2024-09-19T08:36:42.629 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T08:36:42.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T08:36:42.764 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911871 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/postgres}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7911871' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 1 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 0 mountpoint: /tmp/cephfs install: ceph: flavor: default sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 1 mountpoint: /tmp/cephfs mntopts: - ms_mode=crc - wsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1747 sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 sleep_before_teardown: 0 subset: 176/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi092.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNQKkBaEyxdVQPpPFZJFPJUGmB5RsZFU3I275GcBoQY2nlFXurR3q4rVGDx5THJRBen2mDQ0dWtT014g55HIq+o= smithi167.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEJmUPFi8vN/XYt/tj2gGBt2bnliJbJg0DziJD2mgXRrZDNw9P1IomkC9NDgh8U07lmbpUUiE2FNX5QHlzSb490= smithi190.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJgfYz7vxf0jPHiBMCoRxRsHFRTH5Tt1I1lM9s/5FHv1EOEuYKKGu9CynnslVmshBIOPSmS7/8nBqkHZnWu3ivI= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 32 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-19T08:36:42.764 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa; will attempt to use it 2024-09-19T08:36:42.766 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks 2024-09-19T08:36:42.766 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T08:36:42.767 INFO:teuthology.task.internal:Checking packages... 2024-09-19T08:36:42.791 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2f599a46ad10e37c929e5c43da2f6907ddcd1961' 2024-09-19T08:36:42.791 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T08:36:42.791 INFO:teuthology.packaging:ref: None 2024-09-19T08:36:42.791 INFO:teuthology.packaging:tag: None 2024-09-19T08:36:42.792 INFO:teuthology.packaging:branch: squid 2024-09-19T08:36:42.792 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:36:42.792 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-19T08:36:43.017 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-363.g6fad5dd7 2024-09-19T08:36:43.019 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T08:36:43.026 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T08:36:43.026 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T08:36:43.050 INFO:teuthology.task.internal:Saving configuration 2024-09-19T08:36:43.071 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T08:36:43.078 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T08:36:43.100 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911871', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 08:31:42.548607', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNQKkBaEyxdVQPpPFZJFPJUGmB5RsZFU3I275GcBoQY2nlFXurR3q4rVGDx5THJRBen2mDQ0dWtT014g55HIq+o='} 2024-09-19T08:36:43.126 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911871', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 08:31:42.546994', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEJmUPFi8vN/XYt/tj2gGBt2bnliJbJg0DziJD2mgXRrZDNw9P1IomkC9NDgh8U07lmbpUUiE2FNX5QHlzSb490='} 2024-09-19T08:36:43.146 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911871', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 08:31:42.545303', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJgfYz7vxf0jPHiBMCoRxRsHFRTH5Tt1I1lM9s/5FHv1EOEuYKKGu9CynnslVmshBIOPSmS7/8nBqkHZnWu3ivI='} 2024-09-19T08:36:43.146 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T08:36:43.152 INFO:teuthology.task.internal:roles: ubuntu@smithi092.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-19T08:36:43.152 INFO:teuthology.task.internal:roles: ubuntu@smithi167.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-19T08:36:43.152 INFO:teuthology.task.internal:roles: ubuntu@smithi190.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-19T08:36:43.153 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T08:36:43.256 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7febb66ab520>, signals=[15]) 2024-09-19T08:36:43.256 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T08:36:43.262 INFO:teuthology.task.internal:Opening connections... 2024-09-19T08:36:43.262 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi092.front.sepia.ceph.com 2024-09-19T08:36:43.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:36:43.338 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi167.front.sepia.ceph.com 2024-09-19T08:36:43.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:36:43.418 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi190.front.sepia.ceph.com 2024-09-19T08:36:43.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:36:43.495 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T08:36:43.501 DEBUG:teuthology.orchestra.run.smithi092:> uname -m 2024-09-19T08:36:43.519 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64 2024-09-19T08:36:43.519 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2024-09-19T08:36:43.576 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="CentOS Stream" 2024-09-19T08:36:43.576 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="9" 2024-09-19T08:36:43.577 INFO:teuthology.orchestra.run.smithi092.stdout:ID="centos" 2024-09-19T08:36:43.577 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="rhel fedora" 2024-09-19T08:36:43.577 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="9" 2024-09-19T08:36:43.577 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el9" 2024-09-19T08:36:43.577 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T08:36:43.577 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2024-09-19T08:36:43.577 INFO:teuthology.orchestra.run.smithi092.stdout:LOGO="fedora-logo-icon" 2024-09-19T08:36:43.577 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T08:36:43.577 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://centos.org/" 2024-09-19T08:36:43.577 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T08:36:43.577 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T08:36:43.577 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T08:36:43.578 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2024-09-19T08:36:43.595 DEBUG:teuthology.orchestra.run.smithi167:> uname -m 2024-09-19T08:36:43.614 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2024-09-19T08:36:43.614 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2024-09-19T08:36:43.673 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream" 2024-09-19T08:36:43.673 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="9" 2024-09-19T08:36:43.673 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos" 2024-09-19T08:36:43.673 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora" 2024-09-19T08:36:43.673 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="9" 2024-09-19T08:36:43.673 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el9" 2024-09-19T08:36:43.674 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T08:36:43.674 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2024-09-19T08:36:43.674 INFO:teuthology.orchestra.run.smithi167.stdout:LOGO="fedora-logo-icon" 2024-09-19T08:36:43.674 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T08:36:43.674 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/" 2024-09-19T08:36:43.674 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T08:36:43.674 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T08:36:43.674 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T08:36:43.674 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2024-09-19T08:36:43.695 DEBUG:teuthology.orchestra.run.smithi190:> uname -m 2024-09-19T08:36:43.713 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2024-09-19T08:36:43.714 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2024-09-19T08:36:43.772 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="CentOS Stream" 2024-09-19T08:36:43.773 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="9" 2024-09-19T08:36:43.773 INFO:teuthology.orchestra.run.smithi190.stdout:ID="centos" 2024-09-19T08:36:43.773 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="rhel fedora" 2024-09-19T08:36:43.773 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="9" 2024-09-19T08:36:43.773 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el9" 2024-09-19T08:36:43.773 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T08:36:43.773 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2024-09-19T08:36:43.773 INFO:teuthology.orchestra.run.smithi190.stdout:LOGO="fedora-logo-icon" 2024-09-19T08:36:43.773 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T08:36:43.773 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://centos.org/" 2024-09-19T08:36:43.773 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T08:36:43.773 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T08:36:43.773 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T08:36:43.774 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2024-09-19T08:36:43.795 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T08:36:43.805 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T08:36:43.833 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T08:36:43.834 DEBUG:teuthology.orchestra.run.smithi092:> test '!' -e /home/ubuntu/cephtest 2024-09-19T08:36:43.836 DEBUG:teuthology.orchestra.run.smithi167:> test '!' -e /home/ubuntu/cephtest 2024-09-19T08:36:43.838 DEBUG:teuthology.orchestra.run.smithi190:> test '!' -e /home/ubuntu/cephtest 2024-09-19T08:36:43.855 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T08:36:43.861 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T08:36:43.861 DEBUG:teuthology.orchestra.run.smithi092:> test -z $(ls -A /var/lib/ceph) 2024-09-19T08:36:43.894 DEBUG:teuthology.orchestra.run.smithi167:> test -z $(ls -A /var/lib/ceph) 2024-09-19T08:36:43.897 DEBUG:teuthology.orchestra.run.smithi190:> test -z $(ls -A /var/lib/ceph) 2024-09-19T08:36:44.156 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T08:36:44.240 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T08:36:44.255 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-19T08:36:44.255 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-19T08:36:44.255 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-19T08:36:44.256 DEBUG:teuthology.orchestra.run.smithi092:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T08:36:44.272 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:36:44.273 DEBUG:teuthology.orchestra.run.smithi092:> uname -r 2024-09-19T08:36:44.331 INFO:teuthology.orchestra.run.smithi092.stdout:5.14.0-503.el9.x86_64 2024-09-19T08:36:44.331 INFO:teuthology.task.kernel:Running kernel on smithi092: 5.14.0-503.el9.x86_64 2024-09-19T08:36:44.331 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum install -y kernel 2024-09-19T08:36:50.228 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - BaseOS 2.0 MB/s | 8.3 MB 00:04 2024-09-19T08:36:59.203 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - AppStream 2.6 MB/s | 20 MB 00:07 2024-09-19T08:37:04.520 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 6.5 MB 00:01 2024-09-19T08:37:05.962 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - Extras packages 78 kB/s | 19 kB 00:00 2024-09-19T08:37:07.141 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-19T08:37:12.530 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-09-19T08:37:14.369 INFO:teuthology.orchestra.run.smithi092.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T08:37:14.369 INFO:teuthology.orchestra.run.smithi092.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T08:37:14.467 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-19T08:37:14.476 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-19T08:37:14.476 INFO:teuthology.orchestra.run.smithi092.stdout: Package Architecture Version Repository Size 2024-09-19T08:37:14.476 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-19T08:37:14.476 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-19T08:37:14.476 INFO:teuthology.orchestra.run.smithi092.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T08:37:14.476 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-09-19T08:37:14.477 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T08:37:14.477 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T08:37:14.477 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T08:37:14.477 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:37:14.477 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-19T08:37:14.477 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-19T08:37:14.477 INFO:teuthology.orchestra.run.smithi092.stdout:Install 4 Packages 2024-09-19T08:37:14.477 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:37:14.478 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 79 M 2024-09-19T08:37:14.478 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 126 M 2024-09-19T08:37:14.478 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-19T08:37:14.597 INFO:teuthology.orchestra.run.smithi092.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 363 kB/s | 36 kB 00:00 2024-09-19T08:37:15.006 INFO:teuthology.orchestra.run.smithi092.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-09-19T08:37:15.464 INFO:teuthology.orchestra.run.smithi092.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 36 MB/s | 35 MB 00:00 2024-09-19T08:37:15.765 INFO:teuthology.orchestra.run.smithi092.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 24 MB/s | 29 MB 00:01 2024-09-19T08:37:15.765 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:37:15.765 INFO:teuthology.orchestra.run.smithi092.stdout:Total 61 MB/s | 79 MB 00:01 2024-09-19T08:37:16.439 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-19T08:37:16.806 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-19T08:37:16.806 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-19T08:37:17.747 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-19T08:37:17.747 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-19T08:37:20.190 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-19T08:37:20.815 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T08:37:20.931 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:37:23.693 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:37:23.819 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:37:28.634 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:37:28.677 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:37:33.499 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:38:11.495 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:38:11.534 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:38:11.810 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:38:11.810 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T08:38:11.811 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:38:11.811 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:38:12.637 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:38:12.637 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:38:12.637 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-19T08:38:12.637 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T08:38:12.637 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T08:38:12.637 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T08:38:12.638 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T08:38:12.638 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:38:12.638 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-19T08:38:12.990 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T08:38:13.068 INFO:teuthology.orchestra.run.smithi092.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T08:38:13.068 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T08:38:13.069 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T08:38:13.069 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T08:38:13.069 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T08:38:13.069 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-19T08:38:13.069 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi092.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T08:38:13.069 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T08:38:13.128 INFO:teuthology.orchestra.run.smithi092.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T08:38:13.128 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T08:38:13.128 DEBUG:teuthology.orchestra.run.smithi092:> sudo rpm -qi grub2-tools 2024-09-19T08:38:13.169 INFO:teuthology.orchestra.run.smithi092.stdout:Name : grub2-tools 2024-09-19T08:38:13.169 INFO:teuthology.orchestra.run.smithi092.stdout:Epoch : 1 2024-09-19T08:38:13.169 INFO:teuthology.orchestra.run.smithi092.stdout:Version : 2.06 2024-09-19T08:38:13.170 INFO:teuthology.orchestra.run.smithi092.stdout:Release : 82.el9 2024-09-19T08:38:13.170 INFO:teuthology.orchestra.run.smithi092.stdout:Architecture: x86_64 2024-09-19T08:38:13.170 INFO:teuthology.orchestra.run.smithi092.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T08:38:13.170 INFO:teuthology.orchestra.run.smithi092.stdout:Group : Unspecified 2024-09-19T08:38:13.170 INFO:teuthology.orchestra.run.smithi092.stdout:Size : 8274670 2024-09-19T08:38:13.170 INFO:teuthology.orchestra.run.smithi092.stdout:License : GPLv3+ 2024-09-19T08:38:13.170 INFO:teuthology.orchestra.run.smithi092.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T08:38:13.170 INFO:teuthology.orchestra.run.smithi092.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T08:38:13.170 INFO:teuthology.orchestra.run.smithi092.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T08:38:13.170 INFO:teuthology.orchestra.run.smithi092.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T08:38:13.170 INFO:teuthology.orchestra.run.smithi092.stdout:Packager : builder@centos.org 2024-09-19T08:38:13.170 INFO:teuthology.orchestra.run.smithi092.stdout:Vendor : CentOS 2024-09-19T08:38:13.170 INFO:teuthology.orchestra.run.smithi092.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T08:38:13.171 INFO:teuthology.orchestra.run.smithi092.stdout:Summary : Support tools for GRUB. 2024-09-19T08:38:13.171 INFO:teuthology.orchestra.run.smithi092.stdout:Description : 2024-09-19T08:38:13.171 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:38:13.171 INFO:teuthology.orchestra.run.smithi092.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T08:38:13.171 INFO:teuthology.orchestra.run.smithi092.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T08:38:13.171 INFO:teuthology.orchestra.run.smithi092.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T08:38:13.171 INFO:teuthology.orchestra.run.smithi092.stdout:hardware devices. 2024-09-19T08:38:13.171 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:38:13.171 INFO:teuthology.orchestra.run.smithi092.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T08:38:13.172 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T08:38:13.172 INFO:teuthology.task.kernel:Updating grub on smithi092 to boot 5.14.0-508.el9.x86_64 2024-09-19T08:38:13.172 DEBUG:teuthology.orchestra.run.smithi092:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T08:38:13.781 INFO:teuthology.orchestra.run.smithi092.stderr:Generating grub configuration file ... 2024-09-19T08:38:15.119 INFO:teuthology.orchestra.run.smithi092.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T08:38:15.158 INFO:teuthology.orchestra.run.smithi092.stderr:done 2024-09-19T08:38:15.160 DEBUG:teuthology.orchestra.run.smithi092:> mktemp 2024-09-19T08:38:15.176 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.SDCKzrY65G 2024-09-19T08:38:15.176 DEBUG:teuthology.orchestra.run.smithi092:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.SDCKzrY65G 2024-09-19T08:38:15.253 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0666 /tmp/tmp.SDCKzrY65G 2024-09-19T08:38:15.390 DEBUG:teuthology.orchestra.remote:smithi092:/tmp/tmp.SDCKzrY65G is 6KB 2024-09-19T08:38:15.438 DEBUG:teuthology.orchestra.run.smithi092:> rm -fr /tmp/tmp.SDCKzrY65G 2024-09-19T08:38:15.453 DEBUG:teuthology.orchestra.run.smithi092:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T08:38:15.516 INFO:teuthology.orchestra.run.smithi092.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T08:38:15.516 INFO:teuthology.orchestra.run.smithi092.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T08:38:15.517 INFO:teuthology.orchestra.run.smithi092.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T08:38:15.517 INFO:teuthology.orchestra.run.smithi092.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T08:38:15.518 DEBUG:teuthology.orchestra.run.smithi092:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T08:38:15.676 DEBUG:teuthology.orchestra.run.smithi092:> sudo shutdown -r now 2024-09-19T08:38:45.680 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-19T08:38:45.681 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-19T08:38:45.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:39:03.997 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-09-19T08:39:12.998 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-19T08:39:12.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:39:16.065 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-09-19T08:39:28.066 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-19T08:39:28.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:39:46.493 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-09-19T08:40:01.494 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-19T08:40:01.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:40:01.814 DEBUG:teuthology.orchestra.run.smithi092:> true 2024-09-19T08:40:02.265 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-19T08:40:02.266 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-19T08:40:02.266 DEBUG:teuthology.orchestra.run.smithi092:> uname -r 2024-09-19T08:40:02.280 INFO:teuthology.orchestra.run.smithi092.stdout:5.14.0-508.el9.x86_64 2024-09-19T08:40:02.280 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T08:40:02.280 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T08:40:02.281 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T08:40:03.282 DEBUG:teuthology.parallel:result is None 2024-09-19T08:40:03.282 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T08:40:03.290 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T08:40:03.291 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T08:40:03.293 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T08:40:03.296 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T08:40:03.314 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T08:40:03.321 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T08:40:03.356 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T08:40:03.356 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T08:40:03.358 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T08:40:03.361 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T08:40:03.474 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T08:40:03.483 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T08:40:03.484 DEBUG:teuthology.orchestra.run.smithi167:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T08:40:03.501 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:40:03.502 DEBUG:teuthology.orchestra.run.smithi190:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T08:40:03.518 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:40:03.519 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T08:40:03.523 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T08:40:03.544 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T08:40:03.597 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:40:03.599 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:40:03.615 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:40:03.617 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:40:03.634 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:40:03.937 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:40:03.939 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T08:40:03.946 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T08:40:03.946 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T08:40:03.952 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T08:40:03.955 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T08:40:04.007 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T08:40:04.018 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T08:40:04.018 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T08:40:04.024 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T08:40:04.027 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T08:40:04.068 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:40:04.138 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:40:04.218 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:40:04.307 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:40:04.368 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-19T08:40:04.368 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T08:40:04.440 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:40:04.487 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:40:04.540 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:40:04.626 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:40:04.669 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-19T08:40:04.669 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T08:40:04.737 DEBUG:teuthology.orchestra.run.smithi190:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:40:04.781 DEBUG:teuthology.orchestra.run.smithi190:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:40:04.845 DEBUG:teuthology.orchestra.run.smithi190:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:40:04.889 DEBUG:teuthology.orchestra.run.smithi190:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:40:04.931 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-19T08:40:04.931 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T08:40:04.998 DEBUG:teuthology.orchestra.run.smithi092:> sudo service rsyslog restart 2024-09-19T08:40:05.000 DEBUG:teuthology.orchestra.run.smithi167:> sudo service rsyslog restart 2024-09-19T08:40:05.003 DEBUG:teuthology.orchestra.run.smithi190:> sudo service rsyslog restart 2024-09-19T08:40:05.047 INFO:teuthology.orchestra.run.smithi167.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:40:05.074 INFO:teuthology.orchestra.run.smithi190.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:40:05.163 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:40:05.622 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T08:40:05.630 INFO:teuthology.task.internal:Starting timer... 2024-09-19T08:40:05.630 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T08:40:05.660 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T08:40:05.692 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-19T08:40:05.693 DEBUG:teuthology.orchestra.run.smithi092:> sudo service auditd rotate 2024-09-19T08:40:05.734 INFO:teuthology.orchestra.run.smithi092.stdout:Rotating logs: 2024-09-19T08:40:05.736 DEBUG:teuthology.orchestra.run.smithi167:> sudo service auditd rotate 2024-09-19T08:40:05.799 INFO:teuthology.orchestra.run.smithi167.stdout:Rotating logs: 2024-09-19T08:40:05.801 DEBUG:teuthology.orchestra.run.smithi190:> sudo service auditd rotate 2024-09-19T08:40:05.846 INFO:teuthology.orchestra.run.smithi190.stdout:Rotating logs: 2024-09-19T08:40:05.847 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T08:40:05.847 DEBUG:teuthology.orchestra.run.smithi092:> /usr/sbin/getenforce 2024-09-19T08:40:05.869 INFO:teuthology.orchestra.run.smithi092.stdout:Permissive 2024-09-19T08:40:05.870 DEBUG:teuthology.orchestra.run.smithi167:> /usr/sbin/getenforce 2024-09-19T08:40:05.892 INFO:teuthology.orchestra.run.smithi167.stdout:Permissive 2024-09-19T08:40:05.893 DEBUG:teuthology.orchestra.run.smithi190:> /usr/sbin/getenforce 2024-09-19T08:40:05.928 INFO:teuthology.orchestra.run.smithi190.stdout:Permissive 2024-09-19T08:40:05.928 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi092.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi167.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi190.front.sepia.ceph.com': 'permissive'} 2024-09-19T08:40:05.929 DEBUG:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:40:05.953 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:40:05.954 DEBUG:teuthology.orchestra.run.smithi167:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:40:05.981 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:40:05.981 DEBUG:teuthology.orchestra.run.smithi190:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:40:06.009 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:40:06.009 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T08:40:06.010 DEBUG:teuthology.orchestra.run.smithi092:> sudo /usr/sbin/setenforce permissive 2024-09-19T08:40:06.040 DEBUG:teuthology.orchestra.run.smithi167:> sudo /usr/sbin/setenforce permissive 2024-09-19T08:40:06.071 DEBUG:teuthology.orchestra.run.smithi190:> sudo /usr/sbin/setenforce permissive 2024-09-19T08:40:06.112 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T08:40:06.122 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-19T08:40:06.125 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-19T08:40:06.229 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T08:40:06.240 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T08:40:06.241 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi092.front.sepia.ceph.com,smithi167.front.sepia.ceph.com,smithi190.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T08:44:08.669 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi092.front.sepia.ceph.com'), Remote(name='ubuntu@smithi167.front.sepia.ceph.com'), Remote(name='ubuntu@smithi190.front.sepia.ceph.com')] 2024-09-19T08:44:08.670 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-19T08:44:08.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:44:08.749 DEBUG:teuthology.orchestra.run.smithi092:> true 2024-09-19T08:44:08.824 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-19T08:44:08.825 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-19T08:44:08.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:44:08.902 DEBUG:teuthology.orchestra.run.smithi167:> true 2024-09-19T08:44:08.985 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-19T08:44:08.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-09-19T08:44:08.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:44:09.062 DEBUG:teuthology.orchestra.run.smithi190:> true 2024-09-19T08:44:09.149 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-09-19T08:44:09.150 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T08:44:09.161 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T08:44:09.161 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T08:44:09.162 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:44:09.164 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T08:44:09.164 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:44:09.167 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T08:44:09.167 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:44:09.194 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T08:44:09.196 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T08:44:09.209 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T08:44:09.212 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T08:44:09.220 INFO:teuthology.orchestra.run.smithi190.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T08:44:09.235 INFO:teuthology.orchestra.run.smithi092.stderr:sudo: ntpd: command not found 2024-09-19T08:44:09.235 INFO:teuthology.orchestra.run.smithi190.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T08:44:09.237 INFO:teuthology.orchestra.run.smithi167.stderr:sudo: ntpd: command not found 2024-09-19T08:44:09.247 INFO:teuthology.orchestra.run.smithi092.stdout:506 Cannot talk to daemon 2024-09-19T08:44:09.248 INFO:teuthology.orchestra.run.smithi167.stdout:506 Cannot talk to daemon 2024-09-19T08:44:09.261 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T08:44:09.263 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T08:44:09.267 INFO:teuthology.orchestra.run.smithi190.stderr:sudo: ntpd: command not found 2024-09-19T08:44:09.275 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T08:44:09.276 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T08:44:09.279 INFO:teuthology.orchestra.run.smithi190.stdout:506 Cannot talk to daemon 2024-09-19T08:44:09.294 INFO:teuthology.orchestra.run.smithi190.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T08:44:09.308 INFO:teuthology.orchestra.run.smithi190.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T08:44:09.333 INFO:teuthology.orchestra.run.smithi092.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:44:09.337 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:44:09.337 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2024-09-19T08:44:09.337 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:44:09.337 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:44:09.337 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:44:09.337 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:44:09.342 INFO:teuthology.orchestra.run.smithi167.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:44:09.346 INFO:teuthology.orchestra.run.smithi167.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:44:09.346 INFO:teuthology.orchestra.run.smithi167.stdout:=============================================================================== 2024-09-19T08:44:09.346 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:44:09.346 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:44:09.346 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:44:09.346 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:44:09.369 INFO:teuthology.orchestra.run.smithi190.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:44:09.373 INFO:teuthology.orchestra.run.smithi190.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:44:09.373 INFO:teuthology.orchestra.run.smithi190.stdout:=============================================================================== 2024-09-19T08:44:09.373 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:44:09.374 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:44:09.374 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:44:09.374 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:44:09.374 INFO:teuthology.run_tasks:Running task install... 2024-09-19T08:44:09.382 DEBUG:teuthology.task.install:project ceph 2024-09-19T08:44:09.382 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}} 2024-09-19T08:44:09.382 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T08:44:09.382 INFO:teuthology.task.install:Using flavor: default 2024-09-19T08:44:09.388 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T08:44:09.388 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-19T08:44:09.388 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T08:44:09.389 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:44:09.391 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T08:44:09.391 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:44:09.392 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T08:44:09.392 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:44:09.537 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T08:44:09.537 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T08:44:09.541 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T08:44:09.541 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T08:44:09.578 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T08:44:09.579 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T08:44:09.648 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T08:44:09.648 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-19T08:44:09.648 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T08:44:09.656 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T08:44:09.656 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-19T08:44:09.657 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T08:44:09.674 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T08:44:09.675 DEBUG:teuthology.orchestra.run.smithi092:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T08:44:09.684 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T08:44:09.684 DEBUG:teuthology.orchestra.run.smithi190:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T08:44:09.689 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T08:44:09.689 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-19T08:44:09.689 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T08:44:09.716 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T08:44:09.716 DEBUG:teuthology.orchestra.run.smithi167:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T08:44:09.739 DEBUG:teuthology.orchestra.run.smithi092:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T08:44:09.750 DEBUG:teuthology.orchestra.run.smithi190:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T08:44:09.781 DEBUG:teuthology.orchestra.run.smithi167:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T08:44:09.817 DEBUG:teuthology.orchestra.run.smithi092:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T08:44:09.825 DEBUG:teuthology.orchestra.run.smithi190:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T08:44:09.857 DEBUG:teuthology.orchestra.run.smithi167:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T08:44:09.881 INFO:teuthology.orchestra.run.smithi092.stdout:check_obsoletes = 1 2024-09-19T08:44:09.882 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum clean all 2024-09-19T08:44:09.889 INFO:teuthology.orchestra.run.smithi190.stdout:check_obsoletes = 1 2024-09-19T08:44:09.891 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum clean all 2024-09-19T08:44:09.921 INFO:teuthology.orchestra.run.smithi167.stdout:check_obsoletes = 1 2024-09-19T08:44:09.923 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum clean all 2024-09-19T08:44:10.108 INFO:teuthology.orchestra.run.smithi092.stdout:45 files removed 2024-09-19T08:44:10.121 INFO:teuthology.orchestra.run.smithi190.stdout:45 files removed 2024-09-19T08:44:10.134 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T08:44:10.147 INFO:teuthology.orchestra.run.smithi167.stdout:45 files removed 2024-09-19T08:44:10.150 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T08:44:10.175 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T08:44:10.696 INFO:teuthology.orchestra.run.smithi092.stdout:ceph packages for x86_64 304 kB/s | 84 kB 00:00 2024-09-19T08:44:10.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph packages for x86_64 302 kB/s | 84 kB 00:00 2024-09-19T08:44:10.738 INFO:teuthology.orchestra.run.smithi190.stdout:ceph packages for x86_64 276 kB/s | 84 kB 00:00 2024-09-19T08:44:10.972 INFO:teuthology.orchestra.run.smithi092.stdout:ceph noarch packages 51 kB/s | 12 kB 00:00 2024-09-19T08:44:11.014 INFO:teuthology.orchestra.run.smithi190.stdout:ceph noarch packages 50 kB/s | 12 kB 00:00 2024-09-19T08:44:11.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-19T08:44:11.239 INFO:teuthology.orchestra.run.smithi092.stdout:ceph source packages 8.3 kB/s | 1.9 kB 00:00 2024-09-19T08:44:11.298 INFO:teuthology.orchestra.run.smithi190.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-19T08:44:11.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-19T08:44:11.714 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS Stream 9 - BaseOS 22 MB/s | 8.3 MB 00:00 2024-09-19T08:44:11.922 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.3 MB 00:00 2024-09-19T08:44:13.609 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-19T08:44:13.717 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - BaseOS 3.5 MB/s | 8.3 MB 00:02 2024-09-19T08:44:14.107 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - AppStream 18 MB/s | 20 MB 00:01 2024-09-19T08:44:15.802 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - AppStream 20 MB/s | 20 MB 00:01 2024-09-19T08:44:17.875 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-19T08:44:19.451 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS Stream 9 - Extras packages 51 kB/s | 19 kB 00:00 2024-09-19T08:44:19.765 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 6.5 MB 00:01 2024-09-19T08:44:20.303 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - CRB 9.1 MB/s | 6.5 MB 00:00 2024-09-19T08:44:20.397 INFO:teuthology.orchestra.run.smithi190.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-19T08:44:21.434 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - Extras packages 67 kB/s | 19 kB 00:00 2024-09-19T08:44:22.037 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 19 kB 00:00 2024-09-19T08:44:22.355 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-19T08:44:23.208 INFO:teuthology.orchestra.run.smithi167.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-19T08:44:25.920 INFO:teuthology.orchestra.run.smithi190.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-19T08:44:27.702 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-09-19T08:44:28.056 INFO:teuthology.orchestra.run.smithi190.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:44:28.057 INFO:teuthology.orchestra.run.smithi190.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:44:28.071 INFO:teuthology.orchestra.run.smithi190.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T08:44:28.072 INFO:teuthology.orchestra.run.smithi190.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T08:44:28.073 INFO:teuthology.orchestra.run.smithi190.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T08:44:28.074 INFO:teuthology.orchestra.run.smithi190.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T08:44:28.076 INFO:teuthology.orchestra.run.smithi190.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T08:44:28.078 INFO:teuthology.orchestra.run.smithi190.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T08:44:28.079 INFO:teuthology.orchestra.run.smithi190.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T08:44:28.144 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2024-09-19T08:44:28.161 INFO:teuthology.orchestra.run.smithi190.stdout:====================================================================================== 2024-09-19T08:44:28.161 INFO:teuthology.orchestra.run.smithi190.stdout: Package Arch Version Repository Size 2024-09-19T08:44:28.161 INFO:teuthology.orchestra.run.smithi190.stdout:====================================================================================== 2024-09-19T08:44:28.161 INFO:teuthology.orchestra.run.smithi190.stdout:Installing: 2024-09-19T08:44:28.161 INFO:teuthology.orchestra.run.smithi190.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T08:44:28.162 INFO:teuthology.orchestra.run.smithi190.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T08:44:28.162 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T08:44:28.162 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T08:44:28.162 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T08:44:28.162 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T08:44:28.162 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T08:44:28.162 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T08:44:28.162 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T08:44:28.162 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T08:44:28.162 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T08:44:28.162 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T08:44:28.162 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T08:44:28.163 INFO:teuthology.orchestra.run.smithi190.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T08:44:28.163 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T08:44:28.163 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T08:44:28.163 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T08:44:28.163 INFO:teuthology.orchestra.run.smithi190.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T08:44:28.163 INFO:teuthology.orchestra.run.smithi190.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T08:44:28.163 INFO:teuthology.orchestra.run.smithi190.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T08:44:28.163 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T08:44:28.163 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T08:44:28.163 INFO:teuthology.orchestra.run.smithi190.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T08:44:28.163 INFO:teuthology.orchestra.run.smithi190.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T08:44:28.164 INFO:teuthology.orchestra.run.smithi190.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T08:44:28.164 INFO:teuthology.orchestra.run.smithi190.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T08:44:28.164 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T08:44:28.164 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T08:44:28.164 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T08:44:28.164 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T08:44:28.164 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T08:44:28.164 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T08:44:28.164 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T08:44:28.164 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T08:44:28.164 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T08:44:28.164 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T08:44:28.165 INFO:teuthology.orchestra.run.smithi190.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T08:44:28.165 INFO:teuthology.orchestra.run.smithi190.stdout:Upgrading: 2024-09-19T08:44:28.165 INFO:teuthology.orchestra.run.smithi190.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T08:44:28.165 INFO:teuthology.orchestra.run.smithi190.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T08:44:28.165 INFO:teuthology.orchestra.run.smithi190.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T08:44:28.165 INFO:teuthology.orchestra.run.smithi190.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T08:44:28.165 INFO:teuthology.orchestra.run.smithi190.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T08:44:28.165 INFO:teuthology.orchestra.run.smithi190.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T08:44:28.165 INFO:teuthology.orchestra.run.smithi190.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T08:44:28.165 INFO:teuthology.orchestra.run.smithi190.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T08:44:28.165 INFO:teuthology.orchestra.run.smithi190.stdout:Installing dependencies: 2024-09-19T08:44:28.166 INFO:teuthology.orchestra.run.smithi190.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T08:44:28.166 INFO:teuthology.orchestra.run.smithi190.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T08:44:28.166 INFO:teuthology.orchestra.run.smithi190.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T08:44:28.166 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T08:44:28.166 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T08:44:28.166 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T08:44:28.166 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T08:44:28.166 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T08:44:28.166 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T08:44:28.166 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T08:44:28.166 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T08:44:28.166 INFO:teuthology.orchestra.run.smithi190.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T08:44:28.167 INFO:teuthology.orchestra.run.smithi190.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T08:44:28.167 INFO:teuthology.orchestra.run.smithi190.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T08:44:28.167 INFO:teuthology.orchestra.run.smithi190.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T08:44:28.167 INFO:teuthology.orchestra.run.smithi190.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T08:44:28.167 INFO:teuthology.orchestra.run.smithi190.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T08:44:28.167 INFO:teuthology.orchestra.run.smithi190.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T08:44:28.167 INFO:teuthology.orchestra.run.smithi190.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T08:44:28.167 INFO:teuthology.orchestra.run.smithi190.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T08:44:28.167 INFO:teuthology.orchestra.run.smithi190.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T08:44:28.167 INFO:teuthology.orchestra.run.smithi190.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T08:44:28.167 INFO:teuthology.orchestra.run.smithi190.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T08:44:28.168 INFO:teuthology.orchestra.run.smithi190.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T08:44:28.168 INFO:teuthology.orchestra.run.smithi190.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T08:44:28.168 INFO:teuthology.orchestra.run.smithi190.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T08:44:28.168 INFO:teuthology.orchestra.run.smithi190.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T08:44:28.168 INFO:teuthology.orchestra.run.smithi190.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T08:44:28.168 INFO:teuthology.orchestra.run.smithi190.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T08:44:28.168 INFO:teuthology.orchestra.run.smithi190.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T08:44:28.168 INFO:teuthology.orchestra.run.smithi190.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T08:44:28.168 INFO:teuthology.orchestra.run.smithi190.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T08:44:28.168 INFO:teuthology.orchestra.run.smithi190.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T08:44:28.168 INFO:teuthology.orchestra.run.smithi190.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T08:44:28.168 INFO:teuthology.orchestra.run.smithi190.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T08:44:28.168 INFO:teuthology.orchestra.run.smithi190.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T08:44:28.169 INFO:teuthology.orchestra.run.smithi190.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T08:44:28.169 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T08:44:28.169 INFO:teuthology.orchestra.run.smithi190.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T08:44:28.169 INFO:teuthology.orchestra.run.smithi190.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T08:44:28.169 INFO:teuthology.orchestra.run.smithi190.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T08:44:28.169 INFO:teuthology.orchestra.run.smithi190.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T08:44:28.169 INFO:teuthology.orchestra.run.smithi190.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T08:44:28.169 INFO:teuthology.orchestra.run.smithi190.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T08:44:28.169 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T08:44:28.169 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T08:44:28.169 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T08:44:28.169 INFO:teuthology.orchestra.run.smithi190.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T08:44:28.170 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T08:44:28.170 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T08:44:28.170 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T08:44:28.170 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T08:44:28.170 INFO:teuthology.orchestra.run.smithi190.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T08:44:28.170 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T08:44:28.170 INFO:teuthology.orchestra.run.smithi190.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T08:44:28.170 INFO:teuthology.orchestra.run.smithi190.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T08:44:28.170 INFO:teuthology.orchestra.run.smithi190.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T08:44:28.170 INFO:teuthology.orchestra.run.smithi190.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T08:44:28.170 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T08:44:28.170 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T08:44:28.171 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T08:44:28.171 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T08:44:28.171 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T08:44:28.171 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T08:44:28.171 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T08:44:28.171 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T08:44:28.171 INFO:teuthology.orchestra.run.smithi190.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T08:44:28.171 INFO:teuthology.orchestra.run.smithi190.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T08:44:28.171 INFO:teuthology.orchestra.run.smithi190.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T08:44:28.171 INFO:teuthology.orchestra.run.smithi190.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T08:44:28.171 INFO:teuthology.orchestra.run.smithi190.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T08:44:28.171 INFO:teuthology.orchestra.run.smithi190.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T08:44:28.171 INFO:teuthology.orchestra.run.smithi190.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T08:44:28.171 INFO:teuthology.orchestra.run.smithi190.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T08:44:28.172 INFO:teuthology.orchestra.run.smithi190.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T08:44:28.172 INFO:teuthology.orchestra.run.smithi190.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T08:44:28.172 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T08:44:28.172 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T08:44:28.172 INFO:teuthology.orchestra.run.smithi190.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T08:44:28.172 INFO:teuthology.orchestra.run.smithi190.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T08:44:28.172 INFO:teuthology.orchestra.run.smithi190.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T08:44:28.172 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T08:44:28.172 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T08:44:28.172 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T08:44:28.172 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T08:44:28.172 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T08:44:28.172 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T08:44:28.173 INFO:teuthology.orchestra.run.smithi190.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T08:44:28.173 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T08:44:28.173 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T08:44:28.173 INFO:teuthology.orchestra.run.smithi190.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T08:44:28.173 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T08:44:28.173 INFO:teuthology.orchestra.run.smithi190.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T08:44:28.173 INFO:teuthology.orchestra.run.smithi190.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T08:44:28.173 INFO:teuthology.orchestra.run.smithi190.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T08:44:28.173 INFO:teuthology.orchestra.run.smithi190.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T08:44:28.173 INFO:teuthology.orchestra.run.smithi190.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T08:44:28.173 INFO:teuthology.orchestra.run.smithi190.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T08:44:28.173 INFO:teuthology.orchestra.run.smithi190.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T08:44:28.173 INFO:teuthology.orchestra.run.smithi190.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T08:44:28.174 INFO:teuthology.orchestra.run.smithi190.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T08:44:28.174 INFO:teuthology.orchestra.run.smithi190.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T08:44:28.174 INFO:teuthology.orchestra.run.smithi190.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T08:44:28.174 INFO:teuthology.orchestra.run.smithi190.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T08:44:28.174 INFO:teuthology.orchestra.run.smithi190.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T08:44:28.174 INFO:teuthology.orchestra.run.smithi190.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T08:44:28.174 INFO:teuthology.orchestra.run.smithi190.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T08:44:28.174 INFO:teuthology.orchestra.run.smithi190.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T08:44:28.174 INFO:teuthology.orchestra.run.smithi190.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T08:44:28.174 INFO:teuthology.orchestra.run.smithi190.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T08:44:28.174 INFO:teuthology.orchestra.run.smithi190.stdout:Installing weak dependencies: 2024-09-19T08:44:28.174 INFO:teuthology.orchestra.run.smithi190.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T08:44:28.174 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-19T08:44:28.175 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction Summary 2024-09-19T08:44:28.175 INFO:teuthology.orchestra.run.smithi190.stdout:====================================================================================== 2024-09-19T08:44:28.175 INFO:teuthology.orchestra.run.smithi190.stdout:Install 148 Packages 2024-09-19T08:44:28.175 INFO:teuthology.orchestra.run.smithi190.stdout:Upgrade 8 Packages 2024-09-19T08:44:28.175 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-19T08:44:28.175 INFO:teuthology.orchestra.run.smithi190.stdout:Total download size: 226 M 2024-09-19T08:44:28.175 INFO:teuthology.orchestra.run.smithi190.stdout:Downloading Packages: 2024-09-19T08:44:28.614 INFO:teuthology.orchestra.run.smithi167.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-09-19T08:44:28.687 INFO:teuthology.orchestra.run.smithi190.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 53 kB/s | 6.6 kB 00:00 2024-09-19T08:44:28.879 INFO:teuthology.orchestra.run.smithi190.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 4.6 MB/s | 896 kB 00:00 2024-09-19T08:44:28.988 INFO:teuthology.orchestra.run.smithi190.stdout:(3/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 13 MB/s | 5.4 MB 00:00 2024-09-19T08:44:29.013 INFO:teuthology.orchestra.run.smithi190.stdout:(4/156): ceph-immutable-object-cache-19.1.1-361 1.1 MB/s | 145 kB 00:00 2024-09-19T08:44:29.097 INFO:teuthology.orchestra.run.smithi190.stdout:(5/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 22 MB/s | 2.4 MB 00:00 2024-09-19T08:44:29.231 INFO:teuthology.orchestra.run.smithi190.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 7.0 MB/s | 1.5 MB 00:00 2024-09-19T08:44:29.373 INFO:teuthology.orchestra.run.smithi190.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 17 MB/s | 4.7 MB 00:00 2024-09-19T08:44:29.889 INFO:teuthology.orchestra.run.smithi190.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 16 MB/s | 21 MB 00:01 2024-09-19T08:44:29.896 INFO:teuthology.orchestra.run.smithi092.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:44:29.896 INFO:teuthology.orchestra.run.smithi092.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:44:29.908 INFO:teuthology.orchestra.run.smithi092.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T08:44:29.909 INFO:teuthology.orchestra.run.smithi092.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T08:44:29.909 INFO:teuthology.orchestra.run.smithi092.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T08:44:29.910 INFO:teuthology.orchestra.run.smithi092.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T08:44:29.912 INFO:teuthology.orchestra.run.smithi092.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T08:44:29.914 INFO:teuthology.orchestra.run.smithi092.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T08:44:29.915 INFO:teuthology.orchestra.run.smithi092.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T08:44:29.931 INFO:teuthology.orchestra.run.smithi190.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 609 kB/s | 25 kB 00:00 2024-09-19T08:44:29.979 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-19T08:44:29.989 INFO:teuthology.orchestra.run.smithi092.stdout:====================================================================================== 2024-09-19T08:44:29.989 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2024-09-19T08:44:29.989 INFO:teuthology.orchestra.run.smithi092.stdout:====================================================================================== 2024-09-19T08:44:29.989 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-19T08:44:29.990 INFO:teuthology.orchestra.run.smithi092.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T08:44:29.990 INFO:teuthology.orchestra.run.smithi092.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T08:44:29.990 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T08:44:29.990 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T08:44:29.990 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T08:44:29.990 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T08:44:29.990 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T08:44:29.990 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T08:44:29.990 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T08:44:29.990 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T08:44:29.990 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T08:44:29.990 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T08:44:29.991 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T08:44:29.991 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T08:44:29.991 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T08:44:29.991 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T08:44:29.991 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T08:44:29.991 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T08:44:29.991 INFO:teuthology.orchestra.run.smithi092.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T08:44:29.991 INFO:teuthology.orchestra.run.smithi092.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T08:44:29.991 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T08:44:29.991 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T08:44:29.991 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T08:44:29.991 INFO:teuthology.orchestra.run.smithi092.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T08:44:29.992 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T08:44:29.992 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T08:44:29.992 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T08:44:29.992 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T08:44:29.992 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T08:44:29.992 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T08:44:29.992 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T08:44:29.992 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T08:44:29.992 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T08:44:29.992 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T08:44:29.992 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T08:44:29.992 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T08:44:29.992 INFO:teuthology.orchestra.run.smithi092.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T08:44:29.993 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrading: 2024-09-19T08:44:29.993 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T08:44:29.993 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T08:44:29.993 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T08:44:29.993 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T08:44:29.993 INFO:teuthology.orchestra.run.smithi092.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T08:44:29.993 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T08:44:29.993 INFO:teuthology.orchestra.run.smithi092.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T08:44:29.993 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T08:44:29.993 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-09-19T08:44:29.993 INFO:teuthology.orchestra.run.smithi092.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T08:44:29.993 INFO:teuthology.orchestra.run.smithi092.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T08:44:29.994 INFO:teuthology.orchestra.run.smithi092.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T08:44:29.994 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T08:44:29.994 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T08:44:29.994 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T08:44:29.994 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T08:44:29.994 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T08:44:29.994 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T08:44:29.994 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T08:44:29.994 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T08:44:29.994 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T08:44:29.994 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T08:44:29.994 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T08:44:29.994 INFO:teuthology.orchestra.run.smithi092.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T08:44:29.995 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T08:44:29.995 INFO:teuthology.orchestra.run.smithi092.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T08:44:29.995 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T08:44:29.995 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T08:44:29.995 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T08:44:29.995 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T08:44:29.995 INFO:teuthology.orchestra.run.smithi092.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T08:44:29.995 INFO:teuthology.orchestra.run.smithi092.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T08:44:29.995 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T08:44:29.995 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T08:44:29.995 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T08:44:29.996 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T08:44:29.996 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T08:44:29.996 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T08:44:29.996 INFO:teuthology.orchestra.run.smithi092.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T08:44:29.996 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T08:44:29.996 INFO:teuthology.orchestra.run.smithi092.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T08:44:29.996 INFO:teuthology.orchestra.run.smithi092.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T08:44:29.996 INFO:teuthology.orchestra.run.smithi092.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T08:44:29.996 INFO:teuthology.orchestra.run.smithi092.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T08:44:29.996 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T08:44:29.997 INFO:teuthology.orchestra.run.smithi092.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T08:44:29.997 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T08:44:29.997 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T08:44:29.997 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T08:44:29.997 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T08:44:29.997 INFO:teuthology.orchestra.run.smithi092.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T08:44:29.997 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T08:44:29.997 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T08:44:29.997 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T08:44:29.997 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T08:44:29.997 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T08:44:29.998 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T08:44:29.998 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T08:44:29.998 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T08:44:29.998 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T08:44:29.998 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T08:44:29.998 INFO:teuthology.orchestra.run.smithi092.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T08:44:29.998 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T08:44:29.998 INFO:teuthology.orchestra.run.smithi092.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T08:44:29.998 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T08:44:29.998 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T08:44:29.998 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T08:44:29.998 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T08:44:29.998 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T08:44:29.999 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T08:44:29.999 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T08:44:29.999 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T08:44:29.999 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T08:44:29.999 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T08:44:29.999 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T08:44:29.999 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T08:44:29.999 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T08:44:29.999 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T08:44:29.999 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T08:44:29.999 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T08:44:29.999 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T08:44:30.000 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T08:44:30.000 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T08:44:30.000 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T08:44:30.000 INFO:teuthology.orchestra.run.smithi092.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T08:44:30.000 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T08:44:30.000 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T08:44:30.000 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T08:44:30.000 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T08:44:30.000 INFO:teuthology.orchestra.run.smithi092.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T08:44:30.000 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T08:44:30.000 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T08:44:30.000 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T08:44:30.000 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T08:44:30.001 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T08:44:30.001 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T08:44:30.001 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T08:44:30.001 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T08:44:30.001 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T08:44:30.001 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T08:44:30.001 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T08:44:30.001 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T08:44:30.001 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T08:44:30.001 INFO:teuthology.orchestra.run.smithi092.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T08:44:30.001 INFO:teuthology.orchestra.run.smithi092.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T08:44:30.001 INFO:teuthology.orchestra.run.smithi092.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T08:44:30.001 INFO:teuthology.orchestra.run.smithi092.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T08:44:30.002 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T08:44:30.002 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T08:44:30.002 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T08:44:30.002 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T08:44:30.002 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T08:44:30.002 INFO:teuthology.orchestra.run.smithi092.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T08:44:30.002 INFO:teuthology.orchestra.run.smithi092.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T08:44:30.002 INFO:teuthology.orchestra.run.smithi092.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T08:44:30.002 INFO:teuthology.orchestra.run.smithi092.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T08:44:30.002 INFO:teuthology.orchestra.run.smithi092.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T08:44:30.002 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T08:44:30.002 INFO:teuthology.orchestra.run.smithi092.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T08:44:30.003 INFO:teuthology.orchestra.run.smithi092.stdout:Installing weak dependencies: 2024-09-19T08:44:30.003 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T08:44:30.003 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:44:30.003 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-19T08:44:30.003 INFO:teuthology.orchestra.run.smithi092.stdout:====================================================================================== 2024-09-19T08:44:30.003 INFO:teuthology.orchestra.run.smithi092.stdout:Install 148 Packages 2024-09-19T08:44:30.003 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrade 8 Packages 2024-09-19T08:44:30.003 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:44:30.004 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 226 M 2024-09-19T08:44:30.004 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-19T08:44:30.040 INFO:teuthology.orchestra.run.smithi190.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 16 MB/s | 11 MB 00:00 2024-09-19T08:44:30.115 INFO:teuthology.orchestra.run.smithi190.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 3.0 MB/s | 228 kB 00:00 2024-09-19T08:44:30.316 INFO:teuthology.orchestra.run.smithi190.stdout:(12/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 16 MB/s | 17 MB 00:01 2024-09-19T08:44:30.341 INFO:teuthology.orchestra.run.smithi190.stdout:(13/156): cephfs-shell-19.1.1-361.g2f599a46.el9 120 kB/s | 27 kB 00:00 2024-09-19T08:44:30.366 INFO:teuthology.orchestra.run.smithi190.stdout:(14/156): libcephfs-devel-19.1.1-361.g2f599a46. 635 kB/s | 32 kB 00:00 2024-09-19T08:44:30.408 INFO:teuthology.orchestra.run.smithi190.stdout:(15/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 11 MB/s | 751 kB 00:00 2024-09-19T08:44:30.433 INFO:teuthology.orchestra.run.smithi190.stdout:(16/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.4 MB/s | 163 kB 00:00 2024-09-19T08:44:30.459 INFO:teuthology.orchestra.run.smithi190.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 2.5 MB/s | 127 kB 00:00 2024-09-19T08:44:30.492 INFO:teuthology.orchestra.run.smithi190.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 8.5 MB/s | 506 kB 00:00 2024-09-19T08:44:30.542 INFO:teuthology.orchestra.run.smithi190.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 902 kB/s | 45 kB 00:00 2024-09-19T08:44:30.618 INFO:teuthology.orchestra.run.smithi190.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.8 MB/s | 136 kB 00:00 2024-09-19T08:44:30.670 INFO:teuthology.orchestra.run.smithi092.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 37 kB/s | 6.6 kB 00:00 2024-09-19T08:44:30.735 INFO:teuthology.orchestra.run.smithi190.stdout:(21/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 19 MB/s | 5.3 MB 00:00 2024-09-19T08:44:30.741 INFO:teuthology.orchestra.run.smithi167.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:44:30.742 INFO:teuthology.orchestra.run.smithi167.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:44:30.753 INFO:teuthology.orchestra.run.smithi167.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T08:44:30.753 INFO:teuthology.orchestra.run.smithi167.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T08:44:30.754 INFO:teuthology.orchestra.run.smithi167.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T08:44:30.755 INFO:teuthology.orchestra.run.smithi167.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T08:44:30.757 INFO:teuthology.orchestra.run.smithi167.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T08:44:30.759 INFO:teuthology.orchestra.run.smithi167.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T08:44:30.760 INFO:teuthology.orchestra.run.smithi167.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T08:44:30.760 INFO:teuthology.orchestra.run.smithi190.stdout:(22/156): python3-cephfs-19.1.1-361.g2f599a46.e 1.1 MB/s | 161 kB 00:00 2024-09-19T08:44:30.802 INFO:teuthology.orchestra.run.smithi190.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 4.7 MB/s | 320 kB 00:00 2024-09-19T08:44:30.822 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-19T08:44:30.836 INFO:teuthology.orchestra.run.smithi190.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 3.9 MB/s | 300 kB 00:00 2024-09-19T08:44:30.843 INFO:teuthology.orchestra.run.smithi167.stdout:====================================================================================== 2024-09-19T08:44:30.843 INFO:teuthology.orchestra.run.smithi167.stdout: Package Arch Version Repository Size 2024-09-19T08:44:30.844 INFO:teuthology.orchestra.run.smithi167.stdout:====================================================================================== 2024-09-19T08:44:30.844 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-19T08:44:30.844 INFO:teuthology.orchestra.run.smithi167.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T08:44:30.844 INFO:teuthology.orchestra.run.smithi167.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T08:44:30.844 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T08:44:30.844 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T08:44:30.844 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T08:44:30.844 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T08:44:30.844 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T08:44:30.844 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T08:44:30.844 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T08:44:30.845 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T08:44:30.845 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T08:44:30.845 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T08:44:30.845 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T08:44:30.845 INFO:teuthology.orchestra.run.smithi167.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T08:44:30.845 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T08:44:30.845 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T08:44:30.845 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T08:44:30.845 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T08:44:30.845 INFO:teuthology.orchestra.run.smithi167.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T08:44:30.845 INFO:teuthology.orchestra.run.smithi167.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T08:44:30.845 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T08:44:30.846 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T08:44:30.846 INFO:teuthology.orchestra.run.smithi167.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T08:44:30.846 INFO:teuthology.orchestra.run.smithi167.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T08:44:30.846 INFO:teuthology.orchestra.run.smithi167.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T08:44:30.846 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T08:44:30.846 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T08:44:30.846 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T08:44:30.846 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T08:44:30.846 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T08:44:30.846 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T08:44:30.847 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T08:44:30.847 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T08:44:30.847 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T08:44:30.847 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T08:44:30.847 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T08:44:30.847 INFO:teuthology.orchestra.run.smithi167.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T08:44:30.847 INFO:teuthology.orchestra.run.smithi167.stdout:Upgrading: 2024-09-19T08:44:30.847 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T08:44:30.847 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T08:44:30.848 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T08:44:30.848 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T08:44:30.848 INFO:teuthology.orchestra.run.smithi167.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T08:44:30.848 INFO:teuthology.orchestra.run.smithi167.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T08:44:30.848 INFO:teuthology.orchestra.run.smithi167.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T08:44:30.848 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T08:44:30.848 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2024-09-19T08:44:30.848 INFO:teuthology.orchestra.run.smithi167.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T08:44:30.848 INFO:teuthology.orchestra.run.smithi167.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T08:44:30.848 INFO:teuthology.orchestra.run.smithi167.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T08:44:30.848 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T08:44:30.849 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T08:44:30.849 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T08:44:30.849 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T08:44:30.849 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T08:44:30.849 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T08:44:30.849 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T08:44:30.849 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T08:44:30.849 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T08:44:30.849 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T08:44:30.849 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T08:44:30.849 INFO:teuthology.orchestra.run.smithi167.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T08:44:30.849 INFO:teuthology.orchestra.run.smithi167.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T08:44:30.849 INFO:teuthology.orchestra.run.smithi167.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T08:44:30.850 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T08:44:30.850 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T08:44:30.850 INFO:teuthology.orchestra.run.smithi167.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T08:44:30.850 INFO:teuthology.orchestra.run.smithi167.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T08:44:30.850 INFO:teuthology.orchestra.run.smithi167.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T08:44:30.850 INFO:teuthology.orchestra.run.smithi167.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T08:44:30.850 INFO:teuthology.orchestra.run.smithi167.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T08:44:30.850 INFO:teuthology.orchestra.run.smithi167.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T08:44:30.850 INFO:teuthology.orchestra.run.smithi167.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T08:44:30.850 INFO:teuthology.orchestra.run.smithi167.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T08:44:30.850 INFO:teuthology.orchestra.run.smithi167.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T08:44:30.850 INFO:teuthology.orchestra.run.smithi167.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T08:44:30.851 INFO:teuthology.orchestra.run.smithi167.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T08:44:30.851 INFO:teuthology.orchestra.run.smithi167.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T08:44:30.851 INFO:teuthology.orchestra.run.smithi167.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T08:44:30.851 INFO:teuthology.orchestra.run.smithi167.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T08:44:30.851 INFO:teuthology.orchestra.run.smithi167.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T08:44:30.851 INFO:teuthology.orchestra.run.smithi167.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T08:44:30.851 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T08:44:30.851 INFO:teuthology.orchestra.run.smithi167.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T08:44:30.851 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T08:44:30.851 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T08:44:30.851 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T08:44:30.851 INFO:teuthology.orchestra.run.smithi167.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T08:44:30.851 INFO:teuthology.orchestra.run.smithi167.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T08:44:30.852 INFO:teuthology.orchestra.run.smithi167.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T08:44:30.852 INFO:teuthology.orchestra.run.smithi167.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T08:44:30.852 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T08:44:30.852 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T08:44:30.852 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T08:44:30.852 INFO:teuthology.orchestra.run.smithi167.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T08:44:30.852 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T08:44:30.852 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T08:44:30.852 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T08:44:30.852 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T08:44:30.853 INFO:teuthology.orchestra.run.smithi167.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T08:44:30.853 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T08:44:30.853 INFO:teuthology.orchestra.run.smithi167.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T08:44:30.853 INFO:teuthology.orchestra.run.smithi167.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T08:44:30.853 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T08:44:30.853 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T08:44:30.853 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T08:44:30.853 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T08:44:30.853 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T08:44:30.853 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T08:44:30.853 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T08:44:30.853 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T08:44:30.854 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T08:44:30.854 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T08:44:30.854 INFO:teuthology.orchestra.run.smithi167.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T08:44:30.854 INFO:teuthology.orchestra.run.smithi167.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T08:44:30.854 INFO:teuthology.orchestra.run.smithi167.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T08:44:30.854 INFO:teuthology.orchestra.run.smithi167.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T08:44:30.854 INFO:teuthology.orchestra.run.smithi167.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T08:44:30.854 INFO:teuthology.orchestra.run.smithi167.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T08:44:30.855 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T08:44:30.855 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T08:44:30.855 INFO:teuthology.orchestra.run.smithi167.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T08:44:30.855 INFO:teuthology.orchestra.run.smithi167.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T08:44:30.855 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T08:44:30.855 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T08:44:30.855 INFO:teuthology.orchestra.run.smithi167.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T08:44:30.855 INFO:teuthology.orchestra.run.smithi167.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T08:44:30.855 INFO:teuthology.orchestra.run.smithi167.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T08:44:30.855 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T08:44:30.855 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T08:44:30.855 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T08:44:30.855 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T08:44:30.856 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T08:44:30.856 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T08:44:30.856 INFO:teuthology.orchestra.run.smithi167.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T08:44:30.856 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T08:44:30.856 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T08:44:30.856 INFO:teuthology.orchestra.run.smithi167.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T08:44:30.856 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T08:44:30.857 INFO:teuthology.orchestra.run.smithi167.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T08:44:30.857 INFO:teuthology.orchestra.run.smithi167.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T08:44:30.857 INFO:teuthology.orchestra.run.smithi167.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T08:44:30.857 INFO:teuthology.orchestra.run.smithi167.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T08:44:30.857 INFO:teuthology.orchestra.run.smithi167.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T08:44:30.857 INFO:teuthology.orchestra.run.smithi167.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T08:44:30.857 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T08:44:30.857 INFO:teuthology.orchestra.run.smithi167.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T08:44:30.857 INFO:teuthology.orchestra.run.smithi167.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T08:44:30.857 INFO:teuthology.orchestra.run.smithi167.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T08:44:30.857 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T08:44:30.858 INFO:teuthology.orchestra.run.smithi167.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T08:44:30.858 INFO:teuthology.orchestra.run.smithi167.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T08:44:30.858 INFO:teuthology.orchestra.run.smithi167.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T08:44:30.858 INFO:teuthology.orchestra.run.smithi167.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T08:44:30.858 INFO:teuthology.orchestra.run.smithi167.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T08:44:30.858 INFO:teuthology.orchestra.run.smithi167.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T08:44:30.858 INFO:teuthology.orchestra.run.smithi167.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T08:44:30.858 INFO:teuthology.orchestra.run.smithi167.stdout:Installing weak dependencies: 2024-09-19T08:44:30.858 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T08:44:30.859 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T08:44:30.859 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-19T08:44:30.859 INFO:teuthology.orchestra.run.smithi167.stdout:====================================================================================== 2024-09-19T08:44:30.859 INFO:teuthology.orchestra.run.smithi167.stdout:Install 148 Packages 2024-09-19T08:44:30.859 INFO:teuthology.orchestra.run.smithi167.stdout:Upgrade 8 Packages 2024-09-19T08:44:30.859 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T08:44:30.860 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 226 M 2024-09-19T08:44:30.860 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-19T08:44:30.869 INFO:teuthology.orchestra.run.smithi190.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.5 MB/s | 99 kB 00:00 2024-09-19T08:44:30.906 INFO:teuthology.orchestra.run.smithi190.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.2 MB/s | 85 kB 00:00 2024-09-19T08:44:30.987 INFO:teuthology.orchestra.run.smithi092.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 2.8 MB/s | 896 kB 00:00 2024-09-19T08:44:31.006 INFO:teuthology.orchestra.run.smithi190.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 1.7 MB/s | 171 kB 00:00 2024-09-19T08:44:31.062 INFO:teuthology.orchestra.run.smithi092.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.9 MB/s | 145 kB 00:00 2024-09-19T08:44:31.114 INFO:teuthology.orchestra.run.smithi190.stdout:(28/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 13 MB/s | 3.1 MB 00:00 2024-09-19T08:44:31.131 INFO:teuthology.orchestra.run.smithi190.stdout:(29/156): ceph-grafana-dashboards-19.1.1-361.g2 254 kB/s | 32 kB 00:00 2024-09-19T08:44:31.190 INFO:teuthology.orchestra.run.smithi190.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.9 MB/s | 146 kB 00:00 2024-09-19T08:44:31.312 INFO:teuthology.orchestra.run.smithi092.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 6.6 MB/s | 5.4 MB 00:00 2024-09-19T08:44:31.432 INFO:teuthology.orchestra.run.smithi190.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 12 MB/s | 3.6 MB 00:00 2024-09-19T08:44:31.512 INFO:teuthology.orchestra.run.smithi092.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 7.6 MB/s | 1.5 MB 00:00 2024-09-19T08:44:31.524 INFO:teuthology.orchestra.run.smithi190.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.7 MB/s | 249 kB 00:00 2024-09-19T08:44:31.616 INFO:teuthology.orchestra.run.smithi190.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 539 kB/s | 49 kB 00:00 2024-09-19T08:44:31.646 INFO:teuthology.orchestra.run.smithi092.stdout:(6/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 4.1 MB/s | 2.4 MB 00:00 2024-09-19T08:44:31.691 INFO:teuthology.orchestra.run.smithi190.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 219 kB/s | 16 kB 00:00 2024-09-19T08:44:31.774 INFO:teuthology.orchestra.run.smithi167.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 24 kB/s | 6.6 kB 00:00 2024-09-19T08:44:31.791 INFO:teuthology.orchestra.run.smithi190.stdout:(35/156): ceph-volume-19.1.1-361.g2f599a46.el9. 2.8 MB/s | 285 kB 00:00 2024-09-19T08:44:31.917 INFO:teuthology.orchestra.run.smithi190.stdout:(36/156): ceph-mgr-diskprediction-local-19.1.1- 10 MB/s | 7.4 MB 00:00 2024-09-19T08:44:31.951 INFO:teuthology.orchestra.run.smithi190.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 4.7 MB/s | 765 kB 00:00 2024-09-19T08:44:31.984 INFO:teuthology.orchestra.run.smithi190.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 273 kB/s | 18 kB 00:00 2024-09-19T08:44:31.988 INFO:teuthology.orchestra.run.smithi092.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 9.9 MB/s | 4.7 MB 00:00 2024-09-19T08:44:32.052 INFO:teuthology.orchestra.run.smithi190.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 796 kB/s | 80 kB 00:00 2024-09-19T08:44:32.110 INFO:teuthology.orchestra.run.smithi190.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-19T08:44:32.466 INFO:teuthology.orchestra.run.smithi167.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 1.3 MB/s | 896 kB 00:00 2024-09-19T08:44:32.561 INFO:teuthology.orchestra.run.smithi190.stdout:(41/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 19 MB/s | 49 MB 00:02 2024-09-19T08:44:32.583 INFO:teuthology.orchestra.run.smithi167.stdout:(3/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 5.0 MB/s | 5.4 MB 00:01 2024-09-19T08:44:32.585 INFO:teuthology.orchestra.run.smithi190.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 533 kB/s | 253 kB 00:00 2024-09-19T08:44:32.608 INFO:teuthology.orchestra.run.smithi167.stdout:(4/156): ceph-immutable-object-cache-19.1.1-361 1.0 MB/s | 145 kB 00:00 2024-09-19T08:44:32.613 INFO:teuthology.orchestra.run.smithi092.stdout:(8/156): ceph-radosgw-19.1.1-361.g2f599a46.el9. 17 MB/s | 11 MB 00:00 2024-09-19T08:44:32.619 INFO:teuthology.orchestra.run.smithi190.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 801 kB 00:00 2024-09-19T08:44:32.645 INFO:teuthology.orchestra.run.smithi190.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-19T08:44:32.671 INFO:teuthology.orchestra.run.smithi092.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 433 kB/s | 25 kB 00:00 2024-09-19T08:44:32.678 INFO:teuthology.orchestra.run.smithi190.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-19T08:44:32.704 INFO:teuthology.orchestra.run.smithi190.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-19T08:44:32.729 INFO:teuthology.orchestra.run.smithi190.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-19T08:44:32.758 INFO:teuthology.orchestra.run.smithi167.stdout:(5/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 14 MB/s | 2.4 MB 00:00 2024-09-19T08:44:32.854 INFO:teuthology.orchestra.run.smithi190.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 4.2 MB/s | 1.2 MB 00:00 2024-09-19T08:44:32.963 INFO:teuthology.orchestra.run.smithi190.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 2.6 MB/s | 689 kB 00:00 2024-09-19T08:44:33.013 INFO:teuthology.orchestra.run.smithi190.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 3.2 MB/s | 943 kB 00:00 2024-09-19T08:44:33.039 INFO:teuthology.orchestra.run.smithi190.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 288 kB/s | 22 kB 00:00 2024-09-19T08:44:33.064 INFO:teuthology.orchestra.run.smithi190.stdout:(52/156): boost-program-options-1.75.0-8.el9.x8 510 kB/s | 107 kB 00:00 2024-09-19T08:44:33.089 INFO:teuthology.orchestra.run.smithi190.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 651 kB/s | 33 kB 00:00 2024-09-19T08:44:33.131 INFO:teuthology.orchestra.run.smithi190.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-19T08:44:33.156 INFO:teuthology.orchestra.run.smithi190.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 272 kB/s | 18 kB 00:00 2024-09-19T08:44:33.182 INFO:teuthology.orchestra.run.smithi190.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-19T08:44:33.215 INFO:teuthology.orchestra.run.smithi190.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-19T08:44:33.241 INFO:teuthology.orchestra.run.smithi190.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 775 kB/s | 45 kB 00:00 2024-09-19T08:44:33.284 INFO:teuthology.orchestra.run.smithi167.stdout:(6/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 9.0 MB/s | 4.7 MB 00:00 2024-09-19T08:44:33.332 INFO:teuthology.orchestra.run.smithi190.stdout:(59/156): libtool-2.4.6-46.el9.x86_64.rpm 6.2 MB/s | 581 kB 00:00 2024-09-19T08:44:33.351 INFO:teuthology.orchestra.run.smithi167.stdout:(7/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 2.0 MB/s | 1.5 MB 00:00 2024-09-19T08:44:33.357 INFO:teuthology.orchestra.run.smithi190.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.6 MB/s | 662 kB 00:00 2024-09-19T08:44:33.375 INFO:teuthology.orchestra.run.smithi190.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 583 kB/s | 24 kB 00:00 2024-09-19T08:44:33.397 INFO:teuthology.orchestra.run.smithi092.stdout:(10/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 9.6 MB/s | 17 MB 00:01 2024-09-19T08:44:33.400 INFO:teuthology.orchestra.run.smithi190.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-19T08:44:33.433 INFO:teuthology.orchestra.run.smithi190.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-19T08:44:33.459 INFO:teuthology.orchestra.run.smithi190.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-09-19T08:44:33.518 INFO:teuthology.orchestra.run.smithi190.stdout:(65/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.6 MB/s | 3.0 MB 00:00 2024-09-19T08:44:33.543 INFO:teuthology.orchestra.run.smithi190.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 353 kB/s | 38 kB 00:00 2024-09-19T08:44:33.605 INFO:teuthology.orchestra.run.smithi092.stdout:(11/156): ceph-common-19.1.1-361.g2f599a46.el9. 6.8 MB/s | 21 MB 00:03 2024-09-19T08:44:33.630 INFO:teuthology.orchestra.run.smithi092.stdout:(12/156): cephfs-mirror-19.1.1-361.g2f599a46.el 978 kB/s | 228 kB 00:00 2024-09-19T08:44:33.681 INFO:teuthology.orchestra.run.smithi092.stdout:(13/156): cephfs-shell-19.1.1-361.g2f599a46.el9 361 kB/s | 27 kB 00:00 2024-09-19T08:44:33.718 INFO:teuthology.orchestra.run.smithi190.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 9.1 MB/s | 1.6 MB 00:00 2024-09-19T08:44:33.827 INFO:teuthology.orchestra.run.smithi092.stdout:(14/156): libcephfs-devel-19.1.1-361.g2f599a46. 162 kB/s | 32 kB 00:00 2024-09-19T08:44:33.835 INFO:teuthology.orchestra.run.smithi190.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 7.6 MB/s | 910 kB 00:00 2024-09-19T08:44:33.881 INFO:teuthology.orchestra.run.smithi092.stdout:(15/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 3.7 MB/s | 751 kB 00:00 2024-09-19T08:44:33.902 INFO:teuthology.orchestra.run.smithi190.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-19T08:44:33.906 INFO:teuthology.orchestra.run.smithi092.stdout:(16/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.0 MB/s | 163 kB 00:00 2024-09-19T08:44:33.924 INFO:teuthology.orchestra.run.smithi092.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 2.9 MB/s | 127 kB 00:00 2024-09-19T08:44:33.957 INFO:teuthology.orchestra.run.smithi092.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 9.8 MB/s | 506 kB 00:00 2024-09-19T08:44:33.969 INFO:teuthology.orchestra.run.smithi190.stdout:(70/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 9.8 MB/s | 4.4 MB 00:00 2024-09-19T08:44:33.985 INFO:teuthology.orchestra.run.smithi167.stdout:(8/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86_ 24 MB/s | 17 MB 00:00 2024-09-19T08:44:34.008 INFO:teuthology.orchestra.run.smithi092.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 906 kB/s | 45 kB 00:00 2024-09-19T08:44:34.036 INFO:teuthology.orchestra.run.smithi190.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 8.6 MB/s | 4.9 MB 00:00 2024-09-19T08:44:34.043 INFO:teuthology.orchestra.run.smithi167.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 432 kB/s | 25 kB 00:00 2024-09-19T08:44:34.074 INFO:teuthology.orchestra.run.smithi092.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 2.0 MB/s | 136 kB 00:00 2024-09-19T08:44:34.095 INFO:teuthology.orchestra.run.smithi190.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-19T08:44:34.128 INFO:teuthology.orchestra.run.smithi190.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 6.3 MB/s | 1.0 MB 00:00 2024-09-19T08:44:34.158 INFO:teuthology.orchestra.run.smithi092.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 1.9 MB/s | 161 kB 00:00 2024-09-19T08:44:34.187 INFO:teuthology.orchestra.run.smithi190.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-19T08:44:34.242 INFO:teuthology.orchestra.run.smithi092.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 3.8 MB/s | 320 kB 00:00 2024-09-19T08:44:34.254 INFO:teuthology.orchestra.run.smithi190.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 3.6 MB/s | 245 kB 00:00 2024-09-19T08:44:34.321 INFO:teuthology.orchestra.run.smithi190.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 3.6 MB/s | 248 kB 00:00 2024-09-19T08:44:34.325 INFO:teuthology.orchestra.run.smithi092.stdout:(23/156): python3-rbd-19.1.1-361.g2f599a46.el9. 3.5 MB/s | 300 kB 00:00 2024-09-19T08:44:34.379 INFO:teuthology.orchestra.run.smithi190.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 439 kB/s | 26 kB 00:00 2024-09-19T08:44:34.400 INFO:teuthology.orchestra.run.smithi092.stdout:(24/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.3 MB/s | 99 kB 00:00 2024-09-19T08:44:34.455 INFO:teuthology.orchestra.run.smithi190.stdout:(78/156): postgresql-server-13.16-1.el9.x86_64. 10 MB/s | 5.8 MB 00:00 2024-09-19T08:44:34.480 INFO:teuthology.orchestra.run.smithi190.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 191 kB/s | 19 kB 00:00 2024-09-19T08:44:34.484 INFO:teuthology.orchestra.run.smithi092.stdout:(25/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.0 MB/s | 85 kB 00:00 2024-09-19T08:44:34.555 INFO:teuthology.orchestra.run.smithi190.stdout:(80/156): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-09-19T08:44:34.580 INFO:teuthology.orchestra.run.smithi190.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 346 kB/s | 35 kB 00:00 2024-09-19T08:44:34.614 INFO:teuthology.orchestra.run.smithi190.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-19T08:44:34.648 INFO:teuthology.orchestra.run.smithi190.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.6 MB/s | 250 kB 00:00 2024-09-19T08:44:34.673 INFO:teuthology.orchestra.run.smithi190.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-19T08:44:34.707 INFO:teuthology.orchestra.run.smithi190.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-19T08:44:34.732 INFO:teuthology.orchestra.run.smithi190.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 723 kB/s | 42 kB 00:00 2024-09-19T08:44:34.765 INFO:teuthology.orchestra.run.smithi190.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-19T08:44:34.767 INFO:teuthology.orchestra.run.smithi092.stdout:(26/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 6.3 MB/s | 5.3 MB 00:00 2024-09-19T08:44:34.791 INFO:teuthology.orchestra.run.smithi190.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-09-19T08:44:34.833 INFO:teuthology.orchestra.run.smithi190.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-09-19T08:44:34.858 INFO:teuthology.orchestra.run.smithi190.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 761 kB/s | 51 kB 00:00 2024-09-19T08:44:34.868 INFO:teuthology.orchestra.run.smithi092.stdout:(27/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 8.1 MB/s | 3.1 MB 00:00 2024-09-19T08:44:34.893 INFO:teuthology.orchestra.run.smithi092.stdout:(28/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 1.3 MB/s | 171 kB 00:00 2024-09-19T08:44:34.917 INFO:teuthology.orchestra.run.smithi190.stdout:(91/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 14 MB/s | 5.1 MB 00:00 2024-09-19T08:44:34.935 INFO:teuthology.orchestra.run.smithi092.stdout:(29/156): ceph-grafana-dashboards-19.1.1-361.g2 478 kB/s | 32 kB 00:00 2024-09-19T08:44:34.942 INFO:teuthology.orchestra.run.smithi190.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 493 kB/s | 54 kB 00:00 2024-09-19T08:44:34.960 INFO:teuthology.orchestra.run.smithi092.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.1 MB/s | 146 kB 00:00 2024-09-19T08:44:34.967 INFO:teuthology.orchestra.run.smithi190.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 832 kB/s | 42 kB 00:00 2024-09-19T08:44:34.993 INFO:teuthology.orchestra.run.smithi190.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 878 kB/s | 44 kB 00:00 2024-09-19T08:44:35.034 INFO:teuthology.orchestra.run.smithi190.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-19T08:44:35.060 INFO:teuthology.orchestra.run.smithi190.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 537 kB/s | 36 kB 00:00 2024-09-19T08:44:35.085 INFO:teuthology.orchestra.run.smithi190.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 942 kB/s | 47 kB 00:00 2024-09-19T08:44:35.119 INFO:teuthology.orchestra.run.smithi190.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-19T08:44:35.144 INFO:teuthology.orchestra.run.smithi190.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 986 kB/s | 58 kB 00:00 2024-09-19T08:44:35.178 INFO:teuthology.orchestra.run.smithi190.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-19T08:44:35.203 INFO:teuthology.orchestra.run.smithi190.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-19T08:44:35.237 INFO:teuthology.orchestra.run.smithi190.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 762 kB/s | 45 kB 00:00 2024-09-19T08:44:35.262 INFO:teuthology.orchestra.run.smithi190.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 381 kB/s | 22 kB 00:00 2024-09-19T08:44:35.321 INFO:teuthology.orchestra.run.smithi190.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-19T08:44:35.363 INFO:teuthology.orchestra.run.smithi190.stdout:(105/156): protobuf-compiler-3.14.0-13.el9.x86_ 6.7 MB/s | 863 kB 00:00 2024-09-19T08:44:35.396 INFO:teuthology.orchestra.run.smithi190.stdout:(106/156): gperftools-libs-2.9.1-3.el9.x86_64.r 4.0 MB/s | 308 kB 00:00 2024-09-19T08:44:35.422 INFO:teuthology.orchestra.run.smithi190.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 332 kB/s | 19 kB 00:00 2024-09-19T08:44:35.447 INFO:teuthology.orchestra.run.smithi190.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-19T08:44:35.461 INFO:teuthology.orchestra.run.smithi092.stdout:(31/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 17 MB/s | 49 MB 00:02 2024-09-19T08:44:35.472 INFO:teuthology.orchestra.run.smithi190.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-19T08:44:35.498 INFO:teuthology.orchestra.run.smithi190.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-19T08:44:35.531 INFO:teuthology.orchestra.run.smithi190.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-19T08:44:35.536 INFO:teuthology.orchestra.run.smithi092.stdout:(32/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 5.9 MB/s | 3.6 MB 00:00 2024-09-19T08:44:35.561 INFO:teuthology.orchestra.run.smithi092.stdout:(33/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.4 MB/s | 249 kB 00:00 2024-09-19T08:44:35.578 INFO:teuthology.orchestra.run.smithi092.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 1.2 MB/s | 49 kB 00:00 2024-09-19T08:44:35.590 INFO:teuthology.orchestra.run.smithi190.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-19T08:44:35.612 INFO:teuthology.orchestra.run.smithi092.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 330 kB/s | 16 kB 00:00 2024-09-19T08:44:35.637 INFO:teuthology.orchestra.run.smithi092.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 4.8 MB/s | 285 kB 00:00 2024-09-19T08:44:35.665 INFO:teuthology.orchestra.run.smithi190.stdout:(113/156): libarrow-9.0.0-11.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-09-19T08:44:35.679 INFO:teuthology.orchestra.run.smithi092.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 11 MB/s | 765 kB 00:00 2024-09-19T08:44:35.692 INFO:teuthology.orchestra.run.smithi190.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T08:44:35.696 INFO:teuthology.orchestra.run.smithi092.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 312 kB/s | 18 kB 00:00 2024-09-19T08:44:35.849 INFO:teuthology.orchestra.run.smithi190.stdout:(115/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 16 MB/s | 16 MB 00:00 2024-09-19T08:44:35.874 INFO:teuthology.orchestra.run.smithi190.stdout:(116/156): python3-asyncssh-2.13.2-5.el9.noarch 1.9 MB/s | 548 kB 00:00 2024-09-19T08:44:35.908 INFO:teuthology.orchestra.run.smithi190.stdout:(117/156): python3-cachetools-4.2.4-1.el9.noarc 148 kB/s | 32 kB 00:00 2024-09-19T08:44:35.933 INFO:teuthology.orchestra.run.smithi190.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-19T08:44:35.937 INFO:teuthology.orchestra.run.smithi092.stdout:(39/156): ceph-mgr-diskprediction-local-19.1.1- 7.6 MB/s | 7.4 MB 00:00 2024-09-19T08:44:35.958 INFO:teuthology.orchestra.run.smithi190.stdout:(119/156): python3-certifi-2023.05.07-4.el9.noa 129 kB/s | 14 kB 00:00 2024-09-19T08:44:35.984 INFO:teuthology.orchestra.run.smithi190.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 4.8 MB/s | 358 kB 00:00 2024-09-19T08:44:35.985 INFO:teuthology.orchestra.run.smithi167.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 4.0 MB/s | 11 MB 00:02 2024-09-19T08:44:36.009 INFO:teuthology.orchestra.run.smithi190.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-09-19T08:44:36.034 INFO:teuthology.orchestra.run.smithi190.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 2.9 MB/s | 220 kB 00:00 2024-09-19T08:44:36.052 INFO:teuthology.orchestra.run.smithi167.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 3.4 MB/s | 228 kB 00:00 2024-09-19T08:44:36.059 INFO:teuthology.orchestra.run.smithi190.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-19T08:44:36.076 INFO:teuthology.orchestra.run.smithi190.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 255 kB/s | 11 kB 00:00 2024-09-19T08:44:36.102 INFO:teuthology.orchestra.run.smithi167.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 542 kB/s | 27 kB 00:00 2024-09-19T08:44:36.102 INFO:teuthology.orchestra.run.smithi190.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 420 kB/s | 18 kB 00:00 2024-09-19T08:44:36.127 INFO:teuthology.orchestra.run.smithi190.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2024-09-19T08:44:36.153 INFO:teuthology.orchestra.run.smithi190.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 846 kB/s | 20 kB 00:00 2024-09-19T08:44:36.153 INFO:teuthology.orchestra.run.smithi167.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 632 kB/s | 32 kB 00:00 2024-09-19T08:44:36.177 INFO:teuthology.orchestra.run.smithi190.stdout:(128/156): python3-jaraco-collections-3.0.0-8.e 233 kB/s | 23 kB 00:00 2024-09-19T08:44:36.203 INFO:teuthology.orchestra.run.smithi190.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T08:44:36.228 INFO:teuthology.orchestra.run.smithi190.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T08:44:36.256 INFO:teuthology.orchestra.run.smithi190.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T08:44:36.287 INFO:teuthology.orchestra.run.smithi190.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-19T08:44:36.338 INFO:teuthology.orchestra.run.smithi190.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 329 kB/s | 16 kB 00:00 2024-09-19T08:44:36.363 INFO:teuthology.orchestra.run.smithi190.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-19T08:44:36.397 INFO:teuthology.orchestra.run.smithi190.stdout:(135/156): python3-kubernetes-26.1.0-2.el9.noar 4.2 MB/s | 1.0 MB 00:00 2024-09-19T08:44:36.422 INFO:teuthology.orchestra.run.smithi190.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 481 kB/s | 28 kB 00:00 2024-09-19T08:44:36.429 INFO:teuthology.orchestra.run.smithi092.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 106 kB/s | 80 kB 00:00 2024-09-19T08:44:36.447 INFO:teuthology.orchestra.run.smithi190.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-09-19T08:44:36.498 INFO:teuthology.orchestra.run.smithi190.stdout:(138/156): python3-grpcio-1.46.7-10.el9.x86_64. 4.0 MB/s | 2.0 MB 00:00 2024-09-19T08:44:36.523 INFO:teuthology.orchestra.run.smithi190.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 785 kB/s | 59 kB 00:00 2024-09-19T08:44:36.548 INFO:teuthology.orchestra.run.smithi190.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-19T08:44:36.573 INFO:teuthology.orchestra.run.smithi190.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-19T08:44:36.599 INFO:teuthology.orchestra.run.smithi190.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 1.0 MB/s | 188 kB 00:00 2024-09-19T08:44:36.611 INFO:teuthology.orchestra.run.smithi167.stdout:(14/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 19 MB/s | 49 MB 00:02 2024-09-19T08:44:36.624 INFO:teuthology.orchestra.run.smithi190.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-19T08:44:36.645 INFO:teuthology.orchestra.run.smithi167.stdout:(15/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 1.5 MB/s | 751 kB 00:00 2024-09-19T08:44:36.649 INFO:teuthology.orchestra.run.smithi190.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-19T08:44:36.663 INFO:teuthology.orchestra.run.smithi092.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 264 kB/s | 191 kB 00:00 2024-09-19T08:44:36.670 INFO:teuthology.orchestra.run.smithi167.stdout:(16/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.7 MB/s | 163 kB 00:00 2024-09-19T08:44:36.675 INFO:teuthology.orchestra.run.smithi190.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-09-19T08:44:36.705 INFO:teuthology.orchestra.run.smithi092.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 794 kB/s | 801 kB 00:01 2024-09-19T08:44:36.708 INFO:teuthology.orchestra.run.smithi190.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-09-19T08:44:36.712 INFO:teuthology.orchestra.run.smithi167.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 1.8 MB/s | 127 kB 00:00 2024-09-19T08:44:36.733 INFO:teuthology.orchestra.run.smithi190.stdout:(147/156): re2-20211101-20.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-19T08:44:36.763 INFO:teuthology.orchestra.run.smithi167.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 5.4 MB/s | 506 kB 00:00 2024-09-19T08:44:36.784 INFO:teuthology.orchestra.run.smithi190.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-19T08:44:36.813 INFO:teuthology.orchestra.run.smithi167.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 907 kB/s | 45 kB 00:00 2024-09-19T08:44:36.863 INFO:teuthology.orchestra.run.smithi167.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 2.7 MB/s | 136 kB 00:00 2024-09-19T08:44:36.968 INFO:teuthology.orchestra.run.smithi190.stdout:(149/156): librados2-19.1.1-361.g2f599a46.el9.x 13 MB/s | 3.4 MB 00:00 2024-09-19T08:44:37.051 INFO:teuthology.orchestra.run.smithi190.stdout:(150/156): librbd1-19.1.1-361.g2f599a46.el9.x86 10 MB/s | 3.2 MB 00:00 2024-09-19T08:44:37.063 INFO:teuthology.orchestra.run.smithi167.stdout:(21/156): ceph-common-19.1.1-361.g2f599a46.el9. 3.8 MB/s | 21 MB 00:05 2024-09-19T08:44:37.089 INFO:teuthology.orchestra.run.smithi167.stdout:(22/156): python3-cephfs-19.1.1-361.g2f599a46.e 717 kB/s | 161 kB 00:00 2024-09-19T08:44:37.120 INFO:teuthology.orchestra.run.smithi190.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 615 kB/s | 41 kB 00:00 2024-09-19T08:44:37.147 INFO:teuthology.orchestra.run.smithi167.stdout:(23/156): python3-rbd-19.1.1-361.g2f599a46.el9. 5.0 MB/s | 300 kB 00:00 2024-09-19T08:44:37.172 INFO:teuthology.orchestra.run.smithi167.stdout:(24/156): python3-rados-19.1.1-361.g2f599a46.el 2.9 MB/s | 320 kB 00:00 2024-09-19T08:44:37.193 INFO:teuthology.orchestra.run.smithi190.stdout:(152/156): NetworkManager-tui-1.51.0-1.el9.x86_ 3.2 MB/s | 249 kB 00:00 2024-09-19T08:44:37.198 INFO:teuthology.orchestra.run.smithi167.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.9 MB/s | 99 kB 00:00 2024-09-19T08:44:37.213 INFO:teuthology.orchestra.run.smithi092.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 323 kB/s | 253 kB 00:00 2024-09-19T08:44:37.223 INFO:teuthology.orchestra.run.smithi167.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T08:44:37.282 INFO:teuthology.orchestra.run.smithi167.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.9 MB/s | 171 kB 00:00 2024-09-19T08:44:37.324 INFO:teuthology.orchestra.run.smithi167.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 769 kB/s | 32 kB 00:00 2024-09-19T08:44:37.372 INFO:teuthology.orchestra.run.smithi092.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 160 kB/s | 106 kB 00:00 2024-09-19T08:44:37.374 INFO:teuthology.orchestra.run.smithi167.stdout:(29/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 18 MB/s | 3.1 MB 00:00 2024-09-19T08:44:37.399 INFO:teuthology.orchestra.run.smithi167.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.9 MB/s | 146 kB 00:00 2024-09-19T08:44:37.402 INFO:teuthology.orchestra.run.smithi190.stdout:(153/156): NetworkManager-1.51.0-1.el9.x86_64.r 3.8 MB/s | 2.3 MB 00:00 2024-09-19T08:44:37.444 INFO:teuthology.orchestra.run.smithi190.stdout:(154/156): NetworkManager-libnm-1.51.0-1.el9.x8 3.8 MB/s | 1.8 MB 00:00 2024-09-19T08:44:37.502 INFO:teuthology.orchestra.run.smithi190.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 4.4 MB/s | 1.4 MB 00:00 2024-09-19T08:44:37.631 INFO:teuthology.orchestra.run.smithi092.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 1.3 MB/s | 1.2 MB 00:00 2024-09-19T08:44:37.675 INFO:teuthology.orchestra.run.smithi167.stdout:(31/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 5.5 MB/s | 5.3 MB 00:00 2024-09-19T08:44:37.775 INFO:teuthology.orchestra.run.smithi167.stdout:(32/156): ceph-mgr-diskprediction-local-19.1.1- 20 MB/s | 7.4 MB 00:00 2024-09-19T08:44:37.801 INFO:teuthology.orchestra.run.smithi167.stdout:(33/156): ceph-mgr-modules-core-19.1.1-361.g2f5 1.9 MB/s | 249 kB 00:00 2024-09-19T08:44:37.826 INFO:teuthology.orchestra.run.smithi167.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 982 kB/s | 49 kB 00:00 2024-09-19T08:44:37.851 INFO:teuthology.orchestra.run.smithi167.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 328 kB/s | 16 kB 00:00 2024-09-19T08:44:37.877 INFO:teuthology.orchestra.run.smithi167.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 5.5 MB/s | 285 kB 00:00 2024-09-19T08:44:37.952 INFO:teuthology.orchestra.run.smithi167.stdout:(37/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 6.2 MB/s | 3.6 MB 00:00 2024-09-19T08:44:37.974 INFO:teuthology.orchestra.run.smithi167.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 188 kB/s | 18 kB 00:00 2024-09-19T08:44:37.997 INFO:teuthology.orchestra.run.smithi092.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 172 kB/s | 135 kB 00:00 2024-09-19T08:44:38.033 INFO:teuthology.orchestra.run.smithi167.stdout:(39/156): cephadm-19.1.1-361.g2f599a46.el9.noar 4.1 MB/s | 765 kB 00:00 2024-09-19T08:44:38.047 INFO:teuthology.orchestra.run.smithi092.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 185 kB/s | 125 kB 00:00 2024-09-19T08:44:38.100 INFO:teuthology.orchestra.run.smithi167.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 542 kB/s | 80 kB 00:00 2024-09-19T08:44:38.111 INFO:teuthology.orchestra.run.smithi190.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.4 MB/s | 2.4 MB 00:00 2024-09-19T08:44:38.118 INFO:teuthology.orchestra.run.smithi190.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:44:38.118 INFO:teuthology.orchestra.run.smithi190.stdout:Total 23 MB/s | 226 MB 00:09 2024-09-19T08:44:38.191 INFO:teuthology.orchestra.run.smithi167.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.6 MB/s | 801 kB 00:00 2024-09-19T08:44:38.206 INFO:teuthology.orchestra.run.smithi092.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 689 kB 00:00 2024-09-19T08:44:38.217 INFO:teuthology.orchestra.run.smithi167.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 191 kB 00:00 2024-09-19T08:44:38.242 INFO:teuthology.orchestra.run.smithi167.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-09-19T08:44:38.248 INFO:teuthology.orchestra.run.smithi092.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-09-19T08:44:38.267 INFO:teuthology.orchestra.run.smithi167.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-19T08:44:38.293 INFO:teuthology.orchestra.run.smithi167.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-19T08:44:38.307 INFO:teuthology.orchestra.run.smithi092.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 373 kB/s | 22 kB 00:00 2024-09-19T08:44:38.332 INFO:teuthology.orchestra.run.smithi092.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 3.2 MB/s | 943 kB 00:00 2024-09-19T08:44:38.352 INFO:teuthology.orchestra.run.smithi167.stdout:(46/156): python3-cryptography-36.0.1-4.el9.x86 7.7 MB/s | 1.2 MB 00:00 2024-09-19T08:44:38.366 INFO:teuthology.orchestra.run.smithi092.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 982 kB/s | 33 kB 00:00 2024-09-19T08:44:38.377 INFO:teuthology.orchestra.run.smithi167.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-09-19T08:44:38.391 INFO:teuthology.orchestra.run.smithi092.stdout:(53/156): python3-urllib3-1.26.5-6.el9.noarch.r 283 kB/s | 215 kB 00:00 2024-09-19T08:44:38.402 INFO:teuthology.orchestra.run.smithi167.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-09-19T08:44:38.416 INFO:teuthology.orchestra.run.smithi092.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-09-19T08:44:38.450 INFO:teuthology.orchestra.run.smithi092.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 335 kB/s | 11 kB 00:00 2024-09-19T08:44:38.467 INFO:teuthology.orchestra.run.smithi092.stdout:(56/156): flexiblas-openblas-openmp-3.0.4-8.el9 242 kB/s | 18 kB 00:00 2024-09-19T08:44:38.509 INFO:teuthology.orchestra.run.smithi092.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-19T08:44:38.511 INFO:teuthology.orchestra.run.smithi167.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 986 kB/s | 107 kB 00:00 2024-09-19T08:44:38.525 INFO:teuthology.orchestra.run.smithi092.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 773 kB/s | 45 kB 00:00 2024-09-19T08:44:38.553 INFO:teuthology.orchestra.run.smithi167.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 523 kB/s | 22 kB 00:00 2024-09-19T08:44:38.609 INFO:teuthology.orchestra.run.smithi092.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 6.5 MB/s | 662 kB 00:00 2024-09-19T08:44:38.620 INFO:teuthology.orchestra.run.smithi167.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 2.5 MB/s | 689 kB 00:00 2024-09-19T08:44:38.643 INFO:teuthology.orchestra.run.smithi092.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 733 kB/s | 24 kB 00:00 2024-09-19T08:44:38.654 INFO:teuthology.orchestra.run.smithi167.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 3.3 MB/s | 943 kB 00:00 2024-09-19T08:44:38.668 INFO:teuthology.orchestra.run.smithi092.stdout:(61/156): libtool-2.4.6-46.el9.x86_64.rpm 4.0 MB/s | 581 kB 00:00 2024-09-19T08:44:38.679 INFO:teuthology.orchestra.run.smithi167.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 558 kB/s | 33 kB 00:00 2024-09-19T08:44:38.685 INFO:teuthology.orchestra.run.smithi092.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-19T08:44:38.704 INFO:teuthology.orchestra.run.smithi167.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.0 MB/s | 313 kB 00:00 2024-09-19T08:44:38.710 INFO:teuthology.orchestra.run.smithi092.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.9 MB/s | 292 kB 00:00 2024-09-19T08:44:38.729 INFO:teuthology.orchestra.run.smithi167.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-09-19T08:44:38.745 INFO:teuthology.orchestra.run.smithi092.stdout:(64/156): openblas-0.3.26-2.el9.x86_64.rpm 1.1 MB/s | 38 kB 00:00 2024-09-19T08:44:38.755 INFO:teuthology.orchestra.run.smithi167.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 221 kB/s | 11 kB 00:00 2024-09-19T08:44:38.769 INFO:teuthology.orchestra.run.smithi092.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-19T08:44:38.788 INFO:teuthology.orchestra.run.smithi167.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-19T08:44:38.814 INFO:teuthology.orchestra.run.smithi167.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 775 kB/s | 45 kB 00:00 2024-09-19T08:44:38.906 INFO:teuthology.orchestra.run.smithi167.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-09-19T08:44:38.947 INFO:teuthology.orchestra.run.smithi167.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 588 kB/s | 24 kB 00:00 2024-09-19T08:44:38.989 INFO:teuthology.orchestra.run.smithi167.stdout:(61/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-19T08:44:39.048 INFO:teuthology.orchestra.run.smithi167.stdout:(62/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.6 MB/s | 3.0 MB 00:00 2024-09-19T08:44:39.073 INFO:teuthology.orchestra.run.smithi167.stdout:(63/156): libtool-2.4.6-46.el9.x86_64.rpm 2.2 MB/s | 581 kB 00:00 2024-09-19T08:44:39.099 INFO:teuthology.orchestra.run.smithi167.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-19T08:44:39.124 INFO:teuthology.orchestra.run.smithi167.stdout:(65/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-09-19T08:44:39.136 INFO:teuthology.orchestra.run.smithi092.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.9 MB/s | 3.0 MB 00:00 2024-09-19T08:44:39.149 INFO:teuthology.orchestra.run.smithi167.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 509 kB/s | 38 kB 00:00 2024-09-19T08:44:39.352 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction check 2024-09-19T08:44:39.417 INFO:teuthology.orchestra.run.smithi167.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 16 MB/s | 4.9 MB 00:00 2024-09-19T08:44:39.504 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction check succeeded. 2024-09-19T08:44:39.504 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction test 2024-09-19T08:44:39.508 INFO:teuthology.orchestra.run.smithi167.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 4.4 MB/s | 1.6 MB 00:00 2024-09-19T08:44:39.550 INFO:teuthology.orchestra.run.smithi167.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 6.7 MB/s | 910 kB 00:00 2024-09-19T08:44:39.576 INFO:teuthology.orchestra.run.smithi167.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-19T08:44:39.628 INFO:teuthology.orchestra.run.smithi092.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 3.2 MB/s | 1.6 MB 00:00 2024-09-19T08:44:39.659 INFO:teuthology.orchestra.run.smithi167.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 8.3 MB/s | 4.4 MB 00:00 2024-09-19T08:44:39.701 INFO:teuthology.orchestra.run.smithi167.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 2.1 MB/s | 87 kB 00:00 2024-09-19T08:44:39.794 INFO:teuthology.orchestra.run.smithi167.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 4.6 MB/s | 1.0 MB 00:00 2024-09-19T08:44:39.861 INFO:teuthology.orchestra.run.smithi167.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 920 kB/s | 61 kB 00:00 2024-09-19T08:44:39.936 INFO:teuthology.orchestra.run.smithi167.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 15 MB/s | 5.8 MB 00:00 2024-09-19T08:44:39.961 INFO:teuthology.orchestra.run.smithi167.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-19T08:44:39.980 INFO:teuthology.orchestra.run.smithi092.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 2.5 MB/s | 910 kB 00:00 2024-09-19T08:44:39.986 INFO:teuthology.orchestra.run.smithi167.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-19T08:44:40.011 INFO:teuthology.orchestra.run.smithi167.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-09-19T08:44:40.037 INFO:teuthology.orchestra.run.smithi167.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-09-19T08:44:40.070 INFO:teuthology.orchestra.run.smithi092.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 1.5 MB/s | 137 kB 00:00 2024-09-19T08:44:40.070 INFO:teuthology.orchestra.run.smithi167.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-19T08:44:40.096 INFO:teuthology.orchestra.run.smithi167.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 592 kB/s | 35 kB 00:00 2024-09-19T08:44:40.137 INFO:teuthology.orchestra.run.smithi092.stdout:(70/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.2 MB/s | 4.4 MB 00:01 2024-09-19T08:44:40.179 INFO:teuthology.orchestra.run.smithi167.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-09-19T08:44:40.205 INFO:teuthology.orchestra.run.smithi167.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-19T08:44:40.230 INFO:teuthology.orchestra.run.smithi167.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-19T08:44:40.245 INFO:teuthology.orchestra.run.smithi092.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 3.3 MB/s | 4.9 MB 00:01 2024-09-19T08:44:40.255 INFO:teuthology.orchestra.run.smithi167.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-19T08:44:40.281 INFO:teuthology.orchestra.run.smithi167.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 841 kB/s | 42 kB 00:00 2024-09-19T08:44:40.304 INFO:teuthology.orchestra.run.smithi092.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-19T08:44:40.314 INFO:teuthology.orchestra.run.smithi167.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-19T08:44:40.340 INFO:teuthology.orchestra.run.smithi167.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-09-19T08:44:40.365 INFO:teuthology.orchestra.run.smithi167.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-19T08:44:40.390 INFO:teuthology.orchestra.run.smithi167.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-19T08:44:40.416 INFO:teuthology.orchestra.run.smithi167.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-19T08:44:40.490 INFO:teuthology.orchestra.run.smithi167.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 560 kB/s | 42 kB 00:00 2024-09-19T08:44:40.537 INFO:teuthology.orchestra.run.smithi092.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 2.5 MB/s | 1.0 MB 00:00 2024-09-19T08:44:40.549 INFO:teuthology.orchestra.run.smithi167.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 751 kB/s | 44 kB 00:00 2024-09-19T08:44:40.579 INFO:teuthology.orchestra.run.smithi092.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-19T08:44:40.625 INFO:teuthology.orchestra.run.smithi167.stdout:(94/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 9.2 MB/s | 5.1 MB 00:00 2024-09-19T08:44:40.642 INFO:teuthology.orchestra.run.smithi167.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.3 MB/s | 221 kB 00:00 2024-09-19T08:44:40.667 INFO:teuthology.orchestra.run.smithi167.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 856 kB/s | 36 kB 00:00 2024-09-19T08:44:40.680 INFO:teuthology.orchestra.run.smithi092.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-19T08:44:40.692 INFO:teuthology.orchestra.run.smithi167.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 940 kB/s | 47 kB 00:00 2024-09-19T08:44:40.718 INFO:teuthology.orchestra.run.smithi167.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-19T08:44:40.743 INFO:teuthology.orchestra.run.smithi167.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-19T08:44:40.777 INFO:teuthology.orchestra.run.smithi167.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-19T08:44:40.802 INFO:teuthology.orchestra.run.smithi167.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-19T08:44:40.805 INFO:teuthology.orchestra.run.smithi092.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.9 MB/s | 248 kB 00:00 2024-09-19T08:44:40.827 INFO:teuthology.orchestra.run.smithi167.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-09-19T08:44:40.838 INFO:teuthology.orchestra.run.smithi092.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 770 kB/s | 26 kB 00:00 2024-09-19T08:44:40.872 INFO:teuthology.orchestra.run.smithi092.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 576 kB/s | 19 kB 00:00 2024-09-19T08:44:40.970 INFO:teuthology.orchestra.run.smithi167.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 134 kB/s | 22 kB 00:00 2024-09-19T08:44:40.972 INFO:teuthology.orchestra.run.smithi092.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-09-19T08:44:41.028 INFO:teuthology.orchestra.run.smithi167.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-19T08:44:41.031 INFO:teuthology.orchestra.run.smithi092.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 593 kB/s | 35 kB 00:00 2024-09-19T08:44:41.062 INFO:teuthology.orchestra.run.smithi167.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-19T08:44:41.079 INFO:teuthology.orchestra.run.smithi167.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 1.2 MB/s | 19 kB 00:00 2024-09-19T08:44:41.237 INFO:teuthology.orchestra.run.smithi167.stdout:(107/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 19 MB/s | 16 MB 00:00 2024-09-19T08:44:41.279 INFO:teuthology.orchestra.run.smithi167.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 629 kB/s | 26 kB 00:00 2024-09-19T08:44:41.306 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction test succeeded. 2024-09-19T08:44:41.307 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction 2024-09-19T08:44:41.329 INFO:teuthology.orchestra.run.smithi167.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 980 kB/s | 49 kB 00:00 2024-09-19T08:44:41.355 INFO:teuthology.orchestra.run.smithi167.stdout:(110/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.6 MB/s | 863 kB 00:00 2024-09-19T08:44:41.388 INFO:teuthology.orchestra.run.smithi167.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-09-19T08:44:41.422 INFO:teuthology.orchestra.run.smithi167.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-19T08:44:41.481 INFO:teuthology.orchestra.run.smithi167.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.1 MB/s | 839 kB 00:00 2024-09-19T08:44:41.506 INFO:teuthology.orchestra.run.smithi167.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T08:44:41.540 INFO:teuthology.orchestra.run.smithi167.stdout:(115/156): python3-asyncssh-2.13.2-5.el9.noarch 4.6 MB/s | 548 kB 00:00 2024-09-19T08:44:41.565 INFO:teuthology.orchestra.run.smithi167.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 550 kB/s | 32 kB 00:00 2024-09-19T08:44:41.590 INFO:teuthology.orchestra.run.smithi167.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 282 kB/s | 14 kB 00:00 2024-09-19T08:44:41.657 INFO:teuthology.orchestra.run.smithi167.stdout:(118/156): libarrow-9.0.0-11.el9.x86_64.rpm 7.6 MB/s | 4.4 MB 00:00 2024-09-19T08:44:41.683 INFO:teuthology.orchestra.run.smithi167.stdout:(119/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2024-09-19T08:44:41.716 INFO:teuthology.orchestra.run.smithi167.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-19T08:44:41.742 INFO:teuthology.orchestra.run.smithi167.stdout:(121/156): python3-cherrypy-18.6.1-2.el9.noarch 2.3 MB/s | 358 kB 00:00 2024-09-19T08:44:41.767 INFO:teuthology.orchestra.run.smithi167.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-09-19T08:44:41.792 INFO:teuthology.orchestra.run.smithi167.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-19T08:44:41.820 INFO:teuthology.orchestra.run.smithi167.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-19T08:44:41.843 INFO:teuthology.orchestra.run.smithi167.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2024-09-19T08:44:41.868 INFO:teuthology.orchestra.run.smithi167.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-19T08:44:41.894 INFO:teuthology.orchestra.run.smithi167.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 385 kB/s | 19 kB 00:00 2024-09-19T08:44:41.919 INFO:teuthology.orchestra.run.smithi167.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 390 kB/s | 20 kB 00:00 2024-09-19T08:44:41.944 INFO:teuthology.orchestra.run.smithi167.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T08:44:41.969 INFO:teuthology.orchestra.run.smithi167.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T08:44:41.995 INFO:teuthology.orchestra.run.smithi167.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T08:44:42.028 INFO:teuthology.orchestra.run.smithi167.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-19T08:44:42.054 INFO:teuthology.orchestra.run.smithi167.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-09-19T08:44:42.096 INFO:teuthology.orchestra.run.smithi167.stdout:(134/156): python3-kubernetes-26.1.0-2.el9.noar 5.1 MB/s | 1.0 MB 00:00 2024-09-19T08:44:42.121 INFO:teuthology.orchestra.run.smithi167.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-09-19T08:44:42.146 INFO:teuthology.orchestra.run.smithi167.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-19T08:44:42.172 INFO:teuthology.orchestra.run.smithi167.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 615 kB/s | 31 kB 00:00 2024-09-19T08:44:42.197 INFO:teuthology.orchestra.run.smithi167.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-19T08:44:42.222 INFO:teuthology.orchestra.run.smithi167.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-19T08:44:42.247 INFO:teuthology.orchestra.run.smithi167.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 716 kB/s | 36 kB 00:00 2024-09-19T08:44:42.272 INFO:teuthology.orchestra.run.smithi167.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 2.9 MB/s | 74 kB 00:00 2024-09-19T08:44:42.298 INFO:teuthology.orchestra.run.smithi167.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-19T08:44:42.315 INFO:teuthology.orchestra.run.smithi167.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-09-19T08:44:42.365 INFO:teuthology.orchestra.run.smithi167.stdout:(144/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.1 MB/s | 2.0 MB 00:00 2024-09-19T08:44:42.382 INFO:teuthology.orchestra.run.smithi167.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 298 kB/s | 20 kB 00:00 2024-09-19T08:44:42.415 INFO:teuthology.orchestra.run.smithi092.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 2.5 MB/s | 5.8 MB 00:02 2024-09-19T08:44:42.416 INFO:teuthology.orchestra.run.smithi167.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-19T08:44:42.441 INFO:teuthology.orchestra.run.smithi167.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-19T08:44:42.491 INFO:teuthology.orchestra.run.smithi167.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-19T08:44:42.515 INFO:teuthology.orchestra.run.smithi092.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.5 MB/s | 250 kB 00:00 2024-09-19T08:44:42.598 INFO:teuthology.orchestra.run.smithi092.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-09-19T08:44:42.633 INFO:teuthology.orchestra.run.smithi167.stdout:(149/156): NetworkManager-1.51.0-1.el9.x86_64.r 17 MB/s | 2.3 MB 00:00 2024-09-19T08:44:42.682 INFO:teuthology.orchestra.run.smithi092.stdout:(84/156): python3-babel-2.9.1-2.el9.noarch.rpm 2.5 MB/s | 6.0 MB 00:02 2024-09-19T08:44:42.700 INFO:teuthology.orchestra.run.smithi167.stdout:(150/156): NetworkManager-libnm-1.51.0-1.el9.x8 27 MB/s | 1.8 MB 00:00 2024-09-19T08:44:42.707 INFO:teuthology.orchestra.run.smithi092.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 711 kB/s | 77 kB 00:00 2024-09-19T08:44:42.732 INFO:teuthology.orchestra.run.smithi092.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 842 kB/s | 42 kB 00:00 2024-09-19T08:44:42.742 INFO:teuthology.orchestra.run.smithi167.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 985 kB/s | 41 kB 00:00 2024-09-19T08:44:42.809 INFO:teuthology.orchestra.run.smithi167.stdout:(152/156): librbd1-19.1.1-361.g2f599a46.el9.x86 8.6 MB/s | 3.2 MB 00:00 2024-09-19T08:44:42.816 INFO:teuthology.orchestra.run.smithi092.stdout:(87/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.9 MB/s | 5.1 MB 00:01 2024-09-19T08:44:42.834 INFO:teuthology.orchestra.run.smithi167.stdout:(153/156): NetworkManager-tui-1.51.0-1.el9.x86_ 2.6 MB/s | 249 kB 00:00 2024-09-19T08:44:42.841 INFO:teuthology.orchestra.run.smithi092.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 2.0 MB/s | 269 kB 00:00 2024-09-19T08:44:42.866 INFO:teuthology.orchestra.run.smithi092.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-19T08:44:42.883 INFO:teuthology.orchestra.run.smithi092.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-19T08:44:42.900 INFO:teuthology.orchestra.run.smithi092.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-09-19T08:44:42.918 INFO:teuthology.orchestra.run.smithi167.stdout:(154/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 29 MB/s | 2.4 MB 00:00 2024-09-19T08:44:42.942 INFO:teuthology.orchestra.run.smithi092.stdout:(92/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.2 MB/s | 279 kB 00:00 2024-09-19T08:44:42.952 INFO:teuthology.orchestra.run.smithi167.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 9.5 MB/s | 1.4 MB 00:00 2024-09-19T08:44:42.959 INFO:teuthology.orchestra.run.smithi092.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 714 kB/s | 42 kB 00:00 2024-09-19T08:44:42.976 INFO:teuthology.orchestra.run.smithi092.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.3 MB/s | 44 kB 00:00 2024-09-19T08:44:43.010 INFO:teuthology.orchestra.run.smithi092.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 1.1 MB/s | 36 kB 00:00 2024-09-19T08:44:43.043 INFO:teuthology.orchestra.run.smithi092.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-19T08:44:43.069 INFO:teuthology.orchestra.run.smithi092.stdout:(97/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-09-19T08:44:43.102 INFO:teuthology.orchestra.run.smithi092.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.7 MB/s | 58 kB 00:00 2024-09-19T08:44:43.110 INFO:teuthology.orchestra.run.smithi167.stdout:(156/156): librados2-19.1.1-361.g2f599a46.el9.x 4.9 MB/s | 3.4 MB 00:00 2024-09-19T08:44:43.116 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:44:43.117 INFO:teuthology.orchestra.run.smithi167.stdout:Total 18 MB/s | 226 MB 00:12 2024-09-19T08:44:43.161 INFO:teuthology.orchestra.run.smithi092.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.5 MB/s | 304 kB 00:00 2024-09-19T08:44:43.186 INFO:teuthology.orchestra.run.smithi092.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.1 MB/s | 96 kB 00:00 2024-09-19T08:44:43.228 INFO:teuthology.orchestra.run.smithi092.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 951 kB/s | 64 kB 00:00 2024-09-19T08:44:43.253 INFO:teuthology.orchestra.run.smithi092.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 671 kB/s | 45 kB 00:00 2024-09-19T08:44:43.407 INFO:teuthology.orchestra.run.smithi092.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 125 kB/s | 22 kB 00:00 2024-09-19T08:44:43.462 INFO:teuthology.orchestra.run.smithi092.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.7 MB/s | 548 kB 00:00 2024-09-19T08:44:43.496 INFO:teuthology.orchestra.run.smithi092.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-19T08:44:43.521 INFO:teuthology.orchestra.run.smithi092.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 784 kB/s | 19 kB 00:00 2024-09-19T08:44:43.605 INFO:teuthology.orchestra.run.smithi092.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.4 MB/s | 863 kB 00:00 2024-09-19T08:44:43.672 INFO:teuthology.orchestra.run.smithi092.stdout:(108/156): libarrow-9.0.0-11.el9.x86_64.rpm 29 MB/s | 4.4 MB 00:00 2024-09-19T08:44:43.688 INFO:teuthology.orchestra.run.smithi092.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 311 kB/s | 26 kB 00:00 2024-09-19T08:44:43.705 INFO:teuthology.orchestra.run.smithi092.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 1.5 MB/s | 49 kB 00:00 2024-09-19T08:44:43.731 INFO:teuthology.orchestra.run.smithi092.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-19T08:44:43.756 INFO:teuthology.orchestra.run.smithi092.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-19T08:44:43.806 INFO:teuthology.orchestra.run.smithi092.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-19T08:44:43.832 INFO:teuthology.orchestra.run.smithi092.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 7.1 MB/s | 548 kB 00:00 2024-09-19T08:44:43.857 INFO:teuthology.orchestra.run.smithi092.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 867 kB/s | 43 kB 00:00 2024-09-19T08:44:43.882 INFO:teuthology.orchestra.run.smithi092.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 641 kB/s | 32 kB 00:00 2024-09-19T08:44:43.907 INFO:teuthology.orchestra.run.smithi092.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-09-19T08:44:43.933 INFO:teuthology.orchestra.run.smithi092.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-19T08:44:43.958 INFO:teuthology.orchestra.run.smithi092.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-19T08:44:43.983 INFO:teuthology.orchestra.run.smithi092.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-19T08:44:44.008 INFO:teuthology.orchestra.run.smithi092.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-19T08:44:44.042 INFO:teuthology.orchestra.run.smithi092.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-19T08:44:44.067 INFO:teuthology.orchestra.run.smithi092.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-19T08:44:44.093 INFO:teuthology.orchestra.run.smithi092.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 709 kB/s | 18 kB 00:00 2024-09-19T08:44:44.118 INFO:teuthology.orchestra.run.smithi092.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 931 kB/s | 23 kB 00:00 2024-09-19T08:44:44.143 INFO:teuthology.orchestra.run.smithi092.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 781 kB/s | 19 kB 00:00 2024-09-19T08:44:44.168 INFO:teuthology.orchestra.run.smithi092.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 792 kB/s | 20 kB 00:00 2024-09-19T08:44:44.219 INFO:teuthology.orchestra.run.smithi092.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 8.7 MB/s | 2.0 MB 00:00 2024-09-19T08:44:44.235 INFO:teuthology.orchestra.run.smithi092.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 2.8 MB/s | 46 kB 00:00 2024-09-19T08:44:44.261 INFO:teuthology.orchestra.run.smithi092.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T08:44:44.278 INFO:teuthology.orchestra.run.smithi092.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-19T08:44:44.312 INFO:teuthology.orchestra.run.smithi092.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 7.1 MB/s | 1.0 MB 00:00 2024-09-19T08:44:44.328 INFO:teuthology.orchestra.run.smithi092.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 992 kB/s | 16 kB 00:00 2024-09-19T08:44:44.332 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-19T08:44:44.354 INFO:teuthology.orchestra.run.smithi092.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-19T08:44:44.371 INFO:teuthology.orchestra.run.smithi092.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.7 MB/s | 28 kB 00:00 2024-09-19T08:44:44.396 INFO:teuthology.orchestra.run.smithi092.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-09-19T08:44:44.413 INFO:teuthology.orchestra.run.smithi092.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 734 kB/s | 31 kB 00:00 2024-09-19T08:44:44.430 INFO:teuthology.orchestra.run.smithi092.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-09-19T08:44:44.455 INFO:teuthology.orchestra.run.smithi092.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-09-19T08:44:44.472 INFO:teuthology.orchestra.run.smithi092.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 850 kB/s | 36 kB 00:00 2024-09-19T08:44:44.485 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-19T08:44:44.485 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-19T08:44:44.497 INFO:teuthology.orchestra.run.smithi092.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-19T08:44:44.523 INFO:teuthology.orchestra.run.smithi092.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-19T08:44:44.548 INFO:teuthology.orchestra.run.smithi092.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-19T08:44:44.565 INFO:teuthology.orchestra.run.smithi092.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-19T08:44:44.590 INFO:teuthology.orchestra.run.smithi092.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 6.2 MB/s | 427 kB 00:00 2024-09-19T08:44:44.616 INFO:teuthology.orchestra.run.smithi092.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-19T08:44:44.676 INFO:teuthology.orchestra.run.smithi092.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-19T08:44:44.933 INFO:teuthology.orchestra.run.smithi092.stdout:(148/156): librados2-19.1.1-361.g2f599a46.el9.x 11 MB/s | 3.4 MB 00:00 2024-09-19T08:44:44.983 INFO:teuthology.orchestra.run.smithi092.stdout:(149/156): librbd1-19.1.1-361.g2f599a46.el9.x86 10 MB/s | 3.2 MB 00:00 2024-09-19T08:44:45.933 INFO:teuthology.orchestra.run.smithi092.stdout:(150/156): NetworkManager-1.51.0-1.el9.x86_64.r 2.3 MB/s | 2.3 MB 00:00 2024-09-19T08:44:45.975 INFO:teuthology.orchestra.run.smithi092.stdout:(151/156): NetworkManager-libnm-1.51.0-1.el9.x8 1.8 MB/s | 1.8 MB 00:00 2024-09-19T08:44:46.293 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-19T08:44:46.293 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-19T08:44:46.501 INFO:teuthology.orchestra.run.smithi092.stdout:(152/156): NetworkManager-team-1.51.0-1.el9.x86 72 kB/s | 41 kB 00:00 2024-09-19T08:44:46.759 INFO:teuthology.orchestra.run.smithi092.stdout:(153/156): NetworkManager-tui-1.51.0-1.el9.x86_ 318 kB/s | 249 kB 00:00 2024-09-19T08:44:47.517 INFO:teuthology.orchestra.run.smithi092.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 1.3 MB/s | 1.4 MB 00:01 2024-09-19T08:44:47.580 INFO:teuthology.orchestra.run.smithi190.stdout: Preparing : 1/1 2024-09-19T08:44:47.694 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T08:44:47.823 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T08:44:47.904 INFO:teuthology.orchestra.run.smithi092.stdout:(155/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.2 MB/s | 16 MB 00:05 2024-09-19T08:44:47.958 INFO:teuthology.orchestra.run.smithi092.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.0 MB/s | 2.4 MB 00:01 2024-09-19T08:44:47.958 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T08:44:47.959 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:44:47.959 INFO:teuthology.orchestra.run.smithi092.stdout:Total 13 MB/s | 226 MB 00:17 2024-09-19T08:44:48.006 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T08:44:48.044 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T08:44:48.102 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T08:44:48.431 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T08:44:48.551 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:44:48.673 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:44:48.702 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:44:48.792 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:44:48.831 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:44:48.979 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T08:44:49.036 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T08:44:49.064 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:44:49.150 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:44:49.163 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-19T08:44:49.182 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:44:49.237 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:44:49.266 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:44:49.291 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:44:49.313 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-19T08:44:49.314 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-19T08:44:49.486 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:44:49.631 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:44:49.743 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T08:44:49.848 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:44:49.925 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:44:50.150 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:44:50.264 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T08:44:50.365 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T08:44:50.409 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T08:44:50.452 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T08:44:50.525 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T08:44:50.578 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T08:44:50.618 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T08:44:50.670 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T08:44:50.702 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T08:44:50.731 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T08:44:50.800 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T08:44:50.853 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T08:44:50.884 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T08:44:50.928 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T08:44:51.011 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T08:44:51.055 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T08:44:51.098 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T08:44:51.127 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T08:44:51.197 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T08:44:51.241 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T08:44:51.315 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T08:44:51.448 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T08:44:51.511 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T08:44:51.549 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-19T08:44:51.550 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-19T08:44:52.039 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T08:44:52.123 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T08:44:52.153 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T08:44:52.195 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T08:44:52.236 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T08:44:52.277 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T08:44:52.441 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T08:44:52.506 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T08:44:52.541 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-19T08:44:52.560 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T08:44:52.633 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T08:44:52.665 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T08:44:52.689 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T08:44:52.701 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T08:44:52.728 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T08:44:52.748 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T08:44:52.784 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T08:44:52.827 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T08:44:52.877 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T08:44:53.012 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T08:44:53.030 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T08:44:53.050 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T08:44:53.074 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T08:44:53.079 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T08:44:53.119 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T08:44:53.121 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T08:44:53.223 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T08:44:53.254 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T08:44:53.294 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T08:44:53.405 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T08:44:53.478 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T08:44:53.514 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T08:44:53.561 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T08:44:53.567 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:44:53.681 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:44:53.697 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T08:44:53.718 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:44:53.736 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T08:44:53.763 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T08:44:53.798 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T08:44:53.810 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:44:53.837 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T08:44:53.839 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:44:53.869 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T08:44:53.899 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T08:44:53.933 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T08:44:53.967 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T08:44:53.988 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T08:44:54.016 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T08:44:54.045 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T08:44:54.053 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T08:44:54.073 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:44:54.139 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T08:44:54.176 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:44:54.192 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T08:44:54.199 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:44:54.223 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T08:44:54.262 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:44:54.283 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:44:54.310 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:44:54.325 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T08:44:54.374 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T08:44:54.501 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:44:54.642 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:44:54.758 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T08:44:54.864 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:44:54.943 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:44:55.093 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T08:44:55.138 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T08:44:55.180 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T08:44:55.181 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:44:55.278 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T08:44:55.309 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T08:44:55.335 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T08:44:55.380 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T08:44:55.404 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T08:44:55.439 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T08:44:55.466 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T08:44:55.482 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T08:44:55.507 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T08:44:55.557 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T08:44:55.618 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T08:44:55.674 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T08:44:55.690 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T08:44:55.722 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T08:44:55.723 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T08:44:55.763 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T08:44:55.799 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T08:44:55.799 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T08:44:55.869 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T08:44:55.925 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T08:44:55.952 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T08:44:55.995 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T08:44:56.072 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T08:44:56.107 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T08:44:56.150 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T08:44:56.179 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T08:44:56.249 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T08:44:56.302 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T08:44:56.377 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T08:44:56.457 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T08:44:56.511 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T08:44:56.563 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T08:44:56.579 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T08:44:57.098 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T08:44:57.175 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T08:44:57.205 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T08:44:57.250 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T08:44:57.288 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T08:44:57.330 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T08:44:57.495 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T08:44:57.566 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T08:44:57.619 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T08:44:57.691 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T08:44:57.723 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T08:44:57.769 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T08:44:57.806 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T08:44:57.815 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-19T08:44:57.822 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T08:44:57.859 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T08:44:57.901 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T08:44:57.938 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T08:44:57.954 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T08:44:57.973 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T08:44:58.063 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T08:44:58.095 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T08:44:58.113 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T08:44:58.250 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T08:44:58.280 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T08:44:58.296 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T08:44:58.307 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T08:44:58.325 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:44:58.337 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T08:44:58.388 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T08:44:58.413 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T08:44:58.425 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:44:58.442 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T08:44:58.465 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T08:44:58.480 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T08:44:58.520 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T08:44:58.543 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T08:44:58.545 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T08:44:58.570 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T08:44:58.644 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T08:44:58.702 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T08:44:58.781 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T08:44:58.799 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T08:44:58.812 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T08:44:58.840 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T08:44:58.882 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T08:44:58.906 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:44:58.930 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T08:44:58.961 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T08:44:58.993 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T08:44:59.026 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T08:44:59.026 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:44:59.057 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:44:59.059 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T08:44:59.101 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T08:44:59.136 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T08:44:59.152 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:44:59.186 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:44:59.190 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T08:44:59.222 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T08:44:59.237 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:44:59.275 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T08:44:59.292 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:44:59.314 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T08:44:59.322 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T08:44:59.352 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T08:44:59.408 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T08:44:59.417 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T08:44:59.436 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:44:59.465 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T08:44:59.540 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:44:59.570 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:44:59.632 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:44:59.654 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:44:59.675 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:44:59.831 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:45:00.005 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:45:00.144 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T08:45:00.187 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T08:45:00.238 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T08:45:00.251 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:45:00.280 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T08:45:00.337 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:45:00.386 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T08:45:00.443 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T08:45:00.489 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T08:45:00.572 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:45:00.576 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T08:45:00.608 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T08:45:00.680 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T08:45:00.797 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T08:45:00.800 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T08:45:00.831 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T08:45:00.834 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T08:45:00.869 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T08:45:00.908 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T08:45:00.933 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T08:45:00.978 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T08:45:01.010 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T08:45:01.053 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T08:45:01.086 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T08:45:01.113 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T08:45:01.182 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T08:45:01.236 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T08:45:01.267 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T08:45:01.308 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T08:45:01.387 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T08:45:01.430 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T08:45:01.473 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T08:45:01.501 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T08:45:01.561 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T08:45:01.571 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T08:45:01.615 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T08:45:01.629 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:45:01.669 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:45:01.687 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T08:45:01.689 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T08:45:01.821 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T08:45:01.876 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T08:45:02.217 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:45:02.264 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:45:02.340 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:45:02.340 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T08:45:02.340 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T08:45:02.341 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-19T08:45:02.373 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:45:02.393 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T08:45:02.471 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T08:45:02.509 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T08:45:02.544 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T08:45:02.582 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T08:45:02.624 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T08:45:02.771 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T08:45:02.826 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T08:45:02.881 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T08:45:02.911 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T08:45:02.954 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T08:45:02.987 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T08:45:02.994 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T08:45:03.014 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T08:45:03.030 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T08:45:03.048 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T08:45:03.077 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T08:45:03.113 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T08:45:03.156 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T08:45:03.198 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T08:45:03.333 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T08:45:03.357 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T08:45:03.384 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T08:45:03.395 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:45:03.424 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T08:45:03.484 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:45:03.528 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T08:45:03.567 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T08:45:03.614 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T08:45:03.624 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T08:45:03.648 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T08:45:03.669 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T08:45:03.673 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T08:45:03.775 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T08:45:03.899 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T08:45:03.934 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T08:45:03.966 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T08:45:04.005 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T08:45:04.043 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T08:45:04.075 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T08:45:04.105 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T08:45:04.139 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T08:45:04.149 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T08:45:04.172 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T08:45:04.198 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:45:04.205 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T08:45:04.240 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T08:45:04.252 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:45:04.283 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T08:45:04.327 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T08:45:04.379 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T08:45:04.410 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T08:45:04.512 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T08:45:04.561 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T08:45:05.281 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T08:45:05.324 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T08:45:05.358 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T08:45:05.456 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T08:45:05.505 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T08:45:05.549 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T08:45:05.637 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T08:45:05.670 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T08:45:05.861 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T08:45:05.892 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T08:45:05.972 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T08:45:06.645 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T08:45:06.757 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T08:45:06.887 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:45:06.921 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:45:07.462 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:45:07.508 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:45:07.598 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:45:07.598 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T08:45:07.598 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T08:45:07.599 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T08:45:07.635 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:45:08.027 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T08:45:08.111 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T08:45:08.139 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T08:45:08.172 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T08:45:08.485 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T08:45:08.527 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:45:08.601 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:45:08.632 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T08:45:08.668 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T08:45:09.148 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T08:45:09.188 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:45:09.243 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:45:09.273 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T08:45:11.514 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:45:11.553 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:45:12.106 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:45:12.156 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:45:12.255 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:45:12.255 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T08:45:12.256 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T08:45:12.256 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:45:12.292 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:45:14.190 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:45:14.190 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /sys 2024-09-19T08:45:14.190 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /proc 2024-09-19T08:45:14.190 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /mnt 2024-09-19T08:45:14.191 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /var/tmp 2024-09-19T08:45:14.191 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /home 2024-09-19T08:45:14.191 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /root 2024-09-19T08:45:14.191 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /tmp 2024-09-19T08:45:14.191 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-19T08:45:14.370 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:45:14.386 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:45:14.386 INFO:teuthology.orchestra.run.smithi190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:45:14.386 INFO:teuthology.orchestra.run.smithi190.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T08:45:14.386 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-19T08:45:15.848 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:45:15.875 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:45:15.875 INFO:teuthology.orchestra.run.smithi190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:45:15.875 INFO:teuthology.orchestra.run.smithi190.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T08:45:15.875 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:45:15.875 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:45:15.876 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-19T08:45:16.098 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:45:16.123 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:45:16.123 INFO:teuthology.orchestra.run.smithi190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:45:16.123 INFO:teuthology.orchestra.run.smithi190.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T08:45:16.123 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:45:16.123 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:45:16.123 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-19T08:45:16.566 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:45:16.590 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:45:16.590 INFO:teuthology.orchestra.run.smithi190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:45:16.590 INFO:teuthology.orchestra.run.smithi190.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T08:45:16.590 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:45:16.590 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:45:16.590 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-19T08:45:16.696 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T08:45:16.745 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T08:45:16.800 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T08:45:16.985 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T08:45:17.033 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T08:45:17.111 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T08:45:17.199 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T08:45:17.338 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T08:45:17.384 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T08:45:17.424 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T08:45:17.460 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T08:45:17.881 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:45:17.917 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:45:17.949 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T08:45:18.012 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T08:45:18.041 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:45:19.087 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:45:19.126 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:45:19.368 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:45:19.368 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /sys 2024-09-19T08:45:19.368 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /proc 2024-09-19T08:45:19.368 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /mnt 2024-09-19T08:45:19.368 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /var/tmp 2024-09-19T08:45:19.368 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /home 2024-09-19T08:45:19.368 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /root 2024-09-19T08:45:19.368 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /tmp 2024-09-19T08:45:19.369 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T08:45:19.543 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:45:19.559 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:45:19.559 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:45:19.560 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T08:45:19.560 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T08:45:20.087 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:45:20.118 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:45:20.222 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:45:20.381 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T08:45:20.420 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:45:20.444 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:45:20.444 INFO:teuthology.orchestra.run.smithi190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:45:20.444 INFO:teuthology.orchestra.run.smithi190.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T08:45:20.445 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:45:20.445 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:45:20.445 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-19T08:45:20.496 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:45:20.508 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:45:20.605 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T08:45:20.652 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T08:45:21.030 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:45:21.057 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:45:21.057 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:45:21.057 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T08:45:21.057 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:45:21.057 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:45:21.058 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T08:45:21.289 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:45:21.312 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:45:21.312 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:45:21.313 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T08:45:21.313 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:45:21.313 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:45:21.313 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T08:45:21.575 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T08:45:21.607 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:45:21.631 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:45:21.631 INFO:teuthology.orchestra.run.smithi190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:45:21.631 INFO:teuthology.orchestra.run.smithi190.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T08:45:21.631 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:45:21.632 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:45:21.632 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-19T08:45:21.682 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:45:21.705 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:45:21.706 INFO:teuthology.orchestra.run.smithi190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:45:21.706 INFO:teuthology.orchestra.run.smithi190.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T08:45:21.706 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-19T08:45:21.748 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:45:21.766 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:45:21.771 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:45:21.772 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:45:21.772 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T08:45:21.772 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:45:21.772 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:45:21.772 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T08:45:21.790 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:45:21.790 INFO:teuthology.orchestra.run.smithi190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:45:21.790 INFO:teuthology.orchestra.run.smithi190.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T08:45:21.790 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:45:21.790 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:45:21.791 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-19T08:45:21.878 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T08:45:21.934 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T08:45:21.990 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T08:45:22.092 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:45:22.115 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:45:22.116 INFO:teuthology.orchestra.run.smithi190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:45:22.116 INFO:teuthology.orchestra.run.smithi190.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T08:45:22.116 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:45:22.116 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:45:22.116 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-19T08:45:22.182 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T08:45:22.232 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T08:45:22.310 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T08:45:22.398 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T08:45:22.553 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T08:45:22.600 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T08:45:22.640 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T08:45:22.676 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T08:45:23.080 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:45:23.108 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:45:23.140 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T08:45:23.201 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T08:45:23.232 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:45:24.222 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:45:24.222 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /sys 2024-09-19T08:45:24.222 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /proc 2024-09-19T08:45:24.222 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /mnt 2024-09-19T08:45:24.222 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /var/tmp 2024-09-19T08:45:24.222 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /home 2024-09-19T08:45:24.222 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /root 2024-09-19T08:45:24.222 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /tmp 2024-09-19T08:45:24.223 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:45:24.274 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:45:24.317 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:45:24.401 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:45:24.417 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:45:24.418 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:45:24.418 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T08:45:24.418 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:45:25.274 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:45:25.309 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:45:25.411 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:45:25.570 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T08:45:25.607 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:45:25.631 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:45:25.631 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:45:25.631 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T08:45:25.631 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:45:25.631 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:45:25.631 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T08:45:25.679 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:45:25.690 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:45:25.788 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T08:45:25.836 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T08:45:25.913 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:45:25.940 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:45:25.940 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:45:25.940 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T08:45:25.940 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:45:25.940 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:45:25.940 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:45:26.164 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:45:26.187 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:45:26.187 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:45:26.187 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T08:45:26.187 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:45:26.187 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:45:26.188 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:45:26.623 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:45:26.646 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:45:26.646 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:45:26.646 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T08:45:26.646 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:45:26.646 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:45:26.646 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:45:26.679 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T08:45:26.720 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T08:45:26.757 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T08:45:26.761 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T08:45:26.769 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T08:45:26.782 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:45:26.793 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T08:45:26.805 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:45:26.805 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:45:26.806 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T08:45:26.806 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:45:26.806 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:45:26.806 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T08:45:26.821 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T08:45:26.826 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T08:45:26.857 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:45:26.880 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:45:26.880 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:45:26.881 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T08:45:26.881 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T08:45:26.881 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T08:45:26.933 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:45:26.956 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:45:26.956 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:45:26.956 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T08:45:26.957 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:45:26.957 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:45:26.957 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T08:45:27.002 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T08:45:27.051 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T08:45:27.065 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T08:45:27.089 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T08:45:27.115 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T08:45:27.119 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T08:45:27.166 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T08:45:27.192 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T08:45:27.267 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:45:27.280 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T08:45:27.291 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:45:27.291 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:45:27.291 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T08:45:27.291 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:45:27.291 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:45:27.291 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T08:45:27.411 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T08:45:27.471 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T08:45:27.505 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T08:45:27.541 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T08:45:27.728 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:45:27.772 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:45:27.793 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:45:28.020 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:45:28.048 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:45:28.079 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T08:45:28.141 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T08:45:28.171 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:45:28.643 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T08:45:28.735 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T08:45:28.776 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T08:45:28.861 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T08:45:28.889 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T08:45:28.914 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T08:45:28.948 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T08:45:28.948 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:45:29.033 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:45:29.033 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:45:29.117 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:45:29.142 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T08:45:29.147 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:45:29.147 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:45:29.215 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:45:29.248 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:45:29.327 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:45:29.328 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:45:29.412 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:45:29.483 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:45:30.209 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:45:30.240 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:45:30.342 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:45:30.511 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T08:45:30.550 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:45:30.574 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:45:30.574 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:45:30.574 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T08:45:30.574 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:45:30.574 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:45:30.574 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:45:30.625 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:45:30.637 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:45:30.737 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T08:45:30.785 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T08:45:31.704 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T08:45:31.736 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:45:31.760 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:45:31.760 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:45:31.761 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T08:45:31.761 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:45:31.761 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:45:31.761 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:45:31.803 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:45:31.813 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T08:45:31.826 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:45:31.827 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:45:31.827 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T08:45:31.827 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:45:31.854 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T08:45:31.871 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:45:31.895 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:45:31.895 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:45:31.895 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T08:45:31.895 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:45:31.895 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:45:31.895 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:45:31.896 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T08:45:31.928 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T08:45:31.955 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T08:45:32.134 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T08:45:32.177 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T08:45:32.196 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:45:32.207 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T08:45:32.219 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:45:32.219 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:45:32.220 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T08:45:32.220 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:45:32.220 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:45:32.220 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:45:32.237 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T08:45:32.283 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T08:45:32.887 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:45:32.932 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:45:32.952 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:45:33.771 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T08:45:33.854 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T08:45:33.896 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T08:45:33.979 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T08:45:34.008 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T08:45:34.033 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T08:45:34.068 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T08:45:34.068 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:45:34.160 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:45:34.161 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:45:34.253 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:45:34.278 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T08:45:34.283 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:45:34.283 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:45:34.463 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:45:34.463 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:45:34.547 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:45:34.610 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:45:35.124 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:45:35.124 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T08:45:35.124 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T08:45:35.124 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T08:45:35.124 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T08:45:35.124 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T08:45:35.125 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T08:45:35.125 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T08:45:35.125 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:45:35.125 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:45:35.125 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:45:35.125 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T08:45:35.125 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T08:45:35.125 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:45:35.125 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T08:45:35.125 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T08:45:35.125 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T08:45:35.126 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T08:45:35.126 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T08:45:35.126 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T08:45:35.126 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T08:45:35.126 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T08:45:35.126 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T08:45:35.126 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T08:45:35.126 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T08:45:35.126 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T08:45:35.126 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T08:45:35.126 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T08:45:35.126 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T08:45:35.126 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T08:45:35.127 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T08:45:35.127 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T08:45:35.138 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T08:45:35.138 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T08:45:35.139 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T08:45:35.139 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T08:45:35.139 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T08:45:35.139 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T08:45:35.139 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T08:45:35.139 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T08:45:35.139 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T08:45:35.139 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T08:45:35.139 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T08:45:35.139 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T08:45:35.139 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T08:45:35.139 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T08:45:35.140 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T08:45:35.140 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T08:45:35.140 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T08:45:35.140 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T08:45:35.140 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T08:45:35.140 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T08:45:35.140 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T08:45:35.140 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T08:45:35.140 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T08:45:35.140 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T08:45:35.140 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T08:45:35.140 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T08:45:35.141 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T08:45:35.141 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T08:45:35.141 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T08:45:35.141 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T08:45:35.141 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T08:45:35.141 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T08:45:35.141 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T08:45:35.141 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T08:45:35.141 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T08:45:35.141 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T08:45:35.141 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T08:45:35.141 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T08:45:35.142 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T08:45:35.142 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T08:45:35.142 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T08:45:35.142 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T08:45:35.142 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T08:45:35.142 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T08:45:35.142 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T08:45:35.142 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T08:45:35.142 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T08:45:35.142 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T08:45:35.142 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T08:45:35.142 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T08:45:35.142 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T08:45:35.143 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T08:45:35.143 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T08:45:35.143 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T08:45:35.143 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T08:45:35.143 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T08:45:35.143 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T08:45:35.143 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T08:45:35.143 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T08:45:35.143 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T08:45:35.143 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T08:45:35.143 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T08:45:35.143 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T08:45:35.143 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T08:45:35.144 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T08:45:35.144 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T08:45:35.144 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T08:45:35.144 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T08:45:35.144 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T08:45:35.144 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T08:45:35.144 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T08:45:35.144 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T08:45:35.144 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T08:45:35.144 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T08:45:35.144 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T08:45:35.144 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T08:45:35.144 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T08:45:35.145 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T08:45:35.145 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T08:45:35.145 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T08:45:35.145 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T08:45:35.145 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T08:45:35.145 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T08:45:35.145 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T08:45:35.145 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T08:45:35.145 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T08:45:35.145 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T08:45:35.145 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T08:45:35.145 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T08:45:35.146 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T08:45:35.146 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T08:45:35.146 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T08:45:35.146 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T08:45:35.146 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T08:45:35.146 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T08:45:35.146 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T08:45:35.146 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T08:45:35.146 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T08:45:35.146 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T08:45:35.146 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T08:45:35.146 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T08:45:35.147 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T08:45:35.147 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T08:45:35.147 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T08:45:35.147 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T08:45:35.147 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T08:45:35.147 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T08:45:35.147 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T08:45:35.147 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T08:45:35.147 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T08:45:35.147 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T08:45:35.147 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T08:45:35.147 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T08:45:35.147 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T08:45:35.148 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T08:45:35.148 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T08:45:35.148 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T08:45:35.148 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T08:45:35.148 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T08:45:35.148 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T08:45:35.148 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T08:45:35.148 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T08:45:35.148 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T08:45:35.148 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T08:45:35.148 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T08:45:35.148 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T08:45:35.148 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T08:45:35.149 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T08:45:35.149 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T08:45:35.149 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T08:45:35.149 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T08:45:35.149 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T08:45:36.800 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T08:45:36.841 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T08:45:36.882 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T08:45:36.914 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T08:45:36.932 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T08:45:37.127 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T08:45:37.171 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T08:45:37.201 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T08:45:37.231 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T08:45:37.268 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T08:45:37.895 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:45:37.895 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-19T08:45:37.896 INFO:teuthology.orchestra.run.smithi190.stdout:Upgraded: 2024-09-19T08:45:37.896 INFO:teuthology.orchestra.run.smithi190.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T08:45:37.896 INFO:teuthology.orchestra.run.smithi190.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T08:45:37.896 INFO:teuthology.orchestra.run.smithi190.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T08:45:37.896 INFO:teuthology.orchestra.run.smithi190.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T08:45:37.896 INFO:teuthology.orchestra.run.smithi190.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:37.896 INFO:teuthology.orchestra.run.smithi190.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:37.896 INFO:teuthology.orchestra.run.smithi190.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T08:45:37.896 INFO:teuthology.orchestra.run.smithi190.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T08:45:37.896 INFO:teuthology.orchestra.run.smithi190.stdout:Installed: 2024-09-19T08:45:37.896 INFO:teuthology.orchestra.run.smithi190.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T08:45:37.897 INFO:teuthology.orchestra.run.smithi190.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T08:45:37.897 INFO:teuthology.orchestra.run.smithi190.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T08:45:37.897 INFO:teuthology.orchestra.run.smithi190.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T08:45:37.897 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:37.897 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:37.897 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:37.897 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:37.897 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:45:37.897 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:37.897 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:37.897 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:37.897 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:45:37.898 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:45:37.898 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:45:37.898 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:45:37.898 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:45:37.898 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:37.898 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:37.898 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:45:37.898 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:37.898 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:37.898 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:37.898 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:45:37.898 INFO:teuthology.orchestra.run.smithi190.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:45:37.899 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:37.899 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:37.899 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:45:37.899 INFO:teuthology.orchestra.run.smithi190.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T08:45:37.899 INFO:teuthology.orchestra.run.smithi190.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T08:45:37.899 INFO:teuthology.orchestra.run.smithi190.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T08:45:37.899 INFO:teuthology.orchestra.run.smithi190.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T08:45:37.899 INFO:teuthology.orchestra.run.smithi190.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T08:45:37.899 INFO:teuthology.orchestra.run.smithi190.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T08:45:37.899 INFO:teuthology.orchestra.run.smithi190.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T08:45:37.899 INFO:teuthology.orchestra.run.smithi190.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T08:45:37.899 INFO:teuthology.orchestra.run.smithi190.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T08:45:37.900 INFO:teuthology.orchestra.run.smithi190.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T08:45:37.900 INFO:teuthology.orchestra.run.smithi190.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T08:45:37.900 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:37.900 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:37.900 INFO:teuthology.orchestra.run.smithi190.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:37.900 INFO:teuthology.orchestra.run.smithi190.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T08:45:37.900 INFO:teuthology.orchestra.run.smithi190.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T08:45:37.900 INFO:teuthology.orchestra.run.smithi190.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T08:45:37.900 INFO:teuthology.orchestra.run.smithi190.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T08:45:37.900 INFO:teuthology.orchestra.run.smithi190.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T08:45:37.900 INFO:teuthology.orchestra.run.smithi190.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:37.900 INFO:teuthology.orchestra.run.smithi190.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:37.901 INFO:teuthology.orchestra.run.smithi190.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T08:45:37.901 INFO:teuthology.orchestra.run.smithi190.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:37.901 INFO:teuthology.orchestra.run.smithi190.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T08:45:37.901 INFO:teuthology.orchestra.run.smithi190.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T08:45:37.901 INFO:teuthology.orchestra.run.smithi190.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T08:45:37.901 INFO:teuthology.orchestra.run.smithi190.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T08:45:37.901 INFO:teuthology.orchestra.run.smithi190.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T08:45:37.901 INFO:teuthology.orchestra.run.smithi190.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T08:45:37.901 INFO:teuthology.orchestra.run.smithi190.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T08:45:37.901 INFO:teuthology.orchestra.run.smithi190.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T08:45:37.901 INFO:teuthology.orchestra.run.smithi190.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T08:45:37.901 INFO:teuthology.orchestra.run.smithi190.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T08:45:37.902 INFO:teuthology.orchestra.run.smithi190.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T08:45:37.902 INFO:teuthology.orchestra.run.smithi190.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T08:45:37.902 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T08:45:37.902 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T08:45:37.902 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T08:45:37.902 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T08:45:37.902 INFO:teuthology.orchestra.run.smithi190.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T08:45:37.902 INFO:teuthology.orchestra.run.smithi190.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T08:45:37.902 INFO:teuthology.orchestra.run.smithi190.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T08:45:37.902 INFO:teuthology.orchestra.run.smithi190.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T08:45:37.902 INFO:teuthology.orchestra.run.smithi190.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T08:45:37.902 INFO:teuthology.orchestra.run.smithi190.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T08:45:37.902 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T08:45:37.903 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:37.903 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:37.903 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:37.903 INFO:teuthology.orchestra.run.smithi190.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T08:45:37.903 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T08:45:37.903 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T08:45:37.903 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T08:45:37.903 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T08:45:37.903 INFO:teuthology.orchestra.run.smithi190.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T08:45:37.903 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T08:45:37.904 INFO:teuthology.orchestra.run.smithi190.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T08:45:37.904 INFO:teuthology.orchestra.run.smithi190.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T08:45:37.904 INFO:teuthology.orchestra.run.smithi190.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T08:45:37.904 INFO:teuthology.orchestra.run.smithi190.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T08:45:37.904 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T08:45:37.904 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T08:45:37.904 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T08:45:37.904 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T08:45:37.904 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T08:45:37.904 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T08:45:37.904 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T08:45:37.904 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T08:45:37.904 INFO:teuthology.orchestra.run.smithi190.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T08:45:37.905 INFO:teuthology.orchestra.run.smithi190.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T08:45:37.905 INFO:teuthology.orchestra.run.smithi190.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T08:45:37.905 INFO:teuthology.orchestra.run.smithi190.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T08:45:37.905 INFO:teuthology.orchestra.run.smithi190.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T08:45:37.905 INFO:teuthology.orchestra.run.smithi190.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T08:45:37.905 INFO:teuthology.orchestra.run.smithi190.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T08:45:37.905 INFO:teuthology.orchestra.run.smithi190.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T08:45:37.905 INFO:teuthology.orchestra.run.smithi190.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T08:45:37.905 INFO:teuthology.orchestra.run.smithi190.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T08:45:37.905 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T08:45:37.905 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T08:45:37.905 INFO:teuthology.orchestra.run.smithi190.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T08:45:37.905 INFO:teuthology.orchestra.run.smithi190.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T08:45:37.906 INFO:teuthology.orchestra.run.smithi190.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T08:45:37.906 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T08:45:37.906 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T08:45:37.906 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T08:45:37.906 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T08:45:37.906 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T08:45:37.906 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T08:45:37.906 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:37.906 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:37.906 INFO:teuthology.orchestra.run.smithi190.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T08:45:37.906 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T08:45:37.906 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T08:45:37.906 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:37.907 INFO:teuthology.orchestra.run.smithi190.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T08:45:37.907 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T08:45:37.907 INFO:teuthology.orchestra.run.smithi190.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T08:45:37.907 INFO:teuthology.orchestra.run.smithi190.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T08:45:37.907 INFO:teuthology.orchestra.run.smithi190.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T08:45:37.907 INFO:teuthology.orchestra.run.smithi190.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T08:45:37.907 INFO:teuthology.orchestra.run.smithi190.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T08:45:37.907 INFO:teuthology.orchestra.run.smithi190.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T08:45:37.907 INFO:teuthology.orchestra.run.smithi190.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T08:45:37.907 INFO:teuthology.orchestra.run.smithi190.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T08:45:37.908 INFO:teuthology.orchestra.run.smithi190.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T08:45:37.908 INFO:teuthology.orchestra.run.smithi190.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T08:45:37.908 INFO:teuthology.orchestra.run.smithi190.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T08:45:37.908 INFO:teuthology.orchestra.run.smithi190.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T08:45:37.908 INFO:teuthology.orchestra.run.smithi190.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T08:45:37.908 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:37.908 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:37.908 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:37.908 INFO:teuthology.orchestra.run.smithi190.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T08:45:37.908 INFO:teuthology.orchestra.run.smithi190.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T08:45:37.908 INFO:teuthology.orchestra.run.smithi190.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T08:45:37.908 INFO:teuthology.orchestra.run.smithi190.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T08:45:37.908 INFO:teuthology.orchestra.run.smithi190.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T08:45:37.909 INFO:teuthology.orchestra.run.smithi190.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T08:45:37.909 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:45:37.909 INFO:teuthology.orchestra.run.smithi190.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T08:45:37.909 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-19T08:45:37.909 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2024-09-19T08:45:37.941 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:45:37.961 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:45:38.324 DEBUG:teuthology.parallel:result is None 2024-09-19T08:45:38.796 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T08:45:38.870 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T08:45:38.918 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T08:45:39.010 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T08:45:39.040 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T08:45:39.066 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T08:45:39.108 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T08:45:39.108 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:45:39.184 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:45:39.184 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:45:39.259 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:45:39.285 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T08:45:39.289 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:45:39.289 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:45:39.470 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:45:39.470 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:45:39.554 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:45:39.627 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:45:40.525 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:45:40.525 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T08:45:40.525 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T08:45:40.525 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T08:45:40.525 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T08:45:40.525 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T08:45:40.525 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T08:45:40.525 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T08:45:40.526 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:45:40.526 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:45:40.526 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:45:40.526 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T08:45:40.526 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T08:45:40.526 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:45:40.526 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T08:45:40.526 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T08:45:40.526 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T08:45:40.526 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T08:45:40.526 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T08:45:40.526 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T08:45:40.526 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T08:45:40.527 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T08:45:40.527 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T08:45:40.527 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T08:45:40.527 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T08:45:40.527 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T08:45:40.527 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T08:45:40.527 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T08:45:40.527 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T08:45:40.539 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T08:45:40.539 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T08:45:40.539 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T08:45:40.539 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T08:45:40.539 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T08:45:40.539 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T08:45:40.539 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T08:45:40.540 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T08:45:40.540 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T08:45:40.540 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T08:45:40.540 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T08:45:40.540 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T08:45:40.540 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T08:45:40.540 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T08:45:40.540 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T08:45:40.540 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T08:45:40.540 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T08:45:40.540 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T08:45:40.540 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T08:45:40.541 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T08:45:40.541 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T08:45:40.541 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T08:45:40.541 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T08:45:40.541 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T08:45:40.541 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T08:45:40.541 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T08:45:40.541 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T08:45:40.541 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T08:45:40.541 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T08:45:40.541 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T08:45:40.541 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T08:45:40.542 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T08:45:40.542 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T08:45:40.542 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T08:45:40.542 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T08:45:40.542 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T08:45:40.542 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T08:45:40.542 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T08:45:40.542 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T08:45:40.542 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T08:45:40.542 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T08:45:40.542 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T08:45:40.542 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T08:45:40.542 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T08:45:40.543 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T08:45:40.543 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T08:45:40.543 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T08:45:40.543 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T08:45:40.543 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T08:45:40.543 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T08:45:40.543 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T08:45:40.543 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T08:45:40.543 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T08:45:40.543 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T08:45:40.543 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T08:45:40.543 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T08:45:40.544 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T08:45:40.544 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T08:45:40.544 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T08:45:40.544 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T08:45:40.544 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T08:45:40.544 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T08:45:40.544 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T08:45:40.544 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T08:45:40.544 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T08:45:40.544 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T08:45:40.544 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T08:45:40.544 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T08:45:40.545 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T08:45:40.545 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T08:45:40.545 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T08:45:40.545 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T08:45:40.545 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T08:45:40.545 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T08:45:40.545 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T08:45:40.545 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T08:45:40.545 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T08:45:40.545 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T08:45:40.545 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T08:45:40.545 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T08:45:40.545 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T08:45:40.546 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T08:45:40.546 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T08:45:40.546 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T08:45:40.546 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T08:45:40.546 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T08:45:40.546 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T08:45:40.546 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T08:45:40.546 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T08:45:40.546 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T08:45:40.546 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T08:45:40.546 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T08:45:40.546 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T08:45:40.547 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T08:45:40.547 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T08:45:40.547 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T08:45:40.547 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T08:45:40.547 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T08:45:40.547 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T08:45:40.547 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T08:45:40.547 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T08:45:40.547 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T08:45:40.547 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T08:45:40.547 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T08:45:40.547 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T08:45:40.547 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T08:45:40.548 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T08:45:40.548 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T08:45:40.548 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T08:45:40.548 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T08:45:40.548 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T08:45:40.548 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T08:45:40.548 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T08:45:40.548 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T08:45:40.548 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T08:45:40.548 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T08:45:40.548 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T08:45:40.548 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T08:45:40.548 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T08:45:40.549 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T08:45:40.549 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T08:45:40.549 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T08:45:40.549 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T08:45:40.549 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T08:45:40.549 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T08:45:40.549 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T08:45:40.549 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T08:45:40.549 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T08:45:40.549 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T08:45:40.549 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T08:45:40.549 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T08:45:40.550 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T08:45:40.550 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T08:45:40.550 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T08:45:40.550 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T08:45:43.122 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:45:43.122 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T08:45:43.122 INFO:teuthology.orchestra.run.smithi167.stdout:Upgraded: 2024-09-19T08:45:43.122 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T08:45:43.122 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T08:45:43.122 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T08:45:43.122 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T08:45:43.123 INFO:teuthology.orchestra.run.smithi167.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:43.123 INFO:teuthology.orchestra.run.smithi167.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:43.123 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T08:45:43.123 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T08:45:43.123 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-19T08:45:43.123 INFO:teuthology.orchestra.run.smithi167.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T08:45:43.123 INFO:teuthology.orchestra.run.smithi167.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T08:45:43.123 INFO:teuthology.orchestra.run.smithi167.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T08:45:43.123 INFO:teuthology.orchestra.run.smithi167.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T08:45:43.123 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:43.123 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:43.124 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:43.124 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:43.124 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:45:43.124 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:43.124 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:43.124 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:43.124 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:45:43.124 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:45:43.124 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:45:43.124 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:45:43.124 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:45:43.125 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:43.125 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:43.125 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:45:43.125 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:43.125 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:43.125 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:43.125 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:45:43.125 INFO:teuthology.orchestra.run.smithi167.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:45:43.125 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:43.125 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:43.126 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:45:43.126 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T08:45:43.126 INFO:teuthology.orchestra.run.smithi167.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T08:45:43.126 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T08:45:43.126 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T08:45:43.126 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T08:45:43.126 INFO:teuthology.orchestra.run.smithi167.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T08:45:43.126 INFO:teuthology.orchestra.run.smithi167.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T08:45:43.126 INFO:teuthology.orchestra.run.smithi167.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T08:45:43.126 INFO:teuthology.orchestra.run.smithi167.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T08:45:43.126 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T08:45:43.126 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T08:45:43.127 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:43.127 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:43.127 INFO:teuthology.orchestra.run.smithi167.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:43.127 INFO:teuthology.orchestra.run.smithi167.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T08:45:43.127 INFO:teuthology.orchestra.run.smithi167.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T08:45:43.127 INFO:teuthology.orchestra.run.smithi167.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T08:45:43.127 INFO:teuthology.orchestra.run.smithi167.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T08:45:43.127 INFO:teuthology.orchestra.run.smithi167.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T08:45:43.127 INFO:teuthology.orchestra.run.smithi167.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:43.127 INFO:teuthology.orchestra.run.smithi167.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:43.127 INFO:teuthology.orchestra.run.smithi167.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T08:45:43.127 INFO:teuthology.orchestra.run.smithi167.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:43.127 INFO:teuthology.orchestra.run.smithi167.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T08:45:43.128 INFO:teuthology.orchestra.run.smithi167.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T08:45:43.128 INFO:teuthology.orchestra.run.smithi167.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T08:45:43.128 INFO:teuthology.orchestra.run.smithi167.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T08:45:43.128 INFO:teuthology.orchestra.run.smithi167.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T08:45:43.128 INFO:teuthology.orchestra.run.smithi167.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T08:45:43.128 INFO:teuthology.orchestra.run.smithi167.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T08:45:43.128 INFO:teuthology.orchestra.run.smithi167.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T08:45:43.128 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T08:45:43.128 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T08:45:43.128 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T08:45:43.128 INFO:teuthology.orchestra.run.smithi167.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T08:45:43.128 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T08:45:43.129 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T08:45:43.129 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T08:45:43.129 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T08:45:43.129 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T08:45:43.129 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T08:45:43.129 INFO:teuthology.orchestra.run.smithi167.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T08:45:43.129 INFO:teuthology.orchestra.run.smithi167.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T08:45:43.129 INFO:teuthology.orchestra.run.smithi167.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T08:45:43.129 INFO:teuthology.orchestra.run.smithi167.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T08:45:43.130 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T08:45:43.130 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:43.130 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:43.130 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:43.130 INFO:teuthology.orchestra.run.smithi167.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T08:45:43.130 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T08:45:43.130 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T08:45:43.130 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T08:45:43.130 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T08:45:43.130 INFO:teuthology.orchestra.run.smithi167.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T08:45:43.130 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T08:45:43.130 INFO:teuthology.orchestra.run.smithi167.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T08:45:43.131 INFO:teuthology.orchestra.run.smithi167.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T08:45:43.131 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T08:45:43.131 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T08:45:43.131 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T08:45:43.131 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T08:45:43.131 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T08:45:43.131 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T08:45:43.131 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T08:45:43.131 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T08:45:43.131 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T08:45:43.131 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T08:45:43.131 INFO:teuthology.orchestra.run.smithi167.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T08:45:43.132 INFO:teuthology.orchestra.run.smithi167.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T08:45:43.132 INFO:teuthology.orchestra.run.smithi167.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T08:45:43.132 INFO:teuthology.orchestra.run.smithi167.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T08:45:43.132 INFO:teuthology.orchestra.run.smithi167.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T08:45:43.132 INFO:teuthology.orchestra.run.smithi167.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T08:45:43.132 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T08:45:43.132 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T08:45:43.132 INFO:teuthology.orchestra.run.smithi167.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T08:45:43.132 INFO:teuthology.orchestra.run.smithi167.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T08:45:43.132 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T08:45:43.132 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T08:45:43.132 INFO:teuthology.orchestra.run.smithi167.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T08:45:43.133 INFO:teuthology.orchestra.run.smithi167.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T08:45:43.133 INFO:teuthology.orchestra.run.smithi167.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T08:45:43.133 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T08:45:43.133 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T08:45:43.133 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T08:45:43.133 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T08:45:43.133 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T08:45:43.133 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T08:45:43.133 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:43.133 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:43.133 INFO:teuthology.orchestra.run.smithi167.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T08:45:43.133 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T08:45:43.133 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T08:45:43.134 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:43.134 INFO:teuthology.orchestra.run.smithi167.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T08:45:43.134 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T08:45:43.134 INFO:teuthology.orchestra.run.smithi167.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T08:45:43.134 INFO:teuthology.orchestra.run.smithi167.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T08:45:43.134 INFO:teuthology.orchestra.run.smithi167.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T08:45:43.134 INFO:teuthology.orchestra.run.smithi167.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T08:45:43.134 INFO:teuthology.orchestra.run.smithi167.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T08:45:43.134 INFO:teuthology.orchestra.run.smithi167.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T08:45:43.134 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T08:45:43.134 INFO:teuthology.orchestra.run.smithi167.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T08:45:43.134 INFO:teuthology.orchestra.run.smithi167.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T08:45:43.134 INFO:teuthology.orchestra.run.smithi167.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T08:45:43.135 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T08:45:43.135 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T08:45:43.135 INFO:teuthology.orchestra.run.smithi167.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T08:45:43.135 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:43.135 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:43.135 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:43.135 INFO:teuthology.orchestra.run.smithi167.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T08:45:43.135 INFO:teuthology.orchestra.run.smithi167.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T08:45:43.135 INFO:teuthology.orchestra.run.smithi167.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T08:45:43.135 INFO:teuthology.orchestra.run.smithi167.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T08:45:43.135 INFO:teuthology.orchestra.run.smithi167.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T08:45:43.135 INFO:teuthology.orchestra.run.smithi167.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T08:45:43.136 INFO:teuthology.orchestra.run.smithi167.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T08:45:43.136 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T08:45:43.136 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-19T08:45:43.635 DEBUG:teuthology.parallel:result is None 2024-09-19T08:45:45.103 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:45:45.103 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T08:45:45.103 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T08:45:45.103 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T08:45:45.104 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T08:45:45.104 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T08:45:45.104 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T08:45:45.104 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T08:45:45.104 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:45:45.104 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:45:45.104 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:45:45.104 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T08:45:45.104 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T08:45:45.104 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:45:45.104 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T08:45:45.104 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T08:45:45.104 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T08:45:45.105 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T08:45:45.105 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T08:45:45.105 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T08:45:45.105 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T08:45:45.105 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T08:45:45.105 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T08:45:45.105 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T08:45:45.105 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T08:45:45.105 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T08:45:45.105 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T08:45:45.105 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T08:45:45.118 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T08:45:45.118 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T08:45:45.118 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T08:45:45.118 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T08:45:45.119 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T08:45:45.119 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T08:45:45.119 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T08:45:45.119 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T08:45:45.119 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T08:45:45.119 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T08:45:45.119 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T08:45:45.119 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T08:45:45.119 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T08:45:45.119 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T08:45:45.119 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T08:45:45.119 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T08:45:45.119 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T08:45:45.120 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T08:45:45.120 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T08:45:45.120 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T08:45:45.120 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T08:45:45.120 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T08:45:45.120 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T08:45:45.120 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T08:45:45.120 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T08:45:45.120 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T08:45:45.121 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T08:45:45.121 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T08:45:45.121 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T08:45:45.121 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T08:45:45.121 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T08:45:45.121 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T08:45:45.121 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T08:45:45.121 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T08:45:45.121 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T08:45:45.121 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T08:45:45.121 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T08:45:45.121 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T08:45:45.121 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T08:45:45.122 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T08:45:45.122 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T08:45:45.122 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T08:45:45.122 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T08:45:45.122 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T08:45:45.122 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T08:45:45.122 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T08:45:45.122 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T08:45:45.122 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T08:45:45.122 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T08:45:45.122 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T08:45:45.122 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T08:45:45.123 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T08:45:45.123 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T08:45:45.123 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T08:45:45.123 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T08:45:45.123 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T08:45:45.123 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T08:45:45.123 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T08:45:45.123 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T08:45:45.123 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T08:45:45.123 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T08:45:45.123 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T08:45:45.123 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T08:45:45.123 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T08:45:45.123 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T08:45:45.124 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T08:45:45.124 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T08:45:45.124 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T08:45:45.124 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T08:45:45.124 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T08:45:45.124 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T08:45:45.124 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T08:45:45.124 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T08:45:45.124 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T08:45:45.124 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T08:45:45.124 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T08:45:45.124 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T08:45:45.124 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T08:45:45.125 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T08:45:45.125 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T08:45:45.125 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T08:45:45.125 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T08:45:45.125 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T08:45:45.125 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T08:45:45.125 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T08:45:45.125 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T08:45:45.125 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T08:45:45.125 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T08:45:45.125 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T08:45:45.125 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T08:45:45.125 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T08:45:45.126 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T08:45:45.126 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T08:45:45.126 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T08:45:45.126 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T08:45:45.126 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T08:45:45.126 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T08:45:45.126 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T08:45:45.126 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T08:45:45.126 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T08:45:45.126 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T08:45:45.126 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T08:45:45.126 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T08:45:45.126 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T08:45:45.127 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T08:45:45.127 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T08:45:45.127 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T08:45:45.127 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T08:45:45.127 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T08:45:45.127 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T08:45:45.127 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T08:45:45.127 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T08:45:45.127 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T08:45:45.127 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T08:45:45.127 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T08:45:45.127 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T08:45:45.127 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T08:45:45.127 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T08:45:45.128 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T08:45:45.128 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T08:45:45.128 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T08:45:45.128 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T08:45:45.128 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T08:45:45.128 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T08:45:45.128 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T08:45:45.128 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T08:45:45.128 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T08:45:45.128 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T08:45:45.128 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T08:45:45.128 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T08:45:45.128 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T08:45:45.129 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T08:45:45.129 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T08:45:45.129 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T08:45:45.129 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T08:45:45.129 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T08:45:47.503 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:45:47.504 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:45:47.504 INFO:teuthology.orchestra.run.smithi092.stdout:Upgraded: 2024-09-19T08:45:47.504 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T08:45:47.504 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T08:45:47.504 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T08:45:47.504 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T08:45:47.504 INFO:teuthology.orchestra.run.smithi092.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:47.504 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:47.504 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T08:45:47.504 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T08:45:47.504 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-19T08:45:47.504 INFO:teuthology.orchestra.run.smithi092.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T08:45:47.505 INFO:teuthology.orchestra.run.smithi092.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T08:45:47.505 INFO:teuthology.orchestra.run.smithi092.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T08:45:47.505 INFO:teuthology.orchestra.run.smithi092.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T08:45:47.505 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:47.505 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:47.505 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:47.505 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:47.505 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:45:47.505 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:47.505 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:47.505 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:47.505 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:45:47.505 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:45:47.506 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:45:47.506 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:45:47.506 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:45:47.506 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:47.506 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:47.506 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:45:47.506 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:47.506 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:47.506 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:47.506 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:45:47.506 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:45:47.506 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:47.506 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:47.507 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:45:47.507 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T08:45:47.507 INFO:teuthology.orchestra.run.smithi092.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T08:45:47.507 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T08:45:47.507 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T08:45:47.507 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T08:45:47.507 INFO:teuthology.orchestra.run.smithi092.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T08:45:47.507 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T08:45:47.507 INFO:teuthology.orchestra.run.smithi092.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T08:45:47.507 INFO:teuthology.orchestra.run.smithi092.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T08:45:47.508 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T08:45:47.508 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T08:45:47.508 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:47.508 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:47.508 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:47.508 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T08:45:47.508 INFO:teuthology.orchestra.run.smithi092.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T08:45:47.508 INFO:teuthology.orchestra.run.smithi092.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T08:45:47.508 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T08:45:47.508 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T08:45:47.508 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:47.508 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:47.508 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T08:45:47.509 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:47.509 INFO:teuthology.orchestra.run.smithi092.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T08:45:47.509 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T08:45:47.509 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T08:45:47.509 INFO:teuthology.orchestra.run.smithi092.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T08:45:47.509 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T08:45:47.509 INFO:teuthology.orchestra.run.smithi092.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T08:45:47.509 INFO:teuthology.orchestra.run.smithi092.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T08:45:47.509 INFO:teuthology.orchestra.run.smithi092.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T08:45:47.509 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T08:45:47.509 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T08:45:47.509 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T08:45:47.509 INFO:teuthology.orchestra.run.smithi092.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T08:45:47.510 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T08:45:47.510 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T08:45:47.510 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T08:45:47.510 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T08:45:47.510 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T08:45:47.510 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T08:45:47.510 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T08:45:47.510 INFO:teuthology.orchestra.run.smithi092.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T08:45:47.510 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T08:45:47.510 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T08:45:47.511 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T08:45:47.511 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:47.511 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:47.511 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:47.511 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T08:45:47.511 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T08:45:47.511 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T08:45:47.511 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T08:45:47.511 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T08:45:47.511 INFO:teuthology.orchestra.run.smithi092.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T08:45:47.511 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T08:45:47.511 INFO:teuthology.orchestra.run.smithi092.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T08:45:47.511 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T08:45:47.512 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T08:45:47.512 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T08:45:47.512 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T08:45:47.512 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T08:45:47.512 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T08:45:47.512 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T08:45:47.512 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T08:45:47.512 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T08:45:47.512 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T08:45:47.512 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T08:45:47.512 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T08:45:47.512 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T08:45:47.512 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T08:45:47.513 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T08:45:47.513 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T08:45:47.513 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T08:45:47.513 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T08:45:47.513 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T08:45:47.513 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T08:45:47.513 INFO:teuthology.orchestra.run.smithi092.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T08:45:47.513 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T08:45:47.513 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T08:45:47.513 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T08:45:47.513 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T08:45:47.513 INFO:teuthology.orchestra.run.smithi092.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T08:45:47.513 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T08:45:47.513 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T08:45:47.514 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T08:45:47.514 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T08:45:47.514 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T08:45:47.514 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T08:45:47.514 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:47.514 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:47.514 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T08:45:47.514 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T08:45:47.514 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T08:45:47.514 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:47.514 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T08:45:47.514 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T08:45:47.514 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T08:45:47.515 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T08:45:47.515 INFO:teuthology.orchestra.run.smithi092.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T08:45:47.515 INFO:teuthology.orchestra.run.smithi092.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T08:45:47.515 INFO:teuthology.orchestra.run.smithi092.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T08:45:47.515 INFO:teuthology.orchestra.run.smithi092.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T08:45:47.515 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T08:45:47.515 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T08:45:47.515 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T08:45:47.515 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T08:45:47.515 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T08:45:47.515 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T08:45:47.515 INFO:teuthology.orchestra.run.smithi092.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T08:45:47.515 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:47.515 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:47.516 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:45:47.516 INFO:teuthology.orchestra.run.smithi092.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T08:45:47.516 INFO:teuthology.orchestra.run.smithi092.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T08:45:47.516 INFO:teuthology.orchestra.run.smithi092.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T08:45:47.516 INFO:teuthology.orchestra.run.smithi092.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T08:45:47.516 INFO:teuthology.orchestra.run.smithi092.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T08:45:47.516 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T08:45:47.517 INFO:teuthology.orchestra.run.smithi092.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T08:45:47.517 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:45:47.517 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-19T08:45:47.920 DEBUG:teuthology.parallel:result is None 2024-09-19T08:45:47.921 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:45:48.075 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T08:45:48.097 INFO:teuthology.orchestra.run.smithi092.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T08:45:48.098 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T08:45:48.098 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T08:45:48.099 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:45:48.244 DEBUG:teuthology.orchestra.run.smithi167:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T08:45:48.271 INFO:teuthology.orchestra.run.smithi167.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T08:45:48.271 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T08:45:48.271 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T08:45:48.273 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:45:48.411 DEBUG:teuthology.orchestra.run.smithi190:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T08:45:48.437 INFO:teuthology.orchestra.run.smithi190.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T08:45:48.437 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T08:45:48.437 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T08:45:48.439 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T08:45:48.440 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-19T08:45:48.440 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T08:45:48.467 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-19T08:45:48.468 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T08:45:48.501 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-19T08:45:48.501 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T08:45:48.532 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T08:45:48.532 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-19T08:45:48.533 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T08:45:48.558 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T08:45:48.623 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-19T08:45:48.623 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T08:45:48.654 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T08:45:48.725 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-19T08:45:48.725 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T08:45:48.753 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T08:45:48.822 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T08:45:48.822 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-19T08:45:48.822 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T08:45:48.847 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T08:45:48.912 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-19T08:45:48.912 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T08:45:48.941 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T08:45:49.010 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-19T08:45:49.010 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T08:45:49.040 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T08:45:49.109 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T08:45:49.110 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-19T08:45:49.110 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T08:45:49.141 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T08:45:49.206 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-19T08:45:49.206 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T08:45:49.235 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T08:45:49.304 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-19T08:45:49.304 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T08:45:49.334 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T08:45:49.404 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-19T08:45:49.504 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 1, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-19T08:45:49.504 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:45:49.505 INFO:tasks.cephadm:Cluster fsid is 91ff74f2-7663-11ef-bceb-c7b262605968 2024-09-19T08:45:49.505 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-19T08:45:49.505 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.92', 'mon.b': '172.21.15.167', 'mon.c': '172.21.15.190'} 2024-09-19T08:45:49.505 INFO:tasks.cephadm:First mon is mon.a on smithi092 2024-09-19T08:45:49.505 INFO:tasks.cephadm:First mgr is x 2024-09-19T08:45:49.506 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-19T08:45:49.506 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname $(hostname -s) 2024-09-19T08:45:49.531 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname $(hostname -s) 2024-09-19T08:45:49.562 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname $(hostname -s) 2024-09-19T08:45:49.594 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-19T08:45:49.594 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:45:49.753 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56106/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-361-g2f599a46', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-361.g2f599a46'}, 'url': 'https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-18 17:52:24.287651', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-19T08:45:49.892 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref squid, sha1 2f599a46ad10e37c929e5c43da2f6907ddcd1961 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:45:49.895 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T08:45:49.895 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T08:45:49.895 DEBUG:teuthology.orchestra.run.smithi092:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T08:45:50.275 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 08:45 /home/ubuntu/cephtest/cephadm 2024-09-19T08:45:50.276 DEBUG:teuthology.orchestra.run.smithi167:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T08:45:50.661 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 08:45 /home/ubuntu/cephtest/cephadm 2024-09-19T08:45:50.662 DEBUG:teuthology.orchestra.run.smithi190:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T08:45:51.062 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 08:45 /home/ubuntu/cephtest/cephadm 2024-09-19T08:45:51.062 DEBUG:teuthology.orchestra.run.smithi092:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T08:45:51.082 DEBUG:teuthology.orchestra.run.smithi167:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T08:45:51.102 DEBUG:teuthology.orchestra.run.smithi190:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T08:45:51.139 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 on all hosts... 2024-09-19T08:45:51.139 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T08:45:51.142 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T08:45:51.145 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T08:45:52.667 INFO:teuthology.orchestra.run.smithi190.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T08:45:52.716 INFO:teuthology.orchestra.run.smithi092.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T08:45:52.780 INFO:teuthology.orchestra.run.smithi167.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T08:46:36.772 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T08:46:36.773 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T08:46:36.773 INFO:teuthology.orchestra.run.smithi092.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T08:46:36.773 INFO:teuthology.orchestra.run.smithi092.stdout: "repo_digests": [ 2024-09-19T08:46:36.773 INFO:teuthology.orchestra.run.smithi092.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T08:46:36.773 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-09-19T08:46:36.773 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T08:46:44.280 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-19T08:46:44.281 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T08:46:44.281 INFO:teuthology.orchestra.run.smithi167.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T08:46:44.281 INFO:teuthology.orchestra.run.smithi167.stdout: "repo_digests": [ 2024-09-19T08:46:44.281 INFO:teuthology.orchestra.run.smithi167.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T08:46:44.281 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-19T08:46:44.281 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-19T08:46:53.891 INFO:teuthology.orchestra.run.smithi190.stdout:{ 2024-09-19T08:46:53.892 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T08:46:53.892 INFO:teuthology.orchestra.run.smithi190.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T08:46:53.892 INFO:teuthology.orchestra.run.smithi190.stdout: "repo_digests": [ 2024-09-19T08:46:53.892 INFO:teuthology.orchestra.run.smithi190.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T08:46:53.893 INFO:teuthology.orchestra.run.smithi190.stdout: ] 2024-09-19T08:46:53.893 INFO:teuthology.orchestra.run.smithi190.stdout:} 2024-09-19T08:46:53.918 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /etc/ceph 2024-09-19T08:46:53.951 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /etc/ceph 2024-09-19T08:46:53.986 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /etc/ceph 2024-09-19T08:46:54.015 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 777 /etc/ceph 2024-09-19T08:46:54.042 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 777 /etc/ceph 2024-09-19T08:46:54.070 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 777 /etc/ceph 2024-09-19T08:46:54.095 INFO:tasks.cephadm:Writing seed config... 2024-09-19T08:46:54.097 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-19T08:46:54.097 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-19T08:46:54.097 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-19T08:46:54.097 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-19T08:46:54.097 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-19T08:46:54.097 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-19T08:46:54.098 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-19T08:46:54.098 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-19T08:46:54.098 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-19T08:46:54.098 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-19T08:46:54.098 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-19T08:46:54.098 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-19T08:46:54.098 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-19T08:46:54.098 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-19T08:46:54.098 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-19T08:46:54.099 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-19T08:46:54.099 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-19T08:46:54.099 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-19T08:46:54.099 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-19T08:46:54.099 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-19T08:46:54.099 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-19T08:46:54.099 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-19T08:46:54.099 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-19T08:46:54.100 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-19T08:46:54.100 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-19T08:46:54.100 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-19T08:46:54.100 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-19T08:46:54.100 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-19T08:46:54.100 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-19T08:46:54.100 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-19T08:46:54.101 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-19T08:46:54.101 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-19T08:46:54.101 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-19T08:46:54.101 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-19T08:46:54.101 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-19T08:46:54.101 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-19T08:46:54.101 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-19T08:46:54.102 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-19T08:46:54.102 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-19T08:46:54.102 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-19T08:46:54.102 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-19T08:46:54.102 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-19T08:46:54.102 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-19T08:46:54.103 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-19T08:46:54.103 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-19T08:46:54.103 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-19T08:46:54.103 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-19T08:46:54.103 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-19T08:46:54.105 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-19T08:46:54.105 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-19T08:46:54.122 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 91ff74f2-7663-11ef-bceb-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-19T08:46:54.122 DEBUG:teuthology.orchestra.run.smithi092:mon.a> sudo journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mon.a.service 2024-09-19T08:46:54.165 DEBUG:teuthology.orchestra.run.smithi092:mgr.x> sudo journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mgr.x.service 2024-09-19T08:46:54.207 INFO:tasks.cephadm:Bootstrapping... 2024-09-19T08:46:54.208 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 -v bootstrap --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.92 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:46:54.410 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:46:54.410 INFO:teuthology.orchestra.run.smithi092.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961', '-v', 'bootstrap', '--fsid', '91ff74f2-7663-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.92', '--skip-admin-label'] 2024-09-19T08:46:54.410 INFO:teuthology.orchestra.run.smithi092.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-19T08:46:54.411 INFO:teuthology.orchestra.run.smithi092.stdout:Verifying podman|docker is present... 2024-09-19T08:46:54.435 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stdout 5.2.2 2024-09-19T08:46:54.436 INFO:teuthology.orchestra.run.smithi092.stdout:Verifying lvm2 is present... 2024-09-19T08:46:54.436 INFO:teuthology.orchestra.run.smithi092.stdout:Verifying time synchronization is in place... 2024-09-19T08:46:54.443 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T08:46:54.443 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T08:46:54.449 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T08:46:54.449 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout inactive 2024-09-19T08:46:54.456 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout enabled 2024-09-19T08:46:54.462 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout active 2024-09-19T08:46:54.463 INFO:teuthology.orchestra.run.smithi092.stdout:Unit chronyd.service is enabled and running 2024-09-19T08:46:54.463 INFO:teuthology.orchestra.run.smithi092.stdout:Repeating the final host check... 2024-09-19T08:46:54.490 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stdout 5.2.2 2024-09-19T08:46:54.490 INFO:teuthology.orchestra.run.smithi092.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-19T08:46:54.490 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl is present 2024-09-19T08:46:54.491 INFO:teuthology.orchestra.run.smithi092.stdout:lvcreate is present 2024-09-19T08:46:54.497 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T08:46:54.497 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T08:46:54.503 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T08:46:54.503 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout inactive 2024-09-19T08:46:54.510 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout enabled 2024-09-19T08:46:54.516 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout active 2024-09-19T08:46:54.517 INFO:teuthology.orchestra.run.smithi092.stdout:Unit chronyd.service is enabled and running 2024-09-19T08:46:54.517 INFO:teuthology.orchestra.run.smithi092.stdout:Host looks OK 2024-09-19T08:46:54.517 INFO:teuthology.orchestra.run.smithi092.stdout:Cluster fsid: 91ff74f2-7663-11ef-bceb-c7b262605968 2024-09-19T08:46:54.517 INFO:teuthology.orchestra.run.smithi092.stdout:Acquiring lock 140718445790208 on /run/cephadm/91ff74f2-7663-11ef-bceb-c7b262605968.lock 2024-09-19T08:46:54.517 INFO:teuthology.orchestra.run.smithi092.stdout:Lock 140718445790208 acquired on /run/cephadm/91ff74f2-7663-11ef-bceb-c7b262605968.lock 2024-09-19T08:46:54.517 INFO:teuthology.orchestra.run.smithi092.stdout:Verifying IP 172.21.15.92 port 3300 ... 2024-09-19T08:46:54.518 INFO:teuthology.orchestra.run.smithi092.stdout:Verifying IP 172.21.15.92 port 6789 ... 2024-09-19T08:46:54.518 INFO:teuthology.orchestra.run.smithi092.stdout:Base mon IP(s) is [172.21.15.92:3300, 172.21.15.92:6789], mon addrv is [v2:172.21.15.92:3300,v1:172.21.15.92:6789] 2024-09-19T08:46:54.521 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.92 metric 100 2024-09-19T08:46:54.521 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.92 metric 100 2024-09-19T08:46:54.523 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-19T08:46:54.523 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-19T08:46:54.524 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-19T08:46:54.526 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-19T08:46:54.526 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-19T08:46:54.526 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T08:46:54.526 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-19T08:46:54.526 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:cd45/64 scope link noprefixroute 2024-09-19T08:46:54.526 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T08:46:54.527 INFO:teuthology.orchestra.run.smithi092.stdout:Mon IP `172.21.15.92` is in CIDR network `172.21.0.0/20` 2024-09-19T08:46:54.527 INFO:teuthology.orchestra.run.smithi092.stdout:Mon IP `172.21.15.92` is in CIDR network `172.21.0.0/20` 2024-09-19T08:46:54.527 INFO:teuthology.orchestra.run.smithi092.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-19T08:46:54.527 INFO:teuthology.orchestra.run.smithi092.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-19T08:46:54.528 INFO:teuthology.orchestra.run.smithi092.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T08:46:54.997 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stdout d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T08:46:54.997 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T08:46:54.997 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stderr Getting image source signatures 2024-09-19T08:46:54.997 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stderr Copying blob sha256:c4221751d16d26d2a4b7031ebd71ecffffff13c8cf7401cf95ce80dab3b6d67a 2024-09-19T08:46:54.997 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-19T08:46:54.997 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stderr Copying config sha256:d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T08:46:54.997 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-19T08:46:55.969 INFO:teuthology.orchestra.run.smithi092.stdout:ceph: stdout ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T08:46:55.969 INFO:teuthology.orchestra.run.smithi092.stdout:Ceph version: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T08:46:55.969 INFO:teuthology.orchestra.run.smithi092.stdout:Extracting ceph user uid/gid from container image... 2024-09-19T08:46:56.850 INFO:teuthology.orchestra.run.smithi092.stdout:stat: stdout 167 167 2024-09-19T08:46:56.850 INFO:teuthology.orchestra.run.smithi092.stdout:Creating initial keys... 2024-09-19T08:47:02.410 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph-authtool: stdout AQAC5etmkJLmAhAAWRXdiGKhMcYYtvkZTVlrVQ== 2024-09-19T08:47:03.432 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph-authtool: stdout AQAG5etmPHrHKRAA8kEcj3kHY0ZTfRjeuwOLhQ== 2024-09-19T08:47:04.337 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph-authtool: stdout AQAH5etm6S6nKxAA36jcYdlNEX0L7gPIVhEsbA== 2024-09-19T08:47:04.338 INFO:teuthology.orchestra.run.smithi092.stdout:Creating initial monmap... 2024-09-19T08:47:05.219 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T08:47:05.219 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-19T08:47:05.219 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 91ff74f2-7663-11ef-bceb-c7b262605968 2024-09-19T08:47:05.220 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T08:47:05.220 INFO:teuthology.orchestra.run.smithi092.stdout:monmaptool for a [v2:172.21.15.92:3300,v1:172.21.15.92:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T08:47:05.220 INFO:teuthology.orchestra.run.smithi092.stdout:setting min_mon_release = quincy 2024-09-19T08:47:05.220 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/monmaptool: set fsid to 91ff74f2-7663-11ef-bceb-c7b262605968 2024-09-19T08:47:05.220 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T08:47:05.220 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:47:05.220 INFO:teuthology.orchestra.run.smithi092.stdout:Creating mon... 2024-09-19T08:47:06.109 INFO:teuthology.orchestra.run.smithi092.stdout:create mon.a on 2024-09-19T08:47:06.311 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-19T08:47:06.475 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-19T08:47:06.640 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-91ff74f2-7663-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-91ff74f2-7663-11ef-bceb-c7b262605968.target. 2024-09-19T08:47:06.641 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-91ff74f2-7663-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-91ff74f2-7663-11ef-bceb-c7b262605968.target. 2024-09-19T08:47:06.915 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mon.a 2024-09-19T08:47:06.915 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Failed to reset failed state of unit ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-19T08:47:07.105 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-91ff74f2-7663-11ef-bceb-c7b262605968.target.wants/ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-91ff74f2-7663-11ef-bceb-c7b262605968@.service. 2024-09-19T08:47:07.163 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:07 smithi092 systemd[1]: Starting Ceph mon.a for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T08:47:07.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:07 smithi092 podman[31024]: 2024-09-19 08:47:07.258160304 +0000 UTC m=+0.016051273 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:47:08.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:07 smithi092 podman[31024]: 2024-09-19 08:47:07.918996651 +0000 UTC m=+0.676887649 container create 7fa7ce9e66516927ac25f504a518e2e3d3feedd390558eb5036c682244030ba5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-19T08:47:08.193 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T08:47:08.193 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout disabled 2024-09-19T08:47:08.200 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T08:47:08.200 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout inactive 2024-09-19T08:47:08.200 INFO:teuthology.orchestra.run.smithi092.stdout:firewalld.service is not enabled 2024-09-19T08:47:08.200 INFO:teuthology.orchestra.run.smithi092.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T08:47:08.200 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for mon to start... 2024-09-19T08:47:08.200 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for mon... 2024-09-19T08:47:08.322 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:08 smithi092 podman[31024]: 2024-09-19 08:47:08.121197261 +0000 UTC m=+0.879088227 container init 7fa7ce9e66516927ac25f504a518e2e3d3feedd390558eb5036c682244030ba5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mon-a, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:47:08.322 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:08 smithi092 podman[31024]: 2024-09-19 08:47:08.124397106 +0000 UTC m=+0.882288069 container start 7fa7ce9e66516927ac25f504a518e2e3d3feedd390558eb5036c682244030ba5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:47:08.322 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:08 smithi092 ceph-mon[31043]: mkfs 91ff74f2-7663-11ef-bceb-c7b262605968 2024-09-19T08:47:08.322 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:08 smithi092 ceph-mon[31043]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T08:47:08.322 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:08 smithi092 bash[31024]: 7fa7ce9e66516927ac25f504a518e2e3d3feedd390558eb5036c682244030ba5 2024-09-19T08:47:08.322 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:08 smithi092 systemd[1]: Started Ceph mon.a for 91ff74f2-7663-11ef-bceb-c7b262605968. 2024-09-19T08:47:09.252 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:09 smithi092 ceph-mon[31043]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T08:47:09.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:09 smithi092 ceph-mon[31043]: monmap epoch 1 2024-09-19T08:47:09.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:09 smithi092 ceph-mon[31043]: fsid 91ff74f2-7663-11ef-bceb-c7b262605968 2024-09-19T08:47:09.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:09 smithi092 ceph-mon[31043]: last_changed 2024-09-19T08:47:04.662007+0000 2024-09-19T08:47:09.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:09 smithi092 ceph-mon[31043]: created 2024-09-19T08:47:04.662007+0000 2024-09-19T08:47:09.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:09 smithi092 ceph-mon[31043]: min_mon_release 19 (squid) 2024-09-19T08:47:09.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:09 smithi092 ceph-mon[31043]: election_strategy: 1 2024-09-19T08:47:09.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:09 smithi092 ceph-mon[31043]: 0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-09-19T08:47:09.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:09 smithi092 ceph-mon[31043]: fsmap 2024-09-19T08:47:09.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:09 smithi092 ceph-mon[31043]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T08:47:09.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:09 smithi092 ceph-mon[31043]: mgrmap e1: no daemons active 2024-09-19T08:47:09.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:09 smithi092 ceph-mon[31043]: from='client.? 172.21.15.92:0/1398561051' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-19T08:47:09.260 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout cluster: 2024-09-19T08:47:09.260 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout id: 91ff74f2-7663-11ef-bceb-c7b262605968 2024-09-19T08:47:09.260 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-19T08:47:09.260 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-09-19T08:47:09.260 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout services: 2024-09-19T08:47:09.260 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.531024s) 2024-09-19T08:47:09.261 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-19T08:47:09.261 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-19T08:47:09.261 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-09-19T08:47:09.261 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout data: 2024-09-19T08:47:09.261 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-19T08:47:09.261 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-19T08:47:09.261 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-19T08:47:09.261 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout pgs: 2024-09-19T08:47:09.261 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-09-19T08:47:09.261 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.624+0000 7f5e19384640 1 Processor -- start 2024-09-19T08:47:09.261 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.625+0000 7f5e19384640 1 -- start start 2024-09-19T08:47:09.262 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.625+0000 7f5e19384640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e141076b0 0x7f5e14107ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:09.262 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.625+0000 7f5e19384640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5e14108080 con 0x7f5e141076b0 2024-09-19T08:47:09.262 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.625+0000 7f5e12ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e141076b0 0x7f5e14107ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:09.262 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.625+0000 7f5e12ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e141076b0 0x7f5e14107ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52524/0 (socket says 172.21.15.92:52524) 2024-09-19T08:47:09.262 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.625+0000 7f5e12ffd640 1 -- 172.21.15.92:0/124578473 learned_addr learned my addr 172.21.15.92:0/124578473 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:09.262 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.625+0000 7f5e12ffd640 1 -- 172.21.15.92:0/124578473 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e141088b0 con 0x7f5e141076b0 2024-09-19T08:47:09.262 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.627+0000 7f5e12ffd640 1 --2- 172.21.15.92:0/124578473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e141076b0 0x7f5e14107ab0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5e04009820 tx=0x7f5e0402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f575a223a5fcd6ad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:09.262 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.627+0000 7f5e11ffb640 1 -- 172.21.15.92:0/124578473 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e04037070 con 0x7f5e141076b0 2024-09-19T08:47:09.262 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.628+0000 7f5e11ffb640 1 -- 172.21.15.92:0/124578473 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e04032440 con 0x7f5e141076b0 2024-09-19T08:47:09.262 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.628+0000 7f5e11ffb640 1 -- 172.21.15.92:0/124578473 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e04032740 con 0x7f5e141076b0 2024-09-19T08:47:09.262 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.628+0000 7f5e19384640 1 -- 172.21.15.92:0/124578473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e141076b0 msgr2=0x7f5e14107ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:09.263 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.628+0000 7f5e19384640 1 --2- 172.21.15.92:0/124578473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e141076b0 0x7f5e14107ab0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5e04009820 tx=0x7f5e0402a270 comp rx=0 tx=0).stop 2024-09-19T08:47:09.263 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.628+0000 7f5e19384640 1 -- 172.21.15.92:0/124578473 shutdown_connections 2024-09-19T08:47:09.263 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.628+0000 7f5e19384640 1 --2- 172.21.15.92:0/124578473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e141076b0 0x7f5e14107ab0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:09.263 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.628+0000 7f5e19384640 1 -- 172.21.15.92:0/124578473 >> 172.21.15.92:0/124578473 conn(0x7f5e14102e80 msgr2=0x7f5e141052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:09.263 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.628+0000 7f5e19384640 1 -- 172.21.15.92:0/124578473 shutdown_connections 2024-09-19T08:47:09.263 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.628+0000 7f5e19384640 1 -- 172.21.15.92:0/124578473 wait complete. 2024-09-19T08:47:09.263 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.629+0000 7f5e19384640 1 Processor -- start 2024-09-19T08:47:09.263 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.629+0000 7f5e19384640 1 -- start start 2024-09-19T08:47:09.263 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.629+0000 7f5e19384640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e141076b0 0x7f5e1419ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:09.263 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.629+0000 7f5e19384640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5e14108de0 con 0x7f5e141076b0 2024-09-19T08:47:09.263 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.629+0000 7f5e12ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e141076b0 0x7f5e1419ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:09.263 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.629+0000 7f5e12ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e141076b0 0x7f5e1419ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52538/0 (socket says 172.21.15.92:52538) 2024-09-19T08:47:09.264 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.629+0000 7f5e12ffd640 1 -- 172.21.15.92:0/1398561051 learned_addr learned my addr 172.21.15.92:0/1398561051 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:09.264 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.630+0000 7f5e12ffd640 1 -- 172.21.15.92:0/1398561051 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e1419b380 con 0x7f5e141076b0 2024-09-19T08:47:09.264 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.630+0000 7f5e12ffd640 1 --2- 172.21.15.92:0/1398561051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e141076b0 0x7f5e1419ae40 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5e040090b0 tx=0x7f5e040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:09.264 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.630+0000 7f5dfbfff640 1 -- 172.21.15.92:0/1398561051 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e04041070 con 0x7f5e141076b0 2024-09-19T08:47:09.264 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.630+0000 7f5dfbfff640 1 -- 172.21.15.92:0/1398561051 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e0403c7a0 con 0x7f5e141076b0 2024-09-19T08:47:09.264 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.630+0000 7f5e19384640 1 -- 172.21.15.92:0/1398561051 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e1419b610 con 0x7f5e141076b0 2024-09-19T08:47:09.264 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.630+0000 7f5dfbfff640 1 -- 172.21.15.92:0/1398561051 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e04037040 con 0x7f5e141076b0 2024-09-19T08:47:09.264 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.630+0000 7f5e19384640 1 -- 172.21.15.92:0/1398561051 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e1419e300 con 0x7f5e141076b0 2024-09-19T08:47:09.264 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.630+0000 7f5dfbfff640 1 -- 172.21.15.92:0/1398561051 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5e04044070 con 0x7f5e141076b0 2024-09-19T08:47:09.264 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.630+0000 7f5dfbfff640 1 -- 172.21.15.92:0/1398561051 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5e0403d3f0 con 0x7f5e141076b0 2024-09-19T08:47:09.264 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.631+0000 7f5e19384640 1 -- 172.21.15.92:0/1398561051 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e14109430 con 0x7f5e141076b0 2024-09-19T08:47:09.265 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.633+0000 7f5dfbfff640 1 -- 172.21.15.92:0/1398561051 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f5e04046450 con 0x7f5e141076b0 2024-09-19T08:47:09.265 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.691+0000 7f5e19384640 1 -- 172.21.15.92:0/1398561051 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f5e1419e860 con 0x7f5e141076b0 2024-09-19T08:47:09.265 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.691+0000 7f5dfbfff640 1 -- 172.21.15.92:0/1398561051 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f5e04046630 con 0x7f5e141076b0 2024-09-19T08:47:09.265 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.692+0000 7f5e19384640 1 -- 172.21.15.92:0/1398561051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e141076b0 msgr2=0x7f5e1419ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:09.265 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.692+0000 7f5e19384640 1 --2- 172.21.15.92:0/1398561051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e141076b0 0x7f5e1419ae40 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5e040090b0 tx=0x7f5e040046c0 comp rx=0 tx=0).stop 2024-09-19T08:47:09.265 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.692+0000 7f5e19384640 1 -- 172.21.15.92:0/1398561051 shutdown_connections 2024-09-19T08:47:09.265 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.692+0000 7f5e19384640 1 --2- 172.21.15.92:0/1398561051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e141076b0 0x7f5e1419ae40 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:09.265 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.692+0000 7f5e19384640 1 -- 172.21.15.92:0/1398561051 >> 172.21.15.92:0/1398561051 conn(0x7f5e14102e80 msgr2=0x7f5e1418f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:09.265 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.692+0000 7f5e19384640 1 -- 172.21.15.92:0/1398561051 shutdown_connections 2024-09-19T08:47:09.265 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:08.692+0000 7f5e19384640 1 -- 172.21.15.92:0/1398561051 wait complete. 2024-09-19T08:47:09.265 INFO:teuthology.orchestra.run.smithi092.stdout:mon is available 2024-09-19T08:47:09.265 INFO:teuthology.orchestra.run.smithi092.stdout:Assimilating anything we can from ceph.conf... 2024-09-19T08:47:10.351 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-09-19T08:47:10.351 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T08:47:10.351 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout fsid = 91ff74f2-7663-11ef-bceb-c7b262605968 2024-09-19T08:47:10.352 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.92:3300,v1:172.21.15.92:6789] 2024-09-19T08:47:10.352 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T08:47:10.352 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T08:47:10.352 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T08:47:10.352 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T08:47:10.352 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-09-19T08:47:10.352 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T08:47:10.352 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T08:47:10.352 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-09-19T08:47:10.352 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T08:47:10.352 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T08:47:10.352 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T08:47:10.352 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T08:47:10.353 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T08:47:10.353 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T08:47:10.353 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.666+0000 7f8bd3e37640 1 Processor -- start 2024-09-19T08:47:10.353 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.666+0000 7f8bd3e37640 1 -- start start 2024-09-19T08:47:10.353 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.667+0000 7f8bd3e37640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bcc1065c0 0x7f8bcc1069c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:10.353 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.667+0000 7f8bd3e37640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8bcc106f90 con 0x7f8bcc1065c0 2024-09-19T08:47:10.353 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.667+0000 7f8bd1bd3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bcc1065c0 0x7f8bcc1069c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:10.353 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.667+0000 7f8bd1bd3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bcc1065c0 0x7f8bcc1069c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52540/0 (socket says 172.21.15.92:52540) 2024-09-19T08:47:10.353 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.667+0000 7f8bd1bd3640 1 -- 172.21.15.92:0/2940085056 learned_addr learned my addr 172.21.15.92:0/2940085056 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:10.353 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.667+0000 7f8bd1bd3640 1 -- 172.21.15.92:0/2940085056 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bcc1077c0 con 0x7f8bcc1065c0 2024-09-19T08:47:10.353 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.668+0000 7f8bd1bd3640 1 --2- 172.21.15.92:0/2940085056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bcc1065c0 0x7f8bcc1069c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0009820 tx=0x7f8bc002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f89b046a3015976e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:10.353 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.668+0000 7f8bd0bd1640 1 -- 172.21.15.92:0/2940085056 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bc0037070 con 0x7f8bcc1065c0 2024-09-19T08:47:10.354 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.668+0000 7f8bd0bd1640 1 -- 172.21.15.92:0/2940085056 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bc0032440 con 0x7f8bcc1065c0 2024-09-19T08:47:10.354 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.668+0000 7f8bd0bd1640 1 -- 172.21.15.92:0/2940085056 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bc0032740 con 0x7f8bcc1065c0 2024-09-19T08:47:10.354 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.669+0000 7f8bd3e37640 1 -- 172.21.15.92:0/2940085056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bcc1065c0 msgr2=0x7f8bcc1069c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:10.354 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.669+0000 7f8bd3e37640 1 --2- 172.21.15.92:0/2940085056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bcc1065c0 0x7f8bcc1069c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0009820 tx=0x7f8bc002a270 comp rx=0 tx=0).stop 2024-09-19T08:47:10.354 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.669+0000 7f8bd3e37640 1 -- 172.21.15.92:0/2940085056 shutdown_connections 2024-09-19T08:47:10.354 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.669+0000 7f8bd3e37640 1 --2- 172.21.15.92:0/2940085056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bcc1065c0 0x7f8bcc1069c0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:10.354 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.669+0000 7f8bd3e37640 1 -- 172.21.15.92:0/2940085056 >> 172.21.15.92:0/2940085056 conn(0x7f8bcc101d70 msgr2=0x7f8bcc104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:10.354 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.669+0000 7f8bd3e37640 1 -- 172.21.15.92:0/2940085056 shutdown_connections 2024-09-19T08:47:10.354 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.669+0000 7f8bd3e37640 1 -- 172.21.15.92:0/2940085056 wait complete. 2024-09-19T08:47:10.354 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.669+0000 7f8bd3e37640 1 Processor -- start 2024-09-19T08:47:10.354 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.669+0000 7f8bd3e37640 1 -- start start 2024-09-19T08:47:10.354 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.669+0000 7f8bd3e37640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bcc1065c0 0x7f8bcc07ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:10.354 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.670+0000 7f8bd3e37640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8bcc107cf0 con 0x7f8bcc1065c0 2024-09-19T08:47:10.355 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.670+0000 7f8bd1bd3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bcc1065c0 0x7f8bcc07ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:10.355 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.670+0000 7f8bd1bd3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bcc1065c0 0x7f8bcc07ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52550/0 (socket says 172.21.15.92:52550) 2024-09-19T08:47:10.355 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.670+0000 7f8bd1bd3640 1 -- 172.21.15.92:0/3667953117 learned_addr learned my addr 172.21.15.92:0/3667953117 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:10.355 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.670+0000 7f8bd1bd3640 1 -- 172.21.15.92:0/3667953117 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bcc19db60 con 0x7f8bcc1065c0 2024-09-19T08:47:10.355 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.670+0000 7f8bd1bd3640 1 --2- 172.21.15.92:0/3667953117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bcc1065c0 0x7f8bcc07ba70 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f8bc00090b0 tx=0x7f8bc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:10.355 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.670+0000 7f8bbeffd640 1 -- 172.21.15.92:0/3667953117 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bc0041070 con 0x7f8bcc1065c0 2024-09-19T08:47:10.355 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.670+0000 7f8bbeffd640 1 -- 172.21.15.92:0/3667953117 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bc003c7a0 con 0x7f8bcc1065c0 2024-09-19T08:47:10.355 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.670+0000 7f8bd3e37640 1 -- 172.21.15.92:0/3667953117 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bcc19dd30 con 0x7f8bcc1065c0 2024-09-19T08:47:10.355 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.670+0000 7f8bbeffd640 1 -- 172.21.15.92:0/3667953117 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bc0037040 con 0x7f8bcc1065c0 2024-09-19T08:47:10.355 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.670+0000 7f8bd3e37640 1 -- 172.21.15.92:0/3667953117 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bcc19e0d0 con 0x7f8bcc1065c0 2024-09-19T08:47:10.355 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.670+0000 7f8bbeffd640 1 -- 172.21.15.92:0/3667953117 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8bc0044070 con 0x7f8bcc1065c0 2024-09-19T08:47:10.355 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.670+0000 7f8bbeffd640 1 -- 172.21.15.92:0/3667953117 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8bc003d3f0 con 0x7f8bcc1065c0 2024-09-19T08:47:10.356 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.671+0000 7f8bd3e37640 1 -- 172.21.15.92:0/3667953117 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bcc108340 con 0x7f8bcc1065c0 2024-09-19T08:47:10.356 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.673+0000 7f8bbeffd640 1 -- 172.21.15.92:0/3667953117 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f8bc0046450 con 0x7f8bcc1065c0 2024-09-19T08:47:10.356 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.730+0000 7f8bd3e37640 1 -- 172.21.15.92:0/3667953117 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f8bcc19e3b0 con 0x7f8bcc1065c0 2024-09-19T08:47:10.356 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.733+0000 7f8bbeffd640 1 -- 172.21.15.92:0/3667953117 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7f8bc0046630 con 0x7f8bcc1065c0 2024-09-19T08:47:10.356 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.734+0000 7f8bbeffd640 1 -- 172.21.15.92:0/3667953117 <== mon.0 v2:172.21.15.92:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8bc0056070 con 0x7f8bcc1065c0 2024-09-19T08:47:10.356 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.734+0000 7f8bd3e37640 1 -- 172.21.15.92:0/3667953117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bcc1065c0 msgr2=0x7f8bcc07ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:10.356 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.734+0000 7f8bd3e37640 1 --2- 172.21.15.92:0/3667953117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bcc1065c0 0x7f8bcc07ba70 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f8bc00090b0 tx=0x7f8bc00046c0 comp rx=0 tx=0).stop 2024-09-19T08:47:10.356 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.734+0000 7f8bd3e37640 1 -- 172.21.15.92:0/3667953117 shutdown_connections 2024-09-19T08:47:10.356 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.734+0000 7f8bd3e37640 1 --2- 172.21.15.92:0/3667953117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bcc1065c0 0x7f8bcc07ba70 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:10.356 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.734+0000 7f8bd3e37640 1 -- 172.21.15.92:0/3667953117 >> 172.21.15.92:0/3667953117 conn(0x7f8bcc101d70 msgr2=0x7f8bcc18e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:10.356 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.734+0000 7f8bd3e37640 1 -- 172.21.15.92:0/3667953117 shutdown_connections 2024-09-19T08:47:10.356 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:09.734+0000 7f8bd3e37640 1 -- 172.21.15.92:0/3667953117 wait complete. 2024-09-19T08:47:10.356 INFO:teuthology.orchestra.run.smithi092.stdout:Generating new minimal ceph.conf... 2024-09-19T08:47:10.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:10 smithi092 ceph-mon[31043]: from='client.? 172.21.15.92:0/3667953117' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T08:47:10.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:10 smithi092 ceph-mon[31043]: from='client.? 172.21.15.92:0/3667953117' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-19T08:47:11.441 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:11 smithi092 ceph-mon[31043]: from='client.? 172.21.15.92:0/4176760866' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:47:11.443 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.772+0000 7f9df707f640 1 Processor -- start 2024-09-19T08:47:11.447 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.772+0000 7f9df707f640 1 -- start start 2024-09-19T08:47:11.448 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.772+0000 7f9df707f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9df01076b0 0x7f9df0107ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:11.448 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.772+0000 7f9df707f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9df0108080 con 0x7f9df01076b0 2024-09-19T08:47:11.448 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.772+0000 7f9df4e1b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9df01076b0 0x7f9df0107ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:11.448 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.772+0000 7f9df4e1b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9df01076b0 0x7f9df0107ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52562/0 (socket says 172.21.15.92:52562) 2024-09-19T08:47:11.448 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.772+0000 7f9df4e1b640 1 -- 172.21.15.92:0/3241238199 learned_addr learned my addr 172.21.15.92:0/3241238199 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:11.448 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.772+0000 7f9df4e1b640 1 -- 172.21.15.92:0/3241238199 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df01088b0 con 0x7f9df01076b0 2024-09-19T08:47:11.448 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.773+0000 7f9df4e1b640 1 --2- 172.21.15.92:0/3241238199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9df01076b0 0x7f9df0107ab0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9de4009820 tx=0x7f9de402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50445082a8f36627 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:11.448 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.773+0000 7f9def7fe640 1 -- 172.21.15.92:0/3241238199 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9de4037070 con 0x7f9df01076b0 2024-09-19T08:47:11.448 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.773+0000 7f9def7fe640 1 -- 172.21.15.92:0/3241238199 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9de4032900 con 0x7f9df01076b0 2024-09-19T08:47:11.448 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.773+0000 7f9def7fe640 1 -- 172.21.15.92:0/3241238199 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9de4030850 con 0x7f9df01076b0 2024-09-19T08:47:11.448 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.774+0000 7f9df707f640 1 -- 172.21.15.92:0/3241238199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9df01076b0 msgr2=0x7f9df0107ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:11.449 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.774+0000 7f9df707f640 1 --2- 172.21.15.92:0/3241238199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9df01076b0 0x7f9df0107ab0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9de4009820 tx=0x7f9de402a270 comp rx=0 tx=0).stop 2024-09-19T08:47:11.449 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.774+0000 7f9df707f640 1 -- 172.21.15.92:0/3241238199 shutdown_connections 2024-09-19T08:47:11.449 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.774+0000 7f9df707f640 1 --2- 172.21.15.92:0/3241238199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9df01076b0 0x7f9df0107ab0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:11.449 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.774+0000 7f9df707f640 1 -- 172.21.15.92:0/3241238199 >> 172.21.15.92:0/3241238199 conn(0x7f9df0102e80 msgr2=0x7f9df01052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:11.449 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.774+0000 7f9df707f640 1 -- 172.21.15.92:0/3241238199 shutdown_connections 2024-09-19T08:47:11.449 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.774+0000 7f9df707f640 1 -- 172.21.15.92:0/3241238199 wait complete. 2024-09-19T08:47:11.449 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.774+0000 7f9df707f640 1 Processor -- start 2024-09-19T08:47:11.449 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.774+0000 7f9df707f640 1 -- start start 2024-09-19T08:47:11.449 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.774+0000 7f9df707f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9df01076b0 0x7f9df007db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:11.449 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.774+0000 7f9df707f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9df010bc60 con 0x7f9df01076b0 2024-09-19T08:47:11.449 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.775+0000 7f9df4e1b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9df01076b0 0x7f9df007db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:11.449 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.775+0000 7f9df4e1b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9df01076b0 0x7f9df007db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52568/0 (socket says 172.21.15.92:52568) 2024-09-19T08:47:11.449 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.775+0000 7f9df4e1b640 1 -- 172.21.15.92:0/4176760866 learned_addr learned my addr 172.21.15.92:0/4176760866 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:11.450 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.775+0000 7f9df4e1b640 1 -- 172.21.15.92:0/4176760866 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df007e0d0 con 0x7f9df01076b0 2024-09-19T08:47:11.450 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.775+0000 7f9df4e1b640 1 --2- 172.21.15.92:0/4176760866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9df01076b0 0x7f9df007db90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9de4009940 tx=0x7f9de4032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:11.450 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.775+0000 7f9dedffb640 1 -- 172.21.15.92:0/4176760866 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9de4042070 con 0x7f9df01076b0 2024-09-19T08:47:11.450 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.775+0000 7f9dedffb640 1 -- 172.21.15.92:0/4176760866 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9de40308c0 con 0x7f9df01076b0 2024-09-19T08:47:11.450 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.775+0000 7f9df707f640 1 -- 172.21.15.92:0/4176760866 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9df007c2c0 con 0x7f9df01076b0 2024-09-19T08:47:11.450 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.775+0000 7f9dedffb640 1 -- 172.21.15.92:0/4176760866 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9de4037040 con 0x7f9df01076b0 2024-09-19T08:47:11.450 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.775+0000 7f9df707f640 1 -- 172.21.15.92:0/4176760866 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9df007c800 con 0x7f9df01076b0 2024-09-19T08:47:11.450 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.776+0000 7f9dedffb640 1 -- 172.21.15.92:0/4176760866 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9de4045070 con 0x7f9df01076b0 2024-09-19T08:47:11.450 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.776+0000 7f9dedffb640 1 -- 172.21.15.92:0/4176760866 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9de4047b70 con 0x7f9df01076b0 2024-09-19T08:47:11.450 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.776+0000 7f9df707f640 1 -- 172.21.15.92:0/4176760866 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9df0107b30 con 0x7f9df01076b0 2024-09-19T08:47:11.450 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.778+0000 7f9dedffb640 1 -- 172.21.15.92:0/4176760866 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f9de40327b0 con 0x7f9df01076b0 2024-09-19T08:47:11.450 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.835+0000 7f9df707f640 1 -- 172.21.15.92:0/4176760866 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f9df007cb40 con 0x7f9df01076b0 2024-09-19T08:47:11.450 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.836+0000 7f9dedffb640 1 -- 172.21.15.92:0/4176760866 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f9de403c760 con 0x7f9df01076b0 2024-09-19T08:47:11.451 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.836+0000 7f9df707f640 1 -- 172.21.15.92:0/4176760866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9df01076b0 msgr2=0x7f9df007db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:11.451 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.836+0000 7f9df707f640 1 --2- 172.21.15.92:0/4176760866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9df01076b0 0x7f9df007db90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9de4009940 tx=0x7f9de4032ce0 comp rx=0 tx=0).stop 2024-09-19T08:47:11.451 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.836+0000 7f9df707f640 1 -- 172.21.15.92:0/4176760866 shutdown_connections 2024-09-19T08:47:11.451 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.836+0000 7f9df707f640 1 --2- 172.21.15.92:0/4176760866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9df01076b0 0x7f9df007db90 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:11.451 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.836+0000 7f9df707f640 1 -- 172.21.15.92:0/4176760866 >> 172.21.15.92:0/4176760866 conn(0x7f9df0102e80 msgr2=0x7f9df01039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:11.451 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.836+0000 7f9df707f640 1 -- 172.21.15.92:0/4176760866 shutdown_connections 2024-09-19T08:47:11.451 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:10.836+0000 7f9df707f640 1 -- 172.21.15.92:0/4176760866 wait complete. 2024-09-19T08:47:11.451 INFO:teuthology.orchestra.run.smithi092.stdout:Restarting the monitor... 2024-09-19T08:47:11.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:11 smithi092 systemd[1]: Stopping Ceph mon.a for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T08:47:12.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:11 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mon-a[31039]: 2024-09-19T08:47:11.727+0000 7fa112fa3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:47:12.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:11 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mon-a[31039]: 2024-09-19T08:47:11.727+0000 7fa112fa3640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-19T08:47:12.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:11 smithi092 podman[31285]: 2024-09-19 08:47:11.942550706 +0000 UTC m=+0.335001026 container died 7fa7ce9e66516927ac25f504a518e2e3d3feedd390558eb5036c682244030ba5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mon-a, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T08:47:12.477 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:12 smithi092 podman[31285]: 2024-09-19 08:47:12.219355726 +0000 UTC m=+0.611806037 container cleanup 7fa7ce9e66516927ac25f504a518e2e3d3feedd390558eb5036c682244030ba5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mon-a, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T08:47:12.478 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:12 smithi092 bash[31285]: ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mon-a 2024-09-19T08:47:12.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:12 smithi092 podman[31298]: 2024-09-19 08:47:12.478438479 +0000 UTC m=+0.537485971 container remove 7fa7ce9e66516927ac25f504a518e2e3d3feedd390558eb5036c682244030ba5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mon-a, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-19T08:47:12.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:12 smithi092 systemd[1]: ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-19T08:47:12.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:12 smithi092 systemd[1]: Stopped Ceph mon.a for 91ff74f2-7663-11ef-bceb-c7b262605968. 2024-09-19T08:47:12.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:12 smithi092 systemd[1]: Starting Ceph mon.a for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T08:47:13.104 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:12 smithi092 podman[31388]: 2024-09-19 08:47:12.854502798 +0000 UTC m=+0.088755615 container create 74d516b1b00e157432c551a974e2df145e0185400acace9997e25b3605bb71ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mon-a, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-19T08:47:13.105 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:12 smithi092 podman[31388]: 2024-09-19 08:47:12.781347779 +0000 UTC m=+0.015600605 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:47:13.105 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 podman[31388]: 2024-09-19 08:47:13.073674718 +0000 UTC m=+0.307927537 container init 74d516b1b00e157432c551a974e2df145e0185400acace9997e25b3605bb71ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mon-a, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-19T08:47:13.105 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 podman[31388]: 2024-09-19 08:47:13.076680336 +0000 UTC m=+0.310933153 container start 74d516b1b00e157432c551a974e2df145e0185400acace9997e25b3605bb71ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2) 2024-09-19T08:47:13.105 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T08:47:13.105 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T08:47:13.105 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: pidfile_write: ignore empty --pid-file 2024-09-19T08:47:13.105 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: load: jerasure load: lrc 2024-09-19T08:47:13.106 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: RocksDB version: 7.9.2 2024-09-19T08:47:13.106 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Git sha 0 2024-09-19T08:47:13.106 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T08:47:13.106 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: DB SUMMARY 2024-09-19T08:47:13.106 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: DB Session ID: L2XJU1E5XUA0Z4KGY9N1 2024-09-19T08:47:13.106 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: CURRENT file: CURRENT 2024-09-19T08:47:13.106 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T08:47:13.106 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-19T08:47:13.107 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-19T08:47:13.107 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105630 ; 2024-09-19T08:47:13.107 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.error_if_exists: 0 2024-09-19T08:47:13.109 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.create_if_missing: 0 2024-09-19T08:47:13.109 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.paranoid_checks: 1 2024-09-19T08:47:13.109 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T08:47:13.109 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T08:47:13.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T08:47:13.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.env: 0x55e92eadf940 2024-09-19T08:47:13.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T08:47:13.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.info_log: 0x55e92f89d6e0 2024-09-19T08:47:13.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T08:47:13.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.statistics: (nil) 2024-09-19T08:47:13.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.use_fsync: 0 2024-09-19T08:47:13.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.max_log_file_size: 0 2024-09-19T08:47:13.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T08:47:13.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T08:47:13.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T08:47:13.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T08:47:13.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.allow_fallocate: 1 2024-09-19T08:47:13.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T08:47:13.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T08:47:13.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.use_direct_reads: 0 2024-09-19T08:47:13.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T08:47:13.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T08:47:13.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.db_log_dir: 2024-09-19T08:47:13.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.wal_dir: 2024-09-19T08:47:13.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T08:47:13.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T08:47:13.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T08:47:13.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T08:47:13.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T08:47:13.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T08:47:13.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T08:47:13.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T08:47:13.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.write_buffer_manager: 0x55e92f8acdc0 2024-09-19T08:47:13.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T08:47:13.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T08:47:13.114 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T08:47:13.114 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T08:47:13.114 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T08:47:13.114 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T08:47:13.114 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T08:47:13.114 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T08:47:13.114 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.unordered_write: 0 2024-09-19T08:47:13.114 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T08:47:13.115 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T08:47:13.115 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T08:47:13.115 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T08:47:13.115 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.row_cache: None 2024-09-19T08:47:13.115 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.wal_filter: None 2024-09-19T08:47:13.115 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T08:47:13.115 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T08:47:13.115 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.two_write_queues: 0 2024-09-19T08:47:13.116 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T08:47:13.116 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.wal_compression: 0 2024-09-19T08:47:13.116 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.atomic_flush: 0 2024-09-19T08:47:13.116 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T08:47:13.116 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T08:47:13.116 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T08:47:13.116 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.log_readahead_size: 0 2024-09-19T08:47:13.116 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T08:47:13.116 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T08:47:13.116 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T08:47:13.116 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T08:47:13.117 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T08:47:13.117 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T08:47:13.117 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T08:47:13.117 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.max_background_jobs: 2 2024-09-19T08:47:13.117 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.max_background_compactions: -1 2024-09-19T08:47:13.117 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.max_subcompactions: 1 2024-09-19T08:47:13.117 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T08:47:13.117 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T08:47:13.117 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T08:47:13.117 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T08:47:13.117 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T08:47:13.117 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T08:47:13.117 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T08:47:13.117 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T08:47:13.118 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.max_open_files: -1 2024-09-19T08:47:13.118 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T08:47:13.118 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T08:47:13.118 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T08:47:13.118 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T08:47:13.118 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.max_background_flushes: -1 2024-09-19T08:47:13.118 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Compression algorithms supported: 2024-09-19T08:47:13.118 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: kZSTD supported: 0 2024-09-19T08:47:13.118 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: kXpressCompression supported: 0 2024-09-19T08:47:13.118 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: kBZip2Compression supported: 0 2024-09-19T08:47:13.118 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T08:47:13.118 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: kLZ4Compression supported: 1 2024-09-19T08:47:13.118 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: kZlibCompression supported: 1 2024-09-19T08:47:13.119 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T08:47:13.119 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: kSnappyCompression supported: 1 2024-09-19T08:47:13.119 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T08:47:13.119 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T08:47:13.119 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-19T08:47:13.119 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T08:47:13.119 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T08:47:13.119 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.merge_operator: 2024-09-19T08:47:13.119 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.compaction_filter: None 2024-09-19T08:47:13.120 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T08:47:13.120 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T08:47:13.120 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T08:47:13.120 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T08:47:13.120 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e92f89d320) 2024-09-19T08:47:13.120 INFO:journalctl@ceph.mon.a.smithi092.stdout: cache_index_and_filter_blocks: 1 2024-09-19T08:47:13.120 INFO:journalctl@ceph.mon.a.smithi092.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T08:47:13.121 INFO:journalctl@ceph.mon.a.smithi092.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T08:47:13.121 INFO:journalctl@ceph.mon.a.smithi092.stdout: pin_top_level_index_and_filter: 1 2024-09-19T08:47:13.121 INFO:journalctl@ceph.mon.a.smithi092.stdout: index_type: 0 2024-09-19T08:47:13.121 INFO:journalctl@ceph.mon.a.smithi092.stdout: data_block_index_type: 0 2024-09-19T08:47:13.121 INFO:journalctl@ceph.mon.a.smithi092.stdout: index_shortening: 1 2024-09-19T08:47:13.121 INFO:journalctl@ceph.mon.a.smithi092.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T08:47:13.121 INFO:journalctl@ceph.mon.a.smithi092.stdout: checksum: 4 2024-09-19T08:47:13.121 INFO:journalctl@ceph.mon.a.smithi092.stdout: no_block_cache: 0 2024-09-19T08:47:13.121 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_cache: 0x55e92f8911f0 2024-09-19T08:47:13.121 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_cache_name: BinnedLRUCache 2024-09-19T08:47:13.121 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_cache_options: 2024-09-19T08:47:13.121 INFO:journalctl@ceph.mon.a.smithi092.stdout: capacity : 536870912 2024-09-19T08:47:13.121 INFO:journalctl@ceph.mon.a.smithi092.stdout: num_shard_bits : 4 2024-09-19T08:47:13.122 INFO:journalctl@ceph.mon.a.smithi092.stdout: strict_capacity_limit : 0 2024-09-19T08:47:13.122 INFO:journalctl@ceph.mon.a.smithi092.stdout: high_pri_pool_ratio: 0.000 2024-09-19T08:47:13.122 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_cache_compressed: (nil) 2024-09-19T08:47:13.122 INFO:journalctl@ceph.mon.a.smithi092.stdout: persistent_cache: (nil) 2024-09-19T08:47:13.122 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_size: 4096 2024-09-19T08:47:13.122 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_size_deviation: 10 2024-09-19T08:47:13.122 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_restart_interval: 16 2024-09-19T08:47:13.122 INFO:journalctl@ceph.mon.a.smithi092.stdout: index_block_restart_interval: 1 2024-09-19T08:47:13.122 INFO:journalctl@ceph.mon.a.smithi092.stdout: metadata_block_size: 4096 2024-09-19T08:47:13.123 INFO:journalctl@ceph.mon.a.smithi092.stdout: partition_filters: 0 2024-09-19T08:47:13.123 INFO:journalctl@ceph.mon.a.smithi092.stdout: use_delta_encoding: 1 2024-09-19T08:47:13.123 INFO:journalctl@ceph.mon.a.smithi092.stdout: filter_policy: bloomfilter 2024-09-19T08:47:13.123 INFO:journalctl@ceph.mon.a.smithi092.stdout: whole_key_filtering: 1 2024-09-19T08:47:13.123 INFO:journalctl@ceph.mon.a.smithi092.stdout: verify_compression: 0 2024-09-19T08:47:13.123 INFO:journalctl@ceph.mon.a.smithi092.stdout: read_amp_bytes_per_bit: 0 2024-09-19T08:47:13.123 INFO:journalctl@ceph.mon.a.smithi092.stdout: format_version: 5 2024-09-19T08:47:13.123 INFO:journalctl@ceph.mon.a.smithi092.stdout: enable_index_compression: 1 2024-09-19T08:47:13.123 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_align: 0 2024-09-19T08:47:13.123 INFO:journalctl@ceph.mon.a.smithi092.stdout: max_auto_readahead_size: 262144 2024-09-19T08:47:13.124 INFO:journalctl@ceph.mon.a.smithi092.stdout: prepopulate_block_cache: 0 2024-09-19T08:47:13.124 INFO:journalctl@ceph.mon.a.smithi092.stdout: initial_auto_readahead_size: 8192 2024-09-19T08:47:13.124 INFO:journalctl@ceph.mon.a.smithi092.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T08:47:13.124 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T08:47:13.124 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T08:47:13.124 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.compression: NoCompression 2024-09-19T08:47:13.124 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T08:47:13.124 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T08:47:13.124 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T08:47:13.124 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.num_levels: 7 2024-09-19T08:47:13.124 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T08:47:13.124 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T08:47:13.125 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T08:47:13.125 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T08:47:13.125 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T08:47:13.125 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T08:47:13.125 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T08:47:13.125 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T08:47:13.125 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T08:47:13.125 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T08:47:13.125 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T08:47:13.125 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T08:47:13.125 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T08:47:13.125 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T08:47:13.126 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T08:47:13.126 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T08:47:13.126 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T08:47:13.126 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T08:47:13.126 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T08:47:13.126 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T08:47:13.126 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T08:47:13.126 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T08:47:13.126 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T08:47:13.126 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T08:47:13.126 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T08:47:13.126 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T08:47:13.126 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T08:47:13.127 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T08:47:13.127 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T08:47:13.127 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T08:47:13.127 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T08:47:13.127 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T08:47:13.127 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T08:47:13.127 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T08:47:13.127 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T08:47:13.127 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T08:47:13.127 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T08:47:13.127 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T08:47:13.127 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T08:47:13.127 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T08:47:13.128 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T08:47:13.128 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T08:47:13.128 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T08:47:13.128 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T08:47:13.128 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T08:47:13.128 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T08:47:13.128 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T08:47:13.128 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T08:47:13.128 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T08:47:13.128 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T08:47:13.128 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T08:47:13.128 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T08:47:13.128 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T08:47:13.129 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T08:47:13.129 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.inplace_update_support: 0 2024-09-19T08:47:13.129 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T08:47:13.129 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T08:47:13.129 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T08:47:13.129 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T08:47:13.129 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.bloom_locality: 0 2024-09-19T08:47:13.129 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.max_successive_merges: 0 2024-09-19T08:47:13.129 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T08:47:13.129 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T08:47:13.129 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T08:47:13.129 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T08:47:13.130 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.ttl: 2592000 2024-09-19T08:47:13.130 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T08:47:13.130 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T08:47:13.130 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T08:47:13.130 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.enable_blob_files: false 2024-09-19T08:47:13.130 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.min_blob_size: 0 2024-09-19T08:47:13.130 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T08:47:13.130 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T08:47:13.130 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T08:47:13.130 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T08:47:13.130 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T08:47:13.130 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T08:47:13.130 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T08:47:13.131 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T08:47:13.131 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-19T08:47:13.131 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-19T08:47:13.131 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e173bcfd-520b-4443-9eb2-c80debefd943 2024-09-19T08:47:13.131 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726735633103098, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-19T08:47:13.131 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-19T08:47:13.131 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726735633104126, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100618, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 330, "table_properties": {"data_size": 98512, "index_size": 298, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14397, "raw_average_key_size": 49, "raw_value_size": 90758, "raw_average_value_size": 314, "num_data_blocks": 12, "num_entries": 289, "num_filter_entries": 289, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726735633, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e173bcfd-520b-4443-9eb2-c80debefd943", "db_session_id": "L2XJU1E5XUA0Z4KGY9N1", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-19T08:47:13.131 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726735633104221, "job": 1, "event": "recovery_finished"} 2024-09-19T08:47:13.131 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-19T08:47:13.131 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T08:47:13.131 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e92f8bee00 2024-09-19T08:47:13.131 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: DB pointer 0x55e92f9ba000 2024-09-19T08:47:13.132 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T08:47:13.132 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T08:47:13.132 INFO:journalctl@ceph.mon.a.smithi092.stdout: ** DB Stats ** 2024-09-19T08:47:13.132 INFO:journalctl@ceph.mon.a.smithi092.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T08:47:13.132 INFO:journalctl@ceph.mon.a.smithi092.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T08:47:13.132 INFO:journalctl@ceph.mon.a.smithi092.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T08:47:13.132 INFO:journalctl@ceph.mon.a.smithi092.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T08:47:13.132 INFO:journalctl@ceph.mon.a.smithi092.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T08:47:13.132 INFO:journalctl@ceph.mon.a.smithi092.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T08:47:13.132 INFO:journalctl@ceph.mon.a.smithi092.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T08:47:13.132 INFO:journalctl@ceph.mon.a.smithi092.stdout: 2024-09-19T08:47:13.132 INFO:journalctl@ceph.mon.a.smithi092.stdout: ** Compaction Stats [default] ** 2024-09-19T08:47:13.132 INFO:journalctl@ceph.mon.a.smithi092.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T08:47:13.133 INFO:journalctl@ceph.mon.a.smithi092.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T08:47:13.133 INFO:journalctl@ceph.mon.a.smithi092.stdout: L0 2/0 100.12 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 144.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:47:13.133 INFO:journalctl@ceph.mon.a.smithi092.stdout: Sum 2/0 100.12 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 144.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:47:13.133 INFO:journalctl@ceph.mon.a.smithi092.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 144.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:47:13.133 INFO:journalctl@ceph.mon.a.smithi092.stdout: 2024-09-19T08:47:13.133 INFO:journalctl@ceph.mon.a.smithi092.stdout: ** Compaction Stats [default] ** 2024-09-19T08:47:13.133 INFO:journalctl@ceph.mon.a.smithi092.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T08:47:13.133 INFO:journalctl@ceph.mon.a.smithi092.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T08:47:13.133 INFO:journalctl@ceph.mon.a.smithi092.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 144.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:47:13.133 INFO:journalctl@ceph.mon.a.smithi092.stdout: 2024-09-19T08:47:13.133 INFO:journalctl@ceph.mon.a.smithi092.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T08:47:13.133 INFO:journalctl@ceph.mon.a.smithi092.stdout: 2024-09-19T08:47:13.133 INFO:journalctl@ceph.mon.a.smithi092.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T08:47:13.134 INFO:journalctl@ceph.mon.a.smithi092.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T08:47:13.134 INFO:journalctl@ceph.mon.a.smithi092.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T08:47:13.134 INFO:journalctl@ceph.mon.a.smithi092.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T08:47:13.134 INFO:journalctl@ceph.mon.a.smithi092.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T08:47:13.134 INFO:journalctl@ceph.mon.a.smithi092.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T08:47:13.134 INFO:journalctl@ceph.mon.a.smithi092.stdout: Cumulative compaction: 0.00 GB write, 27.09 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T08:47:13.134 INFO:journalctl@ceph.mon.a.smithi092.stdout: Interval compaction: 0.00 GB write, 27.09 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T08:47:13.134 INFO:journalctl@ceph.mon.a.smithi092.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T08:47:13.134 INFO:journalctl@ceph.mon.a.smithi092.stdout: Block cache BinnedLRUCache@0x55e92f8911f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-19T08:47:13.134 INFO:journalctl@ceph.mon.a.smithi092.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-19T08:47:13.134 INFO:journalctl@ceph.mon.a.smithi092.stdout: 2024-09-19T08:47:13.134 INFO:journalctl@ceph.mon.a.smithi092.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T08:47:13.134 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: starting mon.a rank 0 at public addrs [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] at bind addrs [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 91ff74f2-7663-11ef-bceb-c7b262605968 2024-09-19T08:47:13.134 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: mon.a@-1(???) e1 preinit fsid 91ff74f2-7663-11ef-bceb-c7b262605968 2024-09-19T08:47:13.135 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: mon.a@-1(???).mds e1 new map 2024-09-19T08:47:13.135 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: mon.a@-1(???).mds e1 print_map 2024-09-19T08:47:13.135 INFO:journalctl@ceph.mon.a.smithi092.stdout: e1 2024-09-19T08:47:13.135 INFO:journalctl@ceph.mon.a.smithi092.stdout: btime 2024-09-19T08:47:08:161960+0000 2024-09-19T08:47:13.135 INFO:journalctl@ceph.mon.a.smithi092.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T08:47:13.135 INFO:journalctl@ceph.mon.a.smithi092.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T08:47:13.135 INFO:journalctl@ceph.mon.a.smithi092.stdout: legacy client fscid: -1 2024-09-19T08:47:13.135 INFO:journalctl@ceph.mon.a.smithi092.stdout: 2024-09-19T08:47:13.135 INFO:journalctl@ceph.mon.a.smithi092.stdout: No filesystems configured 2024-09-19T08:47:13.135 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T08:47:13.135 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:47:13.135 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:47:13.135 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:47:13.136 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-19T08:47:13.178 INFO:teuthology.orchestra.run.smithi092.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-19T08:47:13.413 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T08:47:13.413 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: monmap epoch 1 2024-09-19T08:47:13.413 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: fsid 91ff74f2-7663-11ef-bceb-c7b262605968 2024-09-19T08:47:13.413 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: last_changed 2024-09-19T08:47:04.662007+0000 2024-09-19T08:47:13.413 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: created 2024-09-19T08:47:04.662007+0000 2024-09-19T08:47:13.414 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: min_mon_release 19 (squid) 2024-09-19T08:47:13.414 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: election_strategy: 1 2024-09-19T08:47:13.414 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: 0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-09-19T08:47:13.414 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: fsmap 2024-09-19T08:47:13.414 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T08:47:13.414 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 ceph-mon[31407]: mgrmap e1: no daemons active 2024-09-19T08:47:13.414 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 bash[31388]: 74d516b1b00e157432c551a974e2df145e0185400acace9997e25b3605bb71ff 2024-09-19T08:47:13.414 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:13 smithi092 systemd[1]: Started Ceph mon.a for 91ff74f2-7663-11ef-bceb-c7b262605968. 2024-09-19T08:47:14.215 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.598+0000 7f266c9ab640 1 Processor -- start 2024-09-19T08:47:14.220 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.598+0000 7f266c9ab640 1 -- start start 2024-09-19T08:47:14.220 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.598+0000 7f266c9ab640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26681065c0 0x7f26681069c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:14.220 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.598+0000 7f266c9ab640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2668106f90 con 0x7f26681065c0 2024-09-19T08:47:14.220 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.598+0000 7f266659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26681065c0 0x7f26681069c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:14.220 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.598+0000 7f266659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26681065c0 0x7f26681069c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39556/0 (socket says 172.21.15.92:39556) 2024-09-19T08:47:14.220 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.598+0000 7f266659c640 1 -- 172.21.15.92:0/4197002998 learned_addr learned my addr 172.21.15.92:0/4197002998 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:14.220 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.599+0000 7f266659c640 1 -- 172.21.15.92:0/4197002998 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26681077c0 con 0x7f26681065c0 2024-09-19T08:47:14.220 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.600+0000 7f266659c640 1 --2- 172.21.15.92:0/4197002998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26681065c0 0x7f26681069c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2658009820 tx=0x7f265802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12415004b2d54d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:14.220 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.600+0000 7f2665d9b640 1 -- 172.21.15.92:0/4197002998 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2658037070 con 0x7f26681065c0 2024-09-19T08:47:14.220 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.601+0000 7f2665d9b640 1 -- 172.21.15.92:0/4197002998 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2658032900 con 0x7f26681065c0 2024-09-19T08:47:14.221 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.601+0000 7f2665d9b640 1 -- 172.21.15.92:0/4197002998 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2658030850 con 0x7f26681065c0 2024-09-19T08:47:14.221 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.601+0000 7f266c9ab640 1 -- 172.21.15.92:0/4197002998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26681065c0 msgr2=0x7f26681069c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:14.221 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.601+0000 7f266c9ab640 1 --2- 172.21.15.92:0/4197002998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26681065c0 0x7f26681069c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2658009820 tx=0x7f265802a270 comp rx=0 tx=0).stop 2024-09-19T08:47:14.221 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.601+0000 7f266c9ab640 1 -- 172.21.15.92:0/4197002998 shutdown_connections 2024-09-19T08:47:14.221 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.601+0000 7f266c9ab640 1 --2- 172.21.15.92:0/4197002998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26681065c0 0x7f26681069c0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:14.221 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.601+0000 7f266c9ab640 1 -- 172.21.15.92:0/4197002998 >> 172.21.15.92:0/4197002998 conn(0x7f2668101d70 msgr2=0x7f2668104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:14.221 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.601+0000 7f266c9ab640 1 -- 172.21.15.92:0/4197002998 shutdown_connections 2024-09-19T08:47:14.221 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.601+0000 7f266c9ab640 1 -- 172.21.15.92:0/4197002998 wait complete. 2024-09-19T08:47:14.221 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.602+0000 7f266c9ab640 1 Processor -- start 2024-09-19T08:47:14.221 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.602+0000 7f266c9ab640 1 -- start start 2024-09-19T08:47:14.221 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.602+0000 7f266c9ab640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26681065c0 0x7f266807ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:14.221 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.602+0000 7f266c9ab640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f266810ab70 con 0x7f26681065c0 2024-09-19T08:47:14.222 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.602+0000 7f266659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26681065c0 0x7f266807ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:14.222 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.602+0000 7f266659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26681065c0 0x7f266807ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39564/0 (socket says 172.21.15.92:39564) 2024-09-19T08:47:14.222 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.602+0000 7f266659c640 1 -- 172.21.15.92:0/3296149263 learned_addr learned my addr 172.21.15.92:0/3296149263 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:14.222 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.603+0000 7f266659c640 1 -- 172.21.15.92:0/3296149263 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f266819e3c0 con 0x7f26681065c0 2024-09-19T08:47:14.222 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.603+0000 7f266659c640 1 --2- 172.21.15.92:0/3296149263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26681065c0 0x7f266807ba70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2658009940 tx=0x7f2658032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:14.222 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.603+0000 7f265ffff640 1 -- 172.21.15.92:0/3296149263 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2658042070 con 0x7f26681065c0 2024-09-19T08:47:14.222 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.603+0000 7f266c9ab640 1 -- 172.21.15.92:0/3296149263 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f266819e590 con 0x7f26681065c0 2024-09-19T08:47:14.222 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.603+0000 7f265ffff640 1 -- 172.21.15.92:0/3296149263 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f26580308c0 con 0x7f26681065c0 2024-09-19T08:47:14.222 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.603+0000 7f265ffff640 1 -- 172.21.15.92:0/3296149263 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2658037040 con 0x7f26681065c0 2024-09-19T08:47:14.223 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.603+0000 7f266c9ab640 1 -- 172.21.15.92:0/3296149263 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f266819e930 con 0x7f26681065c0 2024-09-19T08:47:14.223 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.603+0000 7f265ffff640 1 -- 172.21.15.92:0/3296149263 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2658045070 con 0x7f26681065c0 2024-09-19T08:47:14.223 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.603+0000 7f265ffff640 1 -- 172.21.15.92:0/3296149263 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2658047bc0 con 0x7f26681065c0 2024-09-19T08:47:14.223 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.604+0000 7f266c9ab640 1 -- 172.21.15.92:0/3296149263 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2668106a40 con 0x7f26681065c0 2024-09-19T08:47:14.223 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.606+0000 7f265ffff640 1 -- 172.21.15.92:0/3296149263 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f26580327b0 con 0x7f26681065c0 2024-09-19T08:47:14.223 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.663+0000 7f266c9ab640 1 -- 172.21.15.92:0/3296149263 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f266819ee00 con 0x7f26681065c0 2024-09-19T08:47:14.223 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.667+0000 7f265ffff640 1 -- 172.21.15.92:0/3296149263 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f265803c870 con 0x7f26681065c0 2024-09-19T08:47:14.223 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.668+0000 7f266c9ab640 1 -- 172.21.15.92:0/3296149263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26681065c0 msgr2=0x7f266807ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:14.223 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.668+0000 7f266c9ab640 1 --2- 172.21.15.92:0/3296149263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26681065c0 0x7f266807ba70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2658009940 tx=0x7f2658032ce0 comp rx=0 tx=0).stop 2024-09-19T08:47:14.223 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.668+0000 7f266c9ab640 1 -- 172.21.15.92:0/3296149263 shutdown_connections 2024-09-19T08:47:14.223 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.668+0000 7f266c9ab640 1 --2- 172.21.15.92:0/3296149263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26681065c0 0x7f266807ba70 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:14.223 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.668+0000 7f266c9ab640 1 -- 172.21.15.92:0/3296149263 >> 172.21.15.92:0/3296149263 conn(0x7f2668101d70 msgr2=0x7f26681028a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:14.223 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.668+0000 7f266c9ab640 1 -- 172.21.15.92:0/3296149263 shutdown_connections 2024-09-19T08:47:14.224 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:13.668+0000 7f266c9ab640 1 -- 172.21.15.92:0/3296149263 wait complete. 2024-09-19T08:47:14.224 INFO:teuthology.orchestra.run.smithi092.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-19T08:47:14.246 INFO:teuthology.orchestra.run.smithi092.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:47:14.246 INFO:teuthology.orchestra.run.smithi092.stdout:Creating mgr... 2024-09-19T08:47:14.246 INFO:teuthology.orchestra.run.smithi092.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-19T08:47:14.246 INFO:teuthology.orchestra.run.smithi092.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-19T08:47:14.501 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mgr.x 2024-09-19T08:47:14.501 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Failed to reset failed state of unit ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-19T08:47:14.640 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-91ff74f2-7663-11ef-bceb-c7b262605968.target.wants/ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-91ff74f2-7663-11ef-bceb-c7b262605968@.service. 2024-09-19T08:47:14.878 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:14 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3296149263' entity='client.admin' 2024-09-19T08:47:15.184 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:15 smithi092 podman[31616]: 2024-09-19 08:47:15.079154318 +0000 UTC m=+0.313529312 container start 2a2f457ff5fa483a870859f21cadf73443415c85ec08009886896b950fc7c161 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-19T08:47:15.185 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:15 smithi092 bash[31616]: 2a2f457ff5fa483a870859f21cadf73443415c85ec08009886896b950fc7c161 2024-09-19T08:47:15.198 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T08:47:15.198 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout disabled 2024-09-19T08:47:15.205 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T08:47:15.205 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout inactive 2024-09-19T08:47:15.205 INFO:teuthology.orchestra.run.smithi092.stdout:firewalld.service is not enabled 2024-09-19T08:47:15.206 INFO:teuthology.orchestra.run.smithi092.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T08:47:15.214 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T08:47:15.214 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout disabled 2024-09-19T08:47:15.221 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T08:47:15.221 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout inactive 2024-09-19T08:47:15.221 INFO:teuthology.orchestra.run.smithi092.stdout:firewalld.service is not enabled 2024-09-19T08:47:15.221 INFO:teuthology.orchestra.run.smithi092.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-19T08:47:15.222 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for mgr to start... 2024-09-19T08:47:15.222 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for mgr... 2024-09-19T08:47:15.472 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:15 smithi092 systemd[1]: Started Ceph mgr.x for 91ff74f2-7663-11ef-bceb-c7b262605968. 2024-09-19T08:47:15.472 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:15 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:15.195+0000 7f9e364fb040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T08:47:15.472 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:15 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:15.258+0000 7f9e364fb040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:47:15.472 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:15 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:15.408+0000 7f9e364fb040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:47:15.736 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:15 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:15.476+0000 7f9e364fb040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:47:15.736 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:15 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:15.627+0000 7f9e364fb040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:47:16.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:15 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/2774679679' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T08:47:16.003 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:15 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:15.778+0000 7f9e364fb040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:47:16.295 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-09-19T08:47:16.295 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:47:16.295 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "fsid": "91ff74f2-7663-11ef-bceb-c7b262605968", 2024-09-19T08:47:16.296 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T08:47:16.296 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T08:47:16.296 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T08:47:16.296 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T08:47:16.296 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:47:16.296 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T08:47:16.296 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T08:47:16.296 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 0 2024-09-19T08:47:16.296 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:47:16.297 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T08:47:16.297 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T08:47:16.297 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:47:16.297 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-19T08:47:16.297 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T08:47:16.297 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:47:16.297 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T08:47:16.297 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T08:47:16.297 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:47:16.297 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T08:47:16.297 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:47:16.297 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T08:47:16.297 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T08:47:16.298 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T08:47:16.305 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T08:47:16.305 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T08:47:16.305 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T08:47:16.305 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:47:16.305 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T08:47:16.305 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T08:47:16.306 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T08:47:16.306 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T08:47:16.306 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T08:47:16.306 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T08:47:16.306 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T08:47:16.306 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T08:47:16.306 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T08:47:16.306 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:47:16.306 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T08:47:16.306 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:47:16.306 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T08:47:08:161960+0000", 2024-09-19T08:47:16.306 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T08:47:16.306 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T08:47:16.307 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:47:16.307 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T08:47:16.307 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T08:47:16.307 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T08:47:16.307 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T08:47:16.307 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T08:47:16.307 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T08:47:16.307 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T08:47:16.307 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:47:16.307 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:47:16.307 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:47:16.307 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T08:47:16.307 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:47:16.308 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T08:47:08.162591+0000", 2024-09-19T08:47:16.308 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:47:16.308 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:47:16.308 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T08:47:16.308 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:47:16.308 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.666+0000 7ff88e48a640 1 Processor -- start 2024-09-19T08:47:16.308 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.666+0000 7ff88e48a640 1 -- start start 2024-09-19T08:47:16.308 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.666+0000 7ff88e48a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff888108170 0x7ff88810a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:16.308 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.666+0000 7ff88e48a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff88807be90 con 0x7ff888108170 2024-09-19T08:47:16.308 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.667+0000 7ff887fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff888108170 0x7ff88810a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:16.308 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.667+0000 7ff887fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff888108170 0x7ff88810a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39580/0 (socket says 172.21.15.92:39580) 2024-09-19T08:47:16.308 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.667+0000 7ff887fff640 1 -- 172.21.15.92:0/2088996978 learned_addr learned my addr 172.21.15.92:0/2088996978 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:16.309 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.667+0000 7ff887fff640 1 -- 172.21.15.92:0/2088996978 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff88810aaa0 con 0x7ff888108170 2024-09-19T08:47:16.309 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.668+0000 7ff887fff640 1 --2- 172.21.15.92:0/2088996978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff888108170 0x7ff88810a560 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff878009820 tx=0x7ff87802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f49beecc804979a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:16.309 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.668+0000 7ff8877fe640 1 -- 172.21.15.92:0/2088996978 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff878037070 con 0x7ff888108170 2024-09-19T08:47:16.309 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.668+0000 7ff8877fe640 1 -- 172.21.15.92:0/2088996978 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff878032900 con 0x7ff888108170 2024-09-19T08:47:16.309 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.668+0000 7ff8877fe640 1 -- 172.21.15.92:0/2088996978 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff878030850 con 0x7ff888108170 2024-09-19T08:47:16.309 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.669+0000 7ff88e48a640 1 -- 172.21.15.92:0/2088996978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff888108170 msgr2=0x7ff88810a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:16.309 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.669+0000 7ff88e48a640 1 --2- 172.21.15.92:0/2088996978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff888108170 0x7ff88810a560 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff878009820 tx=0x7ff87802a270 comp rx=0 tx=0).stop 2024-09-19T08:47:16.309 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.669+0000 7ff88e48a640 1 -- 172.21.15.92:0/2088996978 shutdown_connections 2024-09-19T08:47:16.309 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.669+0000 7ff88e48a640 1 --2- 172.21.15.92:0/2088996978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff888108170 0x7ff88810a560 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:16.309 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.669+0000 7ff88e48a640 1 -- 172.21.15.92:0/2088996978 >> 172.21.15.92:0/2088996978 conn(0x7ff888101d70 msgr2=0x7ff888104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:16.309 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.669+0000 7ff88e48a640 1 -- 172.21.15.92:0/2088996978 shutdown_connections 2024-09-19T08:47:16.309 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.669+0000 7ff88e48a640 1 -- 172.21.15.92:0/2088996978 wait complete. 2024-09-19T08:47:16.309 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.669+0000 7ff88e48a640 1 Processor -- start 2024-09-19T08:47:16.310 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.670+0000 7ff88e48a640 1 -- start start 2024-09-19T08:47:16.310 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.670+0000 7ff88e48a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff888108170 0x7ff88819b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:16.310 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.670+0000 7ff88e48a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff88810ba70 con 0x7ff888108170 2024-09-19T08:47:16.310 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.670+0000 7ff887fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff888108170 0x7ff88819b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:16.310 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.670+0000 7ff887fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff888108170 0x7ff88819b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39582/0 (socket says 172.21.15.92:39582) 2024-09-19T08:47:16.310 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.670+0000 7ff887fff640 1 -- 172.21.15.92:0/2774679679 learned_addr learned my addr 172.21.15.92:0/2774679679 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:16.310 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.670+0000 7ff887fff640 1 -- 172.21.15.92:0/2774679679 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff88819bb50 con 0x7ff888108170 2024-09-19T08:47:16.310 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.670+0000 7ff887fff640 1 --2- 172.21.15.92:0/2774679679 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff888108170 0x7ff88819b610 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff878032ce0 tx=0x7ff878032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:16.310 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.670+0000 7ff885ffb640 1 -- 172.21.15.92:0/2774679679 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff878042070 con 0x7ff888108170 2024-09-19T08:47:16.310 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.671+0000 7ff885ffb640 1 -- 172.21.15.92:0/2774679679 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff8780308c0 con 0x7ff888108170 2024-09-19T08:47:16.310 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.671+0000 7ff88e48a640 1 -- 172.21.15.92:0/2774679679 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff88819bde0 con 0x7ff888108170 2024-09-19T08:47:16.310 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.671+0000 7ff88e48a640 1 -- 172.21.15.92:0/2774679679 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff88819ead0 con 0x7ff888108170 2024-09-19T08:47:16.310 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.671+0000 7ff885ffb640 1 -- 172.21.15.92:0/2774679679 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff878037040 con 0x7ff888108170 2024-09-19T08:47:16.311 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.671+0000 7ff885ffb640 1 -- 172.21.15.92:0/2774679679 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff878045070 con 0x7ff888108170 2024-09-19T08:47:16.311 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.671+0000 7ff885ffb640 1 -- 172.21.15.92:0/2774679679 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff878047bc0 con 0x7ff888108170 2024-09-19T08:47:16.311 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.672+0000 7ff88e48a640 1 -- 172.21.15.92:0/2774679679 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8881085d0 con 0x7ff888108170 2024-09-19T08:47:16.311 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.674+0000 7ff885ffb640 1 -- 172.21.15.92:0/2774679679 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7ff87803c820 con 0x7ff888108170 2024-09-19T08:47:16.311 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.736+0000 7ff88e48a640 1 -- 172.21.15.92:0/2774679679 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7ff88819eca0 con 0x7ff888108170 2024-09-19T08:47:16.311 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.736+0000 7ff885ffb640 1 -- 172.21.15.92:0/2774679679 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7ff87803ca00 con 0x7ff888108170 2024-09-19T08:47:16.311 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.737+0000 7ff88e48a640 1 -- 172.21.15.92:0/2774679679 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff888108170 msgr2=0x7ff88819b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:16.311 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.737+0000 7ff88e48a640 1 --2- 172.21.15.92:0/2774679679 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff888108170 0x7ff88819b610 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff878032ce0 tx=0x7ff878032d10 comp rx=0 tx=0).stop 2024-09-19T08:47:16.311 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.737+0000 7ff88e48a640 1 -- 172.21.15.92:0/2774679679 shutdown_connections 2024-09-19T08:47:16.311 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.737+0000 7ff88e48a640 1 --2- 172.21.15.92:0/2774679679 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff888108170 0x7ff88819b610 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:16.311 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.737+0000 7ff88e48a640 1 -- 172.21.15.92:0/2774679679 >> 172.21.15.92:0/2774679679 conn(0x7ff888101d70 msgr2=0x7ff888102920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:16.311 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.737+0000 7ff88e48a640 1 -- 172.21.15.92:0/2774679679 shutdown_connections 2024-09-19T08:47:16.311 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:15.737+0000 7ff88e48a640 1 -- 172.21.15.92:0/2774679679 wait complete. 2024-09-19T08:47:16.311 INFO:teuthology.orchestra.run.smithi092.stdout:mgr not available, waiting (1/15)... 2024-09-19T08:47:16.344 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:16 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:16.099+0000 7f9e364fb040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:47:16.345 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:16 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:16.160+0000 7f9e364fb040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:47:16.753 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:16 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:16.344+0000 7f9e364fb040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:47:17.503 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:17 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:17.221+0000 7f9e364fb040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:47:17.503 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:17 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:17.288+0000 7f9e364fb040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:47:18.265 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:18 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:18.007+0000 7f9e364fb040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:47:18.265 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:18 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:18.123+0000 7f9e364fb040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:47:18.265 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:18 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:18.265+0000 7f9e364fb040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:47:18.516 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:18 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:18.329+0000 7f9e364fb040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:47:18.517 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:18 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:18.483+0000 7f9e364fb040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:47:18.780 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:18 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:18.555+0000 7f9e364fb040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:47:18.780 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:18 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:18.615+0000 7f9e364fb040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:47:18.780 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:18 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:18.780+0000 7f9e364fb040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:47:19.063 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:18 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3162131555' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T08:47:19.064 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:18 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:18.850+0000 7f9e364fb040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:47:19.064 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:18 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:18.918+0000 7f9e364fb040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:47:19.064 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:19 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:19.001+0000 7f9e364fb040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:47:19.373 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:19 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:19.063+0000 7f9e364fb040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:47:19.373 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:19 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:19.123+0000 7f9e364fb040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:47:19.389 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-09-19T08:47:19.389 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:47:19.389 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "fsid": "91ff74f2-7663-11ef-bceb-c7b262605968", 2024-09-19T08:47:19.390 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T08:47:19.390 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T08:47:19.390 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T08:47:19.390 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T08:47:19.390 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:47:19.390 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T08:47:19.390 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T08:47:19.390 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 0 2024-09-19T08:47:19.390 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:47:19.390 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T08:47:19.390 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T08:47:19.390 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:47:19.391 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-19T08:47:19.391 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T08:47:19.391 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:47:19.391 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T08:47:19.391 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T08:47:19.391 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:47:19.391 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T08:47:19.391 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:47:19.391 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T08:47:19.391 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T08:47:19.391 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T08:47:19.391 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T08:47:19.391 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T08:47:19.392 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T08:47:19.392 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:47:19.392 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T08:47:19.392 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T08:47:19.392 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T08:47:19.392 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T08:47:19.392 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T08:47:19.392 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T08:47:19.392 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T08:47:19.392 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T08:47:19.392 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T08:47:19.392 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:47:19.392 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T08:47:19.393 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:47:19.393 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T08:47:08:161960+0000", 2024-09-19T08:47:19.393 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T08:47:19.393 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T08:47:19.393 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:47:19.393 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T08:47:19.393 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T08:47:19.393 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T08:47:19.393 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T08:47:19.393 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T08:47:19.393 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T08:47:19.393 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T08:47:19.393 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:47:19.393 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:47:19.394 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:47:19.394 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T08:47:19.394 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:47:19.394 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T08:47:08.162591+0000", 2024-09-19T08:47:19.394 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:47:19.394 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:47:19.394 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T08:47:19.394 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:47:19.394 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.737+0000 7fd762228640 1 Processor -- start 2024-09-19T08:47:19.394 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.737+0000 7fd762228640 1 -- start start 2024-09-19T08:47:19.394 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.737+0000 7fd762228640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd75c1065c0 0x7fd75c1069c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:19.394 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.737+0000 7fd762228640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd75c106f90 con 0x7fd75c1065c0 2024-09-19T08:47:19.395 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.737+0000 7fd75b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd75c1065c0 0x7fd75c1069c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:19.395 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.737+0000 7fd75b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd75c1065c0 0x7fd75c1069c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39594/0 (socket says 172.21.15.92:39594) 2024-09-19T08:47:19.395 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.737+0000 7fd75b7fe640 1 -- 172.21.15.92:0/1102895572 learned_addr learned my addr 172.21.15.92:0/1102895572 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:19.395 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.738+0000 7fd75b7fe640 1 -- 172.21.15.92:0/1102895572 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd75c1077c0 con 0x7fd75c1065c0 2024-09-19T08:47:19.395 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.738+0000 7fd75b7fe640 1 --2- 172.21.15.92:0/1102895572 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd75c1065c0 0x7fd75c1069c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd750009820 tx=0x7fd75002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9bc32ff5e8237a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:19.395 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.739+0000 7fd75a7fc640 1 -- 172.21.15.92:0/1102895572 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd750037070 con 0x7fd75c1065c0 2024-09-19T08:47:19.395 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.739+0000 7fd75a7fc640 1 -- 172.21.15.92:0/1102895572 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd750032900 con 0x7fd75c1065c0 2024-09-19T08:47:19.395 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.739+0000 7fd75a7fc640 1 -- 172.21.15.92:0/1102895572 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd750030850 con 0x7fd75c1065c0 2024-09-19T08:47:19.395 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.739+0000 7fd762228640 1 -- 172.21.15.92:0/1102895572 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd75c1065c0 msgr2=0x7fd75c1069c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:19.395 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.739+0000 7fd762228640 1 --2- 172.21.15.92:0/1102895572 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd75c1065c0 0x7fd75c1069c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd750009820 tx=0x7fd75002a270 comp rx=0 tx=0).stop 2024-09-19T08:47:19.395 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.739+0000 7fd762228640 1 -- 172.21.15.92:0/1102895572 shutdown_connections 2024-09-19T08:47:19.395 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.739+0000 7fd762228640 1 --2- 172.21.15.92:0/1102895572 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd75c1065c0 0x7fd75c1069c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:19.395 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.739+0000 7fd762228640 1 -- 172.21.15.92:0/1102895572 >> 172.21.15.92:0/1102895572 conn(0x7fd75c101d70 msgr2=0x7fd75c104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:19.396 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.739+0000 7fd762228640 1 -- 172.21.15.92:0/1102895572 shutdown_connections 2024-09-19T08:47:19.396 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.739+0000 7fd762228640 1 -- 172.21.15.92:0/1102895572 wait complete. 2024-09-19T08:47:19.396 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.740+0000 7fd762228640 1 Processor -- start 2024-09-19T08:47:19.396 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.740+0000 7fd762228640 1 -- start start 2024-09-19T08:47:19.396 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.740+0000 7fd762228640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd75c1065c0 0x7fd75c191780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:19.396 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.740+0000 7fd762228640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd75c10ab70 con 0x7fd75c1065c0 2024-09-19T08:47:19.396 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.740+0000 7fd75b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd75c1065c0 0x7fd75c191780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:19.396 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.740+0000 7fd75b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd75c1065c0 0x7fd75c191780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39602/0 (socket says 172.21.15.92:39602) 2024-09-19T08:47:19.396 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.740+0000 7fd75b7fe640 1 -- 172.21.15.92:0/3162131555 learned_addr learned my addr 172.21.15.92:0/3162131555 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:19.396 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.741+0000 7fd75b7fe640 1 -- 172.21.15.92:0/3162131555 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd75c191cc0 con 0x7fd75c1065c0 2024-09-19T08:47:19.396 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.741+0000 7fd75b7fe640 1 --2- 172.21.15.92:0/3162131555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd75c1065c0 0x7fd75c191780 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd750009940 tx=0x7fd750032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:19.396 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.741+0000 7fd758ff9640 1 -- 172.21.15.92:0/3162131555 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd750042070 con 0x7fd75c1065c0 2024-09-19T08:47:19.397 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.741+0000 7fd762228640 1 -- 172.21.15.92:0/3162131555 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd75c18feb0 con 0x7fd75c1065c0 2024-09-19T08:47:19.397 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.741+0000 7fd758ff9640 1 -- 172.21.15.92:0/3162131555 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd7500308c0 con 0x7fd75c1065c0 2024-09-19T08:47:19.397 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.741+0000 7fd758ff9640 1 -- 172.21.15.92:0/3162131555 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd750037040 con 0x7fd75c1065c0 2024-09-19T08:47:19.397 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.741+0000 7fd762228640 1 -- 172.21.15.92:0/3162131555 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd75c1903f0 con 0x7fd75c1065c0 2024-09-19T08:47:19.397 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.741+0000 7fd758ff9640 1 -- 172.21.15.92:0/3162131555 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd750045070 con 0x7fd75c1065c0 2024-09-19T08:47:19.397 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.741+0000 7fd758ff9640 1 -- 172.21.15.92:0/3162131555 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd750047bc0 con 0x7fd75c1065c0 2024-09-19T08:47:19.397 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.742+0000 7fd762228640 1 -- 172.21.15.92:0/3162131555 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd75c106a40 con 0x7fd75c1065c0 2024-09-19T08:47:19.397 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.744+0000 7fd758ff9640 1 -- 172.21.15.92:0/3162131555 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd7500327b0 con 0x7fd75c1065c0 2024-09-19T08:47:19.397 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.807+0000 7fd762228640 1 -- 172.21.15.92:0/3162131555 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fd75c195470 con 0x7fd75c1065c0 2024-09-19T08:47:19.397 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.808+0000 7fd758ff9640 1 -- 172.21.15.92:0/3162131555 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fd75003c870 con 0x7fd75c1065c0 2024-09-19T08:47:19.397 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.809+0000 7fd762228640 1 -- 172.21.15.92:0/3162131555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd75c1065c0 msgr2=0x7fd75c191780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:19.397 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.809+0000 7fd762228640 1 --2- 172.21.15.92:0/3162131555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd75c1065c0 0x7fd75c191780 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd750009940 tx=0x7fd750032ce0 comp rx=0 tx=0).stop 2024-09-19T08:47:19.397 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.809+0000 7fd762228640 1 -- 172.21.15.92:0/3162131555 shutdown_connections 2024-09-19T08:47:19.398 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.809+0000 7fd762228640 1 --2- 172.21.15.92:0/3162131555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd75c1065c0 0x7fd75c191780 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:19.398 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.809+0000 7fd762228640 1 -- 172.21.15.92:0/3162131555 >> 172.21.15.92:0/3162131555 conn(0x7fd75c101d70 msgr2=0x7fd75c102ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:19.398 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.809+0000 7fd762228640 1 -- 172.21.15.92:0/3162131555 shutdown_connections 2024-09-19T08:47:19.398 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:18.809+0000 7fd762228640 1 -- 172.21.15.92:0/3162131555 wait complete. 2024-09-19T08:47:19.398 INFO:teuthology.orchestra.run.smithi092.stdout:mgr not available, waiting (2/15)... 2024-09-19T08:47:20.253 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:19 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:19.914+0000 7f9e364fb040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:47:20.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:19 smithi092 ceph-mon[31407]: Activating manager daemon x 2024-09-19T08:47:20.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:19 smithi092 ceph-mon[31407]: mgrmap e2: x(active, starting, since 0.00299479s) 2024-09-19T08:47:20.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:19 smithi092 ceph-mon[31407]: from='mgr.14100 172.21.15.92:0/2561039145' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T08:47:20.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:19 smithi092 ceph-mon[31407]: from='mgr.14100 172.21.15.92:0/2561039145' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T08:47:20.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:19 smithi092 ceph-mon[31407]: from='mgr.14100 172.21.15.92:0/2561039145' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T08:47:20.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:19 smithi092 ceph-mon[31407]: from='mgr.14100 172.21.15.92:0/2561039145' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:47:20.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:19 smithi092 ceph-mon[31407]: from='mgr.14100 172.21.15.92:0/2561039145' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T08:47:20.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:19 smithi092 ceph-mon[31407]: Manager daemon x is now available 2024-09-19T08:47:20.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:19 smithi092 ceph-mon[31407]: from='mgr.14100 172.21.15.92:0/2561039145' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T08:47:20.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:19 smithi092 ceph-mon[31407]: from='mgr.14100 172.21.15.92:0/2561039145' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T08:47:20.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:19 smithi092 ceph-mon[31407]: from='mgr.14100 172.21.15.92:0/2561039145' entity='mgr.x' 2024-09-19T08:47:20.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:19 smithi092 ceph-mon[31407]: from='mgr.14100 172.21.15.92:0/2561039145' entity='mgr.x' 2024-09-19T08:47:20.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:19 smithi092 ceph-mon[31407]: from='mgr.14100 172.21.15.92:0/2561039145' entity='mgr.x' 2024-09-19T08:47:22.171 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:21 smithi092 ceph-mon[31407]: mgrmap e3: x(active, since 1.00678s) 2024-09-19T08:47:22.659 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-09-19T08:47:22.659 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:47:22.659 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "fsid": "91ff74f2-7663-11ef-bceb-c7b262605968", 2024-09-19T08:47:22.659 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T08:47:22.659 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T08:47:22.659 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T08:47:22.659 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T08:47:22.660 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:47:22.660 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T08:47:22.660 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T08:47:22.660 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 0 2024-09-19T08:47:22.660 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:47:22.660 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T08:47:22.660 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T08:47:22.660 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:47:22.660 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-19T08:47:22.660 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T08:47:22.661 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:47:22.661 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T08:47:22.661 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T08:47:22.661 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:47:22.661 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T08:47:22.661 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:47:22.661 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T08:47:22.661 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T08:47:22.661 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T08:47:22.661 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T08:47:22.661 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T08:47:22.661 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T08:47:22.661 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:47:22.662 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T08:47:22.662 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T08:47:22.662 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T08:47:22.662 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T08:47:22.662 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T08:47:22.662 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T08:47:22.662 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T08:47:22.662 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T08:47:22.662 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T08:47:22.662 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:47:22.662 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T08:47:22.662 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:47:22.662 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T08:47:08:161960+0000", 2024-09-19T08:47:22.662 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T08:47:22.662 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T08:47:22.663 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:47:22.663 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T08:47:22.663 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T08:47:22.663 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T08:47:22.663 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T08:47:22.663 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T08:47:22.663 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T08:47:22.663 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T08:47:22.663 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:47:22.663 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:47:22.663 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:47:22.663 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T08:47:22.663 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:47:22.663 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T08:47:08.162591+0000", 2024-09-19T08:47:22.663 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:47:22.664 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:47:22.664 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T08:47:22.664 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:47:22.664 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.930+0000 7fa8b931a640 1 Processor -- start 2024-09-19T08:47:22.664 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.930+0000 7fa8b931a640 1 -- start start 2024-09-19T08:47:22.664 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.930+0000 7fa8b931a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8b41065c0 0x7fa8b41069c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:22.664 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.930+0000 7fa8b931a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b4106f90 con 0x7fa8b41065c0 2024-09-19T08:47:22.664 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.930+0000 7fa8b2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8b41065c0 0x7fa8b41069c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:22.664 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.930+0000 7fa8b2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8b41065c0 0x7fa8b41069c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33482/0 (socket says 172.21.15.92:33482) 2024-09-19T08:47:22.664 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.930+0000 7fa8b2ffd640 1 -- 172.21.15.92:0/1409694165 learned_addr learned my addr 172.21.15.92:0/1409694165 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:22.664 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.930+0000 7fa8b2ffd640 1 -- 172.21.15.92:0/1409694165 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8b41077c0 con 0x7fa8b41065c0 2024-09-19T08:47:22.664 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.931+0000 7fa8b2ffd640 1 --2- 172.21.15.92:0/1409694165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8b41065c0 0x7fa8b41069c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4009820 tx=0x7fa8a402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=607b92369f8bd277 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:22.665 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.931+0000 7fa8b27fc640 1 -- 172.21.15.92:0/1409694165 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8a4037070 con 0x7fa8b41065c0 2024-09-19T08:47:22.665 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.931+0000 7fa8b27fc640 1 -- 172.21.15.92:0/1409694165 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa8a4032900 con 0x7fa8b41065c0 2024-09-19T08:47:22.665 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.931+0000 7fa8b27fc640 1 -- 172.21.15.92:0/1409694165 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8a4030850 con 0x7fa8b41065c0 2024-09-19T08:47:22.665 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.932+0000 7fa8b931a640 1 -- 172.21.15.92:0/1409694165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8b41065c0 msgr2=0x7fa8b41069c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:22.665 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.932+0000 7fa8b931a640 1 --2- 172.21.15.92:0/1409694165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8b41065c0 0x7fa8b41069c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4009820 tx=0x7fa8a402a270 comp rx=0 tx=0).stop 2024-09-19T08:47:22.665 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.932+0000 7fa8b931a640 1 -- 172.21.15.92:0/1409694165 shutdown_connections 2024-09-19T08:47:22.665 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.932+0000 7fa8b931a640 1 --2- 172.21.15.92:0/1409694165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8b41065c0 0x7fa8b41069c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:22.665 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.932+0000 7fa8b931a640 1 -- 172.21.15.92:0/1409694165 >> 172.21.15.92:0/1409694165 conn(0x7fa8b4101d70 msgr2=0x7fa8b4104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:22.665 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.932+0000 7fa8b931a640 1 -- 172.21.15.92:0/1409694165 shutdown_connections 2024-09-19T08:47:22.665 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.932+0000 7fa8b931a640 1 -- 172.21.15.92:0/1409694165 wait complete. 2024-09-19T08:47:22.665 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.933+0000 7fa8b931a640 1 Processor -- start 2024-09-19T08:47:22.665 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.933+0000 7fa8b931a640 1 -- start start 2024-09-19T08:47:22.665 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.933+0000 7fa8b931a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8b41065c0 0x7fa8b4199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:22.666 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.933+0000 7fa8b931a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b407aff0 con 0x7fa8b41065c0 2024-09-19T08:47:22.666 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.933+0000 7fa8b2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8b41065c0 0x7fa8b4199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:22.666 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.933+0000 7fa8b2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8b41065c0 0x7fa8b4199480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33492/0 (socket says 172.21.15.92:33492) 2024-09-19T08:47:22.666 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.933+0000 7fa8b2ffd640 1 -- 172.21.15.92:0/397778639 learned_addr learned my addr 172.21.15.92:0/397778639 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:22.666 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.933+0000 7fa8b2ffd640 1 -- 172.21.15.92:0/397778639 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8b41999c0 con 0x7fa8b41065c0 2024-09-19T08:47:22.666 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.934+0000 7fa8b2ffd640 1 --2- 172.21.15.92:0/397778639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8b41065c0 0x7fa8b4199480 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4009940 tx=0x7fa8a4032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:22.666 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.934+0000 7fa8b0ff9640 1 -- 172.21.15.92:0/397778639 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8a4042070 con 0x7fa8b41065c0 2024-09-19T08:47:22.666 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.934+0000 7fa8b0ff9640 1 -- 172.21.15.92:0/397778639 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa8a40308c0 con 0x7fa8b41065c0 2024-09-19T08:47:22.666 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.934+0000 7fa8b931a640 1 -- 172.21.15.92:0/397778639 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8b4199c50 con 0x7fa8b41065c0 2024-09-19T08:47:22.666 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.934+0000 7fa8b0ff9640 1 -- 172.21.15.92:0/397778639 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8a4037040 con 0x7fa8b41065c0 2024-09-19T08:47:22.666 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.934+0000 7fa8b931a640 1 -- 172.21.15.92:0/397778639 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8b419c940 con 0x7fa8b41065c0 2024-09-19T08:47:22.666 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.935+0000 7fa8b0ff9640 1 -- 172.21.15.92:0/397778639 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7fa8a4045070 con 0x7fa8b41065c0 2024-09-19T08:47:22.666 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.935+0000 7fa8b0ff9640 1 --2- 172.21.15.92:0/397778639 >> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] conn(0x7fa8a003b410 0x7fa8a003d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:22.667 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.935+0000 7fa8b0ff9640 1 -- 172.21.15.92:0/397778639 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa8a406c190 con 0x7fa8b41065c0 2024-09-19T08:47:22.667 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.935+0000 7fa8abfff640 1 --2- 172.21.15.92:0/397778639 >> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] conn(0x7fa8a003b410 0x7fa8a003d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:22.667 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.935+0000 7fa8b931a640 1 -- 172.21.15.92:0/397778639 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8b4106a40 con 0x7fa8b41065c0 2024-09-19T08:47:22.667 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.936+0000 7fa8abfff640 1 --2- 172.21.15.92:0/397778639 >> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] conn(0x7fa8a003b410 0x7fa8a003d8d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa89c0098c0 tx=0x7fa89c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:22.667 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:21.940+0000 7fa8b0ff9640 1 -- 172.21.15.92:0/397778639 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa8a4045360 con 0x7fa8b41065c0 2024-09-19T08:47:22.667 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:22.170+0000 7fa8b931a640 1 -- 172.21.15.92:0/397778639 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fa8b41928f0 con 0x7fa8b41065c0 2024-09-19T08:47:22.667 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:22.170+0000 7fa8b0ff9640 1 -- 172.21.15.92:0/397778639 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7fa8a402ed90 con 0x7fa8b41065c0 2024-09-19T08:47:22.667 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:22.172+0000 7fa8b931a640 1 -- 172.21.15.92:0/397778639 >> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] conn(0x7fa8a003b410 msgr2=0x7fa8a003d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:22.667 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:22.172+0000 7fa8b931a640 1 --2- 172.21.15.92:0/397778639 >> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] conn(0x7fa8a003b410 0x7fa8a003d8d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa89c0098c0 tx=0x7fa89c006db0 comp rx=0 tx=0).stop 2024-09-19T08:47:22.667 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:22.172+0000 7fa8b931a640 1 -- 172.21.15.92:0/397778639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8b41065c0 msgr2=0x7fa8b4199480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:22.667 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:22.172+0000 7fa8b931a640 1 --2- 172.21.15.92:0/397778639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8b41065c0 0x7fa8b4199480 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4009940 tx=0x7fa8a4032ce0 comp rx=0 tx=0).stop 2024-09-19T08:47:22.667 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:22.172+0000 7fa8b931a640 1 -- 172.21.15.92:0/397778639 shutdown_connections 2024-09-19T08:47:22.667 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:22.172+0000 7fa8b931a640 1 --2- 172.21.15.92:0/397778639 >> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] conn(0x7fa8a003b410 0x7fa8a003d8d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:22.668 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:22.172+0000 7fa8b931a640 1 --2- 172.21.15.92:0/397778639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8b41065c0 0x7fa8b4199480 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:22.668 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:22.172+0000 7fa8b931a640 1 -- 172.21.15.92:0/397778639 >> 172.21.15.92:0/397778639 conn(0x7fa8b4101d70 msgr2=0x7fa8b418fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:22.668 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:22.173+0000 7fa8b931a640 1 -- 172.21.15.92:0/397778639 shutdown_connections 2024-09-19T08:47:22.668 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:22.173+0000 7fa8b931a640 1 -- 172.21.15.92:0/397778639 wait complete. 2024-09-19T08:47:22.668 INFO:teuthology.orchestra.run.smithi092.stdout:mgr is available 2024-09-19T08:47:23.179 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:22 smithi092 ceph-mon[31407]: mgrmap e4: x(active, since 2s) 2024-09-19T08:47:23.179 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:22 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/397778639' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T08:47:23.760 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-09-19T08:47:23.760 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T08:47:23.760 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout fsid = 91ff74f2-7663-11ef-bceb-c7b262605968 2024-09-19T08:47:23.760 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.92:3300,v1:172.21.15.92:6789] 2024-09-19T08:47:23.760 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T08:47:23.760 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T08:47:23.760 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T08:47:23.761 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T08:47:23.761 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-09-19T08:47:23.761 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T08:47:23.761 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T08:47:23.761 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-09-19T08:47:23.761 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T08:47:23.761 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T08:47:23.761 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T08:47:23.761 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T08:47:23.761 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T08:47:23.761 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T08:47:23.761 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.002+0000 7f547f71b640 1 Processor -- start 2024-09-19T08:47:23.761 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.003+0000 7f547f71b640 1 -- start start 2024-09-19T08:47:23.761 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.003+0000 7f547f71b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54781081b0 0x7f547810a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:23.762 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.003+0000 7f547f71b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f547807be50 con 0x7f54781081b0 2024-09-19T08:47:23.762 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.003+0000 7f547d4b7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54781081b0 0x7f547810a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:23.762 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.003+0000 7f547d4b7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54781081b0 0x7f547810a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33508/0 (socket says 172.21.15.92:33508) 2024-09-19T08:47:23.762 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.003+0000 7f547d4b7640 1 -- 172.21.15.92:0/3117265923 learned_addr learned my addr 172.21.15.92:0/3117265923 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:23.762 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.003+0000 7f547d4b7640 1 -- 172.21.15.92:0/3117265923 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f547810aae0 con 0x7f54781081b0 2024-09-19T08:47:23.762 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.004+0000 7f547d4b7640 1 --2- 172.21.15.92:0/3117265923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54781081b0 0x7f547810a5a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f546c009820 tx=0x7f546c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0c9d252e1605a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:23.762 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.004+0000 7f546bfff640 1 -- 172.21.15.92:0/3117265923 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f546c037070 con 0x7f54781081b0 2024-09-19T08:47:23.762 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.004+0000 7f546bfff640 1 -- 172.21.15.92:0/3117265923 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f546c032900 con 0x7f54781081b0 2024-09-19T08:47:23.762 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.004+0000 7f546bfff640 1 -- 172.21.15.92:0/3117265923 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f546c030850 con 0x7f54781081b0 2024-09-19T08:47:23.762 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.005+0000 7f547f71b640 1 -- 172.21.15.92:0/3117265923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54781081b0 msgr2=0x7f547810a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:23.762 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.005+0000 7f547f71b640 1 --2- 172.21.15.92:0/3117265923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54781081b0 0x7f547810a5a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f546c009820 tx=0x7f546c02a270 comp rx=0 tx=0).stop 2024-09-19T08:47:23.762 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.005+0000 7f547f71b640 1 -- 172.21.15.92:0/3117265923 shutdown_connections 2024-09-19T08:47:23.762 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.005+0000 7f547f71b640 1 --2- 172.21.15.92:0/3117265923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54781081b0 0x7f547810a5a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:23.763 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.005+0000 7f547f71b640 1 -- 172.21.15.92:0/3117265923 >> 172.21.15.92:0/3117265923 conn(0x7f5478101d70 msgr2=0x7f5478104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:23.763 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.005+0000 7f547f71b640 1 -- 172.21.15.92:0/3117265923 shutdown_connections 2024-09-19T08:47:23.763 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.005+0000 7f547f71b640 1 -- 172.21.15.92:0/3117265923 wait complete. 2024-09-19T08:47:23.763 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.005+0000 7f547f71b640 1 Processor -- start 2024-09-19T08:47:23.763 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.005+0000 7f547f71b640 1 -- start start 2024-09-19T08:47:23.763 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.006+0000 7f547f71b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54781081b0 0x7f5478107a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:23.763 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.006+0000 7f547f71b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f547810ba50 con 0x7f54781081b0 2024-09-19T08:47:23.763 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.006+0000 7f547d4b7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54781081b0 0x7f5478107a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:23.763 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.006+0000 7f547d4b7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54781081b0 0x7f5478107a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33520/0 (socket says 172.21.15.92:33520) 2024-09-19T08:47:23.763 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.006+0000 7f547d4b7640 1 -- 172.21.15.92:0/3398136696 learned_addr learned my addr 172.21.15.92:0/3398136696 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:23.763 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.006+0000 7f547d4b7640 1 -- 172.21.15.92:0/3398136696 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5478107f70 con 0x7f54781081b0 2024-09-19T08:47:23.763 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.006+0000 7f547d4b7640 1 --2- 172.21.15.92:0/3398136696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54781081b0 0x7f5478107a30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f546c0097f0 tx=0x7f546c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:23.763 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.006+0000 7f546a7fc640 1 -- 172.21.15.92:0/3398136696 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f546c037040 con 0x7f54781081b0 2024-09-19T08:47:23.764 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.006+0000 7f546a7fc640 1 -- 172.21.15.92:0/3398136696 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f546c040070 con 0x7f54781081b0 2024-09-19T08:47:23.764 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.006+0000 7f546a7fc640 1 -- 172.21.15.92:0/3398136696 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f546c03a390 con 0x7f54781081b0 2024-09-19T08:47:23.764 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.006+0000 7f547f71b640 1 -- 172.21.15.92:0/3398136696 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5478106160 con 0x7f54781081b0 2024-09-19T08:47:23.764 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.006+0000 7f547f71b640 1 -- 172.21.15.92:0/3398136696 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5478106640 con 0x7f54781081b0 2024-09-19T08:47:23.764 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.007+0000 7f546a7fc640 1 -- 172.21.15.92:0/3398136696 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f546c03a5e0 con 0x7f54781081b0 2024-09-19T08:47:23.764 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.007+0000 7f546a7fc640 1 --2- 172.21.15.92:0/3398136696 >> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] conn(0x7f54640391b0 0x7f546403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:23.764 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.007+0000 7f546a7fc640 1 -- 172.21.15.92:0/3398136696 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f546c06c3e0 con 0x7f54781081b0 2024-09-19T08:47:23.764 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.007+0000 7f547f71b640 1 -- 172.21.15.92:0/3398136696 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5478108610 con 0x7f54781081b0 2024-09-19T08:47:23.764 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.007+0000 7f547ccb6640 1 --2- 172.21.15.92:0/3398136696 >> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] conn(0x7f54640391b0 0x7f546403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:23.764 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.008+0000 7f547ccb6640 1 --2- 172.21.15.92:0/3398136696 >> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] conn(0x7f54640391b0 0x7f546403b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f54740098c0 tx=0x7f5474006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:23.764 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.012+0000 7f546a7fc640 1 -- 172.21.15.92:0/3398136696 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f546c06c140 con 0x7f54781081b0 2024-09-19T08:47:23.764 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.178+0000 7f547f71b640 1 -- 172.21.15.92:0/3398136696 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f54781068c0 con 0x7f54781081b0 2024-09-19T08:47:23.764 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.179+0000 7f546a7fc640 1 -- 172.21.15.92:0/3398136696 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7f546c043760 con 0x7f54781081b0 2024-09-19T08:47:23.765 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.181+0000 7f547f71b640 1 -- 172.21.15.92:0/3398136696 >> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] conn(0x7f54640391b0 msgr2=0x7f546403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:23.765 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.181+0000 7f547f71b640 1 --2- 172.21.15.92:0/3398136696 >> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] conn(0x7f54640391b0 0x7f546403b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f54740098c0 tx=0x7f5474006db0 comp rx=0 tx=0).stop 2024-09-19T08:47:23.765 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.181+0000 7f547f71b640 1 -- 172.21.15.92:0/3398136696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54781081b0 msgr2=0x7f5478107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:23.765 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.181+0000 7f547f71b640 1 --2- 172.21.15.92:0/3398136696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54781081b0 0x7f5478107a30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f546c0097f0 tx=0x7f546c030d80 comp rx=0 tx=0).stop 2024-09-19T08:47:23.765 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.182+0000 7f547f71b640 1 -- 172.21.15.92:0/3398136696 shutdown_connections 2024-09-19T08:47:23.765 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.182+0000 7f547f71b640 1 --2- 172.21.15.92:0/3398136696 >> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] conn(0x7f54640391b0 0x7f546403b670 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:23.765 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.182+0000 7f547f71b640 1 --2- 172.21.15.92:0/3398136696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54781081b0 0x7f5478107a30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:23.765 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.182+0000 7f547f71b640 1 -- 172.21.15.92:0/3398136696 >> 172.21.15.92:0/3398136696 conn(0x7f5478101d70 msgr2=0x7f5478102900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:23.765 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.182+0000 7f547f71b640 1 -- 172.21.15.92:0/3398136696 shutdown_connections 2024-09-19T08:47:23.765 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:23.182+0000 7f547f71b640 1 -- 172.21.15.92:0/3398136696 wait complete. 2024-09-19T08:47:23.765 INFO:teuthology.orchestra.run.smithi092.stdout:Enabling cephadm module... 2024-09-19T08:47:24.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:23 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3398136696' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T08:47:25.240 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:24 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/2013965300' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-19T08:47:25.241 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:24 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: ignoring --setuser ceph since I am not root 2024-09-19T08:47:25.241 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:24 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: ignoring --setgroup ceph since I am not root 2024-09-19T08:47:25.241 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:25 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:25.086+0000 7fe6a7062040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T08:47:25.241 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:25 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:25.142+0000 7fe6a7062040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:47:25.501 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:25 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:25.289+0000 7fe6a7062040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:47:25.502 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:25 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:25.354+0000 7fe6a7062040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:47:25.502 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:25 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:25.500+0000 7fe6a7062040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:47:25.541 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.082+0000 7f118e06b640 1 Processor -- start 2024-09-19T08:47:25.541 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.082+0000 7f118e06b640 1 -- start start 2024-09-19T08:47:25.541 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.082+0000 7f118e06b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11881076b0 0x7f1188107ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:25.541 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.082+0000 7f118e06b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1188108080 con 0x7f11881076b0 2024-09-19T08:47:25.541 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.082+0000 7f11877fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11881076b0 0x7f1188107ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:25.541 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.082+0000 7f11877fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11881076b0 0x7f1188107ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33534/0 (socket says 172.21.15.92:33534) 2024-09-19T08:47:25.542 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.082+0000 7f11877fe640 1 -- 172.21.15.92:0/694487641 learned_addr learned my addr 172.21.15.92:0/694487641 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:25.542 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.083+0000 7f11877fe640 1 -- 172.21.15.92:0/694487641 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11881088b0 con 0x7f11881076b0 2024-09-19T08:47:25.542 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.083+0000 7f11877fe640 1 --2- 172.21.15.92:0/694487641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11881076b0 0x7f1188107ab0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1178009820 tx=0x7f117802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdf00f233f276160 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:25.542 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.083+0000 7f1186ffd640 1 -- 172.21.15.92:0/694487641 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1178037070 con 0x7f11881076b0 2024-09-19T08:47:25.542 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.083+0000 7f1186ffd640 1 -- 172.21.15.92:0/694487641 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1178032900 con 0x7f11881076b0 2024-09-19T08:47:25.542 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.083+0000 7f1186ffd640 1 -- 172.21.15.92:0/694487641 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1178030850 con 0x7f11881076b0 2024-09-19T08:47:25.542 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.084+0000 7f118e06b640 1 -- 172.21.15.92:0/694487641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11881076b0 msgr2=0x7f1188107ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:25.542 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.084+0000 7f118e06b640 1 --2- 172.21.15.92:0/694487641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11881076b0 0x7f1188107ab0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1178009820 tx=0x7f117802a270 comp rx=0 tx=0).stop 2024-09-19T08:47:25.542 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.084+0000 7f118e06b640 1 -- 172.21.15.92:0/694487641 shutdown_connections 2024-09-19T08:47:25.542 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.084+0000 7f118e06b640 1 --2- 172.21.15.92:0/694487641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11881076b0 0x7f1188107ab0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:25.542 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.084+0000 7f118e06b640 1 -- 172.21.15.92:0/694487641 >> 172.21.15.92:0/694487641 conn(0x7f1188102e80 msgr2=0x7f11881052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:25.543 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.084+0000 7f118e06b640 1 -- 172.21.15.92:0/694487641 shutdown_connections 2024-09-19T08:47:25.543 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.084+0000 7f118e06b640 1 -- 172.21.15.92:0/694487641 wait complete. 2024-09-19T08:47:25.543 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.085+0000 7f118e06b640 1 Processor -- start 2024-09-19T08:47:25.543 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.085+0000 7f118e06b640 1 -- start start 2024-09-19T08:47:25.543 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.085+0000 7f118e06b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11881076b0 0x7f118819b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:25.543 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.085+0000 7f118e06b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f118810bc60 con 0x7f11881076b0 2024-09-19T08:47:25.543 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.085+0000 7f11877fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11881076b0 0x7f118819b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:25.543 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.085+0000 7f11877fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11881076b0 0x7f118819b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33546/0 (socket says 172.21.15.92:33546) 2024-09-19T08:47:25.543 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.085+0000 7f11877fe640 1 -- 172.21.15.92:0/2013965300 learned_addr learned my addr 172.21.15.92:0/2013965300 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:25.543 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.085+0000 7f11877fe640 1 -- 172.21.15.92:0/2013965300 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f118819bba0 con 0x7f11881076b0 2024-09-19T08:47:25.543 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.085+0000 7f11877fe640 1 --2- 172.21.15.92:0/2013965300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11881076b0 0x7f118819b660 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f11780097f0 tx=0x7f1178030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:25.543 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.086+0000 7f11857fa640 1 -- 172.21.15.92:0/2013965300 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1178037040 con 0x7f11881076b0 2024-09-19T08:47:25.544 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.086+0000 7f11857fa640 1 -- 172.21.15.92:0/2013965300 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1178040070 con 0x7f11881076b0 2024-09-19T08:47:25.544 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.086+0000 7f11857fa640 1 -- 172.21.15.92:0/2013965300 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f117803a390 con 0x7f11881076b0 2024-09-19T08:47:25.544 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.086+0000 7f118e06b640 1 -- 172.21.15.92:0/2013965300 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f118819be30 con 0x7f11881076b0 2024-09-19T08:47:25.544 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.086+0000 7f118e06b640 1 -- 172.21.15.92:0/2013965300 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f118819eb20 con 0x7f11881076b0 2024-09-19T08:47:25.544 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.086+0000 7f11857fa640 1 -- 172.21.15.92:0/2013965300 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f117803a630 con 0x7f11881076b0 2024-09-19T08:47:25.544 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.087+0000 7f11857fa640 1 --2- 172.21.15.92:0/2013965300 >> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] conn(0x7f1174039160 0x7f117403b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:25.544 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.087+0000 7f118e06b640 1 -- 172.21.15.92:0/2013965300 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1188107b30 con 0x7f11881076b0 2024-09-19T08:47:25.544 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.087+0000 7f11857fa640 1 -- 172.21.15.92:0/2013965300 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f117806c530 con 0x7f11881076b0 2024-09-19T08:47:25.544 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.087+0000 7f117ffff640 1 --2- 172.21.15.92:0/2013965300 >> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] conn(0x7f1174039160 0x7f117403b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:25.544 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.087+0000 7f117ffff640 1 --2- 172.21.15.92:0/2013965300 >> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] conn(0x7f1174039160 0x7f117403b620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f11700098c0 tx=0x7f1170006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:25.544 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.091+0000 7f11857fa640 1 -- 172.21.15.92:0/2013965300 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1178043360 con 0x7f11881076b0 2024-09-19T08:47:25.544 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.304+0000 7f118e06b640 1 -- 172.21.15.92:0/2013965300 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f118819c2b0 con 0x7f11881076b0 2024-09-19T08:47:25.544 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.926+0000 7f11857fa640 1 -- 172.21.15.92:0/2013965300 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f117806c290 con 0x7f11881076b0 2024-09-19T08:47:25.545 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.928+0000 7f11857fa640 1 -- 172.21.15.92:0/2013965300 <== mon.0 v2:172.21.15.92:3300/0 8 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f1178032c50 con 0x7f11881076b0 2024-09-19T08:47:25.545 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.930+0000 7f118e06b640 1 -- 172.21.15.92:0/2013965300 >> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] conn(0x7f1174039160 msgr2=0x7f117403b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:25.545 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.930+0000 7f118e06b640 1 --2- 172.21.15.92:0/2013965300 >> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] conn(0x7f1174039160 0x7f117403b620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f11700098c0 tx=0x7f1170006db0 comp rx=0 tx=0).stop 2024-09-19T08:47:25.545 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.930+0000 7f118e06b640 1 -- 172.21.15.92:0/2013965300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11881076b0 msgr2=0x7f118819b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:25.545 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.930+0000 7f118e06b640 1 --2- 172.21.15.92:0/2013965300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11881076b0 0x7f118819b660 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f11780097f0 tx=0x7f1178030d80 comp rx=0 tx=0).stop 2024-09-19T08:47:25.545 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.930+0000 7f118e06b640 1 -- 172.21.15.92:0/2013965300 shutdown_connections 2024-09-19T08:47:25.545 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.930+0000 7f118e06b640 1 --2- 172.21.15.92:0/2013965300 >> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] conn(0x7f1174039160 0x7f117403b620 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:25.545 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.930+0000 7f118e06b640 1 --2- 172.21.15.92:0/2013965300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11881076b0 0x7f118819b660 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:25.545 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.930+0000 7f118e06b640 1 -- 172.21.15.92:0/2013965300 >> 172.21.15.92:0/2013965300 conn(0x7f1188102e80 msgr2=0x7f1188103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:25.545 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.930+0000 7f118e06b640 1 -- 172.21.15.92:0/2013965300 shutdown_connections 2024-09-19T08:47:25.545 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:24.930+0000 7f118e06b640 1 -- 172.21.15.92:0/2013965300 wait complete. 2024-09-19T08:47:25.753 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:25 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:25.647+0000 7fe6a7062040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:47:26.032 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:25 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/2013965300' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-19T08:47:26.033 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:25 smithi092 ceph-mon[31407]: mgrmap e5: x(active, since 5s) 2024-09-19T08:47:26.033 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:25 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:25.975+0000 7fe6a7062040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:47:26.472 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:26 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:26.040+0000 7fe6a7062040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:47:26.472 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:26 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:26.236+0000 7fe6a7062040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:47:26.743 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:47:26.750 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-19T08:47:26.750 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T08:47:26.750 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T08:47:26.750 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T08:47:26.750 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:47:26.750 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.938+0000 7f7c48179640 1 Processor -- start 2024-09-19T08:47:26.750 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.938+0000 7f7c48179640 1 -- start start 2024-09-19T08:47:26.750 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.938+0000 7f7c48179640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c40105fb0 0x7f7c401063b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:26.750 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.938+0000 7f7c48179640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4007be50 con 0x7f7c40105fb0 2024-09-19T08:47:26.750 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.938+0000 7f7c45f15640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c40105fb0 0x7f7c401063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:26.750 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.938+0000 7f7c45f15640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c40105fb0 0x7f7c401063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33578/0 (socket says 172.21.15.92:33578) 2024-09-19T08:47:26.751 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.938+0000 7f7c45f15640 1 -- 172.21.15.92:0/2589637015 learned_addr learned my addr 172.21.15.92:0/2589637015 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:26.751 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.939+0000 7f7c45f15640 1 -- 172.21.15.92:0/2589637015 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c401068f0 con 0x7f7c40105fb0 2024-09-19T08:47:26.751 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.940+0000 7f7c45f15640 1 --2- 172.21.15.92:0/2589637015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c40105fb0 0x7f7c401063b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009820 tx=0x7f7c3c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d8d8ab378e558f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:26.751 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.940+0000 7f7c44f13640 1 -- 172.21.15.92:0/2589637015 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c3c037070 con 0x7f7c40105fb0 2024-09-19T08:47:26.751 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.940+0000 7f7c44f13640 1 -- 172.21.15.92:0/2589637015 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7c3c032900 con 0x7f7c40105fb0 2024-09-19T08:47:26.751 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.940+0000 7f7c44f13640 1 -- 172.21.15.92:0/2589637015 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c3c030850 con 0x7f7c40105fb0 2024-09-19T08:47:26.751 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.941+0000 7f7c48179640 1 -- 172.21.15.92:0/2589637015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c40105fb0 msgr2=0x7f7c401063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:26.751 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.941+0000 7f7c48179640 1 --2- 172.21.15.92:0/2589637015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c40105fb0 0x7f7c401063b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009820 tx=0x7f7c3c02a270 comp rx=0 tx=0).stop 2024-09-19T08:47:26.751 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.941+0000 7f7c48179640 1 -- 172.21.15.92:0/2589637015 shutdown_connections 2024-09-19T08:47:26.751 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.941+0000 7f7c48179640 1 --2- 172.21.15.92:0/2589637015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c40105fb0 0x7f7c401063b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:26.751 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.941+0000 7f7c48179640 1 -- 172.21.15.92:0/2589637015 >> 172.21.15.92:0/2589637015 conn(0x7f7c40101d80 msgr2=0x7f7c401041a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:26.751 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.941+0000 7f7c48179640 1 -- 172.21.15.92:0/2589637015 shutdown_connections 2024-09-19T08:47:26.752 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.941+0000 7f7c48179640 1 -- 172.21.15.92:0/2589637015 wait complete. 2024-09-19T08:47:26.752 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.942+0000 7f7c48179640 1 Processor -- start 2024-09-19T08:47:26.752 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.942+0000 7f7c48179640 1 -- start start 2024-09-19T08:47:26.752 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.942+0000 7f7c48179640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c40105fb0 0x7f7c4019d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:26.752 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.942+0000 7f7c48179640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7c40107980 con 0x7f7c40105fb0 2024-09-19T08:47:26.752 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.943+0000 7f7c45f15640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c40105fb0 0x7f7c4019d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:26.752 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.943+0000 7f7c45f15640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c40105fb0 0x7f7c4019d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33588/0 (socket says 172.21.15.92:33588) 2024-09-19T08:47:26.752 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.943+0000 7f7c45f15640 1 -- 172.21.15.92:0/2826757961 learned_addr learned my addr 172.21.15.92:0/2826757961 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:26.752 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.943+0000 7f7c45f15640 1 -- 172.21.15.92:0/2826757961 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c4019dd90 con 0x7f7c40105fb0 2024-09-19T08:47:26.752 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.943+0000 7f7c45f15640 1 --2- 172.21.15.92:0/2826757961 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c40105fb0 0x7f7c4019d850 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c032ce0 tx=0x7f7c3c032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:26.752 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.943+0000 7f7c36ffd640 1 -- 172.21.15.92:0/2826757961 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c3c042070 con 0x7f7c40105fb0 2024-09-19T08:47:26.752 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.943+0000 7f7c48179640 1 -- 172.21.15.92:0/2826757961 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c4019e020 con 0x7f7c40105fb0 2024-09-19T08:47:26.752 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.943+0000 7f7c48179640 1 -- 172.21.15.92:0/2826757961 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c401a0d10 con 0x7f7c40105fb0 2024-09-19T08:47:26.753 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.943+0000 7f7c36ffd640 1 -- 172.21.15.92:0/2826757961 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7c3c0308c0 con 0x7f7c40105fb0 2024-09-19T08:47:26.753 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.943+0000 7f7c36ffd640 1 -- 172.21.15.92:0/2826757961 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c3c037040 con 0x7f7c40105fb0 2024-09-19T08:47:26.753 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.944+0000 7f7c48179640 1 -- 172.21.15.92:0/2826757961 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c4019e500 con 0x7f7c40105fb0 2024-09-19T08:47:26.753 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.944+0000 7f7c36ffd640 1 -- 172.21.15.92:0/2826757961 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f7c3c045070 con 0x7f7c40105fb0 2024-09-19T08:47:26.753 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.945+0000 7f7c36ffd640 1 --2- 172.21.15.92:0/2826757961 >> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] conn(0x7f7c2c039200 0x7f7c2c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:26.753 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.945+0000 7f7c36ffd640 1 -- 172.21.15.92:0/2826757961 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7c3c06c270 con 0x7f7c40105fb0 2024-09-19T08:47:26.753 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.945+0000 7f7c45714640 1 -- 172.21.15.92:0/2826757961 >> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] conn(0x7f7c2c039200 msgr2=0x7f7c2c03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/1369295034 2024-09-19T08:47:26.753 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.945+0000 7f7c45714640 1 --2- 172.21.15.92:0/2826757961 >> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] conn(0x7f7c2c039200 0x7f7c2c03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:47:26.753 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:25.949+0000 7f7c36ffd640 1 -- 172.21.15.92:0/2826757961 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7c4019e500 con 0x7f7c40105fb0 2024-09-19T08:47:26.753 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:26.146+0000 7f7c45714640 1 -- 172.21.15.92:0/2826757961 >> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] conn(0x7f7c2c039200 msgr2=0x7f7c2c03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/1369295034 2024-09-19T08:47:26.753 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:26.146+0000 7f7c45714640 1 --2- 172.21.15.92:0/2826757961 >> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] conn(0x7f7c2c039200 0x7f7c2c03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T08:47:26.753 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:26.169+0000 7f7c48179640 1 -- 172.21.15.92:0/2826757961 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f7c4002da40 con 0x7f7c40105fb0 2024-09-19T08:47:26.753 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:26.169+0000 7f7c36ffd640 1 -- 172.21.15.92:0/2826757961 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f7c3c03cd80 con 0x7f7c40105fb0 2024-09-19T08:47:26.754 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:26.171+0000 7f7c48179640 1 -- 172.21.15.92:0/2826757961 >> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] conn(0x7f7c2c039200 msgr2=0x7f7c2c03b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:47:26.754 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:26.171+0000 7f7c48179640 1 --2- 172.21.15.92:0/2826757961 >> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] conn(0x7f7c2c039200 0x7f7c2c03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:26.754 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:26.171+0000 7f7c48179640 1 -- 172.21.15.92:0/2826757961 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c40105fb0 msgr2=0x7f7c4019d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:26.754 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:26.171+0000 7f7c48179640 1 --2- 172.21.15.92:0/2826757961 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c40105fb0 0x7f7c4019d850 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c032ce0 tx=0x7f7c3c032d10 comp rx=0 tx=0).stop 2024-09-19T08:47:26.754 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:26.172+0000 7f7c48179640 1 -- 172.21.15.92:0/2826757961 shutdown_connections 2024-09-19T08:47:26.754 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:26.172+0000 7f7c48179640 1 --2- 172.21.15.92:0/2826757961 >> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] conn(0x7f7c2c039200 0x7f7c2c03b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:26.754 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:26.172+0000 7f7c48179640 1 --2- 172.21.15.92:0/2826757961 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c40105fb0 0x7f7c4019d850 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:26.754 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:26.172+0000 7f7c48179640 1 -- 172.21.15.92:0/2826757961 >> 172.21.15.92:0/2826757961 conn(0x7f7c40101d80 msgr2=0x7f7c40194510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:26.754 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:26.172+0000 7f7c48179640 1 -- 172.21.15.92:0/2826757961 shutdown_connections 2024-09-19T08:47:26.754 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:26.172+0000 7f7c48179640 1 -- 172.21.15.92:0/2826757961 wait complete. 2024-09-19T08:47:26.754 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for the mgr to restart... 2024-09-19T08:47:26.754 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for mgr epoch 5... 2024-09-19T08:47:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:26 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/2826757961' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T08:47:27.253 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:27 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:27.187+0000 7fe6a7062040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:47:27.753 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:27 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:27.254+0000 7fe6a7062040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:47:28.069 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:27 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:27.954+0000 7fe6a7062040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:47:28.069 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:28 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:28.069+0000 7fe6a7062040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:47:28.420 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:28 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:28.211+0000 7fe6a7062040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:47:28.420 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:28 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:28.271+0000 7fe6a7062040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:47:28.420 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:28 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:28.420+0000 7fe6a7062040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:47:28.703 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:28 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:28.487+0000 7fe6a7062040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:47:28.703 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:28 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:28.546+0000 7fe6a7062040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:47:28.703 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:28 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:28.703+0000 7fe6a7062040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:47:28.974 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:28 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:28.767+0000 7fe6a7062040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:47:28.974 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:28 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:28.833+0000 7fe6a7062040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:47:28.974 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:28 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:28.915+0000 7fe6a7062040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:47:28.974 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:28 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:28.974+0000 7fe6a7062040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:47:29.253 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:29 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:29.033+0000 7fe6a7062040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:47:30.253 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:29 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:29.810+0000 7fe6a7062040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:47:30.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:29 smithi092 ceph-mon[31407]: Active manager daemon x restarted 2024-09-19T08:47:30.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:29 smithi092 ceph-mon[31407]: Activating manager daemon x 2024-09-19T08:47:30.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:29 smithi092 ceph-mon[31407]: osdmap e2: 0 total, 0 up, 0 in 2024-09-19T08:47:30.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:29 smithi092 ceph-mon[31407]: mgrmap e6: x(active, starting, since 0.00336275s) 2024-09-19T08:47:30.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:29 smithi092 ceph-mon[31407]: from='mgr.14118 172.21.15.92:0/17008104' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:47:30.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:29 smithi092 ceph-mon[31407]: from='mgr.14118 172.21.15.92:0/17008104' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T08:47:30.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:29 smithi092 ceph-mon[31407]: from='mgr.14118 172.21.15.92:0/17008104' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T08:47:30.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:29 smithi092 ceph-mon[31407]: from='mgr.14118 172.21.15.92:0/17008104' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T08:47:30.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:29 smithi092 ceph-mon[31407]: from='mgr.14118 172.21.15.92:0/17008104' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T08:47:30.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:29 smithi092 ceph-mon[31407]: Manager daemon x is now available 2024-09-19T08:47:30.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:29 smithi092 ceph-mon[31407]: from='mgr.14118 172.21.15.92:0/17008104' entity='mgr.x' 2024-09-19T08:47:30.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:29 smithi092 ceph-mon[31407]: from='mgr.14118 172.21.15.92:0/17008104' entity='mgr.x' 2024-09-19T08:47:30.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:29 smithi092 ceph-mon[31407]: from='mgr.14118 172.21.15.92:0/17008104' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:47:30.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:29 smithi092 ceph-mon[31407]: from='mgr.14118 172.21.15.92:0/17008104' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:47:30.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:29 smithi092 ceph-mon[31407]: from='mgr.14118 172.21.15.92:0/17008104' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T08:47:30.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:29 smithi092 ceph-mon[31407]: from='mgr.14118 172.21.15.92:0/17008104' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T08:47:31.105 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:30 smithi092 ceph-mon[31407]: Found migration_current of "None". Setting to last migration. 2024-09-19T08:47:31.105 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:30 smithi092 ceph-mon[31407]: from='mgr.14118 172.21.15.92:0/17008104' entity='mgr.x' 2024-09-19T08:47:31.105 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:30 smithi092 ceph-mon[31407]: from='mgr.14118 172.21.15.92:0/17008104' entity='mgr.x' 2024-09-19T08:47:31.105 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:30 smithi092 ceph-mon[31407]: mgrmap e7: x(active, since 1.00495s) 2024-09-19T08:47:31.356 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:47:31.356 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-19T08:47:31.356 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T08:47:31.356 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:47:31.356 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.172+0000 7f87c5556640 1 Processor -- start 2024-09-19T08:47:31.356 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.172+0000 7f87c5556640 1 -- start start 2024-09-19T08:47:31.357 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.172+0000 7f87c5556640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87c0108160 0x7f87c010a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:31.357 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.172+0000 7f87c5556640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f87c007bed0 con 0x7f87c0108160 2024-09-19T08:47:31.357 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.173+0000 7f87beffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87c0108160 0x7f87c010a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:31.357 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.173+0000 7f87beffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87c0108160 0x7f87c010a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33600/0 (socket says 172.21.15.92:33600) 2024-09-19T08:47:31.357 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.173+0000 7f87beffd640 1 -- 172.21.15.92:0/2358280207 learned_addr learned my addr 172.21.15.92:0/2358280207 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:31.357 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.173+0000 7f87beffd640 1 -- 172.21.15.92:0/2358280207 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c010aa90 con 0x7f87c0108160 2024-09-19T08:47:31.357 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.174+0000 7f87beffd640 1 --2- 172.21.15.92:0/2358280207 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87c0108160 0x7f87c010a550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f87b0009820 tx=0x7f87b002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7c42f1122ceab50 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:31.357 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.174+0000 7f87be7fc640 1 -- 172.21.15.92:0/2358280207 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87b0037070 con 0x7f87c0108160 2024-09-19T08:47:31.357 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.174+0000 7f87be7fc640 1 -- 172.21.15.92:0/2358280207 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f87b0032900 con 0x7f87c0108160 2024-09-19T08:47:31.358 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.174+0000 7f87be7fc640 1 -- 172.21.15.92:0/2358280207 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87b0030850 con 0x7f87c0108160 2024-09-19T08:47:31.358 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.174+0000 7f87c5556640 1 -- 172.21.15.92:0/2358280207 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87c0108160 msgr2=0x7f87c010a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:31.358 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.174+0000 7f87c5556640 1 --2- 172.21.15.92:0/2358280207 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87c0108160 0x7f87c010a550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f87b0009820 tx=0x7f87b002a270 comp rx=0 tx=0).stop 2024-09-19T08:47:31.358 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.174+0000 7f87c5556640 1 -- 172.21.15.92:0/2358280207 shutdown_connections 2024-09-19T08:47:31.358 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.174+0000 7f87c5556640 1 --2- 172.21.15.92:0/2358280207 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87c0108160 0x7f87c010a550 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:31.358 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.175+0000 7f87c5556640 1 -- 172.21.15.92:0/2358280207 >> 172.21.15.92:0/2358280207 conn(0x7f87c0101dc0 msgr2=0x7f87c01041e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:31.358 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.175+0000 7f87c5556640 1 -- 172.21.15.92:0/2358280207 shutdown_connections 2024-09-19T08:47:31.358 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.175+0000 7f87c5556640 1 -- 172.21.15.92:0/2358280207 wait complete. 2024-09-19T08:47:31.358 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.175+0000 7f87c5556640 1 Processor -- start 2024-09-19T08:47:31.358 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.175+0000 7f87c5556640 1 -- start start 2024-09-19T08:47:31.358 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.175+0000 7f87c5556640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87c0108160 0x7f87c019d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:31.358 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.175+0000 7f87c5556640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f87c010bac0 con 0x7f87c0108160 2024-09-19T08:47:31.358 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.175+0000 7f87beffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87c0108160 0x7f87c019d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:31.359 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.175+0000 7f87beffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87c0108160 0x7f87c019d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33614/0 (socket says 172.21.15.92:33614) 2024-09-19T08:47:31.359 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.175+0000 7f87beffd640 1 -- 172.21.15.92:0/2416335745 learned_addr learned my addr 172.21.15.92:0/2416335745 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:31.359 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.176+0000 7f87beffd640 1 -- 172.21.15.92:0/2416335745 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c019de10 con 0x7f87c0108160 2024-09-19T08:47:31.359 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.176+0000 7f87beffd640 1 --2- 172.21.15.92:0/2416335745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87c0108160 0x7f87c019d8d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f87b00097f0 tx=0x7f87b0030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:31.359 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.176+0000 7f87bcff9640 1 -- 172.21.15.92:0/2416335745 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87b0042070 con 0x7f87c0108160 2024-09-19T08:47:31.359 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.176+0000 7f87bcff9640 1 -- 172.21.15.92:0/2416335745 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f87b0032ca0 con 0x7f87c0108160 2024-09-19T08:47:31.359 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.176+0000 7f87c5556640 1 -- 172.21.15.92:0/2416335745 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87c019e0a0 con 0x7f87c0108160 2024-09-19T08:47:31.359 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.176+0000 7f87bcff9640 1 -- 172.21.15.92:0/2416335745 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87b0037040 con 0x7f87c0108160 2024-09-19T08:47:31.359 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.176+0000 7f87c5556640 1 -- 172.21.15.92:0/2416335745 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87c01a0d90 con 0x7f87c0108160 2024-09-19T08:47:31.359 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.177+0000 7f87bcff9640 1 -- 172.21.15.92:0/2416335745 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f87b0045070 con 0x7f87c0108160 2024-09-19T08:47:31.359 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.177+0000 7f87bcff9640 1 --2- 172.21.15.92:0/2416335745 >> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] conn(0x7f87ac0391b0 0x7f87ac03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:31.359 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.177+0000 7f87bcff9640 1 -- 172.21.15.92:0/2416335745 --> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f87ac03bd80 con 0x7f87ac0391b0 2024-09-19T08:47:31.359 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.177+0000 7f87bcff9640 1 -- 172.21.15.92:0/2416335745 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f87b006c3d0 con 0x7f87c0108160 2024-09-19T08:47:31.360 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.177+0000 7f87b7fff640 1 -- 172.21.15.92:0/2416335745 >> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] conn(0x7f87ac0391b0 msgr2=0x7f87ac03b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/1369295034 2024-09-19T08:47:31.360 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.177+0000 7f87b7fff640 1 --2- 172.21.15.92:0/2416335745 >> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] conn(0x7f87ac0391b0 0x7f87ac03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:47:31.360 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.379+0000 7f87b7fff640 1 -- 172.21.15.92:0/2416335745 >> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] conn(0x7f87ac0391b0 msgr2=0x7f87ac03b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/1369295034 2024-09-19T08:47:31.360 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.379+0000 7f87b7fff640 1 --2- 172.21.15.92:0/2416335745 >> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] conn(0x7f87ac0391b0 0x7f87ac03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T08:47:31.360 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.780+0000 7f87b7fff640 1 -- 172.21.15.92:0/2416335745 >> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] conn(0x7f87ac0391b0 msgr2=0x7f87ac03b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/1369295034 2024-09-19T08:47:31.360 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:27.780+0000 7f87b7fff640 1 --2- 172.21.15.92:0/2416335745 >> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] conn(0x7f87ac0391b0 0x7f87ac03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T08:47:31.360 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:28.581+0000 7f87b7fff640 1 -- 172.21.15.92:0/2416335745 >> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] conn(0x7f87ac0391b0 msgr2=0x7f87ac03b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/1369295034 2024-09-19T08:47:31.360 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:28.581+0000 7f87b7fff640 1 --2- 172.21.15.92:0/2416335745 >> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] conn(0x7f87ac0391b0 0x7f87ac03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T08:47:31.360 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:29.814+0000 7f87bcff9640 1 -- 172.21.15.92:0/2416335745 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mgrmap(e 6) ==== 46228+0+0 (secure 0 0 0) 0x7f87b006ae90 con 0x7f87c0108160 2024-09-19T08:47:31.360 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:29.814+0000 7f87bcff9640 1 -- 172.21.15.92:0/2416335745 >> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] conn(0x7f87ac0391b0 msgr2=0x7f87ac03b670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:47:31.360 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:29.814+0000 7f87bcff9640 1 --2- 172.21.15.92:0/2416335745 >> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] conn(0x7f87ac0391b0 0x7f87ac03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:31.360 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:30.814+0000 7f87bcff9640 1 -- 172.21.15.92:0/2416335745 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7f87b003cd10 con 0x7f87c0108160 2024-09-19T08:47:31.361 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:30.814+0000 7f87bcff9640 1 --2- 172.21.15.92:0/2416335745 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f87ac03cae0 0x7f87ac03eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:31.361 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:30.814+0000 7f87bcff9640 1 -- 172.21.15.92:0/2416335745 --> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f87b0039e50 con 0x7f87ac03cae0 2024-09-19T08:47:31.361 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:30.815+0000 7f87b7fff640 1 --2- 172.21.15.92:0/2416335745 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f87ac03cae0 0x7f87ac03eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:31.361 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:30.816+0000 7f87b7fff640 1 --2- 172.21.15.92:0/2416335745 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f87ac03cae0 0x7f87ac03eed0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f87a8003980 tx=0x7f87a8006e10 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:31.361 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:30.816+0000 7f87bcff9640 1 -- 172.21.15.92:0/2416335745 <== mgr.14118 v2:172.21.15.92:6800/2908709470 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f87b0039e50 con 0x7f87ac03cae0 2024-09-19T08:47:31.361 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:30.823+0000 7f87c5556640 1 -- 172.21.15.92:0/2416335745 --> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f87c01085c0 con 0x7f87ac03cae0 2024-09-19T08:47:31.361 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:30.823+0000 7f87bcff9640 1 -- 172.21.15.92:0/2416335745 <== mgr.14118 v2:172.21.15.92:6800/2908709470 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f87c01085c0 con 0x7f87ac03cae0 2024-09-19T08:47:31.361 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:30.824+0000 7f87c5556640 1 -- 172.21.15.92:0/2416335745 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f87ac03cae0 msgr2=0x7f87ac03eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:31.362 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:30.824+0000 7f87c5556640 1 --2- 172.21.15.92:0/2416335745 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f87ac03cae0 0x7f87ac03eed0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f87a8003980 tx=0x7f87a8006e10 comp rx=0 tx=0).stop 2024-09-19T08:47:31.362 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:30.824+0000 7f87c5556640 1 -- 172.21.15.92:0/2416335745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87c0108160 msgr2=0x7f87c019d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:31.362 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:30.824+0000 7f87c5556640 1 --2- 172.21.15.92:0/2416335745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87c0108160 0x7f87c019d8d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f87b00097f0 tx=0x7f87b0030ec0 comp rx=0 tx=0).stop 2024-09-19T08:47:31.362 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:30.824+0000 7f87c5556640 1 -- 172.21.15.92:0/2416335745 shutdown_connections 2024-09-19T08:47:31.362 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:30.824+0000 7f87c5556640 1 --2- 172.21.15.92:0/2416335745 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f87ac03cae0 0x7f87ac03eed0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:31.362 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:30.824+0000 7f87c5556640 1 --2- 172.21.15.92:0/2416335745 >> [v2:172.21.15.92:6800/1369295034,v1:172.21.15.92:6801/1369295034] conn(0x7f87ac0391b0 0x7f87ac03b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:31.362 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:30.824+0000 7f87c5556640 1 --2- 172.21.15.92:0/2416335745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87c0108160 0x7f87c019d8d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:31.362 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:30.824+0000 7f87c5556640 1 -- 172.21.15.92:0/2416335745 >> 172.21.15.92:0/2416335745 conn(0x7f87c0101dc0 msgr2=0x7f87c01028f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:31.362 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:30.824+0000 7f87c5556640 1 -- 172.21.15.92:0/2416335745 shutdown_connections 2024-09-19T08:47:31.362 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:30.824+0000 7f87c5556640 1 -- 172.21.15.92:0/2416335745 wait complete. 2024-09-19T08:47:31.363 INFO:teuthology.orchestra.run.smithi092.stdout:mgr epoch 5 is available 2024-09-19T08:47:31.363 INFO:teuthology.orchestra.run.smithi092.stdout:Setting orchestrator backend to cephadm... 2024-09-19T08:47:31.455 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:31 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:31.272+0000 7fe613bc7640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:08:47:31] ENGINE Error in HTTPServer.serve 2024-09-19T08:47:31.456 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:31 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: Traceback (most recent call last): 2024-09-19T08:47:31.456 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:31 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:47:31.456 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:31 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: self._connections.run(self.expiration_interval) 2024-09-19T08:47:31.456 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:31 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:47:31.456 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:31 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: self._run(expiration_interval) 2024-09-19T08:47:31.456 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:31 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:47:31.456 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:31 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:47:31.456 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:31 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:47:31.456 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:31 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:47:31.456 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:31 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:47:31.457 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:31 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: s = self.context.wrap_socket( 2024-09-19T08:47:31.457 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:31 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:47:31.457 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:31 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: return self.sslsocket_class._create( 2024-09-19T08:47:31.457 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:31 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:47:31.457 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:31 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: self.do_handshake() 2024-09-19T08:47:31.457 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:31 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:47:31.457 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:31 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: self._sslobj.do_handshake() 2024-09-19T08:47:31.457 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:31 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:47:31.457 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:31 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:32.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:31 smithi092 ceph-mon[31407]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T08:47:32.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:31 smithi092 ceph-mon[31407]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T08:47:32.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:31 smithi092 ceph-mon[31407]: from='mgr.14118 172.21.15.92:0/17008104' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:47:32.460 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.719+0000 7f5bf5e08640 1 Processor -- start 2024-09-19T08:47:32.460 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.719+0000 7f5bf5e08640 1 -- start start 2024-09-19T08:47:32.460 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.719+0000 7f5bf5e08640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5bf0105980 0x7f5bf0105d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:32.460 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.720+0000 7f5bf5e08640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf0106350 con 0x7f5bf0105980 2024-09-19T08:47:32.461 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.720+0000 7f5bef7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5bf0105980 0x7f5bf0105d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:32.461 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.720+0000 7f5bef7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5bf0105980 0x7f5bf0105d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58762/0 (socket says 172.21.15.92:58762) 2024-09-19T08:47:32.461 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.720+0000 7f5bef7fe640 1 -- 172.21.15.92:0/2408398971 learned_addr learned my addr 172.21.15.92:0/2408398971 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:32.461 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.720+0000 7f5bef7fe640 1 -- 172.21.15.92:0/2408398971 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bf01064d0 con 0x7f5bf0105980 2024-09-19T08:47:32.461 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.721+0000 7f5bef7fe640 1 --2- 172.21.15.92:0/2408398971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5bf0105980 0x7f5bf0105d80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5be0009e80 tx=0x7f5be002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=221602a49db79750 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:32.461 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.721+0000 7f5bee7fc640 1 -- 172.21.15.92:0/2408398971 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5be0036070 con 0x7f5bf0105980 2024-09-19T08:47:32.461 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.721+0000 7f5bee7fc640 1 -- 172.21.15.92:0/2408398971 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5be00318c0 con 0x7f5bf0105980 2024-09-19T08:47:32.461 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.721+0000 7f5bee7fc640 1 -- 172.21.15.92:0/2408398971 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5be0007ab0 con 0x7f5bf0105980 2024-09-19T08:47:32.461 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.721+0000 7f5bf5e08640 1 -- 172.21.15.92:0/2408398971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5bf0105980 msgr2=0x7f5bf0105d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:32.461 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.721+0000 7f5bf5e08640 1 --2- 172.21.15.92:0/2408398971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5bf0105980 0x7f5bf0105d80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5be0009e80 tx=0x7f5be002a7a0 comp rx=0 tx=0).stop 2024-09-19T08:47:32.461 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.721+0000 7f5bf5e08640 1 -- 172.21.15.92:0/2408398971 shutdown_connections 2024-09-19T08:47:32.461 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.721+0000 7f5bf5e08640 1 --2- 172.21.15.92:0/2408398971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5bf0105980 0x7f5bf0105d80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:32.462 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.721+0000 7f5bf5e08640 1 -- 172.21.15.92:0/2408398971 >> 172.21.15.92:0/2408398971 conn(0x7f5bf0101510 msgr2=0x7f5bf0103930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:32.462 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.721+0000 7f5bf5e08640 1 -- 172.21.15.92:0/2408398971 shutdown_connections 2024-09-19T08:47:32.462 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.721+0000 7f5bf5e08640 1 -- 172.21.15.92:0/2408398971 wait complete. 2024-09-19T08:47:32.462 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.722+0000 7f5bf5e08640 1 Processor -- start 2024-09-19T08:47:32.462 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.722+0000 7f5bf5e08640 1 -- start start 2024-09-19T08:47:32.462 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.722+0000 7f5bf5e08640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5bf0105980 0x7f5bf019b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:32.462 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.722+0000 7f5bf5e08640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf010bc30 con 0x7f5bf0105980 2024-09-19T08:47:32.462 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.722+0000 7f5bef7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5bf0105980 0x7f5bf019b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:32.462 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.722+0000 7f5bef7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5bf0105980 0x7f5bf019b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58766/0 (socket says 172.21.15.92:58766) 2024-09-19T08:47:32.463 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.722+0000 7f5bef7fe640 1 -- 172.21.15.92:0/2506981505 learned_addr learned my addr 172.21.15.92:0/2506981505 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:32.463 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.723+0000 7f5bef7fe640 1 -- 172.21.15.92:0/2506981505 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bf019bbc0 con 0x7f5bf0105980 2024-09-19T08:47:32.463 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.723+0000 7f5bef7fe640 1 --2- 172.21.15.92:0/2506981505 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5bf0105980 0x7f5bf019b680 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5be002acc0 tx=0x7f5be0031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:32.463 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.723+0000 7f5becff9640 1 -- 172.21.15.92:0/2506981505 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5be0036050 con 0x7f5bf0105980 2024-09-19T08:47:32.463 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.723+0000 7f5becff9640 1 -- 172.21.15.92:0/2506981505 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5be0037040 con 0x7f5bf0105980 2024-09-19T08:47:32.463 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.723+0000 7f5bf5e08640 1 -- 172.21.15.92:0/2506981505 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bf019be50 con 0x7f5bf0105980 2024-09-19T08:47:32.463 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.723+0000 7f5becff9640 1 -- 172.21.15.92:0/2506981505 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5be003d8c0 con 0x7f5bf0105980 2024-09-19T08:47:32.463 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.723+0000 7f5bf5e08640 1 -- 172.21.15.92:0/2506981505 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bf019eb40 con 0x7f5bf0105980 2024-09-19T08:47:32.463 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.724+0000 7f5becff9640 1 -- 172.21.15.92:0/2506981505 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7f5be0044020 con 0x7f5bf0105980 2024-09-19T08:47:32.463 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.724+0000 7f5becff9640 1 --2- 172.21.15.92:0/2506981505 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f5bd80390a0 0x7f5bd803b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:32.463 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.724+0000 7f5bf5e08640 1 -- 172.21.15.92:0/2506981505 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bf010bdb0 con 0x7f5bf0105980 2024-09-19T08:47:32.463 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.724+0000 7f5becff9640 1 -- 172.21.15.92:0/2506981505 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5be0042020 con 0x7f5bf0105980 2024-09-19T08:47:32.464 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.724+0000 7f5beeffd640 1 --2- 172.21.15.92:0/2506981505 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f5bd80390a0 0x7f5bd803b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:32.464 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.725+0000 7f5beeffd640 1 --2- 172.21.15.92:0/2506981505 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f5bd80390a0 0x7f5bd803b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5be40098c0 tx=0x7f5be4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:32.464 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.729+0000 7f5becff9640 1 -- 172.21.15.92:0/2506981505 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5be004b020 con 0x7f5bf0105980 2024-09-19T08:47:32.464 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.869+0000 7f5becff9640 1 -- 172.21.15.92:0/2506981505 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f5be0046790 con 0x7f5bf0105980 2024-09-19T08:47:32.464 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.910+0000 7f5bf5e08640 1 -- 172.21.15.92:0/2506981505 --> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f5bf01027a0 con 0x7f5bd80390a0 2024-09-19T08:47:32.464 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.914+0000 7f5becff9640 1 -- 172.21.15.92:0/2506981505 <== mgr.14118 v2:172.21.15.92:6800/2908709470 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5bf01027a0 con 0x7f5bd80390a0 2024-09-19T08:47:32.464 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.916+0000 7f5bf5e08640 1 -- 172.21.15.92:0/2506981505 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f5bd80390a0 msgr2=0x7f5bd803b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:32.464 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.916+0000 7f5bf5e08640 1 --2- 172.21.15.92:0/2506981505 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f5bd80390a0 0x7f5bd803b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5be40098c0 tx=0x7f5be4006db0 comp rx=0 tx=0).stop 2024-09-19T08:47:32.464 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.916+0000 7f5bf5e08640 1 -- 172.21.15.92:0/2506981505 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5bf0105980 msgr2=0x7f5bf019b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:32.464 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.916+0000 7f5bf5e08640 1 --2- 172.21.15.92:0/2506981505 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5bf0105980 0x7f5bf019b680 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5be002acc0 tx=0x7f5be0031ca0 comp rx=0 tx=0).stop 2024-09-19T08:47:32.464 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.916+0000 7f5bf5e08640 1 -- 172.21.15.92:0/2506981505 shutdown_connections 2024-09-19T08:47:32.464 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.916+0000 7f5bf5e08640 1 --2- 172.21.15.92:0/2506981505 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f5bd80390a0 0x7f5bd803b560 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:32.465 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.916+0000 7f5bf5e08640 1 --2- 172.21.15.92:0/2506981505 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5bf0105980 0x7f5bf019b680 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:32.465 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.916+0000 7f5bf5e08640 1 -- 172.21.15.92:0/2506981505 >> 172.21.15.92:0/2506981505 conn(0x7f5bf0101510 msgr2=0x7f5bf0102090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:32.465 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.916+0000 7f5bf5e08640 1 -- 172.21.15.92:0/2506981505 shutdown_connections 2024-09-19T08:47:32.465 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:31.916+0000 7f5bf5e08640 1 -- 172.21.15.92:0/2506981505 wait complete. 2024-09-19T08:47:33.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:32 smithi092 ceph-mon[31407]: [19/Sep/2024:08:47:31] ENGINE Bus STARTING 2024-09-19T08:47:33.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:32 smithi092 ceph-mon[31407]: [19/Sep/2024:08:47:31] ENGINE Serving on https://172.21.15.92:7150 2024-09-19T08:47:33.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:32 smithi092 ceph-mon[31407]: [19/Sep/2024:08:47:31] ENGINE Error in HTTPServer.serve 2024-09-19T08:47:33.254 INFO:journalctl@ceph.mon.a.smithi092.stdout: Traceback (most recent call last): 2024-09-19T08:47:33.254 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:47:33.254 INFO:journalctl@ceph.mon.a.smithi092.stdout: self._connections.run(self.expiration_interval) 2024-09-19T08:47:33.254 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:47:33.254 INFO:journalctl@ceph.mon.a.smithi092.stdout: self._run(expiration_interval) 2024-09-19T08:47:33.254 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:47:33.254 INFO:journalctl@ceph.mon.a.smithi092.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:47:33.254 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:47:33.254 INFO:journalctl@ceph.mon.a.smithi092.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:47:33.254 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:47:33.254 INFO:journalctl@ceph.mon.a.smithi092.stdout: s = self.context.wrap_socket( 2024-09-19T08:47:33.254 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:47:33.254 INFO:journalctl@ceph.mon.a.smithi092.stdout: return self.sslsocket_class._create( 2024-09-19T08:47:33.255 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:47:33.255 INFO:journalctl@ceph.mon.a.smithi092.stdout: self.do_handshake() 2024-09-19T08:47:33.255 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:47:33.255 INFO:journalctl@ceph.mon.a.smithi092.stdout: self._sslobj.do_handshake() 2024-09-19T08:47:33.255 INFO:journalctl@ceph.mon.a.smithi092.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:47:33.255 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:32 smithi092 ceph-mon[31407]: [19/Sep/2024:08:47:31] ENGINE Serving on http://172.21.15.92:8765 2024-09-19T08:47:33.255 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:32 smithi092 ceph-mon[31407]: [19/Sep/2024:08:47:31] ENGINE Bus STARTED 2024-09-19T08:47:33.255 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:32 smithi092 ceph-mon[31407]: mgrmap e8: x(active, since 2s) 2024-09-19T08:47:33.255 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:32 smithi092 ceph-mon[31407]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:47:33.255 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:32 smithi092 ceph-mon[31407]: from='mgr.14118 172.21.15.92:0/17008104' entity='mgr.x' 2024-09-19T08:47:33.255 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:32 smithi092 ceph-mon[31407]: from='mgr.14118 172.21.15.92:0/17008104' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:47:33.625 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-19T08:47:33.625 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.857+0000 7ff8a1a2c640 1 Processor -- start 2024-09-19T08:47:33.625 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.857+0000 7ff8a1a2c640 1 -- start start 2024-09-19T08:47:33.625 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.858+0000 7ff8a1a2c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff89c107740 0x7ff89c107b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:33.625 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.858+0000 7ff8a1a2c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff89c108110 con 0x7ff89c107740 2024-09-19T08:47:33.625 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.858+0000 7ff89affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff89c107740 0x7ff89c107b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:33.626 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.858+0000 7ff89affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff89c107740 0x7ff89c107b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58782/0 (socket says 172.21.15.92:58782) 2024-09-19T08:47:33.626 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.858+0000 7ff89affd640 1 -- 172.21.15.92:0/3454246343 learned_addr learned my addr 172.21.15.92:0/3454246343 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:33.626 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.858+0000 7ff89affd640 1 -- 172.21.15.92:0/3454246343 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff89c108940 con 0x7ff89c107740 2024-09-19T08:47:33.626 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.859+0000 7ff89affd640 1 --2- 172.21.15.92:0/3454246343 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff89c107740 0x7ff89c107b40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff884009820 tx=0x7ff88402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b5fd7369507474 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:33.626 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.859+0000 7ff899ffb640 1 -- 172.21.15.92:0/3454246343 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff884037070 con 0x7ff89c107740 2024-09-19T08:47:33.626 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.859+0000 7ff899ffb640 1 -- 172.21.15.92:0/3454246343 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff884032900 con 0x7ff89c107740 2024-09-19T08:47:33.626 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.859+0000 7ff899ffb640 1 -- 172.21.15.92:0/3454246343 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff884030850 con 0x7ff89c107740 2024-09-19T08:47:33.626 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.860+0000 7ff8a1a2c640 1 -- 172.21.15.92:0/3454246343 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff89c107740 msgr2=0x7ff89c107b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:33.626 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.860+0000 7ff8a1a2c640 1 --2- 172.21.15.92:0/3454246343 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff89c107740 0x7ff89c107b40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff884009820 tx=0x7ff88402a270 comp rx=0 tx=0).stop 2024-09-19T08:47:33.626 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.860+0000 7ff8a1a2c640 1 -- 172.21.15.92:0/3454246343 shutdown_connections 2024-09-19T08:47:33.626 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.860+0000 7ff8a1a2c640 1 --2- 172.21.15.92:0/3454246343 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff89c107740 0x7ff89c107b40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:33.627 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.860+0000 7ff8a1a2c640 1 -- 172.21.15.92:0/3454246343 >> 172.21.15.92:0/3454246343 conn(0x7ff89c102ef0 msgr2=0x7ff89c105310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:33.627 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.860+0000 7ff8a1a2c640 1 -- 172.21.15.92:0/3454246343 shutdown_connections 2024-09-19T08:47:33.627 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.860+0000 7ff8a1a2c640 1 -- 172.21.15.92:0/3454246343 wait complete. 2024-09-19T08:47:33.627 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.860+0000 7ff8a1a2c640 1 Processor -- start 2024-09-19T08:47:33.627 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.861+0000 7ff8a1a2c640 1 -- start start 2024-09-19T08:47:33.627 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.861+0000 7ff8a1a2c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff89c107740 0x7ff89c19b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:33.627 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.861+0000 7ff8a1a2c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff89c10bcf0 con 0x7ff89c107740 2024-09-19T08:47:33.627 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.861+0000 7ff89affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff89c107740 0x7ff89c19b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:33.627 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.861+0000 7ff89affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff89c107740 0x7ff89c19b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58794/0 (socket says 172.21.15.92:58794) 2024-09-19T08:47:33.627 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.861+0000 7ff89affd640 1 -- 172.21.15.92:0/1405083534 learned_addr learned my addr 172.21.15.92:0/1405083534 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:33.627 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.861+0000 7ff89affd640 1 -- 172.21.15.92:0/1405083534 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff89c19bbf0 con 0x7ff89c107740 2024-09-19T08:47:33.627 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.861+0000 7ff89affd640 1 --2- 172.21.15.92:0/1405083534 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff89c107740 0x7ff89c19b6b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff884009940 tx=0x7ff8840326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:33.628 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.861+0000 7ff8a0a2a640 1 -- 172.21.15.92:0/1405083534 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff884042070 con 0x7ff89c107740 2024-09-19T08:47:33.628 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.861+0000 7ff8a0a2a640 1 -- 172.21.15.92:0/1405083534 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff884032be0 con 0x7ff89c107740 2024-09-19T08:47:33.628 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.861+0000 7ff8a0a2a640 1 -- 172.21.15.92:0/1405083534 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff884037040 con 0x7ff89c107740 2024-09-19T08:47:33.628 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.861+0000 7ff8a1a2c640 1 -- 172.21.15.92:0/1405083534 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff89c19be80 con 0x7ff89c107740 2024-09-19T08:47:33.628 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.861+0000 7ff8a1a2c640 1 -- 172.21.15.92:0/1405083534 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff89c19eb70 con 0x7ff89c107740 2024-09-19T08:47:33.628 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.862+0000 7ff8a0a2a640 1 -- 172.21.15.92:0/1405083534 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7ff884045070 con 0x7ff89c107740 2024-09-19T08:47:33.628 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.862+0000 7ff8a1a2c640 1 -- 172.21.15.92:0/1405083534 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff89c107bc0 con 0x7ff89c107740 2024-09-19T08:47:33.628 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.862+0000 7ff8a0a2a640 1 --2- 172.21.15.92:0/1405083534 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7ff888039200 0x7ff88803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:33.629 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.863+0000 7ff8a0a2a640 1 -- 172.21.15.92:0/1405083534 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff88406c1c0 con 0x7ff89c107740 2024-09-19T08:47:33.629 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.863+0000 7ff89a7fc640 1 --2- 172.21.15.92:0/1405083534 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7ff888039200 0x7ff88803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:33.629 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.863+0000 7ff89a7fc640 1 --2- 172.21.15.92:0/1405083534 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7ff888039200 0x7ff88803b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff88c0098c0 tx=0x7ff88c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:33.629 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:32.867+0000 7ff8a0a2a640 1 -- 172.21.15.92:0/1405083534 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff884032d90 con 0x7ff89c107740 2024-09-19T08:47:33.629 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:33.032+0000 7ff8a1a2c640 1 -- 172.21.15.92:0/1405083534 --> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7ff89c104160 con 0x7ff888039200 2024-09-19T08:47:33.630 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:33.033+0000 7ff8a0a2a640 1 -- 172.21.15.92:0/1405083534 <== mgr.14118 v2:172.21.15.92:6800/2908709470 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7ff89c104160 con 0x7ff888039200 2024-09-19T08:47:33.630 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:33.035+0000 7ff8a1a2c640 1 -- 172.21.15.92:0/1405083534 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7ff888039200 msgr2=0x7ff88803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:33.630 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:33.035+0000 7ff8a1a2c640 1 --2- 172.21.15.92:0/1405083534 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7ff888039200 0x7ff88803b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff88c0098c0 tx=0x7ff88c006db0 comp rx=0 tx=0).stop 2024-09-19T08:47:33.630 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:33.035+0000 7ff8a1a2c640 1 -- 172.21.15.92:0/1405083534 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff89c107740 msgr2=0x7ff89c19b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:33.630 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:33.035+0000 7ff8a1a2c640 1 --2- 172.21.15.92:0/1405083534 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff89c107740 0x7ff89c19b6b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff884009940 tx=0x7ff8840326e0 comp rx=0 tx=0).stop 2024-09-19T08:47:33.631 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:33.035+0000 7ff8a1a2c640 1 -- 172.21.15.92:0/1405083534 shutdown_connections 2024-09-19T08:47:33.631 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:33.035+0000 7ff8a1a2c640 1 --2- 172.21.15.92:0/1405083534 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7ff888039200 0x7ff88803b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:33.631 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:33.035+0000 7ff8a1a2c640 1 --2- 172.21.15.92:0/1405083534 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff89c107740 0x7ff89c19b6b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:33.631 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:33.035+0000 7ff8a1a2c640 1 -- 172.21.15.92:0/1405083534 >> 172.21.15.92:0/1405083534 conn(0x7ff89c102ef0 msgr2=0x7ff89c103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:33.631 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:33.036+0000 7ff8a1a2c640 1 -- 172.21.15.92:0/1405083534 shutdown_connections 2024-09-19T08:47:33.631 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:33.036+0000 7ff8a1a2c640 1 -- 172.21.15.92:0/1405083534 wait complete. 2024-09-19T08:47:33.631 INFO:teuthology.orchestra.run.smithi092.stdout:Generating ssh key... 2024-09-19T08:47:34.343 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:34 smithi092 ceph-mon[31407]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:47:34.656 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:34 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: Generating public/private rsa key pair. 2024-09-19T08:47:34.657 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:34 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: Your identification has been saved in /tmp/tmpw1q42h3a/key 2024-09-19T08:47:34.657 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:34 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: Your public key has been saved in /tmp/tmpw1q42h3a/key.pub 2024-09-19T08:47:34.657 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:34 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: The key fingerprint is: 2024-09-19T08:47:34.657 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:34 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: SHA256:jemRbzsuaf8zzHaFQzCDa3A+imHKw6Uoj+gSrWUCjAw ceph-91ff74f2-7663-11ef-bceb-c7b262605968 2024-09-19T08:47:34.657 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:34 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: The key's randomart image is: 2024-09-19T08:47:34.657 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:34 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: +---[RSA 3072]----+ 2024-09-19T08:47:34.657 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:34 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: | . | 2024-09-19T08:47:34.657 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:34 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: |E . o + | 2024-09-19T08:47:34.657 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:34 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: |= + . + | 2024-09-19T08:47:34.657 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:34 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: |oo + == . | 2024-09-19T08:47:34.657 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:34 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: |.. + = oSo.. . . | 2024-09-19T08:47:34.658 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:34 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: |+ = * ...o o .| 2024-09-19T08:47:34.658 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:34 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: |.X . ..oo o | 2024-09-19T08:47:34.658 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:34 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: |= . +...* . | 2024-09-19T08:47:34.658 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:34 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: |o. . +++.+ | 2024-09-19T08:47:34.658 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:34 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: +----[SHA256]-----+ 2024-09-19T08:47:34.931 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.021+0000 7f9d22c8d640 1 Processor -- start 2024-09-19T08:47:34.931 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.021+0000 7f9d22c8d640 1 -- start start 2024-09-19T08:47:34.931 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.021+0000 7f9d22c8d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d1c1076b0 0x7f9d1c107ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:34.931 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.021+0000 7f9d22c8d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9d1c108080 con 0x7f9d1c1076b0 2024-09-19T08:47:34.931 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.021+0000 7f9d20a29640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d1c1076b0 0x7f9d1c107ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:34.931 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.021+0000 7f9d20a29640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d1c1076b0 0x7f9d1c107ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58796/0 (socket says 172.21.15.92:58796) 2024-09-19T08:47:34.931 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.021+0000 7f9d20a29640 1 -- 172.21.15.92:0/2908515871 learned_addr learned my addr 172.21.15.92:0/2908515871 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:34.931 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.022+0000 7f9d20a29640 1 -- 172.21.15.92:0/2908515871 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d1c1088b0 con 0x7f9d1c1076b0 2024-09-19T08:47:34.931 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.022+0000 7f9d20a29640 1 --2- 172.21.15.92:0/2908515871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d1c1076b0 0x7f9d1c107ab0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c009820 tx=0x7f9d0c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfa9c3494603e189 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:34.931 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.022+0000 7f9d1b7fe640 1 -- 172.21.15.92:0/2908515871 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d0c037070 con 0x7f9d1c1076b0 2024-09-19T08:47:34.932 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.023+0000 7f9d1b7fe640 1 -- 172.21.15.92:0/2908515871 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9d0c032900 con 0x7f9d1c1076b0 2024-09-19T08:47:34.932 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.023+0000 7f9d1b7fe640 1 -- 172.21.15.92:0/2908515871 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d0c030850 con 0x7f9d1c1076b0 2024-09-19T08:47:34.932 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.023+0000 7f9d22c8d640 1 -- 172.21.15.92:0/2908515871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d1c1076b0 msgr2=0x7f9d1c107ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:34.932 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.023+0000 7f9d22c8d640 1 --2- 172.21.15.92:0/2908515871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d1c1076b0 0x7f9d1c107ab0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c009820 tx=0x7f9d0c02a270 comp rx=0 tx=0).stop 2024-09-19T08:47:34.932 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.023+0000 7f9d22c8d640 1 -- 172.21.15.92:0/2908515871 shutdown_connections 2024-09-19T08:47:34.932 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.023+0000 7f9d22c8d640 1 --2- 172.21.15.92:0/2908515871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d1c1076b0 0x7f9d1c107ab0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:34.932 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.023+0000 7f9d22c8d640 1 -- 172.21.15.92:0/2908515871 >> 172.21.15.92:0/2908515871 conn(0x7f9d1c102e80 msgr2=0x7f9d1c1052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:34.932 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.023+0000 7f9d22c8d640 1 -- 172.21.15.92:0/2908515871 shutdown_connections 2024-09-19T08:47:34.932 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.023+0000 7f9d22c8d640 1 -- 172.21.15.92:0/2908515871 wait complete. 2024-09-19T08:47:34.932 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.024+0000 7f9d22c8d640 1 Processor -- start 2024-09-19T08:47:34.932 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.024+0000 7f9d22c8d640 1 -- start start 2024-09-19T08:47:34.932 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.024+0000 7f9d22c8d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d1c1076b0 0x7f9d1c19b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:34.932 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.024+0000 7f9d22c8d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9d1c10bc60 con 0x7f9d1c1076b0 2024-09-19T08:47:34.933 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.024+0000 7f9d20a29640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d1c1076b0 0x7f9d1c19b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:34.933 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.024+0000 7f9d20a29640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d1c1076b0 0x7f9d1c19b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58810/0 (socket says 172.21.15.92:58810) 2024-09-19T08:47:34.933 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.024+0000 7f9d20a29640 1 -- 172.21.15.92:0/1131907380 learned_addr learned my addr 172.21.15.92:0/1131907380 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:34.933 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.024+0000 7f9d20a29640 1 -- 172.21.15.92:0/1131907380 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d1c19bba0 con 0x7f9d1c1076b0 2024-09-19T08:47:34.933 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.024+0000 7f9d20a29640 1 --2- 172.21.15.92:0/1131907380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d1c1076b0 0x7f9d1c19b660 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c009940 tx=0x7f9d0c032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:34.933 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.024+0000 7f9d19ffb640 1 -- 172.21.15.92:0/1131907380 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d0c042070 con 0x7f9d1c1076b0 2024-09-19T08:47:34.933 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.025+0000 7f9d19ffb640 1 -- 172.21.15.92:0/1131907380 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9d0c0308c0 con 0x7f9d1c1076b0 2024-09-19T08:47:34.933 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.025+0000 7f9d22c8d640 1 -- 172.21.15.92:0/1131907380 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d1c19be30 con 0x7f9d1c1076b0 2024-09-19T08:47:34.933 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.025+0000 7f9d19ffb640 1 -- 172.21.15.92:0/1131907380 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d0c037040 con 0x7f9d1c1076b0 2024-09-19T08:47:34.933 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.025+0000 7f9d22c8d640 1 -- 172.21.15.92:0/1131907380 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d1c19eb20 con 0x7f9d1c1076b0 2024-09-19T08:47:34.933 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.025+0000 7f9d19ffb640 1 -- 172.21.15.92:0/1131907380 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f9d0c045070 con 0x7f9d1c1076b0 2024-09-19T08:47:34.933 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.026+0000 7f9d19ffb640 1 --2- 172.21.15.92:0/1131907380 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f9d040391b0 0x7f9d0403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:34.933 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.026+0000 7f9d22c8d640 1 -- 172.21.15.92:0/1131907380 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d1c107b30 con 0x7f9d1c1076b0 2024-09-19T08:47:34.934 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.026+0000 7f9d19ffb640 1 -- 172.21.15.92:0/1131907380 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f9d0c06c330 con 0x7f9d1c1076b0 2024-09-19T08:47:34.934 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.026+0000 7f9d1bfff640 1 --2- 172.21.15.92:0/1131907380 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f9d040391b0 0x7f9d0403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:34.934 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.026+0000 7f9d1bfff640 1 --2- 172.21.15.92:0/1131907380 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f9d040391b0 0x7f9d0403b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9d100098c0 tx=0x7f9d10006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:34.934 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.031+0000 7f9d19ffb640 1 -- 172.21.15.92:0/1131907380 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9d0c02fd90 con 0x7f9d1c1076b0 2024-09-19T08:47:34.934 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.196+0000 7f9d22c8d640 1 -- 172.21.15.92:0/1131907380 --> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f9d1c1040c0 con 0x7f9d040391b0 2024-09-19T08:47:34.934 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.349+0000 7f9d19ffb640 1 -- 172.21.15.92:0/1131907380 <== mgr.14118 v2:172.21.15.92:6800/2908709470 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9d1c1040c0 con 0x7f9d040391b0 2024-09-19T08:47:34.934 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.351+0000 7f9d22c8d640 1 -- 172.21.15.92:0/1131907380 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f9d040391b0 msgr2=0x7f9d0403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:34.934 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.351+0000 7f9d22c8d640 1 --2- 172.21.15.92:0/1131907380 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f9d040391b0 0x7f9d0403b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9d100098c0 tx=0x7f9d10006db0 comp rx=0 tx=0).stop 2024-09-19T08:47:34.934 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.351+0000 7f9d22c8d640 1 -- 172.21.15.92:0/1131907380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d1c1076b0 msgr2=0x7f9d1c19b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:34.936 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.351+0000 7f9d22c8d640 1 --2- 172.21.15.92:0/1131907380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d1c1076b0 0x7f9d1c19b660 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c009940 tx=0x7f9d0c032ce0 comp rx=0 tx=0).stop 2024-09-19T08:47:34.936 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.352+0000 7f9d22c8d640 1 -- 172.21.15.92:0/1131907380 shutdown_connections 2024-09-19T08:47:34.936 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.352+0000 7f9d22c8d640 1 --2- 172.21.15.92:0/1131907380 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f9d040391b0 0x7f9d0403b670 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:34.936 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.352+0000 7f9d22c8d640 1 --2- 172.21.15.92:0/1131907380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d1c1076b0 0x7f9d1c19b660 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:34.936 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.352+0000 7f9d22c8d640 1 -- 172.21.15.92:0/1131907380 >> 172.21.15.92:0/1131907380 conn(0x7f9d1c102e80 msgr2=0x7f9d1c1039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:34.936 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.352+0000 7f9d22c8d640 1 -- 172.21.15.92:0/1131907380 shutdown_connections 2024-09-19T08:47:34.936 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:34.352+0000 7f9d22c8d640 1 -- 172.21.15.92:0/1131907380 wait complete. 2024-09-19T08:47:35.478 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:35 smithi092 ceph-mon[31407]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:47:35.478 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:35 smithi092 ceph-mon[31407]: Generating ssh key... 2024-09-19T08:47:35.478 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:35 smithi092 ceph-mon[31407]: from='mgr.14118 172.21.15.92:0/17008104' entity='mgr.x' 2024-09-19T08:47:35.478 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:35 smithi092 ceph-mon[31407]: from='mgr.14118 172.21.15.92:0/17008104' entity='mgr.x' 2024-09-19T08:47:36.029 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCjQjqM3huP7q8DcA2oq4mw5qRsXlOG1aLYk9tdkonlBnmZ4q16diKa9ez980nrVQ3tvUb3lzgdtZLIrkUqP1Jx8SYjWdzeA8uw08+zJyIcxexEPPB+6lQ4CtBorJNer3LHF9rpy5CqzC7qbwTqdjmPAMgyRRHpfKxIDyNbHQvmeyhRmiX6c0YHYc9msombr++cm+AVwVDsKzBfEsi6ZpQJNfvTm1Tb2dX3vRtMMxt7/e3h/R9rLTCuMJWvNRy2mxR/IwTciRWi8ZB+kN047WJc3SUVMqnL2xsYbhKh5a7f6bFiCUzh/56dav/zVmjkdGuPUw2zr4xdRIVuyp6S22ef03HNnGQ3EHPIZaz1nEkJCOKqkUrFGHEXCc97fBUShSaJ06AE0bPnILX94cQo3Q4BhjS9QaCGYOL0RYUYox0fItxTD8WHwLO7QBOBfr7ljFIBHTtBySz5tsHkHm0jX3uqWjuoPaJZuFo18gNqrlCCheB7SOFWCROe9MwhRIAtevc= ceph-91ff74f2-7663-11ef-bceb-c7b262605968 2024-09-19T08:47:36.029 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.301+0000 7f612121e640 1 Processor -- start 2024-09-19T08:47:36.029 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.301+0000 7f612121e640 1 -- start start 2024-09-19T08:47:36.029 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.301+0000 7f612121e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f611c1076b0 0x7f611c107ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:36.029 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.301+0000 7f612121e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f611c108080 con 0x7f611c1076b0 2024-09-19T08:47:36.029 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.301+0000 7f611ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f611c1076b0 0x7f611c107ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:36.029 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.301+0000 7f611ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f611c1076b0 0x7f611c107ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58816/0 (socket says 172.21.15.92:58816) 2024-09-19T08:47:36.029 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.301+0000 7f611ad9d640 1 -- 172.21.15.92:0/3318986640 learned_addr learned my addr 172.21.15.92:0/3318986640 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:36.029 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.302+0000 7f611ad9d640 1 -- 172.21.15.92:0/3318986640 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f611c1088b0 con 0x7f611c1076b0 2024-09-19T08:47:36.030 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.302+0000 7f611ad9d640 1 --2- 172.21.15.92:0/3318986640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f611c1076b0 0x7f611c107ab0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f610c009e80 tx=0x7f610c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dafc3ba65f72e2be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:36.030 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.302+0000 7f6119d9b640 1 -- 172.21.15.92:0/3318986640 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f610c036070 con 0x7f611c1076b0 2024-09-19T08:47:36.030 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.303+0000 7f6119d9b640 1 -- 172.21.15.92:0/3318986640 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f610c0318c0 con 0x7f611c1076b0 2024-09-19T08:47:36.030 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.303+0000 7f6119d9b640 1 -- 172.21.15.92:0/3318986640 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f610c007ab0 con 0x7f611c1076b0 2024-09-19T08:47:36.030 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.303+0000 7f612121e640 1 -- 172.21.15.92:0/3318986640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f611c1076b0 msgr2=0x7f611c107ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:36.030 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.303+0000 7f612121e640 1 --2- 172.21.15.92:0/3318986640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f611c1076b0 0x7f611c107ab0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f610c009e80 tx=0x7f610c02a7a0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.030 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.303+0000 7f612121e640 1 -- 172.21.15.92:0/3318986640 shutdown_connections 2024-09-19T08:47:36.030 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.303+0000 7f612121e640 1 --2- 172.21.15.92:0/3318986640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f611c1076b0 0x7f611c107ab0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.030 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.303+0000 7f612121e640 1 -- 172.21.15.92:0/3318986640 >> 172.21.15.92:0/3318986640 conn(0x7f611c102e80 msgr2=0x7f611c1052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:36.030 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.303+0000 7f612121e640 1 -- 172.21.15.92:0/3318986640 shutdown_connections 2024-09-19T08:47:36.030 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.303+0000 7f612121e640 1 -- 172.21.15.92:0/3318986640 wait complete. 2024-09-19T08:47:36.030 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.304+0000 7f612121e640 1 Processor -- start 2024-09-19T08:47:36.030 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.304+0000 7f612121e640 1 -- start start 2024-09-19T08:47:36.031 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.304+0000 7f612121e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f611c1076b0 0x7f611c07db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:36.031 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.304+0000 7f612121e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f611c10bc60 con 0x7f611c1076b0 2024-09-19T08:47:36.031 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.304+0000 7f611ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f611c1076b0 0x7f611c07db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:36.031 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.304+0000 7f611ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f611c1076b0 0x7f611c07db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58822/0 (socket says 172.21.15.92:58822) 2024-09-19T08:47:36.031 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.305+0000 7f611ad9d640 1 -- 172.21.15.92:0/2028467585 learned_addr learned my addr 172.21.15.92:0/2028467585 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:36.031 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.305+0000 7f611ad9d640 1 -- 172.21.15.92:0/2028467585 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f611c07e0d0 con 0x7f611c1076b0 2024-09-19T08:47:36.031 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.305+0000 7f611ad9d640 1 --2- 172.21.15.92:0/2028467585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f611c1076b0 0x7f611c07db90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f610c02ad90 tx=0x7f610c031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:36.031 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.305+0000 7f6103fff640 1 -- 172.21.15.92:0/2028467585 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f610c036050 con 0x7f611c1076b0 2024-09-19T08:47:36.031 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.305+0000 7f6103fff640 1 -- 172.21.15.92:0/2028467585 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f610c042070 con 0x7f611c1076b0 2024-09-19T08:47:36.031 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.305+0000 7f612121e640 1 -- 172.21.15.92:0/2028467585 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f611c07c2c0 con 0x7f611c1076b0 2024-09-19T08:47:36.031 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.305+0000 7f6103fff640 1 -- 172.21.15.92:0/2028467585 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f610c03d7e0 con 0x7f611c1076b0 2024-09-19T08:47:36.031 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.305+0000 7f612121e640 1 -- 172.21.15.92:0/2028467585 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f611c07c800 con 0x7f611c1076b0 2024-09-19T08:47:36.031 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.306+0000 7f6103fff640 1 -- 172.21.15.92:0/2028467585 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f610c03dae0 con 0x7f611c1076b0 2024-09-19T08:47:36.031 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.306+0000 7f612121e640 1 -- 172.21.15.92:0/2028467585 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f611c107b30 con 0x7f611c1076b0 2024-09-19T08:47:36.032 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.306+0000 7f6103fff640 1 --2- 172.21.15.92:0/2028467585 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f61040391b0 0x7f610403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:36.032 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.306+0000 7f6103fff640 1 -- 172.21.15.92:0/2028467585 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f610c007e00 con 0x7f611c1076b0 2024-09-19T08:47:36.032 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.306+0000 7f611a59c640 1 --2- 172.21.15.92:0/2028467585 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f61040391b0 0x7f610403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:36.032 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.307+0000 7f611a59c640 1 --2- 172.21.15.92:0/2028467585 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f61040391b0 0x7f610403b670 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f61100098c0 tx=0x7f6110006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:36.032 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.311+0000 7f6103fff640 1 -- 172.21.15.92:0/2028467585 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f610c039de0 con 0x7f611c1076b0 2024-09-19T08:47:36.032 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.478+0000 7f612121e640 1 -- 172.21.15.92:0/2028467585 --> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f611c07d150 con 0x7f61040391b0 2024-09-19T08:47:36.032 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.478+0000 7f6103fff640 1 -- 172.21.15.92:0/2028467585 <== mgr.14118 v2:172.21.15.92:6800/2908709470 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f611c07d150 con 0x7f61040391b0 2024-09-19T08:47:36.032 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.480+0000 7f612121e640 1 -- 172.21.15.92:0/2028467585 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f61040391b0 msgr2=0x7f610403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:36.032 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.480+0000 7f612121e640 1 --2- 172.21.15.92:0/2028467585 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f61040391b0 0x7f610403b670 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f61100098c0 tx=0x7f6110006db0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.032 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.480+0000 7f612121e640 1 -- 172.21.15.92:0/2028467585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f611c1076b0 msgr2=0x7f611c07db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:36.032 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.480+0000 7f612121e640 1 --2- 172.21.15.92:0/2028467585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f611c1076b0 0x7f611c07db90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f610c02ad90 tx=0x7f610c031ca0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.032 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.481+0000 7f612121e640 1 -- 172.21.15.92:0/2028467585 shutdown_connections 2024-09-19T08:47:36.033 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.481+0000 7f612121e640 1 --2- 172.21.15.92:0/2028467585 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f61040391b0 0x7f610403b670 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.033 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.481+0000 7f612121e640 1 --2- 172.21.15.92:0/2028467585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f611c1076b0 0x7f611c07db90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.033 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.481+0000 7f612121e640 1 -- 172.21.15.92:0/2028467585 >> 172.21.15.92:0/2028467585 conn(0x7f611c102e80 msgr2=0x7f611c1039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:36.033 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.481+0000 7f612121e640 1 -- 172.21.15.92:0/2028467585 shutdown_connections 2024-09-19T08:47:36.033 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:35.481+0000 7f612121e640 1 -- 172.21.15.92:0/2028467585 wait complete. 2024-09-19T08:47:36.033 INFO:teuthology.orchestra.run.smithi092.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-19T08:47:36.033 INFO:teuthology.orchestra.run.smithi092.stdout:Adding key to root@localhost authorized_keys... 2024-09-19T08:47:36.036 INFO:teuthology.orchestra.run.smithi092.stdout:Adding host smithi092... 2024-09-19T08:47:36.606 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:36 smithi092 ceph-mon[31407]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:47:37.388 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:37 smithi092 ceph-mon[31407]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi092", "addr": "172.21.15.92", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:47:38.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:38 smithi092 ceph-mon[31407]: Deploying cephadm binary to smithi092 2024-09-19T08:47:40.421 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout Added host 'smithi092' with addr '172.21.15.92' 2024-09-19T08:47:40.422 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.421+0000 7f07df12c640 1 Processor -- start 2024-09-19T08:47:40.422 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.422+0000 7f07df12c640 1 -- start start 2024-09-19T08:47:40.422 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.422+0000 7f07df12c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07d81076b0 0x7f07d8107ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:40.422 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.422+0000 7f07df12c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f07d8108080 con 0x7f07d81076b0 2024-09-19T08:47:40.422 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.422+0000 7f07dcec8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07d81076b0 0x7f07d8107ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:40.422 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.422+0000 7f07dcec8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07d81076b0 0x7f07d8107ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58830/0 (socket says 172.21.15.92:58830) 2024-09-19T08:47:40.422 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.422+0000 7f07dcec8640 1 -- 172.21.15.92:0/2871189241 learned_addr learned my addr 172.21.15.92:0/2871189241 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:40.422 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.422+0000 7f07dcec8640 1 -- 172.21.15.92:0/2871189241 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07d81088b0 con 0x7f07d81076b0 2024-09-19T08:47:40.422 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.423+0000 7f07dcec8640 1 --2- 172.21.15.92:0/2871189241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07d81076b0 0x7f07d8107ab0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f07cc009820 tx=0x7f07cc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c6c055c7e31b25 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:40.422 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.423+0000 7f07d77fe640 1 -- 172.21.15.92:0/2871189241 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07cc037070 con 0x7f07d81076b0 2024-09-19T08:47:40.422 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.423+0000 7f07d77fe640 1 -- 172.21.15.92:0/2871189241 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f07cc032900 con 0x7f07d81076b0 2024-09-19T08:47:40.423 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.423+0000 7f07d77fe640 1 -- 172.21.15.92:0/2871189241 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07cc030850 con 0x7f07d81076b0 2024-09-19T08:47:40.423 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.423+0000 7f07df12c640 1 -- 172.21.15.92:0/2871189241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07d81076b0 msgr2=0x7f07d8107ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:40.423 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.423+0000 7f07df12c640 1 --2- 172.21.15.92:0/2871189241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07d81076b0 0x7f07d8107ab0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f07cc009820 tx=0x7f07cc02a270 comp rx=0 tx=0).stop 2024-09-19T08:47:40.423 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.424+0000 7f07df12c640 1 -- 172.21.15.92:0/2871189241 shutdown_connections 2024-09-19T08:47:40.423 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.424+0000 7f07df12c640 1 --2- 172.21.15.92:0/2871189241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07d81076b0 0x7f07d8107ab0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.423 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.424+0000 7f07df12c640 1 -- 172.21.15.92:0/2871189241 >> 172.21.15.92:0/2871189241 conn(0x7f07d8102e80 msgr2=0x7f07d81052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:40.423 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.424+0000 7f07df12c640 1 -- 172.21.15.92:0/2871189241 shutdown_connections 2024-09-19T08:47:40.423 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.424+0000 7f07df12c640 1 -- 172.21.15.92:0/2871189241 wait complete. 2024-09-19T08:47:40.423 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.424+0000 7f07df12c640 1 Processor -- start 2024-09-19T08:47:40.423 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.424+0000 7f07df12c640 1 -- start start 2024-09-19T08:47:40.423 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.424+0000 7f07df12c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07d81076b0 0x7f07d819b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:40.423 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.424+0000 7f07df12c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f07d810bc60 con 0x7f07d81076b0 2024-09-19T08:47:40.423 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.424+0000 7f07dcec8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07d81076b0 0x7f07d819b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:40.424 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.424+0000 7f07dcec8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07d81076b0 0x7f07d819b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58840/0 (socket says 172.21.15.92:58840) 2024-09-19T08:47:40.424 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.424+0000 7f07dcec8640 1 -- 172.21.15.92:0/50690037 learned_addr learned my addr 172.21.15.92:0/50690037 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:40.424 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.425+0000 7f07dcec8640 1 -- 172.21.15.92:0/50690037 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07d819bba0 con 0x7f07d81076b0 2024-09-19T08:47:40.424 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.425+0000 7f07dcec8640 1 --2- 172.21.15.92:0/50690037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07d81076b0 0x7f07d819b660 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f07cc009940 tx=0x7f07cc032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:40.424 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.425+0000 7f07d5ffb640 1 -- 172.21.15.92:0/50690037 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07cc042070 con 0x7f07d81076b0 2024-09-19T08:47:40.424 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.425+0000 7f07d5ffb640 1 -- 172.21.15.92:0/50690037 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f07cc0308c0 con 0x7f07d81076b0 2024-09-19T08:47:40.424 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.425+0000 7f07df12c640 1 -- 172.21.15.92:0/50690037 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07d819be30 con 0x7f07d81076b0 2024-09-19T08:47:40.424 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.425+0000 7f07d5ffb640 1 -- 172.21.15.92:0/50690037 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07cc037040 con 0x7f07d81076b0 2024-09-19T08:47:40.424 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.425+0000 7f07df12c640 1 -- 172.21.15.92:0/50690037 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07d819eb20 con 0x7f07d81076b0 2024-09-19T08:47:40.424 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.426+0000 7f07d5ffb640 1 -- 172.21.15.92:0/50690037 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f07cc045070 con 0x7f07d81076b0 2024-09-19T08:47:40.424 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.426+0000 7f07d5ffb640 1 --2- 172.21.15.92:0/50690037 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f07c80391b0 0x7f07c803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:40.424 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.426+0000 7f07df12c640 1 -- 172.21.15.92:0/50690037 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07d8107b30 con 0x7f07d81076b0 2024-09-19T08:47:40.424 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.426+0000 7f07d5ffb640 1 -- 172.21.15.92:0/50690037 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f07cc06c330 con 0x7f07d81076b0 2024-09-19T08:47:40.425 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.426+0000 7f07d7fff640 1 --2- 172.21.15.92:0/50690037 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f07c80391b0 0x7f07c803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:40.425 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.427+0000 7f07d7fff640 1 --2- 172.21.15.92:0/50690037 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f07c80391b0 0x7f07c803b670 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f07c40098c0 tx=0x7f07c4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:40.425 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.431+0000 7f07d5ffb640 1 -- 172.21.15.92:0/50690037 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f07cc02fd90 con 0x7f07d81076b0 2024-09-19T08:47:40.425 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:36.606+0000 7f07df12c640 1 -- 172.21.15.92:0/50690037 --> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi092", "addr": "172.21.15.92", "target": ["mon-mgr", ""]}) -- 0x7f07d81040c0 con 0x7f07c80391b0 2024-09-19T08:47:40.425 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:39.808+0000 7f07d5ffb640 1 -- 172.21.15.92:0/50690037 <== mgr.14118 v2:172.21.15.92:6800/2908709470 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f07d81040c0 con 0x7f07c80391b0 2024-09-19T08:47:40.425 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:39.810+0000 7f07df12c640 1 -- 172.21.15.92:0/50690037 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f07c80391b0 msgr2=0x7f07c803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:40.425 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:39.810+0000 7f07df12c640 1 --2- 172.21.15.92:0/50690037 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f07c80391b0 0x7f07c803b670 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f07c40098c0 tx=0x7f07c4006db0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.425 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:39.810+0000 7f07df12c640 1 -- 172.21.15.92:0/50690037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07d81076b0 msgr2=0x7f07d819b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:40.425 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:39.810+0000 7f07df12c640 1 --2- 172.21.15.92:0/50690037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07d81076b0 0x7f07d819b660 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f07cc009940 tx=0x7f07cc032ce0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.425 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:39.810+0000 7f07df12c640 1 -- 172.21.15.92:0/50690037 shutdown_connections 2024-09-19T08:47:40.425 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:39.810+0000 7f07df12c640 1 --2- 172.21.15.92:0/50690037 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f07c80391b0 0x7f07c803b670 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.425 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:39.810+0000 7f07df12c640 1 --2- 172.21.15.92:0/50690037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07d81076b0 0x7f07d819b660 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.426 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:39.810+0000 7f07df12c640 1 -- 172.21.15.92:0/50690037 >> 172.21.15.92:0/50690037 conn(0x7f07d8102e80 msgr2=0x7f07d81039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:40.426 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:39.811+0000 7f07df12c640 1 -- 172.21.15.92:0/50690037 shutdown_connections 2024-09-19T08:47:40.426 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:39.811+0000 7f07df12c640 1 -- 172.21.15.92:0/50690037 wait complete. 2024-09-19T08:47:40.426 INFO:teuthology.orchestra.run.smithi092.stdout:Deploying unmanaged mon service... 2024-09-19T08:47:41.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:40 smithi092 ceph-mon[31407]: from='mgr.14118 172.21.15.92:0/17008104' entity='mgr.x' 2024-09-19T08:47:41.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:40 smithi092 ceph-mon[31407]: Added host smithi092 2024-09-19T08:47:41.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:40 smithi092 ceph-mon[31407]: from='mgr.14118 172.21.15.92:0/17008104' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:47:41.733 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-19T08:47:41.733 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.824+0000 7fbea58bb640 1 Processor -- start 2024-09-19T08:47:41.733 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.824+0000 7fbea58bb640 1 -- start start 2024-09-19T08:47:41.733 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.824+0000 7fbea58bb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbea01076b0 0x7fbea0107ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:41.733 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.824+0000 7fbea58bb640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbea0108080 con 0x7fbea01076b0 2024-09-19T08:47:41.733 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.824+0000 7fbe9effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbea01076b0 0x7fbea0107ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:41.733 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.824+0000 7fbe9effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbea01076b0 0x7fbea0107ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58842/0 (socket says 172.21.15.92:58842) 2024-09-19T08:47:41.734 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.824+0000 7fbe9effd640 1 -- 172.21.15.92:0/2236109030 learned_addr learned my addr 172.21.15.92:0/2236109030 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:41.734 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.824+0000 7fbe9effd640 1 -- 172.21.15.92:0/2236109030 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbea01088b0 con 0x7fbea01076b0 2024-09-19T08:47:41.734 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.825+0000 7fbe9effd640 1 --2- 172.21.15.92:0/2236109030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbea01076b0 0x7fbea0107ab0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbe90009820 tx=0x7fbe9002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1575e1458682077 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:41.734 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.825+0000 7fbe9e7fc640 1 -- 172.21.15.92:0/2236109030 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe90037070 con 0x7fbea01076b0 2024-09-19T08:47:41.734 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.825+0000 7fbe9e7fc640 1 -- 172.21.15.92:0/2236109030 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbe90032900 con 0x7fbea01076b0 2024-09-19T08:47:41.734 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.825+0000 7fbe9e7fc640 1 -- 172.21.15.92:0/2236109030 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe90030850 con 0x7fbea01076b0 2024-09-19T08:47:41.734 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.826+0000 7fbea58bb640 1 -- 172.21.15.92:0/2236109030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbea01076b0 msgr2=0x7fbea0107ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:41.734 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.826+0000 7fbea58bb640 1 --2- 172.21.15.92:0/2236109030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbea01076b0 0x7fbea0107ab0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbe90009820 tx=0x7fbe9002a270 comp rx=0 tx=0).stop 2024-09-19T08:47:41.734 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.826+0000 7fbea58bb640 1 -- 172.21.15.92:0/2236109030 shutdown_connections 2024-09-19T08:47:41.734 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.826+0000 7fbea58bb640 1 --2- 172.21.15.92:0/2236109030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbea01076b0 0x7fbea0107ab0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:41.734 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.826+0000 7fbea58bb640 1 -- 172.21.15.92:0/2236109030 >> 172.21.15.92:0/2236109030 conn(0x7fbea0102e80 msgr2=0x7fbea01052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:41.734 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.826+0000 7fbea58bb640 1 -- 172.21.15.92:0/2236109030 shutdown_connections 2024-09-19T08:47:41.734 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.826+0000 7fbea58bb640 1 -- 172.21.15.92:0/2236109030 wait complete. 2024-09-19T08:47:41.735 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.826+0000 7fbea58bb640 1 Processor -- start 2024-09-19T08:47:41.735 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.826+0000 7fbea58bb640 1 -- start start 2024-09-19T08:47:41.735 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.827+0000 7fbea58bb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbea01076b0 0x7fbea019b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:41.735 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.827+0000 7fbea58bb640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbea010bc60 con 0x7fbea01076b0 2024-09-19T08:47:41.735 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.827+0000 7fbe9effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbea01076b0 0x7fbea019b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:41.735 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.827+0000 7fbe9effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbea01076b0 0x7fbea019b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58850/0 (socket says 172.21.15.92:58850) 2024-09-19T08:47:41.735 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.827+0000 7fbe9effd640 1 -- 172.21.15.92:0/1213677393 learned_addr learned my addr 172.21.15.92:0/1213677393 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:41.735 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.827+0000 7fbe9effd640 1 -- 172.21.15.92:0/1213677393 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbea019bba0 con 0x7fbea01076b0 2024-09-19T08:47:41.735 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.827+0000 7fbe9effd640 1 --2- 172.21.15.92:0/1213677393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbea01076b0 0x7fbea019b660 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbe90009940 tx=0x7fbe90032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:41.735 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.827+0000 7fbea48b9640 1 -- 172.21.15.92:0/1213677393 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe90042070 con 0x7fbea01076b0 2024-09-19T08:47:41.735 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.827+0000 7fbea58bb640 1 -- 172.21.15.92:0/1213677393 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbea019be30 con 0x7fbea01076b0 2024-09-19T08:47:41.735 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.827+0000 7fbea48b9640 1 -- 172.21.15.92:0/1213677393 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbe900308c0 con 0x7fbea01076b0 2024-09-19T08:47:41.735 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.827+0000 7fbea48b9640 1 -- 172.21.15.92:0/1213677393 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe90037040 con 0x7fbea01076b0 2024-09-19T08:47:41.736 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.827+0000 7fbea58bb640 1 -- 172.21.15.92:0/1213677393 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbea019eb20 con 0x7fbea01076b0 2024-09-19T08:47:41.736 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.828+0000 7fbea48b9640 1 -- 172.21.15.92:0/1213677393 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fbe90045070 con 0x7fbea01076b0 2024-09-19T08:47:41.736 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.828+0000 7fbea48b9640 1 --2- 172.21.15.92:0/1213677393 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7fbe8c0391b0 0x7fbe8c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:41.736 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.828+0000 7fbea48b9640 1 -- 172.21.15.92:0/1213677393 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fbe9006c860 con 0x7fbea01076b0 2024-09-19T08:47:41.736 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.828+0000 7fbe97fff640 1 --2- 172.21.15.92:0/1213677393 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7fbe8c0391b0 0x7fbe8c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:41.736 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.828+0000 7fbea58bb640 1 -- 172.21.15.92:0/1213677393 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbea0107b30 con 0x7fbea01076b0 2024-09-19T08:47:41.736 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.829+0000 7fbe97fff640 1 --2- 172.21.15.92:0/1213677393 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7fbe8c0391b0 0x7fbe8c03b670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbe880098c0 tx=0x7fbe88006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:41.737 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:40.833+0000 7fbea48b9640 1 -- 172.21.15.92:0/1213677393 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbe9004b170 con 0x7fbea01076b0 2024-09-19T08:47:41.737 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:41.024+0000 7fbea58bb640 1 -- 172.21.15.92:0/1213677393 --> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fbea0104110 con 0x7fbe8c0391b0 2024-09-19T08:47:41.737 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:41.029+0000 7fbea48b9640 1 -- 172.21.15.92:0/1213677393 <== mgr.14118 v2:172.21.15.92:6800/2908709470 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fbea0104110 con 0x7fbe8c0391b0 2024-09-19T08:47:41.737 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:41.031+0000 7fbea58bb640 1 -- 172.21.15.92:0/1213677393 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7fbe8c0391b0 msgr2=0x7fbe8c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:41.737 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:41.031+0000 7fbea58bb640 1 --2- 172.21.15.92:0/1213677393 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7fbe8c0391b0 0x7fbe8c03b670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbe880098c0 tx=0x7fbe88006db0 comp rx=0 tx=0).stop 2024-09-19T08:47:41.737 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:41.031+0000 7fbea58bb640 1 -- 172.21.15.92:0/1213677393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbea01076b0 msgr2=0x7fbea019b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:41.737 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:41.031+0000 7fbea58bb640 1 --2- 172.21.15.92:0/1213677393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbea01076b0 0x7fbea019b660 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbe90009940 tx=0x7fbe90032ce0 comp rx=0 tx=0).stop 2024-09-19T08:47:41.737 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:41.031+0000 7fbea58bb640 1 -- 172.21.15.92:0/1213677393 shutdown_connections 2024-09-19T08:47:41.737 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:41.031+0000 7fbea58bb640 1 --2- 172.21.15.92:0/1213677393 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7fbe8c0391b0 0x7fbe8c03b670 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:41.737 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:41.031+0000 7fbea58bb640 1 --2- 172.21.15.92:0/1213677393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbea01076b0 0x7fbea019b660 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:41.737 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:41.031+0000 7fbea58bb640 1 -- 172.21.15.92:0/1213677393 >> 172.21.15.92:0/1213677393 conn(0x7fbea0102e80 msgr2=0x7fbea0103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:41.737 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:41.031+0000 7fbea58bb640 1 -- 172.21.15.92:0/1213677393 shutdown_connections 2024-09-19T08:47:41.737 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:41.031+0000 7fbea58bb640 1 -- 172.21.15.92:0/1213677393 wait complete. 2024-09-19T08:47:41.738 INFO:teuthology.orchestra.run.smithi092.stdout:Deploying unmanaged mgr service... 2024-09-19T08:47:42.325 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:42 smithi092 ceph-mon[31407]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:47:42.325 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:42 smithi092 ceph-mon[31407]: Saving service mon spec with placement count:5 2024-09-19T08:47:42.325 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:42 smithi092 ceph-mon[31407]: from='mgr.14118 172.21.15.92:0/17008104' entity='mgr.x' 2024-09-19T08:47:43.200 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-19T08:47:43.200 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.325+0000 7fc00c59a640 1 Processor -- start 2024-09-19T08:47:43.200 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.325+0000 7fc00c59a640 1 -- start start 2024-09-19T08:47:43.200 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.325+0000 7fc00c59a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc004107b90 0x7fc004107f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:43.200 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.325+0000 7fc00c59a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc004108560 con 0x7fc004107b90 2024-09-19T08:47:43.200 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.325+0000 7fc00a336640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc004107b90 0x7fc004107f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:43.200 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.325+0000 7fc00a336640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc004107b90 0x7fc004107f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53870/0 (socket says 172.21.15.92:53870) 2024-09-19T08:47:43.200 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.325+0000 7fc00a336640 1 -- 172.21.15.92:0/2150535268 learned_addr learned my addr 172.21.15.92:0/2150535268 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:43.200 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.325+0000 7fc00a336640 1 -- 172.21.15.92:0/2150535268 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0041067f0 con 0x7fc004107b90 2024-09-19T08:47:43.201 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.326+0000 7fc00a336640 1 --2- 172.21.15.92:0/2150535268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc004107b90 0x7fc004107f90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc000009820 tx=0x7fc00002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=212fa397787c33fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:43.201 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.326+0000 7fc009334640 1 -- 172.21.15.92:0/2150535268 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc000037070 con 0x7fc004107b90 2024-09-19T08:47:43.201 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.326+0000 7fc009334640 1 -- 172.21.15.92:0/2150535268 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc000032900 con 0x7fc004107b90 2024-09-19T08:47:43.201 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.326+0000 7fc009334640 1 -- 172.21.15.92:0/2150535268 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc000030850 con 0x7fc004107b90 2024-09-19T08:47:43.201 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.327+0000 7fc00c59a640 1 -- 172.21.15.92:0/2150535268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc004107b90 msgr2=0x7fc004107f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:43.201 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.327+0000 7fc00c59a640 1 --2- 172.21.15.92:0/2150535268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc004107b90 0x7fc004107f90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc000009820 tx=0x7fc00002a270 comp rx=0 tx=0).stop 2024-09-19T08:47:43.201 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.327+0000 7fc00c59a640 1 -- 172.21.15.92:0/2150535268 shutdown_connections 2024-09-19T08:47:43.201 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.327+0000 7fc00c59a640 1 --2- 172.21.15.92:0/2150535268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc004107b90 0x7fc004107f90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:43.201 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.327+0000 7fc00c59a640 1 -- 172.21.15.92:0/2150535268 >> 172.21.15.92:0/2150535268 conn(0x7fc004101510 msgr2=0x7fc004103930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:43.201 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.327+0000 7fc00c59a640 1 -- 172.21.15.92:0/2150535268 shutdown_connections 2024-09-19T08:47:43.201 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.327+0000 7fc00c59a640 1 -- 172.21.15.92:0/2150535268 wait complete. 2024-09-19T08:47:43.201 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.327+0000 7fc00c59a640 1 Processor -- start 2024-09-19T08:47:43.201 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.327+0000 7fc00c59a640 1 -- start start 2024-09-19T08:47:43.202 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.328+0000 7fc00c59a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc004107b90 0x7fc004106160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:43.202 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.328+0000 7fc00c59a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc00410abb0 con 0x7fc004107b90 2024-09-19T08:47:43.202 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.328+0000 7fc00a336640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc004107b90 0x7fc004106160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:43.202 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.328+0000 7fc00a336640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc004107b90 0x7fc004106160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53882/0 (socket says 172.21.15.92:53882) 2024-09-19T08:47:43.202 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.328+0000 7fc00a336640 1 -- 172.21.15.92:0/1197676303 learned_addr learned my addr 172.21.15.92:0/1197676303 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:43.202 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.328+0000 7fc00a336640 1 -- 172.21.15.92:0/1197676303 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc00419e3b0 con 0x7fc004107b90 2024-09-19T08:47:43.202 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.328+0000 7fc00a336640 1 --2- 172.21.15.92:0/1197676303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc004107b90 0x7fc004106160 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc0000097f0 tx=0x7fc000030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:43.202 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.328+0000 7fbffb7fe640 1 -- 172.21.15.92:0/1197676303 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc000037040 con 0x7fc004107b90 2024-09-19T08:47:43.202 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.328+0000 7fbffb7fe640 1 -- 172.21.15.92:0/1197676303 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc000040070 con 0x7fc004107b90 2024-09-19T08:47:43.202 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.328+0000 7fc00c59a640 1 -- 172.21.15.92:0/1197676303 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc00419e580 con 0x7fc004107b90 2024-09-19T08:47:43.202 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.328+0000 7fbffb7fe640 1 -- 172.21.15.92:0/1197676303 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc00003a390 con 0x7fc004107b90 2024-09-19T08:47:43.202 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.328+0000 7fc00c59a640 1 -- 172.21.15.92:0/1197676303 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc00419e920 con 0x7fc004107b90 2024-09-19T08:47:43.202 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.329+0000 7fbffb7fe640 1 -- 172.21.15.92:0/1197676303 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fc00003b430 con 0x7fc004107b90 2024-09-19T08:47:43.203 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.329+0000 7fc00c59a640 1 -- 172.21.15.92:0/1197676303 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc004108010 con 0x7fc004107b90 2024-09-19T08:47:43.203 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.330+0000 7fbffb7fe640 1 --2- 172.21.15.92:0/1197676303 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7fbff0039200 0x7fbff003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:43.203 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.330+0000 7fbffb7fe640 1 -- 172.21.15.92:0/1197676303 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc00006c710 con 0x7fc004107b90 2024-09-19T08:47:43.203 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.330+0000 7fc009b35640 1 --2- 172.21.15.92:0/1197676303 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7fbff0039200 0x7fbff003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:43.203 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.330+0000 7fc009b35640 1 --2- 172.21.15.92:0/1197676303 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7fbff0039200 0x7fbff003b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbff40098c0 tx=0x7fbff4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:43.203 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.334+0000 7fbffb7fe640 1 -- 172.21.15.92:0/1197676303 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc000032900 con 0x7fc004107b90 2024-09-19T08:47:43.203 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.518+0000 7fc00c59a640 1 -- 172.21.15.92:0/1197676303 --> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fc004102770 con 0x7fbff0039200 2024-09-19T08:47:43.203 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.523+0000 7fbffb7fe640 1 -- 172.21.15.92:0/1197676303 <== mgr.14118 v2:172.21.15.92:6800/2908709470 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fc004102770 con 0x7fbff0039200 2024-09-19T08:47:43.203 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.525+0000 7fc00c59a640 1 -- 172.21.15.92:0/1197676303 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7fbff0039200 msgr2=0x7fbff003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:43.203 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.525+0000 7fc00c59a640 1 --2- 172.21.15.92:0/1197676303 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7fbff0039200 0x7fbff003b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbff40098c0 tx=0x7fbff4006db0 comp rx=0 tx=0).stop 2024-09-19T08:47:43.203 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.525+0000 7fc00c59a640 1 -- 172.21.15.92:0/1197676303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc004107b90 msgr2=0x7fc004106160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:43.203 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.525+0000 7fc00c59a640 1 --2- 172.21.15.92:0/1197676303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc004107b90 0x7fc004106160 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc0000097f0 tx=0x7fc000030d80 comp rx=0 tx=0).stop 2024-09-19T08:47:43.204 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.525+0000 7fc00c59a640 1 -- 172.21.15.92:0/1197676303 shutdown_connections 2024-09-19T08:47:43.204 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.525+0000 7fc00c59a640 1 --2- 172.21.15.92:0/1197676303 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7fbff0039200 0x7fbff003b6c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:43.204 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.525+0000 7fc00c59a640 1 --2- 172.21.15.92:0/1197676303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc004107b90 0x7fc004106160 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:43.204 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.525+0000 7fc00c59a640 1 -- 172.21.15.92:0/1197676303 >> 172.21.15.92:0/1197676303 conn(0x7fc004101510 msgr2=0x7fc004102060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:43.204 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.525+0000 7fc00c59a640 1 -- 172.21.15.92:0/1197676303 shutdown_connections 2024-09-19T08:47:43.204 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:42.525+0000 7fc00c59a640 1 -- 172.21.15.92:0/1197676303 wait complete. 2024-09-19T08:47:43.570 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:43 smithi092 ceph-mon[31407]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:47:43.570 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:43 smithi092 ceph-mon[31407]: Saving service mgr spec with placement count:2 2024-09-19T08:47:43.570 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:43 smithi092 ceph-mon[31407]: from='mgr.14118 172.21.15.92:0/17008104' entity='mgr.x' 2024-09-19T08:47:44.717 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.579+0000 7f1670a32640 1 Processor -- start 2024-09-19T08:47:44.717 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.579+0000 7f1670a32640 1 -- start start 2024-09-19T08:47:44.717 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.579+0000 7f1670a32640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f166c107c40 0x7f166c108040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:44.717 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.579+0000 7f1670a32640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f166c108610 con 0x7f166c107c40 2024-09-19T08:47:44.717 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.579+0000 7f166a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f166c107c40 0x7f166c108040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:44.718 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.579+0000 7f166a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f166c107c40 0x7f166c108040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53890/0 (socket says 172.21.15.92:53890) 2024-09-19T08:47:44.718 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.579+0000 7f166a59c640 1 -- 172.21.15.92:0/375045387 learned_addr learned my addr 172.21.15.92:0/375045387 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:44.718 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.579+0000 7f166a59c640 1 -- 172.21.15.92:0/375045387 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f166c108790 con 0x7f166c107c40 2024-09-19T08:47:44.718 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.580+0000 7f166a59c640 1 --2- 172.21.15.92:0/375045387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f166c107c40 0x7f166c108040 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f165c009820 tx=0x7f165c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79ba962b2ac9702f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:44.718 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.580+0000 7f1669d9b640 1 -- 172.21.15.92:0/375045387 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f165c037070 con 0x7f166c107c40 2024-09-19T08:47:44.718 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.580+0000 7f1669d9b640 1 -- 172.21.15.92:0/375045387 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f165c032900 con 0x7f166c107c40 2024-09-19T08:47:44.718 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.580+0000 7f1669d9b640 1 -- 172.21.15.92:0/375045387 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f165c030850 con 0x7f166c107c40 2024-09-19T08:47:44.718 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.581+0000 7f1670a32640 1 -- 172.21.15.92:0/375045387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f166c107c40 msgr2=0x7f166c108040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:44.718 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.581+0000 7f1670a32640 1 --2- 172.21.15.92:0/375045387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f166c107c40 0x7f166c108040 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f165c009820 tx=0x7f165c02a270 comp rx=0 tx=0).stop 2024-09-19T08:47:44.718 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.581+0000 7f1670a32640 1 -- 172.21.15.92:0/375045387 shutdown_connections 2024-09-19T08:47:44.718 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.581+0000 7f1670a32640 1 --2- 172.21.15.92:0/375045387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f166c107c40 0x7f166c108040 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:44.718 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.581+0000 7f1670a32640 1 -- 172.21.15.92:0/375045387 >> 172.21.15.92:0/375045387 conn(0x7f166c101510 msgr2=0x7f166c103930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:44.719 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.581+0000 7f1670a32640 1 -- 172.21.15.92:0/375045387 shutdown_connections 2024-09-19T08:47:44.719 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.581+0000 7f1670a32640 1 -- 172.21.15.92:0/375045387 wait complete. 2024-09-19T08:47:44.719 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.582+0000 7f1670a32640 1 Processor -- start 2024-09-19T08:47:44.719 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.582+0000 7f1670a32640 1 -- start start 2024-09-19T08:47:44.719 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.582+0000 7f1670a32640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f166c107c40 0x7f166c19d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:44.719 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.582+0000 7f1670a32640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f166c1065f0 con 0x7f166c107c40 2024-09-19T08:47:44.719 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.582+0000 7f166a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f166c107c40 0x7f166c19d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:44.719 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.582+0000 7f166a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f166c107c40 0x7f166c19d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53894/0 (socket says 172.21.15.92:53894) 2024-09-19T08:47:44.719 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.582+0000 7f166a59c640 1 -- 172.21.15.92:0/4135715722 learned_addr learned my addr 172.21.15.92:0/4135715722 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:44.719 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.582+0000 7f166a59c640 1 -- 172.21.15.92:0/4135715722 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f166c19dd70 con 0x7f166c107c40 2024-09-19T08:47:44.719 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.582+0000 7f166a59c640 1 --2- 172.21.15.92:0/4135715722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f166c107c40 0x7f166c19d830 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f165c0097f0 tx=0x7f165c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:44.719 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.582+0000 7f16637fe640 1 -- 172.21.15.92:0/4135715722 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f165c037040 con 0x7f166c107c40 2024-09-19T08:47:44.720 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.582+0000 7f16637fe640 1 -- 172.21.15.92:0/4135715722 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f165c040070 con 0x7f166c107c40 2024-09-19T08:47:44.720 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.582+0000 7f1670a32640 1 -- 172.21.15.92:0/4135715722 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f166c19e000 con 0x7f166c107c40 2024-09-19T08:47:44.720 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.582+0000 7f16637fe640 1 -- 172.21.15.92:0/4135715722 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f165c03a390 con 0x7f166c107c40 2024-09-19T08:47:44.720 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.583+0000 7f1670a32640 1 -- 172.21.15.92:0/4135715722 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f166c1a0cf0 con 0x7f166c107c40 2024-09-19T08:47:44.720 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.583+0000 7f16637fe640 1 -- 172.21.15.92:0/4135715722 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f165c03a5e0 con 0x7f166c107c40 2024-09-19T08:47:44.720 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.584+0000 7f16637fe640 1 --2- 172.21.15.92:0/4135715722 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f1658039200 0x7f165803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:44.720 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.584+0000 7f16637fe640 1 -- 172.21.15.92:0/4135715722 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f165c06c8b0 con 0x7f166c107c40 2024-09-19T08:47:44.720 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.584+0000 7f1670a32640 1 -- 172.21.15.92:0/4135715722 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f166c1080c0 con 0x7f166c107c40 2024-09-19T08:47:44.720 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.584+0000 7f1663fff640 1 --2- 172.21.15.92:0/4135715722 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f1658039200 0x7f165803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:44.720 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.584+0000 7f1663fff640 1 --2- 172.21.15.92:0/4135715722 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f1658039200 0x7f165803b6c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f16540098c0 tx=0x7f1654006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:44.720 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.588+0000 7f16637fe640 1 -- 172.21.15.92:0/4135715722 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f165c043360 con 0x7f166c107c40 2024-09-19T08:47:44.720 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.761+0000 7f1670a32640 1 -- 172.21.15.92:0/4135715722 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f166c1a13a0 con 0x7f166c107c40 2024-09-19T08:47:44.721 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.766+0000 7f16637fe640 1 -- 172.21.15.92:0/4135715722 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v6)=0 v6) ==== 142+0+0 (secure 0 0 0) 0x7f165c042d90 con 0x7f166c107c40 2024-09-19T08:47:44.721 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.769+0000 7f1670a32640 1 -- 172.21.15.92:0/4135715722 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f1658039200 msgr2=0x7f165803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:44.721 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.769+0000 7f1670a32640 1 --2- 172.21.15.92:0/4135715722 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f1658039200 0x7f165803b6c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f16540098c0 tx=0x7f1654006db0 comp rx=0 tx=0).stop 2024-09-19T08:47:44.721 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.769+0000 7f1670a32640 1 -- 172.21.15.92:0/4135715722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f166c107c40 msgr2=0x7f166c19d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:44.721 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.769+0000 7f1670a32640 1 --2- 172.21.15.92:0/4135715722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f166c107c40 0x7f166c19d830 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f165c0097f0 tx=0x7f165c030d80 comp rx=0 tx=0).stop 2024-09-19T08:47:44.721 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.769+0000 7f1670a32640 1 -- 172.21.15.92:0/4135715722 shutdown_connections 2024-09-19T08:47:44.721 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.769+0000 7f1670a32640 1 --2- 172.21.15.92:0/4135715722 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f1658039200 0x7f165803b6c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:44.721 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.769+0000 7f1670a32640 1 --2- 172.21.15.92:0/4135715722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f166c107c40 0x7f166c19d830 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:44.721 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.769+0000 7f1670a32640 1 -- 172.21.15.92:0/4135715722 >> 172.21.15.92:0/4135715722 conn(0x7f166c101510 msgr2=0x7f166c193e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:44.721 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.769+0000 7f1670a32640 1 -- 172.21.15.92:0/4135715722 shutdown_connections 2024-09-19T08:47:44.721 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:43.769+0000 7f1670a32640 1 -- 172.21.15.92:0/4135715722 wait complete. 2024-09-19T08:47:44.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:44 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/4135715722' entity='client.admin' 2024-09-19T08:47:44.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:44 smithi092 ceph-mon[31407]: from='mgr.14118 172.21.15.92:0/17008104' entity='mgr.x' 2024-09-19T08:47:44.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:44 smithi092 ceph-mon[31407]: from='mgr.14118 172.21.15.92:0/17008104' entity='mgr.x' 2024-09-19T08:47:46.076 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.143+0000 7fc9d2724640 1 Processor -- start 2024-09-19T08:47:46.077 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.143+0000 7fc9d2724640 1 -- start start 2024-09-19T08:47:46.077 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.144+0000 7fc9d2724640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9cc1076b0 0x7fc9cc107ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:46.077 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.144+0000 7fc9d2724640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc9cc108080 con 0x7fc9cc1076b0 2024-09-19T08:47:46.077 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.144+0000 7fc9cbfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9cc1076b0 0x7fc9cc107ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:46.077 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.144+0000 7fc9cbfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9cc1076b0 0x7fc9cc107ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53910/0 (socket says 172.21.15.92:53910) 2024-09-19T08:47:46.077 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.144+0000 7fc9cbfff640 1 -- 172.21.15.92:0/1676800018 learned_addr learned my addr 172.21.15.92:0/1676800018 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:46.077 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.144+0000 7fc9cbfff640 1 -- 172.21.15.92:0/1676800018 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9cc1088b0 con 0x7fc9cc1076b0 2024-09-19T08:47:46.077 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.145+0000 7fc9cbfff640 1 --2- 172.21.15.92:0/1676800018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9cc1076b0 0x7fc9cc107ab0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc009820 tx=0x7fc9bc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e11a1b256d7c7a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:46.078 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.145+0000 7fc9caffd640 1 -- 172.21.15.92:0/1676800018 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9bc037070 con 0x7fc9cc1076b0 2024-09-19T08:47:46.078 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.145+0000 7fc9caffd640 1 -- 172.21.15.92:0/1676800018 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9bc032920 con 0x7fc9cc1076b0 2024-09-19T08:47:46.078 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.145+0000 7fc9caffd640 1 -- 172.21.15.92:0/1676800018 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9bc030810 con 0x7fc9cc1076b0 2024-09-19T08:47:46.078 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.145+0000 7fc9d2724640 1 -- 172.21.15.92:0/1676800018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9cc1076b0 msgr2=0x7fc9cc107ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:46.078 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.145+0000 7fc9d2724640 1 --2- 172.21.15.92:0/1676800018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9cc1076b0 0x7fc9cc107ab0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc009820 tx=0x7fc9bc02a270 comp rx=0 tx=0).stop 2024-09-19T08:47:46.078 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.145+0000 7fc9d2724640 1 -- 172.21.15.92:0/1676800018 shutdown_connections 2024-09-19T08:47:46.078 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.145+0000 7fc9d2724640 1 --2- 172.21.15.92:0/1676800018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9cc1076b0 0x7fc9cc107ab0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:46.078 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.145+0000 7fc9d2724640 1 -- 172.21.15.92:0/1676800018 >> 172.21.15.92:0/1676800018 conn(0x7fc9cc102e80 msgr2=0x7fc9cc1052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:46.078 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.146+0000 7fc9d2724640 1 -- 172.21.15.92:0/1676800018 shutdown_connections 2024-09-19T08:47:46.078 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.146+0000 7fc9d2724640 1 -- 172.21.15.92:0/1676800018 wait complete. 2024-09-19T08:47:46.078 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.146+0000 7fc9d2724640 1 Processor -- start 2024-09-19T08:47:46.078 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.146+0000 7fc9d2724640 1 -- start start 2024-09-19T08:47:46.078 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.146+0000 7fc9d2724640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9cc1076b0 0x7fc9cc07db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:46.079 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.146+0000 7fc9d2724640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc9cc10bc60 con 0x7fc9cc1076b0 2024-09-19T08:47:46.079 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.147+0000 7fc9cbfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9cc1076b0 0x7fc9cc07db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:46.079 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.147+0000 7fc9cbfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9cc1076b0 0x7fc9cc07db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53926/0 (socket says 172.21.15.92:53926) 2024-09-19T08:47:46.079 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.147+0000 7fc9cbfff640 1 -- 172.21.15.92:0/743709826 learned_addr learned my addr 172.21.15.92:0/743709826 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:46.079 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.147+0000 7fc9cbfff640 1 -- 172.21.15.92:0/743709826 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9cc07e0d0 con 0x7fc9cc1076b0 2024-09-19T08:47:46.079 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.147+0000 7fc9cbfff640 1 --2- 172.21.15.92:0/743709826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9cc1076b0 0x7fc9cc07db90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc0097f0 tx=0x7fc9bc0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:46.079 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.147+0000 7fc9c97fa640 1 -- 172.21.15.92:0/743709826 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9bc037040 con 0x7fc9cc1076b0 2024-09-19T08:47:46.079 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.147+0000 7fc9c97fa640 1 -- 172.21.15.92:0/743709826 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9bc030cc0 con 0x7fc9cc1076b0 2024-09-19T08:47:46.079 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.147+0000 7fc9d2724640 1 -- 172.21.15.92:0/743709826 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9cc07c2c0 con 0x7fc9cc1076b0 2024-09-19T08:47:46.079 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.147+0000 7fc9c97fa640 1 -- 172.21.15.92:0/743709826 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9bc03a640 con 0x7fc9cc1076b0 2024-09-19T08:47:46.079 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.147+0000 7fc9d2724640 1 -- 172.21.15.92:0/743709826 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9cc07c800 con 0x7fc9cc1076b0 2024-09-19T08:47:46.079 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.148+0000 7fc9c97fa640 1 -- 172.21.15.92:0/743709826 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fc9bc03b3f0 con 0x7fc9cc1076b0 2024-09-19T08:47:46.080 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.148+0000 7fc9c97fa640 1 --2- 172.21.15.92:0/743709826 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7fc9b40391b0 0x7fc9b403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:46.080 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.148+0000 7fc9c97fa640 1 -- 172.21.15.92:0/743709826 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc9bc06c850 con 0x7fc9cc1076b0 2024-09-19T08:47:46.080 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.148+0000 7fc9d2724640 1 -- 172.21.15.92:0/743709826 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9cc107b30 con 0x7fc9cc1076b0 2024-09-19T08:47:46.080 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.148+0000 7fc9cb7fe640 1 --2- 172.21.15.92:0/743709826 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7fc9b40391b0 0x7fc9b403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:46.080 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.149+0000 7fc9cb7fe640 1 --2- 172.21.15.92:0/743709826 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7fc9b40391b0 0x7fc9b403b670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00098c0 tx=0x7fc9c0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:46.080 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.153+0000 7fc9c97fa640 1 -- 172.21.15.92:0/743709826 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc9bc06c1e0 con 0x7fc9cc1076b0 2024-09-19T08:47:46.080 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.332+0000 7fc9d2724640 1 -- 172.21.15.92:0/743709826 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fc9cc07cb40 con 0x7fc9cc1076b0 2024-09-19T08:47:46.080 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.334+0000 7fc9c97fa640 1 -- 172.21.15.92:0/743709826 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fc9cc07cb40 con 0x7fc9cc1076b0 2024-09-19T08:47:46.080 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.337+0000 7fc9d2724640 1 -- 172.21.15.92:0/743709826 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7fc9b40391b0 msgr2=0x7fc9b403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:46.080 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.337+0000 7fc9d2724640 1 --2- 172.21.15.92:0/743709826 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7fc9b40391b0 0x7fc9b403b670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00098c0 tx=0x7fc9c0006db0 comp rx=0 tx=0).stop 2024-09-19T08:47:46.080 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.337+0000 7fc9d2724640 1 -- 172.21.15.92:0/743709826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9cc1076b0 msgr2=0x7fc9cc07db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:46.080 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.337+0000 7fc9d2724640 1 --2- 172.21.15.92:0/743709826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9cc1076b0 0x7fc9cc07db90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc0097f0 tx=0x7fc9bc0327b0 comp rx=0 tx=0).stop 2024-09-19T08:47:46.080 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.337+0000 7fc9d2724640 1 -- 172.21.15.92:0/743709826 shutdown_connections 2024-09-19T08:47:46.080 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.337+0000 7fc9d2724640 1 --2- 172.21.15.92:0/743709826 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7fc9b40391b0 0x7fc9b403b670 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:46.081 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.337+0000 7fc9d2724640 1 --2- 172.21.15.92:0/743709826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9cc1076b0 0x7fc9cc07db90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:46.081 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.337+0000 7fc9d2724640 1 -- 172.21.15.92:0/743709826 >> 172.21.15.92:0/743709826 conn(0x7fc9cc102e80 msgr2=0x7fc9cc1039d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:46.081 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.337+0000 7fc9d2724640 1 -- 172.21.15.92:0/743709826 shutdown_connections 2024-09-19T08:47:46.081 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:45.337+0000 7fc9d2724640 1 -- 172.21.15.92:0/743709826 wait complete. 2024-09-19T08:47:46.081 INFO:teuthology.orchestra.run.smithi092.stdout:Enabling the dashboard module... 2024-09-19T08:47:46.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:46 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/743709826' entity='client.admin' 2024-09-19T08:47:47.694 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:47 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/425604194' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-19T08:47:47.694 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:47 smithi092 ceph-mon[31407]: from='mgr.14118 172.21.15.92:0/17008104' entity='mgr.x' 2024-09-19T08:47:47.694 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:47 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: ignoring --setuser ceph since I am not root 2024-09-19T08:47:47.694 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:47 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: ignoring --setgroup ceph since I am not root 2024-09-19T08:47:47.694 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:47 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:47.487+0000 7fa936465040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T08:47:47.694 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:47 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:47.544+0000 7fa936465040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:47:47.694 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:47 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:47.693+0000 7fa936465040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:47:47.959 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:47 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:47.761+0000 7fa936465040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:47:47.959 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:47 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:47.909+0000 7fa936465040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:47:47.966 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.492+0000 7fe5e4ad4640 1 Processor -- start 2024-09-19T08:47:47.967 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.492+0000 7fe5e4ad4640 1 -- start start 2024-09-19T08:47:47.967 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.493+0000 7fe5e4ad4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5e0108190 0x7fe5e010a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:47.967 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.493+0000 7fe5e4ad4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e007be70 con 0x7fe5e0108190 2024-09-19T08:47:47.967 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.493+0000 7fe5de59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5e0108190 0x7fe5e010a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:47.967 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.493+0000 7fe5de59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5e0108190 0x7fe5e010a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53942/0 (socket says 172.21.15.92:53942) 2024-09-19T08:47:47.967 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.493+0000 7fe5de59c640 1 -- 172.21.15.92:0/1537948566 learned_addr learned my addr 172.21.15.92:0/1537948566 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:47.967 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.493+0000 7fe5de59c640 1 -- 172.21.15.92:0/1537948566 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5e010aac0 con 0x7fe5e0108190 2024-09-19T08:47:47.967 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.494+0000 7fe5de59c640 1 --2- 172.21.15.92:0/1537948566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5e0108190 0x7fe5e010a580 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8009820 tx=0x7fe5c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f16ba641df359eda server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:47.967 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.494+0000 7fe5dd59a640 1 -- 172.21.15.92:0/1537948566 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5c8037070 con 0x7fe5e0108190 2024-09-19T08:47:47.967 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.494+0000 7fe5dd59a640 1 -- 172.21.15.92:0/1537948566 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5c8032920 con 0x7fe5e0108190 2024-09-19T08:47:47.967 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.494+0000 7fe5dd59a640 1 -- 172.21.15.92:0/1537948566 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5c8030810 con 0x7fe5e0108190 2024-09-19T08:47:47.968 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.495+0000 7fe5e4ad4640 1 -- 172.21.15.92:0/1537948566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5e0108190 msgr2=0x7fe5e010a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:47.968 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.495+0000 7fe5e4ad4640 1 --2- 172.21.15.92:0/1537948566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5e0108190 0x7fe5e010a580 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8009820 tx=0x7fe5c802a270 comp rx=0 tx=0).stop 2024-09-19T08:47:47.968 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.495+0000 7fe5e4ad4640 1 -- 172.21.15.92:0/1537948566 shutdown_connections 2024-09-19T08:47:47.968 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.495+0000 7fe5e4ad4640 1 --2- 172.21.15.92:0/1537948566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5e0108190 0x7fe5e010a580 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:47.968 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.495+0000 7fe5e4ad4640 1 -- 172.21.15.92:0/1537948566 >> 172.21.15.92:0/1537948566 conn(0x7fe5e0101d70 msgr2=0x7fe5e0104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:47.968 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.495+0000 7fe5e4ad4640 1 -- 172.21.15.92:0/1537948566 shutdown_connections 2024-09-19T08:47:47.968 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.495+0000 7fe5e4ad4640 1 -- 172.21.15.92:0/1537948566 wait complete. 2024-09-19T08:47:47.968 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.495+0000 7fe5e4ad4640 1 Processor -- start 2024-09-19T08:47:47.968 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.496+0000 7fe5e4ad4640 1 -- start start 2024-09-19T08:47:47.968 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.496+0000 7fe5e4ad4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5e0108190 0x7fe5e019b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:47.968 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.496+0000 7fe5e4ad4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e010bad0 con 0x7fe5e0108190 2024-09-19T08:47:47.968 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.496+0000 7fe5de59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5e0108190 0x7fe5e019b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:47.968 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.496+0000 7fe5de59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5e0108190 0x7fe5e019b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53956/0 (socket says 172.21.15.92:53956) 2024-09-19T08:47:47.969 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.496+0000 7fe5de59c640 1 -- 172.21.15.92:0/425604194 learned_addr learned my addr 172.21.15.92:0/425604194 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:47.969 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.496+0000 7fe5de59c640 1 -- 172.21.15.92:0/425604194 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5e019bbb0 con 0x7fe5e0108190 2024-09-19T08:47:47.969 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.496+0000 7fe5de59c640 1 --2- 172.21.15.92:0/425604194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5e0108190 0x7fe5e019b670 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8030380 tx=0x7fe5c8032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:47.969 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.496+0000 7fe5d77fe640 1 -- 172.21.15.92:0/425604194 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5c8037040 con 0x7fe5e0108190 2024-09-19T08:47:47.969 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.496+0000 7fe5d77fe640 1 -- 172.21.15.92:0/425604194 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5c8040070 con 0x7fe5e0108190 2024-09-19T08:47:47.969 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.496+0000 7fe5e4ad4640 1 -- 172.21.15.92:0/425604194 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5e019be40 con 0x7fe5e0108190 2024-09-19T08:47:47.969 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.496+0000 7fe5d77fe640 1 -- 172.21.15.92:0/425604194 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5c803a7b0 con 0x7fe5e0108190 2024-09-19T08:47:47.969 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.496+0000 7fe5e4ad4640 1 -- 172.21.15.92:0/425604194 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5e019eb30 con 0x7fe5e0108190 2024-09-19T08:47:47.969 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.497+0000 7fe5d77fe640 1 -- 172.21.15.92:0/425604194 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fe5c803a9e0 con 0x7fe5e0108190 2024-09-19T08:47:47.969 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.497+0000 7fe5e4ad4640 1 -- 172.21.15.92:0/425604194 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5e01085f0 con 0x7fe5e0108190 2024-09-19T08:47:47.969 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.498+0000 7fe5d77fe640 1 --2- 172.21.15.92:0/425604194 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7fe5cc039200 0x7fe5cc03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:47.970 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.498+0000 7fe5d77fe640 1 -- 172.21.15.92:0/425604194 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe5c806c9e0 con 0x7fe5e0108190 2024-09-19T08:47:47.970 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.498+0000 7fe5ddd9b640 1 --2- 172.21.15.92:0/425604194 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7fe5cc039200 0x7fe5cc03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:47.970 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.498+0000 7fe5ddd9b640 1 --2- 172.21.15.92:0/425604194 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7fe5cc039200 0x7fe5cc03b6c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe5d00098c0 tx=0x7fe5d0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:47.970 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.502+0000 7fe5d77fe640 1 -- 172.21.15.92:0/425604194 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe5c8044c70 con 0x7fe5e0108190 2024-09-19T08:47:47.970 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:46.717+0000 7fe5e4ad4640 1 -- 172.21.15.92:0/425604194 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fe5e019ed00 con 0x7fe5e0108190 2024-09-19T08:47:47.970 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:47.338+0000 7fe5d77fe640 1 -- 172.21.15.92:0/425604194 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fe5c803add0 con 0x7fe5e0108190 2024-09-19T08:47:47.970 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:47.340+0000 7fe5d77fe640 1 -- 172.21.15.92:0/425604194 <== mon.0 v2:172.21.15.92:3300/0 8 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7fe5c8045980 con 0x7fe5e0108190 2024-09-19T08:47:47.970 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:47.341+0000 7fe5e4ad4640 1 -- 172.21.15.92:0/425604194 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7fe5cc039200 msgr2=0x7fe5cc03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:47.970 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:47.341+0000 7fe5e4ad4640 1 --2- 172.21.15.92:0/425604194 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7fe5cc039200 0x7fe5cc03b6c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe5d00098c0 tx=0x7fe5d0006db0 comp rx=0 tx=0).stop 2024-09-19T08:47:47.970 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:47.341+0000 7fe5e4ad4640 1 -- 172.21.15.92:0/425604194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5e0108190 msgr2=0x7fe5e019b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:47.970 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:47.341+0000 7fe5e4ad4640 1 --2- 172.21.15.92:0/425604194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5e0108190 0x7fe5e019b670 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8030380 tx=0x7fe5c8032670 comp rx=0 tx=0).stop 2024-09-19T08:47:47.970 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:47.341+0000 7fe5e4ad4640 1 -- 172.21.15.92:0/425604194 shutdown_connections 2024-09-19T08:47:47.971 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:47.341+0000 7fe5e4ad4640 1 --2- 172.21.15.92:0/425604194 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7fe5cc039200 0x7fe5cc03b6c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:47.971 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:47.341+0000 7fe5e4ad4640 1 --2- 172.21.15.92:0/425604194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5e0108190 0x7fe5e019b670 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:47.971 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:47.341+0000 7fe5e4ad4640 1 -- 172.21.15.92:0/425604194 >> 172.21.15.92:0/425604194 conn(0x7fe5e0101d70 msgr2=0x7fe5e0102900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:47.971 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:47.341+0000 7fe5e4ad4640 1 -- 172.21.15.92:0/425604194 shutdown_connections 2024-09-19T08:47:47.971 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:47.341+0000 7fe5e4ad4640 1 -- 172.21.15.92:0/425604194 wait complete. 2024-09-19T08:47:48.226 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:48 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:48.056+0000 7fa936465040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:47:48.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:48 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/425604194' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-19T08:47:48.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:48 smithi092 ceph-mon[31407]: mgrmap e9: x(active, since 17s) 2024-09-19T08:47:48.503 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:48 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:48.379+0000 7fa936465040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:47:48.503 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:48 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:48.444+0000 7fa936465040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:47:49.003 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:48 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:48.636+0000 7fa936465040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:47:49.158 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:47:49.158 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-19T08:47:49.158 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T08:47:49.158 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T08:47:49.158 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T08:47:49.158 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:47:49.158 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.401+0000 7f71b6a19640 1 Processor -- start 2024-09-19T08:47:49.158 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.401+0000 7f71b6a19640 1 -- start start 2024-09-19T08:47:49.158 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.401+0000 7f71b6a19640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71b01065c0 0x7f71b01069c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:49.159 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.401+0000 7f71b6a19640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f71b0106f90 con 0x7f71b01065c0 2024-09-19T08:47:49.159 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.401+0000 7f71affff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71b01065c0 0x7f71b01069c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:49.159 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.401+0000 7f71affff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71b01065c0 0x7f71b01069c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53980/0 (socket says 172.21.15.92:53980) 2024-09-19T08:47:49.159 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.401+0000 7f71affff640 1 -- 172.21.15.92:0/2509432743 learned_addr learned my addr 172.21.15.92:0/2509432743 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:49.159 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.402+0000 7f71affff640 1 -- 172.21.15.92:0/2509432743 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71b01077c0 con 0x7f71b01065c0 2024-09-19T08:47:49.159 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.402+0000 7f71affff640 1 --2- 172.21.15.92:0/2509432743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71b01065c0 0x7f71b01069c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f71a0009820 tx=0x7f71a002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e60af7f21c3154c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:49.159 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.402+0000 7f71af7fe640 1 -- 172.21.15.92:0/2509432743 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71a0037070 con 0x7f71b01065c0 2024-09-19T08:47:49.159 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.402+0000 7f71af7fe640 1 -- 172.21.15.92:0/2509432743 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71a0032920 con 0x7f71b01065c0 2024-09-19T08:47:49.159 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.402+0000 7f71af7fe640 1 -- 172.21.15.92:0/2509432743 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71a0030810 con 0x7f71b01065c0 2024-09-19T08:47:49.159 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.403+0000 7f71b6a19640 1 -- 172.21.15.92:0/2509432743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71b01065c0 msgr2=0x7f71b01069c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:49.159 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.403+0000 7f71b6a19640 1 --2- 172.21.15.92:0/2509432743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71b01065c0 0x7f71b01069c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f71a0009820 tx=0x7f71a002a270 comp rx=0 tx=0).stop 2024-09-19T08:47:49.160 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.403+0000 7f71b6a19640 1 -- 172.21.15.92:0/2509432743 shutdown_connections 2024-09-19T08:47:49.160 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.403+0000 7f71b6a19640 1 --2- 172.21.15.92:0/2509432743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71b01065c0 0x7f71b01069c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:49.160 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.403+0000 7f71b6a19640 1 -- 172.21.15.92:0/2509432743 >> 172.21.15.92:0/2509432743 conn(0x7f71b0101d70 msgr2=0x7f71b0104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:49.160 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.403+0000 7f71b6a19640 1 -- 172.21.15.92:0/2509432743 shutdown_connections 2024-09-19T08:47:49.160 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.403+0000 7f71b6a19640 1 -- 172.21.15.92:0/2509432743 wait complete. 2024-09-19T08:47:49.160 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.404+0000 7f71b6a19640 1 Processor -- start 2024-09-19T08:47:49.160 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.404+0000 7f71b6a19640 1 -- start start 2024-09-19T08:47:49.160 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.404+0000 7f71b6a19640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71b01065c0 0x7f71b007ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:49.160 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.404+0000 7f71b6a19640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f71b010ab70 con 0x7f71b01065c0 2024-09-19T08:47:49.160 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.404+0000 7f71affff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71b01065c0 0x7f71b007ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:49.160 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.404+0000 7f71affff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71b01065c0 0x7f71b007ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53992/0 (socket says 172.21.15.92:53992) 2024-09-19T08:47:49.160 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.404+0000 7f71affff640 1 -- 172.21.15.92:0/1552215155 learned_addr learned my addr 172.21.15.92:0/1552215155 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:49.161 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.404+0000 7f71affff640 1 -- 172.21.15.92:0/1552215155 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71b019e420 con 0x7f71b01065c0 2024-09-19T08:47:49.161 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.404+0000 7f71affff640 1 --2- 172.21.15.92:0/1552215155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71b01065c0 0x7f71b007ba70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f71a0030560 tx=0x7f71a0032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:49.161 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.405+0000 7f71adffb640 1 -- 172.21.15.92:0/1552215155 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71a0037040 con 0x7f71b01065c0 2024-09-19T08:47:49.161 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.405+0000 7f71adffb640 1 -- 172.21.15.92:0/1552215155 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71a0040070 con 0x7f71b01065c0 2024-09-19T08:47:49.161 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.405+0000 7f71b6a19640 1 -- 172.21.15.92:0/1552215155 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71b019e5f0 con 0x7f71b01065c0 2024-09-19T08:47:49.161 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.405+0000 7f71adffb640 1 -- 172.21.15.92:0/1552215155 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71a003a740 con 0x7f71b01065c0 2024-09-19T08:47:49.161 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.405+0000 7f71b6a19640 1 -- 172.21.15.92:0/1552215155 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71b019e990 con 0x7f71b01065c0 2024-09-19T08:47:49.161 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.405+0000 7f71adffb640 1 -- 172.21.15.92:0/1552215155 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f71a003a8e0 con 0x7f71b01065c0 2024-09-19T08:47:49.161 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.406+0000 7f71adffb640 1 --2- 172.21.15.92:0/1552215155 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f719c039260 0x7f719c03b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:49.161 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.406+0000 7f71b6a19640 1 -- 172.21.15.92:0/1552215155 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71b0106a40 con 0x7f71b01065c0 2024-09-19T08:47:49.161 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.406+0000 7f71adffb640 1 -- 172.21.15.92:0/1552215155 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f71a006d930 con 0x7f71b01065c0 2024-09-19T08:47:49.161 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.406+0000 7f71a7fff640 1 -- 172.21.15.92:0/1552215155 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f719c039260 msgr2=0x7f719c03b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/2908709470 2024-09-19T08:47:49.162 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.406+0000 7f71a7fff640 1 --2- 172.21.15.92:0/1552215155 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f719c039260 0x7f719c03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:47:49.162 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.411+0000 7f71adffb640 1 -- 172.21.15.92:0/1552215155 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f71a0044c70 con 0x7f71b01065c0 2024-09-19T08:47:49.162 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.607+0000 7f71a7fff640 1 -- 172.21.15.92:0/1552215155 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f719c039260 msgr2=0x7f719c03b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/2908709470 2024-09-19T08:47:49.162 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.607+0000 7f71a7fff640 1 --2- 172.21.15.92:0/1552215155 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f719c039260 0x7f719c03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T08:47:49.162 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.630+0000 7f71b6a19640 1 -- 172.21.15.92:0/1552215155 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f71b019f180 con 0x7f71b01065c0 2024-09-19T08:47:49.162 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.630+0000 7f71adffb640 1 -- 172.21.15.92:0/1552215155 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f71a0041270 con 0x7f71b01065c0 2024-09-19T08:47:49.162 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.632+0000 7f71b6a19640 1 -- 172.21.15.92:0/1552215155 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f719c039260 msgr2=0x7f719c03b720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:47:49.162 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.632+0000 7f71b6a19640 1 --2- 172.21.15.92:0/1552215155 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f719c039260 0x7f719c03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:49.162 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.632+0000 7f71b6a19640 1 -- 172.21.15.92:0/1552215155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71b01065c0 msgr2=0x7f71b007ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:49.162 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.632+0000 7f71b6a19640 1 --2- 172.21.15.92:0/1552215155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71b01065c0 0x7f71b007ba70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f71a0030560 tx=0x7f71a0032670 comp rx=0 tx=0).stop 2024-09-19T08:47:49.162 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.632+0000 7f71b6a19640 1 -- 172.21.15.92:0/1552215155 shutdown_connections 2024-09-19T08:47:49.162 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.632+0000 7f71b6a19640 1 --2- 172.21.15.92:0/1552215155 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f719c039260 0x7f719c03b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:49.162 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.632+0000 7f71b6a19640 1 --2- 172.21.15.92:0/1552215155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71b01065c0 0x7f71b007ba70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:49.163 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.632+0000 7f71b6a19640 1 -- 172.21.15.92:0/1552215155 >> 172.21.15.92:0/1552215155 conn(0x7f71b0101d70 msgr2=0x7f71b01028a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:49.163 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.633+0000 7f71b6a19640 1 -- 172.21.15.92:0/1552215155 shutdown_connections 2024-09-19T08:47:49.163 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:48.633+0000 7f71b6a19640 1 -- 172.21.15.92:0/1552215155 wait complete. 2024-09-19T08:47:49.163 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for the mgr to restart... 2024-09-19T08:47:49.163 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for mgr epoch 9... 2024-09-19T08:47:49.427 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:49 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1552215155' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T08:47:49.711 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:49 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:49.551+0000 7fa936465040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:47:49.711 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:49 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:49.619+0000 7fa936465040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:47:50.435 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:50 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:50.320+0000 7fa936465040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:47:50.435 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:50 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:50.435+0000 7fa936465040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:47:50.753 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:50 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:50.577+0000 7fa936465040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:47:50.753 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:50 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:50.637+0000 7fa936465040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:47:51.070 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:50 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:50.786+0000 7fa936465040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:47:51.070 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:50 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:50.853+0000 7fa936465040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:47:51.070 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:50 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:50.913+0000 7fa936465040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:47:51.070 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:51 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:51.069+0000 7fa936465040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:47:51.338 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:51 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:51.134+0000 7fa936465040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:47:51.338 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:51 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:51.199+0000 7fa936465040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:47:51.338 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:51 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:51.280+0000 7fa936465040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:47:51.338 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:51 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:51.338+0000 7fa936465040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:47:51.753 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:51 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:51.397+0000 7fa936465040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:47:52.503 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:52 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:52.177+0000 7fa936465040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:47:52.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:52 smithi092 ceph-mon[31407]: Active manager daemon x restarted 2024-09-19T08:47:52.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:52 smithi092 ceph-mon[31407]: Activating manager daemon x 2024-09-19T08:47:52.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:52 smithi092 ceph-mon[31407]: osdmap e3: 0 total, 0 up, 0 in 2024-09-19T08:47:52.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:52 smithi092 ceph-mon[31407]: mgrmap e10: x(active, starting, since 0.00319496s) 2024-09-19T08:47:52.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:47:52.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T08:47:52.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T08:47:52.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T08:47:52.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T08:47:52.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:52 smithi092 ceph-mon[31407]: Manager daemon x is now available 2024-09-19T08:47:52.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:47:52.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T08:47:52.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T08:47:53.753 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:53 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:53.392+0000 7fa8a1779640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:08:47:53] ENGINE Error in HTTPServer.serve 2024-09-19T08:47:53.753 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:53 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: Traceback (most recent call last): 2024-09-19T08:47:53.754 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:53 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:47:53.754 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:53 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: self._connections.run(self.expiration_interval) 2024-09-19T08:47:53.754 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:53 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:47:53.754 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:53 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: self._run(expiration_interval) 2024-09-19T08:47:53.754 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:53 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:47:53.754 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:53 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:47:53.754 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:53 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:47:53.754 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:53 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:47:53.754 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:53 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:47:53.754 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:53 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: s = self.context.wrap_socket( 2024-09-19T08:47:53.754 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:53 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:47:53.754 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:53 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: return self.sslsocket_class._create( 2024-09-19T08:47:53.754 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:53 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:47:53.755 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:53 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: self.do_handshake() 2024-09-19T08:47:53.755 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:53 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:47:53.755 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:53 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: self._sslobj.do_handshake() 2024-09-19T08:47:53.755 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:53 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:47:53.755 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:47:53 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:47:54.001 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:47:54.001 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-19T08:47:54.001 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T08:47:54.002 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:47:54.002 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.505+0000 7f8b0b7f9640 1 Processor -- start 2024-09-19T08:47:54.002 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.505+0000 7f8b0b7f9640 1 -- start start 2024-09-19T08:47:54.002 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.505+0000 7f8b0b7f9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b041065f0 0x7f8b041069f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:54.002 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.505+0000 7f8b0b7f9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8b04106fc0 con 0x7f8b041065f0 2024-09-19T08:47:54.002 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.505+0000 7f8b09595640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b041065f0 0x7f8b041069f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:54.002 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.505+0000 7f8b09595640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b041065f0 0x7f8b041069f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54000/0 (socket says 172.21.15.92:54000) 2024-09-19T08:47:54.002 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.505+0000 7f8b09595640 1 -- 172.21.15.92:0/3219557496 learned_addr learned my addr 172.21.15.92:0/3219557496 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:54.002 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.506+0000 7f8b09595640 1 -- 172.21.15.92:0/3219557496 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b041077f0 con 0x7f8b041065f0 2024-09-19T08:47:54.002 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.506+0000 7f8b09595640 1 --2- 172.21.15.92:0/3219557496 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b041065f0 0x7f8b041069f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8b00009820 tx=0x7f8b0002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e85367bfd6394cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:54.002 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.506+0000 7f8afbfff640 1 -- 172.21.15.92:0/3219557496 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b00037070 con 0x7f8b041065f0 2024-09-19T08:47:54.002 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.507+0000 7f8afbfff640 1 -- 172.21.15.92:0/3219557496 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b00032920 con 0x7f8b041065f0 2024-09-19T08:47:54.003 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.507+0000 7f8afbfff640 1 -- 172.21.15.92:0/3219557496 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b00030810 con 0x7f8b041065f0 2024-09-19T08:47:54.003 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.507+0000 7f8b0b7f9640 1 -- 172.21.15.92:0/3219557496 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b041065f0 msgr2=0x7f8b041069f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:54.003 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.507+0000 7f8b0b7f9640 1 --2- 172.21.15.92:0/3219557496 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b041065f0 0x7f8b041069f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8b00009820 tx=0x7f8b0002a270 comp rx=0 tx=0).stop 2024-09-19T08:47:54.003 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.507+0000 7f8b0b7f9640 1 -- 172.21.15.92:0/3219557496 shutdown_connections 2024-09-19T08:47:54.003 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.507+0000 7f8b0b7f9640 1 --2- 172.21.15.92:0/3219557496 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b041065f0 0x7f8b041069f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:54.003 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.507+0000 7f8b0b7f9640 1 -- 172.21.15.92:0/3219557496 >> 172.21.15.92:0/3219557496 conn(0x7f8b04101dc0 msgr2=0x7f8b041041e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:54.003 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.507+0000 7f8b0b7f9640 1 -- 172.21.15.92:0/3219557496 shutdown_connections 2024-09-19T08:47:54.003 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.507+0000 7f8b0b7f9640 1 -- 172.21.15.92:0/3219557496 wait complete. 2024-09-19T08:47:54.003 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.508+0000 7f8b0b7f9640 1 Processor -- start 2024-09-19T08:47:54.003 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.508+0000 7f8b0b7f9640 1 -- start start 2024-09-19T08:47:54.003 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.508+0000 7f8b0b7f9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b041065f0 0x7f8b0407ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:54.003 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.508+0000 7f8b0b7f9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0410aba0 con 0x7f8b041065f0 2024-09-19T08:47:54.004 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.508+0000 7f8b09595640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b041065f0 0x7f8b0407ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:54.004 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.508+0000 7f8b09595640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b041065f0 0x7f8b0407ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54010/0 (socket says 172.21.15.92:54010) 2024-09-19T08:47:54.004 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.508+0000 7f8b09595640 1 -- 172.21.15.92:0/1720729568 learned_addr learned my addr 172.21.15.92:0/1720729568 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:54.004 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.508+0000 7f8b09595640 1 -- 172.21.15.92:0/1720729568 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b0419e440 con 0x7f8b041065f0 2024-09-19T08:47:54.004 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.508+0000 7f8b09595640 1 --2- 172.21.15.92:0/1720729568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b041065f0 0x7f8b0407ba70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8b00030560 tx=0x7f8b00032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:54.004 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.509+0000 7f8afa7fc640 1 -- 172.21.15.92:0/1720729568 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b00037040 con 0x7f8b041065f0 2024-09-19T08:47:54.004 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.509+0000 7f8afa7fc640 1 -- 172.21.15.92:0/1720729568 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b00040070 con 0x7f8b041065f0 2024-09-19T08:47:54.004 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.509+0000 7f8afa7fc640 1 -- 172.21.15.92:0/1720729568 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b0003a6d0 con 0x7f8b041065f0 2024-09-19T08:47:54.004 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.509+0000 7f8b0b7f9640 1 -- 172.21.15.92:0/1720729568 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b0419e610 con 0x7f8b041065f0 2024-09-19T08:47:54.004 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.509+0000 7f8b0b7f9640 1 -- 172.21.15.92:0/1720729568 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b0419e9b0 con 0x7f8b041065f0 2024-09-19T08:47:54.004 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.510+0000 7f8afa7fc640 1 -- 172.21.15.92:0/1720729568 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f8b0003a870 con 0x7f8b041065f0 2024-09-19T08:47:54.004 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.510+0000 7f8afa7fc640 1 --2- 172.21.15.92:0/1720729568 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f8af0039260 0x7f8af003b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:54.004 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.510+0000 7f8b0b7f9640 1 -- 172.21.15.92:0/1720729568 --> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8b04106a70 con 0x7f8af0039260 2024-09-19T08:47:54.005 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.510+0000 7f8b08d94640 1 -- 172.21.15.92:0/1720729568 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f8af0039260 msgr2=0x7f8af003b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/2908709470 2024-09-19T08:47:54.005 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.510+0000 7f8afa7fc640 1 -- 172.21.15.92:0/1720729568 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8b0006c850 con 0x7f8b041065f0 2024-09-19T08:47:54.005 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.510+0000 7f8b08d94640 1 --2- 172.21.15.92:0/1720729568 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f8af0039260 0x7f8af003b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:47:54.005 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.711+0000 7f8b08d94640 1 -- 172.21.15.92:0/1720729568 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f8af0039260 msgr2=0x7f8af003b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/2908709470 2024-09-19T08:47:54.005 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:49.711+0000 7f8b08d94640 1 --2- 172.21.15.92:0/1720729568 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f8af0039260 0x7f8af003b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T08:47:54.005 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:50.112+0000 7f8b08d94640 1 -- 172.21.15.92:0/1720729568 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f8af0039260 msgr2=0x7f8af003b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/2908709470 2024-09-19T08:47:54.005 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:50.112+0000 7f8b08d94640 1 --2- 172.21.15.92:0/1720729568 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f8af0039260 0x7f8af003b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T08:47:54.005 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:50.913+0000 7f8b08d94640 1 -- 172.21.15.92:0/1720729568 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f8af0039260 msgr2=0x7f8af003b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/2908709470 2024-09-19T08:47:54.005 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:50.913+0000 7f8b08d94640 1 --2- 172.21.15.92:0/1720729568 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f8af0039260 0x7f8af003b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T08:47:54.005 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:52.181+0000 7f8afa7fc640 1 -- 172.21.15.92:0/1720729568 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mgrmap(e 10) ==== 46241+0+0 (secure 0 0 0) 0x7f8b0006b300 con 0x7f8b041065f0 2024-09-19T08:47:54.005 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:52.181+0000 7f8afa7fc640 1 -- 172.21.15.92:0/1720729568 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f8af0039260 msgr2=0x7f8af003b720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:47:54.005 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:52.181+0000 7f8afa7fc640 1 --2- 172.21.15.92:0/1720729568 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f8af0039260 0x7f8af003b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:54.006 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:53.183+0000 7f8afa7fc640 1 -- 172.21.15.92:0/1720729568 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f8b000397b0 con 0x7f8b041065f0 2024-09-19T08:47:54.006 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:53.183+0000 7f8afa7fc640 1 --2- 172.21.15.92:0/1720729568 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8af003cb30 0x7f8af003ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:54.006 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:53.183+0000 7f8afa7fc640 1 -- 172.21.15.92:0/1720729568 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8b0002bba0 con 0x7f8af003cb30 2024-09-19T08:47:54.006 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:53.184+0000 7f8b08d94640 1 --2- 172.21.15.92:0/1720729568 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8af003cb30 0x7f8af003ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:54.006 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:53.184+0000 7f8b08d94640 1 --2- 172.21.15.92:0/1720729568 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8af003cb30 0x7f8af003ef20 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f8af4003980 tx=0x7f8af40092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:54.006 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:53.185+0000 7f8afa7fc640 1 -- 172.21.15.92:0/1720729568 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f8b0002bba0 con 0x7f8af003cb30 2024-09-19T08:47:54.006 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:53.193+0000 7f8b0b7f9640 1 -- 172.21.15.92:0/1720729568 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f8b041030c0 con 0x7f8af003cb30 2024-09-19T08:47:54.006 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:53.193+0000 7f8afa7fc640 1 -- 172.21.15.92:0/1720729568 <== mgr.14150 v2:172.21.15.92:6800/2435349378 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f8b041030c0 con 0x7f8af003cb30 2024-09-19T08:47:54.006 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:53.193+0000 7f8b0b7f9640 1 -- 172.21.15.92:0/1720729568 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8af003cb30 msgr2=0x7f8af003ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:54.006 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:53.193+0000 7f8b0b7f9640 1 --2- 172.21.15.92:0/1720729568 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8af003cb30 0x7f8af003ef20 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f8af4003980 tx=0x7f8af40092b0 comp rx=0 tx=0).stop 2024-09-19T08:47:54.006 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:53.193+0000 7f8b0b7f9640 1 -- 172.21.15.92:0/1720729568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b041065f0 msgr2=0x7f8b0407ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:54.006 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:53.193+0000 7f8b0b7f9640 1 --2- 172.21.15.92:0/1720729568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b041065f0 0x7f8b0407ba70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8b00030560 tx=0x7f8b00032670 comp rx=0 tx=0).stop 2024-09-19T08:47:54.007 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:53.194+0000 7f8b0b7f9640 1 -- 172.21.15.92:0/1720729568 shutdown_connections 2024-09-19T08:47:54.007 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:53.194+0000 7f8b0b7f9640 1 --2- 172.21.15.92:0/1720729568 >> [v2:172.21.15.92:6800/2908709470,v1:172.21.15.92:6801/2908709470] conn(0x7f8af0039260 0x7f8af003b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:54.007 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:53.194+0000 7f8b0b7f9640 1 --2- 172.21.15.92:0/1720729568 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8af003cb30 0x7f8af003ef20 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:54.007 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:53.194+0000 7f8b0b7f9640 1 --2- 172.21.15.92:0/1720729568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b041065f0 0x7f8b0407ba70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:54.007 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:53.194+0000 7f8b0b7f9640 1 -- 172.21.15.92:0/1720729568 >> 172.21.15.92:0/1720729568 conn(0x7f8b04101dc0 msgr2=0x7f8b041029b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:54.007 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:53.194+0000 7f8b0b7f9640 1 -- 172.21.15.92:0/1720729568 shutdown_connections 2024-09-19T08:47:54.007 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:53.194+0000 7f8b0b7f9640 1 -- 172.21.15.92:0/1720729568 wait complete. 2024-09-19T08:47:54.007 INFO:teuthology.orchestra.run.smithi092.stdout:mgr epoch 9 is available 2024-09-19T08:47:54.007 INFO:teuthology.orchestra.run.smithi092.stdout:Generating a dashboard self-signed certificate... 2024-09-19T08:47:54.386 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:54 smithi092 ceph-mon[31407]: mgrmap e11: x(active, since 1.00665s) 2024-09-19T08:47:54.386 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:54 smithi092 ceph-mon[31407]: [19/Sep/2024:08:47:53] ENGINE Bus STARTING 2024-09-19T08:47:54.386 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:54 smithi092 ceph-mon[31407]: [19/Sep/2024:08:47:53] ENGINE Serving on https://172.21.15.92:7150 2024-09-19T08:47:54.386 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:54 smithi092 ceph-mon[31407]: [19/Sep/2024:08:47:53] ENGINE Error in HTTPServer.serve 2024-09-19T08:47:54.386 INFO:journalctl@ceph.mon.a.smithi092.stdout: Traceback (most recent call last): 2024-09-19T08:47:54.387 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:47:54.387 INFO:journalctl@ceph.mon.a.smithi092.stdout: self._connections.run(self.expiration_interval) 2024-09-19T08:47:54.387 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:47:54.387 INFO:journalctl@ceph.mon.a.smithi092.stdout: self._run(expiration_interval) 2024-09-19T08:47:54.387 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:47:54.387 INFO:journalctl@ceph.mon.a.smithi092.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:47:54.387 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:47:54.387 INFO:journalctl@ceph.mon.a.smithi092.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:47:54.387 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:47:54.387 INFO:journalctl@ceph.mon.a.smithi092.stdout: s = self.context.wrap_socket( 2024-09-19T08:47:54.387 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:47:54.387 INFO:journalctl@ceph.mon.a.smithi092.stdout: return self.sslsocket_class._create( 2024-09-19T08:47:54.387 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:47:54.388 INFO:journalctl@ceph.mon.a.smithi092.stdout: self.do_handshake() 2024-09-19T08:47:54.388 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:47:54.388 INFO:journalctl@ceph.mon.a.smithi092.stdout: self._sslobj.do_handshake() 2024-09-19T08:47:54.388 INFO:journalctl@ceph.mon.a.smithi092.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:47:54.388 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:54 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:47:55.215 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-19T08:47:55.215 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.396+0000 7fceeffd1640 1 Processor -- start 2024-09-19T08:47:55.215 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.396+0000 7fceeffd1640 1 -- start start 2024-09-19T08:47:55.215 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.396+0000 7fceeffd1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcee81076b0 0x7fcee8107ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:55.215 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.396+0000 7fceeffd1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcee8108080 con 0x7fcee81076b0 2024-09-19T08:47:55.215 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.396+0000 7fceedd6d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcee81076b0 0x7fcee8107ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:55.215 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.397+0000 7fceedd6d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcee81076b0 0x7fcee8107ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51424/0 (socket says 172.21.15.92:51424) 2024-09-19T08:47:55.215 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.397+0000 7fceedd6d640 1 -- 172.21.15.92:0/305914003 learned_addr learned my addr 172.21.15.92:0/305914003 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:55.215 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.397+0000 7fceedd6d640 1 -- 172.21.15.92:0/305914003 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcee81088b0 con 0x7fcee81076b0 2024-09-19T08:47:55.215 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.397+0000 7fceedd6d640 1 --2- 172.21.15.92:0/305914003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcee81076b0 0x7fcee8107ab0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fced8009e80 tx=0x7fced802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=227e7b4b31a7ab5c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:55.216 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.398+0000 7fceecd6b640 1 -- 172.21.15.92:0/305914003 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fced8036070 con 0x7fcee81076b0 2024-09-19T08:47:55.216 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.398+0000 7fceecd6b640 1 -- 172.21.15.92:0/305914003 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fced80318e0 con 0x7fcee81076b0 2024-09-19T08:47:55.216 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.398+0000 7fceecd6b640 1 -- 172.21.15.92:0/305914003 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fced8007a00 con 0x7fcee81076b0 2024-09-19T08:47:55.216 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.398+0000 7fceeffd1640 1 -- 172.21.15.92:0/305914003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcee81076b0 msgr2=0x7fcee8107ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:55.216 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.398+0000 7fceeffd1640 1 --2- 172.21.15.92:0/305914003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcee81076b0 0x7fcee8107ab0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fced8009e80 tx=0x7fced802a7a0 comp rx=0 tx=0).stop 2024-09-19T08:47:55.216 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.398+0000 7fceeffd1640 1 -- 172.21.15.92:0/305914003 shutdown_connections 2024-09-19T08:47:55.216 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.398+0000 7fceeffd1640 1 --2- 172.21.15.92:0/305914003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcee81076b0 0x7fcee8107ab0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:55.216 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.398+0000 7fceeffd1640 1 -- 172.21.15.92:0/305914003 >> 172.21.15.92:0/305914003 conn(0x7fcee8102e80 msgr2=0x7fcee81052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:55.216 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.398+0000 7fceeffd1640 1 -- 172.21.15.92:0/305914003 shutdown_connections 2024-09-19T08:47:55.216 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.398+0000 7fceeffd1640 1 -- 172.21.15.92:0/305914003 wait complete. 2024-09-19T08:47:55.216 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.399+0000 7fceeffd1640 1 Processor -- start 2024-09-19T08:47:55.217 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.399+0000 7fceeffd1640 1 -- start start 2024-09-19T08:47:55.217 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.399+0000 7fceeffd1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcee81076b0 0x7fcee819b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:55.217 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.399+0000 7fceeffd1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcee810bc60 con 0x7fcee81076b0 2024-09-19T08:47:55.217 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.399+0000 7fceedd6d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcee81076b0 0x7fcee819b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:55.217 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.399+0000 7fceedd6d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcee81076b0 0x7fcee819b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51426/0 (socket says 172.21.15.92:51426) 2024-09-19T08:47:55.217 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.399+0000 7fceedd6d640 1 -- 172.21.15.92:0/2873406052 learned_addr learned my addr 172.21.15.92:0/2873406052 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:55.217 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.399+0000 7fceedd6d640 1 -- 172.21.15.92:0/2873406052 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcee819bbb0 con 0x7fcee81076b0 2024-09-19T08:47:55.217 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.400+0000 7fceedd6d640 1 --2- 172.21.15.92:0/2873406052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcee81076b0 0x7fcee819b670 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fced8031cc0 tx=0x7fced8031cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:55.217 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.400+0000 7fcee6ffd640 1 -- 172.21.15.92:0/2873406052 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fced8036050 con 0x7fcee81076b0 2024-09-19T08:47:55.217 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.400+0000 7fcee6ffd640 1 -- 172.21.15.92:0/2873406052 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fced8042070 con 0x7fcee81076b0 2024-09-19T08:47:55.218 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.400+0000 7fceeffd1640 1 -- 172.21.15.92:0/2873406052 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcee819be40 con 0x7fcee81076b0 2024-09-19T08:47:55.218 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.400+0000 7fcee6ffd640 1 -- 172.21.15.92:0/2873406052 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fced803d8e0 con 0x7fcee81076b0 2024-09-19T08:47:55.218 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.400+0000 7fceeffd1640 1 -- 172.21.15.92:0/2873406052 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcee819eb30 con 0x7fcee81076b0 2024-09-19T08:47:55.218 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.400+0000 7fcee6ffd640 1 -- 172.21.15.92:0/2873406052 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7fced803db90 con 0x7fcee81076b0 2024-09-19T08:47:55.218 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.401+0000 7fcee6ffd640 1 --2- 172.21.15.92:0/2873406052 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fced0039140 0x7fced003b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:55.218 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.401+0000 7fcee6ffd640 1 -- 172.21.15.92:0/2873406052 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fced806d5e0 con 0x7fcee81076b0 2024-09-19T08:47:55.218 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.401+0000 7fceeffd1640 1 -- 172.21.15.92:0/2873406052 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcee8107b30 con 0x7fcee81076b0 2024-09-19T08:47:55.218 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.401+0000 7fceed56c640 1 --2- 172.21.15.92:0/2873406052 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fced0039140 0x7fced003b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:55.218 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.401+0000 7fceed56c640 1 --2- 172.21.15.92:0/2873406052 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fced0039140 0x7fced003b600 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0098c0 tx=0x7fcedc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:55.219 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.406+0000 7fcee6ffd640 1 -- 172.21.15.92:0/2873406052 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fced8044310 con 0x7fcee81076b0 2024-09-19T08:47:55.219 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.585+0000 7fceeffd1640 1 -- 172.21.15.92:0/2873406052 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fcee81040e0 con 0x7fced0039140 2024-09-19T08:47:55.219 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.627+0000 7fcee6ffd640 1 -- 172.21.15.92:0/2873406052 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7fced804dcd0 con 0x7fcee81076b0 2024-09-19T08:47:55.219 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.630+0000 7fcee6ffd640 1 -- 172.21.15.92:0/2873406052 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fcee81040e0 con 0x7fced0039140 2024-09-19T08:47:55.219 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.632+0000 7fceeffd1640 1 -- 172.21.15.92:0/2873406052 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fced0039140 msgr2=0x7fced003b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:55.219 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.632+0000 7fceeffd1640 1 --2- 172.21.15.92:0/2873406052 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fced0039140 0x7fced003b600 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0098c0 tx=0x7fcedc006db0 comp rx=0 tx=0).stop 2024-09-19T08:47:55.219 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.632+0000 7fceeffd1640 1 -- 172.21.15.92:0/2873406052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcee81076b0 msgr2=0x7fcee819b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:55.219 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.632+0000 7fceeffd1640 1 --2- 172.21.15.92:0/2873406052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcee81076b0 0x7fcee819b670 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fced8031cc0 tx=0x7fced8031cf0 comp rx=0 tx=0).stop 2024-09-19T08:47:55.219 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.632+0000 7fceeffd1640 1 -- 172.21.15.92:0/2873406052 shutdown_connections 2024-09-19T08:47:55.219 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.632+0000 7fceeffd1640 1 --2- 172.21.15.92:0/2873406052 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fced0039140 0x7fced003b600 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:55.219 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.632+0000 7fceeffd1640 1 --2- 172.21.15.92:0/2873406052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcee81076b0 0x7fcee819b670 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:55.219 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.632+0000 7fceeffd1640 1 -- 172.21.15.92:0/2873406052 >> 172.21.15.92:0/2873406052 conn(0x7fcee8102e80 msgr2=0x7fcee81039d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:55.219 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.632+0000 7fceeffd1640 1 -- 172.21.15.92:0/2873406052 shutdown_connections 2024-09-19T08:47:55.220 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:54.632+0000 7fceeffd1640 1 -- 172.21.15.92:0/2873406052 wait complete. 2024-09-19T08:47:55.220 INFO:teuthology.orchestra.run.smithi092.stdout:Creating initial admin user... 2024-09-19T08:47:55.417 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:55 smithi092 ceph-mon[31407]: [19/Sep/2024:08:47:53] ENGINE Serving on http://172.21.15.92:8765 2024-09-19T08:47:55.417 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:55 smithi092 ceph-mon[31407]: [19/Sep/2024:08:47:53] ENGINE Bus STARTED 2024-09-19T08:47:55.417 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:55 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:47:55.417 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:55 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:47:55.417 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:55 smithi092 ceph-mon[31407]: mgrmap e12: x(active, since 2s) 2024-09-19T08:47:55.417 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:55 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:47:56.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:56 smithi092 ceph-mon[31407]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:47:56.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:56 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:47:57.327 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$Ainja3.sAk9kbFN7xSuEi.3rRc5lxjtNc73y5uz8TjlbA0tczqVHa", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726735676, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-19T08:47:57.327 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.599+0000 7f2604f56640 1 Processor -- start 2024-09-19T08:47:57.327 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.600+0000 7f2604f56640 1 -- start start 2024-09-19T08:47:57.327 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.600+0000 7f2604f56640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26001081a0 0x7f260010a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:57.327 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.600+0000 7f2604f56640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f260007be70 con 0x7f26001081a0 2024-09-19T08:47:57.327 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.600+0000 7f25fe59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26001081a0 0x7f260010a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:57.327 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.600+0000 7f25fe59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26001081a0 0x7f260010a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51432/0 (socket says 172.21.15.92:51432) 2024-09-19T08:47:57.327 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.600+0000 7f25fe59c640 1 -- 172.21.15.92:0/2143161559 learned_addr learned my addr 172.21.15.92:0/2143161559 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:57.328 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.600+0000 7f25fe59c640 1 -- 172.21.15.92:0/2143161559 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f260010aad0 con 0x7f26001081a0 2024-09-19T08:47:57.328 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.601+0000 7f25fe59c640 1 --2- 172.21.15.92:0/2143161559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26001081a0 0x7f260010a590 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f25f0009820 tx=0x7f25f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8bcaac5f1f28dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:57.328 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.601+0000 7f25fd59a640 1 -- 172.21.15.92:0/2143161559 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25f0037070 con 0x7f26001081a0 2024-09-19T08:47:57.328 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.601+0000 7f25fd59a640 1 -- 172.21.15.92:0/2143161559 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25f0032920 con 0x7f26001081a0 2024-09-19T08:47:57.328 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.601+0000 7f25fd59a640 1 -- 172.21.15.92:0/2143161559 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25f0030810 con 0x7f26001081a0 2024-09-19T08:47:57.328 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.602+0000 7f2604f56640 1 -- 172.21.15.92:0/2143161559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26001081a0 msgr2=0x7f260010a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:57.328 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.602+0000 7f2604f56640 1 --2- 172.21.15.92:0/2143161559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26001081a0 0x7f260010a590 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f25f0009820 tx=0x7f25f002a270 comp rx=0 tx=0).stop 2024-09-19T08:47:57.328 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.602+0000 7f2604f56640 1 -- 172.21.15.92:0/2143161559 shutdown_connections 2024-09-19T08:47:57.328 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.602+0000 7f2604f56640 1 --2- 172.21.15.92:0/2143161559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26001081a0 0x7f260010a590 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:57.328 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.602+0000 7f2604f56640 1 -- 172.21.15.92:0/2143161559 >> 172.21.15.92:0/2143161559 conn(0x7f2600101d80 msgr2=0x7f26001041a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:57.328 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.602+0000 7f2604f56640 1 -- 172.21.15.92:0/2143161559 shutdown_connections 2024-09-19T08:47:57.328 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.602+0000 7f2604f56640 1 -- 172.21.15.92:0/2143161559 wait complete. 2024-09-19T08:47:57.329 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.603+0000 7f2604f56640 1 Processor -- start 2024-09-19T08:47:57.329 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.603+0000 7f2604f56640 1 -- start start 2024-09-19T08:47:57.329 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.603+0000 7f2604f56640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26001081a0 0x7f2600107a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:57.329 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.603+0000 7f2604f56640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f260010bae0 con 0x7f26001081a0 2024-09-19T08:47:57.329 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.603+0000 7f25fe59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26001081a0 0x7f2600107a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:57.329 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.603+0000 7f25fe59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26001081a0 0x7f2600107a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51448/0 (socket says 172.21.15.92:51448) 2024-09-19T08:47:57.329 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.603+0000 7f25fe59c640 1 -- 172.21.15.92:0/4230810973 learned_addr learned my addr 172.21.15.92:0/4230810973 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:57.329 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.603+0000 7f25fe59c640 1 -- 172.21.15.92:0/4230810973 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2600107f60 con 0x7f26001081a0 2024-09-19T08:47:57.329 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.604+0000 7f25fe59c640 1 --2- 172.21.15.92:0/4230810973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26001081a0 0x7f2600107a20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f25f00097f0 tx=0x7f25f00327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:57.329 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.604+0000 7f25f77fe640 1 -- 172.21.15.92:0/4230810973 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25f0037040 con 0x7f26001081a0 2024-09-19T08:47:57.329 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.604+0000 7f25f77fe640 1 -- 172.21.15.92:0/4230810973 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25f0030cc0 con 0x7f26001081a0 2024-09-19T08:47:57.329 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.604+0000 7f2604f56640 1 -- 172.21.15.92:0/4230810973 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2600106150 con 0x7f26001081a0 2024-09-19T08:47:57.329 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.604+0000 7f2604f56640 1 -- 172.21.15.92:0/4230810973 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2600106690 con 0x7f26001081a0 2024-09-19T08:47:57.330 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.604+0000 7f25f77fe640 1 -- 172.21.15.92:0/4230810973 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25f003a6b0 con 0x7f26001081a0 2024-09-19T08:47:57.330 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.605+0000 7f2604f56640 1 -- 172.21.15.92:0/4230810973 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25e00052c0 con 0x7f26001081a0 2024-09-19T08:47:57.330 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.605+0000 7f25f77fe640 1 -- 172.21.15.92:0/4230810973 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f25f003a870 con 0x7f26001081a0 2024-09-19T08:47:57.330 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.605+0000 7f25f77fe640 1 --2- 172.21.15.92:0/4230810973 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f25ec039260 0x7f25ec03b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:57.330 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.605+0000 7f25f77fe640 1 -- 172.21.15.92:0/4230810973 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f25f006caf0 con 0x7f26001081a0 2024-09-19T08:47:57.330 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.605+0000 7f25fdd9b640 1 --2- 172.21.15.92:0/4230810973 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f25ec039260 0x7f25ec03b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:57.330 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.606+0000 7f25fdd9b640 1 --2- 172.21.15.92:0/4230810973 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f25ec039260 0x7f25ec03b720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f25e80098c0 tx=0x7f25e8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:57.330 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.610+0000 7f25f77fe640 1 -- 172.21.15.92:0/4230810973 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f25f00371e0 con 0x7f26001081a0 2024-09-19T08:47:57.330 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:55.805+0000 7f2604f56640 1 -- 172.21.15.92:0/4230810973 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f25e0002420 con 0x7f25ec039260 2024-09-19T08:47:57.330 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:56.034+0000 7f25f77fe640 1 -- 172.21.15.92:0/4230810973 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f25e0002420 con 0x7f25ec039260 2024-09-19T08:47:57.330 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:56.037+0000 7f2604f56640 1 -- 172.21.15.92:0/4230810973 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f25ec039260 msgr2=0x7f25ec03b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:57.330 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:56.037+0000 7f2604f56640 1 --2- 172.21.15.92:0/4230810973 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f25ec039260 0x7f25ec03b720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f25e80098c0 tx=0x7f25e8006db0 comp rx=0 tx=0).stop 2024-09-19T08:47:57.330 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:56.037+0000 7f2604f56640 1 -- 172.21.15.92:0/4230810973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26001081a0 msgr2=0x7f2600107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:57.331 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:56.037+0000 7f2604f56640 1 --2- 172.21.15.92:0/4230810973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26001081a0 0x7f2600107a20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f25f00097f0 tx=0x7f25f00327b0 comp rx=0 tx=0).stop 2024-09-19T08:47:57.331 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:56.037+0000 7f2604f56640 1 -- 172.21.15.92:0/4230810973 shutdown_connections 2024-09-19T08:47:57.331 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:56.037+0000 7f2604f56640 1 --2- 172.21.15.92:0/4230810973 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f25ec039260 0x7f25ec03b720 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:57.331 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:56.037+0000 7f2604f56640 1 --2- 172.21.15.92:0/4230810973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26001081a0 0x7f2600107a20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:57.331 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:56.037+0000 7f2604f56640 1 -- 172.21.15.92:0/4230810973 >> 172.21.15.92:0/4230810973 conn(0x7f2600101d80 msgr2=0x7f2600102930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:57.331 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:56.037+0000 7f2604f56640 1 -- 172.21.15.92:0/4230810973 shutdown_connections 2024-09-19T08:47:57.331 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:56.037+0000 7f2604f56640 1 -- 172.21.15.92:0/4230810973 wait complete. 2024-09-19T08:47:57.331 INFO:teuthology.orchestra.run.smithi092.stdout:Fetching dashboard port number... 2024-09-19T08:47:57.453 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:57 smithi092 ceph-mon[31407]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:47:58.463 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:58 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1179342830' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-19T08:47:58.566 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 8443 2024-09-19T08:47:58.566 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.741+0000 7fd750ce6640 1 Processor -- start 2024-09-19T08:47:58.566 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.741+0000 7fd750ce6640 1 -- start start 2024-09-19T08:47:58.566 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.742+0000 7fd750ce6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd74c1065c0 0x7fd74c1069c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:58.566 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.742+0000 7fd750ce6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd74c106f90 con 0x7fd74c1065c0 2024-09-19T08:47:58.566 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.742+0000 7fd74a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd74c1065c0 0x7fd74c1069c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:58.567 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.742+0000 7fd74a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd74c1065c0 0x7fd74c1069c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51458/0 (socket says 172.21.15.92:51458) 2024-09-19T08:47:58.567 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.742+0000 7fd74a59c640 1 -- 172.21.15.92:0/1887268156 learned_addr learned my addr 172.21.15.92:0/1887268156 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:58.568 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.742+0000 7fd74a59c640 1 -- 172.21.15.92:0/1887268156 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd74c1077c0 con 0x7fd74c1065c0 2024-09-19T08:47:58.568 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.743+0000 7fd74a59c640 1 --2- 172.21.15.92:0/1887268156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd74c1065c0 0x7fd74c1069c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd73c009e80 tx=0x7fd73c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6838c95f304a0f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:58.568 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.743+0000 7fd74959a640 1 -- 172.21.15.92:0/1887268156 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd73c036070 con 0x7fd74c1065c0 2024-09-19T08:47:58.568 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.743+0000 7fd74959a640 1 -- 172.21.15.92:0/1887268156 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd73c0318e0 con 0x7fd74c1065c0 2024-09-19T08:47:58.568 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.743+0000 7fd74959a640 1 -- 172.21.15.92:0/1887268156 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd73c007a00 con 0x7fd74c1065c0 2024-09-19T08:47:58.568 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.744+0000 7fd750ce6640 1 -- 172.21.15.92:0/1887268156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd74c1065c0 msgr2=0x7fd74c1069c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:58.568 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.744+0000 7fd750ce6640 1 --2- 172.21.15.92:0/1887268156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd74c1065c0 0x7fd74c1069c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd73c009e80 tx=0x7fd73c02a7a0 comp rx=0 tx=0).stop 2024-09-19T08:47:58.568 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.744+0000 7fd750ce6640 1 -- 172.21.15.92:0/1887268156 shutdown_connections 2024-09-19T08:47:58.568 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.744+0000 7fd750ce6640 1 --2- 172.21.15.92:0/1887268156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd74c1065c0 0x7fd74c1069c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:58.569 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.744+0000 7fd750ce6640 1 -- 172.21.15.92:0/1887268156 >> 172.21.15.92:0/1887268156 conn(0x7fd74c101d70 msgr2=0x7fd74c104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:58.569 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.744+0000 7fd750ce6640 1 -- 172.21.15.92:0/1887268156 shutdown_connections 2024-09-19T08:47:58.569 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.744+0000 7fd750ce6640 1 -- 172.21.15.92:0/1887268156 wait complete. 2024-09-19T08:47:58.569 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.744+0000 7fd750ce6640 1 Processor -- start 2024-09-19T08:47:58.569 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.744+0000 7fd750ce6640 1 -- start start 2024-09-19T08:47:58.569 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.745+0000 7fd750ce6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd74c1065c0 0x7fd74c07ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:58.569 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.745+0000 7fd750ce6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd74c10ab70 con 0x7fd74c1065c0 2024-09-19T08:47:58.569 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.745+0000 7fd74a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd74c1065c0 0x7fd74c07ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:58.569 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.745+0000 7fd74a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd74c1065c0 0x7fd74c07ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51468/0 (socket says 172.21.15.92:51468) 2024-09-19T08:47:58.569 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.745+0000 7fd74a59c640 1 -- 172.21.15.92:0/1179342830 learned_addr learned my addr 172.21.15.92:0/1179342830 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:58.569 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.745+0000 7fd74a59c640 1 -- 172.21.15.92:0/1179342830 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd74c19e3c0 con 0x7fd74c1065c0 2024-09-19T08:47:58.569 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.745+0000 7fd74a59c640 1 --2- 172.21.15.92:0/1179342830 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd74c1065c0 0x7fd74c07ba70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd73c031cc0 tx=0x7fd73c031cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:58.569 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.745+0000 7fd73b7fe640 1 -- 172.21.15.92:0/1179342830 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd73c036050 con 0x7fd74c1065c0 2024-09-19T08:47:58.570 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.745+0000 7fd750ce6640 1 -- 172.21.15.92:0/1179342830 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd74c19e590 con 0x7fd74c1065c0 2024-09-19T08:47:58.570 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.745+0000 7fd73b7fe640 1 -- 172.21.15.92:0/1179342830 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd73c042070 con 0x7fd74c1065c0 2024-09-19T08:47:58.570 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.745+0000 7fd73b7fe640 1 -- 172.21.15.92:0/1179342830 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd73c03d8e0 con 0x7fd74c1065c0 2024-09-19T08:47:58.570 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.745+0000 7fd750ce6640 1 -- 172.21.15.92:0/1179342830 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd74c19e930 con 0x7fd74c1065c0 2024-09-19T08:47:58.570 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.746+0000 7fd73b7fe640 1 -- 172.21.15.92:0/1179342830 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7fd73c03dbe0 con 0x7fd74c1065c0 2024-09-19T08:47:58.570 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.746+0000 7fd73b7fe640 1 --2- 172.21.15.92:0/1179342830 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd734039200 0x7fd73403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:58.570 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.746+0000 7fd73b7fe640 1 -- 172.21.15.92:0/1179342830 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd73c06d800 con 0x7fd74c1065c0 2024-09-19T08:47:58.570 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.747+0000 7fd750ce6640 1 -- 172.21.15.92:0/1179342830 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd74c106a40 con 0x7fd74c1065c0 2024-09-19T08:47:58.570 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.747+0000 7fd749d9b640 1 --2- 172.21.15.92:0/1179342830 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd734039200 0x7fd73403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:58.570 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.747+0000 7fd749d9b640 1 --2- 172.21.15.92:0/1179342830 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd734039200 0x7fd73403b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd7400098c0 tx=0x7fd740006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:58.570 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.751+0000 7fd73b7fe640 1 -- 172.21.15.92:0/1179342830 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd73c044310 con 0x7fd74c1065c0 2024-09-19T08:47:58.570 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.915+0000 7fd750ce6640 1 -- 172.21.15.92:0/1179342830 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7fd74c19ec70 con 0x7fd74c1065c0 2024-09-19T08:47:58.570 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.916+0000 7fd73b7fe640 1 -- 172.21.15.92:0/1179342830 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7fd74c19ec70 con 0x7fd74c1065c0 2024-09-19T08:47:58.570 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.917+0000 7fd750ce6640 1 -- 172.21.15.92:0/1179342830 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd734039200 msgr2=0x7fd73403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:58.571 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.917+0000 7fd750ce6640 1 --2- 172.21.15.92:0/1179342830 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd734039200 0x7fd73403b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd7400098c0 tx=0x7fd740006db0 comp rx=0 tx=0).stop 2024-09-19T08:47:58.571 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.917+0000 7fd750ce6640 1 -- 172.21.15.92:0/1179342830 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd74c1065c0 msgr2=0x7fd74c07ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:58.571 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.917+0000 7fd750ce6640 1 --2- 172.21.15.92:0/1179342830 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd74c1065c0 0x7fd74c07ba70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd73c031cc0 tx=0x7fd73c031cf0 comp rx=0 tx=0).stop 2024-09-19T08:47:58.571 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.917+0000 7fd750ce6640 1 -- 172.21.15.92:0/1179342830 shutdown_connections 2024-09-19T08:47:58.571 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.917+0000 7fd750ce6640 1 --2- 172.21.15.92:0/1179342830 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd734039200 0x7fd73403b6c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:58.571 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.917+0000 7fd750ce6640 1 --2- 172.21.15.92:0/1179342830 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd74c1065c0 0x7fd74c07ba70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:58.571 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.917+0000 7fd750ce6640 1 -- 172.21.15.92:0/1179342830 >> 172.21.15.92:0/1179342830 conn(0x7fd74c101d70 msgr2=0x7fd74c1028c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:58.571 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.918+0000 7fd750ce6640 1 -- 172.21.15.92:0/1179342830 shutdown_connections 2024-09-19T08:47:58.571 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:57.918+0000 7fd750ce6640 1 -- 172.21.15.92:0/1179342830 wait complete. 2024-09-19T08:47:58.574 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T08:47:58.574 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout disabled 2024-09-19T08:47:58.582 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T08:47:58.582 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout inactive 2024-09-19T08:47:58.582 INFO:teuthology.orchestra.run.smithi092.stdout:firewalld.service is not enabled 2024-09-19T08:47:58.582 INFO:teuthology.orchestra.run.smithi092.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-19T08:47:58.584 INFO:teuthology.orchestra.run.smithi092.stdout:Ceph Dashboard is now available at: 2024-09-19T08:47:58.584 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:47:58.585 INFO:teuthology.orchestra.run.smithi092.stdout: URL: https://smithi092.front.sepia.ceph.com:8443/ 2024-09-19T08:47:58.585 INFO:teuthology.orchestra.run.smithi092.stdout: User: admin 2024-09-19T08:47:58.585 INFO:teuthology.orchestra.run.smithi092.stdout: Password: iv58k1zmqf 2024-09-19T08:47:58.585 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:47:58.585 INFO:teuthology.orchestra.run.smithi092.stdout:Saving cluster configuration to /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/config directory 2024-09-19T08:47:59.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:47:59 smithi092 ceph-mon[31407]: mgrmap e13: x(active, since 6s) 2024-09-19T08:47:59.774 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.957+0000 7f198b256640 1 Processor -- start 2024-09-19T08:47:59.774 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.957+0000 7f198b256640 1 -- start start 2024-09-19T08:47:59.774 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.957+0000 7f198b256640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19841076b0 0x7f1984107ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:59.774 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.957+0000 7f198b256640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1984108080 con 0x7f19841076b0 2024-09-19T08:47:59.775 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.958+0000 7f1988ff2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19841076b0 0x7f1984107ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:59.775 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.958+0000 7f1988ff2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19841076b0 0x7f1984107ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51476/0 (socket says 172.21.15.92:51476) 2024-09-19T08:47:59.775 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.958+0000 7f1988ff2640 1 -- 172.21.15.92:0/2747749244 learned_addr learned my addr 172.21.15.92:0/2747749244 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:59.775 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.958+0000 7f1988ff2640 1 -- 172.21.15.92:0/2747749244 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19841088b0 con 0x7f19841076b0 2024-09-19T08:47:59.775 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.959+0000 7f1988ff2640 1 --2- 172.21.15.92:0/2747749244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19841076b0 0x7f1984107ab0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1980009820 tx=0x7f198002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff2f6fce09f0d516 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:59.775 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.959+0000 7f197b7fe640 1 -- 172.21.15.92:0/2747749244 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1980037070 con 0x7f19841076b0 2024-09-19T08:47:59.775 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.959+0000 7f197b7fe640 1 -- 172.21.15.92:0/2747749244 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1980032920 con 0x7f19841076b0 2024-09-19T08:47:59.775 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.959+0000 7f197b7fe640 1 -- 172.21.15.92:0/2747749244 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1980030810 con 0x7f19841076b0 2024-09-19T08:47:59.775 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.959+0000 7f198b256640 1 -- 172.21.15.92:0/2747749244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19841076b0 msgr2=0x7f1984107ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:59.775 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.959+0000 7f198b256640 1 --2- 172.21.15.92:0/2747749244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19841076b0 0x7f1984107ab0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1980009820 tx=0x7f198002a270 comp rx=0 tx=0).stop 2024-09-19T08:47:59.775 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.959+0000 7f198b256640 1 -- 172.21.15.92:0/2747749244 shutdown_connections 2024-09-19T08:47:59.775 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.959+0000 7f198b256640 1 --2- 172.21.15.92:0/2747749244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19841076b0 0x7f1984107ab0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:59.776 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.959+0000 7f198b256640 1 -- 172.21.15.92:0/2747749244 >> 172.21.15.92:0/2747749244 conn(0x7f1984102e80 msgr2=0x7f19841052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:59.776 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.960+0000 7f198b256640 1 -- 172.21.15.92:0/2747749244 shutdown_connections 2024-09-19T08:47:59.776 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.960+0000 7f198b256640 1 -- 172.21.15.92:0/2747749244 wait complete. 2024-09-19T08:47:59.776 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.960+0000 7f198b256640 1 Processor -- start 2024-09-19T08:47:59.776 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.960+0000 7f198b256640 1 -- start start 2024-09-19T08:47:59.776 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.960+0000 7f198b256640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19841076b0 0x7f198419b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:59.776 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.960+0000 7f198b256640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f198410bc60 con 0x7f19841076b0 2024-09-19T08:47:59.776 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.960+0000 7f1988ff2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19841076b0 0x7f198419b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:59.776 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.960+0000 7f1988ff2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19841076b0 0x7f198419b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51484/0 (socket says 172.21.15.92:51484) 2024-09-19T08:47:59.776 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.960+0000 7f1988ff2640 1 -- 172.21.15.92:0/1147919598 learned_addr learned my addr 172.21.15.92:0/1147919598 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:47:59.776 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.961+0000 7f1988ff2640 1 -- 172.21.15.92:0/1147919598 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f198419bc20 con 0x7f19841076b0 2024-09-19T08:47:59.776 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.961+0000 7f1988ff2640 1 --2- 172.21.15.92:0/1147919598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19841076b0 0x7f198419b6e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f19800097f0 tx=0x7f19800327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:59.777 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.961+0000 7f1979ffb640 1 -- 172.21.15.92:0/1147919598 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1980037040 con 0x7f19841076b0 2024-09-19T08:47:59.777 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.961+0000 7f1979ffb640 1 -- 172.21.15.92:0/1147919598 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1980030cc0 con 0x7f19841076b0 2024-09-19T08:47:59.777 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.961+0000 7f198b256640 1 -- 172.21.15.92:0/1147919598 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f198419beb0 con 0x7f19841076b0 2024-09-19T08:47:59.777 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.961+0000 7f1979ffb640 1 -- 172.21.15.92:0/1147919598 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f198003a640 con 0x7f19841076b0 2024-09-19T08:47:59.777 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.961+0000 7f198b256640 1 -- 172.21.15.92:0/1147919598 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f198419eba0 con 0x7f19841076b0 2024-09-19T08:47:59.777 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.962+0000 7f1979ffb640 1 -- 172.21.15.92:0/1147919598 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f198003a940 con 0x7f19841076b0 2024-09-19T08:47:59.777 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.962+0000 7f198b256640 1 -- 172.21.15.92:0/1147919598 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1984107b30 con 0x7f19841076b0 2024-09-19T08:47:59.777 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.962+0000 7f1979ffb640 1 --2- 172.21.15.92:0/1147919598 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f196c0392a0 0x7f196c03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:59.777 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.962+0000 7f1979ffb640 1 -- 172.21.15.92:0/1147919598 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f198006cc40 con 0x7f19841076b0 2024-09-19T08:47:59.777 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.962+0000 7f197bfff640 1 --2- 172.21.15.92:0/1147919598 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f196c0392a0 0x7f196c03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:59.777 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.963+0000 7f197bfff640 1 --2- 172.21.15.92:0/1147919598 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f196c0392a0 0x7f196c03b760 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f19740098c0 tx=0x7f1974006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:59.777 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:58.967+0000 7f1979ffb640 1 -- 172.21.15.92:0/1147919598 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1980039740 con 0x7f19841076b0 2024-09-19T08:47:59.778 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:59.222+0000 7f198b256640 1 -- 172.21.15.92:0/1147919598 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f198419f120 con 0x7f19841076b0 2024-09-19T08:47:59.778 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:59.224+0000 7f1979ffb640 1 -- 172.21.15.92:0/1147919598 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v27)=0 set mgr/dashboard/cluster/status v27) ==== 153+0+0 (secure 0 0 0) 0x7f198003ba40 con 0x7f19841076b0 2024-09-19T08:47:59.778 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-19T08:47:59.778 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:59.226+0000 7f198b256640 1 -- 172.21.15.92:0/1147919598 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f196c0392a0 msgr2=0x7f196c03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:59.778 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:59.226+0000 7f198b256640 1 --2- 172.21.15.92:0/1147919598 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f196c0392a0 0x7f196c03b760 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f19740098c0 tx=0x7f1974006db0 comp rx=0 tx=0).stop 2024-09-19T08:47:59.778 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:59.226+0000 7f198b256640 1 -- 172.21.15.92:0/1147919598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19841076b0 msgr2=0x7f198419b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:59.778 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:59.226+0000 7f198b256640 1 --2- 172.21.15.92:0/1147919598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19841076b0 0x7f198419b6e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f19800097f0 tx=0x7f19800327b0 comp rx=0 tx=0).stop 2024-09-19T08:47:59.778 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:59.226+0000 7f198b256640 1 -- 172.21.15.92:0/1147919598 shutdown_connections 2024-09-19T08:47:59.778 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:59.226+0000 7f198b256640 1 --2- 172.21.15.92:0/1147919598 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f196c0392a0 0x7f196c03b760 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:59.778 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:59.226+0000 7f198b256640 1 --2- 172.21.15.92:0/1147919598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19841076b0 0x7f198419b6e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:59.778 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:59.226+0000 7f198b256640 1 -- 172.21.15.92:0/1147919598 >> 172.21.15.92:0/1147919598 conn(0x7f1984102e80 msgr2=0x7f1984103a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:59.778 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:59.226+0000 7f198b256640 1 -- 172.21.15.92:0/1147919598 shutdown_connections 2024-09-19T08:47:59.778 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-19T08:47:59.226+0000 7f198b256640 1 -- 172.21.15.92:0/1147919598 wait complete. 2024-09-19T08:47:59.779 INFO:teuthology.orchestra.run.smithi092.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-19T08:47:59.779 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:47:59.779 INFO:teuthology.orchestra.run.smithi092.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:47:59.779 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:47:59.779 INFO:teuthology.orchestra.run.smithi092.stdout:Or, if you are only running a single cluster on this host: 2024-09-19T08:47:59.779 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:47:59.779 INFO:teuthology.orchestra.run.smithi092.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-19T08:47:59.779 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:47:59.779 INFO:teuthology.orchestra.run.smithi092.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-19T08:47:59.779 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:47:59.779 INFO:teuthology.orchestra.run.smithi092.stdout: ceph telemetry on 2024-09-19T08:47:59.779 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:47:59.779 INFO:teuthology.orchestra.run.smithi092.stdout:For more information see: 2024-09-19T08:47:59.780 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:47:59.780 INFO:teuthology.orchestra.run.smithi092.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-19T08:47:59.780 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:47:59.780 INFO:teuthology.orchestra.run.smithi092.stdout:Bootstrap complete. 2024-09-19T08:47:59.814 INFO:tasks.cephadm:Fetching config... 2024-09-19T08:47:59.814 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-19T08:47:59.814 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-19T08:47:59.831 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-19T08:47:59.831 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-19T08:47:59.831 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-19T08:47:59.887 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-19T08:47:59.887 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-19T08:47:59.888 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-19T08:47:59.952 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-19T08:47:59.952 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-19T08:47:59.952 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-19T08:48:00.008 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-19T08:48:00.008 DEBUG:teuthology.orchestra.run.smithi092:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCjQjqM3huP7q8DcA2oq4mw5qRsXlOG1aLYk9tdkonlBnmZ4q16diKa9ez980nrVQ3tvUb3lzgdtZLIrkUqP1Jx8SYjWdzeA8uw08+zJyIcxexEPPB+6lQ4CtBorJNer3LHF9rpy5CqzC7qbwTqdjmPAMgyRRHpfKxIDyNbHQvmeyhRmiX6c0YHYc9msombr++cm+AVwVDsKzBfEsi6ZpQJNfvTm1Tb2dX3vRtMMxt7/e3h/R9rLTCuMJWvNRy2mxR/IwTciRWi8ZB+kN047WJc3SUVMqnL2xsYbhKh5a7f6bFiCUzh/56dav/zVmjkdGuPUw2zr4xdRIVuyp6S22ef03HNnGQ3EHPIZaz1nEkJCOKqkUrFGHEXCc97fBUShSaJ06AE0bPnILX94cQo3Q4BhjS9QaCGYOL0RYUYox0fItxTD8WHwLO7QBOBfr7ljFIBHTtBySz5tsHkHm0jX3uqWjuoPaJZuFo18gNqrlCCheB7SOFWCROe9MwhRIAtevc= ceph-91ff74f2-7663-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T08:48:00.083 INFO:teuthology.orchestra.run.smithi092.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCjQjqM3huP7q8DcA2oq4mw5qRsXlOG1aLYk9tdkonlBnmZ4q16diKa9ez980nrVQ3tvUb3lzgdtZLIrkUqP1Jx8SYjWdzeA8uw08+zJyIcxexEPPB+6lQ4CtBorJNer3LHF9rpy5CqzC7qbwTqdjmPAMgyRRHpfKxIDyNbHQvmeyhRmiX6c0YHYc9msombr++cm+AVwVDsKzBfEsi6ZpQJNfvTm1Tb2dX3vRtMMxt7/e3h/R9rLTCuMJWvNRy2mxR/IwTciRWi8ZB+kN047WJc3SUVMqnL2xsYbhKh5a7f6bFiCUzh/56dav/zVmjkdGuPUw2zr4xdRIVuyp6S22ef03HNnGQ3EHPIZaz1nEkJCOKqkUrFGHEXCc97fBUShSaJ06AE0bPnILX94cQo3Q4BhjS9QaCGYOL0RYUYox0fItxTD8WHwLO7QBOBfr7ljFIBHTtBySz5tsHkHm0jX3uqWjuoPaJZuFo18gNqrlCCheB7SOFWCROe9MwhRIAtevc= ceph-91ff74f2-7663-11ef-bceb-c7b262605968 2024-09-19T08:48:00.094 DEBUG:teuthology.orchestra.run.smithi167:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCjQjqM3huP7q8DcA2oq4mw5qRsXlOG1aLYk9tdkonlBnmZ4q16diKa9ez980nrVQ3tvUb3lzgdtZLIrkUqP1Jx8SYjWdzeA8uw08+zJyIcxexEPPB+6lQ4CtBorJNer3LHF9rpy5CqzC7qbwTqdjmPAMgyRRHpfKxIDyNbHQvmeyhRmiX6c0YHYc9msombr++cm+AVwVDsKzBfEsi6ZpQJNfvTm1Tb2dX3vRtMMxt7/e3h/R9rLTCuMJWvNRy2mxR/IwTciRWi8ZB+kN047WJc3SUVMqnL2xsYbhKh5a7f6bFiCUzh/56dav/zVmjkdGuPUw2zr4xdRIVuyp6S22ef03HNnGQ3EHPIZaz1nEkJCOKqkUrFGHEXCc97fBUShSaJ06AE0bPnILX94cQo3Q4BhjS9QaCGYOL0RYUYox0fItxTD8WHwLO7QBOBfr7ljFIBHTtBySz5tsHkHm0jX3uqWjuoPaJZuFo18gNqrlCCheB7SOFWCROe9MwhRIAtevc= ceph-91ff74f2-7663-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T08:48:00.135 INFO:teuthology.orchestra.run.smithi167.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCjQjqM3huP7q8DcA2oq4mw5qRsXlOG1aLYk9tdkonlBnmZ4q16diKa9ez980nrVQ3tvUb3lzgdtZLIrkUqP1Jx8SYjWdzeA8uw08+zJyIcxexEPPB+6lQ4CtBorJNer3LHF9rpy5CqzC7qbwTqdjmPAMgyRRHpfKxIDyNbHQvmeyhRmiX6c0YHYc9msombr++cm+AVwVDsKzBfEsi6ZpQJNfvTm1Tb2dX3vRtMMxt7/e3h/R9rLTCuMJWvNRy2mxR/IwTciRWi8ZB+kN047WJc3SUVMqnL2xsYbhKh5a7f6bFiCUzh/56dav/zVmjkdGuPUw2zr4xdRIVuyp6S22ef03HNnGQ3EHPIZaz1nEkJCOKqkUrFGHEXCc97fBUShSaJ06AE0bPnILX94cQo3Q4BhjS9QaCGYOL0RYUYox0fItxTD8WHwLO7QBOBfr7ljFIBHTtBySz5tsHkHm0jX3uqWjuoPaJZuFo18gNqrlCCheB7SOFWCROe9MwhRIAtevc= ceph-91ff74f2-7663-11ef-bceb-c7b262605968 2024-09-19T08:48:00.148 DEBUG:teuthology.orchestra.run.smithi190:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCjQjqM3huP7q8DcA2oq4mw5qRsXlOG1aLYk9tdkonlBnmZ4q16diKa9ez980nrVQ3tvUb3lzgdtZLIrkUqP1Jx8SYjWdzeA8uw08+zJyIcxexEPPB+6lQ4CtBorJNer3LHF9rpy5CqzC7qbwTqdjmPAMgyRRHpfKxIDyNbHQvmeyhRmiX6c0YHYc9msombr++cm+AVwVDsKzBfEsi6ZpQJNfvTm1Tb2dX3vRtMMxt7/e3h/R9rLTCuMJWvNRy2mxR/IwTciRWi8ZB+kN047WJc3SUVMqnL2xsYbhKh5a7f6bFiCUzh/56dav/zVmjkdGuPUw2zr4xdRIVuyp6S22ef03HNnGQ3EHPIZaz1nEkJCOKqkUrFGHEXCc97fBUShSaJ06AE0bPnILX94cQo3Q4BhjS9QaCGYOL0RYUYox0fItxTD8WHwLO7QBOBfr7ljFIBHTtBySz5tsHkHm0jX3uqWjuoPaJZuFo18gNqrlCCheB7SOFWCROe9MwhRIAtevc= ceph-91ff74f2-7663-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T08:48:00.189 INFO:teuthology.orchestra.run.smithi190.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCjQjqM3huP7q8DcA2oq4mw5qRsXlOG1aLYk9tdkonlBnmZ4q16diKa9ez980nrVQ3tvUb3lzgdtZLIrkUqP1Jx8SYjWdzeA8uw08+zJyIcxexEPPB+6lQ4CtBorJNer3LHF9rpy5CqzC7qbwTqdjmPAMgyRRHpfKxIDyNbHQvmeyhRmiX6c0YHYc9msombr++cm+AVwVDsKzBfEsi6ZpQJNfvTm1Tb2dX3vRtMMxt7/e3h/R9rLTCuMJWvNRy2mxR/IwTciRWi8ZB+kN047WJc3SUVMqnL2xsYbhKh5a7f6bFiCUzh/56dav/zVmjkdGuPUw2zr4xdRIVuyp6S22ef03HNnGQ3EHPIZaz1nEkJCOKqkUrFGHEXCc97fBUShSaJ06AE0bPnILX94cQo3Q4BhjS9QaCGYOL0RYUYox0fItxTD8WHwLO7QBOBfr7ljFIBHTtBySz5tsHkHm0jX3uqWjuoPaJZuFo18gNqrlCCheB7SOFWCROe9MwhRIAtevc= ceph-91ff74f2-7663-11ef-bceb-c7b262605968 2024-09-19T08:48:00.201 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-19T08:48:00.450 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:48:00.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:00 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1147919598' entity='client.admin' 2024-09-19T08:48:00.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:00.905+0000 7f5d46dbb640 1 -- 172.21.15.92:0/4067576964 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d40100540 msgr2=0x7f5d40100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:00.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:00.905+0000 7f5d46dbb640 1 --2- 172.21.15.92:0/4067576964 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d40100540 0x7f5d40100940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5d30009c20 tx=0x7f5d3002aa90 comp rx=0 tx=0).stop 2024-09-19T08:48:00.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:00.905+0000 7f5d46dbb640 1 -- 172.21.15.92:0/4067576964 shutdown_connections 2024-09-19T08:48:00.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:00.905+0000 7f5d46dbb640 1 --2- 172.21.15.92:0/4067576964 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d40100540 0x7f5d40100940 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:00.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:00.905+0000 7f5d46dbb640 1 -- 172.21.15.92:0/4067576964 >> 172.21.15.92:0/4067576964 conn(0x7f5d400fbcd0 msgr2=0x7f5d400fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:00.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:00.905+0000 7f5d46dbb640 1 -- 172.21.15.92:0/4067576964 shutdown_connections 2024-09-19T08:48:00.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:00.905+0000 7f5d46dbb640 1 -- 172.21.15.92:0/4067576964 wait complete. 2024-09-19T08:48:00.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:00.905+0000 7f5d46dbb640 1 Processor -- start 2024-09-19T08:48:00.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:00.905+0000 7f5d46dbb640 1 -- start start 2024-09-19T08:48:00.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:00.905+0000 7f5d46dbb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d40100540 0x7f5d40195c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:00.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:00.905+0000 7f5d46dbb640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5d401065f0 con 0x7f5d40100540 2024-09-19T08:48:00.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:00.905+0000 7f5d44b57640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d40100540 0x7f5d40195c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:00.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:00.905+0000 7f5d44b57640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d40100540 0x7f5d40195c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51498/0 (socket says 172.21.15.92:51498) 2024-09-19T08:48:00.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:00.905+0000 7f5d44b57640 1 -- 172.21.15.92:0/363996556 learned_addr learned my addr 172.21.15.92:0/363996556 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:48:00.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:00.906+0000 7f5d44b57640 1 -- 172.21.15.92:0/363996556 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d401961a0 con 0x7f5d40100540 2024-09-19T08:48:00.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:00.906+0000 7f5d44b57640 1 --2- 172.21.15.92:0/363996556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d40100540 0x7f5d40195c60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5d3002f040 tx=0x7f5d3002e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:00.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:00.906+0000 7f5d3dffb640 1 -- 172.21.15.92:0/363996556 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d30047070 con 0x7f5d40100540 2024-09-19T08:48:00.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:00.906+0000 7f5d3dffb640 1 -- 172.21.15.92:0/363996556 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d30003e50 con 0x7f5d40100540 2024-09-19T08:48:00.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:00.906+0000 7f5d46dbb640 1 -- 172.21.15.92:0/363996556 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d40196430 con 0x7f5d40100540 2024-09-19T08:48:00.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:00.906+0000 7f5d3dffb640 1 -- 172.21.15.92:0/363996556 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d30033050 con 0x7f5d40100540 2024-09-19T08:48:00.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:00.906+0000 7f5d46dbb640 1 -- 172.21.15.92:0/363996556 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d40199120 con 0x7f5d40100540 2024-09-19T08:48:00.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:00.907+0000 7f5d3dffb640 1 -- 172.21.15.92:0/363996556 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f5d3004a070 con 0x7f5d40100540 2024-09-19T08:48:00.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:00.907+0000 7f5d46dbb640 1 -- 172.21.15.92:0/363996556 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d40106d70 con 0x7f5d40100540 2024-09-19T08:48:00.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:00.907+0000 7f5d3dffb640 1 --2- 172.21.15.92:0/363996556 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5d2c0392a0 0x7f5d2c03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:00.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:00.907+0000 7f5d3dffb640 1 -- 172.21.15.92:0/363996556 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f5d3003e030 con 0x7f5d40100540 2024-09-19T08:48:00.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:00.907+0000 7f5d3ffff640 1 --2- 172.21.15.92:0/363996556 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5d2c0392a0 0x7f5d2c03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:00.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:00.908+0000 7f5d3ffff640 1 --2- 172.21.15.92:0/363996556 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5d2c0392a0 0x7f5d2c03b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5d280098c0 tx=0x7f5d28006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:00.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:00.913+0000 7f5d3dffb640 1 -- 172.21.15.92:0/363996556 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5d300384d0 con 0x7f5d40100540 2024-09-19T08:48:01.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:01.078+0000 7f5d46dbb640 1 -- 172.21.15.92:0/363996556 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f5d4002d830 con 0x7f5d40100540 2024-09-19T08:48:01.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:01.080+0000 7f5d3dffb640 1 -- 172.21.15.92:0/363996556 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f5d3004ac60 con 0x7f5d40100540 2024-09-19T08:48:01.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:01.082+0000 7f5d46dbb640 1 -- 172.21.15.92:0/363996556 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5d2c0392a0 msgr2=0x7f5d2c03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:01.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:01.082+0000 7f5d46dbb640 1 --2- 172.21.15.92:0/363996556 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5d2c0392a0 0x7f5d2c03b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5d280098c0 tx=0x7f5d28006db0 comp rx=0 tx=0).stop 2024-09-19T08:48:01.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:01.082+0000 7f5d46dbb640 1 -- 172.21.15.92:0/363996556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d40100540 msgr2=0x7f5d40195c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:01.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:01.082+0000 7f5d46dbb640 1 --2- 172.21.15.92:0/363996556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d40100540 0x7f5d40195c60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5d3002f040 tx=0x7f5d3002e3c0 comp rx=0 tx=0).stop 2024-09-19T08:48:01.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:01.082+0000 7f5d46dbb640 1 -- 172.21.15.92:0/363996556 shutdown_connections 2024-09-19T08:48:01.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:01.082+0000 7f5d46dbb640 1 --2- 172.21.15.92:0/363996556 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5d2c0392a0 0x7f5d2c03b760 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:01.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:01.082+0000 7f5d46dbb640 1 --2- 172.21.15.92:0/363996556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d40100540 0x7f5d40195c60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:01.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:01.082+0000 7f5d46dbb640 1 -- 172.21.15.92:0/363996556 >> 172.21.15.92:0/363996556 conn(0x7f5d400fbcd0 msgr2=0x7f5d400fc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:01.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:01.083+0000 7f5d46dbb640 1 -- 172.21.15.92:0/363996556 shutdown_connections 2024-09-19T08:48:01.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:01.083+0000 7f5d46dbb640 1 -- 172.21.15.92:0/363996556 wait complete. 2024-09-19T08:48:02.021 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-19T08:48:02.022 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-19T08:48:02.262 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:48:02.382 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:02 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/363996556' entity='client.admin' 2024-09-19T08:48:02.382 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:02 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:02.382 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:02 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:02.382 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:02 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi092", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:48:02.382 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:02 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:02.382 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:02 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:02.383 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:02 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:02.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.674+0000 7fc061be6640 1 -- 172.21.15.92:0/1278511294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc05c100540 msgr2=0x7fc05c100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:02.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.674+0000 7fc061be6640 1 --2- 172.21.15.92:0/1278511294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc05c100540 0x7fc05c100940 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc04c009c20 tx=0x7fc04c02aa90 comp rx=0 tx=0).stop 2024-09-19T08:48:02.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.674+0000 7fc061be6640 1 -- 172.21.15.92:0/1278511294 shutdown_connections 2024-09-19T08:48:02.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.674+0000 7fc061be6640 1 --2- 172.21.15.92:0/1278511294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc05c100540 0x7fc05c100940 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:02.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.674+0000 7fc061be6640 1 -- 172.21.15.92:0/1278511294 >> 172.21.15.92:0/1278511294 conn(0x7fc05c0fbcd0 msgr2=0x7fc05c0fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:02.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.674+0000 7fc061be6640 1 -- 172.21.15.92:0/1278511294 shutdown_connections 2024-09-19T08:48:02.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.674+0000 7fc061be6640 1 -- 172.21.15.92:0/1278511294 wait complete. 2024-09-19T08:48:02.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.674+0000 7fc061be6640 1 Processor -- start 2024-09-19T08:48:02.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.675+0000 7fc061be6640 1 -- start start 2024-09-19T08:48:02.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.675+0000 7fc061be6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc05c100540 0x7fc05c06a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:02.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.675+0000 7fc061be6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc05c1065f0 con 0x7fc05c100540 2024-09-19T08:48:02.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.675+0000 7fc05b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc05c100540 0x7fc05c06a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:02.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.675+0000 7fc05b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc05c100540 0x7fc05c06a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57506/0 (socket says 172.21.15.92:57506) 2024-09-19T08:48:02.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.675+0000 7fc05b7fe640 1 -- 172.21.15.92:0/1668520293 learned_addr learned my addr 172.21.15.92:0/1668520293 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:48:02.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.675+0000 7fc05b7fe640 1 -- 172.21.15.92:0/1668520293 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc05c1978e0 con 0x7fc05c100540 2024-09-19T08:48:02.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.675+0000 7fc05b7fe640 1 --2- 172.21.15.92:0/1668520293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc05c100540 0x7fc05c06a130 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc04c02f040 tx=0x7fc04c02e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:02.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.675+0000 7fc058ff9640 1 -- 172.21.15.92:0/1668520293 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc04c047070 con 0x7fc05c100540 2024-09-19T08:48:02.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.676+0000 7fc058ff9640 1 -- 172.21.15.92:0/1668520293 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc04c003e50 con 0x7fc05c100540 2024-09-19T08:48:02.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.676+0000 7fc061be6640 1 -- 172.21.15.92:0/1668520293 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc05c19bef0 con 0x7fc05c100540 2024-09-19T08:48:02.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.676+0000 7fc058ff9640 1 -- 172.21.15.92:0/1668520293 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc04c033050 con 0x7fc05c100540 2024-09-19T08:48:02.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.676+0000 7fc061be6640 1 -- 172.21.15.92:0/1668520293 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc05c19c290 con 0x7fc05c100540 2024-09-19T08:48:02.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.676+0000 7fc058ff9640 1 -- 172.21.15.92:0/1668520293 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fc04c04a070 con 0x7fc05c100540 2024-09-19T08:48:02.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.677+0000 7fc058ff9640 1 --2- 172.21.15.92:0/1668520293 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc044039300 0x7fc04403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:02.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.677+0000 7fc058ff9640 1 -- 172.21.15.92:0/1668520293 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc04c03e030 con 0x7fc05c100540 2024-09-19T08:48:02.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.677+0000 7fc05affd640 1 --2- 172.21.15.92:0/1668520293 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc044039300 0x7fc04403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:02.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.677+0000 7fc061be6640 1 -- 172.21.15.92:0/1668520293 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc05c106d70 con 0x7fc05c100540 2024-09-19T08:48:02.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.677+0000 7fc05affd640 1 --2- 172.21.15.92:0/1668520293 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc044039300 0x7fc04403b7c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc0500098c0 tx=0x7fc050006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:02.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.681+0000 7fc058ff9640 1 -- 172.21.15.92:0/1668520293 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc04c051080 con 0x7fc05c100540 2024-09-19T08:48:02.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.849+0000 7fc061be6640 1 -- 172.21.15.92:0/1668520293 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fc05c02d860 con 0x7fc044039300 2024-09-19T08:48:02.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.852+0000 7fc058ff9640 1 -- 172.21.15.92:0/1668520293 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc05c02d860 con 0x7fc044039300 2024-09-19T08:48:02.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.855+0000 7fc061be6640 1 -- 172.21.15.92:0/1668520293 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc044039300 msgr2=0x7fc04403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:02.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.855+0000 7fc061be6640 1 --2- 172.21.15.92:0/1668520293 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc044039300 0x7fc04403b7c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc0500098c0 tx=0x7fc050006db0 comp rx=0 tx=0).stop 2024-09-19T08:48:02.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.855+0000 7fc061be6640 1 -- 172.21.15.92:0/1668520293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc05c100540 msgr2=0x7fc05c06a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:02.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.855+0000 7fc061be6640 1 --2- 172.21.15.92:0/1668520293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc05c100540 0x7fc05c06a130 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc04c02f040 tx=0x7fc04c02e3c0 comp rx=0 tx=0).stop 2024-09-19T08:48:02.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.855+0000 7fc061be6640 1 -- 172.21.15.92:0/1668520293 shutdown_connections 2024-09-19T08:48:02.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.855+0000 7fc061be6640 1 --2- 172.21.15.92:0/1668520293 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc044039300 0x7fc04403b7c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:02.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.855+0000 7fc061be6640 1 --2- 172.21.15.92:0/1668520293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc05c100540 0x7fc05c06a130 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:02.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.855+0000 7fc061be6640 1 -- 172.21.15.92:0/1668520293 >> 172.21.15.92:0/1668520293 conn(0x7fc05c0fbcd0 msgr2=0x7fc05c0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:02.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.855+0000 7fc061be6640 1 -- 172.21.15.92:0/1668520293 shutdown_connections 2024-09-19T08:48:02.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:02.855+0000 7fc061be6640 1 -- 172.21.15.92:0/1668520293 wait complete. 2024-09-19T08:48:03.510 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi167 2024-09-19T08:48:03.510 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-19T08:48:03.510 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/etc/ceph/ceph.conf 2024-09-19T08:48:03.530 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-19T08:48:03.530 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:48:03.589 INFO:tasks.cephadm:Adding host smithi167 to orchestrator... 2024-09-19T08:48:03.589 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph orch host add smithi167 2024-09-19T08:48:03.840 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:48:04.191 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:03 smithi092 ceph-mon[31407]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:48:04.191 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:03 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:04.191 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:03 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:04.191 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:03 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:04.192 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:03 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:04.192 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:03 smithi092 ceph-mon[31407]: Updating smithi092:/etc/ceph/ceph.conf 2024-09-19T08:48:04.192 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:03 smithi092 ceph-mon[31407]: Updating smithi092:/var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:48:04.192 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:03 smithi092 ceph-mon[31407]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:48:04.192 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:03 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:04.192 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:03 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:04.192 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:03 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:04.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:04.272+0000 7fa41bf98640 1 -- 172.21.15.92:0/4103501495 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa414106560 msgr2=0x7fa414106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:04.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:04.272+0000 7fa41bf98640 1 --2- 172.21.15.92:0/4103501495 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa414106560 0x7fa414106940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa410009880 tx=0x7fa41002a5d0 comp rx=0 tx=0).stop 2024-09-19T08:48:04.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:04.272+0000 7fa41bf98640 1 -- 172.21.15.92:0/4103501495 shutdown_connections 2024-09-19T08:48:04.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:04.272+0000 7fa41bf98640 1 --2- 172.21.15.92:0/4103501495 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa414106560 0x7fa414106940 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:04.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:04.272+0000 7fa41bf98640 1 -- 172.21.15.92:0/4103501495 >> 172.21.15.92:0/4103501495 conn(0x7fa4140fc1b0 msgr2=0x7fa4140fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:04.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:04.272+0000 7fa41bf98640 1 -- 172.21.15.92:0/4103501495 shutdown_connections 2024-09-19T08:48:04.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:04.272+0000 7fa41bf98640 1 -- 172.21.15.92:0/4103501495 wait complete. 2024-09-19T08:48:04.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:04.273+0000 7fa41bf98640 1 Processor -- start 2024-09-19T08:48:04.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:04.273+0000 7fa41bf98640 1 -- start start 2024-09-19T08:48:04.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:04.273+0000 7fa41bf98640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa414106560 0x7fa414197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:04.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:04.273+0000 7fa41bf98640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa41410ab90 con 0x7fa414106560 2024-09-19T08:48:04.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:04.273+0000 7fa419d34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa414106560 0x7fa414197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:04.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:04.273+0000 7fa419d34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa414106560 0x7fa414197f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57524/0 (socket says 172.21.15.92:57524) 2024-09-19T08:48:04.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:04.273+0000 7fa419d34640 1 -- 172.21.15.92:0/1982547676 learned_addr learned my addr 172.21.15.92:0/1982547676 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:48:04.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:04.274+0000 7fa419d34640 1 -- 172.21.15.92:0/1982547676 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4141984c0 con 0x7fa414106560 2024-09-19T08:48:04.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:04.274+0000 7fa419d34640 1 --2- 172.21.15.92:0/1982547676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa414106560 0x7fa414197f80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa410009230 tx=0x7fa410003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:04.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:04.274+0000 7fa40affd640 1 -- 172.21.15.92:0/1982547676 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa41003f070 con 0x7fa414106560 2024-09-19T08:48:04.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:04.274+0000 7fa40affd640 1 -- 172.21.15.92:0/1982547676 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa41003bc80 con 0x7fa414106560 2024-09-19T08:48:04.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:04.274+0000 7fa41bf98640 1 -- 172.21.15.92:0/1982547676 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa414198750 con 0x7fa414106560 2024-09-19T08:48:04.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:04.274+0000 7fa40affd640 1 -- 172.21.15.92:0/1982547676 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa410035030 con 0x7fa414106560 2024-09-19T08:48:04.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:04.274+0000 7fa41bf98640 1 -- 172.21.15.92:0/1982547676 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa414198bb0 con 0x7fa414106560 2024-09-19T08:48:04.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:04.275+0000 7fa40affd640 1 -- 172.21.15.92:0/1982547676 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fa410042070 con 0x7fa414106560 2024-09-19T08:48:04.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:04.275+0000 7fa41bf98640 1 -- 172.21.15.92:0/1982547676 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa414101bd0 con 0x7fa414106560 2024-09-19T08:48:04.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:04.275+0000 7fa40affd640 1 --2- 172.21.15.92:0/1982547676 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa4000392a0 0x7fa40003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:04.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:04.275+0000 7fa40affd640 1 -- 172.21.15.92:0/1982547676 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa41006cbe0 con 0x7fa414106560 2024-09-19T08:48:04.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:04.275+0000 7fa419533640 1 --2- 172.21.15.92:0/1982547676 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa4000392a0 0x7fa40003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:04.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:04.275+0000 7fa419533640 1 --2- 172.21.15.92:0/1982547676 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa4000392a0 0x7fa40003b760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa4040098c0 tx=0x7fa404006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:04.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:04.280+0000 7fa40affd640 1 -- 172.21.15.92:0/1982547676 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa410042360 con 0x7fa414106560 2024-09-19T08:48:04.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:04.450+0000 7fa41bf98640 1 -- 172.21.15.92:0/1982547676 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi167", "target": ["mon-mgr", ""]}) -- 0x7fa4141069c0 con 0x7fa4000392a0 2024-09-19T08:48:05.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:04 smithi092 ceph-mon[31407]: Updating smithi092:/var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:48:06.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:05 smithi092 ceph-mon[31407]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi167", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:48:06.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:05 smithi092 ceph-mon[31407]: Deploying cephadm binary to smithi167 2024-09-19T08:48:07.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:07.614+0000 7fa40affd640 1 -- 172.21.15.92:0/1982547676 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fa4141069c0 con 0x7fa4000392a0 2024-09-19T08:48:07.614 INFO:teuthology.orchestra.run.smithi092.stdout:Added host 'smithi167' with addr '172.21.15.167' 2024-09-19T08:48:07.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:07.616+0000 7fa41bf98640 1 -- 172.21.15.92:0/1982547676 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa4000392a0 msgr2=0x7fa40003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:07.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:07.616+0000 7fa41bf98640 1 --2- 172.21.15.92:0/1982547676 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa4000392a0 0x7fa40003b760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa4040098c0 tx=0x7fa404006db0 comp rx=0 tx=0).stop 2024-09-19T08:48:07.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:07.616+0000 7fa41bf98640 1 -- 172.21.15.92:0/1982547676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa414106560 msgr2=0x7fa414197f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:07.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:07.616+0000 7fa41bf98640 1 --2- 172.21.15.92:0/1982547676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa414106560 0x7fa414197f80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa410009230 tx=0x7fa410003d40 comp rx=0 tx=0).stop 2024-09-19T08:48:07.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:07.616+0000 7fa41bf98640 1 -- 172.21.15.92:0/1982547676 shutdown_connections 2024-09-19T08:48:07.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:07.616+0000 7fa41bf98640 1 --2- 172.21.15.92:0/1982547676 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa4000392a0 0x7fa40003b760 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:07.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:07.616+0000 7fa41bf98640 1 --2- 172.21.15.92:0/1982547676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa414106560 0x7fa414197f80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:07.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:07.616+0000 7fa41bf98640 1 -- 172.21.15.92:0/1982547676 >> 172.21.15.92:0/1982547676 conn(0x7fa4140fc1b0 msgr2=0x7fa4140fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:07.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:07.617+0000 7fa41bf98640 1 -- 172.21.15.92:0/1982547676 shutdown_connections 2024-09-19T08:48:07.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:07.617+0000 7fa41bf98640 1 -- 172.21.15.92:0/1982547676 wait complete. 2024-09-19T08:48:08.198 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T08:48:08.437 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:48:08.827 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:08 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:08.827 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:08 smithi092 ceph-mon[31407]: Added host smithi167 2024-09-19T08:48:08.827 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:08 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:08.827 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:08 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:08.827 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:08 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:08.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:08.827+0000 7f9d0d5e5640 1 -- 172.21.15.92:0/2135126964 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d08106560 msgr2=0x7f9d08106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:08.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:08.827+0000 7f9d0d5e5640 1 --2- 172.21.15.92:0/2135126964 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d08106560 0x7f9d08106940 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8009880 tx=0x7f9cf802a5d0 comp rx=0 tx=0).stop 2024-09-19T08:48:08.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:08.827+0000 7f9d0d5e5640 1 -- 172.21.15.92:0/2135126964 shutdown_connections 2024-09-19T08:48:08.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:08.827+0000 7f9d0d5e5640 1 --2- 172.21.15.92:0/2135126964 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d08106560 0x7f9d08106940 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:08.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:08.827+0000 7f9d0d5e5640 1 -- 172.21.15.92:0/2135126964 >> 172.21.15.92:0/2135126964 conn(0x7f9d080fc1b0 msgr2=0x7f9d080fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:08.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:08.827+0000 7f9d0d5e5640 1 -- 172.21.15.92:0/2135126964 shutdown_connections 2024-09-19T08:48:08.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:08.827+0000 7f9d0d5e5640 1 -- 172.21.15.92:0/2135126964 wait complete. 2024-09-19T08:48:08.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:08.827+0000 7f9d0d5e5640 1 Processor -- start 2024-09-19T08:48:08.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:08.828+0000 7f9d0d5e5640 1 -- start start 2024-09-19T08:48:08.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:08.828+0000 7f9d0d5e5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d08106560 0x7f9d080fc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:08.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:08.828+0000 7f9d0d5e5640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0810ab90 con 0x7f9d08106560 2024-09-19T08:48:08.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:08.828+0000 7f9d06ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d08106560 0x7f9d080fc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:08.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:08.828+0000 7f9d06ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d08106560 0x7f9d080fc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57542/0 (socket says 172.21.15.92:57542) 2024-09-19T08:48:08.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:08.828+0000 7f9d06ffd640 1 -- 172.21.15.92:0/582581942 learned_addr learned my addr 172.21.15.92:0/582581942 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:48:08.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:08.828+0000 7f9d06ffd640 1 -- 172.21.15.92:0/582581942 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d080fe550 con 0x7f9d08106560 2024-09-19T08:48:08.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:08.828+0000 7f9d06ffd640 1 --2- 172.21.15.92:0/582581942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d08106560 0x7f9d080fc660 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8009230 tx=0x7f9cf8003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:08.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:08.828+0000 7f9ceffff640 1 -- 172.21.15.92:0/582581942 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cf803f070 con 0x7f9d08106560 2024-09-19T08:48:08.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:08.829+0000 7f9ceffff640 1 -- 172.21.15.92:0/582581942 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9cf803bc80 con 0x7f9d08106560 2024-09-19T08:48:08.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:08.829+0000 7f9d0d5e5640 1 -- 172.21.15.92:0/582581942 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d080fcba0 con 0x7f9d08106560 2024-09-19T08:48:08.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:08.829+0000 7f9ceffff640 1 -- 172.21.15.92:0/582581942 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cf8035030 con 0x7f9d08106560 2024-09-19T08:48:08.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:08.829+0000 7f9d0d5e5640 1 -- 172.21.15.92:0/582581942 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d080fd060 con 0x7f9d08106560 2024-09-19T08:48:08.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:08.829+0000 7f9d0d5e5640 1 -- 172.21.15.92:0/582581942 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d08101bd0 con 0x7f9d08106560 2024-09-19T08:48:08.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:08.830+0000 7f9ceffff640 1 -- 172.21.15.92:0/582581942 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f9cf8042070 con 0x7f9d08106560 2024-09-19T08:48:08.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:08.830+0000 7f9ceffff640 1 --2- 172.21.15.92:0/582581942 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9cf00392a0 0x7f9cf003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:08.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:08.830+0000 7f9ceffff640 1 -- 172.21.15.92:0/582581942 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f9cf806cf90 con 0x7f9d08106560 2024-09-19T08:48:08.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:08.830+0000 7f9d067fc640 1 --2- 172.21.15.92:0/582581942 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9cf00392a0 0x7f9cf003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:08.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:08.831+0000 7f9d067fc640 1 --2- 172.21.15.92:0/582581942 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9cf00392a0 0x7f9cf003b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc0098c0 tx=0x7f9cfc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:08.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:08.835+0000 7f9ceffff640 1 -- 172.21.15.92:0/582581942 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9cf804c350 con 0x7f9d08106560 2024-09-19T08:48:09.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:09.007+0000 7f9d0d5e5640 1 -- 172.21.15.92:0/582581942 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9d080fdc00 con 0x7f9cf00392a0 2024-09-19T08:48:09.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:09.008+0000 7f9ceffff640 1 -- 172.21.15.92:0/582581942 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7f9d080fdc00 con 0x7f9cf00392a0 2024-09-19T08:48:09.008 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:48:09.008 INFO:teuthology.orchestra.run.smithi092.stdout:[{"addr": "172.21.15.92", "hostname": "smithi092", "labels": [], "status": ""}, {"addr": "172.21.15.167", "hostname": "smithi167", "labels": [], "status": ""}] 2024-09-19T08:48:09.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:09.011+0000 7f9d0d5e5640 1 -- 172.21.15.92:0/582581942 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9cf00392a0 msgr2=0x7f9cf003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:09.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:09.011+0000 7f9d0d5e5640 1 --2- 172.21.15.92:0/582581942 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9cf00392a0 0x7f9cf003b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc0098c0 tx=0x7f9cfc006db0 comp rx=0 tx=0).stop 2024-09-19T08:48:09.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:09.011+0000 7f9d0d5e5640 1 -- 172.21.15.92:0/582581942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d08106560 msgr2=0x7f9d080fc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:09.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:09.011+0000 7f9d0d5e5640 1 --2- 172.21.15.92:0/582581942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d08106560 0x7f9d080fc660 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8009230 tx=0x7f9cf8003d40 comp rx=0 tx=0).stop 2024-09-19T08:48:09.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:09.011+0000 7f9d0d5e5640 1 -- 172.21.15.92:0/582581942 shutdown_connections 2024-09-19T08:48:09.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:09.011+0000 7f9d0d5e5640 1 --2- 172.21.15.92:0/582581942 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9cf00392a0 0x7f9cf003b760 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:09.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:09.011+0000 7f9d0d5e5640 1 --2- 172.21.15.92:0/582581942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d08106560 0x7f9d080fc660 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:09.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:09.011+0000 7f9d0d5e5640 1 -- 172.21.15.92:0/582581942 >> 172.21.15.92:0/582581942 conn(0x7f9d080fc1b0 msgr2=0x7f9d08069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:09.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:09.011+0000 7f9d0d5e5640 1 -- 172.21.15.92:0/582581942 shutdown_connections 2024-09-19T08:48:09.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:09.011+0000 7f9d0d5e5640 1 -- 172.21.15.92:0/582581942 wait complete. 2024-09-19T08:48:09.527 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi190 2024-09-19T08:48:09.527 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-19T08:48:09.527 DEBUG:teuthology.orchestra.run.smithi190:> dd of=/etc/ceph/ceph.conf 2024-09-19T08:48:09.547 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-19T08:48:09.547 DEBUG:teuthology.orchestra.run.smithi190:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:48:09.606 INFO:tasks.cephadm:Adding host smithi190 to orchestrator... 2024-09-19T08:48:09.606 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph orch host add smithi190 2024-09-19T08:48:09.844 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:48:10.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:09 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:09 smithi092 ceph-mon[31407]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:48:10.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:10.242+0000 7fdd151b9640 1 -- 172.21.15.92:0/1258889514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd10106540 msgr2=0x7fdd10106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:10.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:10.242+0000 7fdd151b9640 1 --2- 172.21.15.92:0/1258889514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd10106540 0x7fdd10106920 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdd00009810 tx=0x7fdd0002a540 comp rx=0 tx=0).stop 2024-09-19T08:48:10.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:10.242+0000 7fdd151b9640 1 -- 172.21.15.92:0/1258889514 shutdown_connections 2024-09-19T08:48:10.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:10.242+0000 7fdd151b9640 1 --2- 172.21.15.92:0/1258889514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd10106540 0x7fdd10106920 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:10.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:10.242+0000 7fdd151b9640 1 -- 172.21.15.92:0/1258889514 >> 172.21.15.92:0/1258889514 conn(0x7fdd10077310 msgr2=0x7fdd100fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:10.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:10.242+0000 7fdd151b9640 1 -- 172.21.15.92:0/1258889514 shutdown_connections 2024-09-19T08:48:10.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:10.243+0000 7fdd151b9640 1 -- 172.21.15.92:0/1258889514 wait complete. 2024-09-19T08:48:10.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:10.243+0000 7fdd151b9640 1 Processor -- start 2024-09-19T08:48:10.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:10.243+0000 7fdd151b9640 1 -- start start 2024-09-19T08:48:10.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:10.244+0000 7fdd151b9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd10106540 0x7fdd101970c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:10.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:10.244+0000 7fdd151b9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1010ab70 con 0x7fdd10106540 2024-09-19T08:48:10.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:10.244+0000 7fdd0ed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd10106540 0x7fdd101970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:10.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:10.244+0000 7fdd0ed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd10106540 0x7fdd101970c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57560/0 (socket says 172.21.15.92:57560) 2024-09-19T08:48:10.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:10.244+0000 7fdd0ed9d640 1 -- 172.21.15.92:0/644861130 learned_addr learned my addr 172.21.15.92:0/644861130 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:48:10.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:10.244+0000 7fdd0ed9d640 1 -- 172.21.15.92:0/644861130 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd10197600 con 0x7fdd10106540 2024-09-19T08:48:10.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:10.244+0000 7fdd0ed9d640 1 --2- 172.21.15.92:0/644861130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd10106540 0x7fdd101970c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdd000045e0 tx=0x7fdd00004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:10.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:10.244+0000 7fdcf7fff640 1 -- 172.21.15.92:0/644861130 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd00030e70 con 0x7fdd10106540 2024-09-19T08:48:10.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:10.244+0000 7fdcf7fff640 1 -- 172.21.15.92:0/644861130 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd000318e0 con 0x7fdd10106540 2024-09-19T08:48:10.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:10.244+0000 7fdd151b9640 1 -- 172.21.15.92:0/644861130 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd10197890 con 0x7fdd10106540 2024-09-19T08:48:10.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:10.244+0000 7fdcf7fff640 1 -- 172.21.15.92:0/644861130 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd000049c0 con 0x7fdd10106540 2024-09-19T08:48:10.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:10.244+0000 7fdd151b9640 1 -- 172.21.15.92:0/644861130 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd1019b990 con 0x7fdd10106540 2024-09-19T08:48:10.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:10.245+0000 7fdcf7fff640 1 -- 172.21.15.92:0/644861130 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fdd00039040 con 0x7fdd10106540 2024-09-19T08:48:10.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:10.245+0000 7fdcf7fff640 1 --2- 172.21.15.92:0/644861130 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdcf8039300 0x7fdcf803b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:10.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:10.245+0000 7fdcf7fff640 1 -- 172.21.15.92:0/644861130 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fdd0006d570 con 0x7fdd10106540 2024-09-19T08:48:10.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:10.245+0000 7fdd151b9640 1 -- 172.21.15.92:0/644861130 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd10101bb0 con 0x7fdd10106540 2024-09-19T08:48:10.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:10.246+0000 7fdd0e59c640 1 --2- 172.21.15.92:0/644861130 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdcf8039300 0x7fdcf803b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:10.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:10.246+0000 7fdd0e59c640 1 --2- 172.21.15.92:0/644861130 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdcf8039300 0x7fdcf803b7c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fdd040098c0 tx=0x7fdd04006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:10.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:10.250+0000 7fdcf7fff640 1 -- 172.21.15.92:0/644861130 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdd00040030 con 0x7fdd10106540 2024-09-19T08:48:10.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:10.421+0000 7fdd151b9640 1 -- 172.21.15.92:0/644861130 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi190", "target": ["mon-mgr", ""]}) -- 0x7fdd10106a00 con 0x7fdcf8039300 2024-09-19T08:48:11.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:11 smithi092 ceph-mon[31407]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi190", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:48:11.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:11 smithi092 ceph-mon[31407]: Deploying cephadm binary to smithi190 2024-09-19T08:48:13.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:12 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:13.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:12 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:13.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:12 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:13.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:12 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:13.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:12 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi167", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:48:13.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:12 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:13.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:12 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:13.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:12 smithi092 ceph-mon[31407]: Updating smithi167:/etc/ceph/ceph.conf 2024-09-19T08:48:13.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:12 smithi092 ceph-mon[31407]: Updating smithi167:/var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:48:13.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:12 smithi092 ceph-mon[31407]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:13.596 INFO:teuthology.orchestra.run.smithi092.stdout:Added host 'smithi190' with addr '172.21.15.190' 2024-09-19T08:48:13.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:13.595+0000 7fdcf7fff640 1 -- 172.21.15.92:0/644861130 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fdd10106a00 con 0x7fdcf8039300 2024-09-19T08:48:13.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:13.597+0000 7fdd151b9640 1 -- 172.21.15.92:0/644861130 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdcf8039300 msgr2=0x7fdcf803b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:13.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:13.597+0000 7fdd151b9640 1 --2- 172.21.15.92:0/644861130 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdcf8039300 0x7fdcf803b7c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fdd040098c0 tx=0x7fdd04006db0 comp rx=0 tx=0).stop 2024-09-19T08:48:13.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:13.597+0000 7fdd151b9640 1 -- 172.21.15.92:0/644861130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd10106540 msgr2=0x7fdd101970c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:13.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:13.597+0000 7fdd151b9640 1 --2- 172.21.15.92:0/644861130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd10106540 0x7fdd101970c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdd000045e0 tx=0x7fdd00004610 comp rx=0 tx=0).stop 2024-09-19T08:48:13.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:13.597+0000 7fdd151b9640 1 -- 172.21.15.92:0/644861130 shutdown_connections 2024-09-19T08:48:13.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:13.597+0000 7fdd151b9640 1 --2- 172.21.15.92:0/644861130 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdcf8039300 0x7fdcf803b7c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:13.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:13.597+0000 7fdd151b9640 1 --2- 172.21.15.92:0/644861130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd10106540 0x7fdd101970c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:13.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:13.597+0000 7fdd151b9640 1 -- 172.21.15.92:0/644861130 >> 172.21.15.92:0/644861130 conn(0x7fdd10077310 msgr2=0x7fdd100696b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:13.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:13.598+0000 7fdd151b9640 1 -- 172.21.15.92:0/644861130 shutdown_connections 2024-09-19T08:48:13.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:13.598+0000 7fdd151b9640 1 -- 172.21.15.92:0/644861130 wait complete. 2024-09-19T08:48:14.124 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T08:48:14.363 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:48:14.621 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:14 smithi092 ceph-mon[31407]: Updating smithi167:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:48:14.621 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:14 smithi092 ceph-mon[31407]: Updating smithi167:/var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:48:14.621 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:14 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:14.621 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:14 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:14.621 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:14 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:14.621 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:14 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:14.621 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:14 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:14.621 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:14 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:14.622 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:14 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:14.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.806+0000 7f9f80b6b640 1 -- 172.21.15.92:0/1198690132 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f7c106560 msgr2=0x7f9f7c106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:14.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.806+0000 7f9f80b6b640 1 --2- 172.21.15.92:0/1198690132 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f7c106560 0x7f9f7c106940 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c009880 tx=0x7f9f6c02a5d0 comp rx=0 tx=0).stop 2024-09-19T08:48:14.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.806+0000 7f9f80b6b640 1 -- 172.21.15.92:0/1198690132 shutdown_connections 2024-09-19T08:48:14.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.806+0000 7f9f80b6b640 1 --2- 172.21.15.92:0/1198690132 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f7c106560 0x7f9f7c106940 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:14.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.806+0000 7f9f80b6b640 1 -- 172.21.15.92:0/1198690132 >> 172.21.15.92:0/1198690132 conn(0x7f9f7c0fc1b0 msgr2=0x7f9f7c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:14.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.806+0000 7f9f80b6b640 1 -- 172.21.15.92:0/1198690132 shutdown_connections 2024-09-19T08:48:14.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.806+0000 7f9f80b6b640 1 -- 172.21.15.92:0/1198690132 wait complete. 2024-09-19T08:48:14.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.807+0000 7f9f80b6b640 1 Processor -- start 2024-09-19T08:48:14.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.807+0000 7f9f80b6b640 1 -- start start 2024-09-19T08:48:14.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.807+0000 7f9f80b6b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f7c106560 0x7f9f7c197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:14.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.807+0000 7f9f80b6b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7c10ab90 con 0x7f9f7c106560 2024-09-19T08:48:14.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.807+0000 7f9f7a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f7c106560 0x7f9f7c197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:14.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.807+0000 7f9f7a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f7c106560 0x7f9f7c197fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50274/0 (socket says 172.21.15.92:50274) 2024-09-19T08:48:14.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.807+0000 7f9f7a59c640 1 -- 172.21.15.92:0/879389834 learned_addr learned my addr 172.21.15.92:0/879389834 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:48:14.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.807+0000 7f9f7a59c640 1 -- 172.21.15.92:0/879389834 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f7c1984e0 con 0x7f9f7c106560 2024-09-19T08:48:14.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.807+0000 7f9f7a59c640 1 --2- 172.21.15.92:0/879389834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f7c106560 0x7f9f7c197fa0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c009230 tx=0x7f9f6c003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:14.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.807+0000 7f9f737fe640 1 -- 172.21.15.92:0/879389834 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f6c03f070 con 0x7f9f7c106560 2024-09-19T08:48:14.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.808+0000 7f9f737fe640 1 -- 172.21.15.92:0/879389834 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f6c03bc80 con 0x7f9f7c106560 2024-09-19T08:48:14.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.808+0000 7f9f80b6b640 1 -- 172.21.15.92:0/879389834 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f7c198770 con 0x7f9f7c106560 2024-09-19T08:48:14.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.808+0000 7f9f737fe640 1 -- 172.21.15.92:0/879389834 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f6c035030 con 0x7f9f7c106560 2024-09-19T08:48:14.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.808+0000 7f9f80b6b640 1 -- 172.21.15.92:0/879389834 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f7c198bd0 con 0x7f9f7c106560 2024-09-19T08:48:14.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.808+0000 7f9f737fe640 1 -- 172.21.15.92:0/879389834 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f9f6c042070 con 0x7f9f7c106560 2024-09-19T08:48:14.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.808+0000 7f9f737fe640 1 --2- 172.21.15.92:0/879389834 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9f680392a0 0x7f9f6803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:14.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.809+0000 7f9f737fe640 1 -- 172.21.15.92:0/879389834 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f9f6c03b7a0 con 0x7f9f7c106560 2024-09-19T08:48:14.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.809+0000 7f9f73fff640 1 --2- 172.21.15.92:0/879389834 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9f680392a0 0x7f9f6803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:14.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.809+0000 7f9f80b6b640 1 -- 172.21.15.92:0/879389834 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f7c101bd0 con 0x7f9f7c106560 2024-09-19T08:48:14.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.809+0000 7f9f73fff640 1 --2- 172.21.15.92:0/879389834 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9f680392a0 0x7f9f6803b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9f640098c0 tx=0x7f9f64006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:14.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.814+0000 7f9f737fe640 1 -- 172.21.15.92:0/879389834 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9f6c0314c0 con 0x7f9f7c106560 2024-09-19T08:48:14.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.984+0000 7f9f80b6b640 1 -- 172.21.15.92:0/879389834 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9f7c1069c0 con 0x7f9f680392a0 2024-09-19T08:48:14.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.985+0000 7f9f737fe640 1 -- 172.21.15.92:0/879389834 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7f9f7c1069c0 con 0x7f9f680392a0 2024-09-19T08:48:14.985 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:48:14.985 INFO:teuthology.orchestra.run.smithi092.stdout:[{"addr": "172.21.15.92", "hostname": "smithi092", "labels": [], "status": ""}, {"addr": "172.21.15.167", "hostname": "smithi167", "labels": [], "status": ""}, {"addr": "172.21.15.190", "hostname": "smithi190", "labels": [], "status": ""}] 2024-09-19T08:48:14.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.987+0000 7f9f80b6b640 1 -- 172.21.15.92:0/879389834 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9f680392a0 msgr2=0x7f9f6803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:14.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.987+0000 7f9f80b6b640 1 --2- 172.21.15.92:0/879389834 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9f680392a0 0x7f9f6803b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9f640098c0 tx=0x7f9f64006db0 comp rx=0 tx=0).stop 2024-09-19T08:48:14.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.987+0000 7f9f80b6b640 1 -- 172.21.15.92:0/879389834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f7c106560 msgr2=0x7f9f7c197fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:14.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.987+0000 7f9f80b6b640 1 --2- 172.21.15.92:0/879389834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f7c106560 0x7f9f7c197fa0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c009230 tx=0x7f9f6c003d40 comp rx=0 tx=0).stop 2024-09-19T08:48:14.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.987+0000 7f9f80b6b640 1 -- 172.21.15.92:0/879389834 shutdown_connections 2024-09-19T08:48:14.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.987+0000 7f9f80b6b640 1 --2- 172.21.15.92:0/879389834 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9f680392a0 0x7f9f6803b760 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:14.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.987+0000 7f9f80b6b640 1 --2- 172.21.15.92:0/879389834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f7c106560 0x7f9f7c197fa0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:14.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.987+0000 7f9f80b6b640 1 -- 172.21.15.92:0/879389834 >> 172.21.15.92:0/879389834 conn(0x7f9f7c0fc1b0 msgr2=0x7f9f7c0fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:14.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.987+0000 7f9f80b6b640 1 -- 172.21.15.92:0/879389834 shutdown_connections 2024-09-19T08:48:14.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:14.987+0000 7f9f80b6b640 1 -- 172.21.15.92:0/879389834 wait complete. 2024-09-19T08:48:15.570 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:15 smithi092 ceph-mon[31407]: Added host smithi190 2024-09-19T08:48:15.570 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:15 smithi092 ceph-mon[31407]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:15.570 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:15 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:15.597 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-19T08:48:15.597 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-19T08:48:15.833 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:48:16.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:16.246+0000 7fa559f17640 1 -- 172.21.15.92:0/4235643660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa554106540 msgr2=0x7fa554106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:16.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:16.246+0000 7fa559f17640 1 --2- 172.21.15.92:0/4235643660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa554106540 0x7fa554106920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa544009810 tx=0x7fa54402a540 comp rx=0 tx=0).stop 2024-09-19T08:48:16.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:16.246+0000 7fa559f17640 1 -- 172.21.15.92:0/4235643660 shutdown_connections 2024-09-19T08:48:16.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:16.246+0000 7fa559f17640 1 --2- 172.21.15.92:0/4235643660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa554106540 0x7fa554106920 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:16.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:16.246+0000 7fa559f17640 1 -- 172.21.15.92:0/4235643660 >> 172.21.15.92:0/4235643660 conn(0x7fa554077310 msgr2=0x7fa5540fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:16.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:16.246+0000 7fa559f17640 1 -- 172.21.15.92:0/4235643660 shutdown_connections 2024-09-19T08:48:16.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:16.246+0000 7fa559f17640 1 -- 172.21.15.92:0/4235643660 wait complete. 2024-09-19T08:48:16.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:16.246+0000 7fa559f17640 1 Processor -- start 2024-09-19T08:48:16.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:16.247+0000 7fa559f17640 1 -- start start 2024-09-19T08:48:16.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:16.247+0000 7fa559f17640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa554106540 0x7fa554197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:16.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:16.247+0000 7fa559f17640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa55410ab70 con 0x7fa554106540 2024-09-19T08:48:16.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:16.247+0000 7fa5537fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa554106540 0x7fa554197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:16.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:16.247+0000 7fa5537fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa554106540 0x7fa554197fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50288/0 (socket says 172.21.15.92:50288) 2024-09-19T08:48:16.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:16.247+0000 7fa5537fe640 1 -- 172.21.15.92:0/297279324 learned_addr learned my addr 172.21.15.92:0/297279324 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:48:16.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:16.247+0000 7fa5537fe640 1 -- 172.21.15.92:0/297279324 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa554198510 con 0x7fa554106540 2024-09-19T08:48:16.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:16.247+0000 7fa5537fe640 1 --2- 172.21.15.92:0/297279324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa554106540 0x7fa554197fd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa5440045e0 tx=0x7fa544004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:16.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:16.247+0000 7fa5517fa640 1 -- 172.21.15.92:0/297279324 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa544030e70 con 0x7fa554106540 2024-09-19T08:48:16.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:16.247+0000 7fa5517fa640 1 -- 172.21.15.92:0/297279324 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa5440318e0 con 0x7fa554106540 2024-09-19T08:48:16.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:16.247+0000 7fa559f17640 1 -- 172.21.15.92:0/297279324 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5541987a0 con 0x7fa554106540 2024-09-19T08:48:16.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:16.247+0000 7fa5517fa640 1 -- 172.21.15.92:0/297279324 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5440049c0 con 0x7fa554106540 2024-09-19T08:48:16.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:16.247+0000 7fa559f17640 1 -- 172.21.15.92:0/297279324 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa554198c00 con 0x7fa554106540 2024-09-19T08:48:16.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:16.248+0000 7fa5517fa640 1 -- 172.21.15.92:0/297279324 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fa544039040 con 0x7fa554106540 2024-09-19T08:48:16.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:16.248+0000 7fa5517fa640 1 --2- 172.21.15.92:0/297279324 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa5400392a0 0x7fa54003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:16.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:16.248+0000 7fa559f17640 1 -- 172.21.15.92:0/297279324 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa554101bb0 con 0x7fa554106540 2024-09-19T08:48:16.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:16.249+0000 7fa5517fa640 1 -- 172.21.15.92:0/297279324 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa54406d590 con 0x7fa554106540 2024-09-19T08:48:16.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:16.249+0000 7fa54bfff640 1 --2- 172.21.15.92:0/297279324 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa5400392a0 0x7fa54003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:16.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:16.249+0000 7fa54bfff640 1 --2- 172.21.15.92:0/297279324 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa5400392a0 0x7fa54003b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa53c0098c0 tx=0x7fa53c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:16.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:16.253+0000 7fa5517fa640 1 -- 172.21.15.92:0/297279324 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa544040030 con 0x7fa554106540 2024-09-19T08:48:16.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:16.425+0000 7fa559f17640 1 -- 172.21.15.92:0/297279324 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fa5541069a0 con 0x7fa554106540 2024-09-19T08:48:16.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:16 smithi092 ceph-mon[31407]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:48:17.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:17.374+0000 7fa5517fa640 1 -- 172.21.15.92:0/297279324 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7fa54403ae40 con 0x7fa554106540 2024-09-19T08:48:17.374 INFO:teuthology.orchestra.run.smithi092.stderr:adjusted tunables profile to default 2024-09-19T08:48:17.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:17.377+0000 7fa559f17640 1 -- 172.21.15.92:0/297279324 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa5400392a0 msgr2=0x7fa54003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:17.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:17.377+0000 7fa559f17640 1 --2- 172.21.15.92:0/297279324 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa5400392a0 0x7fa54003b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa53c0098c0 tx=0x7fa53c006db0 comp rx=0 tx=0).stop 2024-09-19T08:48:17.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:17.377+0000 7fa559f17640 1 -- 172.21.15.92:0/297279324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa554106540 msgr2=0x7fa554197fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:17.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:17.377+0000 7fa559f17640 1 --2- 172.21.15.92:0/297279324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa554106540 0x7fa554197fd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa5440045e0 tx=0x7fa544004610 comp rx=0 tx=0).stop 2024-09-19T08:48:17.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:17.377+0000 7fa559f17640 1 -- 172.21.15.92:0/297279324 shutdown_connections 2024-09-19T08:48:17.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:17.377+0000 7fa559f17640 1 --2- 172.21.15.92:0/297279324 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa5400392a0 0x7fa54003b760 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:17.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:17.377+0000 7fa559f17640 1 --2- 172.21.15.92:0/297279324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa554106540 0x7fa554197fd0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:17.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:17.377+0000 7fa559f17640 1 -- 172.21.15.92:0/297279324 >> 172.21.15.92:0/297279324 conn(0x7fa554077310 msgr2=0x7fa5540fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:17.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:17.377+0000 7fa559f17640 1 -- 172.21.15.92:0/297279324 shutdown_connections 2024-09-19T08:48:17.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:17.377+0000 7fa559f17640 1 -- 172.21.15.92:0/297279324 wait complete. 2024-09-19T08:48:17.677 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:17 smithi092 ceph-mon[31407]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:17.677 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:17 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/297279324' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T08:48:17.961 INFO:tasks.cephadm:Adding mon.a on smithi092 2024-09-19T08:48:17.962 INFO:tasks.cephadm:Adding mon.b on smithi167 2024-09-19T08:48:17.962 INFO:tasks.cephadm:Adding mon.c on smithi190 2024-09-19T08:48:17.962 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi092:172.21.15.92=a;smithi167:172.21.15.167=b;smithi190:172.21.15.190=c' 2024-09-19T08:48:18.206 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T08:48:18.252 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T08:48:18.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:18 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/297279324' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T08:48:18.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:18 smithi092 ceph-mon[31407]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:48:18.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:18 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:18.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:18 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:18.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:18 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:18.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:18 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:18.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:18 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi190", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:48:18.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:18 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:18.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:18 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:18.799 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.760+0000 7fef44293640 1 -- 172.21.15.190:0/3293896192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef3c102730 msgr2=0x7fef3c102b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:18.799 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.760+0000 7fef44293640 1 --2- 172.21.15.190:0/3293896192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef3c102730 0x7fef3c102b10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fef38009810 tx=0x7fef3802a540 comp rx=0 tx=0).stop 2024-09-19T08:48:18.799 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.760+0000 7fef44293640 1 -- 172.21.15.190:0/3293896192 shutdown_connections 2024-09-19T08:48:18.799 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.760+0000 7fef44293640 1 --2- 172.21.15.190:0/3293896192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef3c102730 0x7fef3c102b10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:18.800 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.760+0000 7fef44293640 1 -- 172.21.15.190:0/3293896192 >> 172.21.15.190:0/3293896192 conn(0x7fef3c077310 msgr2=0x7fef3c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:18.800 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.760+0000 7fef44293640 1 -- 172.21.15.190:0/3293896192 shutdown_connections 2024-09-19T08:48:18.800 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.760+0000 7fef44293640 1 -- 172.21.15.190:0/3293896192 wait complete. 2024-09-19T08:48:18.800 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.761+0000 7fef44293640 1 Processor -- start 2024-09-19T08:48:18.800 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.761+0000 7fef44293640 1 -- start start 2024-09-19T08:48:18.800 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.761+0000 7fef44293640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef3c102730 0x7fef3c1971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:18.800 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.761+0000 7fef44293640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fef3c10bc80 con 0x7fef3c102730 2024-09-19T08:48:18.800 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.761+0000 7fef4202f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef3c102730 0x7fef3c1971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:18.800 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.761+0000 7fef4202f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef3c102730 0x7fef3c1971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.190:59588/0 (socket says 172.21.15.190:59588) 2024-09-19T08:48:18.800 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.761+0000 7fef4202f640 1 -- 172.21.15.190:0/2456540432 learned_addr learned my addr 172.21.15.190:0/2456540432 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-09-19T08:48:18.800 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.761+0000 7fef4202f640 1 -- 172.21.15.190:0/2456540432 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef3c1976f0 con 0x7fef3c102730 2024-09-19T08:48:18.800 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.762+0000 7fef4202f640 1 --2- 172.21.15.190:0/2456540432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef3c102730 0x7fef3c1971b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fef380045e0 tx=0x7fef38004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:18.800 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.762+0000 7fef337fe640 1 -- 172.21.15.190:0/2456540432 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef38030e70 con 0x7fef3c102730 2024-09-19T08:48:18.801 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.762+0000 7fef44293640 1 -- 172.21.15.190:0/2456540432 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef3c197980 con 0x7fef3c102730 2024-09-19T08:48:18.801 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.762+0000 7fef337fe640 1 -- 172.21.15.190:0/2456540432 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef380318e0 con 0x7fef3c102730 2024-09-19T08:48:18.801 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.762+0000 7fef337fe640 1 -- 172.21.15.190:0/2456540432 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef380049c0 con 0x7fef3c102730 2024-09-19T08:48:18.801 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.762+0000 7fef44293640 1 -- 172.21.15.190:0/2456540432 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef3c197de0 con 0x7fef3c102730 2024-09-19T08:48:18.801 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.763+0000 7fef337fe640 1 -- 172.21.15.190:0/2456540432 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fef38039040 con 0x7fef3c102730 2024-09-19T08:48:18.801 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.763+0000 7fef44293640 1 -- 172.21.15.190:0/2456540432 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef3c069f90 con 0x7fef3c102730 2024-09-19T08:48:18.801 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.763+0000 7fef337fe640 1 --2- 172.21.15.190:0/2456540432 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fef280392a0 0x7fef2803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:18.801 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.763+0000 7fef337fe640 1 -- 172.21.15.190:0/2456540432 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fef3806d610 con 0x7fef3c102730 2024-09-19T08:48:18.801 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.763+0000 7fef4182e640 1 --2- 172.21.15.190:0/2456540432 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fef280392a0 0x7fef2803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:18.801 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.764+0000 7fef4182e640 1 --2- 172.21.15.190:0/2456540432 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fef280392a0 0x7fef2803b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fef2c0098c0 tx=0x7fef2c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:18.801 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.768+0000 7fef337fe640 1 -- 172.21.15.190:0/2456540432 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fef38040030 con 0x7fef3c102730 2024-09-19T08:48:18.948 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.948+0000 7fef44293640 1 -- 172.21.15.190:0/2456540432 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi092:172.21.15.92=a;smithi167:172.21.15.167=b;smithi190:172.21.15.190=c", "target": ["mon-mgr", ""]}) -- 0x7fef3c106be0 con 0x7fef280392a0 2024-09-19T08:48:18.952 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.952+0000 7fef337fe640 1 -- 172.21.15.190:0/2456540432 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fef3c106be0 con 0x7fef280392a0 2024-09-19T08:48:18.952 INFO:teuthology.orchestra.run.smithi190.stdout:Scheduled mon update... 2024-09-19T08:48:18.955 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.955+0000 7fef44293640 1 -- 172.21.15.190:0/2456540432 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fef280392a0 msgr2=0x7fef2803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:18.955 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.955+0000 7fef44293640 1 --2- 172.21.15.190:0/2456540432 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fef280392a0 0x7fef2803b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fef2c0098c0 tx=0x7fef2c006db0 comp rx=0 tx=0).stop 2024-09-19T08:48:18.955 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.955+0000 7fef44293640 1 -- 172.21.15.190:0/2456540432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef3c102730 msgr2=0x7fef3c1971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:18.955 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.955+0000 7fef44293640 1 --2- 172.21.15.190:0/2456540432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef3c102730 0x7fef3c1971b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fef380045e0 tx=0x7fef38004610 comp rx=0 tx=0).stop 2024-09-19T08:48:18.955 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.955+0000 7fef44293640 1 -- 172.21.15.190:0/2456540432 shutdown_connections 2024-09-19T08:48:18.955 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.955+0000 7fef44293640 1 --2- 172.21.15.190:0/2456540432 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fef280392a0 0x7fef2803b760 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:18.955 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.955+0000 7fef44293640 1 --2- 172.21.15.190:0/2456540432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef3c102730 0x7fef3c1971b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:18.955 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.955+0000 7fef44293640 1 -- 172.21.15.190:0/2456540432 >> 172.21.15.190:0/2456540432 conn(0x7fef3c077310 msgr2=0x7fef3c1054c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:18.955 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.955+0000 7fef44293640 1 -- 172.21.15.190:0/2456540432 shutdown_connections 2024-09-19T08:48:18.955 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:18.955+0000 7fef44293640 1 -- 172.21.15.190:0/2456540432 wait complete. 2024-09-19T08:48:19.515 DEBUG:teuthology.orchestra.run.smithi167:mon.b> sudo journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mon.b.service 2024-09-19T08:48:19.520 DEBUG:teuthology.orchestra.run.smithi190:mon.c> sudo journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mon.c.service 2024-09-19T08:48:19.523 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T08:48:19.524 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:48:19.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:19 smithi092 ceph-mon[31407]: Updating smithi190:/etc/ceph/ceph.conf 2024-09-19T08:48:19.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:19 smithi092 ceph-mon[31407]: Updating smithi190:/var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:48:19.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:19 smithi092 ceph-mon[31407]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:19.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:19 smithi092 ceph-mon[31407]: Updating smithi190:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:48:19.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:19 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:19.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:19 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:19.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:19 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:19.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:19 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:19.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:19 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:19.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:19 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:19.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:19 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:19.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:19 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:19.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:19 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:48:19.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:19 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:20.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:20 smithi092 ceph-mon[31407]: Updating smithi190:/var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:48:20.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:20 smithi092 ceph-mon[31407]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi092:172.21.15.92=a;smithi167:172.21.15.167=b;smithi190:172.21.15.190=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:48:20.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:20 smithi092 ceph-mon[31407]: Saving service mon spec with placement smithi092:172.21.15.92=a;smithi167:172.21.15.167=b;smithi190:172.21.15.190=c;count:3 2024-09-19T08:48:20.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:20 smithi092 ceph-mon[31407]: Deploying daemon mon.c on smithi190 2024-09-19T08:48:21.748 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:48:21.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:21 smithi092 ceph-mon[31407]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:22.335 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.319+0000 7f64c6a9a640 1 -- 172.21.15.190:0/1349476736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64c0106650 msgr2=0x7f64c0106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:22.335 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.319+0000 7f64c6a9a640 1 --2- 172.21.15.190:0/1349476736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64c0106650 0x7f64c0106a30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f64b4009880 tx=0x7f64b402a5d0 comp rx=0 tx=0).stop 2024-09-19T08:48:22.335 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.319+0000 7f64c6a9a640 1 -- 172.21.15.190:0/1349476736 shutdown_connections 2024-09-19T08:48:22.336 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.319+0000 7f64c6a9a640 1 --2- 172.21.15.190:0/1349476736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64c0106650 0x7f64c0106a30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:22.336 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.319+0000 7f64c6a9a640 1 -- 172.21.15.190:0/1349476736 >> 172.21.15.190:0/1349476736 conn(0x7f64c00fc280 msgr2=0x7f64c00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:22.336 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.319+0000 7f64c6a9a640 1 -- 172.21.15.190:0/1349476736 shutdown_connections 2024-09-19T08:48:22.336 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.319+0000 7f64c6a9a640 1 -- 172.21.15.190:0/1349476736 wait complete. 2024-09-19T08:48:22.336 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.320+0000 7f64c6a9a640 1 Processor -- start 2024-09-19T08:48:22.336 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.320+0000 7f64c6a9a640 1 -- start start 2024-09-19T08:48:22.336 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.320+0000 7f64c6a9a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64c0106650 0x7f64c0197200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:22.336 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.320+0000 7f64c6a9a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f64c010ac80 con 0x7f64c0106650 2024-09-19T08:48:22.336 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.320+0000 7f64c4836640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64c0106650 0x7f64c0197200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:22.336 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.320+0000 7f64c4836640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64c0106650 0x7f64c0197200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.190:59608/0 (socket says 172.21.15.190:59608) 2024-09-19T08:48:22.336 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.320+0000 7f64c4836640 1 -- 172.21.15.190:0/2361231063 learned_addr learned my addr 172.21.15.190:0/2361231063 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-09-19T08:48:22.337 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.321+0000 7f64c4836640 1 -- 172.21.15.190:0/2361231063 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64c0197740 con 0x7f64c0106650 2024-09-19T08:48:22.337 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.321+0000 7f64c4836640 1 --2- 172.21.15.190:0/2361231063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64c0106650 0x7f64c0197200 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f64b4009230 tx=0x7f64b4003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:22.337 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.321+0000 7f64bdffb640 1 -- 172.21.15.190:0/2361231063 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64b403f070 con 0x7f64c0106650 2024-09-19T08:48:22.337 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.321+0000 7f64c6a9a640 1 -- 172.21.15.190:0/2361231063 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64c01979d0 con 0x7f64c0106650 2024-09-19T08:48:22.337 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.321+0000 7f64bdffb640 1 -- 172.21.15.190:0/2361231063 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f64b403bc80 con 0x7f64c0106650 2024-09-19T08:48:22.337 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.321+0000 7f64bdffb640 1 -- 172.21.15.190:0/2361231063 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64b4035030 con 0x7f64c0106650 2024-09-19T08:48:22.337 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.321+0000 7f64c6a9a640 1 -- 172.21.15.190:0/2361231063 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64c019bad0 con 0x7f64c0106650 2024-09-19T08:48:22.337 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.322+0000 7f64bdffb640 1 -- 172.21.15.190:0/2361231063 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f64b4042070 con 0x7f64c0106650 2024-09-19T08:48:22.337 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.322+0000 7f64c6a9a640 1 -- 172.21.15.190:0/2361231063 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64c0101cc0 con 0x7f64c0106650 2024-09-19T08:48:22.337 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.323+0000 7f64bdffb640 1 --2- 172.21.15.190:0/2361231063 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f64b00392a0 0x7f64b003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:22.337 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.323+0000 7f64bdffb640 1 -- 172.21.15.190:0/2361231063 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f64b406d120 con 0x7f64c0106650 2024-09-19T08:48:22.337 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.323+0000 7f64bffff640 1 --2- 172.21.15.190:0/2361231063 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f64b00392a0 0x7f64b003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:22.337 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.323+0000 7f64bffff640 1 --2- 172.21.15.190:0/2361231063 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f64b00392a0 0x7f64b003b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f64ac0098c0 tx=0x7f64ac006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:22.338 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.327+0000 7f64bdffb640 1 -- 172.21.15.190:0/2361231063 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f64b404c350 con 0x7f64c0106650 2024-09-19T08:48:22.579 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.579+0000 7f64c6a9a640 1 -- 172.21.15.190:0/2361231063 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f64c0198560 con 0x7f64c0106650 2024-09-19T08:48:22.579 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.580+0000 7f64bdffb640 1 -- 172.21.15.190:0/2361231063 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f64b4031e20 con 0x7f64c0106650 2024-09-19T08:48:22.580 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-19T08:48:22.580 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":1,"fsid":"91ff74f2-7663-11ef-bceb-c7b262605968","modified":"2024-09-19T08:47:04.662007Z","created":"2024-09-19T08:47:04.662007Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:3300","nonce":0},{"type":"v1","addr":"172.21.15.92:6789","nonce":0}]},"addr":"172.21.15.92:6789/0","public_addr":"172.21.15.92:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T08:48:22.580 INFO:teuthology.orchestra.run.smithi190.stderr:dumped monmap epoch 1 2024-09-19T08:48:22.584 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.584+0000 7f64c6a9a640 1 -- 172.21.15.190:0/2361231063 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f64b00392a0 msgr2=0x7f64b003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:22.585 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.584+0000 7f64c6a9a640 1 --2- 172.21.15.190:0/2361231063 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f64b00392a0 0x7f64b003b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f64ac0098c0 tx=0x7f64ac006db0 comp rx=0 tx=0).stop 2024-09-19T08:48:22.585 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.584+0000 7f64c6a9a640 1 -- 172.21.15.190:0/2361231063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64c0106650 msgr2=0x7f64c0197200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:22.585 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.584+0000 7f64c6a9a640 1 --2- 172.21.15.190:0/2361231063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64c0106650 0x7f64c0197200 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f64b4009230 tx=0x7f64b4003d40 comp rx=0 tx=0).stop 2024-09-19T08:48:22.585 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.584+0000 7f64c6a9a640 1 -- 172.21.15.190:0/2361231063 shutdown_connections 2024-09-19T08:48:22.585 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.584+0000 7f64c6a9a640 1 --2- 172.21.15.190:0/2361231063 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f64b00392a0 0x7f64b003b760 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:22.585 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.584+0000 7f64c6a9a640 1 --2- 172.21.15.190:0/2361231063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64c0106650 0x7f64c0197200 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:22.585 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.584+0000 7f64c6a9a640 1 -- 172.21.15.190:0/2361231063 >> 172.21.15.190:0/2361231063 conn(0x7f64c00fc280 msgr2=0x7f64c00fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:22.585 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.585+0000 7f64c6a9a640 1 -- 172.21.15.190:0/2361231063 shutdown_connections 2024-09-19T08:48:22.585 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:22.585+0000 7f64c6a9a640 1 -- 172.21.15.190:0/2361231063 wait complete. 2024-09-19T08:48:22.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:22 smithi190 systemd[1]: Starting Ceph mon.c for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T08:48:23.592 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 podman[35339]: 2024-09-19 08:48:23.226491172 +0000 UTC m=+0.015833220 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:48:23.592 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 podman[35339]: 2024-09-19 08:48:23.352637496 +0000 UTC m=+0.141979599 container create 5b05f588d6ae970d313367bb86c81ce23761cfeb36f423feb4ca417c4d1895ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mon-c, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4) 2024-09-19T08:48:23.592 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 podman[35339]: 2024-09-19 08:48:23.567828734 +0000 UTC m=+0.357170770 container init 5b05f588d6ae970d313367bb86c81ce23761cfeb36f423feb4ca417c4d1895ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mon-c, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS) 2024-09-19T08:48:23.592 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 podman[35339]: 2024-09-19 08:48:23.571002775 +0000 UTC m=+0.360344813 container start 5b05f588d6ae970d313367bb86c81ce23761cfeb36f423feb4ca417c4d1895ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mon-c, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-19T08:48:23.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:23 smithi092 ceph-mon[31407]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:23.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:23 smithi092 ceph-mon[31407]: from='client.? 172.21.15.190:0/2361231063' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:48:23.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T08:48:23.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T08:48:23.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: pidfile_write: ignore empty --pid-file 2024-09-19T08:48:23.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: load: jerasure load: lrc 2024-09-19T08:48:23.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: RocksDB version: 7.9.2 2024-09-19T08:48:23.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Git sha 0 2024-09-19T08:48:23.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T08:48:23.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: DB SUMMARY 2024-09-19T08:48:23.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: DB Session ID: J56RRX69H7LAIT73URSC 2024-09-19T08:48:23.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: CURRENT file: CURRENT 2024-09-19T08:48:23.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T08:48:23.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-19T08:48:23.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-19T08:48:23.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-19T08:48:23.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.error_if_exists: 0 2024-09-19T08:48:23.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.create_if_missing: 0 2024-09-19T08:48:23.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.paranoid_checks: 1 2024-09-19T08:48:23.876 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T08:48:23.876 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T08:48:23.876 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T08:48:23.876 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.env: 0x562f086a1940 2024-09-19T08:48:23.876 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T08:48:23.876 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.info_log: 0x562f092bd6e0 2024-09-19T08:48:23.876 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T08:48:23.876 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.statistics: (nil) 2024-09-19T08:48:23.876 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.use_fsync: 0 2024-09-19T08:48:23.876 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.max_log_file_size: 0 2024-09-19T08:48:23.876 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T08:48:23.876 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T08:48:23.877 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T08:48:23.877 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T08:48:23.877 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.allow_fallocate: 1 2024-09-19T08:48:23.877 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T08:48:23.877 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T08:48:23.877 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.use_direct_reads: 0 2024-09-19T08:48:23.877 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T08:48:23.877 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T08:48:23.877 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.db_log_dir: 2024-09-19T08:48:23.877 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.wal_dir: 2024-09-19T08:48:23.877 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T08:48:23.877 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T08:48:23.878 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T08:48:23.878 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T08:48:23.878 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T08:48:23.878 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T08:48:23.878 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T08:48:23.878 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T08:48:23.878 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.write_buffer_manager: 0x562f092ccdc0 2024-09-19T08:48:23.878 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T08:48:23.878 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T08:48:23.878 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T08:48:23.878 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T08:48:23.878 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T08:48:23.878 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T08:48:23.878 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T08:48:23.879 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T08:48:23.879 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.unordered_write: 0 2024-09-19T08:48:23.879 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T08:48:23.879 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T08:48:23.879 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T08:48:23.879 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T08:48:23.879 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.row_cache: None 2024-09-19T08:48:23.879 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.wal_filter: None 2024-09-19T08:48:23.879 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T08:48:23.879 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T08:48:23.879 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.two_write_queues: 0 2024-09-19T08:48:23.879 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T08:48:23.879 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.wal_compression: 0 2024-09-19T08:48:23.880 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.atomic_flush: 0 2024-09-19T08:48:23.880 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T08:48:23.880 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T08:48:23.880 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T08:48:23.880 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.log_readahead_size: 0 2024-09-19T08:48:23.880 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T08:48:23.880 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T08:48:23.880 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T08:48:23.880 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T08:48:23.880 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T08:48:23.880 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T08:48:23.880 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T08:48:23.882 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.max_background_jobs: 2 2024-09-19T08:48:23.882 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.max_background_compactions: -1 2024-09-19T08:48:23.882 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.max_subcompactions: 1 2024-09-19T08:48:23.882 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T08:48:23.882 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T08:48:23.882 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T08:48:23.882 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T08:48:23.882 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T08:48:23.882 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T08:48:23.883 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T08:48:23.883 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T08:48:23.883 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.max_open_files: -1 2024-09-19T08:48:23.883 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T08:48:23.883 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T08:48:23.883 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T08:48:23.883 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T08:48:23.883 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.max_background_flushes: -1 2024-09-19T08:48:23.883 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Compression algorithms supported: 2024-09-19T08:48:23.883 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: kZSTD supported: 0 2024-09-19T08:48:23.883 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: kXpressCompression supported: 0 2024-09-19T08:48:23.883 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: kBZip2Compression supported: 0 2024-09-19T08:48:23.883 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T08:48:23.884 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: kLZ4Compression supported: 1 2024-09-19T08:48:23.884 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: kZlibCompression supported: 1 2024-09-19T08:48:23.884 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T08:48:23.884 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: kSnappyCompression supported: 1 2024-09-19T08:48:23.884 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T08:48:23.884 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T08:48:23.884 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-19T08:48:23.884 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T08:48:23.884 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T08:48:23.884 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.merge_operator: 2024-09-19T08:48:23.884 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.compaction_filter: None 2024-09-19T08:48:23.884 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T08:48:23.885 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T08:48:23.885 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T08:48:23.885 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T08:48:23.885 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562f092bd320) 2024-09-19T08:48:23.885 INFO:journalctl@ceph.mon.c.smithi190.stdout: cache_index_and_filter_blocks: 1 2024-09-19T08:48:23.885 INFO:journalctl@ceph.mon.c.smithi190.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T08:48:23.885 INFO:journalctl@ceph.mon.c.smithi190.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T08:48:23.885 INFO:journalctl@ceph.mon.c.smithi190.stdout: pin_top_level_index_and_filter: 1 2024-09-19T08:48:23.885 INFO:journalctl@ceph.mon.c.smithi190.stdout: index_type: 0 2024-09-19T08:48:23.885 INFO:journalctl@ceph.mon.c.smithi190.stdout: data_block_index_type: 0 2024-09-19T08:48:23.886 INFO:journalctl@ceph.mon.c.smithi190.stdout: index_shortening: 1 2024-09-19T08:48:23.886 INFO:journalctl@ceph.mon.c.smithi190.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T08:48:23.886 INFO:journalctl@ceph.mon.c.smithi190.stdout: checksum: 4 2024-09-19T08:48:23.886 INFO:journalctl@ceph.mon.c.smithi190.stdout: no_block_cache: 0 2024-09-19T08:48:23.886 INFO:journalctl@ceph.mon.c.smithi190.stdout: block_cache: 0x562f092b11f0 2024-09-19T08:48:23.886 INFO:journalctl@ceph.mon.c.smithi190.stdout: block_cache_name: BinnedLRUCache 2024-09-19T08:48:23.886 INFO:journalctl@ceph.mon.c.smithi190.stdout: block_cache_options: 2024-09-19T08:48:23.886 INFO:journalctl@ceph.mon.c.smithi190.stdout: capacity : 536870912 2024-09-19T08:48:23.886 INFO:journalctl@ceph.mon.c.smithi190.stdout: num_shard_bits : 4 2024-09-19T08:48:23.886 INFO:journalctl@ceph.mon.c.smithi190.stdout: strict_capacity_limit : 0 2024-09-19T08:48:23.886 INFO:journalctl@ceph.mon.c.smithi190.stdout: high_pri_pool_ratio: 0.000 2024-09-19T08:48:23.886 INFO:journalctl@ceph.mon.c.smithi190.stdout: block_cache_compressed: (nil) 2024-09-19T08:48:23.887 INFO:journalctl@ceph.mon.c.smithi190.stdout: persistent_cache: (nil) 2024-09-19T08:48:23.887 INFO:journalctl@ceph.mon.c.smithi190.stdout: block_size: 4096 2024-09-19T08:48:23.887 INFO:journalctl@ceph.mon.c.smithi190.stdout: block_size_deviation: 10 2024-09-19T08:48:23.887 INFO:journalctl@ceph.mon.c.smithi190.stdout: block_restart_interval: 16 2024-09-19T08:48:23.887 INFO:journalctl@ceph.mon.c.smithi190.stdout: index_block_restart_interval: 1 2024-09-19T08:48:23.887 INFO:journalctl@ceph.mon.c.smithi190.stdout: metadata_block_size: 4096 2024-09-19T08:48:23.887 INFO:journalctl@ceph.mon.c.smithi190.stdout: partition_filters: 0 2024-09-19T08:48:23.887 INFO:journalctl@ceph.mon.c.smithi190.stdout: use_delta_encoding: 1 2024-09-19T08:48:23.887 INFO:journalctl@ceph.mon.c.smithi190.stdout: filter_policy: bloomfilter 2024-09-19T08:48:23.887 INFO:journalctl@ceph.mon.c.smithi190.stdout: whole_key_filtering: 1 2024-09-19T08:48:23.887 INFO:journalctl@ceph.mon.c.smithi190.stdout: verify_compression: 0 2024-09-19T08:48:23.887 INFO:journalctl@ceph.mon.c.smithi190.stdout: read_amp_bytes_per_bit: 0 2024-09-19T08:48:23.887 INFO:journalctl@ceph.mon.c.smithi190.stdout: format_version: 5 2024-09-19T08:48:23.888 INFO:journalctl@ceph.mon.c.smithi190.stdout: enable_index_compression: 1 2024-09-19T08:48:23.888 INFO:journalctl@ceph.mon.c.smithi190.stdout: block_align: 0 2024-09-19T08:48:23.888 INFO:journalctl@ceph.mon.c.smithi190.stdout: max_auto_readahead_size: 262144 2024-09-19T08:48:23.888 INFO:journalctl@ceph.mon.c.smithi190.stdout: prepopulate_block_cache: 0 2024-09-19T08:48:23.888 INFO:journalctl@ceph.mon.c.smithi190.stdout: initial_auto_readahead_size: 8192 2024-09-19T08:48:23.888 INFO:journalctl@ceph.mon.c.smithi190.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T08:48:23.888 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T08:48:23.888 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T08:48:23.888 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.compression: NoCompression 2024-09-19T08:48:23.888 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T08:48:23.888 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T08:48:23.888 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T08:48:23.888 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.num_levels: 7 2024-09-19T08:48:23.889 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T08:48:23.889 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T08:48:23.889 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T08:48:23.889 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T08:48:23.889 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T08:48:23.889 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T08:48:23.889 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T08:48:23.889 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T08:48:23.889 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T08:48:23.889 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T08:48:23.889 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T08:48:23.889 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T08:48:23.889 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T08:48:23.890 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T08:48:23.890 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T08:48:23.890 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T08:48:23.890 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T08:48:23.890 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T08:48:23.890 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T08:48:23.890 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T08:48:23.890 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T08:48:23.890 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T08:48:23.890 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T08:48:23.890 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T08:48:23.890 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T08:48:23.890 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T08:48:23.890 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T08:48:23.891 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T08:48:23.891 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T08:48:23.891 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T08:48:23.891 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T08:48:23.891 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T08:48:23.891 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T08:48:23.891 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T08:48:23.891 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T08:48:23.891 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T08:48:23.891 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T08:48:23.891 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T08:48:23.891 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T08:48:23.891 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T08:48:23.892 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T08:48:23.892 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T08:48:23.892 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T08:48:23.892 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T08:48:23.892 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T08:48:23.892 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T08:48:23.892 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T08:48:23.892 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T08:48:23.892 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T08:48:23.892 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T08:48:23.892 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T08:48:23.892 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T08:48:23.892 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T08:48:23.893 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T08:48:23.893 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.inplace_update_support: 0 2024-09-19T08:48:23.893 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T08:48:23.893 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T08:48:23.893 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T08:48:23.893 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T08:48:23.893 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.bloom_locality: 0 2024-09-19T08:48:23.893 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.max_successive_merges: 0 2024-09-19T08:48:23.893 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T08:48:23.893 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T08:48:23.893 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T08:48:23.893 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T08:48:23.893 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.ttl: 2592000 2024-09-19T08:48:23.893 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T08:48:23.894 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T08:48:23.894 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T08:48:23.894 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.enable_blob_files: false 2024-09-19T08:48:23.894 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.min_blob_size: 0 2024-09-19T08:48:23.894 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T08:48:23.894 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T08:48:23.894 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T08:48:23.894 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T08:48:23.894 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T08:48:23.894 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T08:48:23.894 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T08:48:23.894 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T08:48:23.894 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-19T08:48:23.894 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-19T08:48:23.895 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 8b627459-1e2f-424c-a836-65e8ed2313ba 2024-09-19T08:48:23.895 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726735703598421, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-19T08:48:23.895 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-19T08:48:23.895 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726735703598836, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726735703, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "8b627459-1e2f-424c-a836-65e8ed2313ba", "db_session_id": "J56RRX69H7LAIT73URSC", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-19T08:48:23.895 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726735703598945, "job": 1, "event": "recovery_finished"} 2024-09-19T08:48:23.895 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-19T08:48:23.895 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T08:48:23.895 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x562f092dee00 2024-09-19T08:48:23.895 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: DB pointer 0x562f093da000 2024-09-19T08:48:23.895 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T08:48:23.895 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T08:48:23.895 INFO:journalctl@ceph.mon.c.smithi190.stdout: ** DB Stats ** 2024-09-19T08:48:23.895 INFO:journalctl@ceph.mon.c.smithi190.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T08:48:23.896 INFO:journalctl@ceph.mon.c.smithi190.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T08:48:23.896 INFO:journalctl@ceph.mon.c.smithi190.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T08:48:23.896 INFO:journalctl@ceph.mon.c.smithi190.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T08:48:23.896 INFO:journalctl@ceph.mon.c.smithi190.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T08:48:23.896 INFO:journalctl@ceph.mon.c.smithi190.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T08:48:23.896 INFO:journalctl@ceph.mon.c.smithi190.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T08:48:23.896 INFO:journalctl@ceph.mon.c.smithi190.stdout: 2024-09-19T08:48:23.896 INFO:journalctl@ceph.mon.c.smithi190.stdout: ** Compaction Stats [default] ** 2024-09-19T08:48:23.896 INFO:journalctl@ceph.mon.c.smithi190.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T08:48:23.896 INFO:journalctl@ceph.mon.c.smithi190.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T08:48:23.896 INFO:journalctl@ceph.mon.c.smithi190.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T08:48:23.896 INFO:journalctl@ceph.mon.c.smithi190.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T08:48:23.896 INFO:journalctl@ceph.mon.c.smithi190.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T08:48:23.896 INFO:journalctl@ceph.mon.c.smithi190.stdout: 2024-09-19T08:48:23.897 INFO:journalctl@ceph.mon.c.smithi190.stdout: ** Compaction Stats [default] ** 2024-09-19T08:48:23.897 INFO:journalctl@ceph.mon.c.smithi190.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T08:48:23.897 INFO:journalctl@ceph.mon.c.smithi190.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T08:48:23.897 INFO:journalctl@ceph.mon.c.smithi190.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T08:48:23.897 INFO:journalctl@ceph.mon.c.smithi190.stdout: 2024-09-19T08:48:23.897 INFO:journalctl@ceph.mon.c.smithi190.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T08:48:23.897 INFO:journalctl@ceph.mon.c.smithi190.stdout: 2024-09-19T08:48:23.897 INFO:journalctl@ceph.mon.c.smithi190.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T08:48:23.897 INFO:journalctl@ceph.mon.c.smithi190.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T08:48:23.898 INFO:journalctl@ceph.mon.c.smithi190.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T08:48:23.898 INFO:journalctl@ceph.mon.c.smithi190.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T08:48:23.898 INFO:journalctl@ceph.mon.c.smithi190.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T08:48:23.898 INFO:journalctl@ceph.mon.c.smithi190.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T08:48:23.898 INFO:journalctl@ceph.mon.c.smithi190.stdout: Cumulative compaction: 0.00 GB write, 0.55 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T08:48:23.898 INFO:journalctl@ceph.mon.c.smithi190.stdout: Interval compaction: 0.00 GB write, 0.55 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T08:48:23.898 INFO:journalctl@ceph.mon.c.smithi190.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T08:48:23.898 INFO:journalctl@ceph.mon.c.smithi190.stdout: Block cache BinnedLRUCache@0x562f092b11f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-19T08:48:23.898 INFO:journalctl@ceph.mon.c.smithi190.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-19T08:48:23.898 INFO:journalctl@ceph.mon.c.smithi190.stdout: 2024-09-19T08:48:23.898 INFO:journalctl@ceph.mon.c.smithi190.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T08:48:23.899 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-19T08:48:23.899 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: using public_addr v2:172.21.15.190:0/0 -> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-19T08:48:23.899 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: starting mon.c rank -1 at public addrs [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] at bind addrs [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 91ff74f2-7663-11ef-bceb-c7b262605968 2024-09-19T08:48:23.899 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: mon.c@-1(???) e0 preinit fsid 91ff74f2-7663-11ef-bceb-c7b262605968 2024-09-19T08:48:23.899 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: mon.c@-1(synchronizing).mds e1 new map 2024-09-19T08:48:23.899 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-19T08:48:23.899 INFO:journalctl@ceph.mon.c.smithi190.stdout: e1 2024-09-19T08:48:23.899 INFO:journalctl@ceph.mon.c.smithi190.stdout: btime 2024-09-19T08:47:08:161960+0000 2024-09-19T08:48:23.899 INFO:journalctl@ceph.mon.c.smithi190.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T08:48:23.899 INFO:journalctl@ceph.mon.c.smithi190.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T08:48:23.899 INFO:journalctl@ceph.mon.c.smithi190.stdout: legacy client fscid: -1 2024-09-19T08:48:23.899 INFO:journalctl@ceph.mon.c.smithi190.stdout: 2024-09-19T08:48:23.899 INFO:journalctl@ceph.mon.c.smithi190.stdout: No filesystems configured 2024-09-19T08:48:23.900 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-19T08:48:23.900 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-19T08:48:23.900 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-19T08:48:23.900 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-19T08:48:23.900 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-19T08:48:23.900 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-19T08:48:23.900 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T08:48:23.900 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:48:23.900 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:48:23.900 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:48:23.900 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:48:23.900 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:23.900 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/297279324' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T08:48:23.901 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/297279324' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T08:48:23.901 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:48:23.901 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:23.901 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:23.901 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:23.901 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:23.901 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi190", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:48:23.901 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:23.901 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:23.901 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: Updating smithi190:/etc/ceph/ceph.conf 2024-09-19T08:48:23.901 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: Updating smithi190:/var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:48:23.901 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:23.901 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: Updating smithi190:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:48:23.901 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:23.902 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:23.902 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:23.902 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:23.902 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:23.902 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:23.902 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:23.902 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:23.902 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:48:23.902 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:23.902 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: Updating smithi190:/var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:48:23.902 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi092:172.21.15.92=a;smithi167:172.21.15.167=b;smithi190:172.21.15.190=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:48:23.902 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: Saving service mon spec with placement smithi092:172.21.15.92=a;smithi167:172.21.15.167=b;smithi190:172.21.15.190=c;count:3 2024-09-19T08:48:23.902 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: Deploying daemon mon.c on smithi190 2024-09-19T08:48:23.902 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:23.903 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:23.903 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: from='client.? 172.21.15.190:0/2361231063' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:48:23.903 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 ceph-mon[35358]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-19T08:48:23.903 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 bash[35339]: 5b05f588d6ae970d313367bb86c81ce23761cfeb36f423feb4ca417c4d1895ba 2024-09-19T08:48:23.903 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:23 smithi190 systemd[1]: Started Ceph mon.c for 91ff74f2-7663-11ef-bceb-c7b262605968. 2024-09-19T08:48:24.142 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T08:48:24.143 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:48:24.399 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:48:29.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:28 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:48:29.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:28 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:48:29.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:28 smithi092 ceph-mon[31407]: mon.a calling monitor election 2024-09-19T08:48:29.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:28 smithi092 ceph-mon[31407]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:29.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:28 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:48:29.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:28 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:48:29.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:28 smithi092 ceph-mon[31407]: mon.c calling monitor election 2024-09-19T08:48:29.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:28 smithi092 ceph-mon[31407]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:29.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:28 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:48:29.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:28 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:48:29.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:28 smithi092 ceph-mon[31407]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:29.005 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:28 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:48:29.005 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:28 smithi092 ceph-mon[31407]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T08:48:29.005 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:28 smithi092 ceph-mon[31407]: monmap epoch 2 2024-09-19T08:48:29.005 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:28 smithi092 ceph-mon[31407]: fsid 91ff74f2-7663-11ef-bceb-c7b262605968 2024-09-19T08:48:29.005 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:28 smithi092 ceph-mon[31407]: last_changed 2024-09-19T08:48:23.624442+0000 2024-09-19T08:48:29.005 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:28 smithi092 ceph-mon[31407]: created 2024-09-19T08:47:04.662007+0000 2024-09-19T08:48:29.005 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:28 smithi092 ceph-mon[31407]: min_mon_release 19 (squid) 2024-09-19T08:48:29.005 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:28 smithi092 ceph-mon[31407]: election_strategy: 1 2024-09-19T08:48:29.005 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:28 smithi092 ceph-mon[31407]: 0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-09-19T08:48:29.005 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:28 smithi092 ceph-mon[31407]: 1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.c 2024-09-19T08:48:29.005 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:28 smithi092 ceph-mon[31407]: fsmap 2024-09-19T08:48:29.005 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:28 smithi092 ceph-mon[31407]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:48:29.006 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:28 smithi092 ceph-mon[31407]: mgrmap e13: x(active, since 36s) 2024-09-19T08:48:29.006 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:28 smithi092 ceph-mon[31407]: overall HEALTH_OK 2024-09-19T08:48:29.006 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:28 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:29.006 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:28 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:29.006 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:28 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:29.006 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:28 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:48:29.006 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:28 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:29.125 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:28 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:48:29.125 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:28 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:48:29.125 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:28 smithi190 ceph-mon[35358]: mon.a calling monitor election 2024-09-19T08:48:29.125 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:28 smithi190 ceph-mon[35358]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:29.125 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:28 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:48:29.125 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:28 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:48:29.125 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:28 smithi190 ceph-mon[35358]: mon.c calling monitor election 2024-09-19T08:48:29.125 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:28 smithi190 ceph-mon[35358]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:29.125 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:28 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:48:29.125 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:28 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:48:29.126 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:28 smithi190 ceph-mon[35358]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:29.126 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:28 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:48:29.126 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:28 smithi190 ceph-mon[35358]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T08:48:29.126 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:28 smithi190 ceph-mon[35358]: monmap epoch 2 2024-09-19T08:48:29.126 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:28 smithi190 ceph-mon[35358]: fsid 91ff74f2-7663-11ef-bceb-c7b262605968 2024-09-19T08:48:29.126 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:28 smithi190 ceph-mon[35358]: last_changed 2024-09-19T08:48:23.624442+0000 2024-09-19T08:48:29.126 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:28 smithi190 ceph-mon[35358]: created 2024-09-19T08:47:04.662007+0000 2024-09-19T08:48:29.126 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:28 smithi190 ceph-mon[35358]: min_mon_release 19 (squid) 2024-09-19T08:48:29.126 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:28 smithi190 ceph-mon[35358]: election_strategy: 1 2024-09-19T08:48:29.126 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:28 smithi190 ceph-mon[35358]: 0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-09-19T08:48:29.126 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:28 smithi190 ceph-mon[35358]: 1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.c 2024-09-19T08:48:29.126 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:28 smithi190 ceph-mon[35358]: fsmap 2024-09-19T08:48:29.127 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:28 smithi190 ceph-mon[35358]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:48:29.127 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:28 smithi190 ceph-mon[35358]: mgrmap e13: x(active, since 36s) 2024-09-19T08:48:29.127 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:28 smithi190 ceph-mon[35358]: overall HEALTH_OK 2024-09-19T08:48:29.127 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:28 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:29.127 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:28 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:29.127 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:28 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:29.127 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:28 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:48:29.127 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:28 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:29.214 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.213+0000 7ffb63025640 1 -- 172.21.15.190:0/2584420863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb4c003530 msgr2=0x7ffb4c0059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:29.214 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.213+0000 7ffb63025640 1 --2- 172.21.15.190:0/2584420863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb4c003530 0x7ffb4c0059c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c1016a0 tx=0x7ffb5002c490 comp rx=0 tx=0).stop 2024-09-19T08:48:29.214 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.213+0000 7ffb63025640 1 -- 172.21.15.190:0/2584420863 shutdown_connections 2024-09-19T08:48:29.214 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.213+0000 7ffb63025640 1 --2- 172.21.15.190:0/2584420863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb4c003530 0x7ffb4c0059c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:29.215 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.213+0000 7ffb63025640 1 -- 172.21.15.190:0/2584420863 >> 172.21.15.190:0/2584420863 conn(0x7ffb5c0fc220 msgr2=0x7ffb5c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:29.215 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.213+0000 7ffb63025640 1 -- 172.21.15.190:0/2584420863 shutdown_connections 2024-09-19T08:48:29.215 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.213+0000 7ffb63025640 1 -- 172.21.15.190:0/2584420863 wait complete. 2024-09-19T08:48:29.215 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.214+0000 7ffb63025640 1 Processor -- start 2024-09-19T08:48:29.215 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.214+0000 7ffb63025640 1 -- start start 2024-09-19T08:48:29.215 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.214+0000 7ffb63025640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb4c003530 0x7ffb5c199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:29.215 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.214+0000 7ffb63025640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb5c1999c0 0x7ffb5c19dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:29.215 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.214+0000 7ffb63025640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5c108670 con 0x7ffb5c1999c0 2024-09-19T08:48:29.215 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.214+0000 7ffb63025640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5c1084f0 con 0x7ffb4c003530 2024-09-19T08:48:29.217 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.215+0000 7ffb60dc1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb4c003530 0x7ffb5c199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:29.218 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.215+0000 7ffb60dc1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb4c003530 0x7ffb5c199480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:55164/0 (socket says 172.21.15.190:55164) 2024-09-19T08:48:29.218 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.215+0000 7ffb60dc1640 1 -- 172.21.15.190:0/2831731225 learned_addr learned my addr 172.21.15.190:0/2831731225 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-09-19T08:48:29.218 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.215+0000 7ffb5bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb5c1999c0 0x7ffb5c19dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:29.218 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.215+0000 7ffb60dc1640 1 -- 172.21.15.190:0/2831731225 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb4c003530 msgr2=0x7ffb5c199480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T08:48:29.218 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.215+0000 7ffb60dc1640 1 -- 172.21.15.190:0/2831731225 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb4c003530 msgr2=0x7ffb5c199480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T08:48:29.218 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.215+0000 7ffb60dc1640 1 --2- 172.21.15.190:0/2831731225 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb4c003530 0x7ffb5c199480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:48:29.218 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.215+0000 7ffb60dc1640 1 --2- 172.21.15.190:0/2831731225 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb4c003530 0x7ffb5c199480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:48:29.218 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.215+0000 7ffb5bfff640 1 -- 172.21.15.190:0/2831731225 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb4c003530 msgr2=0x7ffb5c199480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:48:29.218 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.215+0000 7ffb5bfff640 1 --2- 172.21.15.190:0/2831731225 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb4c003530 0x7ffb5c199480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:29.218 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.215+0000 7ffb5bfff640 1 -- 172.21.15.190:0/2831731225 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb5c199fe0 con 0x7ffb5c1999c0 2024-09-19T08:48:29.218 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.215+0000 7ffb5bfff640 1 --2- 172.21.15.190:0/2831731225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb5c1999c0 0x7ffb5c19dd50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffb4800b3d0 tx=0x7ffb4800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:29.218 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.215+0000 7ffb59ffb640 1 -- 172.21.15.190:0/2831731225 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7ffb48011630 con 0x7ffb5c1999c0 2024-09-19T08:48:29.219 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.216+0000 7ffb59ffb640 1 -- 172.21.15.190:0/2831731225 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb48011cb0 con 0x7ffb5c1999c0 2024-09-19T08:48:29.219 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.216+0000 7ffb63025640 1 -- 172.21.15.190:0/2831731225 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb5c19e290 con 0x7ffb5c1999c0 2024-09-19T08:48:29.219 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.216+0000 7ffb59ffb640 1 -- 172.21.15.190:0/2831731225 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7ffb48010df0 con 0x7ffb5c1999c0 2024-09-19T08:48:29.219 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.216+0000 7ffb63025640 1 -- 172.21.15.190:0/2831731225 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb5c19e850 con 0x7ffb5c1999c0 2024-09-19T08:48:29.219 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.217+0000 7ffb59ffb640 1 -- 172.21.15.190:0/2831731225 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7ffb48018020 con 0x7ffb5c1999c0 2024-09-19T08:48:29.219 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.217+0000 7ffb59ffb640 1 --2- 172.21.15.190:0/2831731225 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffb40039090 0x7ffb4003b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:29.219 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.217+0000 7ffb59ffb640 1 -- 172.21.15.190:0/2831731225 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ffb4804b280 con 0x7ffb5c1999c0 2024-09-19T08:48:29.219 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.217+0000 7ffb60dc1640 1 --2- 172.21.15.190:0/2831731225 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffb40039090 0x7ffb4003b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:29.219 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.217+0000 7ffb63025640 1 -- 172.21.15.190:0/2831731225 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb5c19eb60 con 0x7ffb5c1999c0 2024-09-19T08:48:29.220 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.218+0000 7ffb60dc1640 1 --2- 172.21.15.190:0/2831731225 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffb40039090 0x7ffb4003b550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ffb50012c10 tx=0x7ffb500323a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:29.222 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.223+0000 7ffb59ffb640 1 -- 172.21.15.190:0/2831731225 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffb48014170 con 0x7ffb5c1999c0 2024-09-19T08:48:29.458 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.458+0000 7ffb63025640 1 -- 172.21.15.190:0/2831731225 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7ffb5c19a840 con 0x7ffb5c1999c0 2024-09-19T08:48:29.459 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.459+0000 7ffb59ffb640 1 -- 172.21.15.190:0/2831731225 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7ffb480172c0 con 0x7ffb5c1999c0 2024-09-19T08:48:29.459 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-19T08:48:29.459 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":2,"fsid":"91ff74f2-7663-11ef-bceb-c7b262605968","modified":"2024-09-19T08:48:23.624442Z","created":"2024-09-19T08:47:04.662007Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:3300","nonce":0},{"type":"v1","addr":"172.21.15.92:6789","nonce":0}]},"addr":"172.21.15.92:6789/0","public_addr":"172.21.15.92:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:3300","nonce":0},{"type":"v1","addr":"172.21.15.190:6789","nonce":0}]},"addr":"172.21.15.190:6789/0","public_addr":"172.21.15.190:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T08:48:29.459 INFO:teuthology.orchestra.run.smithi190.stderr:dumped monmap epoch 2 2024-09-19T08:48:29.461 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.461+0000 7ffb63025640 1 -- 172.21.15.190:0/2831731225 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffb40039090 msgr2=0x7ffb4003b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:29.461 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.461+0000 7ffb63025640 1 --2- 172.21.15.190:0/2831731225 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffb40039090 0x7ffb4003b550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ffb50012c10 tx=0x7ffb500323a0 comp rx=0 tx=0).stop 2024-09-19T08:48:29.461 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.461+0000 7ffb63025640 1 -- 172.21.15.190:0/2831731225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb5c1999c0 msgr2=0x7ffb5c19dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:29.461 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.461+0000 7ffb63025640 1 --2- 172.21.15.190:0/2831731225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb5c1999c0 0x7ffb5c19dd50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffb4800b3d0 tx=0x7ffb4800b890 comp rx=0 tx=0).stop 2024-09-19T08:48:29.462 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.461+0000 7ffb63025640 1 -- 172.21.15.190:0/2831731225 shutdown_connections 2024-09-19T08:48:29.462 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.461+0000 7ffb63025640 1 --2- 172.21.15.190:0/2831731225 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffb40039090 0x7ffb4003b550 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:29.462 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.461+0000 7ffb63025640 1 --2- 172.21.15.190:0/2831731225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb5c1999c0 0x7ffb5c19dd50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:29.462 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.461+0000 7ffb63025640 1 --2- 172.21.15.190:0/2831731225 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb4c003530 0x7ffb5c199480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:29.462 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.461+0000 7ffb63025640 1 -- 172.21.15.190:0/2831731225 >> 172.21.15.190:0/2831731225 conn(0x7ffb5c0fc220 msgr2=0x7ffb5c06a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:29.462 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.461+0000 7ffb63025640 1 -- 172.21.15.190:0/2831731225 shutdown_connections 2024-09-19T08:48:29.462 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:29.461+0000 7ffb63025640 1 -- 172.21.15.190:0/2831731225 wait complete. 2024-09-19T08:48:29.772 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:29 smithi190 ceph-mon[35358]: Deploying daemon mon.b on smithi167 2024-09-19T08:48:29.772 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:29 smithi190 ceph-mon[35358]: from='client.? 172.21.15.190:0/2831731225' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:48:29.773 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:29 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:48:30.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:29 smithi092 ceph-mon[31407]: Deploying daemon mon.b on smithi167 2024-09-19T08:48:30.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:29 smithi092 ceph-mon[31407]: from='client.? 172.21.15.190:0/2831731225' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:48:30.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:29 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:48:31.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:30 smithi092 ceph-mon[31407]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:31.075 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T08:48:31.076 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:48:31.089 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:30 smithi190 ceph-mon[35358]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:31.328 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:48:31.826 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:31.805+0000 7fb787472640 1 -- 172.21.15.190:0/169857214 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb780100610 msgr2=0x7fb7801009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:31.826 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:31.805+0000 7fb787472640 1 --2- 172.21.15.190:0/169857214 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb780100610 0x7fb7801009f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb77c009880 tx=0x7fb77c02a670 comp rx=0 tx=0).stop 2024-09-19T08:48:31.826 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:31.805+0000 7fb787472640 1 -- 172.21.15.190:0/169857214 shutdown_connections 2024-09-19T08:48:31.826 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:31.805+0000 7fb787472640 1 --2- 172.21.15.190:0/169857214 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb780100610 0x7fb7801009f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:31.826 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:31.805+0000 7fb787472640 1 -- 172.21.15.190:0/169857214 >> 172.21.15.190:0/169857214 conn(0x7fb7800fc220 msgr2=0x7fb7800fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:31.826 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:31.806+0000 7fb787472640 1 -- 172.21.15.190:0/169857214 shutdown_connections 2024-09-19T08:48:31.827 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:31.806+0000 7fb787472640 1 -- 172.21.15.190:0/169857214 wait complete. 2024-09-19T08:48:31.827 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:31.806+0000 7fb787472640 1 Processor -- start 2024-09-19T08:48:31.827 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:31.806+0000 7fb787472640 1 -- start start 2024-09-19T08:48:31.827 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:31.807+0000 7fb787472640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb780100610 0x7fb7801a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:31.827 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:31.807+0000 7fb787472640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7801a3c00 0x7fb78019d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:31.827 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:31.807+0000 7fb787472640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb780112370 con 0x7fb7801a3c00 2024-09-19T08:48:31.827 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:31.807+0000 7fb787472640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb7801121f0 con 0x7fb780100610 2024-09-19T08:48:31.827 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:31.807+0000 7fb78520e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb780100610 0x7fb7801a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:31.827 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:31.807+0000 7fb78520e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb780100610 0x7fb7801a36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:55176/0 (socket says 172.21.15.190:55176) 2024-09-19T08:48:31.828 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:31.807+0000 7fb78520e640 1 -- 172.21.15.190:0/2959208364 learned_addr learned my addr 172.21.15.190:0/2959208364 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-09-19T08:48:31.828 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:31.807+0000 7fb78520e640 1 -- 172.21.15.190:0/2959208364 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb780100610 msgr2=0x7fb7801a36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T08:48:31.828 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:31.807+0000 7fb78520e640 1 -- 172.21.15.190:0/2959208364 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb780100610 msgr2=0x7fb7801a36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T08:48:31.828 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:31.807+0000 7fb78520e640 1 --2- 172.21.15.190:0/2959208364 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb780100610 0x7fb7801a36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:48:31.828 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:31.807+0000 7fb78520e640 1 --2- 172.21.15.190:0/2959208364 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb780100610 0x7fb7801a36c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:48:31.828 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:31.807+0000 7fb784a0d640 1 --2- 172.21.15.190:0/2959208364 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7801a3c00 0x7fb78019d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:31.828 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:31.807+0000 7fb784a0d640 1 -- 172.21.15.190:0/2959208364 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb780100610 msgr2=0x7fb7801a36c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:48:31.828 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:31.807+0000 7fb784a0d640 1 --2- 172.21.15.190:0/2959208364 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb780100610 0x7fb7801a36c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:31.828 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:31.807+0000 7fb784a0d640 1 -- 172.21.15.190:0/2959208364 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7801a4210 con 0x7fb7801a3c00 2024-09-19T08:48:31.828 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:31.808+0000 7fb784a0d640 1 --2- 172.21.15.190:0/2959208364 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7801a3c00 0x7fb78019d840 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb77000b3d0 tx=0x7fb77000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:31.829 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:31.808+0000 7fb7767fc640 1 -- 172.21.15.190:0/2959208364 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fb770011630 con 0x7fb7801a3c00 2024-09-19T08:48:31.829 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:31.808+0000 7fb7767fc640 1 -- 172.21.15.190:0/2959208364 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb770011cb0 con 0x7fb7801a3c00 2024-09-19T08:48:31.829 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:31.808+0000 7fb787472640 1 -- 172.21.15.190:0/2959208364 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb78019dd80 con 0x7fb7801a3c00 2024-09-19T08:48:31.829 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:31.808+0000 7fb7767fc640 1 -- 172.21.15.190:0/2959208364 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fb770010df0 con 0x7fb7801a3c00 2024-09-19T08:48:31.829 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:31.808+0000 7fb787472640 1 -- 172.21.15.190:0/2959208364 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb78019e310 con 0x7fb7801a3c00 2024-09-19T08:48:31.829 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:31.809+0000 7fb7767fc640 1 -- 172.21.15.190:0/2959208364 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fb770018020 con 0x7fb7801a3c00 2024-09-19T08:48:31.829 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:31.809+0000 7fb7767fc640 1 --2- 172.21.15.190:0/2959208364 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb76c039040 0x7fb76c03b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:31.829 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:31.809+0000 7fb7767fc640 1 -- 172.21.15.190:0/2959208364 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb77004bfc0 con 0x7fb7801a3c00 2024-09-19T08:48:31.829 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:31.809+0000 7fb787472640 1 -- 172.21.15.190:0/2959208364 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb78006ad10 con 0x7fb7801a3c00 2024-09-19T08:48:31.829 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:31.809+0000 7fb78520e640 1 --2- 172.21.15.190:0/2959208364 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb76c039040 0x7fb76c03b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:31.829 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:31.810+0000 7fb78520e640 1 --2- 172.21.15.190:0/2959208364 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb76c039040 0x7fb76c03b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb77c0096c0 tx=0x7fb77c005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:31.830 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:31.814+0000 7fb7767fc640 1 -- 172.21.15.190:0/2959208364 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb77001f020 con 0x7fb7801a3c00 2024-09-19T08:48:32.050 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:32.051+0000 7fb787472640 1 -- 172.21.15.190:0/2959208364 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fb78019e620 con 0x7fb7801a3c00 2024-09-19T08:48:32.051 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:32.051+0000 7fb7767fc640 1 -- 172.21.15.190:0/2959208364 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7fb770018310 con 0x7fb7801a3c00 2024-09-19T08:48:32.051 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-19T08:48:32.051 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":2,"fsid":"91ff74f2-7663-11ef-bceb-c7b262605968","modified":"2024-09-19T08:48:23.624442Z","created":"2024-09-19T08:47:04.662007Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:3300","nonce":0},{"type":"v1","addr":"172.21.15.92:6789","nonce":0}]},"addr":"172.21.15.92:6789/0","public_addr":"172.21.15.92:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:3300","nonce":0},{"type":"v1","addr":"172.21.15.190:6789","nonce":0}]},"addr":"172.21.15.190:6789/0","public_addr":"172.21.15.190:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T08:48:32.052 INFO:teuthology.orchestra.run.smithi190.stderr:dumped monmap epoch 2 2024-09-19T08:48:32.053 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:32.053+0000 7fb787472640 1 -- 172.21.15.190:0/2959208364 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb76c039040 msgr2=0x7fb76c03b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:32.053 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:32.053+0000 7fb787472640 1 --2- 172.21.15.190:0/2959208364 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb76c039040 0x7fb76c03b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb77c0096c0 tx=0x7fb77c005a40 comp rx=0 tx=0).stop 2024-09-19T08:48:32.053 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:32.053+0000 7fb787472640 1 -- 172.21.15.190:0/2959208364 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7801a3c00 msgr2=0x7fb78019d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:32.054 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:32.053+0000 7fb787472640 1 --2- 172.21.15.190:0/2959208364 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7801a3c00 0x7fb78019d840 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb77000b3d0 tx=0x7fb77000b890 comp rx=0 tx=0).stop 2024-09-19T08:48:32.054 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:32.053+0000 7fb787472640 1 -- 172.21.15.190:0/2959208364 shutdown_connections 2024-09-19T08:48:32.054 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:32.053+0000 7fb787472640 1 --2- 172.21.15.190:0/2959208364 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb76c039040 0x7fb76c03b500 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:32.054 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:32.053+0000 7fb787472640 1 --2- 172.21.15.190:0/2959208364 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7801a3c00 0x7fb78019d840 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:32.054 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:32.053+0000 7fb787472640 1 --2- 172.21.15.190:0/2959208364 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb780100610 0x7fb7801a36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:32.054 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:32.053+0000 7fb787472640 1 -- 172.21.15.190:0/2959208364 >> 172.21.15.190:0/2959208364 conn(0x7fb7800fc220 msgr2=0x7fb7800fdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:32.054 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:32.053+0000 7fb787472640 1 -- 172.21.15.190:0/2959208364 shutdown_connections 2024-09-19T08:48:32.054 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:32.053+0000 7fb787472640 1 -- 172.21.15.190:0/2959208364 wait complete. 2024-09-19T08:48:32.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 podman[35340]: 2024-09-19 08:48:31.960580877 +0000 UTC m=+0.016340476 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:48:32.373 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:32 smithi190 ceph-mon[35358]: from='client.? 172.21.15.190:0/2959208364' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:48:32.434 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 podman[35340]: 2024-09-19 08:48:32.280225722 +0000 UTC m=+0.335985320 container init 9d435bae8dfd3ee2a4900cdce519ebbc017ce38aea1113b3846d302c42cf1d7a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mon-b, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:48:32.434 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 podman[35340]: 2024-09-19 08:48:32.283391249 +0000 UTC m=+0.339150843 container start 9d435bae8dfd3ee2a4900cdce519ebbc017ce38aea1113b3846d302c42cf1d7a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mon-b, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:48:32.435 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T08:48:32.435 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T08:48:32.435 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: pidfile_write: ignore empty --pid-file 2024-09-19T08:48:32.435 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: load: jerasure load: lrc 2024-09-19T08:48:32.435 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: RocksDB version: 7.9.2 2024-09-19T08:48:32.435 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Git sha 0 2024-09-19T08:48:32.435 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T08:48:32.435 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: DB SUMMARY 2024-09-19T08:48:32.435 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: DB Session ID: OAJ0HQK4M8MSO50AC61C 2024-09-19T08:48:32.436 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: CURRENT file: CURRENT 2024-09-19T08:48:32.436 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T08:48:32.436 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-19T08:48:32.436 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-19T08:48:32.436 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-09-19T08:48:32.436 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.error_if_exists: 0 2024-09-19T08:48:32.436 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.create_if_missing: 0 2024-09-19T08:48:32.436 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.paranoid_checks: 1 2024-09-19T08:48:32.436 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T08:48:32.436 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T08:48:32.436 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T08:48:32.437 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.env: 0x55566dbf5940 2024-09-19T08:48:32.437 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T08:48:32.437 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.info_log: 0x5556701a16e0 2024-09-19T08:48:32.437 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T08:48:32.437 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.statistics: (nil) 2024-09-19T08:48:32.437 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.use_fsync: 0 2024-09-19T08:48:32.437 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.max_log_file_size: 0 2024-09-19T08:48:32.437 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T08:48:32.437 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T08:48:32.437 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T08:48:32.437 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T08:48:32.437 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.allow_fallocate: 1 2024-09-19T08:48:32.438 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T08:48:32.438 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T08:48:32.438 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.use_direct_reads: 0 2024-09-19T08:48:32.438 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T08:48:32.438 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T08:48:32.438 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.db_log_dir: 2024-09-19T08:48:32.438 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.wal_dir: 2024-09-19T08:48:32.438 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T08:48:32.438 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T08:48:32.438 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T08:48:32.438 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T08:48:32.438 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T08:48:32.438 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T08:48:32.439 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T08:48:32.439 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T08:48:32.439 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.write_buffer_manager: 0x5556701b0dc0 2024-09-19T08:48:32.439 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T08:48:32.439 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T08:48:32.439 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T08:48:32.439 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T08:48:32.439 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T08:48:32.439 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T08:48:32.439 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T08:48:32.439 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T08:48:32.439 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.unordered_write: 0 2024-09-19T08:48:32.439 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T08:48:32.440 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T08:48:32.440 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T08:48:32.440 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T08:48:32.440 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.row_cache: None 2024-09-19T08:48:32.440 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.wal_filter: None 2024-09-19T08:48:32.441 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T08:48:32.441 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T08:48:32.442 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.two_write_queues: 0 2024-09-19T08:48:32.442 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T08:48:32.442 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.wal_compression: 0 2024-09-19T08:48:32.442 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.atomic_flush: 0 2024-09-19T08:48:32.442 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T08:48:32.442 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T08:48:32.442 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T08:48:32.442 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.log_readahead_size: 0 2024-09-19T08:48:32.442 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T08:48:32.442 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T08:48:32.443 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T08:48:32.443 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T08:48:32.443 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T08:48:32.443 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T08:48:32.443 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T08:48:32.443 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.max_background_jobs: 2 2024-09-19T08:48:32.443 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.max_background_compactions: -1 2024-09-19T08:48:32.443 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.max_subcompactions: 1 2024-09-19T08:48:32.443 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T08:48:32.443 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T08:48:32.443 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T08:48:32.443 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T08:48:32.443 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T08:48:32.444 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T08:48:32.444 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T08:48:32.444 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T08:48:32.444 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.max_open_files: -1 2024-09-19T08:48:32.444 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T08:48:32.444 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T08:48:32.444 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T08:48:32.444 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T08:48:32.444 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.max_background_flushes: -1 2024-09-19T08:48:32.444 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Compression algorithms supported: 2024-09-19T08:48:32.444 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: kZSTD supported: 0 2024-09-19T08:48:32.444 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: kXpressCompression supported: 0 2024-09-19T08:48:32.445 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: kBZip2Compression supported: 0 2024-09-19T08:48:32.445 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T08:48:32.445 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: kLZ4Compression supported: 1 2024-09-19T08:48:32.445 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: kZlibCompression supported: 1 2024-09-19T08:48:32.445 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T08:48:32.445 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: kSnappyCompression supported: 1 2024-09-19T08:48:32.445 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T08:48:32.445 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T08:48:32.445 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-19T08:48:32.445 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T08:48:32.445 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T08:48:32.445 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.merge_operator: 2024-09-19T08:48:32.445 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.compaction_filter: None 2024-09-19T08:48:32.446 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T08:48:32.446 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T08:48:32.446 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T08:48:32.446 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T08:48:32.446 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5556701a1320) 2024-09-19T08:48:32.446 INFO:journalctl@ceph.mon.b.smithi167.stdout: cache_index_and_filter_blocks: 1 2024-09-19T08:48:32.446 INFO:journalctl@ceph.mon.b.smithi167.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T08:48:32.446 INFO:journalctl@ceph.mon.b.smithi167.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T08:48:32.446 INFO:journalctl@ceph.mon.b.smithi167.stdout: pin_top_level_index_and_filter: 1 2024-09-19T08:48:32.446 INFO:journalctl@ceph.mon.b.smithi167.stdout: index_type: 0 2024-09-19T08:48:32.446 INFO:journalctl@ceph.mon.b.smithi167.stdout: data_block_index_type: 0 2024-09-19T08:48:32.446 INFO:journalctl@ceph.mon.b.smithi167.stdout: index_shortening: 1 2024-09-19T08:48:32.446 INFO:journalctl@ceph.mon.b.smithi167.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T08:48:32.447 INFO:journalctl@ceph.mon.b.smithi167.stdout: checksum: 4 2024-09-19T08:48:32.447 INFO:journalctl@ceph.mon.b.smithi167.stdout: no_block_cache: 0 2024-09-19T08:48:32.447 INFO:journalctl@ceph.mon.b.smithi167.stdout: block_cache: 0x5556701951f0 2024-09-19T08:48:32.447 INFO:journalctl@ceph.mon.b.smithi167.stdout: block_cache_name: BinnedLRUCache 2024-09-19T08:48:32.447 INFO:journalctl@ceph.mon.b.smithi167.stdout: block_cache_options: 2024-09-19T08:48:32.447 INFO:journalctl@ceph.mon.b.smithi167.stdout: capacity : 536870912 2024-09-19T08:48:32.447 INFO:journalctl@ceph.mon.b.smithi167.stdout: num_shard_bits : 4 2024-09-19T08:48:32.447 INFO:journalctl@ceph.mon.b.smithi167.stdout: strict_capacity_limit : 0 2024-09-19T08:48:32.447 INFO:journalctl@ceph.mon.b.smithi167.stdout: high_pri_pool_ratio: 0.000 2024-09-19T08:48:32.447 INFO:journalctl@ceph.mon.b.smithi167.stdout: block_cache_compressed: (nil) 2024-09-19T08:48:32.447 INFO:journalctl@ceph.mon.b.smithi167.stdout: persistent_cache: (nil) 2024-09-19T08:48:32.447 INFO:journalctl@ceph.mon.b.smithi167.stdout: block_size: 4096 2024-09-19T08:48:32.447 INFO:journalctl@ceph.mon.b.smithi167.stdout: block_size_deviation: 10 2024-09-19T08:48:32.447 INFO:journalctl@ceph.mon.b.smithi167.stdout: block_restart_interval: 16 2024-09-19T08:48:32.448 INFO:journalctl@ceph.mon.b.smithi167.stdout: index_block_restart_interval: 1 2024-09-19T08:48:32.448 INFO:journalctl@ceph.mon.b.smithi167.stdout: metadata_block_size: 4096 2024-09-19T08:48:32.448 INFO:journalctl@ceph.mon.b.smithi167.stdout: partition_filters: 0 2024-09-19T08:48:32.448 INFO:journalctl@ceph.mon.b.smithi167.stdout: use_delta_encoding: 1 2024-09-19T08:48:32.448 INFO:journalctl@ceph.mon.b.smithi167.stdout: filter_policy: bloomfilter 2024-09-19T08:48:32.448 INFO:journalctl@ceph.mon.b.smithi167.stdout: whole_key_filtering: 1 2024-09-19T08:48:32.448 INFO:journalctl@ceph.mon.b.smithi167.stdout: verify_compression: 0 2024-09-19T08:48:32.448 INFO:journalctl@ceph.mon.b.smithi167.stdout: read_amp_bytes_per_bit: 0 2024-09-19T08:48:32.448 INFO:journalctl@ceph.mon.b.smithi167.stdout: format_version: 5 2024-09-19T08:48:32.448 INFO:journalctl@ceph.mon.b.smithi167.stdout: enable_index_compression: 1 2024-09-19T08:48:32.448 INFO:journalctl@ceph.mon.b.smithi167.stdout: block_align: 0 2024-09-19T08:48:32.449 INFO:journalctl@ceph.mon.b.smithi167.stdout: max_auto_readahead_size: 262144 2024-09-19T08:48:32.449 INFO:journalctl@ceph.mon.b.smithi167.stdout: prepopulate_block_cache: 0 2024-09-19T08:48:32.449 INFO:journalctl@ceph.mon.b.smithi167.stdout: initial_auto_readahead_size: 8192 2024-09-19T08:48:32.449 INFO:journalctl@ceph.mon.b.smithi167.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T08:48:32.449 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T08:48:32.449 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T08:48:32.449 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.compression: NoCompression 2024-09-19T08:48:32.449 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T08:48:32.449 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T08:48:32.449 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T08:48:32.449 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.num_levels: 7 2024-09-19T08:48:32.450 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T08:48:32.450 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T08:48:32.450 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T08:48:32.450 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T08:48:32.450 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T08:48:32.450 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T08:48:32.450 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T08:48:32.450 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T08:48:32.450 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T08:48:32.450 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T08:48:32.450 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T08:48:32.450 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T08:48:32.451 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T08:48:32.451 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T08:48:32.451 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T08:48:32.451 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T08:48:32.451 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T08:48:32.451 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T08:48:32.451 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T08:48:32.451 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T08:48:32.451 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T08:48:32.451 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T08:48:32.451 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T08:48:32.451 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T08:48:32.451 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T08:48:32.451 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T08:48:32.452 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T08:48:32.452 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T08:48:32.452 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T08:48:32.452 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T08:48:32.452 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T08:48:32.452 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T08:48:32.452 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T08:48:32.452 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T08:48:32.452 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T08:48:32.452 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T08:48:32.452 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T08:48:32.452 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T08:48:32.452 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T08:48:32.453 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T08:48:32.453 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T08:48:32.453 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T08:48:32.453 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T08:48:32.453 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T08:48:32.453 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T08:48:32.453 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T08:48:32.453 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T08:48:32.453 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T08:48:32.453 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T08:48:32.453 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T08:48:32.453 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T08:48:32.453 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T08:48:32.454 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T08:48:32.454 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T08:48:32.454 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.inplace_update_support: 0 2024-09-19T08:48:32.454 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T08:48:32.454 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T08:48:32.454 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T08:48:32.454 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T08:48:32.454 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.bloom_locality: 0 2024-09-19T08:48:32.454 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.max_successive_merges: 0 2024-09-19T08:48:32.454 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T08:48:32.454 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T08:48:32.454 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T08:48:32.454 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T08:48:32.454 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.ttl: 2592000 2024-09-19T08:48:32.455 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T08:48:32.455 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T08:48:32.455 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T08:48:32.455 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.enable_blob_files: false 2024-09-19T08:48:32.455 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.min_blob_size: 0 2024-09-19T08:48:32.455 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T08:48:32.455 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T08:48:32.455 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T08:48:32.455 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T08:48:32.455 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T08:48:32.455 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T08:48:32.455 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T08:48:32.455 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T08:48:32.456 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-19T08:48:32.456 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-19T08:48:32.456 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: c1d33bcd-6258-44b4-ab9e-6e6c0db5084c 2024-09-19T08:48:32.456 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726735712310780, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-19T08:48:32.456 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-19T08:48:32.456 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726735712311325, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726735712, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "c1d33bcd-6258-44b4-ab9e-6e6c0db5084c", "db_session_id": "OAJ0HQK4M8MSO50AC61C", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-19T08:48:32.456 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726735712311455, "job": 1, "event": "recovery_finished"} 2024-09-19T08:48:32.456 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-19T08:48:32.456 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T08:48:32.456 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5556701c2e00 2024-09-19T08:48:32.457 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: DB pointer 0x5556702be000 2024-09-19T08:48:32.457 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T08:48:32.457 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T08:48:32.457 INFO:journalctl@ceph.mon.b.smithi167.stdout: ** DB Stats ** 2024-09-19T08:48:32.457 INFO:journalctl@ceph.mon.b.smithi167.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T08:48:32.457 INFO:journalctl@ceph.mon.b.smithi167.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T08:48:32.457 INFO:journalctl@ceph.mon.b.smithi167.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T08:48:32.457 INFO:journalctl@ceph.mon.b.smithi167.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T08:48:32.457 INFO:journalctl@ceph.mon.b.smithi167.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T08:48:32.457 INFO:journalctl@ceph.mon.b.smithi167.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T08:48:32.458 INFO:journalctl@ceph.mon.b.smithi167.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T08:48:32.458 INFO:journalctl@ceph.mon.b.smithi167.stdout: 2024-09-19T08:48:32.458 INFO:journalctl@ceph.mon.b.smithi167.stdout: ** Compaction Stats [default] ** 2024-09-19T08:48:32.458 INFO:journalctl@ceph.mon.b.smithi167.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T08:48:32.458 INFO:journalctl@ceph.mon.b.smithi167.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T08:48:32.458 INFO:journalctl@ceph.mon.b.smithi167.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:48:32.458 INFO:journalctl@ceph.mon.b.smithi167.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:48:32.458 INFO:journalctl@ceph.mon.b.smithi167.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:48:32.458 INFO:journalctl@ceph.mon.b.smithi167.stdout: 2024-09-19T08:48:32.458 INFO:journalctl@ceph.mon.b.smithi167.stdout: ** Compaction Stats [default] ** 2024-09-19T08:48:32.459 INFO:journalctl@ceph.mon.b.smithi167.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T08:48:32.459 INFO:journalctl@ceph.mon.b.smithi167.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T08:48:32.459 INFO:journalctl@ceph.mon.b.smithi167.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:48:32.459 INFO:journalctl@ceph.mon.b.smithi167.stdout: 2024-09-19T08:48:32.459 INFO:journalctl@ceph.mon.b.smithi167.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T08:48:32.459 INFO:journalctl@ceph.mon.b.smithi167.stdout: 2024-09-19T08:48:32.459 INFO:journalctl@ceph.mon.b.smithi167.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T08:48:32.459 INFO:journalctl@ceph.mon.b.smithi167.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T08:48:32.459 INFO:journalctl@ceph.mon.b.smithi167.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T08:48:32.459 INFO:journalctl@ceph.mon.b.smithi167.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T08:48:32.459 INFO:journalctl@ceph.mon.b.smithi167.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T08:48:32.459 INFO:journalctl@ceph.mon.b.smithi167.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T08:48:32.459 INFO:journalctl@ceph.mon.b.smithi167.stdout: Cumulative compaction: 0.00 GB write, 0.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T08:48:32.459 INFO:journalctl@ceph.mon.b.smithi167.stdout: Interval compaction: 0.00 GB write, 0.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T08:48:32.460 INFO:journalctl@ceph.mon.b.smithi167.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T08:48:32.460 INFO:journalctl@ceph.mon.b.smithi167.stdout: Block cache BinnedLRUCache@0x5556701951f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-19T08:48:32.460 INFO:journalctl@ceph.mon.b.smithi167.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-19T08:48:32.460 INFO:journalctl@ceph.mon.b.smithi167.stdout: 2024-09-19T08:48:32.460 INFO:journalctl@ceph.mon.b.smithi167.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T08:48:32.460 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-19T08:48:32.460 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: using public_addr v2:172.21.15.167:0/0 -> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] 2024-09-19T08:48:32.460 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: starting mon.b rank -1 at public addrs [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] at bind addrs [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 91ff74f2-7663-11ef-bceb-c7b262605968 2024-09-19T08:48:32.460 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: mon.b@-1(???) e0 preinit fsid 91ff74f2-7663-11ef-bceb-c7b262605968 2024-09-19T08:48:32.460 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: mon.b@-1(synchronizing).mds e1 new map 2024-09-19T08:48:32.461 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-19T08:48:32.461 INFO:journalctl@ceph.mon.b.smithi167.stdout: e1 2024-09-19T08:48:32.461 INFO:journalctl@ceph.mon.b.smithi167.stdout: btime 2024-09-19T08:47:08:161960+0000 2024-09-19T08:48:32.461 INFO:journalctl@ceph.mon.b.smithi167.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T08:48:32.461 INFO:journalctl@ceph.mon.b.smithi167.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T08:48:32.461 INFO:journalctl@ceph.mon.b.smithi167.stdout: legacy client fscid: -1 2024-09-19T08:48:32.461 INFO:journalctl@ceph.mon.b.smithi167.stdout: 2024-09-19T08:48:32.461 INFO:journalctl@ceph.mon.b.smithi167.stdout: No filesystems configured 2024-09-19T08:48:32.461 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-19T08:48:32.461 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-19T08:48:32.461 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-19T08:48:32.461 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-19T08:48:32.461 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-19T08:48:32.461 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-19T08:48:32.462 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T08:48:32.462 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:48:32.462 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:48:32.462 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:48:32.462 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:48:32.462 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:32.462 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/297279324' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T08:48:32.462 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/297279324' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T08:48:32.462 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:48:32.462 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:32.462 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:32.462 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:32.462 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:32.463 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi190", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:48:32.463 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:32.463 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:32.463 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: Updating smithi190:/etc/ceph/ceph.conf 2024-09-19T08:48:32.463 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: Updating smithi190:/var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:48:32.463 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:32.463 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: Updating smithi190:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:48:32.464 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:32.464 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:32.464 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:32.464 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:32.464 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:32.464 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:32.464 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:32.464 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:32.464 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:48:32.465 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:32.465 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: Updating smithi190:/var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:48:32.465 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi092:172.21.15.92=a;smithi167:172.21.15.167=b;smithi190:172.21.15.190=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:48:32.465 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: Saving service mon spec with placement smithi092:172.21.15.92=a;smithi167:172.21.15.167=b;smithi190:172.21.15.190=c;count:3 2024-09-19T08:48:32.465 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: Deploying daemon mon.c on smithi190 2024-09-19T08:48:32.465 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:32.465 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:32.465 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: from='client.? 172.21.15.190:0/2361231063' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:48:32.465 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:48:32.465 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:48:32.465 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: mon.a calling monitor election 2024-09-19T08:48:32.465 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:32.466 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:48:32.466 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:48:32.466 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: mon.c calling monitor election 2024-09-19T08:48:32.466 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:32.466 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:48:32.466 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:48:32.466 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:32.466 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:48:32.466 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T08:48:32.466 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: monmap epoch 2 2024-09-19T08:48:32.466 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: fsid 91ff74f2-7663-11ef-bceb-c7b262605968 2024-09-19T08:48:32.466 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: last_changed 2024-09-19T08:48:23.624442+0000 2024-09-19T08:48:32.466 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: created 2024-09-19T08:47:04.662007+0000 2024-09-19T08:48:32.467 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: min_mon_release 19 (squid) 2024-09-19T08:48:32.467 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: election_strategy: 1 2024-09-19T08:48:32.467 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: 0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-09-19T08:48:32.467 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: 1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.c 2024-09-19T08:48:32.467 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: fsmap 2024-09-19T08:48:32.467 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:48:32.467 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: mgrmap e13: x(active, since 36s) 2024-09-19T08:48:32.467 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: overall HEALTH_OK 2024-09-19T08:48:32.467 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:32.467 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:32.467 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:32.467 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:48:32.467 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:32.467 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: Deploying daemon mon.b on smithi167 2024-09-19T08:48:32.468 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: from='client.? 172.21.15.190:0/2831731225' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:48:32.468 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:48:32.468 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:32.468 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: from='client.? 172.21.15.190:0/2959208364' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:48:32.468 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 ceph-mon[35359]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-19T08:48:32.468 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 bash[35340]: 9d435bae8dfd3ee2a4900cdce519ebbc017ce38aea1113b3846d302c42cf1d7a 2024-09-19T08:48:32.468 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:32 smithi167 systemd[1]: Started Ceph mon.b for 91ff74f2-7663-11ef-bceb-c7b262605968. 2024-09-19T08:48:32.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:32 smithi092 ceph-mon[31407]: from='client.? 172.21.15.190:0/2959208364' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:48:33.617 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T08:48:33.618 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:48:33.868 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:48:37.473 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.471+0000 7ff1b7bc5640 1 -- 172.21.15.190:0/3444104950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff19c003530 msgr2=0x7ff19c0059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:37.473 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.471+0000 7ff1b7bc5640 1 --2- 172.21.15.190:0/3444104950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff19c003530 0x7ff19c0059c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff1b01016a0 tx=0x7ff1a002c150 comp rx=0 tx=0).stop 2024-09-19T08:48:37.473 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.471+0000 7ff1b7bc5640 1 -- 172.21.15.190:0/3444104950 shutdown_connections 2024-09-19T08:48:37.473 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.471+0000 7ff1b7bc5640 1 --2- 172.21.15.190:0/3444104950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff19c003530 0x7ff19c0059c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:37.473 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.471+0000 7ff1b7bc5640 1 -- 172.21.15.190:0/3444104950 >> 172.21.15.190:0/3444104950 conn(0x7ff1b00fc220 msgr2=0x7ff1b00fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:37.473 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.471+0000 7ff1b7bc5640 1 -- 172.21.15.190:0/3444104950 shutdown_connections 2024-09-19T08:48:37.474 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.471+0000 7ff1b7bc5640 1 -- 172.21.15.190:0/3444104950 wait complete. 2024-09-19T08:48:37.474 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.472+0000 7ff1b7bc5640 1 Processor -- start 2024-09-19T08:48:37.474 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.472+0000 7ff1b7bc5640 1 -- start start 2024-09-19T08:48:37.474 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.472+0000 7ff1b7bc5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff19c003530 0x7ff1b01961f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:37.474 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.472+0000 7ff1b7bc5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1b0196730 0x7ff1b019aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:37.474 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.472+0000 7ff1b7bc5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1b019b000 0x7ff1b019b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:37.474 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.472+0000 7ff1b7bc5640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b0108670 con 0x7ff1b0196730 2024-09-19T08:48:37.474 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.472+0000 7ff1b7bc5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b01084f0 con 0x7ff1b019b000 2024-09-19T08:48:37.474 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.472+0000 7ff1b7bc5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b01087f0 con 0x7ff19c003530 2024-09-19T08:48:37.474 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.472+0000 7ff1b5160640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1b0196730 0x7ff1b019aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:37.474 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.472+0000 7ff1b5160640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1b0196730 0x7ff1b019aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.190:34508/0 (socket says 172.21.15.190:34508) 2024-09-19T08:48:37.474 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.472+0000 7ff1b5160640 1 -- 172.21.15.190:0/325221028 learned_addr learned my addr 172.21.15.190:0/325221028 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-09-19T08:48:37.475 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.472+0000 7ff1b5961640 1 --2- 172.21.15.190:0/325221028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff19c003530 0x7ff1b01961f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:37.475 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.473+0000 7ff1b6162640 1 --2- 172.21.15.190:0/325221028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1b019b000 0x7ff1b019b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:37.475 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.473+0000 7ff1b5961640 1 -- 172.21.15.190:0/325221028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff19c003530 msgr2=0x7ff1b01961f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T08:48:37.475 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.473+0000 7ff1b5961640 1 -- 172.21.15.190:0/325221028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff19c003530 msgr2=0x7ff1b01961f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T08:48:37.475 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.473+0000 7ff1b5961640 1 --2- 172.21.15.190:0/325221028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff19c003530 0x7ff1b01961f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:48:37.475 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.473+0000 7ff1b6162640 1 -- 172.21.15.190:0/325221028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1b019b000 msgr2=0x7ff1b019b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-19T08:48:37.475 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.473+0000 7ff1b6162640 1 -- 172.21.15.190:0/325221028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1b019b000 msgr2=0x7ff1b019b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T08:48:37.475 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.473+0000 7ff1b6162640 1 --2- 172.21.15.190:0/325221028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1b019b000 0x7ff1b019b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:48:37.475 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.473+0000 7ff1b5961640 1 --2- 172.21.15.190:0/325221028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff19c003530 0x7ff1b01961f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:48:37.475 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.473+0000 7ff1b6162640 1 --2- 172.21.15.190:0/325221028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1b019b000 0x7ff1b019b4b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:48:37.475 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.473+0000 7ff1b5160640 1 -- 172.21.15.190:0/325221028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff19c003530 msgr2=0x7ff1b01961f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:48:37.475 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.473+0000 7ff1b5160640 1 --2- 172.21.15.190:0/325221028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff19c003530 0x7ff1b01961f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:37.475 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.473+0000 7ff1b5160640 1 -- 172.21.15.190:0/325221028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1b019b000 msgr2=0x7ff1b019b4b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:48:37.476 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.473+0000 7ff1b5160640 1 --2- 172.21.15.190:0/325221028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1b019b000 0x7ff1b019b4b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:37.476 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.473+0000 7ff1b5160640 1 -- 172.21.15.190:0/325221028 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1b006a430 con 0x7ff1b0196730 2024-09-19T08:48:37.476 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.473+0000 7ff1b5160640 1 --2- 172.21.15.190:0/325221028 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1b0196730 0x7ff1b019aac0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac00b520 tx=0x7ff1ac00b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:37.477 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.473+0000 7ff1a6ffd640 1 -- 172.21.15.190:0/325221028 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac004230 con 0x7ff1b0196730 2024-09-19T08:48:37.477 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.473+0000 7ff1a6ffd640 1 -- 172.21.15.190:0/325221028 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1ac0043d0 con 0x7ff1b0196730 2024-09-19T08:48:37.477 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.473+0000 7ff1a6ffd640 1 -- 172.21.15.190:0/325221028 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac003d60 con 0x7ff1b0196730 2024-09-19T08:48:37.477 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.473+0000 7ff1b7bc5640 1 -- 172.21.15.190:0/325221028 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1b006a720 con 0x7ff1b0196730 2024-09-19T08:48:37.477 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.474+0000 7ff1b7bc5640 1 -- 172.21.15.190:0/325221028 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1b006ac10 con 0x7ff1b0196730 2024-09-19T08:48:37.477 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.475+0000 7ff1a6ffd640 1 -- 172.21.15.190:0/325221028 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7ff1ac00e070 con 0x7ff1b0196730 2024-09-19T08:48:37.477 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.475+0000 7ff1b7bc5640 1 -- 172.21.15.190:0/325221028 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1b01097a0 con 0x7ff1b0196730 2024-09-19T08:48:37.477 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.475+0000 7ff1a6ffd640 1 --2- 172.21.15.190:0/325221028 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff194039730 0x7ff19403bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:37.478 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.475+0000 7ff1a6ffd640 1 -- 172.21.15.190:0/325221028 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff1ac04bc70 con 0x7ff1b0196730 2024-09-19T08:48:37.478 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.475+0000 7ff1b5961640 1 --2- 172.21.15.190:0/325221028 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff194039730 0x7ff19403bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:37.478 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.476+0000 7ff1b5961640 1 --2- 172.21.15.190:0/325221028 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff194039730 0x7ff19403bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0005dc0 tx=0x7ff1a0005d10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:37.480 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.480+0000 7ff1a6ffd640 1 -- 172.21.15.190:0/325221028 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff1ac014020 con 0x7ff1b0196730 2024-09-19T08:48:37.724 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.724+0000 7ff1b7bc5640 1 -- 172.21.15.190:0/325221028 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7ff1b0197550 con 0x7ff1b0196730 2024-09-19T08:48:37.725 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:37 smithi190 ceph-mon[35358]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:37.725 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:37 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:48:37.725 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:37 smithi190 ceph-mon[35358]: mon.a calling monitor election 2024-09-19T08:48:37.725 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:37 smithi190 ceph-mon[35358]: mon.c calling monitor election 2024-09-19T08:48:37.725 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:37 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:48:37.725 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:37 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:48:37.726 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:37 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:48:37.726 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:37 smithi190 ceph-mon[35358]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:37.726 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:37 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:48:37.726 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:37 smithi190 ceph-mon[35358]: mon.b calling monitor election 2024-09-19T08:48:37.726 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:37 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:48:37.726 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:37 smithi190 ceph-mon[35358]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:37.726 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:37 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:48:37.726 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:37 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:48:37.726 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:37 smithi190 ceph-mon[35358]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T08:48:37.726 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:37 smithi190 ceph-mon[35358]: monmap epoch 3 2024-09-19T08:48:37.726 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:37 smithi190 ceph-mon[35358]: fsid 91ff74f2-7663-11ef-bceb-c7b262605968 2024-09-19T08:48:37.726 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:37 smithi190 ceph-mon[35358]: last_changed 2024-09-19T08:48:32.338816+0000 2024-09-19T08:48:37.726 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:37 smithi190 ceph-mon[35358]: created 2024-09-19T08:47:04.662007+0000 2024-09-19T08:48:37.727 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:37 smithi190 ceph-mon[35358]: min_mon_release 19 (squid) 2024-09-19T08:48:37.727 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:37 smithi190 ceph-mon[35358]: election_strategy: 1 2024-09-19T08:48:37.727 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:37 smithi190 ceph-mon[35358]: 0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-09-19T08:48:37.727 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:37 smithi190 ceph-mon[35358]: 1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.c 2024-09-19T08:48:37.727 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:37 smithi190 ceph-mon[35358]: 2: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.b 2024-09-19T08:48:37.727 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:37 smithi190 ceph-mon[35358]: fsmap 2024-09-19T08:48:37.727 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:37 smithi190 ceph-mon[35358]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:48:37.727 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:37 smithi190 ceph-mon[35358]: mgrmap e13: x(active, since 45s) 2024-09-19T08:48:37.727 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:37 smithi190 ceph-mon[35358]: overall HEALTH_OK 2024-09-19T08:48:37.727 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:37 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:37.727 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:37 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:37.727 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:37 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:37.727 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:37 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:37.728 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.725+0000 7ff1a6ffd640 1 -- 172.21.15.190:0/325221028 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1285 (secure 0 0 0) 0x7ff1b0197550 con 0x7ff1b0196730 2024-09-19T08:48:37.728 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-19T08:48:37.728 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":3,"fsid":"91ff74f2-7663-11ef-bceb-c7b262605968","modified":"2024-09-19T08:48:32.338816Z","created":"2024-09-19T08:47:04.662007Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:3300","nonce":0},{"type":"v1","addr":"172.21.15.92:6789","nonce":0}]},"addr":"172.21.15.92:6789/0","public_addr":"172.21.15.92:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:3300","nonce":0},{"type":"v1","addr":"172.21.15.190:6789","nonce":0}]},"addr":"172.21.15.190:6789/0","public_addr":"172.21.15.190:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-19T08:48:37.729 INFO:teuthology.orchestra.run.smithi190.stderr:dumped monmap epoch 3 2024-09-19T08:48:37.729 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.729+0000 7ff1b7bc5640 1 -- 172.21.15.190:0/325221028 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff194039730 msgr2=0x7ff19403bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:37.729 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.729+0000 7ff1b7bc5640 1 --2- 172.21.15.190:0/325221028 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff194039730 0x7ff19403bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0005dc0 tx=0x7ff1a0005d10 comp rx=0 tx=0).stop 2024-09-19T08:48:37.729 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.729+0000 7ff1b7bc5640 1 -- 172.21.15.190:0/325221028 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1b0196730 msgr2=0x7ff1b019aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:37.729 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.729+0000 7ff1b7bc5640 1 --2- 172.21.15.190:0/325221028 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1b0196730 0x7ff1b019aac0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac00b520 tx=0x7ff1ac00b9e0 comp rx=0 tx=0).stop 2024-09-19T08:48:37.729 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.729+0000 7ff1b7bc5640 1 -- 172.21.15.190:0/325221028 shutdown_connections 2024-09-19T08:48:37.730 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.729+0000 7ff1b7bc5640 1 --2- 172.21.15.190:0/325221028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1b019b000 0x7ff1b019b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:37.730 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.729+0000 7ff1b7bc5640 1 --2- 172.21.15.190:0/325221028 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff194039730 0x7ff19403bbf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:37.730 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.729+0000 7ff1b7bc5640 1 --2- 172.21.15.190:0/325221028 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1b0196730 0x7ff1b019aac0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:37.730 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.729+0000 7ff1b7bc5640 1 --2- 172.21.15.190:0/325221028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff19c003530 0x7ff1b01961f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:37.730 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.729+0000 7ff1b7bc5640 1 -- 172.21.15.190:0/325221028 >> 172.21.15.190:0/325221028 conn(0x7ff1b00fc220 msgr2=0x7ff1b00fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:37.730 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.729+0000 7ff1b7bc5640 1 -- 172.21.15.190:0/325221028 shutdown_connections 2024-09-19T08:48:37.730 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:37.729+0000 7ff1b7bc5640 1 -- 172.21.15.190:0/325221028 wait complete. 2024-09-19T08:48:37.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:37 smithi092 ceph-mon[31407]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:37.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:37 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:48:37.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:37 smithi092 ceph-mon[31407]: mon.a calling monitor election 2024-09-19T08:48:37.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:37 smithi092 ceph-mon[31407]: mon.c calling monitor election 2024-09-19T08:48:37.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:37 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:48:37.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:37 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:48:37.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:37 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:48:37.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:37 smithi092 ceph-mon[31407]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:37.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:37 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:48:37.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:37 smithi092 ceph-mon[31407]: mon.b calling monitor election 2024-09-19T08:48:37.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:37 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:48:37.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:37 smithi092 ceph-mon[31407]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:37.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:37 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:48:37.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:37 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:48:37.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:37 smithi092 ceph-mon[31407]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T08:48:37.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:37 smithi092 ceph-mon[31407]: monmap epoch 3 2024-09-19T08:48:37.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:37 smithi092 ceph-mon[31407]: fsid 91ff74f2-7663-11ef-bceb-c7b262605968 2024-09-19T08:48:37.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:37 smithi092 ceph-mon[31407]: last_changed 2024-09-19T08:48:32.338816+0000 2024-09-19T08:48:37.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:37 smithi092 ceph-mon[31407]: created 2024-09-19T08:47:04.662007+0000 2024-09-19T08:48:37.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:37 smithi092 ceph-mon[31407]: min_mon_release 19 (squid) 2024-09-19T08:48:37.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:37 smithi092 ceph-mon[31407]: election_strategy: 1 2024-09-19T08:48:37.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:37 smithi092 ceph-mon[31407]: 0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-09-19T08:48:37.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:37 smithi092 ceph-mon[31407]: 1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.c 2024-09-19T08:48:37.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:37 smithi092 ceph-mon[31407]: 2: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.b 2024-09-19T08:48:37.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:37 smithi092 ceph-mon[31407]: fsmap 2024-09-19T08:48:37.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:37 smithi092 ceph-mon[31407]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:48:37.756 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:37 smithi092 ceph-mon[31407]: mgrmap e13: x(active, since 45s) 2024-09-19T08:48:37.756 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:37 smithi092 ceph-mon[31407]: overall HEALTH_OK 2024-09-19T08:48:37.756 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:37 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:37.756 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:37 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:37.756 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:37 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:37.756 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:37 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:37.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:37 smithi167 ceph-mon[35359]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:37.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:37 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:48:37.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:37 smithi167 ceph-mon[35359]: mon.a calling monitor election 2024-09-19T08:48:37.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:37 smithi167 ceph-mon[35359]: mon.c calling monitor election 2024-09-19T08:48:37.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:37 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:48:37.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:37 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:48:37.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:37 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:48:37.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:37 smithi167 ceph-mon[35359]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:37.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:37 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:48:37.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:37 smithi167 ceph-mon[35359]: mon.b calling monitor election 2024-09-19T08:48:37.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:37 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:48:37.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:37 smithi167 ceph-mon[35359]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:37.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:37 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:48:37.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:37 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:48:37.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:37 smithi167 ceph-mon[35359]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T08:48:37.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:37 smithi167 ceph-mon[35359]: monmap epoch 3 2024-09-19T08:48:37.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:37 smithi167 ceph-mon[35359]: fsid 91ff74f2-7663-11ef-bceb-c7b262605968 2024-09-19T08:48:37.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:37 smithi167 ceph-mon[35359]: last_changed 2024-09-19T08:48:32.338816+0000 2024-09-19T08:48:37.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:37 smithi167 ceph-mon[35359]: created 2024-09-19T08:47:04.662007+0000 2024-09-19T08:48:37.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:37 smithi167 ceph-mon[35359]: min_mon_release 19 (squid) 2024-09-19T08:48:37.854 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:37 smithi167 ceph-mon[35359]: election_strategy: 1 2024-09-19T08:48:37.854 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:37 smithi167 ceph-mon[35359]: 0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-09-19T08:48:37.854 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:37 smithi167 ceph-mon[35359]: 1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.c 2024-09-19T08:48:37.854 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:37 smithi167 ceph-mon[35359]: 2: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.b 2024-09-19T08:48:37.854 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:37 smithi167 ceph-mon[35359]: fsmap 2024-09-19T08:48:37.854 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:37 smithi167 ceph-mon[35359]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:48:37.854 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:37 smithi167 ceph-mon[35359]: mgrmap e13: x(active, since 45s) 2024-09-19T08:48:37.854 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:37 smithi167 ceph-mon[35359]: overall HEALTH_OK 2024-09-19T08:48:37.854 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:37 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:37.854 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:37 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:37.854 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:37 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:37.854 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:37 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:38.458 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:38 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:38.459 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:38 smithi190 ceph-mon[35358]: from='client.? 172.21.15.190:0/325221028' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:48:38.459 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:38 smithi190 ceph-mon[35358]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:38.459 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:38 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:48:38.460 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-19T08:48:38.460 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-19T08:48:38.713 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:48:38.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:38 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:38.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:38 smithi092 ceph-mon[31407]: from='client.? 172.21.15.190:0/325221028' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:48:38.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:38 smithi092 ceph-mon[31407]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:38.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:38 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:48:38.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:38 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:38.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:38 smithi167 ceph-mon[35359]: from='client.? 172.21.15.190:0/325221028' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:48:38.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:38 smithi167 ceph-mon[35359]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:38.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:38 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:48:39.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.150+0000 7f0b606e5640 1 -- 172.21.15.92:0/3392517798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b581027b0 msgr2=0x7f0b58102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:39.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.150+0000 7f0b606e5640 1 --2- 172.21.15.92:0/3392517798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b581027b0 0x7f0b58102b90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0b50009810 tx=0x7f0b5002a540 comp rx=0 tx=0).stop 2024-09-19T08:48:39.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.150+0000 7f0b606e5640 1 -- 172.21.15.92:0/3392517798 shutdown_connections 2024-09-19T08:48:39.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.150+0000 7f0b606e5640 1 --2- 172.21.15.92:0/3392517798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b581027b0 0x7f0b58102b90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:39.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.150+0000 7f0b606e5640 1 -- 172.21.15.92:0/3392517798 >> 172.21.15.92:0/3392517798 conn(0x7f0b58077310 msgr2=0x7f0b580fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:39.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.150+0000 7f0b606e5640 1 -- 172.21.15.92:0/3392517798 shutdown_connections 2024-09-19T08:48:39.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.150+0000 7f0b606e5640 1 -- 172.21.15.92:0/3392517798 wait complete. 2024-09-19T08:48:39.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.150+0000 7f0b606e5640 1 Processor -- start 2024-09-19T08:48:39.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.151+0000 7f0b606e5640 1 -- start start 2024-09-19T08:48:39.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.151+0000 7f0b606e5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b581027b0 0x7f0b58197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:39.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.151+0000 7f0b606e5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b581978a0 0x7f0b5819bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:39.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.151+0000 7f0b606e5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b5819c170 0x7f0b5819c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:39.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.151+0000 7f0b606e5640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5810bc80 con 0x7f0b5819c170 2024-09-19T08:48:39.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.151+0000 7f0b606e5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5810bb00 con 0x7f0b581027b0 2024-09-19T08:48:39.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.151+0000 7f0b606e5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5810be00 con 0x7f0b581978a0 2024-09-19T08:48:39.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.151+0000 7f0b5ec82640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b5819c170 0x7f0b5819c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:39.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.151+0000 7f0b5ec82640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b5819c170 0x7f0b5819c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55682/0 (socket says 172.21.15.92:55682) 2024-09-19T08:48:39.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.151+0000 7f0b5ec82640 1 -- 172.21.15.92:0/3169889493 learned_addr learned my addr 172.21.15.92:0/3169889493 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:48:39.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.151+0000 7f0b5e481640 1 --2- 172.21.15.92:0/3169889493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b581027b0 0x7f0b58197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:39.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.151+0000 7f0b5dc80640 1 --2- 172.21.15.92:0/3169889493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b581978a0 0x7f0b5819bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:39.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.151+0000 7f0b5ec82640 1 -- 172.21.15.92:0/3169889493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b581978a0 msgr2=0x7f0b5819bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:39.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.151+0000 7f0b5ec82640 1 --2- 172.21.15.92:0/3169889493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b581978a0 0x7f0b5819bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:39.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.151+0000 7f0b5ec82640 1 -- 172.21.15.92:0/3169889493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b581027b0 msgr2=0x7f0b58197360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:39.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.151+0000 7f0b5ec82640 1 --2- 172.21.15.92:0/3169889493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b581027b0 0x7f0b58197360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:39.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.151+0000 7f0b5ec82640 1 -- 172.21.15.92:0/3169889493 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b581a3ee0 con 0x7f0b5819c170 2024-09-19T08:48:39.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.151+0000 7f0b5dc80640 1 --2- 172.21.15.92:0/3169889493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b581978a0 0x7f0b5819bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:48:39.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.152+0000 7f0b5ec82640 1 --2- 172.21.15.92:0/3169889493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b5819c170 0x7f0b5819c620 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0b5400ba50 tx=0x7f0b5400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:39.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.152+0000 7f0b4f7fe640 1 -- 172.21.15.92:0/3169889493 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b54019070 con 0x7f0b5819c170 2024-09-19T08:48:39.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.152+0000 7f0b4f7fe640 1 -- 172.21.15.92:0/3169889493 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b5400cbe0 con 0x7f0b5819c170 2024-09-19T08:48:39.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.152+0000 7f0b606e5640 1 -- 172.21.15.92:0/3169889493 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b581a4110 con 0x7f0b5819c170 2024-09-19T08:48:39.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.152+0000 7f0b4f7fe640 1 -- 172.21.15.92:0/3169889493 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b540076a0 con 0x7f0b5819c170 2024-09-19T08:48:39.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.152+0000 7f0b606e5640 1 -- 172.21.15.92:0/3169889493 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b581a4620 con 0x7f0b5819c170 2024-09-19T08:48:39.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.153+0000 7f0b606e5640 1 -- 172.21.15.92:0/3169889493 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b58069f10 con 0x7f0b5819c170 2024-09-19T08:48:39.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.153+0000 7f0b4f7fe640 1 -- 172.21.15.92:0/3169889493 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f0b5401c070 con 0x7f0b5819c170 2024-09-19T08:48:39.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.154+0000 7f0b4f7fe640 1 --2- 172.21.15.92:0/3169889493 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f0b44039730 0x7f0b4403bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:39.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.154+0000 7f0b4f7fe640 1 -- 172.21.15.92:0/3169889493 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0b5404c1c0 con 0x7f0b5819c170 2024-09-19T08:48:39.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.154+0000 7f0b5e481640 1 --2- 172.21.15.92:0/3169889493 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f0b44039730 0x7f0b4403bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:39.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.154+0000 7f0b5e481640 1 --2- 172.21.15.92:0/3169889493 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f0b44039730 0x7f0b4403bbf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0b5002aab0 tx=0x7f0b5002aa40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:39.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.162+0000 7f0b4f7fe640 1 -- 172.21.15.92:0/3169889493 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0b54019210 con 0x7f0b5819c170 2024-09-19T08:48:39.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.341+0000 7f0b606e5640 1 -- 172.21.15.92:0/3169889493 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f0b58102b90 con 0x7f0b5819c170 2024-09-19T08:48:39.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.341+0000 7f0b4f7fe640 1 -- 172.21.15.92:0/3169889493 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7f0b58102b90 con 0x7f0b5819c170 2024-09-19T08:48:39.341 INFO:teuthology.orchestra.run.smithi092.stdout:# minimal ceph.conf for 91ff74f2-7663-11ef-bceb-c7b262605968 2024-09-19T08:48:39.341 INFO:teuthology.orchestra.run.smithi092.stdout:[global] 2024-09-19T08:48:39.345 INFO:teuthology.orchestra.run.smithi092.stdout: fsid = 91ff74f2-7663-11ef-bceb-c7b262605968 2024-09-19T08:48:39.345 INFO:teuthology.orchestra.run.smithi092.stdout: mon_host = [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-09-19T08:48:39.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.343+0000 7f0b606e5640 1 -- 172.21.15.92:0/3169889493 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f0b44039730 msgr2=0x7f0b4403bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:39.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.343+0000 7f0b606e5640 1 --2- 172.21.15.92:0/3169889493 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f0b44039730 0x7f0b4403bbf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0b5002aab0 tx=0x7f0b5002aa40 comp rx=0 tx=0).stop 2024-09-19T08:48:39.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.343+0000 7f0b606e5640 1 -- 172.21.15.92:0/3169889493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b5819c170 msgr2=0x7f0b5819c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:39.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.343+0000 7f0b606e5640 1 --2- 172.21.15.92:0/3169889493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b5819c170 0x7f0b5819c620 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0b5400ba50 tx=0x7f0b5400bf10 comp rx=0 tx=0).stop 2024-09-19T08:48:39.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.343+0000 7f0b606e5640 1 -- 172.21.15.92:0/3169889493 shutdown_connections 2024-09-19T08:48:39.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.343+0000 7f0b606e5640 1 --2- 172.21.15.92:0/3169889493 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f0b44039730 0x7f0b4403bbf0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:39.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.343+0000 7f0b606e5640 1 --2- 172.21.15.92:0/3169889493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b5819c170 0x7f0b5819c620 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:39.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.343+0000 7f0b606e5640 1 --2- 172.21.15.92:0/3169889493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b581978a0 0x7f0b5819bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:39.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.343+0000 7f0b606e5640 1 --2- 172.21.15.92:0/3169889493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b581027b0 0x7f0b58197360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:39.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.343+0000 7f0b606e5640 1 -- 172.21.15.92:0/3169889493 >> 172.21.15.92:0/3169889493 conn(0x7f0b58077310 msgr2=0x7f0b58103670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:39.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.343+0000 7f0b606e5640 1 -- 172.21.15.92:0/3169889493 shutdown_connections 2024-09-19T08:48:39.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:39.343+0000 7f0b606e5640 1 -- 172.21.15.92:0/3169889493 wait complete. 2024-09-19T08:48:39.480 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:48:39 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:48:39.338+0000 7fa8d516e640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-19T08:48:39.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:39 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:39.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:39 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:39.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:39 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:39.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:39 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:39.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:39 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:39.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:39 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:39.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:39 smithi092 ceph-mon[31407]: Updating smithi092:/etc/ceph/ceph.conf 2024-09-19T08:48:39.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:39 smithi092 ceph-mon[31407]: Updating smithi167:/etc/ceph/ceph.conf 2024-09-19T08:48:39.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:39 smithi092 ceph-mon[31407]: Updating smithi190:/etc/ceph/ceph.conf 2024-09-19T08:48:39.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:39 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3169889493' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:39.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:39 smithi092 ceph-mon[31407]: Updating smithi092:/var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:48:39.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:39 smithi092 ceph-mon[31407]: Updating smithi190:/var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:48:39.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:39 smithi092 ceph-mon[31407]: Updating smithi167:/var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:48:39.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:39 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:39.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:39 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:39.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:39 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:39.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:39 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:39.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:39 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:39.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:39 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:39.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:39 smithi167 ceph-mon[35359]: Updating smithi092:/etc/ceph/ceph.conf 2024-09-19T08:48:39.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:39 smithi167 ceph-mon[35359]: Updating smithi167:/etc/ceph/ceph.conf 2024-09-19T08:48:39.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:39 smithi167 ceph-mon[35359]: Updating smithi190:/etc/ceph/ceph.conf 2024-09-19T08:48:39.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:39 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3169889493' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:39.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:39 smithi167 ceph-mon[35359]: Updating smithi092:/var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:48:39.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:39 smithi167 ceph-mon[35359]: Updating smithi190:/var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:48:39.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:39 smithi167 ceph-mon[35359]: Updating smithi167:/var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:48:39.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:39 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:39.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:39 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:39.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:39 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:39.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:39 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:39.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:39 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:39.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:39 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:39.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:39 smithi190 ceph-mon[35358]: Updating smithi092:/etc/ceph/ceph.conf 2024-09-19T08:48:39.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:39 smithi190 ceph-mon[35358]: Updating smithi167:/etc/ceph/ceph.conf 2024-09-19T08:48:39.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:39 smithi190 ceph-mon[35358]: Updating smithi190:/etc/ceph/ceph.conf 2024-09-19T08:48:39.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:39 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3169889493' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:39.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:39 smithi190 ceph-mon[35358]: Updating smithi092:/var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:48:39.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:39 smithi190 ceph-mon[35358]: Updating smithi190:/var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:48:39.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:39 smithi190 ceph-mon[35358]: Updating smithi167:/var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:48:39.977 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-19T08:48:39.977 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-19T08:48:39.977 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T08:48:40.004 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-19T08:48:40.004 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:48:40.070 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-19T08:48:40.070 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T08:48:40.098 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-19T08:48:40.099 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:48:40.164 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-19T08:48:40.164 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T08:48:40.191 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-19T08:48:40.192 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:48:40.256 INFO:tasks.cephadm:Adding mgr.x on smithi092 2024-09-19T08:48:40.256 INFO:tasks.cephadm:Adding mgr.y on smithi167 2024-09-19T08:48:40.256 INFO:tasks.cephadm:Adding mgr.z on smithi190 2024-09-19T08:48:40.257 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi092=x;smithi167=y;smithi190=z' 2024-09-19T08:48:40.529 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:48:40.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:40 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:40.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:40 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:40.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:40 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:40.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:40 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:40.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:40 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:40.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:40 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:40.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:40 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:40.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:40 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:40.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:40 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:40.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:40 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:40.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:40 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:40.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:40 smithi092 ceph-mon[31407]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T08:48:40.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:40 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:48:40.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:40 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:48:40.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:40 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:40.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:40 smithi092 ceph-mon[31407]: Reconfiguring daemon mon.a on smithi092 2024-09-19T08:48:40.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:40 smithi092 ceph-mon[31407]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:40.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:40 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:40.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:40 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:40.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:40 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:40.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:40 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:40.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:40 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:40.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:40 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:40.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:40 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:40.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:40 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:40.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:40 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:40.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:40 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:40.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:40 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:40.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:40 smithi167 ceph-mon[35359]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T08:48:40.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:40 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:48:40.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:40 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:48:40.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:40 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:40.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:40 smithi167 ceph-mon[35359]: Reconfiguring daemon mon.a on smithi092 2024-09-19T08:48:40.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:40 smithi167 ceph-mon[35359]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:40.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:40 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:40.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:40 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:40.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:40 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:40.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:40 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:40.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:40 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:40.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:40 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:40.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:40 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:40.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:40 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:40.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:40 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:40.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:40 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:40.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:40 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:40.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:40 smithi190 ceph-mon[35358]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T08:48:40.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:40 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:48:40.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:40 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:48:40.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:40 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:40.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:40 smithi190 ceph-mon[35358]: Reconfiguring daemon mon.a on smithi092 2024-09-19T08:48:40.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:40 smithi190 ceph-mon[35358]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:40.967 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.964+0000 7fa9867de640 1 -- 172.21.15.190:0/4082639988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9801016e0 msgr2=0x7fa980101ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:40.967 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.964+0000 7fa9867de640 1 --2- 172.21.15.190:0/4082639988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9801016e0 0x7fa980101ae0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa970009880 tx=0x7fa97002a5d0 comp rx=0 tx=0).stop 2024-09-19T08:48:40.967 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.965+0000 7fa9867de640 1 -- 172.21.15.190:0/4082639988 shutdown_connections 2024-09-19T08:48:40.967 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.965+0000 7fa9867de640 1 --2- 172.21.15.190:0/4082639988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9801016e0 0x7fa980101ae0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:40.967 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.965+0000 7fa9867de640 1 -- 172.21.15.190:0/4082639988 >> 172.21.15.190:0/4082639988 conn(0x7fa9800fce90 msgr2=0x7fa9800ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:40.968 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.965+0000 7fa9867de640 1 -- 172.21.15.190:0/4082639988 shutdown_connections 2024-09-19T08:48:40.968 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.965+0000 7fa9867de640 1 -- 172.21.15.190:0/4082639988 wait complete. 2024-09-19T08:48:40.968 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.965+0000 7fa9867de640 1 Processor -- start 2024-09-19T08:48:40.968 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.965+0000 7fa9867de640 1 -- start start 2024-09-19T08:48:40.968 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.966+0000 7fa9867de640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9801016e0 0x7fa980196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:40.968 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.966+0000 7fa9867de640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa980197510 0x7fa98019c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:40.968 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.966+0000 7fa9867de640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa980197990 0x7fa98019eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:40.968 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.966+0000 7fa9867de640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa9801077d0 con 0x7fa980197510 2024-09-19T08:48:40.968 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.966+0000 7fa9867de640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa980107650 con 0x7fa9801016e0 2024-09-19T08:48:40.968 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.966+0000 7fa9867de640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa980107950 con 0x7fa980197990 2024-09-19T08:48:40.968 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.966+0000 7fa984d7b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa980197990 0x7fa98019eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:40.969 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.966+0000 7fa984d7b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa980197990 0x7fa98019eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:40144/0 (socket says 172.21.15.190:40144) 2024-09-19T08:48:40.969 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.966+0000 7fa984d7b640 1 -- 172.21.15.190:0/3160672292 learned_addr learned my addr 172.21.15.190:0/3160672292 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-09-19T08:48:40.969 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.966+0000 7fa97f7fe640 1 --2- 172.21.15.190:0/3160672292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa980197510 0x7fa98019c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:40.969 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.966+0000 7fa97ffff640 1 --2- 172.21.15.190:0/3160672292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9801016e0 0x7fa980196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:40.969 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.966+0000 7fa97f7fe640 1 -- 172.21.15.190:0/3160672292 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa980197990 msgr2=0x7fa98019eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:40.969 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.966+0000 7fa97f7fe640 1 --2- 172.21.15.190:0/3160672292 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa980197990 0x7fa98019eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:40.969 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.966+0000 7fa97f7fe640 1 -- 172.21.15.190:0/3160672292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9801016e0 msgr2=0x7fa980196fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:40.969 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.966+0000 7fa97f7fe640 1 --2- 172.21.15.190:0/3160672292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9801016e0 0x7fa980196fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:40.969 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.966+0000 7fa97f7fe640 1 -- 172.21.15.190:0/3160672292 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa98019f3d0 con 0x7fa980197510 2024-09-19T08:48:40.969 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.966+0000 7fa984d7b640 1 --2- 172.21.15.190:0/3160672292 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa980197990 0x7fa98019eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:48:40.970 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.966+0000 7fa97f7fe640 1 --2- 172.21.15.190:0/3160672292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa980197510 0x7fa98019c580 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa97400b450 tx=0x7fa97400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:40.970 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.967+0000 7fa97d7fa640 1 -- 172.21.15.190:0/3160672292 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa974004230 con 0x7fa980197510 2024-09-19T08:48:40.970 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.967+0000 7fa9867de640 1 -- 172.21.15.190:0/3160672292 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa98019f6c0 con 0x7fa980197510 2024-09-19T08:48:40.970 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.967+0000 7fa9867de640 1 -- 172.21.15.190:0/3160672292 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa98019fcd0 con 0x7fa980197510 2024-09-19T08:48:40.970 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.967+0000 7fa97d7fa640 1 -- 172.21.15.190:0/3160672292 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9740043d0 con 0x7fa980197510 2024-09-19T08:48:40.970 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.967+0000 7fa97d7fa640 1 -- 172.21.15.190:0/3160672292 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa974003bf0 con 0x7fa980197510 2024-09-19T08:48:40.971 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.968+0000 7fa97d7fa640 1 -- 172.21.15.190:0/3160672292 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fa97400f050 con 0x7fa980197510 2024-09-19T08:48:40.971 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.968+0000 7fa9867de640 1 -- 172.21.15.190:0/3160672292 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa96c0052c0 con 0x7fa980197510 2024-09-19T08:48:40.971 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.968+0000 7fa97d7fa640 1 --2- 172.21.15.190:0/3160672292 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa968039730 0x7fa96803bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:40.971 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.968+0000 7fa97d7fa640 1 -- 172.21.15.190:0/3160672292 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa97404bd90 con 0x7fa980197510 2024-09-19T08:48:40.971 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.968+0000 7fa97ffff640 1 --2- 172.21.15.190:0/3160672292 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa968039730 0x7fa96803bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:40.971 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.968+0000 7fa97ffff640 1 --2- 172.21.15.190:0/3160672292 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa968039730 0x7fa96803bbf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa970009230 tx=0x7fa9700315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:40.972 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:40.973+0000 7fa97d7fa640 1 -- 172.21.15.190:0/3160672292 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa974052080 con 0x7fa980197510 2024-09-19T08:48:41.160 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:41.160+0000 7fa9867de640 1 -- 172.21.15.190:0/3160672292 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi092=x;smithi167=y;smithi190=z", "target": ["mon-mgr", ""]}) -- 0x7fa96c000bf0 con 0x7fa968039730 2024-09-19T08:48:41.165 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:41.165+0000 7fa97d7fa640 1 -- 172.21.15.190:0/3160672292 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fa96c000bf0 con 0x7fa968039730 2024-09-19T08:48:41.165 INFO:teuthology.orchestra.run.smithi190.stdout:Scheduled mgr update... 2024-09-19T08:48:41.167 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:41.167+0000 7fa9867de640 1 -- 172.21.15.190:0/3160672292 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa968039730 msgr2=0x7fa96803bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:41.167 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:41.167+0000 7fa9867de640 1 --2- 172.21.15.190:0/3160672292 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa968039730 0x7fa96803bbf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa970009230 tx=0x7fa9700315b0 comp rx=0 tx=0).stop 2024-09-19T08:48:41.168 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:41.167+0000 7fa9867de640 1 -- 172.21.15.190:0/3160672292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa980197510 msgr2=0x7fa98019c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:41.168 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:41.167+0000 7fa9867de640 1 --2- 172.21.15.190:0/3160672292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa980197510 0x7fa98019c580 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa97400b450 tx=0x7fa97400b910 comp rx=0 tx=0).stop 2024-09-19T08:48:41.168 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:41.167+0000 7fa9867de640 1 -- 172.21.15.190:0/3160672292 shutdown_connections 2024-09-19T08:48:41.168 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:41.167+0000 7fa9867de640 1 --2- 172.21.15.190:0/3160672292 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa980197990 0x7fa98019eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:41.168 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:41.167+0000 7fa9867de640 1 --2- 172.21.15.190:0/3160672292 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa968039730 0x7fa96803bbf0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:41.168 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:41.167+0000 7fa9867de640 1 --2- 172.21.15.190:0/3160672292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa980197510 0x7fa98019c580 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:41.168 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:41.167+0000 7fa9867de640 1 --2- 172.21.15.190:0/3160672292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9801016e0 0x7fa980196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:41.168 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:41.168+0000 7fa9867de640 1 -- 172.21.15.190:0/3160672292 >> 172.21.15.190:0/3160672292 conn(0x7fa9800fce90 msgr2=0x7fa9800fd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:41.168 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:41.168+0000 7fa9867de640 1 -- 172.21.15.190:0/3160672292 shutdown_connections 2024-09-19T08:48:41.168 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:48:41.168+0000 7fa9867de640 1 -- 172.21.15.190:0/3160672292 wait complete. 2024-09-19T08:48:41.750 DEBUG:teuthology.orchestra.run.smithi167:mgr.y> sudo journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mgr.y.service 2024-09-19T08:48:41.754 DEBUG:teuthology.orchestra.run.smithi190:mgr.z> sudo journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mgr.z.service 2024-09-19T08:48:41.757 INFO:tasks.cephadm:Deploying OSDs... 2024-09-19T08:48:41.757 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-19T08:48:41.757 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T08:48:41.774 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T08:48:41.774 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_1 2024-09-19T08:48:41.830 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T08:48:41.831 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:48:41.831 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-19T08:48:41.831 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:48:41.831 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:48:41.831 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-09-19 08:48:00.629843704 +0000 2024-09-19T08:48:41.831 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-09-19 08:43:29.800682134 +0000 2024-09-19T08:48:41.831 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-09-19 08:43:29.800682134 +0000 2024-09-19T08:48:41.831 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-09-19 08:43:29.800682134 +0000 2024-09-19T08:48:41.832 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T08:48:41.896 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-09-19T08:48:41.896 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-09-19T08:48:41.896 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000217243 s, 2.4 MB/s 2024-09-19T08:48:41.898 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T08:48:41.954 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_2 2024-09-19T08:48:42.012 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T08:48:42.012 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:48:42.012 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-19T08:48:42.013 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:48:42.013 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:48:42.013 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-09-19 08:48:00.660842796 +0000 2024-09-19T08:48:42.013 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-09-19 08:43:30.138672037 +0000 2024-09-19T08:48:42.013 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-09-19 08:43:30.138672037 +0000 2024-09-19T08:48:42.013 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-09-19 08:43:30.138672037 +0000 2024-09-19T08:48:42.013 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T08:48:42.076 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-09-19T08:48:42.076 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-09-19T08:48:42.076 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000282497 s, 1.8 MB/s 2024-09-19T08:48:42.077 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T08:48:42.134 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_3 2024-09-19T08:48:42.189 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T08:48:42.189 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:48:42.190 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-19T08:48:42.190 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:48:42.190 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:48:42.190 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-09-19 08:48:00.693841829 +0000 2024-09-19T08:48:42.190 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-09-19 08:43:30.475661971 +0000 2024-09-19T08:48:42.190 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-09-19 08:43:30.475661971 +0000 2024-09-19T08:48:42.190 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-09-19 08:43:30.475661971 +0000 2024-09-19T08:48:42.190 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T08:48:42.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:42 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:42.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:42 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:42.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:42 smithi092 ceph-mon[31407]: Reconfiguring mon.b (monmap changed)... 2024-09-19T08:48:42.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:42 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:48:42.252 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:42 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:48:42.252 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:42 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:42.252 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:42 smithi092 ceph-mon[31407]: Reconfiguring daemon mon.b on smithi167 2024-09-19T08:48:42.252 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:42 smithi092 ceph-mon[31407]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi092=x;smithi167=y;smithi190=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:48:42.252 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:42 smithi092 ceph-mon[31407]: Saving service mgr spec with placement smithi092=x;smithi167=y;smithi190=z;count:3 2024-09-19T08:48:42.252 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:42 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:42.253 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-09-19T08:48:42.253 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-09-19T08:48:42.253 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000207178 s, 2.5 MB/s 2024-09-19T08:48:42.254 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T08:48:42.311 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_4 2024-09-19T08:48:42.367 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T08:48:42.367 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:48:42.367 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-19T08:48:42.367 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:48:42.367 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:48:42.367 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-09-19 08:48:00.729840774 +0000 2024-09-19T08:48:42.367 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-09-19 08:43:30.805652114 +0000 2024-09-19T08:48:42.367 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-09-19 08:43:30.805652114 +0000 2024-09-19T08:48:42.367 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-09-19 08:43:30.805652114 +0000 2024-09-19T08:48:42.368 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T08:48:42.373 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:42 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:42.373 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:42 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:42.373 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:42 smithi190 ceph-mon[35358]: Reconfiguring mon.b (monmap changed)... 2024-09-19T08:48:42.373 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:42 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:48:42.373 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:42 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:48:42.374 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:42 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:42.374 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:42 smithi190 ceph-mon[35358]: Reconfiguring daemon mon.b on smithi167 2024-09-19T08:48:42.374 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:42 smithi190 ceph-mon[35358]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi092=x;smithi167=y;smithi190=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:48:42.374 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:42 smithi190 ceph-mon[35358]: Saving service mgr spec with placement smithi092=x;smithi167=y;smithi190=z;count:3 2024-09-19T08:48:42.374 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:42 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:42.430 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-09-19T08:48:42.430 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-09-19T08:48:42.430 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000203368 s, 2.5 MB/s 2024-09-19T08:48:42.431 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T08:48:42.470 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:42 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:42.470 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:42 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:42.470 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:42 smithi167 ceph-mon[35359]: Reconfiguring mon.b (monmap changed)... 2024-09-19T08:48:42.470 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:42 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:48:42.470 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:42 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:48:42.471 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:42 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:42.471 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:42 smithi167 ceph-mon[35359]: Reconfiguring daemon mon.b on smithi167 2024-09-19T08:48:42.471 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:42 smithi167 ceph-mon[35359]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi092=x;smithi167=y;smithi190=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:48:42.471 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:42 smithi167 ceph-mon[35359]: Saving service mgr spec with placement smithi092=x;smithi167=y;smithi190=z;count:3 2024-09-19T08:48:42.471 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:42 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:42.488 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-19T08:48:42.488 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T08:48:42.504 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T08:48:42.504 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_1 2024-09-19T08:48:42.560 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T08:48:42.560 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:48:42.560 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-19T08:48:42.561 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:48:42.561 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:48:42.561 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-19 08:48:31.755921599 +0000 2024-09-19T08:48:42.561 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-19 08:43:49.178706112 +0000 2024-09-19T08:48:42.561 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-19 08:43:49.178706112 +0000 2024-09-19T08:48:42.561 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-09-19 08:43:49.178706112 +0000 2024-09-19T08:48:42.561 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T08:48:42.624 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-19T08:48:42.625 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-19T08:48:42.625 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000239224 s, 2.1 MB/s 2024-09-19T08:48:42.626 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T08:48:42.683 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_2 2024-09-19T08:48:42.737 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T08:48:42.737 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:48:42.737 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 682 Links: 1 2024-09-19T08:48:42.737 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:48:42.738 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:48:42.738 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-19 08:48:31.755921599 +0000 2024-09-19T08:48:42.738 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-19 08:43:49.496700703 +0000 2024-09-19T08:48:42.738 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-19 08:43:49.496700703 +0000 2024-09-19T08:48:42.738 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-09-19 08:43:49.496700703 +0000 2024-09-19T08:48:42.738 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T08:48:42.800 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-19T08:48:42.801 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-19T08:48:42.801 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000228799 s, 2.2 MB/s 2024-09-19T08:48:42.802 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T08:48:42.858 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_3 2024-09-19T08:48:42.914 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T08:48:42.914 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:48:42.914 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-19T08:48:42.914 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:48:42.914 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:48:42.914 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-19 08:48:31.755921599 +0000 2024-09-19T08:48:42.914 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-19 08:43:49.819695209 +0000 2024-09-19T08:48:42.914 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-19 08:43:49.819695209 +0000 2024-09-19T08:48:42.914 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-09-19 08:43:49.819695209 +0000 2024-09-19T08:48:42.915 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T08:48:42.977 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-19T08:48:42.977 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-19T08:48:42.977 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000236745 s, 2.2 MB/s 2024-09-19T08:48:42.978 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T08:48:43.037 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_4 2024-09-19T08:48:43.092 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T08:48:43.092 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:48:43.092 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-19T08:48:43.092 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:48:43.092 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:48:43.092 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-19 08:48:31.756921582 +0000 2024-09-19T08:48:43.092 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-19 08:43:50.144689681 +0000 2024-09-19T08:48:43.092 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-19 08:43:50.144689681 +0000 2024-09-19T08:48:43.092 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-09-19 08:43:50.144689681 +0000 2024-09-19T08:48:43.093 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T08:48:43.156 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-19T08:48:43.157 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-19T08:48:43.157 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000212432 s, 2.4 MB/s 2024-09-19T08:48:43.158 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T08:48:43.215 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-19T08:48:43.215 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T08:48:43.231 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T08:48:43.231 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_1 2024-09-19T08:48:43.287 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T08:48:43.287 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:48:43.287 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-19T08:48:43.287 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:48:43.287 INFO:teuthology.orchestra.run.smithi190.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:48:43.287 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2024-09-19 08:48:22.689589399 +0000 2024-09-19T08:48:43.287 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2024-09-19 08:43:44.686467359 +0000 2024-09-19T08:48:43.287 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2024-09-19 08:43:44.686467359 +0000 2024-09-19T08:48:43.288 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: 2024-09-19 08:43:44.686467359 +0000 2024-09-19T08:48:43.288 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T08:48:43.333 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:43 smithi190 ceph-mon[35358]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:43.333 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:43 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:43.333 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:43 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:43.333 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:43 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:43.333 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:43 smithi190 ceph-mon[35358]: Reconfiguring mon.c (monmap changed)... 2024-09-19T08:48:43.333 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:43 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:48:43.333 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:43 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:48:43.333 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:43 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:43.334 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:43 smithi190 ceph-mon[35358]: Reconfiguring daemon mon.c on smithi190 2024-09-19T08:48:43.351 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2024-09-19T08:48:43.351 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2024-09-19T08:48:43.352 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.00024635 s, 2.1 MB/s 2024-09-19T08:48:43.353 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T08:48:43.408 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_2 2024-09-19T08:48:43.465 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T08:48:43.465 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:48:43.465 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-19T08:48:43.465 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:48:43.465 INFO:teuthology.orchestra.run.smithi190.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:48:43.465 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2024-09-19 08:48:22.690589370 +0000 2024-09-19T08:48:43.465 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2024-09-19 08:43:45.030457401 +0000 2024-09-19T08:48:43.465 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2024-09-19 08:43:45.030457401 +0000 2024-09-19T08:48:43.465 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: 2024-09-19 08:43:45.030457401 +0000 2024-09-19T08:48:43.466 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T08:48:43.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:43 smithi092 ceph-mon[31407]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:43.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:43 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:43.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:43 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:43.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:43 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:43.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:43 smithi092 ceph-mon[31407]: Reconfiguring mon.c (monmap changed)... 2024-09-19T08:48:43.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:43 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:48:43.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:43 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:48:43.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:43 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:43.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:43 smithi092 ceph-mon[31407]: Reconfiguring daemon mon.c on smithi190 2024-09-19T08:48:43.529 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2024-09-19T08:48:43.529 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2024-09-19T08:48:43.529 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000222711 s, 2.3 MB/s 2024-09-19T08:48:43.530 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T08:48:43.587 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_3 2024-09-19T08:48:43.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:43 smithi167 ceph-mon[35359]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:43.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:43 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:43.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:43 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:43.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:43 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:43.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:43 smithi167 ceph-mon[35359]: Reconfiguring mon.c (monmap changed)... 2024-09-19T08:48:43.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:43 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:48:43.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:43 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:48:43.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:43 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:43.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:43 smithi167 ceph-mon[35359]: Reconfiguring daemon mon.c on smithi190 2024-09-19T08:48:43.642 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T08:48:43.643 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:48:43.643 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-19T08:48:43.643 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:48:43.643 INFO:teuthology.orchestra.run.smithi190.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:48:43.643 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2024-09-19 08:48:22.690589370 +0000 2024-09-19T08:48:43.643 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2024-09-19 08:43:45.357447935 +0000 2024-09-19T08:48:43.643 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2024-09-19 08:43:45.357447935 +0000 2024-09-19T08:48:43.643 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: 2024-09-19 08:43:45.357447935 +0000 2024-09-19T08:48:43.643 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T08:48:43.707 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2024-09-19T08:48:43.707 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2024-09-19T08:48:43.707 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.0001863 s, 2.7 MB/s 2024-09-19T08:48:43.708 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T08:48:43.764 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_4 2024-09-19T08:48:43.820 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T08:48:43.820 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:48:43.820 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-19T08:48:43.820 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:48:43.821 INFO:teuthology.orchestra.run.smithi190.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:48:43.821 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2024-09-19 08:48:22.690589370 +0000 2024-09-19T08:48:43.821 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2024-09-19 08:43:45.673438787 +0000 2024-09-19T08:48:43.821 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2024-09-19 08:43:45.673438787 +0000 2024-09-19T08:48:43.821 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: 2024-09-19 08:43:45.673438787 +0000 2024-09-19T08:48:43.821 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T08:48:43.884 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2024-09-19T08:48:43.884 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2024-09-19T08:48:43.884 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000217059 s, 2.4 MB/s 2024-09-19T08:48:43.885 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T08:48:43.942 INFO:tasks.cephadm:Deploying osd.0 on smithi092 with /dev/vg_nvme/lv_4... 2024-09-19T08:48:43.942 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T08:48:44.186 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:48:44.989 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:44 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:44.989 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:44 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:44.989 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:44 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:44.989 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:44 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:44.989 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:44 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:44.990 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:44 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:44.990 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:44 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:48:44.990 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:44 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:48:44.990 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:44 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:48:44.990 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:44 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:44.990 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:44 smithi190 ceph-mon[35358]: Deploying daemon mgr.z on smithi190 2024-09-19T08:48:44.990 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:44 smithi190 ceph-mon[35358]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:45.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:44 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:45.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:44 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:45.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:44 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:45.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:44 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:45.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:44 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:45.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:44 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:45.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:44 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:48:45.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:44 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:48:45.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:44 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:48:45.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:44 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:45.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:44 smithi092 ceph-mon[31407]: Deploying daemon mgr.z on smithi190 2024-09-19T08:48:45.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:44 smithi092 ceph-mon[31407]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:45.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:44 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:45.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:44 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:45.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:44 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:45.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:44 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:45.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:44 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:45.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:44 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:45.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:44 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:48:45.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:44 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:48:45.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:44 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:48:45.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:44 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:45.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:44 smithi167 ceph-mon[35359]: Deploying daemon mgr.z on smithi190 2024-09-19T08:48:45.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:44 smithi167 ceph-mon[35359]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:45.351 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Sep 19 08:48:45 smithi190 systemd[1]: Starting Ceph mgr.z for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T08:48:45.623 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Sep 19 08:48:45 smithi190 podman[37147]: 2024-09-19 08:48:45.466089783 +0000 UTC m=+0.015881016 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:48:45.624 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Sep 19 08:48:45 smithi190 podman[37147]: 2024-09-19 08:48:45.567460412 +0000 UTC m=+0.117251677 container create 48f7f2fac3d0407274fe08060985f8249f876ae8ae7ee379407781d9de8df9ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T08:48:45.971 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Sep 19 08:48:45 smithi190 podman[37147]: 2024-09-19 08:48:45.786213638 +0000 UTC m=+0.336004858 container init 48f7f2fac3d0407274fe08060985f8249f876ae8ae7ee379407781d9de8df9ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-z, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-19T08:48:45.971 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Sep 19 08:48:45 smithi190 podman[37147]: 2024-09-19 08:48:45.789848738 +0000 UTC m=+0.339639962 container start 48f7f2fac3d0407274fe08060985f8249f876ae8ae7ee379407781d9de8df9ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-z, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-19T08:48:45.972 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Sep 19 08:48:45 smithi190 ceph-mgr[37166]: -- 172.21.15.190:0/1619179850 <== mon.1 v2:172.21.15.190:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ce8f7fb0e0 con 0x55ce8f7d8800 2024-09-19T08:48:45.972 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Sep 19 08:48:45 smithi190 bash[37147]: 48f7f2fac3d0407274fe08060985f8249f876ae8ae7ee379407781d9de8df9ec 2024-09-19T08:48:45.972 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Sep 19 08:48:45 smithi190 systemd[1]: Started Ceph mgr.z for 91ff74f2-7663-11ef-bceb-c7b262605968. 2024-09-19T08:48:45.972 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Sep 19 08:48:45 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T08:48:45.910+0000 7f88367a9040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T08:48:45.972 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Sep 19 08:48:45 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T08:48:45.970+0000 7f88367a9040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:48:46.325 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Sep 19 08:48:46 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T08:48:46.116+0000 7f88367a9040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:48:46.325 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Sep 19 08:48:46 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T08:48:46.180+0000 7f88367a9040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:48:46.326 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Sep 19 08:48:46 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T08:48:46.324+0000 7f88367a9040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:48:46.512 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:48:46.538 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi092:vg_nvme/lv_4 2024-09-19T08:48:46.623 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Sep 19 08:48:46 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T08:48:46.461+0000 7f88367a9040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:48:46.778 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:48:47.123 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Sep 19 08:48:46 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T08:48:46.770+0000 7f88367a9040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:48:47.123 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Sep 19 08:48:46 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T08:48:46.829+0000 7f88367a9040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:48:47.123 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Sep 19 08:48:47 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T08:48:47.011+0000 7f88367a9040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:48:47.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:46 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:47.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:46 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:47.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:46 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:47.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:46 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:48:47.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:46 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:48:47.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:46 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:48:47.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:46 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:47.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:46 smithi190 ceph-mon[35358]: Deploying daemon mgr.y on smithi167 2024-09-19T08:48:47.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:46 smithi190 ceph-mon[35358]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:47.170 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:46 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:47.171 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:46 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:47.171 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:46 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:47.171 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:46 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:48:47.171 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:46 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:48:47.171 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:46 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:48:47.171 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:46 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:47.171 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:46 smithi092 ceph-mon[31407]: Deploying daemon mgr.y on smithi167 2024-09-19T08:48:47.171 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:46 smithi092 ceph-mon[31407]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:47.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.194+0000 7fca00dd8640 1 -- 172.21.15.92:0/1877208167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9fc102e00 msgr2=0x7fc9fc103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:47.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.194+0000 7fca00dd8640 1 --2- 172.21.15.92:0/1877208167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9fc102e00 0x7fc9fc103280 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0009900 tx=0x7fc9f002a410 comp rx=0 tx=0).stop 2024-09-19T08:48:47.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.194+0000 7fca00dd8640 1 -- 172.21.15.92:0/1877208167 shutdown_connections 2024-09-19T08:48:47.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.194+0000 7fca00dd8640 1 --2- 172.21.15.92:0/1877208167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9fc1037c0 0x7fc9fc10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:47.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.194+0000 7fca00dd8640 1 --2- 172.21.15.92:0/1877208167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9fc102e00 0x7fc9fc103280 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:47.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.194+0000 7fca00dd8640 1 --2- 172.21.15.92:0/1877208167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9fc101c00 0x7fc9fc102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:47.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.194+0000 7fca00dd8640 1 -- 172.21.15.92:0/1877208167 >> 172.21.15.92:0/1877208167 conn(0x7fc9fc0fd390 msgr2=0x7fc9fc0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:47.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.194+0000 7fca00dd8640 1 -- 172.21.15.92:0/1877208167 shutdown_connections 2024-09-19T08:48:47.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.194+0000 7fca00dd8640 1 -- 172.21.15.92:0/1877208167 wait complete. 2024-09-19T08:48:47.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.195+0000 7fca00dd8640 1 Processor -- start 2024-09-19T08:48:47.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.195+0000 7fca00dd8640 1 -- start start 2024-09-19T08:48:47.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.195+0000 7fca00dd8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9fc101c00 0x7fc9fc197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:47.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.195+0000 7fca00dd8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9fc102e00 0x7fc9fc1983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:47.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.195+0000 7fca00dd8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9fc1037c0 0x7fc9fc19f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:47.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.195+0000 7fca00dd8640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc9fc10d860 con 0x7fc9fc102e00 2024-09-19T08:48:47.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.195+0000 7fca00dd8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc9fc10d6e0 con 0x7fc9fc1037c0 2024-09-19T08:48:47.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.195+0000 7fca00dd8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc9fc10d9e0 con 0x7fc9fc101c00 2024-09-19T08:48:47.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.195+0000 7fc9f9d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9fc102e00 0x7fc9fc1983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:47.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.195+0000 7fc9f9d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9fc102e00 0x7fc9fc1983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57934/0 (socket says 172.21.15.92:57934) 2024-09-19T08:48:47.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.196+0000 7fc9f9d9b640 1 -- 172.21.15.92:0/1162914372 learned_addr learned my addr 172.21.15.92:0/1162914372 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:48:47.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.196+0000 7fc9fad9d640 1 --2- 172.21.15.92:0/1162914372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9fc1037c0 0x7fc9fc19f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:47.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.196+0000 7fc9fa59c640 1 --2- 172.21.15.92:0/1162914372 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9fc101c00 0x7fc9fc197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:47.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.196+0000 7fc9f9d9b640 1 -- 172.21.15.92:0/1162914372 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9fc101c00 msgr2=0x7fc9fc197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:47.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.196+0000 7fc9f9d9b640 1 --2- 172.21.15.92:0/1162914372 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9fc101c00 0x7fc9fc197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:47.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.196+0000 7fc9f9d9b640 1 -- 172.21.15.92:0/1162914372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9fc1037c0 msgr2=0x7fc9fc19f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:47.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.196+0000 7fc9f9d9b640 1 --2- 172.21.15.92:0/1162914372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9fc1037c0 0x7fc9fc19f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:47.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.196+0000 7fc9f9d9b640 1 -- 172.21.15.92:0/1162914372 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9fc19fab0 con 0x7fc9fc102e00 2024-09-19T08:48:47.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.196+0000 7fc9f9d9b640 1 --2- 172.21.15.92:0/1162914372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9fc102e00 0x7fc9fc1983c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0009230 tx=0x7fc9f0004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:47.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.196+0000 7fc9eb7fe640 1 -- 172.21.15.92:0/1162914372 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f003f030 con 0x7fc9fc102e00 2024-09-19T08:48:47.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.196+0000 7fc9eb7fe640 1 -- 172.21.15.92:0/1162914372 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9f0003ce0 con 0x7fc9fc102e00 2024-09-19T08:48:47.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.196+0000 7fca00dd8640 1 -- 172.21.15.92:0/1162914372 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9fc19fd40 con 0x7fc9fc102e00 2024-09-19T08:48:47.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.196+0000 7fc9eb7fe640 1 -- 172.21.15.92:0/1162914372 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f0035070 con 0x7fc9fc102e00 2024-09-19T08:48:47.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.196+0000 7fca00dd8640 1 -- 172.21.15.92:0/1162914372 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9fc1a0210 con 0x7fc9fc102e00 2024-09-19T08:48:47.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.197+0000 7fc9eb7fe640 1 -- 172.21.15.92:0/1162914372 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fc9f0042030 con 0x7fc9fc102e00 2024-09-19T08:48:47.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.197+0000 7fca00dd8640 1 -- 172.21.15.92:0/1162914372 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9fc108fd0 con 0x7fc9fc102e00 2024-09-19T08:48:47.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.197+0000 7fc9eb7fe640 1 --2- 172.21.15.92:0/1162914372 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc9e4039500 0x7fc9e403b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:47.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.197+0000 7fc9eb7fe640 1 -- 172.21.15.92:0/1162914372 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc9f006cd60 con 0x7fc9fc102e00 2024-09-19T08:48:47.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.197+0000 7fc9fa59c640 1 --2- 172.21.15.92:0/1162914372 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc9e4039500 0x7fc9e403b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:47.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.198+0000 7fc9fa59c640 1 --2- 172.21.15.92:0/1162914372 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc9e4039500 0x7fc9e403b9c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc102c60 tx=0x7fc9ec00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:47.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.202+0000 7fc9eb7fe640 1 -- 172.21.15.92:0/1162914372 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc9f003a8e0 con 0x7fc9fc102e00 2024-09-19T08:48:47.281 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:46 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:47.281 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:46 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:47.281 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:46 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:47.281 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:46 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:48:47.282 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:46 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:48:47.282 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:46 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:48:47.282 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:46 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:47.282 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:46 smithi167 ceph-mon[35359]: Deploying daemon mgr.y on smithi167 2024-09-19T08:48:47.282 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:46 smithi167 ceph-mon[35359]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:47.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:47.376+0000 7fca00dd8640 1 -- 172.21.15.92:0/1162914372 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fc9fc062630 con 0x7fc9e4039500 2024-09-19T08:48:47.851 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 08:48:47 smithi167 systemd[1]: Starting Ceph mgr.y for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T08:48:48.056 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:47 smithi092 ceph-mon[31407]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:48:48.056 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:47 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:48:48.056 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:47 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:48:48.056 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:47 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:48.222 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:47 smithi167 ceph-mon[35359]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:48:48.222 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:47 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:48:48.222 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:47 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:48:48.222 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:47 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:48.222 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 08:48:47 smithi167 podman[36707]: 2024-09-19 08:48:47.951003437 +0000 UTC m=+0.098966027 container create 4818274be14c5e8e817b4fd850f4e0220307cbc9a25012d7818e3aca02b42424 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-19T08:48:48.222 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 08:48:47 smithi167 podman[36707]: 2024-09-19 08:48:47.868163405 +0000 UTC m=+0.016125957 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:48:48.222 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 08:48:48 smithi167 podman[36707]: 2024-09-19 08:48:48.195128555 +0000 UTC m=+0.343091104 container init 4818274be14c5e8e817b4fd850f4e0220307cbc9a25012d7818e3aca02b42424 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-y, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux ) 2024-09-19T08:48:48.223 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 08:48:48 smithi167 podman[36707]: 2024-09-19 08:48:48.198556745 +0000 UTC m=+0.346519290 container start 4818274be14c5e8e817b4fd850f4e0220307cbc9a25012d7818e3aca02b42424 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:48:48.373 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Sep 19 08:48:47 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T08:48:47.877+0000 7f88367a9040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:48:48.373 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Sep 19 08:48:47 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T08:48:47.943+0000 7f88367a9040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:48:48.374 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:47 smithi190 ceph-mon[35358]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:48:48.374 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:47 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:48:48.374 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:47 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:48:48.374 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:47 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:48.538 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 08:48:48 smithi167 ceph-mgr[36726]: -- 172.21.15.167:0/540696702 <== mon.2 v2:172.21.15.167:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560eb7ba30e0 con 0x560eb7b81400 2024-09-19T08:48:48.538 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 08:48:48 smithi167 bash[36707]: 4818274be14c5e8e817b4fd850f4e0220307cbc9a25012d7818e3aca02b42424 2024-09-19T08:48:48.539 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 08:48:48 smithi167 systemd[1]: Started Ceph mgr.y for 91ff74f2-7663-11ef-bceb-c7b262605968. 2024-09-19T08:48:48.539 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 08:48:48 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-y[36722]: 2024-09-19T08:48:48.320+0000 7f84b3423040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T08:48:48.539 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 08:48:48 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-y[36722]: 2024-09-19T08:48:48.383+0000 7f84b3423040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:48:48.539 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 08:48:48 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-y[36722]: 2024-09-19T08:48:48.538+0000 7f84b3423040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:48:48.851 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 08:48:48 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-y[36722]: 2024-09-19T08:48:48.606+0000 7f84b3423040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:48:48.851 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 08:48:48 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-y[36722]: 2024-09-19T08:48:48.772+0000 7f84b3423040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:48:48.954 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Sep 19 08:48:48 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T08:48:48.670+0000 7f88367a9040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:48:48.954 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Sep 19 08:48:48 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T08:48:48.800+0000 7f88367a9040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:48:48.954 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Sep 19 08:48:48 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T08:48:48.953+0000 7f88367a9040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:48:49.186 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 08:48:48 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-y[36722]: 2024-09-19T08:48:48.928+0000 7f84b3423040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:48:49.241 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Sep 19 08:48:49 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T08:48:49.014+0000 7f88367a9040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:48:49.241 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Sep 19 08:48:49 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T08:48:49.172+0000 7f88367a9040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:48:49.241 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Sep 19 08:48:49 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T08:48:49.240+0000 7f88367a9040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:48:49.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:49 smithi092 ceph-mon[31407]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:49.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:49 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:49.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:49 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:49.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:49 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:49.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:49 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:49.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:49 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:49.513 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 08:48:49 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-y[36722]: 2024-09-19T08:48:49.255+0000 7f84b3423040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:48:49.513 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 08:48:49 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-y[36722]: 2024-09-19T08:48:49.317+0000 7f84b3423040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:48:49.514 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:49 smithi167 ceph-mon[35359]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:49.514 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:49 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:49.514 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:49 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:49.514 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:49 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:49.514 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:49 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:49.514 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:49 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:49.534 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Sep 19 08:48:49 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T08:48:49.302+0000 7f88367a9040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:48:49.535 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Sep 19 08:48:49 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T08:48:49.463+0000 7f88367a9040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:48:49.535 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Sep 19 08:48:49 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T08:48:49.534+0000 7f88367a9040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:48:49.535 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:49 smithi190 ceph-mon[35358]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:49.535 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:49 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:49.535 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:49 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:49.535 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:49 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:49.535 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:49 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:49.535 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:49 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:49.804 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Sep 19 08:48:49 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T08:48:49.601+0000 7f88367a9040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:48:49.864 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Sep 19 08:48:49 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T08:48:49.687+0000 7f88367a9040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:48:49.865 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Sep 19 08:48:49 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T08:48:49.746+0000 7f88367a9040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:48:49.865 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Sep 19 08:48:49 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T08:48:49.804+0000 7f88367a9040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:48:49.865 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 08:48:49 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-y[36722]: 2024-09-19T08:48:49.513+0000 7f84b3423040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:48:50.601 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 08:48:50 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-y[36722]: 2024-09-19T08:48:50.405+0000 7f84b3423040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:48:50.601 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 08:48:50 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-y[36722]: 2024-09-19T08:48:50.472+0000 7f84b3423040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:48:50.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:50 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3838038031' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fd104fe2-b828-4c98-a499-b212717f2997"}]: dispatch 2024-09-19T08:48:50.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:50 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3838038031' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd104fe2-b828-4c98-a499-b212717f2997"}]': finished 2024-09-19T08:48:50.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:50 smithi167 ceph-mon[35359]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T08:48:50.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:50 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:48:50.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:50 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:50.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:50 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:50.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:50 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:50.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:50 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:50.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:50 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:50.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:50 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:50.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:50 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:50.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:50 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:48:50.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:50 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:48:50.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:50 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:50.603 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:50 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/605833616' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:48:50.623 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Sep 19 08:48:50 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T08:48:50.591+0000 7f88367a9040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:48:50.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:50 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3838038031' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fd104fe2-b828-4c98-a499-b212717f2997"}]: dispatch 2024-09-19T08:48:50.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:50 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3838038031' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd104fe2-b828-4c98-a499-b212717f2997"}]': finished 2024-09-19T08:48:50.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:50 smithi190 ceph-mon[35358]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T08:48:50.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:50 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:48:50.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:50 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:50.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:50 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:50.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:50 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:50.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:50 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:50.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:50 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:50.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:50 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:50.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:50 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:50.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:50 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:48:50.625 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:50 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:48:50.625 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:50 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:50.625 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:50 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/605833616' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:48:50.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:50 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3838038031' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fd104fe2-b828-4c98-a499-b212717f2997"}]: dispatch 2024-09-19T08:48:50.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:50 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3838038031' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd104fe2-b828-4c98-a499-b212717f2997"}]': finished 2024-09-19T08:48:50.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:50 smithi092 ceph-mon[31407]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T08:48:50.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:50 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:48:50.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:50 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:50.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:50 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:50.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:50 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:50.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:50 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:50.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:50 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:50.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:50 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:50.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:50 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:50.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:50 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:48:50.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:50 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:48:50.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:50 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:50.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:50 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/605833616' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:48:51.440 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 08:48:51 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-y[36722]: 2024-09-19T08:48:51.183+0000 7f84b3423040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:48:51.440 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 08:48:51 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-y[36722]: 2024-09-19T08:48:51.297+0000 7f84b3423040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:48:51.441 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 08:48:51 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-y[36722]: 2024-09-19T08:48:51.440+0000 7f84b3423040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:48:51.441 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:51 smithi167 ceph-mon[35359]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T08:48:51.441 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:51 smithi167 ceph-mon[35359]: Reconfiguring daemon mgr.x on smithi092 2024-09-19T08:48:51.441 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:51 smithi167 ceph-mon[35359]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:51.441 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:51 smithi167 ceph-mon[35359]: Standby manager daemon z started 2024-09-19T08:48:51.441 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:51 smithi167 ceph-mon[35359]: from='mgr.? 172.21.15.190:0/3187607399' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T08:48:51.441 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:51 smithi167 ceph-mon[35359]: from='mgr.? 172.21.15.190:0/3187607399' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:48:51.441 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:51 smithi167 ceph-mon[35359]: from='mgr.? 172.21.15.190:0/3187607399' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T08:48:51.441 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:51 smithi167 ceph-mon[35359]: from='mgr.? 172.21.15.190:0/3187607399' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:48:51.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:51.568+0000 7fc9eb7fe640 1 -- 172.21.15.92:0/1162914372 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mgrmap(e 14) ==== 92408+0+0 (secure 0 0 0) 0x7fc9f003a3c0 con 0x7fc9fc102e00 2024-09-19T08:48:51.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:51 smithi190 ceph-mon[35358]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T08:48:51.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:51 smithi190 ceph-mon[35358]: Reconfiguring daemon mgr.x on smithi092 2024-09-19T08:48:51.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:51 smithi190 ceph-mon[35358]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:51.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:51 smithi190 ceph-mon[35358]: Standby manager daemon z started 2024-09-19T08:48:51.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:51 smithi190 ceph-mon[35358]: from='mgr.? 172.21.15.190:0/3187607399' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T08:48:51.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:51 smithi190 ceph-mon[35358]: from='mgr.? 172.21.15.190:0/3187607399' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:48:51.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:51 smithi190 ceph-mon[35358]: from='mgr.? 172.21.15.190:0/3187607399' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T08:48:51.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:51 smithi190 ceph-mon[35358]: from='mgr.? 172.21.15.190:0/3187607399' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:48:51.719 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 08:48:51 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-y[36722]: 2024-09-19T08:48:51.501+0000 7f84b3423040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:48:51.719 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 08:48:51 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-y[36722]: 2024-09-19T08:48:51.652+0000 7f84b3423040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:48:51.719 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 08:48:51 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-y[36722]: 2024-09-19T08:48:51.719+0000 7f84b3423040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:48:51.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:51 smithi092 ceph-mon[31407]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T08:48:51.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:51 smithi092 ceph-mon[31407]: Reconfiguring daemon mgr.x on smithi092 2024-09-19T08:48:51.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:51 smithi092 ceph-mon[31407]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:51.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:51 smithi092 ceph-mon[31407]: Standby manager daemon z started 2024-09-19T08:48:51.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:51 smithi092 ceph-mon[31407]: from='mgr.? 172.21.15.190:0/3187607399' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T08:48:51.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:51 smithi092 ceph-mon[31407]: from='mgr.? 172.21.15.190:0/3187607399' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:48:51.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:51 smithi092 ceph-mon[31407]: from='mgr.? 172.21.15.190:0/3187607399' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T08:48:51.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:51 smithi092 ceph-mon[31407]: from='mgr.? 172.21.15.190:0/3187607399' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:48:52.001 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 08:48:51 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-y[36722]: 2024-09-19T08:48:51.779+0000 7f84b3423040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:48:52.001 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 08:48:51 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-y[36722]: 2024-09-19T08:48:51.936+0000 7f84b3423040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:48:52.001 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 08:48:52 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-y[36722]: 2024-09-19T08:48:52.001+0000 7f84b3423040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:48:52.266 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 08:48:52 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-y[36722]: 2024-09-19T08:48:52.067+0000 7f84b3423040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:48:52.266 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 08:48:52 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-y[36722]: 2024-09-19T08:48:52.147+0000 7f84b3423040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:48:52.267 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 08:48:52 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-y[36722]: 2024-09-19T08:48:52.206+0000 7f84b3423040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:48:52.267 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 08:48:52 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-y[36722]: 2024-09-19T08:48:52.266+0000 7f84b3423040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:48:52.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:52 smithi167 ceph-mon[35359]: mgrmap e14: x(active, since 59s), standbys: z 2024-09-19T08:48:52.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:52 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T08:48:52.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:52 smithi167 ceph-mon[35359]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:52.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:52 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:52.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:52 smithi190 ceph-mon[35358]: mgrmap e14: x(active, since 59s), standbys: z 2024-09-19T08:48:52.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:52 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T08:48:52.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:52 smithi190 ceph-mon[35358]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:52.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:52 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:53.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:52 smithi092 ceph-mon[31407]: mgrmap e14: x(active, since 59s), standbys: z 2024-09-19T08:48:53.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T08:48:53.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:52 smithi092 ceph-mon[31407]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:53.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:53.351 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 08:48:53 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-y[36722]: 2024-09-19T08:48:53.053+0000 7f84b3423040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:48:53.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:48:53.580+0000 7fc9eb7fe640 1 -- 172.21.15.92:0/1162914372 <== mon.0 v2:172.21.15.92:3300/0 8 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7fc9f0043ca0 con 0x7fc9fc102e00 2024-09-19T08:48:53.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:53 smithi167 ceph-mon[35359]: Standby manager daemon y started 2024-09-19T08:48:53.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:53 smithi167 ceph-mon[35359]: from='mgr.? 172.21.15.167:0/4131874438' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T08:48:53.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:53 smithi167 ceph-mon[35359]: from='mgr.? 172.21.15.167:0/4131874438' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:48:53.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:53 smithi167 ceph-mon[35359]: from='mgr.? 172.21.15.167:0/4131874438' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T08:48:53.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:53 smithi167 ceph-mon[35359]: from='mgr.? 172.21.15.167:0/4131874438' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:48:53.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:53 smithi190 ceph-mon[35358]: Standby manager daemon y started 2024-09-19T08:48:53.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:53 smithi190 ceph-mon[35358]: from='mgr.? 172.21.15.167:0/4131874438' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T08:48:53.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:53 smithi190 ceph-mon[35358]: from='mgr.? 172.21.15.167:0/4131874438' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:48:53.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:53 smithi190 ceph-mon[35358]: from='mgr.? 172.21.15.167:0/4131874438' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T08:48:53.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:53 smithi190 ceph-mon[35358]: from='mgr.? 172.21.15.167:0/4131874438' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:48:54.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:53 smithi092 ceph-mon[31407]: Standby manager daemon y started 2024-09-19T08:48:54.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:53 smithi092 ceph-mon[31407]: from='mgr.? 172.21.15.167:0/4131874438' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T08:48:54.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:53 smithi092 ceph-mon[31407]: from='mgr.? 172.21.15.167:0/4131874438' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:48:54.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:53 smithi092 ceph-mon[31407]: from='mgr.? 172.21.15.167:0/4131874438' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T08:48:54.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:53 smithi092 ceph-mon[31407]: from='mgr.? 172.21.15.167:0/4131874438' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:48:54.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:54 smithi167 ceph-mon[35359]: mgrmap e15: x(active, since 61s), standbys: z, y 2024-09-19T08:48:54.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:54 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T08:48:54.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:54 smithi167 ceph-mon[35359]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:54.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:54 smithi190 ceph-mon[35358]: mgrmap e15: x(active, since 61s), standbys: z, y 2024-09-19T08:48:54.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:54 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T08:48:54.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:54 smithi190 ceph-mon[35358]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:54.923 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:54 smithi092 ceph-mon[31407]: mgrmap e15: x(active, since 61s), standbys: z, y 2024-09-19T08:48:54.924 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:54 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T08:48:54.924 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:54 smithi092 ceph-mon[31407]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:57.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:57 smithi092 ceph-mon[31407]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:57.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:57 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:57.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:57 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:57.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:57 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:57.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:57 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:57.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:57 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:57.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:57 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:57.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:57 smithi167 ceph-mon[35359]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:57.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:57 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:57.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:57 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:57.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:57 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:57.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:57 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:57.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:57 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:57.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:57 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:57.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:57 smithi190 ceph-mon[35358]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:57.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:57 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:57.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:57 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:57.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:57 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:57.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:57 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:57.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:57 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:57.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:57 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:48:59.301 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:59 smithi092 ceph-mon[31407]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:59.301 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:59 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T08:48:59.301 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:48:59 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:59.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:59 smithi167 ceph-mon[35359]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:59.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:59 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T08:48:59.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:48:59 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:59.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:59 smithi190 ceph-mon[35358]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:48:59.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:59 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T08:48:59.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:48:59 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:00.317 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:00 smithi092 ceph-mon[31407]: Deploying daemon osd.0 on smithi092 2024-09-19T08:49:00.502 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:00 smithi167 ceph-mon[35359]: Deploying daemon osd.0 on smithi092 2024-09-19T08:49:00.524 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:00 smithi190 ceph-mon[35358]: Deploying daemon osd.0 on smithi092 2024-09-19T08:49:01.417 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:01 smithi092 ceph-mon[31407]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:49:01.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:01 smithi167 ceph-mon[35359]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:49:01.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:01 smithi190 ceph-mon[35358]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:49:03.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:03 smithi167 ceph-mon[35359]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:49:03.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:03 smithi190 ceph-mon[35358]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:49:03.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:03 smithi092 ceph-mon[31407]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:49:05.518 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:05 smithi092 ceph-mon[31407]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:49:05.519 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:05 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:49:05.519 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:05 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:05.519 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:05 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:05.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:05 smithi167 ceph-mon[35359]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:49:05.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:05 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:49:05.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:05 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:05.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:05 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:05.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:05 smithi190 ceph-mon[35358]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:49:05.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:05 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:49:05.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:05 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:05.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:05 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:07.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:07 smithi092 ceph-mon[31407]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:49:07.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:07 smithi167 ceph-mon[35359]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:49:07.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:07 smithi190 ceph-mon[35358]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:49:08.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:08 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:08.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:08 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:08.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:08 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:08.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:08 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:49:08.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:08 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:08.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:08 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:08.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:08 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:08.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:08 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:08.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:08 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:49:08.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:08 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:08.673 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:08 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:08.673 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:08 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:08.673 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:08 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:08.674 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:08 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:49:08.674 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:08 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:08.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:49:08.935+0000 7fc9eb7fe640 1 -- 172.21.15.92:0/1162914372 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc9fc062630 con 0x7fc9e4039500 2024-09-19T08:49:08.936 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 0 on host 'smithi092' 2024-09-19T08:49:08.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:49:08.937+0000 7fca00dd8640 1 -- 172.21.15.92:0/1162914372 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc9e4039500 msgr2=0x7fc9e403b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:08.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:49:08.937+0000 7fca00dd8640 1 --2- 172.21.15.92:0/1162914372 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc9e4039500 0x7fc9e403b9c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc102c60 tx=0x7fc9ec00a2d0 comp rx=0 tx=0).stop 2024-09-19T08:49:08.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:49:08.937+0000 7fca00dd8640 1 -- 172.21.15.92:0/1162914372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9fc102e00 msgr2=0x7fc9fc1983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:08.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:49:08.937+0000 7fca00dd8640 1 --2- 172.21.15.92:0/1162914372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9fc102e00 0x7fc9fc1983c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0009230 tx=0x7fc9f0004430 comp rx=0 tx=0).stop 2024-09-19T08:49:08.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:49:08.937+0000 7fca00dd8640 1 -- 172.21.15.92:0/1162914372 shutdown_connections 2024-09-19T08:49:08.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:49:08.937+0000 7fca00dd8640 1 --2- 172.21.15.92:0/1162914372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9fc1037c0 0x7fc9fc19f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:08.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:49:08.937+0000 7fca00dd8640 1 --2- 172.21.15.92:0/1162914372 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc9e4039500 0x7fc9e403b9c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:08.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:49:08.937+0000 7fca00dd8640 1 --2- 172.21.15.92:0/1162914372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9fc102e00 0x7fc9fc1983c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:08.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:49:08.937+0000 7fca00dd8640 1 --2- 172.21.15.92:0/1162914372 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9fc101c00 0x7fc9fc197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:08.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:49:08.937+0000 7fca00dd8640 1 -- 172.21.15.92:0/1162914372 >> 172.21.15.92:0/1162914372 conn(0x7fc9fc0fd390 msgr2=0x7fc9fc1061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:08.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:49:08.937+0000 7fca00dd8640 1 -- 172.21.15.92:0/1162914372 shutdown_connections 2024-09-19T08:49:08.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:49:08.937+0000 7fca00dd8640 1 -- 172.21.15.92:0/1162914372 wait complete. 2024-09-19T08:49:09.562 DEBUG:teuthology.orchestra.run.smithi092:osd.0> sudo journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@osd.0.service 2024-09-19T08:49:09.565 INFO:tasks.cephadm:Deploying osd.1 on smithi167 with /dev/vg_nvme/lv_4... 2024-09-19T08:49:09.565 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T08:49:09.589 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:09 smithi167 ceph-mon[35359]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:49:09.589 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:09 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:49:09.590 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:09 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:09.590 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:09 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:09.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:09 smithi190 ceph-mon[35358]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:49:09.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:09 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:49:09.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:09 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:09.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:09 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:09.736 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:09 smithi092 ceph-mon[31407]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:49:09.736 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:09 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:49:09.736 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:09 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:09.736 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:09 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:09.806 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:49:11.136 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 19 08:49:11 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-0[42949]: 2024-09-19T08:49:11.113+0000 7f83f8aca640 -1 osd.0 0 log_to_monitors true 2024-09-19T08:49:11.441 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:11 smithi167 ceph-mon[35359]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:49:11.441 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:11 smithi167 ceph-mon[35359]: from='osd.0 [v2:172.21.15.92:6802/4232030626,v1:172.21.15.92:6803/4232030626]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T08:49:11.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:11 smithi092 ceph-mon[31407]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:49:11.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:11 smithi092 ceph-mon[31407]: from='osd.0 [v2:172.21.15.92:6802/4232030626,v1:172.21.15.92:6803/4232030626]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T08:49:11.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:11 smithi190 ceph-mon[35358]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:49:11.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:11 smithi190 ceph-mon[35358]: from='osd.0 [v2:172.21.15.92:6802/4232030626,v1:172.21.15.92:6803/4232030626]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T08:49:12.005 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T08:49:12.030 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi167:vg_nvme/lv_4 2024-09-19T08:49:12.323 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:49:12.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:12 smithi167 ceph-mon[35359]: from='osd.0 [v2:172.21.15.92:6802/4232030626,v1:172.21.15.92:6803/4232030626]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T08:49:12.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:12 smithi167 ceph-mon[35359]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T08:49:12.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:12 smithi167 ceph-mon[35359]: from='osd.0 [v2:172.21.15.92:6802/4232030626,v1:172.21.15.92:6803/4232030626]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-19T08:49:12.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:12 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:49:12.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:12 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:12.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:12 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:12.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:12 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:49:12.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:12 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:12.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:12 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:12.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:12 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:49:12.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:12 smithi167 ceph-mon[35359]: from='osd.0 [v2:172.21.15.92:6802/4232030626,v1:172.21.15.92:6803/4232030626]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-19T08:49:12.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:12 smithi092 ceph-mon[31407]: from='osd.0 [v2:172.21.15.92:6802/4232030626,v1:172.21.15.92:6803/4232030626]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T08:49:12.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:12 smithi092 ceph-mon[31407]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T08:49:12.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:12 smithi092 ceph-mon[31407]: from='osd.0 [v2:172.21.15.92:6802/4232030626,v1:172.21.15.92:6803/4232030626]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-19T08:49:12.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:12 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:49:12.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:12 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:12.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:12 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:12.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:12 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:49:12.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:12 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:12.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:12 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:12.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:12 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:49:12.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:12 smithi092 ceph-mon[31407]: from='osd.0 [v2:172.21.15.92:6802/4232030626,v1:172.21.15.92:6803/4232030626]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-19T08:49:12.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.825+0000 7fd35b8a6640 1 -- 172.21.15.167:0/3061186574 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd354101cd0 msgr2=0x7fd354102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:12.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.825+0000 7fd35b8a6640 1 --2- 172.21.15.167:0/3061186574 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd354101cd0 0x7fd354102150 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd350009900 tx=0x7fd35002a410 comp rx=0 tx=0).stop 2024-09-19T08:49:12.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.825+0000 7fd35b8a6640 1 -- 172.21.15.167:0/3061186574 shutdown_connections 2024-09-19T08:49:12.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.825+0000 7fd35b8a6640 1 --2- 172.21.15.167:0/3061186574 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd354102690 0x7fd354108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:12.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.825+0000 7fd35b8a6640 1 --2- 172.21.15.167:0/3061186574 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd354101cd0 0x7fd354102150 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:12.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.825+0000 7fd35b8a6640 1 --2- 172.21.15.167:0/3061186574 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd354100ad0 0x7fd354100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:12.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.825+0000 7fd35b8a6640 1 -- 172.21.15.167:0/3061186574 >> 172.21.15.167:0/3061186574 conn(0x7fd3540fc280 msgr2=0x7fd3540fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:12.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.826+0000 7fd35b8a6640 1 -- 172.21.15.167:0/3061186574 shutdown_connections 2024-09-19T08:49:12.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.826+0000 7fd35b8a6640 1 -- 172.21.15.167:0/3061186574 wait complete. 2024-09-19T08:49:12.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.826+0000 7fd35b8a6640 1 Processor -- start 2024-09-19T08:49:12.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.826+0000 7fd35b8a6640 1 -- start start 2024-09-19T08:49:12.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.827+0000 7fd35b8a6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd354100ad0 0x7fd35406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:12.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.827+0000 7fd35b8a6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd354101cd0 0x7fd35419aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:12.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.827+0000 7fd35b8a6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd354102690 0x7fd35419b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:12.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.827+0000 7fd35b8a6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd35410c780 con 0x7fd354101cd0 2024-09-19T08:49:12.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.827+0000 7fd35b8a6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd35410c600 con 0x7fd354100ad0 2024-09-19T08:49:12.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.827+0000 7fd35b8a6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd35410c900 con 0x7fd354102690 2024-09-19T08:49:12.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.827+0000 7fd359642640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd354100ad0 0x7fd35406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:12.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.827+0000 7fd359642640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd354100ad0 0x7fd35406ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33626/0 (socket says 172.21.15.167:33626) 2024-09-19T08:49:12.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.827+0000 7fd359642640 1 -- 172.21.15.167:0/2651543987 learned_addr learned my addr 172.21.15.167:0/2651543987 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-19T08:49:12.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.827+0000 7fd358e41640 1 --2- 172.21.15.167:0/2651543987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd354101cd0 0x7fd35419aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:12.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.827+0000 7fd359e43640 1 --2- 172.21.15.167:0/2651543987 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd354102690 0x7fd35419b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:12.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.827+0000 7fd359642640 1 -- 172.21.15.167:0/2651543987 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd354102690 msgr2=0x7fd35419b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:12.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.827+0000 7fd359642640 1 --2- 172.21.15.167:0/2651543987 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd354102690 0x7fd35419b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:12.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.827+0000 7fd359642640 1 -- 172.21.15.167:0/2651543987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd354101cd0 msgr2=0x7fd35419aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:12.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.827+0000 7fd359642640 1 --2- 172.21.15.167:0/2651543987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd354101cd0 0x7fd35419aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:12.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.827+0000 7fd359642640 1 -- 172.21.15.167:0/2651543987 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd35419b910 con 0x7fd354100ad0 2024-09-19T08:49:12.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.827+0000 7fd358e41640 1 --2- 172.21.15.167:0/2651543987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd354101cd0 0x7fd35419aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:49:12.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.827+0000 7fd359e43640 1 --2- 172.21.15.167:0/2651543987 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd354102690 0x7fd35419b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:49:12.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.827+0000 7fd359642640 1 --2- 172.21.15.167:0/2651543987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd354100ad0 0x7fd35406ab10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd34400d770 tx=0x7fd34400dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:12.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.827+0000 7fd34a7fc640 1 -- 172.21.15.167:0/2651543987 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd344017070 con 0x7fd354100ad0 2024-09-19T08:49:12.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.827+0000 7fd35b8a6640 1 -- 172.21.15.167:0/2651543987 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd35419bc00 con 0x7fd354100ad0 2024-09-19T08:49:12.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.827+0000 7fd34a7fc640 1 -- 172.21.15.167:0/2651543987 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd344009c30 con 0x7fd354100ad0 2024-09-19T08:49:12.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.828+0000 7fd34a7fc640 1 -- 172.21.15.167:0/2651543987 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd344003dd0 con 0x7fd354100ad0 2024-09-19T08:49:12.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.828+0000 7fd35b8a6640 1 -- 172.21.15.167:0/2651543987 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd35419c110 con 0x7fd354100ad0 2024-09-19T08:49:12.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.829+0000 7fd35b8a6640 1 -- 172.21.15.167:0/2651543987 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd35419cb30 con 0x7fd354100ad0 2024-09-19T08:49:12.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.830+0000 7fd34a7fc640 1 -- 172.21.15.167:0/2651543987 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7fd344010460 con 0x7fd354100ad0 2024-09-19T08:49:12.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.830+0000 7fd34a7fc640 1 --2- 172.21.15.167:0/2651543987 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd3400a31b0 0x7fd3400a5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:12.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.831+0000 7fd34a7fc640 1 -- 172.21.15.167:0/2651543987 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7fd3440cd730 con 0x7fd354100ad0 2024-09-19T08:49:12.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.831+0000 7fd358e41640 1 --2- 172.21.15.167:0/2651543987 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd3400a31b0 0x7fd3400a5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:12.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.831+0000 7fd358e41640 1 --2- 172.21.15.167:0/2651543987 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd3400a31b0 0x7fd3400a5670 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd350031440 tx=0x7fd3500315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:12.838 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:12.839+0000 7fd34a7fc640 1 -- 172.21.15.167:0/2651543987 <== mon.2 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd344009de0 con 0x7fd354100ad0 2024-09-19T08:49:12.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:12 smithi190 ceph-mon[35358]: from='osd.0 [v2:172.21.15.92:6802/4232030626,v1:172.21.15.92:6803/4232030626]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T08:49:12.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:12 smithi190 ceph-mon[35358]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T08:49:12.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:12 smithi190 ceph-mon[35358]: from='osd.0 [v2:172.21.15.92:6802/4232030626,v1:172.21.15.92:6803/4232030626]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-19T08:49:12.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:12 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:49:12.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:12 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:12.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:12 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:12.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:12 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:49:12.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:12 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:12.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:12 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:12.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:12 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:49:12.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:12 smithi190 ceph-mon[35358]: from='osd.0 [v2:172.21.15.92:6802/4232030626,v1:172.21.15.92:6803/4232030626]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-19T08:49:13.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:13.019+0000 7fd35b8a6640 1 -- 172.21.15.167:0/2651543987 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fd354107bb0 con 0x7fd3400a31b0 2024-09-19T08:49:13.503 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 19 08:49:13 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-0[42949]: 2024-09-19T08:49:13.135+0000 7f83f422a640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T08:49:13.503 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 19 08:49:13 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-0[42949]: 2024-09-19T08:49:13.144+0000 7f83ec85c640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:49:13.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:13 smithi092 ceph-mon[31407]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:49:13.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:13 smithi092 ceph-mon[31407]: Detected new or changed devices on smithi092 2024-09-19T08:49:13.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:13 smithi092 ceph-mon[31407]: Adjusting osd_memory_target on smithi092 to 17088M 2024-09-19T08:49:13.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:13 smithi092 ceph-mon[31407]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T08:49:13.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:13 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:49:13.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:13 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:13.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:13 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:49:13.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:13 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:49:13.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:13 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:49:13.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:13 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:13.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:13 smithi092 ceph-mon[31407]: from='osd.0 [v2:172.21.15.92:6802/4232030626,v1:172.21.15.92:6803/4232030626]' entity='osd.0' 2024-09-19T08:49:13.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:13 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:49:13.547 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:13 smithi167 ceph-mon[35359]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:49:13.548 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:13 smithi167 ceph-mon[35359]: Detected new or changed devices on smithi092 2024-09-19T08:49:13.548 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:13 smithi167 ceph-mon[35359]: Adjusting osd_memory_target on smithi092 to 17088M 2024-09-19T08:49:13.548 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:13 smithi167 ceph-mon[35359]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T08:49:13.548 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:13 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:49:13.548 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:13 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:13.548 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:13 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:49:13.548 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:13 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:49:13.548 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:13 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:49:13.548 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:13 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:13.548 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:13 smithi167 ceph-mon[35359]: from='osd.0 [v2:172.21.15.92:6802/4232030626,v1:172.21.15.92:6803/4232030626]' entity='osd.0' 2024-09-19T08:49:13.549 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:13 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:49:13.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:13 smithi190 ceph-mon[35358]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:49:13.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:13 smithi190 ceph-mon[35358]: Detected new or changed devices on smithi092 2024-09-19T08:49:13.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:13 smithi190 ceph-mon[35358]: Adjusting osd_memory_target on smithi092 to 17088M 2024-09-19T08:49:13.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:13 smithi190 ceph-mon[35358]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T08:49:13.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:13 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:49:13.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:13 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:13.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:13 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:49:13.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:13 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:49:13.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:13 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:49:13.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:13 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:13.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:13 smithi190 ceph-mon[35358]: from='osd.0 [v2:172.21.15.92:6802/4232030626,v1:172.21.15.92:6803/4232030626]' entity='osd.0' 2024-09-19T08:49:13.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:13 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:49:14.546 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:14 smithi167 ceph-mon[35359]: purged_snaps scrub starts 2024-09-19T08:49:14.546 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:14 smithi167 ceph-mon[35359]: purged_snaps scrub ok 2024-09-19T08:49:14.546 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:14 smithi167 ceph-mon[35359]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:49:14.546 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:14 smithi167 ceph-mon[35359]: osd.0 [v2:172.21.15.92:6802/4232030626,v1:172.21.15.92:6803/4232030626] boot 2024-09-19T08:49:14.546 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:14 smithi167 ceph-mon[35359]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T08:49:14.546 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:14 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:49:14.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:14 smithi092 ceph-mon[31407]: purged_snaps scrub starts 2024-09-19T08:49:14.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:14 smithi092 ceph-mon[31407]: purged_snaps scrub ok 2024-09-19T08:49:14.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:14 smithi092 ceph-mon[31407]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:49:14.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:14 smithi092 ceph-mon[31407]: osd.0 [v2:172.21.15.92:6802/4232030626,v1:172.21.15.92:6803/4232030626] boot 2024-09-19T08:49:14.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:14 smithi092 ceph-mon[31407]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T08:49:14.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:14 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:49:14.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:14 smithi190 ceph-mon[35358]: purged_snaps scrub starts 2024-09-19T08:49:14.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:14 smithi190 ceph-mon[35358]: purged_snaps scrub ok 2024-09-19T08:49:14.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:14 smithi190 ceph-mon[35358]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:49:14.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:14 smithi190 ceph-mon[35358]: osd.0 [v2:172.21.15.92:6802/4232030626,v1:172.21.15.92:6803/4232030626] boot 2024-09-19T08:49:14.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:14 smithi190 ceph-mon[35358]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T08:49:14.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:14 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:49:15.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:15 smithi092 ceph-mon[31407]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:49:15.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:15 smithi092 ceph-mon[31407]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T08:49:15.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:15 smithi092 ceph-mon[31407]: from='client.? 172.21.15.167:0/901485320' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f725330-5e61-413c-b3c8-41bc2c0d8e6b"}]: dispatch 2024-09-19T08:49:15.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:15 smithi092 ceph-mon[31407]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f725330-5e61-413c-b3c8-41bc2c0d8e6b"}]: dispatch 2024-09-19T08:49:15.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:15 smithi092 ceph-mon[31407]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0f725330-5e61-413c-b3c8-41bc2c0d8e6b"}]': finished 2024-09-19T08:49:15.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:15 smithi092 ceph-mon[31407]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T08:49:15.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:15 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:49:15.776 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:15 smithi167 ceph-mon[35359]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:49:15.777 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:15 smithi167 ceph-mon[35359]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T08:49:15.777 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:15 smithi167 ceph-mon[35359]: from='client.? 172.21.15.167:0/901485320' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f725330-5e61-413c-b3c8-41bc2c0d8e6b"}]: dispatch 2024-09-19T08:49:15.777 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:15 smithi167 ceph-mon[35359]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f725330-5e61-413c-b3c8-41bc2c0d8e6b"}]: dispatch 2024-09-19T08:49:15.777 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:15 smithi167 ceph-mon[35359]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0f725330-5e61-413c-b3c8-41bc2c0d8e6b"}]': finished 2024-09-19T08:49:15.777 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:15 smithi167 ceph-mon[35359]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T08:49:15.777 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:15 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:49:15.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:15 smithi190 ceph-mon[35358]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:49:15.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:15 smithi190 ceph-mon[35358]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T08:49:15.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:15 smithi190 ceph-mon[35358]: from='client.? 172.21.15.167:0/901485320' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f725330-5e61-413c-b3c8-41bc2c0d8e6b"}]: dispatch 2024-09-19T08:49:15.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:15 smithi190 ceph-mon[35358]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f725330-5e61-413c-b3c8-41bc2c0d8e6b"}]: dispatch 2024-09-19T08:49:15.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:15 smithi190 ceph-mon[35358]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0f725330-5e61-413c-b3c8-41bc2c0d8e6b"}]': finished 2024-09-19T08:49:15.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:15 smithi190 ceph-mon[35358]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T08:49:15.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:15 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:49:16.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:16 smithi092 ceph-mon[31407]: from='client.? 172.21.15.167:0/3873689143' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:49:16.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:16 smithi167 ceph-mon[35359]: from='client.? 172.21.15.167:0/3873689143' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:49:16.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:16 smithi190 ceph-mon[35358]: from='client.? 172.21.15.167:0/3873689143' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:49:17.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:17 smithi092 ceph-mon[31407]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:49:17.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:17 smithi167 ceph-mon[35359]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:49:17.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:17 smithi190 ceph-mon[35358]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:49:18.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:18 smithi092 ceph-mon[31407]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:49:18.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:18 smithi167 ceph-mon[35359]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:49:18.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:18 smithi190 ceph-mon[35358]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:49:21.461 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:21 smithi167 ceph-mon[35359]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:49:21.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:21 smithi092 ceph-mon[31407]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:49:21.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:21 smithi190 ceph-mon[35358]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:49:23.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:23 smithi092 ceph-mon[31407]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:49:23.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:23 smithi167 ceph-mon[35359]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:49:23.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:23 smithi190 ceph-mon[35358]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:49:24.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:24 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T08:49:24.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:24 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:24.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:24 smithi167 ceph-mon[35359]: Deploying daemon osd.1 on smithi167 2024-09-19T08:49:24.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:24 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T08:49:24.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:24 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:24.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:24 smithi190 ceph-mon[35358]: Deploying daemon osd.1 on smithi167 2024-09-19T08:49:24.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:24 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T08:49:24.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:24 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:24.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:24 smithi092 ceph-mon[31407]: Deploying daemon osd.1 on smithi167 2024-09-19T08:49:25.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:25 smithi167 ceph-mon[35359]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:49:25.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:25 smithi190 ceph-mon[35358]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:49:25.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:25 smithi092 ceph-mon[31407]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:49:27.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:27 smithi167 ceph-mon[35359]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:49:27.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:27 smithi190 ceph-mon[35358]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:49:27.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:27 smithi092 ceph-mon[31407]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:49:29.509 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:29 smithi167 ceph-mon[35359]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:49:29.555 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:29 smithi092 ceph-mon[31407]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:49:29.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:29 smithi190 ceph-mon[35358]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:49:30.525 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:30 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:49:30.525 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:30 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:30.525 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:30 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:30.570 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:30 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:49:30.571 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:30 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:30.571 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:30 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:30.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:30 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:49:30.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:30 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:30.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:30 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:31.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:31 smithi092 ceph-mon[31407]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:49:31.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:31 smithi167 ceph-mon[35359]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:49:31.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:31 smithi190 ceph-mon[35358]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:49:33.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:32 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:33.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:32 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:33.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:32 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:33.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:32 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:49:33.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:32 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:33.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:32 smithi092 ceph-mon[31407]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:49:33.091 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:33.091 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:33.092 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:33.092 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:49:33.092 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:33.092 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:32 smithi167 ceph-mon[35359]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:49:33.123 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:32 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:33.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:32 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:33.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:32 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:33.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:32 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:49:33.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:32 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:33.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:32 smithi190 ceph-mon[35358]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:49:33.715 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:33.714+0000 7fd34a7fc640 1 -- 172.21.15.167:0/2651543987 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd354107bb0 con 0x7fd3400a31b0 2024-09-19T08:49:33.715 INFO:teuthology.orchestra.run.smithi167.stdout:Created osd(s) 1 on host 'smithi167' 2024-09-19T08:49:33.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:33.716+0000 7fd35b8a6640 1 -- 172.21.15.167:0/2651543987 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd3400a31b0 msgr2=0x7fd3400a5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:33.717 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:33.716+0000 7fd35b8a6640 1 --2- 172.21.15.167:0/2651543987 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd3400a31b0 0x7fd3400a5670 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd350031440 tx=0x7fd3500315b0 comp rx=0 tx=0).stop 2024-09-19T08:49:33.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:33.716+0000 7fd35b8a6640 1 -- 172.21.15.167:0/2651543987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd354100ad0 msgr2=0x7fd35406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:33.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:33.716+0000 7fd35b8a6640 1 --2- 172.21.15.167:0/2651543987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd354100ad0 0x7fd35406ab10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd34400d770 tx=0x7fd34400dc30 comp rx=0 tx=0).stop 2024-09-19T08:49:33.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:33.717+0000 7fd35b8a6640 1 -- 172.21.15.167:0/2651543987 shutdown_connections 2024-09-19T08:49:33.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:33.717+0000 7fd35b8a6640 1 --2- 172.21.15.167:0/2651543987 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd354102690 0x7fd35419b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:33.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:33.717+0000 7fd35b8a6640 1 --2- 172.21.15.167:0/2651543987 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd3400a31b0 0x7fd3400a5670 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:33.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:33.717+0000 7fd35b8a6640 1 --2- 172.21.15.167:0/2651543987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd354101cd0 0x7fd35419aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:33.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:33.717+0000 7fd35b8a6640 1 --2- 172.21.15.167:0/2651543987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd354100ad0 0x7fd35406ab10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:33.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:33.717+0000 7fd35b8a6640 1 -- 172.21.15.167:0/2651543987 >> 172.21.15.167:0/2651543987 conn(0x7fd3540fc280 msgr2=0x7fd354105070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:33.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:33.717+0000 7fd35b8a6640 1 -- 172.21.15.167:0/2651543987 shutdown_connections 2024-09-19T08:49:33.718 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:49:33.717+0000 7fd35b8a6640 1 -- 172.21.15.167:0/2651543987 wait complete. 2024-09-19T08:49:34.021 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:33 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:49:34.021 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:33 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:34.021 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:33 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:34.123 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:33 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:49:34.123 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:33 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:34.123 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:33 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:34.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:33 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:49:34.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:33 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:34.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:33 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:34.315 DEBUG:teuthology.orchestra.run.smithi167:osd.1> sudo journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@osd.1.service 2024-09-19T08:49:34.317 INFO:tasks.cephadm:Deploying osd.2 on smithi190 with /dev/vg_nvme/lv_4... 2024-09-19T08:49:34.318 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T08:49:34.568 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:49:34.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:34 smithi167 ceph-mon[35359]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:49:34.962 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:34 smithi190 ceph-mon[35358]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:49:35.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:34 smithi092 ceph-mon[31407]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:49:35.713 INFO:journalctl@ceph.osd.1.smithi167.stdout:Sep 19 08:49:35 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-1[39853]: 2024-09-19T08:49:35.699+0000 7f2fcf2c3640 -1 osd.1 0 log_to_monitors true 2024-09-19T08:49:35.792 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:35 smithi190 ceph-mon[35358]: from='osd.1 [v2:172.21.15.167:6800/4163493234,v1:172.21.15.167:6801/4163493234]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:49:35.792 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:35 smithi190 ceph-mon[35358]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:49:36.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:35 smithi167 ceph-mon[35359]: from='osd.1 [v2:172.21.15.167:6800/4163493234,v1:172.21.15.167:6801/4163493234]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:49:36.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:35 smithi167 ceph-mon[35359]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:49:36.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:35 smithi092 ceph-mon[31407]: from='osd.1 [v2:172.21.15.167:6800/4163493234,v1:172.21.15.167:6801/4163493234]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:49:36.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:35 smithi092 ceph-mon[31407]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:49:36.867 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-19T08:49:36.900 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi190:vg_nvme/lv_4 2024-09-19T08:49:37.027 INFO:journalctl@ceph.osd.1.smithi167.stdout:Sep 19 08:49:36 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-1[39853]: 2024-09-19T08:49:36.776+0000 7f2fcaa23640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T08:49:37.027 INFO:journalctl@ceph.osd.1.smithi167.stdout:Sep 19 08:49:36 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-1[39853]: 2024-09-19T08:49:36.780+0000 7f2fc705d640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:49:37.027 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:36 smithi167 ceph-mon[35359]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T08:49:37.027 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:36 smithi167 ceph-mon[35359]: from='osd.1 [v2:172.21.15.167:6800/4163493234,v1:172.21.15.167:6801/4163493234]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T08:49:37.027 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:36 smithi167 ceph-mon[35359]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T08:49:37.028 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:36 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:49:37.028 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:36 smithi167 ceph-mon[35359]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T08:49:37.028 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:36 smithi167 ceph-mon[35359]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:49:37.123 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:36 smithi190 ceph-mon[35358]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T08:49:37.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:36 smithi190 ceph-mon[35358]: from='osd.1 [v2:172.21.15.167:6800/4163493234,v1:172.21.15.167:6801/4163493234]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T08:49:37.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:36 smithi190 ceph-mon[35358]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T08:49:37.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:36 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:49:37.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:36 smithi190 ceph-mon[35358]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T08:49:37.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:36 smithi190 ceph-mon[35358]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:49:37.149 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:49:37.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:36 smithi092 ceph-mon[31407]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T08:49:37.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:36 smithi092 ceph-mon[31407]: from='osd.1 [v2:172.21.15.167:6800/4163493234,v1:172.21.15.167:6801/4163493234]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T08:49:37.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:36 smithi092 ceph-mon[31407]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T08:49:37.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:36 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:49:37.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:36 smithi092 ceph-mon[31407]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T08:49:37.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:36 smithi092 ceph-mon[31407]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:49:37.685 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.682+0000 7f3b10aec640 1 -- 172.21.15.190:0/1486809667 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b0c100b00 msgr2=0x7f3b0c100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:37.685 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.682+0000 7f3b10aec640 1 --2- 172.21.15.190:0/1486809667 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b0c100b00 0x7f3b0c100f00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3afc009900 tx=0x7f3afc02a410 comp rx=0 tx=0).stop 2024-09-19T08:49:37.685 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.683+0000 7f3b10aec640 1 -- 172.21.15.190:0/1486809667 shutdown_connections 2024-09-19T08:49:37.685 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.683+0000 7f3b10aec640 1 --2- 172.21.15.190:0/1486809667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b0c1026c0 0x7f3b0c108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.685 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.683+0000 7f3b10aec640 1 --2- 172.21.15.190:0/1486809667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b0c101d00 0x7f3b0c102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.685 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.683+0000 7f3b10aec640 1 --2- 172.21.15.190:0/1486809667 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b0c100b00 0x7f3b0c100f00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.685 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.683+0000 7f3b10aec640 1 -- 172.21.15.190:0/1486809667 >> 172.21.15.190:0/1486809667 conn(0x7f3b0c0fc290 msgr2=0x7f3b0c0fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:37.685 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.683+0000 7f3b10aec640 1 -- 172.21.15.190:0/1486809667 shutdown_connections 2024-09-19T08:49:37.685 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.683+0000 7f3b10aec640 1 -- 172.21.15.190:0/1486809667 wait complete. 2024-09-19T08:49:37.685 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.683+0000 7f3b10aec640 1 Processor -- start 2024-09-19T08:49:37.686 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.683+0000 7f3b10aec640 1 -- start start 2024-09-19T08:49:37.686 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.684+0000 7f3b10aec640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b0c100b00 0x7f3b0c104a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:37.686 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.684+0000 7f3b10aec640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b0c101d00 0x7f3b0c1030e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:37.686 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.684+0000 7f3b10aec640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b0c1026c0 0x7f3b0c103620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:37.686 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.684+0000 7f3b10aec640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0c10c760 con 0x7f3b0c100b00 2024-09-19T08:49:37.686 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.684+0000 7f3b10aec640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0c10c5e0 con 0x7f3b0c1026c0 2024-09-19T08:49:37.686 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.684+0000 7f3b10aec640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0c10c8e0 con 0x7f3b0c101d00 2024-09-19T08:49:37.686 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.684+0000 7f3b09d9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b0c101d00 0x7f3b0c1030e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:37.686 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.684+0000 7f3b0a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b0c100b00 0x7f3b0c104a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:37.686 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.684+0000 7f3b09d9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b0c101d00 0x7f3b0c1030e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:60458/0 (socket says 172.21.15.190:60458) 2024-09-19T08:49:37.686 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.684+0000 7f3b09d9b640 1 -- 172.21.15.190:0/4075388282 learned_addr learned my addr 172.21.15.190:0/4075388282 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-09-19T08:49:37.687 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.684+0000 7f3b0ad9d640 1 --2- 172.21.15.190:0/4075388282 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b0c1026c0 0x7f3b0c103620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:37.687 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.684+0000 7f3b09d9b640 1 -- 172.21.15.190:0/4075388282 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b0c1026c0 msgr2=0x7f3b0c103620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:37.687 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.684+0000 7f3b09d9b640 1 --2- 172.21.15.190:0/4075388282 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b0c1026c0 0x7f3b0c103620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.687 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.684+0000 7f3b09d9b640 1 -- 172.21.15.190:0/4075388282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b0c100b00 msgr2=0x7f3b0c104a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:37.687 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.684+0000 7f3b09d9b640 1 --2- 172.21.15.190:0/4075388282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b0c100b00 0x7f3b0c104a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.687 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.684+0000 7f3b09d9b640 1 -- 172.21.15.190:0/4075388282 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b0c103ee0 con 0x7f3b0c101d00 2024-09-19T08:49:37.687 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.684+0000 7f3b09d9b640 1 --2- 172.21.15.190:0/4075388282 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b0c101d00 0x7f3b0c1030e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3b0000c920 tx=0x7f3b0000cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:37.687 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.684+0000 7f3afb7fe640 1 -- 172.21.15.190:0/4075388282 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b00007c70 con 0x7f3b0c101d00 2024-09-19T08:49:37.687 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.684+0000 7f3afb7fe640 1 -- 172.21.15.190:0/4075388282 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b00007e10 con 0x7f3b0c101d00 2024-09-19T08:49:37.687 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.684+0000 7f3afb7fe640 1 -- 172.21.15.190:0/4075388282 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b00018890 con 0x7f3b0c101d00 2024-09-19T08:49:37.687 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.684+0000 7f3b10aec640 1 -- 172.21.15.190:0/4075388282 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b0c1a2090 con 0x7f3b0c101d00 2024-09-19T08:49:37.687 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.685+0000 7f3b10aec640 1 -- 172.21.15.190:0/4075388282 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b0c1a2550 con 0x7f3b0c101d00 2024-09-19T08:49:37.688 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.685+0000 7f3b10aec640 1 -- 172.21.15.190:0/4075388282 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b0c1a27e0 con 0x7f3b0c101d00 2024-09-19T08:49:37.688 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.687+0000 7f3afb7fe640 1 -- 172.21.15.190:0/4075388282 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f3b00018a50 con 0x7f3b0c101d00 2024-09-19T08:49:37.688 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.687+0000 7f3afb7fe640 1 --2- 172.21.15.190:0/4075388282 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3af40a31b0 0x7f3af40a5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:37.689 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.687+0000 7f3afb7fe640 1 -- 172.21.15.190:0/4075388282 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7f3b000ce260 con 0x7f3b0c101d00 2024-09-19T08:49:37.689 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.688+0000 7f3b0a59c640 1 --2- 172.21.15.190:0/4075388282 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3af40a31b0 0x7f3af40a5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:37.689 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.688+0000 7f3b0a59c640 1 --2- 172.21.15.190:0/4075388282 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3af40a31b0 0x7f3af40a5670 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3afc005ab0 tx=0x7f3afc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:37.690 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.691+0000 7f3afb7fe640 1 -- 172.21.15.190:0/4075388282 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3b00014030 con 0x7f3b0c101d00 2024-09-19T08:49:37.868 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:37.868+0000 7f3b10aec640 1 -- 172.21.15.190:0/4075388282 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f3b0c1a29b0 con 0x7f3af40a31b0 2024-09-19T08:49:37.868 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:37 smithi190 ceph-mon[35358]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-19T08:49:37.868 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:37 smithi190 ceph-mon[35358]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T08:49:37.868 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:37 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:49:37.868 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:37 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:49:37.868 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:37 smithi190 ceph-mon[35358]: Detected new or changed devices on smithi167 2024-09-19T08:49:37.868 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:37 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:37.869 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:37 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:37.869 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:37 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:49:37.869 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:37 smithi190 ceph-mon[35358]: Adjusting osd_memory_target on smithi167 to 17088M 2024-09-19T08:49:37.869 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:37 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:37.869 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:37 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:37.869 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:37 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:49:37.869 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:37 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:38.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:37 smithi167 ceph-mon[35359]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-19T08:49:38.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:37 smithi167 ceph-mon[35359]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T08:49:38.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:37 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:49:38.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:37 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:49:38.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:37 smithi167 ceph-mon[35359]: Detected new or changed devices on smithi167 2024-09-19T08:49:38.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:37 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:38.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:37 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:38.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:37 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:49:38.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:37 smithi167 ceph-mon[35359]: Adjusting osd_memory_target on smithi167 to 17088M 2024-09-19T08:49:38.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:37 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:38.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:37 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:38.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:37 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:49:38.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:37 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:38.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:37 smithi092 ceph-mon[31407]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-19T08:49:38.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:37 smithi092 ceph-mon[31407]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T08:49:38.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:37 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:49:38.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:37 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:49:38.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:37 smithi092 ceph-mon[31407]: Detected new or changed devices on smithi167 2024-09-19T08:49:38.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:37 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:38.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:37 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:38.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:37 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:49:38.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:37 smithi092 ceph-mon[31407]: Adjusting osd_memory_target on smithi167 to 17088M 2024-09-19T08:49:38.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:37 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:38.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:37 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:38.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:37 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:49:38.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:37 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:38.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:38 smithi190 ceph-mon[35358]: purged_snaps scrub starts 2024-09-19T08:49:38.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:38 smithi190 ceph-mon[35358]: purged_snaps scrub ok 2024-09-19T08:49:38.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:38 smithi190 ceph-mon[35358]: osd.1 [v2:172.21.15.167:6800/4163493234,v1:172.21.15.167:6801/4163493234] boot 2024-09-19T08:49:38.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:38 smithi190 ceph-mon[35358]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T08:49:38.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:38 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:49:38.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:38 smithi190 ceph-mon[35358]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:49:38.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:38 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:49:38.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:38 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:49:38.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:38 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:38.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:38 smithi190 ceph-mon[35358]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:49:39.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:38 smithi167 ceph-mon[35359]: purged_snaps scrub starts 2024-09-19T08:49:39.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:38 smithi167 ceph-mon[35359]: purged_snaps scrub ok 2024-09-19T08:49:39.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:38 smithi167 ceph-mon[35359]: osd.1 [v2:172.21.15.167:6800/4163493234,v1:172.21.15.167:6801/4163493234] boot 2024-09-19T08:49:39.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:38 smithi167 ceph-mon[35359]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T08:49:39.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:38 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:49:39.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:38 smithi167 ceph-mon[35359]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:49:39.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:38 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:49:39.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:38 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:49:39.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:38 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:39.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:38 smithi167 ceph-mon[35359]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:49:39.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:38 smithi092 ceph-mon[31407]: purged_snaps scrub starts 2024-09-19T08:49:39.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:38 smithi092 ceph-mon[31407]: purged_snaps scrub ok 2024-09-19T08:49:39.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:38 smithi092 ceph-mon[31407]: osd.1 [v2:172.21.15.167:6800/4163493234,v1:172.21.15.167:6801/4163493234] boot 2024-09-19T08:49:39.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:38 smithi092 ceph-mon[31407]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T08:49:39.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:38 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:49:39.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:38 smithi092 ceph-mon[31407]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:49:39.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:38 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:49:39.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:38 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:49:39.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:38 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:39.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:38 smithi092 ceph-mon[31407]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:49:39.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:39 smithi190 ceph-mon[35358]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T08:49:40.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:39 smithi167 ceph-mon[35359]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T08:49:40.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:39 smithi092 ceph-mon[31407]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T08:49:41.106 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:40 smithi167 ceph-mon[35359]: from='client.? 172.21.15.190:0/874504555' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "286d2943-23a0-4184-93cf-9d3430781f99"}]: dispatch 2024-09-19T08:49:41.106 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:40 smithi167 ceph-mon[35359]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "286d2943-23a0-4184-93cf-9d3430781f99"}]: dispatch 2024-09-19T08:49:41.106 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:40 smithi167 ceph-mon[35359]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "286d2943-23a0-4184-93cf-9d3430781f99"}]': finished 2024-09-19T08:49:41.106 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:40 smithi167 ceph-mon[35359]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T08:49:41.106 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:40 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:49:41.106 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:40 smithi167 ceph-mon[35359]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:49:41.107 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:40 smithi167 ceph-mon[35359]: from='client.? 172.21.15.190:0/2182630936' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:49:41.123 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:40 smithi190 ceph-mon[35358]: from='client.? 172.21.15.190:0/874504555' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "286d2943-23a0-4184-93cf-9d3430781f99"}]: dispatch 2024-09-19T08:49:41.123 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:40 smithi190 ceph-mon[35358]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "286d2943-23a0-4184-93cf-9d3430781f99"}]: dispatch 2024-09-19T08:49:41.123 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:40 smithi190 ceph-mon[35358]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "286d2943-23a0-4184-93cf-9d3430781f99"}]': finished 2024-09-19T08:49:41.123 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:40 smithi190 ceph-mon[35358]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T08:49:41.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:40 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:49:41.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:40 smithi190 ceph-mon[35358]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:49:41.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:40 smithi190 ceph-mon[35358]: from='client.? 172.21.15.190:0/2182630936' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:49:41.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:40 smithi092 ceph-mon[31407]: from='client.? 172.21.15.190:0/874504555' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "286d2943-23a0-4184-93cf-9d3430781f99"}]: dispatch 2024-09-19T08:49:41.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:40 smithi092 ceph-mon[31407]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "286d2943-23a0-4184-93cf-9d3430781f99"}]: dispatch 2024-09-19T08:49:41.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:40 smithi092 ceph-mon[31407]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "286d2943-23a0-4184-93cf-9d3430781f99"}]': finished 2024-09-19T08:49:41.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:40 smithi092 ceph-mon[31407]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T08:49:41.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:40 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:49:41.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:40 smithi092 ceph-mon[31407]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:49:41.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:40 smithi092 ceph-mon[31407]: from='client.? 172.21.15.190:0/2182630936' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:49:43.598 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:43 smithi167 ceph-mon[35359]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:49:43.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:43 smithi190 ceph-mon[35358]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:49:43.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:43 smithi092 ceph-mon[31407]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:49:45.516 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:45 smithi190 ceph-mon[35358]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:49:45.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:45 smithi167 ceph-mon[35359]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:49:45.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:45 smithi092 ceph-mon[31407]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:49:47.448 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:47 smithi190 ceph-mon[35358]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:49:47.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:47 smithi167 ceph-mon[35359]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:49:47.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:47 smithi092 ceph-mon[31407]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:49:49.313 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:49 smithi190 ceph-mon[35358]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:49:49.313 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:49 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T08:49:49.313 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:49 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:49.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:49 smithi167 ceph-mon[35359]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:49:49.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:49 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T08:49:49.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:49 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:49.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:49 smithi092 ceph-mon[31407]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:49:49.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:49 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T08:49:49.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:49 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:50.455 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:50 smithi190 ceph-mon[35358]: Deploying daemon osd.2 on smithi190 2024-09-19T08:49:50.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:50 smithi167 ceph-mon[35359]: Deploying daemon osd.2 on smithi190 2024-09-19T08:49:50.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:50 smithi092 ceph-mon[31407]: Deploying daemon osd.2 on smithi190 2024-09-19T08:49:51.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:51 smithi167 ceph-mon[35359]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:49:51.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:51 smithi190 ceph-mon[35358]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:49:51.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:51 smithi092 ceph-mon[31407]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:49:53.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:53 smithi167 ceph-mon[35359]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:49:53.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:53 smithi190 ceph-mon[35358]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:49:53.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:53 smithi092 ceph-mon[31407]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:49:55.568 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:55 smithi190 ceph-mon[35358]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:49:55.569 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:55 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:49:55.569 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:55 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:55.569 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:55 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:55.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:55 smithi167 ceph-mon[35359]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:49:55.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:55 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:49:55.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:55 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:55.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:55 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:55.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:55 smithi092 ceph-mon[31407]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:49:55.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:55 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:49:55.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:55 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:55.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:55 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:57.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:57 smithi167 ceph-mon[35359]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:49:57.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:57 smithi190 ceph-mon[35358]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:49:57.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:57 smithi092 ceph-mon[31407]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:49:58.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:58 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:58.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:58 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:58.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:58 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:58.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:58 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:49:58.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:58 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:58.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:58 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:58.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:58 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:58.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:58 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:58.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:58 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:49:58.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:58 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:58.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:58 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:58.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:58 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:58.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:58 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:58.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:58 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:49:58.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:58 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:58.896 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:58.895+0000 7f3afb7fe640 1 -- 172.21.15.190:0/4075388282 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3b0c1a29b0 con 0x7f3af40a31b0 2024-09-19T08:49:58.896 INFO:teuthology.orchestra.run.smithi190.stdout:Created osd(s) 2 on host 'smithi190' 2024-09-19T08:49:58.898 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:58.897+0000 7f3b10aec640 1 -- 172.21.15.190:0/4075388282 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3af40a31b0 msgr2=0x7f3af40a5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:58.898 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:58.897+0000 7f3b10aec640 1 --2- 172.21.15.190:0/4075388282 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3af40a31b0 0x7f3af40a5670 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3afc005ab0 tx=0x7f3afc000bc0 comp rx=0 tx=0).stop 2024-09-19T08:49:58.899 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:58.897+0000 7f3b10aec640 1 -- 172.21.15.190:0/4075388282 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b0c101d00 msgr2=0x7f3b0c1030e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:58.899 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:58.897+0000 7f3b10aec640 1 --2- 172.21.15.190:0/4075388282 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b0c101d00 0x7f3b0c1030e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3b0000c920 tx=0x7f3b0000cde0 comp rx=0 tx=0).stop 2024-09-19T08:49:58.899 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:58.897+0000 7f3b10aec640 1 -- 172.21.15.190:0/4075388282 shutdown_connections 2024-09-19T08:49:58.899 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:58.897+0000 7f3b10aec640 1 --2- 172.21.15.190:0/4075388282 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b0c1026c0 0x7f3b0c103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:58.899 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:58.897+0000 7f3b10aec640 1 --2- 172.21.15.190:0/4075388282 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b0c101d00 0x7f3b0c1030e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:58.899 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:58.897+0000 7f3b10aec640 1 --2- 172.21.15.190:0/4075388282 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3af40a31b0 0x7f3af40a5670 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:58.899 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:58.897+0000 7f3b10aec640 1 --2- 172.21.15.190:0/4075388282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b0c100b00 0x7f3b0c104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:58.900 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:58.897+0000 7f3b10aec640 1 -- 172.21.15.190:0/4075388282 >> 172.21.15.190:0/4075388282 conn(0x7f3b0c0fc290 msgr2=0x7f3b0c06a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:58.900 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:58.897+0000 7f3b10aec640 1 -- 172.21.15.190:0/4075388282 shutdown_connections 2024-09-19T08:49:58.900 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:49:58.897+0000 7f3b10aec640 1 -- 172.21.15.190:0/4075388282 wait complete. 2024-09-19T08:49:59.492 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:59 smithi190 ceph-mon[35358]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:49:59.492 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:59 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:49:59.492 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:59 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:59.492 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:49:59 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:59.519 DEBUG:teuthology.orchestra.run.smithi190:osd.2> sudo journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@osd.2.service 2024-09-19T08:49:59.521 INFO:tasks.cephadm:Deploying osd.3 on smithi092 with /dev/vg_nvme/lv_3... 2024-09-19T08:49:59.522 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T08:49:59.654 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:59 smithi092 ceph-mon[31407]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:49:59.654 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:59 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:49:59.654 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:59 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:59.654 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:49:59 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:59.760 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:49:59.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:59 smithi167 ceph-mon[35359]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:49:59.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:59 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:49:59.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:59 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:49:59.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:49:59 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:00.673 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:00 smithi190 ceph-mon[35358]: overall HEALTH_OK 2024-09-19T08:50:00.752 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:00 smithi167 ceph-mon[35359]: overall HEALTH_OK 2024-09-19T08:50:00.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:00 smithi092 ceph-mon[31407]: overall HEALTH_OK 2024-09-19T08:50:00.974 INFO:journalctl@ceph.osd.2.smithi190.stdout:Sep 19 08:50:00 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-2[40361]: 2024-09-19T08:50:00.865+0000 7f13e7144640 -1 osd.2 0 log_to_monitors true 2024-09-19T08:50:01.658 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:01 smithi190 ceph-mon[35358]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:50:01.658 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:01 smithi190 ceph-mon[35358]: from='osd.2 [v2:172.21.15.190:6800/702507556,v1:172.21.15.190:6801/702507556]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:50:01.658 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:01 smithi190 ceph-mon[35358]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:50:01.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:01 smithi092 ceph-mon[31407]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:50:01.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:01 smithi092 ceph-mon[31407]: from='osd.2 [v2:172.21.15.190:6800/702507556,v1:172.21.15.190:6801/702507556]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:50:01.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:01 smithi092 ceph-mon[31407]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:50:01.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:01 smithi167 ceph-mon[35359]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:50:01.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:01 smithi167 ceph-mon[35359]: from='osd.2 [v2:172.21.15.190:6800/702507556,v1:172.21.15.190:6801/702507556]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:50:01.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:01 smithi167 ceph-mon[35359]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:50:02.025 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:50:02.050 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi092:vg_nvme/lv_3 2024-09-19T08:50:02.301 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:02.590 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:02 smithi092 ceph-mon[31407]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T08:50:02.590 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:02 smithi092 ceph-mon[31407]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T08:50:02.591 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:02 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:50:02.591 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:02 smithi092 ceph-mon[31407]: from='osd.2 [v2:172.21.15.190:6800/702507556,v1:172.21.15.190:6801/702507556]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-09-19T08:50:02.591 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:02 smithi092 ceph-mon[31407]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-09-19T08:50:02.591 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:02 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:02.591 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:02 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:02.591 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:02 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:50:02.591 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:02 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:02.591 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:02 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:02.591 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:02 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:50:02.591 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:02 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:02.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:02 smithi190 ceph-mon[35358]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T08:50:02.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:02 smithi190 ceph-mon[35358]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T08:50:02.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:02 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:50:02.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:02 smithi190 ceph-mon[35358]: from='osd.2 [v2:172.21.15.190:6800/702507556,v1:172.21.15.190:6801/702507556]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-09-19T08:50:02.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:02 smithi190 ceph-mon[35358]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-09-19T08:50:02.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:02 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:02.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:02 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:02.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:02 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:50:02.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:02 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:02.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:02 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:02.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:02 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:50:02.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:02 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:02.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.752+0000 7f54850aa640 1 -- 172.21.15.92:0/230130640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5480100ad0 msgr2=0x7f5480100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:02.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.752+0000 7f54850aa640 1 --2- 172.21.15.92:0/230130640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5480100ad0 0x7f5480100ed0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5470009900 tx=0x7f547002a410 comp rx=0 tx=0).stop 2024-09-19T08:50:02.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.752+0000 7f54850aa640 1 -- 172.21.15.92:0/230130640 shutdown_connections 2024-09-19T08:50:02.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.752+0000 7f54850aa640 1 --2- 172.21.15.92:0/230130640 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5480102690 0x7f5480108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:02.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.752+0000 7f54850aa640 1 --2- 172.21.15.92:0/230130640 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5480101cd0 0x7f5480102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:02.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.752+0000 7f54850aa640 1 --2- 172.21.15.92:0/230130640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5480100ad0 0x7f5480100ed0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:02.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.752+0000 7f54850aa640 1 -- 172.21.15.92:0/230130640 >> 172.21.15.92:0/230130640 conn(0x7f54800fc280 msgr2=0x7f54800fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:02.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.752+0000 7f54850aa640 1 -- 172.21.15.92:0/230130640 shutdown_connections 2024-09-19T08:50:02.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.752+0000 7f54850aa640 1 -- 172.21.15.92:0/230130640 wait complete. 2024-09-19T08:50:02.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.753+0000 7f54850aa640 1 Processor -- start 2024-09-19T08:50:02.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.753+0000 7f54850aa640 1 -- start start 2024-09-19T08:50:02.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.753+0000 7f54850aa640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5480100ad0 0x7f548006aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:02.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.753+0000 7f54850aa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5480101cd0 0x7f548019f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:02.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.753+0000 7f54850aa640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5480102690 0x7f54801a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:02.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.753+0000 7f54850aa640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f548010c750 con 0x7f5480102690 2024-09-19T08:50:02.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.753+0000 7f54850aa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f548010c5d0 con 0x7f5480101cd0 2024-09-19T08:50:02.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.753+0000 7f54850aa640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f548010c8d0 con 0x7f5480100ad0 2024-09-19T08:50:02.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.753+0000 7f547f59e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5480102690 0x7f54801a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:02.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.753+0000 7f547ed9d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5480100ad0 0x7f548006aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:02.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.753+0000 7f547f59e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5480102690 0x7f54801a15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53492/0 (socket says 172.21.15.92:53492) 2024-09-19T08:50:02.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.753+0000 7f547f59e640 1 -- 172.21.15.92:0/1253489007 learned_addr learned my addr 172.21.15.92:0/1253489007 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:50:02.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.753+0000 7f547e59c640 1 --2- 172.21.15.92:0/1253489007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5480101cd0 0x7f548019f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:02.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.753+0000 7f547f59e640 1 -- 172.21.15.92:0/1253489007 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5480100ad0 msgr2=0x7f548006aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:02.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.753+0000 7f547f59e640 1 --2- 172.21.15.92:0/1253489007 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5480100ad0 0x7f548006aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:02.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.753+0000 7f547f59e640 1 -- 172.21.15.92:0/1253489007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5480101cd0 msgr2=0x7f548019f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:02.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.753+0000 7f547f59e640 1 --2- 172.21.15.92:0/1253489007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5480101cd0 0x7f548019f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:02.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.753+0000 7f547f59e640 1 -- 172.21.15.92:0/1253489007 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54801a1dd0 con 0x7f5480102690 2024-09-19T08:50:02.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.753+0000 7f547ed9d640 1 --2- 172.21.15.92:0/1253489007 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5480100ad0 0x7f548006aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:50:02.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.754+0000 7f547f59e640 1 --2- 172.21.15.92:0/1253489007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5480102690 0x7f54801a15e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5478009fd0 tx=0x7f547800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:02.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.754+0000 7f5467fff640 1 -- 172.21.15.92:0/1253489007 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5478017070 con 0x7f5480102690 2024-09-19T08:50:02.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.754+0000 7f54850aa640 1 -- 172.21.15.92:0/1253489007 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54801a2060 con 0x7f5480102690 2024-09-19T08:50:02.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.754+0000 7f5467fff640 1 -- 172.21.15.92:0/1253489007 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5478003e50 con 0x7f5480102690 2024-09-19T08:50:02.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.754+0000 7f5467fff640 1 -- 172.21.15.92:0/1253489007 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54780106c0 con 0x7f5480102690 2024-09-19T08:50:02.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.754+0000 7f54850aa640 1 -- 172.21.15.92:0/1253489007 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54801a2550 con 0x7f5480102690 2024-09-19T08:50:02.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.755+0000 7f54850aa640 1 -- 172.21.15.92:0/1253489007 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5480107f70 con 0x7f5480102690 2024-09-19T08:50:02.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.756+0000 7f5467fff640 1 -- 172.21.15.92:0/1253489007 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f5478003970 con 0x7f5480102690 2024-09-19T08:50:02.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.757+0000 7f5467fff640 1 --2- 172.21.15.92:0/1253489007 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f54680a31e0 0x7f54680a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:02.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.757+0000 7f547ed9d640 1 --2- 172.21.15.92:0/1253489007 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f54680a31e0 0x7f54680a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:02.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.757+0000 7f5467fff640 1 -- 172.21.15.92:0/1253489007 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2571+0+0 (secure 0 0 0) 0x7f54780cdde0 con 0x7f5480102690 2024-09-19T08:50:02.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.757+0000 7f547ed9d640 1 --2- 172.21.15.92:0/1253489007 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f54680a31e0 0x7f54680a56a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5470005ab0 tx=0x7f5470000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:02.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.760+0000 7f5467fff640 1 -- 172.21.15.92:0/1253489007 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f547809bc00 con 0x7f5480102690 2024-09-19T08:50:02.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:02 smithi167 ceph-mon[35359]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T08:50:02.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:02 smithi167 ceph-mon[35359]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T08:50:02.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:02 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:50:02.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:02 smithi167 ceph-mon[35359]: from='osd.2 [v2:172.21.15.190:6800/702507556,v1:172.21.15.190:6801/702507556]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-09-19T08:50:02.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:02 smithi167 ceph-mon[35359]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-09-19T08:50:02.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:02 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:02.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:02 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:02.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:02 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:50:02.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:02 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:02.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:02 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:02.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:02 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:50:02.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:02 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:02.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:02.939+0000 7f54850aa640 1 -- 172.21.15.92:0/1253489007 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f5480062630 con 0x7f54680a31e0 2024-09-19T08:50:03.623 INFO:journalctl@ceph.osd.2.smithi190.stdout:Sep 19 08:50:03 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-2[40361]: 2024-09-19T08:50:03.227+0000 7f13e28a4640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T08:50:03.623 INFO:journalctl@ceph.osd.2.smithi190.stdout:Sep 19 08:50:03 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-2[40361]: 2024-09-19T08:50:03.235+0000 7f13daed6640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:50:03.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:03 smithi190 ceph-mon[35358]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:50:03.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:03 smithi190 ceph-mon[35358]: Detected new or changed devices on smithi190 2024-09-19T08:50:03.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:03 smithi190 ceph-mon[35358]: Adjusting osd_memory_target on smithi190 to 17088M 2024-09-19T08:50:03.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:03 smithi190 ceph-mon[35358]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-09-19T08:50:03.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:03 smithi190 ceph-mon[35358]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T08:50:03.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:03 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:50:03.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:03 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:50:03.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:03 smithi190 ceph-mon[35358]: from='client.14298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:50:03.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:03 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:50:03.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:03 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:50:03.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:03 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:03.625 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:03 smithi190 ceph-mon[35358]: from='osd.2 ' entity='osd.2' 2024-09-19T08:50:03.670 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:03 smithi092 ceph-mon[31407]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:50:03.670 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:03 smithi092 ceph-mon[31407]: Detected new or changed devices on smithi190 2024-09-19T08:50:03.670 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:03 smithi092 ceph-mon[31407]: Adjusting osd_memory_target on smithi190 to 17088M 2024-09-19T08:50:03.670 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:03 smithi092 ceph-mon[31407]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-09-19T08:50:03.670 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:03 smithi092 ceph-mon[31407]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T08:50:03.670 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:03 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:50:03.670 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:03 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:50:03.670 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:03 smithi092 ceph-mon[31407]: from='client.14298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:50:03.670 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:03 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:50:03.670 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:03 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:50:03.671 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:03 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:03.671 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:03 smithi092 ceph-mon[31407]: from='osd.2 ' entity='osd.2' 2024-09-19T08:50:03.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:03 smithi167 ceph-mon[35359]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:50:03.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:03 smithi167 ceph-mon[35359]: Detected new or changed devices on smithi190 2024-09-19T08:50:03.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:03 smithi167 ceph-mon[35359]: Adjusting osd_memory_target on smithi190 to 17088M 2024-09-19T08:50:03.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:03 smithi167 ceph-mon[35359]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-09-19T08:50:03.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:03 smithi167 ceph-mon[35359]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T08:50:03.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:03 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:50:03.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:03 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:50:03.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:03 smithi167 ceph-mon[35359]: from='client.14298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:50:03.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:03 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:50:03.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:03 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:50:03.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:03 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:03.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:03 smithi167 ceph-mon[35359]: from='osd.2 ' entity='osd.2' 2024-09-19T08:50:04.629 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:04 smithi092 ceph-mon[31407]: purged_snaps scrub starts 2024-09-19T08:50:04.629 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:04 smithi092 ceph-mon[31407]: purged_snaps scrub ok 2024-09-19T08:50:04.629 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:04 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:50:04.629 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:04 smithi092 ceph-mon[31407]: osd.2 [v2:172.21.15.190:6800/702507556,v1:172.21.15.190:6801/702507556] boot 2024-09-19T08:50:04.629 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:04 smithi092 ceph-mon[31407]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T08:50:04.629 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:04 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:50:04.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:04 smithi167 ceph-mon[35359]: purged_snaps scrub starts 2024-09-19T08:50:04.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:04 smithi167 ceph-mon[35359]: purged_snaps scrub ok 2024-09-19T08:50:04.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:04 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:50:04.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:04 smithi167 ceph-mon[35359]: osd.2 [v2:172.21.15.190:6800/702507556,v1:172.21.15.190:6801/702507556] boot 2024-09-19T08:50:04.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:04 smithi167 ceph-mon[35359]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T08:50:04.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:04 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:50:04.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:04 smithi190 ceph-mon[35358]: purged_snaps scrub starts 2024-09-19T08:50:04.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:04 smithi190 ceph-mon[35358]: purged_snaps scrub ok 2024-09-19T08:50:04.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:04 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:50:04.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:04 smithi190 ceph-mon[35358]: osd.2 [v2:172.21.15.190:6800/702507556,v1:172.21.15.190:6801/702507556] boot 2024-09-19T08:50:04.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:04 smithi190 ceph-mon[35358]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T08:50:04.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:04 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:50:05.753 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 19 08:50:05 smithi092 sudo[47418]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:50:05.753 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 19 08:50:05 smithi092 sudo[47418]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:50:05.753 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 19 08:50:05 smithi092 sudo[47418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:50:05.753 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 19 08:50:05 smithi092 sudo[47418]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:50:05.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:05 smithi092 ceph-mon[31407]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:50:05.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:05 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:50:05.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:05 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T08:50:05.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:05 smithi092 ceph-mon[31407]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T08:50:05.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:05 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:50:05.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:05 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/901904416' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d126671-7fc1-4f29-9bc3-3598052fd20a"}]: dispatch 2024-09-19T08:50:05.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:05 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T08:50:05.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:05 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/901904416' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d126671-7fc1-4f29-9bc3-3598052fd20a"}]': finished 2024-09-19T08:50:05.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:05 smithi092 ceph-mon[31407]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T08:50:05.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:05 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:50:05.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:05 smithi167 ceph-mon[35359]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:50:05.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:05 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:50:05.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:05 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T08:50:05.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:05 smithi167 ceph-mon[35359]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T08:50:05.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:05 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:50:05.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:05 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/901904416' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d126671-7fc1-4f29-9bc3-3598052fd20a"}]: dispatch 2024-09-19T08:50:05.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:05 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T08:50:05.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:05 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/901904416' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d126671-7fc1-4f29-9bc3-3598052fd20a"}]': finished 2024-09-19T08:50:05.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:05 smithi167 ceph-mon[35359]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T08:50:05.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:05 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:50:05.876 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:05 smithi190 ceph-mon[35358]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:50:05.876 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:05 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:50:05.877 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:05 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T08:50:05.877 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:05 smithi190 ceph-mon[35358]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T08:50:05.877 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:05 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:50:05.877 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:05 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/901904416' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d126671-7fc1-4f29-9bc3-3598052fd20a"}]: dispatch 2024-09-19T08:50:05.877 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:05 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T08:50:05.877 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:05 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/901904416' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d126671-7fc1-4f29-9bc3-3598052fd20a"}]': finished 2024-09-19T08:50:05.877 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:05 smithi190 ceph-mon[35358]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T08:50:05.877 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:05 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:50:06.253 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 19 08:50:05 smithi092 sudo[47424]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:50:06.253 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 19 08:50:05 smithi092 sudo[47424]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:50:06.253 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 19 08:50:05 smithi092 sudo[47424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:50:06.253 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 19 08:50:05 smithi092 sudo[47424]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:50:06.418 INFO:journalctl@ceph.osd.1.smithi167.stdout:Sep 19 08:50:06 smithi167 sudo[43856]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:50:06.418 INFO:journalctl@ceph.osd.1.smithi167.stdout:Sep 19 08:50:06 smithi167 sudo[43856]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:50:06.418 INFO:journalctl@ceph.osd.1.smithi167.stdout:Sep 19 08:50:06 smithi167 sudo[43856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:50:06.418 INFO:journalctl@ceph.osd.1.smithi167.stdout:Sep 19 08:50:06 smithi167 sudo[43856]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:50:06.790 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:06 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3398931670' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:50:06.791 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:06 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:06.791 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:06 smithi190 ceph-mon[35358]: pgmap v77: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:50:06.791 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:06 smithi190 ceph-mon[35358]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T08:50:06.791 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:06 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:50:06.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:06 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3398931670' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:50:06.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:06 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:06.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:06 smithi167 ceph-mon[35359]: pgmap v77: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:50:06.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:06 smithi167 ceph-mon[35359]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T08:50:06.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:06 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:50:06.852 INFO:journalctl@ceph.osd.1.smithi167.stdout:Sep 19 08:50:06 smithi167 sudo[43859]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:50:06.852 INFO:journalctl@ceph.osd.1.smithi167.stdout:Sep 19 08:50:06 smithi167 sudo[43859]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:50:06.852 INFO:journalctl@ceph.osd.1.smithi167.stdout:Sep 19 08:50:06 smithi167 sudo[43859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:50:06.852 INFO:journalctl@ceph.osd.1.smithi167.stdout:Sep 19 08:50:06 smithi167 sudo[43859]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:50:06.933 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:06 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3398931670' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:50:06.933 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:06 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:06.934 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:06 smithi092 ceph-mon[31407]: pgmap v77: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:50:06.934 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:06 smithi092 ceph-mon[31407]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T08:50:06.934 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:06 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:50:06.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:06.933+0000 7f5467fff640 1 -- 172.21.15.92:0/1253489007 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f5478098270 con 0x7f5480102690 2024-09-19T08:50:07.045 INFO:journalctl@ceph.osd.2.smithi190.stdout:Sep 19 08:50:06 smithi190 sudo[44344]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:50:07.045 INFO:journalctl@ceph.osd.2.smithi190.stdout:Sep 19 08:50:06 smithi190 sudo[44344]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:50:07.045 INFO:journalctl@ceph.osd.2.smithi190.stdout:Sep 19 08:50:06 smithi190 sudo[44344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:50:07.045 INFO:journalctl@ceph.osd.2.smithi190.stdout:Sep 19 08:50:06 smithi190 sudo[44344]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:50:07.373 INFO:journalctl@ceph.osd.2.smithi190.stdout:Sep 19 08:50:07 smithi190 sudo[44347]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:50:07.373 INFO:journalctl@ceph.osd.2.smithi190.stdout:Sep 19 08:50:07 smithi190 sudo[44347]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:50:07.374 INFO:journalctl@ceph.osd.2.smithi190.stdout:Sep 19 08:50:07 smithi190 sudo[44347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:50:07.374 INFO:journalctl@ceph.osd.2.smithi190.stdout:Sep 19 08:50:07 smithi190 sudo[44347]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:50:07.584 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:07 smithi092 sudo[47663]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:50:07.584 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:07 smithi092 sudo[47663]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:50:07.584 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:07 smithi092 sudo[47663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:50:07.584 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:07 smithi092 sudo[47663]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:50:07.847 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:07 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:07.847 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:07 smithi190 ceph-mon[35358]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T08:50:07.847 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:07 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:07.847 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:07 smithi190 ceph-mon[35358]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:50:07.847 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:07 smithi190 sudo[44350]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:50:07.847 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:07 smithi190 sudo[44350]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:50:07.848 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:07 smithi190 sudo[44350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:50:07.848 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:07 smithi190 sudo[44350]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:50:07.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:07 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:07.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:07 smithi167 ceph-mon[35359]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T08:50:07.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:07 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:07.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:07 smithi167 ceph-mon[35359]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:50:08.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:07 smithi092 sudo[47852]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:50:08.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:07 smithi092 sudo[47852]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:50:08.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:07 smithi092 sudo[47852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:50:08.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:07 smithi092 sudo[47852]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:50:08.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:07 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:08.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:07 smithi092 ceph-mon[31407]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T08:50:08.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:07 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:08.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:07 smithi092 ceph-mon[31407]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:50:08.123 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:08 smithi190 sudo[44353]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:50:08.123 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:08 smithi190 sudo[44353]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:50:08.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:08 smithi190 sudo[44353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:50:08.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:08 smithi190 sudo[44353]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:50:08.586 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:08 smithi167 sudo[43862]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:50:08.586 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:08 smithi167 sudo[43862]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:50:08.586 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:08 smithi167 sudo[43862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:50:08.586 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:08 smithi167 sudo[43862]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:50:08.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:08 smithi167 sudo[43865]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:50:08.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:08 smithi167 sudo[43865]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:50:08.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:08 smithi167 sudo[43865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:50:08.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:08 smithi167 sudo[43865]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:50:08.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:08 smithi167 ceph-mon[35359]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:50:08.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:08 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:50:08.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:08 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:50:08.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:08 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:50:08.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:08 smithi167 ceph-mon[35359]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:50:08.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:08 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:50:08.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:08 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:50:08.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:08 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:50:08.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:08 smithi167 ceph-mon[35359]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:50:08.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:08 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:50:08.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:08 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:50:08.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:08 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:50:08.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:08 smithi167 ceph-mon[35359]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:50:08.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:08 smithi190 ceph-mon[35358]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:50:08.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:08 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:50:08.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:08 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:50:08.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:08 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:50:08.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:08 smithi190 ceph-mon[35358]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:50:08.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:08 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:50:08.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:08 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:50:08.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:08 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:50:08.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:08 smithi190 ceph-mon[35358]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:50:08.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:08 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:50:08.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:08 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:50:08.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:08 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:50:08.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:08 smithi190 ceph-mon[35358]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:50:09.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:08 smithi092 ceph-mon[31407]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:50:09.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:08 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:50:09.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:08 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:50:09.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:08 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:50:09.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:08 smithi092 ceph-mon[31407]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:50:09.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:08 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:50:09.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:08 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:50:09.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:08 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:50:09.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:08 smithi092 ceph-mon[31407]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:50:09.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:08 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:50:09.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:08 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:50:09.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:08 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:50:09.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:08 smithi092 ceph-mon[31407]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:50:09.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:09 smithi167 ceph-mon[35359]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:50:09.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:09 smithi167 ceph-mon[35359]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:50:09.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:09 smithi190 ceph-mon[35358]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:50:09.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:09 smithi190 ceph-mon[35358]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:50:10.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:09 smithi092 ceph-mon[31407]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:50:10.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:09 smithi092 ceph-mon[31407]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:50:10.706 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:10 smithi092 ceph-mon[31407]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:50:10.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:10 smithi190 ceph-mon[35358]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:50:11.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:10 smithi167 ceph-mon[35359]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:50:13.373 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:13 smithi190 ceph-mon[35358]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:50:13.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:13 smithi167 ceph-mon[35359]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:50:13.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:13 smithi092 ceph-mon[31407]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:50:14.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:14 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T08:50:14.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:14 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:14.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:14 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T08:50:14.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:14 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:14.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:14 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T08:50:14.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:14 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:15.396 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:15 smithi092 ceph-mon[31407]: Deploying daemon osd.3 on smithi092 2024-09-19T08:50:15.396 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:15 smithi092 ceph-mon[31407]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:50:15.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:15 smithi167 ceph-mon[35359]: Deploying daemon osd.3 on smithi092 2024-09-19T08:50:15.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:15 smithi167 ceph-mon[35359]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:50:15.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:15 smithi190 ceph-mon[35358]: Deploying daemon osd.3 on smithi092 2024-09-19T08:50:15.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:15 smithi190 ceph-mon[35358]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:50:17.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:17 smithi167 ceph-mon[35359]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:50:17.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:17 smithi190 ceph-mon[35358]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:50:17.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:17 smithi092 ceph-mon[31407]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:50:19.570 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:19 smithi092 ceph-mon[31407]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:50:19.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:19 smithi167 ceph-mon[35359]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:50:19.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:19 smithi190 ceph-mon[35358]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:50:20.586 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:20 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:50:20.586 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:20 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:20.586 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:20 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:20.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:20 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:50:20.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:20 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:20.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:20 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:20.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:20 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:50:20.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:20 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:20.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:20 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:21.549 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:21 smithi092 ceph-mon[31407]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:50:21.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:21 smithi167 ceph-mon[35359]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:50:21.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:21 smithi190 ceph-mon[35358]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:50:23.205 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 3 on host 'smithi092' 2024-09-19T08:50:23.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:23.204+0000 7f5467fff640 1 -- 172.21.15.92:0/1253489007 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5480062630 con 0x7f54680a31e0 2024-09-19T08:50:23.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:23.207+0000 7f54850aa640 1 -- 172.21.15.92:0/1253489007 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f54680a31e0 msgr2=0x7f54680a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:23.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:23.207+0000 7f54850aa640 1 --2- 172.21.15.92:0/1253489007 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f54680a31e0 0x7f54680a56a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5470005ab0 tx=0x7f5470000bc0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:23.207+0000 7f54850aa640 1 -- 172.21.15.92:0/1253489007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5480102690 msgr2=0x7f54801a15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:23.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:23.207+0000 7f54850aa640 1 --2- 172.21.15.92:0/1253489007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5480102690 0x7f54801a15e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5478009fd0 tx=0x7f547800b260 comp rx=0 tx=0).stop 2024-09-19T08:50:23.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:23.207+0000 7f54850aa640 1 -- 172.21.15.92:0/1253489007 shutdown_connections 2024-09-19T08:50:23.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:23.207+0000 7f54850aa640 1 --2- 172.21.15.92:0/1253489007 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f54680a31e0 0x7f54680a56a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:23.207+0000 7f54850aa640 1 --2- 172.21.15.92:0/1253489007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5480102690 0x7f54801a15e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:23.207+0000 7f54850aa640 1 --2- 172.21.15.92:0/1253489007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5480101cd0 0x7f548019f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:23.207+0000 7f54850aa640 1 --2- 172.21.15.92:0/1253489007 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5480100ad0 0x7f548006aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:23.207+0000 7f54850aa640 1 -- 172.21.15.92:0/1253489007 >> 172.21.15.92:0/1253489007 conn(0x7f54800fc280 msgr2=0x7f5480105140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:23.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:23.207+0000 7f54850aa640 1 -- 172.21.15.92:0/1253489007 shutdown_connections 2024-09-19T08:50:23.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:50:23.207+0000 7f54850aa640 1 -- 172.21.15.92:0/1253489007 wait complete. 2024-09-19T08:50:23.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:23 smithi092 ceph-mon[31407]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:50:23.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:23 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:23.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:23 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:23.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:23 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:23.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:23 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:50:23.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:23 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:23.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:23 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:50:23.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:23 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:23.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:23 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:23.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:23 smithi167 ceph-mon[35359]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:50:23.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:23 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:23.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:23 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:23.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:23 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:23.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:23 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:50:23.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:23 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:23.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:23 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:50:23.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:23 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:23.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:23 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:23.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:23 smithi190 ceph-mon[35358]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:50:23.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:23 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:23.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:23 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:23.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:23 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:23.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:23 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:50:23.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:23 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:23.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:23 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:50:23.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:23 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:23.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:23 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:23.854 DEBUG:teuthology.orchestra.run.smithi092:osd.3> sudo journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@osd.3.service 2024-09-19T08:50:23.857 INFO:tasks.cephadm:Deploying osd.4 on smithi167 with /dev/vg_nvme/lv_3... 2024-09-19T08:50:23.857 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T08:50:24.110 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:50:25.369 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:25 smithi167 ceph-mon[35359]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:50:25.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:25 smithi190 ceph-mon[35358]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:50:25.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:25 smithi092 ceph-mon[31407]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:50:26.003 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 19 08:50:25 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-3[49435]: 2024-09-19T08:50:25.904+0000 7f7d2d121640 -1 osd.3 0 log_to_monitors true 2024-09-19T08:50:26.442 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T08:50:26.469 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi167:vg_nvme/lv_3 2024-09-19T08:50:26.491 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:26 smithi167 ceph-mon[35359]: from='osd.3 [v2:172.21.15.92:6810/945752895,v1:172.21.15.92:6811/945752895]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T08:50:26.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:26 smithi190 ceph-mon[35358]: from='osd.3 [v2:172.21.15.92:6810/945752895,v1:172.21.15.92:6811/945752895]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T08:50:26.722 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:50:26.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:26 smithi092 ceph-mon[31407]: from='osd.3 [v2:172.21.15.92:6810/945752895,v1:172.21.15.92:6811/945752895]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T08:50:27.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.144+0000 7fd9f5937640 1 -- 172.21.15.167:0/924781649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9f00fff10 msgr2=0x7fd9f0100310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:27.147 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.144+0000 7fd9f5937640 1 --2- 172.21.15.167:0/924781649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9f00fff10 0x7fd9f0100310 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0009900 tx=0x7fd9e002a410 comp rx=0 tx=0).stop 2024-09-19T08:50:27.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.144+0000 7fd9f5937640 1 -- 172.21.15.167:0/924781649 shutdown_connections 2024-09-19T08:50:27.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.144+0000 7fd9f5937640 1 --2- 172.21.15.167:0/924781649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9f01038b0 0x7fd9f010a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:27.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.144+0000 7fd9f5937640 1 --2- 172.21.15.167:0/924781649 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd9f0102ef0 0x7fd9f0103370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:27.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.144+0000 7fd9f5937640 1 --2- 172.21.15.167:0/924781649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9f00fff10 0x7fd9f0100310 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:27.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.144+0000 7fd9f5937640 1 -- 172.21.15.167:0/924781649 >> 172.21.15.167:0/924781649 conn(0x7fd9f00fba80 msgr2=0x7fd9f00fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:27.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.144+0000 7fd9f5937640 1 -- 172.21.15.167:0/924781649 shutdown_connections 2024-09-19T08:50:27.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.144+0000 7fd9f5937640 1 -- 172.21.15.167:0/924781649 wait complete. 2024-09-19T08:50:27.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.145+0000 7fd9f5937640 1 Processor -- start 2024-09-19T08:50:27.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.145+0000 7fd9f5937640 1 -- start start 2024-09-19T08:50:27.148 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.145+0000 7fd9f5937640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9f00fff10 0x7fd9f0102850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:27.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.145+0000 7fd9f5937640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9f0102ef0 0x7fd9f0100ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:27.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.145+0000 7fd9f5937640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd9f01038b0 0x7fd9f01013e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:27.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.145+0000 7fd9f5937640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f010d880 con 0x7fd9f0102ef0 2024-09-19T08:50:27.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.145+0000 7fd9f5937640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f010d700 con 0x7fd9f00fff10 2024-09-19T08:50:27.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.145+0000 7fd9f5937640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f010da00 con 0x7fd9f01038b0 2024-09-19T08:50:27.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.145+0000 7fd9eeffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9f00fff10 0x7fd9f0102850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:27.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.145+0000 7fd9eeffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9f00fff10 0x7fd9f0102850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:50134/0 (socket says 172.21.15.167:50134) 2024-09-19T08:50:27.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.145+0000 7fd9eeffd640 1 -- 172.21.15.167:0/2880824590 learned_addr learned my addr 172.21.15.167:0/2880824590 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-19T08:50:27.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.145+0000 7fd9ee7fc640 1 --2- 172.21.15.167:0/2880824590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9f0102ef0 0x7fd9f0100ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:27.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.145+0000 7fd9ef7fe640 1 --2- 172.21.15.167:0/2880824590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd9f01038b0 0x7fd9f01013e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:27.149 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.146+0000 7fd9eeffd640 1 -- 172.21.15.167:0/2880824590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd9f01038b0 msgr2=0x7fd9f01013e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:27.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.146+0000 7fd9eeffd640 1 --2- 172.21.15.167:0/2880824590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd9f01038b0 0x7fd9f01013e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:27.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.146+0000 7fd9eeffd640 1 -- 172.21.15.167:0/2880824590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9f0102ef0 msgr2=0x7fd9f0100ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:27.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.146+0000 7fd9eeffd640 1 --2- 172.21.15.167:0/2880824590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9f0102ef0 0x7fd9f0100ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:27.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.146+0000 7fd9eeffd640 1 -- 172.21.15.167:0/2880824590 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9f0101ca0 con 0x7fd9f00fff10 2024-09-19T08:50:27.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.146+0000 7fd9ef7fe640 1 --2- 172.21.15.167:0/2880824590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd9f01038b0 0x7fd9f01013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:50:27.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.146+0000 7fd9ee7fc640 1 --2- 172.21.15.167:0/2880824590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9f0102ef0 0x7fd9f0100ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:50:27.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.146+0000 7fd9eeffd640 1 --2- 172.21.15.167:0/2880824590 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9f00fff10 0x7fd9f0102850 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0009230 tx=0x7fd9e0032c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:27.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.146+0000 7fd9f4935640 1 -- 172.21.15.167:0/2880824590 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e003f030 con 0x7fd9f00fff10 2024-09-19T08:50:27.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.146+0000 7fd9f5937640 1 -- 172.21.15.167:0/2880824590 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9f01a2040 con 0x7fd9f00fff10 2024-09-19T08:50:27.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.146+0000 7fd9f4935640 1 -- 172.21.15.167:0/2880824590 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9e0003ce0 con 0x7fd9f00fff10 2024-09-19T08:50:27.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.146+0000 7fd9f4935640 1 -- 172.21.15.167:0/2880824590 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e0035070 con 0x7fd9f00fff10 2024-09-19T08:50:27.150 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.146+0000 7fd9f5937640 1 -- 172.21.15.167:0/2880824590 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9f01a24f0 con 0x7fd9f00fff10 2024-09-19T08:50:27.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.147+0000 7fd9f5937640 1 -- 172.21.15.167:0/2880824590 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9f01090e0 con 0x7fd9f00fff10 2024-09-19T08:50:27.151 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.148+0000 7fd9f4935640 1 -- 172.21.15.167:0/2880824590 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fd9e0042030 con 0x7fd9f00fff10 2024-09-19T08:50:27.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.149+0000 7fd9f4935640 1 --2- 172.21.15.167:0/2880824590 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd9d80a3240 0x7fd9d80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:27.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.149+0000 7fd9f4935640 1 -- 172.21.15.167:0/2880824590 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3373+0+0 (secure 0 0 0) 0x7fd9e00eef80 con 0x7fd9f00fff10 2024-09-19T08:50:27.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.149+0000 7fd9ee7fc640 1 --2- 172.21.15.167:0/2880824590 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd9d80a3240 0x7fd9d80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:27.152 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.150+0000 7fd9ee7fc640 1 --2- 172.21.15.167:0/2880824590 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd9d80a3240 0x7fd9d80a5700 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd9e40058c0 tx=0x7fd9e4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:27.153 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.152+0000 7fd9f4935640 1 -- 172.21.15.167:0/2880824590 <== mon.2 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd9e00bcff0 con 0x7fd9f00fff10 2024-09-19T08:50:27.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:27.328+0000 7fd9f5937640 1 -- 172.21.15.167:0/2880824590 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fd9f0062630 con 0x7fd9d80a3240 2024-09-19T08:50:27.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:27 smithi167 ceph-mon[35359]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:50:27.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:27 smithi167 ceph-mon[35359]: Detected new or changed devices on smithi092 2024-09-19T08:50:27.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:27 smithi167 ceph-mon[35359]: from='osd.3 [v2:172.21.15.92:6810/945752895,v1:172.21.15.92:6811/945752895]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T08:50:27.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:27 smithi167 ceph-mon[35359]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T08:50:27.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:27 smithi167 ceph-mon[35359]: from='osd.3 [v2:172.21.15.92:6810/945752895,v1:172.21.15.92:6811/945752895]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-19T08:50:27.603 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:27 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:50:27.603 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:27 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:27.603 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:27 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:27.603 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:27 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:50:27.603 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:27 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:50:27.603 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:27 smithi167 ceph-mon[35359]: Adjusting osd_memory_target on smithi092 to 8544M 2024-09-19T08:50:27.603 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:27 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:27.604 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:27 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:27.604 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:27 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:50:27.604 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:27 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:27.604 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:27 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:50:27.604 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:27 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:50:27.604 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:27 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:27.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:27 smithi190 ceph-mon[35358]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:50:27.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:27 smithi190 ceph-mon[35358]: Detected new or changed devices on smithi092 2024-09-19T08:50:27.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:27 smithi190 ceph-mon[35358]: from='osd.3 [v2:172.21.15.92:6810/945752895,v1:172.21.15.92:6811/945752895]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T08:50:27.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:27 smithi190 ceph-mon[35358]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T08:50:27.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:27 smithi190 ceph-mon[35358]: from='osd.3 [v2:172.21.15.92:6810/945752895,v1:172.21.15.92:6811/945752895]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-19T08:50:27.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:27 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:50:27.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:27 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:27.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:27 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:27.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:27 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:50:27.625 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:27 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:50:27.625 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:27 smithi190 ceph-mon[35358]: Adjusting osd_memory_target on smithi092 to 8544M 2024-09-19T08:50:27.625 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:27 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:27.625 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:27 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:27.625 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:27 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:50:27.625 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:27 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:27.625 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:27 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:50:27.625 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:27 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:50:27.625 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:27 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:27.753 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 19 08:50:27 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-3[49435]: 2024-09-19T08:50:27.356+0000 7f7d28881640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T08:50:27.753 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 19 08:50:27 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-3[49435]: 2024-09-19T08:50:27.365+0000 7f7d24ebb640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:50:27.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:27 smithi092 ceph-mon[31407]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:50:27.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:27 smithi092 ceph-mon[31407]: Detected new or changed devices on smithi092 2024-09-19T08:50:27.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:27 smithi092 ceph-mon[31407]: from='osd.3 [v2:172.21.15.92:6810/945752895,v1:172.21.15.92:6811/945752895]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T08:50:27.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:27 smithi092 ceph-mon[31407]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T08:50:27.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:27 smithi092 ceph-mon[31407]: from='osd.3 [v2:172.21.15.92:6810/945752895,v1:172.21.15.92:6811/945752895]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-19T08:50:27.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:27 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:50:27.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:27 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:27.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:27 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:27.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:27 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:50:27.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:27 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:50:27.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:27 smithi092 ceph-mon[31407]: Adjusting osd_memory_target on smithi092 to 8544M 2024-09-19T08:50:27.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:27 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:27.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:27 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:27.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:27 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:50:27.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:27 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:27.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:27 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:50:27.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:27 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:50:27.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:27 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:28.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:28 smithi190 ceph-mon[35358]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:50:28.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:28 smithi190 ceph-mon[35358]: from='osd.3 [v2:172.21.15.92:6810/945752895,v1:172.21.15.92:6811/945752895]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-19T08:50:28.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:28 smithi190 ceph-mon[35358]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T08:50:28.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:28 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:50:28.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:28 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:50:28.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:28 smithi190 ceph-mon[35358]: osd.3 [v2:172.21.15.92:6810/945752895,v1:172.21.15.92:6811/945752895] boot 2024-09-19T08:50:28.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:28 smithi190 ceph-mon[35358]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T08:50:28.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:28 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:50:28.698 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:28 smithi167 ceph-mon[35359]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:50:28.698 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:28 smithi167 ceph-mon[35359]: from='osd.3 [v2:172.21.15.92:6810/945752895,v1:172.21.15.92:6811/945752895]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-19T08:50:28.698 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:28 smithi167 ceph-mon[35359]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T08:50:28.699 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:28 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:50:28.699 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:28 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:50:28.699 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:28 smithi167 ceph-mon[35359]: osd.3 [v2:172.21.15.92:6810/945752895,v1:172.21.15.92:6811/945752895] boot 2024-09-19T08:50:28.699 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:28 smithi167 ceph-mon[35359]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T08:50:28.699 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:28 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:50:28.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:28 smithi092 ceph-mon[31407]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:50:28.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:28 smithi092 ceph-mon[31407]: from='osd.3 [v2:172.21.15.92:6810/945752895,v1:172.21.15.92:6811/945752895]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-19T08:50:28.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:28 smithi092 ceph-mon[31407]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T08:50:28.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:28 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:50:28.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:28 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:50:28.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:28 smithi092 ceph-mon[31407]: osd.3 [v2:172.21.15.92:6810/945752895,v1:172.21.15.92:6811/945752895] boot 2024-09-19T08:50:28.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:28 smithi092 ceph-mon[31407]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T08:50:28.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:28 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:50:29.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:29 smithi167 ceph-mon[35359]: purged_snaps scrub starts 2024-09-19T08:50:29.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:29 smithi167 ceph-mon[35359]: purged_snaps scrub ok 2024-09-19T08:50:29.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:29 smithi167 ceph-mon[35359]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:50:29.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:29 smithi167 ceph-mon[35359]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T08:50:29.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:29 smithi190 ceph-mon[35358]: purged_snaps scrub starts 2024-09-19T08:50:29.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:29 smithi190 ceph-mon[35358]: purged_snaps scrub ok 2024-09-19T08:50:29.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:29 smithi190 ceph-mon[35358]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:50:29.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:29 smithi190 ceph-mon[35358]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T08:50:29.653 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:29 smithi092 ceph-mon[31407]: purged_snaps scrub starts 2024-09-19T08:50:29.654 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:29 smithi092 ceph-mon[31407]: purged_snaps scrub ok 2024-09-19T08:50:29.654 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:29 smithi092 ceph-mon[31407]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:50:29.654 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:29 smithi092 ceph-mon[31407]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T08:50:30.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:30 smithi167 ceph-mon[35359]: from='client.? 172.21.15.167:0/718043687' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cb10b38d-ae13-4b92-b906-3505fb873b2d"}]: dispatch 2024-09-19T08:50:30.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:30 smithi167 ceph-mon[35359]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cb10b38d-ae13-4b92-b906-3505fb873b2d"}]: dispatch 2024-09-19T08:50:30.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:30 smithi167 ceph-mon[35359]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cb10b38d-ae13-4b92-b906-3505fb873b2d"}]': finished 2024-09-19T08:50:30.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:30 smithi167 ceph-mon[35359]: osdmap e26: 5 total, 4 up, 5 in 2024-09-19T08:50:30.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:30 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:50:30.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:30 smithi167 ceph-mon[35359]: from='client.? 172.21.15.167:0/3369635741' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:50:30.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:30 smithi190 ceph-mon[35358]: from='client.? 172.21.15.167:0/718043687' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cb10b38d-ae13-4b92-b906-3505fb873b2d"}]: dispatch 2024-09-19T08:50:30.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:30 smithi190 ceph-mon[35358]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cb10b38d-ae13-4b92-b906-3505fb873b2d"}]: dispatch 2024-09-19T08:50:30.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:30 smithi190 ceph-mon[35358]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cb10b38d-ae13-4b92-b906-3505fb873b2d"}]': finished 2024-09-19T08:50:30.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:30 smithi190 ceph-mon[35358]: osdmap e26: 5 total, 4 up, 5 in 2024-09-19T08:50:30.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:30 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:50:30.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:30 smithi190 ceph-mon[35358]: from='client.? 172.21.15.167:0/3369635741' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:50:30.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:30 smithi092 ceph-mon[31407]: from='client.? 172.21.15.167:0/718043687' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cb10b38d-ae13-4b92-b906-3505fb873b2d"}]: dispatch 2024-09-19T08:50:30.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:30 smithi092 ceph-mon[31407]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cb10b38d-ae13-4b92-b906-3505fb873b2d"}]: dispatch 2024-09-19T08:50:30.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:30 smithi092 ceph-mon[31407]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cb10b38d-ae13-4b92-b906-3505fb873b2d"}]': finished 2024-09-19T08:50:30.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:30 smithi092 ceph-mon[31407]: osdmap e26: 5 total, 4 up, 5 in 2024-09-19T08:50:30.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:30 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:50:30.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:30 smithi092 ceph-mon[31407]: from='client.? 172.21.15.167:0/3369635741' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:50:31.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:31 smithi190 ceph-mon[35358]: pgmap v95: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:50:31.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:31 smithi190 ceph-mon[35358]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T08:50:31.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:31 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:50:31.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:31 smithi092 ceph-mon[31407]: pgmap v95: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:50:31.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:31 smithi092 ceph-mon[31407]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T08:50:31.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:31 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:50:31.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:31 smithi167 ceph-mon[35359]: pgmap v95: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:50:31.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:31 smithi167 ceph-mon[35359]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T08:50:31.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:31 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:50:33.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:32 smithi092 ceph-mon[31407]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T08:50:33.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:32 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:50:33.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:32 smithi092 ceph-mon[31407]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:50:33.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:32 smithi167 ceph-mon[35359]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T08:50:33.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:50:33.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:32 smithi167 ceph-mon[35359]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:50:33.123 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:32 smithi190 ceph-mon[35358]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T08:50:33.123 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:32 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:50:33.123 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:32 smithi190 ceph-mon[35358]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:50:35.583 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:35 smithi167 ceph-mon[35359]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-09-19T08:50:35.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:35 smithi190 ceph-mon[35358]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-09-19T08:50:35.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:35 smithi092 ceph-mon[31407]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-09-19T08:50:37.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:37 smithi167 ceph-mon[35359]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-19T08:50:37.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:37 smithi190 ceph-mon[35358]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-19T08:50:37.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:37 smithi092 ceph-mon[31407]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-19T08:50:38.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:38 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T08:50:38.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:38 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:38.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:38 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T08:50:38.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:38 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:38.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:38 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T08:50:38.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:38 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:39.463 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:39 smithi167 ceph-mon[35359]: Deploying daemon osd.4 on smithi167 2024-09-19T08:50:39.464 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:39 smithi167 ceph-mon[35359]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:50:39.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:39 smithi190 ceph-mon[35358]: Deploying daemon osd.4 on smithi167 2024-09-19T08:50:39.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:39 smithi190 ceph-mon[35358]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:50:39.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:39 smithi092 ceph-mon[31407]: Deploying daemon osd.4 on smithi167 2024-09-19T08:50:39.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:39 smithi092 ceph-mon[31407]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:50:41.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:41 smithi167 ceph-mon[35359]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-19T08:50:41.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:41 smithi190 ceph-mon[35358]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-19T08:50:41.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:41 smithi092 ceph-mon[31407]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-19T08:50:43.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:43 smithi167 ceph-mon[35359]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-19T08:50:43.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:43 smithi190 ceph-mon[35358]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-19T08:50:43.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:43 smithi092 ceph-mon[31407]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-19T08:50:44.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:44 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:50:44.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:44 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:44.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:44 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:44.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:44 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:50:44.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:44 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:44.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:44 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:44.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:44 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:50:44.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:44 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:44.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:44 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:45.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:45 smithi167 ceph-mon[35359]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:50:45.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:45 smithi190 ceph-mon[35358]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:50:45.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:45 smithi092 ceph-mon[31407]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:50:46.742 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:46.743+0000 7fd9f4935640 1 -- 172.21.15.167:0/2880824590 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd9f0062630 con 0x7fd9d80a3240 2024-09-19T08:50:46.743 INFO:teuthology.orchestra.run.smithi167.stdout:Created osd(s) 4 on host 'smithi167' 2024-09-19T08:50:46.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:46.745+0000 7fd9f5937640 1 -- 172.21.15.167:0/2880824590 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd9d80a3240 msgr2=0x7fd9d80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:46.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:46.745+0000 7fd9f5937640 1 --2- 172.21.15.167:0/2880824590 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd9d80a3240 0x7fd9d80a5700 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd9e40058c0 tx=0x7fd9e4005850 comp rx=0 tx=0).stop 2024-09-19T08:50:46.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:46.745+0000 7fd9f5937640 1 -- 172.21.15.167:0/2880824590 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9f00fff10 msgr2=0x7fd9f0102850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:46.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:46.745+0000 7fd9f5937640 1 --2- 172.21.15.167:0/2880824590 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9f00fff10 0x7fd9f0102850 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0009230 tx=0x7fd9e0032c70 comp rx=0 tx=0).stop 2024-09-19T08:50:46.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:46.745+0000 7fd9f5937640 1 -- 172.21.15.167:0/2880824590 shutdown_connections 2024-09-19T08:50:46.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:46.745+0000 7fd9f5937640 1 --2- 172.21.15.167:0/2880824590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd9f01038b0 0x7fd9f01013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:46.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:46.745+0000 7fd9f5937640 1 --2- 172.21.15.167:0/2880824590 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd9d80a3240 0x7fd9d80a5700 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:46.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:46.745+0000 7fd9f5937640 1 --2- 172.21.15.167:0/2880824590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9f0102ef0 0x7fd9f0100ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:46.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:46.745+0000 7fd9f5937640 1 --2- 172.21.15.167:0/2880824590 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9f00fff10 0x7fd9f0102850 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:46.745 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:46.745+0000 7fd9f5937640 1 -- 172.21.15.167:0/2880824590 >> 172.21.15.167:0/2880824590 conn(0x7fd9f00fba80 msgr2=0x7fd9f01062b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:46.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:46.745+0000 7fd9f5937640 1 -- 172.21.15.167:0/2880824590 shutdown_connections 2024-09-19T08:50:46.746 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:50:46.745+0000 7fd9f5937640 1 -- 172.21.15.167:0/2880824590 wait complete. 2024-09-19T08:50:47.474 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:47 smithi167 ceph-mon[35359]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:50:47.475 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:47 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:47.475 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:47 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:47.475 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:47 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:47.475 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:47 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:47.502 DEBUG:teuthology.orchestra.run.smithi167:osd.4> sudo journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@osd.4.service 2024-09-19T08:50:47.545 INFO:tasks.cephadm:Deploying osd.5 on smithi190 with /dev/vg_nvme/lv_3... 2024-09-19T08:50:47.545 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T08:50:47.573 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:47 smithi190 ceph-mon[35358]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:50:47.573 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:47 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:47.573 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:47 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:47.573 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:47 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:47.573 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:47 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:47.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:47 smithi092 ceph-mon[31407]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:50:47.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:47 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:47.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:47 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:47.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:47 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:47.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:47 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:47.797 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:50:49.374 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:49 smithi190 ceph-mon[35358]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:50:49.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:49 smithi167 ceph-mon[35359]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:50:49.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:49 smithi092 ceph-mon[31407]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:50:49.996 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 19 08:50:49 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-4[46640]: 2024-09-19T08:50:49.920+0000 7efd9c8bb640 -1 osd.4 0 log_to_monitors true 2024-09-19T08:50:50.091 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-19T08:50:50.117 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi190:vg_nvme/lv_3 2024-09-19T08:50:50.415 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:50:50.563 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:50 smithi190 ceph-mon[35358]: from='osd.4 [v2:172.21.15.167:6808/3576893400,v1:172.21.15.167:6809/3576893400]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:50:50.563 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:50 smithi190 ceph-mon[35358]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:50:50.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:50 smithi167 ceph-mon[35359]: from='osd.4 [v2:172.21.15.167:6808/3576893400,v1:172.21.15.167:6809/3576893400]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:50:50.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:50 smithi167 ceph-mon[35359]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:50:50.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:50 smithi092 ceph-mon[31407]: from='osd.4 [v2:172.21.15.167:6808/3576893400,v1:172.21.15.167:6809/3576893400]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:50:50.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:50 smithi092 ceph-mon[31407]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:50:50.895 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.893+0000 7f5d9015f640 1 -- 172.21.15.190:0/4021461808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d88102690 msgr2=0x7f5d88108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:50.895 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.893+0000 7f5d9015f640 1 --2- 172.21.15.190:0/4021461808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d88102690 0x7f5d88108f20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5d80009ca0 tx=0x7f5d8002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:50:50.896 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.894+0000 7f5d9015f640 1 -- 172.21.15.190:0/4021461808 shutdown_connections 2024-09-19T08:50:50.896 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.894+0000 7f5d9015f640 1 --2- 172.21.15.190:0/4021461808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d88102690 0x7f5d88108f20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:50.896 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.894+0000 7f5d9015f640 1 --2- 172.21.15.190:0/4021461808 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d88101cd0 0x7f5d88102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:50.896 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.894+0000 7f5d9015f640 1 --2- 172.21.15.190:0/4021461808 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5d88100ad0 0x7f5d88100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:50.896 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.894+0000 7f5d9015f640 1 -- 172.21.15.190:0/4021461808 >> 172.21.15.190:0/4021461808 conn(0x7f5d880fc280 msgr2=0x7f5d880fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:50.896 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.894+0000 7f5d9015f640 1 -- 172.21.15.190:0/4021461808 shutdown_connections 2024-09-19T08:50:50.896 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.894+0000 7f5d9015f640 1 -- 172.21.15.190:0/4021461808 wait complete. 2024-09-19T08:50:50.896 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.894+0000 7f5d9015f640 1 Processor -- start 2024-09-19T08:50:50.896 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.894+0000 7f5d9015f640 1 -- start start 2024-09-19T08:50:50.896 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.894+0000 7f5d9015f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5d88100ad0 0x7f5d8806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:50.896 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.894+0000 7f5d9015f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d88101cd0 0x7f5d8819cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:50.896 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.894+0000 7f5d9015f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d88102690 0x7f5d8819f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:50.897 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.894+0000 7f5d9015f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8810c730 con 0x7f5d88102690 2024-09-19T08:50:50.897 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.895+0000 7f5d9015f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8810c5b0 con 0x7f5d88101cd0 2024-09-19T08:50:50.897 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.895+0000 7f5d9015f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8810c8b0 con 0x7f5d88100ad0 2024-09-19T08:50:50.897 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.895+0000 7f5d8defb640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5d88100ad0 0x7f5d8806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:50.897 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.895+0000 7f5d8defb640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5d88100ad0 0x7f5d8806ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:34612/0 (socket says 172.21.15.190:34612) 2024-09-19T08:50:50.897 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.895+0000 7f5d8defb640 1 -- 172.21.15.190:0/447547548 learned_addr learned my addr 172.21.15.190:0/447547548 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-09-19T08:50:50.897 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.895+0000 7f5d8d6fa640 1 --2- 172.21.15.190:0/447547548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d88101cd0 0x7f5d8819cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:50.897 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.895+0000 7f5d8e6fc640 1 --2- 172.21.15.190:0/447547548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d88102690 0x7f5d8819f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:50.897 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.895+0000 7f5d8defb640 1 -- 172.21.15.190:0/447547548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d88101cd0 msgr2=0x7f5d8819cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:50.897 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.895+0000 7f5d8defb640 1 --2- 172.21.15.190:0/447547548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d88101cd0 0x7f5d8819cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:50.897 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.895+0000 7f5d8defb640 1 -- 172.21.15.190:0/447547548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d88102690 msgr2=0x7f5d8819f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:50.897 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.895+0000 7f5d8defb640 1 --2- 172.21.15.190:0/447547548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d88102690 0x7f5d8819f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:50.898 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.895+0000 7f5d8defb640 1 -- 172.21.15.190:0/447547548 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d8819fab0 con 0x7f5d88100ad0 2024-09-19T08:50:50.898 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.895+0000 7f5d8d6fa640 1 --2- 172.21.15.190:0/447547548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d88101cd0 0x7f5d8819cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:50:50.898 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.895+0000 7f5d8defb640 1 --2- 172.21.15.190:0/447547548 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5d88100ad0 0x7f5d8806ab10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5d8400e9c0 tx=0x7f5d8400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:50.898 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.895+0000 7f5d7effd640 1 -- 172.21.15.190:0/447547548 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d8400cd80 con 0x7f5d88100ad0 2024-09-19T08:50:50.899 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.895+0000 7f5d9015f640 1 -- 172.21.15.190:0/447547548 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d881969d0 con 0x7f5d88100ad0 2024-09-19T08:50:50.899 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.895+0000 7f5d7effd640 1 -- 172.21.15.190:0/447547548 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d840035f0 con 0x7f5d88100ad0 2024-09-19T08:50:50.899 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.895+0000 7f5d7effd640 1 -- 172.21.15.190:0/447547548 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d84010690 con 0x7f5d88100ad0 2024-09-19T08:50:50.899 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.895+0000 7f5d9015f640 1 -- 172.21.15.190:0/447547548 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d88196f60 con 0x7f5d88100ad0 2024-09-19T08:50:50.899 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.896+0000 7f5d9015f640 1 -- 172.21.15.190:0/447547548 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d88198990 con 0x7f5d88100ad0 2024-09-19T08:50:50.899 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.898+0000 7f5d7effd640 1 -- 172.21.15.190:0/447547548 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f5d840037a0 con 0x7f5d88100ad0 2024-09-19T08:50:50.899 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.898+0000 7f5d7effd640 1 --2- 172.21.15.190:0/447547548 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5d740a3240 0x7f5d740a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:50.899 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.898+0000 7f5d7effd640 1 -- 172.21.15.190:0/447547548 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3805+0+0 (secure 0 0 0) 0x7f5d840cec90 con 0x7f5d88100ad0 2024-09-19T08:50:50.899 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.899+0000 7f5d8d6fa640 1 --2- 172.21.15.190:0/447547548 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5d740a3240 0x7f5d740a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:50.899 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.899+0000 7f5d8d6fa640 1 --2- 172.21.15.190:0/447547548 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5d740a3240 0x7f5d740a5700 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5d8806a890 tx=0x7f5d78005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:50.905 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:50.906+0000 7f5d7effd640 1 -- 172.21.15.190:0/447547548 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5d8409cbe0 con 0x7f5d88100ad0 2024-09-19T08:50:51.082 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:50:51.082+0000 7f5d9015f640 1 -- 172.21.15.190:0/447547548 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f5d88107980 con 0x7f5d740a3240 2024-09-19T08:50:51.565 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:51 smithi190 ceph-mon[35358]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:50:51.565 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:51 smithi190 ceph-mon[35358]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T08:50:51.565 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:51 smithi190 ceph-mon[35358]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T08:50:51.565 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:51 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:50:51.565 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:51 smithi190 ceph-mon[35358]: from='osd.4 [v2:172.21.15.167:6808/3576893400,v1:172.21.15.167:6809/3576893400]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T08:50:51.566 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:51 smithi190 ceph-mon[35358]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T08:50:51.566 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:51 smithi190 ceph-mon[35358]: Detected new or changed devices on smithi167 2024-09-19T08:50:51.566 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:51 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:51.566 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:51 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:51.566 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:51 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:50:51.566 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:51 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:50:51.566 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:51 smithi190 ceph-mon[35358]: Adjusting osd_memory_target on smithi167 to 8544M 2024-09-19T08:50:51.566 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:51 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:51.566 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:51 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:51.566 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:51 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:50:51.566 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:51 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:51.566 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:51 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:50:51.566 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:51 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:51.567 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:51 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:50:51.567 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:51 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:51.567 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:51 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:50:51.567 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:51 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:50:51.567 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:51 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:51.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:51 smithi167 ceph-mon[35359]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:50:51.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:51 smithi167 ceph-mon[35359]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T08:50:51.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:51 smithi167 ceph-mon[35359]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T08:50:51.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:51 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:50:51.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:51 smithi167 ceph-mon[35359]: from='osd.4 [v2:172.21.15.167:6808/3576893400,v1:172.21.15.167:6809/3576893400]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T08:50:51.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:51 smithi167 ceph-mon[35359]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T08:50:51.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:51 smithi167 ceph-mon[35359]: Detected new or changed devices on smithi167 2024-09-19T08:50:51.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:51 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:51.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:51 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:51.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:51 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:50:51.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:51 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:50:51.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:51 smithi167 ceph-mon[35359]: Adjusting osd_memory_target on smithi167 to 8544M 2024-09-19T08:50:51.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:51 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:51.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:51 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:51.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:51 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:50:51.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:51 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:51.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:51 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:50:51.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:51 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:51.603 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:51 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:50:51.603 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:51 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:51.603 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:51 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:50:51.603 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:51 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:50:51.603 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:51 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:51.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:51 smithi092 ceph-mon[31407]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:50:51.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:51 smithi092 ceph-mon[31407]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T08:50:51.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:51 smithi092 ceph-mon[31407]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T08:50:51.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:51 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:50:51.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:51 smithi092 ceph-mon[31407]: from='osd.4 [v2:172.21.15.167:6808/3576893400,v1:172.21.15.167:6809/3576893400]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T08:50:51.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:51 smithi092 ceph-mon[31407]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T08:50:51.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:51 smithi092 ceph-mon[31407]: Detected new or changed devices on smithi167 2024-09-19T08:50:51.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:51 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:51.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:51 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:51.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:51 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:50:51.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:51 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:50:51.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:51 smithi092 ceph-mon[31407]: Adjusting osd_memory_target on smithi167 to 8544M 2024-09-19T08:50:51.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:51 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:51.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:51 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:51.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:51 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:50:51.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:51 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:51.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:51 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:50:51.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:51 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:51.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:51 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:50:51.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:51 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:50:51.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:51 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:50:51.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:51 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:50:51.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:51 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:52.351 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 19 08:50:52 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-4[46640]: 2024-09-19T08:50:52.089+0000 7efd9801b640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T08:50:52.351 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 19 08:50:52 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-4[46640]: 2024-09-19T08:50:52.096+0000 7efd9064d640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:50:52.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:52 smithi167 ceph-mon[35359]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:50:52.352 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:52 smithi167 ceph-mon[35359]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-19T08:50:52.352 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:52 smithi167 ceph-mon[35359]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T08:50:52.352 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:52 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:50:52.352 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:52 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:50:52.352 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:52 smithi167 ceph-mon[35359]: from='osd.4 ' entity='osd.4' 2024-09-19T08:50:52.352 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:52 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:50:52.615 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:52 smithi190 ceph-mon[35358]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:50:52.664 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:52 smithi190 ceph-mon[35358]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-19T08:50:52.664 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:52 smithi190 ceph-mon[35358]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T08:50:52.664 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:52 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:50:52.664 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:52 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:50:52.664 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:52 smithi190 ceph-mon[35358]: from='osd.4 ' entity='osd.4' 2024-09-19T08:50:52.664 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:52 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:50:52.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:52 smithi092 ceph-mon[31407]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:50:52.719 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:52 smithi092 ceph-mon[31407]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-19T08:50:52.719 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:52 smithi092 ceph-mon[31407]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T08:50:52.719 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:50:52.719 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:50:52.719 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:52 smithi092 ceph-mon[31407]: from='osd.4 ' entity='osd.4' 2024-09-19T08:50:52.720 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:50:53.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:53 smithi167 ceph-mon[35359]: purged_snaps scrub starts 2024-09-19T08:50:53.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:53 smithi167 ceph-mon[35359]: purged_snaps scrub ok 2024-09-19T08:50:53.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:53 smithi167 ceph-mon[35359]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:50:53.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:53 smithi167 ceph-mon[35359]: osd.4 [v2:172.21.15.167:6808/3576893400,v1:172.21.15.167:6809/3576893400] boot 2024-09-19T08:50:53.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:53 smithi167 ceph-mon[35359]: osdmap e31: 5 total, 5 up, 5 in 2024-09-19T08:50:53.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:53 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:50:53.604 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:53 smithi190 ceph-mon[35358]: purged_snaps scrub starts 2024-09-19T08:50:53.604 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:53 smithi190 ceph-mon[35358]: purged_snaps scrub ok 2024-09-19T08:50:53.604 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:53 smithi190 ceph-mon[35358]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:50:53.604 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:53 smithi190 ceph-mon[35358]: osd.4 [v2:172.21.15.167:6808/3576893400,v1:172.21.15.167:6809/3576893400] boot 2024-09-19T08:50:53.604 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:53 smithi190 ceph-mon[35358]: osdmap e31: 5 total, 5 up, 5 in 2024-09-19T08:50:53.605 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:53 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:50:53.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:53 smithi092 ceph-mon[31407]: purged_snaps scrub starts 2024-09-19T08:50:53.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:53 smithi092 ceph-mon[31407]: purged_snaps scrub ok 2024-09-19T08:50:53.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:53 smithi092 ceph-mon[31407]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:50:53.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:53 smithi092 ceph-mon[31407]: osd.4 [v2:172.21.15.167:6808/3576893400,v1:172.21.15.167:6809/3576893400] boot 2024-09-19T08:50:53.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:53 smithi092 ceph-mon[31407]: osdmap e31: 5 total, 5 up, 5 in 2024-09-19T08:50:53.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:53 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:50:54.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:54 smithi167 ceph-mon[35359]: from='client.? 172.21.15.190:0/1053903650' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cd90668b-eca5-4bb4-870e-e58578730c89"}]: dispatch 2024-09-19T08:50:54.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:54 smithi167 ceph-mon[35359]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cd90668b-eca5-4bb4-870e-e58578730c89"}]: dispatch 2024-09-19T08:50:54.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:54 smithi167 ceph-mon[35359]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cd90668b-eca5-4bb4-870e-e58578730c89"}]': finished 2024-09-19T08:50:54.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:54 smithi167 ceph-mon[35359]: osdmap e32: 6 total, 5 up, 6 in 2024-09-19T08:50:54.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:54 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:50:54.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:54 smithi167 ceph-mon[35359]: from='client.? 172.21.15.190:0/992408053' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:50:54.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:54 smithi190 ceph-mon[35358]: from='client.? 172.21.15.190:0/1053903650' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cd90668b-eca5-4bb4-870e-e58578730c89"}]: dispatch 2024-09-19T08:50:54.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:54 smithi190 ceph-mon[35358]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cd90668b-eca5-4bb4-870e-e58578730c89"}]: dispatch 2024-09-19T08:50:54.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:54 smithi190 ceph-mon[35358]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cd90668b-eca5-4bb4-870e-e58578730c89"}]': finished 2024-09-19T08:50:54.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:54 smithi190 ceph-mon[35358]: osdmap e32: 6 total, 5 up, 6 in 2024-09-19T08:50:54.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:54 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:50:54.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:54 smithi190 ceph-mon[35358]: from='client.? 172.21.15.190:0/992408053' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:50:54.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:54 smithi092 ceph-mon[31407]: from='client.? 172.21.15.190:0/1053903650' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cd90668b-eca5-4bb4-870e-e58578730c89"}]: dispatch 2024-09-19T08:50:54.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:54 smithi092 ceph-mon[31407]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cd90668b-eca5-4bb4-870e-e58578730c89"}]: dispatch 2024-09-19T08:50:54.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:54 smithi092 ceph-mon[31407]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cd90668b-eca5-4bb4-870e-e58578730c89"}]': finished 2024-09-19T08:50:54.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:54 smithi092 ceph-mon[31407]: osdmap e32: 6 total, 5 up, 6 in 2024-09-19T08:50:54.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:54 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:50:54.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:54 smithi092 ceph-mon[31407]: from='client.? 172.21.15.190:0/992408053' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:50:55.757 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:55 smithi092 ceph-mon[31407]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:50:55.757 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:55 smithi092 ceph-mon[31407]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T08:50:55.758 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:55 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:50:55.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:55 smithi167 ceph-mon[35359]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:50:55.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:55 smithi167 ceph-mon[35359]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T08:50:55.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:55 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:50:55.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:55 smithi190 ceph-mon[35358]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:50:55.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:55 smithi190 ceph-mon[35358]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T08:50:55.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:55 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:50:57.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:57 smithi092 ceph-mon[31407]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:50:57.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:57 smithi167 ceph-mon[35359]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:50:57.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:57 smithi190 ceph-mon[35358]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:50:59.496 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:50:59 smithi190 ceph-mon[35358]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:50:59.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:50:59 smithi092 ceph-mon[31407]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:50:59.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:50:59 smithi167 ceph-mon[35359]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:51:01.464 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:01 smithi190 ceph-mon[35358]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:51:01.654 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:01 smithi167 ceph-mon[35359]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:51:01.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:01 smithi092 ceph-mon[31407]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:51:02.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:02 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T08:51:02.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:02 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:02.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:02 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T08:51:02.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:02 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:02.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:02 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T08:51:02.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:02 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:03.572 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:03 smithi190 ceph-mon[35358]: Deploying daemon osd.5 on smithi190 2024-09-19T08:51:03.572 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:03 smithi190 ceph-mon[35358]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:51:03.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:03 smithi092 ceph-mon[31407]: Deploying daemon osd.5 on smithi190 2024-09-19T08:51:03.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:03 smithi092 ceph-mon[31407]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:51:03.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:03 smithi167 ceph-mon[35359]: Deploying daemon osd.5 on smithi190 2024-09-19T08:51:03.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:03 smithi167 ceph-mon[35359]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:51:05.498 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:05 smithi190 ceph-mon[35358]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:51:05.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:05 smithi092 ceph-mon[31407]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:51:05.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:05 smithi167 ceph-mon[35359]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:51:07.501 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:07 smithi190 ceph-mon[35358]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:51:07.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:07 smithi092 ceph-mon[31407]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:51:07.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:07 smithi167 ceph-mon[35359]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:51:08.716 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:08 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:51:08.716 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:08 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:08.716 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:08 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:08.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:08 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:51:08.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:08 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:08.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:08 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:08.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:08 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:51:08.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:08 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:08.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:08 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:09.525 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:09 smithi190 ceph-mon[35358]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:51:09.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:09 smithi092 ceph-mon[31407]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:51:09.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:09 smithi167 ceph-mon[35359]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:51:11.685 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:11 smithi190 ceph-mon[35358]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:51:11.686 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:11 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:11.686 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:11 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:11.686 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:11 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:11.686 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:11 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:51:11.686 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:11 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:11.726 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:51:11.726+0000 7f5d7effd640 1 -- 172.21.15.190:0/447547548 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5d88107980 con 0x7f5d740a3240 2024-09-19T08:51:11.727 INFO:teuthology.orchestra.run.smithi190.stdout:Created osd(s) 5 on host 'smithi190' 2024-09-19T08:51:11.729 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:51:11.729+0000 7f5d9015f640 1 -- 172.21.15.190:0/447547548 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5d740a3240 msgr2=0x7f5d740a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:11.729 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:51:11.729+0000 7f5d9015f640 1 --2- 172.21.15.190:0/447547548 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5d740a3240 0x7f5d740a5700 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5d8806a890 tx=0x7f5d78005f90 comp rx=0 tx=0).stop 2024-09-19T08:51:11.729 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:51:11.729+0000 7f5d9015f640 1 -- 172.21.15.190:0/447547548 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5d88100ad0 msgr2=0x7f5d8806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:11.729 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:51:11.729+0000 7f5d9015f640 1 --2- 172.21.15.190:0/447547548 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5d88100ad0 0x7f5d8806ab10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5d8400e9c0 tx=0x7f5d8400ee80 comp rx=0 tx=0).stop 2024-09-19T08:51:11.729 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:51:11.729+0000 7f5d9015f640 1 -- 172.21.15.190:0/447547548 shutdown_connections 2024-09-19T08:51:11.729 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:51:11.729+0000 7f5d9015f640 1 --2- 172.21.15.190:0/447547548 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5d740a3240 0x7f5d740a5700 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:11.729 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:51:11.729+0000 7f5d9015f640 1 --2- 172.21.15.190:0/447547548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d88102690 0x7f5d8819f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:11.729 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:51:11.729+0000 7f5d9015f640 1 --2- 172.21.15.190:0/447547548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d88101cd0 0x7f5d8819cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:11.729 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:51:11.729+0000 7f5d9015f640 1 --2- 172.21.15.190:0/447547548 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5d88100ad0 0x7f5d8806ab10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:11.729 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:51:11.729+0000 7f5d9015f640 1 -- 172.21.15.190:0/447547548 >> 172.21.15.190:0/447547548 conn(0x7f5d880fc280 msgr2=0x7f5d88105070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:11.729 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:51:11.729+0000 7f5d9015f640 1 -- 172.21.15.190:0/447547548 shutdown_connections 2024-09-19T08:51:11.730 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:51:11.729+0000 7f5d9015f640 1 -- 172.21.15.190:0/447547548 wait complete. 2024-09-19T08:51:11.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:11 smithi092 ceph-mon[31407]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:51:11.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:11 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:11.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:11 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:11.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:11 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:11.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:11 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:51:11.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:11 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:11.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:11 smithi167 ceph-mon[35359]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:51:11.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:11 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:11.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:11 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:11.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:11 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:11.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:11 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:51:11.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:11 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:12.324 DEBUG:teuthology.orchestra.run.smithi190:osd.5> sudo journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@osd.5.service 2024-09-19T08:51:12.326 INFO:tasks.cephadm:Deploying osd.6 on smithi092 with /dev/vg_nvme/lv_2... 2024-09-19T08:51:12.327 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T08:51:12.548 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:12 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:51:12.548 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:12 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:12.548 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:12 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:12.579 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:12.700 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:12 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:51:12.700 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:12 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:12.700 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:12 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:12.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:12 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:51:12.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:12 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:12.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:12 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:13.469 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:13 smithi190 ceph-mon[35358]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:51:13.707 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:13 smithi092 ceph-mon[31407]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:51:13.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:13 smithi167 ceph-mon[35359]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:51:14.413 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 08:51:14 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5[47211]: 2024-09-19T08:51:14.148+0000 7f2162576640 -1 osd.5 0 log_to_monitors true 2024-09-19T08:51:14.548 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:14 smithi092 ceph-mon[31407]: from='osd.5 [v2:172.21.15.190:6808/1880491675,v1:172.21.15.190:6809/1880491675]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:51:14.549 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:14 smithi092 ceph-mon[31407]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:51:14.742 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:14 smithi190 ceph-mon[35358]: from='osd.5 [v2:172.21.15.190:6808/1880491675,v1:172.21.15.190:6809/1880491675]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:51:14.742 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:14 smithi190 ceph-mon[35358]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:51:14.850 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:51:14.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:14 smithi167 ceph-mon[35359]: from='osd.5 [v2:172.21.15.190:6808/1880491675,v1:172.21.15.190:6809/1880491675]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:51:14.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:14 smithi167 ceph-mon[35359]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:51:14.877 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi092:vg_nvme/lv_2 2024-09-19T08:51:15.129 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:15.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:15 smithi092 ceph-mon[31407]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:51:15.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:15 smithi092 ceph-mon[31407]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T08:51:15.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:15 smithi092 ceph-mon[31407]: from='osd.5 [v2:172.21.15.190:6808/1880491675,v1:172.21.15.190:6809/1880491675]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-09-19T08:51:15.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:15 smithi092 ceph-mon[31407]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T08:51:15.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:15 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:51:15.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:15 smithi092 ceph-mon[31407]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-09-19T08:51:15.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:15 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:15.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:15 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:15.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:15 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:51:15.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:15 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:51:15.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:15 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:15.505 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:15 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:15.505 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:15 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:51:15.505 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:15 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:15.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.543+0000 7f64ac8db640 1 -- 172.21.15.92:0/76635920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64a8104f90 msgr2=0x7f64a8107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:15.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.543+0000 7f64ac8db640 1 --2- 172.21.15.92:0/76635920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64a8104f90 0x7f64a8107380 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6498009900 tx=0x7f649802a410 comp rx=0 tx=0).stop 2024-09-19T08:51:15.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.543+0000 7f64ac8db640 1 -- 172.21.15.92:0/76635920 shutdown_connections 2024-09-19T08:51:15.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.543+0000 7f64ac8db640 1 --2- 172.21.15.92:0/76635920 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64a81078c0 0x7f64a8109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.543+0000 7f64ac8db640 1 --2- 172.21.15.92:0/76635920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64a8104f90 0x7f64a8107380 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.543+0000 7f64ac8db640 1 --2- 172.21.15.92:0/76635920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64a8102660 0x7f64a8104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.543+0000 7f64ac8db640 1 -- 172.21.15.92:0/76635920 >> 172.21.15.92:0/76635920 conn(0x7f64a80fc280 msgr2=0x7f64a80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:15.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.543+0000 7f64ac8db640 1 -- 172.21.15.92:0/76635920 shutdown_connections 2024-09-19T08:51:15.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.543+0000 7f64ac8db640 1 -- 172.21.15.92:0/76635920 wait complete. 2024-09-19T08:51:15.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.544+0000 7f64ac8db640 1 Processor -- start 2024-09-19T08:51:15.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.544+0000 7f64ac8db640 1 -- start start 2024-09-19T08:51:15.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.544+0000 7f64ac8db640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64a8102660 0x7f64a8197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.544+0000 7f64ac8db640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64a8104f90 0x7f64a8198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.544+0000 7f64ac8db640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64a81078c0 0x7f64a819f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.544+0000 7f64ac8db640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f64a810d860 con 0x7f64a8104f90 2024-09-19T08:51:15.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.544+0000 7f64ac8db640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f64a810d6e0 con 0x7f64a8102660 2024-09-19T08:51:15.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.544+0000 7f64ac8db640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f64a810d9e0 con 0x7f64a81078c0 2024-09-19T08:51:15.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.545+0000 7f64a5d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64a8104f90 0x7f64a8198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.545+0000 7f64a5d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64a8104f90 0x7f64a8198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47650/0 (socket says 172.21.15.92:47650) 2024-09-19T08:51:15.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.545+0000 7f64a659c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64a8102660 0x7f64a8197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.545+0000 7f64a5d9b640 1 -- 172.21.15.92:0/2551933391 learned_addr learned my addr 172.21.15.92:0/2551933391 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:51:15.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.545+0000 7f64a6d9d640 1 --2- 172.21.15.92:0/2551933391 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64a81078c0 0x7f64a819f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.545+0000 7f64a5d9b640 1 -- 172.21.15.92:0/2551933391 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64a81078c0 msgr2=0x7f64a819f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:15.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.545+0000 7f64a5d9b640 1 --2- 172.21.15.92:0/2551933391 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64a81078c0 0x7f64a819f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.545+0000 7f64a5d9b640 1 -- 172.21.15.92:0/2551933391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64a8102660 msgr2=0x7f64a8197f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:15.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.545+0000 7f64a5d9b640 1 --2- 172.21.15.92:0/2551933391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64a8102660 0x7f64a8197f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.545+0000 7f64a5d9b640 1 -- 172.21.15.92:0/2551933391 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a819fb40 con 0x7f64a8104f90 2024-09-19T08:51:15.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.545+0000 7f64a5d9b640 1 --2- 172.21.15.92:0/2551933391 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64a8104f90 0x7f64a8198450 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6498031610 tx=0x7f6498004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:15.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.545+0000 7f64977fe640 1 -- 172.21.15.92:0/2551933391 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649803f030 con 0x7f64a8104f90 2024-09-19T08:51:15.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.545+0000 7f64ac8db640 1 -- 172.21.15.92:0/2551933391 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64a819fdd0 con 0x7f64a8104f90 2024-09-19T08:51:15.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.545+0000 7f64977fe640 1 -- 172.21.15.92:0/2551933391 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6498003ad0 con 0x7f64a8104f90 2024-09-19T08:51:15.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.545+0000 7f64977fe640 1 -- 172.21.15.92:0/2551933391 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6498035070 con 0x7f64a8104f90 2024-09-19T08:51:15.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.545+0000 7f64ac8db640 1 -- 172.21.15.92:0/2551933391 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64a81a0250 con 0x7f64a8104f90 2024-09-19T08:51:15.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.546+0000 7f64ac8db640 1 -- 172.21.15.92:0/2551933391 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64a80fdd70 con 0x7f64a8104f90 2024-09-19T08:51:15.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.548+0000 7f64977fe640 1 -- 172.21.15.92:0/2551933391 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f6498042030 con 0x7f64a8104f90 2024-09-19T08:51:15.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.548+0000 7f64977fe640 1 --2- 172.21.15.92:0/2551933391 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f64900a3270 0x7f64900a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.548+0000 7f64a659c640 1 --2- 172.21.15.92:0/2551933391 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f64900a3270 0x7f64900a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.554 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.548+0000 7f64977fe640 1 -- 172.21.15.92:0/2551933391 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4253+0+0 (secure 0 0 0) 0x7f64980ef520 con 0x7f64a8104f90 2024-09-19T08:51:15.554 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.549+0000 7f64a659c640 1 --2- 172.21.15.92:0/2551933391 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f64900a3270 0x7f64900a5730 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f649c00bbe0 tx=0x7f649c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:15.554 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.552+0000 7f64977fe640 1 -- 172.21.15.92:0/2551933391 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f64980bcbd0 con 0x7f64a8104f90 2024-09-19T08:51:15.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:15.727+0000 7f64ac8db640 1 -- 172.21.15.92:0/2551933391 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f64a8062630 con 0x7f64900a3270 2024-09-19T08:51:15.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:15 smithi167 ceph-mon[35359]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:51:15.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:15 smithi167 ceph-mon[35359]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T08:51:15.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:15 smithi167 ceph-mon[35359]: from='osd.5 [v2:172.21.15.190:6808/1880491675,v1:172.21.15.190:6809/1880491675]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-09-19T08:51:15.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:15 smithi167 ceph-mon[35359]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T08:51:15.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:15 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:51:15.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:15 smithi167 ceph-mon[35359]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-09-19T08:51:15.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:15 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:15.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:15 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:15.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:15 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:51:15.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:15 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:51:15.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:15 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:15.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:15 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:15.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:15 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:51:15.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:15 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:15.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:15 smithi190 ceph-mon[35358]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:51:15.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:15 smithi190 ceph-mon[35358]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T08:51:15.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:15 smithi190 ceph-mon[35358]: from='osd.5 [v2:172.21.15.190:6808/1880491675,v1:172.21.15.190:6809/1880491675]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-09-19T08:51:15.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:15 smithi190 ceph-mon[35358]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T08:51:15.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:15 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:51:15.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:15 smithi190 ceph-mon[35358]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-09-19T08:51:15.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:15 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:15.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:15 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:15.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:15 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:51:15.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:15 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:51:15.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:15 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:15.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:15 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:15.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:15 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:51:15.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:15 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:16.438 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 08:51:16 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5[47211]: 2024-09-19T08:51:16.185+0000 7f215ed0d640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T08:51:16.438 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 08:51:16 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5[47211]: 2024-09-19T08:51:16.195+0000 7f2156308640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:51:16.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:16 smithi092 ceph-mon[31407]: Detected new or changed devices on smithi190 2024-09-19T08:51:16.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:16 smithi092 ceph-mon[31407]: Adjusting osd_memory_target on smithi190 to 8544M 2024-09-19T08:51:16.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:16 smithi092 ceph-mon[31407]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-09-19T08:51:16.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:16 smithi092 ceph-mon[31407]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T08:51:16.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:16 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:51:16.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:16 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:51:16.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:16 smithi092 ceph-mon[31407]: from='client.14385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:51:16.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:16 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:51:16.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:16 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:51:16.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:16 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:16.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:16 smithi092 ceph-mon[31407]: from='osd.5 ' entity='osd.5' 2024-09-19T08:51:16.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:16 smithi092 ceph-mon[31407]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:51:16.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:16 smithi167 ceph-mon[35359]: Detected new or changed devices on smithi190 2024-09-19T08:51:16.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:16 smithi167 ceph-mon[35359]: Adjusting osd_memory_target on smithi190 to 8544M 2024-09-19T08:51:16.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:16 smithi167 ceph-mon[35359]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-09-19T08:51:16.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:16 smithi167 ceph-mon[35359]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T08:51:16.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:16 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:51:16.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:16 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:51:16.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:16 smithi167 ceph-mon[35359]: from='client.14385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:51:16.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:16 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:51:16.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:16 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:51:16.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:16 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:16.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:16 smithi167 ceph-mon[35359]: from='osd.5 ' entity='osd.5' 2024-09-19T08:51:16.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:16 smithi167 ceph-mon[35359]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:51:16.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:16 smithi190 ceph-mon[35358]: Detected new or changed devices on smithi190 2024-09-19T08:51:16.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:16 smithi190 ceph-mon[35358]: Adjusting osd_memory_target on smithi190 to 8544M 2024-09-19T08:51:16.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:16 smithi190 ceph-mon[35358]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-09-19T08:51:16.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:16 smithi190 ceph-mon[35358]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T08:51:16.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:16 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:51:16.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:16 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:51:16.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:16 smithi190 ceph-mon[35358]: from='client.14385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:51:16.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:16 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:51:16.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:16 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:51:16.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:16 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:16.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:16 smithi190 ceph-mon[35358]: from='osd.5 ' entity='osd.5' 2024-09-19T08:51:16.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:16 smithi190 ceph-mon[35358]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:51:17.637 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:17 smithi092 ceph-mon[31407]: purged_snaps scrub starts 2024-09-19T08:51:17.637 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:17 smithi092 ceph-mon[31407]: purged_snaps scrub ok 2024-09-19T08:51:17.637 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:17 smithi092 ceph-mon[31407]: osd.5 [v2:172.21.15.190:6808/1880491675,v1:172.21.15.190:6809/1880491675] boot 2024-09-19T08:51:17.637 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:17 smithi092 ceph-mon[31407]: osdmap e36: 6 total, 6 up, 6 in 2024-09-19T08:51:17.637 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:17 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:51:17.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:17 smithi167 ceph-mon[35359]: purged_snaps scrub starts 2024-09-19T08:51:17.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:17 smithi167 ceph-mon[35359]: purged_snaps scrub ok 2024-09-19T08:51:17.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:17 smithi167 ceph-mon[35359]: osd.5 [v2:172.21.15.190:6808/1880491675,v1:172.21.15.190:6809/1880491675] boot 2024-09-19T08:51:17.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:17 smithi167 ceph-mon[35359]: osdmap e36: 6 total, 6 up, 6 in 2024-09-19T08:51:17.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:17 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:51:17.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:17 smithi190 ceph-mon[35358]: purged_snaps scrub starts 2024-09-19T08:51:17.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:17 smithi190 ceph-mon[35358]: purged_snaps scrub ok 2024-09-19T08:51:17.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:17 smithi190 ceph-mon[35358]: osd.5 [v2:172.21.15.190:6808/1880491675,v1:172.21.15.190:6809/1880491675] boot 2024-09-19T08:51:17.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:17 smithi190 ceph-mon[35358]: osdmap e36: 6 total, 6 up, 6 in 2024-09-19T08:51:17.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:17 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:51:18.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:18 smithi092 ceph-mon[31407]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T08:51:18.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:18 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1358710740' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4e047963-afa7-4934-b887-8086165fb831"}]: dispatch 2024-09-19T08:51:18.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:18 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1358710740' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4e047963-afa7-4934-b887-8086165fb831"}]': finished 2024-09-19T08:51:18.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:18 smithi092 ceph-mon[31407]: osdmap e38: 7 total, 6 up, 7 in 2024-09-19T08:51:18.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:18 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:51:18.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:18 smithi092 ceph-mon[31407]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T08:51:18.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:18 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:51:18.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:18 smithi092 ceph-mon[31407]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:51:18.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:18 smithi167 ceph-mon[35359]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T08:51:18.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:18 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/1358710740' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4e047963-afa7-4934-b887-8086165fb831"}]: dispatch 2024-09-19T08:51:18.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:18 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/1358710740' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4e047963-afa7-4934-b887-8086165fb831"}]': finished 2024-09-19T08:51:18.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:18 smithi167 ceph-mon[35359]: osdmap e38: 7 total, 6 up, 7 in 2024-09-19T08:51:18.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:18 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:51:18.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:18 smithi167 ceph-mon[35359]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T08:51:18.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:18 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:51:18.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:18 smithi167 ceph-mon[35359]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:51:18.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:18 smithi190 ceph-mon[35358]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T08:51:18.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:18 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/1358710740' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4e047963-afa7-4934-b887-8086165fb831"}]: dispatch 2024-09-19T08:51:18.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:18 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/1358710740' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4e047963-afa7-4934-b887-8086165fb831"}]': finished 2024-09-19T08:51:18.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:18 smithi190 ceph-mon[35358]: osdmap e38: 7 total, 6 up, 7 in 2024-09-19T08:51:18.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:18 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:51:18.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:18 smithi190 ceph-mon[35358]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T08:51:18.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:18 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:51:18.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:18 smithi190 ceph-mon[35358]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:51:19.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:19 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1254356820' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:51:19.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:19 smithi092 ceph-mon[31407]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T08:51:19.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:19 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:51:19.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:19 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/1254356820' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:51:19.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:19 smithi167 ceph-mon[35359]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T08:51:19.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:19 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:51:19.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:19 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/1254356820' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:51:19.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:19 smithi190 ceph-mon[35358]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T08:51:19.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:19 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:51:20.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:20 smithi092 ceph-mon[31407]: pgmap v134: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 152 KiB/s, 0 objects/s recovering 2024-09-19T08:51:20.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:20 smithi167 ceph-mon[35359]: pgmap v134: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 152 KiB/s, 0 objects/s recovering 2024-09-19T08:51:20.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:20 smithi190 ceph-mon[35358]: pgmap v134: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 152 KiB/s, 0 objects/s recovering 2024-09-19T08:51:23.397 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:23 smithi092 ceph-mon[31407]: pgmap v135: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-09-19T08:51:23.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:23 smithi167 ceph-mon[35359]: pgmap v135: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-09-19T08:51:23.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:23 smithi190 ceph-mon[35358]: pgmap v135: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-09-19T08:51:25.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:25 smithi092 ceph-mon[31407]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-19T08:51:25.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:25 smithi167 ceph-mon[35359]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-19T08:51:25.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:25 smithi190 ceph-mon[35358]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-19T08:51:26.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:26 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T08:51:26.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:26 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:26.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:26 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T08:51:26.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:26 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:26.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:26 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T08:51:26.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:26 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:27.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:27 smithi167 ceph-mon[35359]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-19T08:51:27.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:27 smithi167 ceph-mon[35359]: Deploying daemon osd.6 on smithi092 2024-09-19T08:51:27.607 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:27 smithi092 ceph-mon[31407]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-19T08:51:27.607 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:27 smithi092 ceph-mon[31407]: Deploying daemon osd.6 on smithi092 2024-09-19T08:51:27.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:27 smithi190 ceph-mon[35358]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-19T08:51:27.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:27 smithi190 ceph-mon[35358]: Deploying daemon osd.6 on smithi092 2024-09-19T08:51:29.550 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:29 smithi092 ceph-mon[31407]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T08:51:29.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:29 smithi167 ceph-mon[35359]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T08:51:29.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:29 smithi190 ceph-mon[35358]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T08:51:31.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:31 smithi092 ceph-mon[31407]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:51:31.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:31 smithi167 ceph-mon[35359]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:51:31.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:31 smithi190 ceph-mon[35358]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:51:32.544 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:32 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:51:32.544 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:32 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:32.544 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:32 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:32.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:51:32.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:32.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:32.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:32 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:51:32.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:32 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:32.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:32 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:33.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:33 smithi167 ceph-mon[35359]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:51:33.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:33 smithi190 ceph-mon[35358]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:51:33.633 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:33 smithi092 ceph-mon[31407]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:51:35.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:35 smithi092 ceph-mon[31407]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:51:35.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:35 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:35.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:35 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:35.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:35 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:35.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:35 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:51:35.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:35 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:35.537 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 6 on host 'smithi092' 2024-09-19T08:51:35.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:35.537+0000 7f64977fe640 1 -- 172.21.15.92:0/2551933391 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f64a8062630 con 0x7f64900a3270 2024-09-19T08:51:35.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:35.539+0000 7f64ac8db640 1 -- 172.21.15.92:0/2551933391 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f64900a3270 msgr2=0x7f64900a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:35.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:35.539+0000 7f64ac8db640 1 --2- 172.21.15.92:0/2551933391 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f64900a3270 0x7f64900a5730 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f649c00bbe0 tx=0x7f649c00b390 comp rx=0 tx=0).stop 2024-09-19T08:51:35.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:35.540+0000 7f64ac8db640 1 -- 172.21.15.92:0/2551933391 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64a8104f90 msgr2=0x7f64a8198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:35.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:35.540+0000 7f64ac8db640 1 --2- 172.21.15.92:0/2551933391 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64a8104f90 0x7f64a8198450 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6498031610 tx=0x7f6498004270 comp rx=0 tx=0).stop 2024-09-19T08:51:35.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:35.540+0000 7f64ac8db640 1 -- 172.21.15.92:0/2551933391 shutdown_connections 2024-09-19T08:51:35.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:35.540+0000 7f64ac8db640 1 --2- 172.21.15.92:0/2551933391 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64a81078c0 0x7f64a819f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:35.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:35.540+0000 7f64ac8db640 1 --2- 172.21.15.92:0/2551933391 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f64900a3270 0x7f64900a5730 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:35.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:35.540+0000 7f64ac8db640 1 --2- 172.21.15.92:0/2551933391 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64a8104f90 0x7f64a8198450 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:35.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:35.540+0000 7f64ac8db640 1 --2- 172.21.15.92:0/2551933391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64a8102660 0x7f64a8197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:35.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:35.540+0000 7f64ac8db640 1 -- 172.21.15.92:0/2551933391 >> 172.21.15.92:0/2551933391 conn(0x7f64a80fc280 msgr2=0x7f64a8102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:35.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:35.540+0000 7f64ac8db640 1 -- 172.21.15.92:0/2551933391 shutdown_connections 2024-09-19T08:51:35.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:51:35.540+0000 7f64ac8db640 1 -- 172.21.15.92:0/2551933391 wait complete. 2024-09-19T08:51:35.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:35 smithi167 ceph-mon[35359]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:51:35.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:35 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:35.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:35 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:35.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:35 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:35.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:35 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:51:35.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:35 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:35.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:35 smithi190 ceph-mon[35358]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:51:35.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:35 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:35.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:35 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:35.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:35 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:35.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:35 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:51:35.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:35 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:36.195 DEBUG:teuthology.orchestra.run.smithi092:osd.6> sudo journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@osd.6.service 2024-09-19T08:51:36.198 INFO:tasks.cephadm:Deploying osd.7 on smithi167 with /dev/vg_nvme/lv_2... 2024-09-19T08:51:36.198 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T08:51:36.456 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:51:36.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:36 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:51:36.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:36 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:36.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:36 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:36.577 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:36 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:51:36.577 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:36 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:36.577 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:36 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:36.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:36 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:51:36.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:36 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:36.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:36 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:37.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:37 smithi167 ceph-mon[35359]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:51:37.617 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:37 smithi092 ceph-mon[31407]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:51:37.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:37 smithi190 ceph-mon[35358]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:51:38.372 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:38 smithi092 ceph-mon[31407]: from='osd.6 [v2:172.21.15.92:6818/1743435653,v1:172.21.15.92:6819/1743435653]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T08:51:38.373 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 08:51:38 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T08:51:38.078+0000 7f7ad6f27640 -1 osd.6 0 log_to_monitors true 2024-09-19T08:51:38.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:38 smithi167 ceph-mon[35359]: from='osd.6 [v2:172.21.15.92:6818/1743435653,v1:172.21.15.92:6819/1743435653]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T08:51:38.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:38 smithi190 ceph-mon[35358]: from='osd.6 [v2:172.21.15.92:6818/1743435653,v1:172.21.15.92:6819/1743435653]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T08:51:38.878 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T08:51:38.903 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi167:vg_nvme/lv_2 2024-09-19T08:51:39.154 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:51:39.537 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:39 smithi167 ceph-mon[35359]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:51:39.537 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:39 smithi167 ceph-mon[35359]: from='osd.6 [v2:172.21.15.92:6818/1743435653,v1:172.21.15.92:6819/1743435653]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T08:51:39.538 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:39 smithi167 ceph-mon[35359]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T08:51:39.538 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:39 smithi167 ceph-mon[35359]: from='osd.6 [v2:172.21.15.92:6818/1743435653,v1:172.21.15.92:6819/1743435653]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-19T08:51:39.538 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:39 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:51:39.538 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:39 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:39.538 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:39 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:39.538 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:39 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:51:39.538 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:39 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:51:39.538 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:39 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:51:39.538 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:39 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:39.538 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:39 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:39.538 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:39 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:51:39.538 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:39 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:39.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:39 smithi190 ceph-mon[35358]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:51:39.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:39 smithi190 ceph-mon[35358]: from='osd.6 [v2:172.21.15.92:6818/1743435653,v1:172.21.15.92:6819/1743435653]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T08:51:39.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:39 smithi190 ceph-mon[35358]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T08:51:39.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:39 smithi190 ceph-mon[35358]: from='osd.6 [v2:172.21.15.92:6818/1743435653,v1:172.21.15.92:6819/1743435653]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-19T08:51:39.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:39 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:51:39.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:39 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:39.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:39 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:39.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:39 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:51:39.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:39 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:51:39.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:39 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:51:39.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:39 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:39.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:39 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:39.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:39 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:51:39.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:39 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:39.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.620+0000 7f79108e4640 1 -- 172.21.15.167:0/1774046627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f790c101c00 msgr2=0x7f790c102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:39.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.620+0000 7f79108e4640 1 --2- 172.21.15.167:0/1774046627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f790c101c00 0x7f790c102000 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f78fc009900 tx=0x7f78fc02a410 comp rx=0 tx=0).stop 2024-09-19T08:51:39.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.620+0000 7f79108e4640 1 -- 172.21.15.167:0/1774046627 shutdown_connections 2024-09-19T08:51:39.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.620+0000 7f79108e4640 1 --2- 172.21.15.167:0/1774046627 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f790c1037c0 0x7f790c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:39.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.620+0000 7f79108e4640 1 --2- 172.21.15.167:0/1774046627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f790c102e00 0x7f790c103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:39.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.620+0000 7f79108e4640 1 --2- 172.21.15.167:0/1774046627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f790c101c00 0x7f790c102000 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:39.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.620+0000 7f79108e4640 1 -- 172.21.15.167:0/1774046627 >> 172.21.15.167:0/1774046627 conn(0x7f790c0fd390 msgr2=0x7f790c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:39.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.620+0000 7f79108e4640 1 -- 172.21.15.167:0/1774046627 shutdown_connections 2024-09-19T08:51:39.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.620+0000 7f79108e4640 1 -- 172.21.15.167:0/1774046627 wait complete. 2024-09-19T08:51:39.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.621+0000 7f79108e4640 1 Processor -- start 2024-09-19T08:51:39.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.621+0000 7f79108e4640 1 -- start start 2024-09-19T08:51:39.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.622+0000 7f79108e4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f790c101c00 0x7f790c197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:39.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.622+0000 7f79108e4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f790c102e00 0x7f790c198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:39.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.622+0000 7f79108e4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f790c1037c0 0x7f790c19f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:39.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.622+0000 7f79108e4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f790c10d860 con 0x7f790c1037c0 2024-09-19T08:51:39.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.622+0000 7f79108e4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f790c10d6e0 con 0x7f790c101c00 2024-09-19T08:51:39.638 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.622+0000 7f79108e4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f790c10d9e0 con 0x7f790c102e00 2024-09-19T08:51:39.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.622+0000 7f790a59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f790c101c00 0x7f790c197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:39.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.622+0000 7f790a59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f790c101c00 0x7f790c197f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:37208/0 (socket says 172.21.15.167:37208) 2024-09-19T08:51:39.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.622+0000 7f790a59c640 1 -- 172.21.15.167:0/1871936562 learned_addr learned my addr 172.21.15.167:0/1871936562 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-19T08:51:39.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.622+0000 7f790ad9d640 1 --2- 172.21.15.167:0/1871936562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f790c1037c0 0x7f790c19f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:39.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.622+0000 7f7909d9b640 1 --2- 172.21.15.167:0/1871936562 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f790c102e00 0x7f790c198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:39.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.622+0000 7f790a59c640 1 -- 172.21.15.167:0/1871936562 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f790c102e00 msgr2=0x7f790c198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:39.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.622+0000 7f790a59c640 1 --2- 172.21.15.167:0/1871936562 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f790c102e00 0x7f790c198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:39.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.622+0000 7f790a59c640 1 -- 172.21.15.167:0/1871936562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f790c1037c0 msgr2=0x7f790c19f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:39.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.622+0000 7f790a59c640 1 --2- 172.21.15.167:0/1871936562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f790c1037c0 0x7f790c19f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:39.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.622+0000 7f790a59c640 1 -- 172.21.15.167:0/1871936562 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f790c19fb60 con 0x7f790c101c00 2024-09-19T08:51:39.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.622+0000 7f790a59c640 1 --2- 172.21.15.167:0/1871936562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f790c101c00 0x7f790c197f30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f78fc031610 tx=0x7f78fc0043b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:39.639 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.622+0000 7f78fb7fe640 1 -- 172.21.15.167:0/1871936562 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc03f030 con 0x7f790c101c00 2024-09-19T08:51:39.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.622+0000 7f78fb7fe640 1 -- 172.21.15.167:0/1871936562 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78fc003ce0 con 0x7f790c101c00 2024-09-19T08:51:39.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.622+0000 7f79108e4640 1 -- 172.21.15.167:0/1871936562 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f790c19fdf0 con 0x7f790c101c00 2024-09-19T08:51:39.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.622+0000 7f78fb7fe640 1 -- 172.21.15.167:0/1871936562 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc035070 con 0x7f790c101c00 2024-09-19T08:51:39.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.622+0000 7f79108e4640 1 -- 172.21.15.167:0/1871936562 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f790c1a0210 con 0x7f790c101c00 2024-09-19T08:51:39.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.624+0000 7f79108e4640 1 -- 172.21.15.167:0/1871936562 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f790c108ff0 con 0x7f790c101c00 2024-09-19T08:51:39.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.624+0000 7f78fb7fe640 1 -- 172.21.15.167:0/1871936562 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f78fc042030 con 0x7f790c101c00 2024-09-19T08:51:39.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.625+0000 7f78fb7fe640 1 --2- 172.21.15.167:0/1871936562 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f78f40a3270 0x7f78f40a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:39.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.625+0000 7f78fb7fe640 1 -- 172.21.15.167:0/1871936562 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4685+0+0 (secure 0 0 0) 0x7f78fc0ef030 con 0x7f790c101c00 2024-09-19T08:51:39.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.625+0000 7f7909d9b640 1 --2- 172.21.15.167:0/1871936562 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f78f40a3270 0x7f78f40a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:39.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.626+0000 7f7909d9b640 1 --2- 172.21.15.167:0/1871936562 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f78f40a3270 0x7f78f40a5730 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7900005fd0 tx=0x7f7900005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:39.640 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.629+0000 7f78fb7fe640 1 -- 172.21.15.167:0/1871936562 <== mon.2 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f78fc0bcb80 con 0x7f790c101c00 2024-09-19T08:51:39.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:39 smithi092 ceph-mon[31407]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:51:39.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:39 smithi092 ceph-mon[31407]: from='osd.6 [v2:172.21.15.92:6818/1743435653,v1:172.21.15.92:6819/1743435653]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T08:51:39.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:39 smithi092 ceph-mon[31407]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T08:51:39.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:39 smithi092 ceph-mon[31407]: from='osd.6 [v2:172.21.15.92:6818/1743435653,v1:172.21.15.92:6819/1743435653]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-19T08:51:39.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:39 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:51:39.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:39 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:39.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:39 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:39.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:39 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:51:39.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:39 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:51:39.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:39 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:51:39.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:39 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:39.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:39 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:39.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:39 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:51:39.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:39 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:39.804 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:39.803+0000 7f79108e4640 1 -- 172.21.15.167:0/1871936562 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f790c062630 con 0x7f78f40a3270 2024-09-19T08:51:40.503 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 08:51:40 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T08:51:40.105+0000 7f7ad2687640 -1 osd.6 0 waiting for initial osdmap 2024-09-19T08:51:40.503 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 08:51:40 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T08:51:40.116+0000 7f7acacb9640 -1 osd.6 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:51:40.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:40 smithi092 ceph-mon[31407]: Detected new or changed devices on smithi092 2024-09-19T08:51:40.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:40 smithi092 ceph-mon[31407]: Adjusting osd_memory_target on smithi092 to 5696M 2024-09-19T08:51:40.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:40 smithi092 ceph-mon[31407]: from='osd.6 [v2:172.21.15.92:6818/1743435653,v1:172.21.15.92:6819/1743435653]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-19T08:51:40.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:40 smithi092 ceph-mon[31407]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T08:51:40.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:40 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:51:40.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:40 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:51:40.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:40 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:51:40.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:40 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:51:40.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:40 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:40.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:40 smithi092 ceph-mon[31407]: from='osd.6 [v2:172.21.15.92:6818/1743435653,v1:172.21.15.92:6819/1743435653]' entity='osd.6' 2024-09-19T08:51:40.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:40 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:51:40.515 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:40 smithi167 ceph-mon[35359]: Detected new or changed devices on smithi092 2024-09-19T08:51:40.515 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:40 smithi167 ceph-mon[35359]: Adjusting osd_memory_target on smithi092 to 5696M 2024-09-19T08:51:40.515 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:40 smithi167 ceph-mon[35359]: from='osd.6 [v2:172.21.15.92:6818/1743435653,v1:172.21.15.92:6819/1743435653]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-19T08:51:40.516 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:40 smithi167 ceph-mon[35359]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T08:51:40.516 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:40 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:51:40.516 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:40 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:51:40.516 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:40 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:51:40.516 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:40 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:51:40.516 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:40 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:40.516 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:40 smithi167 ceph-mon[35359]: from='osd.6 [v2:172.21.15.92:6818/1743435653,v1:172.21.15.92:6819/1743435653]' entity='osd.6' 2024-09-19T08:51:40.516 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:40 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:51:40.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:40 smithi190 ceph-mon[35358]: Detected new or changed devices on smithi092 2024-09-19T08:51:40.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:40 smithi190 ceph-mon[35358]: Adjusting osd_memory_target on smithi092 to 5696M 2024-09-19T08:51:40.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:40 smithi190 ceph-mon[35358]: from='osd.6 [v2:172.21.15.92:6818/1743435653,v1:172.21.15.92:6819/1743435653]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-19T08:51:40.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:40 smithi190 ceph-mon[35358]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T08:51:40.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:40 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:51:40.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:40 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:51:40.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:40 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:51:40.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:40 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:51:40.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:40 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:40.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:40 smithi190 ceph-mon[35358]: from='osd.6 [v2:172.21.15.92:6818/1743435653,v1:172.21.15.92:6819/1743435653]' entity='osd.6' 2024-09-19T08:51:40.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:40 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:51:41.348 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:41 smithi167 ceph-mon[35359]: purged_snaps scrub starts 2024-09-19T08:51:41.348 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:41 smithi167 ceph-mon[35359]: purged_snaps scrub ok 2024-09-19T08:51:41.348 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:41 smithi167 ceph-mon[35359]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:51:41.348 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:41 smithi167 ceph-mon[35359]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:51:41.348 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:41 smithi167 ceph-mon[35359]: osd.6 [v2:172.21.15.92:6818/1743435653,v1:172.21.15.92:6819/1743435653] boot 2024-09-19T08:51:41.349 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:41 smithi167 ceph-mon[35359]: osdmap e43: 7 total, 7 up, 7 in 2024-09-19T08:51:41.349 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:41 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:51:41.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:41 smithi190 ceph-mon[35358]: purged_snaps scrub starts 2024-09-19T08:51:41.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:41 smithi190 ceph-mon[35358]: purged_snaps scrub ok 2024-09-19T08:51:41.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:41 smithi190 ceph-mon[35358]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:51:41.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:41 smithi190 ceph-mon[35358]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:51:41.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:41 smithi190 ceph-mon[35358]: osd.6 [v2:172.21.15.92:6818/1743435653,v1:172.21.15.92:6819/1743435653] boot 2024-09-19T08:51:41.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:41 smithi190 ceph-mon[35358]: osdmap e43: 7 total, 7 up, 7 in 2024-09-19T08:51:41.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:41 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:51:41.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:41 smithi092 ceph-mon[31407]: purged_snaps scrub starts 2024-09-19T08:51:41.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:41 smithi092 ceph-mon[31407]: purged_snaps scrub ok 2024-09-19T08:51:41.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:41 smithi092 ceph-mon[31407]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:51:41.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:41 smithi092 ceph-mon[31407]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:51:41.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:41 smithi092 ceph-mon[31407]: osd.6 [v2:172.21.15.92:6818/1743435653,v1:172.21.15.92:6819/1743435653] boot 2024-09-19T08:51:41.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:41 smithi092 ceph-mon[31407]: osdmap e43: 7 total, 7 up, 7 in 2024-09-19T08:51:41.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:41 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:51:42.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:42 smithi167 ceph-mon[35359]: from='client.? 172.21.15.167:0/3576479802' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "652a6aa1-bb94-4608-952e-67cd02bdff66"}]: dispatch 2024-09-19T08:51:42.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:42 smithi167 ceph-mon[35359]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "652a6aa1-bb94-4608-952e-67cd02bdff66"}]: dispatch 2024-09-19T08:51:42.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:42 smithi167 ceph-mon[35359]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "652a6aa1-bb94-4608-952e-67cd02bdff66"}]': finished 2024-09-19T08:51:42.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:42 smithi167 ceph-mon[35359]: osdmap e44: 8 total, 7 up, 8 in 2024-09-19T08:51:42.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:42 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:51:42.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:42 smithi190 ceph-mon[35358]: from='client.? 172.21.15.167:0/3576479802' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "652a6aa1-bb94-4608-952e-67cd02bdff66"}]: dispatch 2024-09-19T08:51:42.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:42 smithi190 ceph-mon[35358]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "652a6aa1-bb94-4608-952e-67cd02bdff66"}]: dispatch 2024-09-19T08:51:42.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:42 smithi190 ceph-mon[35358]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "652a6aa1-bb94-4608-952e-67cd02bdff66"}]': finished 2024-09-19T08:51:42.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:42 smithi190 ceph-mon[35358]: osdmap e44: 8 total, 7 up, 8 in 2024-09-19T08:51:42.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:42 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:51:42.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:42 smithi092 ceph-mon[31407]: from='client.? 172.21.15.167:0/3576479802' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "652a6aa1-bb94-4608-952e-67cd02bdff66"}]: dispatch 2024-09-19T08:51:42.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:42 smithi092 ceph-mon[31407]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "652a6aa1-bb94-4608-952e-67cd02bdff66"}]: dispatch 2024-09-19T08:51:42.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:42 smithi092 ceph-mon[31407]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "652a6aa1-bb94-4608-952e-67cd02bdff66"}]': finished 2024-09-19T08:51:42.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:42 smithi092 ceph-mon[31407]: osdmap e44: 8 total, 7 up, 8 in 2024-09-19T08:51:42.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:42 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:51:43.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:43 smithi167 ceph-mon[35359]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:51:43.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:43 smithi167 ceph-mon[35359]: from='client.? 172.21.15.167:0/2333179117' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:51:43.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:43 smithi190 ceph-mon[35358]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:51:43.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:43 smithi190 ceph-mon[35358]: from='client.? 172.21.15.167:0/2333179117' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:51:43.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:43 smithi092 ceph-mon[31407]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:51:43.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:43 smithi092 ceph-mon[31407]: from='client.? 172.21.15.167:0/2333179117' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:51:45.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:45 smithi167 ceph-mon[35359]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:51:45.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:45 smithi190 ceph-mon[35358]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:51:45.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:45 smithi092 ceph-mon[31407]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:51:47.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:47 smithi167 ceph-mon[35359]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:51:47.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:47 smithi190 ceph-mon[35358]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:51:47.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:47 smithi092 ceph-mon[31407]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:51:49.361 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:49 smithi167 ceph-mon[35359]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:51:49.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:49 smithi190 ceph-mon[35358]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:51:49.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:49 smithi092 ceph-mon[31407]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:51:51.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:51 smithi167 ceph-mon[35359]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:51:51.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:51 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T08:51:51.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:51 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:51.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:51 smithi190 ceph-mon[35358]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:51:51.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:51 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T08:51:51.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:51 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:51.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:51 smithi092 ceph-mon[31407]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:51:51.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:51 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T08:51:51.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:51 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:52.445 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:52 smithi167 ceph-mon[35359]: Deploying daemon osd.7 on smithi167 2024-09-19T08:51:52.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:52 smithi190 ceph-mon[35358]: Deploying daemon osd.7 on smithi167 2024-09-19T08:51:52.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:52 smithi092 ceph-mon[31407]: Deploying daemon osd.7 on smithi167 2024-09-19T08:51:53.333 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:53 smithi167 ceph-mon[35359]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:51:53.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:53 smithi190 ceph-mon[35358]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:51:53.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:53 smithi092 ceph-mon[31407]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:51:55.423 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:55 smithi167 ceph-mon[35359]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:51:55.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:55 smithi190 ceph-mon[35358]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:51:55.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:55 smithi092 ceph-mon[31407]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:51:56.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:56 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:51:56.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:56 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:56.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:56 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:56.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:56 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:51:56.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:56 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:56.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:56 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:56.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:56 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:51:56.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:56 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:56.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:56 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:57.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:57 smithi167 ceph-mon[35359]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:51:57.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:57 smithi190 ceph-mon[35358]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:51:57.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:57 smithi092 ceph-mon[31407]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:51:59.461 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:59 smithi167 ceph-mon[35359]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:51:59.461 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:59 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:59.461 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:59 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:59.462 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:59 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:59.462 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:59 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:51:59.462 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:51:59 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:59.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:59 smithi190 ceph-mon[35358]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:51:59.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:59 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:59.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:59 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:59.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:59 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:59.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:59 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:51:59.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:51:59 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:59.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:59 smithi092 ceph-mon[31407]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:51:59.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:59 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:59.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:59 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:59.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:59 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:59.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:59 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:51:59.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:51:59 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:51:59.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:59.777+0000 7f78fb7fe640 1 -- 172.21.15.167:0/1871936562 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f790c062630 con 0x7f78f40a3270 2024-09-19T08:51:59.777 INFO:teuthology.orchestra.run.smithi167.stdout:Created osd(s) 7 on host 'smithi167' 2024-09-19T08:51:59.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:59.779+0000 7f79108e4640 1 -- 172.21.15.167:0/1871936562 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f78f40a3270 msgr2=0x7f78f40a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:59.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:59.779+0000 7f79108e4640 1 --2- 172.21.15.167:0/1871936562 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f78f40a3270 0x7f78f40a5730 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7900005fd0 tx=0x7f7900005c70 comp rx=0 tx=0).stop 2024-09-19T08:51:59.779 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:59.779+0000 7f79108e4640 1 -- 172.21.15.167:0/1871936562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f790c101c00 msgr2=0x7f790c197f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:59.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:59.779+0000 7f79108e4640 1 --2- 172.21.15.167:0/1871936562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f790c101c00 0x7f790c197f30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f78fc031610 tx=0x7f78fc0043b0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:59.779+0000 7f79108e4640 1 -- 172.21.15.167:0/1871936562 shutdown_connections 2024-09-19T08:51:59.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:59.779+0000 7f79108e4640 1 --2- 172.21.15.167:0/1871936562 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f78f40a3270 0x7f78f40a5730 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:59.779+0000 7f79108e4640 1 --2- 172.21.15.167:0/1871936562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f790c1037c0 0x7f790c19f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:59.779+0000 7f79108e4640 1 --2- 172.21.15.167:0/1871936562 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f790c102e00 0x7f790c198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:59.779+0000 7f79108e4640 1 --2- 172.21.15.167:0/1871936562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f790c101c00 0x7f790c197f30 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:59.780+0000 7f79108e4640 1 -- 172.21.15.167:0/1871936562 >> 172.21.15.167:0/1871936562 conn(0x7f790c0fd390 msgr2=0x7f790c1061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:59.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:59.780+0000 7f79108e4640 1 -- 172.21.15.167:0/1871936562 shutdown_connections 2024-09-19T08:51:59.780 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:51:59.780+0000 7f79108e4640 1 -- 172.21.15.167:0/1871936562 wait complete. 2024-09-19T08:52:00.369 DEBUG:teuthology.orchestra.run.smithi167:osd.7> sudo journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@osd.7.service 2024-09-19T08:52:00.371 INFO:tasks.cephadm:Deploying osd.8 on smithi190 with /dev/vg_nvme/lv_2... 2024-09-19T08:52:00.371 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T08:52:00.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:00 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:52:00.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:00 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:00.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:00 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:00.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:00 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:52:00.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:00 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:00.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:00 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:00.626 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:52:00.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:00 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:52:00.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:00 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:00.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:00 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:01.530 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:01 smithi167 ceph-mon[35359]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:52:01.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:01 smithi190 ceph-mon[35358]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:52:01.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:01 smithi092 ceph-mon[31407]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:52:02.544 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:02 smithi167 ceph-mon[35359]: from='osd.7 [v2:172.21.15.167:6816/2984111963,v1:172.21.15.167:6817/2984111963]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:52:02.544 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:02 smithi167 ceph-mon[35359]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:52:02.545 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 08:52:02 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T08:52:02.153+0000 7fec48057640 -1 osd.7 0 log_to_monitors true 2024-09-19T08:52:02.568 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:02 smithi190 ceph-mon[35358]: from='osd.7 [v2:172.21.15.167:6816/2984111963,v1:172.21.15.167:6817/2984111963]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:52:02.568 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:02 smithi190 ceph-mon[35358]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:52:02.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:02 smithi092 ceph-mon[31407]: from='osd.7 [v2:172.21.15.167:6816/2984111963,v1:172.21.15.167:6817/2984111963]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:52:02.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:02 smithi092 ceph-mon[31407]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:52:03.072 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-19T08:52:03.098 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi190:vg_nvme/lv_2 2024-09-19T08:52:03.349 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:52:03.601 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 08:52:03 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T08:52:03.362+0000 7fec437b7640 -1 osd.7 0 waiting for initial osdmap 2024-09-19T08:52:03.601 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 08:52:03 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T08:52:03.373+0000 7fec3fdf1640 -1 osd.7 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:52:03.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:03 smithi167 ceph-mon[35359]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:52:03.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:03 smithi167 ceph-mon[35359]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T08:52:03.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:03 smithi167 ceph-mon[35359]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T08:52:03.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:03 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:52:03.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:03 smithi167 ceph-mon[35359]: from='osd.7 [v2:172.21.15.167:6816/2984111963,v1:172.21.15.167:6817/2984111963]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T08:52:03.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:03 smithi167 ceph-mon[35359]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T08:52:03.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:03 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:03.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:03 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:03.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:03 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:03.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:03 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:03.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:03 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:03.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:03 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:03.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:03 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:03.603 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:03 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:52:03.603 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:03 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:03.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:03 smithi190 ceph-mon[35358]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:52:03.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:03 smithi190 ceph-mon[35358]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T08:52:03.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:03 smithi190 ceph-mon[35358]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T08:52:03.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:03 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:52:03.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:03 smithi190 ceph-mon[35358]: from='osd.7 [v2:172.21.15.167:6816/2984111963,v1:172.21.15.167:6817/2984111963]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T08:52:03.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:03 smithi190 ceph-mon[35358]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T08:52:03.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:03 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:03.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:03 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:03.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:03 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:03.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:03 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:03.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:03 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:03.625 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:03 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:03.625 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:03 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:03.625 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:03 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:52:03.625 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:03 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:03.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:03 smithi092 ceph-mon[31407]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:52:03.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:03 smithi092 ceph-mon[31407]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T08:52:03.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:03 smithi092 ceph-mon[31407]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T08:52:03.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:03 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:52:03.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:03 smithi092 ceph-mon[31407]: from='osd.7 [v2:172.21.15.167:6816/2984111963,v1:172.21.15.167:6817/2984111963]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T08:52:03.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:03 smithi092 ceph-mon[31407]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T08:52:03.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:03 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:03.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:03 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:03.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:03 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:03.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:03 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:03.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:03 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:03.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:03 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:03.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:03 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:03.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:03 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:52:03.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:03 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:03.773 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.771+0000 7f184dc67640 1 -- 172.21.15.190:0/1091788584 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18481026d0 msgr2=0x7f1848108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:03.773 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.771+0000 7f184dc67640 1 --2- 172.21.15.190:0/1091788584 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18481026d0 0x7f1848108f60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1840009ca0 tx=0x7f184002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.773 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.771+0000 7f184dc67640 1 -- 172.21.15.190:0/1091788584 shutdown_connections 2024-09-19T08:52:03.773 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.771+0000 7f184dc67640 1 --2- 172.21.15.190:0/1091788584 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18481026d0 0x7f1848108f60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.773 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.771+0000 7f184dc67640 1 --2- 172.21.15.190:0/1091788584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1848101d10 0x7f1848102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.774 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.772+0000 7f184dc67640 1 --2- 172.21.15.190:0/1091788584 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1848100b10 0x7f1848100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.774 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.772+0000 7f184dc67640 1 -- 172.21.15.190:0/1091788584 >> 172.21.15.190:0/1091788584 conn(0x7f18480fc2a0 msgr2=0x7f18480fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:03.774 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.772+0000 7f184dc67640 1 -- 172.21.15.190:0/1091788584 shutdown_connections 2024-09-19T08:52:03.774 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.772+0000 7f184dc67640 1 -- 172.21.15.190:0/1091788584 wait complete. 2024-09-19T08:52:03.774 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.772+0000 7f184dc67640 1 Processor -- start 2024-09-19T08:52:03.774 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.772+0000 7f184dc67640 1 -- start start 2024-09-19T08:52:03.774 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.772+0000 7f184dc67640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1848100b10 0x7f1848104aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.774 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.772+0000 7f184dc67640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1848101d10 0x7f18481030f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.774 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.773+0000 7f184dc67640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18481026d0 0x7f1848103630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.774 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.773+0000 7f184dc67640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f184810c770 con 0x7f1848101d10 2024-09-19T08:52:03.774 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.773+0000 7f184dc67640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f184810c5f0 con 0x7f18481026d0 2024-09-19T08:52:03.774 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.773+0000 7f184dc67640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f184810c8f0 con 0x7f1848100b10 2024-09-19T08:52:03.775 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.773+0000 7f18477fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1848100b10 0x7f1848104aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.775 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.773+0000 7f18477fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1848100b10 0x7f1848104aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:33564/0 (socket says 172.21.15.190:33564) 2024-09-19T08:52:03.775 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.773+0000 7f18477fe640 1 -- 172.21.15.190:0/2633085272 learned_addr learned my addr 172.21.15.190:0/2633085272 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-09-19T08:52:03.775 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.773+0000 7f1846ffd640 1 --2- 172.21.15.190:0/2633085272 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1848101d10 0x7f18481030f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.775 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.773+0000 7f1847fff640 1 --2- 172.21.15.190:0/2633085272 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18481026d0 0x7f1848103630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.775 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.773+0000 7f18477fe640 1 -- 172.21.15.190:0/2633085272 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18481026d0 msgr2=0x7f1848103630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:03.775 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.773+0000 7f18477fe640 1 --2- 172.21.15.190:0/2633085272 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18481026d0 0x7f1848103630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.775 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.773+0000 7f18477fe640 1 -- 172.21.15.190:0/2633085272 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1848101d10 msgr2=0x7f18481030f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:03.775 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.773+0000 7f18477fe640 1 --2- 172.21.15.190:0/2633085272 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1848101d10 0x7f18481030f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.775 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.773+0000 7f18477fe640 1 -- 172.21.15.190:0/2633085272 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1848103ef0 con 0x7f1848100b10 2024-09-19T08:52:03.775 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.773+0000 7f1846ffd640 1 --2- 172.21.15.190:0/2633085272 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1848101d10 0x7f18481030f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:03.775 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.773+0000 7f18477fe640 1 --2- 172.21.15.190:0/2633085272 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1848100b10 0x7f1848104aa0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f183800e9c0 tx=0x7f183800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:03.776 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.773+0000 7f1844ff9640 1 -- 172.21.15.190:0/2633085272 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183800cd80 con 0x7f1848100b10 2024-09-19T08:52:03.776 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.773+0000 7f184dc67640 1 -- 172.21.15.190:0/2633085272 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18481a20b0 con 0x7f1848100b10 2024-09-19T08:52:03.776 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.773+0000 7f1844ff9640 1 -- 172.21.15.190:0/2633085272 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18380035f0 con 0x7f1848100b10 2024-09-19T08:52:03.776 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.773+0000 7f1844ff9640 1 -- 172.21.15.190:0/2633085272 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1838010690 con 0x7f1848100b10 2024-09-19T08:52:03.776 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.773+0000 7f184dc67640 1 -- 172.21.15.190:0/2633085272 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18481a25c0 con 0x7f1848100b10 2024-09-19T08:52:03.777 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.774+0000 7f184dc67640 1 -- 172.21.15.190:0/2633085272 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18481a2850 con 0x7f1848100b10 2024-09-19T08:52:03.777 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.776+0000 7f1844ff9640 1 -- 172.21.15.190:0/2633085272 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f18380037a0 con 0x7f1848100b10 2024-09-19T08:52:03.777 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.777+0000 7f1844ff9640 1 --2- 172.21.15.190:0/2633085272 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f18300a3240 0x7f18300a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.777 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.777+0000 7f1844ff9640 1 -- 172.21.15.190:0/2633085272 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5117+0+0 (secure 0 0 0) 0x7f18380cf100 con 0x7f1848100b10 2024-09-19T08:52:03.777 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.777+0000 7f1846ffd640 1 --2- 172.21.15.190:0/2633085272 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f18300a3240 0x7f18300a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.777 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.777+0000 7f1846ffd640 1 --2- 172.21.15.190:0/2633085272 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f18300a3240 0x7f18300a5700 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1848104820 tx=0x7f183c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:03.781 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.781+0000 7f1844ff9640 1 -- 172.21.15.190:0/2633085272 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f183809caa0 con 0x7f1848100b10 2024-09-19T08:52:03.953 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:03.953+0000 7f184dc67640 1 -- 172.21.15.190:0/2633085272 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f18481a2a20 con 0x7f18300a3240 2024-09-19T08:52:04.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:04 smithi190 ceph-mon[35358]: Detected new or changed devices on smithi167 2024-09-19T08:52:04.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:04 smithi190 ceph-mon[35358]: Adjusting osd_memory_target on smithi167 to 5696M 2024-09-19T08:52:04.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:04 smithi190 ceph-mon[35358]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-19T08:52:04.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:04 smithi190 ceph-mon[35358]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T08:52:04.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:04 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:52:04.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:04 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:52:04.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:04 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:52:04.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:04 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:52:04.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:04 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:04.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:04 smithi092 ceph-mon[31407]: Detected new or changed devices on smithi167 2024-09-19T08:52:04.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:04 smithi092 ceph-mon[31407]: Adjusting osd_memory_target on smithi167 to 5696M 2024-09-19T08:52:04.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:04 smithi092 ceph-mon[31407]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-19T08:52:04.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:04 smithi092 ceph-mon[31407]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T08:52:04.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:04 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:52:04.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:04 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:52:04.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:04 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:52:04.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:04 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:52:04.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:04 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:04.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:04 smithi167 ceph-mon[35359]: Detected new or changed devices on smithi167 2024-09-19T08:52:04.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:04 smithi167 ceph-mon[35359]: Adjusting osd_memory_target on smithi167 to 5696M 2024-09-19T08:52:04.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:04 smithi167 ceph-mon[35359]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-19T08:52:04.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:04 smithi167 ceph-mon[35359]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T08:52:04.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:04 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:52:04.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:04 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:52:04.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:04 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:52:04.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:04 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:52:04.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:04 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:05.436 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:05 smithi190 ceph-mon[35358]: purged_snaps scrub starts 2024-09-19T08:52:05.436 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:05 smithi190 ceph-mon[35358]: purged_snaps scrub ok 2024-09-19T08:52:05.436 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:05 smithi190 ceph-mon[35358]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:52:05.436 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:05 smithi190 ceph-mon[35358]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:52:05.436 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:05 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:52:05.436 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:05 smithi190 ceph-mon[35358]: osd.7 [v2:172.21.15.167:6816/2984111963,v1:172.21.15.167:6817/2984111963] boot 2024-09-19T08:52:05.436 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:05 smithi190 ceph-mon[35358]: osdmap e47: 8 total, 8 up, 8 in 2024-09-19T08:52:05.436 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:05 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:52:05.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:05 smithi092 ceph-mon[31407]: purged_snaps scrub starts 2024-09-19T08:52:05.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:05 smithi092 ceph-mon[31407]: purged_snaps scrub ok 2024-09-19T08:52:05.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:05 smithi092 ceph-mon[31407]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:52:05.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:05 smithi092 ceph-mon[31407]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:52:05.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:05 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:52:05.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:05 smithi092 ceph-mon[31407]: osd.7 [v2:172.21.15.167:6816/2984111963,v1:172.21.15.167:6817/2984111963] boot 2024-09-19T08:52:05.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:05 smithi092 ceph-mon[31407]: osdmap e47: 8 total, 8 up, 8 in 2024-09-19T08:52:05.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:05 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:52:05.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:05 smithi167 ceph-mon[35359]: purged_snaps scrub starts 2024-09-19T08:52:05.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:05 smithi167 ceph-mon[35359]: purged_snaps scrub ok 2024-09-19T08:52:05.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:05 smithi167 ceph-mon[35359]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:52:05.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:05 smithi167 ceph-mon[35359]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:52:05.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:05 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:52:05.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:05 smithi167 ceph-mon[35359]: osd.7 [v2:172.21.15.167:6816/2984111963,v1:172.21.15.167:6817/2984111963] boot 2024-09-19T08:52:05.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:05 smithi167 ceph-mon[35359]: osdmap e47: 8 total, 8 up, 8 in 2024-09-19T08:52:05.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:05 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:52:06.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:06 smithi190 ceph-mon[35358]: osdmap e48: 8 total, 8 up, 8 in 2024-09-19T08:52:06.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:06 smithi190 ceph-mon[35358]: from='client.? 172.21.15.190:0/3305540366' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1510ef1f-fdfe-4887-a771-146efce062fe"}]: dispatch 2024-09-19T08:52:06.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:06 smithi190 ceph-mon[35358]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1510ef1f-fdfe-4887-a771-146efce062fe"}]: dispatch 2024-09-19T08:52:06.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:06 smithi190 ceph-mon[35358]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1510ef1f-fdfe-4887-a771-146efce062fe"}]': finished 2024-09-19T08:52:06.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:06 smithi190 ceph-mon[35358]: osdmap e49: 9 total, 8 up, 9 in 2024-09-19T08:52:06.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:06 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:52:06.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:06 smithi092 ceph-mon[31407]: osdmap e48: 8 total, 8 up, 8 in 2024-09-19T08:52:06.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:06 smithi092 ceph-mon[31407]: from='client.? 172.21.15.190:0/3305540366' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1510ef1f-fdfe-4887-a771-146efce062fe"}]: dispatch 2024-09-19T08:52:06.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:06 smithi092 ceph-mon[31407]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1510ef1f-fdfe-4887-a771-146efce062fe"}]: dispatch 2024-09-19T08:52:06.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:06 smithi092 ceph-mon[31407]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1510ef1f-fdfe-4887-a771-146efce062fe"}]': finished 2024-09-19T08:52:06.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:06 smithi092 ceph-mon[31407]: osdmap e49: 9 total, 8 up, 9 in 2024-09-19T08:52:06.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:06 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:52:06.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:06 smithi167 ceph-mon[35359]: osdmap e48: 8 total, 8 up, 8 in 2024-09-19T08:52:06.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:06 smithi167 ceph-mon[35359]: from='client.? 172.21.15.190:0/3305540366' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1510ef1f-fdfe-4887-a771-146efce062fe"}]: dispatch 2024-09-19T08:52:06.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:06 smithi167 ceph-mon[35359]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1510ef1f-fdfe-4887-a771-146efce062fe"}]: dispatch 2024-09-19T08:52:06.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:06 smithi167 ceph-mon[35359]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1510ef1f-fdfe-4887-a771-146efce062fe"}]': finished 2024-09-19T08:52:06.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:06 smithi167 ceph-mon[35359]: osdmap e49: 9 total, 8 up, 9 in 2024-09-19T08:52:06.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:06 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:52:07.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:07 smithi092 ceph-mon[31407]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:52:07.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:07 smithi092 ceph-mon[31407]: from='client.? 172.21.15.190:0/2102228750' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:52:07.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:07 smithi167 ceph-mon[35359]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:52:07.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:07 smithi167 ceph-mon[35359]: from='client.? 172.21.15.190:0/2102228750' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:52:07.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:07 smithi190 ceph-mon[35358]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:52:07.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:07 smithi190 ceph-mon[35358]: from='client.? 172.21.15.190:0/2102228750' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:52:08.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:08 smithi092 ceph-mon[31407]: osdmap e50: 9 total, 8 up, 9 in 2024-09-19T08:52:08.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:08 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:52:08.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:08 smithi167 ceph-mon[35359]: osdmap e50: 9 total, 8 up, 9 in 2024-09-19T08:52:08.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:08 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:52:08.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:08 smithi190 ceph-mon[35358]: osdmap e50: 9 total, 8 up, 9 in 2024-09-19T08:52:08.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:08 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:52:09.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:09 smithi092 ceph-mon[31407]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:52:09.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:09 smithi092 ceph-mon[31407]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T08:52:09.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:09 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:52:09.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:09 smithi167 ceph-mon[35359]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:52:09.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:09 smithi167 ceph-mon[35359]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T08:52:09.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:09 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:52:09.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:09 smithi190 ceph-mon[35358]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:52:09.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:09 smithi190 ceph-mon[35358]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T08:52:09.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:09 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:52:11.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:11 smithi092 ceph-mon[31407]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:52:11.818 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:11 smithi190 ceph-mon[35358]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:52:11.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:11 smithi167 ceph-mon[35359]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:52:13.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:13 smithi167 ceph-mon[35359]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:52:13.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:13 smithi190 ceph-mon[35358]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:52:13.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:13 smithi092 ceph-mon[31407]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:52:15.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:15 smithi190 ceph-mon[35358]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:52:15.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:15 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T08:52:15.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:15 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:15.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:15 smithi092 ceph-mon[31407]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:52:15.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:15 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T08:52:15.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:15 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:15.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:15 smithi167 ceph-mon[35359]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:52:15.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:15 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T08:52:15.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:15 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:16.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:16 smithi092 ceph-mon[31407]: Deploying daemon osd.8 on smithi190 2024-09-19T08:52:16.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:16 smithi167 ceph-mon[35359]: Deploying daemon osd.8 on smithi190 2024-09-19T08:52:16.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:16 smithi190 ceph-mon[35358]: Deploying daemon osd.8 on smithi190 2024-09-19T08:52:17.582 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:17 smithi190 ceph-mon[35358]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:52:17.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:17 smithi092 ceph-mon[31407]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:52:17.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:17 smithi167 ceph-mon[35359]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:52:19.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:19 smithi092 ceph-mon[31407]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:52:19.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:19 smithi167 ceph-mon[35359]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:52:19.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:19 smithi190 ceph-mon[35358]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:52:20.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:20 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:52:20.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:20 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:20.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:20 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:20.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:20 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:52:20.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:20 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:20.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:20 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:20.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:20 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:52:20.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:20 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:20.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:20 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:21.695 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:21 smithi190 ceph-mon[35358]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:52:21.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:21 smithi092 ceph-mon[31407]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:52:21.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:21 smithi167 ceph-mon[35359]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:52:23.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:23 smithi190 ceph-mon[35358]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:52:23.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:23 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:23.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:23 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:23.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:23 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:23.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:23 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:52:23.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:23 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:23.671 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:23.671+0000 7f1844ff9640 1 -- 172.21.15.190:0/2633085272 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f18481a2a20 con 0x7f18300a3240 2024-09-19T08:52:23.672 INFO:teuthology.orchestra.run.smithi190.stdout:Created osd(s) 8 on host 'smithi190' 2024-09-19T08:52:23.673 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:23.673+0000 7f184dc67640 1 -- 172.21.15.190:0/2633085272 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f18300a3240 msgr2=0x7f18300a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:23.673 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:23.673+0000 7f184dc67640 1 --2- 172.21.15.190:0/2633085272 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f18300a3240 0x7f18300a5700 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1848104820 tx=0x7f183c005f90 comp rx=0 tx=0).stop 2024-09-19T08:52:23.674 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:23.674+0000 7f184dc67640 1 -- 172.21.15.190:0/2633085272 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1848100b10 msgr2=0x7f1848104aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:23.674 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:23.674+0000 7f184dc67640 1 --2- 172.21.15.190:0/2633085272 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1848100b10 0x7f1848104aa0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f183800e9c0 tx=0x7f183800ee80 comp rx=0 tx=0).stop 2024-09-19T08:52:23.674 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:23.674+0000 7f184dc67640 1 -- 172.21.15.190:0/2633085272 shutdown_connections 2024-09-19T08:52:23.674 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:23.674+0000 7f184dc67640 1 --2- 172.21.15.190:0/2633085272 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18481026d0 0x7f1848103630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:23.674 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:23.674+0000 7f184dc67640 1 --2- 172.21.15.190:0/2633085272 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f18300a3240 0x7f18300a5700 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:23.674 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:23.674+0000 7f184dc67640 1 --2- 172.21.15.190:0/2633085272 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1848101d10 0x7f18481030f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:23.674 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:23.674+0000 7f184dc67640 1 --2- 172.21.15.190:0/2633085272 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1848100b10 0x7f1848104aa0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:23.674 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:23.674+0000 7f184dc67640 1 -- 172.21.15.190:0/2633085272 >> 172.21.15.190:0/2633085272 conn(0x7f18480fc2a0 msgr2=0x7f18480fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:23.674 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:23.674+0000 7f184dc67640 1 -- 172.21.15.190:0/2633085272 shutdown_connections 2024-09-19T08:52:23.674 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:52:23.674+0000 7f184dc67640 1 -- 172.21.15.190:0/2633085272 wait complete. 2024-09-19T08:52:23.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:23 smithi092 ceph-mon[31407]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:52:23.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:23 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:23.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:23 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:23.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:23 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:23.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:23 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:52:23.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:23 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:23.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:23 smithi167 ceph-mon[35359]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:52:23.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:23 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:23.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:23 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:23.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:23 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:23.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:23 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:52:23.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:23 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:24.234 DEBUG:teuthology.orchestra.run.smithi190:osd.8> sudo journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@osd.8.service 2024-09-19T08:52:24.236 INFO:tasks.cephadm:Deploying osd.9 on smithi092 with /dev/vg_nvme/lv_1... 2024-09-19T08:52:24.237 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T08:52:24.489 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:24.544 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:24 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:52:24.544 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:24 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:24.544 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:24 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:24.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:24 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:52:24.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:24 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:24.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:24 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:24.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:24 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:52:24.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:24 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:24.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:24 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:25.565 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:25 smithi190 ceph-mon[35358]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:52:25.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:25 smithi092 ceph-mon[31407]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:52:25.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:25 smithi167 ceph-mon[35359]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:52:26.578 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:26 smithi190 ceph-mon[35358]: from='osd.8 [v2:172.21.15.190:6816/4190304434,v1:172.21.15.190:6817/4190304434]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:52:26.578 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:26 smithi190 ceph-mon[35358]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:52:26.578 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 08:52:26 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T08:52:26.287+0000 7fe1c3977640 -1 osd.8 0 log_to_monitors true 2024-09-19T08:52:26.635 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:26 smithi092 ceph-mon[31407]: from='osd.8 [v2:172.21.15.190:6816/4190304434,v1:172.21.15.190:6817/4190304434]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:52:26.635 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:26 smithi092 ceph-mon[31407]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:52:26.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:26 smithi167 ceph-mon[35359]: from='osd.8 [v2:172.21.15.190:6816/4190304434,v1:172.21.15.190:6817/4190304434]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:52:26.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:26 smithi167 ceph-mon[35359]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:52:27.052 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:52:27.218 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi092:vg_nvme/lv_1 2024-09-19T08:52:27.465 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:27.694 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:27 smithi092 ceph-mon[31407]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:52:27.695 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:27 smithi092 ceph-mon[31407]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T08:52:27.695 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:27 smithi092 ceph-mon[31407]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T08:52:27.695 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:27 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:52:27.695 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:27 smithi092 ceph-mon[31407]: from='osd.8 [v2:172.21.15.190:6816/4190304434,v1:172.21.15.190:6817/4190304434]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-09-19T08:52:27.695 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:27 smithi092 ceph-mon[31407]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-09-19T08:52:27.695 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:27 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:27.695 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:27 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:27.695 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:27 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:27.695 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:27 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:27.695 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:27 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:27.695 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:27 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:27.696 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:27 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:27.696 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:27 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:52:27.696 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:27 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:27.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:27 smithi167 ceph-mon[35359]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:52:27.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:27 smithi167 ceph-mon[35359]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T08:52:27.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:27 smithi167 ceph-mon[35359]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T08:52:27.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:27 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:52:27.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:27 smithi167 ceph-mon[35359]: from='osd.8 [v2:172.21.15.190:6816/4190304434,v1:172.21.15.190:6817/4190304434]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-09-19T08:52:27.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:27 smithi167 ceph-mon[35359]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-09-19T08:52:27.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:27 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:27.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:27 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:27.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:27 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:27.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:27 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:27.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:27 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:27.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:27 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:27.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:27 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:27.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:27 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:52:27.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:27 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:27.873 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 08:52:27 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T08:52:27.455+0000 7fe1bf0d7640 -1 osd.8 0 waiting for initial osdmap 2024-09-19T08:52:27.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 08:52:27 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T08:52:27.464+0000 7fe1bb711640 -1 osd.8 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:52:27.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:27 smithi190 ceph-mon[35358]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:52:27.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:27 smithi190 ceph-mon[35358]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T08:52:27.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:27 smithi190 ceph-mon[35358]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T08:52:27.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:27 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:52:27.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:27 smithi190 ceph-mon[35358]: from='osd.8 [v2:172.21.15.190:6816/4190304434,v1:172.21.15.190:6817/4190304434]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-09-19T08:52:27.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:27 smithi190 ceph-mon[35358]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-09-19T08:52:27.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:27 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:27.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:27 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:27.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:27 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:27.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:27 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:27.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:27 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:27.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:27 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:27.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:27 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:27.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:27 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:52:27.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:27 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:27.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.987+0000 7f6306d45640 1 -- 172.21.15.92:0/969824778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6300102e00 msgr2=0x7f6300103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:27.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.987+0000 7f6306d45640 1 --2- 172.21.15.92:0/969824778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6300102e00 0x7f6300103280 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f62ec009900 tx=0x7f62ec02a410 comp rx=0 tx=0).stop 2024-09-19T08:52:27.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.987+0000 7f6306d45640 1 -- 172.21.15.92:0/969824778 shutdown_connections 2024-09-19T08:52:27.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.987+0000 7f6306d45640 1 --2- 172.21.15.92:0/969824778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63001037c0 0x7f630010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:27.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.987+0000 7f6306d45640 1 --2- 172.21.15.92:0/969824778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6300102e00 0x7f6300103280 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:27.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.987+0000 7f6306d45640 1 --2- 172.21.15.92:0/969824778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6300101c00 0x7f6300102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:27.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.987+0000 7f6306d45640 1 -- 172.21.15.92:0/969824778 >> 172.21.15.92:0/969824778 conn(0x7f63000fd390 msgr2=0x7f63000ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:27.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.987+0000 7f6306d45640 1 -- 172.21.15.92:0/969824778 shutdown_connections 2024-09-19T08:52:27.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.987+0000 7f6306d45640 1 -- 172.21.15.92:0/969824778 wait complete. 2024-09-19T08:52:27.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.988+0000 7f6306d45640 1 Processor -- start 2024-09-19T08:52:27.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.988+0000 7f6306d45640 1 -- start start 2024-09-19T08:52:27.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.988+0000 7f6306d45640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6300101c00 0x7f6300075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:27.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.988+0000 7f6306d45640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6300102e00 0x7f63000745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:27.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.988+0000 7f6306d45640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63001037c0 0x7f6300074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:27.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.988+0000 7f6306d45640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f630010d880 con 0x7f63001037c0 2024-09-19T08:52:27.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.988+0000 7f6306d45640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f630010d700 con 0x7f6300101c00 2024-09-19T08:52:27.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.988+0000 7f6306d45640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f630010da00 con 0x7f6300102e00 2024-09-19T08:52:27.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.988+0000 7f63052e2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63001037c0 0x7f6300074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:27.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.988+0000 7f63052e2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63001037c0 0x7f6300074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41306/0 (socket says 172.21.15.92:41306) 2024-09-19T08:52:27.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.988+0000 7f63052e2640 1 -- 172.21.15.92:0/2357531714 learned_addr learned my addr 172.21.15.92:0/2357531714 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:52:27.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.988+0000 7f62fffff640 1 --2- 172.21.15.92:0/2357531714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6300102e00 0x7f63000745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:27.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.988+0000 7f6304ae1640 1 --2- 172.21.15.92:0/2357531714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6300101c00 0x7f6300075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:27.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.988+0000 7f63052e2640 1 -- 172.21.15.92:0/2357531714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6300102e00 msgr2=0x7f63000745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:27.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.988+0000 7f63052e2640 1 --2- 172.21.15.92:0/2357531714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6300102e00 0x7f63000745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:27.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.988+0000 7f63052e2640 1 -- 172.21.15.92:0/2357531714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6300101c00 msgr2=0x7f6300075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:27.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.988+0000 7f63052e2640 1 --2- 172.21.15.92:0/2357531714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6300101c00 0x7f6300075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:27.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.988+0000 7f63052e2640 1 -- 172.21.15.92:0/2357531714 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63000753e0 con 0x7f63001037c0 2024-09-19T08:52:27.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.988+0000 7f6304ae1640 1 --2- 172.21.15.92:0/2357531714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6300101c00 0x7f6300075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:27.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.988+0000 7f63052e2640 1 --2- 172.21.15.92:0/2357531714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63001037c0 0x7f6300074b20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f62f8009fd0 tx=0x7f62f800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:27.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.988+0000 7f62fdffb640 1 -- 172.21.15.92:0/2357531714 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f8017070 con 0x7f63001037c0 2024-09-19T08:52:27.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.989+0000 7f62fdffb640 1 -- 172.21.15.92:0/2357531714 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62f8003e50 con 0x7f63001037c0 2024-09-19T08:52:27.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.989+0000 7f6306d45640 1 -- 172.21.15.92:0/2357531714 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63001a20c0 con 0x7f63001037c0 2024-09-19T08:52:27.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.989+0000 7f62fdffb640 1 -- 172.21.15.92:0/2357531714 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f80106c0 con 0x7f63001037c0 2024-09-19T08:52:27.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.989+0000 7f6306d45640 1 -- 172.21.15.92:0/2357531714 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63001a2580 con 0x7f63001037c0 2024-09-19T08:52:27.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.990+0000 7f6306d45640 1 -- 172.21.15.92:0/2357531714 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6300109050 con 0x7f63001037c0 2024-09-19T08:52:27.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.991+0000 7f62fdffb640 1 -- 172.21.15.92:0/2357531714 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f62f8003970 con 0x7f63001037c0 2024-09-19T08:52:27.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.992+0000 7f62fdffb640 1 --2- 172.21.15.92:0/2357531714 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f62f00a3240 0x7f62f00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:27.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.992+0000 7f6304ae1640 1 --2- 172.21.15.92:0/2357531714 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f62f00a3240 0x7f62f00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:27.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.992+0000 7f62fdffb640 1 -- 172.21.15.92:0/2357531714 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5549+0+0 (secure 0 0 0) 0x7f62f80cebe0 con 0x7f63001037c0 2024-09-19T08:52:27.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.992+0000 7f6304ae1640 1 --2- 172.21.15.92:0/2357531714 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f62f00a3240 0x7f62f00a5700 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6300102c60 tx=0x7f62f4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:27.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:27.996+0000 7f62fdffb640 1 -- 172.21.15.92:0/2357531714 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f62f809c3d0 con 0x7f63001037c0 2024-09-19T08:52:28.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:28.172+0000 7f6306d45640 1 -- 172.21.15.92:0/2357531714 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f6300062630 con 0x7f62f00a3240 2024-09-19T08:52:28.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:28 smithi092 ceph-mon[31407]: Detected new or changed devices on smithi190 2024-09-19T08:52:28.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:28 smithi092 ceph-mon[31407]: Adjusting osd_memory_target on smithi190 to 5696M 2024-09-19T08:52:28.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:28 smithi092 ceph-mon[31407]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-09-19T08:52:28.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:28 smithi092 ceph-mon[31407]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T08:52:28.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:28 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:52:28.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:28 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:52:28.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:28 smithi092 ceph-mon[31407]: osd.8 [v2:172.21.15.190:6816/4190304434,v1:172.21.15.190:6817/4190304434] boot 2024-09-19T08:52:28.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:28 smithi092 ceph-mon[31407]: osdmap e54: 9 total, 9 up, 9 in 2024-09-19T08:52:28.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:28 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:52:28.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:28 smithi092 ceph-mon[31407]: from='client.14445 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:52:28.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:28 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:52:28.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:28 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:52:28.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:28 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:28.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:28 smithi092 ceph-mon[31407]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:52:28.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:28 smithi167 ceph-mon[35359]: Detected new or changed devices on smithi190 2024-09-19T08:52:28.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:28 smithi167 ceph-mon[35359]: Adjusting osd_memory_target on smithi190 to 5696M 2024-09-19T08:52:28.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:28 smithi167 ceph-mon[35359]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-09-19T08:52:28.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:28 smithi167 ceph-mon[35359]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T08:52:28.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:28 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:52:28.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:28 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:52:28.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:28 smithi167 ceph-mon[35359]: osd.8 [v2:172.21.15.190:6816/4190304434,v1:172.21.15.190:6817/4190304434] boot 2024-09-19T08:52:28.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:28 smithi167 ceph-mon[35359]: osdmap e54: 9 total, 9 up, 9 in 2024-09-19T08:52:28.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:28 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:52:28.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:28 smithi167 ceph-mon[35359]: from='client.14445 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:52:28.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:28 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:52:28.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:28 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:52:28.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:28 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:28.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:28 smithi167 ceph-mon[35359]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:52:28.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:28 smithi190 ceph-mon[35358]: Detected new or changed devices on smithi190 2024-09-19T08:52:28.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:28 smithi190 ceph-mon[35358]: Adjusting osd_memory_target on smithi190 to 5696M 2024-09-19T08:52:28.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:28 smithi190 ceph-mon[35358]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-09-19T08:52:28.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:28 smithi190 ceph-mon[35358]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T08:52:28.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:28 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:52:28.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:28 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:52:28.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:28 smithi190 ceph-mon[35358]: osd.8 [v2:172.21.15.190:6816/4190304434,v1:172.21.15.190:6817/4190304434] boot 2024-09-19T08:52:28.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:28 smithi190 ceph-mon[35358]: osdmap e54: 9 total, 9 up, 9 in 2024-09-19T08:52:28.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:28 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:52:28.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:28 smithi190 ceph-mon[35358]: from='client.14445 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:52:28.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:28 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:52:28.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:28 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:52:28.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:28 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:28.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:28 smithi190 ceph-mon[35358]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:52:30.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:30 smithi092 ceph-mon[31407]: purged_snaps scrub starts 2024-09-19T08:52:30.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:30 smithi092 ceph-mon[31407]: purged_snaps scrub ok 2024-09-19T08:52:30.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:30 smithi092 ceph-mon[31407]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T08:52:30.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:30 smithi167 ceph-mon[35359]: purged_snaps scrub starts 2024-09-19T08:52:30.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:30 smithi167 ceph-mon[35359]: purged_snaps scrub ok 2024-09-19T08:52:30.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:30 smithi167 ceph-mon[35359]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T08:52:30.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:30 smithi190 ceph-mon[35358]: purged_snaps scrub starts 2024-09-19T08:52:30.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:30 smithi190 ceph-mon[35358]: purged_snaps scrub ok 2024-09-19T08:52:30.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:30 smithi190 ceph-mon[35358]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T08:52:31.503 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:31 smithi167 ceph-mon[35359]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T08:52:31.503 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:31 smithi167 ceph-mon[35359]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:52:31.503 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:31 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3578495043' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9b774bbe-6700-4020-900b-3fdbaa546773"}]: dispatch 2024-09-19T08:52:31.503 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:31 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3578495043' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9b774bbe-6700-4020-900b-3fdbaa546773"}]': finished 2024-09-19T08:52:31.504 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:31 smithi167 ceph-mon[35359]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T08:52:31.504 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:31 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:52:31.504 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:31 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3098291341' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:52:31.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:31 smithi092 ceph-mon[31407]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T08:52:31.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:31 smithi092 ceph-mon[31407]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:52:31.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:31 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3578495043' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9b774bbe-6700-4020-900b-3fdbaa546773"}]: dispatch 2024-09-19T08:52:31.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:31 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3578495043' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9b774bbe-6700-4020-900b-3fdbaa546773"}]': finished 2024-09-19T08:52:31.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:31 smithi092 ceph-mon[31407]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T08:52:31.505 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:31 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:52:31.505 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:31 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3098291341' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:52:31.525 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:31 smithi190 ceph-mon[35358]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T08:52:31.525 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:31 smithi190 ceph-mon[35358]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:52:31.525 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:31 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3578495043' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9b774bbe-6700-4020-900b-3fdbaa546773"}]: dispatch 2024-09-19T08:52:31.525 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:31 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3578495043' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9b774bbe-6700-4020-900b-3fdbaa546773"}]': finished 2024-09-19T08:52:31.525 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:31 smithi190 ceph-mon[35358]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T08:52:31.525 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:31 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:52:31.525 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:31 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3098291341' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:52:32.797 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:32 smithi190 ceph-mon[35358]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T08:52:32.797 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:32 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:52:32.797 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:32 smithi190 ceph-mon[35358]: pgmap v188: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T08:52:32.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:32 smithi167 ceph-mon[35359]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T08:52:32.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:32 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:52:32.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:32 smithi167 ceph-mon[35359]: pgmap v188: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T08:52:33.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:32 smithi092 ceph-mon[31407]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T08:52:33.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:32 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:52:33.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:32 smithi092 ceph-mon[31407]: pgmap v188: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T08:52:35.554 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:35 smithi092 ceph-mon[31407]: pgmap v189: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-09-19T08:52:35.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:35 smithi167 ceph-mon[35359]: pgmap v189: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-09-19T08:52:35.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:35 smithi190 ceph-mon[35358]: pgmap v189: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-09-19T08:52:37.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:37 smithi167 ceph-mon[35359]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-09-19T08:52:37.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:37 smithi190 ceph-mon[35358]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-09-19T08:52:37.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:37 smithi092 ceph-mon[31407]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-09-19T08:52:39.543 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:39 smithi092 ceph-mon[31407]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:52:39.543 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:39 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T08:52:39.543 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:39 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:39.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:39 smithi167 ceph-mon[35359]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:52:39.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:39 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T08:52:39.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:39 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:39.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:39 smithi190 ceph-mon[35358]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:52:39.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:39 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T08:52:39.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:39 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:40.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:40 smithi167 ceph-mon[35359]: Deploying daemon osd.9 on smithi092 2024-09-19T08:52:40.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:40 smithi190 ceph-mon[35358]: Deploying daemon osd.9 on smithi092 2024-09-19T08:52:40.667 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:40 smithi092 ceph-mon[31407]: Deploying daemon osd.9 on smithi092 2024-09-19T08:52:41.580 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:41 smithi092 ceph-mon[31407]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:52:41.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:41 smithi167 ceph-mon[35359]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:52:41.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:41 smithi190 ceph-mon[35358]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:52:43.419 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:43 smithi092 ceph-mon[31407]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:52:43.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:43 smithi167 ceph-mon[35359]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:52:43.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:43 smithi190 ceph-mon[35358]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:52:45.463 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:45 smithi092 ceph-mon[31407]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:52:45.463 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:45 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:52:45.463 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:45 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:45.463 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:45 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:45.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:45 smithi167 ceph-mon[35359]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:52:45.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:45 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:52:45.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:45 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:45.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:45 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:45.625 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:45 smithi190 ceph-mon[35358]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:52:45.625 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:45 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:52:45.625 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:45 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:45.625 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:45 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:47.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:47 smithi167 ceph-mon[35359]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:52:47.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:47 smithi190 ceph-mon[35358]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:52:47.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:47 smithi092 ceph-mon[31407]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:52:47.898 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 9 on host 'smithi092' 2024-09-19T08:52:47.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:47.898+0000 7f62fdffb640 1 -- 172.21.15.92:0/2357531714 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6300062630 con 0x7f62f00a3240 2024-09-19T08:52:47.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:47.900+0000 7f6306d45640 1 -- 172.21.15.92:0/2357531714 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f62f00a3240 msgr2=0x7f62f00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:47.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:47.900+0000 7f6306d45640 1 --2- 172.21.15.92:0/2357531714 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f62f00a3240 0x7f62f00a5700 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6300102c60 tx=0x7f62f4005f90 comp rx=0 tx=0).stop 2024-09-19T08:52:47.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:47.900+0000 7f6306d45640 1 -- 172.21.15.92:0/2357531714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63001037c0 msgr2=0x7f6300074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:47.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:47.900+0000 7f6306d45640 1 --2- 172.21.15.92:0/2357531714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63001037c0 0x7f6300074b20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f62f8009fd0 tx=0x7f62f800b260 comp rx=0 tx=0).stop 2024-09-19T08:52:47.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:47.900+0000 7f6306d45640 1 -- 172.21.15.92:0/2357531714 shutdown_connections 2024-09-19T08:52:47.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:47.900+0000 7f6306d45640 1 --2- 172.21.15.92:0/2357531714 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f62f00a3240 0x7f62f00a5700 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:47.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:47.900+0000 7f6306d45640 1 --2- 172.21.15.92:0/2357531714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63001037c0 0x7f6300074b20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:47.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:47.900+0000 7f6306d45640 1 --2- 172.21.15.92:0/2357531714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6300102e00 0x7f63000745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:47.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:47.900+0000 7f6306d45640 1 --2- 172.21.15.92:0/2357531714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6300101c00 0x7f6300075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:47.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:47.900+0000 7f6306d45640 1 -- 172.21.15.92:0/2357531714 >> 172.21.15.92:0/2357531714 conn(0x7f63000fd390 msgr2=0x7f6300106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:47.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:47.900+0000 7f6306d45640 1 -- 172.21.15.92:0/2357531714 shutdown_connections 2024-09-19T08:52:47.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:52:47.900+0000 7f6306d45640 1 -- 172.21.15.92:0/2357531714 wait complete. 2024-09-19T08:52:48.579 DEBUG:teuthology.orchestra.run.smithi092:osd.9> sudo journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@osd.9.service 2024-09-19T08:52:48.582 INFO:tasks.cephadm:Deploying osd.10 on smithi167 with /dev/vg_nvme/lv_1... 2024-09-19T08:52:48.583 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T08:52:48.840 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:52:49.166 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:48 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:49.166 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:48 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:49.166 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:48 smithi092 ceph-mon[31407]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:52:49.166 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:48 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:49.166 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:48 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:49.223 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:48 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:49.223 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:48 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:49.223 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:48 smithi167 ceph-mon[35359]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:52:49.223 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:48 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:49.223 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:48 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:49.373 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:48 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:49.373 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:48 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:49.373 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:48 smithi190 ceph-mon[35358]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:52:49.373 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:48 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:49.374 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:48 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:51.179 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 08:52:50 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T08:52:50.961+0000 7ff92172e640 -1 osd.9 0 log_to_monitors true 2024-09-19T08:52:51.287 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T08:52:51.317 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi167:vg_nvme/lv_1 2024-09-19T08:52:51.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:51 smithi092 ceph-mon[31407]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:52:51.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:51 smithi092 ceph-mon[31407]: from='osd.9 [v2:172.21.15.92:6826/3066744542,v1:172.21.15.92:6827/3066744542]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T08:52:51.574 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:52:51.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:51 smithi167 ceph-mon[35359]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:52:51.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:51 smithi167 ceph-mon[35359]: from='osd.9 [v2:172.21.15.92:6826/3066744542,v1:172.21.15.92:6827/3066744542]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T08:52:51.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:51 smithi190 ceph-mon[35358]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:52:51.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:51 smithi190 ceph-mon[35358]: from='osd.9 [v2:172.21.15.92:6826/3066744542,v1:172.21.15.92:6827/3066744542]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T08:52:52.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.025+0000 7fe64b6a0640 1 -- 172.21.15.167:0/1168273304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6441078c0 msgr2=0x7fe644109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:52.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.025+0000 7fe64b6a0640 1 --2- 172.21.15.167:0/1168273304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6441078c0 0x7fe644109d10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe63c009ca0 tx=0x7fe63c02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.025+0000 7fe64b6a0640 1 -- 172.21.15.167:0/1168273304 shutdown_connections 2024-09-19T08:52:52.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.025+0000 7fe64b6a0640 1 --2- 172.21.15.167:0/1168273304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6441078c0 0x7fe644109d10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.025+0000 7fe64b6a0640 1 --2- 172.21.15.167:0/1168273304 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe644104f90 0x7fe644107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.025+0000 7fe64b6a0640 1 --2- 172.21.15.167:0/1168273304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe644102660 0x7fe644104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.038 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.025+0000 7fe64b6a0640 1 -- 172.21.15.167:0/1168273304 >> 172.21.15.167:0/1168273304 conn(0x7fe6440fc280 msgr2=0x7fe6440fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:52.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.025+0000 7fe64b6a0640 1 -- 172.21.15.167:0/1168273304 shutdown_connections 2024-09-19T08:52:52.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.025+0000 7fe64b6a0640 1 -- 172.21.15.167:0/1168273304 wait complete. 2024-09-19T08:52:52.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.026+0000 7fe64b6a0640 1 Processor -- start 2024-09-19T08:52:52.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.026+0000 7fe64b6a0640 1 -- start start 2024-09-19T08:52:52.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.026+0000 7fe64b6a0640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe644102660 0x7fe644197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:52.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.026+0000 7fe64b6a0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe644104f90 0x7fe644198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:52.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.026+0000 7fe64b6a0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6441078c0 0x7fe64419f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:52.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.026+0000 7fe64b6a0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe64410d880 con 0x7fe6441078c0 2024-09-19T08:52:52.039 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.026+0000 7fe64b6a0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe64410d700 con 0x7fe644104f90 2024-09-19T08:52:52.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.026+0000 7fe64b6a0640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe64410da00 con 0x7fe644102660 2024-09-19T08:52:52.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.026+0000 7fe648c3b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe644104f90 0x7fe644198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:52.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.026+0000 7fe648c3b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe644104f90 0x7fe644198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33604/0 (socket says 172.21.15.167:33604) 2024-09-19T08:52:52.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.026+0000 7fe648c3b640 1 -- 172.21.15.167:0/4180498189 learned_addr learned my addr 172.21.15.167:0/4180498189 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-19T08:52:52.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.026+0000 7fe64943c640 1 --2- 172.21.15.167:0/4180498189 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe644102660 0x7fe644197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:52.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.027+0000 7fe649c3d640 1 --2- 172.21.15.167:0/4180498189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6441078c0 0x7fe64419f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:52.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.027+0000 7fe648c3b640 1 -- 172.21.15.167:0/4180498189 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe644102660 msgr2=0x7fe644197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:52.040 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.027+0000 7fe648c3b640 1 --2- 172.21.15.167:0/4180498189 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe644102660 0x7fe644197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.027+0000 7fe648c3b640 1 -- 172.21.15.167:0/4180498189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6441078c0 msgr2=0x7fe64419f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:52.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.027+0000 7fe648c3b640 1 --2- 172.21.15.167:0/4180498189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6441078c0 0x7fe64419f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.027+0000 7fe648c3b640 1 -- 172.21.15.167:0/4180498189 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe64419fb00 con 0x7fe644104f90 2024-09-19T08:52:52.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.027+0000 7fe648c3b640 1 --2- 172.21.15.167:0/4180498189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe644104f90 0x7fe644198410 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe64000c970 tx=0x7fe64000ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:52.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.027+0000 7fe63a7fc640 1 -- 172.21.15.167:0/4180498189 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe640007bb0 con 0x7fe644104f90 2024-09-19T08:52:52.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.027+0000 7fe64b6a0640 1 -- 172.21.15.167:0/4180498189 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe64419fdf0 con 0x7fe644104f90 2024-09-19T08:52:52.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.027+0000 7fe63a7fc640 1 -- 172.21.15.167:0/4180498189 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe640007d50 con 0x7fe644104f90 2024-09-19T08:52:52.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.027+0000 7fe63a7fc640 1 -- 172.21.15.167:0/4180498189 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6400187a0 con 0x7fe644104f90 2024-09-19T08:52:52.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.027+0000 7fe64b6a0640 1 -- 172.21.15.167:0/4180498189 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6441a0250 con 0x7fe644104f90 2024-09-19T08:52:52.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.028+0000 7fe64b6a0640 1 -- 172.21.15.167:0/4180498189 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6440fdd70 con 0x7fe644104f90 2024-09-19T08:52:52.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.029+0000 7fe63a7fc640 1 -- 172.21.15.167:0/4180498189 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe64000f450 con 0x7fe644104f90 2024-09-19T08:52:52.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.030+0000 7fe63a7fc640 1 --2- 172.21.15.167:0/4180498189 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe6300a3270 0x7fe6300a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:52.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.030+0000 7fe63a7fc640 1 -- 172.21.15.167:0/4180498189 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5965+0+0 (secure 0 0 0) 0x7fe6400cf470 con 0x7fe644104f90 2024-09-19T08:52:52.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.030+0000 7fe64943c640 1 --2- 172.21.15.167:0/4180498189 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe6300a3270 0x7fe6300a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:52.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.031+0000 7fe64943c640 1 --2- 172.21.15.167:0/4180498189 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe6300a3270 0x7fe6300a5730 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe634005fd0 tx=0x7fe634005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:52.043 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.033+0000 7fe63a7fc640 1 -- 172.21.15.167:0/4180498189 <== mon.2 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe640014030 con 0x7fe644104f90 2024-09-19T08:52:52.215 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:52:52.215+0000 7fe64b6a0640 1 -- 172.21.15.167:0/4180498189 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fe644062630 con 0x7fe6300a3270 2024-09-19T08:52:52.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:52 smithi167 ceph-mon[35359]: from='osd.9 [v2:172.21.15.92:6826/3066744542,v1:172.21.15.92:6827/3066744542]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T08:52:52.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:52 smithi167 ceph-mon[35359]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T08:52:52.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:52 smithi167 ceph-mon[35359]: from='osd.9 [v2:172.21.15.92:6826/3066744542,v1:172.21.15.92:6827/3066744542]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-19T08:52:52.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:52 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:52:52.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:52 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:52.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:52 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:52.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:52 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:52.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:52 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:52.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:52 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:52.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:52 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:52.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:52 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:52.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:52 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:52.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:52 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:52:52.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:52 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:52.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:52 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:52:52.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:52 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:52.603 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:52 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:52:52.603 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:52 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:52.603 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:52 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:52:52.603 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:52 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:52:52.603 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:52 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:52.603 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:52 smithi167 ceph-mon[35359]: from='osd.9 [v2:172.21.15.92:6826/3066744542,v1:172.21.15.92:6827/3066744542]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-19T08:52:52.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:52 smithi190 ceph-mon[35358]: from='osd.9 [v2:172.21.15.92:6826/3066744542,v1:172.21.15.92:6827/3066744542]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T08:52:52.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:52 smithi190 ceph-mon[35358]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T08:52:52.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:52 smithi190 ceph-mon[35358]: from='osd.9 [v2:172.21.15.92:6826/3066744542,v1:172.21.15.92:6827/3066744542]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-19T08:52:52.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:52 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:52:52.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:52 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:52.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:52 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:52.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:52 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:52.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:52 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:52.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:52 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:52.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:52 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:52.625 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:52 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:52.625 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:52 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:52.625 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:52 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:52:52.625 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:52 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:52.625 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:52 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:52:52.625 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:52 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:52.625 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:52 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:52:52.625 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:52 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:52.626 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:52 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:52:52.626 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:52 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:52:52.626 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:52 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:52.626 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:52 smithi190 ceph-mon[35358]: from='osd.9 [v2:172.21.15.92:6826/3066744542,v1:172.21.15.92:6827/3066744542]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-19T08:52:52.753 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 08:52:52 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T08:52:52.298+0000 7ff91dec5640 -1 osd.9 0 waiting for initial osdmap 2024-09-19T08:52:52.753 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 08:52:52 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T08:52:52.314+0000 7ff9194c8640 -1 osd.9 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:52:52.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:52 smithi092 ceph-mon[31407]: from='osd.9 [v2:172.21.15.92:6826/3066744542,v1:172.21.15.92:6827/3066744542]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T08:52:52.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:52 smithi092 ceph-mon[31407]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T08:52:52.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:52 smithi092 ceph-mon[31407]: from='osd.9 [v2:172.21.15.92:6826/3066744542,v1:172.21.15.92:6827/3066744542]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-19T08:52:52.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:52:52.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:52.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:52.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:52.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:52.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:52.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:52:52.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:52.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:52.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:52:52.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:52.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:52:52.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:52.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:52:52.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:52:52.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:52:52.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:52:52.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:52.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:52 smithi092 ceph-mon[31407]: from='osd.9 [v2:172.21.15.92:6826/3066744542,v1:172.21.15.92:6827/3066744542]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-19T08:52:53.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:53 smithi167 ceph-mon[35359]: Detected new or changed devices on smithi092 2024-09-19T08:52:53.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:53 smithi167 ceph-mon[35359]: Adjusting osd_memory_target on smithi092 to 4272M 2024-09-19T08:52:53.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:53 smithi167 ceph-mon[35359]: from='client.24326 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:52:53.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:53 smithi167 ceph-mon[35359]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:52:53.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:53 smithi167 ceph-mon[35359]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T08:52:53.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:53 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:52:53.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:53 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:52:53.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:53 smithi190 ceph-mon[35358]: Detected new or changed devices on smithi092 2024-09-19T08:52:53.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:53 smithi190 ceph-mon[35358]: Adjusting osd_memory_target on smithi092 to 4272M 2024-09-19T08:52:53.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:53 smithi190 ceph-mon[35358]: from='client.24326 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:52:53.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:53 smithi190 ceph-mon[35358]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:52:53.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:53 smithi190 ceph-mon[35358]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T08:52:53.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:53 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:52:53.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:53 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:52:53.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:53 smithi092 ceph-mon[31407]: Detected new or changed devices on smithi092 2024-09-19T08:52:53.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:53 smithi092 ceph-mon[31407]: Adjusting osd_memory_target on smithi092 to 4272M 2024-09-19T08:52:53.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:53 smithi092 ceph-mon[31407]: from='client.24326 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:52:53.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:53 smithi092 ceph-mon[31407]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:52:53.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:53 smithi092 ceph-mon[31407]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T08:52:53.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:53 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:52:53.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:53 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:52:54.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:54 smithi167 ceph-mon[35359]: purged_snaps scrub starts 2024-09-19T08:52:54.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:54 smithi167 ceph-mon[35359]: purged_snaps scrub ok 2024-09-19T08:52:54.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:54 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:52:54.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:54 smithi167 ceph-mon[35359]: osd.9 [v2:172.21.15.92:6826/3066744542,v1:172.21.15.92:6827/3066744542] boot 2024-09-19T08:52:54.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:54 smithi167 ceph-mon[35359]: osdmap e61: 10 total, 10 up, 10 in 2024-09-19T08:52:54.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:54 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:52:54.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:54 smithi190 ceph-mon[35358]: purged_snaps scrub starts 2024-09-19T08:52:54.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:54 smithi190 ceph-mon[35358]: purged_snaps scrub ok 2024-09-19T08:52:54.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:54 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:52:54.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:54 smithi190 ceph-mon[35358]: osd.9 [v2:172.21.15.92:6826/3066744542,v1:172.21.15.92:6827/3066744542] boot 2024-09-19T08:52:54.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:54 smithi190 ceph-mon[35358]: osdmap e61: 10 total, 10 up, 10 in 2024-09-19T08:52:54.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:54 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:52:54.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:54 smithi092 ceph-mon[31407]: purged_snaps scrub starts 2024-09-19T08:52:54.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:54 smithi092 ceph-mon[31407]: purged_snaps scrub ok 2024-09-19T08:52:54.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:54 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:52:54.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:54 smithi092 ceph-mon[31407]: osd.9 [v2:172.21.15.92:6826/3066744542,v1:172.21.15.92:6827/3066744542] boot 2024-09-19T08:52:54.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:54 smithi092 ceph-mon[31407]: osdmap e61: 10 total, 10 up, 10 in 2024-09-19T08:52:54.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:54 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:52:55.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:55 smithi167 ceph-mon[35359]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:52:55.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:55 smithi167 ceph-mon[35359]: osdmap e62: 10 total, 10 up, 10 in 2024-09-19T08:52:55.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:55 smithi167 ceph-mon[35359]: from='client.? 172.21.15.167:0/3548311182' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8abdb835-db2c-4597-ae1d-8ef56e63ab6a"}]: dispatch 2024-09-19T08:52:55.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:55 smithi167 ceph-mon[35359]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8abdb835-db2c-4597-ae1d-8ef56e63ab6a"}]: dispatch 2024-09-19T08:52:55.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:55 smithi167 ceph-mon[35359]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8abdb835-db2c-4597-ae1d-8ef56e63ab6a"}]': finished 2024-09-19T08:52:55.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:55 smithi167 ceph-mon[35359]: osdmap e63: 11 total, 10 up, 11 in 2024-09-19T08:52:55.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:55 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:52:55.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:55 smithi167 ceph-mon[35359]: from='client.? 172.21.15.167:0/1502459277' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:52:55.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:55 smithi190 ceph-mon[35358]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:52:55.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:55 smithi190 ceph-mon[35358]: osdmap e62: 10 total, 10 up, 10 in 2024-09-19T08:52:55.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:55 smithi190 ceph-mon[35358]: from='client.? 172.21.15.167:0/3548311182' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8abdb835-db2c-4597-ae1d-8ef56e63ab6a"}]: dispatch 2024-09-19T08:52:55.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:55 smithi190 ceph-mon[35358]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8abdb835-db2c-4597-ae1d-8ef56e63ab6a"}]: dispatch 2024-09-19T08:52:55.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:55 smithi190 ceph-mon[35358]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8abdb835-db2c-4597-ae1d-8ef56e63ab6a"}]': finished 2024-09-19T08:52:55.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:55 smithi190 ceph-mon[35358]: osdmap e63: 11 total, 10 up, 11 in 2024-09-19T08:52:55.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:55 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:52:55.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:55 smithi190 ceph-mon[35358]: from='client.? 172.21.15.167:0/1502459277' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:52:55.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:55 smithi092 ceph-mon[31407]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:52:55.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:55 smithi092 ceph-mon[31407]: osdmap e62: 10 total, 10 up, 10 in 2024-09-19T08:52:55.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:55 smithi092 ceph-mon[31407]: from='client.? 172.21.15.167:0/3548311182' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8abdb835-db2c-4597-ae1d-8ef56e63ab6a"}]: dispatch 2024-09-19T08:52:55.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:55 smithi092 ceph-mon[31407]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8abdb835-db2c-4597-ae1d-8ef56e63ab6a"}]: dispatch 2024-09-19T08:52:55.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:55 smithi092 ceph-mon[31407]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8abdb835-db2c-4597-ae1d-8ef56e63ab6a"}]': finished 2024-09-19T08:52:55.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:55 smithi092 ceph-mon[31407]: osdmap e63: 11 total, 10 up, 11 in 2024-09-19T08:52:55.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:55 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:52:55.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:55 smithi092 ceph-mon[31407]: from='client.? 172.21.15.167:0/1502459277' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:52:57.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:57 smithi167 ceph-mon[35359]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:52:57.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:57 smithi190 ceph-mon[35358]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:52:57.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:57 smithi092 ceph-mon[31407]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:52:59.571 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:52:59 smithi092 ceph-mon[31407]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:52:59.579 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:52:59 smithi167 ceph-mon[35359]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:52:59.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:52:59 smithi190 ceph-mon[35358]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:53:01.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:01 smithi167 ceph-mon[35359]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:53:01.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:01 smithi190 ceph-mon[35358]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:53:01.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:01 smithi092 ceph-mon[31407]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:53:03.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:03 smithi167 ceph-mon[35359]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:53:03.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:03 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T08:53:03.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:03 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:03.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:03 smithi190 ceph-mon[35358]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:53:03.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:03 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T08:53:03.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:03 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:03.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:03 smithi092 ceph-mon[31407]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:53:03.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:03 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T08:53:03.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:03 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:04.450 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:04 smithi167 ceph-mon[35359]: Deploying daemon osd.10 on smithi167 2024-09-19T08:53:04.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:04 smithi190 ceph-mon[35358]: Deploying daemon osd.10 on smithi167 2024-09-19T08:53:04.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:04 smithi092 ceph-mon[31407]: Deploying daemon osd.10 on smithi167 2024-09-19T08:53:05.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:05 smithi167 ceph-mon[35359]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:53:05.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:05 smithi190 ceph-mon[35358]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:53:05.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:05 smithi092 ceph-mon[31407]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:53:07.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:07 smithi167 ceph-mon[35359]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:53:07.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:07 smithi190 ceph-mon[35358]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:53:07.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:07 smithi092 ceph-mon[31407]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:53:09.556 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:09 smithi167 ceph-mon[35359]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:53:09.556 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:09 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:53:09.557 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:09 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:09.557 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:09 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:09.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:09 smithi190 ceph-mon[35358]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:53:09.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:09 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:53:09.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:09 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:09.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:09 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:09.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:09 smithi092 ceph-mon[31407]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:53:09.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:09 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:53:09.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:09 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:09.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:09 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:11.551 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:11 smithi167 ceph-mon[35359]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:53:11.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:11 smithi190 ceph-mon[35358]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:53:11.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:11 smithi092 ceph-mon[31407]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:53:12.496 INFO:teuthology.orchestra.run.smithi167.stdout:Created osd(s) 10 on host 'smithi167' 2024-09-19T08:53:12.496 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:53:12.496+0000 7fe63a7fc640 1 -- 172.21.15.167:0/4180498189 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fe644062630 con 0x7fe6300a3270 2024-09-19T08:53:12.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:53:12.498+0000 7fe64b6a0640 1 -- 172.21.15.167:0/4180498189 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe6300a3270 msgr2=0x7fe6300a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:12.498 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:53:12.498+0000 7fe64b6a0640 1 --2- 172.21.15.167:0/4180498189 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe6300a3270 0x7fe6300a5730 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe634005fd0 tx=0x7fe634005850 comp rx=0 tx=0).stop 2024-09-19T08:53:12.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:53:12.499+0000 7fe64b6a0640 1 -- 172.21.15.167:0/4180498189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe644104f90 msgr2=0x7fe644198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:12.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:53:12.499+0000 7fe64b6a0640 1 --2- 172.21.15.167:0/4180498189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe644104f90 0x7fe644198410 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe64000c970 tx=0x7fe64000ce30 comp rx=0 tx=0).stop 2024-09-19T08:53:12.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:53:12.499+0000 7fe64b6a0640 1 -- 172.21.15.167:0/4180498189 shutdown_connections 2024-09-19T08:53:12.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:53:12.499+0000 7fe64b6a0640 1 --2- 172.21.15.167:0/4180498189 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe6300a3270 0x7fe6300a5730 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:12.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:53:12.499+0000 7fe64b6a0640 1 --2- 172.21.15.167:0/4180498189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6441078c0 0x7fe64419f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:12.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:53:12.499+0000 7fe64b6a0640 1 --2- 172.21.15.167:0/4180498189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe644104f90 0x7fe644198410 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:12.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:53:12.499+0000 7fe64b6a0640 1 --2- 172.21.15.167:0/4180498189 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe644102660 0x7fe644197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:12.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:53:12.499+0000 7fe64b6a0640 1 -- 172.21.15.167:0/4180498189 >> 172.21.15.167:0/4180498189 conn(0x7fe6440fc280 msgr2=0x7fe644102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:12.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:53:12.499+0000 7fe64b6a0640 1 -- 172.21.15.167:0/4180498189 shutdown_connections 2024-09-19T08:53:12.499 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T08:53:12.499+0000 7fe64b6a0640 1 -- 172.21.15.167:0/4180498189 wait complete. 2024-09-19T08:53:12.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:12 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:12.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:12 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:12.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:12 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:12.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:12 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:53:12.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:12 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:12.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:12 smithi167 ceph-mon[35359]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:53:12.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:12 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:53:12.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:12 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:12.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:12 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:13.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:12 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:13.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:12 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:13.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:12 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:13.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:12 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:53:13.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:12 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:13.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:12 smithi092 ceph-mon[31407]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:53:13.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:12 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:53:13.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:12 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:13.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:12 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:13.123 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:12 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:13.123 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:12 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:13.123 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:12 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:13.123 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:12 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:53:13.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:12 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:13.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:12 smithi190 ceph-mon[35358]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:53:13.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:12 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:53:13.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:12 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:13.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:12 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:13.182 DEBUG:teuthology.orchestra.run.smithi167:osd.10> sudo journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@osd.10.service 2024-09-19T08:53:13.184 INFO:tasks.cephadm:Deploying osd.11 on smithi190 with /dev/vg_nvme/lv_1... 2024-09-19T08:53:13.185 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T08:53:13.439 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:53:15.268 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 08:53:14 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T08:53:14.875+0000 7f457868a640 -1 osd.10 0 log_to_monitors true 2024-09-19T08:53:15.324 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:15 smithi190 ceph-mon[35358]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:53:15.324 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:15 smithi190 ceph-mon[35358]: from='osd.10 [v2:172.21.15.167:6824/2309134313,v1:172.21.15.167:6825/2309134313]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T08:53:15.324 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:15 smithi190 ceph-mon[35358]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T08:53:15.590 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:15 smithi167 ceph-mon[35359]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:53:15.590 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:15 smithi167 ceph-mon[35359]: from='osd.10 [v2:172.21.15.167:6824/2309134313,v1:172.21.15.167:6825/2309134313]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T08:53:15.590 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:15 smithi167 ceph-mon[35359]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T08:53:15.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:15 smithi092 ceph-mon[31407]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:53:15.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:15 smithi092 ceph-mon[31407]: from='osd.10 [v2:172.21.15.167:6824/2309134313,v1:172.21.15.167:6825/2309134313]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T08:53:15.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:15 smithi092 ceph-mon[31407]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T08:53:15.915 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-19T08:53:15.942 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi190:vg_nvme/lv_1 2024-09-19T08:53:16.196 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:53:16.558 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:16 smithi190 ceph-mon[35358]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T08:53:16.558 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:16 smithi190 ceph-mon[35358]: from='osd.10 [v2:172.21.15.167:6824/2309134313,v1:172.21.15.167:6825/2309134313]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T08:53:16.558 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:16 smithi190 ceph-mon[35358]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T08:53:16.558 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:16 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:53:16.559 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:16 smithi190 ceph-mon[35358]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T08:53:16.559 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:16 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:16.559 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:16 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:16.559 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:16 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:53:16.559 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:16 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:53:16.559 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:16 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:53:16.559 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:16 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:53:16.559 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:16 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:16.559 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:16 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:16.559 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:16 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:53:16.559 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:16 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:16.559 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:16 smithi190 ceph-mon[35358]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-19T08:53:16.601 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 08:53:16 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T08:53:16.302+0000 7f4573dea640 -1 osd.10 0 waiting for initial osdmap 2024-09-19T08:53:16.601 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 08:53:16 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T08:53:16.316+0000 7f4570424640 -1 osd.10 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:53:16.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:16 smithi167 ceph-mon[35359]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T08:53:16.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:16 smithi167 ceph-mon[35359]: from='osd.10 [v2:172.21.15.167:6824/2309134313,v1:172.21.15.167:6825/2309134313]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T08:53:16.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:16 smithi167 ceph-mon[35359]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T08:53:16.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:16 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:53:16.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:16 smithi167 ceph-mon[35359]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T08:53:16.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:16 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:16.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:16 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:16.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:16 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:53:16.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:16 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:53:16.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:16 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:53:16.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:16 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:53:16.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:16 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:16.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:16 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:16.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:16 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:53:16.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:16 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:16.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:16 smithi167 ceph-mon[35359]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-19T08:53:16.666 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.641+0000 7faa9b02a640 1 -- 172.21.15.190:0/4156243795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa940761a0 msgr2=0x7faa94074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:16.667 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.641+0000 7faa9b02a640 1 --2- 172.21.15.190:0/4156243795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa940761a0 0x7faa94074600 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7faa88009900 tx=0x7faa8802a410 comp rx=0 tx=0).stop 2024-09-19T08:53:16.667 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.641+0000 7faa9b02a640 1 -- 172.21.15.190:0/4156243795 shutdown_connections 2024-09-19T08:53:16.667 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.641+0000 7faa9b02a640 1 --2- 172.21.15.190:0/4156243795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa94109a70 0x7faa9410bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:16.667 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.641+0000 7faa9b02a640 1 --2- 172.21.15.190:0/4156243795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa94074b40 0x7faa94074fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:16.667 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.641+0000 7faa9b02a640 1 --2- 172.21.15.190:0/4156243795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa940761a0 0x7faa94074600 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:16.667 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.641+0000 7faa9b02a640 1 -- 172.21.15.190:0/4156243795 >> 172.21.15.190:0/4156243795 conn(0x7faa940fd390 msgr2=0x7faa940ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:16.667 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.641+0000 7faa9b02a640 1 -- 172.21.15.190:0/4156243795 shutdown_connections 2024-09-19T08:53:16.667 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.641+0000 7faa9b02a640 1 -- 172.21.15.190:0/4156243795 wait complete. 2024-09-19T08:53:16.667 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.642+0000 7faa9b02a640 1 Processor -- start 2024-09-19T08:53:16.667 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.642+0000 7faa9b02a640 1 -- start start 2024-09-19T08:53:16.667 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.642+0000 7faa9b02a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa94074b40 0x7faa9419a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:16.668 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.642+0000 7faa9b02a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa940761a0 0x7faa9419a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:16.668 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.642+0000 7faa9b02a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa94109a70 0x7faa941a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:16.668 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.642+0000 7faa9b02a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7faa9410fb50 con 0x7faa940761a0 2024-09-19T08:53:16.668 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.642+0000 7faa9b02a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7faa9410f9d0 con 0x7faa94074b40 2024-09-19T08:53:16.668 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.642+0000 7faa9b02a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7faa9410fcd0 con 0x7faa94109a70 2024-09-19T08:53:16.668 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.642+0000 7faa995c7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa94109a70 0x7faa941a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:16.668 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.642+0000 7faa995c7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa94109a70 0x7faa941a17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:41488/0 (socket says 172.21.15.190:41488) 2024-09-19T08:53:16.668 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.642+0000 7faa995c7640 1 -- 172.21.15.190:0/1712059982 learned_addr learned my addr 172.21.15.190:0/1712059982 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-09-19T08:53:16.668 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.642+0000 7faa98dc6640 1 --2- 172.21.15.190:0/1712059982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa94074b40 0x7faa9419a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:16.668 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.642+0000 7faa93fff640 1 --2- 172.21.15.190:0/1712059982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa940761a0 0x7faa9419a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:16.668 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.642+0000 7faa995c7640 1 -- 172.21.15.190:0/1712059982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa94074b40 msgr2=0x7faa9419a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:16.668 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.642+0000 7faa995c7640 1 --2- 172.21.15.190:0/1712059982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa94074b40 0x7faa9419a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:16.668 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.642+0000 7faa995c7640 1 -- 172.21.15.190:0/1712059982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa940761a0 msgr2=0x7faa9419a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:16.669 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.642+0000 7faa995c7640 1 --2- 172.21.15.190:0/1712059982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa940761a0 0x7faa9419a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:16.669 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.642+0000 7faa995c7640 1 -- 172.21.15.190:0/1712059982 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa941a1e40 con 0x7faa94109a70 2024-09-19T08:53:16.669 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.642+0000 7faa98dc6640 1 --2- 172.21.15.190:0/1712059982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa94074b40 0x7faa9419a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:53:16.669 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.642+0000 7faa93fff640 1 --2- 172.21.15.190:0/1712059982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa940761a0 0x7faa9419a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:53:16.669 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.643+0000 7faa995c7640 1 --2- 172.21.15.190:0/1712059982 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa94109a70 0x7faa941a17d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7faa8c00b970 tx=0x7faa8c00be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:16.669 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.643+0000 7faa91ffb640 1 -- 172.21.15.190:0/1712059982 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c019070 con 0x7faa94109a70 2024-09-19T08:53:16.669 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.643+0000 7faa91ffb640 1 -- 172.21.15.190:0/1712059982 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa8c00cb40 con 0x7faa94109a70 2024-09-19T08:53:16.669 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.643+0000 7faa9b02a640 1 -- 172.21.15.190:0/1712059982 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa941a2130 con 0x7faa94109a70 2024-09-19T08:53:16.669 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.643+0000 7faa91ffb640 1 -- 172.21.15.190:0/1712059982 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c007650 con 0x7faa94109a70 2024-09-19T08:53:16.669 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.643+0000 7faa9b02a640 1 -- 172.21.15.190:0/1712059982 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa941a26f0 con 0x7faa94109a70 2024-09-19T08:53:16.669 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.644+0000 7faa9b02a640 1 -- 172.21.15.190:0/1712059982 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa94108880 con 0x7faa94109a70 2024-09-19T08:53:16.669 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.645+0000 7faa91ffb640 1 -- 172.21.15.190:0/1712059982 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7faa8c01c070 con 0x7faa94109a70 2024-09-19T08:53:16.670 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.646+0000 7faa91ffb640 1 --2- 172.21.15.190:0/1712059982 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7faa840a32f0 0x7faa840a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:16.670 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.646+0000 7faa91ffb640 1 -- 172.21.15.190:0/1712059982 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6414+0+0 (secure 0 0 0) 0x7faa8c0ce7a0 con 0x7faa94109a70 2024-09-19T08:53:16.670 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.646+0000 7faa98dc6640 1 --2- 172.21.15.190:0/1712059982 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7faa840a32f0 0x7faa840a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:16.670 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.646+0000 7faa98dc6640 1 --2- 172.21.15.190:0/1712059982 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7faa840a32f0 0x7faa840a57b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faa88000c00 tx=0x7faa880315d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:16.670 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.650+0000 7faa91ffb640 1 -- 172.21.15.190:0/1712059982 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faa8c09bc30 con 0x7faa94109a70 2024-09-19T08:53:16.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:16 smithi092 ceph-mon[31407]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T08:53:16.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:16 smithi092 ceph-mon[31407]: from='osd.10 [v2:172.21.15.167:6824/2309134313,v1:172.21.15.167:6825/2309134313]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T08:53:16.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:16 smithi092 ceph-mon[31407]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T08:53:16.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:16 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:53:16.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:16 smithi092 ceph-mon[31407]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T08:53:16.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:16 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:16.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:16 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:16.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:16 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:53:16.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:16 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:53:16.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:16 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:53:16.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:16 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:53:16.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:16 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:16.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:16 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:16.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:16 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:53:16.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:16 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:16.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:16 smithi092 ceph-mon[31407]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-19T08:53:16.824 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:16.825+0000 7faa9b02a640 1 -- 172.21.15.190:0/1712059982 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7faa94062630 con 0x7faa840a32f0 2024-09-19T08:53:17.503 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:17 smithi190 ceph-mon[35358]: Detected new or changed devices on smithi167 2024-09-19T08:53:17.503 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:17 smithi190 ceph-mon[35358]: Adjusting osd_memory_target on smithi167 to 4272M 2024-09-19T08:53:17.503 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:17 smithi190 ceph-mon[35358]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:53:17.503 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:17 smithi190 ceph-mon[35358]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T08:53:17.503 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:17 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:53:17.503 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:17 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:53:17.503 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:17 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:53:17.503 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:17 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:53:17.503 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:17 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:17.503 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:17 smithi190 ceph-mon[35358]: osd.10 [v2:172.21.15.167:6824/2309134313,v1:172.21.15.167:6825/2309134313] boot 2024-09-19T08:53:17.504 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:17 smithi190 ceph-mon[35358]: osdmap e66: 11 total, 11 up, 11 in 2024-09-19T08:53:17.504 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:17 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:53:17.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:17 smithi167 ceph-mon[35359]: Detected new or changed devices on smithi167 2024-09-19T08:53:17.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:17 smithi167 ceph-mon[35359]: Adjusting osd_memory_target on smithi167 to 4272M 2024-09-19T08:53:17.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:17 smithi167 ceph-mon[35359]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:53:17.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:17 smithi167 ceph-mon[35359]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T08:53:17.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:17 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:53:17.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:17 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:53:17.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:17 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:53:17.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:17 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:53:17.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:17 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:17.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:17 smithi167 ceph-mon[35359]: osd.10 [v2:172.21.15.167:6824/2309134313,v1:172.21.15.167:6825/2309134313] boot 2024-09-19T08:53:17.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:17 smithi167 ceph-mon[35359]: osdmap e66: 11 total, 11 up, 11 in 2024-09-19T08:53:17.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:17 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:53:17.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:17 smithi092 ceph-mon[31407]: Detected new or changed devices on smithi167 2024-09-19T08:53:17.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:17 smithi092 ceph-mon[31407]: Adjusting osd_memory_target on smithi167 to 4272M 2024-09-19T08:53:17.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:17 smithi092 ceph-mon[31407]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:53:17.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:17 smithi092 ceph-mon[31407]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T08:53:17.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:17 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:53:17.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:17 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:53:17.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:17 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:53:17.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:17 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:53:17.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:17 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:17.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:17 smithi092 ceph-mon[31407]: osd.10 [v2:172.21.15.167:6824/2309134313,v1:172.21.15.167:6825/2309134313] boot 2024-09-19T08:53:17.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:17 smithi092 ceph-mon[31407]: osdmap e66: 11 total, 11 up, 11 in 2024-09-19T08:53:17.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:17 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:53:18.534 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:18 smithi190 ceph-mon[35358]: purged_snaps scrub starts 2024-09-19T08:53:18.534 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:18 smithi190 ceph-mon[35358]: purged_snaps scrub ok 2024-09-19T08:53:18.534 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:18 smithi190 ceph-mon[35358]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:53:18.534 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:18 smithi190 ceph-mon[35358]: osdmap e67: 11 total, 11 up, 11 in 2024-09-19T08:53:18.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:18 smithi167 ceph-mon[35359]: purged_snaps scrub starts 2024-09-19T08:53:18.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:18 smithi167 ceph-mon[35359]: purged_snaps scrub ok 2024-09-19T08:53:18.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:18 smithi167 ceph-mon[35359]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:53:18.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:18 smithi167 ceph-mon[35359]: osdmap e67: 11 total, 11 up, 11 in 2024-09-19T08:53:18.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:18 smithi092 ceph-mon[31407]: purged_snaps scrub starts 2024-09-19T08:53:18.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:18 smithi092 ceph-mon[31407]: purged_snaps scrub ok 2024-09-19T08:53:18.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:18 smithi092 ceph-mon[31407]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:53:18.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:18 smithi092 ceph-mon[31407]: osdmap e67: 11 total, 11 up, 11 in 2024-09-19T08:53:19.571 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:19 smithi190 ceph-mon[35358]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:53:19.571 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:19 smithi190 ceph-mon[35358]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T08:53:19.571 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:19 smithi190 ceph-mon[35358]: from='client.? 172.21.15.190:0/3115131725' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "564c844a-378f-40cd-9717-cde35a65631c"}]: dispatch 2024-09-19T08:53:19.571 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:19 smithi190 ceph-mon[35358]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "564c844a-378f-40cd-9717-cde35a65631c"}]: dispatch 2024-09-19T08:53:19.571 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:19 smithi190 ceph-mon[35358]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "564c844a-378f-40cd-9717-cde35a65631c"}]': finished 2024-09-19T08:53:19.571 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:19 smithi190 ceph-mon[35358]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T08:53:19.571 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:19 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:53:19.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:19 smithi167 ceph-mon[35359]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:53:19.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:19 smithi167 ceph-mon[35359]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T08:53:19.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:19 smithi167 ceph-mon[35359]: from='client.? 172.21.15.190:0/3115131725' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "564c844a-378f-40cd-9717-cde35a65631c"}]: dispatch 2024-09-19T08:53:19.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:19 smithi167 ceph-mon[35359]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "564c844a-378f-40cd-9717-cde35a65631c"}]: dispatch 2024-09-19T08:53:19.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:19 smithi167 ceph-mon[35359]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "564c844a-378f-40cd-9717-cde35a65631c"}]': finished 2024-09-19T08:53:19.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:19 smithi167 ceph-mon[35359]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T08:53:19.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:19 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:53:19.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:19 smithi092 ceph-mon[31407]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:53:19.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:19 smithi092 ceph-mon[31407]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T08:53:19.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:19 smithi092 ceph-mon[31407]: from='client.? 172.21.15.190:0/3115131725' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "564c844a-378f-40cd-9717-cde35a65631c"}]: dispatch 2024-09-19T08:53:19.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:19 smithi092 ceph-mon[31407]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "564c844a-378f-40cd-9717-cde35a65631c"}]: dispatch 2024-09-19T08:53:19.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:19 smithi092 ceph-mon[31407]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "564c844a-378f-40cd-9717-cde35a65631c"}]': finished 2024-09-19T08:53:19.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:19 smithi092 ceph-mon[31407]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T08:53:19.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:19 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:53:20.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:20 smithi167 ceph-mon[35359]: from='client.? 172.21.15.190:0/1263837899' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:53:20.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:20 smithi092 ceph-mon[31407]: from='client.? 172.21.15.190:0/1263837899' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:53:20.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:20 smithi190 ceph-mon[35358]: from='client.? 172.21.15.190:0/1263837899' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:53:21.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:21 smithi190 ceph-mon[35358]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:53:21.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:21 smithi190 ceph-mon[35358]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T08:53:21.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:21 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:53:21.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:21 smithi092 ceph-mon[31407]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:53:21.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:21 smithi092 ceph-mon[31407]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T08:53:21.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:21 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:53:21.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:21 smithi167 ceph-mon[35359]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:53:21.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:21 smithi167 ceph-mon[35359]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T08:53:21.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:21 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:53:22.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:22 smithi190 ceph-mon[35358]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T08:53:22.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:22 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:53:22.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:22 smithi092 ceph-mon[31407]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T08:53:22.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:22 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:53:22.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:22 smithi167 ceph-mon[35359]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T08:53:22.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:22 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:53:23.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:23 smithi190 ceph-mon[35358]: pgmap v226: 1 pgs: 1 peering; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T08:53:23.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:23 smithi092 ceph-mon[31407]: pgmap v226: 1 pgs: 1 peering; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T08:53:23.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:23 smithi167 ceph-mon[35359]: pgmap v226: 1 pgs: 1 peering; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T08:53:25.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:25 smithi190 ceph-mon[35358]: pgmap v227: 1 pgs: 1 peering; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-09-19T08:53:25.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:25 smithi092 ceph-mon[31407]: pgmap v227: 1 pgs: 1 peering; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-09-19T08:53:25.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:25 smithi167 ceph-mon[35359]: pgmap v227: 1 pgs: 1 peering; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-09-19T08:53:27.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:27 smithi190 ceph-mon[35358]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-19T08:53:27.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:27 smithi092 ceph-mon[31407]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-19T08:53:27.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:27 smithi167 ceph-mon[35359]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-19T08:53:28.687 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:28 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T08:53:28.687 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:28 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:28.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:28 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T08:53:28.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:28 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:28.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:28 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T08:53:28.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:28 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:29.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:29 smithi190 ceph-mon[35358]: Deploying daemon osd.11 on smithi190 2024-09-19T08:53:29.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:29 smithi190 ceph-mon[35358]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:53:29.654 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:29 smithi092 ceph-mon[31407]: Deploying daemon osd.11 on smithi190 2024-09-19T08:53:29.655 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:29 smithi092 ceph-mon[31407]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:53:29.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:29 smithi167 ceph-mon[35359]: Deploying daemon osd.11 on smithi190 2024-09-19T08:53:29.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:29 smithi167 ceph-mon[35359]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:53:31.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:31 smithi190 ceph-mon[35358]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T08:53:31.651 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:31 smithi167 ceph-mon[35359]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T08:53:31.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:31 smithi092 ceph-mon[31407]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T08:53:33.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:33 smithi190 ceph-mon[35358]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:53:33.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:33 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:53:33.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:33 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:33.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:33 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:33.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:33 smithi092 ceph-mon[31407]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:53:33.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:33 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:53:33.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:33 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:33.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:33 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:33.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:33 smithi167 ceph-mon[35359]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:53:33.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:33 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:53:33.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:33 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:33.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:33 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:35.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:35 smithi190 ceph-mon[35358]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:53:35.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:35 smithi092 ceph-mon[31407]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:53:35.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:35 smithi167 ceph-mon[35359]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:53:35.970 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:35.970+0000 7faa91ffb640 1 -- 172.21.15.190:0/1712059982 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7faa94062630 con 0x7faa840a32f0 2024-09-19T08:53:35.970 INFO:teuthology.orchestra.run.smithi190.stdout:Created osd(s) 11 on host 'smithi190' 2024-09-19T08:53:35.972 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:35.972+0000 7faa9b02a640 1 -- 172.21.15.190:0/1712059982 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7faa840a32f0 msgr2=0x7faa840a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:35.972 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:35.972+0000 7faa9b02a640 1 --2- 172.21.15.190:0/1712059982 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7faa840a32f0 0x7faa840a57b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faa88000c00 tx=0x7faa880315d0 comp rx=0 tx=0).stop 2024-09-19T08:53:35.972 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:35.972+0000 7faa9b02a640 1 -- 172.21.15.190:0/1712059982 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa94109a70 msgr2=0x7faa941a17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:35.972 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:35.972+0000 7faa9b02a640 1 --2- 172.21.15.190:0/1712059982 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa94109a70 0x7faa941a17d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7faa8c00b970 tx=0x7faa8c00be30 comp rx=0 tx=0).stop 2024-09-19T08:53:35.973 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:35.972+0000 7faa9b02a640 1 -- 172.21.15.190:0/1712059982 shutdown_connections 2024-09-19T08:53:35.973 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:35.972+0000 7faa9b02a640 1 --2- 172.21.15.190:0/1712059982 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa94109a70 0x7faa941a17d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:35.973 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:35.972+0000 7faa9b02a640 1 --2- 172.21.15.190:0/1712059982 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7faa840a32f0 0x7faa840a57b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:35.973 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:35.972+0000 7faa9b02a640 1 --2- 172.21.15.190:0/1712059982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa940761a0 0x7faa9419a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:35.973 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:35.972+0000 7faa9b02a640 1 --2- 172.21.15.190:0/1712059982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa94074b40 0x7faa9419a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:35.973 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:35.972+0000 7faa9b02a640 1 -- 172.21.15.190:0/1712059982 >> 172.21.15.190:0/1712059982 conn(0x7faa940fd390 msgr2=0x7faa94105a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:35.973 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:35.973+0000 7faa9b02a640 1 -- 172.21.15.190:0/1712059982 shutdown_connections 2024-09-19T08:53:35.973 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:35.973+0000 7faa9b02a640 1 -- 172.21.15.190:0/1712059982 wait complete. 2024-09-19T08:53:36.631 DEBUG:teuthology.orchestra.run.smithi190:osd.11> sudo journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@osd.11.service 2024-09-19T08:53:36.634 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-19T08:53:36.634 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T08:53:36.889 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:37.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:36 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:37.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:36 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:37.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:36 smithi092 ceph-mon[31407]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:53:37.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:36 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:37.352 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:36 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:37.352 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:36 smithi167 ceph-mon[35359]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:53:37.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.316+0000 7fb6006db640 1 -- 172.21.15.92:0/4244527784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5f8104fd0 msgr2=0x7fb5f81073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:37.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.316+0000 7fb6006db640 1 --2- 172.21.15.92:0/4244527784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5f8104fd0 0x7fb5f81073c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4009900 tx=0x7fb5f402a410 comp rx=0 tx=0).stop 2024-09-19T08:53:37.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.316+0000 7fb6006db640 1 -- 172.21.15.92:0/4244527784 shutdown_connections 2024-09-19T08:53:37.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.316+0000 7fb6006db640 1 --2- 172.21.15.92:0/4244527784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5f8107900 0x7fb5f8109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:37.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.316+0000 7fb6006db640 1 --2- 172.21.15.92:0/4244527784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5f8104fd0 0x7fb5f81073c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:37.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.316+0000 7fb6006db640 1 --2- 172.21.15.92:0/4244527784 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5f81026a0 0x7fb5f8104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:37.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.316+0000 7fb6006db640 1 -- 172.21.15.92:0/4244527784 >> 172.21.15.92:0/4244527784 conn(0x7fb5f80fc2a0 msgr2=0x7fb5f80fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:37.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.316+0000 7fb6006db640 1 -- 172.21.15.92:0/4244527784 shutdown_connections 2024-09-19T08:53:37.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.316+0000 7fb6006db640 1 -- 172.21.15.92:0/4244527784 wait complete. 2024-09-19T08:53:37.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.316+0000 7fb6006db640 1 Processor -- start 2024-09-19T08:53:37.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.316+0000 7fb6006db640 1 -- start start 2024-09-19T08:53:37.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.317+0000 7fb6006db640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5f81026a0 0x7fb5f8102000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:37.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.317+0000 7fb6006db640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5f8104fd0 0x7fb5f8100650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:37.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.317+0000 7fb6006db640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5f8107900 0x7fb5f8100b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:37.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.317+0000 7fb6006db640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f810d910 con 0x7fb5f8107900 2024-09-19T08:53:37.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.317+0000 7fb6006db640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f810d790 con 0x7fb5f8104fd0 2024-09-19T08:53:37.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.317+0000 7fb6006db640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f810da90 con 0x7fb5f81026a0 2024-09-19T08:53:37.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.317+0000 7fb5fec78640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5f8107900 0x7fb5f8100b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:37.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.317+0000 7fb5fec78640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5f8107900 0x7fb5f8100b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34138/0 (socket says 172.21.15.92:34138) 2024-09-19T08:53:37.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.317+0000 7fb5fec78640 1 -- 172.21.15.92:0/3281944363 learned_addr learned my addr 172.21.15.92:0/3281944363 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:53:37.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.317+0000 7fb5fe477640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5f81026a0 0x7fb5f8102000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:37.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.317+0000 7fb5fdc76640 1 --2- 172.21.15.92:0/3281944363 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5f8104fd0 0x7fb5f8100650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:37.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.317+0000 7fb5fec78640 1 -- 172.21.15.92:0/3281944363 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5f81026a0 msgr2=0x7fb5f8102000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:37.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.317+0000 7fb5fec78640 1 --2- 172.21.15.92:0/3281944363 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5f81026a0 0x7fb5f8102000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:37.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.317+0000 7fb5fec78640 1 -- 172.21.15.92:0/3281944363 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5f8104fd0 msgr2=0x7fb5f8100650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:37.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.317+0000 7fb5fec78640 1 --2- 172.21.15.92:0/3281944363 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5f8104fd0 0x7fb5f8100650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:37.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.317+0000 7fb5fec78640 1 -- 172.21.15.92:0/3281944363 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f8101450 con 0x7fb5f8107900 2024-09-19T08:53:37.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.317+0000 7fb5fdc76640 1 --2- 172.21.15.92:0/3281944363 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5f8104fd0 0x7fb5f8100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:53:37.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.317+0000 7fb5fec78640 1 --2- 172.21.15.92:0/3281944363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5f8107900 0x7fb5f8100b90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000b970 tx=0x7fb5f000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:37.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.317+0000 7fb5ef7fe640 1 -- 172.21.15.92:0/3281944363 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0019070 con 0x7fb5f8107900 2024-09-19T08:53:37.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.317+0000 7fb5ef7fe640 1 -- 172.21.15.92:0/3281944363 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5f000cb40 con 0x7fb5f8107900 2024-09-19T08:53:37.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.317+0000 7fb6006db640 1 -- 172.21.15.92:0/3281944363 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5f81a2160 con 0x7fb5f8107900 2024-09-19T08:53:37.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.317+0000 7fb5ef7fe640 1 -- 172.21.15.92:0/3281944363 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0007650 con 0x7fb5f8107900 2024-09-19T08:53:37.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.317+0000 7fb6006db640 1 -- 172.21.15.92:0/3281944363 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5f81a26a0 con 0x7fb5f8107900 2024-09-19T08:53:37.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.318+0000 7fb6006db640 1 -- 172.21.15.92:0/3281944363 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5f80fdd90 con 0x7fb5f8107900 2024-09-19T08:53:37.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.319+0000 7fb5ef7fe640 1 -- 172.21.15.92:0/3281944363 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fb5f001c070 con 0x7fb5f8107900 2024-09-19T08:53:37.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.320+0000 7fb5ef7fe640 1 --2- 172.21.15.92:0/3281944363 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb5e40a3240 0x7fb5e40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:37.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.320+0000 7fb5fe477640 1 --2- 172.21.15.92:0/3281944363 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb5e40a3240 0x7fb5e40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:37.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.320+0000 7fb5ef7fe640 1 -- 172.21.15.92:0/3281944363 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6809+0+0 (secure 0 0 0) 0x7fb5f00ce910 con 0x7fb5f8107900 2024-09-19T08:53:37.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.320+0000 7fb5fe477640 1 --2- 172.21.15.92:0/3281944363 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb5e40a3240 0x7fb5e40a5700 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8005fd0 tx=0x7fb5e800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:37.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.324+0000 7fb5ef7fe640 1 -- 172.21.15.92:0/3281944363 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb5f009b5c0 con 0x7fb5f8107900 2024-09-19T08:53:37.373 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:36 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:37.373 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:36 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:37.373 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:36 smithi190 ceph-mon[35358]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:53:37.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.490+0000 7fb6006db640 1 -- 172.21.15.92:0/3281944363 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fb5f8062df0 con 0x7fb5f8107900 2024-09-19T08:53:37.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.491+0000 7fb5ef7fe640 1 -- 172.21.15.92:0/3281944363 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) ==== 74+0+133 (secure 0 0 0) 0x7fb5f009f8c0 con 0x7fb5f8107900 2024-09-19T08:53:37.492 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:53:37.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.493+0000 7fb6006db640 1 -- 172.21.15.92:0/3281944363 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb5e40a3240 msgr2=0x7fb5e40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:37.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.493+0000 7fb6006db640 1 --2- 172.21.15.92:0/3281944363 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb5e40a3240 0x7fb5e40a5700 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8005fd0 tx=0x7fb5e800b390 comp rx=0 tx=0).stop 2024-09-19T08:53:37.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.493+0000 7fb6006db640 1 -- 172.21.15.92:0/3281944363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5f8107900 msgr2=0x7fb5f8100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:37.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.493+0000 7fb6006db640 1 --2- 172.21.15.92:0/3281944363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5f8107900 0x7fb5f8100b90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000b970 tx=0x7fb5f000be30 comp rx=0 tx=0).stop 2024-09-19T08:53:37.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.493+0000 7fb6006db640 1 -- 172.21.15.92:0/3281944363 shutdown_connections 2024-09-19T08:53:37.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.493+0000 7fb6006db640 1 --2- 172.21.15.92:0/3281944363 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb5e40a3240 0x7fb5e40a5700 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:37.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.493+0000 7fb6006db640 1 --2- 172.21.15.92:0/3281944363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5f8107900 0x7fb5f8100b90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:37.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.493+0000 7fb6006db640 1 --2- 172.21.15.92:0/3281944363 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5f8104fd0 0x7fb5f8100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:37.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.493+0000 7fb6006db640 1 --2- 172.21.15.92:0/3281944363 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5f81026a0 0x7fb5f8102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:37.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.493+0000 7fb6006db640 1 -- 172.21.15.92:0/3281944363 >> 172.21.15.92:0/3281944363 conn(0x7fb5f80fc2a0 msgr2=0x7fb5f8103000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:37.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.493+0000 7fb6006db640 1 -- 172.21.15.92:0/3281944363 shutdown_connections 2024-09-19T08:53:37.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:37.494+0000 7fb6006db640 1 -- 172.21.15.92:0/3281944363 wait complete. 2024-09-19T08:53:38.093 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":71,"num_osds":12,"num_up_osds":11,"osd_up_since":1726735997,"num_in_osds":12,"osd_in_since":1726735999,"num_remapped_pgs":0} 2024-09-19T08:53:38.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:38 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:38.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:38 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:38.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:38 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3281944363' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:53:38.593 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:38 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:38.593 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:38 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:38.593 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:38 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3281944363' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:53:38.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:38 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:38.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:38 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:38.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:38 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3281944363' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:53:39.095 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T08:53:39.352 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:39.474 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:39 smithi092 ceph-mon[31407]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:53:39.566 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:39 smithi190 ceph-mon[35358]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:53:39.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:39 smithi167 ceph-mon[35359]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:53:39.874 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 08:53:39 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T08:53:39.633+0000 7f3b547d5640 -1 osd.11 0 log_to_monitors true 2024-09-19T08:53:39.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.897+0000 7f4f3ff84640 1 -- 172.21.15.92:0/1238596714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f38101d10 msgr2=0x7f4f38102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:39.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.897+0000 7f4f3ff84640 1 --2- 172.21.15.92:0/1238596714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f38101d10 0x7f4f38102190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4f28009900 tx=0x7f4f2802a410 comp rx=0 tx=0).stop 2024-09-19T08:53:39.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.897+0000 7f4f3ff84640 1 -- 172.21.15.92:0/1238596714 shutdown_connections 2024-09-19T08:53:39.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.897+0000 7f4f3ff84640 1 --2- 172.21.15.92:0/1238596714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f381026d0 0x7f4f38108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:39.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.897+0000 7f4f3ff84640 1 --2- 172.21.15.92:0/1238596714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f38101d10 0x7f4f38102190 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:39.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.897+0000 7f4f3ff84640 1 --2- 172.21.15.92:0/1238596714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f38100b10 0x7f4f38100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:39.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.897+0000 7f4f3ff84640 1 -- 172.21.15.92:0/1238596714 >> 172.21.15.92:0/1238596714 conn(0x7f4f380fc2a0 msgr2=0x7f4f380fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:39.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.897+0000 7f4f3ff84640 1 -- 172.21.15.92:0/1238596714 shutdown_connections 2024-09-19T08:53:39.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.897+0000 7f4f3ff84640 1 -- 172.21.15.92:0/1238596714 wait complete. 2024-09-19T08:53:39.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.897+0000 7f4f3ff84640 1 Processor -- start 2024-09-19T08:53:39.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.897+0000 7f4f3ff84640 1 -- start start 2024-09-19T08:53:39.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.897+0000 7f4f3ff84640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f38100b10 0x7f4f38197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:39.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.897+0000 7f4f3ff84640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f38101d10 0x7f4f38198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:39.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.898+0000 7f4f3ff84640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f381026d0 0x7f4f3819f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:39.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.898+0000 7f4f3ff84640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4f3810d8c0 con 0x7f4f38100b10 2024-09-19T08:53:39.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.898+0000 7f4f3ff84640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4f3810d740 con 0x7f4f381026d0 2024-09-19T08:53:39.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.898+0000 7f4f3ff84640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4f3810da40 con 0x7f4f38101d10 2024-09-19T08:53:39.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.898+0000 7f4f3dd20640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f38100b10 0x7f4f38197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:39.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.898+0000 7f4f3dd20640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f38100b10 0x7f4f38197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34148/0 (socket says 172.21.15.92:34148) 2024-09-19T08:53:39.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.898+0000 7f4f3dd20640 1 -- 172.21.15.92:0/3522879889 learned_addr learned my addr 172.21.15.92:0/3522879889 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:53:39.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.898+0000 7f4f3d51f640 1 --2- 172.21.15.92:0/3522879889 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f38101d10 0x7f4f38198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:39.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.898+0000 7f4f3e521640 1 --2- 172.21.15.92:0/3522879889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f381026d0 0x7f4f3819f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:39.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.898+0000 7f4f3dd20640 1 -- 172.21.15.92:0/3522879889 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f38101d10 msgr2=0x7f4f38198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:39.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.898+0000 7f4f3dd20640 1 --2- 172.21.15.92:0/3522879889 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f38101d10 0x7f4f38198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:39.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.898+0000 7f4f3dd20640 1 -- 172.21.15.92:0/3522879889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f381026d0 msgr2=0x7f4f3819f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:39.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.898+0000 7f4f3dd20640 1 --2- 172.21.15.92:0/3522879889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f381026d0 0x7f4f3819f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:39.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.898+0000 7f4f3dd20640 1 -- 172.21.15.92:0/3522879889 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f3819fb10 con 0x7f4f38100b10 2024-09-19T08:53:39.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.898+0000 7f4f3e521640 1 --2- 172.21.15.92:0/3522879889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f381026d0 0x7f4f3819f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:53:39.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.898+0000 7f4f3dd20640 1 --2- 172.21.15.92:0/3522879889 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f38100b10 0x7f4f38197ee0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4f3400e9c0 tx=0x7f4f3400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:39.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.898+0000 7f4f2effd640 1 -- 172.21.15.92:0/3522879889 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f3400cd80 con 0x7f4f38100b10 2024-09-19T08:53:39.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.898+0000 7f4f2effd640 1 -- 172.21.15.92:0/3522879889 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f340035f0 con 0x7f4f38100b10 2024-09-19T08:53:39.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.898+0000 7f4f2effd640 1 -- 172.21.15.92:0/3522879889 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f34010690 con 0x7f4f38100b10 2024-09-19T08:53:39.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.898+0000 7f4f3ff84640 1 -- 172.21.15.92:0/3522879889 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f3819fe00 con 0x7f4f38100b10 2024-09-19T08:53:39.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.898+0000 7f4f3ff84640 1 -- 172.21.15.92:0/3522879889 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f381a0260 con 0x7f4f38100b10 2024-09-19T08:53:39.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.899+0000 7f4f3ff84640 1 -- 172.21.15.92:0/3522879889 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f38107eb0 con 0x7f4f38100b10 2024-09-19T08:53:39.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.901+0000 7f4f2effd640 1 -- 172.21.15.92:0/3522879889 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f4f340037a0 con 0x7f4f38100b10 2024-09-19T08:53:39.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.901+0000 7f4f2effd640 1 --2- 172.21.15.92:0/3522879889 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4f240a32f0 0x7f4f240a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:39.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.901+0000 7f4f3d51f640 1 --2- 172.21.15.92:0/3522879889 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4f240a32f0 0x7f4f240a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:39.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.901+0000 7f4f2effd640 1 -- 172.21.15.92:0/3522879889 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6809+0+0 (secure 0 0 0) 0x7f4f340cf700 con 0x7f4f38100b10 2024-09-19T08:53:39.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.902+0000 7f4f3d51f640 1 --2- 172.21.15.92:0/3522879889 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4f240a32f0 0x7f4f240a57b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4f280314e0 tx=0x7f4f28000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:39.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:39.906+0000 7f4f2effd640 1 -- 172.21.15.92:0/3522879889 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4f3409c9e0 con 0x7f4f38100b10 2024-09-19T08:53:40.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:40.071+0000 7f4f3ff84640 1 -- 172.21.15.92:0/3522879889 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f4f38062e90 con 0x7f4f38100b10 2024-09-19T08:53:40.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:40.071+0000 7f4f2effd640 1 -- 172.21.15.92:0/3522879889 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) ==== 74+0+133 (secure 0 0 0) 0x7f4f3409c2e0 con 0x7f4f38100b10 2024-09-19T08:53:40.072 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:53:40.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:40.073+0000 7f4f3ff84640 1 -- 172.21.15.92:0/3522879889 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4f240a32f0 msgr2=0x7f4f240a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:40.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:40.073+0000 7f4f3ff84640 1 --2- 172.21.15.92:0/3522879889 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4f240a32f0 0x7f4f240a57b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4f280314e0 tx=0x7f4f28000bc0 comp rx=0 tx=0).stop 2024-09-19T08:53:40.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:40.073+0000 7f4f3ff84640 1 -- 172.21.15.92:0/3522879889 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f38100b10 msgr2=0x7f4f38197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:40.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:40.073+0000 7f4f3ff84640 1 --2- 172.21.15.92:0/3522879889 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f38100b10 0x7f4f38197ee0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4f3400e9c0 tx=0x7f4f3400ee80 comp rx=0 tx=0).stop 2024-09-19T08:53:40.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:40.073+0000 7f4f3ff84640 1 -- 172.21.15.92:0/3522879889 shutdown_connections 2024-09-19T08:53:40.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:40.073+0000 7f4f3ff84640 1 --2- 172.21.15.92:0/3522879889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f381026d0 0x7f4f3819f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:40.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:40.073+0000 7f4f3ff84640 1 --2- 172.21.15.92:0/3522879889 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f38101d10 0x7f4f38198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:40.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:40.073+0000 7f4f3ff84640 1 --2- 172.21.15.92:0/3522879889 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4f240a32f0 0x7f4f240a57b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:40.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:40.073+0000 7f4f3ff84640 1 --2- 172.21.15.92:0/3522879889 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f38100b10 0x7f4f38197ee0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:40.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:40.073+0000 7f4f3ff84640 1 -- 172.21.15.92:0/3522879889 >> 172.21.15.92:0/3522879889 conn(0x7f4f380fc2a0 msgr2=0x7f4f38105080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:40.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:40.073+0000 7f4f3ff84640 1 -- 172.21.15.92:0/3522879889 shutdown_connections 2024-09-19T08:53:40.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:40.073+0000 7f4f3ff84640 1 -- 172.21.15.92:0/3522879889 wait complete. 2024-09-19T08:53:40.397 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:40 smithi092 ceph-mon[31407]: from='osd.11 [v2:172.21.15.190:6824/1849208751,v1:172.21.15.190:6825/1849208751]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T08:53:40.397 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:40 smithi092 ceph-mon[31407]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T08:53:40.397 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:40 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3522879889' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:53:40.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:40 smithi167 ceph-mon[35359]: from='osd.11 [v2:172.21.15.190:6824/1849208751,v1:172.21.15.190:6825/1849208751]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T08:53:40.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:40 smithi167 ceph-mon[35359]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T08:53:40.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:40 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3522879889' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:53:40.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:40 smithi190 ceph-mon[35358]: from='osd.11 [v2:172.21.15.190:6824/1849208751,v1:172.21.15.190:6825/1849208751]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T08:53:40.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:40 smithi190 ceph-mon[35358]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T08:53:40.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:40 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3522879889' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:53:40.750 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":71,"num_osds":12,"num_up_osds":11,"osd_up_since":1726735997,"num_in_osds":12,"osd_in_since":1726735999,"num_remapped_pgs":0} 2024-09-19T08:53:41.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:41 smithi092 ceph-mon[31407]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T08:53:41.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:41 smithi092 ceph-mon[31407]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T08:53:41.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:41 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:53:41.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:41 smithi092 ceph-mon[31407]: from='osd.11 [v2:172.21.15.190:6824/1849208751,v1:172.21.15.190:6825/1849208751]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-09-19T08:53:41.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:41 smithi092 ceph-mon[31407]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-09-19T08:53:41.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:41 smithi092 ceph-mon[31407]: Detected new or changed devices on smithi190 2024-09-19T08:53:41.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:41 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:41.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:41 smithi092 ceph-mon[31407]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:53:41.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:41 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:41.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:41 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:53:41.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:41 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:53:41.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:41 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:53:41.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:41 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:53:41.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:41 smithi092 ceph-mon[31407]: Adjusting osd_memory_target on smithi190 to 4272M 2024-09-19T08:53:41.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:41 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:41.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:41 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:41.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:41 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:53:41.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:41 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:41.505 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:41 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:53:41.505 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:41 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:41.505 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:41 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:53:41.505 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:41 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:41.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:41 smithi167 ceph-mon[35359]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T08:53:41.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:41 smithi167 ceph-mon[35359]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T08:53:41.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:41 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:53:41.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:41 smithi167 ceph-mon[35359]: from='osd.11 [v2:172.21.15.190:6824/1849208751,v1:172.21.15.190:6825/1849208751]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-09-19T08:53:41.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:41 smithi167 ceph-mon[35359]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-09-19T08:53:41.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:41 smithi167 ceph-mon[35359]: Detected new or changed devices on smithi190 2024-09-19T08:53:41.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:41 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:41.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:41 smithi167 ceph-mon[35359]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:53:41.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:41 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:41.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:41 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:53:41.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:41 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:53:41.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:41 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:53:41.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:41 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:53:41.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:41 smithi167 ceph-mon[35359]: Adjusting osd_memory_target on smithi190 to 4272M 2024-09-19T08:53:41.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:41 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:41.603 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:41 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:41.603 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:41 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:53:41.603 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:41 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:41.603 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:41 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:53:41.603 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:41 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:41.603 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:41 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:53:41.603 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:41 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:41.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:41 smithi190 ceph-mon[35358]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T08:53:41.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:41 smithi190 ceph-mon[35358]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T08:53:41.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:41 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:53:41.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:41 smithi190 ceph-mon[35358]: from='osd.11 [v2:172.21.15.190:6824/1849208751,v1:172.21.15.190:6825/1849208751]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-09-19T08:53:41.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:41 smithi190 ceph-mon[35358]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-09-19T08:53:41.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:41 smithi190 ceph-mon[35358]: Detected new or changed devices on smithi190 2024-09-19T08:53:41.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:41 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:41.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:41 smithi190 ceph-mon[35358]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:53:41.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:41 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:41.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:41 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:53:41.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:41 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:53:41.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:41 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:53:41.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:41 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:53:41.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:41 smithi190 ceph-mon[35358]: Adjusting osd_memory_target on smithi190 to 4272M 2024-09-19T08:53:41.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:41 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:41.625 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:41 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:41.625 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:41 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:53:41.625 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:41 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:41.625 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:41 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:53:41.625 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:41 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:41.625 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:41 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:53:41.625 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:41 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:41.752 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T08:53:41.996 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:42.373 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 08:53:42 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T08:53:42.019+0000 7f3b4ff35640 -1 osd.11 0 waiting for initial osdmap 2024-09-19T08:53:42.373 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 08:53:42 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T08:53:42.040+0000 7f3b48567640 -1 osd.11 73 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:53:42.374 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:42 smithi190 ceph-mon[35358]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-09-19T08:53:42.374 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:42 smithi190 ceph-mon[35358]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T08:53:42.374 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:42 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:53:42.374 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:42 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:53:42.374 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:42 smithi190 ceph-mon[35358]: from='osd.11 ' entity='osd.11' 2024-09-19T08:53:42.435 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:42 smithi092 ceph-mon[31407]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-09-19T08:53:42.436 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:42 smithi092 ceph-mon[31407]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T08:53:42.436 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:42 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:53:42.436 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:42 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:53:42.436 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:42 smithi092 ceph-mon[31407]: from='osd.11 ' entity='osd.11' 2024-09-19T08:53:42.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.439+0000 7f4bbee3e640 1 -- 172.21.15.92:0/3871108263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4bb8102690 msgr2=0x7f4bb8108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:42.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.439+0000 7f4bbee3e640 1 --2- 172.21.15.92:0/3871108263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4bb8102690 0x7f4bb8108f20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0009ca0 tx=0x7f4bb002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:53:42.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.439+0000 7f4bbee3e640 1 -- 172.21.15.92:0/3871108263 shutdown_connections 2024-09-19T08:53:42.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.439+0000 7f4bbee3e640 1 --2- 172.21.15.92:0/3871108263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4bb8102690 0x7f4bb8108f20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:42.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.439+0000 7f4bbee3e640 1 --2- 172.21.15.92:0/3871108263 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4bb8101cd0 0x7f4bb8102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:42.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.439+0000 7f4bbee3e640 1 --2- 172.21.15.92:0/3871108263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4bb8100ad0 0x7f4bb8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:42.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.439+0000 7f4bbee3e640 1 -- 172.21.15.92:0/3871108263 >> 172.21.15.92:0/3871108263 conn(0x7f4bb80fc280 msgr2=0x7f4bb80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:42.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.439+0000 7f4bbee3e640 1 -- 172.21.15.92:0/3871108263 shutdown_connections 2024-09-19T08:53:42.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.439+0000 7f4bbee3e640 1 -- 172.21.15.92:0/3871108263 wait complete. 2024-09-19T08:53:42.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.439+0000 7f4bbee3e640 1 Processor -- start 2024-09-19T08:53:42.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.439+0000 7f4bbee3e640 1 -- start start 2024-09-19T08:53:42.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.440+0000 7f4bbee3e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4bb8100ad0 0x7f4bb8197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:42.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.440+0000 7f4bbee3e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4bb8101cd0 0x7f4bb81983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:42.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.440+0000 7f4bbee3e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4bb8102690 0x7f4bb819f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:42.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.440+0000 7f4bbee3e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb810c730 con 0x7f4bb8100ad0 2024-09-19T08:53:42.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.440+0000 7f4bbee3e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb810c5b0 con 0x7f4bb8102690 2024-09-19T08:53:42.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.440+0000 7f4bbee3e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb810c8b0 con 0x7f4bb8101cd0 2024-09-19T08:53:42.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.440+0000 7f4bbcbda640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4bb8100ad0 0x7f4bb8197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:42.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.440+0000 7f4bbcbda640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4bb8100ad0 0x7f4bb8197e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42430/0 (socket says 172.21.15.92:42430) 2024-09-19T08:53:42.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.440+0000 7f4bbcbda640 1 -- 172.21.15.92:0/2253042054 learned_addr learned my addr 172.21.15.92:0/2253042054 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:53:42.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.440+0000 7f4bb7fff640 1 --2- 172.21.15.92:0/2253042054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4bb8101cd0 0x7f4bb81983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:42.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.440+0000 7f4bbd3db640 1 --2- 172.21.15.92:0/2253042054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4bb8102690 0x7f4bb819f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:42.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.440+0000 7f4bbcbda640 1 -- 172.21.15.92:0/2253042054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4bb8101cd0 msgr2=0x7f4bb81983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:42.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.440+0000 7f4bbcbda640 1 --2- 172.21.15.92:0/2253042054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4bb8101cd0 0x7f4bb81983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:42.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.440+0000 7f4bbcbda640 1 -- 172.21.15.92:0/2253042054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4bb8102690 msgr2=0x7f4bb819f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:42.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.440+0000 7f4bbcbda640 1 --2- 172.21.15.92:0/2253042054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4bb8102690 0x7f4bb819f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:42.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.440+0000 7f4bbcbda640 1 -- 172.21.15.92:0/2253042054 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb819fa90 con 0x7f4bb8100ad0 2024-09-19T08:53:42.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.440+0000 7f4bbcbda640 1 --2- 172.21.15.92:0/2253042054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4bb8100ad0 0x7f4bb8197e60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4bac00d770 tx=0x7f4bac00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:42.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.440+0000 7f4bb5ffb640 1 -- 172.21.15.92:0/2253042054 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bac017070 con 0x7f4bb8100ad0 2024-09-19T08:53:42.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.440+0000 7f4bbee3e640 1 -- 172.21.15.92:0/2253042054 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bb819fd80 con 0x7f4bb8100ad0 2024-09-19T08:53:42.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.440+0000 7f4bb5ffb640 1 -- 172.21.15.92:0/2253042054 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4bac009c30 con 0x7f4bb8100ad0 2024-09-19T08:53:42.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.440+0000 7f4bb5ffb640 1 -- 172.21.15.92:0/2253042054 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bac003dd0 con 0x7f4bb8100ad0 2024-09-19T08:53:42.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.441+0000 7f4bbee3e640 1 -- 172.21.15.92:0/2253042054 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bb81a0200 con 0x7f4bb8100ad0 2024-09-19T08:53:42.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.442+0000 7f4bbee3e640 1 -- 172.21.15.92:0/2253042054 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bb81a0430 con 0x7f4bb8100ad0 2024-09-19T08:53:42.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.443+0000 7f4bb5ffb640 1 -- 172.21.15.92:0/2253042054 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f4bac003f70 con 0x7f4bb8100ad0 2024-09-19T08:53:42.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.443+0000 7f4bb5ffb640 1 --2- 172.21.15.92:0/2253042054 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4ba80a3270 0x7f4ba80a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:42.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.443+0000 7f4bb7fff640 1 --2- 172.21.15.92:0/2253042054 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4ba80a3270 0x7f4ba80a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:42.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.443+0000 7f4bb5ffb640 1 -- 172.21.15.92:0/2253042054 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6847+0+0 (secure 0 0 0) 0x7f4bac0cec80 con 0x7f4bb8100ad0 2024-09-19T08:53:42.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.444+0000 7f4bb7fff640 1 --2- 172.21.15.92:0/2253042054 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4ba80a3270 0x7f4ba80a5730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8199380 tx=0x7f4ba400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:42.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.447+0000 7f4bb5ffb640 1 -- 172.21.15.92:0/2253042054 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4bac09bf60 con 0x7f4bb8100ad0 2024-09-19T08:53:42.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:42 smithi167 ceph-mon[35359]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-09-19T08:53:42.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:42 smithi167 ceph-mon[35359]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T08:53:42.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:42 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:53:42.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:42 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:53:42.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:42 smithi167 ceph-mon[35359]: from='osd.11 ' entity='osd.11' 2024-09-19T08:53:42.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.613+0000 7f4bbee3e640 1 -- 172.21.15.92:0/2253042054 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f4bb81a07e0 con 0x7f4bb8100ad0 2024-09-19T08:53:42.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.614+0000 7f4bb5ffb640 1 -- 172.21.15.92:0/2253042054 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7f4bac009de0 con 0x7f4bb8100ad0 2024-09-19T08:53:42.615 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:53:42.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.615+0000 7f4bbee3e640 1 -- 172.21.15.92:0/2253042054 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4ba80a3270 msgr2=0x7f4ba80a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:42.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.615+0000 7f4bbee3e640 1 --2- 172.21.15.92:0/2253042054 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4ba80a3270 0x7f4ba80a5730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8199380 tx=0x7f4ba400b410 comp rx=0 tx=0).stop 2024-09-19T08:53:42.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.615+0000 7f4bbee3e640 1 -- 172.21.15.92:0/2253042054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4bb8100ad0 msgr2=0x7f4bb8197e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:42.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.615+0000 7f4bbee3e640 1 --2- 172.21.15.92:0/2253042054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4bb8100ad0 0x7f4bb8197e60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4bac00d770 tx=0x7f4bac00dc30 comp rx=0 tx=0).stop 2024-09-19T08:53:42.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.616+0000 7f4bbee3e640 1 -- 172.21.15.92:0/2253042054 shutdown_connections 2024-09-19T08:53:42.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.616+0000 7f4bbee3e640 1 --2- 172.21.15.92:0/2253042054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4bb8102690 0x7f4bb819f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:42.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.616+0000 7f4bbee3e640 1 --2- 172.21.15.92:0/2253042054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4bb8101cd0 0x7f4bb81983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:42.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.616+0000 7f4bbee3e640 1 --2- 172.21.15.92:0/2253042054 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4ba80a3270 0x7f4ba80a5730 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:42.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.616+0000 7f4bbee3e640 1 --2- 172.21.15.92:0/2253042054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4bb8100ad0 0x7f4bb8197e60 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:42.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.616+0000 7f4bbee3e640 1 -- 172.21.15.92:0/2253042054 >> 172.21.15.92:0/2253042054 conn(0x7f4bb80fc280 msgr2=0x7f4bb8069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:42.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.616+0000 7f4bbee3e640 1 -- 172.21.15.92:0/2253042054 shutdown_connections 2024-09-19T08:53:42.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:42.616+0000 7f4bbee3e640 1 -- 172.21.15.92:0/2253042054 wait complete. 2024-09-19T08:53:43.252 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":73,"num_osds":12,"num_up_osds":11,"osd_up_since":1726735997,"num_in_osds":12,"osd_in_since":1726735999,"num_remapped_pgs":0} 2024-09-19T08:53:43.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:43 smithi092 ceph-mon[31407]: purged_snaps scrub starts 2024-09-19T08:53:43.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:43 smithi092 ceph-mon[31407]: purged_snaps scrub ok 2024-09-19T08:53:43.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:43 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:53:43.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:43 smithi092 ceph-mon[31407]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:53:43.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:43 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/2253042054' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:53:43.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:43 smithi092 ceph-mon[31407]: osd.11 [v2:172.21.15.190:6824/1849208751,v1:172.21.15.190:6825/1849208751] boot 2024-09-19T08:53:43.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:43 smithi092 ceph-mon[31407]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T08:53:43.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:43 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:53:43.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:43 smithi167 ceph-mon[35359]: purged_snaps scrub starts 2024-09-19T08:53:43.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:43 smithi167 ceph-mon[35359]: purged_snaps scrub ok 2024-09-19T08:53:43.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:43 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:53:43.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:43 smithi167 ceph-mon[35359]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:53:43.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:43 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/2253042054' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:53:43.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:43 smithi167 ceph-mon[35359]: osd.11 [v2:172.21.15.190:6824/1849208751,v1:172.21.15.190:6825/1849208751] boot 2024-09-19T08:53:43.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:43 smithi167 ceph-mon[35359]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T08:53:43.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:43 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:53:43.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:43 smithi190 ceph-mon[35358]: purged_snaps scrub starts 2024-09-19T08:53:43.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:43 smithi190 ceph-mon[35358]: purged_snaps scrub ok 2024-09-19T08:53:43.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:43 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:53:43.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:43 smithi190 ceph-mon[35358]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:53:43.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:43 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/2253042054' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:53:43.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:43 smithi190 ceph-mon[35358]: osd.11 [v2:172.21.15.190:6824/1849208751,v1:172.21.15.190:6825/1849208751] boot 2024-09-19T08:53:43.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:43 smithi190 ceph-mon[35358]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T08:53:43.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:43 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:53:44.254 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T08:53:44.507 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:45.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.258+0000 7f340936f640 1 -- 172.21.15.92:0/1845713408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3404102e00 msgr2=0x7f3404103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:45.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.258+0000 7f340936f640 1 --2- 172.21.15.92:0/1845713408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3404102e00 0x7f3404103280 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f33f8009900 tx=0x7f33f802a410 comp rx=0 tx=0).stop 2024-09-19T08:53:45.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.258+0000 7f340936f640 1 -- 172.21.15.92:0/1845713408 shutdown_connections 2024-09-19T08:53:45.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.258+0000 7f340936f640 1 --2- 172.21.15.92:0/1845713408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34041037c0 0x7f340410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:45.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.258+0000 7f340936f640 1 --2- 172.21.15.92:0/1845713408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3404102e00 0x7f3404103280 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:45.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.258+0000 7f340936f640 1 --2- 172.21.15.92:0/1845713408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3404101c00 0x7f3404102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:45.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.258+0000 7f340936f640 1 -- 172.21.15.92:0/1845713408 >> 172.21.15.92:0/1845713408 conn(0x7f34040fd390 msgr2=0x7f34040ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:45.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.258+0000 7f340936f640 1 -- 172.21.15.92:0/1845713408 shutdown_connections 2024-09-19T08:53:45.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.258+0000 7f340936f640 1 -- 172.21.15.92:0/1845713408 wait complete. 2024-09-19T08:53:45.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.258+0000 7f340936f640 1 Processor -- start 2024-09-19T08:53:45.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.259+0000 7f340936f640 1 -- start start 2024-09-19T08:53:45.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.259+0000 7f340936f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3404101c00 0x7f3404197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:45.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.259+0000 7f340936f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3404102e00 0x7f3404198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:45.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.259+0000 7f340936f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f34041037c0 0x7f340419f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:45.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.259+0000 7f340936f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f340410d880 con 0x7f3404102e00 2024-09-19T08:53:45.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.259+0000 7f340936f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f340410d700 con 0x7f3404101c00 2024-09-19T08:53:45.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.259+0000 7f340936f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f340410da00 con 0x7f34041037c0 2024-09-19T08:53:45.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.259+0000 7f34027fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3404102e00 0x7f3404198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:45.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.259+0000 7f34027fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3404102e00 0x7f3404198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42444/0 (socket says 172.21.15.92:42444) 2024-09-19T08:53:45.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.259+0000 7f34027fc640 1 -- 172.21.15.92:0/4289497630 learned_addr learned my addr 172.21.15.92:0/4289497630 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:53:45.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.259+0000 7f34037fe640 1 --2- 172.21.15.92:0/4289497630 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f34041037c0 0x7f340419f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:45.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.259+0000 7f3402ffd640 1 --2- 172.21.15.92:0/4289497630 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3404101c00 0x7f3404197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:45.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.259+0000 7f34027fc640 1 -- 172.21.15.92:0/4289497630 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f34041037c0 msgr2=0x7f340419f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:45.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.259+0000 7f34027fc640 1 --2- 172.21.15.92:0/4289497630 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f34041037c0 0x7f340419f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:45.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.259+0000 7f34027fc640 1 -- 172.21.15.92:0/4289497630 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3404101c00 msgr2=0x7f3404197f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:45.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.259+0000 7f34027fc640 1 --2- 172.21.15.92:0/4289497630 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3404101c00 0x7f3404197f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:45.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.259+0000 7f34027fc640 1 -- 172.21.15.92:0/4289497630 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f340419fb40 con 0x7f3404102e00 2024-09-19T08:53:45.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.259+0000 7f34027fc640 1 --2- 172.21.15.92:0/4289497630 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3404102e00 0x7f3404198450 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f33f8009230 tx=0x7f33f8004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:45.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.260+0000 7f33ebfff640 1 -- 172.21.15.92:0/4289497630 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f803f030 con 0x7f3404102e00 2024-09-19T08:53:45.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.260+0000 7f33ebfff640 1 -- 172.21.15.92:0/4289497630 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33f8003ce0 con 0x7f3404102e00 2024-09-19T08:53:45.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.260+0000 7f340936f640 1 -- 172.21.15.92:0/4289497630 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f340419fdd0 con 0x7f3404102e00 2024-09-19T08:53:45.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.260+0000 7f33ebfff640 1 -- 172.21.15.92:0/4289497630 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f8035070 con 0x7f3404102e00 2024-09-19T08:53:45.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.260+0000 7f340936f640 1 -- 172.21.15.92:0/4289497630 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34041a0250 con 0x7f3404102e00 2024-09-19T08:53:45.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.261+0000 7f340936f640 1 -- 172.21.15.92:0/4289497630 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3404109050 con 0x7f3404102e00 2024-09-19T08:53:45.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.262+0000 7f33ebfff640 1 -- 172.21.15.92:0/4289497630 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f33f8042030 con 0x7f3404102e00 2024-09-19T08:53:45.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.262+0000 7f33ebfff640 1 --2- 172.21.15.92:0/4289497630 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f33ec0a3270 0x7f33ec0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:45.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.262+0000 7f3402ffd640 1 --2- 172.21.15.92:0/4289497630 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f33ec0a3270 0x7f33ec0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:45.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.262+0000 7f33ebfff640 1 -- 172.21.15.92:0/4289497630 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f33f80efab0 con 0x7f3404102e00 2024-09-19T08:53:45.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.263+0000 7f3402ffd640 1 --2- 172.21.15.92:0/4289497630 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f33ec0a3270 0x7f33ec0a5730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f33f4005fd0 tx=0x7f33f4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:45.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.266+0000 7f33ebfff640 1 -- 172.21.15.92:0/4289497630 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f33f80bcc70 con 0x7f3404102e00 2024-09-19T08:53:45.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.431+0000 7f340936f640 1 -- 172.21.15.92:0/4289497630 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f340402d970 con 0x7f3404102e00 2024-09-19T08:53:45.431 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:45 smithi092 ceph-mon[31407]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T08:53:45.431 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:45 smithi092 ceph-mon[31407]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:53:45.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.431+0000 7f33ebfff640 1 -- 172.21.15.92:0/4289497630 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v75) ==== 74+0+133 (secure 0 0 0) 0x7f33f80dc020 con 0x7f3404102e00 2024-09-19T08:53:45.431 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:53:45.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.434+0000 7f340936f640 1 -- 172.21.15.92:0/4289497630 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f33ec0a3270 msgr2=0x7f33ec0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:45.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.434+0000 7f340936f640 1 --2- 172.21.15.92:0/4289497630 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f33ec0a3270 0x7f33ec0a5730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f33f4005fd0 tx=0x7f33f4005850 comp rx=0 tx=0).stop 2024-09-19T08:53:45.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.434+0000 7f340936f640 1 -- 172.21.15.92:0/4289497630 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3404102e00 msgr2=0x7f3404198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:45.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.434+0000 7f340936f640 1 --2- 172.21.15.92:0/4289497630 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3404102e00 0x7f3404198450 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f33f8009230 tx=0x7f33f8004360 comp rx=0 tx=0).stop 2024-09-19T08:53:45.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.434+0000 7f340936f640 1 -- 172.21.15.92:0/4289497630 shutdown_connections 2024-09-19T08:53:45.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.434+0000 7f340936f640 1 --2- 172.21.15.92:0/4289497630 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f34041037c0 0x7f340419f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:45.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.434+0000 7f340936f640 1 --2- 172.21.15.92:0/4289497630 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f33ec0a3270 0x7f33ec0a5730 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:45.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.434+0000 7f340936f640 1 --2- 172.21.15.92:0/4289497630 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3404102e00 0x7f3404198450 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:45.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.434+0000 7f340936f640 1 --2- 172.21.15.92:0/4289497630 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3404101c00 0x7f3404197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:45.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.434+0000 7f340936f640 1 -- 172.21.15.92:0/4289497630 >> 172.21.15.92:0/4289497630 conn(0x7f34040fd390 msgr2=0x7f3404106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:45.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.434+0000 7f340936f640 1 -- 172.21.15.92:0/4289497630 shutdown_connections 2024-09-19T08:53:45.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:45.434+0000 7f340936f640 1 -- 172.21.15.92:0/4289497630 wait complete. 2024-09-19T08:53:45.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:45 smithi167 ceph-mon[35359]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T08:53:45.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:45 smithi167 ceph-mon[35359]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:53:45.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:45 smithi190 ceph-mon[35358]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T08:53:45.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:45 smithi190 ceph-mon[35358]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:53:46.075 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":75,"num_osds":12,"num_up_osds":12,"osd_up_since":1726736023,"num_in_osds":12,"osd_in_since":1726735999,"num_remapped_pgs":0} 2024-09-19T08:53:46.075 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:53:46.316 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:46.502 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:46 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/4289497630' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:53:46.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:46 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/4289497630' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:53:46.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:46 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/4289497630' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:53:46.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.805+0000 7f18f0643640 1 -- 172.21.15.92:0/1220389728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18e8100aa0 msgr2=0x7f18e810ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:46.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.805+0000 7f18f0643640 1 --2- 172.21.15.92:0/1220389728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18e8100aa0 0x7f18e810ea20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f18e0009ca0 tx=0x7f18e002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:53:46.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.805+0000 7f18f0643640 1 -- 172.21.15.92:0/1220389728 shutdown_connections 2024-09-19T08:53:46.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.805+0000 7f18f0643640 1 --2- 172.21.15.92:0/1220389728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18e8100aa0 0x7f18e810ea20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:46.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.805+0000 7f18f0643640 1 --2- 172.21.15.92:0/1220389728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18e8100100 0x7f18e8100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:46.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.805+0000 7f18f0643640 1 --2- 172.21.15.92:0/1220389728 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18e8106b80 0x7f18e8106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:46.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.805+0000 7f18f0643640 1 -- 172.21.15.92:0/1220389728 >> 172.21.15.92:0/1220389728 conn(0x7f18e8077230 msgr2=0x7f18e80fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:46.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.805+0000 7f18f0643640 1 -- 172.21.15.92:0/1220389728 shutdown_connections 2024-09-19T08:53:46.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.805+0000 7f18f0643640 1 -- 172.21.15.92:0/1220389728 wait complete. 2024-09-19T08:53:46.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.805+0000 7f18f0643640 1 Processor -- start 2024-09-19T08:53:46.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.806+0000 7f18f0643640 1 -- start start 2024-09-19T08:53:46.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.806+0000 7f18f0643640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18e8100100 0x7f18e8198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:46.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.806+0000 7f18f0643640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18e8100aa0 0x7f18e81989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:46.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.806+0000 7f18f0643640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18e8106b80 0x7f18e819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:46.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.806+0000 7f18f0643640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f18e8112050 con 0x7f18e8100aa0 2024-09-19T08:53:46.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.806+0000 7f18f0643640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f18e8111ed0 con 0x7f18e8100100 2024-09-19T08:53:46.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.806+0000 7f18f0643640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f18e81121d0 con 0x7f18e8106b80 2024-09-19T08:53:46.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.806+0000 7f18edbde640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18e8100aa0 0x7f18e81989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:46.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.806+0000 7f18edbde640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18e8100aa0 0x7f18e81989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42448/0 (socket says 172.21.15.92:42448) 2024-09-19T08:53:46.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.806+0000 7f18edbde640 1 -- 172.21.15.92:0/2352175421 learned_addr learned my addr 172.21.15.92:0/2352175421 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:53:46.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.806+0000 7f18eebe0640 1 --2- 172.21.15.92:0/2352175421 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18e8106b80 0x7f18e819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:46.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.806+0000 7f18ee3df640 1 --2- 172.21.15.92:0/2352175421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18e8100100 0x7f18e8198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:46.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.806+0000 7f18edbde640 1 -- 172.21.15.92:0/2352175421 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18e8106b80 msgr2=0x7f18e819cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:46.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.806+0000 7f18edbde640 1 --2- 172.21.15.92:0/2352175421 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18e8106b80 0x7f18e819cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:46.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.806+0000 7f18edbde640 1 -- 172.21.15.92:0/2352175421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18e8100100 msgr2=0x7f18e8198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:46.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.806+0000 7f18edbde640 1 --2- 172.21.15.92:0/2352175421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18e8100100 0x7f18e8198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:46.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.806+0000 7f18edbde640 1 -- 172.21.15.92:0/2352175421 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e819d420 con 0x7f18e8100aa0 2024-09-19T08:53:46.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.806+0000 7f18ee3df640 1 --2- 172.21.15.92:0/2352175421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18e8100100 0x7f18e8198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:53:46.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.806+0000 7f18edbde640 1 --2- 172.21.15.92:0/2352175421 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18e8100aa0 0x7f18e81989b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f18d800c890 tx=0x7f18d800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:46.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.807+0000 7f18df7fe640 1 -- 172.21.15.92:0/2352175421 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d8004220 con 0x7f18e8100aa0 2024-09-19T08:53:46.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.807+0000 7f18df7fe640 1 -- 172.21.15.92:0/2352175421 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18d80043c0 con 0x7f18e8100aa0 2024-09-19T08:53:46.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.807+0000 7f18f0643640 1 -- 172.21.15.92:0/2352175421 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18e819d710 con 0x7f18e8100aa0 2024-09-19T08:53:46.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.807+0000 7f18df7fe640 1 -- 172.21.15.92:0/2352175421 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d80049e0 con 0x7f18e8100aa0 2024-09-19T08:53:46.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.807+0000 7f18f0643640 1 -- 172.21.15.92:0/2352175421 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18e81a4ff0 con 0x7f18e8100aa0 2024-09-19T08:53:46.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.808+0000 7f18f0643640 1 -- 172.21.15.92:0/2352175421 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18e8100560 con 0x7f18e8100aa0 2024-09-19T08:53:46.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.809+0000 7f18df7fe640 1 -- 172.21.15.92:0/2352175421 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f18d80079b0 con 0x7f18e8100aa0 2024-09-19T08:53:46.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.810+0000 7f18df7fe640 1 --2- 172.21.15.92:0/2352175421 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f18d40a32c0 0x7f18d40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:46.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.810+0000 7f18ee3df640 1 --2- 172.21.15.92:0/2352175421 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f18d40a32c0 0x7f18d40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:46.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.810+0000 7f18df7fe640 1 -- 172.21.15.92:0/2352175421 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f18d80cf520 con 0x7f18e8100aa0 2024-09-19T08:53:46.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.810+0000 7f18ee3df640 1 --2- 172.21.15.92:0/2352175421 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f18d40a32c0 0x7f18d40a5780 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f18e4009b40 tx=0x7f18e4005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:46.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.813+0000 7f18df7fe640 1 -- 172.21.15.92:0/2352175421 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f18d8014030 con 0x7f18e8100aa0 2024-09-19T08:53:46.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.979+0000 7f18f0643640 1 -- 172.21.15.92:0/2352175421 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f18e81997d0 con 0x7f18e8100aa0 2024-09-19T08:53:46.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.980+0000 7f18df7fe640 1 -- 172.21.15.92:0/2352175421 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+18492 (secure 0 0 0) 0x7f18d809c6c0 con 0x7f18e8100aa0 2024-09-19T08:53:46.980 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:53:46.980 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":75,"fsid":"91ff74f2-7663-11ef-bceb-c7b262605968","created":"2024-09-19T08:47:08.162150+0000","modified":"2024-09-19T08:53:44.234202+0000","last_up_change":"2024-09-19T08:53:43.021949+0000","last_in_change":"2024-09-19T08:53:19.246805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:50:04.482034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd104fe2-b828-4c98-a499-b212717f2997","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6803","nonce":4232030626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6805","nonce":4232030626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6809","nonce":4232030626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6807","nonce":4232030626}]},"public_addr":"172.21.15.92:6803/4232030626","cluster_addr":"172.21.15.92:6805/4232030626","heartbeat_back_addr":"172.21.15.92:6809/4232030626","heartbeat_front_addr":"172.21.15.92:6807/4232030626","state":["exists","up"]},{"osd":1,"uuid":"0f725330-5e61-413c-b3c8-41bc2c0d8e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6801","nonce":4163493234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6803","nonce":4163493234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6807","nonce":4163493234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6805","nonce":4163493234}]},"public_addr":"172.21.15.167:6801/4163493234","cluster_addr":"172.21.15.167:6803/4163493234","heartbeat_back_addr":"172.21.15.167:6807/4163493234","heartbeat_front_addr":"172.21.15.167:6805/4163493234","state":["exists","up"]},{"osd":2,"uuid":"286d2943-23a0-4184-93cf-9d3430781f99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6801","nonce":702507556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6803","nonce":702507556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6807","nonce":702507556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6805","nonce":702507556}]},"public_addr":"172.21.15.190:6801/702507556","cluster_addr":"172.21.15.190:6803/702507556","heartbeat_back_addr":"172.21.15.190:6807/702507556","heartbeat_front_addr":"172.21.15.190:6805/702507556","state":["exists","up"]},{"osd":3,"uuid":"9d126671-7fc1-4f29-9bc3-3598052fd20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6811","nonce":945752895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6813","nonce":945752895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6817","nonce":945752895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6815","nonce":945752895}]},"public_addr":"172.21.15.92:6811/945752895","cluster_addr":"172.21.15.92:6813/945752895","heartbeat_back_addr":"172.21.15.92:6817/945752895","heartbeat_front_addr":"172.21.15.92:6815/945752895","state":["exists","up"]},{"osd":4,"uuid":"cb10b38d-ae13-4b92-b906-3505fb873b2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6809","nonce":3576893400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6811","nonce":3576893400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6815","nonce":3576893400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6813","nonce":3576893400}]},"public_addr":"172.21.15.167:6809/3576893400","cluster_addr":"172.21.15.167:6811/3576893400","heartbeat_back_addr":"172.21.15.167:6815/3576893400","heartbeat_front_addr":"172.21.15.167:6813/3576893400","state":["exists","up"]},{"osd":5,"uuid":"cd90668b-eca5-4bb4-870e-e58578730c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6809","nonce":1880491675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6811","nonce":1880491675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6815","nonce":1880491675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6813","nonce":1880491675}]},"public_addr":"172.21.15.190:6809/1880491675","cluster_addr":"172.21.15.190:6811/1880491675","heartbeat_back_addr":"172.21.15.190:6815/1880491675","heartbeat_front_addr":"172.21.15.190:6813/1880491675","state":["exists","up"]},{"osd":6,"uuid":"4e047963-afa7-4934-b887-8086165fb831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6819","nonce":1743435653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6821","nonce":1743435653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6825","nonce":1743435653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6823","nonce":1743435653}]},"public_addr":"172.21.15.92:6819/1743435653","cluster_addr":"172.21.15.92:6821/1743435653","heartbeat_back_addr":"172.21.15.92:6825/1743435653","heartbeat_front_addr":"172.21.15.92:6823/1743435653","state":["exists","up"]},{"osd":7,"uuid":"652a6aa1-bb94-4608-952e-67cd02bdff66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6817","nonce":2984111963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6819","nonce":2984111963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6823","nonce":2984111963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6821","nonce":2984111963}]},"public_addr":"172.21.15.167:6817/2984111963","cluster_addr":"172.21.15.167:6819/2984111963","heartbeat_back_addr":"172.21.15.167:6823/2984111963","heartbeat_front_addr":"172.21.15.167:6821/2984111963","state":["exists","up"]},{"osd":8,"uuid":"1510ef1f-fdfe-4887-a771-146efce062fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6817","nonce":4190304434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6819","nonce":4190304434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6823","nonce":4190304434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6821","nonce":4190304434}]},"public_addr":"172.21.15.190:6817/4190304434","cluster_addr":"172.21.15.190:6819/4190304434","heartbeat_back_addr":"172.21.15.190:6823/4190304434","heartbeat_front_addr":"172.21.15.190:6821/4190304434","state":["exists","up"]},{"osd":9,"uuid":"9b774bbe-6700-4020-900b-3fdbaa546773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6827","nonce":3066744542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6829","nonce":3066744542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6833","nonce":3066744542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6831","nonce":3066744542}]},"public_addr":"172.21.15.92:6827/3066744542","cluster_addr":"172.21.15.92:6829/3066744542","heartbeat_back_addr":"172.21.15.92:6833/3066744542","heartbeat_front_addr":"172.21.15.92:6831/3066744542","state":["exists","up"]},{"osd":10,"uuid":"8abdb835-db2c-4597-ae1d-8ef56e63ab6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6825","nonce":2309134313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6827","nonce":2309134313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6831","nonce":2309134313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6829","nonce":2309134313}]},"public_addr":"172.21.15.167:6825/2309134313","cluster_addr":"172.21.15.167:6827/2309134313","heartbeat_back_addr":"172.21.15.167:6831/2309134313","heartbeat_front_addr":"172.21.15.167:6829/2309134313","state":["exists","up"]},{"osd":11,"uuid":"564c844a-378f-40cd-9717-cde35a65631c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6825","nonce":1849208751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6827","nonce":1849208751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6831","nonce":1849208751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6829","nonce":1849208751}]},"public_addr":"172.21.15.190:6825/1849208751","cluster_addr":"172.21.15.190:6827/1849208751","heartbeat_back_addr":"172.21.15.190:6831/1849208751","heartbeat_front_addr":"172.21.15.190:6829/1849208751","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:12.072109+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:36.689174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:01.908763+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:26.857439+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:50.881629+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:51:15.160744+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:51:39.101605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:03.179877+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:27.324563+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:51.971287+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:53:15.917311+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:53:40.592486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/2948821221":"2024-09-20T08:47:52.180093+0000","172.21.15.92:0/1441365956":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6801/2908709470":"2024-09-20T08:47:52.180093+0000","172.21.15.92:0/608374871":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6801/1369295034":"2024-09-20T08:47:29.812397+0000","172.21.15.92:6800/2908709470":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6800/1369295034":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/813486656":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/1963725565":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/1668504617":"2024-09-20T08:47:29.812397+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:53:46.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.982+0000 7f18f0643640 1 -- 172.21.15.92:0/2352175421 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f18d40a32c0 msgr2=0x7f18d40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:46.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.982+0000 7f18f0643640 1 --2- 172.21.15.92:0/2352175421 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f18d40a32c0 0x7f18d40a5780 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f18e4009b40 tx=0x7f18e4005e50 comp rx=0 tx=0).stop 2024-09-19T08:53:46.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.982+0000 7f18f0643640 1 -- 172.21.15.92:0/2352175421 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18e8100aa0 msgr2=0x7f18e81989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:46.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.982+0000 7f18f0643640 1 --2- 172.21.15.92:0/2352175421 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18e8100aa0 0x7f18e81989b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f18d800c890 tx=0x7f18d800cd50 comp rx=0 tx=0).stop 2024-09-19T08:53:46.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.982+0000 7f18f0643640 1 -- 172.21.15.92:0/2352175421 shutdown_connections 2024-09-19T08:53:46.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.982+0000 7f18f0643640 1 --2- 172.21.15.92:0/2352175421 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18e8106b80 0x7f18e819cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:46.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.982+0000 7f18f0643640 1 --2- 172.21.15.92:0/2352175421 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f18d40a32c0 0x7f18d40a5780 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:46.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.982+0000 7f18f0643640 1 --2- 172.21.15.92:0/2352175421 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18e8100aa0 0x7f18e81989b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:46.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.982+0000 7f18f0643640 1 --2- 172.21.15.92:0/2352175421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18e8100100 0x7f18e8198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:46.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.982+0000 7f18f0643640 1 -- 172.21.15.92:0/2352175421 >> 172.21.15.92:0/2352175421 conn(0x7f18e8077230 msgr2=0x7f18e8104bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:46.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.982+0000 7f18f0643640 1 -- 172.21.15.92:0/2352175421 shutdown_connections 2024-09-19T08:53:46.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:46.982+0000 7f18f0643640 1 -- 172.21.15.92:0/2352175421 wait complete. 2024-09-19T08:53:47.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:47 smithi092 ceph-mon[31407]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:53:47.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:47 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/2352175421' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:53:47.542 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T08:50:04.482034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T08:53:47.542 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-19T08:53:47.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:47 smithi167 ceph-mon[35359]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:53:47.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:47 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/2352175421' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:53:47.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:47 smithi190 ceph-mon[35358]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:53:47.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:47 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/2352175421' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:53:47.785 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:48.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.223+0000 7ff920f26640 1 -- 172.21.15.92:0/799692559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff91c106f10 msgr2=0x7ff91c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:48.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.223+0000 7ff920f26640 1 --2- 172.21.15.92:0/799692559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff91c106f10 0x7ff91c10ea90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff914009ca0 tx=0x7ff91402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.223+0000 7ff920f26640 1 -- 172.21.15.92:0/799692559 shutdown_connections 2024-09-19T08:53:48.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.223+0000 7ff920f26640 1 --2- 172.21.15.92:0/799692559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff91c106f10 0x7ff91c10ea90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.223+0000 7ff920f26640 1 --2- 172.21.15.92:0/799692559 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff91c102790 0x7ff91c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.223+0000 7ff920f26640 1 --2- 172.21.15.92:0/799692559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff91c101de0 0x7ff91c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.223+0000 7ff920f26640 1 -- 172.21.15.92:0/799692559 >> 172.21.15.92:0/799692559 conn(0x7ff91c0fd8c0 msgr2=0x7ff91c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:48.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.223+0000 7ff920f26640 1 -- 172.21.15.92:0/799692559 shutdown_connections 2024-09-19T08:53:48.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.223+0000 7ff920f26640 1 -- 172.21.15.92:0/799692559 wait complete. 2024-09-19T08:53:48.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.224+0000 7ff920f26640 1 Processor -- start 2024-09-19T08:53:48.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.224+0000 7ff920f26640 1 -- start start 2024-09-19T08:53:48.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.224+0000 7ff920f26640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff91c101de0 0x7ff91c1a0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.224+0000 7ff920f26640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff91c102790 0x7ff91c1a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.224+0000 7ff920f26640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff91c106f10 0x7ff91c19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.224+0000 7ff920f26640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff91c112010 con 0x7ff91c106f10 2024-09-19T08:53:48.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.224+0000 7ff920f26640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff91c111e90 con 0x7ff91c102790 2024-09-19T08:53:48.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.224+0000 7ff920f26640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff91c112190 con 0x7ff91c101de0 2024-09-19T08:53:48.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.224+0000 7ff91ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff91c106f10 0x7ff91c19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.224+0000 7ff91ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff91c106f10 0x7ff91c19a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42466/0 (socket says 172.21.15.92:42466) 2024-09-19T08:53:48.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.224+0000 7ff91ad9d640 1 -- 172.21.15.92:0/517317480 learned_addr learned my addr 172.21.15.92:0/517317480 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:53:48.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.224+0000 7ff91a59c640 1 --2- 172.21.15.92:0/517317480 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff91c101de0 0x7ff91c1a0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.225+0000 7ff919d9b640 1 --2- 172.21.15.92:0/517317480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff91c102790 0x7ff91c1a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.225+0000 7ff91ad9d640 1 -- 172.21.15.92:0/517317480 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff91c101de0 msgr2=0x7ff91c1a0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:48.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.225+0000 7ff91ad9d640 1 --2- 172.21.15.92:0/517317480 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff91c101de0 0x7ff91c1a0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.225+0000 7ff91ad9d640 1 -- 172.21.15.92:0/517317480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff91c102790 msgr2=0x7ff91c1a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:48.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.225+0000 7ff91ad9d640 1 --2- 172.21.15.92:0/517317480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff91c102790 0x7ff91c1a0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.225+0000 7ff91ad9d640 1 -- 172.21.15.92:0/517317480 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff91c19aeb0 con 0x7ff91c106f10 2024-09-19T08:53:48.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.225+0000 7ff919d9b640 1 --2- 172.21.15.92:0/517317480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff91c102790 0x7ff91c1a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:53:48.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.225+0000 7ff91ad9d640 1 --2- 172.21.15.92:0/517317480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff91c106f10 0x7ff91c19a640 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff914031a60 tx=0x7ff914031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:48.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.225+0000 7ff90b7fe640 1 -- 172.21.15.92:0/517317480 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff914003c30 con 0x7ff91c106f10 2024-09-19T08:53:48.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.225+0000 7ff920f26640 1 -- 172.21.15.92:0/517317480 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff91c19b140 con 0x7ff91c106f10 2024-09-19T08:53:48.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.225+0000 7ff90b7fe640 1 -- 172.21.15.92:0/517317480 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff914003dd0 con 0x7ff91c106f10 2024-09-19T08:53:48.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.225+0000 7ff90b7fe640 1 -- 172.21.15.92:0/517317480 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9140047e0 con 0x7ff91c106f10 2024-09-19T08:53:48.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.225+0000 7ff920f26640 1 -- 172.21.15.92:0/517317480 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff91c1a7320 con 0x7ff91c106f10 2024-09-19T08:53:48.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.226+0000 7ff920f26640 1 -- 172.21.15.92:0/517317480 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff91c1032c0 con 0x7ff91c106f10 2024-09-19T08:53:48.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.227+0000 7ff90b7fe640 1 -- 172.21.15.92:0/517317480 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ff91402f790 con 0x7ff91c106f10 2024-09-19T08:53:48.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.228+0000 7ff90b7fe640 1 --2- 172.21.15.92:0/517317480 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff9040a3240 0x7ff9040a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.228+0000 7ff91a59c640 1 --2- 172.21.15.92:0/517317480 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff9040a3240 0x7ff9040a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.228+0000 7ff90b7fe640 1 -- 172.21.15.92:0/517317480 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7ff9140f0950 con 0x7ff91c106f10 2024-09-19T08:53:48.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.228+0000 7ff91a59c640 1 --2- 172.21.15.92:0/517317480 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff9040a3240 0x7ff9040a5700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff90c009890 tx=0x7ff90c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:48.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.232+0000 7ff90b7fe640 1 -- 172.21.15.92:0/517317480 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff9140bdb10 con 0x7ff91c106f10 2024-09-19T08:53:48.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.401+0000 7ff920f26640 1 -- 172.21.15.92:0/517317480 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff91c1a74f0 con 0x7ff91c106f10 2024-09-19T08:53:48.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.401+0000 7ff90b7fe640 1 -- 172.21.15.92:0/517317480 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) ==== 93+0+10 (secure 0 0 0) 0x7ff9140bd410 con 0x7ff91c106f10 2024-09-19T08:53:48.401 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2024-09-19T08:53:48.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.403+0000 7ff920f26640 1 -- 172.21.15.92:0/517317480 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff9040a3240 msgr2=0x7ff9040a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:48.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.403+0000 7ff920f26640 1 --2- 172.21.15.92:0/517317480 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff9040a3240 0x7ff9040a5700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff90c009890 tx=0x7ff90c008040 comp rx=0 tx=0).stop 2024-09-19T08:53:48.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.403+0000 7ff920f26640 1 -- 172.21.15.92:0/517317480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff91c106f10 msgr2=0x7ff91c19a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:48.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.403+0000 7ff920f26640 1 --2- 172.21.15.92:0/517317480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff91c106f10 0x7ff91c19a640 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff914031a60 tx=0x7ff914031a90 comp rx=0 tx=0).stop 2024-09-19T08:53:48.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.403+0000 7ff920f26640 1 -- 172.21.15.92:0/517317480 shutdown_connections 2024-09-19T08:53:48.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.403+0000 7ff920f26640 1 --2- 172.21.15.92:0/517317480 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff9040a3240 0x7ff9040a5700 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.403+0000 7ff920f26640 1 --2- 172.21.15.92:0/517317480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff91c106f10 0x7ff91c19a640 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.403+0000 7ff920f26640 1 --2- 172.21.15.92:0/517317480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff91c102790 0x7ff91c1a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.403+0000 7ff920f26640 1 --2- 172.21.15.92:0/517317480 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff91c101de0 0x7ff91c1a0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.403+0000 7ff920f26640 1 -- 172.21.15.92:0/517317480 >> 172.21.15.92:0/517317480 conn(0x7ff91c0fd8c0 msgr2=0x7ff91c0fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:48.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.403+0000 7ff920f26640 1 -- 172.21.15.92:0/517317480 shutdown_connections 2024-09-19T08:53:48.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:48.403+0000 7ff920f26640 1 -- 172.21.15.92:0/517317480 wait complete. 2024-09-19T08:53:49.057 INFO:tasks.cephadm:Adding mds.a on smithi092 2024-09-19T08:53:49.057 INFO:tasks.cephadm:Adding mds.d on smithi092 2024-09-19T08:53:49.058 INFO:tasks.cephadm:Adding mds.g on smithi092 2024-09-19T08:53:49.058 INFO:tasks.cephadm:Adding mds.j on smithi092 2024-09-19T08:53:49.058 INFO:tasks.cephadm:Adding mds.b on smithi167 2024-09-19T08:53:49.058 INFO:tasks.cephadm:Adding mds.e on smithi167 2024-09-19T08:53:49.058 INFO:tasks.cephadm:Adding mds.h on smithi167 2024-09-19T08:53:49.058 INFO:tasks.cephadm:Adding mds.k on smithi167 2024-09-19T08:53:49.059 INFO:tasks.cephadm:Adding mds.c on smithi190 2024-09-19T08:53:49.059 INFO:tasks.cephadm:Adding mds.f on smithi190 2024-09-19T08:53:49.059 INFO:tasks.cephadm:Adding mds.i on smithi190 2024-09-19T08:53:49.059 INFO:tasks.cephadm:Adding mds.l on smithi190 2024-09-19T08:53:49.060 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi167=b;smithi167=e;smithi167=h;smithi167=k;smithi190=c;smithi190=f;smithi190=i;smithi190=l' 2024-09-19T08:53:49.322 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:53:49.373 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:49 smithi190 ceph-mon[35358]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:53:49.373 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:49 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/517317480' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:53:49.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:49 smithi092 ceph-mon[31407]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:53:49.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:49 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/517317480' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:53:49.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:49 smithi167 ceph-mon[35359]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:53:49.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:49 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/517317480' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:53:49.853 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.851+0000 7f5fbbda1640 1 -- 172.21.15.190:0/3363197904 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5fb4100490 msgr2=0x7f5fb41028a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:49.853 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.851+0000 7f5fbbda1640 1 --2- 172.21.15.190:0/3363197904 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5fb4100490 0x7f5fb41028a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0009900 tx=0x7f5fb002a410 comp rx=0 tx=0).stop 2024-09-19T08:53:49.853 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.851+0000 7f5fbbda1640 1 -- 172.21.15.190:0/3363197904 shutdown_connections 2024-09-19T08:53:49.854 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.851+0000 7f5fbbda1640 1 --2- 172.21.15.190:0/3363197904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5fb4105790 0x7f5fb4105c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:49.854 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.851+0000 7f5fbbda1640 1 --2- 172.21.15.190:0/3363197904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fb4102de0 0x7f5fb4105250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:49.854 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.851+0000 7f5fbbda1640 1 --2- 172.21.15.190:0/3363197904 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5fb4100490 0x7f5fb41028a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:49.854 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.851+0000 7f5fbbda1640 1 -- 172.21.15.190:0/3363197904 >> 172.21.15.190:0/3363197904 conn(0x7f5fb40fc2a0 msgr2=0x7f5fb40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:49.854 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.851+0000 7f5fbbda1640 1 -- 172.21.15.190:0/3363197904 shutdown_connections 2024-09-19T08:53:49.854 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.852+0000 7f5fbbda1640 1 -- 172.21.15.190:0/3363197904 wait complete. 2024-09-19T08:53:49.854 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.852+0000 7f5fbbda1640 1 Processor -- start 2024-09-19T08:53:49.854 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.852+0000 7f5fbbda1640 1 -- start start 2024-09-19T08:53:49.854 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.852+0000 7f5fbbda1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fb4100490 0x7f5fb419e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:49.855 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.852+0000 7f5fbbda1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5fb4102de0 0x7f5fb419ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:49.855 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.852+0000 7f5fbbda1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5fb4105790 0x7f5fb41a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:49.855 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.852+0000 7f5fbbda1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb4113ea0 con 0x7f5fb4105790 2024-09-19T08:53:49.855 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.852+0000 7f5fbbda1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb4113d20 con 0x7f5fb4100490 2024-09-19T08:53:49.855 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.852+0000 7f5fbbda1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb4114020 con 0x7f5fb4102de0 2024-09-19T08:53:49.855 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.852+0000 7f5fb933c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5fb4102de0 0x7f5fb419ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:49.855 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.852+0000 7f5fb933c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5fb4102de0 0x7f5fb419ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:38644/0 (socket says 172.21.15.190:38644) 2024-09-19T08:53:49.855 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.852+0000 7f5fb933c640 1 -- 172.21.15.190:0/3408575844 learned_addr learned my addr 172.21.15.190:0/3408575844 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-09-19T08:53:49.855 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.853+0000 7f5fba33e640 1 --2- 172.21.15.190:0/3408575844 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5fb4105790 0x7f5fb41a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:49.855 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.853+0000 7f5fb9b3d640 1 --2- 172.21.15.190:0/3408575844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fb4100490 0x7f5fb419e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:49.855 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.853+0000 7f5fb933c640 1 -- 172.21.15.190:0/3408575844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fb4100490 msgr2=0x7f5fb419e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:49.855 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.853+0000 7f5fb933c640 1 --2- 172.21.15.190:0/3408575844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fb4100490 0x7f5fb419e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:49.856 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.853+0000 7f5fb933c640 1 -- 172.21.15.190:0/3408575844 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5fb4105790 msgr2=0x7f5fb41a5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:49.856 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.853+0000 7f5fb933c640 1 --2- 172.21.15.190:0/3408575844 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5fb4105790 0x7f5fb41a5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:49.856 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.853+0000 7f5fb933c640 1 -- 172.21.15.190:0/3408575844 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fb41a6130 con 0x7f5fb4102de0 2024-09-19T08:53:49.856 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.853+0000 7f5fba33e640 1 --2- 172.21.15.190:0/3408575844 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5fb4105790 0x7f5fb41a5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:53:49.856 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.853+0000 7f5fb933c640 1 --2- 172.21.15.190:0/3408575844 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5fb4102de0 0x7f5fb419ea40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5fa400d770 tx=0x7f5fa400dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:49.856 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.853+0000 7f5faaffd640 1 -- 172.21.15.190:0/3408575844 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4017070 con 0x7f5fb4102de0 2024-09-19T08:53:49.856 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.853+0000 7f5fbbda1640 1 -- 172.21.15.190:0/3408575844 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fb41a6420 con 0x7f5fb4102de0 2024-09-19T08:53:49.856 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.853+0000 7f5faaffd640 1 -- 172.21.15.190:0/3408575844 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5fa4005500 con 0x7f5fb4102de0 2024-09-19T08:53:49.856 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.853+0000 7f5faaffd640 1 -- 172.21.15.190:0/3408575844 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4004e00 con 0x7f5fb4102de0 2024-09-19T08:53:49.856 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.853+0000 7f5fbbda1640 1 -- 172.21.15.190:0/3408575844 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fb41a6910 con 0x7f5fb4102de0 2024-09-19T08:53:49.857 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.854+0000 7f5fbbda1640 1 -- 172.21.15.190:0/3408575844 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fb40fdd90 con 0x7f5fb4102de0 2024-09-19T08:53:49.857 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.855+0000 7f5faaffd640 1 -- 172.21.15.190:0/3408575844 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f5fa4004fa0 con 0x7f5fb4102de0 2024-09-19T08:53:49.857 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.856+0000 7f5faaffd640 1 --2- 172.21.15.190:0/3408575844 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5fa00a3270 0x7f5fa00a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:49.857 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.856+0000 7f5faaffd640 1 -- 172.21.15.190:0/3408575844 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f5fa40cedc0 con 0x7f5fb4102de0 2024-09-19T08:53:49.857 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.856+0000 7f5fb9b3d640 1 --2- 172.21.15.190:0/3408575844 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5fa00a3270 0x7f5fa00a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:49.857 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.856+0000 7f5fb9b3d640 1 --2- 172.21.15.190:0/3408575844 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5fa00a3270 0x7f5fa00a5730 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5fb00314e0 tx=0x7f5fb0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:49.860 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:49.860+0000 7f5faaffd640 1 -- 172.21.15.190:0/3408575844 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5fa409b930 con 0x7f5fb4102de0 2024-09-19T08:53:50.034 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:50.034+0000 7f5fbbda1640 1 -- 172.21.15.190:0/3408575844 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi167=b;smithi167=e;smithi167=h;smithi167=k;smithi190=c;smithi190=f;smithi190=i;smithi190=l", "target": ["mon-mgr", ""]}) -- 0x7f5fb40627f0 con 0x7f5fa00a3270 2024-09-19T08:53:50.040 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:50.041+0000 7f5faaffd640 1 -- 172.21.15.190:0/3408575844 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f5fb40627f0 con 0x7f5fa00a3270 2024-09-19T08:53:50.040 INFO:teuthology.orchestra.run.smithi190.stdout:Scheduled mds.all update... 2024-09-19T08:53:50.042 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:50.043+0000 7f5fbbda1640 1 -- 172.21.15.190:0/3408575844 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5fa00a3270 msgr2=0x7f5fa00a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:50.043 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:50.043+0000 7f5fbbda1640 1 --2- 172.21.15.190:0/3408575844 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5fa00a3270 0x7f5fa00a5730 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5fb00314e0 tx=0x7f5fb0000bc0 comp rx=0 tx=0).stop 2024-09-19T08:53:50.043 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:50.043+0000 7f5fbbda1640 1 -- 172.21.15.190:0/3408575844 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5fb4102de0 msgr2=0x7f5fb419ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:50.043 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:50.043+0000 7f5fbbda1640 1 --2- 172.21.15.190:0/3408575844 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5fb4102de0 0x7f5fb419ea40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5fa400d770 tx=0x7f5fa400dc30 comp rx=0 tx=0).stop 2024-09-19T08:53:50.043 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:50.043+0000 7f5fbbda1640 1 -- 172.21.15.190:0/3408575844 shutdown_connections 2024-09-19T08:53:50.043 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:50.043+0000 7f5fbbda1640 1 --2- 172.21.15.190:0/3408575844 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5fa00a3270 0x7f5fa00a5730 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:50.043 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:50.043+0000 7f5fbbda1640 1 --2- 172.21.15.190:0/3408575844 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5fb4105790 0x7f5fb41a5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:50.043 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:50.043+0000 7f5fbbda1640 1 --2- 172.21.15.190:0/3408575844 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5fb4102de0 0x7f5fb419ea40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:50.043 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:50.043+0000 7f5fbbda1640 1 --2- 172.21.15.190:0/3408575844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fb4100490 0x7f5fb419e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:50.043 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:50.043+0000 7f5fbbda1640 1 -- 172.21.15.190:0/3408575844 >> 172.21.15.190:0/3408575844 conn(0x7f5fb40fc2a0 msgr2=0x7f5fb4103840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:50.043 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:50.043+0000 7f5fbbda1640 1 -- 172.21.15.190:0/3408575844 shutdown_connections 2024-09-19T08:53:50.043 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-19T08:53:50.043+0000 7f5fbbda1640 1 -- 172.21.15.190:0/3408575844 wait complete. 2024-09-19T08:53:50.809 DEBUG:teuthology.orchestra.run.smithi092:mds.a> sudo journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mds.a.service 2024-09-19T08:53:50.813 DEBUG:teuthology.orchestra.run.smithi092:mds.d> sudo journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mds.d.service 2024-09-19T08:53:50.857 DEBUG:teuthology.orchestra.run.smithi092:mds.g> sudo journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mds.g.service 2024-09-19T08:53:50.899 DEBUG:teuthology.orchestra.run.smithi092:mds.j> sudo journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mds.j.service 2024-09-19T08:53:50.942 DEBUG:teuthology.orchestra.run.smithi167:mds.b> sudo journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mds.b.service 2024-09-19T08:53:50.945 DEBUG:teuthology.orchestra.run.smithi167:mds.e> sudo journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mds.e.service 2024-09-19T08:53:50.988 DEBUG:teuthology.orchestra.run.smithi167:mds.h> sudo journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mds.h.service 2024-09-19T08:53:51.032 DEBUG:teuthology.orchestra.run.smithi167:mds.k> sudo journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mds.k.service 2024-09-19T08:53:51.075 DEBUG:teuthology.orchestra.run.smithi190:mds.c> sudo journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mds.c.service 2024-09-19T08:53:51.078 DEBUG:teuthology.orchestra.run.smithi190:mds.f> sudo journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mds.f.service 2024-09-19T08:53:51.122 DEBUG:teuthology.orchestra.run.smithi190:mds.i> sudo journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mds.i.service 2024-09-19T08:53:51.165 DEBUG:teuthology.orchestra.run.smithi190:mds.l> sudo journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mds.l.service 2024-09-19T08:53:51.208 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-19T08:53:51.208 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:53:51.231 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:51 smithi092 ceph-mon[31407]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi167=b;smithi167=e;smithi167=h;smithi167=k;smithi190=c;smithi190=f;smithi190=i;smithi190=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:53:51.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:51 smithi092 ceph-mon[31407]: Saving service mds.all spec with placement smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi167=b;smithi167=e;smithi167=h;smithi167=k;smithi190=c;smithi190=f;smithi190=i;smithi190=l;count:12 2024-09-19T08:53:51.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:51 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:51.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:51 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:53:51.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:51 smithi092 ceph-mon[31407]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:53:51.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:51 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:51.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:51 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:53:51.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:51 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:51.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:51 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:53:51.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:51 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:53:51.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:51 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:51.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:51 smithi092 ceph-mon[31407]: Deploying daemon mds.l on smithi190 2024-09-19T08:53:51.339 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:51 smithi190 ceph-mon[35358]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi167=b;smithi167=e;smithi167=h;smithi167=k;smithi190=c;smithi190=f;smithi190=i;smithi190=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:53:51.340 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:51 smithi190 ceph-mon[35358]: Saving service mds.all spec with placement smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi167=b;smithi167=e;smithi167=h;smithi167=k;smithi190=c;smithi190=f;smithi190=i;smithi190=l;count:12 2024-09-19T08:53:51.340 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:51 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:51.340 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:51 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:53:51.340 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:51 smithi190 ceph-mon[35358]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:53:51.340 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:51 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:51.340 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:51 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:53:51.340 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:51 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:51.340 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:51 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:53:51.340 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:51 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:53:51.341 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:51 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:51.341 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:51 smithi190 ceph-mon[35358]: Deploying daemon mds.l on smithi190 2024-09-19T08:53:51.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:51 smithi167 ceph-mon[35359]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi167=b;smithi167=e;smithi167=h;smithi167=k;smithi190=c;smithi190=f;smithi190=i;smithi190=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:53:51.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:51 smithi167 ceph-mon[35359]: Saving service mds.all spec with placement smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi167=b;smithi167=e;smithi167=h;smithi167=k;smithi190=c;smithi190=f;smithi190=i;smithi190=l;count:12 2024-09-19T08:53:51.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:51 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:51.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:51 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:53:51.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:51 smithi167 ceph-mon[35359]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:53:51.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:51 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:51.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:51 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:53:51.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:51 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:51.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:51 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:53:51.352 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:51 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:53:51.352 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:51 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:51.352 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:51 smithi167 ceph-mon[35359]: Deploying daemon mds.l on smithi190 2024-09-19T08:53:51.450 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:51.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.896+0000 7f45a7249640 1 -- 172.21.15.92:0/1749481139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45a0106f00 msgr2=0x7f45a010ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:51.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.896+0000 7f45a7249640 1 --2- 172.21.15.92:0/1749481139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45a0106f00 0x7f45a010ea80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4598009ca0 tx=0x7f459802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:53:51.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.896+0000 7f45a7249640 1 -- 172.21.15.92:0/1749481139 shutdown_connections 2024-09-19T08:53:51.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.896+0000 7f45a7249640 1 --2- 172.21.15.92:0/1749481139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45a0106f00 0x7f45a010ea80 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:51.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.896+0000 7f45a7249640 1 --2- 172.21.15.92:0/1749481139 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45a0102780 0x7f45a01067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:51.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.896+0000 7f45a7249640 1 --2- 172.21.15.92:0/1749481139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45a0101dd0 0x7f45a01021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:51.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.896+0000 7f45a7249640 1 -- 172.21.15.92:0/1749481139 >> 172.21.15.92:0/1749481139 conn(0x7f45a00fd8b0 msgr2=0x7f45a00ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:51.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.896+0000 7f45a7249640 1 -- 172.21.15.92:0/1749481139 shutdown_connections 2024-09-19T08:53:51.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.896+0000 7f45a7249640 1 -- 172.21.15.92:0/1749481139 wait complete. 2024-09-19T08:53:51.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.897+0000 7f45a7249640 1 Processor -- start 2024-09-19T08:53:51.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.897+0000 7f45a7249640 1 -- start start 2024-09-19T08:53:51.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.897+0000 7f45a7249640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45a0101dd0 0x7f45a0198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:51.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.897+0000 7f45a7249640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45a0102780 0x7f45a0198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:51.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.897+0000 7f45a7249640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45a0106f00 0x7f45a019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:51.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.897+0000 7f45a7249640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f45a0111f60 con 0x7f45a0106f00 2024-09-19T08:53:51.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.897+0000 7f45a7249640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f45a0111de0 con 0x7f45a0102780 2024-09-19T08:53:51.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.897+0000 7f45a7249640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f45a01120e0 con 0x7f45a0101dd0 2024-09-19T08:53:51.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.897+0000 7f45a57e6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45a0106f00 0x7f45a019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:51.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.897+0000 7f45a57e6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45a0106f00 0x7f45a019cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49770/0 (socket says 172.21.15.92:49770) 2024-09-19T08:53:51.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.897+0000 7f45a57e6640 1 -- 172.21.15.92:0/899777303 learned_addr learned my addr 172.21.15.92:0/899777303 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:53:51.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.897+0000 7f459ffff640 1 --2- 172.21.15.92:0/899777303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45a0102780 0x7f45a0198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:51.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.897+0000 7f45a4fe5640 1 --2- 172.21.15.92:0/899777303 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45a0101dd0 0x7f45a0198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:51.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.898+0000 7f45a57e6640 1 -- 172.21.15.92:0/899777303 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45a0101dd0 msgr2=0x7f45a0198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:51.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.898+0000 7f45a57e6640 1 --2- 172.21.15.92:0/899777303 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45a0101dd0 0x7f45a0198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:51.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.898+0000 7f45a57e6640 1 -- 172.21.15.92:0/899777303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45a0102780 msgr2=0x7f45a0198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:51.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.898+0000 7f45a57e6640 1 --2- 172.21.15.92:0/899777303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45a0102780 0x7f45a0198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:51.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.898+0000 7f45a57e6640 1 -- 172.21.15.92:0/899777303 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a019d3f0 con 0x7f45a0106f00 2024-09-19T08:53:51.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.898+0000 7f45a57e6640 1 --2- 172.21.15.92:0/899777303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45a0106f00 0x7f45a019cd10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4598031a20 tx=0x7f4598031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:51.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.898+0000 7f459dffb640 1 -- 172.21.15.92:0/899777303 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4598003c30 con 0x7f45a0106f00 2024-09-19T08:53:51.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.898+0000 7f459dffb640 1 -- 172.21.15.92:0/899777303 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4598003dd0 con 0x7f45a0106f00 2024-09-19T08:53:51.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.898+0000 7f459dffb640 1 -- 172.21.15.92:0/899777303 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459802fc40 con 0x7f45a0106f00 2024-09-19T08:53:51.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.898+0000 7f45a7249640 1 -- 172.21.15.92:0/899777303 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45a019d680 con 0x7f45a0106f00 2024-09-19T08:53:51.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.898+0000 7f45a7249640 1 -- 172.21.15.92:0/899777303 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45a0074420 con 0x7f45a0106f00 2024-09-19T08:53:51.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.899+0000 7f45a7249640 1 -- 172.21.15.92:0/899777303 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45a01032b0 con 0x7f45a0106f00 2024-09-19T08:53:51.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.900+0000 7f459dffb640 1 -- 172.21.15.92:0/899777303 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f4598004050 con 0x7f45a0106f00 2024-09-19T08:53:51.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.901+0000 7f459dffb640 1 --2- 172.21.15.92:0/899777303 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f45900a3240 0x7f45900a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:51.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.901+0000 7f45a4fe5640 1 --2- 172.21.15.92:0/899777303 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f45900a3240 0x7f45900a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:51.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.901+0000 7f459dffb640 1 -- 172.21.15.92:0/899777303 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f45980f05e0 con 0x7f45a0106f00 2024-09-19T08:53:51.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.901+0000 7f45a4fe5640 1 --2- 172.21.15.92:0/899777303 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f45900a3240 0x7f45900a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4594005d00 tx=0x7f459400f820 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:51.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:51.905+0000 7f459dffb640 1 -- 172.21.15.92:0/899777303 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f45980bd950 con 0x7f45a0106f00 2024-09-19T08:53:52.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:52.107+0000 7f45a7249640 1 -- 172.21.15.92:0/899777303 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45a010a0e0 con 0x7f45a0106f00 2024-09-19T08:53:52.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:52.107+0000 7f459dffb640 1 -- 172.21.15.92:0/899777303 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f45980bd250 con 0x7f45a0106f00 2024-09-19T08:53:52.107 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:53:52.107 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":1,"btime":"2024-09-19T08:47:08:161960+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-19T08:53:52.108 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 1 2024-09-19T08:53:52.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:52.109+0000 7f45a7249640 1 -- 172.21.15.92:0/899777303 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f45900a3240 msgr2=0x7f45900a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:52.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:52.109+0000 7f45a7249640 1 --2- 172.21.15.92:0/899777303 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f45900a3240 0x7f45900a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4594005d00 tx=0x7f459400f820 comp rx=0 tx=0).stop 2024-09-19T08:53:52.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:52.109+0000 7f45a7249640 1 -- 172.21.15.92:0/899777303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45a0106f00 msgr2=0x7f45a019cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:52.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:52.109+0000 7f45a7249640 1 --2- 172.21.15.92:0/899777303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45a0106f00 0x7f45a019cd10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4598031a20 tx=0x7f4598031a50 comp rx=0 tx=0).stop 2024-09-19T08:53:52.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:52.109+0000 7f45a7249640 1 -- 172.21.15.92:0/899777303 shutdown_connections 2024-09-19T08:53:52.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:52.109+0000 7f45a7249640 1 --2- 172.21.15.92:0/899777303 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f45900a3240 0x7f45900a5700 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:52.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:52.109+0000 7f45a7249640 1 --2- 172.21.15.92:0/899777303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45a0106f00 0x7f45a019cd10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:52.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:52.109+0000 7f45a7249640 1 --2- 172.21.15.92:0/899777303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45a0102780 0x7f45a0198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:52.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:52.109+0000 7f45a7249640 1 --2- 172.21.15.92:0/899777303 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45a0101dd0 0x7f45a0198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:52.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:52.109+0000 7f45a7249640 1 -- 172.21.15.92:0/899777303 >> 172.21.15.92:0/899777303 conn(0x7f45a00fd8b0 msgr2=0x7f45a00fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:52.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:52.109+0000 7f45a7249640 1 -- 172.21.15.92:0/899777303 shutdown_connections 2024-09-19T08:53:52.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:52.110+0000 7f45a7249640 1 -- 172.21.15.92:0/899777303 wait complete. 2024-09-19T08:53:52.373 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:52 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/899777303' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:53:52.374 INFO:journalctl@ceph.mds.l.smithi190.stdout:Sep 19 08:53:52 smithi190 systemd[1]: Starting Ceph mds.l for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T08:53:52.502 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:52 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/899777303' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:53:52.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:52 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/899777303' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:53:52.751 INFO:journalctl@ceph.mds.l.smithi190.stdout:Sep 19 08:53:52 smithi190 podman[64835]: 2024-09-19 08:53:52.342114487 +0000 UTC m=+0.016094054 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:53:52.751 INFO:journalctl@ceph.mds.l.smithi190.stdout:Sep 19 08:53:52 smithi190 podman[64835]: 2024-09-19 08:53:52.439861806 +0000 UTC m=+0.113841373 container create 61dd0a59312380cb96bae6522ae96754ed8b6c77cc9f79b40bf2fa0f3b36dbc2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-l, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4) 2024-09-19T08:53:52.751 INFO:journalctl@ceph.mds.l.smithi190.stdout:Sep 19 08:53:52 smithi190 podman[64835]: 2024-09-19 08:53:52.659360788 +0000 UTC m=+0.333340354 container init 61dd0a59312380cb96bae6522ae96754ed8b6c77cc9f79b40bf2fa0f3b36dbc2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-l, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:53:52.751 INFO:journalctl@ceph.mds.l.smithi190.stdout:Sep 19 08:53:52 smithi190 podman[64835]: 2024-09-19 08:53:52.662202556 +0000 UTC m=+0.336182123 container start 61dd0a59312380cb96bae6522ae96754ed8b6c77cc9f79b40bf2fa0f3b36dbc2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-19T08:53:52.751 INFO:journalctl@ceph.mds.l.smithi190.stdout:Sep 19 08:53:52 smithi190 ceph-mds[64854]: -- 172.21.15.190:0/576256314 <== mon.1 v2:172.21.15.190:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55aad080d860 con 0x55aad07ea800 2024-09-19T08:53:52.752 INFO:journalctl@ceph.mds.l.smithi190.stdout:Sep 19 08:53:52 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-l[64850]: starting mds.l at 2024-09-19T08:53:52.752 INFO:journalctl@ceph.mds.l.smithi190.stdout:Sep 19 08:53:52 smithi190 bash[64835]: 61dd0a59312380cb96bae6522ae96754ed8b6c77cc9f79b40bf2fa0f3b36dbc2 2024-09-19T08:53:53.123 INFO:journalctl@ceph.mds.l.smithi190.stdout:Sep 19 08:53:52 smithi190 systemd[1]: Started Ceph mds.l for 91ff74f2-7663-11ef-bceb-c7b262605968. 2024-09-19T08:53:53.451 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:53 smithi167 ceph-mon[35359]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:53:53.451 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:53 smithi167 ceph-mon[35359]: mds.? [v2:172.21.15.190:6832/490523332,v1:172.21.15.190:6833/490523332] up:boot 2024-09-19T08:53:53.451 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:53 smithi167 ceph-mon[35359]: fsmap 1 up:standby 2024-09-19T08:53:53.451 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:53 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T08:53:53.451 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:53 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:53.451 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:53 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:53.451 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:53 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:53.452 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:53 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:53:53.452 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:53 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:53:53.452 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:53 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:53.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:53 smithi092 ceph-mon[31407]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:53:53.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:53 smithi092 ceph-mon[31407]: mds.? [v2:172.21.15.190:6832/490523332,v1:172.21.15.190:6833/490523332] up:boot 2024-09-19T08:53:53.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:53 smithi092 ceph-mon[31407]: fsmap 1 up:standby 2024-09-19T08:53:53.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:53 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T08:53:53.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:53 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:53.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:53 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:53.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:53 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:53.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:53 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:53:53.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:53 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:53:53.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:53 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:53.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:53 smithi190 ceph-mon[35358]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:53:53.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:53 smithi190 ceph-mon[35358]: mds.? [v2:172.21.15.190:6832/490523332,v1:172.21.15.190:6833/490523332] up:boot 2024-09-19T08:53:53.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:53 smithi190 ceph-mon[35358]: fsmap 1 up:standby 2024-09-19T08:53:53.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:53 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T08:53:53.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:53 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:53.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:53 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:53.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:53 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:53.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:53 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:53:53.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:53 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:53:53.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:53 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:54.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:54 smithi092 ceph-mon[31407]: Deploying daemon mds.k on smithi167 2024-09-19T08:53:54.505 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:54 smithi167 ceph-mon[35359]: Deploying daemon mds.k on smithi167 2024-09-19T08:53:54.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:54 smithi190 ceph-mon[35358]: Deploying daemon mds.k on smithi167 2024-09-19T08:53:54.758 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:53:54.851 INFO:journalctl@ceph.mds.k.smithi167.stdout:Sep 19 08:53:54 smithi167 systemd[1]: Starting Ceph mds.k for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T08:53:55.013 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:55.172 INFO:journalctl@ceph.mds.k.smithi167.stdout:Sep 19 08:53:54 smithi167 podman[65399]: 2024-09-19 08:53:54.900185732 +0000 UTC m=+0.111448028 container create 4aeda137d778dda4ab1c915393cada579d36812e57e7e5fb5ac408ec7d03d8d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-19T08:53:55.172 INFO:journalctl@ceph.mds.k.smithi167.stdout:Sep 19 08:53:54 smithi167 podman[65399]: 2024-09-19 08:53:54.805348156 +0000 UTC m=+0.016610417 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:53:55.172 INFO:journalctl@ceph.mds.k.smithi167.stdout:Sep 19 08:53:55 smithi167 podman[65399]: 2024-09-19 08:53:55.119164335 +0000 UTC m=+0.330426585 container init 4aeda137d778dda4ab1c915393cada579d36812e57e7e5fb5ac408ec7d03d8d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-k, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-19T08:53:55.173 INFO:journalctl@ceph.mds.k.smithi167.stdout:Sep 19 08:53:55 smithi167 podman[65399]: 2024-09-19 08:53:55.121793065 +0000 UTC m=+0.333055323 container start 4aeda137d778dda4ab1c915393cada579d36812e57e7e5fb5ac408ec7d03d8d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-k, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, ceph=True) 2024-09-19T08:53:55.173 INFO:journalctl@ceph.mds.k.smithi167.stdout:Sep 19 08:53:55 smithi167 ceph-mds[65418]: -- 172.21.15.167:0/923619750 <== mon.2 v2:172.21.15.167:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dc1d2b3860 con 0x55dc1d291400 2024-09-19T08:53:55.173 INFO:journalctl@ceph.mds.k.smithi167.stdout:Sep 19 08:53:55 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-k[65414]: starting mds.k at 2024-09-19T08:53:55.449 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:55 smithi092 ceph-mon[31407]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:53:55.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.449+0000 7f2112322640 1 -- 172.21.15.92:0/4194398757 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f210c1036e0 msgr2=0x7f210c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:55.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.449+0000 7f2112322640 1 --2- 172.21.15.92:0/4194398757 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f210c1036e0 0x7f210c107b90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2100009930 tx=0x7f210002a420 comp rx=0 tx=0).stop 2024-09-19T08:53:55.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.449+0000 7f2112322640 1 -- 172.21.15.92:0/4194398757 shutdown_connections 2024-09-19T08:53:55.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.449+0000 7f2112322640 1 --2- 172.21.15.92:0/4194398757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f210c1082a0 0x7f210c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:55.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.449+0000 7f2112322640 1 --2- 172.21.15.92:0/4194398757 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f210c1036e0 0x7f210c107b90 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:55.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.449+0000 7f2112322640 1 --2- 172.21.15.92:0/4194398757 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f210c102d30 0x7f210c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:55.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.449+0000 7f2112322640 1 -- 172.21.15.92:0/4194398757 >> 172.21.15.92:0/4194398757 conn(0x7f210c0fc7d0 msgr2=0x7f210c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:55.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.449+0000 7f2112322640 1 -- 172.21.15.92:0/4194398757 shutdown_connections 2024-09-19T08:53:55.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.449+0000 7f2112322640 1 -- 172.21.15.92:0/4194398757 wait complete. 2024-09-19T08:53:55.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.450+0000 7f2112322640 1 Processor -- start 2024-09-19T08:53:55.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.450+0000 7f2112322640 1 -- start start 2024-09-19T08:53:55.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.450+0000 7f2112322640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f210c102d30 0x7f210c198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:55.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.450+0000 7f2112322640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f210c1036e0 0x7f210c198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:55.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.450+0000 7f2112322640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f210c1082a0 0x7f210c19cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:55.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.450+0000 7f2112322640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f210c1120c0 con 0x7f210c1036e0 2024-09-19T08:53:55.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.450+0000 7f2112322640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f210c111f40 con 0x7f210c102d30 2024-09-19T08:53:55.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.450+0000 7f2112322640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f210c112240 con 0x7f210c1082a0 2024-09-19T08:53:55.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.450+0000 7f210b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f210c1036e0 0x7f210c198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:55.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.450+0000 7f210b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f210c1036e0 0x7f210c198b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49786/0 (socket says 172.21.15.92:49786) 2024-09-19T08:53:55.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.450+0000 7f210b7fe640 1 -- 172.21.15.92:0/1902183763 learned_addr learned my addr 172.21.15.92:0/1902183763 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:53:55.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.450+0000 7f210bfff640 1 --2- 172.21.15.92:0/1902183763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f210c102d30 0x7f210c198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:55.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.451+0000 7f21108bf640 1 --2- 172.21.15.92:0/1902183763 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f210c1082a0 0x7f210c19cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:55.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.451+0000 7f210b7fe640 1 -- 172.21.15.92:0/1902183763 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f210c1082a0 msgr2=0x7f210c19cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:55.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.451+0000 7f210b7fe640 1 --2- 172.21.15.92:0/1902183763 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f210c1082a0 0x7f210c19cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:55.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.451+0000 7f210b7fe640 1 -- 172.21.15.92:0/1902183763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f210c102d30 msgr2=0x7f210c198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:55.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.451+0000 7f210b7fe640 1 --2- 172.21.15.92:0/1902183763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f210c102d30 0x7f210c198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:55.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.451+0000 7f210b7fe640 1 -- 172.21.15.92:0/1902183763 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f210c19d5f0 con 0x7f210c1036e0 2024-09-19T08:53:55.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.451+0000 7f210b7fe640 1 --2- 172.21.15.92:0/1902183763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f210c1036e0 0x7f210c198b80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2100005940 tx=0x7f21000042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:55.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.451+0000 7f21097fa640 1 -- 172.21.15.92:0/1902183763 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210003f030 con 0x7f210c1036e0 2024-09-19T08:53:55.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.451+0000 7f2112322640 1 -- 172.21.15.92:0/1902183763 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f210c19d880 con 0x7f210c1036e0 2024-09-19T08:53:55.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.451+0000 7f21097fa640 1 -- 172.21.15.92:0/1902183763 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2100003ce0 con 0x7f210c1036e0 2024-09-19T08:53:55.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.451+0000 7f21097fa640 1 -- 172.21.15.92:0/1902183763 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2100035070 con 0x7f210c1036e0 2024-09-19T08:53:55.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.451+0000 7f2112322640 1 -- 172.21.15.92:0/1902183763 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f210c1a51c0 con 0x7f210c1036e0 2024-09-19T08:53:55.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.452+0000 7f2112322640 1 -- 172.21.15.92:0/1902183763 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f210c06a850 con 0x7f210c1036e0 2024-09-19T08:53:55.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.453+0000 7f21097fa640 1 -- 172.21.15.92:0/1902183763 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f2100042030 con 0x7f210c1036e0 2024-09-19T08:53:55.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.454+0000 7f21097fa640 1 --2- 172.21.15.92:0/1902183763 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f20f40a3240 0x7f20f40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:55.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.454+0000 7f210bfff640 1 --2- 172.21.15.92:0/1902183763 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f20f40a3240 0x7f20f40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:55.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.454+0000 7f21097fa640 1 -- 172.21.15.92:0/1902183763 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f21000ef940 con 0x7f210c1036e0 2024-09-19T08:53:55.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.455+0000 7f210bfff640 1 --2- 172.21.15.92:0/1902183763 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f20f40a3240 0x7f20f40a5700 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f20fc009990 tx=0x7f20fc009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:55.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.459+0000 7f21097fa640 1 -- 172.21.15.92:0/1902183763 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f21000bca60 con 0x7f210c1036e0 2024-09-19T08:53:55.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:55 smithi167 ceph-mon[35359]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:53:55.601 INFO:journalctl@ceph.mds.k.smithi167.stdout:Sep 19 08:53:55 smithi167 bash[65399]: 4aeda137d778dda4ab1c915393cada579d36812e57e7e5fb5ac408ec7d03d8d1 2024-09-19T08:53:55.602 INFO:journalctl@ceph.mds.k.smithi167.stdout:Sep 19 08:53:55 smithi167 systemd[1]: Started Ceph mds.k for 91ff74f2-7663-11ef-bceb-c7b262605968. 2024-09-19T08:53:55.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:55 smithi190 ceph-mon[35358]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:53:55.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.676+0000 7f2112322640 1 -- 172.21.15.92:0/1902183763 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f210c10a2b0 con 0x7f210c1036e0 2024-09-19T08:53:55.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.676+0000 7f21097fa640 1 -- 172.21.15.92:0/1902183763 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2260 (secure 0 0 0) 0x7f21000bc360 con 0x7f210c1036e0 2024-09-19T08:53:55.676 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:53:55.676 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":3,"btime":"2024-09-19T08:53:55:165666+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T08:53:55.677 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 3 2024-09-19T08:53:55.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.679+0000 7f2112322640 1 -- 172.21.15.92:0/1902183763 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f20f40a3240 msgr2=0x7f20f40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:55.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.679+0000 7f2112322640 1 --2- 172.21.15.92:0/1902183763 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f20f40a3240 0x7f20f40a5700 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f20fc009990 tx=0x7f20fc009110 comp rx=0 tx=0).stop 2024-09-19T08:53:55.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.679+0000 7f2112322640 1 -- 172.21.15.92:0/1902183763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f210c1036e0 msgr2=0x7f210c198b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:55.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.679+0000 7f2112322640 1 --2- 172.21.15.92:0/1902183763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f210c1036e0 0x7f210c198b80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2100005940 tx=0x7f21000042f0 comp rx=0 tx=0).stop 2024-09-19T08:53:55.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.679+0000 7f2112322640 1 -- 172.21.15.92:0/1902183763 shutdown_connections 2024-09-19T08:53:55.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.679+0000 7f2112322640 1 --2- 172.21.15.92:0/1902183763 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f210c1082a0 0x7f210c19cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:55.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.679+0000 7f2112322640 1 --2- 172.21.15.92:0/1902183763 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f20f40a3240 0x7f20f40a5700 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:55.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.679+0000 7f2112322640 1 --2- 172.21.15.92:0/1902183763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f210c1036e0 0x7f210c198b80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:55.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.679+0000 7f2112322640 1 --2- 172.21.15.92:0/1902183763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f210c102d30 0x7f210c198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:55.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.679+0000 7f2112322640 1 -- 172.21.15.92:0/1902183763 >> 172.21.15.92:0/1902183763 conn(0x7f210c0fc7d0 msgr2=0x7f210c105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:55.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.679+0000 7f2112322640 1 -- 172.21.15.92:0/1902183763 shutdown_connections 2024-09-19T08:53:55.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:55.679+0000 7f2112322640 1 -- 172.21.15.92:0/1902183763 wait complete. 2024-09-19T08:53:56.464 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:56 smithi092 ceph-mon[31407]: mds.? [v2:172.21.15.167:6832/442320499,v1:172.21.15.167:6833/442320499] up:boot 2024-09-19T08:53:56.464 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:56 smithi092 ceph-mon[31407]: fsmap 2 up:standby 2024-09-19T08:53:56.464 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:56 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T08:53:56.464 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:56 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:56.464 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:56 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:56.464 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:56 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:56.464 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:56 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:53:56.465 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:56 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:53:56.465 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:56 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:56.465 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:56 smithi092 ceph-mon[31407]: Deploying daemon mds.j on smithi092 2024-09-19T08:53:56.465 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:56 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1902183763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:53:56.525 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:56 smithi167 ceph-mon[35359]: mds.? [v2:172.21.15.167:6832/442320499,v1:172.21.15.167:6833/442320499] up:boot 2024-09-19T08:53:56.525 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:56 smithi167 ceph-mon[35359]: fsmap 2 up:standby 2024-09-19T08:53:56.525 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:56 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T08:53:56.525 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:56 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:56.525 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:56 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:56.525 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:56 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:56.525 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:56 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:53:56.525 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:56 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:53:56.525 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:56 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:56.525 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:56 smithi167 ceph-mon[35359]: Deploying daemon mds.j on smithi092 2024-09-19T08:53:56.526 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:56 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/1902183763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:53:56.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:56 smithi190 ceph-mon[35358]: mds.? [v2:172.21.15.167:6832/442320499,v1:172.21.15.167:6833/442320499] up:boot 2024-09-19T08:53:56.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:56 smithi190 ceph-mon[35358]: fsmap 2 up:standby 2024-09-19T08:53:56.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:56 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T08:53:56.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:56 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:56.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:56 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:56.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:56 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:56.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:56 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:53:56.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:56 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:53:56.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:56 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:56.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:56 smithi190 ceph-mon[35358]: Deploying daemon mds.j on smithi092 2024-09-19T08:53:56.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:56 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/1902183763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:53:57.386 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:57 smithi092 ceph-mon[31407]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:53:57.478 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:57 smithi167 ceph-mon[35359]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:53:57.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:57 smithi190 ceph-mon[35358]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:53:58.003 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 19 08:53:57 smithi092 systemd[1]: Starting Ceph mds.j for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T08:53:58.341 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 19 08:53:58 smithi092 podman[68476]: 2024-09-19 08:53:57.958033918 +0000 UTC m=+0.016112152 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:53:58.341 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 19 08:53:58 smithi092 podman[68476]: 2024-09-19 08:53:58.089452459 +0000 UTC m=+0.147530680 container create 56c6763329b17a53a944344f427f26b840f425222af23ff44d3e44e24b0d8af6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-j, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:53:58.342 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 19 08:53:58 smithi092 podman[68476]: 2024-09-19 08:53:58.342338691 +0000 UTC m=+0.400416912 container init 56c6763329b17a53a944344f427f26b840f425222af23ff44d3e44e24b0d8af6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-j, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:53:58.493 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:53:58.753 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 19 08:53:58 smithi092 podman[68476]: 2024-09-19 08:53:58.345378104 +0000 UTC m=+0.403456326 container start 56c6763329b17a53a944344f427f26b840f425222af23ff44d3e44e24b0d8af6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-j, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-19T08:53:58.753 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 19 08:53:58 smithi092 ceph-mds[68495]: -- 172.21.15.92:0/4087618667 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563015921860 con 0x5630158ff000 2024-09-19T08:53:58.753 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 19 08:53:58 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-j[68491]: starting mds.j at 2024-09-19T08:53:58.753 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 19 08:53:58 smithi092 bash[68476]: 56c6763329b17a53a944344f427f26b840f425222af23ff44d3e44e24b0d8af6 2024-09-19T08:53:58.753 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 19 08:53:58 smithi092 systemd[1]: Started Ceph mds.j for 91ff74f2-7663-11ef-bceb-c7b262605968. 2024-09-19T08:53:58.757 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:59.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.253+0000 7fa67462c640 1 -- 172.21.15.92:0/3274825627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa66c102ef0 msgr2=0x7fa66c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:59.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.253+0000 7fa67462c640 1 --2- 172.21.15.92:0/3274825627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa66c102ef0 0x7fa66c10da40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa664009ca0 tx=0x7fa66402a950 comp rx=0 tx=0).stop 2024-09-19T08:53:59.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.253+0000 7fa67462c640 1 -- 172.21.15.92:0/3274825627 shutdown_connections 2024-09-19T08:53:59.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.253+0000 7fa67462c640 1 --2- 172.21.15.92:0/3274825627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa66c102ef0 0x7fa66c10da40 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.253+0000 7fa67462c640 1 --2- 172.21.15.92:0/3274825627 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa66c102570 0x7fa66c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.253+0000 7fa67462c640 1 --2- 172.21.15.92:0/3274825627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa66c100e20 0x7fa66c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.253+0000 7fa67462c640 1 -- 172.21.15.92:0/3274825627 >> 172.21.15.92:0/3274825627 conn(0x7fa66c0fc7d0 msgr2=0x7fa66c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:59.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.253+0000 7fa67462c640 1 -- 172.21.15.92:0/3274825627 shutdown_connections 2024-09-19T08:53:59.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.253+0000 7fa67462c640 1 -- 172.21.15.92:0/3274825627 wait complete. 2024-09-19T08:53:59.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.254+0000 7fa67462c640 1 Processor -- start 2024-09-19T08:53:59.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.254+0000 7fa67462c640 1 -- start start 2024-09-19T08:53:59.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.254+0000 7fa67462c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa66c100e20 0x7fa66c1984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:59.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.254+0000 7fa67462c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa66c102570 0x7fa66c198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:59.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.254+0000 7fa67462c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa66c102ef0 0x7fa66c19cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:59.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.254+0000 7fa67462c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa66c110fc0 con 0x7fa66c102570 2024-09-19T08:53:59.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.254+0000 7fa67462c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa66c110e40 con 0x7fa66c100e20 2024-09-19T08:53:59.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.254+0000 7fa67462c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa66c111140 con 0x7fa66c102ef0 2024-09-19T08:53:59.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.254+0000 7fa671bc7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa66c102570 0x7fa66c198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:59.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.255+0000 7fa671bc7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa66c102570 0x7fa66c198a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49818/0 (socket says 172.21.15.92:49818) 2024-09-19T08:53:59.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.255+0000 7fa671bc7640 1 -- 172.21.15.92:0/1514111725 learned_addr learned my addr 172.21.15.92:0/1514111725 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:53:59.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.255+0000 7fa6723c8640 1 --2- 172.21.15.92:0/1514111725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa66c100e20 0x7fa66c1984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:59.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.255+0000 7fa672bc9640 1 --2- 172.21.15.92:0/1514111725 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa66c102ef0 0x7fa66c19cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:59.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.255+0000 7fa671bc7640 1 -- 172.21.15.92:0/1514111725 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa66c102ef0 msgr2=0x7fa66c19cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:59.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.255+0000 7fa671bc7640 1 --2- 172.21.15.92:0/1514111725 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa66c102ef0 0x7fa66c19cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.255+0000 7fa671bc7640 1 -- 172.21.15.92:0/1514111725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa66c100e20 msgr2=0x7fa66c1984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:59.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.255+0000 7fa671bc7640 1 --2- 172.21.15.92:0/1514111725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa66c100e20 0x7fa66c1984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.255+0000 7fa671bc7640 1 -- 172.21.15.92:0/1514111725 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa66c19d4a0 con 0x7fa66c102570 2024-09-19T08:53:59.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.255+0000 7fa671bc7640 1 --2- 172.21.15.92:0/1514111725 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa66c102570 0x7fa66c198a30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa65c00c970 tx=0x7fa65c00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:59.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.255+0000 7fa6637fe640 1 -- 172.21.15.92:0/1514111725 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa65c007bb0 con 0x7fa66c102570 2024-09-19T08:53:59.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.255+0000 7fa67462c640 1 -- 172.21.15.92:0/1514111725 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa66c19d790 con 0x7fa66c102570 2024-09-19T08:53:59.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.255+0000 7fa6637fe640 1 -- 172.21.15.92:0/1514111725 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa65c007d50 con 0x7fa66c102570 2024-09-19T08:53:59.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.255+0000 7fa6637fe640 1 -- 172.21.15.92:0/1514111725 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa65c00f450 con 0x7fa66c102570 2024-09-19T08:53:59.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.255+0000 7fa67462c640 1 -- 172.21.15.92:0/1514111725 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa66c1a5070 con 0x7fa66c102570 2024-09-19T08:53:59.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.256+0000 7fa67462c640 1 -- 172.21.15.92:0/1514111725 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa66c101200 con 0x7fa66c102570 2024-09-19T08:53:59.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.257+0000 7fa6637fe640 1 -- 172.21.15.92:0/1514111725 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fa65c004f40 con 0x7fa66c102570 2024-09-19T08:53:59.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.258+0000 7fa6637fe640 1 --2- 172.21.15.92:0/1514111725 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa6580a3240 0x7fa6580a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:59.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.258+0000 7fa6723c8640 1 --2- 172.21.15.92:0/1514111725 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa6580a3240 0x7fa6580a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:59.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.258+0000 7fa6637fe640 1 -- 172.21.15.92:0/1514111725 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fa65c0cf290 con 0x7fa66c102570 2024-09-19T08:53:59.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.259+0000 7fa6723c8640 1 --2- 172.21.15.92:0/1514111725 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa6580a3240 0x7fa6580a5700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa668009990 tx=0x7fa668009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:59.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.262+0000 7fa6637fe640 1 -- 172.21.15.92:0/1514111725 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa65c014030 con 0x7fa66c102570 2024-09-19T08:53:59.442 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:59 smithi092 ceph-mon[31407]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:53:59.442 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:59 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:59.442 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:59 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:59.442 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:59 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:59.442 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:59 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:53:59.443 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:59 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:53:59.443 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:53:59 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:59.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.474+0000 7fa67462c640 1 -- 172.21.15.92:0/1514111725 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa66c10a0a0 con 0x7fa66c102570 2024-09-19T08:53:59.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.475+0000 7fa6637fe640 1 -- 172.21.15.92:0/1514111725 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3085 (secure 0 0 0) 0x7fa65c09c3b0 con 0x7fa66c102570 2024-09-19T08:53:59.475 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:53:59.475 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":4,"btime":"2024-09-19T08:53:59:301280+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T08:53:59.475 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 4 2024-09-19T08:53:59.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.477+0000 7fa67462c640 1 -- 172.21.15.92:0/1514111725 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa6580a3240 msgr2=0x7fa6580a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:59.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.477+0000 7fa67462c640 1 --2- 172.21.15.92:0/1514111725 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa6580a3240 0x7fa6580a5700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa668009990 tx=0x7fa668009110 comp rx=0 tx=0).stop 2024-09-19T08:53:59.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.477+0000 7fa67462c640 1 -- 172.21.15.92:0/1514111725 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa66c102570 msgr2=0x7fa66c198a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:59.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.477+0000 7fa67462c640 1 --2- 172.21.15.92:0/1514111725 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa66c102570 0x7fa66c198a30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa65c00c970 tx=0x7fa65c00cd70 comp rx=0 tx=0).stop 2024-09-19T08:53:59.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.477+0000 7fa67462c640 1 -- 172.21.15.92:0/1514111725 shutdown_connections 2024-09-19T08:53:59.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.477+0000 7fa67462c640 1 --2- 172.21.15.92:0/1514111725 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa66c102ef0 0x7fa66c19cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.477+0000 7fa67462c640 1 --2- 172.21.15.92:0/1514111725 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa6580a3240 0x7fa6580a5700 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.477+0000 7fa67462c640 1 --2- 172.21.15.92:0/1514111725 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa66c102570 0x7fa66c198a30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.477+0000 7fa67462c640 1 --2- 172.21.15.92:0/1514111725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa66c100e20 0x7fa66c1984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:59.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.477+0000 7fa67462c640 1 -- 172.21.15.92:0/1514111725 >> 172.21.15.92:0/1514111725 conn(0x7fa66c0fc7d0 msgr2=0x7fa66c06a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:59.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.477+0000 7fa67462c640 1 -- 172.21.15.92:0/1514111725 shutdown_connections 2024-09-19T08:53:59.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:53:59.477+0000 7fa67462c640 1 -- 172.21.15.92:0/1514111725 wait complete. 2024-09-19T08:53:59.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:59 smithi167 ceph-mon[35359]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:53:59.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:59 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:59.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:59 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:59.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:59 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:59.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:59 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:53:59.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:59 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:53:59.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:53:59 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:59.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:59 smithi190 ceph-mon[35358]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:53:59.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:59 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:59.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:59 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:59.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:59 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:53:59.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:59 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:53:59.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:59 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:53:59.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:53:59 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:00.425 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:00 smithi092 ceph-mon[31407]: Deploying daemon mds.d on smithi092 2024-09-19T08:54:00.426 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:00 smithi092 ceph-mon[31407]: mds.? [v2:172.21.15.92:6834/3960227551,v1:172.21.15.92:6835/3960227551] up:boot 2024-09-19T08:54:00.426 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:00 smithi092 ceph-mon[31407]: fsmap 3 up:standby 2024-09-19T08:54:00.426 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:00 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T08:54:00.426 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:00 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1514111725' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:00.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:00 smithi167 ceph-mon[35359]: Deploying daemon mds.d on smithi092 2024-09-19T08:54:00.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:00 smithi167 ceph-mon[35359]: mds.? [v2:172.21.15.92:6834/3960227551,v1:172.21.15.92:6835/3960227551] up:boot 2024-09-19T08:54:00.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:00 smithi167 ceph-mon[35359]: fsmap 3 up:standby 2024-09-19T08:54:00.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:00 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T08:54:00.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:00 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/1514111725' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:00.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:00 smithi190 ceph-mon[35358]: Deploying daemon mds.d on smithi092 2024-09-19T08:54:00.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:00 smithi190 ceph-mon[35358]: mds.? [v2:172.21.15.92:6834/3960227551,v1:172.21.15.92:6835/3960227551] up:boot 2024-09-19T08:54:00.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:00 smithi190 ceph-mon[35358]: fsmap 3 up:standby 2024-09-19T08:54:00.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:00 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T08:54:00.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:00 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/1514111725' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:01.446 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:01 smithi092 ceph-mon[31407]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:01.447 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 19 08:54:01 smithi092 podman[68899]: 2024-09-19 08:54:01.424100604 +0000 UTC m=+0.354298889 container start 6d8ec87e57c16d942e0641fa8de0e81914861ef700be68be3cb0fc86cf6074d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-d, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:54:01.447 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 19 08:54:01 smithi092 ceph-mds[68918]: -- 172.21.15.92:0/1350308564 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c800921860 con 0x55c8008fe800 2024-09-19T08:54:01.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:01 smithi167 ceph-mon[35359]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:01.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:01 smithi190 ceph-mon[35358]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:01.752 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 19 08:54:01 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-d[68914]: starting mds.d at 2024-09-19T08:54:01.753 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 19 08:54:01 smithi092 bash[68899]: 6d8ec87e57c16d942e0641fa8de0e81914861ef700be68be3cb0fc86cf6074d8 2024-09-19T08:54:01.753 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 19 08:54:01 smithi092 systemd[1]: Started Ceph mds.d for 91ff74f2-7663-11ef-bceb-c7b262605968. 2024-09-19T08:54:02.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:02 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:02.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:02 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:02.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:02 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:02.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:02 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:54:02.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:02 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:54:02.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:02 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:02.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:02 smithi167 ceph-mon[35359]: Deploying daemon mds.e on smithi167 2024-09-19T08:54:02.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:02 smithi167 ceph-mon[35359]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:02.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:02 smithi167 ceph-mon[35359]: mds.? [v2:172.21.15.92:6836/589903863,v1:172.21.15.92:6837/589903863] up:boot 2024-09-19T08:54:02.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:02 smithi167 ceph-mon[35359]: fsmap 4 up:standby 2024-09-19T08:54:02.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:02 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T08:54:02.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:02 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:02.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:02 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:02.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:02 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:02.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:02 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:54:02.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:02 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:54:02.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:02 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:02.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:02 smithi190 ceph-mon[35358]: Deploying daemon mds.e on smithi167 2024-09-19T08:54:02.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:02 smithi190 ceph-mon[35358]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:02.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:02 smithi190 ceph-mon[35358]: mds.? [v2:172.21.15.92:6836/589903863,v1:172.21.15.92:6837/589903863] up:boot 2024-09-19T08:54:02.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:02 smithi190 ceph-mon[35358]: fsmap 4 up:standby 2024-09-19T08:54:02.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:02 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T08:54:02.979 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:54:03.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:02 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:03.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:02 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:03.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:02 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:03.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:02 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:54:03.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:02 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:54:03.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:02 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:03.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:02 smithi092 ceph-mon[31407]: Deploying daemon mds.e on smithi167 2024-09-19T08:54:03.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:02 smithi092 ceph-mon[31407]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:03.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:02 smithi092 ceph-mon[31407]: mds.? [v2:172.21.15.92:6836/589903863,v1:172.21.15.92:6837/589903863] up:boot 2024-09-19T08:54:03.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:02 smithi092 ceph-mon[31407]: fsmap 4 up:standby 2024-09-19T08:54:03.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:02 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T08:54:03.241 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:03.601 INFO:journalctl@ceph.mds.e.smithi167.stdout:Sep 19 08:54:03 smithi167 systemd[1]: Starting Ceph mds.e for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T08:54:03.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.688+0000 7f564f648640 1 -- 172.21.15.92:0/1265025907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5648103760 msgr2=0x7f5648107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:03.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.688+0000 7f564f648640 1 --2- 172.21.15.92:0/1265025907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5648103760 0x7f5648107ba0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f563c009930 tx=0x7f563c02a420 comp rx=0 tx=0).stop 2024-09-19T08:54:03.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.688+0000 7f564f648640 1 -- 172.21.15.92:0/1265025907 shutdown_connections 2024-09-19T08:54:03.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.688+0000 7f564f648640 1 --2- 172.21.15.92:0/1265025907 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56481082e0 0x7f564810ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:03.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.688+0000 7f564f648640 1 --2- 172.21.15.92:0/1265025907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5648103760 0x7f5648107ba0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:03.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.688+0000 7f564f648640 1 --2- 172.21.15.92:0/1265025907 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5648102db0 0x7f5648103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:03.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.688+0000 7f564f648640 1 -- 172.21.15.92:0/1265025907 >> 172.21.15.92:0/1265025907 conn(0x7f56480fc7d0 msgr2=0x7f56480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:03.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.688+0000 7f564f648640 1 -- 172.21.15.92:0/1265025907 shutdown_connections 2024-09-19T08:54:03.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.688+0000 7f564f648640 1 -- 172.21.15.92:0/1265025907 wait complete. 2024-09-19T08:54:03.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.689+0000 7f564f648640 1 Processor -- start 2024-09-19T08:54:03.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.689+0000 7f564f648640 1 -- start start 2024-09-19T08:54:03.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.689+0000 7f564f648640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5648102db0 0x7f56481985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:03.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.689+0000 7f564f648640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5648103760 0x7f5648198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:03.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.689+0000 7f564f648640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56481082e0 0x7f564819cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:03.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.689+0000 7f564f648640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f56481120d0 con 0x7f5648102db0 2024-09-19T08:54:03.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.689+0000 7f564f648640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5648111f50 con 0x7f5648103760 2024-09-19T08:54:03.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.689+0000 7f564f648640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5648112250 con 0x7f56481082e0 2024-09-19T08:54:03.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.689+0000 7f564d3e4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5648102db0 0x7f56481985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:03.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.689+0000 7f564d3e4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5648102db0 0x7f56481985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59808/0 (socket says 172.21.15.92:59808) 2024-09-19T08:54:03.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.689+0000 7f564d3e4640 1 -- 172.21.15.92:0/1668558667 learned_addr learned my addr 172.21.15.92:0/1668558667 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:54:03.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.689+0000 7f564cbe3640 1 --2- 172.21.15.92:0/1668558667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5648103760 0x7f5648198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:03.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.689+0000 7f564dbe5640 1 --2- 172.21.15.92:0/1668558667 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56481082e0 0x7f564819cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:03.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.689+0000 7f564d3e4640 1 -- 172.21.15.92:0/1668558667 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56481082e0 msgr2=0x7f564819cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:03.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.689+0000 7f564d3e4640 1 --2- 172.21.15.92:0/1668558667 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56481082e0 0x7f564819cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:03.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.689+0000 7f564d3e4640 1 -- 172.21.15.92:0/1668558667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5648103760 msgr2=0x7f5648198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:03.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.689+0000 7f564d3e4640 1 --2- 172.21.15.92:0/1668558667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5648103760 0x7f5648198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:03.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.689+0000 7f564d3e4640 1 -- 172.21.15.92:0/1668558667 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f564819d5a0 con 0x7f5648102db0 2024-09-19T08:54:03.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.689+0000 7f564d3e4640 1 --2- 172.21.15.92:0/1668558667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5648102db0 0x7f56481985f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f563800ba50 tx=0x7f563800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:03.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.690+0000 7f56467fc640 1 -- 172.21.15.92:0/1668558667 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5638019070 con 0x7f5648102db0 2024-09-19T08:54:03.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.690+0000 7f564f648640 1 -- 172.21.15.92:0/1668558667 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f564819d890 con 0x7f5648102db0 2024-09-19T08:54:03.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.690+0000 7f56467fc640 1 -- 172.21.15.92:0/1668558667 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f563800cbe0 con 0x7f5648102db0 2024-09-19T08:54:03.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.690+0000 7f56467fc640 1 -- 172.21.15.92:0/1668558667 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56380076e0 con 0x7f5648102db0 2024-09-19T08:54:03.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.690+0000 7f564f648640 1 -- 172.21.15.92:0/1668558667 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56481a5170 con 0x7f5648102db0 2024-09-19T08:54:03.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.691+0000 7f564f648640 1 -- 172.21.15.92:0/1668558667 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f564806a7d0 con 0x7f5648102db0 2024-09-19T08:54:03.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.692+0000 7f56467fc640 1 -- 172.21.15.92:0/1668558667 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f563801c070 con 0x7f5648102db0 2024-09-19T08:54:03.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.693+0000 7f56467fc640 1 --2- 172.21.15.92:0/1668558667 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f56300a3240 0x7f56300a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:03.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.693+0000 7f564cbe3640 1 --2- 172.21.15.92:0/1668558667 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f56300a3240 0x7f56300a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:03.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.693+0000 7f56467fc640 1 -- 172.21.15.92:0/1668558667 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f56380cefe0 con 0x7f5648102db0 2024-09-19T08:54:03.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.694+0000 7f564cbe3640 1 --2- 172.21.15.92:0/1668558667 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f56300a3240 0x7f56300a5700 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f563c009900 tx=0x7f563c005c00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:03.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.697+0000 7f56467fc640 1 -- 172.21.15.92:0/1668558667 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f563809c180 con 0x7f5648102db0 2024-09-19T08:54:03.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.895+0000 7f564f648640 1 -- 172.21.15.92:0/1668558667 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f564810a320 con 0x7f5648102db0 2024-09-19T08:54:03.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.896+0000 7f56467fc640 1 -- 172.21.15.92:0/1668558667 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3907 (secure 0 0 0) 0x7f563809ba80 con 0x7f5648102db0 2024-09-19T08:54:03.896 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:54:03.896 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":5,"btime":"2024-09-19T08:54:02:312399+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T08:54:03.896 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 5 2024-09-19T08:54:03.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.898+0000 7f564f648640 1 -- 172.21.15.92:0/1668558667 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f56300a3240 msgr2=0x7f56300a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:03.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.898+0000 7f564f648640 1 --2- 172.21.15.92:0/1668558667 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f56300a3240 0x7f56300a5700 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f563c009900 tx=0x7f563c005c00 comp rx=0 tx=0).stop 2024-09-19T08:54:03.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.898+0000 7f564f648640 1 -- 172.21.15.92:0/1668558667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5648102db0 msgr2=0x7f56481985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:03.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.898+0000 7f564f648640 1 --2- 172.21.15.92:0/1668558667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5648102db0 0x7f56481985f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f563800ba50 tx=0x7f563800bf10 comp rx=0 tx=0).stop 2024-09-19T08:54:03.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.898+0000 7f564f648640 1 -- 172.21.15.92:0/1668558667 shutdown_connections 2024-09-19T08:54:03.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.898+0000 7f564f648640 1 --2- 172.21.15.92:0/1668558667 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56481082e0 0x7f564819cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:03.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.898+0000 7f564f648640 1 --2- 172.21.15.92:0/1668558667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5648103760 0x7f5648198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:03.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.898+0000 7f564f648640 1 --2- 172.21.15.92:0/1668558667 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f56300a3240 0x7f56300a5700 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:03.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.898+0000 7f564f648640 1 --2- 172.21.15.92:0/1668558667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5648102db0 0x7f56481985f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:03.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.898+0000 7f564f648640 1 -- 172.21.15.92:0/1668558667 >> 172.21.15.92:0/1668558667 conn(0x7f56480fc7d0 msgr2=0x7f5648106390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:03.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.898+0000 7f564f648640 1 -- 172.21.15.92:0/1668558667 shutdown_connections 2024-09-19T08:54:03.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:03.898+0000 7f564f648640 1 -- 172.21.15.92:0/1668558667 wait complete. 2024-09-19T08:54:03.925 INFO:journalctl@ceph.mds.e.smithi167.stdout:Sep 19 08:54:03 smithi167 podman[65716]: 2024-09-19 08:54:03.560930231 +0000 UTC m=+0.016201005 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:54:03.925 INFO:journalctl@ceph.mds.e.smithi167.stdout:Sep 19 08:54:03 smithi167 podman[65716]: 2024-09-19 08:54:03.670770199 +0000 UTC m=+0.126040964 container create 0d0d2f3efbf2c17b22966ad4badd671adda7e29370b251f46065d4980c83bd0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-e, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T08:54:03.925 INFO:journalctl@ceph.mds.e.smithi167.stdout:Sep 19 08:54:03 smithi167 podman[65716]: 2024-09-19 08:54:03.898546981 +0000 UTC m=+0.353817746 container init 0d0d2f3efbf2c17b22966ad4badd671adda7e29370b251f46065d4980c83bd0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-e, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-19T08:54:03.925 INFO:journalctl@ceph.mds.e.smithi167.stdout:Sep 19 08:54:03 smithi167 podman[65716]: 2024-09-19 08:54:03.90157144 +0000 UTC m=+0.356842209 container start 0d0d2f3efbf2c17b22966ad4badd671adda7e29370b251f46065d4980c83bd0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-e, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-2f599a4) 2024-09-19T08:54:04.210 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:03 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1668558667' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:04.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:03 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/1668558667' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:04.351 INFO:journalctl@ceph.mds.e.smithi167.stdout:Sep 19 08:54:03 smithi167 ceph-mds[65735]: -- 172.21.15.167:0/1743691998 <== mon.2 v2:172.21.15.167:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ae47263860 con 0x55ae47240800 2024-09-19T08:54:04.352 INFO:journalctl@ceph.mds.e.smithi167.stdout:Sep 19 08:54:03 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-e[65731]: starting mds.e at 2024-09-19T08:54:04.352 INFO:journalctl@ceph.mds.e.smithi167.stdout:Sep 19 08:54:03 smithi167 bash[65716]: 0d0d2f3efbf2c17b22966ad4badd671adda7e29370b251f46065d4980c83bd0b 2024-09-19T08:54:04.352 INFO:journalctl@ceph.mds.e.smithi167.stdout:Sep 19 08:54:04 smithi167 systemd[1]: Started Ceph mds.e for 91ff74f2-7663-11ef-bceb-c7b262605968. 2024-09-19T08:54:04.373 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:03 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/1668558667' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:05.123 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:04 smithi190 ceph-mon[35358]: mds.? [v2:172.21.15.167:6834/862511072,v1:172.21.15.167:6835/862511072] up:boot 2024-09-19T08:54:05.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:04 smithi190 ceph-mon[35358]: fsmap 5 up:standby 2024-09-19T08:54:05.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:04 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T08:54:05.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:04 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:05.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:04 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:05.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:04 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:05.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:04 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:54:05.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:04 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:54:05.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:04 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:05.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:04 smithi190 ceph-mon[35358]: Deploying daemon mds.f on smithi190 2024-09-19T08:54:05.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:04 smithi190 ceph-mon[35358]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:05.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:04 smithi092 ceph-mon[31407]: mds.? [v2:172.21.15.167:6834/862511072,v1:172.21.15.167:6835/862511072] up:boot 2024-09-19T08:54:05.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:04 smithi092 ceph-mon[31407]: fsmap 5 up:standby 2024-09-19T08:54:05.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:04 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T08:54:05.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:04 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:05.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:04 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:05.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:04 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:05.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:04 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:54:05.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:04 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:54:05.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:04 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:05.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:04 smithi092 ceph-mon[31407]: Deploying daemon mds.f on smithi190 2024-09-19T08:54:05.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:04 smithi092 ceph-mon[31407]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:05.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:04 smithi167 ceph-mon[35359]: mds.? [v2:172.21.15.167:6834/862511072,v1:172.21.15.167:6835/862511072] up:boot 2024-09-19T08:54:05.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:04 smithi167 ceph-mon[35359]: fsmap 5 up:standby 2024-09-19T08:54:05.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:04 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T08:54:05.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:04 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:05.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:04 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:05.352 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:04 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:05.352 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:04 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:54:05.352 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:04 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:54:05.352 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:04 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:05.352 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:04 smithi167 ceph-mon[35359]: Deploying daemon mds.f on smithi190 2024-09-19T08:54:05.352 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:04 smithi167 ceph-mon[35359]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:06.011 INFO:journalctl@ceph.mds.f.smithi190.stdout:Sep 19 08:54:05 smithi190 systemd[1]: Starting Ceph mds.f for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T08:54:06.327 INFO:journalctl@ceph.mds.f.smithi190.stdout:Sep 19 08:54:06 smithi190 podman[65142]: 2024-09-19 08:54:05.914430072 +0000 UTC m=+0.015591790 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:54:06.327 INFO:journalctl@ceph.mds.f.smithi190.stdout:Sep 19 08:54:06 smithi190 podman[65142]: 2024-09-19 08:54:06.017383655 +0000 UTC m=+0.118545414 container create a942c88427f6def70ba1ba219a3e3c2173048969cc07e972a11e8785dd8792f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-f, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731) 2024-09-19T08:54:06.327 INFO:journalctl@ceph.mds.f.smithi190.stdout:Sep 19 08:54:06 smithi190 podman[65142]: 2024-09-19 08:54:06.227886975 +0000 UTC m=+0.329048693 container init a942c88427f6def70ba1ba219a3e3c2173048969cc07e972a11e8785dd8792f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-f, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-19T08:54:06.327 INFO:journalctl@ceph.mds.f.smithi190.stdout:Sep 19 08:54:06 smithi190 podman[65142]: 2024-09-19 08:54:06.230643255 +0000 UTC m=+0.331804981 container start a942c88427f6def70ba1ba219a3e3c2173048969cc07e972a11e8785dd8792f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-f, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:54:06.327 INFO:journalctl@ceph.mds.f.smithi190.stdout:Sep 19 08:54:06 smithi190 ceph-mds[65161]: -- 172.21.15.190:0/2724068701 <== mon.1 v2:172.21.15.190:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f8e0983860 con 0x55f8e0960800 2024-09-19T08:54:06.327 INFO:journalctl@ceph.mds.f.smithi190.stdout:Sep 19 08:54:06 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-f[65157]: starting mds.f at 2024-09-19T08:54:06.328 INFO:journalctl@ceph.mds.f.smithi190.stdout:Sep 19 08:54:06 smithi190 bash[65142]: a942c88427f6def70ba1ba219a3e3c2173048969cc07e972a11e8785dd8792f5 2024-09-19T08:54:06.615 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:54:06.623 INFO:journalctl@ceph.mds.f.smithi190.stdout:Sep 19 08:54:06 smithi190 systemd[1]: Started Ceph mds.f for 91ff74f2-7663-11ef-bceb-c7b262605968. 2024-09-19T08:54:06.870 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:07.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.307+0000 7f262bd3a640 1 -- 172.21.15.92:0/511493391 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2624101df0 msgr2=0x7f26241021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:07.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.307+0000 7f262bd3a640 1 --2- 172.21.15.92:0/511493391 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2624101df0 0x7f26241021d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2614009ca0 tx=0x7f261402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.307+0000 7f262bd3a640 1 -- 172.21.15.92:0/511493391 shutdown_connections 2024-09-19T08:54:07.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.307+0000 7f262bd3a640 1 --2- 172.21.15.92:0/511493391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2624106f20 0x7f262410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.307+0000 7f262bd3a640 1 --2- 172.21.15.92:0/511493391 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26241027a0 0x7f26241067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.307+0000 7f262bd3a640 1 --2- 172.21.15.92:0/511493391 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2624101df0 0x7f26241021d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.307+0000 7f262bd3a640 1 -- 172.21.15.92:0/511493391 >> 172.21.15.92:0/511493391 conn(0x7f26240fd8f0 msgr2=0x7f26240ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:07.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.307+0000 7f262bd3a640 1 -- 172.21.15.92:0/511493391 shutdown_connections 2024-09-19T08:54:07.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.307+0000 7f262bd3a640 1 -- 172.21.15.92:0/511493391 wait complete. 2024-09-19T08:54:07.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.307+0000 7f262bd3a640 1 Processor -- start 2024-09-19T08:54:07.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.308+0000 7f262bd3a640 1 -- start start 2024-09-19T08:54:07.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.308+0000 7f262bd3a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2624101df0 0x7f26241984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:07.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.308+0000 7f262bd3a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26241027a0 0x7f2624198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:07.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.308+0000 7f262bd3a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2624106f20 0x7f262419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:07.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.308+0000 7f262bd3a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2624111fa0 con 0x7f2624101df0 2024-09-19T08:54:07.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.308+0000 7f262bd3a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2624111e20 con 0x7f2624106f20 2024-09-19T08:54:07.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.308+0000 7f262bd3a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2624112120 con 0x7f26241027a0 2024-09-19T08:54:07.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.308+0000 7f2629ad6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2624101df0 0x7f26241984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:07.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.308+0000 7f2629ad6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2624101df0 0x7f26241984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59822/0 (socket says 172.21.15.92:59822) 2024-09-19T08:54:07.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.308+0000 7f2629ad6640 1 -- 172.21.15.92:0/2090689527 learned_addr learned my addr 172.21.15.92:0/2090689527 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:54:07.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.308+0000 7f26292d5640 1 --2- 172.21.15.92:0/2090689527 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26241027a0 0x7f2624198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:07.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.308+0000 7f2629ad6640 1 -- 172.21.15.92:0/2090689527 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26241027a0 msgr2=0x7f2624198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:07.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.308+0000 7f2629ad6640 1 --2- 172.21.15.92:0/2090689527 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26241027a0 0x7f2624198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.308+0000 7f2629ad6640 1 -- 172.21.15.92:0/2090689527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2624106f20 msgr2=0x7f262419cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:07.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.308+0000 7f262a2d7640 1 --2- 172.21.15.92:0/2090689527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2624106f20 0x7f262419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:07.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.308+0000 7f2629ad6640 1 --2- 172.21.15.92:0/2090689527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2624106f20 0x7f262419cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.308+0000 7f2629ad6640 1 -- 172.21.15.92:0/2090689527 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f262419d480 con 0x7f2624101df0 2024-09-19T08:54:07.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.308+0000 7f2629ad6640 1 --2- 172.21.15.92:0/2090689527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2624101df0 0x7f26241984d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f261402ade0 tx=0x7f26140319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:07.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.309+0000 7f2622ffd640 1 -- 172.21.15.92:0/2090689527 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f261402fa20 con 0x7f2624101df0 2024-09-19T08:54:07.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.309+0000 7f2622ffd640 1 -- 172.21.15.92:0/2090689527 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f261402fbc0 con 0x7f2624101df0 2024-09-19T08:54:07.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.309+0000 7f2622ffd640 1 -- 172.21.15.92:0/2090689527 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26140467b0 con 0x7f2624101df0 2024-09-19T08:54:07.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.309+0000 7f262bd3a640 1 -- 172.21.15.92:0/2090689527 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f262419d710 con 0x7f2624101df0 2024-09-19T08:54:07.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.309+0000 7f262bd3a640 1 -- 172.21.15.92:0/2090689527 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26241a5050 con 0x7f2624101df0 2024-09-19T08:54:07.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.310+0000 7f262bd3a640 1 -- 172.21.15.92:0/2090689527 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26241032d0 con 0x7f2624101df0 2024-09-19T08:54:07.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.311+0000 7f2622ffd640 1 -- 172.21.15.92:0/2090689527 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f261402fd70 con 0x7f2624101df0 2024-09-19T08:54:07.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.312+0000 7f2622ffd640 1 --2- 172.21.15.92:0/2090689527 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f260c0a3240 0x7f260c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:07.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.312+0000 7f26292d5640 1 --2- 172.21.15.92:0/2090689527 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f260c0a3240 0x7f260c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:07.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.312+0000 7f2622ffd640 1 -- 172.21.15.92:0/2090689527 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f26140f0c30 con 0x7f2624101df0 2024-09-19T08:54:07.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.312+0000 7f26292d5640 1 --2- 172.21.15.92:0/2090689527 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f260c0a3240 0x7f260c0a5700 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f26240fdd10 tx=0x7f261800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:07.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.315+0000 7f2622ffd640 1 -- 172.21.15.92:0/2090689527 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f26140bde80 con 0x7f2624101df0 2024-09-19T08:54:07.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.516+0000 7f262bd3a640 1 -- 172.21.15.92:0/2090689527 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f262410a100 con 0x7f2624101df0 2024-09-19T08:54:07.516 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:07 smithi092 ceph-mon[31407]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:07.516 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:07 smithi092 ceph-mon[31407]: mds.? [v2:172.21.15.190:6834/335271561,v1:172.21.15.190:6835/335271561] up:boot 2024-09-19T08:54:07.517 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:07 smithi092 ceph-mon[31407]: fsmap 6 up:standby 2024-09-19T08:54:07.517 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:07 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T08:54:07.517 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:07 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:07.517 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:07 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:07.517 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:07 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:07.517 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:07 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:54:07.517 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:07 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:54:07.517 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:07 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:07.517 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:07 smithi092 ceph-mon[31407]: Deploying daemon mds.c on smithi190 2024-09-19T08:54:07.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.517+0000 7f2622ffd640 1 -- 172.21.15.92:0/2090689527 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5557 (secure 0 0 0) 0x7f26140bd780 con 0x7f2624101df0 2024-09-19T08:54:07.518 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:54:07.518 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":7,"btime":"2024-09-19T08:54:06:309044+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-19T08:54:07.519 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 7 2024-09-19T08:54:07.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.519+0000 7f262bd3a640 1 -- 172.21.15.92:0/2090689527 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f260c0a3240 msgr2=0x7f260c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:07.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.519+0000 7f262bd3a640 1 --2- 172.21.15.92:0/2090689527 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f260c0a3240 0x7f260c0a5700 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f26240fdd10 tx=0x7f261800b410 comp rx=0 tx=0).stop 2024-09-19T08:54:07.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.519+0000 7f262bd3a640 1 -- 172.21.15.92:0/2090689527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2624101df0 msgr2=0x7f26241984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:07.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.519+0000 7f262bd3a640 1 --2- 172.21.15.92:0/2090689527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2624101df0 0x7f26241984d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f261402ade0 tx=0x7f26140319f0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.519+0000 7f262bd3a640 1 -- 172.21.15.92:0/2090689527 shutdown_connections 2024-09-19T08:54:07.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.519+0000 7f262bd3a640 1 --2- 172.21.15.92:0/2090689527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2624106f20 0x7f262419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.519+0000 7f262bd3a640 1 --2- 172.21.15.92:0/2090689527 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26241027a0 0x7f2624198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.519+0000 7f262bd3a640 1 --2- 172.21.15.92:0/2090689527 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f260c0a3240 0x7f260c0a5700 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.519+0000 7f262bd3a640 1 --2- 172.21.15.92:0/2090689527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2624101df0 0x7f26241984d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.519+0000 7f262bd3a640 1 -- 172.21.15.92:0/2090689527 >> 172.21.15.92:0/2090689527 conn(0x7f26240fd8f0 msgr2=0x7f26240fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:07.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.519+0000 7f262bd3a640 1 -- 172.21.15.92:0/2090689527 shutdown_connections 2024-09-19T08:54:07.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:07.519+0000 7f262bd3a640 1 -- 172.21.15.92:0/2090689527 wait complete. 2024-09-19T08:54:07.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:07 smithi167 ceph-mon[35359]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:07.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:07 smithi167 ceph-mon[35359]: mds.? [v2:172.21.15.190:6834/335271561,v1:172.21.15.190:6835/335271561] up:boot 2024-09-19T08:54:07.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:07 smithi167 ceph-mon[35359]: fsmap 6 up:standby 2024-09-19T08:54:07.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:07 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T08:54:07.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:07 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:07.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:07 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:07.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:07 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:07.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:07 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:54:07.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:07 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:54:07.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:07 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:07.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:07 smithi167 ceph-mon[35359]: Deploying daemon mds.c on smithi190 2024-09-19T08:54:07.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:07 smithi190 ceph-mon[35358]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:07.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:07 smithi190 ceph-mon[35358]: mds.? [v2:172.21.15.190:6834/335271561,v1:172.21.15.190:6835/335271561] up:boot 2024-09-19T08:54:07.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:07 smithi190 ceph-mon[35358]: fsmap 6 up:standby 2024-09-19T08:54:07.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:07 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T08:54:07.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:07 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:07.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:07 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:07.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:07 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:07.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:07 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:54:07.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:07 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:54:07.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:07 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:07.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:07 smithi190 ceph-mon[35358]: Deploying daemon mds.c on smithi190 2024-09-19T08:54:08.323 INFO:journalctl@ceph.mds.c.smithi190.stdout:Sep 19 08:54:08 smithi190 systemd[1]: Starting Ceph mds.c for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T08:54:08.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:08 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/2090689527' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:08.612 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:08 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/2090689527' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:08.613 INFO:journalctl@ceph.mds.c.smithi190.stdout:Sep 19 08:54:08 smithi190 podman[65445]: 2024-09-19 08:54:08.269862368 +0000 UTC m=+0.015848599 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:54:08.613 INFO:journalctl@ceph.mds.c.smithi190.stdout:Sep 19 08:54:08 smithi190 podman[65445]: 2024-09-19 08:54:08.377828694 +0000 UTC m=+0.123814912 container create c2e655d2338b6bdfff4e04453156a38b57c38095615d79e24b78297ff0c2f577 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-c, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:54:08.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:08 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/2090689527' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:08.873 INFO:journalctl@ceph.mds.c.smithi190.stdout:Sep 19 08:54:08 smithi190 podman[65445]: 2024-09-19 08:54:08.61341193 +0000 UTC m=+0.359398148 container init c2e655d2338b6bdfff4e04453156a38b57c38095615d79e24b78297ff0c2f577 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:54:08.873 INFO:journalctl@ceph.mds.c.smithi190.stdout:Sep 19 08:54:08 smithi190 podman[65445]: 2024-09-19 08:54:08.616320703 +0000 UTC m=+0.362306924 container start c2e655d2338b6bdfff4e04453156a38b57c38095615d79e24b78297ff0c2f577 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-c, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-19T08:54:08.873 INFO:journalctl@ceph.mds.c.smithi190.stdout:Sep 19 08:54:08 smithi190 ceph-mds[65464]: -- 172.21.15.190:0/1340943207 <== mon.1 v2:172.21.15.190:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56045c9b9860 con 0x56045c997400 2024-09-19T08:54:08.873 INFO:journalctl@ceph.mds.c.smithi190.stdout:Sep 19 08:54:08 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-c[65460]: starting mds.c at 2024-09-19T08:54:08.874 INFO:journalctl@ceph.mds.c.smithi190.stdout:Sep 19 08:54:08 smithi190 bash[65445]: c2e655d2338b6bdfff4e04453156a38b57c38095615d79e24b78297ff0c2f577 2024-09-19T08:54:08.874 INFO:journalctl@ceph.mds.c.smithi190.stdout:Sep 19 08:54:08 smithi190 systemd[1]: Started Ceph mds.c for 91ff74f2-7663-11ef-bceb-c7b262605968. 2024-09-19T08:54:09.551 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:09 smithi167 ceph-mon[35359]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:09.552 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:09 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:09.552 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:09 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:09.552 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:09 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:09.552 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:09 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:54:09.552 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:09 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:54:09.552 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:09 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:09.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:09 smithi190 ceph-mon[35358]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:09.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:09 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:09.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:09 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:09.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:09 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:09.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:09 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:54:09.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:09 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:54:09.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:09 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:09.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:09 smithi092 ceph-mon[31407]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:09.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:09 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:09.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:09 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:09.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:09 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:09.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:09 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:54:09.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:09 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:54:09.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:09 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:10.239 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:54:10.497 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:10.500 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:10 smithi167 ceph-mon[35359]: Deploying daemon mds.h on smithi167 2024-09-19T08:54:10.500 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:10 smithi167 ceph-mon[35359]: mds.? [v2:172.21.15.190:6836/3700975791,v1:172.21.15.190:6837/3700975791] up:boot 2024-09-19T08:54:10.500 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:10 smithi167 ceph-mon[35359]: fsmap 7 up:standby 2024-09-19T08:54:10.500 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:10 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T08:54:10.594 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:10 smithi092 ceph-mon[31407]: Deploying daemon mds.h on smithi167 2024-09-19T08:54:10.595 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:10 smithi092 ceph-mon[31407]: mds.? [v2:172.21.15.190:6836/3700975791,v1:172.21.15.190:6837/3700975791] up:boot 2024-09-19T08:54:10.595 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:10 smithi092 ceph-mon[31407]: fsmap 7 up:standby 2024-09-19T08:54:10.595 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:10 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T08:54:10.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:10 smithi190 ceph-mon[35358]: Deploying daemon mds.h on smithi167 2024-09-19T08:54:10.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:10 smithi190 ceph-mon[35358]: mds.? [v2:172.21.15.190:6836/3700975791,v1:172.21.15.190:6837/3700975791] up:boot 2024-09-19T08:54:10.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:10 smithi190 ceph-mon[35358]: fsmap 7 up:standby 2024-09-19T08:54:10.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:10 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T08:54:10.851 INFO:journalctl@ceph.mds.h.smithi167.stdout:Sep 19 08:54:10 smithi167 systemd[1]: Starting Ceph mds.h for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T08:54:10.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.952+0000 7fcce51ae640 1 -- 172.21.15.92:0/3429765328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcce0106f10 msgr2=0x7fcce010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:10.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.952+0000 7fcce51ae640 1 --2- 172.21.15.92:0/3429765328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcce0106f10 0x7fcce010ea90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fccd8009ca0 tx=0x7fccd802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.952+0000 7fcce51ae640 1 -- 172.21.15.92:0/3429765328 shutdown_connections 2024-09-19T08:54:10.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.952+0000 7fcce51ae640 1 --2- 172.21.15.92:0/3429765328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcce0106f10 0x7fcce010ea90 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.952+0000 7fcce51ae640 1 --2- 172.21.15.92:0/3429765328 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcce0102790 0x7fcce01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.952+0000 7fcce51ae640 1 --2- 172.21.15.92:0/3429765328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcce0101de0 0x7fcce01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.952+0000 7fcce51ae640 1 -- 172.21.15.92:0/3429765328 >> 172.21.15.92:0/3429765328 conn(0x7fcce00fd8c0 msgr2=0x7fcce00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:10.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.952+0000 7fcce51ae640 1 -- 172.21.15.92:0/3429765328 shutdown_connections 2024-09-19T08:54:10.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.952+0000 7fcce51ae640 1 -- 172.21.15.92:0/3429765328 wait complete. 2024-09-19T08:54:10.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.952+0000 7fcce51ae640 1 Processor -- start 2024-09-19T08:54:10.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.953+0000 7fcce51ae640 1 -- start start 2024-09-19T08:54:10.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.953+0000 7fcce51ae640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcce0101de0 0x7fcce01983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:10.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.953+0000 7fcce51ae640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcce0102790 0x7fcce01988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:10.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.953+0000 7fcce51ae640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcce0106f10 0x7fcce019cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:10.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.953+0000 7fcce51ae640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcce0111f70 con 0x7fcce0102790 2024-09-19T08:54:10.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.953+0000 7fcce51ae640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcce0111df0 con 0x7fcce0101de0 2024-09-19T08:54:10.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.953+0000 7fcce51ae640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fcce01120f0 con 0x7fcce0106f10 2024-09-19T08:54:10.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.953+0000 7fccde59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcce0102790 0x7fcce01988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:10.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.953+0000 7fccde59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcce0102790 0x7fcce01988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59838/0 (socket says 172.21.15.92:59838) 2024-09-19T08:54:10.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.953+0000 7fccde59c640 1 -- 172.21.15.92:0/3380137145 learned_addr learned my addr 172.21.15.92:0/3380137145 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:54:10.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.953+0000 7fccded9d640 1 --2- 172.21.15.92:0/3380137145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcce0101de0 0x7fcce01983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:10.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.953+0000 7fccdf59e640 1 --2- 172.21.15.92:0/3380137145 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcce0106f10 0x7fcce019cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:10.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.953+0000 7fccde59c640 1 -- 172.21.15.92:0/3380137145 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcce0106f10 msgr2=0x7fcce019cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:10.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.953+0000 7fccde59c640 1 --2- 172.21.15.92:0/3380137145 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcce0106f10 0x7fcce019cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.953+0000 7fccde59c640 1 -- 172.21.15.92:0/3380137145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcce0101de0 msgr2=0x7fcce01983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:10.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.953+0000 7fccde59c640 1 --2- 172.21.15.92:0/3380137145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcce0101de0 0x7fcce01983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.953+0000 7fccde59c640 1 -- 172.21.15.92:0/3380137145 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcce019d360 con 0x7fcce0102790 2024-09-19T08:54:10.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.953+0000 7fccde59c640 1 --2- 172.21.15.92:0/3380137145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcce0102790 0x7fcce01988f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fccc800c890 tx=0x7fccc800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:10.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.954+0000 7fccd7fff640 1 -- 172.21.15.92:0/3380137145 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc8004220 con 0x7fcce0102790 2024-09-19T08:54:10.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.954+0000 7fcce51ae640 1 -- 172.21.15.92:0/3380137145 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcce019d650 con 0x7fcce0102790 2024-09-19T08:54:10.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.954+0000 7fccd7fff640 1 -- 172.21.15.92:0/3380137145 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fccc80043c0 con 0x7fcce0102790 2024-09-19T08:54:10.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.954+0000 7fccd7fff640 1 -- 172.21.15.92:0/3380137145 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc8004a00 con 0x7fcce0102790 2024-09-19T08:54:10.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.954+0000 7fcce51ae640 1 -- 172.21.15.92:0/3380137145 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcce01a4f30 con 0x7fcce0102790 2024-09-19T08:54:10.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.955+0000 7fcce51ae640 1 -- 172.21.15.92:0/3380137145 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcce01021c0 con 0x7fcce0102790 2024-09-19T08:54:10.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.956+0000 7fccd7fff640 1 -- 172.21.15.92:0/3380137145 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fccc80079b0 con 0x7fcce0102790 2024-09-19T08:54:10.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.956+0000 7fccd7fff640 1 --2- 172.21.15.92:0/3380137145 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcccc0a3240 0x7fcccc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:10.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.957+0000 7fccded9d640 1 --2- 172.21.15.92:0/3380137145 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcccc0a3240 0x7fcccc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:10.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.957+0000 7fccd7fff640 1 -- 172.21.15.92:0/3380137145 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fccc80cf0c0 con 0x7fcce0102790 2024-09-19T08:54:10.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.957+0000 7fccded9d640 1 --2- 172.21.15.92:0/3380137145 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcccc0a3240 0x7fcccc0a5700 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fccd0005d00 tx=0x7fccd000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:10.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:10.961+0000 7fccd7fff640 1 -- 172.21.15.92:0/3380137145 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fccc8014030 con 0x7fcce0102790 2024-09-19T08:54:11.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:11.159+0000 7fcce51ae640 1 -- 172.21.15.92:0/3380137145 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcce010a150 con 0x7fcce0102790 2024-09-19T08:54:11.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:11.159+0000 7fccd7fff640 1 -- 172.21.15.92:0/3380137145 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6385 (secure 0 0 0) 0x7fccc809c280 con 0x7fcce0102790 2024-09-19T08:54:11.159 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:54:11.160 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":8,"btime":"2024-09-19T08:54:09:323757+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-19T08:54:11.160 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 8 2024-09-19T08:54:11.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:11.161+0000 7fcce51ae640 1 -- 172.21.15.92:0/3380137145 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcccc0a3240 msgr2=0x7fcccc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:11.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:11.161+0000 7fcce51ae640 1 --2- 172.21.15.92:0/3380137145 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcccc0a3240 0x7fcccc0a5700 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fccd0005d00 tx=0x7fccd000b410 comp rx=0 tx=0).stop 2024-09-19T08:54:11.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:11.161+0000 7fcce51ae640 1 -- 172.21.15.92:0/3380137145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcce0102790 msgr2=0x7fcce01988f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:11.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:11.161+0000 7fcce51ae640 1 --2- 172.21.15.92:0/3380137145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcce0102790 0x7fcce01988f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fccc800c890 tx=0x7fccc800cd50 comp rx=0 tx=0).stop 2024-09-19T08:54:11.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:11.162+0000 7fcce51ae640 1 -- 172.21.15.92:0/3380137145 shutdown_connections 2024-09-19T08:54:11.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:11.162+0000 7fcce51ae640 1 --2- 172.21.15.92:0/3380137145 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcce0106f10 0x7fcce019cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:11.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:11.162+0000 7fcce51ae640 1 --2- 172.21.15.92:0/3380137145 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcccc0a3240 0x7fcccc0a5700 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:11.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:11.162+0000 7fcce51ae640 1 --2- 172.21.15.92:0/3380137145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcce0102790 0x7fcce01988f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:11.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:11.162+0000 7fcce51ae640 1 --2- 172.21.15.92:0/3380137145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcce0101de0 0x7fcce01983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:11.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:11.162+0000 7fcce51ae640 1 -- 172.21.15.92:0/3380137145 >> 172.21.15.92:0/3380137145 conn(0x7fcce00fd8c0 msgr2=0x7fcce00fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:11.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:11.162+0000 7fcce51ae640 1 -- 172.21.15.92:0/3380137145 shutdown_connections 2024-09-19T08:54:11.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:11.162+0000 7fcce51ae640 1 -- 172.21.15.92:0/3380137145 wait complete. 2024-09-19T08:54:11.193 INFO:journalctl@ceph.mds.h.smithi167.stdout:Sep 19 08:54:10 smithi167 podman[66019]: 2024-09-19 08:54:10.798011924 +0000 UTC m=+0.016116365 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:54:11.193 INFO:journalctl@ceph.mds.h.smithi167.stdout:Sep 19 08:54:10 smithi167 podman[66019]: 2024-09-19 08:54:10.899898957 +0000 UTC m=+0.118003425 container create 3041fd7082a4a5ddf428004253f1bb6842dbbd86aedc831dfa853c67772dd137 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-h, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-2f599a4) 2024-09-19T08:54:11.194 INFO:journalctl@ceph.mds.h.smithi167.stdout:Sep 19 08:54:11 smithi167 podman[66019]: 2024-09-19 08:54:11.102320449 +0000 UTC m=+0.320424874 container init 3041fd7082a4a5ddf428004253f1bb6842dbbd86aedc831dfa853c67772dd137 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-19T08:54:11.194 INFO:journalctl@ceph.mds.h.smithi167.stdout:Sep 19 08:54:11 smithi167 podman[66019]: 2024-09-19 08:54:11.105115274 +0000 UTC m=+0.323219709 container start 3041fd7082a4a5ddf428004253f1bb6842dbbd86aedc831dfa853c67772dd137 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-h, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True) 2024-09-19T08:54:11.194 INFO:journalctl@ceph.mds.h.smithi167.stdout:Sep 19 08:54:11 smithi167 ceph-mds[66038]: -- 172.21.15.167:0/2684595455 <== mon.2 v2:172.21.15.167:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5583df781860 con 0x5583df75f400 2024-09-19T08:54:11.194 INFO:journalctl@ceph.mds.h.smithi167.stdout:Sep 19 08:54:11 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-h[66034]: starting mds.h at 2024-09-19T08:54:11.194 INFO:journalctl@ceph.mds.h.smithi167.stdout:Sep 19 08:54:11 smithi167 bash[66019]: 3041fd7082a4a5ddf428004253f1bb6842dbbd86aedc831dfa853c67772dd137 2024-09-19T08:54:11.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:11 smithi092 ceph-mon[31407]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:11.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:11 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3380137145' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:11.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:11 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:11.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:11 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:11.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:11 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:11.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:11 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:54:11.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:11 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:54:11.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:11 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:11.601 INFO:journalctl@ceph.mds.h.smithi167.stdout:Sep 19 08:54:11 smithi167 systemd[1]: Started Ceph mds.h for 91ff74f2-7663-11ef-bceb-c7b262605968. 2024-09-19T08:54:11.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:11 smithi167 ceph-mon[35359]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:11.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:11 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3380137145' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:11.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:11 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:11.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:11 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:11.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:11 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:11.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:11 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:54:11.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:11 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:54:11.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:11 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:11.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:11 smithi190 ceph-mon[35358]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:11.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:11 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3380137145' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:11.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:11 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:11.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:11 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:11.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:11 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:11.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:11 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:54:11.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:11 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:54:11.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:11 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:12.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:12 smithi167 ceph-mon[35359]: Deploying daemon mds.i on smithi190 2024-09-19T08:54:12.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:12 smithi167 ceph-mon[35359]: mds.? [v2:172.21.15.167:6836/440158756,v1:172.21.15.167:6837/440158756] up:boot 2024-09-19T08:54:12.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:12 smithi167 ceph-mon[35359]: fsmap 8 up:standby 2024-09-19T08:54:12.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:12 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T08:54:12.619 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:12 smithi190 ceph-mon[35358]: Deploying daemon mds.i on smithi190 2024-09-19T08:54:12.619 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:12 smithi190 ceph-mon[35358]: mds.? [v2:172.21.15.167:6836/440158756,v1:172.21.15.167:6837/440158756] up:boot 2024-09-19T08:54:12.619 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:12 smithi190 ceph-mon[35358]: fsmap 8 up:standby 2024-09-19T08:54:12.619 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:12 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T08:54:12.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:12 smithi092 ceph-mon[31407]: Deploying daemon mds.i on smithi190 2024-09-19T08:54:12.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:12 smithi092 ceph-mon[31407]: mds.? [v2:172.21.15.167:6836/440158756,v1:172.21.15.167:6837/440158756] up:boot 2024-09-19T08:54:12.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:12 smithi092 ceph-mon[31407]: fsmap 8 up:standby 2024-09-19T08:54:12.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:12 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T08:54:13.299 INFO:journalctl@ceph.mds.i.smithi190.stdout:Sep 19 08:54:13 smithi190 systemd[1]: Starting Ceph mds.i for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T08:54:13.566 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:13 smithi190 ceph-mon[35358]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:13.566 INFO:journalctl@ceph.mds.i.smithi190.stdout:Sep 19 08:54:13 smithi190 podman[65747]: 2024-09-19 08:54:13.202167579 +0000 UTC m=+0.016212307 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:54:13.566 INFO:journalctl@ceph.mds.i.smithi190.stdout:Sep 19 08:54:13 smithi190 podman[65747]: 2024-09-19 08:54:13.314158013 +0000 UTC m=+0.128202784 container create 258812e0cf31f28730958540a291cf11132f07d644f314d161d4d7d937c22293 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-i, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=) 2024-09-19T08:54:13.567 INFO:journalctl@ceph.mds.i.smithi190.stdout:Sep 19 08:54:13 smithi190 podman[65747]: 2024-09-19 08:54:13.541458273 +0000 UTC m=+0.355503002 container init 258812e0cf31f28730958540a291cf11132f07d644f314d161d4d7d937c22293 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-i, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:54:13.567 INFO:journalctl@ceph.mds.i.smithi190.stdout:Sep 19 08:54:13 smithi190 podman[65747]: 2024-09-19 08:54:13.544123353 +0000 UTC m=+0.358168083 container start 258812e0cf31f28730958540a291cf11132f07d644f314d161d4d7d937c22293 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-i, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T08:54:13.567 INFO:journalctl@ceph.mds.i.smithi190.stdout:Sep 19 08:54:13 smithi190 ceph-mds[65767]: -- 172.21.15.190:0/3387666922 <== mon.1 v2:172.21.15.190:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c99fcff860 con 0x55c99fcdc800 2024-09-19T08:54:13.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:13 smithi167 ceph-mon[35359]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:13.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:13 smithi092 ceph-mon[31407]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:13.873 INFO:journalctl@ceph.mds.i.smithi190.stdout:Sep 19 08:54:13 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-i[65763]: starting mds.i at 2024-09-19T08:54:13.873 INFO:journalctl@ceph.mds.i.smithi190.stdout:Sep 19 08:54:13 smithi190 bash[65747]: 258812e0cf31f28730958540a291cf11132f07d644f314d161d4d7d937c22293 2024-09-19T08:54:13.874 INFO:journalctl@ceph.mds.i.smithi190.stdout:Sep 19 08:54:13 smithi190 systemd[1]: Started Ceph mds.i for 91ff74f2-7663-11ef-bceb-c7b262605968. 2024-09-19T08:54:13.912 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:54:15.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:14 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:15.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:14 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:15.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:14 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:15.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:14 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:54:15.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:14 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:54:15.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:14 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:15.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:14 smithi092 ceph-mon[31407]: Deploying daemon mds.g on smithi092 2024-09-19T08:54:15.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:14 smithi092 ceph-mon[31407]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:15.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:14 smithi092 ceph-mon[31407]: mds.? [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] up:boot 2024-09-19T08:54:15.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:14 smithi092 ceph-mon[31407]: fsmap 9 up:standby 2024-09-19T08:54:15.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:14 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T08:54:15.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:14 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:15.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:14 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:15.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:14 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:15.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:14 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:54:15.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:14 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:54:15.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:14 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:15.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:14 smithi167 ceph-mon[35359]: Deploying daemon mds.g on smithi092 2024-09-19T08:54:15.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:14 smithi167 ceph-mon[35359]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:15.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:14 smithi167 ceph-mon[35359]: mds.? [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] up:boot 2024-09-19T08:54:15.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:14 smithi167 ceph-mon[35359]: fsmap 9 up:standby 2024-09-19T08:54:15.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:14 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T08:54:15.123 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:14 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:15.123 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:14 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:15.123 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:14 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:15.123 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:14 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:54:15.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:14 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:54:15.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:14 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:15.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:14 smithi190 ceph-mon[35358]: Deploying daemon mds.g on smithi092 2024-09-19T08:54:15.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:14 smithi190 ceph-mon[35358]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:15.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:14 smithi190 ceph-mon[35358]: mds.? [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] up:boot 2024-09-19T08:54:15.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:14 smithi190 ceph-mon[35358]: fsmap 9 up:standby 2024-09-19T08:54:15.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:14 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T08:54:15.149 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:15.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.595+0000 7fda7a935640 1 -- 172.21.15.92:0/2227877494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda74103780 msgr2=0x7fda74107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:15.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.595+0000 7fda7a935640 1 --2- 172.21.15.92:0/2227877494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda74103780 0x7fda74107bc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fda68009930 tx=0x7fda6802a420 comp rx=0 tx=0).stop 2024-09-19T08:54:15.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.595+0000 7fda7a935640 1 -- 172.21.15.92:0/2227877494 shutdown_connections 2024-09-19T08:54:15.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.595+0000 7fda7a935640 1 --2- 172.21.15.92:0/2227877494 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda74108300 0x7fda7410ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:15.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.595+0000 7fda7a935640 1 --2- 172.21.15.92:0/2227877494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda74103780 0x7fda74107bc0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:15.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.595+0000 7fda7a935640 1 --2- 172.21.15.92:0/2227877494 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda74102dd0 0x7fda741031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:15.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.595+0000 7fda7a935640 1 -- 172.21.15.92:0/2227877494 >> 172.21.15.92:0/2227877494 conn(0x7fda740fc7d0 msgr2=0x7fda740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:15.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.595+0000 7fda7a935640 1 -- 172.21.15.92:0/2227877494 shutdown_connections 2024-09-19T08:54:15.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.596+0000 7fda7a935640 1 -- 172.21.15.92:0/2227877494 wait complete. 2024-09-19T08:54:15.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.596+0000 7fda7a935640 1 Processor -- start 2024-09-19T08:54:15.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.596+0000 7fda7a935640 1 -- start start 2024-09-19T08:54:15.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.596+0000 7fda7a935640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda74102dd0 0x7fda74100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:15.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.596+0000 7fda7a935640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda74103780 0x7fda74100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:15.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.597+0000 7fda7a935640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda74108300 0x7fda741014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:15.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.597+0000 7fda7a935640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fda74112070 con 0x7fda74102dd0 2024-09-19T08:54:15.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.597+0000 7fda7a935640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fda74111ef0 con 0x7fda74103780 2024-09-19T08:54:15.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.597+0000 7fda7a935640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fda741121f0 con 0x7fda74108300 2024-09-19T08:54:15.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.597+0000 7fda73fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda74102dd0 0x7fda74100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:15.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.597+0000 7fda73fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda74102dd0 0x7fda74100a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52950/0 (socket says 172.21.15.92:52950) 2024-09-19T08:54:15.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.597+0000 7fda73fff640 1 -- 172.21.15.92:0/233817989 learned_addr learned my addr 172.21.15.92:0/233817989 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:54:15.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.597+0000 7fda737fe640 1 --2- 172.21.15.92:0/233817989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda74103780 0x7fda74100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:15.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.597+0000 7fda78ed2640 1 --2- 172.21.15.92:0/233817989 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda74108300 0x7fda741014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:15.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.597+0000 7fda73fff640 1 -- 172.21.15.92:0/233817989 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda74108300 msgr2=0x7fda741014b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:15.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.597+0000 7fda73fff640 1 --2- 172.21.15.92:0/233817989 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda74108300 0x7fda741014b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:15.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.597+0000 7fda73fff640 1 -- 172.21.15.92:0/233817989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda74103780 msgr2=0x7fda74100f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:15.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.597+0000 7fda73fff640 1 --2- 172.21.15.92:0/233817989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda74103780 0x7fda74100f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:15.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.597+0000 7fda73fff640 1 -- 172.21.15.92:0/233817989 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda741a6a90 con 0x7fda74102dd0 2024-09-19T08:54:15.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.597+0000 7fda78ed2640 1 --2- 172.21.15.92:0/233817989 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda74108300 0x7fda741014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:15.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.597+0000 7fda73fff640 1 --2- 172.21.15.92:0/233817989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda74102dd0 0x7fda74100a30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fda6400d770 tx=0x7fda6400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:15.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.597+0000 7fda717fa640 1 -- 172.21.15.92:0/233817989 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda64017070 con 0x7fda74102dd0 2024-09-19T08:54:15.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.598+0000 7fda7a935640 1 -- 172.21.15.92:0/233817989 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda741a6d80 con 0x7fda74102dd0 2024-09-19T08:54:15.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.598+0000 7fda717fa640 1 -- 172.21.15.92:0/233817989 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda64005500 con 0x7fda74102dd0 2024-09-19T08:54:15.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.598+0000 7fda717fa640 1 -- 172.21.15.92:0/233817989 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda64004e00 con 0x7fda74102dd0 2024-09-19T08:54:15.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.598+0000 7fda7a935640 1 -- 172.21.15.92:0/233817989 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda741a7230 con 0x7fda74102dd0 2024-09-19T08:54:15.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.599+0000 7fda7a935640 1 -- 172.21.15.92:0/233817989 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda741031b0 con 0x7fda74102dd0 2024-09-19T08:54:15.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.600+0000 7fda717fa640 1 -- 172.21.15.92:0/233817989 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fda64004fa0 con 0x7fda74102dd0 2024-09-19T08:54:15.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.601+0000 7fda717fa640 1 --2- 172.21.15.92:0/233817989 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fda5c0a3240 0x7fda5c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:15.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.601+0000 7fda737fe640 1 --2- 172.21.15.92:0/233817989 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fda5c0a3240 0x7fda5c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:15.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.601+0000 7fda717fa640 1 -- 172.21.15.92:0/233817989 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fda640cef90 con 0x7fda74102dd0 2024-09-19T08:54:15.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.601+0000 7fda737fe640 1 --2- 172.21.15.92:0/233817989 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fda5c0a3240 0x7fda5c0a5700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fda68005940 tx=0x7fda680058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:15.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.605+0000 7fda717fa640 1 -- 172.21.15.92:0/233817989 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fda6409c0b0 con 0x7fda74102dd0 2024-09-19T08:54:15.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.840+0000 7fda7a935640 1 -- 172.21.15.92:0/233817989 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda7410a290 con 0x7fda74102dd0 2024-09-19T08:54:15.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.841+0000 7fda717fa640 1 -- 172.21.15.92:0/233817989 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8040 (secure 0 0 0) 0x7fda6409b9b0 con 0x7fda74102dd0 2024-09-19T08:54:15.842 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:54:15.842 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":10,"btime":"2024-09-19T08:54:14:349659+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24472,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T08:54:15.842 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 10 2024-09-19T08:54:15.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.843+0000 7fda7a935640 1 -- 172.21.15.92:0/233817989 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fda5c0a3240 msgr2=0x7fda5c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:15.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.843+0000 7fda7a935640 1 --2- 172.21.15.92:0/233817989 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fda5c0a3240 0x7fda5c0a5700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fda68005940 tx=0x7fda680058d0 comp rx=0 tx=0).stop 2024-09-19T08:54:15.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.843+0000 7fda7a935640 1 -- 172.21.15.92:0/233817989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda74102dd0 msgr2=0x7fda74100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:15.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.843+0000 7fda7a935640 1 --2- 172.21.15.92:0/233817989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda74102dd0 0x7fda74100a30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fda6400d770 tx=0x7fda6400dc30 comp rx=0 tx=0).stop 2024-09-19T08:54:15.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.843+0000 7fda7a935640 1 -- 172.21.15.92:0/233817989 shutdown_connections 2024-09-19T08:54:15.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.843+0000 7fda7a935640 1 --2- 172.21.15.92:0/233817989 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda74108300 0x7fda741014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:15.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.843+0000 7fda7a935640 1 --2- 172.21.15.92:0/233817989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda74103780 0x7fda74100f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:15.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.843+0000 7fda7a935640 1 --2- 172.21.15.92:0/233817989 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fda5c0a3240 0x7fda5c0a5700 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:15.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.843+0000 7fda7a935640 1 --2- 172.21.15.92:0/233817989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda74102dd0 0x7fda74100a30 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:15.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.843+0000 7fda7a935640 1 -- 172.21.15.92:0/233817989 >> 172.21.15.92:0/233817989 conn(0x7fda740fc7d0 msgr2=0x7fda74105e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:15.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.843+0000 7fda7a935640 1 -- 172.21.15.92:0/233817989 shutdown_connections 2024-09-19T08:54:15.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:15.843+0000 7fda7a935640 1 -- 172.21.15.92:0/233817989 wait complete. 2024-09-19T08:54:16.080 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:15 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/233817989' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:16.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:15 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/233817989' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:16.373 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:15 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/233817989' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:17.434 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:17 smithi092 ceph-mon[31407]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:17.434 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:17 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:17.434 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:17 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:17.434 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:17 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:17.434 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:17 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:54:17.434 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:17 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:54:17.434 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:17 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:17.434 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:17 smithi092 ceph-mon[31407]: Deploying daemon mds.a on smithi092 2024-09-19T08:54:17.434 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:17 smithi092 ceph-mon[31407]: mds.? [v2:172.21.15.92:6838/4148028188,v1:172.21.15.92:6839/4148028188] up:boot 2024-09-19T08:54:17.434 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:17 smithi092 ceph-mon[31407]: fsmap 10 up:standby 2024-09-19T08:54:17.434 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:17 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T08:54:17.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:17 smithi167 ceph-mon[35359]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:17.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:17 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:17.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:17 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:17.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:17 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:17.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:17 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:54:17.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:17 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:54:17.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:17 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:17.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:17 smithi167 ceph-mon[35359]: Deploying daemon mds.a on smithi092 2024-09-19T08:54:17.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:17 smithi167 ceph-mon[35359]: mds.? [v2:172.21.15.92:6838/4148028188,v1:172.21.15.92:6839/4148028188] up:boot 2024-09-19T08:54:17.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:17 smithi167 ceph-mon[35359]: fsmap 10 up:standby 2024-09-19T08:54:17.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:17 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T08:54:17.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:17 smithi190 ceph-mon[35358]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:17.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:17 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:17.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:17 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:17.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:17 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:17.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:17 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:54:17.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:17 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:54:17.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:17 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:17.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:17 smithi190 ceph-mon[35358]: Deploying daemon mds.a on smithi092 2024-09-19T08:54:17.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:17 smithi190 ceph-mon[35358]: mds.? [v2:172.21.15.92:6838/4148028188,v1:172.21.15.92:6839/4148028188] up:boot 2024-09-19T08:54:17.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:17 smithi190 ceph-mon[35358]: fsmap 10 up:standby 2024-09-19T08:54:17.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:17 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T08:54:18.753 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 19 08:54:18 smithi092 systemd[1]: Starting Ceph mds.a for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T08:54:18.941 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:54:19.100 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 19 08:54:18 smithi092 podman[69963]: 2024-09-19 08:54:18.739445694 +0000 UTC m=+0.015698799 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:54:19.100 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 19 08:54:18 smithi092 podman[69963]: 2024-09-19 08:54:18.864741617 +0000 UTC m=+0.140994723 container create 52d54c5a9c5c3bcb02a30e762d5150ac760f252383746839547fb3f92bbc7d9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-a, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-19T08:54:19.100 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 19 08:54:19 smithi092 podman[69963]: 2024-09-19 08:54:19.100708103 +0000 UTC m=+0.376961208 container init 52d54c5a9c5c3bcb02a30e762d5150ac760f252383746839547fb3f92bbc7d9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-a, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:54:19.283 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:19.404 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:19 smithi092 ceph-mon[31407]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:19.404 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:19 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:19.404 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:19 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:19.404 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:19 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:19.404 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:19 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:54:19.404 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:19 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:54:19.404 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:19 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:19.404 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 19 08:54:19 smithi092 podman[69963]: 2024-09-19 08:54:19.103870318 +0000 UTC m=+0.380123433 container start 52d54c5a9c5c3bcb02a30e762d5150ac760f252383746839547fb3f92bbc7d9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-a, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-19T08:54:19.404 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 19 08:54:19 smithi092 ceph-mds[70000]: -- 172.21.15.92:0/189873105 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56533912b860 con 0x565339109000 2024-09-19T08:54:19.405 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 19 08:54:19 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-a[69996]: starting mds.a at 2024-09-19T08:54:19.405 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 19 08:54:19 smithi092 bash[69963]: 52d54c5a9c5c3bcb02a30e762d5150ac760f252383746839547fb3f92bbc7d9e 2024-09-19T08:54:19.405 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 19 08:54:19 smithi092 systemd[1]: Started Ceph mds.a for 91ff74f2-7663-11ef-bceb-c7b262605968. 2024-09-19T08:54:19.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:19 smithi167 ceph-mon[35359]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:19.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:19 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:19.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:19 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:19.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:19 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:19.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:19 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:54:19.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:19 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:54:19.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:19 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:19.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:19 smithi190 ceph-mon[35358]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:19.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:19 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:19.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:19 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:19.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:19 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:19.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:19 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:54:19.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:19 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:54:19.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:19 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:19.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.719+0000 7facb6acf640 1 -- 172.21.15.92:0/3750580134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facb0106f10 msgr2=0x7facb010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:19.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.719+0000 7facb6acf640 1 --2- 172.21.15.92:0/3750580134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facb0106f10 0x7facb010ea90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faca8009ca0 tx=0x7faca802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.719+0000 7facb6acf640 1 -- 172.21.15.92:0/3750580134 shutdown_connections 2024-09-19T08:54:19.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.719+0000 7facb6acf640 1 --2- 172.21.15.92:0/3750580134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facb0106f10 0x7facb010ea90 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.719+0000 7facb6acf640 1 --2- 172.21.15.92:0/3750580134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facb0102790 0x7facb01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.719+0000 7facb6acf640 1 --2- 172.21.15.92:0/3750580134 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7facb0101de0 0x7facb01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.719+0000 7facb6acf640 1 -- 172.21.15.92:0/3750580134 >> 172.21.15.92:0/3750580134 conn(0x7facb00fd8c0 msgr2=0x7facb00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:19.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.719+0000 7facb6acf640 1 -- 172.21.15.92:0/3750580134 shutdown_connections 2024-09-19T08:54:19.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.719+0000 7facb6acf640 1 -- 172.21.15.92:0/3750580134 wait complete. 2024-09-19T08:54:19.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.720+0000 7facb6acf640 1 Processor -- start 2024-09-19T08:54:19.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.720+0000 7facb6acf640 1 -- start start 2024-09-19T08:54:19.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.720+0000 7facb6acf640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7facb0101de0 0x7facb00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:19.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.720+0000 7facb6acf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facb0102790 0x7facb0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:19.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.720+0000 7facb6acf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facb0106f10 0x7facb0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:19.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.720+0000 7facb6acf640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7facb0111f90 con 0x7facb0106f10 2024-09-19T08:54:19.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.720+0000 7facb6acf640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7facb0111e10 con 0x7facb0102790 2024-09-19T08:54:19.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.720+0000 7facb6acf640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7facb0112110 con 0x7facb0101de0 2024-09-19T08:54:19.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.720+0000 7facb506c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facb0106f10 0x7facb0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:19.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.720+0000 7facb506c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facb0106f10 0x7facb0074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52984/0 (socket says 172.21.15.92:52984) 2024-09-19T08:54:19.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.720+0000 7facb506c640 1 -- 172.21.15.92:0/3177579462 learned_addr learned my addr 172.21.15.92:0/3177579462 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:54:19.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.720+0000 7facaffff640 1 --2- 172.21.15.92:0/3177579462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facb0102790 0x7facb0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:19.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.720+0000 7facb486b640 1 --2- 172.21.15.92:0/3177579462 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7facb0101de0 0x7facb00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:19.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.721+0000 7facb506c640 1 -- 172.21.15.92:0/3177579462 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7facb0101de0 msgr2=0x7facb00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:19.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.721+0000 7facb506c640 1 --2- 172.21.15.92:0/3177579462 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7facb0101de0 0x7facb00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.721+0000 7facb506c640 1 -- 172.21.15.92:0/3177579462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facb0102790 msgr2=0x7facb0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:19.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.721+0000 7facb506c640 1 --2- 172.21.15.92:0/3177579462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facb0102790 0x7facb0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.721+0000 7facb506c640 1 -- 172.21.15.92:0/3177579462 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facb01a6920 con 0x7facb0106f10 2024-09-19T08:54:19.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.721+0000 7facb506c640 1 --2- 172.21.15.92:0/3177579462 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facb0106f10 0x7facb0074f70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7faca8031a60 tx=0x7faca8031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:19.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.721+0000 7facadffb640 1 -- 172.21.15.92:0/3177579462 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca8003c30 con 0x7facb0106f10 2024-09-19T08:54:19.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.721+0000 7facadffb640 1 -- 172.21.15.92:0/3177579462 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faca8003dd0 con 0x7facb0106f10 2024-09-19T08:54:19.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.721+0000 7facb6acf640 1 -- 172.21.15.92:0/3177579462 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facb01a6bb0 con 0x7facb0106f10 2024-09-19T08:54:19.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.721+0000 7facadffb640 1 -- 172.21.15.92:0/3177579462 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca80047e0 con 0x7facb0106f10 2024-09-19T08:54:19.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.721+0000 7facb6acf640 1 -- 172.21.15.92:0/3177579462 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facb01a70f0 con 0x7facb0106f10 2024-09-19T08:54:19.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.722+0000 7facb6acf640 1 -- 172.21.15.92:0/3177579462 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facb01021c0 con 0x7facb0106f10 2024-09-19T08:54:19.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.724+0000 7facadffb640 1 -- 172.21.15.92:0/3177579462 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7faca8004b40 con 0x7facb0106f10 2024-09-19T08:54:19.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.725+0000 7facadffb640 1 --2- 172.21.15.92:0/3177579462 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7faca00a3240 0x7faca00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:19.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.725+0000 7facb486b640 1 --2- 172.21.15.92:0/3177579462 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7faca00a3240 0x7faca00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:19.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.725+0000 7facadffb640 1 -- 172.21.15.92:0/3177579462 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7faca80f0a60 con 0x7facb0106f10 2024-09-19T08:54:19.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.725+0000 7facb486b640 1 --2- 172.21.15.92:0/3177579462 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7faca00a3240 0x7faca00a5700 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faca4009890 tx=0x7faca4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:19.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.728+0000 7facadffb640 1 -- 172.21.15.92:0/3177579462 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faca80bdc20 con 0x7facb0106f10 2024-09-19T08:54:19.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.929+0000 7facb6acf640 1 -- 172.21.15.92:0/3177579462 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7facb010a0f0 con 0x7facb0106f10 2024-09-19T08:54:19.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.929+0000 7facadffb640 1 -- 172.21.15.92:0/3177579462 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9689 (secure 0 0 0) 0x7faca80eee20 con 0x7facb0106f10 2024-09-19T08:54:19.929 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:54:19.929 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":12,"btime":"2024-09-19T08:54:19:327620+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24472,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T08:54:19.930 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 12 2024-09-19T08:54:19.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.931+0000 7facb6acf640 1 -- 172.21.15.92:0/3177579462 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7faca00a3240 msgr2=0x7faca00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:19.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.931+0000 7facb6acf640 1 --2- 172.21.15.92:0/3177579462 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7faca00a3240 0x7faca00a5700 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faca4009890 tx=0x7faca4008040 comp rx=0 tx=0).stop 2024-09-19T08:54:19.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.931+0000 7facb6acf640 1 -- 172.21.15.92:0/3177579462 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facb0106f10 msgr2=0x7facb0074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:19.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.931+0000 7facb6acf640 1 --2- 172.21.15.92:0/3177579462 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facb0106f10 0x7facb0074f70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7faca8031a60 tx=0x7faca8031a90 comp rx=0 tx=0).stop 2024-09-19T08:54:19.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.932+0000 7facb6acf640 1 -- 172.21.15.92:0/3177579462 shutdown_connections 2024-09-19T08:54:19.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.932+0000 7facb6acf640 1 --2- 172.21.15.92:0/3177579462 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7faca00a3240 0x7faca00a5700 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.932+0000 7facb6acf640 1 --2- 172.21.15.92:0/3177579462 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facb0106f10 0x7facb0074f70 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.932+0000 7facb6acf640 1 --2- 172.21.15.92:0/3177579462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facb0102790 0x7facb0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.932+0000 7facb6acf640 1 --2- 172.21.15.92:0/3177579462 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7facb0101de0 0x7facb00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.932+0000 7facb6acf640 1 -- 172.21.15.92:0/3177579462 >> 172.21.15.92:0/3177579462 conn(0x7facb00fd8c0 msgr2=0x7facb00fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:19.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.932+0000 7facb6acf640 1 -- 172.21.15.92:0/3177579462 shutdown_connections 2024-09-19T08:54:19.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:19.932+0000 7facb6acf640 1 -- 172.21.15.92:0/3177579462 wait complete. 2024-09-19T08:54:20.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:20 smithi167 ceph-mon[35359]: Deploying daemon mds.b on smithi167 2024-09-19T08:54:20.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:20 smithi167 ceph-mon[35359]: mds.? [v2:172.21.15.92:6840/265521661,v1:172.21.15.92:6841/265521661] up:boot 2024-09-19T08:54:20.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:20 smithi167 ceph-mon[35359]: fsmap 11 up:standby 2024-09-19T08:54:20.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:20 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T08:54:20.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:20 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3177579462' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:20.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:20 smithi190 ceph-mon[35358]: Deploying daemon mds.b on smithi167 2024-09-19T08:54:20.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:20 smithi190 ceph-mon[35358]: mds.? [v2:172.21.15.92:6840/265521661,v1:172.21.15.92:6841/265521661] up:boot 2024-09-19T08:54:20.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:20 smithi190 ceph-mon[35358]: fsmap 11 up:standby 2024-09-19T08:54:20.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:20 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T08:54:20.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:20 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3177579462' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:20.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:20 smithi092 ceph-mon[31407]: Deploying daemon mds.b on smithi167 2024-09-19T08:54:20.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:20 smithi092 ceph-mon[31407]: mds.? [v2:172.21.15.92:6840/265521661,v1:172.21.15.92:6841/265521661] up:boot 2024-09-19T08:54:20.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:20 smithi092 ceph-mon[31407]: fsmap 11 up:standby 2024-09-19T08:54:20.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:20 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T08:54:20.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:20 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3177579462' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:21.339 INFO:journalctl@ceph.mds.b.smithi167.stdout:Sep 19 08:54:21 smithi167 systemd[1]: Starting Ceph mds.b for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T08:54:21.601 INFO:journalctl@ceph.mds.b.smithi167.stdout:Sep 19 08:54:21 smithi167 podman[66318]: 2024-09-19 08:54:21.322156929 +0000 UTC m=+0.016208155 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:54:21.601 INFO:journalctl@ceph.mds.b.smithi167.stdout:Sep 19 08:54:21 smithi167 podman[66318]: 2024-09-19 08:54:21.445634533 +0000 UTC m=+0.139685749 container create e921df93c25628e2592cfa194226ad1cd8b8c1f576a8cff0bc79c4ca5c1bae25 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T08:54:21.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:21 smithi167 ceph-mon[35359]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:21.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:21 smithi190 ceph-mon[35358]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:21.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:21 smithi092 ceph-mon[31407]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:22.101 INFO:journalctl@ceph.mds.b.smithi167.stdout:Sep 19 08:54:21 smithi167 podman[66318]: 2024-09-19 08:54:21.781848504 +0000 UTC m=+0.475899733 container init e921df93c25628e2592cfa194226ad1cd8b8c1f576a8cff0bc79c4ca5c1bae25 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-19T08:54:22.101 INFO:journalctl@ceph.mds.b.smithi167.stdout:Sep 19 08:54:21 smithi167 podman[66318]: 2024-09-19 08:54:21.784813828 +0000 UTC m=+0.478865045 container start e921df93c25628e2592cfa194226ad1cd8b8c1f576a8cff0bc79c4ca5c1bae25 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-b, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-19T08:54:22.101 INFO:journalctl@ceph.mds.b.smithi167.stdout:Sep 19 08:54:21 smithi167 ceph-mds[66337]: -- 172.21.15.167:0/3310138353 <== mon.2 v2:172.21.15.167:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ccf1511860 con 0x55ccf14ef400 2024-09-19T08:54:22.101 INFO:journalctl@ceph.mds.b.smithi167.stdout:Sep 19 08:54:21 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-b[66333]: starting mds.b at 2024-09-19T08:54:22.101 INFO:journalctl@ceph.mds.b.smithi167.stdout:Sep 19 08:54:21 smithi167 bash[66318]: e921df93c25628e2592cfa194226ad1cd8b8c1f576a8cff0bc79c4ca5c1bae25 2024-09-19T08:54:22.102 INFO:journalctl@ceph.mds.b.smithi167.stdout:Sep 19 08:54:21 smithi167 systemd[1]: Started Ceph mds.b for 91ff74f2-7663-11ef-bceb-c7b262605968. 2024-09-19T08:54:22.578 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:54:23.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:22 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:23.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:22 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:23.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:22 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:23.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:22 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:23.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:22 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:23.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:22 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:54:23.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:22 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:23.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:22 smithi167 ceph-mon[35359]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:23.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:22 smithi167 ceph-mon[35359]: mds.? [v2:172.21.15.167:6838/3540790060,v1:172.21.15.167:6839/3540790060] up:boot 2024-09-19T08:54:23.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:22 smithi167 ceph-mon[35359]: fsmap 12 up:standby 2024-09-19T08:54:23.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:22 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T08:54:23.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:22 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:23.125 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:22 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:23.125 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:22 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:23.125 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:22 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:23.125 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:22 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:23.125 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:22 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:54:23.125 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:22 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:23.125 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:22 smithi190 ceph-mon[35358]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:23.125 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:22 smithi190 ceph-mon[35358]: mds.? [v2:172.21.15.167:6838/3540790060,v1:172.21.15.167:6839/3540790060] up:boot 2024-09-19T08:54:23.125 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:22 smithi190 ceph-mon[35358]: fsmap 12 up:standby 2024-09-19T08:54:23.125 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:22 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T08:54:23.190 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:23.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:22 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:23.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:22 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:23.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:22 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:23.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:22 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:23.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:22 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:23.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:22 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:54:23.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:22 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:23.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:22 smithi092 ceph-mon[31407]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:23.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:22 smithi092 ceph-mon[31407]: mds.? [v2:172.21.15.167:6838/3540790060,v1:172.21.15.167:6839/3540790060] up:boot 2024-09-19T08:54:23.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:22 smithi092 ceph-mon[31407]: fsmap 12 up:standby 2024-09-19T08:54:23.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:22 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T08:54:23.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.695+0000 7fe500448640 1 -- 172.21.15.92:0/1312701638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4f8100a80 msgr2=0x7fe4f8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:23.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.695+0000 7fe500448640 1 --2- 172.21.15.92:0/1312701638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4f8100a80 0x7fe4f8100ee0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4009930 tx=0x7fe4f402a420 comp rx=0 tx=0).stop 2024-09-19T08:54:23.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.695+0000 7fe500448640 1 -- 172.21.15.92:0/1312701638 shutdown_connections 2024-09-19T08:54:23.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.695+0000 7fe500448640 1 --2- 172.21.15.92:0/1312701638 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4f8101420 0x7fe4f810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:23.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.695+0000 7fe500448640 1 --2- 172.21.15.92:0/1312701638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4f8100a80 0x7fe4f8100ee0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:23.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.695+0000 7fe500448640 1 --2- 172.21.15.92:0/1312701638 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4f8106a80 0x7fe4f8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:23.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.695+0000 7fe500448640 1 -- 172.21.15.92:0/1312701638 >> 172.21.15.92:0/1312701638 conn(0x7fe4f80fc7a0 msgr2=0x7fe4f80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:23.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.695+0000 7fe500448640 1 -- 172.21.15.92:0/1312701638 shutdown_connections 2024-09-19T08:54:23.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.695+0000 7fe500448640 1 -- 172.21.15.92:0/1312701638 wait complete. 2024-09-19T08:54:23.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.696+0000 7fe500448640 1 Processor -- start 2024-09-19T08:54:23.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.696+0000 7fe500448640 1 -- start start 2024-09-19T08:54:23.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.696+0000 7fe500448640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4f8100a80 0x7fe4f8197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:23.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.696+0000 7fe500448640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4f8101420 0x7fe4f8197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:23.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.696+0000 7fe500448640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4f8106a80 0x7fe4f819bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:23.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.696+0000 7fe500448640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f8110e80 con 0x7fe4f8101420 2024-09-19T08:54:23.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.696+0000 7fe500448640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f8110d00 con 0x7fe4f8106a80 2024-09-19T08:54:23.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.696+0000 7fe500448640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f8111000 con 0x7fe4f8100a80 2024-09-19T08:54:23.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.696+0000 7fe4fd9e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4f8101420 0x7fe4f8197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:23.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.696+0000 7fe4fd9e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4f8101420 0x7fe4f8197860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49210/0 (socket says 172.21.15.92:49210) 2024-09-19T08:54:23.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.696+0000 7fe4fd9e3640 1 -- 172.21.15.92:0/4071665601 learned_addr learned my addr 172.21.15.92:0/4071665601 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:54:23.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.696+0000 7fe4fe1e4640 1 --2- 172.21.15.92:0/4071665601 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4f8100a80 0x7fe4f8197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:23.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.697+0000 7fe4fe9e5640 1 --2- 172.21.15.92:0/4071665601 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4f8106a80 0x7fe4f819bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:23.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.697+0000 7fe4fd9e3640 1 -- 172.21.15.92:0/4071665601 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4f8100a80 msgr2=0x7fe4f8197320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:23.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.697+0000 7fe4fd9e3640 1 --2- 172.21.15.92:0/4071665601 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4f8100a80 0x7fe4f8197320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:23.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.697+0000 7fe4fd9e3640 1 -- 172.21.15.92:0/4071665601 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4f8106a80 msgr2=0x7fe4f819bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:23.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.697+0000 7fe4fd9e3640 1 --2- 172.21.15.92:0/4071665601 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4f8106a80 0x7fe4f819bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:23.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.697+0000 7fe4fd9e3640 1 -- 172.21.15.92:0/4071665601 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f819c2d0 con 0x7fe4f8101420 2024-09-19T08:54:23.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.697+0000 7fe4fe9e5640 1 --2- 172.21.15.92:0/4071665601 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4f8106a80 0x7fe4f819bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:23.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.697+0000 7fe4fd9e3640 1 --2- 172.21.15.92:0/4071665601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4f8101420 0x7fe4f8197860 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4009230 tx=0x7fe4f4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:23.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.697+0000 7fe4ef7fe640 1 -- 172.21.15.92:0/4071665601 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f403f030 con 0x7fe4f8101420 2024-09-19T08:54:23.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.697+0000 7fe500448640 1 -- 172.21.15.92:0/4071665601 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4f819c560 con 0x7fe4f8101420 2024-09-19T08:54:23.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.697+0000 7fe4ef7fe640 1 -- 172.21.15.92:0/4071665601 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4f4003ad0 con 0x7fe4f8101420 2024-09-19T08:54:23.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.697+0000 7fe4ef7fe640 1 -- 172.21.15.92:0/4071665601 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f4035070 con 0x7fe4f8101420 2024-09-19T08:54:23.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.697+0000 7fe500448640 1 -- 172.21.15.92:0/4071665601 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4f81a3ea0 con 0x7fe4f8101420 2024-09-19T08:54:23.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.698+0000 7fe500448640 1 -- 172.21.15.92:0/4071665601 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4f8100ee0 con 0x7fe4f8101420 2024-09-19T08:54:23.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.699+0000 7fe4ef7fe640 1 -- 172.21.15.92:0/4071665601 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe4f4042030 con 0x7fe4f8101420 2024-09-19T08:54:23.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.700+0000 7fe4ef7fe640 1 --2- 172.21.15.92:0/4071665601 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe4e40a3240 0x7fe4e40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:23.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.700+0000 7fe4fe1e4640 1 --2- 172.21.15.92:0/4071665601 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe4e40a3240 0x7fe4e40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:23.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.700+0000 7fe4ef7fe640 1 -- 172.21.15.92:0/4071665601 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fe4f40eff00 con 0x7fe4f8101420 2024-09-19T08:54:23.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.700+0000 7fe4fe1e4640 1 --2- 172.21.15.92:0/4071665601 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe4e40a3240 0x7fe4e40a5700 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe4e800bb60 tx=0x7fe4e800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:23.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.703+0000 7fe4ef7fe640 1 -- 172.21.15.92:0/4071665601 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe4f40bd0c0 con 0x7fe4f8101420 2024-09-19T08:54:23.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.942+0000 7fe500448640 1 -- 172.21.15.92:0/4071665601 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4f8198680 con 0x7fe4f8101420 2024-09-19T08:54:23.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.943+0000 7fe4ef7fe640 1 -- 172.21.15.92:0/4071665601 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10518 (secure 0 0 0) 0x7fe4f8198680 con 0x7fe4f8101420 2024-09-19T08:54:23.943 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:54:23.943 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":13,"btime":"2024-09-19T08:54:22:339913+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24472,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T08:54:23.943 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 13 2024-09-19T08:54:23.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.946+0000 7fe500448640 1 -- 172.21.15.92:0/4071665601 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe4e40a3240 msgr2=0x7fe4e40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:23.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.946+0000 7fe500448640 1 --2- 172.21.15.92:0/4071665601 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe4e40a3240 0x7fe4e40a5700 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe4e800bb60 tx=0x7fe4e800b390 comp rx=0 tx=0).stop 2024-09-19T08:54:23.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.946+0000 7fe500448640 1 -- 172.21.15.92:0/4071665601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4f8101420 msgr2=0x7fe4f8197860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:23.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.946+0000 7fe500448640 1 --2- 172.21.15.92:0/4071665601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4f8101420 0x7fe4f8197860 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4009230 tx=0x7fe4f4004270 comp rx=0 tx=0).stop 2024-09-19T08:54:23.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.946+0000 7fe500448640 1 -- 172.21.15.92:0/4071665601 shutdown_connections 2024-09-19T08:54:23.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.946+0000 7fe500448640 1 --2- 172.21.15.92:0/4071665601 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4f8106a80 0x7fe4f819bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:23.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.946+0000 7fe500448640 1 --2- 172.21.15.92:0/4071665601 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe4e40a3240 0x7fe4e40a5700 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:23.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.946+0000 7fe500448640 1 --2- 172.21.15.92:0/4071665601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4f8101420 0x7fe4f8197860 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:23.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.946+0000 7fe500448640 1 --2- 172.21.15.92:0/4071665601 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4f8100a80 0x7fe4f8197320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:23.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.946+0000 7fe500448640 1 -- 172.21.15.92:0/4071665601 >> 172.21.15.92:0/4071665601 conn(0x7fe4f80fc7a0 msgr2=0x7fe4f80fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:23.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.946+0000 7fe500448640 1 -- 172.21.15.92:0/4071665601 shutdown_connections 2024-09-19T08:54:23.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:23.946+0000 7fe500448640 1 -- 172.21.15.92:0/4071665601 wait complete. 2024-09-19T08:54:24.556 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-19T08:54:24.816 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:24.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:24 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:24.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:24 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:24.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:24 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:24.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:24 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:24.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:24 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/4071665601' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:24.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:24 smithi167 ceph-mon[35359]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:24.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:24 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:24.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:24 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:24.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:24 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:24.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:24 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:24.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:24 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/4071665601' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:24.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:24 smithi190 ceph-mon[35358]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:24.937 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:24 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:24.937 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:24 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:24.937 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:24 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:24.938 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:24 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:24.938 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:24 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/4071665601' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:24.938 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:24 smithi092 ceph-mon[31407]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:25.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.295+0000 7f44726db640 1 -- 172.21.15.92:0/1223935064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f446c102d40 msgr2=0x7f446c103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:25.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.295+0000 7f44726db640 1 --2- 172.21.15.92:0/1223935064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f446c102d40 0x7f446c103120 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f445c009900 tx=0x7f445c02a480 comp rx=0 tx=0).stop 2024-09-19T08:54:25.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.295+0000 7f44726db640 1 -- 172.21.15.92:0/1223935064 shutdown_connections 2024-09-19T08:54:25.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.295+0000 7f44726db640 1 --2- 172.21.15.92:0/1223935064 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f446c10c170 0x7f446c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:25.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.295+0000 7f44726db640 1 --2- 172.21.15.92:0/1223935064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f446c103660 0x7f446c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:25.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.295+0000 7f44726db640 1 --2- 172.21.15.92:0/1223935064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f446c102d40 0x7f446c103120 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:25.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.295+0000 7f44726db640 1 -- 172.21.15.92:0/1223935064 >> 172.21.15.92:0/1223935064 conn(0x7f446c0fc7a0 msgr2=0x7f446c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:25.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.295+0000 7f44726db640 1 -- 172.21.15.92:0/1223935064 shutdown_connections 2024-09-19T08:54:25.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.295+0000 7f44726db640 1 -- 172.21.15.92:0/1223935064 wait complete. 2024-09-19T08:54:25.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.296+0000 7f44726db640 1 Processor -- start 2024-09-19T08:54:25.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.296+0000 7f44726db640 1 -- start start 2024-09-19T08:54:25.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.296+0000 7f44726db640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f446c102d40 0x7f446c1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:25.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.296+0000 7f44726db640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f446c103660 0x7f446c100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:25.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.296+0000 7f44726db640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f446c10c170 0x7f446c101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:25.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.296+0000 7f44726db640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f446c111fb0 con 0x7f446c10c170 2024-09-19T08:54:25.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.296+0000 7f44726db640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f446c111e30 con 0x7f446c103660 2024-09-19T08:54:25.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.296+0000 7f44726db640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f446c112130 con 0x7f446c102d40 2024-09-19T08:54:25.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.296+0000 7f4470c78640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f446c10c170 0x7f446c101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:25.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.296+0000 7f4470c78640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f446c10c170 0x7f446c101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49232/0 (socket says 172.21.15.92:49232) 2024-09-19T08:54:25.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.296+0000 7f4470c78640 1 -- 172.21.15.92:0/1864677178 learned_addr learned my addr 172.21.15.92:0/1864677178 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:54:25.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.296+0000 7f446b7fe640 1 --2- 172.21.15.92:0/1864677178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f446c103660 0x7f446c100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:25.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.296+0000 7f4470c78640 1 -- 172.21.15.92:0/1864677178 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f446c102d40 msgr2=0x7f446c1009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:25.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.296+0000 7f446bfff640 1 --2- 172.21.15.92:0/1864677178 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f446c102d40 0x7f446c1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:25.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.296+0000 7f4470c78640 1 --2- 172.21.15.92:0/1864677178 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f446c102d40 0x7f446c1009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:25.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.296+0000 7f4470c78640 1 -- 172.21.15.92:0/1864677178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f446c103660 msgr2=0x7f446c100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:25.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.296+0000 7f4470c78640 1 --2- 172.21.15.92:0/1864677178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f446c103660 0x7f446c100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:25.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.296+0000 7f4470c78640 1 -- 172.21.15.92:0/1864677178 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f446c1a6940 con 0x7f446c10c170 2024-09-19T08:54:25.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.296+0000 7f446b7fe640 1 --2- 172.21.15.92:0/1864677178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f446c103660 0x7f446c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:25.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.297+0000 7f4470c78640 1 --2- 172.21.15.92:0/1864677178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f446c10c170 0x7f446c101420 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f446400b970 tx=0x7f446400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:25.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.297+0000 7f44697fa640 1 -- 172.21.15.92:0/1864677178 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4464019070 con 0x7f446c10c170 2024-09-19T08:54:25.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.297+0000 7f44697fa640 1 -- 172.21.15.92:0/1864677178 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f446400cb40 con 0x7f446c10c170 2024-09-19T08:54:25.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.297+0000 7f44726db640 1 -- 172.21.15.92:0/1864677178 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f446c1a6c30 con 0x7f446c10c170 2024-09-19T08:54:25.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.297+0000 7f44697fa640 1 -- 172.21.15.92:0/1864677178 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4464007650 con 0x7f446c10c170 2024-09-19T08:54:25.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.297+0000 7f44726db640 1 -- 172.21.15.92:0/1864677178 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f446c1a7120 con 0x7f446c10c170 2024-09-19T08:54:25.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.298+0000 7f44726db640 1 -- 172.21.15.92:0/1864677178 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f446c103120 con 0x7f446c10c170 2024-09-19T08:54:25.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.299+0000 7f44697fa640 1 -- 172.21.15.92:0/1864677178 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f446401c070 con 0x7f446c10c170 2024-09-19T08:54:25.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.300+0000 7f44697fa640 1 --2- 172.21.15.92:0/1864677178 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f44540a3240 0x7f44540a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:25.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.300+0000 7f446bfff640 1 --2- 172.21.15.92:0/1864677178 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f44540a3240 0x7f44540a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:25.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.300+0000 7f44697fa640 1 -- 172.21.15.92:0/1864677178 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f44640ceba0 con 0x7f446c10c170 2024-09-19T08:54:25.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.300+0000 7f446bfff640 1 --2- 172.21.15.92:0/1864677178 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f44540a3240 0x7f44540a5700 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f445c0096c0 tx=0x7f445c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:25.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.304+0000 7f44697fa640 1 -- 172.21.15.92:0/1864677178 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f446409bcc0 con 0x7f446c10c170 2024-09-19T08:54:25.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.492+0000 7f44726db640 1 -- 172.21.15.92:0/1864677178 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f446c107270 con 0x7f446c10c170 2024-09-19T08:54:25.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.493+0000 7f44697fa640 1 -- 172.21.15.92:0/1864677178 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v75) ==== 84+0+65 (secure 0 0 0) 0x7f446409b5c0 con 0x7f446c10c170 2024-09-19T08:54:25.492 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:54:25.493 INFO:teuthology.orchestra.run.smithi092.stdout:[ 2024-09-19T08:54:25.493 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T08:54:25.493 INFO:teuthology.orchestra.run.smithi092.stdout: "poolnum": 1, 2024-09-19T08:54:25.493 INFO:teuthology.orchestra.run.smithi092.stdout: "poolname": ".mgr" 2024-09-19T08:54:25.493 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:54:25.493 INFO:teuthology.orchestra.run.smithi092.stdout:] 2024-09-19T08:54:25.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.495+0000 7f44726db640 1 -- 172.21.15.92:0/1864677178 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f44540a3240 msgr2=0x7f44540a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:25.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.495+0000 7f44726db640 1 --2- 172.21.15.92:0/1864677178 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f44540a3240 0x7f44540a5700 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f445c0096c0 tx=0x7f445c000bc0 comp rx=0 tx=0).stop 2024-09-19T08:54:25.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.495+0000 7f44726db640 1 -- 172.21.15.92:0/1864677178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f446c10c170 msgr2=0x7f446c101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:25.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.495+0000 7f44726db640 1 --2- 172.21.15.92:0/1864677178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f446c10c170 0x7f446c101420 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f446400b970 tx=0x7f446400be30 comp rx=0 tx=0).stop 2024-09-19T08:54:25.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.495+0000 7f44726db640 1 -- 172.21.15.92:0/1864677178 shutdown_connections 2024-09-19T08:54:25.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.495+0000 7f44726db640 1 --2- 172.21.15.92:0/1864677178 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f44540a3240 0x7f44540a5700 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:25.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.495+0000 7f44726db640 1 --2- 172.21.15.92:0/1864677178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f446c10c170 0x7f446c101420 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:25.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.495+0000 7f44726db640 1 --2- 172.21.15.92:0/1864677178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f446c103660 0x7f446c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:25.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.495+0000 7f44726db640 1 --2- 172.21.15.92:0/1864677178 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f446c102d40 0x7f446c1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:25.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.495+0000 7f44726db640 1 -- 172.21.15.92:0/1864677178 >> 172.21.15.92:0/1864677178 conn(0x7f446c0fc7a0 msgr2=0x7f446c0fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:25.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.495+0000 7f44726db640 1 -- 172.21.15.92:0/1864677178 shutdown_connections 2024-09-19T08:54:25.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:25.495+0000 7f44726db640 1 -- 172.21.15.92:0/1864677178 wait complete. 2024-09-19T08:54:25.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:25 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:25.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:25 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:25.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:25 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:25.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:25 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:54:25.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:25 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:25.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:25 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:54:25.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:25 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1864677178' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T08:54:26.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:25 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:26.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:25 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:26.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:25 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:26.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:25 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:54:26.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:25 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:26.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:25 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:54:26.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:25 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/1864677178' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T08:54:26.123 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:25 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:26.123 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:25 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:26.123 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:25 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:26.123 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:25 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:54:26.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:25 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:26.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:25 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:54:26.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:25 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/1864677178' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T08:54:26.852 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T08:54:26.852 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T08:54:27.116 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:27.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:27 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:27.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:27 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:27.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:27 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:27.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:27 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:27.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:27 smithi092 ceph-mon[31407]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:27.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:27 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:27.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:27 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:27.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:27 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:27.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:27 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:27.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:27 smithi167 ceph-mon[35359]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:27.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.596+0000 7f4355e4e640 1 -- 172.21.15.92:0/3119813759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4350101de0 msgr2=0x7f43501021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:27.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.596+0000 7f4355e4e640 1 --2- 172.21.15.92:0/3119813759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4350101de0 0x7f43501021c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4340009900 tx=0x7f434002a410 comp rx=0 tx=0).stop 2024-09-19T08:54:27.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.596+0000 7f4355e4e640 1 -- 172.21.15.92:0/3119813759 shutdown_connections 2024-09-19T08:54:27.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.596+0000 7f4355e4e640 1 --2- 172.21.15.92:0/3119813759 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4350106f10 0x7f435010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:27.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.596+0000 7f4355e4e640 1 --2- 172.21.15.92:0/3119813759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4350102790 0x7f43501067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:27.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.596+0000 7f4355e4e640 1 --2- 172.21.15.92:0/3119813759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4350101de0 0x7f43501021c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:27.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.596+0000 7f4355e4e640 1 -- 172.21.15.92:0/3119813759 >> 172.21.15.92:0/3119813759 conn(0x7f43500fd8c0 msgr2=0x7f43500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:27.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.596+0000 7f4355e4e640 1 -- 172.21.15.92:0/3119813759 shutdown_connections 2024-09-19T08:54:27.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.596+0000 7f4355e4e640 1 -- 172.21.15.92:0/3119813759 wait complete. 2024-09-19T08:54:27.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.597+0000 7f4355e4e640 1 Processor -- start 2024-09-19T08:54:27.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.597+0000 7f4355e4e640 1 -- start start 2024-09-19T08:54:27.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.597+0000 7f4355e4e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4350101de0 0x7f43501983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:27.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.597+0000 7f4355e4e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4350102790 0x7f4350198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:27.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.597+0000 7f4355e4e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4350106f10 0x7f435019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:27.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.597+0000 7f4355e4e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4350111f70 con 0x7f4350101de0 2024-09-19T08:54:27.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.597+0000 7f4355e4e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4350111df0 con 0x7f4350106f10 2024-09-19T08:54:27.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.597+0000 7f4355e4e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f43501120f0 con 0x7f4350102790 2024-09-19T08:54:27.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.597+0000 7f434f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4350101de0 0x7f43501983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:27.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.597+0000 7f434f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4350101de0 0x7f43501983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49252/0 (socket says 172.21.15.92:49252) 2024-09-19T08:54:27.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.597+0000 7f434f7fe640 1 -- 172.21.15.92:0/2359288448 learned_addr learned my addr 172.21.15.92:0/2359288448 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:54:27.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.597+0000 7f434effd640 1 --2- 172.21.15.92:0/2359288448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4350102790 0x7f4350198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:27.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.597+0000 7f434ffff640 1 --2- 172.21.15.92:0/2359288448 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4350106f10 0x7f435019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:27.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.597+0000 7f434f7fe640 1 -- 172.21.15.92:0/2359288448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4350102790 msgr2=0x7f4350198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:27.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.597+0000 7f434f7fe640 1 --2- 172.21.15.92:0/2359288448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4350102790 0x7f4350198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:27.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.597+0000 7f434f7fe640 1 -- 172.21.15.92:0/2359288448 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4350106f10 msgr2=0x7f435019cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:27.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.597+0000 7f434f7fe640 1 --2- 172.21.15.92:0/2359288448 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4350106f10 0x7f435019cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:27.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.597+0000 7f434f7fe640 1 -- 172.21.15.92:0/2359288448 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f435019d380 con 0x7f4350101de0 2024-09-19T08:54:27.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.598+0000 7f434f7fe640 1 --2- 172.21.15.92:0/2359288448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4350101de0 0x7f43501983d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4340005ab0 tx=0x7f43400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:27.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.598+0000 7f434cff9640 1 -- 172.21.15.92:0/2359288448 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434003f030 con 0x7f4350101de0 2024-09-19T08:54:27.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.598+0000 7f434cff9640 1 -- 172.21.15.92:0/2359288448 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4340003ce0 con 0x7f4350101de0 2024-09-19T08:54:27.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.598+0000 7f4355e4e640 1 -- 172.21.15.92:0/2359288448 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f435019d610 con 0x7f4350101de0 2024-09-19T08:54:27.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.598+0000 7f434cff9640 1 -- 172.21.15.92:0/2359288448 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4340035070 con 0x7f4350101de0 2024-09-19T08:54:27.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.598+0000 7f4355e4e640 1 -- 172.21.15.92:0/2359288448 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43501a4f50 con 0x7f4350101de0 2024-09-19T08:54:27.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.599+0000 7f4355e4e640 1 -- 172.21.15.92:0/2359288448 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43501021c0 con 0x7f4350101de0 2024-09-19T08:54:27.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.600+0000 7f434cff9640 1 -- 172.21.15.92:0/2359288448 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f4340042030 con 0x7f4350101de0 2024-09-19T08:54:27.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.601+0000 7f434cff9640 1 --2- 172.21.15.92:0/2359288448 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f43380a32c0 0x7f43380a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:27.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.601+0000 7f434effd640 1 --2- 172.21.15.92:0/2359288448 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f43380a32c0 0x7f43380a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:27.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.601+0000 7f434cff9640 1 -- 172.21.15.92:0/2359288448 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f43400ef9c0 con 0x7f4350101de0 2024-09-19T08:54:27.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.601+0000 7f434effd640 1 --2- 172.21.15.92:0/2359288448 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f43380a32c0 0x7f43380a5780 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f43500fdce0 tx=0x7f434400a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:27.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.605+0000 7f434cff9640 1 -- 172.21.15.92:0/2359288448 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f43400f1e20 con 0x7f4350101de0 2024-09-19T08:54:27.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:27 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:27.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:27 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:27.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:27 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:27.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:27 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:27.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:27 smithi190 ceph-mon[35358]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:27.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:27.772+0000 7f4355e4e640 1 -- 172.21.15.92:0/2359288448 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f435010a0f0 con 0x7f4350101de0 2024-09-19T08:54:28.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:28.392+0000 7f434cff9640 1 -- 172.21.15.92:0/2359288448 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v76) ==== 138+0+0 (secure 0 0 0) 0x7f43400bcb80 con 0x7f4350101de0 2024-09-19T08:54:28.392 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'cephfs_metadata' created 2024-09-19T08:54:28.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:28.394+0000 7f4355e4e640 1 -- 172.21.15.92:0/2359288448 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f43380a32c0 msgr2=0x7f43380a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:28.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:28.394+0000 7f4355e4e640 1 --2- 172.21.15.92:0/2359288448 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f43380a32c0 0x7f43380a5780 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f43500fdce0 tx=0x7f434400a4c0 comp rx=0 tx=0).stop 2024-09-19T08:54:28.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:28.394+0000 7f4355e4e640 1 -- 172.21.15.92:0/2359288448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4350101de0 msgr2=0x7f43501983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:28.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:28.394+0000 7f4355e4e640 1 --2- 172.21.15.92:0/2359288448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4350101de0 0x7f43501983d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4340005ab0 tx=0x7f43400042f0 comp rx=0 tx=0).stop 2024-09-19T08:54:28.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:28.394+0000 7f4355e4e640 1 -- 172.21.15.92:0/2359288448 shutdown_connections 2024-09-19T08:54:28.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:28.394+0000 7f4355e4e640 1 --2- 172.21.15.92:0/2359288448 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4350106f10 0x7f435019cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:28.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:28.394+0000 7f4355e4e640 1 --2- 172.21.15.92:0/2359288448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4350102790 0x7f4350198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:28.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:28.394+0000 7f4355e4e640 1 --2- 172.21.15.92:0/2359288448 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f43380a32c0 0x7f43380a5780 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:28.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:28.394+0000 7f4355e4e640 1 --2- 172.21.15.92:0/2359288448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4350101de0 0x7f43501983d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:28.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:28.394+0000 7f4355e4e640 1 -- 172.21.15.92:0/2359288448 >> 172.21.15.92:0/2359288448 conn(0x7f43500fd8c0 msgr2=0x7f43500febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:28.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:28.395+0000 7f4355e4e640 1 -- 172.21.15.92:0/2359288448 shutdown_connections 2024-09-19T08:54:28.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:28.395+0000 7f4355e4e640 1 -- 172.21.15.92:0/2359288448 wait complete. 2024-09-19T08:54:28.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:28 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:28.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:28 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:28.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:28 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:28.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:28 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:54:28.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:28 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:28.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:28 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/2359288448' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T08:54:28.714 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:28 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:28.714 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:28 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:28.714 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:28 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:28.714 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:28 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:54:28.714 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:28 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:28.714 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:28 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/2359288448' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T08:54:28.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:28 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:28.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:28 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:28.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:28 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:28.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:28 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:54:28.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:28 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:54:28.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:28 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/2359288448' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T08:54:29.011 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T08:54:29.257 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:29.506 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:29 smithi092 ceph-mon[31407]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:29.506 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:29 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/2359288448' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T08:54:29.506 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:29 smithi092 ceph-mon[31407]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T08:54:29.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.780+0000 7fbad38d9640 1 -- 172.21.15.92:0/2426989978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbacc100a80 msgr2=0x7fbacc100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:29.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.780+0000 7fbad38d9640 1 --2- 172.21.15.92:0/2426989978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbacc100a80 0x7fbacc100ee0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbabc009930 tx=0x7fbabc02a420 comp rx=0 tx=0).stop 2024-09-19T08:54:29.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.780+0000 7fbad38d9640 1 -- 172.21.15.92:0/2426989978 shutdown_connections 2024-09-19T08:54:29.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.780+0000 7fbad38d9640 1 --2- 172.21.15.92:0/2426989978 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbacc101420 0x7fbacc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:29.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.780+0000 7fbad38d9640 1 --2- 172.21.15.92:0/2426989978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbacc100a80 0x7fbacc100ee0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:29.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.780+0000 7fbad38d9640 1 --2- 172.21.15.92:0/2426989978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbacc106a80 0x7fbacc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:29.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.780+0000 7fbad38d9640 1 -- 172.21.15.92:0/2426989978 >> 172.21.15.92:0/2426989978 conn(0x7fbacc0fc7a0 msgr2=0x7fbacc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:29.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.780+0000 7fbad38d9640 1 -- 172.21.15.92:0/2426989978 shutdown_connections 2024-09-19T08:54:29.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.780+0000 7fbad38d9640 1 -- 172.21.15.92:0/2426989978 wait complete. 2024-09-19T08:54:29.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.780+0000 7fbad38d9640 1 Processor -- start 2024-09-19T08:54:29.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.780+0000 7fbad38d9640 1 -- start start 2024-09-19T08:54:29.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.780+0000 7fbad38d9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbacc100a80 0x7fbacc1984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:29.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.780+0000 7fbad38d9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbacc101420 0x7fbacc198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:29.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.780+0000 7fbad38d9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbacc106a80 0x7fbacc19cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:29.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.780+0000 7fbad38d9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbacc110ec0 con 0x7fbacc101420 2024-09-19T08:54:29.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.780+0000 7fbad38d9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbacc110d40 con 0x7fbacc100a80 2024-09-19T08:54:29.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.780+0000 7fbad38d9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fbacc111040 con 0x7fbacc106a80 2024-09-19T08:54:29.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.781+0000 7fbad0e74640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbacc101420 0x7fbacc198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:29.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.781+0000 7fbad0e74640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbacc101420 0x7fbacc198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49278/0 (socket says 172.21.15.92:49278) 2024-09-19T08:54:29.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.781+0000 7fbad0e74640 1 -- 172.21.15.92:0/51519510 learned_addr learned my addr 172.21.15.92:0/51519510 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:54:29.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.781+0000 7fbad1e76640 1 --2- 172.21.15.92:0/51519510 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbacc106a80 0x7fbacc19cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:29.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.781+0000 7fbad1675640 1 --2- 172.21.15.92:0/51519510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbacc100a80 0x7fbacc1984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:29.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.781+0000 7fbad0e74640 1 -- 172.21.15.92:0/51519510 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbacc106a80 msgr2=0x7fbacc19cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:29.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.781+0000 7fbad0e74640 1 --2- 172.21.15.92:0/51519510 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbacc106a80 0x7fbacc19cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:29.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.781+0000 7fbad0e74640 1 -- 172.21.15.92:0/51519510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbacc100a80 msgr2=0x7fbacc1984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:29.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.781+0000 7fbad0e74640 1 --2- 172.21.15.92:0/51519510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbacc100a80 0x7fbacc1984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:29.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.781+0000 7fbad0e74640 1 -- 172.21.15.92:0/51519510 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbacc19d480 con 0x7fbacc101420 2024-09-19T08:54:29.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.781+0000 7fbad1675640 1 --2- 172.21.15.92:0/51519510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbacc100a80 0x7fbacc1984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:29.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.781+0000 7fbad0e74640 1 --2- 172.21.15.92:0/51519510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbacc101420 0x7fbacc198a10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbabc009230 tx=0x7fbabc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:29.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.781+0000 7fbac27fc640 1 -- 172.21.15.92:0/51519510 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbabc03f030 con 0x7fbacc101420 2024-09-19T08:54:29.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.781+0000 7fbac27fc640 1 -- 172.21.15.92:0/51519510 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbabc003ad0 con 0x7fbacc101420 2024-09-19T08:54:29.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.781+0000 7fbad38d9640 1 -- 172.21.15.92:0/51519510 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbacc19d710 con 0x7fbacc101420 2024-09-19T08:54:29.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.781+0000 7fbac27fc640 1 -- 172.21.15.92:0/51519510 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbabc035070 con 0x7fbacc101420 2024-09-19T08:54:29.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.781+0000 7fbad38d9640 1 -- 172.21.15.92:0/51519510 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbacc1a5050 con 0x7fbacc101420 2024-09-19T08:54:29.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.782+0000 7fbad38d9640 1 -- 172.21.15.92:0/51519510 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbacc100ee0 con 0x7fbacc101420 2024-09-19T08:54:29.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.784+0000 7fbac27fc640 1 -- 172.21.15.92:0/51519510 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fbabc042030 con 0x7fbacc101420 2024-09-19T08:54:29.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.784+0000 7fbac27fc640 1 --2- 172.21.15.92:0/51519510 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fbab80a32c0 0x7fbab80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:29.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.784+0000 7fbad1675640 1 --2- 172.21.15.92:0/51519510 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fbab80a32c0 0x7fbab80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:29.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.784+0000 7fbac27fc640 1 -- 172.21.15.92:0/51519510 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7497+0+0 (secure 0 0 0) 0x7fbabc0efed0 con 0x7fbacc101420 2024-09-19T08:54:29.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.785+0000 7fbad1675640 1 --2- 172.21.15.92:0/51519510 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fbab80a32c0 0x7fbab80a5780 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbac8009930 tx=0x7fbac8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:29.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.787+0000 7fbac27fc640 1 -- 172.21.15.92:0/51519510 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbabc0bcf20 con 0x7fbacc101420 2024-09-19T08:54:29.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:29 smithi167 ceph-mon[35359]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:29.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:29 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/2359288448' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T08:54:29.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:29 smithi167 ceph-mon[35359]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T08:54:29.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:29 smithi190 ceph-mon[35358]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:29.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:29 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/2359288448' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T08:54:29.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:29 smithi190 ceph-mon[35358]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T08:54:29.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:29.956+0000 7fbad38d9640 1 -- 172.21.15.92:0/51519510 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fbacc1a5250 con 0x7fbacc101420 2024-09-19T08:54:30.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:30.406+0000 7fbac27fc640 1 -- 172.21.15.92:0/51519510 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v78) ==== 170+0+0 (secure 0 0 0) 0x7fbabc0bc820 con 0x7fbacc101420 2024-09-19T08:54:30.406 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'cephfs_data' created 2024-09-19T08:54:30.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:30.409+0000 7fbad38d9640 1 -- 172.21.15.92:0/51519510 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fbab80a32c0 msgr2=0x7fbab80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:30.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:30.409+0000 7fbad38d9640 1 --2- 172.21.15.92:0/51519510 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fbab80a32c0 0x7fbab80a5780 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbac8009930 tx=0x7fbac8008040 comp rx=0 tx=0).stop 2024-09-19T08:54:30.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:30.409+0000 7fbad38d9640 1 -- 172.21.15.92:0/51519510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbacc101420 msgr2=0x7fbacc198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:30.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:30.409+0000 7fbad38d9640 1 --2- 172.21.15.92:0/51519510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbacc101420 0x7fbacc198a10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbabc009230 tx=0x7fbabc004270 comp rx=0 tx=0).stop 2024-09-19T08:54:30.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:30.409+0000 7fbad38d9640 1 -- 172.21.15.92:0/51519510 shutdown_connections 2024-09-19T08:54:30.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:30.409+0000 7fbad38d9640 1 --2- 172.21.15.92:0/51519510 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbacc106a80 0x7fbacc19cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:30.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:30.409+0000 7fbad38d9640 1 --2- 172.21.15.92:0/51519510 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fbab80a32c0 0x7fbab80a5780 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:30.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:30.409+0000 7fbad38d9640 1 --2- 172.21.15.92:0/51519510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbacc101420 0x7fbacc198a10 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:30.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:30.409+0000 7fbad38d9640 1 --2- 172.21.15.92:0/51519510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbacc100a80 0x7fbacc1984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:30.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:30.409+0000 7fbad38d9640 1 -- 172.21.15.92:0/51519510 >> 172.21.15.92:0/51519510 conn(0x7fbacc0fc7a0 msgr2=0x7fbacc104830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:30.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:30.409+0000 7fbad38d9640 1 -- 172.21.15.92:0/51519510 shutdown_connections 2024-09-19T08:54:30.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:30.409+0000 7fbad38d9640 1 -- 172.21.15.92:0/51519510 wait complete. 2024-09-19T08:54:30.698 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:30 smithi092 ceph-mon[31407]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T08:54:30.698 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:30 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/51519510' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T08:54:30.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:30 smithi167 ceph-mon[35359]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T08:54:30.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:30 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/51519510' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T08:54:30.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:30 smithi190 ceph-mon[35358]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T08:54:30.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:30 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/51519510' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T08:54:31.051 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T08:54:31.302 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:31.702 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:31 smithi092 ceph-mon[31407]: pgmap v266: 33 pgs: 1 creating+activating, 10 creating+peering, 19 unknown, 3 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:31.702 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:31 smithi092 ceph-mon[31407]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T08:54:31.702 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:31 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/51519510' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T08:54:31.702 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:31 smithi092 ceph-mon[31407]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T08:54:31.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.728+0000 7f0827fb7640 1 -- 172.21.15.92:0/2143922277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0820100e20 msgr2=0x7f0820101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:31.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.728+0000 7f0827fb7640 1 --2- 172.21.15.92:0/2143922277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0820100e20 0x7f0820101200 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0810009900 tx=0x7f081002a480 comp rx=0 tx=0).stop 2024-09-19T08:54:31.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.728+0000 7f0827fb7640 1 -- 172.21.15.92:0/2143922277 shutdown_connections 2024-09-19T08:54:31.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.728+0000 7f0827fb7640 1 --2- 172.21.15.92:0/2143922277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0820102ef0 0x7f082010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:31.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.728+0000 7f0827fb7640 1 --2- 172.21.15.92:0/2143922277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0820102570 0x7f08201029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:31.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.728+0000 7f0827fb7640 1 --2- 172.21.15.92:0/2143922277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0820100e20 0x7f0820101200 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:31.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.728+0000 7f0827fb7640 1 -- 172.21.15.92:0/2143922277 >> 172.21.15.92:0/2143922277 conn(0x7f08200fc7d0 msgr2=0x7f08200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:31.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.728+0000 7f0827fb7640 1 -- 172.21.15.92:0/2143922277 shutdown_connections 2024-09-19T08:54:31.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.728+0000 7f0827fb7640 1 -- 172.21.15.92:0/2143922277 wait complete. 2024-09-19T08:54:31.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.728+0000 7f0827fb7640 1 Processor -- start 2024-09-19T08:54:31.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.729+0000 7f0827fb7640 1 -- start start 2024-09-19T08:54:31.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.729+0000 7f0827fb7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0820100e20 0x7f0820199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:31.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.729+0000 7f0827fb7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0820102570 0x7f0820199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:31.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.729+0000 7f0827fb7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0820102ef0 0x7f08201a44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:31.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.729+0000 7f0827fb7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0820110fa0 con 0x7f0820100e20 2024-09-19T08:54:31.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.729+0000 7f0827fb7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0820110e20 con 0x7f0820102ef0 2024-09-19T08:54:31.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.729+0000 7f0827fb7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0820111120 con 0x7f0820102570 2024-09-19T08:54:31.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.729+0000 7f0825d53640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0820100e20 0x7f0820199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:31.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.729+0000 7f0825d53640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0820100e20 0x7f0820199430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34086/0 (socket says 172.21.15.92:34086) 2024-09-19T08:54:31.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.729+0000 7f0825d53640 1 -- 172.21.15.92:0/2877761972 learned_addr learned my addr 172.21.15.92:0/2877761972 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:54:31.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.729+0000 7f0826554640 1 --2- 172.21.15.92:0/2877761972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0820102ef0 0x7f08201a44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:31.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.729+0000 7f0825552640 1 --2- 172.21.15.92:0/2877761972 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0820102570 0x7f0820199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:31.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.729+0000 7f0825d53640 1 -- 172.21.15.92:0/2877761972 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0820102570 msgr2=0x7f0820199970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:31.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.729+0000 7f0825d53640 1 --2- 172.21.15.92:0/2877761972 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0820102570 0x7f0820199970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:31.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.729+0000 7f0825d53640 1 -- 172.21.15.92:0/2877761972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0820102ef0 msgr2=0x7f08201a44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:31.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.729+0000 7f0825d53640 1 --2- 172.21.15.92:0/2877761972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0820102ef0 0x7f08201a44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:31.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.729+0000 7f0825d53640 1 -- 172.21.15.92:0/2877761972 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08201a49f0 con 0x7f0820100e20 2024-09-19T08:54:31.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.729+0000 7f0826554640 1 --2- 172.21.15.92:0/2877761972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0820102ef0 0x7f08201a44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:31.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.729+0000 7f0825d53640 1 --2- 172.21.15.92:0/2877761972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0820100e20 0x7f0820199430 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0810006010 tx=0x7f0810003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:31.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.729+0000 7f0816ffd640 1 -- 172.21.15.92:0/2877761972 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f081003f070 con 0x7f0820100e20 2024-09-19T08:54:31.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.729+0000 7f0816ffd640 1 -- 172.21.15.92:0/2877761972 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0810031c30 con 0x7f0820100e20 2024-09-19T08:54:31.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.729+0000 7f0827fb7640 1 -- 172.21.15.92:0/2877761972 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08201a4bc0 con 0x7f0820100e20 2024-09-19T08:54:31.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.730+0000 7f0816ffd640 1 -- 172.21.15.92:0/2877761972 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0810035030 con 0x7f0820100e20 2024-09-19T08:54:31.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.730+0000 7f0827fb7640 1 -- 172.21.15.92:0/2877761972 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08201a5010 con 0x7f0820100e20 2024-09-19T08:54:31.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.731+0000 7f0827fb7640 1 -- 172.21.15.92:0/2877761972 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0820101200 con 0x7f0820100e20 2024-09-19T08:54:31.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.732+0000 7f0816ffd640 1 -- 172.21.15.92:0/2877761972 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f0810042070 con 0x7f0820100e20 2024-09-19T08:54:31.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.733+0000 7f0816ffd640 1 --2- 172.21.15.92:0/2877761972 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f080c0a3240 0x7f080c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:31.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.733+0000 7f0825552640 1 --2- 172.21.15.92:0/2877761972 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f080c0a3240 0x7f080c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:31.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.733+0000 7f0816ffd640 1 -- 172.21.15.92:0/2877761972 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7879+0+0 (secure 0 0 0) 0x7f08100f0070 con 0x7f0820100e20 2024-09-19T08:54:31.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.733+0000 7f0825552640 1 --2- 172.21.15.92:0/2877761972 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f080c0a3240 0x7f080c0a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f082006aac0 tx=0x7f081c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:31.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.737+0000 7f0816ffd640 1 -- 172.21.15.92:0/2877761972 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0810031de0 con 0x7f0820100e20 2024-09-19T08:54:31.752 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:31 smithi167 ceph-mon[35359]: pgmap v266: 33 pgs: 1 creating+activating, 10 creating+peering, 19 unknown, 3 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:31.752 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:31 smithi167 ceph-mon[35359]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T08:54:31.753 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:31 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/51519510' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T08:54:31.753 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:31 smithi167 ceph-mon[35359]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T08:54:31.774 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:31 smithi190 ceph-mon[35358]: pgmap v266: 33 pgs: 1 creating+activating, 10 creating+peering, 19 unknown, 3 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:31.775 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:31 smithi190 ceph-mon[35358]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T08:54:31.775 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:31 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/51519510' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T08:54:31.775 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:31 smithi190 ceph-mon[35358]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T08:54:31.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:31.938+0000 7f0827fb7640 1 -- 172.21.15.92:0/2877761972 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f082006a560 con 0x7f0820100e20 2024-09-19T08:54:32.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:32.425+0000 7f0816ffd640 1 -- 172.21.15.92:0/2877761972 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f082006a560 con 0x7f0820100e20 2024-09-19T08:54:32.425 INFO:teuthology.orchestra.run.smithi092.stderr:new fs with metadata pool 2 and data pool 3 2024-09-19T08:54:32.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:32.428+0000 7f0827fb7640 1 -- 172.21.15.92:0/2877761972 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f080c0a3240 msgr2=0x7f080c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:32.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:32.428+0000 7f0827fb7640 1 --2- 172.21.15.92:0/2877761972 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f080c0a3240 0x7f080c0a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f082006aac0 tx=0x7f081c008040 comp rx=0 tx=0).stop 2024-09-19T08:54:32.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:32.428+0000 7f0827fb7640 1 -- 172.21.15.92:0/2877761972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0820100e20 msgr2=0x7f0820199430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:32.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:32.428+0000 7f0827fb7640 1 --2- 172.21.15.92:0/2877761972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0820100e20 0x7f0820199430 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0810006010 tx=0x7f0810003c10 comp rx=0 tx=0).stop 2024-09-19T08:54:32.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:32.428+0000 7f0827fb7640 1 -- 172.21.15.92:0/2877761972 shutdown_connections 2024-09-19T08:54:32.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:32.428+0000 7f0827fb7640 1 --2- 172.21.15.92:0/2877761972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0820102ef0 0x7f08201a44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:32.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:32.428+0000 7f0827fb7640 1 --2- 172.21.15.92:0/2877761972 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0820102570 0x7f0820199970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:32.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:32.428+0000 7f0827fb7640 1 --2- 172.21.15.92:0/2877761972 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f080c0a3240 0x7f080c0a5700 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:32.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:32.428+0000 7f0827fb7640 1 --2- 172.21.15.92:0/2877761972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0820100e20 0x7f0820199430 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:32.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:32.428+0000 7f0827fb7640 1 -- 172.21.15.92:0/2877761972 >> 172.21.15.92:0/2877761972 conn(0x7f08200fc7d0 msgr2=0x7f08200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:32.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:32.428+0000 7f0827fb7640 1 -- 172.21.15.92:0/2877761972 shutdown_connections 2024-09-19T08:54:32.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:32.428+0000 7f0827fb7640 1 -- 172.21.15.92:0/2877761972 wait complete. 2024-09-19T08:54:32.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:32 smithi092 ceph-mon[31407]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T08:54:32.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:32 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/2877761972' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T08:54:32.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:32 smithi092 ceph-mon[31407]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-19T08:54:32.765 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:32 smithi167 ceph-mon[35359]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T08:54:32.765 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:32 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/2877761972' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T08:54:32.765 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:32 smithi167 ceph-mon[35359]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-19T08:54:32.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:32 smithi190 ceph-mon[35358]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T08:54:32.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:32 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/2877761972' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T08:54:32.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:32 smithi190 ceph-mon[35358]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-19T08:54:32.936 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:54:33.185 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:33.624 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:33 smithi092 ceph-mon[31407]: pgmap v269: 97 pgs: 1 creating+activating, 16 creating+peering, 71 unknown, 9 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:33.625 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:33 smithi092 ceph-mon[31407]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T08:54:33.625 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:33 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/2877761972' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T08:54:33.625 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:33 smithi092 ceph-mon[31407]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-19T08:54:33.625 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:33 smithi092 ceph-mon[31407]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-19T08:54:33.625 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:33 smithi092 ceph-mon[31407]: mds.? [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] up:active 2024-09-19T08:54:33.625 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:33 smithi092 ceph-mon[31407]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T08:54:33.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.630+0000 7f91d4430640 1 -- 172.21.15.92:0/1720022561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91cc103670 msgr2=0x7f91cc10bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:33.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.630+0000 7f91d4430640 1 --2- 172.21.15.92:0/1720022561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91cc103670 0x7f91cc10bb60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f91c0009900 tx=0x7f91c002a480 comp rx=0 tx=0).stop 2024-09-19T08:54:33.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.631+0000 7f91d4430640 1 -- 172.21.15.92:0/1720022561 shutdown_connections 2024-09-19T08:54:33.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.631+0000 7f91d4430640 1 --2- 172.21.15.92:0/1720022561 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91cc10c180 0x7f91cc10e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.631+0000 7f91d4430640 1 --2- 172.21.15.92:0/1720022561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91cc103670 0x7f91cc10bb60 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.631+0000 7f91d4430640 1 --2- 172.21.15.92:0/1720022561 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91cc102d50 0x7f91cc103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.631+0000 7f91d4430640 1 -- 172.21.15.92:0/1720022561 >> 172.21.15.92:0/1720022561 conn(0x7f91cc0fc7d0 msgr2=0x7f91cc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:33.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.631+0000 7f91d4430640 1 -- 172.21.15.92:0/1720022561 shutdown_connections 2024-09-19T08:54:33.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.631+0000 7f91d4430640 1 -- 172.21.15.92:0/1720022561 wait complete. 2024-09-19T08:54:33.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.631+0000 7f91d4430640 1 Processor -- start 2024-09-19T08:54:33.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.631+0000 7f91d4430640 1 -- start start 2024-09-19T08:54:33.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.632+0000 7f91d4430640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91cc102d50 0x7f91cc198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:33.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.632+0000 7f91d4430640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91cc103670 0x7f91cc198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:33.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.632+0000 7f91d4430640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91cc10c180 0x7f91cc19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:33.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.632+0000 7f91d4430640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f91cc111fd0 con 0x7f91cc10c180 2024-09-19T08:54:33.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.632+0000 7f91d4430640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f91cc111e50 con 0x7f91cc103670 2024-09-19T08:54:33.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.632+0000 7f91d4430640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f91cc112150 con 0x7f91cc102d50 2024-09-19T08:54:33.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.632+0000 7f91d29cd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91cc10c180 0x7f91cc19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:33.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.632+0000 7f91d29cd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91cc10c180 0x7f91cc19ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34092/0 (socket says 172.21.15.92:34092) 2024-09-19T08:54:33.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.632+0000 7f91d29cd640 1 -- 172.21.15.92:0/1832875706 learned_addr learned my addr 172.21.15.92:0/1832875706 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:54:33.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.632+0000 7f91d21cc640 1 --2- 172.21.15.92:0/1832875706 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91cc102d50 0x7f91cc198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:33.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.632+0000 7f91d19cb640 1 --2- 172.21.15.92:0/1832875706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91cc103670 0x7f91cc198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:33.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.632+0000 7f91d29cd640 1 -- 172.21.15.92:0/1832875706 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91cc102d50 msgr2=0x7f91cc198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:33.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.632+0000 7f91d29cd640 1 --2- 172.21.15.92:0/1832875706 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91cc102d50 0x7f91cc198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.632+0000 7f91d29cd640 1 -- 172.21.15.92:0/1832875706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91cc103670 msgr2=0x7f91cc198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:33.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.632+0000 7f91d29cd640 1 --2- 172.21.15.92:0/1832875706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91cc103670 0x7f91cc198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.632+0000 7f91d29cd640 1 -- 172.21.15.92:0/1832875706 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91cc19d4e0 con 0x7f91cc10c180 2024-09-19T08:54:33.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.632+0000 7f91d29cd640 1 --2- 172.21.15.92:0/1832875706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91cc10c180 0x7f91cc19ce00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f91bc00c970 tx=0x7f91bc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:33.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.633+0000 7f91cb7fe640 1 -- 172.21.15.92:0/1832875706 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91bc007bb0 con 0x7f91cc10c180 2024-09-19T08:54:33.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.633+0000 7f91cb7fe640 1 -- 172.21.15.92:0/1832875706 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91bc007d50 con 0x7f91cc10c180 2024-09-19T08:54:33.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.633+0000 7f91d4430640 1 -- 172.21.15.92:0/1832875706 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91cc19d7d0 con 0x7f91cc10c180 2024-09-19T08:54:33.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.633+0000 7f91cb7fe640 1 -- 172.21.15.92:0/1832875706 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91bc00f450 con 0x7f91cc10c180 2024-09-19T08:54:33.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.633+0000 7f91d4430640 1 -- 172.21.15.92:0/1832875706 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91cc1a50b0 con 0x7f91cc10c180 2024-09-19T08:54:33.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.634+0000 7f91d4430640 1 -- 172.21.15.92:0/1832875706 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91cc103130 con 0x7f91cc10c180 2024-09-19T08:54:33.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.635+0000 7f91cb7fe640 1 -- 172.21.15.92:0/1832875706 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f91bc004f20 con 0x7f91cc10c180 2024-09-19T08:54:33.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.635+0000 7f91cb7fe640 1 --2- 172.21.15.92:0/1832875706 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f91b40a3240 0x7f91b40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:33.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.635+0000 7f91d21cc640 1 --2- 172.21.15.92:0/1832875706 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f91b40a3240 0x7f91b40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:33.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.635+0000 7f91cb7fe640 1 -- 172.21.15.92:0/1832875706 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f91bc0cf320 con 0x7f91cc10c180 2024-09-19T08:54:33.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.636+0000 7f91d21cc640 1 --2- 172.21.15.92:0/1832875706 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f91b40a3240 0x7f91b40a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f91c4005fd0 tx=0x7f91c4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:33.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.639+0000 7f91cb7fe640 1 -- 172.21.15.92:0/1832875706 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f91bc014030 con 0x7f91cc10c180 2024-09-19T08:54:33.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.807+0000 7f91d4430640 1 -- 172.21.15.92:0/1832875706 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f91cc106c60 con 0x7f91cc10c180 2024-09-19T08:54:33.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.809+0000 7f91cb7fe640 1 -- 172.21.15.92:0/1832875706 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22303 (secure 0 0 0) 0x7f91bc09bb40 con 0x7f91cc10c180 2024-09-19T08:54:33.809 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:54:33.809 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":80,"fsid":"91ff74f2-7663-11ef-bceb-c7b262605968","created":"2024-09-19T08:47:08.162150+0000","modified":"2024-09-19T08:54:31.939170+0000","last_up_change":"2024-09-19T08:53:43.021949+0000","last_in_change":"2024-09-19T08:53:19.246805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:50:04.482034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:54:28.005336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:54:30.188980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd104fe2-b828-4c98-a499-b212717f2997","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6803","nonce":4232030626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6805","nonce":4232030626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6809","nonce":4232030626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6807","nonce":4232030626}]},"public_addr":"172.21.15.92:6803/4232030626","cluster_addr":"172.21.15.92:6805/4232030626","heartbeat_back_addr":"172.21.15.92:6809/4232030626","heartbeat_front_addr":"172.21.15.92:6807/4232030626","state":["exists","up"]},{"osd":1,"uuid":"0f725330-5e61-413c-b3c8-41bc2c0d8e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6801","nonce":4163493234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6803","nonce":4163493234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6807","nonce":4163493234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6805","nonce":4163493234}]},"public_addr":"172.21.15.167:6801/4163493234","cluster_addr":"172.21.15.167:6803/4163493234","heartbeat_back_addr":"172.21.15.167:6807/4163493234","heartbeat_front_addr":"172.21.15.167:6805/4163493234","state":["exists","up"]},{"osd":2,"uuid":"286d2943-23a0-4184-93cf-9d3430781f99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6801","nonce":702507556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6803","nonce":702507556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6807","nonce":702507556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6805","nonce":702507556}]},"public_addr":"172.21.15.190:6801/702507556","cluster_addr":"172.21.15.190:6803/702507556","heartbeat_back_addr":"172.21.15.190:6807/702507556","heartbeat_front_addr":"172.21.15.190:6805/702507556","state":["exists","up"]},{"osd":3,"uuid":"9d126671-7fc1-4f29-9bc3-3598052fd20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6811","nonce":945752895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6813","nonce":945752895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6817","nonce":945752895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6815","nonce":945752895}]},"public_addr":"172.21.15.92:6811/945752895","cluster_addr":"172.21.15.92:6813/945752895","heartbeat_back_addr":"172.21.15.92:6817/945752895","heartbeat_front_addr":"172.21.15.92:6815/945752895","state":["exists","up"]},{"osd":4,"uuid":"cb10b38d-ae13-4b92-b906-3505fb873b2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6809","nonce":3576893400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6811","nonce":3576893400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6815","nonce":3576893400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6813","nonce":3576893400}]},"public_addr":"172.21.15.167:6809/3576893400","cluster_addr":"172.21.15.167:6811/3576893400","heartbeat_back_addr":"172.21.15.167:6815/3576893400","heartbeat_front_addr":"172.21.15.167:6813/3576893400","state":["exists","up"]},{"osd":5,"uuid":"cd90668b-eca5-4bb4-870e-e58578730c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6809","nonce":1880491675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6811","nonce":1880491675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6815","nonce":1880491675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6813","nonce":1880491675}]},"public_addr":"172.21.15.190:6809/1880491675","cluster_addr":"172.21.15.190:6811/1880491675","heartbeat_back_addr":"172.21.15.190:6815/1880491675","heartbeat_front_addr":"172.21.15.190:6813/1880491675","state":["exists","up"]},{"osd":6,"uuid":"4e047963-afa7-4934-b887-8086165fb831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6819","nonce":1743435653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6821","nonce":1743435653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6825","nonce":1743435653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6823","nonce":1743435653}]},"public_addr":"172.21.15.92:6819/1743435653","cluster_addr":"172.21.15.92:6821/1743435653","heartbeat_back_addr":"172.21.15.92:6825/1743435653","heartbeat_front_addr":"172.21.15.92:6823/1743435653","state":["exists","up"]},{"osd":7,"uuid":"652a6aa1-bb94-4608-952e-67cd02bdff66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6817","nonce":2984111963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6819","nonce":2984111963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6823","nonce":2984111963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6821","nonce":2984111963}]},"public_addr":"172.21.15.167:6817/2984111963","cluster_addr":"172.21.15.167:6819/2984111963","heartbeat_back_addr":"172.21.15.167:6823/2984111963","heartbeat_front_addr":"172.21.15.167:6821/2984111963","state":["exists","up"]},{"osd":8,"uuid":"1510ef1f-fdfe-4887-a771-146efce062fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6817","nonce":4190304434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6819","nonce":4190304434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6823","nonce":4190304434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6821","nonce":4190304434}]},"public_addr":"172.21.15.190:6817/4190304434","cluster_addr":"172.21.15.190:6819/4190304434","heartbeat_back_addr":"172.21.15.190:6823/4190304434","heartbeat_front_addr":"172.21.15.190:6821/4190304434","state":["exists","up"]},{"osd":9,"uuid":"9b774bbe-6700-4020-900b-3fdbaa546773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6827","nonce":3066744542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6829","nonce":3066744542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6833","nonce":3066744542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6831","nonce":3066744542}]},"public_addr":"172.21.15.92:6827/3066744542","cluster_addr":"172.21.15.92:6829/3066744542","heartbeat_back_addr":"172.21.15.92:6833/3066744542","heartbeat_front_addr":"172.21.15.92:6831/3066744542","state":["exists","up"]},{"osd":10,"uuid":"8abdb835-db2c-4597-ae1d-8ef56e63ab6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6825","nonce":2309134313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6827","nonce":2309134313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6831","nonce":2309134313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6829","nonce":2309134313}]},"public_addr":"172.21.15.167:6825/2309134313","cluster_addr":"172.21.15.167:6827/2309134313","heartbeat_back_addr":"172.21.15.167:6831/2309134313","heartbeat_front_addr":"172.21.15.167:6829/2309134313","state":["exists","up"]},{"osd":11,"uuid":"564c844a-378f-40cd-9717-cde35a65631c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6825","nonce":1849208751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6827","nonce":1849208751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6831","nonce":1849208751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6829","nonce":1849208751}]},"public_addr":"172.21.15.190:6825/1849208751","cluster_addr":"172.21.15.190:6827/1849208751","heartbeat_back_addr":"172.21.15.190:6831/1849208751","heartbeat_front_addr":"172.21.15.190:6829/1849208751","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:12.072109+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:36.689174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:01.908763+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:26.857439+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:50.881629+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:51:15.160744+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:51:39.101605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:03.179877+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:27.324563+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:51.971287+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:53:15.917311+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:53:40.592486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/2948821221":"2024-09-20T08:47:52.180093+0000","172.21.15.92:0/1441365956":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6801/2908709470":"2024-09-20T08:47:52.180093+0000","172.21.15.92:0/608374871":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6801/1369295034":"2024-09-20T08:47:29.812397+0000","172.21.15.92:6800/2908709470":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6800/1369295034":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/813486656":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/1963725565":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/1668504617":"2024-09-20T08:47:29.812397+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:54:33.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.811+0000 7f91d4430640 1 -- 172.21.15.92:0/1832875706 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f91b40a3240 msgr2=0x7f91b40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:33.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.811+0000 7f91d4430640 1 --2- 172.21.15.92:0/1832875706 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f91b40a3240 0x7f91b40a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f91c4005fd0 tx=0x7f91c4009500 comp rx=0 tx=0).stop 2024-09-19T08:54:33.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.811+0000 7f91d4430640 1 -- 172.21.15.92:0/1832875706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91cc10c180 msgr2=0x7f91cc19ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:33.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.811+0000 7f91d4430640 1 --2- 172.21.15.92:0/1832875706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91cc10c180 0x7f91cc19ce00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f91bc00c970 tx=0x7f91bc00ce30 comp rx=0 tx=0).stop 2024-09-19T08:54:33.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.811+0000 7f91d4430640 1 -- 172.21.15.92:0/1832875706 shutdown_connections 2024-09-19T08:54:33.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.811+0000 7f91d4430640 1 --2- 172.21.15.92:0/1832875706 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f91b40a3240 0x7f91b40a5700 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.811+0000 7f91d4430640 1 --2- 172.21.15.92:0/1832875706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91cc10c180 0x7f91cc19ce00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.811+0000 7f91d4430640 1 --2- 172.21.15.92:0/1832875706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91cc103670 0x7f91cc198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.811+0000 7f91d4430640 1 --2- 172.21.15.92:0/1832875706 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91cc102d50 0x7f91cc198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.811+0000 7f91d4430640 1 -- 172.21.15.92:0/1832875706 >> 172.21.15.92:0/1832875706 conn(0x7f91cc0fc7d0 msgr2=0x7f91cc0fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:33.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.811+0000 7f91d4430640 1 -- 172.21.15.92:0/1832875706 shutdown_connections 2024-09-19T08:54:33.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:33.811+0000 7f91d4430640 1 -- 172.21.15.92:0/1832875706 wait complete. 2024-09-19T08:54:33.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:33 smithi167 ceph-mon[35359]: pgmap v269: 97 pgs: 1 creating+activating, 16 creating+peering, 71 unknown, 9 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:33.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:33 smithi167 ceph-mon[35359]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T08:54:33.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:33 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/2877761972' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T08:54:33.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:33 smithi167 ceph-mon[35359]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-19T08:54:33.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:33 smithi167 ceph-mon[35359]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-19T08:54:33.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:33 smithi167 ceph-mon[35359]: mds.? [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] up:active 2024-09-19T08:54:33.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:33 smithi167 ceph-mon[35359]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T08:54:33.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:33 smithi190 ceph-mon[35358]: pgmap v269: 97 pgs: 1 creating+activating, 16 creating+peering, 71 unknown, 9 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:54:33.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:33 smithi190 ceph-mon[35358]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T08:54:33.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:33 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/2877761972' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T08:54:33.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:33 smithi190 ceph-mon[35358]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-19T08:54:33.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:33 smithi190 ceph-mon[35358]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-19T08:54:33.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:33 smithi190 ceph-mon[35358]: mds.? [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] up:active 2024-09-19T08:54:33.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:33 smithi190 ceph-mon[35358]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T08:54:34.477 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:54:34.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:34 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/1832875706' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:54:34.623 INFO:journalctl@ceph.mds.i.smithi190.stdout:Sep 19 08:54:34 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-i[65763]: 2024-09-19T08:54:34.357+0000 7fe274879640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T08:54:34.726 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:34.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:34 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1832875706' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:54:34.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:34 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/1832875706' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:54:35.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.126+0000 7ff7fc564640 1 -- 172.21.15.92:0/990060879 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7f4100aa0 msgr2=0x7ff7f410ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:35.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.126+0000 7ff7fc564640 1 --2- 172.21.15.92:0/990060879 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7f4100aa0 0x7ff7f410ea20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec009ca0 tx=0x7ff7ec02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:54:35.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.126+0000 7ff7fc564640 1 -- 172.21.15.92:0/990060879 shutdown_connections 2024-09-19T08:54:35.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.126+0000 7ff7fc564640 1 --2- 172.21.15.92:0/990060879 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7f4100aa0 0x7ff7f410ea20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:35.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.126+0000 7ff7fc564640 1 --2- 172.21.15.92:0/990060879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7f4100100 0x7ff7f4100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:35.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.126+0000 7ff7fc564640 1 --2- 172.21.15.92:0/990060879 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7f4106b80 0x7ff7f4106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:35.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.126+0000 7ff7fc564640 1 -- 172.21.15.92:0/990060879 >> 172.21.15.92:0/990060879 conn(0x7ff7f4077230 msgr2=0x7ff7f40fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:35.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.126+0000 7ff7fc564640 1 -- 172.21.15.92:0/990060879 shutdown_connections 2024-09-19T08:54:35.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.127+0000 7ff7fc564640 1 -- 172.21.15.92:0/990060879 wait complete. 2024-09-19T08:54:35.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.127+0000 7ff7fc564640 1 Processor -- start 2024-09-19T08:54:35.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.127+0000 7ff7fc564640 1 -- start start 2024-09-19T08:54:35.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.127+0000 7ff7fc564640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7f4100100 0x7ff7f41984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:35.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.127+0000 7ff7fc564640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7f4100aa0 0x7ff7f4198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:35.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.127+0000 7ff7fc564640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7f4106b80 0x7ff7f419cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:35.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.127+0000 7ff7fc564640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f4112070 con 0x7ff7f4100aa0 2024-09-19T08:54:35.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.127+0000 7ff7fc564640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f4111ef0 con 0x7ff7f4100100 2024-09-19T08:54:35.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.127+0000 7ff7fc564640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f41121f0 con 0x7ff7f4106b80 2024-09-19T08:54:35.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.127+0000 7ff7f9aff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7f4100aa0 0x7ff7f4198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:35.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.127+0000 7ff7f9aff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7f4100aa0 0x7ff7f4198a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34118/0 (socket says 172.21.15.92:34118) 2024-09-19T08:54:35.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.128+0000 7ff7f9aff640 1 -- 172.21.15.92:0/4205378923 learned_addr learned my addr 172.21.15.92:0/4205378923 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:54:35.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.128+0000 7ff7fab01640 1 --2- 172.21.15.92:0/4205378923 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7f4106b80 0x7ff7f419cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:35.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.128+0000 7ff7fa300640 1 --2- 172.21.15.92:0/4205378923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7f4100100 0x7ff7f41984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:35.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.128+0000 7ff7f9aff640 1 -- 172.21.15.92:0/4205378923 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7f4106b80 msgr2=0x7ff7f419cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:35.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.128+0000 7ff7f9aff640 1 --2- 172.21.15.92:0/4205378923 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7f4106b80 0x7ff7f419cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:35.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.128+0000 7ff7f9aff640 1 -- 172.21.15.92:0/4205378923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7f4100100 msgr2=0x7ff7f41984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:35.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.128+0000 7ff7f9aff640 1 --2- 172.21.15.92:0/4205378923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7f4100100 0x7ff7f41984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:35.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.128+0000 7ff7f9aff640 1 -- 172.21.15.92:0/4205378923 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f419d4a0 con 0x7ff7f4100aa0 2024-09-19T08:54:35.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.128+0000 7ff7f9aff640 1 --2- 172.21.15.92:0/4205378923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7f4100aa0 0x7ff7f4198a30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400d950 tx=0x7ff7e400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:35.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.128+0000 7ff7eb7fe640 1 -- 172.21.15.92:0/4205378923 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4017070 con 0x7ff7f4100aa0 2024-09-19T08:54:35.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.128+0000 7ff7fc564640 1 -- 172.21.15.92:0/4205378923 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7f419d790 con 0x7ff7f4100aa0 2024-09-19T08:54:35.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.128+0000 7ff7eb7fe640 1 -- 172.21.15.92:0/4205378923 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7e4009c30 con 0x7ff7f4100aa0 2024-09-19T08:54:35.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.128+0000 7ff7eb7fe640 1 -- 172.21.15.92:0/4205378923 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e400f6b0 con 0x7ff7f4100aa0 2024-09-19T08:54:35.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.128+0000 7ff7fc564640 1 -- 172.21.15.92:0/4205378923 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7f41a5070 con 0x7ff7f4100aa0 2024-09-19T08:54:35.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.129+0000 7ff7fc564640 1 -- 172.21.15.92:0/4205378923 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7f4100560 con 0x7ff7f4100aa0 2024-09-19T08:54:35.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.130+0000 7ff7eb7fe640 1 -- 172.21.15.92:0/4205378923 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ff7e40109d0 con 0x7ff7f4100aa0 2024-09-19T08:54:35.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.131+0000 7ff7eb7fe640 1 --2- 172.21.15.92:0/4205378923 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff7e00a3240 0x7ff7e00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:35.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.131+0000 7ff7fa300640 1 --2- 172.21.15.92:0/4205378923 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff7e00a3240 0x7ff7e00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:35.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.131+0000 7ff7eb7fe640 1 -- 172.21.15.92:0/4205378923 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7ff7e40cf500 con 0x7ff7f4100aa0 2024-09-19T08:54:35.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.131+0000 7ff7fa300640 1 --2- 172.21.15.92:0/4205378923 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff7e00a3240 0x7ff7e00a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0009890 tx=0x7ff7f0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:35.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.135+0000 7ff7eb7fe640 1 -- 172.21.15.92:0/4205378923 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff7e4009de0 con 0x7ff7f4100aa0 2024-09-19T08:54:35.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.301+0000 7ff7fc564640 1 -- 172.21.15.92:0/4205378923 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff7f41a5300 con 0x7ff7f4100aa0 2024-09-19T08:54:35.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.302+0000 7ff7eb7fe640 1 -- 172.21.15.92:0/4205378923 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22303 (secure 0 0 0) 0x7ff7e409c370 con 0x7ff7f4100aa0 2024-09-19T08:54:35.302 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:54:35.302 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":80,"fsid":"91ff74f2-7663-11ef-bceb-c7b262605968","created":"2024-09-19T08:47:08.162150+0000","modified":"2024-09-19T08:54:31.939170+0000","last_up_change":"2024-09-19T08:53:43.021949+0000","last_in_change":"2024-09-19T08:53:19.246805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:50:04.482034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:54:28.005336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:54:30.188980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd104fe2-b828-4c98-a499-b212717f2997","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6803","nonce":4232030626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6805","nonce":4232030626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6809","nonce":4232030626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6807","nonce":4232030626}]},"public_addr":"172.21.15.92:6803/4232030626","cluster_addr":"172.21.15.92:6805/4232030626","heartbeat_back_addr":"172.21.15.92:6809/4232030626","heartbeat_front_addr":"172.21.15.92:6807/4232030626","state":["exists","up"]},{"osd":1,"uuid":"0f725330-5e61-413c-b3c8-41bc2c0d8e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6801","nonce":4163493234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6803","nonce":4163493234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6807","nonce":4163493234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6805","nonce":4163493234}]},"public_addr":"172.21.15.167:6801/4163493234","cluster_addr":"172.21.15.167:6803/4163493234","heartbeat_back_addr":"172.21.15.167:6807/4163493234","heartbeat_front_addr":"172.21.15.167:6805/4163493234","state":["exists","up"]},{"osd":2,"uuid":"286d2943-23a0-4184-93cf-9d3430781f99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6801","nonce":702507556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6803","nonce":702507556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6807","nonce":702507556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6805","nonce":702507556}]},"public_addr":"172.21.15.190:6801/702507556","cluster_addr":"172.21.15.190:6803/702507556","heartbeat_back_addr":"172.21.15.190:6807/702507556","heartbeat_front_addr":"172.21.15.190:6805/702507556","state":["exists","up"]},{"osd":3,"uuid":"9d126671-7fc1-4f29-9bc3-3598052fd20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6811","nonce":945752895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6813","nonce":945752895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6817","nonce":945752895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6815","nonce":945752895}]},"public_addr":"172.21.15.92:6811/945752895","cluster_addr":"172.21.15.92:6813/945752895","heartbeat_back_addr":"172.21.15.92:6817/945752895","heartbeat_front_addr":"172.21.15.92:6815/945752895","state":["exists","up"]},{"osd":4,"uuid":"cb10b38d-ae13-4b92-b906-3505fb873b2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6809","nonce":3576893400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6811","nonce":3576893400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6815","nonce":3576893400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6813","nonce":3576893400}]},"public_addr":"172.21.15.167:6809/3576893400","cluster_addr":"172.21.15.167:6811/3576893400","heartbeat_back_addr":"172.21.15.167:6815/3576893400","heartbeat_front_addr":"172.21.15.167:6813/3576893400","state":["exists","up"]},{"osd":5,"uuid":"cd90668b-eca5-4bb4-870e-e58578730c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6809","nonce":1880491675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6811","nonce":1880491675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6815","nonce":1880491675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6813","nonce":1880491675}]},"public_addr":"172.21.15.190:6809/1880491675","cluster_addr":"172.21.15.190:6811/1880491675","heartbeat_back_addr":"172.21.15.190:6815/1880491675","heartbeat_front_addr":"172.21.15.190:6813/1880491675","state":["exists","up"]},{"osd":6,"uuid":"4e047963-afa7-4934-b887-8086165fb831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6819","nonce":1743435653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6821","nonce":1743435653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6825","nonce":1743435653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6823","nonce":1743435653}]},"public_addr":"172.21.15.92:6819/1743435653","cluster_addr":"172.21.15.92:6821/1743435653","heartbeat_back_addr":"172.21.15.92:6825/1743435653","heartbeat_front_addr":"172.21.15.92:6823/1743435653","state":["exists","up"]},{"osd":7,"uuid":"652a6aa1-bb94-4608-952e-67cd02bdff66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6817","nonce":2984111963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6819","nonce":2984111963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6823","nonce":2984111963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6821","nonce":2984111963}]},"public_addr":"172.21.15.167:6817/2984111963","cluster_addr":"172.21.15.167:6819/2984111963","heartbeat_back_addr":"172.21.15.167:6823/2984111963","heartbeat_front_addr":"172.21.15.167:6821/2984111963","state":["exists","up"]},{"osd":8,"uuid":"1510ef1f-fdfe-4887-a771-146efce062fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6817","nonce":4190304434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6819","nonce":4190304434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6823","nonce":4190304434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6821","nonce":4190304434}]},"public_addr":"172.21.15.190:6817/4190304434","cluster_addr":"172.21.15.190:6819/4190304434","heartbeat_back_addr":"172.21.15.190:6823/4190304434","heartbeat_front_addr":"172.21.15.190:6821/4190304434","state":["exists","up"]},{"osd":9,"uuid":"9b774bbe-6700-4020-900b-3fdbaa546773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6827","nonce":3066744542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6829","nonce":3066744542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6833","nonce":3066744542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6831","nonce":3066744542}]},"public_addr":"172.21.15.92:6827/3066744542","cluster_addr":"172.21.15.92:6829/3066744542","heartbeat_back_addr":"172.21.15.92:6833/3066744542","heartbeat_front_addr":"172.21.15.92:6831/3066744542","state":["exists","up"]},{"osd":10,"uuid":"8abdb835-db2c-4597-ae1d-8ef56e63ab6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6825","nonce":2309134313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6827","nonce":2309134313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6831","nonce":2309134313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6829","nonce":2309134313}]},"public_addr":"172.21.15.167:6825/2309134313","cluster_addr":"172.21.15.167:6827/2309134313","heartbeat_back_addr":"172.21.15.167:6831/2309134313","heartbeat_front_addr":"172.21.15.167:6829/2309134313","state":["exists","up"]},{"osd":11,"uuid":"564c844a-378f-40cd-9717-cde35a65631c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6825","nonce":1849208751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6827","nonce":1849208751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6831","nonce":1849208751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6829","nonce":1849208751}]},"public_addr":"172.21.15.190:6825/1849208751","cluster_addr":"172.21.15.190:6827/1849208751","heartbeat_back_addr":"172.21.15.190:6831/1849208751","heartbeat_front_addr":"172.21.15.190:6829/1849208751","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:12.072109+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:36.689174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:01.908763+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:26.857439+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:50.881629+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:51:15.160744+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:51:39.101605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:03.179877+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:27.324563+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:51.971287+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:53:15.917311+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:53:40.592486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/2948821221":"2024-09-20T08:47:52.180093+0000","172.21.15.92:0/1441365956":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6801/2908709470":"2024-09-20T08:47:52.180093+0000","172.21.15.92:0/608374871":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6801/1369295034":"2024-09-20T08:47:29.812397+0000","172.21.15.92:6800/2908709470":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6800/1369295034":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/813486656":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/1963725565":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/1668504617":"2024-09-20T08:47:29.812397+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:54:35.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.304+0000 7ff7fc564640 1 -- 172.21.15.92:0/4205378923 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff7e00a3240 msgr2=0x7ff7e00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:35.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.304+0000 7ff7fc564640 1 --2- 172.21.15.92:0/4205378923 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff7e00a3240 0x7ff7e00a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0009890 tx=0x7ff7f0008040 comp rx=0 tx=0).stop 2024-09-19T08:54:35.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.304+0000 7ff7fc564640 1 -- 172.21.15.92:0/4205378923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7f4100aa0 msgr2=0x7ff7f4198a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:35.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.304+0000 7ff7fc564640 1 --2- 172.21.15.92:0/4205378923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7f4100aa0 0x7ff7f4198a30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400d950 tx=0x7ff7e400de10 comp rx=0 tx=0).stop 2024-09-19T08:54:35.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.304+0000 7ff7fc564640 1 -- 172.21.15.92:0/4205378923 shutdown_connections 2024-09-19T08:54:35.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.304+0000 7ff7fc564640 1 --2- 172.21.15.92:0/4205378923 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7f4106b80 0x7ff7f419cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:35.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.304+0000 7ff7fc564640 1 --2- 172.21.15.92:0/4205378923 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff7e00a3240 0x7ff7e00a5700 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:35.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.304+0000 7ff7fc564640 1 --2- 172.21.15.92:0/4205378923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7f4100aa0 0x7ff7f4198a30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:35.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.304+0000 7ff7fc564640 1 --2- 172.21.15.92:0/4205378923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7f4100100 0x7ff7f41984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:35.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.304+0000 7ff7fc564640 1 -- 172.21.15.92:0/4205378923 >> 172.21.15.92:0/4205378923 conn(0x7ff7f4077230 msgr2=0x7ff7f4104bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:35.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.304+0000 7ff7fc564640 1 -- 172.21.15.92:0/4205378923 shutdown_connections 2024-09-19T08:54:35.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:35.304+0000 7ff7fc564640 1 -- 172.21.15.92:0/4205378923 wait complete. 2024-09-19T08:54:35.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:35 smithi092 ceph-mon[31407]: pgmap v271: 97 pgs: 1 creating+activating, 9 creating+peering, 22 unknown, 65 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 632 B/s wr, 5 op/s 2024-09-19T08:54:35.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:35 smithi092 ceph-mon[31407]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T08:54:35.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:35 smithi092 ceph-mon[31407]: Cluster is now healthy 2024-09-19T08:54:35.735 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:35 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/4205378923' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:54:35.762 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-19T08:54:35.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:35 smithi167 ceph-mon[35359]: pgmap v271: 97 pgs: 1 creating+activating, 9 creating+peering, 22 unknown, 65 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 632 B/s wr, 5 op/s 2024-09-19T08:54:35.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:35 smithi167 ceph-mon[35359]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T08:54:35.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:35 smithi167 ceph-mon[35359]: Cluster is now healthy 2024-09-19T08:54:35.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:35 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/4205378923' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:54:35.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:35 smithi190 ceph-mon[35358]: pgmap v271: 97 pgs: 1 creating+activating, 9 creating+peering, 22 unknown, 65 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 632 B/s wr, 5 op/s 2024-09-19T08:54:35.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:35 smithi190 ceph-mon[35358]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T08:54:35.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:35 smithi190 ceph-mon[35358]: Cluster is now healthy 2024-09-19T08:54:35.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:35 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/4205378923' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:54:36.007 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:36.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.452+0000 7f8440512640 1 -- 172.21.15.92:0/1490141984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8438100a90 msgr2=0x7f8438100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:36.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.452+0000 7f8440512640 1 --2- 172.21.15.92:0/1490141984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8438100a90 0x7f8438100ef0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8428009930 tx=0x7f842802a420 comp rx=0 tx=0).stop 2024-09-19T08:54:36.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.452+0000 7f8440512640 1 -- 172.21.15.92:0/1490141984 shutdown_connections 2024-09-19T08:54:36.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.452+0000 7f8440512640 1 --2- 172.21.15.92:0/1490141984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8438101430 0x7f843810d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:36.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.452+0000 7f8440512640 1 --2- 172.21.15.92:0/1490141984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8438100a90 0x7f8438100ef0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:36.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.452+0000 7f8440512640 1 --2- 172.21.15.92:0/1490141984 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8438106a90 0x7f8438106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:36.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.452+0000 7f8440512640 1 -- 172.21.15.92:0/1490141984 >> 172.21.15.92:0/1490141984 conn(0x7f84380fc7d0 msgr2=0x7f84380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:36.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.452+0000 7f8440512640 1 -- 172.21.15.92:0/1490141984 shutdown_connections 2024-09-19T08:54:36.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.452+0000 7f8440512640 1 -- 172.21.15.92:0/1490141984 wait complete. 2024-09-19T08:54:36.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.453+0000 7f8440512640 1 Processor -- start 2024-09-19T08:54:36.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.453+0000 7f8440512640 1 -- start start 2024-09-19T08:54:36.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.453+0000 7f8440512640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8438100a90 0x7f84381985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:36.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.453+0000 7f8440512640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8438101430 0x7f8438198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:36.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.453+0000 7f8440512640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8438106a90 0x7f843819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:36.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.453+0000 7f8440512640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8438110f30 con 0x7f8438101430 2024-09-19T08:54:36.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.453+0000 7f8440512640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8438110db0 con 0x7f8438106a90 2024-09-19T08:54:36.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.453+0000 7f8440512640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f84381110b0 con 0x7f8438100a90 2024-09-19T08:54:36.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.453+0000 7f843daad640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8438101430 0x7f8438198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:36.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.453+0000 7f843daad640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8438101430 0x7f8438198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34128/0 (socket says 172.21.15.92:34128) 2024-09-19T08:54:36.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.453+0000 7f843daad640 1 -- 172.21.15.92:0/3441527706 learned_addr learned my addr 172.21.15.92:0/3441527706 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:54:36.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.453+0000 7f843daad640 1 -- 172.21.15.92:0/3441527706 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8438100a90 msgr2=0x7f84381985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:36.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.453+0000 7f843daad640 1 --2- 172.21.15.92:0/3441527706 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8438100a90 0x7f84381985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:36.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.453+0000 7f843daad640 1 -- 172.21.15.92:0/3441527706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8438106a90 msgr2=0x7f843819ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:36.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.453+0000 7f843daad640 1 --2- 172.21.15.92:0/3441527706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8438106a90 0x7f843819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:36.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.453+0000 7f843daad640 1 -- 172.21.15.92:0/3441527706 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f843819d550 con 0x7f8438101430 2024-09-19T08:54:36.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.454+0000 7f843daad640 1 --2- 172.21.15.92:0/3441527706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8438101430 0x7f8438198ae0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8428009a50 tx=0x7f8428004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:36.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.456+0000 7f842f7fe640 1 -- 172.21.15.92:0/3441527706 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842803f030 con 0x7f8438101430 2024-09-19T08:54:36.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.456+0000 7f842f7fe640 1 -- 172.21.15.92:0/3441527706 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8428003ce0 con 0x7f8438101430 2024-09-19T08:54:36.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.456+0000 7f842f7fe640 1 -- 172.21.15.92:0/3441527706 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8428035070 con 0x7f8438101430 2024-09-19T08:54:36.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.456+0000 7f8440512640 1 -- 172.21.15.92:0/3441527706 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f843819d7e0 con 0x7f8438101430 2024-09-19T08:54:36.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.456+0000 7f8440512640 1 -- 172.21.15.92:0/3441527706 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f843819dc70 con 0x7f8438101430 2024-09-19T08:54:36.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.457+0000 7f8440512640 1 -- 172.21.15.92:0/3441527706 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8438100f70 con 0x7f8438101430 2024-09-19T08:54:36.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.458+0000 7f842f7fe640 1 -- 172.21.15.92:0/3441527706 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f8428042030 con 0x7f8438101430 2024-09-19T08:54:36.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.459+0000 7f842f7fe640 1 --2- 172.21.15.92:0/3441527706 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f84240a32c0 0x7f84240a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:36.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.459+0000 7f843e2ae640 1 --2- 172.21.15.92:0/3441527706 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f84240a32c0 0x7f84240a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:36.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.459+0000 7f842f7fe640 1 -- 172.21.15.92:0/3441527706 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f84280efd90 con 0x7f8438101430 2024-09-19T08:54:36.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.459+0000 7f843e2ae640 1 --2- 172.21.15.92:0/3441527706 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f84240a32c0 0x7f84240a5780 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8434009710 tx=0x7f8434006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:36.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.463+0000 7f842f7fe640 1 -- 172.21.15.92:0/3441527706 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f84280bcc00 con 0x7f8438101430 2024-09-19T08:54:36.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:36.665+0000 7f8440512640 1 -- 172.21.15.92:0/3441527706 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f84381a5340 con 0x7f8438101430 2024-09-19T08:54:37.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:37.455+0000 7f842f7fe640 1 -- 172.21.15.92:0/3441527706 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f84280bc500 con 0x7f8438101430 2024-09-19T08:54:37.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:37.458+0000 7f8440512640 1 -- 172.21.15.92:0/3441527706 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f84240a32c0 msgr2=0x7f84240a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:37.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:37.458+0000 7f8440512640 1 --2- 172.21.15.92:0/3441527706 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f84240a32c0 0x7f84240a5780 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8434009710 tx=0x7f8434006c90 comp rx=0 tx=0).stop 2024-09-19T08:54:37.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:37.458+0000 7f8440512640 1 -- 172.21.15.92:0/3441527706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8438101430 msgr2=0x7f8438198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:37.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:37.458+0000 7f8440512640 1 --2- 172.21.15.92:0/3441527706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8438101430 0x7f8438198ae0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8428009a50 tx=0x7f8428004270 comp rx=0 tx=0).stop 2024-09-19T08:54:37.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:37.458+0000 7f8440512640 1 -- 172.21.15.92:0/3441527706 shutdown_connections 2024-09-19T08:54:37.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:37.458+0000 7f8440512640 1 --2- 172.21.15.92:0/3441527706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8438106a90 0x7f843819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:37.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:37.458+0000 7f8440512640 1 --2- 172.21.15.92:0/3441527706 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f84240a32c0 0x7f84240a5780 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:37.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:37.458+0000 7f8440512640 1 --2- 172.21.15.92:0/3441527706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8438101430 0x7f8438198ae0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:37.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:37.458+0000 7f8440512640 1 --2- 172.21.15.92:0/3441527706 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8438100a90 0x7f84381985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:37.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:37.458+0000 7f8440512640 1 -- 172.21.15.92:0/3441527706 >> 172.21.15.92:0/3441527706 conn(0x7f84380fc7d0 msgr2=0x7f8438104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:37.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:37.458+0000 7f8440512640 1 -- 172.21.15.92:0/3441527706 shutdown_connections 2024-09-19T08:54:37.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:37.458+0000 7f8440512640 1 -- 172.21.15.92:0/3441527706 wait complete. 2024-09-19T08:54:37.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:37 smithi092 ceph-mon[31407]: pgmap v272: 97 pgs: 6 creating+peering, 91 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-19T08:54:37.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:37 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3441527706' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T08:54:37.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:37 smithi167 ceph-mon[35359]: pgmap v272: 97 pgs: 6 creating+peering, 91 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-19T08:54:37.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:37 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3441527706' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T08:54:37.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:37 smithi190 ceph-mon[35358]: pgmap v272: 97 pgs: 6 creating+peering, 91 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-19T08:54:37.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:37 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3441527706' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T08:54:38.050 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 1, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-19T08:54:38.050 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-19T08:54:38.298 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:38.702 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:38 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3441527706' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T08:54:38.703 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:38 smithi092 ceph-mon[31407]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T08:54:38.703 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:38 smithi092 ceph-mon[31407]: pgmap v273: 97 pgs: 97 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-19T08:54:38.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.703+0000 7f682ec6d640 1 -- 172.21.15.92:0/2392998667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6828106a80 msgr2=0x7f6828106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:38.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.703+0000 7f682ec6d640 1 --2- 172.21.15.92:0/2392998667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6828106a80 0x7f6828106e60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6820009930 tx=0x7f682002a420 comp rx=0 tx=0).stop 2024-09-19T08:54:38.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.703+0000 7f682ec6d640 1 -- 172.21.15.92:0/2392998667 shutdown_connections 2024-09-19T08:54:38.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.703+0000 7f682ec6d640 1 --2- 172.21.15.92:0/2392998667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6828101420 0x7f682810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.703+0000 7f682ec6d640 1 --2- 172.21.15.92:0/2392998667 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6828100a80 0x7f6828100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.703+0000 7f682ec6d640 1 --2- 172.21.15.92:0/2392998667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6828106a80 0x7f6828106e60 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.703+0000 7f682ec6d640 1 -- 172.21.15.92:0/2392998667 >> 172.21.15.92:0/2392998667 conn(0x7f68280fc7a0 msgr2=0x7f68280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:38.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.703+0000 7f682ec6d640 1 -- 172.21.15.92:0/2392998667 shutdown_connections 2024-09-19T08:54:38.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.703+0000 7f682ec6d640 1 -- 172.21.15.92:0/2392998667 wait complete. 2024-09-19T08:54:38.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.703+0000 7f682ec6d640 1 Processor -- start 2024-09-19T08:54:38.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.703+0000 7f682ec6d640 1 -- start start 2024-09-19T08:54:38.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.704+0000 7f682ec6d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6828100a80 0x7f68281984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:38.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.704+0000 7f682ec6d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6828101420 0x7f68281989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:38.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.704+0000 7f682ec6d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6828106a80 0x7f682819cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:38.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.704+0000 7f682ec6d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6828111fa0 con 0x7f6828101420 2024-09-19T08:54:38.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.704+0000 7f682ec6d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6828111e20 con 0x7f6828106a80 2024-09-19T08:54:38.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.704+0000 7f682ec6d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6828112120 con 0x7f6828100a80 2024-09-19T08:54:38.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.704+0000 7f6827fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6828101420 0x7f68281989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:38.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.704+0000 7f6827fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6828101420 0x7f68281989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34144/0 (socket says 172.21.15.92:34144) 2024-09-19T08:54:38.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.704+0000 7f6827fff640 1 -- 172.21.15.92:0/1125290160 learned_addr learned my addr 172.21.15.92:0/1125290160 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:54:38.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.704+0000 7f682d20a640 1 --2- 172.21.15.92:0/1125290160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6828106a80 0x7f682819cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:38.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.704+0000 7f682ca09640 1 --2- 172.21.15.92:0/1125290160 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6828100a80 0x7f68281984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:38.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.704+0000 7f6827fff640 1 -- 172.21.15.92:0/1125290160 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6828100a80 msgr2=0x7f68281984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:38.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.704+0000 7f6827fff640 1 --2- 172.21.15.92:0/1125290160 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6828100a80 0x7f68281984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.704+0000 7f6827fff640 1 -- 172.21.15.92:0/1125290160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6828106a80 msgr2=0x7f682819cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:38.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.704+0000 7f6827fff640 1 --2- 172.21.15.92:0/1125290160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6828106a80 0x7f682819cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.704+0000 7f6827fff640 1 -- 172.21.15.92:0/1125290160 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f682819d450 con 0x7f6828101420 2024-09-19T08:54:38.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.704+0000 7f682ca09640 1 --2- 172.21.15.92:0/1125290160 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6828100a80 0x7f68281984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:54:38.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.704+0000 7f6827fff640 1 --2- 172.21.15.92:0/1125290160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6828101420 0x7f68281989e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f681800eab0 tx=0x7f681800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:38.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.704+0000 7f6825ffb640 1 -- 172.21.15.92:0/1125290160 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f681800ce40 con 0x7f6828101420 2024-09-19T08:54:38.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.704+0000 7f6825ffb640 1 -- 172.21.15.92:0/1125290160 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6818011950 con 0x7f6828101420 2024-09-19T08:54:38.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.704+0000 7f682ec6d640 1 -- 172.21.15.92:0/1125290160 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f682819d740 con 0x7f6828101420 2024-09-19T08:54:38.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.704+0000 7f6825ffb640 1 -- 172.21.15.92:0/1125290160 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6818010ae0 con 0x7f6828101420 2024-09-19T08:54:38.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.705+0000 7f682ec6d640 1 -- 172.21.15.92:0/1125290160 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68281a5020 con 0x7f6828101420 2024-09-19T08:54:38.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.706+0000 7f682ec6d640 1 -- 172.21.15.92:0/1125290160 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6828100ee0 con 0x7f6828101420 2024-09-19T08:54:38.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.707+0000 7f6825ffb640 1 -- 172.21.15.92:0/1125290160 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f6818011b00 con 0x7f6828101420 2024-09-19T08:54:38.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.707+0000 7f6825ffb640 1 --2- 172.21.15.92:0/1125290160 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f68140a3240 0x7f68140a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:38.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.707+0000 7f682ca09640 1 --2- 172.21.15.92:0/1125290160 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f68140a3240 0x7f68140a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:38.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.707+0000 7f6825ffb640 1 -- 172.21.15.92:0/1125290160 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f68180cffb0 con 0x7f6828101420 2024-09-19T08:54:38.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.708+0000 7f682ca09640 1 --2- 172.21.15.92:0/1125290160 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f68140a3240 0x7f68140a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6820000c00 tx=0x7f6820032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:38.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.711+0000 7f6825ffb640 1 -- 172.21.15.92:0/1125290160 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6818016030 con 0x7f6828101420 2024-09-19T08:54:38.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:38 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3441527706' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T08:54:38.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:38 smithi167 ceph-mon[35359]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T08:54:38.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:38 smithi167 ceph-mon[35359]: pgmap v273: 97 pgs: 97 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-19T08:54:38.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:38 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3441527706' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T08:54:38.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:38 smithi190 ceph-mon[35358]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T08:54:38.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:38 smithi190 ceph-mon[35358]: pgmap v273: 97 pgs: 97 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-19T08:54:38.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:38.917+0000 7f682ec6d640 1 -- 172.21.15.92:0/1125290160 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f6828108a60 con 0x7f6828101420 2024-09-19T08:54:39.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:39.474+0000 7f6825ffb640 1 -- 172.21.15.92:0/1125290160 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v17) ==== 121+0+0 (secure 0 0 0) 0x7f681809ce20 con 0x7f6828101420 2024-09-19T08:54:39.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:39.476+0000 7f682ec6d640 1 -- 172.21.15.92:0/1125290160 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f68140a3240 msgr2=0x7f68140a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:39.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:39.476+0000 7f682ec6d640 1 --2- 172.21.15.92:0/1125290160 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f68140a3240 0x7f68140a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6820000c00 tx=0x7f6820032c70 comp rx=0 tx=0).stop 2024-09-19T08:54:39.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:39.476+0000 7f682ec6d640 1 -- 172.21.15.92:0/1125290160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6828101420 msgr2=0x7f68281989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:39.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:39.476+0000 7f682ec6d640 1 --2- 172.21.15.92:0/1125290160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6828101420 0x7f68281989e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f681800eab0 tx=0x7f681800ef70 comp rx=0 tx=0).stop 2024-09-19T08:54:39.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:39.476+0000 7f682ec6d640 1 -- 172.21.15.92:0/1125290160 shutdown_connections 2024-09-19T08:54:39.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:39.476+0000 7f682ec6d640 1 --2- 172.21.15.92:0/1125290160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6828106a80 0x7f682819cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:39.476+0000 7f682ec6d640 1 --2- 172.21.15.92:0/1125290160 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f68140a3240 0x7f68140a5700 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:39.476+0000 7f682ec6d640 1 --2- 172.21.15.92:0/1125290160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6828101420 0x7f68281989e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:39.476+0000 7f682ec6d640 1 --2- 172.21.15.92:0/1125290160 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6828100a80 0x7f68281984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:39.476+0000 7f682ec6d640 1 -- 172.21.15.92:0/1125290160 >> 172.21.15.92:0/1125290160 conn(0x7f68280fc7a0 msgr2=0x7f68280fe050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:39.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:39.476+0000 7f682ec6d640 1 -- 172.21.15.92:0/1125290160 shutdown_connections 2024-09-19T08:54:39.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:39.477+0000 7f682ec6d640 1 -- 172.21.15.92:0/1125290160 wait complete. 2024-09-19T08:54:39.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:39 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1125290160' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T08:54:39.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:39 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/1125290160' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T08:54:39.876 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:39 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/1125290160' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T08:54:40.080 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-19T08:54:40.329 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:40.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:40 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1125290160' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T08:54:40.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:40 smithi092 ceph-mon[31407]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T08:54:40.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:40 smithi092 ceph-mon[31407]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T08:54:40.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:40 smithi092 ceph-mon[31407]: pgmap v274: 97 pgs: 97 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-19T08:54:40.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.751+0000 7fe2baf7d640 1 -- 172.21.15.92:0/1137597089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2b4101de0 msgr2=0x7fe2b41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:40.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.751+0000 7fe2baf7d640 1 --2- 172.21.15.92:0/1137597089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2b4101de0 0x7fe2b41021c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4009900 tx=0x7fe2a402a410 comp rx=0 tx=0).stop 2024-09-19T08:54:40.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.751+0000 7fe2baf7d640 1 -- 172.21.15.92:0/1137597089 shutdown_connections 2024-09-19T08:54:40.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.751+0000 7fe2baf7d640 1 --2- 172.21.15.92:0/1137597089 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2b4106f10 0x7fe2b410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.751+0000 7fe2baf7d640 1 --2- 172.21.15.92:0/1137597089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2b4102790 0x7fe2b41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.751+0000 7fe2baf7d640 1 --2- 172.21.15.92:0/1137597089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2b4101de0 0x7fe2b41021c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.751+0000 7fe2baf7d640 1 -- 172.21.15.92:0/1137597089 >> 172.21.15.92:0/1137597089 conn(0x7fe2b40fd8c0 msgr2=0x7fe2b40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:40.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.751+0000 7fe2baf7d640 1 -- 172.21.15.92:0/1137597089 shutdown_connections 2024-09-19T08:54:40.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.751+0000 7fe2baf7d640 1 -- 172.21.15.92:0/1137597089 wait complete. 2024-09-19T08:54:40.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.752+0000 7fe2baf7d640 1 Processor -- start 2024-09-19T08:54:40.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.752+0000 7fe2baf7d640 1 -- start start 2024-09-19T08:54:40.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.752+0000 7fe2baf7d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2b4101de0 0x7fe2b4198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:40.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.752+0000 7fe2baf7d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2b4102790 0x7fe2b4198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:40.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.752+0000 7fe2baf7d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2b4106f10 0x7fe2b419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:40.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.752+0000 7fe2baf7d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b4111f70 con 0x7fe2b4101de0 2024-09-19T08:54:40.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.752+0000 7fe2baf7d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b4111df0 con 0x7fe2b4102790 2024-09-19T08:54:40.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.752+0000 7fe2baf7d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b41120f0 con 0x7fe2b4106f10 2024-09-19T08:54:40.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.752+0000 7fe2b8d19640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2b4101de0 0x7fe2b4198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:40.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.752+0000 7fe2b8d19640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2b4101de0 0x7fe2b4198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34154/0 (socket says 172.21.15.92:34154) 2024-09-19T08:54:40.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.752+0000 7fe2b8d19640 1 -- 172.21.15.92:0/1147220102 learned_addr learned my addr 172.21.15.92:0/1147220102 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:54:40.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.753+0000 7fe2b951a640 1 --2- 172.21.15.92:0/1147220102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2b4106f10 0x7fe2b419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:40.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.753+0000 7fe2b3fff640 1 --2- 172.21.15.92:0/1147220102 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2b4102790 0x7fe2b4198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:40.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.753+0000 7fe2b8d19640 1 -- 172.21.15.92:0/1147220102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2b4106f10 msgr2=0x7fe2b419cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:40.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.753+0000 7fe2b8d19640 1 --2- 172.21.15.92:0/1147220102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2b4106f10 0x7fe2b419cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.753+0000 7fe2b8d19640 1 -- 172.21.15.92:0/1147220102 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2b4102790 msgr2=0x7fe2b4198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:40.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.753+0000 7fe2b8d19640 1 --2- 172.21.15.92:0/1147220102 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2b4102790 0x7fe2b4198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.753+0000 7fe2b8d19640 1 -- 172.21.15.92:0/1147220102 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b419d3e0 con 0x7fe2b4101de0 2024-09-19T08:54:40.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.753+0000 7fe2b951a640 1 --2- 172.21.15.92:0/1147220102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2b4106f10 0x7fe2b419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:40.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.753+0000 7fe2b3fff640 1 --2- 172.21.15.92:0/1147220102 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2b4102790 0x7fe2b4198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:54:40.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.753+0000 7fe2b8d19640 1 --2- 172.21.15.92:0/1147220102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2b4101de0 0x7fe2b4198430 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4006010 tx=0x7fe2a40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:40.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.753+0000 7fe2b1ffb640 1 -- 172.21.15.92:0/1147220102 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a403f030 con 0x7fe2b4101de0 2024-09-19T08:54:40.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.753+0000 7fe2baf7d640 1 -- 172.21.15.92:0/1147220102 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2b419d670 con 0x7fe2b4101de0 2024-09-19T08:54:40.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.753+0000 7fe2b1ffb640 1 -- 172.21.15.92:0/1147220102 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2a4003ce0 con 0x7fe2b4101de0 2024-09-19T08:54:40.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.753+0000 7fe2b1ffb640 1 -- 172.21.15.92:0/1147220102 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a4035070 con 0x7fe2b4101de0 2024-09-19T08:54:40.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.753+0000 7fe2baf7d640 1 -- 172.21.15.92:0/1147220102 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2b41a4fb0 con 0x7fe2b4101de0 2024-09-19T08:54:40.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.754+0000 7fe2baf7d640 1 -- 172.21.15.92:0/1147220102 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2b41032c0 con 0x7fe2b4101de0 2024-09-19T08:54:40.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.755+0000 7fe2b1ffb640 1 -- 172.21.15.92:0/1147220102 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe2a4042030 con 0x7fe2b4101de0 2024-09-19T08:54:40.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.756+0000 7fe2b1ffb640 1 --2- 172.21.15.92:0/1147220102 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe2a00a3240 0x7fe2a00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:40.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.756+0000 7fe2b3fff640 1 --2- 172.21.15.92:0/1147220102 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe2a00a3240 0x7fe2a00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:40.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.756+0000 7fe2b1ffb640 1 -- 172.21.15.92:0/1147220102 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fe2a40eff30 con 0x7fe2b4101de0 2024-09-19T08:54:40.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.757+0000 7fe2b3fff640 1 --2- 172.21.15.92:0/1147220102 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe2a00a3240 0x7fe2a00a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe2b40fdce0 tx=0x7fe29c0093e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:40.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.760+0000 7fe2b1ffb640 1 -- 172.21.15.92:0/1147220102 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe2a40bce60 con 0x7fe2b4101de0 2024-09-19T08:54:40.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:40 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/1125290160' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T08:54:40.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:40 smithi167 ceph-mon[35359]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T08:54:40.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:40 smithi167 ceph-mon[35359]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T08:54:40.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:40 smithi167 ceph-mon[35359]: pgmap v274: 97 pgs: 97 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-19T08:54:40.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:40 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/1125290160' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T08:54:40.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:40 smithi190 ceph-mon[35358]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T08:54:40.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:40 smithi190 ceph-mon[35358]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T08:54:40.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:40 smithi190 ceph-mon[35358]: pgmap v274: 97 pgs: 97 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-19T08:54:40.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:40.959+0000 7fe2baf7d640 1 -- 172.21.15.92:0/1147220102 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fe2b410a0f0 con 0x7fe2b4101de0 2024-09-19T08:54:41.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:41.485+0000 7fe2b1ffb640 1 -- 172.21.15.92:0/1147220102 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v19) ==== 115+0+0 (secure 0 0 0) 0x7fe2a40bc760 con 0x7fe2b4101de0 2024-09-19T08:54:41.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:41.487+0000 7fe2baf7d640 1 -- 172.21.15.92:0/1147220102 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe2a00a3240 msgr2=0x7fe2a00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:41.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:41.487+0000 7fe2baf7d640 1 --2- 172.21.15.92:0/1147220102 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe2a00a3240 0x7fe2a00a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe2b40fdce0 tx=0x7fe29c0093e0 comp rx=0 tx=0).stop 2024-09-19T08:54:41.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:41.487+0000 7fe2baf7d640 1 -- 172.21.15.92:0/1147220102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2b4101de0 msgr2=0x7fe2b4198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:41.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:41.487+0000 7fe2baf7d640 1 --2- 172.21.15.92:0/1147220102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2b4101de0 0x7fe2b4198430 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4006010 tx=0x7fe2a40042f0 comp rx=0 tx=0).stop 2024-09-19T08:54:41.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:41.487+0000 7fe2baf7d640 1 -- 172.21.15.92:0/1147220102 shutdown_connections 2024-09-19T08:54:41.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:41.487+0000 7fe2baf7d640 1 --2- 172.21.15.92:0/1147220102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2b4106f10 0x7fe2b419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:41.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:41.487+0000 7fe2baf7d640 1 --2- 172.21.15.92:0/1147220102 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2b4102790 0x7fe2b4198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:41.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:41.487+0000 7fe2baf7d640 1 --2- 172.21.15.92:0/1147220102 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe2a00a3240 0x7fe2a00a5700 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:41.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:41.487+0000 7fe2baf7d640 1 --2- 172.21.15.92:0/1147220102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2b4101de0 0x7fe2b4198430 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:41.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:41.487+0000 7fe2baf7d640 1 -- 172.21.15.92:0/1147220102 >> 172.21.15.92:0/1147220102 conn(0x7fe2b40fd8c0 msgr2=0x7fe2b40fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:41.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:41.487+0000 7fe2baf7d640 1 -- 172.21.15.92:0/1147220102 shutdown_connections 2024-09-19T08:54:41.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:41.487+0000 7fe2baf7d640 1 -- 172.21.15.92:0/1147220102 wait complete. 2024-09-19T08:54:41.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:41 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1147220102' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T08:54:41.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:41 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/1147220102' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T08:54:41.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:41 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/1147220102' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T08:54:42.057 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-09-19T08:54:42.057 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-19T08:54:42.304 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:42.707 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:42 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1147220102' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T08:54:42.707 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:42 smithi092 ceph-mon[31407]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T08:54:42.707 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:42 smithi092 ceph-mon[31407]: pgmap v275: 97 pgs: 97 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-19T08:54:42.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.715+0000 7fa05c04b640 1 -- 172.21.15.92:0/143754563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa054101420 msgr2=0x7fa05410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:42.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.715+0000 7fa05c04b640 1 --2- 172.21.15.92:0/143754563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa054101420 0x7fa05410d950 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa04c009930 tx=0x7fa04c02a420 comp rx=0 tx=0).stop 2024-09-19T08:54:42.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.715+0000 7fa05c04b640 1 -- 172.21.15.92:0/143754563 shutdown_connections 2024-09-19T08:54:42.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.715+0000 7fa05c04b640 1 --2- 172.21.15.92:0/143754563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa054101420 0x7fa05410d950 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:42.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.715+0000 7fa05c04b640 1 --2- 172.21.15.92:0/143754563 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa054100a80 0x7fa054100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:42.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.715+0000 7fa05c04b640 1 --2- 172.21.15.92:0/143754563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa054106a80 0x7fa054106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:42.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.715+0000 7fa05c04b640 1 -- 172.21.15.92:0/143754563 >> 172.21.15.92:0/143754563 conn(0x7fa0540fc7a0 msgr2=0x7fa0540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:42.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.715+0000 7fa05c04b640 1 -- 172.21.15.92:0/143754563 shutdown_connections 2024-09-19T08:54:42.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.715+0000 7fa05c04b640 1 -- 172.21.15.92:0/143754563 wait complete. 2024-09-19T08:54:42.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.716+0000 7fa05c04b640 1 Processor -- start 2024-09-19T08:54:42.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.716+0000 7fa05c04b640 1 -- start start 2024-09-19T08:54:42.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.716+0000 7fa05c04b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa054100a80 0x7fa0540fcd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:42.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.716+0000 7fa05c04b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa054101420 0x7fa0540fd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:42.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.716+0000 7fa05c04b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa054106a80 0x7fa0540fd800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:42.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.716+0000 7fa05c04b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa054110ec0 con 0x7fa054106a80 2024-09-19T08:54:42.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.716+0000 7fa05c04b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa054110d40 con 0x7fa054101420 2024-09-19T08:54:42.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.716+0000 7fa05c04b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa054111040 con 0x7fa054100a80 2024-09-19T08:54:42.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.716+0000 7fa05a5e8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa054106a80 0x7fa0540fd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:42.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.716+0000 7fa05a5e8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa054106a80 0x7fa0540fd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52572/0 (socket says 172.21.15.92:52572) 2024-09-19T08:54:42.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.716+0000 7fa05a5e8640 1 -- 172.21.15.92:0/2297274959 learned_addr learned my addr 172.21.15.92:0/2297274959 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:54:42.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.716+0000 7fa0595e6640 1 --2- 172.21.15.92:0/2297274959 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa054101420 0x7fa0540fd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:42.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.716+0000 7fa059de7640 1 --2- 172.21.15.92:0/2297274959 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa054100a80 0x7fa0540fcd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:42.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.716+0000 7fa05a5e8640 1 -- 172.21.15.92:0/2297274959 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa054100a80 msgr2=0x7fa0540fcd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:42.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.716+0000 7fa05a5e8640 1 --2- 172.21.15.92:0/2297274959 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa054100a80 0x7fa0540fcd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:42.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.716+0000 7fa05a5e8640 1 -- 172.21.15.92:0/2297274959 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa054101420 msgr2=0x7fa0540fd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:42.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.717+0000 7fa05a5e8640 1 --2- 172.21.15.92:0/2297274959 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa054101420 0x7fa0540fd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:42.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.717+0000 7fa05a5e8640 1 -- 172.21.15.92:0/2297274959 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0541a69a0 con 0x7fa054106a80 2024-09-19T08:54:42.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.717+0000 7fa05a5e8640 1 --2- 172.21.15.92:0/2297274959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa054106a80 0x7fa0540fd800 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa04c005ab0 tx=0x7fa04c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:42.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.717+0000 7fa04affd640 1 -- 172.21.15.92:0/2297274959 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04c03f030 con 0x7fa054106a80 2024-09-19T08:54:42.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.717+0000 7fa04affd640 1 -- 172.21.15.92:0/2297274959 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa04c003ce0 con 0x7fa054106a80 2024-09-19T08:54:42.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.717+0000 7fa05c04b640 1 -- 172.21.15.92:0/2297274959 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0541a6c30 con 0x7fa054106a80 2024-09-19T08:54:42.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.717+0000 7fa04affd640 1 -- 172.21.15.92:0/2297274959 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04c035070 con 0x7fa054106a80 2024-09-19T08:54:42.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.717+0000 7fa05c04b640 1 -- 172.21.15.92:0/2297274959 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0541a7110 con 0x7fa054106a80 2024-09-19T08:54:42.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.718+0000 7fa05c04b640 1 -- 172.21.15.92:0/2297274959 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa054100ee0 con 0x7fa054106a80 2024-09-19T08:54:42.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.719+0000 7fa04affd640 1 -- 172.21.15.92:0/2297274959 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fa04c042030 con 0x7fa054106a80 2024-09-19T08:54:42.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.720+0000 7fa04affd640 1 --2- 172.21.15.92:0/2297274959 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa0400a3240 0x7fa0400a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:42.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.720+0000 7fa059de7640 1 --2- 172.21.15.92:0/2297274959 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa0400a3240 0x7fa0400a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:42.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.720+0000 7fa04affd640 1 -- 172.21.15.92:0/2297274959 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fa04c0f00a0 con 0x7fa054106a80 2024-09-19T08:54:42.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.720+0000 7fa059de7640 1 --2- 172.21.15.92:0/2297274959 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa0400a3240 0x7fa0400a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa050009f20 tx=0x7fa0500094f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:42.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.723+0000 7fa04affd640 1 -- 172.21.15.92:0/2297274959 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa04c0bcf10 con 0x7fa054106a80 2024-09-19T08:54:42.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:42 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/1147220102' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T08:54:42.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:42 smithi167 ceph-mon[35359]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T08:54:42.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:42 smithi167 ceph-mon[35359]: pgmap v275: 97 pgs: 97 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-19T08:54:42.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:42 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/1147220102' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T08:54:42.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:42 smithi190 ceph-mon[35358]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T08:54:42.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:42 smithi190 ceph-mon[35358]: pgmap v275: 97 pgs: 97 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-19T08:54:42.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.911+0000 7fa05c04b640 1 -- 172.21.15.92:0/2297274959 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fa05410a090 con 0x7fa0400a3240 2024-09-19T08:54:42.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.930+0000 7fa04affd640 1 -- 172.21.15.92:0/2297274959 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa0500173f0 con 0x7fa0400a3240 2024-09-19T08:54:42.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.932+0000 7fa05c04b640 1 -- 172.21.15.92:0/2297274959 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa0400a3240 msgr2=0x7fa0400a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:42.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.932+0000 7fa05c04b640 1 --2- 172.21.15.92:0/2297274959 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa0400a3240 0x7fa0400a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa050009f20 tx=0x7fa0500094f0 comp rx=0 tx=0).stop 2024-09-19T08:54:42.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.932+0000 7fa05c04b640 1 -- 172.21.15.92:0/2297274959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa054106a80 msgr2=0x7fa0540fd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:42.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.932+0000 7fa05c04b640 1 --2- 172.21.15.92:0/2297274959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa054106a80 0x7fa0540fd800 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa04c005ab0 tx=0x7fa04c0042f0 comp rx=0 tx=0).stop 2024-09-19T08:54:42.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.932+0000 7fa05c04b640 1 -- 172.21.15.92:0/2297274959 shutdown_connections 2024-09-19T08:54:42.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.932+0000 7fa05c04b640 1 --2- 172.21.15.92:0/2297274959 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa0400a3240 0x7fa0400a5700 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:42.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.932+0000 7fa05c04b640 1 --2- 172.21.15.92:0/2297274959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa054106a80 0x7fa0540fd800 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:42.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.932+0000 7fa05c04b640 1 --2- 172.21.15.92:0/2297274959 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa054101420 0x7fa0540fd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:42.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.932+0000 7fa05c04b640 1 --2- 172.21.15.92:0/2297274959 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa054100a80 0x7fa0540fcd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:42.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.932+0000 7fa05c04b640 1 -- 172.21.15.92:0/2297274959 >> 172.21.15.92:0/2297274959 conn(0x7fa0540fc7a0 msgr2=0x7fa05406aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:42.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.932+0000 7fa05c04b640 1 -- 172.21.15.92:0/2297274959 shutdown_connections 2024-09-19T08:54:42.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:42.932+0000 7fa05c04b640 1 -- 172.21.15.92:0/2297274959 wait complete. 2024-09-19T08:54:43.003 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:54:42 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:54:42.916+0000 7fa8a1ffa640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:54:43.003 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:54:42 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:54:42.916+0000 7fa8a1ffa640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:54:43.003 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:54:42 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:54:42.916+0000 7fa8a1ffa640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:54:43.003 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:54:42 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:54:42.916+0000 7fa8a1ffa640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:54:43.003 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 08:54:42 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T08:54:42.916+0000 7fa8a1ffa640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:54:43.570 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:43 smithi092 ceph-mon[31407]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:43.600 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-19T08:54:43.846 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:43.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:43 smithi167 ceph-mon[35359]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:43.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:43 smithi190 ceph-mon[35358]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:44.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.291+0000 7f41c64c2640 1 -- 172.21.15.92:0/854816303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41c0100a80 msgr2=0x7f41c0100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:44.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.291+0000 7f41c64c2640 1 --2- 172.21.15.92:0/854816303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41c0100a80 0x7f41c0100ee0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f41a8009930 tx=0x7f41a802a420 comp rx=0 tx=0).stop 2024-09-19T08:54:44.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.291+0000 7f41c64c2640 1 -- 172.21.15.92:0/854816303 shutdown_connections 2024-09-19T08:54:44.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.291+0000 7f41c64c2640 1 --2- 172.21.15.92:0/854816303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f41c0101420 0x7f41c010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.291+0000 7f41c64c2640 1 --2- 172.21.15.92:0/854816303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41c0100a80 0x7f41c0100ee0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.291+0000 7f41c64c2640 1 --2- 172.21.15.92:0/854816303 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41c0106a80 0x7f41c0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.291+0000 7f41c64c2640 1 -- 172.21.15.92:0/854816303 >> 172.21.15.92:0/854816303 conn(0x7f41c00fc7a0 msgr2=0x7f41c00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:44.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.291+0000 7f41c64c2640 1 -- 172.21.15.92:0/854816303 shutdown_connections 2024-09-19T08:54:44.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.291+0000 7f41c64c2640 1 -- 172.21.15.92:0/854816303 wait complete. 2024-09-19T08:54:44.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.292+0000 7f41c64c2640 1 Processor -- start 2024-09-19T08:54:44.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.292+0000 7f41c64c2640 1 -- start start 2024-09-19T08:54:44.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.292+0000 7f41c64c2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41c0100a80 0x7f41c0198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:44.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.292+0000 7f41c64c2640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41c0101420 0x7f41c0198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:44.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.292+0000 7f41c64c2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f41c0106a80 0x7f41c019cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:44.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.292+0000 7f41c64c2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f41c0110e80 con 0x7f41c0100a80 2024-09-19T08:54:44.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.292+0000 7f41c64c2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f41c0110d00 con 0x7f41c0106a80 2024-09-19T08:54:44.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.292+0000 7f41c64c2640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f41c0111000 con 0x7f41c0101420 2024-09-19T08:54:44.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.292+0000 7f41bffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41c0100a80 0x7f41c0198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:44.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.292+0000 7f41bffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41c0100a80 0x7f41c0198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52584/0 (socket says 172.21.15.92:52584) 2024-09-19T08:54:44.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.292+0000 7f41bffff640 1 -- 172.21.15.92:0/1673031895 learned_addr learned my addr 172.21.15.92:0/1673031895 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:54:44.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.292+0000 7f41b7fff640 1 --2- 172.21.15.92:0/1673031895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41c0101420 0x7f41c0198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:44.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.292+0000 7f41c4a5f640 1 --2- 172.21.15.92:0/1673031895 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f41c0106a80 0x7f41c019cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:44.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.293+0000 7f41bffff640 1 -- 172.21.15.92:0/1673031895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41c0101420 msgr2=0x7f41c0198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:44.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.293+0000 7f41bffff640 1 --2- 172.21.15.92:0/1673031895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41c0101420 0x7f41c0198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.293+0000 7f41bffff640 1 -- 172.21.15.92:0/1673031895 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f41c0106a80 msgr2=0x7f41c019cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:44.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.293+0000 7f41bffff640 1 --2- 172.21.15.92:0/1673031895 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f41c0106a80 0x7f41c019cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.293+0000 7f41bffff640 1 -- 172.21.15.92:0/1673031895 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c019d2e0 con 0x7f41c0100a80 2024-09-19T08:54:44.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.293+0000 7f41c4a5f640 1 --2- 172.21.15.92:0/1673031895 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f41c0106a80 0x7f41c019cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:44.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.293+0000 7f41bffff640 1 --2- 172.21.15.92:0/1673031895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41c0100a80 0x7f41c0198330 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f41b000c920 tx=0x7f41b000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:44.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.293+0000 7f41bdffb640 1 -- 172.21.15.92:0/1673031895 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b0007c70 con 0x7f41c0100a80 2024-09-19T08:54:44.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.293+0000 7f41bdffb640 1 -- 172.21.15.92:0/1673031895 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41b0007e10 con 0x7f41c0100a80 2024-09-19T08:54:44.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.293+0000 7f41bdffb640 1 -- 172.21.15.92:0/1673031895 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b0018890 con 0x7f41c0100a80 2024-09-19T08:54:44.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.293+0000 7f41c64c2640 1 -- 172.21.15.92:0/1673031895 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41c019d5d0 con 0x7f41c0100a80 2024-09-19T08:54:44.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.293+0000 7f41c64c2640 1 -- 172.21.15.92:0/1673031895 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41c01a4eb0 con 0x7f41c0100a80 2024-09-19T08:54:44.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.294+0000 7f41c64c2640 1 -- 172.21.15.92:0/1673031895 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41c0100ee0 con 0x7f41c0100a80 2024-09-19T08:54:44.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.295+0000 7f41bdffb640 1 -- 172.21.15.92:0/1673031895 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f41b0018a70 con 0x7f41c0100a80 2024-09-19T08:54:44.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.296+0000 7f41bdffb640 1 --2- 172.21.15.92:0/1673031895 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f41ac0a3240 0x7f41ac0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:44.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.296+0000 7f41b7fff640 1 --2- 172.21.15.92:0/1673031895 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f41ac0a3240 0x7f41ac0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:44.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.296+0000 7f41bdffb640 1 -- 172.21.15.92:0/1673031895 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f41b00cf890 con 0x7f41c0100a80 2024-09-19T08:54:44.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.297+0000 7f41b7fff640 1 --2- 172.21.15.92:0/1673031895 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f41ac0a3240 0x7f41ac0a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f41a8009900 tx=0x7f41a80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:44.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.300+0000 7f41bdffb640 1 -- 172.21.15.92:0/1673031895 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f41b0014030 con 0x7f41c0100a80 2024-09-19T08:54:44.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.493+0000 7f41c64c2640 1 -- 172.21.15.92:0/1673031895 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f41c0062630 con 0x7f41ac0a3240 2024-09-19T08:54:44.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.507+0000 7f41bdffb640 1 -- 172.21.15.92:0/1673031895 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f41b0098670 con 0x7f41c0100a80 2024-09-19T08:54:44.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.525+0000 7f41bdffb640 1 -- 172.21.15.92:0/1673031895 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f41c0062630 con 0x7f41ac0a3240 2024-09-19T08:54:44.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.527+0000 7f41c64c2640 1 -- 172.21.15.92:0/1673031895 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f41ac0a3240 msgr2=0x7f41ac0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:44.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.527+0000 7f41c64c2640 1 --2- 172.21.15.92:0/1673031895 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f41ac0a3240 0x7f41ac0a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f41a8009900 tx=0x7f41a80058d0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.527+0000 7f41c64c2640 1 -- 172.21.15.92:0/1673031895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41c0100a80 msgr2=0x7f41c0198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:44.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.527+0000 7f41c64c2640 1 --2- 172.21.15.92:0/1673031895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41c0100a80 0x7f41c0198330 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f41b000c920 tx=0x7f41b000cde0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.527+0000 7f41c64c2640 1 -- 172.21.15.92:0/1673031895 shutdown_connections 2024-09-19T08:54:44.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.527+0000 7f41c64c2640 1 --2- 172.21.15.92:0/1673031895 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f41c0106a80 0x7f41c019cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.527+0000 7f41c64c2640 1 --2- 172.21.15.92:0/1673031895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41c0101420 0x7f41c0198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.527+0000 7f41c64c2640 1 --2- 172.21.15.92:0/1673031895 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f41ac0a3240 0x7f41ac0a5700 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.527+0000 7f41c64c2640 1 --2- 172.21.15.92:0/1673031895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41c0100a80 0x7f41c0198330 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:44.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.527+0000 7f41c64c2640 1 -- 172.21.15.92:0/1673031895 >> 172.21.15.92:0/1673031895 conn(0x7f41c00fc7a0 msgr2=0x7f41c006a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:44.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.527+0000 7f41c64c2640 1 -- 172.21.15.92:0/1673031895 shutdown_connections 2024-09-19T08:54:44.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:44.527+0000 7f41c64c2640 1 -- 172.21.15.92:0/1673031895 wait complete. 2024-09-19T08:54:44.536 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:44 smithi092 ceph-mon[31407]: pgmap v276: 97 pgs: 97 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 778 B/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-19T08:54:44.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:44 smithi167 ceph-mon[35359]: pgmap v276: 97 pgs: 97 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 778 B/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-19T08:54:44.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:44 smithi190 ceph-mon[35358]: pgmap v276: 97 pgs: 97 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 778 B/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-19T08:54:45.224 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-19T08:54:45.471 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:45.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:45 smithi092 ceph-mon[31407]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:45.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:45 smithi092 ceph-mon[31407]: mgrmap e17: x(active, since 6m), standbys: z, y 2024-09-19T08:54:45.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:45 smithi167 ceph-mon[35359]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:45.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:45 smithi167 ceph-mon[35359]: mgrmap e17: x(active, since 6m), standbys: z, y 2024-09-19T08:54:45.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:45 smithi190 ceph-mon[35358]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:45.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:45 smithi190 ceph-mon[35358]: mgrmap e17: x(active, since 6m), standbys: z, y 2024-09-19T08:54:45.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.920+0000 7f08b15b5640 1 -- 172.21.15.92:0/891726633 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08ac102110 msgr2=0x7f08ac10d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:45.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.920+0000 7f08b15b5640 1 --2- 172.21.15.92:0/891726633 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08ac102110 0x7f08ac10d890 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f08a4009ca0 tx=0x7f08a402a950 comp rx=0 tx=0).stop 2024-09-19T08:54:45.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.920+0000 7f08b15b5640 1 -- 172.21.15.92:0/891726633 shutdown_connections 2024-09-19T08:54:45.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.920+0000 7f08b15b5640 1 --2- 172.21.15.92:0/891726633 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08ac102110 0x7f08ac10d890 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:45.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.920+0000 7f08b15b5640 1 --2- 172.21.15.92:0/891726633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08ac101790 0x7f08ac101bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:45.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.920+0000 7f08b15b5640 1 --2- 172.21.15.92:0/891726633 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08ac105ba0 0x7f08ac105f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:45.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.920+0000 7f08b15b5640 1 -- 172.21.15.92:0/891726633 >> 172.21.15.92:0/891726633 conn(0x7f08ac077210 msgr2=0x7f08ac077620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:45.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.920+0000 7f08b15b5640 1 -- 172.21.15.92:0/891726633 shutdown_connections 2024-09-19T08:54:45.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.920+0000 7f08b15b5640 1 -- 172.21.15.92:0/891726633 wait complete. 2024-09-19T08:54:45.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.921+0000 7f08b15b5640 1 Processor -- start 2024-09-19T08:54:45.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.921+0000 7f08b15b5640 1 -- start start 2024-09-19T08:54:45.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.921+0000 7f08b15b5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08ac101790 0x7f08ac198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:45.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.921+0000 7f08b15b5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08ac102110 0x7f08ac198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:45.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.921+0000 7f08b15b5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08ac105ba0 0x7f08ac19cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:45.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.921+0000 7f08b15b5640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f08ac110e60 con 0x7f08ac102110 2024-09-19T08:54:45.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.921+0000 7f08b15b5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f08ac110ce0 con 0x7f08ac101790 2024-09-19T08:54:45.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.921+0000 7f08b15b5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f08ac110fe0 con 0x7f08ac105ba0 2024-09-19T08:54:45.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.921+0000 7f08a3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08ac102110 0x7f08ac198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:45.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.921+0000 7f08a3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08ac102110 0x7f08ac198750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52594/0 (socket says 172.21.15.92:52594) 2024-09-19T08:54:45.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.921+0000 7f08a3fff640 1 -- 172.21.15.92:0/3325635912 learned_addr learned my addr 172.21.15.92:0/3325635912 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:54:45.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.921+0000 7f08a3fff640 1 -- 172.21.15.92:0/3325635912 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08ac105ba0 msgr2=0x7f08ac19cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:45.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.921+0000 7f08a3fff640 1 --2- 172.21.15.92:0/3325635912 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08ac105ba0 0x7f08ac19cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:45.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.921+0000 7f08a3fff640 1 -- 172.21.15.92:0/3325635912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08ac101790 msgr2=0x7f08ac198210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:45.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.921+0000 7f08aaffd640 1 --2- 172.21.15.92:0/3325635912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08ac101790 0x7f08ac198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:45.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.921+0000 7f08a3fff640 1 --2- 172.21.15.92:0/3325635912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08ac101790 0x7f08ac198210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:45.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.922+0000 7f08a3fff640 1 -- 172.21.15.92:0/3325635912 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08ac19d1c0 con 0x7f08ac102110 2024-09-19T08:54:45.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.922+0000 7f08a3fff640 1 --2- 172.21.15.92:0/3325635912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08ac102110 0x7f08ac198750 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f089400c920 tx=0x7f089400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:45.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.922+0000 7f08a8ff9640 1 -- 172.21.15.92:0/3325635912 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0894007c70 con 0x7f08ac102110 2024-09-19T08:54:45.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.922+0000 7f08a8ff9640 1 -- 172.21.15.92:0/3325635912 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0894007e10 con 0x7f08ac102110 2024-09-19T08:54:45.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.922+0000 7f08b15b5640 1 -- 172.21.15.92:0/3325635912 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08ac19d4b0 con 0x7f08ac102110 2024-09-19T08:54:45.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.922+0000 7f08a8ff9640 1 -- 172.21.15.92:0/3325635912 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0894018890 con 0x7f08ac102110 2024-09-19T08:54:45.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.922+0000 7f08b15b5640 1 -- 172.21.15.92:0/3325635912 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08ac1a4d90 con 0x7f08ac102110 2024-09-19T08:54:45.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.923+0000 7f08b15b5640 1 -- 172.21.15.92:0/3325635912 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08ac101bd0 con 0x7f08ac102110 2024-09-19T08:54:45.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.924+0000 7f08a8ff9640 1 -- 172.21.15.92:0/3325635912 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f0894018a50 con 0x7f08ac102110 2024-09-19T08:54:45.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.925+0000 7f08a8ff9640 1 --2- 172.21.15.92:0/3325635912 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f08980a32d0 0x7f08980a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:45.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.925+0000 7f08aaffd640 1 --2- 172.21.15.92:0/3325635912 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f08980a32d0 0x7f08980a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:45.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.925+0000 7f08a8ff9640 1 -- 172.21.15.92:0/3325635912 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f08940cfae0 con 0x7f08ac102110 2024-09-19T08:54:45.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.925+0000 7f08aaffd640 1 --2- 172.21.15.92:0/3325635912 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f08980a32d0 0x7f08980a5790 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f089c00ba40 tx=0x7f089c005cc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:45.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:45.929+0000 7f08a8ff9640 1 -- 172.21.15.92:0/3325635912 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0894014030 con 0x7f08ac102110 2024-09-19T08:54:46.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:46.120+0000 7f08b15b5640 1 -- 172.21.15.92:0/3325635912 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f08ac0ff730 con 0x7f08980a32d0 2024-09-19T08:54:46.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:46.125+0000 7f08a8ff9640 1 -- 172.21.15.92:0/3325635912 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f08ac0ff730 con 0x7f08980a32d0 2024-09-19T08:54:46.125 INFO:teuthology.orchestra.run.smithi092.stdout:/volumes/qa/sv_0/fd75d036-e68c-429b-bea4-b20705d99edf 2024-09-19T08:54:46.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:46.127+0000 7f08b15b5640 1 -- 172.21.15.92:0/3325635912 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f08980a32d0 msgr2=0x7f08980a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:46.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:46.127+0000 7f08b15b5640 1 --2- 172.21.15.92:0/3325635912 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f08980a32d0 0x7f08980a5790 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f089c00ba40 tx=0x7f089c005cc0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:46.127+0000 7f08b15b5640 1 -- 172.21.15.92:0/3325635912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08ac102110 msgr2=0x7f08ac198750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:46.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:46.127+0000 7f08b15b5640 1 --2- 172.21.15.92:0/3325635912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08ac102110 0x7f08ac198750 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f089400c920 tx=0x7f089400cde0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:46.127+0000 7f08b15b5640 1 -- 172.21.15.92:0/3325635912 shutdown_connections 2024-09-19T08:54:46.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:46.127+0000 7f08b15b5640 1 --2- 172.21.15.92:0/3325635912 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08ac105ba0 0x7f08ac19cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:46.127+0000 7f08b15b5640 1 --2- 172.21.15.92:0/3325635912 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f08980a32d0 0x7f08980a5790 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:46.127+0000 7f08b15b5640 1 --2- 172.21.15.92:0/3325635912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08ac102110 0x7f08ac198750 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:46.127+0000 7f08b15b5640 1 --2- 172.21.15.92:0/3325635912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08ac101790 0x7f08ac198210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:46.127+0000 7f08b15b5640 1 -- 172.21.15.92:0/3325635912 >> 172.21.15.92:0/3325635912 conn(0x7f08ac077210 msgr2=0x7f08ac0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:46.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:46.127+0000 7f08b15b5640 1 -- 172.21.15.92:0/3325635912 shutdown_connections 2024-09-19T08:54:46.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:46.127+0000 7f08b15b5640 1 -- 172.21.15.92:0/3325635912 wait complete. 2024-09-19T08:54:46.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:46 smithi092 ceph-mon[31407]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:46.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:46 smithi092 ceph-mon[31407]: pgmap v277: 97 pgs: 97 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1023 B/s wr, 2 op/s 2024-09-19T08:54:46.761 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-19T08:54:46.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:46 smithi167 ceph-mon[35359]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:46.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:46 smithi167 ceph-mon[35359]: pgmap v277: 97 pgs: 97 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1023 B/s wr, 2 op/s 2024-09-19T08:54:46.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:46 smithi190 ceph-mon[35358]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:46.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:46 smithi190 ceph-mon[35358]: pgmap v277: 97 pgs: 97 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1023 B/s wr, 2 op/s 2024-09-19T08:54:47.005 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:47.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.431+0000 7f8ab84c1640 1 -- 172.21.15.92:0/3313161557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ab0102ef0 msgr2=0x7f8ab010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:47.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.431+0000 7f8ab84c1640 1 --2- 172.21.15.92:0/3313161557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ab0102ef0 0x7f8ab010da40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8009ca0 tx=0x7f8aa802a950 comp rx=0 tx=0).stop 2024-09-19T08:54:47.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.432+0000 7f8ab84c1640 1 -- 172.21.15.92:0/3313161557 shutdown_connections 2024-09-19T08:54:47.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.432+0000 7f8ab84c1640 1 --2- 172.21.15.92:0/3313161557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ab0102ef0 0x7f8ab010da40 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.432+0000 7f8ab84c1640 1 --2- 172.21.15.92:0/3313161557 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ab0102570 0x7f8ab01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.432+0000 7f8ab84c1640 1 --2- 172.21.15.92:0/3313161557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ab0100e20 0x7f8ab0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.432+0000 7f8ab84c1640 1 -- 172.21.15.92:0/3313161557 >> 172.21.15.92:0/3313161557 conn(0x7f8ab00fc7d0 msgr2=0x7f8ab00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:47.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.432+0000 7f8ab84c1640 1 -- 172.21.15.92:0/3313161557 shutdown_connections 2024-09-19T08:54:47.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.432+0000 7f8ab84c1640 1 -- 172.21.15.92:0/3313161557 wait complete. 2024-09-19T08:54:47.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.432+0000 7f8ab84c1640 1 Processor -- start 2024-09-19T08:54:47.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.432+0000 7f8ab84c1640 1 -- start start 2024-09-19T08:54:47.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.433+0000 7f8ab84c1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ab0100e20 0x7f8ab0198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:47.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.433+0000 7f8ab84c1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ab0102570 0x7f8ab0198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:47.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.433+0000 7f8ab84c1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ab0102ef0 0x7f8ab019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:47.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.433+0000 7f8ab84c1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab0110fd0 con 0x7f8ab0100e20 2024-09-19T08:54:47.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.433+0000 7f8ab84c1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab0110e50 con 0x7f8ab0102ef0 2024-09-19T08:54:47.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.433+0000 7f8ab84c1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab0111150 con 0x7f8ab0102570 2024-09-19T08:54:47.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.433+0000 7f8ab625d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ab0100e20 0x7f8ab0198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:47.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.433+0000 7f8ab625d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ab0100e20 0x7f8ab0198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52616/0 (socket says 172.21.15.92:52616) 2024-09-19T08:54:47.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.433+0000 7f8ab625d640 1 -- 172.21.15.92:0/3112829952 learned_addr learned my addr 172.21.15.92:0/3112829952 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:54:47.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.433+0000 7f8ab5a5c640 1 --2- 172.21.15.92:0/3112829952 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ab0102570 0x7f8ab0198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:47.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.433+0000 7f8ab6a5e640 1 --2- 172.21.15.92:0/3112829952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ab0102ef0 0x7f8ab019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:47.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.433+0000 7f8ab625d640 1 -- 172.21.15.92:0/3112829952 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ab0102570 msgr2=0x7f8ab0198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:47.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.433+0000 7f8ab625d640 1 --2- 172.21.15.92:0/3112829952 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ab0102570 0x7f8ab0198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.433+0000 7f8ab625d640 1 -- 172.21.15.92:0/3112829952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ab0102ef0 msgr2=0x7f8ab019cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:47.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.433+0000 7f8ab625d640 1 --2- 172.21.15.92:0/3112829952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ab0102ef0 0x7f8ab019cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.433+0000 7f8ab625d640 1 -- 172.21.15.92:0/3112829952 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab019d3f0 con 0x7f8ab0100e20 2024-09-19T08:54:47.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.433+0000 7f8ab625d640 1 --2- 172.21.15.92:0/3112829952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ab0100e20 0x7f8ab0198440 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8aac00e9f0 tx=0x7f8aac00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:47.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.434+0000 7f8aa77fe640 1 -- 172.21.15.92:0/3112829952 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aac00cd80 con 0x7f8ab0100e20 2024-09-19T08:54:47.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.434+0000 7f8aa77fe640 1 -- 172.21.15.92:0/3112829952 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8aac010910 con 0x7f8ab0100e20 2024-09-19T08:54:47.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.434+0000 7f8ab84c1640 1 -- 172.21.15.92:0/3112829952 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ab019d6e0 con 0x7f8ab0100e20 2024-09-19T08:54:47.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.434+0000 7f8aa77fe640 1 -- 172.21.15.92:0/3112829952 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aac018990 con 0x7f8ab0100e20 2024-09-19T08:54:47.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.434+0000 7f8ab84c1640 1 -- 172.21.15.92:0/3112829952 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ab01a4fc0 con 0x7f8ab0100e20 2024-09-19T08:54:47.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.435+0000 7f8ab84c1640 1 -- 172.21.15.92:0/3112829952 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ab0101200 con 0x7f8ab0100e20 2024-09-19T08:54:47.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.436+0000 7f8aa77fe640 1 -- 172.21.15.92:0/3112829952 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8aac010ac0 con 0x7f8ab0100e20 2024-09-19T08:54:47.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.437+0000 7f8aa77fe640 1 --2- 172.21.15.92:0/3112829952 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8a9c0a3420 0x7f8a9c0a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:47.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.437+0000 7f8ab5a5c640 1 --2- 172.21.15.92:0/3112829952 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8a9c0a3420 0x7f8a9c0a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:47.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.437+0000 7f8aa77fe640 1 -- 172.21.15.92:0/3112829952 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f8aac0cff30 con 0x7f8ab0100e20 2024-09-19T08:54:47.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.438+0000 7f8ab5a5c640 1 --2- 172.21.15.92:0/3112829952 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8a9c0a3420 0x7f8a9c0a58e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8ab01051a0 tx=0x7f8aa000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:47.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.440+0000 7f8aa77fe640 1 -- 172.21.15.92:0/3112829952 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8aac09c650 con 0x7f8ab0100e20 2024-09-19T08:54:47.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.633+0000 7f8ab84c1640 1 -- 172.21.15.92:0/3112829952 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f8ab0062630 con 0x7f8a9c0a3420 2024-09-19T08:54:47.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.662+0000 7f8aa77fe640 1 -- 172.21.15.92:0/3112829952 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8ab0062630 con 0x7f8a9c0a3420 2024-09-19T08:54:47.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.665+0000 7f8ab84c1640 1 -- 172.21.15.92:0/3112829952 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8a9c0a3420 msgr2=0x7f8a9c0a58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:47.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.665+0000 7f8ab84c1640 1 --2- 172.21.15.92:0/3112829952 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8a9c0a3420 0x7f8a9c0a58e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8ab01051a0 tx=0x7f8aa000b390 comp rx=0 tx=0).stop 2024-09-19T08:54:47.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.665+0000 7f8ab84c1640 1 -- 172.21.15.92:0/3112829952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ab0100e20 msgr2=0x7f8ab0198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:47.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.665+0000 7f8ab84c1640 1 --2- 172.21.15.92:0/3112829952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ab0100e20 0x7f8ab0198440 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8aac00e9f0 tx=0x7f8aac00eeb0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.665+0000 7f8ab84c1640 1 -- 172.21.15.92:0/3112829952 shutdown_connections 2024-09-19T08:54:47.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.665+0000 7f8ab84c1640 1 --2- 172.21.15.92:0/3112829952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ab0102ef0 0x7f8ab019cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.665+0000 7f8ab84c1640 1 --2- 172.21.15.92:0/3112829952 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ab0102570 0x7f8ab0198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.665+0000 7f8ab84c1640 1 --2- 172.21.15.92:0/3112829952 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8a9c0a3420 0x7f8a9c0a58e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.665+0000 7f8ab84c1640 1 --2- 172.21.15.92:0/3112829952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ab0100e20 0x7f8ab0198440 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.665+0000 7f8ab84c1640 1 -- 172.21.15.92:0/3112829952 >> 172.21.15.92:0/3112829952 conn(0x7f8ab00fc7d0 msgr2=0x7f8ab006a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:47.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.665+0000 7f8ab84c1640 1 -- 172.21.15.92:0/3112829952 shutdown_connections 2024-09-19T08:54:47.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:47.665+0000 7f8ab84c1640 1 -- 172.21.15.92:0/3112829952 wait complete. 2024-09-19T08:54:48.278 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-19T08:54:48.527 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:48.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.984+0000 7f5d7df3d640 1 -- 172.21.15.92:0/1340186208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d78101de0 msgr2=0x7f5d781021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:48.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.984+0000 7f5d7df3d640 1 --2- 172.21.15.92:0/1340186208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d78101de0 0x7f5d781021c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009ca0 tx=0x7f5d6802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.985+0000 7f5d7df3d640 1 -- 172.21.15.92:0/1340186208 shutdown_connections 2024-09-19T08:54:48.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.985+0000 7f5d7df3d640 1 --2- 172.21.15.92:0/1340186208 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5d78106f10 0x7f5d7810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.985+0000 7f5d7df3d640 1 --2- 172.21.15.92:0/1340186208 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d78102790 0x7f5d781067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.985+0000 7f5d7df3d640 1 --2- 172.21.15.92:0/1340186208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d78101de0 0x7f5d781021c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.985+0000 7f5d7df3d640 1 -- 172.21.15.92:0/1340186208 >> 172.21.15.92:0/1340186208 conn(0x7f5d780fd8c0 msgr2=0x7f5d780ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:48.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.985+0000 7f5d7df3d640 1 -- 172.21.15.92:0/1340186208 shutdown_connections 2024-09-19T08:54:48.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.985+0000 7f5d7df3d640 1 -- 172.21.15.92:0/1340186208 wait complete. 2024-09-19T08:54:48.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.985+0000 7f5d7df3d640 1 Processor -- start 2024-09-19T08:54:48.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.985+0000 7f5d7df3d640 1 -- start start 2024-09-19T08:54:48.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.986+0000 7f5d7df3d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5d78101de0 0x7f5d78198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:48.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.986+0000 7f5d7df3d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d78102790 0x7f5d781989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:48.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.986+0000 7f5d7df3d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d78106f10 0x7f5d7819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:48.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.986+0000 7f5d7df3d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5d78111f90 con 0x7f5d78106f10 2024-09-19T08:54:48.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.986+0000 7f5d7df3d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5d78111e10 con 0x7f5d78102790 2024-09-19T08:54:48.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.986+0000 7f5d7df3d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5d78112110 con 0x7f5d78101de0 2024-09-19T08:54:48.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.986+0000 7f5d77fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d78106f10 0x7f5d7819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:48.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.986+0000 7f5d77fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d78106f10 0x7f5d7819cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52632/0 (socket says 172.21.15.92:52632) 2024-09-19T08:54:48.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.986+0000 7f5d77fff640 1 -- 172.21.15.92:0/2374340026 learned_addr learned my addr 172.21.15.92:0/2374340026 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:54:48.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.986+0000 7f5d76ffd640 1 --2- 172.21.15.92:0/2374340026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d78102790 0x7f5d781989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:48.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.986+0000 7f5d777fe640 1 --2- 172.21.15.92:0/2374340026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5d78101de0 0x7f5d78198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:48.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.986+0000 7f5d77fff640 1 -- 172.21.15.92:0/2374340026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5d78101de0 msgr2=0x7f5d78198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:48.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.986+0000 7f5d77fff640 1 --2- 172.21.15.92:0/2374340026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5d78101de0 0x7f5d78198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.986+0000 7f5d77fff640 1 -- 172.21.15.92:0/2374340026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d78102790 msgr2=0x7f5d781989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:48.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.986+0000 7f5d77fff640 1 --2- 172.21.15.92:0/2374340026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d78102790 0x7f5d781989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.986+0000 7f5d77fff640 1 -- 172.21.15.92:0/2374340026 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d7819d440 con 0x7f5d78106f10 2024-09-19T08:54:48.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.986+0000 7f5d77fff640 1 --2- 172.21.15.92:0/2374340026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d78106f10 0x7f5d7819cd60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5d70009fd0 tx=0x7f5d7000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:48.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.986+0000 7f5d74ff9640 1 -- 172.21.15.92:0/2374340026 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d70011830 con 0x7f5d78106f10 2024-09-19T08:54:48.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.986+0000 7f5d74ff9640 1 -- 172.21.15.92:0/2374340026 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d70016070 con 0x7f5d78106f10 2024-09-19T08:54:48.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.987+0000 7f5d74ff9640 1 -- 172.21.15.92:0/2374340026 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7000f2e0 con 0x7f5d78106f10 2024-09-19T08:54:48.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.987+0000 7f5d7df3d640 1 -- 172.21.15.92:0/2374340026 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d7819d730 con 0x7f5d78106f10 2024-09-19T08:54:48.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.987+0000 7f5d7df3d640 1 -- 172.21.15.92:0/2374340026 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d781a5010 con 0x7f5d78106f10 2024-09-19T08:54:48.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.988+0000 7f5d7df3d640 1 -- 172.21.15.92:0/2374340026 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d781021c0 con 0x7f5d78106f10 2024-09-19T08:54:48.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.989+0000 7f5d74ff9640 1 -- 172.21.15.92:0/2374340026 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5d700119d0 con 0x7f5d78106f10 2024-09-19T08:54:48.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.989+0000 7f5d74ff9640 1 --2- 172.21.15.92:0/2374340026 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5d600a32d0 0x7f5d600a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:48.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.989+0000 7f5d777fe640 1 --2- 172.21.15.92:0/2374340026 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5d600a32d0 0x7f5d600a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:48.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.989+0000 7f5d74ff9640 1 -- 172.21.15.92:0/2374340026 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f5d700cee00 con 0x7f5d78106f10 2024-09-19T08:54:48.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.990+0000 7f5d777fe640 1 --2- 172.21.15.92:0/2374340026 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5d600a32d0 0x7f5d600a5790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5d68000f80 tx=0x7f5d680093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:48.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:48.994+0000 7f5d74ff9640 1 -- 172.21.15.92:0/2374340026 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5d7009bc80 con 0x7f5d78106f10 2024-09-19T08:54:49.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:49.184+0000 7f5d7df3d640 1 -- 172.21.15.92:0/2374340026 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f5d78062630 con 0x7f5d600a32d0 2024-09-19T08:54:49.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:49.189+0000 7f5d74ff9640 1 -- 172.21.15.92:0/2374340026 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f5d78062630 con 0x7f5d600a32d0 2024-09-19T08:54:49.189 INFO:teuthology.orchestra.run.smithi092.stdout:/volumes/qa/sv_1/edc13aaa-2591-4ed4-a5ac-e9372bb5117f 2024-09-19T08:54:49.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:49.191+0000 7f5d7df3d640 1 -- 172.21.15.92:0/2374340026 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5d600a32d0 msgr2=0x7f5d600a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:49.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:49.191+0000 7f5d7df3d640 1 --2- 172.21.15.92:0/2374340026 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5d600a32d0 0x7f5d600a5790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5d68000f80 tx=0x7f5d680093f0 comp rx=0 tx=0).stop 2024-09-19T08:54:49.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:49.191+0000 7f5d7df3d640 1 -- 172.21.15.92:0/2374340026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d78106f10 msgr2=0x7f5d7819cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:49.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:49.191+0000 7f5d7df3d640 1 --2- 172.21.15.92:0/2374340026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d78106f10 0x7f5d7819cd60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5d70009fd0 tx=0x7f5d7000b8e0 comp rx=0 tx=0).stop 2024-09-19T08:54:49.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:49.191+0000 7f5d7df3d640 1 -- 172.21.15.92:0/2374340026 shutdown_connections 2024-09-19T08:54:49.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:49.191+0000 7f5d7df3d640 1 --2- 172.21.15.92:0/2374340026 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5d600a32d0 0x7f5d600a5790 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:49.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:49.191+0000 7f5d7df3d640 1 --2- 172.21.15.92:0/2374340026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d78106f10 0x7f5d7819cd60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:49.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:49.191+0000 7f5d7df3d640 1 --2- 172.21.15.92:0/2374340026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d78102790 0x7f5d781989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:49.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:49.191+0000 7f5d7df3d640 1 --2- 172.21.15.92:0/2374340026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5d78101de0 0x7f5d78198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:49.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:49.191+0000 7f5d7df3d640 1 -- 172.21.15.92:0/2374340026 >> 172.21.15.92:0/2374340026 conn(0x7f5d780fd8c0 msgr2=0x7f5d780fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:49.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:49.191+0000 7f5d7df3d640 1 -- 172.21.15.92:0/2374340026 shutdown_connections 2024-09-19T08:54:49.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:49.191+0000 7f5d7df3d640 1 -- 172.21.15.92:0/2374340026 wait complete. 2024-09-19T08:54:49.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:49 smithi092 ceph-mon[31407]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:49.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:49 smithi092 ceph-mon[31407]: pgmap v278: 97 pgs: 97 active+clean; 599 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-19T08:54:49.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:49 smithi167 ceph-mon[35359]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:49.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:49 smithi167 ceph-mon[35359]: pgmap v278: 97 pgs: 97 active+clean; 599 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-19T08:54:49.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:49 smithi190 ceph-mon[35358]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:49.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:49 smithi190 ceph-mon[35358]: pgmap v278: 97 pgs: 97 active+clean; 599 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-19T08:54:49.800 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:54:50.043 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:50.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:50 smithi092 ceph-mon[31407]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:50.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:50 smithi167 ceph-mon[35359]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:50.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.612+0000 7fba7468e640 1 -- 172.21.15.92:0/740785161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba6c100e20 msgr2=0x7fba6c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:50.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.612+0000 7fba7468e640 1 --2- 172.21.15.92:0/740785161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba6c100e20 0x7fba6c101200 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fba68009900 tx=0x7fba6802a480 comp rx=0 tx=0).stop 2024-09-19T08:54:50.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.613+0000 7fba7468e640 1 -- 172.21.15.92:0/740785161 shutdown_connections 2024-09-19T08:54:50.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.613+0000 7fba7468e640 1 --2- 172.21.15.92:0/740785161 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba6c102ef0 0x7fba6c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:50.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.613+0000 7fba7468e640 1 --2- 172.21.15.92:0/740785161 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba6c102570 0x7fba6c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:50.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.613+0000 7fba7468e640 1 --2- 172.21.15.92:0/740785161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba6c100e20 0x7fba6c101200 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:50.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.613+0000 7fba7468e640 1 -- 172.21.15.92:0/740785161 >> 172.21.15.92:0/740785161 conn(0x7fba6c0fc7d0 msgr2=0x7fba6c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:50.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.613+0000 7fba7468e640 1 -- 172.21.15.92:0/740785161 shutdown_connections 2024-09-19T08:54:50.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.613+0000 7fba7468e640 1 -- 172.21.15.92:0/740785161 wait complete. 2024-09-19T08:54:50.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.613+0000 7fba7468e640 1 Processor -- start 2024-09-19T08:54:50.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.613+0000 7fba7468e640 1 -- start start 2024-09-19T08:54:50.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.613+0000 7fba7468e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba6c100e20 0x7fba6c199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:50.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.613+0000 7fba7468e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba6c102570 0x7fba6c1999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:50.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.613+0000 7fba7468e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba6c102ef0 0x7fba6c1a44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:50.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.613+0000 7fba7468e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fba6c110fa0 con 0x7fba6c102ef0 2024-09-19T08:54:50.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.613+0000 7fba7468e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fba6c110e20 con 0x7fba6c102570 2024-09-19T08:54:50.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.613+0000 7fba7468e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fba6c111120 con 0x7fba6c100e20 2024-09-19T08:54:50.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.614+0000 7fba72c2b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba6c102ef0 0x7fba6c1a44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:50.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.614+0000 7fba72c2b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba6c102ef0 0x7fba6c1a44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52654/0 (socket says 172.21.15.92:52654) 2024-09-19T08:54:50.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.614+0000 7fba72c2b640 1 -- 172.21.15.92:0/4181137497 learned_addr learned my addr 172.21.15.92:0/4181137497 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:54:50.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.614+0000 7fba71c29640 1 --2- 172.21.15.92:0/4181137497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba6c102570 0x7fba6c1999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:50.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.614+0000 7fba7242a640 1 --2- 172.21.15.92:0/4181137497 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba6c100e20 0x7fba6c199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:50.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.614+0000 7fba72c2b640 1 -- 172.21.15.92:0/4181137497 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba6c100e20 msgr2=0x7fba6c199470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:50.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.614+0000 7fba72c2b640 1 --2- 172.21.15.92:0/4181137497 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba6c100e20 0x7fba6c199470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:50.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.614+0000 7fba72c2b640 1 -- 172.21.15.92:0/4181137497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba6c102570 msgr2=0x7fba6c1999b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:50.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.614+0000 7fba72c2b640 1 --2- 172.21.15.92:0/4181137497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba6c102570 0x7fba6c1999b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:50.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.614+0000 7fba72c2b640 1 -- 172.21.15.92:0/4181137497 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba6c1a4a30 con 0x7fba6c102ef0 2024-09-19T08:54:50.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.614+0000 7fba7242a640 1 --2- 172.21.15.92:0/4181137497 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba6c100e20 0x7fba6c199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:50.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.614+0000 7fba72c2b640 1 --2- 172.21.15.92:0/4181137497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba6c102ef0 0x7fba6c1a44f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fba6400cad0 tx=0x7fba6400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:50.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.614+0000 7fba637fe640 1 -- 172.21.15.92:0/4181137497 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba6400ad60 con 0x7fba6c102ef0 2024-09-19T08:54:50.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.614+0000 7fba637fe640 1 -- 172.21.15.92:0/4181137497 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba64005020 con 0x7fba6c102ef0 2024-09-19T08:54:50.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.614+0000 7fba7468e640 1 -- 172.21.15.92:0/4181137497 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba6c1a4c00 con 0x7fba6c102ef0 2024-09-19T08:54:50.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.614+0000 7fba637fe640 1 -- 172.21.15.92:0/4181137497 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba6400f6b0 con 0x7fba6c102ef0 2024-09-19T08:54:50.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.614+0000 7fba7468e640 1 -- 172.21.15.92:0/4181137497 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba6c1a50c0 con 0x7fba6c102ef0 2024-09-19T08:54:50.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.615+0000 7fba7468e640 1 -- 172.21.15.92:0/4181137497 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba6c101200 con 0x7fba6c102ef0 2024-09-19T08:54:50.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.616+0000 7fba637fe640 1 -- 172.21.15.92:0/4181137497 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fba64005560 con 0x7fba6c102ef0 2024-09-19T08:54:50.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.617+0000 7fba637fe640 1 --2- 172.21.15.92:0/4181137497 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fba580a32d0 0x7fba580a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:50.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.617+0000 7fba7242a640 1 --2- 172.21.15.92:0/4181137497 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fba580a32d0 0x7fba580a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:50.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.617+0000 7fba637fe640 1 -- 172.21.15.92:0/4181137497 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fba640cf9b0 con 0x7fba6c102ef0 2024-09-19T08:54:50.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.617+0000 7fba7242a640 1 --2- 172.21.15.92:0/4181137497 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fba580a32d0 0x7fba580a5790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fba68005ab0 tx=0x7fba68005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:50.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.621+0000 7fba637fe640 1 -- 172.21.15.92:0/4181137497 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fba64014030 con 0x7fba6c102ef0 2024-09-19T08:54:50.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:50 smithi190 ceph-mon[35358]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:50.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.826+0000 7fba7468e640 1 -- 172.21.15.92:0/4181137497 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba6c109090 con 0x7fba6c102ef0 2024-09-19T08:54:50.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.827+0000 7fba637fe640 1 -- 172.21.15.92:0/4181137497 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7fba6409c720 con 0x7fba6c102ef0 2024-09-19T08:54:50.828 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:54:50.828 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T08:54:50.828 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T08:54:50.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.829+0000 7fba7468e640 1 -- 172.21.15.92:0/4181137497 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fba580a32d0 msgr2=0x7fba580a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:50.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.829+0000 7fba7468e640 1 --2- 172.21.15.92:0/4181137497 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fba580a32d0 0x7fba580a5790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fba68005ab0 tx=0x7fba68005a20 comp rx=0 tx=0).stop 2024-09-19T08:54:50.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.829+0000 7fba7468e640 1 -- 172.21.15.92:0/4181137497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba6c102ef0 msgr2=0x7fba6c1a44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:50.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.829+0000 7fba7468e640 1 --2- 172.21.15.92:0/4181137497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba6c102ef0 0x7fba6c1a44f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fba6400cad0 tx=0x7fba6400ced0 comp rx=0 tx=0).stop 2024-09-19T08:54:50.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.829+0000 7fba7468e640 1 -- 172.21.15.92:0/4181137497 shutdown_connections 2024-09-19T08:54:50.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.829+0000 7fba7468e640 1 --2- 172.21.15.92:0/4181137497 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fba580a32d0 0x7fba580a5790 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:50.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.829+0000 7fba7468e640 1 --2- 172.21.15.92:0/4181137497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba6c102ef0 0x7fba6c1a44f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:50.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.829+0000 7fba7468e640 1 --2- 172.21.15.92:0/4181137497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba6c102570 0x7fba6c1999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:50.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.829+0000 7fba7468e640 1 --2- 172.21.15.92:0/4181137497 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba6c100e20 0x7fba6c199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:50.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.829+0000 7fba7468e640 1 -- 172.21.15.92:0/4181137497 >> 172.21.15.92:0/4181137497 conn(0x7fba6c0fc7d0 msgr2=0x7fba6c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:50.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.829+0000 7fba7468e640 1 -- 172.21.15.92:0/4181137497 shutdown_connections 2024-09-19T08:54:50.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:50.829+0000 7fba7468e640 1 -- 172.21.15.92:0/4181137497 wait complete. 2024-09-19T08:54:51.389 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:51 smithi092 ceph-mon[31407]: pgmap v279: 97 pgs: 97 active+clean; 599 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-19T08:54:51.390 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:51 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/4181137497' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:51.391 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:54:51.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:51 smithi167 ceph-mon[35359]: pgmap v279: 97 pgs: 97 active+clean; 599 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-19T08:54:51.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:51 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/4181137497' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:51.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:51 smithi190 ceph-mon[35358]: pgmap v279: 97 pgs: 97 active+clean; 599 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-19T08:54:51.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:51 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/4181137497' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:51.636 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:52.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.054+0000 7fb65364e640 1 -- 172.21.15.92:0/2121933270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb64c100e30 msgr2=0x7fb64c104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:52.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.054+0000 7fb65364e640 1 --2- 172.21.15.92:0/2121933270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb64c100e30 0x7fb64c104e80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb63c009900 tx=0x7fb63c02a410 comp rx=0 tx=0).stop 2024-09-19T08:54:52.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.054+0000 7fb65364e640 1 -- 172.21.15.92:0/2121933270 shutdown_connections 2024-09-19T08:54:52.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.054+0000 7fb65364e640 1 --2- 172.21.15.92:0/2121933270 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb64c1055b0 0x7fb64c10d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:52.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.054+0000 7fb65364e640 1 --2- 172.21.15.92:0/2121933270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb64c100e30 0x7fb64c104e80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:52.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.054+0000 7fb65364e640 1 --2- 172.21.15.92:0/2121933270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb64c100480 0x7fb64c100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:52.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.054+0000 7fb65364e640 1 -- 172.21.15.92:0/2121933270 >> 172.21.15.92:0/2121933270 conn(0x7fb64c077210 msgr2=0x7fb64c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:52.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.054+0000 7fb65364e640 1 -- 172.21.15.92:0/2121933270 shutdown_connections 2024-09-19T08:54:52.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.054+0000 7fb65364e640 1 -- 172.21.15.92:0/2121933270 wait complete. 2024-09-19T08:54:52.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.055+0000 7fb65364e640 1 Processor -- start 2024-09-19T08:54:52.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.055+0000 7fb65364e640 1 -- start start 2024-09-19T08:54:52.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.055+0000 7fb65364e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb64c100480 0x7fb64c198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:52.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.055+0000 7fb65364e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb64c100e30 0x7fb64c198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:52.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.055+0000 7fb65364e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb64c1055b0 0x7fb64c19ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:52.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.055+0000 7fb65364e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb64c112030 con 0x7fb64c100e30 2024-09-19T08:54:52.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.055+0000 7fb65364e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb64c111eb0 con 0x7fb64c100480 2024-09-19T08:54:52.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.055+0000 7fb65364e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb64c1121b0 con 0x7fb64c1055b0 2024-09-19T08:54:52.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.055+0000 7fb650be9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb64c100e30 0x7fb64c198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:52.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.055+0000 7fb650be9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb64c100e30 0x7fb64c198b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40938/0 (socket says 172.21.15.92:40938) 2024-09-19T08:54:52.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.055+0000 7fb650be9640 1 -- 172.21.15.92:0/3909774457 learned_addr learned my addr 172.21.15.92:0/3909774457 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:54:52.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.055+0000 7fb6513ea640 1 --2- 172.21.15.92:0/3909774457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb64c100480 0x7fb64c198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:52.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.056+0000 7fb651beb640 1 --2- 172.21.15.92:0/3909774457 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb64c1055b0 0x7fb64c19ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:52.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.056+0000 7fb650be9640 1 -- 172.21.15.92:0/3909774457 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb64c1055b0 msgr2=0x7fb64c19ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:52.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.056+0000 7fb650be9640 1 --2- 172.21.15.92:0/3909774457 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb64c1055b0 0x7fb64c19ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:52.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.056+0000 7fb650be9640 1 -- 172.21.15.92:0/3909774457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb64c100480 msgr2=0x7fb64c198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:52.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.056+0000 7fb650be9640 1 --2- 172.21.15.92:0/3909774457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb64c100480 0x7fb64c198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:52.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.056+0000 7fb650be9640 1 -- 172.21.15.92:0/3909774457 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb64c19d560 con 0x7fb64c100e30 2024-09-19T08:54:52.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.056+0000 7fb6513ea640 1 --2- 172.21.15.92:0/3909774457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb64c100480 0x7fb64c198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:52.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.056+0000 7fb651beb640 1 --2- 172.21.15.92:0/3909774457 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb64c1055b0 0x7fb64c19ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:54:52.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.056+0000 7fb650be9640 1 --2- 172.21.15.92:0/3909774457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb64c100e30 0x7fb64c198b90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb63c005ab0 tx=0x7fb63c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:52.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.056+0000 7fb6427fc640 1 -- 172.21.15.92:0/3909774457 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c03f030 con 0x7fb64c100e30 2024-09-19T08:54:52.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.056+0000 7fb65364e640 1 -- 172.21.15.92:0/3909774457 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb64c19d7f0 con 0x7fb64c100e30 2024-09-19T08:54:52.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.056+0000 7fb6427fc640 1 -- 172.21.15.92:0/3909774457 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb63c003ce0 con 0x7fb64c100e30 2024-09-19T08:54:52.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.056+0000 7fb6427fc640 1 -- 172.21.15.92:0/3909774457 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c035070 con 0x7fb64c100e30 2024-09-19T08:54:52.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.056+0000 7fb65364e640 1 -- 172.21.15.92:0/3909774457 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb64c1a5130 con 0x7fb64c100e30 2024-09-19T08:54:52.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.058+0000 7fb65364e640 1 -- 172.21.15.92:0/3909774457 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb64c101960 con 0x7fb64c100e30 2024-09-19T08:54:52.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.058+0000 7fb6427fc640 1 -- 172.21.15.92:0/3909774457 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb63c042030 con 0x7fb64c100e30 2024-09-19T08:54:52.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.059+0000 7fb6427fc640 1 --2- 172.21.15.92:0/3909774457 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb6380a32d0 0x7fb6380a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:52.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.059+0000 7fb6513ea640 1 --2- 172.21.15.92:0/3909774457 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb6380a32d0 0x7fb6380a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:52.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.059+0000 7fb6427fc640 1 -- 172.21.15.92:0/3909774457 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fb63c0f0290 con 0x7fb64c100e30 2024-09-19T08:54:52.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.059+0000 7fb6513ea640 1 --2- 172.21.15.92:0/3909774457 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb6380a32d0 0x7fb6380a5790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb648009930 tx=0x7fb648008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:52.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.063+0000 7fb6427fc640 1 -- 172.21.15.92:0/3909774457 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb63c0bd000 con 0x7fb64c100e30 2024-09-19T08:54:52.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.231+0000 7fb65364e640 1 -- 172.21.15.92:0/3909774457 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb64c108790 con 0x7fb64c100e30 2024-09-19T08:54:52.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.233+0000 7fb6427fc640 1 -- 172.21.15.92:0/3909774457 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22303 (secure 0 0 0) 0x7fb63c0bc900 con 0x7fb64c100e30 2024-09-19T08:54:52.233 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:54:52.233 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":80,"fsid":"91ff74f2-7663-11ef-bceb-c7b262605968","created":"2024-09-19T08:47:08.162150+0000","modified":"2024-09-19T08:54:31.939170+0000","last_up_change":"2024-09-19T08:53:43.021949+0000","last_in_change":"2024-09-19T08:53:19.246805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:50:04.482034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:54:28.005336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:54:30.188980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd104fe2-b828-4c98-a499-b212717f2997","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6803","nonce":4232030626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6805","nonce":4232030626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6809","nonce":4232030626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6807","nonce":4232030626}]},"public_addr":"172.21.15.92:6803/4232030626","cluster_addr":"172.21.15.92:6805/4232030626","heartbeat_back_addr":"172.21.15.92:6809/4232030626","heartbeat_front_addr":"172.21.15.92:6807/4232030626","state":["exists","up"]},{"osd":1,"uuid":"0f725330-5e61-413c-b3c8-41bc2c0d8e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6801","nonce":4163493234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6803","nonce":4163493234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6807","nonce":4163493234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6805","nonce":4163493234}]},"public_addr":"172.21.15.167:6801/4163493234","cluster_addr":"172.21.15.167:6803/4163493234","heartbeat_back_addr":"172.21.15.167:6807/4163493234","heartbeat_front_addr":"172.21.15.167:6805/4163493234","state":["exists","up"]},{"osd":2,"uuid":"286d2943-23a0-4184-93cf-9d3430781f99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6801","nonce":702507556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6803","nonce":702507556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6807","nonce":702507556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6805","nonce":702507556}]},"public_addr":"172.21.15.190:6801/702507556","cluster_addr":"172.21.15.190:6803/702507556","heartbeat_back_addr":"172.21.15.190:6807/702507556","heartbeat_front_addr":"172.21.15.190:6805/702507556","state":["exists","up"]},{"osd":3,"uuid":"9d126671-7fc1-4f29-9bc3-3598052fd20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6811","nonce":945752895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6813","nonce":945752895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6817","nonce":945752895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6815","nonce":945752895}]},"public_addr":"172.21.15.92:6811/945752895","cluster_addr":"172.21.15.92:6813/945752895","heartbeat_back_addr":"172.21.15.92:6817/945752895","heartbeat_front_addr":"172.21.15.92:6815/945752895","state":["exists","up"]},{"osd":4,"uuid":"cb10b38d-ae13-4b92-b906-3505fb873b2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6809","nonce":3576893400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6811","nonce":3576893400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6815","nonce":3576893400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6813","nonce":3576893400}]},"public_addr":"172.21.15.167:6809/3576893400","cluster_addr":"172.21.15.167:6811/3576893400","heartbeat_back_addr":"172.21.15.167:6815/3576893400","heartbeat_front_addr":"172.21.15.167:6813/3576893400","state":["exists","up"]},{"osd":5,"uuid":"cd90668b-eca5-4bb4-870e-e58578730c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6809","nonce":1880491675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6811","nonce":1880491675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6815","nonce":1880491675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6813","nonce":1880491675}]},"public_addr":"172.21.15.190:6809/1880491675","cluster_addr":"172.21.15.190:6811/1880491675","heartbeat_back_addr":"172.21.15.190:6815/1880491675","heartbeat_front_addr":"172.21.15.190:6813/1880491675","state":["exists","up"]},{"osd":6,"uuid":"4e047963-afa7-4934-b887-8086165fb831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6819","nonce":1743435653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6821","nonce":1743435653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6825","nonce":1743435653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6823","nonce":1743435653}]},"public_addr":"172.21.15.92:6819/1743435653","cluster_addr":"172.21.15.92:6821/1743435653","heartbeat_back_addr":"172.21.15.92:6825/1743435653","heartbeat_front_addr":"172.21.15.92:6823/1743435653","state":["exists","up"]},{"osd":7,"uuid":"652a6aa1-bb94-4608-952e-67cd02bdff66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6817","nonce":2984111963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6819","nonce":2984111963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6823","nonce":2984111963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6821","nonce":2984111963}]},"public_addr":"172.21.15.167:6817/2984111963","cluster_addr":"172.21.15.167:6819/2984111963","heartbeat_back_addr":"172.21.15.167:6823/2984111963","heartbeat_front_addr":"172.21.15.167:6821/2984111963","state":["exists","up"]},{"osd":8,"uuid":"1510ef1f-fdfe-4887-a771-146efce062fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6817","nonce":4190304434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6819","nonce":4190304434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6823","nonce":4190304434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6821","nonce":4190304434}]},"public_addr":"172.21.15.190:6817/4190304434","cluster_addr":"172.21.15.190:6819/4190304434","heartbeat_back_addr":"172.21.15.190:6823/4190304434","heartbeat_front_addr":"172.21.15.190:6821/4190304434","state":["exists","up"]},{"osd":9,"uuid":"9b774bbe-6700-4020-900b-3fdbaa546773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6827","nonce":3066744542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6829","nonce":3066744542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6833","nonce":3066744542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6831","nonce":3066744542}]},"public_addr":"172.21.15.92:6827/3066744542","cluster_addr":"172.21.15.92:6829/3066744542","heartbeat_back_addr":"172.21.15.92:6833/3066744542","heartbeat_front_addr":"172.21.15.92:6831/3066744542","state":["exists","up"]},{"osd":10,"uuid":"8abdb835-db2c-4597-ae1d-8ef56e63ab6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6825","nonce":2309134313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6827","nonce":2309134313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6831","nonce":2309134313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6829","nonce":2309134313}]},"public_addr":"172.21.15.167:6825/2309134313","cluster_addr":"172.21.15.167:6827/2309134313","heartbeat_back_addr":"172.21.15.167:6831/2309134313","heartbeat_front_addr":"172.21.15.167:6829/2309134313","state":["exists","up"]},{"osd":11,"uuid":"564c844a-378f-40cd-9717-cde35a65631c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6825","nonce":1849208751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6827","nonce":1849208751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6831","nonce":1849208751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6829","nonce":1849208751}]},"public_addr":"172.21.15.190:6825/1849208751","cluster_addr":"172.21.15.190:6827/1849208751","heartbeat_back_addr":"172.21.15.190:6831/1849208751","heartbeat_front_addr":"172.21.15.190:6829/1849208751","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:12.072109+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:36.689174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:01.908763+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:26.857439+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:50.881629+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:51:15.160744+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:51:39.101605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:03.179877+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:27.324563+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:51.971287+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:53:15.917311+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:53:40.592486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/2948821221":"2024-09-20T08:47:52.180093+0000","172.21.15.92:0/1441365956":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6801/2908709470":"2024-09-20T08:47:52.180093+0000","172.21.15.92:0/608374871":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6801/1369295034":"2024-09-20T08:47:29.812397+0000","172.21.15.92:6800/2908709470":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6800/1369295034":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/813486656":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/1963725565":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/1668504617":"2024-09-20T08:47:29.812397+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:54:52.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.235+0000 7fb65364e640 1 -- 172.21.15.92:0/3909774457 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb6380a32d0 msgr2=0x7fb6380a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:52.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.235+0000 7fb65364e640 1 --2- 172.21.15.92:0/3909774457 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb6380a32d0 0x7fb6380a5790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb648009930 tx=0x7fb648008040 comp rx=0 tx=0).stop 2024-09-19T08:54:52.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.235+0000 7fb65364e640 1 -- 172.21.15.92:0/3909774457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb64c100e30 msgr2=0x7fb64c198b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:52.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.235+0000 7fb65364e640 1 --2- 172.21.15.92:0/3909774457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb64c100e30 0x7fb64c198b90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb63c005ab0 tx=0x7fb63c0042f0 comp rx=0 tx=0).stop 2024-09-19T08:54:52.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.235+0000 7fb65364e640 1 -- 172.21.15.92:0/3909774457 shutdown_connections 2024-09-19T08:54:52.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.235+0000 7fb65364e640 1 --2- 172.21.15.92:0/3909774457 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb64c1055b0 0x7fb64c19ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:52.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.235+0000 7fb65364e640 1 --2- 172.21.15.92:0/3909774457 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb6380a32d0 0x7fb6380a5790 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:52.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.235+0000 7fb65364e640 1 --2- 172.21.15.92:0/3909774457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb64c100e30 0x7fb64c198b90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:52.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.235+0000 7fb65364e640 1 --2- 172.21.15.92:0/3909774457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb64c100480 0x7fb64c198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:52.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.235+0000 7fb65364e640 1 -- 172.21.15.92:0/3909774457 >> 172.21.15.92:0/3909774457 conn(0x7fb64c077210 msgr2=0x7fb64c103890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:52.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.235+0000 7fb65364e640 1 -- 172.21.15.92:0/3909774457 shutdown_connections 2024-09-19T08:54:52.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:52.235+0000 7fb65364e640 1 -- 172.21.15.92:0/3909774457 wait complete. 2024-09-19T08:54:52.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:52 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-09-19T08:54:52.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:52 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 1]}]: dispatch 2024-09-19T08:54:52.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:52 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-09-19T08:54:52.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:52 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-19T08:54:52.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:52 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]: dispatch 2024-09-19T08:54:52.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:52 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-19T08:54:52.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:52 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2024-09-19T08:54:52.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:52 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]: dispatch 2024-09-19T08:54:52.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:52 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-09-19T08:54:52.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:52 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3909774457' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:54:52.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:52 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-09-19T08:54:52.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:52 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 1]}]: dispatch 2024-09-19T08:54:52.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:52 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-09-19T08:54:52.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:52 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-19T08:54:52.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:52 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]: dispatch 2024-09-19T08:54:52.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:52 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-19T08:54:52.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:52 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2024-09-19T08:54:52.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:52 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]: dispatch 2024-09-19T08:54:52.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:52 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-09-19T08:54:52.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:52 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3909774457' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:54:52.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-09-19T08:54:52.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 1]}]: dispatch 2024-09-19T08:54:52.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-09-19T08:54:52.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-19T08:54:52.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]: dispatch 2024-09-19T08:54:52.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-19T08:54:52.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2024-09-19T08:54:52.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]: dispatch 2024-09-19T08:54:52.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-09-19T08:54:52.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:52 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3909774457' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:54:52.866 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T08:54:52.866 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:54:53.110 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:53.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:53 smithi092 ceph-mon[31407]: pgmap v280: 97 pgs: 97 active+clean; 599 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-19T08:54:53.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:53 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-19T08:54:53.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:53 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 1]}]': finished 2024-09-19T08:54:53.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:53 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-09-19T08:54:53.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:53 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-19T08:54:53.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:53 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]': finished 2024-09-19T08:54:53.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:53 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-19T08:54:53.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:53 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-09-19T08:54:53.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:53 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2024-09-19T08:54:53.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:53 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-19T08:54:53.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:53 smithi092 ceph-mon[31407]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T08:54:53.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.579+0000 7f938556b640 1 -- 172.21.15.92:0/4057709411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9380106f10 msgr2=0x7f938010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:53.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.579+0000 7f938556b640 1 --2- 172.21.15.92:0/4057709411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9380106f10 0x7f938010ea90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9378009ca0 tx=0x7f937802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:54:53.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.579+0000 7f938556b640 1 -- 172.21.15.92:0/4057709411 shutdown_connections 2024-09-19T08:54:53.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.579+0000 7f938556b640 1 --2- 172.21.15.92:0/4057709411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9380106f10 0x7f938010ea90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:53.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.579+0000 7f938556b640 1 --2- 172.21.15.92:0/4057709411 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9380102790 0x7f93801067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:53.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.579+0000 7f938556b640 1 --2- 172.21.15.92:0/4057709411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9380101de0 0x7f93801021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:53.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.579+0000 7f938556b640 1 -- 172.21.15.92:0/4057709411 >> 172.21.15.92:0/4057709411 conn(0x7f93800fd8c0 msgr2=0x7f93800ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:53.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.579+0000 7f938556b640 1 -- 172.21.15.92:0/4057709411 shutdown_connections 2024-09-19T08:54:53.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.579+0000 7f938556b640 1 -- 172.21.15.92:0/4057709411 wait complete. 2024-09-19T08:54:53.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.579+0000 7f938556b640 1 Processor -- start 2024-09-19T08:54:53.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.580+0000 7f938556b640 1 -- start start 2024-09-19T08:54:53.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.580+0000 7f938556b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9380101de0 0x7f9380198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:53.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.580+0000 7f938556b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9380102790 0x7f93801988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:53.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.580+0000 7f938556b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9380106f10 0x7f938019cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:53.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.580+0000 7f938556b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9380111f70 con 0x7f9380101de0 2024-09-19T08:54:53.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.580+0000 7f938556b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9380111df0 con 0x7f9380102790 2024-09-19T08:54:53.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.580+0000 7f938556b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f93801120f0 con 0x7f9380106f10 2024-09-19T08:54:53.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.580+0000 7f937effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9380101de0 0x7f9380198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:53.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.580+0000 7f937effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9380101de0 0x7f9380198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40962/0 (socket says 172.21.15.92:40962) 2024-09-19T08:54:53.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.580+0000 7f937effd640 1 -- 172.21.15.92:0/1252490308 learned_addr learned my addr 172.21.15.92:0/1252490308 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:54:53.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.580+0000 7f937f7fe640 1 --2- 172.21.15.92:0/1252490308 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9380106f10 0x7f938019cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:53.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.580+0000 7f937e7fc640 1 --2- 172.21.15.92:0/1252490308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9380102790 0x7f93801988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:53.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.580+0000 7f937effd640 1 -- 172.21.15.92:0/1252490308 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9380106f10 msgr2=0x7f938019cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:53.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.580+0000 7f937effd640 1 --2- 172.21.15.92:0/1252490308 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9380106f10 0x7f938019cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:53.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.580+0000 7f937effd640 1 -- 172.21.15.92:0/1252490308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9380102790 msgr2=0x7f93801988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:53.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.580+0000 7f937effd640 1 --2- 172.21.15.92:0/1252490308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9380102790 0x7f93801988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:53.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.580+0000 7f937effd640 1 -- 172.21.15.92:0/1252490308 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f938019d330 con 0x7f9380101de0 2024-09-19T08:54:53.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.580+0000 7f937e7fc640 1 --2- 172.21.15.92:0/1252490308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9380102790 0x7f93801988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:53.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.580+0000 7f937effd640 1 --2- 172.21.15.92:0/1252490308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9380101de0 0x7f9380198380 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f937000d950 tx=0x7f937000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:53.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.580+0000 7f9367fff640 1 -- 172.21.15.92:0/1252490308 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9370017030 con 0x7f9380101de0 2024-09-19T08:54:53.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.580+0000 7f938556b640 1 -- 172.21.15.92:0/1252490308 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f938019d620 con 0x7f9380101de0 2024-09-19T08:54:53.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.580+0000 7f9367fff640 1 -- 172.21.15.92:0/1252490308 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9370004020 con 0x7f9380101de0 2024-09-19T08:54:53.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.580+0000 7f9367fff640 1 -- 172.21.15.92:0/1252490308 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93700047a0 con 0x7f9380101de0 2024-09-19T08:54:53.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.581+0000 7f938556b640 1 -- 172.21.15.92:0/1252490308 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93801a4f00 con 0x7f9380101de0 2024-09-19T08:54:53.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.582+0000 7f938556b640 1 -- 172.21.15.92:0/1252490308 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93801021c0 con 0x7f9380101de0 2024-09-19T08:54:53.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.583+0000 7f9367fff640 1 -- 172.21.15.92:0/1252490308 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f93700041d0 con 0x7f9380101de0 2024-09-19T08:54:53.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.584+0000 7f9367fff640 1 --2- 172.21.15.92:0/1252490308 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f93680a32d0 0x7f93680a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:53.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.584+0000 7f937e7fc640 1 --2- 172.21.15.92:0/1252490308 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f93680a32d0 0x7f93680a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:53.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.584+0000 7f9367fff640 1 -- 172.21.15.92:0/1252490308 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f93700cfbe0 con 0x7f9380101de0 2024-09-19T08:54:53.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.585+0000 7f937e7fc640 1 --2- 172.21.15.92:0/1252490308 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f93680a32d0 0x7f93680a5790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9374005e00 tx=0x7f9374005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:53.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.587+0000 7f9367fff640 1 -- 172.21.15.92:0/1252490308 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f937009c7a0 con 0x7f9380101de0 2024-09-19T08:54:53.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:53 smithi167 ceph-mon[35359]: pgmap v280: 97 pgs: 97 active+clean; 599 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-19T08:54:53.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:53 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-19T08:54:53.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:53 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 1]}]': finished 2024-09-19T08:54:53.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:53 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-09-19T08:54:53.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:53 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-19T08:54:53.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:53 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]': finished 2024-09-19T08:54:53.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:53 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-19T08:54:53.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:53 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-09-19T08:54:53.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:53 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2024-09-19T08:54:53.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:53 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-19T08:54:53.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:53 smithi167 ceph-mon[35359]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T08:54:53.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:53 smithi190 ceph-mon[35358]: pgmap v280: 97 pgs: 97 active+clean; 599 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-19T08:54:53.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:53 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-19T08:54:53.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:53 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 1]}]': finished 2024-09-19T08:54:53.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:53 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-09-19T08:54:53.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:53 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-19T08:54:53.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:53 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]': finished 2024-09-19T08:54:53.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:53 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-19T08:54:53.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:53 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-09-19T08:54:53.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:53 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2024-09-19T08:54:53.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:53 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-19T08:54:53.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:53 smithi190 ceph-mon[35358]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T08:54:53.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.753+0000 7f938556b640 1 -- 172.21.15.92:0/1252490308 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9380062630 con 0x7f93680a32d0 2024-09-19T08:54:53.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.759+0000 7f9367fff640 1 -- 172.21.15.92:0/1252490308 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258538 (secure 0 0 0) 0x7f9380062630 con 0x7f93680a32d0 2024-09-19T08:54:53.762 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:54:53.763 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-19T08:54:53.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.762+0000 7f938556b640 1 -- 172.21.15.92:0/1252490308 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f93680a32d0 msgr2=0x7f93680a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:53.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.762+0000 7f938556b640 1 --2- 172.21.15.92:0/1252490308 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f93680a32d0 0x7f93680a5790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9374005e00 tx=0x7f9374005c70 comp rx=0 tx=0).stop 2024-09-19T08:54:53.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.762+0000 7f938556b640 1 -- 172.21.15.92:0/1252490308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9380101de0 msgr2=0x7f9380198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:53.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.762+0000 7f938556b640 1 --2- 172.21.15.92:0/1252490308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9380101de0 0x7f9380198380 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f937000d950 tx=0x7f937000de10 comp rx=0 tx=0).stop 2024-09-19T08:54:53.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.762+0000 7f938556b640 1 -- 172.21.15.92:0/1252490308 shutdown_connections 2024-09-19T08:54:53.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.762+0000 7f938556b640 1 --2- 172.21.15.92:0/1252490308 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9380106f10 0x7f938019cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:53.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.762+0000 7f938556b640 1 --2- 172.21.15.92:0/1252490308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9380102790 0x7f93801988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:53.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.762+0000 7f938556b640 1 --2- 172.21.15.92:0/1252490308 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f93680a32d0 0x7f93680a5790 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:53.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.762+0000 7f938556b640 1 --2- 172.21.15.92:0/1252490308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9380101de0 0x7f9380198380 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:53.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.762+0000 7f938556b640 1 -- 172.21.15.92:0/1252490308 >> 172.21.15.92:0/1252490308 conn(0x7f93800fd8c0 msgr2=0x7f93800fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:53.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.763+0000 7f938556b640 1 -- 172.21.15.92:0/1252490308 shutdown_connections 2024-09-19T08:54:53.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:53.763+0000 7f938556b640 1 -- 172.21.15.92:0/1252490308 wait complete. 2024-09-19T08:54:54.362 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":282,"stamp":"2024-09-19T08:54:53.325809+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":638202,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":162,"num_read_kb":174,"num_write":248,"num_write_kb":3006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":293,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":361408,"kb_used_data":12144,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124580416,"statfs":{"total":1151940427776,"available":1151570345984,"internally_reserved":0,"allocated":12435456,"data_stored":6948679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":45424,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":56,"num_write":22,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.068062"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.326712+0000","last_change":"2024-09-19T08:54:31.437743+0000","last_active":"2024-09-19T08:54:52.326712+0000","last_peered":"2024-09-19T08:54:52.326712+0000","last_clean":"2024-09-19T08:54:52.326712+0000","last_became_active":"2024-09-19T08:54:31.437426+0000","last_became_peered":"2024-09-19T08:54:31.437426+0000","last_unstale":"2024-09-19T08:54:52.326712+0000","last_undegraded":"2024-09-19T08:54:52.326712+0000","last_fullsized":"2024-09-19T08:54:52.326712+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:04.403522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.436656+0000","last_change":"2024-09-19T08:54:31.430322+0000","last_active":"2024-09-19T08:54:32.436656+0000","last_peered":"2024-09-19T08:54:32.436656+0000","last_clean":"2024-09-19T08:54:32.436656+0000","last_became_active":"2024-09-19T08:54:31.430008+0000","last_became_peered":"2024-09-19T08:54:31.430008+0000","last_unstale":"2024-09-19T08:54:32.436656+0000","last_undegraded":"2024-09-19T08:54:32.436656+0000","last_fullsized":"2024-09-19T08:54:32.436656+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:19.800686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.436144+0000","last_change":"2024-09-19T08:54:31.430276+0000","last_active":"2024-09-19T08:54:32.436144+0000","last_peered":"2024-09-19T08:54:32.436144+0000","last_clean":"2024-09-19T08:54:32.436144+0000","last_became_active":"2024-09-19T08:54:31.429939+0000","last_became_peered":"2024-09-19T08:54:31.429939+0000","last_unstale":"2024-09-19T08:54:32.436144+0000","last_undegraded":"2024-09-19T08:54:32.436144+0000","last_fullsized":"2024-09-19T08:54:32.436144+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:08.735067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.329078+0000","last_change":"2024-09-19T08:54:31.435197+0000","last_active":"2024-09-19T08:54:52.329078+0000","last_peered":"2024-09-19T08:54:52.329078+0000","last_clean":"2024-09-19T08:54:52.329078+0000","last_became_active":"2024-09-19T08:54:31.434872+0000","last_became_peered":"2024-09-19T08:54:31.434872+0000","last_unstale":"2024-09-19T08:54:52.329078+0000","last_undegraded":"2024-09-19T08:54:52.329078+0000","last_fullsized":"2024-09-19T08:54:52.329078+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:06.213317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433328+0000","last_change":"2024-09-19T08:54:31.423765+0000","last_active":"2024-09-19T08:54:32.433328+0000","last_peered":"2024-09-19T08:54:32.433328+0000","last_clean":"2024-09-19T08:54:32.433328+0000","last_became_active":"2024-09-19T08:54:31.423296+0000","last_became_peered":"2024-09-19T08:54:31.423296+0000","last_unstale":"2024-09-19T08:54:32.433328+0000","last_undegraded":"2024-09-19T08:54:32.433328+0000","last_fullsized":"2024-09-19T08:54:32.433328+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:07.507168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433541+0000","last_change":"2024-09-19T08:54:31.430299+0000","last_active":"2024-09-19T08:54:32.433541+0000","last_peered":"2024-09-19T08:54:32.433541+0000","last_clean":"2024-09-19T08:54:32.433541+0000","last_became_active":"2024-09-19T08:54:31.429951+0000","last_became_peered":"2024-09-19T08:54:31.429951+0000","last_unstale":"2024-09-19T08:54:32.433541+0000","last_undegraded":"2024-09-19T08:54:32.433541+0000","last_fullsized":"2024-09-19T08:54:32.433541+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:11.299729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.434609+0000","last_change":"2024-09-19T08:54:31.435854+0000","last_active":"2024-09-19T08:54:32.434609+0000","last_peered":"2024-09-19T08:54:32.434609+0000","last_clean":"2024-09-19T08:54:32.434609+0000","last_became_active":"2024-09-19T08:54:31.435522+0000","last_became_peered":"2024-09-19T08:54:31.435522+0000","last_unstale":"2024-09-19T08:54:32.434609+0000","last_undegraded":"2024-09-19T08:54:32.434609+0000","last_fullsized":"2024-09-19T08:54:32.434609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:11.099750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.422934+0000","last_change":"2024-09-19T08:54:31.434574+0000","last_active":"2024-09-19T08:54:32.422934+0000","last_peered":"2024-09-19T08:54:32.422934+0000","last_clean":"2024-09-19T08:54:32.422934+0000","last_became_active":"2024-09-19T08:54:31.434268+0000","last_became_peered":"2024-09-19T08:54:31.434268+0000","last_unstale":"2024-09-19T08:54:32.422934+0000","last_undegraded":"2024-09-19T08:54:32.422934+0000","last_fullsized":"2024-09-19T08:54:32.422934+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:29.159417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.424763+0000","last_change":"2024-09-19T08:54:31.430446+0000","last_active":"2024-09-19T08:54:32.424763+0000","last_peered":"2024-09-19T08:54:32.424763+0000","last_clean":"2024-09-19T08:54:32.424763+0000","last_became_active":"2024-09-19T08:54:31.430048+0000","last_became_peered":"2024-09-19T08:54:31.430048+0000","last_unstale":"2024-09-19T08:54:32.424763+0000","last_undegraded":"2024-09-19T08:54:32.424763+0000","last_fullsized":"2024-09-19T08:54:32.424763+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:24.773947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.437326+0000","last_change":"2024-09-19T08:54:31.433144+0000","last_active":"2024-09-19T08:54:32.437326+0000","last_peered":"2024-09-19T08:54:32.437326+0000","last_clean":"2024-09-19T08:54:32.437326+0000","last_became_active":"2024-09-19T08:54:31.432590+0000","last_became_peered":"2024-09-19T08:54:31.432590+0000","last_unstale":"2024-09-19T08:54:32.437326+0000","last_undegraded":"2024-09-19T08:54:32.437326+0000","last_fullsized":"2024-09-19T08:54:32.437326+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:53.756846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.435148+0000","last_change":"2024-09-19T08:54:31.435712+0000","last_active":"2024-09-19T08:54:32.435148+0000","last_peered":"2024-09-19T08:54:32.435148+0000","last_clean":"2024-09-19T08:54:32.435148+0000","last_became_active":"2024-09-19T08:54:31.435301+0000","last_became_peered":"2024-09-19T08:54:31.435301+0000","last_unstale":"2024-09-19T08:54:32.435148+0000","last_undegraded":"2024-09-19T08:54:32.435148+0000","last_fullsized":"2024-09-19T08:54:32.435148+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:51.703709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.434880+0000","last_change":"2024-09-19T08:54:31.434404+0000","last_active":"2024-09-19T08:54:32.434880+0000","last_peered":"2024-09-19T08:54:32.434880+0000","last_clean":"2024-09-19T08:54:32.434880+0000","last_became_active":"2024-09-19T08:54:31.434033+0000","last_became_peered":"2024-09-19T08:54:31.434033+0000","last_unstale":"2024-09-19T08:54:32.434880+0000","last_undegraded":"2024-09-19T08:54:32.434880+0000","last_fullsized":"2024-09-19T08:54:32.434880+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:06.815278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433455+0000","last_change":"2024-09-19T08:54:31.425590+0000","last_active":"2024-09-19T08:54:32.433455+0000","last_peered":"2024-09-19T08:54:32.433455+0000","last_clean":"2024-09-19T08:54:32.433455+0000","last_became_active":"2024-09-19T08:54:31.425268+0000","last_became_peered":"2024-09-19T08:54:31.425268+0000","last_unstale":"2024-09-19T08:54:32.433455+0000","last_undegraded":"2024-09-19T08:54:32.433455+0000","last_fullsized":"2024-09-19T08:54:32.433455+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:09.404947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.435997+0000","last_change":"2024-09-19T08:54:31.428372+0000","last_active":"2024-09-19T08:54:32.435997+0000","last_peered":"2024-09-19T08:54:32.435997+0000","last_clean":"2024-09-19T08:54:32.435997+0000","last_became_active":"2024-09-19T08:54:31.428064+0000","last_became_peered":"2024-09-19T08:54:31.428064+0000","last_unstale":"2024-09-19T08:54:32.435997+0000","last_undegraded":"2024-09-19T08:54:32.435997+0000","last_fullsized":"2024-09-19T08:54:32.435997+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:40.444117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.435596+0000","last_change":"2024-09-19T08:54:31.424365+0000","last_active":"2024-09-19T08:54:32.435596+0000","last_peered":"2024-09-19T08:54:32.435596+0000","last_clean":"2024-09-19T08:54:32.435596+0000","last_became_active":"2024-09-19T08:54:31.424044+0000","last_became_peered":"2024-09-19T08:54:31.424044+0000","last_unstale":"2024-09-19T08:54:32.435596+0000","last_undegraded":"2024-09-19T08:54:32.435596+0000","last_fullsized":"2024-09-19T08:54:32.435596+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:16.435389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.424181+0000","last_change":"2024-09-19T08:54:31.437238+0000","last_active":"2024-09-19T08:54:32.424181+0000","last_peered":"2024-09-19T08:54:32.424181+0000","last_clean":"2024-09-19T08:54:32.424181+0000","last_became_active":"2024-09-19T08:54:31.436867+0000","last_became_peered":"2024-09-19T08:54:31.436867+0000","last_unstale":"2024-09-19T08:54:32.424181+0000","last_undegraded":"2024-09-19T08:54:32.424181+0000","last_fullsized":"2024-09-19T08:54:32.424181+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:59.839081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.326763+0000","last_change":"2024-09-19T08:54:31.438654+0000","last_active":"2024-09-19T08:54:52.326763+0000","last_peered":"2024-09-19T08:54:52.326763+0000","last_clean":"2024-09-19T08:54:52.326763+0000","last_became_active":"2024-09-19T08:54:31.438342+0000","last_became_peered":"2024-09-19T08:54:31.438342+0000","last_unstale":"2024-09-19T08:54:52.326763+0000","last_undegraded":"2024-09-19T08:54:52.326763+0000","last_fullsized":"2024-09-19T08:54:52.326763+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:55.190605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.434755+0000","last_change":"2024-09-19T08:54:31.431100+0000","last_active":"2024-09-19T08:54:32.434755+0000","last_peered":"2024-09-19T08:54:32.434755+0000","last_clean":"2024-09-19T08:54:32.434755+0000","last_became_active":"2024-09-19T08:54:31.430749+0000","last_became_peered":"2024-09-19T08:54:31.430749+0000","last_unstale":"2024-09-19T08:54:32.434755+0000","last_undegraded":"2024-09-19T08:54:32.434755+0000","last_fullsized":"2024-09-19T08:54:32.434755+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:50.597610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.435486+0000","last_change":"2024-09-19T08:54:31.427454+0000","last_active":"2024-09-19T08:54:32.435486+0000","last_peered":"2024-09-19T08:54:32.435486+0000","last_clean":"2024-09-19T08:54:32.435486+0000","last_became_active":"2024-09-19T08:54:31.427098+0000","last_became_peered":"2024-09-19T08:54:31.427098+0000","last_unstale":"2024-09-19T08:54:32.435486+0000","last_undegraded":"2024-09-19T08:54:32.435486+0000","last_fullsized":"2024-09-19T08:54:32.435486+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:01.042626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.326377+0000","last_change":"2024-09-19T08:54:31.433887+0000","last_active":"2024-09-19T08:54:52.326377+0000","last_peered":"2024-09-19T08:54:52.326377+0000","last_clean":"2024-09-19T08:54:52.326377+0000","last_became_active":"2024-09-19T08:54:31.433528+0000","last_became_peered":"2024-09-19T08:54:31.433528+0000","last_unstale":"2024-09-19T08:54:52.326377+0000","last_undegraded":"2024-09-19T08:54:52.326377+0000","last_fullsized":"2024-09-19T08:54:52.326377+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:37.291226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433596+0000","last_change":"2024-09-19T08:54:31.436976+0000","last_active":"2024-09-19T08:54:32.433596+0000","last_peered":"2024-09-19T08:54:32.433596+0000","last_clean":"2024-09-19T08:54:32.433596+0000","last_became_active":"2024-09-19T08:54:31.436646+0000","last_became_peered":"2024-09-19T08:54:31.436646+0000","last_unstale":"2024-09-19T08:54:32.433596+0000","last_undegraded":"2024-09-19T08:54:32.433596+0000","last_fullsized":"2024-09-19T08:54:32.433596+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:19.755556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.424286+0000","last_change":"2024-09-19T08:54:31.438922+0000","last_active":"2024-09-19T08:54:32.424286+0000","last_peered":"2024-09-19T08:54:32.424286+0000","last_clean":"2024-09-19T08:54:32.424286+0000","last_became_active":"2024-09-19T08:54:31.438593+0000","last_became_peered":"2024-09-19T08:54:31.438593+0000","last_unstale":"2024-09-19T08:54:32.424286+0000","last_undegraded":"2024-09-19T08:54:32.424286+0000","last_fullsized":"2024-09-19T08:54:32.424286+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:07.347900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.422965+0000","last_change":"2024-09-19T08:54:31.431659+0000","last_active":"2024-09-19T08:54:32.422965+0000","last_peered":"2024-09-19T08:54:32.422965+0000","last_clean":"2024-09-19T08:54:32.422965+0000","last_became_active":"2024-09-19T08:54:31.431359+0000","last_became_peered":"2024-09-19T08:54:31.431359+0000","last_unstale":"2024-09-19T08:54:32.422965+0000","last_undegraded":"2024-09-19T08:54:32.422965+0000","last_fullsized":"2024-09-19T08:54:32.422965+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:02.421286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.329257+0000","last_change":"2024-09-19T08:54:31.432185+0000","last_active":"2024-09-19T08:54:52.329257+0000","last_peered":"2024-09-19T08:54:52.329257+0000","last_clean":"2024-09-19T08:54:52.329257+0000","last_became_active":"2024-09-19T08:54:31.431418+0000","last_became_peered":"2024-09-19T08:54:31.431418+0000","last_unstale":"2024-09-19T08:54:52.329257+0000","last_undegraded":"2024-09-19T08:54:52.329257+0000","last_fullsized":"2024-09-19T08:54:52.329257+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:45.347487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.423465+0000","last_change":"2024-09-19T08:54:31.433742+0000","last_active":"2024-09-19T08:54:32.423465+0000","last_peered":"2024-09-19T08:54:32.423465+0000","last_clean":"2024-09-19T08:54:32.423465+0000","last_became_active":"2024-09-19T08:54:31.433455+0000","last_became_peered":"2024-09-19T08:54:31.433455+0000","last_unstale":"2024-09-19T08:54:32.423465+0000","last_undegraded":"2024-09-19T08:54:32.423465+0000","last_fullsized":"2024-09-19T08:54:32.423465+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:38.803705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.438023+0000","last_change":"2024-09-19T08:54:31.432954+0000","last_active":"2024-09-19T08:54:32.438023+0000","last_peered":"2024-09-19T08:54:32.438023+0000","last_clean":"2024-09-19T08:54:32.438023+0000","last_became_active":"2024-09-19T08:54:31.432574+0000","last_became_peered":"2024-09-19T08:54:31.432574+0000","last_unstale":"2024-09-19T08:54:32.438023+0000","last_undegraded":"2024-09-19T08:54:32.438023+0000","last_fullsized":"2024-09-19T08:54:32.438023+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:30.457191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.326618+0000","last_change":"2024-09-19T08:54:31.435544+0000","last_active":"2024-09-19T08:54:52.326618+0000","last_peered":"2024-09-19T08:54:52.326618+0000","last_clean":"2024-09-19T08:54:52.326618+0000","last_became_active":"2024-09-19T08:54:31.435195+0000","last_became_peered":"2024-09-19T08:54:31.435195+0000","last_unstale":"2024-09-19T08:54:52.326618+0000","last_undegraded":"2024-09-19T08:54:52.326618+0000","last_fullsized":"2024-09-19T08:54:52.326618+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:54.240654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433344+0000","last_change":"2024-09-19T08:54:31.428403+0000","last_active":"2024-09-19T08:54:32.433344+0000","last_peered":"2024-09-19T08:54:32.433344+0000","last_clean":"2024-09-19T08:54:32.433344+0000","last_became_active":"2024-09-19T08:54:31.428110+0000","last_became_peered":"2024-09-19T08:54:31.428110+0000","last_unstale":"2024-09-19T08:54:32.433344+0000","last_undegraded":"2024-09-19T08:54:32.433344+0000","last_fullsized":"2024-09-19T08:54:32.433344+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:05.593073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.436572+0000","last_change":"2024-09-19T08:54:31.427291+0000","last_active":"2024-09-19T08:54:32.436572+0000","last_peered":"2024-09-19T08:54:32.436572+0000","last_clean":"2024-09-19T08:54:32.436572+0000","last_became_active":"2024-09-19T08:54:31.427011+0000","last_became_peered":"2024-09-19T08:54:31.427011+0000","last_unstale":"2024-09-19T08:54:32.436572+0000","last_undegraded":"2024-09-19T08:54:32.436572+0000","last_fullsized":"2024-09-19T08:54:32.436572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:54.338526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.434037+0000","last_change":"2024-09-19T08:54:31.429309+0000","last_active":"2024-09-19T08:54:32.434037+0000","last_peered":"2024-09-19T08:54:32.434037+0000","last_clean":"2024-09-19T08:54:32.434037+0000","last_became_active":"2024-09-19T08:54:31.428381+0000","last_became_peered":"2024-09-19T08:54:31.428381+0000","last_unstale":"2024-09-19T08:54:32.434037+0000","last_undegraded":"2024-09-19T08:54:32.434037+0000","last_fullsized":"2024-09-19T08:54:32.434037+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:22:33.920114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.434367+0000","last_change":"2024-09-19T08:54:31.431711+0000","last_active":"2024-09-19T08:54:32.434367+0000","last_peered":"2024-09-19T08:54:32.434367+0000","last_clean":"2024-09-19T08:54:32.434367+0000","last_became_active":"2024-09-19T08:54:31.431425+0000","last_became_peered":"2024-09-19T08:54:31.431425+0000","last_unstale":"2024-09-19T08:54:32.434367+0000","last_undegraded":"2024-09-19T08:54:32.434367+0000","last_fullsized":"2024-09-19T08:54:32.434367+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:39.751214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"peering","last_fresh":"2024-09-19T08:54:33.236674+0000","last_change":"2024-09-19T08:54:52.326921+0000","last_active":"2024-09-19T08:54:52.326921+0000","last_peered":"2024-09-19T08:54:33.236674+0000","last_clean":"2024-09-19T08:54:33.236674+0000","last_became_active":"2024-09-19T08:54:31.427335+0000","last_became_peered":"2024-09-19T08:54:31.427335+0000","last_unstale":"2024-09-19T08:54:33.236674+0000","last_undegraded":"2024-09-19T08:54:33.236674+0000","last_fullsized":"2024-09-19T08:54:33.236674+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,5,9],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.434325+0000","last_change":"2024-09-19T08:54:31.427608+0000","last_active":"2024-09-19T08:54:32.434325+0000","last_peered":"2024-09-19T08:54:32.434325+0000","last_clean":"2024-09-19T08:54:32.434325+0000","last_became_active":"2024-09-19T08:54:31.427294+0000","last_became_peered":"2024-09-19T08:54:31.427294+0000","last_unstale":"2024-09-19T08:54:32.434325+0000","last_undegraded":"2024-09-19T08:54:32.434325+0000","last_fullsized":"2024-09-19T08:54:32.434325+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:41.356609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'1","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.329204+0000","last_change":"2024-09-19T08:54:29.416204+0000","last_active":"2024-09-19T08:54:52.329204+0000","last_peered":"2024-09-19T08:54:52.329204+0000","last_clean":"2024-09-19T08:54:52.329204+0000","last_became_active":"2024-09-19T08:54:29.415872+0000","last_became_peered":"2024-09-19T08:54:29.415872+0000","last_unstale":"2024-09-19T08:54:52.329204+0000","last_undegraded":"2024-09-19T08:54:52.329204+0000","last_fullsized":"2024-09-19T08:54:52.329204+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:13.844147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.329103+0000","last_change":"2024-09-19T08:54:31.432137+0000","last_active":"2024-09-19T08:54:52.329103+0000","last_peered":"2024-09-19T08:54:52.329103+0000","last_clean":"2024-09-19T08:54:52.329103+0000","last_became_active":"2024-09-19T08:54:31.431761+0000","last_became_peered":"2024-09-19T08:54:31.431761+0000","last_unstale":"2024-09-19T08:54:52.329103+0000","last_undegraded":"2024-09-19T08:54:52.329103+0000","last_fullsized":"2024-09-19T08:54:52.329103+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:05.008431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433993+0000","last_change":"2024-09-19T08:54:29.413221+0000","last_active":"2024-09-19T08:54:32.433993+0000","last_peered":"2024-09-19T08:54:32.433993+0000","last_clean":"2024-09-19T08:54:32.433993+0000","last_became_active":"2024-09-19T08:54:29.412829+0000","last_became_peered":"2024-09-19T08:54:29.412829+0000","last_unstale":"2024-09-19T08:54:32.433993+0000","last_undegraded":"2024-09-19T08:54:32.433993+0000","last_fullsized":"2024-09-19T08:54:32.433993+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:07.224136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433498+0000","last_change":"2024-09-19T08:54:29.410221+0000","last_active":"2024-09-19T08:54:32.433498+0000","last_peered":"2024-09-19T08:54:32.433498+0000","last_clean":"2024-09-19T08:54:32.433498+0000","last_became_active":"2024-09-19T08:54:29.409951+0000","last_became_peered":"2024-09-19T08:54:29.409951+0000","last_unstale":"2024-09-19T08:54:32.433498+0000","last_undegraded":"2024-09-19T08:54:32.433498+0000","last_fullsized":"2024-09-19T08:54:32.433498+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:58.350932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.422974+0000","last_change":"2024-09-19T08:54:31.429979+0000","last_active":"2024-09-19T08:54:32.422974+0000","last_peered":"2024-09-19T08:54:32.422974+0000","last_clean":"2024-09-19T08:54:32.422974+0000","last_became_active":"2024-09-19T08:54:31.429661+0000","last_became_peered":"2024-09-19T08:54:31.429661+0000","last_unstale":"2024-09-19T08:54:32.422974+0000","last_undegraded":"2024-09-19T08:54:32.422974+0000","last_fullsized":"2024-09-19T08:54:32.422974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:27:40.603490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.330262+0000","last_change":"2024-09-19T08:54:29.415769+0000","last_active":"2024-09-19T08:54:52.330262+0000","last_peered":"2024-09-19T08:54:52.330262+0000","last_clean":"2024-09-19T08:54:52.330262+0000","last_became_active":"2024-09-19T08:54:29.415245+0000","last_became_peered":"2024-09-19T08:54:29.415245+0000","last_unstale":"2024-09-19T08:54:52.330262+0000","last_undegraded":"2024-09-19T08:54:52.330262+0000","last_fullsized":"2024-09-19T08:54:52.330262+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:15.487945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433915+0000","last_change":"2024-09-19T08:54:31.427126+0000","last_active":"2024-09-19T08:54:32.433915+0000","last_peered":"2024-09-19T08:54:32.433915+0000","last_clean":"2024-09-19T08:54:32.433915+0000","last_became_active":"2024-09-19T08:54:31.426816+0000","last_became_peered":"2024-09-19T08:54:31.426816+0000","last_unstale":"2024-09-19T08:54:32.433915+0000","last_undegraded":"2024-09-19T08:54:32.433915+0000","last_fullsized":"2024-09-19T08:54:32.433915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:38.039428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.434006+0000","last_change":"2024-09-19T08:54:29.411354+0000","last_active":"2024-09-19T08:54:32.434006+0000","last_peered":"2024-09-19T08:54:32.434006+0000","last_clean":"2024-09-19T08:54:32.434006+0000","last_became_active":"2024-09-19T08:54:29.410990+0000","last_became_peered":"2024-09-19T08:54:29.410990+0000","last_unstale":"2024-09-19T08:54:32.434006+0000","last_undegraded":"2024-09-19T08:54:32.434006+0000","last_fullsized":"2024-09-19T08:54:32.434006+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:29.338169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.424504+0000","last_change":"2024-09-19T08:54:31.426243+0000","last_active":"2024-09-19T08:54:32.424504+0000","last_peered":"2024-09-19T08:54:32.424504+0000","last_clean":"2024-09-19T08:54:32.424504+0000","last_became_active":"2024-09-19T08:54:31.425895+0000","last_became_peered":"2024-09-19T08:54:31.425895+0000","last_unstale":"2024-09-19T08:54:32.424504+0000","last_undegraded":"2024-09-19T08:54:32.424504+0000","last_fullsized":"2024-09-19T08:54:32.424504+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:13.562780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.436375+0000","last_change":"2024-09-19T08:54:29.416646+0000","last_active":"2024-09-19T08:54:32.436375+0000","last_peered":"2024-09-19T08:54:32.436375+0000","last_clean":"2024-09-19T08:54:32.436375+0000","last_became_active":"2024-09-19T08:54:29.416260+0000","last_became_peered":"2024-09-19T08:54:29.416260+0000","last_unstale":"2024-09-19T08:54:32.436375+0000","last_undegraded":"2024-09-19T08:54:32.436375+0000","last_fullsized":"2024-09-19T08:54:32.436375+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:42:17.467035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.436253+0000","last_change":"2024-09-19T08:54:31.435538+0000","last_active":"2024-09-19T08:54:32.436253+0000","last_peered":"2024-09-19T08:54:32.436253+0000","last_clean":"2024-09-19T08:54:32.436253+0000","last_became_active":"2024-09-19T08:54:31.435185+0000","last_became_peered":"2024-09-19T08:54:31.435185+0000","last_unstale":"2024-09-19T08:54:32.436253+0000","last_undegraded":"2024-09-19T08:54:32.436253+0000","last_fullsized":"2024-09-19T08:54:32.436253+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:06.940123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'3","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.329891+0000","last_change":"2024-09-19T08:54:29.675914+0000","last_active":"2024-09-19T08:54:52.329891+0000","last_peered":"2024-09-19T08:54:52.329891+0000","last_clean":"2024-09-19T08:54:52.329891+0000","last_became_active":"2024-09-19T08:54:29.675482+0000","last_became_peered":"2024-09-19T08:54:29.675482+0000","last_unstale":"2024-09-19T08:54:52.329891+0000","last_undegraded":"2024-09-19T08:54:52.329891+0000","last_fullsized":"2024-09-19T08:54:52.329891+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:58.893008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.424622+0000","last_change":"2024-09-19T08:54:31.432628+0000","last_active":"2024-09-19T08:54:32.424622+0000","last_peered":"2024-09-19T08:54:32.424622+0000","last_clean":"2024-09-19T08:54:32.424622+0000","last_became_active":"2024-09-19T08:54:31.430640+0000","last_became_peered":"2024-09-19T08:54:31.430640+0000","last_unstale":"2024-09-19T08:54:32.424622+0000","last_undegraded":"2024-09-19T08:54:32.424622+0000","last_fullsized":"2024-09-19T08:54:32.424622+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:07.793089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'20","reported_seq":70,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:51.509862+0000","last_change":"2024-09-19T08:54:29.414619+0000","last_active":"2024-09-19T08:54:51.509862+0000","last_peered":"2024-09-19T08:54:51.509862+0000","last_clean":"2024-09-19T08:54:51.509862+0000","last_became_active":"2024-09-19T08:54:29.414295+0000","last_became_peered":"2024-09-19T08:54:29.414295+0000","last_unstale":"2024-09-19T08:54:51.509862+0000","last_undegraded":"2024-09-19T08:54:51.509862+0000","last_fullsized":"2024-09-19T08:54:51.509862+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:23.782684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46802,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":61,"num_write":20,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.434740+0000","last_change":"2024-09-19T08:54:31.425432+0000","last_active":"2024-09-19T08:54:32.434740+0000","last_peered":"2024-09-19T08:54:32.434740+0000","last_clean":"2024-09-19T08:54:32.434740+0000","last_became_active":"2024-09-19T08:54:31.425086+0000","last_became_peered":"2024-09-19T08:54:31.425086+0000","last_unstale":"2024-09-19T08:54:32.434740+0000","last_undegraded":"2024-09-19T08:54:32.434740+0000","last_fullsized":"2024-09-19T08:54:32.434740+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:56.572339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'2","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.441226+0000","last_change":"2024-09-19T08:54:29.415055+0000","last_active":"2024-09-19T08:54:32.441226+0000","last_peered":"2024-09-19T08:54:32.441226+0000","last_clean":"2024-09-19T08:54:32.441226+0000","last_became_active":"2024-09-19T08:54:29.414573+0000","last_became_peered":"2024-09-19T08:54:29.414573+0000","last_unstale":"2024-09-19T08:54:32.441226+0000","last_undegraded":"2024-09-19T08:54:32.441226+0000","last_fullsized":"2024-09-19T08:54:32.441226+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:13.013714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433266+0000","last_change":"2024-09-19T08:54:31.436905+0000","last_active":"2024-09-19T08:54:32.433266+0000","last_peered":"2024-09-19T08:54:32.433266+0000","last_clean":"2024-09-19T08:54:32.433266+0000","last_became_active":"2024-09-19T08:54:31.436571+0000","last_became_peered":"2024-09-19T08:54:31.436571+0000","last_unstale":"2024-09-19T08:54:32.433266+0000","last_undegraded":"2024-09-19T08:54:32.433266+0000","last_fullsized":"2024-09-19T08:54:32.433266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:55.294255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.329565+0000","last_change":"2024-09-19T08:54:29.417958+0000","last_active":"2024-09-19T08:54:52.329565+0000","last_peered":"2024-09-19T08:54:52.329565+0000","last_clean":"2024-09-19T08:54:52.329565+0000","last_became_active":"2024-09-19T08:54:29.417570+0000","last_became_peered":"2024-09-19T08:54:29.417570+0000","last_unstale":"2024-09-19T08:54:52.329565+0000","last_undegraded":"2024-09-19T08:54:52.329565+0000","last_fullsized":"2024-09-19T08:54:52.329565+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:25.557217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.436309+0000","last_change":"2024-09-19T08:54:31.433019+0000","last_active":"2024-09-19T08:54:32.436309+0000","last_peered":"2024-09-19T08:54:32.436309+0000","last_clean":"2024-09-19T08:54:32.436309+0000","last_became_active":"2024-09-19T08:54:31.431265+0000","last_became_peered":"2024-09-19T08:54:31.431265+0000","last_unstale":"2024-09-19T08:54:32.436309+0000","last_undegraded":"2024-09-19T08:54:32.436309+0000","last_fullsized":"2024-09-19T08:54:32.436309+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:36.481863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.329875+0000","last_change":"2024-09-19T08:54:29.414236+0000","last_active":"2024-09-19T08:54:52.329875+0000","last_peered":"2024-09-19T08:54:52.329875+0000","last_clean":"2024-09-19T08:54:52.329875+0000","last_became_active":"2024-09-19T08:54:29.413878+0000","last_became_peered":"2024-09-19T08:54:29.413878+0000","last_unstale":"2024-09-19T08:54:52.329875+0000","last_undegraded":"2024-09-19T08:54:52.329875+0000","last_fullsized":"2024-09-19T08:54:52.329875+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:11.222362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.434637+0000","last_change":"2024-09-19T08:54:31.439512+0000","last_active":"2024-09-19T08:54:32.434637+0000","last_peered":"2024-09-19T08:54:32.434637+0000","last_clean":"2024-09-19T08:54:32.434637+0000","last_became_active":"2024-09-19T08:54:31.438767+0000","last_became_peered":"2024-09-19T08:54:31.438767+0000","last_unstale":"2024-09-19T08:54:32.434637+0000","last_undegraded":"2024-09-19T08:54:32.434637+0000","last_fullsized":"2024-09-19T08:54:32.434637+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:31.784577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'8","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.441075+0000","last_change":"2024-09-19T08:54:29.675768+0000","last_active":"2024-09-19T08:54:32.441075+0000","last_peered":"2024-09-19T08:54:32.441075+0000","last_clean":"2024-09-19T08:54:32.441075+0000","last_became_active":"2024-09-19T08:54:29.675376+0000","last_became_peered":"2024-09-19T08:54:29.675376+0000","last_unstale":"2024-09-19T08:54:32.441075+0000","last_undegraded":"2024-09-19T08:54:32.441075+0000","last_fullsized":"2024-09-19T08:54:32.441075+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:10.281126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.329401+0000","last_change":"2024-09-19T08:54:31.435904+0000","last_active":"2024-09-19T08:54:52.329401+0000","last_peered":"2024-09-19T08:54:52.329401+0000","last_clean":"2024-09-19T08:54:52.329401+0000","last_became_active":"2024-09-19T08:54:31.435396+0000","last_became_peered":"2024-09-19T08:54:31.435396+0000","last_unstale":"2024-09-19T08:54:52.329401+0000","last_undegraded":"2024-09-19T08:54:52.329401+0000","last_fullsized":"2024-09-19T08:54:52.329401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:41.567463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'1","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.440033+0000","last_change":"2024-09-19T08:54:29.410221+0000","last_active":"2024-09-19T08:54:32.440033+0000","last_peered":"2024-09-19T08:54:32.440033+0000","last_clean":"2024-09-19T08:54:32.440033+0000","last_became_active":"2024-09-19T08:54:29.409856+0000","last_became_peered":"2024-09-19T08:54:29.409856+0000","last_unstale":"2024-09-19T08:54:32.440033+0000","last_undegraded":"2024-09-19T08:54:32.440033+0000","last_fullsized":"2024-09-19T08:54:32.440033+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:46.095816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.326482+0000","last_change":"2024-09-19T08:54:31.437854+0000","last_active":"2024-09-19T08:54:52.326482+0000","last_peered":"2024-09-19T08:54:52.326482+0000","last_clean":"2024-09-19T08:54:52.326482+0000","last_became_active":"2024-09-19T08:54:31.437491+0000","last_became_peered":"2024-09-19T08:54:31.437491+0000","last_unstale":"2024-09-19T08:54:52.326482+0000","last_undegraded":"2024-09-19T08:54:52.326482+0000","last_fullsized":"2024-09-19T08:54:52.326482+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:22.532429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.441422+0000","last_change":"2024-09-19T08:54:29.413937+0000","last_active":"2024-09-19T08:54:32.441422+0000","last_peered":"2024-09-19T08:54:32.441422+0000","last_clean":"2024-09-19T08:54:32.441422+0000","last_became_active":"2024-09-19T08:54:29.413610+0000","last_became_peered":"2024-09-19T08:54:29.413610+0000","last_unstale":"2024-09-19T08:54:32.441422+0000","last_undegraded":"2024-09-19T08:54:32.441422+0000","last_fullsized":"2024-09-19T08:54:32.441422+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:26.093427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.435271+0000","last_change":"2024-09-19T08:54:31.429376+0000","last_active":"2024-09-19T08:54:32.435271+0000","last_peered":"2024-09-19T08:54:32.435271+0000","last_clean":"2024-09-19T08:54:32.435271+0000","last_became_active":"2024-09-19T08:54:31.429006+0000","last_became_peered":"2024-09-19T08:54:31.429006+0000","last_unstale":"2024-09-19T08:54:32.435271+0000","last_undegraded":"2024-09-19T08:54:32.435271+0000","last_fullsized":"2024-09-19T08:54:32.435271+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:26.399838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.330002+0000","last_change":"2024-09-19T08:54:29.414307+0000","last_active":"2024-09-19T08:54:52.330002+0000","last_peered":"2024-09-19T08:54:52.330002+0000","last_clean":"2024-09-19T08:54:52.330002+0000","last_became_active":"2024-09-19T08:54:29.413823+0000","last_became_peered":"2024-09-19T08:54:29.413823+0000","last_unstale":"2024-09-19T08:54:52.330002+0000","last_undegraded":"2024-09-19T08:54:52.330002+0000","last_fullsized":"2024-09-19T08:54:52.330002+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:25.484645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:35.377440+0000","last_change":"2024-09-19T08:54:31.437789+0000","last_active":"2024-09-19T08:54:35.377440+0000","last_peered":"2024-09-19T08:54:35.377440+0000","last_clean":"2024-09-19T08:54:35.377440+0000","last_became_active":"2024-09-19T08:54:31.435488+0000","last_became_peered":"2024-09-19T08:54:31.435488+0000","last_unstale":"2024-09-19T08:54:35.377440+0000","last_undegraded":"2024-09-19T08:54:35.377440+0000","last_fullsized":"2024-09-19T08:54:35.377440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:19.332440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.434579+0000","last_change":"2024-09-19T08:54:29.675623+0000","last_active":"2024-09-19T08:54:32.434579+0000","last_peered":"2024-09-19T08:54:32.434579+0000","last_clean":"2024-09-19T08:54:32.434579+0000","last_became_active":"2024-09-19T08:54:29.675284+0000","last_became_peered":"2024-09-19T08:54:29.675284+0000","last_unstale":"2024-09-19T08:54:32.434579+0000","last_undegraded":"2024-09-19T08:54:32.434579+0000","last_fullsized":"2024-09-19T08:54:32.434579+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:54.621202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.435253+0000","last_change":"2024-09-19T08:54:31.434564+0000","last_active":"2024-09-19T08:54:32.435253+0000","last_peered":"2024-09-19T08:54:32.435253+0000","last_clean":"2024-09-19T08:54:32.435253+0000","last_became_active":"2024-09-19T08:54:31.434231+0000","last_became_peered":"2024-09-19T08:54:31.434231+0000","last_unstale":"2024-09-19T08:54:32.435253+0000","last_undegraded":"2024-09-19T08:54:32.435253+0000","last_fullsized":"2024-09-19T08:54:32.435253+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:31.316400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":330,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.434952+0000","last_change":"2024-09-19T08:53:21.357560+0000","last_active":"2024-09-19T08:54:32.434952+0000","last_peered":"2024-09-19T08:54:32.434952+0000","last_clean":"2024-09-19T08:54:32.434952+0000","last_became_active":"2024-09-19T08:53:21.357122+0000","last_became_peered":"2024-09-19T08:53:21.357122+0000","last_unstale":"2024-09-19T08:54:32.434952+0000","last_undegraded":"2024-09-19T08:54:32.434952+0000","last_fullsized":"2024-09-19T08:54:32.434952+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:05.231370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:05.231370+0000","last_clean_scrub_stamp":"2024-09-19T08:50:05.231370+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:47.867682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.330224+0000","last_change":"2024-09-19T08:54:29.412240+0000","last_active":"2024-09-19T08:54:52.330224+0000","last_peered":"2024-09-19T08:54:52.330224+0000","last_clean":"2024-09-19T08:54:52.330224+0000","last_became_active":"2024-09-19T08:54:29.411908+0000","last_became_peered":"2024-09-19T08:54:29.411908+0000","last_unstale":"2024-09-19T08:54:52.330224+0000","last_undegraded":"2024-09-19T08:54:52.330224+0000","last_fullsized":"2024-09-19T08:54:52.330224+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:37.189373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.423244+0000","last_change":"2024-09-19T08:54:31.432956+0000","last_active":"2024-09-19T08:54:32.423244+0000","last_peered":"2024-09-19T08:54:32.423244+0000","last_clean":"2024-09-19T08:54:32.423244+0000","last_became_active":"2024-09-19T08:54:31.432639+0000","last_became_peered":"2024-09-19T08:54:31.432639+0000","last_unstale":"2024-09-19T08:54:32.423244+0000","last_undegraded":"2024-09-19T08:54:32.423244+0000","last_fullsized":"2024-09-19T08:54:32.423244+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:58.302624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.434851+0000","last_change":"2024-09-19T08:54:29.414214+0000","last_active":"2024-09-19T08:54:32.434851+0000","last_peered":"2024-09-19T08:54:32.434851+0000","last_clean":"2024-09-19T08:54:32.434851+0000","last_became_active":"2024-09-19T08:54:29.413853+0000","last_became_peered":"2024-09-19T08:54:29.413853+0000","last_unstale":"2024-09-19T08:54:32.434851+0000","last_undegraded":"2024-09-19T08:54:32.434851+0000","last_fullsized":"2024-09-19T08:54:32.434851+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:28:29.119856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433152+0000","last_change":"2024-09-19T08:54:31.424643+0000","last_active":"2024-09-19T08:54:32.433152+0000","last_peered":"2024-09-19T08:54:32.433152+0000","last_clean":"2024-09-19T08:54:32.433152+0000","last_became_active":"2024-09-19T08:54:31.424363+0000","last_became_peered":"2024-09-19T08:54:31.424363+0000","last_unstale":"2024-09-19T08:54:32.433152+0000","last_undegraded":"2024-09-19T08:54:32.433152+0000","last_fullsized":"2024-09-19T08:54:32.433152+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:37.529952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433606+0000","last_change":"2024-09-19T08:54:29.675742+0000","last_active":"2024-09-19T08:54:32.433606+0000","last_peered":"2024-09-19T08:54:32.433606+0000","last_clean":"2024-09-19T08:54:32.433606+0000","last_became_active":"2024-09-19T08:54:29.675347+0000","last_became_peered":"2024-09-19T08:54:29.675347+0000","last_unstale":"2024-09-19T08:54:32.433606+0000","last_undegraded":"2024-09-19T08:54:32.433606+0000","last_fullsized":"2024-09-19T08:54:32.433606+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:00.925390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.329392+0000","last_change":"2024-09-19T08:54:31.433887+0000","last_active":"2024-09-19T08:54:52.329392+0000","last_peered":"2024-09-19T08:54:52.329392+0000","last_clean":"2024-09-19T08:54:52.329392+0000","last_became_active":"2024-09-19T08:54:31.433331+0000","last_became_peered":"2024-09-19T08:54:31.433331+0000","last_unstale":"2024-09-19T08:54:52.329392+0000","last_undegraded":"2024-09-19T08:54:52.329392+0000","last_fullsized":"2024-09-19T08:54:52.329392+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:49.875061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.436266+0000","last_change":"2024-09-19T08:54:29.417410+0000","last_active":"2024-09-19T08:54:32.436266+0000","last_peered":"2024-09-19T08:54:32.436266+0000","last_clean":"2024-09-19T08:54:32.436266+0000","last_became_active":"2024-09-19T08:54:29.417018+0000","last_became_peered":"2024-09-19T08:54:29.417018+0000","last_unstale":"2024-09-19T08:54:32.436266+0000","last_undegraded":"2024-09-19T08:54:32.436266+0000","last_fullsized":"2024-09-19T08:54:32.436266+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:53.669027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433939+0000","last_change":"2024-09-19T08:54:31.431313+0000","last_active":"2024-09-19T08:54:32.433939+0000","last_peered":"2024-09-19T08:54:32.433939+0000","last_clean":"2024-09-19T08:54:32.433939+0000","last_became_active":"2024-09-19T08:54:31.429427+0000","last_became_peered":"2024-09-19T08:54:31.429427+0000","last_unstale":"2024-09-19T08:54:32.433939+0000","last_undegraded":"2024-09-19T08:54:32.433939+0000","last_fullsized":"2024-09-19T08:54:32.433939+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:55.106769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433530+0000","last_change":"2024-09-19T08:54:29.675722+0000","last_active":"2024-09-19T08:54:32.433530+0000","last_peered":"2024-09-19T08:54:32.433530+0000","last_clean":"2024-09-19T08:54:32.433530+0000","last_became_active":"2024-09-19T08:54:29.675397+0000","last_became_peered":"2024-09-19T08:54:29.675397+0000","last_unstale":"2024-09-19T08:54:32.433530+0000","last_undegraded":"2024-09-19T08:54:32.433530+0000","last_fullsized":"2024-09-19T08:54:32.433530+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:49.574947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.434637+0000","last_change":"2024-09-19T08:54:31.431106+0000","last_active":"2024-09-19T08:54:32.434637+0000","last_peered":"2024-09-19T08:54:32.434637+0000","last_clean":"2024-09-19T08:54:32.434637+0000","last_became_active":"2024-09-19T08:54:31.430745+0000","last_became_peered":"2024-09-19T08:54:31.430745+0000","last_unstale":"2024-09-19T08:54:32.434637+0000","last_undegraded":"2024-09-19T08:54:32.434637+0000","last_fullsized":"2024-09-19T08:54:32.434637+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:22.714106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.434999+0000","last_change":"2024-09-19T08:54:29.675985+0000","last_active":"2024-09-19T08:54:32.434999+0000","last_peered":"2024-09-19T08:54:32.434999+0000","last_clean":"2024-09-19T08:54:32.434999+0000","last_became_active":"2024-09-19T08:54:29.675374+0000","last_became_peered":"2024-09-19T08:54:29.675374+0000","last_unstale":"2024-09-19T08:54:32.434999+0000","last_undegraded":"2024-09-19T08:54:32.434999+0000","last_fullsized":"2024-09-19T08:54:32.434999+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:06.664621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433500+0000","last_change":"2024-09-19T08:54:31.423493+0000","last_active":"2024-09-19T08:54:32.433500+0000","last_peered":"2024-09-19T08:54:32.433500+0000","last_clean":"2024-09-19T08:54:32.433500+0000","last_became_active":"2024-09-19T08:54:31.422651+0000","last_became_peered":"2024-09-19T08:54:31.422651+0000","last_unstale":"2024-09-19T08:54:32.433500+0000","last_undegraded":"2024-09-19T08:54:32.433500+0000","last_fullsized":"2024-09-19T08:54:32.433500+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:51.863965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'4","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:45.433899+0000","last_change":"2024-09-19T08:54:29.408571+0000","last_active":"2024-09-19T08:54:45.433899+0000","last_peered":"2024-09-19T08:54:45.433899+0000","last_clean":"2024-09-19T08:54:45.433899+0000","last_became_active":"2024-09-19T08:54:29.408142+0000","last_became_peered":"2024-09-19T08:54:29.408142+0000","last_unstale":"2024-09-19T08:54:45.433899+0000","last_undegraded":"2024-09-19T08:54:45.433899+0000","last_fullsized":"2024-09-19T08:54:45.433899+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:34.578230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.423464+0000","last_change":"2024-09-19T08:54:31.435333+0000","last_active":"2024-09-19T08:54:32.423464+0000","last_peered":"2024-09-19T08:54:32.423464+0000","last_clean":"2024-09-19T08:54:32.423464+0000","last_became_active":"2024-09-19T08:54:31.435041+0000","last_became_peered":"2024-09-19T08:54:31.435041+0000","last_unstale":"2024-09-19T08:54:32.423464+0000","last_undegraded":"2024-09-19T08:54:32.423464+0000","last_fullsized":"2024-09-19T08:54:32.423464+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:40.972638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'2","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.329561+0000","last_change":"2024-09-19T08:54:29.554303+0000","last_active":"2024-09-19T08:54:52.329561+0000","last_peered":"2024-09-19T08:54:52.329561+0000","last_clean":"2024-09-19T08:54:52.329561+0000","last_became_active":"2024-09-19T08:54:29.553919+0000","last_became_peered":"2024-09-19T08:54:29.553919+0000","last_unstale":"2024-09-19T08:54:52.329561+0000","last_undegraded":"2024-09-19T08:54:52.329561+0000","last_fullsized":"2024-09-19T08:54:52.329561+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:25.103926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.436742+0000","last_change":"2024-09-19T08:54:31.427542+0000","last_active":"2024-09-19T08:54:32.436742+0000","last_peered":"2024-09-19T08:54:32.436742+0000","last_clean":"2024-09-19T08:54:32.436742+0000","last_became_active":"2024-09-19T08:54:31.427239+0000","last_became_peered":"2024-09-19T08:54:31.427239+0000","last_unstale":"2024-09-19T08:54:32.436742+0000","last_undegraded":"2024-09-19T08:54:32.436742+0000","last_fullsized":"2024-09-19T08:54:32.436742+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:00:53.824215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.424196+0000","last_change":"2024-09-19T08:54:29.675665+0000","last_active":"2024-09-19T08:54:32.424196+0000","last_peered":"2024-09-19T08:54:32.424196+0000","last_clean":"2024-09-19T08:54:32.424196+0000","last_became_active":"2024-09-19T08:54:29.675367+0000","last_became_peered":"2024-09-19T08:54:29.675367+0000","last_unstale":"2024-09-19T08:54:32.424196+0000","last_undegraded":"2024-09-19T08:54:32.424196+0000","last_fullsized":"2024-09-19T08:54:32.424196+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:35.473243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433920+0000","last_change":"2024-09-19T08:54:31.430837+0000","last_active":"2024-09-19T08:54:32.433920+0000","last_peered":"2024-09-19T08:54:32.433920+0000","last_clean":"2024-09-19T08:54:32.433920+0000","last_became_active":"2024-09-19T08:54:31.430465+0000","last_became_peered":"2024-09-19T08:54:31.430465+0000","last_unstale":"2024-09-19T08:54:32.433920+0000","last_undegraded":"2024-09-19T08:54:32.433920+0000","last_fullsized":"2024-09-19T08:54:32.433920+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:50.524730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.423169+0000","last_change":"2024-09-19T08:54:29.413803+0000","last_active":"2024-09-19T08:54:32.423169+0000","last_peered":"2024-09-19T08:54:32.423169+0000","last_clean":"2024-09-19T08:54:32.423169+0000","last_became_active":"2024-09-19T08:54:29.413400+0000","last_became_peered":"2024-09-19T08:54:29.413400+0000","last_unstale":"2024-09-19T08:54:32.423169+0000","last_undegraded":"2024-09-19T08:54:32.423169+0000","last_fullsized":"2024-09-19T08:54:32.423169+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:12.518454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.326597+0000","last_change":"2024-09-19T08:54:31.428451+0000","last_active":"2024-09-19T08:54:52.326597+0000","last_peered":"2024-09-19T08:54:52.326597+0000","last_clean":"2024-09-19T08:54:52.326597+0000","last_became_active":"2024-09-19T08:54:31.428134+0000","last_became_peered":"2024-09-19T08:54:31.428134+0000","last_unstale":"2024-09-19T08:54:52.326597+0000","last_undegraded":"2024-09-19T08:54:52.326597+0000","last_fullsized":"2024-09-19T08:54:52.326597+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:08.260183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.434141+0000","last_change":"2024-09-19T08:54:29.414399+0000","last_active":"2024-09-19T08:54:32.434141+0000","last_peered":"2024-09-19T08:54:32.434141+0000","last_clean":"2024-09-19T08:54:32.434141+0000","last_became_active":"2024-09-19T08:54:29.413080+0000","last_became_peered":"2024-09-19T08:54:29.413080+0000","last_unstale":"2024-09-19T08:54:32.434141+0000","last_undegraded":"2024-09-19T08:54:32.434141+0000","last_fullsized":"2024-09-19T08:54:32.434141+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:27.308297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.423152+0000","last_change":"2024-09-19T08:54:31.434550+0000","last_active":"2024-09-19T08:54:32.423152+0000","last_peered":"2024-09-19T08:54:32.423152+0000","last_clean":"2024-09-19T08:54:32.423152+0000","last_became_active":"2024-09-19T08:54:31.434195+0000","last_became_peered":"2024-09-19T08:54:31.434195+0000","last_unstale":"2024-09-19T08:54:32.423152+0000","last_undegraded":"2024-09-19T08:54:32.423152+0000","last_fullsized":"2024-09-19T08:54:32.423152+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:04.807833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'2","reported_seq":2,"reported_epoch":81,"state":"peering","last_fresh":"2024-09-19T08:54:32.433476+0000","last_change":"2024-09-19T08:54:53.238635+0000","last_active":"2024-09-19T08:54:53.238635+0000","last_peered":"2024-09-19T08:54:32.433476+0000","last_clean":"2024-09-19T08:54:32.433476+0000","last_became_active":"2024-09-19T08:54:29.417231+0000","last_became_peered":"2024-09-19T08:54:29.417231+0000","last_unstale":"2024-09-19T08:54:32.433476+0000","last_undegraded":"2024-09-19T08:54:32.433476+0000","last_fullsized":"2024-09-19T08:54:32.433476+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":1,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.436040+0000","last_change":"2024-09-19T08:54:31.441201+0000","last_active":"2024-09-19T08:54:32.436040+0000","last_peered":"2024-09-19T08:54:32.436040+0000","last_clean":"2024-09-19T08:54:32.436040+0000","last_became_active":"2024-09-19T08:54:31.440738+0000","last_became_peered":"2024-09-19T08:54:31.440738+0000","last_unstale":"2024-09-19T08:54:32.436040+0000","last_undegraded":"2024-09-19T08:54:32.436040+0000","last_fullsized":"2024-09-19T08:54:32.436040+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:39.118320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.329775+0000","last_change":"2024-09-19T08:54:31.435772+0000","last_active":"2024-09-19T08:54:52.329775+0000","last_peered":"2024-09-19T08:54:52.329775+0000","last_clean":"2024-09-19T08:54:52.329775+0000","last_became_active":"2024-09-19T08:54:31.435257+0000","last_became_peered":"2024-09-19T08:54:31.435257+0000","last_unstale":"2024-09-19T08:54:52.329775+0000","last_undegraded":"2024-09-19T08:54:52.329775+0000","last_fullsized":"2024-09-19T08:54:52.329775+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:44:12.219054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":2,"reported_epoch":81,"state":"peering","last_fresh":"2024-09-19T08:54:32.433882+0000","last_change":"2024-09-19T08:54:53.238668+0000","last_active":"2024-09-19T08:54:53.238668+0000","last_peered":"2024-09-19T08:54:32.433882+0000","last_clean":"2024-09-19T08:54:32.433882+0000","last_became_active":"2024-09-19T08:54:29.412867+0000","last_became_peered":"2024-09-19T08:54:29.412867+0000","last_unstale":"2024-09-19T08:54:32.433882+0000","last_undegraded":"2024-09-19T08:54:32.433882+0000","last_fullsized":"2024-09-19T08:54:32.433882+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":1,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.424527+0000","last_change":"2024-09-19T08:54:31.427103+0000","last_active":"2024-09-19T08:54:32.424527+0000","last_peered":"2024-09-19T08:54:32.424527+0000","last_clean":"2024-09-19T08:54:32.424527+0000","last_became_active":"2024-09-19T08:54:31.425958+0000","last_became_peered":"2024-09-19T08:54:31.425958+0000","last_unstale":"2024-09-19T08:54:32.424527+0000","last_undegraded":"2024-09-19T08:54:32.424527+0000","last_fullsized":"2024-09-19T08:54:32.424527+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:36.840940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.440499+0000","last_change":"2024-09-19T08:54:29.415209+0000","last_active":"2024-09-19T08:54:32.440499+0000","last_peered":"2024-09-19T08:54:32.440499+0000","last_clean":"2024-09-19T08:54:32.440499+0000","last_became_active":"2024-09-19T08:54:29.414806+0000","last_became_peered":"2024-09-19T08:54:29.414806+0000","last_unstale":"2024-09-19T08:54:32.440499+0000","last_undegraded":"2024-09-19T08:54:32.440499+0000","last_fullsized":"2024-09-19T08:54:32.440499+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:47.764231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.436110+0000","last_change":"2024-09-19T08:54:31.434027+0000","last_active":"2024-09-19T08:54:32.436110+0000","last_peered":"2024-09-19T08:54:32.436110+0000","last_clean":"2024-09-19T08:54:32.436110+0000","last_became_active":"2024-09-19T08:54:31.433687+0000","last_became_peered":"2024-09-19T08:54:31.433687+0000","last_unstale":"2024-09-19T08:54:32.436110+0000","last_undegraded":"2024-09-19T08:54:32.436110+0000","last_fullsized":"2024-09-19T08:54:32.436110+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:56.462128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433897+0000","last_change":"2024-09-19T08:54:29.675502+0000","last_active":"2024-09-19T08:54:32.433897+0000","last_peered":"2024-09-19T08:54:32.433897+0000","last_clean":"2024-09-19T08:54:32.433897+0000","last_became_active":"2024-09-19T08:54:29.675158+0000","last_became_peered":"2024-09-19T08:54:29.675158+0000","last_unstale":"2024-09-19T08:54:32.433897+0000","last_undegraded":"2024-09-19T08:54:32.433897+0000","last_fullsized":"2024-09-19T08:54:32.433897+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:24:59.377521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.423418+0000","last_change":"2024-09-19T08:54:31.432117+0000","last_active":"2024-09-19T08:54:32.423418+0000","last_peered":"2024-09-19T08:54:32.423418+0000","last_clean":"2024-09-19T08:54:32.423418+0000","last_became_active":"2024-09-19T08:54:31.431831+0000","last_became_peered":"2024-09-19T08:54:31.431831+0000","last_unstale":"2024-09-19T08:54:32.423418+0000","last_undegraded":"2024-09-19T08:54:32.423418+0000","last_fullsized":"2024-09-19T08:54:32.423418+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:42.341694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.439715+0000","last_change":"2024-09-19T08:54:29.414478+0000","last_active":"2024-09-19T08:54:32.439715+0000","last_peered":"2024-09-19T08:54:32.439715+0000","last_clean":"2024-09-19T08:54:32.439715+0000","last_became_active":"2024-09-19T08:54:29.414152+0000","last_became_peered":"2024-09-19T08:54:29.414152+0000","last_unstale":"2024-09-19T08:54:32.439715+0000","last_undegraded":"2024-09-19T08:54:32.439715+0000","last_fullsized":"2024-09-19T08:54:32.439715+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:17.477340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":47600,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":36,"num_read_kb":65,"num_write":65,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":233472,"data_stored":142800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56,"ondisk_log_size":56,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579921,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":880640,"data_stored":427235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841557,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28520,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716632,"statfs":{"total":95995035648,"available":95965831168,"internally_reserved":0,"allocated":1531904,"data_stored":1056015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005082,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":868352,"data_stored":419116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234014,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":872448,"data_stored":419138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462948,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28456,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716696,"statfs":{"total":95995035648,"available":95965896704,"internally_reserved":0,"allocated":1466368,"data_stored":1009601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593769,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":868352,"data_stored":418651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822702,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32624,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712528,"statfs":{"total":95995035648,"available":95961628672,"internally_reserved":0,"allocated":1474560,"data_stored":1009201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986227,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":884736,"data_stored":427257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215158,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":418872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411388,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":925696,"data_stored":465370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":459599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":868352,"data_stored":418624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":46802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":46836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":46996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:54:54.368 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:54:54.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:54 smithi167 ceph-mon[35359]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T08:54:54.612 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:54.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:54 smithi190 ceph-mon[35358]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T08:54:54.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:54 smithi092 ceph-mon[31407]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T08:54:55.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.027+0000 7fe3b6cfa640 1 -- 172.21.15.92:0/2774137836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3b0100a80 msgr2=0x7fe3b0100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:55.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.027+0000 7fe3b6cfa640 1 --2- 172.21.15.92:0/2774137836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3b0100a80 0x7fe3b0100ee0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4009930 tx=0x7fe3a402a420 comp rx=0 tx=0).stop 2024-09-19T08:54:55.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.028+0000 7fe3b6cfa640 1 -- 172.21.15.92:0/2774137836 shutdown_connections 2024-09-19T08:54:55.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.028+0000 7fe3b6cfa640 1 --2- 172.21.15.92:0/2774137836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3b0101420 0x7fe3b010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.028+0000 7fe3b6cfa640 1 --2- 172.21.15.92:0/2774137836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3b0100a80 0x7fe3b0100ee0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.028+0000 7fe3b6cfa640 1 --2- 172.21.15.92:0/2774137836 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3b0106a80 0x7fe3b0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.028+0000 7fe3b6cfa640 1 -- 172.21.15.92:0/2774137836 >> 172.21.15.92:0/2774137836 conn(0x7fe3b00fc7a0 msgr2=0x7fe3b00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:55.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.028+0000 7fe3b6cfa640 1 -- 172.21.15.92:0/2774137836 shutdown_connections 2024-09-19T08:54:55.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.028+0000 7fe3b6cfa640 1 -- 172.21.15.92:0/2774137836 wait complete. 2024-09-19T08:54:55.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.028+0000 7fe3b6cfa640 1 Processor -- start 2024-09-19T08:54:55.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.028+0000 7fe3b6cfa640 1 -- start start 2024-09-19T08:54:55.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.028+0000 7fe3b6cfa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3b0100a80 0x7fe3b0199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:55.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.028+0000 7fe3b6cfa640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3b0101420 0x7fe3b01997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:55.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.028+0000 7fe3b6cfa640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3b0106a80 0x7fe3b01a4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:55.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.028+0000 7fe3b6cfa640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b0110e40 con 0x7fe3b0106a80 2024-09-19T08:54:55.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.028+0000 7fe3b6cfa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b0110cc0 con 0x7fe3b0100a80 2024-09-19T08:54:55.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.028+0000 7fe3b6cfa640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b0110fc0 con 0x7fe3b0101420 2024-09-19T08:54:55.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.028+0000 7fe3b5297640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3b0106a80 0x7fe3b01a4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:55.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.029+0000 7fe3b5297640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3b0106a80 0x7fe3b01a4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40984/0 (socket says 172.21.15.92:40984) 2024-09-19T08:54:55.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.029+0000 7fe3b5297640 1 -- 172.21.15.92:0/2351440895 learned_addr learned my addr 172.21.15.92:0/2351440895 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:54:55.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.029+0000 7fe3b4a96640 1 --2- 172.21.15.92:0/2351440895 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3b0100a80 0x7fe3b0199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:55.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.029+0000 7fe3affff640 1 --2- 172.21.15.92:0/2351440895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3b0101420 0x7fe3b01997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:55.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.029+0000 7fe3b5297640 1 -- 172.21.15.92:0/2351440895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3b0101420 msgr2=0x7fe3b01997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:55.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.029+0000 7fe3b5297640 1 --2- 172.21.15.92:0/2351440895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3b0101420 0x7fe3b01997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.029+0000 7fe3b5297640 1 -- 172.21.15.92:0/2351440895 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3b0100a80 msgr2=0x7fe3b0199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:55.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.029+0000 7fe3b5297640 1 --2- 172.21.15.92:0/2351440895 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3b0100a80 0x7fe3b0199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.029+0000 7fe3b5297640 1 -- 172.21.15.92:0/2351440895 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3b01a4850 con 0x7fe3b0106a80 2024-09-19T08:54:55.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.029+0000 7fe3b4a96640 1 --2- 172.21.15.92:0/2351440895 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3b0100a80 0x7fe3b0199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:55.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.029+0000 7fe3affff640 1 --2- 172.21.15.92:0/2351440895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3b0101420 0x7fe3b01997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:54:55.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.029+0000 7fe3b5297640 1 --2- 172.21.15.92:0/2351440895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3b0106a80 0x7fe3b01a4310 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe3a800cad0 tx=0x7fe3a800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:55.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.029+0000 7fe3adffb640 1 -- 172.21.15.92:0/2351440895 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a800ae20 con 0x7fe3b0106a80 2024-09-19T08:54:55.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.029+0000 7fe3adffb640 1 -- 172.21.15.92:0/2351440895 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3a8005020 con 0x7fe3b0106a80 2024-09-19T08:54:55.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.029+0000 7fe3b6cfa640 1 -- 172.21.15.92:0/2351440895 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3b01a4a20 con 0x7fe3b0106a80 2024-09-19T08:54:55.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.029+0000 7fe3adffb640 1 -- 172.21.15.92:0/2351440895 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a800f6f0 con 0x7fe3b0106a80 2024-09-19T08:54:55.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.029+0000 7fe3b6cfa640 1 -- 172.21.15.92:0/2351440895 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3b01a4f30 con 0x7fe3b0106a80 2024-09-19T08:54:55.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.030+0000 7fe3b6cfa640 1 -- 172.21.15.92:0/2351440895 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3b0100ee0 con 0x7fe3b0106a80 2024-09-19T08:54:55.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.031+0000 7fe3adffb640 1 -- 172.21.15.92:0/2351440895 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe3a80051d0 con 0x7fe3b0106a80 2024-09-19T08:54:55.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.032+0000 7fe3adffb640 1 --2- 172.21.15.92:0/2351440895 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe3980a3350 0x7fe3980a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:55.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.032+0000 7fe3b4a96640 1 --2- 172.21.15.92:0/2351440895 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe3980a3350 0x7fe3980a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:55.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.032+0000 7fe3adffb640 1 -- 172.21.15.92:0/2351440895 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe3a80cfb60 con 0x7fe3b0106a80 2024-09-19T08:54:55.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.033+0000 7fe3b4a96640 1 --2- 172.21.15.92:0/2351440895 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe3980a3350 0x7fe3980a5810 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0005e10 tx=0x7fe3a0005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:55.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.036+0000 7fe3adffb640 1 -- 172.21.15.92:0/2351440895 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe3a8014030 con 0x7fe3b0106a80 2024-09-19T08:54:55.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.198+0000 7fe3b6cfa640 1 -- 172.21.15.92:0/2351440895 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe3b0062630 con 0x7fe3980a3350 2024-09-19T08:54:55.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.205+0000 7fe3adffb640 1 -- 172.21.15.92:0/2351440895 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258538 (secure 0 0 0) 0x7fe3b0062630 con 0x7fe3980a3350 2024-09-19T08:54:55.207 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:54:55.208 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-19T08:54:55.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.209+0000 7fe3b6cfa640 1 -- 172.21.15.92:0/2351440895 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe3980a3350 msgr2=0x7fe3980a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:55.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.209+0000 7fe3b6cfa640 1 --2- 172.21.15.92:0/2351440895 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe3980a3350 0x7fe3980a5810 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0005e10 tx=0x7fe3a0005da0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.209+0000 7fe3b6cfa640 1 -- 172.21.15.92:0/2351440895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3b0106a80 msgr2=0x7fe3b01a4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:55.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.209+0000 7fe3b6cfa640 1 --2- 172.21.15.92:0/2351440895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3b0106a80 0x7fe3b01a4310 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe3a800cad0 tx=0x7fe3a800cf90 comp rx=0 tx=0).stop 2024-09-19T08:54:55.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.209+0000 7fe3b6cfa640 1 -- 172.21.15.92:0/2351440895 shutdown_connections 2024-09-19T08:54:55.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.209+0000 7fe3b6cfa640 1 --2- 172.21.15.92:0/2351440895 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe3980a3350 0x7fe3980a5810 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.209+0000 7fe3b6cfa640 1 --2- 172.21.15.92:0/2351440895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3b0106a80 0x7fe3b01a4310 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.209+0000 7fe3b6cfa640 1 --2- 172.21.15.92:0/2351440895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3b0101420 0x7fe3b01997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.209+0000 7fe3b6cfa640 1 --2- 172.21.15.92:0/2351440895 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3b0100a80 0x7fe3b0199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.209+0000 7fe3b6cfa640 1 -- 172.21.15.92:0/2351440895 >> 172.21.15.92:0/2351440895 conn(0x7fe3b00fc7a0 msgr2=0x7fe3b00fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:55.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.209+0000 7fe3b6cfa640 1 -- 172.21.15.92:0/2351440895 shutdown_connections 2024-09-19T08:54:55.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:55.209+0000 7fe3b6cfa640 1 -- 172.21.15.92:0/2351440895 wait complete. 2024-09-19T08:54:55.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:55 smithi167 ceph-mon[35359]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:54:55.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:55 smithi167 ceph-mon[35359]: pgmap v283: 97 pgs: 3 peering, 94 active+clean; 623 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.6 KiB/s wr, 5 op/s 2024-09-19T08:54:55.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:55 smithi190 ceph-mon[35358]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:54:55.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:55 smithi190 ceph-mon[35358]: pgmap v283: 97 pgs: 3 peering, 94 active+clean; 623 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.6 KiB/s wr, 5 op/s 2024-09-19T08:54:55.652 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:55 smithi092 ceph-mon[31407]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:54:55.652 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:55 smithi092 ceph-mon[31407]: pgmap v283: 97 pgs: 3 peering, 94 active+clean; 623 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.6 KiB/s wr, 5 op/s 2024-09-19T08:54:55.904 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":283,"stamp":"2024-09-19T08:54:54.260058+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":638202,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":162,"num_read_kb":174,"num_write":248,"num_write_kb":3006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":294,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":361476,"kb_used_data":12200,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124580348,"statfs":{"total":1151940427776,"available":1151570276352,"internally_reserved":0,"allocated":12492800,"data_stored":6980519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":45424,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":54,"num_write":20,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001659"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.326712+0000","last_change":"2024-09-19T08:54:31.437743+0000","last_active":"2024-09-19T08:54:52.326712+0000","last_peered":"2024-09-19T08:54:52.326712+0000","last_clean":"2024-09-19T08:54:52.326712+0000","last_became_active":"2024-09-19T08:54:31.437426+0000","last_became_peered":"2024-09-19T08:54:31.437426+0000","last_unstale":"2024-09-19T08:54:52.326712+0000","last_undegraded":"2024-09-19T08:54:52.326712+0000","last_fullsized":"2024-09-19T08:54:52.326712+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:04.403522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.436656+0000","last_change":"2024-09-19T08:54:31.430322+0000","last_active":"2024-09-19T08:54:32.436656+0000","last_peered":"2024-09-19T08:54:32.436656+0000","last_clean":"2024-09-19T08:54:32.436656+0000","last_became_active":"2024-09-19T08:54:31.430008+0000","last_became_peered":"2024-09-19T08:54:31.430008+0000","last_unstale":"2024-09-19T08:54:32.436656+0000","last_undegraded":"2024-09-19T08:54:32.436656+0000","last_fullsized":"2024-09-19T08:54:32.436656+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:19.800686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.436144+0000","last_change":"2024-09-19T08:54:31.430276+0000","last_active":"2024-09-19T08:54:32.436144+0000","last_peered":"2024-09-19T08:54:32.436144+0000","last_clean":"2024-09-19T08:54:32.436144+0000","last_became_active":"2024-09-19T08:54:31.429939+0000","last_became_peered":"2024-09-19T08:54:31.429939+0000","last_unstale":"2024-09-19T08:54:32.436144+0000","last_undegraded":"2024-09-19T08:54:32.436144+0000","last_fullsized":"2024-09-19T08:54:32.436144+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:08.735067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.329078+0000","last_change":"2024-09-19T08:54:31.435197+0000","last_active":"2024-09-19T08:54:52.329078+0000","last_peered":"2024-09-19T08:54:52.329078+0000","last_clean":"2024-09-19T08:54:52.329078+0000","last_became_active":"2024-09-19T08:54:31.434872+0000","last_became_peered":"2024-09-19T08:54:31.434872+0000","last_unstale":"2024-09-19T08:54:52.329078+0000","last_undegraded":"2024-09-19T08:54:52.329078+0000","last_fullsized":"2024-09-19T08:54:52.329078+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:06.213317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330478+0000","last_change":"2024-09-19T08:54:31.423765+0000","last_active":"2024-09-19T08:54:53.330478+0000","last_peered":"2024-09-19T08:54:53.330478+0000","last_clean":"2024-09-19T08:54:53.330478+0000","last_became_active":"2024-09-19T08:54:31.423296+0000","last_became_peered":"2024-09-19T08:54:31.423296+0000","last_unstale":"2024-09-19T08:54:53.330478+0000","last_undegraded":"2024-09-19T08:54:53.330478+0000","last_fullsized":"2024-09-19T08:54:53.330478+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:07.507168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433541+0000","last_change":"2024-09-19T08:54:31.430299+0000","last_active":"2024-09-19T08:54:32.433541+0000","last_peered":"2024-09-19T08:54:32.433541+0000","last_clean":"2024-09-19T08:54:32.433541+0000","last_became_active":"2024-09-19T08:54:31.429951+0000","last_became_peered":"2024-09-19T08:54:31.429951+0000","last_unstale":"2024-09-19T08:54:32.433541+0000","last_undegraded":"2024-09-19T08:54:32.433541+0000","last_fullsized":"2024-09-19T08:54:32.433541+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:11.299729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.434609+0000","last_change":"2024-09-19T08:54:31.435854+0000","last_active":"2024-09-19T08:54:32.434609+0000","last_peered":"2024-09-19T08:54:32.434609+0000","last_clean":"2024-09-19T08:54:32.434609+0000","last_became_active":"2024-09-19T08:54:31.435522+0000","last_became_peered":"2024-09-19T08:54:31.435522+0000","last_unstale":"2024-09-19T08:54:32.434609+0000","last_undegraded":"2024-09-19T08:54:32.434609+0000","last_fullsized":"2024-09-19T08:54:32.434609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:11.099750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.328883+0000","last_change":"2024-09-19T08:54:31.434574+0000","last_active":"2024-09-19T08:54:53.328883+0000","last_peered":"2024-09-19T08:54:53.328883+0000","last_clean":"2024-09-19T08:54:53.328883+0000","last_became_active":"2024-09-19T08:54:31.434268+0000","last_became_peered":"2024-09-19T08:54:31.434268+0000","last_unstale":"2024-09-19T08:54:53.328883+0000","last_undegraded":"2024-09-19T08:54:53.328883+0000","last_fullsized":"2024-09-19T08:54:53.328883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:29.159417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330517+0000","last_change":"2024-09-19T08:54:31.430446+0000","last_active":"2024-09-19T08:54:53.330517+0000","last_peered":"2024-09-19T08:54:53.330517+0000","last_clean":"2024-09-19T08:54:53.330517+0000","last_became_active":"2024-09-19T08:54:31.430048+0000","last_became_peered":"2024-09-19T08:54:31.430048+0000","last_unstale":"2024-09-19T08:54:53.330517+0000","last_undegraded":"2024-09-19T08:54:53.330517+0000","last_fullsized":"2024-09-19T08:54:53.330517+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:24.773947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.437326+0000","last_change":"2024-09-19T08:54:31.433144+0000","last_active":"2024-09-19T08:54:32.437326+0000","last_peered":"2024-09-19T08:54:32.437326+0000","last_clean":"2024-09-19T08:54:32.437326+0000","last_became_active":"2024-09-19T08:54:31.432590+0000","last_became_peered":"2024-09-19T08:54:31.432590+0000","last_unstale":"2024-09-19T08:54:32.437326+0000","last_undegraded":"2024-09-19T08:54:32.437326+0000","last_fullsized":"2024-09-19T08:54:32.437326+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:53.756846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.435148+0000","last_change":"2024-09-19T08:54:31.435712+0000","last_active":"2024-09-19T08:54:32.435148+0000","last_peered":"2024-09-19T08:54:32.435148+0000","last_clean":"2024-09-19T08:54:32.435148+0000","last_became_active":"2024-09-19T08:54:31.435301+0000","last_became_peered":"2024-09-19T08:54:31.435301+0000","last_unstale":"2024-09-19T08:54:32.435148+0000","last_undegraded":"2024-09-19T08:54:32.435148+0000","last_fullsized":"2024-09-19T08:54:32.435148+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:51.703709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.434880+0000","last_change":"2024-09-19T08:54:31.434404+0000","last_active":"2024-09-19T08:54:32.434880+0000","last_peered":"2024-09-19T08:54:32.434880+0000","last_clean":"2024-09-19T08:54:32.434880+0000","last_became_active":"2024-09-19T08:54:31.434033+0000","last_became_peered":"2024-09-19T08:54:31.434033+0000","last_unstale":"2024-09-19T08:54:32.434880+0000","last_undegraded":"2024-09-19T08:54:32.434880+0000","last_fullsized":"2024-09-19T08:54:32.434880+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:06.815278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433455+0000","last_change":"2024-09-19T08:54:31.425590+0000","last_active":"2024-09-19T08:54:32.433455+0000","last_peered":"2024-09-19T08:54:32.433455+0000","last_clean":"2024-09-19T08:54:32.433455+0000","last_became_active":"2024-09-19T08:54:31.425268+0000","last_became_peered":"2024-09-19T08:54:31.425268+0000","last_unstale":"2024-09-19T08:54:32.433455+0000","last_undegraded":"2024-09-19T08:54:32.433455+0000","last_fullsized":"2024-09-19T08:54:32.433455+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:09.404947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.435997+0000","last_change":"2024-09-19T08:54:31.428372+0000","last_active":"2024-09-19T08:54:32.435997+0000","last_peered":"2024-09-19T08:54:32.435997+0000","last_clean":"2024-09-19T08:54:32.435997+0000","last_became_active":"2024-09-19T08:54:31.428064+0000","last_became_peered":"2024-09-19T08:54:31.428064+0000","last_unstale":"2024-09-19T08:54:32.435997+0000","last_undegraded":"2024-09-19T08:54:32.435997+0000","last_fullsized":"2024-09-19T08:54:32.435997+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:40.444117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.435596+0000","last_change":"2024-09-19T08:54:31.424365+0000","last_active":"2024-09-19T08:54:32.435596+0000","last_peered":"2024-09-19T08:54:32.435596+0000","last_clean":"2024-09-19T08:54:32.435596+0000","last_became_active":"2024-09-19T08:54:31.424044+0000","last_became_peered":"2024-09-19T08:54:31.424044+0000","last_unstale":"2024-09-19T08:54:32.435596+0000","last_undegraded":"2024-09-19T08:54:32.435596+0000","last_fullsized":"2024-09-19T08:54:32.435596+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:16.435389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329839+0000","last_change":"2024-09-19T08:54:31.437238+0000","last_active":"2024-09-19T08:54:53.329839+0000","last_peered":"2024-09-19T08:54:53.329839+0000","last_clean":"2024-09-19T08:54:53.329839+0000","last_became_active":"2024-09-19T08:54:31.436867+0000","last_became_peered":"2024-09-19T08:54:31.436867+0000","last_unstale":"2024-09-19T08:54:53.329839+0000","last_undegraded":"2024-09-19T08:54:53.329839+0000","last_fullsized":"2024-09-19T08:54:53.329839+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:59.839081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.326763+0000","last_change":"2024-09-19T08:54:31.438654+0000","last_active":"2024-09-19T08:54:52.326763+0000","last_peered":"2024-09-19T08:54:52.326763+0000","last_clean":"2024-09-19T08:54:52.326763+0000","last_became_active":"2024-09-19T08:54:31.438342+0000","last_became_peered":"2024-09-19T08:54:31.438342+0000","last_unstale":"2024-09-19T08:54:52.326763+0000","last_undegraded":"2024-09-19T08:54:52.326763+0000","last_fullsized":"2024-09-19T08:54:52.326763+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:55.190605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.434755+0000","last_change":"2024-09-19T08:54:31.431100+0000","last_active":"2024-09-19T08:54:32.434755+0000","last_peered":"2024-09-19T08:54:32.434755+0000","last_clean":"2024-09-19T08:54:32.434755+0000","last_became_active":"2024-09-19T08:54:31.430749+0000","last_became_peered":"2024-09-19T08:54:31.430749+0000","last_unstale":"2024-09-19T08:54:32.434755+0000","last_undegraded":"2024-09-19T08:54:32.434755+0000","last_fullsized":"2024-09-19T08:54:32.434755+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:50.597610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.435486+0000","last_change":"2024-09-19T08:54:31.427454+0000","last_active":"2024-09-19T08:54:32.435486+0000","last_peered":"2024-09-19T08:54:32.435486+0000","last_clean":"2024-09-19T08:54:32.435486+0000","last_became_active":"2024-09-19T08:54:31.427098+0000","last_became_peered":"2024-09-19T08:54:31.427098+0000","last_unstale":"2024-09-19T08:54:32.435486+0000","last_undegraded":"2024-09-19T08:54:32.435486+0000","last_fullsized":"2024-09-19T08:54:32.435486+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:01.042626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.326377+0000","last_change":"2024-09-19T08:54:31.433887+0000","last_active":"2024-09-19T08:54:52.326377+0000","last_peered":"2024-09-19T08:54:52.326377+0000","last_clean":"2024-09-19T08:54:52.326377+0000","last_became_active":"2024-09-19T08:54:31.433528+0000","last_became_peered":"2024-09-19T08:54:31.433528+0000","last_unstale":"2024-09-19T08:54:52.326377+0000","last_undegraded":"2024-09-19T08:54:52.326377+0000","last_fullsized":"2024-09-19T08:54:52.326377+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:37.291226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433596+0000","last_change":"2024-09-19T08:54:31.436976+0000","last_active":"2024-09-19T08:54:32.433596+0000","last_peered":"2024-09-19T08:54:32.433596+0000","last_clean":"2024-09-19T08:54:32.433596+0000","last_became_active":"2024-09-19T08:54:31.436646+0000","last_became_peered":"2024-09-19T08:54:31.436646+0000","last_unstale":"2024-09-19T08:54:32.433596+0000","last_undegraded":"2024-09-19T08:54:32.433596+0000","last_fullsized":"2024-09-19T08:54:32.433596+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:19.755556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330114+0000","last_change":"2024-09-19T08:54:31.438922+0000","last_active":"2024-09-19T08:54:53.330114+0000","last_peered":"2024-09-19T08:54:53.330114+0000","last_clean":"2024-09-19T08:54:53.330114+0000","last_became_active":"2024-09-19T08:54:31.438593+0000","last_became_peered":"2024-09-19T08:54:31.438593+0000","last_unstale":"2024-09-19T08:54:53.330114+0000","last_undegraded":"2024-09-19T08:54:53.330114+0000","last_fullsized":"2024-09-19T08:54:53.330114+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:07.347900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.328949+0000","last_change":"2024-09-19T08:54:31.431659+0000","last_active":"2024-09-19T08:54:53.328949+0000","last_peered":"2024-09-19T08:54:53.328949+0000","last_clean":"2024-09-19T08:54:53.328949+0000","last_became_active":"2024-09-19T08:54:31.431359+0000","last_became_peered":"2024-09-19T08:54:31.431359+0000","last_unstale":"2024-09-19T08:54:53.328949+0000","last_undegraded":"2024-09-19T08:54:53.328949+0000","last_fullsized":"2024-09-19T08:54:53.328949+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:02.421286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.329257+0000","last_change":"2024-09-19T08:54:31.432185+0000","last_active":"2024-09-19T08:54:52.329257+0000","last_peered":"2024-09-19T08:54:52.329257+0000","last_clean":"2024-09-19T08:54:52.329257+0000","last_became_active":"2024-09-19T08:54:31.431418+0000","last_became_peered":"2024-09-19T08:54:31.431418+0000","last_unstale":"2024-09-19T08:54:52.329257+0000","last_undegraded":"2024-09-19T08:54:52.329257+0000","last_fullsized":"2024-09-19T08:54:52.329257+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:45.347487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329298+0000","last_change":"2024-09-19T08:54:31.433742+0000","last_active":"2024-09-19T08:54:53.329298+0000","last_peered":"2024-09-19T08:54:53.329298+0000","last_clean":"2024-09-19T08:54:53.329298+0000","last_became_active":"2024-09-19T08:54:31.433455+0000","last_became_peered":"2024-09-19T08:54:31.433455+0000","last_unstale":"2024-09-19T08:54:53.329298+0000","last_undegraded":"2024-09-19T08:54:53.329298+0000","last_fullsized":"2024-09-19T08:54:53.329298+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:38.803705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.438023+0000","last_change":"2024-09-19T08:54:31.432954+0000","last_active":"2024-09-19T08:54:32.438023+0000","last_peered":"2024-09-19T08:54:32.438023+0000","last_clean":"2024-09-19T08:54:32.438023+0000","last_became_active":"2024-09-19T08:54:31.432574+0000","last_became_peered":"2024-09-19T08:54:31.432574+0000","last_unstale":"2024-09-19T08:54:32.438023+0000","last_undegraded":"2024-09-19T08:54:32.438023+0000","last_fullsized":"2024-09-19T08:54:32.438023+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:30.457191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.326618+0000","last_change":"2024-09-19T08:54:31.435544+0000","last_active":"2024-09-19T08:54:52.326618+0000","last_peered":"2024-09-19T08:54:52.326618+0000","last_clean":"2024-09-19T08:54:52.326618+0000","last_became_active":"2024-09-19T08:54:31.435195+0000","last_became_peered":"2024-09-19T08:54:31.435195+0000","last_unstale":"2024-09-19T08:54:52.326618+0000","last_undegraded":"2024-09-19T08:54:52.326618+0000","last_fullsized":"2024-09-19T08:54:52.326618+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:54.240654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433344+0000","last_change":"2024-09-19T08:54:31.428403+0000","last_active":"2024-09-19T08:54:32.433344+0000","last_peered":"2024-09-19T08:54:32.433344+0000","last_clean":"2024-09-19T08:54:32.433344+0000","last_became_active":"2024-09-19T08:54:31.428110+0000","last_became_peered":"2024-09-19T08:54:31.428110+0000","last_unstale":"2024-09-19T08:54:32.433344+0000","last_undegraded":"2024-09-19T08:54:32.433344+0000","last_fullsized":"2024-09-19T08:54:32.433344+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:05.593073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.436572+0000","last_change":"2024-09-19T08:54:31.427291+0000","last_active":"2024-09-19T08:54:32.436572+0000","last_peered":"2024-09-19T08:54:32.436572+0000","last_clean":"2024-09-19T08:54:32.436572+0000","last_became_active":"2024-09-19T08:54:31.427011+0000","last_became_peered":"2024-09-19T08:54:31.427011+0000","last_unstale":"2024-09-19T08:54:32.436572+0000","last_undegraded":"2024-09-19T08:54:32.436572+0000","last_fullsized":"2024-09-19T08:54:32.436572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:54.338526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.434037+0000","last_change":"2024-09-19T08:54:31.429309+0000","last_active":"2024-09-19T08:54:32.434037+0000","last_peered":"2024-09-19T08:54:32.434037+0000","last_clean":"2024-09-19T08:54:32.434037+0000","last_became_active":"2024-09-19T08:54:31.428381+0000","last_became_peered":"2024-09-19T08:54:31.428381+0000","last_unstale":"2024-09-19T08:54:32.434037+0000","last_undegraded":"2024-09-19T08:54:32.434037+0000","last_fullsized":"2024-09-19T08:54:32.434037+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:22:33.920114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.434367+0000","last_change":"2024-09-19T08:54:31.431711+0000","last_active":"2024-09-19T08:54:32.434367+0000","last_peered":"2024-09-19T08:54:32.434367+0000","last_clean":"2024-09-19T08:54:32.434367+0000","last_became_active":"2024-09-19T08:54:31.431425+0000","last_became_peered":"2024-09-19T08:54:31.431425+0000","last_unstale":"2024-09-19T08:54:32.434367+0000","last_undegraded":"2024-09-19T08:54:32.434367+0000","last_fullsized":"2024-09-19T08:54:32.434367+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:39.751214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"peering","last_fresh":"2024-09-19T08:54:33.236674+0000","last_change":"2024-09-19T08:54:52.326921+0000","last_active":"2024-09-19T08:54:52.326921+0000","last_peered":"2024-09-19T08:54:33.236674+0000","last_clean":"2024-09-19T08:54:33.236674+0000","last_became_active":"2024-09-19T08:54:31.427335+0000","last_became_peered":"2024-09-19T08:54:31.427335+0000","last_unstale":"2024-09-19T08:54:33.236674+0000","last_undegraded":"2024-09-19T08:54:33.236674+0000","last_fullsized":"2024-09-19T08:54:33.236674+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,5,9],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331864+0000","last_change":"2024-09-19T08:54:31.427608+0000","last_active":"2024-09-19T08:54:53.331864+0000","last_peered":"2024-09-19T08:54:53.331864+0000","last_clean":"2024-09-19T08:54:53.331864+0000","last_became_active":"2024-09-19T08:54:31.427294+0000","last_became_peered":"2024-09-19T08:54:31.427294+0000","last_unstale":"2024-09-19T08:54:53.331864+0000","last_undegraded":"2024-09-19T08:54:53.331864+0000","last_fullsized":"2024-09-19T08:54:53.331864+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:41.356609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'1","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.329204+0000","last_change":"2024-09-19T08:54:29.416204+0000","last_active":"2024-09-19T08:54:52.329204+0000","last_peered":"2024-09-19T08:54:52.329204+0000","last_clean":"2024-09-19T08:54:52.329204+0000","last_became_active":"2024-09-19T08:54:29.415872+0000","last_became_peered":"2024-09-19T08:54:29.415872+0000","last_unstale":"2024-09-19T08:54:52.329204+0000","last_undegraded":"2024-09-19T08:54:52.329204+0000","last_fullsized":"2024-09-19T08:54:52.329204+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:13.844147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.329103+0000","last_change":"2024-09-19T08:54:31.432137+0000","last_active":"2024-09-19T08:54:52.329103+0000","last_peered":"2024-09-19T08:54:52.329103+0000","last_clean":"2024-09-19T08:54:52.329103+0000","last_became_active":"2024-09-19T08:54:31.431761+0000","last_became_peered":"2024-09-19T08:54:31.431761+0000","last_unstale":"2024-09-19T08:54:52.329103+0000","last_undegraded":"2024-09-19T08:54:52.329103+0000","last_fullsized":"2024-09-19T08:54:52.329103+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:05.008431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433993+0000","last_change":"2024-09-19T08:54:29.413221+0000","last_active":"2024-09-19T08:54:32.433993+0000","last_peered":"2024-09-19T08:54:32.433993+0000","last_clean":"2024-09-19T08:54:32.433993+0000","last_became_active":"2024-09-19T08:54:29.412829+0000","last_became_peered":"2024-09-19T08:54:29.412829+0000","last_unstale":"2024-09-19T08:54:32.433993+0000","last_undegraded":"2024-09-19T08:54:32.433993+0000","last_fullsized":"2024-09-19T08:54:32.433993+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:07.224136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433498+0000","last_change":"2024-09-19T08:54:29.410221+0000","last_active":"2024-09-19T08:54:32.433498+0000","last_peered":"2024-09-19T08:54:32.433498+0000","last_clean":"2024-09-19T08:54:32.433498+0000","last_became_active":"2024-09-19T08:54:29.409951+0000","last_became_peered":"2024-09-19T08:54:29.409951+0000","last_unstale":"2024-09-19T08:54:32.433498+0000","last_undegraded":"2024-09-19T08:54:32.433498+0000","last_fullsized":"2024-09-19T08:54:32.433498+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:58.350932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.328917+0000","last_change":"2024-09-19T08:54:31.429979+0000","last_active":"2024-09-19T08:54:53.328917+0000","last_peered":"2024-09-19T08:54:53.328917+0000","last_clean":"2024-09-19T08:54:53.328917+0000","last_became_active":"2024-09-19T08:54:31.429661+0000","last_became_peered":"2024-09-19T08:54:31.429661+0000","last_unstale":"2024-09-19T08:54:53.328917+0000","last_undegraded":"2024-09-19T08:54:53.328917+0000","last_fullsized":"2024-09-19T08:54:53.328917+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:27:40.603490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.330262+0000","last_change":"2024-09-19T08:54:29.415769+0000","last_active":"2024-09-19T08:54:52.330262+0000","last_peered":"2024-09-19T08:54:52.330262+0000","last_clean":"2024-09-19T08:54:52.330262+0000","last_became_active":"2024-09-19T08:54:29.415245+0000","last_became_peered":"2024-09-19T08:54:29.415245+0000","last_unstale":"2024-09-19T08:54:52.330262+0000","last_undegraded":"2024-09-19T08:54:52.330262+0000","last_fullsized":"2024-09-19T08:54:52.330262+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:15.487945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433915+0000","last_change":"2024-09-19T08:54:31.427126+0000","last_active":"2024-09-19T08:54:32.433915+0000","last_peered":"2024-09-19T08:54:32.433915+0000","last_clean":"2024-09-19T08:54:32.433915+0000","last_became_active":"2024-09-19T08:54:31.426816+0000","last_became_peered":"2024-09-19T08:54:31.426816+0000","last_unstale":"2024-09-19T08:54:32.433915+0000","last_undegraded":"2024-09-19T08:54:32.433915+0000","last_fullsized":"2024-09-19T08:54:32.433915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:38.039428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.434006+0000","last_change":"2024-09-19T08:54:29.411354+0000","last_active":"2024-09-19T08:54:32.434006+0000","last_peered":"2024-09-19T08:54:32.434006+0000","last_clean":"2024-09-19T08:54:32.434006+0000","last_became_active":"2024-09-19T08:54:29.410990+0000","last_became_peered":"2024-09-19T08:54:29.410990+0000","last_unstale":"2024-09-19T08:54:32.434006+0000","last_undegraded":"2024-09-19T08:54:32.434006+0000","last_fullsized":"2024-09-19T08:54:32.434006+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:29.338169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330234+0000","last_change":"2024-09-19T08:54:31.426243+0000","last_active":"2024-09-19T08:54:53.330234+0000","last_peered":"2024-09-19T08:54:53.330234+0000","last_clean":"2024-09-19T08:54:53.330234+0000","last_became_active":"2024-09-19T08:54:31.425895+0000","last_became_peered":"2024-09-19T08:54:31.425895+0000","last_unstale":"2024-09-19T08:54:53.330234+0000","last_undegraded":"2024-09-19T08:54:53.330234+0000","last_fullsized":"2024-09-19T08:54:53.330234+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:13.562780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.436375+0000","last_change":"2024-09-19T08:54:29.416646+0000","last_active":"2024-09-19T08:54:32.436375+0000","last_peered":"2024-09-19T08:54:32.436375+0000","last_clean":"2024-09-19T08:54:32.436375+0000","last_became_active":"2024-09-19T08:54:29.416260+0000","last_became_peered":"2024-09-19T08:54:29.416260+0000","last_unstale":"2024-09-19T08:54:32.436375+0000","last_undegraded":"2024-09-19T08:54:32.436375+0000","last_fullsized":"2024-09-19T08:54:32.436375+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:42:17.467035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.436253+0000","last_change":"2024-09-19T08:54:31.435538+0000","last_active":"2024-09-19T08:54:32.436253+0000","last_peered":"2024-09-19T08:54:32.436253+0000","last_clean":"2024-09-19T08:54:32.436253+0000","last_became_active":"2024-09-19T08:54:31.435185+0000","last_became_peered":"2024-09-19T08:54:31.435185+0000","last_unstale":"2024-09-19T08:54:32.436253+0000","last_undegraded":"2024-09-19T08:54:32.436253+0000","last_fullsized":"2024-09-19T08:54:32.436253+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:06.940123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'3","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.329891+0000","last_change":"2024-09-19T08:54:29.675914+0000","last_active":"2024-09-19T08:54:52.329891+0000","last_peered":"2024-09-19T08:54:52.329891+0000","last_clean":"2024-09-19T08:54:52.329891+0000","last_became_active":"2024-09-19T08:54:29.675482+0000","last_became_peered":"2024-09-19T08:54:29.675482+0000","last_unstale":"2024-09-19T08:54:52.329891+0000","last_undegraded":"2024-09-19T08:54:52.329891+0000","last_fullsized":"2024-09-19T08:54:52.329891+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:58.893008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330567+0000","last_change":"2024-09-19T08:54:31.432628+0000","last_active":"2024-09-19T08:54:53.330567+0000","last_peered":"2024-09-19T08:54:53.330567+0000","last_clean":"2024-09-19T08:54:53.330567+0000","last_became_active":"2024-09-19T08:54:31.430640+0000","last_became_peered":"2024-09-19T08:54:31.430640+0000","last_unstale":"2024-09-19T08:54:53.330567+0000","last_undegraded":"2024-09-19T08:54:53.330567+0000","last_fullsized":"2024-09-19T08:54:53.330567+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:07.793089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'20","reported_seq":70,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:51.509862+0000","last_change":"2024-09-19T08:54:29.414619+0000","last_active":"2024-09-19T08:54:51.509862+0000","last_peered":"2024-09-19T08:54:51.509862+0000","last_clean":"2024-09-19T08:54:51.509862+0000","last_became_active":"2024-09-19T08:54:29.414295+0000","last_became_peered":"2024-09-19T08:54:29.414295+0000","last_unstale":"2024-09-19T08:54:51.509862+0000","last_undegraded":"2024-09-19T08:54:51.509862+0000","last_fullsized":"2024-09-19T08:54:51.509862+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:23.782684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46802,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":61,"num_write":20,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331211+0000","last_change":"2024-09-19T08:54:31.425432+0000","last_active":"2024-09-19T08:54:53.331211+0000","last_peered":"2024-09-19T08:54:53.331211+0000","last_clean":"2024-09-19T08:54:53.331211+0000","last_became_active":"2024-09-19T08:54:31.425086+0000","last_became_peered":"2024-09-19T08:54:31.425086+0000","last_unstale":"2024-09-19T08:54:53.331211+0000","last_undegraded":"2024-09-19T08:54:53.331211+0000","last_fullsized":"2024-09-19T08:54:53.331211+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:56.572339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'2","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.441226+0000","last_change":"2024-09-19T08:54:29.415055+0000","last_active":"2024-09-19T08:54:32.441226+0000","last_peered":"2024-09-19T08:54:32.441226+0000","last_clean":"2024-09-19T08:54:32.441226+0000","last_became_active":"2024-09-19T08:54:29.414573+0000","last_became_peered":"2024-09-19T08:54:29.414573+0000","last_unstale":"2024-09-19T08:54:32.441226+0000","last_undegraded":"2024-09-19T08:54:32.441226+0000","last_fullsized":"2024-09-19T08:54:32.441226+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:13.013714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433266+0000","last_change":"2024-09-19T08:54:31.436905+0000","last_active":"2024-09-19T08:54:32.433266+0000","last_peered":"2024-09-19T08:54:32.433266+0000","last_clean":"2024-09-19T08:54:32.433266+0000","last_became_active":"2024-09-19T08:54:31.436571+0000","last_became_peered":"2024-09-19T08:54:31.436571+0000","last_unstale":"2024-09-19T08:54:32.433266+0000","last_undegraded":"2024-09-19T08:54:32.433266+0000","last_fullsized":"2024-09-19T08:54:32.433266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:55.294255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.329565+0000","last_change":"2024-09-19T08:54:29.417958+0000","last_active":"2024-09-19T08:54:52.329565+0000","last_peered":"2024-09-19T08:54:52.329565+0000","last_clean":"2024-09-19T08:54:52.329565+0000","last_became_active":"2024-09-19T08:54:29.417570+0000","last_became_peered":"2024-09-19T08:54:29.417570+0000","last_unstale":"2024-09-19T08:54:52.329565+0000","last_undegraded":"2024-09-19T08:54:52.329565+0000","last_fullsized":"2024-09-19T08:54:52.329565+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:25.557217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.436309+0000","last_change":"2024-09-19T08:54:31.433019+0000","last_active":"2024-09-19T08:54:32.436309+0000","last_peered":"2024-09-19T08:54:32.436309+0000","last_clean":"2024-09-19T08:54:32.436309+0000","last_became_active":"2024-09-19T08:54:31.431265+0000","last_became_peered":"2024-09-19T08:54:31.431265+0000","last_unstale":"2024-09-19T08:54:32.436309+0000","last_undegraded":"2024-09-19T08:54:32.436309+0000","last_fullsized":"2024-09-19T08:54:32.436309+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:36.481863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.329875+0000","last_change":"2024-09-19T08:54:29.414236+0000","last_active":"2024-09-19T08:54:52.329875+0000","last_peered":"2024-09-19T08:54:52.329875+0000","last_clean":"2024-09-19T08:54:52.329875+0000","last_became_active":"2024-09-19T08:54:29.413878+0000","last_became_peered":"2024-09-19T08:54:29.413878+0000","last_unstale":"2024-09-19T08:54:52.329875+0000","last_undegraded":"2024-09-19T08:54:52.329875+0000","last_fullsized":"2024-09-19T08:54:52.329875+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:11.222362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.434637+0000","last_change":"2024-09-19T08:54:31.439512+0000","last_active":"2024-09-19T08:54:32.434637+0000","last_peered":"2024-09-19T08:54:32.434637+0000","last_clean":"2024-09-19T08:54:32.434637+0000","last_became_active":"2024-09-19T08:54:31.438767+0000","last_became_peered":"2024-09-19T08:54:31.438767+0000","last_unstale":"2024-09-19T08:54:32.434637+0000","last_undegraded":"2024-09-19T08:54:32.434637+0000","last_fullsized":"2024-09-19T08:54:32.434637+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:31.784577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330687+0000","last_change":"2024-09-19T08:54:29.675768+0000","last_active":"2024-09-19T08:54:53.330687+0000","last_peered":"2024-09-19T08:54:53.330687+0000","last_clean":"2024-09-19T08:54:53.330687+0000","last_became_active":"2024-09-19T08:54:29.675376+0000","last_became_peered":"2024-09-19T08:54:29.675376+0000","last_unstale":"2024-09-19T08:54:53.330687+0000","last_undegraded":"2024-09-19T08:54:53.330687+0000","last_fullsized":"2024-09-19T08:54:53.330687+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:10.281126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.329401+0000","last_change":"2024-09-19T08:54:31.435904+0000","last_active":"2024-09-19T08:54:52.329401+0000","last_peered":"2024-09-19T08:54:52.329401+0000","last_clean":"2024-09-19T08:54:52.329401+0000","last_became_active":"2024-09-19T08:54:31.435396+0000","last_became_peered":"2024-09-19T08:54:31.435396+0000","last_unstale":"2024-09-19T08:54:52.329401+0000","last_undegraded":"2024-09-19T08:54:52.329401+0000","last_fullsized":"2024-09-19T08:54:52.329401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:41.567463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331746+0000","last_change":"2024-09-19T08:54:29.410221+0000","last_active":"2024-09-19T08:54:53.331746+0000","last_peered":"2024-09-19T08:54:53.331746+0000","last_clean":"2024-09-19T08:54:53.331746+0000","last_became_active":"2024-09-19T08:54:29.409856+0000","last_became_peered":"2024-09-19T08:54:29.409856+0000","last_unstale":"2024-09-19T08:54:53.331746+0000","last_undegraded":"2024-09-19T08:54:53.331746+0000","last_fullsized":"2024-09-19T08:54:53.331746+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:46.095816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.326482+0000","last_change":"2024-09-19T08:54:31.437854+0000","last_active":"2024-09-19T08:54:52.326482+0000","last_peered":"2024-09-19T08:54:52.326482+0000","last_clean":"2024-09-19T08:54:52.326482+0000","last_became_active":"2024-09-19T08:54:31.437491+0000","last_became_peered":"2024-09-19T08:54:31.437491+0000","last_unstale":"2024-09-19T08:54:52.326482+0000","last_undegraded":"2024-09-19T08:54:52.326482+0000","last_fullsized":"2024-09-19T08:54:52.326482+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:22.532429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.441422+0000","last_change":"2024-09-19T08:54:29.413937+0000","last_active":"2024-09-19T08:54:32.441422+0000","last_peered":"2024-09-19T08:54:32.441422+0000","last_clean":"2024-09-19T08:54:32.441422+0000","last_became_active":"2024-09-19T08:54:29.413610+0000","last_became_peered":"2024-09-19T08:54:29.413610+0000","last_unstale":"2024-09-19T08:54:32.441422+0000","last_undegraded":"2024-09-19T08:54:32.441422+0000","last_fullsized":"2024-09-19T08:54:32.441422+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:26.093427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.435271+0000","last_change":"2024-09-19T08:54:31.429376+0000","last_active":"2024-09-19T08:54:32.435271+0000","last_peered":"2024-09-19T08:54:32.435271+0000","last_clean":"2024-09-19T08:54:32.435271+0000","last_became_active":"2024-09-19T08:54:31.429006+0000","last_became_peered":"2024-09-19T08:54:31.429006+0000","last_unstale":"2024-09-19T08:54:32.435271+0000","last_undegraded":"2024-09-19T08:54:32.435271+0000","last_fullsized":"2024-09-19T08:54:32.435271+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:26.399838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.330002+0000","last_change":"2024-09-19T08:54:29.414307+0000","last_active":"2024-09-19T08:54:52.330002+0000","last_peered":"2024-09-19T08:54:52.330002+0000","last_clean":"2024-09-19T08:54:52.330002+0000","last_became_active":"2024-09-19T08:54:29.413823+0000","last_became_peered":"2024-09-19T08:54:29.413823+0000","last_unstale":"2024-09-19T08:54:52.330002+0000","last_undegraded":"2024-09-19T08:54:52.330002+0000","last_fullsized":"2024-09-19T08:54:52.330002+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:25.484645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:35.377440+0000","last_change":"2024-09-19T08:54:31.437789+0000","last_active":"2024-09-19T08:54:35.377440+0000","last_peered":"2024-09-19T08:54:35.377440+0000","last_clean":"2024-09-19T08:54:35.377440+0000","last_became_active":"2024-09-19T08:54:31.435488+0000","last_became_peered":"2024-09-19T08:54:31.435488+0000","last_unstale":"2024-09-19T08:54:35.377440+0000","last_undegraded":"2024-09-19T08:54:35.377440+0000","last_fullsized":"2024-09-19T08:54:35.377440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:19.332440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.333662+0000","last_change":"2024-09-19T08:54:53.333120+0000","last_active":"2024-09-19T08:54:53.333662+0000","last_peered":"2024-09-19T08:54:53.333662+0000","last_clean":"2024-09-19T08:54:53.333662+0000","last_became_active":"2024-09-19T08:54:53.332711+0000","last_became_peered":"2024-09-19T08:54:53.332711+0000","last_unstale":"2024-09-19T08:54:53.333662+0000","last_undegraded":"2024-09-19T08:54:53.333662+0000","last_fullsized":"2024-09-19T08:54:53.333662+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:18.359002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.435253+0000","last_change":"2024-09-19T08:54:31.434564+0000","last_active":"2024-09-19T08:54:32.435253+0000","last_peered":"2024-09-19T08:54:32.435253+0000","last_clean":"2024-09-19T08:54:32.435253+0000","last_became_active":"2024-09-19T08:54:31.434231+0000","last_became_peered":"2024-09-19T08:54:31.434231+0000","last_unstale":"2024-09-19T08:54:32.435253+0000","last_undegraded":"2024-09-19T08:54:32.435253+0000","last_fullsized":"2024-09-19T08:54:32.435253+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:31.316400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":330,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.434952+0000","last_change":"2024-09-19T08:53:21.357560+0000","last_active":"2024-09-19T08:54:32.434952+0000","last_peered":"2024-09-19T08:54:32.434952+0000","last_clean":"2024-09-19T08:54:32.434952+0000","last_became_active":"2024-09-19T08:53:21.357122+0000","last_became_peered":"2024-09-19T08:53:21.357122+0000","last_unstale":"2024-09-19T08:54:32.434952+0000","last_undegraded":"2024-09-19T08:54:32.434952+0000","last_fullsized":"2024-09-19T08:54:32.434952+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:05.231370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:05.231370+0000","last_clean_scrub_stamp":"2024-09-19T08:50:05.231370+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:47.867682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.330224+0000","last_change":"2024-09-19T08:54:29.412240+0000","last_active":"2024-09-19T08:54:52.330224+0000","last_peered":"2024-09-19T08:54:52.330224+0000","last_clean":"2024-09-19T08:54:52.330224+0000","last_became_active":"2024-09-19T08:54:29.411908+0000","last_became_peered":"2024-09-19T08:54:29.411908+0000","last_unstale":"2024-09-19T08:54:52.330224+0000","last_undegraded":"2024-09-19T08:54:52.330224+0000","last_fullsized":"2024-09-19T08:54:52.330224+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:37.189373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331122+0000","last_change":"2024-09-19T08:54:31.432956+0000","last_active":"2024-09-19T08:54:53.331122+0000","last_peered":"2024-09-19T08:54:53.331122+0000","last_clean":"2024-09-19T08:54:53.331122+0000","last_became_active":"2024-09-19T08:54:31.432639+0000","last_became_peered":"2024-09-19T08:54:31.432639+0000","last_unstale":"2024-09-19T08:54:53.331122+0000","last_undegraded":"2024-09-19T08:54:53.331122+0000","last_fullsized":"2024-09-19T08:54:53.331122+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:58.302624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.434851+0000","last_change":"2024-09-19T08:54:29.414214+0000","last_active":"2024-09-19T08:54:32.434851+0000","last_peered":"2024-09-19T08:54:32.434851+0000","last_clean":"2024-09-19T08:54:32.434851+0000","last_became_active":"2024-09-19T08:54:29.413853+0000","last_became_peered":"2024-09-19T08:54:29.413853+0000","last_unstale":"2024-09-19T08:54:32.434851+0000","last_undegraded":"2024-09-19T08:54:32.434851+0000","last_fullsized":"2024-09-19T08:54:32.434851+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:28:29.119856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433152+0000","last_change":"2024-09-19T08:54:31.424643+0000","last_active":"2024-09-19T08:54:32.433152+0000","last_peered":"2024-09-19T08:54:32.433152+0000","last_clean":"2024-09-19T08:54:32.433152+0000","last_became_active":"2024-09-19T08:54:31.424363+0000","last_became_peered":"2024-09-19T08:54:31.424363+0000","last_unstale":"2024-09-19T08:54:32.433152+0000","last_undegraded":"2024-09-19T08:54:32.433152+0000","last_fullsized":"2024-09-19T08:54:32.433152+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:37.529952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433606+0000","last_change":"2024-09-19T08:54:29.675742+0000","last_active":"2024-09-19T08:54:32.433606+0000","last_peered":"2024-09-19T08:54:32.433606+0000","last_clean":"2024-09-19T08:54:32.433606+0000","last_became_active":"2024-09-19T08:54:29.675347+0000","last_became_peered":"2024-09-19T08:54:29.675347+0000","last_unstale":"2024-09-19T08:54:32.433606+0000","last_undegraded":"2024-09-19T08:54:32.433606+0000","last_fullsized":"2024-09-19T08:54:32.433606+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:00.925390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.329392+0000","last_change":"2024-09-19T08:54:31.433887+0000","last_active":"2024-09-19T08:54:52.329392+0000","last_peered":"2024-09-19T08:54:52.329392+0000","last_clean":"2024-09-19T08:54:52.329392+0000","last_became_active":"2024-09-19T08:54:31.433331+0000","last_became_peered":"2024-09-19T08:54:31.433331+0000","last_unstale":"2024-09-19T08:54:52.329392+0000","last_undegraded":"2024-09-19T08:54:52.329392+0000","last_fullsized":"2024-09-19T08:54:52.329392+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:49.875061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.436266+0000","last_change":"2024-09-19T08:54:29.417410+0000","last_active":"2024-09-19T08:54:32.436266+0000","last_peered":"2024-09-19T08:54:32.436266+0000","last_clean":"2024-09-19T08:54:32.436266+0000","last_became_active":"2024-09-19T08:54:29.417018+0000","last_became_peered":"2024-09-19T08:54:29.417018+0000","last_unstale":"2024-09-19T08:54:32.436266+0000","last_undegraded":"2024-09-19T08:54:32.436266+0000","last_fullsized":"2024-09-19T08:54:32.436266+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:53.669027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433939+0000","last_change":"2024-09-19T08:54:31.431313+0000","last_active":"2024-09-19T08:54:32.433939+0000","last_peered":"2024-09-19T08:54:32.433939+0000","last_clean":"2024-09-19T08:54:32.433939+0000","last_became_active":"2024-09-19T08:54:31.429427+0000","last_became_peered":"2024-09-19T08:54:31.429427+0000","last_unstale":"2024-09-19T08:54:32.433939+0000","last_undegraded":"2024-09-19T08:54:32.433939+0000","last_fullsized":"2024-09-19T08:54:32.433939+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:55.106769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433530+0000","last_change":"2024-09-19T08:54:29.675722+0000","last_active":"2024-09-19T08:54:32.433530+0000","last_peered":"2024-09-19T08:54:32.433530+0000","last_clean":"2024-09-19T08:54:32.433530+0000","last_became_active":"2024-09-19T08:54:29.675397+0000","last_became_peered":"2024-09-19T08:54:29.675397+0000","last_unstale":"2024-09-19T08:54:32.433530+0000","last_undegraded":"2024-09-19T08:54:32.433530+0000","last_fullsized":"2024-09-19T08:54:32.433530+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:49.574947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.434637+0000","last_change":"2024-09-19T08:54:31.431106+0000","last_active":"2024-09-19T08:54:32.434637+0000","last_peered":"2024-09-19T08:54:32.434637+0000","last_clean":"2024-09-19T08:54:32.434637+0000","last_became_active":"2024-09-19T08:54:31.430745+0000","last_became_peered":"2024-09-19T08:54:31.430745+0000","last_unstale":"2024-09-19T08:54:32.434637+0000","last_undegraded":"2024-09-19T08:54:32.434637+0000","last_fullsized":"2024-09-19T08:54:32.434637+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:22.714106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331431+0000","last_change":"2024-09-19T08:54:29.675985+0000","last_active":"2024-09-19T08:54:53.331431+0000","last_peered":"2024-09-19T08:54:53.331431+0000","last_clean":"2024-09-19T08:54:53.331431+0000","last_became_active":"2024-09-19T08:54:29.675374+0000","last_became_peered":"2024-09-19T08:54:29.675374+0000","last_unstale":"2024-09-19T08:54:53.331431+0000","last_undegraded":"2024-09-19T08:54:53.331431+0000","last_fullsized":"2024-09-19T08:54:53.331431+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:06.664621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433500+0000","last_change":"2024-09-19T08:54:31.423493+0000","last_active":"2024-09-19T08:54:32.433500+0000","last_peered":"2024-09-19T08:54:32.433500+0000","last_clean":"2024-09-19T08:54:32.433500+0000","last_became_active":"2024-09-19T08:54:31.422651+0000","last_became_peered":"2024-09-19T08:54:31.422651+0000","last_unstale":"2024-09-19T08:54:32.433500+0000","last_undegraded":"2024-09-19T08:54:32.433500+0000","last_fullsized":"2024-09-19T08:54:32.433500+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:51.863965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'4","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:45.433899+0000","last_change":"2024-09-19T08:54:29.408571+0000","last_active":"2024-09-19T08:54:45.433899+0000","last_peered":"2024-09-19T08:54:45.433899+0000","last_clean":"2024-09-19T08:54:45.433899+0000","last_became_active":"2024-09-19T08:54:29.408142+0000","last_became_peered":"2024-09-19T08:54:29.408142+0000","last_unstale":"2024-09-19T08:54:45.433899+0000","last_undegraded":"2024-09-19T08:54:45.433899+0000","last_fullsized":"2024-09-19T08:54:45.433899+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:34.578230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329321+0000","last_change":"2024-09-19T08:54:31.435333+0000","last_active":"2024-09-19T08:54:53.329321+0000","last_peered":"2024-09-19T08:54:53.329321+0000","last_clean":"2024-09-19T08:54:53.329321+0000","last_became_active":"2024-09-19T08:54:31.435041+0000","last_became_peered":"2024-09-19T08:54:31.435041+0000","last_unstale":"2024-09-19T08:54:53.329321+0000","last_undegraded":"2024-09-19T08:54:53.329321+0000","last_fullsized":"2024-09-19T08:54:53.329321+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:40.972638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'2","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.329561+0000","last_change":"2024-09-19T08:54:29.554303+0000","last_active":"2024-09-19T08:54:52.329561+0000","last_peered":"2024-09-19T08:54:52.329561+0000","last_clean":"2024-09-19T08:54:52.329561+0000","last_became_active":"2024-09-19T08:54:29.553919+0000","last_became_peered":"2024-09-19T08:54:29.553919+0000","last_unstale":"2024-09-19T08:54:52.329561+0000","last_undegraded":"2024-09-19T08:54:52.329561+0000","last_fullsized":"2024-09-19T08:54:52.329561+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:25.103926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.436742+0000","last_change":"2024-09-19T08:54:31.427542+0000","last_active":"2024-09-19T08:54:32.436742+0000","last_peered":"2024-09-19T08:54:32.436742+0000","last_clean":"2024-09-19T08:54:32.436742+0000","last_became_active":"2024-09-19T08:54:31.427239+0000","last_became_peered":"2024-09-19T08:54:31.427239+0000","last_unstale":"2024-09-19T08:54:32.436742+0000","last_undegraded":"2024-09-19T08:54:32.436742+0000","last_fullsized":"2024-09-19T08:54:32.436742+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:00:53.824215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329946+0000","last_change":"2024-09-19T08:54:29.675665+0000","last_active":"2024-09-19T08:54:53.329946+0000","last_peered":"2024-09-19T08:54:53.329946+0000","last_clean":"2024-09-19T08:54:53.329946+0000","last_became_active":"2024-09-19T08:54:29.675367+0000","last_became_peered":"2024-09-19T08:54:29.675367+0000","last_unstale":"2024-09-19T08:54:53.329946+0000","last_undegraded":"2024-09-19T08:54:53.329946+0000","last_fullsized":"2024-09-19T08:54:53.329946+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:35.473243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330857+0000","last_change":"2024-09-19T08:54:31.430837+0000","last_active":"2024-09-19T08:54:53.330857+0000","last_peered":"2024-09-19T08:54:53.330857+0000","last_clean":"2024-09-19T08:54:53.330857+0000","last_became_active":"2024-09-19T08:54:31.430465+0000","last_became_peered":"2024-09-19T08:54:31.430465+0000","last_unstale":"2024-09-19T08:54:53.330857+0000","last_undegraded":"2024-09-19T08:54:53.330857+0000","last_fullsized":"2024-09-19T08:54:53.330857+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:50.524730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329067+0000","last_change":"2024-09-19T08:54:29.413803+0000","last_active":"2024-09-19T08:54:53.329067+0000","last_peered":"2024-09-19T08:54:53.329067+0000","last_clean":"2024-09-19T08:54:53.329067+0000","last_became_active":"2024-09-19T08:54:29.413400+0000","last_became_peered":"2024-09-19T08:54:29.413400+0000","last_unstale":"2024-09-19T08:54:53.329067+0000","last_undegraded":"2024-09-19T08:54:53.329067+0000","last_fullsized":"2024-09-19T08:54:53.329067+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:12.518454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.326597+0000","last_change":"2024-09-19T08:54:31.428451+0000","last_active":"2024-09-19T08:54:52.326597+0000","last_peered":"2024-09-19T08:54:52.326597+0000","last_clean":"2024-09-19T08:54:52.326597+0000","last_became_active":"2024-09-19T08:54:31.428134+0000","last_became_peered":"2024-09-19T08:54:31.428134+0000","last_unstale":"2024-09-19T08:54:52.326597+0000","last_undegraded":"2024-09-19T08:54:52.326597+0000","last_fullsized":"2024-09-19T08:54:52.326597+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:08.260183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.434141+0000","last_change":"2024-09-19T08:54:29.414399+0000","last_active":"2024-09-19T08:54:32.434141+0000","last_peered":"2024-09-19T08:54:32.434141+0000","last_clean":"2024-09-19T08:54:32.434141+0000","last_became_active":"2024-09-19T08:54:29.413080+0000","last_became_peered":"2024-09-19T08:54:29.413080+0000","last_unstale":"2024-09-19T08:54:32.434141+0000","last_undegraded":"2024-09-19T08:54:32.434141+0000","last_fullsized":"2024-09-19T08:54:32.434141+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:27.308297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329046+0000","last_change":"2024-09-19T08:54:31.434550+0000","last_active":"2024-09-19T08:54:53.329046+0000","last_peered":"2024-09-19T08:54:53.329046+0000","last_clean":"2024-09-19T08:54:53.329046+0000","last_became_active":"2024-09-19T08:54:31.434195+0000","last_became_peered":"2024-09-19T08:54:31.434195+0000","last_unstale":"2024-09-19T08:54:53.329046+0000","last_undegraded":"2024-09-19T08:54:53.329046+0000","last_fullsized":"2024-09-19T08:54:53.329046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:04.807833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'2","reported_seq":2,"reported_epoch":81,"state":"peering","last_fresh":"2024-09-19T08:54:32.433476+0000","last_change":"2024-09-19T08:54:53.238635+0000","last_active":"2024-09-19T08:54:53.238635+0000","last_peered":"2024-09-19T08:54:32.433476+0000","last_clean":"2024-09-19T08:54:32.433476+0000","last_became_active":"2024-09-19T08:54:29.417231+0000","last_became_peered":"2024-09-19T08:54:29.417231+0000","last_unstale":"2024-09-19T08:54:32.433476+0000","last_undegraded":"2024-09-19T08:54:32.433476+0000","last_fullsized":"2024-09-19T08:54:32.433476+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":1,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.436040+0000","last_change":"2024-09-19T08:54:31.441201+0000","last_active":"2024-09-19T08:54:32.436040+0000","last_peered":"2024-09-19T08:54:32.436040+0000","last_clean":"2024-09-19T08:54:32.436040+0000","last_became_active":"2024-09-19T08:54:31.440738+0000","last_became_peered":"2024-09-19T08:54:31.440738+0000","last_unstale":"2024-09-19T08:54:32.436040+0000","last_undegraded":"2024-09-19T08:54:32.436040+0000","last_fullsized":"2024-09-19T08:54:32.436040+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:39.118320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.329775+0000","last_change":"2024-09-19T08:54:31.435772+0000","last_active":"2024-09-19T08:54:52.329775+0000","last_peered":"2024-09-19T08:54:52.329775+0000","last_clean":"2024-09-19T08:54:52.329775+0000","last_became_active":"2024-09-19T08:54:31.435257+0000","last_became_peered":"2024-09-19T08:54:31.435257+0000","last_unstale":"2024-09-19T08:54:52.329775+0000","last_undegraded":"2024-09-19T08:54:52.329775+0000","last_fullsized":"2024-09-19T08:54:52.329775+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:44:12.219054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":2,"reported_epoch":81,"state":"peering","last_fresh":"2024-09-19T08:54:32.433882+0000","last_change":"2024-09-19T08:54:53.238668+0000","last_active":"2024-09-19T08:54:53.238668+0000","last_peered":"2024-09-19T08:54:32.433882+0000","last_clean":"2024-09-19T08:54:32.433882+0000","last_became_active":"2024-09-19T08:54:29.412867+0000","last_became_peered":"2024-09-19T08:54:29.412867+0000","last_unstale":"2024-09-19T08:54:32.433882+0000","last_undegraded":"2024-09-19T08:54:32.433882+0000","last_fullsized":"2024-09-19T08:54:32.433882+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":1,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330452+0000","last_change":"2024-09-19T08:54:31.427103+0000","last_active":"2024-09-19T08:54:53.330452+0000","last_peered":"2024-09-19T08:54:53.330452+0000","last_clean":"2024-09-19T08:54:53.330452+0000","last_became_active":"2024-09-19T08:54:31.425958+0000","last_became_peered":"2024-09-19T08:54:31.425958+0000","last_unstale":"2024-09-19T08:54:53.330452+0000","last_undegraded":"2024-09-19T08:54:53.330452+0000","last_fullsized":"2024-09-19T08:54:53.330452+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:36.840940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331317+0000","last_change":"2024-09-19T08:54:29.415209+0000","last_active":"2024-09-19T08:54:53.331317+0000","last_peered":"2024-09-19T08:54:53.331317+0000","last_clean":"2024-09-19T08:54:53.331317+0000","last_became_active":"2024-09-19T08:54:29.414806+0000","last_became_peered":"2024-09-19T08:54:29.414806+0000","last_unstale":"2024-09-19T08:54:53.331317+0000","last_undegraded":"2024-09-19T08:54:53.331317+0000","last_fullsized":"2024-09-19T08:54:53.331317+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:47.764231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.436110+0000","last_change":"2024-09-19T08:54:31.434027+0000","last_active":"2024-09-19T08:54:32.436110+0000","last_peered":"2024-09-19T08:54:32.436110+0000","last_clean":"2024-09-19T08:54:32.436110+0000","last_became_active":"2024-09-19T08:54:31.433687+0000","last_became_peered":"2024-09-19T08:54:31.433687+0000","last_unstale":"2024-09-19T08:54:32.436110+0000","last_undegraded":"2024-09-19T08:54:32.436110+0000","last_fullsized":"2024-09-19T08:54:32.436110+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:56.462128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329231+0000","last_change":"2024-09-19T08:54:29.675502+0000","last_active":"2024-09-19T08:54:53.329231+0000","last_peered":"2024-09-19T08:54:53.329231+0000","last_clean":"2024-09-19T08:54:53.329231+0000","last_became_active":"2024-09-19T08:54:29.675158+0000","last_became_peered":"2024-09-19T08:54:29.675158+0000","last_unstale":"2024-09-19T08:54:53.329231+0000","last_undegraded":"2024-09-19T08:54:53.329231+0000","last_fullsized":"2024-09-19T08:54:53.329231+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:24:59.377521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.423418+0000","last_change":"2024-09-19T08:54:31.432117+0000","last_active":"2024-09-19T08:54:32.423418+0000","last_peered":"2024-09-19T08:54:32.423418+0000","last_clean":"2024-09-19T08:54:32.423418+0000","last_became_active":"2024-09-19T08:54:31.431831+0000","last_became_peered":"2024-09-19T08:54:31.431831+0000","last_unstale":"2024-09-19T08:54:32.423418+0000","last_undegraded":"2024-09-19T08:54:32.423418+0000","last_fullsized":"2024-09-19T08:54:32.423418+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:42.341694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.439715+0000","last_change":"2024-09-19T08:54:29.414478+0000","last_active":"2024-09-19T08:54:32.439715+0000","last_peered":"2024-09-19T08:54:32.439715+0000","last_clean":"2024-09-19T08:54:32.439715+0000","last_became_active":"2024-09-19T08:54:29.414152+0000","last_became_peered":"2024-09-19T08:54:29.414152+0000","last_unstale":"2024-09-19T08:54:32.439715+0000","last_undegraded":"2024-09-19T08:54:32.439715+0000","last_fullsized":"2024-09-19T08:54:32.439715+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:17.477340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":47600,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":36,"num_read_kb":65,"num_write":65,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":241664,"data_stored":152940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56,"ondisk_log_size":56,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579921,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":880640,"data_stored":427235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841557,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28520,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716632,"statfs":{"total":95995035648,"available":95965831168,"internally_reserved":0,"allocated":1531904,"data_stored":1056015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005082,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":868352,"data_stored":419116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234015,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":888832,"data_stored":427839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462948,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28456,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716696,"statfs":{"total":95995035648,"available":95965896704,"internally_reserved":0,"allocated":1466368,"data_stored":1009601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593769,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":868352,"data_stored":418651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822702,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32624,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712528,"statfs":{"total":95995035648,"available":95961628672,"internally_reserved":0,"allocated":1474560,"data_stored":1009201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986227,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":884736,"data_stored":427257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215159,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":897024,"data_stored":427573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411388,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":925696,"data_stored":465370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":937984,"data_stored":474037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":868352,"data_stored":418624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":56942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":46836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":46996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:54:55.908 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:54:56.151 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:56.580 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:56 smithi092 ceph-mon[31407]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:54:56.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.583+0000 7fb848d73640 1 -- 172.21.15.92:0/1596119362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb844102ef0 msgr2=0x7fb84410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:56.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.583+0000 7fb848d73640 1 --2- 172.21.15.92:0/1596119362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb844102ef0 0x7fb84410da40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb83c009ca0 tx=0x7fb83c02a950 comp rx=0 tx=0).stop 2024-09-19T08:54:56.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.583+0000 7fb848d73640 1 -- 172.21.15.92:0/1596119362 shutdown_connections 2024-09-19T08:54:56.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.583+0000 7fb848d73640 1 --2- 172.21.15.92:0/1596119362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb844102ef0 0x7fb84410da40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.583+0000 7fb848d73640 1 --2- 172.21.15.92:0/1596119362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb844102570 0x7fb8441029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.583+0000 7fb848d73640 1 --2- 172.21.15.92:0/1596119362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb844100e20 0x7fb844101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.583+0000 7fb848d73640 1 -- 172.21.15.92:0/1596119362 >> 172.21.15.92:0/1596119362 conn(0x7fb8440fc7d0 msgr2=0x7fb8440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:56.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.583+0000 7fb848d73640 1 -- 172.21.15.92:0/1596119362 shutdown_connections 2024-09-19T08:54:56.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.583+0000 7fb848d73640 1 -- 172.21.15.92:0/1596119362 wait complete. 2024-09-19T08:54:56.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.584+0000 7fb848d73640 1 Processor -- start 2024-09-19T08:54:56.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.584+0000 7fb848d73640 1 -- start start 2024-09-19T08:54:56.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.584+0000 7fb848d73640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb844100e20 0x7fb8441972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:56.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.584+0000 7fb848d73640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb844102570 0x7fb844197820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:56.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.584+0000 7fb848d73640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb844102ef0 0x7fb84419bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:56.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.584+0000 7fb848d73640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb844110f80 con 0x7fb844102570 2024-09-19T08:54:56.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.584+0000 7fb848d73640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb844110e00 con 0x7fb844100e20 2024-09-19T08:54:56.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.584+0000 7fb848d73640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb844111100 con 0x7fb844102ef0 2024-09-19T08:54:56.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.584+0000 7fb841d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb844102570 0x7fb844197820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:56.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.584+0000 7fb841d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb844102570 0x7fb844197820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40996/0 (socket says 172.21.15.92:40996) 2024-09-19T08:54:56.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.584+0000 7fb841d9b640 1 -- 172.21.15.92:0/1018084053 learned_addr learned my addr 172.21.15.92:0/1018084053 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:54:56.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.585+0000 7fb84259c640 1 --2- 172.21.15.92:0/1018084053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb844100e20 0x7fb8441972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:56.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.585+0000 7fb842d9d640 1 --2- 172.21.15.92:0/1018084053 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb844102ef0 0x7fb84419bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:56.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.585+0000 7fb841d9b640 1 -- 172.21.15.92:0/1018084053 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb844102ef0 msgr2=0x7fb84419bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:56.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.585+0000 7fb841d9b640 1 --2- 172.21.15.92:0/1018084053 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb844102ef0 0x7fb84419bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.585+0000 7fb841d9b640 1 -- 172.21.15.92:0/1018084053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb844100e20 msgr2=0x7fb8441972e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:56.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.585+0000 7fb841d9b640 1 --2- 172.21.15.92:0/1018084053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb844100e20 0x7fb8441972e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.585+0000 7fb841d9b640 1 -- 172.21.15.92:0/1018084053 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb84419c290 con 0x7fb844102570 2024-09-19T08:54:56.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.585+0000 7fb84259c640 1 --2- 172.21.15.92:0/1018084053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb844100e20 0x7fb8441972e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:56.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.585+0000 7fb841d9b640 1 --2- 172.21.15.92:0/1018084053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb844102570 0x7fb844197820 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb838007b50 tx=0x7fb83800e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:56.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.585+0000 7fb8337fe640 1 -- 172.21.15.92:0/1018084053 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb838007c40 con 0x7fb844102570 2024-09-19T08:54:56.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.585+0000 7fb8337fe640 1 -- 172.21.15.92:0/1018084053 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb838007de0 con 0x7fb844102570 2024-09-19T08:54:56.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.585+0000 7fb848d73640 1 -- 172.21.15.92:0/1018084053 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb84419c580 con 0x7fb844102570 2024-09-19T08:54:56.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.585+0000 7fb8337fe640 1 -- 172.21.15.92:0/1018084053 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb83800ae60 con 0x7fb844102570 2024-09-19T08:54:56.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.585+0000 7fb848d73640 1 -- 172.21.15.92:0/1018084053 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb844069f70 con 0x7fb844102570 2024-09-19T08:54:56.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.586+0000 7fb848d73640 1 -- 172.21.15.92:0/1018084053 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb844101200 con 0x7fb844102570 2024-09-19T08:54:56.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.587+0000 7fb8337fe640 1 -- 172.21.15.92:0/1018084053 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb83800a440 con 0x7fb844102570 2024-09-19T08:54:56.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.588+0000 7fb8337fe640 1 --2- 172.21.15.92:0/1018084053 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb82c0a32d0 0x7fb82c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:56.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.588+0000 7fb84259c640 1 --2- 172.21.15.92:0/1018084053 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb82c0a32d0 0x7fb82c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:56.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.588+0000 7fb8337fe640 1 -- 172.21.15.92:0/1018084053 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb8380d0fb0 con 0x7fb844102570 2024-09-19T08:54:56.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.588+0000 7fb84259c640 1 --2- 172.21.15.92:0/1018084053 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb82c0a32d0 0x7fb82c0a5790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb834005fd0 tx=0x7fb834005ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:56.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.592+0000 7fb8337fe640 1 -- 172.21.15.92:0/1018084053 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb838023060 con 0x7fb844102570 2024-09-19T08:54:56.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:56 smithi167 ceph-mon[35359]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:54:56.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:56 smithi190 ceph-mon[35358]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:54:56.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.758+0000 7fb848d73640 1 -- 172.21.15.92:0/1018084053 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb844106f40 con 0x7fb82c0a32d0 2024-09-19T08:54:56.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.764+0000 7fb8337fe640 1 -- 172.21.15.92:0/1018084053 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258539 (secure 0 0 0) 0x7fb844106f40 con 0x7fb82c0a32d0 2024-09-19T08:54:56.766 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:54:56.767 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-19T08:54:56.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.767+0000 7fb848d73640 1 -- 172.21.15.92:0/1018084053 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb82c0a32d0 msgr2=0x7fb82c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:56.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.767+0000 7fb848d73640 1 --2- 172.21.15.92:0/1018084053 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb82c0a32d0 0x7fb82c0a5790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb834005fd0 tx=0x7fb834005ea0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.767+0000 7fb848d73640 1 -- 172.21.15.92:0/1018084053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb844102570 msgr2=0x7fb844197820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:56.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.767+0000 7fb848d73640 1 --2- 172.21.15.92:0/1018084053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb844102570 0x7fb844197820 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb838007b50 tx=0x7fb83800e420 comp rx=0 tx=0).stop 2024-09-19T08:54:56.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.768+0000 7fb848d73640 1 -- 172.21.15.92:0/1018084053 shutdown_connections 2024-09-19T08:54:56.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.768+0000 7fb848d73640 1 --2- 172.21.15.92:0/1018084053 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb844102ef0 0x7fb84419bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.768+0000 7fb848d73640 1 --2- 172.21.15.92:0/1018084053 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb82c0a32d0 0x7fb82c0a5790 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.768+0000 7fb848d73640 1 --2- 172.21.15.92:0/1018084053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb844102570 0x7fb844197820 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.768+0000 7fb848d73640 1 --2- 172.21.15.92:0/1018084053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb844100e20 0x7fb8441972e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.768+0000 7fb848d73640 1 -- 172.21.15.92:0/1018084053 >> 172.21.15.92:0/1018084053 conn(0x7fb8440fc7d0 msgr2=0x7fb844106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:56.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.768+0000 7fb848d73640 1 -- 172.21.15.92:0/1018084053 shutdown_connections 2024-09-19T08:54:56.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:56.768+0000 7fb848d73640 1 -- 172.21.15.92:0/1018084053 wait complete. 2024-09-19T08:54:57.471 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2024-09-19T08:54:56.260448+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":638202,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":162,"num_read_kb":174,"num_write":256,"num_write_kb":3007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":294,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365796,"kb_used_data":12336,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576028,"statfs":{"total":1151940427776,"available":1151565852672,"internally_reserved":0,"allocated":12632064,"data_stored":7059415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":24587,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":28,"num_write":20,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001593"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.326712+0000","last_change":"2024-09-19T08:54:31.437743+0000","last_active":"2024-09-19T08:54:52.326712+0000","last_peered":"2024-09-19T08:54:52.326712+0000","last_clean":"2024-09-19T08:54:52.326712+0000","last_became_active":"2024-09-19T08:54:31.437426+0000","last_became_peered":"2024-09-19T08:54:31.437426+0000","last_unstale":"2024-09-19T08:54:52.326712+0000","last_undegraded":"2024-09-19T08:54:52.326712+0000","last_fullsized":"2024-09-19T08:54:52.326712+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:04.403522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330184+0000","last_change":"2024-09-19T08:54:31.430322+0000","last_active":"2024-09-19T08:54:53.330184+0000","last_peered":"2024-09-19T08:54:53.330184+0000","last_clean":"2024-09-19T08:54:53.330184+0000","last_became_active":"2024-09-19T08:54:31.430008+0000","last_became_peered":"2024-09-19T08:54:31.430008+0000","last_unstale":"2024-09-19T08:54:53.330184+0000","last_undegraded":"2024-09-19T08:54:53.330184+0000","last_fullsized":"2024-09-19T08:54:53.330184+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:19.800686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331041+0000","last_change":"2024-09-19T08:54:31.430276+0000","last_active":"2024-09-19T08:54:53.331041+0000","last_peered":"2024-09-19T08:54:53.331041+0000","last_clean":"2024-09-19T08:54:53.331041+0000","last_became_active":"2024-09-19T08:54:31.429939+0000","last_became_peered":"2024-09-19T08:54:31.429939+0000","last_unstale":"2024-09-19T08:54:53.331041+0000","last_undegraded":"2024-09-19T08:54:53.331041+0000","last_fullsized":"2024-09-19T08:54:53.331041+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:08.735067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.329078+0000","last_change":"2024-09-19T08:54:31.435197+0000","last_active":"2024-09-19T08:54:52.329078+0000","last_peered":"2024-09-19T08:54:52.329078+0000","last_clean":"2024-09-19T08:54:52.329078+0000","last_became_active":"2024-09-19T08:54:31.434872+0000","last_became_peered":"2024-09-19T08:54:31.434872+0000","last_unstale":"2024-09-19T08:54:52.329078+0000","last_undegraded":"2024-09-19T08:54:52.329078+0000","last_fullsized":"2024-09-19T08:54:52.329078+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:06.213317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330478+0000","last_change":"2024-09-19T08:54:31.423765+0000","last_active":"2024-09-19T08:54:53.330478+0000","last_peered":"2024-09-19T08:54:53.330478+0000","last_clean":"2024-09-19T08:54:53.330478+0000","last_became_active":"2024-09-19T08:54:31.423296+0000","last_became_peered":"2024-09-19T08:54:31.423296+0000","last_unstale":"2024-09-19T08:54:53.330478+0000","last_undegraded":"2024-09-19T08:54:53.330478+0000","last_fullsized":"2024-09-19T08:54:53.330478+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:07.507168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433541+0000","last_change":"2024-09-19T08:54:31.430299+0000","last_active":"2024-09-19T08:54:32.433541+0000","last_peered":"2024-09-19T08:54:32.433541+0000","last_clean":"2024-09-19T08:54:32.433541+0000","last_became_active":"2024-09-19T08:54:31.429951+0000","last_became_peered":"2024-09-19T08:54:31.429951+0000","last_unstale":"2024-09-19T08:54:32.433541+0000","last_undegraded":"2024-09-19T08:54:32.433541+0000","last_fullsized":"2024-09-19T08:54:32.433541+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:11.299729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330534+0000","last_change":"2024-09-19T08:54:31.435854+0000","last_active":"2024-09-19T08:54:53.330534+0000","last_peered":"2024-09-19T08:54:53.330534+0000","last_clean":"2024-09-19T08:54:53.330534+0000","last_became_active":"2024-09-19T08:54:31.435522+0000","last_became_peered":"2024-09-19T08:54:31.435522+0000","last_unstale":"2024-09-19T08:54:53.330534+0000","last_undegraded":"2024-09-19T08:54:53.330534+0000","last_fullsized":"2024-09-19T08:54:53.330534+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:11.099750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.328883+0000","last_change":"2024-09-19T08:54:31.434574+0000","last_active":"2024-09-19T08:54:53.328883+0000","last_peered":"2024-09-19T08:54:53.328883+0000","last_clean":"2024-09-19T08:54:53.328883+0000","last_became_active":"2024-09-19T08:54:31.434268+0000","last_became_peered":"2024-09-19T08:54:31.434268+0000","last_unstale":"2024-09-19T08:54:53.328883+0000","last_undegraded":"2024-09-19T08:54:53.328883+0000","last_fullsized":"2024-09-19T08:54:53.328883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:29.159417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330517+0000","last_change":"2024-09-19T08:54:31.430446+0000","last_active":"2024-09-19T08:54:53.330517+0000","last_peered":"2024-09-19T08:54:53.330517+0000","last_clean":"2024-09-19T08:54:53.330517+0000","last_became_active":"2024-09-19T08:54:31.430048+0000","last_became_peered":"2024-09-19T08:54:31.430048+0000","last_unstale":"2024-09-19T08:54:53.330517+0000","last_undegraded":"2024-09-19T08:54:53.330517+0000","last_fullsized":"2024-09-19T08:54:53.330517+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:24.773947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.437326+0000","last_change":"2024-09-19T08:54:31.433144+0000","last_active":"2024-09-19T08:54:32.437326+0000","last_peered":"2024-09-19T08:54:32.437326+0000","last_clean":"2024-09-19T08:54:32.437326+0000","last_became_active":"2024-09-19T08:54:31.432590+0000","last_became_peered":"2024-09-19T08:54:31.432590+0000","last_unstale":"2024-09-19T08:54:32.437326+0000","last_undegraded":"2024-09-19T08:54:32.437326+0000","last_fullsized":"2024-09-19T08:54:32.437326+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:53.756846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331069+0000","last_change":"2024-09-19T08:54:31.435712+0000","last_active":"2024-09-19T08:54:53.331069+0000","last_peered":"2024-09-19T08:54:53.331069+0000","last_clean":"2024-09-19T08:54:53.331069+0000","last_became_active":"2024-09-19T08:54:31.435301+0000","last_became_peered":"2024-09-19T08:54:31.435301+0000","last_unstale":"2024-09-19T08:54:53.331069+0000","last_undegraded":"2024-09-19T08:54:53.331069+0000","last_fullsized":"2024-09-19T08:54:53.331069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:51.703709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.333375+0000","last_change":"2024-09-19T08:54:53.332853+0000","last_active":"2024-09-19T08:54:53.333375+0000","last_peered":"2024-09-19T08:54:53.333375+0000","last_clean":"2024-09-19T08:54:53.333375+0000","last_became_active":"2024-09-19T08:54:53.332460+0000","last_became_peered":"2024-09-19T08:54:53.332460+0000","last_unstale":"2024-09-19T08:54:53.333375+0000","last_undegraded":"2024-09-19T08:54:53.333375+0000","last_fullsized":"2024-09-19T08:54:53.333375+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:47:58.025876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433455+0000","last_change":"2024-09-19T08:54:31.425590+0000","last_active":"2024-09-19T08:54:32.433455+0000","last_peered":"2024-09-19T08:54:32.433455+0000","last_clean":"2024-09-19T08:54:32.433455+0000","last_became_active":"2024-09-19T08:54:31.425268+0000","last_became_peered":"2024-09-19T08:54:31.425268+0000","last_unstale":"2024-09-19T08:54:32.433455+0000","last_undegraded":"2024-09-19T08:54:32.433455+0000","last_fullsized":"2024-09-19T08:54:32.433455+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:09.404947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330332+0000","last_change":"2024-09-19T08:54:31.428372+0000","last_active":"2024-09-19T08:54:53.330332+0000","last_peered":"2024-09-19T08:54:53.330332+0000","last_clean":"2024-09-19T08:54:53.330332+0000","last_became_active":"2024-09-19T08:54:31.428064+0000","last_became_peered":"2024-09-19T08:54:31.428064+0000","last_unstale":"2024-09-19T08:54:53.330332+0000","last_undegraded":"2024-09-19T08:54:53.330332+0000","last_fullsized":"2024-09-19T08:54:53.330332+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:40.444117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330115+0000","last_change":"2024-09-19T08:54:31.424365+0000","last_active":"2024-09-19T08:54:53.330115+0000","last_peered":"2024-09-19T08:54:53.330115+0000","last_clean":"2024-09-19T08:54:53.330115+0000","last_became_active":"2024-09-19T08:54:31.424044+0000","last_became_peered":"2024-09-19T08:54:31.424044+0000","last_unstale":"2024-09-19T08:54:53.330115+0000","last_undegraded":"2024-09-19T08:54:53.330115+0000","last_fullsized":"2024-09-19T08:54:53.330115+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:16.435389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329839+0000","last_change":"2024-09-19T08:54:31.437238+0000","last_active":"2024-09-19T08:54:53.329839+0000","last_peered":"2024-09-19T08:54:53.329839+0000","last_clean":"2024-09-19T08:54:53.329839+0000","last_became_active":"2024-09-19T08:54:31.436867+0000","last_became_peered":"2024-09-19T08:54:31.436867+0000","last_unstale":"2024-09-19T08:54:53.329839+0000","last_undegraded":"2024-09-19T08:54:53.329839+0000","last_fullsized":"2024-09-19T08:54:53.329839+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:59.839081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.326763+0000","last_change":"2024-09-19T08:54:31.438654+0000","last_active":"2024-09-19T08:54:52.326763+0000","last_peered":"2024-09-19T08:54:52.326763+0000","last_clean":"2024-09-19T08:54:52.326763+0000","last_became_active":"2024-09-19T08:54:31.438342+0000","last_became_peered":"2024-09-19T08:54:31.438342+0000","last_unstale":"2024-09-19T08:54:52.326763+0000","last_undegraded":"2024-09-19T08:54:52.326763+0000","last_fullsized":"2024-09-19T08:54:52.326763+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:55.190605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330648+0000","last_change":"2024-09-19T08:54:31.431100+0000","last_active":"2024-09-19T08:54:53.330648+0000","last_peered":"2024-09-19T08:54:53.330648+0000","last_clean":"2024-09-19T08:54:53.330648+0000","last_became_active":"2024-09-19T08:54:31.430749+0000","last_became_peered":"2024-09-19T08:54:31.430749+0000","last_unstale":"2024-09-19T08:54:53.330648+0000","last_undegraded":"2024-09-19T08:54:53.330648+0000","last_fullsized":"2024-09-19T08:54:53.330648+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:50.597610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330176+0000","last_change":"2024-09-19T08:54:31.427454+0000","last_active":"2024-09-19T08:54:53.330176+0000","last_peered":"2024-09-19T08:54:53.330176+0000","last_clean":"2024-09-19T08:54:53.330176+0000","last_became_active":"2024-09-19T08:54:31.427098+0000","last_became_peered":"2024-09-19T08:54:31.427098+0000","last_unstale":"2024-09-19T08:54:53.330176+0000","last_undegraded":"2024-09-19T08:54:53.330176+0000","last_fullsized":"2024-09-19T08:54:53.330176+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:01.042626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.326377+0000","last_change":"2024-09-19T08:54:31.433887+0000","last_active":"2024-09-19T08:54:52.326377+0000","last_peered":"2024-09-19T08:54:52.326377+0000","last_clean":"2024-09-19T08:54:52.326377+0000","last_became_active":"2024-09-19T08:54:31.433528+0000","last_became_peered":"2024-09-19T08:54:31.433528+0000","last_unstale":"2024-09-19T08:54:52.326377+0000","last_undegraded":"2024-09-19T08:54:52.326377+0000","last_fullsized":"2024-09-19T08:54:52.326377+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:37.291226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433596+0000","last_change":"2024-09-19T08:54:31.436976+0000","last_active":"2024-09-19T08:54:32.433596+0000","last_peered":"2024-09-19T08:54:32.433596+0000","last_clean":"2024-09-19T08:54:32.433596+0000","last_became_active":"2024-09-19T08:54:31.436646+0000","last_became_peered":"2024-09-19T08:54:31.436646+0000","last_unstale":"2024-09-19T08:54:32.433596+0000","last_undegraded":"2024-09-19T08:54:32.433596+0000","last_fullsized":"2024-09-19T08:54:32.433596+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:19.755556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330114+0000","last_change":"2024-09-19T08:54:31.438922+0000","last_active":"2024-09-19T08:54:53.330114+0000","last_peered":"2024-09-19T08:54:53.330114+0000","last_clean":"2024-09-19T08:54:53.330114+0000","last_became_active":"2024-09-19T08:54:31.438593+0000","last_became_peered":"2024-09-19T08:54:31.438593+0000","last_unstale":"2024-09-19T08:54:53.330114+0000","last_undegraded":"2024-09-19T08:54:53.330114+0000","last_fullsized":"2024-09-19T08:54:53.330114+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:07.347900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.328949+0000","last_change":"2024-09-19T08:54:31.431659+0000","last_active":"2024-09-19T08:54:53.328949+0000","last_peered":"2024-09-19T08:54:53.328949+0000","last_clean":"2024-09-19T08:54:53.328949+0000","last_became_active":"2024-09-19T08:54:31.431359+0000","last_became_peered":"2024-09-19T08:54:31.431359+0000","last_unstale":"2024-09-19T08:54:53.328949+0000","last_undegraded":"2024-09-19T08:54:53.328949+0000","last_fullsized":"2024-09-19T08:54:53.328949+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:02.421286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.329257+0000","last_change":"2024-09-19T08:54:31.432185+0000","last_active":"2024-09-19T08:54:52.329257+0000","last_peered":"2024-09-19T08:54:52.329257+0000","last_clean":"2024-09-19T08:54:52.329257+0000","last_became_active":"2024-09-19T08:54:31.431418+0000","last_became_peered":"2024-09-19T08:54:31.431418+0000","last_unstale":"2024-09-19T08:54:52.329257+0000","last_undegraded":"2024-09-19T08:54:52.329257+0000","last_fullsized":"2024-09-19T08:54:52.329257+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:45.347487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329298+0000","last_change":"2024-09-19T08:54:31.433742+0000","last_active":"2024-09-19T08:54:53.329298+0000","last_peered":"2024-09-19T08:54:53.329298+0000","last_clean":"2024-09-19T08:54:53.329298+0000","last_became_active":"2024-09-19T08:54:31.433455+0000","last_became_peered":"2024-09-19T08:54:31.433455+0000","last_unstale":"2024-09-19T08:54:53.329298+0000","last_undegraded":"2024-09-19T08:54:53.329298+0000","last_fullsized":"2024-09-19T08:54:53.329298+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:38.803705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330825+0000","last_change":"2024-09-19T08:54:31.432954+0000","last_active":"2024-09-19T08:54:53.330825+0000","last_peered":"2024-09-19T08:54:53.330825+0000","last_clean":"2024-09-19T08:54:53.330825+0000","last_became_active":"2024-09-19T08:54:31.432574+0000","last_became_peered":"2024-09-19T08:54:31.432574+0000","last_unstale":"2024-09-19T08:54:53.330825+0000","last_undegraded":"2024-09-19T08:54:53.330825+0000","last_fullsized":"2024-09-19T08:54:53.330825+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:30.457191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.326618+0000","last_change":"2024-09-19T08:54:31.435544+0000","last_active":"2024-09-19T08:54:52.326618+0000","last_peered":"2024-09-19T08:54:52.326618+0000","last_clean":"2024-09-19T08:54:52.326618+0000","last_became_active":"2024-09-19T08:54:31.435195+0000","last_became_peered":"2024-09-19T08:54:31.435195+0000","last_unstale":"2024-09-19T08:54:52.326618+0000","last_undegraded":"2024-09-19T08:54:52.326618+0000","last_fullsized":"2024-09-19T08:54:52.326618+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:54.240654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433344+0000","last_change":"2024-09-19T08:54:31.428403+0000","last_active":"2024-09-19T08:54:32.433344+0000","last_peered":"2024-09-19T08:54:32.433344+0000","last_clean":"2024-09-19T08:54:32.433344+0000","last_became_active":"2024-09-19T08:54:31.428110+0000","last_became_peered":"2024-09-19T08:54:31.428110+0000","last_unstale":"2024-09-19T08:54:32.433344+0000","last_undegraded":"2024-09-19T08:54:32.433344+0000","last_fullsized":"2024-09-19T08:54:32.433344+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:05.593073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330562+0000","last_change":"2024-09-19T08:54:31.427291+0000","last_active":"2024-09-19T08:54:53.330562+0000","last_peered":"2024-09-19T08:54:53.330562+0000","last_clean":"2024-09-19T08:54:53.330562+0000","last_became_active":"2024-09-19T08:54:31.427011+0000","last_became_peered":"2024-09-19T08:54:31.427011+0000","last_unstale":"2024-09-19T08:54:53.330562+0000","last_undegraded":"2024-09-19T08:54:53.330562+0000","last_fullsized":"2024-09-19T08:54:53.330562+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:54.338526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329794+0000","last_change":"2024-09-19T08:54:31.429309+0000","last_active":"2024-09-19T08:54:53.329794+0000","last_peered":"2024-09-19T08:54:53.329794+0000","last_clean":"2024-09-19T08:54:53.329794+0000","last_became_active":"2024-09-19T08:54:31.428381+0000","last_became_peered":"2024-09-19T08:54:31.428381+0000","last_unstale":"2024-09-19T08:54:53.329794+0000","last_undegraded":"2024-09-19T08:54:53.329794+0000","last_fullsized":"2024-09-19T08:54:53.329794+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:22:33.920114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.336591+0000","last_change":"2024-09-19T08:54:53.336591+0000","last_active":"2024-09-19T08:54:53.336591+0000","last_peered":"2024-09-19T08:54:53.336591+0000","last_clean":"2024-09-19T08:54:53.336591+0000","last_became_active":"2024-09-19T08:54:53.336222+0000","last_became_peered":"2024-09-19T08:54:53.336222+0000","last_unstale":"2024-09-19T08:54:53.336591+0000","last_undegraded":"2024-09-19T08:54:53.336591+0000","last_fullsized":"2024-09-19T08:54:53.336591+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:59.019419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"peering","last_fresh":"2024-09-19T08:54:33.236674+0000","last_change":"2024-09-19T08:54:52.326921+0000","last_active":"2024-09-19T08:54:52.326921+0000","last_peered":"2024-09-19T08:54:33.236674+0000","last_clean":"2024-09-19T08:54:33.236674+0000","last_became_active":"2024-09-19T08:54:31.427335+0000","last_became_peered":"2024-09-19T08:54:31.427335+0000","last_unstale":"2024-09-19T08:54:33.236674+0000","last_undegraded":"2024-09-19T08:54:33.236674+0000","last_fullsized":"2024-09-19T08:54:33.236674+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,5,9],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331864+0000","last_change":"2024-09-19T08:54:31.427608+0000","last_active":"2024-09-19T08:54:53.331864+0000","last_peered":"2024-09-19T08:54:53.331864+0000","last_clean":"2024-09-19T08:54:53.331864+0000","last_became_active":"2024-09-19T08:54:31.427294+0000","last_became_peered":"2024-09-19T08:54:31.427294+0000","last_unstale":"2024-09-19T08:54:53.331864+0000","last_undegraded":"2024-09-19T08:54:53.331864+0000","last_fullsized":"2024-09-19T08:54:53.331864+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:41.356609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'1","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.329204+0000","last_change":"2024-09-19T08:54:29.416204+0000","last_active":"2024-09-19T08:54:52.329204+0000","last_peered":"2024-09-19T08:54:52.329204+0000","last_clean":"2024-09-19T08:54:52.329204+0000","last_became_active":"2024-09-19T08:54:29.415872+0000","last_became_peered":"2024-09-19T08:54:29.415872+0000","last_unstale":"2024-09-19T08:54:52.329204+0000","last_undegraded":"2024-09-19T08:54:52.329204+0000","last_fullsized":"2024-09-19T08:54:52.329204+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:13.844147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.329103+0000","last_change":"2024-09-19T08:54:31.432137+0000","last_active":"2024-09-19T08:54:52.329103+0000","last_peered":"2024-09-19T08:54:52.329103+0000","last_clean":"2024-09-19T08:54:52.329103+0000","last_became_active":"2024-09-19T08:54:31.431761+0000","last_became_peered":"2024-09-19T08:54:31.431761+0000","last_unstale":"2024-09-19T08:54:52.329103+0000","last_undegraded":"2024-09-19T08:54:52.329103+0000","last_fullsized":"2024-09-19T08:54:52.329103+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:05.008431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433993+0000","last_change":"2024-09-19T08:54:29.413221+0000","last_active":"2024-09-19T08:54:32.433993+0000","last_peered":"2024-09-19T08:54:32.433993+0000","last_clean":"2024-09-19T08:54:32.433993+0000","last_became_active":"2024-09-19T08:54:29.412829+0000","last_became_peered":"2024-09-19T08:54:29.412829+0000","last_unstale":"2024-09-19T08:54:32.433993+0000","last_undegraded":"2024-09-19T08:54:32.433993+0000","last_fullsized":"2024-09-19T08:54:32.433993+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:07.224136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433498+0000","last_change":"2024-09-19T08:54:29.410221+0000","last_active":"2024-09-19T08:54:32.433498+0000","last_peered":"2024-09-19T08:54:32.433498+0000","last_clean":"2024-09-19T08:54:32.433498+0000","last_became_active":"2024-09-19T08:54:29.409951+0000","last_became_peered":"2024-09-19T08:54:29.409951+0000","last_unstale":"2024-09-19T08:54:32.433498+0000","last_undegraded":"2024-09-19T08:54:32.433498+0000","last_fullsized":"2024-09-19T08:54:32.433498+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:58.350932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.328917+0000","last_change":"2024-09-19T08:54:31.429979+0000","last_active":"2024-09-19T08:54:53.328917+0000","last_peered":"2024-09-19T08:54:53.328917+0000","last_clean":"2024-09-19T08:54:53.328917+0000","last_became_active":"2024-09-19T08:54:31.429661+0000","last_became_peered":"2024-09-19T08:54:31.429661+0000","last_unstale":"2024-09-19T08:54:53.328917+0000","last_undegraded":"2024-09-19T08:54:53.328917+0000","last_fullsized":"2024-09-19T08:54:53.328917+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:27:40.603490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.330262+0000","last_change":"2024-09-19T08:54:29.415769+0000","last_active":"2024-09-19T08:54:52.330262+0000","last_peered":"2024-09-19T08:54:52.330262+0000","last_clean":"2024-09-19T08:54:52.330262+0000","last_became_active":"2024-09-19T08:54:29.415245+0000","last_became_peered":"2024-09-19T08:54:29.415245+0000","last_unstale":"2024-09-19T08:54:52.330262+0000","last_undegraded":"2024-09-19T08:54:52.330262+0000","last_fullsized":"2024-09-19T08:54:52.330262+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:15.487945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330132+0000","last_change":"2024-09-19T08:54:31.427126+0000","last_active":"2024-09-19T08:54:53.330132+0000","last_peered":"2024-09-19T08:54:53.330132+0000","last_clean":"2024-09-19T08:54:53.330132+0000","last_became_active":"2024-09-19T08:54:31.426816+0000","last_became_peered":"2024-09-19T08:54:31.426816+0000","last_unstale":"2024-09-19T08:54:53.330132+0000","last_undegraded":"2024-09-19T08:54:53.330132+0000","last_fullsized":"2024-09-19T08:54:53.330132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:38.039428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.434006+0000","last_change":"2024-09-19T08:54:29.411354+0000","last_active":"2024-09-19T08:54:32.434006+0000","last_peered":"2024-09-19T08:54:32.434006+0000","last_clean":"2024-09-19T08:54:32.434006+0000","last_became_active":"2024-09-19T08:54:29.410990+0000","last_became_peered":"2024-09-19T08:54:29.410990+0000","last_unstale":"2024-09-19T08:54:32.434006+0000","last_undegraded":"2024-09-19T08:54:32.434006+0000","last_fullsized":"2024-09-19T08:54:32.434006+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:29.338169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330234+0000","last_change":"2024-09-19T08:54:31.426243+0000","last_active":"2024-09-19T08:54:53.330234+0000","last_peered":"2024-09-19T08:54:53.330234+0000","last_clean":"2024-09-19T08:54:53.330234+0000","last_became_active":"2024-09-19T08:54:31.425895+0000","last_became_peered":"2024-09-19T08:54:31.425895+0000","last_unstale":"2024-09-19T08:54:53.330234+0000","last_undegraded":"2024-09-19T08:54:53.330234+0000","last_fullsized":"2024-09-19T08:54:53.330234+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:13.562780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331102+0000","last_change":"2024-09-19T08:54:29.416646+0000","last_active":"2024-09-19T08:54:53.331102+0000","last_peered":"2024-09-19T08:54:53.331102+0000","last_clean":"2024-09-19T08:54:53.331102+0000","last_became_active":"2024-09-19T08:54:29.416260+0000","last_became_peered":"2024-09-19T08:54:29.416260+0000","last_unstale":"2024-09-19T08:54:53.331102+0000","last_undegraded":"2024-09-19T08:54:53.331102+0000","last_fullsized":"2024-09-19T08:54:53.331102+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:42:17.467035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331394+0000","last_change":"2024-09-19T08:54:31.435538+0000","last_active":"2024-09-19T08:54:53.331394+0000","last_peered":"2024-09-19T08:54:53.331394+0000","last_clean":"2024-09-19T08:54:53.331394+0000","last_became_active":"2024-09-19T08:54:31.435185+0000","last_became_peered":"2024-09-19T08:54:31.435185+0000","last_unstale":"2024-09-19T08:54:53.331394+0000","last_undegraded":"2024-09-19T08:54:53.331394+0000","last_fullsized":"2024-09-19T08:54:53.331394+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:06.940123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'3","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.329891+0000","last_change":"2024-09-19T08:54:29.675914+0000","last_active":"2024-09-19T08:54:52.329891+0000","last_peered":"2024-09-19T08:54:52.329891+0000","last_clean":"2024-09-19T08:54:52.329891+0000","last_became_active":"2024-09-19T08:54:29.675482+0000","last_became_peered":"2024-09-19T08:54:29.675482+0000","last_unstale":"2024-09-19T08:54:52.329891+0000","last_undegraded":"2024-09-19T08:54:52.329891+0000","last_fullsized":"2024-09-19T08:54:52.329891+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:58.893008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330567+0000","last_change":"2024-09-19T08:54:31.432628+0000","last_active":"2024-09-19T08:54:53.330567+0000","last_peered":"2024-09-19T08:54:53.330567+0000","last_clean":"2024-09-19T08:54:53.330567+0000","last_became_active":"2024-09-19T08:54:31.430640+0000","last_became_peered":"2024-09-19T08:54:31.430640+0000","last_unstale":"2024-09-19T08:54:53.330567+0000","last_undegraded":"2024-09-19T08:54:53.330567+0000","last_fullsized":"2024-09-19T08:54:53.330567+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:07.793089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'20","reported_seq":70,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:51.509862+0000","last_change":"2024-09-19T08:54:29.414619+0000","last_active":"2024-09-19T08:54:51.509862+0000","last_peered":"2024-09-19T08:54:51.509862+0000","last_clean":"2024-09-19T08:54:51.509862+0000","last_became_active":"2024-09-19T08:54:29.414295+0000","last_became_peered":"2024-09-19T08:54:29.414295+0000","last_unstale":"2024-09-19T08:54:51.509862+0000","last_undegraded":"2024-09-19T08:54:51.509862+0000","last_fullsized":"2024-09-19T08:54:51.509862+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:23.782684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46802,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":61,"num_write":20,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331211+0000","last_change":"2024-09-19T08:54:31.425432+0000","last_active":"2024-09-19T08:54:53.331211+0000","last_peered":"2024-09-19T08:54:53.331211+0000","last_clean":"2024-09-19T08:54:53.331211+0000","last_became_active":"2024-09-19T08:54:31.425086+0000","last_became_peered":"2024-09-19T08:54:31.425086+0000","last_unstale":"2024-09-19T08:54:53.331211+0000","last_undegraded":"2024-09-19T08:54:53.331211+0000","last_fullsized":"2024-09-19T08:54:53.331211+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:56.572339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330371+0000","last_change":"2024-09-19T08:54:29.415055+0000","last_active":"2024-09-19T08:54:53.330371+0000","last_peered":"2024-09-19T08:54:53.330371+0000","last_clean":"2024-09-19T08:54:53.330371+0000","last_became_active":"2024-09-19T08:54:29.414573+0000","last_became_peered":"2024-09-19T08:54:29.414573+0000","last_unstale":"2024-09-19T08:54:53.330371+0000","last_undegraded":"2024-09-19T08:54:53.330371+0000","last_fullsized":"2024-09-19T08:54:53.330371+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:13.013714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433266+0000","last_change":"2024-09-19T08:54:31.436905+0000","last_active":"2024-09-19T08:54:32.433266+0000","last_peered":"2024-09-19T08:54:32.433266+0000","last_clean":"2024-09-19T08:54:32.433266+0000","last_became_active":"2024-09-19T08:54:31.436571+0000","last_became_peered":"2024-09-19T08:54:31.436571+0000","last_unstale":"2024-09-19T08:54:32.433266+0000","last_undegraded":"2024-09-19T08:54:32.433266+0000","last_fullsized":"2024-09-19T08:54:32.433266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:55.294255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.329565+0000","last_change":"2024-09-19T08:54:29.417958+0000","last_active":"2024-09-19T08:54:52.329565+0000","last_peered":"2024-09-19T08:54:52.329565+0000","last_clean":"2024-09-19T08:54:52.329565+0000","last_became_active":"2024-09-19T08:54:29.417570+0000","last_became_peered":"2024-09-19T08:54:29.417570+0000","last_unstale":"2024-09-19T08:54:52.329565+0000","last_undegraded":"2024-09-19T08:54:52.329565+0000","last_fullsized":"2024-09-19T08:54:52.329565+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:25.557217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331274+0000","last_change":"2024-09-19T08:54:31.433019+0000","last_active":"2024-09-19T08:54:53.331274+0000","last_peered":"2024-09-19T08:54:53.331274+0000","last_clean":"2024-09-19T08:54:53.331274+0000","last_became_active":"2024-09-19T08:54:31.431265+0000","last_became_peered":"2024-09-19T08:54:31.431265+0000","last_unstale":"2024-09-19T08:54:53.331274+0000","last_undegraded":"2024-09-19T08:54:53.331274+0000","last_fullsized":"2024-09-19T08:54:53.331274+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:36.481863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.329875+0000","last_change":"2024-09-19T08:54:29.414236+0000","last_active":"2024-09-19T08:54:52.329875+0000","last_peered":"2024-09-19T08:54:52.329875+0000","last_clean":"2024-09-19T08:54:52.329875+0000","last_became_active":"2024-09-19T08:54:29.413878+0000","last_became_peered":"2024-09-19T08:54:29.413878+0000","last_unstale":"2024-09-19T08:54:52.329875+0000","last_undegraded":"2024-09-19T08:54:52.329875+0000","last_fullsized":"2024-09-19T08:54:52.329875+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:11.222362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330480+0000","last_change":"2024-09-19T08:54:31.439512+0000","last_active":"2024-09-19T08:54:53.330480+0000","last_peered":"2024-09-19T08:54:53.330480+0000","last_clean":"2024-09-19T08:54:53.330480+0000","last_became_active":"2024-09-19T08:54:31.438767+0000","last_became_peered":"2024-09-19T08:54:31.438767+0000","last_unstale":"2024-09-19T08:54:53.330480+0000","last_undegraded":"2024-09-19T08:54:53.330480+0000","last_fullsized":"2024-09-19T08:54:53.330480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:31.784577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330687+0000","last_change":"2024-09-19T08:54:29.675768+0000","last_active":"2024-09-19T08:54:53.330687+0000","last_peered":"2024-09-19T08:54:53.330687+0000","last_clean":"2024-09-19T08:54:53.330687+0000","last_became_active":"2024-09-19T08:54:29.675376+0000","last_became_peered":"2024-09-19T08:54:29.675376+0000","last_unstale":"2024-09-19T08:54:53.330687+0000","last_undegraded":"2024-09-19T08:54:53.330687+0000","last_fullsized":"2024-09-19T08:54:53.330687+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:10.281126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.329401+0000","last_change":"2024-09-19T08:54:31.435904+0000","last_active":"2024-09-19T08:54:52.329401+0000","last_peered":"2024-09-19T08:54:52.329401+0000","last_clean":"2024-09-19T08:54:52.329401+0000","last_became_active":"2024-09-19T08:54:31.435396+0000","last_became_peered":"2024-09-19T08:54:31.435396+0000","last_unstale":"2024-09-19T08:54:52.329401+0000","last_undegraded":"2024-09-19T08:54:52.329401+0000","last_fullsized":"2024-09-19T08:54:52.329401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:41.567463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331746+0000","last_change":"2024-09-19T08:54:29.410221+0000","last_active":"2024-09-19T08:54:53.331746+0000","last_peered":"2024-09-19T08:54:53.331746+0000","last_clean":"2024-09-19T08:54:53.331746+0000","last_became_active":"2024-09-19T08:54:29.409856+0000","last_became_peered":"2024-09-19T08:54:29.409856+0000","last_unstale":"2024-09-19T08:54:53.331746+0000","last_undegraded":"2024-09-19T08:54:53.331746+0000","last_fullsized":"2024-09-19T08:54:53.331746+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:46.095816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.326482+0000","last_change":"2024-09-19T08:54:31.437854+0000","last_active":"2024-09-19T08:54:52.326482+0000","last_peered":"2024-09-19T08:54:52.326482+0000","last_clean":"2024-09-19T08:54:52.326482+0000","last_became_active":"2024-09-19T08:54:31.437491+0000","last_became_peered":"2024-09-19T08:54:31.437491+0000","last_unstale":"2024-09-19T08:54:52.326482+0000","last_undegraded":"2024-09-19T08:54:52.326482+0000","last_fullsized":"2024-09-19T08:54:52.326482+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:22.532429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.441422+0000","last_change":"2024-09-19T08:54:29.413937+0000","last_active":"2024-09-19T08:54:32.441422+0000","last_peered":"2024-09-19T08:54:32.441422+0000","last_clean":"2024-09-19T08:54:32.441422+0000","last_became_active":"2024-09-19T08:54:29.413610+0000","last_became_peered":"2024-09-19T08:54:29.413610+0000","last_unstale":"2024-09-19T08:54:32.441422+0000","last_undegraded":"2024-09-19T08:54:32.441422+0000","last_fullsized":"2024-09-19T08:54:32.441422+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:26.093427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330480+0000","last_change":"2024-09-19T08:54:31.429376+0000","last_active":"2024-09-19T08:54:53.330480+0000","last_peered":"2024-09-19T08:54:53.330480+0000","last_clean":"2024-09-19T08:54:53.330480+0000","last_became_active":"2024-09-19T08:54:31.429006+0000","last_became_peered":"2024-09-19T08:54:31.429006+0000","last_unstale":"2024-09-19T08:54:53.330480+0000","last_undegraded":"2024-09-19T08:54:53.330480+0000","last_fullsized":"2024-09-19T08:54:53.330480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:26.399838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.330002+0000","last_change":"2024-09-19T08:54:29.414307+0000","last_active":"2024-09-19T08:54:52.330002+0000","last_peered":"2024-09-19T08:54:52.330002+0000","last_clean":"2024-09-19T08:54:52.330002+0000","last_became_active":"2024-09-19T08:54:29.413823+0000","last_became_peered":"2024-09-19T08:54:29.413823+0000","last_unstale":"2024-09-19T08:54:52.330002+0000","last_undegraded":"2024-09-19T08:54:52.330002+0000","last_fullsized":"2024-09-19T08:54:52.330002+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:25.484645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330751+0000","last_change":"2024-09-19T08:54:31.437789+0000","last_active":"2024-09-19T08:54:53.330751+0000","last_peered":"2024-09-19T08:54:53.330751+0000","last_clean":"2024-09-19T08:54:53.330751+0000","last_became_active":"2024-09-19T08:54:31.435488+0000","last_became_peered":"2024-09-19T08:54:31.435488+0000","last_unstale":"2024-09-19T08:54:53.330751+0000","last_undegraded":"2024-09-19T08:54:53.330751+0000","last_fullsized":"2024-09-19T08:54:53.330751+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:19.332440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.333662+0000","last_change":"2024-09-19T08:54:53.333120+0000","last_active":"2024-09-19T08:54:53.333662+0000","last_peered":"2024-09-19T08:54:53.333662+0000","last_clean":"2024-09-19T08:54:53.333662+0000","last_became_active":"2024-09-19T08:54:53.332711+0000","last_became_peered":"2024-09-19T08:54:53.332711+0000","last_unstale":"2024-09-19T08:54:53.333662+0000","last_undegraded":"2024-09-19T08:54:53.333662+0000","last_fullsized":"2024-09-19T08:54:53.333662+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:18.359002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331140+0000","last_change":"2024-09-19T08:54:31.434564+0000","last_active":"2024-09-19T08:54:53.331140+0000","last_peered":"2024-09-19T08:54:53.331140+0000","last_clean":"2024-09-19T08:54:53.331140+0000","last_became_active":"2024-09-19T08:54:31.434231+0000","last_became_peered":"2024-09-19T08:54:31.434231+0000","last_unstale":"2024-09-19T08:54:53.331140+0000","last_undegraded":"2024-09-19T08:54:53.331140+0000","last_fullsized":"2024-09-19T08:54:53.331140+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:31.316400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":334,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331076+0000","last_change":"2024-09-19T08:53:21.357560+0000","last_active":"2024-09-19T08:54:53.331076+0000","last_peered":"2024-09-19T08:54:53.331076+0000","last_clean":"2024-09-19T08:54:53.331076+0000","last_became_active":"2024-09-19T08:53:21.357122+0000","last_became_peered":"2024-09-19T08:53:21.357122+0000","last_unstale":"2024-09-19T08:54:53.331076+0000","last_undegraded":"2024-09-19T08:54:53.331076+0000","last_fullsized":"2024-09-19T08:54:53.331076+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:05.231370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:05.231370+0000","last_clean_scrub_stamp":"2024-09-19T08:50:05.231370+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:47.867682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.330224+0000","last_change":"2024-09-19T08:54:29.412240+0000","last_active":"2024-09-19T08:54:52.330224+0000","last_peered":"2024-09-19T08:54:52.330224+0000","last_clean":"2024-09-19T08:54:52.330224+0000","last_became_active":"2024-09-19T08:54:29.411908+0000","last_became_peered":"2024-09-19T08:54:29.411908+0000","last_unstale":"2024-09-19T08:54:52.330224+0000","last_undegraded":"2024-09-19T08:54:52.330224+0000","last_fullsized":"2024-09-19T08:54:52.330224+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:37.189373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331122+0000","last_change":"2024-09-19T08:54:31.432956+0000","last_active":"2024-09-19T08:54:53.331122+0000","last_peered":"2024-09-19T08:54:53.331122+0000","last_clean":"2024-09-19T08:54:53.331122+0000","last_became_active":"2024-09-19T08:54:31.432639+0000","last_became_peered":"2024-09-19T08:54:31.432639+0000","last_unstale":"2024-09-19T08:54:53.331122+0000","last_undegraded":"2024-09-19T08:54:53.331122+0000","last_fullsized":"2024-09-19T08:54:53.331122+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:58.302624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331178+0000","last_change":"2024-09-19T08:54:29.414214+0000","last_active":"2024-09-19T08:54:53.331178+0000","last_peered":"2024-09-19T08:54:53.331178+0000","last_clean":"2024-09-19T08:54:53.331178+0000","last_became_active":"2024-09-19T08:54:29.413853+0000","last_became_peered":"2024-09-19T08:54:29.413853+0000","last_unstale":"2024-09-19T08:54:53.331178+0000","last_undegraded":"2024-09-19T08:54:53.331178+0000","last_fullsized":"2024-09-19T08:54:53.331178+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:28:29.119856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433152+0000","last_change":"2024-09-19T08:54:31.424643+0000","last_active":"2024-09-19T08:54:32.433152+0000","last_peered":"2024-09-19T08:54:32.433152+0000","last_clean":"2024-09-19T08:54:32.433152+0000","last_became_active":"2024-09-19T08:54:31.424363+0000","last_became_peered":"2024-09-19T08:54:31.424363+0000","last_unstale":"2024-09-19T08:54:32.433152+0000","last_undegraded":"2024-09-19T08:54:32.433152+0000","last_fullsized":"2024-09-19T08:54:32.433152+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:37.529952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433606+0000","last_change":"2024-09-19T08:54:29.675742+0000","last_active":"2024-09-19T08:54:32.433606+0000","last_peered":"2024-09-19T08:54:32.433606+0000","last_clean":"2024-09-19T08:54:32.433606+0000","last_became_active":"2024-09-19T08:54:29.675347+0000","last_became_peered":"2024-09-19T08:54:29.675347+0000","last_unstale":"2024-09-19T08:54:32.433606+0000","last_undegraded":"2024-09-19T08:54:32.433606+0000","last_fullsized":"2024-09-19T08:54:32.433606+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:00.925390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.329392+0000","last_change":"2024-09-19T08:54:31.433887+0000","last_active":"2024-09-19T08:54:52.329392+0000","last_peered":"2024-09-19T08:54:52.329392+0000","last_clean":"2024-09-19T08:54:52.329392+0000","last_became_active":"2024-09-19T08:54:31.433331+0000","last_became_peered":"2024-09-19T08:54:31.433331+0000","last_unstale":"2024-09-19T08:54:52.329392+0000","last_undegraded":"2024-09-19T08:54:52.329392+0000","last_fullsized":"2024-09-19T08:54:52.329392+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:49.875061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331491+0000","last_change":"2024-09-19T08:54:29.417410+0000","last_active":"2024-09-19T08:54:53.331491+0000","last_peered":"2024-09-19T08:54:53.331491+0000","last_clean":"2024-09-19T08:54:53.331491+0000","last_became_active":"2024-09-19T08:54:29.417018+0000","last_became_peered":"2024-09-19T08:54:29.417018+0000","last_unstale":"2024-09-19T08:54:53.331491+0000","last_undegraded":"2024-09-19T08:54:53.331491+0000","last_fullsized":"2024-09-19T08:54:53.331491+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:53.669027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433939+0000","last_change":"2024-09-19T08:54:31.431313+0000","last_active":"2024-09-19T08:54:32.433939+0000","last_peered":"2024-09-19T08:54:32.433939+0000","last_clean":"2024-09-19T08:54:32.433939+0000","last_became_active":"2024-09-19T08:54:31.429427+0000","last_became_peered":"2024-09-19T08:54:31.429427+0000","last_unstale":"2024-09-19T08:54:32.433939+0000","last_undegraded":"2024-09-19T08:54:32.433939+0000","last_fullsized":"2024-09-19T08:54:32.433939+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:55.106769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330517+0000","last_change":"2024-09-19T08:54:29.675722+0000","last_active":"2024-09-19T08:54:53.330517+0000","last_peered":"2024-09-19T08:54:53.330517+0000","last_clean":"2024-09-19T08:54:53.330517+0000","last_became_active":"2024-09-19T08:54:29.675397+0000","last_became_peered":"2024-09-19T08:54:29.675397+0000","last_unstale":"2024-09-19T08:54:53.330517+0000","last_undegraded":"2024-09-19T08:54:53.330517+0000","last_fullsized":"2024-09-19T08:54:53.330517+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:49.574947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.434637+0000","last_change":"2024-09-19T08:54:31.431106+0000","last_active":"2024-09-19T08:54:32.434637+0000","last_peered":"2024-09-19T08:54:32.434637+0000","last_clean":"2024-09-19T08:54:32.434637+0000","last_became_active":"2024-09-19T08:54:31.430745+0000","last_became_peered":"2024-09-19T08:54:31.430745+0000","last_unstale":"2024-09-19T08:54:32.434637+0000","last_undegraded":"2024-09-19T08:54:32.434637+0000","last_fullsized":"2024-09-19T08:54:32.434637+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:22.714106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331431+0000","last_change":"2024-09-19T08:54:29.675985+0000","last_active":"2024-09-19T08:54:53.331431+0000","last_peered":"2024-09-19T08:54:53.331431+0000","last_clean":"2024-09-19T08:54:53.331431+0000","last_became_active":"2024-09-19T08:54:29.675374+0000","last_became_peered":"2024-09-19T08:54:29.675374+0000","last_unstale":"2024-09-19T08:54:53.331431+0000","last_undegraded":"2024-09-19T08:54:53.331431+0000","last_fullsized":"2024-09-19T08:54:53.331431+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:06.664621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:54:32.433500+0000","last_change":"2024-09-19T08:54:31.423493+0000","last_active":"2024-09-19T08:54:32.433500+0000","last_peered":"2024-09-19T08:54:32.433500+0000","last_clean":"2024-09-19T08:54:32.433500+0000","last_became_active":"2024-09-19T08:54:31.422651+0000","last_became_peered":"2024-09-19T08:54:31.422651+0000","last_unstale":"2024-09-19T08:54:32.433500+0000","last_undegraded":"2024-09-19T08:54:32.433500+0000","last_fullsized":"2024-09-19T08:54:32.433500+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:51.863965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330742+0000","last_change":"2024-09-19T08:54:29.408571+0000","last_active":"2024-09-19T08:54:53.330742+0000","last_peered":"2024-09-19T08:54:53.330742+0000","last_clean":"2024-09-19T08:54:53.330742+0000","last_became_active":"2024-09-19T08:54:29.408142+0000","last_became_peered":"2024-09-19T08:54:29.408142+0000","last_unstale":"2024-09-19T08:54:53.330742+0000","last_undegraded":"2024-09-19T08:54:53.330742+0000","last_fullsized":"2024-09-19T08:54:53.330742+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:34.578230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329321+0000","last_change":"2024-09-19T08:54:31.435333+0000","last_active":"2024-09-19T08:54:53.329321+0000","last_peered":"2024-09-19T08:54:53.329321+0000","last_clean":"2024-09-19T08:54:53.329321+0000","last_became_active":"2024-09-19T08:54:31.435041+0000","last_became_peered":"2024-09-19T08:54:31.435041+0000","last_unstale":"2024-09-19T08:54:53.329321+0000","last_undegraded":"2024-09-19T08:54:53.329321+0000","last_fullsized":"2024-09-19T08:54:53.329321+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:40.972638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'2","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.329561+0000","last_change":"2024-09-19T08:54:29.554303+0000","last_active":"2024-09-19T08:54:52.329561+0000","last_peered":"2024-09-19T08:54:52.329561+0000","last_clean":"2024-09-19T08:54:52.329561+0000","last_became_active":"2024-09-19T08:54:29.553919+0000","last_became_peered":"2024-09-19T08:54:29.553919+0000","last_unstale":"2024-09-19T08:54:52.329561+0000","last_undegraded":"2024-09-19T08:54:52.329561+0000","last_fullsized":"2024-09-19T08:54:52.329561+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:25.103926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.333280+0000","last_change":"2024-09-19T08:54:53.333280+0000","last_active":"2024-09-19T08:54:53.333280+0000","last_peered":"2024-09-19T08:54:53.333280+0000","last_clean":"2024-09-19T08:54:53.333280+0000","last_became_active":"2024-09-19T08:54:53.332881+0000","last_became_peered":"2024-09-19T08:54:53.332881+0000","last_unstale":"2024-09-19T08:54:53.333280+0000","last_undegraded":"2024-09-19T08:54:53.333280+0000","last_fullsized":"2024-09-19T08:54:53.333280+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:55.880616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329946+0000","last_change":"2024-09-19T08:54:29.675665+0000","last_active":"2024-09-19T08:54:53.329946+0000","last_peered":"2024-09-19T08:54:53.329946+0000","last_clean":"2024-09-19T08:54:53.329946+0000","last_became_active":"2024-09-19T08:54:29.675367+0000","last_became_peered":"2024-09-19T08:54:29.675367+0000","last_unstale":"2024-09-19T08:54:53.329946+0000","last_undegraded":"2024-09-19T08:54:53.329946+0000","last_fullsized":"2024-09-19T08:54:53.329946+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:35.473243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330857+0000","last_change":"2024-09-19T08:54:31.430837+0000","last_active":"2024-09-19T08:54:53.330857+0000","last_peered":"2024-09-19T08:54:53.330857+0000","last_clean":"2024-09-19T08:54:53.330857+0000","last_became_active":"2024-09-19T08:54:31.430465+0000","last_became_peered":"2024-09-19T08:54:31.430465+0000","last_unstale":"2024-09-19T08:54:53.330857+0000","last_undegraded":"2024-09-19T08:54:53.330857+0000","last_fullsized":"2024-09-19T08:54:53.330857+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:50.524730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329067+0000","last_change":"2024-09-19T08:54:29.413803+0000","last_active":"2024-09-19T08:54:53.329067+0000","last_peered":"2024-09-19T08:54:53.329067+0000","last_clean":"2024-09-19T08:54:53.329067+0000","last_became_active":"2024-09-19T08:54:29.413400+0000","last_became_peered":"2024-09-19T08:54:29.413400+0000","last_unstale":"2024-09-19T08:54:53.329067+0000","last_undegraded":"2024-09-19T08:54:53.329067+0000","last_fullsized":"2024-09-19T08:54:53.329067+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:12.518454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.326597+0000","last_change":"2024-09-19T08:54:31.428451+0000","last_active":"2024-09-19T08:54:52.326597+0000","last_peered":"2024-09-19T08:54:52.326597+0000","last_clean":"2024-09-19T08:54:52.326597+0000","last_became_active":"2024-09-19T08:54:31.428134+0000","last_became_peered":"2024-09-19T08:54:31.428134+0000","last_unstale":"2024-09-19T08:54:52.326597+0000","last_undegraded":"2024-09-19T08:54:52.326597+0000","last_fullsized":"2024-09-19T08:54:52.326597+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:08.260183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329914+0000","last_change":"2024-09-19T08:54:29.414399+0000","last_active":"2024-09-19T08:54:53.329914+0000","last_peered":"2024-09-19T08:54:53.329914+0000","last_clean":"2024-09-19T08:54:53.329914+0000","last_became_active":"2024-09-19T08:54:29.413080+0000","last_became_peered":"2024-09-19T08:54:29.413080+0000","last_unstale":"2024-09-19T08:54:53.329914+0000","last_undegraded":"2024-09-19T08:54:53.329914+0000","last_fullsized":"2024-09-19T08:54:53.329914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:27.308297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329046+0000","last_change":"2024-09-19T08:54:31.434550+0000","last_active":"2024-09-19T08:54:53.329046+0000","last_peered":"2024-09-19T08:54:53.329046+0000","last_clean":"2024-09-19T08:54:53.329046+0000","last_became_active":"2024-09-19T08:54:31.434195+0000","last_became_peered":"2024-09-19T08:54:31.434195+0000","last_unstale":"2024-09-19T08:54:53.329046+0000","last_undegraded":"2024-09-19T08:54:53.329046+0000","last_fullsized":"2024-09-19T08:54:53.329046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:04.807833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'2","reported_seq":2,"reported_epoch":81,"state":"peering","last_fresh":"2024-09-19T08:54:32.433476+0000","last_change":"2024-09-19T08:54:53.238635+0000","last_active":"2024-09-19T08:54:53.238635+0000","last_peered":"2024-09-19T08:54:32.433476+0000","last_clean":"2024-09-19T08:54:32.433476+0000","last_became_active":"2024-09-19T08:54:29.417231+0000","last_became_peered":"2024-09-19T08:54:29.417231+0000","last_unstale":"2024-09-19T08:54:32.433476+0000","last_undegraded":"2024-09-19T08:54:32.433476+0000","last_fullsized":"2024-09-19T08:54:32.433476+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":1,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331391+0000","last_change":"2024-09-19T08:54:31.441201+0000","last_active":"2024-09-19T08:54:53.331391+0000","last_peered":"2024-09-19T08:54:53.331391+0000","last_clean":"2024-09-19T08:54:53.331391+0000","last_became_active":"2024-09-19T08:54:31.440738+0000","last_became_peered":"2024-09-19T08:54:31.440738+0000","last_unstale":"2024-09-19T08:54:53.331391+0000","last_undegraded":"2024-09-19T08:54:53.331391+0000","last_fullsized":"2024-09-19T08:54:53.331391+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:39.118320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.329775+0000","last_change":"2024-09-19T08:54:31.435772+0000","last_active":"2024-09-19T08:54:52.329775+0000","last_peered":"2024-09-19T08:54:52.329775+0000","last_clean":"2024-09-19T08:54:52.329775+0000","last_became_active":"2024-09-19T08:54:31.435257+0000","last_became_peered":"2024-09-19T08:54:31.435257+0000","last_unstale":"2024-09-19T08:54:52.329775+0000","last_undegraded":"2024-09-19T08:54:52.329775+0000","last_fullsized":"2024-09-19T08:54:52.329775+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:44:12.219054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":2,"reported_epoch":81,"state":"peering","last_fresh":"2024-09-19T08:54:32.433882+0000","last_change":"2024-09-19T08:54:53.238668+0000","last_active":"2024-09-19T08:54:53.238668+0000","last_peered":"2024-09-19T08:54:32.433882+0000","last_clean":"2024-09-19T08:54:32.433882+0000","last_became_active":"2024-09-19T08:54:29.412867+0000","last_became_peered":"2024-09-19T08:54:29.412867+0000","last_unstale":"2024-09-19T08:54:32.433882+0000","last_undegraded":"2024-09-19T08:54:32.433882+0000","last_fullsized":"2024-09-19T08:54:32.433882+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":1,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330452+0000","last_change":"2024-09-19T08:54:31.427103+0000","last_active":"2024-09-19T08:54:53.330452+0000","last_peered":"2024-09-19T08:54:53.330452+0000","last_clean":"2024-09-19T08:54:53.330452+0000","last_became_active":"2024-09-19T08:54:31.425958+0000","last_became_peered":"2024-09-19T08:54:31.425958+0000","last_unstale":"2024-09-19T08:54:53.330452+0000","last_undegraded":"2024-09-19T08:54:53.330452+0000","last_fullsized":"2024-09-19T08:54:53.330452+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:36.840940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331317+0000","last_change":"2024-09-19T08:54:29.415209+0000","last_active":"2024-09-19T08:54:53.331317+0000","last_peered":"2024-09-19T08:54:53.331317+0000","last_clean":"2024-09-19T08:54:53.331317+0000","last_became_active":"2024-09-19T08:54:29.414806+0000","last_became_peered":"2024-09-19T08:54:29.414806+0000","last_unstale":"2024-09-19T08:54:53.331317+0000","last_undegraded":"2024-09-19T08:54:53.331317+0000","last_fullsized":"2024-09-19T08:54:53.331317+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:47.764231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331348+0000","last_change":"2024-09-19T08:54:31.434027+0000","last_active":"2024-09-19T08:54:53.331348+0000","last_peered":"2024-09-19T08:54:53.331348+0000","last_clean":"2024-09-19T08:54:53.331348+0000","last_became_active":"2024-09-19T08:54:31.433687+0000","last_became_peered":"2024-09-19T08:54:31.433687+0000","last_unstale":"2024-09-19T08:54:53.331348+0000","last_undegraded":"2024-09-19T08:54:53.331348+0000","last_fullsized":"2024-09-19T08:54:53.331348+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:56.462128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329231+0000","last_change":"2024-09-19T08:54:29.675502+0000","last_active":"2024-09-19T08:54:53.329231+0000","last_peered":"2024-09-19T08:54:53.329231+0000","last_clean":"2024-09-19T08:54:53.329231+0000","last_became_active":"2024-09-19T08:54:29.675158+0000","last_became_peered":"2024-09-19T08:54:29.675158+0000","last_unstale":"2024-09-19T08:54:53.329231+0000","last_undegraded":"2024-09-19T08:54:53.329231+0000","last_fullsized":"2024-09-19T08:54:53.329231+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:24:59.377521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.334600+0000","last_change":"2024-09-19T08:54:53.334264+0000","last_active":"2024-09-19T08:54:53.334600+0000","last_peered":"2024-09-19T08:54:53.334600+0000","last_clean":"2024-09-19T08:54:53.334600+0000","last_became_active":"2024-09-19T08:54:53.333959+0000","last_became_peered":"2024-09-19T08:54:53.333959+0000","last_unstale":"2024-09-19T08:54:53.334600+0000","last_undegraded":"2024-09-19T08:54:53.334600+0000","last_fullsized":"2024-09-19T08:54:53.334600+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:14.085033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330562+0000","last_change":"2024-09-19T08:54:29.414478+0000","last_active":"2024-09-19T08:54:53.330562+0000","last_peered":"2024-09-19T08:54:53.330562+0000","last_clean":"2024-09-19T08:54:53.330562+0000","last_became_active":"2024-09-19T08:54:29.414152+0000","last_became_peered":"2024-09-19T08:54:29.414152+0000","last_unstale":"2024-09-19T08:54:53.330562+0000","last_undegraded":"2024-09-19T08:54:53.330562+0000","last_fullsized":"2024-09-19T08:54:53.330562+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:17.477340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":47600,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":36,"num_read_kb":65,"num_write":73,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":163080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60,"ondisk_log_size":60,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579921,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":880640,"data_stored":427235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841557,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28520,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716632,"statfs":{"total":95995035648,"available":95965831168,"internally_reserved":0,"allocated":1531904,"data_stored":1056015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005083,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":901120,"data_stored":436305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234015,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":888832,"data_stored":427839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462949,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28496,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716656,"statfs":{"total":95995035648,"available":95965855744,"internally_reserved":0,"allocated":1499136,"data_stored":1026790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593769,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":868352,"data_stored":418651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822702,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32624,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712528,"statfs":{"total":95995035648,"available":95961628672,"internally_reserved":0,"allocated":1474560,"data_stored":1009201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986227,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":884736,"data_stored":427257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215159,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":897024,"data_stored":427573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411389,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":966656,"data_stored":492699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":937984,"data_stored":474037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738438,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":901120,"data_stored":435813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":56942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":56976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":46996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:54:57.475 INFO:tasks.cephadm.ceph_manager.ceph:PG 3.20 is not active+clean 2024-09-19T08:54:57.475 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 14, 'reported_epoch': 80, 'state': 'peering', 'last_fresh': '2024-09-19T08:54:33.236674+0000', 'last_change': '2024-09-19T08:54:52.326921+0000', 'last_active': '2024-09-19T08:54:52.326921+0000', 'last_peered': '2024-09-19T08:54:33.236674+0000', 'last_clean': '2024-09-19T08:54:33.236674+0000', 'last_became_active': '2024-09-19T08:54:31.427335+0000', 'last_became_peered': '2024-09-19T08:54:31.427335+0000', 'last_unstale': '2024-09-19T08:54:33.236674+0000', 'last_undegraded': '2024-09-19T08:54:33.236674+0000', 'last_fullsized': '2024-09-19T08:54:33.236674+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 79, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:54:30.402102+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:54:30.402102+0000', 'last_clean_scrub_stamp': '2024-09-19T08:54:30.402102+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [11, 2, 9], 'acting': [11, 2, 9], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2, 5, 9], 'up_primary': 11, 'acting_primary': 11, 'purged_snaps': []} 2024-09-19T08:54:57.475 INFO:tasks.cephadm.ceph_manager.ceph:PG 2.b is not active+clean 2024-09-19T08:54:57.475 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '2.b', 'version': "80'2", 'reported_seq': 2, 'reported_epoch': 81, 'state': 'peering', 'last_fresh': '2024-09-19T08:54:32.433476+0000', 'last_change': '2024-09-19T08:54:53.238635+0000', 'last_active': '2024-09-19T08:54:53.238635+0000', 'last_peered': '2024-09-19T08:54:32.433476+0000', 'last_clean': '2024-09-19T08:54:32.433476+0000', 'last_became_active': '2024-09-19T08:54:29.417231+0000', 'last_became_peered': '2024-09-19T08:54:29.417231+0000', 'last_unstale': '2024-09-19T08:54:32.433476+0000', 'last_undegraded': '2024-09-19T08:54:32.433476+0000', 'last_fullsized': '2024-09-19T08:54:32.433476+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 76, 'last_epoch_clean': 77, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:54:28.391524+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:54:28.391524+0000', 'last_clean_scrub_stamp': '2024-09-19T08:54:28.391524+0000', 'objects_scrubbed': 0, 'log_size': 2, 'log_dups_size': 0, 'ondisk_log_size': 2, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 1, 'num_object_clones': 0, 'num_object_copies': 3, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 1, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 1, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 1, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 1, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [11, 2, 7], 'acting': [11, 2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 11, 'acting_primary': 11, 'purged_snaps': []} 2024-09-19T08:54:57.476 INFO:tasks.cephadm.ceph_manager.ceph:PG 2.1c is not active+clean 2024-09-19T08:54:57.476 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '2.1c', 'version': "80'2", 'reported_seq': 2, 'reported_epoch': 81, 'state': 'peering', 'last_fresh': '2024-09-19T08:54:32.433882+0000', 'last_change': '2024-09-19T08:54:53.238668+0000', 'last_active': '2024-09-19T08:54:53.238668+0000', 'last_peered': '2024-09-19T08:54:32.433882+0000', 'last_clean': '2024-09-19T08:54:32.433882+0000', 'last_became_active': '2024-09-19T08:54:29.412867+0000', 'last_became_peered': '2024-09-19T08:54:29.412867+0000', 'last_unstale': '2024-09-19T08:54:32.433882+0000', 'last_undegraded': '2024-09-19T08:54:32.433882+0000', 'last_fullsized': '2024-09-19T08:54:32.433882+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 76, 'last_epoch_clean': 77, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:54:28.391524+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:54:28.391524+0000', 'last_clean_scrub_stamp': '2024-09-19T08:54:28.391524+0000', 'objects_scrubbed': 0, 'log_size': 2, 'log_dups_size': 0, 'ondisk_log_size': 2, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 1, 'num_object_clones': 0, 'num_object_copies': 3, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 1, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 1, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 3, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 1, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [11, 1, 5], 'acting': [11, 1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 11, 'acting_primary': 11, 'purged_snaps': []} 2024-09-19T08:54:57.476 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph status --format=json 2024-09-19T08:54:57.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:57 smithi167 ceph-mon[35359]: pgmap v284: 97 pgs: 3 peering, 94 active+clean; 623 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 3.9 KiB/s wr, 3 op/s 2024-09-19T08:54:57.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:57 smithi190 ceph-mon[35358]: pgmap v284: 97 pgs: 3 peering, 94 active+clean; 623 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 3.9 KiB/s wr, 3 op/s 2024-09-19T08:54:57.720 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:57.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:57 smithi092 ceph-mon[31407]: pgmap v284: 97 pgs: 3 peering, 94 active+clean; 623 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 3.9 KiB/s wr, 3 op/s 2024-09-19T08:54:58.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.147+0000 7ff607b9c640 1 -- 172.21.15.92:0/2208907314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff600106f20 msgr2=0x7ff60010eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:58.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.147+0000 7ff607b9c640 1 --2- 172.21.15.92:0/2208907314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff600106f20 0x7ff60010eaa0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8009ca0 tx=0x7ff5f802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:54:58.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.147+0000 7ff607b9c640 1 -- 172.21.15.92:0/2208907314 shutdown_connections 2024-09-19T08:54:58.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.147+0000 7ff607b9c640 1 --2- 172.21.15.92:0/2208907314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff600106f20 0x7ff60010eaa0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:58.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.147+0000 7ff607b9c640 1 --2- 172.21.15.92:0/2208907314 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6001027a0 0x7ff6001067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:58.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.147+0000 7ff607b9c640 1 --2- 172.21.15.92:0/2208907314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff600101df0 0x7ff6001021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:58.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.147+0000 7ff607b9c640 1 -- 172.21.15.92:0/2208907314 >> 172.21.15.92:0/2208907314 conn(0x7ff6000fd8f0 msgr2=0x7ff6000ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:58.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.147+0000 7ff607b9c640 1 -- 172.21.15.92:0/2208907314 shutdown_connections 2024-09-19T08:54:58.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.147+0000 7ff607b9c640 1 -- 172.21.15.92:0/2208907314 wait complete. 2024-09-19T08:54:58.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.148+0000 7ff607b9c640 1 Processor -- start 2024-09-19T08:54:58.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.148+0000 7ff607b9c640 1 -- start start 2024-09-19T08:54:58.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.148+0000 7ff607b9c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff600101df0 0x7ff6001a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:58.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.148+0000 7ff607b9c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6001027a0 0x7ff6001a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:58.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.148+0000 7ff607b9c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff600106f20 0x7ff60019a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:58.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.148+0000 7ff607b9c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff600112020 con 0x7ff6001027a0 2024-09-19T08:54:58.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.148+0000 7ff607b9c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff600111ea0 con 0x7ff600101df0 2024-09-19T08:54:58.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.148+0000 7ff607b9c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff6001121a0 con 0x7ff600106f20 2024-09-19T08:54:58.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.148+0000 7ff605137640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6001027a0 0x7ff6001a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:58.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.148+0000 7ff605137640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6001027a0 0x7ff6001a0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41022/0 (socket says 172.21.15.92:41022) 2024-09-19T08:54:58.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.148+0000 7ff605137640 1 -- 172.21.15.92:0/4124400621 learned_addr learned my addr 172.21.15.92:0/4124400621 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:54:58.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.148+0000 7ff605938640 1 --2- 172.21.15.92:0/4124400621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff600101df0 0x7ff6001a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:58.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.148+0000 7ff605137640 1 -- 172.21.15.92:0/4124400621 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff600106f20 msgr2=0x7ff60019a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:58.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.148+0000 7ff605137640 1 --2- 172.21.15.92:0/4124400621 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff600106f20 0x7ff60019a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:58.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.148+0000 7ff605137640 1 -- 172.21.15.92:0/4124400621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff600101df0 msgr2=0x7ff6001a0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:58.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.148+0000 7ff605137640 1 --2- 172.21.15.92:0/4124400621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff600101df0 0x7ff6001a0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:58.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.148+0000 7ff605137640 1 -- 172.21.15.92:0/4124400621 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff60019ad00 con 0x7ff6001027a0 2024-09-19T08:54:58.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.148+0000 7ff605938640 1 --2- 172.21.15.92:0/4124400621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff600101df0 0x7ff6001a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:54:58.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.149+0000 7ff605137640 1 --2- 172.21.15.92:0/4124400621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6001027a0 0x7ff6001a0950 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000b4a0 tx=0x7ff5f000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:58.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.149+0000 7ff5f6ffd640 1 -- 172.21.15.92:0/4124400621 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0014070 con 0x7ff6001027a0 2024-09-19T08:54:58.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.149+0000 7ff5f6ffd640 1 -- 172.21.15.92:0/4124400621 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5f0010af0 con 0x7ff6001027a0 2024-09-19T08:54:58.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.149+0000 7ff607b9c640 1 -- 172.21.15.92:0/4124400621 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff60019aff0 con 0x7ff6001027a0 2024-09-19T08:54:58.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.149+0000 7ff5f6ffd640 1 -- 172.21.15.92:0/4124400621 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0017d10 con 0x7ff6001027a0 2024-09-19T08:54:58.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.149+0000 7ff607b9c640 1 -- 172.21.15.92:0/4124400621 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6001a72e0 con 0x7ff6001027a0 2024-09-19T08:54:58.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.150+0000 7ff607b9c640 1 -- 172.21.15.92:0/4124400621 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff600102250 con 0x7ff6001027a0 2024-09-19T08:54:58.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.151+0000 7ff5f6ffd640 1 -- 172.21.15.92:0/4124400621 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff5f0017070 con 0x7ff6001027a0 2024-09-19T08:54:58.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.152+0000 7ff5f6ffd640 1 --2- 172.21.15.92:0/4124400621 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff5ec0a32d0 0x7ff5ec0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:58.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.152+0000 7ff605938640 1 --2- 172.21.15.92:0/4124400621 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff5ec0a32d0 0x7ff5ec0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:58.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.152+0000 7ff5f6ffd640 1 -- 172.21.15.92:0/4124400621 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff5f00cf260 con 0x7ff6001027a0 2024-09-19T08:54:58.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.152+0000 7ff605938640 1 --2- 172.21.15.92:0/4124400621 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff5ec0a32d0 0x7ff5ec0a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc006fd0 tx=0x7ff5fc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:58.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.155+0000 7ff5f6ffd640 1 -- 172.21.15.92:0/4124400621 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff5f009bef0 con 0x7ff6001027a0 2024-09-19T08:54:58.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.386+0000 7ff607b9c640 1 -- 172.21.15.92:0/4124400621 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7ff60019bb00 con 0x7ff6001027a0 2024-09-19T08:54:58.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.387+0000 7ff5f6ffd640 1 -- 172.21.15.92:0/4124400621 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2712 (secure 0 0 0) 0x7ff60019bb00 con 0x7ff6001027a0 2024-09-19T08:54:58.387 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:54:58.387 INFO:teuthology.orchestra.run.smithi092.stdout:{"fsid":"91ff74f2-7663-11ef-bceb-c7b262605968","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_age":381,"monmap":{"epoch":3,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":82,"num_osds":12,"num_up_osds":12,"osd_up_since":1726736023,"num_in_osds":12,"osd_in_since":1726735999,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":26,"data_bytes":648342,"bytes_used":374718464,"bytes_avail":1151565709312,"bytes_total":1151940427776,"recovering_objects_per_sec":0,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"read_bytes_sec":5502,"write_bytes_sec":5246,"read_op_per_sec":2,"write_op_per_sec":2},"fsmap":{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"c","status":"up:standby-replay","gid":24466},{"filesystem_id":1,"rank":0,"name":"i","status":"up:active","gid":24472}],"up:standby":10},"mgrmap":{"available":true,"num_standbys":2,"modules":["cephadm","dashboard","iostat","nfs","restful"],"services":{"dashboard":"https://172.21.15.92:8443/"}},"servicemap":{"epoch":20,"modified":"2024-09-19T08:54:56.260585+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"e":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"f":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"g":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"h":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"i":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"j":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-19T08:54:58.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.389+0000 7ff607b9c640 1 -- 172.21.15.92:0/4124400621 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff5ec0a32d0 msgr2=0x7ff5ec0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:58.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.389+0000 7ff607b9c640 1 --2- 172.21.15.92:0/4124400621 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff5ec0a32d0 0x7ff5ec0a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc006fd0 tx=0x7ff5fc008040 comp rx=0 tx=0).stop 2024-09-19T08:54:58.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.389+0000 7ff607b9c640 1 -- 172.21.15.92:0/4124400621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6001027a0 msgr2=0x7ff6001a0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:58.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.389+0000 7ff607b9c640 1 --2- 172.21.15.92:0/4124400621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6001027a0 0x7ff6001a0950 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000b4a0 tx=0x7ff5f000b960 comp rx=0 tx=0).stop 2024-09-19T08:54:58.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.389+0000 7ff607b9c640 1 -- 172.21.15.92:0/4124400621 shutdown_connections 2024-09-19T08:54:58.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.389+0000 7ff607b9c640 1 --2- 172.21.15.92:0/4124400621 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff600106f20 0x7ff60019a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:58.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.389+0000 7ff607b9c640 1 --2- 172.21.15.92:0/4124400621 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff5ec0a32d0 0x7ff5ec0a5790 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:58.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.389+0000 7ff607b9c640 1 --2- 172.21.15.92:0/4124400621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6001027a0 0x7ff6001a0950 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:58.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.389+0000 7ff607b9c640 1 --2- 172.21.15.92:0/4124400621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff600101df0 0x7ff6001a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:58.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.389+0000 7ff607b9c640 1 -- 172.21.15.92:0/4124400621 >> 172.21.15.92:0/4124400621 conn(0x7ff6000fd8f0 msgr2=0x7ff6000fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:58.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.389+0000 7ff607b9c640 1 -- 172.21.15.92:0/4124400621 shutdown_connections 2024-09-19T08:54:58.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:58.389+0000 7ff607b9c640 1 -- 172.21.15.92:0/4124400621 wait complete. 2024-09-19T08:54:58.398 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:58 smithi092 ceph-mon[31407]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:54:58.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:58 smithi190 ceph-mon[35358]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:54:58.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:58 smithi167 ceph-mon[35359]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:54:59.042 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-19T08:54:59.043 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:54:59.288 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:59.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:59 smithi092 ceph-mon[31407]: pgmap v285: 97 pgs: 97 active+clean; 633 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 5.1 KiB/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T08:54:59.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:54:59 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/4124400621' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-09-19T08:54:59.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:59 smithi190 ceph-mon[35358]: pgmap v285: 97 pgs: 97 active+clean; 633 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 5.1 KiB/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T08:54:59.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:54:59 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/4124400621' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-09-19T08:54:59.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.690+0000 7f48f4554640 1 -- 172.21.15.92:0/2614358698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48ec102db0 msgr2=0x7f48ec103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:59.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.690+0000 7f48f4554640 1 --2- 172.21.15.92:0/2614358698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48ec102db0 0x7f48ec103190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f48dc009cd0 tx=0x7f48dc02a910 comp rx=0 tx=0).stop 2024-09-19T08:54:59.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.690+0000 7f48f4554640 1 -- 172.21.15.92:0/2614358698 shutdown_connections 2024-09-19T08:54:59.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.690+0000 7f48f4554640 1 --2- 172.21.15.92:0/2614358698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48ec1082e0 0x7f48ec10ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:59.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.690+0000 7f48f4554640 1 --2- 172.21.15.92:0/2614358698 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48ec103760 0x7f48ec107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:59.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.690+0000 7f48f4554640 1 --2- 172.21.15.92:0/2614358698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48ec102db0 0x7f48ec103190 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:59.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.690+0000 7f48f4554640 1 -- 172.21.15.92:0/2614358698 >> 172.21.15.92:0/2614358698 conn(0x7f48ec0fc7d0 msgr2=0x7f48ec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:59.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.690+0000 7f48f4554640 1 -- 172.21.15.92:0/2614358698 shutdown_connections 2024-09-19T08:54:59.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.691+0000 7f48f4554640 1 -- 172.21.15.92:0/2614358698 wait complete. 2024-09-19T08:54:59.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.691+0000 7f48f4554640 1 Processor -- start 2024-09-19T08:54:59.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.691+0000 7f48f4554640 1 -- start start 2024-09-19T08:54:59.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.691+0000 7f48f4554640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48ec102db0 0x7f48ec100a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:59.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.691+0000 7f48f4554640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48ec103760 0x7f48ec100f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:59.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.691+0000 7f48f4554640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48ec1082e0 0x7f48ec101490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:59.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.691+0000 7f48f4554640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f48ec112170 con 0x7f48ec102db0 2024-09-19T08:54:59.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.691+0000 7f48f4554640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f48ec111ff0 con 0x7f48ec103760 2024-09-19T08:54:59.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.691+0000 7f48f4554640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f48ec1122f0 con 0x7f48ec1082e0 2024-09-19T08:54:59.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.691+0000 7f48f22f0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48ec102db0 0x7f48ec100a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:59.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.691+0000 7f48f22f0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48ec102db0 0x7f48ec100a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41040/0 (socket says 172.21.15.92:41040) 2024-09-19T08:54:59.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.691+0000 7f48f22f0640 1 -- 172.21.15.92:0/3869863538 learned_addr learned my addr 172.21.15.92:0/3869863538 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:54:59.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.692+0000 7f48f1aef640 1 --2- 172.21.15.92:0/3869863538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48ec103760 0x7f48ec100f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:59.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.692+0000 7f48f22f0640 1 -- 172.21.15.92:0/3869863538 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48ec1082e0 msgr2=0x7f48ec101490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:59.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.692+0000 7f48f2af1640 1 --2- 172.21.15.92:0/3869863538 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48ec1082e0 0x7f48ec101490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:59.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.692+0000 7f48f22f0640 1 --2- 172.21.15.92:0/3869863538 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48ec1082e0 0x7f48ec101490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:59.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.692+0000 7f48f22f0640 1 -- 172.21.15.92:0/3869863538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48ec103760 msgr2=0x7f48ec100f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:59.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.692+0000 7f48f22f0640 1 --2- 172.21.15.92:0/3869863538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48ec103760 0x7f48ec100f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:59.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.692+0000 7f48f22f0640 1 -- 172.21.15.92:0/3869863538 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48ec1a6c10 con 0x7f48ec102db0 2024-09-19T08:54:59.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.692+0000 7f48f1aef640 1 --2- 172.21.15.92:0/3869863538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48ec103760 0x7f48ec100f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:59.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.692+0000 7f48f22f0640 1 --2- 172.21.15.92:0/3869863538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48ec102db0 0x7f48ec100a10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f48dc0098d0 tx=0x7f48dc031460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:59.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.692+0000 7f48eb7fe640 1 -- 172.21.15.92:0/3869863538 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48dc031850 con 0x7f48ec102db0 2024-09-19T08:54:59.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.692+0000 7f48eb7fe640 1 -- 172.21.15.92:0/3869863538 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48dc004520 con 0x7f48ec102db0 2024-09-19T08:54:59.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.692+0000 7f48eb7fe640 1 -- 172.21.15.92:0/3869863538 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48dc02fe00 con 0x7f48ec102db0 2024-09-19T08:54:59.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.692+0000 7f48f4554640 1 -- 172.21.15.92:0/3869863538 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48ec1a6ea0 con 0x7f48ec102db0 2024-09-19T08:54:59.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.692+0000 7f48f4554640 1 -- 172.21.15.92:0/3869863538 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48ec1a7350 con 0x7f48ec102db0 2024-09-19T08:54:59.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.693+0000 7f48f4554640 1 -- 172.21.15.92:0/3869863538 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48ec103210 con 0x7f48ec102db0 2024-09-19T08:54:59.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.695+0000 7f48eb7fe640 1 -- 172.21.15.92:0/3869863538 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f48dc0046d0 con 0x7f48ec102db0 2024-09-19T08:54:59.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.696+0000 7f48eb7fe640 1 --2- 172.21.15.92:0/3869863538 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f48d40a32d0 0x7f48d40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:59.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.696+0000 7f48f1aef640 1 --2- 172.21.15.92:0/3869863538 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f48d40a32d0 0x7f48d40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:59.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.696+0000 7f48eb7fe640 1 -- 172.21.15.92:0/3869863538 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f48dc0f1140 con 0x7f48ec102db0 2024-09-19T08:54:59.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.696+0000 7f48f1aef640 1 --2- 172.21.15.92:0/3869863538 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f48d40a32d0 0x7f48d40a5790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f48ec1024a0 tx=0x7f48e0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:59.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.699+0000 7f48eb7fe640 1 -- 172.21.15.92:0/3869863538 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f48dc0bde10 con 0x7f48ec102db0 2024-09-19T08:54:59.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:59 smithi167 ceph-mon[35359]: pgmap v285: 97 pgs: 97 active+clean; 633 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 5.1 KiB/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T08:54:59.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:54:59 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/4124400621' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-09-19T08:54:59.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.862+0000 7f48f4554640 1 -- 172.21.15.92:0/3869863538 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f48ec062630 con 0x7f48d40a32d0 2024-09-19T08:54:59.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.868+0000 7f48eb7fe640 1 -- 172.21.15.92:0/3869863538 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258638 (secure 0 0 0) 0x7f48ec062630 con 0x7f48d40a32d0 2024-09-19T08:54:59.870 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:54:59.871 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-19T08:54:59.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.871+0000 7f48f4554640 1 -- 172.21.15.92:0/3869863538 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f48d40a32d0 msgr2=0x7f48d40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:59.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.871+0000 7f48f4554640 1 --2- 172.21.15.92:0/3869863538 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f48d40a32d0 0x7f48d40a5790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f48ec1024a0 tx=0x7f48e0008040 comp rx=0 tx=0).stop 2024-09-19T08:54:59.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.871+0000 7f48f4554640 1 -- 172.21.15.92:0/3869863538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48ec102db0 msgr2=0x7f48ec100a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:59.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.871+0000 7f48f4554640 1 --2- 172.21.15.92:0/3869863538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48ec102db0 0x7f48ec100a10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f48dc0098d0 tx=0x7f48dc031460 comp rx=0 tx=0).stop 2024-09-19T08:54:59.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.871+0000 7f48f4554640 1 -- 172.21.15.92:0/3869863538 shutdown_connections 2024-09-19T08:54:59.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.871+0000 7f48f4554640 1 --2- 172.21.15.92:0/3869863538 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48ec1082e0 0x7f48ec101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:59.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.871+0000 7f48f4554640 1 --2- 172.21.15.92:0/3869863538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48ec103760 0x7f48ec100f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:59.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.871+0000 7f48f4554640 1 --2- 172.21.15.92:0/3869863538 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f48d40a32d0 0x7f48d40a5790 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:59.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.871+0000 7f48f4554640 1 --2- 172.21.15.92:0/3869863538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48ec102db0 0x7f48ec100a10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:59.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.871+0000 7f48f4554640 1 -- 172.21.15.92:0/3869863538 >> 172.21.15.92:0/3869863538 conn(0x7f48ec0fc7d0 msgr2=0x7f48ec105eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:59.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.871+0000 7f48f4554640 1 -- 172.21.15.92:0/3869863538 shutdown_connections 2024-09-19T08:54:59.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:54:59.871+0000 7f48f4554640 1 -- 172.21.15.92:0/3869863538 wait complete. 2024-09-19T08:55:00.578 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":285,"stamp":"2024-09-19T08:54:58.260882+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":648342,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":173,"num_read_kb":189,"num_write":260,"num_write_kb":3019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":203,"ondisk_log_size":203,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":293,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365936,"kb_used_data":12456,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575888,"statfs":{"total":1151940427776,"available":1151565709312,"internally_reserved":0,"allocated":12754944,"data_stored":7129610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34727,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":43,"num_write":20,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001618"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.328272+0000","last_change":"2024-09-19T08:54:31.437743+0000","last_active":"2024-09-19T08:54:53.328272+0000","last_peered":"2024-09-19T08:54:53.328272+0000","last_clean":"2024-09-19T08:54:53.328272+0000","last_became_active":"2024-09-19T08:54:31.437426+0000","last_became_peered":"2024-09-19T08:54:31.437426+0000","last_unstale":"2024-09-19T08:54:53.328272+0000","last_undegraded":"2024-09-19T08:54:53.328272+0000","last_fullsized":"2024-09-19T08:54:53.328272+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:04.403522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330184+0000","last_change":"2024-09-19T08:54:31.430322+0000","last_active":"2024-09-19T08:54:53.330184+0000","last_peered":"2024-09-19T08:54:53.330184+0000","last_clean":"2024-09-19T08:54:53.330184+0000","last_became_active":"2024-09-19T08:54:31.430008+0000","last_became_peered":"2024-09-19T08:54:31.430008+0000","last_unstale":"2024-09-19T08:54:53.330184+0000","last_undegraded":"2024-09-19T08:54:53.330184+0000","last_fullsized":"2024-09-19T08:54:53.330184+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:19.800686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331041+0000","last_change":"2024-09-19T08:54:31.430276+0000","last_active":"2024-09-19T08:54:53.331041+0000","last_peered":"2024-09-19T08:54:53.331041+0000","last_clean":"2024-09-19T08:54:53.331041+0000","last_became_active":"2024-09-19T08:54:31.429939+0000","last_became_peered":"2024-09-19T08:54:31.429939+0000","last_unstale":"2024-09-19T08:54:53.331041+0000","last_undegraded":"2024-09-19T08:54:53.331041+0000","last_fullsized":"2024-09-19T08:54:53.331041+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:08.735067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.329078+0000","last_change":"2024-09-19T08:54:31.435197+0000","last_active":"2024-09-19T08:54:52.329078+0000","last_peered":"2024-09-19T08:54:52.329078+0000","last_clean":"2024-09-19T08:54:52.329078+0000","last_became_active":"2024-09-19T08:54:31.434872+0000","last_became_peered":"2024-09-19T08:54:31.434872+0000","last_unstale":"2024-09-19T08:54:52.329078+0000","last_undegraded":"2024-09-19T08:54:52.329078+0000","last_fullsized":"2024-09-19T08:54:52.329078+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:06.213317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330478+0000","last_change":"2024-09-19T08:54:31.423765+0000","last_active":"2024-09-19T08:54:53.330478+0000","last_peered":"2024-09-19T08:54:53.330478+0000","last_clean":"2024-09-19T08:54:53.330478+0000","last_became_active":"2024-09-19T08:54:31.423296+0000","last_became_peered":"2024-09-19T08:54:31.423296+0000","last_unstale":"2024-09-19T08:54:53.330478+0000","last_undegraded":"2024-09-19T08:54:53.330478+0000","last_fullsized":"2024-09-19T08:54:53.330478+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:07.507168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327935+0000","last_change":"2024-09-19T08:54:31.430299+0000","last_active":"2024-09-19T08:54:53.327935+0000","last_peered":"2024-09-19T08:54:53.327935+0000","last_clean":"2024-09-19T08:54:53.327935+0000","last_became_active":"2024-09-19T08:54:31.429951+0000","last_became_peered":"2024-09-19T08:54:31.429951+0000","last_unstale":"2024-09-19T08:54:53.327935+0000","last_undegraded":"2024-09-19T08:54:53.327935+0000","last_fullsized":"2024-09-19T08:54:53.327935+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:11.299729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330534+0000","last_change":"2024-09-19T08:54:31.435854+0000","last_active":"2024-09-19T08:54:53.330534+0000","last_peered":"2024-09-19T08:54:53.330534+0000","last_clean":"2024-09-19T08:54:53.330534+0000","last_became_active":"2024-09-19T08:54:31.435522+0000","last_became_peered":"2024-09-19T08:54:31.435522+0000","last_unstale":"2024-09-19T08:54:53.330534+0000","last_undegraded":"2024-09-19T08:54:53.330534+0000","last_fullsized":"2024-09-19T08:54:53.330534+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:11.099750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.328883+0000","last_change":"2024-09-19T08:54:31.434574+0000","last_active":"2024-09-19T08:54:53.328883+0000","last_peered":"2024-09-19T08:54:53.328883+0000","last_clean":"2024-09-19T08:54:53.328883+0000","last_became_active":"2024-09-19T08:54:31.434268+0000","last_became_peered":"2024-09-19T08:54:31.434268+0000","last_unstale":"2024-09-19T08:54:53.328883+0000","last_undegraded":"2024-09-19T08:54:53.328883+0000","last_fullsized":"2024-09-19T08:54:53.328883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:29.159417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330517+0000","last_change":"2024-09-19T08:54:31.430446+0000","last_active":"2024-09-19T08:54:53.330517+0000","last_peered":"2024-09-19T08:54:53.330517+0000","last_clean":"2024-09-19T08:54:53.330517+0000","last_became_active":"2024-09-19T08:54:31.430048+0000","last_became_peered":"2024-09-19T08:54:31.430048+0000","last_unstale":"2024-09-19T08:54:53.330517+0000","last_undegraded":"2024-09-19T08:54:53.330517+0000","last_fullsized":"2024-09-19T08:54:53.330517+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:24.773947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.328011+0000","last_change":"2024-09-19T08:54:31.433144+0000","last_active":"2024-09-19T08:54:53.328011+0000","last_peered":"2024-09-19T08:54:53.328011+0000","last_clean":"2024-09-19T08:54:53.328011+0000","last_became_active":"2024-09-19T08:54:31.432590+0000","last_became_peered":"2024-09-19T08:54:31.432590+0000","last_unstale":"2024-09-19T08:54:53.328011+0000","last_undegraded":"2024-09-19T08:54:53.328011+0000","last_fullsized":"2024-09-19T08:54:53.328011+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:53.756846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331069+0000","last_change":"2024-09-19T08:54:31.435712+0000","last_active":"2024-09-19T08:54:53.331069+0000","last_peered":"2024-09-19T08:54:53.331069+0000","last_clean":"2024-09-19T08:54:53.331069+0000","last_became_active":"2024-09-19T08:54:31.435301+0000","last_became_peered":"2024-09-19T08:54:31.435301+0000","last_unstale":"2024-09-19T08:54:53.331069+0000","last_undegraded":"2024-09-19T08:54:53.331069+0000","last_fullsized":"2024-09-19T08:54:53.331069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:51.703709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.333375+0000","last_change":"2024-09-19T08:54:53.332853+0000","last_active":"2024-09-19T08:54:53.333375+0000","last_peered":"2024-09-19T08:54:53.333375+0000","last_clean":"2024-09-19T08:54:53.333375+0000","last_became_active":"2024-09-19T08:54:53.332460+0000","last_became_peered":"2024-09-19T08:54:53.332460+0000","last_unstale":"2024-09-19T08:54:53.333375+0000","last_undegraded":"2024-09-19T08:54:53.333375+0000","last_fullsized":"2024-09-19T08:54:53.333375+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:47:58.025876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327046+0000","last_change":"2024-09-19T08:54:31.425590+0000","last_active":"2024-09-19T08:54:53.327046+0000","last_peered":"2024-09-19T08:54:53.327046+0000","last_clean":"2024-09-19T08:54:53.327046+0000","last_became_active":"2024-09-19T08:54:31.425268+0000","last_became_peered":"2024-09-19T08:54:31.425268+0000","last_unstale":"2024-09-19T08:54:53.327046+0000","last_undegraded":"2024-09-19T08:54:53.327046+0000","last_fullsized":"2024-09-19T08:54:53.327046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:09.404947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330332+0000","last_change":"2024-09-19T08:54:31.428372+0000","last_active":"2024-09-19T08:54:53.330332+0000","last_peered":"2024-09-19T08:54:53.330332+0000","last_clean":"2024-09-19T08:54:53.330332+0000","last_became_active":"2024-09-19T08:54:31.428064+0000","last_became_peered":"2024-09-19T08:54:31.428064+0000","last_unstale":"2024-09-19T08:54:53.330332+0000","last_undegraded":"2024-09-19T08:54:53.330332+0000","last_fullsized":"2024-09-19T08:54:53.330332+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:40.444117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330115+0000","last_change":"2024-09-19T08:54:31.424365+0000","last_active":"2024-09-19T08:54:53.330115+0000","last_peered":"2024-09-19T08:54:53.330115+0000","last_clean":"2024-09-19T08:54:53.330115+0000","last_became_active":"2024-09-19T08:54:31.424044+0000","last_became_peered":"2024-09-19T08:54:31.424044+0000","last_unstale":"2024-09-19T08:54:53.330115+0000","last_undegraded":"2024-09-19T08:54:53.330115+0000","last_fullsized":"2024-09-19T08:54:53.330115+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:16.435389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329839+0000","last_change":"2024-09-19T08:54:31.437238+0000","last_active":"2024-09-19T08:54:53.329839+0000","last_peered":"2024-09-19T08:54:53.329839+0000","last_clean":"2024-09-19T08:54:53.329839+0000","last_became_active":"2024-09-19T08:54:31.436867+0000","last_became_peered":"2024-09-19T08:54:31.436867+0000","last_unstale":"2024-09-19T08:54:53.329839+0000","last_undegraded":"2024-09-19T08:54:53.329839+0000","last_fullsized":"2024-09-19T08:54:53.329839+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:59.839081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.328379+0000","last_change":"2024-09-19T08:54:31.438654+0000","last_active":"2024-09-19T08:54:53.328379+0000","last_peered":"2024-09-19T08:54:53.328379+0000","last_clean":"2024-09-19T08:54:53.328379+0000","last_became_active":"2024-09-19T08:54:31.438342+0000","last_became_peered":"2024-09-19T08:54:31.438342+0000","last_unstale":"2024-09-19T08:54:53.328379+0000","last_undegraded":"2024-09-19T08:54:53.328379+0000","last_fullsized":"2024-09-19T08:54:53.328379+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:55.190605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330648+0000","last_change":"2024-09-19T08:54:31.431100+0000","last_active":"2024-09-19T08:54:53.330648+0000","last_peered":"2024-09-19T08:54:53.330648+0000","last_clean":"2024-09-19T08:54:53.330648+0000","last_became_active":"2024-09-19T08:54:31.430749+0000","last_became_peered":"2024-09-19T08:54:31.430749+0000","last_unstale":"2024-09-19T08:54:53.330648+0000","last_undegraded":"2024-09-19T08:54:53.330648+0000","last_fullsized":"2024-09-19T08:54:53.330648+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:50.597610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330176+0000","last_change":"2024-09-19T08:54:31.427454+0000","last_active":"2024-09-19T08:54:53.330176+0000","last_peered":"2024-09-19T08:54:53.330176+0000","last_clean":"2024-09-19T08:54:53.330176+0000","last_became_active":"2024-09-19T08:54:31.427098+0000","last_became_peered":"2024-09-19T08:54:31.427098+0000","last_unstale":"2024-09-19T08:54:53.330176+0000","last_undegraded":"2024-09-19T08:54:53.330176+0000","last_fullsized":"2024-09-19T08:54:53.330176+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:01.042626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.328302+0000","last_change":"2024-09-19T08:54:31.433887+0000","last_active":"2024-09-19T08:54:53.328302+0000","last_peered":"2024-09-19T08:54:53.328302+0000","last_clean":"2024-09-19T08:54:53.328302+0000","last_became_active":"2024-09-19T08:54:31.433528+0000","last_became_peered":"2024-09-19T08:54:31.433528+0000","last_unstale":"2024-09-19T08:54:53.328302+0000","last_undegraded":"2024-09-19T08:54:53.328302+0000","last_fullsized":"2024-09-19T08:54:53.328302+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:37.291226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327047+0000","last_change":"2024-09-19T08:54:31.436976+0000","last_active":"2024-09-19T08:54:53.327047+0000","last_peered":"2024-09-19T08:54:53.327047+0000","last_clean":"2024-09-19T08:54:53.327047+0000","last_became_active":"2024-09-19T08:54:31.436646+0000","last_became_peered":"2024-09-19T08:54:31.436646+0000","last_unstale":"2024-09-19T08:54:53.327047+0000","last_undegraded":"2024-09-19T08:54:53.327047+0000","last_fullsized":"2024-09-19T08:54:53.327047+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:19.755556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330114+0000","last_change":"2024-09-19T08:54:31.438922+0000","last_active":"2024-09-19T08:54:53.330114+0000","last_peered":"2024-09-19T08:54:53.330114+0000","last_clean":"2024-09-19T08:54:53.330114+0000","last_became_active":"2024-09-19T08:54:31.438593+0000","last_became_peered":"2024-09-19T08:54:31.438593+0000","last_unstale":"2024-09-19T08:54:53.330114+0000","last_undegraded":"2024-09-19T08:54:53.330114+0000","last_fullsized":"2024-09-19T08:54:53.330114+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:07.347900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.328949+0000","last_change":"2024-09-19T08:54:31.431659+0000","last_active":"2024-09-19T08:54:53.328949+0000","last_peered":"2024-09-19T08:54:53.328949+0000","last_clean":"2024-09-19T08:54:53.328949+0000","last_became_active":"2024-09-19T08:54:31.431359+0000","last_became_peered":"2024-09-19T08:54:31.431359+0000","last_unstale":"2024-09-19T08:54:53.328949+0000","last_undegraded":"2024-09-19T08:54:53.328949+0000","last_fullsized":"2024-09-19T08:54:53.328949+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:02.421286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330986+0000","last_change":"2024-09-19T08:54:31.432185+0000","last_active":"2024-09-19T08:54:53.330986+0000","last_peered":"2024-09-19T08:54:53.330986+0000","last_clean":"2024-09-19T08:54:53.330986+0000","last_became_active":"2024-09-19T08:54:31.431418+0000","last_became_peered":"2024-09-19T08:54:31.431418+0000","last_unstale":"2024-09-19T08:54:53.330986+0000","last_undegraded":"2024-09-19T08:54:53.330986+0000","last_fullsized":"2024-09-19T08:54:53.330986+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:45.347487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329298+0000","last_change":"2024-09-19T08:54:31.433742+0000","last_active":"2024-09-19T08:54:53.329298+0000","last_peered":"2024-09-19T08:54:53.329298+0000","last_clean":"2024-09-19T08:54:53.329298+0000","last_became_active":"2024-09-19T08:54:31.433455+0000","last_became_peered":"2024-09-19T08:54:31.433455+0000","last_unstale":"2024-09-19T08:54:53.329298+0000","last_undegraded":"2024-09-19T08:54:53.329298+0000","last_fullsized":"2024-09-19T08:54:53.329298+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:38.803705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330825+0000","last_change":"2024-09-19T08:54:31.432954+0000","last_active":"2024-09-19T08:54:53.330825+0000","last_peered":"2024-09-19T08:54:53.330825+0000","last_clean":"2024-09-19T08:54:53.330825+0000","last_became_active":"2024-09-19T08:54:31.432574+0000","last_became_peered":"2024-09-19T08:54:31.432574+0000","last_unstale":"2024-09-19T08:54:53.330825+0000","last_undegraded":"2024-09-19T08:54:53.330825+0000","last_fullsized":"2024-09-19T08:54:53.330825+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:30.457191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327933+0000","last_change":"2024-09-19T08:54:31.435544+0000","last_active":"2024-09-19T08:54:53.327933+0000","last_peered":"2024-09-19T08:54:53.327933+0000","last_clean":"2024-09-19T08:54:53.327933+0000","last_became_active":"2024-09-19T08:54:31.435195+0000","last_became_peered":"2024-09-19T08:54:31.435195+0000","last_unstale":"2024-09-19T08:54:53.327933+0000","last_undegraded":"2024-09-19T08:54:53.327933+0000","last_fullsized":"2024-09-19T08:54:53.327933+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:54.240654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327032+0000","last_change":"2024-09-19T08:54:31.428403+0000","last_active":"2024-09-19T08:54:53.327032+0000","last_peered":"2024-09-19T08:54:53.327032+0000","last_clean":"2024-09-19T08:54:53.327032+0000","last_became_active":"2024-09-19T08:54:31.428110+0000","last_became_peered":"2024-09-19T08:54:31.428110+0000","last_unstale":"2024-09-19T08:54:53.327032+0000","last_undegraded":"2024-09-19T08:54:53.327032+0000","last_fullsized":"2024-09-19T08:54:53.327032+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:05.593073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330562+0000","last_change":"2024-09-19T08:54:31.427291+0000","last_active":"2024-09-19T08:54:53.330562+0000","last_peered":"2024-09-19T08:54:53.330562+0000","last_clean":"2024-09-19T08:54:53.330562+0000","last_became_active":"2024-09-19T08:54:31.427011+0000","last_became_peered":"2024-09-19T08:54:31.427011+0000","last_unstale":"2024-09-19T08:54:53.330562+0000","last_undegraded":"2024-09-19T08:54:53.330562+0000","last_fullsized":"2024-09-19T08:54:53.330562+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:54.338526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329794+0000","last_change":"2024-09-19T08:54:31.429309+0000","last_active":"2024-09-19T08:54:53.329794+0000","last_peered":"2024-09-19T08:54:53.329794+0000","last_clean":"2024-09-19T08:54:53.329794+0000","last_became_active":"2024-09-19T08:54:31.428381+0000","last_became_peered":"2024-09-19T08:54:31.428381+0000","last_unstale":"2024-09-19T08:54:53.329794+0000","last_undegraded":"2024-09-19T08:54:53.329794+0000","last_fullsized":"2024-09-19T08:54:53.329794+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:22:33.920114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.336591+0000","last_change":"2024-09-19T08:54:53.336591+0000","last_active":"2024-09-19T08:54:53.336591+0000","last_peered":"2024-09-19T08:54:53.336591+0000","last_clean":"2024-09-19T08:54:53.336591+0000","last_became_active":"2024-09-19T08:54:53.336222+0000","last_became_peered":"2024-09-19T08:54:53.336222+0000","last_unstale":"2024-09-19T08:54:53.336591+0000","last_undegraded":"2024-09-19T08:54:53.336591+0000","last_fullsized":"2024-09-19T08:54:53.336591+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:59.019419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.335149+0000","last_change":"2024-09-19T08:54:53.335149+0000","last_active":"2024-09-19T08:54:53.335149+0000","last_peered":"2024-09-19T08:54:53.335149+0000","last_clean":"2024-09-19T08:54:53.335149+0000","last_became_active":"2024-09-19T08:54:53.334766+0000","last_became_peered":"2024-09-19T08:54:53.334766+0000","last_unstale":"2024-09-19T08:54:53.335149+0000","last_undegraded":"2024-09-19T08:54:53.335149+0000","last_fullsized":"2024-09-19T08:54:53.335149+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:36.469044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331864+0000","last_change":"2024-09-19T08:54:31.427608+0000","last_active":"2024-09-19T08:54:53.331864+0000","last_peered":"2024-09-19T08:54:53.331864+0000","last_clean":"2024-09-19T08:54:53.331864+0000","last_became_active":"2024-09-19T08:54:31.427294+0000","last_became_peered":"2024-09-19T08:54:31.427294+0000","last_unstale":"2024-09-19T08:54:53.331864+0000","last_undegraded":"2024-09-19T08:54:53.331864+0000","last_fullsized":"2024-09-19T08:54:53.331864+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:41.356609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331158+0000","last_change":"2024-09-19T08:54:29.416204+0000","last_active":"2024-09-19T08:54:53.331158+0000","last_peered":"2024-09-19T08:54:53.331158+0000","last_clean":"2024-09-19T08:54:53.331158+0000","last_became_active":"2024-09-19T08:54:29.415872+0000","last_became_peered":"2024-09-19T08:54:29.415872+0000","last_unstale":"2024-09-19T08:54:53.331158+0000","last_undegraded":"2024-09-19T08:54:53.331158+0000","last_fullsized":"2024-09-19T08:54:53.331158+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:13.844147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331049+0000","last_change":"2024-09-19T08:54:31.432137+0000","last_active":"2024-09-19T08:54:53.331049+0000","last_peered":"2024-09-19T08:54:53.331049+0000","last_clean":"2024-09-19T08:54:53.331049+0000","last_became_active":"2024-09-19T08:54:31.431761+0000","last_became_peered":"2024-09-19T08:54:31.431761+0000","last_unstale":"2024-09-19T08:54:53.331049+0000","last_undegraded":"2024-09-19T08:54:53.331049+0000","last_fullsized":"2024-09-19T08:54:53.331049+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:05.008431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327676+0000","last_change":"2024-09-19T08:54:29.413221+0000","last_active":"2024-09-19T08:54:53.327676+0000","last_peered":"2024-09-19T08:54:53.327676+0000","last_clean":"2024-09-19T08:54:53.327676+0000","last_became_active":"2024-09-19T08:54:29.412829+0000","last_became_peered":"2024-09-19T08:54:29.412829+0000","last_unstale":"2024-09-19T08:54:53.327676+0000","last_undegraded":"2024-09-19T08:54:53.327676+0000","last_fullsized":"2024-09-19T08:54:53.327676+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:07.224136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.326805+0000","last_change":"2024-09-19T08:54:29.410221+0000","last_active":"2024-09-19T08:54:53.326805+0000","last_peered":"2024-09-19T08:54:53.326805+0000","last_clean":"2024-09-19T08:54:53.326805+0000","last_became_active":"2024-09-19T08:54:29.409951+0000","last_became_peered":"2024-09-19T08:54:29.409951+0000","last_unstale":"2024-09-19T08:54:53.326805+0000","last_undegraded":"2024-09-19T08:54:53.326805+0000","last_fullsized":"2024-09-19T08:54:53.326805+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:58.350932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.328917+0000","last_change":"2024-09-19T08:54:31.429979+0000","last_active":"2024-09-19T08:54:53.328917+0000","last_peered":"2024-09-19T08:54:53.328917+0000","last_clean":"2024-09-19T08:54:53.328917+0000","last_became_active":"2024-09-19T08:54:31.429661+0000","last_became_peered":"2024-09-19T08:54:31.429661+0000","last_unstale":"2024-09-19T08:54:53.328917+0000","last_undegraded":"2024-09-19T08:54:53.328917+0000","last_fullsized":"2024-09-19T08:54:53.328917+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:27:40.603490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331299+0000","last_change":"2024-09-19T08:54:29.415769+0000","last_active":"2024-09-19T08:54:53.331299+0000","last_peered":"2024-09-19T08:54:53.331299+0000","last_clean":"2024-09-19T08:54:53.331299+0000","last_became_active":"2024-09-19T08:54:29.415245+0000","last_became_peered":"2024-09-19T08:54:29.415245+0000","last_unstale":"2024-09-19T08:54:53.331299+0000","last_undegraded":"2024-09-19T08:54:53.331299+0000","last_fullsized":"2024-09-19T08:54:53.331299+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:15.487945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330132+0000","last_change":"2024-09-19T08:54:31.427126+0000","last_active":"2024-09-19T08:54:53.330132+0000","last_peered":"2024-09-19T08:54:53.330132+0000","last_clean":"2024-09-19T08:54:53.330132+0000","last_became_active":"2024-09-19T08:54:31.426816+0000","last_became_peered":"2024-09-19T08:54:31.426816+0000","last_unstale":"2024-09-19T08:54:53.330132+0000","last_undegraded":"2024-09-19T08:54:53.330132+0000","last_fullsized":"2024-09-19T08:54:53.330132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:38.039428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327848+0000","last_change":"2024-09-19T08:54:29.411354+0000","last_active":"2024-09-19T08:54:53.327848+0000","last_peered":"2024-09-19T08:54:53.327848+0000","last_clean":"2024-09-19T08:54:53.327848+0000","last_became_active":"2024-09-19T08:54:29.410990+0000","last_became_peered":"2024-09-19T08:54:29.410990+0000","last_unstale":"2024-09-19T08:54:53.327848+0000","last_undegraded":"2024-09-19T08:54:53.327848+0000","last_fullsized":"2024-09-19T08:54:53.327848+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:29.338169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330234+0000","last_change":"2024-09-19T08:54:31.426243+0000","last_active":"2024-09-19T08:54:53.330234+0000","last_peered":"2024-09-19T08:54:53.330234+0000","last_clean":"2024-09-19T08:54:53.330234+0000","last_became_active":"2024-09-19T08:54:31.425895+0000","last_became_peered":"2024-09-19T08:54:31.425895+0000","last_unstale":"2024-09-19T08:54:53.330234+0000","last_undegraded":"2024-09-19T08:54:53.330234+0000","last_fullsized":"2024-09-19T08:54:53.330234+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:13.562780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331102+0000","last_change":"2024-09-19T08:54:29.416646+0000","last_active":"2024-09-19T08:54:53.331102+0000","last_peered":"2024-09-19T08:54:53.331102+0000","last_clean":"2024-09-19T08:54:53.331102+0000","last_became_active":"2024-09-19T08:54:29.416260+0000","last_became_peered":"2024-09-19T08:54:29.416260+0000","last_unstale":"2024-09-19T08:54:53.331102+0000","last_undegraded":"2024-09-19T08:54:53.331102+0000","last_fullsized":"2024-09-19T08:54:53.331102+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:42:17.467035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331394+0000","last_change":"2024-09-19T08:54:31.435538+0000","last_active":"2024-09-19T08:54:53.331394+0000","last_peered":"2024-09-19T08:54:53.331394+0000","last_clean":"2024-09-19T08:54:53.331394+0000","last_became_active":"2024-09-19T08:54:31.435185+0000","last_became_peered":"2024-09-19T08:54:31.435185+0000","last_unstale":"2024-09-19T08:54:53.331394+0000","last_undegraded":"2024-09-19T08:54:53.331394+0000","last_fullsized":"2024-09-19T08:54:53.331394+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:06.940123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.332501+0000","last_change":"2024-09-19T08:54:29.675914+0000","last_active":"2024-09-19T08:54:53.332501+0000","last_peered":"2024-09-19T08:54:53.332501+0000","last_clean":"2024-09-19T08:54:53.332501+0000","last_became_active":"2024-09-19T08:54:29.675482+0000","last_became_peered":"2024-09-19T08:54:29.675482+0000","last_unstale":"2024-09-19T08:54:53.332501+0000","last_undegraded":"2024-09-19T08:54:53.332501+0000","last_fullsized":"2024-09-19T08:54:53.332501+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:58.893008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330567+0000","last_change":"2024-09-19T08:54:31.432628+0000","last_active":"2024-09-19T08:54:53.330567+0000","last_peered":"2024-09-19T08:54:53.330567+0000","last_clean":"2024-09-19T08:54:53.330567+0000","last_became_active":"2024-09-19T08:54:31.430640+0000","last_became_peered":"2024-09-19T08:54:31.430640+0000","last_unstale":"2024-09-19T08:54:53.330567+0000","last_undegraded":"2024-09-19T08:54:53.330567+0000","last_fullsized":"2024-09-19T08:54:53.330567+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:07.793089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'24","reported_seq":89,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:56.519262+0000","last_change":"2024-09-19T08:54:29.414619+0000","last_active":"2024-09-19T08:54:56.519262+0000","last_peered":"2024-09-19T08:54:56.519262+0000","last_clean":"2024-09-19T08:54:56.519262+0000","last_became_active":"2024-09-19T08:54:29.414295+0000","last_became_peered":"2024-09-19T08:54:29.414295+0000","last_unstale":"2024-09-19T08:54:56.519262+0000","last_undegraded":"2024-09-19T08:54:56.519262+0000","last_fullsized":"2024-09-19T08:54:56.519262+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:23.782684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56942,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":43,"num_read_kb":76,"num_write":24,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331211+0000","last_change":"2024-09-19T08:54:31.425432+0000","last_active":"2024-09-19T08:54:53.331211+0000","last_peered":"2024-09-19T08:54:53.331211+0000","last_clean":"2024-09-19T08:54:53.331211+0000","last_became_active":"2024-09-19T08:54:31.425086+0000","last_became_peered":"2024-09-19T08:54:31.425086+0000","last_unstale":"2024-09-19T08:54:53.331211+0000","last_undegraded":"2024-09-19T08:54:53.331211+0000","last_fullsized":"2024-09-19T08:54:53.331211+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:56.572339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330371+0000","last_change":"2024-09-19T08:54:29.415055+0000","last_active":"2024-09-19T08:54:53.330371+0000","last_peered":"2024-09-19T08:54:53.330371+0000","last_clean":"2024-09-19T08:54:53.330371+0000","last_became_active":"2024-09-19T08:54:29.414573+0000","last_became_peered":"2024-09-19T08:54:29.414573+0000","last_unstale":"2024-09-19T08:54:53.330371+0000","last_undegraded":"2024-09-19T08:54:53.330371+0000","last_fullsized":"2024-09-19T08:54:53.330371+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:13.013714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.326883+0000","last_change":"2024-09-19T08:54:31.436905+0000","last_active":"2024-09-19T08:54:53.326883+0000","last_peered":"2024-09-19T08:54:53.326883+0000","last_clean":"2024-09-19T08:54:53.326883+0000","last_became_active":"2024-09-19T08:54:31.436571+0000","last_became_peered":"2024-09-19T08:54:31.436571+0000","last_unstale":"2024-09-19T08:54:53.326883+0000","last_undegraded":"2024-09-19T08:54:53.326883+0000","last_fullsized":"2024-09-19T08:54:53.326883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:55.294255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330834+0000","last_change":"2024-09-19T08:54:29.417958+0000","last_active":"2024-09-19T08:54:53.330834+0000","last_peered":"2024-09-19T08:54:53.330834+0000","last_clean":"2024-09-19T08:54:53.330834+0000","last_became_active":"2024-09-19T08:54:29.417570+0000","last_became_peered":"2024-09-19T08:54:29.417570+0000","last_unstale":"2024-09-19T08:54:53.330834+0000","last_undegraded":"2024-09-19T08:54:53.330834+0000","last_fullsized":"2024-09-19T08:54:53.330834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:25.557217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331274+0000","last_change":"2024-09-19T08:54:31.433019+0000","last_active":"2024-09-19T08:54:53.331274+0000","last_peered":"2024-09-19T08:54:53.331274+0000","last_clean":"2024-09-19T08:54:53.331274+0000","last_became_active":"2024-09-19T08:54:31.431265+0000","last_became_peered":"2024-09-19T08:54:31.431265+0000","last_unstale":"2024-09-19T08:54:53.331274+0000","last_undegraded":"2024-09-19T08:54:53.331274+0000","last_fullsized":"2024-09-19T08:54:53.331274+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:36.481863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.329875+0000","last_change":"2024-09-19T08:54:29.414236+0000","last_active":"2024-09-19T08:54:52.329875+0000","last_peered":"2024-09-19T08:54:52.329875+0000","last_clean":"2024-09-19T08:54:52.329875+0000","last_became_active":"2024-09-19T08:54:29.413878+0000","last_became_peered":"2024-09-19T08:54:29.413878+0000","last_unstale":"2024-09-19T08:54:52.329875+0000","last_undegraded":"2024-09-19T08:54:52.329875+0000","last_fullsized":"2024-09-19T08:54:52.329875+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:11.222362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330480+0000","last_change":"2024-09-19T08:54:31.439512+0000","last_active":"2024-09-19T08:54:53.330480+0000","last_peered":"2024-09-19T08:54:53.330480+0000","last_clean":"2024-09-19T08:54:53.330480+0000","last_became_active":"2024-09-19T08:54:31.438767+0000","last_became_peered":"2024-09-19T08:54:31.438767+0000","last_unstale":"2024-09-19T08:54:53.330480+0000","last_undegraded":"2024-09-19T08:54:53.330480+0000","last_fullsized":"2024-09-19T08:54:53.330480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:31.784577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330687+0000","last_change":"2024-09-19T08:54:29.675768+0000","last_active":"2024-09-19T08:54:53.330687+0000","last_peered":"2024-09-19T08:54:53.330687+0000","last_clean":"2024-09-19T08:54:53.330687+0000","last_became_active":"2024-09-19T08:54:29.675376+0000","last_became_peered":"2024-09-19T08:54:29.675376+0000","last_unstale":"2024-09-19T08:54:53.330687+0000","last_undegraded":"2024-09-19T08:54:53.330687+0000","last_fullsized":"2024-09-19T08:54:53.330687+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:10.281126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331714+0000","last_change":"2024-09-19T08:54:31.435904+0000","last_active":"2024-09-19T08:54:53.331714+0000","last_peered":"2024-09-19T08:54:53.331714+0000","last_clean":"2024-09-19T08:54:53.331714+0000","last_became_active":"2024-09-19T08:54:31.435396+0000","last_became_peered":"2024-09-19T08:54:31.435396+0000","last_unstale":"2024-09-19T08:54:53.331714+0000","last_undegraded":"2024-09-19T08:54:53.331714+0000","last_fullsized":"2024-09-19T08:54:53.331714+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:41.567463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331746+0000","last_change":"2024-09-19T08:54:29.410221+0000","last_active":"2024-09-19T08:54:53.331746+0000","last_peered":"2024-09-19T08:54:53.331746+0000","last_clean":"2024-09-19T08:54:53.331746+0000","last_became_active":"2024-09-19T08:54:29.409856+0000","last_became_peered":"2024-09-19T08:54:29.409856+0000","last_unstale":"2024-09-19T08:54:53.331746+0000","last_undegraded":"2024-09-19T08:54:53.331746+0000","last_fullsized":"2024-09-19T08:54:53.331746+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:46.095816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327914+0000","last_change":"2024-09-19T08:54:31.437854+0000","last_active":"2024-09-19T08:54:53.327914+0000","last_peered":"2024-09-19T08:54:53.327914+0000","last_clean":"2024-09-19T08:54:53.327914+0000","last_became_active":"2024-09-19T08:54:31.437491+0000","last_became_peered":"2024-09-19T08:54:31.437491+0000","last_unstale":"2024-09-19T08:54:53.327914+0000","last_undegraded":"2024-09-19T08:54:53.327914+0000","last_fullsized":"2024-09-19T08:54:53.327914+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:22.532429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.983440+0000","last_change":"2024-09-19T08:54:53.983440+0000","last_active":"2024-09-19T08:54:53.983440+0000","last_peered":"2024-09-19T08:54:53.983440+0000","last_clean":"2024-09-19T08:54:53.983440+0000","last_became_active":"2024-09-19T08:54:53.980971+0000","last_became_peered":"2024-09-19T08:54:53.980971+0000","last_unstale":"2024-09-19T08:54:53.983440+0000","last_undegraded":"2024-09-19T08:54:53.983440+0000","last_fullsized":"2024-09-19T08:54:53.983440+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:33.070904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330480+0000","last_change":"2024-09-19T08:54:31.429376+0000","last_active":"2024-09-19T08:54:53.330480+0000","last_peered":"2024-09-19T08:54:53.330480+0000","last_clean":"2024-09-19T08:54:53.330480+0000","last_became_active":"2024-09-19T08:54:31.429006+0000","last_became_peered":"2024-09-19T08:54:31.429006+0000","last_unstale":"2024-09-19T08:54:53.330480+0000","last_undegraded":"2024-09-19T08:54:53.330480+0000","last_fullsized":"2024-09-19T08:54:53.330480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:26.399838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.332608+0000","last_change":"2024-09-19T08:54:29.414307+0000","last_active":"2024-09-19T08:54:53.332608+0000","last_peered":"2024-09-19T08:54:53.332608+0000","last_clean":"2024-09-19T08:54:53.332608+0000","last_became_active":"2024-09-19T08:54:29.413823+0000","last_became_peered":"2024-09-19T08:54:29.413823+0000","last_unstale":"2024-09-19T08:54:53.332608+0000","last_undegraded":"2024-09-19T08:54:53.332608+0000","last_fullsized":"2024-09-19T08:54:53.332608+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:25.484645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330751+0000","last_change":"2024-09-19T08:54:31.437789+0000","last_active":"2024-09-19T08:54:53.330751+0000","last_peered":"2024-09-19T08:54:53.330751+0000","last_clean":"2024-09-19T08:54:53.330751+0000","last_became_active":"2024-09-19T08:54:31.435488+0000","last_became_peered":"2024-09-19T08:54:31.435488+0000","last_unstale":"2024-09-19T08:54:53.330751+0000","last_undegraded":"2024-09-19T08:54:53.330751+0000","last_fullsized":"2024-09-19T08:54:53.330751+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:19.332440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.333662+0000","last_change":"2024-09-19T08:54:53.333120+0000","last_active":"2024-09-19T08:54:53.333662+0000","last_peered":"2024-09-19T08:54:53.333662+0000","last_clean":"2024-09-19T08:54:53.333662+0000","last_became_active":"2024-09-19T08:54:53.332711+0000","last_became_peered":"2024-09-19T08:54:53.332711+0000","last_unstale":"2024-09-19T08:54:53.333662+0000","last_undegraded":"2024-09-19T08:54:53.333662+0000","last_fullsized":"2024-09-19T08:54:53.333662+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:18.359002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331140+0000","last_change":"2024-09-19T08:54:31.434564+0000","last_active":"2024-09-19T08:54:53.331140+0000","last_peered":"2024-09-19T08:54:53.331140+0000","last_clean":"2024-09-19T08:54:53.331140+0000","last_became_active":"2024-09-19T08:54:31.434231+0000","last_became_peered":"2024-09-19T08:54:31.434231+0000","last_unstale":"2024-09-19T08:54:53.331140+0000","last_undegraded":"2024-09-19T08:54:53.331140+0000","last_fullsized":"2024-09-19T08:54:53.331140+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:31.316400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":334,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331076+0000","last_change":"2024-09-19T08:53:21.357560+0000","last_active":"2024-09-19T08:54:53.331076+0000","last_peered":"2024-09-19T08:54:53.331076+0000","last_clean":"2024-09-19T08:54:53.331076+0000","last_became_active":"2024-09-19T08:53:21.357122+0000","last_became_peered":"2024-09-19T08:53:21.357122+0000","last_unstale":"2024-09-19T08:54:53.331076+0000","last_undegraded":"2024-09-19T08:54:53.331076+0000","last_fullsized":"2024-09-19T08:54:53.331076+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:05.231370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:05.231370+0000","last_clean_scrub_stamp":"2024-09-19T08:50:05.231370+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:47.867682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.330224+0000","last_change":"2024-09-19T08:54:29.412240+0000","last_active":"2024-09-19T08:54:52.330224+0000","last_peered":"2024-09-19T08:54:52.330224+0000","last_clean":"2024-09-19T08:54:52.330224+0000","last_became_active":"2024-09-19T08:54:29.411908+0000","last_became_peered":"2024-09-19T08:54:29.411908+0000","last_unstale":"2024-09-19T08:54:52.330224+0000","last_undegraded":"2024-09-19T08:54:52.330224+0000","last_fullsized":"2024-09-19T08:54:52.330224+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:37.189373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331122+0000","last_change":"2024-09-19T08:54:31.432956+0000","last_active":"2024-09-19T08:54:53.331122+0000","last_peered":"2024-09-19T08:54:53.331122+0000","last_clean":"2024-09-19T08:54:53.331122+0000","last_became_active":"2024-09-19T08:54:31.432639+0000","last_became_peered":"2024-09-19T08:54:31.432639+0000","last_unstale":"2024-09-19T08:54:53.331122+0000","last_undegraded":"2024-09-19T08:54:53.331122+0000","last_fullsized":"2024-09-19T08:54:53.331122+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:58.302624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331178+0000","last_change":"2024-09-19T08:54:29.414214+0000","last_active":"2024-09-19T08:54:53.331178+0000","last_peered":"2024-09-19T08:54:53.331178+0000","last_clean":"2024-09-19T08:54:53.331178+0000","last_became_active":"2024-09-19T08:54:29.413853+0000","last_became_peered":"2024-09-19T08:54:29.413853+0000","last_unstale":"2024-09-19T08:54:53.331178+0000","last_undegraded":"2024-09-19T08:54:53.331178+0000","last_fullsized":"2024-09-19T08:54:53.331178+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:28:29.119856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.326797+0000","last_change":"2024-09-19T08:54:31.424643+0000","last_active":"2024-09-19T08:54:53.326797+0000","last_peered":"2024-09-19T08:54:53.326797+0000","last_clean":"2024-09-19T08:54:53.326797+0000","last_became_active":"2024-09-19T08:54:31.424363+0000","last_became_peered":"2024-09-19T08:54:31.424363+0000","last_unstale":"2024-09-19T08:54:53.326797+0000","last_undegraded":"2024-09-19T08:54:53.326797+0000","last_fullsized":"2024-09-19T08:54:53.326797+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:37.529952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.326916+0000","last_change":"2024-09-19T08:54:29.675742+0000","last_active":"2024-09-19T08:54:53.326916+0000","last_peered":"2024-09-19T08:54:53.326916+0000","last_clean":"2024-09-19T08:54:53.326916+0000","last_became_active":"2024-09-19T08:54:29.675347+0000","last_became_peered":"2024-09-19T08:54:29.675347+0000","last_unstale":"2024-09-19T08:54:53.326916+0000","last_undegraded":"2024-09-19T08:54:53.326916+0000","last_fullsized":"2024-09-19T08:54:53.326916+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:00.925390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331104+0000","last_change":"2024-09-19T08:54:31.433887+0000","last_active":"2024-09-19T08:54:53.331104+0000","last_peered":"2024-09-19T08:54:53.331104+0000","last_clean":"2024-09-19T08:54:53.331104+0000","last_became_active":"2024-09-19T08:54:31.433331+0000","last_became_peered":"2024-09-19T08:54:31.433331+0000","last_unstale":"2024-09-19T08:54:53.331104+0000","last_undegraded":"2024-09-19T08:54:53.331104+0000","last_fullsized":"2024-09-19T08:54:53.331104+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:49.875061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331491+0000","last_change":"2024-09-19T08:54:29.417410+0000","last_active":"2024-09-19T08:54:53.331491+0000","last_peered":"2024-09-19T08:54:53.331491+0000","last_clean":"2024-09-19T08:54:53.331491+0000","last_became_active":"2024-09-19T08:54:29.417018+0000","last_became_peered":"2024-09-19T08:54:29.417018+0000","last_unstale":"2024-09-19T08:54:53.331491+0000","last_undegraded":"2024-09-19T08:54:53.331491+0000","last_fullsized":"2024-09-19T08:54:53.331491+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:53.669027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327692+0000","last_change":"2024-09-19T08:54:31.431313+0000","last_active":"2024-09-19T08:54:53.327692+0000","last_peered":"2024-09-19T08:54:53.327692+0000","last_clean":"2024-09-19T08:54:53.327692+0000","last_became_active":"2024-09-19T08:54:31.429427+0000","last_became_peered":"2024-09-19T08:54:31.429427+0000","last_unstale":"2024-09-19T08:54:53.327692+0000","last_undegraded":"2024-09-19T08:54:53.327692+0000","last_fullsized":"2024-09-19T08:54:53.327692+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:55.106769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330517+0000","last_change":"2024-09-19T08:54:29.675722+0000","last_active":"2024-09-19T08:54:53.330517+0000","last_peered":"2024-09-19T08:54:53.330517+0000","last_clean":"2024-09-19T08:54:53.330517+0000","last_became_active":"2024-09-19T08:54:29.675397+0000","last_became_peered":"2024-09-19T08:54:29.675397+0000","last_unstale":"2024-09-19T08:54:53.330517+0000","last_undegraded":"2024-09-19T08:54:53.330517+0000","last_fullsized":"2024-09-19T08:54:53.330517+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:49.574947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327665+0000","last_change":"2024-09-19T08:54:31.431106+0000","last_active":"2024-09-19T08:54:53.327665+0000","last_peered":"2024-09-19T08:54:53.327665+0000","last_clean":"2024-09-19T08:54:53.327665+0000","last_became_active":"2024-09-19T08:54:31.430745+0000","last_became_peered":"2024-09-19T08:54:31.430745+0000","last_unstale":"2024-09-19T08:54:53.327665+0000","last_undegraded":"2024-09-19T08:54:53.327665+0000","last_fullsized":"2024-09-19T08:54:53.327665+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:22.714106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331431+0000","last_change":"2024-09-19T08:54:29.675985+0000","last_active":"2024-09-19T08:54:53.331431+0000","last_peered":"2024-09-19T08:54:53.331431+0000","last_clean":"2024-09-19T08:54:53.331431+0000","last_became_active":"2024-09-19T08:54:29.675374+0000","last_became_peered":"2024-09-19T08:54:29.675374+0000","last_unstale":"2024-09-19T08:54:53.331431+0000","last_undegraded":"2024-09-19T08:54:53.331431+0000","last_fullsized":"2024-09-19T08:54:53.331431+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:06.664621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327052+0000","last_change":"2024-09-19T08:54:31.423493+0000","last_active":"2024-09-19T08:54:53.327052+0000","last_peered":"2024-09-19T08:54:53.327052+0000","last_clean":"2024-09-19T08:54:53.327052+0000","last_became_active":"2024-09-19T08:54:31.422651+0000","last_became_peered":"2024-09-19T08:54:31.422651+0000","last_unstale":"2024-09-19T08:54:53.327052+0000","last_undegraded":"2024-09-19T08:54:53.327052+0000","last_fullsized":"2024-09-19T08:54:53.327052+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:51.863965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330742+0000","last_change":"2024-09-19T08:54:29.408571+0000","last_active":"2024-09-19T08:54:53.330742+0000","last_peered":"2024-09-19T08:54:53.330742+0000","last_clean":"2024-09-19T08:54:53.330742+0000","last_became_active":"2024-09-19T08:54:29.408142+0000","last_became_peered":"2024-09-19T08:54:29.408142+0000","last_unstale":"2024-09-19T08:54:53.330742+0000","last_undegraded":"2024-09-19T08:54:53.330742+0000","last_fullsized":"2024-09-19T08:54:53.330742+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:34.578230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329321+0000","last_change":"2024-09-19T08:54:31.435333+0000","last_active":"2024-09-19T08:54:53.329321+0000","last_peered":"2024-09-19T08:54:53.329321+0000","last_clean":"2024-09-19T08:54:53.329321+0000","last_became_active":"2024-09-19T08:54:31.435041+0000","last_became_peered":"2024-09-19T08:54:31.435041+0000","last_unstale":"2024-09-19T08:54:53.329321+0000","last_undegraded":"2024-09-19T08:54:53.329321+0000","last_fullsized":"2024-09-19T08:54:53.329321+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:40.972638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'2","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T08:54:52.329561+0000","last_change":"2024-09-19T08:54:29.554303+0000","last_active":"2024-09-19T08:54:52.329561+0000","last_peered":"2024-09-19T08:54:52.329561+0000","last_clean":"2024-09-19T08:54:52.329561+0000","last_became_active":"2024-09-19T08:54:29.553919+0000","last_became_peered":"2024-09-19T08:54:29.553919+0000","last_unstale":"2024-09-19T08:54:52.329561+0000","last_undegraded":"2024-09-19T08:54:52.329561+0000","last_fullsized":"2024-09-19T08:54:52.329561+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:25.103926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.333280+0000","last_change":"2024-09-19T08:54:53.333280+0000","last_active":"2024-09-19T08:54:53.333280+0000","last_peered":"2024-09-19T08:54:53.333280+0000","last_clean":"2024-09-19T08:54:53.333280+0000","last_became_active":"2024-09-19T08:54:53.332881+0000","last_became_peered":"2024-09-19T08:54:53.332881+0000","last_unstale":"2024-09-19T08:54:53.333280+0000","last_undegraded":"2024-09-19T08:54:53.333280+0000","last_fullsized":"2024-09-19T08:54:53.333280+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:55.880616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329946+0000","last_change":"2024-09-19T08:54:29.675665+0000","last_active":"2024-09-19T08:54:53.329946+0000","last_peered":"2024-09-19T08:54:53.329946+0000","last_clean":"2024-09-19T08:54:53.329946+0000","last_became_active":"2024-09-19T08:54:29.675367+0000","last_became_peered":"2024-09-19T08:54:29.675367+0000","last_unstale":"2024-09-19T08:54:53.329946+0000","last_undegraded":"2024-09-19T08:54:53.329946+0000","last_fullsized":"2024-09-19T08:54:53.329946+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:35.473243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330857+0000","last_change":"2024-09-19T08:54:31.430837+0000","last_active":"2024-09-19T08:54:53.330857+0000","last_peered":"2024-09-19T08:54:53.330857+0000","last_clean":"2024-09-19T08:54:53.330857+0000","last_became_active":"2024-09-19T08:54:31.430465+0000","last_became_peered":"2024-09-19T08:54:31.430465+0000","last_unstale":"2024-09-19T08:54:53.330857+0000","last_undegraded":"2024-09-19T08:54:53.330857+0000","last_fullsized":"2024-09-19T08:54:53.330857+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:50.524730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329067+0000","last_change":"2024-09-19T08:54:29.413803+0000","last_active":"2024-09-19T08:54:53.329067+0000","last_peered":"2024-09-19T08:54:53.329067+0000","last_clean":"2024-09-19T08:54:53.329067+0000","last_became_active":"2024-09-19T08:54:29.413400+0000","last_became_peered":"2024-09-19T08:54:29.413400+0000","last_unstale":"2024-09-19T08:54:53.329067+0000","last_undegraded":"2024-09-19T08:54:53.329067+0000","last_fullsized":"2024-09-19T08:54:53.329067+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:12.518454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327694+0000","last_change":"2024-09-19T08:54:31.428451+0000","last_active":"2024-09-19T08:54:53.327694+0000","last_peered":"2024-09-19T08:54:53.327694+0000","last_clean":"2024-09-19T08:54:53.327694+0000","last_became_active":"2024-09-19T08:54:31.428134+0000","last_became_peered":"2024-09-19T08:54:31.428134+0000","last_unstale":"2024-09-19T08:54:53.327694+0000","last_undegraded":"2024-09-19T08:54:53.327694+0000","last_fullsized":"2024-09-19T08:54:53.327694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:08.260183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329914+0000","last_change":"2024-09-19T08:54:29.414399+0000","last_active":"2024-09-19T08:54:53.329914+0000","last_peered":"2024-09-19T08:54:53.329914+0000","last_clean":"2024-09-19T08:54:53.329914+0000","last_became_active":"2024-09-19T08:54:29.413080+0000","last_became_peered":"2024-09-19T08:54:29.413080+0000","last_unstale":"2024-09-19T08:54:53.329914+0000","last_undegraded":"2024-09-19T08:54:53.329914+0000","last_fullsized":"2024-09-19T08:54:53.329914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:27.308297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329046+0000","last_change":"2024-09-19T08:54:31.434550+0000","last_active":"2024-09-19T08:54:53.329046+0000","last_peered":"2024-09-19T08:54:53.329046+0000","last_clean":"2024-09-19T08:54:53.329046+0000","last_became_active":"2024-09-19T08:54:31.434195+0000","last_became_peered":"2024-09-19T08:54:31.434195+0000","last_unstale":"2024-09-19T08:54:53.329046+0000","last_undegraded":"2024-09-19T08:54:53.329046+0000","last_fullsized":"2024-09-19T08:54:53.329046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:04.807833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.338857+0000","last_change":"2024-09-19T08:54:53.338857+0000","last_active":"2024-09-19T08:54:53.338857+0000","last_peered":"2024-09-19T08:54:53.338857+0000","last_clean":"2024-09-19T08:54:53.338857+0000","last_became_active":"2024-09-19T08:54:53.334162+0000","last_became_peered":"2024-09-19T08:54:53.334162+0000","last_unstale":"2024-09-19T08:54:53.338857+0000","last_undegraded":"2024-09-19T08:54:53.338857+0000","last_fullsized":"2024-09-19T08:54:53.338857+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:38.858918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331391+0000","last_change":"2024-09-19T08:54:31.441201+0000","last_active":"2024-09-19T08:54:53.331391+0000","last_peered":"2024-09-19T08:54:53.331391+0000","last_clean":"2024-09-19T08:54:53.331391+0000","last_became_active":"2024-09-19T08:54:31.440738+0000","last_became_peered":"2024-09-19T08:54:31.440738+0000","last_unstale":"2024-09-19T08:54:53.331391+0000","last_undegraded":"2024-09-19T08:54:53.331391+0000","last_fullsized":"2024-09-19T08:54:53.331391+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:39.118320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.332389+0000","last_change":"2024-09-19T08:54:31.435772+0000","last_active":"2024-09-19T08:54:53.332389+0000","last_peered":"2024-09-19T08:54:53.332389+0000","last_clean":"2024-09-19T08:54:53.332389+0000","last_became_active":"2024-09-19T08:54:31.435257+0000","last_became_peered":"2024-09-19T08:54:31.435257+0000","last_unstale":"2024-09-19T08:54:53.332389+0000","last_undegraded":"2024-09-19T08:54:53.332389+0000","last_fullsized":"2024-09-19T08:54:53.332389+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:44:12.219054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.341203+0000","last_change":"2024-09-19T08:54:53.341203+0000","last_active":"2024-09-19T08:54:53.341203+0000","last_peered":"2024-09-19T08:54:53.341203+0000","last_clean":"2024-09-19T08:54:53.341203+0000","last_became_active":"2024-09-19T08:54:53.336115+0000","last_became_peered":"2024-09-19T08:54:53.336115+0000","last_unstale":"2024-09-19T08:54:53.341203+0000","last_undegraded":"2024-09-19T08:54:53.341203+0000","last_fullsized":"2024-09-19T08:54:53.341203+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:31.532599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330452+0000","last_change":"2024-09-19T08:54:31.427103+0000","last_active":"2024-09-19T08:54:53.330452+0000","last_peered":"2024-09-19T08:54:53.330452+0000","last_clean":"2024-09-19T08:54:53.330452+0000","last_became_active":"2024-09-19T08:54:31.425958+0000","last_became_peered":"2024-09-19T08:54:31.425958+0000","last_unstale":"2024-09-19T08:54:53.330452+0000","last_undegraded":"2024-09-19T08:54:53.330452+0000","last_fullsized":"2024-09-19T08:54:53.330452+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:36.840940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331317+0000","last_change":"2024-09-19T08:54:29.415209+0000","last_active":"2024-09-19T08:54:53.331317+0000","last_peered":"2024-09-19T08:54:53.331317+0000","last_clean":"2024-09-19T08:54:53.331317+0000","last_became_active":"2024-09-19T08:54:29.414806+0000","last_became_peered":"2024-09-19T08:54:29.414806+0000","last_unstale":"2024-09-19T08:54:53.331317+0000","last_undegraded":"2024-09-19T08:54:53.331317+0000","last_fullsized":"2024-09-19T08:54:53.331317+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:47.764231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331348+0000","last_change":"2024-09-19T08:54:31.434027+0000","last_active":"2024-09-19T08:54:53.331348+0000","last_peered":"2024-09-19T08:54:53.331348+0000","last_clean":"2024-09-19T08:54:53.331348+0000","last_became_active":"2024-09-19T08:54:31.433687+0000","last_became_peered":"2024-09-19T08:54:31.433687+0000","last_unstale":"2024-09-19T08:54:53.331348+0000","last_undegraded":"2024-09-19T08:54:53.331348+0000","last_fullsized":"2024-09-19T08:54:53.331348+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:56.462128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329231+0000","last_change":"2024-09-19T08:54:29.675502+0000","last_active":"2024-09-19T08:54:53.329231+0000","last_peered":"2024-09-19T08:54:53.329231+0000","last_clean":"2024-09-19T08:54:53.329231+0000","last_became_active":"2024-09-19T08:54:29.675158+0000","last_became_peered":"2024-09-19T08:54:29.675158+0000","last_unstale":"2024-09-19T08:54:53.329231+0000","last_undegraded":"2024-09-19T08:54:53.329231+0000","last_fullsized":"2024-09-19T08:54:53.329231+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:24:59.377521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.334600+0000","last_change":"2024-09-19T08:54:53.334264+0000","last_active":"2024-09-19T08:54:53.334600+0000","last_peered":"2024-09-19T08:54:53.334600+0000","last_clean":"2024-09-19T08:54:53.334600+0000","last_became_active":"2024-09-19T08:54:53.333959+0000","last_became_peered":"2024-09-19T08:54:53.333959+0000","last_unstale":"2024-09-19T08:54:53.334600+0000","last_undegraded":"2024-09-19T08:54:53.334600+0000","last_fullsized":"2024-09-19T08:54:53.334600+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:14.085033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330562+0000","last_change":"2024-09-19T08:54:29.414478+0000","last_active":"2024-09-19T08:54:53.330562+0000","last_peered":"2024-09-19T08:54:53.330562+0000","last_clean":"2024-09-19T08:54:53.330562+0000","last_became_active":"2024-09-19T08:54:29.414152+0000","last_became_peered":"2024-09-19T08:54:29.414152+0000","last_unstale":"2024-09-19T08:54:53.330562+0000","last_undegraded":"2024-09-19T08:54:53.330562+0000","last_fullsized":"2024-09-19T08:54:53.330562+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:17.477340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":57740,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":47,"num_read_kb":80,"num_write":77,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":173220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579922,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":897024,"data_stored":435723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841558,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28568,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716584,"statfs":{"total":95995035648,"available":95965782016,"internally_reserved":0,"allocated":1572864,"data_stored":1083344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005083,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":901120,"data_stored":436305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234015,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":888832,"data_stored":427839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462949,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28496,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716656,"statfs":{"total":95995035648,"available":95965855744,"internally_reserved":0,"allocated":1499136,"data_stored":1026790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593770,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":901120,"data_stored":435840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822703,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32660,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712492,"statfs":{"total":95995035648,"available":95961591808,"internally_reserved":0,"allocated":1507328,"data_stored":1026390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986227,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":884736,"data_stored":427257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215159,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":897024,"data_stored":427573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411389,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":966656,"data_stored":492699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":937984,"data_stored":474037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738438,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":901120,"data_stored":435813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":56942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":56976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":57136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:55:01.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:01 smithi190 ceph-mon[35358]: from='client.14781 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:55:01.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:01 smithi190 ceph-mon[35358]: pgmap v286: 97 pgs: 97 active+clean; 633 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 5.0 KiB/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T08:55:01.652 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:01 smithi167 ceph-mon[35359]: from='client.14781 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:55:01.653 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:01 smithi167 ceph-mon[35359]: pgmap v286: 97 pgs: 97 active+clean; 633 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 5.0 KiB/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T08:55:01.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:01 smithi092 ceph-mon[31407]: from='client.14781 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:55:01.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:01 smithi092 ceph-mon[31407]: pgmap v286: 97 pgs: 97 active+clean; 633 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 5.0 KiB/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T08:55:03.586 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:55:03.614 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:03 smithi092 ceph-mon[31407]: pgmap v287: 97 pgs: 97 active+clean; 633 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 1.3 KiB/s wr, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T08:55:03.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:03 smithi190 ceph-mon[35358]: pgmap v287: 97 pgs: 97 active+clean; 633 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 1.3 KiB/s wr, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T08:55:03.844 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:03.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:03 smithi167 ceph-mon[35359]: pgmap v287: 97 pgs: 97 active+clean; 633 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 1.3 KiB/s wr, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T08:55:04.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.273+0000 7f7eb78bc640 1 -- 172.21.15.92:0/3785071716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7eb0101de0 msgr2=0x7f7eb01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:04.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.273+0000 7f7eb78bc640 1 --2- 172.21.15.92:0/3785071716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7eb0101de0 0x7f7eb01021c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0009900 tx=0x7f7ea002a410 comp rx=0 tx=0).stop 2024-09-19T08:55:04.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.273+0000 7f7eb78bc640 1 -- 172.21.15.92:0/3785071716 shutdown_connections 2024-09-19T08:55:04.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.273+0000 7f7eb78bc640 1 --2- 172.21.15.92:0/3785071716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7eb0106f10 0x7f7eb010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:04.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.273+0000 7f7eb78bc640 1 --2- 172.21.15.92:0/3785071716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7eb0102790 0x7f7eb01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:04.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.273+0000 7f7eb78bc640 1 --2- 172.21.15.92:0/3785071716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7eb0101de0 0x7f7eb01021c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:04.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.273+0000 7f7eb78bc640 1 -- 172.21.15.92:0/3785071716 >> 172.21.15.92:0/3785071716 conn(0x7f7eb00fd8c0 msgr2=0x7f7eb00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:04.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.273+0000 7f7eb78bc640 1 -- 172.21.15.92:0/3785071716 shutdown_connections 2024-09-19T08:55:04.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.273+0000 7f7eb78bc640 1 -- 172.21.15.92:0/3785071716 wait complete. 2024-09-19T08:55:04.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.274+0000 7f7eb78bc640 1 Processor -- start 2024-09-19T08:55:04.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.274+0000 7f7eb78bc640 1 -- start start 2024-09-19T08:55:04.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.274+0000 7f7eb78bc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7eb0101de0 0x7f7eb00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:04.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.274+0000 7f7eb78bc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7eb0102790 0x7f7eb0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:04.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.274+0000 7f7eb78bc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7eb0106f10 0x7f7eb0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:04.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.274+0000 7f7eb78bc640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb0112010 con 0x7f7eb0102790 2024-09-19T08:55:04.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.274+0000 7f7eb78bc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb0111e90 con 0x7f7eb0106f10 2024-09-19T08:55:04.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.274+0000 7f7eb78bc640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb0112190 con 0x7f7eb0101de0 2024-09-19T08:55:04.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.274+0000 7f7eb4e57640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7eb0102790 0x7f7eb0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:04.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.274+0000 7f7eb4e57640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7eb0102790 0x7f7eb0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47240/0 (socket says 172.21.15.92:47240) 2024-09-19T08:55:04.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.274+0000 7f7eb4e57640 1 -- 172.21.15.92:0/2502693497 learned_addr learned my addr 172.21.15.92:0/2502693497 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:04.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.275+0000 7f7eb4e57640 1 -- 172.21.15.92:0/2502693497 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7eb0101de0 msgr2=0x7f7eb00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:04.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.275+0000 7f7eb4e57640 1 --2- 172.21.15.92:0/2502693497 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7eb0101de0 0x7f7eb00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:04.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.275+0000 7f7eb5e59640 1 --2- 172.21.15.92:0/2502693497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7eb0106f10 0x7f7eb0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:04.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.275+0000 7f7eb4e57640 1 -- 172.21.15.92:0/2502693497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7eb0106f10 msgr2=0x7f7eb0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:04.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.275+0000 7f7eb4e57640 1 --2- 172.21.15.92:0/2502693497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7eb0106f10 0x7f7eb0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:04.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.275+0000 7f7eb4e57640 1 -- 172.21.15.92:0/2502693497 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eb01a6a70 con 0x7f7eb0102790 2024-09-19T08:55:04.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.275+0000 7f7eb5e59640 1 --2- 172.21.15.92:0/2502693497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7eb0106f10 0x7f7eb0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:55:04.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.275+0000 7f7eb4e57640 1 --2- 172.21.15.92:0/2502693497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7eb0102790 0x7f7eb0074a30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7eac00b4a0 tx=0x7f7eac00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:04.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.275+0000 7f7ea67fc640 1 -- 172.21.15.92:0/2502693497 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eac014070 con 0x7f7eb0102790 2024-09-19T08:55:04.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.275+0000 7f7ea67fc640 1 -- 172.21.15.92:0/2502693497 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7eac010af0 con 0x7f7eb0102790 2024-09-19T08:55:04.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.275+0000 7f7eb78bc640 1 -- 172.21.15.92:0/2502693497 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7eb01a6d60 con 0x7f7eb0102790 2024-09-19T08:55:04.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.275+0000 7f7ea67fc640 1 -- 172.21.15.92:0/2502693497 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eac017d10 con 0x7f7eb0102790 2024-09-19T08:55:04.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.275+0000 7f7eb78bc640 1 -- 172.21.15.92:0/2502693497 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7eb01a7240 con 0x7f7eb0102790 2024-09-19T08:55:04.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.276+0000 7f7eb78bc640 1 -- 172.21.15.92:0/2502693497 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7eb0102240 con 0x7f7eb0102790 2024-09-19T08:55:04.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.277+0000 7f7ea67fc640 1 -- 172.21.15.92:0/2502693497 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7eac017070 con 0x7f7eb0102790 2024-09-19T08:55:04.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.278+0000 7f7ea67fc640 1 --2- 172.21.15.92:0/2502693497 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7e9c0a32d0 0x7f7e9c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:04.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.278+0000 7f7eb5658640 1 --2- 172.21.15.92:0/2502693497 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7e9c0a32d0 0x7f7e9c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:04.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.278+0000 7f7ea67fc640 1 -- 172.21.15.92:0/2502693497 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f7eac0cf1a0 con 0x7f7eb0102790 2024-09-19T08:55:04.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.278+0000 7f7eb5658640 1 --2- 172.21.15.92:0/2502693497 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7e9c0a32d0 0x7f7e9c0a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7ea002a930 tx=0x7f7ea0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:04.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.281+0000 7f7ea67fc640 1 -- 172.21.15.92:0/2502693497 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7eac09be70 con 0x7f7eb0102790 2024-09-19T08:55:04.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.447+0000 7f7eb78bc640 1 -- 172.21.15.92:0/2502693497 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7eb0062630 con 0x7f7e9c0a32d0 2024-09-19T08:55:04.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.453+0000 7f7ea67fc640 1 -- 172.21.15.92:0/2502693497 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258643 (secure 0 0 0) 0x7f7eb0062630 con 0x7f7e9c0a32d0 2024-09-19T08:55:04.455 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:55:04.456 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-19T08:55:04.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.456+0000 7f7eb78bc640 1 -- 172.21.15.92:0/2502693497 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7e9c0a32d0 msgr2=0x7f7e9c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:04.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.456+0000 7f7eb78bc640 1 --2- 172.21.15.92:0/2502693497 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7e9c0a32d0 0x7f7e9c0a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7ea002a930 tx=0x7f7ea0000bc0 comp rx=0 tx=0).stop 2024-09-19T08:55:04.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.456+0000 7f7eb78bc640 1 -- 172.21.15.92:0/2502693497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7eb0102790 msgr2=0x7f7eb0074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:04.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.456+0000 7f7eb78bc640 1 --2- 172.21.15.92:0/2502693497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7eb0102790 0x7f7eb0074a30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7eac00b4a0 tx=0x7f7eac00b960 comp rx=0 tx=0).stop 2024-09-19T08:55:04.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.456+0000 7f7eb78bc640 1 -- 172.21.15.92:0/2502693497 shutdown_connections 2024-09-19T08:55:04.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.456+0000 7f7eb78bc640 1 --2- 172.21.15.92:0/2502693497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7eb0106f10 0x7f7eb0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:04.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.456+0000 7f7eb78bc640 1 --2- 172.21.15.92:0/2502693497 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7e9c0a32d0 0x7f7e9c0a5790 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:04.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.456+0000 7f7eb78bc640 1 --2- 172.21.15.92:0/2502693497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7eb0102790 0x7f7eb0074a30 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:04.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.456+0000 7f7eb78bc640 1 --2- 172.21.15.92:0/2502693497 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7eb0101de0 0x7f7eb00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:04.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.456+0000 7f7eb78bc640 1 -- 172.21.15.92:0/2502693497 >> 172.21.15.92:0/2502693497 conn(0x7f7eb00fd8c0 msgr2=0x7f7eb00fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:04.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.456+0000 7f7eb78bc640 1 -- 172.21.15.92:0/2502693497 shutdown_connections 2024-09-19T08:55:04.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:04.456+0000 7f7eb78bc640 1 -- 172.21.15.92:0/2502693497 wait complete. 2024-09-19T08:55:05.241 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":288,"stamp":"2024-09-19T08:55:04.262233+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":652599,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":184,"num_read_kb":199,"num_write":263,"num_write_kb":3024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365992,"kb_used_data":12540,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575832,"statfs":{"total":1151940427776,"available":1151565651968,"internally_reserved":0,"allocated":12840960,"data_stored":7186473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14397,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":-2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":25,"num_write":15,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.936423"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.328272+0000","last_change":"2024-09-19T08:54:31.437743+0000","last_active":"2024-09-19T08:54:53.328272+0000","last_peered":"2024-09-19T08:54:53.328272+0000","last_clean":"2024-09-19T08:54:53.328272+0000","last_became_active":"2024-09-19T08:54:31.437426+0000","last_became_peered":"2024-09-19T08:54:31.437426+0000","last_unstale":"2024-09-19T08:54:53.328272+0000","last_undegraded":"2024-09-19T08:54:53.328272+0000","last_fullsized":"2024-09-19T08:54:53.328272+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:04.403522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330184+0000","last_change":"2024-09-19T08:54:31.430322+0000","last_active":"2024-09-19T08:54:53.330184+0000","last_peered":"2024-09-19T08:54:53.330184+0000","last_clean":"2024-09-19T08:54:53.330184+0000","last_became_active":"2024-09-19T08:54:31.430008+0000","last_became_peered":"2024-09-19T08:54:31.430008+0000","last_unstale":"2024-09-19T08:54:53.330184+0000","last_undegraded":"2024-09-19T08:54:53.330184+0000","last_fullsized":"2024-09-19T08:54:53.330184+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:19.800686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331041+0000","last_change":"2024-09-19T08:54:31.430276+0000","last_active":"2024-09-19T08:54:53.331041+0000","last_peered":"2024-09-19T08:54:53.331041+0000","last_clean":"2024-09-19T08:54:53.331041+0000","last_became_active":"2024-09-19T08:54:31.429939+0000","last_became_peered":"2024-09-19T08:54:31.429939+0000","last_unstale":"2024-09-19T08:54:53.331041+0000","last_undegraded":"2024-09-19T08:54:53.331041+0000","last_fullsized":"2024-09-19T08:54:53.331041+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:08.735067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.980198+0000","last_change":"2024-09-19T08:54:31.435197+0000","last_active":"2024-09-19T08:54:53.980198+0000","last_peered":"2024-09-19T08:54:53.980198+0000","last_clean":"2024-09-19T08:54:53.980198+0000","last_became_active":"2024-09-19T08:54:31.434872+0000","last_became_peered":"2024-09-19T08:54:31.434872+0000","last_unstale":"2024-09-19T08:54:53.980198+0000","last_undegraded":"2024-09-19T08:54:53.980198+0000","last_fullsized":"2024-09-19T08:54:53.980198+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:06.213317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330478+0000","last_change":"2024-09-19T08:54:31.423765+0000","last_active":"2024-09-19T08:54:53.330478+0000","last_peered":"2024-09-19T08:54:53.330478+0000","last_clean":"2024-09-19T08:54:53.330478+0000","last_became_active":"2024-09-19T08:54:31.423296+0000","last_became_peered":"2024-09-19T08:54:31.423296+0000","last_unstale":"2024-09-19T08:54:53.330478+0000","last_undegraded":"2024-09-19T08:54:53.330478+0000","last_fullsized":"2024-09-19T08:54:53.330478+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:07.507168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327935+0000","last_change":"2024-09-19T08:54:31.430299+0000","last_active":"2024-09-19T08:54:53.327935+0000","last_peered":"2024-09-19T08:54:53.327935+0000","last_clean":"2024-09-19T08:54:53.327935+0000","last_became_active":"2024-09-19T08:54:31.429951+0000","last_became_peered":"2024-09-19T08:54:31.429951+0000","last_unstale":"2024-09-19T08:54:53.327935+0000","last_undegraded":"2024-09-19T08:54:53.327935+0000","last_fullsized":"2024-09-19T08:54:53.327935+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:11.299729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330534+0000","last_change":"2024-09-19T08:54:31.435854+0000","last_active":"2024-09-19T08:54:53.330534+0000","last_peered":"2024-09-19T08:54:53.330534+0000","last_clean":"2024-09-19T08:54:53.330534+0000","last_became_active":"2024-09-19T08:54:31.435522+0000","last_became_peered":"2024-09-19T08:54:31.435522+0000","last_unstale":"2024-09-19T08:54:53.330534+0000","last_undegraded":"2024-09-19T08:54:53.330534+0000","last_fullsized":"2024-09-19T08:54:53.330534+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:11.099750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.328883+0000","last_change":"2024-09-19T08:54:31.434574+0000","last_active":"2024-09-19T08:54:53.328883+0000","last_peered":"2024-09-19T08:54:53.328883+0000","last_clean":"2024-09-19T08:54:53.328883+0000","last_became_active":"2024-09-19T08:54:31.434268+0000","last_became_peered":"2024-09-19T08:54:31.434268+0000","last_unstale":"2024-09-19T08:54:53.328883+0000","last_undegraded":"2024-09-19T08:54:53.328883+0000","last_fullsized":"2024-09-19T08:54:53.328883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:29.159417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330517+0000","last_change":"2024-09-19T08:54:31.430446+0000","last_active":"2024-09-19T08:54:53.330517+0000","last_peered":"2024-09-19T08:54:53.330517+0000","last_clean":"2024-09-19T08:54:53.330517+0000","last_became_active":"2024-09-19T08:54:31.430048+0000","last_became_peered":"2024-09-19T08:54:31.430048+0000","last_unstale":"2024-09-19T08:54:53.330517+0000","last_undegraded":"2024-09-19T08:54:53.330517+0000","last_fullsized":"2024-09-19T08:54:53.330517+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:24.773947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.328011+0000","last_change":"2024-09-19T08:54:31.433144+0000","last_active":"2024-09-19T08:54:53.328011+0000","last_peered":"2024-09-19T08:54:53.328011+0000","last_clean":"2024-09-19T08:54:53.328011+0000","last_became_active":"2024-09-19T08:54:31.432590+0000","last_became_peered":"2024-09-19T08:54:31.432590+0000","last_unstale":"2024-09-19T08:54:53.328011+0000","last_undegraded":"2024-09-19T08:54:53.328011+0000","last_fullsized":"2024-09-19T08:54:53.328011+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:53.756846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331069+0000","last_change":"2024-09-19T08:54:31.435712+0000","last_active":"2024-09-19T08:54:53.331069+0000","last_peered":"2024-09-19T08:54:53.331069+0000","last_clean":"2024-09-19T08:54:53.331069+0000","last_became_active":"2024-09-19T08:54:31.435301+0000","last_became_peered":"2024-09-19T08:54:31.435301+0000","last_unstale":"2024-09-19T08:54:53.331069+0000","last_undegraded":"2024-09-19T08:54:53.331069+0000","last_fullsized":"2024-09-19T08:54:53.331069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:51.703709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.333375+0000","last_change":"2024-09-19T08:54:53.332853+0000","last_active":"2024-09-19T08:54:53.333375+0000","last_peered":"2024-09-19T08:54:53.333375+0000","last_clean":"2024-09-19T08:54:53.333375+0000","last_became_active":"2024-09-19T08:54:53.332460+0000","last_became_peered":"2024-09-19T08:54:53.332460+0000","last_unstale":"2024-09-19T08:54:53.333375+0000","last_undegraded":"2024-09-19T08:54:53.333375+0000","last_fullsized":"2024-09-19T08:54:53.333375+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:47:58.025876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327046+0000","last_change":"2024-09-19T08:54:31.425590+0000","last_active":"2024-09-19T08:54:53.327046+0000","last_peered":"2024-09-19T08:54:53.327046+0000","last_clean":"2024-09-19T08:54:53.327046+0000","last_became_active":"2024-09-19T08:54:31.425268+0000","last_became_peered":"2024-09-19T08:54:31.425268+0000","last_unstale":"2024-09-19T08:54:53.327046+0000","last_undegraded":"2024-09-19T08:54:53.327046+0000","last_fullsized":"2024-09-19T08:54:53.327046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:09.404947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330332+0000","last_change":"2024-09-19T08:54:31.428372+0000","last_active":"2024-09-19T08:54:53.330332+0000","last_peered":"2024-09-19T08:54:53.330332+0000","last_clean":"2024-09-19T08:54:53.330332+0000","last_became_active":"2024-09-19T08:54:31.428064+0000","last_became_peered":"2024-09-19T08:54:31.428064+0000","last_unstale":"2024-09-19T08:54:53.330332+0000","last_undegraded":"2024-09-19T08:54:53.330332+0000","last_fullsized":"2024-09-19T08:54:53.330332+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:40.444117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330115+0000","last_change":"2024-09-19T08:54:31.424365+0000","last_active":"2024-09-19T08:54:53.330115+0000","last_peered":"2024-09-19T08:54:53.330115+0000","last_clean":"2024-09-19T08:54:53.330115+0000","last_became_active":"2024-09-19T08:54:31.424044+0000","last_became_peered":"2024-09-19T08:54:31.424044+0000","last_unstale":"2024-09-19T08:54:53.330115+0000","last_undegraded":"2024-09-19T08:54:53.330115+0000","last_fullsized":"2024-09-19T08:54:53.330115+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:16.435389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329839+0000","last_change":"2024-09-19T08:54:31.437238+0000","last_active":"2024-09-19T08:54:53.329839+0000","last_peered":"2024-09-19T08:54:53.329839+0000","last_clean":"2024-09-19T08:54:53.329839+0000","last_became_active":"2024-09-19T08:54:31.436867+0000","last_became_peered":"2024-09-19T08:54:31.436867+0000","last_unstale":"2024-09-19T08:54:53.329839+0000","last_undegraded":"2024-09-19T08:54:53.329839+0000","last_fullsized":"2024-09-19T08:54:53.329839+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:59.839081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.328379+0000","last_change":"2024-09-19T08:54:31.438654+0000","last_active":"2024-09-19T08:54:53.328379+0000","last_peered":"2024-09-19T08:54:53.328379+0000","last_clean":"2024-09-19T08:54:53.328379+0000","last_became_active":"2024-09-19T08:54:31.438342+0000","last_became_peered":"2024-09-19T08:54:31.438342+0000","last_unstale":"2024-09-19T08:54:53.328379+0000","last_undegraded":"2024-09-19T08:54:53.328379+0000","last_fullsized":"2024-09-19T08:54:53.328379+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:55.190605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330648+0000","last_change":"2024-09-19T08:54:31.431100+0000","last_active":"2024-09-19T08:54:53.330648+0000","last_peered":"2024-09-19T08:54:53.330648+0000","last_clean":"2024-09-19T08:54:53.330648+0000","last_became_active":"2024-09-19T08:54:31.430749+0000","last_became_peered":"2024-09-19T08:54:31.430749+0000","last_unstale":"2024-09-19T08:54:53.330648+0000","last_undegraded":"2024-09-19T08:54:53.330648+0000","last_fullsized":"2024-09-19T08:54:53.330648+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:50.597610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330176+0000","last_change":"2024-09-19T08:54:31.427454+0000","last_active":"2024-09-19T08:54:53.330176+0000","last_peered":"2024-09-19T08:54:53.330176+0000","last_clean":"2024-09-19T08:54:53.330176+0000","last_became_active":"2024-09-19T08:54:31.427098+0000","last_became_peered":"2024-09-19T08:54:31.427098+0000","last_unstale":"2024-09-19T08:54:53.330176+0000","last_undegraded":"2024-09-19T08:54:53.330176+0000","last_fullsized":"2024-09-19T08:54:53.330176+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:01.042626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.328302+0000","last_change":"2024-09-19T08:54:31.433887+0000","last_active":"2024-09-19T08:54:53.328302+0000","last_peered":"2024-09-19T08:54:53.328302+0000","last_clean":"2024-09-19T08:54:53.328302+0000","last_became_active":"2024-09-19T08:54:31.433528+0000","last_became_peered":"2024-09-19T08:54:31.433528+0000","last_unstale":"2024-09-19T08:54:53.328302+0000","last_undegraded":"2024-09-19T08:54:53.328302+0000","last_fullsized":"2024-09-19T08:54:53.328302+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:37.291226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327047+0000","last_change":"2024-09-19T08:54:31.436976+0000","last_active":"2024-09-19T08:54:53.327047+0000","last_peered":"2024-09-19T08:54:53.327047+0000","last_clean":"2024-09-19T08:54:53.327047+0000","last_became_active":"2024-09-19T08:54:31.436646+0000","last_became_peered":"2024-09-19T08:54:31.436646+0000","last_unstale":"2024-09-19T08:54:53.327047+0000","last_undegraded":"2024-09-19T08:54:53.327047+0000","last_fullsized":"2024-09-19T08:54:53.327047+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:19.755556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330114+0000","last_change":"2024-09-19T08:54:31.438922+0000","last_active":"2024-09-19T08:54:53.330114+0000","last_peered":"2024-09-19T08:54:53.330114+0000","last_clean":"2024-09-19T08:54:53.330114+0000","last_became_active":"2024-09-19T08:54:31.438593+0000","last_became_peered":"2024-09-19T08:54:31.438593+0000","last_unstale":"2024-09-19T08:54:53.330114+0000","last_undegraded":"2024-09-19T08:54:53.330114+0000","last_fullsized":"2024-09-19T08:54:53.330114+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:07.347900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.328949+0000","last_change":"2024-09-19T08:54:31.431659+0000","last_active":"2024-09-19T08:54:53.328949+0000","last_peered":"2024-09-19T08:54:53.328949+0000","last_clean":"2024-09-19T08:54:53.328949+0000","last_became_active":"2024-09-19T08:54:31.431359+0000","last_became_peered":"2024-09-19T08:54:31.431359+0000","last_unstale":"2024-09-19T08:54:53.328949+0000","last_undegraded":"2024-09-19T08:54:53.328949+0000","last_fullsized":"2024-09-19T08:54:53.328949+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:02.421286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330986+0000","last_change":"2024-09-19T08:54:31.432185+0000","last_active":"2024-09-19T08:54:53.330986+0000","last_peered":"2024-09-19T08:54:53.330986+0000","last_clean":"2024-09-19T08:54:53.330986+0000","last_became_active":"2024-09-19T08:54:31.431418+0000","last_became_peered":"2024-09-19T08:54:31.431418+0000","last_unstale":"2024-09-19T08:54:53.330986+0000","last_undegraded":"2024-09-19T08:54:53.330986+0000","last_fullsized":"2024-09-19T08:54:53.330986+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:45.347487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329298+0000","last_change":"2024-09-19T08:54:31.433742+0000","last_active":"2024-09-19T08:54:53.329298+0000","last_peered":"2024-09-19T08:54:53.329298+0000","last_clean":"2024-09-19T08:54:53.329298+0000","last_became_active":"2024-09-19T08:54:31.433455+0000","last_became_peered":"2024-09-19T08:54:31.433455+0000","last_unstale":"2024-09-19T08:54:53.329298+0000","last_undegraded":"2024-09-19T08:54:53.329298+0000","last_fullsized":"2024-09-19T08:54:53.329298+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:38.803705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330825+0000","last_change":"2024-09-19T08:54:31.432954+0000","last_active":"2024-09-19T08:54:53.330825+0000","last_peered":"2024-09-19T08:54:53.330825+0000","last_clean":"2024-09-19T08:54:53.330825+0000","last_became_active":"2024-09-19T08:54:31.432574+0000","last_became_peered":"2024-09-19T08:54:31.432574+0000","last_unstale":"2024-09-19T08:54:53.330825+0000","last_undegraded":"2024-09-19T08:54:53.330825+0000","last_fullsized":"2024-09-19T08:54:53.330825+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:30.457191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327933+0000","last_change":"2024-09-19T08:54:31.435544+0000","last_active":"2024-09-19T08:54:53.327933+0000","last_peered":"2024-09-19T08:54:53.327933+0000","last_clean":"2024-09-19T08:54:53.327933+0000","last_became_active":"2024-09-19T08:54:31.435195+0000","last_became_peered":"2024-09-19T08:54:31.435195+0000","last_unstale":"2024-09-19T08:54:53.327933+0000","last_undegraded":"2024-09-19T08:54:53.327933+0000","last_fullsized":"2024-09-19T08:54:53.327933+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:54.240654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327032+0000","last_change":"2024-09-19T08:54:31.428403+0000","last_active":"2024-09-19T08:54:53.327032+0000","last_peered":"2024-09-19T08:54:53.327032+0000","last_clean":"2024-09-19T08:54:53.327032+0000","last_became_active":"2024-09-19T08:54:31.428110+0000","last_became_peered":"2024-09-19T08:54:31.428110+0000","last_unstale":"2024-09-19T08:54:53.327032+0000","last_undegraded":"2024-09-19T08:54:53.327032+0000","last_fullsized":"2024-09-19T08:54:53.327032+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:05.593073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330562+0000","last_change":"2024-09-19T08:54:31.427291+0000","last_active":"2024-09-19T08:54:53.330562+0000","last_peered":"2024-09-19T08:54:53.330562+0000","last_clean":"2024-09-19T08:54:53.330562+0000","last_became_active":"2024-09-19T08:54:31.427011+0000","last_became_peered":"2024-09-19T08:54:31.427011+0000","last_unstale":"2024-09-19T08:54:53.330562+0000","last_undegraded":"2024-09-19T08:54:53.330562+0000","last_fullsized":"2024-09-19T08:54:53.330562+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:54.338526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329794+0000","last_change":"2024-09-19T08:54:31.429309+0000","last_active":"2024-09-19T08:54:53.329794+0000","last_peered":"2024-09-19T08:54:53.329794+0000","last_clean":"2024-09-19T08:54:53.329794+0000","last_became_active":"2024-09-19T08:54:31.428381+0000","last_became_peered":"2024-09-19T08:54:31.428381+0000","last_unstale":"2024-09-19T08:54:53.329794+0000","last_undegraded":"2024-09-19T08:54:53.329794+0000","last_fullsized":"2024-09-19T08:54:53.329794+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:22:33.920114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.336591+0000","last_change":"2024-09-19T08:54:53.336591+0000","last_active":"2024-09-19T08:54:53.336591+0000","last_peered":"2024-09-19T08:54:53.336591+0000","last_clean":"2024-09-19T08:54:53.336591+0000","last_became_active":"2024-09-19T08:54:53.336222+0000","last_became_peered":"2024-09-19T08:54:53.336222+0000","last_unstale":"2024-09-19T08:54:53.336591+0000","last_undegraded":"2024-09-19T08:54:53.336591+0000","last_fullsized":"2024-09-19T08:54:53.336591+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:59.019419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.335149+0000","last_change":"2024-09-19T08:54:53.335149+0000","last_active":"2024-09-19T08:54:53.335149+0000","last_peered":"2024-09-19T08:54:53.335149+0000","last_clean":"2024-09-19T08:54:53.335149+0000","last_became_active":"2024-09-19T08:54:53.334766+0000","last_became_peered":"2024-09-19T08:54:53.334766+0000","last_unstale":"2024-09-19T08:54:53.335149+0000","last_undegraded":"2024-09-19T08:54:53.335149+0000","last_fullsized":"2024-09-19T08:54:53.335149+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:36.469044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331864+0000","last_change":"2024-09-19T08:54:31.427608+0000","last_active":"2024-09-19T08:54:53.331864+0000","last_peered":"2024-09-19T08:54:53.331864+0000","last_clean":"2024-09-19T08:54:53.331864+0000","last_became_active":"2024-09-19T08:54:31.427294+0000","last_became_peered":"2024-09-19T08:54:31.427294+0000","last_unstale":"2024-09-19T08:54:53.331864+0000","last_undegraded":"2024-09-19T08:54:53.331864+0000","last_fullsized":"2024-09-19T08:54:53.331864+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:41.356609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331158+0000","last_change":"2024-09-19T08:54:29.416204+0000","last_active":"2024-09-19T08:54:53.331158+0000","last_peered":"2024-09-19T08:54:53.331158+0000","last_clean":"2024-09-19T08:54:53.331158+0000","last_became_active":"2024-09-19T08:54:29.415872+0000","last_became_peered":"2024-09-19T08:54:29.415872+0000","last_unstale":"2024-09-19T08:54:53.331158+0000","last_undegraded":"2024-09-19T08:54:53.331158+0000","last_fullsized":"2024-09-19T08:54:53.331158+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:13.844147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331049+0000","last_change":"2024-09-19T08:54:31.432137+0000","last_active":"2024-09-19T08:54:53.331049+0000","last_peered":"2024-09-19T08:54:53.331049+0000","last_clean":"2024-09-19T08:54:53.331049+0000","last_became_active":"2024-09-19T08:54:31.431761+0000","last_became_peered":"2024-09-19T08:54:31.431761+0000","last_unstale":"2024-09-19T08:54:53.331049+0000","last_undegraded":"2024-09-19T08:54:53.331049+0000","last_fullsized":"2024-09-19T08:54:53.331049+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:05.008431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327676+0000","last_change":"2024-09-19T08:54:29.413221+0000","last_active":"2024-09-19T08:54:53.327676+0000","last_peered":"2024-09-19T08:54:53.327676+0000","last_clean":"2024-09-19T08:54:53.327676+0000","last_became_active":"2024-09-19T08:54:29.412829+0000","last_became_peered":"2024-09-19T08:54:29.412829+0000","last_unstale":"2024-09-19T08:54:53.327676+0000","last_undegraded":"2024-09-19T08:54:53.327676+0000","last_fullsized":"2024-09-19T08:54:53.327676+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:07.224136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.326805+0000","last_change":"2024-09-19T08:54:29.410221+0000","last_active":"2024-09-19T08:54:53.326805+0000","last_peered":"2024-09-19T08:54:53.326805+0000","last_clean":"2024-09-19T08:54:53.326805+0000","last_became_active":"2024-09-19T08:54:29.409951+0000","last_became_peered":"2024-09-19T08:54:29.409951+0000","last_unstale":"2024-09-19T08:54:53.326805+0000","last_undegraded":"2024-09-19T08:54:53.326805+0000","last_fullsized":"2024-09-19T08:54:53.326805+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:58.350932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.328917+0000","last_change":"2024-09-19T08:54:31.429979+0000","last_active":"2024-09-19T08:54:53.328917+0000","last_peered":"2024-09-19T08:54:53.328917+0000","last_clean":"2024-09-19T08:54:53.328917+0000","last_became_active":"2024-09-19T08:54:31.429661+0000","last_became_peered":"2024-09-19T08:54:31.429661+0000","last_unstale":"2024-09-19T08:54:53.328917+0000","last_undegraded":"2024-09-19T08:54:53.328917+0000","last_fullsized":"2024-09-19T08:54:53.328917+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:27:40.603490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331299+0000","last_change":"2024-09-19T08:54:29.415769+0000","last_active":"2024-09-19T08:54:53.331299+0000","last_peered":"2024-09-19T08:54:53.331299+0000","last_clean":"2024-09-19T08:54:53.331299+0000","last_became_active":"2024-09-19T08:54:29.415245+0000","last_became_peered":"2024-09-19T08:54:29.415245+0000","last_unstale":"2024-09-19T08:54:53.331299+0000","last_undegraded":"2024-09-19T08:54:53.331299+0000","last_fullsized":"2024-09-19T08:54:53.331299+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:15.487945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330132+0000","last_change":"2024-09-19T08:54:31.427126+0000","last_active":"2024-09-19T08:54:53.330132+0000","last_peered":"2024-09-19T08:54:53.330132+0000","last_clean":"2024-09-19T08:54:53.330132+0000","last_became_active":"2024-09-19T08:54:31.426816+0000","last_became_peered":"2024-09-19T08:54:31.426816+0000","last_unstale":"2024-09-19T08:54:53.330132+0000","last_undegraded":"2024-09-19T08:54:53.330132+0000","last_fullsized":"2024-09-19T08:54:53.330132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:38.039428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327848+0000","last_change":"2024-09-19T08:54:29.411354+0000","last_active":"2024-09-19T08:54:53.327848+0000","last_peered":"2024-09-19T08:54:53.327848+0000","last_clean":"2024-09-19T08:54:53.327848+0000","last_became_active":"2024-09-19T08:54:29.410990+0000","last_became_peered":"2024-09-19T08:54:29.410990+0000","last_unstale":"2024-09-19T08:54:53.327848+0000","last_undegraded":"2024-09-19T08:54:53.327848+0000","last_fullsized":"2024-09-19T08:54:53.327848+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:29.338169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330234+0000","last_change":"2024-09-19T08:54:31.426243+0000","last_active":"2024-09-19T08:54:53.330234+0000","last_peered":"2024-09-19T08:54:53.330234+0000","last_clean":"2024-09-19T08:54:53.330234+0000","last_became_active":"2024-09-19T08:54:31.425895+0000","last_became_peered":"2024-09-19T08:54:31.425895+0000","last_unstale":"2024-09-19T08:54:53.330234+0000","last_undegraded":"2024-09-19T08:54:53.330234+0000","last_fullsized":"2024-09-19T08:54:53.330234+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:13.562780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331102+0000","last_change":"2024-09-19T08:54:29.416646+0000","last_active":"2024-09-19T08:54:53.331102+0000","last_peered":"2024-09-19T08:54:53.331102+0000","last_clean":"2024-09-19T08:54:53.331102+0000","last_became_active":"2024-09-19T08:54:29.416260+0000","last_became_peered":"2024-09-19T08:54:29.416260+0000","last_unstale":"2024-09-19T08:54:53.331102+0000","last_undegraded":"2024-09-19T08:54:53.331102+0000","last_fullsized":"2024-09-19T08:54:53.331102+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:42:17.467035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331394+0000","last_change":"2024-09-19T08:54:31.435538+0000","last_active":"2024-09-19T08:54:53.331394+0000","last_peered":"2024-09-19T08:54:53.331394+0000","last_clean":"2024-09-19T08:54:53.331394+0000","last_became_active":"2024-09-19T08:54:31.435185+0000","last_became_peered":"2024-09-19T08:54:31.435185+0000","last_unstale":"2024-09-19T08:54:53.331394+0000","last_undegraded":"2024-09-19T08:54:53.331394+0000","last_fullsized":"2024-09-19T08:54:53.331394+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:06.940123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.332501+0000","last_change":"2024-09-19T08:54:29.675914+0000","last_active":"2024-09-19T08:54:53.332501+0000","last_peered":"2024-09-19T08:54:53.332501+0000","last_clean":"2024-09-19T08:54:53.332501+0000","last_became_active":"2024-09-19T08:54:29.675482+0000","last_became_peered":"2024-09-19T08:54:29.675482+0000","last_unstale":"2024-09-19T08:54:53.332501+0000","last_undegraded":"2024-09-19T08:54:53.332501+0000","last_fullsized":"2024-09-19T08:54:53.332501+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:58.893008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330567+0000","last_change":"2024-09-19T08:54:31.432628+0000","last_active":"2024-09-19T08:54:53.330567+0000","last_peered":"2024-09-19T08:54:53.330567+0000","last_clean":"2024-09-19T08:54:53.330567+0000","last_became_active":"2024-09-19T08:54:31.430640+0000","last_became_peered":"2024-09-19T08:54:31.430640+0000","last_unstale":"2024-09-19T08:54:53.330567+0000","last_undegraded":"2024-09-19T08:54:53.330567+0000","last_fullsized":"2024-09-19T08:54:53.330567+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:07.793089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'25","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:01.528344+0000","last_change":"2024-09-19T08:54:29.414619+0000","last_active":"2024-09-19T08:55:01.528344+0000","last_peered":"2024-09-19T08:55:01.528344+0000","last_clean":"2024-09-19T08:55:01.528344+0000","last_became_active":"2024-09-19T08:54:29.414295+0000","last_became_peered":"2024-09-19T08:54:29.414295+0000","last_unstale":"2024-09-19T08:55:01.528344+0000","last_undegraded":"2024-09-19T08:55:01.528344+0000","last_fullsized":"2024-09-19T08:55:01.528344+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:23.782684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61199,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":54,"num_read_kb":86,"num_write":25,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331211+0000","last_change":"2024-09-19T08:54:31.425432+0000","last_active":"2024-09-19T08:54:53.331211+0000","last_peered":"2024-09-19T08:54:53.331211+0000","last_clean":"2024-09-19T08:54:53.331211+0000","last_became_active":"2024-09-19T08:54:31.425086+0000","last_became_peered":"2024-09-19T08:54:31.425086+0000","last_unstale":"2024-09-19T08:54:53.331211+0000","last_undegraded":"2024-09-19T08:54:53.331211+0000","last_fullsized":"2024-09-19T08:54:53.331211+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:56.572339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330371+0000","last_change":"2024-09-19T08:54:29.415055+0000","last_active":"2024-09-19T08:54:53.330371+0000","last_peered":"2024-09-19T08:54:53.330371+0000","last_clean":"2024-09-19T08:54:53.330371+0000","last_became_active":"2024-09-19T08:54:29.414573+0000","last_became_peered":"2024-09-19T08:54:29.414573+0000","last_unstale":"2024-09-19T08:54:53.330371+0000","last_undegraded":"2024-09-19T08:54:53.330371+0000","last_fullsized":"2024-09-19T08:54:53.330371+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:13.013714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.326883+0000","last_change":"2024-09-19T08:54:31.436905+0000","last_active":"2024-09-19T08:54:53.326883+0000","last_peered":"2024-09-19T08:54:53.326883+0000","last_clean":"2024-09-19T08:54:53.326883+0000","last_became_active":"2024-09-19T08:54:31.436571+0000","last_became_peered":"2024-09-19T08:54:31.436571+0000","last_unstale":"2024-09-19T08:54:53.326883+0000","last_undegraded":"2024-09-19T08:54:53.326883+0000","last_fullsized":"2024-09-19T08:54:53.326883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:55.294255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330834+0000","last_change":"2024-09-19T08:54:29.417958+0000","last_active":"2024-09-19T08:54:53.330834+0000","last_peered":"2024-09-19T08:54:53.330834+0000","last_clean":"2024-09-19T08:54:53.330834+0000","last_became_active":"2024-09-19T08:54:29.417570+0000","last_became_peered":"2024-09-19T08:54:29.417570+0000","last_unstale":"2024-09-19T08:54:53.330834+0000","last_undegraded":"2024-09-19T08:54:53.330834+0000","last_fullsized":"2024-09-19T08:54:53.330834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:25.557217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331274+0000","last_change":"2024-09-19T08:54:31.433019+0000","last_active":"2024-09-19T08:54:53.331274+0000","last_peered":"2024-09-19T08:54:53.331274+0000","last_clean":"2024-09-19T08:54:53.331274+0000","last_became_active":"2024-09-19T08:54:31.431265+0000","last_became_peered":"2024-09-19T08:54:31.431265+0000","last_unstale":"2024-09-19T08:54:53.331274+0000","last_undegraded":"2024-09-19T08:54:53.331274+0000","last_fullsized":"2024-09-19T08:54:53.331274+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:36.481863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.979100+0000","last_change":"2024-09-19T08:54:29.414236+0000","last_active":"2024-09-19T08:54:53.979100+0000","last_peered":"2024-09-19T08:54:53.979100+0000","last_clean":"2024-09-19T08:54:53.979100+0000","last_became_active":"2024-09-19T08:54:29.413878+0000","last_became_peered":"2024-09-19T08:54:29.413878+0000","last_unstale":"2024-09-19T08:54:53.979100+0000","last_undegraded":"2024-09-19T08:54:53.979100+0000","last_fullsized":"2024-09-19T08:54:53.979100+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:11.222362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330480+0000","last_change":"2024-09-19T08:54:31.439512+0000","last_active":"2024-09-19T08:54:53.330480+0000","last_peered":"2024-09-19T08:54:53.330480+0000","last_clean":"2024-09-19T08:54:53.330480+0000","last_became_active":"2024-09-19T08:54:31.438767+0000","last_became_peered":"2024-09-19T08:54:31.438767+0000","last_unstale":"2024-09-19T08:54:53.330480+0000","last_undegraded":"2024-09-19T08:54:53.330480+0000","last_fullsized":"2024-09-19T08:54:53.330480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:31.784577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330687+0000","last_change":"2024-09-19T08:54:29.675768+0000","last_active":"2024-09-19T08:54:53.330687+0000","last_peered":"2024-09-19T08:54:53.330687+0000","last_clean":"2024-09-19T08:54:53.330687+0000","last_became_active":"2024-09-19T08:54:29.675376+0000","last_became_peered":"2024-09-19T08:54:29.675376+0000","last_unstale":"2024-09-19T08:54:53.330687+0000","last_undegraded":"2024-09-19T08:54:53.330687+0000","last_fullsized":"2024-09-19T08:54:53.330687+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:10.281126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331714+0000","last_change":"2024-09-19T08:54:31.435904+0000","last_active":"2024-09-19T08:54:53.331714+0000","last_peered":"2024-09-19T08:54:53.331714+0000","last_clean":"2024-09-19T08:54:53.331714+0000","last_became_active":"2024-09-19T08:54:31.435396+0000","last_became_peered":"2024-09-19T08:54:31.435396+0000","last_unstale":"2024-09-19T08:54:53.331714+0000","last_undegraded":"2024-09-19T08:54:53.331714+0000","last_fullsized":"2024-09-19T08:54:53.331714+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:41.567463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331746+0000","last_change":"2024-09-19T08:54:29.410221+0000","last_active":"2024-09-19T08:54:53.331746+0000","last_peered":"2024-09-19T08:54:53.331746+0000","last_clean":"2024-09-19T08:54:53.331746+0000","last_became_active":"2024-09-19T08:54:29.409856+0000","last_became_peered":"2024-09-19T08:54:29.409856+0000","last_unstale":"2024-09-19T08:54:53.331746+0000","last_undegraded":"2024-09-19T08:54:53.331746+0000","last_fullsized":"2024-09-19T08:54:53.331746+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:46.095816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327914+0000","last_change":"2024-09-19T08:54:31.437854+0000","last_active":"2024-09-19T08:54:53.327914+0000","last_peered":"2024-09-19T08:54:53.327914+0000","last_clean":"2024-09-19T08:54:53.327914+0000","last_became_active":"2024-09-19T08:54:31.437491+0000","last_became_peered":"2024-09-19T08:54:31.437491+0000","last_unstale":"2024-09-19T08:54:53.327914+0000","last_undegraded":"2024-09-19T08:54:53.327914+0000","last_fullsized":"2024-09-19T08:54:53.327914+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:22.532429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.983440+0000","last_change":"2024-09-19T08:54:53.983440+0000","last_active":"2024-09-19T08:54:53.983440+0000","last_peered":"2024-09-19T08:54:53.983440+0000","last_clean":"2024-09-19T08:54:53.983440+0000","last_became_active":"2024-09-19T08:54:53.980971+0000","last_became_peered":"2024-09-19T08:54:53.980971+0000","last_unstale":"2024-09-19T08:54:53.983440+0000","last_undegraded":"2024-09-19T08:54:53.983440+0000","last_fullsized":"2024-09-19T08:54:53.983440+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:33.070904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330480+0000","last_change":"2024-09-19T08:54:31.429376+0000","last_active":"2024-09-19T08:54:53.330480+0000","last_peered":"2024-09-19T08:54:53.330480+0000","last_clean":"2024-09-19T08:54:53.330480+0000","last_became_active":"2024-09-19T08:54:31.429006+0000","last_became_peered":"2024-09-19T08:54:31.429006+0000","last_unstale":"2024-09-19T08:54:53.330480+0000","last_undegraded":"2024-09-19T08:54:53.330480+0000","last_fullsized":"2024-09-19T08:54:53.330480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:26.399838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.332608+0000","last_change":"2024-09-19T08:54:29.414307+0000","last_active":"2024-09-19T08:54:53.332608+0000","last_peered":"2024-09-19T08:54:53.332608+0000","last_clean":"2024-09-19T08:54:53.332608+0000","last_became_active":"2024-09-19T08:54:29.413823+0000","last_became_peered":"2024-09-19T08:54:29.413823+0000","last_unstale":"2024-09-19T08:54:53.332608+0000","last_undegraded":"2024-09-19T08:54:53.332608+0000","last_fullsized":"2024-09-19T08:54:53.332608+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:25.484645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330751+0000","last_change":"2024-09-19T08:54:31.437789+0000","last_active":"2024-09-19T08:54:53.330751+0000","last_peered":"2024-09-19T08:54:53.330751+0000","last_clean":"2024-09-19T08:54:53.330751+0000","last_became_active":"2024-09-19T08:54:31.435488+0000","last_became_peered":"2024-09-19T08:54:31.435488+0000","last_unstale":"2024-09-19T08:54:53.330751+0000","last_undegraded":"2024-09-19T08:54:53.330751+0000","last_fullsized":"2024-09-19T08:54:53.330751+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:19.332440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.333662+0000","last_change":"2024-09-19T08:54:53.333120+0000","last_active":"2024-09-19T08:54:53.333662+0000","last_peered":"2024-09-19T08:54:53.333662+0000","last_clean":"2024-09-19T08:54:53.333662+0000","last_became_active":"2024-09-19T08:54:53.332711+0000","last_became_peered":"2024-09-19T08:54:53.332711+0000","last_unstale":"2024-09-19T08:54:53.333662+0000","last_undegraded":"2024-09-19T08:54:53.333662+0000","last_fullsized":"2024-09-19T08:54:53.333662+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:18.359002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331140+0000","last_change":"2024-09-19T08:54:31.434564+0000","last_active":"2024-09-19T08:54:53.331140+0000","last_peered":"2024-09-19T08:54:53.331140+0000","last_clean":"2024-09-19T08:54:53.331140+0000","last_became_active":"2024-09-19T08:54:31.434231+0000","last_became_peered":"2024-09-19T08:54:31.434231+0000","last_unstale":"2024-09-19T08:54:53.331140+0000","last_undegraded":"2024-09-19T08:54:53.331140+0000","last_fullsized":"2024-09-19T08:54:53.331140+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:31.316400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":334,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331076+0000","last_change":"2024-09-19T08:53:21.357560+0000","last_active":"2024-09-19T08:54:53.331076+0000","last_peered":"2024-09-19T08:54:53.331076+0000","last_clean":"2024-09-19T08:54:53.331076+0000","last_became_active":"2024-09-19T08:53:21.357122+0000","last_became_peered":"2024-09-19T08:53:21.357122+0000","last_unstale":"2024-09-19T08:54:53.331076+0000","last_undegraded":"2024-09-19T08:54:53.331076+0000","last_fullsized":"2024-09-19T08:54:53.331076+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:05.231370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:05.231370+0000","last_clean_scrub_stamp":"2024-09-19T08:50:05.231370+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:47.867682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.979104+0000","last_change":"2024-09-19T08:54:29.412240+0000","last_active":"2024-09-19T08:54:53.979104+0000","last_peered":"2024-09-19T08:54:53.979104+0000","last_clean":"2024-09-19T08:54:53.979104+0000","last_became_active":"2024-09-19T08:54:29.411908+0000","last_became_peered":"2024-09-19T08:54:29.411908+0000","last_unstale":"2024-09-19T08:54:53.979104+0000","last_undegraded":"2024-09-19T08:54:53.979104+0000","last_fullsized":"2024-09-19T08:54:53.979104+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:37.189373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331122+0000","last_change":"2024-09-19T08:54:31.432956+0000","last_active":"2024-09-19T08:54:53.331122+0000","last_peered":"2024-09-19T08:54:53.331122+0000","last_clean":"2024-09-19T08:54:53.331122+0000","last_became_active":"2024-09-19T08:54:31.432639+0000","last_became_peered":"2024-09-19T08:54:31.432639+0000","last_unstale":"2024-09-19T08:54:53.331122+0000","last_undegraded":"2024-09-19T08:54:53.331122+0000","last_fullsized":"2024-09-19T08:54:53.331122+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:58.302624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331178+0000","last_change":"2024-09-19T08:54:29.414214+0000","last_active":"2024-09-19T08:54:53.331178+0000","last_peered":"2024-09-19T08:54:53.331178+0000","last_clean":"2024-09-19T08:54:53.331178+0000","last_became_active":"2024-09-19T08:54:29.413853+0000","last_became_peered":"2024-09-19T08:54:29.413853+0000","last_unstale":"2024-09-19T08:54:53.331178+0000","last_undegraded":"2024-09-19T08:54:53.331178+0000","last_fullsized":"2024-09-19T08:54:53.331178+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:28:29.119856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.326797+0000","last_change":"2024-09-19T08:54:31.424643+0000","last_active":"2024-09-19T08:54:53.326797+0000","last_peered":"2024-09-19T08:54:53.326797+0000","last_clean":"2024-09-19T08:54:53.326797+0000","last_became_active":"2024-09-19T08:54:31.424363+0000","last_became_peered":"2024-09-19T08:54:31.424363+0000","last_unstale":"2024-09-19T08:54:53.326797+0000","last_undegraded":"2024-09-19T08:54:53.326797+0000","last_fullsized":"2024-09-19T08:54:53.326797+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:37.529952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.326916+0000","last_change":"2024-09-19T08:54:29.675742+0000","last_active":"2024-09-19T08:54:53.326916+0000","last_peered":"2024-09-19T08:54:53.326916+0000","last_clean":"2024-09-19T08:54:53.326916+0000","last_became_active":"2024-09-19T08:54:29.675347+0000","last_became_peered":"2024-09-19T08:54:29.675347+0000","last_unstale":"2024-09-19T08:54:53.326916+0000","last_undegraded":"2024-09-19T08:54:53.326916+0000","last_fullsized":"2024-09-19T08:54:53.326916+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:00.925390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331104+0000","last_change":"2024-09-19T08:54:31.433887+0000","last_active":"2024-09-19T08:54:53.331104+0000","last_peered":"2024-09-19T08:54:53.331104+0000","last_clean":"2024-09-19T08:54:53.331104+0000","last_became_active":"2024-09-19T08:54:31.433331+0000","last_became_peered":"2024-09-19T08:54:31.433331+0000","last_unstale":"2024-09-19T08:54:53.331104+0000","last_undegraded":"2024-09-19T08:54:53.331104+0000","last_fullsized":"2024-09-19T08:54:53.331104+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:49.875061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331491+0000","last_change":"2024-09-19T08:54:29.417410+0000","last_active":"2024-09-19T08:54:53.331491+0000","last_peered":"2024-09-19T08:54:53.331491+0000","last_clean":"2024-09-19T08:54:53.331491+0000","last_became_active":"2024-09-19T08:54:29.417018+0000","last_became_peered":"2024-09-19T08:54:29.417018+0000","last_unstale":"2024-09-19T08:54:53.331491+0000","last_undegraded":"2024-09-19T08:54:53.331491+0000","last_fullsized":"2024-09-19T08:54:53.331491+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:53.669027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327692+0000","last_change":"2024-09-19T08:54:31.431313+0000","last_active":"2024-09-19T08:54:53.327692+0000","last_peered":"2024-09-19T08:54:53.327692+0000","last_clean":"2024-09-19T08:54:53.327692+0000","last_became_active":"2024-09-19T08:54:31.429427+0000","last_became_peered":"2024-09-19T08:54:31.429427+0000","last_unstale":"2024-09-19T08:54:53.327692+0000","last_undegraded":"2024-09-19T08:54:53.327692+0000","last_fullsized":"2024-09-19T08:54:53.327692+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:55.106769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330517+0000","last_change":"2024-09-19T08:54:29.675722+0000","last_active":"2024-09-19T08:54:53.330517+0000","last_peered":"2024-09-19T08:54:53.330517+0000","last_clean":"2024-09-19T08:54:53.330517+0000","last_became_active":"2024-09-19T08:54:29.675397+0000","last_became_peered":"2024-09-19T08:54:29.675397+0000","last_unstale":"2024-09-19T08:54:53.330517+0000","last_undegraded":"2024-09-19T08:54:53.330517+0000","last_fullsized":"2024-09-19T08:54:53.330517+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:49.574947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327665+0000","last_change":"2024-09-19T08:54:31.431106+0000","last_active":"2024-09-19T08:54:53.327665+0000","last_peered":"2024-09-19T08:54:53.327665+0000","last_clean":"2024-09-19T08:54:53.327665+0000","last_became_active":"2024-09-19T08:54:31.430745+0000","last_became_peered":"2024-09-19T08:54:31.430745+0000","last_unstale":"2024-09-19T08:54:53.327665+0000","last_undegraded":"2024-09-19T08:54:53.327665+0000","last_fullsized":"2024-09-19T08:54:53.327665+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:22.714106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331431+0000","last_change":"2024-09-19T08:54:29.675985+0000","last_active":"2024-09-19T08:54:53.331431+0000","last_peered":"2024-09-19T08:54:53.331431+0000","last_clean":"2024-09-19T08:54:53.331431+0000","last_became_active":"2024-09-19T08:54:29.675374+0000","last_became_peered":"2024-09-19T08:54:29.675374+0000","last_unstale":"2024-09-19T08:54:53.331431+0000","last_undegraded":"2024-09-19T08:54:53.331431+0000","last_fullsized":"2024-09-19T08:54:53.331431+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:06.664621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327052+0000","last_change":"2024-09-19T08:54:31.423493+0000","last_active":"2024-09-19T08:54:53.327052+0000","last_peered":"2024-09-19T08:54:53.327052+0000","last_clean":"2024-09-19T08:54:53.327052+0000","last_became_active":"2024-09-19T08:54:31.422651+0000","last_became_peered":"2024-09-19T08:54:31.422651+0000","last_unstale":"2024-09-19T08:54:53.327052+0000","last_undegraded":"2024-09-19T08:54:53.327052+0000","last_fullsized":"2024-09-19T08:54:53.327052+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:51.863965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.435498+0000","last_change":"2024-09-19T08:54:29.408571+0000","last_active":"2024-09-19T08:54:53.435498+0000","last_peered":"2024-09-19T08:54:53.435498+0000","last_clean":"2024-09-19T08:54:53.435498+0000","last_became_active":"2024-09-19T08:54:29.408142+0000","last_became_peered":"2024-09-19T08:54:29.408142+0000","last_unstale":"2024-09-19T08:54:53.435498+0000","last_undegraded":"2024-09-19T08:54:53.435498+0000","last_fullsized":"2024-09-19T08:54:53.435498+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:34.578230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329321+0000","last_change":"2024-09-19T08:54:31.435333+0000","last_active":"2024-09-19T08:54:53.329321+0000","last_peered":"2024-09-19T08:54:53.329321+0000","last_clean":"2024-09-19T08:54:53.329321+0000","last_became_active":"2024-09-19T08:54:31.435041+0000","last_became_peered":"2024-09-19T08:54:31.435041+0000","last_unstale":"2024-09-19T08:54:53.329321+0000","last_undegraded":"2024-09-19T08:54:53.329321+0000","last_fullsized":"2024-09-19T08:54:53.329321+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:40.972638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.979153+0000","last_change":"2024-09-19T08:54:29.554303+0000","last_active":"2024-09-19T08:54:53.979153+0000","last_peered":"2024-09-19T08:54:53.979153+0000","last_clean":"2024-09-19T08:54:53.979153+0000","last_became_active":"2024-09-19T08:54:29.553919+0000","last_became_peered":"2024-09-19T08:54:29.553919+0000","last_unstale":"2024-09-19T08:54:53.979153+0000","last_undegraded":"2024-09-19T08:54:53.979153+0000","last_fullsized":"2024-09-19T08:54:53.979153+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:25.103926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.333280+0000","last_change":"2024-09-19T08:54:53.333280+0000","last_active":"2024-09-19T08:54:53.333280+0000","last_peered":"2024-09-19T08:54:53.333280+0000","last_clean":"2024-09-19T08:54:53.333280+0000","last_became_active":"2024-09-19T08:54:53.332881+0000","last_became_peered":"2024-09-19T08:54:53.332881+0000","last_unstale":"2024-09-19T08:54:53.333280+0000","last_undegraded":"2024-09-19T08:54:53.333280+0000","last_fullsized":"2024-09-19T08:54:53.333280+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:55.880616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329946+0000","last_change":"2024-09-19T08:54:29.675665+0000","last_active":"2024-09-19T08:54:53.329946+0000","last_peered":"2024-09-19T08:54:53.329946+0000","last_clean":"2024-09-19T08:54:53.329946+0000","last_became_active":"2024-09-19T08:54:29.675367+0000","last_became_peered":"2024-09-19T08:54:29.675367+0000","last_unstale":"2024-09-19T08:54:53.329946+0000","last_undegraded":"2024-09-19T08:54:53.329946+0000","last_fullsized":"2024-09-19T08:54:53.329946+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:35.473243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330857+0000","last_change":"2024-09-19T08:54:31.430837+0000","last_active":"2024-09-19T08:54:53.330857+0000","last_peered":"2024-09-19T08:54:53.330857+0000","last_clean":"2024-09-19T08:54:53.330857+0000","last_became_active":"2024-09-19T08:54:31.430465+0000","last_became_peered":"2024-09-19T08:54:31.430465+0000","last_unstale":"2024-09-19T08:54:53.330857+0000","last_undegraded":"2024-09-19T08:54:53.330857+0000","last_fullsized":"2024-09-19T08:54:53.330857+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:50.524730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329067+0000","last_change":"2024-09-19T08:54:29.413803+0000","last_active":"2024-09-19T08:54:53.329067+0000","last_peered":"2024-09-19T08:54:53.329067+0000","last_clean":"2024-09-19T08:54:53.329067+0000","last_became_active":"2024-09-19T08:54:29.413400+0000","last_became_peered":"2024-09-19T08:54:29.413400+0000","last_unstale":"2024-09-19T08:54:53.329067+0000","last_undegraded":"2024-09-19T08:54:53.329067+0000","last_fullsized":"2024-09-19T08:54:53.329067+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:12.518454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327694+0000","last_change":"2024-09-19T08:54:31.428451+0000","last_active":"2024-09-19T08:54:53.327694+0000","last_peered":"2024-09-19T08:54:53.327694+0000","last_clean":"2024-09-19T08:54:53.327694+0000","last_became_active":"2024-09-19T08:54:31.428134+0000","last_became_peered":"2024-09-19T08:54:31.428134+0000","last_unstale":"2024-09-19T08:54:53.327694+0000","last_undegraded":"2024-09-19T08:54:53.327694+0000","last_fullsized":"2024-09-19T08:54:53.327694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:08.260183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329914+0000","last_change":"2024-09-19T08:54:29.414399+0000","last_active":"2024-09-19T08:54:53.329914+0000","last_peered":"2024-09-19T08:54:53.329914+0000","last_clean":"2024-09-19T08:54:53.329914+0000","last_became_active":"2024-09-19T08:54:29.413080+0000","last_became_peered":"2024-09-19T08:54:29.413080+0000","last_unstale":"2024-09-19T08:54:53.329914+0000","last_undegraded":"2024-09-19T08:54:53.329914+0000","last_fullsized":"2024-09-19T08:54:53.329914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:27.308297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329046+0000","last_change":"2024-09-19T08:54:31.434550+0000","last_active":"2024-09-19T08:54:53.329046+0000","last_peered":"2024-09-19T08:54:53.329046+0000","last_clean":"2024-09-19T08:54:53.329046+0000","last_became_active":"2024-09-19T08:54:31.434195+0000","last_became_peered":"2024-09-19T08:54:31.434195+0000","last_unstale":"2024-09-19T08:54:53.329046+0000","last_undegraded":"2024-09-19T08:54:53.329046+0000","last_fullsized":"2024-09-19T08:54:53.329046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:04.807833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.338857+0000","last_change":"2024-09-19T08:54:53.338857+0000","last_active":"2024-09-19T08:54:53.338857+0000","last_peered":"2024-09-19T08:54:53.338857+0000","last_clean":"2024-09-19T08:54:53.338857+0000","last_became_active":"2024-09-19T08:54:53.334162+0000","last_became_peered":"2024-09-19T08:54:53.334162+0000","last_unstale":"2024-09-19T08:54:53.338857+0000","last_undegraded":"2024-09-19T08:54:53.338857+0000","last_fullsized":"2024-09-19T08:54:53.338857+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:38.858918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331391+0000","last_change":"2024-09-19T08:54:31.441201+0000","last_active":"2024-09-19T08:54:53.331391+0000","last_peered":"2024-09-19T08:54:53.331391+0000","last_clean":"2024-09-19T08:54:53.331391+0000","last_became_active":"2024-09-19T08:54:31.440738+0000","last_became_peered":"2024-09-19T08:54:31.440738+0000","last_unstale":"2024-09-19T08:54:53.331391+0000","last_undegraded":"2024-09-19T08:54:53.331391+0000","last_fullsized":"2024-09-19T08:54:53.331391+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:39.118320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.332389+0000","last_change":"2024-09-19T08:54:31.435772+0000","last_active":"2024-09-19T08:54:53.332389+0000","last_peered":"2024-09-19T08:54:53.332389+0000","last_clean":"2024-09-19T08:54:53.332389+0000","last_became_active":"2024-09-19T08:54:31.435257+0000","last_became_peered":"2024-09-19T08:54:31.435257+0000","last_unstale":"2024-09-19T08:54:53.332389+0000","last_undegraded":"2024-09-19T08:54:53.332389+0000","last_fullsized":"2024-09-19T08:54:53.332389+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:44:12.219054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.341203+0000","last_change":"2024-09-19T08:54:53.341203+0000","last_active":"2024-09-19T08:54:53.341203+0000","last_peered":"2024-09-19T08:54:53.341203+0000","last_clean":"2024-09-19T08:54:53.341203+0000","last_became_active":"2024-09-19T08:54:53.336115+0000","last_became_peered":"2024-09-19T08:54:53.336115+0000","last_unstale":"2024-09-19T08:54:53.341203+0000","last_undegraded":"2024-09-19T08:54:53.341203+0000","last_fullsized":"2024-09-19T08:54:53.341203+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:31.532599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330452+0000","last_change":"2024-09-19T08:54:31.427103+0000","last_active":"2024-09-19T08:54:53.330452+0000","last_peered":"2024-09-19T08:54:53.330452+0000","last_clean":"2024-09-19T08:54:53.330452+0000","last_became_active":"2024-09-19T08:54:31.425958+0000","last_became_peered":"2024-09-19T08:54:31.425958+0000","last_unstale":"2024-09-19T08:54:53.330452+0000","last_undegraded":"2024-09-19T08:54:53.330452+0000","last_fullsized":"2024-09-19T08:54:53.330452+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:36.840940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331317+0000","last_change":"2024-09-19T08:54:29.415209+0000","last_active":"2024-09-19T08:54:53.331317+0000","last_peered":"2024-09-19T08:54:53.331317+0000","last_clean":"2024-09-19T08:54:53.331317+0000","last_became_active":"2024-09-19T08:54:29.414806+0000","last_became_peered":"2024-09-19T08:54:29.414806+0000","last_unstale":"2024-09-19T08:54:53.331317+0000","last_undegraded":"2024-09-19T08:54:53.331317+0000","last_fullsized":"2024-09-19T08:54:53.331317+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:47.764231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331348+0000","last_change":"2024-09-19T08:54:31.434027+0000","last_active":"2024-09-19T08:54:53.331348+0000","last_peered":"2024-09-19T08:54:53.331348+0000","last_clean":"2024-09-19T08:54:53.331348+0000","last_became_active":"2024-09-19T08:54:31.433687+0000","last_became_peered":"2024-09-19T08:54:31.433687+0000","last_unstale":"2024-09-19T08:54:53.331348+0000","last_undegraded":"2024-09-19T08:54:53.331348+0000","last_fullsized":"2024-09-19T08:54:53.331348+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:56.462128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329231+0000","last_change":"2024-09-19T08:54:29.675502+0000","last_active":"2024-09-19T08:54:53.329231+0000","last_peered":"2024-09-19T08:54:53.329231+0000","last_clean":"2024-09-19T08:54:53.329231+0000","last_became_active":"2024-09-19T08:54:29.675158+0000","last_became_peered":"2024-09-19T08:54:29.675158+0000","last_unstale":"2024-09-19T08:54:53.329231+0000","last_undegraded":"2024-09-19T08:54:53.329231+0000","last_fullsized":"2024-09-19T08:54:53.329231+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:24:59.377521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.334600+0000","last_change":"2024-09-19T08:54:53.334264+0000","last_active":"2024-09-19T08:54:53.334600+0000","last_peered":"2024-09-19T08:54:53.334600+0000","last_clean":"2024-09-19T08:54:53.334600+0000","last_became_active":"2024-09-19T08:54:53.333959+0000","last_became_peered":"2024-09-19T08:54:53.333959+0000","last_unstale":"2024-09-19T08:54:53.334600+0000","last_undegraded":"2024-09-19T08:54:53.334600+0000","last_fullsized":"2024-09-19T08:54:53.334600+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:14.085033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330562+0000","last_change":"2024-09-19T08:54:29.414478+0000","last_active":"2024-09-19T08:54:53.330562+0000","last_peered":"2024-09-19T08:54:53.330562+0000","last_clean":"2024-09-19T08:54:53.330562+0000","last_became_active":"2024-09-19T08:54:29.414152+0000","last_became_peered":"2024-09-19T08:54:29.414152+0000","last_unstale":"2024-09-19T08:54:53.330562+0000","last_undegraded":"2024-09-19T08:54:53.330562+0000","last_fullsized":"2024-09-19T08:54:53.330562+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:17.477340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":61997,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":58,"num_read_kb":90,"num_write":80,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":185991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":66,"ondisk_log_size":66,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579923,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":897024,"data_stored":435723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841559,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28564,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716588,"statfs":{"total":95995035648,"available":95965786112,"internally_reserved":0,"allocated":1576960,"data_stored":1087601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005084,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":901120,"data_stored":436305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234017,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":436327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462950,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28496,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716656,"statfs":{"total":95995035648,"available":95965855744,"internally_reserved":0,"allocated":1499136,"data_stored":1026790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593771,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":901120,"data_stored":435840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822704,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32660,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712492,"statfs":{"total":95995035648,"available":95961591808,"internally_reserved":0,"allocated":1507328,"data_stored":1026390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986229,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":901120,"data_stored":435745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215161,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":436061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411390,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":496956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":496922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738439,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":901120,"data_stored":435813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":61199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":61233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":61393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:55:05.245 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T08:55:05.246 INFO:tasks.cephadm:Setting up client nodes... 2024-09-19T08:55:05.246 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-19T08:55:05.492 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:05.502 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:05 smithi092 ceph-mon[31407]: pgmap v288: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 1.6 KiB/s wr, 3 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T08:55:05.502 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:05 smithi092 ceph-mon[31407]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:55:05.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:05 smithi190 ceph-mon[35358]: pgmap v288: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 1.6 KiB/s wr, 3 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T08:55:05.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:05 smithi190 ceph-mon[35358]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:55:05.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:05 smithi167 ceph-mon[35359]: pgmap v288: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 1.6 KiB/s wr, 3 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T08:55:05.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:05 smithi167 ceph-mon[35359]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:55:05.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.914+0000 7ff9bc6cd640 1 -- 172.21.15.92:0/2804279214 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9b4107960 msgr2=0x7ff9b4109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:05.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.914+0000 7ff9bc6cd640 1 --2- 172.21.15.92:0/2804279214 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9b4107960 0x7ff9b4109d50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009ca0 tx=0x7ff9ac02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:55:05.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.914+0000 7ff9bc6cd640 1 -- 172.21.15.92:0/2804279214 shutdown_connections 2024-09-19T08:55:05.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.914+0000 7ff9bc6cd640 1 --2- 172.21.15.92:0/2804279214 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9b4107960 0x7ff9b4109d50 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:05.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.914+0000 7ff9bc6cd640 1 --2- 172.21.15.92:0/2804279214 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9b4105030 0x7ff9b4107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:05.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.914+0000 7ff9bc6cd640 1 --2- 172.21.15.92:0/2804279214 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9b4102700 0x7ff9b4104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:05.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.914+0000 7ff9bc6cd640 1 -- 172.21.15.92:0/2804279214 >> 172.21.15.92:0/2804279214 conn(0x7ff9b40fc2a0 msgr2=0x7ff9b40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:05.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.914+0000 7ff9bc6cd640 1 -- 172.21.15.92:0/2804279214 shutdown_connections 2024-09-19T08:55:05.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.914+0000 7ff9bc6cd640 1 -- 172.21.15.92:0/2804279214 wait complete. 2024-09-19T08:55:05.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.915+0000 7ff9bc6cd640 1 Processor -- start 2024-09-19T08:55:05.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.915+0000 7ff9bc6cd640 1 -- start start 2024-09-19T08:55:05.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.915+0000 7ff9bc6cd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9b4102700 0x7ff9b4198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:05.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.915+0000 7ff9bc6cd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9b4105030 0x7ff9b41985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:05.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.915+0000 7ff9bc6cd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9b4107960 0x7ff9b419f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:05.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.915+0000 7ff9bc6cd640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b410d990 con 0x7ff9b4105030 2024-09-19T08:55:05.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.915+0000 7ff9bc6cd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b410d810 con 0x7ff9b4107960 2024-09-19T08:55:05.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.915+0000 7ff9bc6cd640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b410db10 con 0x7ff9b4102700 2024-09-19T08:55:05.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.915+0000 7ff9b9c68640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9b4105030 0x7ff9b41985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:05.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.915+0000 7ff9b9c68640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9b4105030 0x7ff9b41985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47248/0 (socket says 172.21.15.92:47248) 2024-09-19T08:55:05.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.915+0000 7ff9b9c68640 1 -- 172.21.15.92:0/1042973968 learned_addr learned my addr 172.21.15.92:0/1042973968 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:05.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.916+0000 7ff9bac6a640 1 --2- 172.21.15.92:0/1042973968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9b4107960 0x7ff9b419f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:05.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.916+0000 7ff9ba469640 1 --2- 172.21.15.92:0/1042973968 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9b4102700 0x7ff9b4198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:05.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.916+0000 7ff9b9c68640 1 -- 172.21.15.92:0/1042973968 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9b4102700 msgr2=0x7ff9b4198080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:05.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.916+0000 7ff9b9c68640 1 --2- 172.21.15.92:0/1042973968 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9b4102700 0x7ff9b4198080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:05.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.916+0000 7ff9b9c68640 1 -- 172.21.15.92:0/1042973968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9b4107960 msgr2=0x7ff9b419f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:05.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.916+0000 7ff9b9c68640 1 --2- 172.21.15.92:0/1042973968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9b4107960 0x7ff9b419f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:05.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.916+0000 7ff9b9c68640 1 -- 172.21.15.92:0/1042973968 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b419fcb0 con 0x7ff9b4105030 2024-09-19T08:55:05.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.916+0000 7ff9ba469640 1 --2- 172.21.15.92:0/1042973968 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9b4102700 0x7ff9b4198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:55:05.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.916+0000 7ff9b9c68640 1 --2- 172.21.15.92:0/1042973968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9b4105030 0x7ff9b41985c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff9a400b450 tx=0x7ff9a400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:05.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.916+0000 7ff9ab7fe640 1 -- 172.21.15.92:0/1042973968 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4015020 con 0x7ff9b4105030 2024-09-19T08:55:05.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.916+0000 7ff9ab7fe640 1 -- 172.21.15.92:0/1042973968 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9a4011d70 con 0x7ff9b4105030 2024-09-19T08:55:05.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.916+0000 7ff9bc6cd640 1 -- 172.21.15.92:0/1042973968 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9b419ffa0 con 0x7ff9b4105030 2024-09-19T08:55:05.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.916+0000 7ff9ab7fe640 1 -- 172.21.15.92:0/1042973968 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a400f340 con 0x7ff9b4105030 2024-09-19T08:55:05.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.916+0000 7ff9bc6cd640 1 -- 172.21.15.92:0/1042973968 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9b41a04d0 con 0x7ff9b4105030 2024-09-19T08:55:05.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.917+0000 7ff9bc6cd640 1 -- 172.21.15.92:0/1042973968 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9b40fdd90 con 0x7ff9b4105030 2024-09-19T08:55:05.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.918+0000 7ff9ab7fe640 1 -- 172.21.15.92:0/1042973968 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff9a4018020 con 0x7ff9b4105030 2024-09-19T08:55:05.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.919+0000 7ff9ab7fe640 1 --2- 172.21.15.92:0/1042973968 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff9a00a3300 0x7ff9a00a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:05.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.919+0000 7ff9ba469640 1 --2- 172.21.15.92:0/1042973968 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff9a00a3300 0x7ff9a00a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:05.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.919+0000 7ff9ab7fe640 1 -- 172.21.15.92:0/1042973968 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff9a40cf480 con 0x7ff9b4105030 2024-09-19T08:55:05.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.919+0000 7ff9ba469640 1 --2- 172.21.15.92:0/1042973968 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff9a00a3300 0x7ff9a00a57c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0006fd0 tx=0x7ff9b0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:05.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:05.923+0000 7ff9ab7fe640 1 -- 172.21.15.92:0/1042973968 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff9a401f020 con 0x7ff9b4105030 2024-09-19T08:55:06.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:06.151+0000 7ff9bc6cd640 1 -- 172.21.15.92:0/1042973968 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7ff9b402d9c0 con 0x7ff9b4105030 2024-09-19T08:55:06.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:06.153+0000 7ff9ab7fe640 1 -- 172.21.15.92:0/1042973968 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) ==== 170+0+59 (secure 0 0 0) 0x7ff9a400d040 con 0x7ff9b4105030 2024-09-19T08:55:06.153 INFO:teuthology.orchestra.run.smithi092.stdout:[client.0] 2024-09-19T08:55:06.153 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDq5utmLjUWCRAAPOcc8alY2N3IAB3Fohud8g== 2024-09-19T08:55:06.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:06.155+0000 7ff9bc6cd640 1 -- 172.21.15.92:0/1042973968 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff9a00a3300 msgr2=0x7ff9a00a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:06.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:06.155+0000 7ff9bc6cd640 1 --2- 172.21.15.92:0/1042973968 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff9a00a3300 0x7ff9a00a57c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0006fd0 tx=0x7ff9b0008040 comp rx=0 tx=0).stop 2024-09-19T08:55:06.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:06.155+0000 7ff9bc6cd640 1 -- 172.21.15.92:0/1042973968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9b4105030 msgr2=0x7ff9b41985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:06.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:06.155+0000 7ff9bc6cd640 1 --2- 172.21.15.92:0/1042973968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9b4105030 0x7ff9b41985c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff9a400b450 tx=0x7ff9a400b910 comp rx=0 tx=0).stop 2024-09-19T08:55:06.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:06.155+0000 7ff9bc6cd640 1 -- 172.21.15.92:0/1042973968 shutdown_connections 2024-09-19T08:55:06.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:06.155+0000 7ff9bc6cd640 1 --2- 172.21.15.92:0/1042973968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9b4107960 0x7ff9b419f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:06.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:06.155+0000 7ff9bc6cd640 1 --2- 172.21.15.92:0/1042973968 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff9a00a3300 0x7ff9a00a57c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:06.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:06.155+0000 7ff9bc6cd640 1 --2- 172.21.15.92:0/1042973968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9b4105030 0x7ff9b41985c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:06.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:06.155+0000 7ff9bc6cd640 1 --2- 172.21.15.92:0/1042973968 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9b4102700 0x7ff9b4198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:06.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:06.155+0000 7ff9bc6cd640 1 -- 172.21.15.92:0/1042973968 >> 172.21.15.92:0/1042973968 conn(0x7ff9b40fc2a0 msgr2=0x7ff9b4103060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:06.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:06.155+0000 7ff9bc6cd640 1 -- 172.21.15.92:0/1042973968 shutdown_connections 2024-09-19T08:55:06.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:06.155+0000 7ff9bc6cd640 1 -- 172.21.15.92:0/1042973968 wait complete. 2024-09-19T08:55:06.502 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:06 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1042973968' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T08:55:06.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:06 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1042973968' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T08:55:06.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:06 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/1042973968' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T08:55:06.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:06 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/1042973968' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T08:55:06.782 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-19T08:55:06.782 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-19T08:55:06.782 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T08:55:06.819 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T08:55:06.819 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-19T08:55:06.820 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-19T08:55:06.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:06 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/1042973968' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T08:55:06.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:06 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/1042973968' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T08:55:07.104 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:07.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:07 smithi092 ceph-mon[31407]: pgmap v289: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 1.5 KiB/s wr, 3 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T08:55:07.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.587+0000 7efc162de640 1 -- 172.21.15.92:0/3397355690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc10100e20 msgr2=0x7efc10101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:07.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.587+0000 7efc162de640 1 --2- 172.21.15.92:0/3397355690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc10100e20 0x7efc10101200 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7efc00009900 tx=0x7efc0002a480 comp rx=0 tx=0).stop 2024-09-19T08:55:07.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.587+0000 7efc162de640 1 -- 172.21.15.92:0/3397355690 shutdown_connections 2024-09-19T08:55:07.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.587+0000 7efc162de640 1 --2- 172.21.15.92:0/3397355690 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc10102ef0 0x7efc1010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:07.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.587+0000 7efc162de640 1 --2- 172.21.15.92:0/3397355690 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc10102570 0x7efc101029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:07.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.587+0000 7efc162de640 1 --2- 172.21.15.92:0/3397355690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc10100e20 0x7efc10101200 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:07.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.587+0000 7efc162de640 1 -- 172.21.15.92:0/3397355690 >> 172.21.15.92:0/3397355690 conn(0x7efc100fc7d0 msgr2=0x7efc100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:07.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.587+0000 7efc162de640 1 -- 172.21.15.92:0/3397355690 shutdown_connections 2024-09-19T08:55:07.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.587+0000 7efc162de640 1 -- 172.21.15.92:0/3397355690 wait complete. 2024-09-19T08:55:07.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.588+0000 7efc162de640 1 Processor -- start 2024-09-19T08:55:07.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.588+0000 7efc162de640 1 -- start start 2024-09-19T08:55:07.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.588+0000 7efc162de640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc10100e20 0x7efc10198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:07.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.588+0000 7efc162de640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc10102570 0x7efc10198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:07.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.588+0000 7efc162de640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc10102ef0 0x7efc1019cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:07.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.588+0000 7efc162de640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efc10110fc0 con 0x7efc10102570 2024-09-19T08:55:07.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.588+0000 7efc162de640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efc10110e40 con 0x7efc10100e20 2024-09-19T08:55:07.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.588+0000 7efc162de640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7efc10111140 con 0x7efc10102ef0 2024-09-19T08:55:07.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.588+0000 7efc07fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc10102570 0x7efc10198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:07.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.588+0000 7efc07fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc10102570 0x7efc10198ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47266/0 (socket says 172.21.15.92:47266) 2024-09-19T08:55:07.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.588+0000 7efc07fff640 1 -- 172.21.15.92:0/1522000790 learned_addr learned my addr 172.21.15.92:0/1522000790 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:07.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.588+0000 7efc07fff640 1 -- 172.21.15.92:0/1522000790 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc10102ef0 msgr2=0x7efc1019cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:07.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.588+0000 7efc07fff640 1 --2- 172.21.15.92:0/1522000790 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc10102ef0 0x7efc1019cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:07.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.588+0000 7efc07fff640 1 -- 172.21.15.92:0/1522000790 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc10100e20 msgr2=0x7efc10198660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:07.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.588+0000 7efc07fff640 1 --2- 172.21.15.92:0/1522000790 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc10100e20 0x7efc10198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:07.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.588+0000 7efc07fff640 1 -- 172.21.15.92:0/1522000790 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc1019d5c0 con 0x7efc10102570 2024-09-19T08:55:07.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.588+0000 7efc07fff640 1 --2- 172.21.15.92:0/1522000790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc10102570 0x7efc10198ba0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7efbf800c970 tx=0x7efbf800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:07.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.588+0000 7efc0dffb640 1 -- 172.21.15.92:0/1522000790 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf8007bb0 con 0x7efc10102570 2024-09-19T08:55:07.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.589+0000 7efc0dffb640 1 -- 172.21.15.92:0/1522000790 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efbf8007d50 con 0x7efc10102570 2024-09-19T08:55:07.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.589+0000 7efc162de640 1 -- 172.21.15.92:0/1522000790 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc1019d8b0 con 0x7efc10102570 2024-09-19T08:55:07.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.589+0000 7efc0dffb640 1 -- 172.21.15.92:0/1522000790 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf800f450 con 0x7efc10102570 2024-09-19T08:55:07.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.589+0000 7efc162de640 1 -- 172.21.15.92:0/1522000790 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc101a5190 con 0x7efc10102570 2024-09-19T08:55:07.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.589+0000 7efc162de640 1 -- 172.21.15.92:0/1522000790 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc10101200 con 0x7efc10102570 2024-09-19T08:55:07.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.591+0000 7efc0dffb640 1 -- 172.21.15.92:0/1522000790 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7efbf8005020 con 0x7efc10102570 2024-09-19T08:55:07.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.591+0000 7efc0dffb640 1 --2- 172.21.15.92:0/1522000790 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efbfc0a32d0 0x7efbfc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:07.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.591+0000 7efc0ffff640 1 --2- 172.21.15.92:0/1522000790 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efbfc0a32d0 0x7efbfc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:07.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.591+0000 7efc0dffb640 1 -- 172.21.15.92:0/1522000790 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7efbf80cf930 con 0x7efc10102570 2024-09-19T08:55:07.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.592+0000 7efc0ffff640 1 --2- 172.21.15.92:0/1522000790 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efbfc0a32d0 0x7efbfc0a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efc000096c0 tx=0x7efc00000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:07.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.595+0000 7efc0dffb640 1 -- 172.21.15.92:0/1522000790 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efbf8014030 con 0x7efc10102570 2024-09-19T08:55:07.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:07 smithi190 ceph-mon[35358]: pgmap v289: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 1.5 KiB/s wr, 3 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T08:55:07.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.808+0000 7efc162de640 1 -- 172.21.15.92:0/1522000790 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7efc101a5450 con 0x7efc10102570 2024-09-19T08:55:07.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.814+0000 7efc0dffb640 1 -- 172.21.15.92:0/1522000790 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264049 (secure 0 0 0) 0x7efbf809c4f0 con 0x7efc10102570 2024-09-19T08:55:07.817 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:55:07.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.816+0000 7efc162de640 1 -- 172.21.15.92:0/1522000790 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efbfc0a32d0 msgr2=0x7efbfc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:07.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.816+0000 7efc162de640 1 --2- 172.21.15.92:0/1522000790 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efbfc0a32d0 0x7efbfc0a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efc000096c0 tx=0x7efc00000bc0 comp rx=0 tx=0).stop 2024-09-19T08:55:07.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.816+0000 7efc162de640 1 -- 172.21.15.92:0/1522000790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc10102570 msgr2=0x7efc10198ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:07.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.816+0000 7efc162de640 1 --2- 172.21.15.92:0/1522000790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc10102570 0x7efc10198ba0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7efbf800c970 tx=0x7efbf800ce30 comp rx=0 tx=0).stop 2024-09-19T08:55:07.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.816+0000 7efc162de640 1 -- 172.21.15.92:0/1522000790 shutdown_connections 2024-09-19T08:55:07.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.816+0000 7efc162de640 1 --2- 172.21.15.92:0/1522000790 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc10102ef0 0x7efc1019cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:07.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.816+0000 7efc162de640 1 --2- 172.21.15.92:0/1522000790 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efbfc0a32d0 0x7efbfc0a5790 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:07.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.816+0000 7efc162de640 1 --2- 172.21.15.92:0/1522000790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc10102570 0x7efc10198ba0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:07.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.816+0000 7efc162de640 1 --2- 172.21.15.92:0/1522000790 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc10100e20 0x7efc10198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:07.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.816+0000 7efc162de640 1 -- 172.21.15.92:0/1522000790 >> 172.21.15.92:0/1522000790 conn(0x7efc100fc7d0 msgr2=0x7efc10069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:07.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.817+0000 7efc162de640 1 -- 172.21.15.92:0/1522000790 shutdown_connections 2024-09-19T08:55:07.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:07.817+0000 7efc162de640 1 -- 172.21.15.92:0/1522000790 wait complete. 2024-09-19T08:55:07.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:07 smithi167 ceph-mon[35359]: pgmap v289: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 1.5 KiB/s wr, 3 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T08:55:08.431 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2435349378},{"type":"v1","addr":"172.21.15.92:6801","nonce":2435349378}]},"active_addr":"172.21.15.92:6801/2435349378","active_change":"2024-09-19T08:47:52.180227+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24106,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.92:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":2089892927}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":2618542029}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":1411683911}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":120855599}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":2329180220}]}]} 2024-09-19T08:55:08.436 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-19T08:55:08.437 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-19T08:55:08.437 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:55:08.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:08 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/1522000790' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T08:55:08.679 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:08.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:08 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1522000790' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T08:55:08.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:08 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/1522000790' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T08:55:09.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.160+0000 7f8ede124640 1 -- 172.21.15.92:0/1891167722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ed8102790 msgr2=0x7f8ed81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:09.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.160+0000 7f8ede124640 1 --2- 172.21.15.92:0/1891167722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ed8102790 0x7f8ed81067e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc009900 tx=0x7f8ecc02a410 comp rx=0 tx=0).stop 2024-09-19T08:55:09.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.160+0000 7f8ede124640 1 -- 172.21.15.92:0/1891167722 shutdown_connections 2024-09-19T08:55:09.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.160+0000 7f8ede124640 1 --2- 172.21.15.92:0/1891167722 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ed8106f10 0x7f8ed810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:09.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.160+0000 7f8ede124640 1 --2- 172.21.15.92:0/1891167722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ed8102790 0x7f8ed81067e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:09.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.160+0000 7f8ede124640 1 --2- 172.21.15.92:0/1891167722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ed8101de0 0x7f8ed81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:09.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.160+0000 7f8ede124640 1 -- 172.21.15.92:0/1891167722 >> 172.21.15.92:0/1891167722 conn(0x7f8ed80fd8c0 msgr2=0x7f8ed80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:09.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.160+0000 7f8ede124640 1 -- 172.21.15.92:0/1891167722 shutdown_connections 2024-09-19T08:55:09.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.160+0000 7f8ede124640 1 -- 172.21.15.92:0/1891167722 wait complete. 2024-09-19T08:55:09.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.161+0000 7f8ede124640 1 Processor -- start 2024-09-19T08:55:09.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.161+0000 7f8ede124640 1 -- start start 2024-09-19T08:55:09.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.161+0000 7f8ede124640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ed8101de0 0x7f8ed81985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:09.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.161+0000 7f8ede124640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ed8102790 0x7f8ed8198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:09.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.161+0000 7f8ede124640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ed8106f10 0x7f8ed819ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:09.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.161+0000 7f8ede124640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed8112010 con 0x7f8ed8102790 2024-09-19T08:55:09.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.161+0000 7f8ede124640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed8111e90 con 0x7f8ed8106f10 2024-09-19T08:55:09.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.161+0000 7f8ede124640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed8112190 con 0x7f8ed8101de0 2024-09-19T08:55:09.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.161+0000 7f8ed6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ed8102790 0x7f8ed8198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:09.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.161+0000 7f8ed6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ed8102790 0x7f8ed8198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47290/0 (socket says 172.21.15.92:47290) 2024-09-19T08:55:09.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.161+0000 7f8ed6ffd640 1 -- 172.21.15.92:0/3425233165 learned_addr learned my addr 172.21.15.92:0/3425233165 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:09.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.161+0000 7f8ed77fe640 1 --2- 172.21.15.92:0/3425233165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ed8101de0 0x7f8ed81985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:09.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.162+0000 7f8ed7fff640 1 --2- 172.21.15.92:0/3425233165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ed8106f10 0x7f8ed819ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:09.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.162+0000 7f8ed6ffd640 1 -- 172.21.15.92:0/3425233165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ed8101de0 msgr2=0x7f8ed81985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:09.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.162+0000 7f8ed6ffd640 1 --2- 172.21.15.92:0/3425233165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ed8101de0 0x7f8ed81985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:09.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.162+0000 7f8ed6ffd640 1 -- 172.21.15.92:0/3425233165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ed8106f10 msgr2=0x7f8ed819ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:09.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.162+0000 7f8ed6ffd640 1 --2- 172.21.15.92:0/3425233165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ed8106f10 0x7f8ed819ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:09.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.162+0000 7f8ed6ffd640 1 -- 172.21.15.92:0/3425233165 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ed819d560 con 0x7f8ed8102790 2024-09-19T08:55:09.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.162+0000 7f8ed77fe640 1 --2- 172.21.15.92:0/3425233165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ed8101de0 0x7f8ed81985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:55:09.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.162+0000 7f8ed6ffd640 1 --2- 172.21.15.92:0/3425233165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ed8102790 0x7f8ed8198af0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc005ab0 tx=0x7f8ecc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:09.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.162+0000 7f8ed4ff9640 1 -- 172.21.15.92:0/3425233165 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc03f030 con 0x7f8ed8102790 2024-09-19T08:55:09.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.162+0000 7f8ed4ff9640 1 -- 172.21.15.92:0/3425233165 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ecc003ce0 con 0x7f8ed8102790 2024-09-19T08:55:09.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.162+0000 7f8ede124640 1 -- 172.21.15.92:0/3425233165 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ed819d7f0 con 0x7f8ed8102790 2024-09-19T08:55:09.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.162+0000 7f8ed4ff9640 1 -- 172.21.15.92:0/3425233165 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc035070 con 0x7f8ed8102790 2024-09-19T08:55:09.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.162+0000 7f8ede124640 1 -- 172.21.15.92:0/3425233165 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ed81a5130 con 0x7f8ed8102790 2024-09-19T08:55:09.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.163+0000 7f8ede124640 1 -- 172.21.15.92:0/3425233165 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ed81032c0 con 0x7f8ed8102790 2024-09-19T08:55:09.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.164+0000 7f8ed4ff9640 1 -- 172.21.15.92:0/3425233165 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8ecc042030 con 0x7f8ed8102790 2024-09-19T08:55:09.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.165+0000 7f8ed4ff9640 1 --2- 172.21.15.92:0/3425233165 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8ec00a32d0 0x7f8ec00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:09.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.165+0000 7f8ed4ff9640 1 -- 172.21.15.92:0/3425233165 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8ecc0f0690 con 0x7f8ed8102790 2024-09-19T08:55:09.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.165+0000 7f8ed77fe640 1 --2- 172.21.15.92:0/3425233165 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8ec00a32d0 0x7f8ec00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:09.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.165+0000 7f8ed77fe640 1 --2- 172.21.15.92:0/3425233165 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8ec00a32d0 0x7f8ec00a5790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8009930 tx=0x7f8ec8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:09.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.168+0000 7f8ed4ff9640 1 -- 172.21.15.92:0/3425233165 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8ecc0bd250 con 0x7f8ed8102790 2024-09-19T08:55:09.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.336+0000 7f8ede124640 1 -- 172.21.15.92:0/3425233165 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8ed810a0f0 con 0x7f8ed8102790 2024-09-19T08:55:09.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.338+0000 7f8ed4ff9640 1 -- 172.21.15.92:0/3425233165 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22782 (secure 0 0 0) 0x7f8ecc0bcb50 con 0x7f8ed8102790 2024-09-19T08:55:09.338 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:55:09.338 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":82,"fsid":"91ff74f2-7663-11ef-bceb-c7b262605968","created":"2024-09-19T08:47:08.162150+0000","modified":"2024-09-19T08:54:53.324204+0000","last_up_change":"2024-09-19T08:53:43.021949+0000","last_in_change":"2024-09-19T08:53:19.246805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:50:04.482034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:54:28.005336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:54:30.188980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd104fe2-b828-4c98-a499-b212717f2997","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6803","nonce":4232030626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6805","nonce":4232030626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6809","nonce":4232030626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6807","nonce":4232030626}]},"public_addr":"172.21.15.92:6803/4232030626","cluster_addr":"172.21.15.92:6805/4232030626","heartbeat_back_addr":"172.21.15.92:6809/4232030626","heartbeat_front_addr":"172.21.15.92:6807/4232030626","state":["exists","up"]},{"osd":1,"uuid":"0f725330-5e61-413c-b3c8-41bc2c0d8e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6801","nonce":4163493234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6803","nonce":4163493234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6807","nonce":4163493234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6805","nonce":4163493234}]},"public_addr":"172.21.15.167:6801/4163493234","cluster_addr":"172.21.15.167:6803/4163493234","heartbeat_back_addr":"172.21.15.167:6807/4163493234","heartbeat_front_addr":"172.21.15.167:6805/4163493234","state":["exists","up"]},{"osd":2,"uuid":"286d2943-23a0-4184-93cf-9d3430781f99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6801","nonce":702507556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6803","nonce":702507556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6807","nonce":702507556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6805","nonce":702507556}]},"public_addr":"172.21.15.190:6801/702507556","cluster_addr":"172.21.15.190:6803/702507556","heartbeat_back_addr":"172.21.15.190:6807/702507556","heartbeat_front_addr":"172.21.15.190:6805/702507556","state":["exists","up"]},{"osd":3,"uuid":"9d126671-7fc1-4f29-9bc3-3598052fd20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6811","nonce":945752895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6813","nonce":945752895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6817","nonce":945752895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6815","nonce":945752895}]},"public_addr":"172.21.15.92:6811/945752895","cluster_addr":"172.21.15.92:6813/945752895","heartbeat_back_addr":"172.21.15.92:6817/945752895","heartbeat_front_addr":"172.21.15.92:6815/945752895","state":["exists","up"]},{"osd":4,"uuid":"cb10b38d-ae13-4b92-b906-3505fb873b2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6809","nonce":3576893400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6811","nonce":3576893400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6815","nonce":3576893400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6813","nonce":3576893400}]},"public_addr":"172.21.15.167:6809/3576893400","cluster_addr":"172.21.15.167:6811/3576893400","heartbeat_back_addr":"172.21.15.167:6815/3576893400","heartbeat_front_addr":"172.21.15.167:6813/3576893400","state":["exists","up"]},{"osd":5,"uuid":"cd90668b-eca5-4bb4-870e-e58578730c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6809","nonce":1880491675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6811","nonce":1880491675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6815","nonce":1880491675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6813","nonce":1880491675}]},"public_addr":"172.21.15.190:6809/1880491675","cluster_addr":"172.21.15.190:6811/1880491675","heartbeat_back_addr":"172.21.15.190:6815/1880491675","heartbeat_front_addr":"172.21.15.190:6813/1880491675","state":["exists","up"]},{"osd":6,"uuid":"4e047963-afa7-4934-b887-8086165fb831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6819","nonce":1743435653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6821","nonce":1743435653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6825","nonce":1743435653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6823","nonce":1743435653}]},"public_addr":"172.21.15.92:6819/1743435653","cluster_addr":"172.21.15.92:6821/1743435653","heartbeat_back_addr":"172.21.15.92:6825/1743435653","heartbeat_front_addr":"172.21.15.92:6823/1743435653","state":["exists","up"]},{"osd":7,"uuid":"652a6aa1-bb94-4608-952e-67cd02bdff66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6817","nonce":2984111963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6819","nonce":2984111963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6823","nonce":2984111963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6821","nonce":2984111963}]},"public_addr":"172.21.15.167:6817/2984111963","cluster_addr":"172.21.15.167:6819/2984111963","heartbeat_back_addr":"172.21.15.167:6823/2984111963","heartbeat_front_addr":"172.21.15.167:6821/2984111963","state":["exists","up"]},{"osd":8,"uuid":"1510ef1f-fdfe-4887-a771-146efce062fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6817","nonce":4190304434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6819","nonce":4190304434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6823","nonce":4190304434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6821","nonce":4190304434}]},"public_addr":"172.21.15.190:6817/4190304434","cluster_addr":"172.21.15.190:6819/4190304434","heartbeat_back_addr":"172.21.15.190:6823/4190304434","heartbeat_front_addr":"172.21.15.190:6821/4190304434","state":["exists","up"]},{"osd":9,"uuid":"9b774bbe-6700-4020-900b-3fdbaa546773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6827","nonce":3066744542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6829","nonce":3066744542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6833","nonce":3066744542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6831","nonce":3066744542}]},"public_addr":"172.21.15.92:6827/3066744542","cluster_addr":"172.21.15.92:6829/3066744542","heartbeat_back_addr":"172.21.15.92:6833/3066744542","heartbeat_front_addr":"172.21.15.92:6831/3066744542","state":["exists","up"]},{"osd":10,"uuid":"8abdb835-db2c-4597-ae1d-8ef56e63ab6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6825","nonce":2309134313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6827","nonce":2309134313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6831","nonce":2309134313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6829","nonce":2309134313}]},"public_addr":"172.21.15.167:6825/2309134313","cluster_addr":"172.21.15.167:6827/2309134313","heartbeat_back_addr":"172.21.15.167:6831/2309134313","heartbeat_front_addr":"172.21.15.167:6829/2309134313","state":["exists","up"]},{"osd":11,"uuid":"564c844a-378f-40cd-9717-cde35a65631c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6825","nonce":1849208751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6827","nonce":1849208751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6831","nonce":1849208751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6829","nonce":1849208751}]},"public_addr":"172.21.15.190:6825/1849208751","cluster_addr":"172.21.15.190:6827/1849208751","heartbeat_back_addr":"172.21.15.190:6831/1849208751","heartbeat_front_addr":"172.21.15.190:6829/1849208751","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:12.072109+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:36.689174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:01.908763+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:26.857439+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:50.881629+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:51:15.160744+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:51:39.101605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:03.179877+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:27.324563+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:51.971287+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:53:15.917311+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:53:40.592486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/2948821221":"2024-09-20T08:47:52.180093+0000","172.21.15.92:0/1441365956":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6801/2908709470":"2024-09-20T08:47:52.180093+0000","172.21.15.92:0/608374871":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6801/1369295034":"2024-09-20T08:47:29.812397+0000","172.21.15.92:6800/2908709470":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6800/1369295034":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/813486656":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/1963725565":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/1668504617":"2024-09-20T08:47:29.812397+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:55:09.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.340+0000 7f8ede124640 1 -- 172.21.15.92:0/3425233165 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8ec00a32d0 msgr2=0x7f8ec00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:09.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.340+0000 7f8ede124640 1 --2- 172.21.15.92:0/3425233165 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8ec00a32d0 0x7f8ec00a5790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8009930 tx=0x7f8ec8008040 comp rx=0 tx=0).stop 2024-09-19T08:55:09.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.340+0000 7f8ede124640 1 -- 172.21.15.92:0/3425233165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ed8102790 msgr2=0x7f8ed8198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:09.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.340+0000 7f8ede124640 1 --2- 172.21.15.92:0/3425233165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ed8102790 0x7f8ed8198af0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc005ab0 tx=0x7f8ecc0042f0 comp rx=0 tx=0).stop 2024-09-19T08:55:09.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.340+0000 7f8ede124640 1 -- 172.21.15.92:0/3425233165 shutdown_connections 2024-09-19T08:55:09.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.340+0000 7f8ede124640 1 --2- 172.21.15.92:0/3425233165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ed8106f10 0x7f8ed819ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:09.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.340+0000 7f8ede124640 1 --2- 172.21.15.92:0/3425233165 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8ec00a32d0 0x7f8ec00a5790 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:09.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.340+0000 7f8ede124640 1 --2- 172.21.15.92:0/3425233165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ed8102790 0x7f8ed8198af0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:09.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.340+0000 7f8ede124640 1 --2- 172.21.15.92:0/3425233165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ed8101de0 0x7f8ed81985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:09.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.340+0000 7f8ede124640 1 -- 172.21.15.92:0/3425233165 >> 172.21.15.92:0/3425233165 conn(0x7f8ed80fd8c0 msgr2=0x7f8ed80fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:09.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.340+0000 7f8ede124640 1 -- 172.21.15.92:0/3425233165 shutdown_connections 2024-09-19T08:55:09.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:09.340+0000 7f8ede124640 1 -- 172.21.15.92:0/3425233165 wait complete. 2024-09-19T08:55:09.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:09 smithi190 ceph-mon[35358]: pgmap v290: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.4 KiB/s wr, 3 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T08:55:09.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:09 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3425233165' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:55:09.634 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:09 smithi092 ceph-mon[31407]: pgmap v290: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.4 KiB/s wr, 3 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T08:55:09.634 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:09 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3425233165' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:55:09.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:09 smithi167 ceph-mon[35359]: pgmap v290: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.4 KiB/s wr, 3 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T08:55:09.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:09 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3425233165' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:55:09.946 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-19T08:55:09.946 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:55:10.192 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:10.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.652+0000 7f335b001640 1 -- 172.21.15.92:0/2032661131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3354101df0 msgr2=0x7f33541021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:10.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.652+0000 7f335b001640 1 --2- 172.21.15.92:0/2032661131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3354101df0 0x7f33541021d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3348009900 tx=0x7f334802a410 comp rx=0 tx=0).stop 2024-09-19T08:55:10.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.652+0000 7f335b001640 1 -- 172.21.15.92:0/2032661131 shutdown_connections 2024-09-19T08:55:10.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.652+0000 7f335b001640 1 --2- 172.21.15.92:0/2032661131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3354106f20 0x7f335410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:10.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.652+0000 7f335b001640 1 --2- 172.21.15.92:0/2032661131 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33541027a0 0x7f33541067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:10.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.652+0000 7f335b001640 1 --2- 172.21.15.92:0/2032661131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3354101df0 0x7f33541021d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:10.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.652+0000 7f335b001640 1 -- 172.21.15.92:0/2032661131 >> 172.21.15.92:0/2032661131 conn(0x7f33540fd8f0 msgr2=0x7f33540ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:10.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.652+0000 7f335b001640 1 -- 172.21.15.92:0/2032661131 shutdown_connections 2024-09-19T08:55:10.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.652+0000 7f335b001640 1 -- 172.21.15.92:0/2032661131 wait complete. 2024-09-19T08:55:10.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.652+0000 7f335b001640 1 Processor -- start 2024-09-19T08:55:10.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.652+0000 7f335b001640 1 -- start start 2024-09-19T08:55:10.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.653+0000 7f335b001640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3354101df0 0x7f33541984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:10.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.653+0000 7f335b001640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33541027a0 0x7f3354198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:10.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.653+0000 7f335b001640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3354106f20 0x7f335419cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:10.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.653+0000 7f335b001640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3354111f80 con 0x7f33541027a0 2024-09-19T08:55:10.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.653+0000 7f335b001640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3354111e00 con 0x7f3354106f20 2024-09-19T08:55:10.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.653+0000 7f335b001640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3354112100 con 0x7f3354101df0 2024-09-19T08:55:10.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.653+0000 7f3353fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33541027a0 0x7f3354198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:10.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.653+0000 7f3353fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33541027a0 0x7f3354198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47312/0 (socket says 172.21.15.92:47312) 2024-09-19T08:55:10.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.653+0000 7f3353fff640 1 -- 172.21.15.92:0/1006087103 learned_addr learned my addr 172.21.15.92:0/1006087103 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:10.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.653+0000 7f3358d9d640 1 --2- 172.21.15.92:0/1006087103 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3354101df0 0x7f33541984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:10.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.653+0000 7f335959e640 1 --2- 172.21.15.92:0/1006087103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3354106f20 0x7f335419cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:10.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.653+0000 7f3353fff640 1 -- 172.21.15.92:0/1006087103 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3354101df0 msgr2=0x7f33541984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:10.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.653+0000 7f3353fff640 1 --2- 172.21.15.92:0/1006087103 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3354101df0 0x7f33541984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:10.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.653+0000 7f3353fff640 1 -- 172.21.15.92:0/1006087103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3354106f20 msgr2=0x7f335419cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:10.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.653+0000 7f3353fff640 1 --2- 172.21.15.92:0/1006087103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3354106f20 0x7f335419cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:10.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.653+0000 7f3353fff640 1 -- 172.21.15.92:0/1006087103 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f335419d470 con 0x7f33541027a0 2024-09-19T08:55:10.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.653+0000 7f335959e640 1 --2- 172.21.15.92:0/1006087103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3354106f20 0x7f335419cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:55:10.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.653+0000 7f3353fff640 1 --2- 172.21.15.92:0/1006087103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33541027a0 0x7f3354198a00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f334000d770 tx=0x7f334000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:10.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.653+0000 7f3351ffb640 1 -- 172.21.15.92:0/1006087103 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3340017070 con 0x7f33541027a0 2024-09-19T08:55:10.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.653+0000 7f3351ffb640 1 -- 172.21.15.92:0/1006087103 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3340005500 con 0x7f33541027a0 2024-09-19T08:55:10.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.653+0000 7f335b001640 1 -- 172.21.15.92:0/1006087103 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f335419d760 con 0x7f33541027a0 2024-09-19T08:55:10.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.653+0000 7f3351ffb640 1 -- 172.21.15.92:0/1006087103 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3340004e00 con 0x7f33541027a0 2024-09-19T08:55:10.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.654+0000 7f335b001640 1 -- 172.21.15.92:0/1006087103 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33541a5040 con 0x7f33541027a0 2024-09-19T08:55:10.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.655+0000 7f335b001640 1 -- 172.21.15.92:0/1006087103 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33541021d0 con 0x7f33541027a0 2024-09-19T08:55:10.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.656+0000 7f3351ffb640 1 -- 172.21.15.92:0/1006087103 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3340004fa0 con 0x7f33541027a0 2024-09-19T08:55:10.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.656+0000 7f3351ffb640 1 --2- 172.21.15.92:0/1006087103 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f33440a3350 0x7f33440a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:10.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.656+0000 7f3358d9d640 1 --2- 172.21.15.92:0/1006087103 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f33440a3350 0x7f33440a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:10.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.656+0000 7f3351ffb640 1 -- 172.21.15.92:0/1006087103 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f33400cf470 con 0x7f33541027a0 2024-09-19T08:55:10.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.657+0000 7f3358d9d640 1 --2- 172.21.15.92:0/1006087103 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f33440a3350 0x7f33440a5810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3348009230 tx=0x7f33480058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:10.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.660+0000 7f3351ffb640 1 -- 172.21.15.92:0/1006087103 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f334009c030 con 0x7f33541027a0 2024-09-19T08:55:10.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.828+0000 7f335b001640 1 -- 172.21.15.92:0/1006087103 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f335410a100 con 0x7f33541027a0 2024-09-19T08:55:10.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.830+0000 7f3351ffb640 1 -- 172.21.15.92:0/1006087103 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22782 (secure 0 0 0) 0x7f334009b930 con 0x7f33541027a0 2024-09-19T08:55:10.830 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:55:10.830 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":82,"fsid":"91ff74f2-7663-11ef-bceb-c7b262605968","created":"2024-09-19T08:47:08.162150+0000","modified":"2024-09-19T08:54:53.324204+0000","last_up_change":"2024-09-19T08:53:43.021949+0000","last_in_change":"2024-09-19T08:53:19.246805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:50:04.482034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:54:28.005336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:54:30.188980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd104fe2-b828-4c98-a499-b212717f2997","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6803","nonce":4232030626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6805","nonce":4232030626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6809","nonce":4232030626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6807","nonce":4232030626}]},"public_addr":"172.21.15.92:6803/4232030626","cluster_addr":"172.21.15.92:6805/4232030626","heartbeat_back_addr":"172.21.15.92:6809/4232030626","heartbeat_front_addr":"172.21.15.92:6807/4232030626","state":["exists","up"]},{"osd":1,"uuid":"0f725330-5e61-413c-b3c8-41bc2c0d8e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6801","nonce":4163493234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6803","nonce":4163493234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6807","nonce":4163493234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6805","nonce":4163493234}]},"public_addr":"172.21.15.167:6801/4163493234","cluster_addr":"172.21.15.167:6803/4163493234","heartbeat_back_addr":"172.21.15.167:6807/4163493234","heartbeat_front_addr":"172.21.15.167:6805/4163493234","state":["exists","up"]},{"osd":2,"uuid":"286d2943-23a0-4184-93cf-9d3430781f99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6801","nonce":702507556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6803","nonce":702507556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6807","nonce":702507556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6805","nonce":702507556}]},"public_addr":"172.21.15.190:6801/702507556","cluster_addr":"172.21.15.190:6803/702507556","heartbeat_back_addr":"172.21.15.190:6807/702507556","heartbeat_front_addr":"172.21.15.190:6805/702507556","state":["exists","up"]},{"osd":3,"uuid":"9d126671-7fc1-4f29-9bc3-3598052fd20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6811","nonce":945752895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6813","nonce":945752895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6817","nonce":945752895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6815","nonce":945752895}]},"public_addr":"172.21.15.92:6811/945752895","cluster_addr":"172.21.15.92:6813/945752895","heartbeat_back_addr":"172.21.15.92:6817/945752895","heartbeat_front_addr":"172.21.15.92:6815/945752895","state":["exists","up"]},{"osd":4,"uuid":"cb10b38d-ae13-4b92-b906-3505fb873b2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6809","nonce":3576893400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6811","nonce":3576893400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6815","nonce":3576893400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6813","nonce":3576893400}]},"public_addr":"172.21.15.167:6809/3576893400","cluster_addr":"172.21.15.167:6811/3576893400","heartbeat_back_addr":"172.21.15.167:6815/3576893400","heartbeat_front_addr":"172.21.15.167:6813/3576893400","state":["exists","up"]},{"osd":5,"uuid":"cd90668b-eca5-4bb4-870e-e58578730c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6809","nonce":1880491675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6811","nonce":1880491675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6815","nonce":1880491675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6813","nonce":1880491675}]},"public_addr":"172.21.15.190:6809/1880491675","cluster_addr":"172.21.15.190:6811/1880491675","heartbeat_back_addr":"172.21.15.190:6815/1880491675","heartbeat_front_addr":"172.21.15.190:6813/1880491675","state":["exists","up"]},{"osd":6,"uuid":"4e047963-afa7-4934-b887-8086165fb831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6819","nonce":1743435653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6821","nonce":1743435653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6825","nonce":1743435653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6823","nonce":1743435653}]},"public_addr":"172.21.15.92:6819/1743435653","cluster_addr":"172.21.15.92:6821/1743435653","heartbeat_back_addr":"172.21.15.92:6825/1743435653","heartbeat_front_addr":"172.21.15.92:6823/1743435653","state":["exists","up"]},{"osd":7,"uuid":"652a6aa1-bb94-4608-952e-67cd02bdff66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6817","nonce":2984111963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6819","nonce":2984111963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6823","nonce":2984111963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6821","nonce":2984111963}]},"public_addr":"172.21.15.167:6817/2984111963","cluster_addr":"172.21.15.167:6819/2984111963","heartbeat_back_addr":"172.21.15.167:6823/2984111963","heartbeat_front_addr":"172.21.15.167:6821/2984111963","state":["exists","up"]},{"osd":8,"uuid":"1510ef1f-fdfe-4887-a771-146efce062fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6817","nonce":4190304434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6819","nonce":4190304434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6823","nonce":4190304434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6821","nonce":4190304434}]},"public_addr":"172.21.15.190:6817/4190304434","cluster_addr":"172.21.15.190:6819/4190304434","heartbeat_back_addr":"172.21.15.190:6823/4190304434","heartbeat_front_addr":"172.21.15.190:6821/4190304434","state":["exists","up"]},{"osd":9,"uuid":"9b774bbe-6700-4020-900b-3fdbaa546773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6827","nonce":3066744542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6829","nonce":3066744542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6833","nonce":3066744542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6831","nonce":3066744542}]},"public_addr":"172.21.15.92:6827/3066744542","cluster_addr":"172.21.15.92:6829/3066744542","heartbeat_back_addr":"172.21.15.92:6833/3066744542","heartbeat_front_addr":"172.21.15.92:6831/3066744542","state":["exists","up"]},{"osd":10,"uuid":"8abdb835-db2c-4597-ae1d-8ef56e63ab6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6825","nonce":2309134313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6827","nonce":2309134313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6831","nonce":2309134313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6829","nonce":2309134313}]},"public_addr":"172.21.15.167:6825/2309134313","cluster_addr":"172.21.15.167:6827/2309134313","heartbeat_back_addr":"172.21.15.167:6831/2309134313","heartbeat_front_addr":"172.21.15.167:6829/2309134313","state":["exists","up"]},{"osd":11,"uuid":"564c844a-378f-40cd-9717-cde35a65631c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6825","nonce":1849208751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6827","nonce":1849208751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6831","nonce":1849208751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6829","nonce":1849208751}]},"public_addr":"172.21.15.190:6825/1849208751","cluster_addr":"172.21.15.190:6827/1849208751","heartbeat_back_addr":"172.21.15.190:6831/1849208751","heartbeat_front_addr":"172.21.15.190:6829/1849208751","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:12.072109+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:36.689174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:01.908763+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:26.857439+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:50.881629+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:51:15.160744+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:51:39.101605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:03.179877+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:27.324563+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:51.971287+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:53:15.917311+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:53:40.592486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/2948821221":"2024-09-20T08:47:52.180093+0000","172.21.15.92:0/1441365956":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6801/2908709470":"2024-09-20T08:47:52.180093+0000","172.21.15.92:0/608374871":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6801/1369295034":"2024-09-20T08:47:29.812397+0000","172.21.15.92:6800/2908709470":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6800/1369295034":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/813486656":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/1963725565":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/1668504617":"2024-09-20T08:47:29.812397+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:55:10.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.832+0000 7f335b001640 1 -- 172.21.15.92:0/1006087103 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f33440a3350 msgr2=0x7f33440a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:10.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.832+0000 7f335b001640 1 --2- 172.21.15.92:0/1006087103 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f33440a3350 0x7f33440a5810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3348009230 tx=0x7f33480058d0 comp rx=0 tx=0).stop 2024-09-19T08:55:10.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.832+0000 7f335b001640 1 -- 172.21.15.92:0/1006087103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33541027a0 msgr2=0x7f3354198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:10.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.832+0000 7f335b001640 1 --2- 172.21.15.92:0/1006087103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33541027a0 0x7f3354198a00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f334000d770 tx=0x7f334000dc30 comp rx=0 tx=0).stop 2024-09-19T08:55:10.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.832+0000 7f335b001640 1 -- 172.21.15.92:0/1006087103 shutdown_connections 2024-09-19T08:55:10.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.832+0000 7f335b001640 1 --2- 172.21.15.92:0/1006087103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3354106f20 0x7f335419cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:10.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.832+0000 7f335b001640 1 --2- 172.21.15.92:0/1006087103 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f33440a3350 0x7f33440a5810 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:10.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.832+0000 7f335b001640 1 --2- 172.21.15.92:0/1006087103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33541027a0 0x7f3354198a00 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:10.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.832+0000 7f335b001640 1 --2- 172.21.15.92:0/1006087103 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3354101df0 0x7f33541984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:10.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.832+0000 7f335b001640 1 -- 172.21.15.92:0/1006087103 >> 172.21.15.92:0/1006087103 conn(0x7f33540fd8f0 msgr2=0x7f33540feda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:10.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.832+0000 7f335b001640 1 -- 172.21.15.92:0/1006087103 shutdown_connections 2024-09-19T08:55:10.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:10.832+0000 7f335b001640 1 -- 172.21.15.92:0/1006087103 wait complete. 2024-09-19T08:55:11.461 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-19T08:55:11.462 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-19T08:55:11.462 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-19T08:55:11.463 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-19T08:55:11.463 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-19T08:55:11.463 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-19T08:55:11.464 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-19T08:55:11.464 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-19T08:55:11.465 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-19T08:55:11.465 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-19T08:55:11.466 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-19T08:55:11.466 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-19T08:55:11.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:11 smithi190 ceph-mon[35358]: pgmap v291: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 426 B/s wr, 1 op/s 2024-09-19T08:55:11.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:11 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/1006087103' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:55:11.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:11 smithi092 ceph-mon[31407]: pgmap v291: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 426 B/s wr, 1 op/s 2024-09-19T08:55:11.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:11 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1006087103' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:55:11.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:11 smithi167 ceph-mon[35359]: pgmap v291: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 426 B/s wr, 1 op/s 2024-09-19T08:55:11.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:11 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/1006087103' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:55:12.126 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:12.467 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:12.473 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:12.475 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:12.475 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:12.481 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:12.482 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:12.482 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:12.485 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:12.493 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:12.496 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:12.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.694+0000 7fe5da0ef640 1 -- 172.21.15.92:0/3660903156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5d4106f10 msgr2=0x7fe5d410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:12.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.694+0000 7fe5da0ef640 1 --2- 172.21.15.92:0/3660903156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5d4106f10 0x7fe5d410ea90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc009ca0 tx=0x7fe5cc02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:55:12.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.694+0000 7fe5da0ef640 1 -- 172.21.15.92:0/3660903156 shutdown_connections 2024-09-19T08:55:12.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.694+0000 7fe5da0ef640 1 --2- 172.21.15.92:0/3660903156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5d4106f10 0x7fe5d410ea90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:12.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.694+0000 7fe5da0ef640 1 --2- 172.21.15.92:0/3660903156 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe5d4102790 0x7fe5d41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:12.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.694+0000 7fe5da0ef640 1 --2- 172.21.15.92:0/3660903156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe5d4101de0 0x7fe5d41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:12.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.694+0000 7fe5da0ef640 1 -- 172.21.15.92:0/3660903156 >> 172.21.15.92:0/3660903156 conn(0x7fe5d40fd8c0 msgr2=0x7fe5d40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:12.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.694+0000 7fe5da0ef640 1 -- 172.21.15.92:0/3660903156 shutdown_connections 2024-09-19T08:55:12.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.694+0000 7fe5da0ef640 1 -- 172.21.15.92:0/3660903156 wait complete. 2024-09-19T08:55:12.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.694+0000 7fe5da0ef640 1 Processor -- start 2024-09-19T08:55:12.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.694+0000 7fe5da0ef640 1 -- start start 2024-09-19T08:55:12.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.694+0000 7fe5da0ef640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe5d4101de0 0x7fe5d4198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:12.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.694+0000 7fe5da0ef640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5d4102790 0x7fe5d4198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:12.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.694+0000 7fe5da0ef640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe5d4106f10 0x7fe5d419cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:12.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.694+0000 7fe5da0ef640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d4111f70 con 0x7fe5d4102790 2024-09-19T08:55:12.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.694+0000 7fe5da0ef640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d4111df0 con 0x7fe5d4101de0 2024-09-19T08:55:12.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.694+0000 7fe5da0ef640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d41120f0 con 0x7fe5d4106f10 2024-09-19T08:55:12.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.695+0000 7fe5cbfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5d4102790 0x7fe5d4198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:12.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.695+0000 7fe5cbfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5d4102790 0x7fe5d4198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55162/0 (socket says 172.21.15.92:55162) 2024-09-19T08:55:12.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.695+0000 7fe5cbfff640 1 -- 172.21.15.92:0/3488606171 learned_addr learned my addr 172.21.15.92:0/3488606171 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:12.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.695+0000 7fe5d37fe640 1 --2- 172.21.15.92:0/3488606171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe5d4101de0 0x7fe5d4198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:12.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.695+0000 7fe5d3fff640 1 --2- 172.21.15.92:0/3488606171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe5d4106f10 0x7fe5d419cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:12.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.695+0000 7fe5cbfff640 1 -- 172.21.15.92:0/3488606171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe5d4106f10 msgr2=0x7fe5d419cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:12.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.695+0000 7fe5cbfff640 1 --2- 172.21.15.92:0/3488606171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe5d4106f10 0x7fe5d419cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:12.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.695+0000 7fe5cbfff640 1 -- 172.21.15.92:0/3488606171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe5d4101de0 msgr2=0x7fe5d4198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:12.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.695+0000 7fe5cbfff640 1 --2- 172.21.15.92:0/3488606171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe5d4101de0 0x7fe5d4198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:12.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.695+0000 7fe5cbfff640 1 -- 172.21.15.92:0/3488606171 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d419d2e0 con 0x7fe5d4102790 2024-09-19T08:55:12.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.695+0000 7fe5d3fff640 1 --2- 172.21.15.92:0/3488606171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe5d4106f10 0x7fe5d419cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:55:12.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.695+0000 7fe5cbfff640 1 --2- 172.21.15.92:0/3488606171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5d4102790 0x7fe5d4198870 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc00c920 tx=0x7fe5bc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:12.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.695+0000 7fe5d17fa640 1 -- 172.21.15.92:0/3488606171 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc007c70 con 0x7fe5d4102790 2024-09-19T08:55:12.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.695+0000 7fe5da0ef640 1 -- 172.21.15.92:0/3488606171 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5d419d5d0 con 0x7fe5d4102790 2024-09-19T08:55:12.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.695+0000 7fe5d17fa640 1 -- 172.21.15.92:0/3488606171 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5bc007e10 con 0x7fe5d4102790 2024-09-19T08:55:12.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.695+0000 7fe5d17fa640 1 -- 172.21.15.92:0/3488606171 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc018890 con 0x7fe5d4102790 2024-09-19T08:55:12.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.695+0000 7fe5da0ef640 1 -- 172.21.15.92:0/3488606171 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5d41a4eb0 con 0x7fe5d4102790 2024-09-19T08:55:12.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.696+0000 7fe5da0ef640 1 -- 172.21.15.92:0/3488606171 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe5d40feee0 con 0x7fe5d4102790 2024-09-19T08:55:12.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.697+0000 7fe5d17fa640 1 -- 172.21.15.92:0/3488606171 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe5bc018a30 con 0x7fe5d4102790 2024-09-19T08:55:12.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.698+0000 7fe5d17fa640 1 --2- 172.21.15.92:0/3488606171 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe5c00a32d0 0x7fe5c00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:12.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.698+0000 7fe5d17fa640 1 -- 172.21.15.92:0/3488606171 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe5bc0cffd0 con 0x7fe5d4102790 2024-09-19T08:55:12.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.698+0000 7fe5d37fe640 1 --2- 172.21.15.92:0/3488606171 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe5c00a32d0 0x7fe5c00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:12.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.698+0000 7fe5d17fa640 1 --2- 172.21.15.92:0/3488606171 >> [v2:172.21.15.92:6802/4232030626,v1:172.21.15.92:6803/4232030626] conn(0x7fe5c00acf00 0x7fe5c00af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:12.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.698+0000 7fe5d17fa640 1 -- 172.21.15.92:0/3488606171 --> [v2:172.21.15.92:6802/4232030626,v1:172.21.15.92:6803/4232030626] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe5c00afa70 con 0x7fe5c00acf00 2024-09-19T08:55:12.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.698+0000 7fe5d17fa640 1 -- 172.21.15.92:0/3488606171 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fe5bc0d0400 con 0x7fe5d4102790 2024-09-19T08:55:12.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.698+0000 7fe5d3fff640 1 --2- 172.21.15.92:0/3488606171 >> [v2:172.21.15.92:6802/4232030626,v1:172.21.15.92:6803/4232030626] conn(0x7fe5c00acf00 0x7fe5c00af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:12.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.698+0000 7fe5d37fe640 1 --2- 172.21.15.92:0/3488606171 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe5c00a32d0 0x7fe5c00a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe5c400bbe0 tx=0x7fe5c400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:12.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.699+0000 7fe5d3fff640 1 --2- 172.21.15.92:0/3488606171 >> [v2:172.21.15.92:6802/4232030626,v1:172.21.15.92:6803/4232030626] conn(0x7fe5c00acf00 0x7fe5c00af3a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:12.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.699+0000 7fe5d17fa640 1 -- 172.21.15.92:0/3488606171 <== osd.0 v2:172.21.15.92:6802/4232030626 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe5c00afa70 con 0x7fe5c00acf00 2024-09-19T08:55:12.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.712+0000 7fe5da0ef640 1 -- 172.21.15.92:0/3488606171 --> [v2:172.21.15.92:6802/4232030626,v1:172.21.15.92:6803/4232030626] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe5d41032c0 con 0x7fe5c00acf00 2024-09-19T08:55:12.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.713+0000 7fe5d17fa640 1 -- 172.21.15.92:0/3488606171 <== osd.0 v2:172.21.15.92:6802/4232030626 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe5d41032c0 con 0x7fe5c00acf00 2024-09-19T08:55:12.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.713+0000 7fe5da0ef640 1 -- 172.21.15.92:0/3488606171 >> [v2:172.21.15.92:6802/4232030626,v1:172.21.15.92:6803/4232030626] conn(0x7fe5c00acf00 msgr2=0x7fe5c00af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:12.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.713+0000 7fe5da0ef640 1 --2- 172.21.15.92:0/3488606171 >> [v2:172.21.15.92:6802/4232030626,v1:172.21.15.92:6803/4232030626] conn(0x7fe5c00acf00 0x7fe5c00af3a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:12.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.713+0000 7fe5da0ef640 1 -- 172.21.15.92:0/3488606171 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe5c00a32d0 msgr2=0x7fe5c00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:12.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.713+0000 7fe5da0ef640 1 --2- 172.21.15.92:0/3488606171 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe5c00a32d0 0x7fe5c00a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe5c400bbe0 tx=0x7fe5c400b390 comp rx=0 tx=0).stop 2024-09-19T08:55:12.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.713+0000 7fe5da0ef640 1 -- 172.21.15.92:0/3488606171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5d4102790 msgr2=0x7fe5d4198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:12.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.713+0000 7fe5da0ef640 1 --2- 172.21.15.92:0/3488606171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5d4102790 0x7fe5d4198870 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc00c920 tx=0x7fe5bc00cde0 comp rx=0 tx=0).stop 2024-09-19T08:55:12.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.713+0000 7fe5d3fff640 1 -- 172.21.15.92:0/3488606171 reap_dead start 2024-09-19T08:55:12.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.713+0000 7fe5da0ef640 1 -- 172.21.15.92:0/3488606171 shutdown_connections 2024-09-19T08:55:12.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.713+0000 7fe5da0ef640 1 -- 172.21.15.92:0/3488606171 >> 172.21.15.92:0/3488606171 conn(0x7fe5d40fd8c0 msgr2=0x7fe5d40ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:12.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.713+0000 7fe5da0ef640 1 -- 172.21.15.92:0/3488606171 shutdown_connections 2024-09-19T08:55:12.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:12.713+0000 7fe5da0ef640 1 -- 172.21.15.92:0/3488606171 wait complete. 2024-09-19T08:55:12.910 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:13.430 INFO:teuthology.orchestra.run.smithi092.stdout:34359738442 2024-09-19T08:55:13.430 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-19T08:55:13.713 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:13 smithi092 ceph-mon[31407]: pgmap v292: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 426 B/s wr, 1 op/s 2024-09-19T08:55:13.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:13 smithi167 ceph-mon[35359]: pgmap v292: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 426 B/s wr, 1 op/s 2024-09-19T08:55:13.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:13 smithi190 ceph-mon[35358]: pgmap v292: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 426 B/s wr, 1 op/s 2024-09-19T08:55:13.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.903+0000 7f3eeadbd640 1 -- 172.21.15.92:0/2989193883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ee4102570 msgr2=0x7f3ee41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:13.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.903+0000 7f3eeadbd640 1 --2- 172.21.15.92:0/2989193883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ee4102570 0x7f3ee41029b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0009900 tx=0x7f3ed002a480 comp rx=0 tx=0).stop 2024-09-19T08:55:13.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.903+0000 7f3eeadbd640 1 -- 172.21.15.92:0/2989193883 shutdown_connections 2024-09-19T08:55:13.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.903+0000 7f3eeadbd640 1 --2- 172.21.15.92:0/2989193883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ee4102ef0 0x7f3ee410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:13.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.903+0000 7f3eeadbd640 1 --2- 172.21.15.92:0/2989193883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ee4102570 0x7f3ee41029b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:13.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.903+0000 7f3eeadbd640 1 --2- 172.21.15.92:0/2989193883 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3ee4100e20 0x7f3ee4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:13.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.903+0000 7f3eeadbd640 1 -- 172.21.15.92:0/2989193883 >> 172.21.15.92:0/2989193883 conn(0x7f3ee40fc7d0 msgr2=0x7f3ee40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:13.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.903+0000 7f3eeadbd640 1 -- 172.21.15.92:0/2989193883 shutdown_connections 2024-09-19T08:55:13.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.903+0000 7f3eeadbd640 1 -- 172.21.15.92:0/2989193883 wait complete. 2024-09-19T08:55:13.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.904+0000 7f3eeadbd640 1 Processor -- start 2024-09-19T08:55:13.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.904+0000 7f3eeadbd640 1 -- start start 2024-09-19T08:55:13.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.904+0000 7f3eeadbd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ee4100e20 0x7f3ee41985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:13.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.904+0000 7f3eeadbd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3ee4102570 0x7f3ee4198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:13.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.904+0000 7f3eeadbd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ee4102ef0 0x7f3ee419ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:13.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.904+0000 7f3eeadbd640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee4110fa0 con 0x7f3ee4100e20 2024-09-19T08:55:13.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.904+0000 7f3eeadbd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee4110e20 con 0x7f3ee4102ef0 2024-09-19T08:55:13.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.904+0000 7f3eeadbd640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee4111120 con 0x7f3ee4102570 2024-09-19T08:55:13.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.904+0000 7f3ee8b59640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ee4100e20 0x7f3ee41985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:13.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.904+0000 7f3ee8b59640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ee4100e20 0x7f3ee41985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55172/0 (socket says 172.21.15.92:55172) 2024-09-19T08:55:13.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.904+0000 7f3ee8b59640 1 -- 172.21.15.92:0/1098618779 learned_addr learned my addr 172.21.15.92:0/1098618779 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:13.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.904+0000 7f3ee3fff640 1 --2- 172.21.15.92:0/1098618779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3ee4102570 0x7f3ee4198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:13.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.904+0000 7f3ee935a640 1 --2- 172.21.15.92:0/1098618779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ee4102ef0 0x7f3ee419ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:13.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.905+0000 7f3ee8b59640 1 -- 172.21.15.92:0/1098618779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3ee4102570 msgr2=0x7f3ee4198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:13.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.905+0000 7f3ee8b59640 1 --2- 172.21.15.92:0/1098618779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3ee4102570 0x7f3ee4198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:13.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.905+0000 7f3ee8b59640 1 -- 172.21.15.92:0/1098618779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ee4102ef0 msgr2=0x7f3ee419ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:13.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.905+0000 7f3ee8b59640 1 --2- 172.21.15.92:0/1098618779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ee4102ef0 0x7f3ee419ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:13.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.905+0000 7f3ee8b59640 1 -- 172.21.15.92:0/1098618779 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ee419d570 con 0x7f3ee4100e20 2024-09-19T08:55:13.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.905+0000 7f3ee935a640 1 --2- 172.21.15.92:0/1098618779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ee4102ef0 0x7f3ee419ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:55:13.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.905+0000 7f3ee8b59640 1 --2- 172.21.15.92:0/1098618779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ee4100e20 0x7f3ee41985c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800c890 tx=0x7f3ed800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:13.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.905+0000 7f3ee1ffb640 1 -- 172.21.15.92:0/1098618779 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed8004220 con 0x7f3ee4100e20 2024-09-19T08:55:13.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.905+0000 7f3eeadbd640 1 -- 172.21.15.92:0/1098618779 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ee419d860 con 0x7f3ee4100e20 2024-09-19T08:55:13.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.905+0000 7f3ee1ffb640 1 -- 172.21.15.92:0/1098618779 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ed80043c0 con 0x7f3ee4100e20 2024-09-19T08:55:13.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.905+0000 7f3ee1ffb640 1 -- 172.21.15.92:0/1098618779 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed80049e0 con 0x7f3ee4100e20 2024-09-19T08:55:13.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.905+0000 7f3eeadbd640 1 -- 172.21.15.92:0/1098618779 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ee40fcbb0 con 0x7f3ee4100e20 2024-09-19T08:55:13.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.906+0000 7f3eeadbd640 1 -- 172.21.15.92:0/1098618779 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3ee4062980 con 0x7f3ee4100e20 2024-09-19T08:55:13.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.908+0000 7f3ee1ffb640 1 -- 172.21.15.92:0/1098618779 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3ed80079b0 con 0x7f3ee4100e20 2024-09-19T08:55:13.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.909+0000 7f3ee1ffb640 1 --2- 172.21.15.92:0/1098618779 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3ed40a3350 0x7f3ed40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:13.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.909+0000 7f3ee3fff640 1 --2- 172.21.15.92:0/1098618779 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3ed40a3350 0x7f3ed40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:13.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.909+0000 7f3ee1ffb640 1 -- 172.21.15.92:0/1098618779 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3ed80cfd10 con 0x7f3ee4100e20 2024-09-19T08:55:13.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.909+0000 7f3ee1ffb640 1 --2- 172.21.15.92:0/1098618779 >> [v2:172.21.15.190:6808/1880491675,v1:172.21.15.190:6809/1880491675] conn(0x7f3ed40acf80 0x7f3ed40af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:13.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.909+0000 7f3ee1ffb640 1 -- 172.21.15.92:0/1098618779 --> [v2:172.21.15.190:6808/1880491675,v1:172.21.15.190:6809/1880491675] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3ed40afaf0 con 0x7f3ed40acf80 2024-09-19T08:55:13.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.909+0000 7f3ee1ffb640 1 -- 172.21.15.92:0/1098618779 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f3ed80d0140 con 0x7f3ee4100e20 2024-09-19T08:55:13.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.909+0000 7f3ee3fff640 1 --2- 172.21.15.92:0/1098618779 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3ed40a3350 0x7f3ed40a5810 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4100050 tx=0x7f3ed0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:13.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.910+0000 7f3ee935a640 1 --2- 172.21.15.92:0/1098618779 >> [v2:172.21.15.190:6808/1880491675,v1:172.21.15.190:6809/1880491675] conn(0x7f3ed40acf80 0x7f3ed40af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:13.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.910+0000 7f3ee935a640 1 --2- 172.21.15.92:0/1098618779 >> [v2:172.21.15.190:6808/1880491675,v1:172.21.15.190:6809/1880491675] conn(0x7f3ed40acf80 0x7f3ed40af420 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:13.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.911+0000 7f3ee1ffb640 1 -- 172.21.15.92:0/1098618779 <== osd.5 v2:172.21.15.190:6808/1880491675 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3ed40afaf0 con 0x7f3ed40acf80 2024-09-19T08:55:13.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.925+0000 7f3eeadbd640 1 -- 172.21.15.92:0/1098618779 --> [v2:172.21.15.190:6808/1880491675,v1:172.21.15.190:6809/1880491675] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3ee4062d80 con 0x7f3ed40acf80 2024-09-19T08:55:13.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.926+0000 7f3ee1ffb640 1 -- 172.21.15.92:0/1098618779 <== osd.5 v2:172.21.15.190:6808/1880491675 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3ee4062d80 con 0x7f3ed40acf80 2024-09-19T08:55:13.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.926+0000 7f3eeadbd640 1 -- 172.21.15.92:0/1098618779 >> [v2:172.21.15.190:6808/1880491675,v1:172.21.15.190:6809/1880491675] conn(0x7f3ed40acf80 msgr2=0x7f3ed40af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:13.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.926+0000 7f3eeadbd640 1 --2- 172.21.15.92:0/1098618779 >> [v2:172.21.15.190:6808/1880491675,v1:172.21.15.190:6809/1880491675] conn(0x7f3ed40acf80 0x7f3ed40af420 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:13.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.926+0000 7f3eeadbd640 1 -- 172.21.15.92:0/1098618779 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3ed40a3350 msgr2=0x7f3ed40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:13.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.926+0000 7f3eeadbd640 1 --2- 172.21.15.92:0/1098618779 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3ed40a3350 0x7f3ed40a5810 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4100050 tx=0x7f3ed0005a20 comp rx=0 tx=0).stop 2024-09-19T08:55:13.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.926+0000 7f3eeadbd640 1 -- 172.21.15.92:0/1098618779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ee4100e20 msgr2=0x7f3ee41985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:13.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.926+0000 7f3eeadbd640 1 --2- 172.21.15.92:0/1098618779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ee4100e20 0x7f3ee41985c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800c890 tx=0x7f3ed800cd50 comp rx=0 tx=0).stop 2024-09-19T08:55:13.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.926+0000 7f3ee935a640 1 -- 172.21.15.92:0/1098618779 reap_dead start 2024-09-19T08:55:13.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.926+0000 7f3eeadbd640 1 -- 172.21.15.92:0/1098618779 shutdown_connections 2024-09-19T08:55:13.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.926+0000 7f3eeadbd640 1 -- 172.21.15.92:0/1098618779 >> 172.21.15.92:0/1098618779 conn(0x7f3ee40fc7d0 msgr2=0x7f3ee406a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:13.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.926+0000 7f3eeadbd640 1 -- 172.21.15.92:0/1098618779 shutdown_connections 2024-09-19T08:55:13.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:13.926+0000 7f3eeadbd640 1 -- 172.21.15.92:0/1098618779 wait complete. 2024-09-19T08:55:13.935 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:14.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.935+0000 7f6426bcd640 1 -- 172.21.15.92:0/621660044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6420101400 msgr2=0x7f642010d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:14.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.935+0000 7f6426bcd640 1 --2- 172.21.15.92:0/621660044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6420101400 0x7f642010d930 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6408009930 tx=0x7f640802a420 comp rx=0 tx=0).stop 2024-09-19T08:55:14.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.935+0000 7f6426bcd640 1 -- 172.21.15.92:0/621660044 shutdown_connections 2024-09-19T08:55:14.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.935+0000 7f6426bcd640 1 --2- 172.21.15.92:0/621660044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6420101400 0x7f642010d930 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.935+0000 7f6426bcd640 1 --2- 172.21.15.92:0/621660044 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6420100a60 0x7f6420100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.935+0000 7f6426bcd640 1 --2- 172.21.15.92:0/621660044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6420106a60 0x7f6420106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.936+0000 7f6426bcd640 1 -- 172.21.15.92:0/621660044 >> 172.21.15.92:0/621660044 conn(0x7f64200fc780 msgr2=0x7f64200feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:14.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.936+0000 7f6426bcd640 1 -- 172.21.15.92:0/621660044 shutdown_connections 2024-09-19T08:55:14.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.936+0000 7f6426bcd640 1 -- 172.21.15.92:0/621660044 wait complete. 2024-09-19T08:55:14.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.936+0000 7f6426bcd640 1 Processor -- start 2024-09-19T08:55:14.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.936+0000 7f6426bcd640 1 -- start start 2024-09-19T08:55:14.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.936+0000 7f6426bcd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6420100a60 0x7f642019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:14.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.936+0000 7f6426bcd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6420101400 0x7f642019ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:14.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.936+0000 7f6426bcd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6420106a60 0x7f642019ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:14.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.936+0000 7f6426bcd640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6420110e60 con 0x7f6420101400 2024-09-19T08:55:14.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.936+0000 7f6426bcd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6420110ce0 con 0x7f6420100a60 2024-09-19T08:55:14.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.936+0000 7f6426bcd640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6420110fe0 con 0x7f6420106a60 2024-09-19T08:55:14.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.936+0000 7f641ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6420101400 0x7f642019ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:14.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.936+0000 7f641ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6420101400 0x7f642019ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55192/0 (socket says 172.21.15.92:55192) 2024-09-19T08:55:14.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.936+0000 7f641ffff640 1 -- 172.21.15.92:0/2762405525 learned_addr learned my addr 172.21.15.92:0/2762405525 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:14.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.937+0000 7f6424969640 1 --2- 172.21.15.92:0/2762405525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6420100a60 0x7f642019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:14.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.937+0000 7f642516a640 1 --2- 172.21.15.92:0/2762405525 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6420106a60 0x7f642019ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:14.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.937+0000 7f641ffff640 1 -- 172.21.15.92:0/2762405525 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6420106a60 msgr2=0x7f642019ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:14.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.937+0000 7f641ffff640 1 --2- 172.21.15.92:0/2762405525 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6420106a60 0x7f642019ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.937+0000 7f641ffff640 1 -- 172.21.15.92:0/2762405525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6420100a60 msgr2=0x7f642019a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:14.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.937+0000 7f641ffff640 1 --2- 172.21.15.92:0/2762405525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6420100a60 0x7f642019a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.937+0000 7f641ffff640 1 -- 172.21.15.92:0/2762405525 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f642019f570 con 0x7f6420101400 2024-09-19T08:55:14.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.937+0000 7f6424969640 1 --2- 172.21.15.92:0/2762405525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6420100a60 0x7f642019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:55:14.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.937+0000 7f641ffff640 1 --2- 172.21.15.92:0/2762405525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6420101400 0x7f642019ab00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f641000eab0 tx=0x7f641000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:14.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.937+0000 7f641dffb640 1 -- 172.21.15.92:0/2762405525 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641000ce40 con 0x7f6420101400 2024-09-19T08:55:14.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.937+0000 7f641dffb640 1 -- 172.21.15.92:0/2762405525 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6410011950 con 0x7f6420101400 2024-09-19T08:55:14.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.937+0000 7f6426bcd640 1 -- 172.21.15.92:0/2762405525 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f642019f860 con 0x7f6420101400 2024-09-19T08:55:14.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.937+0000 7f641dffb640 1 -- 172.21.15.92:0/2762405525 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6410010ae0 con 0x7f6420101400 2024-09-19T08:55:14.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.937+0000 7f6426bcd640 1 -- 172.21.15.92:0/2762405525 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64201a7140 con 0x7f6420101400 2024-09-19T08:55:14.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.938+0000 7f6426bcd640 1 -- 172.21.15.92:0/2762405525 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f642010d100 con 0x7f6420101400 2024-09-19T08:55:14.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.939+0000 7f641dffb640 1 -- 172.21.15.92:0/2762405525 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6410011b00 con 0x7f6420101400 2024-09-19T08:55:14.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.940+0000 7f641dffb640 1 --2- 172.21.15.92:0/2762405525 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f640c0a32d0 0x7f640c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:14.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.940+0000 7f6424969640 1 --2- 172.21.15.92:0/2762405525 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f640c0a32d0 0x7f640c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:14.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.940+0000 7f641dffb640 1 -- 172.21.15.92:0/2762405525 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f64100d0240 con 0x7f6420101400 2024-09-19T08:55:14.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.940+0000 7f641dffb640 1 --2- 172.21.15.92:0/2762405525 >> [v2:172.21.15.92:6810/945752895,v1:172.21.15.92:6811/945752895] conn(0x7f640c0acf00 0x7f640c0af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:14.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.940+0000 7f641dffb640 1 -- 172.21.15.92:0/2762405525 --> [v2:172.21.15.92:6810/945752895,v1:172.21.15.92:6811/945752895] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6410014ec0 con 0x7f640c0acf00 2024-09-19T08:55:14.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.940+0000 7f641dffb640 1 -- 172.21.15.92:0/2762405525 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f64100d0670 con 0x7f6420101400 2024-09-19T08:55:14.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.941+0000 7f642516a640 1 --2- 172.21.15.92:0/2762405525 >> [v2:172.21.15.92:6810/945752895,v1:172.21.15.92:6811/945752895] conn(0x7f640c0acf00 0x7f640c0af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:14.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.941+0000 7f6424969640 1 --2- 172.21.15.92:0/2762405525 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f640c0a32d0 0x7f640c0a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6418005d90 tx=0x7f6418005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:14.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.941+0000 7f642516a640 1 --2- 172.21.15.92:0/2762405525 >> [v2:172.21.15.92:6810/945752895,v1:172.21.15.92:6811/945752895] conn(0x7f640c0acf00 0x7f640c0af3a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:14.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.942+0000 7f641dffb640 1 -- 172.21.15.92:0/2762405525 <== osd.3 v2:172.21.15.92:6810/945752895 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6410014ec0 con 0x7f640c0acf00 2024-09-19T08:55:14.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.955+0000 7f6426bcd640 1 -- 172.21.15.92:0/2762405525 --> [v2:172.21.15.92:6810/945752895,v1:172.21.15.92:6811/945752895] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f64201021a0 con 0x7f640c0acf00 2024-09-19T08:55:14.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.955+0000 7f641dffb640 1 -- 172.21.15.92:0/2762405525 <== osd.3 v2:172.21.15.92:6810/945752895 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f64201021a0 con 0x7f640c0acf00 2024-09-19T08:55:14.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.955+0000 7f6426bcd640 1 -- 172.21.15.92:0/2762405525 >> [v2:172.21.15.92:6810/945752895,v1:172.21.15.92:6811/945752895] conn(0x7f640c0acf00 msgr2=0x7f640c0af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:14.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.955+0000 7f6426bcd640 1 --2- 172.21.15.92:0/2762405525 >> [v2:172.21.15.92:6810/945752895,v1:172.21.15.92:6811/945752895] conn(0x7f640c0acf00 0x7f640c0af3a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.956+0000 7f6426bcd640 1 -- 172.21.15.92:0/2762405525 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f640c0a32d0 msgr2=0x7f640c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:14.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.956+0000 7f6426bcd640 1 --2- 172.21.15.92:0/2762405525 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f640c0a32d0 0x7f640c0a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6418005d90 tx=0x7f6418005d20 comp rx=0 tx=0).stop 2024-09-19T08:55:14.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.956+0000 7f6426bcd640 1 -- 172.21.15.92:0/2762405525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6420101400 msgr2=0x7f642019ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:14.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.956+0000 7f6426bcd640 1 --2- 172.21.15.92:0/2762405525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6420101400 0x7f642019ab00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f641000eab0 tx=0x7f641000ef70 comp rx=0 tx=0).stop 2024-09-19T08:55:14.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.956+0000 7f642516a640 1 -- 172.21.15.92:0/2762405525 reap_dead start 2024-09-19T08:55:14.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.956+0000 7f6426bcd640 1 -- 172.21.15.92:0/2762405525 shutdown_connections 2024-09-19T08:55:14.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.956+0000 7f6426bcd640 1 -- 172.21.15.92:0/2762405525 >> 172.21.15.92:0/2762405525 conn(0x7f64200fc780 msgr2=0x7f642010c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:14.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.956+0000 7f6426bcd640 1 -- 172.21.15.92:0/2762405525 shutdown_connections 2024-09-19T08:55:14.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:14.956+0000 7f6426bcd640 1 -- 172.21.15.92:0/2762405525 wait complete. 2024-09-19T08:55:15.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.085+0000 7f2f6cc28640 1 -- 172.21.15.92:0/2957110001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f68103740 msgr2=0x7f2f68107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:15.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.085+0000 7f2f6cc28640 1 --2- 172.21.15.92:0/2957110001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f68103740 0x7f2f68107b80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2f50009930 tx=0x7f2f5002a420 comp rx=0 tx=0).stop 2024-09-19T08:55:15.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.085+0000 7f2f6cc28640 1 -- 172.21.15.92:0/2957110001 shutdown_connections 2024-09-19T08:55:15.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.085+0000 7f2f6cc28640 1 --2- 172.21.15.92:0/2957110001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f68108290 0x7f2f6810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:15.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.085+0000 7f2f6cc28640 1 --2- 172.21.15.92:0/2957110001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f68103740 0x7f2f68107b80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:15.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.085+0000 7f2f6cc28640 1 --2- 172.21.15.92:0/2957110001 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2f68102d90 0x7f2f68103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:15.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.085+0000 7f2f6cc28640 1 -- 172.21.15.92:0/2957110001 >> 172.21.15.92:0/2957110001 conn(0x7f2f680fc7d0 msgr2=0x7f2f680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:15.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.085+0000 7f2f6cc28640 1 -- 172.21.15.92:0/2957110001 shutdown_connections 2024-09-19T08:55:15.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.086+0000 7f2f6cc28640 1 -- 172.21.15.92:0/2957110001 wait complete. 2024-09-19T08:55:15.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.086+0000 7f2f6cc28640 1 Processor -- start 2024-09-19T08:55:15.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.086+0000 7f2f6cc28640 1 -- start start 2024-09-19T08:55:15.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.086+0000 7f2f6cc28640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f68102d90 0x7f2f68198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:15.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.086+0000 7f2f6cc28640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f68103740 0x7f2f68198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:15.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.086+0000 7f2f6cc28640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2f68108290 0x7f2f6819cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:15.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.086+0000 7f2f6cc28640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2f68112130 con 0x7f2f68103740 2024-09-19T08:55:15.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.086+0000 7f2f6cc28640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2f68111fb0 con 0x7f2f68102d90 2024-09-19T08:55:15.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.086+0000 7f2f6cc28640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2f681122b0 con 0x7f2f68108290 2024-09-19T08:55:15.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.087+0000 7f2f65d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f68103740 0x7f2f68198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:15.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.087+0000 7f2f65d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f68103740 0x7f2f68198c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55218/0 (socket says 172.21.15.92:55218) 2024-09-19T08:55:15.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.087+0000 7f2f65d9b640 1 -- 172.21.15.92:0/3876087871 learned_addr learned my addr 172.21.15.92:0/3876087871 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:15.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.087+0000 7f2f6659c640 1 --2- 172.21.15.92:0/3876087871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f68102d90 0x7f2f68198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:15.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.087+0000 7f2f65d9b640 1 -- 172.21.15.92:0/3876087871 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2f68108290 msgr2=0x7f2f6819cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:15.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.087+0000 7f2f65d9b640 1 --2- 172.21.15.92:0/3876087871 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2f68108290 0x7f2f6819cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:15.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.087+0000 7f2f65d9b640 1 -- 172.21.15.92:0/3876087871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f68102d90 msgr2=0x7f2f68198710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:15.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.087+0000 7f2f65d9b640 1 --2- 172.21.15.92:0/3876087871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f68102d90 0x7f2f68198710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:15.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.087+0000 7f2f65d9b640 1 -- 172.21.15.92:0/3876087871 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f6819d6c0 con 0x7f2f68103740 2024-09-19T08:55:15.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.087+0000 7f2f6659c640 1 --2- 172.21.15.92:0/3876087871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f68102d90 0x7f2f68198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:55:15.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.087+0000 7f2f65d9b640 1 --2- 172.21.15.92:0/3876087871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f68103740 0x7f2f68198c50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2f50009230 tx=0x7f2f500042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:15.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.087+0000 7f2f5f7fe640 1 -- 172.21.15.92:0/3876087871 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f5003f030 con 0x7f2f68103740 2024-09-19T08:55:15.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.087+0000 7f2f6cc28640 1 -- 172.21.15.92:0/3876087871 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f6819d950 con 0x7f2f68103740 2024-09-19T08:55:15.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.087+0000 7f2f5f7fe640 1 -- 172.21.15.92:0/3876087871 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f50003ce0 con 0x7f2f68103740 2024-09-19T08:55:15.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.087+0000 7f2f5f7fe640 1 -- 172.21.15.92:0/3876087871 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f50035070 con 0x7f2f68103740 2024-09-19T08:55:15.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.087+0000 7f2f6cc28640 1 -- 172.21.15.92:0/3876087871 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f681a5290 con 0x7f2f68103740 2024-09-19T08:55:15.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.088+0000 7f2f6cc28640 1 -- 172.21.15.92:0/3876087871 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2f68062980 con 0x7f2f68103740 2024-09-19T08:55:15.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.089+0000 7f2f5f7fe640 1 -- 172.21.15.92:0/3876087871 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2f50042030 con 0x7f2f68103740 2024-09-19T08:55:15.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.090+0000 7f2f5f7fe640 1 --2- 172.21.15.92:0/3876087871 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2f540a32d0 0x7f2f540a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:15.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.090+0000 7f2f6659c640 1 --2- 172.21.15.92:0/3876087871 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2f540a32d0 0x7f2f540a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:15.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.090+0000 7f2f5f7fe640 1 -- 172.21.15.92:0/3876087871 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2f500f0500 con 0x7f2f68103740 2024-09-19T08:55:15.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.090+0000 7f2f5f7fe640 1 --2- 172.21.15.92:0/3876087871 >> [v2:172.21.15.190:6824/1849208751,v1:172.21.15.190:6825/1849208751] conn(0x7f2f540acf00 0x7f2f540af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:15.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.090+0000 7f2f5f7fe640 1 -- 172.21.15.92:0/3876087871 --> [v2:172.21.15.190:6824/1849208751,v1:172.21.15.190:6825/1849208751] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2f5000b0b0 con 0x7f2f540acf00 2024-09-19T08:55:15.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.090+0000 7f2f5f7fe640 1 -- 172.21.15.92:0/3876087871 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f2f500f0930 con 0x7f2f68103740 2024-09-19T08:55:15.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.090+0000 7f2f6659c640 1 --2- 172.21.15.92:0/3876087871 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2f540a32d0 0x7f2f540a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2f58007eb0 tx=0x7f2f580073c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:15.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.091+0000 7f2f66d9d640 1 --2- 172.21.15.92:0/3876087871 >> [v2:172.21.15.190:6824/1849208751,v1:172.21.15.190:6825/1849208751] conn(0x7f2f540acf00 0x7f2f540af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:15.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.091+0000 7f2f66d9d640 1 --2- 172.21.15.92:0/3876087871 >> [v2:172.21.15.190:6824/1849208751,v1:172.21.15.190:6825/1849208751] conn(0x7f2f540acf00 0x7f2f540af3a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:15.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.092+0000 7f2f5f7fe640 1 -- 172.21.15.92:0/3876087871 <== osd.11 v2:172.21.15.190:6824/1849208751 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2f5000b0b0 con 0x7f2f540acf00 2024-09-19T08:55:15.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.105+0000 7f2f6cc28640 1 -- 172.21.15.92:0/3876087871 --> [v2:172.21.15.190:6824/1849208751,v1:172.21.15.190:6825/1849208751] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2f68062d80 con 0x7f2f540acf00 2024-09-19T08:55:15.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.106+0000 7f2f5f7fe640 1 -- 172.21.15.92:0/3876087871 <== osd.11 v2:172.21.15.190:6824/1849208751 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2f68062d80 con 0x7f2f540acf00 2024-09-19T08:55:15.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.106+0000 7f2f6cc28640 1 -- 172.21.15.92:0/3876087871 >> [v2:172.21.15.190:6824/1849208751,v1:172.21.15.190:6825/1849208751] conn(0x7f2f540acf00 msgr2=0x7f2f540af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:15.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.106+0000 7f2f6cc28640 1 --2- 172.21.15.92:0/3876087871 >> [v2:172.21.15.190:6824/1849208751,v1:172.21.15.190:6825/1849208751] conn(0x7f2f540acf00 0x7f2f540af3a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:15.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.106+0000 7f2f6cc28640 1 -- 172.21.15.92:0/3876087871 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2f540a32d0 msgr2=0x7f2f540a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:15.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.106+0000 7f2f6cc28640 1 --2- 172.21.15.92:0/3876087871 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2f540a32d0 0x7f2f540a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2f58007eb0 tx=0x7f2f580073c0 comp rx=0 tx=0).stop 2024-09-19T08:55:15.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.106+0000 7f2f6cc28640 1 -- 172.21.15.92:0/3876087871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f68103740 msgr2=0x7f2f68198c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:15.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.106+0000 7f2f6cc28640 1 --2- 172.21.15.92:0/3876087871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f68103740 0x7f2f68198c50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2f50009230 tx=0x7f2f500042f0 comp rx=0 tx=0).stop 2024-09-19T08:55:15.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.106+0000 7f2f66d9d640 1 -- 172.21.15.92:0/3876087871 reap_dead start 2024-09-19T08:55:15.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.106+0000 7f2f6cc28640 1 -- 172.21.15.92:0/3876087871 shutdown_connections 2024-09-19T08:55:15.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.106+0000 7f2f6cc28640 1 -- 172.21.15.92:0/3876087871 >> 172.21.15.92:0/3876087871 conn(0x7f2f680fc7d0 msgr2=0x7f2f68105e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:15.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.106+0000 7f2f6cc28640 1 -- 172.21.15.92:0/3876087871 shutdown_connections 2024-09-19T08:55:15.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:15.106+0000 7f2f6cc28640 1 -- 172.21.15.92:0/3876087871 wait complete. 2024-09-19T08:55:15.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:15 smithi092 ceph-mon[31407]: pgmap v293: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-19T08:55:15.763 INFO:teuthology.orchestra.run.smithi092.stdout:317827579926 2024-09-19T08:55:15.764 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-19T08:55:15.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:15 smithi167 ceph-mon[35359]: pgmap v293: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-19T08:55:15.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:15 smithi190 ceph-mon[35358]: pgmap v293: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-19T08:55:16.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.304+0000 7f9b4fa9b640 1 -- 172.21.15.92:0/2714692089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b48100e20 msgr2=0x7f9b48101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:16.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.304+0000 7f9b4fa9b640 1 --2- 172.21.15.92:0/2714692089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b48100e20 0x7f9b48101200 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9b44009900 tx=0x7f9b4402a480 comp rx=0 tx=0).stop 2024-09-19T08:55:16.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.304+0000 7f9b4fa9b640 1 -- 172.21.15.92:0/2714692089 shutdown_connections 2024-09-19T08:55:16.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.304+0000 7f9b4fa9b640 1 --2- 172.21.15.92:0/2714692089 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b48102ef0 0x7f9b4810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:16.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.304+0000 7f9b4fa9b640 1 --2- 172.21.15.92:0/2714692089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b48102570 0x7f9b481029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:16.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.304+0000 7f9b4fa9b640 1 --2- 172.21.15.92:0/2714692089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b48100e20 0x7f9b48101200 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:16.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.304+0000 7f9b4fa9b640 1 -- 172.21.15.92:0/2714692089 >> 172.21.15.92:0/2714692089 conn(0x7f9b480fc7d0 msgr2=0x7f9b480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:16.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.304+0000 7f9b4fa9b640 1 -- 172.21.15.92:0/2714692089 shutdown_connections 2024-09-19T08:55:16.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.305+0000 7f9b4fa9b640 1 -- 172.21.15.92:0/2714692089 wait complete. 2024-09-19T08:55:16.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.305+0000 7f9b4fa9b640 1 Processor -- start 2024-09-19T08:55:16.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.305+0000 7f9b4fa9b640 1 -- start start 2024-09-19T08:55:16.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.305+0000 7f9b4fa9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b48100e20 0x7f9b48198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:16.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.305+0000 7f9b4fa9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b48102570 0x7f9b48198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:16.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.305+0000 7f9b4fa9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b48102ef0 0x7f9b4819cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:16.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.305+0000 7f9b4fa9b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9b48111020 con 0x7f9b48102ef0 2024-09-19T08:55:16.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.306+0000 7f9b4fa9b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9b48110ea0 con 0x7f9b48102570 2024-09-19T08:55:16.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.306+0000 7f9b4fa9b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9b481111a0 con 0x7f9b48100e20 2024-09-19T08:55:16.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.306+0000 7f9b4d036640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b48102570 0x7f9b48198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:16.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.306+0000 7f9b4e038640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b48102ef0 0x7f9b4819cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:16.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.306+0000 7f9b4d036640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b48102570 0x7f9b48198b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:46722/0 (socket says 172.21.15.92:46722) 2024-09-19T08:55:16.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.306+0000 7f9b4d036640 1 -- 172.21.15.92:0/504815390 learned_addr learned my addr 172.21.15.92:0/504815390 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:16.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.306+0000 7f9b4d837640 1 --2- 172.21.15.92:0/504815390 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b48100e20 0x7f9b48198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:16.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.306+0000 7f9b4e038640 1 -- 172.21.15.92:0/504815390 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b48100e20 msgr2=0x7f9b48198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:16.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.306+0000 7f9b4e038640 1 --2- 172.21.15.92:0/504815390 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b48100e20 0x7f9b48198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:16.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.306+0000 7f9b4e038640 1 -- 172.21.15.92:0/504815390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b48102570 msgr2=0x7f9b48198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:16.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.306+0000 7f9b4e038640 1 --2- 172.21.15.92:0/504815390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b48102570 0x7f9b48198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:16.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.306+0000 7f9b4e038640 1 -- 172.21.15.92:0/504815390 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b4819d5f0 con 0x7f9b48102ef0 2024-09-19T08:55:16.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.306+0000 7f9b4e038640 1 --2- 172.21.15.92:0/504815390 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b48102ef0 0x7f9b4819cf10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9b4000be20 tx=0x7f9b4000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:16.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.306+0000 7f9b3effd640 1 -- 172.21.15.92:0/504815390 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b40019070 con 0x7f9b48102ef0 2024-09-19T08:55:16.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.306+0000 7f9b4fa9b640 1 -- 172.21.15.92:0/504815390 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b4819d8e0 con 0x7f9b48102ef0 2024-09-19T08:55:16.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.306+0000 7f9b3effd640 1 -- 172.21.15.92:0/504815390 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b40014920 con 0x7f9b48102ef0 2024-09-19T08:55:16.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.307+0000 7f9b3effd640 1 -- 172.21.15.92:0/504815390 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b40012880 con 0x7f9b48102ef0 2024-09-19T08:55:16.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.307+0000 7f9b4fa9b640 1 -- 172.21.15.92:0/504815390 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b481a51c0 con 0x7f9b48102ef0 2024-09-19T08:55:16.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.307+0000 7f9b4fa9b640 1 -- 172.21.15.92:0/504815390 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9b48062980 con 0x7f9b48102ef0 2024-09-19T08:55:16.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.310+0000 7f9b3effd640 1 -- 172.21.15.92:0/504815390 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9b4001c070 con 0x7f9b48102ef0 2024-09-19T08:55:16.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.310+0000 7f9b3effd640 1 --2- 172.21.15.92:0/504815390 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9b340a3350 0x7f9b340a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:16.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.310+0000 7f9b4d837640 1 --2- 172.21.15.92:0/504815390 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9b340a3350 0x7f9b340a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:16.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.310+0000 7f9b3effd640 1 -- 172.21.15.92:0/504815390 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9b400cf850 con 0x7f9b48102ef0 2024-09-19T08:55:16.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.311+0000 7f9b3effd640 1 --2- 172.21.15.92:0/504815390 >> [v2:172.21.15.92:6826/3066744542,v1:172.21.15.92:6827/3066744542] conn(0x7f9b340acf80 0x7f9b340af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:16.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.311+0000 7f9b3effd640 1 -- 172.21.15.92:0/504815390 --> [v2:172.21.15.92:6826/3066744542,v1:172.21.15.92:6827/3066744542] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9b4000b260 con 0x7f9b340acf80 2024-09-19T08:55:16.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.311+0000 7f9b3effd640 1 -- 172.21.15.92:0/504815390 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f9b400cfc80 con 0x7f9b48102ef0 2024-09-19T08:55:16.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.311+0000 7f9b4d036640 1 --2- 172.21.15.92:0/504815390 >> [v2:172.21.15.92:6826/3066744542,v1:172.21.15.92:6827/3066744542] conn(0x7f9b340acf80 0x7f9b340af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:16.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.311+0000 7f9b4d837640 1 --2- 172.21.15.92:0/504815390 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9b340a3350 0x7f9b340a5810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9b44000c00 tx=0x7f9b440058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:16.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.311+0000 7f9b4d036640 1 --2- 172.21.15.92:0/504815390 >> [v2:172.21.15.92:6826/3066744542,v1:172.21.15.92:6827/3066744542] conn(0x7f9b340acf80 0x7f9b340af420 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:16.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.312+0000 7f9b3effd640 1 -- 172.21.15.92:0/504815390 <== osd.9 v2:172.21.15.92:6826/3066744542 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9b4000b260 con 0x7f9b340acf80 2024-09-19T08:55:16.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.326+0000 7f9b4fa9b640 1 -- 172.21.15.92:0/504815390 --> [v2:172.21.15.92:6826/3066744542,v1:172.21.15.92:6827/3066744542] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9b48062d80 con 0x7f9b340acf80 2024-09-19T08:55:16.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.326+0000 7f9b3effd640 1 -- 172.21.15.92:0/504815390 <== osd.9 v2:172.21.15.92:6826/3066744542 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9b48062d80 con 0x7f9b340acf80 2024-09-19T08:55:16.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.326+0000 7f9b4fa9b640 1 -- 172.21.15.92:0/504815390 >> [v2:172.21.15.92:6826/3066744542,v1:172.21.15.92:6827/3066744542] conn(0x7f9b340acf80 msgr2=0x7f9b340af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:16.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.326+0000 7f9b4fa9b640 1 --2- 172.21.15.92:0/504815390 >> [v2:172.21.15.92:6826/3066744542,v1:172.21.15.92:6827/3066744542] conn(0x7f9b340acf80 0x7f9b340af420 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:16.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.326+0000 7f9b4fa9b640 1 -- 172.21.15.92:0/504815390 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9b340a3350 msgr2=0x7f9b340a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:16.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.326+0000 7f9b4fa9b640 1 --2- 172.21.15.92:0/504815390 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9b340a3350 0x7f9b340a5810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9b44000c00 tx=0x7f9b440058d0 comp rx=0 tx=0).stop 2024-09-19T08:55:16.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.326+0000 7f9b4fa9b640 1 -- 172.21.15.92:0/504815390 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b48102ef0 msgr2=0x7f9b4819cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:16.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.326+0000 7f9b4fa9b640 1 --2- 172.21.15.92:0/504815390 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b48102ef0 0x7f9b4819cf10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9b4000be20 tx=0x7f9b4000bf10 comp rx=0 tx=0).stop 2024-09-19T08:55:16.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.327+0000 7f9b4e038640 1 -- 172.21.15.92:0/504815390 reap_dead start 2024-09-19T08:55:16.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.327+0000 7f9b4fa9b640 1 -- 172.21.15.92:0/504815390 shutdown_connections 2024-09-19T08:55:16.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.327+0000 7f9b4fa9b640 1 -- 172.21.15.92:0/504815390 >> 172.21.15.92:0/504815390 conn(0x7f9b480fc7d0 msgr2=0x7f9b4806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:16.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.327+0000 7f9b4fa9b640 1 -- 172.21.15.92:0/504815390 shutdown_connections 2024-09-19T08:55:16.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.327+0000 7f9b4fa9b640 1 -- 172.21.15.92:0/504815390 wait complete. 2024-09-19T08:55:16.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.926+0000 7f9ad9cd7640 1 -- 172.21.15.92:0/1749033735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ad4100e20 msgr2=0x7f9ad4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:16.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.926+0000 7f9ad9cd7640 1 --2- 172.21.15.92:0/1749033735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ad4100e20 0x7f9ad4101200 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4009900 tx=0x7f9ac402a480 comp rx=0 tx=0).stop 2024-09-19T08:55:16.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.926+0000 7f9ad9cd7640 1 -- 172.21.15.92:0/1749033735 shutdown_connections 2024-09-19T08:55:16.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.926+0000 7f9ad9cd7640 1 --2- 172.21.15.92:0/1749033735 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ad4102ef0 0x7f9ad410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:16.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.926+0000 7f9ad9cd7640 1 --2- 172.21.15.92:0/1749033735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ad4102570 0x7f9ad41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:16.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.926+0000 7f9ad9cd7640 1 --2- 172.21.15.92:0/1749033735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ad4100e20 0x7f9ad4101200 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:16.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.926+0000 7f9ad9cd7640 1 -- 172.21.15.92:0/1749033735 >> 172.21.15.92:0/1749033735 conn(0x7f9ad40fc7d0 msgr2=0x7f9ad40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:16.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.926+0000 7f9ad9cd7640 1 -- 172.21.15.92:0/1749033735 shutdown_connections 2024-09-19T08:55:16.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.926+0000 7f9ad9cd7640 1 -- 172.21.15.92:0/1749033735 wait complete. 2024-09-19T08:55:16.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.926+0000 7f9ad9cd7640 1 Processor -- start 2024-09-19T08:55:16.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.927+0000 7f9ad9cd7640 1 -- start start 2024-09-19T08:55:16.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.927+0000 7f9ad9cd7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ad4100e20 0x7f9ad40fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:16.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.927+0000 7f9ad9cd7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ad4102570 0x7f9ad40fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:16.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.927+0000 7f9ad9cd7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ad4102ef0 0x7f9ad40fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:16.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.927+0000 7f9ad9cd7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad4110f50 con 0x7f9ad4102570 2024-09-19T08:55:16.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.927+0000 7f9ad9cd7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad4110dd0 con 0x7f9ad4102ef0 2024-09-19T08:55:16.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.927+0000 7f9ad9cd7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad41110d0 con 0x7f9ad4100e20 2024-09-19T08:55:16.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.927+0000 7f9ad2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ad4102570 0x7f9ad40fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:16.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.927+0000 7f9ad2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ad4102570 0x7f9ad40fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55248/0 (socket says 172.21.15.92:55248) 2024-09-19T08:55:16.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.927+0000 7f9ad2ffd640 1 -- 172.21.15.92:0/1737240596 learned_addr learned my addr 172.21.15.92:0/1737240596 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:16.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.927+0000 7f9ad37fe640 1 --2- 172.21.15.92:0/1737240596 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ad4100e20 0x7f9ad40fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:16.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.927+0000 7f9ad3fff640 1 --2- 172.21.15.92:0/1737240596 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ad4102ef0 0x7f9ad40fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:16.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.927+0000 7f9ad2ffd640 1 -- 172.21.15.92:0/1737240596 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ad4100e20 msgr2=0x7f9ad40fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:16.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.927+0000 7f9ad2ffd640 1 --2- 172.21.15.92:0/1737240596 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ad4100e20 0x7f9ad40fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:16.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.927+0000 7f9ad2ffd640 1 -- 172.21.15.92:0/1737240596 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ad4102ef0 msgr2=0x7f9ad40fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:16.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.927+0000 7f9ad2ffd640 1 --2- 172.21.15.92:0/1737240596 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ad4102ef0 0x7f9ad40fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:16.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.927+0000 7f9ad2ffd640 1 -- 172.21.15.92:0/1737240596 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad41a6960 con 0x7f9ad4102570 2024-09-19T08:55:16.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.928+0000 7f9ad2ffd640 1 --2- 172.21.15.92:0/1737240596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ad4102570 0x7f9ad40fd1c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9abc00c920 tx=0x7f9abc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:16.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.928+0000 7f9ad0ff9640 1 -- 172.21.15.92:0/1737240596 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc007c70 con 0x7f9ad4102570 2024-09-19T08:55:16.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.928+0000 7f9ad9cd7640 1 -- 172.21.15.92:0/1737240596 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ad41a6c50 con 0x7f9ad4102570 2024-09-19T08:55:16.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.928+0000 7f9ad0ff9640 1 -- 172.21.15.92:0/1737240596 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9abc007e10 con 0x7f9ad4102570 2024-09-19T08:55:16.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.928+0000 7f9ad0ff9640 1 -- 172.21.15.92:0/1737240596 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc018890 con 0x7f9ad4102570 2024-09-19T08:55:16.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.928+0000 7f9ad9cd7640 1 -- 172.21.15.92:0/1737240596 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ad41a7190 con 0x7f9ad4102570 2024-09-19T08:55:16.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.929+0000 7f9ad9cd7640 1 -- 172.21.15.92:0/1737240596 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9ad4062940 con 0x7f9ad4102570 2024-09-19T08:55:16.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.930+0000 7f9ad0ff9640 1 -- 172.21.15.92:0/1737240596 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9abc018b30 con 0x7f9ad4102570 2024-09-19T08:55:16.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.931+0000 7f9ad0ff9640 1 --2- 172.21.15.92:0/1737240596 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9ac00a32d0 0x7f9ac00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:16.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.931+0000 7f9ad37fe640 1 --2- 172.21.15.92:0/1737240596 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9ac00a32d0 0x7f9ac00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:16.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.931+0000 7f9ad0ff9640 1 -- 172.21.15.92:0/1737240596 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9abc0cfc70 con 0x7f9ad4102570 2024-09-19T08:55:16.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.931+0000 7f9ad0ff9640 1 --2- 172.21.15.92:0/1737240596 >> [v2:172.21.15.167:6808/3576893400,v1:172.21.15.167:6809/3576893400] conn(0x7f9ac00acf00 0x7f9ac00af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:16.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.931+0000 7f9ad0ff9640 1 -- 172.21.15.92:0/1737240596 --> [v2:172.21.15.167:6808/3576893400,v1:172.21.15.167:6809/3576893400] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9abc012ec0 con 0x7f9ac00acf00 2024-09-19T08:55:16.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.931+0000 7f9ad0ff9640 1 -- 172.21.15.92:0/1737240596 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f9abc0d2310 con 0x7f9ad4102570 2024-09-19T08:55:16.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.931+0000 7f9ad37fe640 1 --2- 172.21.15.92:0/1737240596 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9ac00a32d0 0x7f9ac00a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4005ab0 tx=0x7f9ac4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:16.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.931+0000 7f9ad3fff640 1 --2- 172.21.15.92:0/1737240596 >> [v2:172.21.15.167:6808/3576893400,v1:172.21.15.167:6809/3576893400] conn(0x7f9ac00acf00 0x7f9ac00af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:16.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.932+0000 7f9ad3fff640 1 --2- 172.21.15.92:0/1737240596 >> [v2:172.21.15.167:6808/3576893400,v1:172.21.15.167:6809/3576893400] conn(0x7f9ac00acf00 0x7f9ac00af3a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:16.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.933+0000 7f9ad0ff9640 1 -- 172.21.15.92:0/1737240596 <== osd.4 v2:172.21.15.167:6808/3576893400 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9abc012ec0 con 0x7f9ac00acf00 2024-09-19T08:55:16.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.946+0000 7f9ad9cd7640 1 -- 172.21.15.92:0/1737240596 --> [v2:172.21.15.167:6808/3576893400,v1:172.21.15.167:6809/3576893400] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9ad4062df0 con 0x7f9ac00acf00 2024-09-19T08:55:16.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.946+0000 7f9ad0ff9640 1 -- 172.21.15.92:0/1737240596 <== osd.4 v2:172.21.15.167:6808/3576893400 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9ad4062df0 con 0x7f9ac00acf00 2024-09-19T08:55:16.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.947+0000 7f9ad9cd7640 1 -- 172.21.15.92:0/1737240596 >> [v2:172.21.15.167:6808/3576893400,v1:172.21.15.167:6809/3576893400] conn(0x7f9ac00acf00 msgr2=0x7f9ac00af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:16.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.947+0000 7f9ad9cd7640 1 --2- 172.21.15.92:0/1737240596 >> [v2:172.21.15.167:6808/3576893400,v1:172.21.15.167:6809/3576893400] conn(0x7f9ac00acf00 0x7f9ac00af3a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:16.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.947+0000 7f9ad9cd7640 1 -- 172.21.15.92:0/1737240596 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9ac00a32d0 msgr2=0x7f9ac00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:16.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.947+0000 7f9ad9cd7640 1 --2- 172.21.15.92:0/1737240596 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9ac00a32d0 0x7f9ac00a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4005ab0 tx=0x7f9ac4005a20 comp rx=0 tx=0).stop 2024-09-19T08:55:16.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.947+0000 7f9ad9cd7640 1 -- 172.21.15.92:0/1737240596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ad4102570 msgr2=0x7f9ad40fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:16.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.947+0000 7f9ad9cd7640 1 --2- 172.21.15.92:0/1737240596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ad4102570 0x7f9ad40fd1c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9abc00c920 tx=0x7f9abc00cde0 comp rx=0 tx=0).stop 2024-09-19T08:55:16.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.947+0000 7f9ad3fff640 1 -- 172.21.15.92:0/1737240596 reap_dead start 2024-09-19T08:55:16.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.947+0000 7f9ad9cd7640 1 -- 172.21.15.92:0/1737240596 shutdown_connections 2024-09-19T08:55:16.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.947+0000 7f9ad9cd7640 1 -- 172.21.15.92:0/1737240596 >> 172.21.15.92:0/1737240596 conn(0x7f9ad40fc7d0 msgr2=0x7f9ad406a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:16.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.947+0000 7f9ad9cd7640 1 -- 172.21.15.92:0/1737240596 shutdown_connections 2024-09-19T08:55:16.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:16.947+0000 7f9ad9cd7640 1 -- 172.21.15.92:0/1737240596 wait complete. 2024-09-19T08:55:17.570 INFO:teuthology.orchestra.run.smithi092.stdout:103079215164 2024-09-19T08:55:17.570 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-19T08:55:17.677 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:17 smithi092 ceph-mon[31407]: pgmap v294: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:55:17.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:17 smithi167 ceph-mon[35359]: pgmap v294: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:55:17.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:17 smithi190 ceph-mon[35358]: pgmap v294: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:55:17.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.961+0000 7f6bf42fa640 1 -- 172.21.15.92:0/3429521933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bec100a80 msgr2=0x7f6bec100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:17.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.961+0000 7f6bf42fa640 1 --2- 172.21.15.92:0/3429521933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bec100a80 0x7f6bec100ee0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6be8009930 tx=0x7f6be802a440 comp rx=0 tx=0).stop 2024-09-19T08:55:17.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.961+0000 7f6bf42fa640 1 -- 172.21.15.92:0/3429521933 shutdown_connections 2024-09-19T08:55:17.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.961+0000 7f6bf42fa640 1 --2- 172.21.15.92:0/3429521933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6bec101420 0x7f6bec10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:17.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.961+0000 7f6bf42fa640 1 --2- 172.21.15.92:0/3429521933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bec100a80 0x7f6bec100ee0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:17.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.961+0000 7f6bf42fa640 1 --2- 172.21.15.92:0/3429521933 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bec106a80 0x7f6bec106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:17.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.961+0000 7f6bf42fa640 1 -- 172.21.15.92:0/3429521933 >> 172.21.15.92:0/3429521933 conn(0x7f6bec0fc7a0 msgr2=0x7f6bec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:17.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.961+0000 7f6bf42fa640 1 -- 172.21.15.92:0/3429521933 shutdown_connections 2024-09-19T08:55:17.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.961+0000 7f6bf42fa640 1 -- 172.21.15.92:0/3429521933 wait complete. 2024-09-19T08:55:17.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.961+0000 7f6bf42fa640 1 Processor -- start 2024-09-19T08:55:17.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.961+0000 7f6bf42fa640 1 -- start start 2024-09-19T08:55:17.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.962+0000 7f6bf42fa640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bec100a80 0x7f6bec198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:17.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.962+0000 7f6bf42fa640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bec101420 0x7f6bec198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:17.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.962+0000 7f6bf42fa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6bec106a80 0x7f6bec19cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:17.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.962+0000 7f6bf42fa640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6bec110e80 con 0x7f6bec101420 2024-09-19T08:55:17.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.962+0000 7f6bf42fa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6bec110d00 con 0x7f6bec106a80 2024-09-19T08:55:17.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.962+0000 7f6bf42fa640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6bec111000 con 0x7f6bec100a80 2024-09-19T08:55:17.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.962+0000 7f6bf1895640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bec101420 0x7f6bec198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:17.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.962+0000 7f6bf1895640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bec101420 0x7f6bec198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55264/0 (socket says 172.21.15.92:55264) 2024-09-19T08:55:17.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.962+0000 7f6bf1895640 1 -- 172.21.15.92:0/197856882 learned_addr learned my addr 172.21.15.92:0/197856882 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:17.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.962+0000 7f6bf2096640 1 --2- 172.21.15.92:0/197856882 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bec100a80 0x7f6bec198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:17.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.962+0000 7f6bf2897640 1 --2- 172.21.15.92:0/197856882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6bec106a80 0x7f6bec19cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:17.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.962+0000 7f6bf1895640 1 -- 172.21.15.92:0/197856882 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bec100a80 msgr2=0x7f6bec198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:17.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.962+0000 7f6bf1895640 1 --2- 172.21.15.92:0/197856882 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bec100a80 0x7f6bec198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:17.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.962+0000 7f6bf1895640 1 -- 172.21.15.92:0/197856882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6bec106a80 msgr2=0x7f6bec19cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:17.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.962+0000 7f6bf1895640 1 --2- 172.21.15.92:0/197856882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6bec106a80 0x7f6bec19cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:17.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.962+0000 7f6bf1895640 1 -- 172.21.15.92:0/197856882 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bec19d3f0 con 0x7f6bec101420 2024-09-19T08:55:17.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.962+0000 7f6bf1895640 1 --2- 172.21.15.92:0/197856882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bec101420 0x7f6bec198980 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6be8009230 tx=0x7f6be8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:17.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.962+0000 7f6bdf7fe640 1 -- 172.21.15.92:0/197856882 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be803f030 con 0x7f6bec101420 2024-09-19T08:55:17.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.962+0000 7f6bf42fa640 1 -- 172.21.15.92:0/197856882 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bec19d680 con 0x7f6bec101420 2024-09-19T08:55:17.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.962+0000 7f6bdf7fe640 1 -- 172.21.15.92:0/197856882 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6be8003ad0 con 0x7f6bec101420 2024-09-19T08:55:17.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.962+0000 7f6bdf7fe640 1 -- 172.21.15.92:0/197856882 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be8035070 con 0x7f6bec101420 2024-09-19T08:55:17.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.963+0000 7f6bf42fa640 1 -- 172.21.15.92:0/197856882 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bec1a4fc0 con 0x7f6bec101420 2024-09-19T08:55:17.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.963+0000 7f6bf42fa640 1 -- 172.21.15.92:0/197856882 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6bec062940 con 0x7f6bec101420 2024-09-19T08:55:17.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.965+0000 7f6bdf7fe640 1 -- 172.21.15.92:0/197856882 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6be8042030 con 0x7f6bec101420 2024-09-19T08:55:17.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.965+0000 7f6bdf7fe640 1 --2- 172.21.15.92:0/197856882 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6bd80a32d0 0x7f6bd80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:17.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.965+0000 7f6bf2096640 1 --2- 172.21.15.92:0/197856882 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6bd80a32d0 0x7f6bd80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:17.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.965+0000 7f6bdf7fe640 1 -- 172.21.15.92:0/197856882 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f6be80f0300 con 0x7f6bec101420 2024-09-19T08:55:17.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.965+0000 7f6bdf7fe640 1 --2- 172.21.15.92:0/197856882 >> [v2:172.21.15.190:6816/4190304434,v1:172.21.15.190:6817/4190304434] conn(0x7f6bd80acf00 0x7f6bd80af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:17.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.966+0000 7f6bdf7fe640 1 -- 172.21.15.92:0/197856882 --> [v2:172.21.15.190:6816/4190304434,v1:172.21.15.190:6817/4190304434] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6bd80afa70 con 0x7f6bd80acf00 2024-09-19T08:55:17.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.966+0000 7f6bdf7fe640 1 -- 172.21.15.92:0/197856882 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f6be80f0730 con 0x7f6bec101420 2024-09-19T08:55:17.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.966+0000 7f6bf2096640 1 --2- 172.21.15.92:0/197856882 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6bd80a32d0 0x7f6bd80a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6be000ab60 tx=0x7f6be000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:17.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.966+0000 7f6bf2897640 1 --2- 172.21.15.92:0/197856882 >> [v2:172.21.15.190:6816/4190304434,v1:172.21.15.190:6817/4190304434] conn(0x7f6bd80acf00 0x7f6bd80af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:17.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.966+0000 7f6bf2897640 1 --2- 172.21.15.92:0/197856882 >> [v2:172.21.15.190:6816/4190304434,v1:172.21.15.190:6817/4190304434] conn(0x7f6bd80acf00 0x7f6bd80af3a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:17.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.967+0000 7f6bdf7fe640 1 -- 172.21.15.92:0/197856882 <== osd.8 v2:172.21.15.190:6816/4190304434 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6bd80afa70 con 0x7f6bd80acf00 2024-09-19T08:55:17.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.980+0000 7f6bf42fa640 1 -- 172.21.15.92:0/197856882 --> [v2:172.21.15.190:6816/4190304434,v1:172.21.15.190:6817/4190304434] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6bec062d40 con 0x7f6bd80acf00 2024-09-19T08:55:17.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.981+0000 7f6bdf7fe640 1 -- 172.21.15.92:0/197856882 <== osd.8 v2:172.21.15.190:6816/4190304434 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6bec062d40 con 0x7f6bd80acf00 2024-09-19T08:55:17.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.981+0000 7f6bf42fa640 1 -- 172.21.15.92:0/197856882 >> [v2:172.21.15.190:6816/4190304434,v1:172.21.15.190:6817/4190304434] conn(0x7f6bd80acf00 msgr2=0x7f6bd80af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:17.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.981+0000 7f6bf42fa640 1 --2- 172.21.15.92:0/197856882 >> [v2:172.21.15.190:6816/4190304434,v1:172.21.15.190:6817/4190304434] conn(0x7f6bd80acf00 0x7f6bd80af3a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:17.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.981+0000 7f6bf42fa640 1 -- 172.21.15.92:0/197856882 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6bd80a32d0 msgr2=0x7f6bd80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:17.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.981+0000 7f6bf42fa640 1 --2- 172.21.15.92:0/197856882 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6bd80a32d0 0x7f6bd80a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6be000ab60 tx=0x7f6be000a2d0 comp rx=0 tx=0).stop 2024-09-19T08:55:17.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.981+0000 7f6bf42fa640 1 -- 172.21.15.92:0/197856882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bec101420 msgr2=0x7f6bec198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:17.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.981+0000 7f6bf42fa640 1 --2- 172.21.15.92:0/197856882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bec101420 0x7f6bec198980 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6be8009230 tx=0x7f6be8004270 comp rx=0 tx=0).stop 2024-09-19T08:55:17.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.981+0000 7f6bf2897640 1 -- 172.21.15.92:0/197856882 reap_dead start 2024-09-19T08:55:17.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.981+0000 7f6bf42fa640 1 -- 172.21.15.92:0/197856882 shutdown_connections 2024-09-19T08:55:17.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.981+0000 7f6bf42fa640 1 -- 172.21.15.92:0/197856882 >> 172.21.15.92:0/197856882 conn(0x7f6bec0fc7a0 msgr2=0x7f6bec06aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:17.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.981+0000 7f6bf42fa640 1 -- 172.21.15.92:0/197856882 shutdown_connections 2024-09-19T08:55:17.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:17.981+0000 7f6bf42fa640 1 -- 172.21.15.92:0/197856882 wait complete. 2024-09-19T08:55:18.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.734+0000 7f9a09e68640 1 -- 172.21.15.92:0/1715474318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a04100a80 msgr2=0x7f9a04100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:18.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.734+0000 7f9a09e68640 1 --2- 172.21.15.92:0/1715474318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a04100a80 0x7f9a04100ee0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f99f8009930 tx=0x7f99f802a420 comp rx=0 tx=0).stop 2024-09-19T08:55:18.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.734+0000 7f9a09e68640 1 -- 172.21.15.92:0/1715474318 shutdown_connections 2024-09-19T08:55:18.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.734+0000 7f9a09e68640 1 --2- 172.21.15.92:0/1715474318 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a04101420 0x7f9a0410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:18.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.734+0000 7f9a09e68640 1 --2- 172.21.15.92:0/1715474318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a04100a80 0x7f9a04100ee0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:18.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.734+0000 7f9a09e68640 1 --2- 172.21.15.92:0/1715474318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a04106a80 0x7f9a04106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:18.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.734+0000 7f9a09e68640 1 -- 172.21.15.92:0/1715474318 >> 172.21.15.92:0/1715474318 conn(0x7f9a040fc7a0 msgr2=0x7f9a040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:18.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.734+0000 7f9a09e68640 1 -- 172.21.15.92:0/1715474318 shutdown_connections 2024-09-19T08:55:18.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.734+0000 7f9a09e68640 1 -- 172.21.15.92:0/1715474318 wait complete. 2024-09-19T08:55:18.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.735+0000 7f9a09e68640 1 Processor -- start 2024-09-19T08:55:18.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.735+0000 7f9a09e68640 1 -- start start 2024-09-19T08:55:18.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.735+0000 7f9a09e68640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a04100a80 0x7f9a0410e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:18.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.735+0000 7f9a09e68640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a04101420 0x7f9a0410e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:18.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.735+0000 7f9a09e68640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a04106a80 0x7f9a0410ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:18.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.735+0000 7f9a09e68640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9a04111fa0 con 0x7f9a04106a80 2024-09-19T08:55:18.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.735+0000 7f9a09e68640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9a04111e20 con 0x7f9a04101420 2024-09-19T08:55:18.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.735+0000 7f9a09e68640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9a04112120 con 0x7f9a04100a80 2024-09-19T08:55:18.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.735+0000 7f9a03fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a04106a80 0x7f9a0410ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:18.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.735+0000 7f9a03fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a04106a80 0x7f9a0410ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55286/0 (socket says 172.21.15.92:55286) 2024-09-19T08:55:18.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.735+0000 7f9a03fff640 1 -- 172.21.15.92:0/2702574337 learned_addr learned my addr 172.21.15.92:0/2702574337 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:18.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.736+0000 7f9a02ffd640 1 --2- 172.21.15.92:0/2702574337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a04101420 0x7f9a0410e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:18.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.736+0000 7f9a037fe640 1 --2- 172.21.15.92:0/2702574337 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a04100a80 0x7f9a0410e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:18.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.736+0000 7f9a03fff640 1 -- 172.21.15.92:0/2702574337 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a04100a80 msgr2=0x7f9a0410e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:18.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.736+0000 7f9a03fff640 1 --2- 172.21.15.92:0/2702574337 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a04100a80 0x7f9a0410e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:18.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.736+0000 7f9a03fff640 1 -- 172.21.15.92:0/2702574337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a04101420 msgr2=0x7f9a0410e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:18.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.736+0000 7f9a03fff640 1 --2- 172.21.15.92:0/2702574337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a04101420 0x7f9a0410e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:18.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.736+0000 7f9a03fff640 1 -- 172.21.15.92:0/2702574337 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a041a68a0 con 0x7f9a04106a80 2024-09-19T08:55:18.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.736+0000 7f9a02ffd640 1 --2- 172.21.15.92:0/2702574337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a04101420 0x7f9a0410e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:55:18.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.736+0000 7f9a03fff640 1 --2- 172.21.15.92:0/2702574337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a04106a80 0x7f9a0410ee60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00eaa0 tx=0x7f99fc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:18.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.736+0000 7f9a00ff9640 1 -- 172.21.15.92:0/2702574337 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc00cdb0 con 0x7f9a04106a80 2024-09-19T08:55:18.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.736+0000 7f9a09e68640 1 -- 172.21.15.92:0/2702574337 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a041a6b90 con 0x7f9a04106a80 2024-09-19T08:55:18.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.736+0000 7f9a00ff9640 1 -- 172.21.15.92:0/2702574337 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99fc005020 con 0x7f9a04106a80 2024-09-19T08:55:18.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.736+0000 7f9a00ff9640 1 -- 172.21.15.92:0/2702574337 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc0116d0 con 0x7f9a04106a80 2024-09-19T08:55:18.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.736+0000 7f9a09e68640 1 -- 172.21.15.92:0/2702574337 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a041a70a0 con 0x7f9a04106a80 2024-09-19T08:55:18.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.737+0000 7f9a09e68640 1 -- 172.21.15.92:0/2702574337 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9a040fd830 con 0x7f9a04106a80 2024-09-19T08:55:18.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.738+0000 7f9a00ff9640 1 -- 172.21.15.92:0/2702574337 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f99fc0054d0 con 0x7f9a04106a80 2024-09-19T08:55:18.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.739+0000 7f9a00ff9640 1 --2- 172.21.15.92:0/2702574337 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f99ec0a32d0 0x7f99ec0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:18.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.739+0000 7f9a037fe640 1 --2- 172.21.15.92:0/2702574337 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f99ec0a32d0 0x7f99ec0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:18.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.739+0000 7f9a00ff9640 1 -- 172.21.15.92:0/2702574337 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f99fc0d0140 con 0x7f9a04106a80 2024-09-19T08:55:18.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.739+0000 7f9a00ff9640 1 --2- 172.21.15.92:0/2702574337 >> [v2:172.21.15.167:6800/4163493234,v1:172.21.15.167:6801/4163493234] conn(0x7f99ec0acf00 0x7f99ec0af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:18.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.739+0000 7f9a00ff9640 1 -- 172.21.15.92:0/2702574337 --> [v2:172.21.15.167:6800/4163493234,v1:172.21.15.167:6801/4163493234] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f99fc014ec0 con 0x7f99ec0acf00 2024-09-19T08:55:18.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.739+0000 7f9a00ff9640 1 -- 172.21.15.92:0/2702574337 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f99fc0d0570 con 0x7f9a04106a80 2024-09-19T08:55:18.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.740+0000 7f9a037fe640 1 --2- 172.21.15.92:0/2702574337 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f99ec0a32d0 0x7f99ec0a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f99f400cac0 tx=0x7f99f400c4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:18.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.740+0000 7f9a02ffd640 1 --2- 172.21.15.92:0/2702574337 >> [v2:172.21.15.167:6800/4163493234,v1:172.21.15.167:6801/4163493234] conn(0x7f99ec0acf00 0x7f99ec0af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:18.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.740+0000 7f9a02ffd640 1 --2- 172.21.15.92:0/2702574337 >> [v2:172.21.15.167:6800/4163493234,v1:172.21.15.167:6801/4163493234] conn(0x7f99ec0acf00 0x7f99ec0af3a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:18.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.741+0000 7f9a00ff9640 1 -- 172.21.15.92:0/2702574337 <== osd.1 v2:172.21.15.167:6800/4163493234 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f99fc014ec0 con 0x7f99ec0acf00 2024-09-19T08:55:18.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.754+0000 7f9a09e68640 1 -- 172.21.15.92:0/2702574337 --> [v2:172.21.15.167:6800/4163493234,v1:172.21.15.167:6801/4163493234] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9a041021c0 con 0x7f99ec0acf00 2024-09-19T08:55:18.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.755+0000 7f9a00ff9640 1 -- 172.21.15.92:0/2702574337 <== osd.1 v2:172.21.15.167:6800/4163493234 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9a041021c0 con 0x7f99ec0acf00 2024-09-19T08:55:18.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.755+0000 7f9a09e68640 1 -- 172.21.15.92:0/2702574337 >> [v2:172.21.15.167:6800/4163493234,v1:172.21.15.167:6801/4163493234] conn(0x7f99ec0acf00 msgr2=0x7f99ec0af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:18.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.755+0000 7f9a09e68640 1 --2- 172.21.15.92:0/2702574337 >> [v2:172.21.15.167:6800/4163493234,v1:172.21.15.167:6801/4163493234] conn(0x7f99ec0acf00 0x7f99ec0af3a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:18.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.755+0000 7f9a09e68640 1 -- 172.21.15.92:0/2702574337 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f99ec0a32d0 msgr2=0x7f99ec0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:18.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.755+0000 7f9a09e68640 1 --2- 172.21.15.92:0/2702574337 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f99ec0a32d0 0x7f99ec0a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f99f400cac0 tx=0x7f99f400c4a0 comp rx=0 tx=0).stop 2024-09-19T08:55:18.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.755+0000 7f9a09e68640 1 -- 172.21.15.92:0/2702574337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a04106a80 msgr2=0x7f9a0410ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:18.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.755+0000 7f9a09e68640 1 --2- 172.21.15.92:0/2702574337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a04106a80 0x7f9a0410ee60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00eaa0 tx=0x7f99fc00ef60 comp rx=0 tx=0).stop 2024-09-19T08:55:18.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.755+0000 7f9a03fff640 1 -- 172.21.15.92:0/2702574337 reap_dead start 2024-09-19T08:55:18.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.756+0000 7f9a09e68640 1 -- 172.21.15.92:0/2702574337 shutdown_connections 2024-09-19T08:55:18.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.756+0000 7f9a09e68640 1 -- 172.21.15.92:0/2702574337 >> 172.21.15.92:0/2702574337 conn(0x7f9a040fc7a0 msgr2=0x7f9a040fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:18.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.756+0000 7f9a09e68640 1 -- 172.21.15.92:0/2702574337 shutdown_connections 2024-09-19T08:55:18.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:18.756+0000 7f9a09e68640 1 -- 172.21.15.92:0/2702574337 wait complete. 2024-09-19T08:55:19.352 INFO:teuthology.orchestra.run.smithi092.stdout:154618822707 2024-09-19T08:55:19.353 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-19T08:55:19.609 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:19 smithi092 ceph-mon[31407]: pgmap v295: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:55:19.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.505+0000 7f08deb0c640 1 -- 172.21.15.92:0/4248987432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08d8102570 msgr2=0x7f08d81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:19.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.505+0000 7f08deb0c640 1 --2- 172.21.15.92:0/4248987432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08d8102570 0x7f08d81029b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f08c4009900 tx=0x7f08c402a480 comp rx=0 tx=0).stop 2024-09-19T08:55:19.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.505+0000 7f08deb0c640 1 -- 172.21.15.92:0/4248987432 shutdown_connections 2024-09-19T08:55:19.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.505+0000 7f08deb0c640 1 --2- 172.21.15.92:0/4248987432 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08d8102ef0 0x7f08d810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:19.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.505+0000 7f08deb0c640 1 --2- 172.21.15.92:0/4248987432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08d8102570 0x7f08d81029b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:19.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.505+0000 7f08deb0c640 1 --2- 172.21.15.92:0/4248987432 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08d8100e20 0x7f08d8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:19.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.505+0000 7f08deb0c640 1 -- 172.21.15.92:0/4248987432 >> 172.21.15.92:0/4248987432 conn(0x7f08d80fc7d0 msgr2=0x7f08d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:19.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.505+0000 7f08deb0c640 1 -- 172.21.15.92:0/4248987432 shutdown_connections 2024-09-19T08:55:19.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.505+0000 7f08deb0c640 1 -- 172.21.15.92:0/4248987432 wait complete. 2024-09-19T08:55:19.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.505+0000 7f08deb0c640 1 Processor -- start 2024-09-19T08:55:19.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.506+0000 7f08deb0c640 1 -- start start 2024-09-19T08:55:19.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.506+0000 7f08deb0c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08d8100e20 0x7f08d8198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:19.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.506+0000 7f08deb0c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08d8102570 0x7f08d8198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:19.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.506+0000 7f08deb0c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08d8102ef0 0x7f08d819ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:19.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.506+0000 7f08deb0c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f08d8110f80 con 0x7f08d8100e20 2024-09-19T08:55:19.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.506+0000 7f08deb0c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f08d8110e00 con 0x7f08d8102ef0 2024-09-19T08:55:19.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.506+0000 7f08deb0c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f08d8111100 con 0x7f08d8102570 2024-09-19T08:55:19.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.506+0000 7f08dc8a8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08d8100e20 0x7f08d8198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:19.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.506+0000 7f08dc8a8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08d8100e20 0x7f08d8198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55296/0 (socket says 172.21.15.92:55296) 2024-09-19T08:55:19.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.506+0000 7f08dc8a8640 1 -- 172.21.15.92:0/627475119 learned_addr learned my addr 172.21.15.92:0/627475119 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:19.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.506+0000 7f08dd0a9640 1 --2- 172.21.15.92:0/627475119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08d8102ef0 0x7f08d819ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:19.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.506+0000 7f08d7fff640 1 --2- 172.21.15.92:0/627475119 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08d8102570 0x7f08d8198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:19.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.506+0000 7f08dc8a8640 1 -- 172.21.15.92:0/627475119 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08d8102570 msgr2=0x7f08d8198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:19.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.506+0000 7f08dc8a8640 1 --2- 172.21.15.92:0/627475119 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08d8102570 0x7f08d8198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:19.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.506+0000 7f08dc8a8640 1 -- 172.21.15.92:0/627475119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08d8102ef0 msgr2=0x7f08d819ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:19.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.506+0000 7f08dc8a8640 1 --2- 172.21.15.92:0/627475119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08d8102ef0 0x7f08d819ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:19.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.506+0000 7f08dc8a8640 1 -- 172.21.15.92:0/627475119 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08d819d510 con 0x7f08d8100e20 2024-09-19T08:55:19.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.506+0000 7f08dc8a8640 1 --2- 172.21.15.92:0/627475119 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08d8100e20 0x7f08d8198560 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f08cc00d950 tx=0x7f08cc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:19.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.506+0000 7f08d5ffb640 1 -- 172.21.15.92:0/627475119 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08cc017070 con 0x7f08d8100e20 2024-09-19T08:55:19.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.507+0000 7f08deb0c640 1 -- 172.21.15.92:0/627475119 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08d819d800 con 0x7f08d8100e20 2024-09-19T08:55:19.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.507+0000 7f08d5ffb640 1 -- 172.21.15.92:0/627475119 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08cc009c30 con 0x7f08d8100e20 2024-09-19T08:55:19.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.507+0000 7f08d5ffb640 1 -- 172.21.15.92:0/627475119 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08cc020060 con 0x7f08d8100e20 2024-09-19T08:55:19.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.507+0000 7f08deb0c640 1 -- 172.21.15.92:0/627475119 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08d81a50e0 con 0x7f08d8100e20 2024-09-19T08:55:19.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.508+0000 7f08deb0c640 1 -- 172.21.15.92:0/627475119 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08d8101200 con 0x7f08d8100e20 2024-09-19T08:55:19.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.509+0000 7f08d5ffb640 1 -- 172.21.15.92:0/627475119 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f08cc0109d0 con 0x7f08d8100e20 2024-09-19T08:55:19.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.509+0000 7f08d5ffb640 1 --2- 172.21.15.92:0/627475119 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f08c80a3350 0x7f08c80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:19.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.509+0000 7f08d7fff640 1 --2- 172.21.15.92:0/627475119 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f08c80a3350 0x7f08c80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:19.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.510+0000 7f08d5ffb640 1 -- 172.21.15.92:0/627475119 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f08cc0cf3a0 con 0x7f08d8100e20 2024-09-19T08:55:19.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.510+0000 7f08d7fff640 1 --2- 172.21.15.92:0/627475119 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f08c80a3350 0x7f08c80a5810 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f08d8105310 tx=0x7f08c4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:19.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.518+0000 7f08d5ffb640 1 -- 172.21.15.92:0/627475119 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f08cc009de0 con 0x7f08d8100e20 2024-09-19T08:55:19.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.699+0000 7f08deb0c640 1 -- 172.21.15.92:0/627475119 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f08d810a0a0 con 0x7f08d8100e20 2024-09-19T08:55:19.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.700+0000 7f08d5ffb640 1 -- 172.21.15.92:0/627475119 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f08cc09bf60 con 0x7f08d8100e20 2024-09-19T08:55:19.701 INFO:teuthology.orchestra.run.smithi092.stdout:34359738443 2024-09-19T08:55:19.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.702+0000 7f08deb0c640 1 -- 172.21.15.92:0/627475119 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f08c80a3350 msgr2=0x7f08c80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:19.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.702+0000 7f08deb0c640 1 --2- 172.21.15.92:0/627475119 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f08c80a3350 0x7f08c80a5810 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f08d8105310 tx=0x7f08c4005a20 comp rx=0 tx=0).stop 2024-09-19T08:55:19.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.702+0000 7f08deb0c640 1 -- 172.21.15.92:0/627475119 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08d8100e20 msgr2=0x7f08d8198560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:19.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.702+0000 7f08deb0c640 1 --2- 172.21.15.92:0/627475119 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08d8100e20 0x7f08d8198560 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f08cc00d950 tx=0x7f08cc00de10 comp rx=0 tx=0).stop 2024-09-19T08:55:19.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.702+0000 7f08deb0c640 1 -- 172.21.15.92:0/627475119 shutdown_connections 2024-09-19T08:55:19.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.702+0000 7f08deb0c640 1 --2- 172.21.15.92:0/627475119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08d8102ef0 0x7f08d819ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:19.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.702+0000 7f08deb0c640 1 --2- 172.21.15.92:0/627475119 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08d8102570 0x7f08d8198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:19.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.702+0000 7f08deb0c640 1 --2- 172.21.15.92:0/627475119 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f08c80a3350 0x7f08c80a5810 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:19.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.702+0000 7f08deb0c640 1 --2- 172.21.15.92:0/627475119 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08d8100e20 0x7f08d8198560 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:19.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.702+0000 7f08deb0c640 1 -- 172.21.15.92:0/627475119 >> 172.21.15.92:0/627475119 conn(0x7f08d80fc7d0 msgr2=0x7f08d806a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:19.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.702+0000 7f08deb0c640 1 -- 172.21.15.92:0/627475119 shutdown_connections 2024-09-19T08:55:19.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.702+0000 7f08deb0c640 1 -- 172.21.15.92:0/627475119 wait complete. 2024-09-19T08:55:19.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.608+0000 7f92d61d3640 1 -- 172.21.15.92:0/2378135503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92d01027a0 msgr2=0x7f92d01067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:19.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.608+0000 7f92d61d3640 1 --2- 172.21.15.92:0/2378135503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92d01027a0 0x7f92d01067f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f92b8009900 tx=0x7f92b802a410 comp rx=0 tx=0).stop 2024-09-19T08:55:19.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.608+0000 7f92d61d3640 1 -- 172.21.15.92:0/2378135503 shutdown_connections 2024-09-19T08:55:19.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.608+0000 7f92d61d3640 1 --2- 172.21.15.92:0/2378135503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92d0106f20 0x7f92d010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:19.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.608+0000 7f92d61d3640 1 --2- 172.21.15.92:0/2378135503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92d01027a0 0x7f92d01067f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:19.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.608+0000 7f92d61d3640 1 --2- 172.21.15.92:0/2378135503 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92d0101df0 0x7f92d01021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:19.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.608+0000 7f92d61d3640 1 -- 172.21.15.92:0/2378135503 >> 172.21.15.92:0/2378135503 conn(0x7f92d00fd8f0 msgr2=0x7f92d00ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:19.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.608+0000 7f92d61d3640 1 -- 172.21.15.92:0/2378135503 shutdown_connections 2024-09-19T08:55:19.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.608+0000 7f92d61d3640 1 -- 172.21.15.92:0/2378135503 wait complete. 2024-09-19T08:55:19.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.608+0000 7f92d61d3640 1 Processor -- start 2024-09-19T08:55:19.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.609+0000 7f92d61d3640 1 -- start start 2024-09-19T08:55:19.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.609+0000 7f92d61d3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92d0101df0 0x7f92d0198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:19.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.609+0000 7f92d61d3640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92d01027a0 0x7f92d0198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:19.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.609+0000 7f92d61d3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92d0106f20 0x7f92d019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:19.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.609+0000 7f92d61d3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f92d0111f80 con 0x7f92d0101df0 2024-09-19T08:55:19.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.609+0000 7f92d61d3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f92d0111e00 con 0x7f92d0106f20 2024-09-19T08:55:19.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.609+0000 7f92d61d3640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f92d0112100 con 0x7f92d01027a0 2024-09-19T08:55:19.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.609+0000 7f92cf7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92d0101df0 0x7f92d0198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:19.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.609+0000 7f92cf7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92d0101df0 0x7f92d0198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55318/0 (socket says 172.21.15.92:55318) 2024-09-19T08:55:19.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.609+0000 7f92cf7fe640 1 -- 172.21.15.92:0/1457121679 learned_addr learned my addr 172.21.15.92:0/1457121679 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:19.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.609+0000 7f92c7fff640 1 --2- 172.21.15.92:0/1457121679 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92d01027a0 0x7f92d0198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:19.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.609+0000 7f92cffff640 1 --2- 172.21.15.92:0/1457121679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92d0106f20 0x7f92d019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:19.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.609+0000 7f92cf7fe640 1 -- 172.21.15.92:0/1457121679 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92d01027a0 msgr2=0x7f92d0198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:19.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.609+0000 7f92cf7fe640 1 --2- 172.21.15.92:0/1457121679 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92d01027a0 0x7f92d0198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:19.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.609+0000 7f92cf7fe640 1 -- 172.21.15.92:0/1457121679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92d0106f20 msgr2=0x7f92d019cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:19.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.609+0000 7f92cf7fe640 1 --2- 172.21.15.92:0/1457121679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92d0106f20 0x7f92d019cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:19.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.609+0000 7f92cf7fe640 1 -- 172.21.15.92:0/1457121679 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d019d3f0 con 0x7f92d0101df0 2024-09-19T08:55:19.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.610+0000 7f92cf7fe640 1 --2- 172.21.15.92:0/1457121679 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92d0101df0 0x7f92d0198440 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f92c000d950 tx=0x7f92c000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:19.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.610+0000 7f92cd7fa640 1 -- 172.21.15.92:0/1457121679 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c0017070 con 0x7f92d0101df0 2024-09-19T08:55:19.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.610+0000 7f92d61d3640 1 -- 172.21.15.92:0/1457121679 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92d019d6e0 con 0x7f92d0101df0 2024-09-19T08:55:19.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.610+0000 7f92cd7fa640 1 -- 172.21.15.92:0/1457121679 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92c0009c30 con 0x7f92d0101df0 2024-09-19T08:55:19.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.610+0000 7f92cd7fa640 1 -- 172.21.15.92:0/1457121679 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c0017070 con 0x7f92d0101df0 2024-09-19T08:55:19.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.610+0000 7f92d61d3640 1 -- 172.21.15.92:0/1457121679 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92d01a4fc0 con 0x7f92d0101df0 2024-09-19T08:55:19.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.611+0000 7f92d61d3640 1 -- 172.21.15.92:0/1457121679 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f92d0062980 con 0x7f92d0101df0 2024-09-19T08:55:19.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.613+0000 7f92cd7fa640 1 -- 172.21.15.92:0/1457121679 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f92c00109d0 con 0x7f92d0101df0 2024-09-19T08:55:19.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.614+0000 7f92cd7fa640 1 --2- 172.21.15.92:0/1457121679 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f92bc0a34d0 0x7f92bc0a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:19.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.614+0000 7f92c7fff640 1 --2- 172.21.15.92:0/1457121679 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f92bc0a34d0 0x7f92bc0a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:19.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.614+0000 7f92cd7fa640 1 -- 172.21.15.92:0/1457121679 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f92c00cf1e0 con 0x7f92d0101df0 2024-09-19T08:55:19.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.614+0000 7f92cd7fa640 1 --2- 172.21.15.92:0/1457121679 >> [v2:172.21.15.167:6824/2309134313,v1:172.21.15.167:6825/2309134313] conn(0x7f92bc0ad100 0x7f92bc0af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:19.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.614+0000 7f92cd7fa640 1 -- 172.21.15.92:0/1457121679 --> [v2:172.21.15.167:6824/2309134313,v1:172.21.15.167:6825/2309134313] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f92bc0afc70 con 0x7f92bc0ad100 2024-09-19T08:55:19.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.614+0000 7f92cd7fa640 1 -- 172.21.15.92:0/1457121679 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f92c00cf610 con 0x7f92d0101df0 2024-09-19T08:55:19.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.614+0000 7f92c7fff640 1 --2- 172.21.15.92:0/1457121679 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f92bc0a34d0 0x7f92bc0a5990 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f92b8009230 tx=0x7f92b80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:19.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.614+0000 7f92cffff640 1 --2- 172.21.15.92:0/1457121679 >> [v2:172.21.15.167:6824/2309134313,v1:172.21.15.167:6825/2309134313] conn(0x7f92bc0ad100 0x7f92bc0af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:19.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.615+0000 7f92cffff640 1 --2- 172.21.15.92:0/1457121679 >> [v2:172.21.15.167:6824/2309134313,v1:172.21.15.167:6825/2309134313] conn(0x7f92bc0ad100 0x7f92bc0af5a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:19.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.615+0000 7f92cd7fa640 1 -- 172.21.15.92:0/1457121679 <== osd.10 v2:172.21.15.167:6824/2309134313 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f92bc0afc70 con 0x7f92bc0ad100 2024-09-19T08:55:19.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.632+0000 7f92d61d3640 1 -- 172.21.15.92:0/1457121679 --> [v2:172.21.15.167:6824/2309134313,v1:172.21.15.167:6825/2309134313] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f92d0062e30 con 0x7f92bc0ad100 2024-09-19T08:55:19.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.633+0000 7f92cd7fa640 1 -- 172.21.15.92:0/1457121679 <== osd.10 v2:172.21.15.167:6824/2309134313 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f92d0062e30 con 0x7f92bc0ad100 2024-09-19T08:55:19.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.633+0000 7f92d61d3640 1 -- 172.21.15.92:0/1457121679 >> [v2:172.21.15.167:6824/2309134313,v1:172.21.15.167:6825/2309134313] conn(0x7f92bc0ad100 msgr2=0x7f92bc0af5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:19.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.633+0000 7f92d61d3640 1 --2- 172.21.15.92:0/1457121679 >> [v2:172.21.15.167:6824/2309134313,v1:172.21.15.167:6825/2309134313] conn(0x7f92bc0ad100 0x7f92bc0af5a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:19.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.633+0000 7f92d61d3640 1 -- 172.21.15.92:0/1457121679 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f92bc0a34d0 msgr2=0x7f92bc0a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:19.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.633+0000 7f92d61d3640 1 --2- 172.21.15.92:0/1457121679 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f92bc0a34d0 0x7f92bc0a5990 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f92b8009230 tx=0x7f92b80058d0 comp rx=0 tx=0).stop 2024-09-19T08:55:19.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.633+0000 7f92d61d3640 1 -- 172.21.15.92:0/1457121679 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92d0101df0 msgr2=0x7f92d0198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:19.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.633+0000 7f92d61d3640 1 --2- 172.21.15.92:0/1457121679 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92d0101df0 0x7f92d0198440 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f92c000d950 tx=0x7f92c000de10 comp rx=0 tx=0).stop 2024-09-19T08:55:19.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.633+0000 7f92cffff640 1 -- 172.21.15.92:0/1457121679 reap_dead start 2024-09-19T08:55:19.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.633+0000 7f92d61d3640 1 -- 172.21.15.92:0/1457121679 shutdown_connections 2024-09-19T08:55:19.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.633+0000 7f92d61d3640 1 -- 172.21.15.92:0/1457121679 >> 172.21.15.92:0/1457121679 conn(0x7f92d00fd8f0 msgr2=0x7f92d00fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:19.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.633+0000 7f92d61d3640 1 -- 172.21.15.92:0/1457121679 shutdown_connections 2024-09-19T08:55:19.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:19.633+0000 7f92d61d3640 1 -- 172.21.15.92:0/1457121679 wait complete. 2024-09-19T08:55:19.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:19 smithi167 ceph-mon[35359]: pgmap v295: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:55:19.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:19 smithi190 ceph-mon[35358]: pgmap v295: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:55:20.465 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:20 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/627475119' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T08:55:20.493 INFO:teuthology.orchestra.run.smithi092.stdout:133143986232 2024-09-19T08:55:20.494 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-19T08:55:20.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:20 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/627475119' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T08:55:20.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:20 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/627475119' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T08:55:21.111 INFO:teuthology.orchestra.run.smithi092.stdout:283467841563 2024-09-19T08:55:21.112 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-19T08:55:21.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.275+0000 7f41d852f640 1 -- 172.21.15.92:0/3328689538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41d0100e20 msgr2=0x7f41d0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:21.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.275+0000 7f41d852f640 1 --2- 172.21.15.92:0/3328689538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41d0100e20 0x7f41d0101200 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f41cc009900 tx=0x7f41cc02a480 comp rx=0 tx=0).stop 2024-09-19T08:55:21.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.276+0000 7f41d852f640 1 -- 172.21.15.92:0/3328689538 shutdown_connections 2024-09-19T08:55:21.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.276+0000 7f41d852f640 1 --2- 172.21.15.92:0/3328689538 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41d0102ef0 0x7f41d010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:21.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.276+0000 7f41d852f640 1 --2- 172.21.15.92:0/3328689538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f41d0102570 0x7f41d01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:21.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.276+0000 7f41d852f640 1 --2- 172.21.15.92:0/3328689538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41d0100e20 0x7f41d0101200 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:21.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.276+0000 7f41d852f640 1 -- 172.21.15.92:0/3328689538 >> 172.21.15.92:0/3328689538 conn(0x7f41d00fc7d0 msgr2=0x7f41d00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:21.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.276+0000 7f41d852f640 1 -- 172.21.15.92:0/3328689538 shutdown_connections 2024-09-19T08:55:21.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.276+0000 7f41d852f640 1 -- 172.21.15.92:0/3328689538 wait complete. 2024-09-19T08:55:21.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.276+0000 7f41d852f640 1 Processor -- start 2024-09-19T08:55:21.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.276+0000 7f41d852f640 1 -- start start 2024-09-19T08:55:21.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.276+0000 7f41d852f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41d0100e20 0x7f41d019a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:21.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.277+0000 7f41d852f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41d0102570 0x7f41d019ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:21.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.277+0000 7f41d852f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f41d0102ef0 0x7f41d019efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:21.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.277+0000 7f41d852f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f41d0110f80 con 0x7f41d0100e20 2024-09-19T08:55:21.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.277+0000 7f41d852f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f41d0110e00 con 0x7f41d0102ef0 2024-09-19T08:55:21.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.277+0000 7f41d852f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f41d0111100 con 0x7f41d0102570 2024-09-19T08:55:21.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.277+0000 7f41d62cb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41d0100e20 0x7f41d019a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:21.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.277+0000 7f41d62cb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41d0100e20 0x7f41d019a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55328/0 (socket says 172.21.15.92:55328) 2024-09-19T08:55:21.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.277+0000 7f41d62cb640 1 -- 172.21.15.92:0/2725697465 learned_addr learned my addr 172.21.15.92:0/2725697465 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:21.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.277+0000 7f41d5aca640 1 --2- 172.21.15.92:0/2725697465 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41d0102570 0x7f41d019ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:21.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.277+0000 7f41d6acc640 1 --2- 172.21.15.92:0/2725697465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f41d0102ef0 0x7f41d019efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:21.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.277+0000 7f41d62cb640 1 -- 172.21.15.92:0/2725697465 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41d0102570 msgr2=0x7f41d019ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:21.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.277+0000 7f41d62cb640 1 --2- 172.21.15.92:0/2725697465 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41d0102570 0x7f41d019ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:21.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.277+0000 7f41d62cb640 1 -- 172.21.15.92:0/2725697465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f41d0102ef0 msgr2=0x7f41d019efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:21.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.277+0000 7f41d62cb640 1 --2- 172.21.15.92:0/2725697465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f41d0102ef0 0x7f41d019efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:21.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.277+0000 7f41d62cb640 1 -- 172.21.15.92:0/2725697465 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d019f6c0 con 0x7f41d0100e20 2024-09-19T08:55:21.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.277+0000 7f41d6acc640 1 --2- 172.21.15.92:0/2725697465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f41d0102ef0 0x7f41d019efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:55:21.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.277+0000 7f41d62cb640 1 --2- 172.21.15.92:0/2725697465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41d0100e20 0x7f41d019a710 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f41cc006010 tx=0x7f41cc003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:21.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.277+0000 7f41c37fe640 1 -- 172.21.15.92:0/2725697465 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41cc03f070 con 0x7f41d0100e20 2024-09-19T08:55:21.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.277+0000 7f41c37fe640 1 -- 172.21.15.92:0/2725697465 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41cc031e30 con 0x7f41d0100e20 2024-09-19T08:55:21.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.277+0000 7f41d852f640 1 -- 172.21.15.92:0/2725697465 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41d019f950 con 0x7f41d0100e20 2024-09-19T08:55:21.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.277+0000 7f41c37fe640 1 -- 172.21.15.92:0/2725697465 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41cc035030 con 0x7f41d0100e20 2024-09-19T08:55:21.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.278+0000 7f41d852f640 1 -- 172.21.15.92:0/2725697465 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41d01a7290 con 0x7f41d0100e20 2024-09-19T08:55:21.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.278+0000 7f41d852f640 1 -- 172.21.15.92:0/2725697465 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f41d006aa70 con 0x7f41d0100e20 2024-09-19T08:55:21.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.280+0000 7f41c37fe640 1 -- 172.21.15.92:0/2725697465 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f41cc042070 con 0x7f41d0100e20 2024-09-19T08:55:21.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.280+0000 7f41c37fe640 1 --2- 172.21.15.92:0/2725697465 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f41bc0a3350 0x7f41bc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:21.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.280+0000 7f41d5aca640 1 --2- 172.21.15.92:0/2725697465 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f41bc0a3350 0x7f41bc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:21.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.280+0000 7f41c37fe640 1 -- 172.21.15.92:0/2725697465 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f41cc0f09e0 con 0x7f41d0100e20 2024-09-19T08:55:21.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.280+0000 7f41c37fe640 1 --2- 172.21.15.92:0/2725697465 >> [v2:172.21.15.167:6816/2984111963,v1:172.21.15.167:6817/2984111963] conn(0x7f41bc0acf80 0x7f41bc0af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:21.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.281+0000 7f41c37fe640 1 -- 172.21.15.92:0/2725697465 --> [v2:172.21.15.167:6816/2984111963,v1:172.21.15.167:6817/2984111963] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f41cc038e90 con 0x7f41bc0acf80 2024-09-19T08:55:21.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.281+0000 7f41c37fe640 1 -- 172.21.15.92:0/2725697465 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f41cc0f0e10 con 0x7f41d0100e20 2024-09-19T08:55:21.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.281+0000 7f41d5aca640 1 --2- 172.21.15.92:0/2725697465 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f41bc0a3350 0x7f41bc0a5810 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f41d00ff0e0 tx=0x7f41c400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:21.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.281+0000 7f41d6acc640 1 --2- 172.21.15.92:0/2725697465 >> [v2:172.21.15.167:6816/2984111963,v1:172.21.15.167:6817/2984111963] conn(0x7f41bc0acf80 0x7f41bc0af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:21.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.281+0000 7f41d6acc640 1 --2- 172.21.15.92:0/2725697465 >> [v2:172.21.15.167:6816/2984111963,v1:172.21.15.167:6817/2984111963] conn(0x7f41bc0acf80 0x7f41bc0af420 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:21.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.282+0000 7f41c37fe640 1 -- 172.21.15.92:0/2725697465 <== osd.7 v2:172.21.15.167:6816/2984111963 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f41cc038e90 con 0x7f41bc0acf80 2024-09-19T08:55:21.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.296+0000 7f41d852f640 1 -- 172.21.15.92:0/2725697465 --> [v2:172.21.15.167:6816/2984111963,v1:172.21.15.167:6817/2984111963] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f41d01021b0 con 0x7f41bc0acf80 2024-09-19T08:55:21.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.296+0000 7f41c37fe640 1 -- 172.21.15.92:0/2725697465 <== osd.7 v2:172.21.15.167:6816/2984111963 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f41d01021b0 con 0x7f41bc0acf80 2024-09-19T08:55:21.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.297+0000 7f41d852f640 1 -- 172.21.15.92:0/2725697465 >> [v2:172.21.15.167:6816/2984111963,v1:172.21.15.167:6817/2984111963] conn(0x7f41bc0acf80 msgr2=0x7f41bc0af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:21.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.297+0000 7f41d852f640 1 --2- 172.21.15.92:0/2725697465 >> [v2:172.21.15.167:6816/2984111963,v1:172.21.15.167:6817/2984111963] conn(0x7f41bc0acf80 0x7f41bc0af420 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:21.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.297+0000 7f41d852f640 1 -- 172.21.15.92:0/2725697465 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f41bc0a3350 msgr2=0x7f41bc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:21.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.297+0000 7f41d852f640 1 --2- 172.21.15.92:0/2725697465 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f41bc0a3350 0x7f41bc0a5810 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f41d00ff0e0 tx=0x7f41c400a2d0 comp rx=0 tx=0).stop 2024-09-19T08:55:21.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.297+0000 7f41d852f640 1 -- 172.21.15.92:0/2725697465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41d0100e20 msgr2=0x7f41d019a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:21.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.297+0000 7f41d852f640 1 --2- 172.21.15.92:0/2725697465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41d0100e20 0x7f41d019a710 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f41cc006010 tx=0x7f41cc003c80 comp rx=0 tx=0).stop 2024-09-19T08:55:21.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.297+0000 7f41d6acc640 1 -- 172.21.15.92:0/2725697465 reap_dead start 2024-09-19T08:55:21.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.297+0000 7f41d852f640 1 -- 172.21.15.92:0/2725697465 shutdown_connections 2024-09-19T08:55:21.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.297+0000 7f41d852f640 1 -- 172.21.15.92:0/2725697465 >> 172.21.15.92:0/2725697465 conn(0x7f41d00fc7d0 msgr2=0x7f41d006a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:21.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.297+0000 7f41d852f640 1 -- 172.21.15.92:0/2725697465 shutdown_connections 2024-09-19T08:55:21.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.297+0000 7f41d852f640 1 -- 172.21.15.92:0/2725697465 wait complete. 2024-09-19T08:55:21.671 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:21 smithi092 ceph-mon[31407]: pgmap v296: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-19T08:55:21.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.670+0000 7f61f7775640 1 -- 172.21.15.92:0/3584806451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61f0106a80 msgr2=0x7f61f0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:21.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.670+0000 7f61f7775640 1 --2- 172.21.15.92:0/3584806451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61f0106a80 0x7f61f0106e60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f61ec009930 tx=0x7f61ec02a420 comp rx=0 tx=0).stop 2024-09-19T08:55:21.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.670+0000 7f61f7775640 1 -- 172.21.15.92:0/3584806451 shutdown_connections 2024-09-19T08:55:21.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.670+0000 7f61f7775640 1 --2- 172.21.15.92:0/3584806451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61f0101420 0x7f61f010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:21.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.670+0000 7f61f7775640 1 --2- 172.21.15.92:0/3584806451 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61f0100a80 0x7f61f0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:21.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.670+0000 7f61f7775640 1 --2- 172.21.15.92:0/3584806451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61f0106a80 0x7f61f0106e60 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:21.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.670+0000 7f61f7775640 1 -- 172.21.15.92:0/3584806451 >> 172.21.15.92:0/3584806451 conn(0x7f61f00fc7a0 msgr2=0x7f61f00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:21.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.670+0000 7f61f7775640 1 -- 172.21.15.92:0/3584806451 shutdown_connections 2024-09-19T08:55:21.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.670+0000 7f61f7775640 1 -- 172.21.15.92:0/3584806451 wait complete. 2024-09-19T08:55:21.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.671+0000 7f61f7775640 1 Processor -- start 2024-09-19T08:55:21.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.671+0000 7f61f7775640 1 -- start start 2024-09-19T08:55:21.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.671+0000 7f61f7775640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61f0100a80 0x7f61f0198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:21.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.671+0000 7f61f7775640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61f0101420 0x7f61f0198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:21.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.671+0000 7f61f7775640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61f0106a80 0x7f61f019ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:21.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.671+0000 7f61f7775640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f61f0110f20 con 0x7f61f0101420 2024-09-19T08:55:21.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.671+0000 7f61f7775640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f61f0110da0 con 0x7f61f0106a80 2024-09-19T08:55:21.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.671+0000 7f61f7775640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f61f01110a0 con 0x7f61f0100a80 2024-09-19T08:55:21.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.671+0000 7f61f4d10640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61f0101420 0x7f61f0198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:21.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.671+0000 7f61f4d10640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61f0101420 0x7f61f0198b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52230/0 (socket says 172.21.15.92:52230) 2024-09-19T08:55:21.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.671+0000 7f61f4d10640 1 -- 172.21.15.92:0/3991389081 learned_addr learned my addr 172.21.15.92:0/3991389081 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:21.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.671+0000 7f61f5511640 1 --2- 172.21.15.92:0/3991389081 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61f0100a80 0x7f61f0198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:21.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.671+0000 7f61f4d10640 1 -- 172.21.15.92:0/3991389081 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61f0100a80 msgr2=0x7f61f0198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:21.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.671+0000 7f61f4d10640 1 --2- 172.21.15.92:0/3991389081 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61f0100a80 0x7f61f0198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:21.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.671+0000 7f61f4d10640 1 -- 172.21.15.92:0/3991389081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61f0106a80 msgr2=0x7f61f019ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:21.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.671+0000 7f61f5d12640 1 --2- 172.21.15.92:0/3991389081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61f0106a80 0x7f61f019ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:21.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.671+0000 7f61f4d10640 1 --2- 172.21.15.92:0/3991389081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61f0106a80 0x7f61f019ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:21.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.671+0000 7f61f4d10640 1 -- 172.21.15.92:0/3991389081 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61f019d5b0 con 0x7f61f0101420 2024-09-19T08:55:21.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.671+0000 7f61f5511640 1 --2- 172.21.15.92:0/3991389081 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61f0100a80 0x7f61f0198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:55:21.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.671+0000 7f61f5d12640 1 --2- 172.21.15.92:0/3991389081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61f0106a80 0x7f61f019ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:55:21.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.672+0000 7f61f4d10640 1 --2- 172.21.15.92:0/3991389081 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61f0101420 0x7f61f0198b40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f61e000b4a0 tx=0x7f61e000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:21.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.672+0000 7f61e67fc640 1 -- 172.21.15.92:0/3991389081 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e0014070 con 0x7f61f0101420 2024-09-19T08:55:21.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.672+0000 7f61e67fc640 1 -- 172.21.15.92:0/3991389081 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61e0010af0 con 0x7f61f0101420 2024-09-19T08:55:21.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.672+0000 7f61f7775640 1 -- 172.21.15.92:0/3991389081 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61f019d8a0 con 0x7f61f0101420 2024-09-19T08:55:21.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.672+0000 7f61e67fc640 1 -- 172.21.15.92:0/3991389081 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e0017d10 con 0x7f61f0101420 2024-09-19T08:55:21.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.672+0000 7f61f7775640 1 -- 172.21.15.92:0/3991389081 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61f01a5180 con 0x7f61f0101420 2024-09-19T08:55:21.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.673+0000 7f61f7775640 1 -- 172.21.15.92:0/3991389081 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f61f00fd240 con 0x7f61f0101420 2024-09-19T08:55:21.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.674+0000 7f61e67fc640 1 -- 172.21.15.92:0/3991389081 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f61e0017070 con 0x7f61f0101420 2024-09-19T08:55:21.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.674+0000 7f61e67fc640 1 --2- 172.21.15.92:0/3991389081 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f61dc0a3350 0x7f61dc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:21.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.675+0000 7f61f5511640 1 --2- 172.21.15.92:0/3991389081 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f61dc0a3350 0x7f61dc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:21.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.675+0000 7f61e67fc640 1 -- 172.21.15.92:0/3991389081 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f61e00cf1e0 con 0x7f61f0101420 2024-09-19T08:55:21.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.675+0000 7f61e67fc640 1 --2- 172.21.15.92:0/3991389081 >> [v2:172.21.15.92:6818/1743435653,v1:172.21.15.92:6819/1743435653] conn(0x7f61dc0acf80 0x7f61dc0af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:21.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.675+0000 7f61e67fc640 1 -- 172.21.15.92:0/3991389081 --> [v2:172.21.15.92:6818/1743435653,v1:172.21.15.92:6819/1743435653] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f61e000ee50 con 0x7f61dc0acf80 2024-09-19T08:55:21.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.675+0000 7f61e67fc640 1 -- 172.21.15.92:0/3991389081 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f61e00cf610 con 0x7f61f0101420 2024-09-19T08:55:21.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.675+0000 7f61f5d12640 1 --2- 172.21.15.92:0/3991389081 >> [v2:172.21.15.92:6818/1743435653,v1:172.21.15.92:6819/1743435653] conn(0x7f61dc0acf80 0x7f61dc0af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:21.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.675+0000 7f61f5511640 1 --2- 172.21.15.92:0/3991389081 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f61dc0a3350 0x7f61dc0a5810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f61ec000c00 tx=0x7f61ec005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:21.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.675+0000 7f61f5d12640 1 --2- 172.21.15.92:0/3991389081 >> [v2:172.21.15.92:6818/1743435653,v1:172.21.15.92:6819/1743435653] conn(0x7f61dc0acf80 0x7f61dc0af420 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:21.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.676+0000 7f61e67fc640 1 -- 172.21.15.92:0/3991389081 <== osd.6 v2:172.21.15.92:6818/1743435653 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f61e000ee50 con 0x7f61dc0acf80 2024-09-19T08:55:21.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.689+0000 7f61f7775640 1 -- 172.21.15.92:0/3991389081 --> [v2:172.21.15.92:6818/1743435653,v1:172.21.15.92:6819/1743435653] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f61f01021c0 con 0x7f61dc0acf80 2024-09-19T08:55:21.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.689+0000 7f61e67fc640 1 -- 172.21.15.92:0/3991389081 <== osd.6 v2:172.21.15.92:6818/1743435653 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f61f01021c0 con 0x7f61dc0acf80 2024-09-19T08:55:21.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.690+0000 7f61f7775640 1 -- 172.21.15.92:0/3991389081 >> [v2:172.21.15.92:6818/1743435653,v1:172.21.15.92:6819/1743435653] conn(0x7f61dc0acf80 msgr2=0x7f61dc0af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:21.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.690+0000 7f61f7775640 1 --2- 172.21.15.92:0/3991389081 >> [v2:172.21.15.92:6818/1743435653,v1:172.21.15.92:6819/1743435653] conn(0x7f61dc0acf80 0x7f61dc0af420 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:21.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.690+0000 7f61f7775640 1 -- 172.21.15.92:0/3991389081 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f61dc0a3350 msgr2=0x7f61dc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:21.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.690+0000 7f61f7775640 1 --2- 172.21.15.92:0/3991389081 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f61dc0a3350 0x7f61dc0a5810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f61ec000c00 tx=0x7f61ec005a20 comp rx=0 tx=0).stop 2024-09-19T08:55:21.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.690+0000 7f61f7775640 1 -- 172.21.15.92:0/3991389081 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61f0101420 msgr2=0x7f61f0198b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:21.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.690+0000 7f61f7775640 1 --2- 172.21.15.92:0/3991389081 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61f0101420 0x7f61f0198b40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f61e000b4a0 tx=0x7f61e000b960 comp rx=0 tx=0).stop 2024-09-19T08:55:21.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.690+0000 7f61f5d12640 1 -- 172.21.15.92:0/3991389081 reap_dead start 2024-09-19T08:55:21.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.690+0000 7f61f7775640 1 -- 172.21.15.92:0/3991389081 shutdown_connections 2024-09-19T08:55:21.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.690+0000 7f61f7775640 1 -- 172.21.15.92:0/3991389081 >> 172.21.15.92:0/3991389081 conn(0x7f61f00fc7a0 msgr2=0x7f61f0104970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:21.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.690+0000 7f61f7775640 1 -- 172.21.15.92:0/3991389081 shutdown_connections 2024-09-19T08:55:21.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:21.690+0000 7f61f7775640 1 -- 172.21.15.92:0/3991389081 wait complete. 2024-09-19T08:55:21.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:21 smithi167 ceph-mon[35359]: pgmap v296: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-19T08:55:21.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:21 smithi190 ceph-mon[35358]: pgmap v296: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-19T08:55:22.836 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738442 got 34359738443 for osd.0 2024-09-19T08:55:22.836 DEBUG:teuthology.parallel:result is None 2024-09-19T08:55:23.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:23 smithi092 ceph-mon[31407]: pgmap v297: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-19T08:55:23.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:23 smithi167 ceph-mon[35359]: pgmap v297: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-19T08:55:23.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:23 smithi190 ceph-mon[35358]: pgmap v297: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-19T08:55:23.884 INFO:teuthology.orchestra.run.smithi092.stdout:261993005088 2024-09-19T08:55:23.885 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-19T08:55:24.388 INFO:teuthology.orchestra.run.smithi092.stdout:201863462955 2024-09-19T08:55:24.389 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-19T08:55:24.513 INFO:teuthology.orchestra.run.smithi092.stdout:184683593776 2024-09-19T08:55:24.514 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-19T08:55:24.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.542+0000 7f4fdd2b0640 1 -- 172.21.15.92:0/2269020676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fd8106f10 msgr2=0x7f4fd810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:24.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.542+0000 7f4fdd2b0640 1 --2- 172.21.15.92:0/2269020676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fd8106f10 0x7f4fd810ea90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0009ca0 tx=0x7f4fd002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:55:24.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.542+0000 7f4fdd2b0640 1 -- 172.21.15.92:0/2269020676 shutdown_connections 2024-09-19T08:55:24.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.542+0000 7f4fdd2b0640 1 --2- 172.21.15.92:0/2269020676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fd8106f10 0x7f4fd810ea90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:24.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.542+0000 7f4fdd2b0640 1 --2- 172.21.15.92:0/2269020676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fd8102790 0x7f4fd81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:24.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.542+0000 7f4fdd2b0640 1 --2- 172.21.15.92:0/2269020676 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4fd8101de0 0x7f4fd81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:24.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.542+0000 7f4fdd2b0640 1 -- 172.21.15.92:0/2269020676 >> 172.21.15.92:0/2269020676 conn(0x7f4fd80fd8c0 msgr2=0x7f4fd80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:24.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.542+0000 7f4fdd2b0640 1 -- 172.21.15.92:0/2269020676 shutdown_connections 2024-09-19T08:55:24.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.542+0000 7f4fdd2b0640 1 -- 172.21.15.92:0/2269020676 wait complete. 2024-09-19T08:55:24.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.542+0000 7f4fdd2b0640 1 Processor -- start 2024-09-19T08:55:24.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.543+0000 7f4fdd2b0640 1 -- start start 2024-09-19T08:55:24.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.543+0000 7f4fdd2b0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fd8101de0 0x7f4fd8198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:24.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.543+0000 7f4fdd2b0640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4fd8102790 0x7f4fd8198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:24.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.543+0000 7f4fdd2b0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fd8106f10 0x7f4fd819ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:24.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.543+0000 7f4fdd2b0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd8112010 con 0x7f4fd8106f10 2024-09-19T08:55:24.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.543+0000 7f4fdd2b0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd8111e90 con 0x7f4fd8101de0 2024-09-19T08:55:24.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.543+0000 7f4fdd2b0640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd8112190 con 0x7f4fd8102790 2024-09-19T08:55:24.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.543+0000 7f4fd77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fd8106f10 0x7f4fd819ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:24.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.543+0000 7f4fd77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fd8106f10 0x7f4fd819ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52248/0 (socket says 172.21.15.92:52248) 2024-09-19T08:55:24.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.543+0000 7f4fd77fe640 1 -- 172.21.15.92:0/3054881741 learned_addr learned my addr 172.21.15.92:0/3054881741 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:24.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.543+0000 7f4fd67fc640 1 --2- 172.21.15.92:0/3054881741 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4fd8102790 0x7f4fd8198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:24.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.543+0000 7f4fd77fe640 1 -- 172.21.15.92:0/3054881741 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4fd8102790 msgr2=0x7f4fd8198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:24.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.543+0000 7f4fd77fe640 1 --2- 172.21.15.92:0/3054881741 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4fd8102790 0x7f4fd8198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:24.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.543+0000 7f4fd77fe640 1 -- 172.21.15.92:0/3054881741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fd8101de0 msgr2=0x7f4fd8198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:24.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.543+0000 7f4fd6ffd640 1 --2- 172.21.15.92:0/3054881741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fd8101de0 0x7f4fd8198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:24.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.543+0000 7f4fd77fe640 1 --2- 172.21.15.92:0/3054881741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fd8101de0 0x7f4fd8198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:24.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.543+0000 7f4fd77fe640 1 -- 172.21.15.92:0/3054881741 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd819d520 con 0x7f4fd8106f10 2024-09-19T08:55:24.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.543+0000 7f4fd67fc640 1 --2- 172.21.15.92:0/3054881741 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4fd8102790 0x7f4fd8198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:55:24.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.543+0000 7f4fd6ffd640 1 --2- 172.21.15.92:0/3054881741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fd8101de0 0x7f4fd8198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:55:24.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.543+0000 7f4fd77fe640 1 --2- 172.21.15.92:0/3054881741 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fd8106f10 0x7f4fd819ce40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0031a60 tx=0x7f4fd0031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:24.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.544+0000 7f4fcffff640 1 -- 172.21.15.92:0/3054881741 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd0003c30 con 0x7f4fd8106f10 2024-09-19T08:55:24.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.544+0000 7f4fdd2b0640 1 -- 172.21.15.92:0/3054881741 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fd819d7b0 con 0x7f4fd8106f10 2024-09-19T08:55:24.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.544+0000 7f4fcffff640 1 -- 172.21.15.92:0/3054881741 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fd0003dd0 con 0x7f4fd8106f10 2024-09-19T08:55:24.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.544+0000 7f4fcffff640 1 -- 172.21.15.92:0/3054881741 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd00047e0 con 0x7f4fd8106f10 2024-09-19T08:55:24.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.544+0000 7f4fdd2b0640 1 -- 172.21.15.92:0/3054881741 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fd81a50f0 con 0x7f4fd8106f10 2024-09-19T08:55:24.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.544+0000 7f4fdd2b0640 1 -- 172.21.15.92:0/3054881741 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4fd8062980 con 0x7f4fd8106f10 2024-09-19T08:55:24.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.546+0000 7f4fcffff640 1 -- 172.21.15.92:0/3054881741 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4fd002f790 con 0x7f4fd8106f10 2024-09-19T08:55:24.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.546+0000 7f4fcffff640 1 --2- 172.21.15.92:0/3054881741 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4fc40a32d0 0x7f4fc40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:24.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.547+0000 7f4fd6ffd640 1 --2- 172.21.15.92:0/3054881741 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4fc40a32d0 0x7f4fc40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:24.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.547+0000 7f4fcffff640 1 -- 172.21.15.92:0/3054881741 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4fd00f0fb0 con 0x7f4fd8106f10 2024-09-19T08:55:24.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.547+0000 7f4fcffff640 1 --2- 172.21.15.92:0/3054881741 >> [v2:172.21.15.190:6800/702507556,v1:172.21.15.190:6801/702507556] conn(0x7f4fc40acf00 0x7f4fc40af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:24.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.547+0000 7f4fcffff640 1 -- 172.21.15.92:0/3054881741 --> [v2:172.21.15.190:6800/702507556,v1:172.21.15.190:6801/702507556] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4fc40afa70 con 0x7f4fc40acf00 2024-09-19T08:55:24.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.547+0000 7f4fcffff640 1 -- 172.21.15.92:0/3054881741 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f4fd00f1490 con 0x7f4fd8106f10 2024-09-19T08:55:24.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.547+0000 7f4fd6ffd640 1 --2- 172.21.15.92:0/3054881741 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4fc40a32d0 0x7f4fc40a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0006fd0 tx=0x7f4fc0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:24.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.547+0000 7f4fd67fc640 1 --2- 172.21.15.92:0/3054881741 >> [v2:172.21.15.190:6800/702507556,v1:172.21.15.190:6801/702507556] conn(0x7f4fc40acf00 0x7f4fc40af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:24.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.548+0000 7f4fd67fc640 1 --2- 172.21.15.92:0/3054881741 >> [v2:172.21.15.190:6800/702507556,v1:172.21.15.190:6801/702507556] conn(0x7f4fc40acf00 0x7f4fc40af3a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:24.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.548+0000 7f4fcffff640 1 -- 172.21.15.92:0/3054881741 <== osd.2 v2:172.21.15.190:6800/702507556 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4fc40afa70 con 0x7f4fc40acf00 2024-09-19T08:55:24.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.562+0000 7f4fdd2b0640 1 -- 172.21.15.92:0/3054881741 --> [v2:172.21.15.190:6800/702507556,v1:172.21.15.190:6801/702507556] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4fd8062d80 con 0x7f4fc40acf00 2024-09-19T08:55:24.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.563+0000 7f4fcffff640 1 -- 172.21.15.92:0/3054881741 <== osd.2 v2:172.21.15.190:6800/702507556 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4fd8062d80 con 0x7f4fc40acf00 2024-09-19T08:55:24.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.563+0000 7f4fdd2b0640 1 -- 172.21.15.92:0/3054881741 >> [v2:172.21.15.190:6800/702507556,v1:172.21.15.190:6801/702507556] conn(0x7f4fc40acf00 msgr2=0x7f4fc40af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:24.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.563+0000 7f4fdd2b0640 1 --2- 172.21.15.92:0/3054881741 >> [v2:172.21.15.190:6800/702507556,v1:172.21.15.190:6801/702507556] conn(0x7f4fc40acf00 0x7f4fc40af3a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:24.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.563+0000 7f4fdd2b0640 1 -- 172.21.15.92:0/3054881741 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4fc40a32d0 msgr2=0x7f4fc40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:24.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.563+0000 7f4fdd2b0640 1 --2- 172.21.15.92:0/3054881741 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4fc40a32d0 0x7f4fc40a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0006fd0 tx=0x7f4fc0008040 comp rx=0 tx=0).stop 2024-09-19T08:55:24.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.563+0000 7f4fdd2b0640 1 -- 172.21.15.92:0/3054881741 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fd8106f10 msgr2=0x7f4fd819ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:24.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.563+0000 7f4fdd2b0640 1 --2- 172.21.15.92:0/3054881741 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fd8106f10 0x7f4fd819ce40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0031a60 tx=0x7f4fd0031a90 comp rx=0 tx=0).stop 2024-09-19T08:55:24.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.563+0000 7f4fd77fe640 1 -- 172.21.15.92:0/3054881741 reap_dead start 2024-09-19T08:55:24.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.563+0000 7f4fdd2b0640 1 -- 172.21.15.92:0/3054881741 shutdown_connections 2024-09-19T08:55:24.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.563+0000 7f4fdd2b0640 1 -- 172.21.15.92:0/3054881741 >> 172.21.15.92:0/3054881741 conn(0x7f4fd80fd8c0 msgr2=0x7f4fd80fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:24.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.563+0000 7f4fdd2b0640 1 -- 172.21.15.92:0/3054881741 shutdown_connections 2024-09-19T08:55:24.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:23.563+0000 7f4fdd2b0640 1 -- 172.21.15.92:0/3054881741 wait complete. 2024-09-19T08:55:25.283 INFO:teuthology.orchestra.run.smithi092.stdout:231928234020 2024-09-19T08:55:25.284 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-19T08:55:25.663 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:25 smithi092 ceph-mon[31407]: pgmap v298: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:55:25.690 INFO:teuthology.orchestra.run.smithi092.stdout:55834574918 2024-09-19T08:55:25.690 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-19T08:55:25.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:25 smithi167 ceph-mon[35359]: pgmap v298: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:55:25.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:25 smithi190 ceph-mon[35358]: pgmap v298: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:55:26.241 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:26.273 INFO:teuthology.orchestra.run.smithi092.stdout:77309411395 2024-09-19T08:55:26.273 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-19T08:55:26.283 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:26.285 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:26.576 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:26.576 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:26.580 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:26.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.975+0000 7f256174c640 1 -- 172.21.15.92:0/2504827209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f255c102ef0 msgr2=0x7f255c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:26.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.975+0000 7f256174c640 1 --2- 172.21.15.92:0/2504827209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f255c102ef0 0x7f255c10da40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2554009900 tx=0x7f255402a480 comp rx=0 tx=0).stop 2024-09-19T08:55:26.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.976+0000 7f256174c640 1 -- 172.21.15.92:0/2504827209 shutdown_connections 2024-09-19T08:55:26.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.976+0000 7f256174c640 1 --2- 172.21.15.92:0/2504827209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f255c102ef0 0x7f255c10da40 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:26.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.976+0000 7f256174c640 1 --2- 172.21.15.92:0/2504827209 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f255c102570 0x7f255c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:26.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.976+0000 7f256174c640 1 --2- 172.21.15.92:0/2504827209 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f255c100e20 0x7f255c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:26.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.976+0000 7f256174c640 1 -- 172.21.15.92:0/2504827209 >> 172.21.15.92:0/2504827209 conn(0x7f255c0fc7d0 msgr2=0x7f255c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:26.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.976+0000 7f256174c640 1 -- 172.21.15.92:0/2504827209 shutdown_connections 2024-09-19T08:55:26.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.976+0000 7f256174c640 1 -- 172.21.15.92:0/2504827209 wait complete. 2024-09-19T08:55:26.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.976+0000 7f256174c640 1 Processor -- start 2024-09-19T08:55:26.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.976+0000 7f256174c640 1 -- start start 2024-09-19T08:55:26.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.976+0000 7f256174c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f255c100e20 0x7f255c10e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:26.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.977+0000 7f256174c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f255c102570 0x7f255c10ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:26.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.977+0000 7f256174c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f255c102ef0 0x7f255c10ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:26.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.977+0000 7f256174c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f255c112120 con 0x7f255c100e20 2024-09-19T08:55:26.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.977+0000 7f256174c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f255c111fa0 con 0x7f255c102ef0 2024-09-19T08:55:26.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.977+0000 7f256174c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f255c1122a0 con 0x7f255c102570 2024-09-19T08:55:26.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.977+0000 7f255affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f255c100e20 0x7f255c10e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:26.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.977+0000 7f255affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f255c100e20 0x7f255c10e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52260/0 (socket says 172.21.15.92:52260) 2024-09-19T08:55:26.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.977+0000 7f255affd640 1 -- 172.21.15.92:0/3791809521 learned_addr learned my addr 172.21.15.92:0/3791809521 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:26.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.977+0000 7f255a7fc640 1 --2- 172.21.15.92:0/3791809521 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f255c102570 0x7f255c10ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:26.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.977+0000 7f255b7fe640 1 --2- 172.21.15.92:0/3791809521 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f255c102ef0 0x7f255c10ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:26.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.977+0000 7f255affd640 1 -- 172.21.15.92:0/3791809521 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f255c102570 msgr2=0x7f255c10ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:26.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.977+0000 7f255affd640 1 --2- 172.21.15.92:0/3791809521 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f255c102570 0x7f255c10ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:26.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.977+0000 7f255affd640 1 -- 172.21.15.92:0/3791809521 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f255c102ef0 msgr2=0x7f255c10ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:26.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.977+0000 7f255affd640 1 --2- 172.21.15.92:0/3791809521 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f255c102ef0 0x7f255c10ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:26.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.977+0000 7f255affd640 1 -- 172.21.15.92:0/3791809521 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f255c1a6aa0 con 0x7f255c100e20 2024-09-19T08:55:26.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.977+0000 7f255affd640 1 --2- 172.21.15.92:0/3791809521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f255c100e20 0x7f255c10e4d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f254c00ba50 tx=0x7f254c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:26.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.977+0000 7f2553fff640 1 -- 172.21.15.92:0/3791809521 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254c019070 con 0x7f255c100e20 2024-09-19T08:55:26.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.977+0000 7f256174c640 1 -- 172.21.15.92:0/3791809521 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f255c1a6d90 con 0x7f255c100e20 2024-09-19T08:55:26.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.977+0000 7f2553fff640 1 -- 172.21.15.92:0/3791809521 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f254c00cbe0 con 0x7f255c100e20 2024-09-19T08:55:26.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.977+0000 7f2553fff640 1 -- 172.21.15.92:0/3791809521 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254c0076e0 con 0x7f255c100e20 2024-09-19T08:55:26.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.977+0000 7f256174c640 1 -- 172.21.15.92:0/3791809521 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f255c1a7250 con 0x7f255c100e20 2024-09-19T08:55:26.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.978+0000 7f256174c640 1 -- 172.21.15.92:0/3791809521 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f255c101280 con 0x7f255c100e20 2024-09-19T08:55:26.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.979+0000 7f2553fff640 1 -- 172.21.15.92:0/3791809521 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f254c01c070 con 0x7f255c100e20 2024-09-19T08:55:26.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.980+0000 7f2553fff640 1 --2- 172.21.15.92:0/3791809521 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f25480a32d0 0x7f25480a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:26.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.980+0000 7f255a7fc640 1 --2- 172.21.15.92:0/3791809521 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f25480a32d0 0x7f25480a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:26.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.980+0000 7f2553fff640 1 -- 172.21.15.92:0/3791809521 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f254c0cefb0 con 0x7f255c100e20 2024-09-19T08:55:26.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.980+0000 7f255a7fc640 1 --2- 172.21.15.92:0/3791809521 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f25480a32d0 0x7f25480a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f255c10ff60 tx=0x7f2544008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:26.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:26.984+0000 7f2553fff640 1 -- 172.21.15.92:0/3791809521 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f254c09bc80 con 0x7f255c100e20 2024-09-19T08:55:27.001 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:27.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.159+0000 7f256174c640 1 -- 172.21.15.92:0/3791809521 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f255c10fa00 con 0x7f255c100e20 2024-09-19T08:55:27.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.160+0000 7f2553fff640 1 -- 172.21.15.92:0/3791809521 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f255c10fa00 con 0x7f255c100e20 2024-09-19T08:55:27.159 INFO:teuthology.orchestra.run.smithi092.stdout:184683593776 2024-09-19T08:55:27.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.162+0000 7f256174c640 1 -- 172.21.15.92:0/3791809521 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f25480a32d0 msgr2=0x7f25480a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:27.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.162+0000 7f256174c640 1 --2- 172.21.15.92:0/3791809521 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f25480a32d0 0x7f25480a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f255c10ff60 tx=0x7f2544008040 comp rx=0 tx=0).stop 2024-09-19T08:55:27.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.162+0000 7f256174c640 1 -- 172.21.15.92:0/3791809521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f255c100e20 msgr2=0x7f255c10e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:27.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.162+0000 7f256174c640 1 --2- 172.21.15.92:0/3791809521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f255c100e20 0x7f255c10e4d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f254c00ba50 tx=0x7f254c00bf10 comp rx=0 tx=0).stop 2024-09-19T08:55:27.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.162+0000 7f256174c640 1 -- 172.21.15.92:0/3791809521 shutdown_connections 2024-09-19T08:55:27.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.162+0000 7f256174c640 1 --2- 172.21.15.92:0/3791809521 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f255c102ef0 0x7f255c10ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:27.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.162+0000 7f256174c640 1 --2- 172.21.15.92:0/3791809521 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f255c102570 0x7f255c10ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:27.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.162+0000 7f256174c640 1 --2- 172.21.15.92:0/3791809521 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f25480a32d0 0x7f25480a5790 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:27.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.162+0000 7f256174c640 1 --2- 172.21.15.92:0/3791809521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f255c100e20 0x7f255c10e4d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:27.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.162+0000 7f256174c640 1 -- 172.21.15.92:0/3791809521 >> 172.21.15.92:0/3791809521 conn(0x7f255c0fc7d0 msgr2=0x7f255c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:27.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.162+0000 7f256174c640 1 -- 172.21.15.92:0/3791809521 shutdown_connections 2024-09-19T08:55:27.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.162+0000 7f256174c640 1 -- 172.21.15.92:0/3791809521 wait complete. 2024-09-19T08:55:27.410 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:27 smithi092 ceph-mon[31407]: pgmap v299: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:55:27.411 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:27 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3791809521' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T08:55:27.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:27 smithi167 ceph-mon[35359]: pgmap v299: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:55:27.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:27 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3791809521' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T08:55:27.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:27 smithi190 ceph-mon[35358]: pgmap v299: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:55:27.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:27 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3791809521' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T08:55:27.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.227+0000 7fd53ec14640 1 -- 172.21.15.92:0/1987024773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd538101df0 msgr2=0x7fd5381021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:27.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.227+0000 7fd53ec14640 1 --2- 172.21.15.92:0/1987024773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd538101df0 0x7fd5381021d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd52c009900 tx=0x7fd52c02a410 comp rx=0 tx=0).stop 2024-09-19T08:55:27.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.227+0000 7fd53ec14640 1 -- 172.21.15.92:0/1987024773 shutdown_connections 2024-09-19T08:55:27.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.227+0000 7fd53ec14640 1 --2- 172.21.15.92:0/1987024773 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd538106f20 0x7fd53810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:27.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.227+0000 7fd53ec14640 1 --2- 172.21.15.92:0/1987024773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5381027a0 0x7fd5381067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:27.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.227+0000 7fd53ec14640 1 --2- 172.21.15.92:0/1987024773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd538101df0 0x7fd5381021d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:27.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.227+0000 7fd53ec14640 1 -- 172.21.15.92:0/1987024773 >> 172.21.15.92:0/1987024773 conn(0x7fd5380fd8f0 msgr2=0x7fd5380ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:27.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.227+0000 7fd53ec14640 1 -- 172.21.15.92:0/1987024773 shutdown_connections 2024-09-19T08:55:27.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.227+0000 7fd53ec14640 1 -- 172.21.15.92:0/1987024773 wait complete. 2024-09-19T08:55:27.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.228+0000 7fd53ec14640 1 Processor -- start 2024-09-19T08:55:27.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.228+0000 7fd53ec14640 1 -- start start 2024-09-19T08:55:27.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.228+0000 7fd53ec14640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd538101df0 0x7fd538198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:27.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.228+0000 7fd53ec14640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5381027a0 0x7fd5381989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:27.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.228+0000 7fd53ec14640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd538106f20 0x7fd53819cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:27.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.228+0000 7fd53ec14640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd538111f80 con 0x7fd538106f20 2024-09-19T08:55:27.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.228+0000 7fd53ec14640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd538111e00 con 0x7fd538101df0 2024-09-19T08:55:27.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.228+0000 7fd53ec14640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd538112100 con 0x7fd5381027a0 2024-09-19T08:55:27.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.228+0000 7fd53d1b1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd538106f20 0x7fd53819cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:27.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.228+0000 7fd53d1b1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd538106f20 0x7fd53819cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52288/0 (socket says 172.21.15.92:52288) 2024-09-19T08:55:27.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.228+0000 7fd53d1b1640 1 -- 172.21.15.92:0/4271869173 learned_addr learned my addr 172.21.15.92:0/4271869173 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:27.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.228+0000 7fd53c9b0640 1 --2- 172.21.15.92:0/4271869173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd538101df0 0x7fd538198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:27.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.228+0000 7fd537fff640 1 --2- 172.21.15.92:0/4271869173 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5381027a0 0x7fd5381989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:27.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.229+0000 7fd53d1b1640 1 -- 172.21.15.92:0/4271869173 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5381027a0 msgr2=0x7fd5381989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:27.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.229+0000 7fd53d1b1640 1 --2- 172.21.15.92:0/4271869173 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5381027a0 0x7fd5381989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:27.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.229+0000 7fd53d1b1640 1 -- 172.21.15.92:0/4271869173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd538101df0 msgr2=0x7fd538198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:27.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.229+0000 7fd53d1b1640 1 --2- 172.21.15.92:0/4271869173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd538101df0 0x7fd538198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:27.956 INFO:teuthology.orchestra.run.smithi092.stdout:261993005090 2024-09-19T08:55:27.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.229+0000 7fd53d1b1640 1 -- 172.21.15.92:0/4271869173 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd53819d410 con 0x7fd538106f20 2024-09-19T08:55:27.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.229+0000 7fd53d1b1640 1 --2- 172.21.15.92:0/4271869173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd538106f20 0x7fd53819cd30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd53000cad0 tx=0x7fd53000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:27.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.229+0000 7fd535ffb640 1 -- 172.21.15.92:0/4271869173 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd53000ae20 con 0x7fd538106f20 2024-09-19T08:55:27.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.229+0000 7fd535ffb640 1 -- 172.21.15.92:0/4271869173 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd530005020 con 0x7fd538106f20 2024-09-19T08:55:27.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.229+0000 7fd53ec14640 1 -- 172.21.15.92:0/4271869173 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd53819d700 con 0x7fd538106f20 2024-09-19T08:55:27.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.229+0000 7fd535ffb640 1 -- 172.21.15.92:0/4271869173 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd53000f6f0 con 0x7fd538106f20 2024-09-19T08:55:27.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.229+0000 7fd53ec14640 1 -- 172.21.15.92:0/4271869173 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5381a4fe0 con 0x7fd538106f20 2024-09-19T08:55:27.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.230+0000 7fd53ec14640 1 -- 172.21.15.92:0/4271869173 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5381021d0 con 0x7fd538106f20 2024-09-19T08:55:27.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.231+0000 7fd535ffb640 1 -- 172.21.15.92:0/4271869173 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd5300051d0 con 0x7fd538106f20 2024-09-19T08:55:27.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.232+0000 7fd535ffb640 1 --2- 172.21.15.92:0/4271869173 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd5280a32d0 0x7fd5280a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:27.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.232+0000 7fd53c9b0640 1 --2- 172.21.15.92:0/4271869173 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd5280a32d0 0x7fd5280a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:27.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.232+0000 7fd535ffb640 1 -- 172.21.15.92:0/4271869173 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd5300cfd80 con 0x7fd538106f20 2024-09-19T08:55:27.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.232+0000 7fd53c9b0640 1 --2- 172.21.15.92:0/4271869173 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd5280a32d0 0x7fd5280a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd52c009230 tx=0x7fd52c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:27.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.236+0000 7fd535ffb640 1 -- 172.21.15.92:0/4271869173 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd530014030 con 0x7fd538106f20 2024-09-19T08:55:27.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.408+0000 7fd53ec14640 1 -- 172.21.15.92:0/4271869173 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fd538109b70 con 0x7fd538106f20 2024-09-19T08:55:27.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.408+0000 7fd535ffb640 1 -- 172.21.15.92:0/4271869173 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd53009c940 con 0x7fd538106f20 2024-09-19T08:55:27.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.411+0000 7fd53ec14640 1 -- 172.21.15.92:0/4271869173 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd5280a32d0 msgr2=0x7fd5280a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:27.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.411+0000 7fd53ec14640 1 --2- 172.21.15.92:0/4271869173 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd5280a32d0 0x7fd5280a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd52c009230 tx=0x7fd52c0058d0 comp rx=0 tx=0).stop 2024-09-19T08:55:27.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.411+0000 7fd53ec14640 1 -- 172.21.15.92:0/4271869173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd538106f20 msgr2=0x7fd53819cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:27.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.411+0000 7fd53ec14640 1 --2- 172.21.15.92:0/4271869173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd538106f20 0x7fd53819cd30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd53000cad0 tx=0x7fd53000cf90 comp rx=0 tx=0).stop 2024-09-19T08:55:27.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.411+0000 7fd53ec14640 1 -- 172.21.15.92:0/4271869173 shutdown_connections 2024-09-19T08:55:27.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.411+0000 7fd53ec14640 1 --2- 172.21.15.92:0/4271869173 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd5280a32d0 0x7fd5280a5790 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:27.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.411+0000 7fd53ec14640 1 --2- 172.21.15.92:0/4271869173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd538106f20 0x7fd53819cd30 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:27.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.411+0000 7fd53ec14640 1 --2- 172.21.15.92:0/4271869173 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5381027a0 0x7fd5381989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:27.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.411+0000 7fd53ec14640 1 --2- 172.21.15.92:0/4271869173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd538101df0 0x7fd538198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:27.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.411+0000 7fd53ec14640 1 -- 172.21.15.92:0/4271869173 >> 172.21.15.92:0/4271869173 conn(0x7fd5380fd8f0 msgr2=0x7fd5380fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:27.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.411+0000 7fd53ec14640 1 -- 172.21.15.92:0/4271869173 shutdown_connections 2024-09-19T08:55:27.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:27.411+0000 7fd53ec14640 1 -- 172.21.15.92:0/4271869173 wait complete. 2024-09-19T08:55:28.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.318+0000 7ffbf3895640 1 -- 172.21.15.92:0/2728024947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffbec102ef0 msgr2=0x7ffbec10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:28.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.318+0000 7ffbf3895640 1 --2- 172.21.15.92:0/2728024947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffbec102ef0 0x7ffbec10da40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4009ca0 tx=0x7ffbe402a950 comp rx=0 tx=0).stop 2024-09-19T08:55:28.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.318+0000 7ffbf3895640 1 -- 172.21.15.92:0/2728024947 shutdown_connections 2024-09-19T08:55:28.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.318+0000 7ffbf3895640 1 --2- 172.21.15.92:0/2728024947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffbec102ef0 0x7ffbec10da40 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.318+0000 7ffbf3895640 1 --2- 172.21.15.92:0/2728024947 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffbec102570 0x7ffbec1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.318+0000 7ffbf3895640 1 --2- 172.21.15.92:0/2728024947 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffbec100e20 0x7ffbec101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.318+0000 7ffbf3895640 1 -- 172.21.15.92:0/2728024947 >> 172.21.15.92:0/2728024947 conn(0x7ffbec0fc7d0 msgr2=0x7ffbec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:28.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.319+0000 7ffbf3895640 1 -- 172.21.15.92:0/2728024947 shutdown_connections 2024-09-19T08:55:28.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.319+0000 7ffbf3895640 1 -- 172.21.15.92:0/2728024947 wait complete. 2024-09-19T08:55:28.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.319+0000 7ffbf3895640 1 Processor -- start 2024-09-19T08:55:28.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.319+0000 7ffbf3895640 1 -- start start 2024-09-19T08:55:28.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.319+0000 7ffbf3895640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffbec100e20 0x7ffbec0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:28.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.319+0000 7ffbf3895640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffbec102570 0x7ffbec0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:28.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.319+0000 7ffbf3895640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffbec102ef0 0x7ffbec0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:28.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.319+0000 7ffbf3895640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffbec111020 con 0x7ffbec100e20 2024-09-19T08:55:28.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.319+0000 7ffbf3895640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ffbec110ea0 con 0x7ffbec102570 2024-09-19T08:55:28.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.319+0000 7ffbf3895640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ffbec1111a0 con 0x7ffbec102ef0 2024-09-19T08:55:28.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.319+0000 7ffbf1631640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffbec100e20 0x7ffbec0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:28.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.319+0000 7ffbf1631640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffbec100e20 0x7ffbec0fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52312/0 (socket says 172.21.15.92:52312) 2024-09-19T08:55:28.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.319+0000 7ffbf1631640 1 -- 172.21.15.92:0/24915446 learned_addr learned my addr 172.21.15.92:0/24915446 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:28.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.320+0000 7ffbf1e32640 1 --2- 172.21.15.92:0/24915446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffbec102ef0 0x7ffbec0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:28.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.320+0000 7ffbf0e30640 1 --2- 172.21.15.92:0/24915446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffbec102570 0x7ffbec0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:28.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.320+0000 7ffbf1631640 1 -- 172.21.15.92:0/24915446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffbec102ef0 msgr2=0x7ffbec0fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:28.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.320+0000 7ffbf1631640 1 --2- 172.21.15.92:0/24915446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffbec102ef0 0x7ffbec0fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.320+0000 7ffbf1631640 1 -- 172.21.15.92:0/24915446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffbec102570 msgr2=0x7ffbec0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:28.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.320+0000 7ffbf1631640 1 --2- 172.21.15.92:0/24915446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffbec102570 0x7ffbec0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.320+0000 7ffbf1631640 1 -- 172.21.15.92:0/24915446 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbec1a6aa0 con 0x7ffbec100e20 2024-09-19T08:55:28.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.320+0000 7ffbf0e30640 1 --2- 172.21.15.92:0/24915446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffbec102570 0x7ffbec0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:55:28.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.320+0000 7ffbf1631640 1 --2- 172.21.15.92:0/24915446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffbec100e20 0x7ffbec0fcc80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ffbe800b4a0 tx=0x7ffbe800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:28.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.320+0000 7ffbe27fc640 1 -- 172.21.15.92:0/24915446 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe8014070 con 0x7ffbec100e20 2024-09-19T08:55:28.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.320+0000 7ffbe27fc640 1 -- 172.21.15.92:0/24915446 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbe8010af0 con 0x7ffbec100e20 2024-09-19T08:55:28.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.320+0000 7ffbf3895640 1 -- 172.21.15.92:0/24915446 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbec1a6d90 con 0x7ffbec100e20 2024-09-19T08:55:28.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.320+0000 7ffbe27fc640 1 -- 172.21.15.92:0/24915446 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe8017d10 con 0x7ffbec100e20 2024-09-19T08:55:28.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.320+0000 7ffbf3895640 1 -- 172.21.15.92:0/24915446 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbec1a7270 con 0x7ffbec100e20 2024-09-19T08:55:28.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.321+0000 7ffbf3895640 1 -- 172.21.15.92:0/24915446 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbec101280 con 0x7ffbec100e20 2024-09-19T08:55:28.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.323+0000 7ffbe27fc640 1 -- 172.21.15.92:0/24915446 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ffbe8017070 con 0x7ffbec100e20 2024-09-19T08:55:28.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.323+0000 7ffbe27fc640 1 --2- 172.21.15.92:0/24915446 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffbd80a3350 0x7ffbd80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:28.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.324+0000 7ffbf0e30640 1 --2- 172.21.15.92:0/24915446 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffbd80a3350 0x7ffbd80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:28.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.324+0000 7ffbe27fc640 1 -- 172.21.15.92:0/24915446 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ffbe80cf150 con 0x7ffbec100e20 2024-09-19T08:55:28.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.324+0000 7ffbf0e30640 1 --2- 172.21.15.92:0/24915446 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffbd80a3350 0x7ffbd80a5810 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc006fd0 tx=0x7ffbdc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:28.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.327+0000 7ffbe27fc640 1 -- 172.21.15.92:0/24915446 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffbe809be20 con 0x7ffbec100e20 2024-09-19T08:55:28.502 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:28 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/4271869173' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T08:55:28.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:28 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:55:28.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.505+0000 7ffbf3895640 1 -- 172.21.15.92:0/24915446 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7ffbec0fe1b0 con 0x7ffbec100e20 2024-09-19T08:55:28.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.505+0000 7ffbe27fc640 1 -- 172.21.15.92:0/24915446 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7ffbec0fe1b0 con 0x7ffbec100e20 2024-09-19T08:55:28.505 INFO:teuthology.orchestra.run.smithi092.stdout:317827579929 2024-09-19T08:55:28.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.508+0000 7ffbf3895640 1 -- 172.21.15.92:0/24915446 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffbd80a3350 msgr2=0x7ffbd80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:28.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.508+0000 7ffbf3895640 1 --2- 172.21.15.92:0/24915446 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffbd80a3350 0x7ffbd80a5810 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc006fd0 tx=0x7ffbdc008040 comp rx=0 tx=0).stop 2024-09-19T08:55:28.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.508+0000 7ffbf3895640 1 -- 172.21.15.92:0/24915446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffbec100e20 msgr2=0x7ffbec0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:28.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.508+0000 7ffbf3895640 1 --2- 172.21.15.92:0/24915446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffbec100e20 0x7ffbec0fcc80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ffbe800b4a0 tx=0x7ffbe800b960 comp rx=0 tx=0).stop 2024-09-19T08:55:28.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.508+0000 7ffbf3895640 1 -- 172.21.15.92:0/24915446 shutdown_connections 2024-09-19T08:55:28.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.508+0000 7ffbf3895640 1 --2- 172.21.15.92:0/24915446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffbec102ef0 0x7ffbec0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.508+0000 7ffbf3895640 1 --2- 172.21.15.92:0/24915446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffbec102570 0x7ffbec0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.508+0000 7ffbf3895640 1 --2- 172.21.15.92:0/24915446 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffbd80a3350 0x7ffbd80a5810 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.508+0000 7ffbf3895640 1 --2- 172.21.15.92:0/24915446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffbec100e20 0x7ffbec0fcc80 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.508+0000 7ffbf3895640 1 -- 172.21.15.92:0/24915446 >> 172.21.15.92:0/24915446 conn(0x7ffbec0fc7d0 msgr2=0x7ffbec06a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:28.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.508+0000 7ffbf3895640 1 -- 172.21.15.92:0/24915446 shutdown_connections 2024-09-19T08:55:28.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:28.508+0000 7ffbf3895640 1 -- 172.21.15.92:0/24915446 wait complete. 2024-09-19T08:55:28.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:28 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/4271869173' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T08:55:28.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:28 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:55:28.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:28 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/4271869173' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T08:55:28.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:28 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:55:29.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.235+0000 7f01cf2ef640 1 -- 172.21.15.92:0/1499888655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01c8100e20 msgr2=0x7f01c8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:29.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.235+0000 7f01cf2ef640 1 --2- 172.21.15.92:0/1499888655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01c8100e20 0x7f01c8101200 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f01c4009900 tx=0x7f01c402a480 comp rx=0 tx=0).stop 2024-09-19T08:55:29.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.235+0000 7f01cf2ef640 1 -- 172.21.15.92:0/1499888655 shutdown_connections 2024-09-19T08:55:29.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.235+0000 7f01cf2ef640 1 --2- 172.21.15.92:0/1499888655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01c8102ef0 0x7f01c810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:29.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.235+0000 7f01cf2ef640 1 --2- 172.21.15.92:0/1499888655 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01c8102570 0x7f01c81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:29.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.235+0000 7f01cf2ef640 1 --2- 172.21.15.92:0/1499888655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01c8100e20 0x7f01c8101200 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:29.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.235+0000 7f01cf2ef640 1 -- 172.21.15.92:0/1499888655 >> 172.21.15.92:0/1499888655 conn(0x7f01c80fc7d0 msgr2=0x7f01c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:29.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.235+0000 7f01cf2ef640 1 -- 172.21.15.92:0/1499888655 shutdown_connections 2024-09-19T08:55:29.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.235+0000 7f01cf2ef640 1 -- 172.21.15.92:0/1499888655 wait complete. 2024-09-19T08:55:29.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.235+0000 7f01cf2ef640 1 Processor -- start 2024-09-19T08:55:29.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.235+0000 7f01cf2ef640 1 -- start start 2024-09-19T08:55:29.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.236+0000 7f01cf2ef640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01c8100e20 0x7f01c8198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:29.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.236+0000 7f01cf2ef640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01c8102570 0x7f01c8198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:29.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.236+0000 7f01cf2ef640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01c8102ef0 0x7f01c819ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:29.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.236+0000 7f01cf2ef640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f01c8110fa0 con 0x7f01c8100e20 2024-09-19T08:55:29.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.236+0000 7f01cf2ef640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f01c8110e20 con 0x7f01c8102ef0 2024-09-19T08:55:29.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.236+0000 7f01cf2ef640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f01c8111120 con 0x7f01c8102570 2024-09-19T08:55:29.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.236+0000 7f01cd08b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01c8100e20 0x7f01c8198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:29.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.236+0000 7f01cd08b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01c8100e20 0x7f01c8198570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52332/0 (socket says 172.21.15.92:52332) 2024-09-19T08:55:29.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.236+0000 7f01cd08b640 1 -- 172.21.15.92:0/4094691667 learned_addr learned my addr 172.21.15.92:0/4094691667 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:29.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.236+0000 7f01cc88a640 1 --2- 172.21.15.92:0/4094691667 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01c8102570 0x7f01c8198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:29.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.236+0000 7f01cd08b640 1 -- 172.21.15.92:0/4094691667 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01c8102570 msgr2=0x7f01c8198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:29.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.236+0000 7f01cd08b640 1 --2- 172.21.15.92:0/4094691667 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01c8102570 0x7f01c8198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:29.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.236+0000 7f01cd08b640 1 -- 172.21.15.92:0/4094691667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01c8102ef0 msgr2=0x7f01c819ce40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T08:55:29.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.236+0000 7f01cd08b640 1 --2- 172.21.15.92:0/4094691667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01c8102ef0 0x7f01c819ce40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:29.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.236+0000 7f01cd08b640 1 -- 172.21.15.92:0/4094691667 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c819d520 con 0x7f01c8100e20 2024-09-19T08:55:29.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.236+0000 7f01cd08b640 1 --2- 172.21.15.92:0/4094691667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01c8100e20 0x7f01c8198570 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f01c4006010 tx=0x7f01c4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:29.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.236+0000 7f01be7fc640 1 -- 172.21.15.92:0/4094691667 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c403f070 con 0x7f01c8100e20 2024-09-19T08:55:29.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.236+0000 7f01cf2ef640 1 -- 172.21.15.92:0/4094691667 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01c819d7b0 con 0x7f01c8100e20 2024-09-19T08:55:29.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.236+0000 7f01be7fc640 1 -- 172.21.15.92:0/4094691667 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01c4031c30 con 0x7f01c8100e20 2024-09-19T08:55:29.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.236+0000 7f01be7fc640 1 -- 172.21.15.92:0/4094691667 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c4035030 con 0x7f01c8100e20 2024-09-19T08:55:29.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.236+0000 7f01cf2ef640 1 -- 172.21.15.92:0/4094691667 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01c81a50f0 con 0x7f01c8100e20 2024-09-19T08:55:29.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.237+0000 7f01cf2ef640 1 -- 172.21.15.92:0/4094691667 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01c81021b0 con 0x7f01c8100e20 2024-09-19T08:55:29.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.238+0000 7f01be7fc640 1 -- 172.21.15.92:0/4094691667 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f01c4042070 con 0x7f01c8100e20 2024-09-19T08:55:29.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.239+0000 7f01be7fc640 1 --2- 172.21.15.92:0/4094691667 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f01b40a32d0 0x7f01b40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:29.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.239+0000 7f01cc88a640 1 --2- 172.21.15.92:0/4094691667 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f01b40a32d0 0x7f01b40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:29.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.239+0000 7f01be7fc640 1 -- 172.21.15.92:0/4094691667 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f01c40f06d0 con 0x7f01c8100e20 2024-09-19T08:55:29.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.239+0000 7f01cc88a640 1 --2- 172.21.15.92:0/4094691667 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f01b40a32d0 0x7f01b40a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f01c80fef00 tx=0x7f01b8009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:29.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.242+0000 7f01be7fc640 1 -- 172.21.15.92:0/4094691667 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f01c40bd290 con 0x7f01c8100e20 2024-09-19T08:55:29.271 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:29.271 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:29.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.446+0000 7f01cf2ef640 1 -- 172.21.15.92:0/4094691667 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f01c8101200 con 0x7f01c8100e20 2024-09-19T08:55:29.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.446+0000 7f01be7fc640 1 -- 172.21.15.92:0/4094691667 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f01c4031de0 con 0x7f01c8100e20 2024-09-19T08:55:29.447 INFO:teuthology.orchestra.run.smithi092.stdout:133143986234 2024-09-19T08:55:29.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.449+0000 7f01cf2ef640 1 -- 172.21.15.92:0/4094691667 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f01b40a32d0 msgr2=0x7f01b40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:29.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.449+0000 7f01cf2ef640 1 --2- 172.21.15.92:0/4094691667 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f01b40a32d0 0x7f01b40a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f01c80fef00 tx=0x7f01b8009110 comp rx=0 tx=0).stop 2024-09-19T08:55:29.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.449+0000 7f01cf2ef640 1 -- 172.21.15.92:0/4094691667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01c8100e20 msgr2=0x7f01c8198570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:29.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.449+0000 7f01cf2ef640 1 --2- 172.21.15.92:0/4094691667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01c8100e20 0x7f01c8198570 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f01c4006010 tx=0x7f01c4003c10 comp rx=0 tx=0).stop 2024-09-19T08:55:29.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.449+0000 7f01cf2ef640 1 -- 172.21.15.92:0/4094691667 shutdown_connections 2024-09-19T08:55:29.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.449+0000 7f01cf2ef640 1 --2- 172.21.15.92:0/4094691667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01c8102ef0 0x7f01c819ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:29.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.449+0000 7f01cf2ef640 1 --2- 172.21.15.92:0/4094691667 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01c8102570 0x7f01c8198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:29.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.449+0000 7f01cf2ef640 1 --2- 172.21.15.92:0/4094691667 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f01b40a32d0 0x7f01b40a5790 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:29.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.449+0000 7f01cf2ef640 1 --2- 172.21.15.92:0/4094691667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01c8100e20 0x7f01c8198570 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:29.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.449+0000 7f01cf2ef640 1 -- 172.21.15.92:0/4094691667 >> 172.21.15.92:0/4094691667 conn(0x7f01c80fc7d0 msgr2=0x7f01c8069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:29.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.449+0000 7f01cf2ef640 1 -- 172.21.15.92:0/4094691667 shutdown_connections 2024-09-19T08:55:29.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:29.449+0000 7f01cf2ef640 1 -- 172.21.15.92:0/4094691667 wait complete. 2024-09-19T08:55:29.658 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:29 smithi092 ceph-mon[31407]: pgmap v300: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:55:29.658 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:29 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/24915446' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T08:55:29.658 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:29 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:55:29.658 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:29 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:55:29.658 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:29 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:55:29.658 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:29 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:55:29.684 INFO:tasks.cephadm.ceph_manager.ceph:need seq 261993005088 got 261993005090 for osd.9 2024-09-19T08:55:29.685 DEBUG:teuthology.parallel:result is None 2024-09-19T08:55:29.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:29 smithi167 ceph-mon[35359]: pgmap v300: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:55:29.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:29 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/24915446' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T08:55:29.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:29 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:55:29.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:29 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:55:29.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:29 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:55:29.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:29 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:55:29.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:29 smithi190 ceph-mon[35358]: pgmap v300: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:55:29.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:29 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/24915446' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T08:55:29.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:29 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:55:29.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:29 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:55:29.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:29 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:55:29.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:29 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:55:30.584 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:30 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/4094691667' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T08:55:30.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.586+0000 7f0c26e79640 1 -- 172.21.15.92:0/2594348859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c20102570 msgr2=0x7f0c201029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:30.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.586+0000 7f0c26e79640 1 --2- 172.21.15.92:0/2594348859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c20102570 0x7f0c201029b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c009900 tx=0x7f0c0c02a480 comp rx=0 tx=0).stop 2024-09-19T08:55:30.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.586+0000 7f0c26e79640 1 -- 172.21.15.92:0/2594348859 shutdown_connections 2024-09-19T08:55:30.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.586+0000 7f0c26e79640 1 --2- 172.21.15.92:0/2594348859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c20102ef0 0x7f0c2010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:30.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.586+0000 7f0c26e79640 1 --2- 172.21.15.92:0/2594348859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c20102570 0x7f0c201029b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:30.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.586+0000 7f0c26e79640 1 --2- 172.21.15.92:0/2594348859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c20100e20 0x7f0c20101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:30.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.586+0000 7f0c26e79640 1 -- 172.21.15.92:0/2594348859 >> 172.21.15.92:0/2594348859 conn(0x7f0c200fc7d0 msgr2=0x7f0c200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:30.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.586+0000 7f0c26e79640 1 -- 172.21.15.92:0/2594348859 shutdown_connections 2024-09-19T08:55:30.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.586+0000 7f0c26e79640 1 -- 172.21.15.92:0/2594348859 wait complete. 2024-09-19T08:55:30.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.587+0000 7f0c26e79640 1 Processor -- start 2024-09-19T08:55:30.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.587+0000 7f0c26e79640 1 -- start start 2024-09-19T08:55:30.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.587+0000 7f0c26e79640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c20100e20 0x7f0c201985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:30.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.587+0000 7f0c26e79640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c20102570 0x7f0c20198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:30.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.587+0000 7f0c26e79640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c20102ef0 0x7f0c2019ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:30.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.587+0000 7f0c26e79640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0c20110f50 con 0x7f0c20102ef0 2024-09-19T08:55:30.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.587+0000 7f0c26e79640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0c20110dd0 con 0x7f0c20100e20 2024-09-19T08:55:30.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.587+0000 7f0c26e79640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0c201110d0 con 0x7f0c20102570 2024-09-19T08:55:30.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.587+0000 7f0c25416640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c20102ef0 0x7f0c2019ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:30.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.588+0000 7f0c25416640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c20102ef0 0x7f0c2019ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52362/0 (socket says 172.21.15.92:52362) 2024-09-19T08:55:30.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.588+0000 7f0c25416640 1 -- 172.21.15.92:0/337008896 learned_addr learned my addr 172.21.15.92:0/337008896 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:30.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.588+0000 7f0c1ffff640 1 --2- 172.21.15.92:0/337008896 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c20102570 0x7f0c20198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:30.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.588+0000 7f0c24c15640 1 --2- 172.21.15.92:0/337008896 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c20100e20 0x7f0c201985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:30.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.588+0000 7f0c25416640 1 -- 172.21.15.92:0/337008896 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c20102570 msgr2=0x7f0c20198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:30.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.588+0000 7f0c25416640 1 --2- 172.21.15.92:0/337008896 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c20102570 0x7f0c20198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:30.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.588+0000 7f0c25416640 1 -- 172.21.15.92:0/337008896 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c20100e20 msgr2=0x7f0c201985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:30.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.588+0000 7f0c25416640 1 --2- 172.21.15.92:0/337008896 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c20100e20 0x7f0c201985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:30.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.588+0000 7f0c25416640 1 -- 172.21.15.92:0/337008896 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c2019d550 con 0x7f0c20102ef0 2024-09-19T08:55:30.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.588+0000 7f0c25416640 1 --2- 172.21.15.92:0/337008896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c20102ef0 0x7f0c2019ce70 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0c1800efd0 tx=0x7f0c1800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:30.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.588+0000 7f0c1dffb640 1 -- 172.21.15.92:0/337008896 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c18003b70 con 0x7f0c20102ef0 2024-09-19T08:55:30.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.588+0000 7f0c26e79640 1 -- 172.21.15.92:0/337008896 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c2019d840 con 0x7f0c20102ef0 2024-09-19T08:55:30.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.588+0000 7f0c1dffb640 1 -- 172.21.15.92:0/337008896 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c18003d10 con 0x7f0c20102ef0 2024-09-19T08:55:30.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.589+0000 7f0c1dffb640 1 -- 172.21.15.92:0/337008896 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c180109f0 con 0x7f0c20102ef0 2024-09-19T08:55:30.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.589+0000 7f0c26e79640 1 -- 172.21.15.92:0/337008896 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c201a5120 con 0x7f0c20102ef0 2024-09-19T08:55:30.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.590+0000 7f0c26e79640 1 -- 172.21.15.92:0/337008896 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c20101200 con 0x7f0c20102ef0 2024-09-19T08:55:30.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.591+0000 7f0c1dffb640 1 -- 172.21.15.92:0/337008896 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f0c18004000 con 0x7f0c20102ef0 2024-09-19T08:55:30.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.591+0000 7f0c1dffb640 1 --2- 172.21.15.92:0/337008896 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f0c100a32d0 0x7f0c100a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:30.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.592+0000 7f0c1dffb640 1 -- 172.21.15.92:0/337008896 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f0c180cfe00 con 0x7f0c20102ef0 2024-09-19T08:55:30.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.592+0000 7f0c24c15640 1 --2- 172.21.15.92:0/337008896 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f0c100a32d0 0x7f0c100a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:30.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.592+0000 7f0c24c15640 1 --2- 172.21.15.92:0/337008896 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f0c100a32d0 0x7f0c100a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0c14009bd0 tx=0x7f0c14005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:30.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.596+0000 7f0c1dffb640 1 -- 172.21.15.92:0/337008896 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0c1809c9c0 con 0x7f0c20102ef0 2024-09-19T08:55:30.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.493+0000 7fdcb01c0640 1 -- 172.21.15.92:0/4170572244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdca8102d30 msgr2=0x7fdca8103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:30.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.493+0000 7fdcb01c0640 1 --2- 172.21.15.92:0/4170572244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdca8102d30 0x7fdca8103110 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdca4009930 tx=0x7fdca402a440 comp rx=0 tx=0).stop 2024-09-19T08:55:30.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.493+0000 7fdcb01c0640 1 -- 172.21.15.92:0/4170572244 shutdown_connections 2024-09-19T08:55:30.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.493+0000 7fdcb01c0640 1 --2- 172.21.15.92:0/4170572244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdca81082a0 0x7fdca810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:30.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.493+0000 7fdcb01c0640 1 --2- 172.21.15.92:0/4170572244 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdca81036e0 0x7fdca8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:30.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.493+0000 7fdcb01c0640 1 --2- 172.21.15.92:0/4170572244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdca8102d30 0x7fdca8103110 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:30.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.493+0000 7fdcb01c0640 1 -- 172.21.15.92:0/4170572244 >> 172.21.15.92:0/4170572244 conn(0x7fdca80fc7d0 msgr2=0x7fdca80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:30.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.493+0000 7fdcb01c0640 1 -- 172.21.15.92:0/4170572244 shutdown_connections 2024-09-19T08:55:30.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.493+0000 7fdcb01c0640 1 -- 172.21.15.92:0/4170572244 wait complete. 2024-09-19T08:55:30.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.494+0000 7fdcb01c0640 1 Processor -- start 2024-09-19T08:55:30.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.494+0000 7fdcb01c0640 1 -- start start 2024-09-19T08:55:30.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.494+0000 7fdcb01c0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdca8102d30 0x7fdca81985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:30.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.494+0000 7fdcb01c0640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdca81036e0 0x7fdca8198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:30.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.494+0000 7fdcb01c0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdca81082a0 0x7fdca819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:30.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.494+0000 7fdcb01c0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdca81120e0 con 0x7fdca81082a0 2024-09-19T08:55:30.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.494+0000 7fdcb01c0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdca8111f60 con 0x7fdca8102d30 2024-09-19T08:55:30.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.494+0000 7fdcb01c0640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fdca8112260 con 0x7fdca81036e0 2024-09-19T08:55:30.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.494+0000 7fdcae75d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdca81082a0 0x7fdca819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:30.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.494+0000 7fdcae75d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdca81082a0 0x7fdca819ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52354/0 (socket says 172.21.15.92:52354) 2024-09-19T08:55:30.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.494+0000 7fdcae75d640 1 -- 172.21.15.92:0/258643276 learned_addr learned my addr 172.21.15.92:0/258643276 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:30.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.494+0000 7fdcad75b640 1 --2- 172.21.15.92:0/258643276 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdca81036e0 0x7fdca8198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:30.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.494+0000 7fdcadf5c640 1 --2- 172.21.15.92:0/258643276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdca8102d30 0x7fdca81985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:30.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.494+0000 7fdcae75d640 1 -- 172.21.15.92:0/258643276 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdca81036e0 msgr2=0x7fdca8198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:30.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.494+0000 7fdcae75d640 1 --2- 172.21.15.92:0/258643276 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdca81036e0 0x7fdca8198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:30.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.494+0000 7fdcae75d640 1 -- 172.21.15.92:0/258643276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdca8102d30 msgr2=0x7fdca81985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:30.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.494+0000 7fdcae75d640 1 --2- 172.21.15.92:0/258643276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdca8102d30 0x7fdca81985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:30.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.494+0000 7fdcae75d640 1 -- 172.21.15.92:0/258643276 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdca819d550 con 0x7fdca81082a0 2024-09-19T08:55:30.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.494+0000 7fdcad75b640 1 --2- 172.21.15.92:0/258643276 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdca81036e0 0x7fdca8198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:55:30.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.494+0000 7fdcadf5c640 1 --2- 172.21.15.92:0/258643276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdca8102d30 0x7fdca81985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:55:30.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.494+0000 7fdcae75d640 1 --2- 172.21.15.92:0/258643276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdca81082a0 0x7fdca819ce70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdca000cce0 tx=0x7fdca000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:30.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.495+0000 7fdc9effd640 1 -- 172.21.15.92:0/258643276 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca000f450 con 0x7fdca81082a0 2024-09-19T08:55:30.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.495+0000 7fdcb01c0640 1 -- 172.21.15.92:0/258643276 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdca819d840 con 0x7fdca81082a0 2024-09-19T08:55:30.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.495+0000 7fdc9effd640 1 -- 172.21.15.92:0/258643276 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdca000fad0 con 0x7fdca81082a0 2024-09-19T08:55:30.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.495+0000 7fdc9effd640 1 -- 172.21.15.92:0/258643276 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca0018c10 con 0x7fdca81082a0 2024-09-19T08:55:30.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.495+0000 7fdcb01c0640 1 -- 172.21.15.92:0/258643276 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdca81a5120 con 0x7fdca81082a0 2024-09-19T08:55:30.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.496+0000 7fdcb01c0640 1 -- 172.21.15.92:0/258643276 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdca806a850 con 0x7fdca81082a0 2024-09-19T08:55:30.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.497+0000 7fdc9effd640 1 -- 172.21.15.92:0/258643276 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fdca000f5f0 con 0x7fdca81082a0 2024-09-19T08:55:30.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.498+0000 7fdc9effd640 1 --2- 172.21.15.92:0/258643276 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdc940a32d0 0x7fdc940a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:30.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.498+0000 7fdcadf5c640 1 --2- 172.21.15.92:0/258643276 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdc940a32d0 0x7fdc940a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:30.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.498+0000 7fdc9effd640 1 -- 172.21.15.92:0/258643276 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fdca00d0230 con 0x7fdca81082a0 2024-09-19T08:55:30.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.498+0000 7fdcadf5c640 1 --2- 172.21.15.92:0/258643276 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdc940a32d0 0x7fdc940a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdca40096c0 tx=0x7fdca4032d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:30.697 INFO:teuthology.orchestra.run.smithi092.stdout:154618822710 2024-09-19T08:55:30.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.503+0000 7fdc9effd640 1 -- 172.21.15.92:0/258643276 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdca0014030 con 0x7fdca81082a0 2024-09-19T08:55:30.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.687+0000 7fdcb01c0640 1 -- 172.21.15.92:0/258643276 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fdca810a2b0 con 0x7fdca81082a0 2024-09-19T08:55:30.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.687+0000 7fdc9effd640 1 -- 172.21.15.92:0/258643276 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fdca009cdf0 con 0x7fdca81082a0 2024-09-19T08:55:30.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.689+0000 7fdcb01c0640 1 -- 172.21.15.92:0/258643276 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdc940a32d0 msgr2=0x7fdc940a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:30.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.689+0000 7fdcb01c0640 1 --2- 172.21.15.92:0/258643276 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdc940a32d0 0x7fdc940a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdca40096c0 tx=0x7fdca4032d50 comp rx=0 tx=0).stop 2024-09-19T08:55:30.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.689+0000 7fdcb01c0640 1 -- 172.21.15.92:0/258643276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdca81082a0 msgr2=0x7fdca819ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:30.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.689+0000 7fdcb01c0640 1 --2- 172.21.15.92:0/258643276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdca81082a0 0x7fdca819ce70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdca000cce0 tx=0x7fdca000a620 comp rx=0 tx=0).stop 2024-09-19T08:55:30.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.689+0000 7fdcb01c0640 1 -- 172.21.15.92:0/258643276 shutdown_connections 2024-09-19T08:55:30.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.689+0000 7fdcb01c0640 1 --2- 172.21.15.92:0/258643276 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdc940a32d0 0x7fdc940a5790 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:30.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.689+0000 7fdcb01c0640 1 --2- 172.21.15.92:0/258643276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdca81082a0 0x7fdca819ce70 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:30.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.689+0000 7fdcb01c0640 1 --2- 172.21.15.92:0/258643276 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdca81036e0 0x7fdca8198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:30.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.689+0000 7fdcb01c0640 1 --2- 172.21.15.92:0/258643276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdca8102d30 0x7fdca81985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:30.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.689+0000 7fdcb01c0640 1 -- 172.21.15.92:0/258643276 >> 172.21.15.92:0/258643276 conn(0x7fdca80fc7d0 msgr2=0x7fdca8105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:30.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.689+0000 7fdcb01c0640 1 -- 172.21.15.92:0/258643276 shutdown_connections 2024-09-19T08:55:30.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.689+0000 7fdcb01c0640 1 -- 172.21.15.92:0/258643276 wait complete. 2024-09-19T08:55:30.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.785+0000 7f0c26e79640 1 -- 172.21.15.92:0/337008896 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f0c2010a0a0 con 0x7f0c20102ef0 2024-09-19T08:55:30.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.785+0000 7f0c1dffb640 1 -- 172.21.15.92:0/337008896 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f0c1809c2c0 con 0x7f0c20102ef0 2024-09-19T08:55:30.785 INFO:teuthology.orchestra.run.smithi092.stdout:231928234023 2024-09-19T08:55:30.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.787+0000 7f0c26e79640 1 -- 172.21.15.92:0/337008896 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f0c100a32d0 msgr2=0x7f0c100a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:30.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.787+0000 7f0c26e79640 1 --2- 172.21.15.92:0/337008896 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f0c100a32d0 0x7f0c100a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0c14009bd0 tx=0x7f0c14005f90 comp rx=0 tx=0).stop 2024-09-19T08:55:30.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.787+0000 7f0c26e79640 1 -- 172.21.15.92:0/337008896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c20102ef0 msgr2=0x7f0c2019ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:30.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.787+0000 7f0c26e79640 1 --2- 172.21.15.92:0/337008896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c20102ef0 0x7f0c2019ce70 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0c1800efd0 tx=0x7f0c1800c6a0 comp rx=0 tx=0).stop 2024-09-19T08:55:30.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.787+0000 7f0c26e79640 1 -- 172.21.15.92:0/337008896 shutdown_connections 2024-09-19T08:55:30.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.787+0000 7f0c26e79640 1 --2- 172.21.15.92:0/337008896 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f0c100a32d0 0x7f0c100a5790 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:30.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.787+0000 7f0c26e79640 1 --2- 172.21.15.92:0/337008896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c20102ef0 0x7f0c2019ce70 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:30.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.787+0000 7f0c26e79640 1 --2- 172.21.15.92:0/337008896 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c20102570 0x7f0c20198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:30.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.787+0000 7f0c26e79640 1 --2- 172.21.15.92:0/337008896 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c20100e20 0x7f0c201985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:30.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.787+0000 7f0c26e79640 1 -- 172.21.15.92:0/337008896 >> 172.21.15.92:0/337008896 conn(0x7f0c200fc7d0 msgr2=0x7f0c2006a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:30.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.787+0000 7f0c26e79640 1 -- 172.21.15.92:0/337008896 shutdown_connections 2024-09-19T08:55:30.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.787+0000 7f0c26e79640 1 -- 172.21.15.92:0/337008896 wait complete. 2024-09-19T08:55:30.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:30 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/4094691667' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T08:55:30.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:30 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/4094691667' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T08:55:31.395 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986232 got 133143986234 for osd.4 2024-09-19T08:55:31.395 DEBUG:teuthology.parallel:result is None 2024-09-19T08:55:31.616 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:31 smithi092 ceph-mon[31407]: pgmap v301: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:55:31.616 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:31 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/258643276' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T08:55:31.616 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:31 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/337008896' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T08:55:31.616 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:31 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1449383629' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T08:55:31.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.879+0000 7f16a22d7640 1 -- 172.21.15.92:0/2692062822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f169c102ef0 msgr2=0x7f169c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:31.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.879+0000 7f16a22d7640 1 --2- 172.21.15.92:0/2692062822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f169c102ef0 0x7f169c10da40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1694009ca0 tx=0x7f169402a950 comp rx=0 tx=0).stop 2024-09-19T08:55:31.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.879+0000 7f16a22d7640 1 -- 172.21.15.92:0/2692062822 shutdown_connections 2024-09-19T08:55:31.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.879+0000 7f16a22d7640 1 --2- 172.21.15.92:0/2692062822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f169c102ef0 0x7f169c10da40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:31.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.879+0000 7f16a22d7640 1 --2- 172.21.15.92:0/2692062822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f169c102570 0x7f169c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:31.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.879+0000 7f16a22d7640 1 --2- 172.21.15.92:0/2692062822 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f169c100e20 0x7f169c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:31.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.879+0000 7f16a22d7640 1 -- 172.21.15.92:0/2692062822 >> 172.21.15.92:0/2692062822 conn(0x7f169c0fc7d0 msgr2=0x7f169c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:31.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.879+0000 7f16a22d7640 1 -- 172.21.15.92:0/2692062822 shutdown_connections 2024-09-19T08:55:31.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.879+0000 7f16a22d7640 1 -- 172.21.15.92:0/2692062822 wait complete. 2024-09-19T08:55:31.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.880+0000 7f16a22d7640 1 Processor -- start 2024-09-19T08:55:31.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.880+0000 7f16a22d7640 1 -- start start 2024-09-19T08:55:31.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.881+0000 7f16a22d7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f169c100e20 0x7f169c198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:31.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.881+0000 7f16a22d7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f169c102570 0x7f169c198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:31.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.881+0000 7f16a22d7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f169c102ef0 0x7f169c19ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:31.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.881+0000 7f169bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f169c100e20 0x7f169c198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:31.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.881+0000 7f16a22d7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f169c112080 con 0x7f169c100e20 2024-09-19T08:55:31.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.881+0000 7f16a22d7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f169c111f00 con 0x7f169c102ef0 2024-09-19T08:55:31.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.881+0000 7f16a22d7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f169c112200 con 0x7f169c102570 2024-09-19T08:55:31.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.881+0000 7f169bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f169c100e20 0x7f169c198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52392/0 (socket says 172.21.15.92:52392) 2024-09-19T08:55:31.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.881+0000 7f169bfff640 1 -- 172.21.15.92:0/1449383629 learned_addr learned my addr 172.21.15.92:0/1449383629 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:31.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.881+0000 7f169b7fe640 1 --2- 172.21.15.92:0/1449383629 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f169c102570 0x7f169c198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:31.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.881+0000 7f169bfff640 1 -- 172.21.15.92:0/1449383629 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f169c102570 msgr2=0x7f169c198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:31.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.881+0000 7f16a0874640 1 --2- 172.21.15.92:0/1449383629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f169c102ef0 0x7f169c19ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:31.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.881+0000 7f169bfff640 1 --2- 172.21.15.92:0/1449383629 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f169c102570 0x7f169c198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:31.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.881+0000 7f169bfff640 1 -- 172.21.15.92:0/1449383629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f169c102ef0 msgr2=0x7f169c19ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:31.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.881+0000 7f169bfff640 1 --2- 172.21.15.92:0/1449383629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f169c102ef0 0x7f169c19ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:31.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.881+0000 7f169bfff640 1 -- 172.21.15.92:0/1449383629 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f169c19d4f0 con 0x7f169c100e20 2024-09-19T08:55:31.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.881+0000 7f169bfff640 1 --2- 172.21.15.92:0/1449383629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f169c100e20 0x7f169c198540 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f168c00c890 tx=0x7f168c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:31.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.882+0000 7f16997fa640 1 -- 172.21.15.92:0/1449383629 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168c004220 con 0x7f169c100e20 2024-09-19T08:55:31.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.882+0000 7f16997fa640 1 -- 172.21.15.92:0/1449383629 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f168c0043c0 con 0x7f169c100e20 2024-09-19T08:55:31.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.882+0000 7f16997fa640 1 -- 172.21.15.92:0/1449383629 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168c0049e0 con 0x7f169c100e20 2024-09-19T08:55:31.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.882+0000 7f16a22d7640 1 -- 172.21.15.92:0/1449383629 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f169c19d7e0 con 0x7f169c100e20 2024-09-19T08:55:31.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.882+0000 7f16a22d7640 1 -- 172.21.15.92:0/1449383629 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f169c1a50c0 con 0x7f169c100e20 2024-09-19T08:55:31.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.883+0000 7f16a22d7640 1 -- 172.21.15.92:0/1449383629 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f169c101200 con 0x7f169c100e20 2024-09-19T08:55:31.620 INFO:teuthology.orchestra.run.smithi092.stdout:201863462956 2024-09-19T08:55:31.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.884+0000 7f16997fa640 1 -- 172.21.15.92:0/1449383629 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f168c0079b0 con 0x7f169c100e20 2024-09-19T08:55:31.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.884+0000 7f16997fa640 1 --2- 172.21.15.92:0/1449383629 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f16840a32d0 0x7f16840a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:31.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.885+0000 7f16997fa640 1 -- 172.21.15.92:0/1449383629 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f168c0cfd00 con 0x7f169c100e20 2024-09-19T08:55:31.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.885+0000 7f169b7fe640 1 --2- 172.21.15.92:0/1449383629 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f16840a32d0 0x7f16840a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:31.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.885+0000 7f169b7fe640 1 --2- 172.21.15.92:0/1449383629 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f16840a32d0 0x7f16840a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f169c0fece0 tx=0x7f169000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:31.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:30.888+0000 7f16997fa640 1 -- 172.21.15.92:0/1449383629 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f168c014030 con 0x7f169c100e20 2024-09-19T08:55:31.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.063+0000 7f16a22d7640 1 -- 172.21.15.92:0/1449383629 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f169c1998a0 con 0x7f169c100e20 2024-09-19T08:55:31.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.063+0000 7f16997fa640 1 -- 172.21.15.92:0/1449383629 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f168c09c880 con 0x7f169c100e20 2024-09-19T08:55:31.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.065+0000 7f16a22d7640 1 -- 172.21.15.92:0/1449383629 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f16840a32d0 msgr2=0x7f16840a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:31.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.065+0000 7f16a22d7640 1 --2- 172.21.15.92:0/1449383629 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f16840a32d0 0x7f16840a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f169c0fece0 tx=0x7f169000a2d0 comp rx=0 tx=0).stop 2024-09-19T08:55:31.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.065+0000 7f16a22d7640 1 -- 172.21.15.92:0/1449383629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f169c100e20 msgr2=0x7f169c198540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:31.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.065+0000 7f16a22d7640 1 --2- 172.21.15.92:0/1449383629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f169c100e20 0x7f169c198540 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f168c00c890 tx=0x7f168c00cd50 comp rx=0 tx=0).stop 2024-09-19T08:55:31.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.065+0000 7f16a22d7640 1 -- 172.21.15.92:0/1449383629 shutdown_connections 2024-09-19T08:55:31.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.065+0000 7f16a22d7640 1 --2- 172.21.15.92:0/1449383629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f169c102ef0 0x7f169c19ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:31.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.065+0000 7f16a22d7640 1 --2- 172.21.15.92:0/1449383629 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f169c102570 0x7f169c198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:31.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.065+0000 7f16a22d7640 1 --2- 172.21.15.92:0/1449383629 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f16840a32d0 0x7f16840a5790 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:31.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.065+0000 7f16a22d7640 1 --2- 172.21.15.92:0/1449383629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f169c100e20 0x7f169c198540 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:31.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.065+0000 7f16a22d7640 1 -- 172.21.15.92:0/1449383629 >> 172.21.15.92:0/1449383629 conn(0x7f169c0fc7d0 msgr2=0x7f169c1068d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:31.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.065+0000 7f16a22d7640 1 -- 172.21.15.92:0/1449383629 shutdown_connections 2024-09-19T08:55:31.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.065+0000 7f16a22d7640 1 -- 172.21.15.92:0/1449383629 wait complete. 2024-09-19T08:55:31.753 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:31 smithi167 ceph-mon[35359]: pgmap v301: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:55:31.753 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:31 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/258643276' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T08:55:31.753 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:31 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/337008896' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T08:55:31.753 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:31 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/1449383629' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T08:55:31.774 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:31 smithi190 ceph-mon[35358]: pgmap v301: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:55:31.775 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:31 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/258643276' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T08:55:31.775 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:31 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/337008896' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T08:55:31.775 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:31 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/1449383629' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T08:55:31.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.957+0000 7f5cfc67c640 1 -- 172.21.15.92:0/3850907659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5cf4101420 msgr2=0x7f5cf410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:31.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.957+0000 7f5cfc67c640 1 --2- 172.21.15.92:0/3850907659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5cf4101420 0x7f5cf410d950 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5cec009cd0 tx=0x7f5cec02a8e0 comp rx=0 tx=0).stop 2024-09-19T08:55:31.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.957+0000 7f5cfc67c640 1 -- 172.21.15.92:0/3850907659 shutdown_connections 2024-09-19T08:55:31.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.957+0000 7f5cfc67c640 1 --2- 172.21.15.92:0/3850907659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5cf4101420 0x7f5cf410d950 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:31.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.957+0000 7f5cfc67c640 1 --2- 172.21.15.92:0/3850907659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5cf4100a80 0x7f5cf4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:31.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.957+0000 7f5cfc67c640 1 --2- 172.21.15.92:0/3850907659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5cf4106a80 0x7f5cf4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:31.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.957+0000 7f5cfc67c640 1 -- 172.21.15.92:0/3850907659 >> 172.21.15.92:0/3850907659 conn(0x7f5cf40fc7a0 msgr2=0x7f5cf40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:31.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.957+0000 7f5cfc67c640 1 -- 172.21.15.92:0/3850907659 shutdown_connections 2024-09-19T08:55:31.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.957+0000 7f5cfc67c640 1 -- 172.21.15.92:0/3850907659 wait complete. 2024-09-19T08:55:31.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.957+0000 7f5cfc67c640 1 Processor -- start 2024-09-19T08:55:31.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.957+0000 7f5cfc67c640 1 -- start start 2024-09-19T08:55:31.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.958+0000 7f5cfc67c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5cf4100a80 0x7f5cf4198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:31.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.958+0000 7f5cfc67c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5cf4101420 0x7f5cf4198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:31.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.958+0000 7f5cfc67c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5cf4106a80 0x7f5cf419cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:31.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.958+0000 7f5cfc67c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf4110f20 con 0x7f5cf4106a80 2024-09-19T08:55:31.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.958+0000 7f5cfc67c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf4110da0 con 0x7f5cf4100a80 2024-09-19T08:55:31.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.958+0000 7f5cfc67c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf41110a0 con 0x7f5cf4101420 2024-09-19T08:55:31.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.958+0000 7f5cfac19640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5cf4106a80 0x7f5cf419cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:31.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.958+0000 7f5cfac19640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5cf4106a80 0x7f5cf419cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56028/0 (socket says 172.21.15.92:56028) 2024-09-19T08:55:31.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.958+0000 7f5cfac19640 1 -- 172.21.15.92:0/2957457721 learned_addr learned my addr 172.21.15.92:0/2957457721 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:31.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.958+0000 7f5cfa418640 1 --2- 172.21.15.92:0/2957457721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5cf4100a80 0x7f5cf4198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:31.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.958+0000 7f5cf9c17640 1 --2- 172.21.15.92:0/2957457721 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5cf4101420 0x7f5cf4198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:31.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.958+0000 7f5cfac19640 1 -- 172.21.15.92:0/2957457721 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5cf4101420 msgr2=0x7f5cf4198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:31.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.958+0000 7f5cfac19640 1 --2- 172.21.15.92:0/2957457721 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5cf4101420 0x7f5cf4198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:31.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.958+0000 7f5cfac19640 1 -- 172.21.15.92:0/2957457721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5cf4100a80 msgr2=0x7f5cf4198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:31.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.958+0000 7f5cfac19640 1 --2- 172.21.15.92:0/2957457721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5cf4100a80 0x7f5cf4198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:31.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.958+0000 7f5cfac19640 1 -- 172.21.15.92:0/2957457721 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf419d4b0 con 0x7f5cf4106a80 2024-09-19T08:55:31.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.958+0000 7f5cfa418640 1 --2- 172.21.15.92:0/2957457721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5cf4100a80 0x7f5cf4198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:55:31.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.958+0000 7f5cfac19640 1 --2- 172.21.15.92:0/2957457721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5cf4106a80 0x7f5cf419cdd0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5cec006010 tx=0x7f5cec003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:31.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.958+0000 7f5ce77fe640 1 -- 172.21.15.92:0/2957457721 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cec004450 con 0x7f5cf4106a80 2024-09-19T08:55:31.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.958+0000 7f5cfc67c640 1 -- 172.21.15.92:0/2957457721 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cf419d740 con 0x7f5cf4106a80 2024-09-19T08:55:31.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.958+0000 7f5ce77fe640 1 -- 172.21.15.92:0/2957457721 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5cec003e10 con 0x7f5cf4106a80 2024-09-19T08:55:31.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.958+0000 7f5ce77fe640 1 -- 172.21.15.92:0/2957457721 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cec0466e0 con 0x7f5cf4106a80 2024-09-19T08:55:31.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.959+0000 7f5cfc67c640 1 -- 172.21.15.92:0/2957457721 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cf41a5080 con 0x7f5cf4106a80 2024-09-19T08:55:31.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.959+0000 7f5cfc67c640 1 -- 172.21.15.92:0/2957457721 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cf4100f60 con 0x7f5cf4106a80 2024-09-19T08:55:31.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.961+0000 7f5ce77fe640 1 -- 172.21.15.92:0/2957457721 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5cec0305a0 con 0x7f5cf4106a80 2024-09-19T08:55:31.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.961+0000 7f5ce77fe640 1 --2- 172.21.15.92:0/2957457721 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5ce00a32d0 0x7f5ce00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:31.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.961+0000 7f5cfa418640 1 --2- 172.21.15.92:0/2957457721 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5ce00a32d0 0x7f5ce00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:31.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.961+0000 7f5ce77fe640 1 -- 172.21.15.92:0/2957457721 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f5cec02e030 con 0x7f5cf4106a80 2024-09-19T08:55:31.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.962+0000 7f5cfa418640 1 --2- 172.21.15.92:0/2957457721 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5ce00a32d0 0x7f5ce00a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8009930 tx=0x7f5ce8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:31.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:31.965+0000 7f5ce77fe640 1 -- 172.21.15.92:0/2957457721 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5cec04b060 con 0x7f5cf4106a80 2024-09-19T08:55:32.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:32.136+0000 7f5cfc67c640 1 -- 172.21.15.92:0/2957457721 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f5cf410a080 con 0x7f5cf4106a80 2024-09-19T08:55:32.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:32.136+0000 7f5ce77fe640 1 -- 172.21.15.92:0/2957457721 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f5cec039380 con 0x7f5cf4106a80 2024-09-19T08:55:32.136 INFO:teuthology.orchestra.run.smithi092.stdout:103079215167 2024-09-19T08:55:32.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:32.138+0000 7f5cfc67c640 1 -- 172.21.15.92:0/2957457721 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5ce00a32d0 msgr2=0x7f5ce00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:32.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:32.138+0000 7f5cfc67c640 1 --2- 172.21.15.92:0/2957457721 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5ce00a32d0 0x7f5ce00a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8009930 tx=0x7f5ce8008040 comp rx=0 tx=0).stop 2024-09-19T08:55:32.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:32.138+0000 7f5cfc67c640 1 -- 172.21.15.92:0/2957457721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5cf4106a80 msgr2=0x7f5cf419cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:32.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:32.138+0000 7f5cfc67c640 1 --2- 172.21.15.92:0/2957457721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5cf4106a80 0x7f5cf419cdd0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5cec006010 tx=0x7f5cec003c20 comp rx=0 tx=0).stop 2024-09-19T08:55:32.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:32.138+0000 7f5cfc67c640 1 -- 172.21.15.92:0/2957457721 shutdown_connections 2024-09-19T08:55:32.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:32.138+0000 7f5cfc67c640 1 --2- 172.21.15.92:0/2957457721 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5ce00a32d0 0x7f5ce00a5790 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:32.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:32.138+0000 7f5cfc67c640 1 --2- 172.21.15.92:0/2957457721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5cf4106a80 0x7f5cf419cdd0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:32.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:32.138+0000 7f5cfc67c640 1 --2- 172.21.15.92:0/2957457721 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5cf4101420 0x7f5cf4198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:32.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:32.138+0000 7f5cfc67c640 1 --2- 172.21.15.92:0/2957457721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5cf4100a80 0x7f5cf4198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:32.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:32.139+0000 7f5cfc67c640 1 -- 172.21.15.92:0/2957457721 >> 172.21.15.92:0/2957457721 conn(0x7f5cf40fc7a0 msgr2=0x7f5cf406aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:32.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:32.139+0000 7f5cfc67c640 1 -- 172.21.15.92:0/2957457721 shutdown_connections 2024-09-19T08:55:32.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:32.139+0000 7f5cfc67c640 1 -- 172.21.15.92:0/2957457721 wait complete. 2024-09-19T08:55:32.552 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462955 got 201863462956 for osd.7 2024-09-19T08:55:32.552 DEBUG:teuthology.parallel:result is None 2024-09-19T08:55:32.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:32 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/2957457721' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T08:55:32.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:32 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/2957457721' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T08:55:32.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:32 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/2957457721' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T08:55:32.926 INFO:tasks.cephadm.ceph_manager.ceph:need seq 317827579926 got 317827579929 for osd.11 2024-09-19T08:55:32.927 DEBUG:teuthology.parallel:result is None 2024-09-19T08:55:33.464 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593776 got 184683593776 for osd.6 2024-09-19T08:55:33.465 DEBUG:teuthology.parallel:result is None 2024-09-19T08:55:33.555 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:33 smithi092 ceph-mon[31407]: pgmap v302: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s rd, 1 op/s 2024-09-19T08:55:33.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.636+0000 7f3e0d32b640 1 -- 172.21.15.92:0/151483033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e081036e0 msgr2=0x7f3e08107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:33.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.636+0000 7f3e0d32b640 1 --2- 172.21.15.92:0/151483033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e081036e0 0x7f3e08107b90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3df0009930 tx=0x7f3df002a420 comp rx=0 tx=0).stop 2024-09-19T08:55:33.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.636+0000 7f3e0d32b640 1 -- 172.21.15.92:0/151483033 shutdown_connections 2024-09-19T08:55:33.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.636+0000 7f3e0d32b640 1 --2- 172.21.15.92:0/151483033 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e081082a0 0x7f3e0810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:33.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.636+0000 7f3e0d32b640 1 --2- 172.21.15.92:0/151483033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e081036e0 0x7f3e08107b90 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:33.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.636+0000 7f3e0d32b640 1 --2- 172.21.15.92:0/151483033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e08102d30 0x7f3e08103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:33.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.636+0000 7f3e0d32b640 1 -- 172.21.15.92:0/151483033 >> 172.21.15.92:0/151483033 conn(0x7f3e080fc7d0 msgr2=0x7f3e080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:33.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.636+0000 7f3e0d32b640 1 -- 172.21.15.92:0/151483033 shutdown_connections 2024-09-19T08:55:33.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.636+0000 7f3e0d32b640 1 -- 172.21.15.92:0/151483033 wait complete. 2024-09-19T08:55:33.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.637+0000 7f3e0d32b640 1 Processor -- start 2024-09-19T08:55:33.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.637+0000 7f3e0d32b640 1 -- start start 2024-09-19T08:55:33.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.637+0000 7f3e0d32b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e08102d30 0x7f3e08198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:33.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.637+0000 7f3e0d32b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e081036e0 0x7f3e08198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:33.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.637+0000 7f3e0d32b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e081082a0 0x7f3e0819cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:33.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.637+0000 7f3e0d32b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3e081120a0 con 0x7f3e081036e0 2024-09-19T08:55:33.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.637+0000 7f3e0d32b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3e08111f20 con 0x7f3e081082a0 2024-09-19T08:55:33.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.637+0000 7f3e0d32b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3e08112220 con 0x7f3e08102d30 2024-09-19T08:55:33.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.637+0000 7f3e067fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e081036e0 0x7f3e08198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:33.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.637+0000 7f3e067fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e081036e0 0x7f3e08198b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56054/0 (socket says 172.21.15.92:56054) 2024-09-19T08:55:33.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.637+0000 7f3e067fc640 1 -- 172.21.15.92:0/2580073895 learned_addr learned my addr 172.21.15.92:0/2580073895 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:33.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.638+0000 7f3e067fc640 1 -- 172.21.15.92:0/2580073895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e08102d30 msgr2=0x7f3e08198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:33.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.638+0000 7f3e067fc640 1 --2- 172.21.15.92:0/2580073895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e08102d30 0x7f3e08198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:33.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.638+0000 7f3e067fc640 1 -- 172.21.15.92:0/2580073895 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e081082a0 msgr2=0x7f3e0819cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:33.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.638+0000 7f3e067fc640 1 --2- 172.21.15.92:0/2580073895 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e081082a0 0x7f3e0819cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:33.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.638+0000 7f3e067fc640 1 -- 172.21.15.92:0/2580073895 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e0819d5f0 con 0x7f3e081036e0 2024-09-19T08:55:33.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.638+0000 7f3e067fc640 1 --2- 172.21.15.92:0/2580073895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e081036e0 0x7f3e08198b80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3df0005940 tx=0x7f3df00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:33.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.638+0000 7f3dfffff640 1 -- 172.21.15.92:0/2580073895 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df003f030 con 0x7f3e081036e0 2024-09-19T08:55:33.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.638+0000 7f3dfffff640 1 -- 172.21.15.92:0/2580073895 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3df0003ce0 con 0x7f3e081036e0 2024-09-19T08:55:33.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.638+0000 7f3dfffff640 1 -- 172.21.15.92:0/2580073895 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df0035070 con 0x7f3e081036e0 2024-09-19T08:55:33.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.638+0000 7f3e0d32b640 1 -- 172.21.15.92:0/2580073895 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e0819d880 con 0x7f3e081036e0 2024-09-19T08:55:33.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.638+0000 7f3e0d32b640 1 -- 172.21.15.92:0/2580073895 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e081a51c0 con 0x7f3e081036e0 2024-09-19T08:55:33.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.639+0000 7f3e0d32b640 1 -- 172.21.15.92:0/2580073895 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e08103110 con 0x7f3e081036e0 2024-09-19T08:55:33.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.640+0000 7f3dfffff640 1 -- 172.21.15.92:0/2580073895 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3df0042030 con 0x7f3e081036e0 2024-09-19T08:55:33.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.641+0000 7f3dfffff640 1 --2- 172.21.15.92:0/2580073895 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3df40a3350 0x7f3df40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:33.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.641+0000 7f3e06ffd640 1 --2- 172.21.15.92:0/2580073895 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3df40a3350 0x7f3df40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:33.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.641+0000 7f3dfffff640 1 -- 172.21.15.92:0/2580073895 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3df00eff50 con 0x7f3e081036e0 2024-09-19T08:55:33.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.641+0000 7f3e06ffd640 1 --2- 172.21.15.92:0/2580073895 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3df40a3350 0x7f3df40a5810 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3df8007be0 tx=0x7f3df8005f70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:33.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.645+0000 7f3dfffff640 1 -- 172.21.15.92:0/2580073895 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3df00bcb10 con 0x7f3e081036e0 2024-09-19T08:55:33.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.815+0000 7f3e0d32b640 1 -- 172.21.15.92:0/2580073895 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f3e0810a2b0 con 0x7f3e081036e0 2024-09-19T08:55:33.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.815+0000 7f3dfffff640 1 -- 172.21.15.92:0/2580073895 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f3df00bc410 con 0x7f3e081036e0 2024-09-19T08:55:33.815 INFO:teuthology.orchestra.run.smithi092.stdout:283467841565 2024-09-19T08:55:33.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.818+0000 7f3e0d32b640 1 -- 172.21.15.92:0/2580073895 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3df40a3350 msgr2=0x7f3df40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:33.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.818+0000 7f3e0d32b640 1 --2- 172.21.15.92:0/2580073895 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3df40a3350 0x7f3df40a5810 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3df8007be0 tx=0x7f3df8005f70 comp rx=0 tx=0).stop 2024-09-19T08:55:33.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.818+0000 7f3e0d32b640 1 -- 172.21.15.92:0/2580073895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e081036e0 msgr2=0x7f3e08198b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:33.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.818+0000 7f3e0d32b640 1 --2- 172.21.15.92:0/2580073895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e081036e0 0x7f3e08198b80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3df0005940 tx=0x7f3df00042f0 comp rx=0 tx=0).stop 2024-09-19T08:55:33.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.818+0000 7f3e0d32b640 1 -- 172.21.15.92:0/2580073895 shutdown_connections 2024-09-19T08:55:33.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.818+0000 7f3e0d32b640 1 --2- 172.21.15.92:0/2580073895 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e081082a0 0x7f3e0819cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:33.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.818+0000 7f3e0d32b640 1 --2- 172.21.15.92:0/2580073895 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3df40a3350 0x7f3df40a5810 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:33.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.818+0000 7f3e0d32b640 1 --2- 172.21.15.92:0/2580073895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e081036e0 0x7f3e08198b80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:33.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.818+0000 7f3e0d32b640 1 --2- 172.21.15.92:0/2580073895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e08102d30 0x7f3e08198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:33.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.818+0000 7f3e0d32b640 1 -- 172.21.15.92:0/2580073895 >> 172.21.15.92:0/2580073895 conn(0x7f3e080fc7d0 msgr2=0x7f3e08106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:33.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.818+0000 7f3e0d32b640 1 -- 172.21.15.92:0/2580073895 shutdown_connections 2024-09-19T08:55:33.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:33.818+0000 7f3e0d32b640 1 -- 172.21.15.92:0/2580073895 wait complete. 2024-09-19T08:55:33.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:33 smithi167 ceph-mon[35359]: pgmap v302: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s rd, 1 op/s 2024-09-19T08:55:33.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:33 smithi190 ceph-mon[35358]: pgmap v302: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s rd, 1 op/s 2024-09-19T08:55:33.913 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:34.371 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215164 got 103079215167 for osd.3 2024-09-19T08:55:34.371 DEBUG:teuthology.parallel:result is None 2024-09-19T08:55:34.664 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:34 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/2580073895' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T08:55:34.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:34 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/2580073895' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T08:55:34.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:34 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/2580073895' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T08:55:35.153 INFO:tasks.cephadm.ceph_manager.ceph:need seq 283467841563 got 283467841565 for osd.10 2024-09-19T08:55:35.153 DEBUG:teuthology.parallel:result is None 2024-09-19T08:55:35.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.307+0000 7f3404cc8640 1 -- 172.21.15.92:0/775896719 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3400102790 msgr2=0x7f34001067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:35.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.307+0000 7f3404cc8640 1 --2- 172.21.15.92:0/775896719 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3400102790 0x7f34001067e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f33e8009900 tx=0x7f33e802a410 comp rx=0 tx=0).stop 2024-09-19T08:55:35.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.307+0000 7f3404cc8640 1 -- 172.21.15.92:0/775896719 shutdown_connections 2024-09-19T08:55:35.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.307+0000 7f3404cc8640 1 --2- 172.21.15.92:0/775896719 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3400106f10 0x7f340010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:35.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.307+0000 7f3404cc8640 1 --2- 172.21.15.92:0/775896719 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3400102790 0x7f34001067e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:35.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.307+0000 7f3404cc8640 1 --2- 172.21.15.92:0/775896719 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3400101de0 0x7f34001021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:35.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.307+0000 7f3404cc8640 1 -- 172.21.15.92:0/775896719 >> 172.21.15.92:0/775896719 conn(0x7f34000fd8c0 msgr2=0x7f34000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:35.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.307+0000 7f3404cc8640 1 -- 172.21.15.92:0/775896719 shutdown_connections 2024-09-19T08:55:35.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.307+0000 7f3404cc8640 1 -- 172.21.15.92:0/775896719 wait complete. 2024-09-19T08:55:35.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.308+0000 7f3404cc8640 1 Processor -- start 2024-09-19T08:55:35.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.308+0000 7f3404cc8640 1 -- start start 2024-09-19T08:55:35.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.308+0000 7f3404cc8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3400101de0 0x7f34001985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:35.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.308+0000 7f3404cc8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3400102790 0x7f3400198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:35.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.308+0000 7f3404cc8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3400106f10 0x7f340019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:35.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.308+0000 7f3404cc8640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3400112010 con 0x7f3400106f10 2024-09-19T08:55:35.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.308+0000 7f3404cc8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3400111e90 con 0x7f3400102790 2024-09-19T08:55:35.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.308+0000 7f3404cc8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3400112190 con 0x7f3400101de0 2024-09-19T08:55:35.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.308+0000 7f33fed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3400106f10 0x7f340019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:35.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.308+0000 7f33fed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3400106f10 0x7f340019ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56076/0 (socket says 172.21.15.92:56076) 2024-09-19T08:55:35.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.308+0000 7f33fed9d640 1 -- 172.21.15.92:0/1180291939 learned_addr learned my addr 172.21.15.92:0/1180291939 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:35.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.308+0000 7f33fe59c640 1 --2- 172.21.15.92:0/1180291939 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3400101de0 0x7f34001985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:35.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.308+0000 7f33fed9d640 1 -- 172.21.15.92:0/1180291939 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3400101de0 msgr2=0x7f34001985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:35.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.308+0000 7f33fed9d640 1 --2- 172.21.15.92:0/1180291939 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3400101de0 0x7f34001985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:35.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.308+0000 7f33fed9d640 1 -- 172.21.15.92:0/1180291939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3400102790 msgr2=0x7f3400198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:35.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.308+0000 7f33f7fff640 1 --2- 172.21.15.92:0/1180291939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3400102790 0x7f3400198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:35.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.308+0000 7f33fed9d640 1 --2- 172.21.15.92:0/1180291939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3400102790 0x7f3400198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:35.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.308+0000 7f33fed9d640 1 -- 172.21.15.92:0/1180291939 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f340019d560 con 0x7f3400106f10 2024-09-19T08:55:35.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.308+0000 7f33fe59c640 1 --2- 172.21.15.92:0/1180291939 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3400101de0 0x7f34001985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:55:35.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.309+0000 7f33f7fff640 1 --2- 172.21.15.92:0/1180291939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3400102790 0x7f3400198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:55:35.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.309+0000 7f33fed9d640 1 --2- 172.21.15.92:0/1180291939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3400106f10 0x7f340019ce80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f33f800b970 tx=0x7f33f800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:35.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.309+0000 7f33f77fe640 1 -- 172.21.15.92:0/1180291939 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f8019070 con 0x7f3400106f10 2024-09-19T08:55:35.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.309+0000 7f33f77fe640 1 -- 172.21.15.92:0/1180291939 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33f800cb40 con 0x7f3400106f10 2024-09-19T08:55:35.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.309+0000 7f3404cc8640 1 -- 172.21.15.92:0/1180291939 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f340019d850 con 0x7f3400106f10 2024-09-19T08:55:35.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.309+0000 7f33f77fe640 1 -- 172.21.15.92:0/1180291939 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f8007650 con 0x7f3400106f10 2024-09-19T08:55:35.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.309+0000 7f3404cc8640 1 -- 172.21.15.92:0/1180291939 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34001a5130 con 0x7f3400106f10 2024-09-19T08:55:35.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.310+0000 7f3404cc8640 1 -- 172.21.15.92:0/1180291939 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3400102240 con 0x7f3400106f10 2024-09-19T08:55:35.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.311+0000 7f33f77fe640 1 -- 172.21.15.92:0/1180291939 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f33f801c070 con 0x7f3400106f10 2024-09-19T08:55:35.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.312+0000 7f33f77fe640 1 --2- 172.21.15.92:0/1180291939 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f33ec0a3350 0x7f33ec0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:35.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.312+0000 7f33fe59c640 1 --2- 172.21.15.92:0/1180291939 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f33ec0a3350 0x7f33ec0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:35.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.312+0000 7f33f77fe640 1 -- 172.21.15.92:0/1180291939 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f33f80cf400 con 0x7f3400106f10 2024-09-19T08:55:35.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.312+0000 7f33fe59c640 1 --2- 172.21.15.92:0/1180291939 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f33ec0a3350 0x7f33ec0a5810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f33f0006fd0 tx=0x7f33f0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:35.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.316+0000 7f33f77fe640 1 -- 172.21.15.92:0/1180291939 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f33f809c090 con 0x7f3400106f10 2024-09-19T08:55:35.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.491+0000 7f3404cc8640 1 -- 172.21.15.92:0/1180291939 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f3400199910 con 0x7f3400106f10 2024-09-19T08:55:35.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.491+0000 7f33f77fe640 1 -- 172.21.15.92:0/1180291939 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3400199910 con 0x7f3400106f10 2024-09-19T08:55:35.491 INFO:teuthology.orchestra.run.smithi092.stdout:77309411397 2024-09-19T08:55:35.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.493+0000 7f3404cc8640 1 -- 172.21.15.92:0/1180291939 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f33ec0a3350 msgr2=0x7f33ec0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:35.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.493+0000 7f3404cc8640 1 --2- 172.21.15.92:0/1180291939 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f33ec0a3350 0x7f33ec0a5810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f33f0006fd0 tx=0x7f33f0008040 comp rx=0 tx=0).stop 2024-09-19T08:55:35.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.493+0000 7f3404cc8640 1 -- 172.21.15.92:0/1180291939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3400106f10 msgr2=0x7f340019ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:35.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.493+0000 7f3404cc8640 1 --2- 172.21.15.92:0/1180291939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3400106f10 0x7f340019ce80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f33f800b970 tx=0x7f33f800be30 comp rx=0 tx=0).stop 2024-09-19T08:55:35.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.493+0000 7f3404cc8640 1 -- 172.21.15.92:0/1180291939 shutdown_connections 2024-09-19T08:55:35.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.493+0000 7f3404cc8640 1 --2- 172.21.15.92:0/1180291939 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f33ec0a3350 0x7f33ec0a5810 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:35.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.493+0000 7f3404cc8640 1 --2- 172.21.15.92:0/1180291939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3400106f10 0x7f340019ce80 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:35.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.493+0000 7f3404cc8640 1 --2- 172.21.15.92:0/1180291939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3400102790 0x7f3400198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:35.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.493+0000 7f3404cc8640 1 --2- 172.21.15.92:0/1180291939 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3400101de0 0x7f34001985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:35.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.493+0000 7f3404cc8640 1 -- 172.21.15.92:0/1180291939 >> 172.21.15.92:0/1180291939 conn(0x7f34000fd8c0 msgr2=0x7f34000fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:35.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.493+0000 7f3404cc8640 1 -- 172.21.15.92:0/1180291939 shutdown_connections 2024-09-19T08:55:35.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:35.493+0000 7f3404cc8640 1 -- 172.21.15.92:0/1180291939 wait complete. 2024-09-19T08:55:35.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:35 smithi092 ceph-mon[31407]: pgmap v303: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:55:35.831 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822707 got 154618822710 for osd.5 2024-09-19T08:55:35.831 DEBUG:teuthology.parallel:result is None 2024-09-19T08:55:35.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:35 smithi167 ceph-mon[35359]: pgmap v303: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:55:35.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:35 smithi190 ceph-mon[35358]: pgmap v303: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:55:36.259 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928234020 got 231928234023 for osd.8 2024-09-19T08:55:36.259 DEBUG:teuthology.parallel:result is None 2024-09-19T08:55:36.460 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:36.502 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:36 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1180291939' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T08:55:36.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:36 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/1180291939' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T08:55:36.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:36 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/1180291939' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T08:55:36.884 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411395 got 77309411397 for osd.2 2024-09-19T08:55:36.884 DEBUG:teuthology.parallel:result is None 2024-09-19T08:55:37.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:37 smithi092 ceph-mon[31407]: pgmap v304: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:55:37.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:37 smithi167 ceph-mon[35359]: pgmap v304: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:55:37.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:37 smithi190 ceph-mon[35358]: pgmap v304: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:55:37.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.973+0000 7fb9e4a88640 1 -- 172.21.15.92:0/2507500587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9e0102ef0 msgr2=0x7fb9e010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:37.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.973+0000 7fb9e4a88640 1 --2- 172.21.15.92:0/2507500587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9e0102ef0 0x7fb9e010da40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009ca0 tx=0x7fb9d802a950 comp rx=0 tx=0).stop 2024-09-19T08:55:37.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.973+0000 7fb9e4a88640 1 -- 172.21.15.92:0/2507500587 shutdown_connections 2024-09-19T08:55:37.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.973+0000 7fb9e4a88640 1 --2- 172.21.15.92:0/2507500587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9e0102ef0 0x7fb9e010da40 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:37.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.973+0000 7fb9e4a88640 1 --2- 172.21.15.92:0/2507500587 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9e0102570 0x7fb9e01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:37.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.973+0000 7fb9e4a88640 1 --2- 172.21.15.92:0/2507500587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9e0100e20 0x7fb9e0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:37.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.973+0000 7fb9e4a88640 1 -- 172.21.15.92:0/2507500587 >> 172.21.15.92:0/2507500587 conn(0x7fb9e00fc7d0 msgr2=0x7fb9e00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:37.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.973+0000 7fb9e4a88640 1 -- 172.21.15.92:0/2507500587 shutdown_connections 2024-09-19T08:55:37.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.973+0000 7fb9e4a88640 1 -- 172.21.15.92:0/2507500587 wait complete. 2024-09-19T08:55:37.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.973+0000 7fb9e4a88640 1 Processor -- start 2024-09-19T08:55:37.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.974+0000 7fb9e4a88640 1 -- start start 2024-09-19T08:55:37.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.974+0000 7fb9e4a88640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9e0100e20 0x7fb9e0198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:37.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.974+0000 7fb9e4a88640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9e0102570 0x7fb9e0198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:37.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.974+0000 7fb9e4a88640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9e0102ef0 0x7fb9e019cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:37.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.974+0000 7fb9e4a88640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e0110f80 con 0x7fb9e0102570 2024-09-19T08:55:37.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.974+0000 7fb9e4a88640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e0110e00 con 0x7fb9e0100e20 2024-09-19T08:55:37.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.974+0000 7fb9e4a88640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e0111100 con 0x7fb9e0102ef0 2024-09-19T08:55:37.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.974+0000 7fb9d7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9e0102570 0x7fb9e0198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:37.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.974+0000 7fb9d7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9e0102570 0x7fb9e0198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56098/0 (socket says 172.21.15.92:56098) 2024-09-19T08:55:37.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.974+0000 7fb9d7fff640 1 -- 172.21.15.92:0/3458071694 learned_addr learned my addr 172.21.15.92:0/3458071694 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:37.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.974+0000 7fb9ded9d640 1 --2- 172.21.15.92:0/3458071694 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9e0102ef0 0x7fb9e019cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:37.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.974+0000 7fb9de59c640 1 --2- 172.21.15.92:0/3458071694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9e0100e20 0x7fb9e0198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:37.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.974+0000 7fb9d7fff640 1 -- 172.21.15.92:0/3458071694 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9e0102ef0 msgr2=0x7fb9e019cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:37.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.974+0000 7fb9d7fff640 1 --2- 172.21.15.92:0/3458071694 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9e0102ef0 0x7fb9e019cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:37.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.974+0000 7fb9d7fff640 1 -- 172.21.15.92:0/3458071694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9e0100e20 msgr2=0x7fb9e0198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:37.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.974+0000 7fb9d7fff640 1 --2- 172.21.15.92:0/3458071694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9e0100e20 0x7fb9e0198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:37.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.974+0000 7fb9d7fff640 1 -- 172.21.15.92:0/3458071694 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e019d3c0 con 0x7fb9e0102570 2024-09-19T08:55:37.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.974+0000 7fb9de59c640 1 --2- 172.21.15.92:0/3458071694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9e0100e20 0x7fb9e0198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:55:37.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.974+0000 7fb9d7fff640 1 --2- 172.21.15.92:0/3458071694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9e0102570 0x7fb9e0198950 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb9c800d950 tx=0x7fb9c800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:37.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.975+0000 7fb9d77fe640 1 -- 172.21.15.92:0/3458071694 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8017070 con 0x7fb9e0102570 2024-09-19T08:55:37.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.975+0000 7fb9e4a88640 1 -- 172.21.15.92:0/3458071694 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9e019d6b0 con 0x7fb9e0102570 2024-09-19T08:55:37.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.975+0000 7fb9d77fe640 1 -- 172.21.15.92:0/3458071694 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9c8009c30 con 0x7fb9e0102570 2024-09-19T08:55:37.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.975+0000 7fb9d77fe640 1 -- 172.21.15.92:0/3458071694 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c800f6b0 con 0x7fb9e0102570 2024-09-19T08:55:37.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.975+0000 7fb9e4a88640 1 -- 172.21.15.92:0/3458071694 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9e01a4f90 con 0x7fb9e0102570 2024-09-19T08:55:37.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.976+0000 7fb9e4a88640 1 -- 172.21.15.92:0/3458071694 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9e0101200 con 0x7fb9e0102570 2024-09-19T08:55:37.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.977+0000 7fb9d77fe640 1 -- 172.21.15.92:0/3458071694 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb9c80109d0 con 0x7fb9e0102570 2024-09-19T08:55:37.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.978+0000 7fb9d77fe640 1 --2- 172.21.15.92:0/3458071694 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb9cc0a32d0 0x7fb9cc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:37.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.978+0000 7fb9de59c640 1 --2- 172.21.15.92:0/3458071694 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb9cc0a32d0 0x7fb9cc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:37.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.978+0000 7fb9d77fe640 1 -- 172.21.15.92:0/3458071694 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb9c80cf6c0 con 0x7fb9e0102570 2024-09-19T08:55:37.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.978+0000 7fb9de59c640 1 --2- 172.21.15.92:0/3458071694 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb9cc0a32d0 0x7fb9cc0a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb9d000abe0 tx=0x7fb9d000a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:37.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:37.981+0000 7fb9d77fe640 1 -- 172.21.15.92:0/3458071694 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb9c8009de0 con 0x7fb9e0102570 2024-09-19T08:55:38.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:38.171+0000 7fb9e4a88640 1 -- 172.21.15.92:0/3458071694 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb9e010a0a0 con 0x7fb9e0102570 2024-09-19T08:55:38.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:38.171+0000 7fb9d77fe640 1 -- 172.21.15.92:0/3458071694 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb9c809c280 con 0x7fb9e0102570 2024-09-19T08:55:38.171 INFO:teuthology.orchestra.run.smithi092.stdout:55834574922 2024-09-19T08:55:38.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:38.174+0000 7fb9e4a88640 1 -- 172.21.15.92:0/3458071694 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb9cc0a32d0 msgr2=0x7fb9cc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:38.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:38.174+0000 7fb9e4a88640 1 --2- 172.21.15.92:0/3458071694 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb9cc0a32d0 0x7fb9cc0a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb9d000abe0 tx=0x7fb9d000a5c0 comp rx=0 tx=0).stop 2024-09-19T08:55:38.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:38.174+0000 7fb9e4a88640 1 -- 172.21.15.92:0/3458071694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9e0102570 msgr2=0x7fb9e0198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:38.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:38.174+0000 7fb9e4a88640 1 --2- 172.21.15.92:0/3458071694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9e0102570 0x7fb9e0198950 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb9c800d950 tx=0x7fb9c800de10 comp rx=0 tx=0).stop 2024-09-19T08:55:38.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:38.174+0000 7fb9e4a88640 1 -- 172.21.15.92:0/3458071694 shutdown_connections 2024-09-19T08:55:38.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:38.174+0000 7fb9e4a88640 1 --2- 172.21.15.92:0/3458071694 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9e0102ef0 0x7fb9e019cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:38.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:38.174+0000 7fb9e4a88640 1 --2- 172.21.15.92:0/3458071694 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb9cc0a32d0 0x7fb9cc0a5790 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:38.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:38.174+0000 7fb9e4a88640 1 --2- 172.21.15.92:0/3458071694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9e0102570 0x7fb9e0198950 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:38.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:38.174+0000 7fb9e4a88640 1 --2- 172.21.15.92:0/3458071694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9e0100e20 0x7fb9e0198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:38.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:38.174+0000 7fb9e4a88640 1 -- 172.21.15.92:0/3458071694 >> 172.21.15.92:0/3458071694 conn(0x7fb9e00fc7d0 msgr2=0x7fb9e006a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:38.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:38.174+0000 7fb9e4a88640 1 -- 172.21.15.92:0/3458071694 shutdown_connections 2024-09-19T08:55:38.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:38.174+0000 7fb9e4a88640 1 -- 172.21.15.92:0/3458071694 wait complete. 2024-09-19T08:55:38.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:38 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3458071694' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T08:55:38.783 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574918 got 55834574922 for osd.1 2024-09-19T08:55:38.783 DEBUG:teuthology.parallel:result is None 2024-09-19T08:55:38.783 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T08:55:38.783 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:55:38.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:38 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3458071694' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T08:55:38.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:38 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3458071694' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T08:55:39.051 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:39.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.531+0000 7fcc3caf1640 1 -- 172.21.15.92:0/1138318161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc38100e20 msgr2=0x7fcc38101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:39.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.531+0000 7fcc3caf1640 1 --2- 172.21.15.92:0/1138318161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc38100e20 0x7fcc38101200 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fcc20009900 tx=0x7fcc2002a480 comp rx=0 tx=0).stop 2024-09-19T08:55:39.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.531+0000 7fcc3caf1640 1 -- 172.21.15.92:0/1138318161 shutdown_connections 2024-09-19T08:55:39.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.531+0000 7fcc3caf1640 1 --2- 172.21.15.92:0/1138318161 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc38102ef0 0x7fcc3810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:39.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.531+0000 7fcc3caf1640 1 --2- 172.21.15.92:0/1138318161 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc38102570 0x7fcc381029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:39.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.531+0000 7fcc3caf1640 1 --2- 172.21.15.92:0/1138318161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc38100e20 0x7fcc38101200 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:39.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.531+0000 7fcc3caf1640 1 -- 172.21.15.92:0/1138318161 >> 172.21.15.92:0/1138318161 conn(0x7fcc380fc7d0 msgr2=0x7fcc380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:39.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.531+0000 7fcc3caf1640 1 -- 172.21.15.92:0/1138318161 shutdown_connections 2024-09-19T08:55:39.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.531+0000 7fcc3caf1640 1 -- 172.21.15.92:0/1138318161 wait complete. 2024-09-19T08:55:39.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.532+0000 7fcc3caf1640 1 Processor -- start 2024-09-19T08:55:39.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.532+0000 7fcc3caf1640 1 -- start start 2024-09-19T08:55:39.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.532+0000 7fcc3caf1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc38100e20 0x7fcc38197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:39.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.532+0000 7fcc3caf1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc38102570 0x7fcc38197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:39.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.532+0000 7fcc3caf1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc38102ef0 0x7fcc3819bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:39.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.532+0000 7fcc3caf1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcc38110fa0 con 0x7fcc38102570 2024-09-19T08:55:39.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.532+0000 7fcc3caf1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcc38110e20 con 0x7fcc38102ef0 2024-09-19T08:55:39.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.532+0000 7fcc3caf1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fcc38111120 con 0x7fcc38100e20 2024-09-19T08:55:39.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.532+0000 7fcc35d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc38102570 0x7fcc38197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:39.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.533+0000 7fcc35d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc38102570 0x7fcc38197980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56118/0 (socket says 172.21.15.92:56118) 2024-09-19T08:55:39.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.533+0000 7fcc35d9b640 1 -- 172.21.15.92:0/3298635262 learned_addr learned my addr 172.21.15.92:0/3298635262 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:39.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.533+0000 7fcc36d9d640 1 --2- 172.21.15.92:0/3298635262 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc38102ef0 0x7fcc3819bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:39.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.533+0000 7fcc3659c640 1 --2- 172.21.15.92:0/3298635262 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc38100e20 0x7fcc38197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:39.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.533+0000 7fcc35d9b640 1 -- 172.21.15.92:0/3298635262 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc38100e20 msgr2=0x7fcc38197440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:39.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.533+0000 7fcc35d9b640 1 --2- 172.21.15.92:0/3298635262 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc38100e20 0x7fcc38197440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:39.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.533+0000 7fcc35d9b640 1 -- 172.21.15.92:0/3298635262 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc38102ef0 msgr2=0x7fcc3819bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:39.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.533+0000 7fcc35d9b640 1 --2- 172.21.15.92:0/3298635262 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc38102ef0 0x7fcc3819bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:39.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.533+0000 7fcc35d9b640 1 -- 172.21.15.92:0/3298635262 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc3819c3f0 con 0x7fcc38102570 2024-09-19T08:55:39.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.533+0000 7fcc35d9b640 1 --2- 172.21.15.92:0/3298635262 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc38102570 0x7fcc38197980 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800d950 tx=0x7fcc2800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:39.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.533+0000 7fcc2f7fe640 1 -- 172.21.15.92:0/3298635262 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc28017070 con 0x7fcc38102570 2024-09-19T08:55:39.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.533+0000 7fcc2f7fe640 1 -- 172.21.15.92:0/3298635262 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc28009c30 con 0x7fcc38102570 2024-09-19T08:55:39.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.533+0000 7fcc3caf1640 1 -- 172.21.15.92:0/3298635262 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc3819c6e0 con 0x7fcc38102570 2024-09-19T08:55:39.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.533+0000 7fcc2f7fe640 1 -- 172.21.15.92:0/3298635262 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2800f6b0 con 0x7fcc38102570 2024-09-19T08:55:39.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.533+0000 7fcc3caf1640 1 -- 172.21.15.92:0/3298635262 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc381a3fc0 con 0x7fcc38102570 2024-09-19T08:55:39.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.534+0000 7fcc3caf1640 1 -- 172.21.15.92:0/3298635262 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc38101200 con 0x7fcc38102570 2024-09-19T08:55:39.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.535+0000 7fcc2f7fe640 1 -- 172.21.15.92:0/3298635262 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fcc280109d0 con 0x7fcc38102570 2024-09-19T08:55:39.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.536+0000 7fcc2f7fe640 1 --2- 172.21.15.92:0/3298635262 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcc240a32d0 0x7fcc240a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:39.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.536+0000 7fcc3659c640 1 --2- 172.21.15.92:0/3298635262 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcc240a32d0 0x7fcc240a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:39.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.536+0000 7fcc2f7fe640 1 -- 172.21.15.92:0/3298635262 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcc280cf6f0 con 0x7fcc38102570 2024-09-19T08:55:39.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.537+0000 7fcc3659c640 1 --2- 172.21.15.92:0/3298635262 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcc240a32d0 0x7fcc240a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcc20005ab0 tx=0x7fcc20005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:39.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.540+0000 7fcc2f7fe640 1 -- 172.21.15.92:0/3298635262 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcc28009de0 con 0x7fcc38102570 2024-09-19T08:55:39.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.706+0000 7fcc3caf1640 1 -- 172.21.15.92:0/3298635262 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcc38062630 con 0x7fcc240a32d0 2024-09-19T08:55:39.706 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:39 smithi092 ceph-mon[31407]: pgmap v305: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:55:39.706 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:39 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:55:39.706 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:39 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:55:39.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.712+0000 7fcc2f7fe640 1 -- 172.21.15.92:0/3298635262 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258638 (secure 0 0 0) 0x7fcc38062630 con 0x7fcc240a32d0 2024-09-19T08:55:39.714 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:55:39.715 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-19T08:55:39.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.715+0000 7fcc3caf1640 1 -- 172.21.15.92:0/3298635262 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcc240a32d0 msgr2=0x7fcc240a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:39.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.715+0000 7fcc3caf1640 1 --2- 172.21.15.92:0/3298635262 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcc240a32d0 0x7fcc240a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcc20005ab0 tx=0x7fcc20005a20 comp rx=0 tx=0).stop 2024-09-19T08:55:39.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.715+0000 7fcc3caf1640 1 -- 172.21.15.92:0/3298635262 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc38102570 msgr2=0x7fcc38197980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:39.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.715+0000 7fcc3caf1640 1 --2- 172.21.15.92:0/3298635262 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc38102570 0x7fcc38197980 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800d950 tx=0x7fcc2800de10 comp rx=0 tx=0).stop 2024-09-19T08:55:39.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.715+0000 7fcc3caf1640 1 -- 172.21.15.92:0/3298635262 shutdown_connections 2024-09-19T08:55:39.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.715+0000 7fcc3caf1640 1 --2- 172.21.15.92:0/3298635262 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc38102ef0 0x7fcc3819bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:39.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.715+0000 7fcc3caf1640 1 --2- 172.21.15.92:0/3298635262 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcc240a32d0 0x7fcc240a5790 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:39.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.715+0000 7fcc3caf1640 1 --2- 172.21.15.92:0/3298635262 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc38102570 0x7fcc38197980 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:39.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.715+0000 7fcc3caf1640 1 --2- 172.21.15.92:0/3298635262 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc38100e20 0x7fcc38197440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:39.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.715+0000 7fcc3caf1640 1 -- 172.21.15.92:0/3298635262 >> 172.21.15.92:0/3298635262 conn(0x7fcc380fc7d0 msgr2=0x7fcc380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:39.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.715+0000 7fcc3caf1640 1 -- 172.21.15.92:0/3298635262 shutdown_connections 2024-09-19T08:55:39.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:39.715+0000 7fcc3caf1640 1 -- 172.21.15.92:0/3298635262 wait complete. 2024-09-19T08:55:39.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:39 smithi167 ceph-mon[35359]: pgmap v305: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:55:39.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:39 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:55:39.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:39 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:55:39.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:39 smithi190 ceph-mon[35358]: pgmap v305: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:55:39.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:39 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:55:39.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:39 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:55:40.376 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":305,"stamp":"2024-09-19T08:55:38.271398+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":652599,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":254,"num_read_kb":234,"num_write":263,"num_write_kb":3024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365992,"kb_used_data":12540,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575832,"statfs":{"total":1151940427776,"available":1151565651968,"internally_reserved":0,"allocated":12840960,"data_stored":7186473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":15,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003005"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.328272+0000","last_change":"2024-09-19T08:54:31.437743+0000","last_active":"2024-09-19T08:54:53.328272+0000","last_peered":"2024-09-19T08:54:53.328272+0000","last_clean":"2024-09-19T08:54:53.328272+0000","last_became_active":"2024-09-19T08:54:31.437426+0000","last_became_peered":"2024-09-19T08:54:31.437426+0000","last_unstale":"2024-09-19T08:54:53.328272+0000","last_undegraded":"2024-09-19T08:54:53.328272+0000","last_fullsized":"2024-09-19T08:54:53.328272+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:04.403522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330184+0000","last_change":"2024-09-19T08:54:31.430322+0000","last_active":"2024-09-19T08:54:53.330184+0000","last_peered":"2024-09-19T08:54:53.330184+0000","last_clean":"2024-09-19T08:54:53.330184+0000","last_became_active":"2024-09-19T08:54:31.430008+0000","last_became_peered":"2024-09-19T08:54:31.430008+0000","last_unstale":"2024-09-19T08:54:53.330184+0000","last_undegraded":"2024-09-19T08:54:53.330184+0000","last_fullsized":"2024-09-19T08:54:53.330184+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:19.800686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331041+0000","last_change":"2024-09-19T08:54:31.430276+0000","last_active":"2024-09-19T08:54:53.331041+0000","last_peered":"2024-09-19T08:54:53.331041+0000","last_clean":"2024-09-19T08:54:53.331041+0000","last_became_active":"2024-09-19T08:54:31.429939+0000","last_became_peered":"2024-09-19T08:54:31.429939+0000","last_unstale":"2024-09-19T08:54:53.331041+0000","last_undegraded":"2024-09-19T08:54:53.331041+0000","last_fullsized":"2024-09-19T08:54:53.331041+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:08.735067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.980198+0000","last_change":"2024-09-19T08:54:31.435197+0000","last_active":"2024-09-19T08:54:53.980198+0000","last_peered":"2024-09-19T08:54:53.980198+0000","last_clean":"2024-09-19T08:54:53.980198+0000","last_became_active":"2024-09-19T08:54:31.434872+0000","last_became_peered":"2024-09-19T08:54:31.434872+0000","last_unstale":"2024-09-19T08:54:53.980198+0000","last_undegraded":"2024-09-19T08:54:53.980198+0000","last_fullsized":"2024-09-19T08:54:53.980198+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:06.213317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330478+0000","last_change":"2024-09-19T08:54:31.423765+0000","last_active":"2024-09-19T08:54:53.330478+0000","last_peered":"2024-09-19T08:54:53.330478+0000","last_clean":"2024-09-19T08:54:53.330478+0000","last_became_active":"2024-09-19T08:54:31.423296+0000","last_became_peered":"2024-09-19T08:54:31.423296+0000","last_unstale":"2024-09-19T08:54:53.330478+0000","last_undegraded":"2024-09-19T08:54:53.330478+0000","last_fullsized":"2024-09-19T08:54:53.330478+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:07.507168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327935+0000","last_change":"2024-09-19T08:54:31.430299+0000","last_active":"2024-09-19T08:54:53.327935+0000","last_peered":"2024-09-19T08:54:53.327935+0000","last_clean":"2024-09-19T08:54:53.327935+0000","last_became_active":"2024-09-19T08:54:31.429951+0000","last_became_peered":"2024-09-19T08:54:31.429951+0000","last_unstale":"2024-09-19T08:54:53.327935+0000","last_undegraded":"2024-09-19T08:54:53.327935+0000","last_fullsized":"2024-09-19T08:54:53.327935+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:11.299729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330534+0000","last_change":"2024-09-19T08:54:31.435854+0000","last_active":"2024-09-19T08:54:53.330534+0000","last_peered":"2024-09-19T08:54:53.330534+0000","last_clean":"2024-09-19T08:54:53.330534+0000","last_became_active":"2024-09-19T08:54:31.435522+0000","last_became_peered":"2024-09-19T08:54:31.435522+0000","last_unstale":"2024-09-19T08:54:53.330534+0000","last_undegraded":"2024-09-19T08:54:53.330534+0000","last_fullsized":"2024-09-19T08:54:53.330534+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:11.099750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.328883+0000","last_change":"2024-09-19T08:54:31.434574+0000","last_active":"2024-09-19T08:54:53.328883+0000","last_peered":"2024-09-19T08:54:53.328883+0000","last_clean":"2024-09-19T08:54:53.328883+0000","last_became_active":"2024-09-19T08:54:31.434268+0000","last_became_peered":"2024-09-19T08:54:31.434268+0000","last_unstale":"2024-09-19T08:54:53.328883+0000","last_undegraded":"2024-09-19T08:54:53.328883+0000","last_fullsized":"2024-09-19T08:54:53.328883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:29.159417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330517+0000","last_change":"2024-09-19T08:54:31.430446+0000","last_active":"2024-09-19T08:54:53.330517+0000","last_peered":"2024-09-19T08:54:53.330517+0000","last_clean":"2024-09-19T08:54:53.330517+0000","last_became_active":"2024-09-19T08:54:31.430048+0000","last_became_peered":"2024-09-19T08:54:31.430048+0000","last_unstale":"2024-09-19T08:54:53.330517+0000","last_undegraded":"2024-09-19T08:54:53.330517+0000","last_fullsized":"2024-09-19T08:54:53.330517+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:24.773947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.328011+0000","last_change":"2024-09-19T08:54:31.433144+0000","last_active":"2024-09-19T08:54:53.328011+0000","last_peered":"2024-09-19T08:54:53.328011+0000","last_clean":"2024-09-19T08:54:53.328011+0000","last_became_active":"2024-09-19T08:54:31.432590+0000","last_became_peered":"2024-09-19T08:54:31.432590+0000","last_unstale":"2024-09-19T08:54:53.328011+0000","last_undegraded":"2024-09-19T08:54:53.328011+0000","last_fullsized":"2024-09-19T08:54:53.328011+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:53.756846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331069+0000","last_change":"2024-09-19T08:54:31.435712+0000","last_active":"2024-09-19T08:54:53.331069+0000","last_peered":"2024-09-19T08:54:53.331069+0000","last_clean":"2024-09-19T08:54:53.331069+0000","last_became_active":"2024-09-19T08:54:31.435301+0000","last_became_peered":"2024-09-19T08:54:31.435301+0000","last_unstale":"2024-09-19T08:54:53.331069+0000","last_undegraded":"2024-09-19T08:54:53.331069+0000","last_fullsized":"2024-09-19T08:54:53.331069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:51.703709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.333375+0000","last_change":"2024-09-19T08:54:53.332853+0000","last_active":"2024-09-19T08:54:53.333375+0000","last_peered":"2024-09-19T08:54:53.333375+0000","last_clean":"2024-09-19T08:54:53.333375+0000","last_became_active":"2024-09-19T08:54:53.332460+0000","last_became_peered":"2024-09-19T08:54:53.332460+0000","last_unstale":"2024-09-19T08:54:53.333375+0000","last_undegraded":"2024-09-19T08:54:53.333375+0000","last_fullsized":"2024-09-19T08:54:53.333375+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:47:58.025876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327046+0000","last_change":"2024-09-19T08:54:31.425590+0000","last_active":"2024-09-19T08:54:53.327046+0000","last_peered":"2024-09-19T08:54:53.327046+0000","last_clean":"2024-09-19T08:54:53.327046+0000","last_became_active":"2024-09-19T08:54:31.425268+0000","last_became_peered":"2024-09-19T08:54:31.425268+0000","last_unstale":"2024-09-19T08:54:53.327046+0000","last_undegraded":"2024-09-19T08:54:53.327046+0000","last_fullsized":"2024-09-19T08:54:53.327046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:09.404947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330332+0000","last_change":"2024-09-19T08:54:31.428372+0000","last_active":"2024-09-19T08:54:53.330332+0000","last_peered":"2024-09-19T08:54:53.330332+0000","last_clean":"2024-09-19T08:54:53.330332+0000","last_became_active":"2024-09-19T08:54:31.428064+0000","last_became_peered":"2024-09-19T08:54:31.428064+0000","last_unstale":"2024-09-19T08:54:53.330332+0000","last_undegraded":"2024-09-19T08:54:53.330332+0000","last_fullsized":"2024-09-19T08:54:53.330332+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:40.444117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330115+0000","last_change":"2024-09-19T08:54:31.424365+0000","last_active":"2024-09-19T08:54:53.330115+0000","last_peered":"2024-09-19T08:54:53.330115+0000","last_clean":"2024-09-19T08:54:53.330115+0000","last_became_active":"2024-09-19T08:54:31.424044+0000","last_became_peered":"2024-09-19T08:54:31.424044+0000","last_unstale":"2024-09-19T08:54:53.330115+0000","last_undegraded":"2024-09-19T08:54:53.330115+0000","last_fullsized":"2024-09-19T08:54:53.330115+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:16.435389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329839+0000","last_change":"2024-09-19T08:54:31.437238+0000","last_active":"2024-09-19T08:54:53.329839+0000","last_peered":"2024-09-19T08:54:53.329839+0000","last_clean":"2024-09-19T08:54:53.329839+0000","last_became_active":"2024-09-19T08:54:31.436867+0000","last_became_peered":"2024-09-19T08:54:31.436867+0000","last_unstale":"2024-09-19T08:54:53.329839+0000","last_undegraded":"2024-09-19T08:54:53.329839+0000","last_fullsized":"2024-09-19T08:54:53.329839+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:59.839081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.328379+0000","last_change":"2024-09-19T08:54:31.438654+0000","last_active":"2024-09-19T08:54:53.328379+0000","last_peered":"2024-09-19T08:54:53.328379+0000","last_clean":"2024-09-19T08:54:53.328379+0000","last_became_active":"2024-09-19T08:54:31.438342+0000","last_became_peered":"2024-09-19T08:54:31.438342+0000","last_unstale":"2024-09-19T08:54:53.328379+0000","last_undegraded":"2024-09-19T08:54:53.328379+0000","last_fullsized":"2024-09-19T08:54:53.328379+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:55.190605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330648+0000","last_change":"2024-09-19T08:54:31.431100+0000","last_active":"2024-09-19T08:54:53.330648+0000","last_peered":"2024-09-19T08:54:53.330648+0000","last_clean":"2024-09-19T08:54:53.330648+0000","last_became_active":"2024-09-19T08:54:31.430749+0000","last_became_peered":"2024-09-19T08:54:31.430749+0000","last_unstale":"2024-09-19T08:54:53.330648+0000","last_undegraded":"2024-09-19T08:54:53.330648+0000","last_fullsized":"2024-09-19T08:54:53.330648+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:50.597610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330176+0000","last_change":"2024-09-19T08:54:31.427454+0000","last_active":"2024-09-19T08:54:53.330176+0000","last_peered":"2024-09-19T08:54:53.330176+0000","last_clean":"2024-09-19T08:54:53.330176+0000","last_became_active":"2024-09-19T08:54:31.427098+0000","last_became_peered":"2024-09-19T08:54:31.427098+0000","last_unstale":"2024-09-19T08:54:53.330176+0000","last_undegraded":"2024-09-19T08:54:53.330176+0000","last_fullsized":"2024-09-19T08:54:53.330176+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:01.042626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.328302+0000","last_change":"2024-09-19T08:54:31.433887+0000","last_active":"2024-09-19T08:54:53.328302+0000","last_peered":"2024-09-19T08:54:53.328302+0000","last_clean":"2024-09-19T08:54:53.328302+0000","last_became_active":"2024-09-19T08:54:31.433528+0000","last_became_peered":"2024-09-19T08:54:31.433528+0000","last_unstale":"2024-09-19T08:54:53.328302+0000","last_undegraded":"2024-09-19T08:54:53.328302+0000","last_fullsized":"2024-09-19T08:54:53.328302+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:37.291226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327047+0000","last_change":"2024-09-19T08:54:31.436976+0000","last_active":"2024-09-19T08:54:53.327047+0000","last_peered":"2024-09-19T08:54:53.327047+0000","last_clean":"2024-09-19T08:54:53.327047+0000","last_became_active":"2024-09-19T08:54:31.436646+0000","last_became_peered":"2024-09-19T08:54:31.436646+0000","last_unstale":"2024-09-19T08:54:53.327047+0000","last_undegraded":"2024-09-19T08:54:53.327047+0000","last_fullsized":"2024-09-19T08:54:53.327047+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:19.755556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330114+0000","last_change":"2024-09-19T08:54:31.438922+0000","last_active":"2024-09-19T08:54:53.330114+0000","last_peered":"2024-09-19T08:54:53.330114+0000","last_clean":"2024-09-19T08:54:53.330114+0000","last_became_active":"2024-09-19T08:54:31.438593+0000","last_became_peered":"2024-09-19T08:54:31.438593+0000","last_unstale":"2024-09-19T08:54:53.330114+0000","last_undegraded":"2024-09-19T08:54:53.330114+0000","last_fullsized":"2024-09-19T08:54:53.330114+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:07.347900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.328949+0000","last_change":"2024-09-19T08:54:31.431659+0000","last_active":"2024-09-19T08:54:53.328949+0000","last_peered":"2024-09-19T08:54:53.328949+0000","last_clean":"2024-09-19T08:54:53.328949+0000","last_became_active":"2024-09-19T08:54:31.431359+0000","last_became_peered":"2024-09-19T08:54:31.431359+0000","last_unstale":"2024-09-19T08:54:53.328949+0000","last_undegraded":"2024-09-19T08:54:53.328949+0000","last_fullsized":"2024-09-19T08:54:53.328949+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:02.421286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330986+0000","last_change":"2024-09-19T08:54:31.432185+0000","last_active":"2024-09-19T08:54:53.330986+0000","last_peered":"2024-09-19T08:54:53.330986+0000","last_clean":"2024-09-19T08:54:53.330986+0000","last_became_active":"2024-09-19T08:54:31.431418+0000","last_became_peered":"2024-09-19T08:54:31.431418+0000","last_unstale":"2024-09-19T08:54:53.330986+0000","last_undegraded":"2024-09-19T08:54:53.330986+0000","last_fullsized":"2024-09-19T08:54:53.330986+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:45.347487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329298+0000","last_change":"2024-09-19T08:54:31.433742+0000","last_active":"2024-09-19T08:54:53.329298+0000","last_peered":"2024-09-19T08:54:53.329298+0000","last_clean":"2024-09-19T08:54:53.329298+0000","last_became_active":"2024-09-19T08:54:31.433455+0000","last_became_peered":"2024-09-19T08:54:31.433455+0000","last_unstale":"2024-09-19T08:54:53.329298+0000","last_undegraded":"2024-09-19T08:54:53.329298+0000","last_fullsized":"2024-09-19T08:54:53.329298+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:38.803705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330825+0000","last_change":"2024-09-19T08:54:31.432954+0000","last_active":"2024-09-19T08:54:53.330825+0000","last_peered":"2024-09-19T08:54:53.330825+0000","last_clean":"2024-09-19T08:54:53.330825+0000","last_became_active":"2024-09-19T08:54:31.432574+0000","last_became_peered":"2024-09-19T08:54:31.432574+0000","last_unstale":"2024-09-19T08:54:53.330825+0000","last_undegraded":"2024-09-19T08:54:53.330825+0000","last_fullsized":"2024-09-19T08:54:53.330825+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:30.457191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327933+0000","last_change":"2024-09-19T08:54:31.435544+0000","last_active":"2024-09-19T08:54:53.327933+0000","last_peered":"2024-09-19T08:54:53.327933+0000","last_clean":"2024-09-19T08:54:53.327933+0000","last_became_active":"2024-09-19T08:54:31.435195+0000","last_became_peered":"2024-09-19T08:54:31.435195+0000","last_unstale":"2024-09-19T08:54:53.327933+0000","last_undegraded":"2024-09-19T08:54:53.327933+0000","last_fullsized":"2024-09-19T08:54:53.327933+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:54.240654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327032+0000","last_change":"2024-09-19T08:54:31.428403+0000","last_active":"2024-09-19T08:54:53.327032+0000","last_peered":"2024-09-19T08:54:53.327032+0000","last_clean":"2024-09-19T08:54:53.327032+0000","last_became_active":"2024-09-19T08:54:31.428110+0000","last_became_peered":"2024-09-19T08:54:31.428110+0000","last_unstale":"2024-09-19T08:54:53.327032+0000","last_undegraded":"2024-09-19T08:54:53.327032+0000","last_fullsized":"2024-09-19T08:54:53.327032+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:05.593073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330562+0000","last_change":"2024-09-19T08:54:31.427291+0000","last_active":"2024-09-19T08:54:53.330562+0000","last_peered":"2024-09-19T08:54:53.330562+0000","last_clean":"2024-09-19T08:54:53.330562+0000","last_became_active":"2024-09-19T08:54:31.427011+0000","last_became_peered":"2024-09-19T08:54:31.427011+0000","last_unstale":"2024-09-19T08:54:53.330562+0000","last_undegraded":"2024-09-19T08:54:53.330562+0000","last_fullsized":"2024-09-19T08:54:53.330562+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:54.338526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329794+0000","last_change":"2024-09-19T08:54:31.429309+0000","last_active":"2024-09-19T08:54:53.329794+0000","last_peered":"2024-09-19T08:54:53.329794+0000","last_clean":"2024-09-19T08:54:53.329794+0000","last_became_active":"2024-09-19T08:54:31.428381+0000","last_became_peered":"2024-09-19T08:54:31.428381+0000","last_unstale":"2024-09-19T08:54:53.329794+0000","last_undegraded":"2024-09-19T08:54:53.329794+0000","last_fullsized":"2024-09-19T08:54:53.329794+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:22:33.920114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.336591+0000","last_change":"2024-09-19T08:54:53.336591+0000","last_active":"2024-09-19T08:54:53.336591+0000","last_peered":"2024-09-19T08:54:53.336591+0000","last_clean":"2024-09-19T08:54:53.336591+0000","last_became_active":"2024-09-19T08:54:53.336222+0000","last_became_peered":"2024-09-19T08:54:53.336222+0000","last_unstale":"2024-09-19T08:54:53.336591+0000","last_undegraded":"2024-09-19T08:54:53.336591+0000","last_fullsized":"2024-09-19T08:54:53.336591+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:59.019419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.335149+0000","last_change":"2024-09-19T08:54:53.335149+0000","last_active":"2024-09-19T08:54:53.335149+0000","last_peered":"2024-09-19T08:54:53.335149+0000","last_clean":"2024-09-19T08:54:53.335149+0000","last_became_active":"2024-09-19T08:54:53.334766+0000","last_became_peered":"2024-09-19T08:54:53.334766+0000","last_unstale":"2024-09-19T08:54:53.335149+0000","last_undegraded":"2024-09-19T08:54:53.335149+0000","last_fullsized":"2024-09-19T08:54:53.335149+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:36.469044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331864+0000","last_change":"2024-09-19T08:54:31.427608+0000","last_active":"2024-09-19T08:54:53.331864+0000","last_peered":"2024-09-19T08:54:53.331864+0000","last_clean":"2024-09-19T08:54:53.331864+0000","last_became_active":"2024-09-19T08:54:31.427294+0000","last_became_peered":"2024-09-19T08:54:31.427294+0000","last_unstale":"2024-09-19T08:54:53.331864+0000","last_undegraded":"2024-09-19T08:54:53.331864+0000","last_fullsized":"2024-09-19T08:54:53.331864+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:41.356609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331158+0000","last_change":"2024-09-19T08:54:29.416204+0000","last_active":"2024-09-19T08:54:53.331158+0000","last_peered":"2024-09-19T08:54:53.331158+0000","last_clean":"2024-09-19T08:54:53.331158+0000","last_became_active":"2024-09-19T08:54:29.415872+0000","last_became_peered":"2024-09-19T08:54:29.415872+0000","last_unstale":"2024-09-19T08:54:53.331158+0000","last_undegraded":"2024-09-19T08:54:53.331158+0000","last_fullsized":"2024-09-19T08:54:53.331158+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:13.844147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331049+0000","last_change":"2024-09-19T08:54:31.432137+0000","last_active":"2024-09-19T08:54:53.331049+0000","last_peered":"2024-09-19T08:54:53.331049+0000","last_clean":"2024-09-19T08:54:53.331049+0000","last_became_active":"2024-09-19T08:54:31.431761+0000","last_became_peered":"2024-09-19T08:54:31.431761+0000","last_unstale":"2024-09-19T08:54:53.331049+0000","last_undegraded":"2024-09-19T08:54:53.331049+0000","last_fullsized":"2024-09-19T08:54:53.331049+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:05.008431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327676+0000","last_change":"2024-09-19T08:54:29.413221+0000","last_active":"2024-09-19T08:54:53.327676+0000","last_peered":"2024-09-19T08:54:53.327676+0000","last_clean":"2024-09-19T08:54:53.327676+0000","last_became_active":"2024-09-19T08:54:29.412829+0000","last_became_peered":"2024-09-19T08:54:29.412829+0000","last_unstale":"2024-09-19T08:54:53.327676+0000","last_undegraded":"2024-09-19T08:54:53.327676+0000","last_fullsized":"2024-09-19T08:54:53.327676+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:07.224136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.326805+0000","last_change":"2024-09-19T08:54:29.410221+0000","last_active":"2024-09-19T08:54:53.326805+0000","last_peered":"2024-09-19T08:54:53.326805+0000","last_clean":"2024-09-19T08:54:53.326805+0000","last_became_active":"2024-09-19T08:54:29.409951+0000","last_became_peered":"2024-09-19T08:54:29.409951+0000","last_unstale":"2024-09-19T08:54:53.326805+0000","last_undegraded":"2024-09-19T08:54:53.326805+0000","last_fullsized":"2024-09-19T08:54:53.326805+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:58.350932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.328917+0000","last_change":"2024-09-19T08:54:31.429979+0000","last_active":"2024-09-19T08:54:53.328917+0000","last_peered":"2024-09-19T08:54:53.328917+0000","last_clean":"2024-09-19T08:54:53.328917+0000","last_became_active":"2024-09-19T08:54:31.429661+0000","last_became_peered":"2024-09-19T08:54:31.429661+0000","last_unstale":"2024-09-19T08:54:53.328917+0000","last_undegraded":"2024-09-19T08:54:53.328917+0000","last_fullsized":"2024-09-19T08:54:53.328917+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:27:40.603490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331299+0000","last_change":"2024-09-19T08:54:29.415769+0000","last_active":"2024-09-19T08:54:53.331299+0000","last_peered":"2024-09-19T08:54:53.331299+0000","last_clean":"2024-09-19T08:54:53.331299+0000","last_became_active":"2024-09-19T08:54:29.415245+0000","last_became_peered":"2024-09-19T08:54:29.415245+0000","last_unstale":"2024-09-19T08:54:53.331299+0000","last_undegraded":"2024-09-19T08:54:53.331299+0000","last_fullsized":"2024-09-19T08:54:53.331299+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:15.487945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330132+0000","last_change":"2024-09-19T08:54:31.427126+0000","last_active":"2024-09-19T08:54:53.330132+0000","last_peered":"2024-09-19T08:54:53.330132+0000","last_clean":"2024-09-19T08:54:53.330132+0000","last_became_active":"2024-09-19T08:54:31.426816+0000","last_became_peered":"2024-09-19T08:54:31.426816+0000","last_unstale":"2024-09-19T08:54:53.330132+0000","last_undegraded":"2024-09-19T08:54:53.330132+0000","last_fullsized":"2024-09-19T08:54:53.330132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:38.039428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327848+0000","last_change":"2024-09-19T08:54:29.411354+0000","last_active":"2024-09-19T08:54:53.327848+0000","last_peered":"2024-09-19T08:54:53.327848+0000","last_clean":"2024-09-19T08:54:53.327848+0000","last_became_active":"2024-09-19T08:54:29.410990+0000","last_became_peered":"2024-09-19T08:54:29.410990+0000","last_unstale":"2024-09-19T08:54:53.327848+0000","last_undegraded":"2024-09-19T08:54:53.327848+0000","last_fullsized":"2024-09-19T08:54:53.327848+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:29.338169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330234+0000","last_change":"2024-09-19T08:54:31.426243+0000","last_active":"2024-09-19T08:54:53.330234+0000","last_peered":"2024-09-19T08:54:53.330234+0000","last_clean":"2024-09-19T08:54:53.330234+0000","last_became_active":"2024-09-19T08:54:31.425895+0000","last_became_peered":"2024-09-19T08:54:31.425895+0000","last_unstale":"2024-09-19T08:54:53.330234+0000","last_undegraded":"2024-09-19T08:54:53.330234+0000","last_fullsized":"2024-09-19T08:54:53.330234+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:13.562780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331102+0000","last_change":"2024-09-19T08:54:29.416646+0000","last_active":"2024-09-19T08:54:53.331102+0000","last_peered":"2024-09-19T08:54:53.331102+0000","last_clean":"2024-09-19T08:54:53.331102+0000","last_became_active":"2024-09-19T08:54:29.416260+0000","last_became_peered":"2024-09-19T08:54:29.416260+0000","last_unstale":"2024-09-19T08:54:53.331102+0000","last_undegraded":"2024-09-19T08:54:53.331102+0000","last_fullsized":"2024-09-19T08:54:53.331102+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:42:17.467035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331394+0000","last_change":"2024-09-19T08:54:31.435538+0000","last_active":"2024-09-19T08:54:53.331394+0000","last_peered":"2024-09-19T08:54:53.331394+0000","last_clean":"2024-09-19T08:54:53.331394+0000","last_became_active":"2024-09-19T08:54:31.435185+0000","last_became_peered":"2024-09-19T08:54:31.435185+0000","last_unstale":"2024-09-19T08:54:53.331394+0000","last_undegraded":"2024-09-19T08:54:53.331394+0000","last_fullsized":"2024-09-19T08:54:53.331394+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:06.940123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.332501+0000","last_change":"2024-09-19T08:54:29.675914+0000","last_active":"2024-09-19T08:54:53.332501+0000","last_peered":"2024-09-19T08:54:53.332501+0000","last_clean":"2024-09-19T08:54:53.332501+0000","last_became_active":"2024-09-19T08:54:29.675482+0000","last_became_peered":"2024-09-19T08:54:29.675482+0000","last_unstale":"2024-09-19T08:54:53.332501+0000","last_undegraded":"2024-09-19T08:54:53.332501+0000","last_fullsized":"2024-09-19T08:54:53.332501+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:58.893008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330567+0000","last_change":"2024-09-19T08:54:31.432628+0000","last_active":"2024-09-19T08:54:53.330567+0000","last_peered":"2024-09-19T08:54:53.330567+0000","last_clean":"2024-09-19T08:54:53.330567+0000","last_became_active":"2024-09-19T08:54:31.430640+0000","last_became_peered":"2024-09-19T08:54:31.430640+0000","last_unstale":"2024-09-19T08:54:53.330567+0000","last_undegraded":"2024-09-19T08:54:53.330567+0000","last_fullsized":"2024-09-19T08:54:53.330567+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:07.793089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'25","reported_seq":171,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:36.583592+0000","last_change":"2024-09-19T08:54:29.414619+0000","last_active":"2024-09-19T08:55:36.583592+0000","last_peered":"2024-09-19T08:55:36.583592+0000","last_clean":"2024-09-19T08:55:36.583592+0000","last_became_active":"2024-09-19T08:54:29.414295+0000","last_became_peered":"2024-09-19T08:54:29.414295+0000","last_unstale":"2024-09-19T08:55:36.583592+0000","last_undegraded":"2024-09-19T08:55:36.583592+0000","last_fullsized":"2024-09-19T08:55:36.583592+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:23.782684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61199,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":124,"num_read_kb":121,"num_write":25,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331211+0000","last_change":"2024-09-19T08:54:31.425432+0000","last_active":"2024-09-19T08:54:53.331211+0000","last_peered":"2024-09-19T08:54:53.331211+0000","last_clean":"2024-09-19T08:54:53.331211+0000","last_became_active":"2024-09-19T08:54:31.425086+0000","last_became_peered":"2024-09-19T08:54:31.425086+0000","last_unstale":"2024-09-19T08:54:53.331211+0000","last_undegraded":"2024-09-19T08:54:53.331211+0000","last_fullsized":"2024-09-19T08:54:53.331211+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:56.572339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330371+0000","last_change":"2024-09-19T08:54:29.415055+0000","last_active":"2024-09-19T08:54:53.330371+0000","last_peered":"2024-09-19T08:54:53.330371+0000","last_clean":"2024-09-19T08:54:53.330371+0000","last_became_active":"2024-09-19T08:54:29.414573+0000","last_became_peered":"2024-09-19T08:54:29.414573+0000","last_unstale":"2024-09-19T08:54:53.330371+0000","last_undegraded":"2024-09-19T08:54:53.330371+0000","last_fullsized":"2024-09-19T08:54:53.330371+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:13.013714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.326883+0000","last_change":"2024-09-19T08:54:31.436905+0000","last_active":"2024-09-19T08:54:53.326883+0000","last_peered":"2024-09-19T08:54:53.326883+0000","last_clean":"2024-09-19T08:54:53.326883+0000","last_became_active":"2024-09-19T08:54:31.436571+0000","last_became_peered":"2024-09-19T08:54:31.436571+0000","last_unstale":"2024-09-19T08:54:53.326883+0000","last_undegraded":"2024-09-19T08:54:53.326883+0000","last_fullsized":"2024-09-19T08:54:53.326883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:55.294255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330834+0000","last_change":"2024-09-19T08:54:29.417958+0000","last_active":"2024-09-19T08:54:53.330834+0000","last_peered":"2024-09-19T08:54:53.330834+0000","last_clean":"2024-09-19T08:54:53.330834+0000","last_became_active":"2024-09-19T08:54:29.417570+0000","last_became_peered":"2024-09-19T08:54:29.417570+0000","last_unstale":"2024-09-19T08:54:53.330834+0000","last_undegraded":"2024-09-19T08:54:53.330834+0000","last_fullsized":"2024-09-19T08:54:53.330834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:25.557217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331274+0000","last_change":"2024-09-19T08:54:31.433019+0000","last_active":"2024-09-19T08:54:53.331274+0000","last_peered":"2024-09-19T08:54:53.331274+0000","last_clean":"2024-09-19T08:54:53.331274+0000","last_became_active":"2024-09-19T08:54:31.431265+0000","last_became_peered":"2024-09-19T08:54:31.431265+0000","last_unstale":"2024-09-19T08:54:53.331274+0000","last_undegraded":"2024-09-19T08:54:53.331274+0000","last_fullsized":"2024-09-19T08:54:53.331274+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:36.481863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.979100+0000","last_change":"2024-09-19T08:54:29.414236+0000","last_active":"2024-09-19T08:54:53.979100+0000","last_peered":"2024-09-19T08:54:53.979100+0000","last_clean":"2024-09-19T08:54:53.979100+0000","last_became_active":"2024-09-19T08:54:29.413878+0000","last_became_peered":"2024-09-19T08:54:29.413878+0000","last_unstale":"2024-09-19T08:54:53.979100+0000","last_undegraded":"2024-09-19T08:54:53.979100+0000","last_fullsized":"2024-09-19T08:54:53.979100+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:11.222362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330480+0000","last_change":"2024-09-19T08:54:31.439512+0000","last_active":"2024-09-19T08:54:53.330480+0000","last_peered":"2024-09-19T08:54:53.330480+0000","last_clean":"2024-09-19T08:54:53.330480+0000","last_became_active":"2024-09-19T08:54:31.438767+0000","last_became_peered":"2024-09-19T08:54:31.438767+0000","last_unstale":"2024-09-19T08:54:53.330480+0000","last_undegraded":"2024-09-19T08:54:53.330480+0000","last_fullsized":"2024-09-19T08:54:53.330480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:31.784577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330687+0000","last_change":"2024-09-19T08:54:29.675768+0000","last_active":"2024-09-19T08:54:53.330687+0000","last_peered":"2024-09-19T08:54:53.330687+0000","last_clean":"2024-09-19T08:54:53.330687+0000","last_became_active":"2024-09-19T08:54:29.675376+0000","last_became_peered":"2024-09-19T08:54:29.675376+0000","last_unstale":"2024-09-19T08:54:53.330687+0000","last_undegraded":"2024-09-19T08:54:53.330687+0000","last_fullsized":"2024-09-19T08:54:53.330687+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:10.281126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331714+0000","last_change":"2024-09-19T08:54:31.435904+0000","last_active":"2024-09-19T08:54:53.331714+0000","last_peered":"2024-09-19T08:54:53.331714+0000","last_clean":"2024-09-19T08:54:53.331714+0000","last_became_active":"2024-09-19T08:54:31.435396+0000","last_became_peered":"2024-09-19T08:54:31.435396+0000","last_unstale":"2024-09-19T08:54:53.331714+0000","last_undegraded":"2024-09-19T08:54:53.331714+0000","last_fullsized":"2024-09-19T08:54:53.331714+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:41.567463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331746+0000","last_change":"2024-09-19T08:54:29.410221+0000","last_active":"2024-09-19T08:54:53.331746+0000","last_peered":"2024-09-19T08:54:53.331746+0000","last_clean":"2024-09-19T08:54:53.331746+0000","last_became_active":"2024-09-19T08:54:29.409856+0000","last_became_peered":"2024-09-19T08:54:29.409856+0000","last_unstale":"2024-09-19T08:54:53.331746+0000","last_undegraded":"2024-09-19T08:54:53.331746+0000","last_fullsized":"2024-09-19T08:54:53.331746+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:46.095816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327914+0000","last_change":"2024-09-19T08:54:31.437854+0000","last_active":"2024-09-19T08:54:53.327914+0000","last_peered":"2024-09-19T08:54:53.327914+0000","last_clean":"2024-09-19T08:54:53.327914+0000","last_became_active":"2024-09-19T08:54:31.437491+0000","last_became_peered":"2024-09-19T08:54:31.437491+0000","last_unstale":"2024-09-19T08:54:53.327914+0000","last_undegraded":"2024-09-19T08:54:53.327914+0000","last_fullsized":"2024-09-19T08:54:53.327914+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:22.532429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.983440+0000","last_change":"2024-09-19T08:54:53.983440+0000","last_active":"2024-09-19T08:54:53.983440+0000","last_peered":"2024-09-19T08:54:53.983440+0000","last_clean":"2024-09-19T08:54:53.983440+0000","last_became_active":"2024-09-19T08:54:53.980971+0000","last_became_peered":"2024-09-19T08:54:53.980971+0000","last_unstale":"2024-09-19T08:54:53.983440+0000","last_undegraded":"2024-09-19T08:54:53.983440+0000","last_fullsized":"2024-09-19T08:54:53.983440+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:33.070904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330480+0000","last_change":"2024-09-19T08:54:31.429376+0000","last_active":"2024-09-19T08:54:53.330480+0000","last_peered":"2024-09-19T08:54:53.330480+0000","last_clean":"2024-09-19T08:54:53.330480+0000","last_became_active":"2024-09-19T08:54:31.429006+0000","last_became_peered":"2024-09-19T08:54:31.429006+0000","last_unstale":"2024-09-19T08:54:53.330480+0000","last_undegraded":"2024-09-19T08:54:53.330480+0000","last_fullsized":"2024-09-19T08:54:53.330480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:26.399838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.332608+0000","last_change":"2024-09-19T08:54:29.414307+0000","last_active":"2024-09-19T08:54:53.332608+0000","last_peered":"2024-09-19T08:54:53.332608+0000","last_clean":"2024-09-19T08:54:53.332608+0000","last_became_active":"2024-09-19T08:54:29.413823+0000","last_became_peered":"2024-09-19T08:54:29.413823+0000","last_unstale":"2024-09-19T08:54:53.332608+0000","last_undegraded":"2024-09-19T08:54:53.332608+0000","last_fullsized":"2024-09-19T08:54:53.332608+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:25.484645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330751+0000","last_change":"2024-09-19T08:54:31.437789+0000","last_active":"2024-09-19T08:54:53.330751+0000","last_peered":"2024-09-19T08:54:53.330751+0000","last_clean":"2024-09-19T08:54:53.330751+0000","last_became_active":"2024-09-19T08:54:31.435488+0000","last_became_peered":"2024-09-19T08:54:31.435488+0000","last_unstale":"2024-09-19T08:54:53.330751+0000","last_undegraded":"2024-09-19T08:54:53.330751+0000","last_fullsized":"2024-09-19T08:54:53.330751+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:19.332440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.333662+0000","last_change":"2024-09-19T08:54:53.333120+0000","last_active":"2024-09-19T08:54:53.333662+0000","last_peered":"2024-09-19T08:54:53.333662+0000","last_clean":"2024-09-19T08:54:53.333662+0000","last_became_active":"2024-09-19T08:54:53.332711+0000","last_became_peered":"2024-09-19T08:54:53.332711+0000","last_unstale":"2024-09-19T08:54:53.333662+0000","last_undegraded":"2024-09-19T08:54:53.333662+0000","last_fullsized":"2024-09-19T08:54:53.333662+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:18.359002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331140+0000","last_change":"2024-09-19T08:54:31.434564+0000","last_active":"2024-09-19T08:54:53.331140+0000","last_peered":"2024-09-19T08:54:53.331140+0000","last_clean":"2024-09-19T08:54:53.331140+0000","last_became_active":"2024-09-19T08:54:31.434231+0000","last_became_peered":"2024-09-19T08:54:31.434231+0000","last_unstale":"2024-09-19T08:54:53.331140+0000","last_undegraded":"2024-09-19T08:54:53.331140+0000","last_fullsized":"2024-09-19T08:54:53.331140+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:31.316400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":334,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331076+0000","last_change":"2024-09-19T08:53:21.357560+0000","last_active":"2024-09-19T08:54:53.331076+0000","last_peered":"2024-09-19T08:54:53.331076+0000","last_clean":"2024-09-19T08:54:53.331076+0000","last_became_active":"2024-09-19T08:53:21.357122+0000","last_became_peered":"2024-09-19T08:53:21.357122+0000","last_unstale":"2024-09-19T08:54:53.331076+0000","last_undegraded":"2024-09-19T08:54:53.331076+0000","last_fullsized":"2024-09-19T08:54:53.331076+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:05.231370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:05.231370+0000","last_clean_scrub_stamp":"2024-09-19T08:50:05.231370+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:47.867682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.979104+0000","last_change":"2024-09-19T08:54:29.412240+0000","last_active":"2024-09-19T08:54:53.979104+0000","last_peered":"2024-09-19T08:54:53.979104+0000","last_clean":"2024-09-19T08:54:53.979104+0000","last_became_active":"2024-09-19T08:54:29.411908+0000","last_became_peered":"2024-09-19T08:54:29.411908+0000","last_unstale":"2024-09-19T08:54:53.979104+0000","last_undegraded":"2024-09-19T08:54:53.979104+0000","last_fullsized":"2024-09-19T08:54:53.979104+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:37.189373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331122+0000","last_change":"2024-09-19T08:54:31.432956+0000","last_active":"2024-09-19T08:54:53.331122+0000","last_peered":"2024-09-19T08:54:53.331122+0000","last_clean":"2024-09-19T08:54:53.331122+0000","last_became_active":"2024-09-19T08:54:31.432639+0000","last_became_peered":"2024-09-19T08:54:31.432639+0000","last_unstale":"2024-09-19T08:54:53.331122+0000","last_undegraded":"2024-09-19T08:54:53.331122+0000","last_fullsized":"2024-09-19T08:54:53.331122+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:58.302624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331178+0000","last_change":"2024-09-19T08:54:29.414214+0000","last_active":"2024-09-19T08:54:53.331178+0000","last_peered":"2024-09-19T08:54:53.331178+0000","last_clean":"2024-09-19T08:54:53.331178+0000","last_became_active":"2024-09-19T08:54:29.413853+0000","last_became_peered":"2024-09-19T08:54:29.413853+0000","last_unstale":"2024-09-19T08:54:53.331178+0000","last_undegraded":"2024-09-19T08:54:53.331178+0000","last_fullsized":"2024-09-19T08:54:53.331178+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:28:29.119856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.326797+0000","last_change":"2024-09-19T08:54:31.424643+0000","last_active":"2024-09-19T08:54:53.326797+0000","last_peered":"2024-09-19T08:54:53.326797+0000","last_clean":"2024-09-19T08:54:53.326797+0000","last_became_active":"2024-09-19T08:54:31.424363+0000","last_became_peered":"2024-09-19T08:54:31.424363+0000","last_unstale":"2024-09-19T08:54:53.326797+0000","last_undegraded":"2024-09-19T08:54:53.326797+0000","last_fullsized":"2024-09-19T08:54:53.326797+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:37.529952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.326916+0000","last_change":"2024-09-19T08:54:29.675742+0000","last_active":"2024-09-19T08:54:53.326916+0000","last_peered":"2024-09-19T08:54:53.326916+0000","last_clean":"2024-09-19T08:54:53.326916+0000","last_became_active":"2024-09-19T08:54:29.675347+0000","last_became_peered":"2024-09-19T08:54:29.675347+0000","last_unstale":"2024-09-19T08:54:53.326916+0000","last_undegraded":"2024-09-19T08:54:53.326916+0000","last_fullsized":"2024-09-19T08:54:53.326916+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:00.925390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331104+0000","last_change":"2024-09-19T08:54:31.433887+0000","last_active":"2024-09-19T08:54:53.331104+0000","last_peered":"2024-09-19T08:54:53.331104+0000","last_clean":"2024-09-19T08:54:53.331104+0000","last_became_active":"2024-09-19T08:54:31.433331+0000","last_became_peered":"2024-09-19T08:54:31.433331+0000","last_unstale":"2024-09-19T08:54:53.331104+0000","last_undegraded":"2024-09-19T08:54:53.331104+0000","last_fullsized":"2024-09-19T08:54:53.331104+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:49.875061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331491+0000","last_change":"2024-09-19T08:54:29.417410+0000","last_active":"2024-09-19T08:54:53.331491+0000","last_peered":"2024-09-19T08:54:53.331491+0000","last_clean":"2024-09-19T08:54:53.331491+0000","last_became_active":"2024-09-19T08:54:29.417018+0000","last_became_peered":"2024-09-19T08:54:29.417018+0000","last_unstale":"2024-09-19T08:54:53.331491+0000","last_undegraded":"2024-09-19T08:54:53.331491+0000","last_fullsized":"2024-09-19T08:54:53.331491+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:53.669027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327692+0000","last_change":"2024-09-19T08:54:31.431313+0000","last_active":"2024-09-19T08:54:53.327692+0000","last_peered":"2024-09-19T08:54:53.327692+0000","last_clean":"2024-09-19T08:54:53.327692+0000","last_became_active":"2024-09-19T08:54:31.429427+0000","last_became_peered":"2024-09-19T08:54:31.429427+0000","last_unstale":"2024-09-19T08:54:53.327692+0000","last_undegraded":"2024-09-19T08:54:53.327692+0000","last_fullsized":"2024-09-19T08:54:53.327692+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:55.106769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330517+0000","last_change":"2024-09-19T08:54:29.675722+0000","last_active":"2024-09-19T08:54:53.330517+0000","last_peered":"2024-09-19T08:54:53.330517+0000","last_clean":"2024-09-19T08:54:53.330517+0000","last_became_active":"2024-09-19T08:54:29.675397+0000","last_became_peered":"2024-09-19T08:54:29.675397+0000","last_unstale":"2024-09-19T08:54:53.330517+0000","last_undegraded":"2024-09-19T08:54:53.330517+0000","last_fullsized":"2024-09-19T08:54:53.330517+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:49.574947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327665+0000","last_change":"2024-09-19T08:54:31.431106+0000","last_active":"2024-09-19T08:54:53.327665+0000","last_peered":"2024-09-19T08:54:53.327665+0000","last_clean":"2024-09-19T08:54:53.327665+0000","last_became_active":"2024-09-19T08:54:31.430745+0000","last_became_peered":"2024-09-19T08:54:31.430745+0000","last_unstale":"2024-09-19T08:54:53.327665+0000","last_undegraded":"2024-09-19T08:54:53.327665+0000","last_fullsized":"2024-09-19T08:54:53.327665+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:22.714106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331431+0000","last_change":"2024-09-19T08:54:29.675985+0000","last_active":"2024-09-19T08:54:53.331431+0000","last_peered":"2024-09-19T08:54:53.331431+0000","last_clean":"2024-09-19T08:54:53.331431+0000","last_became_active":"2024-09-19T08:54:29.675374+0000","last_became_peered":"2024-09-19T08:54:29.675374+0000","last_unstale":"2024-09-19T08:54:53.331431+0000","last_undegraded":"2024-09-19T08:54:53.331431+0000","last_fullsized":"2024-09-19T08:54:53.331431+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:06.664621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327052+0000","last_change":"2024-09-19T08:54:31.423493+0000","last_active":"2024-09-19T08:54:53.327052+0000","last_peered":"2024-09-19T08:54:53.327052+0000","last_clean":"2024-09-19T08:54:53.327052+0000","last_became_active":"2024-09-19T08:54:31.422651+0000","last_became_peered":"2024-09-19T08:54:31.422651+0000","last_unstale":"2024-09-19T08:54:53.327052+0000","last_undegraded":"2024-09-19T08:54:53.327052+0000","last_fullsized":"2024-09-19T08:54:53.327052+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:51.863965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.435498+0000","last_change":"2024-09-19T08:54:29.408571+0000","last_active":"2024-09-19T08:54:53.435498+0000","last_peered":"2024-09-19T08:54:53.435498+0000","last_clean":"2024-09-19T08:54:53.435498+0000","last_became_active":"2024-09-19T08:54:29.408142+0000","last_became_peered":"2024-09-19T08:54:29.408142+0000","last_unstale":"2024-09-19T08:54:53.435498+0000","last_undegraded":"2024-09-19T08:54:53.435498+0000","last_fullsized":"2024-09-19T08:54:53.435498+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:34.578230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329321+0000","last_change":"2024-09-19T08:54:31.435333+0000","last_active":"2024-09-19T08:54:53.329321+0000","last_peered":"2024-09-19T08:54:53.329321+0000","last_clean":"2024-09-19T08:54:53.329321+0000","last_became_active":"2024-09-19T08:54:31.435041+0000","last_became_peered":"2024-09-19T08:54:31.435041+0000","last_unstale":"2024-09-19T08:54:53.329321+0000","last_undegraded":"2024-09-19T08:54:53.329321+0000","last_fullsized":"2024-09-19T08:54:53.329321+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:40.972638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.979153+0000","last_change":"2024-09-19T08:54:29.554303+0000","last_active":"2024-09-19T08:54:53.979153+0000","last_peered":"2024-09-19T08:54:53.979153+0000","last_clean":"2024-09-19T08:54:53.979153+0000","last_became_active":"2024-09-19T08:54:29.553919+0000","last_became_peered":"2024-09-19T08:54:29.553919+0000","last_unstale":"2024-09-19T08:54:53.979153+0000","last_undegraded":"2024-09-19T08:54:53.979153+0000","last_fullsized":"2024-09-19T08:54:53.979153+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:25.103926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.333280+0000","last_change":"2024-09-19T08:54:53.333280+0000","last_active":"2024-09-19T08:54:53.333280+0000","last_peered":"2024-09-19T08:54:53.333280+0000","last_clean":"2024-09-19T08:54:53.333280+0000","last_became_active":"2024-09-19T08:54:53.332881+0000","last_became_peered":"2024-09-19T08:54:53.332881+0000","last_unstale":"2024-09-19T08:54:53.333280+0000","last_undegraded":"2024-09-19T08:54:53.333280+0000","last_fullsized":"2024-09-19T08:54:53.333280+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:55.880616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329946+0000","last_change":"2024-09-19T08:54:29.675665+0000","last_active":"2024-09-19T08:54:53.329946+0000","last_peered":"2024-09-19T08:54:53.329946+0000","last_clean":"2024-09-19T08:54:53.329946+0000","last_became_active":"2024-09-19T08:54:29.675367+0000","last_became_peered":"2024-09-19T08:54:29.675367+0000","last_unstale":"2024-09-19T08:54:53.329946+0000","last_undegraded":"2024-09-19T08:54:53.329946+0000","last_fullsized":"2024-09-19T08:54:53.329946+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:35.473243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330857+0000","last_change":"2024-09-19T08:54:31.430837+0000","last_active":"2024-09-19T08:54:53.330857+0000","last_peered":"2024-09-19T08:54:53.330857+0000","last_clean":"2024-09-19T08:54:53.330857+0000","last_became_active":"2024-09-19T08:54:31.430465+0000","last_became_peered":"2024-09-19T08:54:31.430465+0000","last_unstale":"2024-09-19T08:54:53.330857+0000","last_undegraded":"2024-09-19T08:54:53.330857+0000","last_fullsized":"2024-09-19T08:54:53.330857+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:50.524730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329067+0000","last_change":"2024-09-19T08:54:29.413803+0000","last_active":"2024-09-19T08:54:53.329067+0000","last_peered":"2024-09-19T08:54:53.329067+0000","last_clean":"2024-09-19T08:54:53.329067+0000","last_became_active":"2024-09-19T08:54:29.413400+0000","last_became_peered":"2024-09-19T08:54:29.413400+0000","last_unstale":"2024-09-19T08:54:53.329067+0000","last_undegraded":"2024-09-19T08:54:53.329067+0000","last_fullsized":"2024-09-19T08:54:53.329067+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:12.518454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327694+0000","last_change":"2024-09-19T08:54:31.428451+0000","last_active":"2024-09-19T08:54:53.327694+0000","last_peered":"2024-09-19T08:54:53.327694+0000","last_clean":"2024-09-19T08:54:53.327694+0000","last_became_active":"2024-09-19T08:54:31.428134+0000","last_became_peered":"2024-09-19T08:54:31.428134+0000","last_unstale":"2024-09-19T08:54:53.327694+0000","last_undegraded":"2024-09-19T08:54:53.327694+0000","last_fullsized":"2024-09-19T08:54:53.327694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:08.260183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329914+0000","last_change":"2024-09-19T08:54:29.414399+0000","last_active":"2024-09-19T08:54:53.329914+0000","last_peered":"2024-09-19T08:54:53.329914+0000","last_clean":"2024-09-19T08:54:53.329914+0000","last_became_active":"2024-09-19T08:54:29.413080+0000","last_became_peered":"2024-09-19T08:54:29.413080+0000","last_unstale":"2024-09-19T08:54:53.329914+0000","last_undegraded":"2024-09-19T08:54:53.329914+0000","last_fullsized":"2024-09-19T08:54:53.329914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:27.308297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329046+0000","last_change":"2024-09-19T08:54:31.434550+0000","last_active":"2024-09-19T08:54:53.329046+0000","last_peered":"2024-09-19T08:54:53.329046+0000","last_clean":"2024-09-19T08:54:53.329046+0000","last_became_active":"2024-09-19T08:54:31.434195+0000","last_became_peered":"2024-09-19T08:54:31.434195+0000","last_unstale":"2024-09-19T08:54:53.329046+0000","last_undegraded":"2024-09-19T08:54:53.329046+0000","last_fullsized":"2024-09-19T08:54:53.329046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:04.807833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.338857+0000","last_change":"2024-09-19T08:54:53.338857+0000","last_active":"2024-09-19T08:54:53.338857+0000","last_peered":"2024-09-19T08:54:53.338857+0000","last_clean":"2024-09-19T08:54:53.338857+0000","last_became_active":"2024-09-19T08:54:53.334162+0000","last_became_peered":"2024-09-19T08:54:53.334162+0000","last_unstale":"2024-09-19T08:54:53.338857+0000","last_undegraded":"2024-09-19T08:54:53.338857+0000","last_fullsized":"2024-09-19T08:54:53.338857+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:38.858918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331391+0000","last_change":"2024-09-19T08:54:31.441201+0000","last_active":"2024-09-19T08:54:53.331391+0000","last_peered":"2024-09-19T08:54:53.331391+0000","last_clean":"2024-09-19T08:54:53.331391+0000","last_became_active":"2024-09-19T08:54:31.440738+0000","last_became_peered":"2024-09-19T08:54:31.440738+0000","last_unstale":"2024-09-19T08:54:53.331391+0000","last_undegraded":"2024-09-19T08:54:53.331391+0000","last_fullsized":"2024-09-19T08:54:53.331391+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:39.118320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.332389+0000","last_change":"2024-09-19T08:54:31.435772+0000","last_active":"2024-09-19T08:54:53.332389+0000","last_peered":"2024-09-19T08:54:53.332389+0000","last_clean":"2024-09-19T08:54:53.332389+0000","last_became_active":"2024-09-19T08:54:31.435257+0000","last_became_peered":"2024-09-19T08:54:31.435257+0000","last_unstale":"2024-09-19T08:54:53.332389+0000","last_undegraded":"2024-09-19T08:54:53.332389+0000","last_fullsized":"2024-09-19T08:54:53.332389+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:44:12.219054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.341203+0000","last_change":"2024-09-19T08:54:53.341203+0000","last_active":"2024-09-19T08:54:53.341203+0000","last_peered":"2024-09-19T08:54:53.341203+0000","last_clean":"2024-09-19T08:54:53.341203+0000","last_became_active":"2024-09-19T08:54:53.336115+0000","last_became_peered":"2024-09-19T08:54:53.336115+0000","last_unstale":"2024-09-19T08:54:53.341203+0000","last_undegraded":"2024-09-19T08:54:53.341203+0000","last_fullsized":"2024-09-19T08:54:53.341203+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:31.532599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330452+0000","last_change":"2024-09-19T08:54:31.427103+0000","last_active":"2024-09-19T08:54:53.330452+0000","last_peered":"2024-09-19T08:54:53.330452+0000","last_clean":"2024-09-19T08:54:53.330452+0000","last_became_active":"2024-09-19T08:54:31.425958+0000","last_became_peered":"2024-09-19T08:54:31.425958+0000","last_unstale":"2024-09-19T08:54:53.330452+0000","last_undegraded":"2024-09-19T08:54:53.330452+0000","last_fullsized":"2024-09-19T08:54:53.330452+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:36.840940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331317+0000","last_change":"2024-09-19T08:54:29.415209+0000","last_active":"2024-09-19T08:54:53.331317+0000","last_peered":"2024-09-19T08:54:53.331317+0000","last_clean":"2024-09-19T08:54:53.331317+0000","last_became_active":"2024-09-19T08:54:29.414806+0000","last_became_peered":"2024-09-19T08:54:29.414806+0000","last_unstale":"2024-09-19T08:54:53.331317+0000","last_undegraded":"2024-09-19T08:54:53.331317+0000","last_fullsized":"2024-09-19T08:54:53.331317+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:47.764231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331348+0000","last_change":"2024-09-19T08:54:31.434027+0000","last_active":"2024-09-19T08:54:53.331348+0000","last_peered":"2024-09-19T08:54:53.331348+0000","last_clean":"2024-09-19T08:54:53.331348+0000","last_became_active":"2024-09-19T08:54:31.433687+0000","last_became_peered":"2024-09-19T08:54:31.433687+0000","last_unstale":"2024-09-19T08:54:53.331348+0000","last_undegraded":"2024-09-19T08:54:53.331348+0000","last_fullsized":"2024-09-19T08:54:53.331348+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:56.462128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329231+0000","last_change":"2024-09-19T08:54:29.675502+0000","last_active":"2024-09-19T08:54:53.329231+0000","last_peered":"2024-09-19T08:54:53.329231+0000","last_clean":"2024-09-19T08:54:53.329231+0000","last_became_active":"2024-09-19T08:54:29.675158+0000","last_became_peered":"2024-09-19T08:54:29.675158+0000","last_unstale":"2024-09-19T08:54:53.329231+0000","last_undegraded":"2024-09-19T08:54:53.329231+0000","last_fullsized":"2024-09-19T08:54:53.329231+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:24:59.377521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.334600+0000","last_change":"2024-09-19T08:54:53.334264+0000","last_active":"2024-09-19T08:54:53.334600+0000","last_peered":"2024-09-19T08:54:53.334600+0000","last_clean":"2024-09-19T08:54:53.334600+0000","last_became_active":"2024-09-19T08:54:53.333959+0000","last_became_peered":"2024-09-19T08:54:53.333959+0000","last_unstale":"2024-09-19T08:54:53.334600+0000","last_undegraded":"2024-09-19T08:54:53.334600+0000","last_fullsized":"2024-09-19T08:54:53.334600+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:14.085033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330562+0000","last_change":"2024-09-19T08:54:29.414478+0000","last_active":"2024-09-19T08:54:53.330562+0000","last_peered":"2024-09-19T08:54:53.330562+0000","last_clean":"2024-09-19T08:54:53.330562+0000","last_became_active":"2024-09-19T08:54:29.414152+0000","last_became_peered":"2024-09-19T08:54:29.414152+0000","last_unstale":"2024-09-19T08:54:53.330562+0000","last_undegraded":"2024-09-19T08:54:53.330562+0000","last_fullsized":"2024-09-19T08:54:53.330562+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:17.477340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":61997,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":128,"num_read_kb":125,"num_write":80,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":185991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":66,"ondisk_log_size":66,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579931,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":897024,"data_stored":435723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841567,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28564,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716588,"statfs":{"total":95995035648,"available":95965786112,"internally_reserved":0,"allocated":1576960,"data_stored":1087601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005092,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":901120,"data_stored":436305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234024,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":436327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462958,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28496,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716656,"statfs":{"total":95995035648,"available":95965855744,"internally_reserved":0,"allocated":1499136,"data_stored":1026790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593779,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":901120,"data_stored":435840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822712,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32660,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712492,"statfs":{"total":95995035648,"available":95961591808,"internally_reserved":0,"allocated":1507328,"data_stored":1026390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986236,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":901120,"data_stored":435745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215168,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":436061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411398,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":496956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":496922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":901120,"data_stored":435813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":61199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":61233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":61393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:55:40.381 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:55:40.626 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:40.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:40 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:40.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:40 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:55:40.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:40 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:55:40.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:40 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:40.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:40 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:55:40.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:40 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:55:40.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:40 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:40.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:40 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:55:40.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:40 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:55:41.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.098+0000 7f6e79bda640 1 -- 172.21.15.92:0/3419763563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e74103660 msgr2=0x7f6e7410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:41.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.098+0000 7f6e79bda640 1 --2- 172.21.15.92:0/3419763563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e74103660 0x7f6e7410bb50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6e68009900 tx=0x7f6e6802a480 comp rx=0 tx=0).stop 2024-09-19T08:55:41.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.099+0000 7f6e79bda640 1 -- 172.21.15.92:0/3419763563 shutdown_connections 2024-09-19T08:55:41.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.099+0000 7f6e79bda640 1 --2- 172.21.15.92:0/3419763563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e7410c170 0x7f6e7410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:41.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.099+0000 7f6e79bda640 1 --2- 172.21.15.92:0/3419763563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e74103660 0x7f6e7410bb50 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:41.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.099+0000 7f6e79bda640 1 --2- 172.21.15.92:0/3419763563 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e74102d40 0x7f6e74103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:41.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.099+0000 7f6e79bda640 1 -- 172.21.15.92:0/3419763563 >> 172.21.15.92:0/3419763563 conn(0x7f6e740fc7a0 msgr2=0x7f6e740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:41.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.099+0000 7f6e79bda640 1 -- 172.21.15.92:0/3419763563 shutdown_connections 2024-09-19T08:55:41.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.099+0000 7f6e79bda640 1 -- 172.21.15.92:0/3419763563 wait complete. 2024-09-19T08:55:41.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.099+0000 7f6e79bda640 1 Processor -- start 2024-09-19T08:55:41.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.099+0000 7f6e79bda640 1 -- start start 2024-09-19T08:55:41.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.100+0000 7f6e79bda640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e74102d40 0x7f6e741009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:41.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.100+0000 7f6e79bda640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e74103660 0x7f6e74100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:41.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.100+0000 7f6e79bda640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e7410c170 0x7f6e74101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:41.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.100+0000 7f6e79bda640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6e74111fd0 con 0x7f6e74102d40 2024-09-19T08:55:41.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.100+0000 7f6e79bda640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6e74111e50 con 0x7f6e74103660 2024-09-19T08:55:41.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.100+0000 7f6e79bda640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6e74112150 con 0x7f6e7410c170 2024-09-19T08:55:41.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.100+0000 7f6e737fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e74102d40 0x7f6e741009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:41.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.100+0000 7f6e737fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e74102d40 0x7f6e741009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56148/0 (socket says 172.21.15.92:56148) 2024-09-19T08:55:41.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.100+0000 7f6e737fe640 1 -- 172.21.15.92:0/1732175855 learned_addr learned my addr 172.21.15.92:0/1732175855 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:41.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.100+0000 7f6e73fff640 1 --2- 172.21.15.92:0/1732175855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e7410c170 0x7f6e74101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:41.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.100+0000 7f6e72ffd640 1 --2- 172.21.15.92:0/1732175855 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e74103660 0x7f6e74100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:41.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.100+0000 7f6e737fe640 1 -- 172.21.15.92:0/1732175855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e7410c170 msgr2=0x7f6e74101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:41.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.100+0000 7f6e737fe640 1 --2- 172.21.15.92:0/1732175855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e7410c170 0x7f6e74101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:41.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.100+0000 7f6e737fe640 1 -- 172.21.15.92:0/1732175855 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e74103660 msgr2=0x7f6e74100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:41.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.100+0000 7f6e737fe640 1 --2- 172.21.15.92:0/1732175855 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e74103660 0x7f6e74100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:41.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.100+0000 7f6e737fe640 1 -- 172.21.15.92:0/1732175855 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e741a6970 con 0x7f6e74102d40 2024-09-19T08:55:41.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.100+0000 7f6e72ffd640 1 --2- 172.21.15.92:0/1732175855 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e74103660 0x7f6e74100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:55:41.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.100+0000 7f6e737fe640 1 --2- 172.21.15.92:0/1732175855 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e74102d40 0x7f6e741009a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6e6400ea80 tx=0x7f6e6400ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:41.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.100+0000 7f6e70ff9640 1 -- 172.21.15.92:0/1732175855 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e6400ce40 con 0x7f6e74102d40 2024-09-19T08:55:41.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.100+0000 7f6e79bda640 1 -- 172.21.15.92:0/1732175855 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e741a6c60 con 0x7f6e74102d40 2024-09-19T08:55:41.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.100+0000 7f6e70ff9640 1 -- 172.21.15.92:0/1732175855 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e64005020 con 0x7f6e74102d40 2024-09-19T08:55:41.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.100+0000 7f6e70ff9640 1 -- 172.21.15.92:0/1732175855 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e64011760 con 0x7f6e74102d40 2024-09-19T08:55:41.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.101+0000 7f6e79bda640 1 -- 172.21.15.92:0/1732175855 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e741a7150 con 0x7f6e74102d40 2024-09-19T08:55:41.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.101+0000 7f6e79bda640 1 -- 172.21.15.92:0/1732175855 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e74103120 con 0x7f6e74102d40 2024-09-19T08:55:41.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.103+0000 7f6e70ff9640 1 -- 172.21.15.92:0/1732175855 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6e640051d0 con 0x7f6e74102d40 2024-09-19T08:55:41.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.103+0000 7f6e70ff9640 1 --2- 172.21.15.92:0/1732175855 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6e5c0a32d0 0x7f6e5c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:41.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.103+0000 7f6e72ffd640 1 --2- 172.21.15.92:0/1732175855 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6e5c0a32d0 0x7f6e5c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:41.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.103+0000 7f6e70ff9640 1 -- 172.21.15.92:0/1732175855 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f6e640d00e0 con 0x7f6e74102d40 2024-09-19T08:55:41.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.104+0000 7f6e72ffd640 1 --2- 172.21.15.92:0/1732175855 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6e5c0a32d0 0x7f6e5c0a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6e68000c00 tx=0x7f6e68032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:41.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.107+0000 7f6e70ff9640 1 -- 172.21.15.92:0/1732175855 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6e64016030 con 0x7f6e74102d40 2024-09-19T08:55:41.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.269+0000 7f6e79bda640 1 -- 172.21.15.92:0/1732175855 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6e74062630 con 0x7f6e5c0a32d0 2024-09-19T08:55:41.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.275+0000 7f6e70ff9640 1 -- 172.21.15.92:0/1732175855 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258638 (secure 0 0 0) 0x7f6e74062630 con 0x7f6e5c0a32d0 2024-09-19T08:55:41.277 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:55:41.278 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-19T08:55:41.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.278+0000 7f6e79bda640 1 -- 172.21.15.92:0/1732175855 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6e5c0a32d0 msgr2=0x7f6e5c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:41.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.278+0000 7f6e79bda640 1 --2- 172.21.15.92:0/1732175855 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6e5c0a32d0 0x7f6e5c0a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6e68000c00 tx=0x7f6e68032c70 comp rx=0 tx=0).stop 2024-09-19T08:55:41.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.278+0000 7f6e79bda640 1 -- 172.21.15.92:0/1732175855 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e74102d40 msgr2=0x7f6e741009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:41.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.278+0000 7f6e79bda640 1 --2- 172.21.15.92:0/1732175855 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e74102d40 0x7f6e741009a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6e6400ea80 tx=0x7f6e6400ef40 comp rx=0 tx=0).stop 2024-09-19T08:55:41.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.278+0000 7f6e79bda640 1 -- 172.21.15.92:0/1732175855 shutdown_connections 2024-09-19T08:55:41.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.278+0000 7f6e79bda640 1 --2- 172.21.15.92:0/1732175855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6e7410c170 0x7f6e74101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:41.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.278+0000 7f6e79bda640 1 --2- 172.21.15.92:0/1732175855 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e74103660 0x7f6e74100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:41.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.278+0000 7f6e79bda640 1 --2- 172.21.15.92:0/1732175855 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6e5c0a32d0 0x7f6e5c0a5790 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:41.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.278+0000 7f6e79bda640 1 --2- 172.21.15.92:0/1732175855 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e74102d40 0x7f6e741009a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:41.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.278+0000 7f6e79bda640 1 -- 172.21.15.92:0/1732175855 >> 172.21.15.92:0/1732175855 conn(0x7f6e740fc7a0 msgr2=0x7f6e740fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:41.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.278+0000 7f6e79bda640 1 -- 172.21.15.92:0/1732175855 shutdown_connections 2024-09-19T08:55:41.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:41.278+0000 7f6e79bda640 1 -- 172.21.15.92:0/1732175855 wait complete. 2024-09-19T08:55:41.642 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:41 smithi092 ceph-mon[31407]: from='client.14961 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:55:41.642 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:41 smithi092 ceph-mon[31407]: pgmap v306: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:55:41.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:41 smithi167 ceph-mon[35359]: from='client.14961 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:55:41.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:41 smithi167 ceph-mon[35359]: pgmap v306: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:55:41.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:41 smithi190 ceph-mon[35358]: from='client.14961 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:55:41.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:41 smithi190 ceph-mon[35358]: pgmap v306: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:55:41.961 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":306,"stamp":"2024-09-19T08:55:40.271928+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":652599,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":254,"num_read_kb":234,"num_write":263,"num_write_kb":3024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365992,"kb_used_data":12540,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575832,"statfs":{"total":1151940427776,"available":1151565651968,"internally_reserved":0,"allocated":12840960,"data_stored":7186473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002991"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.328272+0000","last_change":"2024-09-19T08:54:31.437743+0000","last_active":"2024-09-19T08:54:53.328272+0000","last_peered":"2024-09-19T08:54:53.328272+0000","last_clean":"2024-09-19T08:54:53.328272+0000","last_became_active":"2024-09-19T08:54:31.437426+0000","last_became_peered":"2024-09-19T08:54:31.437426+0000","last_unstale":"2024-09-19T08:54:53.328272+0000","last_undegraded":"2024-09-19T08:54:53.328272+0000","last_fullsized":"2024-09-19T08:54:53.328272+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:04.403522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330184+0000","last_change":"2024-09-19T08:54:31.430322+0000","last_active":"2024-09-19T08:54:53.330184+0000","last_peered":"2024-09-19T08:54:53.330184+0000","last_clean":"2024-09-19T08:54:53.330184+0000","last_became_active":"2024-09-19T08:54:31.430008+0000","last_became_peered":"2024-09-19T08:54:31.430008+0000","last_unstale":"2024-09-19T08:54:53.330184+0000","last_undegraded":"2024-09-19T08:54:53.330184+0000","last_fullsized":"2024-09-19T08:54:53.330184+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:19.800686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331041+0000","last_change":"2024-09-19T08:54:31.430276+0000","last_active":"2024-09-19T08:54:53.331041+0000","last_peered":"2024-09-19T08:54:53.331041+0000","last_clean":"2024-09-19T08:54:53.331041+0000","last_became_active":"2024-09-19T08:54:31.429939+0000","last_became_peered":"2024-09-19T08:54:31.429939+0000","last_unstale":"2024-09-19T08:54:53.331041+0000","last_undegraded":"2024-09-19T08:54:53.331041+0000","last_fullsized":"2024-09-19T08:54:53.331041+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:08.735067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.980198+0000","last_change":"2024-09-19T08:54:31.435197+0000","last_active":"2024-09-19T08:54:53.980198+0000","last_peered":"2024-09-19T08:54:53.980198+0000","last_clean":"2024-09-19T08:54:53.980198+0000","last_became_active":"2024-09-19T08:54:31.434872+0000","last_became_peered":"2024-09-19T08:54:31.434872+0000","last_unstale":"2024-09-19T08:54:53.980198+0000","last_undegraded":"2024-09-19T08:54:53.980198+0000","last_fullsized":"2024-09-19T08:54:53.980198+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:06.213317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330478+0000","last_change":"2024-09-19T08:54:31.423765+0000","last_active":"2024-09-19T08:54:53.330478+0000","last_peered":"2024-09-19T08:54:53.330478+0000","last_clean":"2024-09-19T08:54:53.330478+0000","last_became_active":"2024-09-19T08:54:31.423296+0000","last_became_peered":"2024-09-19T08:54:31.423296+0000","last_unstale":"2024-09-19T08:54:53.330478+0000","last_undegraded":"2024-09-19T08:54:53.330478+0000","last_fullsized":"2024-09-19T08:54:53.330478+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:07.507168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327935+0000","last_change":"2024-09-19T08:54:31.430299+0000","last_active":"2024-09-19T08:54:53.327935+0000","last_peered":"2024-09-19T08:54:53.327935+0000","last_clean":"2024-09-19T08:54:53.327935+0000","last_became_active":"2024-09-19T08:54:31.429951+0000","last_became_peered":"2024-09-19T08:54:31.429951+0000","last_unstale":"2024-09-19T08:54:53.327935+0000","last_undegraded":"2024-09-19T08:54:53.327935+0000","last_fullsized":"2024-09-19T08:54:53.327935+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:11.299729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330534+0000","last_change":"2024-09-19T08:54:31.435854+0000","last_active":"2024-09-19T08:54:53.330534+0000","last_peered":"2024-09-19T08:54:53.330534+0000","last_clean":"2024-09-19T08:54:53.330534+0000","last_became_active":"2024-09-19T08:54:31.435522+0000","last_became_peered":"2024-09-19T08:54:31.435522+0000","last_unstale":"2024-09-19T08:54:53.330534+0000","last_undegraded":"2024-09-19T08:54:53.330534+0000","last_fullsized":"2024-09-19T08:54:53.330534+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:11.099750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.328883+0000","last_change":"2024-09-19T08:54:31.434574+0000","last_active":"2024-09-19T08:54:53.328883+0000","last_peered":"2024-09-19T08:54:53.328883+0000","last_clean":"2024-09-19T08:54:53.328883+0000","last_became_active":"2024-09-19T08:54:31.434268+0000","last_became_peered":"2024-09-19T08:54:31.434268+0000","last_unstale":"2024-09-19T08:54:53.328883+0000","last_undegraded":"2024-09-19T08:54:53.328883+0000","last_fullsized":"2024-09-19T08:54:53.328883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:29.159417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330517+0000","last_change":"2024-09-19T08:54:31.430446+0000","last_active":"2024-09-19T08:54:53.330517+0000","last_peered":"2024-09-19T08:54:53.330517+0000","last_clean":"2024-09-19T08:54:53.330517+0000","last_became_active":"2024-09-19T08:54:31.430048+0000","last_became_peered":"2024-09-19T08:54:31.430048+0000","last_unstale":"2024-09-19T08:54:53.330517+0000","last_undegraded":"2024-09-19T08:54:53.330517+0000","last_fullsized":"2024-09-19T08:54:53.330517+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:24.773947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.328011+0000","last_change":"2024-09-19T08:54:31.433144+0000","last_active":"2024-09-19T08:54:53.328011+0000","last_peered":"2024-09-19T08:54:53.328011+0000","last_clean":"2024-09-19T08:54:53.328011+0000","last_became_active":"2024-09-19T08:54:31.432590+0000","last_became_peered":"2024-09-19T08:54:31.432590+0000","last_unstale":"2024-09-19T08:54:53.328011+0000","last_undegraded":"2024-09-19T08:54:53.328011+0000","last_fullsized":"2024-09-19T08:54:53.328011+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:53.756846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331069+0000","last_change":"2024-09-19T08:54:31.435712+0000","last_active":"2024-09-19T08:54:53.331069+0000","last_peered":"2024-09-19T08:54:53.331069+0000","last_clean":"2024-09-19T08:54:53.331069+0000","last_became_active":"2024-09-19T08:54:31.435301+0000","last_became_peered":"2024-09-19T08:54:31.435301+0000","last_unstale":"2024-09-19T08:54:53.331069+0000","last_undegraded":"2024-09-19T08:54:53.331069+0000","last_fullsized":"2024-09-19T08:54:53.331069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:51.703709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.333375+0000","last_change":"2024-09-19T08:54:53.332853+0000","last_active":"2024-09-19T08:54:53.333375+0000","last_peered":"2024-09-19T08:54:53.333375+0000","last_clean":"2024-09-19T08:54:53.333375+0000","last_became_active":"2024-09-19T08:54:53.332460+0000","last_became_peered":"2024-09-19T08:54:53.332460+0000","last_unstale":"2024-09-19T08:54:53.333375+0000","last_undegraded":"2024-09-19T08:54:53.333375+0000","last_fullsized":"2024-09-19T08:54:53.333375+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:47:58.025876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327046+0000","last_change":"2024-09-19T08:54:31.425590+0000","last_active":"2024-09-19T08:54:53.327046+0000","last_peered":"2024-09-19T08:54:53.327046+0000","last_clean":"2024-09-19T08:54:53.327046+0000","last_became_active":"2024-09-19T08:54:31.425268+0000","last_became_peered":"2024-09-19T08:54:31.425268+0000","last_unstale":"2024-09-19T08:54:53.327046+0000","last_undegraded":"2024-09-19T08:54:53.327046+0000","last_fullsized":"2024-09-19T08:54:53.327046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:09.404947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330332+0000","last_change":"2024-09-19T08:54:31.428372+0000","last_active":"2024-09-19T08:54:53.330332+0000","last_peered":"2024-09-19T08:54:53.330332+0000","last_clean":"2024-09-19T08:54:53.330332+0000","last_became_active":"2024-09-19T08:54:31.428064+0000","last_became_peered":"2024-09-19T08:54:31.428064+0000","last_unstale":"2024-09-19T08:54:53.330332+0000","last_undegraded":"2024-09-19T08:54:53.330332+0000","last_fullsized":"2024-09-19T08:54:53.330332+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:40.444117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330115+0000","last_change":"2024-09-19T08:54:31.424365+0000","last_active":"2024-09-19T08:54:53.330115+0000","last_peered":"2024-09-19T08:54:53.330115+0000","last_clean":"2024-09-19T08:54:53.330115+0000","last_became_active":"2024-09-19T08:54:31.424044+0000","last_became_peered":"2024-09-19T08:54:31.424044+0000","last_unstale":"2024-09-19T08:54:53.330115+0000","last_undegraded":"2024-09-19T08:54:53.330115+0000","last_fullsized":"2024-09-19T08:54:53.330115+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:16.435389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329839+0000","last_change":"2024-09-19T08:54:31.437238+0000","last_active":"2024-09-19T08:54:53.329839+0000","last_peered":"2024-09-19T08:54:53.329839+0000","last_clean":"2024-09-19T08:54:53.329839+0000","last_became_active":"2024-09-19T08:54:31.436867+0000","last_became_peered":"2024-09-19T08:54:31.436867+0000","last_unstale":"2024-09-19T08:54:53.329839+0000","last_undegraded":"2024-09-19T08:54:53.329839+0000","last_fullsized":"2024-09-19T08:54:53.329839+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:59.839081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.328379+0000","last_change":"2024-09-19T08:54:31.438654+0000","last_active":"2024-09-19T08:54:53.328379+0000","last_peered":"2024-09-19T08:54:53.328379+0000","last_clean":"2024-09-19T08:54:53.328379+0000","last_became_active":"2024-09-19T08:54:31.438342+0000","last_became_peered":"2024-09-19T08:54:31.438342+0000","last_unstale":"2024-09-19T08:54:53.328379+0000","last_undegraded":"2024-09-19T08:54:53.328379+0000","last_fullsized":"2024-09-19T08:54:53.328379+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:55.190605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330648+0000","last_change":"2024-09-19T08:54:31.431100+0000","last_active":"2024-09-19T08:54:53.330648+0000","last_peered":"2024-09-19T08:54:53.330648+0000","last_clean":"2024-09-19T08:54:53.330648+0000","last_became_active":"2024-09-19T08:54:31.430749+0000","last_became_peered":"2024-09-19T08:54:31.430749+0000","last_unstale":"2024-09-19T08:54:53.330648+0000","last_undegraded":"2024-09-19T08:54:53.330648+0000","last_fullsized":"2024-09-19T08:54:53.330648+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:50.597610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330176+0000","last_change":"2024-09-19T08:54:31.427454+0000","last_active":"2024-09-19T08:54:53.330176+0000","last_peered":"2024-09-19T08:54:53.330176+0000","last_clean":"2024-09-19T08:54:53.330176+0000","last_became_active":"2024-09-19T08:54:31.427098+0000","last_became_peered":"2024-09-19T08:54:31.427098+0000","last_unstale":"2024-09-19T08:54:53.330176+0000","last_undegraded":"2024-09-19T08:54:53.330176+0000","last_fullsized":"2024-09-19T08:54:53.330176+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:01.042626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.328302+0000","last_change":"2024-09-19T08:54:31.433887+0000","last_active":"2024-09-19T08:54:53.328302+0000","last_peered":"2024-09-19T08:54:53.328302+0000","last_clean":"2024-09-19T08:54:53.328302+0000","last_became_active":"2024-09-19T08:54:31.433528+0000","last_became_peered":"2024-09-19T08:54:31.433528+0000","last_unstale":"2024-09-19T08:54:53.328302+0000","last_undegraded":"2024-09-19T08:54:53.328302+0000","last_fullsized":"2024-09-19T08:54:53.328302+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:37.291226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327047+0000","last_change":"2024-09-19T08:54:31.436976+0000","last_active":"2024-09-19T08:54:53.327047+0000","last_peered":"2024-09-19T08:54:53.327047+0000","last_clean":"2024-09-19T08:54:53.327047+0000","last_became_active":"2024-09-19T08:54:31.436646+0000","last_became_peered":"2024-09-19T08:54:31.436646+0000","last_unstale":"2024-09-19T08:54:53.327047+0000","last_undegraded":"2024-09-19T08:54:53.327047+0000","last_fullsized":"2024-09-19T08:54:53.327047+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:19.755556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330114+0000","last_change":"2024-09-19T08:54:31.438922+0000","last_active":"2024-09-19T08:54:53.330114+0000","last_peered":"2024-09-19T08:54:53.330114+0000","last_clean":"2024-09-19T08:54:53.330114+0000","last_became_active":"2024-09-19T08:54:31.438593+0000","last_became_peered":"2024-09-19T08:54:31.438593+0000","last_unstale":"2024-09-19T08:54:53.330114+0000","last_undegraded":"2024-09-19T08:54:53.330114+0000","last_fullsized":"2024-09-19T08:54:53.330114+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:07.347900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.328949+0000","last_change":"2024-09-19T08:54:31.431659+0000","last_active":"2024-09-19T08:54:53.328949+0000","last_peered":"2024-09-19T08:54:53.328949+0000","last_clean":"2024-09-19T08:54:53.328949+0000","last_became_active":"2024-09-19T08:54:31.431359+0000","last_became_peered":"2024-09-19T08:54:31.431359+0000","last_unstale":"2024-09-19T08:54:53.328949+0000","last_undegraded":"2024-09-19T08:54:53.328949+0000","last_fullsized":"2024-09-19T08:54:53.328949+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:02.421286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330986+0000","last_change":"2024-09-19T08:54:31.432185+0000","last_active":"2024-09-19T08:54:53.330986+0000","last_peered":"2024-09-19T08:54:53.330986+0000","last_clean":"2024-09-19T08:54:53.330986+0000","last_became_active":"2024-09-19T08:54:31.431418+0000","last_became_peered":"2024-09-19T08:54:31.431418+0000","last_unstale":"2024-09-19T08:54:53.330986+0000","last_undegraded":"2024-09-19T08:54:53.330986+0000","last_fullsized":"2024-09-19T08:54:53.330986+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:45.347487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329298+0000","last_change":"2024-09-19T08:54:31.433742+0000","last_active":"2024-09-19T08:54:53.329298+0000","last_peered":"2024-09-19T08:54:53.329298+0000","last_clean":"2024-09-19T08:54:53.329298+0000","last_became_active":"2024-09-19T08:54:31.433455+0000","last_became_peered":"2024-09-19T08:54:31.433455+0000","last_unstale":"2024-09-19T08:54:53.329298+0000","last_undegraded":"2024-09-19T08:54:53.329298+0000","last_fullsized":"2024-09-19T08:54:53.329298+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:38.803705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330825+0000","last_change":"2024-09-19T08:54:31.432954+0000","last_active":"2024-09-19T08:54:53.330825+0000","last_peered":"2024-09-19T08:54:53.330825+0000","last_clean":"2024-09-19T08:54:53.330825+0000","last_became_active":"2024-09-19T08:54:31.432574+0000","last_became_peered":"2024-09-19T08:54:31.432574+0000","last_unstale":"2024-09-19T08:54:53.330825+0000","last_undegraded":"2024-09-19T08:54:53.330825+0000","last_fullsized":"2024-09-19T08:54:53.330825+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:30.457191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327933+0000","last_change":"2024-09-19T08:54:31.435544+0000","last_active":"2024-09-19T08:54:53.327933+0000","last_peered":"2024-09-19T08:54:53.327933+0000","last_clean":"2024-09-19T08:54:53.327933+0000","last_became_active":"2024-09-19T08:54:31.435195+0000","last_became_peered":"2024-09-19T08:54:31.435195+0000","last_unstale":"2024-09-19T08:54:53.327933+0000","last_undegraded":"2024-09-19T08:54:53.327933+0000","last_fullsized":"2024-09-19T08:54:53.327933+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:54.240654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327032+0000","last_change":"2024-09-19T08:54:31.428403+0000","last_active":"2024-09-19T08:54:53.327032+0000","last_peered":"2024-09-19T08:54:53.327032+0000","last_clean":"2024-09-19T08:54:53.327032+0000","last_became_active":"2024-09-19T08:54:31.428110+0000","last_became_peered":"2024-09-19T08:54:31.428110+0000","last_unstale":"2024-09-19T08:54:53.327032+0000","last_undegraded":"2024-09-19T08:54:53.327032+0000","last_fullsized":"2024-09-19T08:54:53.327032+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:05.593073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330562+0000","last_change":"2024-09-19T08:54:31.427291+0000","last_active":"2024-09-19T08:54:53.330562+0000","last_peered":"2024-09-19T08:54:53.330562+0000","last_clean":"2024-09-19T08:54:53.330562+0000","last_became_active":"2024-09-19T08:54:31.427011+0000","last_became_peered":"2024-09-19T08:54:31.427011+0000","last_unstale":"2024-09-19T08:54:53.330562+0000","last_undegraded":"2024-09-19T08:54:53.330562+0000","last_fullsized":"2024-09-19T08:54:53.330562+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:54.338526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329794+0000","last_change":"2024-09-19T08:54:31.429309+0000","last_active":"2024-09-19T08:54:53.329794+0000","last_peered":"2024-09-19T08:54:53.329794+0000","last_clean":"2024-09-19T08:54:53.329794+0000","last_became_active":"2024-09-19T08:54:31.428381+0000","last_became_peered":"2024-09-19T08:54:31.428381+0000","last_unstale":"2024-09-19T08:54:53.329794+0000","last_undegraded":"2024-09-19T08:54:53.329794+0000","last_fullsized":"2024-09-19T08:54:53.329794+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:22:33.920114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.336591+0000","last_change":"2024-09-19T08:54:53.336591+0000","last_active":"2024-09-19T08:54:53.336591+0000","last_peered":"2024-09-19T08:54:53.336591+0000","last_clean":"2024-09-19T08:54:53.336591+0000","last_became_active":"2024-09-19T08:54:53.336222+0000","last_became_peered":"2024-09-19T08:54:53.336222+0000","last_unstale":"2024-09-19T08:54:53.336591+0000","last_undegraded":"2024-09-19T08:54:53.336591+0000","last_fullsized":"2024-09-19T08:54:53.336591+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:59.019419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.335149+0000","last_change":"2024-09-19T08:54:53.335149+0000","last_active":"2024-09-19T08:54:53.335149+0000","last_peered":"2024-09-19T08:54:53.335149+0000","last_clean":"2024-09-19T08:54:53.335149+0000","last_became_active":"2024-09-19T08:54:53.334766+0000","last_became_peered":"2024-09-19T08:54:53.334766+0000","last_unstale":"2024-09-19T08:54:53.335149+0000","last_undegraded":"2024-09-19T08:54:53.335149+0000","last_fullsized":"2024-09-19T08:54:53.335149+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:36.469044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331864+0000","last_change":"2024-09-19T08:54:31.427608+0000","last_active":"2024-09-19T08:54:53.331864+0000","last_peered":"2024-09-19T08:54:53.331864+0000","last_clean":"2024-09-19T08:54:53.331864+0000","last_became_active":"2024-09-19T08:54:31.427294+0000","last_became_peered":"2024-09-19T08:54:31.427294+0000","last_unstale":"2024-09-19T08:54:53.331864+0000","last_undegraded":"2024-09-19T08:54:53.331864+0000","last_fullsized":"2024-09-19T08:54:53.331864+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:41.356609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331158+0000","last_change":"2024-09-19T08:54:29.416204+0000","last_active":"2024-09-19T08:54:53.331158+0000","last_peered":"2024-09-19T08:54:53.331158+0000","last_clean":"2024-09-19T08:54:53.331158+0000","last_became_active":"2024-09-19T08:54:29.415872+0000","last_became_peered":"2024-09-19T08:54:29.415872+0000","last_unstale":"2024-09-19T08:54:53.331158+0000","last_undegraded":"2024-09-19T08:54:53.331158+0000","last_fullsized":"2024-09-19T08:54:53.331158+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:13.844147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331049+0000","last_change":"2024-09-19T08:54:31.432137+0000","last_active":"2024-09-19T08:54:53.331049+0000","last_peered":"2024-09-19T08:54:53.331049+0000","last_clean":"2024-09-19T08:54:53.331049+0000","last_became_active":"2024-09-19T08:54:31.431761+0000","last_became_peered":"2024-09-19T08:54:31.431761+0000","last_unstale":"2024-09-19T08:54:53.331049+0000","last_undegraded":"2024-09-19T08:54:53.331049+0000","last_fullsized":"2024-09-19T08:54:53.331049+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:05.008431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327676+0000","last_change":"2024-09-19T08:54:29.413221+0000","last_active":"2024-09-19T08:54:53.327676+0000","last_peered":"2024-09-19T08:54:53.327676+0000","last_clean":"2024-09-19T08:54:53.327676+0000","last_became_active":"2024-09-19T08:54:29.412829+0000","last_became_peered":"2024-09-19T08:54:29.412829+0000","last_unstale":"2024-09-19T08:54:53.327676+0000","last_undegraded":"2024-09-19T08:54:53.327676+0000","last_fullsized":"2024-09-19T08:54:53.327676+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:07.224136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.326805+0000","last_change":"2024-09-19T08:54:29.410221+0000","last_active":"2024-09-19T08:54:53.326805+0000","last_peered":"2024-09-19T08:54:53.326805+0000","last_clean":"2024-09-19T08:54:53.326805+0000","last_became_active":"2024-09-19T08:54:29.409951+0000","last_became_peered":"2024-09-19T08:54:29.409951+0000","last_unstale":"2024-09-19T08:54:53.326805+0000","last_undegraded":"2024-09-19T08:54:53.326805+0000","last_fullsized":"2024-09-19T08:54:53.326805+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:58.350932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.328917+0000","last_change":"2024-09-19T08:54:31.429979+0000","last_active":"2024-09-19T08:54:53.328917+0000","last_peered":"2024-09-19T08:54:53.328917+0000","last_clean":"2024-09-19T08:54:53.328917+0000","last_became_active":"2024-09-19T08:54:31.429661+0000","last_became_peered":"2024-09-19T08:54:31.429661+0000","last_unstale":"2024-09-19T08:54:53.328917+0000","last_undegraded":"2024-09-19T08:54:53.328917+0000","last_fullsized":"2024-09-19T08:54:53.328917+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:27:40.603490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331299+0000","last_change":"2024-09-19T08:54:29.415769+0000","last_active":"2024-09-19T08:54:53.331299+0000","last_peered":"2024-09-19T08:54:53.331299+0000","last_clean":"2024-09-19T08:54:53.331299+0000","last_became_active":"2024-09-19T08:54:29.415245+0000","last_became_peered":"2024-09-19T08:54:29.415245+0000","last_unstale":"2024-09-19T08:54:53.331299+0000","last_undegraded":"2024-09-19T08:54:53.331299+0000","last_fullsized":"2024-09-19T08:54:53.331299+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:15.487945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330132+0000","last_change":"2024-09-19T08:54:31.427126+0000","last_active":"2024-09-19T08:54:53.330132+0000","last_peered":"2024-09-19T08:54:53.330132+0000","last_clean":"2024-09-19T08:54:53.330132+0000","last_became_active":"2024-09-19T08:54:31.426816+0000","last_became_peered":"2024-09-19T08:54:31.426816+0000","last_unstale":"2024-09-19T08:54:53.330132+0000","last_undegraded":"2024-09-19T08:54:53.330132+0000","last_fullsized":"2024-09-19T08:54:53.330132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:38.039428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327848+0000","last_change":"2024-09-19T08:54:29.411354+0000","last_active":"2024-09-19T08:54:53.327848+0000","last_peered":"2024-09-19T08:54:53.327848+0000","last_clean":"2024-09-19T08:54:53.327848+0000","last_became_active":"2024-09-19T08:54:29.410990+0000","last_became_peered":"2024-09-19T08:54:29.410990+0000","last_unstale":"2024-09-19T08:54:53.327848+0000","last_undegraded":"2024-09-19T08:54:53.327848+0000","last_fullsized":"2024-09-19T08:54:53.327848+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:29.338169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330234+0000","last_change":"2024-09-19T08:54:31.426243+0000","last_active":"2024-09-19T08:54:53.330234+0000","last_peered":"2024-09-19T08:54:53.330234+0000","last_clean":"2024-09-19T08:54:53.330234+0000","last_became_active":"2024-09-19T08:54:31.425895+0000","last_became_peered":"2024-09-19T08:54:31.425895+0000","last_unstale":"2024-09-19T08:54:53.330234+0000","last_undegraded":"2024-09-19T08:54:53.330234+0000","last_fullsized":"2024-09-19T08:54:53.330234+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:13.562780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331102+0000","last_change":"2024-09-19T08:54:29.416646+0000","last_active":"2024-09-19T08:54:53.331102+0000","last_peered":"2024-09-19T08:54:53.331102+0000","last_clean":"2024-09-19T08:54:53.331102+0000","last_became_active":"2024-09-19T08:54:29.416260+0000","last_became_peered":"2024-09-19T08:54:29.416260+0000","last_unstale":"2024-09-19T08:54:53.331102+0000","last_undegraded":"2024-09-19T08:54:53.331102+0000","last_fullsized":"2024-09-19T08:54:53.331102+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:42:17.467035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331394+0000","last_change":"2024-09-19T08:54:31.435538+0000","last_active":"2024-09-19T08:54:53.331394+0000","last_peered":"2024-09-19T08:54:53.331394+0000","last_clean":"2024-09-19T08:54:53.331394+0000","last_became_active":"2024-09-19T08:54:31.435185+0000","last_became_peered":"2024-09-19T08:54:31.435185+0000","last_unstale":"2024-09-19T08:54:53.331394+0000","last_undegraded":"2024-09-19T08:54:53.331394+0000","last_fullsized":"2024-09-19T08:54:53.331394+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:06.940123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.332501+0000","last_change":"2024-09-19T08:54:29.675914+0000","last_active":"2024-09-19T08:54:53.332501+0000","last_peered":"2024-09-19T08:54:53.332501+0000","last_clean":"2024-09-19T08:54:53.332501+0000","last_became_active":"2024-09-19T08:54:29.675482+0000","last_became_peered":"2024-09-19T08:54:29.675482+0000","last_unstale":"2024-09-19T08:54:53.332501+0000","last_undegraded":"2024-09-19T08:54:53.332501+0000","last_fullsized":"2024-09-19T08:54:53.332501+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:58.893008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330567+0000","last_change":"2024-09-19T08:54:31.432628+0000","last_active":"2024-09-19T08:54:53.330567+0000","last_peered":"2024-09-19T08:54:53.330567+0000","last_clean":"2024-09-19T08:54:53.330567+0000","last_became_active":"2024-09-19T08:54:31.430640+0000","last_became_peered":"2024-09-19T08:54:31.430640+0000","last_unstale":"2024-09-19T08:54:53.330567+0000","last_undegraded":"2024-09-19T08:54:53.330567+0000","last_fullsized":"2024-09-19T08:54:53.330567+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:07.793089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'25","reported_seq":171,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:36.583592+0000","last_change":"2024-09-19T08:54:29.414619+0000","last_active":"2024-09-19T08:55:36.583592+0000","last_peered":"2024-09-19T08:55:36.583592+0000","last_clean":"2024-09-19T08:55:36.583592+0000","last_became_active":"2024-09-19T08:54:29.414295+0000","last_became_peered":"2024-09-19T08:54:29.414295+0000","last_unstale":"2024-09-19T08:55:36.583592+0000","last_undegraded":"2024-09-19T08:55:36.583592+0000","last_fullsized":"2024-09-19T08:55:36.583592+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:23.782684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61199,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":124,"num_read_kb":121,"num_write":25,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331211+0000","last_change":"2024-09-19T08:54:31.425432+0000","last_active":"2024-09-19T08:54:53.331211+0000","last_peered":"2024-09-19T08:54:53.331211+0000","last_clean":"2024-09-19T08:54:53.331211+0000","last_became_active":"2024-09-19T08:54:31.425086+0000","last_became_peered":"2024-09-19T08:54:31.425086+0000","last_unstale":"2024-09-19T08:54:53.331211+0000","last_undegraded":"2024-09-19T08:54:53.331211+0000","last_fullsized":"2024-09-19T08:54:53.331211+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:56.572339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330371+0000","last_change":"2024-09-19T08:54:29.415055+0000","last_active":"2024-09-19T08:54:53.330371+0000","last_peered":"2024-09-19T08:54:53.330371+0000","last_clean":"2024-09-19T08:54:53.330371+0000","last_became_active":"2024-09-19T08:54:29.414573+0000","last_became_peered":"2024-09-19T08:54:29.414573+0000","last_unstale":"2024-09-19T08:54:53.330371+0000","last_undegraded":"2024-09-19T08:54:53.330371+0000","last_fullsized":"2024-09-19T08:54:53.330371+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:13.013714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.326883+0000","last_change":"2024-09-19T08:54:31.436905+0000","last_active":"2024-09-19T08:54:53.326883+0000","last_peered":"2024-09-19T08:54:53.326883+0000","last_clean":"2024-09-19T08:54:53.326883+0000","last_became_active":"2024-09-19T08:54:31.436571+0000","last_became_peered":"2024-09-19T08:54:31.436571+0000","last_unstale":"2024-09-19T08:54:53.326883+0000","last_undegraded":"2024-09-19T08:54:53.326883+0000","last_fullsized":"2024-09-19T08:54:53.326883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:55.294255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330834+0000","last_change":"2024-09-19T08:54:29.417958+0000","last_active":"2024-09-19T08:54:53.330834+0000","last_peered":"2024-09-19T08:54:53.330834+0000","last_clean":"2024-09-19T08:54:53.330834+0000","last_became_active":"2024-09-19T08:54:29.417570+0000","last_became_peered":"2024-09-19T08:54:29.417570+0000","last_unstale":"2024-09-19T08:54:53.330834+0000","last_undegraded":"2024-09-19T08:54:53.330834+0000","last_fullsized":"2024-09-19T08:54:53.330834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:25.557217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331274+0000","last_change":"2024-09-19T08:54:31.433019+0000","last_active":"2024-09-19T08:54:53.331274+0000","last_peered":"2024-09-19T08:54:53.331274+0000","last_clean":"2024-09-19T08:54:53.331274+0000","last_became_active":"2024-09-19T08:54:31.431265+0000","last_became_peered":"2024-09-19T08:54:31.431265+0000","last_unstale":"2024-09-19T08:54:53.331274+0000","last_undegraded":"2024-09-19T08:54:53.331274+0000","last_fullsized":"2024-09-19T08:54:53.331274+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:36.481863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.979100+0000","last_change":"2024-09-19T08:54:29.414236+0000","last_active":"2024-09-19T08:54:53.979100+0000","last_peered":"2024-09-19T08:54:53.979100+0000","last_clean":"2024-09-19T08:54:53.979100+0000","last_became_active":"2024-09-19T08:54:29.413878+0000","last_became_peered":"2024-09-19T08:54:29.413878+0000","last_unstale":"2024-09-19T08:54:53.979100+0000","last_undegraded":"2024-09-19T08:54:53.979100+0000","last_fullsized":"2024-09-19T08:54:53.979100+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:11.222362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330480+0000","last_change":"2024-09-19T08:54:31.439512+0000","last_active":"2024-09-19T08:54:53.330480+0000","last_peered":"2024-09-19T08:54:53.330480+0000","last_clean":"2024-09-19T08:54:53.330480+0000","last_became_active":"2024-09-19T08:54:31.438767+0000","last_became_peered":"2024-09-19T08:54:31.438767+0000","last_unstale":"2024-09-19T08:54:53.330480+0000","last_undegraded":"2024-09-19T08:54:53.330480+0000","last_fullsized":"2024-09-19T08:54:53.330480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:31.784577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330687+0000","last_change":"2024-09-19T08:54:29.675768+0000","last_active":"2024-09-19T08:54:53.330687+0000","last_peered":"2024-09-19T08:54:53.330687+0000","last_clean":"2024-09-19T08:54:53.330687+0000","last_became_active":"2024-09-19T08:54:29.675376+0000","last_became_peered":"2024-09-19T08:54:29.675376+0000","last_unstale":"2024-09-19T08:54:53.330687+0000","last_undegraded":"2024-09-19T08:54:53.330687+0000","last_fullsized":"2024-09-19T08:54:53.330687+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:10.281126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331714+0000","last_change":"2024-09-19T08:54:31.435904+0000","last_active":"2024-09-19T08:54:53.331714+0000","last_peered":"2024-09-19T08:54:53.331714+0000","last_clean":"2024-09-19T08:54:53.331714+0000","last_became_active":"2024-09-19T08:54:31.435396+0000","last_became_peered":"2024-09-19T08:54:31.435396+0000","last_unstale":"2024-09-19T08:54:53.331714+0000","last_undegraded":"2024-09-19T08:54:53.331714+0000","last_fullsized":"2024-09-19T08:54:53.331714+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:41.567463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331746+0000","last_change":"2024-09-19T08:54:29.410221+0000","last_active":"2024-09-19T08:54:53.331746+0000","last_peered":"2024-09-19T08:54:53.331746+0000","last_clean":"2024-09-19T08:54:53.331746+0000","last_became_active":"2024-09-19T08:54:29.409856+0000","last_became_peered":"2024-09-19T08:54:29.409856+0000","last_unstale":"2024-09-19T08:54:53.331746+0000","last_undegraded":"2024-09-19T08:54:53.331746+0000","last_fullsized":"2024-09-19T08:54:53.331746+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:46.095816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327914+0000","last_change":"2024-09-19T08:54:31.437854+0000","last_active":"2024-09-19T08:54:53.327914+0000","last_peered":"2024-09-19T08:54:53.327914+0000","last_clean":"2024-09-19T08:54:53.327914+0000","last_became_active":"2024-09-19T08:54:31.437491+0000","last_became_peered":"2024-09-19T08:54:31.437491+0000","last_unstale":"2024-09-19T08:54:53.327914+0000","last_undegraded":"2024-09-19T08:54:53.327914+0000","last_fullsized":"2024-09-19T08:54:53.327914+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:22.532429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.983440+0000","last_change":"2024-09-19T08:54:53.983440+0000","last_active":"2024-09-19T08:54:53.983440+0000","last_peered":"2024-09-19T08:54:53.983440+0000","last_clean":"2024-09-19T08:54:53.983440+0000","last_became_active":"2024-09-19T08:54:53.980971+0000","last_became_peered":"2024-09-19T08:54:53.980971+0000","last_unstale":"2024-09-19T08:54:53.983440+0000","last_undegraded":"2024-09-19T08:54:53.983440+0000","last_fullsized":"2024-09-19T08:54:53.983440+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:33.070904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330480+0000","last_change":"2024-09-19T08:54:31.429376+0000","last_active":"2024-09-19T08:54:53.330480+0000","last_peered":"2024-09-19T08:54:53.330480+0000","last_clean":"2024-09-19T08:54:53.330480+0000","last_became_active":"2024-09-19T08:54:31.429006+0000","last_became_peered":"2024-09-19T08:54:31.429006+0000","last_unstale":"2024-09-19T08:54:53.330480+0000","last_undegraded":"2024-09-19T08:54:53.330480+0000","last_fullsized":"2024-09-19T08:54:53.330480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:26.399838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.332608+0000","last_change":"2024-09-19T08:54:29.414307+0000","last_active":"2024-09-19T08:54:53.332608+0000","last_peered":"2024-09-19T08:54:53.332608+0000","last_clean":"2024-09-19T08:54:53.332608+0000","last_became_active":"2024-09-19T08:54:29.413823+0000","last_became_peered":"2024-09-19T08:54:29.413823+0000","last_unstale":"2024-09-19T08:54:53.332608+0000","last_undegraded":"2024-09-19T08:54:53.332608+0000","last_fullsized":"2024-09-19T08:54:53.332608+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:25.484645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330751+0000","last_change":"2024-09-19T08:54:31.437789+0000","last_active":"2024-09-19T08:54:53.330751+0000","last_peered":"2024-09-19T08:54:53.330751+0000","last_clean":"2024-09-19T08:54:53.330751+0000","last_became_active":"2024-09-19T08:54:31.435488+0000","last_became_peered":"2024-09-19T08:54:31.435488+0000","last_unstale":"2024-09-19T08:54:53.330751+0000","last_undegraded":"2024-09-19T08:54:53.330751+0000","last_fullsized":"2024-09-19T08:54:53.330751+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:19.332440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.333662+0000","last_change":"2024-09-19T08:54:53.333120+0000","last_active":"2024-09-19T08:54:53.333662+0000","last_peered":"2024-09-19T08:54:53.333662+0000","last_clean":"2024-09-19T08:54:53.333662+0000","last_became_active":"2024-09-19T08:54:53.332711+0000","last_became_peered":"2024-09-19T08:54:53.332711+0000","last_unstale":"2024-09-19T08:54:53.333662+0000","last_undegraded":"2024-09-19T08:54:53.333662+0000","last_fullsized":"2024-09-19T08:54:53.333662+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:18.359002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331140+0000","last_change":"2024-09-19T08:54:31.434564+0000","last_active":"2024-09-19T08:54:53.331140+0000","last_peered":"2024-09-19T08:54:53.331140+0000","last_clean":"2024-09-19T08:54:53.331140+0000","last_became_active":"2024-09-19T08:54:31.434231+0000","last_became_peered":"2024-09-19T08:54:31.434231+0000","last_unstale":"2024-09-19T08:54:53.331140+0000","last_undegraded":"2024-09-19T08:54:53.331140+0000","last_fullsized":"2024-09-19T08:54:53.331140+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:31.316400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":334,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331076+0000","last_change":"2024-09-19T08:53:21.357560+0000","last_active":"2024-09-19T08:54:53.331076+0000","last_peered":"2024-09-19T08:54:53.331076+0000","last_clean":"2024-09-19T08:54:53.331076+0000","last_became_active":"2024-09-19T08:53:21.357122+0000","last_became_peered":"2024-09-19T08:53:21.357122+0000","last_unstale":"2024-09-19T08:54:53.331076+0000","last_undegraded":"2024-09-19T08:54:53.331076+0000","last_fullsized":"2024-09-19T08:54:53.331076+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:05.231370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:05.231370+0000","last_clean_scrub_stamp":"2024-09-19T08:50:05.231370+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:47.867682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.979104+0000","last_change":"2024-09-19T08:54:29.412240+0000","last_active":"2024-09-19T08:54:53.979104+0000","last_peered":"2024-09-19T08:54:53.979104+0000","last_clean":"2024-09-19T08:54:53.979104+0000","last_became_active":"2024-09-19T08:54:29.411908+0000","last_became_peered":"2024-09-19T08:54:29.411908+0000","last_unstale":"2024-09-19T08:54:53.979104+0000","last_undegraded":"2024-09-19T08:54:53.979104+0000","last_fullsized":"2024-09-19T08:54:53.979104+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:37.189373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331122+0000","last_change":"2024-09-19T08:54:31.432956+0000","last_active":"2024-09-19T08:54:53.331122+0000","last_peered":"2024-09-19T08:54:53.331122+0000","last_clean":"2024-09-19T08:54:53.331122+0000","last_became_active":"2024-09-19T08:54:31.432639+0000","last_became_peered":"2024-09-19T08:54:31.432639+0000","last_unstale":"2024-09-19T08:54:53.331122+0000","last_undegraded":"2024-09-19T08:54:53.331122+0000","last_fullsized":"2024-09-19T08:54:53.331122+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:58.302624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331178+0000","last_change":"2024-09-19T08:54:29.414214+0000","last_active":"2024-09-19T08:54:53.331178+0000","last_peered":"2024-09-19T08:54:53.331178+0000","last_clean":"2024-09-19T08:54:53.331178+0000","last_became_active":"2024-09-19T08:54:29.413853+0000","last_became_peered":"2024-09-19T08:54:29.413853+0000","last_unstale":"2024-09-19T08:54:53.331178+0000","last_undegraded":"2024-09-19T08:54:53.331178+0000","last_fullsized":"2024-09-19T08:54:53.331178+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:28:29.119856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.326797+0000","last_change":"2024-09-19T08:54:31.424643+0000","last_active":"2024-09-19T08:54:53.326797+0000","last_peered":"2024-09-19T08:54:53.326797+0000","last_clean":"2024-09-19T08:54:53.326797+0000","last_became_active":"2024-09-19T08:54:31.424363+0000","last_became_peered":"2024-09-19T08:54:31.424363+0000","last_unstale":"2024-09-19T08:54:53.326797+0000","last_undegraded":"2024-09-19T08:54:53.326797+0000","last_fullsized":"2024-09-19T08:54:53.326797+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:37.529952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.326916+0000","last_change":"2024-09-19T08:54:29.675742+0000","last_active":"2024-09-19T08:54:53.326916+0000","last_peered":"2024-09-19T08:54:53.326916+0000","last_clean":"2024-09-19T08:54:53.326916+0000","last_became_active":"2024-09-19T08:54:29.675347+0000","last_became_peered":"2024-09-19T08:54:29.675347+0000","last_unstale":"2024-09-19T08:54:53.326916+0000","last_undegraded":"2024-09-19T08:54:53.326916+0000","last_fullsized":"2024-09-19T08:54:53.326916+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:00.925390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331104+0000","last_change":"2024-09-19T08:54:31.433887+0000","last_active":"2024-09-19T08:54:53.331104+0000","last_peered":"2024-09-19T08:54:53.331104+0000","last_clean":"2024-09-19T08:54:53.331104+0000","last_became_active":"2024-09-19T08:54:31.433331+0000","last_became_peered":"2024-09-19T08:54:31.433331+0000","last_unstale":"2024-09-19T08:54:53.331104+0000","last_undegraded":"2024-09-19T08:54:53.331104+0000","last_fullsized":"2024-09-19T08:54:53.331104+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:49.875061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331491+0000","last_change":"2024-09-19T08:54:29.417410+0000","last_active":"2024-09-19T08:54:53.331491+0000","last_peered":"2024-09-19T08:54:53.331491+0000","last_clean":"2024-09-19T08:54:53.331491+0000","last_became_active":"2024-09-19T08:54:29.417018+0000","last_became_peered":"2024-09-19T08:54:29.417018+0000","last_unstale":"2024-09-19T08:54:53.331491+0000","last_undegraded":"2024-09-19T08:54:53.331491+0000","last_fullsized":"2024-09-19T08:54:53.331491+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:53.669027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327692+0000","last_change":"2024-09-19T08:54:31.431313+0000","last_active":"2024-09-19T08:54:53.327692+0000","last_peered":"2024-09-19T08:54:53.327692+0000","last_clean":"2024-09-19T08:54:53.327692+0000","last_became_active":"2024-09-19T08:54:31.429427+0000","last_became_peered":"2024-09-19T08:54:31.429427+0000","last_unstale":"2024-09-19T08:54:53.327692+0000","last_undegraded":"2024-09-19T08:54:53.327692+0000","last_fullsized":"2024-09-19T08:54:53.327692+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:55.106769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330517+0000","last_change":"2024-09-19T08:54:29.675722+0000","last_active":"2024-09-19T08:54:53.330517+0000","last_peered":"2024-09-19T08:54:53.330517+0000","last_clean":"2024-09-19T08:54:53.330517+0000","last_became_active":"2024-09-19T08:54:29.675397+0000","last_became_peered":"2024-09-19T08:54:29.675397+0000","last_unstale":"2024-09-19T08:54:53.330517+0000","last_undegraded":"2024-09-19T08:54:53.330517+0000","last_fullsized":"2024-09-19T08:54:53.330517+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:49.574947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327665+0000","last_change":"2024-09-19T08:54:31.431106+0000","last_active":"2024-09-19T08:54:53.327665+0000","last_peered":"2024-09-19T08:54:53.327665+0000","last_clean":"2024-09-19T08:54:53.327665+0000","last_became_active":"2024-09-19T08:54:31.430745+0000","last_became_peered":"2024-09-19T08:54:31.430745+0000","last_unstale":"2024-09-19T08:54:53.327665+0000","last_undegraded":"2024-09-19T08:54:53.327665+0000","last_fullsized":"2024-09-19T08:54:53.327665+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:22.714106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331431+0000","last_change":"2024-09-19T08:54:29.675985+0000","last_active":"2024-09-19T08:54:53.331431+0000","last_peered":"2024-09-19T08:54:53.331431+0000","last_clean":"2024-09-19T08:54:53.331431+0000","last_became_active":"2024-09-19T08:54:29.675374+0000","last_became_peered":"2024-09-19T08:54:29.675374+0000","last_unstale":"2024-09-19T08:54:53.331431+0000","last_undegraded":"2024-09-19T08:54:53.331431+0000","last_fullsized":"2024-09-19T08:54:53.331431+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:06.664621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327052+0000","last_change":"2024-09-19T08:54:31.423493+0000","last_active":"2024-09-19T08:54:53.327052+0000","last_peered":"2024-09-19T08:54:53.327052+0000","last_clean":"2024-09-19T08:54:53.327052+0000","last_became_active":"2024-09-19T08:54:31.422651+0000","last_became_peered":"2024-09-19T08:54:31.422651+0000","last_unstale":"2024-09-19T08:54:53.327052+0000","last_undegraded":"2024-09-19T08:54:53.327052+0000","last_fullsized":"2024-09-19T08:54:53.327052+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:51.863965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.435498+0000","last_change":"2024-09-19T08:54:29.408571+0000","last_active":"2024-09-19T08:54:53.435498+0000","last_peered":"2024-09-19T08:54:53.435498+0000","last_clean":"2024-09-19T08:54:53.435498+0000","last_became_active":"2024-09-19T08:54:29.408142+0000","last_became_peered":"2024-09-19T08:54:29.408142+0000","last_unstale":"2024-09-19T08:54:53.435498+0000","last_undegraded":"2024-09-19T08:54:53.435498+0000","last_fullsized":"2024-09-19T08:54:53.435498+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:34.578230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329321+0000","last_change":"2024-09-19T08:54:31.435333+0000","last_active":"2024-09-19T08:54:53.329321+0000","last_peered":"2024-09-19T08:54:53.329321+0000","last_clean":"2024-09-19T08:54:53.329321+0000","last_became_active":"2024-09-19T08:54:31.435041+0000","last_became_peered":"2024-09-19T08:54:31.435041+0000","last_unstale":"2024-09-19T08:54:53.329321+0000","last_undegraded":"2024-09-19T08:54:53.329321+0000","last_fullsized":"2024-09-19T08:54:53.329321+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:40.972638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.979153+0000","last_change":"2024-09-19T08:54:29.554303+0000","last_active":"2024-09-19T08:54:53.979153+0000","last_peered":"2024-09-19T08:54:53.979153+0000","last_clean":"2024-09-19T08:54:53.979153+0000","last_became_active":"2024-09-19T08:54:29.553919+0000","last_became_peered":"2024-09-19T08:54:29.553919+0000","last_unstale":"2024-09-19T08:54:53.979153+0000","last_undegraded":"2024-09-19T08:54:53.979153+0000","last_fullsized":"2024-09-19T08:54:53.979153+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:25.103926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.333280+0000","last_change":"2024-09-19T08:54:53.333280+0000","last_active":"2024-09-19T08:54:53.333280+0000","last_peered":"2024-09-19T08:54:53.333280+0000","last_clean":"2024-09-19T08:54:53.333280+0000","last_became_active":"2024-09-19T08:54:53.332881+0000","last_became_peered":"2024-09-19T08:54:53.332881+0000","last_unstale":"2024-09-19T08:54:53.333280+0000","last_undegraded":"2024-09-19T08:54:53.333280+0000","last_fullsized":"2024-09-19T08:54:53.333280+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:55.880616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329946+0000","last_change":"2024-09-19T08:54:29.675665+0000","last_active":"2024-09-19T08:54:53.329946+0000","last_peered":"2024-09-19T08:54:53.329946+0000","last_clean":"2024-09-19T08:54:53.329946+0000","last_became_active":"2024-09-19T08:54:29.675367+0000","last_became_peered":"2024-09-19T08:54:29.675367+0000","last_unstale":"2024-09-19T08:54:53.329946+0000","last_undegraded":"2024-09-19T08:54:53.329946+0000","last_fullsized":"2024-09-19T08:54:53.329946+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:35.473243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330857+0000","last_change":"2024-09-19T08:54:31.430837+0000","last_active":"2024-09-19T08:54:53.330857+0000","last_peered":"2024-09-19T08:54:53.330857+0000","last_clean":"2024-09-19T08:54:53.330857+0000","last_became_active":"2024-09-19T08:54:31.430465+0000","last_became_peered":"2024-09-19T08:54:31.430465+0000","last_unstale":"2024-09-19T08:54:53.330857+0000","last_undegraded":"2024-09-19T08:54:53.330857+0000","last_fullsized":"2024-09-19T08:54:53.330857+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:50.524730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329067+0000","last_change":"2024-09-19T08:54:29.413803+0000","last_active":"2024-09-19T08:54:53.329067+0000","last_peered":"2024-09-19T08:54:53.329067+0000","last_clean":"2024-09-19T08:54:53.329067+0000","last_became_active":"2024-09-19T08:54:29.413400+0000","last_became_peered":"2024-09-19T08:54:29.413400+0000","last_unstale":"2024-09-19T08:54:53.329067+0000","last_undegraded":"2024-09-19T08:54:53.329067+0000","last_fullsized":"2024-09-19T08:54:53.329067+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:12.518454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327694+0000","last_change":"2024-09-19T08:54:31.428451+0000","last_active":"2024-09-19T08:54:53.327694+0000","last_peered":"2024-09-19T08:54:53.327694+0000","last_clean":"2024-09-19T08:54:53.327694+0000","last_became_active":"2024-09-19T08:54:31.428134+0000","last_became_peered":"2024-09-19T08:54:31.428134+0000","last_unstale":"2024-09-19T08:54:53.327694+0000","last_undegraded":"2024-09-19T08:54:53.327694+0000","last_fullsized":"2024-09-19T08:54:53.327694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:08.260183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329914+0000","last_change":"2024-09-19T08:54:29.414399+0000","last_active":"2024-09-19T08:54:53.329914+0000","last_peered":"2024-09-19T08:54:53.329914+0000","last_clean":"2024-09-19T08:54:53.329914+0000","last_became_active":"2024-09-19T08:54:29.413080+0000","last_became_peered":"2024-09-19T08:54:29.413080+0000","last_unstale":"2024-09-19T08:54:53.329914+0000","last_undegraded":"2024-09-19T08:54:53.329914+0000","last_fullsized":"2024-09-19T08:54:53.329914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:27.308297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329046+0000","last_change":"2024-09-19T08:54:31.434550+0000","last_active":"2024-09-19T08:54:53.329046+0000","last_peered":"2024-09-19T08:54:53.329046+0000","last_clean":"2024-09-19T08:54:53.329046+0000","last_became_active":"2024-09-19T08:54:31.434195+0000","last_became_peered":"2024-09-19T08:54:31.434195+0000","last_unstale":"2024-09-19T08:54:53.329046+0000","last_undegraded":"2024-09-19T08:54:53.329046+0000","last_fullsized":"2024-09-19T08:54:53.329046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:04.807833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.338857+0000","last_change":"2024-09-19T08:54:53.338857+0000","last_active":"2024-09-19T08:54:53.338857+0000","last_peered":"2024-09-19T08:54:53.338857+0000","last_clean":"2024-09-19T08:54:53.338857+0000","last_became_active":"2024-09-19T08:54:53.334162+0000","last_became_peered":"2024-09-19T08:54:53.334162+0000","last_unstale":"2024-09-19T08:54:53.338857+0000","last_undegraded":"2024-09-19T08:54:53.338857+0000","last_fullsized":"2024-09-19T08:54:53.338857+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:38.858918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331391+0000","last_change":"2024-09-19T08:54:31.441201+0000","last_active":"2024-09-19T08:54:53.331391+0000","last_peered":"2024-09-19T08:54:53.331391+0000","last_clean":"2024-09-19T08:54:53.331391+0000","last_became_active":"2024-09-19T08:54:31.440738+0000","last_became_peered":"2024-09-19T08:54:31.440738+0000","last_unstale":"2024-09-19T08:54:53.331391+0000","last_undegraded":"2024-09-19T08:54:53.331391+0000","last_fullsized":"2024-09-19T08:54:53.331391+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:39.118320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.332389+0000","last_change":"2024-09-19T08:54:31.435772+0000","last_active":"2024-09-19T08:54:53.332389+0000","last_peered":"2024-09-19T08:54:53.332389+0000","last_clean":"2024-09-19T08:54:53.332389+0000","last_became_active":"2024-09-19T08:54:31.435257+0000","last_became_peered":"2024-09-19T08:54:31.435257+0000","last_unstale":"2024-09-19T08:54:53.332389+0000","last_undegraded":"2024-09-19T08:54:53.332389+0000","last_fullsized":"2024-09-19T08:54:53.332389+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:44:12.219054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.341203+0000","last_change":"2024-09-19T08:54:53.341203+0000","last_active":"2024-09-19T08:54:53.341203+0000","last_peered":"2024-09-19T08:54:53.341203+0000","last_clean":"2024-09-19T08:54:53.341203+0000","last_became_active":"2024-09-19T08:54:53.336115+0000","last_became_peered":"2024-09-19T08:54:53.336115+0000","last_unstale":"2024-09-19T08:54:53.341203+0000","last_undegraded":"2024-09-19T08:54:53.341203+0000","last_fullsized":"2024-09-19T08:54:53.341203+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:31.532599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330452+0000","last_change":"2024-09-19T08:54:31.427103+0000","last_active":"2024-09-19T08:54:53.330452+0000","last_peered":"2024-09-19T08:54:53.330452+0000","last_clean":"2024-09-19T08:54:53.330452+0000","last_became_active":"2024-09-19T08:54:31.425958+0000","last_became_peered":"2024-09-19T08:54:31.425958+0000","last_unstale":"2024-09-19T08:54:53.330452+0000","last_undegraded":"2024-09-19T08:54:53.330452+0000","last_fullsized":"2024-09-19T08:54:53.330452+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:36.840940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331317+0000","last_change":"2024-09-19T08:54:29.415209+0000","last_active":"2024-09-19T08:54:53.331317+0000","last_peered":"2024-09-19T08:54:53.331317+0000","last_clean":"2024-09-19T08:54:53.331317+0000","last_became_active":"2024-09-19T08:54:29.414806+0000","last_became_peered":"2024-09-19T08:54:29.414806+0000","last_unstale":"2024-09-19T08:54:53.331317+0000","last_undegraded":"2024-09-19T08:54:53.331317+0000","last_fullsized":"2024-09-19T08:54:53.331317+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:47.764231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331348+0000","last_change":"2024-09-19T08:54:31.434027+0000","last_active":"2024-09-19T08:54:53.331348+0000","last_peered":"2024-09-19T08:54:53.331348+0000","last_clean":"2024-09-19T08:54:53.331348+0000","last_became_active":"2024-09-19T08:54:31.433687+0000","last_became_peered":"2024-09-19T08:54:31.433687+0000","last_unstale":"2024-09-19T08:54:53.331348+0000","last_undegraded":"2024-09-19T08:54:53.331348+0000","last_fullsized":"2024-09-19T08:54:53.331348+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:56.462128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329231+0000","last_change":"2024-09-19T08:54:29.675502+0000","last_active":"2024-09-19T08:54:53.329231+0000","last_peered":"2024-09-19T08:54:53.329231+0000","last_clean":"2024-09-19T08:54:53.329231+0000","last_became_active":"2024-09-19T08:54:29.675158+0000","last_became_peered":"2024-09-19T08:54:29.675158+0000","last_unstale":"2024-09-19T08:54:53.329231+0000","last_undegraded":"2024-09-19T08:54:53.329231+0000","last_fullsized":"2024-09-19T08:54:53.329231+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:24:59.377521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.334600+0000","last_change":"2024-09-19T08:54:53.334264+0000","last_active":"2024-09-19T08:54:53.334600+0000","last_peered":"2024-09-19T08:54:53.334600+0000","last_clean":"2024-09-19T08:54:53.334600+0000","last_became_active":"2024-09-19T08:54:53.333959+0000","last_became_peered":"2024-09-19T08:54:53.333959+0000","last_unstale":"2024-09-19T08:54:53.334600+0000","last_undegraded":"2024-09-19T08:54:53.334600+0000","last_fullsized":"2024-09-19T08:54:53.334600+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:14.085033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330562+0000","last_change":"2024-09-19T08:54:29.414478+0000","last_active":"2024-09-19T08:54:53.330562+0000","last_peered":"2024-09-19T08:54:53.330562+0000","last_clean":"2024-09-19T08:54:53.330562+0000","last_became_active":"2024-09-19T08:54:29.414152+0000","last_became_peered":"2024-09-19T08:54:29.414152+0000","last_unstale":"2024-09-19T08:54:53.330562+0000","last_undegraded":"2024-09-19T08:54:53.330562+0000","last_fullsized":"2024-09-19T08:54:53.330562+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:17.477340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":61997,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":128,"num_read_kb":125,"num_write":80,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":185991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":66,"ondisk_log_size":66,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579931,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":897024,"data_stored":435723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841567,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28564,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716588,"statfs":{"total":95995035648,"available":95965786112,"internally_reserved":0,"allocated":1576960,"data_stored":1087601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005093,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":901120,"data_stored":436305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234025,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":436327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462958,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28496,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716656,"statfs":{"total":95995035648,"available":95965855744,"internally_reserved":0,"allocated":1499136,"data_stored":1026790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593779,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":901120,"data_stored":435840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822712,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32660,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712492,"statfs":{"total":95995035648,"available":95961591808,"internally_reserved":0,"allocated":1507328,"data_stored":1026390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986237,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":901120,"data_stored":435745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215169,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":436061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411399,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":496956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":496922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":901120,"data_stored":435813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":61199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":61233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":61393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:55:41.965 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T08:55:41.965 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T08:55:41.965 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-19T08:55:41.966 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-19T08:55:42.210 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:42.605 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:42 smithi092 ceph-mon[31407]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:55:42.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.682+0000 7f99335e2640 1 -- 172.21.15.92:0/4010116097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f992c102d90 msgr2=0x7f992c103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:42.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.682+0000 7f99335e2640 1 --2- 172.21.15.92:0/4010116097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f992c102d90 0x7f992c103170 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9928009930 tx=0x7f992802a420 comp rx=0 tx=0).stop 2024-09-19T08:55:42.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.682+0000 7f99335e2640 1 -- 172.21.15.92:0/4010116097 shutdown_connections 2024-09-19T08:55:42.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.682+0000 7f99335e2640 1 --2- 172.21.15.92:0/4010116097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f992c108290 0x7f992c10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:42.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.682+0000 7f99335e2640 1 --2- 172.21.15.92:0/4010116097 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f992c103740 0x7f992c107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:42.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.682+0000 7f99335e2640 1 --2- 172.21.15.92:0/4010116097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f992c102d90 0x7f992c103170 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:42.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.682+0000 7f99335e2640 1 -- 172.21.15.92:0/4010116097 >> 172.21.15.92:0/4010116097 conn(0x7f992c0fc7d0 msgr2=0x7f992c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:42.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.683+0000 7f99335e2640 1 -- 172.21.15.92:0/4010116097 shutdown_connections 2024-09-19T08:55:42.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.683+0000 7f99335e2640 1 -- 172.21.15.92:0/4010116097 wait complete. 2024-09-19T08:55:42.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.683+0000 7f99335e2640 1 Processor -- start 2024-09-19T08:55:42.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.683+0000 7f99335e2640 1 -- start start 2024-09-19T08:55:42.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.683+0000 7f99335e2640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f992c102d90 0x7f992c1985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:42.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.683+0000 7f99335e2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f992c103740 0x7f992c198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:42.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.683+0000 7f99335e2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f992c108290 0x7f992c19cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:42.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.683+0000 7f99335e2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f992c1120d0 con 0x7f992c108290 2024-09-19T08:55:42.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.683+0000 7f99335e2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f992c111f50 con 0x7f992c103740 2024-09-19T08:55:42.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.683+0000 7f99335e2640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f992c112250 con 0x7f992c102d90 2024-09-19T08:55:42.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.684+0000 7f9931b7f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f992c108290 0x7f992c19cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:42.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.684+0000 7f9931b7f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f992c108290 0x7f992c19cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46116/0 (socket says 172.21.15.92:46116) 2024-09-19T08:55:42.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.684+0000 7f9931b7f640 1 -- 172.21.15.92:0/3105068627 learned_addr learned my addr 172.21.15.92:0/3105068627 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:42.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.684+0000 7f9930b7d640 1 --2- 172.21.15.92:0/3105068627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f992c103740 0x7f992c198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:42.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.684+0000 7f993137e640 1 --2- 172.21.15.92:0/3105068627 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f992c102d90 0x7f992c1985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:42.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.684+0000 7f9931b7f640 1 -- 172.21.15.92:0/3105068627 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f992c102d90 msgr2=0x7f992c1985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:42.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.684+0000 7f9931b7f640 1 --2- 172.21.15.92:0/3105068627 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f992c102d90 0x7f992c1985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:42.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.684+0000 7f9931b7f640 1 -- 172.21.15.92:0/3105068627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f992c103740 msgr2=0x7f992c198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:42.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.684+0000 7f9931b7f640 1 --2- 172.21.15.92:0/3105068627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f992c103740 0x7f992c198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:42.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.684+0000 7f9931b7f640 1 -- 172.21.15.92:0/3105068627 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f992c19d580 con 0x7f992c108290 2024-09-19T08:55:42.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.684+0000 7f9931b7f640 1 --2- 172.21.15.92:0/3105068627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f992c108290 0x7f992c19cea0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f992400b970 tx=0x7f992400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:42.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.684+0000 7f99227fc640 1 -- 172.21.15.92:0/3105068627 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9924019070 con 0x7f992c108290 2024-09-19T08:55:42.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.684+0000 7f99335e2640 1 -- 172.21.15.92:0/3105068627 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f992c19d870 con 0x7f992c108290 2024-09-19T08:55:42.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.684+0000 7f99227fc640 1 -- 172.21.15.92:0/3105068627 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f992400cb40 con 0x7f992c108290 2024-09-19T08:55:42.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.684+0000 7f99227fc640 1 -- 172.21.15.92:0/3105068627 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9924007650 con 0x7f992c108290 2024-09-19T08:55:42.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.684+0000 7f99335e2640 1 -- 172.21.15.92:0/3105068627 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f992c1a5150 con 0x7f992c108290 2024-09-19T08:55:42.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.685+0000 7f99335e2640 1 -- 172.21.15.92:0/3105068627 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f992c06a7f0 con 0x7f992c108290 2024-09-19T08:55:42.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.686+0000 7f99227fc640 1 -- 172.21.15.92:0/3105068627 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f992401c070 con 0x7f992c108290 2024-09-19T08:55:42.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.687+0000 7f99227fc640 1 --2- 172.21.15.92:0/3105068627 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f99180a32d0 0x7f99180a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:42.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.687+0000 7f993137e640 1 --2- 172.21.15.92:0/3105068627 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f99180a32d0 0x7f99180a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:42.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.687+0000 7f99227fc640 1 -- 172.21.15.92:0/3105068627 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f99240cf440 con 0x7f992c108290 2024-09-19T08:55:42.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.687+0000 7f993137e640 1 --2- 172.21.15.92:0/3105068627 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f99180a32d0 0x7f99180a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9928000c00 tx=0x7f9928031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:42.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.690+0000 7f99227fc640 1 -- 172.21.15.92:0/3105068627 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f992409bac0 con 0x7f992c108290 2024-09-19T08:55:42.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:42 smithi167 ceph-mon[35359]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:55:42.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:42 smithi190 ceph-mon[35358]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:55:42.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.894+0000 7f99335e2640 1 -- 172.21.15.92:0/3105068627 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f992c103170 con 0x7f992c108290 2024-09-19T08:55:42.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.894+0000 7f99227fc640 1 -- 172.21.15.92:0/3105068627 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f992c103170 con 0x7f992c108290 2024-09-19T08:55:42.894 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:55:42.894 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T08:55:42.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.897+0000 7f99335e2640 1 -- 172.21.15.92:0/3105068627 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f99180a32d0 msgr2=0x7f99180a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:42.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.897+0000 7f99335e2640 1 --2- 172.21.15.92:0/3105068627 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f99180a32d0 0x7f99180a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9928000c00 tx=0x7f9928031490 comp rx=0 tx=0).stop 2024-09-19T08:55:42.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.897+0000 7f99335e2640 1 -- 172.21.15.92:0/3105068627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f992c108290 msgr2=0x7f992c19cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:42.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.897+0000 7f99335e2640 1 --2- 172.21.15.92:0/3105068627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f992c108290 0x7f992c19cea0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f992400b970 tx=0x7f992400be30 comp rx=0 tx=0).stop 2024-09-19T08:55:42.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.897+0000 7f99335e2640 1 -- 172.21.15.92:0/3105068627 shutdown_connections 2024-09-19T08:55:42.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.897+0000 7f99335e2640 1 --2- 172.21.15.92:0/3105068627 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f99180a32d0 0x7f99180a5790 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:42.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.897+0000 7f99335e2640 1 --2- 172.21.15.92:0/3105068627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f992c108290 0x7f992c19cea0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:42.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.897+0000 7f99335e2640 1 --2- 172.21.15.92:0/3105068627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f992c103740 0x7f992c198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:42.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.897+0000 7f99335e2640 1 --2- 172.21.15.92:0/3105068627 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f992c102d90 0x7f992c1985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:42.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.897+0000 7f99335e2640 1 -- 172.21.15.92:0/3105068627 >> 172.21.15.92:0/3105068627 conn(0x7f992c0fc7d0 msgr2=0x7f992c105d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:42.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.897+0000 7f99335e2640 1 -- 172.21.15.92:0/3105068627 shutdown_connections 2024-09-19T08:55:42.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:42.898+0000 7f99335e2640 1 -- 172.21.15.92:0/3105068627 wait complete. 2024-09-19T08:55:43.600 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:43 smithi092 ceph-mon[31407]: pgmap v307: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:55:43.600 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:43 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3105068627' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T08:55:43.628 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-19T08:55:43.628 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:55:43.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:43 smithi167 ceph-mon[35359]: pgmap v307: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:55:43.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:43 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3105068627' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T08:55:43.872 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:43.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:43 smithi190 ceph-mon[35358]: pgmap v307: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:55:43.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:43 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3105068627' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T08:55:44.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.332+0000 7f29f68c6640 1 -- 172.21.15.92:0/571184737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29f010c170 msgr2=0x7f29f010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:44.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.332+0000 7f29f68c6640 1 --2- 172.21.15.92:0/571184737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29f010c170 0x7f29f010e610 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f29e8009ca0 tx=0x7f29e802a950 comp rx=0 tx=0).stop 2024-09-19T08:55:44.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.332+0000 7f29f68c6640 1 -- 172.21.15.92:0/571184737 shutdown_connections 2024-09-19T08:55:44.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.332+0000 7f29f68c6640 1 --2- 172.21.15.92:0/571184737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29f010c170 0x7f29f010e610 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:44.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.332+0000 7f29f68c6640 1 --2- 172.21.15.92:0/571184737 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29f0103660 0x7f29f010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:44.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.332+0000 7f29f68c6640 1 --2- 172.21.15.92:0/571184737 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29f0102d40 0x7f29f0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:44.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.332+0000 7f29f68c6640 1 -- 172.21.15.92:0/571184737 >> 172.21.15.92:0/571184737 conn(0x7f29f00fc7a0 msgr2=0x7f29f00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:44.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.332+0000 7f29f68c6640 1 -- 172.21.15.92:0/571184737 shutdown_connections 2024-09-19T08:55:44.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.332+0000 7f29f68c6640 1 -- 172.21.15.92:0/571184737 wait complete. 2024-09-19T08:55:44.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.333+0000 7f29f68c6640 1 Processor -- start 2024-09-19T08:55:44.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.333+0000 7f29f68c6640 1 -- start start 2024-09-19T08:55:44.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.333+0000 7f29f68c6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29f0102d40 0x7f29f01009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:44.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.333+0000 7f29f68c6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29f0103660 0x7f29f0100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:44.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.333+0000 7f29f68c6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29f010c170 0x7f29f0101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:44.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.333+0000 7f29f68c6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f29f0111fd0 con 0x7f29f0102d40 2024-09-19T08:55:44.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.333+0000 7f29f68c6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f29f0111e50 con 0x7f29f0103660 2024-09-19T08:55:44.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.333+0000 7f29f68c6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f29f0112150 con 0x7f29f010c170 2024-09-19T08:55:44.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.333+0000 7f29effff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29f0102d40 0x7f29f01009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:44.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.333+0000 7f29effff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29f0102d40 0x7f29f01009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46130/0 (socket says 172.21.15.92:46130) 2024-09-19T08:55:44.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.333+0000 7f29effff640 1 -- 172.21.15.92:0/978702157 learned_addr learned my addr 172.21.15.92:0/978702157 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:44.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.334+0000 7f29effff640 1 -- 172.21.15.92:0/978702157 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29f010c170 msgr2=0x7f29f0101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:44.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.334+0000 7f29effff640 1 --2- 172.21.15.92:0/978702157 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29f010c170 0x7f29f0101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:44.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.334+0000 7f29effff640 1 -- 172.21.15.92:0/978702157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29f0103660 msgr2=0x7f29f0100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:44.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.334+0000 7f29effff640 1 --2- 172.21.15.92:0/978702157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29f0103660 0x7f29f0100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:44.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.334+0000 7f29effff640 1 -- 172.21.15.92:0/978702157 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f01a6950 con 0x7f29f0102d40 2024-09-19T08:55:44.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.334+0000 7f29effff640 1 --2- 172.21.15.92:0/978702157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29f0102d40 0x7f29f01009a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f29e000c970 tx=0x7f29e000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:44.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.334+0000 7f29ed7fa640 1 -- 172.21.15.92:0/978702157 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e0007bb0 con 0x7f29f0102d40 2024-09-19T08:55:44.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.334+0000 7f29f68c6640 1 -- 172.21.15.92:0/978702157 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29f01a6c40 con 0x7f29f0102d40 2024-09-19T08:55:44.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.334+0000 7f29ed7fa640 1 -- 172.21.15.92:0/978702157 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29e0007d50 con 0x7f29f0102d40 2024-09-19T08:55:44.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.334+0000 7f29ed7fa640 1 -- 172.21.15.92:0/978702157 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e001d060 con 0x7f29f0102d40 2024-09-19T08:55:44.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.334+0000 7f29f68c6640 1 -- 172.21.15.92:0/978702157 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29f01a7130 con 0x7f29f0102d40 2024-09-19T08:55:44.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.335+0000 7f29f68c6640 1 -- 172.21.15.92:0/978702157 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29f0103120 con 0x7f29f0102d40 2024-09-19T08:55:44.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.336+0000 7f29ed7fa640 1 -- 172.21.15.92:0/978702157 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f29e0004fc0 con 0x7f29f0102d40 2024-09-19T08:55:44.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.337+0000 7f29ed7fa640 1 --2- 172.21.15.92:0/978702157 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f29d80a32d0 0x7f29d80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:44.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.337+0000 7f29ef7fe640 1 --2- 172.21.15.92:0/978702157 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f29d80a32d0 0x7f29d80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:44.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.337+0000 7f29ed7fa640 1 -- 172.21.15.92:0/978702157 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f29e00cf890 con 0x7f29f0102d40 2024-09-19T08:55:44.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.337+0000 7f29ef7fe640 1 --2- 172.21.15.92:0/978702157 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f29d80a32d0 0x7f29d80a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f29f0102430 tx=0x7f29e4006d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:44.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.341+0000 7f29ed7fa640 1 -- 172.21.15.92:0/978702157 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f29e0014030 con 0x7f29f0102d40 2024-09-19T08:55:44.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.542+0000 7f29f68c6640 1 -- 172.21.15.92:0/978702157 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f29f0101ed0 con 0x7f29f0102d40 2024-09-19T08:55:44.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.543+0000 7f29ed7fa640 1 -- 172.21.15.92:0/978702157 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f29e009c450 con 0x7f29f0102d40 2024-09-19T08:55:44.543 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:55:44.543 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T08:55:44.543 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T08:55:44.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.545+0000 7f29f68c6640 1 -- 172.21.15.92:0/978702157 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f29d80a32d0 msgr2=0x7f29d80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:44.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.545+0000 7f29f68c6640 1 --2- 172.21.15.92:0/978702157 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f29d80a32d0 0x7f29d80a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f29f0102430 tx=0x7f29e4006d30 comp rx=0 tx=0).stop 2024-09-19T08:55:44.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.545+0000 7f29f68c6640 1 -- 172.21.15.92:0/978702157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29f0102d40 msgr2=0x7f29f01009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:44.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.545+0000 7f29f68c6640 1 --2- 172.21.15.92:0/978702157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29f0102d40 0x7f29f01009a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f29e000c970 tx=0x7f29e000ce30 comp rx=0 tx=0).stop 2024-09-19T08:55:44.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.546+0000 7f29f68c6640 1 -- 172.21.15.92:0/978702157 shutdown_connections 2024-09-19T08:55:44.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.546+0000 7f29f68c6640 1 --2- 172.21.15.92:0/978702157 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29f010c170 0x7f29f0101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:44.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.546+0000 7f29f68c6640 1 --2- 172.21.15.92:0/978702157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29f0103660 0x7f29f0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:44.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.546+0000 7f29f68c6640 1 --2- 172.21.15.92:0/978702157 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f29d80a32d0 0x7f29d80a5790 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:44.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.546+0000 7f29f68c6640 1 --2- 172.21.15.92:0/978702157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29f0102d40 0x7f29f01009a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:44.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.546+0000 7f29f68c6640 1 -- 172.21.15.92:0/978702157 >> 172.21.15.92:0/978702157 conn(0x7f29f00fc7a0 msgr2=0x7f29f00fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:44.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.546+0000 7f29f68c6640 1 -- 172.21.15.92:0/978702157 shutdown_connections 2024-09-19T08:55:44.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:44.546+0000 7f29f68c6640 1 -- 172.21.15.92:0/978702157 wait complete. 2024-09-19T08:55:45.202 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:55:45.448 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:45.706 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:45 smithi092 ceph-mon[31407]: pgmap v308: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:55:45.707 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:45 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/978702157' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:55:45.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:45 smithi167 ceph-mon[35359]: pgmap v308: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:55:45.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:45 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/978702157' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:55:45.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:45 smithi190 ceph-mon[35358]: pgmap v308: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:55:45.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:45 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/978702157' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:55:45.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.891+0000 7f87d5518640 1 -- 172.21.15.92:0/2939106516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87d0100e20 msgr2=0x7f87d0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:45.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.891+0000 7f87d5518640 1 --2- 172.21.15.92:0/2939106516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87d0100e20 0x7f87d0101200 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f87c0009ca0 tx=0x7f87c002a950 comp rx=0 tx=0).stop 2024-09-19T08:55:45.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.891+0000 7f87d5518640 1 -- 172.21.15.92:0/2939106516 shutdown_connections 2024-09-19T08:55:45.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.891+0000 7f87d5518640 1 --2- 172.21.15.92:0/2939106516 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f87d0102ef0 0x7f87d010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:45.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.891+0000 7f87d5518640 1 --2- 172.21.15.92:0/2939106516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87d0102570 0x7f87d01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:45.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.891+0000 7f87d5518640 1 --2- 172.21.15.92:0/2939106516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87d0100e20 0x7f87d0101200 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:45.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.891+0000 7f87d5518640 1 -- 172.21.15.92:0/2939106516 >> 172.21.15.92:0/2939106516 conn(0x7f87d00fc7d0 msgr2=0x7f87d00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:45.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.891+0000 7f87d5518640 1 -- 172.21.15.92:0/2939106516 shutdown_connections 2024-09-19T08:55:45.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.891+0000 7f87d5518640 1 -- 172.21.15.92:0/2939106516 wait complete. 2024-09-19T08:55:45.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.891+0000 7f87d5518640 1 Processor -- start 2024-09-19T08:55:45.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.892+0000 7f87d5518640 1 -- start start 2024-09-19T08:55:45.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.892+0000 7f87d5518640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f87d0100e20 0x7f87d0197450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:45.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.892+0000 7f87d5518640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87d0102570 0x7f87d0197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:45.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.892+0000 7f87d5518640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87d0102ef0 0x7f87d019bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:45.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.892+0000 7f87d5518640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f87d0110f50 con 0x7f87d0102570 2024-09-19T08:55:45.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.892+0000 7f87d5518640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f87d0110dd0 con 0x7f87d0102ef0 2024-09-19T08:55:45.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.892+0000 7f87d5518640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f87d01110d0 con 0x7f87d0100e20 2024-09-19T08:55:45.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.892+0000 7f87ce7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87d0102570 0x7f87d0197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:45.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.892+0000 7f87ce7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87d0102570 0x7f87d0197990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46158/0 (socket says 172.21.15.92:46158) 2024-09-19T08:55:45.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.892+0000 7f87ce7fc640 1 -- 172.21.15.92:0/3551125665 learned_addr learned my addr 172.21.15.92:0/3551125665 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:45.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.892+0000 7f87cf7fe640 1 --2- 172.21.15.92:0/3551125665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87d0102ef0 0x7f87d019bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:45.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.892+0000 7f87ceffd640 1 --2- 172.21.15.92:0/3551125665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f87d0100e20 0x7f87d0197450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:45.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.892+0000 7f87ce7fc640 1 -- 172.21.15.92:0/3551125665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f87d0100e20 msgr2=0x7f87d0197450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:45.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.892+0000 7f87ce7fc640 1 --2- 172.21.15.92:0/3551125665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f87d0100e20 0x7f87d0197450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:45.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.892+0000 7f87ce7fc640 1 -- 172.21.15.92:0/3551125665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87d0102ef0 msgr2=0x7f87d019bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:45.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.892+0000 7f87ce7fc640 1 --2- 172.21.15.92:0/3551125665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87d0102ef0 0x7f87d019bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:45.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.892+0000 7f87ce7fc640 1 -- 172.21.15.92:0/3551125665 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87d019c400 con 0x7f87d0102570 2024-09-19T08:55:45.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.892+0000 7f87ceffd640 1 --2- 172.21.15.92:0/3551125665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f87d0100e20 0x7f87d0197450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:55:45.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.892+0000 7f87cf7fe640 1 --2- 172.21.15.92:0/3551125665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87d0102ef0 0x7f87d019bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:55:45.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.892+0000 7f87ce7fc640 1 --2- 172.21.15.92:0/3551125665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87d0102570 0x7f87d0197990 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f87b800c890 tx=0x7f87b800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:45.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.892+0000 7f87c7fff640 1 -- 172.21.15.92:0/3551125665 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b8004220 con 0x7f87d0102570 2024-09-19T08:55:45.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.892+0000 7f87c7fff640 1 -- 172.21.15.92:0/3551125665 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87b80043c0 con 0x7f87d0102570 2024-09-19T08:55:45.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.892+0000 7f87d5518640 1 -- 172.21.15.92:0/3551125665 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87d019c6f0 con 0x7f87d0102570 2024-09-19T08:55:45.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.892+0000 7f87c7fff640 1 -- 172.21.15.92:0/3551125665 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b80049e0 con 0x7f87d0102570 2024-09-19T08:55:45.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.893+0000 7f87d5518640 1 -- 172.21.15.92:0/3551125665 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87d01a3fd0 con 0x7f87d0102570 2024-09-19T08:55:45.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.893+0000 7f87d5518640 1 -- 172.21.15.92:0/3551125665 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87d0101200 con 0x7f87d0102570 2024-09-19T08:55:45.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.895+0000 7f87c7fff640 1 -- 172.21.15.92:0/3551125665 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f87b80079b0 con 0x7f87d0102570 2024-09-19T08:55:45.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.895+0000 7f87c7fff640 1 --2- 172.21.15.92:0/3551125665 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f87bc0a32d0 0x7f87bc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:45.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.895+0000 7f87ceffd640 1 --2- 172.21.15.92:0/3551125665 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f87bc0a32d0 0x7f87bc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:45.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.896+0000 7f87c7fff640 1 -- 172.21.15.92:0/3551125665 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f87b80cfc00 con 0x7f87d0102570 2024-09-19T08:55:45.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.896+0000 7f87ceffd640 1 --2- 172.21.15.92:0/3551125665 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f87bc0a32d0 0x7f87bc0a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f87c0006010 tx=0x7f87c0005f80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:45.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:45.898+0000 7f87c7fff640 1 -- 172.21.15.92:0/3551125665 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f87b8014030 con 0x7f87d0102570 2024-09-19T08:55:46.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:46.100+0000 7f87d5518640 1 -- 172.21.15.92:0/3551125665 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f87d01987b0 con 0x7f87d0102570 2024-09-19T08:55:46.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:46.100+0000 7f87c7fff640 1 -- 172.21.15.92:0/3551125665 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f87d01987b0 con 0x7f87d0102570 2024-09-19T08:55:46.100 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:55:46.101 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T08:55:46.101 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T08:55:46.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:46.102+0000 7f87d5518640 1 -- 172.21.15.92:0/3551125665 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f87bc0a32d0 msgr2=0x7f87bc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:46.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:46.102+0000 7f87d5518640 1 --2- 172.21.15.92:0/3551125665 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f87bc0a32d0 0x7f87bc0a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f87c0006010 tx=0x7f87c0005f80 comp rx=0 tx=0).stop 2024-09-19T08:55:46.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:46.102+0000 7f87d5518640 1 -- 172.21.15.92:0/3551125665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87d0102570 msgr2=0x7f87d0197990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:46.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:46.102+0000 7f87d5518640 1 --2- 172.21.15.92:0/3551125665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87d0102570 0x7f87d0197990 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f87b800c890 tx=0x7f87b800cd50 comp rx=0 tx=0).stop 2024-09-19T08:55:46.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:46.102+0000 7f87d5518640 1 -- 172.21.15.92:0/3551125665 shutdown_connections 2024-09-19T08:55:46.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:46.102+0000 7f87d5518640 1 --2- 172.21.15.92:0/3551125665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87d0102ef0 0x7f87d019bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:46.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:46.102+0000 7f87d5518640 1 --2- 172.21.15.92:0/3551125665 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f87bc0a32d0 0x7f87bc0a5790 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:46.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:46.102+0000 7f87d5518640 1 --2- 172.21.15.92:0/3551125665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87d0102570 0x7f87d0197990 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:46.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:46.102+0000 7f87d5518640 1 --2- 172.21.15.92:0/3551125665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f87d0100e20 0x7f87d0197450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:46.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:46.102+0000 7f87d5518640 1 -- 172.21.15.92:0/3551125665 >> 172.21.15.92:0/3551125665 conn(0x7f87d00fc7d0 msgr2=0x7f87d00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:46.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:46.103+0000 7f87d5518640 1 -- 172.21.15.92:0/3551125665 shutdown_connections 2024-09-19T08:55:46.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:46.103+0000 7f87d5518640 1 -- 172.21.15.92:0/3551125665 wait complete. 2024-09-19T08:55:46.659 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:55:46.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:46 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3551125665' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:55:46.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:46 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3551125665' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:55:46.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:46 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3551125665' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:55:46.903 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:47.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.338+0000 7fbe10b48640 1 -- 172.21.15.92:0/2543995666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe0c103760 msgr2=0x7fbe0c107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:47.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.338+0000 7fbe10b48640 1 --2- 172.21.15.92:0/2543995666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe0c103760 0x7fbe0c107ba0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbe00009930 tx=0x7fbe0002a420 comp rx=0 tx=0).stop 2024-09-19T08:55:47.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.339+0000 7fbe10b48640 1 -- 172.21.15.92:0/2543995666 shutdown_connections 2024-09-19T08:55:47.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.339+0000 7fbe10b48640 1 --2- 172.21.15.92:0/2543995666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe0c1082e0 0x7fbe0c10ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:47.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.339+0000 7fbe10b48640 1 --2- 172.21.15.92:0/2543995666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe0c103760 0x7fbe0c107ba0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:47.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.339+0000 7fbe10b48640 1 --2- 172.21.15.92:0/2543995666 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbe0c102db0 0x7fbe0c103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:47.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.339+0000 7fbe10b48640 1 -- 172.21.15.92:0/2543995666 >> 172.21.15.92:0/2543995666 conn(0x7fbe0c0fc7d0 msgr2=0x7fbe0c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:47.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.339+0000 7fbe10b48640 1 -- 172.21.15.92:0/2543995666 shutdown_connections 2024-09-19T08:55:47.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.339+0000 7fbe10b48640 1 -- 172.21.15.92:0/2543995666 wait complete. 2024-09-19T08:55:47.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.339+0000 7fbe10b48640 1 Processor -- start 2024-09-19T08:55:47.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.339+0000 7fbe10b48640 1 -- start start 2024-09-19T08:55:47.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.340+0000 7fbe10b48640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbe0c102db0 0x7fbe0c1a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:47.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.340+0000 7fbe10b48640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe0c103760 0x7fbe0c1a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:47.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.340+0000 7fbe10b48640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe0c1082e0 0x7fbe0c19a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:47.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.340+0000 7fbe10b48640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c112150 con 0x7fbe0c1082e0 2024-09-19T08:55:47.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.340+0000 7fbe10b48640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c111fd0 con 0x7fbe0c103760 2024-09-19T08:55:47.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.340+0000 7fbe10b48640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c1122d0 con 0x7fbe0c102db0 2024-09-19T08:55:47.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.340+0000 7fbe0ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe0c1082e0 0x7fbe0c19a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:47.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.340+0000 7fbe0ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe0c1082e0 0x7fbe0c19a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46176/0 (socket says 172.21.15.92:46176) 2024-09-19T08:55:47.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.340+0000 7fbe0ad9d640 1 -- 172.21.15.92:0/2823178458 learned_addr learned my addr 172.21.15.92:0/2823178458 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:47.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.340+0000 7fbe09d9b640 1 --2- 172.21.15.92:0/2823178458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe0c103760 0x7fbe0c1a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:47.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.340+0000 7fbe0a59c640 1 --2- 172.21.15.92:0/2823178458 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbe0c102db0 0x7fbe0c1a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:47.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.340+0000 7fbe0ad9d640 1 -- 172.21.15.92:0/2823178458 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbe0c102db0 msgr2=0x7fbe0c1a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:47.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.340+0000 7fbe0ad9d640 1 --2- 172.21.15.92:0/2823178458 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbe0c102db0 0x7fbe0c1a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:47.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.340+0000 7fbe0ad9d640 1 -- 172.21.15.92:0/2823178458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe0c103760 msgr2=0x7fbe0c1a0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:47.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.340+0000 7fbe0ad9d640 1 --2- 172.21.15.92:0/2823178458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe0c103760 0x7fbe0c1a0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:47.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.340+0000 7fbe0ad9d640 1 -- 172.21.15.92:0/2823178458 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe0c19afa0 con 0x7fbe0c1082e0 2024-09-19T08:55:47.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.340+0000 7fbe0a59c640 1 --2- 172.21.15.92:0/2823178458 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbe0c102db0 0x7fbe0c1a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:55:47.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.340+0000 7fbe0ad9d640 1 --2- 172.21.15.92:0/2823178458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe0c1082e0 0x7fbe0c19a800 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbe0400b970 tx=0x7fbe0400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:47.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.340+0000 7fbdfb7fe640 1 -- 172.21.15.92:0/2823178458 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe04019070 con 0x7fbe0c1082e0 2024-09-19T08:55:47.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.341+0000 7fbe10b48640 1 -- 172.21.15.92:0/2823178458 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe0c19b290 con 0x7fbe0c1082e0 2024-09-19T08:55:47.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.341+0000 7fbdfb7fe640 1 -- 172.21.15.92:0/2823178458 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe0400cb40 con 0x7fbe0c1082e0 2024-09-19T08:55:47.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.341+0000 7fbdfb7fe640 1 -- 172.21.15.92:0/2823178458 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe04007650 con 0x7fbe0c1082e0 2024-09-19T08:55:47.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.341+0000 7fbe10b48640 1 -- 172.21.15.92:0/2823178458 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe0c1a7440 con 0x7fbe0c1082e0 2024-09-19T08:55:47.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.341+0000 7fbe10b48640 1 -- 172.21.15.92:0/2823178458 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe0c06a7d0 con 0x7fbe0c1082e0 2024-09-19T08:55:47.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.343+0000 7fbdfb7fe640 1 -- 172.21.15.92:0/2823178458 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fbe0401c070 con 0x7fbe0c1082e0 2024-09-19T08:55:47.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.343+0000 7fbdfb7fe640 1 --2- 172.21.15.92:0/2823178458 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fbdf40a32d0 0x7fbdf40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:47.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.343+0000 7fbe0a59c640 1 --2- 172.21.15.92:0/2823178458 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fbdf40a32d0 0x7fbdf40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:47.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.343+0000 7fbdfb7fe640 1 -- 172.21.15.92:0/2823178458 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fbe040cf440 con 0x7fbe0c1082e0 2024-09-19T08:55:47.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.344+0000 7fbe0a59c640 1 --2- 172.21.15.92:0/2823178458 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fbdf40a32d0 0x7fbdf40a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc009930 tx=0x7fbdfc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:47.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.346+0000 7fbdfb7fe640 1 -- 172.21.15.92:0/2823178458 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbe0409bac0 con 0x7fbe0c1082e0 2024-09-19T08:55:47.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.513+0000 7fbe10b48640 1 -- 172.21.15.92:0/2823178458 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbe0c1a7670 con 0x7fbe0c1082e0 2024-09-19T08:55:47.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.515+0000 7fbdfb7fe640 1 -- 172.21.15.92:0/2823178458 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22782 (secure 0 0 0) 0x7fbe0409fdc0 con 0x7fbe0c1082e0 2024-09-19T08:55:47.515 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:55:47.515 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":82,"fsid":"91ff74f2-7663-11ef-bceb-c7b262605968","created":"2024-09-19T08:47:08.162150+0000","modified":"2024-09-19T08:54:53.324204+0000","last_up_change":"2024-09-19T08:53:43.021949+0000","last_in_change":"2024-09-19T08:53:19.246805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:50:04.482034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:54:28.005336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:54:30.188980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd104fe2-b828-4c98-a499-b212717f2997","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6803","nonce":4232030626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6805","nonce":4232030626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6809","nonce":4232030626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6807","nonce":4232030626}]},"public_addr":"172.21.15.92:6803/4232030626","cluster_addr":"172.21.15.92:6805/4232030626","heartbeat_back_addr":"172.21.15.92:6809/4232030626","heartbeat_front_addr":"172.21.15.92:6807/4232030626","state":["exists","up"]},{"osd":1,"uuid":"0f725330-5e61-413c-b3c8-41bc2c0d8e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6801","nonce":4163493234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6803","nonce":4163493234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6807","nonce":4163493234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6805","nonce":4163493234}]},"public_addr":"172.21.15.167:6801/4163493234","cluster_addr":"172.21.15.167:6803/4163493234","heartbeat_back_addr":"172.21.15.167:6807/4163493234","heartbeat_front_addr":"172.21.15.167:6805/4163493234","state":["exists","up"]},{"osd":2,"uuid":"286d2943-23a0-4184-93cf-9d3430781f99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6801","nonce":702507556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6803","nonce":702507556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6807","nonce":702507556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6805","nonce":702507556}]},"public_addr":"172.21.15.190:6801/702507556","cluster_addr":"172.21.15.190:6803/702507556","heartbeat_back_addr":"172.21.15.190:6807/702507556","heartbeat_front_addr":"172.21.15.190:6805/702507556","state":["exists","up"]},{"osd":3,"uuid":"9d126671-7fc1-4f29-9bc3-3598052fd20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6811","nonce":945752895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6813","nonce":945752895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6817","nonce":945752895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6815","nonce":945752895}]},"public_addr":"172.21.15.92:6811/945752895","cluster_addr":"172.21.15.92:6813/945752895","heartbeat_back_addr":"172.21.15.92:6817/945752895","heartbeat_front_addr":"172.21.15.92:6815/945752895","state":["exists","up"]},{"osd":4,"uuid":"cb10b38d-ae13-4b92-b906-3505fb873b2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6809","nonce":3576893400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6811","nonce":3576893400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6815","nonce":3576893400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6813","nonce":3576893400}]},"public_addr":"172.21.15.167:6809/3576893400","cluster_addr":"172.21.15.167:6811/3576893400","heartbeat_back_addr":"172.21.15.167:6815/3576893400","heartbeat_front_addr":"172.21.15.167:6813/3576893400","state":["exists","up"]},{"osd":5,"uuid":"cd90668b-eca5-4bb4-870e-e58578730c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6809","nonce":1880491675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6811","nonce":1880491675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6815","nonce":1880491675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6813","nonce":1880491675}]},"public_addr":"172.21.15.190:6809/1880491675","cluster_addr":"172.21.15.190:6811/1880491675","heartbeat_back_addr":"172.21.15.190:6815/1880491675","heartbeat_front_addr":"172.21.15.190:6813/1880491675","state":["exists","up"]},{"osd":6,"uuid":"4e047963-afa7-4934-b887-8086165fb831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6819","nonce":1743435653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6821","nonce":1743435653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6825","nonce":1743435653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6823","nonce":1743435653}]},"public_addr":"172.21.15.92:6819/1743435653","cluster_addr":"172.21.15.92:6821/1743435653","heartbeat_back_addr":"172.21.15.92:6825/1743435653","heartbeat_front_addr":"172.21.15.92:6823/1743435653","state":["exists","up"]},{"osd":7,"uuid":"652a6aa1-bb94-4608-952e-67cd02bdff66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6817","nonce":2984111963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6819","nonce":2984111963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6823","nonce":2984111963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6821","nonce":2984111963}]},"public_addr":"172.21.15.167:6817/2984111963","cluster_addr":"172.21.15.167:6819/2984111963","heartbeat_back_addr":"172.21.15.167:6823/2984111963","heartbeat_front_addr":"172.21.15.167:6821/2984111963","state":["exists","up"]},{"osd":8,"uuid":"1510ef1f-fdfe-4887-a771-146efce062fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6817","nonce":4190304434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6819","nonce":4190304434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6823","nonce":4190304434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6821","nonce":4190304434}]},"public_addr":"172.21.15.190:6817/4190304434","cluster_addr":"172.21.15.190:6819/4190304434","heartbeat_back_addr":"172.21.15.190:6823/4190304434","heartbeat_front_addr":"172.21.15.190:6821/4190304434","state":["exists","up"]},{"osd":9,"uuid":"9b774bbe-6700-4020-900b-3fdbaa546773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6827","nonce":3066744542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6829","nonce":3066744542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6833","nonce":3066744542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6831","nonce":3066744542}]},"public_addr":"172.21.15.92:6827/3066744542","cluster_addr":"172.21.15.92:6829/3066744542","heartbeat_back_addr":"172.21.15.92:6833/3066744542","heartbeat_front_addr":"172.21.15.92:6831/3066744542","state":["exists","up"]},{"osd":10,"uuid":"8abdb835-db2c-4597-ae1d-8ef56e63ab6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6825","nonce":2309134313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6827","nonce":2309134313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6831","nonce":2309134313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6829","nonce":2309134313}]},"public_addr":"172.21.15.167:6825/2309134313","cluster_addr":"172.21.15.167:6827/2309134313","heartbeat_back_addr":"172.21.15.167:6831/2309134313","heartbeat_front_addr":"172.21.15.167:6829/2309134313","state":["exists","up"]},{"osd":11,"uuid":"564c844a-378f-40cd-9717-cde35a65631c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6825","nonce":1849208751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6827","nonce":1849208751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6831","nonce":1849208751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6829","nonce":1849208751}]},"public_addr":"172.21.15.190:6825/1849208751","cluster_addr":"172.21.15.190:6827/1849208751","heartbeat_back_addr":"172.21.15.190:6831/1849208751","heartbeat_front_addr":"172.21.15.190:6829/1849208751","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:12.072109+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:36.689174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:01.908763+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:26.857439+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:50.881629+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:51:15.160744+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:51:39.101605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:03.179877+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:27.324563+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:51.971287+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:53:15.917311+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:53:40.592486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/2948821221":"2024-09-20T08:47:52.180093+0000","172.21.15.92:0/1441365956":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6801/2908709470":"2024-09-20T08:47:52.180093+0000","172.21.15.92:0/608374871":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6801/1369295034":"2024-09-20T08:47:29.812397+0000","172.21.15.92:6800/2908709470":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6800/1369295034":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/813486656":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/1963725565":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/1668504617":"2024-09-20T08:47:29.812397+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:55:47.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.517+0000 7fbe10b48640 1 -- 172.21.15.92:0/2823178458 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fbdf40a32d0 msgr2=0x7fbdf40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:47.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.517+0000 7fbe10b48640 1 --2- 172.21.15.92:0/2823178458 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fbdf40a32d0 0x7fbdf40a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc009930 tx=0x7fbdfc008040 comp rx=0 tx=0).stop 2024-09-19T08:55:47.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.517+0000 7fbe10b48640 1 -- 172.21.15.92:0/2823178458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe0c1082e0 msgr2=0x7fbe0c19a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:47.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.517+0000 7fbe10b48640 1 --2- 172.21.15.92:0/2823178458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe0c1082e0 0x7fbe0c19a800 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbe0400b970 tx=0x7fbe0400be30 comp rx=0 tx=0).stop 2024-09-19T08:55:47.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.517+0000 7fbe10b48640 1 -- 172.21.15.92:0/2823178458 shutdown_connections 2024-09-19T08:55:47.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.517+0000 7fbe10b48640 1 --2- 172.21.15.92:0/2823178458 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fbdf40a32d0 0x7fbdf40a5790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:47.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.517+0000 7fbe10b48640 1 --2- 172.21.15.92:0/2823178458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe0c1082e0 0x7fbe0c19a800 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:47.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.517+0000 7fbe10b48640 1 --2- 172.21.15.92:0/2823178458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe0c103760 0x7fbe0c1a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:47.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.517+0000 7fbe10b48640 1 --2- 172.21.15.92:0/2823178458 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbe0c102db0 0x7fbe0c1a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:47.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.517+0000 7fbe10b48640 1 -- 172.21.15.92:0/2823178458 >> 172.21.15.92:0/2823178458 conn(0x7fbe0c0fc7d0 msgr2=0x7fbe0c100940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:47.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.517+0000 7fbe10b48640 1 -- 172.21.15.92:0/2823178458 shutdown_connections 2024-09-19T08:55:47.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:47.517+0000 7fbe10b48640 1 -- 172.21.15.92:0/2823178458 wait complete. 2024-09-19T08:55:47.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:47 smithi092 ceph-mon[31407]: pgmap v309: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:55:47.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:47 smithi167 ceph-mon[35359]: pgmap v309: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:55:47.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:47 smithi190 ceph-mon[35358]: pgmap v309: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:55:48.170 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:55:48.418 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:48.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:48 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/2823178458' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:55:48.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:48 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/2823178458' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:55:48.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:48 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/2823178458' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:55:48.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.879+0000 7fed08dbd640 1 -- 172.21.15.92:0/3859015075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed04106a80 msgr2=0x7fed04106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:48.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.879+0000 7fed08dbd640 1 --2- 172.21.15.92:0/3859015075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed04106a80 0x7fed04106e60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fecf4009cd0 tx=0x7fecf402a8e0 comp rx=0 tx=0).stop 2024-09-19T08:55:48.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.879+0000 7fed08dbd640 1 -- 172.21.15.92:0/3859015075 shutdown_connections 2024-09-19T08:55:48.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.879+0000 7fed08dbd640 1 --2- 172.21.15.92:0/3859015075 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed04101420 0x7fed0410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:48.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.879+0000 7fed08dbd640 1 --2- 172.21.15.92:0/3859015075 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed04100a80 0x7fed04100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:48.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.879+0000 7fed08dbd640 1 --2- 172.21.15.92:0/3859015075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed04106a80 0x7fed04106e60 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:48.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.879+0000 7fed08dbd640 1 -- 172.21.15.92:0/3859015075 >> 172.21.15.92:0/3859015075 conn(0x7fed040fc7a0 msgr2=0x7fed040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:48.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.879+0000 7fed08dbd640 1 -- 172.21.15.92:0/3859015075 shutdown_connections 2024-09-19T08:55:48.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.879+0000 7fed08dbd640 1 -- 172.21.15.92:0/3859015075 wait complete. 2024-09-19T08:55:48.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.880+0000 7fed08dbd640 1 Processor -- start 2024-09-19T08:55:48.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.880+0000 7fed08dbd640 1 -- start start 2024-09-19T08:55:48.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.880+0000 7fed08dbd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed04100a80 0x7fed04102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:48.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.880+0000 7fed08dbd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed04101420 0x7fed04102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:48.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.880+0000 7fed08dbd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed04106a80 0x7fed041030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:48.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.880+0000 7fed08dbd640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fed04110ea0 con 0x7fed04100a80 2024-09-19T08:55:48.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.880+0000 7fed08dbd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fed04110d20 con 0x7fed04106a80 2024-09-19T08:55:48.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.880+0000 7fed08dbd640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fed04111020 con 0x7fed04101420 2024-09-19T08:55:48.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.880+0000 7fed0259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed04100a80 0x7fed04102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:48.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.880+0000 7fed0259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed04100a80 0x7fed04102650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46192/0 (socket says 172.21.15.92:46192) 2024-09-19T08:55:48.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.880+0000 7fed0259c640 1 -- 172.21.15.92:0/24009217 learned_addr learned my addr 172.21.15.92:0/24009217 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:48.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.880+0000 7fed0259c640 1 -- 172.21.15.92:0/24009217 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed04101420 msgr2=0x7fed04102b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:48.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.880+0000 7fed01d9b640 1 --2- 172.21.15.92:0/24009217 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed04101420 0x7fed04102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:48.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.880+0000 7fed0259c640 1 --2- 172.21.15.92:0/24009217 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed04101420 0x7fed04102b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:48.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.880+0000 7fed02d9d640 1 --2- 172.21.15.92:0/24009217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed04106a80 0x7fed041030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:48.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.880+0000 7fed0259c640 1 -- 172.21.15.92:0/24009217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed04106a80 msgr2=0x7fed041030d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:48.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.880+0000 7fed0259c640 1 --2- 172.21.15.92:0/24009217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed04106a80 0x7fed041030d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:48.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.880+0000 7fed0259c640 1 -- 172.21.15.92:0/24009217 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed041a69a0 con 0x7fed04100a80 2024-09-19T08:55:48.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.880+0000 7fed01d9b640 1 --2- 172.21.15.92:0/24009217 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed04101420 0x7fed04102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:55:48.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.881+0000 7fed0259c640 1 --2- 172.21.15.92:0/24009217 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed04100a80 0x7fed04102650 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fecf402ae00 tx=0x7fecf4003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:48.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.881+0000 7fecfb7fe640 1 -- 172.21.15.92:0/24009217 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf4004240 con 0x7fed04100a80 2024-09-19T08:55:48.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.881+0000 7fed08dbd640 1 -- 172.21.15.92:0/24009217 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed041a6c30 con 0x7fed04100a80 2024-09-19T08:55:48.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.881+0000 7fecfb7fe640 1 -- 172.21.15.92:0/24009217 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecf40305a0 con 0x7fed04100a80 2024-09-19T08:55:48.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.881+0000 7fecfb7fe640 1 -- 172.21.15.92:0/24009217 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf403a660 con 0x7fed04100a80 2024-09-19T08:55:48.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.881+0000 7fed08dbd640 1 -- 172.21.15.92:0/24009217 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed041a7170 con 0x7fed04100a80 2024-09-19T08:55:48.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.882+0000 7fed08dbd640 1 -- 172.21.15.92:0/24009217 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed04100ee0 con 0x7fed04100a80 2024-09-19T08:55:48.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.883+0000 7fecfb7fe640 1 -- 172.21.15.92:0/24009217 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fecf4030ac0 con 0x7fed04100a80 2024-09-19T08:55:48.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.883+0000 7fecfb7fe640 1 --2- 172.21.15.92:0/24009217 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fecf00a32d0 0x7fecf00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:48.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.884+0000 7fed01d9b640 1 --2- 172.21.15.92:0/24009217 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fecf00a32d0 0x7fecf00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:48.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.884+0000 7fecfb7fe640 1 -- 172.21.15.92:0/24009217 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fecf402e030 con 0x7fed04100a80 2024-09-19T08:55:48.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.884+0000 7fed01d9b640 1 --2- 172.21.15.92:0/24009217 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fecf00a32d0 0x7fecf00a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fed041040e0 tx=0x7fecec005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:48.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:48.887+0000 7fecfb7fe640 1 -- 172.21.15.92:0/24009217 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fecf40098b0 con 0x7fed04100a80 2024-09-19T08:55:49.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:49.087+0000 7fed08dbd640 1 -- 172.21.15.92:0/24009217 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fed041a7450 con 0x7fed04100a80 2024-09-19T08:55:49.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:49.087+0000 7fecfb7fe640 1 -- 172.21.15.92:0/24009217 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7fecf40bdf90 con 0x7fed04100a80 2024-09-19T08:55:49.087 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:55:49.088 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T08:55:49.088 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T08:55:49.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:49.090+0000 7fed08dbd640 1 -- 172.21.15.92:0/24009217 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fecf00a32d0 msgr2=0x7fecf00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:49.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:49.090+0000 7fed08dbd640 1 --2- 172.21.15.92:0/24009217 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fecf00a32d0 0x7fecf00a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fed041040e0 tx=0x7fecec005d30 comp rx=0 tx=0).stop 2024-09-19T08:55:49.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:49.090+0000 7fed08dbd640 1 -- 172.21.15.92:0/24009217 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed04100a80 msgr2=0x7fed04102650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:49.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:49.090+0000 7fed08dbd640 1 --2- 172.21.15.92:0/24009217 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed04100a80 0x7fed04102650 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fecf402ae00 tx=0x7fecf4003ba0 comp rx=0 tx=0).stop 2024-09-19T08:55:49.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:49.090+0000 7fed08dbd640 1 -- 172.21.15.92:0/24009217 shutdown_connections 2024-09-19T08:55:49.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:49.090+0000 7fed08dbd640 1 --2- 172.21.15.92:0/24009217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed04106a80 0x7fed041030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:49.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:49.090+0000 7fed08dbd640 1 --2- 172.21.15.92:0/24009217 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed04101420 0x7fed04102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:49.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:49.090+0000 7fed08dbd640 1 --2- 172.21.15.92:0/24009217 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fecf00a32d0 0x7fecf00a5790 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:49.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:49.090+0000 7fed08dbd640 1 --2- 172.21.15.92:0/24009217 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed04100a80 0x7fed04102650 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:49.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:49.090+0000 7fed08dbd640 1 -- 172.21.15.92:0/24009217 >> 172.21.15.92:0/24009217 conn(0x7fed040fc7a0 msgr2=0x7fed0406a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:49.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:49.090+0000 7fed08dbd640 1 -- 172.21.15.92:0/24009217 shutdown_connections 2024-09-19T08:55:49.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:49.090+0000 7fed08dbd640 1 -- 172.21.15.92:0/24009217 wait complete. 2024-09-19T08:55:49.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:49 smithi092 ceph-mon[31407]: pgmap v310: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:55:49.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:49 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/24009217' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:55:49.755 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T08:54:31.939376+0000', 'modified': '2024-09-19T08:54:40.961053+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24472}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24466': {'gid': 24466, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.190:6837/3700975791', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6836', 'nonce': 3700975791}, {'type': 'v1', 'addr': '172.21.15.190:6837', 'nonce': 3700975791}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.190:6839/3861238400', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6838', 'nonce': 3861238400}, {'type': 'v1', 'addr': '172.21.15.190:6839', 'nonce': 3861238400}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24472, 'qdb_cluster': [24472]} 2024-09-19T08:55:49.755 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T08:55:49.755 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T08:55:49.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:49 smithi167 ceph-mon[35359]: pgmap v310: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:55:49.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:49 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/24009217' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:55:49.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:49 smithi190 ceph-mon[35358]: pgmap v310: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T08:55:49.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:49 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/24009217' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:55:50.001 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:50.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.461+0000 7f721e8d2640 1 -- 172.21.15.92:0/2578220664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72181082a0 msgr2=0x7f721810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:50.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.461+0000 7f721e8d2640 1 --2- 172.21.15.92:0/2578220664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72181082a0 0x7f721810ec40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7210009cd0 tx=0x7f721002a8e0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.461+0000 7f721e8d2640 1 -- 172.21.15.92:0/2578220664 shutdown_connections 2024-09-19T08:55:50.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.461+0000 7f721e8d2640 1 --2- 172.21.15.92:0/2578220664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72181082a0 0x7f721810ec40 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.461+0000 7f721e8d2640 1 --2- 172.21.15.92:0/2578220664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72181036e0 0x7f7218107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.461+0000 7f721e8d2640 1 --2- 172.21.15.92:0/2578220664 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7218102d30 0x7f7218103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.461+0000 7f721e8d2640 1 -- 172.21.15.92:0/2578220664 >> 172.21.15.92:0/2578220664 conn(0x7f72180fc7d0 msgr2=0x7f72180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:50.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.461+0000 7f721e8d2640 1 -- 172.21.15.92:0/2578220664 shutdown_connections 2024-09-19T08:55:50.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.461+0000 7f721e8d2640 1 -- 172.21.15.92:0/2578220664 wait complete. 2024-09-19T08:55:50.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.462+0000 7f721e8d2640 1 Processor -- start 2024-09-19T08:55:50.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.462+0000 7f721e8d2640 1 -- start start 2024-09-19T08:55:50.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.462+0000 7f721e8d2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7218102d30 0x7f7218100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:50.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.462+0000 7f721e8d2640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f72181036e0 0x7f7218100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:50.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.462+0000 7f721e8d2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72181082a0 0x7f7218101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:50.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.462+0000 7f721e8d2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f72181120a0 con 0x7f7218102d30 2024-09-19T08:55:50.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.462+0000 7f721e8d2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7218111f20 con 0x7f72181082a0 2024-09-19T08:55:50.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.462+0000 7f721e8d2640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7218112220 con 0x7f72181036e0 2024-09-19T08:55:50.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.462+0000 7f7217fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7218102d30 0x7f7218100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:50.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.463+0000 7f7217fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7218102d30 0x7f7218100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46198/0 (socket says 172.21.15.92:46198) 2024-09-19T08:55:50.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.463+0000 7f7217fff640 1 -- 172.21.15.92:0/3291478461 learned_addr learned my addr 172.21.15.92:0/3291478461 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:50.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.463+0000 7f72177fe640 1 --2- 172.21.15.92:0/3291478461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f72181036e0 0x7f7218100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:50.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.463+0000 7f721ce6f640 1 --2- 172.21.15.92:0/3291478461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72181082a0 0x7f7218101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:50.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.463+0000 7f7217fff640 1 -- 172.21.15.92:0/3291478461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f72181036e0 msgr2=0x7f7218100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:50.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.463+0000 7f7217fff640 1 --2- 172.21.15.92:0/3291478461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f72181036e0 0x7f7218100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.463+0000 7f7217fff640 1 -- 172.21.15.92:0/3291478461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72181082a0 msgr2=0x7f7218101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:50.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.463+0000 7f7217fff640 1 --2- 172.21.15.92:0/3291478461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72181082a0 0x7f7218101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.463+0000 7f7217fff640 1 -- 172.21.15.92:0/3291478461 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72181a69f0 con 0x7f7218102d30 2024-09-19T08:55:50.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.463+0000 7f72177fe640 1 --2- 172.21.15.92:0/3291478461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f72181036e0 0x7f7218100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:55:50.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.463+0000 7f7217fff640 1 --2- 172.21.15.92:0/3291478461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7218102d30 0x7f7218100990 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f720800c890 tx=0x7f720800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:50.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.463+0000 7f72157fa640 1 -- 172.21.15.92:0/3291478461 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7208004220 con 0x7f7218102d30 2024-09-19T08:55:50.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.463+0000 7f721e8d2640 1 -- 172.21.15.92:0/3291478461 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72181a6ce0 con 0x7f7218102d30 2024-09-19T08:55:50.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.463+0000 7f72157fa640 1 -- 172.21.15.92:0/3291478461 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72080043c0 con 0x7f7218102d30 2024-09-19T08:55:50.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.463+0000 7f72157fa640 1 -- 172.21.15.92:0/3291478461 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7208004a00 con 0x7f7218102d30 2024-09-19T08:55:50.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.463+0000 7f721e8d2640 1 -- 172.21.15.92:0/3291478461 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72181a71c0 con 0x7f7218102d30 2024-09-19T08:55:50.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.466+0000 7f72157fa640 1 -- 172.21.15.92:0/3291478461 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f72080079b0 con 0x7f7218102d30 2024-09-19T08:55:50.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.466+0000 7f7220cab740 1 Processor -- start 2024-09-19T08:55:50.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.466+0000 7f7220cab740 1 -- start start 2024-09-19T08:55:50.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.466+0000 7f72157fa640 1 --2- 172.21.15.92:0/3291478461 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f72000a32d0 0x7f72000a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:50.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.466+0000 7f7220cab740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c081f3a9d0 0x55c081f3adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:50.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.466+0000 7f7220cab740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c081f3b2f0 0x55c081f45670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:50.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.466+0000 7f7220cab740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c081f45bb0 0x55c081f47fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:50.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.466+0000 7f7220cab740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c081ea1090 con 0x55c081f3b2f0 2024-09-19T08:55:50.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.466+0000 7f7220cab740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55c081e48a70 con 0x55c081f45bb0 2024-09-19T08:55:50.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.466+0000 7f7220cab740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55c081e9d050 con 0x55c081f3a9d0 2024-09-19T08:55:50.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.466+0000 7f721ce6f640 1 --2- 172.21.15.92:0/3291478461 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f72000a32d0 0x7f72000a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:50.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.467+0000 7f72157fa640 1 -- 172.21.15.92:0/3291478461 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f72080cf850 con 0x7f7218102d30 2024-09-19T08:55:50.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.467+0000 7f72177fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c081f3b2f0 0x55c081f45670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:50.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.467+0000 7f7217fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c081f3a9d0 0x55c081f3adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:50.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.467+0000 7f72177fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c081f3b2f0 0x55c081f45670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46200/0 (socket says 172.21.15.92:46200) 2024-09-19T08:55:50.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.467+0000 7f72177fe640 1 -- 172.21.15.92:0/3131623229 learned_addr learned my addr 172.21.15.92:0/3131623229 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:50.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.467+0000 7f7217fff640 1 --2- 172.21.15.92:0/3131623229 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c081f3a9d0 0x55c081f3adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:38818/0 (socket says 172.21.15.92:38818) 2024-09-19T08:55:50.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.467+0000 7f721ce6f640 1 --2- 172.21.15.92:0/3131623229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c081f45bb0 0x55c081f47fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:50.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.467+0000 7f72177fe640 1 -- 172.21.15.92:0/3131623229 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c081f3a9d0 msgr2=0x55c081f3adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:50.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.467+0000 7f72177fe640 1 --2- 172.21.15.92:0/3131623229 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c081f3a9d0 0x55c081f3adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.467+0000 7f72177fe640 1 -- 172.21.15.92:0/3131623229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c081f45bb0 msgr2=0x55c081f47fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:50.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.467+0000 7f72177fe640 1 --2- 172.21.15.92:0/3131623229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c081f45bb0 0x55c081f47fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.467+0000 7f72177fe640 1 -- 172.21.15.92:0/3131623229 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c081e55130 con 0x55c081f3b2f0 2024-09-19T08:55:50.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.467+0000 7f72177fe640 1 --2- 172.21.15.92:0/3131623229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c081f3b2f0 0x55c081f45670 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f720c00cb90 tx=0x7f720c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b1f46d8184d0a9f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:50.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.467+0000 7f721ce6f640 1 --2- 172.21.15.92:0/3291478461 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f72000a32d0 0x7f72000a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7210009a60 tx=0x7f72100318c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:50.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.470+0000 7f71fe7fc640 1 -- 172.21.15.92:0/3131623229 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f720c005220 con 0x55c081f3b2f0 2024-09-19T08:55:50.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.470+0000 7f71fe7fc640 1 -- 172.21.15.92:0/3131623229 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f720c004c80 con 0x55c081f3b2f0 2024-09-19T08:55:50.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.470+0000 7f71fe7fc640 1 -- 172.21.15.92:0/3131623229 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f720c0107d0 con 0x55c081f3b2f0 2024-09-19T08:55:50.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.471+0000 7f7220cab740 1 -- 172.21.15.92:0/3131623229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c081f3b2f0 msgr2=0x55c081f45670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:50.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.471+0000 7f7220cab740 1 --2- 172.21.15.92:0/3131623229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c081f3b2f0 0x55c081f45670 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f720c00cb90 tx=0x7f720c00e720 comp rx=0 tx=0).stop 2024-09-19T08:55:50.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.471+0000 7f7220cab740 1 -- 172.21.15.92:0/3131623229 shutdown_connections 2024-09-19T08:55:50.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.471+0000 7f7220cab740 1 --2- 172.21.15.92:0/3131623229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c081f45bb0 0x55c081f47fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.471+0000 7f7220cab740 1 --2- 172.21.15.92:0/3131623229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c081f3b2f0 0x55c081f45670 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.471+0000 7f7220cab740 1 --2- 172.21.15.92:0/3131623229 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c081f3a9d0 0x55c081f3adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.471+0000 7f7220cab740 1 -- 172.21.15.92:0/3131623229 >> 172.21.15.92:0/3131623229 conn(0x55c081f36f60 msgr2=0x55c081f37340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:50.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.471+0000 7f7220cab740 1 -- 172.21.15.92:0/3131623229 shutdown_connections 2024-09-19T08:55:50.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.471+0000 7f7220cab740 1 -- 172.21.15.92:0/3131623229 wait complete. 2024-09-19T08:55:50.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.471+0000 7f7220cab740 1 -- start start 2024-09-19T08:55:50.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.472+0000 7f7220cab740 1 Processor -- start 2024-09-19T08:55:50.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.472+0000 7f7220cab740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c081f3a9d0 0x55c081f453d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:50.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.472+0000 7f7220cab740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c081f3b2f0 0x55c081f42720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:50.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.472+0000 7f7220cab740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c081f45bb0 0x55c081f42c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:50.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.472+0000 7f7220cab740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c081f48780 con 0x55c081f45bb0 2024-09-19T08:55:50.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.472+0000 7f7220cab740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55c081e5bf20 con 0x55c081f3a9d0 2024-09-19T08:55:50.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.472+0000 7f7220cab740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55c081f48900 con 0x55c081f3b2f0 2024-09-19T08:55:50.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.472+0000 7f7220cab740 10 client.0 _ll_register_callbacks cb 0x55c081e25030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:55:50.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.472+0000 7f721ce6f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c081f45bb0 0x55c081f42c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:50.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.472+0000 7f721ce6f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c081f45bb0 0x55c081f42c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46208/0 (socket says 172.21.15.92:46208) 2024-09-19T08:55:50.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.472+0000 7f721ce6f640 1 -- 172.21.15.92:0/568165127 learned_addr learned my addr 172.21.15.92:0/568165127 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:50.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.472+0000 7f72177fe640 1 --2- 172.21.15.92:0/568165127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c081f3b2f0 0x55c081f42720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:50.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.472+0000 7f7217fff640 1 --2- 172.21.15.92:0/568165127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c081f3a9d0 0x55c081f453d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:50.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.472+0000 7f721ce6f640 1 -- 172.21.15.92:0/568165127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c081f3b2f0 msgr2=0x55c081f42720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:50.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.472+0000 7f721ce6f640 1 --2- 172.21.15.92:0/568165127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c081f3b2f0 0x55c081f42720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.472+0000 7f721ce6f640 1 -- 172.21.15.92:0/568165127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c081f3a9d0 msgr2=0x55c081f453d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:50.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.472+0000 7f721ce6f640 1 --2- 172.21.15.92:0/568165127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c081f3a9d0 0x55c081f453d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.472+0000 7f721ce6f640 1 -- 172.21.15.92:0/568165127 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c081c122b0 con 0x55c081f45bb0 2024-09-19T08:55:50.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.473+0000 7f721ce6f640 1 --2- 172.21.15.92:0/568165127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c081f45bb0 0x55c081f42c60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7210035000 tx=0x7f721002a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3698e1750390c61f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:50.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.473+0000 7f71f77fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:55:50.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.476+0000 7f71f77fe640 1 -- 172.21.15.92:0/568165127 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721004e070 con 0x55c081f45bb0 2024-09-19T08:55:50.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.476+0000 7f71f77fe640 1 -- 172.21.15.92:0/568165127 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f72100305a0 con 0x55c081f45bb0 2024-09-19T08:55:50.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.476+0000 7f7220cab740 1 -- 172.21.15.92:0/568165127 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f720c004c80 con 0x55c081f45bb0 2024-09-19T08:55:50.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.476+0000 7f71f77fe640 1 -- 172.21.15.92:0/568165127 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7210004b40 con 0x55c081f45bb0 2024-09-19T08:55:50.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.477+0000 7f7220cab740 10 client.15009 fetch_fsmap learned FSMap version 19 2024-09-19T08:55:50.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.477+0000 7f7220cab740 1 -- 172.21.15.92:0/568165127 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55c081f54030 con 0x55c081f45bb0 2024-09-19T08:55:50.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.477+0000 7f71f77fe640 1 -- 172.21.15.92:0/568165127 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f720c004c80 con 0x55c081f45bb0 2024-09-19T08:55:50.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.477+0000 7f71f77fe640 1 -- 172.21.15.92:0/568165127 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f7210030070 con 0x55c081f45bb0 2024-09-19T08:55:50.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.477+0000 7f7220cab740 10 client.15009 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:55:50.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.477+0000 7f7220cab740 10 client.15009 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T08:55:50.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.477+0000 7f7220cab740 20 client.15009 populate_metadata read hostname 'smithi092' 2024-09-19T08:55:50.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.477+0000 7f7220cab740 1 --2- 172.21.15.92:0/568165127 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55c081f566b0 0x55c081f57b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:50.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.477+0000 7f7220cab740 4 client.15009 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:55:50.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.477+0000 7f7220cab740 1 -- 172.21.15.92:0/568165127 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c081eae600 con 0x55c081f566b0 2024-09-19T08:55:50.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.477+0000 7f7217fff640 1 --2- 172.21.15.92:0/568165127 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55c081f566b0 0x55c081f57b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:50.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.478+0000 7f7217fff640 1 --2- 172.21.15.92:0/568165127 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55c081f566b0 0x55c081f57b20 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e04238bbb63010de server_cookie=a81fe5d0ebd51b0f in_seq=0 out_seq=0 2024-09-19T08:55:50.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.478+0000 7f71f77fe640 10 client.15009 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:55:50.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.478+0000 7f71f77fe640 1 -- 172.21.15.92:0/568165127 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c081eae600 con 0x55c081f566b0 2024-09-19T08:55:50.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.478+0000 7f71f77fe640 10 client.15009 handle_command_reply: tid=0 2024-09-19T08:55:50.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.478+0000 7f7220cab740 1 client.15009 shutdown 2024-09-19T08:55:50.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.479+0000 7f7220cab740 1 -- 172.21.15.92:0/568165127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c081f45bb0 msgr2=0x55c081f42c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:50.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.479+0000 7f7220cab740 1 --2- 172.21.15.92:0/568165127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c081f45bb0 0x55c081f42c60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7210035000 tx=0x7f721002a8e0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.479+0000 7f7220cab740 1 -- 172.21.15.92:0/568165127 shutdown_connections 2024-09-19T08:55:50.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.479+0000 7f7220cab740 1 --2- 172.21.15.92:0/568165127 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55c081f566b0 0x55c081f57b20 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.479+0000 7f7220cab740 1 --2- 172.21.15.92:0/568165127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c081f45bb0 0x55c081f42c60 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.479+0000 7f7220cab740 1 --2- 172.21.15.92:0/568165127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c081f3b2f0 0x55c081f42720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.479+0000 7f71f77fe640 0 client.15009 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:55:50.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.479+0000 7f7220cab740 1 --2- 172.21.15.92:0/568165127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c081f3a9d0 0x55c081f453d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.479+0000 7f7220cab740 1 -- 172.21.15.92:0/568165127 >> 172.21.15.92:0/568165127 conn(0x55c081f36f60 msgr2=0x55c081f3cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:50.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.479+0000 7f7220cab740 1 -- 172.21.15.92:0/568165127 shutdown_connections 2024-09-19T08:55:50.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.479+0000 7f7220cab740 1 -- 172.21.15.92:0/568165127 wait complete. 2024-09-19T08:55:50.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.479+0000 7f7220cab740 20 client.15009 trim_cache size 0 max 16384 2024-09-19T08:55:50.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.496+0000 7f7220cab740 1 Processor -- start 2024-09-19T08:55:50.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.496+0000 7f7220cab740 1 -- start start 2024-09-19T08:55:50.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.497+0000 7f7220cab740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c081f3a9d0 0x55c081f41fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:50.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.497+0000 7f7220cab740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c081f3b2f0 0x55c081f5fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:50.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.497+0000 7f7220cab740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c081f45bb0 0x55c081f60340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:50.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.497+0000 7f7220cab740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c081f55e60 con 0x55c081f3b2f0 2024-09-19T08:55:50.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.497+0000 7f7220cab740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55c081f56530 con 0x55c081f3a9d0 2024-09-19T08:55:50.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.497+0000 7f7220cab740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55c081f56c00 con 0x55c081f45bb0 2024-09-19T08:55:50.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.497+0000 7f72177fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c081f3b2f0 0x55c081f5fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:50.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.497+0000 7f72177fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c081f3b2f0 0x55c081f5fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46214/0 (socket says 172.21.15.92:46214) 2024-09-19T08:55:50.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.497+0000 7f72177fe640 1 -- 172.21.15.92:0/720709106 learned_addr learned my addr 172.21.15.92:0/720709106 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:50.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.497+0000 7f7217fff640 1 --2- 172.21.15.92:0/720709106 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c081f3a9d0 0x55c081f41fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:50.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.497+0000 7f721ce6f640 1 --2- 172.21.15.92:0/720709106 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c081f45bb0 0x55c081f60340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:50.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.497+0000 7f72177fe640 1 -- 172.21.15.92:0/720709106 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c081f45bb0 msgr2=0x55c081f60340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:50.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.497+0000 7f72177fe640 1 --2- 172.21.15.92:0/720709106 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c081f45bb0 0x55c081f60340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.497+0000 7f72177fe640 1 -- 172.21.15.92:0/720709106 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c081f3a9d0 msgr2=0x55c081f41fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:50.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.497+0000 7f72177fe640 1 --2- 172.21.15.92:0/720709106 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c081f3a9d0 0x55c081f41fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.497+0000 7f72177fe640 1 -- 172.21.15.92:0/720709106 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c081f36d90 con 0x55c081f3b2f0 2024-09-19T08:55:50.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.497+0000 7f72177fe640 1 --2- 172.21.15.92:0/720709106 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c081f3b2f0 0x55c081f5fe00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f720c005730 tx=0x7f720c010430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddadcf490553b9fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:50.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.497+0000 7f71fdffb640 1 -- 172.21.15.92:0/720709106 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f720c004220 con 0x55c081f3b2f0 2024-09-19T08:55:50.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.497+0000 7f71fdffb640 1 -- 172.21.15.92:0/720709106 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f720c00c7a0 con 0x55c081f3b2f0 2024-09-19T08:55:50.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.497+0000 7f71fdffb640 1 -- 172.21.15.92:0/720709106 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f720c004d80 con 0x55c081f3b2f0 2024-09-19T08:55:50.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.498+0000 7f7220cab740 1 -- 172.21.15.92:0/720709106 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c081f3b2f0 msgr2=0x55c081f5fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:50.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.498+0000 7f7220cab740 1 --2- 172.21.15.92:0/720709106 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c081f3b2f0 0x55c081f5fe00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f720c005730 tx=0x7f720c010430 comp rx=0 tx=0).stop 2024-09-19T08:55:50.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.498+0000 7f7220cab740 1 -- 172.21.15.92:0/720709106 shutdown_connections 2024-09-19T08:55:50.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.498+0000 7f7220cab740 1 --2- 172.21.15.92:0/720709106 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c081f45bb0 0x55c081f60340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.498+0000 7f7220cab740 1 --2- 172.21.15.92:0/720709106 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c081f3b2f0 0x55c081f5fe00 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.498+0000 7f7220cab740 1 --2- 172.21.15.92:0/720709106 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c081f3a9d0 0x55c081f41fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.498+0000 7f7220cab740 1 -- 172.21.15.92:0/720709106 >> 172.21.15.92:0/720709106 conn(0x55c081f36f60 msgr2=0x55c081f37340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:50.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.498+0000 7f7220cab740 1 -- 172.21.15.92:0/720709106 shutdown_connections 2024-09-19T08:55:50.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.498+0000 7f7220cab740 1 -- 172.21.15.92:0/720709106 wait complete. 2024-09-19T08:55:50.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.498+0000 7f7220cab740 1 -- start start 2024-09-19T08:55:50.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.499+0000 7f7220cab740 1 Processor -- start 2024-09-19T08:55:50.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.499+0000 7f7220cab740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c081f3a9d0 0x55c081f600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:50.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.499+0000 7f7220cab740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c081f3b2f0 0x55c081f605e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:50.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.499+0000 7f7220cab740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c081f45bb0 0x55c081f3f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:50.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.499+0000 7f7220cab740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c081f579a0 con 0x55c081f45bb0 2024-09-19T08:55:50.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.499+0000 7f7220cab740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55c081f572d0 con 0x55c081f3a9d0 2024-09-19T08:55:50.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.499+0000 7f7220cab740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55c081f58070 con 0x55c081f3b2f0 2024-09-19T08:55:50.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.499+0000 7f7220cab740 10 client.0 _ll_register_callbacks cb 0x7f7210009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:55:50.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.499+0000 7f721ce6f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c081f45bb0 0x55c081f3f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:50.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.499+0000 7f721ce6f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c081f45bb0 0x55c081f3f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46218/0 (socket says 172.21.15.92:46218) 2024-09-19T08:55:50.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.499+0000 7f721ce6f640 1 -- 172.21.15.92:0/1009312475 learned_addr learned my addr 172.21.15.92:0/1009312475 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:50.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.499+0000 7f7217fff640 1 --2- 172.21.15.92:0/1009312475 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c081f3a9d0 0x55c081f600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:50.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.499+0000 7f721ce6f640 1 -- 172.21.15.92:0/1009312475 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c081f3b2f0 msgr2=0x55c081f605e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:50.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.499+0000 7f721ce6f640 1 --2- 172.21.15.92:0/1009312475 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c081f3b2f0 0x55c081f605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.499+0000 7f721ce6f640 1 -- 172.21.15.92:0/1009312475 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c081f3a9d0 msgr2=0x55c081f600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:50.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.499+0000 7f721ce6f640 1 --2- 172.21.15.92:0/1009312475 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c081f3a9d0 0x55c081f600a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.499+0000 7f721ce6f640 1 -- 172.21.15.92:0/1009312475 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c081f3fa70 con 0x55c081f45bb0 2024-09-19T08:55:50.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.499+0000 7f7217fff640 1 --2- 172.21.15.92:0/1009312475 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c081f3a9d0 0x55c081f600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:55:50.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.499+0000 7f721ce6f640 1 --2- 172.21.15.92:0/1009312475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c081f45bb0 0x55c081f3f270 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f721002ae00 tx=0x7f7210031820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27801dc0fa43089b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:50.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.499+0000 7f71f77fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:55:50.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.499+0000 7f71f77fe640 1 -- 172.21.15.92:0/1009312475 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721004e040 con 0x55c081f45bb0 2024-09-19T08:55:50.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.500+0000 7f71f77fe640 1 -- 172.21.15.92:0/1009312475 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f7210004de0 con 0x55c081f45bb0 2024-09-19T08:55:50.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.500+0000 7f7220cab740 1 -- 172.21.15.92:0/1009312475 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f720c00c7a0 con 0x55c081f45bb0 2024-09-19T08:55:50.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.500+0000 7f71f77fe640 1 -- 172.21.15.92:0/1009312475 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7210005780 con 0x55c081f45bb0 2024-09-19T08:55:50.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.500+0000 7f7220cab740 10 client.15015 fetch_fsmap learned FSMap version 19 2024-09-19T08:55:50.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.500+0000 7f7220cab740 1 -- 172.21.15.92:0/1009312475 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55c081f5e7b0 con 0x55c081f45bb0 2024-09-19T08:55:50.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.500+0000 7f71f77fe640 1 -- 172.21.15.92:0/1009312475 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f720c00c7a0 con 0x55c081f45bb0 2024-09-19T08:55:50.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.500+0000 7f71f77fe640 1 -- 172.21.15.92:0/1009312475 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f721005e440 con 0x55c081f45bb0 2024-09-19T08:55:50.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.500+0000 7f7220cab740 10 client.15015 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:55:50.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.500+0000 7f7220cab740 10 client.15015 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T08:55:50.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.500+0000 7f7220cab740 20 client.15015 populate_metadata read hostname 'smithi092' 2024-09-19T08:55:50.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.500+0000 7f7220cab740 1 --2- 172.21.15.92:0/1009312475 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55c081f566b0 0x55c081fc42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:50.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.500+0000 7f7220cab740 4 client.15015 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T08:55:50.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.500+0000 7f7220cab740 1 -- 172.21.15.92:0/1009312475 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "status"}) -- 0x55c081ea8b10 con 0x55c081f566b0 2024-09-19T08:55:50.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.501+0000 7f7217fff640 1 --2- 172.21.15.92:0/1009312475 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55c081f566b0 0x55c081fc42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:50.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.501+0000 7f71f77fe640 10 client.15015 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:55:50.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.501+0000 7f7217fff640 1 --2- 172.21.15.92:0/1009312475 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55c081f566b0 0x55c081fc42d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8895de97ac3c35f0 server_cookie=1bc11a8f56697a1a in_seq=0 out_seq=0 2024-09-19T08:55:50.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.501+0000 7f71f77fe640 1 -- 172.21.15.92:0/1009312475 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55c081ea8b10 con 0x55c081f566b0 2024-09-19T08:55:50.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.501+0000 7f71f77fe640 10 client.15015 handle_command_reply: tid=0 2024-09-19T08:55:50.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.501+0000 7f7220cab740 1 client.15015 shutdown 2024-09-19T08:55:50.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.501+0000 7f7220cab740 1 -- 172.21.15.92:0/1009312475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c081f45bb0 msgr2=0x55c081f3f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:50.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.501+0000 7f7220cab740 1 --2- 172.21.15.92:0/1009312475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c081f45bb0 0x55c081f3f270 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f721002ae00 tx=0x7f7210031820 comp rx=0 tx=0).stop 2024-09-19T08:55:50.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.501+0000 7f7220cab740 1 -- 172.21.15.92:0/1009312475 shutdown_connections 2024-09-19T08:55:50.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.501+0000 7f7220cab740 1 --2- 172.21.15.92:0/1009312475 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55c081f566b0 0x55c081fc42d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.501+0000 7f7220cab740 1 --2- 172.21.15.92:0/1009312475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c081f45bb0 0x55c081f3f270 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.501+0000 7f7220cab740 1 --2- 172.21.15.92:0/1009312475 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c081f3b2f0 0x55c081f605e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.501+0000 7f7220cab740 1 --2- 172.21.15.92:0/1009312475 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c081f3a9d0 0x55c081f600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.501+0000 7f7220cab740 1 -- 172.21.15.92:0/1009312475 >> 172.21.15.92:0/1009312475 conn(0x55c081f36f60 msgr2=0x55c081f40ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:50.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.502+0000 7f71f77fe640 0 client.15015 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:55:50.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.502+0000 7f7220cab740 1 -- 172.21.15.92:0/1009312475 shutdown_connections 2024-09-19T08:55:50.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.502+0000 7f7220cab740 1 -- 172.21.15.92:0/1009312475 wait complete. 2024-09-19T08:55:50.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.502+0000 7f7220cab740 20 client.15015 trim_cache size 0 max 16384 2024-09-19T08:55:50.507 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T08:55:50.507 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "91ff74f2-7663-11ef-bceb-c7b262605968", 2024-09-19T08:55:50.507 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 0, 2024-09-19T08:55:50.507 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24472, 2024-09-19T08:55:50.508 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-09-19T08:55:50.508 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-09-19T08:55:50.508 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-09-19T08:55:50.508 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 78.074808039999994, 2024-09-19T08:55:50.508 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 19, 2024-09-19T08:55:50.508 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 82, 2024-09-19T08:55:50.508 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 80, 2024-09-19T08:55:50.508 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 96.932232873000004 2024-09-19T08:55:50.508 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T08:55:50.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.502+0000 7f721e8d2640 1 -- 172.21.15.92:0/3291478461 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f72000a32d0 msgr2=0x7f72000a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:50.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.502+0000 7f721e8d2640 1 --2- 172.21.15.92:0/3291478461 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f72000a32d0 0x7f72000a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7210009a60 tx=0x7f72100318c0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.502+0000 7f721e8d2640 1 -- 172.21.15.92:0/3291478461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7218102d30 msgr2=0x7f7218100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:50.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.502+0000 7f721e8d2640 1 --2- 172.21.15.92:0/3291478461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7218102d30 0x7f7218100990 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f720800c890 tx=0x7f720800cd50 comp rx=0 tx=0).stop 2024-09-19T08:55:50.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.502+0000 7f721e8d2640 1 -- 172.21.15.92:0/3291478461 shutdown_connections 2024-09-19T08:55:50.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.502+0000 7f721e8d2640 1 --2- 172.21.15.92:0/3291478461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72181082a0 0x7f7218101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.502+0000 7f721e8d2640 1 --2- 172.21.15.92:0/3291478461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f72181036e0 0x7f7218100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.502+0000 7f721e8d2640 1 --2- 172.21.15.92:0/3291478461 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f72000a32d0 0x7f72000a5790 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.502+0000 7f721e8d2640 1 --2- 172.21.15.92:0/3291478461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7218102d30 0x7f7218100990 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.502+0000 7f721e8d2640 1 -- 172.21.15.92:0/3291478461 >> 172.21.15.92:0/3291478461 conn(0x7f72180fc7d0 msgr2=0x7f7218105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:50.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.502+0000 7f721e8d2640 1 -- 172.21.15.92:0/3291478461 shutdown_connections 2024-09-19T08:55:50.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:50.503+0000 7f721e8d2640 1 -- 172.21.15.92:0/3291478461 wait complete. 2024-09-19T08:55:50.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:50 smithi092 ceph-mon[31407]: pgmap v311: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:55:50.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:50 smithi167 ceph-mon[35359]: pgmap v311: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:55:50.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:50 smithi190 ceph-mon[35358]: pgmap v311: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:55:51.125 INFO:tasks.cephadm:Setup complete, yielding 2024-09-19T08:55:51.125 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T08:55:51.135 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi092.front.sepia.ceph.com 2024-09-19T08:55:51.136 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-19T08:55:51.380 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:51.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.906+0000 7f8223b81640 1 -- 172.21.15.92:0/854466767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f821c100b10 msgr2=0x7f821c100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:51.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.906+0000 7f8223b81640 1 --2- 172.21.15.92:0/854466767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f821c100b10 0x7f821c100f10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8218009900 tx=0x7f821802a410 comp rx=0 tx=0).stop 2024-09-19T08:55:51.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.906+0000 7f8223b81640 1 -- 172.21.15.92:0/854466767 shutdown_connections 2024-09-19T08:55:51.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.906+0000 7f8223b81640 1 --2- 172.21.15.92:0/854466767 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f821c1026d0 0x7f821c108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:51.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.906+0000 7f8223b81640 1 --2- 172.21.15.92:0/854466767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f821c101d10 0x7f821c102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:51.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.906+0000 7f8223b81640 1 --2- 172.21.15.92:0/854466767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f821c100b10 0x7f821c100f10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:51.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.906+0000 7f8223b81640 1 -- 172.21.15.92:0/854466767 >> 172.21.15.92:0/854466767 conn(0x7f821c0fc2a0 msgr2=0x7f821c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:51.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.906+0000 7f8223b81640 1 -- 172.21.15.92:0/854466767 shutdown_connections 2024-09-19T08:55:51.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.906+0000 7f8223b81640 1 -- 172.21.15.92:0/854466767 wait complete. 2024-09-19T08:55:51.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.907+0000 7f8223b81640 1 Processor -- start 2024-09-19T08:55:51.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.907+0000 7f8223b81640 1 -- start start 2024-09-19T08:55:51.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.907+0000 7f8223b81640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f821c100b10 0x7f821c104aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:51.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.907+0000 7f8223b81640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f821c101d10 0x7f821c1030f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:51.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.907+0000 7f8223b81640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f821c1026d0 0x7f821c103630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:51.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.907+0000 7f8223b81640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f821c10c810 con 0x7f821c101d10 2024-09-19T08:55:51.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.907+0000 7f8223b81640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f821c10c690 con 0x7f821c100b10 2024-09-19T08:55:51.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.907+0000 7f8223b81640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f821c10c990 con 0x7f821c1026d0 2024-09-19T08:55:51.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.907+0000 7f822111c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f821c101d10 0x7f821c1030f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:51.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.907+0000 7f822111c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f821c101d10 0x7f821c1030f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42034/0 (socket says 172.21.15.92:42034) 2024-09-19T08:55:51.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.907+0000 7f822111c640 1 -- 172.21.15.92:0/2124126746 learned_addr learned my addr 172.21.15.92:0/2124126746 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:51.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.907+0000 7f822191d640 1 --2- 172.21.15.92:0/2124126746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f821c100b10 0x7f821c104aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:51.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.907+0000 7f822211e640 1 --2- 172.21.15.92:0/2124126746 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f821c1026d0 0x7f821c103630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:51.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.907+0000 7f822111c640 1 -- 172.21.15.92:0/2124126746 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f821c1026d0 msgr2=0x7f821c103630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:51.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.907+0000 7f822111c640 1 --2- 172.21.15.92:0/2124126746 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f821c1026d0 0x7f821c103630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:51.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.907+0000 7f822111c640 1 -- 172.21.15.92:0/2124126746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f821c100b10 msgr2=0x7f821c104aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:51.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.907+0000 7f822111c640 1 --2- 172.21.15.92:0/2124126746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f821c100b10 0x7f821c104aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:51.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.908+0000 7f822111c640 1 -- 172.21.15.92:0/2124126746 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f821c103ef0 con 0x7f821c101d10 2024-09-19T08:55:51.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.908+0000 7f822111c640 1 --2- 172.21.15.92:0/2124126746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f821c101d10 0x7f821c1030f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f820c00b4a0 tx=0x7f820c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:51.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.908+0000 7f8212ffd640 1 -- 172.21.15.92:0/2124126746 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820c014070 con 0x7f821c101d10 2024-09-19T08:55:51.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.908+0000 7f8223b81640 1 -- 172.21.15.92:0/2124126746 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f821c1a2150 con 0x7f821c101d10 2024-09-19T08:55:51.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.908+0000 7f8212ffd640 1 -- 172.21.15.92:0/2124126746 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f820c010af0 con 0x7f821c101d10 2024-09-19T08:55:51.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.908+0000 7f8212ffd640 1 -- 172.21.15.92:0/2124126746 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820c017d10 con 0x7f821c101d10 2024-09-19T08:55:51.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.908+0000 7f8223b81640 1 -- 172.21.15.92:0/2124126746 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f821c1a2730 con 0x7f821c101d10 2024-09-19T08:55:51.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.909+0000 7f8223b81640 1 -- 172.21.15.92:0/2124126746 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f821c1a29c0 con 0x7f821c101d10 2024-09-19T08:55:51.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.910+0000 7f8212ffd640 1 -- 172.21.15.92:0/2124126746 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f820c017070 con 0x7f821c101d10 2024-09-19T08:55:51.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.911+0000 7f8212ffd640 1 --2- 172.21.15.92:0/2124126746 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f82080a32d0 0x7f82080a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:51.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.911+0000 7f822191d640 1 --2- 172.21.15.92:0/2124126746 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f82080a32d0 0x7f82080a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:51.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.911+0000 7f8212ffd640 1 -- 172.21.15.92:0/2124126746 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f820c0cf0a0 con 0x7f821c101d10 2024-09-19T08:55:51.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.911+0000 7f822191d640 1 --2- 172.21.15.92:0/2124126746 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f82080a32d0 0x7f82080a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8218005ab0 tx=0x7f8218000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:51.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:51.914+0000 7f8212ffd640 1 -- 172.21.15.92:0/2124126746 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f820c09bd70 con 0x7f821c101d10 2024-09-19T08:55:52.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:52.094+0000 7f8223b81640 1 -- 172.21.15.92:0/2124126746 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f821c06af50 con 0x7f82080a32d0 2024-09-19T08:55:52.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:52.095+0000 7f8212ffd640 1 -- 172.21.15.92:0/2124126746 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f821c06af50 con 0x7f82080a32d0 2024-09-19T08:55:52.095 INFO:teuthology.orchestra.run.smithi092.stdout:Backend: cephadm 2024-09-19T08:55:52.095 INFO:teuthology.orchestra.run.smithi092.stdout:Available: Yes 2024-09-19T08:55:52.095 INFO:teuthology.orchestra.run.smithi092.stdout:Paused: No 2024-09-19T08:55:52.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:52.097+0000 7f8223b81640 1 -- 172.21.15.92:0/2124126746 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f82080a32d0 msgr2=0x7f82080a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:52.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:52.097+0000 7f8223b81640 1 --2- 172.21.15.92:0/2124126746 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f82080a32d0 0x7f82080a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8218005ab0 tx=0x7f8218000bc0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:52.097+0000 7f8223b81640 1 -- 172.21.15.92:0/2124126746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f821c101d10 msgr2=0x7f821c1030f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:52.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:52.097+0000 7f8223b81640 1 --2- 172.21.15.92:0/2124126746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f821c101d10 0x7f821c1030f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f820c00b4a0 tx=0x7f820c00b960 comp rx=0 tx=0).stop 2024-09-19T08:55:52.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:52.097+0000 7f8223b81640 1 -- 172.21.15.92:0/2124126746 shutdown_connections 2024-09-19T08:55:52.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:52.097+0000 7f8223b81640 1 --2- 172.21.15.92:0/2124126746 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f821c1026d0 0x7f821c103630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:52.097+0000 7f8223b81640 1 --2- 172.21.15.92:0/2124126746 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f82080a32d0 0x7f82080a5790 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:52.097+0000 7f8223b81640 1 --2- 172.21.15.92:0/2124126746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f821c101d10 0x7f821c1030f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:52.098+0000 7f8223b81640 1 --2- 172.21.15.92:0/2124126746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f821c100b10 0x7f821c104aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:52.098+0000 7f8223b81640 1 -- 172.21.15.92:0/2124126746 >> 172.21.15.92:0/2124126746 conn(0x7f821c0fc2a0 msgr2=0x7f821c06a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:52.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:52.098+0000 7f8223b81640 1 -- 172.21.15.92:0/2124126746 shutdown_connections 2024-09-19T08:55:52.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:52.098+0000 7f8223b81640 1 -- 172.21.15.92:0/2124126746 wait complete. 2024-09-19T08:55:52.708 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-19T08:55:52.953 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:53.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.400+0000 7fd577390640 1 -- 172.21.15.92:0/3496497540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd570100b10 msgr2=0x7fd570100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:53.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.400+0000 7fd577390640 1 --2- 172.21.15.92:0/3496497540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd570100b10 0x7fd570100f10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd560009900 tx=0x7fd56002a410 comp rx=0 tx=0).stop 2024-09-19T08:55:53.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.400+0000 7fd577390640 1 -- 172.21.15.92:0/3496497540 shutdown_connections 2024-09-19T08:55:53.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.400+0000 7fd577390640 1 --2- 172.21.15.92:0/3496497540 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5701026d0 0x7fd570108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:53.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.400+0000 7fd577390640 1 --2- 172.21.15.92:0/3496497540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd570101d10 0x7fd570102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:53.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.400+0000 7fd577390640 1 --2- 172.21.15.92:0/3496497540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd570100b10 0x7fd570100f10 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:53.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.400+0000 7fd577390640 1 -- 172.21.15.92:0/3496497540 >> 172.21.15.92:0/3496497540 conn(0x7fd5700fc2a0 msgr2=0x7fd5700fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:53.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.400+0000 7fd577390640 1 -- 172.21.15.92:0/3496497540 shutdown_connections 2024-09-19T08:55:53.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.400+0000 7fd577390640 1 -- 172.21.15.92:0/3496497540 wait complete. 2024-09-19T08:55:53.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.401+0000 7fd577390640 1 Processor -- start 2024-09-19T08:55:53.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.401+0000 7fd577390640 1 -- start start 2024-09-19T08:55:53.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.401+0000 7fd577390640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd570100b10 0x7fd570197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:53.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.401+0000 7fd577390640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd570101d10 0x7fd5701984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:53.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.401+0000 7fd577390640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5701026d0 0x7fd57019f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:53.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.401+0000 7fd577390640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd57010d920 con 0x7fd570101d10 2024-09-19T08:55:53.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.401+0000 7fd577390640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd57010d7a0 con 0x7fd5701026d0 2024-09-19T08:55:53.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.401+0000 7fd577390640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd57010daa0 con 0x7fd570100b10 2024-09-19T08:55:53.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.401+0000 7fd57492b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd570101d10 0x7fd5701984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:53.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.401+0000 7fd57492b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd570101d10 0x7fd5701984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42038/0 (socket says 172.21.15.92:42038) 2024-09-19T08:55:53.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.401+0000 7fd57492b640 1 -- 172.21.15.92:0/378291981 learned_addr learned my addr 172.21.15.92:0/378291981 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:53.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.401+0000 7fd57592d640 1 --2- 172.21.15.92:0/378291981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5701026d0 0x7fd57019f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:53.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.401+0000 7fd57512c640 1 --2- 172.21.15.92:0/378291981 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd570100b10 0x7fd570197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:53.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.401+0000 7fd57492b640 1 -- 172.21.15.92:0/378291981 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd570100b10 msgr2=0x7fd570197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:53.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.401+0000 7fd57492b640 1 --2- 172.21.15.92:0/378291981 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd570100b10 0x7fd570197f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:53.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.401+0000 7fd57492b640 1 -- 172.21.15.92:0/378291981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5701026d0 msgr2=0x7fd57019f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:53.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.401+0000 7fd57492b640 1 --2- 172.21.15.92:0/378291981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5701026d0 0x7fd57019f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:53.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.401+0000 7fd57492b640 1 -- 172.21.15.92:0/378291981 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd57019fba0 con 0x7fd570101d10 2024-09-19T08:55:53.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.401+0000 7fd57592d640 1 --2- 172.21.15.92:0/378291981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5701026d0 0x7fd57019f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:55:53.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.402+0000 7fd57492b640 1 --2- 172.21.15.92:0/378291981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd570101d10 0x7fd5701984b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd56c00b4a0 tx=0x7fd56c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:53.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.402+0000 7fd5667fc640 1 -- 172.21.15.92:0/378291981 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd56c014070 con 0x7fd570101d10 2024-09-19T08:55:53.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.402+0000 7fd5667fc640 1 -- 172.21.15.92:0/378291981 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd56c010af0 con 0x7fd570101d10 2024-09-19T08:55:53.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.402+0000 7fd577390640 1 -- 172.21.15.92:0/378291981 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd57019fe90 con 0x7fd570101d10 2024-09-19T08:55:53.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.402+0000 7fd5667fc640 1 -- 172.21.15.92:0/378291981 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd56c017d10 con 0x7fd570101d10 2024-09-19T08:55:53.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.402+0000 7fd577390640 1 -- 172.21.15.92:0/378291981 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5701a03c0 con 0x7fd570101d10 2024-09-19T08:55:53.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.403+0000 7fd577390640 1 -- 172.21.15.92:0/378291981 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd570107f60 con 0x7fd570101d10 2024-09-19T08:55:53.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.404+0000 7fd5667fc640 1 -- 172.21.15.92:0/378291981 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd56c017070 con 0x7fd570101d10 2024-09-19T08:55:53.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.405+0000 7fd5667fc640 1 --2- 172.21.15.92:0/378291981 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd55c0a3270 0x7fd55c0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:53.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.405+0000 7fd57512c640 1 --2- 172.21.15.92:0/378291981 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd55c0a3270 0x7fd55c0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:53.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.405+0000 7fd5667fc640 1 -- 172.21.15.92:0/378291981 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd56c0ceff0 con 0x7fd570101d10 2024-09-19T08:55:53.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.405+0000 7fd57512c640 1 --2- 172.21.15.92:0/378291981 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd55c0a3270 0x7fd55c0a5730 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd560031610 tx=0x7fd560000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:53.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.408+0000 7fd5667fc640 1 -- 172.21.15.92:0/378291981 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd56c09bdb0 con 0x7fd570101d10 2024-09-19T08:55:53.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.580+0000 7fd577390640 1 -- 172.21.15.92:0/378291981 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fd570062630 con 0x7fd55c0a3270 2024-09-19T08:55:53.581 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:53 smithi092 ceph-mon[31407]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:55:53.581 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:53 smithi092 ceph-mon[31407]: pgmap v312: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:55:53.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.594+0000 7fd5667fc640 1 -- 172.21.15.92:0/378291981 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7fd570062630 con 0x7fd55c0a3270 2024-09-19T08:55:53.595 INFO:teuthology.orchestra.run.smithi092.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T08:55:53.595 INFO:teuthology.orchestra.run.smithi092.stdout:mds.a smithi092 running (94s) 14s ago 94s 15.6M - 19.1.1-361-g2f599a46 d2baa855c067 52d54c5a9c5c 2024-09-19T08:55:53.595 INFO:teuthology.orchestra.run.smithi092.stdout:mds.b smithi167 running (92s) 24s ago 91s 13.2M - 19.1.1-361-g2f599a46 d2baa855c067 e921df93c256 2024-09-19T08:55:53.595 INFO:teuthology.orchestra.run.smithi092.stdout:mds.c smithi190 running (105s) 24s ago 104s 18.0M - 19.1.1-361-g2f599a46 d2baa855c067 c2e655d2338b 2024-09-19T08:55:53.596 INFO:teuthology.orchestra.run.smithi092.stdout:mds.d smithi092 running (112s) 14s ago 112s 13.4M - 19.1.1-361-g2f599a46 d2baa855c067 6d8ec87e57c1 2024-09-19T08:55:53.596 INFO:teuthology.orchestra.run.smithi092.stdout:mds.e smithi167 running (110s) 24s ago 109s 14.2M - 19.1.1-361-g2f599a46 d2baa855c067 0d0d2f3efbf2 2024-09-19T08:55:53.596 INFO:teuthology.orchestra.run.smithi092.stdout:mds.f smithi190 running (107s) 24s ago 107s 14.3M - 19.1.1-361-g2f599a46 d2baa855c067 a942c88427f6 2024-09-19T08:55:53.596 INFO:teuthology.orchestra.run.smithi092.stdout:mds.g smithi092 running (97s) 14s ago 97s 14.3M - 19.1.1-361-g2f599a46 d2baa855c067 bec86d02e627 2024-09-19T08:55:53.596 INFO:teuthology.orchestra.run.smithi092.stdout:mds.h smithi167 running (102s) 24s ago 102s 14.3M - 19.1.1-361-g2f599a46 d2baa855c067 3041fd7082a4 2024-09-19T08:55:53.596 INFO:teuthology.orchestra.run.smithi092.stdout:mds.i smithi190 running (100s) 24s ago 99s 25.2M - 19.1.1-361-g2f599a46 d2baa855c067 258812e0cf31 2024-09-19T08:55:53.596 INFO:teuthology.orchestra.run.smithi092.stdout:mds.j smithi092 running (115s) 14s ago 115s 13.4M - 19.1.1-361-g2f599a46 d2baa855c067 56c6763329b1 2024-09-19T08:55:53.596 INFO:teuthology.orchestra.run.smithi092.stdout:mds.k smithi167 running (118s) 24s ago 118s 15.8M - 19.1.1-361-g2f599a46 d2baa855c067 4aeda137d778 2024-09-19T08:55:53.596 INFO:teuthology.orchestra.run.smithi092.stdout:mds.l smithi190 running (2m) 24s ago 2m 16.7M - 19.1.1-361-g2f599a46 d2baa855c067 61dd0a593123 2024-09-19T08:55:53.596 INFO:teuthology.orchestra.run.smithi092.stdout:mgr.x smithi092 *:9283,8765 running (8m) 14s ago 8m 508M - 19.1.1-361-g2f599a46 d2baa855c067 2a2f457ff5fa 2024-09-19T08:55:53.596 INFO:teuthology.orchestra.run.smithi092.stdout:mgr.y smithi167 *:8443,8765 running (7m) 24s ago 7m 442M - 19.1.1-361-g2f599a46 d2baa855c067 4818274be14c 2024-09-19T08:55:53.596 INFO:teuthology.orchestra.run.smithi092.stdout:mgr.z smithi190 *:8443,8765 running (7m) 24s ago 7m 444M - 19.1.1-361-g2f599a46 d2baa855c067 48f7f2fac3d0 2024-09-19T08:55:53.597 INFO:teuthology.orchestra.run.smithi092.stdout:mon.a smithi092 running (8m) 14s ago 8m 50.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 74d516b1b00e 2024-09-19T08:55:53.597 INFO:teuthology.orchestra.run.smithi092.stdout:mon.b smithi167 running (7m) 24s ago 7m 40.6M 2048M 19.1.1-361-g2f599a46 d2baa855c067 9d435bae8dfd 2024-09-19T08:55:53.597 INFO:teuthology.orchestra.run.smithi092.stdout:mon.c smithi190 running (7m) 24s ago 7m 40.5M 2048M 19.1.1-361-g2f599a46 d2baa855c067 5b05f588d6ae 2024-09-19T08:55:53.597 INFO:teuthology.orchestra.run.smithi092.stdout:osd.0 smithi092 running (6m) 14s ago 6m 55.4M 4272M 19.1.1-361-g2f599a46 d2baa855c067 d6f28ed9db50 2024-09-19T08:55:53.597 INFO:teuthology.orchestra.run.smithi092.stdout:osd.1 smithi167 running (6m) 24s ago 6m 50.7M 4272M 19.1.1-361-g2f599a46 d2baa855c067 1b18703c68d5 2024-09-19T08:55:53.597 INFO:teuthology.orchestra.run.smithi092.stdout:osd.2 smithi190 running (5m) 24s ago 5m 58.0M 4272M 19.1.1-361-g2f599a46 d2baa855c067 6f9e74c582d5 2024-09-19T08:55:53.597 INFO:teuthology.orchestra.run.smithi092.stdout:osd.3 smithi092 running (5m) 14s ago 5m 45.6M 4272M 19.1.1-361-g2f599a46 d2baa855c067 6c62cdb7d086 2024-09-19T08:55:53.597 INFO:teuthology.orchestra.run.smithi092.stdout:osd.4 smithi167 running (5m) 24s ago 5m 52.5M 4272M 19.1.1-361-g2f599a46 d2baa855c067 a7e0b27e2938 2024-09-19T08:55:53.597 INFO:teuthology.orchestra.run.smithi092.stdout:osd.5 smithi190 running (4m) 24s ago 4m 54.6M 4272M 19.1.1-361-g2f599a46 d2baa855c067 fee96f10d6bb 2024-09-19T08:55:53.597 INFO:teuthology.orchestra.run.smithi092.stdout:osd.6 smithi092 running (4m) 14s ago 4m 51.9M 4272M 19.1.1-361-g2f599a46 d2baa855c067 3589d37de55e 2024-09-19T08:55:53.597 INFO:teuthology.orchestra.run.smithi092.stdout:osd.7 smithi167 running (3m) 24s ago 3m 49.5M 4272M 19.1.1-361-g2f599a46 d2baa855c067 bf4d33a9985a 2024-09-19T08:55:53.598 INFO:teuthology.orchestra.run.smithi092.stdout:osd.8 smithi190 running (3m) 24s ago 3m 46.2M 4272M 19.1.1-361-g2f599a46 d2baa855c067 43cb948bc09d 2024-09-19T08:55:53.598 INFO:teuthology.orchestra.run.smithi092.stdout:osd.9 smithi092 running (3m) 14s ago 3m 46.1M 4272M 19.1.1-361-g2f599a46 d2baa855c067 188309d6209d 2024-09-19T08:55:53.598 INFO:teuthology.orchestra.run.smithi092.stdout:osd.10 smithi167 running (2m) 24s ago 2m 45.9M 4272M 19.1.1-361-g2f599a46 d2baa855c067 4d47457edd71 2024-09-19T08:55:53.598 INFO:teuthology.orchestra.run.smithi092.stdout:osd.11 smithi190 running (2m) 24s ago 2m 50.9M 4272M 19.1.1-361-g2f599a46 d2baa855c067 7623b3ed3ce7 2024-09-19T08:55:53.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.596+0000 7fd577390640 1 -- 172.21.15.92:0/378291981 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd55c0a3270 msgr2=0x7fd55c0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:53.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.596+0000 7fd577390640 1 --2- 172.21.15.92:0/378291981 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd55c0a3270 0x7fd55c0a5730 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd560031610 tx=0x7fd560000bc0 comp rx=0 tx=0).stop 2024-09-19T08:55:53.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.596+0000 7fd577390640 1 -- 172.21.15.92:0/378291981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd570101d10 msgr2=0x7fd5701984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:53.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.596+0000 7fd577390640 1 --2- 172.21.15.92:0/378291981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd570101d10 0x7fd5701984b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd56c00b4a0 tx=0x7fd56c00b960 comp rx=0 tx=0).stop 2024-09-19T08:55:53.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.596+0000 7fd577390640 1 -- 172.21.15.92:0/378291981 shutdown_connections 2024-09-19T08:55:53.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.597+0000 7fd577390640 1 --2- 172.21.15.92:0/378291981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5701026d0 0x7fd57019f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:53.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.597+0000 7fd577390640 1 --2- 172.21.15.92:0/378291981 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd55c0a3270 0x7fd55c0a5730 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:53.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.597+0000 7fd577390640 1 --2- 172.21.15.92:0/378291981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd570101d10 0x7fd5701984b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:53.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.597+0000 7fd577390640 1 --2- 172.21.15.92:0/378291981 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd570100b10 0x7fd570197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:53.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.597+0000 7fd577390640 1 -- 172.21.15.92:0/378291981 >> 172.21.15.92:0/378291981 conn(0x7fd5700fc2a0 msgr2=0x7fd570105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:53.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.597+0000 7fd577390640 1 -- 172.21.15.92:0/378291981 shutdown_connections 2024-09-19T08:55:53.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:53.597+0000 7fd577390640 1 -- 172.21.15.92:0/378291981 wait complete. 2024-09-19T08:55:53.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:53 smithi167 ceph-mon[35359]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:55:53.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:53 smithi167 ceph-mon[35359]: pgmap v312: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:55:53.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:53 smithi190 ceph-mon[35358]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:55:53.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:53 smithi190 ceph-mon[35358]: pgmap v312: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:55:54.200 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-19T08:55:54.445 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:54.502 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:54 smithi092 ceph-mon[31407]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T08:55:54.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:54 smithi167 ceph-mon[35359]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T08:55:54.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:54 smithi190 ceph-mon[35358]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T08:55:54.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.936+0000 7f0150dec640 1 -- 172.21.15.92:0/1008184171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f014c1026d0 msgr2=0x7f014c108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:54.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.936+0000 7f0150dec640 1 --2- 172.21.15.92:0/1008184171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f014c1026d0 0x7f014c108f60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0144009ca0 tx=0x7f014402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:55:54.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.936+0000 7f0150dec640 1 -- 172.21.15.92:0/1008184171 shutdown_connections 2024-09-19T08:55:54.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.936+0000 7f0150dec640 1 --2- 172.21.15.92:0/1008184171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f014c1026d0 0x7f014c108f60 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:54.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.936+0000 7f0150dec640 1 --2- 172.21.15.92:0/1008184171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f014c101d10 0x7f014c102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:54.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.936+0000 7f0150dec640 1 --2- 172.21.15.92:0/1008184171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f014c100b10 0x7f014c100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:54.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.936+0000 7f0150dec640 1 -- 172.21.15.92:0/1008184171 >> 172.21.15.92:0/1008184171 conn(0x7f014c0fc2a0 msgr2=0x7f014c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:54.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.936+0000 7f0150dec640 1 -- 172.21.15.92:0/1008184171 shutdown_connections 2024-09-19T08:55:54.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.936+0000 7f0150dec640 1 -- 172.21.15.92:0/1008184171 wait complete. 2024-09-19T08:55:54.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.937+0000 7f0150dec640 1 Processor -- start 2024-09-19T08:55:54.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.937+0000 7f0150dec640 1 -- start start 2024-09-19T08:55:54.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.937+0000 7f0150dec640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f014c100b10 0x7f014c197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:54.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.937+0000 7f0150dec640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f014c101d10 0x7f014c1983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:54.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.937+0000 7f0150dec640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f014c1026d0 0x7f014c19f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:54.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.937+0000 7f0150dec640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f014c10d920 con 0x7f014c100b10 2024-09-19T08:55:54.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.937+0000 7f0150dec640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f014c10d7a0 con 0x7f014c1026d0 2024-09-19T08:55:54.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.937+0000 7f0150dec640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f014c10daa0 con 0x7f014c101d10 2024-09-19T08:55:54.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.937+0000 7f014a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f014c100b10 0x7f014c197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:54.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.937+0000 7f014a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f014c100b10 0x7f014c197e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42046/0 (socket says 172.21.15.92:42046) 2024-09-19T08:55:54.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.937+0000 7f014a59c640 1 -- 172.21.15.92:0/3922927660 learned_addr learned my addr 172.21.15.92:0/3922927660 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:54.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.937+0000 7f014ad9d640 1 --2- 172.21.15.92:0/3922927660 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f014c1026d0 0x7f014c19f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:54.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.937+0000 7f0149d9b640 1 --2- 172.21.15.92:0/3922927660 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f014c101d10 0x7f014c1983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:54.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.937+0000 7f014a59c640 1 -- 172.21.15.92:0/3922927660 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f014c101d10 msgr2=0x7f014c1983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:54.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.937+0000 7f014a59c640 1 --2- 172.21.15.92:0/3922927660 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f014c101d10 0x7f014c1983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:54.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.937+0000 7f014a59c640 1 -- 172.21.15.92:0/3922927660 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f014c1026d0 msgr2=0x7f014c19f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:54.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.937+0000 7f014a59c640 1 --2- 172.21.15.92:0/3922927660 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f014c1026d0 0x7f014c19f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:54.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.937+0000 7f014a59c640 1 -- 172.21.15.92:0/3922927660 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f014c19fab0 con 0x7f014c100b10 2024-09-19T08:55:54.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.938+0000 7f014a59c640 1 --2- 172.21.15.92:0/3922927660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f014c100b10 0x7f014c197e80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f014000b450 tx=0x7f014000b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:54.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.938+0000 7f013b7fe640 1 -- 172.21.15.92:0/3922927660 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0140015020 con 0x7f014c100b10 2024-09-19T08:55:54.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.938+0000 7f0150dec640 1 -- 172.21.15.92:0/3922927660 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f014c19fda0 con 0x7f014c100b10 2024-09-19T08:55:54.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.938+0000 7f013b7fe640 1 -- 172.21.15.92:0/3922927660 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0140011d10 con 0x7f014c100b10 2024-09-19T08:55:54.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.938+0000 7f013b7fe640 1 -- 172.21.15.92:0/3922927660 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f014000f2e0 con 0x7f014c100b10 2024-09-19T08:55:54.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.938+0000 7f0150dec640 1 -- 172.21.15.92:0/3922927660 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f014c1a0280 con 0x7f014c100b10 2024-09-19T08:55:54.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.939+0000 7f0150dec640 1 -- 172.21.15.92:0/3922927660 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f014c107de0 con 0x7f014c100b10 2024-09-19T08:55:54.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.940+0000 7f013b7fe640 1 -- 172.21.15.92:0/3922927660 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0140018020 con 0x7f014c100b10 2024-09-19T08:55:54.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.940+0000 7f013b7fe640 1 --2- 172.21.15.92:0/3922927660 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f01340a3270 0x7f01340a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:54.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.941+0000 7f0149d9b640 1 --2- 172.21.15.92:0/3922927660 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f01340a3270 0x7f01340a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:54.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.941+0000 7f013b7fe640 1 -- 172.21.15.92:0/3922927660 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f01400cf150 con 0x7f014c100b10 2024-09-19T08:55:54.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.941+0000 7f0149d9b640 1 --2- 172.21.15.92:0/3922927660 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f01340a3270 0x7f01340a5730 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f014c1993a0 tx=0x7f013c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:54.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:54.945+0000 7f013b7fe640 1 -- 172.21.15.92:0/3922927660 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f014001f020 con 0x7f014c100b10 2024-09-19T08:55:55.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:55.117+0000 7f0150dec640 1 -- 172.21.15.92:0/3922927660 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f014c062630 con 0x7f01340a3270 2024-09-19T08:55:55.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:55.123+0000 7f013b7fe640 1 -- 172.21.15.92:0/3922927660 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f014c062630 con 0x7f01340a3270 2024-09-19T08:55:55.123 INFO:teuthology.orchestra.run.smithi092.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-19T08:55:55.124 INFO:teuthology.orchestra.run.smithi092.stdout:mds.all 12/12 26s ago 2m smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi167=b;smithi167=e;smithi167=h;smithi167=k;smithi190=c;smithi190=f;smithi190=i;smithi190=l;count:12 2024-09-19T08:55:55.124 INFO:teuthology.orchestra.run.smithi092.stdout:mgr 3/3 26s ago 7m smithi092=x;smithi167=y;smithi190=z;count:3 2024-09-19T08:55:55.124 INFO:teuthology.orchestra.run.smithi092.stdout:mon 3/3 26s ago 7m smithi092:172.21.15.92=a;smithi167:172.21.15.167=b;smithi190:172.21.15.190=c;count:3 2024-09-19T08:55:55.124 INFO:teuthology.orchestra.run.smithi092.stdout:osd 12 26s ago - 2024-09-19T08:55:55.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:55.125+0000 7f0150dec640 1 -- 172.21.15.92:0/3922927660 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f01340a3270 msgr2=0x7f01340a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:55.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:55.125+0000 7f0150dec640 1 --2- 172.21.15.92:0/3922927660 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f01340a3270 0x7f01340a5730 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f014c1993a0 tx=0x7f013c00a2d0 comp rx=0 tx=0).stop 2024-09-19T08:55:55.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:55.125+0000 7f0150dec640 1 -- 172.21.15.92:0/3922927660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f014c100b10 msgr2=0x7f014c197e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:55.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:55.125+0000 7f0150dec640 1 --2- 172.21.15.92:0/3922927660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f014c100b10 0x7f014c197e80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f014000b450 tx=0x7f014000b850 comp rx=0 tx=0).stop 2024-09-19T08:55:55.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:55.125+0000 7f0150dec640 1 -- 172.21.15.92:0/3922927660 shutdown_connections 2024-09-19T08:55:55.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:55.125+0000 7f0150dec640 1 --2- 172.21.15.92:0/3922927660 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f014c1026d0 0x7f014c19f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:55.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:55.125+0000 7f0150dec640 1 --2- 172.21.15.92:0/3922927660 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f014c101d10 0x7f014c1983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:55.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:55.125+0000 7f0150dec640 1 --2- 172.21.15.92:0/3922927660 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f01340a3270 0x7f01340a5730 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:55.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:55.125+0000 7f0150dec640 1 --2- 172.21.15.92:0/3922927660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f014c100b10 0x7f014c197e80 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:55.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:55.125+0000 7f0150dec640 1 -- 172.21.15.92:0/3922927660 >> 172.21.15.92:0/3922927660 conn(0x7f014c0fc2a0 msgr2=0x7f014c104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:55.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:55.125+0000 7f0150dec640 1 -- 172.21.15.92:0/3922927660 shutdown_connections 2024-09-19T08:55:55.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:55.125+0000 7f0150dec640 1 -- 172.21.15.92:0/3922927660 wait complete. 2024-09-19T08:55:55.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:55 smithi092 ceph-mon[31407]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:55:55.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:55 smithi092 ceph-mon[31407]: pgmap v313: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:55:55.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:55 smithi167 ceph-mon[35359]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:55:55.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:55 smithi167 ceph-mon[35359]: pgmap v313: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:55:55.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:55 smithi190 ceph-mon[35358]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:55:55.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:55 smithi190 ceph-mon[35358]: pgmap v313: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:55:55.759 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-19T08:55:56.007 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:56.396 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:56 smithi092 ceph-mon[31407]: from='client.15033 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:55:56.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.396+0000 7f943004c640 1 -- 172.21.15.92:0/1619452356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94281026d0 msgr2=0x7f9428108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:56.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.396+0000 7f943004c640 1 --2- 172.21.15.92:0/1619452356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94281026d0 0x7f9428108f60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9420009ca0 tx=0x7f942002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:55:56.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.396+0000 7f943004c640 1 -- 172.21.15.92:0/1619452356 shutdown_connections 2024-09-19T08:55:56.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.396+0000 7f943004c640 1 --2- 172.21.15.92:0/1619452356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94281026d0 0x7f9428108f60 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:56.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.396+0000 7f943004c640 1 --2- 172.21.15.92:0/1619452356 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9428101d10 0x7f9428102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:56.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.396+0000 7f943004c640 1 --2- 172.21.15.92:0/1619452356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9428100b10 0x7f9428100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:56.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.396+0000 7f943004c640 1 -- 172.21.15.92:0/1619452356 >> 172.21.15.92:0/1619452356 conn(0x7f94280fc2a0 msgr2=0x7f94280fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:56.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.396+0000 7f943004c640 1 -- 172.21.15.92:0/1619452356 shutdown_connections 2024-09-19T08:55:56.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.396+0000 7f943004c640 1 -- 172.21.15.92:0/1619452356 wait complete. 2024-09-19T08:55:56.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.397+0000 7f943004c640 1 Processor -- start 2024-09-19T08:55:56.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.397+0000 7f943004c640 1 -- start start 2024-09-19T08:55:56.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.397+0000 7f943004c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9428100b10 0x7f9428196d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:56.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.397+0000 7f943004c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9428101d10 0x7f94281972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:56.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.397+0000 7f943004c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94281026d0 0x7f942819e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:56.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.397+0000 7f943004c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f942810c7f0 con 0x7f94281026d0 2024-09-19T08:55:56.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.397+0000 7f943004c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f942810c670 con 0x7f9428100b10 2024-09-19T08:55:56.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.397+0000 7f943004c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f942810c970 con 0x7f9428101d10 2024-09-19T08:55:56.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.397+0000 7f942e5e9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94281026d0 0x7f942819e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:56.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.397+0000 7f942e5e9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94281026d0 0x7f942819e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42056/0 (socket says 172.21.15.92:42056) 2024-09-19T08:55:56.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.397+0000 7f942e5e9640 1 -- 172.21.15.92:0/1505930901 learned_addr learned my addr 172.21.15.92:0/1505930901 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:56.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.397+0000 7f942e5e9640 1 -- 172.21.15.92:0/1505930901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9428101d10 msgr2=0x7f94281972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:56.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.397+0000 7f942dde8640 1 --2- 172.21.15.92:0/1505930901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9428100b10 0x7f9428196d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:56.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.397+0000 7f942e5e9640 1 --2- 172.21.15.92:0/1505930901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9428101d10 0x7f94281972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:56.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.397+0000 7f942e5e9640 1 -- 172.21.15.92:0/1505930901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9428100b10 msgr2=0x7f9428196d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:56.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.397+0000 7f942e5e9640 1 --2- 172.21.15.92:0/1505930901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9428100b10 0x7f9428196d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:56.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.397+0000 7f942e5e9640 1 -- 172.21.15.92:0/1505930901 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f942819e990 con 0x7f94281026d0 2024-09-19T08:55:56.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.397+0000 7f942dde8640 1 --2- 172.21.15.92:0/1505930901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9428100b10 0x7f9428196d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:55:56.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.398+0000 7f942e5e9640 1 --2- 172.21.15.92:0/1505930901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94281026d0 0x7f942819e320 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f94200098d0 tx=0x7f942002f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:56.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.398+0000 7f941effd640 1 -- 172.21.15.92:0/1505930901 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942002fc30 con 0x7f94281026d0 2024-09-19T08:55:56.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.398+0000 7f943004c640 1 -- 172.21.15.92:0/1505930901 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f942819ec20 con 0x7f94281026d0 2024-09-19T08:55:56.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.398+0000 7f941effd640 1 -- 172.21.15.92:0/1505930901 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9420003e50 con 0x7f94281026d0 2024-09-19T08:55:56.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.398+0000 7f941effd640 1 -- 172.21.15.92:0/1505930901 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94200305c0 con 0x7f94281026d0 2024-09-19T08:55:56.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.398+0000 7f943004c640 1 -- 172.21.15.92:0/1505930901 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f942819f230 con 0x7f94281026d0 2024-09-19T08:55:56.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.399+0000 7f943004c640 1 -- 172.21.15.92:0/1505930901 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9428107e40 con 0x7f94281026d0 2024-09-19T08:55:56.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.400+0000 7f941effd640 1 -- 172.21.15.92:0/1505930901 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9420003970 con 0x7f94281026d0 2024-09-19T08:55:56.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.401+0000 7f941effd640 1 --2- 172.21.15.92:0/1505930901 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f94140a32f0 0x7f94140a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:56.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.401+0000 7f942dde8640 1 --2- 172.21.15.92:0/1505930901 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f94140a32f0 0x7f94140a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:56.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.401+0000 7f941effd640 1 -- 172.21.15.92:0/1505930901 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f94200f0e90 con 0x7f94281026d0 2024-09-19T08:55:56.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.401+0000 7f942dde8640 1 --2- 172.21.15.92:0/1505930901 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f94140a32f0 0x7f94140a57b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9428101b70 tx=0x7f9424005db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:56.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.405+0000 7f941effd640 1 -- 172.21.15.92:0/1505930901 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9420042380 con 0x7f94281026d0 2024-09-19T08:55:56.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.576+0000 7f943004c640 1 -- 172.21.15.92:0/1505930901 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f9428062630 con 0x7f94140a32f0 2024-09-19T08:55:56.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.578+0000 7f941effd640 1 -- 172.21.15.92:0/1505930901 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f9428062630 con 0x7f94140a32f0 2024-09-19T08:55:56.578 INFO:teuthology.orchestra.run.smithi092.stdout:HOST ADDR LABELS STATUS 2024-09-19T08:55:56.579 INFO:teuthology.orchestra.run.smithi092.stdout:smithi092 172.21.15.92 2024-09-19T08:55:56.579 INFO:teuthology.orchestra.run.smithi092.stdout:smithi167 172.21.15.167 2024-09-19T08:55:56.579 INFO:teuthology.orchestra.run.smithi092.stdout:smithi190 172.21.15.190 2024-09-19T08:55:56.579 INFO:teuthology.orchestra.run.smithi092.stdout:3 hosts in cluster 2024-09-19T08:55:56.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.580+0000 7f943004c640 1 -- 172.21.15.92:0/1505930901 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f94140a32f0 msgr2=0x7f94140a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:56.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.580+0000 7f943004c640 1 --2- 172.21.15.92:0/1505930901 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f94140a32f0 0x7f94140a57b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9428101b70 tx=0x7f9424005db0 comp rx=0 tx=0).stop 2024-09-19T08:55:56.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.580+0000 7f943004c640 1 -- 172.21.15.92:0/1505930901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94281026d0 msgr2=0x7f942819e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:56.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.580+0000 7f943004c640 1 --2- 172.21.15.92:0/1505930901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94281026d0 0x7f942819e320 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f94200098d0 tx=0x7f942002f840 comp rx=0 tx=0).stop 2024-09-19T08:55:56.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.580+0000 7f943004c640 1 -- 172.21.15.92:0/1505930901 shutdown_connections 2024-09-19T08:55:56.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.580+0000 7f943004c640 1 --2- 172.21.15.92:0/1505930901 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f94140a32f0 0x7f94140a57b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:56.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.580+0000 7f943004c640 1 --2- 172.21.15.92:0/1505930901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94281026d0 0x7f942819e320 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:56.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.580+0000 7f943004c640 1 --2- 172.21.15.92:0/1505930901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9428101d10 0x7f94281972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:56.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.580+0000 7f943004c640 1 --2- 172.21.15.92:0/1505930901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9428100b10 0x7f9428196d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:56.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.580+0000 7f943004c640 1 -- 172.21.15.92:0/1505930901 >> 172.21.15.92:0/1505930901 conn(0x7f94280fc2a0 msgr2=0x7f9428105010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:56.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.580+0000 7f943004c640 1 -- 172.21.15.92:0/1505930901 shutdown_connections 2024-09-19T08:55:56.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:56.580+0000 7f943004c640 1 -- 172.21.15.92:0/1505930901 wait complete. 2024-09-19T08:55:56.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:56 smithi167 ceph-mon[35359]: from='client.15033 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:55:56.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:56 smithi190 ceph-mon[35358]: from='client.15033 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:55:57.105 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-19T08:55:57.350 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:57.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:57 smithi092 ceph-mon[31407]: pgmap v314: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:55:57.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:57 smithi167 ceph-mon[35359]: pgmap v314: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:55:57.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:57 smithi190 ceph-mon[35358]: pgmap v314: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:55:57.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.811+0000 7fedee99a640 1 -- 172.21.15.92:0/3252694621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fede8100dd0 msgr2=0x7fede8101230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:57.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.811+0000 7fedee99a640 1 --2- 172.21.15.92:0/3252694621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fede8100dd0 0x7fede8101230 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7feddc009900 tx=0x7feddc02a410 comp rx=0 tx=0).stop 2024-09-19T08:55:57.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.811+0000 7fedee99a640 1 -- 172.21.15.92:0/3252694621 shutdown_connections 2024-09-19T08:55:57.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.811+0000 7fedee99a640 1 --2- 172.21.15.92:0/3252694621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fede8101770 0x7fede8101c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:57.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.811+0000 7fedee99a640 1 --2- 172.21.15.92:0/3252694621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fede8100dd0 0x7fede8101230 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:57.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.811+0000 7fedee99a640 1 --2- 172.21.15.92:0/3252694621 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fede8100490 0x7fede8100890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:57.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.811+0000 7fedee99a640 1 -- 172.21.15.92:0/3252694621 >> 172.21.15.92:0/3252694621 conn(0x7fede80fc2a0 msgr2=0x7fede80fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:57.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.811+0000 7fedee99a640 1 -- 172.21.15.92:0/3252694621 shutdown_connections 2024-09-19T08:55:57.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.811+0000 7fedee99a640 1 -- 172.21.15.92:0/3252694621 wait complete. 2024-09-19T08:55:57.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.812+0000 7fedee99a640 1 Processor -- start 2024-09-19T08:55:57.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.812+0000 7fedee99a640 1 -- start start 2024-09-19T08:55:57.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.812+0000 7fedee99a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fede8100490 0x7fede819a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:57.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.812+0000 7fedee99a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fede8100dd0 0x7fede819a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:57.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.812+0000 7fedee99a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fede8101770 0x7fede81a1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:57.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.812+0000 7fedee99a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fede810fae0 con 0x7fede8101770 2024-09-19T08:55:57.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.812+0000 7fedee99a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fede810f960 con 0x7fede8100490 2024-09-19T08:55:57.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.812+0000 7fedee99a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fede810fc60 con 0x7fede8100dd0 2024-09-19T08:55:57.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.812+0000 7fedecf37640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fede8101770 0x7fede81a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:57.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.812+0000 7fedecf37640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fede8101770 0x7fede81a1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42066/0 (socket says 172.21.15.92:42066) 2024-09-19T08:55:57.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.812+0000 7fedecf37640 1 -- 172.21.15.92:0/3894502905 learned_addr learned my addr 172.21.15.92:0/3894502905 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:57.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.812+0000 7fede77fe640 1 --2- 172.21.15.92:0/3894502905 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fede8100dd0 0x7fede819a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:57.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.813+0000 7fede7fff640 1 --2- 172.21.15.92:0/3894502905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fede8100490 0x7fede819a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:57.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.813+0000 7fedecf37640 1 -- 172.21.15.92:0/3894502905 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fede8100dd0 msgr2=0x7fede819a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:57.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.813+0000 7fedecf37640 1 --2- 172.21.15.92:0/3894502905 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fede8100dd0 0x7fede819a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:57.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.813+0000 7fedecf37640 1 -- 172.21.15.92:0/3894502905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fede8100490 msgr2=0x7fede819a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:57.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.813+0000 7fedecf37640 1 --2- 172.21.15.92:0/3894502905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fede8100490 0x7fede819a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:57.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.813+0000 7fedecf37640 1 -- 172.21.15.92:0/3894502905 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede81a1df0 con 0x7fede8101770 2024-09-19T08:55:57.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.813+0000 7fede7fff640 1 --2- 172.21.15.92:0/3894502905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fede8100490 0x7fede819a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:55:57.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.813+0000 7fedecf37640 1 --2- 172.21.15.92:0/3894502905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fede8101770 0x7fede81a1780 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fede000eaa0 tx=0x7fede000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:57.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.813+0000 7fede57fa640 1 -- 172.21.15.92:0/3894502905 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede000cdb0 con 0x7fede8101770 2024-09-19T08:55:57.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.813+0000 7fedee99a640 1 -- 172.21.15.92:0/3894502905 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fede81a20e0 con 0x7fede8101770 2024-09-19T08:55:57.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.813+0000 7fede57fa640 1 -- 172.21.15.92:0/3894502905 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fede0005020 con 0x7fede8101770 2024-09-19T08:55:57.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.813+0000 7fede57fa640 1 -- 172.21.15.92:0/3894502905 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede00116b0 con 0x7fede8101770 2024-09-19T08:55:57.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.813+0000 7fedee99a640 1 -- 172.21.15.92:0/3894502905 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fede81a2670 con 0x7fede8101770 2024-09-19T08:55:57.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.814+0000 7fedee99a640 1 -- 172.21.15.92:0/3894502905 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fede8101230 con 0x7fede8101770 2024-09-19T08:55:57.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.815+0000 7fede57fa640 1 -- 172.21.15.92:0/3894502905 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fede0005560 con 0x7fede8101770 2024-09-19T08:55:57.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.816+0000 7fede57fa640 1 --2- 172.21.15.92:0/3894502905 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fedd00a3270 0x7fedd00a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:57.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.816+0000 7fede7fff640 1 --2- 172.21.15.92:0/3894502905 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fedd00a3270 0x7fedd00a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:57.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.816+0000 7fede57fa640 1 -- 172.21.15.92:0/3894502905 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fede00cfbf0 con 0x7fede8101770 2024-09-19T08:55:57.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.816+0000 7fede7fff640 1 --2- 172.21.15.92:0/3894502905 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fedd00a3270 0x7fedd00a5730 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fedd8006fd0 tx=0x7fedd8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:57.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.820+0000 7fede57fa640 1 -- 172.21.15.92:0/3894502905 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fede0016030 con 0x7fede8101770 2024-09-19T08:55:57.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.992+0000 7fedee99a640 1 -- 172.21.15.92:0/3894502905 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fede8062630 con 0x7fedd00a3270 2024-09-19T08:55:57.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.994+0000 7fede57fa640 1 -- 172.21.15.92:0/3894502905 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fede8062630 con 0x7fedd00a3270 2024-09-19T08:55:57.995 INFO:teuthology.orchestra.run.smithi092.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-19T08:55:57.995 INFO:teuthology.orchestra.run.smithi092.stdout:smithi092 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400QM400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-19T08:55:57.995 INFO:teuthology.orchestra.run.smithi092.stdout:smithi167 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT62330080400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T08:55:57.995 INFO:teuthology.orchestra.run.smithi092.stdout:smithi190 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT63210012400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T08:55:57.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.996+0000 7fedee99a640 1 -- 172.21.15.92:0/3894502905 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fedd00a3270 msgr2=0x7fedd00a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:57.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.996+0000 7fedee99a640 1 --2- 172.21.15.92:0/3894502905 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fedd00a3270 0x7fedd00a5730 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fedd8006fd0 tx=0x7fedd8008040 comp rx=0 tx=0).stop 2024-09-19T08:55:57.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.996+0000 7fedee99a640 1 -- 172.21.15.92:0/3894502905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fede8101770 msgr2=0x7fede81a1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:57.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.996+0000 7fedee99a640 1 --2- 172.21.15.92:0/3894502905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fede8101770 0x7fede81a1780 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fede000eaa0 tx=0x7fede000ef60 comp rx=0 tx=0).stop 2024-09-19T08:55:57.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.996+0000 7fedee99a640 1 -- 172.21.15.92:0/3894502905 shutdown_connections 2024-09-19T08:55:57.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.996+0000 7fedee99a640 1 --2- 172.21.15.92:0/3894502905 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fedd00a3270 0x7fedd00a5730 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:57.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.996+0000 7fedee99a640 1 --2- 172.21.15.92:0/3894502905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fede8101770 0x7fede81a1780 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:57.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.996+0000 7fedee99a640 1 --2- 172.21.15.92:0/3894502905 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fede8100dd0 0x7fede819a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:57.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.996+0000 7fedee99a640 1 --2- 172.21.15.92:0/3894502905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fede8100490 0x7fede819a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:57.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.996+0000 7fedee99a640 1 -- 172.21.15.92:0/3894502905 >> 172.21.15.92:0/3894502905 conn(0x7fede80fc2a0 msgr2=0x7fede80fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:57.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.996+0000 7fedee99a640 1 -- 172.21.15.92:0/3894502905 shutdown_connections 2024-09-19T08:55:57.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:57.997+0000 7fedee99a640 1 -- 172.21.15.92:0/3894502905 wait complete. 2024-09-19T08:55:58.578 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:58 smithi092 ceph-mon[31407]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:55:58.579 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T08:55:58.588 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi092.front.sepia.ceph.com 2024-09-19T08:55:58.588 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-19T08:55:58.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:58 smithi190 ceph-mon[35358]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:55:58.833 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:58.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:58 smithi167 ceph-mon[35359]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:55:59.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.249+0000 7f5f5d04d640 1 -- 172.21.15.92:0/4266718664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f58101cd0 msgr2=0x7f5f58102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:59.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.249+0000 7f5f5d04d640 1 --2- 172.21.15.92:0/4266718664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f58101cd0 0x7f5f58102150 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c009900 tx=0x7f5f4c02a410 comp rx=0 tx=0).stop 2024-09-19T08:55:59.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.250+0000 7f5f5d04d640 1 -- 172.21.15.92:0/4266718664 shutdown_connections 2024-09-19T08:55:59.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.250+0000 7f5f5d04d640 1 --2- 172.21.15.92:0/4266718664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f58102690 0x7f5f58108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:59.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.250+0000 7f5f5d04d640 1 --2- 172.21.15.92:0/4266718664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f58101cd0 0x7f5f58102150 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:59.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.250+0000 7f5f5d04d640 1 --2- 172.21.15.92:0/4266718664 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f58100ad0 0x7f5f58100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:59.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.250+0000 7f5f5d04d640 1 -- 172.21.15.92:0/4266718664 >> 172.21.15.92:0/4266718664 conn(0x7f5f580fc280 msgr2=0x7f5f580fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:59.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.250+0000 7f5f5d04d640 1 -- 172.21.15.92:0/4266718664 shutdown_connections 2024-09-19T08:55:59.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.250+0000 7f5f5d04d640 1 -- 172.21.15.92:0/4266718664 wait complete. 2024-09-19T08:55:59.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.250+0000 7f5f5d04d640 1 Processor -- start 2024-09-19T08:55:59.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.250+0000 7f5f5d04d640 1 -- start start 2024-09-19T08:55:59.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.251+0000 7f5f5d04d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f58100ad0 0x7f5f58104a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:59.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.251+0000 7f5f5d04d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f58101cd0 0x7f5f581030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:59.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.251+0000 7f5f5d04d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f58102690 0x7f5f581035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:59.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.251+0000 7f5f5d04d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5810c7d0 con 0x7f5f58102690 2024-09-19T08:55:59.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.251+0000 7f5f5d04d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5810c650 con 0x7f5f58100ad0 2024-09-19T08:55:59.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.251+0000 7f5f5d04d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5810c950 con 0x7f5f58101cd0 2024-09-19T08:55:59.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.251+0000 7f5f5759e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f58102690 0x7f5f581035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:59.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.251+0000 7f5f5659c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f58101cd0 0x7f5f581030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:59.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.251+0000 7f5f5659c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f58101cd0 0x7f5f581030b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:44802/0 (socket says 172.21.15.92:44802) 2024-09-19T08:55:59.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.251+0000 7f5f5759e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f58102690 0x7f5f581035f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42080/0 (socket says 172.21.15.92:42080) 2024-09-19T08:55:59.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.251+0000 7f5f5659c640 1 -- 172.21.15.92:0/1632125911 learned_addr learned my addr 172.21.15.92:0/1632125911 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:55:59.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.251+0000 7f5f56d9d640 1 --2- 172.21.15.92:0/1632125911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f58100ad0 0x7f5f58104a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:59.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.251+0000 7f5f5759e640 1 -- 172.21.15.92:0/1632125911 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f58101cd0 msgr2=0x7f5f581030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:59.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.251+0000 7f5f5759e640 1 --2- 172.21.15.92:0/1632125911 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f58101cd0 0x7f5f581030b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:59.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.251+0000 7f5f5759e640 1 -- 172.21.15.92:0/1632125911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f58100ad0 msgr2=0x7f5f58104a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:59.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.251+0000 7f5f5759e640 1 --2- 172.21.15.92:0/1632125911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f58100ad0 0x7f5f58104a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:59.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.251+0000 7f5f5759e640 1 -- 172.21.15.92:0/1632125911 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f58103eb0 con 0x7f5f58102690 2024-09-19T08:55:59.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.251+0000 7f5f56d9d640 1 --2- 172.21.15.92:0/1632125911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f58100ad0 0x7f5f58104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:55:59.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.251+0000 7f5f5759e640 1 --2- 172.21.15.92:0/1632125911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f58102690 0x7f5f581035f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5f5000cab0 tx=0x7f5f5000cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:59.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.252+0000 7f5f3ffff640 1 -- 172.21.15.92:0/1632125911 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f5000ae20 con 0x7f5f58102690 2024-09-19T08:55:59.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.252+0000 7f5f5d04d640 1 -- 172.21.15.92:0/1632125911 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f581a20d0 con 0x7f5f58102690 2024-09-19T08:55:59.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.252+0000 7f5f3ffff640 1 -- 172.21.15.92:0/1632125911 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f5000f930 con 0x7f5f58102690 2024-09-19T08:55:59.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.252+0000 7f5f3ffff640 1 -- 172.21.15.92:0/1632125911 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f50018b30 con 0x7f5f58102690 2024-09-19T08:55:59.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.252+0000 7f5f5d04d640 1 -- 172.21.15.92:0/1632125911 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f581a2610 con 0x7f5f58102690 2024-09-19T08:55:59.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.253+0000 7f5f5d04d640 1 -- 172.21.15.92:0/1632125911 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f58100eb0 con 0x7f5f58102690 2024-09-19T08:55:59.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.254+0000 7f5f3ffff640 1 -- 172.21.15.92:0/1632125911 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5f5000fae0 con 0x7f5f58102690 2024-09-19T08:55:59.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.255+0000 7f5f3ffff640 1 --2- 172.21.15.92:0/1632125911 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5f400a3240 0x7f5f400a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:59.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.255+0000 7f5f56d9d640 1 --2- 172.21.15.92:0/1632125911 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5f400a3240 0x7f5f400a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:59.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.255+0000 7f5f3ffff640 1 -- 172.21.15.92:0/1632125911 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f5f500d00a0 con 0x7f5f58102690 2024-09-19T08:55:59.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.255+0000 7f5f56d9d640 1 --2- 172.21.15.92:0/1632125911 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5f400a3240 0x7f5f400a5700 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5f58101b30 tx=0x7f5f48008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:59.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.259+0000 7f5f3ffff640 1 -- 172.21.15.92:0/1632125911 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5f50014030 con 0x7f5f58102690 2024-09-19T08:55:59.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.465+0000 7f5f5d04d640 1 -- 172.21.15.92:0/1632125911 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f5f581a28a0 con 0x7f5f58102690 2024-09-19T08:55:59.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.465+0000 7f5f3ffff640 1 -- 172.21.15.92:0/1632125911 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) ==== 76+0+3042 (secure 0 0 0) 0x7f5f5009cdc0 con 0x7f5f58102690 2024-09-19T08:55:59.465 INFO:teuthology.orchestra.run.smithi092.stdout:e19 2024-09-19T08:55:59.465 INFO:teuthology.orchestra.run.smithi092.stdout:btime 2024-09-19T08:54:41:480530+0000 2024-09-19T08:55:59.466 INFO:teuthology.orchestra.run.smithi092.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T08:55:59.466 INFO:teuthology.orchestra.run.smithi092.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T08:55:59.466 INFO:teuthology.orchestra.run.smithi092.stdout:legacy client fscid: 1 2024-09-19T08:55:59.466 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:55:59.466 INFO:teuthology.orchestra.run.smithi092.stdout:Filesystem 'cephfs' (1) 2024-09-19T08:55:59.466 INFO:teuthology.orchestra.run.smithi092.stdout:fs_name cephfs 2024-09-19T08:55:59.466 INFO:teuthology.orchestra.run.smithi092.stdout:epoch 19 2024-09-19T08:55:59.466 INFO:teuthology.orchestra.run.smithi092.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T08:55:59.466 INFO:teuthology.orchestra.run.smithi092.stdout:created 2024-09-19T08:54:31.939376+0000 2024-09-19T08:55:59.466 INFO:teuthology.orchestra.run.smithi092.stdout:modified 2024-09-19T08:54:40.961053+0000 2024-09-19T08:55:59.466 INFO:teuthology.orchestra.run.smithi092.stdout:tableserver 0 2024-09-19T08:55:59.466 INFO:teuthology.orchestra.run.smithi092.stdout:root 0 2024-09-19T08:55:59.467 INFO:teuthology.orchestra.run.smithi092.stdout:session_timeout 300 2024-09-19T08:55:59.467 INFO:teuthology.orchestra.run.smithi092.stdout:session_autoclose 300 2024-09-19T08:55:59.467 INFO:teuthology.orchestra.run.smithi092.stdout:max_file_size 1099511627776 2024-09-19T08:55:59.467 INFO:teuthology.orchestra.run.smithi092.stdout:max_xattr_size 65536 2024-09-19T08:55:59.467 INFO:teuthology.orchestra.run.smithi092.stdout:required_client_features {} 2024-09-19T08:55:59.467 INFO:teuthology.orchestra.run.smithi092.stdout:last_failure 0 2024-09-19T08:55:59.467 INFO:teuthology.orchestra.run.smithi092.stdout:last_failure_osd_epoch 0 2024-09-19T08:55:59.467 INFO:teuthology.orchestra.run.smithi092.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T08:55:59.467 INFO:teuthology.orchestra.run.smithi092.stdout:max_mds 1 2024-09-19T08:55:59.467 INFO:teuthology.orchestra.run.smithi092.stdout:in 0 2024-09-19T08:55:59.467 INFO:teuthology.orchestra.run.smithi092.stdout:up {0=24472} 2024-09-19T08:55:59.467 INFO:teuthology.orchestra.run.smithi092.stdout:failed 2024-09-19T08:55:59.467 INFO:teuthology.orchestra.run.smithi092.stdout:damaged 2024-09-19T08:55:59.467 INFO:teuthology.orchestra.run.smithi092.stdout:stopped 2024-09-19T08:55:59.468 INFO:teuthology.orchestra.run.smithi092.stdout:data_pools [3] 2024-09-19T08:55:59.468 INFO:teuthology.orchestra.run.smithi092.stdout:metadata_pool 2 2024-09-19T08:55:59.468 INFO:teuthology.orchestra.run.smithi092.stdout:inline_data disabled 2024-09-19T08:55:59.468 INFO:teuthology.orchestra.run.smithi092.stdout:balancer 2024-09-19T08:55:59.468 INFO:teuthology.orchestra.run.smithi092.stdout:bal_rank_mask -1 2024-09-19T08:55:59.468 INFO:teuthology.orchestra.run.smithi092.stdout:standby_count_wanted 0 2024-09-19T08:55:59.468 INFO:teuthology.orchestra.run.smithi092.stdout:qdb_cluster leader: 24472 members: 24472 2024-09-19T08:55:59.468 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.i{0:24472} state up:active seq 6 addr [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:55:59.468 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.c{0:24466} state up:standby-replay seq 1 addr [v2:172.21.15.190:6836/3700975791,v1:172.21.15.190:6837/3700975791] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:55:59.468 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:55:59.468 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:55:59.468 INFO:teuthology.orchestra.run.smithi092.stdout:Standby daemons: 2024-09-19T08:55:59.468 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:55:59.469 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.j{-1:14565} state up:standby seq 1 addr [v2:172.21.15.92:6834/3960227551,v1:172.21.15.92:6835/3960227551] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:55:59.469 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.d{-1:14577} state up:standby seq 1 addr [v2:172.21.15.92:6836/589903863,v1:172.21.15.92:6837/589903863] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:55:59.469 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.g{-1:14628} state up:standby seq 1 addr [v2:172.21.15.92:6838/4148028188,v1:172.21.15.92:6839/4148028188] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:55:59.469 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.a{-1:14634} state up:standby seq 1 addr [v2:172.21.15.92:6840/265521661,v1:172.21.15.92:6841/265521661] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:55:59.469 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.k{-1:24398} state up:standby seq 1 addr [v2:172.21.15.167:6832/442320499,v1:172.21.15.167:6833/442320499] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:55:59.469 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.e{-1:24422} state up:standby seq 1 addr [v2:172.21.15.167:6834/862511072,v1:172.21.15.167:6835/862511072] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:55:59.469 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.l{-1:24427} state up:standby seq 1 addr [v2:172.21.15.190:6832/490523332,v1:172.21.15.190:6833/490523332] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:55:59.469 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.h{-1:24437} state up:standby seq 1 addr [v2:172.21.15.167:6836/440158756,v1:172.21.15.167:6837/440158756] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:55:59.469 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.f{-1:24454} state up:standby seq 1 addr [v2:172.21.15.190:6834/335271561,v1:172.21.15.190:6835/335271561] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:55:59.469 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.b{-1:24458} state up:standby seq 1 addr [v2:172.21.15.167:6838/3540790060,v1:172.21.15.167:6839/3540790060] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:55:59.470 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T08:55:59.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.467+0000 7f5f5d04d640 1 -- 172.21.15.92:0/1632125911 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5f400a3240 msgr2=0x7f5f400a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:59.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.467+0000 7f5f5d04d640 1 --2- 172.21.15.92:0/1632125911 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5f400a3240 0x7f5f400a5700 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5f58101b30 tx=0x7f5f48008040 comp rx=0 tx=0).stop 2024-09-19T08:55:59.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.468+0000 7f5f5d04d640 1 -- 172.21.15.92:0/1632125911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f58102690 msgr2=0x7f5f581035f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:59.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.468+0000 7f5f5d04d640 1 --2- 172.21.15.92:0/1632125911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f58102690 0x7f5f581035f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5f5000cab0 tx=0x7f5f5000cf70 comp rx=0 tx=0).stop 2024-09-19T08:55:59.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.468+0000 7f5f5d04d640 1 -- 172.21.15.92:0/1632125911 shutdown_connections 2024-09-19T08:55:59.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.468+0000 7f5f5d04d640 1 --2- 172.21.15.92:0/1632125911 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5f400a3240 0x7f5f400a5700 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:59.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.468+0000 7f5f5d04d640 1 --2- 172.21.15.92:0/1632125911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f58102690 0x7f5f581035f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:59.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.468+0000 7f5f5d04d640 1 --2- 172.21.15.92:0/1632125911 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f58101cd0 0x7f5f581030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:59.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.468+0000 7f5f5d04d640 1 --2- 172.21.15.92:0/1632125911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f58100ad0 0x7f5f58104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:59.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.468+0000 7f5f5d04d640 1 -- 172.21.15.92:0/1632125911 >> 172.21.15.92:0/1632125911 conn(0x7f5f580fc280 msgr2=0x7f5f58069fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:59.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.468+0000 7f5f5d04d640 1 -- 172.21.15.92:0/1632125911 shutdown_connections 2024-09-19T08:55:59.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:55:59.468+0000 7f5f5d04d640 1 -- 172.21.15.92:0/1632125911 wait complete. 2024-09-19T08:55:59.502 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:59 smithi092 ceph-mon[31407]: from='client.15045 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:55:59.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:55:59 smithi092 ceph-mon[31407]: pgmap v315: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:55:59.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:59 smithi190 ceph-mon[35358]: from='client.15045 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:55:59.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:55:59 smithi190 ceph-mon[35358]: pgmap v315: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:55:59.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:59 smithi167 ceph-mon[35359]: from='client.15045 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:55:59.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:55:59 smithi167 ceph-mon[35359]: pgmap v315: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:56:00.146 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-19T08:56:00.405 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:00.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:00 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/1632125911' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T08:56:00.631 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:00 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1632125911' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T08:56:00.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.804+0000 7fa645da9640 1 -- 172.21.15.92:0/3711261556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa640102690 msgr2=0x7fa640108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:00.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.804+0000 7fa645da9640 1 --2- 172.21.15.92:0/3711261556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa640102690 0x7fa640108f20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa638009ca0 tx=0x7fa63802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.804+0000 7fa645da9640 1 -- 172.21.15.92:0/3711261556 shutdown_connections 2024-09-19T08:56:00.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.804+0000 7fa645da9640 1 --2- 172.21.15.92:0/3711261556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa640102690 0x7fa640108f20 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.804+0000 7fa645da9640 1 --2- 172.21.15.92:0/3711261556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa640101cd0 0x7fa640102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.804+0000 7fa645da9640 1 --2- 172.21.15.92:0/3711261556 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa640100ad0 0x7fa640100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.804+0000 7fa645da9640 1 -- 172.21.15.92:0/3711261556 >> 172.21.15.92:0/3711261556 conn(0x7fa6400fc280 msgr2=0x7fa6400fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:00.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.804+0000 7fa645da9640 1 -- 172.21.15.92:0/3711261556 shutdown_connections 2024-09-19T08:56:00.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.804+0000 7fa645da9640 1 -- 172.21.15.92:0/3711261556 wait complete. 2024-09-19T08:56:00.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.805+0000 7fa645da9640 1 Processor -- start 2024-09-19T08:56:00.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.805+0000 7fa645da9640 1 -- start start 2024-09-19T08:56:00.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.805+0000 7fa645da9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa640100ad0 0x7fa640104bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:00.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.805+0000 7fa645da9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa640101cd0 0x7fa640103220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:00.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.805+0000 7fa645da9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa640102690 0x7fa640103760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:00.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.805+0000 7fa645da9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa64010c750 con 0x7fa640102690 2024-09-19T08:56:00.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.805+0000 7fa645da9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa64010c5d0 con 0x7fa640101cd0 2024-09-19T08:56:00.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.805+0000 7fa645da9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa64010c8d0 con 0x7fa640100ad0 2024-09-19T08:56:00.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.805+0000 7fa63ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa640102690 0x7fa640103760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:00.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.805+0000 7fa63ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa640102690 0x7fa640103760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42100/0 (socket says 172.21.15.92:42100) 2024-09-19T08:56:00.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.805+0000 7fa63ffff640 1 -- 172.21.15.92:0/1083629676 learned_addr learned my addr 172.21.15.92:0/1083629676 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:00.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.805+0000 7fa63effd640 1 --2- 172.21.15.92:0/1083629676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa640101cd0 0x7fa640103220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:00.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.805+0000 7fa63f7fe640 1 --2- 172.21.15.92:0/1083629676 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa640100ad0 0x7fa640104bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:00.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.805+0000 7fa63ffff640 1 -- 172.21.15.92:0/1083629676 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa640100ad0 msgr2=0x7fa640104bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:00.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.805+0000 7fa63ffff640 1 --2- 172.21.15.92:0/1083629676 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa640100ad0 0x7fa640104bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.805+0000 7fa63ffff640 1 -- 172.21.15.92:0/1083629676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa640101cd0 msgr2=0x7fa640103220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:00.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.805+0000 7fa63ffff640 1 --2- 172.21.15.92:0/1083629676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa640101cd0 0x7fa640103220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.805+0000 7fa63ffff640 1 -- 172.21.15.92:0/1083629676 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa640104020 con 0x7fa640102690 2024-09-19T08:56:00.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.806+0000 7fa63ffff640 1 --2- 172.21.15.92:0/1083629676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa640102690 0x7fa640103760 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa638005e30 tx=0x7fa638031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:00.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.806+0000 7fa63cff9640 1 -- 172.21.15.92:0/1083629676 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa638003c30 con 0x7fa640102690 2024-09-19T08:56:00.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.806+0000 7fa645da9640 1 -- 172.21.15.92:0/1083629676 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6401a1fd0 con 0x7fa640102690 2024-09-19T08:56:00.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.806+0000 7fa63cff9640 1 -- 172.21.15.92:0/1083629676 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa638003dd0 con 0x7fa640102690 2024-09-19T08:56:00.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.806+0000 7fa63cff9640 1 -- 172.21.15.92:0/1083629676 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa63802fde0 con 0x7fa640102690 2024-09-19T08:56:00.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.806+0000 7fa645da9640 1 -- 172.21.15.92:0/1083629676 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6401a24d0 con 0x7fa640102690 2024-09-19T08:56:00.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.807+0000 7fa645da9640 1 -- 172.21.15.92:0/1083629676 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6401a2700 con 0x7fa640102690 2024-09-19T08:56:00.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.808+0000 7fa63cff9640 1 -- 172.21.15.92:0/1083629676 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa638004050 con 0x7fa640102690 2024-09-19T08:56:00.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.809+0000 7fa63cff9640 1 --2- 172.21.15.92:0/1083629676 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa6280a32c0 0x7fa6280a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:00.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.809+0000 7fa63f7fe640 1 --2- 172.21.15.92:0/1083629676 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa6280a32c0 0x7fa6280a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:00.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.809+0000 7fa63cff9640 1 -- 172.21.15.92:0/1083629676 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa6380f0bb0 con 0x7fa640102690 2024-09-19T08:56:00.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.809+0000 7fa63f7fe640 1 --2- 172.21.15.92:0/1083629676 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa6280a32c0 0x7fa6280a5780 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa630005fd0 tx=0x7fa63000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:00.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.813+0000 7fa63cff9640 1 -- 172.21.15.92:0/1083629676 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa6380bd8d0 con 0x7fa640102690 2024-09-19T08:56:00.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:00 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/1632125911' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T08:56:00.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.987+0000 7fa645da9640 1 -- 172.21.15.92:0/1083629676 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fa6401a2a90 con 0x7fa640102690 2024-09-19T08:56:00.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.988+0000 7fa63cff9640 1 -- 172.21.15.92:0/1083629676 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v82) ==== 56+0+5312 (secure 0 0 0) 0x7fa6380bd1d0 con 0x7fa640102690 2024-09-19T08:56:00.990 INFO:teuthology.orchestra.run.smithi092.stdout:epoch 82 2024-09-19T08:56:00.990 INFO:teuthology.orchestra.run.smithi092.stdout:fsid 91ff74f2-7663-11ef-bceb-c7b262605968 2024-09-19T08:56:00.990 INFO:teuthology.orchestra.run.smithi092.stdout:created 2024-09-19T08:47:08.162150+0000 2024-09-19T08:56:00.990 INFO:teuthology.orchestra.run.smithi092.stdout:modified 2024-09-19T08:54:53.324204+0000 2024-09-19T08:56:00.990 INFO:teuthology.orchestra.run.smithi092.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-19T08:56:00.990 INFO:teuthology.orchestra.run.smithi092.stdout:crush_version 26 2024-09-19T08:56:00.990 INFO:teuthology.orchestra.run.smithi092.stdout:full_ratio 0.95 2024-09-19T08:56:00.990 INFO:teuthology.orchestra.run.smithi092.stdout:backfillfull_ratio 0.9 2024-09-19T08:56:00.990 INFO:teuthology.orchestra.run.smithi092.stdout:nearfull_ratio 0.85 2024-09-19T08:56:00.990 INFO:teuthology.orchestra.run.smithi092.stdout:require_min_compat_client luminous 2024-09-19T08:56:00.990 INFO:teuthology.orchestra.run.smithi092.stdout:min_compat_client luminous 2024-09-19T08:56:00.991 INFO:teuthology.orchestra.run.smithi092.stdout:require_osd_release squid 2024-09-19T08:56:00.991 INFO:teuthology.orchestra.run.smithi092.stdout:stretch_mode_enabled false 2024-09-19T08:56:00.991 INFO:teuthology.orchestra.run.smithi092.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-19T08:56:00.991 INFO:teuthology.orchestra.run.smithi092.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-19T08:56:00.991 INFO:teuthology.orchestra.run.smithi092.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-19T08:56:00.991 INFO:teuthology.orchestra.run.smithi092.stdout:max_osd 12 2024-09-19T08:56:00.991 INFO:teuthology.orchestra.run.smithi092.stdout:osd.0 up in weight 1 up_from 8 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.92:6802/4232030626,v1:172.21.15.92:6803/4232030626] [v2:172.21.15.92:6804/4232030626,v1:172.21.15.92:6805/4232030626] exists,up fd104fe2-b828-4c98-a499-b212717f2997 2024-09-19T08:56:00.991 INFO:teuthology.orchestra.run.smithi092.stdout:osd.1 up in weight 1 up_from 13 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.167:6800/4163493234,v1:172.21.15.167:6801/4163493234] [v2:172.21.15.167:6802/4163493234,v1:172.21.15.167:6803/4163493234] exists,up 0f725330-5e61-413c-b3c8-41bc2c0d8e6b 2024-09-19T08:56:00.991 INFO:teuthology.orchestra.run.smithi092.stdout:osd.2 up in weight 1 up_from 18 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.190:6800/702507556,v1:172.21.15.190:6801/702507556] [v2:172.21.15.190:6802/702507556,v1:172.21.15.190:6803/702507556] exists,up 286d2943-23a0-4184-93cf-9d3430781f99 2024-09-19T08:56:00.991 INFO:teuthology.orchestra.run.smithi092.stdout:osd.3 up in weight 1 up_from 24 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.92:6810/945752895,v1:172.21.15.92:6811/945752895] [v2:172.21.15.92:6812/945752895,v1:172.21.15.92:6813/945752895] exists,up 9d126671-7fc1-4f29-9bc3-3598052fd20a 2024-09-19T08:56:00.991 INFO:teuthology.orchestra.run.smithi092.stdout:osd.4 up in weight 1 up_from 31 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.167:6808/3576893400,v1:172.21.15.167:6809/3576893400] [v2:172.21.15.167:6810/3576893400,v1:172.21.15.167:6811/3576893400] exists,up cb10b38d-ae13-4b92-b906-3505fb873b2d 2024-09-19T08:56:00.991 INFO:teuthology.orchestra.run.smithi092.stdout:osd.5 up in weight 1 up_from 36 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.190:6808/1880491675,v1:172.21.15.190:6809/1880491675] [v2:172.21.15.190:6810/1880491675,v1:172.21.15.190:6811/1880491675] exists,up cd90668b-eca5-4bb4-870e-e58578730c89 2024-09-19T08:56:00.992 INFO:teuthology.orchestra.run.smithi092.stdout:osd.6 up in weight 1 up_from 43 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.92:6818/1743435653,v1:172.21.15.92:6819/1743435653] [v2:172.21.15.92:6820/1743435653,v1:172.21.15.92:6821/1743435653] exists,up 4e047963-afa7-4934-b887-8086165fb831 2024-09-19T08:56:00.992 INFO:teuthology.orchestra.run.smithi092.stdout:osd.7 up in weight 1 up_from 47 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.167:6816/2984111963,v1:172.21.15.167:6817/2984111963] [v2:172.21.15.167:6818/2984111963,v1:172.21.15.167:6819/2984111963] exists,up 652a6aa1-bb94-4608-952e-67cd02bdff66 2024-09-19T08:56:00.992 INFO:teuthology.orchestra.run.smithi092.stdout:osd.8 up in weight 1 up_from 54 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.190:6816/4190304434,v1:172.21.15.190:6817/4190304434] [v2:172.21.15.190:6818/4190304434,v1:172.21.15.190:6819/4190304434] exists,up 1510ef1f-fdfe-4887-a771-146efce062fe 2024-09-19T08:56:00.992 INFO:teuthology.orchestra.run.smithi092.stdout:osd.9 up in weight 1 up_from 61 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.92:6826/3066744542,v1:172.21.15.92:6827/3066744542] [v2:172.21.15.92:6828/3066744542,v1:172.21.15.92:6829/3066744542] exists,up 9b774bbe-6700-4020-900b-3fdbaa546773 2024-09-19T08:56:00.992 INFO:teuthology.orchestra.run.smithi092.stdout:osd.10 up in weight 1 up_from 66 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.167:6824/2309134313,v1:172.21.15.167:6825/2309134313] [v2:172.21.15.167:6826/2309134313,v1:172.21.15.167:6827/2309134313] exists,up 8abdb835-db2c-4597-ae1d-8ef56e63ab6a 2024-09-19T08:56:00.992 INFO:teuthology.orchestra.run.smithi092.stdout:osd.11 up in weight 1 up_from 74 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.190:6824/1849208751,v1:172.21.15.190:6825/1849208751] [v2:172.21.15.190:6826/1849208751,v1:172.21.15.190:6827/1849208751] exists,up 564c844a-378f-40cd-9717-cde35a65631c 2024-09-19T08:56:00.992 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 2.b [8,11] 2024-09-19T08:56:00.992 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 2.c [2,1] 2024-09-19T08:56:00.992 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 2.e [2,4] 2024-09-19T08:56:00.992 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 2.1c [8,11] 2024-09-19T08:56:00.992 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 3.6 [4,7] 2024-09-19T08:56:00.992 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 3.1e [3,9] 2024-09-19T08:56:00.992 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 3.20 [5,9] 2024-09-19T08:56:00.993 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 3.21 [4,8] 2024-09-19T08:56:00.993 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 3.34 [4,9] 2024-09-19T08:56:00.993 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:0/2948821221 expires 2024-09-20T08:47:52.180093+0000 2024-09-19T08:56:00.993 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:0/1441365956 expires 2024-09-20T08:47:52.180093+0000 2024-09-19T08:56:00.993 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:6801/2908709470 expires 2024-09-20T08:47:52.180093+0000 2024-09-19T08:56:00.993 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:0/608374871 expires 2024-09-20T08:47:52.180093+0000 2024-09-19T08:56:00.993 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:6801/1369295034 expires 2024-09-20T08:47:29.812397+0000 2024-09-19T08:56:00.993 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:6800/2908709470 expires 2024-09-20T08:47:52.180093+0000 2024-09-19T08:56:00.993 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:6800/1369295034 expires 2024-09-20T08:47:29.812397+0000 2024-09-19T08:56:00.993 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:0/813486656 expires 2024-09-20T08:47:29.812397+0000 2024-09-19T08:56:00.993 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:0/1963725565 expires 2024-09-20T08:47:29.812397+0000 2024-09-19T08:56:00.993 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:0/1668504617 expires 2024-09-20T08:47:29.812397+0000 2024-09-19T08:56:00.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.991+0000 7fa645da9640 1 -- 172.21.15.92:0/1083629676 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa6280a32c0 msgr2=0x7fa6280a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:00.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.991+0000 7fa645da9640 1 --2- 172.21.15.92:0/1083629676 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa6280a32c0 0x7fa6280a5780 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa630005fd0 tx=0x7fa63000b390 comp rx=0 tx=0).stop 2024-09-19T08:56:00.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.991+0000 7fa645da9640 1 -- 172.21.15.92:0/1083629676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa640102690 msgr2=0x7fa640103760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:00.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.991+0000 7fa645da9640 1 --2- 172.21.15.92:0/1083629676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa640102690 0x7fa640103760 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa638005e30 tx=0x7fa638031ee0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.991+0000 7fa645da9640 1 -- 172.21.15.92:0/1083629676 shutdown_connections 2024-09-19T08:56:00.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.991+0000 7fa645da9640 1 --2- 172.21.15.92:0/1083629676 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa6280a32c0 0x7fa6280a5780 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.991+0000 7fa645da9640 1 --2- 172.21.15.92:0/1083629676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa640102690 0x7fa640103760 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.991+0000 7fa645da9640 1 --2- 172.21.15.92:0/1083629676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa640101cd0 0x7fa640103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.991+0000 7fa645da9640 1 --2- 172.21.15.92:0/1083629676 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa640100ad0 0x7fa640104bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.991+0000 7fa645da9640 1 -- 172.21.15.92:0/1083629676 >> 172.21.15.92:0/1083629676 conn(0x7fa6400fc280 msgr2=0x7fa640069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:00.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.991+0000 7fa645da9640 1 -- 172.21.15.92:0/1083629676 shutdown_connections 2024-09-19T08:56:00.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:00.991+0000 7fa645da9640 1 -- 172.21.15.92:0/1083629676 wait complete. 2024-09-19T08:56:01.549 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:01 smithi092 ceph-mon[31407]: pgmap v316: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:56:01.549 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:01 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1083629676' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T08:56:01.575 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-19T08:56:01.589 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:56:01.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:01 smithi190 ceph-mon[35358]: pgmap v316: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:56:01.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:01 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/1083629676' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T08:56:01.752 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:01 smithi167 ceph-mon[35359]: pgmap v316: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:56:01.752 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:01 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/1083629676' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T08:56:01.837 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:02.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.299+0000 7f40ddd69640 1 -- 172.21.15.92:0/1062670174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40d8103660 msgr2=0x7f40d810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:02.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.299+0000 7f40ddd69640 1 --2- 172.21.15.92:0/1062670174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40d8103660 0x7f40d810bb50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f40c8009900 tx=0x7f40c802a480 comp rx=0 tx=0).stop 2024-09-19T08:56:02.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.299+0000 7f40ddd69640 1 -- 172.21.15.92:0/1062670174 shutdown_connections 2024-09-19T08:56:02.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.299+0000 7f40ddd69640 1 --2- 172.21.15.92:0/1062670174 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40d810c170 0x7f40d810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.299+0000 7f40ddd69640 1 --2- 172.21.15.92:0/1062670174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40d8103660 0x7f40d810bb50 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.299+0000 7f40ddd69640 1 --2- 172.21.15.92:0/1062670174 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40d8102d40 0x7f40d8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.299+0000 7f40ddd69640 1 -- 172.21.15.92:0/1062670174 >> 172.21.15.92:0/1062670174 conn(0x7f40d80fc7a0 msgr2=0x7f40d80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:02.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.299+0000 7f40ddd69640 1 -- 172.21.15.92:0/1062670174 shutdown_connections 2024-09-19T08:56:02.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.299+0000 7f40ddd69640 1 -- 172.21.15.92:0/1062670174 wait complete. 2024-09-19T08:56:02.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.300+0000 7f40ddd69640 1 Processor -- start 2024-09-19T08:56:02.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.300+0000 7f40ddd69640 1 -- start start 2024-09-19T08:56:02.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.301+0000 7f40ddd69640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40d8102d40 0x7f40d81009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:02.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.301+0000 7f40ddd69640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40d8103660 0x7f40d8100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:02.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.301+0000 7f40ddd69640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40d810c170 0x7f40d8101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:02.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.301+0000 7f40ddd69640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f40d8112030 con 0x7f40d8102d40 2024-09-19T08:56:02.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.301+0000 7f40ddd69640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f40d8111eb0 con 0x7f40d810c170 2024-09-19T08:56:02.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.301+0000 7f40ddd69640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f40d81121b0 con 0x7f40d8103660 2024-09-19T08:56:02.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.301+0000 7f40d77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40d8102d40 0x7f40d81009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:02.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.301+0000 7f40d77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40d8102d40 0x7f40d81009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49776/0 (socket says 172.21.15.92:49776) 2024-09-19T08:56:02.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.301+0000 7f40d77fe640 1 -- 172.21.15.92:0/3556810169 learned_addr learned my addr 172.21.15.92:0/3556810169 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:02.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.301+0000 7f40d6ffd640 1 --2- 172.21.15.92:0/3556810169 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40d8103660 0x7f40d8100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:02.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.301+0000 7f40d77fe640 1 -- 172.21.15.92:0/3556810169 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40d8103660 msgr2=0x7f40d8100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:02.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.301+0000 7f40d77fe640 1 --2- 172.21.15.92:0/3556810169 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40d8103660 0x7f40d8100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.301+0000 7f40d77fe640 1 -- 172.21.15.92:0/3556810169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40d810c170 msgr2=0x7f40d8101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:02.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.301+0000 7f40d77fe640 1 --2- 172.21.15.92:0/3556810169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40d810c170 0x7f40d8101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.301+0000 7f40d77fe640 1 -- 172.21.15.92:0/3556810169 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40d81a6a40 con 0x7f40d8102d40 2024-09-19T08:56:02.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.301+0000 7f40d6ffd640 1 --2- 172.21.15.92:0/3556810169 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40d8103660 0x7f40d8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:02.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.301+0000 7f40d77fe640 1 --2- 172.21.15.92:0/3556810169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40d8102d40 0x7f40d81009a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f40c000ba50 tx=0x7f40c000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:02.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.301+0000 7f40d4ff9640 1 -- 172.21.15.92:0/3556810169 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c0019070 con 0x7f40d8102d40 2024-09-19T08:56:02.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.301+0000 7f40d4ff9640 1 -- 172.21.15.92:0/3556810169 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40c000cbe0 con 0x7f40d8102d40 2024-09-19T08:56:02.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.301+0000 7f40ddd69640 1 -- 172.21.15.92:0/3556810169 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40d81a6d30 con 0x7f40d8102d40 2024-09-19T08:56:02.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.301+0000 7f40d4ff9640 1 -- 172.21.15.92:0/3556810169 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c00076e0 con 0x7f40d8102d40 2024-09-19T08:56:02.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.301+0000 7f40ddd69640 1 -- 172.21.15.92:0/3556810169 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40d81a7210 con 0x7f40d8102d40 2024-09-19T08:56:02.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.302+0000 7f40ddd69640 1 -- 172.21.15.92:0/3556810169 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40d81031a0 con 0x7f40d8102d40 2024-09-19T08:56:02.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.303+0000 7f40d4ff9640 1 -- 172.21.15.92:0/3556810169 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f40c001c070 con 0x7f40d8102d40 2024-09-19T08:56:02.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.304+0000 7f40d4ff9640 1 --2- 172.21.15.92:0/3556810169 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f40c40a3240 0x7f40c40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:02.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.304+0000 7f40d6ffd640 1 --2- 172.21.15.92:0/3556810169 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f40c40a3240 0x7f40c40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:02.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.304+0000 7f40d4ff9640 1 -- 172.21.15.92:0/3556810169 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f40c00cef70 con 0x7f40d8102d40 2024-09-19T08:56:02.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.305+0000 7f40d6ffd640 1 --2- 172.21.15.92:0/3556810169 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f40c40a3240 0x7f40c40a5700 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f40d8102430 tx=0x7f40c8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:02.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.308+0000 7f40d4ff9640 1 -- 172.21.15.92:0/3556810169 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f40c009bc90 con 0x7f40d8102d40 2024-09-19T08:56:02.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.511+0000 7f40ddd69640 1 -- 172.21.15.92:0/3556810169 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f40d802d7c0 con 0x7f40d8102d40 2024-09-19T08:56:02.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.511+0000 7f40d4ff9640 1 -- 172.21.15.92:0/3556810169 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f40c009b590 con 0x7f40d8102d40 2024-09-19T08:56:02.511 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:02.511 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T08:56:02.512 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T08:56:02.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.513+0000 7f40ddd69640 1 -- 172.21.15.92:0/3556810169 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f40c40a3240 msgr2=0x7f40c40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:02.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.513+0000 7f40ddd69640 1 --2- 172.21.15.92:0/3556810169 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f40c40a3240 0x7f40c40a5700 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f40d8102430 tx=0x7f40c8005a20 comp rx=0 tx=0).stop 2024-09-19T08:56:02.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.513+0000 7f40ddd69640 1 -- 172.21.15.92:0/3556810169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40d8102d40 msgr2=0x7f40d81009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:02.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.513+0000 7f40ddd69640 1 --2- 172.21.15.92:0/3556810169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40d8102d40 0x7f40d81009a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f40c000ba50 tx=0x7f40c000bf10 comp rx=0 tx=0).stop 2024-09-19T08:56:02.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.513+0000 7f40ddd69640 1 -- 172.21.15.92:0/3556810169 shutdown_connections 2024-09-19T08:56:02.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.513+0000 7f40ddd69640 1 --2- 172.21.15.92:0/3556810169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40d810c170 0x7f40d8101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.513+0000 7f40ddd69640 1 --2- 172.21.15.92:0/3556810169 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40d8103660 0x7f40d8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.513+0000 7f40ddd69640 1 --2- 172.21.15.92:0/3556810169 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f40c40a3240 0x7f40c40a5700 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.513+0000 7f40ddd69640 1 --2- 172.21.15.92:0/3556810169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40d8102d40 0x7f40d81009a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.513+0000 7f40ddd69640 1 -- 172.21.15.92:0/3556810169 >> 172.21.15.92:0/3556810169 conn(0x7f40d80fc7a0 msgr2=0x7f40d80fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:02.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.513+0000 7f40ddd69640 1 -- 172.21.15.92:0/3556810169 shutdown_connections 2024-09-19T08:56:02.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:02.513+0000 7f40ddd69640 1 -- 172.21.15.92:0/3556810169 wait complete. 2024-09-19T08:56:03.118 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:56:03.374 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:03.618 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:03 smithi092 ceph-mon[31407]: pgmap v317: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:56:03.618 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:03 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3556810169' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:56:03.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:03 smithi190 ceph-mon[35358]: pgmap v317: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:56:03.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:03 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3556810169' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:56:03.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:03 smithi167 ceph-mon[35359]: pgmap v317: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:56:03.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:03 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3556810169' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:56:03.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.855+0000 7f76e2534640 1 -- 172.21.15.92:0/1426406767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76dc101de0 msgr2=0x7f76dc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:03.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.855+0000 7f76e2534640 1 --2- 172.21.15.92:0/1426406767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76dc101de0 0x7f76dc1021c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f76cc009900 tx=0x7f76cc02a410 comp rx=0 tx=0).stop 2024-09-19T08:56:03.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.855+0000 7f76e2534640 1 -- 172.21.15.92:0/1426406767 shutdown_connections 2024-09-19T08:56:03.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.855+0000 7f76e2534640 1 --2- 172.21.15.92:0/1426406767 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76dc106f10 0x7f76dc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:03.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.855+0000 7f76e2534640 1 --2- 172.21.15.92:0/1426406767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76dc102790 0x7f76dc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:03.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.855+0000 7f76e2534640 1 --2- 172.21.15.92:0/1426406767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76dc101de0 0x7f76dc1021c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:03.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.855+0000 7f76e2534640 1 -- 172.21.15.92:0/1426406767 >> 172.21.15.92:0/1426406767 conn(0x7f76dc0fd8c0 msgr2=0x7f76dc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:03.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.855+0000 7f76e2534640 1 -- 172.21.15.92:0/1426406767 shutdown_connections 2024-09-19T08:56:03.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.855+0000 7f76e2534640 1 -- 172.21.15.92:0/1426406767 wait complete. 2024-09-19T08:56:03.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.855+0000 7f76e2534640 1 Processor -- start 2024-09-19T08:56:03.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.855+0000 7f76e2534640 1 -- start start 2024-09-19T08:56:03.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.856+0000 7f76e2534640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76dc101de0 0x7f76dc198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:03.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.856+0000 7f76e2534640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76dc102790 0x7f76dc1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:03.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.856+0000 7f76e2534640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76dc106f10 0x7f76dc19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:03.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.856+0000 7f76e2534640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f76dc111f90 con 0x7f76dc106f10 2024-09-19T08:56:03.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.856+0000 7f76e2534640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f76dc111e10 con 0x7f76dc101de0 2024-09-19T08:56:03.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.856+0000 7f76e2534640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f76dc112110 con 0x7f76dc102790 2024-09-19T08:56:03.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.856+0000 7f76e0ad1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76dc106f10 0x7f76dc19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:03.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.856+0000 7f76e0ad1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76dc106f10 0x7f76dc19cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49786/0 (socket says 172.21.15.92:49786) 2024-09-19T08:56:03.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.856+0000 7f76e0ad1640 1 -- 172.21.15.92:0/438424827 learned_addr learned my addr 172.21.15.92:0/438424827 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:03.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.856+0000 7f76db7fe640 1 --2- 172.21.15.92:0/438424827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76dc102790 0x7f76dc1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:03.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.856+0000 7f76dbfff640 1 --2- 172.21.15.92:0/438424827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76dc101de0 0x7f76dc198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:03.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.856+0000 7f76e0ad1640 1 -- 172.21.15.92:0/438424827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76dc102790 msgr2=0x7f76dc1989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:03.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.856+0000 7f76e0ad1640 1 --2- 172.21.15.92:0/438424827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76dc102790 0x7f76dc1989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:03.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.856+0000 7f76e0ad1640 1 -- 172.21.15.92:0/438424827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76dc101de0 msgr2=0x7f76dc198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:03.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.856+0000 7f76e0ad1640 1 --2- 172.21.15.92:0/438424827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76dc101de0 0x7f76dc198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:03.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.856+0000 7f76e0ad1640 1 -- 172.21.15.92:0/438424827 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76dc19d440 con 0x7f76dc106f10 2024-09-19T08:56:03.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.856+0000 7f76dbfff640 1 --2- 172.21.15.92:0/438424827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76dc101de0 0x7f76dc198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:56:03.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.856+0000 7f76e0ad1640 1 --2- 172.21.15.92:0/438424827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76dc106f10 0x7f76dc19cd60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f76d400b970 tx=0x7f76d400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:03.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.857+0000 7f76d97fa640 1 -- 172.21.15.92:0/438424827 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d4019070 con 0x7f76dc106f10 2024-09-19T08:56:03.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.857+0000 7f76d97fa640 1 -- 172.21.15.92:0/438424827 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76d400cb40 con 0x7f76dc106f10 2024-09-19T08:56:03.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.857+0000 7f76e2534640 1 -- 172.21.15.92:0/438424827 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76dc19d730 con 0x7f76dc106f10 2024-09-19T08:56:03.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.857+0000 7f76d97fa640 1 -- 172.21.15.92:0/438424827 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d4007650 con 0x7f76dc106f10 2024-09-19T08:56:03.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.857+0000 7f76e2534640 1 -- 172.21.15.92:0/438424827 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76dc1a5010 con 0x7f76dc106f10 2024-09-19T08:56:03.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.858+0000 7f76e2534640 1 -- 172.21.15.92:0/438424827 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76dc1021c0 con 0x7f76dc106f10 2024-09-19T08:56:03.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.859+0000 7f76d97fa640 1 -- 172.21.15.92:0/438424827 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f76d401c070 con 0x7f76dc106f10 2024-09-19T08:56:03.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.859+0000 7f76d97fa640 1 --2- 172.21.15.92:0/438424827 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f76c80a3240 0x7f76c80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:03.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.860+0000 7f76dbfff640 1 --2- 172.21.15.92:0/438424827 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f76c80a3240 0x7f76c80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:03.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.860+0000 7f76d97fa640 1 -- 172.21.15.92:0/438424827 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f76d40cee70 con 0x7f76dc106f10 2024-09-19T08:56:03.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.860+0000 7f76dbfff640 1 --2- 172.21.15.92:0/438424827 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f76c80a3240 0x7f76c80a5700 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f76cc000c00 tx=0x7f76cc032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:03.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:03.864+0000 7f76d97fa640 1 -- 172.21.15.92:0/438424827 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f76d409b540 con 0x7f76dc106f10 2024-09-19T08:56:04.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:04.065+0000 7f76e2534640 1 -- 172.21.15.92:0/438424827 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f76dc02d7c0 con 0x7f76dc106f10 2024-09-19T08:56:04.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:04.066+0000 7f76d97fa640 1 -- 172.21.15.92:0/438424827 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f76d409f840 con 0x7f76dc106f10 2024-09-19T08:56:04.066 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:04.066 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T08:56:04.066 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T08:56:04.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:04.068+0000 7f76e2534640 1 -- 172.21.15.92:0/438424827 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f76c80a3240 msgr2=0x7f76c80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:04.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:04.068+0000 7f76e2534640 1 --2- 172.21.15.92:0/438424827 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f76c80a3240 0x7f76c80a5700 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f76cc000c00 tx=0x7f76cc032c70 comp rx=0 tx=0).stop 2024-09-19T08:56:04.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:04.068+0000 7f76e2534640 1 -- 172.21.15.92:0/438424827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76dc106f10 msgr2=0x7f76dc19cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:04.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:04.068+0000 7f76e2534640 1 --2- 172.21.15.92:0/438424827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76dc106f10 0x7f76dc19cd60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f76d400b970 tx=0x7f76d400be30 comp rx=0 tx=0).stop 2024-09-19T08:56:04.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:04.068+0000 7f76e2534640 1 -- 172.21.15.92:0/438424827 shutdown_connections 2024-09-19T08:56:04.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:04.068+0000 7f76e2534640 1 --2- 172.21.15.92:0/438424827 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f76c80a3240 0x7f76c80a5700 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:04.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:04.068+0000 7f76e2534640 1 --2- 172.21.15.92:0/438424827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76dc106f10 0x7f76dc19cd60 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:04.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:04.068+0000 7f76e2534640 1 --2- 172.21.15.92:0/438424827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76dc102790 0x7f76dc1989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:04.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:04.068+0000 7f76e2534640 1 --2- 172.21.15.92:0/438424827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76dc101de0 0x7f76dc198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:04.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:04.068+0000 7f76e2534640 1 -- 172.21.15.92:0/438424827 >> 172.21.15.92:0/438424827 conn(0x7f76dc0fd8c0 msgr2=0x7f76dc0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:04.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:04.068+0000 7f76e2534640 1 -- 172.21.15.92:0/438424827 shutdown_connections 2024-09-19T08:56:04.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:04.068+0000 7f76e2534640 1 -- 172.21.15.92:0/438424827 wait complete. 2024-09-19T08:56:04.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:04 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/438424827' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:56:04.639 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:04 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/438424827' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:56:04.669 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:56:04.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:04 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/438424827' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:56:04.913 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:05.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.354+0000 7f00c036b640 1 -- 172.21.15.92:0/3127539648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00b8106f10 msgr2=0x7f00b810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:05.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.354+0000 7f00c036b640 1 --2- 172.21.15.92:0/3127539648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00b8106f10 0x7f00b810ea90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f00a8009ca0 tx=0x7f00a802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.354+0000 7f00c036b640 1 -- 172.21.15.92:0/3127539648 shutdown_connections 2024-09-19T08:56:05.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.354+0000 7f00c036b640 1 --2- 172.21.15.92:0/3127539648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00b8106f10 0x7f00b810ea90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.354+0000 7f00c036b640 1 --2- 172.21.15.92:0/3127539648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00b8102790 0x7f00b81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.354+0000 7f00c036b640 1 --2- 172.21.15.92:0/3127539648 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00b8101de0 0x7f00b81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.354+0000 7f00c036b640 1 -- 172.21.15.92:0/3127539648 >> 172.21.15.92:0/3127539648 conn(0x7f00b80fd8c0 msgr2=0x7f00b80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:05.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.354+0000 7f00c036b640 1 -- 172.21.15.92:0/3127539648 shutdown_connections 2024-09-19T08:56:05.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.354+0000 7f00c036b640 1 -- 172.21.15.92:0/3127539648 wait complete. 2024-09-19T08:56:05.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.355+0000 7f00c036b640 1 Processor -- start 2024-09-19T08:56:05.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.355+0000 7f00c036b640 1 -- start start 2024-09-19T08:56:05.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.355+0000 7f00c036b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00b8101de0 0x7f00b8198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:05.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.355+0000 7f00c036b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00b8102790 0x7f00b81989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:05.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.355+0000 7f00c036b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00b8106f10 0x7f00b819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:05.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.355+0000 7f00c036b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f00b8111fb0 con 0x7f00b8106f10 2024-09-19T08:56:05.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.355+0000 7f00c036b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f00b8111e30 con 0x7f00b8102790 2024-09-19T08:56:05.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.355+0000 7f00c036b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f00b8112130 con 0x7f00b8101de0 2024-09-19T08:56:05.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.355+0000 7f00be908640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00b8106f10 0x7f00b819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:05.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.355+0000 7f00be908640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00b8106f10 0x7f00b819cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49798/0 (socket says 172.21.15.92:49798) 2024-09-19T08:56:05.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.355+0000 7f00be908640 1 -- 172.21.15.92:0/2395611537 learned_addr learned my addr 172.21.15.92:0/2395611537 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:05.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.355+0000 7f00be107640 1 --2- 172.21.15.92:0/2395611537 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00b8101de0 0x7f00b8198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:05.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.356+0000 7f00bd906640 1 --2- 172.21.15.92:0/2395611537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00b8102790 0x7f00b81989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:05.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.356+0000 7f00be908640 1 -- 172.21.15.92:0/2395611537 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00b8101de0 msgr2=0x7f00b8198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:05.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.356+0000 7f00be908640 1 --2- 172.21.15.92:0/2395611537 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00b8101de0 0x7f00b8198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.356+0000 7f00be908640 1 -- 172.21.15.92:0/2395611537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00b8102790 msgr2=0x7f00b81989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:05.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.356+0000 7f00be908640 1 --2- 172.21.15.92:0/2395611537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00b8102790 0x7f00b81989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.356+0000 7f00be908640 1 -- 172.21.15.92:0/2395611537 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b819d440 con 0x7f00b8106f10 2024-09-19T08:56:05.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.356+0000 7f00bd906640 1 --2- 172.21.15.92:0/2395611537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00b8102790 0x7f00b81989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:56:05.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.356+0000 7f00be107640 1 --2- 172.21.15.92:0/2395611537 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00b8101de0 0x7f00b8198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:05.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.356+0000 7f00be908640 1 --2- 172.21.15.92:0/2395611537 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00b8106f10 0x7f00b819cd60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f00a8031a20 tx=0x7f00a8031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:05.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.356+0000 7f00b77fe640 1 -- 172.21.15.92:0/2395611537 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8003c30 con 0x7f00b8106f10 2024-09-19T08:56:05.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.356+0000 7f00c036b640 1 -- 172.21.15.92:0/2395611537 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00b819d6d0 con 0x7f00b8106f10 2024-09-19T08:56:05.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.356+0000 7f00b77fe640 1 -- 172.21.15.92:0/2395611537 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00a8003dd0 con 0x7f00b8106f10 2024-09-19T08:56:05.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.356+0000 7f00b77fe640 1 -- 172.21.15.92:0/2395611537 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a802fcf0 con 0x7f00b8106f10 2024-09-19T08:56:05.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.356+0000 7f00c036b640 1 -- 172.21.15.92:0/2395611537 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00b81a5010 con 0x7f00b8106f10 2024-09-19T08:56:05.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.357+0000 7f00c036b640 1 -- 172.21.15.92:0/2395611537 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00b81021c0 con 0x7f00b8106f10 2024-09-19T08:56:05.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.358+0000 7f00b77fe640 1 -- 172.21.15.92:0/2395611537 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f00a8004050 con 0x7f00b8106f10 2024-09-19T08:56:05.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.359+0000 7f00b77fe640 1 --2- 172.21.15.92:0/2395611537 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f00a00a3240 0x7f00a00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:05.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.359+0000 7f00be107640 1 --2- 172.21.15.92:0/2395611537 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f00a00a3240 0x7f00a00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:05.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.359+0000 7f00b77fe640 1 -- 172.21.15.92:0/2395611537 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f00a80f0ec0 con 0x7f00b8106f10 2024-09-19T08:56:05.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.359+0000 7f00be107640 1 --2- 172.21.15.92:0/2395611537 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f00a00a3240 0x7f00a00a5700 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f00b00058c0 tx=0x7f00b0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:05.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.362+0000 7f00b77fe640 1 -- 172.21.15.92:0/2395611537 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f00a80bdc70 con 0x7f00b8106f10 2024-09-19T08:56:05.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.531+0000 7f00c036b640 1 -- 172.21.15.92:0/2395611537 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f00b810a150 con 0x7f00b8106f10 2024-09-19T08:56:05.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.532+0000 7f00b77fe640 1 -- 172.21.15.92:0/2395611537 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22782 (secure 0 0 0) 0x7f00a802fe90 con 0x7f00b8106f10 2024-09-19T08:56:05.532 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:05.532 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":82,"fsid":"91ff74f2-7663-11ef-bceb-c7b262605968","created":"2024-09-19T08:47:08.162150+0000","modified":"2024-09-19T08:54:53.324204+0000","last_up_change":"2024-09-19T08:53:43.021949+0000","last_in_change":"2024-09-19T08:53:19.246805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:50:04.482034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:54:28.005336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:54:30.188980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd104fe2-b828-4c98-a499-b212717f2997","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6803","nonce":4232030626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6805","nonce":4232030626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6809","nonce":4232030626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6807","nonce":4232030626}]},"public_addr":"172.21.15.92:6803/4232030626","cluster_addr":"172.21.15.92:6805/4232030626","heartbeat_back_addr":"172.21.15.92:6809/4232030626","heartbeat_front_addr":"172.21.15.92:6807/4232030626","state":["exists","up"]},{"osd":1,"uuid":"0f725330-5e61-413c-b3c8-41bc2c0d8e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6801","nonce":4163493234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6803","nonce":4163493234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6807","nonce":4163493234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6805","nonce":4163493234}]},"public_addr":"172.21.15.167:6801/4163493234","cluster_addr":"172.21.15.167:6803/4163493234","heartbeat_back_addr":"172.21.15.167:6807/4163493234","heartbeat_front_addr":"172.21.15.167:6805/4163493234","state":["exists","up"]},{"osd":2,"uuid":"286d2943-23a0-4184-93cf-9d3430781f99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6801","nonce":702507556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6803","nonce":702507556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6807","nonce":702507556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6805","nonce":702507556}]},"public_addr":"172.21.15.190:6801/702507556","cluster_addr":"172.21.15.190:6803/702507556","heartbeat_back_addr":"172.21.15.190:6807/702507556","heartbeat_front_addr":"172.21.15.190:6805/702507556","state":["exists","up"]},{"osd":3,"uuid":"9d126671-7fc1-4f29-9bc3-3598052fd20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6811","nonce":945752895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6813","nonce":945752895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6817","nonce":945752895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6815","nonce":945752895}]},"public_addr":"172.21.15.92:6811/945752895","cluster_addr":"172.21.15.92:6813/945752895","heartbeat_back_addr":"172.21.15.92:6817/945752895","heartbeat_front_addr":"172.21.15.92:6815/945752895","state":["exists","up"]},{"osd":4,"uuid":"cb10b38d-ae13-4b92-b906-3505fb873b2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6809","nonce":3576893400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6811","nonce":3576893400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6815","nonce":3576893400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6813","nonce":3576893400}]},"public_addr":"172.21.15.167:6809/3576893400","cluster_addr":"172.21.15.167:6811/3576893400","heartbeat_back_addr":"172.21.15.167:6815/3576893400","heartbeat_front_addr":"172.21.15.167:6813/3576893400","state":["exists","up"]},{"osd":5,"uuid":"cd90668b-eca5-4bb4-870e-e58578730c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6809","nonce":1880491675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6811","nonce":1880491675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6815","nonce":1880491675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6813","nonce":1880491675}]},"public_addr":"172.21.15.190:6809/1880491675","cluster_addr":"172.21.15.190:6811/1880491675","heartbeat_back_addr":"172.21.15.190:6815/1880491675","heartbeat_front_addr":"172.21.15.190:6813/1880491675","state":["exists","up"]},{"osd":6,"uuid":"4e047963-afa7-4934-b887-8086165fb831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6819","nonce":1743435653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6821","nonce":1743435653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6825","nonce":1743435653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6823","nonce":1743435653}]},"public_addr":"172.21.15.92:6819/1743435653","cluster_addr":"172.21.15.92:6821/1743435653","heartbeat_back_addr":"172.21.15.92:6825/1743435653","heartbeat_front_addr":"172.21.15.92:6823/1743435653","state":["exists","up"]},{"osd":7,"uuid":"652a6aa1-bb94-4608-952e-67cd02bdff66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6817","nonce":2984111963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6819","nonce":2984111963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6823","nonce":2984111963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6821","nonce":2984111963}]},"public_addr":"172.21.15.167:6817/2984111963","cluster_addr":"172.21.15.167:6819/2984111963","heartbeat_back_addr":"172.21.15.167:6823/2984111963","heartbeat_front_addr":"172.21.15.167:6821/2984111963","state":["exists","up"]},{"osd":8,"uuid":"1510ef1f-fdfe-4887-a771-146efce062fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6817","nonce":4190304434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6819","nonce":4190304434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6823","nonce":4190304434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6821","nonce":4190304434}]},"public_addr":"172.21.15.190:6817/4190304434","cluster_addr":"172.21.15.190:6819/4190304434","heartbeat_back_addr":"172.21.15.190:6823/4190304434","heartbeat_front_addr":"172.21.15.190:6821/4190304434","state":["exists","up"]},{"osd":9,"uuid":"9b774bbe-6700-4020-900b-3fdbaa546773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6827","nonce":3066744542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6829","nonce":3066744542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6833","nonce":3066744542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6831","nonce":3066744542}]},"public_addr":"172.21.15.92:6827/3066744542","cluster_addr":"172.21.15.92:6829/3066744542","heartbeat_back_addr":"172.21.15.92:6833/3066744542","heartbeat_front_addr":"172.21.15.92:6831/3066744542","state":["exists","up"]},{"osd":10,"uuid":"8abdb835-db2c-4597-ae1d-8ef56e63ab6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6825","nonce":2309134313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6827","nonce":2309134313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6831","nonce":2309134313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6829","nonce":2309134313}]},"public_addr":"172.21.15.167:6825/2309134313","cluster_addr":"172.21.15.167:6827/2309134313","heartbeat_back_addr":"172.21.15.167:6831/2309134313","heartbeat_front_addr":"172.21.15.167:6829/2309134313","state":["exists","up"]},{"osd":11,"uuid":"564c844a-378f-40cd-9717-cde35a65631c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6825","nonce":1849208751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6827","nonce":1849208751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6831","nonce":1849208751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6829","nonce":1849208751}]},"public_addr":"172.21.15.190:6825/1849208751","cluster_addr":"172.21.15.190:6827/1849208751","heartbeat_back_addr":"172.21.15.190:6831/1849208751","heartbeat_front_addr":"172.21.15.190:6829/1849208751","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:12.072109+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:36.689174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:01.908763+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:26.857439+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:50.881629+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:51:15.160744+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:51:39.101605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:03.179877+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:27.324563+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:51.971287+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:53:15.917311+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:53:40.592486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/2948821221":"2024-09-20T08:47:52.180093+0000","172.21.15.92:0/1441365956":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6801/2908709470":"2024-09-20T08:47:52.180093+0000","172.21.15.92:0/608374871":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6801/1369295034":"2024-09-20T08:47:29.812397+0000","172.21.15.92:6800/2908709470":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6800/1369295034":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/813486656":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/1963725565":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/1668504617":"2024-09-20T08:47:29.812397+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:56:05.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.534+0000 7f00c036b640 1 -- 172.21.15.92:0/2395611537 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f00a00a3240 msgr2=0x7f00a00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:05.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.534+0000 7f00c036b640 1 --2- 172.21.15.92:0/2395611537 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f00a00a3240 0x7f00a00a5700 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f00b00058c0 tx=0x7f00b0005850 comp rx=0 tx=0).stop 2024-09-19T08:56:05.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.534+0000 7f00c036b640 1 -- 172.21.15.92:0/2395611537 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00b8106f10 msgr2=0x7f00b819cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:05.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.534+0000 7f00c036b640 1 --2- 172.21.15.92:0/2395611537 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00b8106f10 0x7f00b819cd60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f00a8031a20 tx=0x7f00a8031a50 comp rx=0 tx=0).stop 2024-09-19T08:56:05.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.534+0000 7f00c036b640 1 -- 172.21.15.92:0/2395611537 shutdown_connections 2024-09-19T08:56:05.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.534+0000 7f00c036b640 1 --2- 172.21.15.92:0/2395611537 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f00a00a3240 0x7f00a00a5700 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.534+0000 7f00c036b640 1 --2- 172.21.15.92:0/2395611537 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00b8106f10 0x7f00b819cd60 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.534+0000 7f00c036b640 1 --2- 172.21.15.92:0/2395611537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00b8102790 0x7f00b81989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.534+0000 7f00c036b640 1 --2- 172.21.15.92:0/2395611537 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00b8101de0 0x7f00b8198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.534+0000 7f00c036b640 1 -- 172.21.15.92:0/2395611537 >> 172.21.15.92:0/2395611537 conn(0x7f00b80fd8c0 msgr2=0x7f00b80fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:05.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.534+0000 7f00c036b640 1 -- 172.21.15.92:0/2395611537 shutdown_connections 2024-09-19T08:56:05.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:05.534+0000 7f00c036b640 1 -- 172.21.15.92:0/2395611537 wait complete. 2024-09-19T08:56:05.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:05 smithi190 ceph-mon[35358]: pgmap v318: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:56:05.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:05 smithi092 ceph-mon[31407]: pgmap v318: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:56:05.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:05 smithi167 ceph-mon[35359]: pgmap v318: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:56:06.107 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T08:54:31.939376+0000', 'modified': '2024-09-19T08:54:40.961053+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24472}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24466': {'gid': 24466, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.190:6837/3700975791', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6836', 'nonce': 3700975791}, {'type': 'v1', 'addr': '172.21.15.190:6837', 'nonce': 3700975791}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.190:6839/3861238400', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6838', 'nonce': 3861238400}, {'type': 'v1', 'addr': '172.21.15.190:6839', 'nonce': 3861238400}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24472, 'qdb_cluster': [24472]} 2024-09-19T08:56:06.107 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T08:56:06.107 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T08:56:06.351 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:06.708 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:06 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/2395611537' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:56:06.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.788+0000 7fab0b214640 1 -- 172.21.15.92:0/3092962428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab04102570 msgr2=0x7fab041029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:06.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.788+0000 7fab0b214640 1 --2- 172.21.15.92:0/3092962428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab04102570 0x7fab041029b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7faaf0009900 tx=0x7faaf002a480 comp rx=0 tx=0).stop 2024-09-19T08:56:06.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.788+0000 7fab0b214640 1 -- 172.21.15.92:0/3092962428 shutdown_connections 2024-09-19T08:56:06.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.788+0000 7fab0b214640 1 --2- 172.21.15.92:0/3092962428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab04102ef0 0x7fab0410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.788+0000 7fab0b214640 1 --2- 172.21.15.92:0/3092962428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab04102570 0x7fab041029b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.788+0000 7fab0b214640 1 --2- 172.21.15.92:0/3092962428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab04100e20 0x7fab04101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.788+0000 7fab0b214640 1 -- 172.21.15.92:0/3092962428 >> 172.21.15.92:0/3092962428 conn(0x7fab040fc7d0 msgr2=0x7fab040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:06.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.788+0000 7fab0b214640 1 -- 172.21.15.92:0/3092962428 shutdown_connections 2024-09-19T08:56:06.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.788+0000 7fab0b214640 1 -- 172.21.15.92:0/3092962428 wait complete. 2024-09-19T08:56:06.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.788+0000 7fab0b214640 1 Processor -- start 2024-09-19T08:56:06.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.788+0000 7fab0b214640 1 -- start start 2024-09-19T08:56:06.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.788+0000 7fab0b214640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab04100e20 0x7fab0410e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:06.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.788+0000 7fab0b214640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab04102570 0x7fab0410ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:06.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.789+0000 7fab0b214640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab04102ef0 0x7fab0410ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:06.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.789+0000 7fab0b214640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fab04112120 con 0x7fab04102570 2024-09-19T08:56:06.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.789+0000 7fab0b214640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fab04111fa0 con 0x7fab04100e20 2024-09-19T08:56:06.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.789+0000 7fab0b214640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fab041122a0 con 0x7fab04102ef0 2024-09-19T08:56:06.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.789+0000 7fab03fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab04102570 0x7fab0410ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:06.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.789+0000 7fab03fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab04102570 0x7fab0410ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49826/0 (socket says 172.21.15.92:49826) 2024-09-19T08:56:06.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.789+0000 7fab03fff640 1 -- 172.21.15.92:0/3258928879 learned_addr learned my addr 172.21.15.92:0/3258928879 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:06.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.789+0000 7fab08fb0640 1 --2- 172.21.15.92:0/3258928879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab04100e20 0x7fab0410e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:06.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.789+0000 7fab097b1640 1 --2- 172.21.15.92:0/3258928879 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab04102ef0 0x7fab0410ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:06.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.789+0000 7fab03fff640 1 -- 172.21.15.92:0/3258928879 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab04102ef0 msgr2=0x7fab0410ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:06.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.789+0000 7fab03fff640 1 --2- 172.21.15.92:0/3258928879 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab04102ef0 0x7fab0410ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.789+0000 7fab03fff640 1 -- 172.21.15.92:0/3258928879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab04100e20 msgr2=0x7fab0410e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:06.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.789+0000 7fab03fff640 1 --2- 172.21.15.92:0/3258928879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab04100e20 0x7fab0410e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.789+0000 7fab03fff640 1 -- 172.21.15.92:0/3258928879 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab041a6b00 con 0x7fab04102570 2024-09-19T08:56:06.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.789+0000 7fab03fff640 1 --2- 172.21.15.92:0/3258928879 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab04102570 0x7fab0410ea10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7faaf0006010 tx=0x7faaf0003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:06.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.789+0000 7fab01ffb640 1 -- 172.21.15.92:0/3258928879 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf003f070 con 0x7fab04102570 2024-09-19T08:56:06.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.789+0000 7fab01ffb640 1 -- 172.21.15.92:0/3258928879 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faaf0031e30 con 0x7fab04102570 2024-09-19T08:56:06.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.789+0000 7fab0b214640 1 -- 172.21.15.92:0/3258928879 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab041a6d90 con 0x7fab04102570 2024-09-19T08:56:06.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.789+0000 7fab01ffb640 1 -- 172.21.15.92:0/3258928879 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf0035030 con 0x7fab04102570 2024-09-19T08:56:06.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.790+0000 7fab0b214640 1 -- 172.21.15.92:0/3258928879 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab041a7210 con 0x7fab04102570 2024-09-19T08:56:06.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.792+0000 7fab01ffb640 1 -- 172.21.15.92:0/3258928879 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7faaf0042070 con 0x7fab04102570 2024-09-19T08:56:06.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.792+0000 7fab0d5ed740 1 Processor -- start 2024-09-19T08:56:06.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.792+0000 7fab0d5ed740 1 -- start start 2024-09-19T08:56:06.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.792+0000 7fab0d5ed740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56246bef89d0 0x56246bef8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:06.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.792+0000 7fab0d5ed740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56246bef92f0 0x56246bf03670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:06.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.792+0000 7fab01ffb640 1 --2- 172.21.15.92:0/3258928879 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7faaf40a3240 0x7faaf40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:06.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.792+0000 7fab0d5ed740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56246bf03bb0 0x56246bf05fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:06.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.792+0000 7fab0d5ed740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56246be5f090 con 0x56246bef92f0 2024-09-19T08:56:06.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.792+0000 7fab0d5ed740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56246be06a70 con 0x56246bef89d0 2024-09-19T08:56:06.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.793+0000 7fab0d5ed740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56246be5b050 con 0x56246bf03bb0 2024-09-19T08:56:06.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.793+0000 7fab03fff640 1 --2- 172.21.15.92:0/3258928879 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7faaf40a3240 0x7faaf40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:06.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.793+0000 7fab08fb0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56246bef92f0 0x56246bf03670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:06.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.793+0000 7fab08fb0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56246bef92f0 0x56246bf03670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49832/0 (socket says 172.21.15.92:49832) 2024-09-19T08:56:06.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.793+0000 7fab08fb0640 1 -- 172.21.15.92:0/2190084146 learned_addr learned my addr 172.21.15.92:0/2190084146 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:06.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.793+0000 7fab097b1640 1 --2- 172.21.15.92:0/2190084146 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56246bf03bb0 0x56246bf05fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:06.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.793+0000 7fab097b1640 1 --2- 172.21.15.92:0/2190084146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56246bef89d0 0x56246bef8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:06.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.793+0000 7fab01ffb640 1 -- 172.21.15.92:0/3258928879 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7faaf00f0120 con 0x7fab04102570 2024-09-19T08:56:06.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.793+0000 7fab08fb0640 1 -- 172.21.15.92:0/2190084146 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56246bf03bb0 msgr2=0x56246bf05fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:06.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.793+0000 7fab08fb0640 1 --2- 172.21.15.92:0/2190084146 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56246bf03bb0 0x56246bf05fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.793+0000 7fab08fb0640 1 -- 172.21.15.92:0/2190084146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56246bef89d0 msgr2=0x56246bef8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:06.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.793+0000 7fab08fb0640 1 --2- 172.21.15.92:0/2190084146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56246bef89d0 0x56246bef8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.793+0000 7fab08fb0640 1 -- 172.21.15.92:0/2190084146 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56246be13130 con 0x56246bef92f0 2024-09-19T08:56:06.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.793+0000 7fab03fff640 1 --2- 172.21.15.92:0/3258928879 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7faaf40a3240 0x7faaf40a5700 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7faaf0005ab0 tx=0x7faaf002a480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:06.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.793+0000 7fab08fb0640 1 --2- 172.21.15.92:0/2190084146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56246bef92f0 0x56246bf03670 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7faaf8009a70 tx=0x7faaf8009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d682faa5882290dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:06.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.793+0000 7faaeeffd640 1 -- 172.21.15.92:0/2190084146 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf8017070 con 0x56246bef92f0 2024-09-19T08:56:06.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.793+0000 7faaeeffd640 1 -- 172.21.15.92:0/2190084146 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faaf8013470 con 0x56246bef92f0 2024-09-19T08:56:06.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.793+0000 7faaeeffd640 1 -- 172.21.15.92:0/2190084146 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf8012610 con 0x56246bef92f0 2024-09-19T08:56:06.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.794+0000 7fab0d5ed740 1 -- 172.21.15.92:0/2190084146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56246bef92f0 msgr2=0x56246bf03670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:06.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.794+0000 7fab0d5ed740 1 --2- 172.21.15.92:0/2190084146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56246bef92f0 0x56246bf03670 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7faaf8009a70 tx=0x7faaf8009f30 comp rx=0 tx=0).stop 2024-09-19T08:56:06.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.794+0000 7fab0d5ed740 1 -- 172.21.15.92:0/2190084146 shutdown_connections 2024-09-19T08:56:06.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.794+0000 7fab0d5ed740 1 --2- 172.21.15.92:0/2190084146 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56246bf03bb0 0x56246bf05fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.794+0000 7fab0d5ed740 1 --2- 172.21.15.92:0/2190084146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56246bef92f0 0x56246bf03670 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.794+0000 7fab0d5ed740 1 --2- 172.21.15.92:0/2190084146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56246bef89d0 0x56246bef8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.794+0000 7fab0d5ed740 1 -- 172.21.15.92:0/2190084146 >> 172.21.15.92:0/2190084146 conn(0x56246bef4f60 msgr2=0x56246bef5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:06.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.794+0000 7fab0d5ed740 1 -- 172.21.15.92:0/2190084146 shutdown_connections 2024-09-19T08:56:06.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.794+0000 7fab0d5ed740 1 -- 172.21.15.92:0/2190084146 wait complete. 2024-09-19T08:56:06.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.794+0000 7fab0d5ed740 1 -- start start 2024-09-19T08:56:06.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.795+0000 7fab0d5ed740 1 Processor -- start 2024-09-19T08:56:06.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.795+0000 7fab0d5ed740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56246bef89d0 0x56246bf033c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:06.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.795+0000 7fab0d5ed740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56246bef92f0 0x56246bf00710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:06.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.795+0000 7fab0d5ed740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56246bf03bb0 0x56246bf00c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:06.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.795+0000 7fab0d5ed740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56246bf06780 con 0x56246bf03bb0 2024-09-19T08:56:06.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.795+0000 7fab0d5ed740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56246be19f20 con 0x56246bef92f0 2024-09-19T08:56:06.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.795+0000 7fab0d5ed740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56246bf06900 con 0x56246bef89d0 2024-09-19T08:56:06.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.795+0000 7fab0d5ed740 10 client.0 _ll_register_callbacks cb 0x56246bde3030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:06.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.795+0000 7fab097b1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56246bf03bb0 0x56246bf00c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:06.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.795+0000 7fab097b1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56246bf03bb0 0x56246bf00c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49844/0 (socket says 172.21.15.92:49844) 2024-09-19T08:56:06.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.795+0000 7fab097b1640 1 -- 172.21.15.92:0/416804416 learned_addr learned my addr 172.21.15.92:0/416804416 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:06.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.795+0000 7fab08fb0640 1 --2- 172.21.15.92:0/416804416 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56246bef92f0 0x56246bf00710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:06.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.795+0000 7fab097b1640 1 --2- 172.21.15.92:0/416804416 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56246bef89d0 0x56246bf033c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:06.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.795+0000 7fab097b1640 1 -- 172.21.15.92:0/416804416 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56246bef89d0 msgr2=0x56246bf033c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:06.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.795+0000 7fab097b1640 1 --2- 172.21.15.92:0/416804416 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56246bef89d0 0x56246bf033c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.795+0000 7fab097b1640 1 -- 172.21.15.92:0/416804416 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56246bef92f0 msgr2=0x56246bf00710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:06.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.795+0000 7fab097b1640 1 --2- 172.21.15.92:0/416804416 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56246bef92f0 0x56246bf00710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.795+0000 7fab097b1640 1 -- 172.21.15.92:0/416804416 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56246bbd02b0 con 0x56246bf03bb0 2024-09-19T08:56:06.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.795+0000 7fab097b1640 1 --2- 172.21.15.92:0/416804416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56246bf03bb0 0x56246bf00c50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7faafc00be90 tx=0x7faafc00d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed5bed0aa7037d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:06.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.795+0000 7faae3fff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:56:06.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.796+0000 7faae3fff640 1 -- 172.21.15.92:0/416804416 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faafc01e020 con 0x56246bf03bb0 2024-09-19T08:56:06.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.796+0000 7faae3fff640 1 -- 172.21.15.92:0/416804416 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7faafc01a5f0 con 0x56246bf03bb0 2024-09-19T08:56:06.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.796+0000 7fab0d5ed740 1 -- 172.21.15.92:0/416804416 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faaf8013470 con 0x56246bf03bb0 2024-09-19T08:56:06.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.796+0000 7faae3fff640 1 -- 172.21.15.92:0/416804416 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7faafc014040 con 0x56246bf03bb0 2024-09-19T08:56:06.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.796+0000 7fab0d5ed740 10 client.15087 fetch_fsmap learned FSMap version 19 2024-09-19T08:56:06.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.796+0000 7fab0d5ed740 1 -- 172.21.15.92:0/416804416 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56246bf120a0 con 0x56246bf03bb0 2024-09-19T08:56:06.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.796+0000 7faae3fff640 1 -- 172.21.15.92:0/416804416 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faaf8013470 con 0x56246bf03bb0 2024-09-19T08:56:06.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.796+0000 7faae3fff640 1 -- 172.21.15.92:0/416804416 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7faafc0259c0 con 0x56246bf03bb0 2024-09-19T08:56:06.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.796+0000 7fab0d5ed740 10 client.15087 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:56:06.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.796+0000 7fab0d5ed740 10 client.15087 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T08:56:06.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.796+0000 7fab0d5ed740 20 client.15087 populate_metadata read hostname 'smithi092' 2024-09-19T08:56:06.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.796+0000 7fab0d5ed740 1 --2- 172.21.15.92:0/416804416 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56246bf146c0 0x56246bf15b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:06.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.796+0000 7fab0d5ed740 4 client.15087 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:56:06.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.796+0000 7fab0d5ed740 1 -- 172.21.15.92:0/416804416 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56246be6c600 con 0x56246bf146c0 2024-09-19T08:56:06.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.797+0000 7fab08fb0640 1 --2- 172.21.15.92:0/416804416 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56246bf146c0 0x56246bf15b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:06.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.797+0000 7fab08fb0640 1 --2- 172.21.15.92:0/416804416 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56246bf146c0 0x56246bf15b30 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14c029d2d4f366ee server_cookie=bb88ed1fc6eeb8ce in_seq=0 out_seq=0 2024-09-19T08:56:06.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.797+0000 7faae3fff640 10 client.15087 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:06.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.798+0000 7faae3fff640 1 -- 172.21.15.92:0/416804416 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56246be6c600 con 0x56246bf146c0 2024-09-19T08:56:06.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.798+0000 7faae3fff640 10 client.15087 handle_command_reply: tid=0 2024-09-19T08:56:06.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.798+0000 7fab0d5ed740 1 client.15087 shutdown 2024-09-19T08:56:06.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.798+0000 7fab0d5ed740 1 -- 172.21.15.92:0/416804416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56246bf03bb0 msgr2=0x56246bf00c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:06.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.798+0000 7fab0d5ed740 1 --2- 172.21.15.92:0/416804416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56246bf03bb0 0x56246bf00c50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7faafc00be90 tx=0x7faafc00d040 comp rx=0 tx=0).stop 2024-09-19T08:56:06.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.798+0000 7fab0d5ed740 1 -- 172.21.15.92:0/416804416 shutdown_connections 2024-09-19T08:56:06.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.798+0000 7fab0d5ed740 1 --2- 172.21.15.92:0/416804416 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56246bf146c0 0x56246bf15b30 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.798+0000 7fab0d5ed740 1 --2- 172.21.15.92:0/416804416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56246bf03bb0 0x56246bf00c50 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.798+0000 7fab0d5ed740 1 --2- 172.21.15.92:0/416804416 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56246bef92f0 0x56246bf00710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.798+0000 7fab0d5ed740 1 --2- 172.21.15.92:0/416804416 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56246bef89d0 0x56246bf033c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.798+0000 7fab0d5ed740 1 -- 172.21.15.92:0/416804416 >> 172.21.15.92:0/416804416 conn(0x56246bef4f60 msgr2=0x56246befac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:06.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.798+0000 7faae3fff640 0 client.15087 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:06.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.798+0000 7fab0d5ed740 1 -- 172.21.15.92:0/416804416 shutdown_connections 2024-09-19T08:56:06.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.798+0000 7fab0d5ed740 1 -- 172.21.15.92:0/416804416 wait complete. 2024-09-19T08:56:06.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.799+0000 7fab0d5ed740 20 client.15087 trim_cache size 0 max 16384 2024-09-19T08:56:06.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.816+0000 7fab0d5ed740 1 Processor -- start 2024-09-19T08:56:06.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.816+0000 7fab0d5ed740 1 -- start start 2024-09-19T08:56:06.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.816+0000 7fab0d5ed740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56246bef89d0 0x56246bf13ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:06.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.816+0000 7fab0d5ed740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56246bef92f0 0x56246bf15460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:06.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.816+0000 7fab0d5ed740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56246bf03bb0 0x56246bf006d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:06.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.816+0000 7fab0d5ed740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56246bf13e70 con 0x56246bef89d0 2024-09-19T08:56:06.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.816+0000 7fab0d5ed740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56246bf14540 con 0x56246bef92f0 2024-09-19T08:56:06.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.816+0000 7fab0d5ed740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56246bf14c10 con 0x56246bf03bb0 2024-09-19T08:56:06.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.816+0000 7fab097b1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56246bef89d0 0x56246bf13ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:06.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.817+0000 7fab097b1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56246bef89d0 0x56246bf13ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49860/0 (socket says 172.21.15.92:49860) 2024-09-19T08:56:06.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.817+0000 7fab097b1640 1 -- 172.21.15.92:0/3291624332 learned_addr learned my addr 172.21.15.92:0/3291624332 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:06.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.817+0000 7fab08fb0640 1 --2- 172.21.15.92:0/3291624332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56246bef92f0 0x56246bf15460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:06.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.817+0000 7fab097b1640 1 --2- 172.21.15.92:0/3291624332 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56246bf03bb0 0x56246bf006d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:06.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.817+0000 7fab097b1640 1 -- 172.21.15.92:0/3291624332 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56246bf03bb0 msgr2=0x56246bf006d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:06.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.817+0000 7fab097b1640 1 --2- 172.21.15.92:0/3291624332 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56246bf03bb0 0x56246bf006d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.817+0000 7fab097b1640 1 -- 172.21.15.92:0/3291624332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56246bef92f0 msgr2=0x56246bf15460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:06.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.817+0000 7fab097b1640 1 --2- 172.21.15.92:0/3291624332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56246bef92f0 0x56246bf15460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.817+0000 7fab097b1640 1 -- 172.21.15.92:0/3291624332 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56246bef9120 con 0x56246bef89d0 2024-09-19T08:56:06.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.817+0000 7fab097b1640 1 --2- 172.21.15.92:0/3291624332 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56246bef89d0 0x56246bf13ff0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7faafc004b90 tx=0x7faafc018dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4863fc1a96e9c003 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:06.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.817+0000 7faaee7fc640 1 -- 172.21.15.92:0/3291624332 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faafc01e070 con 0x56246bef89d0 2024-09-19T08:56:06.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.817+0000 7faaee7fc640 1 -- 172.21.15.92:0/3291624332 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faafc025b10 con 0x56246bef89d0 2024-09-19T08:56:06.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.817+0000 7faaee7fc640 1 -- 172.21.15.92:0/3291624332 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faafc022e80 con 0x56246bef89d0 2024-09-19T08:56:06.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.818+0000 7fab0d5ed740 1 -- 172.21.15.92:0/3291624332 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56246bef89d0 msgr2=0x56246bf13ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:06.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.818+0000 7fab0d5ed740 1 --2- 172.21.15.92:0/3291624332 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56246bef89d0 0x56246bf13ff0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7faafc004b90 tx=0x7faafc018dc0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.818+0000 7fab0d5ed740 1 -- 172.21.15.92:0/3291624332 shutdown_connections 2024-09-19T08:56:06.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.818+0000 7fab0d5ed740 1 --2- 172.21.15.92:0/3291624332 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56246bf03bb0 0x56246bf006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.818+0000 7fab0d5ed740 1 --2- 172.21.15.92:0/3291624332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56246bef92f0 0x56246bf15460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.818+0000 7fab0d5ed740 1 --2- 172.21.15.92:0/3291624332 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56246bef89d0 0x56246bf13ff0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.818+0000 7fab0d5ed740 1 -- 172.21.15.92:0/3291624332 >> 172.21.15.92:0/3291624332 conn(0x56246bef4f60 msgr2=0x56246bef5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:06.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.818+0000 7fab0d5ed740 1 -- 172.21.15.92:0/3291624332 shutdown_connections 2024-09-19T08:56:06.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.818+0000 7fab0d5ed740 1 -- 172.21.15.92:0/3291624332 wait complete. 2024-09-19T08:56:06.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.818+0000 7fab0d5ed740 1 -- start start 2024-09-19T08:56:06.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.818+0000 7fab0d5ed740 1 Processor -- start 2024-09-19T08:56:06.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.819+0000 7fab0d5ed740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56246bef89d0 0x56246bf1e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:06.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.819+0000 7fab0d5ed740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56246bef92f0 0x56246bf16c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:06.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.819+0000 7fab0d5ed740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56246bf03bb0 0x56246bf17250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:06.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.819+0000 7fab0d5ed740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56246bf159b0 con 0x56246bef89d0 2024-09-19T08:56:06.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.819+0000 7fab0d5ed740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56246bf152e0 con 0x56246bef92f0 2024-09-19T08:56:06.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.819+0000 7fab0d5ed740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56246bf16080 con 0x56246bf03bb0 2024-09-19T08:56:06.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.819+0000 7fab0d5ed740 10 client.0 _ll_register_callbacks cb 0x7faafc00bd90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:06.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.819+0000 7fab097b1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56246bef89d0 0x56246bf1e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:06.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.819+0000 7fab097b1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56246bef89d0 0x56246bf1e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49874/0 (socket says 172.21.15.92:49874) 2024-09-19T08:56:06.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.819+0000 7fab097b1640 1 -- 172.21.15.92:0/746028332 learned_addr learned my addr 172.21.15.92:0/746028332 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:06.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.819+0000 7fab08fb0640 1 --2- 172.21.15.92:0/746028332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56246bef92f0 0x56246bf16c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:06.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.819+0000 7fab097b1640 1 -- 172.21.15.92:0/746028332 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56246bf03bb0 msgr2=0x56246bf17250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:06.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.819+0000 7fab097b1640 1 --2- 172.21.15.92:0/746028332 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56246bf03bb0 0x56246bf17250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.819+0000 7fab097b1640 1 -- 172.21.15.92:0/746028332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56246bef92f0 msgr2=0x56246bf16c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:06.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.819+0000 7fab097b1640 1 --2- 172.21.15.92:0/746028332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56246bef92f0 0x56246bf16c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.819+0000 7fab097b1640 1 -- 172.21.15.92:0/746028332 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56246bf17a80 con 0x56246bef89d0 2024-09-19T08:56:06.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.819+0000 7fab08fb0640 1 --2- 172.21.15.92:0/746028332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56246bef92f0 0x56246bf16c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:56:06.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.819+0000 7fab097b1640 1 --2- 172.21.15.92:0/746028332 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56246bef89d0 0x56246bf1e720 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7faafc022f90 tx=0x7faafc00b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b45aad3e8b6f0a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:06.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.819+0000 7faae3fff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:56:06.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.820+0000 7faae3fff640 1 -- 172.21.15.92:0/746028332 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faafc01e070 con 0x56246bef89d0 2024-09-19T08:56:06.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.820+0000 7faae3fff640 1 -- 172.21.15.92:0/746028332 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7faafc025640 con 0x56246bef89d0 2024-09-19T08:56:06.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.820+0000 7fab0d5ed740 1 -- 172.21.15.92:0/746028332 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faafc025b10 con 0x56246bef89d0 2024-09-19T08:56:06.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.820+0000 7faae3fff640 1 -- 172.21.15.92:0/746028332 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7faafc025880 con 0x56246bef89d0 2024-09-19T08:56:06.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.820+0000 7fab0d5ed740 10 client.15093 fetch_fsmap learned FSMap version 19 2024-09-19T08:56:06.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.820+0000 7fab0d5ed740 1 -- 172.21.15.92:0/746028332 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56246bf7def0 con 0x56246bef89d0 2024-09-19T08:56:06.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.820+0000 7faae3fff640 1 -- 172.21.15.92:0/746028332 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faafc025b10 con 0x56246bef89d0 2024-09-19T08:56:06.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.820+0000 7faae3fff640 1 -- 172.21.15.92:0/746028332 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7faafc02f420 con 0x56246bef89d0 2024-09-19T08:56:06.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.820+0000 7fab0d5ed740 10 client.15093 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:56:06.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.820+0000 7fab0d5ed740 10 client.15093 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T08:56:06.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.820+0000 7fab0d5ed740 20 client.15093 populate_metadata read hostname 'smithi092' 2024-09-19T08:56:06.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.820+0000 7fab0d5ed740 1 --2- 172.21.15.92:0/746028332 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56246bf827f0 0x56246bf81500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:06.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.820+0000 7fab0d5ed740 4 client.15093 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T08:56:06.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.820+0000 7fab0d5ed740 1 -- 172.21.15.92:0/746028332 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "status"}) -- 0x56246be66b10 con 0x56246bf827f0 2024-09-19T08:56:06.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.820+0000 7fab08fb0640 1 --2- 172.21.15.92:0/746028332 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56246bf827f0 0x56246bf81500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:06.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.821+0000 7fab08fb0640 1 --2- 172.21.15.92:0/746028332 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56246bf827f0 0x56246bf81500 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb3eedd653e850c3 server_cookie=88d5005c8cc3c823 in_seq=0 out_seq=0 2024-09-19T08:56:06.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.821+0000 7faae3fff640 10 client.15093 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:06.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.821+0000 7faae3fff640 1 -- 172.21.15.92:0/746028332 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x56246be66b10 con 0x56246bf827f0 2024-09-19T08:56:06.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.821+0000 7faae3fff640 10 client.15093 handle_command_reply: tid=0 2024-09-19T08:56:06.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.821+0000 7fab0d5ed740 1 client.15093 shutdown 2024-09-19T08:56:06.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.821+0000 7fab0d5ed740 1 -- 172.21.15.92:0/746028332 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56246bef89d0 msgr2=0x56246bf1e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:06.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.821+0000 7fab0d5ed740 1 --2- 172.21.15.92:0/746028332 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56246bef89d0 0x56246bf1e720 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7faafc022f90 tx=0x7faafc00b9b0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.822+0000 7fab0d5ed740 1 -- 172.21.15.92:0/746028332 shutdown_connections 2024-09-19T08:56:06.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.822+0000 7fab0d5ed740 1 --2- 172.21.15.92:0/746028332 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56246bf827f0 0x56246bf81500 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.822+0000 7fab0d5ed740 1 --2- 172.21.15.92:0/746028332 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56246bf03bb0 0x56246bf17250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.822+0000 7fab0d5ed740 1 --2- 172.21.15.92:0/746028332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56246bef92f0 0x56246bf16c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.822+0000 7faae3fff640 0 client.15093 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:06.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.822+0000 7fab0d5ed740 1 --2- 172.21.15.92:0/746028332 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56246bef89d0 0x56246bf1e720 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.822+0000 7fab0d5ed740 1 -- 172.21.15.92:0/746028332 >> 172.21.15.92:0/746028332 conn(0x56246bef4f60 msgr2=0x56246bf006d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:06.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.822+0000 7fab0d5ed740 1 -- 172.21.15.92:0/746028332 shutdown_connections 2024-09-19T08:56:06.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.822+0000 7fab0d5ed740 1 -- 172.21.15.92:0/746028332 wait complete. 2024-09-19T08:56:06.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.822+0000 7fab0d5ed740 20 client.15093 trim_cache size 0 max 16384 2024-09-19T08:56:06.828 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T08:56:06.828 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "91ff74f2-7663-11ef-bceb-c7b262605968", 2024-09-19T08:56:06.828 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 0, 2024-09-19T08:56:06.828 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24472, 2024-09-19T08:56:06.829 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-09-19T08:56:06.829 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-09-19T08:56:06.829 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-09-19T08:56:06.829 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 94.394653782999995, 2024-09-19T08:56:06.829 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 19, 2024-09-19T08:56:06.829 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 82, 2024-09-19T08:56:06.829 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 80, 2024-09-19T08:56:06.829 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 113.252090241 2024-09-19T08:56:06.829 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T08:56:06.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.822+0000 7fab0b214640 1 -- 172.21.15.92:0/3258928879 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7faaf40a3240 msgr2=0x7faaf40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:06.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.822+0000 7fab0b214640 1 --2- 172.21.15.92:0/3258928879 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7faaf40a3240 0x7faaf40a5700 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7faaf0005ab0 tx=0x7faaf002a480 comp rx=0 tx=0).stop 2024-09-19T08:56:06.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.822+0000 7fab0b214640 1 -- 172.21.15.92:0/3258928879 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab04102570 msgr2=0x7fab0410ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:06.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.822+0000 7fab0b214640 1 --2- 172.21.15.92:0/3258928879 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab04102570 0x7fab0410ea10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7faaf0006010 tx=0x7faaf0003c80 comp rx=0 tx=0).stop 2024-09-19T08:56:06.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.823+0000 7fab0b214640 1 -- 172.21.15.92:0/3258928879 shutdown_connections 2024-09-19T08:56:06.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.823+0000 7fab0b214640 1 --2- 172.21.15.92:0/3258928879 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab04102ef0 0x7fab0410ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.823+0000 7fab0b214640 1 --2- 172.21.15.92:0/3258928879 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7faaf40a3240 0x7faaf40a5700 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.823+0000 7fab0b214640 1 --2- 172.21.15.92:0/3258928879 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab04102570 0x7fab0410ea10 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.823+0000 7fab0b214640 1 --2- 172.21.15.92:0/3258928879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab04100e20 0x7fab0410e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.823+0000 7fab0b214640 1 -- 172.21.15.92:0/3258928879 >> 172.21.15.92:0/3258928879 conn(0x7fab040fc7d0 msgr2=0x7fab040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:06.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.823+0000 7fab0b214640 1 -- 172.21.15.92:0/3258928879 shutdown_connections 2024-09-19T08:56:06.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:06.823+0000 7fab0b214640 1 -- 172.21.15.92:0/3258928879 wait complete. 2024-09-19T08:56:06.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:06 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/2395611537' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:56:06.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:06 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/2395611537' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:56:07.555 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:07 smithi092 ceph-mon[31407]: pgmap v319: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2024-09-19T08:56:07.583 INFO:teuthology.run_tasks:Running task sequential... 2024-09-19T08:56:07.593 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-19T08:56:07.593 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-19T08:56:07.593 INFO:teuthology.task.print:Enabling mgr modules 2024-09-19T08:56:07.593 INFO:teuthology.run_tasks:Running task kclient... 2024-09-19T08:56:07.647 INFO:tasks.kclient:Mounting kernel clients... 2024-09-19T08:56:07.647 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-19T08:56:07.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:56:07.648 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2024-09-19T08:56:07.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:56:07.665 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link delete ceph-brx 2024-09-19T08:56:07.732 INFO:teuthology.orchestra.run.smithi092.stderr:Cannot find device "ceph-brx" 2024-09-19T08:56:07.733 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:56:07.734 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync', 'context=system_u:object_r:postgresql_db_t:s0'], 'syntax': 'v1', 'mount_subvol_num': 1, 'mountpoint': '/tmp/cephfs'} 2024-09-19T08:56:07.734 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T08:56:07.734 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2024-09-19T08:56:07.734 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2024-09-19T08:56:07.734 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T08:56:07.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:07 smithi167 ceph-mon[35359]: pgmap v319: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2024-09-19T08:56:07.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:07 smithi190 ceph-mon[35358]: pgmap v319: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2024-09-19T08:56:08.017 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:08.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.515+0000 7fe646244640 1 -- 172.21.15.92:0/849959650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe640100c00 msgr2=0x7fe64010d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:08.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.515+0000 7fe646244640 1 --2- 172.21.15.92:0/849959650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe640100c00 0x7fe64010d0f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe638009cd0 tx=0x7fe63802a8e0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.515+0000 7fe646244640 1 -- 172.21.15.92:0/849959650 shutdown_connections 2024-09-19T08:56:08.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.515+0000 7fe646244640 1 --2- 172.21.15.92:0/849959650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe640100c00 0x7fe64010d0f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.515+0000 7fe646244640 1 --2- 172.21.15.92:0/849959650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6401002a0 0x7fe6401006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.515+0000 7fe646244640 1 --2- 172.21.15.92:0/849959650 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6401062b0 0x7fe640106690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.515+0000 7fe646244640 1 -- 172.21.15.92:0/849959650 >> 172.21.15.92:0/849959650 conn(0x7fe6400fc5c0 msgr2=0x7fe6400fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:08.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.515+0000 7fe646244640 1 -- 172.21.15.92:0/849959650 shutdown_connections 2024-09-19T08:56:08.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.515+0000 7fe646244640 1 -- 172.21.15.92:0/849959650 wait complete. 2024-09-19T08:56:08.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.515+0000 7fe646244640 1 Processor -- start 2024-09-19T08:56:08.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.515+0000 7fe646244640 1 -- start start 2024-09-19T08:56:08.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.516+0000 7fe646244640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6401002a0 0x7fe640198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:08.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.516+0000 7fe646244640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe640100c00 0x7fe6401989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:08.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.516+0000 7fe646244640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6401062b0 0x7fe64019cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:08.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.516+0000 7fe646244640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe64010fdb0 con 0x7fe6401002a0 2024-09-19T08:56:08.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.516+0000 7fe646244640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe64010fc30 con 0x7fe640100c00 2024-09-19T08:56:08.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.516+0000 7fe646244640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe64010ff30 con 0x7fe6401062b0 2024-09-19T08:56:08.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.516+0000 7fe63f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6401002a0 0x7fe640198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:08.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.516+0000 7fe63f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6401002a0 0x7fe640198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49888/0 (socket says 172.21.15.92:49888) 2024-09-19T08:56:08.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.516+0000 7fe63f7fe640 1 -- 172.21.15.92:0/1411746615 learned_addr learned my addr 172.21.15.92:0/1411746615 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:08.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.516+0000 7fe63effd640 1 --2- 172.21.15.92:0/1411746615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe640100c00 0x7fe6401989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:08.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.516+0000 7fe63ffff640 1 --2- 172.21.15.92:0/1411746615 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6401062b0 0x7fe64019cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:08.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.516+0000 7fe63f7fe640 1 -- 172.21.15.92:0/1411746615 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6401062b0 msgr2=0x7fe64019cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:08.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.516+0000 7fe63f7fe640 1 --2- 172.21.15.92:0/1411746615 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6401062b0 0x7fe64019cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.516+0000 7fe63f7fe640 1 -- 172.21.15.92:0/1411746615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe640100c00 msgr2=0x7fe6401989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:08.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.516+0000 7fe63f7fe640 1 --2- 172.21.15.92:0/1411746615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe640100c00 0x7fe6401989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.516+0000 7fe63f7fe640 1 -- 172.21.15.92:0/1411746615 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe64019d410 con 0x7fe6401002a0 2024-09-19T08:56:08.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.516+0000 7fe63effd640 1 --2- 172.21.15.92:0/1411746615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe640100c00 0x7fe6401989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:08.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.516+0000 7fe63f7fe640 1 --2- 172.21.15.92:0/1411746615 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6401002a0 0x7fe640198460 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe63000b4a0 tx=0x7fe63000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:08.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.516+0000 7fe63cff9640 1 -- 172.21.15.92:0/1411746615 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe630014070 con 0x7fe6401002a0 2024-09-19T08:56:08.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.516+0000 7fe646244640 1 -- 172.21.15.92:0/1411746615 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe64019d700 con 0x7fe6401002a0 2024-09-19T08:56:08.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.516+0000 7fe63cff9640 1 -- 172.21.15.92:0/1411746615 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe630010af0 con 0x7fe6401002a0 2024-09-19T08:56:08.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.516+0000 7fe63cff9640 1 -- 172.21.15.92:0/1411746615 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe630017d10 con 0x7fe6401002a0 2024-09-19T08:56:08.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.516+0000 7fe646244640 1 -- 172.21.15.92:0/1411746615 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6401a4fe0 con 0x7fe6401002a0 2024-09-19T08:56:08.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.518+0000 7fe646244640 1 -- 172.21.15.92:0/1411746615 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6401006c0 con 0x7fe6401002a0 2024-09-19T08:56:08.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.519+0000 7fe63cff9640 1 -- 172.21.15.92:0/1411746615 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe630017070 con 0x7fe6401002a0 2024-09-19T08:56:08.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.519+0000 7fe63cff9640 1 --2- 172.21.15.92:0/1411746615 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe6280a3230 0x7fe6280a56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:08.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.519+0000 7fe63effd640 1 --2- 172.21.15.92:0/1411746615 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe6280a3230 0x7fe6280a56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:08.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.519+0000 7fe63cff9640 1 -- 172.21.15.92:0/1411746615 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe6300ced90 con 0x7fe6401002a0 2024-09-19T08:56:08.554 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.520+0000 7fe63effd640 1 --2- 172.21.15.92:0/1411746615 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe6280a3230 0x7fe6280a56f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe6400fe760 tx=0x7fe63400a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:08.554 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.523+0000 7fe63cff9640 1 -- 172.21.15.92:0/1411746615 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe63009bab0 con 0x7fe6401002a0 2024-09-19T08:56:08.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.726+0000 7fe646244640 1 -- 172.21.15.92:0/1411746615 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe6401997c0 con 0x7fe6401002a0 2024-09-19T08:56:08.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.726+0000 7fe63cff9640 1 -- 172.21.15.92:0/1411746615 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) ==== 53+0+73 (secure 0 0 0) 0x7fe63009b3b0 con 0x7fe6401002a0 2024-09-19T08:56:08.726 INFO:teuthology.orchestra.run.smithi092.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T08:56:08.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.729+0000 7fe646244640 1 -- 172.21.15.92:0/1411746615 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe6280a3230 msgr2=0x7fe6280a56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:08.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.729+0000 7fe646244640 1 --2- 172.21.15.92:0/1411746615 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe6280a3230 0x7fe6280a56f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe6400fe760 tx=0x7fe63400a5c0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.729+0000 7fe646244640 1 -- 172.21.15.92:0/1411746615 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6401002a0 msgr2=0x7fe640198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:08.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.729+0000 7fe646244640 1 --2- 172.21.15.92:0/1411746615 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6401002a0 0x7fe640198460 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe63000b4a0 tx=0x7fe63000b960 comp rx=0 tx=0).stop 2024-09-19T08:56:08.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.729+0000 7fe646244640 1 -- 172.21.15.92:0/1411746615 shutdown_connections 2024-09-19T08:56:08.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.729+0000 7fe646244640 1 --2- 172.21.15.92:0/1411746615 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6401062b0 0x7fe64019cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.729+0000 7fe646244640 1 --2- 172.21.15.92:0/1411746615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe640100c00 0x7fe6401989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.729+0000 7fe646244640 1 --2- 172.21.15.92:0/1411746615 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe6280a3230 0x7fe6280a56f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.729+0000 7fe646244640 1 --2- 172.21.15.92:0/1411746615 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6401002a0 0x7fe640198460 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.729+0000 7fe646244640 1 -- 172.21.15.92:0/1411746615 >> 172.21.15.92:0/1411746615 conn(0x7fe6400fc5c0 msgr2=0x7fe6400feeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:08.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.730+0000 7fe646244640 1 -- 172.21.15.92:0/1411746615 shutdown_connections 2024-09-19T08:56:08.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:08.730+0000 7fe646244640 1 -- 172.21.15.92:0/1411746615 wait complete. 2024-09-19T08:56:09.317 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T08:56:09.317 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T08:56:09.317 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi092.front.sepia.ceph.com 2024-09-19T08:56:09.317 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T08:56:09.317 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2024-09-19T08:56:09.317 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T08:56:09.317 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T08:56:09.318 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T08:56:09.318 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2024-09-19T08:56:09.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:56:09.318 DEBUG:teuthology.orchestra.run.smithi092:> ip addr 2024-09-19T08:56:09.334 INFO:teuthology.orchestra.run.smithi092.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T08:56:09.334 INFO:teuthology.orchestra.run.smithi092.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T08:56:09.334 INFO:teuthology.orchestra.run.smithi092.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T08:56:09.334 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:56:09.334 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 ::1/128 scope host 2024-09-19T08:56:09.334 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:56:09.335 INFO:teuthology.orchestra.run.smithi092.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:56:09.335 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b2 brd ff:ff:ff:ff:ff:ff 2024-09-19T08:56:09.335 INFO:teuthology.orchestra.run.smithi092.stdout: altname enp7s0f0 2024-09-19T08:56:09.335 INFO:teuthology.orchestra.run.smithi092.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:56:09.335 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b3 brd ff:ff:ff:ff:ff:ff 2024-09-19T08:56:09.335 INFO:teuthology.orchestra.run.smithi092.stdout: altname enp7s0f1 2024-09-19T08:56:09.335 INFO:teuthology.orchestra.run.smithi092.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:56:09.335 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:44 brd ff:ff:ff:ff:ff:ff 2024-09-19T08:56:09.335 INFO:teuthology.orchestra.run.smithi092.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T08:56:09.335 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:45 brd ff:ff:ff:ff:ff:ff 2024-09-19T08:56:09.335 INFO:teuthology.orchestra.run.smithi092.stdout: inet 172.21.15.92/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T08:56:09.335 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft 42226sec preferred_lft 42226sec 2024-09-19T08:56:09.335 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::ec4:7aff:fe8f:cd45/64 scope link noprefixroute 2024-09-19T08:56:09.336 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:56:09.336 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T08:56:09.336 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:56:09.336 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-19T08:56:09.336 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link add name ceph-brx type bridge 2024-09-19T08:56:09.336 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip addr flush dev ceph-brx 2024-09-19T08:56:09.337 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set ceph-brx up 2024-09-19T08:56:09.337 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T08:56:09.337 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-19T08:56:09.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:56:09.431 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:09 smithi092 ceph-mon[31407]: pgmap v320: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-19T08:56:09.432 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:09 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1411746615' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T08:56:09.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:56:09.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:56:09.539 DEBUG:teuthology.orchestra.run.smithi092:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T08:56:09.564 INFO:teuthology.orchestra.run.smithi092.stdout:1 2024-09-19T08:56:09.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:56:09.566 DEBUG:teuthology.orchestra.run.smithi092:> route 2024-09-19T08:56:09.642 INFO:teuthology.orchestra.run.smithi092.stdout:Kernel IP routing table 2024-09-19T08:56:09.642 INFO:teuthology.orchestra.run.smithi092.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T08:56:09.642 INFO:teuthology.orchestra.run.smithi092.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T08:56:09.642 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T08:56:09.642 INFO:teuthology.orchestra.run.smithi092.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T08:56:09.643 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:56:09.643 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-19T08:56:09.643 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T08:56:09.643 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T08:56:09.643 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T08:56:09.643 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-19T08:56:09.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:56:09.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:09 smithi167 ceph-mon[35359]: pgmap v320: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-19T08:56:09.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:09 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/1411746615' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T08:56:09.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:09 smithi190 ceph-mon[35358]: pgmap v320: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-19T08:56:09.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:09 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/1411746615' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T08:56:09.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:56:09.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:56:09.963 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2024-09-19T08:56:09.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:56:09.979 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list-id 2024-09-19T08:56:10.034 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:56:10.034 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-19T08:56:10.034 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns add ceph-ns--tmp-cephfs 2024-09-19T08:56:10.034 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns set ceph-ns--tmp-cephfs 0 2024-09-19T08:56:10.035 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-19T08:56:10.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:56:10.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:56:10.152 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2024-09-19T08:56:10.152 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:56:10.153 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-19T08:56:10.153 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2024-09-19T08:56:10.153 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T08:56:10.153 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2024-09-19T08:56:10.153 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2024-09-19T08:56:10.153 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2024-09-19T08:56:10.153 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-19T08:56:10.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:56:10.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:56:10.276 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:56:10.276 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-19T08:56:10.277 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set brx.0 up 2024-09-19T08:56:10.277 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T08:56:10.277 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-19T08:56:10.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:56:10.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:56:10.352 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T08:56:10.353 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -v /tmp/cephfs 2024-09-19T08:56:10.368 INFO:teuthology.orchestra.run.smithi092.stdout:mkdir: created directory '/tmp/cephfs' 2024-09-19T08:56:10.368 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T08:56:10.368 DEBUG:teuthology.orchestra.run.smithi092:> chmod 0000 /tmp/cephfs 2024-09-19T08:56:10.424 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-19T08:56:10.424 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-19T08:56:10.424 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/edc13aaa-2591-4ed4-a5ac-e9372bb5117f 2024-09-19T08:56:10.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:56:10.425 DEBUG:teuthology.orchestra.run.smithi092:> sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/edc13aaa-2591-4ed4-a5ac-e9372bb5117f /tmp/cephfs -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,context=system_u:object_r:postgresql_db_t:s0 2024-09-19T08:56:10.535 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,context="system_u:object_r:postgresql_db_t:s0" 2024-09-19T08:56:10.535 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,context="system_u:object_r:postgresql_db_t:s0"". 2024-09-19T08:56:10.535 INFO:teuthology.orchestra.run.smithi092.stdout:invalid new device string format 2024-09-19T08:56:10.672 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,context="system_u:object_r:postgresql_db_t:s0" 2024-09-19T08:56:10.672 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,context="system_u:object_r:postgresql_db_t:s0"". 2024-09-19T08:56:10.672 INFO:teuthology.orchestra.run.smithi092.stdout:invalid new device string format 2024-09-19T08:56:10.672 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: resolved to: "172.21.15.92:3300,172.21.15.167:3300,172.21.15.190:3300" 2024-09-19T08:56:10.673 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.92:3300,172.21.15.167:3300,172.21.15.190:3300:/volumes/qa/sv_1/edc13aaa-2591-4ed4-a5ac-e9372bb5117f 2024-09-19T08:56:10.673 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,context="system_u:object_r:postgresql_db_t:s0",key=0,fsid=91ff74f2-7663-11ef-bceb-c7b262605968" will pass to kernel 2024-09-19T08:56:10.674 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T08:56:10.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:56:10.675 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 1777 /tmp/cephfs 2024-09-19T08:56:10.701 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T08:56:10.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T08:56:10.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:56:10.796 INFO:teuthology.orchestra.run.smithi092.stdout:client24674 2024-09-19T08:56:10.797 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-19T08:56:10.797 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:56:10.814 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T08:56:10.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T08:56:10.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:56:10.910 INFO:teuthology.orchestra.run.smithi092.stdout:client24674 2024-09-19T08:56:10.911 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T08:56:10.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T08:56:10.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:56:10.966 INFO:teuthology.orchestra.run.smithi092.stdout:client24674 2024-09-19T08:56:10.967 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/cephfs && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/91ff74f2-7663-11ef-bceb-c7b262605968.client24674/status') 2024-09-19T08:56:11.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:56:11.025 INFO:teuthology.orchestra.run.smithi092.stdout:instance: client.24674 (3)172.21.15.92:0/3644032874 2024-09-19T08:56:11.025 INFO:teuthology.orchestra.run.smithi092.stdout:blocklisted: false 2024-09-19T08:56:11.025 INFO:teuthology.orchestra.run.smithi092.stderr:0+1 records in 2024-09-19T08:56:11.025 INFO:teuthology.orchestra.run.smithi092.stderr:0+1 records out 2024-09-19T08:56:11.025 INFO:teuthology.orchestra.run.smithi092.stderr:71 bytes copied, 2.2785e-05 s, 3.1 MB/s 2024-09-19T08:56:11.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:56:11.032 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-19T08:56:11.043 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-19T08:56:11.083 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T08:56:11.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.184+0000 7f3df66d2640 1 -- 172.21.15.92:0/467659362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3df0101c20 msgr2=0x7f3df01020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:11.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.184+0000 7f3df66d2640 1 --2- 172.21.15.92:0/467659362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3df0101c20 0x7f3df01020a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3de4009900 tx=0x7f3de402a410 comp rx=0 tx=0).stop 2024-09-19T08:56:11.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.184+0000 7f3df66d2640 1 -- 172.21.15.92:0/467659362 shutdown_connections 2024-09-19T08:56:11.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.184+0000 7f3df66d2640 1 --2- 172.21.15.92:0/467659362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3df01025e0 0x7f3df0108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.184+0000 7f3df66d2640 1 --2- 172.21.15.92:0/467659362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3df0101c20 0x7f3df01020a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.184+0000 7f3df66d2640 1 --2- 172.21.15.92:0/467659362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3df0100a30 0x7f3df0100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.184+0000 7f3df66d2640 1 -- 172.21.15.92:0/467659362 >> 172.21.15.92:0/467659362 conn(0x7f3df00fc1b0 msgr2=0x7f3df00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:11.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.184+0000 7f3df66d2640 1 -- 172.21.15.92:0/467659362 shutdown_connections 2024-09-19T08:56:11.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.184+0000 7f3df66d2640 1 -- 172.21.15.92:0/467659362 wait complete. 2024-09-19T08:56:11.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.185+0000 7f3df66d2640 1 Processor -- start 2024-09-19T08:56:11.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.185+0000 7f3df66d2640 1 -- start start 2024-09-19T08:56:11.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.185+0000 7f3df66d2640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3df0100a30 0x7f3df006af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:11.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.185+0000 7f3df66d2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3df0101c20 0x7f3df019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:11.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.185+0000 7f3df66d2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3df01025e0 0x7f3df019f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:11.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.185+0000 7f3df66d2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3df010c800 con 0x7f3df01025e0 2024-09-19T08:56:11.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.185+0000 7f3df66d2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3df010c680 con 0x7f3df0101c20 2024-09-19T08:56:11.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.185+0000 7f3df66d2640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3df010c980 con 0x7f3df0100a30 2024-09-19T08:56:11.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.185+0000 7f3df4c6f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3df01025e0 0x7f3df019f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:11.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.185+0000 7f3df4c6f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3df01025e0 0x7f3df019f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49904/0 (socket says 172.21.15.92:49904) 2024-09-19T08:56:11.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.185+0000 7f3df4c6f640 1 -- 172.21.15.92:0/2985695982 learned_addr learned my addr 172.21.15.92:0/2985695982 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:11.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.186+0000 7f3df4c6f640 1 -- 172.21.15.92:0/2985695982 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3df0100a30 msgr2=0x7f3df006af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:11.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.186+0000 7f3deffff640 1 --2- 172.21.15.92:0/2985695982 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3df0100a30 0x7f3df006af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:11.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.186+0000 7f3df4c6f640 1 --2- 172.21.15.92:0/2985695982 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3df0100a30 0x7f3df006af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.186+0000 7f3df4c6f640 1 -- 172.21.15.92:0/2985695982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3df0101c20 msgr2=0x7f3df019cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:11.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.186+0000 7f3df4c6f640 1 --2- 172.21.15.92:0/2985695982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3df0101c20 0x7f3df019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.186+0000 7f3df4c6f640 1 -- 172.21.15.92:0/2985695982 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3df019fbb0 con 0x7f3df01025e0 2024-09-19T08:56:11.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.186+0000 7f3df4c6f640 1 --2- 172.21.15.92:0/2985695982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3df01025e0 0x7f3df019f2f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3de800b970 tx=0x7f3de800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:11.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.186+0000 7f3ded7fa640 1 -- 172.21.15.92:0/2985695982 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de8019070 con 0x7f3df01025e0 2024-09-19T08:56:11.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.186+0000 7f3ded7fa640 1 -- 172.21.15.92:0/2985695982 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3de800cb40 con 0x7f3df01025e0 2024-09-19T08:56:11.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.186+0000 7f3df66d2640 1 -- 172.21.15.92:0/2985695982 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3df019fea0 con 0x7f3df01025e0 2024-09-19T08:56:11.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.186+0000 7f3ded7fa640 1 -- 172.21.15.92:0/2985695982 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de8007650 con 0x7f3df01025e0 2024-09-19T08:56:11.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.186+0000 7f3df66d2640 1 -- 172.21.15.92:0/2985695982 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3df01a0440 con 0x7f3df01025e0 2024-09-19T08:56:11.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.187+0000 7f3df66d2640 1 -- 172.21.15.92:0/2985695982 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3df0107e70 con 0x7f3df01025e0 2024-09-19T08:56:11.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.188+0000 7f3ded7fa640 1 -- 172.21.15.92:0/2985695982 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3de801c070 con 0x7f3df01025e0 2024-09-19T08:56:11.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.189+0000 7f3ded7fa640 1 --2- 172.21.15.92:0/2985695982 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3dd80a32d0 0x7f3dd80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:11.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.189+0000 7f3deffff640 1 --2- 172.21.15.92:0/2985695982 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3dd80a32d0 0x7f3dd80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:11.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.189+0000 7f3ded7fa640 1 -- 172.21.15.92:0/2985695982 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3de80cf360 con 0x7f3df01025e0 2024-09-19T08:56:11.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.189+0000 7f3deffff640 1 --2- 172.21.15.92:0/2985695982 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3dd80a32d0 0x7f3dd80a5790 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3df0101a80 tx=0x7f3de0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:11.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.192+0000 7f3ded7fa640 1 -- 172.21.15.92:0/2985695982 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3de809c080 con 0x7f3df01025e0 2024-09-19T08:56:11.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.359+0000 7f3df66d2640 1 -- 172.21.15.92:0/2985695982 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3df002da10 con 0x7f3df01025e0 2024-09-19T08:56:11.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.361+0000 7f3ded7fa640 1 -- 172.21.15.92:0/2985695982 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22782 (secure 0 0 0) 0x7f3de809b980 con 0x7f3df01025e0 2024-09-19T08:56:11.361 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:11.361 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":82,"fsid":"91ff74f2-7663-11ef-bceb-c7b262605968","created":"2024-09-19T08:47:08.162150+0000","modified":"2024-09-19T08:54:53.324204+0000","last_up_change":"2024-09-19T08:53:43.021949+0000","last_in_change":"2024-09-19T08:53:19.246805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:50:04.482034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:54:28.005336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:54:30.188980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd104fe2-b828-4c98-a499-b212717f2997","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6803","nonce":4232030626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6805","nonce":4232030626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6809","nonce":4232030626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6807","nonce":4232030626}]},"public_addr":"172.21.15.92:6803/4232030626","cluster_addr":"172.21.15.92:6805/4232030626","heartbeat_back_addr":"172.21.15.92:6809/4232030626","heartbeat_front_addr":"172.21.15.92:6807/4232030626","state":["exists","up"]},{"osd":1,"uuid":"0f725330-5e61-413c-b3c8-41bc2c0d8e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6801","nonce":4163493234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6803","nonce":4163493234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6807","nonce":4163493234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6805","nonce":4163493234}]},"public_addr":"172.21.15.167:6801/4163493234","cluster_addr":"172.21.15.167:6803/4163493234","heartbeat_back_addr":"172.21.15.167:6807/4163493234","heartbeat_front_addr":"172.21.15.167:6805/4163493234","state":["exists","up"]},{"osd":2,"uuid":"286d2943-23a0-4184-93cf-9d3430781f99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6801","nonce":702507556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6803","nonce":702507556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6807","nonce":702507556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6805","nonce":702507556}]},"public_addr":"172.21.15.190:6801/702507556","cluster_addr":"172.21.15.190:6803/702507556","heartbeat_back_addr":"172.21.15.190:6807/702507556","heartbeat_front_addr":"172.21.15.190:6805/702507556","state":["exists","up"]},{"osd":3,"uuid":"9d126671-7fc1-4f29-9bc3-3598052fd20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6811","nonce":945752895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6813","nonce":945752895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6817","nonce":945752895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6815","nonce":945752895}]},"public_addr":"172.21.15.92:6811/945752895","cluster_addr":"172.21.15.92:6813/945752895","heartbeat_back_addr":"172.21.15.92:6817/945752895","heartbeat_front_addr":"172.21.15.92:6815/945752895","state":["exists","up"]},{"osd":4,"uuid":"cb10b38d-ae13-4b92-b906-3505fb873b2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6809","nonce":3576893400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6811","nonce":3576893400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6815","nonce":3576893400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6813","nonce":3576893400}]},"public_addr":"172.21.15.167:6809/3576893400","cluster_addr":"172.21.15.167:6811/3576893400","heartbeat_back_addr":"172.21.15.167:6815/3576893400","heartbeat_front_addr":"172.21.15.167:6813/3576893400","state":["exists","up"]},{"osd":5,"uuid":"cd90668b-eca5-4bb4-870e-e58578730c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6809","nonce":1880491675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6811","nonce":1880491675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6815","nonce":1880491675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6813","nonce":1880491675}]},"public_addr":"172.21.15.190:6809/1880491675","cluster_addr":"172.21.15.190:6811/1880491675","heartbeat_back_addr":"172.21.15.190:6815/1880491675","heartbeat_front_addr":"172.21.15.190:6813/1880491675","state":["exists","up"]},{"osd":6,"uuid":"4e047963-afa7-4934-b887-8086165fb831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6819","nonce":1743435653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6821","nonce":1743435653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6825","nonce":1743435653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6823","nonce":1743435653}]},"public_addr":"172.21.15.92:6819/1743435653","cluster_addr":"172.21.15.92:6821/1743435653","heartbeat_back_addr":"172.21.15.92:6825/1743435653","heartbeat_front_addr":"172.21.15.92:6823/1743435653","state":["exists","up"]},{"osd":7,"uuid":"652a6aa1-bb94-4608-952e-67cd02bdff66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6817","nonce":2984111963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6819","nonce":2984111963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6823","nonce":2984111963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6821","nonce":2984111963}]},"public_addr":"172.21.15.167:6817/2984111963","cluster_addr":"172.21.15.167:6819/2984111963","heartbeat_back_addr":"172.21.15.167:6823/2984111963","heartbeat_front_addr":"172.21.15.167:6821/2984111963","state":["exists","up"]},{"osd":8,"uuid":"1510ef1f-fdfe-4887-a771-146efce062fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6817","nonce":4190304434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6819","nonce":4190304434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6823","nonce":4190304434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6821","nonce":4190304434}]},"public_addr":"172.21.15.190:6817/4190304434","cluster_addr":"172.21.15.190:6819/4190304434","heartbeat_back_addr":"172.21.15.190:6823/4190304434","heartbeat_front_addr":"172.21.15.190:6821/4190304434","state":["exists","up"]},{"osd":9,"uuid":"9b774bbe-6700-4020-900b-3fdbaa546773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6827","nonce":3066744542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6829","nonce":3066744542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6833","nonce":3066744542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6831","nonce":3066744542}]},"public_addr":"172.21.15.92:6827/3066744542","cluster_addr":"172.21.15.92:6829/3066744542","heartbeat_back_addr":"172.21.15.92:6833/3066744542","heartbeat_front_addr":"172.21.15.92:6831/3066744542","state":["exists","up"]},{"osd":10,"uuid":"8abdb835-db2c-4597-ae1d-8ef56e63ab6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6825","nonce":2309134313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6827","nonce":2309134313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6831","nonce":2309134313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6829","nonce":2309134313}]},"public_addr":"172.21.15.167:6825/2309134313","cluster_addr":"172.21.15.167:6827/2309134313","heartbeat_back_addr":"172.21.15.167:6831/2309134313","heartbeat_front_addr":"172.21.15.167:6829/2309134313","state":["exists","up"]},{"osd":11,"uuid":"564c844a-378f-40cd-9717-cde35a65631c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6825","nonce":1849208751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6827","nonce":1849208751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6831","nonce":1849208751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6829","nonce":1849208751}]},"public_addr":"172.21.15.190:6825/1849208751","cluster_addr":"172.21.15.190:6827/1849208751","heartbeat_back_addr":"172.21.15.190:6831/1849208751","heartbeat_front_addr":"172.21.15.190:6829/1849208751","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:12.072109+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:36.689174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:01.908763+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:26.857439+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:50.881629+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:51:15.160744+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:51:39.101605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:03.179877+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:27.324563+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:51.971287+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:53:15.917311+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:53:40.592486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/2948821221":"2024-09-20T08:47:52.180093+0000","172.21.15.92:0/1441365956":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6801/2908709470":"2024-09-20T08:47:52.180093+0000","172.21.15.92:0/608374871":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6801/1369295034":"2024-09-20T08:47:29.812397+0000","172.21.15.92:6800/2908709470":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6800/1369295034":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/813486656":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/1963725565":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/1668504617":"2024-09-20T08:47:29.812397+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:56:11.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.363+0000 7f3df66d2640 1 -- 172.21.15.92:0/2985695982 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3dd80a32d0 msgr2=0x7f3dd80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:11.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.363+0000 7f3df66d2640 1 --2- 172.21.15.92:0/2985695982 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3dd80a32d0 0x7f3dd80a5790 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3df0101a80 tx=0x7f3de0008040 comp rx=0 tx=0).stop 2024-09-19T08:56:11.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.363+0000 7f3df66d2640 1 -- 172.21.15.92:0/2985695982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3df01025e0 msgr2=0x7f3df019f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:11.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.363+0000 7f3df66d2640 1 --2- 172.21.15.92:0/2985695982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3df01025e0 0x7f3df019f2f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3de800b970 tx=0x7f3de800be30 comp rx=0 tx=0).stop 2024-09-19T08:56:11.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.363+0000 7f3df66d2640 1 -- 172.21.15.92:0/2985695982 shutdown_connections 2024-09-19T08:56:11.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.363+0000 7f3df66d2640 1 --2- 172.21.15.92:0/2985695982 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3dd80a32d0 0x7f3dd80a5790 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.363+0000 7f3df66d2640 1 --2- 172.21.15.92:0/2985695982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3df01025e0 0x7f3df019f2f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.363+0000 7f3df66d2640 1 --2- 172.21.15.92:0/2985695982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3df0101c20 0x7f3df019cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.363+0000 7f3df66d2640 1 --2- 172.21.15.92:0/2985695982 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3df0100a30 0x7f3df006af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.363+0000 7f3df66d2640 1 -- 172.21.15.92:0/2985695982 >> 172.21.15.92:0/2985695982 conn(0x7f3df00fc1b0 msgr2=0x7f3df0105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:11.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.363+0000 7f3df66d2640 1 -- 172.21.15.92:0/2985695982 shutdown_connections 2024-09-19T08:56:11.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.363+0000 7f3df66d2640 1 -- 172.21.15.92:0/2985695982 wait complete. 2024-09-19T08:56:11.374 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T08:50:04.482034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T08:54:28.005336+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T08:54:30.188980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T08:56:11.374 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T08:56:11.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.477+0000 7fb3c72e4640 1 -- 172.21.15.92:0/3706074468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3c0107880 msgr2=0x7fb3c0109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:11.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.477+0000 7fb3c72e4640 1 --2- 172.21.15.92:0/3706074468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3c0107880 0x7fb3c0109c70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8009900 tx=0x7fb3b802a410 comp rx=0 tx=0).stop 2024-09-19T08:56:11.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.477+0000 7fb3c72e4640 1 -- 172.21.15.92:0/3706074468 shutdown_connections 2024-09-19T08:56:11.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.477+0000 7fb3c72e4640 1 --2- 172.21.15.92:0/3706074468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3c0107880 0x7fb3c0109c70 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.477+0000 7fb3c72e4640 1 --2- 172.21.15.92:0/3706074468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3c0104f50 0x7fb3c0107340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.477+0000 7fb3c72e4640 1 --2- 172.21.15.92:0/3706074468 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3c0102620 0x7fb3c0104a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.477+0000 7fb3c72e4640 1 -- 172.21.15.92:0/3706074468 >> 172.21.15.92:0/3706074468 conn(0x7fb3c00fc140 msgr2=0x7fb3c00fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:11.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.477+0000 7fb3c72e4640 1 -- 172.21.15.92:0/3706074468 shutdown_connections 2024-09-19T08:56:11.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.477+0000 7fb3c72e4640 1 -- 172.21.15.92:0/3706074468 wait complete. 2024-09-19T08:56:11.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.478+0000 7fb3c72e4640 1 Processor -- start 2024-09-19T08:56:11.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.478+0000 7fb3c72e4640 1 -- start start 2024-09-19T08:56:11.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.478+0000 7fb3c72e4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3c0102620 0x7fb3c0197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:11.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.478+0000 7fb3c72e4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3c0104f50 0x7fb3c01983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:11.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.478+0000 7fb3c72e4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3c0107880 0x7fb3c019f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:11.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.478+0000 7fb3c72e4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c010d7c0 con 0x7fb3c0104f50 2024-09-19T08:56:11.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.478+0000 7fb3c72e4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c010d640 con 0x7fb3c0102620 2024-09-19T08:56:11.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.478+0000 7fb3c72e4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c010d940 con 0x7fb3c0107880 2024-09-19T08:56:11.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.478+0000 7fb3c487f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3c0104f50 0x7fb3c01983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:11.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.478+0000 7fb3c487f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3c0104f50 0x7fb3c01983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50236/0 (socket says 172.21.15.92:50236) 2024-09-19T08:56:11.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.478+0000 7fb3c487f640 1 -- 172.21.15.92:0/3016489745 learned_addr learned my addr 172.21.15.92:0/3016489745 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:11.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.478+0000 7fb3c5881640 1 --2- 172.21.15.92:0/3016489745 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3c0107880 0x7fb3c019f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:11.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.479+0000 7fb3c5080640 1 --2- 172.21.15.92:0/3016489745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3c0102620 0x7fb3c0197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:11.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.479+0000 7fb3c487f640 1 -- 172.21.15.92:0/3016489745 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3c0107880 msgr2=0x7fb3c019f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:11.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.479+0000 7fb3c487f640 1 --2- 172.21.15.92:0/3016489745 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3c0107880 0x7fb3c019f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.479+0000 7fb3c487f640 1 -- 172.21.15.92:0/3016489745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3c0102620 msgr2=0x7fb3c0197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:11.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.479+0000 7fb3c487f640 1 --2- 172.21.15.92:0/3016489745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3c0102620 0x7fb3c0197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.479+0000 7fb3c487f640 1 -- 172.21.15.92:0/3016489745 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3c019fac0 con 0x7fb3c0104f50 2024-09-19T08:56:11.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.479+0000 7fb3c5080640 1 --2- 172.21.15.92:0/3016489745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3c0102620 0x7fb3c0197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:56:11.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.479+0000 7fb3c487f640 1 --2- 172.21.15.92:0/3016489745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3c0104f50 0x7fb3c01983e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb3b400d770 tx=0x7fb3b400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:11.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.479+0000 7fb3be7fc640 1 -- 172.21.15.92:0/3016489745 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b4017070 con 0x7fb3c0104f50 2024-09-19T08:56:11.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.479+0000 7fb3be7fc640 1 -- 172.21.15.92:0/3016489745 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3b4009c30 con 0x7fb3c0104f50 2024-09-19T08:56:11.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.479+0000 7fb3be7fc640 1 -- 172.21.15.92:0/3016489745 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b400f620 con 0x7fb3c0104f50 2024-09-19T08:56:11.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.479+0000 7fb3c72e4640 1 -- 172.21.15.92:0/3016489745 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3c019fdb0 con 0x7fb3c0104f50 2024-09-19T08:56:11.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.479+0000 7fb3c72e4640 1 -- 172.21.15.92:0/3016489745 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3c01a0220 con 0x7fb3c0104f50 2024-09-19T08:56:11.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.480+0000 7fb3c72e4640 1 -- 172.21.15.92:0/3016489745 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3c00fdc30 con 0x7fb3c0104f50 2024-09-19T08:56:11.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.481+0000 7fb3be7fc640 1 -- 172.21.15.92:0/3016489745 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb3b401a070 con 0x7fb3c0104f50 2024-09-19T08:56:11.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.482+0000 7fb3be7fc640 1 --2- 172.21.15.92:0/3016489745 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb3a80a3250 0x7fb3a80a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:11.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.482+0000 7fb3be7fc640 1 -- 172.21.15.92:0/3016489745 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb3b40cf470 con 0x7fb3c0104f50 2024-09-19T08:56:11.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.482+0000 7fb3c5080640 1 --2- 172.21.15.92:0/3016489745 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb3a80a3250 0x7fb3a80a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:11.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.482+0000 7fb3c5080640 1 --2- 172.21.15.92:0/3016489745 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb3a80a3250 0x7fb3a80a5710 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0005fd0 tx=0x7fb3b00093e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:11.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.485+0000 7fb3be7fc640 1 -- 172.21.15.92:0/3016489745 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb3b4009de0 con 0x7fb3c0104f50 2024-09-19T08:56:11.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.654+0000 7fb3c72e4640 1 -- 172.21.15.92:0/3016489745 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb3c002da10 con 0x7fb3c0104f50 2024-09-19T08:56:11.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.654+0000 7fb3be7fc640 1 -- 172.21.15.92:0/3016489745 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7fb3b409c190 con 0x7fb3c0104f50 2024-09-19T08:56:11.654 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2024-09-19T08:56:11.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.657+0000 7fb3c72e4640 1 -- 172.21.15.92:0/3016489745 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb3a80a3250 msgr2=0x7fb3a80a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:11.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.657+0000 7fb3c72e4640 1 --2- 172.21.15.92:0/3016489745 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb3a80a3250 0x7fb3a80a5710 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0005fd0 tx=0x7fb3b00093e0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.657+0000 7fb3c72e4640 1 -- 172.21.15.92:0/3016489745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3c0104f50 msgr2=0x7fb3c01983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:11.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.657+0000 7fb3c72e4640 1 --2- 172.21.15.92:0/3016489745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3c0104f50 0x7fb3c01983e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb3b400d770 tx=0x7fb3b400dc30 comp rx=0 tx=0).stop 2024-09-19T08:56:11.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.657+0000 7fb3c72e4640 1 -- 172.21.15.92:0/3016489745 shutdown_connections 2024-09-19T08:56:11.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.657+0000 7fb3c72e4640 1 --2- 172.21.15.92:0/3016489745 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3c0107880 0x7fb3c019f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.657+0000 7fb3c72e4640 1 --2- 172.21.15.92:0/3016489745 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb3a80a3250 0x7fb3a80a5710 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.657+0000 7fb3c72e4640 1 --2- 172.21.15.92:0/3016489745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3c0104f50 0x7fb3c01983e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.657+0000 7fb3c72e4640 1 --2- 172.21.15.92:0/3016489745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3c0102620 0x7fb3c0197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.657+0000 7fb3c72e4640 1 -- 172.21.15.92:0/3016489745 >> 172.21.15.92:0/3016489745 conn(0x7fb3c00fc140 msgr2=0x7fb3c0103000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:11.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.657+0000 7fb3c72e4640 1 -- 172.21.15.92:0/3016489745 shutdown_connections 2024-09-19T08:56:11.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.657+0000 7fb3c72e4640 1 -- 172.21.15.92:0/3016489745 wait complete. 2024-09-19T08:56:11.666 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:11 smithi092 ceph-mon[31407]: pgmap v321: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:56:11.666 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:11 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/2985695982' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:56:11.667 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T08:56:11.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.769+0000 7f06f6568640 1 -- 172.21.15.92:0/1512814833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06f00ffbc0 msgr2=0x7f06f0100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:11.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.769+0000 7f06f6568640 1 --2- 172.21.15.92:0/1512814833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06f00ffbc0 0x7f06f0100040 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f06d8009900 tx=0x7f06d802a410 comp rx=0 tx=0).stop 2024-09-19T08:56:11.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.769+0000 7f06f6568640 1 -- 172.21.15.92:0/1512814833 shutdown_connections 2024-09-19T08:56:11.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.769+0000 7f06f6568640 1 --2- 172.21.15.92:0/1512814833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06f0100580 0x7f06f010a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.769+0000 7f06f6568640 1 --2- 172.21.15.92:0/1512814833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06f00ffbc0 0x7f06f0100040 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.769+0000 7f06f6568640 1 --2- 172.21.15.92:0/1512814833 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06f0103150 0x7f06f0103550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.769+0000 7f06f6568640 1 -- 172.21.15.92:0/1512814833 >> 172.21.15.92:0/1512814833 conn(0x7f06f00fb910 msgr2=0x7f06f00fdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:11.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.769+0000 7f06f6568640 1 -- 172.21.15.92:0/1512814833 shutdown_connections 2024-09-19T08:56:11.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.769+0000 7f06f6568640 1 -- 172.21.15.92:0/1512814833 wait complete. 2024-09-19T08:56:11.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.770+0000 7f06f6568640 1 Processor -- start 2024-09-19T08:56:11.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.770+0000 7f06f6568640 1 -- start start 2024-09-19T08:56:11.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.770+0000 7f06f6568640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06f00ffbc0 0x7f06f0197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:11.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.770+0000 7f06f6568640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06f0100580 0x7f06f01983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:11.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.770+0000 7f06f6568640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06f0103150 0x7f06f019f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:11.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.770+0000 7f06f6568640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f06f010d7a0 con 0x7f06f00ffbc0 2024-09-19T08:56:11.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.770+0000 7f06f6568640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f06f010d620 con 0x7f06f0100580 2024-09-19T08:56:11.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.770+0000 7f06f6568640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f06f010d920 con 0x7f06f0103150 2024-09-19T08:56:11.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.770+0000 7f06effff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06f00ffbc0 0x7f06f0197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:11.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.770+0000 7f06effff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06f00ffbc0 0x7f06f0197e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50258/0 (socket says 172.21.15.92:50258) 2024-09-19T08:56:11.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.770+0000 7f06effff640 1 -- 172.21.15.92:0/1619926733 learned_addr learned my addr 172.21.15.92:0/1619926733 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:11.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.770+0000 7f06effff640 1 -- 172.21.15.92:0/1619926733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06f0103150 msgr2=0x7f06f019f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:11.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.770+0000 7f06effff640 1 --2- 172.21.15.92:0/1619926733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06f0103150 0x7f06f019f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.770+0000 7f06effff640 1 -- 172.21.15.92:0/1619926733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06f0100580 msgr2=0x7f06f01983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:11.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.770+0000 7f06e7fff640 1 --2- 172.21.15.92:0/1619926733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06f0100580 0x7f06f01983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:11.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.770+0000 7f06effff640 1 --2- 172.21.15.92:0/1619926733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06f0100580 0x7f06f01983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.770+0000 7f06effff640 1 -- 172.21.15.92:0/1619926733 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f019faa0 con 0x7f06f00ffbc0 2024-09-19T08:56:11.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.771+0000 7f06effff640 1 --2- 172.21.15.92:0/1619926733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06f00ffbc0 0x7f06f0197e80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f06e000c970 tx=0x7f06e000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:11.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.771+0000 7f06edffb640 1 -- 172.21.15.92:0/1619926733 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e0004220 con 0x7f06f00ffbc0 2024-09-19T08:56:11.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.771+0000 7f06f6568640 1 -- 172.21.15.92:0/1619926733 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06f019fd90 con 0x7f06f00ffbc0 2024-09-19T08:56:11.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.771+0000 7f06edffb640 1 -- 172.21.15.92:0/1619926733 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06e00043c0 con 0x7f06f00ffbc0 2024-09-19T08:56:11.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.771+0000 7f06edffb640 1 -- 172.21.15.92:0/1619926733 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e000f450 con 0x7f06f00ffbc0 2024-09-19T08:56:11.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.771+0000 7f06f6568640 1 -- 172.21.15.92:0/1619926733 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06f01a0260 con 0x7f06f00ffbc0 2024-09-19T08:56:11.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.772+0000 7f06f6568640 1 -- 172.21.15.92:0/1619926733 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06f01090e0 con 0x7f06f00ffbc0 2024-09-19T08:56:11.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.773+0000 7f06edffb640 1 -- 172.21.15.92:0/1619926733 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f06e00079b0 con 0x7f06f00ffbc0 2024-09-19T08:56:11.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.773+0000 7f06edffb640 1 --2- 172.21.15.92:0/1619926733 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f06dc0a3250 0x7f06dc0a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:11.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.774+0000 7f06e7fff640 1 --2- 172.21.15.92:0/1619926733 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f06dc0a3250 0x7f06dc0a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:11.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.774+0000 7f06edffb640 1 -- 172.21.15.92:0/1619926733 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f06e00cfb80 con 0x7f06f00ffbc0 2024-09-19T08:56:11.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.774+0000 7f06e7fff640 1 --2- 172.21.15.92:0/1619926733 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f06dc0a3250 0x7f06dc0a5710 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f06d8031610 tx=0x7f06d8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:11.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.777+0000 7f06edffb640 1 -- 172.21.15.92:0/1619926733 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f06e0014030 con 0x7f06f00ffbc0 2024-09-19T08:56:11.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:11 smithi167 ceph-mon[35359]: pgmap v321: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:56:11.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:11 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/2985695982' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:56:11.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:11 smithi190 ceph-mon[35358]: pgmap v321: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:56:11.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:11 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/2985695982' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:56:11.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.942+0000 7f06f6568640 1 -- 172.21.15.92:0/1619926733 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f06f002da20 con 0x7f06f00ffbc0 2024-09-19T08:56:11.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.942+0000 7f06edffb640 1 -- 172.21.15.92:0/1619926733 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) ==== 104+0+11 (secure 0 0 0) 0x7f06e009c8a0 con 0x7f06f00ffbc0 2024-09-19T08:56:11.942 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 32 2024-09-19T08:56:11.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.945+0000 7f06f6568640 1 -- 172.21.15.92:0/1619926733 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f06dc0a3250 msgr2=0x7f06dc0a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:11.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.945+0000 7f06f6568640 1 --2- 172.21.15.92:0/1619926733 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f06dc0a3250 0x7f06dc0a5710 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f06d8031610 tx=0x7f06d8000bc0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.945+0000 7f06f6568640 1 -- 172.21.15.92:0/1619926733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06f00ffbc0 msgr2=0x7f06f0197e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:11.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.945+0000 7f06f6568640 1 --2- 172.21.15.92:0/1619926733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06f00ffbc0 0x7f06f0197e80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f06e000c970 tx=0x7f06e000ce30 comp rx=0 tx=0).stop 2024-09-19T08:56:11.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.945+0000 7f06f6568640 1 -- 172.21.15.92:0/1619926733 shutdown_connections 2024-09-19T08:56:11.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.945+0000 7f06f6568640 1 --2- 172.21.15.92:0/1619926733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06f0103150 0x7f06f019f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.945+0000 7f06f6568640 1 --2- 172.21.15.92:0/1619926733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06f0100580 0x7f06f01983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.945+0000 7f06f6568640 1 --2- 172.21.15.92:0/1619926733 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f06dc0a3250 0x7f06dc0a5710 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.945+0000 7f06f6568640 1 --2- 172.21.15.92:0/1619926733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06f00ffbc0 0x7f06f0197e80 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.945+0000 7f06f6568640 1 -- 172.21.15.92:0/1619926733 >> 172.21.15.92:0/1619926733 conn(0x7f06f00fb910 msgr2=0x7f06f01062b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:11.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.945+0000 7f06f6568640 1 -- 172.21.15.92:0/1619926733 shutdown_connections 2024-09-19T08:56:11.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:11.945+0000 7f06f6568640 1 -- 172.21.15.92:0/1619926733 wait complete. 2024-09-19T08:56:11.955 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T08:56:12.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.057+0000 7f45a3ac9640 1 -- 172.21.15.92:0/2500624461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f459c101c00 msgr2=0x7f459c102080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:12.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.057+0000 7f45a3ac9640 1 --2- 172.21.15.92:0/2500624461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f459c101c00 0x7f459c102080 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f458c009900 tx=0x7f458c02a410 comp rx=0 tx=0).stop 2024-09-19T08:56:12.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.057+0000 7f45a3ac9640 1 -- 172.21.15.92:0/2500624461 shutdown_connections 2024-09-19T08:56:12.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.057+0000 7f45a3ac9640 1 --2- 172.21.15.92:0/2500624461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f459c1025c0 0x7f459c108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:12.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.057+0000 7f45a3ac9640 1 --2- 172.21.15.92:0/2500624461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f459c101c00 0x7f459c102080 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:12.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.057+0000 7f45a3ac9640 1 --2- 172.21.15.92:0/2500624461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f459c100a10 0x7f459c100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:12.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.057+0000 7f45a3ac9640 1 -- 172.21.15.92:0/2500624461 >> 172.21.15.92:0/2500624461 conn(0x7f459c0fc1b0 msgr2=0x7f459c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:12.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.057+0000 7f45a3ac9640 1 -- 172.21.15.92:0/2500624461 shutdown_connections 2024-09-19T08:56:12.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.057+0000 7f45a3ac9640 1 -- 172.21.15.92:0/2500624461 wait complete. 2024-09-19T08:56:12.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.058+0000 7f45a3ac9640 1 Processor -- start 2024-09-19T08:56:12.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.058+0000 7f45a3ac9640 1 -- start start 2024-09-19T08:56:12.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.058+0000 7f45a3ac9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f459c100a10 0x7f459c104b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:12.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.058+0000 7f45a3ac9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f459c101c00 0x7f459c103170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:12.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.058+0000 7f45a3ac9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f459c1025c0 0x7f459c1036b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:12.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.058+0000 7f45a3ac9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f459c10c670 con 0x7f459c100a10 2024-09-19T08:56:12.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.058+0000 7f45a3ac9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f459c10c4f0 con 0x7f459c1025c0 2024-09-19T08:56:12.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.058+0000 7f45a3ac9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f459c10c7f0 con 0x7f459c101c00 2024-09-19T08:56:12.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.058+0000 7f45a1865640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f459c100a10 0x7f459c104b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:12.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.058+0000 7f45a1865640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f459c100a10 0x7f459c104b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50278/0 (socket says 172.21.15.92:50278) 2024-09-19T08:56:12.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.058+0000 7f45a1865640 1 -- 172.21.15.92:0/1881459320 learned_addr learned my addr 172.21.15.92:0/1881459320 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:12.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.058+0000 7f45a2066640 1 --2- 172.21.15.92:0/1881459320 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f459c1025c0 0x7f459c1036b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:12.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.058+0000 7f45a1064640 1 --2- 172.21.15.92:0/1881459320 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f459c101c00 0x7f459c103170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:12.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.058+0000 7f45a1865640 1 -- 172.21.15.92:0/1881459320 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f459c101c00 msgr2=0x7f459c103170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:12.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.058+0000 7f45a1865640 1 --2- 172.21.15.92:0/1881459320 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f459c101c00 0x7f459c103170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:12.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.058+0000 7f45a1865640 1 -- 172.21.15.92:0/1881459320 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f459c1025c0 msgr2=0x7f459c1036b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:12.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.058+0000 7f45a1865640 1 --2- 172.21.15.92:0/1881459320 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f459c1025c0 0x7f459c1036b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:12.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.058+0000 7f45a1865640 1 -- 172.21.15.92:0/1881459320 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f459c103f40 con 0x7f459c100a10 2024-09-19T08:56:12.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.058+0000 7f45a2066640 1 --2- 172.21.15.92:0/1881459320 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f459c1025c0 0x7f459c1036b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:12.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.058+0000 7f45a1865640 1 --2- 172.21.15.92:0/1881459320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f459c100a10 0x7f459c104b30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f459800c970 tx=0x7f459800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:12.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.058+0000 7f4592ffd640 1 -- 172.21.15.92:0/1881459320 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4598007c10 con 0x7f459c100a10 2024-09-19T08:56:12.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.059+0000 7f4592ffd640 1 -- 172.21.15.92:0/1881459320 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4598007db0 con 0x7f459c100a10 2024-09-19T08:56:12.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.059+0000 7f45a3ac9640 1 -- 172.21.15.92:0/1881459320 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f459c1a1ee0 con 0x7f459c100a10 2024-09-19T08:56:12.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.059+0000 7f4592ffd640 1 -- 172.21.15.92:0/1881459320 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459800f940 con 0x7f459c100a10 2024-09-19T08:56:12.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.059+0000 7f45a3ac9640 1 -- 172.21.15.92:0/1881459320 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f459c1a2340 con 0x7f459c100a10 2024-09-19T08:56:12.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.059+0000 7f45a3ac9640 1 -- 172.21.15.92:0/1881459320 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f459c1a2630 con 0x7f459c100a10 2024-09-19T08:56:12.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.061+0000 7f4592ffd640 1 -- 172.21.15.92:0/1881459320 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f459800fae0 con 0x7f459c100a10 2024-09-19T08:56:12.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.062+0000 7f4592ffd640 1 --2- 172.21.15.92:0/1881459320 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f45880a32d0 0x7f45880a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:12.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.062+0000 7f45a1064640 1 --2- 172.21.15.92:0/1881459320 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f45880a32d0 0x7f45880a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:12.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.062+0000 7f4592ffd640 1 -- 172.21.15.92:0/1881459320 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f45980cffa0 con 0x7f459c100a10 2024-09-19T08:56:12.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.062+0000 7f45a1064640 1 --2- 172.21.15.92:0/1881459320 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f45880a32d0 0x7f45880a5790 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f458c000c00 tx=0x7f458c0315d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:12.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.065+0000 7f4592ffd640 1 -- 172.21.15.92:0/1881459320 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f459809cde0 con 0x7f459c100a10 2024-09-19T08:56:12.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.236+0000 7f45a3ac9640 1 -- 172.21.15.92:0/1881459320 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f459c1088e0 con 0x7f459c100a10 2024-09-19T08:56:12.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.237+0000 7f4592ffd640 1 -- 172.21.15.92:0/1881459320 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) ==== 100+0+11 (secure 0 0 0) 0x7f459809c6e0 con 0x7f459c100a10 2024-09-19T08:56:12.237 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 64 2024-09-19T08:56:12.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.239+0000 7f45a3ac9640 1 -- 172.21.15.92:0/1881459320 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f45880a32d0 msgr2=0x7f45880a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:12.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.239+0000 7f45a3ac9640 1 --2- 172.21.15.92:0/1881459320 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f45880a32d0 0x7f45880a5790 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f458c000c00 tx=0x7f458c0315d0 comp rx=0 tx=0).stop 2024-09-19T08:56:12.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.239+0000 7f45a3ac9640 1 -- 172.21.15.92:0/1881459320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f459c100a10 msgr2=0x7f459c104b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:12.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.239+0000 7f45a3ac9640 1 --2- 172.21.15.92:0/1881459320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f459c100a10 0x7f459c104b30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f459800c970 tx=0x7f459800ce30 comp rx=0 tx=0).stop 2024-09-19T08:56:12.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.239+0000 7f45a3ac9640 1 -- 172.21.15.92:0/1881459320 shutdown_connections 2024-09-19T08:56:12.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.239+0000 7f45a3ac9640 1 --2- 172.21.15.92:0/1881459320 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f459c1025c0 0x7f459c1036b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:12.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.239+0000 7f45a3ac9640 1 --2- 172.21.15.92:0/1881459320 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f459c101c00 0x7f459c103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:12.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.239+0000 7f45a3ac9640 1 --2- 172.21.15.92:0/1881459320 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f45880a32d0 0x7f45880a5790 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:12.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.239+0000 7f45a3ac9640 1 --2- 172.21.15.92:0/1881459320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f459c100a10 0x7f459c104b30 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:12.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.239+0000 7f45a3ac9640 1 -- 172.21.15.92:0/1881459320 >> 172.21.15.92:0/1881459320 conn(0x7f459c0fc1b0 msgr2=0x7f459c0fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:12.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.239+0000 7f45a3ac9640 1 -- 172.21.15.92:0/1881459320 shutdown_connections 2024-09-19T08:56:12.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.239+0000 7f45a3ac9640 1 -- 172.21.15.92:0/1881459320 wait complete. 2024-09-19T08:56:12.249 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-19T08:56:12.249 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:56:12.499 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:12.502 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:12 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3016489745' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:56:12.502 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:12 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1619926733' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T08:56:12.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:12 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1881459320' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T08:56:12.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:12 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3016489745' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:56:12.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:12 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/1619926733' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T08:56:12.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:12 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/1881459320' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T08:56:12.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:12 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3016489745' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:56:12.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:12 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/1619926733' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T08:56:12.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:12 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/1881459320' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T08:56:12.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.926+0000 7fd8028a3640 1 -- 172.21.15.92:0/1715065163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7fc100e20 msgr2=0x7fd7fc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:12.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.926+0000 7fd8028a3640 1 --2- 172.21.15.92:0/1715065163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7fc100e20 0x7fd7fc101200 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec009900 tx=0x7fd7ec02a480 comp rx=0 tx=0).stop 2024-09-19T08:56:12.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.926+0000 7fd8028a3640 1 -- 172.21.15.92:0/1715065163 shutdown_connections 2024-09-19T08:56:12.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.926+0000 7fd8028a3640 1 --2- 172.21.15.92:0/1715065163 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7fc102ef0 0x7fd7fc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:12.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.926+0000 7fd8028a3640 1 --2- 172.21.15.92:0/1715065163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd7fc102570 0x7fd7fc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:12.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.926+0000 7fd8028a3640 1 --2- 172.21.15.92:0/1715065163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7fc100e20 0x7fd7fc101200 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:12.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.926+0000 7fd8028a3640 1 -- 172.21.15.92:0/1715065163 >> 172.21.15.92:0/1715065163 conn(0x7fd7fc0fc7d0 msgr2=0x7fd7fc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:12.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.926+0000 7fd8028a3640 1 -- 172.21.15.92:0/1715065163 shutdown_connections 2024-09-19T08:56:12.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.926+0000 7fd8028a3640 1 -- 172.21.15.92:0/1715065163 wait complete. 2024-09-19T08:56:12.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.927+0000 7fd8028a3640 1 Processor -- start 2024-09-19T08:56:12.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.927+0000 7fd8028a3640 1 -- start start 2024-09-19T08:56:12.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.927+0000 7fd8028a3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd7fc100e20 0x7fd7fc19a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:12.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.927+0000 7fd8028a3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7fc102570 0x7fd7fc19abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:12.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.927+0000 7fd8028a3640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7fc102ef0 0x7fd7fc19ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:12.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.927+0000 7fd8028a3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd7fc110ff0 con 0x7fd7fc102570 2024-09-19T08:56:12.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.927+0000 7fd8028a3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd7fc110e70 con 0x7fd7fc100e20 2024-09-19T08:56:12.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.927+0000 7fd8028a3640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd7fc111170 con 0x7fd7fc102ef0 2024-09-19T08:56:12.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.927+0000 7fd7f3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7fc102570 0x7fd7fc19abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:12.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.927+0000 7fd7f3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7fc102570 0x7fd7fc19abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50288/0 (socket says 172.21.15.92:50288) 2024-09-19T08:56:12.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.927+0000 7fd7f3fff640 1 -- 172.21.15.92:0/3211814489 learned_addr learned my addr 172.21.15.92:0/3211814489 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:12.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.927+0000 7fd7fbfff640 1 --2- 172.21.15.92:0/3211814489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd7fc100e20 0x7fd7fc19a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:12.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.927+0000 7fd800e40640 1 --2- 172.21.15.92:0/3211814489 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7fc102ef0 0x7fd7fc19ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:12.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.927+0000 7fd7f3fff640 1 -- 172.21.15.92:0/3211814489 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7fc102ef0 msgr2=0x7fd7fc19ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:12.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.927+0000 7fd7f3fff640 1 --2- 172.21.15.92:0/3211814489 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7fc102ef0 0x7fd7fc19ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:12.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.927+0000 7fd7f3fff640 1 -- 172.21.15.92:0/3211814489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd7fc100e20 msgr2=0x7fd7fc19a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:12.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.927+0000 7fd7f3fff640 1 --2- 172.21.15.92:0/3211814489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd7fc100e20 0x7fd7fc19a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:12.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.927+0000 7fd7f3fff640 1 -- 172.21.15.92:0/3211814489 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7fc19f660 con 0x7fd7fc102570 2024-09-19T08:56:12.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.927+0000 7fd800e40640 1 --2- 172.21.15.92:0/3211814489 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7fc102ef0 0x7fd7fc19ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:56:12.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.928+0000 7fd7f3fff640 1 --2- 172.21.15.92:0/3211814489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7fc102570 0x7fd7fc19abf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd7e400c920 tx=0x7fd7e400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:12.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.928+0000 7fd7f9ffb640 1 -- 172.21.15.92:0/3211814489 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e4007c70 con 0x7fd7fc102570 2024-09-19T08:56:12.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.928+0000 7fd7f9ffb640 1 -- 172.21.15.92:0/3211814489 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7e4007e10 con 0x7fd7fc102570 2024-09-19T08:56:12.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.928+0000 7fd7f9ffb640 1 -- 172.21.15.92:0/3211814489 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e4018890 con 0x7fd7fc102570 2024-09-19T08:56:12.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.928+0000 7fd8028a3640 1 -- 172.21.15.92:0/3211814489 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7fc19f950 con 0x7fd7fc102570 2024-09-19T08:56:12.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.928+0000 7fd8028a3640 1 -- 172.21.15.92:0/3211814489 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7fc1a7230 con 0x7fd7fc102570 2024-09-19T08:56:12.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.929+0000 7fd8028a3640 1 -- 172.21.15.92:0/3211814489 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7fc101200 con 0x7fd7fc102570 2024-09-19T08:56:12.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.930+0000 7fd7f9ffb640 1 -- 172.21.15.92:0/3211814489 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd7e4018a70 con 0x7fd7fc102570 2024-09-19T08:56:12.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.931+0000 7fd7f9ffb640 1 --2- 172.21.15.92:0/3211814489 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd7e80a3240 0x7fd7e80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:12.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.931+0000 7fd7fbfff640 1 --2- 172.21.15.92:0/3211814489 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd7e80a3240 0x7fd7e80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:12.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.931+0000 7fd7f9ffb640 1 -- 172.21.15.92:0/3211814489 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd7e40cfa60 con 0x7fd7fc102570 2024-09-19T08:56:12.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.931+0000 7fd7fbfff640 1 --2- 172.21.15.92:0/3211814489 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd7e80a3240 0x7fd7e80a5700 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec000c00 tx=0x7fd7ec005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:12.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:12.935+0000 7fd7f9ffb640 1 -- 172.21.15.92:0/3211814489 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd7e4014030 con 0x7fd7fc102570 2024-09-19T08:56:13.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:13.133+0000 7fd8028a3640 1 -- 172.21.15.92:0/3211814489 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7fc1a74c0 con 0x7fd7fc102570 2024-09-19T08:56:13.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:13.133+0000 7fd7f9ffb640 1 -- 172.21.15.92:0/3211814489 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7fd7e409c780 con 0x7fd7fc102570 2024-09-19T08:56:13.133 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:13.134 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T08:56:13.134 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T08:56:13.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:13.135+0000 7fd8028a3640 1 -- 172.21.15.92:0/3211814489 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd7e80a3240 msgr2=0x7fd7e80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:13.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:13.135+0000 7fd8028a3640 1 --2- 172.21.15.92:0/3211814489 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd7e80a3240 0x7fd7e80a5700 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec000c00 tx=0x7fd7ec005e50 comp rx=0 tx=0).stop 2024-09-19T08:56:13.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:13.136+0000 7fd8028a3640 1 -- 172.21.15.92:0/3211814489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7fc102570 msgr2=0x7fd7fc19abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:13.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:13.136+0000 7fd8028a3640 1 --2- 172.21.15.92:0/3211814489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7fc102570 0x7fd7fc19abf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd7e400c920 tx=0x7fd7e400cde0 comp rx=0 tx=0).stop 2024-09-19T08:56:13.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:13.136+0000 7fd8028a3640 1 -- 172.21.15.92:0/3211814489 shutdown_connections 2024-09-19T08:56:13.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:13.136+0000 7fd8028a3640 1 --2- 172.21.15.92:0/3211814489 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7fc102ef0 0x7fd7fc19ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:13.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:13.136+0000 7fd8028a3640 1 --2- 172.21.15.92:0/3211814489 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd7e80a3240 0x7fd7e80a5700 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:13.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:13.136+0000 7fd8028a3640 1 --2- 172.21.15.92:0/3211814489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7fc102570 0x7fd7fc19abf0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:13.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:13.136+0000 7fd8028a3640 1 --2- 172.21.15.92:0/3211814489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd7fc100e20 0x7fd7fc19a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:13.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:13.136+0000 7fd8028a3640 1 -- 172.21.15.92:0/3211814489 >> 172.21.15.92:0/3211814489 conn(0x7fd7fc0fc7d0 msgr2=0x7fd7fc06a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:13.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:13.136+0000 7fd8028a3640 1 -- 172.21.15.92:0/3211814489 shutdown_connections 2024-09-19T08:56:13.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:13.136+0000 7fd8028a3640 1 -- 172.21.15.92:0/3211814489 wait complete. 2024-09-19T08:56:13.621 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:13 smithi092 ceph-mon[31407]: pgmap v322: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:56:13.621 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:13 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3211814489' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:56:13.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:13 smithi167 ceph-mon[35359]: pgmap v322: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:56:13.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:13 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3211814489' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:56:13.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:13 smithi190 ceph-mon[35358]: pgmap v322: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T08:56:13.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:13 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3211814489' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:56:14.014 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-19T08:56:14.014 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-19T08:56:14.015 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T08:56:14.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.119+0000 7fbc25a5e640 1 -- 172.21.15.92:0/405979729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc20102d30 msgr2=0x7fbc201031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:14.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.119+0000 7fbc25a5e640 1 --2- 172.21.15.92:0/405979729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc20102d30 0x7fbc201031b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbc08009900 tx=0x7fbc0802a410 comp rx=0 tx=0).stop 2024-09-19T08:56:14.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.119+0000 7fbc25a5e640 1 -- 172.21.15.92:0/405979729 shutdown_connections 2024-09-19T08:56:14.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.119+0000 7fbc25a5e640 1 --2- 172.21.15.92:0/405979729 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbc201036f0 0x7fbc20109f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:14.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.119+0000 7fbc25a5e640 1 --2- 172.21.15.92:0/405979729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc20102d30 0x7fbc201031b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:14.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.119+0000 7fbc25a5e640 1 --2- 172.21.15.92:0/405979729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc20101b40 0x7fbc20101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:14.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.119+0000 7fbc25a5e640 1 -- 172.21.15.92:0/405979729 >> 172.21.15.92:0/405979729 conn(0x7fbc200fd2c0 msgr2=0x7fbc200ff6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:14.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.119+0000 7fbc25a5e640 1 -- 172.21.15.92:0/405979729 shutdown_connections 2024-09-19T08:56:14.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.119+0000 7fbc25a5e640 1 -- 172.21.15.92:0/405979729 wait complete. 2024-09-19T08:56:14.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.119+0000 7fbc25a5e640 1 Processor -- start 2024-09-19T08:56:14.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.119+0000 7fbc25a5e640 1 -- start start 2024-09-19T08:56:14.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.120+0000 7fbc25a5e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc20101b40 0x7fbc20197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:14.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.120+0000 7fbc25a5e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc20102d30 0x7fbc201983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:14.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.120+0000 7fbc25a5e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbc201036f0 0x7fbc2019f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:14.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.120+0000 7fbc25a5e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2010d820 con 0x7fbc20102d30 2024-09-19T08:56:14.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.120+0000 7fbc25a5e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2010d6a0 con 0x7fbc20101b40 2024-09-19T08:56:14.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.120+0000 7fbc25a5e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2010d9a0 con 0x7fbc201036f0 2024-09-19T08:56:14.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.120+0000 7fbc167fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc20102d30 0x7fbc201983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:14.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.120+0000 7fbc167fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc20102d30 0x7fbc201983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50310/0 (socket says 172.21.15.92:50310) 2024-09-19T08:56:14.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.120+0000 7fbc167fc640 1 -- 172.21.15.92:0/3010912395 learned_addr learned my addr 172.21.15.92:0/3010912395 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:14.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.120+0000 7fbc1effd640 1 --2- 172.21.15.92:0/3010912395 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc20101b40 0x7fbc20197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:14.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.120+0000 7fbc1f7fe640 1 --2- 172.21.15.92:0/3010912395 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbc201036f0 0x7fbc2019f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:14.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.120+0000 7fbc167fc640 1 -- 172.21.15.92:0/3010912395 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbc201036f0 msgr2=0x7fbc2019f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:14.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.120+0000 7fbc167fc640 1 --2- 172.21.15.92:0/3010912395 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbc201036f0 0x7fbc2019f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:14.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.120+0000 7fbc167fc640 1 -- 172.21.15.92:0/3010912395 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc20101b40 msgr2=0x7fbc20197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:14.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.120+0000 7fbc167fc640 1 --2- 172.21.15.92:0/3010912395 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc20101b40 0x7fbc20197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:14.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.120+0000 7fbc167fc640 1 -- 172.21.15.92:0/3010912395 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc2019faa0 con 0x7fbc20102d30 2024-09-19T08:56:14.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.120+0000 7fbc167fc640 1 --2- 172.21.15.92:0/3010912395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc20102d30 0x7fbc201983c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbc08009230 tx=0x7fbc08004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:14.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.120+0000 7fbc24a5c640 1 -- 172.21.15.92:0/3010912395 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc0803f030 con 0x7fbc20102d30 2024-09-19T08:56:14.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.120+0000 7fbc25a5e640 1 -- 172.21.15.92:0/3010912395 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc2019fd30 con 0x7fbc20102d30 2024-09-19T08:56:14.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.120+0000 7fbc24a5c640 1 -- 172.21.15.92:0/3010912395 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc08003ce0 con 0x7fbc20102d30 2024-09-19T08:56:14.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.120+0000 7fbc24a5c640 1 -- 172.21.15.92:0/3010912395 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc08035070 con 0x7fbc20102d30 2024-09-19T08:56:14.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.120+0000 7fbc25a5e640 1 -- 172.21.15.92:0/3010912395 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc201a0290 con 0x7fbc20102d30 2024-09-19T08:56:14.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.122+0000 7fbc25a5e640 1 -- 172.21.15.92:0/3010912395 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc20108f30 con 0x7fbc20102d30 2024-09-19T08:56:14.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.123+0000 7fbc24a5c640 1 -- 172.21.15.92:0/3010912395 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fbc08042030 con 0x7fbc20102d30 2024-09-19T08:56:14.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.124+0000 7fbc24a5c640 1 --2- 172.21.15.92:0/3010912395 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fbc0c0a3250 0x7fbc0c0a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:14.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.124+0000 7fbc1effd640 1 --2- 172.21.15.92:0/3010912395 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fbc0c0a3250 0x7fbc0c0a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:14.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.124+0000 7fbc24a5c640 1 -- 172.21.15.92:0/3010912395 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fbc080f0310 con 0x7fbc20102d30 2024-09-19T08:56:14.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.124+0000 7fbc1effd640 1 --2- 172.21.15.92:0/3010912395 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fbc0c0a3250 0x7fbc0c0a5710 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbc20102b90 tx=0x7fbc1000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:14.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.127+0000 7fbc24a5c640 1 -- 172.21.15.92:0/3010912395 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbc080bd150 con 0x7fbc20102d30 2024-09-19T08:56:14.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.291+0000 7fbc25a5e640 1 -- 172.21.15.92:0/3010912395 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbc20062630 con 0x7fbc0c0a3250 2024-09-19T08:56:14.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.297+0000 7fbc24a5c640 1 -- 172.21.15.92:0/3010912395 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258748 (secure 0 0 0) 0x7fbc20062630 con 0x7fbc0c0a3250 2024-09-19T08:56:14.299 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:14.301 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-19T08:56:14.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.300+0000 7fbc25a5e640 1 -- 172.21.15.92:0/3010912395 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fbc0c0a3250 msgr2=0x7fbc0c0a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:14.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.300+0000 7fbc25a5e640 1 --2- 172.21.15.92:0/3010912395 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fbc0c0a3250 0x7fbc0c0a5710 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbc20102b90 tx=0x7fbc1000b390 comp rx=0 tx=0).stop 2024-09-19T08:56:14.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.300+0000 7fbc25a5e640 1 -- 172.21.15.92:0/3010912395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc20102d30 msgr2=0x7fbc201983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:14.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.300+0000 7fbc25a5e640 1 --2- 172.21.15.92:0/3010912395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc20102d30 0x7fbc201983c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbc08009230 tx=0x7fbc08004360 comp rx=0 tx=0).stop 2024-09-19T08:56:14.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.300+0000 7fbc25a5e640 1 -- 172.21.15.92:0/3010912395 shutdown_connections 2024-09-19T08:56:14.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.300+0000 7fbc25a5e640 1 --2- 172.21.15.92:0/3010912395 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbc201036f0 0x7fbc2019f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:14.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.300+0000 7fbc25a5e640 1 --2- 172.21.15.92:0/3010912395 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fbc0c0a3250 0x7fbc0c0a5710 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:14.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.300+0000 7fbc25a5e640 1 --2- 172.21.15.92:0/3010912395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc20102d30 0x7fbc201983c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:14.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.300+0000 7fbc25a5e640 1 --2- 172.21.15.92:0/3010912395 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc20101b40 0x7fbc20197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:14.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.300+0000 7fbc25a5e640 1 -- 172.21.15.92:0/3010912395 >> 172.21.15.92:0/3010912395 conn(0x7fbc200fd2c0 msgr2=0x7fbc20106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:14.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.300+0000 7fbc25a5e640 1 -- 172.21.15.92:0/3010912395 shutdown_connections 2024-09-19T08:56:14.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.300+0000 7fbc25a5e640 1 -- 172.21.15.92:0/3010912395 wait complete. 2024-09-19T08:56:14.311 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":323,"stamp":"2024-09-19T08:56:14.280012+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653156,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":326,"num_read_kb":271,"num_write":270,"num_write_kb":3029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":711,"ondisk_log_size":711,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365948,"kb_used_data":12540,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575876,"statfs":{"total":1151940427776,"available":1151565697024,"internally_reserved":0,"allocated":12840960,"data_stored":7187836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":308,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":16,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002756"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277427+0000","last_change":"2024-09-19T08:54:31.437743+0000","last_active":"2024-09-19T08:55:52.277427+0000","last_peered":"2024-09-19T08:55:52.277427+0000","last_clean":"2024-09-19T08:55:52.277427+0000","last_became_active":"2024-09-19T08:54:31.437426+0000","last_became_peered":"2024-09-19T08:54:31.437426+0000","last_unstale":"2024-09-19T08:55:52.277427+0000","last_undegraded":"2024-09-19T08:55:52.277427+0000","last_fullsized":"2024-09-19T08:55:52.277427+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:04.403522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.282945+0000","last_change":"2024-09-19T08:54:31.430322+0000","last_active":"2024-09-19T08:55:52.282945+0000","last_peered":"2024-09-19T08:55:52.282945+0000","last_clean":"2024-09-19T08:55:52.282945+0000","last_became_active":"2024-09-19T08:54:31.430008+0000","last_became_peered":"2024-09-19T08:54:31.430008+0000","last_unstale":"2024-09-19T08:55:52.282945+0000","last_undegraded":"2024-09-19T08:55:52.282945+0000","last_fullsized":"2024-09-19T08:55:52.282945+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:19.800686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.271299+0000","last_change":"2024-09-19T08:54:31.430276+0000","last_active":"2024-09-19T08:55:52.271299+0000","last_peered":"2024-09-19T08:55:52.271299+0000","last_clean":"2024-09-19T08:55:52.271299+0000","last_became_active":"2024-09-19T08:54:31.429939+0000","last_became_peered":"2024-09-19T08:54:31.429939+0000","last_unstale":"2024-09-19T08:55:52.271299+0000","last_undegraded":"2024-09-19T08:55:52.271299+0000","last_fullsized":"2024-09-19T08:55:52.271299+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:08.735067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.260618+0000","last_change":"2024-09-19T08:54:31.435197+0000","last_active":"2024-09-19T08:55:52.260618+0000","last_peered":"2024-09-19T08:55:52.260618+0000","last_clean":"2024-09-19T08:55:52.260618+0000","last_became_active":"2024-09-19T08:54:31.434872+0000","last_became_peered":"2024-09-19T08:54:31.434872+0000","last_unstale":"2024-09-19T08:55:52.260618+0000","last_undegraded":"2024-09-19T08:55:52.260618+0000","last_fullsized":"2024-09-19T08:55:52.260618+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:06.213317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.256859+0000","last_change":"2024-09-19T08:54:31.423765+0000","last_active":"2024-09-19T08:55:52.256859+0000","last_peered":"2024-09-19T08:55:52.256859+0000","last_clean":"2024-09-19T08:55:52.256859+0000","last_became_active":"2024-09-19T08:54:31.423296+0000","last_became_peered":"2024-09-19T08:54:31.423296+0000","last_unstale":"2024-09-19T08:55:52.256859+0000","last_undegraded":"2024-09-19T08:55:52.256859+0000","last_fullsized":"2024-09-19T08:55:52.256859+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:07.507168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.283359+0000","last_change":"2024-09-19T08:54:31.430299+0000","last_active":"2024-09-19T08:55:52.283359+0000","last_peered":"2024-09-19T08:55:52.283359+0000","last_clean":"2024-09-19T08:55:52.283359+0000","last_became_active":"2024-09-19T08:54:31.429951+0000","last_became_peered":"2024-09-19T08:54:31.429951+0000","last_unstale":"2024-09-19T08:55:52.283359+0000","last_undegraded":"2024-09-19T08:55:52.283359+0000","last_fullsized":"2024-09-19T08:55:52.283359+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:11.299729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.278219+0000","last_change":"2024-09-19T08:54:31.435854+0000","last_active":"2024-09-19T08:55:52.278219+0000","last_peered":"2024-09-19T08:55:52.278219+0000","last_clean":"2024-09-19T08:55:52.278219+0000","last_became_active":"2024-09-19T08:54:31.435522+0000","last_became_peered":"2024-09-19T08:54:31.435522+0000","last_unstale":"2024-09-19T08:55:52.278219+0000","last_undegraded":"2024-09-19T08:55:52.278219+0000","last_fullsized":"2024-09-19T08:55:52.278219+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:11.099750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.282506+0000","last_change":"2024-09-19T08:54:31.434574+0000","last_active":"2024-09-19T08:55:52.282506+0000","last_peered":"2024-09-19T08:55:52.282506+0000","last_clean":"2024-09-19T08:55:52.282506+0000","last_became_active":"2024-09-19T08:54:31.434268+0000","last_became_peered":"2024-09-19T08:54:31.434268+0000","last_unstale":"2024-09-19T08:55:52.282506+0000","last_undegraded":"2024-09-19T08:55:52.282506+0000","last_fullsized":"2024-09-19T08:55:52.282506+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:29.159417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.279084+0000","last_change":"2024-09-19T08:54:31.430446+0000","last_active":"2024-09-19T08:55:52.279084+0000","last_peered":"2024-09-19T08:55:52.279084+0000","last_clean":"2024-09-19T08:55:52.279084+0000","last_became_active":"2024-09-19T08:54:31.430048+0000","last_became_peered":"2024-09-19T08:54:31.430048+0000","last_unstale":"2024-09-19T08:55:52.279084+0000","last_undegraded":"2024-09-19T08:55:52.279084+0000","last_fullsized":"2024-09-19T08:55:52.279084+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:24.773947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.283319+0000","last_change":"2024-09-19T08:54:31.433144+0000","last_active":"2024-09-19T08:55:52.283319+0000","last_peered":"2024-09-19T08:55:52.283319+0000","last_clean":"2024-09-19T08:55:52.283319+0000","last_became_active":"2024-09-19T08:54:31.432590+0000","last_became_peered":"2024-09-19T08:54:31.432590+0000","last_unstale":"2024-09-19T08:55:52.283319+0000","last_undegraded":"2024-09-19T08:55:52.283319+0000","last_fullsized":"2024-09-19T08:55:52.283319+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:53.756846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.275955+0000","last_change":"2024-09-19T08:54:31.435712+0000","last_active":"2024-09-19T08:55:52.275955+0000","last_peered":"2024-09-19T08:55:52.275955+0000","last_clean":"2024-09-19T08:55:52.275955+0000","last_became_active":"2024-09-19T08:54:31.435301+0000","last_became_peered":"2024-09-19T08:54:31.435301+0000","last_unstale":"2024-09-19T08:55:52.275955+0000","last_undegraded":"2024-09-19T08:55:52.275955+0000","last_fullsized":"2024-09-19T08:55:52.275955+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:51.703709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.270429+0000","last_change":"2024-09-19T08:54:53.332853+0000","last_active":"2024-09-19T08:55:52.270429+0000","last_peered":"2024-09-19T08:55:52.270429+0000","last_clean":"2024-09-19T08:55:52.270429+0000","last_became_active":"2024-09-19T08:54:53.332460+0000","last_became_peered":"2024-09-19T08:54:53.332460+0000","last_unstale":"2024-09-19T08:55:52.270429+0000","last_undegraded":"2024-09-19T08:55:52.270429+0000","last_fullsized":"2024-09-19T08:55:52.270429+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:47:58.025876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277366+0000","last_change":"2024-09-19T08:54:31.425590+0000","last_active":"2024-09-19T08:55:52.277366+0000","last_peered":"2024-09-19T08:55:52.277366+0000","last_clean":"2024-09-19T08:55:52.277366+0000","last_became_active":"2024-09-19T08:54:31.425268+0000","last_became_peered":"2024-09-19T08:54:31.425268+0000","last_unstale":"2024-09-19T08:55:52.277366+0000","last_undegraded":"2024-09-19T08:55:52.277366+0000","last_fullsized":"2024-09-19T08:55:52.277366+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:09.404947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.283086+0000","last_change":"2024-09-19T08:54:31.428372+0000","last_active":"2024-09-19T08:55:52.283086+0000","last_peered":"2024-09-19T08:55:52.283086+0000","last_clean":"2024-09-19T08:55:52.283086+0000","last_became_active":"2024-09-19T08:54:31.428064+0000","last_became_peered":"2024-09-19T08:54:31.428064+0000","last_unstale":"2024-09-19T08:55:52.283086+0000","last_undegraded":"2024-09-19T08:55:52.283086+0000","last_fullsized":"2024-09-19T08:55:52.283086+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:40.444117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.271059+0000","last_change":"2024-09-19T08:54:31.424365+0000","last_active":"2024-09-19T08:55:52.271059+0000","last_peered":"2024-09-19T08:55:52.271059+0000","last_clean":"2024-09-19T08:55:52.271059+0000","last_became_active":"2024-09-19T08:54:31.424044+0000","last_became_peered":"2024-09-19T08:54:31.424044+0000","last_unstale":"2024-09-19T08:55:52.271059+0000","last_undegraded":"2024-09-19T08:55:52.271059+0000","last_fullsized":"2024-09-19T08:55:52.271059+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:16.435389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.278276+0000","last_change":"2024-09-19T08:54:31.437238+0000","last_active":"2024-09-19T08:55:52.278276+0000","last_peered":"2024-09-19T08:55:52.278276+0000","last_clean":"2024-09-19T08:55:52.278276+0000","last_became_active":"2024-09-19T08:54:31.436867+0000","last_became_peered":"2024-09-19T08:54:31.436867+0000","last_unstale":"2024-09-19T08:55:52.278276+0000","last_undegraded":"2024-09-19T08:55:52.278276+0000","last_fullsized":"2024-09-19T08:55:52.278276+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:59.839081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277741+0000","last_change":"2024-09-19T08:54:31.438654+0000","last_active":"2024-09-19T08:55:52.277741+0000","last_peered":"2024-09-19T08:55:52.277741+0000","last_clean":"2024-09-19T08:55:52.277741+0000","last_became_active":"2024-09-19T08:54:31.438342+0000","last_became_peered":"2024-09-19T08:54:31.438342+0000","last_unstale":"2024-09-19T08:55:52.277741+0000","last_undegraded":"2024-09-19T08:55:52.277741+0000","last_fullsized":"2024-09-19T08:55:52.277741+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:55.190605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.271267+0000","last_change":"2024-09-19T08:54:31.431100+0000","last_active":"2024-09-19T08:55:52.271267+0000","last_peered":"2024-09-19T08:55:52.271267+0000","last_clean":"2024-09-19T08:55:52.271267+0000","last_became_active":"2024-09-19T08:54:31.430749+0000","last_became_peered":"2024-09-19T08:54:31.430749+0000","last_unstale":"2024-09-19T08:55:52.271267+0000","last_undegraded":"2024-09-19T08:55:52.271267+0000","last_fullsized":"2024-09-19T08:55:52.271267+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:50.597610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.261809+0000","last_change":"2024-09-19T08:54:31.427454+0000","last_active":"2024-09-19T08:55:52.261809+0000","last_peered":"2024-09-19T08:55:52.261809+0000","last_clean":"2024-09-19T08:55:52.261809+0000","last_became_active":"2024-09-19T08:54:31.427098+0000","last_became_peered":"2024-09-19T08:54:31.427098+0000","last_unstale":"2024-09-19T08:55:52.261809+0000","last_undegraded":"2024-09-19T08:55:52.261809+0000","last_fullsized":"2024-09-19T08:55:52.261809+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:01.042626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.275970+0000","last_change":"2024-09-19T08:54:31.433887+0000","last_active":"2024-09-19T08:55:52.275970+0000","last_peered":"2024-09-19T08:55:52.275970+0000","last_clean":"2024-09-19T08:55:52.275970+0000","last_became_active":"2024-09-19T08:54:31.433528+0000","last_became_peered":"2024-09-19T08:54:31.433528+0000","last_unstale":"2024-09-19T08:55:52.275970+0000","last_undegraded":"2024-09-19T08:55:52.275970+0000","last_fullsized":"2024-09-19T08:55:52.275970+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:37.291226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.266435+0000","last_change":"2024-09-19T08:54:31.436976+0000","last_active":"2024-09-19T08:55:52.266435+0000","last_peered":"2024-09-19T08:55:52.266435+0000","last_clean":"2024-09-19T08:55:52.266435+0000","last_became_active":"2024-09-19T08:54:31.436646+0000","last_became_peered":"2024-09-19T08:54:31.436646+0000","last_unstale":"2024-09-19T08:55:52.266435+0000","last_undegraded":"2024-09-19T08:55:52.266435+0000","last_fullsized":"2024-09-19T08:55:52.266435+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:19.755556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.278449+0000","last_change":"2024-09-19T08:54:31.438922+0000","last_active":"2024-09-19T08:55:52.278449+0000","last_peered":"2024-09-19T08:55:52.278449+0000","last_clean":"2024-09-19T08:55:52.278449+0000","last_became_active":"2024-09-19T08:54:31.438593+0000","last_became_peered":"2024-09-19T08:54:31.438593+0000","last_unstale":"2024-09-19T08:55:52.278449+0000","last_undegraded":"2024-09-19T08:55:52.278449+0000","last_fullsized":"2024-09-19T08:55:52.278449+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:07.347900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.262522+0000","last_change":"2024-09-19T08:54:31.431659+0000","last_active":"2024-09-19T08:55:52.262522+0000","last_peered":"2024-09-19T08:55:52.262522+0000","last_clean":"2024-09-19T08:55:52.262522+0000","last_became_active":"2024-09-19T08:54:31.431359+0000","last_became_peered":"2024-09-19T08:54:31.431359+0000","last_unstale":"2024-09-19T08:55:52.262522+0000","last_undegraded":"2024-09-19T08:55:52.262522+0000","last_fullsized":"2024-09-19T08:55:52.262522+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:02.421286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.278570+0000","last_change":"2024-09-19T08:54:31.432185+0000","last_active":"2024-09-19T08:55:52.278570+0000","last_peered":"2024-09-19T08:55:52.278570+0000","last_clean":"2024-09-19T08:55:52.278570+0000","last_became_active":"2024-09-19T08:54:31.431418+0000","last_became_peered":"2024-09-19T08:54:31.431418+0000","last_unstale":"2024-09-19T08:55:52.278570+0000","last_undegraded":"2024-09-19T08:55:52.278570+0000","last_fullsized":"2024-09-19T08:55:52.278570+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:45.347487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.256343+0000","last_change":"2024-09-19T08:54:31.433742+0000","last_active":"2024-09-19T08:55:52.256343+0000","last_peered":"2024-09-19T08:55:52.256343+0000","last_clean":"2024-09-19T08:55:52.256343+0000","last_became_active":"2024-09-19T08:54:31.433455+0000","last_became_peered":"2024-09-19T08:54:31.433455+0000","last_unstale":"2024-09-19T08:55:52.256343+0000","last_undegraded":"2024-09-19T08:55:52.256343+0000","last_fullsized":"2024-09-19T08:55:52.256343+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:38.803705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.271146+0000","last_change":"2024-09-19T08:54:31.432954+0000","last_active":"2024-09-19T08:55:52.271146+0000","last_peered":"2024-09-19T08:55:52.271146+0000","last_clean":"2024-09-19T08:55:52.271146+0000","last_became_active":"2024-09-19T08:54:31.432574+0000","last_became_peered":"2024-09-19T08:54:31.432574+0000","last_unstale":"2024-09-19T08:55:52.271146+0000","last_undegraded":"2024-09-19T08:55:52.271146+0000","last_fullsized":"2024-09-19T08:55:52.271146+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:30.457191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.274173+0000","last_change":"2024-09-19T08:54:31.435544+0000","last_active":"2024-09-19T08:55:52.274173+0000","last_peered":"2024-09-19T08:55:52.274173+0000","last_clean":"2024-09-19T08:55:52.274173+0000","last_became_active":"2024-09-19T08:54:31.435195+0000","last_became_peered":"2024-09-19T08:54:31.435195+0000","last_unstale":"2024-09-19T08:55:52.274173+0000","last_undegraded":"2024-09-19T08:55:52.274173+0000","last_fullsized":"2024-09-19T08:55:52.274173+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:54.240654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.266764+0000","last_change":"2024-09-19T08:54:31.428403+0000","last_active":"2024-09-19T08:55:52.266764+0000","last_peered":"2024-09-19T08:55:52.266764+0000","last_clean":"2024-09-19T08:55:52.266764+0000","last_became_active":"2024-09-19T08:54:31.428110+0000","last_became_peered":"2024-09-19T08:54:31.428110+0000","last_unstale":"2024-09-19T08:55:52.266764+0000","last_undegraded":"2024-09-19T08:55:52.266764+0000","last_fullsized":"2024-09-19T08:55:52.266764+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:05.593073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.269495+0000","last_change":"2024-09-19T08:54:31.427291+0000","last_active":"2024-09-19T08:55:52.269495+0000","last_peered":"2024-09-19T08:55:52.269495+0000","last_clean":"2024-09-19T08:55:52.269495+0000","last_became_active":"2024-09-19T08:54:31.427011+0000","last_became_peered":"2024-09-19T08:54:31.427011+0000","last_unstale":"2024-09-19T08:55:52.269495+0000","last_undegraded":"2024-09-19T08:55:52.269495+0000","last_fullsized":"2024-09-19T08:55:52.269495+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:54.338526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.254032+0000","last_change":"2024-09-19T08:54:31.429309+0000","last_active":"2024-09-19T08:55:52.254032+0000","last_peered":"2024-09-19T08:55:52.254032+0000","last_clean":"2024-09-19T08:55:52.254032+0000","last_became_active":"2024-09-19T08:54:31.428381+0000","last_became_peered":"2024-09-19T08:54:31.428381+0000","last_unstale":"2024-09-19T08:55:52.254032+0000","last_undegraded":"2024-09-19T08:55:52.254032+0000","last_fullsized":"2024-09-19T08:55:52.254032+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:22:33.920114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.273963+0000","last_change":"2024-09-19T08:54:53.336591+0000","last_active":"2024-09-19T08:55:52.273963+0000","last_peered":"2024-09-19T08:55:52.273963+0000","last_clean":"2024-09-19T08:55:52.273963+0000","last_became_active":"2024-09-19T08:54:53.336222+0000","last_became_peered":"2024-09-19T08:54:53.336222+0000","last_unstale":"2024-09-19T08:55:52.273963+0000","last_undegraded":"2024-09-19T08:55:52.273963+0000","last_fullsized":"2024-09-19T08:55:52.273963+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:59.019419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277017+0000","last_change":"2024-09-19T08:54:53.335149+0000","last_active":"2024-09-19T08:55:52.277017+0000","last_peered":"2024-09-19T08:55:52.277017+0000","last_clean":"2024-09-19T08:55:52.277017+0000","last_became_active":"2024-09-19T08:54:53.334766+0000","last_became_peered":"2024-09-19T08:54:53.334766+0000","last_unstale":"2024-09-19T08:55:52.277017+0000","last_undegraded":"2024-09-19T08:55:52.277017+0000","last_fullsized":"2024-09-19T08:55:52.277017+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:36.469044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277210+0000","last_change":"2024-09-19T08:54:31.427608+0000","last_active":"2024-09-19T08:55:52.277210+0000","last_peered":"2024-09-19T08:55:52.277210+0000","last_clean":"2024-09-19T08:55:52.277210+0000","last_became_active":"2024-09-19T08:54:31.427294+0000","last_became_peered":"2024-09-19T08:54:31.427294+0000","last_unstale":"2024-09-19T08:55:52.277210+0000","last_undegraded":"2024-09-19T08:55:52.277210+0000","last_fullsized":"2024-09-19T08:55:52.277210+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:41.356609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331158+0000","last_change":"2024-09-19T08:54:29.416204+0000","last_active":"2024-09-19T08:54:53.331158+0000","last_peered":"2024-09-19T08:54:53.331158+0000","last_clean":"2024-09-19T08:54:53.331158+0000","last_became_active":"2024-09-19T08:54:29.415872+0000","last_became_peered":"2024-09-19T08:54:29.415872+0000","last_unstale":"2024-09-19T08:54:53.331158+0000","last_undegraded":"2024-09-19T08:54:53.331158+0000","last_fullsized":"2024-09-19T08:54:53.331158+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:13.844147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.283160+0000","last_change":"2024-09-19T08:54:31.432137+0000","last_active":"2024-09-19T08:55:52.283160+0000","last_peered":"2024-09-19T08:55:52.283160+0000","last_clean":"2024-09-19T08:55:52.283160+0000","last_became_active":"2024-09-19T08:54:31.431761+0000","last_became_peered":"2024-09-19T08:54:31.431761+0000","last_unstale":"2024-09-19T08:55:52.283160+0000","last_undegraded":"2024-09-19T08:55:52.283160+0000","last_fullsized":"2024-09-19T08:55:52.283160+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:05.008431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327676+0000","last_change":"2024-09-19T08:54:29.413221+0000","last_active":"2024-09-19T08:54:53.327676+0000","last_peered":"2024-09-19T08:54:53.327676+0000","last_clean":"2024-09-19T08:54:53.327676+0000","last_became_active":"2024-09-19T08:54:29.412829+0000","last_became_peered":"2024-09-19T08:54:29.412829+0000","last_unstale":"2024-09-19T08:54:53.327676+0000","last_undegraded":"2024-09-19T08:54:53.327676+0000","last_fullsized":"2024-09-19T08:54:53.327676+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:07.224136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.326805+0000","last_change":"2024-09-19T08:54:29.410221+0000","last_active":"2024-09-19T08:54:53.326805+0000","last_peered":"2024-09-19T08:54:53.326805+0000","last_clean":"2024-09-19T08:54:53.326805+0000","last_became_active":"2024-09-19T08:54:29.409951+0000","last_became_peered":"2024-09-19T08:54:29.409951+0000","last_unstale":"2024-09-19T08:54:53.326805+0000","last_undegraded":"2024-09-19T08:54:53.326805+0000","last_fullsized":"2024-09-19T08:54:53.326805+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:58.350932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.259466+0000","last_change":"2024-09-19T08:54:31.429979+0000","last_active":"2024-09-19T08:55:52.259466+0000","last_peered":"2024-09-19T08:55:52.259466+0000","last_clean":"2024-09-19T08:55:52.259466+0000","last_became_active":"2024-09-19T08:54:31.429661+0000","last_became_peered":"2024-09-19T08:54:31.429661+0000","last_unstale":"2024-09-19T08:55:52.259466+0000","last_undegraded":"2024-09-19T08:55:52.259466+0000","last_fullsized":"2024-09-19T08:55:52.259466+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:27:40.603490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331299+0000","last_change":"2024-09-19T08:54:29.415769+0000","last_active":"2024-09-19T08:54:53.331299+0000","last_peered":"2024-09-19T08:54:53.331299+0000","last_clean":"2024-09-19T08:54:53.331299+0000","last_became_active":"2024-09-19T08:54:29.415245+0000","last_became_peered":"2024-09-19T08:54:29.415245+0000","last_unstale":"2024-09-19T08:54:53.331299+0000","last_undegraded":"2024-09-19T08:54:53.331299+0000","last_fullsized":"2024-09-19T08:54:53.331299+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:15.487945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.270548+0000","last_change":"2024-09-19T08:54:31.427126+0000","last_active":"2024-09-19T08:55:52.270548+0000","last_peered":"2024-09-19T08:55:52.270548+0000","last_clean":"2024-09-19T08:55:52.270548+0000","last_became_active":"2024-09-19T08:54:31.426816+0000","last_became_peered":"2024-09-19T08:54:31.426816+0000","last_unstale":"2024-09-19T08:55:52.270548+0000","last_undegraded":"2024-09-19T08:55:52.270548+0000","last_fullsized":"2024-09-19T08:55:52.270548+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:38.039428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327848+0000","last_change":"2024-09-19T08:54:29.411354+0000","last_active":"2024-09-19T08:54:53.327848+0000","last_peered":"2024-09-19T08:54:53.327848+0000","last_clean":"2024-09-19T08:54:53.327848+0000","last_became_active":"2024-09-19T08:54:29.410990+0000","last_became_peered":"2024-09-19T08:54:29.410990+0000","last_unstale":"2024-09-19T08:54:53.327848+0000","last_undegraded":"2024-09-19T08:54:53.327848+0000","last_fullsized":"2024-09-19T08:54:53.327848+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:29.338169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277112+0000","last_change":"2024-09-19T08:54:31.426243+0000","last_active":"2024-09-19T08:55:52.277112+0000","last_peered":"2024-09-19T08:55:52.277112+0000","last_clean":"2024-09-19T08:55:52.277112+0000","last_became_active":"2024-09-19T08:54:31.425895+0000","last_became_peered":"2024-09-19T08:54:31.425895+0000","last_unstale":"2024-09-19T08:55:52.277112+0000","last_undegraded":"2024-09-19T08:55:52.277112+0000","last_fullsized":"2024-09-19T08:55:52.277112+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:13.562780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331102+0000","last_change":"2024-09-19T08:54:29.416646+0000","last_active":"2024-09-19T08:54:53.331102+0000","last_peered":"2024-09-19T08:54:53.331102+0000","last_clean":"2024-09-19T08:54:53.331102+0000","last_became_active":"2024-09-19T08:54:29.416260+0000","last_became_peered":"2024-09-19T08:54:29.416260+0000","last_unstale":"2024-09-19T08:54:53.331102+0000","last_undegraded":"2024-09-19T08:54:53.331102+0000","last_fullsized":"2024-09-19T08:54:53.331102+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:42:17.467035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.276583+0000","last_change":"2024-09-19T08:54:31.435538+0000","last_active":"2024-09-19T08:55:52.276583+0000","last_peered":"2024-09-19T08:55:52.276583+0000","last_clean":"2024-09-19T08:55:52.276583+0000","last_became_active":"2024-09-19T08:54:31.435185+0000","last_became_peered":"2024-09-19T08:54:31.435185+0000","last_unstale":"2024-09-19T08:55:52.276583+0000","last_undegraded":"2024-09-19T08:55:52.276583+0000","last_fullsized":"2024-09-19T08:55:52.276583+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:06.940123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.332501+0000","last_change":"2024-09-19T08:54:29.675914+0000","last_active":"2024-09-19T08:54:53.332501+0000","last_peered":"2024-09-19T08:54:53.332501+0000","last_clean":"2024-09-19T08:54:53.332501+0000","last_became_active":"2024-09-19T08:54:29.675482+0000","last_became_peered":"2024-09-19T08:54:29.675482+0000","last_unstale":"2024-09-19T08:54:53.332501+0000","last_undegraded":"2024-09-19T08:54:53.332501+0000","last_fullsized":"2024-09-19T08:54:53.332501+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:58.893008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.273901+0000","last_change":"2024-09-19T08:54:31.432628+0000","last_active":"2024-09-19T08:55:52.273901+0000","last_peered":"2024-09-19T08:55:52.273901+0000","last_clean":"2024-09-19T08:55:52.273901+0000","last_became_active":"2024-09-19T08:54:31.430640+0000","last_became_peered":"2024-09-19T08:54:31.430640+0000","last_unstale":"2024-09-19T08:55:52.273901+0000","last_undegraded":"2024-09-19T08:55:52.273901+0000","last_fullsized":"2024-09-19T08:55:52.273901+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:07.793089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'30","reported_seq":248,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:56:11.641416+0000","last_change":"2024-09-19T08:54:29.414619+0000","last_active":"2024-09-19T08:56:11.641416+0000","last_peered":"2024-09-19T08:56:11.641416+0000","last_clean":"2024-09-19T08:56:11.641416+0000","last_became_active":"2024-09-19T08:54:29.414295+0000","last_became_peered":"2024-09-19T08:54:29.414295+0000","last_unstale":"2024-09-19T08:56:11.641416+0000","last_undegraded":"2024-09-19T08:56:11.641416+0000","last_fullsized":"2024-09-19T08:56:11.641416+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:23.782684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61756,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":196,"num_read_kb":158,"num_write":30,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.276986+0000","last_change":"2024-09-19T08:54:31.425432+0000","last_active":"2024-09-19T08:55:52.276986+0000","last_peered":"2024-09-19T08:55:52.276986+0000","last_clean":"2024-09-19T08:55:52.276986+0000","last_became_active":"2024-09-19T08:54:31.425086+0000","last_became_peered":"2024-09-19T08:54:31.425086+0000","last_unstale":"2024-09-19T08:55:52.276986+0000","last_undegraded":"2024-09-19T08:55:52.276986+0000","last_fullsized":"2024-09-19T08:55:52.276986+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:56.572339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330371+0000","last_change":"2024-09-19T08:54:29.415055+0000","last_active":"2024-09-19T08:54:53.330371+0000","last_peered":"2024-09-19T08:54:53.330371+0000","last_clean":"2024-09-19T08:54:53.330371+0000","last_became_active":"2024-09-19T08:54:29.414573+0000","last_became_peered":"2024-09-19T08:54:29.414573+0000","last_unstale":"2024-09-19T08:54:53.330371+0000","last_undegraded":"2024-09-19T08:54:53.330371+0000","last_fullsized":"2024-09-19T08:54:53.330371+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:13.013714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.260081+0000","last_change":"2024-09-19T08:54:31.436905+0000","last_active":"2024-09-19T08:55:52.260081+0000","last_peered":"2024-09-19T08:55:52.260081+0000","last_clean":"2024-09-19T08:55:52.260081+0000","last_became_active":"2024-09-19T08:54:31.436571+0000","last_became_peered":"2024-09-19T08:54:31.436571+0000","last_unstale":"2024-09-19T08:55:52.260081+0000","last_undegraded":"2024-09-19T08:55:52.260081+0000","last_fullsized":"2024-09-19T08:55:52.260081+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:55.294255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330834+0000","last_change":"2024-09-19T08:54:29.417958+0000","last_active":"2024-09-19T08:54:53.330834+0000","last_peered":"2024-09-19T08:54:53.330834+0000","last_clean":"2024-09-19T08:54:53.330834+0000","last_became_active":"2024-09-19T08:54:29.417570+0000","last_became_peered":"2024-09-19T08:54:29.417570+0000","last_unstale":"2024-09-19T08:54:53.330834+0000","last_undegraded":"2024-09-19T08:54:53.330834+0000","last_fullsized":"2024-09-19T08:54:53.330834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:25.557217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.279834+0000","last_change":"2024-09-19T08:54:31.433019+0000","last_active":"2024-09-19T08:55:52.279834+0000","last_peered":"2024-09-19T08:55:52.279834+0000","last_clean":"2024-09-19T08:55:52.279834+0000","last_became_active":"2024-09-19T08:54:31.431265+0000","last_became_peered":"2024-09-19T08:54:31.431265+0000","last_unstale":"2024-09-19T08:55:52.279834+0000","last_undegraded":"2024-09-19T08:55:52.279834+0000","last_fullsized":"2024-09-19T08:55:52.279834+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:36.481863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.979100+0000","last_change":"2024-09-19T08:54:29.414236+0000","last_active":"2024-09-19T08:54:53.979100+0000","last_peered":"2024-09-19T08:54:53.979100+0000","last_clean":"2024-09-19T08:54:53.979100+0000","last_became_active":"2024-09-19T08:54:29.413878+0000","last_became_peered":"2024-09-19T08:54:29.413878+0000","last_unstale":"2024-09-19T08:54:53.979100+0000","last_undegraded":"2024-09-19T08:54:53.979100+0000","last_fullsized":"2024-09-19T08:54:53.979100+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:11.222362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.279321+0000","last_change":"2024-09-19T08:54:31.439512+0000","last_active":"2024-09-19T08:55:52.279321+0000","last_peered":"2024-09-19T08:55:52.279321+0000","last_clean":"2024-09-19T08:55:52.279321+0000","last_became_active":"2024-09-19T08:54:31.438767+0000","last_became_peered":"2024-09-19T08:54:31.438767+0000","last_unstale":"2024-09-19T08:55:52.279321+0000","last_undegraded":"2024-09-19T08:55:52.279321+0000","last_fullsized":"2024-09-19T08:55:52.279321+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:31.784577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330687+0000","last_change":"2024-09-19T08:54:29.675768+0000","last_active":"2024-09-19T08:54:53.330687+0000","last_peered":"2024-09-19T08:54:53.330687+0000","last_clean":"2024-09-19T08:54:53.330687+0000","last_became_active":"2024-09-19T08:54:29.675376+0000","last_became_peered":"2024-09-19T08:54:29.675376+0000","last_unstale":"2024-09-19T08:54:53.330687+0000","last_undegraded":"2024-09-19T08:54:53.330687+0000","last_fullsized":"2024-09-19T08:54:53.330687+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:10.281126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.282865+0000","last_change":"2024-09-19T08:54:31.435904+0000","last_active":"2024-09-19T08:55:52.282865+0000","last_peered":"2024-09-19T08:55:52.282865+0000","last_clean":"2024-09-19T08:55:52.282865+0000","last_became_active":"2024-09-19T08:54:31.435396+0000","last_became_peered":"2024-09-19T08:54:31.435396+0000","last_unstale":"2024-09-19T08:55:52.282865+0000","last_undegraded":"2024-09-19T08:55:52.282865+0000","last_fullsized":"2024-09-19T08:55:52.282865+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:41.567463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331746+0000","last_change":"2024-09-19T08:54:29.410221+0000","last_active":"2024-09-19T08:54:53.331746+0000","last_peered":"2024-09-19T08:54:53.331746+0000","last_clean":"2024-09-19T08:54:53.331746+0000","last_became_active":"2024-09-19T08:54:29.409856+0000","last_became_peered":"2024-09-19T08:54:29.409856+0000","last_unstale":"2024-09-19T08:54:53.331746+0000","last_undegraded":"2024-09-19T08:54:53.331746+0000","last_fullsized":"2024-09-19T08:54:53.331746+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:46.095816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.270387+0000","last_change":"2024-09-19T08:54:31.437854+0000","last_active":"2024-09-19T08:55:52.270387+0000","last_peered":"2024-09-19T08:55:52.270387+0000","last_clean":"2024-09-19T08:55:52.270387+0000","last_became_active":"2024-09-19T08:54:31.437491+0000","last_became_peered":"2024-09-19T08:54:31.437491+0000","last_unstale":"2024-09-19T08:55:52.270387+0000","last_undegraded":"2024-09-19T08:55:52.270387+0000","last_fullsized":"2024-09-19T08:55:52.270387+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:22.532429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.983440+0000","last_change":"2024-09-19T08:54:53.983440+0000","last_active":"2024-09-19T08:54:53.983440+0000","last_peered":"2024-09-19T08:54:53.983440+0000","last_clean":"2024-09-19T08:54:53.983440+0000","last_became_active":"2024-09-19T08:54:53.980971+0000","last_became_peered":"2024-09-19T08:54:53.980971+0000","last_unstale":"2024-09-19T08:54:53.983440+0000","last_undegraded":"2024-09-19T08:54:53.983440+0000","last_fullsized":"2024-09-19T08:54:53.983440+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:33.070904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.278128+0000","last_change":"2024-09-19T08:54:31.429376+0000","last_active":"2024-09-19T08:55:52.278128+0000","last_peered":"2024-09-19T08:55:52.278128+0000","last_clean":"2024-09-19T08:55:52.278128+0000","last_became_active":"2024-09-19T08:54:31.429006+0000","last_became_peered":"2024-09-19T08:54:31.429006+0000","last_unstale":"2024-09-19T08:55:52.278128+0000","last_undegraded":"2024-09-19T08:55:52.278128+0000","last_fullsized":"2024-09-19T08:55:52.278128+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:26.399838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.332608+0000","last_change":"2024-09-19T08:54:29.414307+0000","last_active":"2024-09-19T08:54:53.332608+0000","last_peered":"2024-09-19T08:54:53.332608+0000","last_clean":"2024-09-19T08:54:53.332608+0000","last_became_active":"2024-09-19T08:54:29.413823+0000","last_became_peered":"2024-09-19T08:54:29.413823+0000","last_unstale":"2024-09-19T08:54:53.332608+0000","last_undegraded":"2024-09-19T08:54:53.332608+0000","last_fullsized":"2024-09-19T08:54:53.332608+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:25.484645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.279004+0000","last_change":"2024-09-19T08:54:31.437789+0000","last_active":"2024-09-19T08:55:52.279004+0000","last_peered":"2024-09-19T08:55:52.279004+0000","last_clean":"2024-09-19T08:55:52.279004+0000","last_became_active":"2024-09-19T08:54:31.435488+0000","last_became_peered":"2024-09-19T08:54:31.435488+0000","last_unstale":"2024-09-19T08:55:52.279004+0000","last_undegraded":"2024-09-19T08:55:52.279004+0000","last_fullsized":"2024-09-19T08:55:52.279004+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:19.332440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.333662+0000","last_change":"2024-09-19T08:54:53.333120+0000","last_active":"2024-09-19T08:54:53.333662+0000","last_peered":"2024-09-19T08:54:53.333662+0000","last_clean":"2024-09-19T08:54:53.333662+0000","last_became_active":"2024-09-19T08:54:53.332711+0000","last_became_peered":"2024-09-19T08:54:53.332711+0000","last_unstale":"2024-09-19T08:54:53.333662+0000","last_undegraded":"2024-09-19T08:54:53.333662+0000","last_fullsized":"2024-09-19T08:54:53.333662+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:18.359002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.279878+0000","last_change":"2024-09-19T08:54:31.434564+0000","last_active":"2024-09-19T08:55:52.279878+0000","last_peered":"2024-09-19T08:55:52.279878+0000","last_clean":"2024-09-19T08:55:52.279878+0000","last_became_active":"2024-09-19T08:54:31.434231+0000","last_became_peered":"2024-09-19T08:54:31.434231+0000","last_unstale":"2024-09-19T08:55:52.279878+0000","last_undegraded":"2024-09-19T08:55:52.279878+0000","last_fullsized":"2024-09-19T08:55:52.279878+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:31.316400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":335,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331130+0000","last_change":"2024-09-19T08:53:21.357560+0000","last_active":"2024-09-19T08:54:53.331130+0000","last_peered":"2024-09-19T08:54:53.331130+0000","last_clean":"2024-09-19T08:54:53.331130+0000","last_became_active":"2024-09-19T08:53:21.357122+0000","last_became_peered":"2024-09-19T08:53:21.357122+0000","last_unstale":"2024-09-19T08:54:53.331130+0000","last_undegraded":"2024-09-19T08:54:53.331130+0000","last_fullsized":"2024-09-19T08:54:53.331130+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:05.231370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:05.231370+0000","last_clean_scrub_stamp":"2024-09-19T08:50:05.231370+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:47.867682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.979104+0000","last_change":"2024-09-19T08:54:29.412240+0000","last_active":"2024-09-19T08:54:53.979104+0000","last_peered":"2024-09-19T08:54:53.979104+0000","last_clean":"2024-09-19T08:54:53.979104+0000","last_became_active":"2024-09-19T08:54:29.411908+0000","last_became_peered":"2024-09-19T08:54:29.411908+0000","last_unstale":"2024-09-19T08:54:53.979104+0000","last_undegraded":"2024-09-19T08:54:53.979104+0000","last_fullsized":"2024-09-19T08:54:53.979104+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:37.189373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277537+0000","last_change":"2024-09-19T08:54:31.432956+0000","last_active":"2024-09-19T08:55:52.277537+0000","last_peered":"2024-09-19T08:55:52.277537+0000","last_clean":"2024-09-19T08:55:52.277537+0000","last_became_active":"2024-09-19T08:54:31.432639+0000","last_became_peered":"2024-09-19T08:54:31.432639+0000","last_unstale":"2024-09-19T08:55:52.277537+0000","last_undegraded":"2024-09-19T08:55:52.277537+0000","last_fullsized":"2024-09-19T08:55:52.277537+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:58.302624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331178+0000","last_change":"2024-09-19T08:54:29.414214+0000","last_active":"2024-09-19T08:54:53.331178+0000","last_peered":"2024-09-19T08:54:53.331178+0000","last_clean":"2024-09-19T08:54:53.331178+0000","last_became_active":"2024-09-19T08:54:29.413853+0000","last_became_peered":"2024-09-19T08:54:29.413853+0000","last_unstale":"2024-09-19T08:54:53.331178+0000","last_undegraded":"2024-09-19T08:54:53.331178+0000","last_fullsized":"2024-09-19T08:54:53.331178+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:28:29.119856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.266896+0000","last_change":"2024-09-19T08:54:31.424643+0000","last_active":"2024-09-19T08:55:52.266896+0000","last_peered":"2024-09-19T08:55:52.266896+0000","last_clean":"2024-09-19T08:55:52.266896+0000","last_became_active":"2024-09-19T08:54:31.424363+0000","last_became_peered":"2024-09-19T08:54:31.424363+0000","last_unstale":"2024-09-19T08:55:52.266896+0000","last_undegraded":"2024-09-19T08:55:52.266896+0000","last_fullsized":"2024-09-19T08:55:52.266896+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:37.529952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.326916+0000","last_change":"2024-09-19T08:54:29.675742+0000","last_active":"2024-09-19T08:54:53.326916+0000","last_peered":"2024-09-19T08:54:53.326916+0000","last_clean":"2024-09-19T08:54:53.326916+0000","last_became_active":"2024-09-19T08:54:29.675347+0000","last_became_peered":"2024-09-19T08:54:29.675347+0000","last_unstale":"2024-09-19T08:54:53.326916+0000","last_undegraded":"2024-09-19T08:54:53.326916+0000","last_fullsized":"2024-09-19T08:54:53.326916+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:00.925390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.283427+0000","last_change":"2024-09-19T08:54:31.433887+0000","last_active":"2024-09-19T08:55:52.283427+0000","last_peered":"2024-09-19T08:55:52.283427+0000","last_clean":"2024-09-19T08:55:52.283427+0000","last_became_active":"2024-09-19T08:54:31.433331+0000","last_became_peered":"2024-09-19T08:54:31.433331+0000","last_unstale":"2024-09-19T08:55:52.283427+0000","last_undegraded":"2024-09-19T08:55:52.283427+0000","last_fullsized":"2024-09-19T08:55:52.283427+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:49.875061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331491+0000","last_change":"2024-09-19T08:54:29.417410+0000","last_active":"2024-09-19T08:54:53.331491+0000","last_peered":"2024-09-19T08:54:53.331491+0000","last_clean":"2024-09-19T08:54:53.331491+0000","last_became_active":"2024-09-19T08:54:29.417018+0000","last_became_peered":"2024-09-19T08:54:29.417018+0000","last_unstale":"2024-09-19T08:54:53.331491+0000","last_undegraded":"2024-09-19T08:54:53.331491+0000","last_fullsized":"2024-09-19T08:54:53.331491+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:53.669027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.280825+0000","last_change":"2024-09-19T08:54:31.431313+0000","last_active":"2024-09-19T08:55:52.280825+0000","last_peered":"2024-09-19T08:55:52.280825+0000","last_clean":"2024-09-19T08:55:52.280825+0000","last_became_active":"2024-09-19T08:54:31.429427+0000","last_became_peered":"2024-09-19T08:54:31.429427+0000","last_unstale":"2024-09-19T08:55:52.280825+0000","last_undegraded":"2024-09-19T08:55:52.280825+0000","last_fullsized":"2024-09-19T08:55:52.280825+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:55.106769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330517+0000","last_change":"2024-09-19T08:54:29.675722+0000","last_active":"2024-09-19T08:54:53.330517+0000","last_peered":"2024-09-19T08:54:53.330517+0000","last_clean":"2024-09-19T08:54:53.330517+0000","last_became_active":"2024-09-19T08:54:29.675397+0000","last_became_peered":"2024-09-19T08:54:29.675397+0000","last_unstale":"2024-09-19T08:54:53.330517+0000","last_undegraded":"2024-09-19T08:54:53.330517+0000","last_fullsized":"2024-09-19T08:54:53.330517+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:49.574947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.283206+0000","last_change":"2024-09-19T08:54:31.431106+0000","last_active":"2024-09-19T08:55:52.283206+0000","last_peered":"2024-09-19T08:55:52.283206+0000","last_clean":"2024-09-19T08:55:52.283206+0000","last_became_active":"2024-09-19T08:54:31.430745+0000","last_became_peered":"2024-09-19T08:54:31.430745+0000","last_unstale":"2024-09-19T08:55:52.283206+0000","last_undegraded":"2024-09-19T08:55:52.283206+0000","last_fullsized":"2024-09-19T08:55:52.283206+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:22.714106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331431+0000","last_change":"2024-09-19T08:54:29.675985+0000","last_active":"2024-09-19T08:54:53.331431+0000","last_peered":"2024-09-19T08:54:53.331431+0000","last_clean":"2024-09-19T08:54:53.331431+0000","last_became_active":"2024-09-19T08:54:29.675374+0000","last_became_peered":"2024-09-19T08:54:29.675374+0000","last_unstale":"2024-09-19T08:54:53.331431+0000","last_undegraded":"2024-09-19T08:54:53.331431+0000","last_fullsized":"2024-09-19T08:54:53.331431+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:06.664621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.260250+0000","last_change":"2024-09-19T08:54:31.423493+0000","last_active":"2024-09-19T08:55:52.260250+0000","last_peered":"2024-09-19T08:55:52.260250+0000","last_clean":"2024-09-19T08:55:52.260250+0000","last_became_active":"2024-09-19T08:54:31.422651+0000","last_became_peered":"2024-09-19T08:54:31.422651+0000","last_unstale":"2024-09-19T08:55:52.260250+0000","last_undegraded":"2024-09-19T08:55:52.260250+0000","last_fullsized":"2024-09-19T08:55:52.260250+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:51.863965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'10","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:55.435276+0000","last_change":"2024-09-19T08:54:29.408571+0000","last_active":"2024-09-19T08:54:55.435276+0000","last_peered":"2024-09-19T08:54:55.435276+0000","last_clean":"2024-09-19T08:54:55.435276+0000","last_became_active":"2024-09-19T08:54:29.408142+0000","last_became_peered":"2024-09-19T08:54:29.408142+0000","last_unstale":"2024-09-19T08:54:55.435276+0000","last_undegraded":"2024-09-19T08:54:55.435276+0000","last_fullsized":"2024-09-19T08:54:55.435276+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:34.578230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.262764+0000","last_change":"2024-09-19T08:54:31.435333+0000","last_active":"2024-09-19T08:55:52.262764+0000","last_peered":"2024-09-19T08:55:52.262764+0000","last_clean":"2024-09-19T08:55:52.262764+0000","last_became_active":"2024-09-19T08:54:31.435041+0000","last_became_peered":"2024-09-19T08:54:31.435041+0000","last_unstale":"2024-09-19T08:55:52.262764+0000","last_undegraded":"2024-09-19T08:55:52.262764+0000","last_fullsized":"2024-09-19T08:55:52.262764+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:40.972638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.979153+0000","last_change":"2024-09-19T08:54:29.554303+0000","last_active":"2024-09-19T08:54:53.979153+0000","last_peered":"2024-09-19T08:54:53.979153+0000","last_clean":"2024-09-19T08:54:53.979153+0000","last_became_active":"2024-09-19T08:54:29.553919+0000","last_became_peered":"2024-09-19T08:54:29.553919+0000","last_unstale":"2024-09-19T08:54:53.979153+0000","last_undegraded":"2024-09-19T08:54:53.979153+0000","last_fullsized":"2024-09-19T08:54:53.979153+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:25.103926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.279407+0000","last_change":"2024-09-19T08:54:53.333280+0000","last_active":"2024-09-19T08:55:52.279407+0000","last_peered":"2024-09-19T08:55:52.279407+0000","last_clean":"2024-09-19T08:55:52.279407+0000","last_became_active":"2024-09-19T08:54:53.332881+0000","last_became_peered":"2024-09-19T08:54:53.332881+0000","last_unstale":"2024-09-19T08:55:52.279407+0000","last_undegraded":"2024-09-19T08:55:52.279407+0000","last_fullsized":"2024-09-19T08:55:52.279407+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:55.880616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329946+0000","last_change":"2024-09-19T08:54:29.675665+0000","last_active":"2024-09-19T08:54:53.329946+0000","last_peered":"2024-09-19T08:54:53.329946+0000","last_clean":"2024-09-19T08:54:53.329946+0000","last_became_active":"2024-09-19T08:54:29.675367+0000","last_became_peered":"2024-09-19T08:54:29.675367+0000","last_unstale":"2024-09-19T08:54:53.329946+0000","last_undegraded":"2024-09-19T08:54:53.329946+0000","last_fullsized":"2024-09-19T08:54:53.329946+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:35.473243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.237269+0000","last_change":"2024-09-19T08:54:31.430837+0000","last_active":"2024-09-19T08:55:52.237269+0000","last_peered":"2024-09-19T08:55:52.237269+0000","last_clean":"2024-09-19T08:55:52.237269+0000","last_became_active":"2024-09-19T08:54:31.430465+0000","last_became_peered":"2024-09-19T08:54:31.430465+0000","last_unstale":"2024-09-19T08:55:52.237269+0000","last_undegraded":"2024-09-19T08:55:52.237269+0000","last_fullsized":"2024-09-19T08:55:52.237269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:50.524730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329067+0000","last_change":"2024-09-19T08:54:29.413803+0000","last_active":"2024-09-19T08:54:53.329067+0000","last_peered":"2024-09-19T08:54:53.329067+0000","last_clean":"2024-09-19T08:54:53.329067+0000","last_became_active":"2024-09-19T08:54:29.413400+0000","last_became_peered":"2024-09-19T08:54:29.413400+0000","last_unstale":"2024-09-19T08:54:53.329067+0000","last_undegraded":"2024-09-19T08:54:53.329067+0000","last_fullsized":"2024-09-19T08:54:53.329067+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:12.518454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.271551+0000","last_change":"2024-09-19T08:54:31.428451+0000","last_active":"2024-09-19T08:55:52.271551+0000","last_peered":"2024-09-19T08:55:52.271551+0000","last_clean":"2024-09-19T08:55:52.271551+0000","last_became_active":"2024-09-19T08:54:31.428134+0000","last_became_peered":"2024-09-19T08:54:31.428134+0000","last_unstale":"2024-09-19T08:55:52.271551+0000","last_undegraded":"2024-09-19T08:55:52.271551+0000","last_fullsized":"2024-09-19T08:55:52.271551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:08.260183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329914+0000","last_change":"2024-09-19T08:54:29.414399+0000","last_active":"2024-09-19T08:54:53.329914+0000","last_peered":"2024-09-19T08:54:53.329914+0000","last_clean":"2024-09-19T08:54:53.329914+0000","last_became_active":"2024-09-19T08:54:29.413080+0000","last_became_peered":"2024-09-19T08:54:29.413080+0000","last_unstale":"2024-09-19T08:54:53.329914+0000","last_undegraded":"2024-09-19T08:54:53.329914+0000","last_fullsized":"2024-09-19T08:54:53.329914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:27.308297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.282381+0000","last_change":"2024-09-19T08:54:31.434550+0000","last_active":"2024-09-19T08:55:52.282381+0000","last_peered":"2024-09-19T08:55:52.282381+0000","last_clean":"2024-09-19T08:55:52.282381+0000","last_became_active":"2024-09-19T08:54:31.434195+0000","last_became_peered":"2024-09-19T08:54:31.434195+0000","last_unstale":"2024-09-19T08:55:52.282381+0000","last_undegraded":"2024-09-19T08:55:52.282381+0000","last_fullsized":"2024-09-19T08:55:52.282381+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:04.807833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.338857+0000","last_change":"2024-09-19T08:54:53.338857+0000","last_active":"2024-09-19T08:54:53.338857+0000","last_peered":"2024-09-19T08:54:53.338857+0000","last_clean":"2024-09-19T08:54:53.338857+0000","last_became_active":"2024-09-19T08:54:53.334162+0000","last_became_peered":"2024-09-19T08:54:53.334162+0000","last_unstale":"2024-09-19T08:54:53.338857+0000","last_undegraded":"2024-09-19T08:54:53.338857+0000","last_fullsized":"2024-09-19T08:54:53.338857+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:38.858918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.280213+0000","last_change":"2024-09-19T08:54:31.441201+0000","last_active":"2024-09-19T08:55:52.280213+0000","last_peered":"2024-09-19T08:55:52.280213+0000","last_clean":"2024-09-19T08:55:52.280213+0000","last_became_active":"2024-09-19T08:54:31.440738+0000","last_became_peered":"2024-09-19T08:54:31.440738+0000","last_unstale":"2024-09-19T08:55:52.280213+0000","last_undegraded":"2024-09-19T08:55:52.280213+0000","last_fullsized":"2024-09-19T08:55:52.280213+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:39.118320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.284175+0000","last_change":"2024-09-19T08:54:31.435772+0000","last_active":"2024-09-19T08:55:52.284175+0000","last_peered":"2024-09-19T08:55:52.284175+0000","last_clean":"2024-09-19T08:55:52.284175+0000","last_became_active":"2024-09-19T08:54:31.435257+0000","last_became_peered":"2024-09-19T08:54:31.435257+0000","last_unstale":"2024-09-19T08:55:52.284175+0000","last_undegraded":"2024-09-19T08:55:52.284175+0000","last_fullsized":"2024-09-19T08:55:52.284175+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:44:12.219054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.341203+0000","last_change":"2024-09-19T08:54:53.341203+0000","last_active":"2024-09-19T08:54:53.341203+0000","last_peered":"2024-09-19T08:54:53.341203+0000","last_clean":"2024-09-19T08:54:53.341203+0000","last_became_active":"2024-09-19T08:54:53.336115+0000","last_became_peered":"2024-09-19T08:54:53.336115+0000","last_unstale":"2024-09-19T08:54:53.341203+0000","last_undegraded":"2024-09-19T08:54:53.341203+0000","last_fullsized":"2024-09-19T08:54:53.341203+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:31.532599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277536+0000","last_change":"2024-09-19T08:54:31.427103+0000","last_active":"2024-09-19T08:55:52.277536+0000","last_peered":"2024-09-19T08:55:52.277536+0000","last_clean":"2024-09-19T08:55:52.277536+0000","last_became_active":"2024-09-19T08:54:31.425958+0000","last_became_peered":"2024-09-19T08:54:31.425958+0000","last_unstale":"2024-09-19T08:55:52.277536+0000","last_undegraded":"2024-09-19T08:55:52.277536+0000","last_fullsized":"2024-09-19T08:55:52.277536+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:36.840940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331317+0000","last_change":"2024-09-19T08:54:29.415209+0000","last_active":"2024-09-19T08:54:53.331317+0000","last_peered":"2024-09-19T08:54:53.331317+0000","last_clean":"2024-09-19T08:54:53.331317+0000","last_became_active":"2024-09-19T08:54:29.414806+0000","last_became_peered":"2024-09-19T08:54:29.414806+0000","last_unstale":"2024-09-19T08:54:53.331317+0000","last_undegraded":"2024-09-19T08:54:53.331317+0000","last_fullsized":"2024-09-19T08:54:53.331317+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:47.764231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.271279+0000","last_change":"2024-09-19T08:54:31.434027+0000","last_active":"2024-09-19T08:55:52.271279+0000","last_peered":"2024-09-19T08:55:52.271279+0000","last_clean":"2024-09-19T08:55:52.271279+0000","last_became_active":"2024-09-19T08:54:31.433687+0000","last_became_peered":"2024-09-19T08:54:31.433687+0000","last_unstale":"2024-09-19T08:55:52.271279+0000","last_undegraded":"2024-09-19T08:55:52.271279+0000","last_fullsized":"2024-09-19T08:55:52.271279+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:56.462128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329231+0000","last_change":"2024-09-19T08:54:29.675502+0000","last_active":"2024-09-19T08:54:53.329231+0000","last_peered":"2024-09-19T08:54:53.329231+0000","last_clean":"2024-09-19T08:54:53.329231+0000","last_became_active":"2024-09-19T08:54:29.675158+0000","last_became_peered":"2024-09-19T08:54:29.675158+0000","last_unstale":"2024-09-19T08:54:53.329231+0000","last_undegraded":"2024-09-19T08:54:53.329231+0000","last_fullsized":"2024-09-19T08:54:53.329231+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:24:59.377521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.278201+0000","last_change":"2024-09-19T08:54:53.334264+0000","last_active":"2024-09-19T08:55:52.278201+0000","last_peered":"2024-09-19T08:55:52.278201+0000","last_clean":"2024-09-19T08:55:52.278201+0000","last_became_active":"2024-09-19T08:54:53.333959+0000","last_became_peered":"2024-09-19T08:54:53.333959+0000","last_unstale":"2024-09-19T08:55:52.278201+0000","last_undegraded":"2024-09-19T08:55:52.278201+0000","last_fullsized":"2024-09-19T08:55:52.278201+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:14.085033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330562+0000","last_change":"2024-09-19T08:54:29.414478+0000","last_active":"2024-09-19T08:54:53.330562+0000","last_peered":"2024-09-19T08:54:53.330562+0000","last_clean":"2024-09-19T08:54:53.330562+0000","last_became_active":"2024-09-19T08:54:29.414152+0000","last_became_peered":"2024-09-19T08:54:29.414152+0000","last_unstale":"2024-09-19T08:54:53.330562+0000","last_undegraded":"2024-09-19T08:54:53.330562+0000","last_fullsized":"2024-09-19T08:54:53.330562+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:17.477340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":62554,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":200,"num_read_kb":162,"num_write":87,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":192727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579938,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":897024,"data_stored":435723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841574,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28564,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716588,"statfs":{"total":95995035648,"available":95965786112,"internally_reserved":0,"allocated":1576960,"data_stored":1088158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005099,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":436305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234032,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":436327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462965,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28488,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716664,"statfs":{"total":95995035648,"available":95965863936,"internally_reserved":0,"allocated":1499136,"data_stored":1026790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593786,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":435840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822719,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32656,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712496,"statfs":{"total":95995035648,"available":95961595904,"internally_reserved":0,"allocated":1507328,"data_stored":1026390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986244,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":435745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215176,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":436061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411405,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":497205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":497479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738454,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":435813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":67129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":61482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":61950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:56:14.316 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T08:56:14.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.454+0000 7feaa6c82640 1 -- 172.21.15.92:0/3091124791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feaa00ffbc0 msgr2=0x7feaa0100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:14.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.454+0000 7feaa6c82640 1 --2- 172.21.15.92:0/3091124791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feaa00ffbc0 0x7feaa0100040 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fea88009900 tx=0x7fea8802a410 comp rx=0 tx=0).stop 2024-09-19T08:56:14.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.454+0000 7feaa6c82640 1 -- 172.21.15.92:0/3091124791 shutdown_connections 2024-09-19T08:56:14.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.454+0000 7feaa6c82640 1 --2- 172.21.15.92:0/3091124791 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feaa0100580 0x7feaa010a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:14.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.454+0000 7feaa6c82640 1 --2- 172.21.15.92:0/3091124791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feaa00ffbc0 0x7feaa0100040 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:14.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.454+0000 7feaa6c82640 1 --2- 172.21.15.92:0/3091124791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaa0103150 0x7feaa0103550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:14.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.454+0000 7feaa6c82640 1 -- 172.21.15.92:0/3091124791 >> 172.21.15.92:0/3091124791 conn(0x7feaa00fb950 msgr2=0x7feaa00fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:14.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.454+0000 7feaa6c82640 1 -- 172.21.15.92:0/3091124791 shutdown_connections 2024-09-19T08:56:14.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.454+0000 7feaa6c82640 1 -- 172.21.15.92:0/3091124791 wait complete. 2024-09-19T08:56:14.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.455+0000 7feaa6c82640 1 Processor -- start 2024-09-19T08:56:14.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.455+0000 7feaa6c82640 1 -- start start 2024-09-19T08:56:14.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.455+0000 7feaa6c82640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feaa00ffbc0 0x7feaa0197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:14.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.455+0000 7feaa6c82640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaa0100580 0x7feaa0198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:14.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.455+0000 7feaa6c82640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feaa0103150 0x7feaa019f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:14.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.455+0000 7feaa6c82640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7feaa010d7a0 con 0x7feaa00ffbc0 2024-09-19T08:56:14.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.455+0000 7feaa6c82640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7feaa010d620 con 0x7feaa0100580 2024-09-19T08:56:14.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.455+0000 7feaa6c82640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7feaa010d920 con 0x7feaa0103150 2024-09-19T08:56:14.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.455+0000 7feaa4a1e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feaa00ffbc0 0x7feaa0197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:14.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.455+0000 7feaa4a1e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feaa00ffbc0 0x7feaa0197e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50330/0 (socket says 172.21.15.92:50330) 2024-09-19T08:56:14.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.455+0000 7feaa4a1e640 1 -- 172.21.15.92:0/771746560 learned_addr learned my addr 172.21.15.92:0/771746560 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:14.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.455+0000 7fea9ffff640 1 --2- 172.21.15.92:0/771746560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaa0100580 0x7feaa0198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:14.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.455+0000 7feaa521f640 1 --2- 172.21.15.92:0/771746560 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feaa0103150 0x7feaa019f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:14.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.455+0000 7feaa4a1e640 1 -- 172.21.15.92:0/771746560 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feaa0103150 msgr2=0x7feaa019f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:14.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.455+0000 7feaa4a1e640 1 --2- 172.21.15.92:0/771746560 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feaa0103150 0x7feaa019f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:14.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.455+0000 7feaa4a1e640 1 -- 172.21.15.92:0/771746560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaa0100580 msgr2=0x7feaa0198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:14.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.455+0000 7feaa4a1e640 1 --2- 172.21.15.92:0/771746560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaa0100580 0x7feaa0198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:14.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.455+0000 7feaa4a1e640 1 -- 172.21.15.92:0/771746560 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaa019fa70 con 0x7feaa00ffbc0 2024-09-19T08:56:14.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.455+0000 7fea9ffff640 1 --2- 172.21.15.92:0/771746560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaa0100580 0x7feaa0198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:14.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.455+0000 7feaa4a1e640 1 --2- 172.21.15.92:0/771746560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feaa00ffbc0 0x7feaa0197e50 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fea9000d770 tx=0x7fea9000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:14.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.456+0000 7fea9dffb640 1 -- 172.21.15.92:0/771746560 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea90017070 con 0x7feaa00ffbc0 2024-09-19T08:56:14.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.456+0000 7fea9dffb640 1 -- 172.21.15.92:0/771746560 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea90009c30 con 0x7feaa00ffbc0 2024-09-19T08:56:14.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.456+0000 7feaa6c82640 1 -- 172.21.15.92:0/771746560 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaa019fd60 con 0x7feaa00ffbc0 2024-09-19T08:56:14.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.456+0000 7fea9dffb640 1 -- 172.21.15.92:0/771746560 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea90003dd0 con 0x7feaa00ffbc0 2024-09-19T08:56:14.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.456+0000 7feaa6c82640 1 -- 172.21.15.92:0/771746560 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaa01a01d0 con 0x7feaa00ffbc0 2024-09-19T08:56:14.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.457+0000 7feaa6c82640 1 -- 172.21.15.92:0/771746560 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaa01090e0 con 0x7feaa00ffbc0 2024-09-19T08:56:14.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.458+0000 7fea9dffb640 1 -- 172.21.15.92:0/771746560 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fea90003fb0 con 0x7feaa00ffbc0 2024-09-19T08:56:14.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.459+0000 7fea9dffb640 1 --2- 172.21.15.92:0/771746560 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fea8c0a3250 0x7fea8c0a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:14.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.459+0000 7fea9ffff640 1 --2- 172.21.15.92:0/771746560 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fea8c0a3250 0x7fea8c0a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:14.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.459+0000 7fea9dffb640 1 -- 172.21.15.92:0/771746560 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fea900cf350 con 0x7feaa00ffbc0 2024-09-19T08:56:14.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.459+0000 7fea9ffff640 1 --2- 172.21.15.92:0/771746560 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fea8c0a3250 0x7fea8c0a5710 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fea88000c00 tx=0x7fea880095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:14.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.463+0000 7fea9dffb640 1 -- 172.21.15.92:0/771746560 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fea9009c070 con 0x7feaa00ffbc0 2024-09-19T08:56:14.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.628+0000 7feaa6c82640 1 -- 172.21.15.92:0/771746560 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feaa0062630 con 0x7fea8c0a3250 2024-09-19T08:56:14.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.634+0000 7fea9dffb640 1 -- 172.21.15.92:0/771746560 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258748 (secure 0 0 0) 0x7feaa0062630 con 0x7fea8c0a3250 2024-09-19T08:56:14.637 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:14.638 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-19T08:56:14.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.637+0000 7feaa6c82640 1 -- 172.21.15.92:0/771746560 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fea8c0a3250 msgr2=0x7fea8c0a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:14.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.637+0000 7feaa6c82640 1 --2- 172.21.15.92:0/771746560 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fea8c0a3250 0x7fea8c0a5710 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fea88000c00 tx=0x7fea880095f0 comp rx=0 tx=0).stop 2024-09-19T08:56:14.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.637+0000 7feaa6c82640 1 -- 172.21.15.92:0/771746560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feaa00ffbc0 msgr2=0x7feaa0197e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:14.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.637+0000 7feaa6c82640 1 --2- 172.21.15.92:0/771746560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feaa00ffbc0 0x7feaa0197e50 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fea9000d770 tx=0x7fea9000dc30 comp rx=0 tx=0).stop 2024-09-19T08:56:14.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.637+0000 7feaa6c82640 1 -- 172.21.15.92:0/771746560 shutdown_connections 2024-09-19T08:56:14.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.637+0000 7feaa6c82640 1 --2- 172.21.15.92:0/771746560 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feaa0103150 0x7feaa019f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:14.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.637+0000 7feaa6c82640 1 --2- 172.21.15.92:0/771746560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaa0100580 0x7feaa0198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:14.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.637+0000 7feaa6c82640 1 --2- 172.21.15.92:0/771746560 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fea8c0a3250 0x7fea8c0a5710 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:14.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.637+0000 7feaa6c82640 1 --2- 172.21.15.92:0/771746560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feaa00ffbc0 0x7feaa0197e50 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:14.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.638+0000 7feaa6c82640 1 -- 172.21.15.92:0/771746560 >> 172.21.15.92:0/771746560 conn(0x7feaa00fb950 msgr2=0x7feaa01062b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:14.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.638+0000 7feaa6c82640 1 -- 172.21.15.92:0/771746560 shutdown_connections 2024-09-19T08:56:14.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.638+0000 7feaa6c82640 1 -- 172.21.15.92:0/771746560 wait complete. 2024-09-19T08:56:14.649 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":323,"stamp":"2024-09-19T08:56:14.280012+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653156,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":326,"num_read_kb":271,"num_write":270,"num_write_kb":3029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":711,"ondisk_log_size":711,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365948,"kb_used_data":12540,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575876,"statfs":{"total":1151940427776,"available":1151565697024,"internally_reserved":0,"allocated":12840960,"data_stored":7187836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":308,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":16,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002756"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277427+0000","last_change":"2024-09-19T08:54:31.437743+0000","last_active":"2024-09-19T08:55:52.277427+0000","last_peered":"2024-09-19T08:55:52.277427+0000","last_clean":"2024-09-19T08:55:52.277427+0000","last_became_active":"2024-09-19T08:54:31.437426+0000","last_became_peered":"2024-09-19T08:54:31.437426+0000","last_unstale":"2024-09-19T08:55:52.277427+0000","last_undegraded":"2024-09-19T08:55:52.277427+0000","last_fullsized":"2024-09-19T08:55:52.277427+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:04.403522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.282945+0000","last_change":"2024-09-19T08:54:31.430322+0000","last_active":"2024-09-19T08:55:52.282945+0000","last_peered":"2024-09-19T08:55:52.282945+0000","last_clean":"2024-09-19T08:55:52.282945+0000","last_became_active":"2024-09-19T08:54:31.430008+0000","last_became_peered":"2024-09-19T08:54:31.430008+0000","last_unstale":"2024-09-19T08:55:52.282945+0000","last_undegraded":"2024-09-19T08:55:52.282945+0000","last_fullsized":"2024-09-19T08:55:52.282945+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:19.800686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.271299+0000","last_change":"2024-09-19T08:54:31.430276+0000","last_active":"2024-09-19T08:55:52.271299+0000","last_peered":"2024-09-19T08:55:52.271299+0000","last_clean":"2024-09-19T08:55:52.271299+0000","last_became_active":"2024-09-19T08:54:31.429939+0000","last_became_peered":"2024-09-19T08:54:31.429939+0000","last_unstale":"2024-09-19T08:55:52.271299+0000","last_undegraded":"2024-09-19T08:55:52.271299+0000","last_fullsized":"2024-09-19T08:55:52.271299+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:08.735067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.260618+0000","last_change":"2024-09-19T08:54:31.435197+0000","last_active":"2024-09-19T08:55:52.260618+0000","last_peered":"2024-09-19T08:55:52.260618+0000","last_clean":"2024-09-19T08:55:52.260618+0000","last_became_active":"2024-09-19T08:54:31.434872+0000","last_became_peered":"2024-09-19T08:54:31.434872+0000","last_unstale":"2024-09-19T08:55:52.260618+0000","last_undegraded":"2024-09-19T08:55:52.260618+0000","last_fullsized":"2024-09-19T08:55:52.260618+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:06.213317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.256859+0000","last_change":"2024-09-19T08:54:31.423765+0000","last_active":"2024-09-19T08:55:52.256859+0000","last_peered":"2024-09-19T08:55:52.256859+0000","last_clean":"2024-09-19T08:55:52.256859+0000","last_became_active":"2024-09-19T08:54:31.423296+0000","last_became_peered":"2024-09-19T08:54:31.423296+0000","last_unstale":"2024-09-19T08:55:52.256859+0000","last_undegraded":"2024-09-19T08:55:52.256859+0000","last_fullsized":"2024-09-19T08:55:52.256859+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:07.507168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.283359+0000","last_change":"2024-09-19T08:54:31.430299+0000","last_active":"2024-09-19T08:55:52.283359+0000","last_peered":"2024-09-19T08:55:52.283359+0000","last_clean":"2024-09-19T08:55:52.283359+0000","last_became_active":"2024-09-19T08:54:31.429951+0000","last_became_peered":"2024-09-19T08:54:31.429951+0000","last_unstale":"2024-09-19T08:55:52.283359+0000","last_undegraded":"2024-09-19T08:55:52.283359+0000","last_fullsized":"2024-09-19T08:55:52.283359+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:11.299729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.278219+0000","last_change":"2024-09-19T08:54:31.435854+0000","last_active":"2024-09-19T08:55:52.278219+0000","last_peered":"2024-09-19T08:55:52.278219+0000","last_clean":"2024-09-19T08:55:52.278219+0000","last_became_active":"2024-09-19T08:54:31.435522+0000","last_became_peered":"2024-09-19T08:54:31.435522+0000","last_unstale":"2024-09-19T08:55:52.278219+0000","last_undegraded":"2024-09-19T08:55:52.278219+0000","last_fullsized":"2024-09-19T08:55:52.278219+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:11.099750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.282506+0000","last_change":"2024-09-19T08:54:31.434574+0000","last_active":"2024-09-19T08:55:52.282506+0000","last_peered":"2024-09-19T08:55:52.282506+0000","last_clean":"2024-09-19T08:55:52.282506+0000","last_became_active":"2024-09-19T08:54:31.434268+0000","last_became_peered":"2024-09-19T08:54:31.434268+0000","last_unstale":"2024-09-19T08:55:52.282506+0000","last_undegraded":"2024-09-19T08:55:52.282506+0000","last_fullsized":"2024-09-19T08:55:52.282506+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:29.159417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.279084+0000","last_change":"2024-09-19T08:54:31.430446+0000","last_active":"2024-09-19T08:55:52.279084+0000","last_peered":"2024-09-19T08:55:52.279084+0000","last_clean":"2024-09-19T08:55:52.279084+0000","last_became_active":"2024-09-19T08:54:31.430048+0000","last_became_peered":"2024-09-19T08:54:31.430048+0000","last_unstale":"2024-09-19T08:55:52.279084+0000","last_undegraded":"2024-09-19T08:55:52.279084+0000","last_fullsized":"2024-09-19T08:55:52.279084+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:24.773947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.283319+0000","last_change":"2024-09-19T08:54:31.433144+0000","last_active":"2024-09-19T08:55:52.283319+0000","last_peered":"2024-09-19T08:55:52.283319+0000","last_clean":"2024-09-19T08:55:52.283319+0000","last_became_active":"2024-09-19T08:54:31.432590+0000","last_became_peered":"2024-09-19T08:54:31.432590+0000","last_unstale":"2024-09-19T08:55:52.283319+0000","last_undegraded":"2024-09-19T08:55:52.283319+0000","last_fullsized":"2024-09-19T08:55:52.283319+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:53.756846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.275955+0000","last_change":"2024-09-19T08:54:31.435712+0000","last_active":"2024-09-19T08:55:52.275955+0000","last_peered":"2024-09-19T08:55:52.275955+0000","last_clean":"2024-09-19T08:55:52.275955+0000","last_became_active":"2024-09-19T08:54:31.435301+0000","last_became_peered":"2024-09-19T08:54:31.435301+0000","last_unstale":"2024-09-19T08:55:52.275955+0000","last_undegraded":"2024-09-19T08:55:52.275955+0000","last_fullsized":"2024-09-19T08:55:52.275955+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:51.703709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.270429+0000","last_change":"2024-09-19T08:54:53.332853+0000","last_active":"2024-09-19T08:55:52.270429+0000","last_peered":"2024-09-19T08:55:52.270429+0000","last_clean":"2024-09-19T08:55:52.270429+0000","last_became_active":"2024-09-19T08:54:53.332460+0000","last_became_peered":"2024-09-19T08:54:53.332460+0000","last_unstale":"2024-09-19T08:55:52.270429+0000","last_undegraded":"2024-09-19T08:55:52.270429+0000","last_fullsized":"2024-09-19T08:55:52.270429+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:47:58.025876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277366+0000","last_change":"2024-09-19T08:54:31.425590+0000","last_active":"2024-09-19T08:55:52.277366+0000","last_peered":"2024-09-19T08:55:52.277366+0000","last_clean":"2024-09-19T08:55:52.277366+0000","last_became_active":"2024-09-19T08:54:31.425268+0000","last_became_peered":"2024-09-19T08:54:31.425268+0000","last_unstale":"2024-09-19T08:55:52.277366+0000","last_undegraded":"2024-09-19T08:55:52.277366+0000","last_fullsized":"2024-09-19T08:55:52.277366+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:09.404947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.283086+0000","last_change":"2024-09-19T08:54:31.428372+0000","last_active":"2024-09-19T08:55:52.283086+0000","last_peered":"2024-09-19T08:55:52.283086+0000","last_clean":"2024-09-19T08:55:52.283086+0000","last_became_active":"2024-09-19T08:54:31.428064+0000","last_became_peered":"2024-09-19T08:54:31.428064+0000","last_unstale":"2024-09-19T08:55:52.283086+0000","last_undegraded":"2024-09-19T08:55:52.283086+0000","last_fullsized":"2024-09-19T08:55:52.283086+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:40.444117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.271059+0000","last_change":"2024-09-19T08:54:31.424365+0000","last_active":"2024-09-19T08:55:52.271059+0000","last_peered":"2024-09-19T08:55:52.271059+0000","last_clean":"2024-09-19T08:55:52.271059+0000","last_became_active":"2024-09-19T08:54:31.424044+0000","last_became_peered":"2024-09-19T08:54:31.424044+0000","last_unstale":"2024-09-19T08:55:52.271059+0000","last_undegraded":"2024-09-19T08:55:52.271059+0000","last_fullsized":"2024-09-19T08:55:52.271059+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:16.435389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.278276+0000","last_change":"2024-09-19T08:54:31.437238+0000","last_active":"2024-09-19T08:55:52.278276+0000","last_peered":"2024-09-19T08:55:52.278276+0000","last_clean":"2024-09-19T08:55:52.278276+0000","last_became_active":"2024-09-19T08:54:31.436867+0000","last_became_peered":"2024-09-19T08:54:31.436867+0000","last_unstale":"2024-09-19T08:55:52.278276+0000","last_undegraded":"2024-09-19T08:55:52.278276+0000","last_fullsized":"2024-09-19T08:55:52.278276+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:59.839081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277741+0000","last_change":"2024-09-19T08:54:31.438654+0000","last_active":"2024-09-19T08:55:52.277741+0000","last_peered":"2024-09-19T08:55:52.277741+0000","last_clean":"2024-09-19T08:55:52.277741+0000","last_became_active":"2024-09-19T08:54:31.438342+0000","last_became_peered":"2024-09-19T08:54:31.438342+0000","last_unstale":"2024-09-19T08:55:52.277741+0000","last_undegraded":"2024-09-19T08:55:52.277741+0000","last_fullsized":"2024-09-19T08:55:52.277741+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:55.190605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.271267+0000","last_change":"2024-09-19T08:54:31.431100+0000","last_active":"2024-09-19T08:55:52.271267+0000","last_peered":"2024-09-19T08:55:52.271267+0000","last_clean":"2024-09-19T08:55:52.271267+0000","last_became_active":"2024-09-19T08:54:31.430749+0000","last_became_peered":"2024-09-19T08:54:31.430749+0000","last_unstale":"2024-09-19T08:55:52.271267+0000","last_undegraded":"2024-09-19T08:55:52.271267+0000","last_fullsized":"2024-09-19T08:55:52.271267+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:50.597610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.261809+0000","last_change":"2024-09-19T08:54:31.427454+0000","last_active":"2024-09-19T08:55:52.261809+0000","last_peered":"2024-09-19T08:55:52.261809+0000","last_clean":"2024-09-19T08:55:52.261809+0000","last_became_active":"2024-09-19T08:54:31.427098+0000","last_became_peered":"2024-09-19T08:54:31.427098+0000","last_unstale":"2024-09-19T08:55:52.261809+0000","last_undegraded":"2024-09-19T08:55:52.261809+0000","last_fullsized":"2024-09-19T08:55:52.261809+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:01.042626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.275970+0000","last_change":"2024-09-19T08:54:31.433887+0000","last_active":"2024-09-19T08:55:52.275970+0000","last_peered":"2024-09-19T08:55:52.275970+0000","last_clean":"2024-09-19T08:55:52.275970+0000","last_became_active":"2024-09-19T08:54:31.433528+0000","last_became_peered":"2024-09-19T08:54:31.433528+0000","last_unstale":"2024-09-19T08:55:52.275970+0000","last_undegraded":"2024-09-19T08:55:52.275970+0000","last_fullsized":"2024-09-19T08:55:52.275970+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:37.291226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.266435+0000","last_change":"2024-09-19T08:54:31.436976+0000","last_active":"2024-09-19T08:55:52.266435+0000","last_peered":"2024-09-19T08:55:52.266435+0000","last_clean":"2024-09-19T08:55:52.266435+0000","last_became_active":"2024-09-19T08:54:31.436646+0000","last_became_peered":"2024-09-19T08:54:31.436646+0000","last_unstale":"2024-09-19T08:55:52.266435+0000","last_undegraded":"2024-09-19T08:55:52.266435+0000","last_fullsized":"2024-09-19T08:55:52.266435+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:19.755556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.278449+0000","last_change":"2024-09-19T08:54:31.438922+0000","last_active":"2024-09-19T08:55:52.278449+0000","last_peered":"2024-09-19T08:55:52.278449+0000","last_clean":"2024-09-19T08:55:52.278449+0000","last_became_active":"2024-09-19T08:54:31.438593+0000","last_became_peered":"2024-09-19T08:54:31.438593+0000","last_unstale":"2024-09-19T08:55:52.278449+0000","last_undegraded":"2024-09-19T08:55:52.278449+0000","last_fullsized":"2024-09-19T08:55:52.278449+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:07.347900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.262522+0000","last_change":"2024-09-19T08:54:31.431659+0000","last_active":"2024-09-19T08:55:52.262522+0000","last_peered":"2024-09-19T08:55:52.262522+0000","last_clean":"2024-09-19T08:55:52.262522+0000","last_became_active":"2024-09-19T08:54:31.431359+0000","last_became_peered":"2024-09-19T08:54:31.431359+0000","last_unstale":"2024-09-19T08:55:52.262522+0000","last_undegraded":"2024-09-19T08:55:52.262522+0000","last_fullsized":"2024-09-19T08:55:52.262522+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:02.421286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.278570+0000","last_change":"2024-09-19T08:54:31.432185+0000","last_active":"2024-09-19T08:55:52.278570+0000","last_peered":"2024-09-19T08:55:52.278570+0000","last_clean":"2024-09-19T08:55:52.278570+0000","last_became_active":"2024-09-19T08:54:31.431418+0000","last_became_peered":"2024-09-19T08:54:31.431418+0000","last_unstale":"2024-09-19T08:55:52.278570+0000","last_undegraded":"2024-09-19T08:55:52.278570+0000","last_fullsized":"2024-09-19T08:55:52.278570+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:45.347487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.256343+0000","last_change":"2024-09-19T08:54:31.433742+0000","last_active":"2024-09-19T08:55:52.256343+0000","last_peered":"2024-09-19T08:55:52.256343+0000","last_clean":"2024-09-19T08:55:52.256343+0000","last_became_active":"2024-09-19T08:54:31.433455+0000","last_became_peered":"2024-09-19T08:54:31.433455+0000","last_unstale":"2024-09-19T08:55:52.256343+0000","last_undegraded":"2024-09-19T08:55:52.256343+0000","last_fullsized":"2024-09-19T08:55:52.256343+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:38.803705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.271146+0000","last_change":"2024-09-19T08:54:31.432954+0000","last_active":"2024-09-19T08:55:52.271146+0000","last_peered":"2024-09-19T08:55:52.271146+0000","last_clean":"2024-09-19T08:55:52.271146+0000","last_became_active":"2024-09-19T08:54:31.432574+0000","last_became_peered":"2024-09-19T08:54:31.432574+0000","last_unstale":"2024-09-19T08:55:52.271146+0000","last_undegraded":"2024-09-19T08:55:52.271146+0000","last_fullsized":"2024-09-19T08:55:52.271146+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:30.457191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.274173+0000","last_change":"2024-09-19T08:54:31.435544+0000","last_active":"2024-09-19T08:55:52.274173+0000","last_peered":"2024-09-19T08:55:52.274173+0000","last_clean":"2024-09-19T08:55:52.274173+0000","last_became_active":"2024-09-19T08:54:31.435195+0000","last_became_peered":"2024-09-19T08:54:31.435195+0000","last_unstale":"2024-09-19T08:55:52.274173+0000","last_undegraded":"2024-09-19T08:55:52.274173+0000","last_fullsized":"2024-09-19T08:55:52.274173+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:54.240654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.266764+0000","last_change":"2024-09-19T08:54:31.428403+0000","last_active":"2024-09-19T08:55:52.266764+0000","last_peered":"2024-09-19T08:55:52.266764+0000","last_clean":"2024-09-19T08:55:52.266764+0000","last_became_active":"2024-09-19T08:54:31.428110+0000","last_became_peered":"2024-09-19T08:54:31.428110+0000","last_unstale":"2024-09-19T08:55:52.266764+0000","last_undegraded":"2024-09-19T08:55:52.266764+0000","last_fullsized":"2024-09-19T08:55:52.266764+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:05.593073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.269495+0000","last_change":"2024-09-19T08:54:31.427291+0000","last_active":"2024-09-19T08:55:52.269495+0000","last_peered":"2024-09-19T08:55:52.269495+0000","last_clean":"2024-09-19T08:55:52.269495+0000","last_became_active":"2024-09-19T08:54:31.427011+0000","last_became_peered":"2024-09-19T08:54:31.427011+0000","last_unstale":"2024-09-19T08:55:52.269495+0000","last_undegraded":"2024-09-19T08:55:52.269495+0000","last_fullsized":"2024-09-19T08:55:52.269495+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:54.338526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.254032+0000","last_change":"2024-09-19T08:54:31.429309+0000","last_active":"2024-09-19T08:55:52.254032+0000","last_peered":"2024-09-19T08:55:52.254032+0000","last_clean":"2024-09-19T08:55:52.254032+0000","last_became_active":"2024-09-19T08:54:31.428381+0000","last_became_peered":"2024-09-19T08:54:31.428381+0000","last_unstale":"2024-09-19T08:55:52.254032+0000","last_undegraded":"2024-09-19T08:55:52.254032+0000","last_fullsized":"2024-09-19T08:55:52.254032+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:22:33.920114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.273963+0000","last_change":"2024-09-19T08:54:53.336591+0000","last_active":"2024-09-19T08:55:52.273963+0000","last_peered":"2024-09-19T08:55:52.273963+0000","last_clean":"2024-09-19T08:55:52.273963+0000","last_became_active":"2024-09-19T08:54:53.336222+0000","last_became_peered":"2024-09-19T08:54:53.336222+0000","last_unstale":"2024-09-19T08:55:52.273963+0000","last_undegraded":"2024-09-19T08:55:52.273963+0000","last_fullsized":"2024-09-19T08:55:52.273963+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:59.019419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277017+0000","last_change":"2024-09-19T08:54:53.335149+0000","last_active":"2024-09-19T08:55:52.277017+0000","last_peered":"2024-09-19T08:55:52.277017+0000","last_clean":"2024-09-19T08:55:52.277017+0000","last_became_active":"2024-09-19T08:54:53.334766+0000","last_became_peered":"2024-09-19T08:54:53.334766+0000","last_unstale":"2024-09-19T08:55:52.277017+0000","last_undegraded":"2024-09-19T08:55:52.277017+0000","last_fullsized":"2024-09-19T08:55:52.277017+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:36.469044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277210+0000","last_change":"2024-09-19T08:54:31.427608+0000","last_active":"2024-09-19T08:55:52.277210+0000","last_peered":"2024-09-19T08:55:52.277210+0000","last_clean":"2024-09-19T08:55:52.277210+0000","last_became_active":"2024-09-19T08:54:31.427294+0000","last_became_peered":"2024-09-19T08:54:31.427294+0000","last_unstale":"2024-09-19T08:55:52.277210+0000","last_undegraded":"2024-09-19T08:55:52.277210+0000","last_fullsized":"2024-09-19T08:55:52.277210+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:41.356609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331158+0000","last_change":"2024-09-19T08:54:29.416204+0000","last_active":"2024-09-19T08:54:53.331158+0000","last_peered":"2024-09-19T08:54:53.331158+0000","last_clean":"2024-09-19T08:54:53.331158+0000","last_became_active":"2024-09-19T08:54:29.415872+0000","last_became_peered":"2024-09-19T08:54:29.415872+0000","last_unstale":"2024-09-19T08:54:53.331158+0000","last_undegraded":"2024-09-19T08:54:53.331158+0000","last_fullsized":"2024-09-19T08:54:53.331158+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:13.844147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.283160+0000","last_change":"2024-09-19T08:54:31.432137+0000","last_active":"2024-09-19T08:55:52.283160+0000","last_peered":"2024-09-19T08:55:52.283160+0000","last_clean":"2024-09-19T08:55:52.283160+0000","last_became_active":"2024-09-19T08:54:31.431761+0000","last_became_peered":"2024-09-19T08:54:31.431761+0000","last_unstale":"2024-09-19T08:55:52.283160+0000","last_undegraded":"2024-09-19T08:55:52.283160+0000","last_fullsized":"2024-09-19T08:55:52.283160+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:05.008431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327676+0000","last_change":"2024-09-19T08:54:29.413221+0000","last_active":"2024-09-19T08:54:53.327676+0000","last_peered":"2024-09-19T08:54:53.327676+0000","last_clean":"2024-09-19T08:54:53.327676+0000","last_became_active":"2024-09-19T08:54:29.412829+0000","last_became_peered":"2024-09-19T08:54:29.412829+0000","last_unstale":"2024-09-19T08:54:53.327676+0000","last_undegraded":"2024-09-19T08:54:53.327676+0000","last_fullsized":"2024-09-19T08:54:53.327676+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:07.224136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.326805+0000","last_change":"2024-09-19T08:54:29.410221+0000","last_active":"2024-09-19T08:54:53.326805+0000","last_peered":"2024-09-19T08:54:53.326805+0000","last_clean":"2024-09-19T08:54:53.326805+0000","last_became_active":"2024-09-19T08:54:29.409951+0000","last_became_peered":"2024-09-19T08:54:29.409951+0000","last_unstale":"2024-09-19T08:54:53.326805+0000","last_undegraded":"2024-09-19T08:54:53.326805+0000","last_fullsized":"2024-09-19T08:54:53.326805+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:58.350932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.259466+0000","last_change":"2024-09-19T08:54:31.429979+0000","last_active":"2024-09-19T08:55:52.259466+0000","last_peered":"2024-09-19T08:55:52.259466+0000","last_clean":"2024-09-19T08:55:52.259466+0000","last_became_active":"2024-09-19T08:54:31.429661+0000","last_became_peered":"2024-09-19T08:54:31.429661+0000","last_unstale":"2024-09-19T08:55:52.259466+0000","last_undegraded":"2024-09-19T08:55:52.259466+0000","last_fullsized":"2024-09-19T08:55:52.259466+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:27:40.603490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331299+0000","last_change":"2024-09-19T08:54:29.415769+0000","last_active":"2024-09-19T08:54:53.331299+0000","last_peered":"2024-09-19T08:54:53.331299+0000","last_clean":"2024-09-19T08:54:53.331299+0000","last_became_active":"2024-09-19T08:54:29.415245+0000","last_became_peered":"2024-09-19T08:54:29.415245+0000","last_unstale":"2024-09-19T08:54:53.331299+0000","last_undegraded":"2024-09-19T08:54:53.331299+0000","last_fullsized":"2024-09-19T08:54:53.331299+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:15.487945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.270548+0000","last_change":"2024-09-19T08:54:31.427126+0000","last_active":"2024-09-19T08:55:52.270548+0000","last_peered":"2024-09-19T08:55:52.270548+0000","last_clean":"2024-09-19T08:55:52.270548+0000","last_became_active":"2024-09-19T08:54:31.426816+0000","last_became_peered":"2024-09-19T08:54:31.426816+0000","last_unstale":"2024-09-19T08:55:52.270548+0000","last_undegraded":"2024-09-19T08:55:52.270548+0000","last_fullsized":"2024-09-19T08:55:52.270548+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:38.039428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327848+0000","last_change":"2024-09-19T08:54:29.411354+0000","last_active":"2024-09-19T08:54:53.327848+0000","last_peered":"2024-09-19T08:54:53.327848+0000","last_clean":"2024-09-19T08:54:53.327848+0000","last_became_active":"2024-09-19T08:54:29.410990+0000","last_became_peered":"2024-09-19T08:54:29.410990+0000","last_unstale":"2024-09-19T08:54:53.327848+0000","last_undegraded":"2024-09-19T08:54:53.327848+0000","last_fullsized":"2024-09-19T08:54:53.327848+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:29.338169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277112+0000","last_change":"2024-09-19T08:54:31.426243+0000","last_active":"2024-09-19T08:55:52.277112+0000","last_peered":"2024-09-19T08:55:52.277112+0000","last_clean":"2024-09-19T08:55:52.277112+0000","last_became_active":"2024-09-19T08:54:31.425895+0000","last_became_peered":"2024-09-19T08:54:31.425895+0000","last_unstale":"2024-09-19T08:55:52.277112+0000","last_undegraded":"2024-09-19T08:55:52.277112+0000","last_fullsized":"2024-09-19T08:55:52.277112+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:13.562780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331102+0000","last_change":"2024-09-19T08:54:29.416646+0000","last_active":"2024-09-19T08:54:53.331102+0000","last_peered":"2024-09-19T08:54:53.331102+0000","last_clean":"2024-09-19T08:54:53.331102+0000","last_became_active":"2024-09-19T08:54:29.416260+0000","last_became_peered":"2024-09-19T08:54:29.416260+0000","last_unstale":"2024-09-19T08:54:53.331102+0000","last_undegraded":"2024-09-19T08:54:53.331102+0000","last_fullsized":"2024-09-19T08:54:53.331102+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:42:17.467035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.276583+0000","last_change":"2024-09-19T08:54:31.435538+0000","last_active":"2024-09-19T08:55:52.276583+0000","last_peered":"2024-09-19T08:55:52.276583+0000","last_clean":"2024-09-19T08:55:52.276583+0000","last_became_active":"2024-09-19T08:54:31.435185+0000","last_became_peered":"2024-09-19T08:54:31.435185+0000","last_unstale":"2024-09-19T08:55:52.276583+0000","last_undegraded":"2024-09-19T08:55:52.276583+0000","last_fullsized":"2024-09-19T08:55:52.276583+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:06.940123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.332501+0000","last_change":"2024-09-19T08:54:29.675914+0000","last_active":"2024-09-19T08:54:53.332501+0000","last_peered":"2024-09-19T08:54:53.332501+0000","last_clean":"2024-09-19T08:54:53.332501+0000","last_became_active":"2024-09-19T08:54:29.675482+0000","last_became_peered":"2024-09-19T08:54:29.675482+0000","last_unstale":"2024-09-19T08:54:53.332501+0000","last_undegraded":"2024-09-19T08:54:53.332501+0000","last_fullsized":"2024-09-19T08:54:53.332501+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:58.893008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.273901+0000","last_change":"2024-09-19T08:54:31.432628+0000","last_active":"2024-09-19T08:55:52.273901+0000","last_peered":"2024-09-19T08:55:52.273901+0000","last_clean":"2024-09-19T08:55:52.273901+0000","last_became_active":"2024-09-19T08:54:31.430640+0000","last_became_peered":"2024-09-19T08:54:31.430640+0000","last_unstale":"2024-09-19T08:55:52.273901+0000","last_undegraded":"2024-09-19T08:55:52.273901+0000","last_fullsized":"2024-09-19T08:55:52.273901+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:07.793089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'30","reported_seq":248,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:56:11.641416+0000","last_change":"2024-09-19T08:54:29.414619+0000","last_active":"2024-09-19T08:56:11.641416+0000","last_peered":"2024-09-19T08:56:11.641416+0000","last_clean":"2024-09-19T08:56:11.641416+0000","last_became_active":"2024-09-19T08:54:29.414295+0000","last_became_peered":"2024-09-19T08:54:29.414295+0000","last_unstale":"2024-09-19T08:56:11.641416+0000","last_undegraded":"2024-09-19T08:56:11.641416+0000","last_fullsized":"2024-09-19T08:56:11.641416+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:23.782684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61756,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":196,"num_read_kb":158,"num_write":30,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.276986+0000","last_change":"2024-09-19T08:54:31.425432+0000","last_active":"2024-09-19T08:55:52.276986+0000","last_peered":"2024-09-19T08:55:52.276986+0000","last_clean":"2024-09-19T08:55:52.276986+0000","last_became_active":"2024-09-19T08:54:31.425086+0000","last_became_peered":"2024-09-19T08:54:31.425086+0000","last_unstale":"2024-09-19T08:55:52.276986+0000","last_undegraded":"2024-09-19T08:55:52.276986+0000","last_fullsized":"2024-09-19T08:55:52.276986+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:56.572339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330371+0000","last_change":"2024-09-19T08:54:29.415055+0000","last_active":"2024-09-19T08:54:53.330371+0000","last_peered":"2024-09-19T08:54:53.330371+0000","last_clean":"2024-09-19T08:54:53.330371+0000","last_became_active":"2024-09-19T08:54:29.414573+0000","last_became_peered":"2024-09-19T08:54:29.414573+0000","last_unstale":"2024-09-19T08:54:53.330371+0000","last_undegraded":"2024-09-19T08:54:53.330371+0000","last_fullsized":"2024-09-19T08:54:53.330371+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:13.013714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.260081+0000","last_change":"2024-09-19T08:54:31.436905+0000","last_active":"2024-09-19T08:55:52.260081+0000","last_peered":"2024-09-19T08:55:52.260081+0000","last_clean":"2024-09-19T08:55:52.260081+0000","last_became_active":"2024-09-19T08:54:31.436571+0000","last_became_peered":"2024-09-19T08:54:31.436571+0000","last_unstale":"2024-09-19T08:55:52.260081+0000","last_undegraded":"2024-09-19T08:55:52.260081+0000","last_fullsized":"2024-09-19T08:55:52.260081+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:55.294255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330834+0000","last_change":"2024-09-19T08:54:29.417958+0000","last_active":"2024-09-19T08:54:53.330834+0000","last_peered":"2024-09-19T08:54:53.330834+0000","last_clean":"2024-09-19T08:54:53.330834+0000","last_became_active":"2024-09-19T08:54:29.417570+0000","last_became_peered":"2024-09-19T08:54:29.417570+0000","last_unstale":"2024-09-19T08:54:53.330834+0000","last_undegraded":"2024-09-19T08:54:53.330834+0000","last_fullsized":"2024-09-19T08:54:53.330834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:25.557217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.279834+0000","last_change":"2024-09-19T08:54:31.433019+0000","last_active":"2024-09-19T08:55:52.279834+0000","last_peered":"2024-09-19T08:55:52.279834+0000","last_clean":"2024-09-19T08:55:52.279834+0000","last_became_active":"2024-09-19T08:54:31.431265+0000","last_became_peered":"2024-09-19T08:54:31.431265+0000","last_unstale":"2024-09-19T08:55:52.279834+0000","last_undegraded":"2024-09-19T08:55:52.279834+0000","last_fullsized":"2024-09-19T08:55:52.279834+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:36.481863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.979100+0000","last_change":"2024-09-19T08:54:29.414236+0000","last_active":"2024-09-19T08:54:53.979100+0000","last_peered":"2024-09-19T08:54:53.979100+0000","last_clean":"2024-09-19T08:54:53.979100+0000","last_became_active":"2024-09-19T08:54:29.413878+0000","last_became_peered":"2024-09-19T08:54:29.413878+0000","last_unstale":"2024-09-19T08:54:53.979100+0000","last_undegraded":"2024-09-19T08:54:53.979100+0000","last_fullsized":"2024-09-19T08:54:53.979100+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:11.222362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.279321+0000","last_change":"2024-09-19T08:54:31.439512+0000","last_active":"2024-09-19T08:55:52.279321+0000","last_peered":"2024-09-19T08:55:52.279321+0000","last_clean":"2024-09-19T08:55:52.279321+0000","last_became_active":"2024-09-19T08:54:31.438767+0000","last_became_peered":"2024-09-19T08:54:31.438767+0000","last_unstale":"2024-09-19T08:55:52.279321+0000","last_undegraded":"2024-09-19T08:55:52.279321+0000","last_fullsized":"2024-09-19T08:55:52.279321+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:31.784577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330687+0000","last_change":"2024-09-19T08:54:29.675768+0000","last_active":"2024-09-19T08:54:53.330687+0000","last_peered":"2024-09-19T08:54:53.330687+0000","last_clean":"2024-09-19T08:54:53.330687+0000","last_became_active":"2024-09-19T08:54:29.675376+0000","last_became_peered":"2024-09-19T08:54:29.675376+0000","last_unstale":"2024-09-19T08:54:53.330687+0000","last_undegraded":"2024-09-19T08:54:53.330687+0000","last_fullsized":"2024-09-19T08:54:53.330687+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:10.281126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.282865+0000","last_change":"2024-09-19T08:54:31.435904+0000","last_active":"2024-09-19T08:55:52.282865+0000","last_peered":"2024-09-19T08:55:52.282865+0000","last_clean":"2024-09-19T08:55:52.282865+0000","last_became_active":"2024-09-19T08:54:31.435396+0000","last_became_peered":"2024-09-19T08:54:31.435396+0000","last_unstale":"2024-09-19T08:55:52.282865+0000","last_undegraded":"2024-09-19T08:55:52.282865+0000","last_fullsized":"2024-09-19T08:55:52.282865+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:41.567463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331746+0000","last_change":"2024-09-19T08:54:29.410221+0000","last_active":"2024-09-19T08:54:53.331746+0000","last_peered":"2024-09-19T08:54:53.331746+0000","last_clean":"2024-09-19T08:54:53.331746+0000","last_became_active":"2024-09-19T08:54:29.409856+0000","last_became_peered":"2024-09-19T08:54:29.409856+0000","last_unstale":"2024-09-19T08:54:53.331746+0000","last_undegraded":"2024-09-19T08:54:53.331746+0000","last_fullsized":"2024-09-19T08:54:53.331746+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:46.095816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.270387+0000","last_change":"2024-09-19T08:54:31.437854+0000","last_active":"2024-09-19T08:55:52.270387+0000","last_peered":"2024-09-19T08:55:52.270387+0000","last_clean":"2024-09-19T08:55:52.270387+0000","last_became_active":"2024-09-19T08:54:31.437491+0000","last_became_peered":"2024-09-19T08:54:31.437491+0000","last_unstale":"2024-09-19T08:55:52.270387+0000","last_undegraded":"2024-09-19T08:55:52.270387+0000","last_fullsized":"2024-09-19T08:55:52.270387+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:22.532429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.983440+0000","last_change":"2024-09-19T08:54:53.983440+0000","last_active":"2024-09-19T08:54:53.983440+0000","last_peered":"2024-09-19T08:54:53.983440+0000","last_clean":"2024-09-19T08:54:53.983440+0000","last_became_active":"2024-09-19T08:54:53.980971+0000","last_became_peered":"2024-09-19T08:54:53.980971+0000","last_unstale":"2024-09-19T08:54:53.983440+0000","last_undegraded":"2024-09-19T08:54:53.983440+0000","last_fullsized":"2024-09-19T08:54:53.983440+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:33.070904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.278128+0000","last_change":"2024-09-19T08:54:31.429376+0000","last_active":"2024-09-19T08:55:52.278128+0000","last_peered":"2024-09-19T08:55:52.278128+0000","last_clean":"2024-09-19T08:55:52.278128+0000","last_became_active":"2024-09-19T08:54:31.429006+0000","last_became_peered":"2024-09-19T08:54:31.429006+0000","last_unstale":"2024-09-19T08:55:52.278128+0000","last_undegraded":"2024-09-19T08:55:52.278128+0000","last_fullsized":"2024-09-19T08:55:52.278128+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:26.399838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.332608+0000","last_change":"2024-09-19T08:54:29.414307+0000","last_active":"2024-09-19T08:54:53.332608+0000","last_peered":"2024-09-19T08:54:53.332608+0000","last_clean":"2024-09-19T08:54:53.332608+0000","last_became_active":"2024-09-19T08:54:29.413823+0000","last_became_peered":"2024-09-19T08:54:29.413823+0000","last_unstale":"2024-09-19T08:54:53.332608+0000","last_undegraded":"2024-09-19T08:54:53.332608+0000","last_fullsized":"2024-09-19T08:54:53.332608+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:25.484645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.279004+0000","last_change":"2024-09-19T08:54:31.437789+0000","last_active":"2024-09-19T08:55:52.279004+0000","last_peered":"2024-09-19T08:55:52.279004+0000","last_clean":"2024-09-19T08:55:52.279004+0000","last_became_active":"2024-09-19T08:54:31.435488+0000","last_became_peered":"2024-09-19T08:54:31.435488+0000","last_unstale":"2024-09-19T08:55:52.279004+0000","last_undegraded":"2024-09-19T08:55:52.279004+0000","last_fullsized":"2024-09-19T08:55:52.279004+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:19.332440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.333662+0000","last_change":"2024-09-19T08:54:53.333120+0000","last_active":"2024-09-19T08:54:53.333662+0000","last_peered":"2024-09-19T08:54:53.333662+0000","last_clean":"2024-09-19T08:54:53.333662+0000","last_became_active":"2024-09-19T08:54:53.332711+0000","last_became_peered":"2024-09-19T08:54:53.332711+0000","last_unstale":"2024-09-19T08:54:53.333662+0000","last_undegraded":"2024-09-19T08:54:53.333662+0000","last_fullsized":"2024-09-19T08:54:53.333662+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:18.359002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.279878+0000","last_change":"2024-09-19T08:54:31.434564+0000","last_active":"2024-09-19T08:55:52.279878+0000","last_peered":"2024-09-19T08:55:52.279878+0000","last_clean":"2024-09-19T08:55:52.279878+0000","last_became_active":"2024-09-19T08:54:31.434231+0000","last_became_peered":"2024-09-19T08:54:31.434231+0000","last_unstale":"2024-09-19T08:55:52.279878+0000","last_undegraded":"2024-09-19T08:55:52.279878+0000","last_fullsized":"2024-09-19T08:55:52.279878+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:31.316400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":335,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331130+0000","last_change":"2024-09-19T08:53:21.357560+0000","last_active":"2024-09-19T08:54:53.331130+0000","last_peered":"2024-09-19T08:54:53.331130+0000","last_clean":"2024-09-19T08:54:53.331130+0000","last_became_active":"2024-09-19T08:53:21.357122+0000","last_became_peered":"2024-09-19T08:53:21.357122+0000","last_unstale":"2024-09-19T08:54:53.331130+0000","last_undegraded":"2024-09-19T08:54:53.331130+0000","last_fullsized":"2024-09-19T08:54:53.331130+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:05.231370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:05.231370+0000","last_clean_scrub_stamp":"2024-09-19T08:50:05.231370+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:47.867682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.979104+0000","last_change":"2024-09-19T08:54:29.412240+0000","last_active":"2024-09-19T08:54:53.979104+0000","last_peered":"2024-09-19T08:54:53.979104+0000","last_clean":"2024-09-19T08:54:53.979104+0000","last_became_active":"2024-09-19T08:54:29.411908+0000","last_became_peered":"2024-09-19T08:54:29.411908+0000","last_unstale":"2024-09-19T08:54:53.979104+0000","last_undegraded":"2024-09-19T08:54:53.979104+0000","last_fullsized":"2024-09-19T08:54:53.979104+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:37.189373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277537+0000","last_change":"2024-09-19T08:54:31.432956+0000","last_active":"2024-09-19T08:55:52.277537+0000","last_peered":"2024-09-19T08:55:52.277537+0000","last_clean":"2024-09-19T08:55:52.277537+0000","last_became_active":"2024-09-19T08:54:31.432639+0000","last_became_peered":"2024-09-19T08:54:31.432639+0000","last_unstale":"2024-09-19T08:55:52.277537+0000","last_undegraded":"2024-09-19T08:55:52.277537+0000","last_fullsized":"2024-09-19T08:55:52.277537+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:58.302624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331178+0000","last_change":"2024-09-19T08:54:29.414214+0000","last_active":"2024-09-19T08:54:53.331178+0000","last_peered":"2024-09-19T08:54:53.331178+0000","last_clean":"2024-09-19T08:54:53.331178+0000","last_became_active":"2024-09-19T08:54:29.413853+0000","last_became_peered":"2024-09-19T08:54:29.413853+0000","last_unstale":"2024-09-19T08:54:53.331178+0000","last_undegraded":"2024-09-19T08:54:53.331178+0000","last_fullsized":"2024-09-19T08:54:53.331178+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:28:29.119856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.266896+0000","last_change":"2024-09-19T08:54:31.424643+0000","last_active":"2024-09-19T08:55:52.266896+0000","last_peered":"2024-09-19T08:55:52.266896+0000","last_clean":"2024-09-19T08:55:52.266896+0000","last_became_active":"2024-09-19T08:54:31.424363+0000","last_became_peered":"2024-09-19T08:54:31.424363+0000","last_unstale":"2024-09-19T08:55:52.266896+0000","last_undegraded":"2024-09-19T08:55:52.266896+0000","last_fullsized":"2024-09-19T08:55:52.266896+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:37.529952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.326916+0000","last_change":"2024-09-19T08:54:29.675742+0000","last_active":"2024-09-19T08:54:53.326916+0000","last_peered":"2024-09-19T08:54:53.326916+0000","last_clean":"2024-09-19T08:54:53.326916+0000","last_became_active":"2024-09-19T08:54:29.675347+0000","last_became_peered":"2024-09-19T08:54:29.675347+0000","last_unstale":"2024-09-19T08:54:53.326916+0000","last_undegraded":"2024-09-19T08:54:53.326916+0000","last_fullsized":"2024-09-19T08:54:53.326916+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:00.925390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.283427+0000","last_change":"2024-09-19T08:54:31.433887+0000","last_active":"2024-09-19T08:55:52.283427+0000","last_peered":"2024-09-19T08:55:52.283427+0000","last_clean":"2024-09-19T08:55:52.283427+0000","last_became_active":"2024-09-19T08:54:31.433331+0000","last_became_peered":"2024-09-19T08:54:31.433331+0000","last_unstale":"2024-09-19T08:55:52.283427+0000","last_undegraded":"2024-09-19T08:55:52.283427+0000","last_fullsized":"2024-09-19T08:55:52.283427+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:49.875061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331491+0000","last_change":"2024-09-19T08:54:29.417410+0000","last_active":"2024-09-19T08:54:53.331491+0000","last_peered":"2024-09-19T08:54:53.331491+0000","last_clean":"2024-09-19T08:54:53.331491+0000","last_became_active":"2024-09-19T08:54:29.417018+0000","last_became_peered":"2024-09-19T08:54:29.417018+0000","last_unstale":"2024-09-19T08:54:53.331491+0000","last_undegraded":"2024-09-19T08:54:53.331491+0000","last_fullsized":"2024-09-19T08:54:53.331491+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:53.669027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.280825+0000","last_change":"2024-09-19T08:54:31.431313+0000","last_active":"2024-09-19T08:55:52.280825+0000","last_peered":"2024-09-19T08:55:52.280825+0000","last_clean":"2024-09-19T08:55:52.280825+0000","last_became_active":"2024-09-19T08:54:31.429427+0000","last_became_peered":"2024-09-19T08:54:31.429427+0000","last_unstale":"2024-09-19T08:55:52.280825+0000","last_undegraded":"2024-09-19T08:55:52.280825+0000","last_fullsized":"2024-09-19T08:55:52.280825+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:55.106769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330517+0000","last_change":"2024-09-19T08:54:29.675722+0000","last_active":"2024-09-19T08:54:53.330517+0000","last_peered":"2024-09-19T08:54:53.330517+0000","last_clean":"2024-09-19T08:54:53.330517+0000","last_became_active":"2024-09-19T08:54:29.675397+0000","last_became_peered":"2024-09-19T08:54:29.675397+0000","last_unstale":"2024-09-19T08:54:53.330517+0000","last_undegraded":"2024-09-19T08:54:53.330517+0000","last_fullsized":"2024-09-19T08:54:53.330517+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:49.574947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.283206+0000","last_change":"2024-09-19T08:54:31.431106+0000","last_active":"2024-09-19T08:55:52.283206+0000","last_peered":"2024-09-19T08:55:52.283206+0000","last_clean":"2024-09-19T08:55:52.283206+0000","last_became_active":"2024-09-19T08:54:31.430745+0000","last_became_peered":"2024-09-19T08:54:31.430745+0000","last_unstale":"2024-09-19T08:55:52.283206+0000","last_undegraded":"2024-09-19T08:55:52.283206+0000","last_fullsized":"2024-09-19T08:55:52.283206+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:22.714106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331431+0000","last_change":"2024-09-19T08:54:29.675985+0000","last_active":"2024-09-19T08:54:53.331431+0000","last_peered":"2024-09-19T08:54:53.331431+0000","last_clean":"2024-09-19T08:54:53.331431+0000","last_became_active":"2024-09-19T08:54:29.675374+0000","last_became_peered":"2024-09-19T08:54:29.675374+0000","last_unstale":"2024-09-19T08:54:53.331431+0000","last_undegraded":"2024-09-19T08:54:53.331431+0000","last_fullsized":"2024-09-19T08:54:53.331431+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:06.664621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.260250+0000","last_change":"2024-09-19T08:54:31.423493+0000","last_active":"2024-09-19T08:55:52.260250+0000","last_peered":"2024-09-19T08:55:52.260250+0000","last_clean":"2024-09-19T08:55:52.260250+0000","last_became_active":"2024-09-19T08:54:31.422651+0000","last_became_peered":"2024-09-19T08:54:31.422651+0000","last_unstale":"2024-09-19T08:55:52.260250+0000","last_undegraded":"2024-09-19T08:55:52.260250+0000","last_fullsized":"2024-09-19T08:55:52.260250+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:51.863965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'10","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:55.435276+0000","last_change":"2024-09-19T08:54:29.408571+0000","last_active":"2024-09-19T08:54:55.435276+0000","last_peered":"2024-09-19T08:54:55.435276+0000","last_clean":"2024-09-19T08:54:55.435276+0000","last_became_active":"2024-09-19T08:54:29.408142+0000","last_became_peered":"2024-09-19T08:54:29.408142+0000","last_unstale":"2024-09-19T08:54:55.435276+0000","last_undegraded":"2024-09-19T08:54:55.435276+0000","last_fullsized":"2024-09-19T08:54:55.435276+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:34.578230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.262764+0000","last_change":"2024-09-19T08:54:31.435333+0000","last_active":"2024-09-19T08:55:52.262764+0000","last_peered":"2024-09-19T08:55:52.262764+0000","last_clean":"2024-09-19T08:55:52.262764+0000","last_became_active":"2024-09-19T08:54:31.435041+0000","last_became_peered":"2024-09-19T08:54:31.435041+0000","last_unstale":"2024-09-19T08:55:52.262764+0000","last_undegraded":"2024-09-19T08:55:52.262764+0000","last_fullsized":"2024-09-19T08:55:52.262764+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:40.972638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.979153+0000","last_change":"2024-09-19T08:54:29.554303+0000","last_active":"2024-09-19T08:54:53.979153+0000","last_peered":"2024-09-19T08:54:53.979153+0000","last_clean":"2024-09-19T08:54:53.979153+0000","last_became_active":"2024-09-19T08:54:29.553919+0000","last_became_peered":"2024-09-19T08:54:29.553919+0000","last_unstale":"2024-09-19T08:54:53.979153+0000","last_undegraded":"2024-09-19T08:54:53.979153+0000","last_fullsized":"2024-09-19T08:54:53.979153+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:25.103926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.279407+0000","last_change":"2024-09-19T08:54:53.333280+0000","last_active":"2024-09-19T08:55:52.279407+0000","last_peered":"2024-09-19T08:55:52.279407+0000","last_clean":"2024-09-19T08:55:52.279407+0000","last_became_active":"2024-09-19T08:54:53.332881+0000","last_became_peered":"2024-09-19T08:54:53.332881+0000","last_unstale":"2024-09-19T08:55:52.279407+0000","last_undegraded":"2024-09-19T08:55:52.279407+0000","last_fullsized":"2024-09-19T08:55:52.279407+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:55.880616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329946+0000","last_change":"2024-09-19T08:54:29.675665+0000","last_active":"2024-09-19T08:54:53.329946+0000","last_peered":"2024-09-19T08:54:53.329946+0000","last_clean":"2024-09-19T08:54:53.329946+0000","last_became_active":"2024-09-19T08:54:29.675367+0000","last_became_peered":"2024-09-19T08:54:29.675367+0000","last_unstale":"2024-09-19T08:54:53.329946+0000","last_undegraded":"2024-09-19T08:54:53.329946+0000","last_fullsized":"2024-09-19T08:54:53.329946+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:35.473243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.237269+0000","last_change":"2024-09-19T08:54:31.430837+0000","last_active":"2024-09-19T08:55:52.237269+0000","last_peered":"2024-09-19T08:55:52.237269+0000","last_clean":"2024-09-19T08:55:52.237269+0000","last_became_active":"2024-09-19T08:54:31.430465+0000","last_became_peered":"2024-09-19T08:54:31.430465+0000","last_unstale":"2024-09-19T08:55:52.237269+0000","last_undegraded":"2024-09-19T08:55:52.237269+0000","last_fullsized":"2024-09-19T08:55:52.237269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:50.524730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329067+0000","last_change":"2024-09-19T08:54:29.413803+0000","last_active":"2024-09-19T08:54:53.329067+0000","last_peered":"2024-09-19T08:54:53.329067+0000","last_clean":"2024-09-19T08:54:53.329067+0000","last_became_active":"2024-09-19T08:54:29.413400+0000","last_became_peered":"2024-09-19T08:54:29.413400+0000","last_unstale":"2024-09-19T08:54:53.329067+0000","last_undegraded":"2024-09-19T08:54:53.329067+0000","last_fullsized":"2024-09-19T08:54:53.329067+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:12.518454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.271551+0000","last_change":"2024-09-19T08:54:31.428451+0000","last_active":"2024-09-19T08:55:52.271551+0000","last_peered":"2024-09-19T08:55:52.271551+0000","last_clean":"2024-09-19T08:55:52.271551+0000","last_became_active":"2024-09-19T08:54:31.428134+0000","last_became_peered":"2024-09-19T08:54:31.428134+0000","last_unstale":"2024-09-19T08:55:52.271551+0000","last_undegraded":"2024-09-19T08:55:52.271551+0000","last_fullsized":"2024-09-19T08:55:52.271551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:08.260183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329914+0000","last_change":"2024-09-19T08:54:29.414399+0000","last_active":"2024-09-19T08:54:53.329914+0000","last_peered":"2024-09-19T08:54:53.329914+0000","last_clean":"2024-09-19T08:54:53.329914+0000","last_became_active":"2024-09-19T08:54:29.413080+0000","last_became_peered":"2024-09-19T08:54:29.413080+0000","last_unstale":"2024-09-19T08:54:53.329914+0000","last_undegraded":"2024-09-19T08:54:53.329914+0000","last_fullsized":"2024-09-19T08:54:53.329914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:27.308297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.282381+0000","last_change":"2024-09-19T08:54:31.434550+0000","last_active":"2024-09-19T08:55:52.282381+0000","last_peered":"2024-09-19T08:55:52.282381+0000","last_clean":"2024-09-19T08:55:52.282381+0000","last_became_active":"2024-09-19T08:54:31.434195+0000","last_became_peered":"2024-09-19T08:54:31.434195+0000","last_unstale":"2024-09-19T08:55:52.282381+0000","last_undegraded":"2024-09-19T08:55:52.282381+0000","last_fullsized":"2024-09-19T08:55:52.282381+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:04.807833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.338857+0000","last_change":"2024-09-19T08:54:53.338857+0000","last_active":"2024-09-19T08:54:53.338857+0000","last_peered":"2024-09-19T08:54:53.338857+0000","last_clean":"2024-09-19T08:54:53.338857+0000","last_became_active":"2024-09-19T08:54:53.334162+0000","last_became_peered":"2024-09-19T08:54:53.334162+0000","last_unstale":"2024-09-19T08:54:53.338857+0000","last_undegraded":"2024-09-19T08:54:53.338857+0000","last_fullsized":"2024-09-19T08:54:53.338857+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:38.858918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.280213+0000","last_change":"2024-09-19T08:54:31.441201+0000","last_active":"2024-09-19T08:55:52.280213+0000","last_peered":"2024-09-19T08:55:52.280213+0000","last_clean":"2024-09-19T08:55:52.280213+0000","last_became_active":"2024-09-19T08:54:31.440738+0000","last_became_peered":"2024-09-19T08:54:31.440738+0000","last_unstale":"2024-09-19T08:55:52.280213+0000","last_undegraded":"2024-09-19T08:55:52.280213+0000","last_fullsized":"2024-09-19T08:55:52.280213+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:39.118320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.284175+0000","last_change":"2024-09-19T08:54:31.435772+0000","last_active":"2024-09-19T08:55:52.284175+0000","last_peered":"2024-09-19T08:55:52.284175+0000","last_clean":"2024-09-19T08:55:52.284175+0000","last_became_active":"2024-09-19T08:54:31.435257+0000","last_became_peered":"2024-09-19T08:54:31.435257+0000","last_unstale":"2024-09-19T08:55:52.284175+0000","last_undegraded":"2024-09-19T08:55:52.284175+0000","last_fullsized":"2024-09-19T08:55:52.284175+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:44:12.219054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.341203+0000","last_change":"2024-09-19T08:54:53.341203+0000","last_active":"2024-09-19T08:54:53.341203+0000","last_peered":"2024-09-19T08:54:53.341203+0000","last_clean":"2024-09-19T08:54:53.341203+0000","last_became_active":"2024-09-19T08:54:53.336115+0000","last_became_peered":"2024-09-19T08:54:53.336115+0000","last_unstale":"2024-09-19T08:54:53.341203+0000","last_undegraded":"2024-09-19T08:54:53.341203+0000","last_fullsized":"2024-09-19T08:54:53.341203+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:31.532599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277536+0000","last_change":"2024-09-19T08:54:31.427103+0000","last_active":"2024-09-19T08:55:52.277536+0000","last_peered":"2024-09-19T08:55:52.277536+0000","last_clean":"2024-09-19T08:55:52.277536+0000","last_became_active":"2024-09-19T08:54:31.425958+0000","last_became_peered":"2024-09-19T08:54:31.425958+0000","last_unstale":"2024-09-19T08:55:52.277536+0000","last_undegraded":"2024-09-19T08:55:52.277536+0000","last_fullsized":"2024-09-19T08:55:52.277536+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:36.840940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331317+0000","last_change":"2024-09-19T08:54:29.415209+0000","last_active":"2024-09-19T08:54:53.331317+0000","last_peered":"2024-09-19T08:54:53.331317+0000","last_clean":"2024-09-19T08:54:53.331317+0000","last_became_active":"2024-09-19T08:54:29.414806+0000","last_became_peered":"2024-09-19T08:54:29.414806+0000","last_unstale":"2024-09-19T08:54:53.331317+0000","last_undegraded":"2024-09-19T08:54:53.331317+0000","last_fullsized":"2024-09-19T08:54:53.331317+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:47.764231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.271279+0000","last_change":"2024-09-19T08:54:31.434027+0000","last_active":"2024-09-19T08:55:52.271279+0000","last_peered":"2024-09-19T08:55:52.271279+0000","last_clean":"2024-09-19T08:55:52.271279+0000","last_became_active":"2024-09-19T08:54:31.433687+0000","last_became_peered":"2024-09-19T08:54:31.433687+0000","last_unstale":"2024-09-19T08:55:52.271279+0000","last_undegraded":"2024-09-19T08:55:52.271279+0000","last_fullsized":"2024-09-19T08:55:52.271279+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:56.462128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329231+0000","last_change":"2024-09-19T08:54:29.675502+0000","last_active":"2024-09-19T08:54:53.329231+0000","last_peered":"2024-09-19T08:54:53.329231+0000","last_clean":"2024-09-19T08:54:53.329231+0000","last_became_active":"2024-09-19T08:54:29.675158+0000","last_became_peered":"2024-09-19T08:54:29.675158+0000","last_unstale":"2024-09-19T08:54:53.329231+0000","last_undegraded":"2024-09-19T08:54:53.329231+0000","last_fullsized":"2024-09-19T08:54:53.329231+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:24:59.377521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.278201+0000","last_change":"2024-09-19T08:54:53.334264+0000","last_active":"2024-09-19T08:55:52.278201+0000","last_peered":"2024-09-19T08:55:52.278201+0000","last_clean":"2024-09-19T08:55:52.278201+0000","last_became_active":"2024-09-19T08:54:53.333959+0000","last_became_peered":"2024-09-19T08:54:53.333959+0000","last_unstale":"2024-09-19T08:55:52.278201+0000","last_undegraded":"2024-09-19T08:55:52.278201+0000","last_fullsized":"2024-09-19T08:55:52.278201+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:14.085033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330562+0000","last_change":"2024-09-19T08:54:29.414478+0000","last_active":"2024-09-19T08:54:53.330562+0000","last_peered":"2024-09-19T08:54:53.330562+0000","last_clean":"2024-09-19T08:54:53.330562+0000","last_became_active":"2024-09-19T08:54:29.414152+0000","last_became_peered":"2024-09-19T08:54:29.414152+0000","last_unstale":"2024-09-19T08:54:53.330562+0000","last_undegraded":"2024-09-19T08:54:53.330562+0000","last_fullsized":"2024-09-19T08:54:53.330562+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:17.477340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":62554,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":200,"num_read_kb":162,"num_write":87,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":192727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579938,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":897024,"data_stored":435723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841574,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28564,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716588,"statfs":{"total":95995035648,"available":95965786112,"internally_reserved":0,"allocated":1576960,"data_stored":1088158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005099,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":436305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234032,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":436327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462965,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28488,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716664,"statfs":{"total":95995035648,"available":95965863936,"internally_reserved":0,"allocated":1499136,"data_stored":1026790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593786,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":435840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822719,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32656,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712496,"statfs":{"total":95995035648,"available":95961595904,"internally_reserved":0,"allocated":1507328,"data_stored":1026390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986244,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":435745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215176,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":436061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411405,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":497205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":497479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738454,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":435813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":67129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":61482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":61950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:56:14.653 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-19T08:56:14.653 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T08:56:14.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.790+0000 7fd286198640 1 -- 172.21.15.92:0/4139736530 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2801025e0 msgr2=0x7fd280108e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:14.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.790+0000 7fd286198640 1 --2- 172.21.15.92:0/4139736530 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2801025e0 0x7fd280108e70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd278009ca0 tx=0x7fd27802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:56:14.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.790+0000 7fd286198640 1 -- 172.21.15.92:0/4139736530 shutdown_connections 2024-09-19T08:56:14.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.790+0000 7fd286198640 1 --2- 172.21.15.92:0/4139736530 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2801025e0 0x7fd280108e70 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:14.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.790+0000 7fd286198640 1 --2- 172.21.15.92:0/4139736530 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd280101c20 0x7fd2801020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:14.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.790+0000 7fd286198640 1 --2- 172.21.15.92:0/4139736530 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd280100a30 0x7fd280100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:14.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.790+0000 7fd286198640 1 -- 172.21.15.92:0/4139736530 >> 172.21.15.92:0/4139736530 conn(0x7fd2800fc1b0 msgr2=0x7fd2800fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:14.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.790+0000 7fd286198640 1 -- 172.21.15.92:0/4139736530 shutdown_connections 2024-09-19T08:56:14.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.790+0000 7fd286198640 1 -- 172.21.15.92:0/4139736530 wait complete. 2024-09-19T08:56:14.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.790+0000 7fd286198640 1 Processor -- start 2024-09-19T08:56:14.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.791+0000 7fd286198640 1 -- start start 2024-09-19T08:56:14.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.791+0000 7fd286198640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd280100a30 0x7fd28019a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:14.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.791+0000 7fd286198640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd280101c20 0x7fd28019a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:14.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.791+0000 7fd286198640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2801025e0 0x7fd2801a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:14.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.791+0000 7fd286198640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd28010c6e0 con 0x7fd2801025e0 2024-09-19T08:56:14.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.791+0000 7fd286198640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd28010c560 con 0x7fd280101c20 2024-09-19T08:56:14.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.791+0000 7fd286198640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd28010c860 con 0x7fd280100a30 2024-09-19T08:56:14.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.791+0000 7fd27ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2801025e0 0x7fd2801a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:14.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.791+0000 7fd27ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2801025e0 0x7fd2801a1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50336/0 (socket says 172.21.15.92:50336) 2024-09-19T08:56:14.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.791+0000 7fd27ffff640 1 -- 172.21.15.92:0/2093204548 learned_addr learned my addr 172.21.15.92:0/2093204548 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:14.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.791+0000 7fd27f7fe640 1 --2- 172.21.15.92:0/2093204548 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd280100a30 0x7fd28019a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:14.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.791+0000 7fd277fff640 1 --2- 172.21.15.92:0/2093204548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd280101c20 0x7fd28019a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:14.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.791+0000 7fd27ffff640 1 -- 172.21.15.92:0/2093204548 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd280100a30 msgr2=0x7fd28019a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:14.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.791+0000 7fd27ffff640 1 --2- 172.21.15.92:0/2093204548 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd280100a30 0x7fd28019a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:14.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.791+0000 7fd27ffff640 1 -- 172.21.15.92:0/2093204548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd280101c20 msgr2=0x7fd28019a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:14.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.791+0000 7fd27ffff640 1 --2- 172.21.15.92:0/2093204548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd280101c20 0x7fd28019a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:14.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.791+0000 7fd27ffff640 1 -- 172.21.15.92:0/2093204548 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2801a1cb0 con 0x7fd2801025e0 2024-09-19T08:56:14.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.791+0000 7fd277fff640 1 --2- 172.21.15.92:0/2093204548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd280101c20 0x7fd28019a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:14.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.791+0000 7fd27ffff640 1 --2- 172.21.15.92:0/2093204548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2801025e0 0x7fd2801a1640 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd278003c70 tx=0x7fd278003ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:14.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.791+0000 7fd27d7fa640 1 -- 172.21.15.92:0/2093204548 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd278031650 con 0x7fd2801025e0 2024-09-19T08:56:14.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.791+0000 7fd27d7fa640 1 -- 172.21.15.92:0/2093204548 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2780317f0 con 0x7fd2801025e0 2024-09-19T08:56:14.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.791+0000 7fd286198640 1 -- 172.21.15.92:0/2093204548 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2801a1f40 con 0x7fd2801025e0 2024-09-19T08:56:14.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.791+0000 7fd27d7fa640 1 -- 172.21.15.92:0/2093204548 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27802fad0 con 0x7fd2801025e0 2024-09-19T08:56:14.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.792+0000 7fd286198640 1 -- 172.21.15.92:0/2093204548 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2801a2450 con 0x7fd2801025e0 2024-09-19T08:56:14.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.792+0000 7fd286198640 1 -- 172.21.15.92:0/2093204548 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2801a26b0 con 0x7fd2801025e0 2024-09-19T08:56:14.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.793+0000 7fd27d7fa640 1 -- 172.21.15.92:0/2093204548 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd2780045b0 con 0x7fd2801025e0 2024-09-19T08:56:14.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.794+0000 7fd27d7fa640 1 --2- 172.21.15.92:0/2093204548 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd26c0a32d0 0x7fd26c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:14.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.794+0000 7fd27f7fe640 1 --2- 172.21.15.92:0/2093204548 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd26c0a32d0 0x7fd26c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:14.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.794+0000 7fd27d7fa640 1 -- 172.21.15.92:0/2093204548 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd2780f0cd0 con 0x7fd2801025e0 2024-09-19T08:56:14.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.795+0000 7fd27f7fe640 1 --2- 172.21.15.92:0/2093204548 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd26c0a32d0 0x7fd26c0a5790 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd280101a80 tx=0x7fd270005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:14.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.798+0000 7fd27d7fa640 1 -- 172.21.15.92:0/2093204548 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd2780f6020 con 0x7fd2801025e0 2024-09-19T08:56:14.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.961+0000 7fd286198640 1 -- 172.21.15.92:0/2093204548 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd2801a2880 con 0x7fd26c0a32d0 2024-09-19T08:56:14.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.967+0000 7fd27d7fa640 1 -- 172.21.15.92:0/2093204548 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258748 (secure 0 0 0) 0x7fd2801a2880 con 0x7fd26c0a32d0 2024-09-19T08:56:14.969 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:14.971 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-19T08:56:14.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.970+0000 7fd286198640 1 -- 172.21.15.92:0/2093204548 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd26c0a32d0 msgr2=0x7fd26c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:14.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.970+0000 7fd286198640 1 --2- 172.21.15.92:0/2093204548 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd26c0a32d0 0x7fd26c0a5790 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd280101a80 tx=0x7fd270005f90 comp rx=0 tx=0).stop 2024-09-19T08:56:14.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.970+0000 7fd286198640 1 -- 172.21.15.92:0/2093204548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2801025e0 msgr2=0x7fd2801a1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:14.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.970+0000 7fd286198640 1 --2- 172.21.15.92:0/2093204548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2801025e0 0x7fd2801a1640 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd278003c70 tx=0x7fd278003ca0 comp rx=0 tx=0).stop 2024-09-19T08:56:14.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.970+0000 7fd286198640 1 -- 172.21.15.92:0/2093204548 shutdown_connections 2024-09-19T08:56:14.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.970+0000 7fd286198640 1 --2- 172.21.15.92:0/2093204548 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd26c0a32d0 0x7fd26c0a5790 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:14.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.970+0000 7fd286198640 1 --2- 172.21.15.92:0/2093204548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2801025e0 0x7fd2801a1640 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:14.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.970+0000 7fd286198640 1 --2- 172.21.15.92:0/2093204548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd280101c20 0x7fd28019a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:14.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.970+0000 7fd286198640 1 --2- 172.21.15.92:0/2093204548 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd280100a30 0x7fd28019a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:14.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.970+0000 7fd286198640 1 -- 172.21.15.92:0/2093204548 >> 172.21.15.92:0/2093204548 conn(0x7fd2800fc1b0 msgr2=0x7fd2800fdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:14.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.970+0000 7fd286198640 1 -- 172.21.15.92:0/2093204548 shutdown_connections 2024-09-19T08:56:14.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:14.970+0000 7fd286198640 1 -- 172.21.15.92:0/2093204548 wait complete. 2024-09-19T08:56:14.981 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":323,"stamp":"2024-09-19T08:56:14.280012+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653156,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":326,"num_read_kb":271,"num_write":270,"num_write_kb":3029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":711,"ondisk_log_size":711,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365948,"kb_used_data":12540,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575876,"statfs":{"total":1151940427776,"available":1151565697024,"internally_reserved":0,"allocated":12840960,"data_stored":7187836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":308,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":16,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002756"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277427+0000","last_change":"2024-09-19T08:54:31.437743+0000","last_active":"2024-09-19T08:55:52.277427+0000","last_peered":"2024-09-19T08:55:52.277427+0000","last_clean":"2024-09-19T08:55:52.277427+0000","last_became_active":"2024-09-19T08:54:31.437426+0000","last_became_peered":"2024-09-19T08:54:31.437426+0000","last_unstale":"2024-09-19T08:55:52.277427+0000","last_undegraded":"2024-09-19T08:55:52.277427+0000","last_fullsized":"2024-09-19T08:55:52.277427+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:04.403522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.282945+0000","last_change":"2024-09-19T08:54:31.430322+0000","last_active":"2024-09-19T08:55:52.282945+0000","last_peered":"2024-09-19T08:55:52.282945+0000","last_clean":"2024-09-19T08:55:52.282945+0000","last_became_active":"2024-09-19T08:54:31.430008+0000","last_became_peered":"2024-09-19T08:54:31.430008+0000","last_unstale":"2024-09-19T08:55:52.282945+0000","last_undegraded":"2024-09-19T08:55:52.282945+0000","last_fullsized":"2024-09-19T08:55:52.282945+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:19.800686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.271299+0000","last_change":"2024-09-19T08:54:31.430276+0000","last_active":"2024-09-19T08:55:52.271299+0000","last_peered":"2024-09-19T08:55:52.271299+0000","last_clean":"2024-09-19T08:55:52.271299+0000","last_became_active":"2024-09-19T08:54:31.429939+0000","last_became_peered":"2024-09-19T08:54:31.429939+0000","last_unstale":"2024-09-19T08:55:52.271299+0000","last_undegraded":"2024-09-19T08:55:52.271299+0000","last_fullsized":"2024-09-19T08:55:52.271299+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:08.735067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.260618+0000","last_change":"2024-09-19T08:54:31.435197+0000","last_active":"2024-09-19T08:55:52.260618+0000","last_peered":"2024-09-19T08:55:52.260618+0000","last_clean":"2024-09-19T08:55:52.260618+0000","last_became_active":"2024-09-19T08:54:31.434872+0000","last_became_peered":"2024-09-19T08:54:31.434872+0000","last_unstale":"2024-09-19T08:55:52.260618+0000","last_undegraded":"2024-09-19T08:55:52.260618+0000","last_fullsized":"2024-09-19T08:55:52.260618+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:06.213317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.256859+0000","last_change":"2024-09-19T08:54:31.423765+0000","last_active":"2024-09-19T08:55:52.256859+0000","last_peered":"2024-09-19T08:55:52.256859+0000","last_clean":"2024-09-19T08:55:52.256859+0000","last_became_active":"2024-09-19T08:54:31.423296+0000","last_became_peered":"2024-09-19T08:54:31.423296+0000","last_unstale":"2024-09-19T08:55:52.256859+0000","last_undegraded":"2024-09-19T08:55:52.256859+0000","last_fullsized":"2024-09-19T08:55:52.256859+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:07.507168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.283359+0000","last_change":"2024-09-19T08:54:31.430299+0000","last_active":"2024-09-19T08:55:52.283359+0000","last_peered":"2024-09-19T08:55:52.283359+0000","last_clean":"2024-09-19T08:55:52.283359+0000","last_became_active":"2024-09-19T08:54:31.429951+0000","last_became_peered":"2024-09-19T08:54:31.429951+0000","last_unstale":"2024-09-19T08:55:52.283359+0000","last_undegraded":"2024-09-19T08:55:52.283359+0000","last_fullsized":"2024-09-19T08:55:52.283359+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:11.299729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.278219+0000","last_change":"2024-09-19T08:54:31.435854+0000","last_active":"2024-09-19T08:55:52.278219+0000","last_peered":"2024-09-19T08:55:52.278219+0000","last_clean":"2024-09-19T08:55:52.278219+0000","last_became_active":"2024-09-19T08:54:31.435522+0000","last_became_peered":"2024-09-19T08:54:31.435522+0000","last_unstale":"2024-09-19T08:55:52.278219+0000","last_undegraded":"2024-09-19T08:55:52.278219+0000","last_fullsized":"2024-09-19T08:55:52.278219+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:11.099750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.282506+0000","last_change":"2024-09-19T08:54:31.434574+0000","last_active":"2024-09-19T08:55:52.282506+0000","last_peered":"2024-09-19T08:55:52.282506+0000","last_clean":"2024-09-19T08:55:52.282506+0000","last_became_active":"2024-09-19T08:54:31.434268+0000","last_became_peered":"2024-09-19T08:54:31.434268+0000","last_unstale":"2024-09-19T08:55:52.282506+0000","last_undegraded":"2024-09-19T08:55:52.282506+0000","last_fullsized":"2024-09-19T08:55:52.282506+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:29.159417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.279084+0000","last_change":"2024-09-19T08:54:31.430446+0000","last_active":"2024-09-19T08:55:52.279084+0000","last_peered":"2024-09-19T08:55:52.279084+0000","last_clean":"2024-09-19T08:55:52.279084+0000","last_became_active":"2024-09-19T08:54:31.430048+0000","last_became_peered":"2024-09-19T08:54:31.430048+0000","last_unstale":"2024-09-19T08:55:52.279084+0000","last_undegraded":"2024-09-19T08:55:52.279084+0000","last_fullsized":"2024-09-19T08:55:52.279084+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:24.773947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.283319+0000","last_change":"2024-09-19T08:54:31.433144+0000","last_active":"2024-09-19T08:55:52.283319+0000","last_peered":"2024-09-19T08:55:52.283319+0000","last_clean":"2024-09-19T08:55:52.283319+0000","last_became_active":"2024-09-19T08:54:31.432590+0000","last_became_peered":"2024-09-19T08:54:31.432590+0000","last_unstale":"2024-09-19T08:55:52.283319+0000","last_undegraded":"2024-09-19T08:55:52.283319+0000","last_fullsized":"2024-09-19T08:55:52.283319+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:53.756846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.275955+0000","last_change":"2024-09-19T08:54:31.435712+0000","last_active":"2024-09-19T08:55:52.275955+0000","last_peered":"2024-09-19T08:55:52.275955+0000","last_clean":"2024-09-19T08:55:52.275955+0000","last_became_active":"2024-09-19T08:54:31.435301+0000","last_became_peered":"2024-09-19T08:54:31.435301+0000","last_unstale":"2024-09-19T08:55:52.275955+0000","last_undegraded":"2024-09-19T08:55:52.275955+0000","last_fullsized":"2024-09-19T08:55:52.275955+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:51.703709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.270429+0000","last_change":"2024-09-19T08:54:53.332853+0000","last_active":"2024-09-19T08:55:52.270429+0000","last_peered":"2024-09-19T08:55:52.270429+0000","last_clean":"2024-09-19T08:55:52.270429+0000","last_became_active":"2024-09-19T08:54:53.332460+0000","last_became_peered":"2024-09-19T08:54:53.332460+0000","last_unstale":"2024-09-19T08:55:52.270429+0000","last_undegraded":"2024-09-19T08:55:52.270429+0000","last_fullsized":"2024-09-19T08:55:52.270429+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:47:58.025876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277366+0000","last_change":"2024-09-19T08:54:31.425590+0000","last_active":"2024-09-19T08:55:52.277366+0000","last_peered":"2024-09-19T08:55:52.277366+0000","last_clean":"2024-09-19T08:55:52.277366+0000","last_became_active":"2024-09-19T08:54:31.425268+0000","last_became_peered":"2024-09-19T08:54:31.425268+0000","last_unstale":"2024-09-19T08:55:52.277366+0000","last_undegraded":"2024-09-19T08:55:52.277366+0000","last_fullsized":"2024-09-19T08:55:52.277366+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:09.404947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.283086+0000","last_change":"2024-09-19T08:54:31.428372+0000","last_active":"2024-09-19T08:55:52.283086+0000","last_peered":"2024-09-19T08:55:52.283086+0000","last_clean":"2024-09-19T08:55:52.283086+0000","last_became_active":"2024-09-19T08:54:31.428064+0000","last_became_peered":"2024-09-19T08:54:31.428064+0000","last_unstale":"2024-09-19T08:55:52.283086+0000","last_undegraded":"2024-09-19T08:55:52.283086+0000","last_fullsized":"2024-09-19T08:55:52.283086+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:40.444117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.271059+0000","last_change":"2024-09-19T08:54:31.424365+0000","last_active":"2024-09-19T08:55:52.271059+0000","last_peered":"2024-09-19T08:55:52.271059+0000","last_clean":"2024-09-19T08:55:52.271059+0000","last_became_active":"2024-09-19T08:54:31.424044+0000","last_became_peered":"2024-09-19T08:54:31.424044+0000","last_unstale":"2024-09-19T08:55:52.271059+0000","last_undegraded":"2024-09-19T08:55:52.271059+0000","last_fullsized":"2024-09-19T08:55:52.271059+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:16.435389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.278276+0000","last_change":"2024-09-19T08:54:31.437238+0000","last_active":"2024-09-19T08:55:52.278276+0000","last_peered":"2024-09-19T08:55:52.278276+0000","last_clean":"2024-09-19T08:55:52.278276+0000","last_became_active":"2024-09-19T08:54:31.436867+0000","last_became_peered":"2024-09-19T08:54:31.436867+0000","last_unstale":"2024-09-19T08:55:52.278276+0000","last_undegraded":"2024-09-19T08:55:52.278276+0000","last_fullsized":"2024-09-19T08:55:52.278276+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:59.839081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277741+0000","last_change":"2024-09-19T08:54:31.438654+0000","last_active":"2024-09-19T08:55:52.277741+0000","last_peered":"2024-09-19T08:55:52.277741+0000","last_clean":"2024-09-19T08:55:52.277741+0000","last_became_active":"2024-09-19T08:54:31.438342+0000","last_became_peered":"2024-09-19T08:54:31.438342+0000","last_unstale":"2024-09-19T08:55:52.277741+0000","last_undegraded":"2024-09-19T08:55:52.277741+0000","last_fullsized":"2024-09-19T08:55:52.277741+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:55.190605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.271267+0000","last_change":"2024-09-19T08:54:31.431100+0000","last_active":"2024-09-19T08:55:52.271267+0000","last_peered":"2024-09-19T08:55:52.271267+0000","last_clean":"2024-09-19T08:55:52.271267+0000","last_became_active":"2024-09-19T08:54:31.430749+0000","last_became_peered":"2024-09-19T08:54:31.430749+0000","last_unstale":"2024-09-19T08:55:52.271267+0000","last_undegraded":"2024-09-19T08:55:52.271267+0000","last_fullsized":"2024-09-19T08:55:52.271267+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:50.597610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.261809+0000","last_change":"2024-09-19T08:54:31.427454+0000","last_active":"2024-09-19T08:55:52.261809+0000","last_peered":"2024-09-19T08:55:52.261809+0000","last_clean":"2024-09-19T08:55:52.261809+0000","last_became_active":"2024-09-19T08:54:31.427098+0000","last_became_peered":"2024-09-19T08:54:31.427098+0000","last_unstale":"2024-09-19T08:55:52.261809+0000","last_undegraded":"2024-09-19T08:55:52.261809+0000","last_fullsized":"2024-09-19T08:55:52.261809+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:01.042626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.275970+0000","last_change":"2024-09-19T08:54:31.433887+0000","last_active":"2024-09-19T08:55:52.275970+0000","last_peered":"2024-09-19T08:55:52.275970+0000","last_clean":"2024-09-19T08:55:52.275970+0000","last_became_active":"2024-09-19T08:54:31.433528+0000","last_became_peered":"2024-09-19T08:54:31.433528+0000","last_unstale":"2024-09-19T08:55:52.275970+0000","last_undegraded":"2024-09-19T08:55:52.275970+0000","last_fullsized":"2024-09-19T08:55:52.275970+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:37.291226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.266435+0000","last_change":"2024-09-19T08:54:31.436976+0000","last_active":"2024-09-19T08:55:52.266435+0000","last_peered":"2024-09-19T08:55:52.266435+0000","last_clean":"2024-09-19T08:55:52.266435+0000","last_became_active":"2024-09-19T08:54:31.436646+0000","last_became_peered":"2024-09-19T08:54:31.436646+0000","last_unstale":"2024-09-19T08:55:52.266435+0000","last_undegraded":"2024-09-19T08:55:52.266435+0000","last_fullsized":"2024-09-19T08:55:52.266435+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:19.755556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.278449+0000","last_change":"2024-09-19T08:54:31.438922+0000","last_active":"2024-09-19T08:55:52.278449+0000","last_peered":"2024-09-19T08:55:52.278449+0000","last_clean":"2024-09-19T08:55:52.278449+0000","last_became_active":"2024-09-19T08:54:31.438593+0000","last_became_peered":"2024-09-19T08:54:31.438593+0000","last_unstale":"2024-09-19T08:55:52.278449+0000","last_undegraded":"2024-09-19T08:55:52.278449+0000","last_fullsized":"2024-09-19T08:55:52.278449+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:07.347900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.262522+0000","last_change":"2024-09-19T08:54:31.431659+0000","last_active":"2024-09-19T08:55:52.262522+0000","last_peered":"2024-09-19T08:55:52.262522+0000","last_clean":"2024-09-19T08:55:52.262522+0000","last_became_active":"2024-09-19T08:54:31.431359+0000","last_became_peered":"2024-09-19T08:54:31.431359+0000","last_unstale":"2024-09-19T08:55:52.262522+0000","last_undegraded":"2024-09-19T08:55:52.262522+0000","last_fullsized":"2024-09-19T08:55:52.262522+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:02.421286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.278570+0000","last_change":"2024-09-19T08:54:31.432185+0000","last_active":"2024-09-19T08:55:52.278570+0000","last_peered":"2024-09-19T08:55:52.278570+0000","last_clean":"2024-09-19T08:55:52.278570+0000","last_became_active":"2024-09-19T08:54:31.431418+0000","last_became_peered":"2024-09-19T08:54:31.431418+0000","last_unstale":"2024-09-19T08:55:52.278570+0000","last_undegraded":"2024-09-19T08:55:52.278570+0000","last_fullsized":"2024-09-19T08:55:52.278570+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:45.347487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.256343+0000","last_change":"2024-09-19T08:54:31.433742+0000","last_active":"2024-09-19T08:55:52.256343+0000","last_peered":"2024-09-19T08:55:52.256343+0000","last_clean":"2024-09-19T08:55:52.256343+0000","last_became_active":"2024-09-19T08:54:31.433455+0000","last_became_peered":"2024-09-19T08:54:31.433455+0000","last_unstale":"2024-09-19T08:55:52.256343+0000","last_undegraded":"2024-09-19T08:55:52.256343+0000","last_fullsized":"2024-09-19T08:55:52.256343+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:38.803705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.271146+0000","last_change":"2024-09-19T08:54:31.432954+0000","last_active":"2024-09-19T08:55:52.271146+0000","last_peered":"2024-09-19T08:55:52.271146+0000","last_clean":"2024-09-19T08:55:52.271146+0000","last_became_active":"2024-09-19T08:54:31.432574+0000","last_became_peered":"2024-09-19T08:54:31.432574+0000","last_unstale":"2024-09-19T08:55:52.271146+0000","last_undegraded":"2024-09-19T08:55:52.271146+0000","last_fullsized":"2024-09-19T08:55:52.271146+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:30.457191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.274173+0000","last_change":"2024-09-19T08:54:31.435544+0000","last_active":"2024-09-19T08:55:52.274173+0000","last_peered":"2024-09-19T08:55:52.274173+0000","last_clean":"2024-09-19T08:55:52.274173+0000","last_became_active":"2024-09-19T08:54:31.435195+0000","last_became_peered":"2024-09-19T08:54:31.435195+0000","last_unstale":"2024-09-19T08:55:52.274173+0000","last_undegraded":"2024-09-19T08:55:52.274173+0000","last_fullsized":"2024-09-19T08:55:52.274173+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:54.240654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.266764+0000","last_change":"2024-09-19T08:54:31.428403+0000","last_active":"2024-09-19T08:55:52.266764+0000","last_peered":"2024-09-19T08:55:52.266764+0000","last_clean":"2024-09-19T08:55:52.266764+0000","last_became_active":"2024-09-19T08:54:31.428110+0000","last_became_peered":"2024-09-19T08:54:31.428110+0000","last_unstale":"2024-09-19T08:55:52.266764+0000","last_undegraded":"2024-09-19T08:55:52.266764+0000","last_fullsized":"2024-09-19T08:55:52.266764+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:05.593073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.269495+0000","last_change":"2024-09-19T08:54:31.427291+0000","last_active":"2024-09-19T08:55:52.269495+0000","last_peered":"2024-09-19T08:55:52.269495+0000","last_clean":"2024-09-19T08:55:52.269495+0000","last_became_active":"2024-09-19T08:54:31.427011+0000","last_became_peered":"2024-09-19T08:54:31.427011+0000","last_unstale":"2024-09-19T08:55:52.269495+0000","last_undegraded":"2024-09-19T08:55:52.269495+0000","last_fullsized":"2024-09-19T08:55:52.269495+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:54.338526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.254032+0000","last_change":"2024-09-19T08:54:31.429309+0000","last_active":"2024-09-19T08:55:52.254032+0000","last_peered":"2024-09-19T08:55:52.254032+0000","last_clean":"2024-09-19T08:55:52.254032+0000","last_became_active":"2024-09-19T08:54:31.428381+0000","last_became_peered":"2024-09-19T08:54:31.428381+0000","last_unstale":"2024-09-19T08:55:52.254032+0000","last_undegraded":"2024-09-19T08:55:52.254032+0000","last_fullsized":"2024-09-19T08:55:52.254032+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:22:33.920114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.273963+0000","last_change":"2024-09-19T08:54:53.336591+0000","last_active":"2024-09-19T08:55:52.273963+0000","last_peered":"2024-09-19T08:55:52.273963+0000","last_clean":"2024-09-19T08:55:52.273963+0000","last_became_active":"2024-09-19T08:54:53.336222+0000","last_became_peered":"2024-09-19T08:54:53.336222+0000","last_unstale":"2024-09-19T08:55:52.273963+0000","last_undegraded":"2024-09-19T08:55:52.273963+0000","last_fullsized":"2024-09-19T08:55:52.273963+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:59.019419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277017+0000","last_change":"2024-09-19T08:54:53.335149+0000","last_active":"2024-09-19T08:55:52.277017+0000","last_peered":"2024-09-19T08:55:52.277017+0000","last_clean":"2024-09-19T08:55:52.277017+0000","last_became_active":"2024-09-19T08:54:53.334766+0000","last_became_peered":"2024-09-19T08:54:53.334766+0000","last_unstale":"2024-09-19T08:55:52.277017+0000","last_undegraded":"2024-09-19T08:55:52.277017+0000","last_fullsized":"2024-09-19T08:55:52.277017+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:36.469044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277210+0000","last_change":"2024-09-19T08:54:31.427608+0000","last_active":"2024-09-19T08:55:52.277210+0000","last_peered":"2024-09-19T08:55:52.277210+0000","last_clean":"2024-09-19T08:55:52.277210+0000","last_became_active":"2024-09-19T08:54:31.427294+0000","last_became_peered":"2024-09-19T08:54:31.427294+0000","last_unstale":"2024-09-19T08:55:52.277210+0000","last_undegraded":"2024-09-19T08:55:52.277210+0000","last_fullsized":"2024-09-19T08:55:52.277210+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:41.356609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331158+0000","last_change":"2024-09-19T08:54:29.416204+0000","last_active":"2024-09-19T08:54:53.331158+0000","last_peered":"2024-09-19T08:54:53.331158+0000","last_clean":"2024-09-19T08:54:53.331158+0000","last_became_active":"2024-09-19T08:54:29.415872+0000","last_became_peered":"2024-09-19T08:54:29.415872+0000","last_unstale":"2024-09-19T08:54:53.331158+0000","last_undegraded":"2024-09-19T08:54:53.331158+0000","last_fullsized":"2024-09-19T08:54:53.331158+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:13.844147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.283160+0000","last_change":"2024-09-19T08:54:31.432137+0000","last_active":"2024-09-19T08:55:52.283160+0000","last_peered":"2024-09-19T08:55:52.283160+0000","last_clean":"2024-09-19T08:55:52.283160+0000","last_became_active":"2024-09-19T08:54:31.431761+0000","last_became_peered":"2024-09-19T08:54:31.431761+0000","last_unstale":"2024-09-19T08:55:52.283160+0000","last_undegraded":"2024-09-19T08:55:52.283160+0000","last_fullsized":"2024-09-19T08:55:52.283160+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:05.008431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327676+0000","last_change":"2024-09-19T08:54:29.413221+0000","last_active":"2024-09-19T08:54:53.327676+0000","last_peered":"2024-09-19T08:54:53.327676+0000","last_clean":"2024-09-19T08:54:53.327676+0000","last_became_active":"2024-09-19T08:54:29.412829+0000","last_became_peered":"2024-09-19T08:54:29.412829+0000","last_unstale":"2024-09-19T08:54:53.327676+0000","last_undegraded":"2024-09-19T08:54:53.327676+0000","last_fullsized":"2024-09-19T08:54:53.327676+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:07.224136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.326805+0000","last_change":"2024-09-19T08:54:29.410221+0000","last_active":"2024-09-19T08:54:53.326805+0000","last_peered":"2024-09-19T08:54:53.326805+0000","last_clean":"2024-09-19T08:54:53.326805+0000","last_became_active":"2024-09-19T08:54:29.409951+0000","last_became_peered":"2024-09-19T08:54:29.409951+0000","last_unstale":"2024-09-19T08:54:53.326805+0000","last_undegraded":"2024-09-19T08:54:53.326805+0000","last_fullsized":"2024-09-19T08:54:53.326805+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:58.350932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.259466+0000","last_change":"2024-09-19T08:54:31.429979+0000","last_active":"2024-09-19T08:55:52.259466+0000","last_peered":"2024-09-19T08:55:52.259466+0000","last_clean":"2024-09-19T08:55:52.259466+0000","last_became_active":"2024-09-19T08:54:31.429661+0000","last_became_peered":"2024-09-19T08:54:31.429661+0000","last_unstale":"2024-09-19T08:55:52.259466+0000","last_undegraded":"2024-09-19T08:55:52.259466+0000","last_fullsized":"2024-09-19T08:55:52.259466+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:27:40.603490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331299+0000","last_change":"2024-09-19T08:54:29.415769+0000","last_active":"2024-09-19T08:54:53.331299+0000","last_peered":"2024-09-19T08:54:53.331299+0000","last_clean":"2024-09-19T08:54:53.331299+0000","last_became_active":"2024-09-19T08:54:29.415245+0000","last_became_peered":"2024-09-19T08:54:29.415245+0000","last_unstale":"2024-09-19T08:54:53.331299+0000","last_undegraded":"2024-09-19T08:54:53.331299+0000","last_fullsized":"2024-09-19T08:54:53.331299+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:15.487945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.270548+0000","last_change":"2024-09-19T08:54:31.427126+0000","last_active":"2024-09-19T08:55:52.270548+0000","last_peered":"2024-09-19T08:55:52.270548+0000","last_clean":"2024-09-19T08:55:52.270548+0000","last_became_active":"2024-09-19T08:54:31.426816+0000","last_became_peered":"2024-09-19T08:54:31.426816+0000","last_unstale":"2024-09-19T08:55:52.270548+0000","last_undegraded":"2024-09-19T08:55:52.270548+0000","last_fullsized":"2024-09-19T08:55:52.270548+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:38.039428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327848+0000","last_change":"2024-09-19T08:54:29.411354+0000","last_active":"2024-09-19T08:54:53.327848+0000","last_peered":"2024-09-19T08:54:53.327848+0000","last_clean":"2024-09-19T08:54:53.327848+0000","last_became_active":"2024-09-19T08:54:29.410990+0000","last_became_peered":"2024-09-19T08:54:29.410990+0000","last_unstale":"2024-09-19T08:54:53.327848+0000","last_undegraded":"2024-09-19T08:54:53.327848+0000","last_fullsized":"2024-09-19T08:54:53.327848+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:29.338169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277112+0000","last_change":"2024-09-19T08:54:31.426243+0000","last_active":"2024-09-19T08:55:52.277112+0000","last_peered":"2024-09-19T08:55:52.277112+0000","last_clean":"2024-09-19T08:55:52.277112+0000","last_became_active":"2024-09-19T08:54:31.425895+0000","last_became_peered":"2024-09-19T08:54:31.425895+0000","last_unstale":"2024-09-19T08:55:52.277112+0000","last_undegraded":"2024-09-19T08:55:52.277112+0000","last_fullsized":"2024-09-19T08:55:52.277112+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:13.562780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331102+0000","last_change":"2024-09-19T08:54:29.416646+0000","last_active":"2024-09-19T08:54:53.331102+0000","last_peered":"2024-09-19T08:54:53.331102+0000","last_clean":"2024-09-19T08:54:53.331102+0000","last_became_active":"2024-09-19T08:54:29.416260+0000","last_became_peered":"2024-09-19T08:54:29.416260+0000","last_unstale":"2024-09-19T08:54:53.331102+0000","last_undegraded":"2024-09-19T08:54:53.331102+0000","last_fullsized":"2024-09-19T08:54:53.331102+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:42:17.467035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.276583+0000","last_change":"2024-09-19T08:54:31.435538+0000","last_active":"2024-09-19T08:55:52.276583+0000","last_peered":"2024-09-19T08:55:52.276583+0000","last_clean":"2024-09-19T08:55:52.276583+0000","last_became_active":"2024-09-19T08:54:31.435185+0000","last_became_peered":"2024-09-19T08:54:31.435185+0000","last_unstale":"2024-09-19T08:55:52.276583+0000","last_undegraded":"2024-09-19T08:55:52.276583+0000","last_fullsized":"2024-09-19T08:55:52.276583+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:06.940123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.332501+0000","last_change":"2024-09-19T08:54:29.675914+0000","last_active":"2024-09-19T08:54:53.332501+0000","last_peered":"2024-09-19T08:54:53.332501+0000","last_clean":"2024-09-19T08:54:53.332501+0000","last_became_active":"2024-09-19T08:54:29.675482+0000","last_became_peered":"2024-09-19T08:54:29.675482+0000","last_unstale":"2024-09-19T08:54:53.332501+0000","last_undegraded":"2024-09-19T08:54:53.332501+0000","last_fullsized":"2024-09-19T08:54:53.332501+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:58.893008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.273901+0000","last_change":"2024-09-19T08:54:31.432628+0000","last_active":"2024-09-19T08:55:52.273901+0000","last_peered":"2024-09-19T08:55:52.273901+0000","last_clean":"2024-09-19T08:55:52.273901+0000","last_became_active":"2024-09-19T08:54:31.430640+0000","last_became_peered":"2024-09-19T08:54:31.430640+0000","last_unstale":"2024-09-19T08:55:52.273901+0000","last_undegraded":"2024-09-19T08:55:52.273901+0000","last_fullsized":"2024-09-19T08:55:52.273901+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:07.793089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'30","reported_seq":248,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:56:11.641416+0000","last_change":"2024-09-19T08:54:29.414619+0000","last_active":"2024-09-19T08:56:11.641416+0000","last_peered":"2024-09-19T08:56:11.641416+0000","last_clean":"2024-09-19T08:56:11.641416+0000","last_became_active":"2024-09-19T08:54:29.414295+0000","last_became_peered":"2024-09-19T08:54:29.414295+0000","last_unstale":"2024-09-19T08:56:11.641416+0000","last_undegraded":"2024-09-19T08:56:11.641416+0000","last_fullsized":"2024-09-19T08:56:11.641416+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:23.782684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61756,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":196,"num_read_kb":158,"num_write":30,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.276986+0000","last_change":"2024-09-19T08:54:31.425432+0000","last_active":"2024-09-19T08:55:52.276986+0000","last_peered":"2024-09-19T08:55:52.276986+0000","last_clean":"2024-09-19T08:55:52.276986+0000","last_became_active":"2024-09-19T08:54:31.425086+0000","last_became_peered":"2024-09-19T08:54:31.425086+0000","last_unstale":"2024-09-19T08:55:52.276986+0000","last_undegraded":"2024-09-19T08:55:52.276986+0000","last_fullsized":"2024-09-19T08:55:52.276986+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:56.572339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330371+0000","last_change":"2024-09-19T08:54:29.415055+0000","last_active":"2024-09-19T08:54:53.330371+0000","last_peered":"2024-09-19T08:54:53.330371+0000","last_clean":"2024-09-19T08:54:53.330371+0000","last_became_active":"2024-09-19T08:54:29.414573+0000","last_became_peered":"2024-09-19T08:54:29.414573+0000","last_unstale":"2024-09-19T08:54:53.330371+0000","last_undegraded":"2024-09-19T08:54:53.330371+0000","last_fullsized":"2024-09-19T08:54:53.330371+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:13.013714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.260081+0000","last_change":"2024-09-19T08:54:31.436905+0000","last_active":"2024-09-19T08:55:52.260081+0000","last_peered":"2024-09-19T08:55:52.260081+0000","last_clean":"2024-09-19T08:55:52.260081+0000","last_became_active":"2024-09-19T08:54:31.436571+0000","last_became_peered":"2024-09-19T08:54:31.436571+0000","last_unstale":"2024-09-19T08:55:52.260081+0000","last_undegraded":"2024-09-19T08:55:52.260081+0000","last_fullsized":"2024-09-19T08:55:52.260081+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:55.294255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330834+0000","last_change":"2024-09-19T08:54:29.417958+0000","last_active":"2024-09-19T08:54:53.330834+0000","last_peered":"2024-09-19T08:54:53.330834+0000","last_clean":"2024-09-19T08:54:53.330834+0000","last_became_active":"2024-09-19T08:54:29.417570+0000","last_became_peered":"2024-09-19T08:54:29.417570+0000","last_unstale":"2024-09-19T08:54:53.330834+0000","last_undegraded":"2024-09-19T08:54:53.330834+0000","last_fullsized":"2024-09-19T08:54:53.330834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:25.557217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.279834+0000","last_change":"2024-09-19T08:54:31.433019+0000","last_active":"2024-09-19T08:55:52.279834+0000","last_peered":"2024-09-19T08:55:52.279834+0000","last_clean":"2024-09-19T08:55:52.279834+0000","last_became_active":"2024-09-19T08:54:31.431265+0000","last_became_peered":"2024-09-19T08:54:31.431265+0000","last_unstale":"2024-09-19T08:55:52.279834+0000","last_undegraded":"2024-09-19T08:55:52.279834+0000","last_fullsized":"2024-09-19T08:55:52.279834+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:36.481863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.979100+0000","last_change":"2024-09-19T08:54:29.414236+0000","last_active":"2024-09-19T08:54:53.979100+0000","last_peered":"2024-09-19T08:54:53.979100+0000","last_clean":"2024-09-19T08:54:53.979100+0000","last_became_active":"2024-09-19T08:54:29.413878+0000","last_became_peered":"2024-09-19T08:54:29.413878+0000","last_unstale":"2024-09-19T08:54:53.979100+0000","last_undegraded":"2024-09-19T08:54:53.979100+0000","last_fullsized":"2024-09-19T08:54:53.979100+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:11.222362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.279321+0000","last_change":"2024-09-19T08:54:31.439512+0000","last_active":"2024-09-19T08:55:52.279321+0000","last_peered":"2024-09-19T08:55:52.279321+0000","last_clean":"2024-09-19T08:55:52.279321+0000","last_became_active":"2024-09-19T08:54:31.438767+0000","last_became_peered":"2024-09-19T08:54:31.438767+0000","last_unstale":"2024-09-19T08:55:52.279321+0000","last_undegraded":"2024-09-19T08:55:52.279321+0000","last_fullsized":"2024-09-19T08:55:52.279321+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:31.784577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330687+0000","last_change":"2024-09-19T08:54:29.675768+0000","last_active":"2024-09-19T08:54:53.330687+0000","last_peered":"2024-09-19T08:54:53.330687+0000","last_clean":"2024-09-19T08:54:53.330687+0000","last_became_active":"2024-09-19T08:54:29.675376+0000","last_became_peered":"2024-09-19T08:54:29.675376+0000","last_unstale":"2024-09-19T08:54:53.330687+0000","last_undegraded":"2024-09-19T08:54:53.330687+0000","last_fullsized":"2024-09-19T08:54:53.330687+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:10.281126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.282865+0000","last_change":"2024-09-19T08:54:31.435904+0000","last_active":"2024-09-19T08:55:52.282865+0000","last_peered":"2024-09-19T08:55:52.282865+0000","last_clean":"2024-09-19T08:55:52.282865+0000","last_became_active":"2024-09-19T08:54:31.435396+0000","last_became_peered":"2024-09-19T08:54:31.435396+0000","last_unstale":"2024-09-19T08:55:52.282865+0000","last_undegraded":"2024-09-19T08:55:52.282865+0000","last_fullsized":"2024-09-19T08:55:52.282865+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:41.567463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331746+0000","last_change":"2024-09-19T08:54:29.410221+0000","last_active":"2024-09-19T08:54:53.331746+0000","last_peered":"2024-09-19T08:54:53.331746+0000","last_clean":"2024-09-19T08:54:53.331746+0000","last_became_active":"2024-09-19T08:54:29.409856+0000","last_became_peered":"2024-09-19T08:54:29.409856+0000","last_unstale":"2024-09-19T08:54:53.331746+0000","last_undegraded":"2024-09-19T08:54:53.331746+0000","last_fullsized":"2024-09-19T08:54:53.331746+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:46.095816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.270387+0000","last_change":"2024-09-19T08:54:31.437854+0000","last_active":"2024-09-19T08:55:52.270387+0000","last_peered":"2024-09-19T08:55:52.270387+0000","last_clean":"2024-09-19T08:55:52.270387+0000","last_became_active":"2024-09-19T08:54:31.437491+0000","last_became_peered":"2024-09-19T08:54:31.437491+0000","last_unstale":"2024-09-19T08:55:52.270387+0000","last_undegraded":"2024-09-19T08:55:52.270387+0000","last_fullsized":"2024-09-19T08:55:52.270387+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:22.532429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.983440+0000","last_change":"2024-09-19T08:54:53.983440+0000","last_active":"2024-09-19T08:54:53.983440+0000","last_peered":"2024-09-19T08:54:53.983440+0000","last_clean":"2024-09-19T08:54:53.983440+0000","last_became_active":"2024-09-19T08:54:53.980971+0000","last_became_peered":"2024-09-19T08:54:53.980971+0000","last_unstale":"2024-09-19T08:54:53.983440+0000","last_undegraded":"2024-09-19T08:54:53.983440+0000","last_fullsized":"2024-09-19T08:54:53.983440+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:33.070904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.278128+0000","last_change":"2024-09-19T08:54:31.429376+0000","last_active":"2024-09-19T08:55:52.278128+0000","last_peered":"2024-09-19T08:55:52.278128+0000","last_clean":"2024-09-19T08:55:52.278128+0000","last_became_active":"2024-09-19T08:54:31.429006+0000","last_became_peered":"2024-09-19T08:54:31.429006+0000","last_unstale":"2024-09-19T08:55:52.278128+0000","last_undegraded":"2024-09-19T08:55:52.278128+0000","last_fullsized":"2024-09-19T08:55:52.278128+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:26.399838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.332608+0000","last_change":"2024-09-19T08:54:29.414307+0000","last_active":"2024-09-19T08:54:53.332608+0000","last_peered":"2024-09-19T08:54:53.332608+0000","last_clean":"2024-09-19T08:54:53.332608+0000","last_became_active":"2024-09-19T08:54:29.413823+0000","last_became_peered":"2024-09-19T08:54:29.413823+0000","last_unstale":"2024-09-19T08:54:53.332608+0000","last_undegraded":"2024-09-19T08:54:53.332608+0000","last_fullsized":"2024-09-19T08:54:53.332608+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:25.484645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.279004+0000","last_change":"2024-09-19T08:54:31.437789+0000","last_active":"2024-09-19T08:55:52.279004+0000","last_peered":"2024-09-19T08:55:52.279004+0000","last_clean":"2024-09-19T08:55:52.279004+0000","last_became_active":"2024-09-19T08:54:31.435488+0000","last_became_peered":"2024-09-19T08:54:31.435488+0000","last_unstale":"2024-09-19T08:55:52.279004+0000","last_undegraded":"2024-09-19T08:55:52.279004+0000","last_fullsized":"2024-09-19T08:55:52.279004+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:19.332440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.333662+0000","last_change":"2024-09-19T08:54:53.333120+0000","last_active":"2024-09-19T08:54:53.333662+0000","last_peered":"2024-09-19T08:54:53.333662+0000","last_clean":"2024-09-19T08:54:53.333662+0000","last_became_active":"2024-09-19T08:54:53.332711+0000","last_became_peered":"2024-09-19T08:54:53.332711+0000","last_unstale":"2024-09-19T08:54:53.333662+0000","last_undegraded":"2024-09-19T08:54:53.333662+0000","last_fullsized":"2024-09-19T08:54:53.333662+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:18.359002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.279878+0000","last_change":"2024-09-19T08:54:31.434564+0000","last_active":"2024-09-19T08:55:52.279878+0000","last_peered":"2024-09-19T08:55:52.279878+0000","last_clean":"2024-09-19T08:55:52.279878+0000","last_became_active":"2024-09-19T08:54:31.434231+0000","last_became_peered":"2024-09-19T08:54:31.434231+0000","last_unstale":"2024-09-19T08:55:52.279878+0000","last_undegraded":"2024-09-19T08:55:52.279878+0000","last_fullsized":"2024-09-19T08:55:52.279878+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:31.316400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":335,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331130+0000","last_change":"2024-09-19T08:53:21.357560+0000","last_active":"2024-09-19T08:54:53.331130+0000","last_peered":"2024-09-19T08:54:53.331130+0000","last_clean":"2024-09-19T08:54:53.331130+0000","last_became_active":"2024-09-19T08:53:21.357122+0000","last_became_peered":"2024-09-19T08:53:21.357122+0000","last_unstale":"2024-09-19T08:54:53.331130+0000","last_undegraded":"2024-09-19T08:54:53.331130+0000","last_fullsized":"2024-09-19T08:54:53.331130+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:05.231370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:05.231370+0000","last_clean_scrub_stamp":"2024-09-19T08:50:05.231370+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:47.867682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.979104+0000","last_change":"2024-09-19T08:54:29.412240+0000","last_active":"2024-09-19T08:54:53.979104+0000","last_peered":"2024-09-19T08:54:53.979104+0000","last_clean":"2024-09-19T08:54:53.979104+0000","last_became_active":"2024-09-19T08:54:29.411908+0000","last_became_peered":"2024-09-19T08:54:29.411908+0000","last_unstale":"2024-09-19T08:54:53.979104+0000","last_undegraded":"2024-09-19T08:54:53.979104+0000","last_fullsized":"2024-09-19T08:54:53.979104+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:37.189373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277537+0000","last_change":"2024-09-19T08:54:31.432956+0000","last_active":"2024-09-19T08:55:52.277537+0000","last_peered":"2024-09-19T08:55:52.277537+0000","last_clean":"2024-09-19T08:55:52.277537+0000","last_became_active":"2024-09-19T08:54:31.432639+0000","last_became_peered":"2024-09-19T08:54:31.432639+0000","last_unstale":"2024-09-19T08:55:52.277537+0000","last_undegraded":"2024-09-19T08:55:52.277537+0000","last_fullsized":"2024-09-19T08:55:52.277537+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:58.302624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331178+0000","last_change":"2024-09-19T08:54:29.414214+0000","last_active":"2024-09-19T08:54:53.331178+0000","last_peered":"2024-09-19T08:54:53.331178+0000","last_clean":"2024-09-19T08:54:53.331178+0000","last_became_active":"2024-09-19T08:54:29.413853+0000","last_became_peered":"2024-09-19T08:54:29.413853+0000","last_unstale":"2024-09-19T08:54:53.331178+0000","last_undegraded":"2024-09-19T08:54:53.331178+0000","last_fullsized":"2024-09-19T08:54:53.331178+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:28:29.119856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.266896+0000","last_change":"2024-09-19T08:54:31.424643+0000","last_active":"2024-09-19T08:55:52.266896+0000","last_peered":"2024-09-19T08:55:52.266896+0000","last_clean":"2024-09-19T08:55:52.266896+0000","last_became_active":"2024-09-19T08:54:31.424363+0000","last_became_peered":"2024-09-19T08:54:31.424363+0000","last_unstale":"2024-09-19T08:55:52.266896+0000","last_undegraded":"2024-09-19T08:55:52.266896+0000","last_fullsized":"2024-09-19T08:55:52.266896+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:37.529952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.326916+0000","last_change":"2024-09-19T08:54:29.675742+0000","last_active":"2024-09-19T08:54:53.326916+0000","last_peered":"2024-09-19T08:54:53.326916+0000","last_clean":"2024-09-19T08:54:53.326916+0000","last_became_active":"2024-09-19T08:54:29.675347+0000","last_became_peered":"2024-09-19T08:54:29.675347+0000","last_unstale":"2024-09-19T08:54:53.326916+0000","last_undegraded":"2024-09-19T08:54:53.326916+0000","last_fullsized":"2024-09-19T08:54:53.326916+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:00.925390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.283427+0000","last_change":"2024-09-19T08:54:31.433887+0000","last_active":"2024-09-19T08:55:52.283427+0000","last_peered":"2024-09-19T08:55:52.283427+0000","last_clean":"2024-09-19T08:55:52.283427+0000","last_became_active":"2024-09-19T08:54:31.433331+0000","last_became_peered":"2024-09-19T08:54:31.433331+0000","last_unstale":"2024-09-19T08:55:52.283427+0000","last_undegraded":"2024-09-19T08:55:52.283427+0000","last_fullsized":"2024-09-19T08:55:52.283427+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:49.875061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331491+0000","last_change":"2024-09-19T08:54:29.417410+0000","last_active":"2024-09-19T08:54:53.331491+0000","last_peered":"2024-09-19T08:54:53.331491+0000","last_clean":"2024-09-19T08:54:53.331491+0000","last_became_active":"2024-09-19T08:54:29.417018+0000","last_became_peered":"2024-09-19T08:54:29.417018+0000","last_unstale":"2024-09-19T08:54:53.331491+0000","last_undegraded":"2024-09-19T08:54:53.331491+0000","last_fullsized":"2024-09-19T08:54:53.331491+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:53.669027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.280825+0000","last_change":"2024-09-19T08:54:31.431313+0000","last_active":"2024-09-19T08:55:52.280825+0000","last_peered":"2024-09-19T08:55:52.280825+0000","last_clean":"2024-09-19T08:55:52.280825+0000","last_became_active":"2024-09-19T08:54:31.429427+0000","last_became_peered":"2024-09-19T08:54:31.429427+0000","last_unstale":"2024-09-19T08:55:52.280825+0000","last_undegraded":"2024-09-19T08:55:52.280825+0000","last_fullsized":"2024-09-19T08:55:52.280825+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:55.106769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330517+0000","last_change":"2024-09-19T08:54:29.675722+0000","last_active":"2024-09-19T08:54:53.330517+0000","last_peered":"2024-09-19T08:54:53.330517+0000","last_clean":"2024-09-19T08:54:53.330517+0000","last_became_active":"2024-09-19T08:54:29.675397+0000","last_became_peered":"2024-09-19T08:54:29.675397+0000","last_unstale":"2024-09-19T08:54:53.330517+0000","last_undegraded":"2024-09-19T08:54:53.330517+0000","last_fullsized":"2024-09-19T08:54:53.330517+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:49.574947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.283206+0000","last_change":"2024-09-19T08:54:31.431106+0000","last_active":"2024-09-19T08:55:52.283206+0000","last_peered":"2024-09-19T08:55:52.283206+0000","last_clean":"2024-09-19T08:55:52.283206+0000","last_became_active":"2024-09-19T08:54:31.430745+0000","last_became_peered":"2024-09-19T08:54:31.430745+0000","last_unstale":"2024-09-19T08:55:52.283206+0000","last_undegraded":"2024-09-19T08:55:52.283206+0000","last_fullsized":"2024-09-19T08:55:52.283206+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:22.714106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331431+0000","last_change":"2024-09-19T08:54:29.675985+0000","last_active":"2024-09-19T08:54:53.331431+0000","last_peered":"2024-09-19T08:54:53.331431+0000","last_clean":"2024-09-19T08:54:53.331431+0000","last_became_active":"2024-09-19T08:54:29.675374+0000","last_became_peered":"2024-09-19T08:54:29.675374+0000","last_unstale":"2024-09-19T08:54:53.331431+0000","last_undegraded":"2024-09-19T08:54:53.331431+0000","last_fullsized":"2024-09-19T08:54:53.331431+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:06.664621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.260250+0000","last_change":"2024-09-19T08:54:31.423493+0000","last_active":"2024-09-19T08:55:52.260250+0000","last_peered":"2024-09-19T08:55:52.260250+0000","last_clean":"2024-09-19T08:55:52.260250+0000","last_became_active":"2024-09-19T08:54:31.422651+0000","last_became_peered":"2024-09-19T08:54:31.422651+0000","last_unstale":"2024-09-19T08:55:52.260250+0000","last_undegraded":"2024-09-19T08:55:52.260250+0000","last_fullsized":"2024-09-19T08:55:52.260250+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:51.863965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'10","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:55.435276+0000","last_change":"2024-09-19T08:54:29.408571+0000","last_active":"2024-09-19T08:54:55.435276+0000","last_peered":"2024-09-19T08:54:55.435276+0000","last_clean":"2024-09-19T08:54:55.435276+0000","last_became_active":"2024-09-19T08:54:29.408142+0000","last_became_peered":"2024-09-19T08:54:29.408142+0000","last_unstale":"2024-09-19T08:54:55.435276+0000","last_undegraded":"2024-09-19T08:54:55.435276+0000","last_fullsized":"2024-09-19T08:54:55.435276+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:34.578230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.262764+0000","last_change":"2024-09-19T08:54:31.435333+0000","last_active":"2024-09-19T08:55:52.262764+0000","last_peered":"2024-09-19T08:55:52.262764+0000","last_clean":"2024-09-19T08:55:52.262764+0000","last_became_active":"2024-09-19T08:54:31.435041+0000","last_became_peered":"2024-09-19T08:54:31.435041+0000","last_unstale":"2024-09-19T08:55:52.262764+0000","last_undegraded":"2024-09-19T08:55:52.262764+0000","last_fullsized":"2024-09-19T08:55:52.262764+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:40.972638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.979153+0000","last_change":"2024-09-19T08:54:29.554303+0000","last_active":"2024-09-19T08:54:53.979153+0000","last_peered":"2024-09-19T08:54:53.979153+0000","last_clean":"2024-09-19T08:54:53.979153+0000","last_became_active":"2024-09-19T08:54:29.553919+0000","last_became_peered":"2024-09-19T08:54:29.553919+0000","last_unstale":"2024-09-19T08:54:53.979153+0000","last_undegraded":"2024-09-19T08:54:53.979153+0000","last_fullsized":"2024-09-19T08:54:53.979153+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:25.103926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.279407+0000","last_change":"2024-09-19T08:54:53.333280+0000","last_active":"2024-09-19T08:55:52.279407+0000","last_peered":"2024-09-19T08:55:52.279407+0000","last_clean":"2024-09-19T08:55:52.279407+0000","last_became_active":"2024-09-19T08:54:53.332881+0000","last_became_peered":"2024-09-19T08:54:53.332881+0000","last_unstale":"2024-09-19T08:55:52.279407+0000","last_undegraded":"2024-09-19T08:55:52.279407+0000","last_fullsized":"2024-09-19T08:55:52.279407+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:55.880616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329946+0000","last_change":"2024-09-19T08:54:29.675665+0000","last_active":"2024-09-19T08:54:53.329946+0000","last_peered":"2024-09-19T08:54:53.329946+0000","last_clean":"2024-09-19T08:54:53.329946+0000","last_became_active":"2024-09-19T08:54:29.675367+0000","last_became_peered":"2024-09-19T08:54:29.675367+0000","last_unstale":"2024-09-19T08:54:53.329946+0000","last_undegraded":"2024-09-19T08:54:53.329946+0000","last_fullsized":"2024-09-19T08:54:53.329946+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:35.473243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.237269+0000","last_change":"2024-09-19T08:54:31.430837+0000","last_active":"2024-09-19T08:55:52.237269+0000","last_peered":"2024-09-19T08:55:52.237269+0000","last_clean":"2024-09-19T08:55:52.237269+0000","last_became_active":"2024-09-19T08:54:31.430465+0000","last_became_peered":"2024-09-19T08:54:31.430465+0000","last_unstale":"2024-09-19T08:55:52.237269+0000","last_undegraded":"2024-09-19T08:55:52.237269+0000","last_fullsized":"2024-09-19T08:55:52.237269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:50.524730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329067+0000","last_change":"2024-09-19T08:54:29.413803+0000","last_active":"2024-09-19T08:54:53.329067+0000","last_peered":"2024-09-19T08:54:53.329067+0000","last_clean":"2024-09-19T08:54:53.329067+0000","last_became_active":"2024-09-19T08:54:29.413400+0000","last_became_peered":"2024-09-19T08:54:29.413400+0000","last_unstale":"2024-09-19T08:54:53.329067+0000","last_undegraded":"2024-09-19T08:54:53.329067+0000","last_fullsized":"2024-09-19T08:54:53.329067+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:12.518454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.271551+0000","last_change":"2024-09-19T08:54:31.428451+0000","last_active":"2024-09-19T08:55:52.271551+0000","last_peered":"2024-09-19T08:55:52.271551+0000","last_clean":"2024-09-19T08:55:52.271551+0000","last_became_active":"2024-09-19T08:54:31.428134+0000","last_became_peered":"2024-09-19T08:54:31.428134+0000","last_unstale":"2024-09-19T08:55:52.271551+0000","last_undegraded":"2024-09-19T08:55:52.271551+0000","last_fullsized":"2024-09-19T08:55:52.271551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:08.260183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329914+0000","last_change":"2024-09-19T08:54:29.414399+0000","last_active":"2024-09-19T08:54:53.329914+0000","last_peered":"2024-09-19T08:54:53.329914+0000","last_clean":"2024-09-19T08:54:53.329914+0000","last_became_active":"2024-09-19T08:54:29.413080+0000","last_became_peered":"2024-09-19T08:54:29.413080+0000","last_unstale":"2024-09-19T08:54:53.329914+0000","last_undegraded":"2024-09-19T08:54:53.329914+0000","last_fullsized":"2024-09-19T08:54:53.329914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:27.308297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.282381+0000","last_change":"2024-09-19T08:54:31.434550+0000","last_active":"2024-09-19T08:55:52.282381+0000","last_peered":"2024-09-19T08:55:52.282381+0000","last_clean":"2024-09-19T08:55:52.282381+0000","last_became_active":"2024-09-19T08:54:31.434195+0000","last_became_peered":"2024-09-19T08:54:31.434195+0000","last_unstale":"2024-09-19T08:55:52.282381+0000","last_undegraded":"2024-09-19T08:55:52.282381+0000","last_fullsized":"2024-09-19T08:55:52.282381+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:04.807833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.338857+0000","last_change":"2024-09-19T08:54:53.338857+0000","last_active":"2024-09-19T08:54:53.338857+0000","last_peered":"2024-09-19T08:54:53.338857+0000","last_clean":"2024-09-19T08:54:53.338857+0000","last_became_active":"2024-09-19T08:54:53.334162+0000","last_became_peered":"2024-09-19T08:54:53.334162+0000","last_unstale":"2024-09-19T08:54:53.338857+0000","last_undegraded":"2024-09-19T08:54:53.338857+0000","last_fullsized":"2024-09-19T08:54:53.338857+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:38.858918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.280213+0000","last_change":"2024-09-19T08:54:31.441201+0000","last_active":"2024-09-19T08:55:52.280213+0000","last_peered":"2024-09-19T08:55:52.280213+0000","last_clean":"2024-09-19T08:55:52.280213+0000","last_became_active":"2024-09-19T08:54:31.440738+0000","last_became_peered":"2024-09-19T08:54:31.440738+0000","last_unstale":"2024-09-19T08:55:52.280213+0000","last_undegraded":"2024-09-19T08:55:52.280213+0000","last_fullsized":"2024-09-19T08:55:52.280213+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:39.118320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.284175+0000","last_change":"2024-09-19T08:54:31.435772+0000","last_active":"2024-09-19T08:55:52.284175+0000","last_peered":"2024-09-19T08:55:52.284175+0000","last_clean":"2024-09-19T08:55:52.284175+0000","last_became_active":"2024-09-19T08:54:31.435257+0000","last_became_peered":"2024-09-19T08:54:31.435257+0000","last_unstale":"2024-09-19T08:55:52.284175+0000","last_undegraded":"2024-09-19T08:55:52.284175+0000","last_fullsized":"2024-09-19T08:55:52.284175+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:44:12.219054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.341203+0000","last_change":"2024-09-19T08:54:53.341203+0000","last_active":"2024-09-19T08:54:53.341203+0000","last_peered":"2024-09-19T08:54:53.341203+0000","last_clean":"2024-09-19T08:54:53.341203+0000","last_became_active":"2024-09-19T08:54:53.336115+0000","last_became_peered":"2024-09-19T08:54:53.336115+0000","last_unstale":"2024-09-19T08:54:53.341203+0000","last_undegraded":"2024-09-19T08:54:53.341203+0000","last_fullsized":"2024-09-19T08:54:53.341203+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:31.532599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277536+0000","last_change":"2024-09-19T08:54:31.427103+0000","last_active":"2024-09-19T08:55:52.277536+0000","last_peered":"2024-09-19T08:55:52.277536+0000","last_clean":"2024-09-19T08:55:52.277536+0000","last_became_active":"2024-09-19T08:54:31.425958+0000","last_became_peered":"2024-09-19T08:54:31.425958+0000","last_unstale":"2024-09-19T08:55:52.277536+0000","last_undegraded":"2024-09-19T08:55:52.277536+0000","last_fullsized":"2024-09-19T08:55:52.277536+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:36.840940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331317+0000","last_change":"2024-09-19T08:54:29.415209+0000","last_active":"2024-09-19T08:54:53.331317+0000","last_peered":"2024-09-19T08:54:53.331317+0000","last_clean":"2024-09-19T08:54:53.331317+0000","last_became_active":"2024-09-19T08:54:29.414806+0000","last_became_peered":"2024-09-19T08:54:29.414806+0000","last_unstale":"2024-09-19T08:54:53.331317+0000","last_undegraded":"2024-09-19T08:54:53.331317+0000","last_fullsized":"2024-09-19T08:54:53.331317+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:47.764231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.271279+0000","last_change":"2024-09-19T08:54:31.434027+0000","last_active":"2024-09-19T08:55:52.271279+0000","last_peered":"2024-09-19T08:55:52.271279+0000","last_clean":"2024-09-19T08:55:52.271279+0000","last_became_active":"2024-09-19T08:54:31.433687+0000","last_became_peered":"2024-09-19T08:54:31.433687+0000","last_unstale":"2024-09-19T08:55:52.271279+0000","last_undegraded":"2024-09-19T08:55:52.271279+0000","last_fullsized":"2024-09-19T08:55:52.271279+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:56.462128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329231+0000","last_change":"2024-09-19T08:54:29.675502+0000","last_active":"2024-09-19T08:54:53.329231+0000","last_peered":"2024-09-19T08:54:53.329231+0000","last_clean":"2024-09-19T08:54:53.329231+0000","last_became_active":"2024-09-19T08:54:29.675158+0000","last_became_peered":"2024-09-19T08:54:29.675158+0000","last_unstale":"2024-09-19T08:54:53.329231+0000","last_undegraded":"2024-09-19T08:54:53.329231+0000","last_fullsized":"2024-09-19T08:54:53.329231+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:24:59.377521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.278201+0000","last_change":"2024-09-19T08:54:53.334264+0000","last_active":"2024-09-19T08:55:52.278201+0000","last_peered":"2024-09-19T08:55:52.278201+0000","last_clean":"2024-09-19T08:55:52.278201+0000","last_became_active":"2024-09-19T08:54:53.333959+0000","last_became_peered":"2024-09-19T08:54:53.333959+0000","last_unstale":"2024-09-19T08:55:52.278201+0000","last_undegraded":"2024-09-19T08:55:52.278201+0000","last_fullsized":"2024-09-19T08:55:52.278201+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:14.085033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330562+0000","last_change":"2024-09-19T08:54:29.414478+0000","last_active":"2024-09-19T08:54:53.330562+0000","last_peered":"2024-09-19T08:54:53.330562+0000","last_clean":"2024-09-19T08:54:53.330562+0000","last_became_active":"2024-09-19T08:54:29.414152+0000","last_became_peered":"2024-09-19T08:54:29.414152+0000","last_unstale":"2024-09-19T08:54:53.330562+0000","last_undegraded":"2024-09-19T08:54:53.330562+0000","last_fullsized":"2024-09-19T08:54:53.330562+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:17.477340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":62554,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":200,"num_read_kb":162,"num_write":87,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":192727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579938,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":897024,"data_stored":435723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841574,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28564,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716588,"statfs":{"total":95995035648,"available":95965786112,"internally_reserved":0,"allocated":1576960,"data_stored":1088158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005099,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":436305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234032,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":436327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462965,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28488,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716664,"statfs":{"total":95995035648,"available":95965863936,"internally_reserved":0,"allocated":1499136,"data_stored":1026790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593786,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":435840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822719,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32656,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712496,"statfs":{"total":95995035648,"available":95961595904,"internally_reserved":0,"allocated":1507328,"data_stored":1026390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986244,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":435745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215176,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":436061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411405,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":497205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":497479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738454,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":435813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":67129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":61482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":61950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:56:14.986 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:56:15.266 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:15.654 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:15 smithi092 ceph-mon[31407]: pgmap v323: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:56:15.654 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:15 smithi092 ceph-mon[31407]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:56:15.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.734+0000 7f1d67c42640 1 -- 172.21.15.92:0/298340692 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d60102790 msgr2=0x7f1d601067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:15.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.734+0000 7f1d67c42640 1 --2- 172.21.15.92:0/298340692 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d60102790 0x7f1d601067e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1d50009900 tx=0x7f1d5002a410 comp rx=0 tx=0).stop 2024-09-19T08:56:15.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.734+0000 7f1d67c42640 1 -- 172.21.15.92:0/298340692 shutdown_connections 2024-09-19T08:56:15.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.734+0000 7f1d67c42640 1 --2- 172.21.15.92:0/298340692 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d60106f10 0x7f1d6010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:15.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.734+0000 7f1d67c42640 1 --2- 172.21.15.92:0/298340692 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d60102790 0x7f1d601067e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:15.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.734+0000 7f1d67c42640 1 --2- 172.21.15.92:0/298340692 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d60101de0 0x7f1d601021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:15.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.734+0000 7f1d67c42640 1 -- 172.21.15.92:0/298340692 >> 172.21.15.92:0/298340692 conn(0x7f1d600fd8c0 msgr2=0x7f1d600ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:15.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.735+0000 7f1d67c42640 1 -- 172.21.15.92:0/298340692 shutdown_connections 2024-09-19T08:56:15.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.735+0000 7f1d67c42640 1 -- 172.21.15.92:0/298340692 wait complete. 2024-09-19T08:56:15.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.735+0000 7f1d67c42640 1 Processor -- start 2024-09-19T08:56:15.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.735+0000 7f1d67c42640 1 -- start start 2024-09-19T08:56:15.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.735+0000 7f1d67c42640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d60101de0 0x7f1d60198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:15.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.735+0000 7f1d67c42640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d60102790 0x7f1d60198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:15.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.735+0000 7f1d67c42640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d60106f10 0x7f1d6019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:15.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.735+0000 7f1d67c42640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1d60111f30 con 0x7f1d60106f10 2024-09-19T08:56:15.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.735+0000 7f1d67c42640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1d60111db0 con 0x7f1d60101de0 2024-09-19T08:56:15.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.735+0000 7f1d67c42640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1d601120b0 con 0x7f1d60102790 2024-09-19T08:56:15.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.735+0000 7f1d661df640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d60106f10 0x7f1d6019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:15.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.735+0000 7f1d661df640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d60106f10 0x7f1d6019cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50352/0 (socket says 172.21.15.92:50352) 2024-09-19T08:56:15.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.735+0000 7f1d661df640 1 -- 172.21.15.92:0/410896361 learned_addr learned my addr 172.21.15.92:0/410896361 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:15.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.736+0000 7f1d659de640 1 --2- 172.21.15.92:0/410896361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d60101de0 0x7f1d60198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:15.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.736+0000 7f1d661df640 1 -- 172.21.15.92:0/410896361 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d60102790 msgr2=0x7f1d60198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:15.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.736+0000 7f1d661df640 1 --2- 172.21.15.92:0/410896361 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d60102790 0x7f1d60198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:15.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.736+0000 7f1d661df640 1 -- 172.21.15.92:0/410896361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d60101de0 msgr2=0x7f1d60198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:15.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.736+0000 7f1d661df640 1 --2- 172.21.15.92:0/410896361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d60101de0 0x7f1d60198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:15.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.736+0000 7f1d661df640 1 -- 172.21.15.92:0/410896361 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d6019d3e0 con 0x7f1d60106f10 2024-09-19T08:56:15.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.736+0000 7f1d661df640 1 --2- 172.21.15.92:0/410896361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d60106f10 0x7f1d6019cd00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1d5800eaa0 tx=0x7f1d5800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:15.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.736+0000 7f1d56ffd640 1 -- 172.21.15.92:0/410896361 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d5800cdb0 con 0x7f1d60106f10 2024-09-19T08:56:15.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.736+0000 7f1d67c42640 1 -- 172.21.15.92:0/410896361 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d6019d6d0 con 0x7f1d60106f10 2024-09-19T08:56:15.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.736+0000 7f1d56ffd640 1 -- 172.21.15.92:0/410896361 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d58005020 con 0x7f1d60106f10 2024-09-19T08:56:15.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.736+0000 7f1d56ffd640 1 -- 172.21.15.92:0/410896361 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d580116b0 con 0x7f1d60106f10 2024-09-19T08:56:15.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.736+0000 7f1d67c42640 1 -- 172.21.15.92:0/410896361 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d601a4fb0 con 0x7f1d60106f10 2024-09-19T08:56:15.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.737+0000 7f1d67c42640 1 -- 172.21.15.92:0/410896361 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d601021c0 con 0x7f1d60106f10 2024-09-19T08:56:15.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.738+0000 7f1d56ffd640 1 -- 172.21.15.92:0/410896361 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1d58005560 con 0x7f1d60106f10 2024-09-19T08:56:15.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.739+0000 7f1d56ffd640 1 --2- 172.21.15.92:0/410896361 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1d4c0a3240 0x7f1d4c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:15.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.739+0000 7f1d659de640 1 --2- 172.21.15.92:0/410896361 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1d4c0a3240 0x7f1d4c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:15.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.739+0000 7f1d56ffd640 1 -- 172.21.15.92:0/410896361 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1d580cfb00 con 0x7f1d60106f10 2024-09-19T08:56:15.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.739+0000 7f1d659de640 1 --2- 172.21.15.92:0/410896361 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1d4c0a3240 0x7f1d4c0a5700 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c00bbe0 tx=0x7f1d5c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:15.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.743+0000 7f1d56ffd640 1 -- 172.21.15.92:0/410896361 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1d58016030 con 0x7f1d60106f10 2024-09-19T08:56:15.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:15 smithi167 ceph-mon[35359]: pgmap v323: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:56:15.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:15 smithi167 ceph-mon[35359]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:56:15.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:15 smithi190 ceph-mon[35358]: pgmap v323: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-19T08:56:15.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:15 smithi190 ceph-mon[35358]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:56:15.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.945+0000 7f1d67c42640 1 -- 172.21.15.92:0/410896361 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1d6010a150 con 0x7f1d60106f10 2024-09-19T08:56:15.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.945+0000 7f1d56ffd640 1 -- 172.21.15.92:0/410896361 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f1d5809c820 con 0x7f1d60106f10 2024-09-19T08:56:15.946 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:15.946 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T08:56:15.946 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T08:56:15.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.948+0000 7f1d67c42640 1 -- 172.21.15.92:0/410896361 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1d4c0a3240 msgr2=0x7f1d4c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:15.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.948+0000 7f1d67c42640 1 --2- 172.21.15.92:0/410896361 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1d4c0a3240 0x7f1d4c0a5700 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c00bbe0 tx=0x7f1d5c00b390 comp rx=0 tx=0).stop 2024-09-19T08:56:15.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.948+0000 7f1d67c42640 1 -- 172.21.15.92:0/410896361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d60106f10 msgr2=0x7f1d6019cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:15.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.948+0000 7f1d67c42640 1 --2- 172.21.15.92:0/410896361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d60106f10 0x7f1d6019cd00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1d5800eaa0 tx=0x7f1d5800ef60 comp rx=0 tx=0).stop 2024-09-19T08:56:15.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.948+0000 7f1d67c42640 1 -- 172.21.15.92:0/410896361 shutdown_connections 2024-09-19T08:56:15.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.948+0000 7f1d67c42640 1 --2- 172.21.15.92:0/410896361 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1d4c0a3240 0x7f1d4c0a5700 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:15.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.948+0000 7f1d67c42640 1 --2- 172.21.15.92:0/410896361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d60106f10 0x7f1d6019cd00 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:15.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.948+0000 7f1d67c42640 1 --2- 172.21.15.92:0/410896361 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d60102790 0x7f1d60198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:15.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.948+0000 7f1d67c42640 1 --2- 172.21.15.92:0/410896361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d60101de0 0x7f1d60198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:15.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.948+0000 7f1d67c42640 1 -- 172.21.15.92:0/410896361 >> 172.21.15.92:0/410896361 conn(0x7f1d600fd8c0 msgr2=0x7f1d600fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:15.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.948+0000 7f1d67c42640 1 -- 172.21.15.92:0/410896361 shutdown_connections 2024-09-19T08:56:15.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:15.948+0000 7f1d67c42640 1 -- 172.21.15.92:0/410896361 wait complete. 2024-09-19T08:56:16.612 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:56:16.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:16 smithi092 ceph-mon[31407]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:56:16.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:16 smithi092 ceph-mon[31407]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:56:16.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:16 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/410896361' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:56:16.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:16 smithi167 ceph-mon[35359]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:56:16.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:16 smithi167 ceph-mon[35359]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:56:16.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:16 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/410896361' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:56:16.861 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:16.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:16 smithi190 ceph-mon[35358]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:56:16.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:16 smithi190 ceph-mon[35358]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:56:16.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:16 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/410896361' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:56:17.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.309+0000 7f501bdbf640 1 -- 172.21.15.92:0/3093180691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5014100a60 msgr2=0x7f5014100ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:17.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.309+0000 7f501bdbf640 1 --2- 172.21.15.92:0/3093180691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5014100a60 0x7f5014100ec0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5008009930 tx=0x7f500802a420 comp rx=0 tx=0).stop 2024-09-19T08:56:17.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.309+0000 7f501bdbf640 1 -- 172.21.15.92:0/3093180691 shutdown_connections 2024-09-19T08:56:17.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.309+0000 7f501bdbf640 1 --2- 172.21.15.92:0/3093180691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5014101400 0x7f501410d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:17.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.309+0000 7f501bdbf640 1 --2- 172.21.15.92:0/3093180691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5014100a60 0x7f5014100ec0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:17.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.309+0000 7f501bdbf640 1 --2- 172.21.15.92:0/3093180691 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5014106a60 0x7f5014106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:17.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.309+0000 7f501bdbf640 1 -- 172.21.15.92:0/3093180691 >> 172.21.15.92:0/3093180691 conn(0x7f50140fc780 msgr2=0x7f50140feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:17.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.309+0000 7f501bdbf640 1 -- 172.21.15.92:0/3093180691 shutdown_connections 2024-09-19T08:56:17.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.309+0000 7f501bdbf640 1 -- 172.21.15.92:0/3093180691 wait complete. 2024-09-19T08:56:17.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.309+0000 7f501bdbf640 1 Processor -- start 2024-09-19T08:56:17.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.310+0000 7f501bdbf640 1 -- start start 2024-09-19T08:56:17.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.310+0000 7f501bdbf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5014100a60 0x7f5014199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:17.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.310+0000 7f501bdbf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5014101400 0x7f50141998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:17.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.310+0000 7f501bdbf640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5014106a60 0x7f50141a4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:17.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.310+0000 7f501bdbf640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5014110e80 con 0x7f5014100a60 2024-09-19T08:56:17.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.310+0000 7f501bdbf640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5014110d00 con 0x7f5014101400 2024-09-19T08:56:17.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.310+0000 7f501bdbf640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5014111000 con 0x7f5014106a60 2024-09-19T08:56:17.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.310+0000 7f5019b5b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5014100a60 0x7f5014199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:17.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.310+0000 7f5019b5b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5014100a60 0x7f5014199390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50368/0 (socket says 172.21.15.92:50368) 2024-09-19T08:56:17.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.310+0000 7f5019b5b640 1 -- 172.21.15.92:0/2880362400 learned_addr learned my addr 172.21.15.92:0/2880362400 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:17.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.310+0000 7f5019b5b640 1 -- 172.21.15.92:0/2880362400 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5014106a60 msgr2=0x7f50141a4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:17.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.310+0000 7f5019b5b640 1 --2- 172.21.15.92:0/2880362400 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5014106a60 0x7f50141a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:17.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.310+0000 7f5019b5b640 1 -- 172.21.15.92:0/2880362400 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5014101400 msgr2=0x7f50141998d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T08:56:17.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.310+0000 7f5019b5b640 1 --2- 172.21.15.92:0/2880362400 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5014101400 0x7f50141998d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:17.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.310+0000 7f5019b5b640 1 -- 172.21.15.92:0/2880362400 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50141a4950 con 0x7f5014100a60 2024-09-19T08:56:17.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.310+0000 7f5019b5b640 1 --2- 172.21.15.92:0/2880362400 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5014100a60 0x7f5014199390 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f500c00b4a0 tx=0x7f500c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:17.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.310+0000 7f5012ffd640 1 -- 172.21.15.92:0/2880362400 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500c014070 con 0x7f5014100a60 2024-09-19T08:56:17.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.310+0000 7f501bdbf640 1 -- 172.21.15.92:0/2880362400 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50141a4b20 con 0x7f5014100a60 2024-09-19T08:56:17.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.310+0000 7f501bdbf640 1 -- 172.21.15.92:0/2880362400 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50141a5030 con 0x7f5014100a60 2024-09-19T08:56:17.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.310+0000 7f5012ffd640 1 -- 172.21.15.92:0/2880362400 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f500c010af0 con 0x7f5014100a60 2024-09-19T08:56:17.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.310+0000 7f5012ffd640 1 -- 172.21.15.92:0/2880362400 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500c017d10 con 0x7f5014100a60 2024-09-19T08:56:17.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.311+0000 7f501bdbf640 1 -- 172.21.15.92:0/2880362400 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5000005290 con 0x7f5014100a60 2024-09-19T08:56:17.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.313+0000 7f5012ffd640 1 -- 172.21.15.92:0/2880362400 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f500c017070 con 0x7f5014100a60 2024-09-19T08:56:17.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.313+0000 7f5012ffd640 1 --2- 172.21.15.92:0/2880362400 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4ffc0a3240 0x7f4ffc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:17.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.313+0000 7f501935a640 1 --2- 172.21.15.92:0/2880362400 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4ffc0a3240 0x7f4ffc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:17.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.313+0000 7f5012ffd640 1 -- 172.21.15.92:0/2880362400 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f500c0cf000 con 0x7f5014100a60 2024-09-19T08:56:17.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.314+0000 7f501935a640 1 --2- 172.21.15.92:0/2880362400 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4ffc0a3240 0x7f4ffc0a5700 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f500802a940 tx=0x7f5008000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:17.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.316+0000 7f5012ffd640 1 -- 172.21.15.92:0/2880362400 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f500c09bd20 con 0x7f5014100a60 2024-09-19T08:56:17.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.487+0000 7f501bdbf640 1 -- 172.21.15.92:0/2880362400 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5000005850 con 0x7f5014100a60 2024-09-19T08:56:17.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.489+0000 7f5012ffd640 1 -- 172.21.15.92:0/2880362400 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22782 (secure 0 0 0) 0x7f500c09b620 con 0x7f5014100a60 2024-09-19T08:56:17.489 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:17.489 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":82,"fsid":"91ff74f2-7663-11ef-bceb-c7b262605968","created":"2024-09-19T08:47:08.162150+0000","modified":"2024-09-19T08:54:53.324204+0000","last_up_change":"2024-09-19T08:53:43.021949+0000","last_in_change":"2024-09-19T08:53:19.246805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:50:04.482034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:54:28.005336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:54:30.188980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd104fe2-b828-4c98-a499-b212717f2997","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6803","nonce":4232030626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6805","nonce":4232030626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6809","nonce":4232030626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6807","nonce":4232030626}]},"public_addr":"172.21.15.92:6803/4232030626","cluster_addr":"172.21.15.92:6805/4232030626","heartbeat_back_addr":"172.21.15.92:6809/4232030626","heartbeat_front_addr":"172.21.15.92:6807/4232030626","state":["exists","up"]},{"osd":1,"uuid":"0f725330-5e61-413c-b3c8-41bc2c0d8e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6801","nonce":4163493234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6803","nonce":4163493234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6807","nonce":4163493234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6805","nonce":4163493234}]},"public_addr":"172.21.15.167:6801/4163493234","cluster_addr":"172.21.15.167:6803/4163493234","heartbeat_back_addr":"172.21.15.167:6807/4163493234","heartbeat_front_addr":"172.21.15.167:6805/4163493234","state":["exists","up"]},{"osd":2,"uuid":"286d2943-23a0-4184-93cf-9d3430781f99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6801","nonce":702507556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6803","nonce":702507556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6807","nonce":702507556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6805","nonce":702507556}]},"public_addr":"172.21.15.190:6801/702507556","cluster_addr":"172.21.15.190:6803/702507556","heartbeat_back_addr":"172.21.15.190:6807/702507556","heartbeat_front_addr":"172.21.15.190:6805/702507556","state":["exists","up"]},{"osd":3,"uuid":"9d126671-7fc1-4f29-9bc3-3598052fd20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6811","nonce":945752895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6813","nonce":945752895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6817","nonce":945752895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6815","nonce":945752895}]},"public_addr":"172.21.15.92:6811/945752895","cluster_addr":"172.21.15.92:6813/945752895","heartbeat_back_addr":"172.21.15.92:6817/945752895","heartbeat_front_addr":"172.21.15.92:6815/945752895","state":["exists","up"]},{"osd":4,"uuid":"cb10b38d-ae13-4b92-b906-3505fb873b2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6809","nonce":3576893400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6811","nonce":3576893400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6815","nonce":3576893400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6813","nonce":3576893400}]},"public_addr":"172.21.15.167:6809/3576893400","cluster_addr":"172.21.15.167:6811/3576893400","heartbeat_back_addr":"172.21.15.167:6815/3576893400","heartbeat_front_addr":"172.21.15.167:6813/3576893400","state":["exists","up"]},{"osd":5,"uuid":"cd90668b-eca5-4bb4-870e-e58578730c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6809","nonce":1880491675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6811","nonce":1880491675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6815","nonce":1880491675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6813","nonce":1880491675}]},"public_addr":"172.21.15.190:6809/1880491675","cluster_addr":"172.21.15.190:6811/1880491675","heartbeat_back_addr":"172.21.15.190:6815/1880491675","heartbeat_front_addr":"172.21.15.190:6813/1880491675","state":["exists","up"]},{"osd":6,"uuid":"4e047963-afa7-4934-b887-8086165fb831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6819","nonce":1743435653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6821","nonce":1743435653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6825","nonce":1743435653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6823","nonce":1743435653}]},"public_addr":"172.21.15.92:6819/1743435653","cluster_addr":"172.21.15.92:6821/1743435653","heartbeat_back_addr":"172.21.15.92:6825/1743435653","heartbeat_front_addr":"172.21.15.92:6823/1743435653","state":["exists","up"]},{"osd":7,"uuid":"652a6aa1-bb94-4608-952e-67cd02bdff66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6817","nonce":2984111963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6819","nonce":2984111963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6823","nonce":2984111963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6821","nonce":2984111963}]},"public_addr":"172.21.15.167:6817/2984111963","cluster_addr":"172.21.15.167:6819/2984111963","heartbeat_back_addr":"172.21.15.167:6823/2984111963","heartbeat_front_addr":"172.21.15.167:6821/2984111963","state":["exists","up"]},{"osd":8,"uuid":"1510ef1f-fdfe-4887-a771-146efce062fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6817","nonce":4190304434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6819","nonce":4190304434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6823","nonce":4190304434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6821","nonce":4190304434}]},"public_addr":"172.21.15.190:6817/4190304434","cluster_addr":"172.21.15.190:6819/4190304434","heartbeat_back_addr":"172.21.15.190:6823/4190304434","heartbeat_front_addr":"172.21.15.190:6821/4190304434","state":["exists","up"]},{"osd":9,"uuid":"9b774bbe-6700-4020-900b-3fdbaa546773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6827","nonce":3066744542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6829","nonce":3066744542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6833","nonce":3066744542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6831","nonce":3066744542}]},"public_addr":"172.21.15.92:6827/3066744542","cluster_addr":"172.21.15.92:6829/3066744542","heartbeat_back_addr":"172.21.15.92:6833/3066744542","heartbeat_front_addr":"172.21.15.92:6831/3066744542","state":["exists","up"]},{"osd":10,"uuid":"8abdb835-db2c-4597-ae1d-8ef56e63ab6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6825","nonce":2309134313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6827","nonce":2309134313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6831","nonce":2309134313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6829","nonce":2309134313}]},"public_addr":"172.21.15.167:6825/2309134313","cluster_addr":"172.21.15.167:6827/2309134313","heartbeat_back_addr":"172.21.15.167:6831/2309134313","heartbeat_front_addr":"172.21.15.167:6829/2309134313","state":["exists","up"]},{"osd":11,"uuid":"564c844a-378f-40cd-9717-cde35a65631c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6825","nonce":1849208751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6827","nonce":1849208751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6831","nonce":1849208751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6829","nonce":1849208751}]},"public_addr":"172.21.15.190:6825/1849208751","cluster_addr":"172.21.15.190:6827/1849208751","heartbeat_back_addr":"172.21.15.190:6831/1849208751","heartbeat_front_addr":"172.21.15.190:6829/1849208751","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:12.072109+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:36.689174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:01.908763+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:26.857439+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:50.881629+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:51:15.160744+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:51:39.101605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:03.179877+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:27.324563+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:51.971287+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:53:15.917311+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:53:40.592486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/2948821221":"2024-09-20T08:47:52.180093+0000","172.21.15.92:0/1441365956":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6801/2908709470":"2024-09-20T08:47:52.180093+0000","172.21.15.92:0/608374871":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6801/1369295034":"2024-09-20T08:47:29.812397+0000","172.21.15.92:6800/2908709470":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6800/1369295034":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/813486656":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/1963725565":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/1668504617":"2024-09-20T08:47:29.812397+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:56:17.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.491+0000 7f501bdbf640 1 -- 172.21.15.92:0/2880362400 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4ffc0a3240 msgr2=0x7f4ffc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:17.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.491+0000 7f501bdbf640 1 --2- 172.21.15.92:0/2880362400 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4ffc0a3240 0x7f4ffc0a5700 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f500802a940 tx=0x7f5008000bc0 comp rx=0 tx=0).stop 2024-09-19T08:56:17.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.491+0000 7f501bdbf640 1 -- 172.21.15.92:0/2880362400 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5014100a60 msgr2=0x7f5014199390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:17.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.491+0000 7f501bdbf640 1 --2- 172.21.15.92:0/2880362400 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5014100a60 0x7f5014199390 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f500c00b4a0 tx=0x7f500c00b960 comp rx=0 tx=0).stop 2024-09-19T08:56:17.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.491+0000 7f501bdbf640 1 -- 172.21.15.92:0/2880362400 shutdown_connections 2024-09-19T08:56:17.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.491+0000 7f501bdbf640 1 --2- 172.21.15.92:0/2880362400 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5014106a60 0x7f50141a4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:17.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.491+0000 7f501bdbf640 1 --2- 172.21.15.92:0/2880362400 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5014101400 0x7f50141998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:17.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.491+0000 7f501bdbf640 1 --2- 172.21.15.92:0/2880362400 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4ffc0a3240 0x7f4ffc0a5700 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:17.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.491+0000 7f501bdbf640 1 --2- 172.21.15.92:0/2880362400 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5014100a60 0x7f5014199390 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:17.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.491+0000 7f501bdbf640 1 -- 172.21.15.92:0/2880362400 >> 172.21.15.92:0/2880362400 conn(0x7f50140fc780 msgr2=0x7f50140fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:17.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.491+0000 7f501bdbf640 1 -- 172.21.15.92:0/2880362400 shutdown_connections 2024-09-19T08:56:17.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:17.491+0000 7f501bdbf640 1 -- 172.21.15.92:0/2880362400 wait complete. 2024-09-19T08:56:17.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:17 smithi092 ceph-mon[31407]: pgmap v324: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:56:17.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:17 smithi167 ceph-mon[35359]: pgmap v324: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:56:17.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:17 smithi190 ceph-mon[35358]: pgmap v324: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T08:56:18.156 DEBUG:tasks.fwd_scrub:Yielding 2024-09-19T08:56:18.156 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-19T08:56:18.167 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi092.front.sepia.ceph.com 2024-09-19T08:56:18.167 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-19T08:56:18.168 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-19T08:56:18.168 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:56:18.168 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:56:18.172 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-19T08:56:18.219 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T08:56:18.219 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:56:18.438 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:18.669 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:18 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/2880362400' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:56:18.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:18 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/2880362400' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:56:18.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:18 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/2880362400' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:56:18.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.877+0000 7f748b64d640 1 -- 172.21.15.92:0/2829400360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7484106f10 msgr2=0x7f748410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:18.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.877+0000 7f748b64d640 1 --2- 172.21.15.92:0/2829400360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7484106f10 0x7f748410ea90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f747c009ca0 tx=0x7f747c02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.877+0000 7f748b64d640 1 -- 172.21.15.92:0/2829400360 shutdown_connections 2024-09-19T08:56:18.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.877+0000 7f748b64d640 1 --2- 172.21.15.92:0/2829400360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7484106f10 0x7f748410ea90 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.877+0000 7f748b64d640 1 --2- 172.21.15.92:0/2829400360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7484102790 0x7f74841067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.877+0000 7f748b64d640 1 --2- 172.21.15.92:0/2829400360 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7484101de0 0x7f74841021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.877+0000 7f748b64d640 1 -- 172.21.15.92:0/2829400360 >> 172.21.15.92:0/2829400360 conn(0x7f74840fd8c0 msgr2=0x7f74840ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:18.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.877+0000 7f748b64d640 1 -- 172.21.15.92:0/2829400360 shutdown_connections 2024-09-19T08:56:18.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.877+0000 7f748b64d640 1 -- 172.21.15.92:0/2829400360 wait complete. 2024-09-19T08:56:18.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.878+0000 7f748b64d640 1 Processor -- start 2024-09-19T08:56:18.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.878+0000 7f748b64d640 1 -- start start 2024-09-19T08:56:18.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.878+0000 7f748b64d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7484101de0 0x7f74841983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:18.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.878+0000 7f748b64d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7484102790 0x7f7484198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:18.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.878+0000 7f748b64d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7484106f10 0x7f748419cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:18.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.878+0000 7f748b64d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7484111fc0 con 0x7f7484101de0 2024-09-19T08:56:18.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.878+0000 7f748b64d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7484111e40 con 0x7f7484102790 2024-09-19T08:56:18.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.878+0000 7f748b64d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7484112140 con 0x7f7484106f10 2024-09-19T08:56:18.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.878+0000 7f74893e9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7484101de0 0x7f74841983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:18.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.878+0000 7f74893e9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7484101de0 0x7f74841983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50386/0 (socket says 172.21.15.92:50386) 2024-09-19T08:56:18.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.878+0000 7f74893e9640 1 -- 172.21.15.92:0/1871436947 learned_addr learned my addr 172.21.15.92:0/1871436947 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:18.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.878+0000 7f7488be8640 1 --2- 172.21.15.92:0/1871436947 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7484102790 0x7f7484198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:18.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.879+0000 7f7489bea640 1 --2- 172.21.15.92:0/1871436947 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7484106f10 0x7f748419cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:18.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.879+0000 7f74893e9640 1 -- 172.21.15.92:0/1871436947 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7484106f10 msgr2=0x7f748419cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:18.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.879+0000 7f74893e9640 1 --2- 172.21.15.92:0/1871436947 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7484106f10 0x7f748419cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.879+0000 7f74893e9640 1 -- 172.21.15.92:0/1871436947 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7484102790 msgr2=0x7f7484198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:18.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.879+0000 7f74893e9640 1 --2- 172.21.15.92:0/1871436947 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7484102790 0x7f7484198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.879+0000 7f74893e9640 1 -- 172.21.15.92:0/1871436947 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f748419d380 con 0x7f7484101de0 2024-09-19T08:56:18.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.879+0000 7f7488be8640 1 --2- 172.21.15.92:0/1871436947 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7484102790 0x7f7484198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:18.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.879+0000 7f74893e9640 1 --2- 172.21.15.92:0/1871436947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7484101de0 0x7f74841983d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f748000d770 tx=0x7f748000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:18.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.879+0000 7f747a7fc640 1 -- 172.21.15.92:0/1871436947 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7480017070 con 0x7f7484101de0 2024-09-19T08:56:18.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.879+0000 7f748b64d640 1 -- 172.21.15.92:0/1871436947 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f748419d670 con 0x7f7484101de0 2024-09-19T08:56:18.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.879+0000 7f747a7fc640 1 -- 172.21.15.92:0/1871436947 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7480005500 con 0x7f7484101de0 2024-09-19T08:56:18.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.879+0000 7f747a7fc640 1 -- 172.21.15.92:0/1871436947 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7480004e00 con 0x7f7484101de0 2024-09-19T08:56:18.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.879+0000 7f748b64d640 1 -- 172.21.15.92:0/1871436947 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74841a4f50 con 0x7f7484101de0 2024-09-19T08:56:18.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.881+0000 7f747a7fc640 1 -- 172.21.15.92:0/1871436947 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7480004fa0 con 0x7f7484101de0 2024-09-19T08:56:18.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.882+0000 7f748da26740 1 Processor -- start 2024-09-19T08:56:18.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.882+0000 7f748da26740 1 -- start start 2024-09-19T08:56:18.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.882+0000 7f748da26740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cfe3e73b60 0x55cfe3e73f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:18.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.882+0000 7f748da26740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfe3e74480 0x55cfe3e7e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:18.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.882+0000 7f748da26740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cfe3e7ed40 0x55cfe3e81130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:18.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.882+0000 7f748da26740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cfe3dd9280 con 0x55cfe3e7ed40 2024-09-19T08:56:18.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.882+0000 7f748da26740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55cfe3d80b10 con 0x55cfe3e74480 2024-09-19T08:56:18.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.882+0000 7f748da26740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55cfe3dd5240 con 0x55cfe3e73b60 2024-09-19T08:56:18.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.882+0000 7f747a7fc640 1 --2- 172.21.15.92:0/1871436947 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f74700a3240 0x7f74700a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:18.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.882+0000 7f7488be8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cfe3e7ed40 0x55cfe3e81130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:18.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.882+0000 7f7488be8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cfe3e7ed40 0x55cfe3e81130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50392/0 (socket says 172.21.15.92:50392) 2024-09-19T08:56:18.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.882+0000 7f7488be8640 1 -- 172.21.15.92:0/4250206491 learned_addr learned my addr 172.21.15.92:0/4250206491 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:18.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.883+0000 7f7489bea640 1 --2- 172.21.15.92:0/4250206491 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cfe3e73b60 0x55cfe3e73f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:18.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.883+0000 7f7489bea640 1 --2- 172.21.15.92:0/1871436947 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f74700a3240 0x7f74700a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:18.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.883+0000 7f747a7fc640 1 -- 172.21.15.92:0/1871436947 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f74800cf480 con 0x7f7484101de0 2024-09-19T08:56:18.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.883+0000 7f74893e9640 1 --2- 172.21.15.92:0/4250206491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfe3e74480 0x55cfe3e7e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:18.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.883+0000 7f7488be8640 1 -- 172.21.15.92:0/4250206491 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cfe3e73b60 msgr2=0x55cfe3e73f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:18.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.883+0000 7f7488be8640 1 --2- 172.21.15.92:0/4250206491 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cfe3e73b60 0x55cfe3e73f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.883+0000 7f7488be8640 1 -- 172.21.15.92:0/4250206491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfe3e74480 msgr2=0x55cfe3e7e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:18.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.883+0000 7f7488be8640 1 --2- 172.21.15.92:0/4250206491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfe3e74480 0x55cfe3e7e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.883+0000 7f7488be8640 1 -- 172.21.15.92:0/4250206491 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfe3d8d1f0 con 0x55cfe3e7ed40 2024-09-19T08:56:18.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.883+0000 7f7488be8640 1 --2- 172.21.15.92:0/4250206491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cfe3e7ed40 0x55cfe3e81130 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f747400cbd0 tx=0x7f747400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46f559130f81c7e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:18.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.883+0000 7f7489bea640 1 --2- 172.21.15.92:0/1871436947 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f74700a3240 0x7f74700a5700 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f747c009a60 tx=0x7f747c0095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:18.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.883+0000 7f746f7fe640 1 -- 172.21.15.92:0/4250206491 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7474005220 con 0x55cfe3e7ed40 2024-09-19T08:56:18.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.883+0000 7f746f7fe640 1 -- 172.21.15.92:0/4250206491 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7474004c80 con 0x55cfe3e7ed40 2024-09-19T08:56:18.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.883+0000 7f746f7fe640 1 -- 172.21.15.92:0/4250206491 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7474010830 con 0x55cfe3e7ed40 2024-09-19T08:56:18.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.884+0000 7f748da26740 1 -- 172.21.15.92:0/4250206491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cfe3e7ed40 msgr2=0x55cfe3e81130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:18.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.884+0000 7f748da26740 1 --2- 172.21.15.92:0/4250206491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cfe3e7ed40 0x55cfe3e81130 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f747400cbd0 tx=0x7f747400e720 comp rx=0 tx=0).stop 2024-09-19T08:56:18.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.884+0000 7f748da26740 1 -- 172.21.15.92:0/4250206491 shutdown_connections 2024-09-19T08:56:18.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.884+0000 7f748da26740 1 --2- 172.21.15.92:0/4250206491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cfe3e7ed40 0x55cfe3e81130 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.884+0000 7f748da26740 1 --2- 172.21.15.92:0/4250206491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfe3e74480 0x55cfe3e7e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.884+0000 7f748da26740 1 --2- 172.21.15.92:0/4250206491 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cfe3e73b60 0x55cfe3e73f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.884+0000 7f748da26740 1 -- 172.21.15.92:0/4250206491 >> 172.21.15.92:0/4250206491 conn(0x55cfe3e700f0 msgr2=0x55cfe3e704d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:18.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.884+0000 7f748da26740 1 -- 172.21.15.92:0/4250206491 shutdown_connections 2024-09-19T08:56:18.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.884+0000 7f748da26740 1 -- 172.21.15.92:0/4250206491 wait complete. 2024-09-19T08:56:18.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.884+0000 7f748da26740 1 -- start start 2024-09-19T08:56:18.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.884+0000 7f748da26740 1 Processor -- start 2024-09-19T08:56:18.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.885+0000 7f748da26740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfe3e73b60 0x55cfe3e7bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:18.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.885+0000 7f748da26740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cfe3e74480 0x55cfe3e7c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:18.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.885+0000 7f748da26740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cfe3e7ed40 0x55cfe3e7c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:18.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.885+0000 7f748da26740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cfe3e81910 con 0x55cfe3e74480 2024-09-19T08:56:18.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.885+0000 7f748da26740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55cfe3d93f10 con 0x55cfe3e73b60 2024-09-19T08:56:18.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.885+0000 7f748da26740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55cfe3e81a90 con 0x55cfe3e7ed40 2024-09-19T08:56:18.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.885+0000 7f748da26740 10 client.0 _ll_register_callbacks cb 0x55cfe3d5ca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:18.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.885+0000 7f7488be8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cfe3e74480 0x55cfe3e7c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:18.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.885+0000 7f7488be8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cfe3e74480 0x55cfe3e7c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50396/0 (socket says 172.21.15.92:50396) 2024-09-19T08:56:18.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.885+0000 7f7488be8640 1 -- 172.21.15.92:0/3780989911 learned_addr learned my addr 172.21.15.92:0/3780989911 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:18.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.885+0000 7f74893e9640 1 --2- 172.21.15.92:0/3780989911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfe3e73b60 0x55cfe3e7bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:18.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.885+0000 7f7489bea640 1 --2- 172.21.15.92:0/3780989911 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cfe3e7ed40 0x55cfe3e7c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:18.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.885+0000 7f7488be8640 1 -- 172.21.15.92:0/3780989911 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cfe3e7ed40 msgr2=0x55cfe3e7c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:18.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.885+0000 7f7488be8640 1 --2- 172.21.15.92:0/3780989911 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cfe3e7ed40 0x55cfe3e7c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.885+0000 7f7488be8640 1 -- 172.21.15.92:0/3780989911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfe3e73b60 msgr2=0x55cfe3e7bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:18.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.885+0000 7f7488be8640 1 --2- 172.21.15.92:0/3780989911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfe3e73b60 0x55cfe3e7bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.885+0000 7f7488be8640 1 -- 172.21.15.92:0/3780989911 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfe3b4a6a0 con 0x55cfe3e74480 2024-09-19T08:56:18.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.885+0000 7f7489bea640 1 --2- 172.21.15.92:0/3780989911 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cfe3e7ed40 0x55cfe3e7c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:18.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.885+0000 7f7488be8640 1 --2- 172.21.15.92:0/3780989911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cfe3e74480 0x55cfe3e7c0e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f747400f010 tx=0x7f747400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3f724d91d4f0b3a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:18.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.885+0000 7f746cff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:56:18.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.886+0000 7f746cff9640 1 -- 172.21.15.92:0/3780989911 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747402a060 con 0x55cfe3e74480 2024-09-19T08:56:18.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.886+0000 7f746cff9640 1 -- 172.21.15.92:0/3780989911 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f74740048d0 con 0x55cfe3e74480 2024-09-19T08:56:18.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.886+0000 7f748da26740 1 -- 172.21.15.92:0/3780989911 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7474004c80 con 0x55cfe3e74480 2024-09-19T08:56:18.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.886+0000 7f746cff9640 1 -- 172.21.15.92:0/3780989911 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7474004ad0 con 0x55cfe3e74480 2024-09-19T08:56:18.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.886+0000 7f748da26740 10 client.15171 fetch_fsmap learned FSMap version 19 2024-09-19T08:56:18.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.886+0000 7f748da26740 1 -- 172.21.15.92:0/3780989911 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55cfe3e8d4a0 con 0x55cfe3e74480 2024-09-19T08:56:18.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.886+0000 7f746cff9640 1 -- 172.21.15.92:0/3780989911 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7474004c80 con 0x55cfe3e74480 2024-09-19T08:56:18.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.886+0000 7f746cff9640 1 -- 172.21.15.92:0/3780989911 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f747402f070 con 0x55cfe3e74480 2024-09-19T08:56:18.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.886+0000 7f748da26740 10 client.15171 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:56:18.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.886+0000 7f748da26740 10 client.15171 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:56:18.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.886+0000 7f748da26740 20 client.15171 populate_metadata read hostname 'smithi092' 2024-09-19T08:56:18.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.886+0000 7f748da26740 1 --2- 172.21.15.92:0/3780989911 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55cfe3e8e960 0x55cfe3e90d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:18.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.886+0000 7f748da26740 4 client.15171 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:56:18.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.886+0000 7f748da26740 1 -- 172.21.15.92:0/3780989911 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cfe3de67f0 con 0x55cfe3e8e960 2024-09-19T08:56:18.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.887+0000 7f74893e9640 1 --2- 172.21.15.92:0/3780989911 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55cfe3e8e960 0x55cfe3e90d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:18.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.887+0000 7f74893e9640 1 --2- 172.21.15.92:0/3780989911 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55cfe3e8e960 0x55cfe3e90d50 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1bd5178416cf9d7 server_cookie=922366d55bdd5ba9 in_seq=0 out_seq=0 2024-09-19T08:56:18.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.887+0000 7f746cff9640 10 client.15171 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:18.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.888+0000 7f746cff9640 1 -- 172.21.15.92:0/3780989911 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cfe3de67f0 con 0x55cfe3e8e960 2024-09-19T08:56:18.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.888+0000 7f746cff9640 10 client.15171 handle_command_reply: tid=0 2024-09-19T08:56:18.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.888+0000 7f748da26740 1 client.15171 shutdown 2024-09-19T08:56:18.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.888+0000 7f748da26740 1 -- 172.21.15.92:0/3780989911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cfe3e74480 msgr2=0x55cfe3e7c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:18.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.888+0000 7f748da26740 1 --2- 172.21.15.92:0/3780989911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cfe3e74480 0x55cfe3e7c0e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f747400f010 tx=0x7f747400c940 comp rx=0 tx=0).stop 2024-09-19T08:56:18.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.888+0000 7f748da26740 1 -- 172.21.15.92:0/3780989911 shutdown_connections 2024-09-19T08:56:18.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.888+0000 7f748da26740 1 --2- 172.21.15.92:0/3780989911 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55cfe3e8e960 0x55cfe3e90d50 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.888+0000 7f748da26740 1 --2- 172.21.15.92:0/3780989911 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cfe3e7ed40 0x55cfe3e7c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.888+0000 7f748da26740 1 --2- 172.21.15.92:0/3780989911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cfe3e74480 0x55cfe3e7c0e0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.888+0000 7f746cff9640 0 client.15171 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:18.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.888+0000 7f748da26740 1 --2- 172.21.15.92:0/3780989911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfe3e73b60 0x55cfe3e7bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.888+0000 7f748da26740 1 -- 172.21.15.92:0/3780989911 >> 172.21.15.92:0/3780989911 conn(0x55cfe3e700f0 msgr2=0x55cfe3e6f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:18.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.888+0000 7f748da26740 1 -- 172.21.15.92:0/3780989911 shutdown_connections 2024-09-19T08:56:18.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.888+0000 7f748da26740 1 -- 172.21.15.92:0/3780989911 wait complete. 2024-09-19T08:56:18.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.888+0000 7f748da26740 20 client.15171 trim_cache size 0 max 16384 2024-09-19T08:56:18.898 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:18.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.905+0000 7f748da26740 1 Processor -- start 2024-09-19T08:56:18.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.906+0000 7f748da26740 1 -- start start 2024-09-19T08:56:18.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.906+0000 7f748da26740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfe3e73b60 0x55cfe3e96380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:18.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.906+0000 7f748da26740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cfe3e74480 0x55cfe3e968c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:18.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.906+0000 7f748da26740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cfe3e7ed40 0x55cfe3e755b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:18.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.906+0000 7f748da26740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f74841ab550 con 0x55cfe3e7ed40 2024-09-19T08:56:18.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.906+0000 7f748da26740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f74841addf0 con 0x55cfe3e73b60 2024-09-19T08:56:18.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.906+0000 7f748da26740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f74841abbe0 con 0x55cfe3e74480 2024-09-19T08:56:18.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.906+0000 7f7489bea640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cfe3e7ed40 0x55cfe3e755b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:18.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.906+0000 7f7489bea640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cfe3e7ed40 0x55cfe3e755b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50412/0 (socket says 172.21.15.92:50412) 2024-09-19T08:56:18.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.906+0000 7f7489bea640 1 -- 172.21.15.92:0/2875159552 learned_addr learned my addr 172.21.15.92:0/2875159552 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:18.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.906+0000 7f7488be8640 1 --2- 172.21.15.92:0/2875159552 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cfe3e74480 0x55cfe3e968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:18.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.906+0000 7f74893e9640 1 --2- 172.21.15.92:0/2875159552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfe3e73b60 0x55cfe3e96380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:18.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.907+0000 7f7489bea640 1 -- 172.21.15.92:0/2875159552 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cfe3e74480 msgr2=0x55cfe3e968c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:18.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.907+0000 7f7489bea640 1 --2- 172.21.15.92:0/2875159552 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cfe3e74480 0x55cfe3e968c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.907+0000 7f7489bea640 1 -- 172.21.15.92:0/2875159552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfe3e73b60 msgr2=0x55cfe3e96380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:18.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.907+0000 7f7489bea640 1 --2- 172.21.15.92:0/2875159552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfe3e73b60 0x55cfe3e96380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.907+0000 7f7489bea640 1 -- 172.21.15.92:0/2875159552 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfe3e6fb90 con 0x55cfe3e7ed40 2024-09-19T08:56:18.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.907+0000 7f7488be8640 1 --2- 172.21.15.92:0/2875159552 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cfe3e74480 0x55cfe3e968c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:18.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.907+0000 7f7489bea640 1 --2- 172.21.15.92:0/2875159552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cfe3e7ed40 0x55cfe3e755b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f747c035000 tx=0x7f747c043000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c37f3e2a9fbc258 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:18.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.907+0000 7f746effd640 1 -- 172.21.15.92:0/2875159552 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747c0318e0 con 0x55cfe3e7ed40 2024-09-19T08:56:18.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.907+0000 7f746effd640 1 -- 172.21.15.92:0/2875159552 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f747c036040 con 0x55cfe3e7ed40 2024-09-19T08:56:18.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.907+0000 7f746effd640 1 -- 172.21.15.92:0/2875159552 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747c030b30 con 0x55cfe3e7ed40 2024-09-19T08:56:18.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.908+0000 7f748da26740 1 -- 172.21.15.92:0/2875159552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cfe3e7ed40 msgr2=0x55cfe3e755b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:18.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.908+0000 7f748da26740 1 --2- 172.21.15.92:0/2875159552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cfe3e7ed40 0x55cfe3e755b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f747c035000 tx=0x7f747c043000 comp rx=0 tx=0).stop 2024-09-19T08:56:18.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.908+0000 7f748da26740 1 -- 172.21.15.92:0/2875159552 shutdown_connections 2024-09-19T08:56:18.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.908+0000 7f748da26740 1 --2- 172.21.15.92:0/2875159552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cfe3e7ed40 0x55cfe3e755b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.908+0000 7f748da26740 1 --2- 172.21.15.92:0/2875159552 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cfe3e74480 0x55cfe3e968c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.908+0000 7f748da26740 1 --2- 172.21.15.92:0/2875159552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfe3e73b60 0x55cfe3e96380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.908+0000 7f748da26740 1 -- 172.21.15.92:0/2875159552 >> 172.21.15.92:0/2875159552 conn(0x55cfe3e700f0 msgr2=0x55cfe3e7db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:18.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.908+0000 7f748da26740 1 -- 172.21.15.92:0/2875159552 shutdown_connections 2024-09-19T08:56:18.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.908+0000 7f748da26740 1 -- 172.21.15.92:0/2875159552 wait complete. 2024-09-19T08:56:18.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.908+0000 7f748da26740 1 -- start start 2024-09-19T08:56:18.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.908+0000 7f748da26740 1 Processor -- start 2024-09-19T08:56:18.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.909+0000 7f748da26740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfe3e73b60 0x55cfe3e87490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:18.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.909+0000 7f748da26740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cfe3e74480 0x55cfe3e827c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:18.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.909+0000 7f748da26740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cfe3e7ed40 0x55cfe3e82d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:18.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.909+0000 7f748da26740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f74841ac2b0 con 0x55cfe3e7ed40 2024-09-19T08:56:18.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.909+0000 7f748da26740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f74841ad720 con 0x55cfe3e73b60 2024-09-19T08:56:18.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.909+0000 7f748da26740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f74841ac980 con 0x55cfe3e74480 2024-09-19T08:56:18.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.909+0000 7f748da26740 10 client.0 _ll_register_callbacks cb 0x7f7474014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:18.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.909+0000 7f7489bea640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cfe3e7ed40 0x55cfe3e82d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:18.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.909+0000 7f7489bea640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cfe3e7ed40 0x55cfe3e82d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50414/0 (socket says 172.21.15.92:50414) 2024-09-19T08:56:18.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.909+0000 7f7489bea640 1 -- 172.21.15.92:0/2924550896 learned_addr learned my addr 172.21.15.92:0/2924550896 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:18.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.909+0000 7f74893e9640 1 --2- 172.21.15.92:0/2924550896 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfe3e73b60 0x55cfe3e87490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:18.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.909+0000 7f7488be8640 1 --2- 172.21.15.92:0/2924550896 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cfe3e74480 0x55cfe3e827c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:18.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.909+0000 7f7489bea640 1 -- 172.21.15.92:0/2924550896 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cfe3e74480 msgr2=0x55cfe3e827c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:18.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.909+0000 7f7489bea640 1 --2- 172.21.15.92:0/2924550896 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cfe3e74480 0x55cfe3e827c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.909+0000 7f7489bea640 1 -- 172.21.15.92:0/2924550896 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfe3e73b60 msgr2=0x55cfe3e87490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:18.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.909+0000 7f7489bea640 1 --2- 172.21.15.92:0/2924550896 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfe3e73b60 0x55cfe3e87490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.909+0000 7f7489bea640 1 -- 172.21.15.92:0/2924550896 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfe3e83530 con 0x55cfe3e7ed40 2024-09-19T08:56:18.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.909+0000 7f74893e9640 1 --2- 172.21.15.92:0/2924550896 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfe3e73b60 0x55cfe3e87490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:18.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.910+0000 7f7489bea640 1 --2- 172.21.15.92:0/2924550896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cfe3e7ed40 0x55cfe3e82d00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f747c006010 tx=0x7f747c02f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f802752cf2b8b04 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:18.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.910+0000 7f746cff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:56:18.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.910+0000 7f746cff9640 1 -- 172.21.15.92:0/2924550896 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747c031cf0 con 0x55cfe3e7ed40 2024-09-19T08:56:18.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.910+0000 7f746cff9640 1 -- 172.21.15.92:0/2924550896 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f747c02fda0 con 0x55cfe3e7ed40 2024-09-19T08:56:18.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.910+0000 7f748da26740 1 -- 172.21.15.92:0/2924550896 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f747c036040 con 0x55cfe3e7ed40 2024-09-19T08:56:18.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.911+0000 7f746cff9640 1 -- 172.21.15.92:0/2924550896 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f747c030870 con 0x55cfe3e7ed40 2024-09-19T08:56:18.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.911+0000 7f748da26740 10 client.15177 fetch_fsmap learned FSMap version 19 2024-09-19T08:56:18.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.911+0000 7f748da26740 1 -- 172.21.15.92:0/2924550896 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55cfe3efd800 con 0x55cfe3e7ed40 2024-09-19T08:56:18.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.911+0000 7f746cff9640 1 -- 172.21.15.92:0/2924550896 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f747c036040 con 0x55cfe3e7ed40 2024-09-19T08:56:18.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.911+0000 7f746cff9640 1 -- 172.21.15.92:0/2924550896 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f747c04a040 con 0x55cfe3e7ed40 2024-09-19T08:56:18.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.911+0000 7f748da26740 10 client.15177 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:56:18.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.911+0000 7f748da26740 10 client.15177 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:56:18.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.911+0000 7f748da26740 20 client.15177 populate_metadata read hostname 'smithi092' 2024-09-19T08:56:18.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.911+0000 7f748da26740 1 --2- 172.21.15.92:0/2924550896 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55cfe3efde70 0x55cfe3f00260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:18.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.911+0000 7f748da26740 4 client.15177 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:56:18.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.911+0000 7f748da26740 1 -- 172.21.15.92:0/2924550896 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55cfe3de0d00 con 0x55cfe3efde70 2024-09-19T08:56:18.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.912+0000 7f74893e9640 1 --2- 172.21.15.92:0/2924550896 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55cfe3efde70 0x55cfe3f00260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:18.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.912+0000 7f74893e9640 1 --2- 172.21.15.92:0/2924550896 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55cfe3efde70 0x55cfe3f00260 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31bbf75a0fe94454 server_cookie=25e3eae51515bf5c in_seq=0 out_seq=0 2024-09-19T08:56:18.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.912+0000 7f746cff9640 10 client.15177 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:18.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.913+0000 7f746cff9640 1 -- 172.21.15.92:0/2924550896 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55cfe3de0d00 con 0x55cfe3efde70 2024-09-19T08:56:18.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.913+0000 7f746cff9640 10 client.15177 handle_command_reply: tid=0 2024-09-19T08:56:18.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.913+0000 7f748da26740 1 client.15177 shutdown 2024-09-19T08:56:18.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.913+0000 7f748da26740 1 -- 172.21.15.92:0/2924550896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cfe3e7ed40 msgr2=0x55cfe3e82d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:18.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.913+0000 7f748da26740 1 --2- 172.21.15.92:0/2924550896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cfe3e7ed40 0x55cfe3e82d00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f747c006010 tx=0x7f747c02f490 comp rx=0 tx=0).stop 2024-09-19T08:56:18.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.913+0000 7f748da26740 1 -- 172.21.15.92:0/2924550896 shutdown_connections 2024-09-19T08:56:18.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.913+0000 7f748da26740 1 --2- 172.21.15.92:0/2924550896 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55cfe3efde70 0x55cfe3f00260 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.913+0000 7f748da26740 1 --2- 172.21.15.92:0/2924550896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cfe3e7ed40 0x55cfe3e82d00 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.913+0000 7f746cff9640 0 client.15177 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:18.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.913+0000 7f748da26740 1 --2- 172.21.15.92:0/2924550896 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cfe3e74480 0x55cfe3e827c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.913+0000 7f748da26740 1 --2- 172.21.15.92:0/2924550896 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfe3e73b60 0x55cfe3e87490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.913+0000 7f748da26740 1 -- 172.21.15.92:0/2924550896 >> 172.21.15.92:0/2924550896 conn(0x55cfe3e700f0 msgr2=0x55cfe3e7baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:18.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.914+0000 7f748da26740 1 -- 172.21.15.92:0/2924550896 shutdown_connections 2024-09-19T08:56:18.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.914+0000 7f748da26740 1 -- 172.21.15.92:0/2924550896 wait complete. 2024-09-19T08:56:18.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.914+0000 7f748da26740 20 client.15177 trim_cache size 0 max 16384 2024-09-19T08:56:18.917 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T08:56:18.917 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-19T08:56:18.917 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "0c846b43-9676-4d94-9823-f5cb19280415", 2024-09-19T08:56:18.917 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-19T08:56:18.917 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T08:56:18.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.914+0000 7f748b64d640 1 -- 172.21.15.92:0/1871436947 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f74700a3240 msgr2=0x7f74700a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:18.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.914+0000 7f748b64d640 1 --2- 172.21.15.92:0/1871436947 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f74700a3240 0x7f74700a5700 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f747c009a60 tx=0x7f747c0095c0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.914+0000 7f748b64d640 1 -- 172.21.15.92:0/1871436947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7484101de0 msgr2=0x7f74841983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:18.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.914+0000 7f748b64d640 1 --2- 172.21.15.92:0/1871436947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7484101de0 0x7f74841983d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f748000d770 tx=0x7f748000dc30 comp rx=0 tx=0).stop 2024-09-19T08:56:18.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.914+0000 7f748b64d640 1 -- 172.21.15.92:0/1871436947 shutdown_connections 2024-09-19T08:56:18.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.914+0000 7f748b64d640 1 --2- 172.21.15.92:0/1871436947 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7484106f10 0x7f748419cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.914+0000 7f748b64d640 1 --2- 172.21.15.92:0/1871436947 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7484102790 0x7f7484198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.914+0000 7f748b64d640 1 --2- 172.21.15.92:0/1871436947 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f74700a3240 0x7f74700a5700 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.914+0000 7f748b64d640 1 --2- 172.21.15.92:0/1871436947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7484101de0 0x7f74841983d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.914+0000 7f748b64d640 1 -- 172.21.15.92:0/1871436947 >> 172.21.15.92:0/1871436947 conn(0x7f74840fd8c0 msgr2=0x7f74840fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:18.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.915+0000 7f748b64d640 1 -- 172.21.15.92:0/1871436947 shutdown_connections 2024-09-19T08:56:18.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:18.915+0000 7f748b64d640 1 -- 172.21.15.92:0/1871436947 wait complete. 2024-09-19T08:56:19.651 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:19 smithi092 ceph-mon[31407]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-19T08:56:19.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.651+0000 7f55d4fa7640 1 -- 172.21.15.92:0/626017843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55d0101de0 msgr2=0x7f55d01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:19.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.651+0000 7f55d4fa7640 1 --2- 172.21.15.92:0/626017843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55d0101de0 0x7f55d01021c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f55c0009900 tx=0x7f55c002a3f0 comp rx=0 tx=0).stop 2024-09-19T08:56:19.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.651+0000 7f55d4fa7640 1 -- 172.21.15.92:0/626017843 shutdown_connections 2024-09-19T08:56:19.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.651+0000 7f55d4fa7640 1 --2- 172.21.15.92:0/626017843 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55d0106f10 0x7f55d010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:19.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.651+0000 7f55d4fa7640 1 --2- 172.21.15.92:0/626017843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55d0102790 0x7f55d01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:19.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.651+0000 7f55d4fa7640 1 --2- 172.21.15.92:0/626017843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55d0101de0 0x7f55d01021c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:19.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.651+0000 7f55d4fa7640 1 -- 172.21.15.92:0/626017843 >> 172.21.15.92:0/626017843 conn(0x7f55d00fd8c0 msgr2=0x7f55d00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:19.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.651+0000 7f55d4fa7640 1 -- 172.21.15.92:0/626017843 shutdown_connections 2024-09-19T08:56:19.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.651+0000 7f55d4fa7640 1 -- 172.21.15.92:0/626017843 wait complete. 2024-09-19T08:56:19.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.652+0000 7f55d4fa7640 1 Processor -- start 2024-09-19T08:56:19.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.652+0000 7f55d4fa7640 1 -- start start 2024-09-19T08:56:19.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.653+0000 7f55d4fa7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55d0101de0 0x7f55d00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:19.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.653+0000 7f55d4fa7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55d0102790 0x7f55d0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:19.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.653+0000 7f55d4fa7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55d0106f10 0x7f55d0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:19.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.653+0000 7f55d4fa7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f55d0111f90 con 0x7f55d0101de0 2024-09-19T08:56:19.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.653+0000 7f55d4fa7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f55d0111e10 con 0x7f55d0102790 2024-09-19T08:56:19.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.653+0000 7f55d4fa7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f55d0112110 con 0x7f55d0106f10 2024-09-19T08:56:19.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.653+0000 7f55ce59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55d0101de0 0x7f55d00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:19.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.653+0000 7f55ce59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55d0101de0 0x7f55d00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50440/0 (socket says 172.21.15.92:50440) 2024-09-19T08:56:19.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.653+0000 7f55ce59c640 1 -- 172.21.15.92:0/819007789 learned_addr learned my addr 172.21.15.92:0/819007789 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:19.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.653+0000 7f55ced9d640 1 --2- 172.21.15.92:0/819007789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55d0106f10 0x7f55d0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:19.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.653+0000 7f55c5d9b640 1 --2- 172.21.15.92:0/819007789 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55d0102790 0x7f55d0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:19.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.653+0000 7f55ce59c640 1 -- 172.21.15.92:0/819007789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55d0106f10 msgr2=0x7f55d0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:19.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.653+0000 7f55ce59c640 1 --2- 172.21.15.92:0/819007789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55d0106f10 0x7f55d0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:19.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.653+0000 7f55ce59c640 1 -- 172.21.15.92:0/819007789 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55d0102790 msgr2=0x7f55d0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:19.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.653+0000 7f55ce59c640 1 --2- 172.21.15.92:0/819007789 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55d0102790 0x7f55d0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:19.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.653+0000 7f55ce59c640 1 -- 172.21.15.92:0/819007789 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55d01a6890 con 0x7f55d0101de0 2024-09-19T08:56:19.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.653+0000 7f55ced9d640 1 --2- 172.21.15.92:0/819007789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55d0106f10 0x7f55d0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:19.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.653+0000 7f55ce59c640 1 --2- 172.21.15.92:0/819007789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55d0101de0 0x7f55d00744f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f55c0005ab0 tx=0x7f55c00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:19.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.653+0000 7f55c7fff640 1 -- 172.21.15.92:0/819007789 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c003f030 con 0x7f55d0101de0 2024-09-19T08:56:19.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.653+0000 7f55d4fa7640 1 -- 172.21.15.92:0/819007789 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55d01a6b20 con 0x7f55d0101de0 2024-09-19T08:56:19.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.653+0000 7f55c7fff640 1 -- 172.21.15.92:0/819007789 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55c0003ce0 con 0x7f55d0101de0 2024-09-19T08:56:19.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.654+0000 7f55c7fff640 1 -- 172.21.15.92:0/819007789 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c0035070 con 0x7f55d0101de0 2024-09-19T08:56:19.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.654+0000 7f55d4fa7640 1 -- 172.21.15.92:0/819007789 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55d01a7050 con 0x7f55d0101de0 2024-09-19T08:56:19.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.654+0000 7f55d4fa7640 1 -- 172.21.15.92:0/819007789 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55d01021c0 con 0x7f55d0101de0 2024-09-19T08:56:19.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.656+0000 7f55c7fff640 1 -- 172.21.15.92:0/819007789 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f55c0042030 con 0x7f55d0101de0 2024-09-19T08:56:19.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.656+0000 7f55c7fff640 1 --2- 172.21.15.92:0/819007789 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f55bc0a3240 0x7f55bc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:19.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.656+0000 7f55c5d9b640 1 --2- 172.21.15.92:0/819007789 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f55bc0a3240 0x7f55bc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:19.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.656+0000 7f55c7fff640 1 -- 172.21.15.92:0/819007789 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f55c00f02d0 con 0x7f55d0101de0 2024-09-19T08:56:19.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.657+0000 7f55c5d9b640 1 --2- 172.21.15.92:0/819007789 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f55bc0a3240 0x7f55bc0a5700 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f55b8005e10 tx=0x7f55b8005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:19.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.660+0000 7f55c7fff640 1 -- 172.21.15.92:0/819007789 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f55c00bcff0 con 0x7f55d0101de0 2024-09-19T08:56:19.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.826+0000 7f55d4fa7640 1 -- 172.21.15.92:0/819007789 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f55d0062630 con 0x7f55bc0a3240 2024-09-19T08:56:19.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.833+0000 7f55c7fff640 1 -- 172.21.15.92:0/819007789 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258749 (secure 0 0 0) 0x7f55d0062630 con 0x7f55bc0a3240 2024-09-19T08:56:19.835 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:19.836 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-19T08:56:19.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.836+0000 7f55d4fa7640 1 -- 172.21.15.92:0/819007789 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f55bc0a3240 msgr2=0x7f55bc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:19.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.836+0000 7f55d4fa7640 1 --2- 172.21.15.92:0/819007789 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f55bc0a3240 0x7f55bc0a5700 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f55b8005e10 tx=0x7f55b8005da0 comp rx=0 tx=0).stop 2024-09-19T08:56:19.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.836+0000 7f55d4fa7640 1 -- 172.21.15.92:0/819007789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55d0101de0 msgr2=0x7f55d00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:19.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.836+0000 7f55d4fa7640 1 --2- 172.21.15.92:0/819007789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55d0101de0 0x7f55d00744f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f55c0005ab0 tx=0x7f55c00042f0 comp rx=0 tx=0).stop 2024-09-19T08:56:19.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.836+0000 7f55d4fa7640 1 -- 172.21.15.92:0/819007789 shutdown_connections 2024-09-19T08:56:19.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.836+0000 7f55d4fa7640 1 --2- 172.21.15.92:0/819007789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55d0106f10 0x7f55d0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:19.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.836+0000 7f55d4fa7640 1 --2- 172.21.15.92:0/819007789 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55d0102790 0x7f55d0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:19.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.836+0000 7f55d4fa7640 1 --2- 172.21.15.92:0/819007789 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f55bc0a3240 0x7f55bc0a5700 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:19.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.836+0000 7f55d4fa7640 1 --2- 172.21.15.92:0/819007789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55d0101de0 0x7f55d00744f0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:19.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.836+0000 7f55d4fa7640 1 -- 172.21.15.92:0/819007789 >> 172.21.15.92:0/819007789 conn(0x7f55d00fd8c0 msgr2=0x7f55d00fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:19.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.836+0000 7f55d4fa7640 1 -- 172.21.15.92:0/819007789 shutdown_connections 2024-09-19T08:56:19.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:19.836+0000 7f55d4fa7640 1 -- 172.21.15.92:0/819007789 wait complete. 2024-09-19T08:56:19.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:19 smithi167 ceph-mon[35359]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-19T08:56:19.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:19 smithi190 ceph-mon[35358]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-19T08:56:20.186 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:56:20.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:20 smithi092 ceph-mon[31407]: scrub queued for path: / 2024-09-19T08:56:20.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:20 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T08:56:20.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:20 smithi092 ceph-mon[31407]: scrub summary: active paths [/] 2024-09-19T08:56:20.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:20 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T08:56:20.802 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":325,"stamp":"2024-09-19T08:56:18.281161+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658529,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":337,"num_read_kb":282,"num_write":273,"num_write_kb":3036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":713,"ondisk_log_size":713,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365964,"kb_used_data":12556,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575860,"statfs":{"total":1151940427776,"available":1151565680640,"internally_reserved":0,"allocated":12857344,"data_stored":7198890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5681,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":22,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003061"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277427+0000","last_change":"2024-09-19T08:54:31.437743+0000","last_active":"2024-09-19T08:55:52.277427+0000","last_peered":"2024-09-19T08:55:52.277427+0000","last_clean":"2024-09-19T08:55:52.277427+0000","last_became_active":"2024-09-19T08:54:31.437426+0000","last_became_peered":"2024-09-19T08:54:31.437426+0000","last_unstale":"2024-09-19T08:55:52.277427+0000","last_undegraded":"2024-09-19T08:55:52.277427+0000","last_fullsized":"2024-09-19T08:55:52.277427+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:04.403522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.282945+0000","last_change":"2024-09-19T08:54:31.430322+0000","last_active":"2024-09-19T08:55:52.282945+0000","last_peered":"2024-09-19T08:55:52.282945+0000","last_clean":"2024-09-19T08:55:52.282945+0000","last_became_active":"2024-09-19T08:54:31.430008+0000","last_became_peered":"2024-09-19T08:54:31.430008+0000","last_unstale":"2024-09-19T08:55:52.282945+0000","last_undegraded":"2024-09-19T08:55:52.282945+0000","last_fullsized":"2024-09-19T08:55:52.282945+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:19.800686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.271299+0000","last_change":"2024-09-19T08:54:31.430276+0000","last_active":"2024-09-19T08:55:52.271299+0000","last_peered":"2024-09-19T08:55:52.271299+0000","last_clean":"2024-09-19T08:55:52.271299+0000","last_became_active":"2024-09-19T08:54:31.429939+0000","last_became_peered":"2024-09-19T08:54:31.429939+0000","last_unstale":"2024-09-19T08:55:52.271299+0000","last_undegraded":"2024-09-19T08:55:52.271299+0000","last_fullsized":"2024-09-19T08:55:52.271299+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:08.735067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.260618+0000","last_change":"2024-09-19T08:54:31.435197+0000","last_active":"2024-09-19T08:55:52.260618+0000","last_peered":"2024-09-19T08:55:52.260618+0000","last_clean":"2024-09-19T08:55:52.260618+0000","last_became_active":"2024-09-19T08:54:31.434872+0000","last_became_peered":"2024-09-19T08:54:31.434872+0000","last_unstale":"2024-09-19T08:55:52.260618+0000","last_undegraded":"2024-09-19T08:55:52.260618+0000","last_fullsized":"2024-09-19T08:55:52.260618+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:06.213317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.256859+0000","last_change":"2024-09-19T08:54:31.423765+0000","last_active":"2024-09-19T08:55:52.256859+0000","last_peered":"2024-09-19T08:55:52.256859+0000","last_clean":"2024-09-19T08:55:52.256859+0000","last_became_active":"2024-09-19T08:54:31.423296+0000","last_became_peered":"2024-09-19T08:54:31.423296+0000","last_unstale":"2024-09-19T08:55:52.256859+0000","last_undegraded":"2024-09-19T08:55:52.256859+0000","last_fullsized":"2024-09-19T08:55:52.256859+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:07.507168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.283359+0000","last_change":"2024-09-19T08:54:31.430299+0000","last_active":"2024-09-19T08:55:52.283359+0000","last_peered":"2024-09-19T08:55:52.283359+0000","last_clean":"2024-09-19T08:55:52.283359+0000","last_became_active":"2024-09-19T08:54:31.429951+0000","last_became_peered":"2024-09-19T08:54:31.429951+0000","last_unstale":"2024-09-19T08:55:52.283359+0000","last_undegraded":"2024-09-19T08:55:52.283359+0000","last_fullsized":"2024-09-19T08:55:52.283359+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:11.299729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.278219+0000","last_change":"2024-09-19T08:54:31.435854+0000","last_active":"2024-09-19T08:55:52.278219+0000","last_peered":"2024-09-19T08:55:52.278219+0000","last_clean":"2024-09-19T08:55:52.278219+0000","last_became_active":"2024-09-19T08:54:31.435522+0000","last_became_peered":"2024-09-19T08:54:31.435522+0000","last_unstale":"2024-09-19T08:55:52.278219+0000","last_undegraded":"2024-09-19T08:55:52.278219+0000","last_fullsized":"2024-09-19T08:55:52.278219+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:11.099750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.282506+0000","last_change":"2024-09-19T08:54:31.434574+0000","last_active":"2024-09-19T08:55:52.282506+0000","last_peered":"2024-09-19T08:55:52.282506+0000","last_clean":"2024-09-19T08:55:52.282506+0000","last_became_active":"2024-09-19T08:54:31.434268+0000","last_became_peered":"2024-09-19T08:54:31.434268+0000","last_unstale":"2024-09-19T08:55:52.282506+0000","last_undegraded":"2024-09-19T08:55:52.282506+0000","last_fullsized":"2024-09-19T08:55:52.282506+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:29.159417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.279084+0000","last_change":"2024-09-19T08:54:31.430446+0000","last_active":"2024-09-19T08:55:52.279084+0000","last_peered":"2024-09-19T08:55:52.279084+0000","last_clean":"2024-09-19T08:55:52.279084+0000","last_became_active":"2024-09-19T08:54:31.430048+0000","last_became_peered":"2024-09-19T08:54:31.430048+0000","last_unstale":"2024-09-19T08:55:52.279084+0000","last_undegraded":"2024-09-19T08:55:52.279084+0000","last_fullsized":"2024-09-19T08:55:52.279084+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:24.773947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.283319+0000","last_change":"2024-09-19T08:54:31.433144+0000","last_active":"2024-09-19T08:55:52.283319+0000","last_peered":"2024-09-19T08:55:52.283319+0000","last_clean":"2024-09-19T08:55:52.283319+0000","last_became_active":"2024-09-19T08:54:31.432590+0000","last_became_peered":"2024-09-19T08:54:31.432590+0000","last_unstale":"2024-09-19T08:55:52.283319+0000","last_undegraded":"2024-09-19T08:55:52.283319+0000","last_fullsized":"2024-09-19T08:55:52.283319+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:53.756846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.275955+0000","last_change":"2024-09-19T08:54:31.435712+0000","last_active":"2024-09-19T08:55:52.275955+0000","last_peered":"2024-09-19T08:55:52.275955+0000","last_clean":"2024-09-19T08:55:52.275955+0000","last_became_active":"2024-09-19T08:54:31.435301+0000","last_became_peered":"2024-09-19T08:54:31.435301+0000","last_unstale":"2024-09-19T08:55:52.275955+0000","last_undegraded":"2024-09-19T08:55:52.275955+0000","last_fullsized":"2024-09-19T08:55:52.275955+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:51.703709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.270429+0000","last_change":"2024-09-19T08:54:53.332853+0000","last_active":"2024-09-19T08:55:52.270429+0000","last_peered":"2024-09-19T08:55:52.270429+0000","last_clean":"2024-09-19T08:55:52.270429+0000","last_became_active":"2024-09-19T08:54:53.332460+0000","last_became_peered":"2024-09-19T08:54:53.332460+0000","last_unstale":"2024-09-19T08:55:52.270429+0000","last_undegraded":"2024-09-19T08:55:52.270429+0000","last_fullsized":"2024-09-19T08:55:52.270429+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:47:58.025876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277366+0000","last_change":"2024-09-19T08:54:31.425590+0000","last_active":"2024-09-19T08:55:52.277366+0000","last_peered":"2024-09-19T08:55:52.277366+0000","last_clean":"2024-09-19T08:55:52.277366+0000","last_became_active":"2024-09-19T08:54:31.425268+0000","last_became_peered":"2024-09-19T08:54:31.425268+0000","last_unstale":"2024-09-19T08:55:52.277366+0000","last_undegraded":"2024-09-19T08:55:52.277366+0000","last_fullsized":"2024-09-19T08:55:52.277366+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:09.404947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.283086+0000","last_change":"2024-09-19T08:54:31.428372+0000","last_active":"2024-09-19T08:55:52.283086+0000","last_peered":"2024-09-19T08:55:52.283086+0000","last_clean":"2024-09-19T08:55:52.283086+0000","last_became_active":"2024-09-19T08:54:31.428064+0000","last_became_peered":"2024-09-19T08:54:31.428064+0000","last_unstale":"2024-09-19T08:55:52.283086+0000","last_undegraded":"2024-09-19T08:55:52.283086+0000","last_fullsized":"2024-09-19T08:55:52.283086+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:40.444117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.271059+0000","last_change":"2024-09-19T08:54:31.424365+0000","last_active":"2024-09-19T08:55:52.271059+0000","last_peered":"2024-09-19T08:55:52.271059+0000","last_clean":"2024-09-19T08:55:52.271059+0000","last_became_active":"2024-09-19T08:54:31.424044+0000","last_became_peered":"2024-09-19T08:54:31.424044+0000","last_unstale":"2024-09-19T08:55:52.271059+0000","last_undegraded":"2024-09-19T08:55:52.271059+0000","last_fullsized":"2024-09-19T08:55:52.271059+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:16.435389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.278276+0000","last_change":"2024-09-19T08:54:31.437238+0000","last_active":"2024-09-19T08:55:52.278276+0000","last_peered":"2024-09-19T08:55:52.278276+0000","last_clean":"2024-09-19T08:55:52.278276+0000","last_became_active":"2024-09-19T08:54:31.436867+0000","last_became_peered":"2024-09-19T08:54:31.436867+0000","last_unstale":"2024-09-19T08:55:52.278276+0000","last_undegraded":"2024-09-19T08:55:52.278276+0000","last_fullsized":"2024-09-19T08:55:52.278276+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:59.839081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277741+0000","last_change":"2024-09-19T08:54:31.438654+0000","last_active":"2024-09-19T08:55:52.277741+0000","last_peered":"2024-09-19T08:55:52.277741+0000","last_clean":"2024-09-19T08:55:52.277741+0000","last_became_active":"2024-09-19T08:54:31.438342+0000","last_became_peered":"2024-09-19T08:54:31.438342+0000","last_unstale":"2024-09-19T08:55:52.277741+0000","last_undegraded":"2024-09-19T08:55:52.277741+0000","last_fullsized":"2024-09-19T08:55:52.277741+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:55.190605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.271267+0000","last_change":"2024-09-19T08:54:31.431100+0000","last_active":"2024-09-19T08:55:52.271267+0000","last_peered":"2024-09-19T08:55:52.271267+0000","last_clean":"2024-09-19T08:55:52.271267+0000","last_became_active":"2024-09-19T08:54:31.430749+0000","last_became_peered":"2024-09-19T08:54:31.430749+0000","last_unstale":"2024-09-19T08:55:52.271267+0000","last_undegraded":"2024-09-19T08:55:52.271267+0000","last_fullsized":"2024-09-19T08:55:52.271267+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:50.597610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.261809+0000","last_change":"2024-09-19T08:54:31.427454+0000","last_active":"2024-09-19T08:55:52.261809+0000","last_peered":"2024-09-19T08:55:52.261809+0000","last_clean":"2024-09-19T08:55:52.261809+0000","last_became_active":"2024-09-19T08:54:31.427098+0000","last_became_peered":"2024-09-19T08:54:31.427098+0000","last_unstale":"2024-09-19T08:55:52.261809+0000","last_undegraded":"2024-09-19T08:55:52.261809+0000","last_fullsized":"2024-09-19T08:55:52.261809+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:01.042626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.275970+0000","last_change":"2024-09-19T08:54:31.433887+0000","last_active":"2024-09-19T08:55:52.275970+0000","last_peered":"2024-09-19T08:55:52.275970+0000","last_clean":"2024-09-19T08:55:52.275970+0000","last_became_active":"2024-09-19T08:54:31.433528+0000","last_became_peered":"2024-09-19T08:54:31.433528+0000","last_unstale":"2024-09-19T08:55:52.275970+0000","last_undegraded":"2024-09-19T08:55:52.275970+0000","last_fullsized":"2024-09-19T08:55:52.275970+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:37.291226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.266435+0000","last_change":"2024-09-19T08:54:31.436976+0000","last_active":"2024-09-19T08:55:52.266435+0000","last_peered":"2024-09-19T08:55:52.266435+0000","last_clean":"2024-09-19T08:55:52.266435+0000","last_became_active":"2024-09-19T08:54:31.436646+0000","last_became_peered":"2024-09-19T08:54:31.436646+0000","last_unstale":"2024-09-19T08:55:52.266435+0000","last_undegraded":"2024-09-19T08:55:52.266435+0000","last_fullsized":"2024-09-19T08:55:52.266435+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:19.755556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.278449+0000","last_change":"2024-09-19T08:54:31.438922+0000","last_active":"2024-09-19T08:55:52.278449+0000","last_peered":"2024-09-19T08:55:52.278449+0000","last_clean":"2024-09-19T08:55:52.278449+0000","last_became_active":"2024-09-19T08:54:31.438593+0000","last_became_peered":"2024-09-19T08:54:31.438593+0000","last_unstale":"2024-09-19T08:55:52.278449+0000","last_undegraded":"2024-09-19T08:55:52.278449+0000","last_fullsized":"2024-09-19T08:55:52.278449+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:07.347900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.262522+0000","last_change":"2024-09-19T08:54:31.431659+0000","last_active":"2024-09-19T08:55:52.262522+0000","last_peered":"2024-09-19T08:55:52.262522+0000","last_clean":"2024-09-19T08:55:52.262522+0000","last_became_active":"2024-09-19T08:54:31.431359+0000","last_became_peered":"2024-09-19T08:54:31.431359+0000","last_unstale":"2024-09-19T08:55:52.262522+0000","last_undegraded":"2024-09-19T08:55:52.262522+0000","last_fullsized":"2024-09-19T08:55:52.262522+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:02.421286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.278570+0000","last_change":"2024-09-19T08:54:31.432185+0000","last_active":"2024-09-19T08:55:52.278570+0000","last_peered":"2024-09-19T08:55:52.278570+0000","last_clean":"2024-09-19T08:55:52.278570+0000","last_became_active":"2024-09-19T08:54:31.431418+0000","last_became_peered":"2024-09-19T08:54:31.431418+0000","last_unstale":"2024-09-19T08:55:52.278570+0000","last_undegraded":"2024-09-19T08:55:52.278570+0000","last_fullsized":"2024-09-19T08:55:52.278570+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:45.347487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.256343+0000","last_change":"2024-09-19T08:54:31.433742+0000","last_active":"2024-09-19T08:55:52.256343+0000","last_peered":"2024-09-19T08:55:52.256343+0000","last_clean":"2024-09-19T08:55:52.256343+0000","last_became_active":"2024-09-19T08:54:31.433455+0000","last_became_peered":"2024-09-19T08:54:31.433455+0000","last_unstale":"2024-09-19T08:55:52.256343+0000","last_undegraded":"2024-09-19T08:55:52.256343+0000","last_fullsized":"2024-09-19T08:55:52.256343+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:38.803705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.271146+0000","last_change":"2024-09-19T08:54:31.432954+0000","last_active":"2024-09-19T08:55:52.271146+0000","last_peered":"2024-09-19T08:55:52.271146+0000","last_clean":"2024-09-19T08:55:52.271146+0000","last_became_active":"2024-09-19T08:54:31.432574+0000","last_became_peered":"2024-09-19T08:54:31.432574+0000","last_unstale":"2024-09-19T08:55:52.271146+0000","last_undegraded":"2024-09-19T08:55:52.271146+0000","last_fullsized":"2024-09-19T08:55:52.271146+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:30.457191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.274173+0000","last_change":"2024-09-19T08:54:31.435544+0000","last_active":"2024-09-19T08:55:52.274173+0000","last_peered":"2024-09-19T08:55:52.274173+0000","last_clean":"2024-09-19T08:55:52.274173+0000","last_became_active":"2024-09-19T08:54:31.435195+0000","last_became_peered":"2024-09-19T08:54:31.435195+0000","last_unstale":"2024-09-19T08:55:52.274173+0000","last_undegraded":"2024-09-19T08:55:52.274173+0000","last_fullsized":"2024-09-19T08:55:52.274173+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:54.240654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.266764+0000","last_change":"2024-09-19T08:54:31.428403+0000","last_active":"2024-09-19T08:55:52.266764+0000","last_peered":"2024-09-19T08:55:52.266764+0000","last_clean":"2024-09-19T08:55:52.266764+0000","last_became_active":"2024-09-19T08:54:31.428110+0000","last_became_peered":"2024-09-19T08:54:31.428110+0000","last_unstale":"2024-09-19T08:55:52.266764+0000","last_undegraded":"2024-09-19T08:55:52.266764+0000","last_fullsized":"2024-09-19T08:55:52.266764+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:05.593073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.269495+0000","last_change":"2024-09-19T08:54:31.427291+0000","last_active":"2024-09-19T08:55:52.269495+0000","last_peered":"2024-09-19T08:55:52.269495+0000","last_clean":"2024-09-19T08:55:52.269495+0000","last_became_active":"2024-09-19T08:54:31.427011+0000","last_became_peered":"2024-09-19T08:54:31.427011+0000","last_unstale":"2024-09-19T08:55:52.269495+0000","last_undegraded":"2024-09-19T08:55:52.269495+0000","last_fullsized":"2024-09-19T08:55:52.269495+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:54.338526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.254032+0000","last_change":"2024-09-19T08:54:31.429309+0000","last_active":"2024-09-19T08:55:52.254032+0000","last_peered":"2024-09-19T08:55:52.254032+0000","last_clean":"2024-09-19T08:55:52.254032+0000","last_became_active":"2024-09-19T08:54:31.428381+0000","last_became_peered":"2024-09-19T08:54:31.428381+0000","last_unstale":"2024-09-19T08:55:52.254032+0000","last_undegraded":"2024-09-19T08:55:52.254032+0000","last_fullsized":"2024-09-19T08:55:52.254032+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:22:33.920114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.273963+0000","last_change":"2024-09-19T08:54:53.336591+0000","last_active":"2024-09-19T08:55:52.273963+0000","last_peered":"2024-09-19T08:55:52.273963+0000","last_clean":"2024-09-19T08:55:52.273963+0000","last_became_active":"2024-09-19T08:54:53.336222+0000","last_became_peered":"2024-09-19T08:54:53.336222+0000","last_unstale":"2024-09-19T08:55:52.273963+0000","last_undegraded":"2024-09-19T08:55:52.273963+0000","last_fullsized":"2024-09-19T08:55:52.273963+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:59.019419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277017+0000","last_change":"2024-09-19T08:54:53.335149+0000","last_active":"2024-09-19T08:55:52.277017+0000","last_peered":"2024-09-19T08:55:52.277017+0000","last_clean":"2024-09-19T08:55:52.277017+0000","last_became_active":"2024-09-19T08:54:53.334766+0000","last_became_peered":"2024-09-19T08:54:53.334766+0000","last_unstale":"2024-09-19T08:55:52.277017+0000","last_undegraded":"2024-09-19T08:55:52.277017+0000","last_fullsized":"2024-09-19T08:55:52.277017+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:36.469044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277210+0000","last_change":"2024-09-19T08:54:31.427608+0000","last_active":"2024-09-19T08:55:52.277210+0000","last_peered":"2024-09-19T08:55:52.277210+0000","last_clean":"2024-09-19T08:55:52.277210+0000","last_became_active":"2024-09-19T08:54:31.427294+0000","last_became_peered":"2024-09-19T08:54:31.427294+0000","last_unstale":"2024-09-19T08:55:52.277210+0000","last_undegraded":"2024-09-19T08:55:52.277210+0000","last_fullsized":"2024-09-19T08:55:52.277210+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:41.356609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331158+0000","last_change":"2024-09-19T08:54:29.416204+0000","last_active":"2024-09-19T08:54:53.331158+0000","last_peered":"2024-09-19T08:54:53.331158+0000","last_clean":"2024-09-19T08:54:53.331158+0000","last_became_active":"2024-09-19T08:54:29.415872+0000","last_became_peered":"2024-09-19T08:54:29.415872+0000","last_unstale":"2024-09-19T08:54:53.331158+0000","last_undegraded":"2024-09-19T08:54:53.331158+0000","last_fullsized":"2024-09-19T08:54:53.331158+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:13.844147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.283160+0000","last_change":"2024-09-19T08:54:31.432137+0000","last_active":"2024-09-19T08:55:52.283160+0000","last_peered":"2024-09-19T08:55:52.283160+0000","last_clean":"2024-09-19T08:55:52.283160+0000","last_became_active":"2024-09-19T08:54:31.431761+0000","last_became_peered":"2024-09-19T08:54:31.431761+0000","last_unstale":"2024-09-19T08:55:52.283160+0000","last_undegraded":"2024-09-19T08:55:52.283160+0000","last_fullsized":"2024-09-19T08:55:52.283160+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:05.008431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327676+0000","last_change":"2024-09-19T08:54:29.413221+0000","last_active":"2024-09-19T08:54:53.327676+0000","last_peered":"2024-09-19T08:54:53.327676+0000","last_clean":"2024-09-19T08:54:53.327676+0000","last_became_active":"2024-09-19T08:54:29.412829+0000","last_became_peered":"2024-09-19T08:54:29.412829+0000","last_unstale":"2024-09-19T08:54:53.327676+0000","last_undegraded":"2024-09-19T08:54:53.327676+0000","last_fullsized":"2024-09-19T08:54:53.327676+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:07.224136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.326805+0000","last_change":"2024-09-19T08:54:29.410221+0000","last_active":"2024-09-19T08:54:53.326805+0000","last_peered":"2024-09-19T08:54:53.326805+0000","last_clean":"2024-09-19T08:54:53.326805+0000","last_became_active":"2024-09-19T08:54:29.409951+0000","last_became_peered":"2024-09-19T08:54:29.409951+0000","last_unstale":"2024-09-19T08:54:53.326805+0000","last_undegraded":"2024-09-19T08:54:53.326805+0000","last_fullsized":"2024-09-19T08:54:53.326805+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:58.350932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.259466+0000","last_change":"2024-09-19T08:54:31.429979+0000","last_active":"2024-09-19T08:55:52.259466+0000","last_peered":"2024-09-19T08:55:52.259466+0000","last_clean":"2024-09-19T08:55:52.259466+0000","last_became_active":"2024-09-19T08:54:31.429661+0000","last_became_peered":"2024-09-19T08:54:31.429661+0000","last_unstale":"2024-09-19T08:55:52.259466+0000","last_undegraded":"2024-09-19T08:55:52.259466+0000","last_fullsized":"2024-09-19T08:55:52.259466+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:27:40.603490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331299+0000","last_change":"2024-09-19T08:54:29.415769+0000","last_active":"2024-09-19T08:54:53.331299+0000","last_peered":"2024-09-19T08:54:53.331299+0000","last_clean":"2024-09-19T08:54:53.331299+0000","last_became_active":"2024-09-19T08:54:29.415245+0000","last_became_peered":"2024-09-19T08:54:29.415245+0000","last_unstale":"2024-09-19T08:54:53.331299+0000","last_undegraded":"2024-09-19T08:54:53.331299+0000","last_fullsized":"2024-09-19T08:54:53.331299+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:15.487945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.270548+0000","last_change":"2024-09-19T08:54:31.427126+0000","last_active":"2024-09-19T08:55:52.270548+0000","last_peered":"2024-09-19T08:55:52.270548+0000","last_clean":"2024-09-19T08:55:52.270548+0000","last_became_active":"2024-09-19T08:54:31.426816+0000","last_became_peered":"2024-09-19T08:54:31.426816+0000","last_unstale":"2024-09-19T08:55:52.270548+0000","last_undegraded":"2024-09-19T08:55:52.270548+0000","last_fullsized":"2024-09-19T08:55:52.270548+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:38.039428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327848+0000","last_change":"2024-09-19T08:54:29.411354+0000","last_active":"2024-09-19T08:54:53.327848+0000","last_peered":"2024-09-19T08:54:53.327848+0000","last_clean":"2024-09-19T08:54:53.327848+0000","last_became_active":"2024-09-19T08:54:29.410990+0000","last_became_peered":"2024-09-19T08:54:29.410990+0000","last_unstale":"2024-09-19T08:54:53.327848+0000","last_undegraded":"2024-09-19T08:54:53.327848+0000","last_fullsized":"2024-09-19T08:54:53.327848+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:29.338169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277112+0000","last_change":"2024-09-19T08:54:31.426243+0000","last_active":"2024-09-19T08:55:52.277112+0000","last_peered":"2024-09-19T08:55:52.277112+0000","last_clean":"2024-09-19T08:55:52.277112+0000","last_became_active":"2024-09-19T08:54:31.425895+0000","last_became_peered":"2024-09-19T08:54:31.425895+0000","last_unstale":"2024-09-19T08:55:52.277112+0000","last_undegraded":"2024-09-19T08:55:52.277112+0000","last_fullsized":"2024-09-19T08:55:52.277112+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:13.562780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331102+0000","last_change":"2024-09-19T08:54:29.416646+0000","last_active":"2024-09-19T08:54:53.331102+0000","last_peered":"2024-09-19T08:54:53.331102+0000","last_clean":"2024-09-19T08:54:53.331102+0000","last_became_active":"2024-09-19T08:54:29.416260+0000","last_became_peered":"2024-09-19T08:54:29.416260+0000","last_unstale":"2024-09-19T08:54:53.331102+0000","last_undegraded":"2024-09-19T08:54:53.331102+0000","last_fullsized":"2024-09-19T08:54:53.331102+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:42:17.467035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.276583+0000","last_change":"2024-09-19T08:54:31.435538+0000","last_active":"2024-09-19T08:55:52.276583+0000","last_peered":"2024-09-19T08:55:52.276583+0000","last_clean":"2024-09-19T08:55:52.276583+0000","last_became_active":"2024-09-19T08:54:31.435185+0000","last_became_peered":"2024-09-19T08:54:31.435185+0000","last_unstale":"2024-09-19T08:55:52.276583+0000","last_undegraded":"2024-09-19T08:55:52.276583+0000","last_fullsized":"2024-09-19T08:55:52.276583+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:06.940123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.332501+0000","last_change":"2024-09-19T08:54:29.675914+0000","last_active":"2024-09-19T08:54:53.332501+0000","last_peered":"2024-09-19T08:54:53.332501+0000","last_clean":"2024-09-19T08:54:53.332501+0000","last_became_active":"2024-09-19T08:54:29.675482+0000","last_became_peered":"2024-09-19T08:54:29.675482+0000","last_unstale":"2024-09-19T08:54:53.332501+0000","last_undegraded":"2024-09-19T08:54:53.332501+0000","last_fullsized":"2024-09-19T08:54:53.332501+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:58.893008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.273901+0000","last_change":"2024-09-19T08:54:31.432628+0000","last_active":"2024-09-19T08:55:52.273901+0000","last_peered":"2024-09-19T08:55:52.273901+0000","last_clean":"2024-09-19T08:55:52.273901+0000","last_became_active":"2024-09-19T08:54:31.430640+0000","last_became_peered":"2024-09-19T08:54:31.430640+0000","last_unstale":"2024-09-19T08:55:52.273901+0000","last_undegraded":"2024-09-19T08:55:52.273901+0000","last_fullsized":"2024-09-19T08:55:52.273901+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:07.793089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'31","reported_seq":260,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:56:16.651077+0000","last_change":"2024-09-19T08:54:29.414619+0000","last_active":"2024-09-19T08:56:16.651077+0000","last_peered":"2024-09-19T08:56:16.651077+0000","last_clean":"2024-09-19T08:56:16.651077+0000","last_became_active":"2024-09-19T08:54:29.414295+0000","last_became_peered":"2024-09-19T08:54:29.414295+0000","last_unstale":"2024-09-19T08:56:16.651077+0000","last_undegraded":"2024-09-19T08:56:16.651077+0000","last_fullsized":"2024-09-19T08:56:16.651077+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:23.782684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67129,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":207,"num_read_kb":169,"num_write":31,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.276986+0000","last_change":"2024-09-19T08:54:31.425432+0000","last_active":"2024-09-19T08:55:52.276986+0000","last_peered":"2024-09-19T08:55:52.276986+0000","last_clean":"2024-09-19T08:55:52.276986+0000","last_became_active":"2024-09-19T08:54:31.425086+0000","last_became_peered":"2024-09-19T08:54:31.425086+0000","last_unstale":"2024-09-19T08:55:52.276986+0000","last_undegraded":"2024-09-19T08:55:52.276986+0000","last_fullsized":"2024-09-19T08:55:52.276986+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:56.572339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330371+0000","last_change":"2024-09-19T08:54:29.415055+0000","last_active":"2024-09-19T08:54:53.330371+0000","last_peered":"2024-09-19T08:54:53.330371+0000","last_clean":"2024-09-19T08:54:53.330371+0000","last_became_active":"2024-09-19T08:54:29.414573+0000","last_became_peered":"2024-09-19T08:54:29.414573+0000","last_unstale":"2024-09-19T08:54:53.330371+0000","last_undegraded":"2024-09-19T08:54:53.330371+0000","last_fullsized":"2024-09-19T08:54:53.330371+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:13.013714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.260081+0000","last_change":"2024-09-19T08:54:31.436905+0000","last_active":"2024-09-19T08:55:52.260081+0000","last_peered":"2024-09-19T08:55:52.260081+0000","last_clean":"2024-09-19T08:55:52.260081+0000","last_became_active":"2024-09-19T08:54:31.436571+0000","last_became_peered":"2024-09-19T08:54:31.436571+0000","last_unstale":"2024-09-19T08:55:52.260081+0000","last_undegraded":"2024-09-19T08:55:52.260081+0000","last_fullsized":"2024-09-19T08:55:52.260081+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:55.294255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330834+0000","last_change":"2024-09-19T08:54:29.417958+0000","last_active":"2024-09-19T08:54:53.330834+0000","last_peered":"2024-09-19T08:54:53.330834+0000","last_clean":"2024-09-19T08:54:53.330834+0000","last_became_active":"2024-09-19T08:54:29.417570+0000","last_became_peered":"2024-09-19T08:54:29.417570+0000","last_unstale":"2024-09-19T08:54:53.330834+0000","last_undegraded":"2024-09-19T08:54:53.330834+0000","last_fullsized":"2024-09-19T08:54:53.330834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:25.557217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.279834+0000","last_change":"2024-09-19T08:54:31.433019+0000","last_active":"2024-09-19T08:55:52.279834+0000","last_peered":"2024-09-19T08:55:52.279834+0000","last_clean":"2024-09-19T08:55:52.279834+0000","last_became_active":"2024-09-19T08:54:31.431265+0000","last_became_peered":"2024-09-19T08:54:31.431265+0000","last_unstale":"2024-09-19T08:55:52.279834+0000","last_undegraded":"2024-09-19T08:55:52.279834+0000","last_fullsized":"2024-09-19T08:55:52.279834+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:36.481863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.979100+0000","last_change":"2024-09-19T08:54:29.414236+0000","last_active":"2024-09-19T08:54:53.979100+0000","last_peered":"2024-09-19T08:54:53.979100+0000","last_clean":"2024-09-19T08:54:53.979100+0000","last_became_active":"2024-09-19T08:54:29.413878+0000","last_became_peered":"2024-09-19T08:54:29.413878+0000","last_unstale":"2024-09-19T08:54:53.979100+0000","last_undegraded":"2024-09-19T08:54:53.979100+0000","last_fullsized":"2024-09-19T08:54:53.979100+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:11.222362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.279321+0000","last_change":"2024-09-19T08:54:31.439512+0000","last_active":"2024-09-19T08:55:52.279321+0000","last_peered":"2024-09-19T08:55:52.279321+0000","last_clean":"2024-09-19T08:55:52.279321+0000","last_became_active":"2024-09-19T08:54:31.438767+0000","last_became_peered":"2024-09-19T08:54:31.438767+0000","last_unstale":"2024-09-19T08:55:52.279321+0000","last_undegraded":"2024-09-19T08:55:52.279321+0000","last_fullsized":"2024-09-19T08:55:52.279321+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:31.784577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330687+0000","last_change":"2024-09-19T08:54:29.675768+0000","last_active":"2024-09-19T08:54:53.330687+0000","last_peered":"2024-09-19T08:54:53.330687+0000","last_clean":"2024-09-19T08:54:53.330687+0000","last_became_active":"2024-09-19T08:54:29.675376+0000","last_became_peered":"2024-09-19T08:54:29.675376+0000","last_unstale":"2024-09-19T08:54:53.330687+0000","last_undegraded":"2024-09-19T08:54:53.330687+0000","last_fullsized":"2024-09-19T08:54:53.330687+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:10.281126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.282865+0000","last_change":"2024-09-19T08:54:31.435904+0000","last_active":"2024-09-19T08:55:52.282865+0000","last_peered":"2024-09-19T08:55:52.282865+0000","last_clean":"2024-09-19T08:55:52.282865+0000","last_became_active":"2024-09-19T08:54:31.435396+0000","last_became_peered":"2024-09-19T08:54:31.435396+0000","last_unstale":"2024-09-19T08:55:52.282865+0000","last_undegraded":"2024-09-19T08:55:52.282865+0000","last_fullsized":"2024-09-19T08:55:52.282865+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:41.567463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331746+0000","last_change":"2024-09-19T08:54:29.410221+0000","last_active":"2024-09-19T08:54:53.331746+0000","last_peered":"2024-09-19T08:54:53.331746+0000","last_clean":"2024-09-19T08:54:53.331746+0000","last_became_active":"2024-09-19T08:54:29.409856+0000","last_became_peered":"2024-09-19T08:54:29.409856+0000","last_unstale":"2024-09-19T08:54:53.331746+0000","last_undegraded":"2024-09-19T08:54:53.331746+0000","last_fullsized":"2024-09-19T08:54:53.331746+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:46.095816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.270387+0000","last_change":"2024-09-19T08:54:31.437854+0000","last_active":"2024-09-19T08:55:52.270387+0000","last_peered":"2024-09-19T08:55:52.270387+0000","last_clean":"2024-09-19T08:55:52.270387+0000","last_became_active":"2024-09-19T08:54:31.437491+0000","last_became_peered":"2024-09-19T08:54:31.437491+0000","last_unstale":"2024-09-19T08:55:52.270387+0000","last_undegraded":"2024-09-19T08:55:52.270387+0000","last_fullsized":"2024-09-19T08:55:52.270387+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:22.532429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.983440+0000","last_change":"2024-09-19T08:54:53.983440+0000","last_active":"2024-09-19T08:54:53.983440+0000","last_peered":"2024-09-19T08:54:53.983440+0000","last_clean":"2024-09-19T08:54:53.983440+0000","last_became_active":"2024-09-19T08:54:53.980971+0000","last_became_peered":"2024-09-19T08:54:53.980971+0000","last_unstale":"2024-09-19T08:54:53.983440+0000","last_undegraded":"2024-09-19T08:54:53.983440+0000","last_fullsized":"2024-09-19T08:54:53.983440+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:33.070904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.278128+0000","last_change":"2024-09-19T08:54:31.429376+0000","last_active":"2024-09-19T08:55:52.278128+0000","last_peered":"2024-09-19T08:55:52.278128+0000","last_clean":"2024-09-19T08:55:52.278128+0000","last_became_active":"2024-09-19T08:54:31.429006+0000","last_became_peered":"2024-09-19T08:54:31.429006+0000","last_unstale":"2024-09-19T08:55:52.278128+0000","last_undegraded":"2024-09-19T08:55:52.278128+0000","last_fullsized":"2024-09-19T08:55:52.278128+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:26.399838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.332608+0000","last_change":"2024-09-19T08:54:29.414307+0000","last_active":"2024-09-19T08:54:53.332608+0000","last_peered":"2024-09-19T08:54:53.332608+0000","last_clean":"2024-09-19T08:54:53.332608+0000","last_became_active":"2024-09-19T08:54:29.413823+0000","last_became_peered":"2024-09-19T08:54:29.413823+0000","last_unstale":"2024-09-19T08:54:53.332608+0000","last_undegraded":"2024-09-19T08:54:53.332608+0000","last_fullsized":"2024-09-19T08:54:53.332608+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:25.484645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.279004+0000","last_change":"2024-09-19T08:54:31.437789+0000","last_active":"2024-09-19T08:55:52.279004+0000","last_peered":"2024-09-19T08:55:52.279004+0000","last_clean":"2024-09-19T08:55:52.279004+0000","last_became_active":"2024-09-19T08:54:31.435488+0000","last_became_peered":"2024-09-19T08:54:31.435488+0000","last_unstale":"2024-09-19T08:55:52.279004+0000","last_undegraded":"2024-09-19T08:55:52.279004+0000","last_fullsized":"2024-09-19T08:55:52.279004+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:19.332440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.333662+0000","last_change":"2024-09-19T08:54:53.333120+0000","last_active":"2024-09-19T08:54:53.333662+0000","last_peered":"2024-09-19T08:54:53.333662+0000","last_clean":"2024-09-19T08:54:53.333662+0000","last_became_active":"2024-09-19T08:54:53.332711+0000","last_became_peered":"2024-09-19T08:54:53.332711+0000","last_unstale":"2024-09-19T08:54:53.333662+0000","last_undegraded":"2024-09-19T08:54:53.333662+0000","last_fullsized":"2024-09-19T08:54:53.333662+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:18.359002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.279878+0000","last_change":"2024-09-19T08:54:31.434564+0000","last_active":"2024-09-19T08:55:52.279878+0000","last_peered":"2024-09-19T08:55:52.279878+0000","last_clean":"2024-09-19T08:55:52.279878+0000","last_became_active":"2024-09-19T08:54:31.434231+0000","last_became_peered":"2024-09-19T08:54:31.434231+0000","last_unstale":"2024-09-19T08:55:52.279878+0000","last_undegraded":"2024-09-19T08:55:52.279878+0000","last_fullsized":"2024-09-19T08:55:52.279878+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:31.316400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":335,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331130+0000","last_change":"2024-09-19T08:53:21.357560+0000","last_active":"2024-09-19T08:54:53.331130+0000","last_peered":"2024-09-19T08:54:53.331130+0000","last_clean":"2024-09-19T08:54:53.331130+0000","last_became_active":"2024-09-19T08:53:21.357122+0000","last_became_peered":"2024-09-19T08:53:21.357122+0000","last_unstale":"2024-09-19T08:54:53.331130+0000","last_undegraded":"2024-09-19T08:54:53.331130+0000","last_fullsized":"2024-09-19T08:54:53.331130+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:05.231370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:05.231370+0000","last_clean_scrub_stamp":"2024-09-19T08:50:05.231370+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:47.867682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.979104+0000","last_change":"2024-09-19T08:54:29.412240+0000","last_active":"2024-09-19T08:54:53.979104+0000","last_peered":"2024-09-19T08:54:53.979104+0000","last_clean":"2024-09-19T08:54:53.979104+0000","last_became_active":"2024-09-19T08:54:29.411908+0000","last_became_peered":"2024-09-19T08:54:29.411908+0000","last_unstale":"2024-09-19T08:54:53.979104+0000","last_undegraded":"2024-09-19T08:54:53.979104+0000","last_fullsized":"2024-09-19T08:54:53.979104+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:37.189373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277537+0000","last_change":"2024-09-19T08:54:31.432956+0000","last_active":"2024-09-19T08:55:52.277537+0000","last_peered":"2024-09-19T08:55:52.277537+0000","last_clean":"2024-09-19T08:55:52.277537+0000","last_became_active":"2024-09-19T08:54:31.432639+0000","last_became_peered":"2024-09-19T08:54:31.432639+0000","last_unstale":"2024-09-19T08:55:52.277537+0000","last_undegraded":"2024-09-19T08:55:52.277537+0000","last_fullsized":"2024-09-19T08:55:52.277537+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:58.302624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331178+0000","last_change":"2024-09-19T08:54:29.414214+0000","last_active":"2024-09-19T08:54:53.331178+0000","last_peered":"2024-09-19T08:54:53.331178+0000","last_clean":"2024-09-19T08:54:53.331178+0000","last_became_active":"2024-09-19T08:54:29.413853+0000","last_became_peered":"2024-09-19T08:54:29.413853+0000","last_unstale":"2024-09-19T08:54:53.331178+0000","last_undegraded":"2024-09-19T08:54:53.331178+0000","last_fullsized":"2024-09-19T08:54:53.331178+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:28:29.119856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.266896+0000","last_change":"2024-09-19T08:54:31.424643+0000","last_active":"2024-09-19T08:55:52.266896+0000","last_peered":"2024-09-19T08:55:52.266896+0000","last_clean":"2024-09-19T08:55:52.266896+0000","last_became_active":"2024-09-19T08:54:31.424363+0000","last_became_peered":"2024-09-19T08:54:31.424363+0000","last_unstale":"2024-09-19T08:55:52.266896+0000","last_undegraded":"2024-09-19T08:55:52.266896+0000","last_fullsized":"2024-09-19T08:55:52.266896+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:37.529952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.326916+0000","last_change":"2024-09-19T08:54:29.675742+0000","last_active":"2024-09-19T08:54:53.326916+0000","last_peered":"2024-09-19T08:54:53.326916+0000","last_clean":"2024-09-19T08:54:53.326916+0000","last_became_active":"2024-09-19T08:54:29.675347+0000","last_became_peered":"2024-09-19T08:54:29.675347+0000","last_unstale":"2024-09-19T08:54:53.326916+0000","last_undegraded":"2024-09-19T08:54:53.326916+0000","last_fullsized":"2024-09-19T08:54:53.326916+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:00.925390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.283427+0000","last_change":"2024-09-19T08:54:31.433887+0000","last_active":"2024-09-19T08:55:52.283427+0000","last_peered":"2024-09-19T08:55:52.283427+0000","last_clean":"2024-09-19T08:55:52.283427+0000","last_became_active":"2024-09-19T08:54:31.433331+0000","last_became_peered":"2024-09-19T08:54:31.433331+0000","last_unstale":"2024-09-19T08:55:52.283427+0000","last_undegraded":"2024-09-19T08:55:52.283427+0000","last_fullsized":"2024-09-19T08:55:52.283427+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:49.875061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331491+0000","last_change":"2024-09-19T08:54:29.417410+0000","last_active":"2024-09-19T08:54:53.331491+0000","last_peered":"2024-09-19T08:54:53.331491+0000","last_clean":"2024-09-19T08:54:53.331491+0000","last_became_active":"2024-09-19T08:54:29.417018+0000","last_became_peered":"2024-09-19T08:54:29.417018+0000","last_unstale":"2024-09-19T08:54:53.331491+0000","last_undegraded":"2024-09-19T08:54:53.331491+0000","last_fullsized":"2024-09-19T08:54:53.331491+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:53.669027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.280825+0000","last_change":"2024-09-19T08:54:31.431313+0000","last_active":"2024-09-19T08:55:52.280825+0000","last_peered":"2024-09-19T08:55:52.280825+0000","last_clean":"2024-09-19T08:55:52.280825+0000","last_became_active":"2024-09-19T08:54:31.429427+0000","last_became_peered":"2024-09-19T08:54:31.429427+0000","last_unstale":"2024-09-19T08:55:52.280825+0000","last_undegraded":"2024-09-19T08:55:52.280825+0000","last_fullsized":"2024-09-19T08:55:52.280825+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:55.106769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330517+0000","last_change":"2024-09-19T08:54:29.675722+0000","last_active":"2024-09-19T08:54:53.330517+0000","last_peered":"2024-09-19T08:54:53.330517+0000","last_clean":"2024-09-19T08:54:53.330517+0000","last_became_active":"2024-09-19T08:54:29.675397+0000","last_became_peered":"2024-09-19T08:54:29.675397+0000","last_unstale":"2024-09-19T08:54:53.330517+0000","last_undegraded":"2024-09-19T08:54:53.330517+0000","last_fullsized":"2024-09-19T08:54:53.330517+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:49.574947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.283206+0000","last_change":"2024-09-19T08:54:31.431106+0000","last_active":"2024-09-19T08:55:52.283206+0000","last_peered":"2024-09-19T08:55:52.283206+0000","last_clean":"2024-09-19T08:55:52.283206+0000","last_became_active":"2024-09-19T08:54:31.430745+0000","last_became_peered":"2024-09-19T08:54:31.430745+0000","last_unstale":"2024-09-19T08:55:52.283206+0000","last_undegraded":"2024-09-19T08:55:52.283206+0000","last_fullsized":"2024-09-19T08:55:52.283206+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:22.714106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331431+0000","last_change":"2024-09-19T08:54:29.675985+0000","last_active":"2024-09-19T08:54:53.331431+0000","last_peered":"2024-09-19T08:54:53.331431+0000","last_clean":"2024-09-19T08:54:53.331431+0000","last_became_active":"2024-09-19T08:54:29.675374+0000","last_became_peered":"2024-09-19T08:54:29.675374+0000","last_unstale":"2024-09-19T08:54:53.331431+0000","last_undegraded":"2024-09-19T08:54:53.331431+0000","last_fullsized":"2024-09-19T08:54:53.331431+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:06.664621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.260250+0000","last_change":"2024-09-19T08:54:31.423493+0000","last_active":"2024-09-19T08:55:52.260250+0000","last_peered":"2024-09-19T08:55:52.260250+0000","last_clean":"2024-09-19T08:55:52.260250+0000","last_became_active":"2024-09-19T08:54:31.422651+0000","last_became_peered":"2024-09-19T08:54:31.422651+0000","last_unstale":"2024-09-19T08:55:52.260250+0000","last_undegraded":"2024-09-19T08:55:52.260250+0000","last_fullsized":"2024-09-19T08:55:52.260250+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:51.863965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'11","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.443763+0000","last_change":"2024-09-19T08:54:29.408571+0000","last_active":"2024-09-19T08:55:52.443763+0000","last_peered":"2024-09-19T08:55:52.443763+0000","last_clean":"2024-09-19T08:55:52.443763+0000","last_became_active":"2024-09-19T08:54:29.408142+0000","last_became_peered":"2024-09-19T08:54:29.408142+0000","last_unstale":"2024-09-19T08:55:52.443763+0000","last_undegraded":"2024-09-19T08:55:52.443763+0000","last_fullsized":"2024-09-19T08:55:52.443763+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:34.578230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.262764+0000","last_change":"2024-09-19T08:54:31.435333+0000","last_active":"2024-09-19T08:55:52.262764+0000","last_peered":"2024-09-19T08:55:52.262764+0000","last_clean":"2024-09-19T08:55:52.262764+0000","last_became_active":"2024-09-19T08:54:31.435041+0000","last_became_peered":"2024-09-19T08:54:31.435041+0000","last_unstale":"2024-09-19T08:55:52.262764+0000","last_undegraded":"2024-09-19T08:55:52.262764+0000","last_fullsized":"2024-09-19T08:55:52.262764+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:40.972638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.979153+0000","last_change":"2024-09-19T08:54:29.554303+0000","last_active":"2024-09-19T08:54:53.979153+0000","last_peered":"2024-09-19T08:54:53.979153+0000","last_clean":"2024-09-19T08:54:53.979153+0000","last_became_active":"2024-09-19T08:54:29.553919+0000","last_became_peered":"2024-09-19T08:54:29.553919+0000","last_unstale":"2024-09-19T08:54:53.979153+0000","last_undegraded":"2024-09-19T08:54:53.979153+0000","last_fullsized":"2024-09-19T08:54:53.979153+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:25.103926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.279407+0000","last_change":"2024-09-19T08:54:53.333280+0000","last_active":"2024-09-19T08:55:52.279407+0000","last_peered":"2024-09-19T08:55:52.279407+0000","last_clean":"2024-09-19T08:55:52.279407+0000","last_became_active":"2024-09-19T08:54:53.332881+0000","last_became_peered":"2024-09-19T08:54:53.332881+0000","last_unstale":"2024-09-19T08:55:52.279407+0000","last_undegraded":"2024-09-19T08:55:52.279407+0000","last_fullsized":"2024-09-19T08:55:52.279407+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:55.880616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329946+0000","last_change":"2024-09-19T08:54:29.675665+0000","last_active":"2024-09-19T08:54:53.329946+0000","last_peered":"2024-09-19T08:54:53.329946+0000","last_clean":"2024-09-19T08:54:53.329946+0000","last_became_active":"2024-09-19T08:54:29.675367+0000","last_became_peered":"2024-09-19T08:54:29.675367+0000","last_unstale":"2024-09-19T08:54:53.329946+0000","last_undegraded":"2024-09-19T08:54:53.329946+0000","last_fullsized":"2024-09-19T08:54:53.329946+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:35.473243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.237269+0000","last_change":"2024-09-19T08:54:31.430837+0000","last_active":"2024-09-19T08:55:52.237269+0000","last_peered":"2024-09-19T08:55:52.237269+0000","last_clean":"2024-09-19T08:55:52.237269+0000","last_became_active":"2024-09-19T08:54:31.430465+0000","last_became_peered":"2024-09-19T08:54:31.430465+0000","last_unstale":"2024-09-19T08:55:52.237269+0000","last_undegraded":"2024-09-19T08:55:52.237269+0000","last_fullsized":"2024-09-19T08:55:52.237269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:50.524730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329067+0000","last_change":"2024-09-19T08:54:29.413803+0000","last_active":"2024-09-19T08:54:53.329067+0000","last_peered":"2024-09-19T08:54:53.329067+0000","last_clean":"2024-09-19T08:54:53.329067+0000","last_became_active":"2024-09-19T08:54:29.413400+0000","last_became_peered":"2024-09-19T08:54:29.413400+0000","last_unstale":"2024-09-19T08:54:53.329067+0000","last_undegraded":"2024-09-19T08:54:53.329067+0000","last_fullsized":"2024-09-19T08:54:53.329067+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:12.518454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.271551+0000","last_change":"2024-09-19T08:54:31.428451+0000","last_active":"2024-09-19T08:55:52.271551+0000","last_peered":"2024-09-19T08:55:52.271551+0000","last_clean":"2024-09-19T08:55:52.271551+0000","last_became_active":"2024-09-19T08:54:31.428134+0000","last_became_peered":"2024-09-19T08:54:31.428134+0000","last_unstale":"2024-09-19T08:55:52.271551+0000","last_undegraded":"2024-09-19T08:55:52.271551+0000","last_fullsized":"2024-09-19T08:55:52.271551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:08.260183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329914+0000","last_change":"2024-09-19T08:54:29.414399+0000","last_active":"2024-09-19T08:54:53.329914+0000","last_peered":"2024-09-19T08:54:53.329914+0000","last_clean":"2024-09-19T08:54:53.329914+0000","last_became_active":"2024-09-19T08:54:29.413080+0000","last_became_peered":"2024-09-19T08:54:29.413080+0000","last_unstale":"2024-09-19T08:54:53.329914+0000","last_undegraded":"2024-09-19T08:54:53.329914+0000","last_fullsized":"2024-09-19T08:54:53.329914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:27.308297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.282381+0000","last_change":"2024-09-19T08:54:31.434550+0000","last_active":"2024-09-19T08:55:52.282381+0000","last_peered":"2024-09-19T08:55:52.282381+0000","last_clean":"2024-09-19T08:55:52.282381+0000","last_became_active":"2024-09-19T08:54:31.434195+0000","last_became_peered":"2024-09-19T08:54:31.434195+0000","last_unstale":"2024-09-19T08:55:52.282381+0000","last_undegraded":"2024-09-19T08:55:52.282381+0000","last_fullsized":"2024-09-19T08:55:52.282381+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:04.807833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.338857+0000","last_change":"2024-09-19T08:54:53.338857+0000","last_active":"2024-09-19T08:54:53.338857+0000","last_peered":"2024-09-19T08:54:53.338857+0000","last_clean":"2024-09-19T08:54:53.338857+0000","last_became_active":"2024-09-19T08:54:53.334162+0000","last_became_peered":"2024-09-19T08:54:53.334162+0000","last_unstale":"2024-09-19T08:54:53.338857+0000","last_undegraded":"2024-09-19T08:54:53.338857+0000","last_fullsized":"2024-09-19T08:54:53.338857+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:38.858918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.280213+0000","last_change":"2024-09-19T08:54:31.441201+0000","last_active":"2024-09-19T08:55:52.280213+0000","last_peered":"2024-09-19T08:55:52.280213+0000","last_clean":"2024-09-19T08:55:52.280213+0000","last_became_active":"2024-09-19T08:54:31.440738+0000","last_became_peered":"2024-09-19T08:54:31.440738+0000","last_unstale":"2024-09-19T08:55:52.280213+0000","last_undegraded":"2024-09-19T08:55:52.280213+0000","last_fullsized":"2024-09-19T08:55:52.280213+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:39.118320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.284175+0000","last_change":"2024-09-19T08:54:31.435772+0000","last_active":"2024-09-19T08:55:52.284175+0000","last_peered":"2024-09-19T08:55:52.284175+0000","last_clean":"2024-09-19T08:55:52.284175+0000","last_became_active":"2024-09-19T08:54:31.435257+0000","last_became_peered":"2024-09-19T08:54:31.435257+0000","last_unstale":"2024-09-19T08:55:52.284175+0000","last_undegraded":"2024-09-19T08:55:52.284175+0000","last_fullsized":"2024-09-19T08:55:52.284175+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:44:12.219054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.341203+0000","last_change":"2024-09-19T08:54:53.341203+0000","last_active":"2024-09-19T08:54:53.341203+0000","last_peered":"2024-09-19T08:54:53.341203+0000","last_clean":"2024-09-19T08:54:53.341203+0000","last_became_active":"2024-09-19T08:54:53.336115+0000","last_became_peered":"2024-09-19T08:54:53.336115+0000","last_unstale":"2024-09-19T08:54:53.341203+0000","last_undegraded":"2024-09-19T08:54:53.341203+0000","last_fullsized":"2024-09-19T08:54:53.341203+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:31.532599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277536+0000","last_change":"2024-09-19T08:54:31.427103+0000","last_active":"2024-09-19T08:55:52.277536+0000","last_peered":"2024-09-19T08:55:52.277536+0000","last_clean":"2024-09-19T08:55:52.277536+0000","last_became_active":"2024-09-19T08:54:31.425958+0000","last_became_peered":"2024-09-19T08:54:31.425958+0000","last_unstale":"2024-09-19T08:55:52.277536+0000","last_undegraded":"2024-09-19T08:55:52.277536+0000","last_fullsized":"2024-09-19T08:55:52.277536+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:36.840940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331317+0000","last_change":"2024-09-19T08:54:29.415209+0000","last_active":"2024-09-19T08:54:53.331317+0000","last_peered":"2024-09-19T08:54:53.331317+0000","last_clean":"2024-09-19T08:54:53.331317+0000","last_became_active":"2024-09-19T08:54:29.414806+0000","last_became_peered":"2024-09-19T08:54:29.414806+0000","last_unstale":"2024-09-19T08:54:53.331317+0000","last_undegraded":"2024-09-19T08:54:53.331317+0000","last_fullsized":"2024-09-19T08:54:53.331317+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:47.764231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.271279+0000","last_change":"2024-09-19T08:54:31.434027+0000","last_active":"2024-09-19T08:55:52.271279+0000","last_peered":"2024-09-19T08:55:52.271279+0000","last_clean":"2024-09-19T08:55:52.271279+0000","last_became_active":"2024-09-19T08:54:31.433687+0000","last_became_peered":"2024-09-19T08:54:31.433687+0000","last_unstale":"2024-09-19T08:55:52.271279+0000","last_undegraded":"2024-09-19T08:55:52.271279+0000","last_fullsized":"2024-09-19T08:55:52.271279+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:56.462128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329231+0000","last_change":"2024-09-19T08:54:29.675502+0000","last_active":"2024-09-19T08:54:53.329231+0000","last_peered":"2024-09-19T08:54:53.329231+0000","last_clean":"2024-09-19T08:54:53.329231+0000","last_became_active":"2024-09-19T08:54:29.675158+0000","last_became_peered":"2024-09-19T08:54:29.675158+0000","last_unstale":"2024-09-19T08:54:53.329231+0000","last_undegraded":"2024-09-19T08:54:53.329231+0000","last_fullsized":"2024-09-19T08:54:53.329231+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:24:59.377521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.278201+0000","last_change":"2024-09-19T08:54:53.334264+0000","last_active":"2024-09-19T08:55:52.278201+0000","last_peered":"2024-09-19T08:55:52.278201+0000","last_clean":"2024-09-19T08:55:52.278201+0000","last_became_active":"2024-09-19T08:54:53.333959+0000","last_became_peered":"2024-09-19T08:54:53.333959+0000","last_unstale":"2024-09-19T08:55:52.278201+0000","last_undegraded":"2024-09-19T08:55:52.278201+0000","last_fullsized":"2024-09-19T08:55:52.278201+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:14.085033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330562+0000","last_change":"2024-09-19T08:54:29.414478+0000","last_active":"2024-09-19T08:54:53.330562+0000","last_peered":"2024-09-19T08:54:53.330562+0000","last_clean":"2024-09-19T08:54:53.330562+0000","last_became_active":"2024-09-19T08:54:29.414152+0000","last_became_peered":"2024-09-19T08:54:29.414152+0000","last_unstale":"2024-09-19T08:54:53.330562+0000","last_undegraded":"2024-09-19T08:54:53.330562+0000","last_fullsized":"2024-09-19T08:54:53.330562+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:17.477340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67927,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":211,"num_read_kb":173,"num_write":90,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294912,"data_stored":203781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579939,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":897024,"data_stored":435723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841575,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28572,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716580,"statfs":{"total":95995035648,"available":95965777920,"internally_reserved":0,"allocated":1585152,"data_stored":1093531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005100,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":436305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234032,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":436327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462966,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28488,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716664,"statfs":{"total":95995035648,"available":95965863936,"internally_reserved":0,"allocated":1499136,"data_stored":1026790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593787,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":435840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822720,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32656,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712496,"statfs":{"total":95995035648,"available":95961595904,"internally_reserved":0,"allocated":1507328,"data_stored":1026390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986244,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":435745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215176,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":436061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411406,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":978944,"data_stored":502886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":497479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738455,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":435813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":67129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":67163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":67323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:56:20.806 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:56:20.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:20 smithi167 ceph-mon[35359]: scrub queued for path: / 2024-09-19T08:56:20.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:20 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T08:56:20.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:20 smithi167 ceph-mon[35359]: scrub summary: active paths [/] 2024-09-19T08:56:20.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:20 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T08:56:20.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:20 smithi190 ceph-mon[35358]: scrub queued for path: / 2024-09-19T08:56:20.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:20 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T08:56:20.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:20 smithi190 ceph-mon[35358]: scrub summary: active paths [/] 2024-09-19T08:56:20.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:20 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T08:56:20.897 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:21.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.284+0000 7f018b358640 1 -- 172.21.15.92:0/3708085093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0184106f50 msgr2=0x7f018410eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:21.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.284+0000 7f018b358640 1 --2- 172.21.15.92:0/3708085093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0184106f50 0x7f018410eaf0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f017c009cd0 tx=0x7f017c02a8e0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.284+0000 7f018b358640 1 -- 172.21.15.92:0/3708085093 shutdown_connections 2024-09-19T08:56:21.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.284+0000 7f018b358640 1 --2- 172.21.15.92:0/3708085093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0184106f50 0x7f018410eaf0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.284+0000 7f018b358640 1 --2- 172.21.15.92:0/3708085093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0184100ca0 0x7f0184106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.284+0000 7f018b358640 1 --2- 172.21.15.92:0/3708085093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01841002f0 0x7f01841006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.284+0000 7f018b358640 1 -- 172.21.15.92:0/3708085093 >> 172.21.15.92:0/3708085093 conn(0x7f0184077210 msgr2=0x7f01840fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:21.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.284+0000 7f018b358640 1 -- 172.21.15.92:0/3708085093 shutdown_connections 2024-09-19T08:56:21.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.284+0000 7f018b358640 1 -- 172.21.15.92:0/3708085093 wait complete. 2024-09-19T08:56:21.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.285+0000 7f018b358640 1 Processor -- start 2024-09-19T08:56:21.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.285+0000 7f018b358640 1 -- start start 2024-09-19T08:56:21.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.285+0000 7f018b358640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01841002f0 0x7f01841985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:21.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.285+0000 7f018b358640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0184100ca0 0x7f0184198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:21.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.285+0000 7f018b358640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0184106f50 0x7f018419ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:21.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.285+0000 7f018b358640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0184112080 con 0x7f0184106f50 2024-09-19T08:56:21.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.285+0000 7f018b358640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0184111f00 con 0x7f0184100ca0 2024-09-19T08:56:21.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.285+0000 7f018b358640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0184112200 con 0x7f01841002f0 2024-09-19T08:56:21.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.285+0000 7f01898f5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0184106f50 0x7f018419ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:21.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.285+0000 7f01898f5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0184106f50 0x7f018419ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50460/0 (socket says 172.21.15.92:50460) 2024-09-19T08:56:21.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.285+0000 7f01898f5640 1 -- 172.21.15.92:0/715497730 learned_addr learned my addr 172.21.15.92:0/715497730 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:21.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.285+0000 7f01890f4640 1 --2- 172.21.15.92:0/715497730 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01841002f0 0x7f01841985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:21.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.285+0000 7f01888f3640 1 --2- 172.21.15.92:0/715497730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0184100ca0 0x7f0184198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:21.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.285+0000 7f01898f5640 1 -- 172.21.15.92:0/715497730 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01841002f0 msgr2=0x7f01841985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:21.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.285+0000 7f01898f5640 1 --2- 172.21.15.92:0/715497730 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01841002f0 0x7f01841985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.285+0000 7f01898f5640 1 -- 172.21.15.92:0/715497730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0184100ca0 msgr2=0x7f0184198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:21.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.285+0000 7f01898f5640 1 --2- 172.21.15.92:0/715497730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0184100ca0 0x7f0184198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.285+0000 7f01898f5640 1 -- 172.21.15.92:0/715497730 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f018419d570 con 0x7f0184106f50 2024-09-19T08:56:21.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.285+0000 7f01888f3640 1 --2- 172.21.15.92:0/715497730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0184100ca0 0x7f0184198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:56:21.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.286+0000 7f01898f5640 1 --2- 172.21.15.92:0/715497730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0184106f50 0x7f018419ce90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f017c006010 tx=0x7f017c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:21.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.286+0000 7f01767fc640 1 -- 172.21.15.92:0/715497730 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017c004450 con 0x7f0184106f50 2024-09-19T08:56:21.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.286+0000 7f01767fc640 1 -- 172.21.15.92:0/715497730 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f017c003e10 con 0x7f0184106f50 2024-09-19T08:56:21.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.286+0000 7f018b358640 1 -- 172.21.15.92:0/715497730 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f018419d800 con 0x7f0184106f50 2024-09-19T08:56:21.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.286+0000 7f01767fc640 1 -- 172.21.15.92:0/715497730 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017c0466e0 con 0x7f0184106f50 2024-09-19T08:56:21.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.286+0000 7f018b358640 1 -- 172.21.15.92:0/715497730 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01841a5140 con 0x7f0184106f50 2024-09-19T08:56:21.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.288+0000 7f01767fc640 1 -- 172.21.15.92:0/715497730 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f017c0305a0 con 0x7f0184106f50 2024-09-19T08:56:21.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.288+0000 7f018d731740 1 Processor -- start 2024-09-19T08:56:21.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.288+0000 7f018d731740 1 -- start start 2024-09-19T08:56:21.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.289+0000 7f018d731740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f722ffe360 0x55f722ffe740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:21.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.289+0000 7f018d731740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f722ffec80 0x55f72300d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:21.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.289+0000 7f018d731740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f72300da90 0x55f72300fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:21.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.289+0000 7f018d731740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f722f642e0 con 0x55f72300da90 2024-09-19T08:56:21.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.289+0000 7f018d731740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f722f0bce0 con 0x55f722ffe360 2024-09-19T08:56:21.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.289+0000 7f018d731740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f722f602a0 con 0x55f722ffec80 2024-09-19T08:56:21.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.289+0000 7f01767fc640 1 --2- 172.21.15.92:0/715497730 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f01700a3240 0x7f01700a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:21.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.289+0000 7f01890f4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f722ffec80 0x55f72300d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:21.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.289+0000 7f01890f4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f722ffec80 0x55f72300d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:38810/0 (socket says 172.21.15.92:38810) 2024-09-19T08:56:21.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.289+0000 7f01890f4640 1 -- 172.21.15.92:0/1265767606 learned_addr learned my addr 172.21.15.92:0/1265767606 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:21.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.289+0000 7f01898f5640 1 --2- 172.21.15.92:0/715497730 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f01700a3240 0x7f01700a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:21.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.289+0000 7f01767fc640 1 -- 172.21.15.92:0/715497730 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f017c02e030 con 0x7f0184106f50 2024-09-19T08:56:21.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.289+0000 7f01890f4640 1 -- 172.21.15.92:0/1265767606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f722ffe360 msgr2=0x55f722ffe740 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T08:56:21.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.289+0000 7f01890f4640 1 --2- 172.21.15.92:0/1265767606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f722ffe360 0x55f722ffe740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.289+0000 7f01890f4640 1 -- 172.21.15.92:0/1265767606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f72300da90 msgr2=0x55f72300fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:21.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.289+0000 7f01890f4640 1 --2- 172.21.15.92:0/1265767606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f72300da90 0x55f72300fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.289+0000 7f01890f4640 1 -- 172.21.15.92:0/1265767606 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f722ef0440 con 0x55f722ffec80 2024-09-19T08:56:21.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.290+0000 7f01890f4640 1 --2- 172.21.15.92:0/1265767606 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f722ffec80 0x55f72300d550 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f017800b820 tx=0x7f017800bce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6deed64c7eb4d09f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:21.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.290+0000 7f01898f5640 1 --2- 172.21.15.92:0/715497730 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f01700a3240 0x7f01700a5700 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f017c0b9df0 tx=0x7f017c0a8040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:21.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.290+0000 7f016f7fe640 1 -- 172.21.15.92:0/1265767606 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017800d950 con 0x55f722ffec80 2024-09-19T08:56:21.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.290+0000 7f016f7fe640 1 -- 172.21.15.92:0/1265767606 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0178019070 con 0x55f722ffec80 2024-09-19T08:56:21.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.290+0000 7f016f7fe640 1 -- 172.21.15.92:0/1265767606 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01780123e0 con 0x55f722ffec80 2024-09-19T08:56:21.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.291+0000 7f018d731740 1 -- 172.21.15.92:0/1265767606 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f722ffec80 msgr2=0x55f72300d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:21.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.291+0000 7f018d731740 1 --2- 172.21.15.92:0/1265767606 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f722ffec80 0x55f72300d550 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f017800b820 tx=0x7f017800bce0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.291+0000 7f018d731740 1 -- 172.21.15.92:0/1265767606 shutdown_connections 2024-09-19T08:56:21.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.291+0000 7f018d731740 1 --2- 172.21.15.92:0/1265767606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f72300da90 0x55f72300fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.291+0000 7f018d731740 1 --2- 172.21.15.92:0/1265767606 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f722ffec80 0x55f72300d550 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.291+0000 7f018d731740 1 --2- 172.21.15.92:0/1265767606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f722ffe360 0x55f722ffe740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.291+0000 7f018d731740 1 -- 172.21.15.92:0/1265767606 >> 172.21.15.92:0/1265767606 conn(0x55f722ffaa30 msgr2=0x55f722ffae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:21.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.291+0000 7f018d731740 1 -- 172.21.15.92:0/1265767606 shutdown_connections 2024-09-19T08:56:21.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.291+0000 7f018d731740 1 -- 172.21.15.92:0/1265767606 wait complete. 2024-09-19T08:56:21.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.291+0000 7f018d731740 1 -- start start 2024-09-19T08:56:21.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.291+0000 7f018d731740 1 Processor -- start 2024-09-19T08:56:21.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.292+0000 7f018d731740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f722ffe360 0x55f72300d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:21.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.292+0000 7f018d731740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f722ffec80 0x55f72300a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:21.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.292+0000 7f018d731740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f72300da90 0x55f72300ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:21.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.292+0000 7f018d731740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f723010660 con 0x55f72300da90 2024-09-19T08:56:21.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.292+0000 7f018d731740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f722f1f050 con 0x55f722ffe360 2024-09-19T08:56:21.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.292+0000 7f018d731740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f7230107e0 con 0x55f722ffec80 2024-09-19T08:56:21.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.292+0000 7f018d731740 10 client.0 _ll_register_callbacks cb 0x55f722f5f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:21.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.292+0000 7f01888f3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f72300da90 0x55f72300ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:21.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.292+0000 7f01888f3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f72300da90 0x55f72300ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50468/0 (socket says 172.21.15.92:50468) 2024-09-19T08:56:21.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.292+0000 7f01890f4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f722ffec80 0x55f72300a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:21.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.292+0000 7f01888f3640 1 -- 172.21.15.92:0/4246947991 learned_addr learned my addr 172.21.15.92:0/4246947991 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:21.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.292+0000 7f01888f3640 1 --2- 172.21.15.92:0/4246947991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f722ffe360 0x55f72300d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:21.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.292+0000 7f01888f3640 1 -- 172.21.15.92:0/4246947991 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f722ffec80 msgr2=0x55f72300a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:21.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.292+0000 7f01888f3640 1 --2- 172.21.15.92:0/4246947991 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f722ffec80 0x55f72300a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.292+0000 7f01888f3640 1 -- 172.21.15.92:0/4246947991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f722ffe360 msgr2=0x55f72300d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:21.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.292+0000 7f01888f3640 1 --2- 172.21.15.92:0/4246947991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f722ffe360 0x55f72300d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.292+0000 7f01888f3640 1 -- 172.21.15.92:0/4246947991 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f722cd53c0 con 0x55f72300da90 2024-09-19T08:56:21.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.293+0000 7f01888f3640 1 --2- 172.21.15.92:0/4246947991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f72300da90 0x55f72300ac00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f018000cea0 tx=0x7f018000c110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=420eaebd9baac5a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:21.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.293+0000 7f016cff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:56:21.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.293+0000 7f016cff9640 1 -- 172.21.15.92:0/4246947991 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018000f040 con 0x55f72300da90 2024-09-19T08:56:21.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.293+0000 7f016cff9640 1 -- 172.21.15.92:0/4246947991 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f018001eb80 con 0x55f72300da90 2024-09-19T08:56:21.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.293+0000 7f018d731740 1 -- 172.21.15.92:0/4246947991 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0178019070 con 0x55f72300da90 2024-09-19T08:56:21.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.293+0000 7f016cff9640 1 -- 172.21.15.92:0/4246947991 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f018001ed80 con 0x55f72300da90 2024-09-19T08:56:21.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.293+0000 7f018d731740 10 client.15192 fetch_fsmap learned FSMap version 19 2024-09-19T08:56:21.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.293+0000 7f018d731740 1 -- 172.21.15.92:0/4246947991 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f7230010e0 con 0x55f72300da90 2024-09-19T08:56:21.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.293+0000 7f016cff9640 1 -- 172.21.15.92:0/4246947991 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0178019070 con 0x55f72300da90 2024-09-19T08:56:21.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.293+0000 7f016cff9640 1 -- 172.21.15.92:0/4246947991 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f0180027b70 con 0x55f72300da90 2024-09-19T08:56:21.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.293+0000 7f018d731740 10 client.15192 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:56:21.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.293+0000 7f018d731740 10 client.15192 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:56:21.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.293+0000 7f018d731740 20 client.15192 populate_metadata read hostname 'smithi092' 2024-09-19T08:56:21.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.294+0000 7f018d731740 1 --2- 172.21.15.92:0/4246947991 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f723002540 0x55f723004930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:21.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.294+0000 7f018d731740 4 client.15192 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:56:21.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.294+0000 7f018d731740 1 -- 172.21.15.92:0/4246947991 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f722f71850 con 0x55f723002540 2024-09-19T08:56:21.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.294+0000 7f01890f4640 1 --2- 172.21.15.92:0/4246947991 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f723002540 0x55f723004930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:21.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.294+0000 7f01890f4640 1 --2- 172.21.15.92:0/4246947991 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f723002540 0x55f723004930 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1cd973fb9d37a5b server_cookie=470ff424b48c8f8a in_seq=0 out_seq=0 2024-09-19T08:56:21.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.294+0000 7f016cff9640 10 client.15192 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:21.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.295+0000 7f016cff9640 1 -- 172.21.15.92:0/4246947991 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f722f71850 con 0x55f723002540 2024-09-19T08:56:21.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.295+0000 7f016cff9640 10 client.15192 handle_command_reply: tid=0 2024-09-19T08:56:21.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.295+0000 7f018d731740 1 client.15192 shutdown 2024-09-19T08:56:21.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.295+0000 7f018d731740 1 -- 172.21.15.92:0/4246947991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f72300da90 msgr2=0x55f72300ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:21.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.295+0000 7f018d731740 1 --2- 172.21.15.92:0/4246947991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f72300da90 0x55f72300ac00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f018000cea0 tx=0x7f018000c110 comp rx=0 tx=0).stop 2024-09-19T08:56:21.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.295+0000 7f018d731740 1 -- 172.21.15.92:0/4246947991 shutdown_connections 2024-09-19T08:56:21.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.295+0000 7f018d731740 1 --2- 172.21.15.92:0/4246947991 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f723002540 0x55f723004930 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.295+0000 7f018d731740 1 --2- 172.21.15.92:0/4246947991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f72300da90 0x55f72300ac00 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.295+0000 7f018d731740 1 --2- 172.21.15.92:0/4246947991 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f722ffec80 0x55f72300a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.295+0000 7f018d731740 1 --2- 172.21.15.92:0/4246947991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f722ffe360 0x55f72300d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.295+0000 7f018d731740 1 -- 172.21.15.92:0/4246947991 >> 172.21.15.92:0/4246947991 conn(0x55f722ffaa30 msgr2=0x55f723000790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:21.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.295+0000 7f016cff9640 0 client.15192 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:21.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.295+0000 7f018d731740 1 -- 172.21.15.92:0/4246947991 shutdown_connections 2024-09-19T08:56:21.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.296+0000 7f018d731740 1 -- 172.21.15.92:0/4246947991 wait complete. 2024-09-19T08:56:21.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.296+0000 7f018d731740 20 client.15192 trim_cache size 0 max 16384 2024-09-19T08:56:21.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.313+0000 7f018d731740 1 Processor -- start 2024-09-19T08:56:21.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.313+0000 7f018d731740 1 -- start start 2024-09-19T08:56:21.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.313+0000 7f018d731740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f722ffe360 0x55f72300c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:21.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.313+0000 7f018d731740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f722ffec80 0x55f723007900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:21.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.313+0000 7f018d731740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f72300da90 0x55f723007e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:21.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.314+0000 7f018d731740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f01841a9440 con 0x55f722ffe360 2024-09-19T08:56:21.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.314+0000 7f018d731740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f01841abce0 con 0x55f722ffec80 2024-09-19T08:56:21.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.314+0000 7f018d731740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f01841a9ad0 con 0x55f72300da90 2024-09-19T08:56:21.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.314+0000 7f01888f3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f722ffe360 0x55f72300c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:21.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.314+0000 7f01888f3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f722ffe360 0x55f72300c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50484/0 (socket says 172.21.15.92:50484) 2024-09-19T08:56:21.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.314+0000 7f01888f3640 1 -- 172.21.15.92:0/4285129506 learned_addr learned my addr 172.21.15.92:0/4285129506 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:21.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.314+0000 7f01890f4640 1 --2- 172.21.15.92:0/4285129506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f722ffec80 0x55f723007900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:21.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.314+0000 7f01888f3640 1 --2- 172.21.15.92:0/4285129506 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f72300da90 0x55f723007e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:21.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.314+0000 7f01888f3640 1 -- 172.21.15.92:0/4285129506 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f72300da90 msgr2=0x55f723007e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:21.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.314+0000 7f01888f3640 1 --2- 172.21.15.92:0/4285129506 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f72300da90 0x55f723007e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.314+0000 7f01888f3640 1 -- 172.21.15.92:0/4285129506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f722ffec80 msgr2=0x55f723007900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:21.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.314+0000 7f01888f3640 1 --2- 172.21.15.92:0/4285129506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f722ffec80 0x55f723007900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.314+0000 7f01888f3640 1 -- 172.21.15.92:0/4285129506 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f722ffa840 con 0x55f722ffe360 2024-09-19T08:56:21.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.314+0000 7f01890f4640 1 --2- 172.21.15.92:0/4285129506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f722ffec80 0x55f723007900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:21.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.314+0000 7f01888f3640 1 --2- 172.21.15.92:0/4285129506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f722ffe360 0x55f72300c610 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0180004700 tx=0x7f01800156a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21dbae55b3b6cb3e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:21.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.315+0000 7f016effd640 1 -- 172.21.15.92:0/4285129506 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0180038030 con 0x55f722ffe360 2024-09-19T08:56:21.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.315+0000 7f016effd640 1 -- 172.21.15.92:0/4285129506 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0180023070 con 0x55f722ffe360 2024-09-19T08:56:21.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.315+0000 7f016effd640 1 -- 172.21.15.92:0/4285129506 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01800287a0 con 0x55f722ffe360 2024-09-19T08:56:21.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.315+0000 7f018d731740 1 -- 172.21.15.92:0/4285129506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f722ffe360 msgr2=0x55f72300c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:21.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.315+0000 7f018d731740 1 --2- 172.21.15.92:0/4285129506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f722ffe360 0x55f72300c610 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0180004700 tx=0x7f01800156a0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.315+0000 7f018d731740 1 -- 172.21.15.92:0/4285129506 shutdown_connections 2024-09-19T08:56:21.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.315+0000 7f018d731740 1 --2- 172.21.15.92:0/4285129506 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f72300da90 0x55f723007e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.315+0000 7f018d731740 1 --2- 172.21.15.92:0/4285129506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f722ffec80 0x55f723007900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.315+0000 7f018d731740 1 --2- 172.21.15.92:0/4285129506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f722ffe360 0x55f72300c610 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.315+0000 7f018d731740 1 -- 172.21.15.92:0/4285129506 >> 172.21.15.92:0/4285129506 conn(0x55f722ffaa30 msgr2=0x55f72300bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:21.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.315+0000 7f018d731740 1 -- 172.21.15.92:0/4285129506 shutdown_connections 2024-09-19T08:56:21.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.315+0000 7f018d731740 1 -- 172.21.15.92:0/4285129506 wait complete. 2024-09-19T08:56:21.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.316+0000 7f018d731740 1 -- start start 2024-09-19T08:56:21.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.316+0000 7f018d731740 1 Processor -- start 2024-09-19T08:56:21.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.316+0000 7f018d731740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f722ffe360 0x55f72301e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:21.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.316+0000 7f018d731740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f722ffec80 0x55f72301ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:21.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.316+0000 7f018d731740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f72300da90 0x55f723082070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:21.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.316+0000 7f018d731740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f01841aa1a0 con 0x55f722ffec80 2024-09-19T08:56:21.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.316+0000 7f018d731740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f01841ab610 con 0x55f722ffe360 2024-09-19T08:56:21.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.316+0000 7f018d731740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f01841aa870 con 0x55f72300da90 2024-09-19T08:56:21.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.316+0000 7f018d731740 10 client.0 _ll_register_callbacks cb 0x7f018000c650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:21.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.316+0000 7f01890f4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f722ffec80 0x55f72301ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:21.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.317+0000 7f01890f4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f722ffec80 0x55f72301ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50486/0 (socket says 172.21.15.92:50486) 2024-09-19T08:56:21.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.317+0000 7f01890f4640 1 -- 172.21.15.92:0/4260029875 learned_addr learned my addr 172.21.15.92:0/4260029875 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:21.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.317+0000 7f01888f3640 1 --2- 172.21.15.92:0/4260029875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f722ffe360 0x55f72301e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:21.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.317+0000 7f01888f3640 1 --2- 172.21.15.92:0/4260029875 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f72300da90 0x55f723082070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:21.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.317+0000 7f01890f4640 1 -- 172.21.15.92:0/4260029875 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f72300da90 msgr2=0x55f723082070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:21.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.317+0000 7f01890f4640 1 --2- 172.21.15.92:0/4260029875 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f72300da90 0x55f723082070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.317+0000 7f01890f4640 1 -- 172.21.15.92:0/4260029875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f722ffe360 msgr2=0x55f72301e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:21.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.317+0000 7f01890f4640 1 --2- 172.21.15.92:0/4260029875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f722ffe360 0x55f72301e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.317+0000 7f01890f4640 1 -- 172.21.15.92:0/4260029875 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7230825b0 con 0x55f722ffec80 2024-09-19T08:56:21.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.317+0000 7f01888f3640 1 --2- 172.21.15.92:0/4260029875 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f72300da90 0x55f723082070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:56:21.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.317+0000 7f01890f4640 1 --2- 172.21.15.92:0/4260029875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f722ffec80 0x55f72301ea40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f017800b7f0 tx=0x7f017800bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e410d35b8908a706 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:21.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.317+0000 7f016cff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:56:21.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.317+0000 7f016cff9640 1 -- 172.21.15.92:0/4260029875 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017800d950 con 0x55f722ffec80 2024-09-19T08:56:21.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.317+0000 7f016cff9640 1 -- 172.21.15.92:0/4260029875 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f017800daf0 con 0x55f722ffec80 2024-09-19T08:56:21.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.317+0000 7f018d731740 1 -- 172.21.15.92:0/4260029875 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0180023070 con 0x55f722ffec80 2024-09-19T08:56:21.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.317+0000 7f016cff9640 1 -- 172.21.15.92:0/4260029875 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f0178037050 con 0x55f722ffec80 2024-09-19T08:56:21.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.317+0000 7f018d731740 10 client.15198 fetch_fsmap learned FSMap version 19 2024-09-19T08:56:21.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.317+0000 7f018d731740 1 -- 172.21.15.92:0/4260029875 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f723083830 con 0x55f722ffec80 2024-09-19T08:56:21.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.318+0000 7f016cff9640 1 -- 172.21.15.92:0/4260029875 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0180023070 con 0x55f722ffec80 2024-09-19T08:56:21.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.318+0000 7f016cff9640 1 -- 172.21.15.92:0/4260029875 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f0178013070 con 0x55f722ffec80 2024-09-19T08:56:21.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.318+0000 7f018d731740 10 client.15198 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:56:21.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.318+0000 7f018d731740 10 client.15198 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:56:21.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.318+0000 7f018d731740 20 client.15198 populate_metadata read hostname 'smithi092' 2024-09-19T08:56:21.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.318+0000 7f018d731740 1 --2- 172.21.15.92:0/4260029875 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f723083d30 0x55f723086150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:21.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.318+0000 7f018d731740 4 client.15198 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:56:21.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.318+0000 7f018d731740 1 -- 172.21.15.92:0/4260029875 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f722f6bd60 con 0x55f723083d30 2024-09-19T08:56:21.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.318+0000 7f01888f3640 1 --2- 172.21.15.92:0/4260029875 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f723083d30 0x55f723086150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:21.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.319+0000 7f016cff9640 10 client.15198 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:21.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.319+0000 7f01888f3640 1 --2- 172.21.15.92:0/4260029875 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f723083d30 0x55f723086150 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75c3bddbb4be36a3 server_cookie=61c74281baa32a79 in_seq=0 out_seq=0 2024-09-19T08:56:21.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.319+0000 7f016cff9640 1 -- 172.21.15.92:0/4260029875 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55f722f6bd60 con 0x55f723083d30 2024-09-19T08:56:21.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.319+0000 7f016cff9640 10 client.15198 handle_command_reply: tid=0 2024-09-19T08:56:21.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.319+0000 7f018d731740 1 client.15198 shutdown 2024-09-19T08:56:21.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.319+0000 7f018d731740 1 -- 172.21.15.92:0/4260029875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f722ffec80 msgr2=0x55f72301ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:21.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.319+0000 7f018d731740 1 --2- 172.21.15.92:0/4260029875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f722ffec80 0x55f72301ea40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f017800b7f0 tx=0x7f017800bf80 comp rx=0 tx=0).stop 2024-09-19T08:56:21.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.319+0000 7f018d731740 1 -- 172.21.15.92:0/4260029875 shutdown_connections 2024-09-19T08:56:21.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.319+0000 7f018d731740 1 --2- 172.21.15.92:0/4260029875 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f723083d30 0x55f723086150 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.319+0000 7f018d731740 1 --2- 172.21.15.92:0/4260029875 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f72300da90 0x55f723082070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.319+0000 7f018d731740 1 --2- 172.21.15.92:0/4260029875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f722ffec80 0x55f72301ea40 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.319+0000 7f018d731740 1 --2- 172.21.15.92:0/4260029875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f722ffe360 0x55f72301e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.319+0000 7f018d731740 1 -- 172.21.15.92:0/4260029875 >> 172.21.15.92:0/4260029875 conn(0x55f722ffaa30 msgr2=0x55f72300c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:21.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.319+0000 7f016cff9640 0 client.15198 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:21.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.319+0000 7f018d731740 1 -- 172.21.15.92:0/4260029875 shutdown_connections 2024-09-19T08:56:21.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.319+0000 7f018d731740 1 -- 172.21.15.92:0/4260029875 wait complete. 2024-09-19T08:56:21.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.320+0000 7f018d731740 20 client.15198 trim_cache size 0 max 16384 2024-09-19T08:56:21.325 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T08:56:21.325 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T08:56:21.325 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": { 2024-09-19T08:56:21.325 INFO:teuthology.orchestra.run.smithi092.stdout: "0c846b43-9676-4d94-9823-f5cb19280415": { 2024-09-19T08:56:21.325 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-19T08:56:21.325 INFO:teuthology.orchestra.run.smithi092.stdout: "tag": "0c846b43-9676-4d94-9823-f5cb19280415", 2024-09-19T08:56:21.325 INFO:teuthology.orchestra.run.smithi092.stdout: "options": "recursive,force" 2024-09-19T08:56:21.325 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:56:21.325 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:56:21.325 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T08:56:21.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.320+0000 7f018b358640 1 -- 172.21.15.92:0/715497730 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f01700a3240 msgr2=0x7f01700a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:21.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.320+0000 7f018b358640 1 --2- 172.21.15.92:0/715497730 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f01700a3240 0x7f01700a5700 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f017c0b9df0 tx=0x7f017c0a8040 comp rx=0 tx=0).stop 2024-09-19T08:56:21.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.320+0000 7f018b358640 1 -- 172.21.15.92:0/715497730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0184106f50 msgr2=0x7f018419ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:21.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.320+0000 7f018b358640 1 --2- 172.21.15.92:0/715497730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0184106f50 0x7f018419ce90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f017c006010 tx=0x7f017c003c20 comp rx=0 tx=0).stop 2024-09-19T08:56:21.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.320+0000 7f018b358640 1 -- 172.21.15.92:0/715497730 shutdown_connections 2024-09-19T08:56:21.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.320+0000 7f018b358640 1 --2- 172.21.15.92:0/715497730 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f01700a3240 0x7f01700a5700 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.320+0000 7f018b358640 1 --2- 172.21.15.92:0/715497730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0184106f50 0x7f018419ce90 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.320+0000 7f018b358640 1 --2- 172.21.15.92:0/715497730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0184100ca0 0x7f0184198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.320+0000 7f018b358640 1 --2- 172.21.15.92:0/715497730 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01841002f0 0x7f01841985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.320+0000 7f018b358640 1 -- 172.21.15.92:0/715497730 >> 172.21.15.92:0/715497730 conn(0x7f0184077210 msgr2=0x7f01841051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:21.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.320+0000 7f018b358640 1 -- 172.21.15.92:0/715497730 shutdown_connections 2024-09-19T08:56:21.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:21.321+0000 7f018b358640 1 -- 172.21.15.92:0/715497730 wait complete. 2024-09-19T08:56:21.327 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:21.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:21 smithi092 ceph-mon[31407]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:56:21.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:21 smithi092 ceph-mon[31407]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-19T08:56:21.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:21 smithi167 ceph-mon[35359]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:56:21.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:21 smithi167 ceph-mon[35359]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-19T08:56:21.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:21 smithi190 ceph-mon[35358]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:56:21.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:21 smithi190 ceph-mon[35358]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-19T08:56:22.247 INFO:tasks.cephfs.filesystem:scrub status for tag:0c846b43-9676-4d94-9823-f5cb19280415 - {'path': '/', 'tag': '0c846b43-9676-4d94-9823-f5cb19280415', 'options': 'recursive,force'} 2024-09-19T08:56:22.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.451+0000 7f7ed1c41640 1 -- 172.21.15.92:0/2734329588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ecc102790 msgr2=0x7f7ecc1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:22.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.451+0000 7f7ed1c41640 1 --2- 172.21.15.92:0/2734329588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ecc102790 0x7f7ecc1067e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4009900 tx=0x7f7eb402a410 comp rx=0 tx=0).stop 2024-09-19T08:56:22.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.451+0000 7f7ed1c41640 1 -- 172.21.15.92:0/2734329588 shutdown_connections 2024-09-19T08:56:22.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.451+0000 7f7ed1c41640 1 --2- 172.21.15.92:0/2734329588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ecc106f10 0x7f7ecc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:22.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.451+0000 7f7ed1c41640 1 --2- 172.21.15.92:0/2734329588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ecc102790 0x7f7ecc1067e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:22.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.451+0000 7f7ed1c41640 1 --2- 172.21.15.92:0/2734329588 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ecc101de0 0x7f7ecc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:22.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.451+0000 7f7ed1c41640 1 -- 172.21.15.92:0/2734329588 >> 172.21.15.92:0/2734329588 conn(0x7f7ecc0fd8c0 msgr2=0x7f7ecc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:22.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.451+0000 7f7ed1c41640 1 -- 172.21.15.92:0/2734329588 shutdown_connections 2024-09-19T08:56:22.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.451+0000 7f7ed1c41640 1 -- 172.21.15.92:0/2734329588 wait complete. 2024-09-19T08:56:22.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.452+0000 7f7ed1c41640 1 Processor -- start 2024-09-19T08:56:22.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.452+0000 7f7ed1c41640 1 -- start start 2024-09-19T08:56:22.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.452+0000 7f7ed1c41640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ecc101de0 0x7f7ecc1983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:22.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.452+0000 7f7ed1c41640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ecc102790 0x7f7ecc1988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:22.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.452+0000 7f7ed1c41640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ecc106f10 0x7f7ecc19cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:22.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.452+0000 7f7ed1c41640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7ecc111f70 con 0x7f7ecc102790 2024-09-19T08:56:22.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.452+0000 7f7ed1c41640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7ecc111df0 con 0x7f7ecc101de0 2024-09-19T08:56:22.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.452+0000 7f7ed1c41640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7ecc1120f0 con 0x7f7ecc106f10 2024-09-19T08:56:22.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.452+0000 7f7ec3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ecc102790 0x7f7ecc1988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:22.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.452+0000 7f7ec3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ecc102790 0x7f7ecc1988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37944/0 (socket says 172.21.15.92:37944) 2024-09-19T08:56:22.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.452+0000 7f7ec3fff640 1 -- 172.21.15.92:0/3104064084 learned_addr learned my addr 172.21.15.92:0/3104064084 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:22.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.452+0000 7f7ecbfff640 1 --2- 172.21.15.92:0/3104064084 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ecc106f10 0x7f7ecc19cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:22.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.452+0000 7f7ecb7fe640 1 --2- 172.21.15.92:0/3104064084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ecc101de0 0x7f7ecc1983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:22.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.452+0000 7f7ec3fff640 1 -- 172.21.15.92:0/3104064084 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ecc106f10 msgr2=0x7f7ecc19cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:22.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.452+0000 7f7ec3fff640 1 --2- 172.21.15.92:0/3104064084 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ecc106f10 0x7f7ecc19cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:22.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.452+0000 7f7ec3fff640 1 -- 172.21.15.92:0/3104064084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ecc101de0 msgr2=0x7f7ecc1983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:22.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.452+0000 7f7ec3fff640 1 --2- 172.21.15.92:0/3104064084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ecc101de0 0x7f7ecc1983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:22.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.452+0000 7f7ec3fff640 1 -- 172.21.15.92:0/3104064084 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ecc19d360 con 0x7f7ecc102790 2024-09-19T08:56:22.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.452+0000 7f7ecb7fe640 1 --2- 172.21.15.92:0/3104064084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ecc101de0 0x7f7ecc1983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:56:22.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.453+0000 7f7ec3fff640 1 --2- 172.21.15.92:0/3104064084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ecc102790 0x7f7ecc1988f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4005ab0 tx=0x7f7eb40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:22.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.453+0000 7f7ec97fa640 1 -- 172.21.15.92:0/3104064084 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb403f030 con 0x7f7ecc102790 2024-09-19T08:56:22.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.453+0000 7f7ec97fa640 1 -- 172.21.15.92:0/3104064084 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7eb4003ce0 con 0x7f7ecc102790 2024-09-19T08:56:22.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.453+0000 7f7ed1c41640 1 -- 172.21.15.92:0/3104064084 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ecc19d5f0 con 0x7f7ecc102790 2024-09-19T08:56:22.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.453+0000 7f7ec97fa640 1 -- 172.21.15.92:0/3104064084 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb4035070 con 0x7f7ecc102790 2024-09-19T08:56:22.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.453+0000 7f7ed1c41640 1 -- 172.21.15.92:0/3104064084 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ecc1a4f30 con 0x7f7ecc102790 2024-09-19T08:56:22.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.454+0000 7f7ed1c41640 1 -- 172.21.15.92:0/3104064084 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ecc1032c0 con 0x7f7ecc102790 2024-09-19T08:56:22.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.455+0000 7f7ec97fa640 1 -- 172.21.15.92:0/3104064084 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7eb4042030 con 0x7f7ecc102790 2024-09-19T08:56:22.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.456+0000 7f7ec97fa640 1 --2- 172.21.15.92:0/3104064084 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7eb80a3240 0x7f7eb80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:22.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.456+0000 7f7ecb7fe640 1 --2- 172.21.15.92:0/3104064084 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7eb80a3240 0x7f7eb80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:22.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.456+0000 7f7ec97fa640 1 -- 172.21.15.92:0/3104064084 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f7eb40f02b0 con 0x7f7ecc102790 2024-09-19T08:56:22.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.456+0000 7f7ecb7fe640 1 --2- 172.21.15.92:0/3104064084 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7eb80a3240 0x7f7eb80a5700 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc0058c0 tx=0x7f7ebc005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:22.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.460+0000 7f7ec97fa640 1 -- 172.21.15.92:0/3104064084 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7eb40bcfd0 con 0x7f7ecc102790 2024-09-19T08:56:22.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.626+0000 7f7ed1c41640 1 -- 172.21.15.92:0/3104064084 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7ecc062630 con 0x7f7eb80a3240 2024-09-19T08:56:22.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.632+0000 7f7ec97fa640 1 -- 172.21.15.92:0/3104064084 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258749 (secure 0 0 0) 0x7f7ecc062630 con 0x7f7eb80a3240 2024-09-19T08:56:22.634 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:22.634 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-19T08:56:22.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.634+0000 7f7ed1c41640 1 -- 172.21.15.92:0/3104064084 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7eb80a3240 msgr2=0x7f7eb80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:22.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.634+0000 7f7ed1c41640 1 --2- 172.21.15.92:0/3104064084 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7eb80a3240 0x7f7eb80a5700 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc0058c0 tx=0x7f7ebc005d30 comp rx=0 tx=0).stop 2024-09-19T08:56:22.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.634+0000 7f7ed1c41640 1 -- 172.21.15.92:0/3104064084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ecc102790 msgr2=0x7f7ecc1988f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:22.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.634+0000 7f7ed1c41640 1 --2- 172.21.15.92:0/3104064084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ecc102790 0x7f7ecc1988f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4005ab0 tx=0x7f7eb40042f0 comp rx=0 tx=0).stop 2024-09-19T08:56:22.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.634+0000 7f7ed1c41640 1 -- 172.21.15.92:0/3104064084 shutdown_connections 2024-09-19T08:56:22.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.634+0000 7f7ed1c41640 1 --2- 172.21.15.92:0/3104064084 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ecc106f10 0x7f7ecc19cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:22.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.635+0000 7f7ed1c41640 1 --2- 172.21.15.92:0/3104064084 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7eb80a3240 0x7f7eb80a5700 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:22.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.635+0000 7f7ed1c41640 1 --2- 172.21.15.92:0/3104064084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ecc102790 0x7f7ecc1988f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:22.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.635+0000 7f7ed1c41640 1 --2- 172.21.15.92:0/3104064084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ecc101de0 0x7f7ecc1983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:22.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.635+0000 7f7ed1c41640 1 -- 172.21.15.92:0/3104064084 >> 172.21.15.92:0/3104064084 conn(0x7f7ecc0fd8c0 msgr2=0x7f7ecc0fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:22.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.635+0000 7f7ed1c41640 1 -- 172.21.15.92:0/3104064084 shutdown_connections 2024-09-19T08:56:22.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:22.635+0000 7f7ed1c41640 1 -- 172.21.15.92:0/3104064084 wait complete. 2024-09-19T08:56:23.281 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":327,"stamp":"2024-09-19T08:56:22.282128+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658529,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":338,"num_read_kb":283,"num_write":273,"num_write_kb":3036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":713,"ondisk_log_size":713,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365972,"kb_used_data":12564,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575852,"statfs":{"total":1151940427776,"available":1151565672448,"internally_reserved":0,"allocated":12865536,"data_stored":7204263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5681,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":18,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003032"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277427+0000","last_change":"2024-09-19T08:54:31.437743+0000","last_active":"2024-09-19T08:55:52.277427+0000","last_peered":"2024-09-19T08:55:52.277427+0000","last_clean":"2024-09-19T08:55:52.277427+0000","last_became_active":"2024-09-19T08:54:31.437426+0000","last_became_peered":"2024-09-19T08:54:31.437426+0000","last_unstale":"2024-09-19T08:55:52.277427+0000","last_undegraded":"2024-09-19T08:55:52.277427+0000","last_fullsized":"2024-09-19T08:55:52.277427+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:04.403522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.282945+0000","last_change":"2024-09-19T08:54:31.430322+0000","last_active":"2024-09-19T08:55:52.282945+0000","last_peered":"2024-09-19T08:55:52.282945+0000","last_clean":"2024-09-19T08:55:52.282945+0000","last_became_active":"2024-09-19T08:54:31.430008+0000","last_became_peered":"2024-09-19T08:54:31.430008+0000","last_unstale":"2024-09-19T08:55:52.282945+0000","last_undegraded":"2024-09-19T08:55:52.282945+0000","last_fullsized":"2024-09-19T08:55:52.282945+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:19.800686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.271299+0000","last_change":"2024-09-19T08:54:31.430276+0000","last_active":"2024-09-19T08:55:52.271299+0000","last_peered":"2024-09-19T08:55:52.271299+0000","last_clean":"2024-09-19T08:55:52.271299+0000","last_became_active":"2024-09-19T08:54:31.429939+0000","last_became_peered":"2024-09-19T08:54:31.429939+0000","last_unstale":"2024-09-19T08:55:52.271299+0000","last_undegraded":"2024-09-19T08:55:52.271299+0000","last_fullsized":"2024-09-19T08:55:52.271299+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:08.735067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.260618+0000","last_change":"2024-09-19T08:54:31.435197+0000","last_active":"2024-09-19T08:55:52.260618+0000","last_peered":"2024-09-19T08:55:52.260618+0000","last_clean":"2024-09-19T08:55:52.260618+0000","last_became_active":"2024-09-19T08:54:31.434872+0000","last_became_peered":"2024-09-19T08:54:31.434872+0000","last_unstale":"2024-09-19T08:55:52.260618+0000","last_undegraded":"2024-09-19T08:55:52.260618+0000","last_fullsized":"2024-09-19T08:55:52.260618+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:06.213317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.256859+0000","last_change":"2024-09-19T08:54:31.423765+0000","last_active":"2024-09-19T08:55:52.256859+0000","last_peered":"2024-09-19T08:55:52.256859+0000","last_clean":"2024-09-19T08:55:52.256859+0000","last_became_active":"2024-09-19T08:54:31.423296+0000","last_became_peered":"2024-09-19T08:54:31.423296+0000","last_unstale":"2024-09-19T08:55:52.256859+0000","last_undegraded":"2024-09-19T08:55:52.256859+0000","last_fullsized":"2024-09-19T08:55:52.256859+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:07.507168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.283359+0000","last_change":"2024-09-19T08:54:31.430299+0000","last_active":"2024-09-19T08:55:52.283359+0000","last_peered":"2024-09-19T08:55:52.283359+0000","last_clean":"2024-09-19T08:55:52.283359+0000","last_became_active":"2024-09-19T08:54:31.429951+0000","last_became_peered":"2024-09-19T08:54:31.429951+0000","last_unstale":"2024-09-19T08:55:52.283359+0000","last_undegraded":"2024-09-19T08:55:52.283359+0000","last_fullsized":"2024-09-19T08:55:52.283359+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:11.299729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.278219+0000","last_change":"2024-09-19T08:54:31.435854+0000","last_active":"2024-09-19T08:55:52.278219+0000","last_peered":"2024-09-19T08:55:52.278219+0000","last_clean":"2024-09-19T08:55:52.278219+0000","last_became_active":"2024-09-19T08:54:31.435522+0000","last_became_peered":"2024-09-19T08:54:31.435522+0000","last_unstale":"2024-09-19T08:55:52.278219+0000","last_undegraded":"2024-09-19T08:55:52.278219+0000","last_fullsized":"2024-09-19T08:55:52.278219+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:11.099750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.282506+0000","last_change":"2024-09-19T08:54:31.434574+0000","last_active":"2024-09-19T08:55:52.282506+0000","last_peered":"2024-09-19T08:55:52.282506+0000","last_clean":"2024-09-19T08:55:52.282506+0000","last_became_active":"2024-09-19T08:54:31.434268+0000","last_became_peered":"2024-09-19T08:54:31.434268+0000","last_unstale":"2024-09-19T08:55:52.282506+0000","last_undegraded":"2024-09-19T08:55:52.282506+0000","last_fullsized":"2024-09-19T08:55:52.282506+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:29.159417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.279084+0000","last_change":"2024-09-19T08:54:31.430446+0000","last_active":"2024-09-19T08:55:52.279084+0000","last_peered":"2024-09-19T08:55:52.279084+0000","last_clean":"2024-09-19T08:55:52.279084+0000","last_became_active":"2024-09-19T08:54:31.430048+0000","last_became_peered":"2024-09-19T08:54:31.430048+0000","last_unstale":"2024-09-19T08:55:52.279084+0000","last_undegraded":"2024-09-19T08:55:52.279084+0000","last_fullsized":"2024-09-19T08:55:52.279084+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:24.773947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.283319+0000","last_change":"2024-09-19T08:54:31.433144+0000","last_active":"2024-09-19T08:55:52.283319+0000","last_peered":"2024-09-19T08:55:52.283319+0000","last_clean":"2024-09-19T08:55:52.283319+0000","last_became_active":"2024-09-19T08:54:31.432590+0000","last_became_peered":"2024-09-19T08:54:31.432590+0000","last_unstale":"2024-09-19T08:55:52.283319+0000","last_undegraded":"2024-09-19T08:55:52.283319+0000","last_fullsized":"2024-09-19T08:55:52.283319+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:53.756846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.275955+0000","last_change":"2024-09-19T08:54:31.435712+0000","last_active":"2024-09-19T08:55:52.275955+0000","last_peered":"2024-09-19T08:55:52.275955+0000","last_clean":"2024-09-19T08:55:52.275955+0000","last_became_active":"2024-09-19T08:54:31.435301+0000","last_became_peered":"2024-09-19T08:54:31.435301+0000","last_unstale":"2024-09-19T08:55:52.275955+0000","last_undegraded":"2024-09-19T08:55:52.275955+0000","last_fullsized":"2024-09-19T08:55:52.275955+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:51.703709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.270429+0000","last_change":"2024-09-19T08:54:53.332853+0000","last_active":"2024-09-19T08:55:52.270429+0000","last_peered":"2024-09-19T08:55:52.270429+0000","last_clean":"2024-09-19T08:55:52.270429+0000","last_became_active":"2024-09-19T08:54:53.332460+0000","last_became_peered":"2024-09-19T08:54:53.332460+0000","last_unstale":"2024-09-19T08:55:52.270429+0000","last_undegraded":"2024-09-19T08:55:52.270429+0000","last_fullsized":"2024-09-19T08:55:52.270429+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:47:58.025876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277366+0000","last_change":"2024-09-19T08:54:31.425590+0000","last_active":"2024-09-19T08:55:52.277366+0000","last_peered":"2024-09-19T08:55:52.277366+0000","last_clean":"2024-09-19T08:55:52.277366+0000","last_became_active":"2024-09-19T08:54:31.425268+0000","last_became_peered":"2024-09-19T08:54:31.425268+0000","last_unstale":"2024-09-19T08:55:52.277366+0000","last_undegraded":"2024-09-19T08:55:52.277366+0000","last_fullsized":"2024-09-19T08:55:52.277366+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:09.404947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.283086+0000","last_change":"2024-09-19T08:54:31.428372+0000","last_active":"2024-09-19T08:55:52.283086+0000","last_peered":"2024-09-19T08:55:52.283086+0000","last_clean":"2024-09-19T08:55:52.283086+0000","last_became_active":"2024-09-19T08:54:31.428064+0000","last_became_peered":"2024-09-19T08:54:31.428064+0000","last_unstale":"2024-09-19T08:55:52.283086+0000","last_undegraded":"2024-09-19T08:55:52.283086+0000","last_fullsized":"2024-09-19T08:55:52.283086+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:40.444117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.271059+0000","last_change":"2024-09-19T08:54:31.424365+0000","last_active":"2024-09-19T08:55:52.271059+0000","last_peered":"2024-09-19T08:55:52.271059+0000","last_clean":"2024-09-19T08:55:52.271059+0000","last_became_active":"2024-09-19T08:54:31.424044+0000","last_became_peered":"2024-09-19T08:54:31.424044+0000","last_unstale":"2024-09-19T08:55:52.271059+0000","last_undegraded":"2024-09-19T08:55:52.271059+0000","last_fullsized":"2024-09-19T08:55:52.271059+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:16.435389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.278276+0000","last_change":"2024-09-19T08:54:31.437238+0000","last_active":"2024-09-19T08:55:52.278276+0000","last_peered":"2024-09-19T08:55:52.278276+0000","last_clean":"2024-09-19T08:55:52.278276+0000","last_became_active":"2024-09-19T08:54:31.436867+0000","last_became_peered":"2024-09-19T08:54:31.436867+0000","last_unstale":"2024-09-19T08:55:52.278276+0000","last_undegraded":"2024-09-19T08:55:52.278276+0000","last_fullsized":"2024-09-19T08:55:52.278276+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:59.839081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277741+0000","last_change":"2024-09-19T08:54:31.438654+0000","last_active":"2024-09-19T08:55:52.277741+0000","last_peered":"2024-09-19T08:55:52.277741+0000","last_clean":"2024-09-19T08:55:52.277741+0000","last_became_active":"2024-09-19T08:54:31.438342+0000","last_became_peered":"2024-09-19T08:54:31.438342+0000","last_unstale":"2024-09-19T08:55:52.277741+0000","last_undegraded":"2024-09-19T08:55:52.277741+0000","last_fullsized":"2024-09-19T08:55:52.277741+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:55.190605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.271267+0000","last_change":"2024-09-19T08:54:31.431100+0000","last_active":"2024-09-19T08:55:52.271267+0000","last_peered":"2024-09-19T08:55:52.271267+0000","last_clean":"2024-09-19T08:55:52.271267+0000","last_became_active":"2024-09-19T08:54:31.430749+0000","last_became_peered":"2024-09-19T08:54:31.430749+0000","last_unstale":"2024-09-19T08:55:52.271267+0000","last_undegraded":"2024-09-19T08:55:52.271267+0000","last_fullsized":"2024-09-19T08:55:52.271267+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:50.597610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.261809+0000","last_change":"2024-09-19T08:54:31.427454+0000","last_active":"2024-09-19T08:55:52.261809+0000","last_peered":"2024-09-19T08:55:52.261809+0000","last_clean":"2024-09-19T08:55:52.261809+0000","last_became_active":"2024-09-19T08:54:31.427098+0000","last_became_peered":"2024-09-19T08:54:31.427098+0000","last_unstale":"2024-09-19T08:55:52.261809+0000","last_undegraded":"2024-09-19T08:55:52.261809+0000","last_fullsized":"2024-09-19T08:55:52.261809+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:01.042626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.275970+0000","last_change":"2024-09-19T08:54:31.433887+0000","last_active":"2024-09-19T08:55:52.275970+0000","last_peered":"2024-09-19T08:55:52.275970+0000","last_clean":"2024-09-19T08:55:52.275970+0000","last_became_active":"2024-09-19T08:54:31.433528+0000","last_became_peered":"2024-09-19T08:54:31.433528+0000","last_unstale":"2024-09-19T08:55:52.275970+0000","last_undegraded":"2024-09-19T08:55:52.275970+0000","last_fullsized":"2024-09-19T08:55:52.275970+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:37.291226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.266435+0000","last_change":"2024-09-19T08:54:31.436976+0000","last_active":"2024-09-19T08:55:52.266435+0000","last_peered":"2024-09-19T08:55:52.266435+0000","last_clean":"2024-09-19T08:55:52.266435+0000","last_became_active":"2024-09-19T08:54:31.436646+0000","last_became_peered":"2024-09-19T08:54:31.436646+0000","last_unstale":"2024-09-19T08:55:52.266435+0000","last_undegraded":"2024-09-19T08:55:52.266435+0000","last_fullsized":"2024-09-19T08:55:52.266435+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:19.755556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.278449+0000","last_change":"2024-09-19T08:54:31.438922+0000","last_active":"2024-09-19T08:55:52.278449+0000","last_peered":"2024-09-19T08:55:52.278449+0000","last_clean":"2024-09-19T08:55:52.278449+0000","last_became_active":"2024-09-19T08:54:31.438593+0000","last_became_peered":"2024-09-19T08:54:31.438593+0000","last_unstale":"2024-09-19T08:55:52.278449+0000","last_undegraded":"2024-09-19T08:55:52.278449+0000","last_fullsized":"2024-09-19T08:55:52.278449+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:07.347900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.262522+0000","last_change":"2024-09-19T08:54:31.431659+0000","last_active":"2024-09-19T08:55:52.262522+0000","last_peered":"2024-09-19T08:55:52.262522+0000","last_clean":"2024-09-19T08:55:52.262522+0000","last_became_active":"2024-09-19T08:54:31.431359+0000","last_became_peered":"2024-09-19T08:54:31.431359+0000","last_unstale":"2024-09-19T08:55:52.262522+0000","last_undegraded":"2024-09-19T08:55:52.262522+0000","last_fullsized":"2024-09-19T08:55:52.262522+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:02.421286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.278570+0000","last_change":"2024-09-19T08:54:31.432185+0000","last_active":"2024-09-19T08:55:52.278570+0000","last_peered":"2024-09-19T08:55:52.278570+0000","last_clean":"2024-09-19T08:55:52.278570+0000","last_became_active":"2024-09-19T08:54:31.431418+0000","last_became_peered":"2024-09-19T08:54:31.431418+0000","last_unstale":"2024-09-19T08:55:52.278570+0000","last_undegraded":"2024-09-19T08:55:52.278570+0000","last_fullsized":"2024-09-19T08:55:52.278570+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:45.347487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.256343+0000","last_change":"2024-09-19T08:54:31.433742+0000","last_active":"2024-09-19T08:55:52.256343+0000","last_peered":"2024-09-19T08:55:52.256343+0000","last_clean":"2024-09-19T08:55:52.256343+0000","last_became_active":"2024-09-19T08:54:31.433455+0000","last_became_peered":"2024-09-19T08:54:31.433455+0000","last_unstale":"2024-09-19T08:55:52.256343+0000","last_undegraded":"2024-09-19T08:55:52.256343+0000","last_fullsized":"2024-09-19T08:55:52.256343+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:38.803705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.271146+0000","last_change":"2024-09-19T08:54:31.432954+0000","last_active":"2024-09-19T08:55:52.271146+0000","last_peered":"2024-09-19T08:55:52.271146+0000","last_clean":"2024-09-19T08:55:52.271146+0000","last_became_active":"2024-09-19T08:54:31.432574+0000","last_became_peered":"2024-09-19T08:54:31.432574+0000","last_unstale":"2024-09-19T08:55:52.271146+0000","last_undegraded":"2024-09-19T08:55:52.271146+0000","last_fullsized":"2024-09-19T08:55:52.271146+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:30.457191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.274173+0000","last_change":"2024-09-19T08:54:31.435544+0000","last_active":"2024-09-19T08:55:52.274173+0000","last_peered":"2024-09-19T08:55:52.274173+0000","last_clean":"2024-09-19T08:55:52.274173+0000","last_became_active":"2024-09-19T08:54:31.435195+0000","last_became_peered":"2024-09-19T08:54:31.435195+0000","last_unstale":"2024-09-19T08:55:52.274173+0000","last_undegraded":"2024-09-19T08:55:52.274173+0000","last_fullsized":"2024-09-19T08:55:52.274173+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:54.240654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.266764+0000","last_change":"2024-09-19T08:54:31.428403+0000","last_active":"2024-09-19T08:55:52.266764+0000","last_peered":"2024-09-19T08:55:52.266764+0000","last_clean":"2024-09-19T08:55:52.266764+0000","last_became_active":"2024-09-19T08:54:31.428110+0000","last_became_peered":"2024-09-19T08:54:31.428110+0000","last_unstale":"2024-09-19T08:55:52.266764+0000","last_undegraded":"2024-09-19T08:55:52.266764+0000","last_fullsized":"2024-09-19T08:55:52.266764+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:05.593073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.269495+0000","last_change":"2024-09-19T08:54:31.427291+0000","last_active":"2024-09-19T08:55:52.269495+0000","last_peered":"2024-09-19T08:55:52.269495+0000","last_clean":"2024-09-19T08:55:52.269495+0000","last_became_active":"2024-09-19T08:54:31.427011+0000","last_became_peered":"2024-09-19T08:54:31.427011+0000","last_unstale":"2024-09-19T08:55:52.269495+0000","last_undegraded":"2024-09-19T08:55:52.269495+0000","last_fullsized":"2024-09-19T08:55:52.269495+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:54.338526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.254032+0000","last_change":"2024-09-19T08:54:31.429309+0000","last_active":"2024-09-19T08:55:52.254032+0000","last_peered":"2024-09-19T08:55:52.254032+0000","last_clean":"2024-09-19T08:55:52.254032+0000","last_became_active":"2024-09-19T08:54:31.428381+0000","last_became_peered":"2024-09-19T08:54:31.428381+0000","last_unstale":"2024-09-19T08:55:52.254032+0000","last_undegraded":"2024-09-19T08:55:52.254032+0000","last_fullsized":"2024-09-19T08:55:52.254032+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:22:33.920114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.273963+0000","last_change":"2024-09-19T08:54:53.336591+0000","last_active":"2024-09-19T08:55:52.273963+0000","last_peered":"2024-09-19T08:55:52.273963+0000","last_clean":"2024-09-19T08:55:52.273963+0000","last_became_active":"2024-09-19T08:54:53.336222+0000","last_became_peered":"2024-09-19T08:54:53.336222+0000","last_unstale":"2024-09-19T08:55:52.273963+0000","last_undegraded":"2024-09-19T08:55:52.273963+0000","last_fullsized":"2024-09-19T08:55:52.273963+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:59.019419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277017+0000","last_change":"2024-09-19T08:54:53.335149+0000","last_active":"2024-09-19T08:55:52.277017+0000","last_peered":"2024-09-19T08:55:52.277017+0000","last_clean":"2024-09-19T08:55:52.277017+0000","last_became_active":"2024-09-19T08:54:53.334766+0000","last_became_peered":"2024-09-19T08:54:53.334766+0000","last_unstale":"2024-09-19T08:55:52.277017+0000","last_undegraded":"2024-09-19T08:55:52.277017+0000","last_fullsized":"2024-09-19T08:55:52.277017+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:36.469044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277210+0000","last_change":"2024-09-19T08:54:31.427608+0000","last_active":"2024-09-19T08:55:52.277210+0000","last_peered":"2024-09-19T08:55:52.277210+0000","last_clean":"2024-09-19T08:55:52.277210+0000","last_became_active":"2024-09-19T08:54:31.427294+0000","last_became_peered":"2024-09-19T08:54:31.427294+0000","last_unstale":"2024-09-19T08:55:52.277210+0000","last_undegraded":"2024-09-19T08:55:52.277210+0000","last_fullsized":"2024-09-19T08:55:52.277210+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:41.356609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331158+0000","last_change":"2024-09-19T08:54:29.416204+0000","last_active":"2024-09-19T08:54:53.331158+0000","last_peered":"2024-09-19T08:54:53.331158+0000","last_clean":"2024-09-19T08:54:53.331158+0000","last_became_active":"2024-09-19T08:54:29.415872+0000","last_became_peered":"2024-09-19T08:54:29.415872+0000","last_unstale":"2024-09-19T08:54:53.331158+0000","last_undegraded":"2024-09-19T08:54:53.331158+0000","last_fullsized":"2024-09-19T08:54:53.331158+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:13.844147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.283160+0000","last_change":"2024-09-19T08:54:31.432137+0000","last_active":"2024-09-19T08:55:52.283160+0000","last_peered":"2024-09-19T08:55:52.283160+0000","last_clean":"2024-09-19T08:55:52.283160+0000","last_became_active":"2024-09-19T08:54:31.431761+0000","last_became_peered":"2024-09-19T08:54:31.431761+0000","last_unstale":"2024-09-19T08:55:52.283160+0000","last_undegraded":"2024-09-19T08:55:52.283160+0000","last_fullsized":"2024-09-19T08:55:52.283160+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:05.008431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327676+0000","last_change":"2024-09-19T08:54:29.413221+0000","last_active":"2024-09-19T08:54:53.327676+0000","last_peered":"2024-09-19T08:54:53.327676+0000","last_clean":"2024-09-19T08:54:53.327676+0000","last_became_active":"2024-09-19T08:54:29.412829+0000","last_became_peered":"2024-09-19T08:54:29.412829+0000","last_unstale":"2024-09-19T08:54:53.327676+0000","last_undegraded":"2024-09-19T08:54:53.327676+0000","last_fullsized":"2024-09-19T08:54:53.327676+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:07.224136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.326805+0000","last_change":"2024-09-19T08:54:29.410221+0000","last_active":"2024-09-19T08:54:53.326805+0000","last_peered":"2024-09-19T08:54:53.326805+0000","last_clean":"2024-09-19T08:54:53.326805+0000","last_became_active":"2024-09-19T08:54:29.409951+0000","last_became_peered":"2024-09-19T08:54:29.409951+0000","last_unstale":"2024-09-19T08:54:53.326805+0000","last_undegraded":"2024-09-19T08:54:53.326805+0000","last_fullsized":"2024-09-19T08:54:53.326805+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:58.350932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.259466+0000","last_change":"2024-09-19T08:54:31.429979+0000","last_active":"2024-09-19T08:55:52.259466+0000","last_peered":"2024-09-19T08:55:52.259466+0000","last_clean":"2024-09-19T08:55:52.259466+0000","last_became_active":"2024-09-19T08:54:31.429661+0000","last_became_peered":"2024-09-19T08:54:31.429661+0000","last_unstale":"2024-09-19T08:55:52.259466+0000","last_undegraded":"2024-09-19T08:55:52.259466+0000","last_fullsized":"2024-09-19T08:55:52.259466+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:27:40.603490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331299+0000","last_change":"2024-09-19T08:54:29.415769+0000","last_active":"2024-09-19T08:54:53.331299+0000","last_peered":"2024-09-19T08:54:53.331299+0000","last_clean":"2024-09-19T08:54:53.331299+0000","last_became_active":"2024-09-19T08:54:29.415245+0000","last_became_peered":"2024-09-19T08:54:29.415245+0000","last_unstale":"2024-09-19T08:54:53.331299+0000","last_undegraded":"2024-09-19T08:54:53.331299+0000","last_fullsized":"2024-09-19T08:54:53.331299+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:15.487945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.270548+0000","last_change":"2024-09-19T08:54:31.427126+0000","last_active":"2024-09-19T08:55:52.270548+0000","last_peered":"2024-09-19T08:55:52.270548+0000","last_clean":"2024-09-19T08:55:52.270548+0000","last_became_active":"2024-09-19T08:54:31.426816+0000","last_became_peered":"2024-09-19T08:54:31.426816+0000","last_unstale":"2024-09-19T08:55:52.270548+0000","last_undegraded":"2024-09-19T08:55:52.270548+0000","last_fullsized":"2024-09-19T08:55:52.270548+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:38.039428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327848+0000","last_change":"2024-09-19T08:54:29.411354+0000","last_active":"2024-09-19T08:54:53.327848+0000","last_peered":"2024-09-19T08:54:53.327848+0000","last_clean":"2024-09-19T08:54:53.327848+0000","last_became_active":"2024-09-19T08:54:29.410990+0000","last_became_peered":"2024-09-19T08:54:29.410990+0000","last_unstale":"2024-09-19T08:54:53.327848+0000","last_undegraded":"2024-09-19T08:54:53.327848+0000","last_fullsized":"2024-09-19T08:54:53.327848+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:29.338169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277112+0000","last_change":"2024-09-19T08:54:31.426243+0000","last_active":"2024-09-19T08:55:52.277112+0000","last_peered":"2024-09-19T08:55:52.277112+0000","last_clean":"2024-09-19T08:55:52.277112+0000","last_became_active":"2024-09-19T08:54:31.425895+0000","last_became_peered":"2024-09-19T08:54:31.425895+0000","last_unstale":"2024-09-19T08:55:52.277112+0000","last_undegraded":"2024-09-19T08:55:52.277112+0000","last_fullsized":"2024-09-19T08:55:52.277112+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:13.562780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331102+0000","last_change":"2024-09-19T08:54:29.416646+0000","last_active":"2024-09-19T08:54:53.331102+0000","last_peered":"2024-09-19T08:54:53.331102+0000","last_clean":"2024-09-19T08:54:53.331102+0000","last_became_active":"2024-09-19T08:54:29.416260+0000","last_became_peered":"2024-09-19T08:54:29.416260+0000","last_unstale":"2024-09-19T08:54:53.331102+0000","last_undegraded":"2024-09-19T08:54:53.331102+0000","last_fullsized":"2024-09-19T08:54:53.331102+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:42:17.467035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.276583+0000","last_change":"2024-09-19T08:54:31.435538+0000","last_active":"2024-09-19T08:55:52.276583+0000","last_peered":"2024-09-19T08:55:52.276583+0000","last_clean":"2024-09-19T08:55:52.276583+0000","last_became_active":"2024-09-19T08:54:31.435185+0000","last_became_peered":"2024-09-19T08:54:31.435185+0000","last_unstale":"2024-09-19T08:55:52.276583+0000","last_undegraded":"2024-09-19T08:55:52.276583+0000","last_fullsized":"2024-09-19T08:55:52.276583+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:06.940123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.332501+0000","last_change":"2024-09-19T08:54:29.675914+0000","last_active":"2024-09-19T08:54:53.332501+0000","last_peered":"2024-09-19T08:54:53.332501+0000","last_clean":"2024-09-19T08:54:53.332501+0000","last_became_active":"2024-09-19T08:54:29.675482+0000","last_became_peered":"2024-09-19T08:54:29.675482+0000","last_unstale":"2024-09-19T08:54:53.332501+0000","last_undegraded":"2024-09-19T08:54:53.332501+0000","last_fullsized":"2024-09-19T08:54:53.332501+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:58.893008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.273901+0000","last_change":"2024-09-19T08:54:31.432628+0000","last_active":"2024-09-19T08:55:52.273901+0000","last_peered":"2024-09-19T08:55:52.273901+0000","last_clean":"2024-09-19T08:55:52.273901+0000","last_became_active":"2024-09-19T08:54:31.430640+0000","last_became_peered":"2024-09-19T08:54:31.430640+0000","last_unstale":"2024-09-19T08:55:52.273901+0000","last_undegraded":"2024-09-19T08:55:52.273901+0000","last_fullsized":"2024-09-19T08:55:52.273901+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:07.793089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'31","reported_seq":260,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:56:16.651077+0000","last_change":"2024-09-19T08:54:29.414619+0000","last_active":"2024-09-19T08:56:16.651077+0000","last_peered":"2024-09-19T08:56:16.651077+0000","last_clean":"2024-09-19T08:56:16.651077+0000","last_became_active":"2024-09-19T08:54:29.414295+0000","last_became_peered":"2024-09-19T08:54:29.414295+0000","last_unstale":"2024-09-19T08:56:16.651077+0000","last_undegraded":"2024-09-19T08:56:16.651077+0000","last_fullsized":"2024-09-19T08:56:16.651077+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:23.782684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67129,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":207,"num_read_kb":169,"num_write":31,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.276986+0000","last_change":"2024-09-19T08:54:31.425432+0000","last_active":"2024-09-19T08:55:52.276986+0000","last_peered":"2024-09-19T08:55:52.276986+0000","last_clean":"2024-09-19T08:55:52.276986+0000","last_became_active":"2024-09-19T08:54:31.425086+0000","last_became_peered":"2024-09-19T08:54:31.425086+0000","last_unstale":"2024-09-19T08:55:52.276986+0000","last_undegraded":"2024-09-19T08:55:52.276986+0000","last_fullsized":"2024-09-19T08:55:52.276986+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:56.572339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330371+0000","last_change":"2024-09-19T08:54:29.415055+0000","last_active":"2024-09-19T08:54:53.330371+0000","last_peered":"2024-09-19T08:54:53.330371+0000","last_clean":"2024-09-19T08:54:53.330371+0000","last_became_active":"2024-09-19T08:54:29.414573+0000","last_became_peered":"2024-09-19T08:54:29.414573+0000","last_unstale":"2024-09-19T08:54:53.330371+0000","last_undegraded":"2024-09-19T08:54:53.330371+0000","last_fullsized":"2024-09-19T08:54:53.330371+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:13.013714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.260081+0000","last_change":"2024-09-19T08:54:31.436905+0000","last_active":"2024-09-19T08:55:52.260081+0000","last_peered":"2024-09-19T08:55:52.260081+0000","last_clean":"2024-09-19T08:55:52.260081+0000","last_became_active":"2024-09-19T08:54:31.436571+0000","last_became_peered":"2024-09-19T08:54:31.436571+0000","last_unstale":"2024-09-19T08:55:52.260081+0000","last_undegraded":"2024-09-19T08:55:52.260081+0000","last_fullsized":"2024-09-19T08:55:52.260081+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:55.294255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330834+0000","last_change":"2024-09-19T08:54:29.417958+0000","last_active":"2024-09-19T08:54:53.330834+0000","last_peered":"2024-09-19T08:54:53.330834+0000","last_clean":"2024-09-19T08:54:53.330834+0000","last_became_active":"2024-09-19T08:54:29.417570+0000","last_became_peered":"2024-09-19T08:54:29.417570+0000","last_unstale":"2024-09-19T08:54:53.330834+0000","last_undegraded":"2024-09-19T08:54:53.330834+0000","last_fullsized":"2024-09-19T08:54:53.330834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:25.557217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.279834+0000","last_change":"2024-09-19T08:54:31.433019+0000","last_active":"2024-09-19T08:55:52.279834+0000","last_peered":"2024-09-19T08:55:52.279834+0000","last_clean":"2024-09-19T08:55:52.279834+0000","last_became_active":"2024-09-19T08:54:31.431265+0000","last_became_peered":"2024-09-19T08:54:31.431265+0000","last_unstale":"2024-09-19T08:55:52.279834+0000","last_undegraded":"2024-09-19T08:55:52.279834+0000","last_fullsized":"2024-09-19T08:55:52.279834+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:36.481863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.979100+0000","last_change":"2024-09-19T08:54:29.414236+0000","last_active":"2024-09-19T08:54:53.979100+0000","last_peered":"2024-09-19T08:54:53.979100+0000","last_clean":"2024-09-19T08:54:53.979100+0000","last_became_active":"2024-09-19T08:54:29.413878+0000","last_became_peered":"2024-09-19T08:54:29.413878+0000","last_unstale":"2024-09-19T08:54:53.979100+0000","last_undegraded":"2024-09-19T08:54:53.979100+0000","last_fullsized":"2024-09-19T08:54:53.979100+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:11.222362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.279321+0000","last_change":"2024-09-19T08:54:31.439512+0000","last_active":"2024-09-19T08:55:52.279321+0000","last_peered":"2024-09-19T08:55:52.279321+0000","last_clean":"2024-09-19T08:55:52.279321+0000","last_became_active":"2024-09-19T08:54:31.438767+0000","last_became_peered":"2024-09-19T08:54:31.438767+0000","last_unstale":"2024-09-19T08:55:52.279321+0000","last_undegraded":"2024-09-19T08:55:52.279321+0000","last_fullsized":"2024-09-19T08:55:52.279321+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:31.784577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330687+0000","last_change":"2024-09-19T08:54:29.675768+0000","last_active":"2024-09-19T08:54:53.330687+0000","last_peered":"2024-09-19T08:54:53.330687+0000","last_clean":"2024-09-19T08:54:53.330687+0000","last_became_active":"2024-09-19T08:54:29.675376+0000","last_became_peered":"2024-09-19T08:54:29.675376+0000","last_unstale":"2024-09-19T08:54:53.330687+0000","last_undegraded":"2024-09-19T08:54:53.330687+0000","last_fullsized":"2024-09-19T08:54:53.330687+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:10.281126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.282865+0000","last_change":"2024-09-19T08:54:31.435904+0000","last_active":"2024-09-19T08:55:52.282865+0000","last_peered":"2024-09-19T08:55:52.282865+0000","last_clean":"2024-09-19T08:55:52.282865+0000","last_became_active":"2024-09-19T08:54:31.435396+0000","last_became_peered":"2024-09-19T08:54:31.435396+0000","last_unstale":"2024-09-19T08:55:52.282865+0000","last_undegraded":"2024-09-19T08:55:52.282865+0000","last_fullsized":"2024-09-19T08:55:52.282865+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:41.567463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331746+0000","last_change":"2024-09-19T08:54:29.410221+0000","last_active":"2024-09-19T08:54:53.331746+0000","last_peered":"2024-09-19T08:54:53.331746+0000","last_clean":"2024-09-19T08:54:53.331746+0000","last_became_active":"2024-09-19T08:54:29.409856+0000","last_became_peered":"2024-09-19T08:54:29.409856+0000","last_unstale":"2024-09-19T08:54:53.331746+0000","last_undegraded":"2024-09-19T08:54:53.331746+0000","last_fullsized":"2024-09-19T08:54:53.331746+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:46.095816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.270387+0000","last_change":"2024-09-19T08:54:31.437854+0000","last_active":"2024-09-19T08:55:52.270387+0000","last_peered":"2024-09-19T08:55:52.270387+0000","last_clean":"2024-09-19T08:55:52.270387+0000","last_became_active":"2024-09-19T08:54:31.437491+0000","last_became_peered":"2024-09-19T08:54:31.437491+0000","last_unstale":"2024-09-19T08:55:52.270387+0000","last_undegraded":"2024-09-19T08:55:52.270387+0000","last_fullsized":"2024-09-19T08:55:52.270387+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:22.532429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.983440+0000","last_change":"2024-09-19T08:54:53.983440+0000","last_active":"2024-09-19T08:54:53.983440+0000","last_peered":"2024-09-19T08:54:53.983440+0000","last_clean":"2024-09-19T08:54:53.983440+0000","last_became_active":"2024-09-19T08:54:53.980971+0000","last_became_peered":"2024-09-19T08:54:53.980971+0000","last_unstale":"2024-09-19T08:54:53.983440+0000","last_undegraded":"2024-09-19T08:54:53.983440+0000","last_fullsized":"2024-09-19T08:54:53.983440+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:33.070904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.278128+0000","last_change":"2024-09-19T08:54:31.429376+0000","last_active":"2024-09-19T08:55:52.278128+0000","last_peered":"2024-09-19T08:55:52.278128+0000","last_clean":"2024-09-19T08:55:52.278128+0000","last_became_active":"2024-09-19T08:54:31.429006+0000","last_became_peered":"2024-09-19T08:54:31.429006+0000","last_unstale":"2024-09-19T08:55:52.278128+0000","last_undegraded":"2024-09-19T08:55:52.278128+0000","last_fullsized":"2024-09-19T08:55:52.278128+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:26.399838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.332608+0000","last_change":"2024-09-19T08:54:29.414307+0000","last_active":"2024-09-19T08:54:53.332608+0000","last_peered":"2024-09-19T08:54:53.332608+0000","last_clean":"2024-09-19T08:54:53.332608+0000","last_became_active":"2024-09-19T08:54:29.413823+0000","last_became_peered":"2024-09-19T08:54:29.413823+0000","last_unstale":"2024-09-19T08:54:53.332608+0000","last_undegraded":"2024-09-19T08:54:53.332608+0000","last_fullsized":"2024-09-19T08:54:53.332608+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:25.484645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.279004+0000","last_change":"2024-09-19T08:54:31.437789+0000","last_active":"2024-09-19T08:55:52.279004+0000","last_peered":"2024-09-19T08:55:52.279004+0000","last_clean":"2024-09-19T08:55:52.279004+0000","last_became_active":"2024-09-19T08:54:31.435488+0000","last_became_peered":"2024-09-19T08:54:31.435488+0000","last_unstale":"2024-09-19T08:55:52.279004+0000","last_undegraded":"2024-09-19T08:55:52.279004+0000","last_fullsized":"2024-09-19T08:55:52.279004+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:19.332440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.333662+0000","last_change":"2024-09-19T08:54:53.333120+0000","last_active":"2024-09-19T08:54:53.333662+0000","last_peered":"2024-09-19T08:54:53.333662+0000","last_clean":"2024-09-19T08:54:53.333662+0000","last_became_active":"2024-09-19T08:54:53.332711+0000","last_became_peered":"2024-09-19T08:54:53.332711+0000","last_unstale":"2024-09-19T08:54:53.333662+0000","last_undegraded":"2024-09-19T08:54:53.333662+0000","last_fullsized":"2024-09-19T08:54:53.333662+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:18.359002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.279878+0000","last_change":"2024-09-19T08:54:31.434564+0000","last_active":"2024-09-19T08:55:52.279878+0000","last_peered":"2024-09-19T08:55:52.279878+0000","last_clean":"2024-09-19T08:55:52.279878+0000","last_became_active":"2024-09-19T08:54:31.434231+0000","last_became_peered":"2024-09-19T08:54:31.434231+0000","last_unstale":"2024-09-19T08:55:52.279878+0000","last_undegraded":"2024-09-19T08:55:52.279878+0000","last_fullsized":"2024-09-19T08:55:52.279878+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:31.316400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":335,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331130+0000","last_change":"2024-09-19T08:53:21.357560+0000","last_active":"2024-09-19T08:54:53.331130+0000","last_peered":"2024-09-19T08:54:53.331130+0000","last_clean":"2024-09-19T08:54:53.331130+0000","last_became_active":"2024-09-19T08:53:21.357122+0000","last_became_peered":"2024-09-19T08:53:21.357122+0000","last_unstale":"2024-09-19T08:54:53.331130+0000","last_undegraded":"2024-09-19T08:54:53.331130+0000","last_fullsized":"2024-09-19T08:54:53.331130+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:05.231370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:05.231370+0000","last_clean_scrub_stamp":"2024-09-19T08:50:05.231370+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:47.867682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.979104+0000","last_change":"2024-09-19T08:54:29.412240+0000","last_active":"2024-09-19T08:54:53.979104+0000","last_peered":"2024-09-19T08:54:53.979104+0000","last_clean":"2024-09-19T08:54:53.979104+0000","last_became_active":"2024-09-19T08:54:29.411908+0000","last_became_peered":"2024-09-19T08:54:29.411908+0000","last_unstale":"2024-09-19T08:54:53.979104+0000","last_undegraded":"2024-09-19T08:54:53.979104+0000","last_fullsized":"2024-09-19T08:54:53.979104+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:37.189373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277537+0000","last_change":"2024-09-19T08:54:31.432956+0000","last_active":"2024-09-19T08:55:52.277537+0000","last_peered":"2024-09-19T08:55:52.277537+0000","last_clean":"2024-09-19T08:55:52.277537+0000","last_became_active":"2024-09-19T08:54:31.432639+0000","last_became_peered":"2024-09-19T08:54:31.432639+0000","last_unstale":"2024-09-19T08:55:52.277537+0000","last_undegraded":"2024-09-19T08:55:52.277537+0000","last_fullsized":"2024-09-19T08:55:52.277537+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:58.302624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331178+0000","last_change":"2024-09-19T08:54:29.414214+0000","last_active":"2024-09-19T08:54:53.331178+0000","last_peered":"2024-09-19T08:54:53.331178+0000","last_clean":"2024-09-19T08:54:53.331178+0000","last_became_active":"2024-09-19T08:54:29.413853+0000","last_became_peered":"2024-09-19T08:54:29.413853+0000","last_unstale":"2024-09-19T08:54:53.331178+0000","last_undegraded":"2024-09-19T08:54:53.331178+0000","last_fullsized":"2024-09-19T08:54:53.331178+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:28:29.119856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.266896+0000","last_change":"2024-09-19T08:54:31.424643+0000","last_active":"2024-09-19T08:55:52.266896+0000","last_peered":"2024-09-19T08:55:52.266896+0000","last_clean":"2024-09-19T08:55:52.266896+0000","last_became_active":"2024-09-19T08:54:31.424363+0000","last_became_peered":"2024-09-19T08:54:31.424363+0000","last_unstale":"2024-09-19T08:55:52.266896+0000","last_undegraded":"2024-09-19T08:55:52.266896+0000","last_fullsized":"2024-09-19T08:55:52.266896+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:37.529952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.326916+0000","last_change":"2024-09-19T08:54:29.675742+0000","last_active":"2024-09-19T08:54:53.326916+0000","last_peered":"2024-09-19T08:54:53.326916+0000","last_clean":"2024-09-19T08:54:53.326916+0000","last_became_active":"2024-09-19T08:54:29.675347+0000","last_became_peered":"2024-09-19T08:54:29.675347+0000","last_unstale":"2024-09-19T08:54:53.326916+0000","last_undegraded":"2024-09-19T08:54:53.326916+0000","last_fullsized":"2024-09-19T08:54:53.326916+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:00.925390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.283427+0000","last_change":"2024-09-19T08:54:31.433887+0000","last_active":"2024-09-19T08:55:52.283427+0000","last_peered":"2024-09-19T08:55:52.283427+0000","last_clean":"2024-09-19T08:55:52.283427+0000","last_became_active":"2024-09-19T08:54:31.433331+0000","last_became_peered":"2024-09-19T08:54:31.433331+0000","last_unstale":"2024-09-19T08:55:52.283427+0000","last_undegraded":"2024-09-19T08:55:52.283427+0000","last_fullsized":"2024-09-19T08:55:52.283427+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:49.875061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331491+0000","last_change":"2024-09-19T08:54:29.417410+0000","last_active":"2024-09-19T08:54:53.331491+0000","last_peered":"2024-09-19T08:54:53.331491+0000","last_clean":"2024-09-19T08:54:53.331491+0000","last_became_active":"2024-09-19T08:54:29.417018+0000","last_became_peered":"2024-09-19T08:54:29.417018+0000","last_unstale":"2024-09-19T08:54:53.331491+0000","last_undegraded":"2024-09-19T08:54:53.331491+0000","last_fullsized":"2024-09-19T08:54:53.331491+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:53.669027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.280825+0000","last_change":"2024-09-19T08:54:31.431313+0000","last_active":"2024-09-19T08:55:52.280825+0000","last_peered":"2024-09-19T08:55:52.280825+0000","last_clean":"2024-09-19T08:55:52.280825+0000","last_became_active":"2024-09-19T08:54:31.429427+0000","last_became_peered":"2024-09-19T08:54:31.429427+0000","last_unstale":"2024-09-19T08:55:52.280825+0000","last_undegraded":"2024-09-19T08:55:52.280825+0000","last_fullsized":"2024-09-19T08:55:52.280825+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:55.106769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330517+0000","last_change":"2024-09-19T08:54:29.675722+0000","last_active":"2024-09-19T08:54:53.330517+0000","last_peered":"2024-09-19T08:54:53.330517+0000","last_clean":"2024-09-19T08:54:53.330517+0000","last_became_active":"2024-09-19T08:54:29.675397+0000","last_became_peered":"2024-09-19T08:54:29.675397+0000","last_unstale":"2024-09-19T08:54:53.330517+0000","last_undegraded":"2024-09-19T08:54:53.330517+0000","last_fullsized":"2024-09-19T08:54:53.330517+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:49.574947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.283206+0000","last_change":"2024-09-19T08:54:31.431106+0000","last_active":"2024-09-19T08:55:52.283206+0000","last_peered":"2024-09-19T08:55:52.283206+0000","last_clean":"2024-09-19T08:55:52.283206+0000","last_became_active":"2024-09-19T08:54:31.430745+0000","last_became_peered":"2024-09-19T08:54:31.430745+0000","last_unstale":"2024-09-19T08:55:52.283206+0000","last_undegraded":"2024-09-19T08:55:52.283206+0000","last_fullsized":"2024-09-19T08:55:52.283206+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:22.714106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331431+0000","last_change":"2024-09-19T08:54:29.675985+0000","last_active":"2024-09-19T08:54:53.331431+0000","last_peered":"2024-09-19T08:54:53.331431+0000","last_clean":"2024-09-19T08:54:53.331431+0000","last_became_active":"2024-09-19T08:54:29.675374+0000","last_became_peered":"2024-09-19T08:54:29.675374+0000","last_unstale":"2024-09-19T08:54:53.331431+0000","last_undegraded":"2024-09-19T08:54:53.331431+0000","last_fullsized":"2024-09-19T08:54:53.331431+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:06.664621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.260250+0000","last_change":"2024-09-19T08:54:31.423493+0000","last_active":"2024-09-19T08:55:52.260250+0000","last_peered":"2024-09-19T08:55:52.260250+0000","last_clean":"2024-09-19T08:55:52.260250+0000","last_became_active":"2024-09-19T08:54:31.422651+0000","last_became_peered":"2024-09-19T08:54:31.422651+0000","last_unstale":"2024-09-19T08:55:52.260250+0000","last_undegraded":"2024-09-19T08:55:52.260250+0000","last_fullsized":"2024-09-19T08:55:52.260250+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:51.863965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'11","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.443763+0000","last_change":"2024-09-19T08:54:29.408571+0000","last_active":"2024-09-19T08:55:52.443763+0000","last_peered":"2024-09-19T08:55:52.443763+0000","last_clean":"2024-09-19T08:55:52.443763+0000","last_became_active":"2024-09-19T08:54:29.408142+0000","last_became_peered":"2024-09-19T08:54:29.408142+0000","last_unstale":"2024-09-19T08:55:52.443763+0000","last_undegraded":"2024-09-19T08:55:52.443763+0000","last_fullsized":"2024-09-19T08:55:52.443763+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:34.578230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.262764+0000","last_change":"2024-09-19T08:54:31.435333+0000","last_active":"2024-09-19T08:55:52.262764+0000","last_peered":"2024-09-19T08:55:52.262764+0000","last_clean":"2024-09-19T08:55:52.262764+0000","last_became_active":"2024-09-19T08:54:31.435041+0000","last_became_peered":"2024-09-19T08:54:31.435041+0000","last_unstale":"2024-09-19T08:55:52.262764+0000","last_undegraded":"2024-09-19T08:55:52.262764+0000","last_fullsized":"2024-09-19T08:55:52.262764+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:40.972638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.979153+0000","last_change":"2024-09-19T08:54:29.554303+0000","last_active":"2024-09-19T08:54:53.979153+0000","last_peered":"2024-09-19T08:54:53.979153+0000","last_clean":"2024-09-19T08:54:53.979153+0000","last_became_active":"2024-09-19T08:54:29.553919+0000","last_became_peered":"2024-09-19T08:54:29.553919+0000","last_unstale":"2024-09-19T08:54:53.979153+0000","last_undegraded":"2024-09-19T08:54:53.979153+0000","last_fullsized":"2024-09-19T08:54:53.979153+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:25.103926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.279407+0000","last_change":"2024-09-19T08:54:53.333280+0000","last_active":"2024-09-19T08:55:52.279407+0000","last_peered":"2024-09-19T08:55:52.279407+0000","last_clean":"2024-09-19T08:55:52.279407+0000","last_became_active":"2024-09-19T08:54:53.332881+0000","last_became_peered":"2024-09-19T08:54:53.332881+0000","last_unstale":"2024-09-19T08:55:52.279407+0000","last_undegraded":"2024-09-19T08:55:52.279407+0000","last_fullsized":"2024-09-19T08:55:52.279407+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:55.880616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329946+0000","last_change":"2024-09-19T08:54:29.675665+0000","last_active":"2024-09-19T08:54:53.329946+0000","last_peered":"2024-09-19T08:54:53.329946+0000","last_clean":"2024-09-19T08:54:53.329946+0000","last_became_active":"2024-09-19T08:54:29.675367+0000","last_became_peered":"2024-09-19T08:54:29.675367+0000","last_unstale":"2024-09-19T08:54:53.329946+0000","last_undegraded":"2024-09-19T08:54:53.329946+0000","last_fullsized":"2024-09-19T08:54:53.329946+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:35.473243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.237269+0000","last_change":"2024-09-19T08:54:31.430837+0000","last_active":"2024-09-19T08:55:52.237269+0000","last_peered":"2024-09-19T08:55:52.237269+0000","last_clean":"2024-09-19T08:55:52.237269+0000","last_became_active":"2024-09-19T08:54:31.430465+0000","last_became_peered":"2024-09-19T08:54:31.430465+0000","last_unstale":"2024-09-19T08:55:52.237269+0000","last_undegraded":"2024-09-19T08:55:52.237269+0000","last_fullsized":"2024-09-19T08:55:52.237269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:50.524730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329067+0000","last_change":"2024-09-19T08:54:29.413803+0000","last_active":"2024-09-19T08:54:53.329067+0000","last_peered":"2024-09-19T08:54:53.329067+0000","last_clean":"2024-09-19T08:54:53.329067+0000","last_became_active":"2024-09-19T08:54:29.413400+0000","last_became_peered":"2024-09-19T08:54:29.413400+0000","last_unstale":"2024-09-19T08:54:53.329067+0000","last_undegraded":"2024-09-19T08:54:53.329067+0000","last_fullsized":"2024-09-19T08:54:53.329067+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:12.518454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.271551+0000","last_change":"2024-09-19T08:54:31.428451+0000","last_active":"2024-09-19T08:55:52.271551+0000","last_peered":"2024-09-19T08:55:52.271551+0000","last_clean":"2024-09-19T08:55:52.271551+0000","last_became_active":"2024-09-19T08:54:31.428134+0000","last_became_peered":"2024-09-19T08:54:31.428134+0000","last_unstale":"2024-09-19T08:55:52.271551+0000","last_undegraded":"2024-09-19T08:55:52.271551+0000","last_fullsized":"2024-09-19T08:55:52.271551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:08.260183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329914+0000","last_change":"2024-09-19T08:54:29.414399+0000","last_active":"2024-09-19T08:54:53.329914+0000","last_peered":"2024-09-19T08:54:53.329914+0000","last_clean":"2024-09-19T08:54:53.329914+0000","last_became_active":"2024-09-19T08:54:29.413080+0000","last_became_peered":"2024-09-19T08:54:29.413080+0000","last_unstale":"2024-09-19T08:54:53.329914+0000","last_undegraded":"2024-09-19T08:54:53.329914+0000","last_fullsized":"2024-09-19T08:54:53.329914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:27.308297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.282381+0000","last_change":"2024-09-19T08:54:31.434550+0000","last_active":"2024-09-19T08:55:52.282381+0000","last_peered":"2024-09-19T08:55:52.282381+0000","last_clean":"2024-09-19T08:55:52.282381+0000","last_became_active":"2024-09-19T08:54:31.434195+0000","last_became_peered":"2024-09-19T08:54:31.434195+0000","last_unstale":"2024-09-19T08:55:52.282381+0000","last_undegraded":"2024-09-19T08:55:52.282381+0000","last_fullsized":"2024-09-19T08:55:52.282381+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:04.807833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.338857+0000","last_change":"2024-09-19T08:54:53.338857+0000","last_active":"2024-09-19T08:54:53.338857+0000","last_peered":"2024-09-19T08:54:53.338857+0000","last_clean":"2024-09-19T08:54:53.338857+0000","last_became_active":"2024-09-19T08:54:53.334162+0000","last_became_peered":"2024-09-19T08:54:53.334162+0000","last_unstale":"2024-09-19T08:54:53.338857+0000","last_undegraded":"2024-09-19T08:54:53.338857+0000","last_fullsized":"2024-09-19T08:54:53.338857+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:38.858918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.280213+0000","last_change":"2024-09-19T08:54:31.441201+0000","last_active":"2024-09-19T08:55:52.280213+0000","last_peered":"2024-09-19T08:55:52.280213+0000","last_clean":"2024-09-19T08:55:52.280213+0000","last_became_active":"2024-09-19T08:54:31.440738+0000","last_became_peered":"2024-09-19T08:54:31.440738+0000","last_unstale":"2024-09-19T08:55:52.280213+0000","last_undegraded":"2024-09-19T08:55:52.280213+0000","last_fullsized":"2024-09-19T08:55:52.280213+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:39.118320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.284175+0000","last_change":"2024-09-19T08:54:31.435772+0000","last_active":"2024-09-19T08:55:52.284175+0000","last_peered":"2024-09-19T08:55:52.284175+0000","last_clean":"2024-09-19T08:55:52.284175+0000","last_became_active":"2024-09-19T08:54:31.435257+0000","last_became_peered":"2024-09-19T08:54:31.435257+0000","last_unstale":"2024-09-19T08:55:52.284175+0000","last_undegraded":"2024-09-19T08:55:52.284175+0000","last_fullsized":"2024-09-19T08:55:52.284175+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:44:12.219054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.341203+0000","last_change":"2024-09-19T08:54:53.341203+0000","last_active":"2024-09-19T08:54:53.341203+0000","last_peered":"2024-09-19T08:54:53.341203+0000","last_clean":"2024-09-19T08:54:53.341203+0000","last_became_active":"2024-09-19T08:54:53.336115+0000","last_became_peered":"2024-09-19T08:54:53.336115+0000","last_unstale":"2024-09-19T08:54:53.341203+0000","last_undegraded":"2024-09-19T08:54:53.341203+0000","last_fullsized":"2024-09-19T08:54:53.341203+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:31.532599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277536+0000","last_change":"2024-09-19T08:54:31.427103+0000","last_active":"2024-09-19T08:55:52.277536+0000","last_peered":"2024-09-19T08:55:52.277536+0000","last_clean":"2024-09-19T08:55:52.277536+0000","last_became_active":"2024-09-19T08:54:31.425958+0000","last_became_peered":"2024-09-19T08:54:31.425958+0000","last_unstale":"2024-09-19T08:55:52.277536+0000","last_undegraded":"2024-09-19T08:55:52.277536+0000","last_fullsized":"2024-09-19T08:55:52.277536+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:36.840940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331317+0000","last_change":"2024-09-19T08:54:29.415209+0000","last_active":"2024-09-19T08:54:53.331317+0000","last_peered":"2024-09-19T08:54:53.331317+0000","last_clean":"2024-09-19T08:54:53.331317+0000","last_became_active":"2024-09-19T08:54:29.414806+0000","last_became_peered":"2024-09-19T08:54:29.414806+0000","last_unstale":"2024-09-19T08:54:53.331317+0000","last_undegraded":"2024-09-19T08:54:53.331317+0000","last_fullsized":"2024-09-19T08:54:53.331317+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:47.764231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.271279+0000","last_change":"2024-09-19T08:54:31.434027+0000","last_active":"2024-09-19T08:55:52.271279+0000","last_peered":"2024-09-19T08:55:52.271279+0000","last_clean":"2024-09-19T08:55:52.271279+0000","last_became_active":"2024-09-19T08:54:31.433687+0000","last_became_peered":"2024-09-19T08:54:31.433687+0000","last_unstale":"2024-09-19T08:55:52.271279+0000","last_undegraded":"2024-09-19T08:55:52.271279+0000","last_fullsized":"2024-09-19T08:55:52.271279+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:56.462128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329231+0000","last_change":"2024-09-19T08:54:29.675502+0000","last_active":"2024-09-19T08:54:53.329231+0000","last_peered":"2024-09-19T08:54:53.329231+0000","last_clean":"2024-09-19T08:54:53.329231+0000","last_became_active":"2024-09-19T08:54:29.675158+0000","last_became_peered":"2024-09-19T08:54:29.675158+0000","last_unstale":"2024-09-19T08:54:53.329231+0000","last_undegraded":"2024-09-19T08:54:53.329231+0000","last_fullsized":"2024-09-19T08:54:53.329231+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:24:59.377521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.278201+0000","last_change":"2024-09-19T08:54:53.334264+0000","last_active":"2024-09-19T08:55:52.278201+0000","last_peered":"2024-09-19T08:55:52.278201+0000","last_clean":"2024-09-19T08:55:52.278201+0000","last_became_active":"2024-09-19T08:54:53.333959+0000","last_became_peered":"2024-09-19T08:54:53.333959+0000","last_unstale":"2024-09-19T08:55:52.278201+0000","last_undegraded":"2024-09-19T08:55:52.278201+0000","last_fullsized":"2024-09-19T08:55:52.278201+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:14.085033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"80'4","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330611+0000","last_change":"2024-09-19T08:54:29.414478+0000","last_active":"2024-09-19T08:54:53.330611+0000","last_peered":"2024-09-19T08:54:53.330611+0000","last_clean":"2024-09-19T08:54:53.330611+0000","last_became_active":"2024-09-19T08:54:29.414152+0000","last_became_peered":"2024-09-19T08:54:29.414152+0000","last_unstale":"2024-09-19T08:54:53.330611+0000","last_undegraded":"2024-09-19T08:54:53.330611+0000","last_fullsized":"2024-09-19T08:54:53.330611+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:17.477340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67927,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":212,"num_read_kb":174,"num_write":90,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294912,"data_stored":203781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579939,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":897024,"data_stored":435723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841575,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28572,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716580,"statfs":{"total":95995035648,"available":95965777920,"internally_reserved":0,"allocated":1585152,"data_stored":1093531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005101,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":436305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234033,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":436327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462967,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28488,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716664,"statfs":{"total":95995035648,"available":95965863936,"internally_reserved":0,"allocated":1499136,"data_stored":1026790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593788,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":435840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822720,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32656,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712496,"statfs":{"total":95995035648,"available":95961595904,"internally_reserved":0,"allocated":1507328,"data_stored":1026390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986245,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":435745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215177,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":436061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411407,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":978944,"data_stored":502886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":502852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":435813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":67129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":67163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":67323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:56:23.286 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T08:56:23.286 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:56:23.538 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:23.659 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:23 smithi092 ceph-mon[31407]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-19T08:56:23.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:23 smithi167 ceph-mon[35359]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-19T08:56:23.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:23 smithi190 ceph-mon[35358]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-19T08:56:23.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.977+0000 7fdc56abc640 1 -- 172.21.15.92:0/3838144490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc50106a80 msgr2=0x7fdc50106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:23.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.977+0000 7fdc56abc640 1 --2- 172.21.15.92:0/3838144490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc50106a80 0x7fdc50106e60 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fdc48009930 tx=0x7fdc4802a420 comp rx=0 tx=0).stop 2024-09-19T08:56:23.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.977+0000 7fdc56abc640 1 -- 172.21.15.92:0/3838144490 shutdown_connections 2024-09-19T08:56:23.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.977+0000 7fdc56abc640 1 --2- 172.21.15.92:0/3838144490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc50101420 0x7fdc5010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:23.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.977+0000 7fdc56abc640 1 --2- 172.21.15.92:0/3838144490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc50100a80 0x7fdc50100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:23.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.977+0000 7fdc56abc640 1 --2- 172.21.15.92:0/3838144490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc50106a80 0x7fdc50106e60 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:23.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.977+0000 7fdc56abc640 1 -- 172.21.15.92:0/3838144490 >> 172.21.15.92:0/3838144490 conn(0x7fdc500fc7a0 msgr2=0x7fdc500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:23.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.977+0000 7fdc56abc640 1 -- 172.21.15.92:0/3838144490 shutdown_connections 2024-09-19T08:56:23.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.977+0000 7fdc56abc640 1 -- 172.21.15.92:0/3838144490 wait complete. 2024-09-19T08:56:23.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.978+0000 7fdc56abc640 1 Processor -- start 2024-09-19T08:56:23.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.978+0000 7fdc56abc640 1 -- start start 2024-09-19T08:56:23.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.978+0000 7fdc56abc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc50100a80 0x7fdc501a0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:23.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.978+0000 7fdc56abc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc50101420 0x7fdc501a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:23.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.978+0000 7fdc56abc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc50106a80 0x7fdc5019a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:23.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.978+0000 7fdc56abc640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdc50112020 con 0x7fdc50100a80 2024-09-19T08:56:23.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.978+0000 7fdc56abc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdc50111ea0 con 0x7fdc50101420 2024-09-19T08:56:23.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.978+0000 7fdc56abc640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fdc501121a0 con 0x7fdc50106a80 2024-09-19T08:56:23.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.978+0000 7fdc54858640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc50100a80 0x7fdc501a0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:23.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.978+0000 7fdc54858640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc50100a80 0x7fdc501a0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37958/0 (socket says 172.21.15.92:37958) 2024-09-19T08:56:23.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.978+0000 7fdc54858640 1 -- 172.21.15.92:0/996220370 learned_addr learned my addr 172.21.15.92:0/996220370 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:23.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.978+0000 7fdc4ffff640 1 --2- 172.21.15.92:0/996220370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc50101420 0x7fdc501a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:23.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.978+0000 7fdc55059640 1 --2- 172.21.15.92:0/996220370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc50106a80 0x7fdc5019a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:23.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.978+0000 7fdc54858640 1 -- 172.21.15.92:0/996220370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc50106a80 msgr2=0x7fdc5019a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:23.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.978+0000 7fdc54858640 1 --2- 172.21.15.92:0/996220370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc50106a80 0x7fdc5019a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:23.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.978+0000 7fdc54858640 1 -- 172.21.15.92:0/996220370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc50101420 msgr2=0x7fdc501a0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:24.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.978+0000 7fdc54858640 1 --2- 172.21.15.92:0/996220370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc50101420 0x7fdc501a0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:24.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.978+0000 7fdc54858640 1 -- 172.21.15.92:0/996220370 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc5019aea0 con 0x7fdc50100a80 2024-09-19T08:56:24.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.978+0000 7fdc4ffff640 1 --2- 172.21.15.92:0/996220370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc50101420 0x7fdc501a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:56:24.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.978+0000 7fdc55059640 1 --2- 172.21.15.92:0/996220370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc50106a80 0x7fdc5019a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:56:24.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.978+0000 7fdc54858640 1 --2- 172.21.15.92:0/996220370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc50100a80 0x7fdc501a0560 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fdc48009a50 tx=0x7fdc48004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:24.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.979+0000 7fdc4dffb640 1 -- 172.21.15.92:0/996220370 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4803f030 con 0x7fdc50100a80 2024-09-19T08:56:24.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.979+0000 7fdc56abc640 1 -- 172.21.15.92:0/996220370 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc5019b130 con 0x7fdc50100a80 2024-09-19T08:56:24.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.979+0000 7fdc4dffb640 1 -- 172.21.15.92:0/996220370 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc48003ce0 con 0x7fdc50100a80 2024-09-19T08:56:24.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.979+0000 7fdc4dffb640 1 -- 172.21.15.92:0/996220370 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc48035070 con 0x7fdc50100a80 2024-09-19T08:56:24.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.979+0000 7fdc56abc640 1 -- 172.21.15.92:0/996220370 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc501a7310 con 0x7fdc50100a80 2024-09-19T08:56:24.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.980+0000 7fdc56abc640 1 -- 172.21.15.92:0/996220370 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc501021c0 con 0x7fdc50100a80 2024-09-19T08:56:24.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.981+0000 7fdc4dffb640 1 -- 172.21.15.92:0/996220370 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fdc48042030 con 0x7fdc50100a80 2024-09-19T08:56:24.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.982+0000 7fdc4dffb640 1 --2- 172.21.15.92:0/996220370 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdc3c0a3240 0x7fdc3c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:24.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.982+0000 7fdc4ffff640 1 --2- 172.21.15.92:0/996220370 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdc3c0a3240 0x7fdc3c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:24.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.982+0000 7fdc4dffb640 1 -- 172.21.15.92:0/996220370 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fdc480f03b0 con 0x7fdc50100a80 2024-09-19T08:56:24.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.982+0000 7fdc4ffff640 1 --2- 172.21.15.92:0/996220370 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdc3c0a3240 0x7fdc3c0a5700 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdc5019be80 tx=0x7fdc400073c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:24.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:23.985+0000 7fdc4dffb640 1 -- 172.21.15.92:0/996220370 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdc480bd0d0 con 0x7fdc50100a80 2024-09-19T08:56:24.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:24.148+0000 7fdc56abc640 1 -- 172.21.15.92:0/996220370 --> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdc500fde10 con 0x7fdc3c0a3240 2024-09-19T08:56:24.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:24.154+0000 7fdc4dffb640 1 -- 172.21.15.92:0/996220370 <== mgr.14150 v2:172.21.15.92:6800/2435349378 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258749 (secure 0 0 0) 0x7fdc500fde10 con 0x7fdc3c0a3240 2024-09-19T08:56:24.156 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:24.157 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-19T08:56:24.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:24.158+0000 7fdc56abc640 1 -- 172.21.15.92:0/996220370 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdc3c0a3240 msgr2=0x7fdc3c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:24.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:24.158+0000 7fdc56abc640 1 --2- 172.21.15.92:0/996220370 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdc3c0a3240 0x7fdc3c0a5700 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdc5019be80 tx=0x7fdc400073c0 comp rx=0 tx=0).stop 2024-09-19T08:56:24.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:24.158+0000 7fdc56abc640 1 -- 172.21.15.92:0/996220370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc50100a80 msgr2=0x7fdc501a0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:24.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:24.158+0000 7fdc56abc640 1 --2- 172.21.15.92:0/996220370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc50100a80 0x7fdc501a0560 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fdc48009a50 tx=0x7fdc48004270 comp rx=0 tx=0).stop 2024-09-19T08:56:24.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:24.158+0000 7fdc56abc640 1 -- 172.21.15.92:0/996220370 shutdown_connections 2024-09-19T08:56:24.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:24.158+0000 7fdc56abc640 1 --2- 172.21.15.92:0/996220370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc50106a80 0x7fdc5019a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:24.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:24.158+0000 7fdc56abc640 1 --2- 172.21.15.92:0/996220370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc50101420 0x7fdc501a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:24.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:24.158+0000 7fdc56abc640 1 --2- 172.21.15.92:0/996220370 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdc3c0a3240 0x7fdc3c0a5700 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:24.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:24.158+0000 7fdc56abc640 1 --2- 172.21.15.92:0/996220370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc50100a80 0x7fdc501a0560 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:24.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:24.158+0000 7fdc56abc640 1 -- 172.21.15.92:0/996220370 >> 172.21.15.92:0/996220370 conn(0x7fdc500fc7a0 msgr2=0x7fdc5010c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:24.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:24.158+0000 7fdc56abc640 1 -- 172.21.15.92:0/996220370 shutdown_connections 2024-09-19T08:56:24.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:24.158+0000 7fdc56abc640 1 -- 172.21.15.92:0/996220370 wait complete. 2024-09-19T08:56:24.681 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:24 smithi092 ceph-mon[31407]: from='client.15204 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:56:24.681 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:24 smithi092 ceph-mon[31407]: scrub summary: idle 2024-09-19T08:56:24.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:24 smithi167 ceph-mon[35359]: from='client.15204 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:56:24.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:24 smithi167 ceph-mon[35359]: scrub summary: idle 2024-09-19T08:56:24.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:24 smithi190 ceph-mon[35358]: from='client.15204 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:56:24.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:24 smithi190 ceph-mon[35358]: scrub summary: idle 2024-09-19T08:56:24.881 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":327,"stamp":"2024-09-19T08:56:22.282128+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658529,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":338,"num_read_kb":283,"num_write":273,"num_write_kb":3036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":713,"ondisk_log_size":713,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365972,"kb_used_data":12564,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575852,"statfs":{"total":1151940427776,"available":1151565672448,"internally_reserved":0,"allocated":12865536,"data_stored":7204263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5681,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":18,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003032"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277427+0000","last_change":"2024-09-19T08:54:31.437743+0000","last_active":"2024-09-19T08:55:52.277427+0000","last_peered":"2024-09-19T08:55:52.277427+0000","last_clean":"2024-09-19T08:55:52.277427+0000","last_became_active":"2024-09-19T08:54:31.437426+0000","last_became_peered":"2024-09-19T08:54:31.437426+0000","last_unstale":"2024-09-19T08:55:52.277427+0000","last_undegraded":"2024-09-19T08:55:52.277427+0000","last_fullsized":"2024-09-19T08:55:52.277427+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:04.403522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.282945+0000","last_change":"2024-09-19T08:54:31.430322+0000","last_active":"2024-09-19T08:55:52.282945+0000","last_peered":"2024-09-19T08:55:52.282945+0000","last_clean":"2024-09-19T08:55:52.282945+0000","last_became_active":"2024-09-19T08:54:31.430008+0000","last_became_peered":"2024-09-19T08:54:31.430008+0000","last_unstale":"2024-09-19T08:55:52.282945+0000","last_undegraded":"2024-09-19T08:55:52.282945+0000","last_fullsized":"2024-09-19T08:55:52.282945+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:19.800686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.271299+0000","last_change":"2024-09-19T08:54:31.430276+0000","last_active":"2024-09-19T08:55:52.271299+0000","last_peered":"2024-09-19T08:55:52.271299+0000","last_clean":"2024-09-19T08:55:52.271299+0000","last_became_active":"2024-09-19T08:54:31.429939+0000","last_became_peered":"2024-09-19T08:54:31.429939+0000","last_unstale":"2024-09-19T08:55:52.271299+0000","last_undegraded":"2024-09-19T08:55:52.271299+0000","last_fullsized":"2024-09-19T08:55:52.271299+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:08.735067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.260618+0000","last_change":"2024-09-19T08:54:31.435197+0000","last_active":"2024-09-19T08:55:52.260618+0000","last_peered":"2024-09-19T08:55:52.260618+0000","last_clean":"2024-09-19T08:55:52.260618+0000","last_became_active":"2024-09-19T08:54:31.434872+0000","last_became_peered":"2024-09-19T08:54:31.434872+0000","last_unstale":"2024-09-19T08:55:52.260618+0000","last_undegraded":"2024-09-19T08:55:52.260618+0000","last_fullsized":"2024-09-19T08:55:52.260618+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:06.213317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.256859+0000","last_change":"2024-09-19T08:54:31.423765+0000","last_active":"2024-09-19T08:55:52.256859+0000","last_peered":"2024-09-19T08:55:52.256859+0000","last_clean":"2024-09-19T08:55:52.256859+0000","last_became_active":"2024-09-19T08:54:31.423296+0000","last_became_peered":"2024-09-19T08:54:31.423296+0000","last_unstale":"2024-09-19T08:55:52.256859+0000","last_undegraded":"2024-09-19T08:55:52.256859+0000","last_fullsized":"2024-09-19T08:55:52.256859+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:07.507168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.283359+0000","last_change":"2024-09-19T08:54:31.430299+0000","last_active":"2024-09-19T08:55:52.283359+0000","last_peered":"2024-09-19T08:55:52.283359+0000","last_clean":"2024-09-19T08:55:52.283359+0000","last_became_active":"2024-09-19T08:54:31.429951+0000","last_became_peered":"2024-09-19T08:54:31.429951+0000","last_unstale":"2024-09-19T08:55:52.283359+0000","last_undegraded":"2024-09-19T08:55:52.283359+0000","last_fullsized":"2024-09-19T08:55:52.283359+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:11.299729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.278219+0000","last_change":"2024-09-19T08:54:31.435854+0000","last_active":"2024-09-19T08:55:52.278219+0000","last_peered":"2024-09-19T08:55:52.278219+0000","last_clean":"2024-09-19T08:55:52.278219+0000","last_became_active":"2024-09-19T08:54:31.435522+0000","last_became_peered":"2024-09-19T08:54:31.435522+0000","last_unstale":"2024-09-19T08:55:52.278219+0000","last_undegraded":"2024-09-19T08:55:52.278219+0000","last_fullsized":"2024-09-19T08:55:52.278219+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:11.099750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.282506+0000","last_change":"2024-09-19T08:54:31.434574+0000","last_active":"2024-09-19T08:55:52.282506+0000","last_peered":"2024-09-19T08:55:52.282506+0000","last_clean":"2024-09-19T08:55:52.282506+0000","last_became_active":"2024-09-19T08:54:31.434268+0000","last_became_peered":"2024-09-19T08:54:31.434268+0000","last_unstale":"2024-09-19T08:55:52.282506+0000","last_undegraded":"2024-09-19T08:55:52.282506+0000","last_fullsized":"2024-09-19T08:55:52.282506+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:29.159417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.279084+0000","last_change":"2024-09-19T08:54:31.430446+0000","last_active":"2024-09-19T08:55:52.279084+0000","last_peered":"2024-09-19T08:55:52.279084+0000","last_clean":"2024-09-19T08:55:52.279084+0000","last_became_active":"2024-09-19T08:54:31.430048+0000","last_became_peered":"2024-09-19T08:54:31.430048+0000","last_unstale":"2024-09-19T08:55:52.279084+0000","last_undegraded":"2024-09-19T08:55:52.279084+0000","last_fullsized":"2024-09-19T08:55:52.279084+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:24.773947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.283319+0000","last_change":"2024-09-19T08:54:31.433144+0000","last_active":"2024-09-19T08:55:52.283319+0000","last_peered":"2024-09-19T08:55:52.283319+0000","last_clean":"2024-09-19T08:55:52.283319+0000","last_became_active":"2024-09-19T08:54:31.432590+0000","last_became_peered":"2024-09-19T08:54:31.432590+0000","last_unstale":"2024-09-19T08:55:52.283319+0000","last_undegraded":"2024-09-19T08:55:52.283319+0000","last_fullsized":"2024-09-19T08:55:52.283319+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:53.756846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.275955+0000","last_change":"2024-09-19T08:54:31.435712+0000","last_active":"2024-09-19T08:55:52.275955+0000","last_peered":"2024-09-19T08:55:52.275955+0000","last_clean":"2024-09-19T08:55:52.275955+0000","last_became_active":"2024-09-19T08:54:31.435301+0000","last_became_peered":"2024-09-19T08:54:31.435301+0000","last_unstale":"2024-09-19T08:55:52.275955+0000","last_undegraded":"2024-09-19T08:55:52.275955+0000","last_fullsized":"2024-09-19T08:55:52.275955+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:51.703709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.270429+0000","last_change":"2024-09-19T08:54:53.332853+0000","last_active":"2024-09-19T08:55:52.270429+0000","last_peered":"2024-09-19T08:55:52.270429+0000","last_clean":"2024-09-19T08:55:52.270429+0000","last_became_active":"2024-09-19T08:54:53.332460+0000","last_became_peered":"2024-09-19T08:54:53.332460+0000","last_unstale":"2024-09-19T08:55:52.270429+0000","last_undegraded":"2024-09-19T08:55:52.270429+0000","last_fullsized":"2024-09-19T08:55:52.270429+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:47:58.025876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277366+0000","last_change":"2024-09-19T08:54:31.425590+0000","last_active":"2024-09-19T08:55:52.277366+0000","last_peered":"2024-09-19T08:55:52.277366+0000","last_clean":"2024-09-19T08:55:52.277366+0000","last_became_active":"2024-09-19T08:54:31.425268+0000","last_became_peered":"2024-09-19T08:54:31.425268+0000","last_unstale":"2024-09-19T08:55:52.277366+0000","last_undegraded":"2024-09-19T08:55:52.277366+0000","last_fullsized":"2024-09-19T08:55:52.277366+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:09.404947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.283086+0000","last_change":"2024-09-19T08:54:31.428372+0000","last_active":"2024-09-19T08:55:52.283086+0000","last_peered":"2024-09-19T08:55:52.283086+0000","last_clean":"2024-09-19T08:55:52.283086+0000","last_became_active":"2024-09-19T08:54:31.428064+0000","last_became_peered":"2024-09-19T08:54:31.428064+0000","last_unstale":"2024-09-19T08:55:52.283086+0000","last_undegraded":"2024-09-19T08:55:52.283086+0000","last_fullsized":"2024-09-19T08:55:52.283086+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:40.444117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.271059+0000","last_change":"2024-09-19T08:54:31.424365+0000","last_active":"2024-09-19T08:55:52.271059+0000","last_peered":"2024-09-19T08:55:52.271059+0000","last_clean":"2024-09-19T08:55:52.271059+0000","last_became_active":"2024-09-19T08:54:31.424044+0000","last_became_peered":"2024-09-19T08:54:31.424044+0000","last_unstale":"2024-09-19T08:55:52.271059+0000","last_undegraded":"2024-09-19T08:55:52.271059+0000","last_fullsized":"2024-09-19T08:55:52.271059+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:16.435389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.278276+0000","last_change":"2024-09-19T08:54:31.437238+0000","last_active":"2024-09-19T08:55:52.278276+0000","last_peered":"2024-09-19T08:55:52.278276+0000","last_clean":"2024-09-19T08:55:52.278276+0000","last_became_active":"2024-09-19T08:54:31.436867+0000","last_became_peered":"2024-09-19T08:54:31.436867+0000","last_unstale":"2024-09-19T08:55:52.278276+0000","last_undegraded":"2024-09-19T08:55:52.278276+0000","last_fullsized":"2024-09-19T08:55:52.278276+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:59.839081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277741+0000","last_change":"2024-09-19T08:54:31.438654+0000","last_active":"2024-09-19T08:55:52.277741+0000","last_peered":"2024-09-19T08:55:52.277741+0000","last_clean":"2024-09-19T08:55:52.277741+0000","last_became_active":"2024-09-19T08:54:31.438342+0000","last_became_peered":"2024-09-19T08:54:31.438342+0000","last_unstale":"2024-09-19T08:55:52.277741+0000","last_undegraded":"2024-09-19T08:55:52.277741+0000","last_fullsized":"2024-09-19T08:55:52.277741+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:55.190605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.271267+0000","last_change":"2024-09-19T08:54:31.431100+0000","last_active":"2024-09-19T08:55:52.271267+0000","last_peered":"2024-09-19T08:55:52.271267+0000","last_clean":"2024-09-19T08:55:52.271267+0000","last_became_active":"2024-09-19T08:54:31.430749+0000","last_became_peered":"2024-09-19T08:54:31.430749+0000","last_unstale":"2024-09-19T08:55:52.271267+0000","last_undegraded":"2024-09-19T08:55:52.271267+0000","last_fullsized":"2024-09-19T08:55:52.271267+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:50.597610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.261809+0000","last_change":"2024-09-19T08:54:31.427454+0000","last_active":"2024-09-19T08:55:52.261809+0000","last_peered":"2024-09-19T08:55:52.261809+0000","last_clean":"2024-09-19T08:55:52.261809+0000","last_became_active":"2024-09-19T08:54:31.427098+0000","last_became_peered":"2024-09-19T08:54:31.427098+0000","last_unstale":"2024-09-19T08:55:52.261809+0000","last_undegraded":"2024-09-19T08:55:52.261809+0000","last_fullsized":"2024-09-19T08:55:52.261809+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:01.042626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.275970+0000","last_change":"2024-09-19T08:54:31.433887+0000","last_active":"2024-09-19T08:55:52.275970+0000","last_peered":"2024-09-19T08:55:52.275970+0000","last_clean":"2024-09-19T08:55:52.275970+0000","last_became_active":"2024-09-19T08:54:31.433528+0000","last_became_peered":"2024-09-19T08:54:31.433528+0000","last_unstale":"2024-09-19T08:55:52.275970+0000","last_undegraded":"2024-09-19T08:55:52.275970+0000","last_fullsized":"2024-09-19T08:55:52.275970+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:37.291226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.266435+0000","last_change":"2024-09-19T08:54:31.436976+0000","last_active":"2024-09-19T08:55:52.266435+0000","last_peered":"2024-09-19T08:55:52.266435+0000","last_clean":"2024-09-19T08:55:52.266435+0000","last_became_active":"2024-09-19T08:54:31.436646+0000","last_became_peered":"2024-09-19T08:54:31.436646+0000","last_unstale":"2024-09-19T08:55:52.266435+0000","last_undegraded":"2024-09-19T08:55:52.266435+0000","last_fullsized":"2024-09-19T08:55:52.266435+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:19.755556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.278449+0000","last_change":"2024-09-19T08:54:31.438922+0000","last_active":"2024-09-19T08:55:52.278449+0000","last_peered":"2024-09-19T08:55:52.278449+0000","last_clean":"2024-09-19T08:55:52.278449+0000","last_became_active":"2024-09-19T08:54:31.438593+0000","last_became_peered":"2024-09-19T08:54:31.438593+0000","last_unstale":"2024-09-19T08:55:52.278449+0000","last_undegraded":"2024-09-19T08:55:52.278449+0000","last_fullsized":"2024-09-19T08:55:52.278449+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:07.347900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.262522+0000","last_change":"2024-09-19T08:54:31.431659+0000","last_active":"2024-09-19T08:55:52.262522+0000","last_peered":"2024-09-19T08:55:52.262522+0000","last_clean":"2024-09-19T08:55:52.262522+0000","last_became_active":"2024-09-19T08:54:31.431359+0000","last_became_peered":"2024-09-19T08:54:31.431359+0000","last_unstale":"2024-09-19T08:55:52.262522+0000","last_undegraded":"2024-09-19T08:55:52.262522+0000","last_fullsized":"2024-09-19T08:55:52.262522+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:02.421286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.278570+0000","last_change":"2024-09-19T08:54:31.432185+0000","last_active":"2024-09-19T08:55:52.278570+0000","last_peered":"2024-09-19T08:55:52.278570+0000","last_clean":"2024-09-19T08:55:52.278570+0000","last_became_active":"2024-09-19T08:54:31.431418+0000","last_became_peered":"2024-09-19T08:54:31.431418+0000","last_unstale":"2024-09-19T08:55:52.278570+0000","last_undegraded":"2024-09-19T08:55:52.278570+0000","last_fullsized":"2024-09-19T08:55:52.278570+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:45.347487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.256343+0000","last_change":"2024-09-19T08:54:31.433742+0000","last_active":"2024-09-19T08:55:52.256343+0000","last_peered":"2024-09-19T08:55:52.256343+0000","last_clean":"2024-09-19T08:55:52.256343+0000","last_became_active":"2024-09-19T08:54:31.433455+0000","last_became_peered":"2024-09-19T08:54:31.433455+0000","last_unstale":"2024-09-19T08:55:52.256343+0000","last_undegraded":"2024-09-19T08:55:52.256343+0000","last_fullsized":"2024-09-19T08:55:52.256343+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:38.803705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.271146+0000","last_change":"2024-09-19T08:54:31.432954+0000","last_active":"2024-09-19T08:55:52.271146+0000","last_peered":"2024-09-19T08:55:52.271146+0000","last_clean":"2024-09-19T08:55:52.271146+0000","last_became_active":"2024-09-19T08:54:31.432574+0000","last_became_peered":"2024-09-19T08:54:31.432574+0000","last_unstale":"2024-09-19T08:55:52.271146+0000","last_undegraded":"2024-09-19T08:55:52.271146+0000","last_fullsized":"2024-09-19T08:55:52.271146+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:30.457191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.274173+0000","last_change":"2024-09-19T08:54:31.435544+0000","last_active":"2024-09-19T08:55:52.274173+0000","last_peered":"2024-09-19T08:55:52.274173+0000","last_clean":"2024-09-19T08:55:52.274173+0000","last_became_active":"2024-09-19T08:54:31.435195+0000","last_became_peered":"2024-09-19T08:54:31.435195+0000","last_unstale":"2024-09-19T08:55:52.274173+0000","last_undegraded":"2024-09-19T08:55:52.274173+0000","last_fullsized":"2024-09-19T08:55:52.274173+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:54.240654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.266764+0000","last_change":"2024-09-19T08:54:31.428403+0000","last_active":"2024-09-19T08:55:52.266764+0000","last_peered":"2024-09-19T08:55:52.266764+0000","last_clean":"2024-09-19T08:55:52.266764+0000","last_became_active":"2024-09-19T08:54:31.428110+0000","last_became_peered":"2024-09-19T08:54:31.428110+0000","last_unstale":"2024-09-19T08:55:52.266764+0000","last_undegraded":"2024-09-19T08:55:52.266764+0000","last_fullsized":"2024-09-19T08:55:52.266764+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:05.593073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.269495+0000","last_change":"2024-09-19T08:54:31.427291+0000","last_active":"2024-09-19T08:55:52.269495+0000","last_peered":"2024-09-19T08:55:52.269495+0000","last_clean":"2024-09-19T08:55:52.269495+0000","last_became_active":"2024-09-19T08:54:31.427011+0000","last_became_peered":"2024-09-19T08:54:31.427011+0000","last_unstale":"2024-09-19T08:55:52.269495+0000","last_undegraded":"2024-09-19T08:55:52.269495+0000","last_fullsized":"2024-09-19T08:55:52.269495+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:54.338526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.254032+0000","last_change":"2024-09-19T08:54:31.429309+0000","last_active":"2024-09-19T08:55:52.254032+0000","last_peered":"2024-09-19T08:55:52.254032+0000","last_clean":"2024-09-19T08:55:52.254032+0000","last_became_active":"2024-09-19T08:54:31.428381+0000","last_became_peered":"2024-09-19T08:54:31.428381+0000","last_unstale":"2024-09-19T08:55:52.254032+0000","last_undegraded":"2024-09-19T08:55:52.254032+0000","last_fullsized":"2024-09-19T08:55:52.254032+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:22:33.920114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.273963+0000","last_change":"2024-09-19T08:54:53.336591+0000","last_active":"2024-09-19T08:55:52.273963+0000","last_peered":"2024-09-19T08:55:52.273963+0000","last_clean":"2024-09-19T08:55:52.273963+0000","last_became_active":"2024-09-19T08:54:53.336222+0000","last_became_peered":"2024-09-19T08:54:53.336222+0000","last_unstale":"2024-09-19T08:55:52.273963+0000","last_undegraded":"2024-09-19T08:55:52.273963+0000","last_fullsized":"2024-09-19T08:55:52.273963+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:59.019419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277017+0000","last_change":"2024-09-19T08:54:53.335149+0000","last_active":"2024-09-19T08:55:52.277017+0000","last_peered":"2024-09-19T08:55:52.277017+0000","last_clean":"2024-09-19T08:55:52.277017+0000","last_became_active":"2024-09-19T08:54:53.334766+0000","last_became_peered":"2024-09-19T08:54:53.334766+0000","last_unstale":"2024-09-19T08:55:52.277017+0000","last_undegraded":"2024-09-19T08:55:52.277017+0000","last_fullsized":"2024-09-19T08:55:52.277017+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:36.469044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277210+0000","last_change":"2024-09-19T08:54:31.427608+0000","last_active":"2024-09-19T08:55:52.277210+0000","last_peered":"2024-09-19T08:55:52.277210+0000","last_clean":"2024-09-19T08:55:52.277210+0000","last_became_active":"2024-09-19T08:54:31.427294+0000","last_became_peered":"2024-09-19T08:54:31.427294+0000","last_unstale":"2024-09-19T08:55:52.277210+0000","last_undegraded":"2024-09-19T08:55:52.277210+0000","last_fullsized":"2024-09-19T08:55:52.277210+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:41.356609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331158+0000","last_change":"2024-09-19T08:54:29.416204+0000","last_active":"2024-09-19T08:54:53.331158+0000","last_peered":"2024-09-19T08:54:53.331158+0000","last_clean":"2024-09-19T08:54:53.331158+0000","last_became_active":"2024-09-19T08:54:29.415872+0000","last_became_peered":"2024-09-19T08:54:29.415872+0000","last_unstale":"2024-09-19T08:54:53.331158+0000","last_undegraded":"2024-09-19T08:54:53.331158+0000","last_fullsized":"2024-09-19T08:54:53.331158+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:13.844147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.283160+0000","last_change":"2024-09-19T08:54:31.432137+0000","last_active":"2024-09-19T08:55:52.283160+0000","last_peered":"2024-09-19T08:55:52.283160+0000","last_clean":"2024-09-19T08:55:52.283160+0000","last_became_active":"2024-09-19T08:54:31.431761+0000","last_became_peered":"2024-09-19T08:54:31.431761+0000","last_unstale":"2024-09-19T08:55:52.283160+0000","last_undegraded":"2024-09-19T08:55:52.283160+0000","last_fullsized":"2024-09-19T08:55:52.283160+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:05.008431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327676+0000","last_change":"2024-09-19T08:54:29.413221+0000","last_active":"2024-09-19T08:54:53.327676+0000","last_peered":"2024-09-19T08:54:53.327676+0000","last_clean":"2024-09-19T08:54:53.327676+0000","last_became_active":"2024-09-19T08:54:29.412829+0000","last_became_peered":"2024-09-19T08:54:29.412829+0000","last_unstale":"2024-09-19T08:54:53.327676+0000","last_undegraded":"2024-09-19T08:54:53.327676+0000","last_fullsized":"2024-09-19T08:54:53.327676+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:07.224136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.326805+0000","last_change":"2024-09-19T08:54:29.410221+0000","last_active":"2024-09-19T08:54:53.326805+0000","last_peered":"2024-09-19T08:54:53.326805+0000","last_clean":"2024-09-19T08:54:53.326805+0000","last_became_active":"2024-09-19T08:54:29.409951+0000","last_became_peered":"2024-09-19T08:54:29.409951+0000","last_unstale":"2024-09-19T08:54:53.326805+0000","last_undegraded":"2024-09-19T08:54:53.326805+0000","last_fullsized":"2024-09-19T08:54:53.326805+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:58.350932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.259466+0000","last_change":"2024-09-19T08:54:31.429979+0000","last_active":"2024-09-19T08:55:52.259466+0000","last_peered":"2024-09-19T08:55:52.259466+0000","last_clean":"2024-09-19T08:55:52.259466+0000","last_became_active":"2024-09-19T08:54:31.429661+0000","last_became_peered":"2024-09-19T08:54:31.429661+0000","last_unstale":"2024-09-19T08:55:52.259466+0000","last_undegraded":"2024-09-19T08:55:52.259466+0000","last_fullsized":"2024-09-19T08:55:52.259466+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:27:40.603490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331299+0000","last_change":"2024-09-19T08:54:29.415769+0000","last_active":"2024-09-19T08:54:53.331299+0000","last_peered":"2024-09-19T08:54:53.331299+0000","last_clean":"2024-09-19T08:54:53.331299+0000","last_became_active":"2024-09-19T08:54:29.415245+0000","last_became_peered":"2024-09-19T08:54:29.415245+0000","last_unstale":"2024-09-19T08:54:53.331299+0000","last_undegraded":"2024-09-19T08:54:53.331299+0000","last_fullsized":"2024-09-19T08:54:53.331299+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:15.487945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.270548+0000","last_change":"2024-09-19T08:54:31.427126+0000","last_active":"2024-09-19T08:55:52.270548+0000","last_peered":"2024-09-19T08:55:52.270548+0000","last_clean":"2024-09-19T08:55:52.270548+0000","last_became_active":"2024-09-19T08:54:31.426816+0000","last_became_peered":"2024-09-19T08:54:31.426816+0000","last_unstale":"2024-09-19T08:55:52.270548+0000","last_undegraded":"2024-09-19T08:55:52.270548+0000","last_fullsized":"2024-09-19T08:55:52.270548+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:38.039428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.327848+0000","last_change":"2024-09-19T08:54:29.411354+0000","last_active":"2024-09-19T08:54:53.327848+0000","last_peered":"2024-09-19T08:54:53.327848+0000","last_clean":"2024-09-19T08:54:53.327848+0000","last_became_active":"2024-09-19T08:54:29.410990+0000","last_became_peered":"2024-09-19T08:54:29.410990+0000","last_unstale":"2024-09-19T08:54:53.327848+0000","last_undegraded":"2024-09-19T08:54:53.327848+0000","last_fullsized":"2024-09-19T08:54:53.327848+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:29.338169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277112+0000","last_change":"2024-09-19T08:54:31.426243+0000","last_active":"2024-09-19T08:55:52.277112+0000","last_peered":"2024-09-19T08:55:52.277112+0000","last_clean":"2024-09-19T08:55:52.277112+0000","last_became_active":"2024-09-19T08:54:31.425895+0000","last_became_peered":"2024-09-19T08:54:31.425895+0000","last_unstale":"2024-09-19T08:55:52.277112+0000","last_undegraded":"2024-09-19T08:55:52.277112+0000","last_fullsized":"2024-09-19T08:55:52.277112+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:13.562780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331102+0000","last_change":"2024-09-19T08:54:29.416646+0000","last_active":"2024-09-19T08:54:53.331102+0000","last_peered":"2024-09-19T08:54:53.331102+0000","last_clean":"2024-09-19T08:54:53.331102+0000","last_became_active":"2024-09-19T08:54:29.416260+0000","last_became_peered":"2024-09-19T08:54:29.416260+0000","last_unstale":"2024-09-19T08:54:53.331102+0000","last_undegraded":"2024-09-19T08:54:53.331102+0000","last_fullsized":"2024-09-19T08:54:53.331102+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:42:17.467035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.276583+0000","last_change":"2024-09-19T08:54:31.435538+0000","last_active":"2024-09-19T08:55:52.276583+0000","last_peered":"2024-09-19T08:55:52.276583+0000","last_clean":"2024-09-19T08:55:52.276583+0000","last_became_active":"2024-09-19T08:54:31.435185+0000","last_became_peered":"2024-09-19T08:54:31.435185+0000","last_unstale":"2024-09-19T08:55:52.276583+0000","last_undegraded":"2024-09-19T08:55:52.276583+0000","last_fullsized":"2024-09-19T08:55:52.276583+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:06.940123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.332501+0000","last_change":"2024-09-19T08:54:29.675914+0000","last_active":"2024-09-19T08:54:53.332501+0000","last_peered":"2024-09-19T08:54:53.332501+0000","last_clean":"2024-09-19T08:54:53.332501+0000","last_became_active":"2024-09-19T08:54:29.675482+0000","last_became_peered":"2024-09-19T08:54:29.675482+0000","last_unstale":"2024-09-19T08:54:53.332501+0000","last_undegraded":"2024-09-19T08:54:53.332501+0000","last_fullsized":"2024-09-19T08:54:53.332501+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:58.893008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.273901+0000","last_change":"2024-09-19T08:54:31.432628+0000","last_active":"2024-09-19T08:55:52.273901+0000","last_peered":"2024-09-19T08:55:52.273901+0000","last_clean":"2024-09-19T08:55:52.273901+0000","last_became_active":"2024-09-19T08:54:31.430640+0000","last_became_peered":"2024-09-19T08:54:31.430640+0000","last_unstale":"2024-09-19T08:55:52.273901+0000","last_undegraded":"2024-09-19T08:55:52.273901+0000","last_fullsized":"2024-09-19T08:55:52.273901+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:07.793089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'31","reported_seq":260,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:56:16.651077+0000","last_change":"2024-09-19T08:54:29.414619+0000","last_active":"2024-09-19T08:56:16.651077+0000","last_peered":"2024-09-19T08:56:16.651077+0000","last_clean":"2024-09-19T08:56:16.651077+0000","last_became_active":"2024-09-19T08:54:29.414295+0000","last_became_peered":"2024-09-19T08:54:29.414295+0000","last_unstale":"2024-09-19T08:56:16.651077+0000","last_undegraded":"2024-09-19T08:56:16.651077+0000","last_fullsized":"2024-09-19T08:56:16.651077+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:23.782684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67129,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":207,"num_read_kb":169,"num_write":31,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.276986+0000","last_change":"2024-09-19T08:54:31.425432+0000","last_active":"2024-09-19T08:55:52.276986+0000","last_peered":"2024-09-19T08:55:52.276986+0000","last_clean":"2024-09-19T08:55:52.276986+0000","last_became_active":"2024-09-19T08:54:31.425086+0000","last_became_peered":"2024-09-19T08:54:31.425086+0000","last_unstale":"2024-09-19T08:55:52.276986+0000","last_undegraded":"2024-09-19T08:55:52.276986+0000","last_fullsized":"2024-09-19T08:55:52.276986+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:56.572339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330371+0000","last_change":"2024-09-19T08:54:29.415055+0000","last_active":"2024-09-19T08:54:53.330371+0000","last_peered":"2024-09-19T08:54:53.330371+0000","last_clean":"2024-09-19T08:54:53.330371+0000","last_became_active":"2024-09-19T08:54:29.414573+0000","last_became_peered":"2024-09-19T08:54:29.414573+0000","last_unstale":"2024-09-19T08:54:53.330371+0000","last_undegraded":"2024-09-19T08:54:53.330371+0000","last_fullsized":"2024-09-19T08:54:53.330371+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:13.013714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.260081+0000","last_change":"2024-09-19T08:54:31.436905+0000","last_active":"2024-09-19T08:55:52.260081+0000","last_peered":"2024-09-19T08:55:52.260081+0000","last_clean":"2024-09-19T08:55:52.260081+0000","last_became_active":"2024-09-19T08:54:31.436571+0000","last_became_peered":"2024-09-19T08:54:31.436571+0000","last_unstale":"2024-09-19T08:55:52.260081+0000","last_undegraded":"2024-09-19T08:55:52.260081+0000","last_fullsized":"2024-09-19T08:55:52.260081+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:55.294255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330834+0000","last_change":"2024-09-19T08:54:29.417958+0000","last_active":"2024-09-19T08:54:53.330834+0000","last_peered":"2024-09-19T08:54:53.330834+0000","last_clean":"2024-09-19T08:54:53.330834+0000","last_became_active":"2024-09-19T08:54:29.417570+0000","last_became_peered":"2024-09-19T08:54:29.417570+0000","last_unstale":"2024-09-19T08:54:53.330834+0000","last_undegraded":"2024-09-19T08:54:53.330834+0000","last_fullsized":"2024-09-19T08:54:53.330834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:25.557217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.279834+0000","last_change":"2024-09-19T08:54:31.433019+0000","last_active":"2024-09-19T08:55:52.279834+0000","last_peered":"2024-09-19T08:55:52.279834+0000","last_clean":"2024-09-19T08:55:52.279834+0000","last_became_active":"2024-09-19T08:54:31.431265+0000","last_became_peered":"2024-09-19T08:54:31.431265+0000","last_unstale":"2024-09-19T08:55:52.279834+0000","last_undegraded":"2024-09-19T08:55:52.279834+0000","last_fullsized":"2024-09-19T08:55:52.279834+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:36.481863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.979100+0000","last_change":"2024-09-19T08:54:29.414236+0000","last_active":"2024-09-19T08:54:53.979100+0000","last_peered":"2024-09-19T08:54:53.979100+0000","last_clean":"2024-09-19T08:54:53.979100+0000","last_became_active":"2024-09-19T08:54:29.413878+0000","last_became_peered":"2024-09-19T08:54:29.413878+0000","last_unstale":"2024-09-19T08:54:53.979100+0000","last_undegraded":"2024-09-19T08:54:53.979100+0000","last_fullsized":"2024-09-19T08:54:53.979100+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:11.222362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.279321+0000","last_change":"2024-09-19T08:54:31.439512+0000","last_active":"2024-09-19T08:55:52.279321+0000","last_peered":"2024-09-19T08:55:52.279321+0000","last_clean":"2024-09-19T08:55:52.279321+0000","last_became_active":"2024-09-19T08:54:31.438767+0000","last_became_peered":"2024-09-19T08:54:31.438767+0000","last_unstale":"2024-09-19T08:55:52.279321+0000","last_undegraded":"2024-09-19T08:55:52.279321+0000","last_fullsized":"2024-09-19T08:55:52.279321+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:31.784577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330687+0000","last_change":"2024-09-19T08:54:29.675768+0000","last_active":"2024-09-19T08:54:53.330687+0000","last_peered":"2024-09-19T08:54:53.330687+0000","last_clean":"2024-09-19T08:54:53.330687+0000","last_became_active":"2024-09-19T08:54:29.675376+0000","last_became_peered":"2024-09-19T08:54:29.675376+0000","last_unstale":"2024-09-19T08:54:53.330687+0000","last_undegraded":"2024-09-19T08:54:53.330687+0000","last_fullsized":"2024-09-19T08:54:53.330687+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:10.281126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.282865+0000","last_change":"2024-09-19T08:54:31.435904+0000","last_active":"2024-09-19T08:55:52.282865+0000","last_peered":"2024-09-19T08:55:52.282865+0000","last_clean":"2024-09-19T08:55:52.282865+0000","last_became_active":"2024-09-19T08:54:31.435396+0000","last_became_peered":"2024-09-19T08:54:31.435396+0000","last_unstale":"2024-09-19T08:55:52.282865+0000","last_undegraded":"2024-09-19T08:55:52.282865+0000","last_fullsized":"2024-09-19T08:55:52.282865+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:41.567463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331746+0000","last_change":"2024-09-19T08:54:29.410221+0000","last_active":"2024-09-19T08:54:53.331746+0000","last_peered":"2024-09-19T08:54:53.331746+0000","last_clean":"2024-09-19T08:54:53.331746+0000","last_became_active":"2024-09-19T08:54:29.409856+0000","last_became_peered":"2024-09-19T08:54:29.409856+0000","last_unstale":"2024-09-19T08:54:53.331746+0000","last_undegraded":"2024-09-19T08:54:53.331746+0000","last_fullsized":"2024-09-19T08:54:53.331746+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:46.095816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.270387+0000","last_change":"2024-09-19T08:54:31.437854+0000","last_active":"2024-09-19T08:55:52.270387+0000","last_peered":"2024-09-19T08:55:52.270387+0000","last_clean":"2024-09-19T08:55:52.270387+0000","last_became_active":"2024-09-19T08:54:31.437491+0000","last_became_peered":"2024-09-19T08:54:31.437491+0000","last_unstale":"2024-09-19T08:55:52.270387+0000","last_undegraded":"2024-09-19T08:55:52.270387+0000","last_fullsized":"2024-09-19T08:55:52.270387+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:22.532429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.983440+0000","last_change":"2024-09-19T08:54:53.983440+0000","last_active":"2024-09-19T08:54:53.983440+0000","last_peered":"2024-09-19T08:54:53.983440+0000","last_clean":"2024-09-19T08:54:53.983440+0000","last_became_active":"2024-09-19T08:54:53.980971+0000","last_became_peered":"2024-09-19T08:54:53.980971+0000","last_unstale":"2024-09-19T08:54:53.983440+0000","last_undegraded":"2024-09-19T08:54:53.983440+0000","last_fullsized":"2024-09-19T08:54:53.983440+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:33.070904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.278128+0000","last_change":"2024-09-19T08:54:31.429376+0000","last_active":"2024-09-19T08:55:52.278128+0000","last_peered":"2024-09-19T08:55:52.278128+0000","last_clean":"2024-09-19T08:55:52.278128+0000","last_became_active":"2024-09-19T08:54:31.429006+0000","last_became_peered":"2024-09-19T08:54:31.429006+0000","last_unstale":"2024-09-19T08:55:52.278128+0000","last_undegraded":"2024-09-19T08:55:52.278128+0000","last_fullsized":"2024-09-19T08:55:52.278128+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:26.399838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.332608+0000","last_change":"2024-09-19T08:54:29.414307+0000","last_active":"2024-09-19T08:54:53.332608+0000","last_peered":"2024-09-19T08:54:53.332608+0000","last_clean":"2024-09-19T08:54:53.332608+0000","last_became_active":"2024-09-19T08:54:29.413823+0000","last_became_peered":"2024-09-19T08:54:29.413823+0000","last_unstale":"2024-09-19T08:54:53.332608+0000","last_undegraded":"2024-09-19T08:54:53.332608+0000","last_fullsized":"2024-09-19T08:54:53.332608+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:25.484645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.279004+0000","last_change":"2024-09-19T08:54:31.437789+0000","last_active":"2024-09-19T08:55:52.279004+0000","last_peered":"2024-09-19T08:55:52.279004+0000","last_clean":"2024-09-19T08:55:52.279004+0000","last_became_active":"2024-09-19T08:54:31.435488+0000","last_became_peered":"2024-09-19T08:54:31.435488+0000","last_unstale":"2024-09-19T08:55:52.279004+0000","last_undegraded":"2024-09-19T08:55:52.279004+0000","last_fullsized":"2024-09-19T08:55:52.279004+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:19.332440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.333662+0000","last_change":"2024-09-19T08:54:53.333120+0000","last_active":"2024-09-19T08:54:53.333662+0000","last_peered":"2024-09-19T08:54:53.333662+0000","last_clean":"2024-09-19T08:54:53.333662+0000","last_became_active":"2024-09-19T08:54:53.332711+0000","last_became_peered":"2024-09-19T08:54:53.332711+0000","last_unstale":"2024-09-19T08:54:53.333662+0000","last_undegraded":"2024-09-19T08:54:53.333662+0000","last_fullsized":"2024-09-19T08:54:53.333662+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:18.359002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.279878+0000","last_change":"2024-09-19T08:54:31.434564+0000","last_active":"2024-09-19T08:55:52.279878+0000","last_peered":"2024-09-19T08:55:52.279878+0000","last_clean":"2024-09-19T08:55:52.279878+0000","last_became_active":"2024-09-19T08:54:31.434231+0000","last_became_peered":"2024-09-19T08:54:31.434231+0000","last_unstale":"2024-09-19T08:55:52.279878+0000","last_undegraded":"2024-09-19T08:55:52.279878+0000","last_fullsized":"2024-09-19T08:55:52.279878+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:31.316400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":335,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331130+0000","last_change":"2024-09-19T08:53:21.357560+0000","last_active":"2024-09-19T08:54:53.331130+0000","last_peered":"2024-09-19T08:54:53.331130+0000","last_clean":"2024-09-19T08:54:53.331130+0000","last_became_active":"2024-09-19T08:53:21.357122+0000","last_became_peered":"2024-09-19T08:53:21.357122+0000","last_unstale":"2024-09-19T08:54:53.331130+0000","last_undegraded":"2024-09-19T08:54:53.331130+0000","last_fullsized":"2024-09-19T08:54:53.331130+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:05.231370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:05.231370+0000","last_clean_scrub_stamp":"2024-09-19T08:50:05.231370+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:47.867682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.979104+0000","last_change":"2024-09-19T08:54:29.412240+0000","last_active":"2024-09-19T08:54:53.979104+0000","last_peered":"2024-09-19T08:54:53.979104+0000","last_clean":"2024-09-19T08:54:53.979104+0000","last_became_active":"2024-09-19T08:54:29.411908+0000","last_became_peered":"2024-09-19T08:54:29.411908+0000","last_unstale":"2024-09-19T08:54:53.979104+0000","last_undegraded":"2024-09-19T08:54:53.979104+0000","last_fullsized":"2024-09-19T08:54:53.979104+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:37.189373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277537+0000","last_change":"2024-09-19T08:54:31.432956+0000","last_active":"2024-09-19T08:55:52.277537+0000","last_peered":"2024-09-19T08:55:52.277537+0000","last_clean":"2024-09-19T08:55:52.277537+0000","last_became_active":"2024-09-19T08:54:31.432639+0000","last_became_peered":"2024-09-19T08:54:31.432639+0000","last_unstale":"2024-09-19T08:55:52.277537+0000","last_undegraded":"2024-09-19T08:55:52.277537+0000","last_fullsized":"2024-09-19T08:55:52.277537+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:58.302624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331178+0000","last_change":"2024-09-19T08:54:29.414214+0000","last_active":"2024-09-19T08:54:53.331178+0000","last_peered":"2024-09-19T08:54:53.331178+0000","last_clean":"2024-09-19T08:54:53.331178+0000","last_became_active":"2024-09-19T08:54:29.413853+0000","last_became_peered":"2024-09-19T08:54:29.413853+0000","last_unstale":"2024-09-19T08:54:53.331178+0000","last_undegraded":"2024-09-19T08:54:53.331178+0000","last_fullsized":"2024-09-19T08:54:53.331178+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:28:29.119856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.266896+0000","last_change":"2024-09-19T08:54:31.424643+0000","last_active":"2024-09-19T08:55:52.266896+0000","last_peered":"2024-09-19T08:55:52.266896+0000","last_clean":"2024-09-19T08:55:52.266896+0000","last_became_active":"2024-09-19T08:54:31.424363+0000","last_became_peered":"2024-09-19T08:54:31.424363+0000","last_unstale":"2024-09-19T08:55:52.266896+0000","last_undegraded":"2024-09-19T08:55:52.266896+0000","last_fullsized":"2024-09-19T08:55:52.266896+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:37.529952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.326916+0000","last_change":"2024-09-19T08:54:29.675742+0000","last_active":"2024-09-19T08:54:53.326916+0000","last_peered":"2024-09-19T08:54:53.326916+0000","last_clean":"2024-09-19T08:54:53.326916+0000","last_became_active":"2024-09-19T08:54:29.675347+0000","last_became_peered":"2024-09-19T08:54:29.675347+0000","last_unstale":"2024-09-19T08:54:53.326916+0000","last_undegraded":"2024-09-19T08:54:53.326916+0000","last_fullsized":"2024-09-19T08:54:53.326916+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:00.925390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.283427+0000","last_change":"2024-09-19T08:54:31.433887+0000","last_active":"2024-09-19T08:55:52.283427+0000","last_peered":"2024-09-19T08:55:52.283427+0000","last_clean":"2024-09-19T08:55:52.283427+0000","last_became_active":"2024-09-19T08:54:31.433331+0000","last_became_peered":"2024-09-19T08:54:31.433331+0000","last_unstale":"2024-09-19T08:55:52.283427+0000","last_undegraded":"2024-09-19T08:55:52.283427+0000","last_fullsized":"2024-09-19T08:55:52.283427+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:49.875061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331491+0000","last_change":"2024-09-19T08:54:29.417410+0000","last_active":"2024-09-19T08:54:53.331491+0000","last_peered":"2024-09-19T08:54:53.331491+0000","last_clean":"2024-09-19T08:54:53.331491+0000","last_became_active":"2024-09-19T08:54:29.417018+0000","last_became_peered":"2024-09-19T08:54:29.417018+0000","last_unstale":"2024-09-19T08:54:53.331491+0000","last_undegraded":"2024-09-19T08:54:53.331491+0000","last_fullsized":"2024-09-19T08:54:53.331491+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:53.669027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.280825+0000","last_change":"2024-09-19T08:54:31.431313+0000","last_active":"2024-09-19T08:55:52.280825+0000","last_peered":"2024-09-19T08:55:52.280825+0000","last_clean":"2024-09-19T08:55:52.280825+0000","last_became_active":"2024-09-19T08:54:31.429427+0000","last_became_peered":"2024-09-19T08:54:31.429427+0000","last_unstale":"2024-09-19T08:55:52.280825+0000","last_undegraded":"2024-09-19T08:55:52.280825+0000","last_fullsized":"2024-09-19T08:55:52.280825+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:55.106769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330517+0000","last_change":"2024-09-19T08:54:29.675722+0000","last_active":"2024-09-19T08:54:53.330517+0000","last_peered":"2024-09-19T08:54:53.330517+0000","last_clean":"2024-09-19T08:54:53.330517+0000","last_became_active":"2024-09-19T08:54:29.675397+0000","last_became_peered":"2024-09-19T08:54:29.675397+0000","last_unstale":"2024-09-19T08:54:53.330517+0000","last_undegraded":"2024-09-19T08:54:53.330517+0000","last_fullsized":"2024-09-19T08:54:53.330517+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:49.574947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.283206+0000","last_change":"2024-09-19T08:54:31.431106+0000","last_active":"2024-09-19T08:55:52.283206+0000","last_peered":"2024-09-19T08:55:52.283206+0000","last_clean":"2024-09-19T08:55:52.283206+0000","last_became_active":"2024-09-19T08:54:31.430745+0000","last_became_peered":"2024-09-19T08:54:31.430745+0000","last_unstale":"2024-09-19T08:55:52.283206+0000","last_undegraded":"2024-09-19T08:55:52.283206+0000","last_fullsized":"2024-09-19T08:55:52.283206+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:22.714106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331431+0000","last_change":"2024-09-19T08:54:29.675985+0000","last_active":"2024-09-19T08:54:53.331431+0000","last_peered":"2024-09-19T08:54:53.331431+0000","last_clean":"2024-09-19T08:54:53.331431+0000","last_became_active":"2024-09-19T08:54:29.675374+0000","last_became_peered":"2024-09-19T08:54:29.675374+0000","last_unstale":"2024-09-19T08:54:53.331431+0000","last_undegraded":"2024-09-19T08:54:53.331431+0000","last_fullsized":"2024-09-19T08:54:53.331431+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:06.664621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.260250+0000","last_change":"2024-09-19T08:54:31.423493+0000","last_active":"2024-09-19T08:55:52.260250+0000","last_peered":"2024-09-19T08:55:52.260250+0000","last_clean":"2024-09-19T08:55:52.260250+0000","last_became_active":"2024-09-19T08:54:31.422651+0000","last_became_peered":"2024-09-19T08:54:31.422651+0000","last_unstale":"2024-09-19T08:55:52.260250+0000","last_undegraded":"2024-09-19T08:55:52.260250+0000","last_fullsized":"2024-09-19T08:55:52.260250+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:51.863965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'11","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.443763+0000","last_change":"2024-09-19T08:54:29.408571+0000","last_active":"2024-09-19T08:55:52.443763+0000","last_peered":"2024-09-19T08:55:52.443763+0000","last_clean":"2024-09-19T08:55:52.443763+0000","last_became_active":"2024-09-19T08:54:29.408142+0000","last_became_peered":"2024-09-19T08:54:29.408142+0000","last_unstale":"2024-09-19T08:55:52.443763+0000","last_undegraded":"2024-09-19T08:55:52.443763+0000","last_fullsized":"2024-09-19T08:55:52.443763+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:34.578230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.262764+0000","last_change":"2024-09-19T08:54:31.435333+0000","last_active":"2024-09-19T08:55:52.262764+0000","last_peered":"2024-09-19T08:55:52.262764+0000","last_clean":"2024-09-19T08:55:52.262764+0000","last_became_active":"2024-09-19T08:54:31.435041+0000","last_became_peered":"2024-09-19T08:54:31.435041+0000","last_unstale":"2024-09-19T08:55:52.262764+0000","last_undegraded":"2024-09-19T08:55:52.262764+0000","last_fullsized":"2024-09-19T08:55:52.262764+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:40.972638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.979153+0000","last_change":"2024-09-19T08:54:29.554303+0000","last_active":"2024-09-19T08:54:53.979153+0000","last_peered":"2024-09-19T08:54:53.979153+0000","last_clean":"2024-09-19T08:54:53.979153+0000","last_became_active":"2024-09-19T08:54:29.553919+0000","last_became_peered":"2024-09-19T08:54:29.553919+0000","last_unstale":"2024-09-19T08:54:53.979153+0000","last_undegraded":"2024-09-19T08:54:53.979153+0000","last_fullsized":"2024-09-19T08:54:53.979153+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:25.103926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.279407+0000","last_change":"2024-09-19T08:54:53.333280+0000","last_active":"2024-09-19T08:55:52.279407+0000","last_peered":"2024-09-19T08:55:52.279407+0000","last_clean":"2024-09-19T08:55:52.279407+0000","last_became_active":"2024-09-19T08:54:53.332881+0000","last_became_peered":"2024-09-19T08:54:53.332881+0000","last_unstale":"2024-09-19T08:55:52.279407+0000","last_undegraded":"2024-09-19T08:55:52.279407+0000","last_fullsized":"2024-09-19T08:55:52.279407+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:55.880616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329946+0000","last_change":"2024-09-19T08:54:29.675665+0000","last_active":"2024-09-19T08:54:53.329946+0000","last_peered":"2024-09-19T08:54:53.329946+0000","last_clean":"2024-09-19T08:54:53.329946+0000","last_became_active":"2024-09-19T08:54:29.675367+0000","last_became_peered":"2024-09-19T08:54:29.675367+0000","last_unstale":"2024-09-19T08:54:53.329946+0000","last_undegraded":"2024-09-19T08:54:53.329946+0000","last_fullsized":"2024-09-19T08:54:53.329946+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:35.473243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.237269+0000","last_change":"2024-09-19T08:54:31.430837+0000","last_active":"2024-09-19T08:55:52.237269+0000","last_peered":"2024-09-19T08:55:52.237269+0000","last_clean":"2024-09-19T08:55:52.237269+0000","last_became_active":"2024-09-19T08:54:31.430465+0000","last_became_peered":"2024-09-19T08:54:31.430465+0000","last_unstale":"2024-09-19T08:55:52.237269+0000","last_undegraded":"2024-09-19T08:55:52.237269+0000","last_fullsized":"2024-09-19T08:55:52.237269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:50.524730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329067+0000","last_change":"2024-09-19T08:54:29.413803+0000","last_active":"2024-09-19T08:54:53.329067+0000","last_peered":"2024-09-19T08:54:53.329067+0000","last_clean":"2024-09-19T08:54:53.329067+0000","last_became_active":"2024-09-19T08:54:29.413400+0000","last_became_peered":"2024-09-19T08:54:29.413400+0000","last_unstale":"2024-09-19T08:54:53.329067+0000","last_undegraded":"2024-09-19T08:54:53.329067+0000","last_fullsized":"2024-09-19T08:54:53.329067+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:12.518454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.271551+0000","last_change":"2024-09-19T08:54:31.428451+0000","last_active":"2024-09-19T08:55:52.271551+0000","last_peered":"2024-09-19T08:55:52.271551+0000","last_clean":"2024-09-19T08:55:52.271551+0000","last_became_active":"2024-09-19T08:54:31.428134+0000","last_became_peered":"2024-09-19T08:54:31.428134+0000","last_unstale":"2024-09-19T08:55:52.271551+0000","last_undegraded":"2024-09-19T08:55:52.271551+0000","last_fullsized":"2024-09-19T08:55:52.271551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:08.260183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329914+0000","last_change":"2024-09-19T08:54:29.414399+0000","last_active":"2024-09-19T08:54:53.329914+0000","last_peered":"2024-09-19T08:54:53.329914+0000","last_clean":"2024-09-19T08:54:53.329914+0000","last_became_active":"2024-09-19T08:54:29.413080+0000","last_became_peered":"2024-09-19T08:54:29.413080+0000","last_unstale":"2024-09-19T08:54:53.329914+0000","last_undegraded":"2024-09-19T08:54:53.329914+0000","last_fullsized":"2024-09-19T08:54:53.329914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:27.308297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.282381+0000","last_change":"2024-09-19T08:54:31.434550+0000","last_active":"2024-09-19T08:55:52.282381+0000","last_peered":"2024-09-19T08:55:52.282381+0000","last_clean":"2024-09-19T08:55:52.282381+0000","last_became_active":"2024-09-19T08:54:31.434195+0000","last_became_peered":"2024-09-19T08:54:31.434195+0000","last_unstale":"2024-09-19T08:55:52.282381+0000","last_undegraded":"2024-09-19T08:55:52.282381+0000","last_fullsized":"2024-09-19T08:55:52.282381+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:04.807833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.338857+0000","last_change":"2024-09-19T08:54:53.338857+0000","last_active":"2024-09-19T08:54:53.338857+0000","last_peered":"2024-09-19T08:54:53.338857+0000","last_clean":"2024-09-19T08:54:53.338857+0000","last_became_active":"2024-09-19T08:54:53.334162+0000","last_became_peered":"2024-09-19T08:54:53.334162+0000","last_unstale":"2024-09-19T08:54:53.338857+0000","last_undegraded":"2024-09-19T08:54:53.338857+0000","last_fullsized":"2024-09-19T08:54:53.338857+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:38.858918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.280213+0000","last_change":"2024-09-19T08:54:31.441201+0000","last_active":"2024-09-19T08:55:52.280213+0000","last_peered":"2024-09-19T08:55:52.280213+0000","last_clean":"2024-09-19T08:55:52.280213+0000","last_became_active":"2024-09-19T08:54:31.440738+0000","last_became_peered":"2024-09-19T08:54:31.440738+0000","last_unstale":"2024-09-19T08:55:52.280213+0000","last_undegraded":"2024-09-19T08:55:52.280213+0000","last_fullsized":"2024-09-19T08:55:52.280213+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:39.118320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.284175+0000","last_change":"2024-09-19T08:54:31.435772+0000","last_active":"2024-09-19T08:55:52.284175+0000","last_peered":"2024-09-19T08:55:52.284175+0000","last_clean":"2024-09-19T08:55:52.284175+0000","last_became_active":"2024-09-19T08:54:31.435257+0000","last_became_peered":"2024-09-19T08:54:31.435257+0000","last_unstale":"2024-09-19T08:55:52.284175+0000","last_undegraded":"2024-09-19T08:55:52.284175+0000","last_fullsized":"2024-09-19T08:55:52.284175+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:44:12.219054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.341203+0000","last_change":"2024-09-19T08:54:53.341203+0000","last_active":"2024-09-19T08:54:53.341203+0000","last_peered":"2024-09-19T08:54:53.341203+0000","last_clean":"2024-09-19T08:54:53.341203+0000","last_became_active":"2024-09-19T08:54:53.336115+0000","last_became_peered":"2024-09-19T08:54:53.336115+0000","last_unstale":"2024-09-19T08:54:53.341203+0000","last_undegraded":"2024-09-19T08:54:53.341203+0000","last_fullsized":"2024-09-19T08:54:53.341203+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:31.532599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.277536+0000","last_change":"2024-09-19T08:54:31.427103+0000","last_active":"2024-09-19T08:55:52.277536+0000","last_peered":"2024-09-19T08:55:52.277536+0000","last_clean":"2024-09-19T08:55:52.277536+0000","last_became_active":"2024-09-19T08:54:31.425958+0000","last_became_peered":"2024-09-19T08:54:31.425958+0000","last_unstale":"2024-09-19T08:55:52.277536+0000","last_undegraded":"2024-09-19T08:55:52.277536+0000","last_fullsized":"2024-09-19T08:55:52.277536+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:36.840940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.331317+0000","last_change":"2024-09-19T08:54:29.415209+0000","last_active":"2024-09-19T08:54:53.331317+0000","last_peered":"2024-09-19T08:54:53.331317+0000","last_clean":"2024-09-19T08:54:53.331317+0000","last_became_active":"2024-09-19T08:54:29.414806+0000","last_became_peered":"2024-09-19T08:54:29.414806+0000","last_unstale":"2024-09-19T08:54:53.331317+0000","last_undegraded":"2024-09-19T08:54:53.331317+0000","last_fullsized":"2024-09-19T08:54:53.331317+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:47.764231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.271279+0000","last_change":"2024-09-19T08:54:31.434027+0000","last_active":"2024-09-19T08:55:52.271279+0000","last_peered":"2024-09-19T08:55:52.271279+0000","last_clean":"2024-09-19T08:55:52.271279+0000","last_became_active":"2024-09-19T08:54:31.433687+0000","last_became_peered":"2024-09-19T08:54:31.433687+0000","last_unstale":"2024-09-19T08:55:52.271279+0000","last_undegraded":"2024-09-19T08:55:52.271279+0000","last_fullsized":"2024-09-19T08:55:52.271279+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:56.462128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.329231+0000","last_change":"2024-09-19T08:54:29.675502+0000","last_active":"2024-09-19T08:54:53.329231+0000","last_peered":"2024-09-19T08:54:53.329231+0000","last_clean":"2024-09-19T08:54:53.329231+0000","last_became_active":"2024-09-19T08:54:29.675158+0000","last_became_peered":"2024-09-19T08:54:29.675158+0000","last_unstale":"2024-09-19T08:54:53.329231+0000","last_undegraded":"2024-09-19T08:54:53.329231+0000","last_fullsized":"2024-09-19T08:54:53.329231+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:24:59.377521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:55:52.278201+0000","last_change":"2024-09-19T08:54:53.334264+0000","last_active":"2024-09-19T08:55:52.278201+0000","last_peered":"2024-09-19T08:55:52.278201+0000","last_clean":"2024-09-19T08:55:52.278201+0000","last_became_active":"2024-09-19T08:54:53.333959+0000","last_became_peered":"2024-09-19T08:54:53.333959+0000","last_unstale":"2024-09-19T08:55:52.278201+0000","last_undegraded":"2024-09-19T08:55:52.278201+0000","last_fullsized":"2024-09-19T08:55:52.278201+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:30.402102+0000","last_clean_scrub_stamp":"2024-09-19T08:54:30.402102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:14.085033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"80'4","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:54:53.330611+0000","last_change":"2024-09-19T08:54:29.414478+0000","last_active":"2024-09-19T08:54:53.330611+0000","last_peered":"2024-09-19T08:54:53.330611+0000","last_clean":"2024-09-19T08:54:53.330611+0000","last_became_active":"2024-09-19T08:54:29.414152+0000","last_became_peered":"2024-09-19T08:54:29.414152+0000","last_unstale":"2024-09-19T08:54:53.330611+0000","last_undegraded":"2024-09-19T08:54:53.330611+0000","last_fullsized":"2024-09-19T08:54:53.330611+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:54:28.391524+0000","last_clean_scrub_stamp":"2024-09-19T08:54:28.391524+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:17.477340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67927,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":212,"num_read_kb":174,"num_write":90,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294912,"data_stored":203781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579939,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":897024,"data_stored":435723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841575,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28572,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716580,"statfs":{"total":95995035648,"available":95965777920,"internally_reserved":0,"allocated":1585152,"data_stored":1093531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005101,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":436305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234033,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":436327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462967,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28488,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716664,"statfs":{"total":95995035648,"available":95965863936,"internally_reserved":0,"allocated":1499136,"data_stored":1026790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593788,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":435840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822720,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32656,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712496,"statfs":{"total":95995035648,"available":95961595904,"internally_reserved":0,"allocated":1507328,"data_stored":1026390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986245,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":435745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215177,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":436061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411407,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":978944,"data_stored":502886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":502852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":435813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":67129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":67163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":67323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:56:24.941 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:56:25.184 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:25.573 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:25 smithi092 ceph-mon[31407]: from='client.15210 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:56:25.573 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:25 smithi092 ceph-mon[31407]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-19T08:56:25.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.652+0000 7f3c93fed640 1 -- 172.21.15.92:0/4139119669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c8c100b30 msgr2=0x7f3c8c100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:25.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.652+0000 7f3c93fed640 1 --2- 172.21.15.92:0/4139119669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c8c100b30 0x7f3c8c100f10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3c88009900 tx=0x7f3c8802a470 comp rx=0 tx=0).stop 2024-09-19T08:56:25.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.652+0000 7f3c93fed640 1 -- 172.21.15.92:0/4139119669 shutdown_connections 2024-09-19T08:56:25.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.652+0000 7f3c93fed640 1 --2- 172.21.15.92:0/4139119669 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c8c105f40 0x7f3c8c1063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.652+0000 7f3c93fed640 1 --2- 172.21.15.92:0/4139119669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c8c101450 0x7f3c8c105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.652+0000 7f3c93fed640 1 --2- 172.21.15.92:0/4139119669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c8c100b30 0x7f3c8c100f10 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.652+0000 7f3c93fed640 1 -- 172.21.15.92:0/4139119669 >> 172.21.15.92:0/4139119669 conn(0x7f3c8c0fc7a0 msgr2=0x7f3c8c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:25.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.652+0000 7f3c93fed640 1 -- 172.21.15.92:0/4139119669 shutdown_connections 2024-09-19T08:56:25.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.652+0000 7f3c93fed640 1 -- 172.21.15.92:0/4139119669 wait complete. 2024-09-19T08:56:25.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.653+0000 7f3c93fed640 1 Processor -- start 2024-09-19T08:56:25.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.653+0000 7f3c93fed640 1 -- start start 2024-09-19T08:56:25.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.653+0000 7f3c93fed640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c8c100b30 0x7f3c8c1a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:25.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.653+0000 7f3c93fed640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c8c101450 0x7f3c8c1a4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:25.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.653+0000 7f3c93fed640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c8c105f40 0x7f3c8c19e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:25.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.653+0000 7f3c93fed640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3c8c1185d0 con 0x7f3c8c105f40 2024-09-19T08:56:25.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.653+0000 7f3c93fed640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3c8c118450 con 0x7f3c8c100b30 2024-09-19T08:56:25.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.653+0000 7f3c93fed640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3c8c118750 con 0x7f3c8c101450 2024-09-19T08:56:25.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.653+0000 7f3c9258a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c8c105f40 0x7f3c8c19e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:25.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.653+0000 7f3c9258a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c8c105f40 0x7f3c8c19e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37970/0 (socket says 172.21.15.92:37970) 2024-09-19T08:56:25.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.653+0000 7f3c9258a640 1 -- 172.21.15.92:0/3885457274 learned_addr learned my addr 172.21.15.92:0/3885457274 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:25.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.653+0000 7f3c91d89640 1 --2- 172.21.15.92:0/3885457274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c8c100b30 0x7f3c8c1a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:25.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.653+0000 7f3c91588640 1 --2- 172.21.15.92:0/3885457274 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c8c101450 0x7f3c8c1a4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:25.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.654+0000 7f3c9258a640 1 -- 172.21.15.92:0/3885457274 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c8c101450 msgr2=0x7f3c8c1a4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:25.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.654+0000 7f3c9258a640 1 --2- 172.21.15.92:0/3885457274 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c8c101450 0x7f3c8c1a4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.654+0000 7f3c9258a640 1 -- 172.21.15.92:0/3885457274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c8c100b30 msgr2=0x7f3c8c1a4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:25.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.654+0000 7f3c9258a640 1 --2- 172.21.15.92:0/3885457274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c8c100b30 0x7f3c8c1a4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.654+0000 7f3c9258a640 1 -- 172.21.15.92:0/3885457274 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c8c19eff0 con 0x7f3c8c105f40 2024-09-19T08:56:25.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.654+0000 7f3c91588640 1 --2- 172.21.15.92:0/3885457274 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c8c101450 0x7f3c8c1a4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:56:25.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.654+0000 7f3c91d89640 1 --2- 172.21.15.92:0/3885457274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c8c100b30 0x7f3c8c1a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:56:25.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.654+0000 7f3c9258a640 1 --2- 172.21.15.92:0/3885457274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c8c105f40 0x7f3c8c19e8c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3c8400b970 tx=0x7f3c8400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:25.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.654+0000 7f3c82ffd640 1 -- 172.21.15.92:0/3885457274 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c84019070 con 0x7f3c8c105f40 2024-09-19T08:56:25.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.654+0000 7f3c82ffd640 1 -- 172.21.15.92:0/3885457274 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c8400cb40 con 0x7f3c8c105f40 2024-09-19T08:56:25.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.654+0000 7f3c93fed640 1 -- 172.21.15.92:0/3885457274 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c8c19f2e0 con 0x7f3c8c105f40 2024-09-19T08:56:25.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.654+0000 7f3c82ffd640 1 -- 172.21.15.92:0/3885457274 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c84007650 con 0x7f3c8c105f40 2024-09-19T08:56:25.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.654+0000 7f3c93fed640 1 -- 172.21.15.92:0/3885457274 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c8c1ab5d0 con 0x7f3c8c105f40 2024-09-19T08:56:25.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.655+0000 7f3c93fed640 1 -- 172.21.15.92:0/3885457274 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c8c105920 con 0x7f3c8c105f40 2024-09-19T08:56:25.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.656+0000 7f3c82ffd640 1 -- 172.21.15.92:0/3885457274 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3c8401c070 con 0x7f3c8c105f40 2024-09-19T08:56:25.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.657+0000 7f3c82ffd640 1 --2- 172.21.15.92:0/3885457274 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3c780a3240 0x7f3c780a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:25.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.657+0000 7f3c82ffd640 1 -- 172.21.15.92:0/3885457274 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3c840cef30 con 0x7f3c8c105f40 2024-09-19T08:56:25.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.657+0000 7f3c91d89640 1 --2- 172.21.15.92:0/3885457274 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3c780a3240 0x7f3c780a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:25.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.657+0000 7f3c91d89640 1 --2- 172.21.15.92:0/3885457274 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3c780a3240 0x7f3c780a5700 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3c88000c00 tx=0x7f3c88032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:25.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.661+0000 7f3c82ffd640 1 -- 172.21.15.92:0/3885457274 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3c8409bc50 con 0x7f3c8c105f40 2024-09-19T08:56:25.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:25 smithi167 ceph-mon[35359]: from='client.15210 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:56:25.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:25 smithi167 ceph-mon[35359]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-19T08:56:25.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.860+0000 7f3c93fed640 1 -- 172.21.15.92:0/3885457274 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3c8c1ab9a0 con 0x7f3c8c105f40 2024-09-19T08:56:25.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.861+0000 7f3c82ffd640 1 -- 172.21.15.92:0/3885457274 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f3c8409b550 con 0x7f3c8c105f40 2024-09-19T08:56:25.861 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:25.861 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T08:56:25.861 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T08:56:25.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.863+0000 7f3c93fed640 1 -- 172.21.15.92:0/3885457274 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3c780a3240 msgr2=0x7f3c780a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:25.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.863+0000 7f3c93fed640 1 --2- 172.21.15.92:0/3885457274 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3c780a3240 0x7f3c780a5700 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3c88000c00 tx=0x7f3c88032c70 comp rx=0 tx=0).stop 2024-09-19T08:56:25.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.863+0000 7f3c93fed640 1 -- 172.21.15.92:0/3885457274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c8c105f40 msgr2=0x7f3c8c19e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:25.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.863+0000 7f3c93fed640 1 --2- 172.21.15.92:0/3885457274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c8c105f40 0x7f3c8c19e8c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3c8400b970 tx=0x7f3c8400be30 comp rx=0 tx=0).stop 2024-09-19T08:56:25.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.863+0000 7f3c93fed640 1 -- 172.21.15.92:0/3885457274 shutdown_connections 2024-09-19T08:56:25.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.863+0000 7f3c93fed640 1 --2- 172.21.15.92:0/3885457274 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3c780a3240 0x7f3c780a5700 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.863+0000 7f3c93fed640 1 --2- 172.21.15.92:0/3885457274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c8c105f40 0x7f3c8c19e8c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.863+0000 7f3c93fed640 1 --2- 172.21.15.92:0/3885457274 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c8c101450 0x7f3c8c1a4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.863+0000 7f3c93fed640 1 --2- 172.21.15.92:0/3885457274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c8c100b30 0x7f3c8c1a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.863+0000 7f3c93fed640 1 -- 172.21.15.92:0/3885457274 >> 172.21.15.92:0/3885457274 conn(0x7f3c8c0fc7a0 msgr2=0x7f3c8c10f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:25.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.864+0000 7f3c93fed640 1 -- 172.21.15.92:0/3885457274 shutdown_connections 2024-09-19T08:56:25.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:25.864+0000 7f3c93fed640 1 -- 172.21.15.92:0/3885457274 wait complete. 2024-09-19T08:56:25.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:25 smithi190 ceph-mon[35358]: from='client.15210 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:56:25.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:25 smithi190 ceph-mon[35358]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-19T08:56:26.591 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:56:26.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:26 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3885457274' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:56:26.838 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:26.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:26 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3885457274' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:56:26.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:26 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3885457274' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:56:27.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.254+0000 7f67dba62640 1 -- 172.21.15.92:0/1533184468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67d410c590 msgr2=0x7f67d410c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:27.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.254+0000 7f67dba62640 1 --2- 172.21.15.92:0/1533184468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67d410c590 0x7f67d410c9f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f67c4009900 tx=0x7f67c402a410 comp rx=0 tx=0).stop 2024-09-19T08:56:27.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.254+0000 7f67dba62640 1 -- 172.21.15.92:0/1533184468 shutdown_connections 2024-09-19T08:56:27.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.254+0000 7f67dba62640 1 --2- 172.21.15.92:0/1533184468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67d410cf30 0x7f67d4119410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:27.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.254+0000 7f67dba62640 1 --2- 172.21.15.92:0/1533184468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67d410c590 0x7f67d410c9f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:27.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.254+0000 7f67dba62640 1 --2- 172.21.15.92:0/1533184468 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67d4112640 0x7f67d4112a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:27.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.254+0000 7f67dba62640 1 -- 172.21.15.92:0/1533184468 >> 172.21.15.92:0/1533184468 conn(0x7f67d406cdc0 msgr2=0x7f67d406d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:27.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.254+0000 7f67dba62640 1 -- 172.21.15.92:0/1533184468 shutdown_connections 2024-09-19T08:56:27.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.254+0000 7f67dba62640 1 -- 172.21.15.92:0/1533184468 wait complete. 2024-09-19T08:56:27.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.255+0000 7f67dba62640 1 Processor -- start 2024-09-19T08:56:27.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.255+0000 7f67dba62640 1 -- start start 2024-09-19T08:56:27.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.255+0000 7f67dba62640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67d410c590 0x7f67d41a2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:27.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.255+0000 7f67dba62640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67d410cf30 0x7f67d41a33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:27.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.255+0000 7f67dba62640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67d4112640 0x7f67d41a7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:27.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.255+0000 7f67dba62640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f67d411c9a0 con 0x7f67d4112640 2024-09-19T08:56:27.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.255+0000 7f67dba62640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f67d411c820 con 0x7f67d410c590 2024-09-19T08:56:27.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.255+0000 7f67dba62640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f67d411cb20 con 0x7f67d410cf30 2024-09-19T08:56:27.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.255+0000 7f67d9fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67d4112640 0x7f67d41a7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:27.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.255+0000 7f67d9fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67d4112640 0x7f67d41a7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37982/0 (socket says 172.21.15.92:37982) 2024-09-19T08:56:27.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.255+0000 7f67d9fff640 1 -- 172.21.15.92:0/2945289700 learned_addr learned my addr 172.21.15.92:0/2945289700 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:27.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.255+0000 7f67d8ffd640 1 --2- 172.21.15.92:0/2945289700 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67d410cf30 0x7f67d41a33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:27.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.255+0000 7f67d9fff640 1 -- 172.21.15.92:0/2945289700 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67d410cf30 msgr2=0x7f67d41a33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:27.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.255+0000 7f67d9fff640 1 --2- 172.21.15.92:0/2945289700 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67d410cf30 0x7f67d41a33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:27.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.255+0000 7f67d9fff640 1 -- 172.21.15.92:0/2945289700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67d410c590 msgr2=0x7f67d41a2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:27.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.255+0000 7f67d97fe640 1 --2- 172.21.15.92:0/2945289700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67d410c590 0x7f67d41a2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:27.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.255+0000 7f67d9fff640 1 --2- 172.21.15.92:0/2945289700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67d410c590 0x7f67d41a2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:27.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.255+0000 7f67d9fff640 1 -- 172.21.15.92:0/2945289700 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67d41a7e60 con 0x7f67d4112640 2024-09-19T08:56:27.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.256+0000 7f67d97fe640 1 --2- 172.21.15.92:0/2945289700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67d410c590 0x7f67d41a2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:56:27.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.256+0000 7f67d9fff640 1 --2- 172.21.15.92:0/2945289700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67d4112640 0x7f67d41a7780 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f67cc00eb10 tx=0x7f67cc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:27.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.256+0000 7f67ca7fc640 1 -- 172.21.15.92:0/2945289700 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67cc004b20 con 0x7f67d4112640 2024-09-19T08:56:27.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.256+0000 7f67ca7fc640 1 -- 172.21.15.92:0/2945289700 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67cc004cc0 con 0x7f67d4112640 2024-09-19T08:56:27.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.256+0000 7f67dba62640 1 -- 172.21.15.92:0/2945289700 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67d41a8150 con 0x7f67d4112640 2024-09-19T08:56:27.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.256+0000 7f67ca7fc640 1 -- 172.21.15.92:0/2945289700 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67cc010760 con 0x7f67d4112640 2024-09-19T08:56:27.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.256+0000 7f67dba62640 1 -- 172.21.15.92:0/2945289700 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67d41afa30 con 0x7f67d4112640 2024-09-19T08:56:27.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.257+0000 7f67dba62640 1 -- 172.21.15.92:0/2945289700 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67d410c9f0 con 0x7f67d4112640 2024-09-19T08:56:27.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.258+0000 7f67ca7fc640 1 -- 172.21.15.92:0/2945289700 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f67cc005000 con 0x7f67d4112640 2024-09-19T08:56:27.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.259+0000 7f67ca7fc640 1 --2- 172.21.15.92:0/2945289700 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f67c00a3240 0x7f67c00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:27.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.259+0000 7f67ca7fc640 1 -- 172.21.15.92:0/2945289700 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f67cc0d0240 con 0x7f67d4112640 2024-09-19T08:56:27.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.259+0000 7f67d97fe640 1 --2- 172.21.15.92:0/2945289700 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f67c00a3240 0x7f67c00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:27.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.259+0000 7f67d97fe640 1 --2- 172.21.15.92:0/2945289700 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f67c00a3240 0x7f67c00a5700 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f67d0005fd0 tx=0x7f67d00094d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:27.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.262+0000 7f67ca7fc640 1 -- 172.21.15.92:0/2945289700 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f67cc054210 con 0x7f67d4112640 2024-09-19T08:56:27.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.462+0000 7f67dba62640 1 -- 172.21.15.92:0/2945289700 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f67d41a4210 con 0x7f67d4112640 2024-09-19T08:56:27.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.463+0000 7f67ca7fc640 1 -- 172.21.15.92:0/2945289700 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f67d41a4210 con 0x7f67d4112640 2024-09-19T08:56:27.464 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:27.464 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T08:56:27.464 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T08:56:27.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.465+0000 7f67dba62640 1 -- 172.21.15.92:0/2945289700 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f67c00a3240 msgr2=0x7f67c00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:27.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.465+0000 7f67dba62640 1 --2- 172.21.15.92:0/2945289700 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f67c00a3240 0x7f67c00a5700 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f67d0005fd0 tx=0x7f67d00094d0 comp rx=0 tx=0).stop 2024-09-19T08:56:27.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.465+0000 7f67dba62640 1 -- 172.21.15.92:0/2945289700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67d4112640 msgr2=0x7f67d41a7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:27.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.465+0000 7f67dba62640 1 --2- 172.21.15.92:0/2945289700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67d4112640 0x7f67d41a7780 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f67cc00eb10 tx=0x7f67cc00c2d0 comp rx=0 tx=0).stop 2024-09-19T08:56:27.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.465+0000 7f67dba62640 1 -- 172.21.15.92:0/2945289700 shutdown_connections 2024-09-19T08:56:27.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.465+0000 7f67dba62640 1 --2- 172.21.15.92:0/2945289700 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f67c00a3240 0x7f67c00a5700 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:27.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.465+0000 7f67dba62640 1 --2- 172.21.15.92:0/2945289700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67d4112640 0x7f67d41a7780 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:27.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.465+0000 7f67dba62640 1 --2- 172.21.15.92:0/2945289700 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67d410cf30 0x7f67d41a33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:27.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.465+0000 7f67dba62640 1 --2- 172.21.15.92:0/2945289700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67d410c590 0x7f67d41a2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:27.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.465+0000 7f67dba62640 1 -- 172.21.15.92:0/2945289700 >> 172.21.15.92:0/2945289700 conn(0x7f67d406cdc0 msgr2=0x7f67d410af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:27.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.466+0000 7f67dba62640 1 -- 172.21.15.92:0/2945289700 shutdown_connections 2024-09-19T08:56:27.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:27.466+0000 7f67dba62640 1 -- 172.21.15.92:0/2945289700 wait complete. 2024-09-19T08:56:27.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:27 smithi092 ceph-mon[31407]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T08:56:27.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:27 smithi167 ceph-mon[35359]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T08:56:27.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:27 smithi190 ceph-mon[35358]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T08:56:28.075 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:56:28.320 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:28.709 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:28 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/2945289700' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:56:28.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.787+0000 7f0796ec5640 1 -- 172.21.15.92:0/730090164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0790102db0 msgr2=0x7f0790103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:28.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.787+0000 7f0796ec5640 1 --2- 172.21.15.92:0/730090164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0790102db0 0x7f0790103190 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0780009930 tx=0x7f078002a420 comp rx=0 tx=0).stop 2024-09-19T08:56:28.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.787+0000 7f0796ec5640 1 -- 172.21.15.92:0/730090164 shutdown_connections 2024-09-19T08:56:28.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.787+0000 7f0796ec5640 1 --2- 172.21.15.92:0/730090164 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07901082e0 0x7f079010ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:28.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.787+0000 7f0796ec5640 1 --2- 172.21.15.92:0/730090164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0790103760 0x7f0790107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:28.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.787+0000 7f0796ec5640 1 --2- 172.21.15.92:0/730090164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0790102db0 0x7f0790103190 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:28.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.787+0000 7f0796ec5640 1 -- 172.21.15.92:0/730090164 >> 172.21.15.92:0/730090164 conn(0x7f07900fc7d0 msgr2=0x7f07900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:28.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.788+0000 7f0796ec5640 1 -- 172.21.15.92:0/730090164 shutdown_connections 2024-09-19T08:56:28.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.788+0000 7f0796ec5640 1 -- 172.21.15.92:0/730090164 wait complete. 2024-09-19T08:56:28.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.788+0000 7f0796ec5640 1 Processor -- start 2024-09-19T08:56:28.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.788+0000 7f0796ec5640 1 -- start start 2024-09-19T08:56:28.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.788+0000 7f0796ec5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0790102db0 0x7f0790100a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:28.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.788+0000 7f0796ec5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0790103760 0x7f0790100f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:28.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.788+0000 7f0796ec5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07901082e0 0x7f0790101490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:28.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.788+0000 7f0796ec5640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f07901120e0 con 0x7f0790102db0 2024-09-19T08:56:28.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.788+0000 7f0796ec5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0790111f60 con 0x7f0790103760 2024-09-19T08:56:28.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.788+0000 7f0796ec5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0790112260 con 0x7f07901082e0 2024-09-19T08:56:28.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.788+0000 7f0794c61640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0790102db0 0x7f0790100a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:28.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.788+0000 7f0794c61640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0790102db0 0x7f0790100a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38010/0 (socket says 172.21.15.92:38010) 2024-09-19T08:56:28.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.789+0000 7f0794c61640 1 -- 172.21.15.92:0/668742295 learned_addr learned my addr 172.21.15.92:0/668742295 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:28.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.789+0000 7f0795462640 1 --2- 172.21.15.92:0/668742295 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07901082e0 0x7f0790101490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:28.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.789+0000 7f078ffff640 1 --2- 172.21.15.92:0/668742295 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0790103760 0x7f0790100f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:28.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.789+0000 7f0794c61640 1 -- 172.21.15.92:0/668742295 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07901082e0 msgr2=0x7f0790101490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:28.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.789+0000 7f0794c61640 1 --2- 172.21.15.92:0/668742295 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07901082e0 0x7f0790101490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:28.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.789+0000 7f0794c61640 1 -- 172.21.15.92:0/668742295 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0790103760 msgr2=0x7f0790100f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:28.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.789+0000 7f0794c61640 1 --2- 172.21.15.92:0/668742295 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0790103760 0x7f0790100f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:28.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.789+0000 7f0794c61640 1 -- 172.21.15.92:0/668742295 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07901a6a60 con 0x7f0790102db0 2024-09-19T08:56:28.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.789+0000 7f0794c61640 1 --2- 172.21.15.92:0/668742295 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0790102db0 0x7f0790100a10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f078002a940 tx=0x7f0780003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:28.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.789+0000 7f078dffb640 1 -- 172.21.15.92:0/668742295 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f078003f070 con 0x7f0790102db0 2024-09-19T08:56:28.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.789+0000 7f078dffb640 1 -- 172.21.15.92:0/668742295 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0780031c20 con 0x7f0790102db0 2024-09-19T08:56:28.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.789+0000 7f0796ec5640 1 -- 172.21.15.92:0/668742295 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07901a6cf0 con 0x7f0790102db0 2024-09-19T08:56:28.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.789+0000 7f078dffb640 1 -- 172.21.15.92:0/668742295 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0780035030 con 0x7f0790102db0 2024-09-19T08:56:28.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.789+0000 7f0796ec5640 1 -- 172.21.15.92:0/668742295 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07901a7180 con 0x7f0790102db0 2024-09-19T08:56:28.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.791+0000 7f0796ec5640 1 -- 172.21.15.92:0/668742295 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0790103190 con 0x7f0790102db0 2024-09-19T08:56:28.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.791+0000 7f078dffb640 1 -- 172.21.15.92:0/668742295 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0780042070 con 0x7f0790102db0 2024-09-19T08:56:28.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.792+0000 7f078dffb640 1 --2- 172.21.15.92:0/668742295 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f07780a3240 0x7f07780a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:28.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.792+0000 7f078ffff640 1 --2- 172.21.15.92:0/668742295 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f07780a3240 0x7f07780a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:28.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.792+0000 7f078dffb640 1 -- 172.21.15.92:0/668742295 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f07800effe0 con 0x7f0790102db0 2024-09-19T08:56:28.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.793+0000 7f078ffff640 1 --2- 172.21.15.92:0/668742295 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f07780a3240 0x7f07780a5700 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f07901024a0 tx=0x7f0784005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:28.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.796+0000 7f078dffb640 1 -- 172.21.15.92:0/668742295 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0780031dd0 con 0x7f0790102db0 2024-09-19T08:56:28.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:28 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/2945289700' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:56:28.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:28 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/2945289700' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:56:28.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.963+0000 7f0796ec5640 1 -- 172.21.15.92:0/668742295 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f079010a2c0 con 0x7f0790102db0 2024-09-19T08:56:28.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.964+0000 7f078dffb640 1 -- 172.21.15.92:0/668742295 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22782 (secure 0 0 0) 0x7f07800bcda0 con 0x7f0790102db0 2024-09-19T08:56:28.965 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:28.965 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":82,"fsid":"91ff74f2-7663-11ef-bceb-c7b262605968","created":"2024-09-19T08:47:08.162150+0000","modified":"2024-09-19T08:54:53.324204+0000","last_up_change":"2024-09-19T08:53:43.021949+0000","last_in_change":"2024-09-19T08:53:19.246805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:50:04.482034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:54:28.005336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:54:30.188980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd104fe2-b828-4c98-a499-b212717f2997","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6803","nonce":4232030626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6805","nonce":4232030626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6809","nonce":4232030626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6807","nonce":4232030626}]},"public_addr":"172.21.15.92:6803/4232030626","cluster_addr":"172.21.15.92:6805/4232030626","heartbeat_back_addr":"172.21.15.92:6809/4232030626","heartbeat_front_addr":"172.21.15.92:6807/4232030626","state":["exists","up"]},{"osd":1,"uuid":"0f725330-5e61-413c-b3c8-41bc2c0d8e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6801","nonce":4163493234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6803","nonce":4163493234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6807","nonce":4163493234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6805","nonce":4163493234}]},"public_addr":"172.21.15.167:6801/4163493234","cluster_addr":"172.21.15.167:6803/4163493234","heartbeat_back_addr":"172.21.15.167:6807/4163493234","heartbeat_front_addr":"172.21.15.167:6805/4163493234","state":["exists","up"]},{"osd":2,"uuid":"286d2943-23a0-4184-93cf-9d3430781f99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6801","nonce":702507556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6803","nonce":702507556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6807","nonce":702507556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6805","nonce":702507556}]},"public_addr":"172.21.15.190:6801/702507556","cluster_addr":"172.21.15.190:6803/702507556","heartbeat_back_addr":"172.21.15.190:6807/702507556","heartbeat_front_addr":"172.21.15.190:6805/702507556","state":["exists","up"]},{"osd":3,"uuid":"9d126671-7fc1-4f29-9bc3-3598052fd20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6811","nonce":945752895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6813","nonce":945752895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6817","nonce":945752895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6815","nonce":945752895}]},"public_addr":"172.21.15.92:6811/945752895","cluster_addr":"172.21.15.92:6813/945752895","heartbeat_back_addr":"172.21.15.92:6817/945752895","heartbeat_front_addr":"172.21.15.92:6815/945752895","state":["exists","up"]},{"osd":4,"uuid":"cb10b38d-ae13-4b92-b906-3505fb873b2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6809","nonce":3576893400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6811","nonce":3576893400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6815","nonce":3576893400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6813","nonce":3576893400}]},"public_addr":"172.21.15.167:6809/3576893400","cluster_addr":"172.21.15.167:6811/3576893400","heartbeat_back_addr":"172.21.15.167:6815/3576893400","heartbeat_front_addr":"172.21.15.167:6813/3576893400","state":["exists","up"]},{"osd":5,"uuid":"cd90668b-eca5-4bb4-870e-e58578730c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6809","nonce":1880491675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6811","nonce":1880491675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6815","nonce":1880491675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6813","nonce":1880491675}]},"public_addr":"172.21.15.190:6809/1880491675","cluster_addr":"172.21.15.190:6811/1880491675","heartbeat_back_addr":"172.21.15.190:6815/1880491675","heartbeat_front_addr":"172.21.15.190:6813/1880491675","state":["exists","up"]},{"osd":6,"uuid":"4e047963-afa7-4934-b887-8086165fb831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6819","nonce":1743435653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6821","nonce":1743435653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6825","nonce":1743435653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6823","nonce":1743435653}]},"public_addr":"172.21.15.92:6819/1743435653","cluster_addr":"172.21.15.92:6821/1743435653","heartbeat_back_addr":"172.21.15.92:6825/1743435653","heartbeat_front_addr":"172.21.15.92:6823/1743435653","state":["exists","up"]},{"osd":7,"uuid":"652a6aa1-bb94-4608-952e-67cd02bdff66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6817","nonce":2984111963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6819","nonce":2984111963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6823","nonce":2984111963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6821","nonce":2984111963}]},"public_addr":"172.21.15.167:6817/2984111963","cluster_addr":"172.21.15.167:6819/2984111963","heartbeat_back_addr":"172.21.15.167:6823/2984111963","heartbeat_front_addr":"172.21.15.167:6821/2984111963","state":["exists","up"]},{"osd":8,"uuid":"1510ef1f-fdfe-4887-a771-146efce062fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6817","nonce":4190304434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6819","nonce":4190304434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6823","nonce":4190304434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6821","nonce":4190304434}]},"public_addr":"172.21.15.190:6817/4190304434","cluster_addr":"172.21.15.190:6819/4190304434","heartbeat_back_addr":"172.21.15.190:6823/4190304434","heartbeat_front_addr":"172.21.15.190:6821/4190304434","state":["exists","up"]},{"osd":9,"uuid":"9b774bbe-6700-4020-900b-3fdbaa546773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6827","nonce":3066744542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6829","nonce":3066744542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6833","nonce":3066744542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6831","nonce":3066744542}]},"public_addr":"172.21.15.92:6827/3066744542","cluster_addr":"172.21.15.92:6829/3066744542","heartbeat_back_addr":"172.21.15.92:6833/3066744542","heartbeat_front_addr":"172.21.15.92:6831/3066744542","state":["exists","up"]},{"osd":10,"uuid":"8abdb835-db2c-4597-ae1d-8ef56e63ab6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6825","nonce":2309134313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6827","nonce":2309134313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6831","nonce":2309134313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6829","nonce":2309134313}]},"public_addr":"172.21.15.167:6825/2309134313","cluster_addr":"172.21.15.167:6827/2309134313","heartbeat_back_addr":"172.21.15.167:6831/2309134313","heartbeat_front_addr":"172.21.15.167:6829/2309134313","state":["exists","up"]},{"osd":11,"uuid":"564c844a-378f-40cd-9717-cde35a65631c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6825","nonce":1849208751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6827","nonce":1849208751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6831","nonce":1849208751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6829","nonce":1849208751}]},"public_addr":"172.21.15.190:6825/1849208751","cluster_addr":"172.21.15.190:6827/1849208751","heartbeat_back_addr":"172.21.15.190:6831/1849208751","heartbeat_front_addr":"172.21.15.190:6829/1849208751","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:12.072109+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:36.689174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:01.908763+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:26.857439+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:50.881629+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:51:15.160744+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:51:39.101605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:03.179877+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:27.324563+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:51.971287+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:53:15.917311+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:53:40.592486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/2948821221":"2024-09-20T08:47:52.180093+0000","172.21.15.92:0/1441365956":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6801/2908709470":"2024-09-20T08:47:52.180093+0000","172.21.15.92:0/608374871":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6801/1369295034":"2024-09-20T08:47:29.812397+0000","172.21.15.92:6800/2908709470":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6800/1369295034":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/813486656":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/1963725565":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/1668504617":"2024-09-20T08:47:29.812397+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:56:28.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.966+0000 7f0796ec5640 1 -- 172.21.15.92:0/668742295 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f07780a3240 msgr2=0x7f07780a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:28.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.966+0000 7f0796ec5640 1 --2- 172.21.15.92:0/668742295 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f07780a3240 0x7f07780a5700 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f07901024a0 tx=0x7f0784005f90 comp rx=0 tx=0).stop 2024-09-19T08:56:28.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.966+0000 7f0796ec5640 1 -- 172.21.15.92:0/668742295 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0790102db0 msgr2=0x7f0790100a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:28.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.966+0000 7f0796ec5640 1 --2- 172.21.15.92:0/668742295 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0790102db0 0x7f0790100a10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f078002a940 tx=0x7f0780003b90 comp rx=0 tx=0).stop 2024-09-19T08:56:28.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.966+0000 7f0796ec5640 1 -- 172.21.15.92:0/668742295 shutdown_connections 2024-09-19T08:56:28.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.966+0000 7f0796ec5640 1 --2- 172.21.15.92:0/668742295 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07901082e0 0x7f0790101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:28.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.966+0000 7f0796ec5640 1 --2- 172.21.15.92:0/668742295 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0790103760 0x7f0790100f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:28.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.966+0000 7f0796ec5640 1 --2- 172.21.15.92:0/668742295 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f07780a3240 0x7f07780a5700 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:28.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.966+0000 7f0796ec5640 1 --2- 172.21.15.92:0/668742295 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0790102db0 0x7f0790100a10 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:28.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.966+0000 7f0796ec5640 1 -- 172.21.15.92:0/668742295 >> 172.21.15.92:0/668742295 conn(0x7f07900fc7d0 msgr2=0x7f0790105d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:28.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.966+0000 7f0796ec5640 1 -- 172.21.15.92:0/668742295 shutdown_connections 2024-09-19T08:56:28.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:28.967+0000 7f0796ec5640 1 -- 172.21.15.92:0/668742295 wait complete. 2024-09-19T08:56:29.639 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:29 smithi092 ceph-mon[31407]: pgmap v330: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-19T08:56:29.639 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:29 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/668742295' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:56:29.668 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-09-19T08:56:29.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:29 smithi167 ceph-mon[35359]: pgmap v330: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-19T08:56:29.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:29 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/668742295' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:56:29.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:29 smithi190 ceph-mon[35358]: pgmap v330: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-19T08:56:29.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:29 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/668742295' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:56:29.911 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:31.076 INFO:teuthology.orchestra.run.smithi092.stdout:{"run_dir":"/var/run/ceph"} 2024-09-19T08:56:31.076 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-19T08:56:31.076 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 1747 2024-09-19T08:56:31.076 DEBUG:tasks.quiescer:Yielding 2024-09-19T08:56:31.077 INFO:teuthology.run_tasks:Running task exec... 2024-09-19T08:56:31.088 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T08:56:31.088 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi092.front.sepia.ceph.com 2024-09-19T08:56:31.088 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2024-09-19T08:56:31.088 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:56:31.126 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-19T08:56:31.137 INFO:teuthology.orchestra.run.smithi092.stdout:Filesystem Size Used Avail Use% Mounted on 2024-09-19T08:56:31.138 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:3300,172.21.15.167:3300,172.21.15.190:3300:/volumes/qa/sv_1/edc13aaa-2591-4ed4-a5ac-e9372bb5117f 340G 0 340G 0% /tmp/cephfs 2024-09-19T08:56:31.141 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2024-09-19T08:56:31.232 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2024-09-19T08:56:31.272 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2024-09-19T08:56:31.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.308+0000 7f1f7dae6640 1 -- 172.21.15.92:0/1886643532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f78100a70 msgr2=0x7f1f78100e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:31.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.308+0000 7f1f7dae6640 1 --2- 172.21.15.92:0/1886643532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f78100a70 0x7f1f78100e70 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1f68009900 tx=0x7f1f6802a410 comp rx=0 tx=0).stop 2024-09-19T08:56:31.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.308+0000 7f1f7dae6640 1 -- 172.21.15.92:0/1886643532 shutdown_connections 2024-09-19T08:56:31.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.308+0000 7f1f7dae6640 1 --2- 172.21.15.92:0/1886643532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1f78102620 0x7f1f78108eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:31.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.308+0000 7f1f7dae6640 1 --2- 172.21.15.92:0/1886643532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f78101c60 0x7f1f781020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.308+0000 7f1f7dae6640 1 --2- 172.21.15.92:0/1886643532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f78100a70 0x7f1f78100e70 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.308+0000 7f1f7dae6640 1 -- 172.21.15.92:0/1886643532 >> 172.21.15.92:0/1886643532 conn(0x7f1f780fc1b0 msgr2=0x7f1f780fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.308+0000 7f1f7dae6640 1 -- 172.21.15.92:0/1886643532 shutdown_connections 2024-09-19T08:56:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.308+0000 7f1f7dae6640 1 -- 172.21.15.92:0/1886643532 wait complete. 2024-09-19T08:56:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.309+0000 7f1f7dae6640 1 Processor -- start 2024-09-19T08:56:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.309+0000 7f1f7dae6640 1 -- start start 2024-09-19T08:56:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.309+0000 7f1f7dae6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1f78100a70 0x7f1f7806ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.309+0000 7f1f7dae6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f78101c60 0x7f1f7819cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.309+0000 7f1f7dae6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f78102620 0x7f1f7819f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.309+0000 7f1f7dae6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7810c750 con 0x7f1f78102620 2024-09-19T08:56:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.309+0000 7f1f7dae6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7810c5d0 con 0x7f1f78101c60 2024-09-19T08:56:31.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.309+0000 7f1f7dae6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7810c8d0 con 0x7f1f78100a70 2024-09-19T08:56:31.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.309+0000 7f1f77fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f78102620 0x7f1f7819f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:31.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.309+0000 7f1f77fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f78102620 0x7f1f7819f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38022/0 (socket says 172.21.15.92:38022) 2024-09-19T08:56:31.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.309+0000 7f1f77fff640 1 -- 172.21.15.92:0/1146045278 learned_addr learned my addr 172.21.15.92:0/1146045278 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:31.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.309+0000 7f1f777fe640 1 --2- 172.21.15.92:0/1146045278 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1f78100a70 0x7f1f7806ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:31.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.309+0000 7f1f76ffd640 1 --2- 172.21.15.92:0/1146045278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f78101c60 0x7f1f7819cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:31.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.310+0000 7f1f77fff640 1 -- 172.21.15.92:0/1146045278 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1f78100a70 msgr2=0x7f1f7806ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:31.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.310+0000 7f1f77fff640 1 --2- 172.21.15.92:0/1146045278 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1f78100a70 0x7f1f7806ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:31.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.310+0000 7f1f77fff640 1 -- 172.21.15.92:0/1146045278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f78101c60 msgr2=0x7f1f7819cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:31.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.310+0000 7f1f77fff640 1 --2- 172.21.15.92:0/1146045278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f78101c60 0x7f1f7819cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:31.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.310+0000 7f1f77fff640 1 -- 172.21.15.92:0/1146045278 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f7819faa0 con 0x7f1f78102620 2024-09-19T08:56:31.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.310+0000 7f1f77fff640 1 --2- 172.21.15.92:0/1146045278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f78102620 0x7f1f7819f190 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1f7000b970 tx=0x7f1f7000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:31.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.310+0000 7f1f74ff9640 1 -- 172.21.15.92:0/1146045278 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f70019070 con 0x7f1f78102620 2024-09-19T08:56:31.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.310+0000 7f1f7dae6640 1 -- 172.21.15.92:0/1146045278 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f7819fd30 con 0x7f1f78102620 2024-09-19T08:56:31.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.310+0000 7f1f74ff9640 1 -- 172.21.15.92:0/1146045278 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f7000cb40 con 0x7f1f78102620 2024-09-19T08:56:31.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.310+0000 7f1f7dae6640 1 -- 172.21.15.92:0/1146045278 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f781a02a0 con 0x7f1f78102620 2024-09-19T08:56:31.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.310+0000 7f1f74ff9640 1 -- 172.21.15.92:0/1146045278 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f70007650 con 0x7f1f78102620 2024-09-19T08:56:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.313+0000 7f1f80882740 1 Processor -- start 2024-09-19T08:56:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.313+0000 7f1f74ff9640 1 -- 172.21.15.92:0/1146045278 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1f7001c070 con 0x7f1f78102620 2024-09-19T08:56:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.314+0000 7f1f80882740 1 -- start start 2024-09-19T08:56:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.314+0000 7f1f80882740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d55939a0 0x5618d5593da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.314+0000 7f1f80882740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618d55942e0 0x5618d5598da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.314+0000 7f1f80882740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618d5599370 0x5618d559b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.314+0000 7f1f80882740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5618d54f72f0 con 0x5618d55942e0 2024-09-19T08:56:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.314+0000 7f1f80882740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5618d549f270 con 0x5618d55939a0 2024-09-19T08:56:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.314+0000 7f1f80882740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5618d54f32b0 con 0x5618d5599370 2024-09-19T08:56:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.314+0000 7f1f777fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618d55942e0 0x5618d5598da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.314+0000 7f1f777fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618d55942e0 0x5618d5598da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38030/0 (socket says 172.21.15.92:38030) 2024-09-19T08:56:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.314+0000 7f1f777fe640 1 -- 172.21.15.92:0/1367160752 learned_addr learned my addr 172.21.15.92:0/1367160752 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.314+0000 7f1f76ffd640 1 --2- 172.21.15.92:0/1367160752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d55939a0 0x5618d5593da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.314+0000 7f1f76ffd640 1 --2- 172.21.15.92:0/1367160752 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618d5599370 0x5618d559b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.314+0000 7f1f74ff9640 1 --2- 172.21.15.92:0/1146045278 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1f600a32f0 0x7f1f600a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.314+0000 7f1f777fe640 1 -- 172.21.15.92:0/1367160752 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618d5599370 msgr2=0x5618d559b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:31.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.314+0000 7f1f777fe640 1 --2- 172.21.15.92:0/1367160752 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618d5599370 0x5618d559b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:31.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.314+0000 7f1f777fe640 1 -- 172.21.15.92:0/1367160752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d55939a0 msgr2=0x5618d5593da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:31.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.314+0000 7f1f777fe640 1 --2- 172.21.15.92:0/1367160752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d55939a0 0x5618d5593da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:31.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.314+0000 7f1f777fe640 1 -- 172.21.15.92:0/1367160752 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618d549e340 con 0x5618d55942e0 2024-09-19T08:56:31.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.314+0000 7f1f76ffd640 1 --2- 172.21.15.92:0/1367160752 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618d5599370 0x5618d559b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:31.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.315+0000 7f1f74ff9640 1 -- 172.21.15.92:0/1146045278 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1f700cee90 con 0x7f1f78102620 2024-09-19T08:56:31.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.315+0000 7f1f77fff640 1 --2- 172.21.15.92:0/1146045278 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1f600a32f0 0x7f1f600a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:31.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.315+0000 7f1f777fe640 1 --2- 172.21.15.92:0/1367160752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618d55942e0 0x5618d5598da0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1f680314e0 tx=0x7f1f68032d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99817f3ba38ce459 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:31.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.315+0000 7f1f5dffb640 1 -- 172.21.15.92:0/1367160752 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f68040070 con 0x5618d55942e0 2024-09-19T08:56:31.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.315+0000 7f1f5dffb640 1 -- 172.21.15.92:0/1367160752 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f680318b0 con 0x5618d55942e0 2024-09-19T08:56:31.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.315+0000 7f1f5dffb640 1 -- 172.21.15.92:0/1367160752 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f68040070 con 0x5618d55942e0 2024-09-19T08:56:31.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.316+0000 7f1f80882740 1 -- 172.21.15.92:0/1367160752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618d55942e0 msgr2=0x5618d5598da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:31.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.316+0000 7f1f80882740 1 --2- 172.21.15.92:0/1367160752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618d55942e0 0x5618d5598da0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1f680314e0 tx=0x7f1f68032d70 comp rx=0 tx=0).stop 2024-09-19T08:56:31.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.316+0000 7f1f77fff640 1 --2- 172.21.15.92:0/1146045278 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1f600a32f0 0x7f1f600a57b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1f700979c0 tx=0x7f1f70009970 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:31.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.316+0000 7f1f80882740 1 -- 172.21.15.92:0/1367160752 shutdown_connections 2024-09-19T08:56:31.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.316+0000 7f1f80882740 1 --2- 172.21.15.92:0/1367160752 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618d5599370 0x5618d559b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:31.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.316+0000 7f1f80882740 1 --2- 172.21.15.92:0/1367160752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618d55942e0 0x5618d5598da0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:31.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.316+0000 7f1f80882740 1 --2- 172.21.15.92:0/1367160752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d55939a0 0x5618d5593da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:31.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.316+0000 7f1f80882740 1 -- 172.21.15.92:0/1367160752 >> 172.21.15.92:0/1367160752 conn(0x5618d558f010 msgr2=0x5618d558f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:31.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.316+0000 7f1f80882740 1 -- 172.21.15.92:0/1367160752 shutdown_connections 2024-09-19T08:56:31.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.316+0000 7f1f80882740 1 -- 172.21.15.92:0/1367160752 wait complete. 2024-09-19T08:56:31.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.316+0000 7f1f80882740 1 -- start start 2024-09-19T08:56:31.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.317+0000 7f1f80882740 1 Processor -- start 2024-09-19T08:56:31.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.317+0000 7f1f80882740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618d55939a0 0x5618d559db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:31.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.317+0000 7f1f80882740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618d55942e0 0x5618d559e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:31.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.317+0000 7f1f80882740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d5599370 0x5618d55a5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:31.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.317+0000 7f1f80882740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5618d559c330 con 0x5618d55939a0 2024-09-19T08:56:31.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.317+0000 7f1f80882740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5618d5480290 con 0x5618d5599370 2024-09-19T08:56:31.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.317+0000 7f1f80882740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5618d559c4b0 con 0x5618d55942e0 2024-09-19T08:56:31.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.317+0000 7f1f80882740 10 client.0 _ll_register_callbacks cb 0x5618d54b1140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:31.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.317+0000 7f1f76ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618d55939a0 0x5618d559db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:31.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.317+0000 7f1f76ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618d55939a0 0x5618d559db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38036/0 (socket says 172.21.15.92:38036) 2024-09-19T08:56:31.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.317+0000 7f1f76ffd640 1 -- 172.21.15.92:0/2180575774 learned_addr learned my addr 172.21.15.92:0/2180575774 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:31.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.317+0000 7f1f777fe640 1 --2- 172.21.15.92:0/2180575774 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618d55942e0 0x5618d559e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:31.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.318+0000 7f1f777fe640 1 -- 172.21.15.92:0/2180575774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d5599370 msgr2=0x5618d55a5100 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T08:56:31.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.318+0000 7f1f777fe640 1 --2- 172.21.15.92:0/2180575774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d5599370 0x5618d55a5100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:31.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.318+0000 7f1f777fe640 1 -- 172.21.15.92:0/2180575774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618d55939a0 msgr2=0x5618d559db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:31.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.318+0000 7f1f777fe640 1 --2- 172.21.15.92:0/2180575774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618d55939a0 0x5618d559db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:31.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.318+0000 7f1f777fe640 1 -- 172.21.15.92:0/2180575774 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618d520a210 con 0x5618d55942e0 2024-09-19T08:56:31.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.318+0000 7f1f76ffd640 1 --2- 172.21.15.92:0/2180575774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618d55939a0 0x5618d559db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:31.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.318+0000 7f1f777fe640 1 --2- 172.21.15.92:0/2180575774 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618d55942e0 0x5618d559e0c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1f68005ab0 tx=0x7f1f68004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42a108e22a198245 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:31.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.318+0000 7f1f56ffd640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T08:56:31.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.318+0000 7f1f56ffd640 1 -- 172.21.15.92:0/2180575774 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6804c030 con 0x5618d55942e0 2024-09-19T08:56:31.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.318+0000 7f1f80882740 1 -- 172.21.15.92:0/2180575774 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f680318b0 con 0x5618d55942e0 2024-09-19T08:56:31.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.318+0000 7f1f56ffd640 1 -- 172.21.15.92:0/2180575774 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1f680316b0 con 0x5618d55942e0 2024-09-19T08:56:31.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.319+0000 7f1f56ffd640 1 -- 172.21.15.92:0/2180575774 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1f68040040 con 0x5618d55942e0 2024-09-19T08:56:31.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.319+0000 7f1f80882740 10 client.24781 fetch_fsmap learned FSMap version 19 2024-09-19T08:56:31.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.319+0000 7f1f80882740 1 -- 172.21.15.92:0/2180575774 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5618d52d6620 con 0x5618d55942e0 2024-09-19T08:56:31.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.319+0000 7f1f56ffd640 1 -- 172.21.15.92:0/2180575774 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f680318b0 con 0x5618d55942e0 2024-09-19T08:56:31.327 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.320+0000 7f1f56ffd640 1 -- 172.21.15.92:0/2180575774 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1f68051860 con 0x5618d55942e0 2024-09-19T08:56:31.327 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.320+0000 7f1f80882740 10 client.24781 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:56:31.327 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.320+0000 7f1f80882740 10 client.24781 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T08:56:31.327 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.320+0000 7f1f80882740 20 client.24781 populate_metadata read hostname 'smithi092' 2024-09-19T08:56:31.328 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.320+0000 7f1f80882740 1 --2- 172.21.15.92:0/2180575774 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5618d55ade30 0x5618d55b0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:31.328 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.320+0000 7f1f80882740 4 client.24781 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:56:31.328 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.320+0000 7f1f80882740 1 -- 172.21.15.92:0/2180575774 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5618d5504a20 con 0x5618d55ade30 2024-09-19T08:56:31.328 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.321+0000 7f1f76ffd640 1 --2- 172.21.15.92:0/2180575774 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5618d55ade30 0x5618d55b0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:31.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.321+0000 7f1f76ffd640 1 --2- 172.21.15.92:0/2180575774 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5618d55ade30 0x5618d55b0290 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=593543918afa5ea9 server_cookie=58d5d2af98a016f3 in_seq=0 out_seq=0 2024-09-19T08:56:31.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.321+0000 7f1f56ffd640 10 client.24781 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:31.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.322+0000 7f1f56ffd640 1 -- 172.21.15.92:0/2180575774 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5618d5504a20 con 0x5618d55ade30 2024-09-19T08:56:31.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.322+0000 7f1f56ffd640 10 client.24781 handle_command_reply: tid=0 2024-09-19T08:56:31.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.322+0000 7f1f80882740 1 client.24781 shutdown 2024-09-19T08:56:31.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.322+0000 7f1f80882740 1 -- 172.21.15.92:0/2180575774 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618d55942e0 msgr2=0x5618d559e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:31.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.322+0000 7f1f80882740 1 --2- 172.21.15.92:0/2180575774 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618d55942e0 0x5618d559e0c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1f68005ab0 tx=0x7f1f68004270 comp rx=0 tx=0).stop 2024-09-19T08:56:31.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.322+0000 7f1f80882740 1 -- 172.21.15.92:0/2180575774 shutdown_connections 2024-09-19T08:56:31.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.322+0000 7f1f80882740 1 --2- 172.21.15.92:0/2180575774 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5618d55ade30 0x5618d55b0290 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:31.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.322+0000 7f1f80882740 1 --2- 172.21.15.92:0/2180575774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d5599370 0x5618d55a5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:31.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.322+0000 7f1f56ffd640 0 client.24781 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:31.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.322+0000 7f1f80882740 1 --2- 172.21.15.92:0/2180575774 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618d55942e0 0x5618d559e0c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:31.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.322+0000 7f1f80882740 1 --2- 172.21.15.92:0/2180575774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618d55939a0 0x5618d559db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:31.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.322+0000 7f1f80882740 1 -- 172.21.15.92:0/2180575774 >> 172.21.15.92:0/2180575774 conn(0x5618d558f010 msgr2=0x5618d5590820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:31.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.322+0000 7f1f80882740 1 -- 172.21.15.92:0/2180575774 shutdown_connections 2024-09-19T08:56:31.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.323+0000 7f1f80882740 1 -- 172.21.15.92:0/2180575774 wait complete. 2024-09-19T08:56:31.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.323+0000 7f1f80882740 20 client.24781 trim_cache size 0 max 16384 2024-09-19T08:56:31.346 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.344+0000 7f1f80882740 1 Processor -- start 2024-09-19T08:56:31.346 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.344+0000 7f1f80882740 1 -- start start 2024-09-19T08:56:31.346 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.344+0000 7f1f80882740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618d55939a0 0x5618d558f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:31.346 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.344+0000 7f1f80882740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d55942e0 0x5618d55a5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:31.347 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.344+0000 7f1f80882740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618d5599370 0x5618d558f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:31.347 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.344+0000 7f1f80882740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1f781a4d70 con 0x5618d55939a0 2024-09-19T08:56:31.347 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.344+0000 7f1f80882740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1f781a7610 con 0x5618d55942e0 2024-09-19T08:56:31.347 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.344+0000 7f1f80882740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1f781a5400 con 0x5618d5599370 2024-09-19T08:56:31.347 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.345+0000 7f1f76ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618d55939a0 0x5618d558f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:31.347 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.345+0000 7f1f76ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618d55939a0 0x5618d558f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38050/0 (socket says 172.21.15.92:38050) 2024-09-19T08:56:31.347 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.345+0000 7f1f76ffd640 1 -- 172.21.15.92:0/757013742 learned_addr learned my addr 172.21.15.92:0/757013742 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:31.347 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.345+0000 7f1f777fe640 1 --2- 172.21.15.92:0/757013742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d55942e0 0x5618d55a5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:31.347 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.345+0000 7f1f76ffd640 1 --2- 172.21.15.92:0/757013742 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618d5599370 0x5618d558f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:31.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.345+0000 7f1f76ffd640 1 -- 172.21.15.92:0/757013742 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618d5599370 msgr2=0x5618d558f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:31.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.345+0000 7f1f76ffd640 1 --2- 172.21.15.92:0/757013742 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618d5599370 0x5618d558f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:31.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.345+0000 7f1f76ffd640 1 -- 172.21.15.92:0/757013742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d55942e0 msgr2=0x5618d55a5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:31.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.345+0000 7f1f76ffd640 1 --2- 172.21.15.92:0/757013742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d55942e0 0x5618d55a5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:31.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.345+0000 7f1f76ffd640 1 -- 172.21.15.92:0/757013742 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618d5594f40 con 0x5618d55939a0 2024-09-19T08:56:31.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.345+0000 7f1f76ffd640 1 --2- 172.21.15.92:0/757013742 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618d55939a0 0x5618d558f3f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c00c610 tx=0x7f1f6c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d825d3f6d66a189a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:31.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.346+0000 7f1f5d7fa640 1 -- 172.21.15.92:0/757013742 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c011c90 con 0x5618d55939a0 2024-09-19T08:56:31.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.346+0000 7f1f5d7fa640 1 -- 172.21.15.92:0/757013742 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f6c011e30 con 0x5618d55939a0 2024-09-19T08:56:31.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.346+0000 7f1f5d7fa640 1 -- 172.21.15.92:0/757013742 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c020390 con 0x5618d55939a0 2024-09-19T08:56:31.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.346+0000 7f1f80882740 1 -- 172.21.15.92:0/757013742 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618d55939a0 msgr2=0x5618d558f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:31.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.346+0000 7f1f80882740 1 --2- 172.21.15.92:0/757013742 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618d55939a0 0x5618d558f3f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c00c610 tx=0x7f1f6c004730 comp rx=0 tx=0).stop 2024-09-19T08:56:31.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.347+0000 7f1f80882740 1 -- 172.21.15.92:0/757013742 shutdown_connections 2024-09-19T08:56:31.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.347+0000 7f1f80882740 1 --2- 172.21.15.92:0/757013742 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618d5599370 0x5618d558f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:31.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.347+0000 7f1f80882740 1 --2- 172.21.15.92:0/757013742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d55942e0 0x5618d55a5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:31.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.347+0000 7f1f80882740 1 --2- 172.21.15.92:0/757013742 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618d55939a0 0x5618d558f3f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:31.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.347+0000 7f1f80882740 1 -- 172.21.15.92:0/757013742 >> 172.21.15.92:0/757013742 conn(0x5618d558f010 msgr2=0x5618d559db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:31.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.347+0000 7f1f80882740 1 -- 172.21.15.92:0/757013742 shutdown_connections 2024-09-19T08:56:31.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.347+0000 7f1f80882740 1 -- 172.21.15.92:0/757013742 wait complete. 2024-09-19T08:56:31.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.347+0000 7f1f80882740 1 -- start start 2024-09-19T08:56:31.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.347+0000 7f1f80882740 1 Processor -- start 2024-09-19T08:56:31.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.347+0000 7f1f80882740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618d55939a0 0x5618d55a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:31.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.347+0000 7f1f80882740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618d55942e0 0x5618d55a23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:31.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.347+0000 7f1f80882740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d5599370 0x5618d5616b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:31.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.347+0000 7f1f80882740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1f781a5ad0 con 0x5618d55942e0 2024-09-19T08:56:31.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.347+0000 7f1f80882740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1f781a6f40 con 0x5618d5599370 2024-09-19T08:56:31.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.347+0000 7f1f80882740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1f781a61a0 con 0x5618d55939a0 2024-09-19T08:56:31.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.347+0000 7f1f80882740 10 client.0 _ll_register_callbacks cb 0x7f1f6c00c9f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:31.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.348+0000 7f1f777fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618d55942e0 0x5618d55a23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:31.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.348+0000 7f1f777fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618d55942e0 0x5618d55a23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38066/0 (socket says 172.21.15.92:38066) 2024-09-19T08:56:31.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.348+0000 7f1f777fe640 1 -- 172.21.15.92:0/3595687434 learned_addr learned my addr 172.21.15.92:0/3595687434 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:31.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.348+0000 7f1f76ffd640 1 --2- 172.21.15.92:0/3595687434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d5599370 0x5618d5616b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:31.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.348+0000 7f1f76ffd640 1 --2- 172.21.15.92:0/3595687434 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618d55939a0 0x5618d55a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:31.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.348+0000 7f1f777fe640 1 -- 172.21.15.92:0/3595687434 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618d55939a0 msgr2=0x5618d55a1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:31.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.348+0000 7f1f777fe640 1 --2- 172.21.15.92:0/3595687434 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618d55939a0 0x5618d55a1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:31.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.348+0000 7f1f777fe640 1 -- 172.21.15.92:0/3595687434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d5599370 msgr2=0x5618d5616b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:31.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.348+0000 7f1f777fe640 1 --2- 172.21.15.92:0/3595687434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d5599370 0x5618d5616b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:31.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.348+0000 7f1f777fe640 1 -- 172.21.15.92:0/3595687434 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618d55a2a00 con 0x5618d55942e0 2024-09-19T08:56:31.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.348+0000 7f1f76ffd640 1 --2- 172.21.15.92:0/3595687434 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618d55939a0 0x5618d55a1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:56:31.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.348+0000 7f1f777fe640 1 --2- 172.21.15.92:0/3595687434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618d55942e0 0x5618d55a23c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1f680314e0 tx=0x7f1f68005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ce2b2b25afa64f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:31.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.348+0000 7f1f56ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:56:31.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.348+0000 7f1f56ffd640 1 -- 172.21.15.92:0/3595687434 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6804c040 con 0x5618d55942e0 2024-09-19T08:56:31.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.348+0000 7f1f56ffd640 1 -- 172.21.15.92:0/3595687434 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1f680318b0 con 0x5618d55942e0 2024-09-19T08:56:31.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.348+0000 7f1f80882740 1 -- 172.21.15.92:0/3595687434 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f6c011e30 con 0x5618d55942e0 2024-09-19T08:56:31.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.348+0000 7f1f56ffd640 1 -- 172.21.15.92:0/3595687434 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1f68035040 con 0x5618d55942e0 2024-09-19T08:56:31.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.348+0000 7f1f80882740 10 client.15246 fetch_fsmap learned FSMap version 19 2024-09-19T08:56:31.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.348+0000 7f1f80882740 1 -- 172.21.15.92:0/3595687434 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5618d5618120 con 0x5618d55942e0 2024-09-19T08:56:31.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.349+0000 7f1f56ffd640 1 -- 172.21.15.92:0/3595687434 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f6c011e30 con 0x5618d55942e0 2024-09-19T08:56:31.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.349+0000 7f1f56ffd640 1 -- 172.21.15.92:0/3595687434 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1f68051860 con 0x5618d55942e0 2024-09-19T08:56:31.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.349+0000 7f1f80882740 10 client.15246 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:56:31.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.349+0000 7f1f80882740 10 client.15246 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T08:56:31.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.349+0000 7f1f80882740 20 client.15246 populate_metadata read hostname 'smithi092' 2024-09-19T08:56:31.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.349+0000 7f1f80882740 1 --2- 172.21.15.92:0/3595687434 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5618d5618a60 0x5618d561ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:31.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.349+0000 7f1f80882740 4 client.15246 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:56:31.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.349+0000 7f1f80882740 1 -- 172.21.15.92:0/3595687434 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5618d54fed70 con 0x5618d5618a60 2024-09-19T08:56:31.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.349+0000 7f1f76ffd640 1 --2- 172.21.15.92:0/3595687434 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5618d5618a60 0x5618d561ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:31.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.350+0000 7f1f56ffd640 10 client.15246 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:31.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.350+0000 7f1f76ffd640 1 --2- 172.21.15.92:0/3595687434 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5618d5618a60 0x5618d561ae80 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ef4898bf514c4a6 server_cookie=66d132214521123f in_seq=0 out_seq=0 2024-09-19T08:56:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.362+0000 7f1f56ffd640 1 -- 172.21.15.92:0/3595687434 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5618d54fed70 con 0x5618d5618a60 2024-09-19T08:56:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.362+0000 7f1f56ffd640 10 client.15246 handle_command_reply: tid=0 2024-09-19T08:56:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.362+0000 7f1f80882740 1 client.15246 shutdown 2024-09-19T08:56:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.362+0000 7f1f80882740 1 -- 172.21.15.92:0/3595687434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618d55942e0 msgr2=0x5618d55a23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.362+0000 7f1f80882740 1 --2- 172.21.15.92:0/3595687434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618d55942e0 0x5618d55a23c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1f680314e0 tx=0x7f1f68005fd0 comp rx=0 tx=0).stop 2024-09-19T08:56:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.362+0000 7f1f80882740 1 -- 172.21.15.92:0/3595687434 shutdown_connections 2024-09-19T08:56:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.362+0000 7f1f80882740 1 --2- 172.21.15.92:0/3595687434 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5618d5618a60 0x5618d561ae80 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.362+0000 7f1f80882740 1 --2- 172.21.15.92:0/3595687434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5618d5599370 0x5618d5616b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.362+0000 7f1f80882740 1 --2- 172.21.15.92:0/3595687434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618d55942e0 0x5618d55a23c0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.362+0000 7f1f56ffd640 0 client.15246 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.362+0000 7f1f80882740 1 --2- 172.21.15.92:0/3595687434 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5618d55939a0 0x5618d55a1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.363+0000 7f1f80882740 1 -- 172.21.15.92:0/3595687434 >> 172.21.15.92:0/3595687434 conn(0x5618d558f010 msgr2=0x5618d558d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.363+0000 7f1f80882740 1 -- 172.21.15.92:0/3595687434 shutdown_connections 2024-09-19T08:56:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.363+0000 7f1f80882740 1 -- 172.21.15.92:0/3595687434 wait complete. 2024-09-19T08:56:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.363+0000 7f1f80882740 20 client.15246 trim_cache size 0 max 16384 2024-09-19T08:56:31.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T08:56:31.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T08:56:31.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T08:56:31.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T08:56:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.363+0000 7f1f7dae6640 1 -- 172.21.15.92:0/1146045278 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1f600a32f0 msgr2=0x7f1f600a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.363+0000 7f1f7dae6640 1 --2- 172.21.15.92:0/1146045278 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1f600a32f0 0x7f1f600a57b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1f700979c0 tx=0x7f1f70009970 comp rx=0 tx=0).stop 2024-09-19T08:56:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.363+0000 7f1f7dae6640 1 -- 172.21.15.92:0/1146045278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f78102620 msgr2=0x7f1f7819f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.363+0000 7f1f7dae6640 1 --2- 172.21.15.92:0/1146045278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f78102620 0x7f1f7819f190 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1f7000b970 tx=0x7f1f7000be30 comp rx=0 tx=0).stop 2024-09-19T08:56:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.364+0000 7f1f7dae6640 1 -- 172.21.15.92:0/1146045278 shutdown_connections 2024-09-19T08:56:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.364+0000 7f1f7dae6640 1 --2- 172.21.15.92:0/1146045278 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1f600a32f0 0x7f1f600a57b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.364+0000 7f1f7dae6640 1 --2- 172.21.15.92:0/1146045278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f78102620 0x7f1f7819f190 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.364+0000 7f1f7dae6640 1 --2- 172.21.15.92:0/1146045278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f78101c60 0x7f1f7819cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.364+0000 7f1f7dae6640 1 --2- 172.21.15.92:0/1146045278 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1f78100a70 0x7f1f7806ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:31.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.364+0000 7f1f7dae6640 1 -- 172.21.15.92:0/1146045278 >> 172.21.15.92:0/1146045278 conn(0x7f1f780fc1b0 msgr2=0x7f1f78104f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:31.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.364+0000 7f1f7dae6640 1 -- 172.21.15.92:0/1146045278 shutdown_connections 2024-09-19T08:56:31.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:31.364+0000 7f1f7dae6640 1 -- 172.21.15.92:0/1146045278 wait complete. 2024-09-19T08:56:31.370 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:31.633 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:31 smithi092 ceph-mon[31407]: pgmap v331: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:56:31.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:31 smithi167 ceph-mon[35359]: pgmap v331: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:56:31.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.855+0000 7f83939e0640 1 -- 172.21.15.92:0/707475534 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f838c101440 msgr2=0x7f838c10df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:31.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.855+0000 7f83939e0640 1 --2- 172.21.15.92:0/707475534 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f838c101440 0x7f838c10df30 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f837c009900 tx=0x7f837c02a410 comp rx=0 tx=0).stop 2024-09-19T08:56:31.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.855+0000 7f83939e0640 1 -- 172.21.15.92:0/707475534 shutdown_connections 2024-09-19T08:56:31.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.855+0000 7f83939e0640 1 --2- 172.21.15.92:0/707475534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f838c10e500 0x7f838c110910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:31.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.855+0000 7f83939e0640 1 --2- 172.21.15.92:0/707475534 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f838c101440 0x7f838c10df30 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:31.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.855+0000 7f83939e0640 1 --2- 172.21.15.92:0/707475534 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f838c100b20 0x7f838c100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:31.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.855+0000 7f83939e0640 1 -- 172.21.15.92:0/707475534 >> 172.21.15.92:0/707475534 conn(0x7f838c0fc7d0 msgr2=0x7f838c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:31.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.855+0000 7f83939e0640 1 -- 172.21.15.92:0/707475534 shutdown_connections 2024-09-19T08:56:31.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.855+0000 7f83939e0640 1 -- 172.21.15.92:0/707475534 wait complete. 2024-09-19T08:56:31.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.856+0000 7f83939e0640 1 Processor -- start 2024-09-19T08:56:31.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.856+0000 7f83939e0640 1 -- start start 2024-09-19T08:56:31.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.856+0000 7f83939e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f838c100b20 0x7f838c1a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:31.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.856+0000 7f83939e0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f838c101440 0x7f838c1a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:31.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.856+0000 7f83939e0640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f838c10e500 0x7f838c19a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:31.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.856+0000 7f83939e0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f838c114250 con 0x7f838c100b20 2024-09-19T08:56:31.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.856+0000 7f83939e0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f838c1140d0 con 0x7f838c101440 2024-09-19T08:56:31.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.856+0000 7f83939e0640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f838c1143d0 con 0x7f838c10e500 2024-09-19T08:56:31.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.856+0000 7f839177c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f838c100b20 0x7f838c1a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:31.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.856+0000 7f839177c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f838c100b20 0x7f838c1a0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45216/0 (socket says 172.21.15.92:45216) 2024-09-19T08:56:31.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.856+0000 7f839177c640 1 -- 172.21.15.92:0/504011578 learned_addr learned my addr 172.21.15.92:0/504011578 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:31.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.856+0000 7f8390f7b640 1 --2- 172.21.15.92:0/504011578 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f838c101440 0x7f838c1a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:31.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.856+0000 7f8391f7d640 1 --2- 172.21.15.92:0/504011578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f838c10e500 0x7f838c19a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:31.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.856+0000 7f839177c640 1 -- 172.21.15.92:0/504011578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f838c10e500 msgr2=0x7f838c19a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:31.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.856+0000 7f839177c640 1 --2- 172.21.15.92:0/504011578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f838c10e500 0x7f838c19a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:31.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.856+0000 7f839177c640 1 -- 172.21.15.92:0/504011578 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f838c101440 msgr2=0x7f838c1a0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:31.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.856+0000 7f839177c640 1 --2- 172.21.15.92:0/504011578 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f838c101440 0x7f838c1a0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:31.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.856+0000 7f839177c640 1 -- 172.21.15.92:0/504011578 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f838c19acf0 con 0x7f838c100b20 2024-09-19T08:56:31.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.857+0000 7f839177c640 1 --2- 172.21.15.92:0/504011578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f838c100b20 0x7f838c1a0400 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f838800c890 tx=0x7f838800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:31.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.857+0000 7f83827fc640 1 -- 172.21.15.92:0/504011578 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8388004220 con 0x7f838c100b20 2024-09-19T08:56:31.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.857+0000 7f83939e0640 1 -- 172.21.15.92:0/504011578 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f838c19afe0 con 0x7f838c100b20 2024-09-19T08:56:31.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.857+0000 7f83827fc640 1 -- 172.21.15.92:0/504011578 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83880043c0 con 0x7f838c100b20 2024-09-19T08:56:31.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.857+0000 7f83827fc640 1 -- 172.21.15.92:0/504011578 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8388004a00 con 0x7f838c100b20 2024-09-19T08:56:31.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.857+0000 7f83939e0640 1 -- 172.21.15.92:0/504011578 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f838c1a72d0 con 0x7f838c100b20 2024-09-19T08:56:31.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.858+0000 7f83939e0640 1 -- 172.21.15.92:0/504011578 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f838c100f00 con 0x7f838c100b20 2024-09-19T08:56:31.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.859+0000 7f83827fc640 1 -- 172.21.15.92:0/504011578 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f83880079b0 con 0x7f838c100b20 2024-09-19T08:56:31.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.860+0000 7f83827fc640 1 --2- 172.21.15.92:0/504011578 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f83780a3240 0x7f83780a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:31.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.860+0000 7f8390f7b640 1 --2- 172.21.15.92:0/504011578 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f83780a3240 0x7f83780a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:31.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.860+0000 7f83827fc640 1 -- 172.21.15.92:0/504011578 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f83880cf9f0 con 0x7f838c100b20 2024-09-19T08:56:31.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.860+0000 7f8390f7b640 1 --2- 172.21.15.92:0/504011578 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f83780a3240 0x7f83780a5700 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f837c004770 tx=0x7f837c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:31.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:31.864+0000 7f83827fc640 1 -- 172.21.15.92:0/504011578 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8388014030 con 0x7f838c100b20 2024-09-19T08:56:31.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:31 smithi190 ceph-mon[35358]: pgmap v331: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T08:56:32.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:32.070+0000 7f83939e0640 1 -- 172.21.15.92:0/504011578 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f838c19baf0 con 0x7f838c100b20 2024-09-19T08:56:32.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:32.071+0000 7f83827fc640 1 -- 172.21.15.92:0/504011578 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f838809c710 con 0x7f838c100b20 2024-09-19T08:56:32.072 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:32.072 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T08:56:32.072 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T08:56:32.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:32.073+0000 7f83939e0640 1 -- 172.21.15.92:0/504011578 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f83780a3240 msgr2=0x7f83780a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:32.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:32.073+0000 7f83939e0640 1 --2- 172.21.15.92:0/504011578 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f83780a3240 0x7f83780a5700 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f837c004770 tx=0x7f837c0058d0 comp rx=0 tx=0).stop 2024-09-19T08:56:32.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:32.073+0000 7f83939e0640 1 -- 172.21.15.92:0/504011578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f838c100b20 msgr2=0x7f838c1a0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:32.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:32.073+0000 7f83939e0640 1 --2- 172.21.15.92:0/504011578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f838c100b20 0x7f838c1a0400 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f838800c890 tx=0x7f838800cd50 comp rx=0 tx=0).stop 2024-09-19T08:56:32.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:32.073+0000 7f83939e0640 1 -- 172.21.15.92:0/504011578 shutdown_connections 2024-09-19T08:56:32.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:32.073+0000 7f83939e0640 1 --2- 172.21.15.92:0/504011578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f838c10e500 0x7f838c19a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:32.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:32.073+0000 7f83939e0640 1 --2- 172.21.15.92:0/504011578 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f838c101440 0x7f838c1a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:32.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:32.073+0000 7f83939e0640 1 --2- 172.21.15.92:0/504011578 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f83780a3240 0x7f83780a5700 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:32.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:32.073+0000 7f83939e0640 1 --2- 172.21.15.92:0/504011578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f838c100b20 0x7f838c1a0400 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:32.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:32.073+0000 7f83939e0640 1 -- 172.21.15.92:0/504011578 >> 172.21.15.92:0/504011578 conn(0x7f838c0fc7d0 msgr2=0x7f838c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:32.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:32.073+0000 7f83939e0640 1 -- 172.21.15.92:0/504011578 shutdown_connections 2024-09-19T08:56:32.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:32.073+0000 7f83939e0640 1 -- 172.21.15.92:0/504011578 wait complete. 2024-09-19T08:56:32.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:32 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/504011578' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:56:32.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:32 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/504011578' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:56:32.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:32 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/504011578' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:56:33.377 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2024-09-19T08:56:33.459 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2024-09-19T08:56:33.461 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2024-09-19T08:56:33.543 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-19T08:56:33.553 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T08:54:31.939376+0000', 'modified': '2024-09-19T08:54:40.961053+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24472}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24466': {'gid': 24466, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.190:6837/3700975791', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6836', 'nonce': 3700975791}, {'type': 'v1', 'addr': '172.21.15.190:6837', 'nonce': 3700975791}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.190:6839/3861238400', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6838', 'nonce': 3861238400}, {'type': 'v1', 'addr': '172.21.15.190:6839', 'nonce': 3861238400}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24472, 'qdb_cluster': [24472]} 2024-09-19T08:56:33.553 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T08:56:33.554 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T08:56:33.625 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:33 smithi092 ceph-mon[31407]: pgmap v332: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-19T08:56:33.628 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/: 2024-09-19T08:56:33.628 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-19T08:56:33.628 INFO:teuthology.orchestra.run.smithi092.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 08:56 . 2024-09-19T08:56:33.628 INFO:teuthology.orchestra.run.smithi092.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Sep 19 08:56 .. 2024-09-19T08:56:33.628 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 data 2024-09-19T08:56:33.628 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:33.628 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data: 2024-09-19T08:56:33.628 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-19T08:56:33.628 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 . 2024-09-19T08:56:33.628 INFO:teuthology.orchestra.run.smithi092.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 08:56 .. 2024-09-19T08:56:33.631 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2024-09-19T08:56:33.714 INFO:teuthology.orchestra.run.smithi092.stdout:[Service] 2024-09-19T08:56:33.714 INFO:teuthology.orchestra.run.smithi092.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2024-09-19T08:56:33.714 INFO:teuthology.orchestra.run.smithi092.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2024-09-19T08:56:33.716 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2024-09-19T08:56:33.848 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:33.849 INFO:teuthology.orchestra.run.smithi092.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2024-09-19T08:56:33.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:33 smithi167 ceph-mon[35359]: pgmap v332: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-19T08:56:33.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:33 smithi190 ceph-mon[35358]: pgmap v332: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-19T08:56:34.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.368+0000 7f260576b640 1 -- 172.21.15.92:0/1054792641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2600100e20 msgr2=0x7f2600101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:34.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.368+0000 7f260576b640 1 --2- 172.21.15.92:0/1054792641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2600100e20 0x7f2600101200 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f25f0009900 tx=0x7f25f002a480 comp rx=0 tx=0).stop 2024-09-19T08:56:34.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.368+0000 7f260576b640 1 -- 172.21.15.92:0/1054792641 shutdown_connections 2024-09-19T08:56:34.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.368+0000 7f260576b640 1 --2- 172.21.15.92:0/1054792641 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2600102ef0 0x7f260010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.368+0000 7f260576b640 1 --2- 172.21.15.92:0/1054792641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2600102570 0x7f26001029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.368+0000 7f260576b640 1 --2- 172.21.15.92:0/1054792641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2600100e20 0x7f2600101200 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.368+0000 7f260576b640 1 -- 172.21.15.92:0/1054792641 >> 172.21.15.92:0/1054792641 conn(0x7f26000fc7d0 msgr2=0x7f26000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:34.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.368+0000 7f260576b640 1 -- 172.21.15.92:0/1054792641 shutdown_connections 2024-09-19T08:56:34.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.368+0000 7f260576b640 1 -- 172.21.15.92:0/1054792641 wait complete. 2024-09-19T08:56:34.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.369+0000 7f260576b640 1 Processor -- start 2024-09-19T08:56:34.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.369+0000 7f260576b640 1 -- start start 2024-09-19T08:56:34.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.369+0000 7f260576b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2600100e20 0x7f26001962b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:34.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.369+0000 7f260576b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2600102570 0x7f26001967f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:34.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.369+0000 7f260576b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2600102ef0 0x7f260019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:34.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.369+0000 7f260576b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f260010fec0 con 0x7f2600102ef0 2024-09-19T08:56:34.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.369+0000 7f260576b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f260010fd40 con 0x7f2600100e20 2024-09-19T08:56:34.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.369+0000 7f260576b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2600110040 con 0x7f2600102570 2024-09-19T08:56:34.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.369+0000 7f25ff7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2600102ef0 0x7f260019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:34.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.369+0000 7f25ff7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2600102ef0 0x7f260019ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45244/0 (socket says 172.21.15.92:45244) 2024-09-19T08:56:34.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.369+0000 7f25ff7fe640 1 -- 172.21.15.92:0/3649522939 learned_addr learned my addr 172.21.15.92:0/3649522939 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:34.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.369+0000 7f25fe7fc640 1 --2- 172.21.15.92:0/3649522939 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2600102570 0x7f26001967f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:34.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.369+0000 7f25feffd640 1 --2- 172.21.15.92:0/3649522939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2600100e20 0x7f26001962b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:34.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.370+0000 7f25fe7fc640 1 -- 172.21.15.92:0/3649522939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2600100e20 msgr2=0x7f26001962b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:34.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.370+0000 7f25fe7fc640 1 --2- 172.21.15.92:0/3649522939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2600100e20 0x7f26001962b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.370+0000 7f25fe7fc640 1 -- 172.21.15.92:0/3649522939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2600102ef0 msgr2=0x7f260019ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:34.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.370+0000 7f25fe7fc640 1 --2- 172.21.15.92:0/3649522939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2600102ef0 0x7f260019ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.370+0000 7f25fe7fc640 1 -- 172.21.15.92:0/3649522939 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f260019b260 con 0x7f2600102570 2024-09-19T08:56:34.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.370+0000 7f25ff7fe640 1 --2- 172.21.15.92:0/3649522939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2600102ef0 0x7f260019ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:34.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.370+0000 7f25fe7fc640 1 --2- 172.21.15.92:0/3649522939 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2600102570 0x7f26001967f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f25f4010ad0 tx=0x7f25f4010f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:34.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.370+0000 7f25e7fff640 1 -- 172.21.15.92:0/3649522939 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f401a020 con 0x7f2600102570 2024-09-19T08:56:34.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.370+0000 7f260576b640 1 -- 172.21.15.92:0/3649522939 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f260019b550 con 0x7f2600102570 2024-09-19T08:56:34.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.370+0000 7f25e7fff640 1 -- 172.21.15.92:0/3649522939 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25f400eb70 con 0x7f2600102570 2024-09-19T08:56:34.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.370+0000 7f25e7fff640 1 -- 172.21.15.92:0/3649522939 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f40156d0 con 0x7f2600102570 2024-09-19T08:56:34.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.370+0000 7f260576b640 1 -- 172.21.15.92:0/3649522939 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26001a2e30 con 0x7f2600102570 2024-09-19T08:56:34.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.372+0000 7f2607b44740 1 Processor -- start 2024-09-19T08:56:34.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.373+0000 7f2607b44740 1 -- start start 2024-09-19T08:56:34.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.373+0000 7f25e7fff640 1 -- 172.21.15.92:0/3649522939 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f25f401d020 con 0x7f2600102570 2024-09-19T08:56:34.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.373+0000 7f2607b44740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e8b6508d0 0x560e8b650cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:34.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.373+0000 7f2607b44740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560e8b6511f0 0x560e8b65fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:34.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.373+0000 7f2607b44740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e8b65ffc0 0x560e8b6623b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:34.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.373+0000 7f2607b44740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560e8b5b7090 con 0x560e8b6508d0 2024-09-19T08:56:34.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.373+0000 7f2607b44740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560e8b55ea70 con 0x560e8b65ffc0 2024-09-19T08:56:34.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.373+0000 7f2607b44740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x560e8b5b3050 con 0x560e8b6511f0 2024-09-19T08:56:34.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.373+0000 7f25ff7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e8b6508d0 0x560e8b650cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:34.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.373+0000 7f25ff7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e8b6508d0 0x560e8b650cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45248/0 (socket says 172.21.15.92:45248) 2024-09-19T08:56:34.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.373+0000 7f25ff7fe640 1 -- 172.21.15.92:0/247213362 learned_addr learned my addr 172.21.15.92:0/247213362 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:34.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.373+0000 7f25feffd640 1 --2- 172.21.15.92:0/247213362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560e8b6511f0 0x560e8b65fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:34.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.373+0000 7f25fe7fc640 1 --2- 172.21.15.92:0/247213362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e8b65ffc0 0x560e8b6623b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:34.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.373+0000 7f25ff7fe640 1 -- 172.21.15.92:0/247213362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560e8b6511f0 msgr2=0x560e8b65fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:34.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.373+0000 7f25ff7fe640 1 --2- 172.21.15.92:0/247213362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560e8b6511f0 0x560e8b65fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.373+0000 7f25ff7fe640 1 -- 172.21.15.92:0/247213362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e8b65ffc0 msgr2=0x560e8b6623b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:34.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.373+0000 7f25ff7fe640 1 --2- 172.21.15.92:0/247213362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e8b65ffc0 0x560e8b6623b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.373+0000 7f25ff7fe640 1 -- 172.21.15.92:0/247213362 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e8b56b130 con 0x560e8b6508d0 2024-09-19T08:56:34.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.373+0000 7f25fe7fc640 1 --2- 172.21.15.92:0/247213362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e8b65ffc0 0x560e8b6623b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:56:34.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.373+0000 7f25e7fff640 1 --2- 172.21.15.92:0/3649522939 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f25e80a3240 0x7f25e80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:34.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.374+0000 7f25ff7fe640 1 --2- 172.21.15.92:0/247213362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e8b6508d0 0x560e8b650cb0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f25f8010890 tx=0x7f25f8010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7352ffe24ef09d83 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:34.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.374+0000 7f25feffd640 1 --2- 172.21.15.92:0/3649522939 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f25e80a3240 0x7f25e80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:34.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.374+0000 7f25e7fff640 1 -- 172.21.15.92:0/3649522939 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f25f40088e0 con 0x7f2600102570 2024-09-19T08:56:34.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.374+0000 7f25e57fa640 1 -- 172.21.15.92:0/247213362 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f800ebf0 con 0x560e8b6508d0 2024-09-19T08:56:34.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.374+0000 7f25e57fa640 1 -- 172.21.15.92:0/247213362 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25f8015070 con 0x560e8b6508d0 2024-09-19T08:56:34.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.374+0000 7f25e57fa640 1 -- 172.21.15.92:0/247213362 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f800f620 con 0x560e8b6508d0 2024-09-19T08:56:34.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.375+0000 7f2607b44740 1 -- 172.21.15.92:0/247213362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e8b6508d0 msgr2=0x560e8b650cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:34.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.375+0000 7f25feffd640 1 --2- 172.21.15.92:0/3649522939 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f25e80a3240 0x7f25e80a5700 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f25f0000c00 tx=0x7f25f0005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:34.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.375+0000 7f2607b44740 1 --2- 172.21.15.92:0/247213362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e8b6508d0 0x560e8b650cb0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f25f8010890 tx=0x7f25f8010d50 comp rx=0 tx=0).stop 2024-09-19T08:56:34.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.375+0000 7f2607b44740 1 -- 172.21.15.92:0/247213362 shutdown_connections 2024-09-19T08:56:34.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.375+0000 7f2607b44740 1 --2- 172.21.15.92:0/247213362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e8b65ffc0 0x560e8b6623b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.375+0000 7f2607b44740 1 --2- 172.21.15.92:0/247213362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560e8b6511f0 0x560e8b65fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.375+0000 7f2607b44740 1 --2- 172.21.15.92:0/247213362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e8b6508d0 0x560e8b650cb0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.375+0000 7f2607b44740 1 -- 172.21.15.92:0/247213362 >> 172.21.15.92:0/247213362 conn(0x560e8b64cf60 msgr2=0x560e8b64d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:34.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.375+0000 7f2607b44740 1 -- 172.21.15.92:0/247213362 shutdown_connections 2024-09-19T08:56:34.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.375+0000 7f2607b44740 1 -- 172.21.15.92:0/247213362 wait complete. 2024-09-19T08:56:34.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.375+0000 7f2607b44740 1 -- start start 2024-09-19T08:56:34.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.375+0000 7f2607b44740 1 Processor -- start 2024-09-19T08:56:34.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.375+0000 7f2607b44740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e8b6508d0 0x560e8b65f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:34.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.375+0000 7f2607b44740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e8b6511f0 0x560e8b65cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:34.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.375+0000 7f2607b44740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560e8b65ffc0 0x560e8b65d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:34.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.375+0000 7f2607b44740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560e8b662bf0 con 0x560e8b6511f0 2024-09-19T08:56:34.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.375+0000 7f2607b44740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560e8b571f20 con 0x560e8b6508d0 2024-09-19T08:56:34.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.375+0000 7f2607b44740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x560e8b662d70 con 0x560e8b65ffc0 2024-09-19T08:56:34.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.376+0000 7f2607b44740 10 client.0 _ll_register_callbacks cb 0x560e8b53b030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:34.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.376+0000 7f25fe7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e8b6511f0 0x560e8b65cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:34.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.376+0000 7f25fe7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e8b6511f0 0x560e8b65cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45254/0 (socket says 172.21.15.92:45254) 2024-09-19T08:56:34.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.376+0000 7f25fe7fc640 1 -- 172.21.15.92:0/525015699 learned_addr learned my addr 172.21.15.92:0/525015699 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:34.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.376+0000 7f25ff7fe640 1 --2- 172.21.15.92:0/525015699 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560e8b65ffc0 0x560e8b65d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:34.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.376+0000 7f25feffd640 1 --2- 172.21.15.92:0/525015699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e8b6508d0 0x560e8b65f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:34.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.376+0000 7f25fe7fc640 1 -- 172.21.15.92:0/525015699 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560e8b65ffc0 msgr2=0x560e8b65d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:34.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.376+0000 7f25fe7fc640 1 --2- 172.21.15.92:0/525015699 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560e8b65ffc0 0x560e8b65d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.376+0000 7f25fe7fc640 1 -- 172.21.15.92:0/525015699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e8b6508d0 msgr2=0x560e8b65f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:34.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.376+0000 7f25fe7fc640 1 --2- 172.21.15.92:0/525015699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e8b6508d0 0x560e8b65f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.376+0000 7f25fe7fc640 1 -- 172.21.15.92:0/525015699 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e8b3282b0 con 0x560e8b6511f0 2024-09-19T08:56:34.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.376+0000 7f25fe7fc640 1 --2- 172.21.15.92:0/525015699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e8b6511f0 0x560e8b65cc30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f25f409ad20 tx=0x7f25f409dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a45d326cb3c0cea6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:34.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.376+0000 7f25e2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:56:34.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.376+0000 7f25e2ff5640 1 -- 172.21.15.92:0/525015699 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f4008e60 con 0x560e8b6511f0 2024-09-19T08:56:34.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.376+0000 7f25e2ff5640 1 -- 172.21.15.92:0/525015699 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f25f409d7a0 con 0x560e8b6511f0 2024-09-19T08:56:34.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.376+0000 7f2607b44740 1 -- 172.21.15.92:0/525015699 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25f8015070 con 0x560e8b6511f0 2024-09-19T08:56:34.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.376+0000 7f25e2ff5640 1 -- 172.21.15.92:0/525015699 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f25f40a6fc0 con 0x560e8b6511f0 2024-09-19T08:56:34.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.376+0000 7f2607b44740 10 client.15264 fetch_fsmap learned FSMap version 19 2024-09-19T08:56:34.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.376+0000 7f2607b44740 1 -- 172.21.15.92:0/525015699 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x560e8b66e520 con 0x560e8b6511f0 2024-09-19T08:56:34.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.377+0000 7f25e2ff5640 1 -- 172.21.15.92:0/525015699 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25f8015070 con 0x560e8b6511f0 2024-09-19T08:56:34.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.377+0000 7f25e2ff5640 1 -- 172.21.15.92:0/525015699 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f25f400b020 con 0x560e8b6511f0 2024-09-19T08:56:34.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.377+0000 7f2607b44740 10 client.15264 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:56:34.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.377+0000 7f2607b44740 10 client.15264 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T08:56:34.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.377+0000 7f2607b44740 20 client.15264 populate_metadata read hostname 'smithi092' 2024-09-19T08:56:34.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.377+0000 7f2607b44740 1 --2- 172.21.15.92:0/525015699 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x560e8b670b10 0x560e8b671f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:34.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.377+0000 7f2607b44740 4 client.15264 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:56:34.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.377+0000 7f2607b44740 1 -- 172.21.15.92:0/525015699 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e8b5c4600 con 0x560e8b670b10 2024-09-19T08:56:34.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.377+0000 7f25feffd640 1 --2- 172.21.15.92:0/525015699 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x560e8b670b10 0x560e8b671f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:34.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.377+0000 7f25feffd640 1 --2- 172.21.15.92:0/525015699 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x560e8b670b10 0x560e8b671f80 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80177c3b8b5eaaa2 server_cookie=aa14499a8b8a11cf in_seq=0 out_seq=0 2024-09-19T08:56:34.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.377+0000 7f25e2ff5640 10 client.15264 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:34.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.378+0000 7f25e2ff5640 1 -- 172.21.15.92:0/525015699 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560e8b5c4600 con 0x560e8b670b10 2024-09-19T08:56:34.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.378+0000 7f25e2ff5640 10 client.15264 handle_command_reply: tid=0 2024-09-19T08:56:34.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.378+0000 7f2607b44740 1 client.15264 shutdown 2024-09-19T08:56:34.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.378+0000 7f2607b44740 1 -- 172.21.15.92:0/525015699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e8b6511f0 msgr2=0x560e8b65cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:34.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.378+0000 7f2607b44740 1 --2- 172.21.15.92:0/525015699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e8b6511f0 0x560e8b65cc30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f25f409ad20 tx=0x7f25f409dd70 comp rx=0 tx=0).stop 2024-09-19T08:56:34.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.378+0000 7f2607b44740 1 -- 172.21.15.92:0/525015699 shutdown_connections 2024-09-19T08:56:34.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.378+0000 7f2607b44740 1 --2- 172.21.15.92:0/525015699 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x560e8b670b10 0x560e8b671f80 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.378+0000 7f2607b44740 1 --2- 172.21.15.92:0/525015699 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560e8b65ffc0 0x560e8b65d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.378+0000 7f2607b44740 1 --2- 172.21.15.92:0/525015699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e8b6511f0 0x560e8b65cc30 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.378+0000 7f2607b44740 1 --2- 172.21.15.92:0/525015699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e8b6508d0 0x560e8b65f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.379+0000 7f2607b44740 1 -- 172.21.15.92:0/525015699 >> 172.21.15.92:0/525015699 conn(0x560e8b64cf60 msgr2=0x560e8b652cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:34.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.379+0000 7f25e2ff5640 0 client.15264 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:34.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.379+0000 7f2607b44740 1 -- 172.21.15.92:0/525015699 shutdown_connections 2024-09-19T08:56:34.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.379+0000 7f2607b44740 1 -- 172.21.15.92:0/525015699 wait complete. 2024-09-19T08:56:34.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.379+0000 7f2607b44740 20 client.15264 trim_cache size 0 max 16384 2024-09-19T08:56:34.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.398+0000 7f2607b44740 1 Processor -- start 2024-09-19T08:56:34.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.398+0000 7f2607b44740 1 -- start start 2024-09-19T08:56:34.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.398+0000 7f2607b44740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560e8b6508d0 0x560e8b66c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:34.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.398+0000 7f2607b44740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e8b6511f0 0x560e8b671f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:34.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.398+0000 7f2607b44740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e8b65ffc0 0x560e8b670440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:34.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.398+0000 7f2607b44740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560e8b6702c0 con 0x560e8b65ffc0 2024-09-19T08:56:34.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.398+0000 7f2607b44740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560e8b670990 con 0x560e8b6511f0 2024-09-19T08:56:34.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.398+0000 7f2607b44740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x560e8b671060 con 0x560e8b6508d0 2024-09-19T08:56:34.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.398+0000 7f25ff7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e8b65ffc0 0x560e8b670440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:34.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.398+0000 7f25ff7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e8b65ffc0 0x560e8b670440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45256/0 (socket says 172.21.15.92:45256) 2024-09-19T08:56:34.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.398+0000 7f25ff7fe640 1 -- 172.21.15.92:0/3483903468 learned_addr learned my addr 172.21.15.92:0/3483903468 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:34.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.398+0000 7f25feffd640 1 --2- 172.21.15.92:0/3483903468 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560e8b6508d0 0x560e8b66c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:34.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.398+0000 7f25fe7fc640 1 --2- 172.21.15.92:0/3483903468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e8b6511f0 0x560e8b671f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:34.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.399+0000 7f25ff7fe640 1 -- 172.21.15.92:0/3483903468 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560e8b6508d0 msgr2=0x560e8b66c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:34.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.399+0000 7f25ff7fe640 1 --2- 172.21.15.92:0/3483903468 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560e8b6508d0 0x560e8b66c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.399+0000 7f25ff7fe640 1 -- 172.21.15.92:0/3483903468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e8b6511f0 msgr2=0x560e8b671f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:34.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.399+0000 7f25ff7fe640 1 --2- 172.21.15.92:0/3483903468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e8b6511f0 0x560e8b671f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.399+0000 7f25ff7fe640 1 -- 172.21.15.92:0/3483903468 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e8b64c7f0 con 0x560e8b65ffc0 2024-09-19T08:56:34.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.399+0000 7f25fe7fc640 1 --2- 172.21.15.92:0/3483903468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e8b6511f0 0x560e8b671f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:56:34.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.399+0000 7f25ff7fe640 1 --2- 172.21.15.92:0/3483903468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e8b65ffc0 0x560e8b670440 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f25f8010890 tx=0x7f25f8009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2009ad6e3694c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:34.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.399+0000 7f25e4ff9640 1 -- 172.21.15.92:0/3483903468 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f8011e60 con 0x560e8b65ffc0 2024-09-19T08:56:34.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.399+0000 7f25e4ff9640 1 -- 172.21.15.92:0/3483903468 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25f8015050 con 0x560e8b65ffc0 2024-09-19T08:56:34.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.399+0000 7f25e4ff9640 1 -- 172.21.15.92:0/3483903468 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f80118e0 con 0x560e8b65ffc0 2024-09-19T08:56:34.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.400+0000 7f2607b44740 1 -- 172.21.15.92:0/3483903468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e8b65ffc0 msgr2=0x560e8b670440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:34.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.400+0000 7f2607b44740 1 --2- 172.21.15.92:0/3483903468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e8b65ffc0 0x560e8b670440 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f25f8010890 tx=0x7f25f8009f10 comp rx=0 tx=0).stop 2024-09-19T08:56:34.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.400+0000 7f2607b44740 1 -- 172.21.15.92:0/3483903468 shutdown_connections 2024-09-19T08:56:34.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.400+0000 7f2607b44740 1 --2- 172.21.15.92:0/3483903468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e8b65ffc0 0x560e8b670440 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.400+0000 7f2607b44740 1 --2- 172.21.15.92:0/3483903468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e8b6511f0 0x560e8b671f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.400+0000 7f2607b44740 1 --2- 172.21.15.92:0/3483903468 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560e8b6508d0 0x560e8b66c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.400+0000 7f2607b44740 1 -- 172.21.15.92:0/3483903468 >> 172.21.15.92:0/3483903468 conn(0x560e8b64cf60 msgr2=0x560e8b64d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:34.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.400+0000 7f2607b44740 1 -- 172.21.15.92:0/3483903468 shutdown_connections 2024-09-19T08:56:34.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.400+0000 7f2607b44740 1 -- 172.21.15.92:0/3483903468 wait complete. 2024-09-19T08:56:34.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.400+0000 7f2607b44740 1 -- start start 2024-09-19T08:56:34.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.400+0000 7f2607b44740 1 Processor -- start 2024-09-19T08:56:34.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.400+0000 7f2607b44740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e8b6508d0 0x560e8b673180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:34.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.400+0000 7f2607b44740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560e8b6511f0 0x560e8b6736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:34.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.400+0000 7f2607b44740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e8b65ffc0 0x560e8b673c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:34.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.400+0000 7f2607b44740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560e8b671e00 con 0x560e8b6508d0 2024-09-19T08:56:34.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.400+0000 7f2607b44740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560e8b671730 con 0x560e8b65ffc0 2024-09-19T08:56:34.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.400+0000 7f2607b44740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x560e8b6724d0 con 0x560e8b6511f0 2024-09-19T08:56:34.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.400+0000 7f2607b44740 10 client.0 _ll_register_callbacks cb 0x7f25f4016c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:34.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.400+0000 7f25feffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e8b6508d0 0x560e8b673180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:34.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.400+0000 7f25feffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e8b6508d0 0x560e8b673180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45266/0 (socket says 172.21.15.92:45266) 2024-09-19T08:56:34.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.400+0000 7f25feffd640 1 -- 172.21.15.92:0/2507654599 learned_addr learned my addr 172.21.15.92:0/2507654599 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:34.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.400+0000 7f25fe7fc640 1 --2- 172.21.15.92:0/2507654599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560e8b6511f0 0x560e8b6736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:34.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.401+0000 7f25ff7fe640 1 --2- 172.21.15.92:0/2507654599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e8b65ffc0 0x560e8b673c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:34.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.401+0000 7f25feffd640 1 -- 172.21.15.92:0/2507654599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560e8b6511f0 msgr2=0x560e8b6736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:34.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.401+0000 7f25feffd640 1 --2- 172.21.15.92:0/2507654599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560e8b6511f0 0x560e8b6736c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.401+0000 7f25feffd640 1 -- 172.21.15.92:0/2507654599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e8b65ffc0 msgr2=0x560e8b673c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:34.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.401+0000 7f25feffd640 1 --2- 172.21.15.92:0/2507654599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e8b65ffc0 0x560e8b673c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.401+0000 7f25feffd640 1 -- 172.21.15.92:0/2507654599 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e8b6d92e0 con 0x560e8b6508d0 2024-09-19T08:56:34.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.401+0000 7f25feffd640 1 --2- 172.21.15.92:0/2507654599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e8b6508d0 0x560e8b673180 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f25f0009230 tx=0x7f25f0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c538d76119c256 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:34.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.401+0000 7f25e2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:56:34.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.401+0000 7f25e2ff5640 1 -- 172.21.15.92:0/2507654599 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f0035040 con 0x560e8b6508d0 2024-09-19T08:56:34.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.401+0000 7f25e2ff5640 1 -- 172.21.15.92:0/2507654599 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f25f0004af0 con 0x560e8b6508d0 2024-09-19T08:56:34.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.401+0000 7f2607b44740 1 -- 172.21.15.92:0/2507654599 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25f8015050 con 0x560e8b6508d0 2024-09-19T08:56:34.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.401+0000 7f25e2ff5640 1 -- 172.21.15.92:0/2507654599 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f25f0004cf0 con 0x560e8b6508d0 2024-09-19T08:56:34.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.401+0000 7f2607b44740 10 client.15270 fetch_fsmap learned FSMap version 19 2024-09-19T08:56:34.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.401+0000 7f2607b44740 1 -- 172.21.15.92:0/2507654599 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x560e8b6da5b0 con 0x560e8b6508d0 2024-09-19T08:56:34.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.401+0000 7f25e2ff5640 1 -- 172.21.15.92:0/2507654599 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25f8015050 con 0x560e8b6508d0 2024-09-19T08:56:34.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.402+0000 7f25e2ff5640 1 -- 172.21.15.92:0/2507654599 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f25f005b070 con 0x560e8b6508d0 2024-09-19T08:56:34.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.402+0000 7f2607b44740 10 client.15270 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:56:34.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.402+0000 7f2607b44740 10 client.15270 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T08:56:34.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.402+0000 7f2607b44740 20 client.15270 populate_metadata read hostname 'smithi092' 2024-09-19T08:56:34.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.402+0000 7f2607b44740 1 --2- 172.21.15.92:0/2507654599 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x560e8b6df1e0 0x560e8b6ddef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:34.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.402+0000 7f2607b44740 4 client.15270 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T08:56:34.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.402+0000 7f2607b44740 1 -- 172.21.15.92:0/2507654599 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "status"}) -- 0x560e8b5beb10 con 0x560e8b6df1e0 2024-09-19T08:56:34.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.402+0000 7f25fe7fc640 1 --2- 172.21.15.92:0/2507654599 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x560e8b6df1e0 0x560e8b6ddef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:34.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.402+0000 7f25fe7fc640 1 --2- 172.21.15.92:0/2507654599 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x560e8b6df1e0 0x560e8b6ddef0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3475399326599699 server_cookie=aae106ae8b79f669 in_seq=0 out_seq=0 2024-09-19T08:56:34.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.402+0000 7f25e2ff5640 10 client.15270 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:34.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.403+0000 7f25e2ff5640 1 -- 172.21.15.92:0/2507654599 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x560e8b5beb10 con 0x560e8b6df1e0 2024-09-19T08:56:34.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.403+0000 7f25e2ff5640 10 client.15270 handle_command_reply: tid=0 2024-09-19T08:56:34.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.403+0000 7f2607b44740 1 client.15270 shutdown 2024-09-19T08:56:34.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.403+0000 7f2607b44740 1 -- 172.21.15.92:0/2507654599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e8b6508d0 msgr2=0x560e8b673180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:34.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.403+0000 7f2607b44740 1 --2- 172.21.15.92:0/2507654599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e8b6508d0 0x560e8b673180 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f25f0009230 tx=0x7f25f0009260 comp rx=0 tx=0).stop 2024-09-19T08:56:34.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.403+0000 7f2607b44740 1 -- 172.21.15.92:0/2507654599 shutdown_connections 2024-09-19T08:56:34.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.403+0000 7f2607b44740 1 --2- 172.21.15.92:0/2507654599 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x560e8b6df1e0 0x560e8b6ddef0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.403+0000 7f2607b44740 1 --2- 172.21.15.92:0/2507654599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e8b65ffc0 0x560e8b673c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.403+0000 7f2607b44740 1 --2- 172.21.15.92:0/2507654599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560e8b6511f0 0x560e8b6736c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.403+0000 7f2607b44740 1 --2- 172.21.15.92:0/2507654599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e8b6508d0 0x560e8b673180 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.403+0000 7f2607b44740 1 -- 172.21.15.92:0/2507654599 >> 172.21.15.92:0/2507654599 conn(0x560e8b64cf60 msgr2=0x560e8b658240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:34.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.403+0000 7f25e2ff5640 0 client.15270 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:34.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.403+0000 7f2607b44740 1 -- 172.21.15.92:0/2507654599 shutdown_connections 2024-09-19T08:56:34.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.403+0000 7f2607b44740 1 -- 172.21.15.92:0/2507654599 wait complete. 2024-09-19T08:56:34.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.403+0000 7f2607b44740 20 client.15270 trim_cache size 0 max 16384 2024-09-19T08:56:34.411 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T08:56:34.411 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "91ff74f2-7663-11ef-bceb-c7b262605968", 2024-09-19T08:56:34.411 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 0, 2024-09-19T08:56:34.411 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24472, 2024-09-19T08:56:34.411 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-09-19T08:56:34.411 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-09-19T08:56:34.412 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-09-19T08:56:34.412 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 121.976453725, 2024-09-19T08:56:34.412 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 19, 2024-09-19T08:56:34.412 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 82, 2024-09-19T08:56:34.412 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 80, 2024-09-19T08:56:34.412 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 140.83387581100001 2024-09-19T08:56:34.412 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T08:56:34.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.404+0000 7f260576b640 1 -- 172.21.15.92:0/3649522939 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f25e80a3240 msgr2=0x7f25e80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:34.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.404+0000 7f260576b640 1 --2- 172.21.15.92:0/3649522939 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f25e80a3240 0x7f25e80a5700 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f25f0000c00 tx=0x7f25f0005b50 comp rx=0 tx=0).stop 2024-09-19T08:56:34.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.404+0000 7f260576b640 1 -- 172.21.15.92:0/3649522939 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2600102570 msgr2=0x7f26001967f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:34.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.404+0000 7f260576b640 1 --2- 172.21.15.92:0/3649522939 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2600102570 0x7f26001967f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f25f4010ad0 tx=0x7f25f4010f90 comp rx=0 tx=0).stop 2024-09-19T08:56:34.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.404+0000 7f260576b640 1 -- 172.21.15.92:0/3649522939 shutdown_connections 2024-09-19T08:56:34.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.404+0000 7f260576b640 1 --2- 172.21.15.92:0/3649522939 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f25e80a3240 0x7f25e80a5700 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.404+0000 7f260576b640 1 --2- 172.21.15.92:0/3649522939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2600102ef0 0x7f260019ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.404+0000 7f260576b640 1 --2- 172.21.15.92:0/3649522939 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2600102570 0x7f26001967f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.404+0000 7f260576b640 1 --2- 172.21.15.92:0/3649522939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2600100e20 0x7f26001962b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.404+0000 7f260576b640 1 -- 172.21.15.92:0/3649522939 >> 172.21.15.92:0/3649522939 conn(0x7f26000fc7d0 msgr2=0x7f26000fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:34.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.404+0000 7f260576b640 1 -- 172.21.15.92:0/3649522939 shutdown_connections 2024-09-19T08:56:34.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:34.404+0000 7f260576b640 1 -- 172.21.15.92:0/3649522939 wait complete. 2024-09-19T08:56:35.268 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-19T08:56:35.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:35 smithi092 ceph-mon[31407]: pgmap v333: 97 pgs: 97 active+clean; 661 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.8 KiB/s wr, 6 op/s 2024-09-19T08:56:35.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:35 smithi167 ceph-mon[35359]: pgmap v333: 97 pgs: 97 active+clean; 661 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.8 KiB/s wr, 6 op/s 2024-09-19T08:56:35.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:35 smithi190 ceph-mon[35358]: pgmap v333: 97 pgs: 97 active+clean; 661 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.8 KiB/s wr, 6 op/s 2024-09-19T08:56:37.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:37 smithi092 ceph-mon[31407]: pgmap v334: 97 pgs: 97 active+clean; 661 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 6.2 KiB/s wr, 7 op/s 2024-09-19T08:56:37.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:37 smithi167 ceph-mon[35359]: pgmap v334: 97 pgs: 97 active+clean; 661 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 6.2 KiB/s wr, 7 op/s 2024-09-19T08:56:37.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:37 smithi190 ceph-mon[35358]: pgmap v334: 97 pgs: 97 active+clean; 661 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 6.2 KiB/s wr, 7 op/s 2024-09-19T08:56:39.117 INFO:teuthology.orchestra.run.smithi092.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2024-09-19T08:56:39.120 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-19T08:56:39.166 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/: 2024-09-19T08:56:39.166 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-19T08:56:39.166 INFO:teuthology.orchestra.run.smithi092.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 08:56 . 2024-09-19T08:56:39.166 INFO:teuthology.orchestra.run.smithi092.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Sep 19 08:56 .. 2024-09-19T08:56:39.166 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 08:56 data 2024-09-19T08:56:39.166 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:39.166 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data: 2024-09-19T08:56:39.167 INFO:teuthology.orchestra.run.smithi092.stdout:total 35 2024-09-19T08:56:39.167 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 08:56 . 2024-09-19T08:56:39.167 INFO:teuthology.orchestra.run.smithi092.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 08:56 .. 2024-09-19T08:56:39.167 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 08:56 base 2024-09-19T08:56:39.167 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57 Sep 19 08:56 global 2024-09-19T08:56:39.167 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 log 2024-09-19T08:56:39.167 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 pg_commit_ts 2024-09-19T08:56:39.167 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 pg_dynshmem 2024-09-19T08:56:39.167 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 Sep 19 08:56 pg_hba.conf 2024-09-19T08:56:39.167 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Sep 19 08:56 pg_ident.conf 2024-09-19T08:56:39.167 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 08:56 pg_logical 2024-09-19T08:56:39.167 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 19 08:56 pg_multixact 2024-09-19T08:56:39.168 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 pg_notify 2024-09-19T08:56:39.168 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 pg_replslot 2024-09-19T08:56:39.168 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 pg_serial 2024-09-19T08:56:39.168 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 pg_snapshots 2024-09-19T08:56:39.168 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 pg_stat 2024-09-19T08:56:39.168 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 pg_stat_tmp 2024-09-19T08:56:39.168 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 08:56 pg_subtrans 2024-09-19T08:56:39.168 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 pg_tblspc 2024-09-19T08:56:39.168 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 pg_twophase 2024-09-19T08:56:39.168 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 08:56 PG_VERSION 2024-09-19T08:56:39.169 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 19 08:56 pg_wal 2024-09-19T08:56:39.169 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 08:56 pg_xact 2024-09-19T08:56:39.169 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Sep 19 08:56 postgresql.auto.conf 2024-09-19T08:56:39.169 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28074 Sep 19 08:56 postgresql.conf 2024-09-19T08:56:39.169 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:39.169 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/base: 2024-09-19T08:56:39.169 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-19T08:56:39.169 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 08:56 . 2024-09-19T08:56:39.169 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 08:56 .. 2024-09-19T08:56:39.169 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 19 08:56 1 2024-09-19T08:56:39.169 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 19 08:56 13493 2024-09-19T08:56:39.170 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 19 08:56 13494 2024-09-19T08:56:39.170 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:39.170 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/base/1: 2024-09-19T08:56:39.170 INFO:teuthology.orchestra.run.smithi092.stdout:total 7777 2024-09-19T08:56:39.170 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 19 08:56 . 2024-09-19T08:56:39.170 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 08:56 .. 2024-09-19T08:56:39.170 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 112 2024-09-19T08:56:39.170 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 113 2024-09-19T08:56:39.170 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 19 08:56 1247 2024-09-19T08:56:39.170 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 1247_fsm 2024-09-19T08:56:39.170 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1247_vm 2024-09-19T08:56:39.170 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 19 08:56 1249 2024-09-19T08:56:39.171 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 1249_fsm 2024-09-19T08:56:39.171 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1249_vm 2024-09-19T08:56:39.171 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 19 08:56 1255 2024-09-19T08:56:39.171 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 1255_fsm 2024-09-19T08:56:39.171 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1255_vm 2024-09-19T08:56:39.171 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 19 08:56 1259 2024-09-19T08:56:39.171 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 1259_fsm 2024-09-19T08:56:39.171 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1259_vm 2024-09-19T08:56:39.171 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 19 08:56 13344 2024-09-19T08:56:39.171 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 13344_fsm 2024-09-19T08:56:39.171 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13344_vm 2024-09-19T08:56:39.171 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 13346 2024-09-19T08:56:39.172 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13348 2024-09-19T08:56:39.172 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13349 2024-09-19T08:56:39.172 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 13349_fsm 2024-09-19T08:56:39.172 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13349_vm 2024-09-19T08:56:39.172 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 13351 2024-09-19T08:56:39.172 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13353 2024-09-19T08:56:39.172 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13354 2024-09-19T08:56:39.172 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 13354_fsm 2024-09-19T08:56:39.172 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13354_vm 2024-09-19T08:56:39.172 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 13356 2024-09-19T08:56:39.172 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13358 2024-09-19T08:56:39.173 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13359 2024-09-19T08:56:39.173 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 13359_fsm 2024-09-19T08:56:39.173 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13359_vm 2024-09-19T08:56:39.173 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 13361 2024-09-19T08:56:39.173 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13363 2024-09-19T08:56:39.173 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 1417 2024-09-19T08:56:39.173 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 1418 2024-09-19T08:56:39.173 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 174 2024-09-19T08:56:39.173 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 175 2024-09-19T08:56:39.173 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2187 2024-09-19T08:56:39.173 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2224 2024-09-19T08:56:39.173 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2328 2024-09-19T08:56:39.174 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2336 2024-09-19T08:56:39.174 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2337 2024-09-19T08:56:39.174 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2579 2024-09-19T08:56:39.174 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2600 2024-09-19T08:56:39.174 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2600_fsm 2024-09-19T08:56:39.174 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2600_vm 2024-09-19T08:56:39.174 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2601 2024-09-19T08:56:39.174 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2601_fsm 2024-09-19T08:56:39.174 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2601_vm 2024-09-19T08:56:39.174 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 08:56 2602 2024-09-19T08:56:39.174 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2602_fsm 2024-09-19T08:56:39.175 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2602_vm 2024-09-19T08:56:39.175 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2603 2024-09-19T08:56:39.175 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2603_fsm 2024-09-19T08:56:39.175 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2603_vm 2024-09-19T08:56:39.175 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2604 2024-09-19T08:56:39.175 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2605 2024-09-19T08:56:39.175 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2605_fsm 2024-09-19T08:56:39.175 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2605_vm 2024-09-19T08:56:39.175 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2606 2024-09-19T08:56:39.175 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2606_fsm 2024-09-19T08:56:39.175 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2606_vm 2024-09-19T08:56:39.176 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2607 2024-09-19T08:56:39.176 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2607_fsm 2024-09-19T08:56:39.176 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2607_vm 2024-09-19T08:56:39.176 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 19 08:56 2608 2024-09-19T08:56:39.176 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2608_fsm 2024-09-19T08:56:39.177 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2608_vm 2024-09-19T08:56:39.177 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 19 08:56 2609 2024-09-19T08:56:39.177 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2609_fsm 2024-09-19T08:56:39.177 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2609_vm 2024-09-19T08:56:39.177 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2610 2024-09-19T08:56:39.177 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2610_fsm 2024-09-19T08:56:39.177 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2610_vm 2024-09-19T08:56:39.177 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2611 2024-09-19T08:56:39.177 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2612 2024-09-19T08:56:39.177 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2612_fsm 2024-09-19T08:56:39.177 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2612_vm 2024-09-19T08:56:39.177 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2613 2024-09-19T08:56:39.177 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2615 2024-09-19T08:56:39.177 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2615_fsm 2024-09-19T08:56:39.178 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2615_vm 2024-09-19T08:56:39.178 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2616 2024-09-19T08:56:39.178 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2616_fsm 2024-09-19T08:56:39.178 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2616_vm 2024-09-19T08:56:39.178 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 19 08:56 2617 2024-09-19T08:56:39.178 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2617_fsm 2024-09-19T08:56:39.178 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2617_vm 2024-09-19T08:56:39.178 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 19 08:56 2618 2024-09-19T08:56:39.178 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2618_fsm 2024-09-19T08:56:39.178 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2618_vm 2024-09-19T08:56:39.178 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 19 08:56 2619 2024-09-19T08:56:39.178 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2619_fsm 2024-09-19T08:56:39.178 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2619_vm 2024-09-19T08:56:39.179 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2620 2024-09-19T08:56:39.179 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2650 2024-09-19T08:56:39.179 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2651 2024-09-19T08:56:39.179 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2652 2024-09-19T08:56:39.179 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 08:56 2653 2024-09-19T08:56:39.179 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 08:56 2654 2024-09-19T08:56:39.179 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2655 2024-09-19T08:56:39.179 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2656 2024-09-19T08:56:39.179 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2657 2024-09-19T08:56:39.179 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 19 08:56 2658 2024-09-19T08:56:39.179 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 19 08:56 2659 2024-09-19T08:56:39.179 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2660 2024-09-19T08:56:39.179 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2661 2024-09-19T08:56:39.180 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2662 2024-09-19T08:56:39.180 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 08:56 2663 2024-09-19T08:56:39.180 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2664 2024-09-19T08:56:39.180 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2665 2024-09-19T08:56:39.180 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2666 2024-09-19T08:56:39.180 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2667 2024-09-19T08:56:39.180 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2668 2024-09-19T08:56:39.180 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2669 2024-09-19T08:56:39.180 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2670 2024-09-19T08:56:39.180 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 19 08:56 2673 2024-09-19T08:56:39.180 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 19 08:56 2674 2024-09-19T08:56:39.180 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 19 08:56 2675 2024-09-19T08:56:39.180 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2678 2024-09-19T08:56:39.181 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2679 2024-09-19T08:56:39.181 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2680 2024-09-19T08:56:39.181 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2681 2024-09-19T08:56:39.181 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2682 2024-09-19T08:56:39.181 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2683 2024-09-19T08:56:39.181 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2684 2024-09-19T08:56:39.181 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2685 2024-09-19T08:56:39.181 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2686 2024-09-19T08:56:39.181 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2687 2024-09-19T08:56:39.181 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 08:56 2688 2024-09-19T08:56:39.181 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 08:56 2689 2024-09-19T08:56:39.181 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 19 08:56 2690 2024-09-19T08:56:39.181 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 19 08:56 2691 2024-09-19T08:56:39.181 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2692 2024-09-19T08:56:39.182 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2693 2024-09-19T08:56:39.182 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2696 2024-09-19T08:56:39.182 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2699 2024-09-19T08:56:39.182 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2701 2024-09-19T08:56:39.182 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2702 2024-09-19T08:56:39.182 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2703 2024-09-19T08:56:39.182 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 08:56 2704 2024-09-19T08:56:39.182 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2753 2024-09-19T08:56:39.182 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2753_fsm 2024-09-19T08:56:39.182 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2753_vm 2024-09-19T08:56:39.182 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2754 2024-09-19T08:56:39.182 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2755 2024-09-19T08:56:39.182 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2756 2024-09-19T08:56:39.183 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2757 2024-09-19T08:56:39.183 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2830 2024-09-19T08:56:39.183 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2831 2024-09-19T08:56:39.183 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2832 2024-09-19T08:56:39.183 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2833 2024-09-19T08:56:39.183 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2834 2024-09-19T08:56:39.183 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2835 2024-09-19T08:56:39.183 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2836 2024-09-19T08:56:39.183 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2837 2024-09-19T08:56:39.183 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 19 08:56 2838 2024-09-19T08:56:39.183 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2838_fsm 2024-09-19T08:56:39.183 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2838_vm 2024-09-19T08:56:39.183 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2839 2024-09-19T08:56:39.183 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2840 2024-09-19T08:56:39.184 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2840_fsm 2024-09-19T08:56:39.184 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2840_vm 2024-09-19T08:56:39.184 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2841 2024-09-19T08:56:39.184 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2995 2024-09-19T08:56:39.184 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2996 2024-09-19T08:56:39.184 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3079 2024-09-19T08:56:39.184 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3079_fsm 2024-09-19T08:56:39.184 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3079_vm 2024-09-19T08:56:39.184 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3080 2024-09-19T08:56:39.184 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3081 2024-09-19T08:56:39.184 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 08:56 3085 2024-09-19T08:56:39.184 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3118 2024-09-19T08:56:39.185 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3119 2024-09-19T08:56:39.185 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 19 08:56 3164 2024-09-19T08:56:39.185 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3256 2024-09-19T08:56:39.185 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3257 2024-09-19T08:56:39.185 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3258 2024-09-19T08:56:39.185 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3350 2024-09-19T08:56:39.185 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3351 2024-09-19T08:56:39.185 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3379 2024-09-19T08:56:39.185 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3380 2024-09-19T08:56:39.185 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3381 2024-09-19T08:56:39.185 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3394 2024-09-19T08:56:39.185 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3394_fsm 2024-09-19T08:56:39.185 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3394_vm 2024-09-19T08:56:39.185 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3395 2024-09-19T08:56:39.186 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3429 2024-09-19T08:56:39.186 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3430 2024-09-19T08:56:39.186 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3431 2024-09-19T08:56:39.186 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3433 2024-09-19T08:56:39.186 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3439 2024-09-19T08:56:39.186 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3440 2024-09-19T08:56:39.186 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 08:56 3455 2024-09-19T08:56:39.186 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 19 08:56 3456 2024-09-19T08:56:39.186 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3456_fsm 2024-09-19T08:56:39.186 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3456_vm 2024-09-19T08:56:39.186 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3466 2024-09-19T08:56:39.186 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3467 2024-09-19T08:56:39.186 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3468 2024-09-19T08:56:39.187 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3501 2024-09-19T08:56:39.187 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3502 2024-09-19T08:56:39.187 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3503 2024-09-19T08:56:39.187 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3534 2024-09-19T08:56:39.187 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3541 2024-09-19T08:56:39.187 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3541_fsm 2024-09-19T08:56:39.187 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3541_vm 2024-09-19T08:56:39.187 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3542 2024-09-19T08:56:39.187 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3574 2024-09-19T08:56:39.187 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3575 2024-09-19T08:56:39.187 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3576 2024-09-19T08:56:39.187 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3596 2024-09-19T08:56:39.187 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3597 2024-09-19T08:56:39.187 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3598 2024-09-19T08:56:39.188 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3599 2024-09-19T08:56:39.188 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3600 2024-09-19T08:56:39.188 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3600_fsm 2024-09-19T08:56:39.188 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3600_vm 2024-09-19T08:56:39.188 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3601 2024-09-19T08:56:39.188 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3601_fsm 2024-09-19T08:56:39.188 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3601_vm 2024-09-19T08:56:39.188 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3602 2024-09-19T08:56:39.188 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3602_fsm 2024-09-19T08:56:39.188 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3602_vm 2024-09-19T08:56:39.188 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3603 2024-09-19T08:56:39.188 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3603_fsm 2024-09-19T08:56:39.189 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3603_vm 2024-09-19T08:56:39.189 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3604 2024-09-19T08:56:39.189 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3605 2024-09-19T08:56:39.189 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3606 2024-09-19T08:56:39.189 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3607 2024-09-19T08:56:39.189 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3608 2024-09-19T08:56:39.189 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 3609 2024-09-19T08:56:39.189 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3712 2024-09-19T08:56:39.189 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3764 2024-09-19T08:56:39.189 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3764_fsm 2024-09-19T08:56:39.189 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3764_vm 2024-09-19T08:56:39.189 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3766 2024-09-19T08:56:39.189 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3767 2024-09-19T08:56:39.189 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3997 2024-09-19T08:56:39.190 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4143 2024-09-19T08:56:39.190 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4144 2024-09-19T08:56:39.190 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4145 2024-09-19T08:56:39.190 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4146 2024-09-19T08:56:39.190 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4147 2024-09-19T08:56:39.190 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4148 2024-09-19T08:56:39.190 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4149 2024-09-19T08:56:39.190 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4150 2024-09-19T08:56:39.190 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4151 2024-09-19T08:56:39.190 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4152 2024-09-19T08:56:39.190 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4153 2024-09-19T08:56:39.190 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4154 2024-09-19T08:56:39.190 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4155 2024-09-19T08:56:39.191 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4156 2024-09-19T08:56:39.191 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4157 2024-09-19T08:56:39.191 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4158 2024-09-19T08:56:39.191 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4159 2024-09-19T08:56:39.191 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4160 2024-09-19T08:56:39.191 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4161 2024-09-19T08:56:39.191 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4162 2024-09-19T08:56:39.191 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4163 2024-09-19T08:56:39.191 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4164 2024-09-19T08:56:39.191 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4165 2024-09-19T08:56:39.194 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4166 2024-09-19T08:56:39.194 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4167 2024-09-19T08:56:39.194 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4168 2024-09-19T08:56:39.194 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4169 2024-09-19T08:56:39.194 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4170 2024-09-19T08:56:39.195 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4171 2024-09-19T08:56:39.195 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4172 2024-09-19T08:56:39.195 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4173 2024-09-19T08:56:39.195 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4174 2024-09-19T08:56:39.195 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 5002 2024-09-19T08:56:39.195 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 548 2024-09-19T08:56:39.195 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 549 2024-09-19T08:56:39.195 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 6102 2024-09-19T08:56:39.195 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 6104 2024-09-19T08:56:39.195 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 6106 2024-09-19T08:56:39.195 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 6110 2024-09-19T08:56:39.195 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 6111 2024-09-19T08:56:39.195 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 6112 2024-09-19T08:56:39.195 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 6113 2024-09-19T08:56:39.196 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 6117 2024-09-19T08:56:39.196 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 826 2024-09-19T08:56:39.196 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 827 2024-09-19T08:56:39.196 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 828 2024-09-19T08:56:39.196 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 19 08:56 pg_filenode.map 2024-09-19T08:56:39.196 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 08:56 PG_VERSION 2024-09-19T08:56:39.196 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:39.196 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-09-19T08:56:39.196 INFO:teuthology.orchestra.run.smithi092.stdout:total 7777 2024-09-19T08:56:39.196 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 19 08:56 . 2024-09-19T08:56:39.196 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 08:56 .. 2024-09-19T08:56:39.197 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 112 2024-09-19T08:56:39.197 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 113 2024-09-19T08:56:39.197 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 19 08:56 1247 2024-09-19T08:56:39.197 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 1247_fsm 2024-09-19T08:56:39.197 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1247_vm 2024-09-19T08:56:39.197 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 19 08:56 1249 2024-09-19T08:56:39.197 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 1249_fsm 2024-09-19T08:56:39.197 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1249_vm 2024-09-19T08:56:39.197 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 19 08:56 1255 2024-09-19T08:56:39.197 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 1255_fsm 2024-09-19T08:56:39.197 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1255_vm 2024-09-19T08:56:39.197 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 19 08:56 1259 2024-09-19T08:56:39.197 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 1259_fsm 2024-09-19T08:56:39.198 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1259_vm 2024-09-19T08:56:39.198 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 19 08:56 13344 2024-09-19T08:56:39.198 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 13344_fsm 2024-09-19T08:56:39.198 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13344_vm 2024-09-19T08:56:39.198 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 13346 2024-09-19T08:56:39.198 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13348 2024-09-19T08:56:39.198 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13349 2024-09-19T08:56:39.198 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 13349_fsm 2024-09-19T08:56:39.198 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13349_vm 2024-09-19T08:56:39.198 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 13351 2024-09-19T08:56:39.198 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13353 2024-09-19T08:56:39.198 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13354 2024-09-19T08:56:39.198 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 13354_fsm 2024-09-19T08:56:39.198 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13354_vm 2024-09-19T08:56:39.199 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 13356 2024-09-19T08:56:39.199 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13358 2024-09-19T08:56:39.199 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13359 2024-09-19T08:56:39.199 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 13359_fsm 2024-09-19T08:56:39.199 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13359_vm 2024-09-19T08:56:39.199 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 13361 2024-09-19T08:56:39.199 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13363 2024-09-19T08:56:39.199 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 1417 2024-09-19T08:56:39.199 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 1418 2024-09-19T08:56:39.199 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 174 2024-09-19T08:56:39.199 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 175 2024-09-19T08:56:39.199 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2187 2024-09-19T08:56:39.200 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2224 2024-09-19T08:56:39.200 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2328 2024-09-19T08:56:39.200 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2336 2024-09-19T08:56:39.200 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2337 2024-09-19T08:56:39.200 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2579 2024-09-19T08:56:39.200 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2600 2024-09-19T08:56:39.200 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2600_fsm 2024-09-19T08:56:39.200 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2600_vm 2024-09-19T08:56:39.200 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2601 2024-09-19T08:56:39.200 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2601_fsm 2024-09-19T08:56:39.200 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2601_vm 2024-09-19T08:56:39.200 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 08:56 2602 2024-09-19T08:56:39.200 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2602_fsm 2024-09-19T08:56:39.201 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2602_vm 2024-09-19T08:56:39.201 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2603 2024-09-19T08:56:39.201 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2603_fsm 2024-09-19T08:56:39.201 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2603_vm 2024-09-19T08:56:39.201 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2604 2024-09-19T08:56:39.201 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2605 2024-09-19T08:56:39.201 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2605_fsm 2024-09-19T08:56:39.201 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2605_vm 2024-09-19T08:56:39.201 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2606 2024-09-19T08:56:39.201 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2606_fsm 2024-09-19T08:56:39.201 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2606_vm 2024-09-19T08:56:39.201 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2607 2024-09-19T08:56:39.201 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2607_fsm 2024-09-19T08:56:39.202 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2607_vm 2024-09-19T08:56:39.202 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 19 08:56 2608 2024-09-19T08:56:39.202 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2608_fsm 2024-09-19T08:56:39.202 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2608_vm 2024-09-19T08:56:39.202 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 19 08:56 2609 2024-09-19T08:56:39.204 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2609_fsm 2024-09-19T08:56:39.205 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2609_vm 2024-09-19T08:56:39.205 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2610 2024-09-19T08:56:39.205 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2610_fsm 2024-09-19T08:56:39.205 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2610_vm 2024-09-19T08:56:39.205 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2611 2024-09-19T08:56:39.205 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2612 2024-09-19T08:56:39.205 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2612_fsm 2024-09-19T08:56:39.205 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2612_vm 2024-09-19T08:56:39.205 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2613 2024-09-19T08:56:39.205 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2615 2024-09-19T08:56:39.206 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2615_fsm 2024-09-19T08:56:39.206 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2615_vm 2024-09-19T08:56:39.206 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2616 2024-09-19T08:56:39.206 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2616_fsm 2024-09-19T08:56:39.206 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2616_vm 2024-09-19T08:56:39.206 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 19 08:56 2617 2024-09-19T08:56:39.206 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2617_fsm 2024-09-19T08:56:39.206 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2617_vm 2024-09-19T08:56:39.206 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 19 08:56 2618 2024-09-19T08:56:39.206 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2618_fsm 2024-09-19T08:56:39.206 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2618_vm 2024-09-19T08:56:39.206 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 19 08:56 2619 2024-09-19T08:56:39.207 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2619_fsm 2024-09-19T08:56:39.207 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2619_vm 2024-09-19T08:56:39.207 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2620 2024-09-19T08:56:39.207 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2650 2024-09-19T08:56:39.207 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2651 2024-09-19T08:56:39.207 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2652 2024-09-19T08:56:39.207 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 08:56 2653 2024-09-19T08:56:39.207 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 08:56 2654 2024-09-19T08:56:39.207 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2655 2024-09-19T08:56:39.207 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2656 2024-09-19T08:56:39.207 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2657 2024-09-19T08:56:39.207 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 19 08:56 2658 2024-09-19T08:56:39.207 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 19 08:56 2659 2024-09-19T08:56:39.208 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2660 2024-09-19T08:56:39.208 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2661 2024-09-19T08:56:39.208 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2662 2024-09-19T08:56:39.208 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 08:56 2663 2024-09-19T08:56:39.208 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2664 2024-09-19T08:56:39.208 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2665 2024-09-19T08:56:39.208 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2666 2024-09-19T08:56:39.208 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2667 2024-09-19T08:56:39.208 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2668 2024-09-19T08:56:39.208 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2669 2024-09-19T08:56:39.208 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2670 2024-09-19T08:56:39.208 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 19 08:56 2673 2024-09-19T08:56:39.209 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 19 08:56 2674 2024-09-19T08:56:39.209 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 19 08:56 2675 2024-09-19T08:56:39.209 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2678 2024-09-19T08:56:39.209 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2679 2024-09-19T08:56:39.209 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2680 2024-09-19T08:56:39.209 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2681 2024-09-19T08:56:39.209 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2682 2024-09-19T08:56:39.209 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2683 2024-09-19T08:56:39.209 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2684 2024-09-19T08:56:39.209 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2685 2024-09-19T08:56:39.209 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2686 2024-09-19T08:56:39.209 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2687 2024-09-19T08:56:39.209 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 08:56 2688 2024-09-19T08:56:39.209 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 08:56 2689 2024-09-19T08:56:39.210 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 19 08:56 2690 2024-09-19T08:56:39.210 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 19 08:56 2691 2024-09-19T08:56:39.210 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2692 2024-09-19T08:56:39.210 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2693 2024-09-19T08:56:39.210 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2696 2024-09-19T08:56:39.210 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2699 2024-09-19T08:56:39.210 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2701 2024-09-19T08:56:39.210 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2702 2024-09-19T08:56:39.210 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2703 2024-09-19T08:56:39.210 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 08:56 2704 2024-09-19T08:56:39.210 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2753 2024-09-19T08:56:39.210 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2753_fsm 2024-09-19T08:56:39.210 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2753_vm 2024-09-19T08:56:39.211 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2754 2024-09-19T08:56:39.211 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2755 2024-09-19T08:56:39.211 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2756 2024-09-19T08:56:39.211 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2757 2024-09-19T08:56:39.211 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2830 2024-09-19T08:56:39.211 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2831 2024-09-19T08:56:39.211 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2832 2024-09-19T08:56:39.211 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2833 2024-09-19T08:56:39.211 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2834 2024-09-19T08:56:39.211 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2835 2024-09-19T08:56:39.211 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2836 2024-09-19T08:56:39.211 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2837 2024-09-19T08:56:39.212 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 19 08:56 2838 2024-09-19T08:56:39.212 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2838_fsm 2024-09-19T08:56:39.212 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2838_vm 2024-09-19T08:56:39.212 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2839 2024-09-19T08:56:39.212 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2840 2024-09-19T08:56:39.212 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2840_fsm 2024-09-19T08:56:39.212 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2840_vm 2024-09-19T08:56:39.212 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2841 2024-09-19T08:56:39.212 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2995 2024-09-19T08:56:39.212 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2996 2024-09-19T08:56:39.212 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3079 2024-09-19T08:56:39.212 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3079_fsm 2024-09-19T08:56:39.212 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3079_vm 2024-09-19T08:56:39.213 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3080 2024-09-19T08:56:39.213 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3081 2024-09-19T08:56:39.213 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 08:56 3085 2024-09-19T08:56:39.213 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3118 2024-09-19T08:56:39.213 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3119 2024-09-19T08:56:39.213 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 19 08:56 3164 2024-09-19T08:56:39.213 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3256 2024-09-19T08:56:39.213 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3257 2024-09-19T08:56:39.213 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3258 2024-09-19T08:56:39.214 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3350 2024-09-19T08:56:39.214 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3351 2024-09-19T08:56:39.214 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3379 2024-09-19T08:56:39.214 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3380 2024-09-19T08:56:39.214 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3381 2024-09-19T08:56:39.214 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3394 2024-09-19T08:56:39.214 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3394_fsm 2024-09-19T08:56:39.214 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3394_vm 2024-09-19T08:56:39.214 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3395 2024-09-19T08:56:39.215 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3429 2024-09-19T08:56:39.215 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3430 2024-09-19T08:56:39.215 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3431 2024-09-19T08:56:39.215 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3433 2024-09-19T08:56:39.215 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3439 2024-09-19T08:56:39.215 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3440 2024-09-19T08:56:39.215 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 08:56 3455 2024-09-19T08:56:39.215 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 19 08:56 3456 2024-09-19T08:56:39.215 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3456_fsm 2024-09-19T08:56:39.215 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3456_vm 2024-09-19T08:56:39.215 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3466 2024-09-19T08:56:39.215 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3467 2024-09-19T08:56:39.215 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3468 2024-09-19T08:56:39.216 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3501 2024-09-19T08:56:39.216 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3502 2024-09-19T08:56:39.216 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3503 2024-09-19T08:56:39.216 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3534 2024-09-19T08:56:39.216 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3541 2024-09-19T08:56:39.216 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3541_fsm 2024-09-19T08:56:39.216 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3541_vm 2024-09-19T08:56:39.216 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3542 2024-09-19T08:56:39.216 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3574 2024-09-19T08:56:39.216 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3575 2024-09-19T08:56:39.216 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3576 2024-09-19T08:56:39.216 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3596 2024-09-19T08:56:39.216 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3597 2024-09-19T08:56:39.217 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3598 2024-09-19T08:56:39.217 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3599 2024-09-19T08:56:39.217 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3600 2024-09-19T08:56:39.217 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3600_fsm 2024-09-19T08:56:39.217 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3600_vm 2024-09-19T08:56:39.217 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3601 2024-09-19T08:56:39.217 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3601_fsm 2024-09-19T08:56:39.217 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3601_vm 2024-09-19T08:56:39.217 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3602 2024-09-19T08:56:39.217 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3602_fsm 2024-09-19T08:56:39.217 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3602_vm 2024-09-19T08:56:39.217 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3603 2024-09-19T08:56:39.217 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3603_fsm 2024-09-19T08:56:39.218 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3603_vm 2024-09-19T08:56:39.218 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3604 2024-09-19T08:56:39.218 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3605 2024-09-19T08:56:39.218 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3606 2024-09-19T08:56:39.218 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3607 2024-09-19T08:56:39.218 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3608 2024-09-19T08:56:39.218 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 3609 2024-09-19T08:56:39.218 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3712 2024-09-19T08:56:39.218 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3764 2024-09-19T08:56:39.218 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3764_fsm 2024-09-19T08:56:39.218 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3764_vm 2024-09-19T08:56:39.218 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3766 2024-09-19T08:56:39.219 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3767 2024-09-19T08:56:39.219 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3997 2024-09-19T08:56:39.219 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4143 2024-09-19T08:56:39.219 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4144 2024-09-19T08:56:39.219 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4145 2024-09-19T08:56:39.219 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4146 2024-09-19T08:56:39.219 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4147 2024-09-19T08:56:39.219 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4148 2024-09-19T08:56:39.219 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4149 2024-09-19T08:56:39.219 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4150 2024-09-19T08:56:39.219 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4151 2024-09-19T08:56:39.219 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4152 2024-09-19T08:56:39.220 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4153 2024-09-19T08:56:39.220 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4154 2024-09-19T08:56:39.220 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4155 2024-09-19T08:56:39.220 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4156 2024-09-19T08:56:39.220 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4157 2024-09-19T08:56:39.220 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4158 2024-09-19T08:56:39.220 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4159 2024-09-19T08:56:39.220 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4160 2024-09-19T08:56:39.220 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4161 2024-09-19T08:56:39.220 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4162 2024-09-19T08:56:39.220 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4163 2024-09-19T08:56:39.220 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4164 2024-09-19T08:56:39.220 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4165 2024-09-19T08:56:39.221 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4166 2024-09-19T08:56:39.221 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4167 2024-09-19T08:56:39.221 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4168 2024-09-19T08:56:39.221 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4169 2024-09-19T08:56:39.221 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4170 2024-09-19T08:56:39.221 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4171 2024-09-19T08:56:39.221 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4172 2024-09-19T08:56:39.221 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4173 2024-09-19T08:56:39.221 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4174 2024-09-19T08:56:39.221 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 5002 2024-09-19T08:56:39.221 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 548 2024-09-19T08:56:39.221 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 549 2024-09-19T08:56:39.221 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 6102 2024-09-19T08:56:39.221 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 6104 2024-09-19T08:56:39.222 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 6106 2024-09-19T08:56:39.222 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 6110 2024-09-19T08:56:39.222 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 6111 2024-09-19T08:56:39.222 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 6112 2024-09-19T08:56:39.222 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 6113 2024-09-19T08:56:39.222 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 6117 2024-09-19T08:56:39.222 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 826 2024-09-19T08:56:39.222 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 827 2024-09-19T08:56:39.222 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 828 2024-09-19T08:56:39.222 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 19 08:56 pg_filenode.map 2024-09-19T08:56:39.222 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 08:56 PG_VERSION 2024-09-19T08:56:39.222 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:39.223 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-09-19T08:56:39.223 INFO:teuthology.orchestra.run.smithi092.stdout:total 7777 2024-09-19T08:56:39.223 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 19 08:56 . 2024-09-19T08:56:39.223 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 08:56 .. 2024-09-19T08:56:39.223 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 112 2024-09-19T08:56:39.223 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 113 2024-09-19T08:56:39.223 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 19 08:56 1247 2024-09-19T08:56:39.223 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 1247_fsm 2024-09-19T08:56:39.223 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1247_vm 2024-09-19T08:56:39.223 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 19 08:56 1249 2024-09-19T08:56:39.223 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 1249_fsm 2024-09-19T08:56:39.223 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1249_vm 2024-09-19T08:56:39.223 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 19 08:56 1255 2024-09-19T08:56:39.224 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 1255_fsm 2024-09-19T08:56:39.224 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1255_vm 2024-09-19T08:56:39.224 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 19 08:56 1259 2024-09-19T08:56:39.224 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 1259_fsm 2024-09-19T08:56:39.224 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1259_vm 2024-09-19T08:56:39.224 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 19 08:56 13344 2024-09-19T08:56:39.224 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 13344_fsm 2024-09-19T08:56:39.224 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13344_vm 2024-09-19T08:56:39.224 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 13346 2024-09-19T08:56:39.224 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13348 2024-09-19T08:56:39.224 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13349 2024-09-19T08:56:39.224 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 13349_fsm 2024-09-19T08:56:39.224 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13349_vm 2024-09-19T08:56:39.224 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 13351 2024-09-19T08:56:39.225 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13353 2024-09-19T08:56:39.225 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13354 2024-09-19T08:56:39.225 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 13354_fsm 2024-09-19T08:56:39.225 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13354_vm 2024-09-19T08:56:39.225 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 13356 2024-09-19T08:56:39.225 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13358 2024-09-19T08:56:39.225 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13359 2024-09-19T08:56:39.225 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 13359_fsm 2024-09-19T08:56:39.225 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13359_vm 2024-09-19T08:56:39.225 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 13361 2024-09-19T08:56:39.225 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13363 2024-09-19T08:56:39.225 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 1417 2024-09-19T08:56:39.225 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 1418 2024-09-19T08:56:39.226 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 174 2024-09-19T08:56:39.226 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 175 2024-09-19T08:56:39.226 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2187 2024-09-19T08:56:39.226 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2224 2024-09-19T08:56:39.226 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2328 2024-09-19T08:56:39.226 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2336 2024-09-19T08:56:39.226 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2337 2024-09-19T08:56:39.226 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2579 2024-09-19T08:56:39.226 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2600 2024-09-19T08:56:39.226 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2600_fsm 2024-09-19T08:56:39.226 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2600_vm 2024-09-19T08:56:39.226 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2601 2024-09-19T08:56:39.226 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2601_fsm 2024-09-19T08:56:39.227 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2601_vm 2024-09-19T08:56:39.227 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 08:56 2602 2024-09-19T08:56:39.227 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2602_fsm 2024-09-19T08:56:39.227 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2602_vm 2024-09-19T08:56:39.227 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2603 2024-09-19T08:56:39.227 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2603_fsm 2024-09-19T08:56:39.227 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2603_vm 2024-09-19T08:56:39.227 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2604 2024-09-19T08:56:39.227 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2605 2024-09-19T08:56:39.227 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2605_fsm 2024-09-19T08:56:39.227 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2605_vm 2024-09-19T08:56:39.227 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2606 2024-09-19T08:56:39.227 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2606_fsm 2024-09-19T08:56:39.227 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2606_vm 2024-09-19T08:56:39.228 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2607 2024-09-19T08:56:39.228 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2607_fsm 2024-09-19T08:56:39.228 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2607_vm 2024-09-19T08:56:39.228 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 19 08:56 2608 2024-09-19T08:56:39.228 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2608_fsm 2024-09-19T08:56:39.228 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2608_vm 2024-09-19T08:56:39.228 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 19 08:56 2609 2024-09-19T08:56:39.228 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2609_fsm 2024-09-19T08:56:39.228 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2609_vm 2024-09-19T08:56:39.228 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2610 2024-09-19T08:56:39.228 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2610_fsm 2024-09-19T08:56:39.228 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2610_vm 2024-09-19T08:56:39.228 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2611 2024-09-19T08:56:39.229 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2612 2024-09-19T08:56:39.229 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2612_fsm 2024-09-19T08:56:39.229 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2612_vm 2024-09-19T08:56:39.229 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2613 2024-09-19T08:56:39.229 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2615 2024-09-19T08:56:39.229 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2615_fsm 2024-09-19T08:56:39.229 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2615_vm 2024-09-19T08:56:39.229 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2616 2024-09-19T08:56:39.229 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2616_fsm 2024-09-19T08:56:39.229 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2616_vm 2024-09-19T08:56:39.229 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 19 08:56 2617 2024-09-19T08:56:39.229 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2617_fsm 2024-09-19T08:56:39.229 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2617_vm 2024-09-19T08:56:39.229 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 19 08:56 2618 2024-09-19T08:56:39.230 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2618_fsm 2024-09-19T08:56:39.230 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2618_vm 2024-09-19T08:56:39.230 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 19 08:56 2619 2024-09-19T08:56:39.230 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2619_fsm 2024-09-19T08:56:39.230 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2619_vm 2024-09-19T08:56:39.230 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2620 2024-09-19T08:56:39.230 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2650 2024-09-19T08:56:39.230 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2651 2024-09-19T08:56:39.230 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2652 2024-09-19T08:56:39.230 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 08:56 2653 2024-09-19T08:56:39.230 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 08:56 2654 2024-09-19T08:56:39.230 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2655 2024-09-19T08:56:39.230 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2656 2024-09-19T08:56:39.230 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2657 2024-09-19T08:56:39.231 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 19 08:56 2658 2024-09-19T08:56:39.231 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 19 08:56 2659 2024-09-19T08:56:39.231 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2660 2024-09-19T08:56:39.231 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2661 2024-09-19T08:56:39.231 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2662 2024-09-19T08:56:39.231 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 08:56 2663 2024-09-19T08:56:39.231 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2664 2024-09-19T08:56:39.231 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2665 2024-09-19T08:56:39.231 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2666 2024-09-19T08:56:39.231 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2667 2024-09-19T08:56:39.231 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2668 2024-09-19T08:56:39.231 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2669 2024-09-19T08:56:39.231 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2670 2024-09-19T08:56:39.231 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 19 08:56 2673 2024-09-19T08:56:39.232 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 19 08:56 2674 2024-09-19T08:56:39.232 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 19 08:56 2675 2024-09-19T08:56:39.232 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2678 2024-09-19T08:56:39.232 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2679 2024-09-19T08:56:39.232 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2680 2024-09-19T08:56:39.232 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2681 2024-09-19T08:56:39.232 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2682 2024-09-19T08:56:39.232 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2683 2024-09-19T08:56:39.232 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2684 2024-09-19T08:56:39.232 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2685 2024-09-19T08:56:39.232 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2686 2024-09-19T08:56:39.232 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2687 2024-09-19T08:56:39.232 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 08:56 2688 2024-09-19T08:56:39.233 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 08:56 2689 2024-09-19T08:56:39.233 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 19 08:56 2690 2024-09-19T08:56:39.233 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 19 08:56 2691 2024-09-19T08:56:39.233 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2692 2024-09-19T08:56:39.233 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2693 2024-09-19T08:56:39.233 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2696 2024-09-19T08:56:39.233 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2699 2024-09-19T08:56:39.233 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2701 2024-09-19T08:56:39.233 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2702 2024-09-19T08:56:39.233 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2703 2024-09-19T08:56:39.233 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 08:56 2704 2024-09-19T08:56:39.233 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2753 2024-09-19T08:56:39.233 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2753_fsm 2024-09-19T08:56:39.234 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2753_vm 2024-09-19T08:56:39.234 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2754 2024-09-19T08:56:39.234 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2755 2024-09-19T08:56:39.234 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2756 2024-09-19T08:56:39.234 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2757 2024-09-19T08:56:39.234 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2830 2024-09-19T08:56:39.234 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2831 2024-09-19T08:56:39.234 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2832 2024-09-19T08:56:39.234 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2833 2024-09-19T08:56:39.234 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2834 2024-09-19T08:56:39.234 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2835 2024-09-19T08:56:39.234 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2836 2024-09-19T08:56:39.234 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2837 2024-09-19T08:56:39.234 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 19 08:56 2838 2024-09-19T08:56:39.235 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2838_fsm 2024-09-19T08:56:39.235 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2838_vm 2024-09-19T08:56:39.235 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2839 2024-09-19T08:56:39.235 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2840 2024-09-19T08:56:39.235 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2840_fsm 2024-09-19T08:56:39.235 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2840_vm 2024-09-19T08:56:39.235 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2841 2024-09-19T08:56:39.235 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2995 2024-09-19T08:56:39.235 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2996 2024-09-19T08:56:39.235 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3079 2024-09-19T08:56:39.235 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3079_fsm 2024-09-19T08:56:39.235 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3079_vm 2024-09-19T08:56:39.235 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3080 2024-09-19T08:56:39.235 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3081 2024-09-19T08:56:39.236 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 08:56 3085 2024-09-19T08:56:39.236 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3118 2024-09-19T08:56:39.236 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3119 2024-09-19T08:56:39.236 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 19 08:56 3164 2024-09-19T08:56:39.236 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3256 2024-09-19T08:56:39.236 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3257 2024-09-19T08:56:39.236 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3258 2024-09-19T08:56:39.236 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3350 2024-09-19T08:56:39.236 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3351 2024-09-19T08:56:39.236 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3379 2024-09-19T08:56:39.236 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3380 2024-09-19T08:56:39.236 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3381 2024-09-19T08:56:39.236 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3394 2024-09-19T08:56:39.237 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3394_fsm 2024-09-19T08:56:39.237 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3394_vm 2024-09-19T08:56:39.237 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3395 2024-09-19T08:56:39.237 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3429 2024-09-19T08:56:39.237 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3430 2024-09-19T08:56:39.237 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3431 2024-09-19T08:56:39.237 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3433 2024-09-19T08:56:39.237 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3439 2024-09-19T08:56:39.237 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3440 2024-09-19T08:56:39.237 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 08:56 3455 2024-09-19T08:56:39.237 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 19 08:56 3456 2024-09-19T08:56:39.237 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3456_fsm 2024-09-19T08:56:39.237 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3456_vm 2024-09-19T08:56:39.238 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3466 2024-09-19T08:56:39.238 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3467 2024-09-19T08:56:39.238 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3468 2024-09-19T08:56:39.238 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3501 2024-09-19T08:56:39.238 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3502 2024-09-19T08:56:39.238 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3503 2024-09-19T08:56:39.238 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3534 2024-09-19T08:56:39.238 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3541 2024-09-19T08:56:39.238 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3541_fsm 2024-09-19T08:56:39.238 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3541_vm 2024-09-19T08:56:39.238 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3542 2024-09-19T08:56:39.238 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3574 2024-09-19T08:56:39.238 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3575 2024-09-19T08:56:39.238 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3576 2024-09-19T08:56:39.239 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3596 2024-09-19T08:56:39.239 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3597 2024-09-19T08:56:39.239 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3598 2024-09-19T08:56:39.239 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3599 2024-09-19T08:56:39.239 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3600 2024-09-19T08:56:39.239 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3600_fsm 2024-09-19T08:56:39.239 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3600_vm 2024-09-19T08:56:39.239 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3601 2024-09-19T08:56:39.239 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3601_fsm 2024-09-19T08:56:39.239 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3601_vm 2024-09-19T08:56:39.239 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3602 2024-09-19T08:56:39.239 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3602_fsm 2024-09-19T08:56:39.239 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3602_vm 2024-09-19T08:56:39.240 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3603 2024-09-19T08:56:39.240 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3603_fsm 2024-09-19T08:56:39.240 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3603_vm 2024-09-19T08:56:39.240 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3604 2024-09-19T08:56:39.240 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3605 2024-09-19T08:56:39.240 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3606 2024-09-19T08:56:39.240 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3607 2024-09-19T08:56:39.240 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3608 2024-09-19T08:56:39.240 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 3609 2024-09-19T08:56:39.240 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3712 2024-09-19T08:56:39.240 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3764 2024-09-19T08:56:39.240 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3764_fsm 2024-09-19T08:56:39.240 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3764_vm 2024-09-19T08:56:39.241 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3766 2024-09-19T08:56:39.241 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3767 2024-09-19T08:56:39.241 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3997 2024-09-19T08:56:39.241 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4143 2024-09-19T08:56:39.241 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4144 2024-09-19T08:56:39.241 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4145 2024-09-19T08:56:39.241 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4146 2024-09-19T08:56:39.241 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4147 2024-09-19T08:56:39.241 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4148 2024-09-19T08:56:39.241 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4149 2024-09-19T08:56:39.241 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4150 2024-09-19T08:56:39.241 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4151 2024-09-19T08:56:39.241 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4152 2024-09-19T08:56:39.242 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4153 2024-09-19T08:56:39.242 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4154 2024-09-19T08:56:39.242 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4155 2024-09-19T08:56:39.242 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4156 2024-09-19T08:56:39.242 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4157 2024-09-19T08:56:39.242 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4158 2024-09-19T08:56:39.242 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4159 2024-09-19T08:56:39.242 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4160 2024-09-19T08:56:39.242 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4161 2024-09-19T08:56:39.242 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4162 2024-09-19T08:56:39.242 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4163 2024-09-19T08:56:39.242 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4164 2024-09-19T08:56:39.242 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4165 2024-09-19T08:56:39.242 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4166 2024-09-19T08:56:39.243 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4167 2024-09-19T08:56:39.243 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4168 2024-09-19T08:56:39.243 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4169 2024-09-19T08:56:39.243 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4170 2024-09-19T08:56:39.243 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4171 2024-09-19T08:56:39.243 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4172 2024-09-19T08:56:39.243 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4173 2024-09-19T08:56:39.243 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4174 2024-09-19T08:56:39.243 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 5002 2024-09-19T08:56:39.243 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 548 2024-09-19T08:56:39.243 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 549 2024-09-19T08:56:39.243 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 6102 2024-09-19T08:56:39.243 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 6104 2024-09-19T08:56:39.243 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 6106 2024-09-19T08:56:39.244 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 6110 2024-09-19T08:56:39.244 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 6111 2024-09-19T08:56:39.244 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 6112 2024-09-19T08:56:39.244 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 6113 2024-09-19T08:56:39.244 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 6117 2024-09-19T08:56:39.244 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 826 2024-09-19T08:56:39.244 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 827 2024-09-19T08:56:39.244 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 828 2024-09-19T08:56:39.244 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 19 08:56 pg_filenode.map 2024-09-19T08:56:39.244 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 08:56 PG_VERSION 2024-09-19T08:56:39.244 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:39.244 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/global: 2024-09-19T08:56:39.244 INFO:teuthology.orchestra.run.smithi092.stdout:total 537 2024-09-19T08:56:39.245 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57 Sep 19 08:56 . 2024-09-19T08:56:39.245 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 08:56 .. 2024-09-19T08:56:39.245 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1213 2024-09-19T08:56:39.245 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 1213_fsm 2024-09-19T08:56:39.245 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1213_vm 2024-09-19T08:56:39.245 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1214 2024-09-19T08:56:39.245 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 1214_fsm 2024-09-19T08:56:39.245 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1214_vm 2024-09-19T08:56:39.245 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 1232 2024-09-19T08:56:39.245 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 1233 2024-09-19T08:56:39.245 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1260 2024-09-19T08:56:39.245 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 1260_fsm 2024-09-19T08:56:39.245 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1260_vm 2024-09-19T08:56:39.246 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1261 2024-09-19T08:56:39.246 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 1261_fsm 2024-09-19T08:56:39.246 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1261_vm 2024-09-19T08:56:39.246 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1262 2024-09-19T08:56:39.246 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 1262_fsm 2024-09-19T08:56:39.246 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1262_vm 2024-09-19T08:56:39.246 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2396 2024-09-19T08:56:39.246 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2396_fsm 2024-09-19T08:56:39.246 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2396_vm 2024-09-19T08:56:39.246 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2397 2024-09-19T08:56:39.246 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2671 2024-09-19T08:56:39.246 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2672 2024-09-19T08:56:39.247 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2676 2024-09-19T08:56:39.247 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2677 2024-09-19T08:56:39.247 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2694 2024-09-19T08:56:39.247 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2695 2024-09-19T08:56:39.247 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2697 2024-09-19T08:56:39.247 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2698 2024-09-19T08:56:39.247 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2846 2024-09-19T08:56:39.247 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2847 2024-09-19T08:56:39.247 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2964 2024-09-19T08:56:39.247 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2965 2024-09-19T08:56:39.247 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2966 2024-09-19T08:56:39.247 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2967 2024-09-19T08:56:39.247 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3592 2024-09-19T08:56:39.247 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3593 2024-09-19T08:56:39.248 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4060 2024-09-19T08:56:39.248 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4061 2024-09-19T08:56:39.248 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4175 2024-09-19T08:56:39.248 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4176 2024-09-19T08:56:39.248 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4177 2024-09-19T08:56:39.248 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4178 2024-09-19T08:56:39.248 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4181 2024-09-19T08:56:39.248 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4182 2024-09-19T08:56:39.248 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4183 2024-09-19T08:56:39.248 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4184 2024-09-19T08:56:39.248 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4185 2024-09-19T08:56:39.249 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4186 2024-09-19T08:56:39.249 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 6000 2024-09-19T08:56:39.249 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 6001 2024-09-19T08:56:39.249 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 6002 2024-09-19T08:56:39.249 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 6100 2024-09-19T08:56:39.249 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 6114 2024-09-19T08:56:39.249 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 6115 2024-09-19T08:56:39.249 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 pg_control 2024-09-19T08:56:39.249 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 19 08:56 pg_filenode.map 2024-09-19T08:56:39.249 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:39.249 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/log: 2024-09-19T08:56:39.249 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-19T08:56:39.249 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 . 2024-09-19T08:56:39.250 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 08:56 .. 2024-09-19T08:56:39.250 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:39.250 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-09-19T08:56:39.250 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-19T08:56:39.250 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 . 2024-09-19T08:56:39.250 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 08:56 .. 2024-09-19T08:56:39.250 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:39.250 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-09-19T08:56:39.250 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-19T08:56:39.250 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 . 2024-09-19T08:56:39.250 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 08:56 .. 2024-09-19T08:56:39.250 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:39.250 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-09-19T08:56:39.251 INFO:teuthology.orchestra.run.smithi092.stdout:total 1 2024-09-19T08:56:39.251 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 08:56 . 2024-09-19T08:56:39.251 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 08:56 .. 2024-09-19T08:56:39.251 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 mappings 2024-09-19T08:56:39.251 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 19 08:56 replorigin_checkpoint 2024-09-19T08:56:39.251 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 snapshots 2024-09-19T08:56:39.251 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:39.251 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-09-19T08:56:39.251 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-19T08:56:39.251 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 . 2024-09-19T08:56:39.251 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 08:56 .. 2024-09-19T08:56:39.251 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:39.251 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-09-19T08:56:39.251 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-19T08:56:39.252 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 . 2024-09-19T08:56:39.252 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 08:56 .. 2024-09-19T08:56:39.252 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:39.252 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-09-19T08:56:39.252 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-19T08:56:39.252 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 19 08:56 . 2024-09-19T08:56:39.252 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 08:56 .. 2024-09-19T08:56:39.252 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 08:56 members 2024-09-19T08:56:39.252 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 08:56 offsets 2024-09-19T08:56:39.252 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:39.252 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-09-19T08:56:39.252 INFO:teuthology.orchestra.run.smithi092.stdout:total 8 2024-09-19T08:56:39.252 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 08:56 . 2024-09-19T08:56:39.253 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 19 08:56 .. 2024-09-19T08:56:39.253 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 0000 2024-09-19T08:56:39.253 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:39.253 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-09-19T08:56:39.253 INFO:teuthology.orchestra.run.smithi092.stdout:total 8 2024-09-19T08:56:39.253 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 08:56 . 2024-09-19T08:56:39.253 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 19 08:56 .. 2024-09-19T08:56:39.253 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 0000 2024-09-19T08:56:39.253 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:39.253 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-09-19T08:56:39.253 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-19T08:56:39.253 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 . 2024-09-19T08:56:39.254 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 08:56 .. 2024-09-19T08:56:39.254 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:39.254 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-09-19T08:56:39.254 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-19T08:56:39.254 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 . 2024-09-19T08:56:39.254 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 08:56 .. 2024-09-19T08:56:39.254 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:39.254 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-09-19T08:56:39.254 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-19T08:56:39.254 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 . 2024-09-19T08:56:39.254 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 08:56 .. 2024-09-19T08:56:39.254 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:39.254 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-09-19T08:56:39.255 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-19T08:56:39.255 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 . 2024-09-19T08:56:39.255 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 08:56 .. 2024-09-19T08:56:39.255 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:39.255 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-09-19T08:56:39.255 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-19T08:56:39.255 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 . 2024-09-19T08:56:39.255 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 08:56 .. 2024-09-19T08:56:39.255 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:39.255 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-09-19T08:56:39.255 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-19T08:56:39.255 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 . 2024-09-19T08:56:39.255 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 08:56 .. 2024-09-19T08:56:39.256 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:39.256 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-09-19T08:56:39.256 INFO:teuthology.orchestra.run.smithi092.stdout:total 8 2024-09-19T08:56:39.256 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 08:56 . 2024-09-19T08:56:39.256 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 08:56 .. 2024-09-19T08:56:39.256 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 0000 2024-09-19T08:56:39.256 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:39.256 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-09-19T08:56:39.256 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-19T08:56:39.256 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 . 2024-09-19T08:56:39.256 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 08:56 .. 2024-09-19T08:56:39.256 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:39.256 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-09-19T08:56:39.257 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-19T08:56:39.257 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 . 2024-09-19T08:56:39.257 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 08:56 .. 2024-09-19T08:56:39.257 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:39.257 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-09-19T08:56:39.257 INFO:teuthology.orchestra.run.smithi092.stdout:total 16384 2024-09-19T08:56:39.257 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 19 08:56 . 2024-09-19T08:56:39.257 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 08:56 .. 2024-09-19T08:56:39.257 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 08:56 000000010000000000000001 2024-09-19T08:56:39.257 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 archive_status 2024-09-19T08:56:39.257 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:39.257 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-09-19T08:56:39.257 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-19T08:56:39.257 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 . 2024-09-19T08:56:39.258 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 19 08:56 .. 2024-09-19T08:56:39.258 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:39.258 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-09-19T08:56:39.258 INFO:teuthology.orchestra.run.smithi092.stdout:total 8 2024-09-19T08:56:39.258 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 08:56 . 2024-09-19T08:56:39.258 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 08:56 .. 2024-09-19T08:56:39.258 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 0000 2024-09-19T08:56:39.258 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2024-09-19T08:56:39.401 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 32 -i' 2024-09-19T08:56:39.447 INFO:teuthology.orchestra.run.smithi092.stderr:dropping old tables... 2024-09-19T08:56:39.448 INFO:teuthology.orchestra.run.smithi092.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2024-09-19T08:56:39.448 INFO:teuthology.orchestra.run.smithi092.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2024-09-19T08:56:39.448 INFO:teuthology.orchestra.run.smithi092.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2024-09-19T08:56:39.448 INFO:teuthology.orchestra.run.smithi092.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2024-09-19T08:56:39.448 INFO:teuthology.orchestra.run.smithi092.stderr:creating tables... 2024-09-19T08:56:39.464 INFO:teuthology.orchestra.run.smithi092.stderr:generating data (client-side)... 2024-09-19T08:56:39.534 INFO:teuthology.orchestra.run.smithi092.stderr:100000 of 3200000 tuples (3%) done (elapsed 0.06 s, remaining 1.73 s) 2024-09-19T08:56:39.688 INFO:teuthology.orchestra.run.smithi092.stderr:200000 of 3200000 tuples (6%) done (elapsed 0.21 s, remaining 3.15 s) 2024-09-19T08:56:39.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:39 smithi092 ceph-mon[31407]: pgmap v335: 97 pgs: 97 active+clean; 9.9 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 795 KiB/s wr, 19 op/s 2024-09-19T08:56:39.777 INFO:teuthology.orchestra.run.smithi092.stderr:300000 of 3200000 tuples (9%) done (elapsed 0.30 s, remaining 2.89 s) 2024-09-19T08:56:39.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:39 smithi167 ceph-mon[35359]: pgmap v335: 97 pgs: 97 active+clean; 9.9 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 795 KiB/s wr, 19 op/s 2024-09-19T08:56:39.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:39 smithi190 ceph-mon[35358]: pgmap v335: 97 pgs: 97 active+clean; 9.9 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 795 KiB/s wr, 19 op/s 2024-09-19T08:56:39.927 INFO:teuthology.orchestra.run.smithi092.stderr:400000 of 3200000 tuples (12%) done (elapsed 0.45 s, remaining 3.14 s) 2024-09-19T08:56:40.095 INFO:teuthology.orchestra.run.smithi092.stderr:500000 of 3200000 tuples (15%) done (elapsed 0.62 s, remaining 3.33 s) 2024-09-19T08:56:40.269 INFO:teuthology.orchestra.run.smithi092.stderr:600000 of 3200000 tuples (18%) done (elapsed 0.79 s, remaining 3.42 s) 2024-09-19T08:56:40.344 INFO:teuthology.orchestra.run.smithi092.stderr:700000 of 3200000 tuples (21%) done (elapsed 0.86 s, remaining 3.09 s) 2024-09-19T08:56:40.530 INFO:teuthology.orchestra.run.smithi092.stderr:800000 of 3200000 tuples (25%) done (elapsed 1.05 s, remaining 3.15 s) 2024-09-19T08:56:40.700 INFO:teuthology.orchestra.run.smithi092.stderr:900000 of 3200000 tuples (28%) done (elapsed 1.22 s, remaining 3.12 s) 2024-09-19T08:56:40.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:40 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:40.778 INFO:teuthology.orchestra.run.smithi092.stderr:1000000 of 3200000 tuples (31%) done (elapsed 1.30 s, remaining 2.86 s) 2024-09-19T08:56:40.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:40 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:40.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:40 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:40.956 INFO:teuthology.orchestra.run.smithi092.stderr:1100000 of 3200000 tuples (34%) done (elapsed 1.48 s, remaining 2.82 s) 2024-09-19T08:56:41.030 INFO:teuthology.orchestra.run.smithi092.stderr:1200000 of 3200000 tuples (37%) done (elapsed 1.55 s, remaining 2.59 s) 2024-09-19T08:56:41.209 INFO:teuthology.orchestra.run.smithi092.stderr:1300000 of 3200000 tuples (40%) done (elapsed 1.73 s, remaining 2.53 s) 2024-09-19T08:56:41.395 INFO:teuthology.orchestra.run.smithi092.stderr:1400000 of 3200000 tuples (43%) done (elapsed 1.92 s, remaining 2.46 s) 2024-09-19T08:56:41.465 INFO:teuthology.orchestra.run.smithi092.stderr:1500000 of 3200000 tuples (46%) done (elapsed 1.99 s, remaining 2.25 s) 2024-09-19T08:56:41.625 INFO:teuthology.orchestra.run.smithi092.stderr:1600000 of 3200000 tuples (50%) done (elapsed 2.15 s, remaining 2.15 s) 2024-09-19T08:56:41.725 INFO:teuthology.orchestra.run.smithi092.stderr:1700000 of 3200000 tuples (53%) done (elapsed 2.25 s, remaining 1.98 s) 2024-09-19T08:56:41.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:41 smithi092 ceph-mon[31407]: pgmap v336: 97 pgs: 97 active+clean; 31 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 2.6 MiB/s wr, 47 op/s 2024-09-19T08:56:41.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:41 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:56:41.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:41 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:56:41.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:41 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:56:41.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:41 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:56:41.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:41 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:56:41.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:41 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:56:41.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:41 smithi167 ceph-mon[35359]: pgmap v336: 97 pgs: 97 active+clean; 31 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 2.6 MiB/s wr, 47 op/s 2024-09-19T08:56:41.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:41 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:56:41.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:41 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:56:41.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:41 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:56:41.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:41 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:56:41.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:41 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:56:41.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:41 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:56:41.872 INFO:teuthology.orchestra.run.smithi092.stderr:1800000 of 3200000 tuples (56%) done (elapsed 2.39 s, remaining 1.86 s) 2024-09-19T08:56:41.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:41 smithi190 ceph-mon[35358]: pgmap v336: 97 pgs: 97 active+clean; 31 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 2.6 MiB/s wr, 47 op/s 2024-09-19T08:56:41.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:41 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:56:41.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:41 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:56:41.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:41 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:56:41.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:41 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:56:41.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:41 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:56:41.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:41 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:56:42.051 INFO:teuthology.orchestra.run.smithi092.stderr:1900000 of 3200000 tuples (59%) done (elapsed 2.57 s, remaining 1.76 s) 2024-09-19T08:56:42.227 INFO:teuthology.orchestra.run.smithi092.stderr:2000000 of 3200000 tuples (62%) done (elapsed 2.75 s, remaining 1.65 s) 2024-09-19T08:56:42.299 INFO:teuthology.orchestra.run.smithi092.stderr:2100000 of 3200000 tuples (65%) done (elapsed 2.82 s, remaining 1.48 s) 2024-09-19T08:56:42.453 INFO:teuthology.orchestra.run.smithi092.stderr:2200000 of 3200000 tuples (68%) done (elapsed 2.97 s, remaining 1.35 s) 2024-09-19T08:56:42.532 INFO:teuthology.orchestra.run.smithi092.stderr:2300000 of 3200000 tuples (71%) done (elapsed 3.05 s, remaining 1.19 s) 2024-09-19T08:56:42.703 INFO:teuthology.orchestra.run.smithi092.stderr:2400000 of 3200000 tuples (75%) done (elapsed 3.22 s, remaining 1.07 s) 2024-09-19T08:56:42.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:42 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:42.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:42 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:42.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:42 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:56:42.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:42 smithi092 ceph-mon[31407]: pgmap v337: 97 pgs: 97 active+clean; 57 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 6.4 MiB/s wr, 64 op/s 2024-09-19T08:56:42.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:42 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:42.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:42 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:42.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:42 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:56:42.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:42 smithi167 ceph-mon[35359]: pgmap v337: 97 pgs: 97 active+clean; 57 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 6.4 MiB/s wr, 64 op/s 2024-09-19T08:56:42.871 INFO:teuthology.orchestra.run.smithi092.stderr:2500000 of 3200000 tuples (78%) done (elapsed 3.39 s, remaining 0.95 s) 2024-09-19T08:56:42.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:42 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:42.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:42 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:42.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:42 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:56:42.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:42 smithi190 ceph-mon[35358]: pgmap v337: 97 pgs: 97 active+clean; 57 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 6.4 MiB/s wr, 64 op/s 2024-09-19T08:56:42.945 INFO:teuthology.orchestra.run.smithi092.stderr:2600000 of 3200000 tuples (81%) done (elapsed 3.47 s, remaining 0.80 s) 2024-09-19T08:56:43.128 INFO:teuthology.orchestra.run.smithi092.stderr:2700000 of 3200000 tuples (84%) done (elapsed 3.65 s, remaining 0.68 s) 2024-09-19T08:56:43.289 INFO:teuthology.orchestra.run.smithi092.stderr:2800000 of 3200000 tuples (87%) done (elapsed 3.81 s, remaining 0.54 s) 2024-09-19T08:56:43.366 INFO:teuthology.orchestra.run.smithi092.stderr:2900000 of 3200000 tuples (90%) done (elapsed 3.89 s, remaining 0.40 s) 2024-09-19T08:56:43.527 INFO:teuthology.orchestra.run.smithi092.stderr:3000000 of 3200000 tuples (93%) done (elapsed 4.05 s, remaining 0.27 s) 2024-09-19T08:56:43.619 INFO:teuthology.orchestra.run.smithi092.stderr:3100000 of 3200000 tuples (96%) done (elapsed 4.14 s, remaining 0.13 s) 2024-09-19T08:56:43.812 INFO:teuthology.orchestra.run.smithi092.stderr:3200000 of 3200000 tuples (100%) done (elapsed 4.33 s, remaining 0.00 s) 2024-09-19T08:56:43.826 INFO:teuthology.orchestra.run.smithi092.stderr:vacuuming... 2024-09-19T08:56:44.416 INFO:teuthology.orchestra.run.smithi092.stderr:creating primary keys... 2024-09-19T08:56:44.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.462+0000 7f5afe6ba640 1 -- 172.21.15.92:0/4010519749 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af81025d0 msgr2=0x7f5af81049c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:44.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.462+0000 7f5afe6ba640 1 --2- 172.21.15.92:0/4010519749 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af81025d0 0x7f5af81049c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8009900 tx=0x7f5ae802a410 comp rx=0 tx=0).stop 2024-09-19T08:56:44.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.462+0000 7f5afe6ba640 1 -- 172.21.15.92:0/4010519749 shutdown_connections 2024-09-19T08:56:44.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.462+0000 7f5afe6ba640 1 --2- 172.21.15.92:0/4010519749 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5af8107830 0x7f5af8109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:44.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.462+0000 7f5afe6ba640 1 --2- 172.21.15.92:0/4010519749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5af8104f00 0x7f5af81072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:44.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.462+0000 7f5afe6ba640 1 --2- 172.21.15.92:0/4010519749 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af81025d0 0x7f5af81049c0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:44.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.462+0000 7f5afe6ba640 1 -- 172.21.15.92:0/4010519749 >> 172.21.15.92:0/4010519749 conn(0x7f5af80fc1b0 msgr2=0x7f5af80fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:44.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.462+0000 7f5afe6ba640 1 -- 172.21.15.92:0/4010519749 shutdown_connections 2024-09-19T08:56:44.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.462+0000 7f5afe6ba640 1 -- 172.21.15.92:0/4010519749 wait complete. 2024-09-19T08:56:44.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.463+0000 7f5afe6ba640 1 Processor -- start 2024-09-19T08:56:44.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.463+0000 7f5afe6ba640 1 -- start start 2024-09-19T08:56:44.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.463+0000 7f5afe6ba640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5af81025d0 0x7f5af8101f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:44.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.463+0000 7f5afe6ba640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af8104f00 0x7f5af8100580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:44.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.463+0000 7f5afe6ba640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5af8107830 0x7f5af8100ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:44.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.463+0000 7f5afe6ba640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5af810d810 con 0x7f5af8104f00 2024-09-19T08:56:44.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.463+0000 7f5afe6ba640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5af810d690 con 0x7f5af81025d0 2024-09-19T08:56:44.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.463+0000 7f5afe6ba640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5af810d990 con 0x7f5af8107830 2024-09-19T08:56:44.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.464+0000 7f5af77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af8104f00 0x7f5af8100580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:44.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.464+0000 7f5af7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5af81025d0 0x7f5af8101f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:44.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.464+0000 7f5af77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af8104f00 0x7f5af8100580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53648/0 (socket says 172.21.15.92:53648) 2024-09-19T08:56:44.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.464+0000 7f5af77fe640 1 -- 172.21.15.92:0/49399934 learned_addr learned my addr 172.21.15.92:0/49399934 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:44.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.464+0000 7f5afcc57640 1 --2- 172.21.15.92:0/49399934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5af8107830 0x7f5af8100ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:44.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.464+0000 7f5af77fe640 1 -- 172.21.15.92:0/49399934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5af8107830 msgr2=0x7f5af8100ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:44.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.464+0000 7f5af77fe640 1 --2- 172.21.15.92:0/49399934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5af8107830 0x7f5af8100ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:44.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.464+0000 7f5af77fe640 1 -- 172.21.15.92:0/49399934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5af81025d0 msgr2=0x7f5af8101f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:44.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.464+0000 7f5af77fe640 1 --2- 172.21.15.92:0/49399934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5af81025d0 0x7f5af8101f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:44.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.464+0000 7f5af77fe640 1 -- 172.21.15.92:0/49399934 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af8101350 con 0x7f5af8104f00 2024-09-19T08:56:44.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.464+0000 7f5af7fff640 1 --2- 172.21.15.92:0/49399934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5af81025d0 0x7f5af8101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:44.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.464+0000 7f5af77fe640 1 --2- 172.21.15.92:0/49399934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af8104f00 0x7f5af8100580 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00e9c0 tx=0x7f5aec00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.464+0000 7f5af57fa640 1 -- 172.21.15.92:0/49399934 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aec00cd80 con 0x7f5af8104f00 2024-09-19T08:56:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.464+0000 7f5af57fa640 1 -- 172.21.15.92:0/49399934 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5aec005500 con 0x7f5af8104f00 2024-09-19T08:56:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.464+0000 7f5afe6ba640 1 -- 172.21.15.92:0/49399934 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5af81a1f60 con 0x7f5af8104f00 2024-09-19T08:56:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.464+0000 7f5af57fa640 1 -- 172.21.15.92:0/49399934 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aec010690 con 0x7f5af8104f00 2024-09-19T08:56:44.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.464+0000 7f5afe6ba640 1 -- 172.21.15.92:0/49399934 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5af81a23d0 con 0x7f5af8104f00 2024-09-19T08:56:44.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.467+0000 7f5af57fa640 1 -- 172.21.15.92:0/49399934 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5aec0046c0 con 0x7f5af8104f00 2024-09-19T08:56:44.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.468+0000 7f5b0145b740 1 Processor -- start 2024-09-19T08:56:44.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.468+0000 7f5b0145b740 1 -- start start 2024-09-19T08:56:44.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.468+0000 7f5af57fa640 1 --2- 172.21.15.92:0/49399934 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5ae00a3370 0x7f5ae00a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:44.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.468+0000 7f5b0145b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5597c4eff9a0 0x5597c4effda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:44.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.468+0000 7f5b0145b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597c4f002e0 0x5597c4f04da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:44.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.468+0000 7f5afcc57640 1 --2- 172.21.15.92:0/49399934 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5ae00a3370 0x7f5ae00a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:44.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.468+0000 7f5af57fa640 1 -- 172.21.15.92:0/49399934 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f5aec0cfc00 con 0x7f5af8104f00 2024-09-19T08:56:44.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.468+0000 7f5b0145b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597c4f05370 0x5597c4f07830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:44.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.468+0000 7f5b0145b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5597c4e632f0 con 0x5597c4f002e0 2024-09-19T08:56:44.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.468+0000 7f5b0145b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5597c4e0b270 con 0x5597c4f05370 2024-09-19T08:56:44.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.468+0000 7f5b0145b740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5597c4e5f2b0 con 0x5597c4eff9a0 2024-09-19T08:56:44.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.468+0000 7f5af77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597c4f002e0 0x5597c4f04da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:44.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.468+0000 7f5af77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597c4f002e0 0x5597c4f04da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53662/0 (socket says 172.21.15.92:53662) 2024-09-19T08:56:44.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.469+0000 7f5af77fe640 1 -- 172.21.15.92:0/4214927109 learned_addr learned my addr 172.21.15.92:0/4214927109 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:44.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.469+0000 7f5afcc57640 1 --2- 172.21.15.92:0/4214927109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597c4f05370 0x5597c4f07830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:44.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.469+0000 7f5af7fff640 1 --2- 172.21.15.92:0/4214927109 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5597c4eff9a0 0x5597c4effda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:44.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.469+0000 7f5af77fe640 1 -- 172.21.15.92:0/4214927109 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5597c4eff9a0 msgr2=0x5597c4effda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:44.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.469+0000 7f5af77fe640 1 --2- 172.21.15.92:0/4214927109 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5597c4eff9a0 0x5597c4effda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:44.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.469+0000 7f5af77fe640 1 -- 172.21.15.92:0/4214927109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597c4f05370 msgr2=0x5597c4f07830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:44.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.469+0000 7f5af77fe640 1 --2- 172.21.15.92:0/4214927109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597c4f05370 0x5597c4f07830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:44.476 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.469+0000 7f5af77fe640 1 -- 172.21.15.92:0/4214927109 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597c4e0a340 con 0x5597c4f002e0 2024-09-19T08:56:44.476 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.469+0000 7f5afcc57640 1 --2- 172.21.15.92:0/49399934 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5ae00a3370 0x7f5ae00a5830 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5af806b1a0 tx=0x7f5af0011bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:44.476 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.469+0000 7f5af7fff640 1 --2- 172.21.15.92:0/4214927109 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5597c4eff9a0 0x5597c4effda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:44.476 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.469+0000 7f5af77fe640 1 --2- 172.21.15.92:0/4214927109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597c4f002e0 0x5597c4f04da0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5aec09c1b0 tx=0x7f5aec09bb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d48f2f28ba201c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:44.476 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.469+0000 7f5ade7fc640 1 -- 172.21.15.92:0/4214927109 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aec0bae60 con 0x5597c4f002e0 2024-09-19T08:56:44.476 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.469+0000 7f5ade7fc640 1 -- 172.21.15.92:0/4214927109 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5aec0a05d0 con 0x5597c4f002e0 2024-09-19T08:56:44.476 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.469+0000 7f5ade7fc640 1 -- 172.21.15.92:0/4214927109 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aec0a03d0 con 0x5597c4f002e0 2024-09-19T08:56:44.476 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.470+0000 7f5b0145b740 1 -- 172.21.15.92:0/4214927109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597c4f002e0 msgr2=0x5597c4f04da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:44.476 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.470+0000 7f5b0145b740 1 --2- 172.21.15.92:0/4214927109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597c4f002e0 0x5597c4f04da0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5aec09c1b0 tx=0x7f5aec09bb80 comp rx=0 tx=0).stop 2024-09-19T08:56:44.476 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.470+0000 7f5b0145b740 1 -- 172.21.15.92:0/4214927109 shutdown_connections 2024-09-19T08:56:44.476 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.470+0000 7f5b0145b740 1 --2- 172.21.15.92:0/4214927109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597c4f05370 0x5597c4f07830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:44.476 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.470+0000 7f5b0145b740 1 --2- 172.21.15.92:0/4214927109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597c4f002e0 0x5597c4f04da0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:44.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.470+0000 7f5b0145b740 1 --2- 172.21.15.92:0/4214927109 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5597c4eff9a0 0x5597c4effda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:44.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.470+0000 7f5b0145b740 1 -- 172.21.15.92:0/4214927109 >> 172.21.15.92:0/4214927109 conn(0x5597c4efb010 msgr2=0x5597c4efb410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:44.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.470+0000 7f5b0145b740 1 -- 172.21.15.92:0/4214927109 shutdown_connections 2024-09-19T08:56:44.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.470+0000 7f5b0145b740 1 -- 172.21.15.92:0/4214927109 wait complete. 2024-09-19T08:56:44.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.470+0000 7f5b0145b740 1 -- start start 2024-09-19T08:56:44.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.471+0000 7f5b0145b740 1 Processor -- start 2024-09-19T08:56:44.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.471+0000 7f5b0145b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5597c4eff9a0 0x5597c4f09b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:44.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.471+0000 7f5b0145b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597c4f002e0 0x5597c4f0a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:44.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.471+0000 7f5b0145b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597c4f05370 0x5597c4f110e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:44.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.471+0000 7f5b0145b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5597c4f082e0 con 0x5597c4f002e0 2024-09-19T08:56:44.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.471+0000 7f5b0145b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5597c4dec290 con 0x5597c4f05370 2024-09-19T08:56:44.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.471+0000 7f5b0145b740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5597c4f08460 con 0x5597c4eff9a0 2024-09-19T08:56:44.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.471+0000 7f5b0145b740 10 client.0 _ll_register_callbacks cb 0x5597c4e1d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:44.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.471+0000 7f5af77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597c4f002e0 0x5597c4f0a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:44.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.471+0000 7f5af7fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5597c4eff9a0 0x5597c4f09b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:44.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.471+0000 7f5af77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597c4f002e0 0x5597c4f0a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53678/0 (socket says 172.21.15.92:53678) 2024-09-19T08:56:44.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.471+0000 7f5af77fe640 1 -- 172.21.15.92:0/3788338322 learned_addr learned my addr 172.21.15.92:0/3788338322 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:44.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.471+0000 7f5afcc57640 1 --2- 172.21.15.92:0/3788338322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597c4f05370 0x5597c4f110e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:44.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.471+0000 7f5af7fff640 1 -- 172.21.15.92:0/3788338322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597c4f05370 msgr2=0x5597c4f110e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:44.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.471+0000 7f5af7fff640 1 --2- 172.21.15.92:0/3788338322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597c4f05370 0x5597c4f110e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:44.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.471+0000 7f5af7fff640 1 -- 172.21.15.92:0/3788338322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597c4f002e0 msgr2=0x5597c4f0a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:44.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.471+0000 7f5af7fff640 1 --2- 172.21.15.92:0/3788338322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597c4f002e0 0x5597c4f0a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:44.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.471+0000 7f5af7fff640 1 -- 172.21.15.92:0/3788338322 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597c4b76210 con 0x5597c4eff9a0 2024-09-19T08:56:44.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.472+0000 7f5af7fff640 1 --2- 172.21.15.92:0/3788338322 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5597c4eff9a0 0x5597c4f09b60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8031440 tx=0x7f5ae80318e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85b902b553dfbc07 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:44.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.472+0000 7f5ad77fe640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T08:56:44.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.472+0000 7f5ad77fe640 1 -- 172.21.15.92:0/3788338322 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8035040 con 0x5597c4eff9a0 2024-09-19T08:56:44.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.472+0000 7f5ad77fe640 1 -- 172.21.15.92:0/3788338322 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f5ae8004240 con 0x5597c4eff9a0 2024-09-19T08:56:44.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.472+0000 7f5b0145b740 1 -- 172.21.15.92:0/3788338322 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5aec0a05d0 con 0x5597c4eff9a0 2024-09-19T08:56:44.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.472+0000 7f5ad77fe640 1 -- 172.21.15.92:0/3788338322 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f5ae8004440 con 0x5597c4eff9a0 2024-09-19T08:56:44.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.472+0000 7f5b0145b740 10 client.24814 fetch_fsmap learned FSMap version 19 2024-09-19T08:56:44.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.472+0000 7f5b0145b740 1 -- 172.21.15.92:0/3788338322 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5597c4c42620 con 0x5597c4eff9a0 2024-09-19T08:56:44.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.472+0000 7f5ad77fe640 1 -- 172.21.15.92:0/3788338322 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5aec0a05d0 con 0x5597c4eff9a0 2024-09-19T08:56:44.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.472+0000 7f5ad77fe640 1 -- 172.21.15.92:0/3788338322 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f5ae8004b20 con 0x5597c4eff9a0 2024-09-19T08:56:44.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.472+0000 7f5b0145b740 10 client.24814 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:56:44.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.472+0000 7f5b0145b740 10 client.24814 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T08:56:44.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.472+0000 7f5b0145b740 20 client.24814 populate_metadata read hostname 'smithi092' 2024-09-19T08:56:44.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.472+0000 7f5b0145b740 1 --2- 172.21.15.92:0/3788338322 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5597c4f157d0 0x5597c4f17bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:44.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.472+0000 7f5b0145b740 4 client.24814 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:56:44.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.472+0000 7f5b0145b740 1 -- 172.21.15.92:0/3788338322 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597c4e70a20 con 0x5597c4f157d0 2024-09-19T08:56:44.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.473+0000 7f5af77fe640 1 --2- 172.21.15.92:0/3788338322 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5597c4f157d0 0x5597c4f17bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:44.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.473+0000 7f5af77fe640 1 --2- 172.21.15.92:0/3788338322 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5597c4f157d0 0x5597c4f17bc0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a87fa43085ed018c server_cookie=c3f614c691c6ee60 in_seq=0 out_seq=0 2024-09-19T08:56:44.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.473+0000 7f5ad77fe640 10 client.24814 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:44.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.473+0000 7f5ad77fe640 1 -- 172.21.15.92:0/3788338322 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f5aec07ae50 con 0x5597c4f157d0 2024-09-19T08:56:44.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.474+0000 7f5ad77fe640 10 client.24814 handle_command_reply: tid=0 2024-09-19T08:56:44.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.474+0000 7f5b0145b740 1 client.24814 shutdown 2024-09-19T08:56:44.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.474+0000 7f5b0145b740 1 -- 172.21.15.92:0/3788338322 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5597c4eff9a0 msgr2=0x5597c4f09b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:44.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.474+0000 7f5b0145b740 1 --2- 172.21.15.92:0/3788338322 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5597c4eff9a0 0x5597c4f09b60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8031440 tx=0x7f5ae80318e0 comp rx=0 tx=0).stop 2024-09-19T08:56:44.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.474+0000 7f5b0145b740 1 -- 172.21.15.92:0/3788338322 shutdown_connections 2024-09-19T08:56:44.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.474+0000 7f5b0145b740 1 --2- 172.21.15.92:0/3788338322 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5597c4f157d0 0x5597c4f17bc0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:44.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.474+0000 7f5b0145b740 1 --2- 172.21.15.92:0/3788338322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597c4f05370 0x5597c4f110e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:44.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.474+0000 7f5ad77fe640 0 client.24814 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:44.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.474+0000 7f5b0145b740 1 --2- 172.21.15.92:0/3788338322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597c4f002e0 0x5597c4f0a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:44.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.474+0000 7f5b0145b740 1 --2- 172.21.15.92:0/3788338322 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5597c4eff9a0 0x5597c4f09b60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:44.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.474+0000 7f5b0145b740 1 -- 172.21.15.92:0/3788338322 >> 172.21.15.92:0/3788338322 conn(0x5597c4efb010 msgr2=0x5597c4efc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:44.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.474+0000 7f5b0145b740 1 -- 172.21.15.92:0/3788338322 shutdown_connections 2024-09-19T08:56:44.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.474+0000 7f5b0145b740 1 -- 172.21.15.92:0/3788338322 wait complete. 2024-09-19T08:56:44.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.474+0000 7f5b0145b740 20 client.24814 trim_cache size 0 max 16384 2024-09-19T08:56:44.503 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.502+0000 7f5b0145b740 1 Processor -- start 2024-09-19T08:56:44.503 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.502+0000 7f5b0145b740 1 -- start start 2024-09-19T08:56:44.503 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.502+0000 7f5b0145b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597c4efb010 0x5597c4f09910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:44.503 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.502+0000 7f5b0145b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597c4eff9a0 0x5597c4f110a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:44.503 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.502+0000 7f5b0145b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5597c4f002e0 0x5597c4efc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:44.503 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.502+0000 7f5b0145b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5af81a9310 con 0x5597c4eff9a0 2024-09-19T08:56:44.503 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.502+0000 7f5b0145b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5af81abbb0 con 0x5597c4efb010 2024-09-19T08:56:44.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.502+0000 7f5b0145b740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5af81a99a0 con 0x5597c4f002e0 2024-09-19T08:56:44.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.502+0000 7f5af77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597c4eff9a0 0x5597c4f110a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:44.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.502+0000 7f5af77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597c4eff9a0 0x5597c4f110a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53684/0 (socket says 172.21.15.92:53684) 2024-09-19T08:56:44.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.502+0000 7f5af77fe640 1 -- 172.21.15.92:0/2767926849 learned_addr learned my addr 172.21.15.92:0/2767926849 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:44.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.502+0000 7f5af7fff640 1 --2- 172.21.15.92:0/2767926849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597c4efb010 0x5597c4f09910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:44.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.503+0000 7f5afcc57640 1 --2- 172.21.15.92:0/2767926849 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5597c4f002e0 0x5597c4efc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:44.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.503+0000 7f5af77fe640 1 -- 172.21.15.92:0/2767926849 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5597c4f002e0 msgr2=0x5597c4efc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:44.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.503+0000 7f5af77fe640 1 --2- 172.21.15.92:0/2767926849 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5597c4f002e0 0x5597c4efc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:44.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.503+0000 7f5af77fe640 1 -- 172.21.15.92:0/2767926849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597c4efb010 msgr2=0x5597c4f09910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:44.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.503+0000 7f5af77fe640 1 --2- 172.21.15.92:0/2767926849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597c4efb010 0x5597c4f09910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:44.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.503+0000 7f5af77fe640 1 -- 172.21.15.92:0/2767926849 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597c4f09ff0 con 0x5597c4eff9a0 2024-09-19T08:56:44.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.503+0000 7f5af77fe640 1 --2- 172.21.15.92:0/2767926849 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597c4eff9a0 0x5597c4f110a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00c6a0 tx=0x7f5aec09bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11acefeb9ac3305b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:44.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.503+0000 7f5addffb640 1 -- 172.21.15.92:0/2767926849 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aec0bae60 con 0x5597c4eff9a0 2024-09-19T08:56:44.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.503+0000 7f5addffb640 1 -- 172.21.15.92:0/2767926849 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5597c4e70a20 con 0x5597c4eff9a0 2024-09-19T08:56:44.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.503+0000 7f5addffb640 1 -- 172.21.15.92:0/2767926849 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aec0a03d0 con 0x5597c4eff9a0 2024-09-19T08:56:44.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.504+0000 7f5b0145b740 1 -- 172.21.15.92:0/2767926849 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597c4eff9a0 msgr2=0x5597c4f110a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:44.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.504+0000 7f5b0145b740 1 --2- 172.21.15.92:0/2767926849 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597c4eff9a0 0x5597c4f110a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00c6a0 tx=0x7f5aec09bcb0 comp rx=0 tx=0).stop 2024-09-19T08:56:44.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.504+0000 7f5b0145b740 1 -- 172.21.15.92:0/2767926849 shutdown_connections 2024-09-19T08:56:44.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.504+0000 7f5b0145b740 1 --2- 172.21.15.92:0/2767926849 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5597c4f002e0 0x5597c4efc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:44.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.504+0000 7f5b0145b740 1 --2- 172.21.15.92:0/2767926849 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597c4eff9a0 0x5597c4f110a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:44.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.504+0000 7f5b0145b740 1 --2- 172.21.15.92:0/2767926849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597c4efb010 0x5597c4f09910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:44.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.504+0000 7f5b0145b740 1 -- 172.21.15.92:0/2767926849 >> 172.21.15.92:0/2767926849 conn(0x5597c4f04e90 msgr2=0x5597c4efa1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:44.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.504+0000 7f5b0145b740 1 -- 172.21.15.92:0/2767926849 shutdown_connections 2024-09-19T08:56:44.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.504+0000 7f5b0145b740 1 -- 172.21.15.92:0/2767926849 wait complete. 2024-09-19T08:56:44.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.505+0000 7f5b0145b740 1 -- start start 2024-09-19T08:56:44.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.505+0000 7f5b0145b740 1 Processor -- start 2024-09-19T08:56:44.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.505+0000 7f5b0145b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5597c4efb010 0x5597c4f0ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:44.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.505+0000 7f5b0145b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597c4eff9a0 0x5597c4f0f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.505+0000 7f5b0145b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597c4f002e0 0x5597c4f103d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.505+0000 7f5b0145b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5af81aa070 con 0x5597c4eff9a0 2024-09-19T08:56:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.505+0000 7f5b0145b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5af81ab4e0 con 0x5597c4f002e0 2024-09-19T08:56:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.505+0000 7f5b0145b740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5af81aa740 con 0x5597c4efb010 2024-09-19T08:56:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.505+0000 7f5b0145b740 10 client.0 _ll_register_callbacks cb 0x7f5af00093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.505+0000 7f5af77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597c4eff9a0 0x5597c4f0f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.505+0000 7f5af77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597c4eff9a0 0x5597c4f0f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53686/0 (socket says 172.21.15.92:53686) 2024-09-19T08:56:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.505+0000 7f5af77fe640 1 -- 172.21.15.92:0/37143211 learned_addr learned my addr 172.21.15.92:0/37143211 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.505+0000 7f5af7fff640 1 --2- 172.21.15.92:0/37143211 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5597c4efb010 0x5597c4f0ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.506+0000 7f5afcc57640 1 --2- 172.21.15.92:0/37143211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597c4f002e0 0x5597c4f103d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.506+0000 7f5af7fff640 1 -- 172.21.15.92:0/37143211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597c4f002e0 msgr2=0x5597c4f103d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.506+0000 7f5af7fff640 1 --2- 172.21.15.92:0/37143211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597c4f002e0 0x5597c4f103d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.506+0000 7f5af7fff640 1 -- 172.21.15.92:0/37143211 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597c4eff9a0 msgr2=0x5597c4f0f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.506+0000 7f5af7fff640 1 --2- 172.21.15.92:0/37143211 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597c4eff9a0 0x5597c4f0f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.506+0000 7f5af7fff640 1 -- 172.21.15.92:0/37143211 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597c4f109e0 con 0x5597c4efb010 2024-09-19T08:56:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.506+0000 7f5afcc57640 1 --2- 172.21.15.92:0/37143211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597c4f002e0 0x5597c4f103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.506+0000 7f5af77fe640 1 --2- 172.21.15.92:0/37143211 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597c4eff9a0 0x5597c4f0f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.506+0000 7f5af7fff640 1 --2- 172.21.15.92:0/37143211 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5597c4efb010 0x5597c4f0ee80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8004e90 tx=0x7f5ae8009230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf1a97c8595e4aac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.506+0000 7f5ad77fe640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T08:56:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.506+0000 7f5ad77fe640 1 -- 172.21.15.92:0/37143211 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8035070 con 0x5597c4efb010 2024-09-19T08:56:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.506+0000 7f5b0145b740 1 -- 172.21.15.92:0/37143211 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5597c4e70a20 con 0x5597c4efb010 2024-09-19T08:56:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.506+0000 7f5ad77fe640 1 -- 172.21.15.92:0/37143211 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f5ae8004b70 con 0x5597c4efb010 2024-09-19T08:56:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.507+0000 7f5ad77fe640 1 -- 172.21.15.92:0/37143211 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f5ae8004f90 con 0x5597c4efb010 2024-09-19T08:56:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.507+0000 7f5b0145b740 10 client.24820 fetch_fsmap learned FSMap version 19 2024-09-19T08:56:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.507+0000 7f5b0145b740 1 -- 172.21.15.92:0/37143211 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5597c4f80bd0 con 0x5597c4efb010 2024-09-19T08:56:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.507+0000 7f5ad77fe640 1 -- 172.21.15.92:0/37143211 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5597c4e70a20 con 0x5597c4efb010 2024-09-19T08:56:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.507+0000 7f5ad77fe640 1 -- 172.21.15.92:0/37143211 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f5ae8003fb0 con 0x5597c4efb010 2024-09-19T08:56:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.507+0000 7f5b0145b740 10 client.24820 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:56:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.507+0000 7f5b0145b740 10 client.24820 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T08:56:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.507+0000 7f5b0145b740 20 client.24820 populate_metadata read hostname 'smithi092' 2024-09-19T08:56:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.507+0000 7f5b0145b740 1 --2- 172.21.15.92:0/37143211 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5597c4f05370 0x5597c4f835e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.507+0000 7f5b0145b740 4 client.24820 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:56:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.507+0000 7f5b0145b740 1 -- 172.21.15.92:0/37143211 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5597c4e6ad70 con 0x5597c4f05370 2024-09-19T08:56:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.507+0000 7f5af77fe640 1 --2- 172.21.15.92:0/37143211 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5597c4f05370 0x5597c4f835e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.508+0000 7f5ad77fe640 10 client.24820 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.508+0000 7f5af77fe640 1 --2- 172.21.15.92:0/37143211 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5597c4f05370 0x5597c4f835e0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50212a1ea225211b server_cookie=f31a9c8263cbd0b9 in_seq=0 out_seq=0 2024-09-19T08:56:44.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.664+0000 7f5ad77fe640 1 -- 172.21.15.92:0/37143211 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5597c4e6ad70 con 0x5597c4f05370 2024-09-19T08:56:44.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.664+0000 7f5ad77fe640 10 client.24820 handle_command_reply: tid=0 2024-09-19T08:56:44.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.664+0000 7f5b0145b740 1 client.24820 shutdown 2024-09-19T08:56:44.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.664+0000 7f5b0145b740 1 -- 172.21.15.92:0/37143211 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5597c4efb010 msgr2=0x5597c4f0ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:44.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.664+0000 7f5b0145b740 1 --2- 172.21.15.92:0/37143211 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5597c4efb010 0x5597c4f0ee80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8004e90 tx=0x7f5ae8009230 comp rx=0 tx=0).stop 2024-09-19T08:56:44.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.664+0000 7f5b0145b740 1 -- 172.21.15.92:0/37143211 shutdown_connections 2024-09-19T08:56:44.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.664+0000 7f5b0145b740 1 --2- 172.21.15.92:0/37143211 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5597c4f05370 0x5597c4f835e0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:44.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.664+0000 7f5b0145b740 1 --2- 172.21.15.92:0/37143211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597c4f002e0 0x5597c4f103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.664+0000 7f5b0145b740 1 --2- 172.21.15.92:0/37143211 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597c4eff9a0 0x5597c4f0f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.664+0000 7f5b0145b740 1 --2- 172.21.15.92:0/37143211 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5597c4efb010 0x5597c4f0ee80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.664+0000 7f5ad77fe640 0 client.24820 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.664+0000 7f5b0145b740 1 -- 172.21.15.92:0/37143211 >> 172.21.15.92:0/37143211 conn(0x5597c4f04e90 msgr2=0x5597c4efb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.664+0000 7f5b0145b740 1 -- 172.21.15.92:0/37143211 shutdown_connections 2024-09-19T08:56:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.664+0000 7f5b0145b740 1 -- 172.21.15.92:0/37143211 wait complete. 2024-09-19T08:56:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.664+0000 7f5b0145b740 20 client.24820 trim_cache size 0 max 16384 2024-09-19T08:56:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T08:56:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T08:56:44.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T08:56:44.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T08:56:44.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.665+0000 7f5afe6ba640 1 -- 172.21.15.92:0/49399934 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5ae00a3370 msgr2=0x7f5ae00a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:44.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.665+0000 7f5afe6ba640 1 --2- 172.21.15.92:0/49399934 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5ae00a3370 0x7f5ae00a5830 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5af806b1a0 tx=0x7f5af0011bc0 comp rx=0 tx=0).stop 2024-09-19T08:56:44.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.665+0000 7f5afe6ba640 1 -- 172.21.15.92:0/49399934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af8104f00 msgr2=0x7f5af8100580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:44.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.665+0000 7f5afe6ba640 1 --2- 172.21.15.92:0/49399934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af8104f00 0x7f5af8100580 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00e9c0 tx=0x7f5aec00ee80 comp rx=0 tx=0).stop 2024-09-19T08:56:44.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.665+0000 7f5afe6ba640 1 -- 172.21.15.92:0/49399934 shutdown_connections 2024-09-19T08:56:44.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.665+0000 7f5afe6ba640 1 --2- 172.21.15.92:0/49399934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5af8107830 0x7f5af8100ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:44.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.665+0000 7f5afe6ba640 1 --2- 172.21.15.92:0/49399934 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5ae00a3370 0x7f5ae00a5830 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:44.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.665+0000 7f5afe6ba640 1 --2- 172.21.15.92:0/49399934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af8104f00 0x7f5af8100580 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:44.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.665+0000 7f5afe6ba640 1 --2- 172.21.15.92:0/49399934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5af81025d0 0x7f5af8101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:44.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.665+0000 7f5afe6ba640 1 -- 172.21.15.92:0/49399934 >> 172.21.15.92:0/49399934 conn(0x7f5af80fc1b0 msgr2=0x7f5af8102fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:44.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.665+0000 7f5afe6ba640 1 -- 172.21.15.92:0/49399934 shutdown_connections 2024-09-19T08:56:44.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:44.665+0000 7f5afe6ba640 1 -- 172.21.15.92:0/49399934 wait complete. 2024-09-19T08:56:45.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:45 smithi167 ceph-mon[35359]: pgmap v338: 97 pgs: 97 active+clean; 208 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 32 MiB/s wr, 132 op/s 2024-09-19T08:56:45.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:45 smithi190 ceph-mon[35358]: pgmap v338: 97 pgs: 97 active+clean; 208 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 32 MiB/s wr, 132 op/s 2024-09-19T08:56:45.737 INFO:teuthology.orchestra.run.smithi092.stderr:done in 6.29 s (drop tables 0.00 s, create tables 0.02 s, client-side generate 4.36 s, vacuum 0.59 s, primary keys 1.32 s). 2024-09-19T08:56:45.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:45 smithi092 ceph-mon[31407]: pgmap v338: 97 pgs: 97 active+clean; 208 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 32 MiB/s wr, 132 op/s 2024-09-19T08:56:45.738 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900' 2024-09-19T08:56:45.793 INFO:teuthology.orchestra.run.smithi092.stderr:starting vacuum...end. 2024-09-19T08:56:47.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:47 smithi167 ceph-mon[35359]: pgmap v339: 97 pgs: 97 active+clean; 324 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 51 MiB/s wr, 156 op/s 2024-09-19T08:56:47.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:47 smithi190 ceph-mon[35358]: pgmap v339: 97 pgs: 97 active+clean; 324 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 51 MiB/s wr, 156 op/s 2024-09-19T08:56:47.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:47 smithi092 ceph-mon[31407]: pgmap v339: 97 pgs: 97 active+clean; 324 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 51 MiB/s wr, 156 op/s 2024-09-19T08:56:49.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:49 smithi190 ceph-mon[35358]: pgmap v340: 97 pgs: 97 active+clean; 464 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 66 MiB/s wr, 296 op/s 2024-09-19T08:56:49.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:49 smithi092 ceph-mon[31407]: pgmap v340: 97 pgs: 97 active+clean; 464 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 66 MiB/s wr, 296 op/s 2024-09-19T08:56:49.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:49 smithi167 ceph-mon[35359]: pgmap v340: 97 pgs: 97 active+clean; 464 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 66 MiB/s wr, 296 op/s 2024-09-19T08:56:50.269 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 11.2 2024-09-19T08:56:50.269 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:56:50.684 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:50.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 5.0 s, 6595.1 tps, lat 14.938 ms stddev 15.498 2024-09-19T08:56:51.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.287+0000 7f6129ffb640 1 -- 172.21.15.92:0/191776685 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f611c0035f0 con 0x7f612c100e20 2024-09-19T08:56:51.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.288+0000 7f613173c640 1 -- 172.21.15.92:0/191776685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f612c100e20 msgr2=0x7f612c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:51.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.288+0000 7f613173c640 1 --2- 172.21.15.92:0/191776685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f612c100e20 0x7f612c101200 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f611c009900 tx=0x7f611c02a4d0 comp rx=0 tx=0).stop 2024-09-19T08:56:51.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.288+0000 7f613173c640 1 -- 172.21.15.92:0/191776685 shutdown_connections 2024-09-19T08:56:51.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.288+0000 7f613173c640 1 --2- 172.21.15.92:0/191776685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f612c102ef0 0x7f612c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:51.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.288+0000 7f613173c640 1 --2- 172.21.15.92:0/191776685 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f612c102570 0x7f612c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:51.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.288+0000 7f613173c640 1 --2- 172.21.15.92:0/191776685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f612c100e20 0x7f612c101200 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:51.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.288+0000 7f613173c640 1 -- 172.21.15.92:0/191776685 >> 172.21.15.92:0/191776685 conn(0x7f612c0fc7d0 msgr2=0x7f612c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:51.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.288+0000 7f613173c640 1 -- 172.21.15.92:0/191776685 shutdown_connections 2024-09-19T08:56:51.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.290+0000 7f613173c640 1 -- 172.21.15.92:0/191776685 wait complete. 2024-09-19T08:56:51.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.291+0000 7f613173c640 1 Processor -- start 2024-09-19T08:56:51.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.291+0000 7f613173c640 1 -- start start 2024-09-19T08:56:51.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.291+0000 7f613173c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f612c100e20 0x7f612c19d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:51.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.291+0000 7f613173c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f612c102570 0x7f612c19d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:51.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.291+0000 7f613173c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f612c102ef0 0x7f612c196320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:51.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.291+0000 7f613173c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f612c10fe80 con 0x7f612c102570 2024-09-19T08:56:51.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.291+0000 7f613173c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f612c10fd00 con 0x7f612c102ef0 2024-09-19T08:56:51.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.291+0000 7f613173c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f612c110000 con 0x7f612c100e20 2024-09-19T08:56:51.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.292+0000 7f612b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f612c102ef0 0x7f612c196320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:51.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.292+0000 7f612b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f612c102ef0 0x7f612c196320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:49332/0 (socket says 172.21.15.92:49332) 2024-09-19T08:56:51.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.292+0000 7f612b7fe640 1 -- 172.21.15.92:0/698551655 learned_addr learned my addr 172.21.15.92:0/698551655 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:51.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.292+0000 7f612b7fe640 1 -- 172.21.15.92:0/698551655 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f612c100e20 msgr2=0x7f612c19d0b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T08:56:51.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.292+0000 7f612b7fe640 1 --2- 172.21.15.92:0/698551655 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f612c100e20 0x7f612c19d0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:51.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.292+0000 7f612b7fe640 1 -- 172.21.15.92:0/698551655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f612c102570 msgr2=0x7f612c19d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:51.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.292+0000 7f612b7fe640 1 --2- 172.21.15.92:0/698551655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f612c102570 0x7f612c19d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:51.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.293+0000 7f612b7fe640 1 -- 172.21.15.92:0/698551655 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f612c196be0 con 0x7f612c102ef0 2024-09-19T08:56:51.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.293+0000 7f612b7fe640 1 --2- 172.21.15.92:0/698551655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f612c102ef0 0x7f612c196320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f612400eaa0 tx=0x7f612400ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:51.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.294+0000 7f6113fff640 1 -- 172.21.15.92:0/698551655 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612400cdb0 con 0x7f612c102ef0 2024-09-19T08:56:51.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.294+0000 7f6113fff640 1 -- 172.21.15.92:0/698551655 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6124005020 con 0x7f612c102ef0 2024-09-19T08:56:51.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.294+0000 7f6113fff640 1 -- 172.21.15.92:0/698551655 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61240116d0 con 0x7f612c102ef0 2024-09-19T08:56:51.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.294+0000 7f613173c640 1 -- 172.21.15.92:0/698551655 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f612c196ed0 con 0x7f612c102ef0 2024-09-19T08:56:51.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.294+0000 7f613173c640 1 -- 172.21.15.92:0/698551655 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f612c19ae70 con 0x7f612c102ef0 2024-09-19T08:56:51.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.297+0000 7f613173c640 1 -- 172.21.15.92:0/698551655 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f612c1021b0 con 0x7f612c102ef0 2024-09-19T08:56:51.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.298+0000 7f6113fff640 1 -- 172.21.15.92:0/698551655 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6124005540 con 0x7f612c102ef0 2024-09-19T08:56:51.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.299+0000 7f6113fff640 1 --2- 172.21.15.92:0/698551655 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f61140a3450 0x7f61140a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:51.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.299+0000 7f6113fff640 1 -- 172.21.15.92:0/698551655 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f61240cfb10 con 0x7f612c102ef0 2024-09-19T08:56:51.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.300+0000 7f612affd640 1 --2- 172.21.15.92:0/698551655 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f61140a3450 0x7f61140a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:51.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.301+0000 7f612affd640 1 --2- 172.21.15.92:0/698551655 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f61140a3450 0x7f61140a5910 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f611c033040 tx=0x7f611c005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:51.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.303+0000 7f6113fff640 1 -- 172.21.15.92:0/698551655 <== mon.2 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6124016030 con 0x7f612c102ef0 2024-09-19T08:56:51.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:51 smithi092 ceph-mon[31407]: pgmap v341: 97 pgs: 97 active+clean; 693 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 74 MiB/s wr, 416 op/s 2024-09-19T08:56:51.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:51 smithi190 ceph-mon[35358]: pgmap v341: 97 pgs: 97 active+clean; 693 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 74 MiB/s wr, 416 op/s 2024-09-19T08:56:51.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.730+0000 7f613173c640 1 -- 172.21.15.92:0/698551655 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f612c19b950 con 0x7f612c102ef0 2024-09-19T08:56:51.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.731+0000 7f6113fff640 1 -- 172.21.15.92:0/698551655 <== mon.2 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f612409c7f0 con 0x7f612c102ef0 2024-09-19T08:56:51.731 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:51.731 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T08:56:51.732 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T08:56:51.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.734+0000 7f613173c640 1 -- 172.21.15.92:0/698551655 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f61140a3450 msgr2=0x7f61140a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:51.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.734+0000 7f613173c640 1 --2- 172.21.15.92:0/698551655 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f61140a3450 0x7f61140a5910 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f611c033040 tx=0x7f611c005fd0 comp rx=0 tx=0).stop 2024-09-19T08:56:51.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.734+0000 7f613173c640 1 -- 172.21.15.92:0/698551655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f612c102ef0 msgr2=0x7f612c196320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:51.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.734+0000 7f613173c640 1 --2- 172.21.15.92:0/698551655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f612c102ef0 0x7f612c196320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f612400eaa0 tx=0x7f612400ef60 comp rx=0 tx=0).stop 2024-09-19T08:56:51.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.735+0000 7f613173c640 1 -- 172.21.15.92:0/698551655 shutdown_connections 2024-09-19T08:56:51.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.735+0000 7f613173c640 1 --2- 172.21.15.92:0/698551655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f612c102ef0 0x7f612c196320 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:51.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.735+0000 7f613173c640 1 --2- 172.21.15.92:0/698551655 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f61140a3450 0x7f61140a5910 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:51.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.735+0000 7f613173c640 1 --2- 172.21.15.92:0/698551655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f612c102570 0x7f612c19d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:51.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.735+0000 7f613173c640 1 --2- 172.21.15.92:0/698551655 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f612c100e20 0x7f612c19d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:51.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.735+0000 7f613173c640 1 -- 172.21.15.92:0/698551655 >> 172.21.15.92:0/698551655 conn(0x7f612c0fc7d0 msgr2=0x7f612c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:51.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.736+0000 7f613173c640 1 -- 172.21.15.92:0/698551655 shutdown_connections 2024-09-19T08:56:51.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:51.736+0000 7f613173c640 1 -- 172.21.15.92:0/698551655 wait complete. 2024-09-19T08:56:51.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:51 smithi167 ceph-mon[35359]: pgmap v341: 97 pgs: 97 active+clean; 693 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 74 MiB/s wr, 416 op/s 2024-09-19T08:56:52.248 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:56:52.547 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:52 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/698551655' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:56:52.550 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 131.2 --await-for 45.0' 2024-09-19T08:56:52.550 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 131.2 --await-for 45.0 2024-09-19T08:56:52.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:52 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/698551655' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:56:52.686 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:52.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:52 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/698551655' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:56:53.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.353+0000 7f19b7413640 1 -- 172.21.15.92:0/3273520649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19b0100e20 msgr2=0x7f19b0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:53.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.353+0000 7f19b7413640 1 --2- 172.21.15.92:0/3273520649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19b0100e20 0x7f19b0101200 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f19a8009ca0 tx=0x7f19a802a950 comp rx=0 tx=0).stop 2024-09-19T08:56:53.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.354+0000 7f19b7413640 1 -- 172.21.15.92:0/3273520649 shutdown_connections 2024-09-19T08:56:53.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.354+0000 7f19b7413640 1 --2- 172.21.15.92:0/3273520649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19b0102ef0 0x7f19b010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:53.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.354+0000 7f19b7413640 1 --2- 172.21.15.92:0/3273520649 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19b0102570 0x7f19b01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:53.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.354+0000 7f19b7413640 1 --2- 172.21.15.92:0/3273520649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19b0100e20 0x7f19b0101200 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:53.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.354+0000 7f19b7413640 1 -- 172.21.15.92:0/3273520649 >> 172.21.15.92:0/3273520649 conn(0x7f19b00fc7d0 msgr2=0x7f19b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:53.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.354+0000 7f19b7413640 1 -- 172.21.15.92:0/3273520649 shutdown_connections 2024-09-19T08:56:53.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.354+0000 7f19b7413640 1 -- 172.21.15.92:0/3273520649 wait complete. 2024-09-19T08:56:53.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.356+0000 7f19b7413640 1 Processor -- start 2024-09-19T08:56:53.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.356+0000 7f19b7413640 1 -- start start 2024-09-19T08:56:53.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.356+0000 7f19b7413640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19b0100e20 0x7f19b0197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:53.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.357+0000 7f19b7413640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19b0102570 0x7f19b01979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:53.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.357+0000 7f19b7413640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19b0102ef0 0x7f19b019bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:53.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.357+0000 7f19b7413640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f19b0110fd0 con 0x7f19b0102ef0 2024-09-19T08:56:53.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.357+0000 7f19b7413640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f19b0110e50 con 0x7f19b0100e20 2024-09-19T08:56:53.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.357+0000 7f19b7413640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f19b0111150 con 0x7f19b0102570 2024-09-19T08:56:53.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.357+0000 7f19b49ae640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19b0102570 0x7f19b01979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:53.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.357+0000 7f19b51af640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19b0100e20 0x7f19b0197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:53.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.357+0000 7f19b51af640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19b0100e20 0x7f19b0197490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:34966/0 (socket says 172.21.15.92:34966) 2024-09-19T08:56:53.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.357+0000 7f19b51af640 1 -- 172.21.15.92:0/2504196448 learned_addr learned my addr 172.21.15.92:0/2504196448 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:53.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.357+0000 7f19b49ae640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19b0102570 0x7f19b01979d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:50466/0 (socket says 172.21.15.92:50466) 2024-09-19T08:56:53.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.357+0000 7f19b59b0640 1 --2- 172.21.15.92:0/2504196448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19b0102ef0 0x7f19b019bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:53.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.358+0000 7f19b59b0640 1 -- 172.21.15.92:0/2504196448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19b0102570 msgr2=0x7f19b01979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:53.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.358+0000 7f19b59b0640 1 --2- 172.21.15.92:0/2504196448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19b0102570 0x7f19b01979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:53.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.358+0000 7f19b59b0640 1 -- 172.21.15.92:0/2504196448 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19b0100e20 msgr2=0x7f19b0197490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:53.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.358+0000 7f19b59b0640 1 --2- 172.21.15.92:0/2504196448 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19b0100e20 0x7f19b0197490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:53.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.358+0000 7f19b59b0640 1 -- 172.21.15.92:0/2504196448 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19b019c440 con 0x7f19b0102ef0 2024-09-19T08:56:53.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.359+0000 7f19b59b0640 1 --2- 172.21.15.92:0/2504196448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19b0102ef0 0x7f19b019bd60 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f19a000d6b0 tx=0x7f19a000db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:53.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.360+0000 7f19a67fc640 1 -- 172.21.15.92:0/2504196448 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a0004230 con 0x7f19b0102ef0 2024-09-19T08:56:53.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.360+0000 7f19a67fc640 1 -- 172.21.15.92:0/2504196448 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19a00043d0 con 0x7f19b0102ef0 2024-09-19T08:56:53.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.360+0000 7f19a67fc640 1 -- 172.21.15.92:0/2504196448 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a0010460 con 0x7f19b0102ef0 2024-09-19T08:56:53.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.360+0000 7f19b7413640 1 -- 172.21.15.92:0/2504196448 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19b019c730 con 0x7f19b0102ef0 2024-09-19T08:56:53.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.360+0000 7f19b7413640 1 -- 172.21.15.92:0/2504196448 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19b0069f70 con 0x7f19b0102ef0 2024-09-19T08:56:53.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.366+0000 7f19b97ec740 1 Processor -- start 2024-09-19T08:56:53.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.366+0000 7f19a67fc640 1 -- 172.21.15.92:0/2504196448 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f19a0009820 con 0x7f19b0102ef0 2024-09-19T08:56:53.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.366+0000 7f19b97ec740 1 -- start start 2024-09-19T08:56:53.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.367+0000 7f19b97ec740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a09e154b50 0x55a09e154f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:53.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.367+0000 7f19b97ec740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09e155470 0x55a09e150460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:53.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.367+0000 7f19b49ae640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a09e154b50 0x55a09e154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:53.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.367+0000 7f19b49ae640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a09e154b50 0x55a09e154f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:34970/0 (socket says 172.21.15.92:34970) 2024-09-19T08:56:53.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.367+0000 7f19a67fc640 1 --2- 172.21.15.92:0/2504196448 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f199c0a3340 0x7f199c0a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:53.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.367+0000 7f19a67fc640 1 -- 172.21.15.92:0/2504196448 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f19a00cf230 con 0x7f19b0102ef0 2024-09-19T08:56:53.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.368+0000 7f19b97ec740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a09e168900 0x55a09e16acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:53.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.368+0000 7f19b97ec740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a09e0b22e0 con 0x55a09e155470 2024-09-19T08:56:53.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.368+0000 7f19b49ae640 1 -- 172.21.15.92:0/3602364040 learned_addr learned my addr 172.21.15.92:0/3602364040 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:53.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.368+0000 7f19b97ec740 1 -- 172.21.15.92:0/3602364040 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a09e059ce0 con 0x55a09e154b50 2024-09-19T08:56:53.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.368+0000 7f19b97ec740 1 -- 172.21.15.92:0/3602364040 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55a09e0ae2a0 con 0x55a09e168900 2024-09-19T08:56:53.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.368+0000 7f19b49ae640 1 -- 172.21.15.92:0/3602364040 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a09e168900 msgr2=0x55a09e16acf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T08:56:53.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.368+0000 7f19b49ae640 1 --2- 172.21.15.92:0/3602364040 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a09e168900 0x55a09e16acf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:53.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.368+0000 7f19b49ae640 1 -- 172.21.15.92:0/3602364040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09e155470 msgr2=0x55a09e150460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:53.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.368+0000 7f19b49ae640 1 --2- 172.21.15.92:0/3602364040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09e155470 0x55a09e150460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:53.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.368+0000 7f19b49ae640 1 -- 172.21.15.92:0/3602364040 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a09e03e440 con 0x55a09e154b50 2024-09-19T08:56:53.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.368+0000 7f19b49ae640 1 --2- 172.21.15.92:0/2504196448 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f199c0a3340 0x7f199c0a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:53.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.369+0000 7f19b49ae640 1 --2- 172.21.15.92:0/3602364040 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a09e154b50 0x55a09e154f30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00ff50 tx=0x7f19ac009670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecb4c4f06d0bc3f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:53.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.369+0000 7f199b7fe640 1 -- 172.21.15.92:0/3602364040 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ac0198e0 con 0x55a09e154b50 2024-09-19T08:56:53.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.369+0000 7f199b7fe640 1 -- 172.21.15.92:0/3602364040 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19ac018380 con 0x55a09e154b50 2024-09-19T08:56:53.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.369+0000 7f199b7fe640 1 -- 172.21.15.92:0/3602364040 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ac0225b0 con 0x55a09e154b50 2024-09-19T08:56:53.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.370+0000 7f19b49ae640 1 --2- 172.21.15.92:0/2504196448 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f199c0a3340 0x7f199c0a5800 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f19ac021000 tx=0x7f19ac022970 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:53.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.370+0000 7f19b97ec740 1 -- 172.21.15.92:0/3602364040 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a09e154b50 msgr2=0x55a09e154f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:53.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.370+0000 7f19b97ec740 1 --2- 172.21.15.92:0/3602364040 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a09e154b50 0x55a09e154f30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00ff50 tx=0x7f19ac009670 comp rx=0 tx=0).stop 2024-09-19T08:56:53.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.371+0000 7f19b97ec740 1 -- 172.21.15.92:0/3602364040 shutdown_connections 2024-09-19T08:56:53.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.371+0000 7f19b97ec740 1 --2- 172.21.15.92:0/3602364040 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a09e168900 0x55a09e16acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:53.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.371+0000 7f19b97ec740 1 --2- 172.21.15.92:0/3602364040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09e155470 0x55a09e150460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:53.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.371+0000 7f19b97ec740 1 --2- 172.21.15.92:0/3602364040 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a09e154b50 0x55a09e154f30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:53.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.371+0000 7f19b97ec740 1 -- 172.21.15.92:0/3602364040 >> 172.21.15.92:0/3602364040 conn(0x55a09e151240 msgr2=0x55a09e151620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:53.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.371+0000 7f19b97ec740 1 -- 172.21.15.92:0/3602364040 shutdown_connections 2024-09-19T08:56:53.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.371+0000 7f19b97ec740 1 -- 172.21.15.92:0/3602364040 wait complete. 2024-09-19T08:56:53.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.372+0000 7f19b97ec740 1 -- start start 2024-09-19T08:56:53.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.372+0000 7f19b97ec740 1 Processor -- start 2024-09-19T08:56:53.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.373+0000 7f19b97ec740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a09e154b50 0x55a09e1503e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:53.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.373+0000 7f19b97ec740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09e155470 0x55a09e14d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:53.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.373+0000 7f19b97ec740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a09e168900 0x55a09e14dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:53.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.373+0000 7f19b97ec740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a09e16b2f0 con 0x55a09e155470 2024-09-19T08:56:53.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.373+0000 7f19b97ec740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a09e06d050 con 0x55a09e154b50 2024-09-19T08:56:53.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.373+0000 7f19b97ec740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55a09e16b470 con 0x55a09e168900 2024-09-19T08:56:53.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.373+0000 7f19b97ec740 10 client.0 _ll_register_callbacks cb 0x55a09e0ad160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:53.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.373+0000 7f19b49ae640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09e155470 0x55a09e14d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:53.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.373+0000 7f19b49ae640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09e155470 0x55a09e14d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47142/0 (socket says 172.21.15.92:47142) 2024-09-19T08:56:53.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.373+0000 7f19b49ae640 1 -- 172.21.15.92:0/183782243 learned_addr learned my addr 172.21.15.92:0/183782243 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:53.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.373+0000 7f19b51af640 1 --2- 172.21.15.92:0/183782243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a09e154b50 0x55a09e1503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:53.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.373+0000 7f19b59b0640 1 --2- 172.21.15.92:0/183782243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a09e168900 0x55a09e14dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:53.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.373+0000 7f19b49ae640 1 -- 172.21.15.92:0/183782243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a09e168900 msgr2=0x55a09e14dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:53.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.373+0000 7f19b49ae640 1 --2- 172.21.15.92:0/183782243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a09e168900 0x55a09e14dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:53.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.373+0000 7f19b49ae640 1 -- 172.21.15.92:0/183782243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a09e154b50 msgr2=0x55a09e1503e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:53.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.373+0000 7f19b49ae640 1 --2- 172.21.15.92:0/183782243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a09e154b50 0x55a09e1503e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:53.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.373+0000 7f19b49ae640 1 -- 172.21.15.92:0/183782243 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a09de233c0 con 0x55a09e155470 2024-09-19T08:56:53.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.374+0000 7f19b49ae640 1 --2- 172.21.15.92:0/183782243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09e155470 0x55a09e14d690 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f19ac000c00 tx=0x7f19ac011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab0714480f6f716f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:53.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.374+0000 7f1998ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:56:53.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.375+0000 7f1998ff9640 1 -- 172.21.15.92:0/183782243 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ac037060 con 0x55a09e155470 2024-09-19T08:56:53.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.376+0000 7f19b97ec740 1 -- 172.21.15.92:0/183782243 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19ac018380 con 0x55a09e155470 2024-09-19T08:56:53.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.376+0000 7f1998ff9640 1 -- 172.21.15.92:0/183782243 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f19ac004030 con 0x55a09e155470 2024-09-19T08:56:53.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.376+0000 7f1998ff9640 1 -- 172.21.15.92:0/183782243 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f19ac004230 con 0x55a09e155470 2024-09-19T08:56:53.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.376+0000 7f19b97ec740 10 client.15300 fetch_fsmap learned FSMap version 19 2024-09-19T08:56:53.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.376+0000 7f19b97ec740 1 -- 172.21.15.92:0/183782243 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55a09e176d90 con 0x55a09e155470 2024-09-19T08:56:53.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.377+0000 7f1998ff9640 1 -- 172.21.15.92:0/183782243 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19ac018380 con 0x55a09e155470 2024-09-19T08:56:53.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.377+0000 7f1998ff9640 1 -- 172.21.15.92:0/183782243 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f19ac03c070 con 0x55a09e155470 2024-09-19T08:56:53.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.377+0000 7f19b97ec740 10 client.15300 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:56:53.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.377+0000 7f19b97ec740 10 client.15300 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:56:53.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.377+0000 7f19b97ec740 20 client.15300 populate_metadata read hostname 'smithi092' 2024-09-19T08:56:53.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.377+0000 7f19b97ec740 1 --2- 172.21.15.92:0/183782243 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a09e178250 0x55a09e17a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:53.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.377+0000 7f19b97ec740 4 client.15300 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:56:53.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.377+0000 7f19b97ec740 1 -- 172.21.15.92:0/183782243 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a09e0bf850 con 0x55a09e178250 2024-09-19T08:56:53.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.378+0000 7f19b51af640 1 --2- 172.21.15.92:0/183782243 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a09e178250 0x55a09e17a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:53.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.378+0000 7f19b51af640 1 --2- 172.21.15.92:0/183782243 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a09e178250 0x55a09e17a640 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2c73ac4a0ad5577 server_cookie=8fa2dcfe5c2c7bf2 in_seq=0 out_seq=0 2024-09-19T08:56:53.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.378+0000 7f1998ff9640 10 client.15300 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:53.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.379+0000 7f1998ff9640 1 -- 172.21.15.92:0/183782243 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a09e0bf850 con 0x55a09e178250 2024-09-19T08:56:53.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.379+0000 7f1998ff9640 10 client.15300 handle_command_reply: tid=0 2024-09-19T08:56:53.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.379+0000 7f19b97ec740 1 client.15300 shutdown 2024-09-19T08:56:53.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.380+0000 7f19b97ec740 1 -- 172.21.15.92:0/183782243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09e155470 msgr2=0x55a09e14d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:53.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.380+0000 7f19b97ec740 1 --2- 172.21.15.92:0/183782243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09e155470 0x55a09e14d690 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f19ac000c00 tx=0x7f19ac011000 comp rx=0 tx=0).stop 2024-09-19T08:56:53.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.380+0000 7f19b97ec740 1 -- 172.21.15.92:0/183782243 shutdown_connections 2024-09-19T08:56:53.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.380+0000 7f19b97ec740 1 --2- 172.21.15.92:0/183782243 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a09e178250 0x55a09e17a640 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:53.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.380+0000 7f19b97ec740 1 --2- 172.21.15.92:0/183782243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a09e168900 0x55a09e14dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:53.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.380+0000 7f19b97ec740 1 --2- 172.21.15.92:0/183782243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09e155470 0x55a09e14d690 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:53.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.380+0000 7f19b97ec740 1 --2- 172.21.15.92:0/183782243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a09e154b50 0x55a09e1503e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:53.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.380+0000 7f19b97ec740 1 -- 172.21.15.92:0/183782243 >> 172.21.15.92:0/183782243 conn(0x55a09e151240 msgr2=0x55a09e156fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:53.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.380+0000 7f1998ff9640 0 client.15300 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:53.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.380+0000 7f19b97ec740 1 -- 172.21.15.92:0/183782243 shutdown_connections 2024-09-19T08:56:53.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.380+0000 7f19b97ec740 1 -- 172.21.15.92:0/183782243 wait complete. 2024-09-19T08:56:53.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.380+0000 7f19b97ec740 20 client.15300 trim_cache size 0 max 16384 2024-09-19T08:56:53.406 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:53.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.413+0000 7f19b97ec740 1 Processor -- start 2024-09-19T08:56:53.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.413+0000 7f19b97ec740 1 -- start start 2024-09-19T08:56:53.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.413+0000 7f19b97ec740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a09e154b50 0x55a09e147a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:53.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.414+0000 7f19b97ec740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09e155470 0x55a09e174590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:53.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.414+0000 7f19b51af640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a09e154b50 0x55a09e147a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:53.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.414+0000 7f19b51af640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a09e154b50 0x55a09e147a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:34992/0 (socket says 172.21.15.92:34992) 2024-09-19T08:56:53.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.414+0000 7f19b51af640 1 -- 172.21.15.92:0/2534321836 learned_addr learned my addr 172.21.15.92:0/2534321836 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:53.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.414+0000 7f19b97ec740 1 --2- 172.21.15.92:0/2534321836 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a09e168900 0x55a09e17ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:53.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.414+0000 7f19b49ae640 1 --2- 172.21.15.92:0/2534321836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09e155470 0x55a09e174590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:53.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.414+0000 7f19b97ec740 1 -- 172.21.15.92:0/2534321836 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f19b01a9540 con 0x55a09e155470 2024-09-19T08:56:53.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.415+0000 7f19b97ec740 1 -- 172.21.15.92:0/2534321836 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f19b01abde0 con 0x55a09e154b50 2024-09-19T08:56:53.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.415+0000 7f19b97ec740 1 -- 172.21.15.92:0/2534321836 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f19b01a9bd0 con 0x55a09e168900 2024-09-19T08:56:53.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.415+0000 7f19b59b0640 1 --2- 172.21.15.92:0/2534321836 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a09e168900 0x55a09e17ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:53.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.415+0000 7f19b49ae640 1 -- 172.21.15.92:0/2534321836 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a09e168900 msgr2=0x55a09e17ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:53.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.415+0000 7f19b49ae640 1 --2- 172.21.15.92:0/2534321836 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a09e168900 0x55a09e17ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:53.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.415+0000 7f19b49ae640 1 -- 172.21.15.92:0/2534321836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a09e154b50 msgr2=0x55a09e147a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:53.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.415+0000 7f19b49ae640 1 --2- 172.21.15.92:0/2534321836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a09e154b50 0x55a09e147a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:53.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.415+0000 7f19b49ae640 1 -- 172.21.15.92:0/2534321836 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a09e14c640 con 0x55a09e155470 2024-09-19T08:56:53.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.416+0000 7f19b49ae640 1 --2- 172.21.15.92:0/2534321836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09e155470 0x55a09e174590 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x55a09e14ec40 tx=0x7f19ac01af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=540b48769158f28f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:53.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.417+0000 7f199affd640 1 -- 172.21.15.92:0/2534321836 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ac037070 con 0x55a09e155470 2024-09-19T08:56:53.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.417+0000 7f199affd640 1 -- 172.21.15.92:0/2534321836 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19ac022560 con 0x55a09e155470 2024-09-19T08:56:53.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.418+0000 7f19b97ec740 1 -- 172.21.15.92:0/2534321836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09e155470 msgr2=0x55a09e174590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:53.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.418+0000 7f19b97ec740 1 --2- 172.21.15.92:0/2534321836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09e155470 0x55a09e174590 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x55a09e14ec40 tx=0x7f19ac01af50 comp rx=0 tx=0).stop 2024-09-19T08:56:53.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.418+0000 7f19b97ec740 1 -- 172.21.15.92:0/2534321836 shutdown_connections 2024-09-19T08:56:53.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.418+0000 7f19b97ec740 1 --2- 172.21.15.92:0/2534321836 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a09e168900 0x55a09e17ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:53.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.418+0000 7f19b97ec740 1 --2- 172.21.15.92:0/2534321836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09e155470 0x55a09e174590 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:53.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.418+0000 7f19b97ec740 1 --2- 172.21.15.92:0/2534321836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a09e154b50 0x55a09e147a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:53.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.418+0000 7f19b97ec740 1 -- 172.21.15.92:0/2534321836 >> 172.21.15.92:0/2534321836 conn(0x55a09e151240 msgr2=0x55a09e147370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:53.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.418+0000 7f19b97ec740 1 -- 172.21.15.92:0/2534321836 shutdown_connections 2024-09-19T08:56:53.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.419+0000 7f19b97ec740 1 -- 172.21.15.92:0/2534321836 wait complete. 2024-09-19T08:56:53.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.419+0000 7f19b97ec740 1 -- start start 2024-09-19T08:56:53.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.419+0000 7f19b97ec740 1 Processor -- start 2024-09-19T08:56:53.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.420+0000 7f19b97ec740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a09e154b50 0x55a09e170a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:53.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.420+0000 7f19b97ec740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09e168900 0x55a09e170fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:53.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.420+0000 7f19b97ec740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a09e16bec0 0x55a09e16c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:53.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.420+0000 7f19b97ec740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f19b01aa2a0 con 0x55a09e168900 2024-09-19T08:56:53.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.420+0000 7f19b97ec740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f19b01ab710 con 0x55a09e16bec0 2024-09-19T08:56:53.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.420+0000 7f19b97ec740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f19b01aa970 con 0x55a09e154b50 2024-09-19T08:56:53.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.420+0000 7f19b97ec740 10 client.0 _ll_register_callbacks cb 0x7f19ac00fe50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:53.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.420+0000 7f19b51af640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a09e154b50 0x55a09e170a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:53.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.420+0000 7f19b49ae640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09e168900 0x55a09e170fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:53.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.421+0000 7f19b49ae640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09e168900 0x55a09e170fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47158/0 (socket says 172.21.15.92:47158) 2024-09-19T08:56:53.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.421+0000 7f19b49ae640 1 -- 172.21.15.92:0/364797768 learned_addr learned my addr 172.21.15.92:0/364797768 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:53.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.421+0000 7f19b59b0640 1 --2- 172.21.15.92:0/364797768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a09e16bec0 0x55a09e16c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:53.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.421+0000 7f19b49ae640 1 -- 172.21.15.92:0/364797768 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a09e154b50 msgr2=0x55a09e170a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:53.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.421+0000 7f19b49ae640 1 --2- 172.21.15.92:0/364797768 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a09e154b50 0x55a09e170a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:53.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.421+0000 7f19b49ae640 1 -- 172.21.15.92:0/364797768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a09e16bec0 msgr2=0x55a09e16c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:53.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.421+0000 7f19b49ae640 1 --2- 172.21.15.92:0/364797768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a09e16bec0 0x55a09e16c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:53.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.421+0000 7f19b49ae640 1 -- 172.21.15.92:0/364797768 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a09e14dff0 con 0x55a09e168900 2024-09-19T08:56:53.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.421+0000 7f19b49ae640 1 --2- 172.21.15.92:0/364797768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09e168900 0x55a09e170fc0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f19ac005830 tx=0x7f19ac00ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37c1332afb0887eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:53.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.421+0000 7f1998ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:56:53.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.422+0000 7f1998ff9640 1 -- 172.21.15.92:0/364797768 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ac037070 con 0x55a09e168900 2024-09-19T08:56:53.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.422+0000 7f19b97ec740 1 -- 172.21.15.92:0/364797768 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a09e0b9d60 con 0x55a09e168900 2024-09-19T08:56:53.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.422+0000 7f1998ff9640 1 -- 172.21.15.92:0/364797768 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f19ac019890 con 0x55a09e168900 2024-09-19T08:56:53.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.423+0000 7f1998ff9640 1 -- 172.21.15.92:0/364797768 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f19ac018380 con 0x55a09e168900 2024-09-19T08:56:53.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.423+0000 7f19b97ec740 10 client.15306 fetch_fsmap learned FSMap version 19 2024-09-19T08:56:53.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.423+0000 7f19b97ec740 1 -- 172.21.15.92:0/364797768 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55a09e1e2de0 con 0x55a09e168900 2024-09-19T08:56:53.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.423+0000 7f1998ff9640 1 -- 172.21.15.92:0/364797768 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55a09e0b9d60 con 0x55a09e168900 2024-09-19T08:56:53.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.424+0000 7f1998ff9640 1 -- 172.21.15.92:0/364797768 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f19ac03c040 con 0x55a09e168900 2024-09-19T08:56:53.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.424+0000 7f19b97ec740 10 client.15306 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:56:53.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.424+0000 7f19b97ec740 10 client.15306 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:56:53.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.424+0000 7f19b97ec740 20 client.15306 populate_metadata read hostname 'smithi092' 2024-09-19T08:56:53.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.424+0000 7f19b97ec740 1 --2- 172.21.15.92:0/364797768 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a09e1e3470 0x55a09e1e5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:53.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.424+0000 7f19b97ec740 4 client.15306 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:56:53.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.424+0000 7f19b97ec740 1 -- 172.21.15.92:0/364797768 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a09e036210 con 0x55a09e1e3470 2024-09-19T08:56:53.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.425+0000 7f19b51af640 1 --2- 172.21.15.92:0/364797768 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a09e154b50 0x55a09e170a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:53.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.428+0000 7f19b51af640 1 --2- 172.21.15.92:0/364797768 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a09e1e3470 0x55a09e1e5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:53.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.431+0000 7f19b51af640 1 --2- 172.21.15.92:0/364797768 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a09e1e3470 0x55a09e1e5930 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=643859fd4e58292d server_cookie=5680f13ffcbadbd4 in_seq=0 out_seq=0 2024-09-19T08:56:53.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.431+0000 7f1998ff9640 10 client.15306 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:53.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.432+0000 7f1998ff9640 1 -- 172.21.15.92:0/364797768 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a09e036210 con 0x55a09e1e3470 2024-09-19T08:56:53.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.432+0000 7f1998ff9640 10 client.15306 handle_command_reply: tid=0 2024-09-19T08:56:53.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.432+0000 7f19b97ec740 1 client.15306 shutdown 2024-09-19T08:56:53.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.432+0000 7f19b97ec740 1 -- 172.21.15.92:0/364797768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09e168900 msgr2=0x55a09e170fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:53.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.432+0000 7f19b97ec740 1 --2- 172.21.15.92:0/364797768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09e168900 0x55a09e170fc0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f19ac005830 tx=0x7f19ac00ff70 comp rx=0 tx=0).stop 2024-09-19T08:56:53.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.433+0000 7f19b97ec740 1 -- 172.21.15.92:0/364797768 shutdown_connections 2024-09-19T08:56:53.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.433+0000 7f19b97ec740 1 --2- 172.21.15.92:0/364797768 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a09e1e3470 0x55a09e1e5930 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:53.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.433+0000 7f19b97ec740 1 --2- 172.21.15.92:0/364797768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a09e16bec0 0x55a09e16c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:53.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.433+0000 7f19b97ec740 1 --2- 172.21.15.92:0/364797768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a09e168900 0x55a09e170fc0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:53.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.433+0000 7f19b97ec740 1 --2- 172.21.15.92:0/364797768 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a09e154b50 0x55a09e170a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:53.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.433+0000 7f19b97ec740 1 -- 172.21.15.92:0/364797768 >> 172.21.15.92:0/364797768 conn(0x55a09e151240 msgr2=0x55a09e14eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:53.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.433+0000 7f1998ff9640 0 client.15306 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:53.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.433+0000 7f19b97ec740 1 -- 172.21.15.92:0/364797768 shutdown_connections 2024-09-19T08:56:53.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.435+0000 7f19b97ec740 1 -- 172.21.15.92:0/364797768 wait complete. 2024-09-19T08:56:53.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.435+0000 7f19b97ec740 20 client.15306 trim_cache size 0 max 16384 2024-09-19T08:56:53.435 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T08:56:53.435 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-19T08:56:53.435 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {} 2024-09-19T08:56:53.435 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T08:56:53.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.436+0000 7f19b7413640 1 -- 172.21.15.92:0/2504196448 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f199c0a3340 msgr2=0x7f199c0a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:53.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.436+0000 7f19b7413640 1 --2- 172.21.15.92:0/2504196448 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f199c0a3340 0x7f199c0a5800 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f19ac021000 tx=0x7f19ac022970 comp rx=0 tx=0).stop 2024-09-19T08:56:53.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.436+0000 7f19b7413640 1 -- 172.21.15.92:0/2504196448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19b0102ef0 msgr2=0x7f19b019bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:53.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.436+0000 7f19b7413640 1 --2- 172.21.15.92:0/2504196448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19b0102ef0 0x7f19b019bd60 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f19a000d6b0 tx=0x7f19a000db70 comp rx=0 tx=0).stop 2024-09-19T08:56:53.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.437+0000 7f19b7413640 1 -- 172.21.15.92:0/2504196448 shutdown_connections 2024-09-19T08:56:53.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.437+0000 7f19b7413640 1 --2- 172.21.15.92:0/2504196448 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f199c0a3340 0x7f199c0a5800 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:53.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.437+0000 7f19b7413640 1 --2- 172.21.15.92:0/2504196448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19b0102ef0 0x7f19b019bd60 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:53.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.437+0000 7f19b7413640 1 --2- 172.21.15.92:0/2504196448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19b0102570 0x7f19b01979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:53.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.437+0000 7f19b7413640 1 --2- 172.21.15.92:0/2504196448 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19b0100e20 0x7f19b0197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:53.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.437+0000 7f19b7413640 1 -- 172.21.15.92:0/2504196448 >> 172.21.15.92:0/2504196448 conn(0x7f19b00fc7d0 msgr2=0x7f19b00fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:53.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.437+0000 7f19b7413640 1 -- 172.21.15.92:0/2504196448 shutdown_connections 2024-09-19T08:56:53.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:53.437+0000 7f19b7413640 1 -- 172.21.15.92:0/2504196448 wait complete. 2024-09-19T08:56:53.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:53 smithi092 ceph-mon[31407]: pgmap v342: 97 pgs: 97 active+clean; 829 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 77 MiB/s wr, 572 op/s 2024-09-19T08:56:53.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:53 smithi190 ceph-mon[35358]: pgmap v342: 97 pgs: 97 active+clean; 829 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 77 MiB/s wr, 572 op/s 2024-09-19T08:56:53.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:53 smithi167 ceph-mon[35359]: pgmap v342: 97 pgs: 97 active+clean; 829 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 77 MiB/s wr, 572 op/s 2024-09-19T08:56:54.721 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:56:54.721 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:56:54.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.956+0000 7f201105e640 1 -- 172.21.15.92:0/3337920622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f200c1082a0 msgr2=0x7f200c10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:54.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.956+0000 7f201105e640 1 --2- 172.21.15.92:0/3337920622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f200c1082a0 0x7f200c10ec40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2004009cd0 tx=0x7f200402a8f0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.958+0000 7f201105e640 1 -- 172.21.15.92:0/3337920622 shutdown_connections 2024-09-19T08:56:54.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.958+0000 7f201105e640 1 --2- 172.21.15.92:0/3337920622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f200c1082a0 0x7f200c10ec40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.958+0000 7f201105e640 1 --2- 172.21.15.92:0/3337920622 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f200c1036e0 0x7f200c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.958+0000 7f201105e640 1 --2- 172.21.15.92:0/3337920622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f200c102d30 0x7f200c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.958+0000 7f201105e640 1 -- 172.21.15.92:0/3337920622 >> 172.21.15.92:0/3337920622 conn(0x7f200c0fc7d0 msgr2=0x7f200c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:54.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.958+0000 7f201105e640 1 -- 172.21.15.92:0/3337920622 shutdown_connections 2024-09-19T08:56:54.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.959+0000 7f201105e640 1 -- 172.21.15.92:0/3337920622 wait complete. 2024-09-19T08:56:54.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.959+0000 7f201105e640 1 Processor -- start 2024-09-19T08:56:54.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.960+0000 7f201105e640 1 -- start start 2024-09-19T08:56:54.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.960+0000 7f201105e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f200c102d30 0x7f200c100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:54.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.960+0000 7f201105e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f200c1036e0 0x7f200c100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:54.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.960+0000 7f201105e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f200c1082a0 0x7f200c101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:54.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.960+0000 7f201105e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f200c1120d0 con 0x7f200c1082a0 2024-09-19T08:56:54.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.960+0000 7f201105e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f200c111f50 con 0x7f200c102d30 2024-09-19T08:56:54.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.960+0000 7f201105e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f200c112250 con 0x7f200c1036e0 2024-09-19T08:56:54.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.960+0000 7f200ad9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f200c102d30 0x7f200c100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:54.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.960+0000 7f200ad9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f200c102d30 0x7f200c100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:35022/0 (socket says 172.21.15.92:35022) 2024-09-19T08:56:54.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.960+0000 7f200ad9d640 1 -- 172.21.15.92:0/1532607297 learned_addr learned my addr 172.21.15.92:0/1532607297 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:54.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.961+0000 7f200ad9d640 1 -- 172.21.15.92:0/1532607297 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f200c1036e0 msgr2=0x7f200c100ed0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T08:56:54.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.961+0000 7f200ad9d640 1 --2- 172.21.15.92:0/1532607297 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f200c1036e0 0x7f200c100ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.961+0000 7f200ad9d640 1 -- 172.21.15.92:0/1532607297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f200c1082a0 msgr2=0x7f200c101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:54.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.961+0000 7f200ad9d640 1 --2- 172.21.15.92:0/1532607297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f200c1082a0 0x7f200c101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.961+0000 7f200ad9d640 1 -- 172.21.15.92:0/1532607297 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f200c1a6ac0 con 0x7f200c102d30 2024-09-19T08:56:54.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.961+0000 7f200ad9d640 1 --2- 172.21.15.92:0/1532607297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f200c102d30 0x7f200c100990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc00e9f0 tx=0x7f1ffc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:54.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.962+0000 7f1ff3fff640 1 -- 172.21.15.92:0/1532607297 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc00cd80 con 0x7f200c102d30 2024-09-19T08:56:54.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.962+0000 7f201105e640 1 -- 172.21.15.92:0/1532607297 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f200c1a6db0 con 0x7f200c102d30 2024-09-19T08:56:54.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.962+0000 7f1ff3fff640 1 -- 172.21.15.92:0/1532607297 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ffc010910 con 0x7f200c102d30 2024-09-19T08:56:54.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.962+0000 7f1ff3fff640 1 -- 172.21.15.92:0/1532607297 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc00cd80 con 0x7f200c102d30 2024-09-19T08:56:54.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.962+0000 7f201105e640 1 -- 172.21.15.92:0/1532607297 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f200c1a72c0 con 0x7f200c102d30 2024-09-19T08:56:54.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.966+0000 7f1ff3fff640 1 -- 172.21.15.92:0/1532607297 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1ffc018780 con 0x7f200c102d30 2024-09-19T08:56:54.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.966+0000 7f2013437740 1 Processor -- start 2024-09-19T08:56:54.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.967+0000 7f2013437740 1 -- start start 2024-09-19T08:56:54.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.967+0000 7f2013437740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e33ec23680 0x55e33ec23a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:54.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.967+0000 7f2013437740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e33ec23fa0 0x55e33ec36c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:54.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.967+0000 7f2013437740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33ec37150 0x55e33ec39540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:54.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.967+0000 7f2013437740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e33eb892a0 con 0x55e33ec37150 2024-09-19T08:56:54.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.967+0000 7f2013437740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e33eb30b10 con 0x55e33ec23680 2024-09-19T08:56:54.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.967+0000 7f2013437740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e33eb85260 con 0x55e33ec23fa0 2024-09-19T08:56:54.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.967+0000 7f200a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33ec37150 0x55e33ec39540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:54.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.967+0000 7f200a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33ec37150 0x55e33ec39540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47188/0 (socket says 172.21.15.92:47188) 2024-09-19T08:56:54.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.967+0000 7f200a59c640 1 -- 172.21.15.92:0/3592973506 learned_addr learned my addr 172.21.15.92:0/3592973506 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:54.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.967+0000 7f200b59e640 1 --2- 172.21.15.92:0/3592973506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e33ec23680 0x55e33ec23a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:54.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.967+0000 7f200ad9d640 1 --2- 172.21.15.92:0/3592973506 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e33ec23fa0 0x55e33ec36c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:54.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.968+0000 7f1ff3fff640 1 --2- 172.21.15.92:0/1532607297 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1ff40a3650 0x7f1ff40a5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:54.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.968+0000 7f200b59e640 1 -- 172.21.15.92:0/3592973506 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e33ec23fa0 msgr2=0x55e33ec36c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:54.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.968+0000 7f200b59e640 1 --2- 172.21.15.92:0/3592973506 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e33ec23fa0 0x55e33ec36c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.968+0000 7f200b59e640 1 -- 172.21.15.92:0/3592973506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33ec37150 msgr2=0x55e33ec39540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:54.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.968+0000 7f200b59e640 1 --2- 172.21.15.92:0/3592973506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33ec37150 0x55e33ec39540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.968+0000 7f200b59e640 1 -- 172.21.15.92:0/3592973506 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e33e8fab90 con 0x55e33ec23680 2024-09-19T08:56:54.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.968+0000 7f200a59c640 1 --2- 172.21.15.92:0/3592973506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33ec37150 0x55e33ec39540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:54.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.968+0000 7f200ad9d640 1 --2- 172.21.15.92:0/3592973506 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e33ec23fa0 0x55e33ec36c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:54.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.968+0000 7f1ff3fff640 1 -- 172.21.15.92:0/1532607297 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1ffc00cb80 con 0x7f200c102d30 2024-09-19T08:56:54.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.968+0000 7f200b59e640 1 --2- 172.21.15.92:0/1532607297 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1ff40a3650 0x7f1ff40a5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:54.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.968+0000 7f200b59e640 1 --2- 172.21.15.92:0/3592973506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e33ec23680 0x55e33ec23a60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f200402ae10 tx=0x7f2004009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecb3668fb95ad8e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:54.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.969+0000 7f1ff17fa640 1 -- 172.21.15.92:0/3592973506 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200404b070 con 0x55e33ec23680 2024-09-19T08:56:54.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.969+0000 7f1ff17fa640 1 -- 172.21.15.92:0/3592973506 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f200403f070 con 0x55e33ec23680 2024-09-19T08:56:54.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.969+0000 7f1ff17fa640 1 -- 172.21.15.92:0/3592973506 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2004031ae0 con 0x55e33ec23680 2024-09-19T08:56:54.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.970+0000 7f2013437740 1 -- 172.21.15.92:0/3592973506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e33ec23680 msgr2=0x55e33ec23a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:54.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.970+0000 7f200b59e640 1 --2- 172.21.15.92:0/1532607297 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1ff40a3650 0x7f1ff40a5b10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2004044000 tx=0x7f2004031dc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:54.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.970+0000 7f2013437740 1 --2- 172.21.15.92:0/3592973506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e33ec23680 0x55e33ec23a60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f200402ae10 tx=0x7f2004009a20 comp rx=0 tx=0).stop 2024-09-19T08:56:54.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.970+0000 7f2013437740 1 -- 172.21.15.92:0/3592973506 shutdown_connections 2024-09-19T08:56:54.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.970+0000 7f2013437740 1 --2- 172.21.15.92:0/3592973506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33ec37150 0x55e33ec39540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.970+0000 7f2013437740 1 --2- 172.21.15.92:0/3592973506 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e33ec23fa0 0x55e33ec36c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.970+0000 7f2013437740 1 --2- 172.21.15.92:0/3592973506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e33ec23680 0x55e33ec23a60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.970+0000 7f2013437740 1 -- 172.21.15.92:0/3592973506 >> 172.21.15.92:0/3592973506 conn(0x55e33ec1fcf0 msgr2=0x55e33ec200d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:54.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.970+0000 7f2013437740 1 -- 172.21.15.92:0/3592973506 shutdown_connections 2024-09-19T08:56:54.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.970+0000 7f2013437740 1 -- 172.21.15.92:0/3592973506 wait complete. 2024-09-19T08:56:54.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.971+0000 7f2013437740 1 -- start start 2024-09-19T08:56:54.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.971+0000 7f2013437740 1 Processor -- start 2024-09-19T08:56:54.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.971+0000 7f2013437740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e33ec23680 0x55e33ec34110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:54.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.971+0000 7f2013437740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33ec23fa0 0x55e33ec34650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:54.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.971+0000 7f2013437740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e33ec37150 0x55e33ec34b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:54.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.971+0000 7f2013437740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e33ec39cc0 con 0x55e33ec23fa0 2024-09-19T08:56:54.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.971+0000 7f2013437740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e33eb116e0 con 0x55e33ec23680 2024-09-19T08:56:54.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.971+0000 7f2013437740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e33ec39e40 con 0x55e33ec37150 2024-09-19T08:56:54.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.972+0000 7f2013437740 10 client.0 _ll_register_callbacks cb 0x55e33eb35a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:54.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.972+0000 7f200ad9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e33ec23680 0x55e33ec34110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:54.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.972+0000 7f200a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33ec23fa0 0x55e33ec34650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:54.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.972+0000 7f200ad9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e33ec23680 0x55e33ec34110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:35030/0 (socket says 172.21.15.92:35030) 2024-09-19T08:56:54.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.972+0000 7f200ad9d640 1 -- 172.21.15.92:0/3376025302 learned_addr learned my addr 172.21.15.92:0/3376025302 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:54.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.972+0000 7f200a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33ec23fa0 0x55e33ec34650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47200/0 (socket says 172.21.15.92:47200) 2024-09-19T08:56:54.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.972+0000 7f200ad9d640 1 -- 172.21.15.92:0/3376025302 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e33ec37150 msgr2=0x55e33ec34b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:54.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.972+0000 7f200ad9d640 1 --2- 172.21.15.92:0/3376025302 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e33ec37150 0x55e33ec34b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.972+0000 7f200ad9d640 1 -- 172.21.15.92:0/3376025302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33ec23fa0 msgr2=0x55e33ec34650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:54.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.972+0000 7f200ad9d640 1 --2- 172.21.15.92:0/3376025302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33ec23fa0 0x55e33ec34650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.972+0000 7f200ad9d640 1 -- 172.21.15.92:0/3376025302 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e33ec432d0 con 0x55e33ec23680 2024-09-19T08:56:54.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.972+0000 7f200ad9d640 1 --2- 172.21.15.92:0/3376025302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e33ec23680 0x55e33ec34110 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc098490 tx=0x7f1ffc09bec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f07631e9fdb9362 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:54.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.972+0000 7f1feeff5640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T08:56:54.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.973+0000 7f1feeff5640 1 -- 172.21.15.92:0/3376025302 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc09c030 con 0x55e33ec23680 2024-09-19T08:56:54.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.973+0000 7f1feeff5640 1 -- 172.21.15.92:0/3376025302 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1ffc09a330 con 0x55e33ec23680 2024-09-19T08:56:54.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.973+0000 7f2013437740 1 -- 172.21.15.92:0/3376025302 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f200403f070 con 0x55e33ec23680 2024-09-19T08:56:54.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.973+0000 7f1feeff5640 1 -- 172.21.15.92:0/3376025302 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1ffc0a03e0 con 0x55e33ec23680 2024-09-19T08:56:54.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.973+0000 7f2013437740 10 client.24839 fetch_fsmap learned FSMap version 19 2024-09-19T08:56:54.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.973+0000 7f2013437740 1 -- 172.21.15.92:0/3376025302 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e33ec45cf0 con 0x55e33ec23680 2024-09-19T08:56:54.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.973+0000 7f1feeff5640 1 -- 172.21.15.92:0/3376025302 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f200403f070 con 0x55e33ec23680 2024-09-19T08:56:54.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.973+0000 7f1feeff5640 1 -- 172.21.15.92:0/3376025302 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1ffc064080 con 0x55e33ec23680 2024-09-19T08:56:54.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.973+0000 7f2013437740 10 client.24839 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:56:54.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.973+0000 7f2013437740 10 client.24839 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T08:56:54.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.974+0000 7f2013437740 20 client.24839 populate_metadata read hostname 'smithi092' 2024-09-19T08:56:54.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.974+0000 7f2013437740 1 --2- 172.21.15.92:0/3376025302 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e33ec471b0 0x55e33ec495c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:54.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.974+0000 7f2013437740 4 client.24839 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:56:54.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.974+0000 7f2013437740 1 -- 172.21.15.92:0/3376025302 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e33eb969d0 con 0x55e33ec471b0 2024-09-19T08:56:54.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.974+0000 7f200a59c640 1 --2- 172.21.15.92:0/3376025302 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e33ec471b0 0x55e33ec495c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:54.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.975+0000 7f1feeff5640 10 client.24839 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:54.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.975+0000 7f200a59c640 1 --2- 172.21.15.92:0/3376025302 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e33ec471b0 0x55e33ec495c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad0296d555f198df server_cookie=fda8cb0832b3e049 in_seq=0 out_seq=0 2024-09-19T08:56:54.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.977+0000 7f1feeff5640 1 -- 172.21.15.92:0/3376025302 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e33eb969d0 con 0x55e33ec471b0 2024-09-19T08:56:54.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.977+0000 7f1feeff5640 10 client.24839 handle_command_reply: tid=0 2024-09-19T08:56:54.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.977+0000 7f2013437740 1 client.24839 shutdown 2024-09-19T08:56:54.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.977+0000 7f2013437740 1 -- 172.21.15.92:0/3376025302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e33ec23680 msgr2=0x55e33ec34110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:54.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.977+0000 7f2013437740 1 --2- 172.21.15.92:0/3376025302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e33ec23680 0x55e33ec34110 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc098490 tx=0x7f1ffc09bec0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.977+0000 7f2013437740 1 -- 172.21.15.92:0/3376025302 shutdown_connections 2024-09-19T08:56:54.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.977+0000 7f2013437740 1 --2- 172.21.15.92:0/3376025302 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e33ec471b0 0x55e33ec495c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.977+0000 7f2013437740 1 --2- 172.21.15.92:0/3376025302 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e33ec37150 0x55e33ec34b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.977+0000 7f2013437740 1 --2- 172.21.15.92:0/3376025302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33ec23fa0 0x55e33ec34650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.977+0000 7f2013437740 1 --2- 172.21.15.92:0/3376025302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e33ec23680 0x55e33ec34110 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.977+0000 7f1feeff5640 0 client.24839 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:54.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.977+0000 7f2013437740 1 -- 172.21.15.92:0/3376025302 >> 172.21.15.92:0/3376025302 conn(0x55e33ec1fcf0 msgr2=0x55e33ec1ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:54.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.977+0000 7f2013437740 1 -- 172.21.15.92:0/3376025302 shutdown_connections 2024-09-19T08:56:54.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.978+0000 7f2013437740 1 -- 172.21.15.92:0/3376025302 wait complete. 2024-09-19T08:56:54.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:54.978+0000 7f2013437740 20 client.24839 trim_cache size 0 max 16384 2024-09-19T08:56:55.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.004+0000 7f2013437740 1 Processor -- start 2024-09-19T08:56:55.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.005+0000 7f2013437740 1 -- start start 2024-09-19T08:56:55.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.005+0000 7f2013437740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33ec23680 0x55e33ec34740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:55.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.005+0000 7f2013437740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e33ec23fa0 0x55e33ec4ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:55.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.005+0000 7f2013437740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e33ec37150 0x55e33ec4f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:55.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.005+0000 7f2013437740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f200c1a9510 con 0x55e33ec23680 2024-09-19T08:56:55.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.006+0000 7f2013437740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f200c1abd90 con 0x55e33ec23fa0 2024-09-19T08:56:55.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.006+0000 7f2013437740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f200c1a9b80 con 0x55e33ec37150 2024-09-19T08:56:55.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.006+0000 7f200b59e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e33ec37150 0x55e33ec4f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:55.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.006+0000 7f200b59e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e33ec37150 0x55e33ec4f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:50538/0 (socket says 172.21.15.92:50538) 2024-09-19T08:56:55.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.006+0000 7f200b59e640 1 -- 172.21.15.92:0/3746576882 learned_addr learned my addr 172.21.15.92:0/3746576882 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:55.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.006+0000 7f200ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33ec23680 0x55e33ec34740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:55.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.006+0000 7f200b59e640 1 -- 172.21.15.92:0/3746576882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e33ec23fa0 msgr2=0x55e33ec4ee90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T08:56:55.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.006+0000 7f200b59e640 1 --2- 172.21.15.92:0/3746576882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e33ec23fa0 0x55e33ec4ee90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:55.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.006+0000 7f200b59e640 1 -- 172.21.15.92:0/3746576882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33ec23680 msgr2=0x55e33ec34740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:55.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.006+0000 7f200b59e640 1 --2- 172.21.15.92:0/3746576882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33ec23680 0x55e33ec34740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:55.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.006+0000 7f200b59e640 1 -- 172.21.15.92:0/3746576882 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e33ec1b260 con 0x55e33ec37150 2024-09-19T08:56:55.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.006+0000 7f200ad9d640 1 --2- 172.21.15.92:0/3746576882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33ec23680 0x55e33ec34740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:55.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.007+0000 7f200b59e640 1 --2- 172.21.15.92:0/3746576882 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e33ec37150 0x55e33ec4f3d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2004009430 tx=0x7f2004047040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98d4f1d0254e0015 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:55.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.008+0000 7f1ff0ff9640 1 -- 172.21.15.92:0/3746576882 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2004055070 con 0x55e33ec37150 2024-09-19T08:56:55.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.008+0000 7f1ff0ff9640 1 -- 172.21.15.92:0/3746576882 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2004036030 con 0x55e33ec37150 2024-09-19T08:56:55.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.008+0000 7f1ff0ff9640 1 -- 172.21.15.92:0/3746576882 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200404b070 con 0x55e33ec37150 2024-09-19T08:56:55.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.010+0000 7f2013437740 1 -- 172.21.15.92:0/3746576882 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e33ec37150 msgr2=0x55e33ec4f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:55.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.010+0000 7f2013437740 1 --2- 172.21.15.92:0/3746576882 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e33ec37150 0x55e33ec4f3d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2004009430 tx=0x7f2004047040 comp rx=0 tx=0).stop 2024-09-19T08:56:55.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.011+0000 7f2013437740 1 -- 172.21.15.92:0/3746576882 shutdown_connections 2024-09-19T08:56:55.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.011+0000 7f2013437740 1 --2- 172.21.15.92:0/3746576882 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e33ec37150 0x55e33ec4f3d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:55.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.011+0000 7f2013437740 1 --2- 172.21.15.92:0/3746576882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e33ec23fa0 0x55e33ec4ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:55.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.011+0000 7f2013437740 1 --2- 172.21.15.92:0/3746576882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33ec23680 0x55e33ec34740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:55.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.011+0000 7f2013437740 1 -- 172.21.15.92:0/3746576882 >> 172.21.15.92:0/3746576882 conn(0x55e33ec1fcf0 msgr2=0x55e33ec1ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:55.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.011+0000 7f2013437740 1 -- 172.21.15.92:0/3746576882 shutdown_connections 2024-09-19T08:56:55.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.012+0000 7f2013437740 1 -- 172.21.15.92:0/3746576882 wait complete. 2024-09-19T08:56:55.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.012+0000 7f2013437740 1 -- start start 2024-09-19T08:56:55.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.012+0000 7f2013437740 1 Processor -- start 2024-09-19T08:56:55.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.013+0000 7f2013437740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e33ec23680 0x55e33ec3f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:55.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.013+0000 7f2013437740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33ec23fa0 0x55e33ec3bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:55.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.013+0000 7f2013437740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e33ec37150 0x55e33ec3c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:55.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.013+0000 7f200ad9d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e33ec23680 0x55e33ec3f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:55.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.014+0000 7f2013437740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f200c1aa250 con 0x55e33ec23fa0 2024-09-19T08:56:55.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.014+0000 7f200ad9d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e33ec23680 0x55e33ec3f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:50546/0 (socket says 172.21.15.92:50546) 2024-09-19T08:56:55.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.014+0000 7f200ad9d640 1 -- 172.21.15.92:0/3737511555 learned_addr learned my addr 172.21.15.92:0/3737511555 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:55.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.014+0000 7f2013437740 1 -- 172.21.15.92:0/3737511555 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f200c1ab6c0 con 0x55e33ec37150 2024-09-19T08:56:55.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.014+0000 7f2013437740 1 -- 172.21.15.92:0/3737511555 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f200c1aa920 con 0x55e33ec23680 2024-09-19T08:56:55.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.014+0000 7f2013437740 10 client.0 _ll_register_callbacks cb 0x7f1ffc097bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:55.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.014+0000 7f200b59e640 1 --2- 172.21.15.92:0/3737511555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e33ec37150 0x55e33ec3c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:55.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.014+0000 7f200b59e640 1 -- 172.21.15.92:0/3737511555 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e33ec23680 msgr2=0x55e33ec3f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:55.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.014+0000 7f200b59e640 1 --2- 172.21.15.92:0/3737511555 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e33ec23680 0x55e33ec3f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:55.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.014+0000 7f200b59e640 1 -- 172.21.15.92:0/3737511555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33ec23fa0 msgr2=0x55e33ec3bb60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T08:56:55.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.014+0000 7f200b59e640 1 --2- 172.21.15.92:0/3737511555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33ec23fa0 0x55e33ec3bb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:55.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.014+0000 7f200b59e640 1 -- 172.21.15.92:0/3737511555 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e33ec3c880 con 0x55e33ec37150 2024-09-19T08:56:55.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.014+0000 7f200ad9d640 1 --2- 172.21.15.92:0/3737511555 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e33ec23680 0x55e33ec3f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:55.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.014+0000 7f200b59e640 1 --2- 172.21.15.92:0/3737511555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e33ec37150 0x55e33ec3c0a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2004031fd0 tx=0x7f2004031ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38ba39b9b15f9b41 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:55.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.015+0000 7f1feeff5640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T08:56:55.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.015+0000 7f1feeff5640 1 -- 172.21.15.92:0/3737511555 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200405e070 con 0x55e33ec37150 2024-09-19T08:56:55.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.015+0000 7f1feeff5640 1 -- 172.21.15.92:0/3737511555 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2004003d80 con 0x55e33ec37150 2024-09-19T08:56:55.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.015+0000 7f2013437740 1 -- 172.21.15.92:0/3737511555 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2004036030 con 0x55e33ec37150 2024-09-19T08:56:55.016 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.015+0000 7f1feeff5640 1 -- 172.21.15.92:0/3737511555 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2004068050 con 0x55e33ec37150 2024-09-19T08:56:55.016 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.016+0000 7f2013437740 10 client.24842 fetch_fsmap learned FSMap version 19 2024-09-19T08:56:55.016 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.016+0000 7f2013437740 1 -- 172.21.15.92:0/3737511555 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e33ecb2e60 con 0x55e33ec37150 2024-09-19T08:56:55.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.016+0000 7f1feeff5640 1 -- 172.21.15.92:0/3737511555 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f200403f040 con 0x55e33ec37150 2024-09-19T08:56:55.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.016+0000 7f1feeff5640 1 -- 172.21.15.92:0/3737511555 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f20040516b0 con 0x55e33ec37150 2024-09-19T08:56:55.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.017+0000 7f2013437740 10 client.24842 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:56:55.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.017+0000 7f2013437740 10 client.24842 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T08:56:55.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.017+0000 7f2013437740 20 client.24842 populate_metadata read hostname 'smithi092' 2024-09-19T08:56:55.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.017+0000 7f2013437740 1 --2- 172.21.15.92:0/3737511555 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e33ecb30e0 0x55e33ecb54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:55.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.017+0000 7f2013437740 4 client.24842 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.2, "await_for": 45.0}] 2024-09-19T08:56:55.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.017+0000 7f2013437740 1 -- 172.21.15.92:0/3737511555 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.2, "await_for": 45.0}) -- 0x7f2004036030 con 0x55e33ecb30e0 2024-09-19T08:56:55.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.018+0000 7f200ad9d640 1 --2- 172.21.15.92:0/3737511555 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e33ecb30e0 0x55e33ecb54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:55.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.020+0000 7f1feeff5640 10 client.24842 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:55.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.020+0000 7f200ad9d640 1 --2- 172.21.15.92:0/3737511555 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e33ecb30e0 0x55e33ecb54d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14c42647e04a3fc4 server_cookie=132e1d04a42e0620 in_seq=0 out_seq=0 2024-09-19T08:56:55.116 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:55.502 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:55 smithi092 ceph-mon[31407]: pgmap v343: 97 pgs: 97 active+clean; 905 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 76 MiB/s wr, 786 op/s 2024-09-19T08:56:55.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:55 smithi190 ceph-mon[35358]: pgmap v343: 97 pgs: 97 active+clean; 905 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 76 MiB/s wr, 786 op/s 2024-09-19T08:56:55.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.635+0000 7fb73add2640 1 -- 172.21.15.92:0/842138178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb734100a70 msgr2=0x7fb734100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:55.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.635+0000 7fb73add2640 1 --2- 172.21.15.92:0/842138178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb734100a70 0x7fb734100ed0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb724009cd0 tx=0x7fb72402a8e0 comp rx=0 tx=0).stop 2024-09-19T08:56:55.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.635+0000 7fb73add2640 1 -- 172.21.15.92:0/842138178 shutdown_connections 2024-09-19T08:56:55.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.635+0000 7fb73add2640 1 --2- 172.21.15.92:0/842138178 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb734101410 0x7fb73410d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:55.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.635+0000 7fb73add2640 1 --2- 172.21.15.92:0/842138178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb734100a70 0x7fb734100ed0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:55.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.635+0000 7fb73add2640 1 --2- 172.21.15.92:0/842138178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb734106a70 0x7fb734106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:55.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.635+0000 7fb73add2640 1 -- 172.21.15.92:0/842138178 >> 172.21.15.92:0/842138178 conn(0x7fb7340fc790 msgr2=0x7fb7340febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:55.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.635+0000 7fb73add2640 1 -- 172.21.15.92:0/842138178 shutdown_connections 2024-09-19T08:56:55.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.635+0000 7fb73add2640 1 -- 172.21.15.92:0/842138178 wait complete. 2024-09-19T08:56:55.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.636+0000 7fb73add2640 1 Processor -- start 2024-09-19T08:56:55.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.636+0000 7fb73add2640 1 -- start start 2024-09-19T08:56:55.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.636+0000 7fb73add2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb734100a70 0x7fb7341992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:55.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.636+0000 7fb73add2640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb734101410 0x7fb734199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:55.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.636+0000 7fb73add2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb734106a70 0x7fb7341a4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:55.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.636+0000 7fb73add2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb734110e70 con 0x7fb734106a70 2024-09-19T08:56:55.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.636+0000 7fb73add2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb734110cf0 con 0x7fb734100a70 2024-09-19T08:56:55.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.636+0000 7fb73add2640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb734110ff0 con 0x7fb734101410 2024-09-19T08:56:55.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.636+0000 7fb73936f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb734106a70 0x7fb7341a4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:55.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.636+0000 7fb73936f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb734106a70 0x7fb7341a4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47228/0 (socket says 172.21.15.92:47228) 2024-09-19T08:56:55.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.636+0000 7fb73936f640 1 -- 172.21.15.92:0/4184460883 learned_addr learned my addr 172.21.15.92:0/4184460883 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:55.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.636+0000 7fb738b6e640 1 --2- 172.21.15.92:0/4184460883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb734100a70 0x7fb7341992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:55.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.636+0000 7fb733fff640 1 --2- 172.21.15.92:0/4184460883 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb734101410 0x7fb734199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:55.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.636+0000 7fb73936f640 1 -- 172.21.15.92:0/4184460883 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb734101410 msgr2=0x7fb734199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:55.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.636+0000 7fb73936f640 1 --2- 172.21.15.92:0/4184460883 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb734101410 0x7fb734199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:55.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.636+0000 7fb73936f640 1 -- 172.21.15.92:0/4184460883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb734100a70 msgr2=0x7fb7341992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:55.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.636+0000 7fb73936f640 1 --2- 172.21.15.92:0/4184460883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb734100a70 0x7fb7341992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:55.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.636+0000 7fb73936f640 1 -- 172.21.15.92:0/4184460883 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7341a4880 con 0x7fb734106a70 2024-09-19T08:56:55.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.636+0000 7fb73936f640 1 --2- 172.21.15.92:0/4184460883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb734106a70 0x7fb7341a4340 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb71c00d750 tx=0x7fb71c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:55.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.637+0000 7fb731ffb640 1 -- 172.21.15.92:0/4184460883 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71c017070 con 0x7fb734106a70 2024-09-19T08:56:55.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.637+0000 7fb731ffb640 1 -- 172.21.15.92:0/4184460883 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb71c005500 con 0x7fb734106a70 2024-09-19T08:56:55.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.637+0000 7fb73add2640 1 -- 172.21.15.92:0/4184460883 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7341a4a50 con 0x7fb734106a70 2024-09-19T08:56:55.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.637+0000 7fb731ffb640 1 -- 172.21.15.92:0/4184460883 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71c004d90 con 0x7fb734106a70 2024-09-19T08:56:55.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.637+0000 7fb73add2640 1 -- 172.21.15.92:0/4184460883 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7341a4f60 con 0x7fb734106a70 2024-09-19T08:56:55.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.638+0000 7fb73add2640 1 -- 172.21.15.92:0/4184460883 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb734100ed0 con 0x7fb734106a70 2024-09-19T08:56:55.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.639+0000 7fb731ffb640 1 -- 172.21.15.92:0/4184460883 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb71c004f30 con 0x7fb734106a70 2024-09-19T08:56:55.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.640+0000 7fb731ffb640 1 --2- 172.21.15.92:0/4184460883 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb7200a32c0 0x7fb7200a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:55.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.640+0000 7fb738b6e640 1 --2- 172.21.15.92:0/4184460883 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb7200a32c0 0x7fb7200a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:55.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.640+0000 7fb731ffb640 1 -- 172.21.15.92:0/4184460883 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb71c0cf180 con 0x7fb734106a70 2024-09-19T08:56:55.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.640+0000 7fb738b6e640 1 --2- 172.21.15.92:0/4184460883 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb7200a32c0 0x7fb7200a5780 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb72c009b50 tx=0x7fb72c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:55.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.644+0000 7fb731ffb640 1 -- 172.21.15.92:0/4184460883 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb71c09b850 con 0x7fb734106a70 2024-09-19T08:56:55.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 10.0 s, 4740.3 tps, lat 17.980 ms stddev 18.379 2024-09-19T08:56:55.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.846+0000 7fb73add2640 1 -- 172.21.15.92:0/4184460883 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb734109000 con 0x7fb734106a70 2024-09-19T08:56:55.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.847+0000 7fb731ffb640 1 -- 172.21.15.92:0/4184460883 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7fb71c09fb50 con 0x7fb734106a70 2024-09-19T08:56:55.846 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:56:55.847 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T08:56:55.847 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T08:56:55.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.849+0000 7fb73add2640 1 -- 172.21.15.92:0/4184460883 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb7200a32c0 msgr2=0x7fb7200a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:55.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.849+0000 7fb73add2640 1 --2- 172.21.15.92:0/4184460883 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb7200a32c0 0x7fb7200a5780 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb72c009b50 tx=0x7fb72c005f90 comp rx=0 tx=0).stop 2024-09-19T08:56:55.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.849+0000 7fb73add2640 1 -- 172.21.15.92:0/4184460883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb734106a70 msgr2=0x7fb7341a4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:55.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.849+0000 7fb73add2640 1 --2- 172.21.15.92:0/4184460883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb734106a70 0x7fb7341a4340 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb71c00d750 tx=0x7fb71c00dc10 comp rx=0 tx=0).stop 2024-09-19T08:56:55.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.849+0000 7fb73add2640 1 -- 172.21.15.92:0/4184460883 shutdown_connections 2024-09-19T08:56:55.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.849+0000 7fb73add2640 1 --2- 172.21.15.92:0/4184460883 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb7200a32c0 0x7fb7200a5780 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:55.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.849+0000 7fb73add2640 1 --2- 172.21.15.92:0/4184460883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb734106a70 0x7fb7341a4340 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:55.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.849+0000 7fb73add2640 1 --2- 172.21.15.92:0/4184460883 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb734101410 0x7fb734199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:55.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.849+0000 7fb73add2640 1 --2- 172.21.15.92:0/4184460883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb734100a70 0x7fb7341992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:55.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.849+0000 7fb73add2640 1 -- 172.21.15.92:0/4184460883 >> 172.21.15.92:0/4184460883 conn(0x7fb7340fc790 msgr2=0x7fb7340fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:55.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.849+0000 7fb73add2640 1 -- 172.21.15.92:0/4184460883 shutdown_connections 2024-09-19T08:56:55.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:55.849+0000 7fb73add2640 1 -- 172.21.15.92:0/4184460883 wait complete. 2024-09-19T08:56:55.850 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:55 smithi167 ceph-mon[35359]: pgmap v343: 97 pgs: 97 active+clean; 905 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 76 MiB/s wr, 786 op/s 2024-09-19T08:56:56.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:56.351+0000 7f1feeff5640 1 -- 172.21.15.92:0/3737511555 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x7f2004036030 con 0x55e33ecb30e0 2024-09-19T08:56:56.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:56.351+0000 7f1feeff5640 10 client.24842 handle_command_reply: tid=0 2024-09-19T08:56:56.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:56.351+0000 7f2013437740 1 client.24842 shutdown 2024-09-19T08:56:56.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:56.351+0000 7f2013437740 1 -- 172.21.15.92:0/3737511555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e33ec37150 msgr2=0x55e33ec3c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:56.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:56.351+0000 7f2013437740 1 --2- 172.21.15.92:0/3737511555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e33ec37150 0x55e33ec3c0a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2004031fd0 tx=0x7f2004031ab0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:56.351+0000 7f2013437740 1 -- 172.21.15.92:0/3737511555 shutdown_connections 2024-09-19T08:56:56.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:56.351+0000 7f2013437740 1 --2- 172.21.15.92:0/3737511555 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e33ecb30e0 0x55e33ecb54d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:56.351+0000 7f2013437740 1 --2- 172.21.15.92:0/3737511555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e33ec37150 0x55e33ec3c0a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:56.351+0000 7f1feeff5640 0 client.24842 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:56.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:56.351+0000 7f2013437740 1 --2- 172.21.15.92:0/3737511555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e33ec23fa0 0x55e33ec3bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:56.351+0000 7f2013437740 1 --2- 172.21.15.92:0/3737511555 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e33ec23680 0x55e33ec3f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:56.351+0000 7f2013437740 1 -- 172.21.15.92:0/3737511555 >> 172.21.15.92:0/3737511555 conn(0x55e33ec1fcf0 msgr2=0x55e33ec1e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:56.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:56.352+0000 7f2013437740 1 -- 172.21.15.92:0/3737511555 shutdown_connections 2024-09-19T08:56:56.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:56.352+0000 7f2013437740 1 -- 172.21.15.92:0/3737511555 wait complete. 2024-09-19T08:56:56.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:56.352+0000 7f2013437740 20 client.24842 trim_cache size 0 max 16384 2024-09-19T08:56:56.356 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T08:56:56.356 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 19, 2024-09-19T08:56:56.356 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24472, 2024-09-19T08:56:56.356 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 2, 2024-09-19T08:56:56.356 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-09-19T08:56:56.356 INFO:teuthology.orchestra.run.smithi092.stdout: "d86dc111": { 2024-09-19T08:56:56.356 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 2, 2024-09-19T08:56:56.356 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-09-19T08:56:56.356 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T08:56:56.356 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-09-19T08:56:56.357 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T08:56:56.357 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T08:56:56.357 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 90.0, 2024-09-19T08:56:56.357 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 131.2, 2024-09-19T08:56:56.357 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-09-19T08:56:56.357 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-09-19T08:56:56.357 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-09-19T08:56:56.357 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T08:56:56.357 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-09-19T08:56:56.357 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T08:56:56.358 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:56:56.358 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:56:56.358 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:56:56.358 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:56:56.358 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:56:56.358 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T08:56:56.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:56.352+0000 7f201105e640 1 -- 172.21.15.92:0/1532607297 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1ff40a3650 msgr2=0x7f1ff40a5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:56.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:56.352+0000 7f201105e640 1 --2- 172.21.15.92:0/1532607297 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1ff40a3650 0x7f1ff40a5b10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2004044000 tx=0x7f2004031dc0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:56.352+0000 7f201105e640 1 -- 172.21.15.92:0/1532607297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f200c102d30 msgr2=0x7f200c100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:56.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:56.352+0000 7f201105e640 1 --2- 172.21.15.92:0/1532607297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f200c102d30 0x7f200c100990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc00e9f0 tx=0x7f1ffc00eeb0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:56.352+0000 7f201105e640 1 -- 172.21.15.92:0/1532607297 shutdown_connections 2024-09-19T08:56:56.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:56.352+0000 7f201105e640 1 --2- 172.21.15.92:0/1532607297 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1ff40a3650 0x7f1ff40a5b10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:56.352+0000 7f201105e640 1 --2- 172.21.15.92:0/1532607297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f200c1082a0 0x7f200c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:56.352+0000 7f201105e640 1 --2- 172.21.15.92:0/1532607297 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f200c1036e0 0x7f200c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:56.352+0000 7f201105e640 1 --2- 172.21.15.92:0/1532607297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f200c102d30 0x7f200c100990 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:56.352+0000 7f201105e640 1 -- 172.21.15.92:0/1532607297 >> 172.21.15.92:0/1532607297 conn(0x7f200c0fc7d0 msgr2=0x7f200c106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:56.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:56.353+0000 7f201105e640 1 -- 172.21.15.92:0/1532607297 shutdown_connections 2024-09-19T08:56:56.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:56.353+0000 7f201105e640 1 -- 172.21.15.92:0/1532607297 wait complete. 2024-09-19T08:56:56.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:56 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/4184460883' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:56:56.495 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:56:56.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:56 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/4184460883' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:56:56.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:56 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/4184460883' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:56:57.023 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd86dc111', quiesce took 6.8 seconds. Will release after: 4.3999999999999995 2024-09-19T08:56:57.104 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:57.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:57 smithi092 ceph-mon[31407]: pgmap v344: 97 pgs: 97 active+clean; 921 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 52 MiB/s wr, 792 op/s 2024-09-19T08:56:57.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.524+0000 7f421749e640 1 -- 172.21.15.92:0/4164119933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4210106f50 msgr2=0x7f421010eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:57.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.524+0000 7f421749e640 1 --2- 172.21.15.92:0/4164119933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4210106f50 0x7f421010eaf0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4208009cd0 tx=0x7f420802a8e0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.524+0000 7f421749e640 1 -- 172.21.15.92:0/4164119933 shutdown_connections 2024-09-19T08:56:57.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.524+0000 7f421749e640 1 --2- 172.21.15.92:0/4164119933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4210106f50 0x7f421010eaf0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.524+0000 7f421749e640 1 --2- 172.21.15.92:0/4164119933 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4210100d00 0x7f4210106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.524+0000 7f421749e640 1 --2- 172.21.15.92:0/4164119933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4210100350 0x7f4210100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.524+0000 7f421749e640 1 -- 172.21.15.92:0/4164119933 >> 172.21.15.92:0/4164119933 conn(0x7f4210077210 msgr2=0x7f42100fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:57.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.524+0000 7f421749e640 1 -- 172.21.15.92:0/4164119933 shutdown_connections 2024-09-19T08:56:57.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.524+0000 7f421749e640 1 -- 172.21.15.92:0/4164119933 wait complete. 2024-09-19T08:56:57.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.525+0000 7f421749e640 1 Processor -- start 2024-09-19T08:56:57.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.525+0000 7f421749e640 1 -- start start 2024-09-19T08:56:57.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.525+0000 7f421749e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4210100350 0x7f4210198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:57.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.525+0000 7f421749e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4210100d00 0x7f4210198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:57.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.525+0000 7f421749e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4210106f50 0x7f421019ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:57.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.525+0000 7f421749e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4210111fa0 con 0x7f4210100d00 2024-09-19T08:56:57.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.525+0000 7f421749e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4210111e20 con 0x7f4210106f50 2024-09-19T08:56:57.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.525+0000 7f421749e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4210112120 con 0x7f4210100350 2024-09-19T08:56:57.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.525+0000 7f4214a39640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4210100d00 0x7f4210198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:57.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.525+0000 7f4214a39640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4210100d00 0x7f4210198ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47240/0 (socket says 172.21.15.92:47240) 2024-09-19T08:56:57.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.525+0000 7f4214a39640 1 -- 172.21.15.92:0/1263542016 learned_addr learned my addr 172.21.15.92:0/1263542016 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:57.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.525+0000 7f421523a640 1 --2- 172.21.15.92:0/1263542016 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4210100350 0x7f4210198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:57.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.525+0000 7f4214a39640 1 -- 172.21.15.92:0/1263542016 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4210100350 msgr2=0x7f4210198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:57.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.525+0000 7f4215a3b640 1 --2- 172.21.15.92:0/1263542016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4210106f50 0x7f421019ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:57.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.525+0000 7f4214a39640 1 --2- 172.21.15.92:0/1263542016 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4210100350 0x7f4210198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.525+0000 7f4214a39640 1 -- 172.21.15.92:0/1263542016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4210106f50 msgr2=0x7f421019ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:57.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.525+0000 7f4214a39640 1 --2- 172.21.15.92:0/1263542016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4210106f50 0x7f421019ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.525+0000 7f4214a39640 1 -- 172.21.15.92:0/1263542016 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f421019d530 con 0x7f4210100d00 2024-09-19T08:56:57.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.525+0000 7f421523a640 1 --2- 172.21.15.92:0/1263542016 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4210100350 0x7f4210198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:57.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.525+0000 7f4214a39640 1 --2- 172.21.15.92:0/1263542016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4210100d00 0x7f4210198ac0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f420000d740 tx=0x7f420000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:57.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.525+0000 7f420e7fc640 1 -- 172.21.15.92:0/1263542016 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4200017070 con 0x7f4210100d00 2024-09-19T08:56:57.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.526+0000 7f421749e640 1 -- 172.21.15.92:0/1263542016 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f421019d820 con 0x7f4210100d00 2024-09-19T08:56:57.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.526+0000 7f420e7fc640 1 -- 172.21.15.92:0/1263542016 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f420000de50 con 0x7f4210100d00 2024-09-19T08:56:57.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.526+0000 7f420e7fc640 1 -- 172.21.15.92:0/1263542016 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4200004e00 con 0x7f4210100d00 2024-09-19T08:56:57.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.526+0000 7f421749e640 1 -- 172.21.15.92:0/1263542016 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42101a5100 con 0x7f4210100d00 2024-09-19T08:56:57.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.528+0000 7f420e7fc640 1 -- 172.21.15.92:0/1263542016 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4200004fa0 con 0x7f4210100d00 2024-09-19T08:56:57.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.528+0000 7f4219877740 1 Processor -- start 2024-09-19T08:56:57.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.528+0000 7f4219877740 1 -- start start 2024-09-19T08:56:57.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.528+0000 7f4219877740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557fcd999b40 0x557fcd998090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:57.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.528+0000 7f4219877740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fcd9985d0 0x557fcd998a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:57.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.528+0000 7f4219877740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557fcd9a3370 0x557fcd9a5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:57.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.528+0000 7f4219877740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557fcd8fe2f0 con 0x557fcd999b40 2024-09-19T08:56:57.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.528+0000 7f4219877740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x557fcd8a5cf0 con 0x557fcd9a3370 2024-09-19T08:56:57.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.528+0000 7f4219877740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x557fcd8fa2b0 con 0x557fcd9985d0 2024-09-19T08:56:57.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.528+0000 7f420e7fc640 1 --2- 172.21.15.92:0/1263542016 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f41f80a3240 0x7f41f80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:57.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.529+0000 7f4215a3b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557fcd999b40 0x557fcd998090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:57.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.529+0000 7f4215a3b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557fcd999b40 0x557fcd998090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47242/0 (socket says 172.21.15.92:47242) 2024-09-19T08:56:57.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.529+0000 7f4215a3b640 1 -- 172.21.15.92:0/2930532447 learned_addr learned my addr 172.21.15.92:0/2930532447 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:57.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.529+0000 7f4214a39640 1 --2- 172.21.15.92:0/2930532447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557fcd9a3370 0x557fcd9a5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:57.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.529+0000 7f4215a3b640 1 --2- 172.21.15.92:0/1263542016 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f41f80a3240 0x7f41f80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:57.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.529+0000 7f421523a640 1 --2- 172.21.15.92:0/2930532447 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fcd9985d0 0x557fcd998a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:57.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.529+0000 7f420e7fc640 1 -- 172.21.15.92:0/1263542016 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f42000cf300 con 0x7f4210100d00 2024-09-19T08:56:57.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.529+0000 7f4215a3b640 1 -- 172.21.15.92:0/2930532447 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fcd9985d0 msgr2=0x557fcd998a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:57.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.529+0000 7f4215a3b640 1 --2- 172.21.15.92:0/2930532447 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fcd9985d0 0x557fcd998a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.529+0000 7f4215a3b640 1 -- 172.21.15.92:0/2930532447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557fcd9a3370 msgr2=0x557fcd9a5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:57.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.529+0000 7f4215a3b640 1 --2- 172.21.15.92:0/2930532447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557fcd9a3370 0x557fcd9a5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.529+0000 7f4215a3b640 1 -- 172.21.15.92:0/2930532447 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fcd88a3a0 con 0x557fcd999b40 2024-09-19T08:56:57.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.529+0000 7f4215a3b640 1 --2- 172.21.15.92:0/2930532447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557fcd999b40 0x557fcd998090 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4208033040 tx=0x7f4208031c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad15421ee8fdb8b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:57.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.529+0000 7f4215a3b640 1 --2- 172.21.15.92:0/1263542016 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f41f80a3240 0x7f41f80a5700 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4208009430 tx=0x7f4208047000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:57.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.529+0000 7f41f77fe640 1 -- 172.21.15.92:0/2930532447 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4208004440 con 0x557fcd999b40 2024-09-19T08:56:57.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.529+0000 7f41f77fe640 1 -- 172.21.15.92:0/2930532447 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4208036040 con 0x557fcd999b40 2024-09-19T08:56:57.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.529+0000 7f41f77fe640 1 -- 172.21.15.92:0/2930532447 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4208030e80 con 0x557fcd999b40 2024-09-19T08:56:57.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.530+0000 7f4219877740 1 -- 172.21.15.92:0/2930532447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557fcd999b40 msgr2=0x557fcd998090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:57.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.530+0000 7f4219877740 1 --2- 172.21.15.92:0/2930532447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557fcd999b40 0x557fcd998090 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4208033040 tx=0x7f4208031c90 comp rx=0 tx=0).stop 2024-09-19T08:56:57.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.530+0000 7f4219877740 1 -- 172.21.15.92:0/2930532447 shutdown_connections 2024-09-19T08:56:57.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.530+0000 7f4219877740 1 --2- 172.21.15.92:0/2930532447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557fcd9a3370 0x557fcd9a5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.530+0000 7f4219877740 1 --2- 172.21.15.92:0/2930532447 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fcd9985d0 0x557fcd998a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.530+0000 7f4219877740 1 --2- 172.21.15.92:0/2930532447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557fcd999b40 0x557fcd998090 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.530+0000 7f4219877740 1 -- 172.21.15.92:0/2930532447 >> 172.21.15.92:0/2930532447 conn(0x557fcd961310 msgr2=0x557fcd994c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:57.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.530+0000 7f4219877740 1 -- 172.21.15.92:0/2930532447 shutdown_connections 2024-09-19T08:56:57.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.530+0000 7f4219877740 1 -- 172.21.15.92:0/2930532447 wait complete. 2024-09-19T08:56:57.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.530+0000 7f4219877740 1 -- start start 2024-09-19T08:56:57.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.531+0000 7f4219877740 1 Processor -- start 2024-09-19T08:56:57.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.531+0000 7f4219877740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fcd9985d0 0x557fcd9a2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:57.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.531+0000 7f4219877740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557fcd999b40 0x557fcd9a0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:57.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.531+0000 7f4219877740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557fcd9a3370 0x557fcd9a07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:57.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.531+0000 7f4219877740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557fcd9a6010 con 0x557fcd9a3370 2024-09-19T08:56:57.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.531+0000 7f4219877740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x557fcd8b9060 con 0x557fcd999b40 2024-09-19T08:56:57.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.531+0000 7f4219877740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x557fcd9a6190 con 0x557fcd9985d0 2024-09-19T08:56:57.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.531+0000 7f4219877740 10 client.0 _ll_register_callbacks cb 0x557fcd60c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:57.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.531+0000 7f4215a3b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557fcd9a3370 0x557fcd9a07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:57.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.531+0000 7f4215a3b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557fcd9a3370 0x557fcd9a07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47244/0 (socket says 172.21.15.92:47244) 2024-09-19T08:56:57.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.531+0000 7f4215a3b640 1 -- 172.21.15.92:0/2025948226 learned_addr learned my addr 172.21.15.92:0/2025948226 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:57.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.531+0000 7f4214a39640 1 --2- 172.21.15.92:0/2025948226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557fcd999b40 0x557fcd9a0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:57.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.531+0000 7f421523a640 1 --2- 172.21.15.92:0/2025948226 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fcd9985d0 0x557fcd9a2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:57.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.531+0000 7f4215a3b640 1 -- 172.21.15.92:0/2025948226 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fcd9985d0 msgr2=0x557fcd9a2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:57.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.531+0000 7f4215a3b640 1 --2- 172.21.15.92:0/2025948226 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fcd9985d0 0x557fcd9a2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.531+0000 7f4215a3b640 1 -- 172.21.15.92:0/2025948226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557fcd999b40 msgr2=0x557fcd9a0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:57.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.531+0000 7f4215a3b640 1 --2- 172.21.15.92:0/2025948226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557fcd999b40 0x557fcd9a0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.531+0000 7f4215a3b640 1 -- 172.21.15.92:0/2025948226 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fcd66f3c0 con 0x557fcd9a3370 2024-09-19T08:56:57.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.531+0000 7f4214a39640 1 --2- 172.21.15.92:0/2025948226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557fcd999b40 0x557fcd9a0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:57.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.532+0000 7f4215a3b640 1 --2- 172.21.15.92:0/2025948226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557fcd9a3370 0x557fcd9a07e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4208005ba0 tx=0x7f4208005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a5649f0c4fe2b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:57.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.532+0000 7f41f4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:56:57.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.532+0000 7f41f4ff9640 1 -- 172.21.15.92:0/2025948226 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4208058030 con 0x557fcd9a3370 2024-09-19T08:56:57.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.532+0000 7f41f4ff9640 1 -- 172.21.15.92:0/2025948226 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f420802e040 con 0x557fcd9a3370 2024-09-19T08:56:57.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.532+0000 7f4219877740 1 -- 172.21.15.92:0/2025948226 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4208036040 con 0x557fcd9a3370 2024-09-19T08:56:57.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.532+0000 7f41f4ff9640 1 -- 172.21.15.92:0/2025948226 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4208031640 con 0x557fcd9a3370 2024-09-19T08:56:57.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.532+0000 7f4219877740 10 client.15336 fetch_fsmap learned FSMap version 19 2024-09-19T08:56:57.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.532+0000 7f4219877740 1 -- 172.21.15.92:0/2025948226 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x557fcd9b1af0 con 0x557fcd9a3370 2024-09-19T08:56:57.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.532+0000 7f41f4ff9640 1 -- 172.21.15.92:0/2025948226 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4208036040 con 0x557fcd9a3370 2024-09-19T08:56:57.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.532+0000 7f41f4ff9640 1 -- 172.21.15.92:0/2025948226 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f4208048070 con 0x557fcd9a3370 2024-09-19T08:56:57.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.532+0000 7f4219877740 10 client.15336 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:56:57.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.532+0000 7f4219877740 10 client.15336 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:56:57.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.532+0000 7f4219877740 20 client.15336 populate_metadata read hostname 'smithi092' 2024-09-19T08:56:57.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.532+0000 7f4219877740 1 --2- 172.21.15.92:0/2025948226 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557fcd9b2e40 0x557fcd9b5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:57.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.532+0000 7f4219877740 4 client.15336 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:56:57.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.532+0000 7f4219877740 1 -- 172.21.15.92:0/2025948226 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557fcd90b860 con 0x557fcd9b2e40 2024-09-19T08:56:57.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.533+0000 7f421523a640 1 --2- 172.21.15.92:0/2025948226 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557fcd9b2e40 0x557fcd9b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:57.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.533+0000 7f41f4ff9640 10 client.15336 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:57.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.533+0000 7f421523a640 1 --2- 172.21.15.92:0/2025948226 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557fcd9b2e40 0x557fcd9b5230 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc6a1543ff8f643c server_cookie=6aa710d1d1e7c6b3 in_seq=0 out_seq=0 2024-09-19T08:56:57.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.534+0000 7f41f4ff9640 1 -- 172.21.15.92:0/2025948226 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557fcd90b860 con 0x557fcd9b2e40 2024-09-19T08:56:57.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.534+0000 7f41f4ff9640 10 client.15336 handle_command_reply: tid=0 2024-09-19T08:56:57.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.534+0000 7f4219877740 1 client.15336 shutdown 2024-09-19T08:56:57.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.534+0000 7f4219877740 1 -- 172.21.15.92:0/2025948226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557fcd9a3370 msgr2=0x557fcd9a07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:57.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.534+0000 7f4219877740 1 --2- 172.21.15.92:0/2025948226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557fcd9a3370 0x557fcd9a07e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4208005ba0 tx=0x7f4208005dc0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.534+0000 7f4219877740 1 -- 172.21.15.92:0/2025948226 shutdown_connections 2024-09-19T08:56:57.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.534+0000 7f4219877740 1 --2- 172.21.15.92:0/2025948226 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557fcd9b2e40 0x557fcd9b5230 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.534+0000 7f4219877740 1 --2- 172.21.15.92:0/2025948226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557fcd9a3370 0x557fcd9a07e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.534+0000 7f4219877740 1 --2- 172.21.15.92:0/2025948226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557fcd999b40 0x557fcd9a0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.534+0000 7f4219877740 1 --2- 172.21.15.92:0/2025948226 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fcd9985d0 0x557fcd9a2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.534+0000 7f41f4ff9640 0 client.15336 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:57.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.534+0000 7f4219877740 1 -- 172.21.15.92:0/2025948226 >> 172.21.15.92:0/2025948226 conn(0x557fcd961310 msgr2=0x557fcd99a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:57.554 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.534+0000 7f4219877740 1 -- 172.21.15.92:0/2025948226 shutdown_connections 2024-09-19T08:56:57.554 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.534+0000 7f4219877740 1 -- 172.21.15.92:0/2025948226 wait complete. 2024-09-19T08:56:57.554 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.534+0000 7f4219877740 20 client.15336 trim_cache size 0 max 16384 2024-09-19T08:56:57.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.547+0000 7f4219877740 1 Processor -- start 2024-09-19T08:56:57.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.547+0000 7f4219877740 1 -- start start 2024-09-19T08:56:57.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.547+0000 7f4219877740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fcd9985d0 0x557fcd994d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:57.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.547+0000 7f4219877740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557fcd999b40 0x557fcd99b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:57.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.547+0000 7f4219877740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557fcd9a3370 0x557fcd99b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:57.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.547+0000 7f4219877740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f42101ab540 con 0x557fcd999b40 2024-09-19T08:56:57.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.547+0000 7f4219877740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f42101adde0 con 0x557fcd9a3370 2024-09-19T08:56:57.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.547+0000 7f4219877740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f42101abbd0 con 0x557fcd9985d0 2024-09-19T08:56:57.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.547+0000 7f4214a39640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557fcd999b40 0x557fcd99b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:57.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.547+0000 7f4214a39640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557fcd999b40 0x557fcd99b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47260/0 (socket says 172.21.15.92:47260) 2024-09-19T08:56:57.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.547+0000 7f4214a39640 1 -- 172.21.15.92:0/3700342303 learned_addr learned my addr 172.21.15.92:0/3700342303 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:57.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.548+0000 7f4215a3b640 1 --2- 172.21.15.92:0/3700342303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557fcd9a3370 0x557fcd99b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:57.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.548+0000 7f421523a640 1 --2- 172.21.15.92:0/3700342303 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fcd9985d0 0x557fcd994d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:57.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.548+0000 7f4214a39640 1 -- 172.21.15.92:0/3700342303 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fcd9985d0 msgr2=0x557fcd994d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:57.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.548+0000 7f4214a39640 1 --2- 172.21.15.92:0/3700342303 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fcd9985d0 0x557fcd994d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.548+0000 7f4214a39640 1 -- 172.21.15.92:0/3700342303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557fcd9a3370 msgr2=0x557fcd99b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:57.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.548+0000 7f4214a39640 1 --2- 172.21.15.92:0/3700342303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557fcd9a3370 0x557fcd99b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.548+0000 7f4214a39640 1 -- 172.21.15.92:0/3700342303 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fcd9a5ad0 con 0x557fcd999b40 2024-09-19T08:56:57.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.548+0000 7f421523a640 1 --2- 172.21.15.92:0/3700342303 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fcd9985d0 0x557fcd994d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:57.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.548+0000 7f4214a39640 1 --2- 172.21.15.92:0/3700342303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557fcd999b40 0x557fcd99b120 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4200097d30 tx=0x7f420001e310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a8db76c3211f6b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:57.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.548+0000 7f41f6ffd640 1 -- 172.21.15.92:0/3700342303 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4200020040 con 0x557fcd999b40 2024-09-19T08:56:57.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.548+0000 7f41f6ffd640 1 -- 172.21.15.92:0/3700342303 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42000a4590 con 0x557fcd999b40 2024-09-19T08:56:57.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.548+0000 7f41f6ffd640 1 -- 172.21.15.92:0/3700342303 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4200009de0 con 0x557fcd999b40 2024-09-19T08:56:57.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.549+0000 7f4219877740 1 -- 172.21.15.92:0/3700342303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557fcd999b40 msgr2=0x557fcd99b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:57.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.549+0000 7f4219877740 1 --2- 172.21.15.92:0/3700342303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557fcd999b40 0x557fcd99b120 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4200097d30 tx=0x7f420001e310 comp rx=0 tx=0).stop 2024-09-19T08:56:57.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.549+0000 7f4219877740 1 -- 172.21.15.92:0/3700342303 shutdown_connections 2024-09-19T08:56:57.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.549+0000 7f4219877740 1 --2- 172.21.15.92:0/3700342303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557fcd9a3370 0x557fcd99b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.549+0000 7f4219877740 1 --2- 172.21.15.92:0/3700342303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557fcd999b40 0x557fcd99b120 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.549+0000 7f4219877740 1 --2- 172.21.15.92:0/3700342303 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fcd9985d0 0x557fcd994d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.549+0000 7f4219877740 1 -- 172.21.15.92:0/3700342303 >> 172.21.15.92:0/3700342303 conn(0x557fcd961310 msgr2=0x557fcd99f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:57.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.549+0000 7f4219877740 1 -- 172.21.15.92:0/3700342303 shutdown_connections 2024-09-19T08:56:57.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.549+0000 7f4219877740 1 -- 172.21.15.92:0/3700342303 wait complete. 2024-09-19T08:56:57.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.549+0000 7f4219877740 1 -- start start 2024-09-19T08:56:57.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.549+0000 7f4219877740 1 Processor -- start 2024-09-19T08:56:57.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.549+0000 7f4219877740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557fcd9985d0 0x557fcd9ab600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:57.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.549+0000 7f4219877740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fcd999b40 0x557fcd9abb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:57.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.549+0000 7f4219877740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557fcd9a3370 0x557fcd99c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:57.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.550+0000 7f4219877740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f42101ac2a0 con 0x557fcd9a3370 2024-09-19T08:56:57.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.550+0000 7f4219877740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f42101ad710 con 0x557fcd9985d0 2024-09-19T08:56:57.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.550+0000 7f4219877740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f42101ac970 con 0x557fcd999b40 2024-09-19T08:56:57.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.550+0000 7f4219877740 10 client.0 _ll_register_callbacks cb 0x7f4200005d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:57.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.550+0000 7f4215a3b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557fcd9a3370 0x557fcd99c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:57.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.550+0000 7f4215a3b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557fcd9a3370 0x557fcd99c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47276/0 (socket says 172.21.15.92:47276) 2024-09-19T08:56:57.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.550+0000 7f4215a3b640 1 -- 172.21.15.92:0/3544190494 learned_addr learned my addr 172.21.15.92:0/3544190494 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:57.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.550+0000 7f4214a39640 1 --2- 172.21.15.92:0/3544190494 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fcd999b40 0x557fcd9abb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:57.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.550+0000 7f421523a640 1 --2- 172.21.15.92:0/3544190494 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557fcd9985d0 0x557fcd9ab600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:57.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.550+0000 7f4215a3b640 1 -- 172.21.15.92:0/3544190494 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fcd999b40 msgr2=0x557fcd9abb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:57.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.550+0000 7f4215a3b640 1 --2- 172.21.15.92:0/3544190494 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fcd999b40 0x557fcd9abb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.550+0000 7f4215a3b640 1 -- 172.21.15.92:0/3544190494 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557fcd9985d0 msgr2=0x557fcd9ab600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:57.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.550+0000 7f4215a3b640 1 --2- 172.21.15.92:0/3544190494 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557fcd9985d0 0x557fcd9ab600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.550+0000 7f4215a3b640 1 -- 172.21.15.92:0/3544190494 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fcd99d0c0 con 0x557fcd9a3370 2024-09-19T08:56:57.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.550+0000 7f4215a3b640 1 --2- 172.21.15.92:0/3544190494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557fcd9a3370 0x557fcd99c8c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4208005b70 tx=0x7f42080098c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b84ddc951e74b29 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:57.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.550+0000 7f41f4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:56:57.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.550+0000 7f41f4ff9640 1 -- 172.21.15.92:0/3544190494 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4208058070 con 0x557fcd9a3370 2024-09-19T08:56:57.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.550+0000 7f4219877740 1 -- 172.21.15.92:0/3544190494 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42000a4590 con 0x557fcd9a3370 2024-09-19T08:56:57.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.550+0000 7f41f4ff9640 1 -- 172.21.15.92:0/3544190494 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4208031c10 con 0x557fcd9a3370 2024-09-19T08:56:57.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.550+0000 7f41f4ff9640 1 -- 172.21.15.92:0/3544190494 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4208030e90 con 0x557fcd9a3370 2024-09-19T08:56:57.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.550+0000 7f4219877740 10 client.15342 fetch_fsmap learned FSMap version 19 2024-09-19T08:56:57.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.550+0000 7f4219877740 1 -- 172.21.15.92:0/3544190494 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x557fcda1d280 con 0x557fcd9a3370 2024-09-19T08:56:57.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.551+0000 7f41f4ff9640 1 -- 172.21.15.92:0/3544190494 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42000a4590 con 0x557fcd9a3370 2024-09-19T08:56:57.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.551+0000 7f41f4ff9640 1 -- 172.21.15.92:0/3544190494 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f4208048040 con 0x557fcd9a3370 2024-09-19T08:56:57.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.551+0000 7f4219877740 10 client.15342 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:56:57.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.551+0000 7f4219877740 10 client.15342 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:56:57.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.551+0000 7f4219877740 20 client.15342 populate_metadata read hostname 'smithi092' 2024-09-19T08:56:57.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.551+0000 7f4219877740 1 --2- 172.21.15.92:0/3544190494 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557fcda1d940 0x557fcda1fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:57.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.551+0000 7f4219877740 4 client.15342 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:56:57.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.551+0000 7f4219877740 1 -- 172.21.15.92:0/3544190494 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557fcd905d70 con 0x557fcda1d940 2024-09-19T08:56:57.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.551+0000 7f421523a640 1 --2- 172.21.15.92:0/3544190494 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557fcda1d940 0x557fcda1fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:57.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.551+0000 7f421523a640 1 --2- 172.21.15.92:0/3544190494 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557fcda1d940 0x557fcda1fd30 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4f9cd5f2450c7e1 server_cookie=bf0e0b2d69ca54d1 in_seq=0 out_seq=0 2024-09-19T08:56:57.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.551+0000 7f41f4ff9640 10 client.15342 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:57.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.552+0000 7f41f4ff9640 1 -- 172.21.15.92:0/3544190494 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557fcd905d70 con 0x557fcda1d940 2024-09-19T08:56:57.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.552+0000 7f41f4ff9640 10 client.15342 handle_command_reply: tid=0 2024-09-19T08:56:57.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.552+0000 7f4219877740 1 client.15342 shutdown 2024-09-19T08:56:57.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.552+0000 7f4219877740 1 -- 172.21.15.92:0/3544190494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557fcd9a3370 msgr2=0x557fcd99c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:57.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.552+0000 7f4219877740 1 --2- 172.21.15.92:0/3544190494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557fcd9a3370 0x557fcd99c8c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4208005b70 tx=0x7f42080098c0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.552+0000 7f4219877740 1 -- 172.21.15.92:0/3544190494 shutdown_connections 2024-09-19T08:56:57.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.552+0000 7f4219877740 1 --2- 172.21.15.92:0/3544190494 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557fcda1d940 0x557fcda1fd30 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.552+0000 7f4219877740 1 --2- 172.21.15.92:0/3544190494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557fcd9a3370 0x557fcd99c8c0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.552+0000 7f4219877740 1 --2- 172.21.15.92:0/3544190494 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557fcd999b40 0x557fcd9abb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.552+0000 7f4219877740 1 --2- 172.21.15.92:0/3544190494 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557fcd9985d0 0x557fcd9ab600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.552+0000 7f41f4ff9640 0 client.15342 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:57.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.552+0000 7f4219877740 1 -- 172.21.15.92:0/3544190494 >> 172.21.15.92:0/3544190494 conn(0x557fcd961310 msgr2=0x557fcd9a18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:57.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.552+0000 7f4219877740 1 -- 172.21.15.92:0/3544190494 shutdown_connections 2024-09-19T08:56:57.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.552+0000 7f4219877740 1 -- 172.21.15.92:0/3544190494 wait complete. 2024-09-19T08:56:57.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.552+0000 7f4219877740 20 client.15342 trim_cache size 0 max 16384 2024-09-19T08:56:57.568 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-19T08:56:57.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.552+0000 7f421749e640 1 -- 172.21.15.92:0/1263542016 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f41f80a3240 msgr2=0x7f41f80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:57.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.552+0000 7f421749e640 1 --2- 172.21.15.92:0/1263542016 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f41f80a3240 0x7f41f80a5700 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4208009430 tx=0x7f4208047000 comp rx=0 tx=0).stop 2024-09-19T08:56:57.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.552+0000 7f421749e640 1 -- 172.21.15.92:0/1263542016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4210100d00 msgr2=0x7f4210198ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:57.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.552+0000 7f421749e640 1 --2- 172.21.15.92:0/1263542016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4210100d00 0x7f4210198ac0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f420000d740 tx=0x7f420000dc00 comp rx=0 tx=0).stop 2024-09-19T08:56:57.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.553+0000 7f421749e640 1 -- 172.21.15.92:0/1263542016 shutdown_connections 2024-09-19T08:56:57.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.553+0000 7f421749e640 1 --2- 172.21.15.92:0/1263542016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4210106f50 0x7f421019ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.553+0000 7f421749e640 1 --2- 172.21.15.92:0/1263542016 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f41f80a3240 0x7f41f80a5700 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.553+0000 7f421749e640 1 --2- 172.21.15.92:0/1263542016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4210100d00 0x7f4210198ac0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.553+0000 7f421749e640 1 --2- 172.21.15.92:0/1263542016 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4210100350 0x7f4210198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.553+0000 7f421749e640 1 -- 172.21.15.92:0/1263542016 >> 172.21.15.92:0/1263542016 conn(0x7f4210077210 msgr2=0x7f42100fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:57.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.553+0000 7f421749e640 1 -- 172.21.15.92:0/1263542016 shutdown_connections 2024-09-19T08:56:57.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:57.553+0000 7f421749e640 1 -- 172.21.15.92:0/1263542016 wait complete. 2024-09-19T08:56:57.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.753+0000 7fa754f4b640 1 -- 172.21.15.92:0/2954510018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa750100d10 msgr2=0x7fa750101190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:57.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.753+0000 7fa754f4b640 1 --2- 172.21.15.92:0/2954510018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa750100d10 0x7fa750101190 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa744009900 tx=0x7fa74402a410 comp rx=0 tx=0).stop 2024-09-19T08:56:57.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.753+0000 7fa754f4b640 1 -- 172.21.15.92:0/2954510018 shutdown_connections 2024-09-19T08:56:57.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.753+0000 7fa754f4b640 1 --2- 172.21.15.92:0/2954510018 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa7501016d0 0x7fa750108f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.753+0000 7fa754f4b640 1 --2- 172.21.15.92:0/2954510018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa750100d10 0x7fa750101190 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.753+0000 7fa754f4b640 1 --2- 172.21.15.92:0/2954510018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa750101fe0 0x7fa7501023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.753+0000 7fa754f4b640 1 -- 172.21.15.92:0/2954510018 >> 172.21.15.92:0/2954510018 conn(0x7fa7500fb970 msgr2=0x7fa7500fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:57.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.753+0000 7fa754f4b640 1 -- 172.21.15.92:0/2954510018 shutdown_connections 2024-09-19T08:56:57.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.753+0000 7fa754f4b640 1 -- 172.21.15.92:0/2954510018 wait complete. 2024-09-19T08:56:57.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.754+0000 7fa754f4b640 1 Processor -- start 2024-09-19T08:56:57.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.754+0000 7fa754f4b640 1 -- start start 2024-09-19T08:56:57.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.754+0000 7fa754f4b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa750100d10 0x7fa750197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:57.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.754+0000 7fa754f4b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7501016d0 0x7fa750198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:57.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.754+0000 7fa754f4b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa750101fe0 0x7fa75019f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:57.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.754+0000 7fa754f4b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa75010d830 con 0x7fa7501016d0 2024-09-19T08:56:57.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.754+0000 7fa754f4b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa75010d6b0 con 0x7fa750100d10 2024-09-19T08:56:57.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.754+0000 7fa754f4b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa75010d9b0 con 0x7fa750101fe0 2024-09-19T08:56:57.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.754+0000 7fa74dd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7501016d0 0x7fa750198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:57.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.754+0000 7fa74dd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7501016d0 0x7fa750198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47298/0 (socket says 172.21.15.92:47298) 2024-09-19T08:56:57.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.754+0000 7fa74dd9b640 1 -- 172.21.15.92:0/1600441368 learned_addr learned my addr 172.21.15.92:0/1600441368 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:57.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.754+0000 7fa74ed9d640 1 --2- 172.21.15.92:0/1600441368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa750101fe0 0x7fa75019f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:57.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.754+0000 7fa74e59c640 1 --2- 172.21.15.92:0/1600441368 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa750100d10 0x7fa750197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:57.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.754+0000 7fa74dd9b640 1 -- 172.21.15.92:0/1600441368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa750101fe0 msgr2=0x7fa75019f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:57.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.754+0000 7fa74dd9b640 1 --2- 172.21.15.92:0/1600441368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa750101fe0 0x7fa75019f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.754+0000 7fa74dd9b640 1 -- 172.21.15.92:0/1600441368 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa750100d10 msgr2=0x7fa750197dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:57.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.754+0000 7fa74dd9b640 1 --2- 172.21.15.92:0/1600441368 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa750100d10 0x7fa750197dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.755+0000 7fa74dd9b640 1 -- 172.21.15.92:0/1600441368 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa75019f9e0 con 0x7fa7501016d0 2024-09-19T08:56:57.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.755+0000 7fa74ed9d640 1 --2- 172.21.15.92:0/1600441368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa750101fe0 0x7fa75019f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:57.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.755+0000 7fa74e59c640 1 --2- 172.21.15.92:0/1600441368 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa750100d10 0x7fa750197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:56:57.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.755+0000 7fa74dd9b640 1 --2- 172.21.15.92:0/1600441368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7501016d0 0x7fa750198300 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa744009230 tx=0x7fa7440042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:57.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.755+0000 7fa73f7fe640 1 -- 172.21.15.92:0/1600441368 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa74403f030 con 0x7fa7501016d0 2024-09-19T08:56:57.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.755+0000 7fa754f4b640 1 -- 172.21.15.92:0/1600441368 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa75019fc70 con 0x7fa7501016d0 2024-09-19T08:56:57.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.755+0000 7fa73f7fe640 1 -- 172.21.15.92:0/1600441368 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa744003ce0 con 0x7fa7501016d0 2024-09-19T08:56:57.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.755+0000 7fa73f7fe640 1 -- 172.21.15.92:0/1600441368 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa744035070 con 0x7fa7501016d0 2024-09-19T08:56:57.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.755+0000 7fa754f4b640 1 -- 172.21.15.92:0/1600441368 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7501a01b0 con 0x7fa7501016d0 2024-09-19T08:56:57.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.758+0000 7fa757dc0740 1 Processor -- start 2024-09-19T08:56:57.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.758+0000 7fa73f7fe640 1 -- 172.21.15.92:0/1600441368 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa744042030 con 0x7fa7501016d0 2024-09-19T08:56:57.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.758+0000 7fa757dc0740 1 -- start start 2024-09-19T08:56:57.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.758+0000 7fa757dc0740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1a50ac9a0 0x55a1a50acda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:57.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.758+0000 7fa757dc0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1a50ad2e0 0x55a1a50b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.758+0000 7fa757dc0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1a50b2370 0x55a1a50b4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.758+0000 7fa757dc0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a1a50102f0 con 0x55a1a50b2370 2024-09-19T08:56:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.758+0000 7fa757dc0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a1a4fb8270 con 0x55a1a50ad2e0 2024-09-19T08:56:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.758+0000 7fa757dc0740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55a1a500c2b0 con 0x55a1a50ac9a0 2024-09-19T08:56:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.758+0000 7fa74dd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1a50b2370 0x55a1a50b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.758+0000 7fa74dd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1a50b2370 0x55a1a50b4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47302/0 (socket says 172.21.15.92:47302) 2024-09-19T08:56:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.758+0000 7fa74dd9b640 1 -- 172.21.15.92:0/1804370244 learned_addr learned my addr 172.21.15.92:0/1804370244 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.758+0000 7fa74ed9d640 1 --2- 172.21.15.92:0/1804370244 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1a50ac9a0 0x55a1a50acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.759+0000 7fa74e59c640 1 --2- 172.21.15.92:0/1804370244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1a50ad2e0 0x55a1a50b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.759+0000 7fa73f7fe640 1 --2- 172.21.15.92:0/1600441368 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa7380a32f0 0x7fa7380a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.759+0000 7fa74dd9b640 1 -- 172.21.15.92:0/1804370244 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1a50ac9a0 msgr2=0x55a1a50acda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.759+0000 7fa74dd9b640 1 --2- 172.21.15.92:0/1804370244 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1a50ac9a0 0x55a1a50acda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.759+0000 7fa74dd9b640 1 -- 172.21.15.92:0/1804370244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1a50ad2e0 msgr2=0x55a1a50b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.759+0000 7fa74dd9b640 1 --2- 172.21.15.92:0/1804370244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1a50ad2e0 0x55a1a50b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.759+0000 7fa74dd9b640 1 -- 172.21.15.92:0/1804370244 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1a4fb7340 con 0x55a1a50b2370 2024-09-19T08:56:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.759+0000 7fa74ed9d640 1 --2- 172.21.15.92:0/1804370244 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1a50ac9a0 0x55a1a50acda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.759+0000 7fa74ed9d640 1 --2- 172.21.15.92:0/1600441368 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa7380a32f0 0x7fa7380a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.759+0000 7fa73f7fe640 1 -- 172.21.15.92:0/1600441368 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa7440eff80 con 0x7fa7501016d0 2024-09-19T08:56:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.759+0000 7fa74dd9b640 1 --2- 172.21.15.92:0/1804370244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1a50b2370 0x55a1a50b4830 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa7440dc7d0 tx=0x7fa7440e7370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae1cea212056db6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.759+0000 7fa73cff9640 1 -- 172.21.15.92:0/1804370244 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa744049030 con 0x55a1a50b2370 2024-09-19T08:56:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.759+0000 7fa73cff9640 1 -- 172.21.15.92:0/1804370244 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7440df210 con 0x55a1a50b2370 2024-09-19T08:56:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.759+0000 7fa73cff9640 1 -- 172.21.15.92:0/1804370244 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7440df010 con 0x55a1a50b2370 2024-09-19T08:56:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.760+0000 7fa757dc0740 1 -- 172.21.15.92:0/1804370244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1a50b2370 msgr2=0x55a1a50b4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.760+0000 7fa74ed9d640 1 --2- 172.21.15.92:0/1600441368 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa7380a32f0 0x7fa7380a57b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa748005fd0 tx=0x7fa748004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:57.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.760+0000 7fa757dc0740 1 --2- 172.21.15.92:0/1804370244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1a50b2370 0x55a1a50b4830 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa7440dc7d0 tx=0x7fa7440e7370 comp rx=0 tx=0).stop 2024-09-19T08:56:57.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.760+0000 7fa757dc0740 1 -- 172.21.15.92:0/1804370244 shutdown_connections 2024-09-19T08:56:57.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.760+0000 7fa757dc0740 1 --2- 172.21.15.92:0/1804370244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1a50b2370 0x55a1a50b4830 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.760+0000 7fa757dc0740 1 --2- 172.21.15.92:0/1804370244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1a50ad2e0 0x55a1a50b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.760+0000 7fa757dc0740 1 --2- 172.21.15.92:0/1804370244 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1a50ac9a0 0x55a1a50acda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.760+0000 7fa757dc0740 1 -- 172.21.15.92:0/1804370244 >> 172.21.15.92:0/1804370244 conn(0x55a1a50a8010 msgr2=0x55a1a50a8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:57.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.760+0000 7fa757dc0740 1 -- 172.21.15.92:0/1804370244 shutdown_connections 2024-09-19T08:56:57.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.760+0000 7fa757dc0740 1 -- 172.21.15.92:0/1804370244 wait complete. 2024-09-19T08:56:57.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.761+0000 7fa757dc0740 1 -- start start 2024-09-19T08:56:57.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.761+0000 7fa757dc0740 1 Processor -- start 2024-09-19T08:56:57.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.761+0000 7fa757dc0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1a50ac9a0 0x55a1a50b6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:57.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.761+0000 7fa757dc0740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1a50ad2e0 0x55a1a50b6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:57.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.761+0000 7fa757dc0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1a50b2370 0x55a1a50bdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:57.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.761+0000 7fa757dc0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a1a50102f0 con 0x55a1a50ac9a0 2024-09-19T08:56:57.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.761+0000 7fa757dc0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a1a4f99290 con 0x55a1a50b2370 2024-09-19T08:56:57.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.761+0000 7fa757dc0740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55a1a50b5100 con 0x55a1a50ad2e0 2024-09-19T08:56:57.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.761+0000 7fa757dc0740 10 client.0 _ll_register_callbacks cb 0x55a1a4fca140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:57.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.761+0000 7fa74e59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1a50ac9a0 0x55a1a50b6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:57.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.761+0000 7fa74e59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1a50ac9a0 0x55a1a50b6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47314/0 (socket says 172.21.15.92:47314) 2024-09-19T08:56:57.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.761+0000 7fa74e59c640 1 -- 172.21.15.92:0/2288229898 learned_addr learned my addr 172.21.15.92:0/2288229898 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:57.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.761+0000 7fa74ed9d640 1 --2- 172.21.15.92:0/2288229898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1a50b2370 0x55a1a50bdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:57.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.761+0000 7fa74e59c640 1 -- 172.21.15.92:0/2288229898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1a50ad2e0 msgr2=0x55a1a50b6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:57.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.761+0000 7fa74e59c640 1 --2- 172.21.15.92:0/2288229898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1a50ad2e0 0x55a1a50b6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.761+0000 7fa74e59c640 1 -- 172.21.15.92:0/2288229898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1a50b2370 msgr2=0x55a1a50bdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:57.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.761+0000 7fa74e59c640 1 --2- 172.21.15.92:0/2288229898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1a50b2370 0x55a1a50bdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.761+0000 7fa74e59c640 1 -- 172.21.15.92:0/2288229898 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1a4d23210 con 0x55a1a50ac9a0 2024-09-19T08:56:57.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.761+0000 7fa74ed9d640 1 --2- 172.21.15.92:0/2288229898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1a50b2370 0x55a1a50bdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:56:57.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.762+0000 7fa74e59c640 1 --2- 172.21.15.92:0/2288229898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1a50ac9a0 0x55a1a50b6810 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa7400126a0 tx=0x7fa740012b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49d5237868c43caa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:57.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.762+0000 7fa735ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:56:57.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.762+0000 7fa735ffb640 1 -- 172.21.15.92:0/2288229898 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa740010d60 con 0x55a1a50ac9a0 2024-09-19T08:56:57.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.762+0000 7fa735ffb640 1 -- 172.21.15.92:0/2288229898 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa740005020 con 0x55a1a50ac9a0 2024-09-19T08:56:57.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.762+0000 7fa757dc0740 1 -- 172.21.15.92:0/2288229898 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a1a501da20 con 0x55a1a50ac9a0 2024-09-19T08:56:57.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.762+0000 7fa735ffb640 1 -- 172.21.15.92:0/2288229898 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa740005220 con 0x55a1a50ac9a0 2024-09-19T08:56:57.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.762+0000 7fa757dc0740 10 client.15354 fetch_fsmap learned FSMap version 19 2024-09-19T08:56:57.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.762+0000 7fa757dc0740 1 -- 172.21.15.92:0/2288229898 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55a1a4def620 con 0x55a1a50ac9a0 2024-09-19T08:56:57.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.762+0000 7fa735ffb640 1 -- 172.21.15.92:0/2288229898 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55a1a501da20 con 0x55a1a50ac9a0 2024-09-19T08:56:57.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.762+0000 7fa735ffb640 1 -- 172.21.15.92:0/2288229898 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fa740019030 con 0x55a1a50ac9a0 2024-09-19T08:56:57.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.762+0000 7fa757dc0740 10 client.15354 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:56:57.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.762+0000 7fa757dc0740 10 client.15354 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T08:56:57.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.762+0000 7fa757dc0740 20 client.15354 populate_metadata read hostname 'smithi092' 2024-09-19T08:56:57.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.762+0000 7fa757dc0740 1 --2- 172.21.15.92:0/2288229898 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a1a50c2570 0x55a1a50c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:57.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.762+0000 7fa757dc0740 4 client.15354 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:56:57.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.762+0000 7fa757dc0740 1 -- 172.21.15.92:0/2288229898 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1a5017d70 con 0x55a1a50c2570 2024-09-19T08:56:57.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.763+0000 7fa74dd9b640 1 --2- 172.21.15.92:0/2288229898 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a1a50c2570 0x55a1a50c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:57.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.763+0000 7fa735ffb640 10 client.15354 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:57.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.763+0000 7fa74dd9b640 1 --2- 172.21.15.92:0/2288229898 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a1a50c2570 0x55a1a50c4a30 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=661f38e1ff23c853 server_cookie=432bef6c6638c4b7 in_seq=0 out_seq=0 2024-09-19T08:56:57.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.764+0000 7fa735ffb640 1 -- 172.21.15.92:0/2288229898 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a1a5017d70 con 0x55a1a50c2570 2024-09-19T08:56:57.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.764+0000 7fa735ffb640 10 client.15354 handle_command_reply: tid=0 2024-09-19T08:56:57.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.764+0000 7fa757dc0740 1 client.15354 shutdown 2024-09-19T08:56:57.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.764+0000 7fa757dc0740 1 -- 172.21.15.92:0/2288229898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1a50ac9a0 msgr2=0x55a1a50b6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:57.773 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.764+0000 7fa757dc0740 1 --2- 172.21.15.92:0/2288229898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1a50ac9a0 0x55a1a50b6810 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa7400126a0 tx=0x7fa740012b60 comp rx=0 tx=0).stop 2024-09-19T08:56:57.773 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.764+0000 7fa757dc0740 1 -- 172.21.15.92:0/2288229898 shutdown_connections 2024-09-19T08:56:57.773 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.764+0000 7fa757dc0740 1 --2- 172.21.15.92:0/2288229898 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a1a50c2570 0x55a1a50c4a30 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.773 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.764+0000 7fa757dc0740 1 --2- 172.21.15.92:0/2288229898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1a50b2370 0x55a1a50bdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.773 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.764+0000 7fa757dc0740 1 --2- 172.21.15.92:0/2288229898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1a50ad2e0 0x55a1a50b6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.773 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.764+0000 7fa735ffb640 0 client.15354 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:57.773 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.764+0000 7fa757dc0740 1 --2- 172.21.15.92:0/2288229898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1a50ac9a0 0x55a1a50b6810 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.773 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.764+0000 7fa757dc0740 1 -- 172.21.15.92:0/2288229898 >> 172.21.15.92:0/2288229898 conn(0x55a1a50a8010 msgr2=0x55a1a50a9820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:57.773 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.764+0000 7fa757dc0740 1 -- 172.21.15.92:0/2288229898 shutdown_connections 2024-09-19T08:56:57.773 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.764+0000 7fa757dc0740 1 -- 172.21.15.92:0/2288229898 wait complete. 2024-09-19T08:56:57.773 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.764+0000 7fa757dc0740 20 client.15354 trim_cache size 0 max 16384 2024-09-19T08:56:57.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.779+0000 7fa757dc0740 1 Processor -- start 2024-09-19T08:56:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.779+0000 7fa757dc0740 1 -- start start 2024-09-19T08:56:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.779+0000 7fa757dc0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1a50ac9a0 0x55a1a50b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.779+0000 7fa757dc0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1a50ad2e0 0x55a1a50bdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.779+0000 7fa757dc0740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1a50b2370 0x55a1a50b1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.779+0000 7fa757dc0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa7501a7000 con 0x55a1a50ad2e0 2024-09-19T08:56:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.779+0000 7fa757dc0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa7501a98a0 con 0x55a1a50ac9a0 2024-09-19T08:56:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.779+0000 7fa757dc0740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa7501a7690 con 0x55a1a50b2370 2024-09-19T08:56:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.779+0000 7fa74e59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1a50ac9a0 0x55a1a50b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.779+0000 7fa74e59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1a50ac9a0 0x55a1a50b6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:35188/0 (socket says 172.21.15.92:35188) 2024-09-19T08:56:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.779+0000 7fa74e59c640 1 -- 172.21.15.92:0/49262145 learned_addr learned my addr 172.21.15.92:0/49262145 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.779+0000 7fa74dd9b640 1 --2- 172.21.15.92:0/49262145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1a50ad2e0 0x55a1a50bdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.779+0000 7fa74ed9d640 1 --2- 172.21.15.92:0/49262145 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1a50b2370 0x55a1a50b1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:57.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.779+0000 7fa74e59c640 1 -- 172.21.15.92:0/49262145 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1a50b2370 msgr2=0x55a1a50b1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:57.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.779+0000 7fa74e59c640 1 --2- 172.21.15.92:0/49262145 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1a50b2370 0x55a1a50b1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.779+0000 7fa74e59c640 1 -- 172.21.15.92:0/49262145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1a50ad2e0 msgr2=0x55a1a50bdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:57.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.779+0000 7fa74e59c640 1 --2- 172.21.15.92:0/49262145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1a50ad2e0 0x55a1a50bdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.779+0000 7fa74e59c640 1 -- 172.21.15.92:0/49262145 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1a50c0e50 con 0x55a1a50ac9a0 2024-09-19T08:56:57.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.780+0000 7fa74e59c640 1 --2- 172.21.15.92:0/49262145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1a50ac9a0 0x55a1a50b6cd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa74001a560 tx=0x7fa740009d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79c39ca34bb4b6e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:57.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.780+0000 7fa737fff640 1 -- 172.21.15.92:0/49262145 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa740029070 con 0x55a1a50ac9a0 2024-09-19T08:56:57.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.780+0000 7fa737fff640 1 -- 172.21.15.92:0/49262145 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa74002b070 con 0x55a1a50ac9a0 2024-09-19T08:56:57.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.780+0000 7fa737fff640 1 -- 172.21.15.92:0/49262145 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa740004640 con 0x55a1a50ac9a0 2024-09-19T08:56:57.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.780+0000 7fa757dc0740 1 -- 172.21.15.92:0/49262145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1a50ac9a0 msgr2=0x55a1a50b6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:57.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.780+0000 7fa757dc0740 1 --2- 172.21.15.92:0/49262145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1a50ac9a0 0x55a1a50b6cd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa74001a560 tx=0x7fa740009d90 comp rx=0 tx=0).stop 2024-09-19T08:56:57.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.780+0000 7fa757dc0740 1 -- 172.21.15.92:0/49262145 shutdown_connections 2024-09-19T08:56:57.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.781+0000 7fa757dc0740 1 --2- 172.21.15.92:0/49262145 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1a50b2370 0x55a1a50b1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.781+0000 7fa757dc0740 1 --2- 172.21.15.92:0/49262145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1a50ad2e0 0x55a1a50bdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.781+0000 7fa757dc0740 1 --2- 172.21.15.92:0/49262145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1a50ac9a0 0x55a1a50b6cd0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.781+0000 7fa757dc0740 1 -- 172.21.15.92:0/49262145 >> 172.21.15.92:0/49262145 conn(0x55a1a50a8010 msgr2=0x55a1a50b65c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:57.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.781+0000 7fa757dc0740 1 -- 172.21.15.92:0/49262145 shutdown_connections 2024-09-19T08:56:57.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.781+0000 7fa757dc0740 1 -- 172.21.15.92:0/49262145 wait complete. 2024-09-19T08:56:57.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.781+0000 7fa757dc0740 1 -- start start 2024-09-19T08:56:57.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.781+0000 7fa757dc0740 1 Processor -- start 2024-09-19T08:56:57.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.781+0000 7fa757dc0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1a50ac9a0 0x55a1a50bae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:57.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.781+0000 7fa757dc0740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1a50ad2e0 0x55a1a50bb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:57.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.781+0000 7fa757dc0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1a50b2370 0x55a1a50bc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:57.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.781+0000 7fa757dc0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa7501a7d60 con 0x55a1a50ac9a0 2024-09-19T08:56:57.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.781+0000 7fa757dc0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa7501a91d0 con 0x55a1a50b2370 2024-09-19T08:56:57.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.781+0000 7fa757dc0740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa7501a8430 con 0x55a1a50ad2e0 2024-09-19T08:56:57.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.781+0000 7fa757dc0740 10 client.0 _ll_register_callbacks cb 0x7fa7400095b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:57.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.781+0000 7fa74e59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1a50ac9a0 0x55a1a50bae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:57.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.781+0000 7fa74e59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1a50ac9a0 0x55a1a50bae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47330/0 (socket says 172.21.15.92:47330) 2024-09-19T08:56:57.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.781+0000 7fa74e59c640 1 -- 172.21.15.92:0/2553654689 learned_addr learned my addr 172.21.15.92:0/2553654689 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:57.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.781+0000 7fa74ed9d640 1 --2- 172.21.15.92:0/2553654689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1a50b2370 0x55a1a50bc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:57.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.781+0000 7fa74e59c640 1 -- 172.21.15.92:0/2553654689 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1a50ad2e0 msgr2=0x55a1a50bb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:57.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.781+0000 7fa74e59c640 1 --2- 172.21.15.92:0/2553654689 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1a50ad2e0 0x55a1a50bb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.781+0000 7fa74e59c640 1 -- 172.21.15.92:0/2553654689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1a50b2370 msgr2=0x55a1a50bc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:57.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.781+0000 7fa74e59c640 1 --2- 172.21.15.92:0/2553654689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1a50b2370 0x55a1a50bc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.781+0000 7fa74e59c640 1 -- 172.21.15.92:0/2553654689 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1a50bc9e0 con 0x55a1a50ac9a0 2024-09-19T08:56:57.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.782+0000 7fa74e59c640 1 --2- 172.21.15.92:0/2553654689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1a50ac9a0 0x55a1a50bae80 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa74001a4e0 tx=0x7fa74001a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6470984626798581 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:57.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.782+0000 7fa735ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:56:57.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.782+0000 7fa735ffb640 1 -- 172.21.15.92:0/2553654689 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa740029040 con 0x55a1a50ac9a0 2024-09-19T08:56:57.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.782+0000 7fa735ffb640 1 -- 172.21.15.92:0/2553654689 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa74001a8e0 con 0x55a1a50ac9a0 2024-09-19T08:56:57.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.782+0000 7fa757dc0740 1 -- 172.21.15.92:0/2553654689 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa74002b070 con 0x55a1a50ac9a0 2024-09-19T08:56:57.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.782+0000 7fa735ffb640 1 -- 172.21.15.92:0/2553654689 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa740010b60 con 0x55a1a50ac9a0 2024-09-19T08:56:57.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.782+0000 7fa757dc0740 10 client.15360 fetch_fsmap learned FSMap version 19 2024-09-19T08:56:57.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.782+0000 7fa757dc0740 1 -- 172.21.15.92:0/2553654689 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55a1a50bdcf0 con 0x55a1a50ac9a0 2024-09-19T08:56:57.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.782+0000 7fa735ffb640 1 -- 172.21.15.92:0/2553654689 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa74002b070 con 0x55a1a50ac9a0 2024-09-19T08:56:57.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.782+0000 7fa735ffb640 1 -- 172.21.15.92:0/2553654689 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fa740019040 con 0x55a1a50ac9a0 2024-09-19T08:56:57.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.782+0000 7fa757dc0740 10 client.15360 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:56:57.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.782+0000 7fa757dc0740 10 client.15360 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T08:56:57.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.782+0000 7fa757dc0740 20 client.15360 populate_metadata read hostname 'smithi092' 2024-09-19T08:56:57.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.782+0000 7fa757dc0740 1 --2- 172.21.15.92:0/2553654689 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a1a512d610 0x55a1a512fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:57.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.782+0000 7fa757dc0740 4 client.15360 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:56:57.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.782+0000 7fa757dc0740 1 -- 172.21.15.92:0/2553654689 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a1a4f94900 con 0x55a1a512d610 2024-09-19T08:56:57.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.783+0000 7fa74dd9b640 1 --2- 172.21.15.92:0/2553654689 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a1a512d610 0x55a1a512fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:57.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.783+0000 7fa735ffb640 10 client.15360 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:57.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.783+0000 7fa74dd9b640 1 --2- 172.21.15.92:0/2553654689 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a1a512d610 0x55a1a512fa00 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f32986be89f83a20 server_cookie=f44ea625ddc545b8 in_seq=0 out_seq=0 2024-09-19T08:56:57.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.849+0000 7fa735ffb640 1 -- 172.21.15.92:0/2553654689 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a1a4f94900 con 0x55a1a512d610 2024-09-19T08:56:57.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.849+0000 7fa735ffb640 10 client.15360 handle_command_reply: tid=0 2024-09-19T08:56:57.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.849+0000 7fa757dc0740 1 client.15360 shutdown 2024-09-19T08:56:57.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.849+0000 7fa757dc0740 1 -- 172.21.15.92:0/2553654689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1a50ac9a0 msgr2=0x55a1a50bae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:57.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.849+0000 7fa757dc0740 1 --2- 172.21.15.92:0/2553654689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1a50ac9a0 0x55a1a50bae80 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa74001a4e0 tx=0x7fa74001a3f0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.849+0000 7fa757dc0740 1 -- 172.21.15.92:0/2553654689 shutdown_connections 2024-09-19T08:56:57.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.849+0000 7fa757dc0740 1 --2- 172.21.15.92:0/2553654689 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a1a512d610 0x55a1a512fa00 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.849+0000 7fa757dc0740 1 --2- 172.21.15.92:0/2553654689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1a50b2370 0x55a1a50bc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.849+0000 7fa757dc0740 1 --2- 172.21.15.92:0/2553654689 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1a50ad2e0 0x55a1a50bb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.849+0000 7fa757dc0740 1 --2- 172.21.15.92:0/2553654689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1a50ac9a0 0x55a1a50bae80 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.849+0000 7fa735ffb640 0 client.15360 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:57.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.849+0000 7fa757dc0740 1 -- 172.21.15.92:0/2553654689 >> 172.21.15.92:0/2553654689 conn(0x55a1a50a8010 msgr2=0x55a1a50a69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:57.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.849+0000 7fa757dc0740 1 -- 172.21.15.92:0/2553654689 shutdown_connections 2024-09-19T08:56:57.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.850+0000 7fa757dc0740 1 -- 172.21.15.92:0/2553654689 wait complete. 2024-09-19T08:56:57.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.850+0000 7fa757dc0740 20 client.15360 trim_cache size 0 max 16384 2024-09-19T08:56:57.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T08:56:57.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T08:56:57.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T08:56:57.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T08:56:57.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.850+0000 7fa754f4b640 1 -- 172.21.15.92:0/1600441368 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa7380a32f0 msgr2=0x7fa7380a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:57.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.850+0000 7fa754f4b640 1 --2- 172.21.15.92:0/1600441368 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa7380a32f0 0x7fa7380a57b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa748005fd0 tx=0x7fa748004a40 comp rx=0 tx=0).stop 2024-09-19T08:56:57.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.850+0000 7fa754f4b640 1 -- 172.21.15.92:0/1600441368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7501016d0 msgr2=0x7fa750198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:57.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.850+0000 7fa754f4b640 1 --2- 172.21.15.92:0/1600441368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7501016d0 0x7fa750198300 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa744009230 tx=0x7fa7440042f0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.850+0000 7fa754f4b640 1 -- 172.21.15.92:0/1600441368 shutdown_connections 2024-09-19T08:56:57.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.850+0000 7fa754f4b640 1 --2- 172.21.15.92:0/1600441368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa750101fe0 0x7fa75019f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.850+0000 7fa754f4b640 1 --2- 172.21.15.92:0/1600441368 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa7380a32f0 0x7fa7380a57b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.850+0000 7fa754f4b640 1 --2- 172.21.15.92:0/1600441368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7501016d0 0x7fa750198300 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.850+0000 7fa754f4b640 1 --2- 172.21.15.92:0/1600441368 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa750100d10 0x7fa750197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:57.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.850+0000 7fa754f4b640 1 -- 172.21.15.92:0/1600441368 >> 172.21.15.92:0/1600441368 conn(0x7fa7500fb970 msgr2=0x7fa750105020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:57.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.850+0000 7fa754f4b640 1 -- 172.21.15.92:0/1600441368 shutdown_connections 2024-09-19T08:56:57.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:56:57.850+0000 7fa754f4b640 1 -- 172.21.15.92:0/1600441368 wait complete. 2024-09-19T08:56:57.856 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:57 smithi167 ceph-mon[35359]: pgmap v344: 97 pgs: 97 active+clean; 921 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 52 MiB/s wr, 792 op/s 2024-09-19T08:56:57.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:57 smithi190 ceph-mon[35358]: pgmap v344: 97 pgs: 97 active+clean; 921 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 52 MiB/s wr, 792 op/s 2024-09-19T08:56:59.198 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:56:59.199 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:56:59.468 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:59.502 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:56:59 smithi092 ceph-mon[31407]: pgmap v345: 97 pgs: 97 active+clean; 925 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 34 MiB/s wr, 884 op/s 2024-09-19T08:56:59.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:56:59 smithi167 ceph-mon[35359]: pgmap v345: 97 pgs: 97 active+clean; 925 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 34 MiB/s wr, 884 op/s 2024-09-19T08:56:59.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:56:59 smithi190 ceph-mon[35358]: pgmap v345: 97 pgs: 97 active+clean; 925 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 34 MiB/s wr, 884 op/s 2024-09-19T08:56:59.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.890+0000 7f037c964640 1 -- 172.21.15.92:0/2028671758 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0378102570 msgr2=0x7f03781029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:59.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.891+0000 7f037c964640 1 --2- 172.21.15.92:0/2028671758 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0378102570 0x7f03781029b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f0360009900 tx=0x7f036002a480 comp rx=0 tx=0).stop 2024-09-19T08:56:59.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.891+0000 7f037c964640 1 -- 172.21.15.92:0/2028671758 shutdown_connections 2024-09-19T08:56:59.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.891+0000 7f037c964640 1 --2- 172.21.15.92:0/2028671758 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0378102ef0 0x7f037810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:59.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.891+0000 7f037c964640 1 --2- 172.21.15.92:0/2028671758 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0378102570 0x7f03781029b0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:59.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.891+0000 7f037c964640 1 --2- 172.21.15.92:0/2028671758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0378100e20 0x7f0378101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:59.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.891+0000 7f037c964640 1 -- 172.21.15.92:0/2028671758 >> 172.21.15.92:0/2028671758 conn(0x7f03780fc7d0 msgr2=0x7f03780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:59.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.891+0000 7f037c964640 1 -- 172.21.15.92:0/2028671758 shutdown_connections 2024-09-19T08:56:59.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.891+0000 7f037c964640 1 -- 172.21.15.92:0/2028671758 wait complete. 2024-09-19T08:56:59.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.891+0000 7f037c964640 1 Processor -- start 2024-09-19T08:56:59.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.891+0000 7f037c964640 1 -- start start 2024-09-19T08:56:59.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.892+0000 7f037c964640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0378100e20 0x7f03780fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:59.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.892+0000 7f037c964640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0378102570 0x7f03780fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:59.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.892+0000 7f037c964640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0378102ef0 0x7f03780fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:59.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.892+0000 7f037c964640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0378110f80 con 0x7f0378102570 2024-09-19T08:56:59.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.892+0000 7f037c964640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0378110e00 con 0x7f0378100e20 2024-09-19T08:56:59.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.892+0000 7f037c964640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0378111100 con 0x7f0378102ef0 2024-09-19T08:56:59.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.892+0000 7f0375d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0378102570 0x7f03780fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:59.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.892+0000 7f0375d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0378102570 0x7f03780fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47348/0 (socket says 172.21.15.92:47348) 2024-09-19T08:56:59.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.892+0000 7f0375d9b640 1 -- 172.21.15.92:0/3812859912 learned_addr learned my addr 172.21.15.92:0/3812859912 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:59.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.892+0000 7f0376d9d640 1 --2- 172.21.15.92:0/3812859912 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0378102ef0 0x7f03780fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:59.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.892+0000 7f037659c640 1 --2- 172.21.15.92:0/3812859912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0378100e20 0x7f03780fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:59.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.892+0000 7f0375d9b640 1 -- 172.21.15.92:0/3812859912 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0378102ef0 msgr2=0x7f03780fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:59.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.892+0000 7f0375d9b640 1 --2- 172.21.15.92:0/3812859912 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0378102ef0 0x7f03780fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:59.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.892+0000 7f0375d9b640 1 -- 172.21.15.92:0/3812859912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0378100e20 msgr2=0x7f03780fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:59.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.892+0000 7f0375d9b640 1 --2- 172.21.15.92:0/3812859912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0378100e20 0x7f03780fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:59.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.892+0000 7f0375d9b640 1 -- 172.21.15.92:0/3812859912 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03781a6a10 con 0x7f0378102570 2024-09-19T08:56:59.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.892+0000 7f037659c640 1 --2- 172.21.15.92:0/3812859912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0378100e20 0x7f03780fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:59.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.892+0000 7f0375d9b640 1 --2- 172.21.15.92:0/3812859912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0378102570 0x7f03780fd1c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0360006010 tx=0x7f0360003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:59.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.892+0000 7f036f7fe640 1 -- 172.21.15.92:0/3812859912 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036003f070 con 0x7f0378102570 2024-09-19T08:56:59.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.893+0000 7f037c964640 1 -- 172.21.15.92:0/3812859912 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03781a6ca0 con 0x7f0378102570 2024-09-19T08:56:59.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.893+0000 7f036f7fe640 1 -- 172.21.15.92:0/3812859912 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0360031c30 con 0x7f0378102570 2024-09-19T08:56:59.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.893+0000 7f036f7fe640 1 -- 172.21.15.92:0/3812859912 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0360035030 con 0x7f0378102570 2024-09-19T08:56:59.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.893+0000 7f037c964640 1 -- 172.21.15.92:0/3812859912 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03781a7180 con 0x7f0378102570 2024-09-19T08:56:59.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.895+0000 7f036f7fe640 1 -- 172.21.15.92:0/3812859912 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0360042070 con 0x7f0378102570 2024-09-19T08:56:59.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.895+0000 7f037ed3d740 1 Processor -- start 2024-09-19T08:56:59.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.895+0000 7f037ed3d740 1 -- start start 2024-09-19T08:56:59.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.896+0000 7f037ed3d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650845a6b60 0x5650845a6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:59.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.896+0000 7f037ed3d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650845a7480 0x5650845b1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:59.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.896+0000 7f037ed3d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650845b1d40 0x5650845b4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:59.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.896+0000 7f037ed3d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56508450c280 con 0x5650845a6b60 2024-09-19T08:56:59.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.896+0000 7f037ed3d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5650844b3b10 con 0x5650845a7480 2024-09-19T08:56:59.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.896+0000 7f037ed3d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x565084508240 con 0x5650845b1d40 2024-09-19T08:56:59.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.896+0000 7f036f7fe640 1 --2- 172.21.15.92:0/3812859912 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f03640a3240 0x7f03640a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:59.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.896+0000 7f0376d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650845a6b60 0x5650845a6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:59.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.896+0000 7f0376d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650845a6b60 0x5650845a6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47362/0 (socket says 172.21.15.92:47362) 2024-09-19T08:56:59.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.896+0000 7f0376d9d640 1 -- 172.21.15.92:0/335628943 learned_addr learned my addr 172.21.15.92:0/335628943 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:59.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.896+0000 7f036f7fe640 1 -- 172.21.15.92:0/3812859912 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f03600f0170 con 0x7f0378102570 2024-09-19T08:56:59.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.896+0000 7f037659c640 1 --2- 172.21.15.92:0/335628943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650845a7480 0x5650845b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:59.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.896+0000 7f0376d9d640 1 --2- 172.21.15.92:0/3812859912 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f03640a3240 0x7f03640a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:59.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.896+0000 7f0375d9b640 1 --2- 172.21.15.92:0/335628943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650845b1d40 0x5650845b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:59.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.896+0000 7f0376d9d640 1 -- 172.21.15.92:0/335628943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650845b1d40 msgr2=0x5650845b4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:59.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.896+0000 7f0376d9d640 1 --2- 172.21.15.92:0/335628943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650845b1d40 0x5650845b4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:59.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.896+0000 7f0376d9d640 1 -- 172.21.15.92:0/335628943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650845a7480 msgr2=0x5650845b1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:59.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.896+0000 7f0376d9d640 1 --2- 172.21.15.92:0/335628943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650845a7480 0x5650845b1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:59.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.896+0000 7f0376d9d640 1 -- 172.21.15.92:0/335628943 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650844c01f0 con 0x5650845a6b60 2024-09-19T08:56:59.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.896+0000 7f0376d9d640 1 --2- 172.21.15.92:0/335628943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650845a6b60 0x5650845a6f40 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f037000bd20 tx=0x7f03700039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbad321300b393e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:59.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.897+0000 7f036cff9640 1 -- 172.21.15.92:0/335628943 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037000b700 con 0x5650845a6b60 2024-09-19T08:56:59.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.897+0000 7f036cff9640 1 -- 172.21.15.92:0/335628943 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03700054b0 con 0x5650845a6b60 2024-09-19T08:56:59.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.897+0000 7f0376d9d640 1 --2- 172.21.15.92:0/3812859912 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f03640a3240 0x7f03640a5700 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0370021000 tx=0x7f0370020000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:59.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.897+0000 7f036cff9640 1 -- 172.21.15.92:0/335628943 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037001ed70 con 0x5650845a6b60 2024-09-19T08:56:59.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.897+0000 7f037ed3d740 1 -- 172.21.15.92:0/335628943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650845a6b60 msgr2=0x5650845a6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:59.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.897+0000 7f037ed3d740 1 --2- 172.21.15.92:0/335628943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650845a6b60 0x5650845a6f40 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f037000bd20 tx=0x7f03700039c0 comp rx=0 tx=0).stop 2024-09-19T08:56:59.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.897+0000 7f037ed3d740 1 -- 172.21.15.92:0/335628943 shutdown_connections 2024-09-19T08:56:59.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.897+0000 7f037ed3d740 1 --2- 172.21.15.92:0/335628943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650845b1d40 0x5650845b4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:59.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.897+0000 7f037ed3d740 1 --2- 172.21.15.92:0/335628943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650845a7480 0x5650845b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:59.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.897+0000 7f037ed3d740 1 --2- 172.21.15.92:0/335628943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650845a6b60 0x5650845a6f40 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:59.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.897+0000 7f037ed3d740 1 -- 172.21.15.92:0/335628943 >> 172.21.15.92:0/335628943 conn(0x5650845a30f0 msgr2=0x5650845a34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:59.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.898+0000 7f037ed3d740 1 -- 172.21.15.92:0/335628943 shutdown_connections 2024-09-19T08:56:59.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.898+0000 7f037ed3d740 1 -- 172.21.15.92:0/335628943 wait complete. 2024-09-19T08:56:59.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.898+0000 7f037ed3d740 1 -- start start 2024-09-19T08:56:59.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.898+0000 7f037ed3d740 1 Processor -- start 2024-09-19T08:56:59.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.898+0000 7f037ed3d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650845a6b60 0x5650845aec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:59.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.898+0000 7f037ed3d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650845a7480 0x5650845af150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:59.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.898+0000 7f037ed3d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650845b1d40 0x5650845af690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:59.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.898+0000 7f037ed3d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5650845b4910 con 0x5650845b1d40 2024-09-19T08:56:59.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.898+0000 7f037ed3d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5650844c6f10 con 0x5650845a6b60 2024-09-19T08:56:59.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.898+0000 7f037ed3d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5650845b4a90 con 0x5650845a7480 2024-09-19T08:56:59.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.898+0000 7f037ed3d740 10 client.0 _ll_register_callbacks cb 0x56508448fa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:59.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.898+0000 7f0376d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650845b1d40 0x5650845af690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:59.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.899+0000 7f0376d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650845b1d40 0x5650845af690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47368/0 (socket says 172.21.15.92:47368) 2024-09-19T08:56:59.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.899+0000 7f0376d9d640 1 -- 172.21.15.92:0/219650645 learned_addr learned my addr 172.21.15.92:0/219650645 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:59.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.899+0000 7f037659c640 1 --2- 172.21.15.92:0/219650645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650845a6b60 0x5650845aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:59.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.899+0000 7f0375d9b640 1 --2- 172.21.15.92:0/219650645 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650845a7480 0x5650845af150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:59.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.899+0000 7f0376d9d640 1 -- 172.21.15.92:0/219650645 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650845a7480 msgr2=0x5650845af150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:59.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.899+0000 7f0376d9d640 1 --2- 172.21.15.92:0/219650645 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650845a7480 0x5650845af150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:59.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.899+0000 7f0376d9d640 1 -- 172.21.15.92:0/219650645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650845a6b60 msgr2=0x5650845aec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:59.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.899+0000 7f0376d9d640 1 --2- 172.21.15.92:0/219650645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650845a6b60 0x5650845aec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:59.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.899+0000 7f0376d9d640 1 -- 172.21.15.92:0/219650645 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56508427d6a0 con 0x5650845b1d40 2024-09-19T08:56:59.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.899+0000 7f037659c640 1 --2- 172.21.15.92:0/219650645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650845a6b60 0x5650845aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:59.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.899+0000 7f0375d9b640 1 --2- 172.21.15.92:0/219650645 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650845a7480 0x5650845af150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:59.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.899+0000 7f0376d9d640 1 --2- 172.21.15.92:0/219650645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650845b1d40 0x5650845af690 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0370004d90 tx=0x7f0370004dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35a0728a9afeb5d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:59.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.899+0000 7f035dffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:56:59.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.899+0000 7f035dffb640 1 -- 172.21.15.92:0/219650645 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037001eaf0 con 0x5650845b1d40 2024-09-19T08:56:59.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.899+0000 7f035dffb640 1 -- 172.21.15.92:0/219650645 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f037001ec90 con 0x5650845b1d40 2024-09-19T08:56:59.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.899+0000 7f037ed3d740 1 -- 172.21.15.92:0/219650645 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03700054b0 con 0x5650845b1d40 2024-09-19T08:56:59.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.899+0000 7f035dffb640 1 -- 172.21.15.92:0/219650645 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f037001e470 con 0x5650845b1d40 2024-09-19T08:56:59.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.899+0000 7f037ed3d740 10 client.15372 fetch_fsmap learned FSMap version 19 2024-09-19T08:56:59.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.899+0000 7f037ed3d740 1 -- 172.21.15.92:0/219650645 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5650845c0510 con 0x5650845b1d40 2024-09-19T08:56:59.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.900+0000 7f035dffb640 1 -- 172.21.15.92:0/219650645 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03700054b0 con 0x5650845b1d40 2024-09-19T08:56:59.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.900+0000 7f035dffb640 1 -- 172.21.15.92:0/219650645 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f037002f020 con 0x5650845b1d40 2024-09-19T08:56:59.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.900+0000 7f037ed3d740 10 client.15372 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:56:59.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.900+0000 7f037ed3d740 10 client.15372 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:56:59.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.900+0000 7f037ed3d740 20 client.15372 populate_metadata read hostname 'smithi092' 2024-09-19T08:56:59.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.900+0000 7f037ed3d740 1 --2- 172.21.15.92:0/219650645 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5650845c1860 0x5650845c3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:59.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.900+0000 7f037ed3d740 4 client.15372 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:56:59.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.900+0000 7f037ed3d740 1 -- 172.21.15.92:0/219650645 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5650845197f0 con 0x5650845c1860 2024-09-19T08:56:59.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.900+0000 7f037659c640 1 --2- 172.21.15.92:0/219650645 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5650845c1860 0x5650845c3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:59.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.901+0000 7f037659c640 1 --2- 172.21.15.92:0/219650645 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5650845c1860 0x5650845c3c50 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0d1899b55ff1c03 server_cookie=400223d898f76e56 in_seq=0 out_seq=0 2024-09-19T08:56:59.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.901+0000 7f035dffb640 10 client.15372 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:59.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.901+0000 7f035dffb640 1 -- 172.21.15.92:0/219650645 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5650845197f0 con 0x5650845c1860 2024-09-19T08:56:59.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.901+0000 7f035dffb640 10 client.15372 handle_command_reply: tid=0 2024-09-19T08:56:59.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.901+0000 7f037ed3d740 1 client.15372 shutdown 2024-09-19T08:56:59.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.902+0000 7f037ed3d740 1 -- 172.21.15.92:0/219650645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650845b1d40 msgr2=0x5650845af690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:59.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.902+0000 7f037ed3d740 1 --2- 172.21.15.92:0/219650645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650845b1d40 0x5650845af690 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0370004d90 tx=0x7f0370004dc0 comp rx=0 tx=0).stop 2024-09-19T08:56:59.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.902+0000 7f037ed3d740 1 -- 172.21.15.92:0/219650645 shutdown_connections 2024-09-19T08:56:59.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.902+0000 7f037ed3d740 1 --2- 172.21.15.92:0/219650645 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5650845c1860 0x5650845c3c50 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:59.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.902+0000 7f035dffb640 0 client.15372 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:59.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.902+0000 7f037ed3d740 1 --2- 172.21.15.92:0/219650645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650845b1d40 0x5650845af690 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:59.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.902+0000 7f037ed3d740 1 --2- 172.21.15.92:0/219650645 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650845a7480 0x5650845af150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:59.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.902+0000 7f037ed3d740 1 --2- 172.21.15.92:0/219650645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650845a6b60 0x5650845aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:59.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.902+0000 7f037ed3d740 1 -- 172.21.15.92:0/219650645 >> 172.21.15.92:0/219650645 conn(0x5650845a30f0 msgr2=0x5650845a2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:59.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.902+0000 7f037ed3d740 1 -- 172.21.15.92:0/219650645 shutdown_connections 2024-09-19T08:56:59.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.902+0000 7f037ed3d740 1 -- 172.21.15.92:0/219650645 wait complete. 2024-09-19T08:56:59.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.902+0000 7f037ed3d740 20 client.15372 trim_cache size 0 max 16384 2024-09-19T08:56:59.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.919+0000 7f037ed3d740 1 Processor -- start 2024-09-19T08:56:59.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.919+0000 7f037ed3d740 1 -- start start 2024-09-19T08:56:59.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.919+0000 7f037ed3d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650845a6b60 0x5650845a95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:59.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.919+0000 7f037ed3d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650845a7480 0x5650845c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:59.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.919+0000 7f037ed3d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650845b1d40 0x5650845c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:59.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.919+0000 7f037ed3d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f03781ad7c0 con 0x5650845a7480 2024-09-19T08:56:59.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.919+0000 7f037ed3d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f03781b0060 con 0x5650845b1d40 2024-09-19T08:56:59.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.919+0000 7f037ed3d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f03781ade50 con 0x5650845a6b60 2024-09-19T08:56:59.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.919+0000 7f0375d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650845a7480 0x5650845c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:59.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.919+0000 7f0375d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650845a7480 0x5650845c94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47380/0 (socket says 172.21.15.92:47380) 2024-09-19T08:56:59.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.919+0000 7f0375d9b640 1 -- 172.21.15.92:0/3928861378 learned_addr learned my addr 172.21.15.92:0/3928861378 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:59.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.919+0000 7f0376d9d640 1 --2- 172.21.15.92:0/3928861378 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650845b1d40 0x5650845c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:59.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.919+0000 7f0375d9b640 1 -- 172.21.15.92:0/3928861378 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650845a6b60 msgr2=0x5650845a95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:59.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.919+0000 7f0375d9b640 1 --2- 172.21.15.92:0/3928861378 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650845a6b60 0x5650845a95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:59.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.919+0000 7f0375d9b640 1 -- 172.21.15.92:0/3928861378 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650845b1d40 msgr2=0x5650845c9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:59.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.919+0000 7f0375d9b640 1 --2- 172.21.15.92:0/3928861378 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650845b1d40 0x5650845c9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:59.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.919+0000 7f0375d9b640 1 -- 172.21.15.92:0/3928861378 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650845b1210 con 0x5650845a7480 2024-09-19T08:56:59.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.920+0000 7f0375d9b640 1 --2- 172.21.15.92:0/3928861378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650845a7480 0x5650845c94d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f03600b9160 tx=0x7f036002a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a14ea80560b9d318 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:59.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.920+0000 7f035ffff640 1 -- 172.21.15.92:0/3928861378 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0360049040 con 0x5650845a7480 2024-09-19T08:56:59.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.920+0000 7f035ffff640 1 -- 172.21.15.92:0/3928861378 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03600bce90 con 0x5650845a7480 2024-09-19T08:56:59.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.920+0000 7f035ffff640 1 -- 172.21.15.92:0/3928861378 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03600b8e00 con 0x5650845a7480 2024-09-19T08:56:59.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.920+0000 7f037ed3d740 1 -- 172.21.15.92:0/3928861378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650845a7480 msgr2=0x5650845c94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:59.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.920+0000 7f037ed3d740 1 --2- 172.21.15.92:0/3928861378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650845a7480 0x5650845c94d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f03600b9160 tx=0x7f036002a480 comp rx=0 tx=0).stop 2024-09-19T08:56:59.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.920+0000 7f037ed3d740 1 -- 172.21.15.92:0/3928861378 shutdown_connections 2024-09-19T08:56:59.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.920+0000 7f037ed3d740 1 --2- 172.21.15.92:0/3928861378 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650845b1d40 0x5650845c9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:59.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.920+0000 7f037ed3d740 1 --2- 172.21.15.92:0/3928861378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650845a7480 0x5650845c94d0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:59.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.920+0000 7f037ed3d740 1 --2- 172.21.15.92:0/3928861378 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650845a6b60 0x5650845a95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:59.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.920+0000 7f037ed3d740 1 -- 172.21.15.92:0/3928861378 >> 172.21.15.92:0/3928861378 conn(0x5650845a30f0 msgr2=0x5650845adbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:59.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.920+0000 7f037ed3d740 1 -- 172.21.15.92:0/3928861378 shutdown_connections 2024-09-19T08:56:59.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.920+0000 7f037ed3d740 1 -- 172.21.15.92:0/3928861378 wait complete. 2024-09-19T08:56:59.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.921+0000 7f037ed3d740 1 -- start start 2024-09-19T08:56:59.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.921+0000 7f037ed3d740 1 Processor -- start 2024-09-19T08:56:59.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.921+0000 7f037ed3d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650845a6b60 0x5650845ba5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:59.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.921+0000 7f037ed3d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650845a7480 0x5650845b58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:59.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.921+0000 7f037ed3d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650845b1d40 0x5650845b6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:59.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.921+0000 7f037ed3d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f03781ae520 con 0x5650845b1d40 2024-09-19T08:56:59.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.921+0000 7f037ed3d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f03781af990 con 0x5650845a6b60 2024-09-19T08:56:59.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.921+0000 7f037ed3d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f03781aebf0 con 0x5650845a7480 2024-09-19T08:56:59.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.921+0000 7f037ed3d740 10 client.0 _ll_register_callbacks cb 0x7f037000baf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:59.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.921+0000 7f0376d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650845b1d40 0x5650845b6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:59.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.921+0000 7f0375d9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650845a7480 0x5650845b58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:59.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.921+0000 7f0375d9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650845a7480 0x5650845b58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:50732/0 (socket says 172.21.15.92:50732) 2024-09-19T08:56:59.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.921+0000 7f0375d9b640 1 -- 172.21.15.92:0/2446459477 learned_addr learned my addr 172.21.15.92:0/2446459477 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:56:59.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.921+0000 7f037659c640 1 --2- 172.21.15.92:0/2446459477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650845a6b60 0x5650845ba5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:59.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.921+0000 7f0376d9d640 1 -- 172.21.15.92:0/2446459477 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650845a7480 msgr2=0x5650845b58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:59.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.921+0000 7f0376d9d640 1 --2- 172.21.15.92:0/2446459477 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650845a7480 0x5650845b58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:59.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.921+0000 7f0376d9d640 1 -- 172.21.15.92:0/2446459477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650845a6b60 msgr2=0x5650845ba5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:59.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.921+0000 7f0376d9d640 1 --2- 172.21.15.92:0/2446459477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650845a6b60 0x5650845ba5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:59.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.921+0000 7f0376d9d640 1 -- 172.21.15.92:0/2446459477 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650845c3fc0 con 0x5650845b1d40 2024-09-19T08:56:59.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.922+0000 7f0376d9d640 1 --2- 172.21.15.92:0/2446459477 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650845b1d40 0x5650845b6070 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0370012db0 tx=0x7f0370004e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e7403876b5bf7d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:59.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.922+0000 7f035dffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:56:59.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.922+0000 7f035dffb640 1 -- 172.21.15.92:0/2446459477 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03700054b0 con 0x5650845b1d40 2024-09-19T08:56:59.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.922+0000 7f035dffb640 1 -- 172.21.15.92:0/2446459477 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f03700125d0 con 0x5650845b1d40 2024-09-19T08:56:59.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.922+0000 7f037ed3d740 1 -- 172.21.15.92:0/2446459477 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03600bce90 con 0x5650845b1d40 2024-09-19T08:56:59.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.922+0000 7f035dffb640 1 -- 172.21.15.92:0/2446459477 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f0370045050 con 0x5650845b1d40 2024-09-19T08:56:59.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.922+0000 7f037ed3d740 10 client.15378 fetch_fsmap learned FSMap version 19 2024-09-19T08:56:59.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.922+0000 7f037ed3d740 1 -- 172.21.15.92:0/2446459477 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56508462c4a0 con 0x5650845b1d40 2024-09-19T08:56:59.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.922+0000 7f035dffb640 1 -- 172.21.15.92:0/2446459477 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03600bce90 con 0x5650845b1d40 2024-09-19T08:56:59.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.922+0000 7f035dffb640 1 -- 172.21.15.92:0/2446459477 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f037002f040 con 0x5650845b1d40 2024-09-19T08:56:59.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.922+0000 7f037ed3d740 10 client.15378 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:56:59.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.922+0000 7f037ed3d740 10 client.15378 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:56:59.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.922+0000 7f037ed3d740 20 client.15378 populate_metadata read hostname 'smithi092' 2024-09-19T08:56:59.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.922+0000 7f037ed3d740 1 --2- 172.21.15.92:0/2446459477 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5650845c1860 0x56508462eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:59.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.922+0000 7f037ed3d740 4 client.15378 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:56:59.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.922+0000 7f037ed3d740 1 -- 172.21.15.92:0/2446459477 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x565084513d00 con 0x5650845c1860 2024-09-19T08:56:59.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.923+0000 7f037659c640 1 --2- 172.21.15.92:0/2446459477 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5650845c1860 0x56508462eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:59.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.923+0000 7f037659c640 1 --2- 172.21.15.92:0/2446459477 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5650845c1860 0x56508462eb10 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20b433c32a946436 server_cookie=f3762691d5e7a812 in_seq=0 out_seq=0 2024-09-19T08:56:59.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.923+0000 7f035dffb640 10 client.15378 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:59.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.924+0000 7f035dffb640 1 -- 172.21.15.92:0/2446459477 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x565084513d00 con 0x5650845c1860 2024-09-19T08:56:59.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.924+0000 7f035dffb640 10 client.15378 handle_command_reply: tid=0 2024-09-19T08:56:59.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.924+0000 7f037ed3d740 1 client.15378 shutdown 2024-09-19T08:56:59.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.924+0000 7f037ed3d740 1 -- 172.21.15.92:0/2446459477 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650845b1d40 msgr2=0x5650845b6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:59.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.924+0000 7f037ed3d740 1 --2- 172.21.15.92:0/2446459477 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650845b1d40 0x5650845b6070 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0370012db0 tx=0x7f0370004e30 comp rx=0 tx=0).stop 2024-09-19T08:56:59.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.924+0000 7f037ed3d740 1 -- 172.21.15.92:0/2446459477 shutdown_connections 2024-09-19T08:56:59.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.924+0000 7f037ed3d740 1 --2- 172.21.15.92:0/2446459477 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5650845c1860 0x56508462eb10 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:59.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.924+0000 7f037ed3d740 1 --2- 172.21.15.92:0/2446459477 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650845b1d40 0x5650845b6070 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:59.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.924+0000 7f037ed3d740 1 --2- 172.21.15.92:0/2446459477 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650845a7480 0x5650845b58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:59.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.924+0000 7f037ed3d740 1 --2- 172.21.15.92:0/2446459477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5650845a6b60 0x5650845ba5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:59.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.924+0000 7f037ed3d740 1 -- 172.21.15.92:0/2446459477 >> 172.21.15.92:0/2446459477 conn(0x5650845a30f0 msgr2=0x5650845ad3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:59.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.924+0000 7f035dffb640 0 client.15378 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:56:59.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.925+0000 7f037ed3d740 1 -- 172.21.15.92:0/2446459477 shutdown_connections 2024-09-19T08:56:59.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.925+0000 7f037ed3d740 1 -- 172.21.15.92:0/2446459477 wait complete. 2024-09-19T08:56:59.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.925+0000 7f037ed3d740 20 client.15378 trim_cache size 0 max 16384 2024-09-19T08:56:59.932 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T08:56:59.932 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-19T08:56:59.932 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "a821964f-f5c7-4c37-bf83-3bbf27f19261", 2024-09-19T08:56:59.932 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-19T08:56:59.932 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T08:56:59.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.925+0000 7f037c964640 1 -- 172.21.15.92:0/3812859912 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f03640a3240 msgr2=0x7f03640a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:59.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.925+0000 7f037c964640 1 --2- 172.21.15.92:0/3812859912 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f03640a3240 0x7f03640a5700 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0370021000 tx=0x7f0370020000 comp rx=0 tx=0).stop 2024-09-19T08:56:59.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.925+0000 7f037c964640 1 -- 172.21.15.92:0/3812859912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0378102570 msgr2=0x7f03780fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:59.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.925+0000 7f037c964640 1 --2- 172.21.15.92:0/3812859912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0378102570 0x7f03780fd1c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0360006010 tx=0x7f0360003c10 comp rx=0 tx=0).stop 2024-09-19T08:56:59.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.925+0000 7f037c964640 1 -- 172.21.15.92:0/3812859912 shutdown_connections 2024-09-19T08:56:59.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.925+0000 7f037c964640 1 --2- 172.21.15.92:0/3812859912 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0378102ef0 0x7f03780fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:59.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.925+0000 7f037c964640 1 --2- 172.21.15.92:0/3812859912 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f03640a3240 0x7f03640a5700 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:59.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.925+0000 7f037c964640 1 --2- 172.21.15.92:0/3812859912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0378102570 0x7f03780fd1c0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:59.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.925+0000 7f037c964640 1 --2- 172.21.15.92:0/3812859912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0378100e20 0x7f03780fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:59.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.925+0000 7f037c964640 1 -- 172.21.15.92:0/3812859912 >> 172.21.15.92:0/3812859912 conn(0x7f03780fc7d0 msgr2=0x7f0378069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:59.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.925+0000 7f037c964640 1 -- 172.21.15.92:0/3812859912 shutdown_connections 2024-09-19T08:56:59.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:56:59.926+0000 7f037c964640 1 -- 172.21.15.92:0/3812859912 wait complete. 2024-09-19T08:57:00.631 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:57:00.799 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 15.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T08:57:00.876 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:57:01.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.273+0000 7f0aa9945640 1 -- 172.21.15.92:0/3201769585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0aa4106ba0 msgr2=0x7f0aa4106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:01.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.273+0000 7f0aa9945640 1 --2- 172.21.15.92:0/3201769585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0aa4106ba0 0x7f0aa4106f80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0a94009900 tx=0x7f0a9402a410 comp rx=0 tx=0).stop 2024-09-19T08:57:01.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.273+0000 7f0aa9945640 1 -- 172.21.15.92:0/3201769585 shutdown_connections 2024-09-19T08:57:01.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.273+0000 7f0aa9945640 1 --2- 172.21.15.92:0/3201769585 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0aa4100a70 0x7f0aa410ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.273+0000 7f0aa9945640 1 --2- 172.21.15.92:0/3201769585 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0aa41000d0 0x7f0aa4100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.273+0000 7f0aa9945640 1 --2- 172.21.15.92:0/3201769585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0aa4106ba0 0x7f0aa4106f80 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.273+0000 7f0aa9945640 1 -- 172.21.15.92:0/3201769585 >> 172.21.15.92:0/3201769585 conn(0x7f0aa4077210 msgr2=0x7f0aa40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:01.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.273+0000 7f0aa9945640 1 -- 172.21.15.92:0/3201769585 shutdown_connections 2024-09-19T08:57:01.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.273+0000 7f0aa9945640 1 -- 172.21.15.92:0/3201769585 wait complete. 2024-09-19T08:57:01.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.273+0000 7f0aa9945640 1 Processor -- start 2024-09-19T08:57:01.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.273+0000 7f0aa9945640 1 -- start start 2024-09-19T08:57:01.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.274+0000 7f0aa9945640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0aa41000d0 0x7f0aa41985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:01.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.274+0000 7f0aa9945640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0aa4100a70 0x7f0aa4198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:01.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.274+0000 7f0aa9945640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0aa4106ba0 0x7f0aa419ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:01.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.274+0000 7f0aa9945640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa4112130 con 0x7f0aa41000d0 2024-09-19T08:57:01.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.274+0000 7f0aa9945640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa4111fb0 con 0x7f0aa4106ba0 2024-09-19T08:57:01.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.274+0000 7f0aa9945640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa41122b0 con 0x7f0aa4100a70 2024-09-19T08:57:01.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.274+0000 7f0aa2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0aa41000d0 0x7f0aa41985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:01.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.274+0000 7f0aa2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0aa41000d0 0x7f0aa41985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47402/0 (socket says 172.21.15.92:47402) 2024-09-19T08:57:01.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.274+0000 7f0aa2ffd640 1 -- 172.21.15.92:0/3390759794 learned_addr learned my addr 172.21.15.92:0/3390759794 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:01.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.274+0000 7f0aa27fc640 1 --2- 172.21.15.92:0/3390759794 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0aa4100a70 0x7f0aa4198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:01.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.274+0000 7f0aa37fe640 1 --2- 172.21.15.92:0/3390759794 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0aa4106ba0 0x7f0aa419ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:01.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.274+0000 7f0aa2ffd640 1 -- 172.21.15.92:0/3390759794 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0aa4100a70 msgr2=0x7f0aa4198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:01.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.274+0000 7f0aa2ffd640 1 --2- 172.21.15.92:0/3390759794 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0aa4100a70 0x7f0aa4198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.274+0000 7f0aa2ffd640 1 -- 172.21.15.92:0/3390759794 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0aa4106ba0 msgr2=0x7f0aa419ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:01.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.274+0000 7f0aa2ffd640 1 --2- 172.21.15.92:0/3390759794 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0aa4106ba0 0x7f0aa419ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.274+0000 7f0aa2ffd640 1 -- 172.21.15.92:0/3390759794 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aa419d550 con 0x7f0aa41000d0 2024-09-19T08:57:01.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.274+0000 7f0aa2ffd640 1 --2- 172.21.15.92:0/3390759794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0aa41000d0 0x7f0aa41985a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0a94006010 tx=0x7f0a94003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:01.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.274+0000 7f0aa8943640 1 -- 172.21.15.92:0/3390759794 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9403f070 con 0x7f0aa41000d0 2024-09-19T08:57:01.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.275+0000 7f0aa9945640 1 -- 172.21.15.92:0/3390759794 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aa419d7e0 con 0x7f0aa41000d0 2024-09-19T08:57:01.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.275+0000 7f0aa8943640 1 -- 172.21.15.92:0/3390759794 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a94031e30 con 0x7f0aa41000d0 2024-09-19T08:57:01.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.275+0000 7f0aa8943640 1 -- 172.21.15.92:0/3390759794 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a94035030 con 0x7f0aa41000d0 2024-09-19T08:57:01.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.275+0000 7f0aa9945640 1 -- 172.21.15.92:0/3390759794 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aa41a5120 con 0x7f0aa41000d0 2024-09-19T08:57:01.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.277+0000 7f0aa8943640 1 -- 172.21.15.92:0/3390759794 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0a94042070 con 0x7f0aa41000d0 2024-09-19T08:57:01.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.277+0000 7f0aabd1e740 1 Processor -- start 2024-09-19T08:57:01.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.277+0000 7f0aabd1e740 1 -- start start 2024-09-19T08:57:01.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.277+0000 7f0aabd1e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee016bf4a0 0x55ee016bf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:01.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.277+0000 7f0aabd1e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee016bfdc0 0x55ee016ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:01.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.277+0000 7f0aabd1e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee016ca680 0x55ee016cca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:01.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.277+0000 7f0aabd1e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ee016252e0 con 0x55ee016ca680 2024-09-19T08:57:01.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.277+0000 7f0aabd1e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ee015ccce0 con 0x55ee016bf4a0 2024-09-19T08:57:01.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.277+0000 7f0aabd1e740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ee016212a0 con 0x55ee016bfdc0 2024-09-19T08:57:01.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.277+0000 7f0aa8943640 1 --2- 172.21.15.92:0/3390759794 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f0a8c0a3240 0x7f0a8c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:01.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.278+0000 7f0aa27fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee016ca680 0x55ee016cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:01.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.278+0000 7f0aa27fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee016ca680 0x55ee016cca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47414/0 (socket says 172.21.15.92:47414) 2024-09-19T08:57:01.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.278+0000 7f0aa27fc640 1 -- 172.21.15.92:0/368290341 learned_addr learned my addr 172.21.15.92:0/368290341 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:01.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.278+0000 7f0aa37fe640 1 --2- 172.21.15.92:0/368290341 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee016bf4a0 0x55ee016bf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:01.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.278+0000 7f0aa2ffd640 1 --2- 172.21.15.92:0/368290341 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee016bfdc0 0x55ee016ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:01.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.278+0000 7f0aa37fe640 1 --2- 172.21.15.92:0/3390759794 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f0a8c0a3240 0x7f0a8c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:01.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.278+0000 7f0aa8943640 1 -- 172.21.15.92:0/3390759794 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f0a940f0150 con 0x7f0aa41000d0 2024-09-19T08:57:01.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.278+0000 7f0aa27fc640 1 -- 172.21.15.92:0/368290341 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee016bfdc0 msgr2=0x55ee016ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:01.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.278+0000 7f0aa27fc640 1 --2- 172.21.15.92:0/368290341 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee016bfdc0 0x55ee016ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.278+0000 7f0aa27fc640 1 -- 172.21.15.92:0/368290341 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee016bf4a0 msgr2=0x55ee016bf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:01.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.278+0000 7f0aa27fc640 1 --2- 172.21.15.92:0/368290341 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee016bf4a0 0x55ee016bf880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.278+0000 7f0aa27fc640 1 -- 172.21.15.92:0/368290341 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee015b1440 con 0x55ee016ca680 2024-09-19T08:57:01.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.278+0000 7f0aa27fc640 1 --2- 172.21.15.92:0/368290341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee016ca680 0x55ee016cca70 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f0a98009a40 tx=0x7f0a98009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4a9e192278bb0b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:01.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.278+0000 7f0aa37fe640 1 --2- 172.21.15.92:0/3390759794 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f0a8c0a3240 0x7f0a8c0a5700 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c009900 tx=0x7f0a9c009650 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:01.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.278+0000 7f0a89ffb640 1 -- 172.21.15.92:0/368290341 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a98017070 con 0x55ee016ca680 2024-09-19T08:57:01.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.278+0000 7f0a89ffb640 1 -- 172.21.15.92:0/368290341 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a98013470 con 0x55ee016ca680 2024-09-19T08:57:01.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.278+0000 7f0a89ffb640 1 -- 172.21.15.92:0/368290341 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a98012630 con 0x55ee016ca680 2024-09-19T08:57:01.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.279+0000 7f0aabd1e740 1 -- 172.21.15.92:0/368290341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee016ca680 msgr2=0x55ee016cca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:01.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.279+0000 7f0aabd1e740 1 --2- 172.21.15.92:0/368290341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee016ca680 0x55ee016cca70 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f0a98009a40 tx=0x7f0a98009f00 comp rx=0 tx=0).stop 2024-09-19T08:57:01.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.279+0000 7f0aabd1e740 1 -- 172.21.15.92:0/368290341 shutdown_connections 2024-09-19T08:57:01.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.279+0000 7f0aabd1e740 1 --2- 172.21.15.92:0/368290341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee016ca680 0x55ee016cca70 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.279+0000 7f0aabd1e740 1 --2- 172.21.15.92:0/368290341 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee016bfdc0 0x55ee016ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.279+0000 7f0aabd1e740 1 --2- 172.21.15.92:0/368290341 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee016bf4a0 0x55ee016bf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.279+0000 7f0aabd1e740 1 -- 172.21.15.92:0/368290341 >> 172.21.15.92:0/368290341 conn(0x55ee016bba30 msgr2=0x55ee016bbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:01.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.279+0000 7f0aabd1e740 1 -- 172.21.15.92:0/368290341 shutdown_connections 2024-09-19T08:57:01.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.279+0000 7f0aabd1e740 1 -- 172.21.15.92:0/368290341 wait complete. 2024-09-19T08:57:01.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.279+0000 7f0aabd1e740 1 -- start start 2024-09-19T08:57:01.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.280+0000 7f0aabd1e740 1 Processor -- start 2024-09-19T08:57:01.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.280+0000 7f0aabd1e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee016bf4a0 0x55ee016c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:01.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.280+0000 7f0aabd1e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee016bfdc0 0x55ee016c7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:01.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.280+0000 7f0aabd1e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee016ca680 0x55ee016c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:01.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.280+0000 7f0aabd1e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ee016cd250 con 0x55ee016ca680 2024-09-19T08:57:01.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.280+0000 7f0aabd1e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ee015e0050 con 0x55ee016bf4a0 2024-09-19T08:57:01.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.280+0000 7f0aabd1e740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ee016cd3d0 con 0x55ee016bfdc0 2024-09-19T08:57:01.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.280+0000 7f0aabd1e740 10 client.0 _ll_register_callbacks cb 0x55ee01620160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:01.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.280+0000 7f0aa37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee016ca680 0x55ee016c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:01.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.280+0000 7f0aa37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee016ca680 0x55ee016c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47426/0 (socket says 172.21.15.92:47426) 2024-09-19T08:57:01.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.280+0000 7f0aa37fe640 1 -- 172.21.15.92:0/327869714 learned_addr learned my addr 172.21.15.92:0/327869714 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:01.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.280+0000 7f0aa2ffd640 1 --2- 172.21.15.92:0/327869714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee016bf4a0 0x55ee016c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:01.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.280+0000 7f0aa27fc640 1 --2- 172.21.15.92:0/327869714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee016bfdc0 0x55ee016c7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:01.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.280+0000 7f0aa37fe640 1 -- 172.21.15.92:0/327869714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee016bfdc0 msgr2=0x55ee016c7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:01.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.280+0000 7f0aa37fe640 1 --2- 172.21.15.92:0/327869714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee016bfdc0 0x55ee016c7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.280+0000 7f0aa37fe640 1 -- 172.21.15.92:0/327869714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee016bf4a0 msgr2=0x55ee016c9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:01.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.280+0000 7f0aa37fe640 1 --2- 172.21.15.92:0/327869714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee016bf4a0 0x55ee016c9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.280+0000 7f0aa37fe640 1 -- 172.21.15.92:0/327869714 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee013963c0 con 0x55ee016ca680 2024-09-19T08:57:01.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.280+0000 7f0aa37fe640 1 --2- 172.21.15.92:0/327869714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee016ca680 0x55ee016c7760 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c017e50 tx=0x7f0a9c004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fcb202b622e53cf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:01.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.280+0000 7f0a82ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:57:01.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.281+0000 7f0a82ffd640 1 -- 172.21.15.92:0/327869714 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c014040 con 0x55ee016ca680 2024-09-19T08:57:01.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.281+0000 7f0a82ffd640 1 -- 172.21.15.92:0/327869714 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f0a9c01bcd0 con 0x55ee016ca680 2024-09-19T08:57:01.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.281+0000 7f0aabd1e740 1 -- 172.21.15.92:0/327869714 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a98013470 con 0x55ee016ca680 2024-09-19T08:57:01.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.281+0000 7f0a82ffd640 1 -- 172.21.15.92:0/327869714 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f0a9c00be30 con 0x55ee016ca680 2024-09-19T08:57:01.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.281+0000 7f0aabd1e740 10 client.15390 fetch_fsmap learned FSMap version 19 2024-09-19T08:57:01.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.281+0000 7f0aabd1e740 1 -- 172.21.15.92:0/327869714 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ee016d8bc0 con 0x55ee016ca680 2024-09-19T08:57:01.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.281+0000 7f0a82ffd640 1 -- 172.21.15.92:0/327869714 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a98013470 con 0x55ee016ca680 2024-09-19T08:57:01.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.281+0000 7f0a82ffd640 1 -- 172.21.15.92:0/327869714 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f0a9c0253c0 con 0x55ee016ca680 2024-09-19T08:57:01.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.281+0000 7f0aabd1e740 10 client.15390 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:57:01.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.281+0000 7f0aabd1e740 10 client.15390 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:57:01.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.281+0000 7f0aabd1e740 20 client.15390 populate_metadata read hostname 'smithi092' 2024-09-19T08:57:01.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.281+0000 7f0aabd1e740 1 --2- 172.21.15.92:0/327869714 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ee016da080 0x55ee016dc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:01.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.281+0000 7f0aabd1e740 4 client.15390 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:57:01.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.281+0000 7f0aabd1e740 1 -- 172.21.15.92:0/327869714 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee01632850 con 0x55ee016da080 2024-09-19T08:57:01.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.282+0000 7f0aa2ffd640 1 --2- 172.21.15.92:0/327869714 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ee016da080 0x55ee016dc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:01.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.282+0000 7f0a82ffd640 10 client.15390 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:01.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.282+0000 7f0aa2ffd640 1 --2- 172.21.15.92:0/327869714 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ee016da080 0x55ee016dc520 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50a7d9bbb4f13c07 server_cookie=5f56f90a1095c4ee in_seq=0 out_seq=0 2024-09-19T08:57:01.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.283+0000 7f0a82ffd640 1 -- 172.21.15.92:0/327869714 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ee01632850 con 0x55ee016da080 2024-09-19T08:57:01.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.283+0000 7f0a82ffd640 10 client.15390 handle_command_reply: tid=0 2024-09-19T08:57:01.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.283+0000 7f0aabd1e740 1 client.15390 shutdown 2024-09-19T08:57:01.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.283+0000 7f0aabd1e740 1 -- 172.21.15.92:0/327869714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee016ca680 msgr2=0x55ee016c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:01.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.283+0000 7f0aabd1e740 1 --2- 172.21.15.92:0/327869714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee016ca680 0x55ee016c7760 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c017e50 tx=0x7f0a9c004b50 comp rx=0 tx=0).stop 2024-09-19T08:57:01.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.284+0000 7f0aabd1e740 1 -- 172.21.15.92:0/327869714 shutdown_connections 2024-09-19T08:57:01.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.284+0000 7f0aabd1e740 1 --2- 172.21.15.92:0/327869714 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ee016da080 0x55ee016dc520 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.284+0000 7f0a82ffd640 0 client.15390 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:01.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.284+0000 7f0aabd1e740 1 --2- 172.21.15.92:0/327869714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee016ca680 0x55ee016c7760 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.284+0000 7f0aabd1e740 1 --2- 172.21.15.92:0/327869714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee016bfdc0 0x55ee016c7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.284+0000 7f0aabd1e740 1 --2- 172.21.15.92:0/327869714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee016bf4a0 0x55ee016c9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.284+0000 7f0aabd1e740 1 -- 172.21.15.92:0/327869714 >> 172.21.15.92:0/327869714 conn(0x55ee016bba30 msgr2=0x55ee016c1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:01.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.284+0000 7f0aabd1e740 1 -- 172.21.15.92:0/327869714 shutdown_connections 2024-09-19T08:57:01.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.284+0000 7f0aabd1e740 1 -- 172.21.15.92:0/327869714 wait complete. 2024-09-19T08:57:01.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.284+0000 7f0aabd1e740 20 client.15390 trim_cache size 0 max 16384 2024-09-19T08:57:01.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.300+0000 7f0aabd1e740 1 Processor -- start 2024-09-19T08:57:01.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.300+0000 7f0aabd1e740 1 -- start start 2024-09-19T08:57:01.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.301+0000 7f0aabd1e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee016bf4a0 0x55ee016d64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:01.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.301+0000 7f0aabd1e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee016bfdc0 0x55ee016e1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:01.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.301+0000 7f0aabd1e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee016ca680 0x55ee016e2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:01.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.301+0000 7f0aabd1e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa41a9430 con 0x55ee016bf4a0 2024-09-19T08:57:01.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.301+0000 7f0aabd1e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa41abcb0 con 0x55ee016ca680 2024-09-19T08:57:01.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.301+0000 7f0aabd1e740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa41a9aa0 con 0x55ee016bfdc0 2024-09-19T08:57:01.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.301+0000 7f0aa2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee016bf4a0 0x55ee016d64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:01.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.301+0000 7f0aa2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee016bf4a0 0x55ee016d64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47428/0 (socket says 172.21.15.92:47428) 2024-09-19T08:57:01.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.301+0000 7f0aa2ffd640 1 -- 172.21.15.92:0/1279312147 learned_addr learned my addr 172.21.15.92:0/1279312147 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:01.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.301+0000 7f0aa27fc640 1 --2- 172.21.15.92:0/1279312147 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee016bfdc0 0x55ee016e1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:01.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.301+0000 7f0aa2ffd640 1 -- 172.21.15.92:0/1279312147 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee016bfdc0 msgr2=0x55ee016e1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:01.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.301+0000 7f0aa2ffd640 1 --2- 172.21.15.92:0/1279312147 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee016bfdc0 0x55ee016e1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.301+0000 7f0aa2ffd640 1 -- 172.21.15.92:0/1279312147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee016ca680 msgr2=0x55ee016e2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:01.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.301+0000 7f0aa37fe640 1 --2- 172.21.15.92:0/1279312147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee016ca680 0x55ee016e2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:01.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.301+0000 7f0aa2ffd640 1 --2- 172.21.15.92:0/1279312147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee016ca680 0x55ee016e2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.301+0000 7f0aa2ffd640 1 -- 172.21.15.92:0/1279312147 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee016bcba0 con 0x55ee016bf4a0 2024-09-19T08:57:01.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.301+0000 7f0aa37fe640 1 --2- 172.21.15.92:0/1279312147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee016ca680 0x55ee016e2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:57:01.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.301+0000 7f0aa2ffd640 1 --2- 172.21.15.92:0/1279312147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee016bf4a0 0x55ee016d64b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0a940b9140 tx=0x7f0a94049dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98a78462d92d55bf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:01.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.301+0000 7f0a897fa640 1 -- 172.21.15.92:0/1279312147 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a94049040 con 0x55ee016bf4a0 2024-09-19T08:57:01.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.302+0000 7f0a897fa640 1 -- 172.21.15.92:0/1279312147 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a9403be50 con 0x55ee016bf4a0 2024-09-19T08:57:01.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.302+0000 7f0a897fa640 1 -- 172.21.15.92:0/1279312147 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a940edd60 con 0x55ee016bf4a0 2024-09-19T08:57:01.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.302+0000 7f0aabd1e740 1 -- 172.21.15.92:0/1279312147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee016bf4a0 msgr2=0x55ee016d64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:01.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.302+0000 7f0aabd1e740 1 --2- 172.21.15.92:0/1279312147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee016bf4a0 0x55ee016d64b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0a940b9140 tx=0x7f0a94049dd0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.302+0000 7f0aabd1e740 1 -- 172.21.15.92:0/1279312147 shutdown_connections 2024-09-19T08:57:01.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.302+0000 7f0aabd1e740 1 --2- 172.21.15.92:0/1279312147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee016ca680 0x55ee016e2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.302+0000 7f0aabd1e740 1 --2- 172.21.15.92:0/1279312147 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee016bfdc0 0x55ee016e1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.302+0000 7f0aabd1e740 1 --2- 172.21.15.92:0/1279312147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee016bf4a0 0x55ee016d64b0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.302+0000 7f0aabd1e740 1 -- 172.21.15.92:0/1279312147 >> 172.21.15.92:0/1279312147 conn(0x55ee016bba30 msgr2=0x55ee016c2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:01.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.302+0000 7f0aabd1e740 1 -- 172.21.15.92:0/1279312147 shutdown_connections 2024-09-19T08:57:01.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.302+0000 7f0aabd1e740 1 -- 172.21.15.92:0/1279312147 wait complete. 2024-09-19T08:57:01.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.303+0000 7f0aabd1e740 1 -- start start 2024-09-19T08:57:01.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.303+0000 7f0aabd1e740 1 Processor -- start 2024-09-19T08:57:01.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.303+0000 7f0aabd1e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee016bf4a0 0x55ee016ce330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:01.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.303+0000 7f0aabd1e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee016bfdc0 0x55ee016ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:01.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.303+0000 7f0aabd1e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee016ca680 0x55ee016cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:01.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.303+0000 7f0aabd1e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa41aa170 con 0x55ee016ca680 2024-09-19T08:57:01.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.303+0000 7f0aabd1e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa41ab5e0 con 0x55ee016bf4a0 2024-09-19T08:57:01.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.303+0000 7f0aabd1e740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa41aa840 con 0x55ee016bfdc0 2024-09-19T08:57:01.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.303+0000 7f0aabd1e740 10 client.0 _ll_register_callbacks cb 0x7f0a9c009e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:01.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.303+0000 7f0aa37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee016ca680 0x55ee016cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:01.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.303+0000 7f0aa37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee016ca680 0x55ee016cedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47444/0 (socket says 172.21.15.92:47444) 2024-09-19T08:57:01.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.303+0000 7f0aa37fe640 1 -- 172.21.15.92:0/2719464605 learned_addr learned my addr 172.21.15.92:0/2719464605 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:01.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.303+0000 7f0aa2ffd640 1 --2- 172.21.15.92:0/2719464605 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee016bf4a0 0x55ee016ce330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:01.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.303+0000 7f0aa27fc640 1 --2- 172.21.15.92:0/2719464605 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee016bfdc0 0x55ee016ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:01.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.304+0000 7f0aa37fe640 1 -- 172.21.15.92:0/2719464605 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee016bfdc0 msgr2=0x55ee016ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:01.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.304+0000 7f0aa37fe640 1 --2- 172.21.15.92:0/2719464605 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee016bfdc0 0x55ee016ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.304+0000 7f0aa37fe640 1 -- 172.21.15.92:0/2719464605 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee016bf4a0 msgr2=0x55ee016ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:01.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.304+0000 7f0aa37fe640 1 --2- 172.21.15.92:0/2719464605 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee016bf4a0 0x55ee016ce330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.304+0000 7f0aa37fe640 1 -- 172.21.15.92:0/2719464605 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee01743e10 con 0x55ee016ca680 2024-09-19T08:57:01.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.304+0000 7f0aa37fe640 1 --2- 172.21.15.92:0/2719464605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee016ca680 0x55ee016cedb0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c0258b0 tx=0x7f0a9c025f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5c89ca0f4271551 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:01.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.304+0000 7f0a82ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:57:01.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.304+0000 7f0a82ffd640 1 -- 172.21.15.92:0/2719464605 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c035030 con 0x55ee016ca680 2024-09-19T08:57:01.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.304+0000 7f0a82ffd640 1 -- 172.21.15.92:0/2719464605 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f0a9c021040 con 0x55ee016ca680 2024-09-19T08:57:01.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.304+0000 7f0aabd1e740 1 -- 172.21.15.92:0/2719464605 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a9403be50 con 0x55ee016ca680 2024-09-19T08:57:01.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.304+0000 7f0a82ffd640 1 -- 172.21.15.92:0/2719464605 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f0a9c00baf0 con 0x55ee016ca680 2024-09-19T08:57:01.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.304+0000 7f0aabd1e740 10 client.15396 fetch_fsmap learned FSMap version 19 2024-09-19T08:57:01.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.304+0000 7f0aabd1e740 1 -- 172.21.15.92:0/2719464605 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ee01745020 con 0x55ee016ca680 2024-09-19T08:57:01.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.304+0000 7f0a82ffd640 1 -- 172.21.15.92:0/2719464605 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a9403be50 con 0x55ee016ca680 2024-09-19T08:57:01.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.304+0000 7f0a82ffd640 1 -- 172.21.15.92:0/2719464605 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f0a9c03bb80 con 0x55ee016ca680 2024-09-19T08:57:01.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.304+0000 7f0aabd1e740 10 client.15396 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:57:01.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.304+0000 7f0aabd1e740 10 client.15396 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:57:01.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.305+0000 7f0aabd1e740 20 client.15396 populate_metadata read hostname 'smithi092' 2024-09-19T08:57:01.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.305+0000 7f0aabd1e740 1 --2- 172.21.15.92:0/2719464605 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ee01745790 0x55ee01747b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:01.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.305+0000 7f0aabd1e740 4 client.15396 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:57:01.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.305+0000 7f0aabd1e740 1 -- 172.21.15.92:0/2719464605 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ee0162cd60 con 0x55ee01745790 2024-09-19T08:57:01.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.305+0000 7f0aa2ffd640 1 --2- 172.21.15.92:0/2719464605 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ee01745790 0x55ee01747b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:01.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.305+0000 7f0a82ffd640 10 client.15396 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:01.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.305+0000 7f0aa2ffd640 1 --2- 172.21.15.92:0/2719464605 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ee01745790 0x55ee01747b80 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db728aca0c24edfa server_cookie=4662242010dc200b in_seq=0 out_seq=0 2024-09-19T08:57:01.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.305+0000 7f0a82ffd640 1 -- 172.21.15.92:0/2719464605 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55ee0162cd60 con 0x55ee01745790 2024-09-19T08:57:01.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.305+0000 7f0a82ffd640 10 client.15396 handle_command_reply: tid=0 2024-09-19T08:57:01.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.305+0000 7f0aabd1e740 1 client.15396 shutdown 2024-09-19T08:57:01.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.306+0000 7f0aabd1e740 1 -- 172.21.15.92:0/2719464605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee016ca680 msgr2=0x55ee016cedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:01.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.306+0000 7f0aabd1e740 1 --2- 172.21.15.92:0/2719464605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee016ca680 0x55ee016cedb0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c0258b0 tx=0x7f0a9c025f00 comp rx=0 tx=0).stop 2024-09-19T08:57:01.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.306+0000 7f0aabd1e740 1 -- 172.21.15.92:0/2719464605 shutdown_connections 2024-09-19T08:57:01.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.306+0000 7f0aabd1e740 1 --2- 172.21.15.92:0/2719464605 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ee01745790 0x55ee01747b80 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.306+0000 7f0aabd1e740 1 --2- 172.21.15.92:0/2719464605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee016ca680 0x55ee016cedb0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.306+0000 7f0aabd1e740 1 --2- 172.21.15.92:0/2719464605 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee016bfdc0 0x55ee016ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.306+0000 7f0aabd1e740 1 --2- 172.21.15.92:0/2719464605 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee016bf4a0 0x55ee016ce330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.306+0000 7f0a82ffd640 0 client.15396 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:01.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.306+0000 7f0aabd1e740 1 -- 172.21.15.92:0/2719464605 >> 172.21.15.92:0/2719464605 conn(0x55ee016bba30 msgr2=0x55ee016c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:01.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.306+0000 7f0aabd1e740 1 -- 172.21.15.92:0/2719464605 shutdown_connections 2024-09-19T08:57:01.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.306+0000 7f0aabd1e740 1 -- 172.21.15.92:0/2719464605 wait complete. 2024-09-19T08:57:01.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.306+0000 7f0aabd1e740 20 client.15396 trim_cache size 0 max 16384 2024-09-19T08:57:01.321 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T08:57:01.321 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T08:57:01.321 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": { 2024-09-19T08:57:01.322 INFO:teuthology.orchestra.run.smithi092.stdout: "a821964f-f5c7-4c37-bf83-3bbf27f19261": { 2024-09-19T08:57:01.322 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-19T08:57:01.322 INFO:teuthology.orchestra.run.smithi092.stdout: "tag": "a821964f-f5c7-4c37-bf83-3bbf27f19261", 2024-09-19T08:57:01.322 INFO:teuthology.orchestra.run.smithi092.stdout: "options": "recursive,force" 2024-09-19T08:57:01.322 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:57:01.322 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:57:01.322 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T08:57:01.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.306+0000 7f0aa9945640 1 -- 172.21.15.92:0/3390759794 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f0a8c0a3240 msgr2=0x7f0a8c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:01.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.306+0000 7f0aa9945640 1 --2- 172.21.15.92:0/3390759794 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f0a8c0a3240 0x7f0a8c0a5700 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c009900 tx=0x7f0a9c009650 comp rx=0 tx=0).stop 2024-09-19T08:57:01.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.306+0000 7f0aa9945640 1 -- 172.21.15.92:0/3390759794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0aa41000d0 msgr2=0x7f0aa41985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:01.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.306+0000 7f0aa9945640 1 --2- 172.21.15.92:0/3390759794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0aa41000d0 0x7f0aa41985a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0a94006010 tx=0x7f0a94003c80 comp rx=0 tx=0).stop 2024-09-19T08:57:01.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.306+0000 7f0aa9945640 1 -- 172.21.15.92:0/3390759794 shutdown_connections 2024-09-19T08:57:01.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.306+0000 7f0aa9945640 1 --2- 172.21.15.92:0/3390759794 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0aa4106ba0 0x7f0aa419ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.306+0000 7f0aa9945640 1 --2- 172.21.15.92:0/3390759794 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0aa4100a70 0x7f0aa4198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.306+0000 7f0aa9945640 1 --2- 172.21.15.92:0/3390759794 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f0a8c0a3240 0x7f0a8c0a5700 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.306+0000 7f0aa9945640 1 --2- 172.21.15.92:0/3390759794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0aa41000d0 0x7f0aa41985a0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.306+0000 7f0aa9945640 1 -- 172.21.15.92:0/3390759794 >> 172.21.15.92:0/3390759794 conn(0x7f0aa4077210 msgr2=0x7f0aa4104bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:01.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.306+0000 7f0aa9945640 1 -- 172.21.15.92:0/3390759794 shutdown_connections 2024-09-19T08:57:01.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:01.306+0000 7f0aa9945640 1 -- 172.21.15.92:0/3390759794 wait complete. 2024-09-19T08:57:01.424 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:57:01.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:01 smithi092 ceph-mon[31407]: scrub queued for path: / 2024-09-19T08:57:01.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:01 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T08:57:01.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:01 smithi092 ceph-mon[31407]: scrub summary: active paths [/] 2024-09-19T08:57:01.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:01 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T08:57:01.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:01 smithi092 ceph-mon[31407]: pgmap v346: 97 pgs: 97 active+clean; 927 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 19 MiB/s wr, 833 op/s 2024-09-19T08:57:01.654 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:01 smithi167 ceph-mon[35359]: scrub queued for path: / 2024-09-19T08:57:01.654 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:01 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T08:57:01.655 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:01 smithi167 ceph-mon[35359]: scrub summary: active paths [/] 2024-09-19T08:57:01.655 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:01 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T08:57:01.656 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:01 smithi167 ceph-mon[35359]: pgmap v346: 97 pgs: 97 active+clean; 927 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 19 MiB/s wr, 833 op/s 2024-09-19T08:57:01.676 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:01 smithi190 ceph-mon[35358]: scrub queued for path: / 2024-09-19T08:57:01.676 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:01 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T08:57:01.676 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:01 smithi190 ceph-mon[35358]: scrub summary: active paths [/] 2024-09-19T08:57:01.676 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:01 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T08:57:01.676 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:01 smithi190 ceph-mon[35358]: pgmap v346: 97 pgs: 97 active+clean; 927 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 19 MiB/s wr, 833 op/s 2024-09-19T08:57:02.037 INFO:tasks.cephfs.filesystem:scrub status for tag:a821964f-f5c7-4c37-bf83-3bbf27f19261 - {'path': '/', 'tag': 'a821964f-f5c7-4c37-bf83-3bbf27f19261', 'options': 'recursive,force'} 2024-09-19T08:57:02.073 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:57:02.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.519+0000 7f00e541d640 1 -- 172.21.15.92:0/2064174379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00e010c180 msgr2=0x7f00e010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:02.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.519+0000 7f00e541d640 1 --2- 172.21.15.92:0/2064174379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00e010c180 0x7f00e010e610 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f00d8009ca0 tx=0x7f00d802a950 comp rx=0 tx=0).stop 2024-09-19T08:57:02.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.519+0000 7f00e541d640 1 -- 172.21.15.92:0/2064174379 shutdown_connections 2024-09-19T08:57:02.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.519+0000 7f00e541d640 1 --2- 172.21.15.92:0/2064174379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00e010c180 0x7f00e010e610 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:02.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.519+0000 7f00e541d640 1 --2- 172.21.15.92:0/2064174379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00e0103700 0x7f00e010bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:02.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.519+0000 7f00e541d640 1 --2- 172.21.15.92:0/2064174379 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00e0102de0 0x7f00e01031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:02.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.520+0000 7f00e541d640 1 -- 172.21.15.92:0/2064174379 >> 172.21.15.92:0/2064174379 conn(0x7f00e00fc7a0 msgr2=0x7f00e00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:02.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.520+0000 7f00e541d640 1 -- 172.21.15.92:0/2064174379 shutdown_connections 2024-09-19T08:57:02.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.520+0000 7f00e541d640 1 -- 172.21.15.92:0/2064174379 wait complete. 2024-09-19T08:57:02.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.520+0000 7f00e541d640 1 Processor -- start 2024-09-19T08:57:02.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.520+0000 7f00e541d640 1 -- start start 2024-09-19T08:57:02.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.521+0000 7f00e541d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00e0102de0 0x7f00e0198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:02.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.521+0000 7f00e541d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00e0103700 0x7f00e0198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:02.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.521+0000 7f00e541d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00e010c180 0x7f00e019ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:02.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.521+0000 7f00e541d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f00e0112030 con 0x7f00e0103700 2024-09-19T08:57:02.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.521+0000 7f00e541d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f00e0111eb0 con 0x7f00e010c180 2024-09-19T08:57:02.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.521+0000 7f00e541d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f00e01121b0 con 0x7f00e0102de0 2024-09-19T08:57:02.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.521+0000 7f00de7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00e0103700 0x7f00e0198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:02.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.521+0000 7f00de7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00e0103700 0x7f00e0198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34386/0 (socket says 172.21.15.92:34386) 2024-09-19T08:57:02.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.521+0000 7f00de7fc640 1 -- 172.21.15.92:0/381312649 learned_addr learned my addr 172.21.15.92:0/381312649 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:02.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.521+0000 7f00deffd640 1 --2- 172.21.15.92:0/381312649 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00e0102de0 0x7f00e0198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:02.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.521+0000 7f00df7fe640 1 --2- 172.21.15.92:0/381312649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00e010c180 0x7f00e019ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:02.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.521+0000 7f00de7fc640 1 -- 172.21.15.92:0/381312649 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00e0102de0 msgr2=0x7f00e0198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:02.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.521+0000 7f00de7fc640 1 --2- 172.21.15.92:0/381312649 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00e0102de0 0x7f00e0198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:02.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.521+0000 7f00de7fc640 1 -- 172.21.15.92:0/381312649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00e010c180 msgr2=0x7f00e019ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:02.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.521+0000 7f00de7fc640 1 --2- 172.21.15.92:0/381312649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00e010c180 0x7f00e019ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:02.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.521+0000 7f00de7fc640 1 -- 172.21.15.92:0/381312649 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e019d4f0 con 0x7f00e0103700 2024-09-19T08:57:02.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.521+0000 7f00deffd640 1 --2- 172.21.15.92:0/381312649 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00e0102de0 0x7f00e0198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:57:02.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.521+0000 7f00de7fc640 1 --2- 172.21.15.92:0/381312649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00e0103700 0x7f00e0198a80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f00c800b4a0 tx=0x7f00c800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:02.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.521+0000 7f00d7fff640 1 -- 172.21.15.92:0/381312649 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c8014070 con 0x7f00e0103700 2024-09-19T08:57:02.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.522+0000 7f00e541d640 1 -- 172.21.15.92:0/381312649 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00e019d7e0 con 0x7f00e0103700 2024-09-19T08:57:02.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.522+0000 7f00d7fff640 1 -- 172.21.15.92:0/381312649 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00c8010af0 con 0x7f00e0103700 2024-09-19T08:57:02.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.522+0000 7f00d7fff640 1 -- 172.21.15.92:0/381312649 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c8017d10 con 0x7f00e0103700 2024-09-19T08:57:02.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.522+0000 7f00e541d640 1 -- 172.21.15.92:0/381312649 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00e01a50c0 con 0x7f00e0103700 2024-09-19T08:57:02.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.522+0000 7f00e541d640 1 -- 172.21.15.92:0/381312649 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00e0103240 con 0x7f00e0103700 2024-09-19T08:57:02.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.524+0000 7f00d7fff640 1 -- 172.21.15.92:0/381312649 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f00c8017070 con 0x7f00e0103700 2024-09-19T08:57:02.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.525+0000 7f00d7fff640 1 --2- 172.21.15.92:0/381312649 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f00cc0a3240 0x7f00cc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:02.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.525+0000 7f00deffd640 1 --2- 172.21.15.92:0/381312649 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f00cc0a3240 0x7f00cc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:02.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.525+0000 7f00d7fff640 1 -- 172.21.15.92:0/381312649 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f00c80cf160 con 0x7f00e0103700 2024-09-19T08:57:02.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.525+0000 7f00deffd640 1 --2- 172.21.15.92:0/381312649 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f00cc0a3240 0x7f00cc0a5700 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f00d0009930 tx=0x7f00d0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:02.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.528+0000 7f00d7fff640 1 -- 172.21.15.92:0/381312649 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f00c809be40 con 0x7f00e0103700 2024-09-19T08:57:02.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.729+0000 7f00e541d640 1 -- 172.21.15.92:0/381312649 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00e0106cb0 con 0x7f00e0103700 2024-09-19T08:57:02.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.730+0000 7f00d7fff640 1 -- 172.21.15.92:0/381312649 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f00c809b740 con 0x7f00e0103700 2024-09-19T08:57:02.731 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:57:02.731 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T08:57:02.731 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T08:57:02.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.732+0000 7f00e541d640 1 -- 172.21.15.92:0/381312649 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f00cc0a3240 msgr2=0x7f00cc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:02.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.732+0000 7f00e541d640 1 --2- 172.21.15.92:0/381312649 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f00cc0a3240 0x7f00cc0a5700 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f00d0009930 tx=0x7f00d0008040 comp rx=0 tx=0).stop 2024-09-19T08:57:02.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.732+0000 7f00e541d640 1 -- 172.21.15.92:0/381312649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00e0103700 msgr2=0x7f00e0198a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:02.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.732+0000 7f00e541d640 1 --2- 172.21.15.92:0/381312649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00e0103700 0x7f00e0198a80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f00c800b4a0 tx=0x7f00c800b960 comp rx=0 tx=0).stop 2024-09-19T08:57:02.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.732+0000 7f00e541d640 1 -- 172.21.15.92:0/381312649 shutdown_connections 2024-09-19T08:57:02.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.732+0000 7f00e541d640 1 --2- 172.21.15.92:0/381312649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00e010c180 0x7f00e019ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:02.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.732+0000 7f00e541d640 1 --2- 172.21.15.92:0/381312649 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f00cc0a3240 0x7f00cc0a5700 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:02.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.732+0000 7f00e541d640 1 --2- 172.21.15.92:0/381312649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00e0103700 0x7f00e0198a80 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:02.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.732+0000 7f00e541d640 1 --2- 172.21.15.92:0/381312649 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00e0102de0 0x7f00e0198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:02.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.732+0000 7f00e541d640 1 -- 172.21.15.92:0/381312649 >> 172.21.15.92:0/381312649 conn(0x7f00e00fc7a0 msgr2=0x7f00e00fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:02.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.733+0000 7f00e541d640 1 -- 172.21.15.92:0/381312649 shutdown_connections 2024-09-19T08:57:02.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:02.733+0000 7f00e541d640 1 -- 172.21.15.92:0/381312649 wait complete. 2024-09-19T08:57:03.297 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id d86dc111 --release --await' 2024-09-19T08:57:03.297 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id d86dc111 --release --await 2024-09-19T08:57:03.584 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:57:03.704 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:03 smithi092 ceph-mon[31407]: pgmap v347: 97 pgs: 97 active+clean; 927 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 11 MiB/s wr, 722 op/s 2024-09-19T08:57:03.704 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:03 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/381312649' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:57:03.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:03 smithi167 ceph-mon[35359]: pgmap v347: 97 pgs: 97 active+clean; 927 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 11 MiB/s wr, 722 op/s 2024-09-19T08:57:03.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:03 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/381312649' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:57:03.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:03 smithi190 ceph-mon[35358]: pgmap v347: 97 pgs: 97 active+clean; 927 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 11 MiB/s wr, 722 op/s 2024-09-19T08:57:03.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:03 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/381312649' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:57:04.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.033+0000 7f873b9ec640 1 -- 172.21.15.92:0/2411965607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8734106b70 msgr2=0x7f8734106f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:04.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.033+0000 7f873b9ec640 1 --2- 172.21.15.92:0/2411965607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8734106b70 0x7f8734106f50 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8724009ca0 tx=0x7f872402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.033+0000 7f873b9ec640 1 -- 172.21.15.92:0/2411965607 shutdown_connections 2024-09-19T08:57:04.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.033+0000 7f873b9ec640 1 --2- 172.21.15.92:0/2411965607 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8734100a50 0x7f87341057e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.033+0000 7f873b9ec640 1 --2- 172.21.15.92:0/2411965607 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8734100090 0x7f8734100510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.033+0000 7f873b9ec640 1 --2- 172.21.15.92:0/2411965607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8734106b70 0x7f8734106f50 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.033+0000 7f873b9ec640 1 -- 172.21.15.92:0/2411965607 >> 172.21.15.92:0/2411965607 conn(0x7f8734077210 msgr2=0x7f87340fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:04.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.033+0000 7f873b9ec640 1 -- 172.21.15.92:0/2411965607 shutdown_connections 2024-09-19T08:57:04.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.033+0000 7f873b9ec640 1 -- 172.21.15.92:0/2411965607 wait complete. 2024-09-19T08:57:04.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.034+0000 7f873b9ec640 1 Processor -- start 2024-09-19T08:57:04.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.034+0000 7f873b9ec640 1 -- start start 2024-09-19T08:57:04.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.034+0000 7f873b9ec640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8734100090 0x7f87341a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:04.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.034+0000 7f873b9ec640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8734100a50 0x7f87341a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:04.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.034+0000 7f873b9ec640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8734106b70 0x7f873419e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:04.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.034+0000 7f873b9ec640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f87341185c0 con 0x7f8734106b70 2024-09-19T08:57:04.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.034+0000 7f873b9ec640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8734118440 con 0x7f8734100090 2024-09-19T08:57:04.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.034+0000 7f873b9ec640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8734118740 con 0x7f8734100a50 2024-09-19T08:57:04.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.034+0000 7f8739f89640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8734106b70 0x7f873419e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:04.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.034+0000 7f8739f89640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8734106b70 0x7f873419e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34412/0 (socket says 172.21.15.92:34412) 2024-09-19T08:57:04.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.034+0000 7f8739f89640 1 -- 172.21.15.92:0/2767924631 learned_addr learned my addr 172.21.15.92:0/2767924631 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:04.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.034+0000 7f8738f87640 1 --2- 172.21.15.92:0/2767924631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8734100a50 0x7f87341a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:04.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.034+0000 7f8739788640 1 --2- 172.21.15.92:0/2767924631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8734100090 0x7f87341a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:04.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.035+0000 7f8739f89640 1 -- 172.21.15.92:0/2767924631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8734100a50 msgr2=0x7f87341a4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:04.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.035+0000 7f8739f89640 1 --2- 172.21.15.92:0/2767924631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8734100a50 0x7f87341a4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.035+0000 7f8739f89640 1 -- 172.21.15.92:0/2767924631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8734100090 msgr2=0x7f87341a46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:04.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.035+0000 7f8739f89640 1 --2- 172.21.15.92:0/2767924631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8734100090 0x7f87341a46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.035+0000 7f8739f89640 1 -- 172.21.15.92:0/2767924631 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f873419efa0 con 0x7f8734106b70 2024-09-19T08:57:04.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.035+0000 7f8739788640 1 --2- 172.21.15.92:0/2767924631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8734100090 0x7f87341a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:57:04.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.035+0000 7f8739f89640 1 --2- 172.21.15.92:0/2767924631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8734106b70 0x7f873419e870 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f872c00d720 tx=0x7f872c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:04.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.035+0000 7f87327fc640 1 -- 172.21.15.92:0/2767924631 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872c017030 con 0x7f8734106b70 2024-09-19T08:57:04.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.035+0000 7f873b9ec640 1 -- 172.21.15.92:0/2767924631 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f873419f290 con 0x7f8734106b70 2024-09-19T08:57:04.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.035+0000 7f87327fc640 1 -- 172.21.15.92:0/2767924631 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f872c00de30 con 0x7f8734106b70 2024-09-19T08:57:04.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.035+0000 7f87327fc640 1 -- 172.21.15.92:0/2767924631 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872c004bc0 con 0x7f8734106b70 2024-09-19T08:57:04.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.035+0000 7f873b9ec640 1 -- 172.21.15.92:0/2767924631 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87341ab580 con 0x7f8734106b70 2024-09-19T08:57:04.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.038+0000 7f87327fc640 1 -- 172.21.15.92:0/2767924631 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f872c01a070 con 0x7f8734106b70 2024-09-19T08:57:04.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.038+0000 7f873ddc5740 1 Processor -- start 2024-09-19T08:57:04.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.038+0000 7f873ddc5740 1 -- start start 2024-09-19T08:57:04.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.038+0000 7f873ddc5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55aeb2683060 0x55aeb2683440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:04.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.039+0000 7f873ddc5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aeb2683980 0x55aeb268dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:04.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.039+0000 7f873ddc5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeb268e240 0x55aeb2690630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:04.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.039+0000 7f87327fc640 1 --2- 172.21.15.92:0/2767924631 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f871c0a3240 0x7f871c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:04.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.039+0000 7f873ddc5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55aeb25e8620 con 0x55aeb268e240 2024-09-19T08:57:04.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.039+0000 7f873ddc5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55aeb258fe50 con 0x55aeb2683980 2024-09-19T08:57:04.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.039+0000 7f873ddc5740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55aeb25e45e0 con 0x55aeb2683060 2024-09-19T08:57:04.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.039+0000 7f8738f87640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeb268e240 0x55aeb2690630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:04.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.039+0000 7f8738f87640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeb268e240 0x55aeb2690630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34428/0 (socket says 172.21.15.92:34428) 2024-09-19T08:57:04.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.039+0000 7f8738f87640 1 -- 172.21.15.92:0/2860859240 learned_addr learned my addr 172.21.15.92:0/2860859240 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:04.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.039+0000 7f8738f87640 1 --2- 172.21.15.92:0/2860859240 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55aeb2683060 0x55aeb2683440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:04.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.039+0000 7f8739788640 1 --2- 172.21.15.92:0/2860859240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aeb2683980 0x55aeb268dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:04.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.039+0000 7f87327fc640 1 -- 172.21.15.92:0/2767924631 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f872c0cf490 con 0x7f8734106b70 2024-09-19T08:57:04.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.039+0000 7f8739f89640 1 --2- 172.21.15.92:0/2767924631 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f871c0a3240 0x7f871c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:04.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.039+0000 7f8738f87640 1 -- 172.21.15.92:0/2860859240 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55aeb2683060 msgr2=0x55aeb2683440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:04.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.039+0000 7f8738f87640 1 --2- 172.21.15.92:0/2860859240 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55aeb2683060 0x55aeb2683440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.039+0000 7f8738f87640 1 -- 172.21.15.92:0/2860859240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aeb2683980 msgr2=0x55aeb268dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:04.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.039+0000 7f8738f87640 1 --2- 172.21.15.92:0/2860859240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aeb2683980 0x55aeb268dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.039+0000 7f8738f87640 1 -- 172.21.15.92:0/2860859240 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aeb2580d40 con 0x55aeb268e240 2024-09-19T08:57:04.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.039+0000 7f8738f87640 1 --2- 172.21.15.92:0/2860859240 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeb268e240 0x55aeb2690630 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f872800bf00 tx=0x7f8728004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c39c3bbe7dbf19b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:04.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.039+0000 7f8739f89640 1 --2- 172.21.15.92:0/2767924631 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f871c0a3240 0x7f871c0a5700 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f872c009610 tx=0x7f872c0046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:04.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.040+0000 7f871b7fe640 1 -- 172.21.15.92:0/2860859240 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8728004030 con 0x55aeb268e240 2024-09-19T08:57:04.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.040+0000 7f871b7fe640 1 -- 172.21.15.92:0/2860859240 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8728005500 con 0x55aeb268e240 2024-09-19T08:57:04.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.040+0000 7f871b7fe640 1 -- 172.21.15.92:0/2860859240 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8728004e10 con 0x55aeb268e240 2024-09-19T08:57:04.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.040+0000 7f873ddc5740 1 -- 172.21.15.92:0/2860859240 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeb268e240 msgr2=0x55aeb2690630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:04.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.040+0000 7f873ddc5740 1 --2- 172.21.15.92:0/2860859240 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeb268e240 0x55aeb2690630 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f872800bf00 tx=0x7f8728004730 comp rx=0 tx=0).stop 2024-09-19T08:57:04.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.040+0000 7f873ddc5740 1 -- 172.21.15.92:0/2860859240 shutdown_connections 2024-09-19T08:57:04.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.040+0000 7f873ddc5740 1 --2- 172.21.15.92:0/2860859240 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeb268e240 0x55aeb2690630 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.040+0000 7f873ddc5740 1 --2- 172.21.15.92:0/2860859240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aeb2683980 0x55aeb268dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.040+0000 7f873ddc5740 1 --2- 172.21.15.92:0/2860859240 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55aeb2683060 0x55aeb2683440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.040+0000 7f873ddc5740 1 -- 172.21.15.92:0/2860859240 >> 172.21.15.92:0/2860859240 conn(0x55aeb267f5f0 msgr2=0x55aeb267f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:04.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.040+0000 7f873ddc5740 1 -- 172.21.15.92:0/2860859240 shutdown_connections 2024-09-19T08:57:04.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.040+0000 7f873ddc5740 1 -- 172.21.15.92:0/2860859240 wait complete. 2024-09-19T08:57:04.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.041+0000 7f873ddc5740 1 -- start start 2024-09-19T08:57:04.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.041+0000 7f873ddc5740 1 Processor -- start 2024-09-19T08:57:04.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.041+0000 7f873ddc5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55aeb2683060 0x55aeb268b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:04.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.041+0000 7f873ddc5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeb2683980 0x55aeb268b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:04.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.041+0000 7f873ddc5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aeb268e240 0x55aeb268bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:04.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.041+0000 7f873ddc5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55aeb2690e10 con 0x55aeb2683980 2024-09-19T08:57:04.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.041+0000 7f873ddc5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55aeb2570f10 con 0x55aeb268e240 2024-09-19T08:57:04.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.041+0000 7f873ddc5740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55aeb2690f90 con 0x55aeb2683060 2024-09-19T08:57:04.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.041+0000 7f873ddc5740 10 client.0 _ll_register_callbacks cb 0x55aeb2594db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:04.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.041+0000 7f8739788640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeb2683980 0x55aeb268b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:04.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.041+0000 7f8739788640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeb2683980 0x55aeb268b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34438/0 (socket says 172.21.15.92:34438) 2024-09-19T08:57:04.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.041+0000 7f8739788640 1 -- 172.21.15.92:0/2756568530 learned_addr learned my addr 172.21.15.92:0/2756568530 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:04.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.042+0000 7f8738f87640 1 --2- 172.21.15.92:0/2756568530 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aeb268e240 0x55aeb268bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:04.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.042+0000 7f8739788640 1 -- 172.21.15.92:0/2756568530 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55aeb2683060 msgr2=0x55aeb268b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:04.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.042+0000 7f8739788640 1 --2- 172.21.15.92:0/2756568530 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55aeb2683060 0x55aeb268b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.042+0000 7f8739788640 1 -- 172.21.15.92:0/2756568530 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aeb268e240 msgr2=0x55aeb268bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:04.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.042+0000 7f8739788640 1 --2- 172.21.15.92:0/2756568530 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aeb268e240 0x55aeb268bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.042+0000 7f8739788640 1 -- 172.21.15.92:0/2756568530 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aeb22f7580 con 0x55aeb2683980 2024-09-19T08:57:04.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.042+0000 7f8738f87640 1 --2- 172.21.15.92:0/2756568530 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aeb268e240 0x55aeb268bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:57:04.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.042+0000 7f8739788640 1 --2- 172.21.15.92:0/2756568530 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeb2683980 0x55aeb268b6c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8724009ca0 tx=0x7f8724003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f71cc6d9281696fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:04.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.042+0000 7f8718ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:57:04.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.042+0000 7f8718ff9640 1 -- 172.21.15.92:0/2756568530 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8724049060 con 0x55aeb2683980 2024-09-19T08:57:04.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.042+0000 7f8718ff9640 1 -- 172.21.15.92:0/2756568530 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8724031450 con 0x55aeb2683980 2024-09-19T08:57:04.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.042+0000 7f873ddc5740 1 -- 172.21.15.92:0/2756568530 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8728005500 con 0x55aeb2683980 2024-09-19T08:57:04.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.042+0000 7f8718ff9640 1 -- 172.21.15.92:0/2756568530 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8724031650 con 0x55aeb2683980 2024-09-19T08:57:04.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.042+0000 7f873ddc5740 10 client.15414 fetch_fsmap learned FSMap version 19 2024-09-19T08:57:04.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.042+0000 7f873ddc5740 1 -- 172.21.15.92:0/2756568530 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55aeb23c1960 con 0x55aeb2683980 2024-09-19T08:57:04.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.042+0000 7f8718ff9640 1 -- 172.21.15.92:0/2756568530 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8728005500 con 0x55aeb2683980 2024-09-19T08:57:04.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.043+0000 7f8718ff9640 1 -- 172.21.15.92:0/2756568530 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f872404e070 con 0x55aeb2683980 2024-09-19T08:57:04.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.043+0000 7f873ddc5740 10 client.15414 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:57:04.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.043+0000 7f873ddc5740 10 client.15414 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T08:57:04.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.043+0000 7f873ddc5740 20 client.15414 populate_metadata read hostname 'smithi092' 2024-09-19T08:57:04.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.043+0000 7f873ddc5740 1 --2- 172.21.15.92:0/2756568530 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55aeb269de00 0x55aeb26a0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:04.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.043+0000 7f873ddc5740 4 client.15414 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:57:04.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.043+0000 7f873ddc5740 1 -- 172.21.15.92:0/2756568530 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aeb25f5b90 con 0x55aeb269de00 2024-09-19T08:57:04.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.043+0000 7f8738f87640 1 --2- 172.21.15.92:0/2756568530 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55aeb269de00 0x55aeb26a0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:04.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.043+0000 7f8718ff9640 10 client.15414 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:04.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.043+0000 7f8738f87640 1 --2- 172.21.15.92:0/2756568530 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55aeb269de00 0x55aeb26a0280 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6424610b102e5d25 server_cookie=a2f41341806ac9c6 in_seq=0 out_seq=0 2024-09-19T08:57:04.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.044+0000 7f8718ff9640 1 -- 172.21.15.92:0/2756568530 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55aeb25f5b90 con 0x55aeb269de00 2024-09-19T08:57:04.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.044+0000 7f8718ff9640 10 client.15414 handle_command_reply: tid=0 2024-09-19T08:57:04.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.044+0000 7f873ddc5740 1 client.15414 shutdown 2024-09-19T08:57:04.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.044+0000 7f873ddc5740 1 -- 172.21.15.92:0/2756568530 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeb2683980 msgr2=0x55aeb268b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:04.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.044+0000 7f873ddc5740 1 --2- 172.21.15.92:0/2756568530 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeb2683980 0x55aeb268b6c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8724009ca0 tx=0x7f8724003970 comp rx=0 tx=0).stop 2024-09-19T08:57:04.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.044+0000 7f873ddc5740 1 -- 172.21.15.92:0/2756568530 shutdown_connections 2024-09-19T08:57:04.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.044+0000 7f873ddc5740 1 --2- 172.21.15.92:0/2756568530 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55aeb269de00 0x55aeb26a0280 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.044+0000 7f873ddc5740 1 --2- 172.21.15.92:0/2756568530 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aeb268e240 0x55aeb268bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.044+0000 7f873ddc5740 1 --2- 172.21.15.92:0/2756568530 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeb2683980 0x55aeb268b6c0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.044+0000 7f8718ff9640 0 client.15414 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:04.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.044+0000 7f873ddc5740 1 --2- 172.21.15.92:0/2756568530 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55aeb2683060 0x55aeb268b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.044+0000 7f873ddc5740 1 -- 172.21.15.92:0/2756568530 >> 172.21.15.92:0/2756568530 conn(0x55aeb267f5f0 msgr2=0x55aeb26852d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:04.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.044+0000 7f873ddc5740 1 -- 172.21.15.92:0/2756568530 shutdown_connections 2024-09-19T08:57:04.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.044+0000 7f873ddc5740 1 -- 172.21.15.92:0/2756568530 wait complete. 2024-09-19T08:57:04.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.045+0000 7f873ddc5740 20 client.15414 trim_cache size 0 max 16384 2024-09-19T08:57:04.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.061+0000 7f873ddc5740 1 Processor -- start 2024-09-19T08:57:04.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.061+0000 7f873ddc5740 1 -- start start 2024-09-19T08:57:04.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.061+0000 7f873ddc5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeb2683060 0x55aeb267fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:04.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.061+0000 7f873ddc5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55aeb2683980 0x55aeb26a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:04.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.061+0000 7f873ddc5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aeb268e240 0x55aeb26a6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:04.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.061+0000 7f873ddc5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f87341b1c00 con 0x55aeb2683060 2024-09-19T08:57:04.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.061+0000 7f873ddc5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f87341b44a0 con 0x55aeb268e240 2024-09-19T08:57:04.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.061+0000 7f873ddc5740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f87341b2290 con 0x55aeb2683980 2024-09-19T08:57:04.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.061+0000 7f8738f87640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeb2683060 0x55aeb267fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:04.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.061+0000 7f8738f87640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeb2683060 0x55aeb267fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34454/0 (socket says 172.21.15.92:34454) 2024-09-19T08:57:04.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.062+0000 7f8738f87640 1 -- 172.21.15.92:0/4191202116 learned_addr learned my addr 172.21.15.92:0/4191202116 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:04.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.062+0000 7f8738f87640 1 --2- 172.21.15.92:0/4191202116 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aeb268e240 0x55aeb26a6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:04.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.062+0000 7f8738f87640 1 -- 172.21.15.92:0/4191202116 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55aeb2683980 msgr2=0x55aeb26a5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:04.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.062+0000 7f8738f87640 1 --2- 172.21.15.92:0/4191202116 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55aeb2683980 0x55aeb26a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.062+0000 7f8738f87640 1 -- 172.21.15.92:0/4191202116 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aeb268e240 msgr2=0x55aeb26a6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:04.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.062+0000 7f8738f87640 1 --2- 172.21.15.92:0/4191202116 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aeb268e240 0x55aeb26a6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.062+0000 7f8738f87640 1 -- 172.21.15.92:0/4191202116 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aeb267f090 con 0x55aeb2683060 2024-09-19T08:57:04.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.062+0000 7f8738f87640 1 --2- 172.21.15.92:0/4191202116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeb2683060 0x55aeb267fc00 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f8728010bd0 tx=0x7f8728004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c190e6fb1a188c98 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:04.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.062+0000 7f871affd640 1 -- 172.21.15.92:0/4191202116 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8728012450 con 0x55aeb2683060 2024-09-19T08:57:04.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.062+0000 7f871affd640 1 -- 172.21.15.92:0/4191202116 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8728012ad0 con 0x55aeb2683060 2024-09-19T08:57:04.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.062+0000 7f871affd640 1 -- 172.21.15.92:0/4191202116 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87280267f0 con 0x55aeb2683060 2024-09-19T08:57:04.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.063+0000 7f873ddc5740 1 -- 172.21.15.92:0/4191202116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeb2683060 msgr2=0x55aeb267fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:04.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.063+0000 7f873ddc5740 1 --2- 172.21.15.92:0/4191202116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeb2683060 0x55aeb267fc00 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f8728010bd0 tx=0x7f8728004a50 comp rx=0 tx=0).stop 2024-09-19T08:57:04.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.063+0000 7f873ddc5740 1 -- 172.21.15.92:0/4191202116 shutdown_connections 2024-09-19T08:57:04.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.063+0000 7f873ddc5740 1 --2- 172.21.15.92:0/4191202116 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aeb268e240 0x55aeb26a6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.063+0000 7f873ddc5740 1 --2- 172.21.15.92:0/4191202116 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55aeb2683980 0x55aeb26a5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.063+0000 7f873ddc5740 1 --2- 172.21.15.92:0/4191202116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeb2683060 0x55aeb267fc00 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.063+0000 7f873ddc5740 1 -- 172.21.15.92:0/4191202116 >> 172.21.15.92:0/4191202116 conn(0x55aeb267f5f0 msgr2=0x55aeb26852d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:04.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.063+0000 7f873ddc5740 1 -- 172.21.15.92:0/4191202116 shutdown_connections 2024-09-19T08:57:04.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.063+0000 7f873ddc5740 1 -- 172.21.15.92:0/4191202116 wait complete. 2024-09-19T08:57:04.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.063+0000 7f873ddc5740 1 -- start start 2024-09-19T08:57:04.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.063+0000 7f873ddc5740 1 Processor -- start 2024-09-19T08:57:04.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.063+0000 7f873ddc5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55aeb2683060 0x55aeb2692360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:04.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.063+0000 7f873ddc5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeb2683980 0x55aeb26928a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:04.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.063+0000 7f873ddc5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aeb268e240 0x55aeb2707b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:04.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.063+0000 7f873ddc5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f87341b2960 con 0x55aeb2683980 2024-09-19T08:57:04.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.063+0000 7f873ddc5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f87341b3dd0 con 0x55aeb268e240 2024-09-19T08:57:04.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.063+0000 7f873ddc5740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f87341b3030 con 0x55aeb2683060 2024-09-19T08:57:04.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.064+0000 7f873ddc5740 10 client.0 _ll_register_callbacks cb 0x7f872402f310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:04.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.064+0000 7f8739788640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeb2683980 0x55aeb26928a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:04.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.064+0000 7f8739788640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeb2683980 0x55aeb26928a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34456/0 (socket says 172.21.15.92:34456) 2024-09-19T08:57:04.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.064+0000 7f8739788640 1 -- 172.21.15.92:0/4247441469 learned_addr learned my addr 172.21.15.92:0/4247441469 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:04.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.064+0000 7f8738f87640 1 --2- 172.21.15.92:0/4247441469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aeb268e240 0x55aeb2707b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:04.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.064+0000 7f8738f87640 1 --2- 172.21.15.92:0/4247441469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55aeb2683060 0x55aeb2692360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:04.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.064+0000 7f8739788640 1 -- 172.21.15.92:0/4247441469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55aeb2683060 msgr2=0x55aeb2692360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:04.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.064+0000 7f8739788640 1 --2- 172.21.15.92:0/4247441469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55aeb2683060 0x55aeb2692360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.064+0000 7f8739788640 1 -- 172.21.15.92:0/4247441469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aeb268e240 msgr2=0x55aeb2707b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:04.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.064+0000 7f8739788640 1 --2- 172.21.15.92:0/4247441469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aeb268e240 0x55aeb2707b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.064+0000 7f8739788640 1 -- 172.21.15.92:0/4247441469 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aeb2708060 con 0x55aeb2683980 2024-09-19T08:57:04.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.064+0000 7f8738f87640 1 --2- 172.21.15.92:0/4247441469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aeb268e240 0x55aeb2707b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:57:04.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.064+0000 7f8739788640 1 --2- 172.21.15.92:0/4247441469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeb2683980 0x55aeb26928a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f872402ade0 tx=0x7f8724005df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d98b322f1cf7399 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:04.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.064+0000 7f8718ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:57:04.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.064+0000 7f8718ff9640 1 -- 172.21.15.92:0/4247441469 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8724054070 con 0x55aeb2683980 2024-09-19T08:57:04.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.064+0000 7f8718ff9640 1 -- 172.21.15.92:0/4247441469 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8724041040 con 0x55aeb2683980 2024-09-19T08:57:04.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.064+0000 7f873ddc5740 1 -- 172.21.15.92:0/4247441469 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8728012ad0 con 0x55aeb2683980 2024-09-19T08:57:04.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.064+0000 7f8718ff9640 1 -- 172.21.15.92:0/4247441469 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8724049040 con 0x55aeb2683980 2024-09-19T08:57:04.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.065+0000 7f873ddc5740 10 client.15420 fetch_fsmap learned FSMap version 19 2024-09-19T08:57:04.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.065+0000 7f873ddc5740 1 -- 172.21.15.92:0/4247441469 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55aeb2709260 con 0x55aeb2683980 2024-09-19T08:57:04.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.065+0000 7f8718ff9640 1 -- 172.21.15.92:0/4247441469 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8728012ad0 con 0x55aeb2683980 2024-09-19T08:57:04.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.065+0000 7f8718ff9640 1 -- 172.21.15.92:0/4247441469 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f8724057020 con 0x55aeb2683980 2024-09-19T08:57:04.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.065+0000 7f873ddc5740 10 client.15420 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:57:04.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.065+0000 7f873ddc5740 10 client.15420 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T08:57:04.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.065+0000 7f873ddc5740 20 client.15420 populate_metadata read hostname 'smithi092' 2024-09-19T08:57:04.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.065+0000 7f873ddc5740 1 --2- 172.21.15.92:0/4247441469 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55aeb2709950 0x55aeb270bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:04.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.065+0000 7f873ddc5740 4 client.15420 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d86dc111", "release": true, "await": true}] 2024-09-19T08:57:04.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.065+0000 7f873ddc5740 1 -- 172.21.15.92:0/4247441469 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d86dc111", "release": true, "await": true}) -- 0x55aeb25f00a0 con 0x55aeb2709950 2024-09-19T08:57:04.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.065+0000 7f8738f87640 1 --2- 172.21.15.92:0/4247441469 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55aeb2709950 0x55aeb270bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:04.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.065+0000 7f8738f87640 1 --2- 172.21.15.92:0/4247441469 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55aeb2709950 0x55aeb270bd70 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=224a3ecd6799b4ba server_cookie=76d6ed12d57302a3 in_seq=0 out_seq=0 2024-09-19T08:57:04.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.065+0000 7f8718ff9640 10 client.15420 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:04.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.111+0000 7f8718ff9640 1 -- 172.21.15.92:0/4247441469 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55aeb25f00a0 con 0x55aeb2709950 2024-09-19T08:57:04.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.111+0000 7f8718ff9640 10 client.15420 handle_command_reply: tid=0 2024-09-19T08:57:04.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.111+0000 7f873ddc5740 1 client.15420 shutdown 2024-09-19T08:57:04.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.112+0000 7f873ddc5740 1 -- 172.21.15.92:0/4247441469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeb2683980 msgr2=0x55aeb26928a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:04.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.112+0000 7f873ddc5740 1 --2- 172.21.15.92:0/4247441469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeb2683980 0x55aeb26928a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f872402ade0 tx=0x7f8724005df0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.112+0000 7f873ddc5740 1 -- 172.21.15.92:0/4247441469 shutdown_connections 2024-09-19T08:57:04.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.112+0000 7f873ddc5740 1 --2- 172.21.15.92:0/4247441469 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55aeb2709950 0x55aeb270bd70 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.112+0000 7f8718ff9640 0 client.15420 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:04.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.112+0000 7f873ddc5740 1 --2- 172.21.15.92:0/4247441469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aeb268e240 0x55aeb2707b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.112+0000 7f873ddc5740 1 --2- 172.21.15.92:0/4247441469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeb2683980 0x55aeb26928a0 secure :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f872402ade0 tx=0x7f8724005df0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.112+0000 7f873ddc5740 1 --2- 172.21.15.92:0/4247441469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55aeb2683060 0x55aeb2692360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.112+0000 7f873ddc5740 1 -- 172.21.15.92:0/4247441469 >> 172.21.15.92:0/4247441469 conn(0x55aeb267f5f0 msgr2=0x55aeb267df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:04.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.116+0000 7f873ddc5740 1 -- 172.21.15.92:0/4247441469 shutdown_connections 2024-09-19T08:57:04.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.116+0000 7f873ddc5740 1 -- 172.21.15.92:0/4247441469 wait complete. 2024-09-19T08:57:04.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.116+0000 7f873ddc5740 20 client.15420 trim_cache size 0 max 16384 2024-09-19T08:57:04.117 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T08:57:04.118 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 19, 2024-09-19T08:57:04.118 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24472, 2024-09-19T08:57:04.118 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 4, 2024-09-19T08:57:04.118 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-09-19T08:57:04.118 INFO:teuthology.orchestra.run.smithi092.stdout: "d86dc111": { 2024-09-19T08:57:04.118 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 4, 2024-09-19T08:57:04.118 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-09-19T08:57:04.118 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T08:57:04.118 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-09-19T08:57:04.118 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T08:57:04.119 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T08:57:04.119 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 90.0, 2024-09-19T08:57:04.119 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 131.2, 2024-09-19T08:57:04.119 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-09-19T08:57:04.119 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-09-19T08:57:04.119 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-09-19T08:57:04.119 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T08:57:04.119 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-09-19T08:57:04.119 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T08:57:04.119 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:57:04.119 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:57:04.120 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:57:04.120 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:57:04.120 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:57:04.120 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T08:57:04.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.118+0000 7f873b9ec640 1 -- 172.21.15.92:0/2767924631 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f871c0a3240 msgr2=0x7f871c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:04.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.118+0000 7f873b9ec640 1 --2- 172.21.15.92:0/2767924631 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f871c0a3240 0x7f871c0a5700 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f872c009610 tx=0x7f872c0046c0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.118+0000 7f873b9ec640 1 -- 172.21.15.92:0/2767924631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8734106b70 msgr2=0x7f873419e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:04.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.118+0000 7f873b9ec640 1 --2- 172.21.15.92:0/2767924631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8734106b70 0x7f873419e870 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f872c00d720 tx=0x7f872c00dbe0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.118+0000 7f873b9ec640 1 -- 172.21.15.92:0/2767924631 shutdown_connections 2024-09-19T08:57:04.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.118+0000 7f873b9ec640 1 --2- 172.21.15.92:0/2767924631 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f871c0a3240 0x7f871c0a5700 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.118+0000 7f873b9ec640 1 --2- 172.21.15.92:0/2767924631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8734106b70 0x7f873419e870 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.118+0000 7f873b9ec640 1 --2- 172.21.15.92:0/2767924631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8734100a50 0x7f87341a4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.118+0000 7f873b9ec640 1 --2- 172.21.15.92:0/2767924631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8734100090 0x7f87341a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.118+0000 7f873b9ec640 1 -- 172.21.15.92:0/2767924631 >> 172.21.15.92:0/2767924631 conn(0x7f8734077210 msgr2=0x7f87341037b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:04.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.119+0000 7f873b9ec640 1 -- 172.21.15.92:0/2767924631 shutdown_connections 2024-09-19T08:57:04.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:04.120+0000 7f873b9ec640 1 -- 172.21.15.92:0/2767924631 wait complete. 2024-09-19T08:57:04.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:04 smithi092 ceph-mon[31407]: scrub summary: idle 2024-09-19T08:57:04.845 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd86dc111', total seconds elapsed: 14.6 2024-09-19T08:57:04.850 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:04 smithi167 ceph-mon[35359]: scrub summary: idle 2024-09-19T08:57:04.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:04 smithi190 ceph-mon[35358]: scrub summary: idle 2024-09-19T08:57:05.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:05 smithi092 ceph-mon[31407]: pgmap v348: 97 pgs: 97 active+clean; 927 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 6.0 MiB/s wr, 588 op/s 2024-09-19T08:57:05.807 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 20.0 s, 1941.2 tps, lat 110.797 ms stddev 918.094 2024-09-19T08:57:05.863 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:05 smithi167 ceph-mon[35359]: pgmap v348: 97 pgs: 97 active+clean; 927 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 6.0 MiB/s wr, 588 op/s 2024-09-19T08:57:05.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:05 smithi190 ceph-mon[35358]: pgmap v348: 97 pgs: 97 active+clean; 927 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 6.0 MiB/s wr, 588 op/s 2024-09-19T08:57:07.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:07 smithi092 ceph-mon[31407]: pgmap v349: 97 pgs: 97 active+clean; 927 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 2.7 MiB/s wr, 406 op/s 2024-09-19T08:57:07.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:07 smithi167 ceph-mon[35359]: pgmap v349: 97 pgs: 97 active+clean; 927 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 2.7 MiB/s wr, 406 op/s 2024-09-19T08:57:07.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:07 smithi190 ceph-mon[35358]: pgmap v349: 97 pgs: 97 active+clean; 927 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 2.7 MiB/s wr, 406 op/s 2024-09-19T08:57:09.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:09 smithi092 ceph-mon[31407]: pgmap v350: 97 pgs: 97 active+clean; 933 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 2.4 MiB/s wr, 378 op/s 2024-09-19T08:57:09.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:09 smithi167 ceph-mon[35359]: pgmap v350: 97 pgs: 97 active+clean; 933 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 2.4 MiB/s wr, 378 op/s 2024-09-19T08:57:09.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:09 smithi190 ceph-mon[35358]: pgmap v350: 97 pgs: 97 active+clean; 933 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 2.4 MiB/s wr, 378 op/s 2024-09-19T08:57:10.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 25.0 s, 6736.8 tps, lat 14.836 ms stddev 14.809 2024-09-19T08:57:10.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:10.992+0000 7effb119f640 1 -- 172.21.15.92:0/2113069431 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effac108470 msgr2=0x7effac108870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:10.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:10.992+0000 7effb119f640 1 --2- 172.21.15.92:0/2113069431 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effac108470 0x7effac108870 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7eff9c009930 tx=0x7eff9c02a440 comp rx=0 tx=0).stop 2024-09-19T08:57:10.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:10.992+0000 7effb119f640 1 -- 172.21.15.92:0/2113069431 shutdown_connections 2024-09-19T08:57:10.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:10.992+0000 7effb119f640 1 --2- 172.21.15.92:0/2113069431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effac109b40 0x7effac1103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:10.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:10.992+0000 7effb119f640 1 --2- 172.21.15.92:0/2113069431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effac109180 0x7effac109600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:10.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:10.992+0000 7effb119f640 1 --2- 172.21.15.92:0/2113069431 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effac108470 0x7effac108870 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:10.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:10.992+0000 7effb119f640 1 -- 172.21.15.92:0/2113069431 >> 172.21.15.92:0/2113069431 conn(0x7effac077470 msgr2=0x7effac0798b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:10.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:10.992+0000 7effb119f640 1 -- 172.21.15.92:0/2113069431 shutdown_connections 2024-09-19T08:57:10.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:10.992+0000 7effb119f640 1 -- 172.21.15.92:0/2113069431 wait complete. 2024-09-19T08:57:10.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:10.993+0000 7effb119f640 1 Processor -- start 2024-09-19T08:57:10.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:10.993+0000 7effb119f640 1 -- start start 2024-09-19T08:57:10.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:10.994+0000 7effb119f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effac108470 0x7effac07fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:10.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:10.994+0000 7effb119f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effac109180 0x7effac07ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:10.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:10.994+0000 7effb119f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effac109b40 0x7effac1ae350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:10.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:10.994+0000 7effb119f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7effac113c80 con 0x7effac109180 2024-09-19T08:57:10.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:10.994+0000 7effb119f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7effac113b00 con 0x7effac109b40 2024-09-19T08:57:10.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:10.994+0000 7effb119f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7effac113e00 con 0x7effac108470 2024-09-19T08:57:10.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:10.994+0000 7effabfff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effac108470 0x7effac07fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:10.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:10.994+0000 7effabfff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effac108470 0x7effac07fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:54254/0 (socket says 172.21.15.92:54254) 2024-09-19T08:57:10.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:10.994+0000 7effabfff640 1 -- 172.21.15.92:0/2022915160 learned_addr learned my addr 172.21.15.92:0/2022915160 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:10.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:10.994+0000 7effb099e640 1 --2- 172.21.15.92:0/2022915160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effac109b40 0x7effac1ae350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:10.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:10.994+0000 7effab7fe640 1 --2- 172.21.15.92:0/2022915160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effac109180 0x7effac07ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:10.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:10.995+0000 7effb099e640 1 -- 172.21.15.92:0/2022915160 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effac108470 msgr2=0x7effac07fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:10.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:10.995+0000 7effb099e640 1 --2- 172.21.15.92:0/2022915160 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effac108470 0x7effac07fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:10.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:10.995+0000 7effb099e640 1 -- 172.21.15.92:0/2022915160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effac109180 msgr2=0x7effac07ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:10.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:10.995+0000 7effb099e640 1 --2- 172.21.15.92:0/2022915160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effac109180 0x7effac07ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:10.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:10.995+0000 7effb099e640 1 -- 172.21.15.92:0/2022915160 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effac1ae890 con 0x7effac109b40 2024-09-19T08:57:10.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:10.995+0000 7effb099e640 1 --2- 172.21.15.92:0/2022915160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effac109b40 0x7effac1ae350 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7eff9400e940 tx=0x7eff9400ee00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:10.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:10.996+0000 7effa97fa640 1 -- 172.21.15.92:0/2022915160 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff94004d20 con 0x7effac109b40 2024-09-19T08:57:10.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:10.996+0000 7effa97fa640 1 -- 172.21.15.92:0/2022915160 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff94005020 con 0x7effac109b40 2024-09-19T08:57:10.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:10.996+0000 7effa97fa640 1 -- 172.21.15.92:0/2022915160 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff940116d0 con 0x7effac109b40 2024-09-19T08:57:10.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:10.996+0000 7effb119f640 1 -- 172.21.15.92:0/2022915160 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effac1aea60 con 0x7effac109b40 2024-09-19T08:57:10.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:10.996+0000 7effb119f640 1 -- 172.21.15.92:0/2022915160 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effac1aeea0 con 0x7effac109b40 2024-09-19T08:57:10.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.000+0000 7effb5274740 1 Processor -- start 2024-09-19T08:57:11.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.000+0000 7effb5274740 1 -- start start 2024-09-19T08:57:11.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.000+0000 7effa97fa640 1 -- 172.21.15.92:0/2022915160 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7eff940054d0 con 0x7effac109b40 2024-09-19T08:57:11.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.000+0000 7effb5274740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b087bcb70 0x561b087bcf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:11.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.000+0000 7effb5274740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b087bd4b0 0x561b087c1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:11.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.000+0000 7effb5274740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b087c2540 0x561b087c4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:11.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.000+0000 7effb5274740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561b087202f0 con 0x561b087c2540 2024-09-19T08:57:11.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.000+0000 7effb5274740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561b086c8270 con 0x561b087bd4b0 2024-09-19T08:57:11.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.001+0000 7effb5274740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x561b0871c2b0 con 0x561b087bcb70 2024-09-19T08:57:11.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.001+0000 7effab7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b087bcb70 0x561b087bcf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:11.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.001+0000 7effab7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b087bcb70 0x561b087bcf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:54260/0 (socket says 172.21.15.92:54260) 2024-09-19T08:57:11.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.001+0000 7effab7fe640 1 -- 172.21.15.92:0/710754449 learned_addr learned my addr 172.21.15.92:0/710754449 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:11.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.001+0000 7effabfff640 1 --2- 172.21.15.92:0/710754449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b087bd4b0 0x561b087c1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:11.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.001+0000 7effab7fe640 1 --2- 172.21.15.92:0/710754449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b087c2540 0x561b087c4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:11.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.002+0000 7effab7fe640 1 -- 172.21.15.92:0/710754449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b087bd4b0 msgr2=0x561b087c1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:11.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.002+0000 7effab7fe640 1 --2- 172.21.15.92:0/710754449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b087bd4b0 0x561b087c1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:11.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.002+0000 7effab7fe640 1 -- 172.21.15.92:0/710754449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b087c2540 msgr2=0x561b087c4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:11.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.002+0000 7effab7fe640 1 --2- 172.21.15.92:0/710754449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b087c2540 0x561b087c4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:11.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.002+0000 7effab7fe640 1 -- 172.21.15.92:0/710754449 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b086c7340 con 0x561b087bcb70 2024-09-19T08:57:11.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.002+0000 7effa97fa640 1 --2- 172.21.15.92:0/2022915160 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7eff980a3340 0x7eff980a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:11.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.002+0000 7effa97fa640 1 -- 172.21.15.92:0/2022915160 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7eff940cf930 con 0x7effac109b40 2024-09-19T08:57:11.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.002+0000 7effab7fe640 1 --2- 172.21.15.92:0/710754449 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b087bcb70 0x561b087bcf70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7effa4011730 tx=0x7effa400a6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f03be87619495caa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:11.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.002+0000 7effabfff640 1 --2- 172.21.15.92:0/2022915160 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7eff980a3340 0x7eff980a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:11.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.002+0000 7effa27fc640 1 -- 172.21.15.92:0/710754449 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa4004020 con 0x561b087bcb70 2024-09-19T08:57:11.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.002+0000 7effa27fc640 1 -- 172.21.15.92:0/710754449 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effa4005500 con 0x561b087bcb70 2024-09-19T08:57:11.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.002+0000 7effa27fc640 1 -- 172.21.15.92:0/710754449 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa4004c60 con 0x561b087bcb70 2024-09-19T08:57:11.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.003+0000 7effabfff640 1 --2- 172.21.15.92:0/2022915160 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7eff980a3340 0x7eff980a5800 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7eff9c006010 tx=0x7eff9c0315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:11.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.003+0000 7effb5274740 1 -- 172.21.15.92:0/710754449 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b087bcb70 msgr2=0x561b087bcf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:11.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.003+0000 7effb5274740 1 --2- 172.21.15.92:0/710754449 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b087bcb70 0x561b087bcf70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7effa4011730 tx=0x7effa400a6a0 comp rx=0 tx=0).stop 2024-09-19T08:57:11.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.004+0000 7effb5274740 1 -- 172.21.15.92:0/710754449 shutdown_connections 2024-09-19T08:57:11.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.004+0000 7effb5274740 1 --2- 172.21.15.92:0/710754449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b087c2540 0x561b087c4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:11.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.004+0000 7effb5274740 1 --2- 172.21.15.92:0/710754449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b087bd4b0 0x561b087c1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:11.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.004+0000 7effb5274740 1 --2- 172.21.15.92:0/710754449 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b087bcb70 0x561b087bcf70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:11.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.004+0000 7effb5274740 1 -- 172.21.15.92:0/710754449 >> 172.21.15.92:0/710754449 conn(0x561b087b81e0 msgr2=0x561b087b85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:11.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.005+0000 7effb5274740 1 -- 172.21.15.92:0/710754449 shutdown_connections 2024-09-19T08:57:11.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.005+0000 7effb5274740 1 -- 172.21.15.92:0/710754449 wait complete. 2024-09-19T08:57:11.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.005+0000 7effb5274740 1 -- start start 2024-09-19T08:57:11.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.005+0000 7effb5274740 1 Processor -- start 2024-09-19T08:57:11.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.006+0000 7effb5274740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b087bcb70 0x561b087d7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:11.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.006+0000 7effb5274740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b087bd4b0 0x561b087d8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:11.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.006+0000 7effb5274740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b087c2540 0x561b087df3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:11.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.006+0000 7effb5274740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561b087d6520 con 0x561b087bcb70 2024-09-19T08:57:11.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.006+0000 7effabfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b087bcb70 0x561b087d7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:11.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.006+0000 7effabfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b087bcb70 0x561b087d7ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34494/0 (socket says 172.21.15.92:34494) 2024-09-19T08:57:11.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.006+0000 7effabfff640 1 -- 172.21.15.92:0/1465857292 learned_addr learned my addr 172.21.15.92:0/1465857292 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.006+0000 7effb099e640 1 --2- 172.21.15.92:0/1465857292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b087c2540 0x561b087df3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.006+0000 7effb5274740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561b086a9290 con 0x561b087c2540 2024-09-19T08:57:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.006+0000 7effb5274740 1 -- 172.21.15.92:0/1465857292 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x561b087d66a0 con 0x561b087bd4b0 2024-09-19T08:57:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.006+0000 7effab7fe640 1 --2- 172.21.15.92:0/1465857292 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b087bd4b0 0x561b087d8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.007+0000 7effb5274740 10 client.0 _ll_register_callbacks cb 0x561b086da140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.007+0000 7effab7fe640 1 -- 172.21.15.92:0/1465857292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b087c2540 msgr2=0x561b087df3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.007+0000 7effab7fe640 1 --2- 172.21.15.92:0/1465857292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b087c2540 0x561b087df3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.007+0000 7effab7fe640 1 -- 172.21.15.92:0/1465857292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b087bcb70 msgr2=0x561b087d7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.007+0000 7effab7fe640 1 --2- 172.21.15.92:0/1465857292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b087bcb70 0x561b087d7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.007+0000 7effab7fe640 1 -- 172.21.15.92:0/1465857292 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b08433210 con 0x561b087bd4b0 2024-09-19T08:57:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.007+0000 7effab7fe640 1 --2- 172.21.15.92:0/1465857292 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b087bd4b0 0x561b087d8400 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7effa4011700 tx=0x7effa4004c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c45c3bedf57be0d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.007+0000 7effb5274740 1 -- 172.21.15.92:0/1465857292 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effa4005500 con 0x561b087bd4b0 2024-09-19T08:57:11.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.007+0000 7eff8b7fe640 10 client.24940 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T08:57:11.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.007+0000 7eff8b7fe640 1 -- 172.21.15.92:0/1465857292 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa4011240 con 0x561b087bd4b0 2024-09-19T08:57:11.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.007+0000 7eff8b7fe640 1 -- 172.21.15.92:0/1465857292 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7effa400f790 con 0x561b087bd4b0 2024-09-19T08:57:11.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.008+0000 7eff8b7fe640 1 -- 172.21.15.92:0/1465857292 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7effa402e050 con 0x561b087bd4b0 2024-09-19T08:57:11.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.008+0000 7effb5274740 10 client.24940 fetch_fsmap learned FSMap version 19 2024-09-19T08:57:11.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.008+0000 7effb5274740 1 -- 172.21.15.92:0/1465857292 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({fsmap=19}) -- 0x561b084ff620 con 0x561b087bd4b0 2024-09-19T08:57:11.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.008+0000 7eff8b7fe640 1 -- 172.21.15.92:0/1465857292 <== mon.1 v2:172.21.15.190:3300/0 4 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7effa400f990 con 0x561b087bd4b0 2024-09-19T08:57:11.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.008+0000 7effb5274740 10 client.24940 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:57:11.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.008+0000 7effb5274740 10 client.24940 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T08:57:11.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.008+0000 7effb5274740 20 client.24940 populate_metadata read hostname 'smithi092' 2024-09-19T08:57:11.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.008+0000 7effb5274740 1 --2- 172.21.15.92:0/1465857292 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561b087e3660 0x561b087e5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:11.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.009+0000 7effb5274740 4 client.24940 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:57:11.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.009+0000 7effb5274740 1 -- 172.21.15.92:0/1465857292 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b0872da20 con 0x561b087e3660 2024-09-19T08:57:11.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.009+0000 7effabfff640 1 --2- 172.21.15.92:0/1465857292 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561b087e3660 0x561b087e5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:11.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.009+0000 7effabfff640 1 --2- 172.21.15.92:0/1465857292 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561b087e3660 0x561b087e5a50 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a0f15e9809390d9 server_cookie=c7a3a2c4f19b3937 in_seq=0 out_seq=0 2024-09-19T08:57:11.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.009+0000 7eff8b7fe640 10 client.24940 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:11.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.010+0000 7eff8b7fe640 1 -- 172.21.15.92:0/1465857292 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561b0872da20 con 0x561b087e3660 2024-09-19T08:57:11.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.010+0000 7eff8b7fe640 10 client.24940 handle_command_reply: tid=0 2024-09-19T08:57:11.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.010+0000 7effb5274740 1 client.24940 shutdown 2024-09-19T08:57:11.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.010+0000 7effb5274740 1 -- 172.21.15.92:0/1465857292 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b087bd4b0 msgr2=0x561b087d8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:11.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.010+0000 7effb5274740 1 --2- 172.21.15.92:0/1465857292 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b087bd4b0 0x561b087d8400 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7effa4011700 tx=0x7effa4004c10 comp rx=0 tx=0).stop 2024-09-19T08:57:11.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.010+0000 7effb5274740 1 -- 172.21.15.92:0/1465857292 shutdown_connections 2024-09-19T08:57:11.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.010+0000 7effb5274740 1 --2- 172.21.15.92:0/1465857292 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561b087e3660 0x561b087e5a50 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:11.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.010+0000 7effb5274740 1 --2- 172.21.15.92:0/1465857292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b087c2540 0x561b087df3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:11.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.010+0000 7eff8b7fe640 0 client.24940 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:11.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.010+0000 7effb5274740 1 --2- 172.21.15.92:0/1465857292 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b087bd4b0 0x561b087d8400 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:11.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.010+0000 7effb5274740 1 --2- 172.21.15.92:0/1465857292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b087bcb70 0x561b087d7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:11.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.010+0000 7effb5274740 1 -- 172.21.15.92:0/1465857292 >> 172.21.15.92:0/1465857292 conn(0x561b087b81e0 msgr2=0x561b087b99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:11.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.010+0000 7effb5274740 1 -- 172.21.15.92:0/1465857292 shutdown_connections 2024-09-19T08:57:11.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.010+0000 7effb5274740 1 -- 172.21.15.92:0/1465857292 wait complete. 2024-09-19T08:57:11.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.010+0000 7effb5274740 20 client.24940 trim_cache size 0 max 16384 2024-09-19T08:57:11.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.038+0000 7effb5274740 1 Processor -- start 2024-09-19T08:57:11.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.038+0000 7effb5274740 1 -- start start 2024-09-19T08:57:11.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.039+0000 7effb5274740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b087bcb70 0x561b087b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:11.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.039+0000 7effb5274740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b087bd4b0 0x561b087b76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:11.040 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.039+0000 7effb5274740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b087c2540 0x561b087df390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:11.040 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.039+0000 7effabfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b087bcb70 0x561b087b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:11.040 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.039+0000 7effabfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b087bcb70 0x561b087b71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34502/0 (socket says 172.21.15.92:34502) 2024-09-19T08:57:11.040 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.039+0000 7effab7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b087bd4b0 0x561b087b76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:11.040 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.039+0000 7effab7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b087bd4b0 0x561b087b76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:38494/0 (socket says 172.21.15.92:38494) 2024-09-19T08:57:11.040 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.039+0000 7effabfff640 1 -- 172.21.15.92:0/1316731757 learned_addr learned my addr 172.21.15.92:0/1316731757 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:11.040 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.039+0000 7effb5274740 1 -- 172.21.15.92:0/1316731757 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7effac072780 con 0x561b087bcb70 2024-09-19T08:57:11.040 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.039+0000 7effb5274740 1 -- 172.21.15.92:0/1316731757 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7effac1afd60 con 0x561b087bd4b0 2024-09-19T08:57:11.040 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.039+0000 7effb5274740 1 -- 172.21.15.92:0/1316731757 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7effac072e10 con 0x561b087c2540 2024-09-19T08:57:11.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.039+0000 7effb099e640 1 --2- 172.21.15.92:0/1316731757 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b087c2540 0x561b087df390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:11.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.040+0000 7effb099e640 1 -- 172.21.15.92:0/1316731757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b087bd4b0 msgr2=0x561b087b76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:11.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.040+0000 7effb099e640 1 --2- 172.21.15.92:0/1316731757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b087bd4b0 0x561b087b76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:11.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.040+0000 7effb099e640 1 -- 172.21.15.92:0/1316731757 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b087bcb70 msgr2=0x561b087b71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:11.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.040+0000 7effb099e640 1 --2- 172.21.15.92:0/1316731757 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b087bcb70 0x561b087b71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:11.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.040+0000 7effb099e640 1 -- 172.21.15.92:0/1316731757 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b087b8000 con 0x561b087c2540 2024-09-19T08:57:11.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.040+0000 7effb099e640 1 --2- 172.21.15.92:0/1316731757 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b087c2540 0x561b087df390 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7eff94005c40 tx=0x7eff9409b920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb6b89d7d4a2c196 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:11.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.040+0000 7effa1ffb640 1 -- 172.21.15.92:0/1316731757 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff940b4070 con 0x561b087c2540 2024-09-19T08:57:11.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.040+0000 7effa1ffb640 1 -- 172.21.15.92:0/1316731757 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff940a4b80 con 0x561b087c2540 2024-09-19T08:57:11.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.040+0000 7effa1ffb640 1 -- 172.21.15.92:0/1316731757 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9401f040 con 0x561b087c2540 2024-09-19T08:57:11.043 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.042+0000 7effb5274740 1 -- 172.21.15.92:0/1316731757 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b087c2540 msgr2=0x561b087df390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:11.043 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.042+0000 7effb5274740 1 --2- 172.21.15.92:0/1316731757 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b087c2540 0x561b087df390 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7eff94005c40 tx=0x7eff9409b920 comp rx=0 tx=0).stop 2024-09-19T08:57:11.043 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.042+0000 7effb5274740 1 -- 172.21.15.92:0/1316731757 shutdown_connections 2024-09-19T08:57:11.043 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.042+0000 7effb5274740 1 --2- 172.21.15.92:0/1316731757 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b087c2540 0x561b087df390 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:11.043 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.042+0000 7effb5274740 1 --2- 172.21.15.92:0/1316731757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b087bd4b0 0x561b087b76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:11.043 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.042+0000 7effb5274740 1 --2- 172.21.15.92:0/1316731757 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b087bcb70 0x561b087b71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:11.043 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.042+0000 7effb5274740 1 -- 172.21.15.92:0/1316731757 >> 172.21.15.92:0/1316731757 conn(0x561b087b81e0 msgr2=0x561b087b6a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:11.043 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.042+0000 7effb5274740 1 -- 172.21.15.92:0/1316731757 shutdown_connections 2024-09-19T08:57:11.043 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.043+0000 7effb5274740 1 -- 172.21.15.92:0/1316731757 wait complete. 2024-09-19T08:57:11.043 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.043+0000 7effb5274740 1 -- start start 2024-09-19T08:57:11.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.044+0000 7effb5274740 1 Processor -- start 2024-09-19T08:57:11.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.044+0000 7effb5274740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b087bcb70 0x561b087dc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:11.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.044+0000 7effb5274740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b087bd4b0 0x561b087dc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:11.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.044+0000 7effb5274740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b087c2540 0x561b0884c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:11.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.045+0000 7effab7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b087bd4b0 0x561b087dc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:11.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.045+0000 7effab7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b087bd4b0 0x561b087dc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:38504/0 (socket says 172.21.15.92:38504) 2024-09-19T08:57:11.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.045+0000 7effb099e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b087c2540 0x561b0884c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:11.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.045+0000 7effb099e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b087c2540 0x561b0884c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:54282/0 (socket says 172.21.15.92:54282) 2024-09-19T08:57:11.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.045+0000 7effab7fe640 1 -- 172.21.15.92:0/4206459327 learned_addr learned my addr 172.21.15.92:0/4206459327 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:11.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.045+0000 7effb5274740 1 -- 172.21.15.92:0/4206459327 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7effac0734e0 con 0x561b087bcb70 2024-09-19T08:57:11.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.045+0000 7effb5274740 1 -- 172.21.15.92:0/4206459327 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7effac1af690 con 0x561b087bd4b0 2024-09-19T08:57:11.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.045+0000 7effb5274740 1 -- 172.21.15.92:0/4206459327 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7effac073bb0 con 0x561b087c2540 2024-09-19T08:57:11.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.045+0000 7effab7fe640 1 -- 172.21.15.92:0/4206459327 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b087c2540 msgr2=0x561b0884c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:11.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.045+0000 7effab7fe640 1 --2- 172.21.15.92:0/4206459327 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b087c2540 0x561b0884c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:11.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.045+0000 7effab7fe640 1 -- 172.21.15.92:0/4206459327 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b087bcb70 msgr2=0x561b087dc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:11.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.045+0000 7effab7fe640 1 --2- 172.21.15.92:0/4206459327 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b087bcb70 0x561b087dc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:11.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.045+0000 7effab7fe640 1 -- 172.21.15.92:0/4206459327 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b0884c860 con 0x561b087bd4b0 2024-09-19T08:57:11.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.045+0000 7effb5274740 10 client.0 _ll_register_callbacks cb 0x7effa400adb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:11.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.046+0000 7effab7fe640 1 --2- 172.21.15.92:0/4206459327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b087bd4b0 0x561b087dc6e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x561b087d9330 tx=0x7effa400ab00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87fa370fd8833000 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.046+0000 7eff8b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T08:57:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.046+0000 7eff8b7fe640 1 -- 172.21.15.92:0/4206459327 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa4036030 con 0x561b087bd4b0 2024-09-19T08:57:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.046+0000 7effb5274740 1 -- 172.21.15.92:0/4206459327 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff940a4b80 con 0x561b087bd4b0 2024-09-19T08:57:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.046+0000 7eff8b7fe640 1 -- 172.21.15.92:0/4206459327 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7effa401a040 con 0x561b087bd4b0 2024-09-19T08:57:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.046+0000 7eff8b7fe640 1 -- 172.21.15.92:0/4206459327 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7effa4042050 con 0x561b087bd4b0 2024-09-19T08:57:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.046+0000 7effb5274740 10 client.24935 fetch_fsmap learned FSMap version 19 2024-09-19T08:57:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.046+0000 7effb5274740 1 -- 172.21.15.92:0/4206459327 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({fsmap=19}) -- 0x561b0884d920 con 0x561b087bd4b0 2024-09-19T08:57:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.047+0000 7eff8b7fe640 1 -- 172.21.15.92:0/4206459327 <== mon.2 v2:172.21.15.167:3300/0 4 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7effa400f790 con 0x561b087bd4b0 2024-09-19T08:57:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.047+0000 7effb5274740 10 client.24935 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:57:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.047+0000 7effb5274740 10 client.24935 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T08:57:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.047+0000 7effb5274740 20 client.24935 populate_metadata read hostname 'smithi092' 2024-09-19T08:57:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.047+0000 7effb5274740 1 --2- 172.21.15.92:0/4206459327 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561b0884e160 0x561b08850550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.048+0000 7effb5274740 4 client.24935 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:57:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.048+0000 7effb5274740 1 -- 172.21.15.92:0/4206459327 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7eff940a4b80 con 0x561b0884e160 2024-09-19T08:57:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.048+0000 7effabfff640 1 --2- 172.21.15.92:0/4206459327 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561b0884e160 0x561b08850550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.049+0000 7effabfff640 1 --2- 172.21.15.92:0/4206459327 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561b0884e160 0x561b08850550 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aaa838eb69c3b2d1 server_cookie=6053e8d8c869c322 in_seq=0 out_seq=0 2024-09-19T08:57:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.049+0000 7eff8b7fe640 10 client.24935 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:11.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.068+0000 7eff8b7fe640 1 -- 172.21.15.92:0/4206459327 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7eff940a4b80 con 0x561b0884e160 2024-09-19T08:57:11.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.068+0000 7eff8b7fe640 10 client.24935 handle_command_reply: tid=0 2024-09-19T08:57:11.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.068+0000 7effb5274740 1 client.24935 shutdown 2024-09-19T08:57:11.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.068+0000 7effb5274740 1 -- 172.21.15.92:0/4206459327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b087bd4b0 msgr2=0x561b087dc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:11.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.068+0000 7effb5274740 1 --2- 172.21.15.92:0/4206459327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b087bd4b0 0x561b087dc6e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x561b087d9330 tx=0x7effa400ab00 comp rx=0 tx=0).stop 2024-09-19T08:57:11.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.068+0000 7effb5274740 1 -- 172.21.15.92:0/4206459327 shutdown_connections 2024-09-19T08:57:11.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.068+0000 7effb5274740 1 --2- 172.21.15.92:0/4206459327 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561b0884e160 0x561b08850550 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:11.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.068+0000 7effb5274740 1 --2- 172.21.15.92:0/4206459327 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b087c2540 0x561b0884c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:11.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.068+0000 7eff8b7fe640 0 client.24935 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:11.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.068+0000 7effb5274740 1 --2- 172.21.15.92:0/4206459327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b087bd4b0 0x561b087dc6e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:11.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.068+0000 7effb5274740 1 --2- 172.21.15.92:0/4206459327 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b087bcb70 0x561b087dc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:11.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.068+0000 7effb5274740 1 -- 172.21.15.92:0/4206459327 >> 172.21.15.92:0/4206459327 conn(0x561b087b81e0 msgr2=0x561b087b72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:11.070 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.068+0000 7effb5274740 1 -- 172.21.15.92:0/4206459327 shutdown_connections 2024-09-19T08:57:11.070 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.069+0000 7effb5274740 1 -- 172.21.15.92:0/4206459327 wait complete. 2024-09-19T08:57:11.070 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.069+0000 7effb5274740 20 client.24935 trim_cache size 0 max 16384 2024-09-19T08:57:11.070 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T08:57:11.070 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T08:57:11.070 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T08:57:11.070 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T08:57:11.071 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.071+0000 7effb119f640 1 -- 172.21.15.92:0/2022915160 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7eff980a3340 msgr2=0x7eff980a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:11.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.071+0000 7effb119f640 1 --2- 172.21.15.92:0/2022915160 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7eff980a3340 0x7eff980a5800 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7eff9c006010 tx=0x7eff9c0315b0 comp rx=0 tx=0).stop 2024-09-19T08:57:11.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.071+0000 7effb119f640 1 -- 172.21.15.92:0/2022915160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effac109b40 msgr2=0x7effac1ae350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:11.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.071+0000 7effb119f640 1 --2- 172.21.15.92:0/2022915160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effac109b40 0x7effac1ae350 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7eff9400e940 tx=0x7eff9400ee00 comp rx=0 tx=0).stop 2024-09-19T08:57:11.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.071+0000 7effb119f640 1 -- 172.21.15.92:0/2022915160 shutdown_connections 2024-09-19T08:57:11.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.071+0000 7effb119f640 1 --2- 172.21.15.92:0/2022915160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effac109b40 0x7effac1ae350 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:11.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.071+0000 7effb119f640 1 --2- 172.21.15.92:0/2022915160 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7eff980a3340 0x7eff980a5800 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:11.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.071+0000 7effb119f640 1 --2- 172.21.15.92:0/2022915160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effac109180 0x7effac07ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:11.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.072+0000 7effb119f640 1 --2- 172.21.15.92:0/2022915160 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effac108470 0x7effac07fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:11.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.072+0000 7effb119f640 1 -- 172.21.15.92:0/2022915160 >> 172.21.15.92:0/2022915160 conn(0x7effac077470 msgr2=0x7effac10c550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:11.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.072+0000 7effb119f640 1 -- 172.21.15.92:0/2022915160 shutdown_connections 2024-09-19T08:57:11.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:11.072+0000 7effb119f640 1 -- 172.21.15.92:0/2022915160 wait complete. 2024-09-19T08:57:11.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:11 smithi092 ceph-mon[31407]: pgmap v351: 97 pgs: 97 active+clean; 952 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 6.1 MiB/s wr, 521 op/s 2024-09-19T08:57:11.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:11 smithi167 ceph-mon[35359]: pgmap v351: 97 pgs: 97 active+clean; 952 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 6.1 MiB/s wr, 521 op/s 2024-09-19T08:57:11.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:11 smithi190 ceph-mon[35358]: pgmap v351: 97 pgs: 97 active+clean; 952 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 6.1 MiB/s wr, 521 op/s 2024-09-19T08:57:13.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:13 smithi092 ceph-mon[31407]: pgmap v352: 97 pgs: 97 active+clean; 953 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 5.5 MiB/s wr, 486 op/s 2024-09-19T08:57:13.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:13 smithi167 ceph-mon[35359]: pgmap v352: 97 pgs: 97 active+clean; 953 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 5.5 MiB/s wr, 486 op/s 2024-09-19T08:57:13.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:13 smithi190 ceph-mon[35358]: pgmap v352: 97 pgs: 97 active+clean; 953 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 5.5 MiB/s wr, 486 op/s 2024-09-19T08:57:15.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:15 smithi092 ceph-mon[31407]: pgmap v353: 97 pgs: 97 active+clean; 968 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 10 MiB/s wr, 755 op/s 2024-09-19T08:57:15.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 30.0 s, 6384.0 tps, lat 15.656 ms stddev 15.888 2024-09-19T08:57:15.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:15 smithi167 ceph-mon[35359]: pgmap v353: 97 pgs: 97 active+clean; 968 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 10 MiB/s wr, 755 op/s 2024-09-19T08:57:15.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:15 smithi190 ceph-mon[35358]: pgmap v353: 97 pgs: 97 active+clean; 968 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 10 MiB/s wr, 755 op/s 2024-09-19T08:57:17.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:17 smithi092 ceph-mon[31407]: pgmap v354: 97 pgs: 97 active+clean; 974 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 12 MiB/s wr, 845 op/s 2024-09-19T08:57:17.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:17 smithi167 ceph-mon[35359]: pgmap v354: 97 pgs: 97 active+clean; 974 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 12 MiB/s wr, 845 op/s 2024-09-19T08:57:17.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:17 smithi190 ceph-mon[35358]: pgmap v354: 97 pgs: 97 active+clean; 974 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 12 MiB/s wr, 845 op/s 2024-09-19T08:57:19.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:19 smithi092 ceph-mon[31407]: pgmap v355: 97 pgs: 97 active+clean; 985 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 899 op/s 2024-09-19T08:57:19.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:19 smithi167 ceph-mon[35359]: pgmap v355: 97 pgs: 97 active+clean; 985 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 899 op/s 2024-09-19T08:57:19.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:19 smithi190 ceph-mon[35358]: pgmap v355: 97 pgs: 97 active+clean; 985 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 899 op/s 2024-09-19T08:57:20.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 35.0 s, 6165.0 tps, lat 16.197 ms stddev 17.371 2024-09-19T08:57:21.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:21 smithi092 ceph-mon[31407]: pgmap v356: 97 pgs: 97 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 21 MiB/s wr, 1.09k op/s 2024-09-19T08:57:21.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:21 smithi167 ceph-mon[35359]: pgmap v356: 97 pgs: 97 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 21 MiB/s wr, 1.09k op/s 2024-09-19T08:57:21.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:21 smithi190 ceph-mon[35358]: pgmap v356: 97 pgs: 97 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 21 MiB/s wr, 1.09k op/s 2024-09-19T08:57:23.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:23 smithi092 ceph-mon[31407]: pgmap v357: 97 pgs: 97 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 20 MiB/s wr, 966 op/s 2024-09-19T08:57:23.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:23 smithi167 ceph-mon[35359]: pgmap v357: 97 pgs: 97 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 20 MiB/s wr, 966 op/s 2024-09-19T08:57:23.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:23 smithi190 ceph-mon[35358]: pgmap v357: 97 pgs: 97 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 20 MiB/s wr, 966 op/s 2024-09-19T08:57:24.215 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.215+0000 7f0696774640 1 -- 172.21.15.92:0/4198790450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06901011d0 msgr2=0x7f0690101650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:24.215 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.215+0000 7f0696774640 1 --2- 172.21.15.92:0/4198790450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06901011d0 0x7f0690101650 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f0680005fd0 tx=0x7f068002a200 comp rx=0 tx=0).stop 2024-09-19T08:57:24.215 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.215+0000 7f0696774640 1 -- 172.21.15.92:0/4198790450 shutdown_connections 2024-09-19T08:57:24.215 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.215+0000 7f0696774640 1 --2- 172.21.15.92:0/4198790450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0690101b90 0x7f0690108420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:24.215 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.215+0000 7f0696774640 1 --2- 172.21.15.92:0/4198790450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06901011d0 0x7f0690101650 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:24.215 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.215+0000 7f0696774640 1 --2- 172.21.15.92:0/4198790450 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06900fffe0 0x7f06901003e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:24.216 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.215+0000 7f0696774640 1 -- 172.21.15.92:0/4198790450 >> 172.21.15.92:0/4198790450 conn(0x7f06900fb740 msgr2=0x7f06900fdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:24.216 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.215+0000 7f0696774640 1 -- 172.21.15.92:0/4198790450 shutdown_connections 2024-09-19T08:57:24.216 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.215+0000 7f0696774640 1 -- 172.21.15.92:0/4198790450 wait complete. 2024-09-19T08:57:24.218 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.216+0000 7f0696774640 1 Processor -- start 2024-09-19T08:57:24.219 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.216+0000 7f0696774640 1 -- start start 2024-09-19T08:57:24.219 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.217+0000 7f0696774640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06900fffe0 0x7f0690195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:24.219 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.217+0000 7f0696774640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06901011d0 0x7f0690195fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:24.219 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.217+0000 7f0696774640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0690101b90 0x7f069019d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:24.219 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.217+0000 7f0696774640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f069010b410 con 0x7f06900fffe0 2024-09-19T08:57:24.219 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.217+0000 7f0696774640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f069010b290 con 0x7f0690101b90 2024-09-19T08:57:24.219 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.217+0000 7f0696774640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f069010b590 con 0x7f06901011d0 2024-09-19T08:57:24.219 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.217+0000 7f0694f71640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06901011d0 0x7f0690195fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:24.219 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.217+0000 7f0694f71640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06901011d0 0x7f0690195fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:47762/0 (socket says 172.21.15.92:47762) 2024-09-19T08:57:24.219 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.217+0000 7f0694f71640 1 -- 172.21.15.92:0/3247942962 learned_addr learned my addr 172.21.15.92:0/3247942962 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:24.219 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.217+0000 7f0695f73640 1 --2- 172.21.15.92:0/3247942962 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0690101b90 0x7f069019d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:24.219 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.218+0000 7f0694f71640 1 -- 172.21.15.92:0/3247942962 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0690101b90 msgr2=0x7f069019d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:24.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.218+0000 7f0694f71640 1 --2- 172.21.15.92:0/3247942962 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0690101b90 0x7f069019d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:24.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.218+0000 7f0695772640 1 --2- 172.21.15.92:0/3247942962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06900fffe0 0x7f0690195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:24.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.218+0000 7f0694f71640 1 -- 172.21.15.92:0/3247942962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06900fffe0 msgr2=0x7f0690195a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:24.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.218+0000 7f0694f71640 1 --2- 172.21.15.92:0/3247942962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06900fffe0 0x7f0690195a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:24.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.218+0000 7f0694f71640 1 -- 172.21.15.92:0/3247942962 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f069019d680 con 0x7f06901011d0 2024-09-19T08:57:24.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.218+0000 7f0694f71640 1 --2- 172.21.15.92:0/3247942962 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06901011d0 0x7f0690195fa0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f068000fce0 tx=0x7f0680005000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:24.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.218+0000 7f0695f73640 1 --2- 172.21.15.92:0/3247942962 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0690101b90 0x7f069019d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:57:24.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.218+0000 7f0695772640 1 --2- 172.21.15.92:0/3247942962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06900fffe0 0x7f0690195a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:57:24.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.218+0000 7f06867fc640 1 -- 172.21.15.92:0/3247942962 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0680004030 con 0x7f06901011d0 2024-09-19T08:57:24.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.218+0000 7f06867fc640 1 -- 172.21.15.92:0/3247942962 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0680040070 con 0x7f06901011d0 2024-09-19T08:57:24.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.218+0000 7f06867fc640 1 -- 172.21.15.92:0/3247942962 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06800326a0 con 0x7f06901011d0 2024-09-19T08:57:24.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.218+0000 7f0696774640 1 -- 172.21.15.92:0/3247942962 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f069019d910 con 0x7f06901011d0 2024-09-19T08:57:24.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.218+0000 7f0696774640 1 -- 172.21.15.92:0/3247942962 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f069019ddb0 con 0x7f06901011d0 2024-09-19T08:57:24.222 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.222+0000 7f06867fc640 1 -- 172.21.15.92:0/3247942962 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f068003a070 con 0x7f06901011d0 2024-09-19T08:57:24.223 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.223+0000 7f06867fc640 1 --2- 172.21.15.92:0/3247942962 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f067c0a32c0 0x7f067c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:24.223 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.223+0000 7f069a84e740 1 Processor -- start 2024-09-19T08:57:24.223 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.223+0000 7f069a84e740 1 -- start start 2024-09-19T08:57:24.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.224+0000 7f069a84e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561997ae7b70 0x561997ae7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:24.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.224+0000 7f069a84e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561997ae84b0 0x561997aecf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:24.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.224+0000 7f06867fc640 1 -- 172.21.15.92:0/3247942962 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f06800ef950 con 0x7f06901011d0 2024-09-19T08:57:24.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.224+0000 7f069a84e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561997aed540 0x561997aefa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:24.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.224+0000 7f069a84e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561997a4b2f0 con 0x561997ae7b70 2024-09-19T08:57:24.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.224+0000 7f069a84e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5619979f3270 con 0x561997ae84b0 2024-09-19T08:57:24.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.224+0000 7f069a84e740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x561997a472b0 con 0x561997aed540 2024-09-19T08:57:24.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.224+0000 7f0695772640 1 --2- 172.21.15.92:0/3247942962 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f067c0a32c0 0x7f067c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:24.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.224+0000 7f0695f73640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561997aed540 0x561997aefa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:24.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.224+0000 7f0695f73640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561997aed540 0x561997aefa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:47766/0 (socket says 172.21.15.92:47766) 2024-09-19T08:57:24.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.224+0000 7f0695f73640 1 -- 172.21.15.92:0/3818299135 learned_addr learned my addr 172.21.15.92:0/3818299135 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:24.226 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.224+0000 7f0695772640 1 --2- 172.21.15.92:0/3818299135 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561997ae7b70 0x561997ae7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:24.226 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.224+0000 7f0694f71640 1 --2- 172.21.15.92:0/3818299135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561997ae84b0 0x561997aecf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:24.226 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.224+0000 7f0695f73640 1 -- 172.21.15.92:0/3818299135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561997ae84b0 msgr2=0x561997aecf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:24.226 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.224+0000 7f0695f73640 1 --2- 172.21.15.92:0/3818299135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561997ae84b0 0x561997aecf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:24.226 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.224+0000 7f0695f73640 1 -- 172.21.15.92:0/3818299135 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561997ae7b70 msgr2=0x561997ae7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:24.226 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.224+0000 7f0695f73640 1 --2- 172.21.15.92:0/3818299135 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561997ae7b70 0x561997ae7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:24.226 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.224+0000 7f0695f73640 1 -- 172.21.15.92:0/3818299135 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619979f2340 con 0x561997aed540 2024-09-19T08:57:24.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.225+0000 7f0695772640 1 --2- 172.21.15.92:0/3247942962 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f067c0a32c0 0x7f067c0a5780 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0690101030 tx=0x7f068c009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:24.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.225+0000 7f0695f73640 1 --2- 172.21.15.92:0/3818299135 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561997aed540 0x561997aefa00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f068800bd10 tx=0x7f0688009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59033ffa64af0fd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:24.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.226+0000 7f067b7fe640 1 -- 172.21.15.92:0/3818299135 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0688023020 con 0x561997aed540 2024-09-19T08:57:24.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.226+0000 7f067b7fe640 1 -- 172.21.15.92:0/3818299135 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0688007e40 con 0x561997aed540 2024-09-19T08:57:24.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.226+0000 7f067b7fe640 1 -- 172.21.15.92:0/3818299135 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068801ea80 con 0x561997aed540 2024-09-19T08:57:24.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.227+0000 7f069a84e740 1 -- 172.21.15.92:0/3818299135 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561997aed540 msgr2=0x561997aefa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:24.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.227+0000 7f069a84e740 1 --2- 172.21.15.92:0/3818299135 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561997aed540 0x561997aefa00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f068800bd10 tx=0x7f0688009260 comp rx=0 tx=0).stop 2024-09-19T08:57:24.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.228+0000 7f069a84e740 1 -- 172.21.15.92:0/3818299135 shutdown_connections 2024-09-19T08:57:24.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.228+0000 7f069a84e740 1 --2- 172.21.15.92:0/3818299135 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561997aed540 0x561997aefa00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:24.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.228+0000 7f069a84e740 1 --2- 172.21.15.92:0/3818299135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561997ae84b0 0x561997aecf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:24.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.228+0000 7f069a84e740 1 --2- 172.21.15.92:0/3818299135 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561997ae7b70 0x561997ae7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:24.229 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.228+0000 7f069a84e740 1 -- 172.21.15.92:0/3818299135 >> 172.21.15.92:0/3818299135 conn(0x561997ae31e0 msgr2=0x561997ae35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:24.229 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.228+0000 7f069a84e740 1 -- 172.21.15.92:0/3818299135 shutdown_connections 2024-09-19T08:57:24.229 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.228+0000 7f069a84e740 1 -- 172.21.15.92:0/3818299135 wait complete. 2024-09-19T08:57:24.229 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.229+0000 7f069a84e740 1 -- start start 2024-09-19T08:57:24.229 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.229+0000 7f069a84e740 1 Processor -- start 2024-09-19T08:57:24.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.229+0000 7f069a84e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561997ae7b70 0x561997af1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:24.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.229+0000 7f069a84e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561997ae84b0 0x561997af2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:24.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.229+0000 7f069a84e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561997aed540 0x561997af9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:24.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.229+0000 7f069a84e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561997af0560 con 0x561997ae7b70 2024-09-19T08:57:24.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.229+0000 7f069a84e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5619979d4290 con 0x561997ae84b0 2024-09-19T08:57:24.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.229+0000 7f069a84e740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x561997af06e0 con 0x561997aed540 2024-09-19T08:57:24.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.229+0000 7f069a84e740 10 client.0 _ll_register_callbacks cb 0x561997a05140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:24.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.230+0000 7f0695772640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561997ae7b70 0x561997af1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:24.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.230+0000 7f0695772640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561997ae7b70 0x561997af1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46416/0 (socket says 172.21.15.92:46416) 2024-09-19T08:57:24.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.230+0000 7f0695772640 1 -- 172.21.15.92:0/4094791249 learned_addr learned my addr 172.21.15.92:0/4094791249 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:24.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.230+0000 7f0694f71640 1 --2- 172.21.15.92:0/4094791249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561997ae84b0 0x561997af2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:24.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.230+0000 7f0695f73640 1 --2- 172.21.15.92:0/4094791249 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561997aed540 0x561997af9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:24.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.230+0000 7f0695772640 1 -- 172.21.15.92:0/4094791249 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561997aed540 msgr2=0x561997af9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:24.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.230+0000 7f0695772640 1 --2- 172.21.15.92:0/4094791249 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561997aed540 0x561997af9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:24.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.230+0000 7f0695772640 1 -- 172.21.15.92:0/4094791249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561997ae84b0 msgr2=0x561997af2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:24.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.230+0000 7f0695772640 1 --2- 172.21.15.92:0/4094791249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561997ae84b0 0x561997af2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:24.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.230+0000 7f0695772640 1 -- 172.21.15.92:0/4094791249 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56199775e210 con 0x561997ae7b70 2024-09-19T08:57:24.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.230+0000 7f0694f71640 1 --2- 172.21.15.92:0/4094791249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561997ae84b0 0x561997af2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:57:24.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.231+0000 7f0695772640 1 --2- 172.21.15.92:0/4094791249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561997ae7b70 0x561997af1de0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f068c009db0 tx=0x7f068c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc1c05cd3715aaa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:24.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.231+0000 7f0678ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:57:24.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.232+0000 7f0678ff9640 1 -- 172.21.15.92:0/4094791249 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068c010610 con 0x561997ae7b70 2024-09-19T08:57:24.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.232+0000 7f0678ff9640 1 -- 172.21.15.92:0/4094791249 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f068c0107b0 con 0x561997ae7b70 2024-09-19T08:57:24.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.232+0000 7f069a84e740 1 -- 172.21.15.92:0/4094791249 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561997a58a20 con 0x561997ae7b70 2024-09-19T08:57:24.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.233+0000 7f0678ff9640 1 -- 172.21.15.92:0/4094791249 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f068c0109b0 con 0x561997ae7b70 2024-09-19T08:57:24.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.233+0000 7f069a84e740 10 client.15444 fetch_fsmap learned FSMap version 19 2024-09-19T08:57:24.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.233+0000 7f069a84e740 1 -- 172.21.15.92:0/4094791249 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56199782a620 con 0x561997ae7b70 2024-09-19T08:57:24.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.233+0000 7f0678ff9640 1 -- 172.21.15.92:0/4094791249 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x561997a58a20 con 0x561997ae7b70 2024-09-19T08:57:24.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.233+0000 7f0678ff9640 1 -- 172.21.15.92:0/4094791249 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f068c00f040 con 0x561997ae7b70 2024-09-19T08:57:24.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.233+0000 7f069a84e740 10 client.15444 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:57:24.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.233+0000 7f069a84e740 10 client.15444 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T08:57:24.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.233+0000 7f069a84e740 20 client.15444 populate_metadata read hostname 'smithi092' 2024-09-19T08:57:24.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.233+0000 7f069a84e740 1 --2- 172.21.15.92:0/4094791249 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561997b0eae0 0x561997b10f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:24.236 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.233+0000 7f069a84e740 4 client.15444 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:57:24.236 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.233+0000 7f069a84e740 1 -- 172.21.15.92:0/4094791249 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561997a52d70 con 0x561997b0eae0 2024-09-19T08:57:24.236 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.234+0000 7f0694f71640 1 --2- 172.21.15.92:0/4094791249 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561997b0eae0 0x561997b10f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:24.236 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.234+0000 7f0678ff9640 10 client.15444 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:24.236 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.234+0000 7f0694f71640 1 --2- 172.21.15.92:0/4094791249 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561997b0eae0 0x561997b10f10 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb71212532ace4dd server_cookie=64e9ae4fbfc0c13c in_seq=0 out_seq=0 2024-09-19T08:57:24.237 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.235+0000 7f0678ff9640 1 -- 172.21.15.92:0/4094791249 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561997a52d70 con 0x561997b0eae0 2024-09-19T08:57:24.237 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.235+0000 7f0678ff9640 10 client.15444 handle_command_reply: tid=0 2024-09-19T08:57:24.237 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.235+0000 7f069a84e740 1 client.15444 shutdown 2024-09-19T08:57:24.237 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.235+0000 7f069a84e740 1 -- 172.21.15.92:0/4094791249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561997ae7b70 msgr2=0x561997af1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:24.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.235+0000 7f069a84e740 1 --2- 172.21.15.92:0/4094791249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561997ae7b70 0x561997af1de0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f068c009db0 tx=0x7f068c005f90 comp rx=0 tx=0).stop 2024-09-19T08:57:24.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.235+0000 7f069a84e740 1 -- 172.21.15.92:0/4094791249 shutdown_connections 2024-09-19T08:57:24.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.235+0000 7f069a84e740 1 --2- 172.21.15.92:0/4094791249 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561997b0eae0 0x561997b10f10 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:24.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.235+0000 7f069a84e740 1 --2- 172.21.15.92:0/4094791249 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561997aed540 0x561997af9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:24.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.235+0000 7f069a84e740 1 --2- 172.21.15.92:0/4094791249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561997ae84b0 0x561997af2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:24.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.235+0000 7f069a84e740 1 --2- 172.21.15.92:0/4094791249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561997ae7b70 0x561997af1de0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:24.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.235+0000 7f069a84e740 1 -- 172.21.15.92:0/4094791249 >> 172.21.15.92:0/4094791249 conn(0x561997ae31e0 msgr2=0x561997ae49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:24.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.235+0000 7f0678ff9640 0 client.15444 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:24.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.236+0000 7f069a84e740 1 -- 172.21.15.92:0/4094791249 shutdown_connections 2024-09-19T08:57:24.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.236+0000 7f069a84e740 1 -- 172.21.15.92:0/4094791249 wait complete. 2024-09-19T08:57:24.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.236+0000 7f069a84e740 20 client.15444 trim_cache size 0 max 16384 2024-09-19T08:57:24.263 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.262+0000 7f069a84e740 1 Processor -- start 2024-09-19T08:57:24.263 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.262+0000 7f069a84e740 1 -- start start 2024-09-19T08:57:24.263 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.263+0000 7f069a84e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561997ae7b70 0x561997b108c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:24.263 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.263+0000 7f069a84e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561997ae84b0 0x561997af9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:24.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.263+0000 7f069a84e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561997aed540 0x561997b10e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:24.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.263+0000 7f0695772640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561997ae7b70 0x561997b108c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:24.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.263+0000 7f069a84e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0690072900 con 0x561997ae7b70 2024-09-19T08:57:24.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.263+0000 7f0695772640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561997ae7b70 0x561997b108c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46430/0 (socket says 172.21.15.92:46430) 2024-09-19T08:57:24.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.263+0000 7f0695772640 1 -- 172.21.15.92:0/1573698095 learned_addr learned my addr 172.21.15.92:0/1573698095 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:24.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.263+0000 7f0694f71640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561997ae84b0 0x561997af9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:24.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.263+0000 7f069a84e740 1 -- 172.21.15.92:0/1573698095 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f069019edf0 con 0x561997ae84b0 2024-09-19T08:57:24.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.263+0000 7f069a84e740 1 -- 172.21.15.92:0/1573698095 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0690072f90 con 0x561997aed540 2024-09-19T08:57:24.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.263+0000 7f0695f73640 1 --2- 172.21.15.92:0/1573698095 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561997aed540 0x561997b10e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:24.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.264+0000 7f0694f71640 1 -- 172.21.15.92:0/1573698095 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561997aed540 msgr2=0x561997b10e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:24.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.264+0000 7f0694f71640 1 --2- 172.21.15.92:0/1573698095 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561997aed540 0x561997b10e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:24.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.264+0000 7f0694f71640 1 -- 172.21.15.92:0/1573698095 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561997ae7b70 msgr2=0x561997b108c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:24.265 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.264+0000 7f0694f71640 1 --2- 172.21.15.92:0/1573698095 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561997ae7b70 0x561997b108c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:24.265 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.264+0000 7f0694f71640 1 -- 172.21.15.92:0/1573698095 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561997af1920 con 0x561997ae84b0 2024-09-19T08:57:24.265 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.264+0000 7f0694f71640 1 --2- 172.21.15.92:0/1573698095 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561997ae84b0 0x561997af9320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0680004940 tx=0x7f0680047040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92275114dddd9088 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:24.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.264+0000 7f067affd640 1 -- 172.21.15.92:0/1573698095 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06800bc630 con 0x561997ae84b0 2024-09-19T08:57:24.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.264+0000 7f067affd640 1 -- 172.21.15.92:0/1573698095 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06800bbf30 con 0x561997ae84b0 2024-09-19T08:57:24.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.264+0000 7f067affd640 1 -- 172.21.15.92:0/1573698095 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06800043f0 con 0x561997ae84b0 2024-09-19T08:57:24.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.265+0000 7f069a84e740 1 -- 172.21.15.92:0/1573698095 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561997ae84b0 msgr2=0x561997af9320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:24.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.265+0000 7f069a84e740 1 --2- 172.21.15.92:0/1573698095 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561997ae84b0 0x561997af9320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0680004940 tx=0x7f0680047040 comp rx=0 tx=0).stop 2024-09-19T08:57:24.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.267+0000 7f069a84e740 1 -- 172.21.15.92:0/1573698095 shutdown_connections 2024-09-19T08:57:24.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.268+0000 7f069a84e740 1 --2- 172.21.15.92:0/1573698095 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561997aed540 0x561997b10e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:24.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.268+0000 7f069a84e740 1 --2- 172.21.15.92:0/1573698095 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561997ae84b0 0x561997af9320 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:24.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.268+0000 7f069a84e740 1 --2- 172.21.15.92:0/1573698095 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561997ae7b70 0x561997b108c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:24.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.268+0000 7f069a84e740 1 -- 172.21.15.92:0/1573698095 >> 172.21.15.92:0/1573698095 conn(0x561997ae31e0 msgr2=0x561997ae9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:24.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.270+0000 7f069a84e740 1 -- 172.21.15.92:0/1573698095 shutdown_connections 2024-09-19T08:57:24.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.270+0000 7f069a84e740 1 -- 172.21.15.92:0/1573698095 wait complete. 2024-09-19T08:57:24.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.270+0000 7f069a84e740 1 -- start start 2024-09-19T08:57:24.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.271+0000 7f069a84e740 1 Processor -- start 2024-09-19T08:57:24.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.271+0000 7f069a84e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561997ae7b70 0x561997af9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:24.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.271+0000 7f069a84e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561997ae84b0 0x561997af5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:24.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.272+0000 7f069a84e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561997aed540 0x561997af6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:24.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.272+0000 7f069a84e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0690073660 con 0x561997ae7b70 2024-09-19T08:57:24.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.272+0000 7f069a84e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f069019e720 con 0x561997ae84b0 2024-09-19T08:57:24.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.272+0000 7f069a84e740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0690073d30 con 0x561997aed540 2024-09-19T08:57:24.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.272+0000 7f0695f73640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561997aed540 0x561997af6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:24.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.272+0000 7f0695f73640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561997aed540 0x561997af6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:47792/0 (socket says 172.21.15.92:47792) 2024-09-19T08:57:24.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.272+0000 7f0695f73640 1 -- 172.21.15.92:0/3289323257 learned_addr learned my addr 172.21.15.92:0/3289323257 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:24.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.272+0000 7f069a84e740 10 client.0 _ll_register_callbacks cb 0x7f068c009d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:24.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.272+0000 7f0695f73640 1 -- 172.21.15.92:0/3289323257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561997ae84b0 msgr2=0x561997af5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:24.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.272+0000 7f0695f73640 1 --2- 172.21.15.92:0/3289323257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561997ae84b0 0x561997af5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:24.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.272+0000 7f0695f73640 1 -- 172.21.15.92:0/3289323257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561997ae7b70 msgr2=0x561997af9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:24.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.272+0000 7f0695f73640 1 --2- 172.21.15.92:0/3289323257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561997ae7b70 0x561997af9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:24.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.273+0000 7f0695f73640 1 -- 172.21.15.92:0/3289323257 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561997b77810 con 0x561997aed540 2024-09-19T08:57:24.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.274+0000 7f0695f73640 1 --2- 172.21.15.92:0/3289323257 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561997aed540 0x561997af6390 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f068800bd10 tx=0x7f0688005280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e41df15b4338185 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:24.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.274+0000 7f0678ff9640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T08:57:24.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.277+0000 7f0678ff9640 1 -- 172.21.15.92:0/3289323257 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0688038060 con 0x561997aed540 2024-09-19T08:57:24.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.277+0000 7f069a84e740 1 -- 172.21.15.92:0/3289323257 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06800bbf30 con 0x561997aed540 2024-09-19T08:57:24.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.277+0000 7f0678ff9640 1 -- 172.21.15.92:0/3289323257 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f06880055f0 con 0x561997aed540 2024-09-19T08:57:24.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.277+0000 7f0678ff9640 1 -- 172.21.15.92:0/3289323257 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f0688023040 con 0x561997aed540 2024-09-19T08:57:24.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.277+0000 7f069a84e740 10 client.24964 fetch_fsmap learned FSMap version 19 2024-09-19T08:57:24.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.277+0000 7f069a84e740 1 -- 172.21.15.92:0/3289323257 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x561997b78b70 con 0x561997aed540 2024-09-19T08:57:24.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.278+0000 7f0678ff9640 1 -- 172.21.15.92:0/3289323257 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06880057f0 con 0x561997aed540 2024-09-19T08:57:24.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.278+0000 7f0678ff9640 1 -- 172.21.15.92:0/3289323257 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f068803d070 con 0x561997aed540 2024-09-19T08:57:24.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.278+0000 7f069a84e740 10 client.24964 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:57:24.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.278+0000 7f069a84e740 10 client.24964 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T08:57:24.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.278+0000 7f069a84e740 20 client.24964 populate_metadata read hostname 'smithi092' 2024-09-19T08:57:24.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.278+0000 7f069a84e740 1 --2- 172.21.15.92:0/3289323257 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561997b79500 0x561997b7b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:24.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.278+0000 7f069a84e740 4 client.24964 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:57:24.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.278+0000 7f069a84e740 1 -- 172.21.15.92:0/3289323257 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f06800bbf30 con 0x561997b79500 2024-09-19T08:57:24.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.279+0000 7f0695772640 1 --2- 172.21.15.92:0/3289323257 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561997b79500 0x561997b7b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:24.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.281+0000 7f0695772640 1 --2- 172.21.15.92:0/3289323257 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561997b79500 0x561997b7b980 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2e72410de47928e server_cookie=7411ec98b9426e88 in_seq=0 out_seq=0 2024-09-19T08:57:24.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.281+0000 7f0678ff9640 10 client.24964 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:24.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.306+0000 7f0678ff9640 1 -- 172.21.15.92:0/3289323257 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f06800bbf30 con 0x561997b79500 2024-09-19T08:57:24.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.306+0000 7f0678ff9640 10 client.24964 handle_command_reply: tid=0 2024-09-19T08:57:24.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.306+0000 7f069a84e740 1 client.24964 shutdown 2024-09-19T08:57:24.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.306+0000 7f069a84e740 1 -- 172.21.15.92:0/3289323257 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561997aed540 msgr2=0x561997af6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:24.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.306+0000 7f069a84e740 1 --2- 172.21.15.92:0/3289323257 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561997aed540 0x561997af6390 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f068800bd10 tx=0x7f0688005280 comp rx=0 tx=0).stop 2024-09-19T08:57:24.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.306+0000 7f069a84e740 1 -- 172.21.15.92:0/3289323257 shutdown_connections 2024-09-19T08:57:24.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.306+0000 7f069a84e740 1 --2- 172.21.15.92:0/3289323257 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561997b79500 0x561997b7b980 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:24.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.306+0000 7f069a84e740 1 --2- 172.21.15.92:0/3289323257 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561997aed540 0x561997af6390 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:24.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.306+0000 7f0678ff9640 0 client.24964 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:24.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.306+0000 7f069a84e740 1 --2- 172.21.15.92:0/3289323257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561997ae84b0 0x561997af5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:24.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.306+0000 7f069a84e740 1 --2- 172.21.15.92:0/3289323257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561997ae7b70 0x561997af9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:24.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.306+0000 7f069a84e740 1 -- 172.21.15.92:0/3289323257 >> 172.21.15.92:0/3289323257 conn(0x561997ae31e0 msgr2=0x561997af1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:24.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.306+0000 7f069a84e740 1 -- 172.21.15.92:0/3289323257 shutdown_connections 2024-09-19T08:57:24.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.306+0000 7f069a84e740 1 -- 172.21.15.92:0/3289323257 wait complete. 2024-09-19T08:57:24.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.306+0000 7f069a84e740 20 client.24964 trim_cache size 0 max 16384 2024-09-19T08:57:24.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T08:57:24.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T08:57:24.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T08:57:24.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T08:57:24.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.307+0000 7f0696774640 1 -- 172.21.15.92:0/3247942962 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f067c0a32c0 msgr2=0x7f067c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:24.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.307+0000 7f0696774640 1 --2- 172.21.15.92:0/3247942962 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f067c0a32c0 0x7f067c0a5780 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0690101030 tx=0x7f068c009680 comp rx=0 tx=0).stop 2024-09-19T08:57:24.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.307+0000 7f0696774640 1 -- 172.21.15.92:0/3247942962 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06901011d0 msgr2=0x7f0690195fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:24.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.307+0000 7f0696774640 1 --2- 172.21.15.92:0/3247942962 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06901011d0 0x7f0690195fa0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f068000fce0 tx=0x7f0680005000 comp rx=0 tx=0).stop 2024-09-19T08:57:24.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.308+0000 7f0696774640 1 -- 172.21.15.92:0/3247942962 shutdown_connections 2024-09-19T08:57:24.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.308+0000 7f0696774640 1 --2- 172.21.15.92:0/3247942962 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0690101b90 0x7f069019d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:24.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.308+0000 7f0696774640 1 --2- 172.21.15.92:0/3247942962 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06901011d0 0x7f0690195fa0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:24.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.308+0000 7f0696774640 1 --2- 172.21.15.92:0/3247942962 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f067c0a32c0 0x7f067c0a5780 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:24.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.308+0000 7f0696774640 1 --2- 172.21.15.92:0/3247942962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06900fffe0 0x7f0690195a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:24.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.308+0000 7f0696774640 1 -- 172.21.15.92:0/3247942962 >> 172.21.15.92:0/3247942962 conn(0x7f06900fb740 msgr2=0x7f06900fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:24.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.309+0000 7f0696774640 1 -- 172.21.15.92:0/3247942962 shutdown_connections 2024-09-19T08:57:24.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:24.309+0000 7f0696774640 1 -- 172.21.15.92:0/3247942962 wait complete. 2024-09-19T08:57:25.646 INFO:tasks.quiescer.fs.[cephfs]:Total duration (40.7) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T08:57:25.646 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-09-19T08:57:25.647 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:57:25.685 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:25 smithi092 ceph-mon[31407]: pgmap v358: 97 pgs: 97 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 MiB/s wr, 1.13k op/s 2024-09-19T08:57:25.797 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 40.0 s, 5606.8 tps, lat 17.801 ms stddev 19.383 2024-09-19T08:57:25.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:25 smithi167 ceph-mon[35359]: pgmap v358: 97 pgs: 97 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 MiB/s wr, 1.13k op/s 2024-09-19T08:57:25.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:25 smithi190 ceph-mon[35358]: pgmap v358: 97 pgs: 97 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 MiB/s wr, 1.13k op/s 2024-09-19T08:57:26.088 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:57:26.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.660+0000 7f8ba3fff640 1 -- 172.21.15.92:0/3743298136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ba4074590 msgr2=0x7f8ba4074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:26.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.660+0000 7f8ba3fff640 1 --2- 172.21.15.92:0/3743298136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ba4074590 0x7f8ba4074970 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c009900 tx=0x7f8b8c02a480 comp rx=0 tx=0).stop 2024-09-19T08:57:26.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.660+0000 7f8ba3fff640 1 -- 172.21.15.92:0/3743298136 shutdown_connections 2024-09-19T08:57:26.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.660+0000 7f8ba3fff640 1 --2- 172.21.15.92:0/3743298136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ba41129b0 0x7f8ba4114da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:26.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.660+0000 7f8ba3fff640 1 --2- 172.21.15.92:0/3743298136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ba4074eb0 0x7f8ba4112470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:26.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.660+0000 7f8ba3fff640 1 --2- 172.21.15.92:0/3743298136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ba4074590 0x7f8ba4074970 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:26.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.660+0000 7f8ba3fff640 1 -- 172.21.15.92:0/3743298136 >> 172.21.15.92:0/3743298136 conn(0x7f8ba40fd700 msgr2=0x7f8ba40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:26.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.663+0000 7f8ba3fff640 1 -- 172.21.15.92:0/3743298136 shutdown_connections 2024-09-19T08:57:26.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.664+0000 7f8ba3fff640 1 -- 172.21.15.92:0/3743298136 wait complete. 2024-09-19T08:57:26.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.665+0000 7f8ba3fff640 1 Processor -- start 2024-09-19T08:57:26.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.666+0000 7f8ba3fff640 1 -- start start 2024-09-19T08:57:26.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.666+0000 7f8ba3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ba4074590 0x7f8ba4111fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:26.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.666+0000 7f8ba3fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ba4074eb0 0x7f8ba410b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:26.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.666+0000 7f8ba3fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ba41129b0 0x7f8ba410b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:26.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.666+0000 7f8ba3fff640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba41183c0 con 0x7f8ba4074590 2024-09-19T08:57:26.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.666+0000 7f8ba3fff640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba4118240 con 0x7f8ba41129b0 2024-09-19T08:57:26.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.666+0000 7f8ba3fff640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba4118540 con 0x7f8ba4074eb0 2024-09-19T08:57:26.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.666+0000 7f8ba2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ba4074590 0x7f8ba4111fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:26.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.667+0000 7f8ba37fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ba41129b0 0x7f8ba410b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:26.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.667+0000 7f8ba2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ba4074590 0x7f8ba4111fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46454/0 (socket says 172.21.15.92:46454) 2024-09-19T08:57:26.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.667+0000 7f8ba2ffd640 1 -- 172.21.15.92:0/218884464 learned_addr learned my addr 172.21.15.92:0/218884464 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:26.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.667+0000 7f8ba37fe640 1 -- 172.21.15.92:0/218884464 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ba4074eb0 msgr2=0x7f8ba410b030 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:57:26.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.667+0000 7f8ba37fe640 1 --2- 172.21.15.92:0/218884464 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ba4074eb0 0x7f8ba410b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:26.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.667+0000 7f8ba37fe640 1 -- 172.21.15.92:0/218884464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ba4074590 msgr2=0x7f8ba4111fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:26.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.667+0000 7f8ba37fe640 1 --2- 172.21.15.92:0/218884464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ba4074590 0x7f8ba4111fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:26.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.667+0000 7f8ba37fe640 1 -- 172.21.15.92:0/218884464 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba410bb60 con 0x7f8ba41129b0 2024-09-19T08:57:26.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.668+0000 7f8ba37fe640 1 --2- 172.21.15.92:0/218884464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ba41129b0 0x7f8ba410b570 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c00d650 tx=0x7f8b9c00db10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:26.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.668+0000 7f8b9bfff640 1 -- 172.21.15.92:0/218884464 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c017070 con 0x7f8ba41129b0 2024-09-19T08:57:26.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.669+0000 7f8ba3fff640 1 -- 172.21.15.92:0/218884464 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ba410be50 con 0x7f8ba41129b0 2024-09-19T08:57:26.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.669+0000 7f8ba3fff640 1 -- 172.21.15.92:0/218884464 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ba410fe40 con 0x7f8ba41129b0 2024-09-19T08:57:26.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.669+0000 7f8b9bfff640 1 -- 172.21.15.92:0/218884464 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b9c009820 con 0x7f8ba41129b0 2024-09-19T08:57:26.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.669+0000 7f8b9bfff640 1 -- 172.21.15.92:0/218884464 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c004d00 con 0x7f8ba41129b0 2024-09-19T08:57:26.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.672+0000 7f8ba3fff640 1 -- 172.21.15.92:0/218884464 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b84005290 con 0x7f8ba41129b0 2024-09-19T08:57:26.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.673+0000 7f8b9bfff640 1 -- 172.21.15.92:0/218884464 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8b9c010460 con 0x7f8ba41129b0 2024-09-19T08:57:26.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.674+0000 7f8b9bfff640 1 --2- 172.21.15.92:0/218884464 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8b900a3410 0x7f8b900a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:26.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.674+0000 7f8b9bfff640 1 -- 172.21.15.92:0/218884464 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8b9c0cf020 con 0x7f8ba41129b0 2024-09-19T08:57:26.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.675+0000 7f8ba2ffd640 1 --2- 172.21.15.92:0/218884464 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8b900a3410 0x7f8b900a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:26.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.675+0000 7f8ba2ffd640 1 --2- 172.21.15.92:0/218884464 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8b900a3410 0x7f8b900a58d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c0096c0 tx=0x7f8b8c0046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:26.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:26.678+0000 7f8b9bfff640 1 -- 172.21.15.92:0/218884464 <== mon.2 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8b9c09bd40 con 0x7f8ba41129b0 2024-09-19T08:57:27.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:27.095+0000 7f8ba3fff640 1 -- 172.21.15.92:0/218884464 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b84005580 con 0x7f8ba41129b0 2024-09-19T08:57:27.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:27.097+0000 7f8b9bfff640 1 -- 172.21.15.92:0/218884464 <== mon.2 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f8b9c09f9b0 con 0x7f8ba41129b0 2024-09-19T08:57:27.097 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:57:27.097 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T08:57:27.097 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T08:57:27.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:27.100+0000 7f8ba3fff640 1 -- 172.21.15.92:0/218884464 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8b900a3410 msgr2=0x7f8b900a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:27.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:27.100+0000 7f8ba3fff640 1 --2- 172.21.15.92:0/218884464 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8b900a3410 0x7f8b900a58d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c0096c0 tx=0x7f8b8c0046c0 comp rx=0 tx=0).stop 2024-09-19T08:57:27.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:27.100+0000 7f8ba3fff640 1 -- 172.21.15.92:0/218884464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ba41129b0 msgr2=0x7f8ba410b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:27.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:27.100+0000 7f8ba3fff640 1 --2- 172.21.15.92:0/218884464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ba41129b0 0x7f8ba410b570 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c00d650 tx=0x7f8b9c00db10 comp rx=0 tx=0).stop 2024-09-19T08:57:27.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:27.101+0000 7f8ba3fff640 1 -- 172.21.15.92:0/218884464 shutdown_connections 2024-09-19T08:57:27.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:27.101+0000 7f8ba3fff640 1 --2- 172.21.15.92:0/218884464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ba41129b0 0x7f8ba410b570 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:27.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:27.101+0000 7f8ba3fff640 1 --2- 172.21.15.92:0/218884464 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ba4074eb0 0x7f8ba410b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:27.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:27.101+0000 7f8ba3fff640 1 --2- 172.21.15.92:0/218884464 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8b900a3410 0x7f8b900a58d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:27.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:27.101+0000 7f8ba3fff640 1 --2- 172.21.15.92:0/218884464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ba4074590 0x7f8ba4111fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:27.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:27.101+0000 7f8ba3fff640 1 -- 172.21.15.92:0/218884464 >> 172.21.15.92:0/218884464 conn(0x7f8ba40fd700 msgr2=0x7f8ba40fef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:27.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:27.101+0000 7f8ba3fff640 1 -- 172.21.15.92:0/218884464 shutdown_connections 2024-09-19T08:57:27.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:27.102+0000 7f8ba3fff640 1 -- 172.21.15.92:0/218884464 wait complete. 2024-09-19T08:57:27.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:27 smithi092 ceph-mon[31407]: pgmap v359: 97 pgs: 97 active+clean; 1013 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 19 MiB/s wr, 927 op/s 2024-09-19T08:57:27.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:27 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/218884464' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:57:27.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:27 smithi167 ceph-mon[35359]: pgmap v359: 97 pgs: 97 active+clean; 1013 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 19 MiB/s wr, 927 op/s 2024-09-19T08:57:27.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:27 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/218884464' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:57:27.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:27 smithi190 ceph-mon[35358]: pgmap v359: 97 pgs: 97 active+clean; 1013 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 19 MiB/s wr, 927 op/s 2024-09-19T08:57:27.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:27 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/218884464' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:57:27.953 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-09-19T08:57:27.953 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-09-19T08:57:28.434 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:57:29.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.046+0000 7fc75cec9640 1 -- 172.21.15.92:0/4156585695 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc758102570 msgr2=0x7fc7581029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:29.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.047+0000 7fc75cec9640 1 --2- 172.21.15.92:0/4156585695 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc758102570 0x7fc7581029b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc74c0098f0 tx=0x7fc74c02c630 comp rx=0 tx=0).stop 2024-09-19T08:57:29.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.047+0000 7fc75cec9640 1 -- 172.21.15.92:0/4156585695 shutdown_connections 2024-09-19T08:57:29.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.047+0000 7fc75cec9640 1 --2- 172.21.15.92:0/4156585695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc758102ef0 0x7fc75810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:29.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.047+0000 7fc75cec9640 1 --2- 172.21.15.92:0/4156585695 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc758102570 0x7fc7581029b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:29.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.047+0000 7fc75cec9640 1 --2- 172.21.15.92:0/4156585695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc758100e20 0x7fc758101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:29.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.047+0000 7fc75cec9640 1 -- 172.21.15.92:0/4156585695 >> 172.21.15.92:0/4156585695 conn(0x7fc7580fc7d0 msgr2=0x7fc7580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:29.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.048+0000 7fc75cec9640 1 -- 172.21.15.92:0/4156585695 shutdown_connections 2024-09-19T08:57:29.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.048+0000 7fc75cec9640 1 -- 172.21.15.92:0/4156585695 wait complete. 2024-09-19T08:57:29.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.049+0000 7fc75cec9640 1 Processor -- start 2024-09-19T08:57:29.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.049+0000 7fc75cec9640 1 -- start start 2024-09-19T08:57:29.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.049+0000 7fc75cec9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc758100e20 0x7fc75819a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:29.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.049+0000 7fc75cec9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc758102570 0x7fc75819ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:29.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.049+0000 7fc75cec9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc758102ef0 0x7fc75819efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:29.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.049+0000 7fc75cec9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc75810fe40 con 0x7fc758102570 2024-09-19T08:57:29.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.049+0000 7fc75cec9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc75810fcc0 con 0x7fc758102ef0 2024-09-19T08:57:29.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.049+0000 7fc75cec9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc75810ffc0 con 0x7fc758100e20 2024-09-19T08:57:29.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.049+0000 7fc755d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc758102570 0x7fc75819ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:29.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.049+0000 7fc75659c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc758100e20 0x7fc75819a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:29.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.049+0000 7fc755d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc758102570 0x7fc75819ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46480/0 (socket says 172.21.15.92:46480) 2024-09-19T08:57:29.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.049+0000 7fc755d9b640 1 -- 172.21.15.92:0/2747318407 learned_addr learned my addr 172.21.15.92:0/2747318407 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:29.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.049+0000 7fc756d9d640 1 --2- 172.21.15.92:0/2747318407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc758102ef0 0x7fc75819efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:29.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.050+0000 7fc755d9b640 1 -- 172.21.15.92:0/2747318407 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc758100e20 msgr2=0x7fc75819a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:29.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.050+0000 7fc755d9b640 1 --2- 172.21.15.92:0/2747318407 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc758100e20 0x7fc75819a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:29.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.050+0000 7fc755d9b640 1 -- 172.21.15.92:0/2747318407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc758102ef0 msgr2=0x7fc75819efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:29.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.050+0000 7fc755d9b640 1 --2- 172.21.15.92:0/2747318407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc758102ef0 0x7fc75819efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:29.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.050+0000 7fc755d9b640 1 -- 172.21.15.92:0/2747318407 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc75819f6b0 con 0x7fc758102570 2024-09-19T08:57:29.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.050+0000 7fc75659c640 1 --2- 172.21.15.92:0/2747318407 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc758100e20 0x7fc75819a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:57:29.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.050+0000 7fc756d9d640 1 --2- 172.21.15.92:0/2747318407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc758102ef0 0x7fc75819efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:57:29.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.050+0000 7fc755d9b640 1 --2- 172.21.15.92:0/2747318407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc758102570 0x7fc75819ac40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc74c009a10 tx=0x7fc74c004350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:29.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.051+0000 7fc7477fe640 1 -- 172.21.15.92:0/2747318407 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc74c041070 con 0x7fc758102570 2024-09-19T08:57:29.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.051+0000 7fc7477fe640 1 -- 172.21.15.92:0/2747318407 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc74c005530 con 0x7fc758102570 2024-09-19T08:57:29.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.051+0000 7fc75cec9640 1 -- 172.21.15.92:0/2747318407 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc75819f940 con 0x7fc758102570 2024-09-19T08:57:29.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.052+0000 7fc7477fe640 1 -- 172.21.15.92:0/2747318407 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc74c033600 con 0x7fc758102570 2024-09-19T08:57:29.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.052+0000 7fc75cec9640 1 -- 172.21.15.92:0/2747318407 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7581a7280 con 0x7fc758102570 2024-09-19T08:57:29.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.055+0000 7fc75f2a2740 1 Processor -- start 2024-09-19T08:57:29.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.055+0000 7fc75f2a2740 1 -- start start 2024-09-19T08:57:29.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.056+0000 7fc75f2a2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dae654770 0x559dae654b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:29.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.056+0000 7fc75f2a2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559dae655090 0x559dae667d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:29.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.056+0000 7fc75f2a2740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559dae668240 0x559dae66a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:29.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.056+0000 7fc75f2a2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559dae5b9160 con 0x559dae655090 2024-09-19T08:57:29.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.056+0000 7fc75f2a2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559dae560720 con 0x559dae654770 2024-09-19T08:57:29.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.056+0000 7fc75f2a2740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x559dae5b5120 con 0x559dae668240 2024-09-19T08:57:29.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.056+0000 7fc75659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559dae655090 0x559dae667d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:29.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.056+0000 7fc75659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559dae655090 0x559dae667d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46484/0 (socket says 172.21.15.92:46484) 2024-09-19T08:57:29.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.056+0000 7fc75659c640 1 -- 172.21.15.92:0/195410003 learned_addr learned my addr 172.21.15.92:0/195410003 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:29.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.056+0000 7fc756d9d640 1 --2- 172.21.15.92:0/195410003 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dae654770 0x559dae654b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:29.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.056+0000 7fc75659c640 1 -- 172.21.15.92:0/195410003 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559dae668240 msgr2=0x559dae66a630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T08:57:29.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.056+0000 7fc75659c640 1 --2- 172.21.15.92:0/195410003 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559dae668240 0x559dae66a630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:29.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.056+0000 7fc75659c640 1 -- 172.21.15.92:0/195410003 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dae654770 msgr2=0x559dae654b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:29.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.056+0000 7fc75659c640 1 --2- 172.21.15.92:0/195410003 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dae654770 0x559dae654b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:29.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.056+0000 7fc75659c640 1 -- 172.21.15.92:0/195410003 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dae32aba0 con 0x559dae655090 2024-09-19T08:57:29.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.057+0000 7fc7477fe640 1 -- 172.21.15.92:0/2747318407 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc74c044070 con 0x7fc758102570 2024-09-19T08:57:29.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.058+0000 7fc75659c640 1 --2- 172.21.15.92:0/195410003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559dae655090 0x559dae667d00 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc7480104d0 tx=0x7fc748010990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3b02d4d581f2a88 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:29.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.058+0000 7fc744ff9640 1 -- 172.21.15.92:0/195410003 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc748004220 con 0x559dae655090 2024-09-19T08:57:29.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.058+0000 7fc744ff9640 1 -- 172.21.15.92:0/195410003 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7480043c0 con 0x559dae655090 2024-09-19T08:57:29.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.058+0000 7fc744ff9640 1 -- 172.21.15.92:0/195410003 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc748011bd0 con 0x559dae655090 2024-09-19T08:57:29.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.059+0000 7fc7477fe640 1 --2- 172.21.15.92:0/2747318407 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc7400a3410 0x7fc7400a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:29.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.059+0000 7fc75f2a2740 1 -- 172.21.15.92:0/195410003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559dae655090 msgr2=0x559dae667d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:29.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.059+0000 7fc75f2a2740 1 --2- 172.21.15.92:0/195410003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559dae655090 0x559dae667d00 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc7480104d0 tx=0x7fc748010990 comp rx=0 tx=0).stop 2024-09-19T08:57:29.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.060+0000 7fc75f2a2740 1 -- 172.21.15.92:0/195410003 shutdown_connections 2024-09-19T08:57:29.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.060+0000 7fc75f2a2740 1 --2- 172.21.15.92:0/195410003 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559dae668240 0x559dae66a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:29.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.060+0000 7fc75f2a2740 1 --2- 172.21.15.92:0/195410003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559dae655090 0x559dae667d00 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:29.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.060+0000 7fc75f2a2740 1 --2- 172.21.15.92:0/195410003 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dae654770 0x559dae654b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:29.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.060+0000 7fc75f2a2740 1 -- 172.21.15.92:0/195410003 >> 172.21.15.92:0/195410003 conn(0x559dae650de0 msgr2=0x559dae6511c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:29.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.060+0000 7fc75f2a2740 1 -- 172.21.15.92:0/195410003 shutdown_connections 2024-09-19T08:57:29.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.060+0000 7fc756d9d640 1 --2- 172.21.15.92:0/2747318407 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc7400a3410 0x7fc7400a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:29.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.060+0000 7fc75f2a2740 1 -- 172.21.15.92:0/195410003 wait complete. 2024-09-19T08:57:29.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.061+0000 7fc7477fe640 1 -- 172.21.15.92:0/2747318407 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc74c0f08f0 con 0x7fc758102570 2024-09-19T08:57:29.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.061+0000 7fc75f2a2740 1 -- start start 2024-09-19T08:57:29.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.061+0000 7fc75f2a2740 1 Processor -- start 2024-09-19T08:57:29.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.061+0000 7fc756d9d640 1 --2- 172.21.15.92:0/2747318407 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc7400a3410 0x7fc7400a58d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc750005fd0 tx=0x7fc7500095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:29.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.062+0000 7fc75f2a2740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559dae654770 0x559dae665230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:29.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.062+0000 7fc75f2a2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559dae655090 0x559dae665770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:29.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.062+0000 7fc75f2a2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dae668240 0x559dae665cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:29.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.062+0000 7fc75f2a2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559dae66adb0 con 0x559dae655090 2024-09-19T08:57:29.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.062+0000 7fc75f2a2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559dae541900 con 0x559dae668240 2024-09-19T08:57:29.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.062+0000 7fc75f2a2740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x559dae66af30 con 0x559dae654770 2024-09-19T08:57:29.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.062+0000 7fc75f2a2740 10 client.0 _ll_register_callbacks cb 0x559dae53f780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:29.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.062+0000 7fc75659c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559dae654770 0x559dae665230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:29.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.062+0000 7fc756d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dae668240 0x559dae665cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:29.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.062+0000 7fc755d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559dae655090 0x559dae665770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:29.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.062+0000 7fc756d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dae668240 0x559dae665cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:45894/0 (socket says 172.21.15.92:45894) 2024-09-19T08:57:29.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.062+0000 7fc756d9d640 1 -- 172.21.15.92:0/4879904 learned_addr learned my addr 172.21.15.92:0/4879904 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:29.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.062+0000 7fc75659c640 1 -- 172.21.15.92:0/4879904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dae668240 msgr2=0x559dae665cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:29.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.062+0000 7fc75659c640 1 --2- 172.21.15.92:0/4879904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dae668240 0x559dae665cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:29.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.062+0000 7fc75659c640 1 -- 172.21.15.92:0/4879904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559dae655090 msgr2=0x559dae665770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:29.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.062+0000 7fc75659c640 1 --2- 172.21.15.92:0/4879904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559dae655090 0x559dae665770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:29.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.062+0000 7fc75659c640 1 -- 172.21.15.92:0/4879904 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559dae581c50 con 0x559dae654770 2024-09-19T08:57:29.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.063+0000 7fc75659c640 1 --2- 172.21.15.92:0/4879904 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559dae654770 0x559dae665230 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc748010e90 tx=0x7fc748004160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbe68680677a0449 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:29.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.063+0000 7fc73dffb640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T08:57:29.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.063+0000 7fc73dffb640 1 -- 172.21.15.92:0/4879904 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc748011ae0 con 0x559dae654770 2024-09-19T08:57:29.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.063+0000 7fc73dffb640 1 -- 172.21.15.92:0/4879904 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc748011c80 con 0x559dae654770 2024-09-19T08:57:29.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.063+0000 7fc75f2a2740 1 -- 172.21.15.92:0/4879904 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7480043c0 con 0x559dae654770 2024-09-19T08:57:29.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.064+0000 7fc73dffb640 1 -- 172.21.15.92:0/4879904 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc748005040 con 0x559dae654770 2024-09-19T08:57:29.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.064+0000 7fc75f2a2740 10 client.24976 fetch_fsmap learned FSMap version 19 2024-09-19T08:57:29.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.064+0000 7fc75f2a2740 1 -- 172.21.15.92:0/4879904 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x559dae676ba0 con 0x559dae654770 2024-09-19T08:57:29.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.064+0000 7fc73dffb640 1 -- 172.21.15.92:0/4879904 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7480035f0 con 0x559dae654770 2024-09-19T08:57:29.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.064+0000 7fc73dffb640 1 -- 172.21.15.92:0/4879904 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fc7480046c0 con 0x559dae654770 2024-09-19T08:57:29.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.064+0000 7fc75f2a2740 10 client.24976 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:57:29.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.064+0000 7fc75f2a2740 10 client.24976 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T08:57:29.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.065+0000 7fc75f2a2740 20 client.24976 populate_metadata read hostname 'smithi092' 2024-09-19T08:57:29.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.065+0000 7fc75f2a2740 1 --2- 172.21.15.92:0/4879904 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559dae678000 0x559dae67a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:29.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.065+0000 7fc75f2a2740 4 client.24976 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:57:29.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.065+0000 7fc75f2a2740 1 -- 172.21.15.92:0/4879904 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc7480043c0 con 0x559dae678000 2024-09-19T08:57:29.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.065+0000 7fc755d9b640 1 --2- 172.21.15.92:0/4879904 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559dae678000 0x559dae67a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:29.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.066+0000 7fc755d9b640 1 --2- 172.21.15.92:0/4879904 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559dae678000 0x559dae67a3f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=165abdb4e54ecde7 server_cookie=b906899c5451a7b8 in_seq=0 out_seq=0 2024-09-19T08:57:29.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.067+0000 7fc73dffb640 10 client.24976 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:29.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.067+0000 7fc73dffb640 1 -- 172.21.15.92:0/4879904 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fc7480043c0 con 0x559dae678000 2024-09-19T08:57:29.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.067+0000 7fc73dffb640 10 client.24976 handle_command_reply: tid=0 2024-09-19T08:57:29.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.067+0000 7fc75f2a2740 1 client.24976 shutdown 2024-09-19T08:57:29.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.067+0000 7fc75f2a2740 1 -- 172.21.15.92:0/4879904 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559dae654770 msgr2=0x559dae665230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:29.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.067+0000 7fc75f2a2740 1 --2- 172.21.15.92:0/4879904 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559dae654770 0x559dae665230 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc748010e90 tx=0x7fc748004160 comp rx=0 tx=0).stop 2024-09-19T08:57:29.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.067+0000 7fc75f2a2740 1 -- 172.21.15.92:0/4879904 shutdown_connections 2024-09-19T08:57:29.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.067+0000 7fc75f2a2740 1 --2- 172.21.15.92:0/4879904 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559dae678000 0x559dae67a3f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:29.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.067+0000 7fc75f2a2740 1 --2- 172.21.15.92:0/4879904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dae668240 0x559dae665cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:29.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.067+0000 7fc75f2a2740 1 --2- 172.21.15.92:0/4879904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559dae655090 0x559dae665770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:29.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.067+0000 7fc73dffb640 0 client.24976 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:29.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.067+0000 7fc75f2a2740 1 --2- 172.21.15.92:0/4879904 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559dae654770 0x559dae665230 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:29.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.068+0000 7fc75f2a2740 1 -- 172.21.15.92:0/4879904 >> 172.21.15.92:0/4879904 conn(0x559dae650de0 msgr2=0x559dae656a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:29.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.068+0000 7fc75f2a2740 1 -- 172.21.15.92:0/4879904 shutdown_connections 2024-09-19T08:57:29.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.069+0000 7fc75f2a2740 1 -- 172.21.15.92:0/4879904 wait complete. 2024-09-19T08:57:29.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.069+0000 7fc75f2a2740 20 client.24976 trim_cache size 0 max 16384 2024-09-19T08:57:29.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.100+0000 7fc75f2a2740 1 Processor -- start 2024-09-19T08:57:29.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.100+0000 7fc75f2a2740 1 -- start start 2024-09-19T08:57:29.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.100+0000 7fc75f2a2740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559dae654770 0x559dae665b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:29.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.100+0000 7fc75f2a2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dae655090 0x559dae64fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:29.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.100+0000 7fc75f2a2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559dae668240 0x559dae6502f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:29.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.100+0000 7fc75f2a2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc7581a9520 con 0x559dae668240 2024-09-19T08:57:29.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.100+0000 7fc75f2a2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc7581abda0 con 0x559dae655090 2024-09-19T08:57:29.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.100+0000 7fc75f2a2740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc7581a9b90 con 0x559dae654770 2024-09-19T08:57:29.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.101+0000 7fc75659c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559dae654770 0x559dae665b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:29.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.101+0000 7fc756d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559dae668240 0x559dae6502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:29.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.101+0000 7fc75659c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559dae654770 0x559dae665b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:47832/0 (socket says 172.21.15.92:47832) 2024-09-19T08:57:29.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.101+0000 7fc75659c640 1 -- 172.21.15.92:0/3985141942 learned_addr learned my addr 172.21.15.92:0/3985141942 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:29.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.101+0000 7fc755d9b640 1 --2- 172.21.15.92:0/3985141942 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dae655090 0x559dae64fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:29.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.101+0000 7fc756d9d640 1 -- 172.21.15.92:0/3985141942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559dae654770 msgr2=0x559dae665b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:29.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.101+0000 7fc756d9d640 1 --2- 172.21.15.92:0/3985141942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559dae654770 0x559dae665b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:29.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.101+0000 7fc756d9d640 1 -- 172.21.15.92:0/3985141942 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dae655090 msgr2=0x559dae64fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:29.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.101+0000 7fc756d9d640 1 --2- 172.21.15.92:0/3985141942 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dae655090 0x559dae64fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:29.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.101+0000 7fc756d9d640 1 -- 172.21.15.92:0/3985141942 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dae66ae00 con 0x559dae668240 2024-09-19T08:57:29.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.102+0000 7fc756d9d640 1 --2- 172.21.15.92:0/3985141942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559dae668240 0x559dae6502f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc75000efd0 tx=0x7fc750019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3631a2c910d1b8f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:29.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.102+0000 7fc73ffff640 1 -- 172.21.15.92:0/3985141942 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7500047b0 con 0x559dae668240 2024-09-19T08:57:29.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.102+0000 7fc73ffff640 1 -- 172.21.15.92:0/3985141942 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc750029910 con 0x559dae668240 2024-09-19T08:57:29.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.103+0000 7fc73ffff640 1 -- 172.21.15.92:0/3985141942 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc75001e820 con 0x559dae668240 2024-09-19T08:57:29.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.104+0000 7fc75f2a2740 1 -- 172.21.15.92:0/3985141942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559dae668240 msgr2=0x559dae6502f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:29.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.104+0000 7fc75f2a2740 1 --2- 172.21.15.92:0/3985141942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559dae668240 0x559dae6502f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc75000efd0 tx=0x7fc750019000 comp rx=0 tx=0).stop 2024-09-19T08:57:29.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.104+0000 7fc75f2a2740 1 -- 172.21.15.92:0/3985141942 shutdown_connections 2024-09-19T08:57:29.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.104+0000 7fc75f2a2740 1 --2- 172.21.15.92:0/3985141942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559dae668240 0x559dae6502f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:29.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.104+0000 7fc75f2a2740 1 --2- 172.21.15.92:0/3985141942 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dae655090 0x559dae64fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:29.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.104+0000 7fc75f2a2740 1 --2- 172.21.15.92:0/3985141942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559dae654770 0x559dae665b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:29.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.104+0000 7fc75f2a2740 1 -- 172.21.15.92:0/3985141942 >> 172.21.15.92:0/3985141942 conn(0x559dae650de0 msgr2=0x559dae64f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:29.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.104+0000 7fc75f2a2740 1 -- 172.21.15.92:0/3985141942 shutdown_connections 2024-09-19T08:57:29.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.104+0000 7fc75f2a2740 1 -- 172.21.15.92:0/3985141942 wait complete. 2024-09-19T08:57:29.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.105+0000 7fc75f2a2740 1 -- start start 2024-09-19T08:57:29.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.105+0000 7fc75f2a2740 1 Processor -- start 2024-09-19T08:57:29.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.105+0000 7fc75f2a2740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559dae654770 0x559dae67b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:29.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.105+0000 7fc75f2a2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559dae655090 0x559dae67be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:29.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.105+0000 7fc75f2a2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dae668240 0x559dae6e1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:29.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.105+0000 7fc75f2a2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc7581aa260 con 0x559dae655090 2024-09-19T08:57:29.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.106+0000 7fc75f2a2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc7581ab6d0 con 0x559dae668240 2024-09-19T08:57:29.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.106+0000 7fc75f2a2740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc7581aa930 con 0x559dae654770 2024-09-19T08:57:29.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.106+0000 7fc75f2a2740 10 client.0 _ll_register_callbacks cb 0x7fc74800bf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:29.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.106+0000 7fc756d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dae668240 0x559dae6e1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:29.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.106+0000 7fc756d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dae668240 0x559dae6e1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:45908/0 (socket says 172.21.15.92:45908) 2024-09-19T08:57:29.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.106+0000 7fc756d9d640 1 -- 172.21.15.92:0/3744718831 learned_addr learned my addr 172.21.15.92:0/3744718831 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:29.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.106+0000 7fc755d9b640 1 --2- 172.21.15.92:0/3744718831 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559dae655090 0x559dae67be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:29.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.106+0000 7fc756d9d640 1 -- 172.21.15.92:0/3744718831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559dae654770 msgr2=0x559dae67b940 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T08:57:29.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.106+0000 7fc756d9d640 1 --2- 172.21.15.92:0/3744718831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559dae654770 0x559dae67b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:29.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.106+0000 7fc756d9d640 1 -- 172.21.15.92:0/3744718831 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559dae655090 msgr2=0x559dae67be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:29.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.106+0000 7fc756d9d640 1 --2- 172.21.15.92:0/3744718831 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559dae655090 0x559dae67be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:29.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.106+0000 7fc756d9d640 1 -- 172.21.15.92:0/3744718831 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559dae6e1eb0 con 0x559dae668240 2024-09-19T08:57:29.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.106+0000 7fc756d9d640 1 --2- 172.21.15.92:0/3744718831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dae668240 0x559dae6e1940 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc750029690 tx=0x7fc7500296c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a69c384e1a04240 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:29.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.106+0000 7fc73dffb640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T08:57:29.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.107+0000 7fc73dffb640 1 -- 172.21.15.92:0/3744718831 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc750029cd0 con 0x559dae668240 2024-09-19T08:57:29.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.107+0000 7fc73dffb640 1 -- 172.21.15.92:0/3744718831 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc750004a00 con 0x559dae668240 2024-09-19T08:57:29.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.107+0000 7fc75f2a2740 1 -- 172.21.15.92:0/3744718831 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc750029910 con 0x559dae668240 2024-09-19T08:57:29.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.107+0000 7fc73dffb640 1 -- 172.21.15.92:0/3744718831 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc750004c00 con 0x559dae668240 2024-09-19T08:57:29.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.109+0000 7fc75f2a2740 10 client.24971 fetch_fsmap learned FSMap version 19 2024-09-19T08:57:29.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.109+0000 7fc75f2a2740 1 -- 172.21.15.92:0/3744718831 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x559dae6e3170 con 0x559dae668240 2024-09-19T08:57:29.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.109+0000 7fc73dffb640 1 -- 172.21.15.92:0/3744718831 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc750004da0 con 0x559dae668240 2024-09-19T08:57:29.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.110+0000 7fc73dffb640 1 -- 172.21.15.92:0/3744718831 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fc75000b040 con 0x559dae668240 2024-09-19T08:57:29.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.110+0000 7fc75f2a2740 10 client.24971 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:57:29.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.110+0000 7fc75f2a2740 10 client.24971 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T08:57:29.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.110+0000 7fc75f2a2740 20 client.24971 populate_metadata read hostname 'smithi092' 2024-09-19T08:57:29.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.110+0000 7fc75f2a2740 1 --2- 172.21.15.92:0/3744718831 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559dae6e3780 0x559dae6e5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:29.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.110+0000 7fc75f2a2740 4 client.24971 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-09-19T08:57:29.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.110+0000 7fc75f2a2740 1 -- 172.21.15.92:0/3744718831 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x7fc750029910 con 0x559dae6e3780 2024-09-19T08:57:29.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.110+0000 7fc75659c640 1 --2- 172.21.15.92:0/3744718831 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559dae6e3780 0x559dae6e5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:29.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.111+0000 7fc75659c640 1 --2- 172.21.15.92:0/3744718831 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559dae6e3780 0x559dae6e5ba0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c49b4f844ea8c89 server_cookie=588c67767188ed2e in_seq=0 out_seq=0 2024-09-19T08:57:29.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.111+0000 7fc73dffb640 10 client.24971 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:29.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.339+0000 7fc73dffb640 1 -- 172.21.15.92:0/3744718831 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x7fc750029910 con 0x559dae6e3780 2024-09-19T08:57:29.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.339+0000 7fc73dffb640 10 client.24971 handle_command_reply: tid=0 2024-09-19T08:57:29.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.339+0000 7fc75f2a2740 1 client.24971 shutdown 2024-09-19T08:57:29.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.339+0000 7fc75f2a2740 1 -- 172.21.15.92:0/3744718831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dae668240 msgr2=0x559dae6e1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:29.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.339+0000 7fc75f2a2740 1 --2- 172.21.15.92:0/3744718831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dae668240 0x559dae6e1940 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc750029690 tx=0x7fc7500296c0 comp rx=0 tx=0).stop 2024-09-19T08:57:29.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.339+0000 7fc75f2a2740 1 -- 172.21.15.92:0/3744718831 shutdown_connections 2024-09-19T08:57:29.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.339+0000 7fc75f2a2740 1 --2- 172.21.15.92:0/3744718831 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559dae6e3780 0x559dae6e5ba0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:29.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.339+0000 7fc75f2a2740 1 --2- 172.21.15.92:0/3744718831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dae668240 0x559dae6e1940 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:29.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.339+0000 7fc75f2a2740 1 --2- 172.21.15.92:0/3744718831 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559dae655090 0x559dae67be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:29.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.339+0000 7fc75f2a2740 1 --2- 172.21.15.92:0/3744718831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559dae654770 0x559dae67b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:29.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.339+0000 7fc73dffb640 0 client.24971 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:29.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.339+0000 7fc75f2a2740 1 -- 172.21.15.92:0/3744718831 >> 172.21.15.92:0/3744718831 conn(0x559dae650de0 msgr2=0x559dae656950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:29.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.339+0000 7fc75f2a2740 1 -- 172.21.15.92:0/3744718831 shutdown_connections 2024-09-19T08:57:29.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.339+0000 7fc75f2a2740 1 -- 172.21.15.92:0/3744718831 wait complete. 2024-09-19T08:57:29.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.339+0000 7fc75f2a2740 20 client.24971 trim_cache size 0 max 16384 2024-09-19T08:57:29.341 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T08:57:29.341 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 19, 2024-09-19T08:57:29.341 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24472, 2024-09-19T08:57:29.341 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 6, 2024-09-19T08:57:29.341 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-09-19T08:57:29.341 INFO:teuthology.orchestra.run.smithi092.stdout: "5bb65959": { 2024-09-19T08:57:29.341 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 6, 2024-09-19T08:57:29.341 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-09-19T08:57:29.342 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T08:57:29.342 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-09-19T08:57:29.342 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T08:57:29.342 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T08:57:29.342 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 90.0, 2024-09-19T08:57:29.342 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 140.3, 2024-09-19T08:57:29.342 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-09-19T08:57:29.342 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-09-19T08:57:29.342 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-09-19T08:57:29.342 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T08:57:29.342 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-09-19T08:57:29.342 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T08:57:29.342 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:57:29.343 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:57:29.343 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:57:29.343 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:57:29.343 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:57:29.343 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T08:57:29.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.340+0000 7fc75cec9640 1 -- 172.21.15.92:0/2747318407 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc7400a3410 msgr2=0x7fc7400a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:29.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.340+0000 7fc75cec9640 1 --2- 172.21.15.92:0/2747318407 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc7400a3410 0x7fc7400a58d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc750005fd0 tx=0x7fc7500095c0 comp rx=0 tx=0).stop 2024-09-19T08:57:29.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.340+0000 7fc75cec9640 1 -- 172.21.15.92:0/2747318407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc758102570 msgr2=0x7fc75819ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:29.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.340+0000 7fc75cec9640 1 --2- 172.21.15.92:0/2747318407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc758102570 0x7fc75819ac40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc74c009a10 tx=0x7fc74c004350 comp rx=0 tx=0).stop 2024-09-19T08:57:29.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.340+0000 7fc75cec9640 1 -- 172.21.15.92:0/2747318407 shutdown_connections 2024-09-19T08:57:29.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.340+0000 7fc75cec9640 1 --2- 172.21.15.92:0/2747318407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc758102ef0 0x7fc75819efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:29.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.340+0000 7fc75cec9640 1 --2- 172.21.15.92:0/2747318407 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc7400a3410 0x7fc7400a58d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:29.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.340+0000 7fc75cec9640 1 --2- 172.21.15.92:0/2747318407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc758102570 0x7fc75819ac40 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:29.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.340+0000 7fc75cec9640 1 --2- 172.21.15.92:0/2747318407 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc758100e20 0x7fc75819a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:29.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.340+0000 7fc75cec9640 1 -- 172.21.15.92:0/2747318407 >> 172.21.15.92:0/2747318407 conn(0x7fc7580fc7d0 msgr2=0x7fc75810bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:29.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.340+0000 7fc75cec9640 1 -- 172.21.15.92:0/2747318407 shutdown_connections 2024-09-19T08:57:29.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:29.340+0000 7fc75cec9640 1 -- 172.21.15.92:0/2747318407 wait complete. 2024-09-19T08:57:29.652 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:29 smithi092 ceph-mon[31407]: pgmap v360: 97 pgs: 97 active+clean; 1014 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 20 MiB/s wr, 1.01k op/s 2024-09-19T08:57:29.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:29 smithi167 ceph-mon[35359]: pgmap v360: 97 pgs: 97 active+clean; 1014 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 20 MiB/s wr, 1.01k op/s 2024-09-19T08:57:29.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:29 smithi190 ceph-mon[35358]: pgmap v360: 97 pgs: 97 active+clean; 1014 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 20 MiB/s wr, 1.01k op/s 2024-09-19T08:57:29.979 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '5bb65959', quiesce took 4.3 seconds. Will release after: 16.05 2024-09-19T08:57:30.796 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 45.0 s, 3565.2 tps, lat 18.710 ms stddev 19.613 2024-09-19T08:57:31.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:31 smithi092 ceph-mon[31407]: pgmap v361: 97 pgs: 97 active+clean; 1.0 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 20 MiB/s wr, 1.04k op/s 2024-09-19T08:57:31.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:31 smithi167 ceph-mon[35359]: pgmap v361: 97 pgs: 97 active+clean; 1.0 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 20 MiB/s wr, 1.04k op/s 2024-09-19T08:57:31.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:31 smithi190 ceph-mon[35358]: pgmap v361: 97 pgs: 97 active+clean; 1.0 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 20 MiB/s wr, 1.04k op/s 2024-09-19T08:57:32.039 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:57:32.295 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:57:32.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.771+0000 7ff862792640 1 -- 172.21.15.92:0/1945362598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff85c101420 msgr2=0x7ff85c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:32.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.771+0000 7ff862792640 1 --2- 172.21.15.92:0/1945362598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff85c101420 0x7ff85c10d950 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff854009cd0 tx=0x7ff85402a8e0 comp rx=0 tx=0).stop 2024-09-19T08:57:32.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.771+0000 7ff862792640 1 -- 172.21.15.92:0/1945362598 shutdown_connections 2024-09-19T08:57:32.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.771+0000 7ff862792640 1 --2- 172.21.15.92:0/1945362598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff85c101420 0x7ff85c10d950 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:32.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.771+0000 7ff862792640 1 --2- 172.21.15.92:0/1945362598 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff85c100a80 0x7ff85c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:32.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.771+0000 7ff862792640 1 --2- 172.21.15.92:0/1945362598 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff85c106a80 0x7ff85c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:32.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.771+0000 7ff862792640 1 -- 172.21.15.92:0/1945362598 >> 172.21.15.92:0/1945362598 conn(0x7ff85c0fc7a0 msgr2=0x7ff85c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:32.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.771+0000 7ff862792640 1 -- 172.21.15.92:0/1945362598 shutdown_connections 2024-09-19T08:57:32.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.771+0000 7ff862792640 1 -- 172.21.15.92:0/1945362598 wait complete. 2024-09-19T08:57:32.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.772+0000 7ff862792640 1 Processor -- start 2024-09-19T08:57:32.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.772+0000 7ff862792640 1 -- start start 2024-09-19T08:57:32.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.772+0000 7ff862792640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff85c100a80 0x7ff85c1985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:32.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.772+0000 7ff862792640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff85c101420 0x7ff85c198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:32.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.772+0000 7ff862792640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff85c106a80 0x7ff85c19ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:32.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.772+0000 7ff862792640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff85c112020 con 0x7ff85c100a80 2024-09-19T08:57:32.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.772+0000 7ff862792640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff85c111ea0 con 0x7ff85c106a80 2024-09-19T08:57:32.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.772+0000 7ff862792640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff85c1121a0 con 0x7ff85c101420 2024-09-19T08:57:32.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.772+0000 7ff85bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff85c100a80 0x7ff85c1985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:32.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.772+0000 7ff85bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff85c100a80 0x7ff85c1985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54012/0 (socket says 172.21.15.92:54012) 2024-09-19T08:57:32.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.772+0000 7ff85bfff640 1 -- 172.21.15.92:0/3809094705 learned_addr learned my addr 172.21.15.92:0/3809094705 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:32.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.772+0000 7ff853fff640 1 --2- 172.21.15.92:0/3809094705 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff85c101420 0x7ff85c198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:32.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.772+0000 7ff85bfff640 1 -- 172.21.15.92:0/3809094705 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff85c101420 msgr2=0x7ff85c198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:32.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.772+0000 7ff85bfff640 1 --2- 172.21.15.92:0/3809094705 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff85c101420 0x7ff85c198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:32.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.772+0000 7ff85bfff640 1 -- 172.21.15.92:0/3809094705 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff85c106a80 msgr2=0x7ff85c19ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:32.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.772+0000 7ff85bfff640 1 --2- 172.21.15.92:0/3809094705 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff85c106a80 0x7ff85c19ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:32.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.772+0000 7ff85bfff640 1 -- 172.21.15.92:0/3809094705 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff85c19d550 con 0x7ff85c100a80 2024-09-19T08:57:32.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.772+0000 7ff853fff640 1 --2- 172.21.15.92:0/3809094705 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff85c101420 0x7ff85c198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:57:32.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.772+0000 7ff85bfff640 1 --2- 172.21.15.92:0/3809094705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff85c100a80 0x7ff85c1985a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff84c00b4a0 tx=0x7ff84c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:32.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.772+0000 7ff859ffb640 1 -- 172.21.15.92:0/3809094705 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84c014070 con 0x7ff85c100a80 2024-09-19T08:57:32.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.773+0000 7ff859ffb640 1 -- 172.21.15.92:0/3809094705 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff84c010af0 con 0x7ff85c100a80 2024-09-19T08:57:32.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.773+0000 7ff862792640 1 -- 172.21.15.92:0/3809094705 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff85c19d840 con 0x7ff85c100a80 2024-09-19T08:57:32.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.773+0000 7ff859ffb640 1 -- 172.21.15.92:0/3809094705 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84c017d10 con 0x7ff85c100a80 2024-09-19T08:57:32.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.773+0000 7ff862792640 1 -- 172.21.15.92:0/3809094705 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff85c1a5120 con 0x7ff85c100a80 2024-09-19T08:57:32.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.775+0000 7ff859ffb640 1 -- 172.21.15.92:0/3809094705 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff84c017070 con 0x7ff85c100a80 2024-09-19T08:57:32.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.775+0000 7ff864b6b740 1 Processor -- start 2024-09-19T08:57:32.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.775+0000 7ff864b6b740 1 -- start start 2024-09-19T08:57:32.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.775+0000 7ff864b6b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f6a5c374a0 0x55f6a5c37880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:32.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.775+0000 7ff864b6b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f6a5c37dc0 0x55f6a5c42140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:32.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.775+0000 7ff864b6b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f6a5c42680 0x55f6a5c44a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:32.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.775+0000 7ff864b6b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f6a5b9d2e0 con 0x55f6a5c42680 2024-09-19T08:57:32.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.775+0000 7ff864b6b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f6a5b44ce0 con 0x55f6a5c37dc0 2024-09-19T08:57:32.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.775+0000 7ff864b6b740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f6a5b992a0 con 0x55f6a5c374a0 2024-09-19T08:57:32.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.776+0000 7ff859ffb640 1 --2- 172.21.15.92:0/3809094705 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff8480a3240 0x7ff8480a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:32.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.776+0000 7ff853fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f6a5c42680 0x55f6a5c44a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:32.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.776+0000 7ff853fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f6a5c42680 0x55f6a5c44a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54020/0 (socket says 172.21.15.92:54020) 2024-09-19T08:57:32.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.776+0000 7ff853fff640 1 -- 172.21.15.92:0/2393339043 learned_addr learned my addr 172.21.15.92:0/2393339043 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:32.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.776+0000 7ff85bfff640 1 --2- 172.21.15.92:0/2393339043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f6a5c37dc0 0x55f6a5c42140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:32.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.776+0000 7ff860d2f640 1 --2- 172.21.15.92:0/2393339043 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f6a5c374a0 0x55f6a5c37880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:32.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.776+0000 7ff860d2f640 1 --2- 172.21.15.92:0/3809094705 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff8480a3240 0x7ff8480a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:32.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.776+0000 7ff859ffb640 1 -- 172.21.15.92:0/3809094705 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff84c0ced90 con 0x7ff85c100a80 2024-09-19T08:57:32.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.776+0000 7ff853fff640 1 -- 172.21.15.92:0/2393339043 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f6a5c374a0 msgr2=0x55f6a5c37880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:32.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.776+0000 7ff853fff640 1 --2- 172.21.15.92:0/2393339043 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f6a5c374a0 0x55f6a5c37880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:32.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.776+0000 7ff853fff640 1 -- 172.21.15.92:0/2393339043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f6a5c37dc0 msgr2=0x55f6a5c42140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:32.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.776+0000 7ff853fff640 1 --2- 172.21.15.92:0/2393339043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f6a5c37dc0 0x55f6a5c42140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:32.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.776+0000 7ff853fff640 1 -- 172.21.15.92:0/2393339043 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6a5b29440 con 0x55f6a5c42680 2024-09-19T08:57:32.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.776+0000 7ff853fff640 1 --2- 172.21.15.92:0/2393339043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f6a5c42680 0x55f6a5c44a70 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff84400a9d0 tx=0x7ff84400ae90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a52a68a871d330d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:32.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.776+0000 7ff860d2f640 1 --2- 172.21.15.92:0/3809094705 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff8480a3240 0x7ff8480a5700 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff85402ae00 tx=0x7ff8540095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:32.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.776+0000 7ff8527fc640 1 -- 172.21.15.92:0/2393339043 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff844015070 con 0x55f6a5c42680 2024-09-19T08:57:32.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.776+0000 7ff8527fc640 1 -- 172.21.15.92:0/2393339043 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff84400cc60 con 0x55f6a5c42680 2024-09-19T08:57:32.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.776+0000 7ff8527fc640 1 -- 172.21.15.92:0/2393339043 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8440185a0 con 0x55f6a5c42680 2024-09-19T08:57:32.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.777+0000 7ff864b6b740 1 -- 172.21.15.92:0/2393339043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f6a5c42680 msgr2=0x55f6a5c44a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:32.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.777+0000 7ff864b6b740 1 --2- 172.21.15.92:0/2393339043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f6a5c42680 0x55f6a5c44a70 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff84400a9d0 tx=0x7ff84400ae90 comp rx=0 tx=0).stop 2024-09-19T08:57:32.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.777+0000 7ff864b6b740 1 -- 172.21.15.92:0/2393339043 shutdown_connections 2024-09-19T08:57:32.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.777+0000 7ff864b6b740 1 --2- 172.21.15.92:0/2393339043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f6a5c42680 0x55f6a5c44a70 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:32.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.777+0000 7ff864b6b740 1 --2- 172.21.15.92:0/2393339043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f6a5c37dc0 0x55f6a5c42140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:32.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.777+0000 7ff864b6b740 1 --2- 172.21.15.92:0/2393339043 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f6a5c374a0 0x55f6a5c37880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:32.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.777+0000 7ff864b6b740 1 -- 172.21.15.92:0/2393339043 >> 172.21.15.92:0/2393339043 conn(0x55f6a5c33a30 msgr2=0x55f6a5c33e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:32.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.777+0000 7ff864b6b740 1 -- 172.21.15.92:0/2393339043 shutdown_connections 2024-09-19T08:57:32.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.777+0000 7ff864b6b740 1 -- 172.21.15.92:0/2393339043 wait complete. 2024-09-19T08:57:32.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.778+0000 7ff864b6b740 1 -- start start 2024-09-19T08:57:32.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.778+0000 7ff864b6b740 1 Processor -- start 2024-09-19T08:57:32.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.778+0000 7ff864b6b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f6a5c374a0 0x55f6a5c41f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:32.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.778+0000 7ff864b6b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f6a5c37dc0 0x55f6a5c3f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:32.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.778+0000 7ff864b6b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f6a5c42680 0x55f6a5c3f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:32.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.778+0000 7ff864b6b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f6a5c45250 con 0x55f6a5c42680 2024-09-19T08:57:32.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.778+0000 7ff864b6b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f6a5b58050 con 0x55f6a5c374a0 2024-09-19T08:57:32.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.778+0000 7ff864b6b740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f6a5c453d0 con 0x55f6a5c37dc0 2024-09-19T08:57:32.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.778+0000 7ff864b6b740 10 client.0 _ll_register_callbacks cb 0x55f6a5b98160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:32.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.778+0000 7ff860d2f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f6a5c42680 0x55f6a5c3f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:32.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.778+0000 7ff860d2f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f6a5c42680 0x55f6a5c3f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54026/0 (socket says 172.21.15.92:54026) 2024-09-19T08:57:32.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.778+0000 7ff860d2f640 1 -- 172.21.15.92:0/2725919690 learned_addr learned my addr 172.21.15.92:0/2725919690 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:32.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.778+0000 7ff85bfff640 1 --2- 172.21.15.92:0/2725919690 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f6a5c374a0 0x55f6a5c41f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:32.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.778+0000 7ff853fff640 1 --2- 172.21.15.92:0/2725919690 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f6a5c37dc0 0x55f6a5c3f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:32.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.778+0000 7ff860d2f640 1 -- 172.21.15.92:0/2725919690 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f6a5c37dc0 msgr2=0x55f6a5c3f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:32.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.778+0000 7ff860d2f640 1 --2- 172.21.15.92:0/2725919690 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f6a5c37dc0 0x55f6a5c3f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:32.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.778+0000 7ff860d2f640 1 -- 172.21.15.92:0/2725919690 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f6a5c374a0 msgr2=0x55f6a5c41f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:32.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.778+0000 7ff860d2f640 1 --2- 172.21.15.92:0/2725919690 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f6a5c374a0 0x55f6a5c41f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:32.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.778+0000 7ff860d2f640 1 -- 172.21.15.92:0/2725919690 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6a590e3c0 con 0x55f6a5c42680 2024-09-19T08:57:32.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.779+0000 7ff860d2f640 1 --2- 172.21.15.92:0/2725919690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f6a5c42680 0x55f6a5c3f720 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ff854030850 tx=0x7ff854030880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=318c82d2b9903e78 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:32.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.779+0000 7ff83b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:57:32.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.779+0000 7ff83b7fe640 1 -- 172.21.15.92:0/2725919690 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85404f070 con 0x55f6a5c42680 2024-09-19T08:57:32.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.779+0000 7ff83b7fe640 1 -- 172.21.15.92:0/2725919690 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff85404a880 con 0x55f6a5c42680 2024-09-19T08:57:32.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.779+0000 7ff864b6b740 1 -- 172.21.15.92:0/2725919690 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff84400cc60 con 0x55f6a5c42680 2024-09-19T08:57:32.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.779+0000 7ff83b7fe640 1 -- 172.21.15.92:0/2725919690 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff85405b050 con 0x55f6a5c42680 2024-09-19T08:57:32.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.779+0000 7ff864b6b740 10 client.15483 fetch_fsmap learned FSMap version 19 2024-09-19T08:57:32.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.779+0000 7ff864b6b740 1 -- 172.21.15.92:0/2725919690 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f6a5c50b70 con 0x55f6a5c42680 2024-09-19T08:57:32.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.779+0000 7ff83b7fe640 1 -- 172.21.15.92:0/2725919690 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff84400cc60 con 0x55f6a5c42680 2024-09-19T08:57:32.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.779+0000 7ff83b7fe640 1 -- 172.21.15.92:0/2725919690 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff854030070 con 0x55f6a5c42680 2024-09-19T08:57:32.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.779+0000 7ff864b6b740 10 client.15483 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:57:32.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.779+0000 7ff864b6b740 10 client.15483 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:57:32.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.779+0000 7ff864b6b740 20 client.15483 populate_metadata read hostname 'smithi092' 2024-09-19T08:57:32.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.779+0000 7ff864b6b740 1 --2- 172.21.15.92:0/2725919690 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f6a5c51f80 0x55f6a5c54440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:32.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.779+0000 7ff864b6b740 4 client.15483 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:57:32.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.779+0000 7ff864b6b740 1 -- 172.21.15.92:0/2725919690 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f6a5baa850 con 0x55f6a5c51f80 2024-09-19T08:57:32.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.780+0000 7ff85bfff640 1 --2- 172.21.15.92:0/2725919690 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f6a5c51f80 0x55f6a5c54440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:32.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.780+0000 7ff83b7fe640 10 client.15483 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:32.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.780+0000 7ff85bfff640 1 --2- 172.21.15.92:0/2725919690 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f6a5c51f80 0x55f6a5c54440 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a358605770ef138 server_cookie=f46111cb502e1422 in_seq=0 out_seq=0 2024-09-19T08:57:32.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.781+0000 7ff83b7fe640 1 -- 172.21.15.92:0/2725919690 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f6a5baa850 con 0x55f6a5c51f80 2024-09-19T08:57:32.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.781+0000 7ff83b7fe640 10 client.15483 handle_command_reply: tid=0 2024-09-19T08:57:32.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.781+0000 7ff864b6b740 1 client.15483 shutdown 2024-09-19T08:57:32.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.781+0000 7ff864b6b740 1 -- 172.21.15.92:0/2725919690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f6a5c42680 msgr2=0x55f6a5c3f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:32.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.781+0000 7ff864b6b740 1 --2- 172.21.15.92:0/2725919690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f6a5c42680 0x55f6a5c3f720 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ff854030850 tx=0x7ff854030880 comp rx=0 tx=0).stop 2024-09-19T08:57:32.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.781+0000 7ff864b6b740 1 -- 172.21.15.92:0/2725919690 shutdown_connections 2024-09-19T08:57:32.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.781+0000 7ff864b6b740 1 --2- 172.21.15.92:0/2725919690 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f6a5c51f80 0x55f6a5c54440 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:32.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.781+0000 7ff864b6b740 1 --2- 172.21.15.92:0/2725919690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f6a5c42680 0x55f6a5c3f720 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:32.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.781+0000 7ff864b6b740 1 --2- 172.21.15.92:0/2725919690 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f6a5c37dc0 0x55f6a5c3f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:32.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.781+0000 7ff864b6b740 1 --2- 172.21.15.92:0/2725919690 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f6a5c374a0 0x55f6a5c41f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:32.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.781+0000 7ff864b6b740 1 -- 172.21.15.92:0/2725919690 >> 172.21.15.92:0/2725919690 conn(0x55f6a5c33a30 msgr2=0x55f6a5c39710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:32.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.781+0000 7ff83b7fe640 0 client.15483 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:32.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.781+0000 7ff864b6b740 1 -- 172.21.15.92:0/2725919690 shutdown_connections 2024-09-19T08:57:32.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.781+0000 7ff864b6b740 1 -- 172.21.15.92:0/2725919690 wait complete. 2024-09-19T08:57:32.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.781+0000 7ff864b6b740 20 client.15483 trim_cache size 0 max 16384 2024-09-19T08:57:32.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.798+0000 7ff864b6b740 1 Processor -- start 2024-09-19T08:57:32.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.798+0000 7ff864b6b740 1 -- start start 2024-09-19T08:57:32.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.798+0000 7ff864b6b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f6a5c33a30 0x55f6a5c4e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:32.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.798+0000 7ff864b6b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f6a5c374a0 0x55f6a5c3dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:32.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.798+0000 7ff864b6b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f6a5c37dc0 0x55f6a5c41150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:32.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.798+0000 7ff864b6b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff85c1ab700 con 0x55f6a5c37dc0 2024-09-19T08:57:32.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.798+0000 7ff864b6b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff85c1adfa0 con 0x55f6a5c33a30 2024-09-19T08:57:32.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.798+0000 7ff864b6b740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff85c1abd90 con 0x55f6a5c374a0 2024-09-19T08:57:32.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.798+0000 7ff860d2f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f6a5c37dc0 0x55f6a5c41150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:32.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.798+0000 7ff860d2f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f6a5c37dc0 0x55f6a5c41150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54030/0 (socket says 172.21.15.92:54030) 2024-09-19T08:57:32.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.798+0000 7ff860d2f640 1 -- 172.21.15.92:0/3840338813 learned_addr learned my addr 172.21.15.92:0/3840338813 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:32.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.799+0000 7ff85bfff640 1 --2- 172.21.15.92:0/3840338813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f6a5c33a30 0x55f6a5c4e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:32.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.799+0000 7ff860d2f640 1 -- 172.21.15.92:0/3840338813 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f6a5c374a0 msgr2=0x55f6a5c3dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:32.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.799+0000 7ff853fff640 1 --2- 172.21.15.92:0/3840338813 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f6a5c374a0 0x55f6a5c3dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:32.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.799+0000 7ff860d2f640 1 --2- 172.21.15.92:0/3840338813 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f6a5c374a0 0x55f6a5c3dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:32.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.799+0000 7ff860d2f640 1 -- 172.21.15.92:0/3840338813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f6a5c33a30 msgr2=0x55f6a5c4e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:32.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.799+0000 7ff860d2f640 1 --2- 172.21.15.92:0/3840338813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f6a5c33a30 0x55f6a5c4e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:32.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.799+0000 7ff860d2f640 1 -- 172.21.15.92:0/3840338813 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6a5c3e190 con 0x55f6a5c37dc0 2024-09-19T08:57:32.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.799+0000 7ff860d2f640 1 --2- 172.21.15.92:0/3840338813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f6a5c37dc0 0x55f6a5c41150 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff854009bf0 tx=0x7ff85402b020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dafcb41a1d391047 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:32.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.799+0000 7ff851ffb640 1 -- 172.21.15.92:0/3840338813 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff854064070 con 0x55f6a5c37dc0 2024-09-19T08:57:32.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.799+0000 7ff851ffb640 1 -- 172.21.15.92:0/3840338813 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff854045040 con 0x55f6a5c37dc0 2024-09-19T08:57:32.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.799+0000 7ff851ffb640 1 -- 172.21.15.92:0/3840338813 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85404f040 con 0x55f6a5c37dc0 2024-09-19T08:57:32.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.800+0000 7ff864b6b740 1 -- 172.21.15.92:0/3840338813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f6a5c37dc0 msgr2=0x55f6a5c41150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:32.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.800+0000 7ff864b6b740 1 --2- 172.21.15.92:0/3840338813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f6a5c37dc0 0x55f6a5c41150 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff854009bf0 tx=0x7ff85402b020 comp rx=0 tx=0).stop 2024-09-19T08:57:32.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.800+0000 7ff864b6b740 1 -- 172.21.15.92:0/3840338813 shutdown_connections 2024-09-19T08:57:32.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.800+0000 7ff864b6b740 1 --2- 172.21.15.92:0/3840338813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f6a5c37dc0 0x55f6a5c41150 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:32.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.800+0000 7ff864b6b740 1 --2- 172.21.15.92:0/3840338813 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f6a5c374a0 0x55f6a5c3dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:32.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.800+0000 7ff864b6b740 1 --2- 172.21.15.92:0/3840338813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f6a5c33a30 0x55f6a5c4e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:32.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.800+0000 7ff864b6b740 1 -- 172.21.15.92:0/3840338813 >> 172.21.15.92:0/3840338813 conn(0x55f6a5c3f880 msgr2=0x55f6a5c40a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:32.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.800+0000 7ff864b6b740 1 -- 172.21.15.92:0/3840338813 shutdown_connections 2024-09-19T08:57:32.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.800+0000 7ff864b6b740 1 -- 172.21.15.92:0/3840338813 wait complete. 2024-09-19T08:57:32.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.800+0000 7ff864b6b740 1 -- start start 2024-09-19T08:57:32.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.800+0000 7ff864b6b740 1 Processor -- start 2024-09-19T08:57:32.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.801+0000 7ff864b6b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f6a5c33a30 0x55f6a5c46be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:32.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.801+0000 7ff864b6b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f6a5c374a0 0x55f6a5c47120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:32.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.801+0000 7ff864b6b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f6a5c37dc0 0x55f6a5cbbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:32.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.801+0000 7ff864b6b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff85c1ac460 con 0x55f6a5c374a0 2024-09-19T08:57:32.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.801+0000 7ff864b6b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff85c1ad8d0 con 0x55f6a5c33a30 2024-09-19T08:57:32.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.801+0000 7ff864b6b740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff85c1acb30 con 0x55f6a5c37dc0 2024-09-19T08:57:32.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.801+0000 7ff864b6b740 10 client.0 _ll_register_callbacks cb 0x7ff854009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:32.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.801+0000 7ff853fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f6a5c374a0 0x55f6a5c47120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:32.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.801+0000 7ff853fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f6a5c374a0 0x55f6a5c47120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54038/0 (socket says 172.21.15.92:54038) 2024-09-19T08:57:32.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.801+0000 7ff853fff640 1 -- 172.21.15.92:0/4008495648 learned_addr learned my addr 172.21.15.92:0/4008495648 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:32.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.801+0000 7ff85bfff640 1 --2- 172.21.15.92:0/4008495648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f6a5c33a30 0x55f6a5c46be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:32.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.801+0000 7ff860d2f640 1 --2- 172.21.15.92:0/4008495648 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f6a5c37dc0 0x55f6a5cbbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:32.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.801+0000 7ff853fff640 1 -- 172.21.15.92:0/4008495648 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f6a5c37dc0 msgr2=0x55f6a5cbbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:32.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.801+0000 7ff853fff640 1 --2- 172.21.15.92:0/4008495648 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f6a5c37dc0 0x55f6a5cbbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:32.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.801+0000 7ff853fff640 1 -- 172.21.15.92:0/4008495648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f6a5c33a30 msgr2=0x55f6a5c46be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:32.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.801+0000 7ff853fff640 1 --2- 172.21.15.92:0/4008495648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f6a5c33a30 0x55f6a5c46be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:32.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.801+0000 7ff853fff640 1 -- 172.21.15.92:0/4008495648 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6a5cbc340 con 0x55f6a5c374a0 2024-09-19T08:57:32.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.801+0000 7ff85bfff640 1 --2- 172.21.15.92:0/4008495648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f6a5c33a30 0x55f6a5c46be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:57:32.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.801+0000 7ff853fff640 1 --2- 172.21.15.92:0/4008495648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f6a5c374a0 0x55f6a5c47120 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff84400c520 tx=0x7ff84400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc73f1544e0f106 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:32.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.801+0000 7ff83b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:57:32.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.801+0000 7ff83b7fe640 1 -- 172.21.15.92:0/4008495648 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff844015040 con 0x55f6a5c374a0 2024-09-19T08:57:32.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.801+0000 7ff83b7fe640 1 -- 172.21.15.92:0/4008495648 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff844011600 con 0x55f6a5c374a0 2024-09-19T08:57:32.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.801+0000 7ff864b6b740 1 -- 172.21.15.92:0/4008495648 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff854045040 con 0x55f6a5c374a0 2024-09-19T08:57:32.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.802+0000 7ff83b7fe640 1 -- 172.21.15.92:0/4008495648 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff844011800 con 0x55f6a5c374a0 2024-09-19T08:57:32.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.802+0000 7ff864b6b740 10 client.15489 fetch_fsmap learned FSMap version 19 2024-09-19T08:57:32.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.802+0000 7ff864b6b740 1 -- 172.21.15.92:0/4008495648 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f6a5cbd610 con 0x55f6a5c374a0 2024-09-19T08:57:32.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.802+0000 7ff83b7fe640 1 -- 172.21.15.92:0/4008495648 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff854045040 con 0x55f6a5c374a0 2024-09-19T08:57:32.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.802+0000 7ff83b7fe640 1 -- 172.21.15.92:0/4008495648 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff844022070 con 0x55f6a5c374a0 2024-09-19T08:57:32.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.802+0000 7ff864b6b740 10 client.15489 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:57:32.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.802+0000 7ff864b6b740 10 client.15489 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:57:32.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.802+0000 7ff864b6b740 20 client.15489 populate_metadata read hostname 'smithi092' 2024-09-19T08:57:32.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.802+0000 7ff864b6b740 1 --2- 172.21.15.92:0/4008495648 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f6a5c42680 0x55f6a5cbfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:32.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.802+0000 7ff864b6b740 4 client.15489 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:57:32.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.802+0000 7ff864b6b740 1 -- 172.21.15.92:0/4008495648 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f6a5ba4d60 con 0x55f6a5c42680 2024-09-19T08:57:32.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.802+0000 7ff85bfff640 1 --2- 172.21.15.92:0/4008495648 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f6a5c42680 0x55f6a5cbfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:32.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.803+0000 7ff85bfff640 1 --2- 172.21.15.92:0/4008495648 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f6a5c42680 0x55f6a5cbfb40 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90f1bd3399b46b9b server_cookie=b34f0049c1feb882 in_seq=0 out_seq=0 2024-09-19T08:57:32.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.803+0000 7ff83b7fe640 10 client.15489 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:32.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.803+0000 7ff83b7fe640 1 -- 172.21.15.92:0/4008495648 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55f6a5ba4d60 con 0x55f6a5c42680 2024-09-19T08:57:32.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.803+0000 7ff83b7fe640 10 client.15489 handle_command_reply: tid=0 2024-09-19T08:57:32.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.803+0000 7ff864b6b740 1 client.15489 shutdown 2024-09-19T08:57:32.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.803+0000 7ff864b6b740 1 -- 172.21.15.92:0/4008495648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f6a5c374a0 msgr2=0x55f6a5c47120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:32.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.803+0000 7ff864b6b740 1 --2- 172.21.15.92:0/4008495648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f6a5c374a0 0x55f6a5c47120 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff84400c520 tx=0x7ff84400a710 comp rx=0 tx=0).stop 2024-09-19T08:57:32.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.803+0000 7ff864b6b740 1 -- 172.21.15.92:0/4008495648 shutdown_connections 2024-09-19T08:57:32.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.803+0000 7ff864b6b740 1 --2- 172.21.15.92:0/4008495648 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f6a5c42680 0x55f6a5cbfb40 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:32.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.803+0000 7ff864b6b740 1 --2- 172.21.15.92:0/4008495648 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f6a5c37dc0 0x55f6a5cbbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:32.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.803+0000 7ff864b6b740 1 --2- 172.21.15.92:0/4008495648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f6a5c374a0 0x55f6a5c47120 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:32.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.803+0000 7ff83b7fe640 0 client.15489 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:32.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.803+0000 7ff864b6b740 1 --2- 172.21.15.92:0/4008495648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f6a5c33a30 0x55f6a5c46be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:32.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.803+0000 7ff864b6b740 1 -- 172.21.15.92:0/4008495648 >> 172.21.15.92:0/4008495648 conn(0x55f6a5c3f880 msgr2=0x55f6a5c38ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:32.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.803+0000 7ff864b6b740 1 -- 172.21.15.92:0/4008495648 shutdown_connections 2024-09-19T08:57:32.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.803+0000 7ff864b6b740 1 -- 172.21.15.92:0/4008495648 wait complete. 2024-09-19T08:57:32.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.803+0000 7ff864b6b740 20 client.15489 trim_cache size 0 max 16384 2024-09-19T08:57:32.820 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T08:57:32.821 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-19T08:57:32.821 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {} 2024-09-19T08:57:32.821 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T08:57:32.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.804+0000 7ff862792640 1 -- 172.21.15.92:0/3809094705 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff8480a3240 msgr2=0x7ff8480a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:32.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.804+0000 7ff862792640 1 --2- 172.21.15.92:0/3809094705 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff8480a3240 0x7ff8480a5700 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff85402ae00 tx=0x7ff8540095c0 comp rx=0 tx=0).stop 2024-09-19T08:57:32.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.804+0000 7ff862792640 1 -- 172.21.15.92:0/3809094705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff85c100a80 msgr2=0x7ff85c1985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:32.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.804+0000 7ff862792640 1 --2- 172.21.15.92:0/3809094705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff85c100a80 0x7ff85c1985a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff84c00b4a0 tx=0x7ff84c00b960 comp rx=0 tx=0).stop 2024-09-19T08:57:32.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.804+0000 7ff862792640 1 -- 172.21.15.92:0/3809094705 shutdown_connections 2024-09-19T08:57:32.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.804+0000 7ff862792640 1 --2- 172.21.15.92:0/3809094705 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff85c106a80 0x7ff85c19ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:32.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.804+0000 7ff862792640 1 --2- 172.21.15.92:0/3809094705 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff85c101420 0x7ff85c198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:32.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.804+0000 7ff862792640 1 --2- 172.21.15.92:0/3809094705 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff8480a3240 0x7ff8480a5700 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:32.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.804+0000 7ff862792640 1 --2- 172.21.15.92:0/3809094705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff85c100a80 0x7ff85c1985a0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:32.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.804+0000 7ff862792640 1 -- 172.21.15.92:0/3809094705 >> 172.21.15.92:0/3809094705 conn(0x7ff85c0fc7a0 msgr2=0x7ff85c0fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:32.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.804+0000 7ff862792640 1 -- 172.21.15.92:0/3809094705 shutdown_connections 2024-09-19T08:57:32.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:32.804+0000 7ff862792640 1 -- 172.21.15.92:0/3809094705 wait complete. 2024-09-19T08:57:33.472 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:57:33.472 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:57:33.719 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:57:33.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:33 smithi092 ceph-mon[31407]: pgmap v362: 97 pgs: 97 active+clean; 1.0 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 843 op/s 2024-09-19T08:57:33.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:33 smithi167 ceph-mon[35359]: pgmap v362: 97 pgs: 97 active+clean; 1.0 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 843 op/s 2024-09-19T08:57:33.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:33 smithi190 ceph-mon[35358]: pgmap v362: 97 pgs: 97 active+clean; 1.0 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 843 op/s 2024-09-19T08:57:34.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.134+0000 7f5bbb403640 1 -- 172.21.15.92:0/3059916335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5bb4100e20 msgr2=0x7f5bb4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:34.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.134+0000 7f5bbb403640 1 --2- 172.21.15.92:0/3059916335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5bb4100e20 0x7f5bb4101200 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5bac009ca0 tx=0x7f5bac02a950 comp rx=0 tx=0).stop 2024-09-19T08:57:34.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.134+0000 7f5bbb403640 1 -- 172.21.15.92:0/3059916335 shutdown_connections 2024-09-19T08:57:34.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.134+0000 7f5bbb403640 1 --2- 172.21.15.92:0/3059916335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5bb4102ef0 0x7f5bb410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:34.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.134+0000 7f5bbb403640 1 --2- 172.21.15.92:0/3059916335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5bb4102570 0x7f5bb41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:34.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.134+0000 7f5bbb403640 1 --2- 172.21.15.92:0/3059916335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5bb4100e20 0x7f5bb4101200 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:34.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.134+0000 7f5bbb403640 1 -- 172.21.15.92:0/3059916335 >> 172.21.15.92:0/3059916335 conn(0x7f5bb40fc7d0 msgr2=0x7f5bb40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:34.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.134+0000 7f5bbb403640 1 -- 172.21.15.92:0/3059916335 shutdown_connections 2024-09-19T08:57:34.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.134+0000 7f5bbb403640 1 -- 172.21.15.92:0/3059916335 wait complete. 2024-09-19T08:57:34.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.135+0000 7f5bbb403640 1 Processor -- start 2024-09-19T08:57:34.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.135+0000 7f5bbb403640 1 -- start start 2024-09-19T08:57:34.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.135+0000 7f5bbb403640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5bb4100e20 0x7f5bb4197580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:34.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.135+0000 7f5bbb403640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5bb4102570 0x7f5bb4197ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:34.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.135+0000 7f5bbb403640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5bb4102ef0 0x7f5bb419be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:34.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.135+0000 7f5bbb403640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb4111020 con 0x7f5bb4100e20 2024-09-19T08:57:34.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.135+0000 7f5bbb403640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb4110ea0 con 0x7f5bb4102ef0 2024-09-19T08:57:34.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.135+0000 7f5bbb403640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb41111a0 con 0x7f5bb4102570 2024-09-19T08:57:34.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.135+0000 7f5bb919f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5bb4100e20 0x7f5bb4197580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:34.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.135+0000 7f5bb919f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5bb4100e20 0x7f5bb4197580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54068/0 (socket says 172.21.15.92:54068) 2024-09-19T08:57:34.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.135+0000 7f5bb919f640 1 -- 172.21.15.92:0/4146155836 learned_addr learned my addr 172.21.15.92:0/4146155836 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:34.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.135+0000 7f5bb99a0640 1 --2- 172.21.15.92:0/4146155836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5bb4102ef0 0x7f5bb419be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:34.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.135+0000 7f5bb899e640 1 --2- 172.21.15.92:0/4146155836 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5bb4102570 0x7f5bb4197ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:34.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.135+0000 7f5bb919f640 1 -- 172.21.15.92:0/4146155836 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5bb4102570 msgr2=0x7f5bb4197ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:34.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.135+0000 7f5bb919f640 1 --2- 172.21.15.92:0/4146155836 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5bb4102570 0x7f5bb4197ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:34.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.135+0000 7f5bb919f640 1 -- 172.21.15.92:0/4146155836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5bb4102ef0 msgr2=0x7f5bb419be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:34.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.135+0000 7f5bb919f640 1 --2- 172.21.15.92:0/4146155836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5bb4102ef0 0x7f5bb419be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:34.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.135+0000 7f5bb919f640 1 -- 172.21.15.92:0/4146155836 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb419c530 con 0x7f5bb4100e20 2024-09-19T08:57:34.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.136+0000 7f5bb919f640 1 --2- 172.21.15.92:0/4146155836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5bb4100e20 0x7f5bb4197580 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5bac005cc0 tx=0x7f5bac02f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:34.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.136+0000 7f5bb27fc640 1 -- 172.21.15.92:0/4146155836 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bac034040 con 0x7f5bb4100e20 2024-09-19T08:57:34.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.136+0000 7f5bb27fc640 1 -- 172.21.15.92:0/4146155836 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5bac030920 con 0x7f5bb4100e20 2024-09-19T08:57:34.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.136+0000 7f5bbb403640 1 -- 172.21.15.92:0/4146155836 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bb419c7c0 con 0x7f5bb4100e20 2024-09-19T08:57:34.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.136+0000 7f5bb27fc640 1 -- 172.21.15.92:0/4146155836 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bac045480 con 0x7f5bb4100e20 2024-09-19T08:57:34.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.136+0000 7f5bbb403640 1 -- 172.21.15.92:0/4146155836 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bb41a4100 con 0x7f5bb4100e20 2024-09-19T08:57:34.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.137+0000 7f5bbb403640 1 -- 172.21.15.92:0/4146155836 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bb4101280 con 0x7f5bb4100e20 2024-09-19T08:57:34.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.138+0000 7f5bb27fc640 1 -- 172.21.15.92:0/4146155836 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5bac037020 con 0x7f5bb4100e20 2024-09-19T08:57:34.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.139+0000 7f5bb27fc640 1 --2- 172.21.15.92:0/4146155836 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5b9c0a3240 0x7f5b9c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:34.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.139+0000 7f5bb27fc640 1 -- 172.21.15.92:0/4146155836 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f5bac0f0ce0 con 0x7f5bb4100e20 2024-09-19T08:57:34.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.139+0000 7f5bb899e640 1 --2- 172.21.15.92:0/4146155836 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5b9c0a3240 0x7f5b9c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:34.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.140+0000 7f5bb899e640 1 --2- 172.21.15.92:0/4146155836 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5b9c0a3240 0x7f5b9c0a5700 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5bb40ffea0 tx=0x7f5ba8009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:34.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.142+0000 7f5bb27fc640 1 -- 172.21.15.92:0/4146155836 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5bac081210 con 0x7f5bb4100e20 2024-09-19T08:57:34.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.344+0000 7f5bbb403640 1 -- 172.21.15.92:0/4146155836 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5bb4109090 con 0x7f5bb4100e20 2024-09-19T08:57:34.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.344+0000 7f5bb27fc640 1 -- 172.21.15.92:0/4146155836 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f5bac0bda00 con 0x7f5bb4100e20 2024-09-19T08:57:34.345 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:57:34.346 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T08:57:34.346 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T08:57:34.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.347+0000 7f5bbb403640 1 -- 172.21.15.92:0/4146155836 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5b9c0a3240 msgr2=0x7f5b9c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:34.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.347+0000 7f5bbb403640 1 --2- 172.21.15.92:0/4146155836 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5b9c0a3240 0x7f5b9c0a5700 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5bb40ffea0 tx=0x7f5ba8009110 comp rx=0 tx=0).stop 2024-09-19T08:57:34.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.347+0000 7f5bbb403640 1 -- 172.21.15.92:0/4146155836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5bb4100e20 msgr2=0x7f5bb4197580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:34.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.347+0000 7f5bbb403640 1 --2- 172.21.15.92:0/4146155836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5bb4100e20 0x7f5bb4197580 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5bac005cc0 tx=0x7f5bac02f6c0 comp rx=0 tx=0).stop 2024-09-19T08:57:34.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.347+0000 7f5bbb403640 1 -- 172.21.15.92:0/4146155836 shutdown_connections 2024-09-19T08:57:34.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.347+0000 7f5bbb403640 1 --2- 172.21.15.92:0/4146155836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5bb4102ef0 0x7f5bb419be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:34.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.347+0000 7f5bbb403640 1 --2- 172.21.15.92:0/4146155836 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5bb4102570 0x7f5bb4197ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:34.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.347+0000 7f5bbb403640 1 --2- 172.21.15.92:0/4146155836 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5b9c0a3240 0x7f5b9c0a5700 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:34.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.347+0000 7f5bbb403640 1 --2- 172.21.15.92:0/4146155836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5bb4100e20 0x7f5bb4197580 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:34.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.347+0000 7f5bbb403640 1 -- 172.21.15.92:0/4146155836 >> 172.21.15.92:0/4146155836 conn(0x7f5bb40fc7d0 msgr2=0x7f5bb40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:34.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.347+0000 7f5bbb403640 1 -- 172.21.15.92:0/4146155836 shutdown_connections 2024-09-19T08:57:34.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:34.347+0000 7f5bbb403640 1 -- 172.21.15.92:0/4146155836 wait complete. 2024-09-19T08:57:34.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:34 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/4146155836' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:57:34.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:34 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/4146155836' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:57:34.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:34 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/4146155836' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:57:34.995 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:57:35.239 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:57:35.662 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:35 smithi092 ceph-mon[31407]: pgmap v363: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 751 op/s 2024-09-19T08:57:35.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.669+0000 7f438fb11640 1 -- 172.21.15.92:0/3099115047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4388103660 msgr2=0x7f438810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:35.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.669+0000 7f438fb11640 1 --2- 172.21.15.92:0/3099115047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4388103660 0x7f438810bb50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4378009900 tx=0x7f437802a480 comp rx=0 tx=0).stop 2024-09-19T08:57:35.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.669+0000 7f438fb11640 1 -- 172.21.15.92:0/3099115047 shutdown_connections 2024-09-19T08:57:35.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.669+0000 7f438fb11640 1 --2- 172.21.15.92:0/3099115047 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f438810c170 0x7f438810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.669+0000 7f438fb11640 1 --2- 172.21.15.92:0/3099115047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4388103660 0x7f438810bb50 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.669+0000 7f438fb11640 1 --2- 172.21.15.92:0/3099115047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4388102d40 0x7f4388103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.669+0000 7f438fb11640 1 -- 172.21.15.92:0/3099115047 >> 172.21.15.92:0/3099115047 conn(0x7f43880fc7a0 msgr2=0x7f43880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:35.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.669+0000 7f438fb11640 1 -- 172.21.15.92:0/3099115047 shutdown_connections 2024-09-19T08:57:35.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.669+0000 7f438fb11640 1 -- 172.21.15.92:0/3099115047 wait complete. 2024-09-19T08:57:35.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.669+0000 7f438fb11640 1 Processor -- start 2024-09-19T08:57:35.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.669+0000 7f438fb11640 1 -- start start 2024-09-19T08:57:35.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.670+0000 7f438fb11640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4388102d40 0x7f4388198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:35.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.670+0000 7f438fb11640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4388103660 0x7f4388198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:35.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.670+0000 7f438fb11640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f438810c170 0x7f438819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:35.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.670+0000 7f438fb11640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4388111fb0 con 0x7f438810c170 2024-09-19T08:57:35.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.670+0000 7f438fb11640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4388111e30 con 0x7f4388102d40 2024-09-19T08:57:35.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.670+0000 7f438fb11640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4388112130 con 0x7f4388103660 2024-09-19T08:57:35.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.670+0000 7f438e0ae640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f438810c170 0x7f438819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:35.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.670+0000 7f438e0ae640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f438810c170 0x7f438819cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54078/0 (socket says 172.21.15.92:54078) 2024-09-19T08:57:35.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.670+0000 7f438e0ae640 1 -- 172.21.15.92:0/1330297668 learned_addr learned my addr 172.21.15.92:0/1330297668 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:35.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.670+0000 7f438d8ad640 1 --2- 172.21.15.92:0/1330297668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4388102d40 0x7f4388198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:35.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.670+0000 7f438d0ac640 1 --2- 172.21.15.92:0/1330297668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4388103660 0x7f4388198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:35.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.670+0000 7f438e0ae640 1 -- 172.21.15.92:0/1330297668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4388103660 msgr2=0x7f4388198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:35.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.670+0000 7f438e0ae640 1 --2- 172.21.15.92:0/1330297668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4388103660 0x7f4388198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.670+0000 7f438e0ae640 1 -- 172.21.15.92:0/1330297668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4388102d40 msgr2=0x7f4388198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:35.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.670+0000 7f438e0ae640 1 --2- 172.21.15.92:0/1330297668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4388102d40 0x7f4388198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.670+0000 7f438e0ae640 1 -- 172.21.15.92:0/1330297668 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f438819d3e0 con 0x7f438810c170 2024-09-19T08:57:35.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.670+0000 7f438d8ad640 1 --2- 172.21.15.92:0/1330297668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4388102d40 0x7f4388198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:57:35.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.670+0000 7f438e0ae640 1 --2- 172.21.15.92:0/1330297668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f438810c170 0x7f438819cd00 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f438000b970 tx=0x7f438000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:35.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.670+0000 7f437effd640 1 -- 172.21.15.92:0/1330297668 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4380019070 con 0x7f438810c170 2024-09-19T08:57:35.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.670+0000 7f437effd640 1 -- 172.21.15.92:0/1330297668 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f438000cb40 con 0x7f438810c170 2024-09-19T08:57:35.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.670+0000 7f438fb11640 1 -- 172.21.15.92:0/1330297668 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f438819d6d0 con 0x7f438810c170 2024-09-19T08:57:35.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.670+0000 7f437effd640 1 -- 172.21.15.92:0/1330297668 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4380007650 con 0x7f438810c170 2024-09-19T08:57:35.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.671+0000 7f438fb11640 1 -- 172.21.15.92:0/1330297668 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43881a4fb0 con 0x7f438810c170 2024-09-19T08:57:35.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.673+0000 7f437effd640 1 -- 172.21.15.92:0/1330297668 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f438001c070 con 0x7f438810c170 2024-09-19T08:57:35.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.673+0000 7f4391eea740 1 Processor -- start 2024-09-19T08:57:35.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.673+0000 7f4391eea740 1 -- start start 2024-09-19T08:57:35.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.673+0000 7f437effd640 1 --2- 172.21.15.92:0/1330297668 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f43740a32c0 0x7f43740a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:35.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.673+0000 7f4391eea740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bda3feb40 0x561bda3fd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:35.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.673+0000 7f4391eea740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561bda3fd5d0 0x561bda3fda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:35.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.674+0000 7f4391eea740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bda408370 0x561bda40a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:35.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.674+0000 7f4391eea740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561bda3632f0 con 0x561bda3feb40 2024-09-19T08:57:35.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.674+0000 7f4391eea740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561bda30acf0 con 0x561bda3fd5d0 2024-09-19T08:57:35.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.674+0000 7f4391eea740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x561bda35f2b0 con 0x561bda408370 2024-09-19T08:57:35.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.674+0000 7f437effd640 1 -- 172.21.15.92:0/1330297668 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f43800cef10 con 0x7f438810c170 2024-09-19T08:57:35.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.674+0000 7f438d0ac640 1 --2- 172.21.15.92:0/1330297668 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f43740a32c0 0x7f43740a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:35.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.674+0000 7f438d8ad640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bda3feb40 0x561bda3fd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:35.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.674+0000 7f438d8ad640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bda3feb40 0x561bda3fd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54088/0 (socket says 172.21.15.92:54088) 2024-09-19T08:57:35.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.674+0000 7f438d8ad640 1 -- 172.21.15.92:0/2340094335 learned_addr learned my addr 172.21.15.92:0/2340094335 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:35.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.674+0000 7f438d0ac640 1 --2- 172.21.15.92:0/2340094335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561bda3fd5d0 0x561bda3fda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:35.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.674+0000 7f438e0ae640 1 --2- 172.21.15.92:0/2340094335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bda408370 0x561bda40a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:35.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.674+0000 7f438d8ad640 1 -- 172.21.15.92:0/2340094335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bda408370 msgr2=0x561bda40a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:35.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.674+0000 7f438d8ad640 1 --2- 172.21.15.92:0/2340094335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bda408370 0x561bda40a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.674+0000 7f438d8ad640 1 -- 172.21.15.92:0/2340094335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561bda3fd5d0 msgr2=0x561bda3fda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:35.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.674+0000 7f438d8ad640 1 --2- 172.21.15.92:0/2340094335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561bda3fd5d0 0x561bda3fda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.674+0000 7f438d8ad640 1 -- 172.21.15.92:0/2340094335 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bda2ef3a0 con 0x561bda3feb40 2024-09-19T08:57:35.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.674+0000 7f438d0ac640 1 --2- 172.21.15.92:0/1330297668 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f43740a32c0 0x7f43740a5780 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f438810d4e0 tx=0x7f4378032cb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:35.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.674+0000 7f438d8ad640 1 --2- 172.21.15.92:0/2340094335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bda3feb40 0x561bda3fd090 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f4384008c60 tx=0x7f438400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c39f7503251c881 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:35.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.674+0000 7f4373fff640 1 -- 172.21.15.92:0/2340094335 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4384014070 con 0x561bda3feb40 2024-09-19T08:57:35.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.675+0000 7f4373fff640 1 -- 172.21.15.92:0/2340094335 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43840047a0 con 0x561bda3feb40 2024-09-19T08:57:35.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.675+0000 7f4373fff640 1 -- 172.21.15.92:0/2340094335 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4384010700 con 0x561bda3feb40 2024-09-19T08:57:35.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.675+0000 7f4391eea740 1 -- 172.21.15.92:0/2340094335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bda3feb40 msgr2=0x561bda3fd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:35.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.675+0000 7f4391eea740 1 --2- 172.21.15.92:0/2340094335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bda3feb40 0x561bda3fd090 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f4384008c60 tx=0x7f438400e720 comp rx=0 tx=0).stop 2024-09-19T08:57:35.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.675+0000 7f4391eea740 1 -- 172.21.15.92:0/2340094335 shutdown_connections 2024-09-19T08:57:35.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.675+0000 7f4391eea740 1 --2- 172.21.15.92:0/2340094335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bda408370 0x561bda40a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.675+0000 7f4391eea740 1 --2- 172.21.15.92:0/2340094335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561bda3fd5d0 0x561bda3fda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.675+0000 7f4391eea740 1 --2- 172.21.15.92:0/2340094335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bda3feb40 0x561bda3fd090 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.675+0000 7f4391eea740 1 -- 172.21.15.92:0/2340094335 >> 172.21.15.92:0/2340094335 conn(0x561bda3c6310 msgr2=0x561bda3f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:35.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.675+0000 7f4391eea740 1 -- 172.21.15.92:0/2340094335 shutdown_connections 2024-09-19T08:57:35.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.675+0000 7f4391eea740 1 -- 172.21.15.92:0/2340094335 wait complete. 2024-09-19T08:57:35.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.676+0000 7f4391eea740 1 -- start start 2024-09-19T08:57:35.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.676+0000 7f4391eea740 1 Processor -- start 2024-09-19T08:57:35.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.676+0000 7f4391eea740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bda3fd5d0 0x561bda407cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:35.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.676+0000 7f4391eea740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561bda3feb40 0x561bda404fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:35.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.676+0000 7f4391eea740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bda408370 0x561bda405570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:35.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.676+0000 7f4391eea740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561bda40f480 con 0x561bda408370 2024-09-19T08:57:35.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.676+0000 7f4391eea740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561bda31e060 con 0x561bda3feb40 2024-09-19T08:57:35.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.676+0000 7f4391eea740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x561bda40f600 con 0x561bda3fd5d0 2024-09-19T08:57:35.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.676+0000 7f4391eea740 10 client.0 _ll_register_callbacks cb 0x561bda0718c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:35.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.676+0000 7f438e0ae640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bda408370 0x561bda405570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:35.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.676+0000 7f438e0ae640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bda408370 0x561bda405570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54096/0 (socket says 172.21.15.92:54096) 2024-09-19T08:57:35.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.677+0000 7f438e0ae640 1 -- 172.21.15.92:0/3024502654 learned_addr learned my addr 172.21.15.92:0/3024502654 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:35.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.677+0000 7f438d8ad640 1 --2- 172.21.15.92:0/3024502654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bda3fd5d0 0x561bda407cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:35.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.677+0000 7f438d0ac640 1 --2- 172.21.15.92:0/3024502654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561bda3feb40 0x561bda404fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:35.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.677+0000 7f438e0ae640 1 -- 172.21.15.92:0/3024502654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bda3fd5d0 msgr2=0x561bda407cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:35.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.677+0000 7f438e0ae640 1 --2- 172.21.15.92:0/3024502654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bda3fd5d0 0x561bda407cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.677+0000 7f438e0ae640 1 -- 172.21.15.92:0/3024502654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561bda3feb40 msgr2=0x561bda404fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:35.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.677+0000 7f438e0ae640 1 --2- 172.21.15.92:0/3024502654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561bda3feb40 0x561bda404fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.677+0000 7f438e0ae640 1 -- 172.21.15.92:0/3024502654 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bda0d43c0 con 0x561bda408370 2024-09-19T08:57:35.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.677+0000 7f438e0ae640 1 --2- 172.21.15.92:0/3024502654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bda408370 0x561bda405570 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4380014d40 tx=0x7f438009ae50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb14904c39d6c00 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:35.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.677+0000 7f43717fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:57:35.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.677+0000 7f43717fa640 1 -- 172.21.15.92:0/3024502654 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438009f8a0 con 0x561bda408370 2024-09-19T08:57:35.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.677+0000 7f43717fa640 1 -- 172.21.15.92:0/3024502654 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f43800a3cd0 con 0x561bda408370 2024-09-19T08:57:35.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.677+0000 7f4391eea740 1 -- 172.21.15.92:0/3024502654 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43840047a0 con 0x561bda408370 2024-09-19T08:57:35.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.677+0000 7f43717fa640 1 -- 172.21.15.92:0/3024502654 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f43800a4160 con 0x561bda408370 2024-09-19T08:57:35.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.677+0000 7f4391eea740 10 client.15507 fetch_fsmap learned FSMap version 19 2024-09-19T08:57:35.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.677+0000 7f4391eea740 1 -- 172.21.15.92:0/3024502654 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x561bda41af30 con 0x561bda408370 2024-09-19T08:57:35.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.677+0000 7f43717fa640 1 -- 172.21.15.92:0/3024502654 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43840047a0 con 0x561bda408370 2024-09-19T08:57:35.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.678+0000 7f43717fa640 1 -- 172.21.15.92:0/3024502654 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f43800b4150 con 0x561bda408370 2024-09-19T08:57:35.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.678+0000 7f4391eea740 10 client.15507 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:57:35.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.678+0000 7f4391eea740 10 client.15507 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:57:35.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.678+0000 7f4391eea740 20 client.15507 populate_metadata read hostname 'smithi092' 2024-09-19T08:57:35.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.678+0000 7f4391eea740 1 --2- 172.21.15.92:0/3024502654 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561bda41c3f0 0x561bda41e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:35.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.678+0000 7f4391eea740 4 client.15507 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:57:35.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.678+0000 7f4391eea740 1 -- 172.21.15.92:0/3024502654 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561bda370860 con 0x561bda41c3f0 2024-09-19T08:57:35.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.678+0000 7f438d8ad640 1 --2- 172.21.15.92:0/3024502654 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561bda41c3f0 0x561bda41e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:35.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.678+0000 7f438d8ad640 1 --2- 172.21.15.92:0/3024502654 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561bda41c3f0 0x561bda41e840 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1518b12bbbcd1203 server_cookie=d16a3767631161b7 in_seq=0 out_seq=0 2024-09-19T08:57:35.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.678+0000 7f43717fa640 10 client.15507 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:35.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.679+0000 7f43717fa640 1 -- 172.21.15.92:0/3024502654 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561bda370860 con 0x561bda41c3f0 2024-09-19T08:57:35.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.679+0000 7f43717fa640 10 client.15507 handle_command_reply: tid=0 2024-09-19T08:57:35.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.679+0000 7f4391eea740 1 client.15507 shutdown 2024-09-19T08:57:35.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.679+0000 7f4391eea740 1 -- 172.21.15.92:0/3024502654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bda408370 msgr2=0x561bda405570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:35.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.679+0000 7f4391eea740 1 --2- 172.21.15.92:0/3024502654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bda408370 0x561bda405570 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4380014d40 tx=0x7f438009ae50 comp rx=0 tx=0).stop 2024-09-19T08:57:35.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.680+0000 7f4391eea740 1 -- 172.21.15.92:0/3024502654 shutdown_connections 2024-09-19T08:57:35.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.680+0000 7f4391eea740 1 --2- 172.21.15.92:0/3024502654 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561bda41c3f0 0x561bda41e840 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.680+0000 7f4391eea740 1 --2- 172.21.15.92:0/3024502654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bda408370 0x561bda405570 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.680+0000 7f4391eea740 1 --2- 172.21.15.92:0/3024502654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561bda3feb40 0x561bda404fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.680+0000 7f43717fa640 0 client.15507 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:35.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.680+0000 7f4391eea740 1 --2- 172.21.15.92:0/3024502654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bda3fd5d0 0x561bda407cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.680+0000 7f4391eea740 1 -- 172.21.15.92:0/3024502654 >> 172.21.15.92:0/3024502654 conn(0x561bda3c6310 msgr2=0x561bda3ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:35.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.680+0000 7f4391eea740 1 -- 172.21.15.92:0/3024502654 shutdown_connections 2024-09-19T08:57:35.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.680+0000 7f4391eea740 1 -- 172.21.15.92:0/3024502654 wait complete. 2024-09-19T08:57:35.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.680+0000 7f4391eea740 20 client.15507 trim_cache size 0 max 16384 2024-09-19T08:57:35.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.693+0000 7f4391eea740 1 Processor -- start 2024-09-19T08:57:35.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.693+0000 7f4391eea740 1 -- start start 2024-09-19T08:57:35.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.693+0000 7f4391eea740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bda3fd5d0 0x561bda418720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:35.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.693+0000 7f4391eea740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bda3feb40 0x561bda424110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:35.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.693+0000 7f4391eea740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561bda408370 0x561bda424650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:35.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.693+0000 7f4391eea740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f43881a9390 con 0x561bda3feb40 2024-09-19T08:57:35.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.693+0000 7f4391eea740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f43881abc30 con 0x561bda408370 2024-09-19T08:57:35.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.693+0000 7f4391eea740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f43881a9a20 con 0x561bda3fd5d0 2024-09-19T08:57:35.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.693+0000 7f438d0ac640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bda3feb40 0x561bda424110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:35.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.693+0000 7f438d0ac640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bda3feb40 0x561bda424110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54110/0 (socket says 172.21.15.92:54110) 2024-09-19T08:57:35.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.693+0000 7f438d0ac640 1 -- 172.21.15.92:0/715073008 learned_addr learned my addr 172.21.15.92:0/715073008 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:35.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.693+0000 7f438d8ad640 1 --2- 172.21.15.92:0/715073008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bda3fd5d0 0x561bda418720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:35.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.693+0000 7f438d0ac640 1 -- 172.21.15.92:0/715073008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bda3fd5d0 msgr2=0x561bda418720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:35.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.693+0000 7f438d0ac640 1 --2- 172.21.15.92:0/715073008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bda3fd5d0 0x561bda418720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.693+0000 7f438d0ac640 1 -- 172.21.15.92:0/715073008 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561bda408370 msgr2=0x561bda424650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:35.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.693+0000 7f438d0ac640 1 --2- 172.21.15.92:0/715073008 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561bda408370 0x561bda424650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.693+0000 7f438d0ac640 1 -- 172.21.15.92:0/715073008 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bda41eec0 con 0x561bda3feb40 2024-09-19T08:57:35.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.693+0000 7f438d0ac640 1 --2- 172.21.15.92:0/715073008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bda3feb40 0x561bda424110 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f437802a9a0 tx=0x7f437802a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be04d88668363a7b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:35.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.694+0000 7f43737fe640 1 -- 172.21.15.92:0/715073008 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f437804f070 con 0x561bda3feb40 2024-09-19T08:57:35.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.694+0000 7f43737fe640 1 -- 172.21.15.92:0/715073008 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4378004340 con 0x561bda3feb40 2024-09-19T08:57:35.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.694+0000 7f43737fe640 1 -- 172.21.15.92:0/715073008 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4378035040 con 0x561bda3feb40 2024-09-19T08:57:35.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.694+0000 7f4391eea740 1 -- 172.21.15.92:0/715073008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bda3feb40 msgr2=0x561bda424110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:35.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.694+0000 7f4391eea740 1 --2- 172.21.15.92:0/715073008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bda3feb40 0x561bda424110 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f437802a9a0 tx=0x7f437802a480 comp rx=0 tx=0).stop 2024-09-19T08:57:35.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.694+0000 7f4391eea740 1 -- 172.21.15.92:0/715073008 shutdown_connections 2024-09-19T08:57:35.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.694+0000 7f4391eea740 1 --2- 172.21.15.92:0/715073008 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561bda408370 0x561bda424650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.694+0000 7f4391eea740 1 --2- 172.21.15.92:0/715073008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bda3feb40 0x561bda424110 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.694+0000 7f4391eea740 1 --2- 172.21.15.92:0/715073008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bda3fd5d0 0x561bda418720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.694+0000 7f4391eea740 1 -- 172.21.15.92:0/715073008 >> 172.21.15.92:0/715073008 conn(0x561bda3c6310 msgr2=0x561bda404f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:35.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.694+0000 7f4391eea740 1 -- 172.21.15.92:0/715073008 shutdown_connections 2024-09-19T08:57:35.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.694+0000 7f4391eea740 1 -- 172.21.15.92:0/715073008 wait complete. 2024-09-19T08:57:35.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.695+0000 7f4391eea740 1 -- start start 2024-09-19T08:57:35.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.695+0000 7f4391eea740 1 Processor -- start 2024-09-19T08:57:35.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.695+0000 7f4391eea740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bda3fd5d0 0x561bda410d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:35.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.695+0000 7f4391eea740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bda3feb40 0x561bda4112c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:35.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.695+0000 7f4391eea740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561bda408370 0x561bda4860e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:35.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.695+0000 7f4391eea740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f43881aa0f0 con 0x561bda3fd5d0 2024-09-19T08:57:35.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.695+0000 7f4391eea740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f43881ab560 con 0x561bda408370 2024-09-19T08:57:35.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.695+0000 7f4391eea740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f43881aa7c0 con 0x561bda3feb40 2024-09-19T08:57:35.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.695+0000 7f4391eea740 10 client.0 _ll_register_callbacks cb 0x7f4380097150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:35.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.695+0000 7f438d8ad640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bda3fd5d0 0x561bda410d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:35.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.695+0000 7f438d8ad640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bda3fd5d0 0x561bda410d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54120/0 (socket says 172.21.15.92:54120) 2024-09-19T08:57:35.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.695+0000 7f438d8ad640 1 -- 172.21.15.92:0/2772730024 learned_addr learned my addr 172.21.15.92:0/2772730024 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:35.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.696+0000 7f438e0ae640 1 --2- 172.21.15.92:0/2772730024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561bda408370 0x561bda4860e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:35.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.696+0000 7f438d0ac640 1 --2- 172.21.15.92:0/2772730024 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bda3feb40 0x561bda4112c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:35.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.696+0000 7f438d8ad640 1 -- 172.21.15.92:0/2772730024 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bda3feb40 msgr2=0x561bda4112c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:35.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.696+0000 7f438d8ad640 1 --2- 172.21.15.92:0/2772730024 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bda3feb40 0x561bda4112c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.696+0000 7f438d8ad640 1 -- 172.21.15.92:0/2772730024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561bda408370 msgr2=0x561bda4860e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:35.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.696+0000 7f438d8ad640 1 --2- 172.21.15.92:0/2772730024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561bda408370 0x561bda4860e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.696+0000 7f438d8ad640 1 -- 172.21.15.92:0/2772730024 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bda4866d0 con 0x561bda3fd5d0 2024-09-19T08:57:35.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.696+0000 7f438e0ae640 1 --2- 172.21.15.92:0/2772730024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561bda408370 0x561bda4860e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:57:35.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.696+0000 7f438d0ac640 1 --2- 172.21.15.92:0/2772730024 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bda3feb40 0x561bda4112c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:57:35.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.696+0000 7f438d8ad640 1 --2- 172.21.15.92:0/2772730024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bda3fd5d0 0x561bda410d80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4384008b80 tx=0x7f4384000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bd3d7b852a21fce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:35.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.696+0000 7f43717fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:57:35.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.696+0000 7f43717fa640 1 -- 172.21.15.92:0/2772730024 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4384014040 con 0x561bda3fd5d0 2024-09-19T08:57:35.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.696+0000 7f43717fa640 1 -- 172.21.15.92:0/2772730024 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4384025650 con 0x561bda3fd5d0 2024-09-19T08:57:35.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.696+0000 7f4391eea740 1 -- 172.21.15.92:0/2772730024 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4378004340 con 0x561bda3fd5d0 2024-09-19T08:57:35.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.696+0000 7f43717fa640 1 -- 172.21.15.92:0/2772730024 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4384025850 con 0x561bda3fd5d0 2024-09-19T08:57:35.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.696+0000 7f4391eea740 10 client.15513 fetch_fsmap learned FSMap version 19 2024-09-19T08:57:35.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.696+0000 7f4391eea740 1 -- 172.21.15.92:0/2772730024 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x561bda487970 con 0x561bda3fd5d0 2024-09-19T08:57:35.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.696+0000 7f43717fa640 1 -- 172.21.15.92:0/2772730024 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4378004340 con 0x561bda3fd5d0 2024-09-19T08:57:35.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.697+0000 7f43717fa640 1 -- 172.21.15.92:0/2772730024 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f4384037050 con 0x561bda3fd5d0 2024-09-19T08:57:35.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.697+0000 7f4391eea740 10 client.15513 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:57:35.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.697+0000 7f4391eea740 10 client.15513 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:57:35.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.697+0000 7f4391eea740 20 client.15513 populate_metadata read hostname 'smithi092' 2024-09-19T08:57:35.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.697+0000 7f4391eea740 1 --2- 172.21.15.92:0/2772730024 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561bda487de0 0x561bda48a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:35.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.697+0000 7f4391eea740 4 client.15513 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:57:35.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.697+0000 7f4391eea740 1 -- 172.21.15.92:0/2772730024 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561bda36ad70 con 0x561bda487de0 2024-09-19T08:57:35.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.697+0000 7f438d0ac640 1 --2- 172.21.15.92:0/2772730024 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561bda487de0 0x561bda48a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:35.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.697+0000 7f43717fa640 10 client.15513 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:35.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.697+0000 7f438d0ac640 1 --2- 172.21.15.92:0/2772730024 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561bda487de0 0x561bda48a200 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e2e6954f951522e server_cookie=cd118b29c14bd955 in_seq=0 out_seq=0 2024-09-19T08:57:35.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.698+0000 7f43717fa640 1 -- 172.21.15.92:0/2772730024 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561bda36ad70 con 0x561bda487de0 2024-09-19T08:57:35.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.698+0000 7f43717fa640 10 client.15513 handle_command_reply: tid=0 2024-09-19T08:57:35.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.698+0000 7f4391eea740 1 client.15513 shutdown 2024-09-19T08:57:35.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.698+0000 7f4391eea740 1 -- 172.21.15.92:0/2772730024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bda3fd5d0 msgr2=0x561bda410d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:35.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.698+0000 7f4391eea740 1 --2- 172.21.15.92:0/2772730024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bda3fd5d0 0x561bda410d80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4384008b80 tx=0x7f4384000bc0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.698+0000 7f4391eea740 1 -- 172.21.15.92:0/2772730024 shutdown_connections 2024-09-19T08:57:35.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.698+0000 7f4391eea740 1 --2- 172.21.15.92:0/2772730024 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561bda487de0 0x561bda48a200 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.698+0000 7f4391eea740 1 --2- 172.21.15.92:0/2772730024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561bda408370 0x561bda4860e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.698+0000 7f43717fa640 0 client.15513 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:35.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.698+0000 7f4391eea740 1 --2- 172.21.15.92:0/2772730024 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561bda3feb40 0x561bda4112c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.698+0000 7f4391eea740 1 --2- 172.21.15.92:0/2772730024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bda3fd5d0 0x561bda410d80 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.698+0000 7f4391eea740 1 -- 172.21.15.92:0/2772730024 >> 172.21.15.92:0/2772730024 conn(0x561bda3c6310 msgr2=0x561bda406830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:35.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.698+0000 7f4391eea740 1 -- 172.21.15.92:0/2772730024 shutdown_connections 2024-09-19T08:57:35.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.698+0000 7f4391eea740 1 -- 172.21.15.92:0/2772730024 wait complete. 2024-09-19T08:57:35.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.698+0000 7f4391eea740 20 client.15513 trim_cache size 0 max 16384 2024-09-19T08:57:35.705 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-19T08:57:35.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.698+0000 7f438fb11640 1 -- 172.21.15.92:0/1330297668 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f43740a32c0 msgr2=0x7f43740a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:35.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.698+0000 7f438fb11640 1 --2- 172.21.15.92:0/1330297668 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f43740a32c0 0x7f43740a5780 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f438810d4e0 tx=0x7f4378032cb0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.698+0000 7f438fb11640 1 -- 172.21.15.92:0/1330297668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f438810c170 msgr2=0x7f438819cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:35.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.698+0000 7f438fb11640 1 --2- 172.21.15.92:0/1330297668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f438810c170 0x7f438819cd00 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f438000b970 tx=0x7f438000be30 comp rx=0 tx=0).stop 2024-09-19T08:57:35.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.699+0000 7f438fb11640 1 -- 172.21.15.92:0/1330297668 shutdown_connections 2024-09-19T08:57:35.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.699+0000 7f438fb11640 1 --2- 172.21.15.92:0/1330297668 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f43740a32c0 0x7f43740a5780 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.699+0000 7f438fb11640 1 --2- 172.21.15.92:0/1330297668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f438810c170 0x7f438819cd00 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.699+0000 7f438fb11640 1 --2- 172.21.15.92:0/1330297668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4388103660 0x7f4388198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.699+0000 7f438fb11640 1 --2- 172.21.15.92:0/1330297668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4388102d40 0x7f4388198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.699+0000 7f438fb11640 1 -- 172.21.15.92:0/1330297668 >> 172.21.15.92:0/1330297668 conn(0x7f43880fc7a0 msgr2=0x7f43880fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:35.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.699+0000 7f438fb11640 1 -- 172.21.15.92:0/1330297668 shutdown_connections 2024-09-19T08:57:35.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:35.699+0000 7f438fb11640 1 -- 172.21.15.92:0/1330297668 wait complete. 2024-09-19T08:57:35.799 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 50.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T08:57:35.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:35 smithi167 ceph-mon[35359]: pgmap v363: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 751 op/s 2024-09-19T08:57:35.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:35 smithi190 ceph-mon[35358]: pgmap v363: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 751 op/s 2024-09-19T08:57:37.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.409+0000 7ff58bc01640 1 -- 172.21.15.92:0/3603278121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff584103710 msgr2=0x7ff584109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:37.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.409+0000 7ff58bc01640 1 --2- 172.21.15.92:0/3603278121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff584103710 0x7ff584109fa0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff57c009ca0 tx=0x7ff57c02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.409+0000 7ff58bc01640 1 -- 172.21.15.92:0/3603278121 shutdown_connections 2024-09-19T08:57:37.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.409+0000 7ff58bc01640 1 --2- 172.21.15.92:0/3603278121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff584103710 0x7ff584109fa0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.409+0000 7ff58bc01640 1 --2- 172.21.15.92:0/3603278121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff584102d50 0x7ff5841031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.409+0000 7ff58bc01640 1 --2- 172.21.15.92:0/3603278121 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff584101b60 0x7ff584101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.409+0000 7ff58bc01640 1 -- 172.21.15.92:0/3603278121 >> 172.21.15.92:0/3603278121 conn(0x7ff5840fd2e0 msgr2=0x7ff5840ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:37.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.409+0000 7ff58bc01640 1 -- 172.21.15.92:0/3603278121 shutdown_connections 2024-09-19T08:57:37.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.409+0000 7ff58bc01640 1 -- 172.21.15.92:0/3603278121 wait complete. 2024-09-19T08:57:37.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.410+0000 7ff58bc01640 1 Processor -- start 2024-09-19T08:57:37.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.410+0000 7ff58bc01640 1 -- start start 2024-09-19T08:57:37.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.410+0000 7ff58bc01640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff584101b60 0x7ff584075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:37.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.410+0000 7ff58bc01640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff584102d50 0x7ff5840745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:37.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.410+0000 7ff58bc01640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff584103710 0x7ff584074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:37.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.410+0000 7ff58bc01640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff58410d7e0 con 0x7ff584101b60 2024-09-19T08:57:37.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.410+0000 7ff58bc01640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff58410d660 con 0x7ff584102d50 2024-09-19T08:57:37.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.410+0000 7ff58bc01640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff58410d960 con 0x7ff584103710 2024-09-19T08:57:37.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.411+0000 7ff58999d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff584101b60 0x7ff584075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:37.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.411+0000 7ff58999d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff584101b60 0x7ff584075fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54142/0 (socket says 172.21.15.92:54142) 2024-09-19T08:57:37.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.411+0000 7ff58999d640 1 -- 172.21.15.92:0/2764416339 learned_addr learned my addr 172.21.15.92:0/2764416339 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:37.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.411+0000 7ff58919c640 1 --2- 172.21.15.92:0/2764416339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff584102d50 0x7ff5840745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:37.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.411+0000 7ff58a19e640 1 --2- 172.21.15.92:0/2764416339 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff584103710 0x7ff584074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:37.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.411+0000 7ff58999d640 1 -- 172.21.15.92:0/2764416339 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff584103710 msgr2=0x7ff584074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:37.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.411+0000 7ff58999d640 1 --2- 172.21.15.92:0/2764416339 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff584103710 0x7ff584074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.411+0000 7ff58999d640 1 -- 172.21.15.92:0/2764416339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff584102d50 msgr2=0x7ff5840745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:37.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.411+0000 7ff58999d640 1 --2- 172.21.15.92:0/2764416339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff584102d50 0x7ff5840745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.411+0000 7ff58999d640 1 -- 172.21.15.92:0/2764416339 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5840753b0 con 0x7ff584101b60 2024-09-19T08:57:37.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.411+0000 7ff58919c640 1 --2- 172.21.15.92:0/2764416339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff584102d50 0x7ff5840745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:57:37.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.411+0000 7ff58a19e640 1 --2- 172.21.15.92:0/2764416339 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff584103710 0x7ff584074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:57:37.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.411+0000 7ff58999d640 1 --2- 172.21.15.92:0/2764416339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff584101b60 0x7ff584075fa0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff57800d950 tx=0x7ff57800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:37.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.411+0000 7ff576ffd640 1 -- 172.21.15.92:0/2764416339 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff578017070 con 0x7ff584101b60 2024-09-19T08:57:37.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.411+0000 7ff576ffd640 1 -- 172.21.15.92:0/2764416339 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff578009c30 con 0x7ff584101b60 2024-09-19T08:57:37.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.411+0000 7ff58bc01640 1 -- 172.21.15.92:0/2764416339 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5841a1ec0 con 0x7ff584101b60 2024-09-19T08:57:37.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.411+0000 7ff576ffd640 1 -- 172.21.15.92:0/2764416339 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57800f600 con 0x7ff584101b60 2024-09-19T08:57:37.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.411+0000 7ff58bc01640 1 -- 172.21.15.92:0/2764416339 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5841a22d0 con 0x7ff584101b60 2024-09-19T08:57:37.421 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:57:37.421 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:57:37.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.414+0000 7ff58ea71740 1 Processor -- start 2024-09-19T08:57:37.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.415+0000 7ff58ea71740 1 -- start start 2024-09-19T08:57:37.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.415+0000 7ff576ffd640 1 -- 172.21.15.92:0/2764416339 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff57801a070 con 0x7ff584101b60 2024-09-19T08:57:37.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.415+0000 7ff58ea71740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581635b99a0 0x5581635b9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:37.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.415+0000 7ff58ea71740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581635ba2e0 0x5581635beda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:37.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.415+0000 7ff58ea71740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5581635bf370 0x5581635c1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.415+0000 7ff58ea71740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55816351d2f0 con 0x5581635b99a0 2024-09-19T08:57:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.415+0000 7ff58ea71740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5581634c5270 con 0x5581635bf370 2024-09-19T08:57:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.415+0000 7ff58ea71740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5581635192b0 con 0x5581635ba2e0 2024-09-19T08:57:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.415+0000 7ff58a19e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581635b99a0 0x5581635b9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.415+0000 7ff58a19e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581635b99a0 0x5581635b9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54150/0 (socket says 172.21.15.92:54150) 2024-09-19T08:57:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.415+0000 7ff58a19e640 1 -- 172.21.15.92:0/618701130 learned_addr learned my addr 172.21.15.92:0/618701130 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.415+0000 7ff58919c640 1 --2- 172.21.15.92:0/618701130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5581635bf370 0x5581635c1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.415+0000 7ff58999d640 1 --2- 172.21.15.92:0/618701130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581635ba2e0 0x5581635beda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.416+0000 7ff576ffd640 1 --2- 172.21.15.92:0/2764416339 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff5700a32f0 0x7ff5700a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.416+0000 7ff58a19e640 1 -- 172.21.15.92:0/618701130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581635ba2e0 msgr2=0x5581635beda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.416+0000 7ff58a19e640 1 --2- 172.21.15.92:0/618701130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581635ba2e0 0x5581635beda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.416+0000 7ff58a19e640 1 -- 172.21.15.92:0/618701130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5581635bf370 msgr2=0x5581635c1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.416+0000 7ff58a19e640 1 --2- 172.21.15.92:0/618701130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5581635bf370 0x5581635c1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.416+0000 7ff58a19e640 1 -- 172.21.15.92:0/618701130 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581634c4340 con 0x5581635b99a0 2024-09-19T08:57:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.416+0000 7ff58999d640 1 --2- 172.21.15.92:0/618701130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581635ba2e0 0x5581635beda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:57:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.416+0000 7ff576ffd640 1 -- 172.21.15.92:0/2764416339 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff5780cf3d0 con 0x7ff584101b60 2024-09-19T08:57:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.416+0000 7ff58a19e640 1 --2- 172.21.15.92:0/618701130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581635b99a0 0x5581635b9da0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff57c009880 tx=0x7ff57c0098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aff098aef9b9295 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.416+0000 7ff58a19e640 1 --2- 172.21.15.92:0/2764416339 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff5700a32f0 0x7ff5700a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.416+0000 7ff56ffff640 1 -- 172.21.15.92:0/618701130 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57c049040 con 0x5581635b99a0 2024-09-19T08:57:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.416+0000 7ff56ffff640 1 -- 172.21.15.92:0/618701130 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff57c036050 con 0x5581635b99a0 2024-09-19T08:57:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.416+0000 7ff56ffff640 1 -- 172.21.15.92:0/618701130 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57c02f850 con 0x5581635b99a0 2024-09-19T08:57:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.417+0000 7ff58ea71740 1 -- 172.21.15.92:0/618701130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581635b99a0 msgr2=0x5581635b9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:37.425 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.417+0000 7ff58a19e640 1 --2- 172.21.15.92:0/2764416339 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff5700a32f0 0x7ff5700a57b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff57c044000 tx=0x7ff57c02ff70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.417+0000 7ff58ea71740 1 --2- 172.21.15.92:0/618701130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581635b99a0 0x5581635b9da0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff57c009880 tx=0x7ff57c0098b0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.417+0000 7ff58ea71740 1 -- 172.21.15.92:0/618701130 shutdown_connections 2024-09-19T08:57:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.417+0000 7ff58ea71740 1 --2- 172.21.15.92:0/618701130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5581635bf370 0x5581635c1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.417+0000 7ff58ea71740 1 --2- 172.21.15.92:0/618701130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581635ba2e0 0x5581635beda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.417+0000 7ff58ea71740 1 --2- 172.21.15.92:0/618701130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581635b99a0 0x5581635b9da0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.417+0000 7ff58ea71740 1 -- 172.21.15.92:0/618701130 >> 172.21.15.92:0/618701130 conn(0x5581635b5010 msgr2=0x5581635b5410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.417+0000 7ff58ea71740 1 -- 172.21.15.92:0/618701130 shutdown_connections 2024-09-19T08:57:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.417+0000 7ff58ea71740 1 -- 172.21.15.92:0/618701130 wait complete. 2024-09-19T08:57:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.418+0000 7ff58ea71740 1 -- start start 2024-09-19T08:57:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.418+0000 7ff58ea71740 1 Processor -- start 2024-09-19T08:57:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.418+0000 7ff58ea71740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581635b99a0 0x5581635c3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.418+0000 7ff58ea71740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5581635ba2e0 0x5581635c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.418+0000 7ff58ea71740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581635bf370 0x5581635caed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.418+0000 7ff58ea71740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5581635c2160 con 0x5581635bf370 2024-09-19T08:57:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.418+0000 7ff58ea71740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5581634a6290 con 0x5581635ba2e0 2024-09-19T08:57:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.418+0000 7ff58ea71740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5581635c22e0 con 0x5581635b99a0 2024-09-19T08:57:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.418+0000 7ff58ea71740 10 client.0 _ll_register_callbacks cb 0x5581634d7140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.418+0000 7ff58a19e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581635bf370 0x5581635caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.418+0000 7ff58a19e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581635bf370 0x5581635caed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54166/0 (socket says 172.21.15.92:54166) 2024-09-19T08:57:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.418+0000 7ff58a19e640 1 -- 172.21.15.92:0/2453390988 learned_addr learned my addr 172.21.15.92:0/2453390988 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.418+0000 7ff58919c640 1 --2- 172.21.15.92:0/2453390988 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5581635ba2e0 0x5581635c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.418+0000 7ff58999d640 1 --2- 172.21.15.92:0/2453390988 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581635b99a0 0x5581635c3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.418+0000 7ff58a19e640 1 -- 172.21.15.92:0/2453390988 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581635b99a0 msgr2=0x5581635c3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.418+0000 7ff58a19e640 1 --2- 172.21.15.92:0/2453390988 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581635b99a0 0x5581635c3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.418+0000 7ff58a19e640 1 -- 172.21.15.92:0/2453390988 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5581635ba2e0 msgr2=0x5581635c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.418+0000 7ff58a19e640 1 --2- 172.21.15.92:0/2453390988 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5581635ba2e0 0x5581635c3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.418+0000 7ff58a19e640 1 -- 172.21.15.92:0/2453390988 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558163230210 con 0x5581635bf370 2024-09-19T08:57:37.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.419+0000 7ff58a19e640 1 --2- 172.21.15.92:0/2453390988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581635bf370 0x5581635caed0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ff57c031ae0 tx=0x7ff57c042000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1812c4e8102ffd68 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:37.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.419+0000 7ff56d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:57:37.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.419+0000 7ff56d7fa640 1 -- 172.21.15.92:0/2453390988 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57c049040 con 0x5581635bf370 2024-09-19T08:57:37.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.419+0000 7ff56d7fa640 1 -- 172.21.15.92:0/2453390988 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff57c056070 con 0x5581635bf370 2024-09-19T08:57:37.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.419+0000 7ff58ea71740 1 -- 172.21.15.92:0/2453390988 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff57c036050 con 0x5581635bf370 2024-09-19T08:57:37.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.419+0000 7ff56d7fa640 1 -- 172.21.15.92:0/2453390988 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff57c004360 con 0x5581635bf370 2024-09-19T08:57:37.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.419+0000 7ff58ea71740 10 client.15525 fetch_fsmap learned FSMap version 19 2024-09-19T08:57:37.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.419+0000 7ff58ea71740 1 -- 172.21.15.92:0/2453390988 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5581632fc620 con 0x5581635bf370 2024-09-19T08:57:37.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.419+0000 7ff56d7fa640 1 -- 172.21.15.92:0/2453390988 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff57c036050 con 0x5581635bf370 2024-09-19T08:57:37.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.419+0000 7ff56d7fa640 1 -- 172.21.15.92:0/2453390988 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff57c062020 con 0x5581635bf370 2024-09-19T08:57:37.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.419+0000 7ff58ea71740 10 client.15525 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:57:37.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.419+0000 7ff58ea71740 10 client.15525 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T08:57:37.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.419+0000 7ff58ea71740 20 client.15525 populate_metadata read hostname 'smithi092' 2024-09-19T08:57:37.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.419+0000 7ff58ea71740 1 --2- 172.21.15.92:0/2453390988 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5581635cf320 0x5581635d1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:37.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.419+0000 7ff58ea71740 4 client.15525 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:57:37.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.419+0000 7ff58ea71740 1 -- 172.21.15.92:0/2453390988 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55816352aa20 con 0x5581635cf320 2024-09-19T08:57:37.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.420+0000 7ff58999d640 1 --2- 172.21.15.92:0/2453390988 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5581635cf320 0x5581635d1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:37.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.420+0000 7ff58999d640 1 --2- 172.21.15.92:0/2453390988 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5581635cf320 0x5581635d1770 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=296f7da887883a02 server_cookie=a69324c9725e76cd in_seq=0 out_seq=0 2024-09-19T08:57:37.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.420+0000 7ff56d7fa640 10 client.15525 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:37.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.421+0000 7ff56d7fa640 1 -- 172.21.15.92:0/2453390988 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55816352aa20 con 0x5581635cf320 2024-09-19T08:57:37.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.421+0000 7ff56d7fa640 10 client.15525 handle_command_reply: tid=0 2024-09-19T08:57:37.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.421+0000 7ff58ea71740 1 client.15525 shutdown 2024-09-19T08:57:37.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.421+0000 7ff58ea71740 1 -- 172.21.15.92:0/2453390988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581635bf370 msgr2=0x5581635caed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:37.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.421+0000 7ff58ea71740 1 --2- 172.21.15.92:0/2453390988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581635bf370 0x5581635caed0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ff57c031ae0 tx=0x7ff57c042000 comp rx=0 tx=0).stop 2024-09-19T08:57:37.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.421+0000 7ff58ea71740 1 -- 172.21.15.92:0/2453390988 shutdown_connections 2024-09-19T08:57:37.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.421+0000 7ff58ea71740 1 --2- 172.21.15.92:0/2453390988 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5581635cf320 0x5581635d1770 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.421+0000 7ff58ea71740 1 --2- 172.21.15.92:0/2453390988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581635bf370 0x5581635caed0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.421+0000 7ff58ea71740 1 --2- 172.21.15.92:0/2453390988 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5581635ba2e0 0x5581635c3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.421+0000 7ff58ea71740 1 --2- 172.21.15.92:0/2453390988 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581635b99a0 0x5581635c3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.421+0000 7ff56d7fa640 0 client.15525 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:37.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.421+0000 7ff58ea71740 1 -- 172.21.15.92:0/2453390988 >> 172.21.15.92:0/2453390988 conn(0x5581635b5010 msgr2=0x5581635b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:37.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.421+0000 7ff58ea71740 1 -- 172.21.15.92:0/2453390988 shutdown_connections 2024-09-19T08:57:37.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.421+0000 7ff58ea71740 1 -- 172.21.15.92:0/2453390988 wait complete. 2024-09-19T08:57:37.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.421+0000 7ff58ea71740 20 client.15525 trim_cache size 0 max 16384 2024-09-19T08:57:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.436+0000 7ff58ea71740 1 Processor -- start 2024-09-19T08:57:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.436+0000 7ff58ea71740 1 -- start start 2024-09-19T08:57:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.436+0000 7ff58ea71740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581635b99a0 0x5581635c3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.436+0000 7ff58ea71740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581635ba2e0 0x5581635cae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.436+0000 7ff58ea71740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5581635bf370 0x5581635c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.436+0000 7ff58ea71740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff5841a9180 con 0x5581635ba2e0 2024-09-19T08:57:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.436+0000 7ff58ea71740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff5841aba20 con 0x5581635bf370 2024-09-19T08:57:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.436+0000 7ff58ea71740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff5841a9810 con 0x5581635b99a0 2024-09-19T08:57:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.436+0000 7ff58919c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581635ba2e0 0x5581635cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.436+0000 7ff58919c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581635ba2e0 0x5581635cae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54178/0 (socket says 172.21.15.92:54178) 2024-09-19T08:57:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.436+0000 7ff58919c640 1 -- 172.21.15.92:0/1484587524 learned_addr learned my addr 172.21.15.92:0/1484587524 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.436+0000 7ff58999d640 1 --2- 172.21.15.92:0/1484587524 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581635b99a0 0x5581635c3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.436+0000 7ff58a19e640 1 --2- 172.21.15.92:0/1484587524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5581635bf370 0x5581635c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.436+0000 7ff58919c640 1 -- 172.21.15.92:0/1484587524 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581635b99a0 msgr2=0x5581635c3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.436+0000 7ff58919c640 1 --2- 172.21.15.92:0/1484587524 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581635b99a0 0x5581635c3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.436+0000 7ff58919c640 1 -- 172.21.15.92:0/1484587524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5581635bf370 msgr2=0x5581635c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.436+0000 7ff58919c640 1 --2- 172.21.15.92:0/1484587524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5581635bf370 0x5581635c3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.436+0000 7ff58919c640 1 -- 172.21.15.92:0/1484587524 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581635be6b0 con 0x5581635ba2e0 2024-09-19T08:57:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.436+0000 7ff58a19e640 1 --2- 172.21.15.92:0/1484587524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5581635bf370 0x5581635c3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:57:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.437+0000 7ff58919c640 1 --2- 172.21.15.92:0/1484587524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581635ba2e0 0x5581635cae90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff58000ce00 tx=0x7ff580011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a59f22464e96b34 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.437+0000 7ff56f7fe640 1 -- 172.21.15.92:0/1484587524 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58001e070 con 0x5581635ba2e0 2024-09-19T08:57:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.437+0000 7ff56f7fe640 1 -- 172.21.15.92:0/1484587524 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5800035f0 con 0x5581635ba2e0 2024-09-19T08:57:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.437+0000 7ff56f7fe640 1 -- 172.21.15.92:0/1484587524 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58001a6e0 con 0x5581635ba2e0 2024-09-19T08:57:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.437+0000 7ff58ea71740 1 -- 172.21.15.92:0/1484587524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581635ba2e0 msgr2=0x5581635cae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.437+0000 7ff58ea71740 1 --2- 172.21.15.92:0/1484587524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581635ba2e0 0x5581635cae90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff58000ce00 tx=0x7ff580011810 comp rx=0 tx=0).stop 2024-09-19T08:57:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.438+0000 7ff58ea71740 1 -- 172.21.15.92:0/1484587524 shutdown_connections 2024-09-19T08:57:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.438+0000 7ff58ea71740 1 --2- 172.21.15.92:0/1484587524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5581635bf370 0x5581635c3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.438+0000 7ff58ea71740 1 --2- 172.21.15.92:0/1484587524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581635ba2e0 0x5581635cae90 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.438+0000 7ff58ea71740 1 --2- 172.21.15.92:0/1484587524 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581635b99a0 0x5581635c3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.438+0000 7ff58ea71740 1 -- 172.21.15.92:0/1484587524 >> 172.21.15.92:0/1484587524 conn(0x5581635b5010 msgr2=0x5581635bb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:37.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.438+0000 7ff58ea71740 1 -- 172.21.15.92:0/1484587524 shutdown_connections 2024-09-19T08:57:37.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.438+0000 7ff58ea71740 1 -- 172.21.15.92:0/1484587524 wait complete. 2024-09-19T08:57:37.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.438+0000 7ff58ea71740 1 -- start start 2024-09-19T08:57:37.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.438+0000 7ff58ea71740 1 Processor -- start 2024-09-19T08:57:37.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.438+0000 7ff58ea71740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5581635b99a0 0x5581635c8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:37.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.438+0000 7ff58ea71740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581635ba2e0 0x5581635c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:37.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.438+0000 7ff58ea71740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581635bf370 0x5581635c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:37.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.438+0000 7ff58ea71740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff5841a9ee0 con 0x5581635ba2e0 2024-09-19T08:57:37.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.438+0000 7ff58ea71740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff5841ab350 con 0x5581635b99a0 2024-09-19T08:57:37.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.438+0000 7ff58ea71740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff5841aa5b0 con 0x5581635bf370 2024-09-19T08:57:37.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.438+0000 7ff58ea71740 10 client.0 _ll_register_callbacks cb 0x7ff58000c390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:37.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.439+0000 7ff58919c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581635ba2e0 0x5581635c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:37.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.439+0000 7ff58919c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581635ba2e0 0x5581635c8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54194/0 (socket says 172.21.15.92:54194) 2024-09-19T08:57:37.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.439+0000 7ff58919c640 1 -- 172.21.15.92:0/3909004599 learned_addr learned my addr 172.21.15.92:0/3909004599 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:37.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.439+0000 7ff58a19e640 1 --2- 172.21.15.92:0/3909004599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581635bf370 0x5581635c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:37.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.439+0000 7ff58999d640 1 --2- 172.21.15.92:0/3909004599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5581635b99a0 0x5581635c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:37.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.439+0000 7ff58919c640 1 -- 172.21.15.92:0/3909004599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581635bf370 msgr2=0x5581635c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:37.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.439+0000 7ff58919c640 1 --2- 172.21.15.92:0/3909004599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581635bf370 0x5581635c9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.439+0000 7ff58919c640 1 -- 172.21.15.92:0/3909004599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5581635b99a0 msgr2=0x5581635c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:37.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.439+0000 7ff58919c640 1 --2- 172.21.15.92:0/3909004599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5581635b99a0 0x5581635c8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.439+0000 7ff58919c640 1 -- 172.21.15.92:0/3909004599 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581635ca070 con 0x5581635ba2e0 2024-09-19T08:57:37.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.439+0000 7ff58999d640 1 --2- 172.21.15.92:0/3909004599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5581635b99a0 0x5581635c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:57:37.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.439+0000 7ff58919c640 1 --2- 172.21.15.92:0/3909004599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581635ba2e0 0x5581635c8a50 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ff5800058c0 tx=0x7ff5800039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8220e933f4db1468 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:37.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.439+0000 7ff56d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:57:37.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.439+0000 7ff56d7fa640 1 -- 172.21.15.92:0/3909004599 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58001e040 con 0x5581635ba2e0 2024-09-19T08:57:37.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.439+0000 7ff56d7fa640 1 -- 172.21.15.92:0/3909004599 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff58001a660 con 0x5581635ba2e0 2024-09-19T08:57:37.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.439+0000 7ff58ea71740 1 -- 172.21.15.92:0/3909004599 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5800035f0 con 0x5581635ba2e0 2024-09-19T08:57:37.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.439+0000 7ff56d7fa640 1 -- 172.21.15.92:0/3909004599 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff58000ca70 con 0x5581635ba2e0 2024-09-19T08:57:37.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.440+0000 7ff58ea71740 10 client.15531 fetch_fsmap learned FSMap version 19 2024-09-19T08:57:37.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.440+0000 7ff58ea71740 1 -- 172.21.15.92:0/3909004599 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55816363a060 con 0x5581635ba2e0 2024-09-19T08:57:37.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.440+0000 7ff56d7fa640 1 -- 172.21.15.92:0/3909004599 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5800035f0 con 0x5581635ba2e0 2024-09-19T08:57:37.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.440+0000 7ff56d7fa640 1 -- 172.21.15.92:0/3909004599 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff580021030 con 0x5581635ba2e0 2024-09-19T08:57:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.440+0000 7ff58ea71740 10 client.15531 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:57:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.440+0000 7ff58ea71740 10 client.15531 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T08:57:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.440+0000 7ff58ea71740 20 client.15531 populate_metadata read hostname 'smithi092' 2024-09-19T08:57:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.440+0000 7ff58ea71740 1 --2- 172.21.15.92:0/3909004599 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55816363a920 0x55816363cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.440+0000 7ff58ea71740 4 client.15531 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:57:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.440+0000 7ff58ea71740 1 -- 172.21.15.92:0/3909004599 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558163524d70 con 0x55816363a920 2024-09-19T08:57:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.440+0000 7ff58999d640 1 --2- 172.21.15.92:0/3909004599 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55816363a920 0x55816363cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.441+0000 7ff58999d640 1 --2- 172.21.15.92:0/3909004599 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55816363a920 0x55816363cd40 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5281eef2570a938 server_cookie=6c382718043e4c30 in_seq=0 out_seq=0 2024-09-19T08:57:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.441+0000 7ff56d7fa640 10 client.15531 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:37.463 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.461+0000 7ff56d7fa640 1 -- 172.21.15.92:0/3909004599 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558163524d70 con 0x55816363a920 2024-09-19T08:57:37.463 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.461+0000 7ff56d7fa640 10 client.15531 handle_command_reply: tid=0 2024-09-19T08:57:37.463 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.461+0000 7ff58ea71740 1 client.15531 shutdown 2024-09-19T08:57:37.463 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.462+0000 7ff58ea71740 1 -- 172.21.15.92:0/3909004599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581635ba2e0 msgr2=0x5581635c8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:37.463 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.462+0000 7ff58ea71740 1 --2- 172.21.15.92:0/3909004599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581635ba2e0 0x5581635c8a50 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ff5800058c0 tx=0x7ff5800039d0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.463 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.462+0000 7ff58ea71740 1 -- 172.21.15.92:0/3909004599 shutdown_connections 2024-09-19T08:57:37.463 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.462+0000 7ff58ea71740 1 --2- 172.21.15.92:0/3909004599 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55816363a920 0x55816363cd40 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.463 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.462+0000 7ff58ea71740 1 --2- 172.21.15.92:0/3909004599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581635bf370 0x5581635c9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.462+0000 7ff58ea71740 1 --2- 172.21.15.92:0/3909004599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581635ba2e0 0x5581635c8a50 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.462+0000 7ff56d7fa640 0 client.15531 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:37.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.462+0000 7ff58ea71740 1 --2- 172.21.15.92:0/3909004599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5581635b99a0 0x5581635c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.462+0000 7ff58ea71740 1 -- 172.21.15.92:0/3909004599 >> 172.21.15.92:0/3909004599 conn(0x5581635b5010 msgr2=0x5581635b39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:37.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.462+0000 7ff58ea71740 1 -- 172.21.15.92:0/3909004599 shutdown_connections 2024-09-19T08:57:37.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.462+0000 7ff58ea71740 1 -- 172.21.15.92:0/3909004599 wait complete. 2024-09-19T08:57:37.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.462+0000 7ff58ea71740 20 client.15531 trim_cache size 0 max 16384 2024-09-19T08:57:37.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T08:57:37.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T08:57:37.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T08:57:37.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T08:57:37.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.462+0000 7ff58bc01640 1 -- 172.21.15.92:0/2764416339 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff5700a32f0 msgr2=0x7ff5700a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:37.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.462+0000 7ff58bc01640 1 --2- 172.21.15.92:0/2764416339 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff5700a32f0 0x7ff5700a57b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff57c044000 tx=0x7ff57c02ff70 comp rx=0 tx=0).stop 2024-09-19T08:57:37.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.462+0000 7ff58bc01640 1 -- 172.21.15.92:0/2764416339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff584101b60 msgr2=0x7ff584075fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:37.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.462+0000 7ff58bc01640 1 --2- 172.21.15.92:0/2764416339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff584101b60 0x7ff584075fa0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff57800d950 tx=0x7ff57800de10 comp rx=0 tx=0).stop 2024-09-19T08:57:37.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.463+0000 7ff58bc01640 1 -- 172.21.15.92:0/2764416339 shutdown_connections 2024-09-19T08:57:37.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.463+0000 7ff58bc01640 1 --2- 172.21.15.92:0/2764416339 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff584103710 0x7ff584074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.463+0000 7ff58bc01640 1 --2- 172.21.15.92:0/2764416339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff584102d50 0x7ff5840745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.463+0000 7ff58bc01640 1 --2- 172.21.15.92:0/2764416339 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff5700a32f0 0x7ff5700a57b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.463+0000 7ff58bc01640 1 --2- 172.21.15.92:0/2764416339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff584101b60 0x7ff584075fa0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.463+0000 7ff58bc01640 1 -- 172.21.15.92:0/2764416339 >> 172.21.15.92:0/2764416339 conn(0x7ff5840fd2e0 msgr2=0x7ff584106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:37.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.463+0000 7ff58bc01640 1 -- 172.21.15.92:0/2764416339 shutdown_connections 2024-09-19T08:57:37.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:37.463+0000 7ff58bc01640 1 -- 172.21.15.92:0/2764416339 wait complete. 2024-09-19T08:57:37.680 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:57:37.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:37 smithi092 ceph-mon[31407]: pgmap v364: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.6 MiB/s wr, 527 op/s 2024-09-19T08:57:37.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:37 smithi167 ceph-mon[35359]: pgmap v364: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.6 MiB/s wr, 527 op/s 2024-09-19T08:57:37.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:37 smithi190 ceph-mon[35358]: pgmap v364: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.6 MiB/s wr, 527 op/s 2024-09-19T08:57:38.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.144+0000 7fb8c0ba4640 1 -- 172.21.15.92:0/3004610715 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8bc102570 msgr2=0x7fb8bc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:38.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.144+0000 7fb8c0ba4640 1 --2- 172.21.15.92:0/3004610715 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8bc102570 0x7fb8bc1029b0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0009900 tx=0x7fb8b002a480 comp rx=0 tx=0).stop 2024-09-19T08:57:38.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.144+0000 7fb8c0ba4640 1 -- 172.21.15.92:0/3004610715 shutdown_connections 2024-09-19T08:57:38.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.144+0000 7fb8c0ba4640 1 --2- 172.21.15.92:0/3004610715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8bc102ef0 0x7fb8bc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:38.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.144+0000 7fb8c0ba4640 1 --2- 172.21.15.92:0/3004610715 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8bc102570 0x7fb8bc1029b0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:38.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.144+0000 7fb8c0ba4640 1 --2- 172.21.15.92:0/3004610715 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8bc100e20 0x7fb8bc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:38.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.144+0000 7fb8c0ba4640 1 -- 172.21.15.92:0/3004610715 >> 172.21.15.92:0/3004610715 conn(0x7fb8bc0fc7d0 msgr2=0x7fb8bc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:38.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.144+0000 7fb8c0ba4640 1 -- 172.21.15.92:0/3004610715 shutdown_connections 2024-09-19T08:57:38.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.144+0000 7fb8c0ba4640 1 -- 172.21.15.92:0/3004610715 wait complete. 2024-09-19T08:57:38.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.144+0000 7fb8c0ba4640 1 Processor -- start 2024-09-19T08:57:38.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.144+0000 7fb8c0ba4640 1 -- start start 2024-09-19T08:57:38.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.145+0000 7fb8c0ba4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8bc100e20 0x7fb8bc199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:38.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.145+0000 7fb8c0ba4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8bc102570 0x7fb8bc199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:38.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.145+0000 7fb8c0ba4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8bc102ef0 0x7fb8bc1a4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:38.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.145+0000 7fb8c0ba4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb8bc110f80 con 0x7fb8bc100e20 2024-09-19T08:57:38.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.145+0000 7fb8c0ba4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb8bc110e00 con 0x7fb8bc102570 2024-09-19T08:57:38.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.145+0000 7fb8c0ba4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb8bc111100 con 0x7fb8bc102ef0 2024-09-19T08:57:38.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.145+0000 7fb8ba59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8bc100e20 0x7fb8bc199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:38.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.145+0000 7fb8ba59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8bc100e20 0x7fb8bc199210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54216/0 (socket says 172.21.15.92:54216) 2024-09-19T08:57:38.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.145+0000 7fb8ba59c640 1 -- 172.21.15.92:0/2815265787 learned_addr learned my addr 172.21.15.92:0/2815265787 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:38.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.145+0000 7fb8bad9d640 1 --2- 172.21.15.92:0/2815265787 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8bc102ef0 0x7fb8bc1a4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:38.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.145+0000 7fb8b9d9b640 1 --2- 172.21.15.92:0/2815265787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8bc102570 0x7fb8bc199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:38.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.145+0000 7fb8ba59c640 1 -- 172.21.15.92:0/2815265787 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8bc102ef0 msgr2=0x7fb8bc1a4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:38.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.145+0000 7fb8ba59c640 1 --2- 172.21.15.92:0/2815265787 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8bc102ef0 0x7fb8bc1a4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:38.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.145+0000 7fb8ba59c640 1 -- 172.21.15.92:0/2815265787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8bc102570 msgr2=0x7fb8bc199750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:38.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.145+0000 7fb8ba59c640 1 --2- 172.21.15.92:0/2815265787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8bc102570 0x7fb8bc199750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:38.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.145+0000 7fb8ba59c640 1 -- 172.21.15.92:0/2815265787 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8bc1a47d0 con 0x7fb8bc100e20 2024-09-19T08:57:38.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.145+0000 7fb8ba59c640 1 --2- 172.21.15.92:0/2815265787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8bc100e20 0x7fb8bc199210 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac00c920 tx=0x7fb8ac00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:38.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.145+0000 7fb8ab7fe640 1 -- 172.21.15.92:0/2815265787 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac007c70 con 0x7fb8bc100e20 2024-09-19T08:57:38.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.145+0000 7fb8c0ba4640 1 -- 172.21.15.92:0/2815265787 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8bc1a49a0 con 0x7fb8bc100e20 2024-09-19T08:57:38.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.145+0000 7fb8ab7fe640 1 -- 172.21.15.92:0/2815265787 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8ac007e10 con 0x7fb8bc100e20 2024-09-19T08:57:38.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.145+0000 7fb8ab7fe640 1 -- 172.21.15.92:0/2815265787 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac018890 con 0x7fb8bc100e20 2024-09-19T08:57:38.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.146+0000 7fb8c0ba4640 1 -- 172.21.15.92:0/2815265787 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8bc1a4ee0 con 0x7fb8bc100e20 2024-09-19T08:57:38.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.148+0000 7fb8ab7fe640 1 -- 172.21.15.92:0/2815265787 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb8ac018a70 con 0x7fb8bc100e20 2024-09-19T08:57:38.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.148+0000 7fb8c2f7d740 1 Processor -- start 2024-09-19T08:57:38.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.148+0000 7fb8c2f7d740 1 -- start start 2024-09-19T08:57:38.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.148+0000 7fb8c2f7d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff89d92f70 0x55ff89d93350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:38.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.148+0000 7fb8c2f7d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ff89d93890 0x55ff89d9dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:38.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.148+0000 7fb8c2f7d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff89d9e150 0x55ff89da0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:38.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.148+0000 7fb8c2f7d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ff89cf4280 con 0x55ff89d92f70 2024-09-19T08:57:38.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.148+0000 7fb8c2f7d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ff89c9bb10 con 0x55ff89d9e150 2024-09-19T08:57:38.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.148+0000 7fb8c2f7d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ff89cf0240 con 0x55ff89d93890 2024-09-19T08:57:38.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.149+0000 7fb8bad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff89d92f70 0x55ff89d93350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:38.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.149+0000 7fb8ab7fe640 1 --2- 172.21.15.92:0/2815265787 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb8a40a3240 0x7fb8a40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:38.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.149+0000 7fb8bad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff89d92f70 0x55ff89d93350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54228/0 (socket says 172.21.15.92:54228) 2024-09-19T08:57:38.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.149+0000 7fb8bad9d640 1 -- 172.21.15.92:0/1131772024 learned_addr learned my addr 172.21.15.92:0/1131772024 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:38.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.149+0000 7fb8ba59c640 1 --2- 172.21.15.92:0/1131772024 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ff89d93890 0x55ff89d9dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:38.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.149+0000 7fb8bad9d640 1 --2- 172.21.15.92:0/2815265787 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb8a40a3240 0x7fb8a40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:38.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.149+0000 7fb8b9d9b640 1 --2- 172.21.15.92:0/1131772024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff89d9e150 0x55ff89da0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:38.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.149+0000 7fb8ab7fe640 1 -- 172.21.15.92:0/2815265787 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb8ac0cfa60 con 0x7fb8bc100e20 2024-09-19T08:57:38.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.149+0000 7fb8bad9d640 1 -- 172.21.15.92:0/1131772024 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ff89d93890 msgr2=0x55ff89d9dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:38.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.149+0000 7fb8bad9d640 1 --2- 172.21.15.92:0/1131772024 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ff89d93890 0x55ff89d9dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:38.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.149+0000 7fb8bad9d640 1 -- 172.21.15.92:0/1131772024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff89d9e150 msgr2=0x55ff89da0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:38.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.149+0000 7fb8bad9d640 1 --2- 172.21.15.92:0/1131772024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff89d9e150 0x55ff89da0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:38.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.149+0000 7fb8bad9d640 1 -- 172.21.15.92:0/1131772024 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff89ca81f0 con 0x55ff89d92f70 2024-09-19T08:57:38.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.149+0000 7fb8ba59c640 1 --2- 172.21.15.92:0/1131772024 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ff89d93890 0x55ff89d9dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:57:38.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.149+0000 7fb8b9d9b640 1 --2- 172.21.15.92:0/1131772024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff89d9e150 0x55ff89da0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:57:38.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.149+0000 7fb8bad9d640 1 --2- 172.21.15.92:0/1131772024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff89d92f70 0x55ff89d93350 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb8b40139d0 tx=0x7fb8b4013e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fbc94bdcca1f3c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:38.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.149+0000 7fb8bad9d640 1 --2- 172.21.15.92:0/2815265787 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb8a40a3240 0x7fb8a40a5700 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb8b400a000 tx=0x7fb8b401d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:38.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.149+0000 7fb8a8ff9640 1 -- 172.21.15.92:0/1131772024 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b401c770 con 0x55ff89d92f70 2024-09-19T08:57:38.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.150+0000 7fb8a8ff9640 1 -- 172.21.15.92:0/1131772024 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8b401cdf0 con 0x55ff89d92f70 2024-09-19T08:57:38.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.150+0000 7fb8a8ff9640 1 -- 172.21.15.92:0/1131772024 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b401dd10 con 0x55ff89d92f70 2024-09-19T08:57:38.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.150+0000 7fb8c2f7d740 1 -- 172.21.15.92:0/1131772024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff89d92f70 msgr2=0x55ff89d93350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:38.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.150+0000 7fb8c2f7d740 1 --2- 172.21.15.92:0/1131772024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff89d92f70 0x55ff89d93350 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb8b40139d0 tx=0x7fb8b4013e90 comp rx=0 tx=0).stop 2024-09-19T08:57:38.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.150+0000 7fb8c2f7d740 1 -- 172.21.15.92:0/1131772024 shutdown_connections 2024-09-19T08:57:38.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.150+0000 7fb8c2f7d740 1 --2- 172.21.15.92:0/1131772024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff89d9e150 0x55ff89da0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:38.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.150+0000 7fb8c2f7d740 1 --2- 172.21.15.92:0/1131772024 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ff89d93890 0x55ff89d9dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:38.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.150+0000 7fb8c2f7d740 1 --2- 172.21.15.92:0/1131772024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff89d92f70 0x55ff89d93350 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:38.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.150+0000 7fb8c2f7d740 1 -- 172.21.15.92:0/1131772024 >> 172.21.15.92:0/1131772024 conn(0x55ff89d8f500 msgr2=0x55ff89d8f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:38.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.150+0000 7fb8c2f7d740 1 -- 172.21.15.92:0/1131772024 shutdown_connections 2024-09-19T08:57:38.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.150+0000 7fb8c2f7d740 1 -- 172.21.15.92:0/1131772024 wait complete. 2024-09-19T08:57:38.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.151+0000 7fb8c2f7d740 1 -- start start 2024-09-19T08:57:38.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.151+0000 7fb8c2f7d740 1 Processor -- start 2024-09-19T08:57:38.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.151+0000 7fb8c2f7d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ff89d92f70 0x55ff89d9afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:38.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.151+0000 7fb8c2f7d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff89d93890 0x55ff89d9b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:38.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.151+0000 7fb8c2f7d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff89d9e150 0x55ff89d9ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:38.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.151+0000 7fb8c2f7d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ff89da0cc0 con 0x55ff89d9e150 2024-09-19T08:57:38.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.151+0000 7fb8c2f7d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ff89caef10 con 0x55ff89d93890 2024-09-19T08:57:38.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.151+0000 7fb8c2f7d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ff89da0e40 con 0x55ff89d92f70 2024-09-19T08:57:38.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.151+0000 7fb8c2f7d740 10 client.0 _ll_register_callbacks cb 0x55ff89c77a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:38.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.151+0000 7fb8bad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff89d9e150 0x55ff89d9ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:38.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.151+0000 7fb8bad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff89d9e150 0x55ff89d9ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54244/0 (socket says 172.21.15.92:54244) 2024-09-19T08:57:38.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.151+0000 7fb8bad9d640 1 -- 172.21.15.92:0/1462189830 learned_addr learned my addr 172.21.15.92:0/1462189830 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:38.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.151+0000 7fb8ba59c640 1 --2- 172.21.15.92:0/1462189830 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ff89d92f70 0x55ff89d9afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:38.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.151+0000 7fb8b9d9b640 1 --2- 172.21.15.92:0/1462189830 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff89d93890 0x55ff89d9b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:38.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.152+0000 7fb8bad9d640 1 -- 172.21.15.92:0/1462189830 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ff89d92f70 msgr2=0x55ff89d9afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:38.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.152+0000 7fb8bad9d640 1 --2- 172.21.15.92:0/1462189830 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ff89d92f70 0x55ff89d9afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:38.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.152+0000 7fb8bad9d640 1 -- 172.21.15.92:0/1462189830 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff89d93890 msgr2=0x55ff89d9b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:38.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.152+0000 7fb8bad9d640 1 --2- 172.21.15.92:0/1462189830 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff89d93890 0x55ff89d9b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:38.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.152+0000 7fb8bad9d640 1 -- 172.21.15.92:0/1462189830 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff89a656a0 con 0x55ff89d9e150 2024-09-19T08:57:38.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.152+0000 7fb8ba59c640 1 --2- 172.21.15.92:0/1462189830 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ff89d92f70 0x55ff89d9afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:57:38.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.152+0000 7fb8bad9d640 1 --2- 172.21.15.92:0/1462189830 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff89d9e150 0x55ff89d9ba40 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb8b40117b0 tx=0x7fb8b4007350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84fa5fbc8f5f75ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:38.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.152+0000 7fb8a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:57:38.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.152+0000 7fb8a1ffb640 1 -- 172.21.15.92:0/1462189830 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b4007520 con 0x55ff89d9e150 2024-09-19T08:57:38.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.152+0000 7fb8c2f7d740 1 -- 172.21.15.92:0/1462189830 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8b401cdf0 con 0x55ff89d9e150 2024-09-19T08:57:38.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.152+0000 7fb8a1ffb640 1 -- 172.21.15.92:0/1462189830 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb8b4004a00 con 0x55ff89d9e150 2024-09-19T08:57:38.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.152+0000 7fb8a1ffb640 1 -- 172.21.15.92:0/1462189830 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb8b4004c00 con 0x55ff89d9e150 2024-09-19T08:57:38.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.152+0000 7fb8c2f7d740 10 client.15543 fetch_fsmap learned FSMap version 19 2024-09-19T08:57:38.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.152+0000 7fb8c2f7d740 1 -- 172.21.15.92:0/1462189830 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ff89dac7c0 con 0x55ff89d9e150 2024-09-19T08:57:38.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.152+0000 7fb8a1ffb640 1 -- 172.21.15.92:0/1462189830 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8b401cdf0 con 0x55ff89d9e150 2024-09-19T08:57:38.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.152+0000 7fb8a1ffb640 1 -- 172.21.15.92:0/1462189830 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fb8b402e070 con 0x55ff89d9e150 2024-09-19T08:57:38.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.152+0000 7fb8c2f7d740 10 client.15543 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:57:38.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.152+0000 7fb8c2f7d740 10 client.15543 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:57:38.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.152+0000 7fb8c2f7d740 20 client.15543 populate_metadata read hostname 'smithi092' 2024-09-19T08:57:38.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.153+0000 7fb8c2f7d740 1 --2- 172.21.15.92:0/1462189830 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ff89dadbd0 0x55ff89daffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:38.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.153+0000 7fb8c2f7d740 4 client.15543 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:57:38.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.153+0000 7fb8c2f7d740 1 -- 172.21.15.92:0/1462189830 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff89d017f0 con 0x55ff89dadbd0 2024-09-19T08:57:38.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.153+0000 7fb8ba59c640 1 --2- 172.21.15.92:0/1462189830 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ff89dadbd0 0x55ff89daffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:38.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.153+0000 7fb8a1ffb640 10 client.15543 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:38.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.153+0000 7fb8ba59c640 1 --2- 172.21.15.92:0/1462189830 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ff89dadbd0 0x55ff89daffc0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ba36a107c85750c server_cookie=2b95db34c87deaae in_seq=0 out_seq=0 2024-09-19T08:57:38.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.154+0000 7fb8a1ffb640 1 -- 172.21.15.92:0/1462189830 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ff89d017f0 con 0x55ff89dadbd0 2024-09-19T08:57:38.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.154+0000 7fb8a1ffb640 10 client.15543 handle_command_reply: tid=0 2024-09-19T08:57:38.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.154+0000 7fb8c2f7d740 1 client.15543 shutdown 2024-09-19T08:57:38.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.154+0000 7fb8c2f7d740 1 -- 172.21.15.92:0/1462189830 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff89d9e150 msgr2=0x55ff89d9ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:38.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.154+0000 7fb8c2f7d740 1 --2- 172.21.15.92:0/1462189830 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff89d9e150 0x55ff89d9ba40 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb8b40117b0 tx=0x7fb8b4007350 comp rx=0 tx=0).stop 2024-09-19T08:57:38.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.154+0000 7fb8c2f7d740 1 -- 172.21.15.92:0/1462189830 shutdown_connections 2024-09-19T08:57:38.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.154+0000 7fb8c2f7d740 1 --2- 172.21.15.92:0/1462189830 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ff89dadbd0 0x55ff89daffc0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:38.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.154+0000 7fb8c2f7d740 1 --2- 172.21.15.92:0/1462189830 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff89d9e150 0x55ff89d9ba40 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:38.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.154+0000 7fb8a1ffb640 0 client.15543 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:38.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.154+0000 7fb8c2f7d740 1 --2- 172.21.15.92:0/1462189830 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff89d93890 0x55ff89d9b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:38.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.154+0000 7fb8c2f7d740 1 --2- 172.21.15.92:0/1462189830 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ff89d92f70 0x55ff89d9afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:38.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.154+0000 7fb8c2f7d740 1 -- 172.21.15.92:0/1462189830 >> 172.21.15.92:0/1462189830 conn(0x55ff89d8f500 msgr2=0x55ff89d8a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:38.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.154+0000 7fb8c2f7d740 1 -- 172.21.15.92:0/1462189830 shutdown_connections 2024-09-19T08:57:38.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.154+0000 7fb8c2f7d740 1 -- 172.21.15.92:0/1462189830 wait complete. 2024-09-19T08:57:38.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.154+0000 7fb8c2f7d740 20 client.15543 trim_cache size 0 max 16384 2024-09-19T08:57:38.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.171+0000 7fb8c2f7d740 1 Processor -- start 2024-09-19T08:57:38.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.171+0000 7fb8c2f7d740 1 -- start start 2024-09-19T08:57:38.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.171+0000 7fb8c2f7d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ff89d92f70 0x55ff89d959d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:38.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.171+0000 7fb8c2f7d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff89d93890 0x55ff89d99e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:38.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.171+0000 7fb8c2f7d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff89d9e150 0x55ff89db5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:38.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.171+0000 7fb8c2f7d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb8bc1a9330 con 0x55ff89d93890 2024-09-19T08:57:38.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.171+0000 7fb8c2f7d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb8bc1abbb0 con 0x55ff89d9e150 2024-09-19T08:57:38.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.171+0000 7fb8c2f7d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb8bc1a99a0 con 0x55ff89d92f70 2024-09-19T08:57:38.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.172+0000 7fb8b9d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff89d93890 0x55ff89d99e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:38.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.172+0000 7fb8b9d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff89d93890 0x55ff89d99e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54260/0 (socket says 172.21.15.92:54260) 2024-09-19T08:57:38.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.172+0000 7fb8b9d9b640 1 -- 172.21.15.92:0/1733025666 learned_addr learned my addr 172.21.15.92:0/1733025666 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:38.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.172+0000 7fb8bad9d640 1 --2- 172.21.15.92:0/1733025666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff89d9e150 0x55ff89db5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:38.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.172+0000 7fb8ba59c640 1 --2- 172.21.15.92:0/1733025666 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ff89d92f70 0x55ff89d959d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:38.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.172+0000 7fb8b9d9b640 1 -- 172.21.15.92:0/1733025666 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ff89d92f70 msgr2=0x55ff89d959d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:38.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.172+0000 7fb8b9d9b640 1 --2- 172.21.15.92:0/1733025666 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ff89d92f70 0x55ff89d959d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:38.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.172+0000 7fb8b9d9b640 1 -- 172.21.15.92:0/1733025666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff89d9e150 msgr2=0x55ff89db5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:38.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.172+0000 7fb8b9d9b640 1 --2- 172.21.15.92:0/1733025666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff89d9e150 0x55ff89db5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:38.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.172+0000 7fb8b9d9b640 1 -- 172.21.15.92:0/1733025666 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff89d936c0 con 0x55ff89d93890 2024-09-19T08:57:38.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.172+0000 7fb8b9d9b640 1 --2- 172.21.15.92:0/1733025666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff89d93890 0x55ff89d99e70 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0005ab0 tx=0x7fb8b0004310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b11cc8486cd1c152 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:38.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.172+0000 7fb8a3fff640 1 -- 172.21.15.92:0/1733025666 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b0035040 con 0x55ff89d93890 2024-09-19T08:57:38.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.172+0000 7fb8a3fff640 1 -- 172.21.15.92:0/1733025666 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8b00046c0 con 0x55ff89d93890 2024-09-19T08:57:38.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.172+0000 7fb8a3fff640 1 -- 172.21.15.92:0/1733025666 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b0003850 con 0x55ff89d93890 2024-09-19T08:57:38.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.173+0000 7fb8c2f7d740 1 -- 172.21.15.92:0/1733025666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff89d93890 msgr2=0x55ff89d99e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:38.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.173+0000 7fb8c2f7d740 1 --2- 172.21.15.92:0/1733025666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff89d93890 0x55ff89d99e70 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0005ab0 tx=0x7fb8b0004310 comp rx=0 tx=0).stop 2024-09-19T08:57:38.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.173+0000 7fb8c2f7d740 1 -- 172.21.15.92:0/1733025666 shutdown_connections 2024-09-19T08:57:38.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.173+0000 7fb8c2f7d740 1 --2- 172.21.15.92:0/1733025666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff89d9e150 0x55ff89db5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:38.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.173+0000 7fb8c2f7d740 1 --2- 172.21.15.92:0/1733025666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff89d93890 0x55ff89d99e70 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:38.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.173+0000 7fb8c2f7d740 1 --2- 172.21.15.92:0/1733025666 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ff89d92f70 0x55ff89d959d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:38.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.173+0000 7fb8c2f7d740 1 -- 172.21.15.92:0/1733025666 >> 172.21.15.92:0/1733025666 conn(0x55ff89d8f500 msgr2=0x55ff89d99760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:38.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.173+0000 7fb8c2f7d740 1 -- 172.21.15.92:0/1733025666 shutdown_connections 2024-09-19T08:57:38.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.173+0000 7fb8c2f7d740 1 -- 172.21.15.92:0/1733025666 wait complete. 2024-09-19T08:57:38.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.173+0000 7fb8c2f7d740 1 -- start start 2024-09-19T08:57:38.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.173+0000 7fb8c2f7d740 1 Processor -- start 2024-09-19T08:57:38.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.174+0000 7fb8c2f7d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ff89d92f70 0x55ff89da6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:38.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.174+0000 7fb8c2f7d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff89d93890 0x55ff89da1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:38.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.174+0000 7fb8c2f7d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff89d9e150 0x55ff89da1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:38.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.174+0000 7fb8c2f7d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb8bc1aa070 con 0x55ff89d93890 2024-09-19T08:57:38.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.174+0000 7fb8c2f7d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb8bc1ab4e0 con 0x55ff89d9e150 2024-09-19T08:57:38.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.174+0000 7fb8c2f7d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb8bc1aa740 con 0x55ff89d92f70 2024-09-19T08:57:38.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.174+0000 7fb8c2f7d740 10 client.0 _ll_register_callbacks cb 0x7fb8b40137d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:38.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.174+0000 7fb8b9d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff89d93890 0x55ff89da1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:38.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.174+0000 7fb8b9d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff89d93890 0x55ff89da1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54262/0 (socket says 172.21.15.92:54262) 2024-09-19T08:57:38.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.174+0000 7fb8b9d9b640 1 -- 172.21.15.92:0/3142576204 learned_addr learned my addr 172.21.15.92:0/3142576204 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:38.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.174+0000 7fb8ba59c640 1 --2- 172.21.15.92:0/3142576204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ff89d92f70 0x55ff89da6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:38.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.174+0000 7fb8bad9d640 1 --2- 172.21.15.92:0/3142576204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff89d9e150 0x55ff89da1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:38.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.174+0000 7fb8b9d9b640 1 -- 172.21.15.92:0/3142576204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ff89d92f70 msgr2=0x55ff89da6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:38.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.174+0000 7fb8b9d9b640 1 --2- 172.21.15.92:0/3142576204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ff89d92f70 0x55ff89da6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:38.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.174+0000 7fb8b9d9b640 1 -- 172.21.15.92:0/3142576204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff89d9e150 msgr2=0x55ff89da1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:38.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.174+0000 7fb8b9d9b640 1 --2- 172.21.15.92:0/3142576204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff89d9e150 0x55ff89da1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:38.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.174+0000 7fb8b9d9b640 1 -- 172.21.15.92:0/3142576204 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff89da24d0 con 0x55ff89d93890 2024-09-19T08:57:38.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.174+0000 7fb8b9d9b640 1 --2- 172.21.15.92:0/3142576204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff89d93890 0x55ff89da1950 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb8b002a4c0 tx=0x7fb8b0004be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a068a769ec50ce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:38.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.174+0000 7fb8a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:57:38.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.174+0000 7fb8a1ffb640 1 -- 172.21.15.92:0/3142576204 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b0035030 con 0x55ff89d93890 2024-09-19T08:57:38.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.174+0000 7fb8a1ffb640 1 -- 172.21.15.92:0/3142576204 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb8b0005200 con 0x55ff89d93890 2024-09-19T08:57:38.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.174+0000 7fb8c2f7d740 1 -- 172.21.15.92:0/3142576204 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8b00046c0 con 0x55ff89d93890 2024-09-19T08:57:38.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.175+0000 7fb8a1ffb640 1 -- 172.21.15.92:0/3142576204 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb8b0005400 con 0x55ff89d93890 2024-09-19T08:57:38.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.175+0000 7fb8c2f7d740 10 client.15549 fetch_fsmap learned FSMap version 19 2024-09-19T08:57:38.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.175+0000 7fb8c2f7d740 1 -- 172.21.15.92:0/3142576204 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ff89e185e0 con 0x55ff89d93890 2024-09-19T08:57:38.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.175+0000 7fb8a1ffb640 1 -- 172.21.15.92:0/3142576204 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8b00046c0 con 0x55ff89d93890 2024-09-19T08:57:38.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.175+0000 7fb8a1ffb640 1 -- 172.21.15.92:0/3142576204 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fb8b003c5b0 con 0x55ff89d93890 2024-09-19T08:57:38.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.175+0000 7fb8c2f7d740 10 client.15549 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:57:38.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.175+0000 7fb8c2f7d740 10 client.15549 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:57:38.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.175+0000 7fb8c2f7d740 20 client.15549 populate_metadata read hostname 'smithi092' 2024-09-19T08:57:38.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.175+0000 7fb8c2f7d740 1 --2- 172.21.15.92:0/3142576204 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ff89dadbd0 0x55ff89e1acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:38.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.175+0000 7fb8c2f7d740 4 client.15549 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:57:38.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.175+0000 7fb8c2f7d740 1 -- 172.21.15.92:0/3142576204 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ff89cfbd00 con 0x55ff89dadbd0 2024-09-19T08:57:38.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.175+0000 7fb8ba59c640 1 --2- 172.21.15.92:0/3142576204 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ff89dadbd0 0x55ff89e1acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:38.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.176+0000 7fb8ba59c640 1 --2- 172.21.15.92:0/3142576204 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ff89dadbd0 0x55ff89e1acd0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58d9c6011f49b19 server_cookie=457c31da236a44e3 in_seq=0 out_seq=0 2024-09-19T08:57:38.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.176+0000 7fb8a1ffb640 10 client.15549 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:38.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.177+0000 7fb8a1ffb640 1 -- 172.21.15.92:0/3142576204 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ff89cfbd00 con 0x55ff89dadbd0 2024-09-19T08:57:38.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.177+0000 7fb8a1ffb640 10 client.15549 handle_command_reply: tid=0 2024-09-19T08:57:38.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.177+0000 7fb8c2f7d740 1 client.15549 shutdown 2024-09-19T08:57:38.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.177+0000 7fb8c2f7d740 1 -- 172.21.15.92:0/3142576204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff89d93890 msgr2=0x55ff89da1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:38.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.177+0000 7fb8c2f7d740 1 --2- 172.21.15.92:0/3142576204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff89d93890 0x55ff89da1950 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb8b002a4c0 tx=0x7fb8b0004be0 comp rx=0 tx=0).stop 2024-09-19T08:57:38.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.177+0000 7fb8c2f7d740 1 -- 172.21.15.92:0/3142576204 shutdown_connections 2024-09-19T08:57:38.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.177+0000 7fb8c2f7d740 1 --2- 172.21.15.92:0/3142576204 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ff89dadbd0 0x55ff89e1acd0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:38.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.177+0000 7fb8c2f7d740 1 --2- 172.21.15.92:0/3142576204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff89d9e150 0x55ff89da1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:38.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.177+0000 7fb8c2f7d740 1 --2- 172.21.15.92:0/3142576204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff89d93890 0x55ff89da1950 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:38.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.177+0000 7fb8c2f7d740 1 --2- 172.21.15.92:0/3142576204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ff89d92f70 0x55ff89da6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:38.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.177+0000 7fb8c2f7d740 1 -- 172.21.15.92:0/3142576204 >> 172.21.15.92:0/3142576204 conn(0x55ff89d8f500 msgr2=0x55ff89d99f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:38.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.177+0000 7fb8a1ffb640 0 client.15549 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:38.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.177+0000 7fb8c2f7d740 1 -- 172.21.15.92:0/3142576204 shutdown_connections 2024-09-19T08:57:38.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.177+0000 7fb8c2f7d740 1 -- 172.21.15.92:0/3142576204 wait complete. 2024-09-19T08:57:38.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.177+0000 7fb8c2f7d740 20 client.15549 trim_cache size 0 max 16384 2024-09-19T08:57:38.183 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T08:57:38.183 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-19T08:57:38.183 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "0b2af31b-1041-4d60-a11d-53395278a698", 2024-09-19T08:57:38.183 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-19T08:57:38.183 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T08:57:38.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.178+0000 7fb8c0ba4640 1 -- 172.21.15.92:0/2815265787 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb8a40a3240 msgr2=0x7fb8a40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:38.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.178+0000 7fb8c0ba4640 1 --2- 172.21.15.92:0/2815265787 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb8a40a3240 0x7fb8a40a5700 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb8b400a000 tx=0x7fb8b401d000 comp rx=0 tx=0).stop 2024-09-19T08:57:38.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.178+0000 7fb8c0ba4640 1 -- 172.21.15.92:0/2815265787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8bc100e20 msgr2=0x7fb8bc199210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:38.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.178+0000 7fb8c0ba4640 1 --2- 172.21.15.92:0/2815265787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8bc100e20 0x7fb8bc199210 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac00c920 tx=0x7fb8ac00cde0 comp rx=0 tx=0).stop 2024-09-19T08:57:38.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.178+0000 7fb8c0ba4640 1 -- 172.21.15.92:0/2815265787 shutdown_connections 2024-09-19T08:57:38.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.178+0000 7fb8c0ba4640 1 --2- 172.21.15.92:0/2815265787 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8bc102ef0 0x7fb8bc1a4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:38.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.178+0000 7fb8c0ba4640 1 --2- 172.21.15.92:0/2815265787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8bc102570 0x7fb8bc199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:38.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.178+0000 7fb8c0ba4640 1 --2- 172.21.15.92:0/2815265787 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb8a40a3240 0x7fb8a40a5700 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:38.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.178+0000 7fb8c0ba4640 1 --2- 172.21.15.92:0/2815265787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8bc100e20 0x7fb8bc199210 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:38.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.178+0000 7fb8c0ba4640 1 -- 172.21.15.92:0/2815265787 >> 172.21.15.92:0/2815265787 conn(0x7fb8bc0fc7d0 msgr2=0x7fb8bc1067d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:38.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.178+0000 7fb8c0ba4640 1 -- 172.21.15.92:0/2815265787 shutdown_connections 2024-09-19T08:57:38.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:38.178+0000 7fb8c0ba4640 1 -- 172.21.15.92:0/2815265787 wait complete. 2024-09-19T08:57:38.938 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:57:39.221 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:57:39.605 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:39 smithi092 ceph-mon[31407]: scrub queued for path: / 2024-09-19T08:57:39.606 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:39 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T08:57:39.606 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:39 smithi092 ceph-mon[31407]: scrub summary: active paths [/] 2024-09-19T08:57:39.606 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:39 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T08:57:39.606 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:39 smithi092 ceph-mon[31407]: pgmap v365: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.9 MiB/s wr, 451 op/s 2024-09-19T08:57:39.606 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:39 smithi092 ceph-mon[31407]: scrub summary: idle 2024-09-19T08:57:39.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.688+0000 7f65fd5ce640 1 -- 172.21.15.92:0/3417930536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65f8100e20 msgr2=0x7f65f8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:39.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.688+0000 7f65fd5ce640 1 --2- 172.21.15.92:0/3417930536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65f8100e20 0x7f65f8101200 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f65e8009900 tx=0x7f65e802a480 comp rx=0 tx=0).stop 2024-09-19T08:57:39.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.688+0000 7f65fd5ce640 1 -- 172.21.15.92:0/3417930536 shutdown_connections 2024-09-19T08:57:39.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.688+0000 7f65fd5ce640 1 --2- 172.21.15.92:0/3417930536 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65f8102ef0 0x7f65f810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:39.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.688+0000 7f65fd5ce640 1 --2- 172.21.15.92:0/3417930536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65f8102570 0x7f65f81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:39.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.688+0000 7f65fd5ce640 1 --2- 172.21.15.92:0/3417930536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65f8100e20 0x7f65f8101200 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:39.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.688+0000 7f65fd5ce640 1 -- 172.21.15.92:0/3417930536 >> 172.21.15.92:0/3417930536 conn(0x7f65f80fc7d0 msgr2=0x7f65f80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:39.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.689+0000 7f65fd5ce640 1 -- 172.21.15.92:0/3417930536 shutdown_connections 2024-09-19T08:57:39.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.689+0000 7f65fd5ce640 1 -- 172.21.15.92:0/3417930536 wait complete. 2024-09-19T08:57:39.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.689+0000 7f65fd5ce640 1 Processor -- start 2024-09-19T08:57:39.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.689+0000 7f65fd5ce640 1 -- start start 2024-09-19T08:57:39.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.689+0000 7f65fd5ce640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65f8100e20 0x7f65f8198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:39.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.689+0000 7f65fd5ce640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65f8102570 0x7f65f8198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:39.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.689+0000 7f65fd5ce640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65f8102ef0 0x7f65f819ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:39.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.689+0000 7f65fd5ce640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f65f8110f80 con 0x7f65f8102570 2024-09-19T08:57:39.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.689+0000 7f65fd5ce640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f65f8110e00 con 0x7f65f8102ef0 2024-09-19T08:57:39.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.689+0000 7f65fd5ce640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f65f8111100 con 0x7f65f8100e20 2024-09-19T08:57:39.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.690+0000 7f65ee7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65f8102570 0x7f65f8198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:39.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.690+0000 7f65ee7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65f8102570 0x7f65f8198ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54284/0 (socket says 172.21.15.92:54284) 2024-09-19T08:57:39.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.690+0000 7f65ee7fc640 1 -- 172.21.15.92:0/3721832010 learned_addr learned my addr 172.21.15.92:0/3721832010 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:39.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.690+0000 7f65f6ffd640 1 --2- 172.21.15.92:0/3721832010 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65f8100e20 0x7f65f8198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:39.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.690+0000 7f65f77fe640 1 --2- 172.21.15.92:0/3721832010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65f8102ef0 0x7f65f819ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:39.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.690+0000 7f65ee7fc640 1 -- 172.21.15.92:0/3721832010 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65f8100e20 msgr2=0x7f65f8198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:39.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.690+0000 7f65ee7fc640 1 --2- 172.21.15.92:0/3721832010 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65f8100e20 0x7f65f8198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:39.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.690+0000 7f65ee7fc640 1 -- 172.21.15.92:0/3721832010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65f8102ef0 msgr2=0x7f65f819ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:39.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.690+0000 7f65ee7fc640 1 --2- 172.21.15.92:0/3721832010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65f8102ef0 0x7f65f819ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:39.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.690+0000 7f65ee7fc640 1 -- 172.21.15.92:0/3721832010 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65f819d530 con 0x7f65f8102570 2024-09-19T08:57:39.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.690+0000 7f65ee7fc640 1 --2- 172.21.15.92:0/3721832010 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65f8102570 0x7f65f8198ac0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f65e000d950 tx=0x7f65e000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:39.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.690+0000 7f65f4ff9640 1 -- 172.21.15.92:0/3721832010 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e0017030 con 0x7f65f8102570 2024-09-19T08:57:39.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.690+0000 7f65fd5ce640 1 -- 172.21.15.92:0/3721832010 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65f819d820 con 0x7f65f8102570 2024-09-19T08:57:39.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.690+0000 7f65f4ff9640 1 -- 172.21.15.92:0/3721832010 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65e0004020 con 0x7f65f8102570 2024-09-19T08:57:39.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.690+0000 7f65f4ff9640 1 -- 172.21.15.92:0/3721832010 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e00047a0 con 0x7f65f8102570 2024-09-19T08:57:39.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.690+0000 7f65fd5ce640 1 -- 172.21.15.92:0/3721832010 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65f81a5100 con 0x7f65f8102570 2024-09-19T08:57:39.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.692+0000 7f65f4ff9640 1 -- 172.21.15.92:0/3721832010 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f65e00041d0 con 0x7f65f8102570 2024-09-19T08:57:39.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.693+0000 7f65ff9a7740 1 Processor -- start 2024-09-19T08:57:39.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.693+0000 7f65ff9a7740 1 -- start start 2024-09-19T08:57:39.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.693+0000 7f65ff9a7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a55ea34a0 0x561a55ea3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:39.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.693+0000 7f65f4ff9640 1 --2- 172.21.15.92:0/3721832010 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f65e40a3240 0x7f65e40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:39.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.693+0000 7f65ff9a7740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a55ea3dc0 0x561a55eae140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:39.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.693+0000 7f65ff9a7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a55eae680 0x561a55eb0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:39.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.693+0000 7f65ff9a7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561a55e092e0 con 0x561a55ea34a0 2024-09-19T08:57:39.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.693+0000 7f65ff9a7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561a55db0ce0 con 0x561a55eae680 2024-09-19T08:57:39.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.693+0000 7f65ff9a7740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x561a55e052a0 con 0x561a55ea3dc0 2024-09-19T08:57:39.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.693+0000 7f65f77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a55ea34a0 0x561a55ea3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:39.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.693+0000 7f65f6ffd640 1 --2- 172.21.15.92:0/3721832010 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f65e40a3240 0x7f65e40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:39.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.693+0000 7f65f77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a55ea34a0 0x561a55ea3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54300/0 (socket says 172.21.15.92:54300) 2024-09-19T08:57:39.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.693+0000 7f65f77fe640 1 -- 172.21.15.92:0/236790423 learned_addr learned my addr 172.21.15.92:0/236790423 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:39.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.693+0000 7f65f4ff9640 1 -- 172.21.15.92:0/3721832010 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f65e00cf3b0 con 0x7f65f8102570 2024-09-19T08:57:39.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.693+0000 7f65f77fe640 1 -- 172.21.15.92:0/236790423 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a55ea3dc0 msgr2=0x561a55eae140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:39.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.693+0000 7f65f77fe640 1 --2- 172.21.15.92:0/236790423 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a55ea3dc0 0x561a55eae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:39.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.693+0000 7f65f77fe640 1 -- 172.21.15.92:0/236790423 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a55eae680 msgr2=0x561a55eb0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:39.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.693+0000 7f65f77fe640 1 --2- 172.21.15.92:0/236790423 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a55eae680 0x561a55eb0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:39.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.693+0000 7f65f77fe640 1 -- 172.21.15.92:0/236790423 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a55d95440 con 0x561a55ea34a0 2024-09-19T08:57:39.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.694+0000 7f65f77fe640 1 --2- 172.21.15.92:0/236790423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a55ea34a0 0x561a55ea3880 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f65f0008db0 tx=0x7f65f0010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3db6317a91fd0128 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:39.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.694+0000 7f65f6ffd640 1 --2- 172.21.15.92:0/3721832010 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f65e40a3240 0x7f65e40a5700 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f65e8005ab0 tx=0x7f65e8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:39.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.694+0000 7f65ed7fa640 1 -- 172.21.15.92:0/236790423 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f0016070 con 0x561a55ea34a0 2024-09-19T08:57:39.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.694+0000 7f65ed7fa640 1 -- 172.21.15.92:0/236790423 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65f0010e50 con 0x561a55ea34a0 2024-09-19T08:57:39.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.694+0000 7f65ed7fa640 1 -- 172.21.15.92:0/236790423 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f0011850 con 0x561a55ea34a0 2024-09-19T08:57:39.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.695+0000 7f65ff9a7740 1 -- 172.21.15.92:0/236790423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a55ea34a0 msgr2=0x561a55ea3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:39.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.695+0000 7f65ff9a7740 1 --2- 172.21.15.92:0/236790423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a55ea34a0 0x561a55ea3880 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f65f0008db0 tx=0x7f65f0010740 comp rx=0 tx=0).stop 2024-09-19T08:57:39.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.695+0000 7f65ff9a7740 1 -- 172.21.15.92:0/236790423 shutdown_connections 2024-09-19T08:57:39.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.695+0000 7f65ff9a7740 1 --2- 172.21.15.92:0/236790423 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a55eae680 0x561a55eb0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:39.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.695+0000 7f65ff9a7740 1 --2- 172.21.15.92:0/236790423 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a55ea3dc0 0x561a55eae140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:39.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.695+0000 7f65ff9a7740 1 --2- 172.21.15.92:0/236790423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a55ea34a0 0x561a55ea3880 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:39.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.695+0000 7f65ff9a7740 1 -- 172.21.15.92:0/236790423 >> 172.21.15.92:0/236790423 conn(0x561a55e9fa30 msgr2=0x561a55e9fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:39.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.695+0000 7f65ff9a7740 1 -- 172.21.15.92:0/236790423 shutdown_connections 2024-09-19T08:57:39.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.695+0000 7f65ff9a7740 1 -- 172.21.15.92:0/236790423 wait complete. 2024-09-19T08:57:39.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.695+0000 7f65ff9a7740 1 -- start start 2024-09-19T08:57:39.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.695+0000 7f65ff9a7740 1 Processor -- start 2024-09-19T08:57:39.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.695+0000 7f65ff9a7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a55ea34a0 0x561a55eadfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:39.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.695+0000 7f65ff9a7740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a55ea3dc0 0x561a55eab290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:39.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.695+0000 7f65ff9a7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a55eae680 0x561a55eab7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:39.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.696+0000 7f65ff9a7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561a55eb1250 con 0x561a55ea34a0 2024-09-19T08:57:39.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.696+0000 7f65ff9a7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561a55dc4050 con 0x561a55eae680 2024-09-19T08:57:39.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.696+0000 7f65ff9a7740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x561a55eb13d0 con 0x561a55ea3dc0 2024-09-19T08:57:39.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.696+0000 7f65ff9a7740 10 client.0 _ll_register_callbacks cb 0x561a55e04160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:39.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.696+0000 7f65f6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a55ea34a0 0x561a55eadfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:39.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.696+0000 7f65f6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a55ea34a0 0x561a55eadfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54312/0 (socket says 172.21.15.92:54312) 2024-09-19T08:57:39.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.696+0000 7f65f6ffd640 1 -- 172.21.15.92:0/2759814339 learned_addr learned my addr 172.21.15.92:0/2759814339 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:39.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.696+0000 7f65ee7fc640 1 --2- 172.21.15.92:0/2759814339 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a55ea3dc0 0x561a55eab290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:39.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.696+0000 7f65f77fe640 1 --2- 172.21.15.92:0/2759814339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a55eae680 0x561a55eab7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:39.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.696+0000 7f65f6ffd640 1 -- 172.21.15.92:0/2759814339 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a55ea3dc0 msgr2=0x561a55eab290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:39.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.696+0000 7f65f6ffd640 1 --2- 172.21.15.92:0/2759814339 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a55ea3dc0 0x561a55eab290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:39.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.696+0000 7f65f6ffd640 1 -- 172.21.15.92:0/2759814339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a55eae680 msgr2=0x561a55eab7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:39.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.696+0000 7f65f6ffd640 1 --2- 172.21.15.92:0/2759814339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a55eae680 0x561a55eab7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:39.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.696+0000 7f65f6ffd640 1 -- 172.21.15.92:0/2759814339 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a55b7a3c0 con 0x561a55ea34a0 2024-09-19T08:57:39.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.696+0000 7f65f6ffd640 1 --2- 172.21.15.92:0/2759814339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a55ea34a0 0x561a55eadfe0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f65e80096c0 tx=0x7f65e8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fd973e0fb2a118c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:39.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.696+0000 7f65de7fc640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:57:39.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.696+0000 7f65de7fc640 1 -- 172.21.15.92:0/2759814339 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e804c020 con 0x561a55ea34a0 2024-09-19T08:57:39.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.696+0000 7f65de7fc640 1 -- 172.21.15.92:0/2759814339 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f65e8004d90 con 0x561a55ea34a0 2024-09-19T08:57:39.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.696+0000 7f65ff9a7740 1 -- 172.21.15.92:0/2759814339 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65f0010e50 con 0x561a55ea34a0 2024-09-19T08:57:39.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.696+0000 7f65de7fc640 1 -- 172.21.15.92:0/2759814339 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f65e8035050 con 0x561a55ea34a0 2024-09-19T08:57:39.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.697+0000 7f65ff9a7740 10 client.15561 fetch_fsmap learned FSMap version 19 2024-09-19T08:57:39.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.697+0000 7f65ff9a7740 1 -- 172.21.15.92:0/2759814339 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x561a55ebcc20 con 0x561a55ea34a0 2024-09-19T08:57:39.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.697+0000 7f65de7fc640 1 -- 172.21.15.92:0/2759814339 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65f0010e50 con 0x561a55ea34a0 2024-09-19T08:57:39.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.697+0000 7f65de7fc640 1 -- 172.21.15.92:0/2759814339 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f65e8032850 con 0x561a55ea34a0 2024-09-19T08:57:39.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.697+0000 7f65ff9a7740 10 client.15561 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:57:39.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.697+0000 7f65ff9a7740 10 client.15561 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:57:39.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.697+0000 7f65ff9a7740 20 client.15561 populate_metadata read hostname 'smithi092' 2024-09-19T08:57:39.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.697+0000 7f65ff9a7740 1 --2- 172.21.15.92:0/2759814339 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561a55ebe030 0x561a55ec0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:39.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.697+0000 7f65ff9a7740 4 client.15561 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:57:39.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.697+0000 7f65ff9a7740 1 -- 172.21.15.92:0/2759814339 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a55e16850 con 0x561a55ebe030 2024-09-19T08:57:39.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.697+0000 7f65ee7fc640 1 --2- 172.21.15.92:0/2759814339 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561a55ebe030 0x561a55ec0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:39.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.698+0000 7f65ee7fc640 1 --2- 172.21.15.92:0/2759814339 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561a55ebe030 0x561a55ec0420 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b59816c851a1f6eb server_cookie=308aee44201660bf in_seq=0 out_seq=0 2024-09-19T08:57:39.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.698+0000 7f65de7fc640 10 client.15561 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:39.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.699+0000 7f65de7fc640 1 -- 172.21.15.92:0/2759814339 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561a55e16850 con 0x561a55ebe030 2024-09-19T08:57:39.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.699+0000 7f65de7fc640 10 client.15561 handle_command_reply: tid=0 2024-09-19T08:57:39.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.699+0000 7f65ff9a7740 1 client.15561 shutdown 2024-09-19T08:57:39.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.699+0000 7f65ff9a7740 1 -- 172.21.15.92:0/2759814339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a55ea34a0 msgr2=0x561a55eadfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:39.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.699+0000 7f65ff9a7740 1 --2- 172.21.15.92:0/2759814339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a55ea34a0 0x561a55eadfe0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f65e80096c0 tx=0x7f65e8009260 comp rx=0 tx=0).stop 2024-09-19T08:57:39.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.699+0000 7f65ff9a7740 1 -- 172.21.15.92:0/2759814339 shutdown_connections 2024-09-19T08:57:39.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.699+0000 7f65ff9a7740 1 --2- 172.21.15.92:0/2759814339 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561a55ebe030 0x561a55ec0420 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:39.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.699+0000 7f65de7fc640 0 client.15561 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:39.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.699+0000 7f65ff9a7740 1 --2- 172.21.15.92:0/2759814339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a55eae680 0x561a55eab7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:39.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.699+0000 7f65ff9a7740 1 --2- 172.21.15.92:0/2759814339 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a55ea3dc0 0x561a55eab290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:39.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.699+0000 7f65ff9a7740 1 --2- 172.21.15.92:0/2759814339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a55ea34a0 0x561a55eadfe0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:39.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.699+0000 7f65ff9a7740 1 -- 172.21.15.92:0/2759814339 >> 172.21.15.92:0/2759814339 conn(0x561a55e9fa30 msgr2=0x561a55ea5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:39.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.699+0000 7f65ff9a7740 1 -- 172.21.15.92:0/2759814339 shutdown_connections 2024-09-19T08:57:39.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.699+0000 7f65ff9a7740 1 -- 172.21.15.92:0/2759814339 wait complete. 2024-09-19T08:57:39.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.699+0000 7f65ff9a7740 20 client.15561 trim_cache size 0 max 16384 2024-09-19T08:57:39.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.716+0000 7f65ff9a7740 1 Processor -- start 2024-09-19T08:57:39.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.716+0000 7f65ff9a7740 1 -- start start 2024-09-19T08:57:39.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.716+0000 7f65ff9a7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a55ea34a0 0x561a55eab260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:39.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.716+0000 7f65ff9a7740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a55ea3dc0 0x561a55eba4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:39.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.716+0000 7f65ff9a7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a55eae680 0x561a55ec5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:39.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.716+0000 7f65ff9a7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f65f81ab690 con 0x561a55eae680 2024-09-19T08:57:39.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.716+0000 7f65ff9a7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f65f81adf30 con 0x561a55ea34a0 2024-09-19T08:57:39.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.716+0000 7f65ff9a7740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f65f81abd20 con 0x561a55ea3dc0 2024-09-19T08:57:39.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.717+0000 7f65f77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a55eae680 0x561a55ec5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:39.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.717+0000 7f65f77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a55eae680 0x561a55ec5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54326/0 (socket says 172.21.15.92:54326) 2024-09-19T08:57:39.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.717+0000 7f65f77fe640 1 -- 172.21.15.92:0/2759378465 learned_addr learned my addr 172.21.15.92:0/2759378465 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:39.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.717+0000 7f65f6ffd640 1 --2- 172.21.15.92:0/2759378465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a55ea34a0 0x561a55eab260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:39.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.717+0000 7f65ee7fc640 1 --2- 172.21.15.92:0/2759378465 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a55ea3dc0 0x561a55eba4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:39.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.717+0000 7f65f77fe640 1 -- 172.21.15.92:0/2759378465 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a55ea3dc0 msgr2=0x561a55eba4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:39.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.717+0000 7f65f77fe640 1 --2- 172.21.15.92:0/2759378465 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a55ea3dc0 0x561a55eba4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:39.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.717+0000 7f65f77fe640 1 -- 172.21.15.92:0/2759378465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a55ea34a0 msgr2=0x561a55eab260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:39.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.717+0000 7f65f77fe640 1 --2- 172.21.15.92:0/2759378465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a55ea34a0 0x561a55eab260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:39.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.717+0000 7f65f77fe640 1 -- 172.21.15.92:0/2759378465 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a55eaa280 con 0x561a55eae680 2024-09-19T08:57:39.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.717+0000 7f65f77fe640 1 --2- 172.21.15.92:0/2759378465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a55eae680 0x561a55ec5d10 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f65f0010c40 tx=0x7f65f0008970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1471881b8177c112 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:39.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.717+0000 7f65ecff9640 1 -- 172.21.15.92:0/2759378465 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f0016040 con 0x561a55eae680 2024-09-19T08:57:39.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.717+0000 7f65ecff9640 1 -- 172.21.15.92:0/2759378465 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65f0011cd0 con 0x561a55eae680 2024-09-19T08:57:39.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.717+0000 7f65ecff9640 1 -- 172.21.15.92:0/2759378465 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f0012d60 con 0x561a55eae680 2024-09-19T08:57:39.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.718+0000 7f65ff9a7740 1 -- 172.21.15.92:0/2759378465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a55eae680 msgr2=0x561a55ec5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:39.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.718+0000 7f65ff9a7740 1 --2- 172.21.15.92:0/2759378465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a55eae680 0x561a55ec5d10 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f65f0010c40 tx=0x7f65f0008970 comp rx=0 tx=0).stop 2024-09-19T08:57:39.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.718+0000 7f65ff9a7740 1 -- 172.21.15.92:0/2759378465 shutdown_connections 2024-09-19T08:57:39.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.718+0000 7f65ff9a7740 1 --2- 172.21.15.92:0/2759378465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a55eae680 0x561a55ec5d10 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:39.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.718+0000 7f65ff9a7740 1 --2- 172.21.15.92:0/2759378465 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a55ea3dc0 0x561a55eba4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:39.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.718+0000 7f65ff9a7740 1 --2- 172.21.15.92:0/2759378465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a55ea34a0 0x561a55eab260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:39.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.718+0000 7f65ff9a7740 1 -- 172.21.15.92:0/2759378465 >> 172.21.15.92:0/2759378465 conn(0x561a55e9fa30 msgr2=0x561a55eaab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:39.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.718+0000 7f65ff9a7740 1 -- 172.21.15.92:0/2759378465 shutdown_connections 2024-09-19T08:57:39.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.718+0000 7f65ff9a7740 1 -- 172.21.15.92:0/2759378465 wait complete. 2024-09-19T08:57:39.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.718+0000 7f65ff9a7740 1 -- start start 2024-09-19T08:57:39.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.718+0000 7f65ff9a7740 1 Processor -- start 2024-09-19T08:57:39.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.719+0000 7f65ff9a7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a55ea34a0 0x561a55eb6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:39.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.719+0000 7f65ff9a7740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a55ea3dc0 0x561a55eb6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:39.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.719+0000 7f65ff9a7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a55eae680 0x561a55eb35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:39.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.719+0000 7f65ff9a7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f65f81ac3f0 con 0x561a55eae680 2024-09-19T08:57:39.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.719+0000 7f65ff9a7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f65f81ad860 con 0x561a55ea34a0 2024-09-19T08:57:39.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.719+0000 7f65ff9a7740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f65f81acac0 con 0x561a55ea3dc0 2024-09-19T08:57:39.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.719+0000 7f65ff9a7740 10 client.0 _ll_register_callbacks cb 0x7f65e803f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:39.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.719+0000 7f65f77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a55eae680 0x561a55eb35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:39.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.719+0000 7f65f77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a55eae680 0x561a55eb35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54336/0 (socket says 172.21.15.92:54336) 2024-09-19T08:57:39.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.719+0000 7f65f77fe640 1 -- 172.21.15.92:0/3801650338 learned_addr learned my addr 172.21.15.92:0/3801650338 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:39.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.719+0000 7f65ee7fc640 1 --2- 172.21.15.92:0/3801650338 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a55ea3dc0 0x561a55eb6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:39.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.719+0000 7f65f6ffd640 1 --2- 172.21.15.92:0/3801650338 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a55ea34a0 0x561a55eb6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:39.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.719+0000 7f65f77fe640 1 -- 172.21.15.92:0/3801650338 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a55ea3dc0 msgr2=0x561a55eb6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:39.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.719+0000 7f65f77fe640 1 --2- 172.21.15.92:0/3801650338 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a55ea3dc0 0x561a55eb6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:39.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.719+0000 7f65f77fe640 1 -- 172.21.15.92:0/3801650338 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a55ea34a0 msgr2=0x561a55eb6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:39.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.719+0000 7f65f77fe640 1 --2- 172.21.15.92:0/3801650338 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a55ea34a0 0x561a55eb6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:39.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.719+0000 7f65f77fe640 1 -- 172.21.15.92:0/3801650338 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a55eabb60 con 0x561a55eae680 2024-09-19T08:57:39.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.719+0000 7f65f77fe640 1 --2- 172.21.15.92:0/3801650338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a55eae680 0x561a55eb35f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f65f0008d80 tx=0x7f65f0012d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bbc1be666a8bae2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:39.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.719+0000 7f65de7fc640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:57:39.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.720+0000 7f65de7fc640 1 -- 172.21.15.92:0/3801650338 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f0034060 con 0x561a55eae680 2024-09-19T08:57:39.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.720+0000 7f65de7fc640 1 -- 172.21.15.92:0/3801650338 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f65f0005ad0 con 0x561a55eae680 2024-09-19T08:57:39.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.720+0000 7f65ff9a7740 1 -- 172.21.15.92:0/3801650338 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65f0011cd0 con 0x561a55eae680 2024-09-19T08:57:39.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.720+0000 7f65de7fc640 1 -- 172.21.15.92:0/3801650338 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f65f0016070 con 0x561a55eae680 2024-09-19T08:57:39.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.720+0000 7f65ff9a7740 10 client.15567 fetch_fsmap learned FSMap version 19 2024-09-19T08:57:39.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.720+0000 7f65ff9a7740 1 -- 172.21.15.92:0/3801650338 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x561a55f29110 con 0x561a55eae680 2024-09-19T08:57:39.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.720+0000 7f65de7fc640 1 -- 172.21.15.92:0/3801650338 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65f0011cd0 con 0x561a55eae680 2024-09-19T08:57:39.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.720+0000 7f65de7fc640 1 -- 172.21.15.92:0/3801650338 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f65f0039070 con 0x561a55eae680 2024-09-19T08:57:39.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.720+0000 7f65ff9a7740 10 client.15567 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:57:39.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.720+0000 7f65ff9a7740 10 client.15567 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:57:39.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.720+0000 7f65ff9a7740 20 client.15567 populate_metadata read hostname 'smithi092' 2024-09-19T08:57:39.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.720+0000 7f65ff9a7740 1 --2- 172.21.15.92:0/3801650338 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561a55ebe030 0x561a55f2b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:39.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.720+0000 7f65ff9a7740 4 client.15567 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:57:39.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.720+0000 7f65ff9a7740 1 -- 172.21.15.92:0/3801650338 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561a55e10d60 con 0x561a55ebe030 2024-09-19T08:57:39.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.720+0000 7f65f6ffd640 1 --2- 172.21.15.92:0/3801650338 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561a55ebe030 0x561a55f2b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:39.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.721+0000 7f65f6ffd640 1 --2- 172.21.15.92:0/3801650338 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561a55ebe030 0x561a55f2b610 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=355cf1f87cb0d55e server_cookie=d5db2f57fa99234a in_seq=0 out_seq=0 2024-09-19T08:57:39.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.721+0000 7f65de7fc640 10 client.15567 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:39.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.721+0000 7f65de7fc640 1 -- 172.21.15.92:0/3801650338 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x561a55e10d60 con 0x561a55ebe030 2024-09-19T08:57:39.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.721+0000 7f65de7fc640 10 client.15567 handle_command_reply: tid=0 2024-09-19T08:57:39.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.721+0000 7f65ff9a7740 1 client.15567 shutdown 2024-09-19T08:57:39.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.721+0000 7f65ff9a7740 1 -- 172.21.15.92:0/3801650338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a55eae680 msgr2=0x561a55eb35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:39.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.721+0000 7f65ff9a7740 1 --2- 172.21.15.92:0/3801650338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a55eae680 0x561a55eb35f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f65f0008d80 tx=0x7f65f0012d70 comp rx=0 tx=0).stop 2024-09-19T08:57:39.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.721+0000 7f65ff9a7740 1 -- 172.21.15.92:0/3801650338 shutdown_connections 2024-09-19T08:57:39.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.721+0000 7f65ff9a7740 1 --2- 172.21.15.92:0/3801650338 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561a55ebe030 0x561a55f2b610 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:39.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.721+0000 7f65de7fc640 0 client.15567 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:39.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.721+0000 7f65ff9a7740 1 --2- 172.21.15.92:0/3801650338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a55eae680 0x561a55eb35f0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:39.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.721+0000 7f65ff9a7740 1 --2- 172.21.15.92:0/3801650338 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a55ea3dc0 0x561a55eb6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:39.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.721+0000 7f65ff9a7740 1 --2- 172.21.15.92:0/3801650338 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a55ea34a0 0x561a55eb6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:39.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.721+0000 7f65ff9a7740 1 -- 172.21.15.92:0/3801650338 >> 172.21.15.92:0/3801650338 conn(0x561a55e9fa30 msgr2=0x561a55ead310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:39.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.721+0000 7f65ff9a7740 1 -- 172.21.15.92:0/3801650338 shutdown_connections 2024-09-19T08:57:39.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.721+0000 7f65ff9a7740 1 -- 172.21.15.92:0/3801650338 wait complete. 2024-09-19T08:57:39.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.721+0000 7f65ff9a7740 20 client.15567 trim_cache size 0 max 16384 2024-09-19T08:57:39.727 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T08:57:39.727 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-19T08:57:39.727 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {} 2024-09-19T08:57:39.728 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T08:57:39.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.722+0000 7f65fd5ce640 1 -- 172.21.15.92:0/3721832010 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f65e40a3240 msgr2=0x7f65e40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:39.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.722+0000 7f65fd5ce640 1 --2- 172.21.15.92:0/3721832010 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f65e40a3240 0x7f65e40a5700 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f65e8005ab0 tx=0x7f65e8005a20 comp rx=0 tx=0).stop 2024-09-19T08:57:39.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.722+0000 7f65fd5ce640 1 -- 172.21.15.92:0/3721832010 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65f8102570 msgr2=0x7f65f8198ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:39.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.722+0000 7f65fd5ce640 1 --2- 172.21.15.92:0/3721832010 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65f8102570 0x7f65f8198ac0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f65e000d950 tx=0x7f65e000de10 comp rx=0 tx=0).stop 2024-09-19T08:57:39.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.722+0000 7f65fd5ce640 1 -- 172.21.15.92:0/3721832010 shutdown_connections 2024-09-19T08:57:39.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.722+0000 7f65fd5ce640 1 --2- 172.21.15.92:0/3721832010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65f8102ef0 0x7f65f819ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:39.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.722+0000 7f65fd5ce640 1 --2- 172.21.15.92:0/3721832010 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f65e40a3240 0x7f65e40a5700 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:39.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.722+0000 7f65fd5ce640 1 --2- 172.21.15.92:0/3721832010 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65f8102570 0x7f65f8198ac0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:39.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.722+0000 7f65fd5ce640 1 --2- 172.21.15.92:0/3721832010 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65f8100e20 0x7f65f8198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:39.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.722+0000 7f65fd5ce640 1 -- 172.21.15.92:0/3721832010 >> 172.21.15.92:0/3721832010 conn(0x7f65f80fc7d0 msgr2=0x7f65f806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:39.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.722+0000 7f65fd5ce640 1 -- 172.21.15.92:0/3721832010 shutdown_connections 2024-09-19T08:57:39.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:39.722+0000 7f65fd5ce640 1 -- 172.21.15.92:0/3721832010 wait complete. 2024-09-19T08:57:39.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:39 smithi167 ceph-mon[35359]: scrub queued for path: / 2024-09-19T08:57:39.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:39 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T08:57:39.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:39 smithi167 ceph-mon[35359]: scrub summary: active paths [/] 2024-09-19T08:57:39.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:39 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T08:57:39.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:39 smithi167 ceph-mon[35359]: pgmap v365: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.9 MiB/s wr, 451 op/s 2024-09-19T08:57:39.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:39 smithi167 ceph-mon[35359]: scrub summary: idle 2024-09-19T08:57:39.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:39 smithi190 ceph-mon[35358]: scrub queued for path: / 2024-09-19T08:57:39.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:39 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T08:57:39.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:39 smithi190 ceph-mon[35358]: scrub summary: active paths [/] 2024-09-19T08:57:39.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:39 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T08:57:39.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:39 smithi190 ceph-mon[35358]: pgmap v365: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.9 MiB/s wr, 451 op/s 2024-09-19T08:57:39.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:39 smithi190 ceph-mon[35358]: scrub summary: idle 2024-09-19T08:57:40.498 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:57:40.603 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:57:40.798 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 55.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T08:57:40.854 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:57:41.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.325+0000 7fe15d11c640 1 -- 172.21.15.92:0/3823971068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe158106f10 msgr2=0x7fe15810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:41.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.325+0000 7fe15d11c640 1 --2- 172.21.15.92:0/3823971068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe158106f10 0x7fe15810ea90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe150009ca0 tx=0x7fe15002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:57:41.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.325+0000 7fe15d11c640 1 -- 172.21.15.92:0/3823971068 shutdown_connections 2024-09-19T08:57:41.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.325+0000 7fe15d11c640 1 --2- 172.21.15.92:0/3823971068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe158106f10 0x7fe15810ea90 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:41.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.325+0000 7fe15d11c640 1 --2- 172.21.15.92:0/3823971068 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe158102790 0x7fe1581067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:41.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.325+0000 7fe15d11c640 1 --2- 172.21.15.92:0/3823971068 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe158101de0 0x7fe1581021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:41.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.325+0000 7fe15d11c640 1 -- 172.21.15.92:0/3823971068 >> 172.21.15.92:0/3823971068 conn(0x7fe1580fd8c0 msgr2=0x7fe1580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:41.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.325+0000 7fe15d11c640 1 -- 172.21.15.92:0/3823971068 shutdown_connections 2024-09-19T08:57:41.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.325+0000 7fe15d11c640 1 -- 172.21.15.92:0/3823971068 wait complete. 2024-09-19T08:57:41.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.326+0000 7fe15d11c640 1 Processor -- start 2024-09-19T08:57:41.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.326+0000 7fe15d11c640 1 -- start start 2024-09-19T08:57:41.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.326+0000 7fe15d11c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe158101de0 0x7fe1581985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:41.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.326+0000 7fe15d11c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe158102790 0x7fe158198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:41.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.326+0000 7fe15d11c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe158106f10 0x7fe15819cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:41.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.326+0000 7fe15d11c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe158112010 con 0x7fe158101de0 2024-09-19T08:57:41.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.326+0000 7fe15d11c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe158111e90 con 0x7fe158102790 2024-09-19T08:57:41.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.326+0000 7fe15d11c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe158112190 con 0x7fe158106f10 2024-09-19T08:57:41.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.326+0000 7fe156d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe158101de0 0x7fe1581985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:41.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.326+0000 7fe156d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe158101de0 0x7fe1581985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54360/0 (socket says 172.21.15.92:54360) 2024-09-19T08:57:41.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.326+0000 7fe156d9d640 1 -- 172.21.15.92:0/1216647163 learned_addr learned my addr 172.21.15.92:0/1216647163 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:41.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.326+0000 7fe15659c640 1 --2- 172.21.15.92:0/1216647163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe158102790 0x7fe158198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:41.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.326+0000 7fe15759e640 1 --2- 172.21.15.92:0/1216647163 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe158106f10 0x7fe15819cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:41.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.326+0000 7fe156d9d640 1 -- 172.21.15.92:0/1216647163 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe158106f10 msgr2=0x7fe15819cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:41.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.326+0000 7fe156d9d640 1 --2- 172.21.15.92:0/1216647163 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe158106f10 0x7fe15819cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:41.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.326+0000 7fe156d9d640 1 -- 172.21.15.92:0/1216647163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe158102790 msgr2=0x7fe158198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:41.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.326+0000 7fe156d9d640 1 --2- 172.21.15.92:0/1216647163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe158102790 0x7fe158198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:41.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.326+0000 7fe156d9d640 1 -- 172.21.15.92:0/1216647163 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe15819d5a0 con 0x7fe158101de0 2024-09-19T08:57:41.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.327+0000 7fe15659c640 1 --2- 172.21.15.92:0/1216647163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe158102790 0x7fe158198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:57:41.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.327+0000 7fe15759e640 1 --2- 172.21.15.92:0/1216647163 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe158106f10 0x7fe15819cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:57:41.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.327+0000 7fe156d9d640 1 --2- 172.21.15.92:0/1216647163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe158101de0 0x7fe1581985f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe14800b4a0 tx=0x7fe14800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:41.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.327+0000 7fe14ffff640 1 -- 172.21.15.92:0/1216647163 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe148014070 con 0x7fe158101de0 2024-09-19T08:57:41.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.327+0000 7fe14ffff640 1 -- 172.21.15.92:0/1216647163 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe148010af0 con 0x7fe158101de0 2024-09-19T08:57:41.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.327+0000 7fe15d11c640 1 -- 172.21.15.92:0/1216647163 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe15819d890 con 0x7fe158101de0 2024-09-19T08:57:41.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.327+0000 7fe14ffff640 1 -- 172.21.15.92:0/1216647163 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe148017d10 con 0x7fe158101de0 2024-09-19T08:57:41.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.327+0000 7fe15d11c640 1 -- 172.21.15.92:0/1216647163 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1581a5170 con 0x7fe158101de0 2024-09-19T08:57:41.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.328+0000 7fe15d11c640 1 -- 172.21.15.92:0/1216647163 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe158102240 con 0x7fe158101de0 2024-09-19T08:57:41.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.329+0000 7fe14ffff640 1 -- 172.21.15.92:0/1216647163 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe148017070 con 0x7fe158101de0 2024-09-19T08:57:41.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.330+0000 7fe14ffff640 1 --2- 172.21.15.92:0/1216647163 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe1440a3240 0x7fe1440a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:41.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.330+0000 7fe15659c640 1 --2- 172.21.15.92:0/1216647163 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe1440a3240 0x7fe1440a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:41.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.330+0000 7fe14ffff640 1 -- 172.21.15.92:0/1216647163 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe1480ced90 con 0x7fe158101de0 2024-09-19T08:57:41.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.330+0000 7fe15659c640 1 --2- 172.21.15.92:0/1216647163 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe1440a3240 0x7fe1440a5700 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe140006fd0 tx=0x7fe140008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:41.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.334+0000 7fe14ffff640 1 -- 172.21.15.92:0/1216647163 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe14809bab0 con 0x7fe158101de0 2024-09-19T08:57:41.502 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:41 smithi092 ceph-mon[31407]: pgmap v366: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 3.4 MiB/s wr, 277 op/s 2024-09-19T08:57:41.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.541+0000 7fe15d11c640 1 -- 172.21.15.92:0/1216647163 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe158199950 con 0x7fe158101de0 2024-09-19T08:57:41.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.542+0000 7fe14ffff640 1 -- 172.21.15.92:0/1216647163 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7fe14809b3b0 con 0x7fe158101de0 2024-09-19T08:57:41.542 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:57:41.542 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T08:57:41.543 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T08:57:41.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.544+0000 7fe15d11c640 1 -- 172.21.15.92:0/1216647163 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe1440a3240 msgr2=0x7fe1440a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:41.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.544+0000 7fe15d11c640 1 --2- 172.21.15.92:0/1216647163 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe1440a3240 0x7fe1440a5700 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe140006fd0 tx=0x7fe140008040 comp rx=0 tx=0).stop 2024-09-19T08:57:41.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.544+0000 7fe15d11c640 1 -- 172.21.15.92:0/1216647163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe158101de0 msgr2=0x7fe1581985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:41.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.544+0000 7fe15d11c640 1 --2- 172.21.15.92:0/1216647163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe158101de0 0x7fe1581985f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe14800b4a0 tx=0x7fe14800b960 comp rx=0 tx=0).stop 2024-09-19T08:57:41.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.544+0000 7fe15d11c640 1 -- 172.21.15.92:0/1216647163 shutdown_connections 2024-09-19T08:57:41.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.544+0000 7fe15d11c640 1 --2- 172.21.15.92:0/1216647163 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe158106f10 0x7fe15819cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:41.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.544+0000 7fe15d11c640 1 --2- 172.21.15.92:0/1216647163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe158102790 0x7fe158198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:41.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.544+0000 7fe15d11c640 1 --2- 172.21.15.92:0/1216647163 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe1440a3240 0x7fe1440a5700 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:41.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.544+0000 7fe15d11c640 1 --2- 172.21.15.92:0/1216647163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe158101de0 0x7fe1581985f0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:41.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.544+0000 7fe15d11c640 1 -- 172.21.15.92:0/1216647163 >> 172.21.15.92:0/1216647163 conn(0x7fe1580fd8c0 msgr2=0x7fe1580fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:41.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.544+0000 7fe15d11c640 1 -- 172.21.15.92:0/1216647163 shutdown_connections 2024-09-19T08:57:41.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:41.544+0000 7fe15d11c640 1 -- 172.21.15.92:0/1216647163 wait complete. 2024-09-19T08:57:41.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:41 smithi167 ceph-mon[35359]: pgmap v366: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 3.4 MiB/s wr, 277 op/s 2024-09-19T08:57:41.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:41 smithi190 ceph-mon[35358]: pgmap v366: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 3.4 MiB/s wr, 277 op/s 2024-09-19T08:57:42.194 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:57:42.490 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:57:42.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:42 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1216647163' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:57:42.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:42 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:42.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:42 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:42.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:42 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:42.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:42 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:57:42.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:42 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/1216647163' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:57:42.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:42 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:42.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:42 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:42.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:42 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:42.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:42 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:57:42.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:42 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/1216647163' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:57:42.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:42 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:42.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:42 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:42.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:42 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:42.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:42 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:57:42.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.909+0000 7f348ccd7640 1 -- 172.21.15.92:0/3190507690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3488108290 msgr2=0x7f348810ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:42.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.909+0000 7f348ccd7640 1 --2- 172.21.15.92:0/3190507690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3488108290 0x7f348810ec30 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3480009cd0 tx=0x7f348002a8e0 comp rx=0 tx=0).stop 2024-09-19T08:57:42.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.910+0000 7f348ccd7640 1 -- 172.21.15.92:0/3190507690 shutdown_connections 2024-09-19T08:57:42.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.910+0000 7f348ccd7640 1 --2- 172.21.15.92:0/3190507690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3488108290 0x7f348810ec30 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:42.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.910+0000 7f348ccd7640 1 --2- 172.21.15.92:0/3190507690 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3488103740 0x7f3488107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:42.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.910+0000 7f348ccd7640 1 --2- 172.21.15.92:0/3190507690 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3488102d90 0x7f3488103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:42.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.910+0000 7f348ccd7640 1 -- 172.21.15.92:0/3190507690 >> 172.21.15.92:0/3190507690 conn(0x7f34880fc7d0 msgr2=0x7f34880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:42.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.910+0000 7f348ccd7640 1 -- 172.21.15.92:0/3190507690 shutdown_connections 2024-09-19T08:57:42.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.910+0000 7f348ccd7640 1 -- 172.21.15.92:0/3190507690 wait complete. 2024-09-19T08:57:42.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.910+0000 7f348ccd7640 1 Processor -- start 2024-09-19T08:57:42.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.911+0000 7f348ccd7640 1 -- start start 2024-09-19T08:57:42.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.911+0000 7f348ccd7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3488102d90 0x7f34881985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:42.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.911+0000 7f348ccd7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3488103740 0x7f3488198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:42.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.911+0000 7f348ccd7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3488108290 0x7f348819ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:42.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.911+0000 7f348ccd7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f34881120d0 con 0x7f3488108290 2024-09-19T08:57:42.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.911+0000 7f348ccd7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3488111f50 con 0x7f3488103740 2024-09-19T08:57:42.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.911+0000 7f348ccd7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3488112250 con 0x7f3488102d90 2024-09-19T08:57:42.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.911+0000 7f3486d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3488108290 0x7f348819ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:42.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.911+0000 7f3486d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3488108290 0x7f348819ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59080/0 (socket says 172.21.15.92:59080) 2024-09-19T08:57:42.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.911+0000 7f3486d9d640 1 -- 172.21.15.92:0/1576470672 learned_addr learned my addr 172.21.15.92:0/1576470672 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:42.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.911+0000 7f348659c640 1 --2- 172.21.15.92:0/1576470672 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3488102d90 0x7f34881985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:42.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.911+0000 7f3485d9b640 1 --2- 172.21.15.92:0/1576470672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3488103740 0x7f3488198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:42.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.911+0000 7f3486d9d640 1 -- 172.21.15.92:0/1576470672 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3488102d90 msgr2=0x7f34881985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:42.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.911+0000 7f3486d9d640 1 --2- 172.21.15.92:0/1576470672 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3488102d90 0x7f34881985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:42.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.911+0000 7f3486d9d640 1 -- 172.21.15.92:0/1576470672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3488103740 msgr2=0x7f3488198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:42.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.911+0000 7f3486d9d640 1 --2- 172.21.15.92:0/1576470672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3488103740 0x7f3488198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:42.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.911+0000 7f3486d9d640 1 -- 172.21.15.92:0/1576470672 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f348819d560 con 0x7f3488108290 2024-09-19T08:57:42.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.911+0000 7f3485d9b640 1 --2- 172.21.15.92:0/1576470672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3488103740 0x7f3488198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:57:42.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.911+0000 7f3486d9d640 1 --2- 172.21.15.92:0/1576470672 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3488108290 0x7f348819ce80 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f3480006010 tx=0x7f3480003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:42.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.912+0000 7f34777fe640 1 -- 172.21.15.92:0/1576470672 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3480004450 con 0x7f3488108290 2024-09-19T08:57:42.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.912+0000 7f348ccd7640 1 -- 172.21.15.92:0/1576470672 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f348819d7f0 con 0x7f3488108290 2024-09-19T08:57:42.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.912+0000 7f34777fe640 1 -- 172.21.15.92:0/1576470672 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3480003e10 con 0x7f3488108290 2024-09-19T08:57:42.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.912+0000 7f34777fe640 1 -- 172.21.15.92:0/1576470672 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34800466e0 con 0x7f3488108290 2024-09-19T08:57:42.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.912+0000 7f348ccd7640 1 -- 172.21.15.92:0/1576470672 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34881a5130 con 0x7f3488108290 2024-09-19T08:57:42.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.914+0000 7f34777fe640 1 -- 172.21.15.92:0/1576470672 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f34800305a0 con 0x7f3488108290 2024-09-19T08:57:42.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.914+0000 7f348f0b0740 1 Processor -- start 2024-09-19T08:57:42.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.914+0000 7f348f0b0740 1 -- start start 2024-09-19T08:57:42.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.915+0000 7f34777fe640 1 --2- 172.21.15.92:0/1576470672 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f34700a3240 0x7f34700a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:42.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.915+0000 7f348f0b0740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559986320b40 0x55998631f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:42.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.915+0000 7f348f0b0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55998631f5d0 0x55998631fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:42.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.915+0000 7f348f0b0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55998632e780 0x559986330b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:42.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.915+0000 7f348f0b0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5599862852f0 con 0x55998632e780 2024-09-19T08:57:42.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.915+0000 7f348f0b0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55998622ccf0 con 0x55998631f5d0 2024-09-19T08:57:42.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.915+0000 7f348f0b0740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5599862812b0 con 0x559986320b40 2024-09-19T08:57:42.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.915+0000 7f34777fe640 1 -- 172.21.15.92:0/1576470672 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f348002e030 con 0x7f3488108290 2024-09-19T08:57:42.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.915+0000 7f3485d9b640 1 --2- 172.21.15.92:0/1576470672 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f34700a3240 0x7f34700a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:42.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.915+0000 7f348659c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559986320b40 0x55998631f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:42.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.915+0000 7f348659c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559986320b40 0x55998631f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:35268/0 (socket says 172.21.15.92:35268) 2024-09-19T08:57:42.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.915+0000 7f348659c640 1 -- 172.21.15.92:0/1431856143 learned_addr learned my addr 172.21.15.92:0/1431856143 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:42.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.915+0000 7f3486d9d640 1 --2- 172.21.15.92:0/1431856143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55998632e780 0x559986330b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:42.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.915+0000 7f3485d9b640 1 --2- 172.21.15.92:0/1431856143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55998631f5d0 0x55998631fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:42.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.915+0000 7f348659c640 1 -- 172.21.15.92:0/1431856143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55998631f5d0 msgr2=0x55998631fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:42.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.915+0000 7f348659c640 1 --2- 172.21.15.92:0/1431856143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55998631f5d0 0x55998631fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:42.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.915+0000 7f348659c640 1 -- 172.21.15.92:0/1431856143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55998632e780 msgr2=0x559986330b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:42.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.915+0000 7f348659c640 1 --2- 172.21.15.92:0/1431856143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55998632e780 0x559986330b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:42.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.915+0000 7f348659c640 1 -- 172.21.15.92:0/1431856143 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599862113a0 con 0x559986320b40 2024-09-19T08:57:42.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.915+0000 7f3485d9b640 1 --2- 172.21.15.92:0/1576470672 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f34700a3240 0x7f34700a5700 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f34880fee10 tx=0x7f347c014660 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:42.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.916+0000 7f348659c640 1 --2- 172.21.15.92:0/1431856143 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559986320b40 0x55998631f090 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f347800ac20 tx=0x7f347800f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96e4e8c7414bc67e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:42.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.916+0000 7f3474ff9640 1 -- 172.21.15.92:0/1431856143 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347801d070 con 0x559986320b40 2024-09-19T08:57:42.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.916+0000 7f3474ff9640 1 -- 172.21.15.92:0/1431856143 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3478018b20 con 0x559986320b40 2024-09-19T08:57:42.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.916+0000 7f3474ff9640 1 -- 172.21.15.92:0/1431856143 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3478010ad0 con 0x559986320b40 2024-09-19T08:57:42.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.916+0000 7f348f0b0740 1 -- 172.21.15.92:0/1431856143 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559986320b40 msgr2=0x55998631f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:42.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.916+0000 7f348f0b0740 1 --2- 172.21.15.92:0/1431856143 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559986320b40 0x55998631f090 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f347800ac20 tx=0x7f347800f790 comp rx=0 tx=0).stop 2024-09-19T08:57:42.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.916+0000 7f348f0b0740 1 -- 172.21.15.92:0/1431856143 shutdown_connections 2024-09-19T08:57:42.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.916+0000 7f348f0b0740 1 --2- 172.21.15.92:0/1431856143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55998632e780 0x559986330b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:42.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.916+0000 7f348f0b0740 1 --2- 172.21.15.92:0/1431856143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55998631f5d0 0x55998631fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:42.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.916+0000 7f348f0b0740 1 --2- 172.21.15.92:0/1431856143 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559986320b40 0x55998631f090 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:42.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.916+0000 7f348f0b0740 1 -- 172.21.15.92:0/1431856143 >> 172.21.15.92:0/1431856143 conn(0x5599862e8310 msgr2=0x55998631bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:42.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.917+0000 7f348f0b0740 1 -- 172.21.15.92:0/1431856143 shutdown_connections 2024-09-19T08:57:42.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.917+0000 7f348f0b0740 1 -- 172.21.15.92:0/1431856143 wait complete. 2024-09-19T08:57:42.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.917+0000 7f348f0b0740 1 -- start start 2024-09-19T08:57:42.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.917+0000 7f348f0b0740 1 Processor -- start 2024-09-19T08:57:42.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.917+0000 7f348f0b0740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55998631f5d0 0x55998632e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:42.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.917+0000 7f348f0b0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559986320b40 0x55998632b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:42.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.917+0000 7f348f0b0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55998632e780 0x55998632b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:42.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.917+0000 7f348f0b0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559986331480 con 0x559986320b40 2024-09-19T08:57:42.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.917+0000 7f348f0b0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559986240060 con 0x55998632e780 2024-09-19T08:57:42.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.917+0000 7f348f0b0740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x559986331600 con 0x55998631f5d0 2024-09-19T08:57:42.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.917+0000 7f348f0b0740 10 client.0 _ll_register_callbacks cb 0x559985f938c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:42.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.917+0000 7f3485d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559986320b40 0x55998632b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:42.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.917+0000 7f348659c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55998631f5d0 0x55998632e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:42.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.917+0000 7f3485d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559986320b40 0x55998632b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59086/0 (socket says 172.21.15.92:59086) 2024-09-19T08:57:42.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.917+0000 7f3485d9b640 1 -- 172.21.15.92:0/3248814728 learned_addr learned my addr 172.21.15.92:0/3248814728 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:42.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.917+0000 7f3486d9d640 1 --2- 172.21.15.92:0/3248814728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55998632e780 0x55998632b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:42.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.918+0000 7f3485d9b640 1 -- 172.21.15.92:0/3248814728 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55998631f5d0 msgr2=0x55998632e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:42.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.918+0000 7f3485d9b640 1 --2- 172.21.15.92:0/3248814728 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55998631f5d0 0x55998632e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:42.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.918+0000 7f3485d9b640 1 -- 172.21.15.92:0/3248814728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55998632e780 msgr2=0x55998632b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:42.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.918+0000 7f3485d9b640 1 --2- 172.21.15.92:0/3248814728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55998632e780 0x55998632b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:42.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.918+0000 7f3485d9b640 1 -- 172.21.15.92:0/3248814728 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559985ff63c0 con 0x559986320b40 2024-09-19T08:57:42.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.918+0000 7f348659c640 1 --2- 172.21.15.92:0/3248814728 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55998631f5d0 0x55998632e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:57:42.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.918+0000 7f3485d9b640 1 --2- 172.21.15.92:0/3248814728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559986320b40 0x55998632b3e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f347c017d50 tx=0x7f347c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa41cbbc0249eb2e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:42.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.918+0000 7f346dffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:57:42.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.918+0000 7f346dffb640 1 -- 172.21.15.92:0/3248814728 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347c014ea0 con 0x559986320b40 2024-09-19T08:57:42.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.918+0000 7f346dffb640 1 -- 172.21.15.92:0/3248814728 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f347c016d80 con 0x559986320b40 2024-09-19T08:57:42.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.918+0000 7f348f0b0740 1 -- 172.21.15.92:0/3248814728 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3478018b20 con 0x559986320b40 2024-09-19T08:57:42.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.918+0000 7f346dffb640 1 -- 172.21.15.92:0/3248814728 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f347c0059c0 con 0x559986320b40 2024-09-19T08:57:42.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.918+0000 7f348f0b0740 10 client.15585 fetch_fsmap learned FSMap version 19 2024-09-19T08:57:42.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.918+0000 7f348f0b0740 1 -- 172.21.15.92:0/3248814728 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55998633ced0 con 0x559986320b40 2024-09-19T08:57:42.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.918+0000 7f346dffb640 1 -- 172.21.15.92:0/3248814728 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3478018b20 con 0x559986320b40 2024-09-19T08:57:42.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.919+0000 7f346dffb640 1 -- 172.21.15.92:0/3248814728 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f347c02d440 con 0x559986320b40 2024-09-19T08:57:42.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.919+0000 7f348f0b0740 10 client.15585 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:57:42.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.919+0000 7f348f0b0740 10 client.15585 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:57:42.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.919+0000 7f348f0b0740 20 client.15585 populate_metadata read hostname 'smithi092' 2024-09-19T08:57:42.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.919+0000 7f348f0b0740 1 --2- 172.21.15.92:0/3248814728 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55998633e3e0 0x559986340860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:42.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.919+0000 7f348f0b0740 4 client.15585 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:57:42.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.919+0000 7f348f0b0740 1 -- 172.21.15.92:0/3248814728 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559986292860 con 0x55998633e3e0 2024-09-19T08:57:42.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.919+0000 7f348659c640 1 --2- 172.21.15.92:0/3248814728 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55998633e3e0 0x559986340860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:42.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.919+0000 7f346dffb640 10 client.15585 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:42.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.919+0000 7f348659c640 1 --2- 172.21.15.92:0/3248814728 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55998633e3e0 0x559986340860 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5adee426532f0a70 server_cookie=7ee609e1658f0a18 in_seq=0 out_seq=0 2024-09-19T08:57:42.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.920+0000 7f346dffb640 1 -- 172.21.15.92:0/3248814728 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559986292860 con 0x55998633e3e0 2024-09-19T08:57:42.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.920+0000 7f346dffb640 10 client.15585 handle_command_reply: tid=0 2024-09-19T08:57:42.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.920+0000 7f348f0b0740 1 client.15585 shutdown 2024-09-19T08:57:42.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.920+0000 7f348f0b0740 1 -- 172.21.15.92:0/3248814728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559986320b40 msgr2=0x55998632b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:42.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.920+0000 7f348f0b0740 1 --2- 172.21.15.92:0/3248814728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559986320b40 0x55998632b3e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f347c017d50 tx=0x7f347c0046c0 comp rx=0 tx=0).stop 2024-09-19T08:57:42.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.920+0000 7f348f0b0740 1 -- 172.21.15.92:0/3248814728 shutdown_connections 2024-09-19T08:57:42.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.920+0000 7f348f0b0740 1 --2- 172.21.15.92:0/3248814728 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55998633e3e0 0x559986340860 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:42.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.920+0000 7f348f0b0740 1 --2- 172.21.15.92:0/3248814728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55998632e780 0x55998632b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:42.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.920+0000 7f346dffb640 0 client.15585 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:42.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.920+0000 7f348f0b0740 1 --2- 172.21.15.92:0/3248814728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559986320b40 0x55998632b3e0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:42.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.920+0000 7f348f0b0740 1 --2- 172.21.15.92:0/3248814728 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55998631f5d0 0x55998632e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:42.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.920+0000 7f348f0b0740 1 -- 172.21.15.92:0/3248814728 >> 172.21.15.92:0/3248814728 conn(0x5599862e8310 msgr2=0x559986321960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:42.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.920+0000 7f348f0b0740 1 -- 172.21.15.92:0/3248814728 shutdown_connections 2024-09-19T08:57:42.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.920+0000 7f348f0b0740 1 -- 172.21.15.92:0/3248814728 wait complete. 2024-09-19T08:57:42.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.920+0000 7f348f0b0740 20 client.15585 trim_cache size 0 max 16384 2024-09-19T08:57:42.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.933+0000 7f348f0b0740 1 Processor -- start 2024-09-19T08:57:42.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.933+0000 7f348f0b0740 1 -- start start 2024-09-19T08:57:42.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.933+0000 7f348f0b0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55998631f5d0 0x55998633a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:42.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.933+0000 7f348f0b0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559986320b40 0x55998631b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:42.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.933+0000 7f348f0b0740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55998632e780 0x559986346130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:42.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.933+0000 7f348f0b0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f34881a9400 con 0x55998631f5d0 2024-09-19T08:57:42.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.933+0000 7f348f0b0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f34881abca0 con 0x559986320b40 2024-09-19T08:57:42.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.933+0000 7f348f0b0740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f34881a9a90 con 0x55998632e780 2024-09-19T08:57:42.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.933+0000 7f348659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55998631f5d0 0x55998633a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:42.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.933+0000 7f348659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55998631f5d0 0x55998633a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59092/0 (socket says 172.21.15.92:59092) 2024-09-19T08:57:42.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.933+0000 7f348659c640 1 -- 172.21.15.92:0/3081625072 learned_addr learned my addr 172.21.15.92:0/3081625072 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:42.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.934+0000 7f348659c640 1 -- 172.21.15.92:0/3081625072 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55998632e780 msgr2=0x559986346130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:42.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.934+0000 7f348659c640 1 --2- 172.21.15.92:0/3081625072 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55998632e780 0x559986346130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:42.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.934+0000 7f348659c640 1 -- 172.21.15.92:0/3081625072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559986320b40 msgr2=0x55998631b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:42.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.934+0000 7f3485d9b640 1 --2- 172.21.15.92:0/3081625072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559986320b40 0x55998631b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:42.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.934+0000 7f348659c640 1 --2- 172.21.15.92:0/3081625072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559986320b40 0x55998631b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:42.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.934+0000 7f348659c640 1 -- 172.21.15.92:0/3081625072 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559986322120 con 0x55998631f5d0 2024-09-19T08:57:42.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.934+0000 7f348659c640 1 --2- 172.21.15.92:0/3081625072 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55998631f5d0 0x55998633a720 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f3478000c00 tx=0x7f3478010550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67455c4e584a4ab8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:42.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.934+0000 7f346ffff640 1 -- 172.21.15.92:0/3081625072 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3478034070 con 0x55998631f5d0 2024-09-19T08:57:42.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.934+0000 7f346ffff640 1 -- 172.21.15.92:0/3081625072 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f347801e040 con 0x55998631f5d0 2024-09-19T08:57:42.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.934+0000 7f346ffff640 1 -- 172.21.15.92:0/3081625072 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347801d040 con 0x55998631f5d0 2024-09-19T08:57:42.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.935+0000 7f348f0b0740 1 -- 172.21.15.92:0/3081625072 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55998631f5d0 msgr2=0x55998633a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:42.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.935+0000 7f348f0b0740 1 --2- 172.21.15.92:0/3081625072 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55998631f5d0 0x55998633a720 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f3478000c00 tx=0x7f3478010550 comp rx=0 tx=0).stop 2024-09-19T08:57:42.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.935+0000 7f348f0b0740 1 -- 172.21.15.92:0/3081625072 shutdown_connections 2024-09-19T08:57:42.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.935+0000 7f348f0b0740 1 --2- 172.21.15.92:0/3081625072 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55998632e780 0x559986346130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:42.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.935+0000 7f348f0b0740 1 --2- 172.21.15.92:0/3081625072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559986320b40 0x55998631b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:42.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.935+0000 7f348f0b0740 1 --2- 172.21.15.92:0/3081625072 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55998631f5d0 0x55998633a720 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:42.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.935+0000 7f348f0b0740 1 -- 172.21.15.92:0/3081625072 >> 172.21.15.92:0/3081625072 conn(0x5599862e8310 msgr2=0x55998632a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:42.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.935+0000 7f348f0b0740 1 -- 172.21.15.92:0/3081625072 shutdown_connections 2024-09-19T08:57:42.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.935+0000 7f348f0b0740 1 -- 172.21.15.92:0/3081625072 wait complete. 2024-09-19T08:57:42.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.935+0000 7f348f0b0740 1 -- start start 2024-09-19T08:57:42.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.935+0000 7f348f0b0740 1 Processor -- start 2024-09-19T08:57:42.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.935+0000 7f348f0b0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55998631f5d0 0x5599863327d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:42.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.935+0000 7f348f0b0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559986320b40 0x559986332d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:42.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.935+0000 7f348f0b0740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55998632e780 0x559986333250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:42.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.935+0000 7f348f0b0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f34881aa160 con 0x559986320b40 2024-09-19T08:57:42.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.935+0000 7f348f0b0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f34881ab5d0 con 0x55998631f5d0 2024-09-19T08:57:42.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.935+0000 7f348f0b0740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f34881aa830 con 0x55998632e780 2024-09-19T08:57:42.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.936+0000 7f348f0b0740 10 client.0 _ll_register_callbacks cb 0x7f347c0091e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:42.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.936+0000 7f3485d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559986320b40 0x559986332d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:42.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.936+0000 7f3485d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559986320b40 0x559986332d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59098/0 (socket says 172.21.15.92:59098) 2024-09-19T08:57:42.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.936+0000 7f3485d9b640 1 -- 172.21.15.92:0/1073453775 learned_addr learned my addr 172.21.15.92:0/1073453775 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:42.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.936+0000 7f348659c640 1 --2- 172.21.15.92:0/1073453775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55998631f5d0 0x5599863327d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:42.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.936+0000 7f3486d9d640 1 --2- 172.21.15.92:0/1073453775 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55998632e780 0x559986333250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:42.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.936+0000 7f3485d9b640 1 -- 172.21.15.92:0/1073453775 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55998632e780 msgr2=0x559986333250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:42.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.936+0000 7f3485d9b640 1 --2- 172.21.15.92:0/1073453775 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55998632e780 0x559986333250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:42.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.936+0000 7f3485d9b640 1 -- 172.21.15.92:0/1073453775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55998631f5d0 msgr2=0x5599863327d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:42.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.936+0000 7f3485d9b640 1 --2- 172.21.15.92:0/1073453775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55998631f5d0 0x5599863327d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:42.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.936+0000 7f3485d9b640 1 -- 172.21.15.92:0/1073453775 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599863a8300 con 0x559986320b40 2024-09-19T08:57:42.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.936+0000 7f3486d9d640 1 --2- 172.21.15.92:0/1073453775 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55998632e780 0x559986333250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:57:42.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.936+0000 7f3485d9b640 1 --2- 172.21.15.92:0/1073453775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559986320b40 0x559986332d10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f347c004810 tx=0x7f347c02d750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323ec1922332610a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:42.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.936+0000 7f346dffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:57:42.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.936+0000 7f346dffb640 1 -- 172.21.15.92:0/1073453775 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347c014ea0 con 0x559986320b40 2024-09-19T08:57:42.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.936+0000 7f346dffb640 1 -- 172.21.15.92:0/1073453775 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f347c016de0 con 0x559986320b40 2024-09-19T08:57:42.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.936+0000 7f348f0b0740 1 -- 172.21.15.92:0/1073453775 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f347801e040 con 0x559986320b40 2024-09-19T08:57:42.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.936+0000 7f346dffb640 1 -- 172.21.15.92:0/1073453775 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f347c023480 con 0x559986320b40 2024-09-19T08:57:42.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.936+0000 7f348f0b0740 10 client.15591 fetch_fsmap learned FSMap version 19 2024-09-19T08:57:42.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.936+0000 7f348f0b0740 1 -- 172.21.15.92:0/1073453775 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5599863a9620 con 0x559986320b40 2024-09-19T08:57:42.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.937+0000 7f346dffb640 1 -- 172.21.15.92:0/1073453775 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f347801e040 con 0x559986320b40 2024-09-19T08:57:42.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.937+0000 7f346dffb640 1 -- 172.21.15.92:0/1073453775 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f347c036510 con 0x559986320b40 2024-09-19T08:57:42.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.937+0000 7f348f0b0740 10 client.15591 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:57:42.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.937+0000 7f348f0b0740 10 client.15591 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:57:42.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.937+0000 7f348f0b0740 20 client.15591 populate_metadata read hostname 'smithi092' 2024-09-19T08:57:42.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.937+0000 7f348f0b0740 1 --2- 172.21.15.92:0/1073453775 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5599863a9df0 0x5599863ac210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:42.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.937+0000 7f348f0b0740 4 client.15591 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:57:42.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.937+0000 7f348f0b0740 1 -- 172.21.15.92:0/1073453775 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55998628cd70 con 0x5599863a9df0 2024-09-19T08:57:42.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.937+0000 7f348659c640 1 --2- 172.21.15.92:0/1073453775 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5599863a9df0 0x5599863ac210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:42.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.937+0000 7f348659c640 1 --2- 172.21.15.92:0/1073453775 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5599863a9df0 0x5599863ac210 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df650c10c865a58d server_cookie=d18231e7af2f4acf in_seq=0 out_seq=0 2024-09-19T08:57:42.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.937+0000 7f346dffb640 10 client.15591 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:42.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.938+0000 7f346dffb640 1 -- 172.21.15.92:0/1073453775 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55998628cd70 con 0x5599863a9df0 2024-09-19T08:57:42.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.938+0000 7f346dffb640 10 client.15591 handle_command_reply: tid=0 2024-09-19T08:57:42.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.938+0000 7f348f0b0740 1 client.15591 shutdown 2024-09-19T08:57:42.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.938+0000 7f348f0b0740 1 -- 172.21.15.92:0/1073453775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559986320b40 msgr2=0x559986332d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:42.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.938+0000 7f348f0b0740 1 --2- 172.21.15.92:0/1073453775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559986320b40 0x559986332d10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f347c004810 tx=0x7f347c02d750 comp rx=0 tx=0).stop 2024-09-19T08:57:42.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.938+0000 7f348f0b0740 1 -- 172.21.15.92:0/1073453775 shutdown_connections 2024-09-19T08:57:42.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.938+0000 7f348f0b0740 1 --2- 172.21.15.92:0/1073453775 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5599863a9df0 0x5599863ac210 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:42.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.938+0000 7f348f0b0740 1 --2- 172.21.15.92:0/1073453775 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55998632e780 0x559986333250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:42.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.938+0000 7f348f0b0740 1 --2- 172.21.15.92:0/1073453775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559986320b40 0x559986332d10 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:42.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.938+0000 7f348f0b0740 1 --2- 172.21.15.92:0/1073453775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55998631f5d0 0x5599863327d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:42.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.938+0000 7f346dffb640 0 client.15591 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:42.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.938+0000 7f348f0b0740 1 -- 172.21.15.92:0/1073453775 >> 172.21.15.92:0/1073453775 conn(0x5599862e8310 msgr2=0x55998632a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:42.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.938+0000 7f348f0b0740 1 -- 172.21.15.92:0/1073453775 shutdown_connections 2024-09-19T08:57:42.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.938+0000 7f348f0b0740 1 -- 172.21.15.92:0/1073453775 wait complete. 2024-09-19T08:57:42.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.938+0000 7f348f0b0740 20 client.15591 trim_cache size 0 max 16384 2024-09-19T08:57:42.945 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-19T08:57:42.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.938+0000 7f348ccd7640 1 -- 172.21.15.92:0/1576470672 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f34700a3240 msgr2=0x7f34700a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:42.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.938+0000 7f348ccd7640 1 --2- 172.21.15.92:0/1576470672 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f34700a3240 0x7f34700a5700 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f34880fee10 tx=0x7f347c014660 comp rx=0 tx=0).stop 2024-09-19T08:57:42.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.938+0000 7f348ccd7640 1 -- 172.21.15.92:0/1576470672 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3488108290 msgr2=0x7f348819ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:42.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.938+0000 7f348ccd7640 1 --2- 172.21.15.92:0/1576470672 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3488108290 0x7f348819ce80 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f3480006010 tx=0x7f3480003c20 comp rx=0 tx=0).stop 2024-09-19T08:57:42.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.938+0000 7f348ccd7640 1 -- 172.21.15.92:0/1576470672 shutdown_connections 2024-09-19T08:57:42.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.938+0000 7f348ccd7640 1 --2- 172.21.15.92:0/1576470672 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f34700a3240 0x7f34700a5700 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:42.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.938+0000 7f348ccd7640 1 --2- 172.21.15.92:0/1576470672 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3488108290 0x7f348819ce80 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:42.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.939+0000 7f348ccd7640 1 --2- 172.21.15.92:0/1576470672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3488103740 0x7f3488198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:42.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.939+0000 7f348ccd7640 1 --2- 172.21.15.92:0/1576470672 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3488102d90 0x7f34881985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:42.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.939+0000 7f348ccd7640 1 -- 172.21.15.92:0/1576470672 >> 172.21.15.92:0/1576470672 conn(0x7f34880fc7d0 msgr2=0x7f3488105d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:42.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.939+0000 7f348ccd7640 1 -- 172.21.15.92:0/1576470672 shutdown_connections 2024-09-19T08:57:42.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:42.939+0000 7f348ccd7640 1 -- 172.21.15.92:0/1576470672 wait complete. 2024-09-19T08:57:43.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:43 smithi092 ceph-mon[31407]: pgmap v367: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 1.1 MiB/s wr, 160 op/s 2024-09-19T08:57:43.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:43 smithi167 ceph-mon[35359]: pgmap v367: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 1.1 MiB/s wr, 160 op/s 2024-09-19T08:57:43.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:43 smithi190 ceph-mon[35358]: pgmap v367: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 1.1 MiB/s wr, 160 op/s 2024-09-19T08:57:44.699 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:57:44.699 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:57:44.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:44 smithi167 ceph-mon[35359]: pgmap v368: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 522 KiB/s wr, 141 op/s 2024-09-19T08:57:44.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:44 smithi190 ceph-mon[35358]: pgmap v368: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 522 KiB/s wr, 141 op/s 2024-09-19T08:57:44.964 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:57:45.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:44 smithi092 ceph-mon[31407]: pgmap v368: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 522 KiB/s wr, 141 op/s 2024-09-19T08:57:45.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.354+0000 7f859b7c4640 1 -- 172.21.15.92:0/395043741 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8594106f10 msgr2=0x7f859410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:45.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.354+0000 7f859b7c4640 1 --2- 172.21.15.92:0/395043741 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8594106f10 0x7f859410ea90 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f858c009ca0 tx=0x7f858c02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.354+0000 7f859b7c4640 1 -- 172.21.15.92:0/395043741 shutdown_connections 2024-09-19T08:57:45.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.354+0000 7f859b7c4640 1 --2- 172.21.15.92:0/395043741 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8594106f10 0x7f859410ea90 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.354+0000 7f859b7c4640 1 --2- 172.21.15.92:0/395043741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8594102790 0x7f85941067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.354+0000 7f859b7c4640 1 --2- 172.21.15.92:0/395043741 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8594101de0 0x7f85941021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.354+0000 7f859b7c4640 1 -- 172.21.15.92:0/395043741 >> 172.21.15.92:0/395043741 conn(0x7f85940fd8c0 msgr2=0x7f85940ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:45.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.354+0000 7f859b7c4640 1 -- 172.21.15.92:0/395043741 shutdown_connections 2024-09-19T08:57:45.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.354+0000 7f859b7c4640 1 -- 172.21.15.92:0/395043741 wait complete. 2024-09-19T08:57:45.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.355+0000 7f859b7c4640 1 Processor -- start 2024-09-19T08:57:45.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.355+0000 7f859b7c4640 1 -- start start 2024-09-19T08:57:45.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.355+0000 7f859b7c4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8594101de0 0x7f8594198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:45.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.355+0000 7f859b7c4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8594102790 0x7f8594198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:45.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.355+0000 7f859b7c4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8594106f10 0x7f859419ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:45.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.355+0000 7f859b7c4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8594112060 con 0x7f8594106f10 2024-09-19T08:57:45.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.355+0000 7f859b7c4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8594111ee0 con 0x7f8594101de0 2024-09-19T08:57:45.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.355+0000 7f859b7c4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f85941121e0 con 0x7f8594102790 2024-09-19T08:57:45.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.355+0000 7f8599d61640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8594106f10 0x7f859419ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:45.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.355+0000 7f8599d61640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8594106f10 0x7f859419ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59104/0 (socket says 172.21.15.92:59104) 2024-09-19T08:57:45.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.355+0000 7f8599d61640 1 -- 172.21.15.92:0/2956155281 learned_addr learned my addr 172.21.15.92:0/2956155281 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:45.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.356+0000 7f8599560640 1 --2- 172.21.15.92:0/2956155281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8594101de0 0x7f8594198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:45.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.356+0000 7f8598d5f640 1 --2- 172.21.15.92:0/2956155281 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8594102790 0x7f8594198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:45.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.356+0000 7f8599d61640 1 -- 172.21.15.92:0/2956155281 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8594102790 msgr2=0x7f8594198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:45.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.356+0000 7f8599d61640 1 --2- 172.21.15.92:0/2956155281 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8594102790 0x7f8594198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.356+0000 7f8599d61640 1 -- 172.21.15.92:0/2956155281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8594101de0 msgr2=0x7f8594198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:45.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.356+0000 7f8599d61640 1 --2- 172.21.15.92:0/2956155281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8594101de0 0x7f8594198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.356+0000 7f8599d61640 1 -- 172.21.15.92:0/2956155281 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f859419d510 con 0x7f8594106f10 2024-09-19T08:57:45.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.356+0000 7f8599560640 1 --2- 172.21.15.92:0/2956155281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8594101de0 0x7f8594198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:57:45.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.356+0000 7f8598d5f640 1 --2- 172.21.15.92:0/2956155281 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8594102790 0x7f8594198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:57:45.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.356+0000 7f8599d61640 1 --2- 172.21.15.92:0/2956155281 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8594106f10 0x7f859419ce30 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f858c003f40 tx=0x7f858c003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:45.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.356+0000 7f858a7fc640 1 -- 172.21.15.92:0/2956155281 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858c0318c0 con 0x7f8594106f10 2024-09-19T08:57:45.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.356+0000 7f858a7fc640 1 -- 172.21.15.92:0/2956155281 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f858c004520 con 0x7f8594106f10 2024-09-19T08:57:45.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.356+0000 7f859b7c4640 1 -- 172.21.15.92:0/2956155281 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f859419d7a0 con 0x7f8594106f10 2024-09-19T08:57:45.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.356+0000 7f858a7fc640 1 -- 172.21.15.92:0/2956155281 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858c02fe10 con 0x7f8594106f10 2024-09-19T08:57:45.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.356+0000 7f859b7c4640 1 -- 172.21.15.92:0/2956155281 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85941a50e0 con 0x7f8594106f10 2024-09-19T08:57:45.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.358+0000 7f858a7fc640 1 -- 172.21.15.92:0/2956155281 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f858c02f610 con 0x7f8594106f10 2024-09-19T08:57:45.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.359+0000 7f858a7fc640 1 --2- 172.21.15.92:0/2956155281 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f85800a3240 0x7f85800a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:45.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.359+0000 7f859db9d740 1 Processor -- start 2024-09-19T08:57:45.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.359+0000 7f859db9d740 1 -- start start 2024-09-19T08:57:45.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.359+0000 7f8599560640 1 --2- 172.21.15.92:0/2956155281 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f85800a3240 0x7f85800a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:45.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.360+0000 7f858a7fc640 1 -- 172.21.15.92:0/2956155281 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f858c0f0ff0 con 0x7f8594106f10 2024-09-19T08:57:45.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.360+0000 7f859db9d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5b9405a40 0x55f5b9405e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:45.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.360+0000 7f859db9d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5b9406360 0x55f5b9414c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:45.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.360+0000 7f859db9d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5b9415150 0x55f5b9417540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:45.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.360+0000 7f859db9d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f5b936b280 con 0x55f5b9405a40 2024-09-19T08:57:45.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.360+0000 7f859db9d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f5b9312b10 con 0x55f5b9406360 2024-09-19T08:57:45.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.360+0000 7f859db9d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f5b9367240 con 0x55f5b9415150 2024-09-19T08:57:45.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.360+0000 7f8599560640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5b9405a40 0x55f5b9405e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:45.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.360+0000 7f8599560640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5b9405a40 0x55f5b9405e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59118/0 (socket says 172.21.15.92:59118) 2024-09-19T08:57:45.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.360+0000 7f8599560640 1 -- 172.21.15.92:0/4078932642 learned_addr learned my addr 172.21.15.92:0/4078932642 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:45.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.360+0000 7f8599d61640 1 --2- 172.21.15.92:0/4078932642 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5b9415150 0x55f5b9417540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:45.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.360+0000 7f8599560640 1 --2- 172.21.15.92:0/2956155281 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f85800a3240 0x7f85800a5700 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8590009ea0 tx=0x7f8590014660 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:45.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.360+0000 7f8599560640 1 -- 172.21.15.92:0/4078932642 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5b9415150 msgr2=0x55f5b9417540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:45.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.360+0000 7f8599560640 1 --2- 172.21.15.92:0/4078932642 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5b9415150 0x55f5b9417540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.360+0000 7f8599560640 1 -- 172.21.15.92:0/4078932642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5b9406360 msgr2=0x55f5b9414c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:45.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.360+0000 7f8599560640 1 --2- 172.21.15.92:0/4078932642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5b9406360 0x55f5b9414c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.360+0000 7f8599560640 1 -- 172.21.15.92:0/4078932642 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5b931f1f0 con 0x55f5b9405a40 2024-09-19T08:57:45.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.360+0000 7f8599560640 1 --2- 172.21.15.92:0/4078932642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5b9405a40 0x55f5b9405e20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8590014fa0 tx=0x7f859001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3db974673e2d5f08 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:45.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.360+0000 7f857f7fe640 1 -- 172.21.15.92:0/4078932642 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85900115c0 con 0x55f5b9405a40 2024-09-19T08:57:45.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.361+0000 7f857f7fe640 1 -- 172.21.15.92:0/4078932642 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8590011c40 con 0x55f5b9405a40 2024-09-19T08:57:45.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.361+0000 7f857f7fe640 1 -- 172.21.15.92:0/4078932642 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8590021d40 con 0x55f5b9405a40 2024-09-19T08:57:45.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.361+0000 7f859db9d740 1 -- 172.21.15.92:0/4078932642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5b9405a40 msgr2=0x55f5b9405e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:45.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.361+0000 7f859db9d740 1 --2- 172.21.15.92:0/4078932642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5b9405a40 0x55f5b9405e20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8590014fa0 tx=0x7f859001b000 comp rx=0 tx=0).stop 2024-09-19T08:57:45.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.361+0000 7f859db9d740 1 -- 172.21.15.92:0/4078932642 shutdown_connections 2024-09-19T08:57:45.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.361+0000 7f859db9d740 1 --2- 172.21.15.92:0/4078932642 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5b9415150 0x55f5b9417540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.361+0000 7f859db9d740 1 --2- 172.21.15.92:0/4078932642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5b9406360 0x55f5b9414c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.361+0000 7f859db9d740 1 --2- 172.21.15.92:0/4078932642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5b9405a40 0x55f5b9405e20 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.361+0000 7f859db9d740 1 -- 172.21.15.92:0/4078932642 >> 172.21.15.92:0/4078932642 conn(0x55f5b94020f0 msgr2=0x55f5b94024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:45.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.361+0000 7f859db9d740 1 -- 172.21.15.92:0/4078932642 shutdown_connections 2024-09-19T08:57:45.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.361+0000 7f859db9d740 1 -- 172.21.15.92:0/4078932642 wait complete. 2024-09-19T08:57:45.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.362+0000 7f859db9d740 1 -- start start 2024-09-19T08:57:45.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.362+0000 7f859db9d740 1 Processor -- start 2024-09-19T08:57:45.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.362+0000 7f859db9d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5b9405a40 0x55f5b94120d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:45.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.362+0000 7f859db9d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5b9406360 0x55f5b9412610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:45.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.362+0000 7f859db9d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5b9415150 0x55f5b9412b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:45.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.362+0000 7f859db9d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f5b9417cc0 con 0x55f5b9406360 2024-09-19T08:57:45.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.362+0000 7f859db9d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f5b9325f10 con 0x55f5b9405a40 2024-09-19T08:57:45.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.362+0000 7f859db9d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f5b9417e40 con 0x55f5b9415150 2024-09-19T08:57:45.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.362+0000 7f859db9d740 10 client.0 _ll_register_callbacks cb 0x55f5b92eea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:45.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.362+0000 7f8598d5f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5b9406360 0x55f5b9412610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:45.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.362+0000 7f8598d5f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5b9406360 0x55f5b9412610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59120/0 (socket says 172.21.15.92:59120) 2024-09-19T08:57:45.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.362+0000 7f8598d5f640 1 -- 172.21.15.92:0/2320491301 learned_addr learned my addr 172.21.15.92:0/2320491301 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:45.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.362+0000 7f8599560640 1 --2- 172.21.15.92:0/2320491301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5b9405a40 0x55f5b94120d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:45.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.362+0000 7f8599d61640 1 --2- 172.21.15.92:0/2320491301 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5b9415150 0x55f5b9412b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:45.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.363+0000 7f8598d5f640 1 -- 172.21.15.92:0/2320491301 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5b9415150 msgr2=0x55f5b9412b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:45.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.363+0000 7f8598d5f640 1 --2- 172.21.15.92:0/2320491301 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5b9415150 0x55f5b9412b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.363+0000 7f8598d5f640 1 -- 172.21.15.92:0/2320491301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5b9405a40 msgr2=0x55f5b94120d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:45.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.363+0000 7f8598d5f640 1 --2- 172.21.15.92:0/2320491301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5b9405a40 0x55f5b94120d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.363+0000 7f8598d5f640 1 -- 172.21.15.92:0/2320491301 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5b90dc6a0 con 0x55f5b9406360 2024-09-19T08:57:45.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.363+0000 7f8599d61640 1 --2- 172.21.15.92:0/2320491301 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5b9415150 0x55f5b9412b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:57:45.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.363+0000 7f8598d5f640 1 --2- 172.21.15.92:0/2320491301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5b9406360 0x55f5b9412610 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f858400c180 tx=0x7f858400c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd07cd55a2572bf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:45.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.363+0000 7f857cff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:57:45.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.363+0000 7f857cff9640 1 -- 172.21.15.92:0/2320491301 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8584015070 con 0x55f5b9406360 2024-09-19T08:57:45.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.363+0000 7f857cff9640 1 -- 172.21.15.92:0/2320491301 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8584011800 con 0x55f5b9406360 2024-09-19T08:57:45.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.363+0000 7f859db9d740 1 -- 172.21.15.92:0/2320491301 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8590011c40 con 0x55f5b9406360 2024-09-19T08:57:45.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.363+0000 7f857cff9640 1 -- 172.21.15.92:0/2320491301 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8584021050 con 0x55f5b9406360 2024-09-19T08:57:45.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.363+0000 7f859db9d740 10 client.15603 fetch_fsmap learned FSMap version 19 2024-09-19T08:57:45.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.363+0000 7f859db9d740 1 -- 172.21.15.92:0/2320491301 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f5b9423980 con 0x55f5b9406360 2024-09-19T08:57:45.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.363+0000 7f857cff9640 1 -- 172.21.15.92:0/2320491301 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8590011c40 con 0x55f5b9406360 2024-09-19T08:57:45.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.364+0000 7f857cff9640 1 -- 172.21.15.92:0/2320491301 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f8584019a50 con 0x55f5b9406360 2024-09-19T08:57:45.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.364+0000 7f859db9d740 10 client.15603 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:57:45.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.364+0000 7f859db9d740 10 client.15603 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:57:45.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.364+0000 7f859db9d740 20 client.15603 populate_metadata read hostname 'smithi092' 2024-09-19T08:57:45.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.364+0000 7f859db9d740 1 --2- 172.21.15.92:0/2320491301 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f5b9424e50 0x55f5b9427270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:45.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.364+0000 7f859db9d740 4 client.15603 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:57:45.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.364+0000 7f859db9d740 1 -- 172.21.15.92:0/2320491301 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f5b93787f0 con 0x55f5b9424e50 2024-09-19T08:57:45.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.364+0000 7f8599560640 1 --2- 172.21.15.92:0/2320491301 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f5b9424e50 0x55f5b9427270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:45.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.364+0000 7f8599560640 1 --2- 172.21.15.92:0/2320491301 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f5b9424e50 0x55f5b9427270 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e97ab8fa4a2527e4 server_cookie=8f44fff438ee3708 in_seq=0 out_seq=0 2024-09-19T08:57:45.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.364+0000 7f857cff9640 10 client.15603 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:45.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.365+0000 7f857cff9640 1 -- 172.21.15.92:0/2320491301 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f5b93787f0 con 0x55f5b9424e50 2024-09-19T08:57:45.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.365+0000 7f857cff9640 10 client.15603 handle_command_reply: tid=0 2024-09-19T08:57:45.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.365+0000 7f859db9d740 1 client.15603 shutdown 2024-09-19T08:57:45.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.365+0000 7f859db9d740 1 -- 172.21.15.92:0/2320491301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5b9406360 msgr2=0x55f5b9412610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:45.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.365+0000 7f859db9d740 1 --2- 172.21.15.92:0/2320491301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5b9406360 0x55f5b9412610 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f858400c180 tx=0x7f858400c640 comp rx=0 tx=0).stop 2024-09-19T08:57:45.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.365+0000 7f859db9d740 1 -- 172.21.15.92:0/2320491301 shutdown_connections 2024-09-19T08:57:45.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.365+0000 7f859db9d740 1 --2- 172.21.15.92:0/2320491301 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f5b9424e50 0x55f5b9427270 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.365+0000 7f859db9d740 1 --2- 172.21.15.92:0/2320491301 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5b9415150 0x55f5b9412b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.365+0000 7f859db9d740 1 --2- 172.21.15.92:0/2320491301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5b9406360 0x55f5b9412610 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.365+0000 7f859db9d740 1 --2- 172.21.15.92:0/2320491301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5b9405a40 0x55f5b94120d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.365+0000 7f859db9d740 1 -- 172.21.15.92:0/2320491301 >> 172.21.15.92:0/2320491301 conn(0x55f5b94020f0 msgr2=0x55f5b9407e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:45.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.365+0000 7f857cff9640 0 client.15603 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:45.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.365+0000 7f859db9d740 1 -- 172.21.15.92:0/2320491301 shutdown_connections 2024-09-19T08:57:45.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.365+0000 7f859db9d740 1 -- 172.21.15.92:0/2320491301 wait complete. 2024-09-19T08:57:45.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.366+0000 7f859db9d740 20 client.15603 trim_cache size 0 max 16384 2024-09-19T08:57:45.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.382+0000 7f859db9d740 1 Processor -- start 2024-09-19T08:57:45.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.382+0000 7f859db9d740 1 -- start start 2024-09-19T08:57:45.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.382+0000 7f859db9d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5b9405a40 0x55f5b94129a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:45.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.382+0000 7f859db9d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5b9406360 0x55f5b942cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:45.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.383+0000 7f859db9d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5b9415150 0x55f5b942d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:45.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.383+0000 7f859db9d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f85941a9410 con 0x55f5b9415150 2024-09-19T08:57:45.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.383+0000 7f859db9d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f85941abcb0 con 0x55f5b9405a40 2024-09-19T08:57:45.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.383+0000 7f859db9d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f85941a9aa0 con 0x55f5b9406360 2024-09-19T08:57:45.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.383+0000 7f8599d61640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5b9415150 0x55f5b942d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:45.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.383+0000 7f8599d61640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5b9415150 0x55f5b942d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59122/0 (socket says 172.21.15.92:59122) 2024-09-19T08:57:45.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.383+0000 7f8599d61640 1 -- 172.21.15.92:0/4028810027 learned_addr learned my addr 172.21.15.92:0/4028810027 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:45.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.383+0000 7f8599560640 1 --2- 172.21.15.92:0/4028810027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5b9405a40 0x55f5b94129a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:45.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.383+0000 7f8598d5f640 1 --2- 172.21.15.92:0/4028810027 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5b9406360 0x55f5b942cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:45.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.383+0000 7f8599d61640 1 -- 172.21.15.92:0/4028810027 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5b9406360 msgr2=0x55f5b942cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:45.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.383+0000 7f8599d61640 1 --2- 172.21.15.92:0/4028810027 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5b9406360 0x55f5b942cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.383+0000 7f8599d61640 1 -- 172.21.15.92:0/4028810027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5b9405a40 msgr2=0x55f5b94129a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:45.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.383+0000 7f8599d61640 1 --2- 172.21.15.92:0/4028810027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5b9405a40 0x55f5b94129a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.383+0000 7f8599d61640 1 -- 172.21.15.92:0/4028810027 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5b9417540 con 0x55f5b9415150 2024-09-19T08:57:45.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.383+0000 7f8599d61640 1 --2- 172.21.15.92:0/4028810027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5b9415150 0x55f5b942d080 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f858c0bd310 tx=0x7f858c0bd030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a44a23556d856b47 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:45.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.383+0000 7f857effd640 1 -- 172.21.15.92:0/4028810027 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858c0c6280 con 0x55f5b9415150 2024-09-19T08:57:45.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.383+0000 7f857effd640 1 -- 172.21.15.92:0/4028810027 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f858c036040 con 0x55f5b9415150 2024-09-19T08:57:45.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.383+0000 7f857effd640 1 -- 172.21.15.92:0/4028810027 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858c0047d0 con 0x55f5b9415150 2024-09-19T08:57:45.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.384+0000 7f859db9d740 1 -- 172.21.15.92:0/4028810027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5b9415150 msgr2=0x55f5b942d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:45.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.384+0000 7f859db9d740 1 --2- 172.21.15.92:0/4028810027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5b9415150 0x55f5b942d080 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f858c0bd310 tx=0x7f858c0bd030 comp rx=0 tx=0).stop 2024-09-19T08:57:45.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.384+0000 7f859db9d740 1 -- 172.21.15.92:0/4028810027 shutdown_connections 2024-09-19T08:57:45.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.384+0000 7f859db9d740 1 --2- 172.21.15.92:0/4028810027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5b9415150 0x55f5b942d080 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.384+0000 7f859db9d740 1 --2- 172.21.15.92:0/4028810027 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5b9406360 0x55f5b942cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.384+0000 7f859db9d740 1 --2- 172.21.15.92:0/4028810027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5b9405a40 0x55f5b94129a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.384+0000 7f859db9d740 1 -- 172.21.15.92:0/4028810027 >> 172.21.15.92:0/4028810027 conn(0x55f5b94020f0 msgr2=0x55f5b9414040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:45.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.384+0000 7f859db9d740 1 -- 172.21.15.92:0/4028810027 shutdown_connections 2024-09-19T08:57:45.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.384+0000 7f859db9d740 1 -- 172.21.15.92:0/4028810027 wait complete. 2024-09-19T08:57:45.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.384+0000 7f859db9d740 1 -- start start 2024-09-19T08:57:45.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.384+0000 7f859db9d740 1 Processor -- start 2024-09-19T08:57:45.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.385+0000 7f859db9d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5b9405a40 0x55f5b9419700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:45.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.385+0000 7f859db9d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5b9406360 0x55f5b9419c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:45.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.385+0000 7f859db9d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5b9415150 0x55f5b9488b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:45.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.385+0000 7f859db9d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f85941aa170 con 0x55f5b9415150 2024-09-19T08:57:45.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.385+0000 7f859db9d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f85941ab5e0 con 0x55f5b9405a40 2024-09-19T08:57:45.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.385+0000 7f859db9d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f85941aa840 con 0x55f5b9406360 2024-09-19T08:57:45.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.385+0000 7f859db9d740 10 client.0 _ll_register_callbacks cb 0x7f858400a0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:45.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.385+0000 7f8599d61640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5b9415150 0x55f5b9488b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:45.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.385+0000 7f8599d61640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5b9415150 0x55f5b9488b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59130/0 (socket says 172.21.15.92:59130) 2024-09-19T08:57:45.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.385+0000 7f8599d61640 1 -- 172.21.15.92:0/3202959472 learned_addr learned my addr 172.21.15.92:0/3202959472 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:45.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.385+0000 7f8598d5f640 1 --2- 172.21.15.92:0/3202959472 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5b9406360 0x55f5b9419c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:45.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.385+0000 7f8599d61640 1 -- 172.21.15.92:0/3202959472 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5b9406360 msgr2=0x55f5b9419c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:45.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.385+0000 7f8599d61640 1 --2- 172.21.15.92:0/3202959472 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5b9406360 0x55f5b9419c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.385+0000 7f8599560640 1 --2- 172.21.15.92:0/3202959472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5b9405a40 0x55f5b9419700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:45.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.385+0000 7f8599d61640 1 -- 172.21.15.92:0/3202959472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5b9405a40 msgr2=0x55f5b9419700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:45.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.385+0000 7f8599d61640 1 --2- 172.21.15.92:0/3202959472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5b9405a40 0x55f5b9419700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.385+0000 7f8599d61640 1 -- 172.21.15.92:0/3202959472 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5b94891c0 con 0x55f5b9415150 2024-09-19T08:57:45.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.385+0000 7f8599d61640 1 --2- 172.21.15.92:0/3202959472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5b9415150 0x55f5b9488b50 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f858c0049d0 tx=0x7f858c0bb7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0146b84d8efebd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:45.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.385+0000 7f857cff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:57:45.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.385+0000 7f857cff9640 1 -- 172.21.15.92:0/3202959472 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858c0046d0 con 0x55f5b9415150 2024-09-19T08:57:45.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.385+0000 7f857cff9640 1 -- 172.21.15.92:0/3202959472 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f858c0b9c80 con 0x55f5b9415150 2024-09-19T08:57:45.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.385+0000 7f859db9d740 1 -- 172.21.15.92:0/3202959472 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f858c036040 con 0x55f5b9415150 2024-09-19T08:57:45.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.386+0000 7f857cff9640 1 -- 172.21.15.92:0/3202959472 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f858c0bd870 con 0x55f5b9415150 2024-09-19T08:57:45.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.386+0000 7f859db9d740 10 client.15609 fetch_fsmap learned FSMap version 19 2024-09-19T08:57:45.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.386+0000 7f859db9d740 1 -- 172.21.15.92:0/3202959472 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f5b9490580 con 0x55f5b9415150 2024-09-19T08:57:45.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.386+0000 7f857cff9640 1 -- 172.21.15.92:0/3202959472 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f858c036040 con 0x55f5b9415150 2024-09-19T08:57:45.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.386+0000 7f857cff9640 1 -- 172.21.15.92:0/3202959472 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f858c0db720 con 0x55f5b9415150 2024-09-19T08:57:45.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.386+0000 7f859db9d740 10 client.15609 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:57:45.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.386+0000 7f859db9d740 10 client.15609 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:57:45.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.386+0000 7f859db9d740 20 client.15609 populate_metadata read hostname 'smithi092' 2024-09-19T08:57:45.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.386+0000 7f859db9d740 1 --2- 172.21.15.92:0/3202959472 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f5b9490be0 0x55f5b9492fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:45.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.386+0000 7f859db9d740 4 client.15609 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:57:45.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.386+0000 7f859db9d740 1 -- 172.21.15.92:0/3202959472 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f5b9372d00 con 0x55f5b9490be0 2024-09-19T08:57:45.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.386+0000 7f8599560640 1 --2- 172.21.15.92:0/3202959472 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f5b9490be0 0x55f5b9492fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:45.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.387+0000 7f857cff9640 10 client.15609 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:45.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.387+0000 7f8599560640 1 --2- 172.21.15.92:0/3202959472 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f5b9490be0 0x55f5b9492fd0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c620e0ee18b22b2 server_cookie=3a518e30975a002 in_seq=0 out_seq=0 2024-09-19T08:57:45.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.388+0000 7f857cff9640 1 -- 172.21.15.92:0/3202959472 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f5b9372d00 con 0x55f5b9490be0 2024-09-19T08:57:45.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.388+0000 7f857cff9640 10 client.15609 handle_command_reply: tid=0 2024-09-19T08:57:45.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.388+0000 7f859db9d740 1 client.15609 shutdown 2024-09-19T08:57:45.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.388+0000 7f859db9d740 1 -- 172.21.15.92:0/3202959472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5b9415150 msgr2=0x55f5b9488b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:45.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.388+0000 7f859db9d740 1 --2- 172.21.15.92:0/3202959472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5b9415150 0x55f5b9488b50 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f858c0049d0 tx=0x7f858c0bb7f0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.388+0000 7f859db9d740 1 -- 172.21.15.92:0/3202959472 shutdown_connections 2024-09-19T08:57:45.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.388+0000 7f859db9d740 1 --2- 172.21.15.92:0/3202959472 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f5b9490be0 0x55f5b9492fd0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.388+0000 7f859db9d740 1 --2- 172.21.15.92:0/3202959472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5b9415150 0x55f5b9488b50 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.388+0000 7f859db9d740 1 --2- 172.21.15.92:0/3202959472 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5b9406360 0x55f5b9419c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.388+0000 7f859db9d740 1 --2- 172.21.15.92:0/3202959472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5b9405a40 0x55f5b9419700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.388+0000 7f859db9d740 1 -- 172.21.15.92:0/3202959472 >> 172.21.15.92:0/3202959472 conn(0x55f5b94020f0 msgr2=0x55f5b9400a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:45.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.388+0000 7f857cff9640 0 client.15609 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:45.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.388+0000 7f859db9d740 1 -- 172.21.15.92:0/3202959472 shutdown_connections 2024-09-19T08:57:45.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.388+0000 7f859db9d740 1 -- 172.21.15.92:0/3202959472 wait complete. 2024-09-19T08:57:45.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.388+0000 7f859db9d740 20 client.15609 trim_cache size 0 max 16384 2024-09-19T08:57:45.393 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T08:57:45.393 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-19T08:57:45.393 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "4eaf2b47-8ae6-4f0f-88b6-917120cb6e12", 2024-09-19T08:57:45.394 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-19T08:57:45.394 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T08:57:45.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.389+0000 7f859b7c4640 1 -- 172.21.15.92:0/2956155281 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f85800a3240 msgr2=0x7f85800a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:45.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.389+0000 7f859b7c4640 1 --2- 172.21.15.92:0/2956155281 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f85800a3240 0x7f85800a5700 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8590009ea0 tx=0x7f8590014660 comp rx=0 tx=0).stop 2024-09-19T08:57:45.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.389+0000 7f859b7c4640 1 -- 172.21.15.92:0/2956155281 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8594106f10 msgr2=0x7f859419ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:45.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.389+0000 7f859b7c4640 1 --2- 172.21.15.92:0/2956155281 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8594106f10 0x7f859419ce30 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f858c003f40 tx=0x7f858c003f70 comp rx=0 tx=0).stop 2024-09-19T08:57:45.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.389+0000 7f859b7c4640 1 -- 172.21.15.92:0/2956155281 shutdown_connections 2024-09-19T08:57:45.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.389+0000 7f859b7c4640 1 --2- 172.21.15.92:0/2956155281 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f85800a3240 0x7f85800a5700 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.389+0000 7f859b7c4640 1 --2- 172.21.15.92:0/2956155281 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8594106f10 0x7f859419ce30 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.389+0000 7f859b7c4640 1 --2- 172.21.15.92:0/2956155281 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8594102790 0x7f8594198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.389+0000 7f859b7c4640 1 --2- 172.21.15.92:0/2956155281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8594101de0 0x7f8594198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.389+0000 7f859b7c4640 1 -- 172.21.15.92:0/2956155281 >> 172.21.15.92:0/2956155281 conn(0x7f85940fd8c0 msgr2=0x7f85940fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:45.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.389+0000 7f859b7c4640 1 -- 172.21.15.92:0/2956155281 shutdown_connections 2024-09-19T08:57:45.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:45.389+0000 7f859b7c4640 1 -- 172.21.15.92:0/2956155281 wait complete. 2024-09-19T08:57:45.798 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 60.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T08:57:46.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:45 smithi092 ceph-mon[31407]: scrub queued for path: / 2024-09-19T08:57:46.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:45 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T08:57:46.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:45 smithi092 ceph-mon[31407]: scrub summary: active paths [/] 2024-09-19T08:57:46.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:45 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T08:57:46.031 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:57:46.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:45 smithi167 ceph-mon[35359]: scrub queued for path: / 2024-09-19T08:57:46.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:45 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T08:57:46.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:45 smithi167 ceph-mon[35359]: scrub summary: active paths [/] 2024-09-19T08:57:46.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:45 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T08:57:46.113 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:57:46.123 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:45 smithi190 ceph-mon[35358]: scrub queued for path: / 2024-09-19T08:57:46.123 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:45 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T08:57:46.123 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:45 smithi190 ceph-mon[35358]: scrub summary: active paths [/] 2024-09-19T08:57:46.123 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:45 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T08:57:46.294 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:57:46.690 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:46 smithi092 ceph-mon[31407]: pgmap v369: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 445 KiB/s wr, 102 op/s 2024-09-19T08:57:47.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.052+0000 7ff0b2f83640 1 -- 172.21.15.92:0/3208692821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0ac100a80 msgr2=0x7ff0ac100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:47.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.052+0000 7ff0b2f83640 1 --2- 172.21.15.92:0/3208692821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0ac100a80 0x7ff0ac100ee0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff09c009930 tx=0x7ff09c02a420 comp rx=0 tx=0).stop 2024-09-19T08:57:47.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.052+0000 7ff0b2f83640 1 -- 172.21.15.92:0/3208692821 shutdown_connections 2024-09-19T08:57:47.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.052+0000 7ff0b2f83640 1 --2- 172.21.15.92:0/3208692821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0ac101420 0x7ff0ac10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:47.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.052+0000 7ff0b2f83640 1 --2- 172.21.15.92:0/3208692821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0ac100a80 0x7ff0ac100ee0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:47.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.052+0000 7ff0b2f83640 1 --2- 172.21.15.92:0/3208692821 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0ac106a80 0x7ff0ac106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:47.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.052+0000 7ff0b2f83640 1 -- 172.21.15.92:0/3208692821 >> 172.21.15.92:0/3208692821 conn(0x7ff0ac0fc7a0 msgr2=0x7ff0ac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:47.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.052+0000 7ff0b2f83640 1 -- 172.21.15.92:0/3208692821 shutdown_connections 2024-09-19T08:57:47.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.052+0000 7ff0b2f83640 1 -- 172.21.15.92:0/3208692821 wait complete. 2024-09-19T08:57:47.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.052+0000 7ff0b2f83640 1 Processor -- start 2024-09-19T08:57:47.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.052+0000 7ff0b2f83640 1 -- start start 2024-09-19T08:57:47.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.053+0000 7ff0b2f83640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0ac100a80 0x7ff0ac1985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:47.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.053+0000 7ff0b2f83640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0ac101420 0x7ff0ac198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:47.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.053+0000 7ff0b2f83640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0ac106a80 0x7ff0ac19ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:47.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.053+0000 7ff0b2f83640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff0ac110f20 con 0x7ff0ac100a80 2024-09-19T08:57:47.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.053+0000 7ff0b2f83640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff0ac110da0 con 0x7ff0ac106a80 2024-09-19T08:57:47.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.053+0000 7ff0b2f83640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff0ac1110a0 con 0x7ff0ac101420 2024-09-19T08:57:47.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.053+0000 7ff0b0d1f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0ac100a80 0x7ff0ac1985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:47.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.053+0000 7ff0b0d1f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0ac100a80 0x7ff0ac1985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59150/0 (socket says 172.21.15.92:59150) 2024-09-19T08:57:47.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.053+0000 7ff0b0d1f640 1 -- 172.21.15.92:0/602459054 learned_addr learned my addr 172.21.15.92:0/602459054 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:47.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.053+0000 7ff0a3fff640 1 --2- 172.21.15.92:0/602459054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0ac101420 0x7ff0ac198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:47.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.053+0000 7ff0b0d1f640 1 -- 172.21.15.92:0/602459054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0ac101420 msgr2=0x7ff0ac198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:47.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.053+0000 7ff0b0d1f640 1 --2- 172.21.15.92:0/602459054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0ac101420 0x7ff0ac198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:47.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.053+0000 7ff0b1520640 1 --2- 172.21.15.92:0/602459054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0ac106a80 0x7ff0ac19ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:47.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.053+0000 7ff0b0d1f640 1 -- 172.21.15.92:0/602459054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0ac106a80 msgr2=0x7ff0ac19ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:47.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.053+0000 7ff0b0d1f640 1 --2- 172.21.15.92:0/602459054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0ac106a80 0x7ff0ac19ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:47.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.053+0000 7ff0b0d1f640 1 -- 172.21.15.92:0/602459054 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0ac19d560 con 0x7ff0ac100a80 2024-09-19T08:57:47.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.053+0000 7ff0b0d1f640 1 --2- 172.21.15.92:0/602459054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0ac100a80 0x7ff0ac1985b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff0a800b4a0 tx=0x7ff0a800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:47.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.053+0000 7ff0a1ffb640 1 -- 172.21.15.92:0/602459054 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a8014070 con 0x7ff0ac100a80 2024-09-19T08:57:47.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.053+0000 7ff0a1ffb640 1 -- 172.21.15.92:0/602459054 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0a8010af0 con 0x7ff0ac100a80 2024-09-19T08:57:47.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.054+0000 7ff0b2f83640 1 -- 172.21.15.92:0/602459054 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0ac19d850 con 0x7ff0ac100a80 2024-09-19T08:57:47.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.054+0000 7ff0a1ffb640 1 -- 172.21.15.92:0/602459054 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a8017d10 con 0x7ff0ac100a80 2024-09-19T08:57:47.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.054+0000 7ff0b2f83640 1 -- 172.21.15.92:0/602459054 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0ac1a5130 con 0x7ff0ac100a80 2024-09-19T08:57:47.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.055+0000 7ff0b2f83640 1 -- 172.21.15.92:0/602459054 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0ac100f60 con 0x7ff0ac100a80 2024-09-19T08:57:47.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.056+0000 7ff0a1ffb640 1 -- 172.21.15.92:0/602459054 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff0a8017070 con 0x7ff0ac100a80 2024-09-19T08:57:47.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.056+0000 7ff0a1ffb640 1 --2- 172.21.15.92:0/602459054 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff0940a32c0 0x7ff0940a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:47.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.056+0000 7ff0a3fff640 1 --2- 172.21.15.92:0/602459054 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff0940a32c0 0x7ff0940a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:47.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.056+0000 7ff0a1ffb640 1 -- 172.21.15.92:0/602459054 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff0a80ced20 con 0x7ff0ac100a80 2024-09-19T08:57:47.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.057+0000 7ff0a3fff640 1 --2- 172.21.15.92:0/602459054 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff0940a32c0 0x7ff0940a5780 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff09c000c00 tx=0x7ff09c031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:47.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.062+0000 7ff0a1ffb640 1 -- 172.21.15.92:0/602459054 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff0a809ba40 con 0x7ff0ac100a80 2024-09-19T08:57:47.100 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:57:47.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:46 smithi167 ceph-mon[35359]: pgmap v369: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 445 KiB/s wr, 102 op/s 2024-09-19T08:57:47.123 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:46 smithi190 ceph-mon[35358]: pgmap v369: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 445 KiB/s wr, 102 op/s 2024-09-19T08:57:47.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.281+0000 7ff0b2f83640 1 -- 172.21.15.92:0/602459054 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0ac10a080 con 0x7ff0ac100a80 2024-09-19T08:57:47.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.281+0000 7ff0a1ffb640 1 -- 172.21.15.92:0/602459054 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7ff0a809b340 con 0x7ff0ac100a80 2024-09-19T08:57:47.282 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:57:47.282 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T08:57:47.282 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T08:57:47.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.284+0000 7ff0b2f83640 1 -- 172.21.15.92:0/602459054 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff0940a32c0 msgr2=0x7ff0940a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:47.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.284+0000 7ff0b2f83640 1 --2- 172.21.15.92:0/602459054 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff0940a32c0 0x7ff0940a5780 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff09c000c00 tx=0x7ff09c031490 comp rx=0 tx=0).stop 2024-09-19T08:57:47.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.284+0000 7ff0b2f83640 1 -- 172.21.15.92:0/602459054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0ac100a80 msgr2=0x7ff0ac1985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:47.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.284+0000 7ff0b2f83640 1 --2- 172.21.15.92:0/602459054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0ac100a80 0x7ff0ac1985b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff0a800b4a0 tx=0x7ff0a800b960 comp rx=0 tx=0).stop 2024-09-19T08:57:47.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.284+0000 7ff0b2f83640 1 -- 172.21.15.92:0/602459054 shutdown_connections 2024-09-19T08:57:47.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.284+0000 7ff0b2f83640 1 --2- 172.21.15.92:0/602459054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0ac106a80 0x7ff0ac19ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:47.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.284+0000 7ff0b2f83640 1 --2- 172.21.15.92:0/602459054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0ac101420 0x7ff0ac198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:47.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.284+0000 7ff0b2f83640 1 --2- 172.21.15.92:0/602459054 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff0940a32c0 0x7ff0940a5780 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:47.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.284+0000 7ff0b2f83640 1 --2- 172.21.15.92:0/602459054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0ac100a80 0x7ff0ac1985b0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:47.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.284+0000 7ff0b2f83640 1 -- 172.21.15.92:0/602459054 >> 172.21.15.92:0/602459054 conn(0x7ff0ac0fc7a0 msgr2=0x7ff0ac06aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:47.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.284+0000 7ff0b2f83640 1 -- 172.21.15.92:0/602459054 shutdown_connections 2024-09-19T08:57:47.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:47.284+0000 7ff0b2f83640 1 -- 172.21.15.92:0/602459054 wait complete. 2024-09-19T08:57:48.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:47 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/602459054' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:57:48.074 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id 5bb65959 --release --await' 2024-09-19T08:57:48.074 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id 5bb65959 --release --await 2024-09-19T08:57:48.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:47 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/602459054' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:57:48.123 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:47 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/602459054' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:57:48.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.320+0000 7f2d35038640 1 -- 172.21.15.92:0/2228716834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d30101410 msgr2=0x7f2d3010d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:48.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.320+0000 7f2d35038640 1 --2- 172.21.15.92:0/2228716834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d30101410 0x7f2d3010d940 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2d28009cd0 tx=0x7f2d2802a8e0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.320+0000 7f2d35038640 1 -- 172.21.15.92:0/2228716834 shutdown_connections 2024-09-19T08:57:48.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.320+0000 7f2d35038640 1 --2- 172.21.15.92:0/2228716834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d30101410 0x7f2d3010d940 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.320+0000 7f2d35038640 1 --2- 172.21.15.92:0/2228716834 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2d30100a70 0x7f2d30100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.320+0000 7f2d35038640 1 --2- 172.21.15.92:0/2228716834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d30106a70 0x7f2d30106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.320+0000 7f2d35038640 1 -- 172.21.15.92:0/2228716834 >> 172.21.15.92:0/2228716834 conn(0x7f2d300fc790 msgr2=0x7f2d300febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:48.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.320+0000 7f2d35038640 1 -- 172.21.15.92:0/2228716834 shutdown_connections 2024-09-19T08:57:48.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.320+0000 7f2d35038640 1 -- 172.21.15.92:0/2228716834 wait complete. 2024-09-19T08:57:48.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.321+0000 7f2d35038640 1 Processor -- start 2024-09-19T08:57:48.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.321+0000 7f2d35038640 1 -- start start 2024-09-19T08:57:48.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.321+0000 7f2d35038640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2d30100a70 0x7f2d300739f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:48.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.321+0000 7f2d35038640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d30101410 0x7f2d3006ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:48.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.321+0000 7f2d35038640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d30106a70 0x7f2d3006cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:48.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.321+0000 7f2d35038640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2d30110f60 con 0x7f2d30106a70 2024-09-19T08:57:48.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.321+0000 7f2d35038640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2d30110de0 con 0x7f2d30101410 2024-09-19T08:57:48.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.321+0000 7f2d35038640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2d301110e0 con 0x7f2d30100a70 2024-09-19T08:57:48.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.321+0000 7f2d2f59e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d30106a70 0x7f2d3006cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:48.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.321+0000 7f2d2f59e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d30106a70 0x7f2d3006cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59160/0 (socket says 172.21.15.92:59160) 2024-09-19T08:57:48.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.321+0000 7f2d2f59e640 1 -- 172.21.15.92:0/363458224 learned_addr learned my addr 172.21.15.92:0/363458224 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:48.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.321+0000 7f2d2e59c640 1 --2- 172.21.15.92:0/363458224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d30101410 0x7f2d3006ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:48.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.321+0000 7f2d2ed9d640 1 --2- 172.21.15.92:0/363458224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2d30100a70 0x7f2d300739f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:48.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.321+0000 7f2d2f59e640 1 -- 172.21.15.92:0/363458224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2d30100a70 msgr2=0x7f2d300739f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:48.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.321+0000 7f2d2f59e640 1 --2- 172.21.15.92:0/363458224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2d30100a70 0x7f2d300739f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.322+0000 7f2d2f59e640 1 -- 172.21.15.92:0/363458224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d30101410 msgr2=0x7f2d3006ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:48.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.322+0000 7f2d2f59e640 1 --2- 172.21.15.92:0/363458224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d30101410 0x7f2d3006ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.322+0000 7f2d2f59e640 1 -- 172.21.15.92:0/363458224 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d3006d580 con 0x7f2d30106a70 2024-09-19T08:57:48.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.322+0000 7f2d2f59e640 1 --2- 172.21.15.92:0/363458224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d30106a70 0x7f2d3006cfc0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2d28003ba0 tx=0x7f2d28003bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:48.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.322+0000 7f2d17fff640 1 -- 172.21.15.92:0/363458224 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d28004240 con 0x7f2d30106a70 2024-09-19T08:57:48.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.322+0000 7f2d35038640 1 -- 172.21.15.92:0/363458224 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d3006d810 con 0x7f2d30106a70 2024-09-19T08:57:48.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.322+0000 7f2d17fff640 1 -- 172.21.15.92:0/363458224 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d280305a0 con 0x7f2d30106a70 2024-09-19T08:57:48.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.322+0000 7f2d17fff640 1 -- 172.21.15.92:0/363458224 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2803b660 con 0x7f2d30106a70 2024-09-19T08:57:48.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.322+0000 7f2d35038640 1 -- 172.21.15.92:0/363458224 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d30071830 con 0x7f2d30106a70 2024-09-19T08:57:48.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.325+0000 7f2d37411740 1 Processor -- start 2024-09-19T08:57:48.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.325+0000 7f2d17fff640 1 -- 172.21.15.92:0/363458224 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2d2803b800 con 0x7f2d30106a70 2024-09-19T08:57:48.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.325+0000 7f2d37411740 1 -- start start 2024-09-19T08:57:48.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.325+0000 7f2d37411740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbea410340 0x55dbea410720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:48.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.325+0000 7f2d37411740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbea410c60 0x55dbea41d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:48.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.325+0000 7f2d37411740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dbea41d890 0x55dbea41fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:48.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.325+0000 7f2d37411740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55dbea3762e0 con 0x55dbea410340 2024-09-19T08:57:48.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.325+0000 7f2d37411740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55dbea31dce0 con 0x55dbea410c60 2024-09-19T08:57:48.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.325+0000 7f2d37411740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55dbea3722a0 con 0x55dbea41d890 2024-09-19T08:57:48.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.325+0000 7f2d2e59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbea410340 0x55dbea410720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:48.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.325+0000 7f2d2e59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbea410340 0x55dbea410720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59174/0 (socket says 172.21.15.92:59174) 2024-09-19T08:57:48.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.325+0000 7f2d2e59c640 1 -- 172.21.15.92:0/3892238134 learned_addr learned my addr 172.21.15.92:0/3892238134 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:48.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.326+0000 7f2d2ed9d640 1 --2- 172.21.15.92:0/3892238134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbea410c60 0x55dbea41d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:48.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.326+0000 7f2d2e59c640 1 -- 172.21.15.92:0/3892238134 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dbea41d890 msgr2=0x55dbea41fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:48.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.326+0000 7f2d2e59c640 1 --2- 172.21.15.92:0/3892238134 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dbea41d890 0x55dbea41fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.326+0000 7f2d2e59c640 1 -- 172.21.15.92:0/3892238134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbea410c60 msgr2=0x55dbea41d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:48.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.326+0000 7f2d2e59c640 1 --2- 172.21.15.92:0/3892238134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbea410c60 0x55dbea41d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.326+0000 7f2d2e59c640 1 -- 172.21.15.92:0/3892238134 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbea302440 con 0x55dbea410340 2024-09-19T08:57:48.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.326+0000 7f2d2ed9d640 1 --2- 172.21.15.92:0/3892238134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbea410c60 0x55dbea41d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:57:48.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.326+0000 7f2d17fff640 1 --2- 172.21.15.92:0/363458224 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2d180a3240 0x7f2d180a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:48.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.326+0000 7f2d17fff640 1 -- 172.21.15.92:0/363458224 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2d2802e030 con 0x7f2d30106a70 2024-09-19T08:57:48.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.326+0000 7f2d2ed9d640 1 --2- 172.21.15.92:0/363458224 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2d180a3240 0x7f2d180a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:48.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.326+0000 7f2d2e59c640 1 --2- 172.21.15.92:0/3892238134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbea410340 0x55dbea410720 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f2d2400b9f0 tx=0x7f2d2400beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a731f177e302abbb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:48.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.326+0000 7f2d157fa640 1 -- 172.21.15.92:0/3892238134 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2400fc90 con 0x55dbea410340 2024-09-19T08:57:48.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.326+0000 7f2d157fa640 1 -- 172.21.15.92:0/3892238134 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d24010040 con 0x55dbea410340 2024-09-19T08:57:48.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.326+0000 7f2d157fa640 1 -- 172.21.15.92:0/3892238134 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d24013750 con 0x55dbea410340 2024-09-19T08:57:48.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.327+0000 7f2d37411740 1 -- 172.21.15.92:0/3892238134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbea410340 msgr2=0x55dbea410720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:48.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.327+0000 7f2d2ed9d640 1 --2- 172.21.15.92:0/363458224 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2d180a3240 0x7f2d180a5700 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2d20006fd0 tx=0x7f2d20008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:48.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.327+0000 7f2d37411740 1 --2- 172.21.15.92:0/3892238134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbea410340 0x55dbea410720 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f2d2400b9f0 tx=0x7f2d2400beb0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.327+0000 7f2d37411740 1 -- 172.21.15.92:0/3892238134 shutdown_connections 2024-09-19T08:57:48.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.327+0000 7f2d37411740 1 --2- 172.21.15.92:0/3892238134 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dbea41d890 0x55dbea41fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.327+0000 7f2d37411740 1 --2- 172.21.15.92:0/3892238134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbea410c60 0x55dbea41d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.327+0000 7f2d37411740 1 --2- 172.21.15.92:0/3892238134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbea410340 0x55dbea410720 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.327+0000 7f2d37411740 1 -- 172.21.15.92:0/3892238134 >> 172.21.15.92:0/3892238134 conn(0x55dbea40ca30 msgr2=0x55dbea40ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:48.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.327+0000 7f2d37411740 1 -- 172.21.15.92:0/3892238134 shutdown_connections 2024-09-19T08:57:48.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.327+0000 7f2d37411740 1 -- 172.21.15.92:0/3892238134 wait complete. 2024-09-19T08:57:48.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.327+0000 7f2d37411740 1 -- start start 2024-09-19T08:57:48.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.327+0000 7f2d37411740 1 Processor -- start 2024-09-19T08:57:48.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.327+0000 7f2d37411740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbea410340 0x55dbea41d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:48.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.327+0000 7f2d37411740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dbea410c60 0x55dbea41a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:48.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.327+0000 7f2d37411740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbea41d890 0x55dbea41a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:48.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.327+0000 7f2d37411740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55dbea420460 con 0x55dbea410340 2024-09-19T08:57:48.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.327+0000 7f2d37411740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55dbea331050 con 0x55dbea41d890 2024-09-19T08:57:48.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.327+0000 7f2d37411740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55dbea4205e0 con 0x55dbea410c60 2024-09-19T08:57:48.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.328+0000 7f2d37411740 10 client.0 _ll_register_callbacks cb 0x55dbea371160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:48.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.328+0000 7f2d2ed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbea410340 0x55dbea41d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:48.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.328+0000 7f2d2ed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbea410340 0x55dbea41d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59188/0 (socket says 172.21.15.92:59188) 2024-09-19T08:57:48.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.328+0000 7f2d2ed9d640 1 -- 172.21.15.92:0/2600988736 learned_addr learned my addr 172.21.15.92:0/2600988736 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:48.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.328+0000 7f2d2f59e640 1 --2- 172.21.15.92:0/2600988736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbea41d890 0x55dbea41a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:48.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.328+0000 7f2d2e59c640 1 --2- 172.21.15.92:0/2600988736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dbea410c60 0x55dbea41a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:48.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.328+0000 7f2d2ed9d640 1 -- 172.21.15.92:0/2600988736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dbea410c60 msgr2=0x55dbea41a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:48.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.328+0000 7f2d2ed9d640 1 --2- 172.21.15.92:0/2600988736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dbea410c60 0x55dbea41a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.328+0000 7f2d2ed9d640 1 -- 172.21.15.92:0/2600988736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbea41d890 msgr2=0x55dbea41a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:48.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.328+0000 7f2d2ed9d640 1 --2- 172.21.15.92:0/2600988736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbea41d890 0x55dbea41a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.328+0000 7f2d2ed9d640 1 -- 172.21.15.92:0/2600988736 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbea0e73c0 con 0x55dbea410340 2024-09-19T08:57:48.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.328+0000 7f2d2e59c640 1 --2- 172.21.15.92:0/2600988736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dbea410c60 0x55dbea41a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:57:48.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.328+0000 7f2d2ed9d640 1 --2- 172.21.15.92:0/2600988736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbea410340 0x55dbea41d1c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2d20014720 tx=0x7f2d200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32cb7a994e8eb446 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:48.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.328+0000 7f2d12ff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:57:48.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.328+0000 7f2d12ff5640 1 -- 172.21.15.92:0/2600988736 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d20022030 con 0x55dbea410340 2024-09-19T08:57:48.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.328+0000 7f2d12ff5640 1 -- 172.21.15.92:0/2600988736 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2d20014d10 con 0x55dbea410340 2024-09-19T08:57:48.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.328+0000 7f2d37411740 1 -- 172.21.15.92:0/2600988736 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d24010040 con 0x55dbea410340 2024-09-19T08:57:48.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.329+0000 7f2d12ff5640 1 -- 172.21.15.92:0/2600988736 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2d2001a040 con 0x55dbea410340 2024-09-19T08:57:48.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.329+0000 7f2d37411740 10 client.15627 fetch_fsmap learned FSMap version 19 2024-09-19T08:57:48.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.329+0000 7f2d37411740 1 -- 172.21.15.92:0/2600988736 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55dbea42be70 con 0x55dbea410340 2024-09-19T08:57:48.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.329+0000 7f2d12ff5640 1 -- 172.21.15.92:0/2600988736 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d24010040 con 0x55dbea410340 2024-09-19T08:57:48.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.329+0000 7f2d12ff5640 1 -- 172.21.15.92:0/2600988736 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f2d2001d030 con 0x55dbea410340 2024-09-19T08:57:48.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.329+0000 7f2d37411740 10 client.15627 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:57:48.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.329+0000 7f2d37411740 10 client.15627 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:57:48.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.329+0000 7f2d37411740 20 client.15627 populate_metadata read hostname 'smithi092' 2024-09-19T08:57:48.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.329+0000 7f2d37411740 1 --2- 172.21.15.92:0/2600988736 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55dbea42d380 0x55dbea42f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:48.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.329+0000 7f2d37411740 4 client.15627 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:57:48.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.329+0000 7f2d37411740 1 -- 172.21.15.92:0/2600988736 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dbea383850 con 0x55dbea42d380 2024-09-19T08:57:48.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.330+0000 7f2d2e59c640 1 --2- 172.21.15.92:0/2600988736 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55dbea42d380 0x55dbea42f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:48.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.330+0000 7f2d2e59c640 1 --2- 172.21.15.92:0/2600988736 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55dbea42d380 0x55dbea42f810 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5328bf53e3ddc85 server_cookie=a10c8072f35a6afb in_seq=0 out_seq=0 2024-09-19T08:57:48.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.330+0000 7f2d12ff5640 10 client.15627 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:48.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.331+0000 7f2d12ff5640 1 -- 172.21.15.92:0/2600988736 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dbea383850 con 0x55dbea42d380 2024-09-19T08:57:48.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.331+0000 7f2d12ff5640 10 client.15627 handle_command_reply: tid=0 2024-09-19T08:57:48.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.331+0000 7f2d37411740 1 client.15627 shutdown 2024-09-19T08:57:48.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.331+0000 7f2d37411740 1 -- 172.21.15.92:0/2600988736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbea410340 msgr2=0x55dbea41d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:48.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.331+0000 7f2d37411740 1 --2- 172.21.15.92:0/2600988736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbea410340 0x55dbea41d1c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2d20014720 tx=0x7f2d200046c0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.331+0000 7f2d37411740 1 -- 172.21.15.92:0/2600988736 shutdown_connections 2024-09-19T08:57:48.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.331+0000 7f2d37411740 1 --2- 172.21.15.92:0/2600988736 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55dbea42d380 0x55dbea42f810 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.331+0000 7f2d37411740 1 --2- 172.21.15.92:0/2600988736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbea41d890 0x55dbea41a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.331+0000 7f2d37411740 1 --2- 172.21.15.92:0/2600988736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dbea410c60 0x55dbea41a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.331+0000 7f2d37411740 1 --2- 172.21.15.92:0/2600988736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbea410340 0x55dbea41d1c0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.331+0000 7f2d37411740 1 -- 172.21.15.92:0/2600988736 >> 172.21.15.92:0/2600988736 conn(0x55dbea40ca30 msgr2=0x55dbea412790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:48.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.331+0000 7f2d12ff5640 0 client.15627 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:48.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.331+0000 7f2d37411740 1 -- 172.21.15.92:0/2600988736 shutdown_connections 2024-09-19T08:57:48.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.331+0000 7f2d37411740 1 -- 172.21.15.92:0/2600988736 wait complete. 2024-09-19T08:57:48.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.331+0000 7f2d37411740 20 client.15627 trim_cache size 0 max 16384 2024-09-19T08:57:48.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.348+0000 7f2d37411740 1 Processor -- start 2024-09-19T08:57:48.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.348+0000 7f2d37411740 1 -- start start 2024-09-19T08:57:48.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.348+0000 7f2d37411740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbea410c60 0x55dbea429700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:48.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.348+0000 7f2d37411740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dbea41d890 0x55dbea415a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:48.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.348+0000 7f2d37411740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbea419560 0x55dbea4350e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:48.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.348+0000 7f2d37411740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2d301b1b40 con 0x55dbea410c60 2024-09-19T08:57:48.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.348+0000 7f2d37411740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2d301b43e0 con 0x55dbea419560 2024-09-19T08:57:48.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.348+0000 7f2d37411740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2d301b21d0 con 0x55dbea41d890 2024-09-19T08:57:48.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.348+0000 7f2d2ed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbea410c60 0x55dbea429700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:48.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.348+0000 7f2d2ed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbea410c60 0x55dbea429700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59198/0 (socket says 172.21.15.92:59198) 2024-09-19T08:57:48.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.348+0000 7f2d2ed9d640 1 -- 172.21.15.92:0/2818481469 learned_addr learned my addr 172.21.15.92:0/2818481469 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:48.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.349+0000 7f2d2e59c640 1 --2- 172.21.15.92:0/2818481469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dbea41d890 0x55dbea415a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:48.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.349+0000 7f2d2f59e640 1 --2- 172.21.15.92:0/2818481469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbea419560 0x55dbea4350e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:48.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.349+0000 7f2d2ed9d640 1 -- 172.21.15.92:0/2818481469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dbea41d890 msgr2=0x55dbea415a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:48.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.349+0000 7f2d2ed9d640 1 --2- 172.21.15.92:0/2818481469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dbea41d890 0x55dbea415a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.349+0000 7f2d2ed9d640 1 -- 172.21.15.92:0/2818481469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbea419560 msgr2=0x55dbea4350e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:48.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.349+0000 7f2d2ed9d640 1 --2- 172.21.15.92:0/2818481469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbea419560 0x55dbea4350e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.349+0000 7f2d2ed9d640 1 -- 172.21.15.92:0/2818481469 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbea4189c0 con 0x55dbea410c60 2024-09-19T08:57:48.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.349+0000 7f2d2f59e640 1 --2- 172.21.15.92:0/2818481469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbea419560 0x55dbea4350e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:57:48.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.349+0000 7f2d2e59c640 1 --2- 172.21.15.92:0/2818481469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dbea41d890 0x55dbea415a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:57:48.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.349+0000 7f2d2ed9d640 1 --2- 172.21.15.92:0/2818481469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbea410c60 0x55dbea429700 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f2d2001e040 tx=0x7f2d20009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=861d94dce7bc73ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:48.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.349+0000 7f2d14ff9640 1 -- 172.21.15.92:0/2818481469 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d20022040 con 0x55dbea410c60 2024-09-19T08:57:48.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.349+0000 7f2d14ff9640 1 -- 172.21.15.92:0/2818481469 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d20012ce0 con 0x55dbea410c60 2024-09-19T08:57:48.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.349+0000 7f2d14ff9640 1 -- 172.21.15.92:0/2818481469 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d20029920 con 0x55dbea410c60 2024-09-19T08:57:48.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.350+0000 7f2d37411740 1 -- 172.21.15.92:0/2818481469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbea410c60 msgr2=0x55dbea429700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:48.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.350+0000 7f2d37411740 1 --2- 172.21.15.92:0/2818481469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbea410c60 0x55dbea429700 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f2d2001e040 tx=0x7f2d20009060 comp rx=0 tx=0).stop 2024-09-19T08:57:48.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.350+0000 7f2d37411740 1 -- 172.21.15.92:0/2818481469 shutdown_connections 2024-09-19T08:57:48.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.350+0000 7f2d37411740 1 --2- 172.21.15.92:0/2818481469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbea419560 0x55dbea4350e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.350+0000 7f2d37411740 1 --2- 172.21.15.92:0/2818481469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dbea41d890 0x55dbea415a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.350+0000 7f2d37411740 1 --2- 172.21.15.92:0/2818481469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbea410c60 0x55dbea429700 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.350+0000 7f2d37411740 1 -- 172.21.15.92:0/2818481469 >> 172.21.15.92:0/2818481469 conn(0x55dbea40ca30 msgr2=0x55dbea4152f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:48.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.350+0000 7f2d37411740 1 -- 172.21.15.92:0/2818481469 shutdown_connections 2024-09-19T08:57:48.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.350+0000 7f2d37411740 1 -- 172.21.15.92:0/2818481469 wait complete. 2024-09-19T08:57:48.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.350+0000 7f2d37411740 1 -- start start 2024-09-19T08:57:48.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.350+0000 7f2d37411740 1 Processor -- start 2024-09-19T08:57:48.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.351+0000 7f2d37411740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbea410c60 0x55dbea425b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:48.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.351+0000 7f2d37411740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dbea419560 0x55dbea426070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:48.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.351+0000 7f2d37411740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbea41d890 0x55dbea420f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:48.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.351+0000 7f2d37411740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2d301b28a0 con 0x55dbea410c60 2024-09-19T08:57:48.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.351+0000 7f2d37411740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2d301b3d10 con 0x55dbea41d890 2024-09-19T08:57:48.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.351+0000 7f2d37411740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2d301b2f70 con 0x55dbea419560 2024-09-19T08:57:48.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.351+0000 7f2d37411740 10 client.0 _ll_register_callbacks cb 0x7f2d2000b690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:48.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.351+0000 7f2d2ed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbea410c60 0x55dbea425b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:48.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.351+0000 7f2d2ed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbea410c60 0x55dbea425b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59202/0 (socket says 172.21.15.92:59202) 2024-09-19T08:57:48.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.351+0000 7f2d2ed9d640 1 -- 172.21.15.92:0/2614904055 learned_addr learned my addr 172.21.15.92:0/2614904055 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:48.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.351+0000 7f2d2f59e640 1 --2- 172.21.15.92:0/2614904055 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbea41d890 0x55dbea420f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:48.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.351+0000 7f2d2ed9d640 1 -- 172.21.15.92:0/2614904055 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dbea419560 msgr2=0x55dbea426070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:48.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.351+0000 7f2d2ed9d640 1 --2- 172.21.15.92:0/2614904055 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dbea419560 0x55dbea426070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.351+0000 7f2d2ed9d640 1 -- 172.21.15.92:0/2614904055 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbea41d890 msgr2=0x55dbea420f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:48.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.351+0000 7f2d2ed9d640 1 --2- 172.21.15.92:0/2614904055 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbea41d890 0x55dbea420f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.351+0000 7f2d2ed9d640 1 -- 172.21.15.92:0/2614904055 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbea421740 con 0x55dbea410c60 2024-09-19T08:57:48.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.352+0000 7f2d2ed9d640 1 --2- 172.21.15.92:0/2614904055 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbea410c60 0x55dbea425b30 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f2d20000c00 tx=0x7f2d20012f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e084238d04672631 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:48.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.352+0000 7f2d12ff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:57:48.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.352+0000 7f2d12ff5640 1 -- 172.21.15.92:0/2614904055 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d20041020 con 0x55dbea410c60 2024-09-19T08:57:48.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.352+0000 7f2d12ff5640 1 -- 172.21.15.92:0/2614904055 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2d20012a90 con 0x55dbea410c60 2024-09-19T08:57:48.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.352+0000 7f2d37411740 1 -- 172.21.15.92:0/2614904055 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d20012ce0 con 0x55dbea410c60 2024-09-19T08:57:48.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.352+0000 7f2d12ff5640 1 -- 172.21.15.92:0/2614904055 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2d20022040 con 0x55dbea410c60 2024-09-19T08:57:48.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.352+0000 7f2d37411740 10 client.15633 fetch_fsmap learned FSMap version 19 2024-09-19T08:57:48.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.352+0000 7f2d37411740 1 -- 172.21.15.92:0/2614904055 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55dbea497bb0 con 0x55dbea410c60 2024-09-19T08:57:48.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.352+0000 7f2d12ff5640 1 -- 172.21.15.92:0/2614904055 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d20012ce0 con 0x55dbea410c60 2024-09-19T08:57:48.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.352+0000 7f2d12ff5640 1 -- 172.21.15.92:0/2614904055 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f2d20046070 con 0x55dbea410c60 2024-09-19T08:57:48.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.352+0000 7f2d37411740 10 client.15633 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:57:48.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.352+0000 7f2d37411740 10 client.15633 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:57:48.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.353+0000 7f2d37411740 20 client.15633 populate_metadata read hostname 'smithi092' 2024-09-19T08:57:48.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.353+0000 7f2d37411740 1 --2- 172.21.15.92:0/2614904055 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55dbea498210 0x55dbea49a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:48.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.353+0000 7f2d37411740 4 client.15633 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:57:48.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.353+0000 7f2d37411740 1 -- 172.21.15.92:0/2614904055 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55dbea37dd60 con 0x55dbea498210 2024-09-19T08:57:48.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.353+0000 7f2d2e59c640 1 --2- 172.21.15.92:0/2614904055 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55dbea498210 0x55dbea49a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:48.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.353+0000 7f2d12ff5640 10 client.15633 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:48.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.353+0000 7f2d2e59c640 1 --2- 172.21.15.92:0/2614904055 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55dbea498210 0x55dbea49a600 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7052aa94c567e8b server_cookie=684e7c22d0373cb5 in_seq=0 out_seq=0 2024-09-19T08:57:48.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.354+0000 7f2d12ff5640 1 -- 172.21.15.92:0/2614904055 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55dbea37dd60 con 0x55dbea498210 2024-09-19T08:57:48.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.354+0000 7f2d12ff5640 10 client.15633 handle_command_reply: tid=0 2024-09-19T08:57:48.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.354+0000 7f2d37411740 1 client.15633 shutdown 2024-09-19T08:57:48.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.354+0000 7f2d37411740 1 -- 172.21.15.92:0/2614904055 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbea410c60 msgr2=0x55dbea425b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:48.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.354+0000 7f2d37411740 1 --2- 172.21.15.92:0/2614904055 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbea410c60 0x55dbea425b30 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f2d20000c00 tx=0x7f2d20012f10 comp rx=0 tx=0).stop 2024-09-19T08:57:48.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.354+0000 7f2d37411740 1 -- 172.21.15.92:0/2614904055 shutdown_connections 2024-09-19T08:57:48.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.354+0000 7f2d37411740 1 --2- 172.21.15.92:0/2614904055 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55dbea498210 0x55dbea49a600 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.354+0000 7f2d37411740 1 --2- 172.21.15.92:0/2614904055 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dbea41d890 0x55dbea420f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.354+0000 7f2d12ff5640 0 client.15633 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:48.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.354+0000 7f2d37411740 1 --2- 172.21.15.92:0/2614904055 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dbea419560 0x55dbea426070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.354+0000 7f2d37411740 1 --2- 172.21.15.92:0/2614904055 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbea410c60 0x55dbea425b30 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.354+0000 7f2d37411740 1 -- 172.21.15.92:0/2614904055 >> 172.21.15.92:0/2614904055 conn(0x55dbea40ca30 msgr2=0x55dbea415b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:48.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.354+0000 7f2d37411740 1 -- 172.21.15.92:0/2614904055 shutdown_connections 2024-09-19T08:57:48.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.354+0000 7f2d37411740 1 -- 172.21.15.92:0/2614904055 wait complete. 2024-09-19T08:57:48.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.354+0000 7f2d37411740 20 client.15633 trim_cache size 0 max 16384 2024-09-19T08:57:48.367 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T08:57:48.367 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T08:57:48.368 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": { 2024-09-19T08:57:48.368 INFO:teuthology.orchestra.run.smithi092.stdout: "4eaf2b47-8ae6-4f0f-88b6-917120cb6e12": { 2024-09-19T08:57:48.368 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-19T08:57:48.368 INFO:teuthology.orchestra.run.smithi092.stdout: "tag": "4eaf2b47-8ae6-4f0f-88b6-917120cb6e12", 2024-09-19T08:57:48.368 INFO:teuthology.orchestra.run.smithi092.stdout: "options": "recursive,force" 2024-09-19T08:57:48.368 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:57:48.368 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:57:48.368 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T08:57:48.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.355+0000 7f2d35038640 1 -- 172.21.15.92:0/363458224 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2d180a3240 msgr2=0x7f2d180a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:48.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.355+0000 7f2d35038640 1 --2- 172.21.15.92:0/363458224 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2d180a3240 0x7f2d180a5700 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2d20006fd0 tx=0x7f2d20008040 comp rx=0 tx=0).stop 2024-09-19T08:57:48.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.355+0000 7f2d35038640 1 -- 172.21.15.92:0/363458224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d30106a70 msgr2=0x7f2d3006cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:48.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.355+0000 7f2d35038640 1 --2- 172.21.15.92:0/363458224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d30106a70 0x7f2d3006cfc0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2d28003ba0 tx=0x7f2d28003bd0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.355+0000 7f2d35038640 1 -- 172.21.15.92:0/363458224 shutdown_connections 2024-09-19T08:57:48.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.355+0000 7f2d35038640 1 --2- 172.21.15.92:0/363458224 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2d180a3240 0x7f2d180a5700 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.355+0000 7f2d35038640 1 --2- 172.21.15.92:0/363458224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d30106a70 0x7f2d3006cfc0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.355+0000 7f2d35038640 1 --2- 172.21.15.92:0/363458224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d30101410 0x7f2d3006ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.355+0000 7f2d35038640 1 --2- 172.21.15.92:0/363458224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2d30100a70 0x7f2d300739f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.355+0000 7f2d35038640 1 -- 172.21.15.92:0/363458224 >> 172.21.15.92:0/363458224 conn(0x7f2d300fc790 msgr2=0x7f2d300fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:48.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.355+0000 7f2d35038640 1 -- 172.21.15.92:0/363458224 shutdown_connections 2024-09-19T08:57:48.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:48.355+0000 7f2d35038640 1 -- 172.21.15.92:0/363458224 wait complete. 2024-09-19T08:57:48.966 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:48 smithi092 ceph-mon[31407]: pgmap v370: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 760 KiB/s wr, 136 op/s 2024-09-19T08:57:48.966 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:48 smithi092 ceph-mon[31407]: scrub summary: idle 2024-09-19T08:57:49.001 INFO:tasks.cephfs.filesystem:scrub status for tag:4eaf2b47-8ae6-4f0f-88b6-917120cb6e12 - {'path': '/', 'tag': '4eaf2b47-8ae6-4f0f-88b6-917120cb6e12', 'options': 'recursive,force'} 2024-09-19T08:57:49.047 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:57:49.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:48 smithi167 ceph-mon[35359]: pgmap v370: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 760 KiB/s wr, 136 op/s 2024-09-19T08:57:49.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:48 smithi167 ceph-mon[35359]: scrub summary: idle 2024-09-19T08:57:49.123 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:48 smithi190 ceph-mon[35358]: pgmap v370: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 760 KiB/s wr, 136 op/s 2024-09-19T08:57:49.123 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:48 smithi190 ceph-mon[35358]: scrub summary: idle 2024-09-19T08:57:49.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.515+0000 7f8d2e54e640 1 -- 172.21.15.92:0/244716511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d28101de0 msgr2=0x7f8d281021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:49.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.515+0000 7f8d2e54e640 1 --2- 172.21.15.92:0/244716511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d28101de0 0x7f8d281021c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8d18009900 tx=0x7f8d1802a410 comp rx=0 tx=0).stop 2024-09-19T08:57:49.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.515+0000 7f8d2e54e640 1 -- 172.21.15.92:0/244716511 shutdown_connections 2024-09-19T08:57:49.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.515+0000 7f8d2e54e640 1 --2- 172.21.15.92:0/244716511 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8d28106f10 0x7f8d2810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.515+0000 7f8d2e54e640 1 --2- 172.21.15.92:0/244716511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d28102790 0x7f8d281067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.515+0000 7f8d2e54e640 1 --2- 172.21.15.92:0/244716511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d28101de0 0x7f8d281021c0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.515+0000 7f8d2e54e640 1 -- 172.21.15.92:0/244716511 >> 172.21.15.92:0/244716511 conn(0x7f8d280fd8c0 msgr2=0x7f8d280ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:49.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.515+0000 7f8d2e54e640 1 -- 172.21.15.92:0/244716511 shutdown_connections 2024-09-19T08:57:49.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.515+0000 7f8d2e54e640 1 -- 172.21.15.92:0/244716511 wait complete. 2024-09-19T08:57:49.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.515+0000 7f8d2e54e640 1 Processor -- start 2024-09-19T08:57:49.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.516+0000 7f8d2e54e640 1 -- start start 2024-09-19T08:57:49.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.516+0000 7f8d2e54e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8d28101de0 0x7f8d281984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:49.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.516+0000 7f8d2e54e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d28102790 0x7f8d281989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:49.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.516+0000 7f8d2e54e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d28106f10 0x7f8d2819cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:49.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.516+0000 7f8d2e54e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8d28111f70 con 0x7f8d28102790 2024-09-19T08:57:49.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.516+0000 7f8d2e54e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8d28111df0 con 0x7f8d28106f10 2024-09-19T08:57:49.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.516+0000 7f8d2e54e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8d281120f0 con 0x7f8d28101de0 2024-09-19T08:57:49.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.516+0000 7f8d277fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d28102790 0x7f8d281989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:49.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.516+0000 7f8d277fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d28102790 0x7f8d281989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59216/0 (socket says 172.21.15.92:59216) 2024-09-19T08:57:49.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.516+0000 7f8d277fe640 1 -- 172.21.15.92:0/1207153998 learned_addr learned my addr 172.21.15.92:0/1207153998 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:49.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.516+0000 7f8d27fff640 1 --2- 172.21.15.92:0/1207153998 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8d28101de0 0x7f8d281984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:49.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.516+0000 7f8d2caeb640 1 --2- 172.21.15.92:0/1207153998 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d28106f10 0x7f8d2819cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:49.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.516+0000 7f8d277fe640 1 -- 172.21.15.92:0/1207153998 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8d28101de0 msgr2=0x7f8d281984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:49.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.516+0000 7f8d277fe640 1 --2- 172.21.15.92:0/1207153998 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8d28101de0 0x7f8d281984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.516+0000 7f8d277fe640 1 -- 172.21.15.92:0/1207153998 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d28106f10 msgr2=0x7f8d2819cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:49.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.516+0000 7f8d277fe640 1 --2- 172.21.15.92:0/1207153998 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d28106f10 0x7f8d2819cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.516+0000 7f8d277fe640 1 -- 172.21.15.92:0/1207153998 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d2819d460 con 0x7f8d28102790 2024-09-19T08:57:49.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.516+0000 7f8d277fe640 1 --2- 172.21.15.92:0/1207153998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d28102790 0x7f8d281989f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c00e9f0 tx=0x7f8d1c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:49.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.517+0000 7f8d257fa640 1 -- 172.21.15.92:0/1207153998 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c00cd80 con 0x7f8d28102790 2024-09-19T08:57:49.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.517+0000 7f8d257fa640 1 -- 172.21.15.92:0/1207153998 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d1c010910 con 0x7f8d28102790 2024-09-19T08:57:49.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.517+0000 7f8d2e54e640 1 -- 172.21.15.92:0/1207153998 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d2819d750 con 0x7f8d28102790 2024-09-19T08:57:49.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.517+0000 7f8d257fa640 1 -- 172.21.15.92:0/1207153998 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c018990 con 0x7f8d28102790 2024-09-19T08:57:49.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.517+0000 7f8d2e54e640 1 -- 172.21.15.92:0/1207153998 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d281a5030 con 0x7f8d28102790 2024-09-19T08:57:49.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.519+0000 7f8d257fa640 1 -- 172.21.15.92:0/1207153998 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8d1c010ac0 con 0x7f8d28102790 2024-09-19T08:57:49.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.519+0000 7f8d30927740 1 Processor -- start 2024-09-19T08:57:49.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.519+0000 7f8d30927740 1 -- start start 2024-09-19T08:57:49.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.520+0000 7f8d30927740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5564ae8db060 0x5564ae8db440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:49.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.520+0000 7f8d30927740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564ae8db980 0x5564ae8e5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:49.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.520+0000 7f8d257fa640 1 --2- 172.21.15.92:0/1207153998 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8d100a3240 0x7f8d100a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:49.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.520+0000 7f8d30927740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564ae8e6240 0x5564ae8e8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:49.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.520+0000 7f8d30927740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5564ae840620 con 0x5564ae8db980 2024-09-19T08:57:49.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.520+0000 7f8d30927740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5564ae7e7e50 con 0x5564ae8e6240 2024-09-19T08:57:49.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.520+0000 7f8d30927740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5564ae83c5e0 con 0x5564ae8db060 2024-09-19T08:57:49.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.520+0000 7f8d27fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564ae8db980 0x5564ae8e5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:49.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.520+0000 7f8d27fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564ae8db980 0x5564ae8e5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59226/0 (socket says 172.21.15.92:59226) 2024-09-19T08:57:49.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.520+0000 7f8d27fff640 1 -- 172.21.15.92:0/3094958331 learned_addr learned my addr 172.21.15.92:0/3094958331 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:49.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.520+0000 7f8d2caeb640 1 --2- 172.21.15.92:0/3094958331 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5564ae8db060 0x5564ae8db440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:49.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.520+0000 7f8d277fe640 1 --2- 172.21.15.92:0/1207153998 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8d100a3240 0x7f8d100a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:49.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.520+0000 7f8d2caeb640 1 --2- 172.21.15.92:0/3094958331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564ae8e6240 0x5564ae8e8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:49.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.520+0000 7f8d257fa640 1 -- 172.21.15.92:0/1207153998 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8d1c0cfd10 con 0x7f8d28102790 2024-09-19T08:57:49.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.520+0000 7f8d27fff640 1 -- 172.21.15.92:0/3094958331 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5564ae8db060 msgr2=0x5564ae8db440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:49.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.520+0000 7f8d27fff640 1 --2- 172.21.15.92:0/3094958331 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5564ae8db060 0x5564ae8db440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.520+0000 7f8d27fff640 1 -- 172.21.15.92:0/3094958331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564ae8e6240 msgr2=0x5564ae8e8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:49.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.520+0000 7f8d27fff640 1 --2- 172.21.15.92:0/3094958331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564ae8e6240 0x5564ae8e8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.520+0000 7f8d27fff640 1 -- 172.21.15.92:0/3094958331 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564ae7d8d40 con 0x5564ae8db980 2024-09-19T08:57:49.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.520+0000 7f8d277fe640 1 --2- 172.21.15.92:0/1207153998 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8d100a3240 0x7f8d100a5700 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c0cd7d0 tx=0x7f8d1c097f70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:49.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.520+0000 7f8d27fff640 1 --2- 172.21.15.92:0/3094958331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564ae8db980 0x5564ae8e5d00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f8d18009900 tx=0x7f8d18005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b6ed7d8e6803695 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:49.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.520+0000 7f8d0e7fc640 1 -- 172.21.15.92:0/3094958331 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d18035040 con 0x5564ae8db980 2024-09-19T08:57:49.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.520+0000 7f8d0e7fc640 1 -- 172.21.15.92:0/3094958331 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d18004030 con 0x5564ae8db980 2024-09-19T08:57:49.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.520+0000 7f8d0e7fc640 1 -- 172.21.15.92:0/3094958331 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d180054e0 con 0x5564ae8db980 2024-09-19T08:57:49.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.521+0000 7f8d30927740 1 -- 172.21.15.92:0/3094958331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564ae8db980 msgr2=0x5564ae8e5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:49.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.521+0000 7f8d30927740 1 --2- 172.21.15.92:0/3094958331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564ae8db980 0x5564ae8e5d00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f8d18009900 tx=0x7f8d18005be0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.521+0000 7f8d30927740 1 -- 172.21.15.92:0/3094958331 shutdown_connections 2024-09-19T08:57:49.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.521+0000 7f8d30927740 1 --2- 172.21.15.92:0/3094958331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564ae8e6240 0x5564ae8e8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.521+0000 7f8d30927740 1 --2- 172.21.15.92:0/3094958331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564ae8db980 0x5564ae8e5d00 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.521+0000 7f8d30927740 1 --2- 172.21.15.92:0/3094958331 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5564ae8db060 0x5564ae8db440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.521+0000 7f8d30927740 1 -- 172.21.15.92:0/3094958331 >> 172.21.15.92:0/3094958331 conn(0x5564ae8d75f0 msgr2=0x5564ae8d79d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:49.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.521+0000 7f8d30927740 1 -- 172.21.15.92:0/3094958331 shutdown_connections 2024-09-19T08:57:49.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.521+0000 7f8d30927740 1 -- 172.21.15.92:0/3094958331 wait complete. 2024-09-19T08:57:49.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.521+0000 7f8d30927740 1 -- start start 2024-09-19T08:57:49.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.522+0000 7f8d30927740 1 Processor -- start 2024-09-19T08:57:49.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.522+0000 7f8d30927740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564ae8db060 0x5564ae8e3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:49.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.522+0000 7f8d30927740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5564ae8db980 0x5564ae8e36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:49.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.522+0000 7f8d30927740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564ae8e6240 0x5564ae8e3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:49.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.522+0000 7f8d30927740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5564ae8e8e10 con 0x5564ae8e6240 2024-09-19T08:57:49.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.522+0000 7f8d30927740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5564ae7c8f10 con 0x5564ae8db060 2024-09-19T08:57:49.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.522+0000 7f8d30927740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5564ae8e8f90 con 0x5564ae8db980 2024-09-19T08:57:49.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.522+0000 7f8d30927740 10 client.0 _ll_register_callbacks cb 0x5564ae7ecdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:49.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.522+0000 7f8d2caeb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564ae8e6240 0x5564ae8e3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:49.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.522+0000 7f8d2caeb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564ae8e6240 0x5564ae8e3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59242/0 (socket says 172.21.15.92:59242) 2024-09-19T08:57:49.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.522+0000 7f8d2caeb640 1 -- 172.21.15.92:0/2881548034 learned_addr learned my addr 172.21.15.92:0/2881548034 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:49.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.522+0000 7f8d2caeb640 1 --2- 172.21.15.92:0/2881548034 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564ae8db060 0x5564ae8e3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:49.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.522+0000 7f8d27fff640 1 --2- 172.21.15.92:0/2881548034 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5564ae8db980 0x5564ae8e36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:49.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.522+0000 7f8d2caeb640 1 -- 172.21.15.92:0/2881548034 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5564ae8db980 msgr2=0x5564ae8e36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:49.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.522+0000 7f8d2caeb640 1 --2- 172.21.15.92:0/2881548034 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5564ae8db980 0x5564ae8e36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.522+0000 7f8d2caeb640 1 -- 172.21.15.92:0/2881548034 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564ae8db060 msgr2=0x5564ae8e3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:49.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.522+0000 7f8d2caeb640 1 --2- 172.21.15.92:0/2881548034 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564ae8db060 0x5564ae8e3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.522+0000 7f8d2caeb640 1 -- 172.21.15.92:0/2881548034 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564ae54f580 con 0x5564ae8e6240 2024-09-19T08:57:49.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.523+0000 7f8d2caeb640 1 --2- 172.21.15.92:0/2881548034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564ae8e6240 0x5564ae8e3c00 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f8d20010420 tx=0x7f8d20004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df17a04a93de2c02 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:49.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.523+0000 7f8d077fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:57:49.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.523+0000 7f8d077fe640 1 -- 172.21.15.92:0/2881548034 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2000c540 con 0x5564ae8e6240 2024-09-19T08:57:49.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.523+0000 7f8d30927740 1 -- 172.21.15.92:0/2881548034 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d18004030 con 0x5564ae8e6240 2024-09-19T08:57:49.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.523+0000 7f8d077fe640 1 -- 172.21.15.92:0/2881548034 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8d2000c6e0 con 0x5564ae8e6240 2024-09-19T08:57:49.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.523+0000 7f8d077fe640 1 -- 172.21.15.92:0/2881548034 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8d2000c8e0 con 0x5564ae8e6240 2024-09-19T08:57:49.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.523+0000 7f8d30927740 10 client.15645 fetch_fsmap learned FSMap version 19 2024-09-19T08:57:49.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.523+0000 7f8d30927740 1 -- 172.21.15.92:0/2881548034 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5564ae619960 con 0x5564ae8e6240 2024-09-19T08:57:49.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.523+0000 7f8d077fe640 1 -- 172.21.15.92:0/2881548034 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d18004030 con 0x5564ae8e6240 2024-09-19T08:57:49.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.523+0000 7f8d077fe640 1 -- 172.21.15.92:0/2881548034 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f8d20020940 con 0x5564ae8e6240 2024-09-19T08:57:49.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.523+0000 7f8d30927740 10 client.15645 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:57:49.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.523+0000 7f8d30927740 10 client.15645 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T08:57:49.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.523+0000 7f8d30927740 20 client.15645 populate_metadata read hostname 'smithi092' 2024-09-19T08:57:49.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.523+0000 7f8d30927740 1 --2- 172.21.15.92:0/2881548034 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5564ae8f5da0 0x5564ae8f81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:49.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.523+0000 7f8d30927740 4 client.15645 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:57:49.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.523+0000 7f8d30927740 1 -- 172.21.15.92:0/2881548034 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564ae84db90 con 0x5564ae8f5da0 2024-09-19T08:57:49.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.524+0000 7f8d27fff640 1 --2- 172.21.15.92:0/2881548034 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5564ae8f5da0 0x5564ae8f81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:49.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.524+0000 7f8d077fe640 10 client.15645 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:49.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.524+0000 7f8d27fff640 1 --2- 172.21.15.92:0/2881548034 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5564ae8f5da0 0x5564ae8f81f0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1529341ab393382a server_cookie=9333a1847895e056 in_seq=0 out_seq=0 2024-09-19T08:57:49.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.525+0000 7f8d077fe640 1 -- 172.21.15.92:0/2881548034 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5564ae84db90 con 0x5564ae8f5da0 2024-09-19T08:57:49.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.525+0000 7f8d077fe640 10 client.15645 handle_command_reply: tid=0 2024-09-19T08:57:49.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.525+0000 7f8d30927740 1 client.15645 shutdown 2024-09-19T08:57:49.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.525+0000 7f8d30927740 1 -- 172.21.15.92:0/2881548034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564ae8e6240 msgr2=0x5564ae8e3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:49.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.525+0000 7f8d30927740 1 --2- 172.21.15.92:0/2881548034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564ae8e6240 0x5564ae8e3c00 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f8d20010420 tx=0x7f8d20004a40 comp rx=0 tx=0).stop 2024-09-19T08:57:49.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.525+0000 7f8d30927740 1 -- 172.21.15.92:0/2881548034 shutdown_connections 2024-09-19T08:57:49.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.525+0000 7f8d30927740 1 --2- 172.21.15.92:0/2881548034 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5564ae8f5da0 0x5564ae8f81f0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.525+0000 7f8d30927740 1 --2- 172.21.15.92:0/2881548034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564ae8e6240 0x5564ae8e3c00 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.525+0000 7f8d30927740 1 --2- 172.21.15.92:0/2881548034 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5564ae8db980 0x5564ae8e36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.525+0000 7f8d30927740 1 --2- 172.21.15.92:0/2881548034 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564ae8db060 0x5564ae8e3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.525+0000 7f8d077fe640 0 client.15645 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:49.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.525+0000 7f8d30927740 1 -- 172.21.15.92:0/2881548034 >> 172.21.15.92:0/2881548034 conn(0x5564ae8d75f0 msgr2=0x5564ae8dd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:49.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.525+0000 7f8d30927740 1 -- 172.21.15.92:0/2881548034 shutdown_connections 2024-09-19T08:57:49.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.525+0000 7f8d30927740 1 -- 172.21.15.92:0/2881548034 wait complete. 2024-09-19T08:57:49.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.525+0000 7f8d30927740 20 client.15645 trim_cache size 0 max 16384 2024-09-19T08:57:49.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.542+0000 7f8d30927740 1 Processor -- start 2024-09-19T08:57:49.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.542+0000 7f8d30927740 1 -- start start 2024-09-19T08:57:49.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.542+0000 7f8d30927740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564ae8db060 0x5564ae8e5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:49.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.542+0000 7f8d30927740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5564ae8db980 0x5564ae8ddac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:49.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.542+0000 7f8d30927740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564ae8e6240 0x5564ae8fdac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:49.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.542+0000 7f8d30927740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8d281a93b0 con 0x5564ae8e6240 2024-09-19T08:57:49.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.542+0000 7f8d30927740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8d281abc50 con 0x5564ae8db060 2024-09-19T08:57:49.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.542+0000 7f8d30927740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8d281a9a40 con 0x5564ae8db980 2024-09-19T08:57:49.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.542+0000 7f8d2caeb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564ae8e6240 0x5564ae8fdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:49.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.542+0000 7f8d2caeb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564ae8e6240 0x5564ae8fdac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59258/0 (socket says 172.21.15.92:59258) 2024-09-19T08:57:49.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.542+0000 7f8d2caeb640 1 -- 172.21.15.92:0/1205488679 learned_addr learned my addr 172.21.15.92:0/1205488679 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:49.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.542+0000 7f8d2caeb640 1 --2- 172.21.15.92:0/1205488679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564ae8db060 0x5564ae8e5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:49.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.542+0000 7f8d27fff640 1 --2- 172.21.15.92:0/1205488679 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5564ae8db980 0x5564ae8ddac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:49.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.542+0000 7f8d2caeb640 1 -- 172.21.15.92:0/1205488679 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5564ae8db980 msgr2=0x5564ae8ddac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:49.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.542+0000 7f8d2caeb640 1 --2- 172.21.15.92:0/1205488679 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5564ae8db980 0x5564ae8ddac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.542+0000 7f8d2caeb640 1 -- 172.21.15.92:0/1205488679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564ae8db060 msgr2=0x5564ae8e5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:49.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.542+0000 7f8d2caeb640 1 --2- 172.21.15.92:0/1205488679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564ae8db060 0x5564ae8e5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.542+0000 7f8d2caeb640 1 -- 172.21.15.92:0/1205488679 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564ae8dae90 con 0x5564ae8e6240 2024-09-19T08:57:49.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.542+0000 7f8d27fff640 1 --2- 172.21.15.92:0/1205488679 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5564ae8db980 0x5564ae8ddac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:57:49.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.543+0000 7f8d2caeb640 1 --2- 172.21.15.92:0/1205488679 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564ae8e6240 0x5564ae8fdac0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f8d20005b40 tx=0x7f8d200096b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9a51cdc8782ef09 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:49.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.543+0000 7f8d0dffb640 1 -- 172.21.15.92:0/1205488679 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2002f030 con 0x5564ae8e6240 2024-09-19T08:57:49.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.543+0000 7f8d0dffb640 1 -- 172.21.15.92:0/1205488679 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d20016070 con 0x5564ae8e6240 2024-09-19T08:57:49.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.543+0000 7f8d0dffb640 1 -- 172.21.15.92:0/1205488679 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d20020670 con 0x5564ae8e6240 2024-09-19T08:57:49.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.544+0000 7f8d30927740 1 -- 172.21.15.92:0/1205488679 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564ae8e6240 msgr2=0x5564ae8fdac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:49.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.544+0000 7f8d30927740 1 --2- 172.21.15.92:0/1205488679 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564ae8e6240 0x5564ae8fdac0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f8d20005b40 tx=0x7f8d200096b0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.544+0000 7f8d30927740 1 -- 172.21.15.92:0/1205488679 shutdown_connections 2024-09-19T08:57:49.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.544+0000 7f8d30927740 1 --2- 172.21.15.92:0/1205488679 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564ae8e6240 0x5564ae8fdac0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.544+0000 7f8d30927740 1 --2- 172.21.15.92:0/1205488679 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5564ae8db980 0x5564ae8ddac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.544+0000 7f8d30927740 1 --2- 172.21.15.92:0/1205488679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564ae8db060 0x5564ae8e5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.544+0000 7f8d30927740 1 -- 172.21.15.92:0/1205488679 >> 172.21.15.92:0/1205488679 conn(0x5564ae8d75f0 msgr2=0x5564ae8d6750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:49.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.544+0000 7f8d30927740 1 -- 172.21.15.92:0/1205488679 shutdown_connections 2024-09-19T08:57:49.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.544+0000 7f8d30927740 1 -- 172.21.15.92:0/1205488679 wait complete. 2024-09-19T08:57:49.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.544+0000 7f8d30927740 1 -- start start 2024-09-19T08:57:49.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.544+0000 7f8d30927740 1 Processor -- start 2024-09-19T08:57:49.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.545+0000 7f8d30927740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564ae8db060 0x5564ae8eaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:49.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.545+0000 7f8d30927740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5564ae8db980 0x5564ae8eafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:49.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.545+0000 7f8d30927740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564ae8e6240 0x5564ae8ee030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:49.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.545+0000 7f8d30927740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8d281aa110 con 0x5564ae8db060 2024-09-19T08:57:49.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.545+0000 7f8d30927740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8d281ab580 con 0x5564ae8e6240 2024-09-19T08:57:49.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.545+0000 7f8d30927740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8d281aa7e0 con 0x5564ae8db980 2024-09-19T08:57:49.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.545+0000 7f8d30927740 10 client.0 _ll_register_callbacks cb 0x7f8d20012c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:49.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.545+0000 7f8d2caeb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564ae8db060 0x5564ae8eaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:49.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.545+0000 7f8d2caeb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564ae8db060 0x5564ae8eaa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59274/0 (socket says 172.21.15.92:59274) 2024-09-19T08:57:49.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.545+0000 7f8d2caeb640 1 -- 172.21.15.92:0/2977703934 learned_addr learned my addr 172.21.15.92:0/2977703934 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:49.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.545+0000 7f8d27fff640 1 --2- 172.21.15.92:0/2977703934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5564ae8db980 0x5564ae8eafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:49.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.545+0000 7f8d2caeb640 1 -- 172.21.15.92:0/2977703934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5564ae8db980 msgr2=0x5564ae8eafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:49.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.545+0000 7f8d2caeb640 1 --2- 172.21.15.92:0/2977703934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5564ae8db980 0x5564ae8eafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.545+0000 7f8d2caeb640 1 -- 172.21.15.92:0/2977703934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564ae8e6240 msgr2=0x5564ae8ee030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:49.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.545+0000 7f8d2caeb640 1 --2- 172.21.15.92:0/2977703934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564ae8e6240 0x5564ae8ee030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.545+0000 7f8d2caeb640 1 -- 172.21.15.92:0/2977703934 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564ae8ee6d0 con 0x5564ae8db060 2024-09-19T08:57:49.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.546+0000 7f8d2caeb640 1 --2- 172.21.15.92:0/2977703934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564ae8db060 0x5564ae8eaa80 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f8d2000c690 tx=0x7f8d20020f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=809d9d43d50b4f7b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:49.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.546+0000 7f8d077fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:57:49.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.546+0000 7f8d077fe640 1 -- 172.21.15.92:0/2977703934 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2002f040 con 0x5564ae8db060 2024-09-19T08:57:49.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.546+0000 7f8d077fe640 1 -- 172.21.15.92:0/2977703934 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8d2000cc80 con 0x5564ae8db060 2024-09-19T08:57:49.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.546+0000 7f8d30927740 1 -- 172.21.15.92:0/2977703934 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d20016070 con 0x5564ae8db060 2024-09-19T08:57:49.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.546+0000 7f8d077fe640 1 -- 172.21.15.92:0/2977703934 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8d20046050 con 0x5564ae8db060 2024-09-19T08:57:49.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.546+0000 7f8d30927740 10 client.15651 fetch_fsmap learned FSMap version 19 2024-09-19T08:57:49.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.546+0000 7f8d30927740 1 -- 172.21.15.92:0/2977703934 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5564ae9616a0 con 0x5564ae8db060 2024-09-19T08:57:49.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.546+0000 7f8d077fe640 1 -- 172.21.15.92:0/2977703934 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d2003b070 con 0x5564ae8db060 2024-09-19T08:57:49.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.546+0000 7f8d077fe640 1 -- 172.21.15.92:0/2977703934 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f8d20020850 con 0x5564ae8db060 2024-09-19T08:57:49.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.546+0000 7f8d30927740 10 client.15651 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:57:49.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.546+0000 7f8d30927740 10 client.15651 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T08:57:49.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.546+0000 7f8d30927740 20 client.15651 populate_metadata read hostname 'smithi092' 2024-09-19T08:57:49.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.546+0000 7f8d30927740 1 --2- 172.21.15.92:0/2977703934 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5564ae961d70 0x5564ae964160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:49.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.547+0000 7f8d30927740 4 client.15651 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "5bb65959", "release": true, "await": true}] 2024-09-19T08:57:49.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.547+0000 7f8d30927740 1 -- 172.21.15.92:0/2977703934 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "quiesce db", "set_id": "5bb65959", "release": true, "await": true}) -- 0x7f8d20016070 con 0x5564ae961d70 2024-09-19T08:57:49.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.547+0000 7f8d27fff640 1 --2- 172.21.15.92:0/2977703934 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5564ae961d70 0x5564ae964160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:49.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.547+0000 7f8d27fff640 1 --2- 172.21.15.92:0/2977703934 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5564ae961d70 0x5564ae964160 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1dd745fac90a0bd1 server_cookie=9ebd4001ba77f4f3 in_seq=0 out_seq=0 2024-09-19T08:57:49.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.547+0000 7f8d077fe640 10 client.15651 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:49.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.590+0000 7f8d077fe640 1 -- 172.21.15.92:0/2977703934 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x7f8d20016070 con 0x5564ae961d70 2024-09-19T08:57:49.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.590+0000 7f8d077fe640 10 client.15651 handle_command_reply: tid=0 2024-09-19T08:57:49.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.590+0000 7f8d30927740 1 client.15651 shutdown 2024-09-19T08:57:49.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.594+0000 7f8d30927740 1 -- 172.21.15.92:0/2977703934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564ae8db060 msgr2=0x5564ae8eaa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:49.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.594+0000 7f8d30927740 1 --2- 172.21.15.92:0/2977703934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564ae8db060 0x5564ae8eaa80 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f8d2000c690 tx=0x7f8d20020f90 comp rx=0 tx=0).stop 2024-09-19T08:57:49.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.595+0000 7f8d30927740 1 -- 172.21.15.92:0/2977703934 shutdown_connections 2024-09-19T08:57:49.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.595+0000 7f8d30927740 1 --2- 172.21.15.92:0/2977703934 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5564ae961d70 0x5564ae964160 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.595+0000 7f8d30927740 1 --2- 172.21.15.92:0/2977703934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5564ae8e6240 0x5564ae8ee030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.595+0000 7f8d30927740 1 --2- 172.21.15.92:0/2977703934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5564ae8db980 0x5564ae8eafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.595+0000 7f8d30927740 1 --2- 172.21.15.92:0/2977703934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564ae8db060 0x5564ae8eaa80 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.595+0000 7f8d30927740 1 -- 172.21.15.92:0/2977703934 >> 172.21.15.92:0/2977703934 conn(0x5564ae8d75f0 msgr2=0x5564ae8d5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:49.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.595+0000 7f8d077fe640 0 client.15651 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:49.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.595+0000 7f8d30927740 1 -- 172.21.15.92:0/2977703934 shutdown_connections 2024-09-19T08:57:49.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.596+0000 7f8d30927740 1 -- 172.21.15.92:0/2977703934 wait complete. 2024-09-19T08:57:49.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.597+0000 7f8d30927740 20 client.15651 trim_cache size 0 max 16384 2024-09-19T08:57:49.597 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T08:57:49.597 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 19, 2024-09-19T08:57:49.597 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24472, 2024-09-19T08:57:49.598 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 8, 2024-09-19T08:57:49.598 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-09-19T08:57:49.598 INFO:teuthology.orchestra.run.smithi092.stdout: "5bb65959": { 2024-09-19T08:57:49.598 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 8, 2024-09-19T08:57:49.598 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-09-19T08:57:49.598 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T08:57:49.598 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-09-19T08:57:49.598 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T08:57:49.598 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T08:57:49.598 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 90.0, 2024-09-19T08:57:49.598 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 140.3, 2024-09-19T08:57:49.598 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-09-19T08:57:49.598 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-09-19T08:57:49.599 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-09-19T08:57:49.599 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T08:57:49.599 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-09-19T08:57:49.599 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T08:57:49.599 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:57:49.599 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:57:49.599 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:57:49.599 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:57:49.599 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:57:49.599 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T08:57:49.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.599+0000 7f8d2e54e640 1 -- 172.21.15.92:0/1207153998 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8d100a3240 msgr2=0x7f8d100a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:49.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.599+0000 7f8d2e54e640 1 --2- 172.21.15.92:0/1207153998 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8d100a3240 0x7f8d100a5700 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c0cd7d0 tx=0x7f8d1c097f70 comp rx=0 tx=0).stop 2024-09-19T08:57:49.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.599+0000 7f8d2e54e640 1 -- 172.21.15.92:0/1207153998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d28102790 msgr2=0x7f8d281989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:49.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.599+0000 7f8d2e54e640 1 --2- 172.21.15.92:0/1207153998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d28102790 0x7f8d281989f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c00e9f0 tx=0x7f8d1c00eeb0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.599+0000 7f8d2e54e640 1 -- 172.21.15.92:0/1207153998 shutdown_connections 2024-09-19T08:57:49.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.599+0000 7f8d2e54e640 1 --2- 172.21.15.92:0/1207153998 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d28106f10 0x7f8d2819cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.599+0000 7f8d2e54e640 1 --2- 172.21.15.92:0/1207153998 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8d100a3240 0x7f8d100a5700 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.599+0000 7f8d2e54e640 1 --2- 172.21.15.92:0/1207153998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d28102790 0x7f8d281989f0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.599+0000 7f8d2e54e640 1 --2- 172.21.15.92:0/1207153998 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8d28101de0 0x7f8d281984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.599+0000 7f8d2e54e640 1 -- 172.21.15.92:0/1207153998 >> 172.21.15.92:0/1207153998 conn(0x7f8d280fd8c0 msgr2=0x7f8d280fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:49.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.600+0000 7f8d2e54e640 1 -- 172.21.15.92:0/1207153998 shutdown_connections 2024-09-19T08:57:49.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:49.600+0000 7f8d2e54e640 1 -- 172.21.15.92:0/1207153998 wait complete. 2024-09-19T08:57:50.394 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '5bb65959', total seconds elapsed: 24.7 2024-09-19T08:57:50.394 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-09-19T08:57:50.395 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:57:50.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.607+0000 7fa1203e4640 1 -- 172.21.15.92:0/3479698875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa118109cd0 msgr2=0x7fa118110560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:50.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.607+0000 7fa1203e4640 1 --2- 172.21.15.92:0/3479698875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa118109cd0 0x7fa118110560 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa110009ca0 tx=0x7fa11002a8b0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.608+0000 7fa1203e4640 1 -- 172.21.15.92:0/3479698875 shutdown_connections 2024-09-19T08:57:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.608+0000 7fa1203e4640 1 --2- 172.21.15.92:0/3479698875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa118109cd0 0x7fa118110560 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.608+0000 7fa1203e4640 1 --2- 172.21.15.92:0/3479698875 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa118109310 0x7fa118109790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.608+0000 7fa1203e4640 1 --2- 172.21.15.92:0/3479698875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1181084c0 0x7fa1181088c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.608+0000 7fa1203e4640 1 -- 172.21.15.92:0/3479698875 >> 172.21.15.92:0/3479698875 conn(0x7fa11806b6d0 msgr2=0x7fa118079830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:50.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.609+0000 7fa1203e4640 1 -- 172.21.15.92:0/3479698875 shutdown_connections 2024-09-19T08:57:50.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.609+0000 7fa1203e4640 1 -- 172.21.15.92:0/3479698875 wait complete. 2024-09-19T08:57:50.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.610+0000 7fa1203e4640 1 Processor -- start 2024-09-19T08:57:50.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.610+0000 7fa1203e4640 1 -- start start 2024-09-19T08:57:50.611 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.610+0000 7fa1203e4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1181084c0 0x7fa11819e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:50.611 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.610+0000 7fa1203e4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa118109310 0x7fa11819e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:50.611 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.610+0000 7fa1203e4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa118109cd0 0x7fa1181a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:50.611 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.610+0000 7fa1203e4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa118113de0 con 0x7fa1181084c0 2024-09-19T08:57:50.611 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.610+0000 7fa1203e4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa118113c60 con 0x7fa118109cd0 2024-09-19T08:57:50.611 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.610+0000 7fa1203e4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa118113f60 con 0x7fa118109310 2024-09-19T08:57:50.611 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.611+0000 7fa11e981640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa118109cd0 0x7fa1181a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:50.611 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.611+0000 7fa11e981640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa118109cd0 0x7fa1181a5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:50952/0 (socket says 172.21.15.92:50952) 2024-09-19T08:57:50.611 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.611+0000 7fa11e981640 1 -- 172.21.15.92:0/2784926371 learned_addr learned my addr 172.21.15.92:0/2784926371 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:50.612 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.611+0000 7fa11e981640 1 -- 172.21.15.92:0/2784926371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa118109310 msgr2=0x7fa11819e8b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T08:57:50.612 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.611+0000 7fa11e981640 1 --2- 172.21.15.92:0/2784926371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa118109310 0x7fa11819e8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.612 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.611+0000 7fa11e981640 1 -- 172.21.15.92:0/2784926371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1181084c0 msgr2=0x7fa11819e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:50.612 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.611+0000 7fa11e981640 1 --2- 172.21.15.92:0/2784926371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1181084c0 0x7fa11819e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.612 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.611+0000 7fa11e981640 1 -- 172.21.15.92:0/2784926371 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1181a5f90 con 0x7fa118109cd0 2024-09-19T08:57:50.612 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.611+0000 7fa11e981640 1 --2- 172.21.15.92:0/2784926371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa118109cd0 0x7fa1181a5920 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa1100098d0 tx=0x7fa110003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:50.612 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.612+0000 7fa10b7fe640 1 -- 172.21.15.92:0/2784926371 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa110030ed0 con 0x7fa118109cd0 2024-09-19T08:57:50.612 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.612+0000 7fa10b7fe640 1 -- 172.21.15.92:0/2784926371 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa110040070 con 0x7fa118109cd0 2024-09-19T08:57:50.613 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.612+0000 7fa10b7fe640 1 -- 172.21.15.92:0/2784926371 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa110030ed0 con 0x7fa118109cd0 2024-09-19T08:57:50.613 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.614+0000 7fa1203e4640 1 -- 172.21.15.92:0/2784926371 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1181a6220 con 0x7fa118109cd0 2024-09-19T08:57:50.613 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.614+0000 7fa1203e4640 1 -- 172.21.15.92:0/2784926371 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1181a6630 con 0x7fa118109cd0 2024-09-19T08:57:50.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.619+0000 7fa123258740 1 Processor -- start 2024-09-19T08:57:50.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.620+0000 7fa10b7fe640 1 -- 172.21.15.92:0/2784926371 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa110031a70 con 0x7fa118109cd0 2024-09-19T08:57:50.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.621+0000 7fa10b7fe640 1 --2- 172.21.15.92:0/2784926371 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa1040a3550 0x7fa1040a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:50.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.621+0000 7fa11d97f640 1 --2- 172.21.15.92:0/2784926371 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa1040a3550 0x7fa1040a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:50.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.621+0000 7fa10b7fe640 1 -- 172.21.15.92:0/2784926371 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa1100f05e0 con 0x7fa118109cd0 2024-09-19T08:57:50.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.622+0000 7fa123258740 1 -- start start 2024-09-19T08:57:50.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.622+0000 7fa123258740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632d68009a0 0x5632d6800da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:50.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.622+0000 7fa123258740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632d68012e0 0x5632d6805da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:50.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.622+0000 7fa123258740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632d6806370 0x5632d6808830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:50.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.622+0000 7fa123258740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5632d67642f0 con 0x5632d6806370 2024-09-19T08:57:50.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.622+0000 7fa123258740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5632d670c270 con 0x5632d68009a0 2024-09-19T08:57:50.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.622+0000 7fa123258740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5632d67602b0 con 0x5632d68012e0 2024-09-19T08:57:50.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.623+0000 7fa11e981640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632d6806370 0x5632d6808830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:50.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.623+0000 7fa11e981640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632d6806370 0x5632d6808830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59300/0 (socket says 172.21.15.92:59300) 2024-09-19T08:57:50.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.623+0000 7fa11e981640 1 -- 172.21.15.92:0/1807172668 learned_addr learned my addr 172.21.15.92:0/1807172668 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:50.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.623+0000 7fa11d97f640 1 --2- 172.21.15.92:0/1807172668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632d68012e0 0x5632d6805da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:50.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.623+0000 7fa11d97f640 1 --2- 172.21.15.92:0/2784926371 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa1040a3550 0x7fa1040a5a10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa11819f880 tx=0x7fa11400b370 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:50.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.623+0000 7fa11e981640 1 -- 172.21.15.92:0/1807172668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632d68012e0 msgr2=0x5632d6805da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:50.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.623+0000 7fa11e981640 1 --2- 172.21.15.92:0/1807172668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632d68012e0 0x5632d6805da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.623+0000 7fa11e981640 1 -- 172.21.15.92:0/1807172668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632d68009a0 msgr2=0x5632d6800da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T08:57:50.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.623+0000 7fa11e981640 1 --2- 172.21.15.92:0/1807172668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632d68009a0 0x5632d6800da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.623+0000 7fa11e981640 1 -- 172.21.15.92:0/1807172668 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632d670b340 con 0x5632d6806370 2024-09-19T08:57:50.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.624+0000 7fa11e981640 1 --2- 172.21.15.92:0/1807172668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632d6806370 0x5632d6808830 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fa110009bf0 tx=0x7fa1100b8f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=208485ad36e0df server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:50.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.624+0000 7fa108bfe640 1 -- 172.21.15.92:0/1807172668 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa110031440 con 0x5632d6806370 2024-09-19T08:57:50.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.625+0000 7fa108bfe640 1 -- 172.21.15.92:0/1807172668 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa110036040 con 0x5632d6806370 2024-09-19T08:57:50.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.625+0000 7fa108bfe640 1 -- 172.21.15.92:0/1807172668 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa110031d60 con 0x5632d6806370 2024-09-19T08:57:50.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.626+0000 7fa123258740 1 -- 172.21.15.92:0/1807172668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632d6806370 msgr2=0x5632d6808830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:50.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.626+0000 7fa123258740 1 --2- 172.21.15.92:0/1807172668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632d6806370 0x5632d6808830 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fa110009bf0 tx=0x7fa1100b8f60 comp rx=0 tx=0).stop 2024-09-19T08:57:50.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.626+0000 7fa123258740 1 -- 172.21.15.92:0/1807172668 shutdown_connections 2024-09-19T08:57:50.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.626+0000 7fa123258740 1 --2- 172.21.15.92:0/1807172668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632d6806370 0x5632d6808830 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.626+0000 7fa123258740 1 --2- 172.21.15.92:0/1807172668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632d68012e0 0x5632d6805da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.626+0000 7fa123258740 1 --2- 172.21.15.92:0/1807172668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632d68009a0 0x5632d6800da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.626+0000 7fa123258740 1 -- 172.21.15.92:0/1807172668 >> 172.21.15.92:0/1807172668 conn(0x5632d67fc010 msgr2=0x5632d67fc410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:50.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.627+0000 7fa123258740 1 -- 172.21.15.92:0/1807172668 shutdown_connections 2024-09-19T08:57:50.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.627+0000 7fa123258740 1 -- 172.21.15.92:0/1807172668 wait complete. 2024-09-19T08:57:50.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.628+0000 7fa123258740 1 -- start start 2024-09-19T08:57:50.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.628+0000 7fa123258740 1 Processor -- start 2024-09-19T08:57:50.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.628+0000 7fa123258740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632d68009a0 0x5632d680a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:50.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.629+0000 7fa123258740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632d68012e0 0x5632d680aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:50.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.629+0000 7fa11e180640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632d68009a0 0x5632d680a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:50.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.629+0000 7fa11e180640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632d68009a0 0x5632d680a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59304/0 (socket says 172.21.15.92:59304) 2024-09-19T08:57:50.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.629+0000 7fa11e180640 1 -- 172.21.15.92:0/1047377823 learned_addr learned my addr 172.21.15.92:0/1047377823 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:50.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.629+0000 7fa123258740 1 --2- 172.21.15.92:0/1047377823 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632d6806370 0x5632d6811ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:50.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.629+0000 7fa11d97f640 1 --2- 172.21.15.92:0/1047377823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632d68012e0 0x5632d680aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:50.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.630+0000 7fa11e981640 1 --2- 172.21.15.92:0/1047377823 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632d6806370 0x5632d6811ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:50.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.630+0000 7fa123258740 1 -- 172.21.15.92:0/1047377823 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5632d6809100 con 0x5632d68009a0 2024-09-19T08:57:50.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.630+0000 7fa123258740 1 -- 172.21.15.92:0/1047377823 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5632d66ed290 con 0x5632d68012e0 2024-09-19T08:57:50.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.630+0000 7fa123258740 1 -- 172.21.15.92:0/1047377823 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5632d6809280 con 0x5632d6806370 2024-09-19T08:57:50.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.630+0000 7fa123258740 10 client.0 _ll_register_callbacks cb 0x5632d671e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:50.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.631+0000 7fa11e180640 1 -- 172.21.15.92:0/1047377823 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632d6806370 msgr2=0x5632d6811ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:50.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.631+0000 7fa11e180640 1 --2- 172.21.15.92:0/1047377823 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632d6806370 0x5632d6811ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.631+0000 7fa11e180640 1 -- 172.21.15.92:0/1047377823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632d68012e0 msgr2=0x5632d680aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:50.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.631+0000 7fa11e180640 1 --2- 172.21.15.92:0/1047377823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632d68012e0 0x5632d680aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.631+0000 7fa11e180640 1 -- 172.21.15.92:0/1047377823 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632d6477210 con 0x5632d68009a0 2024-09-19T08:57:50.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.632+0000 7fa11e180640 1 --2- 172.21.15.92:0/1047377823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632d68009a0 0x5632d680a960 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa10c00bc50 tx=0x7fa10c00d6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d7669a2bc5d216 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:50.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.632+0000 7fa101ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:57:50.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.635+0000 7fa101ffb640 1 -- 172.21.15.92:0/1047377823 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10c016070 con 0x5632d68009a0 2024-09-19T08:57:50.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.635+0000 7fa101ffb640 1 -- 172.21.15.92:0/1047377823 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa10c010660 con 0x5632d68009a0 2024-09-19T08:57:50.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.635+0000 7fa123258740 1 -- 172.21.15.92:0/1047377823 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa110036040 con 0x5632d68009a0 2024-09-19T08:57:50.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.636+0000 7fa101ffb640 1 -- 172.21.15.92:0/1047377823 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa10c022050 con 0x5632d68009a0 2024-09-19T08:57:50.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.636+0000 7fa123258740 10 client.15660 fetch_fsmap learned FSMap version 19 2024-09-19T08:57:50.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.636+0000 7fa123258740 1 -- 172.21.15.92:0/1047377823 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5632d6543620 con 0x5632d68009a0 2024-09-19T08:57:50.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.637+0000 7fa101ffb640 1 -- 172.21.15.92:0/1047377823 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa110036040 con 0x5632d68009a0 2024-09-19T08:57:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.637+0000 7fa101ffb640 1 -- 172.21.15.92:0/1047377823 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fa10c00f950 con 0x5632d68009a0 2024-09-19T08:57:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.637+0000 7fa123258740 10 client.15660 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:57:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.637+0000 7fa123258740 10 client.15660 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T08:57:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.637+0000 7fa123258740 20 client.15660 populate_metadata read hostname 'smithi092' 2024-09-19T08:57:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.638+0000 7fa123258740 1 --2- 172.21.15.92:0/1047377823 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5632d6816ac0 0x5632d6818f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.638+0000 7fa123258740 4 client.15660 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:57:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.638+0000 7fa123258740 1 -- 172.21.15.92:0/1047377823 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5632d6771a20 con 0x5632d6816ac0 2024-09-19T08:57:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.638+0000 7fa11d97f640 1 --2- 172.21.15.92:0/1047377823 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5632d6816ac0 0x5632d6818f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:50.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.644+0000 7fa11d97f640 1 --2- 172.21.15.92:0/1047377823 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5632d6816ac0 0x5632d6818f20 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55590e75be25ee41 server_cookie=14f2f9b664056cc in_seq=0 out_seq=0 2024-09-19T08:57:50.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.644+0000 7fa101ffb640 10 client.15660 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:50.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.645+0000 7fa101ffb640 1 -- 172.21.15.92:0/1047377823 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5632d6771a20 con 0x5632d6816ac0 2024-09-19T08:57:50.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.645+0000 7fa101ffb640 10 client.15660 handle_command_reply: tid=0 2024-09-19T08:57:50.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.645+0000 7fa123258740 1 client.15660 shutdown 2024-09-19T08:57:50.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.646+0000 7fa123258740 1 -- 172.21.15.92:0/1047377823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632d68009a0 msgr2=0x5632d680a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:50.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.646+0000 7fa123258740 1 --2- 172.21.15.92:0/1047377823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632d68009a0 0x5632d680a960 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa10c00bc50 tx=0x7fa10c00d6b0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.649+0000 7fa123258740 1 -- 172.21.15.92:0/1047377823 shutdown_connections 2024-09-19T08:57:50.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.649+0000 7fa123258740 1 --2- 172.21.15.92:0/1047377823 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5632d6816ac0 0x5632d6818f20 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.649+0000 7fa123258740 1 --2- 172.21.15.92:0/1047377823 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632d6806370 0x5632d6811ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.649+0000 7fa123258740 1 --2- 172.21.15.92:0/1047377823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632d68012e0 0x5632d680aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.649+0000 7fa123258740 1 --2- 172.21.15.92:0/1047377823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632d68009a0 0x5632d680a960 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.649+0000 7fa123258740 1 -- 172.21.15.92:0/1047377823 >> 172.21.15.92:0/1047377823 conn(0x5632d67fc010 msgr2=0x5632d67fd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:50.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.649+0000 7fa101ffb640 0 client.15660 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:50.653 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.653+0000 7fa123258740 1 -- 172.21.15.92:0/1047377823 shutdown_connections 2024-09-19T08:57:50.653 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.653+0000 7fa123258740 1 -- 172.21.15.92:0/1047377823 wait complete. 2024-09-19T08:57:50.653 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.653+0000 7fa123258740 20 client.15660 trim_cache size 0 max 16384 2024-09-19T08:57:50.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.684+0000 7fa123258740 1 Processor -- start 2024-09-19T08:57:50.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.685+0000 7fa123258740 1 -- start start 2024-09-19T08:57:50.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.685+0000 7fa123258740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632d68009a0 0x5632d6800d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:50.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.685+0000 7fa123258740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632d68012e0 0x5632d6811e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:50.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.686+0000 7fa11e180640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632d68009a0 0x5632d6800d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:50.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.686+0000 7fa11e180640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632d68009a0 0x5632d6800d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:50974/0 (socket says 172.21.15.92:50974) 2024-09-19T08:57:50.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.686+0000 7fa123258740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632d6806370 0x5632d67fb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:50.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.686+0000 7fa123258740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa1181ad600 con 0x5632d68012e0 2024-09-19T08:57:50.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.686+0000 7fa123258740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa1181afea0 con 0x5632d68009a0 2024-09-19T08:57:50.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.686+0000 7fa123258740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa1181adc90 con 0x5632d6806370 2024-09-19T08:57:50.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.686+0000 7fa11e180640 1 -- 172.21.15.92:0/4024847248 learned_addr learned my addr 172.21.15.92:0/4024847248 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:50.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.686+0000 7fa11d97f640 1 --2- 172.21.15.92:0/4024847248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632d68012e0 0x5632d6811e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:50.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.686+0000 7fa11e981640 1 --2- 172.21.15.92:0/4024847248 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632d6806370 0x5632d67fb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:50.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.686+0000 7fa11e180640 1 -- 172.21.15.92:0/4024847248 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632d6806370 msgr2=0x5632d67fb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:50.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.686+0000 7fa11e180640 1 --2- 172.21.15.92:0/4024847248 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632d6806370 0x5632d67fb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.686+0000 7fa11e180640 1 -- 172.21.15.92:0/4024847248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632d68012e0 msgr2=0x5632d6811e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:50.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.686+0000 7fa11e180640 1 --2- 172.21.15.92:0/4024847248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632d68012e0 0x5632d6811e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.686+0000 7fa11e180640 1 -- 172.21.15.92:0/4024847248 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632d67fbe30 con 0x5632d68009a0 2024-09-19T08:57:50.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.686+0000 7fa11e981640 1 --2- 172.21.15.92:0/4024847248 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632d6806370 0x5632d67fb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:57:50.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.687+0000 7fa11e180640 1 --2- 172.21.15.92:0/4024847248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632d68009a0 0x5632d6800d80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa10c00dc60 tx=0x7fa10c00dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f749001dd635a8e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:50.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.687+0000 7fa103fff640 1 -- 172.21.15.92:0/4024847248 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10c02a070 con 0x5632d68009a0 2024-09-19T08:57:50.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.688+0000 7fa103fff640 1 -- 172.21.15.92:0/4024847248 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa10c005850 con 0x5632d68009a0 2024-09-19T08:57:50.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.688+0000 7fa103fff640 1 -- 172.21.15.92:0/4024847248 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10c016040 con 0x5632d68009a0 2024-09-19T08:57:50.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.689+0000 7fa123258740 1 -- 172.21.15.92:0/4024847248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632d68009a0 msgr2=0x5632d6800d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:50.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.689+0000 7fa123258740 1 --2- 172.21.15.92:0/4024847248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632d68009a0 0x5632d6800d80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa10c00dc60 tx=0x7fa10c00dc90 comp rx=0 tx=0).stop 2024-09-19T08:57:50.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.689+0000 7fa123258740 1 -- 172.21.15.92:0/4024847248 shutdown_connections 2024-09-19T08:57:50.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.689+0000 7fa123258740 1 --2- 172.21.15.92:0/4024847248 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632d6806370 0x5632d67fb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.689+0000 7fa123258740 1 --2- 172.21.15.92:0/4024847248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632d68012e0 0x5632d6811e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.689+0000 7fa123258740 1 --2- 172.21.15.92:0/4024847248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632d68009a0 0x5632d6800d80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.689+0000 7fa123258740 1 -- 172.21.15.92:0/4024847248 >> 172.21.15.92:0/4024847248 conn(0x5632d67fc010 msgr2=0x5632d67fa9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:50.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.689+0000 7fa123258740 1 -- 172.21.15.92:0/4024847248 shutdown_connections 2024-09-19T08:57:50.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.689+0000 7fa123258740 1 -- 172.21.15.92:0/4024847248 wait complete. 2024-09-19T08:57:50.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.690+0000 7fa123258740 1 -- start start 2024-09-19T08:57:50.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.690+0000 7fa123258740 1 Processor -- start 2024-09-19T08:57:50.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.690+0000 7fa123258740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632d68009a0 0x5632d680e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:50.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.690+0000 7fa123258740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632d68012e0 0x5632d680eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:50.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.691+0000 7fa123258740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632d6806370 0x5632d687f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:50.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.691+0000 7fa11e180640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632d68009a0 0x5632d680e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:50.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.691+0000 7fa123258740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa1181ae360 con 0x5632d68012e0 2024-09-19T08:57:50.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.691+0000 7fa123258740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa1181af7d0 con 0x5632d68009a0 2024-09-19T08:57:50.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.691+0000 7fa11e180640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632d68009a0 0x5632d680e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:50984/0 (socket says 172.21.15.92:50984) 2024-09-19T08:57:50.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.691+0000 7fa123258740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa1181aea30 con 0x5632d6806370 2024-09-19T08:57:50.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.691+0000 7fa11e180640 1 -- 172.21.15.92:0/1263604108 learned_addr learned my addr 172.21.15.92:0/1263604108 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:50.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.691+0000 7fa123258740 10 client.0 _ll_register_callbacks cb 0x7fa10c00b280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:50.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.691+0000 7fa11d97f640 1 --2- 172.21.15.92:0/1263604108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632d68012e0 0x5632d680eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:50.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.691+0000 7fa11e981640 1 --2- 172.21.15.92:0/1263604108 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632d6806370 0x5632d687f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:50.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.691+0000 7fa11e180640 1 -- 172.21.15.92:0/1263604108 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632d6806370 msgr2=0x5632d687f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:50.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.691+0000 7fa11e180640 1 --2- 172.21.15.92:0/1263604108 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632d6806370 0x5632d687f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.691+0000 7fa11e180640 1 -- 172.21.15.92:0/1263604108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632d68012e0 msgr2=0x5632d680eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:50.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.691+0000 7fa11e180640 1 --2- 172.21.15.92:0/1263604108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632d68012e0 0x5632d680eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.691+0000 7fa11e180640 1 -- 172.21.15.92:0/1263604108 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632d6811fb0 con 0x5632d68009a0 2024-09-19T08:57:50.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.691+0000 7fa11d97f640 1 --2- 172.21.15.92:0/1263604108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632d68012e0 0x5632d680eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:57:50.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.691+0000 7fa11e180640 1 --2- 172.21.15.92:0/1263604108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632d68009a0 0x5632d680e980 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa10c00f5f0 tx=0x7fa10c00f620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94291a675c66fbf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:50.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.691+0000 7fa101ffb640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T08:57:50.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.692+0000 7fa101ffb640 1 -- 172.21.15.92:0/1263604108 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10c033070 con 0x5632d68009a0 2024-09-19T08:57:50.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.692+0000 7fa123258740 1 -- 172.21.15.92:0/1263604108 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa10c005850 con 0x5632d68009a0 2024-09-19T08:57:50.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.692+0000 7fa101ffb640 1 -- 172.21.15.92:0/1263604108 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa10c00fa50 con 0x5632d68009a0 2024-09-19T08:57:50.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.693+0000 7fa101ffb640 1 -- 172.21.15.92:0/1263604108 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa10c03f050 con 0x5632d68009a0 2024-09-19T08:57:50.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.693+0000 7fa123258740 10 client.25097 fetch_fsmap learned FSMap version 19 2024-09-19T08:57:50.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.693+0000 7fa123258740 1 -- 172.21.15.92:0/1263604108 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5632d6880b10 con 0x5632d68009a0 2024-09-19T08:57:50.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.694+0000 7fa101ffb640 1 -- 172.21.15.92:0/1263604108 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa10c005850 con 0x5632d68009a0 2024-09-19T08:57:50.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.694+0000 7fa101ffb640 1 -- 172.21.15.92:0/1263604108 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fa10c02f450 con 0x5632d68009a0 2024-09-19T08:57:50.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.694+0000 7fa123258740 10 client.25097 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:57:50.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.694+0000 7fa123258740 10 client.25097 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T08:57:50.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.694+0000 7fa123258740 20 client.25097 populate_metadata read hostname 'smithi092' 2024-09-19T08:57:50.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.694+0000 7fa123258740 1 --2- 172.21.15.92:0/1263604108 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5632d68814c0 0x5632d68838e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:50.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.694+0000 7fa123258740 4 client.25097 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:57:50.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.694+0000 7fa123258740 1 -- 172.21.15.92:0/1263604108 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5632d676bd70 con 0x5632d68814c0 2024-09-19T08:57:50.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.694+0000 7fa11d97f640 1 --2- 172.21.15.92:0/1263604108 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5632d68814c0 0x5632d68838e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:50.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.695+0000 7fa11d97f640 1 --2- 172.21.15.92:0/1263604108 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5632d68814c0 0x5632d68838e0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d658af555772174 server_cookie=e94199777e824471 in_seq=0 out_seq=0 2024-09-19T08:57:50.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.696+0000 7fa101ffb640 10 client.25097 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:50.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.714+0000 7fa101ffb640 1 -- 172.21.15.92:0/1263604108 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5632d676bd70 con 0x5632d68814c0 2024-09-19T08:57:50.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.715+0000 7fa101ffb640 10 client.25097 handle_command_reply: tid=0 2024-09-19T08:57:50.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.715+0000 7fa123258740 1 client.25097 shutdown 2024-09-19T08:57:50.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.715+0000 7fa123258740 1 -- 172.21.15.92:0/1263604108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632d68009a0 msgr2=0x5632d680e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:50.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.715+0000 7fa123258740 1 --2- 172.21.15.92:0/1263604108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632d68009a0 0x5632d680e980 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa10c00f5f0 tx=0x7fa10c00f620 comp rx=0 tx=0).stop 2024-09-19T08:57:50.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.715+0000 7fa123258740 1 -- 172.21.15.92:0/1263604108 shutdown_connections 2024-09-19T08:57:50.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.715+0000 7fa123258740 1 --2- 172.21.15.92:0/1263604108 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5632d68814c0 0x5632d68838e0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.719 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.715+0000 7fa123258740 1 --2- 172.21.15.92:0/1263604108 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632d6806370 0x5632d687f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.719 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.715+0000 7fa123258740 1 --2- 172.21.15.92:0/1263604108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632d68012e0 0x5632d680eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.719 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.715+0000 7fa123258740 1 --2- 172.21.15.92:0/1263604108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632d68009a0 0x5632d680e980 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.719 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.715+0000 7fa123258740 1 -- 172.21.15.92:0/1263604108 >> 172.21.15.92:0/1263604108 conn(0x5632d67fc010 msgr2=0x5632d67fa9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:50.719 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.715+0000 7fa101ffb640 0 client.25097 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:50.719 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.716+0000 7fa123258740 1 -- 172.21.15.92:0/1263604108 shutdown_connections 2024-09-19T08:57:50.719 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.716+0000 7fa123258740 1 -- 172.21.15.92:0/1263604108 wait complete. 2024-09-19T08:57:50.719 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.716+0000 7fa123258740 20 client.25097 trim_cache size 0 max 16384 2024-09-19T08:57:50.719 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T08:57:50.719 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T08:57:50.719 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T08:57:50.720 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T08:57:50.720 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.717+0000 7fa1203e4640 1 -- 172.21.15.92:0/2784926371 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa1040a3550 msgr2=0x7fa1040a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:50.720 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.717+0000 7fa1203e4640 1 --2- 172.21.15.92:0/2784926371 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa1040a3550 0x7fa1040a5a10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa11819f880 tx=0x7fa11400b370 comp rx=0 tx=0).stop 2024-09-19T08:57:50.720 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.717+0000 7fa1203e4640 1 -- 172.21.15.92:0/2784926371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa118109cd0 msgr2=0x7fa1181a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:50.720 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.717+0000 7fa1203e4640 1 --2- 172.21.15.92:0/2784926371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa118109cd0 0x7fa1181a5920 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa1100098d0 tx=0x7fa110003ba0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.719+0000 7fa1203e4640 1 -- 172.21.15.92:0/2784926371 shutdown_connections 2024-09-19T08:57:50.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.721+0000 7fa1203e4640 1 --2- 172.21.15.92:0/2784926371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa118109cd0 0x7fa1181a5920 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.722+0000 7fa1203e4640 1 --2- 172.21.15.92:0/2784926371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa118109310 0x7fa11819e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.722+0000 7fa1203e4640 1 --2- 172.21.15.92:0/2784926371 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa1040a3550 0x7fa1040a5a10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.722+0000 7fa1203e4640 1 --2- 172.21.15.92:0/2784926371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1181084c0 0x7fa11819e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.722+0000 7fa1203e4640 1 -- 172.21.15.92:0/2784926371 >> 172.21.15.92:0/2784926371 conn(0x7fa11806b6d0 msgr2=0x7fa1180794e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:50.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.722+0000 7fa1203e4640 1 -- 172.21.15.92:0/2784926371 shutdown_connections 2024-09-19T08:57:50.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:57:50.722+0000 7fa1203e4640 1 -- 172.21.15.92:0/2784926371 wait complete. 2024-09-19T08:57:50.795 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 65.0 s, 1183.2 tps, lat 366.731 ms stddev 2644.604 2024-09-19T08:57:50.820 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:57:51.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.472+0000 7f3909202640 1 -- 172.21.15.92:0/1596018617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f390410ea80 msgr2=0x7f39041154f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:51.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.472+0000 7f3909202640 1 --2- 172.21.15.92:0/1596018617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f390410ea80 0x7f39041154f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f38fc009ca0 tx=0x7f38fc02a8b0 comp rx=0 tx=0).stop 2024-09-19T08:57:51.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.472+0000 7f3909202640 1 -- 172.21.15.92:0/1596018617 shutdown_connections 2024-09-19T08:57:51.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.472+0000 7f3909202640 1 --2- 172.21.15.92:0/1596018617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f390410ea80 0x7f39041154f0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:51.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.472+0000 7f3909202640 1 --2- 172.21.15.92:0/1596018617 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3904109e00 0x7f390410e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:51.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.472+0000 7f3909202640 1 --2- 172.21.15.92:0/1596018617 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3904109450 0x7f3904109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:51.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.472+0000 7f3909202640 1 -- 172.21.15.92:0/1596018617 >> 172.21.15.92:0/1596018617 conn(0x7f390406e2d0 msgr2=0x7f390406e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:51.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.473+0000 7f3909202640 1 -- 172.21.15.92:0/1596018617 shutdown_connections 2024-09-19T08:57:51.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.473+0000 7f3909202640 1 -- 172.21.15.92:0/1596018617 wait complete. 2024-09-19T08:57:51.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.474+0000 7f3909202640 1 Processor -- start 2024-09-19T08:57:51.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.474+0000 7f3909202640 1 -- start start 2024-09-19T08:57:51.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.475+0000 7f3909202640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3904109450 0x7f39041a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:51.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.475+0000 7f3909202640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3904109e00 0x7f39041a12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:51.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.475+0000 7f3909202640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f390410ea80 0x7f39041a5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:51.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.475+0000 7f3909202640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3904118640 con 0x7f3904109450 2024-09-19T08:57:51.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.475+0000 7f3902d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3904109450 0x7f39041a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:51.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.475+0000 7f3902d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3904109450 0x7f39041a0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41632/0 (socket says 172.21.15.92:41632) 2024-09-19T08:57:51.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.475+0000 7f3902d9d640 1 -- 172.21.15.92:0/3852423325 learned_addr learned my addr 172.21.15.92:0/3852423325 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:51.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.475+0000 7f3909202640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f39041184c0 con 0x7f390410ea80 2024-09-19T08:57:51.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.475+0000 7f390359e640 1 --2- 172.21.15.92:0/3852423325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f390410ea80 0x7f39041a5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:51.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.475+0000 7f3909202640 1 -- 172.21.15.92:0/3852423325 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f39041187c0 con 0x7f3904109e00 2024-09-19T08:57:51.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.475+0000 7f3902d9d640 1 -- 172.21.15.92:0/3852423325 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3904109e00 msgr2=0x7f39041a12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:51.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.475+0000 7f390259c640 1 --2- 172.21.15.92:0/3852423325 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3904109e00 0x7f39041a12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:51.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.476+0000 7f3902d9d640 1 --2- 172.21.15.92:0/3852423325 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3904109e00 0x7f39041a12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:51.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.476+0000 7f3902d9d640 1 -- 172.21.15.92:0/3852423325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f390410ea80 msgr2=0x7f39041a5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:51.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.476+0000 7f3902d9d640 1 --2- 172.21.15.92:0/3852423325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f390410ea80 0x7f39041a5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:51.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.476+0000 7f3902d9d640 1 -- 172.21.15.92:0/3852423325 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39041a5d30 con 0x7f3904109450 2024-09-19T08:57:51.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.476+0000 7f390259c640 1 --2- 172.21.15.92:0/3852423325 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3904109e00 0x7f39041a12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:57:51.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.476+0000 7f3902d9d640 1 --2- 172.21.15.92:0/3852423325 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3904109450 0x7f39041a0d80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f38f400f9e0 tx=0x7f38f400fea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:51.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.476+0000 7f38ebfff640 1 -- 172.21.15.92:0/3852423325 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f4010810 con 0x7f3904109450 2024-09-19T08:57:51.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.476+0000 7f38ebfff640 1 -- 172.21.15.92:0/3852423325 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38f400b450 con 0x7f3904109450 2024-09-19T08:57:51.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.476+0000 7f38ebfff640 1 -- 172.21.15.92:0/3852423325 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f4018650 con 0x7f3904109450 2024-09-19T08:57:51.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.477+0000 7f3909202640 1 -- 172.21.15.92:0/3852423325 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39041a5fc0 con 0x7f3904109450 2024-09-19T08:57:51.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.477+0000 7f3909202640 1 -- 172.21.15.92:0/3852423325 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f390410a310 con 0x7f3904109450 2024-09-19T08:57:51.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.479+0000 7f3909202640 1 -- 172.21.15.92:0/3852423325 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3904073f40 con 0x7f3904109450 2024-09-19T08:57:51.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.481+0000 7f38ebfff640 1 -- 172.21.15.92:0/3852423325 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f38f400b600 con 0x7f3904109450 2024-09-19T08:57:51.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.482+0000 7f38ebfff640 1 --2- 172.21.15.92:0/3852423325 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f38ec0a32b0 0x7f38ec0a5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:51.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.482+0000 7f38ebfff640 1 -- 172.21.15.92:0/3852423325 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f38f40d2bb0 con 0x7f3904109450 2024-09-19T08:57:51.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.484+0000 7f390259c640 1 --2- 172.21.15.92:0/3852423325 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f38ec0a32b0 0x7f38ec0a5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:51.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.485+0000 7f390259c640 1 --2- 172.21.15.92:0/3852423325 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f38ec0a32b0 0x7f38ec0a5770 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f38f8006fd0 tx=0x7f38f8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:51.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.494+0000 7f38ebfff640 1 -- 172.21.15.92:0/3852423325 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f38f409f8d0 con 0x7f3904109450 2024-09-19T08:57:51.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:51 smithi190 ceph-mon[35358]: pgmap v371: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 3.3 MiB/s wr, 215 op/s 2024-09-19T08:57:51.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:51 smithi092 ceph-mon[31407]: pgmap v371: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 3.3 MiB/s wr, 215 op/s 2024-09-19T08:57:51.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:51 smithi167 ceph-mon[35359]: pgmap v371: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 3.3 MiB/s wr, 215 op/s 2024-09-19T08:57:51.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.882+0000 7f3909202640 1 -- 172.21.15.92:0/3852423325 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3904112b30 con 0x7f3904109450 2024-09-19T08:57:51.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.883+0000 7f38ebfff640 1 -- 172.21.15.92:0/3852423325 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f38f409f1d0 con 0x7f3904109450 2024-09-19T08:57:51.883 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:57:51.883 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T08:57:51.883 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T08:57:51.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.887+0000 7f3909202640 1 -- 172.21.15.92:0/3852423325 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f38ec0a32b0 msgr2=0x7f38ec0a5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:51.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.887+0000 7f3909202640 1 --2- 172.21.15.92:0/3852423325 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f38ec0a32b0 0x7f38ec0a5770 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f38f8006fd0 tx=0x7f38f8008040 comp rx=0 tx=0).stop 2024-09-19T08:57:51.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.887+0000 7f3909202640 1 -- 172.21.15.92:0/3852423325 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3904109450 msgr2=0x7f39041a0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:51.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.887+0000 7f3909202640 1 --2- 172.21.15.92:0/3852423325 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3904109450 0x7f39041a0d80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f38f400f9e0 tx=0x7f38f400fea0 comp rx=0 tx=0).stop 2024-09-19T08:57:51.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.887+0000 7f3909202640 1 -- 172.21.15.92:0/3852423325 shutdown_connections 2024-09-19T08:57:51.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.887+0000 7f3909202640 1 --2- 172.21.15.92:0/3852423325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f390410ea80 0x7f39041a5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:51.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.887+0000 7f3909202640 1 --2- 172.21.15.92:0/3852423325 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3904109e00 0x7f39041a12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:51.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.887+0000 7f3909202640 1 --2- 172.21.15.92:0/3852423325 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f38ec0a32b0 0x7f38ec0a5770 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:51.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.887+0000 7f3909202640 1 --2- 172.21.15.92:0/3852423325 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3904109450 0x7f39041a0d80 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:51.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.887+0000 7f3909202640 1 -- 172.21.15.92:0/3852423325 >> 172.21.15.92:0/3852423325 conn(0x7f390406e2d0 msgr2=0x7f390410c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:51.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.887+0000 7f3909202640 1 -- 172.21.15.92:0/3852423325 shutdown_connections 2024-09-19T08:57:51.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:51.887+0000 7f3909202640 1 -- 172.21.15.92:0/3852423325 wait complete. 2024-09-19T08:57:52.692 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:52 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3852423325' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:57:52.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:52 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3852423325' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:57:52.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:52 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3852423325' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:57:53.026 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-09-19T08:57:53.027 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-09-19T08:57:53.429 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:57:53.706 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:53 smithi092 ceph-mon[31407]: pgmap v372: 97 pgs: 97 active+clean; 1.0 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 8.6 MiB/s wr, 247 op/s 2024-09-19T08:57:53.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:53 smithi167 ceph-mon[35359]: pgmap v372: 97 pgs: 97 active+clean; 1.0 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 8.6 MiB/s wr, 247 op/s 2024-09-19T08:57:53.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:53 smithi190 ceph-mon[35358]: pgmap v372: 97 pgs: 97 active+clean; 1.0 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 8.6 MiB/s wr, 247 op/s 2024-09-19T08:57:53.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.971+0000 7f130e7fc640 1 -- 172.21.15.92:0/3402269927 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13040319b0 con 0x7f130809d790 2024-09-19T08:57:53.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.972+0000 7f1315b84640 1 -- 172.21.15.92:0/3402269927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f130809d790 msgr2=0x7f130809db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:53.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.972+0000 7f1315b84640 1 --2- 172.21.15.92:0/3402269927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f130809d790 0x7f130809db70 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f1304009930 tx=0x7f130402a420 comp rx=0 tx=0).stop 2024-09-19T08:57:53.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.972+0000 7f1315b84640 1 -- 172.21.15.92:0/3402269927 shutdown_connections 2024-09-19T08:57:53.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.972+0000 7f1315b84640 1 --2- 172.21.15.92:0/3402269927 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1308098130 0x7f13080a4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.972+0000 7f1315b84640 1 --2- 172.21.15.92:0/3402269927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1308097790 0x7f1308097bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.972+0000 7f1315b84640 1 --2- 172.21.15.92:0/3402269927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f130809d790 0x7f130809db70 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.972+0000 7f1315b84640 1 -- 172.21.15.92:0/3402269927 >> 172.21.15.92:0/3402269927 conn(0x7f1308093470 msgr2=0x7f1308095890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:53.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.972+0000 7f1315b84640 1 -- 172.21.15.92:0/3402269927 shutdown_connections 2024-09-19T08:57:53.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.972+0000 7f1315b84640 1 -- 172.21.15.92:0/3402269927 wait complete. 2024-09-19T08:57:53.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.973+0000 7f1315b84640 1 Processor -- start 2024-09-19T08:57:53.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.973+0000 7f1315b84640 1 -- start start 2024-09-19T08:57:53.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.974+0000 7f1315b84640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1308097790 0x7f1308009480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:53.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.974+0000 7f1315b84640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1308098130 0x7f13080099c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:53.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.974+0000 7f1315b84640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f130809d790 0x7f1308009f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:53.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.974+0000 7f1315b84640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f13080a7c00 con 0x7f1308097790 2024-09-19T08:57:53.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.974+0000 7f1315b84640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f13080a7a80 con 0x7f130809d790 2024-09-19T08:57:53.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.974+0000 7f1315b84640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f13080a7d80 con 0x7f1308098130 2024-09-19T08:57:53.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.974+0000 7f130effd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1308098130 0x7f13080099c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:53.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.974+0000 7f130effd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1308098130 0x7f13080099c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:43336/0 (socket says 172.21.15.92:43336) 2024-09-19T08:57:53.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.974+0000 7f130effd640 1 -- 172.21.15.92:0/4024591664 learned_addr learned my addr 172.21.15.92:0/4024591664 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:53.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.974+0000 7f130ffff640 1 --2- 172.21.15.92:0/4024591664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f130809d790 0x7f1308009f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:53.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.974+0000 7f130ffff640 1 -- 172.21.15.92:0/4024591664 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1308098130 msgr2=0x7f13080099c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:53.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.974+0000 7f130ffff640 1 --2- 172.21.15.92:0/4024591664 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1308098130 0x7f13080099c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.974+0000 7f130ffff640 1 -- 172.21.15.92:0/4024591664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1308097790 msgr2=0x7f1308009480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:53.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.974+0000 7f130ffff640 1 --2- 172.21.15.92:0/4024591664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1308097790 0x7f1308009480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.974+0000 7f130ffff640 1 -- 172.21.15.92:0/4024591664 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f130813e7d0 con 0x7f130809d790 2024-09-19T08:57:53.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.974+0000 7f130effd640 1 --2- 172.21.15.92:0/4024591664 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1308098130 0x7f13080099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:57:53.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.975+0000 7f130ffff640 1 --2- 172.21.15.92:0/4024591664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f130809d790 0x7f1308009f00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f13100679d0 tx=0x7f131006bb60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:53.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.975+0000 7f130cff9640 1 -- 172.21.15.92:0/4024591664 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1310085070 con 0x7f130809d790 2024-09-19T08:57:53.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.975+0000 7f130cff9640 1 -- 172.21.15.92:0/4024591664 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1310075e30 con 0x7f130809d790 2024-09-19T08:57:53.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.975+0000 7f130cff9640 1 -- 172.21.15.92:0/4024591664 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f131007f980 con 0x7f130809d790 2024-09-19T08:57:53.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.975+0000 7f1315b84640 1 -- 172.21.15.92:0/4024591664 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f130813eac0 con 0x7f130809d790 2024-09-19T08:57:53.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.976+0000 7f1315b84640 1 -- 172.21.15.92:0/4024591664 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f130813efb0 con 0x7f130809d790 2024-09-19T08:57:53.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.979+0000 7f130cff9640 1 -- 172.21.15.92:0/4024591664 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1310088070 con 0x7f130809d790 2024-09-19T08:57:53.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.979+0000 7f1317f5d740 1 Processor -- start 2024-09-19T08:57:53.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.980+0000 7f130cff9640 1 --2- 172.21.15.92:0/4024591664 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f13000a3420 0x7f13000a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:53.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.981+0000 7f1317f5d740 1 -- start start 2024-09-19T08:57:53.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.981+0000 7f130effd640 1 --2- 172.21.15.92:0/4024591664 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f13000a3420 0x7f13000a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:53.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.981+0000 7f1317f5d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d77d93a20 0x563d77d93e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:53.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.981+0000 7f1317f5d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d77d94340 0x563d77d9e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:53.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.981+0000 7f1317f5d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563d77d9ec00 0x563d77da0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:53.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.981+0000 7f1317f5d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563d77cf8160 con 0x563d77d93a20 2024-09-19T08:57:53.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.981+0000 7f130cff9640 1 -- 172.21.15.92:0/4024591664 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f131013adc0 con 0x7f130809d790 2024-09-19T08:57:53.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.981+0000 7f1317f5d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563d77c9f720 con 0x563d77d94340 2024-09-19T08:57:53.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.981+0000 7f1317f5d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x563d77cf4120 con 0x563d77d9ec00 2024-09-19T08:57:53.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.981+0000 7f130effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d77d94340 0x563d77d9e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:53.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.981+0000 7f130effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d77d94340 0x563d77d9e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:56626/0 (socket says 172.21.15.92:56626) 2024-09-19T08:57:53.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.981+0000 7f130effd640 1 -- 172.21.15.92:0/662002330 learned_addr learned my addr 172.21.15.92:0/662002330 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:53.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.981+0000 7f130f7fe640 1 --2- 172.21.15.92:0/662002330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d77d93a20 0x563d77d93e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:53.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.981+0000 7f130ffff640 1 --2- 172.21.15.92:0/662002330 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563d77d9ec00 0x563d77da0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:53.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.982+0000 7f130effd640 1 -- 172.21.15.92:0/662002330 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563d77d9ec00 msgr2=0x563d77da0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:53.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.982+0000 7f130effd640 1 --2- 172.21.15.92:0/662002330 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563d77d9ec00 0x563d77da0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.982+0000 7f130effd640 1 -- 172.21.15.92:0/662002330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d77d93a20 msgr2=0x563d77d93e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:53.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.982+0000 7f130effd640 1 --2- 172.21.15.92:0/662002330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d77d93a20 0x563d77d93e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.982+0000 7f130effd640 1 -- 172.21.15.92:0/662002330 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d77a69ba0 con 0x563d77d94340 2024-09-19T08:57:53.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.982+0000 7f130effd640 1 --2- 172.21.15.92:0/662002330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d77d94340 0x563d77d9e6c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f12fc005d00 tx=0x7f12fc01c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12e889c7f5b980dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:53.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.982+0000 7f130effd640 1 --2- 172.21.15.92:0/4024591664 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f13000a3420 0x7f13000a58e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f12fc012e40 tx=0x7f12fc00bd10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:53.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.982+0000 7f12f9ffb640 1 -- 172.21.15.92:0/662002330 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12fc00ede0 con 0x563d77d94340 2024-09-19T08:57:53.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.982+0000 7f12f9ffb640 1 -- 172.21.15.92:0/662002330 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12fc025070 con 0x563d77d94340 2024-09-19T08:57:53.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.982+0000 7f12f9ffb640 1 -- 172.21.15.92:0/662002330 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12fc010b60 con 0x563d77d94340 2024-09-19T08:57:53.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.983+0000 7f1317f5d740 1 -- 172.21.15.92:0/662002330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d77d94340 msgr2=0x563d77d9e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:53.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.983+0000 7f1317f5d740 1 --2- 172.21.15.92:0/662002330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d77d94340 0x563d77d9e6c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f12fc005d00 tx=0x7f12fc01c000 comp rx=0 tx=0).stop 2024-09-19T08:57:53.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.983+0000 7f1317f5d740 1 -- 172.21.15.92:0/662002330 shutdown_connections 2024-09-19T08:57:53.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.984+0000 7f1317f5d740 1 --2- 172.21.15.92:0/662002330 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563d77d9ec00 0x563d77da0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.984+0000 7f1317f5d740 1 --2- 172.21.15.92:0/662002330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d77d94340 0x563d77d9e6c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.984+0000 7f1317f5d740 1 --2- 172.21.15.92:0/662002330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d77d93a20 0x563d77d93e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.984+0000 7f1317f5d740 1 -- 172.21.15.92:0/662002330 >> 172.21.15.92:0/662002330 conn(0x563d77d8ffb0 msgr2=0x563d77d90390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:53.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.984+0000 7f1317f5d740 1 -- 172.21.15.92:0/662002330 shutdown_connections 2024-09-19T08:57:53.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.984+0000 7f1317f5d740 1 -- 172.21.15.92:0/662002330 wait complete. 2024-09-19T08:57:53.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.985+0000 7f1317f5d740 1 -- start start 2024-09-19T08:57:53.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.985+0000 7f1317f5d740 1 Processor -- start 2024-09-19T08:57:53.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.986+0000 7f1317f5d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d77d93a20 0x563d77d9bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:53.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.986+0000 7f1317f5d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563d77d94340 0x563d77d9c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:53.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.986+0000 7f1317f5d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d77d9ec00 0x563d77d9c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:53.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.986+0000 7f1317f5d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563d77db2780 con 0x563d77d9ec00 2024-09-19T08:57:53.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.986+0000 7f1317f5d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563d77c80900 con 0x563d77d93a20 2024-09-19T08:57:53.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.986+0000 7f1317f5d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x563d77db2900 con 0x563d77d94340 2024-09-19T08:57:53.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.986+0000 7f1317f5d740 10 client.0 _ll_register_callbacks cb 0x563d77c7e780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:53.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.987+0000 7f130ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d77d9ec00 0x563d77d9c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:53.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.987+0000 7f130ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d77d9ec00 0x563d77d9c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41672/0 (socket says 172.21.15.92:41672) 2024-09-19T08:57:53.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.987+0000 7f130ffff640 1 -- 172.21.15.92:0/2786273042 learned_addr learned my addr 172.21.15.92:0/2786273042 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:53.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.987+0000 7f130f7fe640 1 --2- 172.21.15.92:0/2786273042 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d77d93a20 0x563d77d9bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:53.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.987+0000 7f130ffff640 1 -- 172.21.15.92:0/2786273042 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563d77d94340 msgr2=0x563d77d9c040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T08:57:53.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.987+0000 7f130ffff640 1 --2- 172.21.15.92:0/2786273042 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563d77d94340 0x563d77d9c040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.987+0000 7f130ffff640 1 -- 172.21.15.92:0/2786273042 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d77d93a20 msgr2=0x563d77d9bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:53.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.987+0000 7f130ffff640 1 --2- 172.21.15.92:0/2786273042 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d77d93a20 0x563d77d9bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.987+0000 7f130ffff640 1 -- 172.21.15.92:0/2786273042 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d77cc0c50 con 0x563d77d9ec00 2024-09-19T08:57:53.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.987+0000 7f130f7fe640 1 --2- 172.21.15.92:0/2786273042 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d77d93a20 0x563d77d9bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:57:53.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.988+0000 7f130ffff640 1 --2- 172.21.15.92:0/2786273042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d77d9ec00 0x563d77d9c580 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f13100654a0 tx=0x7f131007f430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e872431fabb193 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:53.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.988+0000 7f12eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:57:53.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.988+0000 7f12eeffd640 1 -- 172.21.15.92:0/2786273042 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1310120060 con 0x563d77d9ec00 2024-09-19T08:57:53.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.988+0000 7f1317f5d740 1 -- 172.21.15.92:0/2786273042 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12fc025070 con 0x563d77d9ec00 2024-09-19T08:57:53.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.988+0000 7f12eeffd640 1 -- 172.21.15.92:0/2786273042 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1310120200 con 0x563d77d9ec00 2024-09-19T08:57:53.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.989+0000 7f12eeffd640 1 -- 172.21.15.92:0/2786273042 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1310110010 con 0x563d77d9ec00 2024-09-19T08:57:53.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.989+0000 7f1317f5d740 10 client.15681 fetch_fsmap learned FSMap version 19 2024-09-19T08:57:53.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.989+0000 7f1317f5d740 1 -- 172.21.15.92:0/2786273042 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x563d77dbe560 con 0x563d77d9ec00 2024-09-19T08:57:53.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.990+0000 7f12eeffd640 1 -- 172.21.15.92:0/2786273042 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12fc025070 con 0x563d77d9ec00 2024-09-19T08:57:53.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.990+0000 7f12eeffd640 1 -- 172.21.15.92:0/2786273042 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f13101031a0 con 0x563d77d9ec00 2024-09-19T08:57:53.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.990+0000 7f1317f5d740 10 client.15681 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:57:53.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.990+0000 7f1317f5d740 10 client.15681 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T08:57:53.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.990+0000 7f1317f5d740 20 client.15681 populate_metadata read hostname 'smithi092' 2024-09-19T08:57:53.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.990+0000 7f1317f5d740 1 --2- 172.21.15.92:0/2786273042 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x563d77dbfe10 0x563d77dc22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:53.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.990+0000 7f1317f5d740 4 client.15681 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:57:53.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.990+0000 7f1317f5d740 1 -- 172.21.15.92:0/2786273042 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d77d05890 con 0x563d77dbfe10 2024-09-19T08:57:53.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.990+0000 7f130f7fe640 1 --2- 172.21.15.92:0/2786273042 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x563d77dbfe10 0x563d77dc22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:53.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.992+0000 7f12eeffd640 10 client.15681 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:53.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.992+0000 7f130f7fe640 1 --2- 172.21.15.92:0/2786273042 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x563d77dbfe10 0x563d77dc22d0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f40dcaf71adcdcdf server_cookie=d45600d2634b5ea4 in_seq=0 out_seq=0 2024-09-19T08:57:53.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.993+0000 7f12eeffd640 1 -- 172.21.15.92:0/2786273042 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563d77d05890 con 0x563d77dbfe10 2024-09-19T08:57:53.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.993+0000 7f12eeffd640 10 client.15681 handle_command_reply: tid=0 2024-09-19T08:57:53.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.993+0000 7f1317f5d740 1 client.15681 shutdown 2024-09-19T08:57:53.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.994+0000 7f1317f5d740 1 -- 172.21.15.92:0/2786273042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d77d9ec00 msgr2=0x563d77d9c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:53.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.994+0000 7f1317f5d740 1 --2- 172.21.15.92:0/2786273042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d77d9ec00 0x563d77d9c580 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f13100654a0 tx=0x7f131007f430 comp rx=0 tx=0).stop 2024-09-19T08:57:53.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.994+0000 7f1317f5d740 1 -- 172.21.15.92:0/2786273042 shutdown_connections 2024-09-19T08:57:53.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.994+0000 7f1317f5d740 1 --2- 172.21.15.92:0/2786273042 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x563d77dbfe10 0x563d77dc22d0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.994+0000 7f1317f5d740 1 --2- 172.21.15.92:0/2786273042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d77d9ec00 0x563d77d9c580 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.994+0000 7f1317f5d740 1 --2- 172.21.15.92:0/2786273042 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563d77d94340 0x563d77d9c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.994+0000 7f1317f5d740 1 --2- 172.21.15.92:0/2786273042 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d77d93a20 0x563d77d9bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.994+0000 7f1317f5d740 1 -- 172.21.15.92:0/2786273042 >> 172.21.15.92:0/2786273042 conn(0x563d77d8ffb0 msgr2=0x563d77d95ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:53.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.994+0000 7f12eeffd640 0 client.15681 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:53.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.995+0000 7f1317f5d740 1 -- 172.21.15.92:0/2786273042 shutdown_connections 2024-09-19T08:57:53.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.995+0000 7f1317f5d740 1 -- 172.21.15.92:0/2786273042 wait complete. 2024-09-19T08:57:53.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:53.995+0000 7f1317f5d740 20 client.15681 trim_cache size 0 max 16384 2024-09-19T08:57:54.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.028+0000 7f1317f5d740 1 Processor -- start 2024-09-19T08:57:54.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.028+0000 7f1317f5d740 1 -- start start 2024-09-19T08:57:54.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.029+0000 7f1317f5d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d77d93a20 0x563d77d964d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:54.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.029+0000 7f1317f5d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d77d94340 0x563d77d9c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:54.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.029+0000 7f1317f5d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563d77d9ec00 0x563d77dc7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:54.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.029+0000 7f1317f5d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1308098ed0 con 0x563d77d94340 2024-09-19T08:57:54.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.029+0000 7f1317f5d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f130813f690 con 0x563d77d93a20 2024-09-19T08:57:54.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.029+0000 7f1317f5d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1308134880 con 0x563d77d9ec00 2024-09-19T08:57:54.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.029+0000 7f130effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d77d94340 0x563d77d9c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:54.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.029+0000 7f130f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d77d93a20 0x563d77d964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:54.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.029+0000 7f130effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d77d94340 0x563d77d9c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41684/0 (socket says 172.21.15.92:41684) 2024-09-19T08:57:54.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.029+0000 7f130effd640 1 -- 172.21.15.92:0/3292028618 learned_addr learned my addr 172.21.15.92:0/3292028618 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:54.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.029+0000 7f130ffff640 1 --2- 172.21.15.92:0/3292028618 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563d77d9ec00 0x563d77dc7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:54.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.029+0000 7f130f7fe640 1 -- 172.21.15.92:0/3292028618 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563d77d9ec00 msgr2=0x563d77dc7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:54.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.029+0000 7f130f7fe640 1 --2- 172.21.15.92:0/3292028618 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563d77d9ec00 0x563d77dc7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:54.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.029+0000 7f130f7fe640 1 -- 172.21.15.92:0/3292028618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d77d94340 msgr2=0x563d77d9c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:54.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.029+0000 7f130f7fe640 1 --2- 172.21.15.92:0/3292028618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d77d94340 0x563d77d9c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:54.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.029+0000 7f130f7fe640 1 -- 172.21.15.92:0/3292028618 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d77d8fde0 con 0x563d77d93a20 2024-09-19T08:57:54.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.029+0000 7f130ffff640 1 --2- 172.21.15.92:0/3292028618 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563d77d9ec00 0x563d77dc7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:57:54.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.030+0000 7f130f7fe640 1 --2- 172.21.15.92:0/3292028618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d77d93a20 0x563d77d964d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1304005940 tx=0x7f1304005a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cb18c87463d6bc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:54.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.031+0000 7f12f97fa640 1 -- 172.21.15.92:0/3292028618 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f130404a070 con 0x563d77d93a20 2024-09-19T08:57:54.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.031+0000 7f12f97fa640 1 -- 172.21.15.92:0/3292028618 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1304005040 con 0x563d77d93a20 2024-09-19T08:57:54.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.031+0000 7f12f97fa640 1 -- 172.21.15.92:0/3292028618 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1304035040 con 0x563d77d93a20 2024-09-19T08:57:54.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.032+0000 7f1317f5d740 1 -- 172.21.15.92:0/3292028618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d77d93a20 msgr2=0x563d77d964d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:54.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.032+0000 7f1317f5d740 1 --2- 172.21.15.92:0/3292028618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d77d93a20 0x563d77d964d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1304005940 tx=0x7f1304005a20 comp rx=0 tx=0).stop 2024-09-19T08:57:54.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.033+0000 7f1317f5d740 1 -- 172.21.15.92:0/3292028618 shutdown_connections 2024-09-19T08:57:54.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.033+0000 7f1317f5d740 1 --2- 172.21.15.92:0/3292028618 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563d77d9ec00 0x563d77dc7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:54.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.033+0000 7f1317f5d740 1 --2- 172.21.15.92:0/3292028618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d77d94340 0x563d77d9c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:54.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.033+0000 7f1317f5d740 1 --2- 172.21.15.92:0/3292028618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d77d93a20 0x563d77d964d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:54.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.033+0000 7f1317f5d740 1 -- 172.21.15.92:0/3292028618 >> 172.21.15.92:0/3292028618 conn(0x563d77d8ffb0 msgr2=0x563d77d9db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:54.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.034+0000 7f1317f5d740 1 -- 172.21.15.92:0/3292028618 shutdown_connections 2024-09-19T08:57:54.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.034+0000 7f1317f5d740 1 -- 172.21.15.92:0/3292028618 wait complete. 2024-09-19T08:57:54.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.034+0000 7f1317f5d740 1 -- start start 2024-09-19T08:57:54.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.035+0000 7f1317f5d740 1 Processor -- start 2024-09-19T08:57:54.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.036+0000 7f1317f5d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d77d93a20 0x563d77db8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:54.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.036+0000 7f1317f5d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d77d94340 0x563d77db3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:54.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.036+0000 7f1317f5d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563d77d9ec00 0x563d77db3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:54.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.036+0000 7f1317f5d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1308134f50 con 0x563d77d94340 2024-09-19T08:57:54.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.036+0000 7f1317f5d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f13081363c0 con 0x563d77d93a20 2024-09-19T08:57:54.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.036+0000 7f1317f5d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1308135620 con 0x563d77d9ec00 2024-09-19T08:57:54.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.036+0000 7f130f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d77d93a20 0x563d77db8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:54.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.036+0000 7f130f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d77d93a20 0x563d77db8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:56662/0 (socket says 172.21.15.92:56662) 2024-09-19T08:57:54.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.036+0000 7f130f7fe640 1 -- 172.21.15.92:0/2197104998 learned_addr learned my addr 172.21.15.92:0/2197104998 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:57:54.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.036+0000 7f1317f5d740 10 client.0 _ll_register_callbacks cb 0x7f1310106f90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:54.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.036+0000 7f130f7fe640 1 -- 172.21.15.92:0/2197104998 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563d77d9ec00 msgr2=0x563d77db3fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T08:57:54.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.036+0000 7f130f7fe640 1 --2- 172.21.15.92:0/2197104998 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563d77d9ec00 0x563d77db3fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:54.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.036+0000 7f130f7fe640 1 -- 172.21.15.92:0/2197104998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d77d94340 msgr2=0x563d77db3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:54.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.036+0000 7f130f7fe640 1 --2- 172.21.15.92:0/2197104998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d77d94340 0x563d77db3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:54.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.036+0000 7f130f7fe640 1 -- 172.21.15.92:0/2197104998 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d77e29bb0 con 0x563d77d93a20 2024-09-19T08:57:54.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.037+0000 7f130f7fe640 1 --2- 172.21.15.92:0/2197104998 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d77d93a20 0x563d77db8500 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1304009850 tx=0x7f1304009680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9688b44b77c9a9a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:54.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.037+0000 7f12eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T08:57:54.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.037+0000 7f12eeffd640 1 -- 172.21.15.92:0/2197104998 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1304052060 con 0x563d77d93a20 2024-09-19T08:57:54.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.037+0000 7f12eeffd640 1 -- 172.21.15.92:0/2197104998 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1304031750 con 0x563d77d93a20 2024-09-19T08:57:54.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.037+0000 7f1317f5d740 1 -- 172.21.15.92:0/2197104998 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1304005040 con 0x563d77d93a20 2024-09-19T08:57:54.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.038+0000 7f12eeffd640 1 -- 172.21.15.92:0/2197104998 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1304035050 con 0x563d77d93a20 2024-09-19T08:57:54.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.038+0000 7f1317f5d740 10 client.25112 fetch_fsmap learned FSMap version 19 2024-09-19T08:57:54.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.038+0000 7f1317f5d740 1 -- 172.21.15.92:0/2197104998 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x563d77e2ad30 con 0x563d77d93a20 2024-09-19T08:57:54.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.038+0000 7f12eeffd640 1 -- 172.21.15.92:0/2197104998 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1304005040 con 0x563d77d93a20 2024-09-19T08:57:54.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.039+0000 7f12eeffd640 1 -- 172.21.15.92:0/2197104998 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1304003730 con 0x563d77d93a20 2024-09-19T08:57:54.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.039+0000 7f1317f5d740 10 client.25112 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:57:54.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.039+0000 7f1317f5d740 10 client.25112 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T08:57:54.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.039+0000 7f1317f5d740 20 client.25112 populate_metadata read hostname 'smithi092' 2024-09-19T08:57:54.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.039+0000 7f1317f5d740 1 --2- 172.21.15.92:0/2197104998 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x563d77e2b290 0x563d77e2d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:54.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.039+0000 7f1317f5d740 4 client.25112 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-09-19T08:57:54.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.039+0000 7f1317f5d740 1 -- 172.21.15.92:0/2197104998 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x563d77cffbe0 con 0x563d77e2b290 2024-09-19T08:57:54.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.039+0000 7f130effd640 1 --2- 172.21.15.92:0/2197104998 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x563d77e2b290 0x563d77e2d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:54.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.040+0000 7f130effd640 1 --2- 172.21.15.92:0/2197104998 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x563d77e2b290 0x563d77e2d6f0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57c1537f4b9dc1f8 server_cookie=cff532f895f94b22 in_seq=0 out_seq=0 2024-09-19T08:57:54.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.040+0000 7f12eeffd640 10 client.25112 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:54.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.270+0000 7f12eeffd640 1 -- 172.21.15.92:0/2197104998 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x563d77cffbe0 con 0x563d77e2b290 2024-09-19T08:57:54.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.270+0000 7f12eeffd640 10 client.25112 handle_command_reply: tid=0 2024-09-19T08:57:54.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.270+0000 7f1317f5d740 1 client.25112 shutdown 2024-09-19T08:57:54.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.271+0000 7f1317f5d740 1 -- 172.21.15.92:0/2197104998 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d77d93a20 msgr2=0x563d77db8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:54.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.271+0000 7f1317f5d740 1 --2- 172.21.15.92:0/2197104998 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d77d93a20 0x563d77db8500 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1304009850 tx=0x7f1304009680 comp rx=0 tx=0).stop 2024-09-19T08:57:54.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.271+0000 7f1317f5d740 1 -- 172.21.15.92:0/2197104998 shutdown_connections 2024-09-19T08:57:54.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.271+0000 7f1317f5d740 1 --2- 172.21.15.92:0/2197104998 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x563d77e2b290 0x563d77e2d6f0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:54.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.271+0000 7f1317f5d740 1 --2- 172.21.15.92:0/2197104998 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563d77d9ec00 0x563d77db3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:54.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.271+0000 7f1317f5d740 1 --2- 172.21.15.92:0/2197104998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563d77d94340 0x563d77db3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:54.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.271+0000 7f12eeffd640 0 client.25112 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:57:54.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.271+0000 7f1317f5d740 1 --2- 172.21.15.92:0/2197104998 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563d77d93a20 0x563d77db8500 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:54.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.271+0000 7f1317f5d740 1 -- 172.21.15.92:0/2197104998 >> 172.21.15.92:0/2197104998 conn(0x563d77d8ffb0 msgr2=0x563d77dbaa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:54.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.271+0000 7f1317f5d740 1 -- 172.21.15.92:0/2197104998 shutdown_connections 2024-09-19T08:57:54.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.271+0000 7f1317f5d740 1 -- 172.21.15.92:0/2197104998 wait complete. 2024-09-19T08:57:54.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.271+0000 7f1317f5d740 20 client.25112 trim_cache size 0 max 16384 2024-09-19T08:57:54.272 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T08:57:54.272 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 19, 2024-09-19T08:57:54.272 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24472, 2024-09-19T08:57:54.272 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 10, 2024-09-19T08:57:54.272 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-09-19T08:57:54.272 INFO:teuthology.orchestra.run.smithi092.stdout: "507ce254": { 2024-09-19T08:57:54.273 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 10, 2024-09-19T08:57:54.273 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-09-19T08:57:54.273 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T08:57:54.273 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-09-19T08:57:54.273 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T08:57:54.273 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T08:57:54.273 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 90.0, 2024-09-19T08:57:54.273 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 140.3, 2024-09-19T08:57:54.273 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-09-19T08:57:54.273 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-09-19T08:57:54.273 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-09-19T08:57:54.273 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T08:57:54.273 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-09-19T08:57:54.273 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T08:57:54.274 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:57:54.274 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:57:54.274 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:57:54.274 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:57:54.274 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:57:54.274 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T08:57:54.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.271+0000 7f1315b84640 1 -- 172.21.15.92:0/4024591664 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f13000a3420 msgr2=0x7f13000a58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:54.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.271+0000 7f1315b84640 1 --2- 172.21.15.92:0/4024591664 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f13000a3420 0x7f13000a58e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f12fc012e40 tx=0x7f12fc00bd10 comp rx=0 tx=0).stop 2024-09-19T08:57:54.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.271+0000 7f1315b84640 1 -- 172.21.15.92:0/4024591664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f130809d790 msgr2=0x7f1308009f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:54.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.271+0000 7f1315b84640 1 --2- 172.21.15.92:0/4024591664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f130809d790 0x7f1308009f00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f13100679d0 tx=0x7f131006bb60 comp rx=0 tx=0).stop 2024-09-19T08:57:54.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.271+0000 7f1315b84640 1 -- 172.21.15.92:0/4024591664 shutdown_connections 2024-09-19T08:57:54.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.271+0000 7f1315b84640 1 --2- 172.21.15.92:0/4024591664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f130809d790 0x7f1308009f00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:54.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.271+0000 7f1315b84640 1 --2- 172.21.15.92:0/4024591664 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1308098130 0x7f13080099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:54.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.271+0000 7f1315b84640 1 --2- 172.21.15.92:0/4024591664 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f13000a3420 0x7f13000a58e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:54.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.271+0000 7f1315b84640 1 --2- 172.21.15.92:0/4024591664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1308097790 0x7f1308009480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:54.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.271+0000 7f1315b84640 1 -- 172.21.15.92:0/4024591664 >> 172.21.15.92:0/4024591664 conn(0x7f1308093470 msgr2=0x7f1308094cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:54.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.272+0000 7f1315b84640 1 -- 172.21.15.92:0/4024591664 shutdown_connections 2024-09-19T08:57:54.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:57:54.272+0000 7f1315b84640 1 -- 172.21.15.92:0/4024591664 wait complete. 2024-09-19T08:57:55.121 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '507ce254', quiesce took 4.7 seconds. Will release after: 15.650000000000002 2024-09-19T08:57:55.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:55 smithi092 ceph-mon[31407]: pgmap v373: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 16 MiB/s wr, 401 op/s 2024-09-19T08:57:55.795 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 70.0 s, 3198.5 tps, lat 20.380 ms stddev 23.470 2024-09-19T08:57:55.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:55 smithi167 ceph-mon[35359]: pgmap v373: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 16 MiB/s wr, 401 op/s 2024-09-19T08:57:55.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:55 smithi190 ceph-mon[35358]: pgmap v373: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 16 MiB/s wr, 401 op/s 2024-09-19T08:57:57.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:57 smithi092 ceph-mon[31407]: pgmap v374: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 19 MiB/s wr, 597 op/s 2024-09-19T08:57:57.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:57 smithi167 ceph-mon[35359]: pgmap v374: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 19 MiB/s wr, 597 op/s 2024-09-19T08:57:57.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:57 smithi190 ceph-mon[35358]: pgmap v374: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 19 MiB/s wr, 597 op/s 2024-09-19T08:57:59.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:57:59 smithi092 ceph-mon[31407]: pgmap v375: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 19 MiB/s wr, 618 op/s 2024-09-19T08:57:59.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:57:59 smithi167 ceph-mon[35359]: pgmap v375: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 19 MiB/s wr, 618 op/s 2024-09-19T08:57:59.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:57:59 smithi190 ceph-mon[35358]: pgmap v375: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 19 MiB/s wr, 618 op/s 2024-09-19T08:58:00.799 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 75.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T08:58:01.654 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:01 smithi167 ceph-mon[35359]: pgmap v376: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 18 MiB/s wr, 590 op/s 2024-09-19T08:58:01.675 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:01 smithi190 ceph-mon[35358]: pgmap v376: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 18 MiB/s wr, 590 op/s 2024-09-19T08:58:01.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:01 smithi092 ceph-mon[31407]: pgmap v376: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 18 MiB/s wr, 590 op/s 2024-09-19T08:58:03.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:03 smithi092 ceph-mon[31407]: pgmap v377: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 16 MiB/s wr, 503 op/s 2024-09-19T08:58:03.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.825+0000 7f48a72a5640 1 -- 172.21.15.92:0/3814008777 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48a0100a50 msgr2=0x7f48a0100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:03.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.825+0000 7f48a72a5640 1 --2- 172.21.15.92:0/3814008777 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48a0100a50 0x7f48a0100e50 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f489c009900 tx=0x7f489c02a410 comp rx=0 tx=0).stop 2024-09-19T08:58:03.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.825+0000 7f48a72a5640 1 -- 172.21.15.92:0/3814008777 shutdown_connections 2024-09-19T08:58:03.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.825+0000 7f48a72a5640 1 --2- 172.21.15.92:0/3814008777 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48a0102600 0x7f48a0108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.825+0000 7f48a72a5640 1 --2- 172.21.15.92:0/3814008777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48a0101c40 0x7f48a01020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.825+0000 7f48a72a5640 1 --2- 172.21.15.92:0/3814008777 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48a0100a50 0x7f48a0100e50 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.825+0000 7f48a72a5640 1 -- 172.21.15.92:0/3814008777 >> 172.21.15.92:0/3814008777 conn(0x7f48a00fc1b0 msgr2=0x7f48a00fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:03.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.825+0000 7f48a72a5640 1 -- 172.21.15.92:0/3814008777 shutdown_connections 2024-09-19T08:58:03.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.825+0000 7f48a72a5640 1 -- 172.21.15.92:0/3814008777 wait complete. 2024-09-19T08:58:03.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.826+0000 7f48a72a5640 1 Processor -- start 2024-09-19T08:58:03.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.826+0000 7f48a72a5640 1 -- start start 2024-09-19T08:58:03.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.826+0000 7f48a72a5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48a0100a50 0x7f48a006ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:03.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.826+0000 7f48a72a5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48a0101c40 0x7f48a019cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.826+0000 7f48a72a5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48a0102600 0x7f48a019f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.826+0000 7f48a72a5640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f48a010c6d0 con 0x7f48a0100a50 2024-09-19T08:58:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.826+0000 7f48a72a5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f48a010c550 con 0x7f48a0101c40 2024-09-19T08:58:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.826+0000 7f48a72a5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f48a010c850 con 0x7f48a0102600 2024-09-19T08:58:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.826+0000 7f48a5041640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48a0100a50 0x7f48a006ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.826+0000 7f48a5041640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48a0100a50 0x7f48a006ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54626/0 (socket says 172.21.15.92:54626) 2024-09-19T08:58:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.826+0000 7f48a5041640 1 -- 172.21.15.92:0/4272965171 learned_addr learned my addr 172.21.15.92:0/4272965171 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.826+0000 7f48a4840640 1 --2- 172.21.15.92:0/4272965171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48a0101c40 0x7f48a019cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.826+0000 7f48a5041640 1 -- 172.21.15.92:0/4272965171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48a0102600 msgr2=0x7f48a019f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.826+0000 7f48a5041640 1 --2- 172.21.15.92:0/4272965171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48a0102600 0x7f48a019f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.826+0000 7f48a5041640 1 -- 172.21.15.92:0/4272965171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48a0101c40 msgr2=0x7f48a019cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.826+0000 7f48a5041640 1 --2- 172.21.15.92:0/4272965171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48a0101c40 0x7f48a019cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.826+0000 7f48a5041640 1 -- 172.21.15.92:0/4272965171 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48a019fa40 con 0x7f48a0100a50 2024-09-19T08:58:03.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.826+0000 7f48a4840640 1 --2- 172.21.15.92:0/4272965171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48a0101c40 0x7f48a019cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:58:03.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.826+0000 7f48a5041640 1 --2- 172.21.15.92:0/4272965171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48a0100a50 0x7f48a006ae70 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f489c031610 tx=0x7f489c0043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:03.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.826+0000 7f48967fc640 1 -- 172.21.15.92:0/4272965171 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f489c03f030 con 0x7f48a0100a50 2024-09-19T08:58:03.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.827+0000 7f48967fc640 1 -- 172.21.15.92:0/4272965171 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f489c003ce0 con 0x7f48a0100a50 2024-09-19T08:58:03.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.827+0000 7f48a72a5640 1 -- 172.21.15.92:0/4272965171 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48a019fc70 con 0x7f48a0100a50 2024-09-19T08:58:03.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.827+0000 7f48967fc640 1 -- 172.21.15.92:0/4272965171 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f489c035070 con 0x7f48a0100a50 2024-09-19T08:58:03.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.827+0000 7f48a72a5640 1 -- 172.21.15.92:0/4272965171 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48a01a01b0 con 0x7f48a0100a50 2024-09-19T08:58:03.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.829+0000 7f48967fc640 1 -- 172.21.15.92:0/4272965171 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f489c042030 con 0x7f48a0100a50 2024-09-19T08:58:03.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.829+0000 7f48aa047740 1 Processor -- start 2024-09-19T08:58:03.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.830+0000 7f48aa047740 1 -- start start 2024-09-19T08:58:03.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.830+0000 7f48967fc640 1 --2- 172.21.15.92:0/4272965171 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f488c0a3370 0x7f488c0a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:03.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.830+0000 7f48aa047740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56281a90c9a0 0x56281a90cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:03.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.830+0000 7f48aa047740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56281a90d2e0 0x56281a911da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:03.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.830+0000 7f48aa047740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56281a912370 0x56281a914830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:03.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.830+0000 7f48aa047740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56281a8702f0 con 0x56281a912370 2024-09-19T08:58:03.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.830+0000 7f48aa047740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56281a818270 con 0x56281a90d2e0 2024-09-19T08:58:03.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.830+0000 7f48aa047740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56281a86c2b0 con 0x56281a90c9a0 2024-09-19T08:58:03.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.830+0000 7f48967fc640 1 -- 172.21.15.92:0/4272965171 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f489c0eff10 con 0x7f48a0100a50 2024-09-19T08:58:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.830+0000 7f48a5842640 1 --2- 172.21.15.92:0/4272965171 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f488c0a3370 0x7f488c0a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.830+0000 7f48a5842640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56281a912370 0x56281a914830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.830+0000 7f48a5842640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56281a912370 0x56281a914830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54632/0 (socket says 172.21.15.92:54632) 2024-09-19T08:58:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.830+0000 7f48a5842640 1 -- 172.21.15.92:0/2375298341 learned_addr learned my addr 172.21.15.92:0/2375298341 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.830+0000 7f48a5041640 1 --2- 172.21.15.92:0/2375298341 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56281a90c9a0 0x56281a90cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.830+0000 7f48a4840640 1 --2- 172.21.15.92:0/2375298341 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56281a90d2e0 0x56281a911da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.830+0000 7f48a5842640 1 -- 172.21.15.92:0/2375298341 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56281a90c9a0 msgr2=0x56281a90cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.830+0000 7f48a5842640 1 --2- 172.21.15.92:0/2375298341 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56281a90c9a0 0x56281a90cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.830+0000 7f48a5842640 1 -- 172.21.15.92:0/2375298341 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56281a90d2e0 msgr2=0x56281a911da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:03.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.830+0000 7f48a5842640 1 --2- 172.21.15.92:0/2375298341 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56281a90d2e0 0x56281a911da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.830+0000 7f48a5842640 1 -- 172.21.15.92:0/2375298341 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56281a817340 con 0x56281a912370 2024-09-19T08:58:03.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.830+0000 7f48a5842640 1 --2- 172.21.15.92:0/4272965171 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f488c0a3370 0x7f488c0a5830 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4898009fd0 tx=0x7f4898009c60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:03.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.830+0000 7f48a5842640 1 --2- 172.21.15.92:0/2375298341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56281a912370 0x56281a914830 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f489800f730 tx=0x7f4898019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a1186ab01027c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:03.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.831+0000 7f488b7fe640 1 -- 172.21.15.92:0/2375298341 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4898022070 con 0x56281a912370 2024-09-19T08:58:03.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.831+0000 7f488b7fe640 1 -- 172.21.15.92:0/2375298341 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f489800fe60 con 0x56281a912370 2024-09-19T08:58:03.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.831+0000 7f488b7fe640 1 -- 172.21.15.92:0/2375298341 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4898005580 con 0x56281a912370 2024-09-19T08:58:03.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.831+0000 7f48aa047740 1 -- 172.21.15.92:0/2375298341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56281a912370 msgr2=0x56281a914830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:03.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.831+0000 7f48aa047740 1 --2- 172.21.15.92:0/2375298341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56281a912370 0x56281a914830 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f489800f730 tx=0x7f4898019000 comp rx=0 tx=0).stop 2024-09-19T08:58:03.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.831+0000 7f48aa047740 1 -- 172.21.15.92:0/2375298341 shutdown_connections 2024-09-19T08:58:03.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.831+0000 7f48aa047740 1 --2- 172.21.15.92:0/2375298341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56281a912370 0x56281a914830 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.831+0000 7f48aa047740 1 --2- 172.21.15.92:0/2375298341 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56281a90d2e0 0x56281a911da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.831+0000 7f48aa047740 1 --2- 172.21.15.92:0/2375298341 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56281a90c9a0 0x56281a90cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.831+0000 7f48aa047740 1 -- 172.21.15.92:0/2375298341 >> 172.21.15.92:0/2375298341 conn(0x56281a908010 msgr2=0x56281a908410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:03.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.831+0000 7f48aa047740 1 -- 172.21.15.92:0/2375298341 shutdown_connections 2024-09-19T08:58:03.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.831+0000 7f48aa047740 1 -- 172.21.15.92:0/2375298341 wait complete. 2024-09-19T08:58:03.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.832+0000 7f48aa047740 1 -- start start 2024-09-19T08:58:03.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.832+0000 7f48aa047740 1 Processor -- start 2024-09-19T08:58:03.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.832+0000 7f48aa047740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56281a90c9a0 0x56281a916bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:03.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.832+0000 7f48aa047740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56281a90d2e0 0x56281a917100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:03.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.832+0000 7f48aa047740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56281a912370 0x56281a91e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:03.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.832+0000 7f48aa047740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56281a9152e0 con 0x56281a912370 2024-09-19T08:58:03.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.832+0000 7f48aa047740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56281a7f9290 con 0x56281a90d2e0 2024-09-19T08:58:03.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.832+0000 7f48aa047740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56281a915460 con 0x56281a90c9a0 2024-09-19T08:58:03.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.832+0000 7f48aa047740 10 client.0 _ll_register_callbacks cb 0x56281a82a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:03.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.832+0000 7f48a5842640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56281a912370 0x56281a91e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:03.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.832+0000 7f48a5842640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56281a912370 0x56281a91e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54634/0 (socket says 172.21.15.92:54634) 2024-09-19T08:58:03.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.832+0000 7f48a5842640 1 -- 172.21.15.92:0/3708706356 learned_addr learned my addr 172.21.15.92:0/3708706356 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:03.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.832+0000 7f48a5041640 1 --2- 172.21.15.92:0/3708706356 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56281a90c9a0 0x56281a916bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:03.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.833+0000 7f48a4840640 1 --2- 172.21.15.92:0/3708706356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56281a90d2e0 0x56281a917100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:03.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.833+0000 7f48a5842640 1 -- 172.21.15.92:0/3708706356 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56281a90c9a0 msgr2=0x56281a916bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:03.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.833+0000 7f48a5842640 1 --2- 172.21.15.92:0/3708706356 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56281a90c9a0 0x56281a916bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.833+0000 7f48a5842640 1 -- 172.21.15.92:0/3708706356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56281a90d2e0 msgr2=0x56281a917100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:03.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.833+0000 7f48a5842640 1 --2- 172.21.15.92:0/3708706356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56281a90d2e0 0x56281a917100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.833+0000 7f48a5842640 1 -- 172.21.15.92:0/3708706356 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56281a583210 con 0x56281a912370 2024-09-19T08:58:03.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.833+0000 7f48a5842640 1 --2- 172.21.15.92:0/3708706356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56281a912370 0x56281a91e140 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f4898009860 tx=0x7f4898009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede804d17f8c5f3a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:03.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.833+0000 7f4888ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:58:03.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.833+0000 7f4888ff9640 1 -- 172.21.15.92:0/3708706356 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4898022040 con 0x56281a912370 2024-09-19T08:58:03.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.833+0000 7f4888ff9640 1 -- 172.21.15.92:0/3708706356 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4898005510 con 0x56281a912370 2024-09-19T08:58:03.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.833+0000 7f48aa047740 1 -- 172.21.15.92:0/3708706356 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f489800fe60 con 0x56281a912370 2024-09-19T08:58:03.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.833+0000 7f4888ff9640 1 -- 172.21.15.92:0/3708706356 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f48980095f0 con 0x56281a912370 2024-09-19T08:58:03.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.833+0000 7f48aa047740 10 client.15696 fetch_fsmap learned FSMap version 19 2024-09-19T08:58:03.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.833+0000 7f48aa047740 1 -- 172.21.15.92:0/3708706356 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56281a64f620 con 0x56281a912370 2024-09-19T08:58:03.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.833+0000 7f4888ff9640 1 -- 172.21.15.92:0/3708706356 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f489800fe60 con 0x56281a912370 2024-09-19T08:58:03.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.833+0000 7f4888ff9640 1 -- 172.21.15.92:0/3708706356 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f489802e070 con 0x56281a912370 2024-09-19T08:58:03.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.833+0000 7f48aa047740 10 client.15696 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:58:03.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.833+0000 7f48aa047740 10 client.15696 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T08:58:03.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.833+0000 7f48aa047740 20 client.15696 populate_metadata read hostname 'smithi092' 2024-09-19T08:58:03.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.833+0000 7f48aa047740 1 --2- 172.21.15.92:0/3708706356 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56281a9226b0 0x56281a924aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:03.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.833+0000 7f48aa047740 4 client.15696 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:58:03.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.833+0000 7f48aa047740 1 -- 172.21.15.92:0/3708706356 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56281a87da20 con 0x56281a9226b0 2024-09-19T08:58:03.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.834+0000 7f48a5041640 1 --2- 172.21.15.92:0/3708706356 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56281a9226b0 0x56281a924aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:03.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.834+0000 7f4888ff9640 10 client.15696 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:03.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.834+0000 7f48a5041640 1 --2- 172.21.15.92:0/3708706356 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56281a9226b0 0x56281a924aa0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2033ea28dfd50d89 server_cookie=e5735a7adaa89467 in_seq=0 out_seq=0 2024-09-19T08:58:03.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.835+0000 7f4888ff9640 1 -- 172.21.15.92:0/3708706356 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56281a87da20 con 0x56281a9226b0 2024-09-19T08:58:03.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.835+0000 7f4888ff9640 10 client.15696 handle_command_reply: tid=0 2024-09-19T08:58:03.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.835+0000 7f48aa047740 1 client.15696 shutdown 2024-09-19T08:58:03.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.835+0000 7f48aa047740 1 -- 172.21.15.92:0/3708706356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56281a912370 msgr2=0x56281a91e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:03.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.835+0000 7f48aa047740 1 --2- 172.21.15.92:0/3708706356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56281a912370 0x56281a91e140 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f4898009860 tx=0x7f4898009a20 comp rx=0 tx=0).stop 2024-09-19T08:58:03.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.835+0000 7f48aa047740 1 -- 172.21.15.92:0/3708706356 shutdown_connections 2024-09-19T08:58:03.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.835+0000 7f48aa047740 1 --2- 172.21.15.92:0/3708706356 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56281a9226b0 0x56281a924aa0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.835+0000 7f48aa047740 1 --2- 172.21.15.92:0/3708706356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56281a912370 0x56281a91e140 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.835+0000 7f48aa047740 1 --2- 172.21.15.92:0/3708706356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56281a90d2e0 0x56281a917100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.835+0000 7f48aa047740 1 --2- 172.21.15.92:0/3708706356 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56281a90c9a0 0x56281a916bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.835+0000 7f4888ff9640 0 client.15696 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:03.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.835+0000 7f48aa047740 1 -- 172.21.15.92:0/3708706356 >> 172.21.15.92:0/3708706356 conn(0x56281a908010 msgr2=0x56281a909820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:03.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.835+0000 7f48aa047740 1 -- 172.21.15.92:0/3708706356 shutdown_connections 2024-09-19T08:58:03.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.835+0000 7f48aa047740 1 -- 172.21.15.92:0/3708706356 wait complete. 2024-09-19T08:58:03.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.835+0000 7f48aa047740 20 client.15696 trim_cache size 0 max 16384 2024-09-19T08:58:03.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.849+0000 7f48aa047740 1 Processor -- start 2024-09-19T08:58:03.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.849+0000 7f48aa047740 1 -- start start 2024-09-19T08:58:03.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.849+0000 7f48aa047740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56281a90c9a0 0x56281a908ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:03.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.849+0000 7f48aa047740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56281a90d2e0 0x56281a91e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:03.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.849+0000 7f48aa047740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56281a912370 0x56281a909400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:03.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.849+0000 7f48aa047740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f48a01a6fe0 con 0x56281a90d2e0 2024-09-19T08:58:03.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.849+0000 7f48aa047740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f48a01a9880 con 0x56281a90c9a0 2024-09-19T08:58:03.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.849+0000 7f48aa047740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f48a01a7670 con 0x56281a912370 2024-09-19T08:58:03.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.850+0000 7f48a4840640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56281a90d2e0 0x56281a91e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:03.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.850+0000 7f48a4840640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56281a90d2e0 0x56281a91e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54640/0 (socket says 172.21.15.92:54640) 2024-09-19T08:58:03.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.850+0000 7f48a4840640 1 -- 172.21.15.92:0/1433583688 learned_addr learned my addr 172.21.15.92:0/1433583688 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:03.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.850+0000 7f48a5041640 1 --2- 172.21.15.92:0/1433583688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56281a90c9a0 0x56281a908ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:03.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.850+0000 7f48a4840640 1 -- 172.21.15.92:0/1433583688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56281a912370 msgr2=0x56281a909400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:03.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.850+0000 7f48a5842640 1 --2- 172.21.15.92:0/1433583688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56281a912370 0x56281a909400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:03.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.850+0000 7f48a4840640 1 --2- 172.21.15.92:0/1433583688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56281a912370 0x56281a909400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.850+0000 7f48a4840640 1 -- 172.21.15.92:0/1433583688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56281a90c9a0 msgr2=0x56281a908ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:03.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.850+0000 7f48a4840640 1 --2- 172.21.15.92:0/1433583688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56281a90c9a0 0x56281a908ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.850+0000 7f48a4840640 1 -- 172.21.15.92:0/1433583688 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56281a908ca0 con 0x56281a90d2e0 2024-09-19T08:58:03.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.850+0000 7f48a5041640 1 --2- 172.21.15.92:0/1433583688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56281a90c9a0 0x56281a908ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:58:03.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.850+0000 7f48a5842640 1 --2- 172.21.15.92:0/1433583688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56281a912370 0x56281a909400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:58:03.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.850+0000 7f48a4840640 1 --2- 172.21.15.92:0/1433583688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56281a90d2e0 0x56281a91e100 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f48900043c0 tx=0x7f489000bbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee91a2257c4fcac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:03.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.850+0000 7f488affd640 1 -- 172.21.15.92:0/1433583688 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4890003b50 con 0x56281a90d2e0 2024-09-19T08:58:03.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.850+0000 7f488affd640 1 -- 172.21.15.92:0/1433583688 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4890004c80 con 0x56281a90d2e0 2024-09-19T08:58:03.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.850+0000 7f488affd640 1 -- 172.21.15.92:0/1433583688 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4890005690 con 0x56281a90d2e0 2024-09-19T08:58:03.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.851+0000 7f48aa047740 1 -- 172.21.15.92:0/1433583688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56281a90d2e0 msgr2=0x56281a91e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:03.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.851+0000 7f48aa047740 1 --2- 172.21.15.92:0/1433583688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56281a90d2e0 0x56281a91e100 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f48900043c0 tx=0x7f489000bbf0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.851+0000 7f48aa047740 1 -- 172.21.15.92:0/1433583688 shutdown_connections 2024-09-19T08:58:03.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.851+0000 7f48aa047740 1 --2- 172.21.15.92:0/1433583688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56281a912370 0x56281a909400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.851+0000 7f48aa047740 1 --2- 172.21.15.92:0/1433583688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56281a90d2e0 0x56281a91e100 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.851+0000 7f48aa047740 1 --2- 172.21.15.92:0/1433583688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56281a90c9a0 0x56281a908ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.851+0000 7f48aa047740 1 -- 172.21.15.92:0/1433583688 >> 172.21.15.92:0/1433583688 conn(0x56281a908010 msgr2=0x56281a916bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:03.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.851+0000 7f48aa047740 1 -- 172.21.15.92:0/1433583688 shutdown_connections 2024-09-19T08:58:03.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.851+0000 7f48aa047740 1 -- 172.21.15.92:0/1433583688 wait complete. 2024-09-19T08:58:03.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.851+0000 7f48aa047740 1 -- start start 2024-09-19T08:58:03.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.851+0000 7f48aa047740 1 Processor -- start 2024-09-19T08:58:03.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.851+0000 7f48aa047740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56281a90c9a0 0x56281a91b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:03.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.851+0000 7f48aa047740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56281a90d2e0 0x56281a91b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:03.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.851+0000 7f48aa047740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56281a912370 0x56281a91c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:03.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.851+0000 7f48aa047740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f48a01a7d40 con 0x56281a90d2e0 2024-09-19T08:58:03.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.851+0000 7f48aa047740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f48a01a91b0 con 0x56281a912370 2024-09-19T08:58:03.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.851+0000 7f48aa047740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f48a01a8410 con 0x56281a90c9a0 2024-09-19T08:58:03.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.851+0000 7f48aa047740 10 client.0 _ll_register_callbacks cb 0x7f489000b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:03.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.852+0000 7f48a4840640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56281a90d2e0 0x56281a91b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:03.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.852+0000 7f48a4840640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56281a90d2e0 0x56281a91b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54652/0 (socket says 172.21.15.92:54652) 2024-09-19T08:58:03.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.852+0000 7f48a4840640 1 -- 172.21.15.92:0/280685047 learned_addr learned my addr 172.21.15.92:0/280685047 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:03.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.852+0000 7f48a5842640 1 --2- 172.21.15.92:0/280685047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56281a912370 0x56281a91c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:03.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.852+0000 7f48a5041640 1 --2- 172.21.15.92:0/280685047 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56281a90c9a0 0x56281a91b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:03.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.852+0000 7f48a4840640 1 -- 172.21.15.92:0/280685047 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56281a90c9a0 msgr2=0x56281a91b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:03.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.852+0000 7f48a4840640 1 --2- 172.21.15.92:0/280685047 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56281a90c9a0 0x56281a91b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.852+0000 7f48a4840640 1 -- 172.21.15.92:0/280685047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56281a912370 msgr2=0x56281a91c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:03.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.852+0000 7f48a4840640 1 --2- 172.21.15.92:0/280685047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56281a912370 0x56281a91c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.852+0000 7f48a4840640 1 -- 172.21.15.92:0/280685047 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56281a91cef0 con 0x56281a90d2e0 2024-09-19T08:58:03.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.852+0000 7f48a4840640 1 --2- 172.21.15.92:0/280685047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56281a90d2e0 0x56281a91b940 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4890000c00 tx=0x7f4890004f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b52b78ee1d7585d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:03.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.852+0000 7f4888ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:58:03.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.852+0000 7f4888ff9640 1 -- 172.21.15.92:0/280685047 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f489002b060 con 0x56281a90d2e0 2024-09-19T08:58:03.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.852+0000 7f4888ff9640 1 -- 172.21.15.92:0/280685047 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4890003b50 con 0x56281a90d2e0 2024-09-19T08:58:03.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.852+0000 7f48aa047740 1 -- 172.21.15.92:0/280685047 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4890004c80 con 0x56281a90d2e0 2024-09-19T08:58:03.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.852+0000 7f4888ff9640 1 -- 172.21.15.92:0/280685047 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4890003d50 con 0x56281a90d2e0 2024-09-19T08:58:03.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.852+0000 7f48aa047740 10 client.15702 fetch_fsmap learned FSMap version 19 2024-09-19T08:58:03.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.852+0000 7f48aa047740 1 -- 172.21.15.92:0/280685047 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56281a91e170 con 0x56281a90d2e0 2024-09-19T08:58:03.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.852+0000 7f4888ff9640 1 -- 172.21.15.92:0/280685047 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4890004c80 con 0x56281a90d2e0 2024-09-19T08:58:03.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.853+0000 7f4888ff9640 1 -- 172.21.15.92:0/280685047 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f4890030070 con 0x56281a90d2e0 2024-09-19T08:58:03.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.853+0000 7f48aa047740 10 client.15702 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:58:03.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.853+0000 7f48aa047740 10 client.15702 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T08:58:03.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.853+0000 7f48aa047740 20 client.15702 populate_metadata read hostname 'smithi092' 2024-09-19T08:58:03.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.853+0000 7f48aa047740 1 --2- 172.21.15.92:0/280685047 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56281a98d7c0 0x56281a98fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:03.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.853+0000 7f48aa047740 4 client.15702 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:58:03.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.853+0000 7f48aa047740 1 -- 172.21.15.92:0/280685047 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56281a877d70 con 0x56281a98d7c0 2024-09-19T08:58:03.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.853+0000 7f48a5041640 1 --2- 172.21.15.92:0/280685047 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56281a98d7c0 0x56281a98fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:03.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.853+0000 7f4888ff9640 10 client.15702 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:03.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.853+0000 7f48a5041640 1 --2- 172.21.15.92:0/280685047 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56281a98d7c0 0x56281a98fbe0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f955047a93e1cccc server_cookie=de757b1debf96559 in_seq=0 out_seq=0 2024-09-19T08:58:03.861 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:03 smithi167 ceph-mon[35359]: pgmap v377: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 16 MiB/s wr, 503 op/s 2024-09-19T08:58:03.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.868+0000 7f4888ff9640 1 -- 172.21.15.92:0/280685047 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56281a877d70 con 0x56281a98d7c0 2024-09-19T08:58:03.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.868+0000 7f4888ff9640 10 client.15702 handle_command_reply: tid=0 2024-09-19T08:58:03.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.868+0000 7f48aa047740 1 client.15702 shutdown 2024-09-19T08:58:03.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.868+0000 7f48aa047740 1 -- 172.21.15.92:0/280685047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56281a90d2e0 msgr2=0x56281a91b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:03.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.868+0000 7f48aa047740 1 --2- 172.21.15.92:0/280685047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56281a90d2e0 0x56281a91b940 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4890000c00 tx=0x7f4890004f70 comp rx=0 tx=0).stop 2024-09-19T08:58:03.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.868+0000 7f48aa047740 1 -- 172.21.15.92:0/280685047 shutdown_connections 2024-09-19T08:58:03.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.868+0000 7f48aa047740 1 --2- 172.21.15.92:0/280685047 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56281a98d7c0 0x56281a98fbe0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.868+0000 7f48aa047740 1 --2- 172.21.15.92:0/280685047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56281a912370 0x56281a91c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.868+0000 7f4888ff9640 0 client.15702 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:03.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.868+0000 7f48aa047740 1 --2- 172.21.15.92:0/280685047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56281a90d2e0 0x56281a91b940 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.868+0000 7f48aa047740 1 --2- 172.21.15.92:0/280685047 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56281a90c9a0 0x56281a91b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.868+0000 7f48aa047740 1 -- 172.21.15.92:0/280685047 >> 172.21.15.92:0/280685047 conn(0x56281a908010 msgr2=0x56281a9069a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:03.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.869+0000 7f48aa047740 1 -- 172.21.15.92:0/280685047 shutdown_connections 2024-09-19T08:58:03.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.869+0000 7f48aa047740 1 -- 172.21.15.92:0/280685047 wait complete. 2024-09-19T08:58:03.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.869+0000 7f48aa047740 20 client.15702 trim_cache size 0 max 16384 2024-09-19T08:58:03.871 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T08:58:03.871 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T08:58:03.871 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T08:58:03.871 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T08:58:03.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.869+0000 7f48a72a5640 1 -- 172.21.15.92:0/4272965171 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f488c0a3370 msgr2=0x7f488c0a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:03.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.869+0000 7f48a72a5640 1 --2- 172.21.15.92:0/4272965171 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f488c0a3370 0x7f488c0a5830 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4898009fd0 tx=0x7f4898009c60 comp rx=0 tx=0).stop 2024-09-19T08:58:03.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.869+0000 7f48a72a5640 1 -- 172.21.15.92:0/4272965171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48a0100a50 msgr2=0x7f48a006ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:03.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.869+0000 7f48a72a5640 1 --2- 172.21.15.92:0/4272965171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48a0100a50 0x7f48a006ae70 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f489c031610 tx=0x7f489c0043b0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.869+0000 7f48a72a5640 1 -- 172.21.15.92:0/4272965171 shutdown_connections 2024-09-19T08:58:03.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.869+0000 7f48a72a5640 1 --2- 172.21.15.92:0/4272965171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48a0102600 0x7f48a019f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.869+0000 7f48a72a5640 1 --2- 172.21.15.92:0/4272965171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48a0101c40 0x7f48a019cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.873 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.869+0000 7f48a72a5640 1 --2- 172.21.15.92:0/4272965171 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f488c0a3370 0x7f488c0a5830 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.873 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.869+0000 7f48a72a5640 1 --2- 172.21.15.92:0/4272965171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48a0100a50 0x7f48a006ae70 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.873 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.869+0000 7f48a72a5640 1 -- 172.21.15.92:0/4272965171 >> 172.21.15.92:0/4272965171 conn(0x7f48a00fc1b0 msgr2=0x7f48a0104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:03.873 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.869+0000 7f48a72a5640 1 -- 172.21.15.92:0/4272965171 shutdown_connections 2024-09-19T08:58:03.873 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:03.869+0000 7f48a72a5640 1 -- 172.21.15.92:0/4272965171 wait complete. 2024-09-19T08:58:03.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:03 smithi190 ceph-mon[35358]: pgmap v377: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 16 MiB/s wr, 503 op/s 2024-09-19T08:58:05.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:05 smithi092 ceph-mon[31407]: pgmap v378: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 10 MiB/s wr, 423 op/s 2024-09-19T08:58:05.799 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 80.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T08:58:05.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:05 smithi167 ceph-mon[35359]: pgmap v378: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 10 MiB/s wr, 423 op/s 2024-09-19T08:58:05.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:05 smithi190 ceph-mon[35358]: pgmap v378: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 10 MiB/s wr, 423 op/s 2024-09-19T08:58:07.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:07 smithi092 ceph-mon[31407]: pgmap v379: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 2.7 MiB/s wr, 251 op/s 2024-09-19T08:58:07.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:07 smithi167 ceph-mon[35359]: pgmap v379: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 2.7 MiB/s wr, 251 op/s 2024-09-19T08:58:07.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:07 smithi190 ceph-mon[35358]: pgmap v379: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 2.7 MiB/s wr, 251 op/s 2024-09-19T08:58:09.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:09 smithi092 ceph-mon[31407]: pgmap v380: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 243 KiB/s wr, 39 op/s 2024-09-19T08:58:09.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:09 smithi167 ceph-mon[35359]: pgmap v380: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 243 KiB/s wr, 39 op/s 2024-09-19T08:58:09.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:09 smithi190 ceph-mon[35358]: pgmap v380: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 243 KiB/s wr, 39 op/s 2024-09-19T08:58:10.772 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:58:10.798 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 85.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T08:58:11.035 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:58:11.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.486+0000 7f129e773640 1 -- 172.21.15.92:0/3216386280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1298102d40 msgr2=0x7f1298103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:11.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.486+0000 7f129e773640 1 --2- 172.21.15.92:0/3216386280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1298102d40 0x7f1298103120 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1288009900 tx=0x7f128802a480 comp rx=0 tx=0).stop 2024-09-19T08:58:11.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.486+0000 7f129e773640 1 -- 172.21.15.92:0/3216386280 shutdown_connections 2024-09-19T08:58:11.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.486+0000 7f129e773640 1 --2- 172.21.15.92:0/3216386280 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f129810c170 0x7f129810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.486+0000 7f129e773640 1 --2- 172.21.15.92:0/3216386280 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1298103660 0x7f129810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.486+0000 7f129e773640 1 --2- 172.21.15.92:0/3216386280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1298102d40 0x7f1298103120 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.486+0000 7f129e773640 1 -- 172.21.15.92:0/3216386280 >> 172.21.15.92:0/3216386280 conn(0x7f12980fc7a0 msgr2=0x7f12980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:11.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.486+0000 7f129e773640 1 -- 172.21.15.92:0/3216386280 shutdown_connections 2024-09-19T08:58:11.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.486+0000 7f129e773640 1 -- 172.21.15.92:0/3216386280 wait complete. 2024-09-19T08:58:11.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.487+0000 7f129e773640 1 Processor -- start 2024-09-19T08:58:11.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.487+0000 7f129e773640 1 -- start start 2024-09-19T08:58:11.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.487+0000 7f129e773640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1298102d40 0x7f1298198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:11.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.487+0000 7f129e773640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1298103660 0x7f1298198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:11.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.487+0000 7f129e773640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f129810c170 0x7f129819ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:11.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.487+0000 7f129e773640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1298111fd0 con 0x7f129810c170 2024-09-19T08:58:11.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.487+0000 7f129e773640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1298111e50 con 0x7f1298102d40 2024-09-19T08:58:11.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.487+0000 7f129e773640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1298112150 con 0x7f1298103660 2024-09-19T08:58:11.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.488+0000 7f129cd10640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f129810c170 0x7f129819ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:11.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.488+0000 7f129cd10640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f129810c170 0x7f129819ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36388/0 (socket says 172.21.15.92:36388) 2024-09-19T08:58:11.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.488+0000 7f129cd10640 1 -- 172.21.15.92:0/2440117791 learned_addr learned my addr 172.21.15.92:0/2440117791 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:11.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.488+0000 7f12977fe640 1 --2- 172.21.15.92:0/2440117791 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1298103660 0x7f1298198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:11.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.488+0000 7f1297fff640 1 --2- 172.21.15.92:0/2440117791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1298102d40 0x7f1298198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:11.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.488+0000 7f129cd10640 1 -- 172.21.15.92:0/2440117791 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1298103660 msgr2=0x7f1298198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:11.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.488+0000 7f129cd10640 1 --2- 172.21.15.92:0/2440117791 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1298103660 0x7f1298198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.488+0000 7f129cd10640 1 -- 172.21.15.92:0/2440117791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1298102d40 msgr2=0x7f1298198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:11.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.488+0000 7f129cd10640 1 --2- 172.21.15.92:0/2440117791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1298102d40 0x7f1298198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.488+0000 7f129cd10640 1 -- 172.21.15.92:0/2440117791 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f129819d4e0 con 0x7f129810c170 2024-09-19T08:58:11.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.488+0000 7f1297fff640 1 --2- 172.21.15.92:0/2440117791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1298102d40 0x7f1298198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:58:11.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.488+0000 7f129cd10640 1 --2- 172.21.15.92:0/2440117791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f129810c170 0x7f129819ce00 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f129000b970 tx=0x7f129000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:11.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.488+0000 7f12957fa640 1 -- 172.21.15.92:0/2440117791 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1290019070 con 0x7f129810c170 2024-09-19T08:58:11.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.488+0000 7f12957fa640 1 -- 172.21.15.92:0/2440117791 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f129000cb40 con 0x7f129810c170 2024-09-19T08:58:11.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.488+0000 7f129e773640 1 -- 172.21.15.92:0/2440117791 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f129819d7d0 con 0x7f129810c170 2024-09-19T08:58:11.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.488+0000 7f12957fa640 1 -- 172.21.15.92:0/2440117791 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1290007650 con 0x7f129810c170 2024-09-19T08:58:11.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.488+0000 7f129e773640 1 -- 172.21.15.92:0/2440117791 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12981a50b0 con 0x7f129810c170 2024-09-19T08:58:11.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.490+0000 7f129e773640 1 -- 172.21.15.92:0/2440117791 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1298103120 con 0x7f129810c170 2024-09-19T08:58:11.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.491+0000 7f12957fa640 1 -- 172.21.15.92:0/2440117791 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f129001c070 con 0x7f129810c170 2024-09-19T08:58:11.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.491+0000 7f12957fa640 1 --2- 172.21.15.92:0/2440117791 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f12800a3240 0x7f12800a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:11.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.491+0000 7f1297fff640 1 --2- 172.21.15.92:0/2440117791 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f12800a3240 0x7f12800a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:11.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.491+0000 7f12957fa640 1 -- 172.21.15.92:0/2440117791 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f12900cef00 con 0x7f129810c170 2024-09-19T08:58:11.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.492+0000 7f1297fff640 1 --2- 172.21.15.92:0/2440117791 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f12800a3240 0x7f12800a5700 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1288000c00 tx=0x7f1288032d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:11.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.495+0000 7f12957fa640 1 -- 172.21.15.92:0/2440117791 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f129009b5d0 con 0x7f129810c170 2024-09-19T08:58:11.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.695+0000 7f129e773640 1 -- 172.21.15.92:0/2440117791 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f129802d7c0 con 0x7f129810c170 2024-09-19T08:58:11.697 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:11 smithi092 ceph-mon[31407]: pgmap v381: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-09-19T08:58:11.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.696+0000 7f12957fa640 1 -- 172.21.15.92:0/2440117791 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f129009f8d0 con 0x7f129810c170 2024-09-19T08:58:11.698 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:58:11.698 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T08:58:11.698 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T08:58:11.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.698+0000 7f129e773640 1 -- 172.21.15.92:0/2440117791 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f12800a3240 msgr2=0x7f12800a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:11.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.698+0000 7f129e773640 1 --2- 172.21.15.92:0/2440117791 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f12800a3240 0x7f12800a5700 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1288000c00 tx=0x7f1288032d50 comp rx=0 tx=0).stop 2024-09-19T08:58:11.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.698+0000 7f129e773640 1 -- 172.21.15.92:0/2440117791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f129810c170 msgr2=0x7f129819ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:11.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.698+0000 7f129e773640 1 --2- 172.21.15.92:0/2440117791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f129810c170 0x7f129819ce00 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f129000b970 tx=0x7f129000be30 comp rx=0 tx=0).stop 2024-09-19T08:58:11.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.699+0000 7f129e773640 1 -- 172.21.15.92:0/2440117791 shutdown_connections 2024-09-19T08:58:11.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.699+0000 7f129e773640 1 --2- 172.21.15.92:0/2440117791 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f12800a3240 0x7f12800a5700 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.699+0000 7f129e773640 1 --2- 172.21.15.92:0/2440117791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f129810c170 0x7f129819ce00 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.699+0000 7f129e773640 1 --2- 172.21.15.92:0/2440117791 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1298103660 0x7f1298198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.699+0000 7f129e773640 1 --2- 172.21.15.92:0/2440117791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1298102d40 0x7f1298198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.699+0000 7f129e773640 1 -- 172.21.15.92:0/2440117791 >> 172.21.15.92:0/2440117791 conn(0x7f12980fc7a0 msgr2=0x7f12980fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:11.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.699+0000 7f129e773640 1 -- 172.21.15.92:0/2440117791 shutdown_connections 2024-09-19T08:58:11.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:11.699+0000 7f129e773640 1 -- 172.21.15.92:0/2440117791 wait complete. 2024-09-19T08:58:11.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:11 smithi167 ceph-mon[35359]: pgmap v381: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-09-19T08:58:11.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:11 smithi190 ceph-mon[35358]: pgmap v381: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-09-19T08:58:12.231 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id 507ce254 --release --await' 2024-09-19T08:58:12.232 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id 507ce254 --release --await 2024-09-19T08:58:12.506 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:12 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/2440117791' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:58:12.531 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:58:12.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:12 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/2440117791' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:58:12.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:12 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/2440117791' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:58:12.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.961+0000 7fd426a86640 1 -- 172.21.15.92:0/3300570955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd420106b80 msgr2=0x7fd420106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:12.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.961+0000 7fd426a86640 1 --2- 172.21.15.92:0/3300570955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd420106b80 0x7fd420106f60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd418009900 tx=0x7fd41802a410 comp rx=0 tx=0).stop 2024-09-19T08:58:12.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.961+0000 7fd426a86640 1 -- 172.21.15.92:0/3300570955 shutdown_connections 2024-09-19T08:58:12.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.961+0000 7fd426a86640 1 --2- 172.21.15.92:0/3300570955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd420100aa0 0x7fd42010ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.961+0000 7fd426a86640 1 --2- 172.21.15.92:0/3300570955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd420100100 0x7fd420100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.961+0000 7fd426a86640 1 --2- 172.21.15.92:0/3300570955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd420106b80 0x7fd420106f60 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.961+0000 7fd426a86640 1 -- 172.21.15.92:0/3300570955 >> 172.21.15.92:0/3300570955 conn(0x7fd420077230 msgr2=0x7fd4200fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:12.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.961+0000 7fd426a86640 1 -- 172.21.15.92:0/3300570955 shutdown_connections 2024-09-19T08:58:12.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.961+0000 7fd426a86640 1 -- 172.21.15.92:0/3300570955 wait complete. 2024-09-19T08:58:12.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.962+0000 7fd426a86640 1 Processor -- start 2024-09-19T08:58:12.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.962+0000 7fd426a86640 1 -- start start 2024-09-19T08:58:12.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.962+0000 7fd426a86640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd420100100 0x7fd4201984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:12.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.962+0000 7fd426a86640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd420100aa0 0x7fd4201989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:12.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.962+0000 7fd426a86640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd420106b80 0x7fd42019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:12.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.962+0000 7fd426a86640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd420112050 con 0x7fd420100aa0 2024-09-19T08:58:12.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.962+0000 7fd426a86640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd420111ed0 con 0x7fd420100100 2024-09-19T08:58:12.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.962+0000 7fd426a86640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd4201121d0 con 0x7fd420106b80 2024-09-19T08:58:12.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.962+0000 7fd41ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd420100aa0 0x7fd4201989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:12.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.962+0000 7fd41ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd420100aa0 0x7fd4201989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36412/0 (socket says 172.21.15.92:36412) 2024-09-19T08:58:12.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.962+0000 7fd41ffff640 1 -- 172.21.15.92:0/2104305022 learned_addr learned my addr 172.21.15.92:0/2104305022 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:12.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.962+0000 7fd424822640 1 --2- 172.21.15.92:0/2104305022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd420100100 0x7fd4201984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:12.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.962+0000 7fd425023640 1 --2- 172.21.15.92:0/2104305022 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd420106b80 0x7fd42019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:12.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.963+0000 7fd41ffff640 1 -- 172.21.15.92:0/2104305022 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd420106b80 msgr2=0x7fd42019cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:12.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.963+0000 7fd41ffff640 1 --2- 172.21.15.92:0/2104305022 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd420106b80 0x7fd42019cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.963+0000 7fd41ffff640 1 -- 172.21.15.92:0/2104305022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd420100100 msgr2=0x7fd4201984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:12.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.963+0000 7fd41ffff640 1 --2- 172.21.15.92:0/2104305022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd420100100 0x7fd4201984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.963+0000 7fd41ffff640 1 -- 172.21.15.92:0/2104305022 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd42019d460 con 0x7fd420100aa0 2024-09-19T08:58:12.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.963+0000 7fd41ffff640 1 --2- 172.21.15.92:0/2104305022 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd420100aa0 0x7fd4201989f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fd40800db80 tx=0x7fd40800b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:12.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.963+0000 7fd41dffb640 1 -- 172.21.15.92:0/2104305022 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd408017070 con 0x7fd420100aa0 2024-09-19T08:58:12.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.963+0000 7fd41dffb640 1 -- 172.21.15.92:0/2104305022 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd408003b70 con 0x7fd420100aa0 2024-09-19T08:58:12.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.963+0000 7fd426a86640 1 -- 172.21.15.92:0/2104305022 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd42019d750 con 0x7fd420100aa0 2024-09-19T08:58:12.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.963+0000 7fd41dffb640 1 -- 172.21.15.92:0/2104305022 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4080106c0 con 0x7fd420100aa0 2024-09-19T08:58:12.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.963+0000 7fd426a86640 1 -- 172.21.15.92:0/2104305022 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4201a5030 con 0x7fd420100aa0 2024-09-19T08:58:12.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.966+0000 7fd41dffb640 1 -- 172.21.15.92:0/2104305022 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd408004020 con 0x7fd420100aa0 2024-09-19T08:58:12.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.966+0000 7fd428e5f740 1 Processor -- start 2024-09-19T08:58:12.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.966+0000 7fd428e5f740 1 -- start start 2024-09-19T08:58:12.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.966+0000 7fd428e5f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449a13a060 0x56449a13a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:12.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.966+0000 7fd428e5f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56449a13a980 0x56449a144d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:12.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.966+0000 7fd428e5f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56449a145240 0x56449a147630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:12.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.966+0000 7fd428e5f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56449a09f620 con 0x56449a13a060 2024-09-19T08:58:12.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.966+0000 7fd428e5f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56449a046e50 con 0x56449a13a980 2024-09-19T08:58:12.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.966+0000 7fd428e5f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56449a09b5e0 con 0x56449a145240 2024-09-19T08:58:12.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.966+0000 7fd425023640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449a13a060 0x56449a13a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:12.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.966+0000 7fd41dffb640 1 --2- 172.21.15.92:0/2104305022 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd40c0a32c0 0x7fd40c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:12.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.966+0000 7fd425023640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449a13a060 0x56449a13a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36418/0 (socket says 172.21.15.92:36418) 2024-09-19T08:58:12.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.966+0000 7fd425023640 1 -- 172.21.15.92:0/2502646535 learned_addr learned my addr 172.21.15.92:0/2502646535 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:12.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.967+0000 7fd424822640 1 --2- 172.21.15.92:0/2502646535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56449a13a980 0x56449a144d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:12.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.967+0000 7fd41ffff640 1 --2- 172.21.15.92:0/2502646535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56449a145240 0x56449a147630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:12.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.967+0000 7fd425023640 1 --2- 172.21.15.92:0/2104305022 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd40c0a32c0 0x7fd40c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:12.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.967+0000 7fd41dffb640 1 -- 172.21.15.92:0/2104305022 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd4080cf790 con 0x7fd420100aa0 2024-09-19T08:58:12.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.967+0000 7fd424822640 1 -- 172.21.15.92:0/2502646535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56449a145240 msgr2=0x56449a147630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:12.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.967+0000 7fd424822640 1 --2- 172.21.15.92:0/2502646535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56449a145240 0x56449a147630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.967+0000 7fd424822640 1 -- 172.21.15.92:0/2502646535 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449a13a060 msgr2=0x56449a13a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:12.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.967+0000 7fd424822640 1 --2- 172.21.15.92:0/2502646535 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449a13a060 0x56449a13a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.967+0000 7fd424822640 1 -- 172.21.15.92:0/2502646535 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56449a037d40 con 0x56449a13a980 2024-09-19T08:58:12.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.967+0000 7fd425023640 1 --2- 172.21.15.92:0/2104305022 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd40c0a32c0 0x7fd40c0a5780 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd4100058c0 tx=0x7fd410004730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:12.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.967+0000 7fd424822640 1 --2- 172.21.15.92:0/2502646535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56449a13a980 0x56449a144d00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd418009230 tx=0x7fd418005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=667a79ca4bbb43c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:12.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.967+0000 7fd416ffd640 1 -- 172.21.15.92:0/2502646535 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41803f070 con 0x56449a13a980 2024-09-19T08:58:12.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.967+0000 7fd416ffd640 1 -- 172.21.15.92:0/2502646535 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd418004030 con 0x56449a13a980 2024-09-19T08:58:12.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.968+0000 7fd416ffd640 1 -- 172.21.15.92:0/2502646535 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd418035070 con 0x56449a13a980 2024-09-19T08:58:12.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.968+0000 7fd428e5f740 1 -- 172.21.15.92:0/2502646535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56449a13a980 msgr2=0x56449a144d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:12.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.968+0000 7fd428e5f740 1 --2- 172.21.15.92:0/2502646535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56449a13a980 0x56449a144d00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd418009230 tx=0x7fd418005e80 comp rx=0 tx=0).stop 2024-09-19T08:58:12.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.968+0000 7fd428e5f740 1 -- 172.21.15.92:0/2502646535 shutdown_connections 2024-09-19T08:58:12.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.968+0000 7fd428e5f740 1 --2- 172.21.15.92:0/2502646535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56449a145240 0x56449a147630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.968+0000 7fd428e5f740 1 --2- 172.21.15.92:0/2502646535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56449a13a980 0x56449a144d00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.968+0000 7fd428e5f740 1 --2- 172.21.15.92:0/2502646535 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449a13a060 0x56449a13a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.968+0000 7fd428e5f740 1 -- 172.21.15.92:0/2502646535 >> 172.21.15.92:0/2502646535 conn(0x56449a1365f0 msgr2=0x56449a1369d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:12.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.968+0000 7fd428e5f740 1 -- 172.21.15.92:0/2502646535 shutdown_connections 2024-09-19T08:58:12.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.968+0000 7fd428e5f740 1 -- 172.21.15.92:0/2502646535 wait complete. 2024-09-19T08:58:12.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.969+0000 7fd428e5f740 1 -- start start 2024-09-19T08:58:12.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.969+0000 7fd428e5f740 1 Processor -- start 2024-09-19T08:58:12.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.969+0000 7fd428e5f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449a13a060 0x56449a142140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:12.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.969+0000 7fd428e5f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56449a13a980 0x56449a142680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:12.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.969+0000 7fd428e5f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56449a145240 0x56449a142bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:12.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.969+0000 7fd428e5f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56449a147e10 con 0x56449a13a060 2024-09-19T08:58:12.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.969+0000 7fd428e5f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56449a027f10 con 0x56449a145240 2024-09-19T08:58:12.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.969+0000 7fd428e5f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56449a147f90 con 0x56449a13a980 2024-09-19T08:58:12.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.969+0000 7fd424822640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449a13a060 0x56449a142140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:12.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.969+0000 7fd428e5f740 10 client.0 _ll_register_callbacks cb 0x56449a04bdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:12.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.969+0000 7fd424822640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449a13a060 0x56449a142140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36420/0 (socket says 172.21.15.92:36420) 2024-09-19T08:58:12.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.969+0000 7fd424822640 1 -- 172.21.15.92:0/519900943 learned_addr learned my addr 172.21.15.92:0/519900943 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:12.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.969+0000 7fd425023640 1 --2- 172.21.15.92:0/519900943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56449a145240 0x56449a142bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:12.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.970+0000 7fd424822640 1 -- 172.21.15.92:0/519900943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56449a13a980 msgr2=0x56449a142680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:12.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.970+0000 7fd424822640 1 --2- 172.21.15.92:0/519900943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56449a13a980 0x56449a142680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.970+0000 7fd424822640 1 -- 172.21.15.92:0/519900943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56449a145240 msgr2=0x56449a142bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:12.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.970+0000 7fd424822640 1 --2- 172.21.15.92:0/519900943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56449a145240 0x56449a142bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.970+0000 7fd424822640 1 -- 172.21.15.92:0/519900943 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564499dae580 con 0x56449a13a060 2024-09-19T08:58:12.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.970+0000 7fd424822640 1 --2- 172.21.15.92:0/519900943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449a13a060 0x56449a142140 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd418009900 tx=0x7fd418032fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaa2944804e377a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:12.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.970+0000 7fd3fffff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:58:12.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.970+0000 7fd3fffff640 1 -- 172.21.15.92:0/519900943 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd418035070 con 0x56449a13a060 2024-09-19T08:58:12.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.970+0000 7fd3fffff640 1 -- 172.21.15.92:0/519900943 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd4180317b0 con 0x56449a13a060 2024-09-19T08:58:12.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.970+0000 7fd428e5f740 1 -- 172.21.15.92:0/519900943 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd418004030 con 0x56449a13a060 2024-09-19T08:58:12.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.970+0000 7fd3fffff640 1 -- 172.21.15.92:0/519900943 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd41803f040 con 0x56449a13a060 2024-09-19T08:58:12.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.970+0000 7fd428e5f740 10 client.15720 fetch_fsmap learned FSMap version 19 2024-09-19T08:58:12.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.970+0000 7fd428e5f740 1 -- 172.21.15.92:0/519900943 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x564499e78960 con 0x56449a13a060 2024-09-19T08:58:12.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.970+0000 7fd3fffff640 1 -- 172.21.15.92:0/519900943 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd418004030 con 0x56449a13a060 2024-09-19T08:58:12.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.970+0000 7fd3fffff640 1 -- 172.21.15.92:0/519900943 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fd4180047e0 con 0x56449a13a060 2024-09-19T08:58:12.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.970+0000 7fd428e5f740 10 client.15720 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:58:12.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.970+0000 7fd428e5f740 10 client.15720 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T08:58:12.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.970+0000 7fd428e5f740 20 client.15720 populate_metadata read hostname 'smithi092' 2024-09-19T08:58:12.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.970+0000 7fd428e5f740 1 --2- 172.21.15.92:0/519900943 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56449a154c50 0x56449a157040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:12.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.970+0000 7fd428e5f740 4 client.15720 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:58:12.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.970+0000 7fd428e5f740 1 -- 172.21.15.92:0/519900943 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56449a0acb90 con 0x56449a154c50 2024-09-19T08:58:12.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.971+0000 7fd41ffff640 1 --2- 172.21.15.92:0/519900943 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56449a154c50 0x56449a157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:12.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.971+0000 7fd3fffff640 10 client.15720 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:12.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.971+0000 7fd41ffff640 1 --2- 172.21.15.92:0/519900943 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56449a154c50 0x56449a157040 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f23d95df898a2d3 server_cookie=e6d39630ff09011 in_seq=0 out_seq=0 2024-09-19T08:58:12.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.972+0000 7fd3fffff640 1 -- 172.21.15.92:0/519900943 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56449a0acb90 con 0x56449a154c50 2024-09-19T08:58:12.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.972+0000 7fd3fffff640 10 client.15720 handle_command_reply: tid=0 2024-09-19T08:58:12.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.972+0000 7fd428e5f740 1 client.15720 shutdown 2024-09-19T08:58:12.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.972+0000 7fd428e5f740 1 -- 172.21.15.92:0/519900943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449a13a060 msgr2=0x56449a142140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:12.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.972+0000 7fd428e5f740 1 --2- 172.21.15.92:0/519900943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449a13a060 0x56449a142140 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd418009900 tx=0x7fd418032fc0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.972+0000 7fd428e5f740 1 -- 172.21.15.92:0/519900943 shutdown_connections 2024-09-19T08:58:12.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.972+0000 7fd428e5f740 1 --2- 172.21.15.92:0/519900943 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56449a154c50 0x56449a157040 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:13.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.972+0000 7fd3fffff640 0 client.15720 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:13.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.972+0000 7fd428e5f740 1 --2- 172.21.15.92:0/519900943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56449a145240 0x56449a142bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:13.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.972+0000 7fd428e5f740 1 --2- 172.21.15.92:0/519900943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56449a13a980 0x56449a142680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:13.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.972+0000 7fd428e5f740 1 --2- 172.21.15.92:0/519900943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449a13a060 0x56449a142140 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:13.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.972+0000 7fd428e5f740 1 -- 172.21.15.92:0/519900943 >> 172.21.15.92:0/519900943 conn(0x56449a1365f0 msgr2=0x56449a13c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:13.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.972+0000 7fd428e5f740 1 -- 172.21.15.92:0/519900943 shutdown_connections 2024-09-19T08:58:13.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.972+0000 7fd428e5f740 1 -- 172.21.15.92:0/519900943 wait complete. 2024-09-19T08:58:13.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.972+0000 7fd428e5f740 20 client.15720 trim_cache size 0 max 16384 2024-09-19T08:58:13.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.990+0000 7fd428e5f740 1 Processor -- start 2024-09-19T08:58:13.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.990+0000 7fd428e5f740 1 -- start start 2024-09-19T08:58:13.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.990+0000 7fd428e5f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56449a13a060 0x56449a15c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:13.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.990+0000 7fd428e5f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449a13a980 0x56449a15cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:13.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.990+0000 7fd428e5f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56449a145240 0x56449a13f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:13.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.990+0000 7fd428e5f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd4201ab480 con 0x56449a13a980 2024-09-19T08:58:13.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.990+0000 7fd428e5f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd4201add20 con 0x56449a145240 2024-09-19T08:58:13.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.990+0000 7fd428e5f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd4201abb10 con 0x56449a13a060 2024-09-19T08:58:13.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.990+0000 7fd41ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449a13a980 0x56449a15cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:13.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.991+0000 7fd41ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449a13a980 0x56449a15cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36434/0 (socket says 172.21.15.92:36434) 2024-09-19T08:58:13.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.991+0000 7fd41ffff640 1 -- 172.21.15.92:0/2660507178 learned_addr learned my addr 172.21.15.92:0/2660507178 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:13.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.991+0000 7fd425023640 1 --2- 172.21.15.92:0/2660507178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56449a145240 0x56449a13f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:13.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.991+0000 7fd424822640 1 --2- 172.21.15.92:0/2660507178 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56449a13a060 0x56449a15c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:13.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.991+0000 7fd41ffff640 1 -- 172.21.15.92:0/2660507178 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56449a13a060 msgr2=0x56449a15c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:13.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.991+0000 7fd41ffff640 1 --2- 172.21.15.92:0/2660507178 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56449a13a060 0x56449a15c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:13.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.991+0000 7fd41ffff640 1 -- 172.21.15.92:0/2660507178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56449a145240 msgr2=0x56449a13f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:13.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.991+0000 7fd41ffff640 1 --2- 172.21.15.92:0/2660507178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56449a145240 0x56449a13f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:13.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.991+0000 7fd41ffff640 1 -- 172.21.15.92:0/2660507178 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56449a13b200 con 0x56449a13a980 2024-09-19T08:58:13.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.991+0000 7fd424822640 1 --2- 172.21.15.92:0/2660507178 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56449a13a060 0x56449a15c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:58:13.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.991+0000 7fd41ffff640 1 --2- 172.21.15.92:0/2660507178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449a13a980 0x56449a15cb20 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd4080981c0 tx=0x7fd408016360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a91604c12550a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:13.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.991+0000 7fd4167fc640 1 -- 172.21.15.92:0/2660507178 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd408016170 con 0x56449a13a980 2024-09-19T08:58:13.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.991+0000 7fd4167fc640 1 -- 172.21.15.92:0/2660507178 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd408004310 con 0x56449a13a980 2024-09-19T08:58:13.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.991+0000 7fd4167fc640 1 -- 172.21.15.92:0/2660507178 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd408003e40 con 0x56449a13a980 2024-09-19T08:58:13.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.992+0000 7fd428e5f740 1 -- 172.21.15.92:0/2660507178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449a13a980 msgr2=0x56449a15cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:13.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.992+0000 7fd428e5f740 1 --2- 172.21.15.92:0/2660507178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449a13a980 0x56449a15cb20 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd4080981c0 tx=0x7fd408016360 comp rx=0 tx=0).stop 2024-09-19T08:58:13.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.992+0000 7fd428e5f740 1 -- 172.21.15.92:0/2660507178 shutdown_connections 2024-09-19T08:58:13.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.992+0000 7fd428e5f740 1 --2- 172.21.15.92:0/2660507178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56449a145240 0x56449a13f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:13.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.992+0000 7fd428e5f740 1 --2- 172.21.15.92:0/2660507178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449a13a980 0x56449a15cb20 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:13.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.992+0000 7fd428e5f740 1 --2- 172.21.15.92:0/2660507178 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56449a13a060 0x56449a15c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:13.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.992+0000 7fd428e5f740 1 -- 172.21.15.92:0/2660507178 >> 172.21.15.92:0/2660507178 conn(0x56449a1365f0 msgr2=0x56449a1439a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:13.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.992+0000 7fd428e5f740 1 -- 172.21.15.92:0/2660507178 shutdown_connections 2024-09-19T08:58:13.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.992+0000 7fd428e5f740 1 -- 172.21.15.92:0/2660507178 wait complete. 2024-09-19T08:58:13.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.992+0000 7fd428e5f740 1 -- start start 2024-09-19T08:58:13.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.992+0000 7fd428e5f740 1 Processor -- start 2024-09-19T08:58:13.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.993+0000 7fd428e5f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449a13a060 0x56449a1491f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:13.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.993+0000 7fd428e5f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56449a13a980 0x56449a149730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:13.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.993+0000 7fd428e5f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56449a145240 0x56449a149c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:13.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.993+0000 7fd428e5f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd4201ac1e0 con 0x56449a13a060 2024-09-19T08:58:13.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.993+0000 7fd428e5f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd4201ad650 con 0x56449a145240 2024-09-19T08:58:13.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.993+0000 7fd428e5f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd4201ac8b0 con 0x56449a13a980 2024-09-19T08:58:13.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.993+0000 7fd428e5f740 10 client.0 _ll_register_callbacks cb 0x7fd418005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:13.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.993+0000 7fd424822640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449a13a060 0x56449a1491f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:13.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.993+0000 7fd424822640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449a13a060 0x56449a1491f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36446/0 (socket says 172.21.15.92:36446) 2024-09-19T08:58:13.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.993+0000 7fd424822640 1 -- 172.21.15.92:0/312783931 learned_addr learned my addr 172.21.15.92:0/312783931 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:13.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.993+0000 7fd425023640 1 --2- 172.21.15.92:0/312783931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56449a145240 0x56449a149c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:13.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.993+0000 7fd41ffff640 1 --2- 172.21.15.92:0/312783931 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56449a13a980 0x56449a149730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:13.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.993+0000 7fd424822640 1 -- 172.21.15.92:0/312783931 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56449a13a980 msgr2=0x56449a149730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:13.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.993+0000 7fd424822640 1 --2- 172.21.15.92:0/312783931 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56449a13a980 0x56449a149730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:13.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.993+0000 7fd424822640 1 -- 172.21.15.92:0/312783931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56449a145240 msgr2=0x56449a149c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:13.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.993+0000 7fd424822640 1 --2- 172.21.15.92:0/312783931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56449a145240 0x56449a149c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:13.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.993+0000 7fd424822640 1 -- 172.21.15.92:0/312783931 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56449a1be800 con 0x56449a13a060 2024-09-19T08:58:13.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.993+0000 7fd425023640 1 --2- 172.21.15.92:0/312783931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56449a145240 0x56449a149c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:58:13.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.993+0000 7fd41ffff640 1 --2- 172.21.15.92:0/312783931 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56449a13a980 0x56449a149730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:58:13.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.994+0000 7fd424822640 1 --2- 172.21.15.92:0/312783931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449a13a060 0x56449a1491f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd41802a930 tx=0x7fd418004970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=687efca4affee87b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:13.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.994+0000 7fd3fffff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:58:13.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.994+0000 7fd3fffff640 1 -- 172.21.15.92:0/312783931 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd418060060 con 0x56449a13a060 2024-09-19T08:58:13.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.994+0000 7fd3fffff640 1 -- 172.21.15.92:0/312783931 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd4180319c0 con 0x56449a13a060 2024-09-19T08:58:13.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.994+0000 7fd428e5f740 1 -- 172.21.15.92:0/312783931 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd408004310 con 0x56449a13a060 2024-09-19T08:58:13.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.994+0000 7fd3fffff640 1 -- 172.21.15.92:0/312783931 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd418035040 con 0x56449a13a060 2024-09-19T08:58:13.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.994+0000 7fd428e5f740 10 client.15726 fetch_fsmap learned FSMap version 19 2024-09-19T08:58:13.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.994+0000 7fd428e5f740 1 -- 172.21.15.92:0/312783931 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56449a1bfab0 con 0x56449a13a060 2024-09-19T08:58:13.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.994+0000 7fd3fffff640 1 -- 172.21.15.92:0/312783931 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd408004310 con 0x56449a13a060 2024-09-19T08:58:13.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.994+0000 7fd3fffff640 1 -- 172.21.15.92:0/312783931 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fd418065070 con 0x56449a13a060 2024-09-19T08:58:13.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.994+0000 7fd428e5f740 10 client.15726 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:58:13.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.994+0000 7fd428e5f740 10 client.15726 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T08:58:13.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.995+0000 7fd428e5f740 20 client.15726 populate_metadata read hostname 'smithi092' 2024-09-19T08:58:13.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.995+0000 7fd428e5f740 1 --2- 172.21.15.92:0/312783931 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56449a154c50 0x56449a1c2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:13.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.995+0000 7fd428e5f740 4 client.15726 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "507ce254", "release": true, "await": true}] 2024-09-19T08:58:13.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.995+0000 7fd428e5f740 1 -- 172.21.15.92:0/312783931 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "quiesce db", "set_id": "507ce254", "release": true, "await": true}) -- 0x56449a0a70a0 con 0x56449a154c50 2024-09-19T08:58:13.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.995+0000 7fd41ffff640 1 --2- 172.21.15.92:0/312783931 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56449a154c50 0x56449a1c2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:13.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.995+0000 7fd41ffff640 1 --2- 172.21.15.92:0/312783931 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56449a154c50 0x56449a1c2260 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7cfa5efc3f48df server_cookie=3e2b9e03ca787c3a in_seq=0 out_seq=0 2024-09-19T08:58:13.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:12.995+0000 7fd3fffff640 10 client.15726 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:13.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:13.045+0000 7fd3fffff640 1 -- 172.21.15.92:0/312783931 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56449a0a70a0 con 0x56449a154c50 2024-09-19T08:58:13.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:13.045+0000 7fd3fffff640 10 client.15726 handle_command_reply: tid=0 2024-09-19T08:58:13.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:13.047+0000 7fd428e5f740 1 client.15726 shutdown 2024-09-19T08:58:13.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:13.050+0000 7fd428e5f740 1 -- 172.21.15.92:0/312783931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449a13a060 msgr2=0x56449a1491f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:13.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:13.050+0000 7fd428e5f740 1 --2- 172.21.15.92:0/312783931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449a13a060 0x56449a1491f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd41802a930 tx=0x7fd418004970 comp rx=0 tx=0).stop 2024-09-19T08:58:13.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:13.052+0000 7fd428e5f740 1 -- 172.21.15.92:0/312783931 shutdown_connections 2024-09-19T08:58:13.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:13.052+0000 7fd428e5f740 1 --2- 172.21.15.92:0/312783931 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56449a154c50 0x56449a1c2260 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:13.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:13.052+0000 7fd428e5f740 1 --2- 172.21.15.92:0/312783931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56449a145240 0x56449a149c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:13.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:13.052+0000 7fd428e5f740 1 --2- 172.21.15.92:0/312783931 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56449a13a980 0x56449a149730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:13.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:13.052+0000 7fd428e5f740 1 --2- 172.21.15.92:0/312783931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449a13a060 0x56449a1491f0 secure :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd41802a930 tx=0x7fd418004970 comp rx=0 tx=0).stop 2024-09-19T08:58:13.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:13.052+0000 7fd3fffff640 0 client.15726 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:13.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:13.052+0000 7fd428e5f740 1 -- 172.21.15.92:0/312783931 >> 172.21.15.92:0/312783931 conn(0x56449a1365f0 msgr2=0x56449a134f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:13.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:13.055+0000 7fd428e5f740 1 -- 172.21.15.92:0/312783931 shutdown_connections 2024-09-19T08:58:13.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:13.055+0000 7fd428e5f740 1 -- 172.21.15.92:0/312783931 wait complete. 2024-09-19T08:58:13.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:13.056+0000 7fd428e5f740 20 client.15726 trim_cache size 0 max 16384 2024-09-19T08:58:13.055 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T08:58:13.056 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 19, 2024-09-19T08:58:13.056 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24472, 2024-09-19T08:58:13.056 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 12, 2024-09-19T08:58:13.056 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-09-19T08:58:13.056 INFO:teuthology.orchestra.run.smithi092.stdout: "507ce254": { 2024-09-19T08:58:13.056 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 12, 2024-09-19T08:58:13.056 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-09-19T08:58:13.056 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T08:58:13.056 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-09-19T08:58:13.056 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T08:58:13.056 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T08:58:13.056 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 90.0, 2024-09-19T08:58:13.056 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 140.3, 2024-09-19T08:58:13.057 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-09-19T08:58:13.057 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-09-19T08:58:13.057 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-09-19T08:58:13.057 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T08:58:13.057 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-09-19T08:58:13.057 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T08:58:13.057 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:58:13.057 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:58:13.057 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:58:13.057 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:58:13.057 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:58:13.057 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T08:58:13.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:13.058+0000 7fd426a86640 1 -- 172.21.15.92:0/2104305022 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd40c0a32c0 msgr2=0x7fd40c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:13.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:13.058+0000 7fd426a86640 1 --2- 172.21.15.92:0/2104305022 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd40c0a32c0 0x7fd40c0a5780 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd4100058c0 tx=0x7fd410004730 comp rx=0 tx=0).stop 2024-09-19T08:58:13.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:13.058+0000 7fd426a86640 1 -- 172.21.15.92:0/2104305022 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd420100aa0 msgr2=0x7fd4201989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:13.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:13.058+0000 7fd426a86640 1 --2- 172.21.15.92:0/2104305022 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd420100aa0 0x7fd4201989f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fd40800db80 tx=0x7fd40800b630 comp rx=0 tx=0).stop 2024-09-19T08:58:13.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:13.058+0000 7fd426a86640 1 -- 172.21.15.92:0/2104305022 shutdown_connections 2024-09-19T08:58:13.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:13.058+0000 7fd426a86640 1 --2- 172.21.15.92:0/2104305022 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd420106b80 0x7fd42019cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:13.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:13.059+0000 7fd426a86640 1 --2- 172.21.15.92:0/2104305022 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd40c0a32c0 0x7fd40c0a5780 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:13.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:13.059+0000 7fd426a86640 1 --2- 172.21.15.92:0/2104305022 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd420100aa0 0x7fd4201989f0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:13.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:13.059+0000 7fd426a86640 1 --2- 172.21.15.92:0/2104305022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd420100100 0x7fd4201984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:13.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:13.059+0000 7fd426a86640 1 -- 172.21.15.92:0/2104305022 >> 172.21.15.92:0/2104305022 conn(0x7fd420077230 msgr2=0x7fd420104c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:13.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:13.060+0000 7fd426a86640 1 -- 172.21.15.92:0/2104305022 shutdown_connections 2024-09-19T08:58:13.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:13.060+0000 7fd426a86640 1 -- 172.21.15.92:0/2104305022 wait complete. 2024-09-19T08:58:13.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:13 smithi092 ceph-mon[31407]: pgmap v382: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 7.3 KiB/s wr, 9 op/s 2024-09-19T08:58:13.784 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '507ce254', total seconds elapsed: 23.4 2024-09-19T08:58:13.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:13 smithi167 ceph-mon[35359]: pgmap v382: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 7.3 KiB/s wr, 9 op/s 2024-09-19T08:58:13.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:13 smithi190 ceph-mon[35358]: pgmap v382: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 7.3 KiB/s wr, 9 op/s 2024-09-19T08:58:15.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:15 smithi092 ceph-mon[31407]: pgmap v383: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 55 KiB/s wr, 15 op/s 2024-09-19T08:58:15.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 90.0 s, 3404.0 tps, lat 127.834 ms stddev 1455.086 2024-09-19T08:58:15.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:15 smithi167 ceph-mon[35359]: pgmap v383: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 55 KiB/s wr, 15 op/s 2024-09-19T08:58:15.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:15 smithi190 ceph-mon[35358]: pgmap v383: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 55 KiB/s wr, 15 op/s 2024-09-19T08:58:17.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.001+0000 7fb3c96a5640 1 -- 172.21.15.92:0/63434189 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3c4109380 msgr2=0x7fb3c4109800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:17.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.001+0000 7fb3c96a5640 1 --2- 172.21.15.92:0/63434189 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3c4109380 0x7fb3c4109800 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8009900 tx=0x7fb3b802a3f0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.002+0000 7fb3c96a5640 1 -- 172.21.15.92:0/63434189 shutdown_connections 2024-09-19T08:58:17.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.002+0000 7fb3c96a5640 1 --2- 172.21.15.92:0/63434189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3c4109d40 0x7fb3c41105d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.002+0000 7fb3c96a5640 1 --2- 172.21.15.92:0/63434189 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3c4109380 0x7fb3c4109800 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8009900 tx=0x7fb3b802a3f0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.002+0000 7fb3c96a5640 1 --2- 172.21.15.92:0/63434189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3c41084c0 0x7fb3c41088c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.002+0000 7fb3c96a5640 1 -- 172.21.15.92:0/63434189 >> 172.21.15.92:0/63434189 conn(0x7fb3c4077490 msgr2=0x7fb3c40798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.003+0000 7fb3c96a5640 1 -- 172.21.15.92:0/63434189 shutdown_connections 2024-09-19T08:58:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.003+0000 7fb3c96a5640 1 -- 172.21.15.92:0/63434189 wait complete. 2024-09-19T08:58:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.003+0000 7fb3c96a5640 1 Processor -- start 2024-09-19T08:58:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.004+0000 7fb3c96a5640 1 -- start start 2024-09-19T08:58:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.004+0000 7fb3c96a5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3c41084c0 0x7fb3c419e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.004+0000 7fb3c96a5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3c4109d40 0x7fb3c419eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.004+0000 7fb3c96a5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3c41a3b40 0x7fb3c41a5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.004+0000 7fb3c96a5640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c4113df0 con 0x7fb3c41084c0 2024-09-19T08:58:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.004+0000 7fb3c96a5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c4113c70 con 0x7fb3c41a3b40 2024-09-19T08:58:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.004+0000 7fb3c96a5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c4113f70 con 0x7fb3c4109d40 2024-09-19T08:58:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.005+0000 7fb3c37fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3c41a3b40 0x7fb3c41a5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.005+0000 7fb3c37fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3c41a3b40 0x7fb3c41a5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:56446/0 (socket says 172.21.15.92:56446) 2024-09-19T08:58:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.005+0000 7fb3c37fe640 1 -- 172.21.15.92:0/36674166 learned_addr learned my addr 172.21.15.92:0/36674166 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.005+0000 7fb3c2ffd640 1 --2- 172.21.15.92:0/36674166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3c41084c0 0x7fb3c419e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.005+0000 7fb3c37fe640 1 -- 172.21.15.92:0/36674166 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3c4109d40 msgr2=0x7fb3c419eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.005+0000 7fb3c37fe640 1 --2- 172.21.15.92:0/36674166 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3c4109d40 0x7fb3c419eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.005+0000 7fb3c37fe640 1 -- 172.21.15.92:0/36674166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3c41084c0 msgr2=0x7fb3c419e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.005+0000 7fb3c37fe640 1 --2- 172.21.15.92:0/36674166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3c41084c0 0x7fb3c419e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.005+0000 7fb3c37fe640 1 -- 172.21.15.92:0/36674166 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3c41a65a0 con 0x7fb3c41a3b40 2024-09-19T08:58:17.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.006+0000 7fb3c37fe640 1 --2- 172.21.15.92:0/36674166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3c41a3b40 0x7fb3c41a5f30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc00eb10 tx=0x7fb3bc00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:17.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.006+0000 7fb3abfff640 1 -- 172.21.15.92:0/36674166 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc004b20 con 0x7fb3c41a3b40 2024-09-19T08:58:17.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.006+0000 7fb3c96a5640 1 -- 172.21.15.92:0/36674166 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3c41a6890 con 0x7fb3c41a3b40 2024-09-19T08:58:17.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.006+0000 7fb3c96a5640 1 -- 172.21.15.92:0/36674166 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3c41a6de0 con 0x7fb3c41a3b40 2024-09-19T08:58:17.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.006+0000 7fb3abfff640 1 -- 172.21.15.92:0/36674166 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3bc004cc0 con 0x7fb3c41a3b40 2024-09-19T08:58:17.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.006+0000 7fb3abfff640 1 -- 172.21.15.92:0/36674166 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc010760 con 0x7fb3c41a3b40 2024-09-19T08:58:17.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.009+0000 7fb3cc443740 1 Processor -- start 2024-09-19T08:58:17.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.010+0000 7fb3abfff640 1 -- 172.21.15.92:0/36674166 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb3bc010900 con 0x7fb3c41a3b40 2024-09-19T08:58:17.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.010+0000 7fb3cc443740 1 -- start start 2024-09-19T08:58:17.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.010+0000 7fb3cc443740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647550ae9a0 0x5647550aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:17.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.010+0000 7fb3cc443740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647550af2e0 0x5647550b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:17.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.010+0000 7fb3cc443740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647550b4370 0x5647550b6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:17.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.010+0000 7fb3cc443740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5647550122f0 con 0x5647550af2e0 2024-09-19T08:58:17.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.010+0000 7fb3cc443740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564754fba270 con 0x5647550ae9a0 2024-09-19T08:58:17.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.010+0000 7fb3cc443740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56475500e2b0 con 0x5647550b4370 2024-09-19T08:58:17.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.011+0000 7fb3c27fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647550b4370 0x5647550b6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.011+0000 7fb3c27fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647550ae9a0 0x5647550aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.011+0000 7fb3c27fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647550ae9a0 0x5647550aeda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:56454/0 (socket says 172.21.15.92:56454) 2024-09-19T08:58:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.011+0000 7fb3c27fc640 1 -- 172.21.15.92:0/3875665097 learned_addr learned my addr 172.21.15.92:0/3875665097 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.011+0000 7fb3c27fc640 1 -- 172.21.15.92:0/3875665097 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647550b4370 msgr2=0x5647550b6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.011+0000 7fb3c27fc640 1 --2- 172.21.15.92:0/3875665097 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647550b4370 0x5647550b6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.011+0000 7fb3c27fc640 1 -- 172.21.15.92:0/3875665097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647550af2e0 msgr2=0x5647550b3da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T08:58:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.011+0000 7fb3c27fc640 1 --2- 172.21.15.92:0/3875665097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647550af2e0 0x5647550b3da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.011+0000 7fb3c27fc640 1 -- 172.21.15.92:0/3875665097 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564754fb9340 con 0x5647550ae9a0 2024-09-19T08:58:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.012+0000 7fb3c27fc640 1 --2- 172.21.15.92:0/3875665097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647550ae9a0 0x5647550aeda0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8005ec0 tx=0x7fb3b8000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf0bdd696bbe61dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.012+0000 7fb3a97fa640 1 -- 172.21.15.92:0/3875665097 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8035070 con 0x5647550ae9a0 2024-09-19T08:58:17.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.012+0000 7fb3a97fa640 1 -- 172.21.15.92:0/3875665097 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3b8005500 con 0x5647550ae9a0 2024-09-19T08:58:17.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.012+0000 7fb3a97fa640 1 -- 172.21.15.92:0/3875665097 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8004d70 con 0x5647550ae9a0 2024-09-19T08:58:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.013+0000 7fb3abfff640 1 --2- 172.21.15.92:0/36674166 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb3ac0a33f0 0x7fb3ac0a58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.013+0000 7fb3abfff640 1 -- 172.21.15.92:0/36674166 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb3bc0cfe90 con 0x7fb3c41a3b40 2024-09-19T08:58:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.013+0000 7fb3cc443740 1 -- 172.21.15.92:0/3875665097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647550ae9a0 msgr2=0x5647550aeda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.013+0000 7fb3cc443740 1 --2- 172.21.15.92:0/3875665097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647550ae9a0 0x5647550aeda0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8005ec0 tx=0x7fb3b8000bc0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.013+0000 7fb3c2ffd640 1 --2- 172.21.15.92:0/36674166 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb3ac0a33f0 0x7fb3ac0a58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.013+0000 7fb3cc443740 1 -- 172.21.15.92:0/3875665097 shutdown_connections 2024-09-19T08:58:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.013+0000 7fb3cc443740 1 --2- 172.21.15.92:0/3875665097 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647550b4370 0x5647550b6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.013+0000 7fb3cc443740 1 --2- 172.21.15.92:0/3875665097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647550af2e0 0x5647550b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.013+0000 7fb3cc443740 1 --2- 172.21.15.92:0/3875665097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647550ae9a0 0x5647550aeda0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.013+0000 7fb3cc443740 1 -- 172.21.15.92:0/3875665097 >> 172.21.15.92:0/3875665097 conn(0x5647550aa010 msgr2=0x5647550aa410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.014+0000 7fb3cc443740 1 -- 172.21.15.92:0/3875665097 shutdown_connections 2024-09-19T08:58:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.014+0000 7fb3cc443740 1 -- 172.21.15.92:0/3875665097 wait complete. 2024-09-19T08:58:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.015+0000 7fb3c2ffd640 1 --2- 172.21.15.92:0/36674166 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb3ac0a33f0 0x7fb3ac0a58b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x5647550aae90 tx=0x7fb3b4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.015+0000 7fb3cc443740 1 -- start start 2024-09-19T08:58:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.015+0000 7fb3cc443740 1 Processor -- start 2024-09-19T08:58:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.015+0000 7fb3cc443740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647550ae9a0 0x5647550c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.015+0000 7fb3cc443740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647550af2e0 0x5647550ca080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.015+0000 7fb3cc443740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647550b4370 0x5647550d10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.015+0000 7fb3cc443740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5647550c82f0 con 0x5647550af2e0 2024-09-19T08:58:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.015+0000 7fb3cc443740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564754f9b290 con 0x5647550b4370 2024-09-19T08:58:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.015+0000 7fb3cc443740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5647550c8470 con 0x5647550ae9a0 2024-09-19T08:58:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.016+0000 7fb3cc443740 10 client.0 _ll_register_callbacks cb 0x564754fcc140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.016+0000 7fb3c2ffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647550ae9a0 0x5647550c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.016+0000 7fb3c2ffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647550ae9a0 0x5647550c9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:48340/0 (socket says 172.21.15.92:48340) 2024-09-19T08:58:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.016+0000 7fb3c2ffd640 1 -- 172.21.15.92:0/2301917240 learned_addr learned my addr 172.21.15.92:0/2301917240 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:17.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.016+0000 7fb3c27fc640 1 --2- 172.21.15.92:0/2301917240 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647550af2e0 0x5647550ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:17.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.016+0000 7fb3c37fe640 1 --2- 172.21.15.92:0/2301917240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647550b4370 0x5647550d10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.016+0000 7fb3c2ffd640 1 -- 172.21.15.92:0/2301917240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647550b4370 msgr2=0x5647550d10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.016+0000 7fb3c2ffd640 1 --2- 172.21.15.92:0/2301917240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647550b4370 0x5647550d10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.016+0000 7fb3c2ffd640 1 -- 172.21.15.92:0/2301917240 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647550af2e0 msgr2=0x5647550ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.016+0000 7fb3c2ffd640 1 --2- 172.21.15.92:0/2301917240 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647550af2e0 0x5647550ca080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.016+0000 7fb3c2ffd640 1 -- 172.21.15.92:0/2301917240 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564754d25210 con 0x5647550ae9a0 2024-09-19T08:58:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.017+0000 7fb3c2ffd640 1 --2- 172.21.15.92:0/2301917240 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647550ae9a0 0x5647550c9b40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb3b400e840 tx=0x7fb3b4004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed5996cf74158c14 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.017+0000 7fb3a6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T08:58:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.017+0000 7fb3c37fe640 1 --2- 172.21.15.92:0/2301917240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647550b4370 0x5647550d10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:58:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.017+0000 7fb3a6ff5640 1 -- 172.21.15.92:0/2301917240 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b4026630 con 0x5647550ae9a0 2024-09-19T08:58:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.017+0000 7fb3a6ff5640 1 -- 172.21.15.92:0/2301917240 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb3b401c410 con 0x5647550ae9a0 2024-09-19T08:58:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.017+0000 7fb3cc443740 1 -- 172.21.15.92:0/2301917240 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3b8005500 con 0x5647550ae9a0 2024-09-19T08:58:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.017+0000 7fb3a6ff5640 1 -- 172.21.15.92:0/2301917240 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb3b40267d0 con 0x5647550ae9a0 2024-09-19T08:58:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.017+0000 7fb3cc443740 10 client.25141 fetch_fsmap learned FSMap version 19 2024-09-19T08:58:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.018+0000 7fb3cc443740 1 -- 172.21.15.92:0/2301917240 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x564754df1620 con 0x5647550ae9a0 2024-09-19T08:58:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.018+0000 7fb3a6ff5640 1 -- 172.21.15.92:0/2301917240 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3b8005500 con 0x5647550ae9a0 2024-09-19T08:58:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.018+0000 7fb3a6ff5640 1 -- 172.21.15.92:0/2301917240 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fb3b401ccd0 con 0x5647550ae9a0 2024-09-19T08:58:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.018+0000 7fb3cc443740 10 client.25141 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:58:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.018+0000 7fb3cc443740 10 client.25141 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T08:58:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.018+0000 7fb3cc443740 20 client.25141 populate_metadata read hostname 'smithi092' 2024-09-19T08:58:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.018+0000 7fb3cc443740 1 --2- 172.21.15.92:0/2301917240 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5647550e6d40 0x5647550e9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.018+0000 7fb3cc443740 4 client.25141 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:58:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.018+0000 7fb3cc443740 1 -- 172.21.15.92:0/2301917240 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56475501fa20 con 0x5647550e6d40 2024-09-19T08:58:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.019+0000 7fb3c27fc640 1 --2- 172.21.15.92:0/2301917240 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5647550e6d40 0x5647550e9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:17.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.019+0000 7fb3a6ff5640 10 client.25141 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:17.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.019+0000 7fb3c27fc640 1 --2- 172.21.15.92:0/2301917240 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5647550e6d40 0x5647550e9180 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=daad77a07a5f26b1 server_cookie=45b13b0ed674cbc6 in_seq=0 out_seq=0 2024-09-19T08:58:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.020+0000 7fb3a6ff5640 1 -- 172.21.15.92:0/2301917240 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56475501fa20 con 0x5647550e6d40 2024-09-19T08:58:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.020+0000 7fb3a6ff5640 10 client.25141 handle_command_reply: tid=0 2024-09-19T08:58:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.020+0000 7fb3cc443740 1 client.25141 shutdown 2024-09-19T08:58:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.021+0000 7fb3cc443740 1 -- 172.21.15.92:0/2301917240 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647550ae9a0 msgr2=0x5647550c9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.021+0000 7fb3cc443740 1 --2- 172.21.15.92:0/2301917240 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647550ae9a0 0x5647550c9b40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb3b400e840 tx=0x7fb3b4004730 comp rx=0 tx=0).stop 2024-09-19T08:58:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.021+0000 7fb3cc443740 1 -- 172.21.15.92:0/2301917240 shutdown_connections 2024-09-19T08:58:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.021+0000 7fb3cc443740 1 --2- 172.21.15.92:0/2301917240 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5647550e6d40 0x5647550e9180 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.021+0000 7fb3cc443740 1 --2- 172.21.15.92:0/2301917240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647550b4370 0x5647550d10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.021+0000 7fb3cc443740 1 --2- 172.21.15.92:0/2301917240 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647550af2e0 0x5647550ca080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.021+0000 7fb3cc443740 1 --2- 172.21.15.92:0/2301917240 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647550ae9a0 0x5647550c9b40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.021+0000 7fb3cc443740 1 -- 172.21.15.92:0/2301917240 >> 172.21.15.92:0/2301917240 conn(0x5647550aa010 msgr2=0x5647550ab820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:17.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.021+0000 7fb3a6ff5640 0 client.25141 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:17.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.021+0000 7fb3cc443740 1 -- 172.21.15.92:0/2301917240 shutdown_connections 2024-09-19T08:58:17.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.021+0000 7fb3cc443740 1 -- 172.21.15.92:0/2301917240 wait complete. 2024-09-19T08:58:17.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.021+0000 7fb3cc443740 20 client.25141 trim_cache size 0 max 16384 2024-09-19T08:58:17.051 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.051+0000 7fb3cc443740 1 Processor -- start 2024-09-19T08:58:17.051 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.051+0000 7fb3cc443740 1 -- start start 2024-09-19T08:58:17.053 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.052+0000 7fb3cc443740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647550ae9a0 0x5647550c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:17.053 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.052+0000 7fb3cc443740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647550af2e0 0x5647550d0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:17.053 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.052+0000 7fb3cc443740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647550b4370 0x5647550c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:17.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.052+0000 7fb3c2ffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647550ae9a0 0x5647550c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:17.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.052+0000 7fb3c2ffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647550ae9a0 0x5647550c88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:48356/0 (socket says 172.21.15.92:48356) 2024-09-19T08:58:17.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.052+0000 7fb3c2ffd640 1 -- 172.21.15.92:0/993043257 learned_addr learned my addr 172.21.15.92:0/993043257 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:17.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.052+0000 7fb3cc443740 1 -- 172.21.15.92:0/993043257 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b000c490 con 0x5647550b4370 2024-09-19T08:58:17.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.052+0000 7fb3cc443740 1 -- 172.21.15.92:0/993043257 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b000ed30 con 0x5647550af2e0 2024-09-19T08:58:17.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.052+0000 7fb3cc443740 1 -- 172.21.15.92:0/993043257 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b000cb20 con 0x5647550ae9a0 2024-09-19T08:58:17.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.052+0000 7fb3c27fc640 1 --2- 172.21.15.92:0/993043257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647550af2e0 0x5647550d0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:17.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.052+0000 7fb3c37fe640 1 --2- 172.21.15.92:0/993043257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647550b4370 0x5647550c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:17.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.053+0000 7fb3c2ffd640 1 -- 172.21.15.92:0/993043257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647550af2e0 msgr2=0x5647550d0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:17.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.053+0000 7fb3c2ffd640 1 --2- 172.21.15.92:0/993043257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647550af2e0 0x5647550d0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.053+0000 7fb3c2ffd640 1 -- 172.21.15.92:0/993043257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647550b4370 msgr2=0x5647550c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:17.055 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.053+0000 7fb3c2ffd640 1 --2- 172.21.15.92:0/993043257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647550b4370 0x5647550c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.055 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.053+0000 7fb3c2ffd640 1 -- 172.21.15.92:0/993043257 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647550c9680 con 0x5647550ae9a0 2024-09-19T08:58:17.055 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.053+0000 7fb3c2ffd640 1 --2- 172.21.15.92:0/993043257 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647550ae9a0 0x5647550c88a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb3b40059f0 tx=0x7fb3b400ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16587495b93b92f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:17.056 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.054+0000 7fb3a8ff9640 1 -- 172.21.15.92:0/993043257 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b4005c10 con 0x5647550ae9a0 2024-09-19T08:58:17.056 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.054+0000 7fb3a8ff9640 1 -- 172.21.15.92:0/993043257 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3b4035070 con 0x5647550ae9a0 2024-09-19T08:58:17.056 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.054+0000 7fb3a8ff9640 1 -- 172.21.15.92:0/993043257 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b401d410 con 0x5647550ae9a0 2024-09-19T08:58:17.056 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.056+0000 7fb3cc443740 1 -- 172.21.15.92:0/993043257 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647550ae9a0 msgr2=0x5647550c88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:17.056 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.056+0000 7fb3cc443740 1 --2- 172.21.15.92:0/993043257 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647550ae9a0 0x5647550c88a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb3b40059f0 tx=0x7fb3b400ec40 comp rx=0 tx=0).stop 2024-09-19T08:58:17.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.056+0000 7fb3cc443740 1 -- 172.21.15.92:0/993043257 shutdown_connections 2024-09-19T08:58:17.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.056+0000 7fb3cc443740 1 --2- 172.21.15.92:0/993043257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647550b4370 0x5647550c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.056+0000 7fb3cc443740 1 --2- 172.21.15.92:0/993043257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647550af2e0 0x5647550d0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.056+0000 7fb3cc443740 1 --2- 172.21.15.92:0/993043257 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647550ae9a0 0x5647550c88a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.056+0000 7fb3cc443740 1 -- 172.21.15.92:0/993043257 >> 172.21.15.92:0/993043257 conn(0x5647550aa010 msgr2=0x5647550b0420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:17.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.056+0000 7fb3cc443740 1 -- 172.21.15.92:0/993043257 shutdown_connections 2024-09-19T08:58:17.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.056+0000 7fb3cc443740 1 -- 172.21.15.92:0/993043257 wait complete. 2024-09-19T08:58:17.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.057+0000 7fb3cc443740 1 -- start start 2024-09-19T08:58:17.058 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.057+0000 7fb3cc443740 1 Processor -- start 2024-09-19T08:58:17.058 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.057+0000 7fb3cc443740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647550ae9a0 0x5647550cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:17.058 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.057+0000 7fb3cc443740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647550af2e0 0x5647550ce180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:17.058 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.057+0000 7fb3c2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647550ae9a0 0x5647550cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:17.058 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.057+0000 7fb3c2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647550ae9a0 0x5647550cdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36492/0 (socket says 172.21.15.92:36492) 2024-09-19T08:58:17.058 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.057+0000 7fb3c2ffd640 1 -- 172.21.15.92:0/1246862667 learned_addr learned my addr 172.21.15.92:0/1246862667 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:17.059 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.057+0000 7fb3cc443740 1 --2- 172.21.15.92:0/1246862667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647550b4370 0x56475514fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:17.059 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.058+0000 7fb3c27fc640 1 --2- 172.21.15.92:0/1246862667 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647550af2e0 0x5647550ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:17.059 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.058+0000 7fb3cc443740 1 -- 172.21.15.92:0/1246862667 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b000d1f0 con 0x5647550ae9a0 2024-09-19T08:58:17.059 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.058+0000 7fb3cc443740 1 -- 172.21.15.92:0/1246862667 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b000e660 con 0x5647550b4370 2024-09-19T08:58:17.059 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.058+0000 7fb3cc443740 1 -- 172.21.15.92:0/1246862667 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b000d8c0 con 0x5647550af2e0 2024-09-19T08:58:17.059 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.058+0000 7fb3c37fe640 1 --2- 172.21.15.92:0/1246862667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647550b4370 0x56475514fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:17.059 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.058+0000 7fb3cc443740 10 client.0 _ll_register_callbacks cb 0x7fb3b4009980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:17.059 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.058+0000 7fb3c27fc640 1 -- 172.21.15.92:0/1246862667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647550b4370 msgr2=0x56475514fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:17.059 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.058+0000 7fb3c27fc640 1 --2- 172.21.15.92:0/1246862667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647550b4370 0x56475514fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.059 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.058+0000 7fb3c27fc640 1 -- 172.21.15.92:0/1246862667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647550ae9a0 msgr2=0x5647550cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:17.059 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.058+0000 7fb3c27fc640 1 --2- 172.21.15.92:0/1246862667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647550ae9a0 0x5647550cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.060 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.058+0000 7fb3c27fc640 1 -- 172.21.15.92:0/1246862667 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647550d1270 con 0x5647550af2e0 2024-09-19T08:58:17.060 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.058+0000 7fb3cc443740 1 -- 172.21.15.92:0/1246862667 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3b4035070 con 0x5647550af2e0 2024-09-19T08:58:17.061 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.059+0000 7fb3c27fc640 1 --2- 172.21.15.92:0/1246862667 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647550af2e0 0x5647550ce180 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8031470 tx=0x7fb3b8031bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1402354369e54630 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:17.061 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.059+0000 7fb3a6ff5640 10 client.25147 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T08:58:17.061 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.059+0000 7fb3a6ff5640 1 -- 172.21.15.92:0/1246862667 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8035040 con 0x5647550af2e0 2024-09-19T08:58:17.061 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.059+0000 7fb3a6ff5640 1 -- 172.21.15.92:0/1246862667 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb3b8004220 con 0x5647550af2e0 2024-09-19T08:58:17.061 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.059+0000 7fb3a6ff5640 1 -- 172.21.15.92:0/1246862667 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb3b8004480 con 0x5647550af2e0 2024-09-19T08:58:17.061 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.059+0000 7fb3cc443740 10 client.25147 fetch_fsmap learned FSMap version 19 2024-09-19T08:58:17.062 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.059+0000 7fb3cc443740 1 -- 172.21.15.92:0/1246862667 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({fsmap=19}) -- 0x564755150f50 con 0x5647550af2e0 2024-09-19T08:58:17.062 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.060+0000 7fb3a6ff5640 1 -- 172.21.15.92:0/1246862667 <== mon.1 v2:172.21.15.190:3300/0 4 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fb3b803a040 con 0x5647550af2e0 2024-09-19T08:58:17.062 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.060+0000 7fb3cc443740 10 client.25147 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:58:17.062 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.060+0000 7fb3cc443740 10 client.25147 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T08:58:17.062 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.060+0000 7fb3cc443740 20 client.25147 populate_metadata read hostname 'smithi092' 2024-09-19T08:58:17.062 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.060+0000 7fb3cc443740 1 --2- 172.21.15.92:0/1246862667 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564755151850 0x564755153c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:17.062 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.060+0000 7fb3cc443740 4 client.25147 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:58:17.062 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.060+0000 7fb3cc443740 1 -- 172.21.15.92:0/1246862667 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564755019d70 con 0x564755151850 2024-09-19T08:58:17.063 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.062+0000 7fb3c2ffd640 1 --2- 172.21.15.92:0/1246862667 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564755151850 0x564755153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:17.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.066+0000 7fb3c2ffd640 1 --2- 172.21.15.92:0/1246862667 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564755151850 0x564755153c70 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab30070d0f806d8b server_cookie=aa8282ff92c55872 in_seq=0 out_seq=0 2024-09-19T08:58:17.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.066+0000 7fb3a6ff5640 10 client.25147 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:17.085 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.086+0000 7fb3a6ff5640 1 -- 172.21.15.92:0/1246862667 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564755019d70 con 0x564755151850 2024-09-19T08:58:17.086 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.086+0000 7fb3a6ff5640 10 client.25147 handle_command_reply: tid=0 2024-09-19T08:58:17.086 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.086+0000 7fb3cc443740 1 client.25147 shutdown 2024-09-19T08:58:17.086 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.087+0000 7fb3cc443740 1 -- 172.21.15.92:0/1246862667 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647550af2e0 msgr2=0x5647550ce180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:17.086 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.087+0000 7fb3cc443740 1 --2- 172.21.15.92:0/1246862667 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647550af2e0 0x5647550ce180 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8031470 tx=0x7fb3b8031bb0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.087+0000 7fb3cc443740 1 -- 172.21.15.92:0/1246862667 shutdown_connections 2024-09-19T08:58:17.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.087+0000 7fb3cc443740 1 --2- 172.21.15.92:0/1246862667 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564755151850 0x564755153c70 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.087+0000 7fb3cc443740 1 --2- 172.21.15.92:0/1246862667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647550b4370 0x56475514fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.087+0000 7fb3a6ff5640 0 client.25147 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:17.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.088+0000 7fb3cc443740 1 --2- 172.21.15.92:0/1246862667 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647550af2e0 0x5647550ce180 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.088+0000 7fb3cc443740 1 --2- 172.21.15.92:0/1246862667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647550ae9a0 0x5647550cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.088+0000 7fb3cc443740 1 -- 172.21.15.92:0/1246862667 >> 172.21.15.92:0/1246862667 conn(0x5647550aa010 msgr2=0x5647550c98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:17.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.088+0000 7fb3cc443740 1 -- 172.21.15.92:0/1246862667 shutdown_connections 2024-09-19T08:58:17.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.088+0000 7fb3cc443740 1 -- 172.21.15.92:0/1246862667 wait complete. 2024-09-19T08:58:17.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.088+0000 7fb3cc443740 20 client.25147 trim_cache size 0 max 16384 2024-09-19T08:58:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T08:58:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T08:58:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T08:58:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T08:58:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.090+0000 7fb3c96a5640 1 -- 172.21.15.92:0/36674166 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb3ac0a33f0 msgr2=0x7fb3ac0a58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.090+0000 7fb3c96a5640 1 --2- 172.21.15.92:0/36674166 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb3ac0a33f0 0x7fb3ac0a58b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x5647550aae90 tx=0x7fb3b4005f90 comp rx=0 tx=0).stop 2024-09-19T08:58:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.090+0000 7fb3c96a5640 1 -- 172.21.15.92:0/36674166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3c41a3b40 msgr2=0x7fb3c41a5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.090+0000 7fb3c96a5640 1 --2- 172.21.15.92:0/36674166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3c41a3b40 0x7fb3c41a5f30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc00eb10 tx=0x7fb3bc00c2d0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.090+0000 7fb3c96a5640 1 -- 172.21.15.92:0/36674166 shutdown_connections 2024-09-19T08:58:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.090+0000 7fb3c96a5640 1 --2- 172.21.15.92:0/36674166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3c41a3b40 0x7fb3c41a5f30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.090+0000 7fb3c96a5640 1 --2- 172.21.15.92:0/36674166 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3c4109d40 0x7fb3c419eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.090+0000 7fb3c96a5640 1 --2- 172.21.15.92:0/36674166 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb3ac0a33f0 0x7fb3ac0a58b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.090+0000 7fb3c96a5640 1 --2- 172.21.15.92:0/36674166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3c41084c0 0x7fb3c419e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.090+0000 7fb3c96a5640 1 -- 172.21.15.92:0/36674166 >> 172.21.15.92:0/36674166 conn(0x7fb3c4077490 msgr2=0x7fb3c410c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.090+0000 7fb3c96a5640 1 -- 172.21.15.92:0/36674166 shutdown_connections 2024-09-19T08:58:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:17.090+0000 7fb3c96a5640 1 -- 172.21.15.92:0/36674166 wait complete. 2024-09-19T08:58:17.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:17 smithi092 ceph-mon[31407]: pgmap v384: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.4 MiB/s wr, 81 op/s 2024-09-19T08:58:17.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:17 smithi167 ceph-mon[35359]: pgmap v384: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.4 MiB/s wr, 81 op/s 2024-09-19T08:58:17.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:17 smithi190 ceph-mon[35358]: pgmap v384: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.4 MiB/s wr, 81 op/s 2024-09-19T08:58:19.002 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:58:19.394 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:58:19.684 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:19 smithi092 ceph-mon[31407]: pgmap v385: 97 pgs: 97 active+clean; 1.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.7 MiB/s wr, 201 op/s 2024-09-19T08:58:19.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:19 smithi167 ceph-mon[35359]: pgmap v385: 97 pgs: 97 active+clean; 1.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.7 MiB/s wr, 201 op/s 2024-09-19T08:58:19.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:19 smithi190 ceph-mon[35358]: pgmap v385: 97 pgs: 97 active+clean; 1.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.7 MiB/s wr, 201 op/s 2024-09-19T08:58:19.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.937+0000 7f689382a640 1 -- 172.21.15.92:0/1852350558 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f688c109b10 msgr2=0x7f688c116960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:19.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.937+0000 7f689382a640 1 --2- 172.21.15.92:0/1852350558 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f688c109b10 0x7f688c116960 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6884009ca0 tx=0x7f688402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.937+0000 7f689382a640 1 -- 172.21.15.92:0/1852350558 shutdown_connections 2024-09-19T08:58:19.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.937+0000 7f689382a640 1 --2- 172.21.15.92:0/1852350558 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f688c116ea0 0x7f688c119290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.937+0000 7f689382a640 1 --2- 172.21.15.92:0/1852350558 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f688c109b10 0x7f688c116960 secure :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6884009ca0 tx=0x7f688402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.937+0000 7f689382a640 1 --2- 172.21.15.92:0/1852350558 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f688c1091f0 0x7f688c1095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.937+0000 7f689382a640 1 -- 172.21.15.92:0/1852350558 >> 172.21.15.92:0/1852350558 conn(0x7f688c06e2d0 msgr2=0x7f688c06e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:19.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.938+0000 7f689382a640 1 -- 172.21.15.92:0/1852350558 shutdown_connections 2024-09-19T08:58:19.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.938+0000 7f689382a640 1 -- 172.21.15.92:0/1852350558 wait complete. 2024-09-19T08:58:19.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.939+0000 7f689382a640 1 Processor -- start 2024-09-19T08:58:19.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.939+0000 7f689382a640 1 -- start start 2024-09-19T08:58:19.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.940+0000 7f689382a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f688c1091f0 0x7f688c1a3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:19.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.940+0000 7f689382a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f688c116ea0 0x7f688c1a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:19.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.940+0000 7f689382a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f688c1a7a00 0x7f688c1a7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:19.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.940+0000 7f689382a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f688c11ca80 con 0x7f688c1a7a00 2024-09-19T08:58:19.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.940+0000 7f689382a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f688c11c900 con 0x7f688c1091f0 2024-09-19T08:58:19.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.940+0000 7f689382a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f688c11cc00 con 0x7f688c116ea0 2024-09-19T08:58:19.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.941+0000 7f68915c6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f688c1091f0 0x7f688c1a3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:19.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.941+0000 7f68915c6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f688c1091f0 0x7f688c1a3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:56498/0 (socket says 172.21.15.92:56498) 2024-09-19T08:58:19.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.941+0000 7f68915c6640 1 -- 172.21.15.92:0/3473050302 learned_addr learned my addr 172.21.15.92:0/3473050302 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:19.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.941+0000 7f6891dc7640 1 --2- 172.21.15.92:0/3473050302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f688c1a7a00 0x7f688c1a7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:19.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.941+0000 7f6890dc5640 1 --2- 172.21.15.92:0/3473050302 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f688c116ea0 0x7f688c1a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:19.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.941+0000 7f68915c6640 1 -- 172.21.15.92:0/3473050302 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f688c116ea0 msgr2=0x7f688c1a3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:19.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.941+0000 7f68915c6640 1 --2- 172.21.15.92:0/3473050302 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f688c116ea0 0x7f688c1a3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.941+0000 7f68915c6640 1 -- 172.21.15.92:0/3473050302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f688c1a7a00 msgr2=0x7f688c1a7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:19.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.941+0000 7f68915c6640 1 --2- 172.21.15.92:0/3473050302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f688c1a7a00 0x7f688c1a7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.941+0000 7f68915c6640 1 -- 172.21.15.92:0/3473050302 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f688c1a84c0 con 0x7f688c1091f0 2024-09-19T08:58:19.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.942+0000 7f6891dc7640 1 --2- 172.21.15.92:0/3473050302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f688c1a7a00 0x7f688c1a7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:58:19.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.942+0000 7f68915c6640 1 --2- 172.21.15.92:0/3473050302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f688c1091f0 0x7f688c1a3130 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f687c00b4a0 tx=0x7f687c00b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:19.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.942+0000 7f68827fc640 1 -- 172.21.15.92:0/3473050302 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687c014070 con 0x7f688c1091f0 2024-09-19T08:58:19.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.942+0000 7f68827fc640 1 -- 172.21.15.92:0/3473050302 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f687c010af0 con 0x7f688c1091f0 2024-09-19T08:58:19.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.943+0000 7f68827fc640 1 -- 172.21.15.92:0/3473050302 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687c017d10 con 0x7f688c1091f0 2024-09-19T08:58:19.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.943+0000 7f689382a640 1 -- 172.21.15.92:0/3473050302 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f688c1a87b0 con 0x7f688c1091f0 2024-09-19T08:58:19.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.943+0000 7f689382a640 1 -- 172.21.15.92:0/3473050302 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f688c1affe0 con 0x7f688c1091f0 2024-09-19T08:58:19.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.948+0000 7f68827fc640 1 -- 172.21.15.92:0/3473050302 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f687c017070 con 0x7f688c1091f0 2024-09-19T08:58:19.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.949+0000 7f6895c03740 1 Processor -- start 2024-09-19T08:58:19.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.949+0000 7f6895c03740 1 -- start start 2024-09-19T08:58:19.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.949+0000 7f6895c03740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558793edcb70 0x558793edcf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:19.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.949+0000 7f6895c03740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558793edd490 0x558793ed8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:19.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.949+0000 7f6895c03740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558793ef0900 0x558793ef2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:19.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.949+0000 7f6895c03740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558793e3a2e0 con 0x558793edd490 2024-09-19T08:58:19.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.949+0000 7f6895c03740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558793de1ce0 con 0x558793edcb70 2024-09-19T08:58:19.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.949+0000 7f6895c03740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x558793e362a0 con 0x558793ef0900 2024-09-19T08:58:19.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.950+0000 7f6891dc7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558793edcb70 0x558793edcf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:19.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.950+0000 7f6891dc7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558793edcb70 0x558793edcf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:56506/0 (socket says 172.21.15.92:56506) 2024-09-19T08:58:19.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.950+0000 7f6891dc7640 1 -- 172.21.15.92:0/268415122 learned_addr learned my addr 172.21.15.92:0/268415122 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:19.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.950+0000 7f6890dc5640 1 --2- 172.21.15.92:0/268415122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558793ef0900 0x558793ef2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:19.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.950+0000 7f6890dc5640 1 -- 172.21.15.92:0/268415122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558793edcb70 msgr2=0x558793edcf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:19.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.950+0000 7f6890dc5640 1 --2- 172.21.15.92:0/268415122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558793edcb70 0x558793edcf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.950+0000 7f6890dc5640 1 -- 172.21.15.92:0/268415122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558793edd490 msgr2=0x558793ed8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:19.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.950+0000 7f6890dc5640 1 --2- 172.21.15.92:0/268415122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558793edd490 0x558793ed8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.950+0000 7f6890dc5640 1 -- 172.21.15.92:0/268415122 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558793dc6440 con 0x558793ef0900 2024-09-19T08:58:19.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.950+0000 7f68827fc640 1 --2- 172.21.15.92:0/3473050302 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f68780a3300 0x7f68780a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:19.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.950+0000 7f68827fc640 1 -- 172.21.15.92:0/3473050302 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f687c0cec00 con 0x7f688c1091f0 2024-09-19T08:58:19.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.950+0000 7f6890dc5640 1 --2- 172.21.15.92:0/268415122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558793ef0900 0x558793ef2cf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6884008000 tx=0x7f6884030690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c2cd8c797e76d8e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:19.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.950+0000 7f6891dc7640 1 --2- 172.21.15.92:0/3473050302 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f68780a3300 0x7f68780a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:19.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.951+0000 7f68777fe640 1 -- 172.21.15.92:0/268415122 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6884031db0 con 0x558793ef0900 2024-09-19T08:58:19.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.951+0000 7f68777fe640 1 -- 172.21.15.92:0/268415122 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6884036070 con 0x558793ef0900 2024-09-19T08:58:19.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.951+0000 7f68777fe640 1 -- 172.21.15.92:0/268415122 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68840316b0 con 0x558793ef0900 2024-09-19T08:58:19.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.952+0000 7f6895c03740 1 -- 172.21.15.92:0/268415122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558793ef0900 msgr2=0x558793ef2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:19.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.952+0000 7f6895c03740 1 --2- 172.21.15.92:0/268415122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558793ef0900 0x558793ef2cf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6884008000 tx=0x7f6884030690 comp rx=0 tx=0).stop 2024-09-19T08:58:19.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.952+0000 7f6891dc7640 1 --2- 172.21.15.92:0/3473050302 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f68780a3300 0x7f68780a57c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f68880058c0 tx=0x7f6888005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:19.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.952+0000 7f6895c03740 1 -- 172.21.15.92:0/268415122 shutdown_connections 2024-09-19T08:58:19.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.952+0000 7f6895c03740 1 --2- 172.21.15.92:0/268415122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558793ef0900 0x558793ef2cf0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.952+0000 7f6895c03740 1 --2- 172.21.15.92:0/268415122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558793edd490 0x558793ed8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.952+0000 7f6895c03740 1 --2- 172.21.15.92:0/268415122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558793edcb70 0x558793edcf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.952+0000 7f6895c03740 1 -- 172.21.15.92:0/268415122 >> 172.21.15.92:0/268415122 conn(0x558793ed9240 msgr2=0x558793ed9620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:19.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.952+0000 7f6895c03740 1 -- 172.21.15.92:0/268415122 shutdown_connections 2024-09-19T08:58:19.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.952+0000 7f6895c03740 1 -- 172.21.15.92:0/268415122 wait complete. 2024-09-19T08:58:19.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.953+0000 7f6895c03740 1 -- start start 2024-09-19T08:58:19.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.953+0000 7f6895c03740 1 Processor -- start 2024-09-19T08:58:19.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.953+0000 7f6895c03740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558793edcb70 0x558793ed8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:19.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.953+0000 7f6895c03740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558793edd490 0x558793ed56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:19.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.953+0000 7f6895c03740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558793ef0900 0x558793ed5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:19.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.953+0000 7f6895c03740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558793ef3230 con 0x558793ef0900 2024-09-19T08:58:19.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.953+0000 7f6895c03740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558793df5050 con 0x558793edcb70 2024-09-19T08:58:19.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.953+0000 7f6895c03740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x558793ef33b0 con 0x558793edd490 2024-09-19T08:58:19.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.953+0000 7f6895c03740 10 client.0 _ll_register_callbacks cb 0x558793e35160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:19.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.954+0000 7f6891dc7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558793ef0900 0x558793ed5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:19.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.954+0000 7f6890dc5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558793edd490 0x558793ed56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:19.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.954+0000 7f6891dc7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558793ef0900 0x558793ed5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36550/0 (socket says 172.21.15.92:36550) 2024-09-19T08:58:19.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.954+0000 7f6891dc7640 1 -- 172.21.15.92:0/2019453370 learned_addr learned my addr 172.21.15.92:0/2019453370 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:19.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.954+0000 7f68915c6640 1 --2- 172.21.15.92:0/2019453370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558793edcb70 0x558793ed8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:19.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.954+0000 7f68915c6640 1 -- 172.21.15.92:0/2019453370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558793edd490 msgr2=0x558793ed56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:19.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.954+0000 7f68915c6640 1 --2- 172.21.15.92:0/2019453370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558793edd490 0x558793ed56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.954+0000 7f68915c6640 1 -- 172.21.15.92:0/2019453370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558793ef0900 msgr2=0x558793ed5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:19.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.954+0000 7f68915c6640 1 --2- 172.21.15.92:0/2019453370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558793ef0900 0x558793ed5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.955+0000 7f68915c6640 1 -- 172.21.15.92:0/2019453370 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558793bab3c0 con 0x558793edcb70 2024-09-19T08:58:19.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.955+0000 7f68915c6640 1 --2- 172.21.15.92:0/2019453370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558793edcb70 0x558793ed8410 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f687c00be60 tx=0x7f687c09b920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e788d9abf50032f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:19.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.956+0000 7f6874ff9640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T08:58:19.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.956+0000 7f6874ff9640 1 -- 172.21.15.92:0/2019453370 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687c01e070 con 0x558793edcb70 2024-09-19T08:58:19.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.956+0000 7f6874ff9640 1 -- 172.21.15.92:0/2019453370 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f687c010ca0 con 0x558793edcb70 2024-09-19T08:58:19.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.956+0000 7f6895c03740 1 -- 172.21.15.92:0/2019453370 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6884036070 con 0x558793edcb70 2024-09-19T08:58:19.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.957+0000 7f6874ff9640 1 -- 172.21.15.92:0/2019453370 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f687c0b9e60 con 0x558793edcb70 2024-09-19T08:58:19.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.957+0000 7f6895c03740 10 client.25175 fetch_fsmap learned FSMap version 19 2024-09-19T08:58:19.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.957+0000 7f6895c03740 1 -- 172.21.15.92:0/2019453370 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x558793efec10 con 0x558793edcb70 2024-09-19T08:58:19.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.957+0000 7f6874ff9640 1 -- 172.21.15.92:0/2019453370 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6884036070 con 0x558793edcb70 2024-09-19T08:58:19.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.957+0000 7f6874ff9640 1 -- 172.21.15.92:0/2019453370 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f687c0bb0e0 con 0x558793edcb70 2024-09-19T08:58:19.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.957+0000 7f6895c03740 10 client.25175 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:58:19.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.957+0000 7f6895c03740 10 client.25175 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:58:19.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.957+0000 7f6895c03740 20 client.25175 populate_metadata read hostname 'smithi092' 2024-09-19T08:58:19.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.957+0000 7f6895c03740 1 --2- 172.21.15.92:0/2019453370 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558793f00500 0x558793f02930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:19.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.957+0000 7f6895c03740 4 client.25175 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:58:19.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.957+0000 7f6895c03740 1 -- 172.21.15.92:0/2019453370 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558793e47850 con 0x558793f00500 2024-09-19T08:58:19.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.958+0000 7f6890dc5640 1 --2- 172.21.15.92:0/2019453370 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558793f00500 0x558793f02930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:19.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.959+0000 7f6874ff9640 10 client.25175 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:19.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.959+0000 7f6890dc5640 1 --2- 172.21.15.92:0/2019453370 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558793f00500 0x558793f02930 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd2d5777e2e18685 server_cookie=f0fe770b607d1529 in_seq=0 out_seq=0 2024-09-19T08:58:19.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.960+0000 7f6874ff9640 1 -- 172.21.15.92:0/2019453370 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558793e47850 con 0x558793f00500 2024-09-19T08:58:19.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.960+0000 7f6874ff9640 10 client.25175 handle_command_reply: tid=0 2024-09-19T08:58:19.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.960+0000 7f6895c03740 1 client.25175 shutdown 2024-09-19T08:58:19.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.960+0000 7f6895c03740 1 -- 172.21.15.92:0/2019453370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558793edcb70 msgr2=0x558793ed8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:19.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.960+0000 7f6895c03740 1 --2- 172.21.15.92:0/2019453370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558793edcb70 0x558793ed8410 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f687c00be60 tx=0x7f687c09b920 comp rx=0 tx=0).stop 2024-09-19T08:58:19.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.961+0000 7f6895c03740 1 -- 172.21.15.92:0/2019453370 shutdown_connections 2024-09-19T08:58:19.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.961+0000 7f6895c03740 1 --2- 172.21.15.92:0/2019453370 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558793f00500 0x558793f02930 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.961+0000 7f6895c03740 1 --2- 172.21.15.92:0/2019453370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558793ef0900 0x558793ed5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.961+0000 7f6895c03740 1 --2- 172.21.15.92:0/2019453370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558793edd490 0x558793ed56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.961+0000 7f6895c03740 1 --2- 172.21.15.92:0/2019453370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558793edcb70 0x558793ed8410 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.961+0000 7f6895c03740 1 -- 172.21.15.92:0/2019453370 >> 172.21.15.92:0/2019453370 conn(0x558793ed9240 msgr2=0x558793edefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:19.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.961+0000 7f6874ff9640 0 client.25175 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:19.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.961+0000 7f6895c03740 1 -- 172.21.15.92:0/2019453370 shutdown_connections 2024-09-19T08:58:19.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.961+0000 7f6895c03740 1 -- 172.21.15.92:0/2019453370 wait complete. 2024-09-19T08:58:19.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.961+0000 7f6895c03740 20 client.25175 trim_cache size 0 max 16384 2024-09-19T08:58:19.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.995+0000 7f6895c03740 1 Processor -- start 2024-09-19T08:58:19.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.995+0000 7f6895c03740 1 -- start start 2024-09-19T08:58:19.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.995+0000 7f6895c03740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558793edcb70 0x558793ed46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:19.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.995+0000 7f6895c03740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558793edd490 0x558793efc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:19.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.995+0000 7f6895c03740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558793ef0900 0x558793f081e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:19.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.995+0000 7f6895c03740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f688c1b2230 con 0x558793ef0900 2024-09-19T08:58:19.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.995+0000 7f6895c03740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f688c1b4ab0 con 0x558793edd490 2024-09-19T08:58:19.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.995+0000 7f6895c03740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f688c1b28a0 con 0x558793edcb70 2024-09-19T08:58:19.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.995+0000 7f6890dc5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558793edd490 0x558793efc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:19.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.995+0000 7f6891dc7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558793ef0900 0x558793f081e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:19.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.996+0000 7f6890dc5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558793edd490 0x558793efc100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:56536/0 (socket says 172.21.15.92:56536) 2024-09-19T08:58:19.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.996+0000 7f6891dc7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558793ef0900 0x558793f081e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36562/0 (socket says 172.21.15.92:36562) 2024-09-19T08:58:19.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.996+0000 7f6890dc5640 1 -- 172.21.15.92:0/3629081670 learned_addr learned my addr 172.21.15.92:0/3629081670 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:19.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.996+0000 7f68915c6640 1 --2- 172.21.15.92:0/3629081670 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558793edcb70 0x558793ed46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:19.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.996+0000 7f6891dc7640 1 -- 172.21.15.92:0/3629081670 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558793edcb70 msgr2=0x558793ed46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:19.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.996+0000 7f6891dc7640 1 --2- 172.21.15.92:0/3629081670 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558793edcb70 0x558793ed46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.996+0000 7f6891dc7640 1 -- 172.21.15.92:0/3629081670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558793edd490 msgr2=0x558793efc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:19.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.996+0000 7f6891dc7640 1 --2- 172.21.15.92:0/3629081670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558793edd490 0x558793efc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.996+0000 7f6891dc7640 1 -- 172.21.15.92:0/3629081670 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558793ed3c10 con 0x558793ef0900 2024-09-19T08:58:19.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.997+0000 7f6891dc7640 1 --2- 172.21.15.92:0/3629081670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558793ef0900 0x558793f081e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6888009910 tx=0x7f688801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f2598df3e24394 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:19.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.997+0000 7f6876ffd640 1 -- 172.21.15.92:0/3629081670 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6888005020 con 0x558793ef0900 2024-09-19T08:58:19.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.998+0000 7f6876ffd640 1 -- 172.21.15.92:0/3629081670 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68880047a0 con 0x558793ef0900 2024-09-19T08:58:19.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.998+0000 7f6876ffd640 1 -- 172.21.15.92:0/3629081670 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68880119c0 con 0x558793ef0900 2024-09-19T08:58:19.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.999+0000 7f6895c03740 1 -- 172.21.15.92:0/3629081670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558793ef0900 msgr2=0x558793f081e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:19.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.999+0000 7f6895c03740 1 --2- 172.21.15.92:0/3629081670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558793ef0900 0x558793f081e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6888009910 tx=0x7f688801a000 comp rx=0 tx=0).stop 2024-09-19T08:58:19.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.999+0000 7f6895c03740 1 -- 172.21.15.92:0/3629081670 shutdown_connections 2024-09-19T08:58:19.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.999+0000 7f6895c03740 1 --2- 172.21.15.92:0/3629081670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558793ef0900 0x558793f081e0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.999+0000 7f6895c03740 1 --2- 172.21.15.92:0/3629081670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558793edd490 0x558793efc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.999+0000 7f6895c03740 1 --2- 172.21.15.92:0/3629081670 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558793edcb70 0x558793ed46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.999+0000 7f6895c03740 1 -- 172.21.15.92:0/3629081670 >> 172.21.15.92:0/3629081670 conn(0x558793ed9240 msgr2=0x558793ed3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:20.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.999+0000 7f6895c03740 1 -- 172.21.15.92:0/3629081670 shutdown_connections 2024-09-19T08:58:20.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:19.999+0000 7f6895c03740 1 -- 172.21.15.92:0/3629081670 wait complete. 2024-09-19T08:58:20.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.000+0000 7f6895c03740 1 -- start start 2024-09-19T08:58:20.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.000+0000 7f6895c03740 1 Processor -- start 2024-09-19T08:58:20.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.001+0000 7f6895c03740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558793edcb70 0x558793ef8330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:20.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.001+0000 7f6895c03740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558793edd490 0x558793ef8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:20.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.001+0000 7f6895c03740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558793ef0900 0x558793ef37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:20.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.001+0000 7f68915c6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558793edcb70 0x558793ef8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:20.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.001+0000 7f68915c6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558793edcb70 0x558793ef8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36570/0 (socket says 172.21.15.92:36570) 2024-09-19T08:58:20.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.001+0000 7f6890dc5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558793edd490 0x558793ef8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:20.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.001+0000 7f6890dc5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558793edd490 0x558793ef8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:48402/0 (socket says 172.21.15.92:48402) 2024-09-19T08:58:20.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.001+0000 7f6891dc7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558793ef0900 0x558793ef37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:20.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.002+0000 7f6891dc7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558793ef0900 0x558793ef37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:56552/0 (socket says 172.21.15.92:56552) 2024-09-19T08:58:20.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.002+0000 7f6890dc5640 1 -- 172.21.15.92:0/998956538 learned_addr learned my addr 172.21.15.92:0/998956538 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:20.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.002+0000 7f6895c03740 1 -- 172.21.15.92:0/998956538 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f688c1b2f70 con 0x558793edcb70 2024-09-19T08:58:20.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.002+0000 7f6895c03740 1 -- 172.21.15.92:0/998956538 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f688c1b43e0 con 0x558793ef0900 2024-09-19T08:58:20.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.002+0000 7f6895c03740 1 -- 172.21.15.92:0/998956538 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f688c1b3640 con 0x558793edd490 2024-09-19T08:58:20.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.002+0000 7f6895c03740 10 client.0 _ll_register_callbacks cb 0x7f687c017eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:20.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.002+0000 7f6891dc7640 1 -- 172.21.15.92:0/998956538 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558793edd490 msgr2=0x558793ef8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:20.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.002+0000 7f6891dc7640 1 --2- 172.21.15.92:0/998956538 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558793edd490 0x558793ef8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.002+0000 7f6891dc7640 1 -- 172.21.15.92:0/998956538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558793edcb70 msgr2=0x558793ef8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:20.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.002+0000 7f6891dc7640 1 --2- 172.21.15.92:0/998956538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558793edcb70 0x558793ef8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.002+0000 7f6891dc7640 1 -- 172.21.15.92:0/998956538 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558793ef3fe0 con 0x558793ef0900 2024-09-19T08:58:20.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.002+0000 7f6890dc5640 1 --2- 172.21.15.92:0/998956538 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558793edd490 0x558793ef8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:58:20.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.003+0000 7f6891dc7640 1 --2- 172.21.15.92:0/998956538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558793ef0900 0x558793ef37b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6888012cb0 tx=0x7f6888004b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6de36e07250d1bfc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:20.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.003+0000 7f6874ff9640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T08:58:20.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.003+0000 7f6874ff9640 1 -- 172.21.15.92:0/998956538 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6888005410 con 0x558793ef0900 2024-09-19T08:58:20.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.003+0000 7f6874ff9640 1 -- 172.21.15.92:0/998956538 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f68880055b0 con 0x558793ef0900 2024-09-19T08:58:20.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.003+0000 7f6895c03740 1 -- 172.21.15.92:0/998956538 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68880047a0 con 0x558793ef0900 2024-09-19T08:58:20.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.004+0000 7f6874ff9640 1 -- 172.21.15.92:0/998956538 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6888009e60 con 0x558793ef0900 2024-09-19T08:58:20.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.004+0000 7f6895c03740 10 client.25181 fetch_fsmap learned FSMap version 19 2024-09-19T08:58:20.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.004+0000 7f6895c03740 1 -- 172.21.15.92:0/998956538 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x558793f6ac60 con 0x558793ef0900 2024-09-19T08:58:20.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.004+0000 7f6874ff9640 1 -- 172.21.15.92:0/998956538 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68880047a0 con 0x558793ef0900 2024-09-19T08:58:20.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.005+0000 7f6874ff9640 1 -- 172.21.15.92:0/998956538 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f6888032070 con 0x558793ef0900 2024-09-19T08:58:20.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.005+0000 7f6895c03740 10 client.25181 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:58:20.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.005+0000 7f6895c03740 10 client.25181 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:58:20.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.005+0000 7f6895c03740 20 client.25181 populate_metadata read hostname 'smithi092' 2024-09-19T08:58:20.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.005+0000 7f6895c03740 1 --2- 172.21.15.92:0/998956538 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558793f6b180 0x558793f6d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:20.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.005+0000 7f6895c03740 4 client.25181 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:58:20.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.005+0000 7f6895c03740 1 -- 172.21.15.92:0/998956538 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558793e41d60 con 0x558793f6b180 2024-09-19T08:58:20.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.005+0000 7f68915c6640 1 --2- 172.21.15.92:0/998956538 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558793f6b180 0x558793f6d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:20.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.006+0000 7f68915c6640 1 --2- 172.21.15.92:0/998956538 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558793f6b180 0x558793f6d570 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=661b31446e13fc48 server_cookie=d6fb67c74aca832d in_seq=0 out_seq=0 2024-09-19T08:58:20.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.006+0000 7f6874ff9640 10 client.25181 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:20.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.006+0000 7f6874ff9640 1 -- 172.21.15.92:0/998956538 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x558793e41d60 con 0x558793f6b180 2024-09-19T08:58:20.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.006+0000 7f6874ff9640 10 client.25181 handle_command_reply: tid=0 2024-09-19T08:58:20.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.006+0000 7f6895c03740 1 client.25181 shutdown 2024-09-19T08:58:20.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.007+0000 7f6895c03740 1 -- 172.21.15.92:0/998956538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558793ef0900 msgr2=0x558793ef37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:20.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.007+0000 7f6895c03740 1 --2- 172.21.15.92:0/998956538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558793ef0900 0x558793ef37b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6888012cb0 tx=0x7f6888004b80 comp rx=0 tx=0).stop 2024-09-19T08:58:20.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.007+0000 7f6895c03740 1 -- 172.21.15.92:0/998956538 shutdown_connections 2024-09-19T08:58:20.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.007+0000 7f6895c03740 1 --2- 172.21.15.92:0/998956538 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558793f6b180 0x558793f6d570 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.007+0000 7f6895c03740 1 --2- 172.21.15.92:0/998956538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558793ef0900 0x558793ef37b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.007+0000 7f6895c03740 1 --2- 172.21.15.92:0/998956538 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558793edd490 0x558793ef8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.007+0000 7f6895c03740 1 --2- 172.21.15.92:0/998956538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558793edcb70 0x558793ef8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.007+0000 7f6895c03740 1 -- 172.21.15.92:0/998956538 >> 172.21.15.92:0/998956538 conn(0x558793ed9240 msgr2=0x558793ede610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:20.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.007+0000 7f6874ff9640 0 client.25181 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:20.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.007+0000 7f6895c03740 1 -- 172.21.15.92:0/998956538 shutdown_connections 2024-09-19T08:58:20.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.007+0000 7f6895c03740 1 -- 172.21.15.92:0/998956538 wait complete. 2024-09-19T08:58:20.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.007+0000 7f6895c03740 20 client.25181 trim_cache size 0 max 16384 2024-09-19T08:58:20.010 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T08:58:20.010 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-19T08:58:20.010 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {} 2024-09-19T08:58:20.010 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T08:58:20.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.008+0000 7f689382a640 1 -- 172.21.15.92:0/3473050302 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f68780a3300 msgr2=0x7f68780a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:20.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.008+0000 7f689382a640 1 --2- 172.21.15.92:0/3473050302 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f68780a3300 0x7f68780a57c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f68880058c0 tx=0x7f6888005f90 comp rx=0 tx=0).stop 2024-09-19T08:58:20.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.008+0000 7f689382a640 1 -- 172.21.15.92:0/3473050302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f688c1091f0 msgr2=0x7f688c1a3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:20.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.008+0000 7f689382a640 1 --2- 172.21.15.92:0/3473050302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f688c1091f0 0x7f688c1a3130 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f687c00b4a0 tx=0x7f687c00b960 comp rx=0 tx=0).stop 2024-09-19T08:58:20.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.008+0000 7f689382a640 1 -- 172.21.15.92:0/3473050302 shutdown_connections 2024-09-19T08:58:20.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.008+0000 7f689382a640 1 --2- 172.21.15.92:0/3473050302 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f68780a3300 0x7f68780a57c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.008+0000 7f689382a640 1 --2- 172.21.15.92:0/3473050302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f688c1a7a00 0x7f688c1a7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.008+0000 7f689382a640 1 --2- 172.21.15.92:0/3473050302 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f688c116ea0 0x7f688c1a3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.008+0000 7f689382a640 1 --2- 172.21.15.92:0/3473050302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f688c1091f0 0x7f688c1a3130 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.008+0000 7f689382a640 1 -- 172.21.15.92:0/3473050302 >> 172.21.15.92:0/3473050302 conn(0x7f688c06e2d0 msgr2=0x7f688c117460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:20.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.009+0000 7f689382a640 1 -- 172.21.15.92:0/3473050302 shutdown_connections 2024-09-19T08:58:20.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:20.009+0000 7f689382a640 1 -- 172.21.15.92:0/3473050302 wait complete. 2024-09-19T08:58:20.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 95.0 s, 6546.2 tps, lat 15.277 ms stddev 16.520 2024-09-19T08:58:20.801 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:58:20.802 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:58:21.237 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:58:21.666 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:21 smithi092 ceph-mon[31407]: pgmap v386: 97 pgs: 97 active+clean; 1.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 6.3 MiB/s wr, 365 op/s 2024-09-19T08:58:21.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.800+0000 7f92e6639640 1 -- 172.21.15.92:0/1245184653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92e0103760 msgr2=0x7f92e0107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:21.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.800+0000 7f92e6639640 1 --2- 172.21.15.92:0/1245184653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92e0103760 0x7f92e0107ba0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f92c8009960 tx=0x7f92c802a460 comp rx=0 tx=0).stop 2024-09-19T08:58:21.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.800+0000 7f92e6639640 1 -- 172.21.15.92:0/1245184653 shutdown_connections 2024-09-19T08:58:21.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.800+0000 7f92e6639640 1 --2- 172.21.15.92:0/1245184653 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92e01082e0 0x7f92e010ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:21.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.800+0000 7f92e6639640 1 --2- 172.21.15.92:0/1245184653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92e0103760 0x7f92e0107ba0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:21.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.800+0000 7f92e6639640 1 --2- 172.21.15.92:0/1245184653 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92e0102db0 0x7f92e0103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:21.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.800+0000 7f92e6639640 1 -- 172.21.15.92:0/1245184653 >> 172.21.15.92:0/1245184653 conn(0x7f92e00fc7d0 msgr2=0x7f92e00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:21.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.800+0000 7f92e6639640 1 -- 172.21.15.92:0/1245184653 shutdown_connections 2024-09-19T08:58:21.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.800+0000 7f92e6639640 1 -- 172.21.15.92:0/1245184653 wait complete. 2024-09-19T08:58:21.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.801+0000 7f92e6639640 1 Processor -- start 2024-09-19T08:58:21.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.801+0000 7f92e6639640 1 -- start start 2024-09-19T08:58:21.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.801+0000 7f92e6639640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92e0102db0 0x7f92e010bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:21.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.801+0000 7f92e6639640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92e0103760 0x7f92e010c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:21.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.801+0000 7f92e6639640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92e01082e0 0x7f92e010c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:21.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.801+0000 7f92e6639640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f92e0102620 con 0x7f92e0103760 2024-09-19T08:58:21.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.801+0000 7f92e6639640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f92e01024a0 con 0x7f92e01082e0 2024-09-19T08:58:21.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.801+0000 7f92e6639640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f92e01027a0 con 0x7f92e0102db0 2024-09-19T08:58:21.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.802+0000 7f92e4bd6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92e01082e0 0x7f92e010c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:21.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.802+0000 7f92e4bd6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92e01082e0 0x7f92e010c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:38678/0 (socket says 172.21.15.92:38678) 2024-09-19T08:58:21.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.802+0000 7f92e4bd6640 1 -- 172.21.15.92:0/1263355651 learned_addr learned my addr 172.21.15.92:0/1263355651 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:21.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.802+0000 7f92df7fe640 1 --2- 172.21.15.92:0/1263355651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92e0103760 0x7f92e010c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:21.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.802+0000 7f92dffff640 1 --2- 172.21.15.92:0/1263355651 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92e0102db0 0x7f92e010bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:21.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.802+0000 7f92e4bd6640 1 -- 172.21.15.92:0/1263355651 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92e0102db0 msgr2=0x7f92e010bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:21.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.802+0000 7f92e4bd6640 1 --2- 172.21.15.92:0/1263355651 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92e0102db0 0x7f92e010bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:21.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.802+0000 7f92e4bd6640 1 -- 172.21.15.92:0/1263355651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92e0103760 msgr2=0x7f92e010c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:21.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.802+0000 7f92e4bd6640 1 --2- 172.21.15.92:0/1263355651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92e0103760 0x7f92e010c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:21.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.802+0000 7f92e4bd6640 1 -- 172.21.15.92:0/1263355651 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92e011ba60 con 0x7f92e01082e0 2024-09-19T08:58:21.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.802+0000 7f92df7fe640 1 --2- 172.21.15.92:0/1263355651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92e0103760 0x7f92e010c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:58:21.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.802+0000 7f92dffff640 1 --2- 172.21.15.92:0/1263355651 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92e0102db0 0x7f92e010bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:58:21.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.803+0000 7f92e4bd6640 1 --2- 172.21.15.92:0/1263355651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92e01082e0 0x7f92e010c990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f92d000b970 tx=0x7f92d000be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:21.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.803+0000 7f92dd7fa640 1 -- 172.21.15.92:0/1263355651 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d0019070 con 0x7f92e01082e0 2024-09-19T08:58:21.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.803+0000 7f92dd7fa640 1 -- 172.21.15.92:0/1263355651 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92d000cb40 con 0x7f92e01082e0 2024-09-19T08:58:21.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.803+0000 7f92dd7fa640 1 -- 172.21.15.92:0/1263355651 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d0007650 con 0x7f92e01082e0 2024-09-19T08:58:21.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.803+0000 7f92e6639640 1 -- 172.21.15.92:0/1263355651 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92e011bd50 con 0x7f92e01082e0 2024-09-19T08:58:21.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.803+0000 7f92e6639640 1 -- 172.21.15.92:0/1263355651 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92e011c210 con 0x7f92e01082e0 2024-09-19T08:58:21.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.805+0000 7f92e6639640 1 -- 172.21.15.92:0/1263355651 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92e006a7d0 con 0x7f92e01082e0 2024-09-19T08:58:21.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.806+0000 7f92dd7fa640 1 -- 172.21.15.92:0/1263355651 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f92d001c070 con 0x7f92e01082e0 2024-09-19T08:58:21.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.807+0000 7f92dd7fa640 1 --2- 172.21.15.92:0/1263355651 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f92cc0a33d0 0x7f92cc0a5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:21.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.807+0000 7f92dd7fa640 1 -- 172.21.15.92:0/1263355651 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f92d00ceda0 con 0x7f92e01082e0 2024-09-19T08:58:21.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.808+0000 7f92dffff640 1 --2- 172.21.15.92:0/1263355651 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f92cc0a33d0 0x7f92cc0a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:21.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.809+0000 7f92dffff640 1 --2- 172.21.15.92:0/1263355651 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f92cc0a33d0 0x7f92cc0a5890 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f92d800bfd0 tx=0x7f92d800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:21.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:21.812+0000 7f92dd7fa640 1 -- 172.21.15.92:0/1263355651 <== mon.2 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f92d009b470 con 0x7f92e01082e0 2024-09-19T08:58:21.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:21 smithi167 ceph-mon[35359]: pgmap v386: 97 pgs: 97 active+clean; 1.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 6.3 MiB/s wr, 365 op/s 2024-09-19T08:58:21.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:21 smithi190 ceph-mon[35358]: pgmap v386: 97 pgs: 97 active+clean; 1.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 6.3 MiB/s wr, 365 op/s 2024-09-19T08:58:22.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:22.204+0000 7f92e6639640 1 -- 172.21.15.92:0/1263355651 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92e011cc60 con 0x7f92e01082e0 2024-09-19T08:58:22.205 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:58:22.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:22.206+0000 7f92dd7fa640 1 -- 172.21.15.92:0/1263355651 <== mon.2 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f92d009f770 con 0x7f92e01082e0 2024-09-19T08:58:22.206 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T08:58:22.206 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T08:58:22.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:22.210+0000 7f92e6639640 1 -- 172.21.15.92:0/1263355651 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f92cc0a33d0 msgr2=0x7f92cc0a5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:22.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:22.210+0000 7f92e6639640 1 --2- 172.21.15.92:0/1263355651 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f92cc0a33d0 0x7f92cc0a5890 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f92d800bfd0 tx=0x7f92d800b390 comp rx=0 tx=0).stop 2024-09-19T08:58:22.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:22.210+0000 7f92e6639640 1 -- 172.21.15.92:0/1263355651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92e01082e0 msgr2=0x7f92e010c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:22.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:22.210+0000 7f92e6639640 1 --2- 172.21.15.92:0/1263355651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92e01082e0 0x7f92e010c990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f92d000b970 tx=0x7f92d000be30 comp rx=0 tx=0).stop 2024-09-19T08:58:22.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:22.211+0000 7f92e6639640 1 -- 172.21.15.92:0/1263355651 shutdown_connections 2024-09-19T08:58:22.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:22.211+0000 7f92e6639640 1 --2- 172.21.15.92:0/1263355651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92e01082e0 0x7f92e010c990 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:22.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:22.211+0000 7f92e6639640 1 --2- 172.21.15.92:0/1263355651 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f92cc0a33d0 0x7f92cc0a5890 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:22.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:22.211+0000 7f92e6639640 1 --2- 172.21.15.92:0/1263355651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92e0103760 0x7f92e010c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:22.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:22.211+0000 7f92e6639640 1 --2- 172.21.15.92:0/1263355651 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92e0102db0 0x7f92e010bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:22.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:22.211+0000 7f92e6639640 1 -- 172.21.15.92:0/1263355651 >> 172.21.15.92:0/1263355651 conn(0x7f92e00fc7d0 msgr2=0x7f92e0104060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:22.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:22.212+0000 7f92e6639640 1 -- 172.21.15.92:0/1263355651 shutdown_connections 2024-09-19T08:58:22.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:22.212+0000 7f92e6639640 1 -- 172.21.15.92:0/1263355651 wait complete. 2024-09-19T08:58:22.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:22 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1263355651' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:58:22.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:22 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/1263355651' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:58:22.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:22 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/1263355651' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:58:23.064 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:58:23.500 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:58:23.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:23 smithi092 ceph-mon[31407]: pgmap v387: 97 pgs: 97 active+clean; 1.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 7.5 MiB/s wr, 482 op/s 2024-09-19T08:58:23.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:23 smithi167 ceph-mon[35359]: pgmap v387: 97 pgs: 97 active+clean; 1.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 7.5 MiB/s wr, 482 op/s 2024-09-19T08:58:23.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:23 smithi190 ceph-mon[35358]: pgmap v387: 97 pgs: 97 active+clean; 1.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 7.5 MiB/s wr, 482 op/s 2024-09-19T08:58:24.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.461+0000 7f7e76464640 1 -- 172.21.15.92:0/787143169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e70108e00 msgr2=0x7f7e7010ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:24.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.461+0000 7f7e76464640 1 --2- 172.21.15.92:0/787143169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e70108e00 0x7f7e7010ce00 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7e64009900 tx=0x7f7e6402a410 comp rx=0 tx=0).stop 2024-09-19T08:58:24.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.461+0000 7f7e76464640 1 -- 172.21.15.92:0/787143169 shutdown_connections 2024-09-19T08:58:24.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.461+0000 7f7e76464640 1 --2- 172.21.15.92:0/787143169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e7010d530 0x7f7e701150b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.461+0000 7f7e76464640 1 --2- 172.21.15.92:0/787143169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e70108e00 0x7f7e7010ce00 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.461+0000 7f7e76464640 1 --2- 172.21.15.92:0/787143169 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e70108450 0x7f7e70108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.461+0000 7f7e76464640 1 -- 172.21.15.92:0/787143169 >> 172.21.15.92:0/787143169 conn(0x7f7e70077ba0 msgr2=0x7f7e70079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:24.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.461+0000 7f7e76464640 1 -- 172.21.15.92:0/787143169 shutdown_connections 2024-09-19T08:58:24.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.461+0000 7f7e76464640 1 -- 172.21.15.92:0/787143169 wait complete. 2024-09-19T08:58:24.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.462+0000 7f7e76464640 1 Processor -- start 2024-09-19T08:58:24.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.463+0000 7f7e76464640 1 -- start start 2024-09-19T08:58:24.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.463+0000 7f7e76464640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e70108450 0x7f7e7019eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:24.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.464+0000 7f7e76464640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e70108e00 0x7f7e7019f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:24.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.464+0000 7f7e76464640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e7010d530 0x7f7e701a33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:24.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.464+0000 7f7e76464640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7e701185a0 con 0x7f7e70108450 2024-09-19T08:58:24.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.464+0000 7f7e76464640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7e70118420 con 0x7f7e7010d530 2024-09-19T08:58:24.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.464+0000 7f7e76464640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7e70118720 con 0x7f7e70108e00 2024-09-19T08:58:24.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.464+0000 7f7e74a01640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e7010d530 0x7f7e701a33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:24.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.464+0000 7f7e6f7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e70108e00 0x7f7e7019f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:24.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.464+0000 7f7e6f7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e70108e00 0x7f7e7019f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:43244/0 (socket says 172.21.15.92:43244) 2024-09-19T08:58:24.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.464+0000 7f7e6f7fe640 1 -- 172.21.15.92:0/675713998 learned_addr learned my addr 172.21.15.92:0/675713998 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:24.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.465+0000 7f7e6f7fe640 1 -- 172.21.15.92:0/675713998 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e7010d530 msgr2=0x7f7e701a33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:24.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.465+0000 7f7e6f7fe640 1 --2- 172.21.15.92:0/675713998 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e7010d530 0x7f7e701a33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.465+0000 7f7e6f7fe640 1 -- 172.21.15.92:0/675713998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e70108450 msgr2=0x7f7e7019eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:24.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.465+0000 7f7e6f7fe640 1 --2- 172.21.15.92:0/675713998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e70108450 0x7f7e7019eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.465+0000 7f7e6f7fe640 1 -- 172.21.15.92:0/675713998 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e701a3b10 con 0x7f7e70108e00 2024-09-19T08:58:24.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.465+0000 7f7e6f7fe640 1 --2- 172.21.15.92:0/675713998 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e70108e00 0x7f7e7019f020 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7e6402a980 tx=0x7f7e64003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:24.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.466+0000 7f7e6d7fa640 1 -- 172.21.15.92:0/675713998 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6403f070 con 0x7f7e70108e00 2024-09-19T08:58:24.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.466+0000 7f7e6d7fa640 1 -- 172.21.15.92:0/675713998 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e64031c90 con 0x7f7e70108e00 2024-09-19T08:58:24.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.466+0000 7f7e6d7fa640 1 -- 172.21.15.92:0/675713998 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e64035030 con 0x7f7e70108e00 2024-09-19T08:58:24.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.466+0000 7f7e76464640 1 -- 172.21.15.92:0/675713998 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e701a3da0 con 0x7f7e70108e00 2024-09-19T08:58:24.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.466+0000 7f7e76464640 1 -- 172.21.15.92:0/675713998 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e701ab690 con 0x7f7e70108e00 2024-09-19T08:58:24.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.471+0000 7f7e7883d740 1 Processor -- start 2024-09-19T08:58:24.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.475+0000 7f7e6d7fa640 1 -- 172.21.15.92:0/675713998 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7e64042070 con 0x7f7e70108e00 2024-09-19T08:58:24.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.476+0000 7f7e6d7fa640 1 --2- 172.21.15.92:0/675713998 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7e580a3450 0x7f7e580a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:24.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.476+0000 7f7e6d7fa640 1 -- 172.21.15.92:0/675713998 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f7e640efec0 con 0x7f7e70108e00 2024-09-19T08:58:24.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.477+0000 7f7e74a01640 1 --2- 172.21.15.92:0/675713998 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7e580a3450 0x7f7e580a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:24.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.477+0000 7f7e7883d740 1 -- start start 2024-09-19T08:58:24.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.477+0000 7f7e7883d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa3be00b40 0x55fa3bdff090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:24.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.477+0000 7f7e7883d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa3bdff5d0 0x55fa3bdffa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:24.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.477+0000 7f7e7883d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa3be0a370 0x55fa3be0c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:24.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.477+0000 7f7e7883d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55fa3bd652f0 con 0x55fa3bdff5d0 2024-09-19T08:58:24.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.477+0000 7f7e7883d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55fa3bd0ccf0 con 0x55fa3be00b40 2024-09-19T08:58:24.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.477+0000 7f7e7883d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55fa3bd612b0 con 0x55fa3be0a370 2024-09-19T08:58:24.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.478+0000 7f7e6ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa3be00b40 0x55fa3bdff090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:24.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.478+0000 7f7e6ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa3be00b40 0x55fa3bdff090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:38710/0 (socket says 172.21.15.92:38710) 2024-09-19T08:58:24.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.478+0000 7f7e6ffff640 1 -- 172.21.15.92:0/1026600408 learned_addr learned my addr 172.21.15.92:0/1026600408 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:24.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.478+0000 7f7e74a01640 1 --2- 172.21.15.92:0/1026600408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa3be0a370 0x55fa3be0c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:24.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.479+0000 7f7e74a01640 1 --2- 172.21.15.92:0/675713998 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7e580a3450 0x7f7e580a5910 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7e68005fd0 tx=0x7f7e68009550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:24.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.479+0000 7f7e74a01640 1 -- 172.21.15.92:0/1026600408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa3be00b40 msgr2=0x55fa3bdff090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:24.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.479+0000 7f7e74a01640 1 --2- 172.21.15.92:0/1026600408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa3be00b40 0x55fa3bdff090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.479+0000 7f7e74a01640 1 -- 172.21.15.92:0/1026600408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa3bdff5d0 msgr2=0x55fa3bdffa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:24.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.479+0000 7f7e74a01640 1 --2- 172.21.15.92:0/1026600408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa3bdff5d0 0x55fa3bdffa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.479+0000 7f7e74a01640 1 -- 172.21.15.92:0/1026600408 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa3bcf13a0 con 0x55fa3be0a370 2024-09-19T08:58:24.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.479+0000 7f7e74a01640 1 --2- 172.21.15.92:0/1026600408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa3be0a370 0x55fa3be0c760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7e68011010 tx=0x7f7e68018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef5cb1519f8bbdb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:24.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.479+0000 7f7e567fc640 1 -- 172.21.15.92:0/1026600408 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6801e6f0 con 0x55fa3be0a370 2024-09-19T08:58:24.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.479+0000 7f7e567fc640 1 -- 172.21.15.92:0/1026600408 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e68018070 con 0x55fa3be0a370 2024-09-19T08:58:24.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.479+0000 7f7e567fc640 1 -- 172.21.15.92:0/1026600408 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e68026d30 con 0x55fa3be0a370 2024-09-19T08:58:24.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.481+0000 7f7e7883d740 1 -- 172.21.15.92:0/1026600408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa3be0a370 msgr2=0x55fa3be0c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:24.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.481+0000 7f7e7883d740 1 --2- 172.21.15.92:0/1026600408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa3be0a370 0x55fa3be0c760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7e68011010 tx=0x7f7e68018000 comp rx=0 tx=0).stop 2024-09-19T08:58:24.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.481+0000 7f7e7883d740 1 -- 172.21.15.92:0/1026600408 shutdown_connections 2024-09-19T08:58:24.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.481+0000 7f7e7883d740 1 --2- 172.21.15.92:0/1026600408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa3be0a370 0x55fa3be0c760 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.481+0000 7f7e7883d740 1 --2- 172.21.15.92:0/1026600408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa3bdff5d0 0x55fa3bdffa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.481+0000 7f7e7883d740 1 --2- 172.21.15.92:0/1026600408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa3be00b40 0x55fa3bdff090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.481+0000 7f7e7883d740 1 -- 172.21.15.92:0/1026600408 >> 172.21.15.92:0/1026600408 conn(0x55fa3bdc8310 msgr2=0x55fa3bdfbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:24.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.483+0000 7f7e7883d740 1 -- 172.21.15.92:0/1026600408 shutdown_connections 2024-09-19T08:58:24.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.483+0000 7f7e7883d740 1 -- 172.21.15.92:0/1026600408 wait complete. 2024-09-19T08:58:24.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.483+0000 7f7e7883d740 1 -- start start 2024-09-19T08:58:24.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.483+0000 7f7e7883d740 1 Processor -- start 2024-09-19T08:58:24.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.484+0000 7f7e7883d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa3bdff5d0 0x55fa3be09d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:24.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.484+0000 7f7e7883d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa3be00b40 0x55fa3be07030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:24.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.484+0000 7f7e6ffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa3bdff5d0 0x55fa3be09d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:24.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.484+0000 7f7e6ffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa3bdff5d0 0x55fa3be09d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:43254/0 (socket says 172.21.15.92:43254) 2024-09-19T08:58:24.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.484+0000 7f7e6ffff640 1 -- 172.21.15.92:0/1114029983 learned_addr learned my addr 172.21.15.92:0/1114029983 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:24.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.484+0000 7f7e6f7fe640 1 --2- 172.21.15.92:0/1114029983 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa3be00b40 0x55fa3be07030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:24.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.484+0000 7f7e7883d740 1 --2- 172.21.15.92:0/1114029983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa3be0a370 0x55fa3be07640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:24.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.484+0000 7f7e7883d740 1 -- 172.21.15.92:0/1114029983 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55fa3be1e080 con 0x55fa3be00b40 2024-09-19T08:58:24.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.484+0000 7f7e7883d740 1 -- 172.21.15.92:0/1114029983 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55fa3bd20060 con 0x55fa3be0a370 2024-09-19T08:58:24.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.484+0000 7f7e7883d740 1 -- 172.21.15.92:0/1114029983 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55fa3be1e200 con 0x55fa3bdff5d0 2024-09-19T08:58:24.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.485+0000 7f7e7883d740 10 client.0 _ll_register_callbacks cb 0x55fa3ba738c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:24.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.485+0000 7f7e6ffff640 1 -- 172.21.15.92:0/1114029983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa3be0a370 msgr2=0x55fa3be07640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T08:58:24.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.485+0000 7f7e6ffff640 1 --2- 172.21.15.92:0/1114029983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa3be0a370 0x55fa3be07640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.485+0000 7f7e6ffff640 1 -- 172.21.15.92:0/1114029983 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa3be00b40 msgr2=0x55fa3be07030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:24.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.485+0000 7f7e6ffff640 1 --2- 172.21.15.92:0/1114029983 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa3be00b40 0x55fa3be07030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.485+0000 7f7e6ffff640 1 -- 172.21.15.92:0/1114029983 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3bad63c0 con 0x55fa3bdff5d0 2024-09-19T08:58:24.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.485+0000 7f7e7883d740 1 -- 172.21.15.92:0/1114029983 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e68018070 con 0x55fa3bdff5d0 2024-09-19T08:58:24.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.487+0000 7f7e6ffff640 1 --2- 172.21.15.92:0/1114029983 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa3bdff5d0 0x55fa3be09d80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7e60011690 tx=0x7f7e60011a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d13a5ce5587eeda server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:24.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.487+0000 7f7e4f7fe640 10 client.25177 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T08:58:24.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.488+0000 7f7e4f7fe640 1 -- 172.21.15.92:0/1114029983 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6001f060 con 0x55fa3bdff5d0 2024-09-19T08:58:24.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.488+0000 7f7e4f7fe640 1 -- 172.21.15.92:0/1114029983 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f7e60012920 con 0x55fa3bdff5d0 2024-09-19T08:58:24.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.488+0000 7f7e4f7fe640 1 -- 172.21.15.92:0/1114029983 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7e60012b60 con 0x55fa3bdff5d0 2024-09-19T08:58:24.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.488+0000 7f7e7883d740 10 client.25177 fetch_fsmap learned FSMap version 19 2024-09-19T08:58:24.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.488+0000 7f7e7883d740 1 -- 172.21.15.92:0/1114029983 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55fa3be29b40 con 0x55fa3bdff5d0 2024-09-19T08:58:24.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.489+0000 7f7e4f7fe640 1 -- 172.21.15.92:0/1114029983 <== mon.1 v2:172.21.15.190:3300/0 4 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f7e6001a440 con 0x55fa3bdff5d0 2024-09-19T08:58:24.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.489+0000 7f7e7883d740 10 client.25177 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:58:24.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.489+0000 7f7e7883d740 10 client.25177 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:58:24.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.489+0000 7f7e7883d740 20 client.25177 populate_metadata read hostname 'smithi092' 2024-09-19T08:58:24.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.489+0000 7f7e7883d740 1 --2- 172.21.15.92:0/1114029983 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55fa3be2ae90 0x55fa3be2d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:24.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.489+0000 7f7e7883d740 4 client.25177 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:58:24.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.489+0000 7f7e7883d740 1 -- 172.21.15.92:0/1114029983 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa3bd72860 con 0x55fa3be2ae90 2024-09-19T08:58:24.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.489+0000 7f7e6f7fe640 1 --2- 172.21.15.92:0/1114029983 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55fa3be2ae90 0x55fa3be2d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:24.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.490+0000 7f7e6f7fe640 1 --2- 172.21.15.92:0/1114029983 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55fa3be2ae90 0x55fa3be2d2e0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e851bf9ffcb404b0 server_cookie=2a78edeea8b6814e in_seq=0 out_seq=0 2024-09-19T08:58:24.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.490+0000 7f7e4f7fe640 10 client.25177 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:24.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.491+0000 7f7e4f7fe640 1 -- 172.21.15.92:0/1114029983 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fa3bd72860 con 0x55fa3be2ae90 2024-09-19T08:58:24.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.491+0000 7f7e4f7fe640 10 client.25177 handle_command_reply: tid=0 2024-09-19T08:58:24.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.491+0000 7f7e7883d740 1 client.25177 shutdown 2024-09-19T08:58:24.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.491+0000 7f7e7883d740 1 -- 172.21.15.92:0/1114029983 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa3bdff5d0 msgr2=0x55fa3be09d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:24.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.491+0000 7f7e7883d740 1 --2- 172.21.15.92:0/1114029983 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa3bdff5d0 0x55fa3be09d80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7e60011690 tx=0x7f7e60011a90 comp rx=0 tx=0).stop 2024-09-19T08:58:24.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.491+0000 7f7e7883d740 1 -- 172.21.15.92:0/1114029983 shutdown_connections 2024-09-19T08:58:24.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.491+0000 7f7e7883d740 1 --2- 172.21.15.92:0/1114029983 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55fa3be2ae90 0x55fa3be2d2e0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.491+0000 7f7e7883d740 1 --2- 172.21.15.92:0/1114029983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa3be0a370 0x55fa3be07640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.491+0000 7f7e4f7fe640 0 client.25177 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:24.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.492+0000 7f7e7883d740 1 --2- 172.21.15.92:0/1114029983 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa3be00b40 0x55fa3be07030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.492+0000 7f7e7883d740 1 --2- 172.21.15.92:0/1114029983 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa3bdff5d0 0x55fa3be09d80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.492+0000 7f7e7883d740 1 -- 172.21.15.92:0/1114029983 >> 172.21.15.92:0/1114029983 conn(0x55fa3bdc8310 msgr2=0x55fa3be01930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:24.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.492+0000 7f7e7883d740 1 -- 172.21.15.92:0/1114029983 shutdown_connections 2024-09-19T08:58:24.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.492+0000 7f7e7883d740 1 -- 172.21.15.92:0/1114029983 wait complete. 2024-09-19T08:58:24.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.492+0000 7f7e7883d740 20 client.25177 trim_cache size 0 max 16384 2024-09-19T08:58:24.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.517+0000 7f7e7883d740 1 Processor -- start 2024-09-19T08:58:24.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.517+0000 7f7e7883d740 1 -- start start 2024-09-19T08:58:24.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.518+0000 7f7e7883d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa3bdff5d0 0x55fa3be273f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:24.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.518+0000 7f7e7883d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa3be00b40 0x55fa3be32bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:24.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.518+0000 7f7e7883d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa3be0a370 0x55fa3be330f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:24.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.518+0000 7f7e7883d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5c00c510 con 0x55fa3be0a370 2024-09-19T08:58:24.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.518+0000 7f7e7883d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5c00edb0 con 0x55fa3bdff5d0 2024-09-19T08:58:24.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.518+0000 7f7e7883d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5c00cba0 con 0x55fa3be00b40 2024-09-19T08:58:24.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.518+0000 7f7e74a01640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa3be0a370 0x55fa3be330f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:24.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.518+0000 7f7e6f7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa3be00b40 0x55fa3be32bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:24.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.518+0000 7f7e74a01640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa3be0a370 0x55fa3be330f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59326/0 (socket says 172.21.15.92:59326) 2024-09-19T08:58:24.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.518+0000 7f7e74a01640 1 -- 172.21.15.92:0/3663629570 learned_addr learned my addr 172.21.15.92:0/3663629570 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:24.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.519+0000 7f7e6ffff640 1 --2- 172.21.15.92:0/3663629570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa3bdff5d0 0x55fa3be273f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:24.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.519+0000 7f7e74a01640 1 -- 172.21.15.92:0/3663629570 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa3be00b40 msgr2=0x55fa3be32bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:24.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.519+0000 7f7e74a01640 1 --2- 172.21.15.92:0/3663629570 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa3be00b40 0x55fa3be32bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.519+0000 7f7e74a01640 1 -- 172.21.15.92:0/3663629570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa3bdff5d0 msgr2=0x55fa3be273f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:24.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.519+0000 7f7e74a01640 1 --2- 172.21.15.92:0/3663629570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa3bdff5d0 0x55fa3be273f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.519+0000 7f7e74a01640 1 -- 172.21.15.92:0/3663629570 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa3be0cad0 con 0x55fa3be0a370 2024-09-19T08:58:24.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.519+0000 7f7e74a01640 1 --2- 172.21.15.92:0/3663629570 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa3be0a370 0x55fa3be330f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f7e68012520 tx=0x7f7e680207c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe1ba37198c5807 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:24.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.520+0000 7f7e55ffb640 1 -- 172.21.15.92:0/3663629570 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e68034070 con 0x55fa3be0a370 2024-09-19T08:58:24.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.520+0000 7f7e55ffb640 1 -- 172.21.15.92:0/3663629570 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e68020d40 con 0x55fa3be0a370 2024-09-19T08:58:24.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.520+0000 7f7e55ffb640 1 -- 172.21.15.92:0/3663629570 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6801e9e0 con 0x55fa3be0a370 2024-09-19T08:58:24.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.521+0000 7f7e7883d740 1 -- 172.21.15.92:0/3663629570 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa3be0a370 msgr2=0x55fa3be330f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:24.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.521+0000 7f7e7883d740 1 --2- 172.21.15.92:0/3663629570 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa3be0a370 0x55fa3be330f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f7e68012520 tx=0x7f7e680207c0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.521+0000 7f7e7883d740 1 -- 172.21.15.92:0/3663629570 shutdown_connections 2024-09-19T08:58:24.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.521+0000 7f7e7883d740 1 --2- 172.21.15.92:0/3663629570 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa3be0a370 0x55fa3be330f0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.521+0000 7f7e7883d740 1 --2- 172.21.15.92:0/3663629570 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa3be00b40 0x55fa3be32bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.521+0000 7f7e7883d740 1 --2- 172.21.15.92:0/3663629570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa3bdff5d0 0x55fa3be273f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.521+0000 7f7e7883d740 1 -- 172.21.15.92:0/3663629570 >> 172.21.15.92:0/3663629570 conn(0x55fa3bdc8310 msgr2=0x55fa3be06d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:24.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.521+0000 7f7e7883d740 1 -- 172.21.15.92:0/3663629570 shutdown_connections 2024-09-19T08:58:24.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.521+0000 7f7e7883d740 1 -- 172.21.15.92:0/3663629570 wait complete. 2024-09-19T08:58:24.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.522+0000 7f7e7883d740 1 -- start start 2024-09-19T08:58:24.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.522+0000 7f7e7883d740 1 Processor -- start 2024-09-19T08:58:24.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.523+0000 7f7e7883d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa3bdff5d0 0x55fa3be1f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:24.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.523+0000 7f7e7883d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa3be00b40 0x55fa3be1f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:24.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.523+0000 7f7e7883d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa3be0a370 0x55fa3be1fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:24.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.523+0000 7f7e7883d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5c00d270 con 0x55fa3bdff5d0 2024-09-19T08:58:24.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.523+0000 7f7e7883d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5c00e6e0 con 0x55fa3be0a370 2024-09-19T08:58:24.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.523+0000 7f7e7883d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5c00d940 con 0x55fa3be00b40 2024-09-19T08:58:24.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.523+0000 7f7e7883d740 10 client.0 _ll_register_callbacks cb 0x7f7e60009670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:24.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.523+0000 7f7e6ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa3bdff5d0 0x55fa3be1f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:24.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.523+0000 7f7e6ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa3bdff5d0 0x55fa3be1f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59338/0 (socket says 172.21.15.92:59338) 2024-09-19T08:58:24.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.523+0000 7f7e6ffff640 1 -- 172.21.15.92:0/663617999 learned_addr learned my addr 172.21.15.92:0/663617999 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:24.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.523+0000 7f7e6f7fe640 1 --2- 172.21.15.92:0/663617999 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa3be00b40 0x55fa3be1f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:24.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.524+0000 7f7e6ffff640 1 -- 172.21.15.92:0/663617999 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa3be00b40 msgr2=0x55fa3be1f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:24.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.524+0000 7f7e6ffff640 1 --2- 172.21.15.92:0/663617999 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa3be00b40 0x55fa3be1f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.524+0000 7f7e6ffff640 1 -- 172.21.15.92:0/663617999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa3be0a370 msgr2=0x55fa3be1fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:24.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.524+0000 7f7e6ffff640 1 --2- 172.21.15.92:0/663617999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa3be0a370 0x55fa3be1fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.524+0000 7f7e6ffff640 1 -- 172.21.15.92:0/663617999 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3bea5b90 con 0x55fa3bdff5d0 2024-09-19T08:58:24.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.525+0000 7f7e6ffff640 1 --2- 172.21.15.92:0/663617999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa3bdff5d0 0x55fa3be1f2a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7e6000f3b0 tx=0x7f7e600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2877eee313c0b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:24.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.525+0000 7f7e4f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:58:24.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.525+0000 7f7e4f7fe640 1 -- 172.21.15.92:0/663617999 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e60031060 con 0x55fa3bdff5d0 2024-09-19T08:58:24.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.525+0000 7f7e4f7fe640 1 -- 172.21.15.92:0/663617999 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f7e60004040 con 0x55fa3bdff5d0 2024-09-19T08:58:24.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.525+0000 7f7e7883d740 1 -- 172.21.15.92:0/663617999 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e68020d40 con 0x55fa3bdff5d0 2024-09-19T08:58:24.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.526+0000 7f7e4f7fe640 1 -- 172.21.15.92:0/663617999 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7e6001f040 con 0x55fa3bdff5d0 2024-09-19T08:58:24.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.526+0000 7f7e7883d740 10 client.15774 fetch_fsmap learned FSMap version 19 2024-09-19T08:58:24.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.526+0000 7f7e7883d740 1 -- 172.21.15.92:0/663617999 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55fa3bea6e70 con 0x55fa3bdff5d0 2024-09-19T08:58:24.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.527+0000 7f7e4f7fe640 1 -- 172.21.15.92:0/663617999 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e68020d40 con 0x55fa3bdff5d0 2024-09-19T08:58:24.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.527+0000 7f7e4f7fe640 1 -- 172.21.15.92:0/663617999 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f7e60036070 con 0x55fa3bdff5d0 2024-09-19T08:58:24.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.527+0000 7f7e7883d740 10 client.15774 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:58:24.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.527+0000 7f7e7883d740 10 client.15774 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:58:24.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.527+0000 7f7e7883d740 20 client.15774 populate_metadata read hostname 'smithi092' 2024-09-19T08:58:24.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.527+0000 7f7e7883d740 1 --2- 172.21.15.92:0/663617999 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55fa3be2ae90 0x55fa3bea9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:24.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.527+0000 7f7e7883d740 4 client.15774 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:58:24.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.527+0000 7f7e7883d740 1 -- 172.21.15.92:0/663617999 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fa3bd6cd70 con 0x55fa3be2ae90 2024-09-19T08:58:24.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.528+0000 7f7e6f7fe640 1 --2- 172.21.15.92:0/663617999 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55fa3be2ae90 0x55fa3bea9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:24.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.529+0000 7f7e4f7fe640 10 client.15774 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:24.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.529+0000 7f7e6f7fe640 1 --2- 172.21.15.92:0/663617999 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55fa3be2ae90 0x55fa3bea9650 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=307d588d288c74cb server_cookie=6aabeb5ccf24974 in_seq=0 out_seq=0 2024-09-19T08:58:24.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.529+0000 7f7e4f7fe640 1 -- 172.21.15.92:0/663617999 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fa3bd6cd70 con 0x55fa3be2ae90 2024-09-19T08:58:24.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.529+0000 7f7e4f7fe640 10 client.15774 handle_command_reply: tid=0 2024-09-19T08:58:24.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.529+0000 7f7e7883d740 1 client.15774 shutdown 2024-09-19T08:58:24.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.530+0000 7f7e7883d740 1 -- 172.21.15.92:0/663617999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa3bdff5d0 msgr2=0x55fa3be1f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:24.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.530+0000 7f7e7883d740 1 --2- 172.21.15.92:0/663617999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa3bdff5d0 0x55fa3be1f2a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7e6000f3b0 tx=0x7f7e600046c0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.531+0000 7f7e7883d740 1 -- 172.21.15.92:0/663617999 shutdown_connections 2024-09-19T08:58:24.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.531+0000 7f7e7883d740 1 --2- 172.21.15.92:0/663617999 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55fa3be2ae90 0x55fa3bea9650 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.531+0000 7f7e7883d740 1 --2- 172.21.15.92:0/663617999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa3be0a370 0x55fa3be1fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.531+0000 7f7e7883d740 1 --2- 172.21.15.92:0/663617999 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fa3be00b40 0x55fa3be1f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.531+0000 7f7e7883d740 1 --2- 172.21.15.92:0/663617999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa3bdff5d0 0x55fa3be1f2a0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.531+0000 7f7e7883d740 1 -- 172.21.15.92:0/663617999 >> 172.21.15.92:0/663617999 conn(0x55fa3bdc8310 msgr2=0x55fa3be01110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:24.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.531+0000 7f7e4f7fe640 0 client.15774 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:24.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.531+0000 7f7e7883d740 1 -- 172.21.15.92:0/663617999 shutdown_connections 2024-09-19T08:58:24.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.531+0000 7f7e7883d740 1 -- 172.21.15.92:0/663617999 wait complete. 2024-09-19T08:58:24.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.531+0000 7f7e7883d740 20 client.15774 trim_cache size 0 max 16384 2024-09-19T08:58:24.532 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-19T08:58:24.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.533+0000 7f7e76464640 1 -- 172.21.15.92:0/675713998 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7e580a3450 msgr2=0x7f7e580a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:24.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.533+0000 7f7e76464640 1 --2- 172.21.15.92:0/675713998 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7e580a3450 0x7f7e580a5910 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7e68005fd0 tx=0x7f7e68009550 comp rx=0 tx=0).stop 2024-09-19T08:58:24.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.533+0000 7f7e76464640 1 -- 172.21.15.92:0/675713998 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e70108e00 msgr2=0x7f7e7019f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:24.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.533+0000 7f7e76464640 1 --2- 172.21.15.92:0/675713998 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e70108e00 0x7f7e7019f020 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7e6402a980 tx=0x7f7e64003b90 comp rx=0 tx=0).stop 2024-09-19T08:58:24.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.533+0000 7f7e76464640 1 -- 172.21.15.92:0/675713998 shutdown_connections 2024-09-19T08:58:24.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.533+0000 7f7e76464640 1 --2- 172.21.15.92:0/675713998 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e7010d530 0x7f7e701a33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.533+0000 7f7e76464640 1 --2- 172.21.15.92:0/675713998 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e70108e00 0x7f7e7019f020 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.533+0000 7f7e76464640 1 --2- 172.21.15.92:0/675713998 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7e580a3450 0x7f7e580a5910 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.534+0000 7f7e76464640 1 --2- 172.21.15.92:0/675713998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e70108450 0x7f7e7019eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.534+0000 7f7e76464640 1 -- 172.21.15.92:0/675713998 >> 172.21.15.92:0/675713998 conn(0x7f7e70077ba0 msgr2=0x7f7e70078e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:24.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.534+0000 7f7e76464640 1 -- 172.21.15.92:0/675713998 shutdown_connections 2024-09-19T08:58:24.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:24.534+0000 7f7e76464640 1 -- 172.21.15.92:0/675713998 wait complete. 2024-09-19T08:58:25.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:25 smithi092 ceph-mon[31407]: pgmap v388: 97 pgs: 97 active+clean; 1.0 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 11 MiB/s wr, 734 op/s 2024-09-19T08:58:25.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 100.0 s, 5992.4 tps, lat 16.676 ms stddev 17.857 2024-09-19T08:58:25.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:25 smithi167 ceph-mon[35359]: pgmap v388: 97 pgs: 97 active+clean; 1.0 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 11 MiB/s wr, 734 op/s 2024-09-19T08:58:25.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:25 smithi190 ceph-mon[35358]: pgmap v388: 97 pgs: 97 active+clean; 1.0 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 11 MiB/s wr, 734 op/s 2024-09-19T08:58:26.163 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:58:26.164 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:58:26.569 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:58:27.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.135+0000 7faecffcb640 1 -- 172.21.15.92:0/2651405397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faec8100a70 msgr2=0x7faec8100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:27.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.135+0000 7faecffcb640 1 --2- 172.21.15.92:0/2651405397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faec8100a70 0x7faec8100ed0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7faeb8009930 tx=0x7faeb802a420 comp rx=0 tx=0).stop 2024-09-19T08:58:27.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.135+0000 7faecffcb640 1 -- 172.21.15.92:0/2651405397 shutdown_connections 2024-09-19T08:58:27.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.135+0000 7faecffcb640 1 --2- 172.21.15.92:0/2651405397 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faec8101410 0x7faec810d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:27.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.135+0000 7faecffcb640 1 --2- 172.21.15.92:0/2651405397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faec8100a70 0x7faec8100ed0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:27.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.135+0000 7faecffcb640 1 --2- 172.21.15.92:0/2651405397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faec8106a70 0x7faec8106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:27.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.135+0000 7faecffcb640 1 -- 172.21.15.92:0/2651405397 >> 172.21.15.92:0/2651405397 conn(0x7faec80fc7d0 msgr2=0x7faec80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:27.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.136+0000 7faecffcb640 1 -- 172.21.15.92:0/2651405397 shutdown_connections 2024-09-19T08:58:27.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.136+0000 7faecffcb640 1 -- 172.21.15.92:0/2651405397 wait complete. 2024-09-19T08:58:27.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.137+0000 7faecffcb640 1 Processor -- start 2024-09-19T08:58:27.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.137+0000 7faecffcb640 1 -- start start 2024-09-19T08:58:27.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.137+0000 7faecffcb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faec8100a70 0x7faec810e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:27.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.137+0000 7faecffcb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faec8101410 0x7faec810e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:27.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.137+0000 7faecffcb640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faec8106a70 0x7faec810ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:27.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.137+0000 7faecffcb640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7faec8111f50 con 0x7faec8101410 2024-09-19T08:58:27.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.137+0000 7faecffcb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7faec8111dd0 con 0x7faec8100a70 2024-09-19T08:58:27.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.137+0000 7faecffcb640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7faec81120d0 con 0x7faec8106a70 2024-09-19T08:58:27.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.137+0000 7faecd566640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faec8101410 0x7faec810e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:27.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.137+0000 7faecd566640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faec8101410 0x7faec810e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59368/0 (socket says 172.21.15.92:59368) 2024-09-19T08:58:27.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.137+0000 7faecd566640 1 -- 172.21.15.92:0/4157002546 learned_addr learned my addr 172.21.15.92:0/4157002546 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:27.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.137+0000 7faece568640 1 --2- 172.21.15.92:0/4157002546 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faec8106a70 0x7faec810ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:27.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.137+0000 7faecdd67640 1 --2- 172.21.15.92:0/4157002546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faec8100a70 0x7faec810e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:27.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.138+0000 7faecdd67640 1 -- 172.21.15.92:0/4157002546 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faec8106a70 msgr2=0x7faec810ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:27.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.138+0000 7faecdd67640 1 --2- 172.21.15.92:0/4157002546 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faec8106a70 0x7faec810ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:27.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.138+0000 7faecdd67640 1 -- 172.21.15.92:0/4157002546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faec8101410 msgr2=0x7faec810e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:27.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.138+0000 7faecdd67640 1 --2- 172.21.15.92:0/4157002546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faec8101410 0x7faec810e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:27.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.138+0000 7faecdd67640 1 -- 172.21.15.92:0/4157002546 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec81a6950 con 0x7faec8100a70 2024-09-19T08:58:27.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.138+0000 7faece568640 1 --2- 172.21.15.92:0/4157002546 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faec8106a70 0x7faec810ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:58:27.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.139+0000 7faecdd67640 1 --2- 172.21.15.92:0/4157002546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faec8100a70 0x7faec810e3d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faec400c970 tx=0x7faec400ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:27.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.139+0000 7faebeffd640 1 -- 172.21.15.92:0/4157002546 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec4007bb0 con 0x7faec8100a70 2024-09-19T08:58:27.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.139+0000 7faecffcb640 1 -- 172.21.15.92:0/4157002546 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faec81a6c40 con 0x7faec8100a70 2024-09-19T08:58:27.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.139+0000 7faebeffd640 1 -- 172.21.15.92:0/4157002546 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faec4007d50 con 0x7faec8100a70 2024-09-19T08:58:27.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.139+0000 7faebeffd640 1 -- 172.21.15.92:0/4157002546 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec4004e60 con 0x7faec8100a70 2024-09-19T08:58:27.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.139+0000 7faecffcb640 1 -- 172.21.15.92:0/4157002546 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faec81a7180 con 0x7faec8100a70 2024-09-19T08:58:27.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.143+0000 7faebeffd640 1 -- 172.21.15.92:0/4157002546 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7faec4005000 con 0x7faec8100a70 2024-09-19T08:58:27.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.145+0000 7faebeffd640 1 --2- 172.21.15.92:0/4157002546 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7faeb40a32c0 0x7faeb40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:27.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.145+0000 7faed23a4740 1 Processor -- start 2024-09-19T08:58:27.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.146+0000 7faebeffd640 1 -- 172.21.15.92:0/4157002546 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7faec40cf360 con 0x7faec8100a70 2024-09-19T08:58:27.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.146+0000 7faed23a4740 1 -- start start 2024-09-19T08:58:27.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.146+0000 7faecd566640 1 --2- 172.21.15.92:0/4157002546 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7faeb40a32c0 0x7faeb40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:27.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.147+0000 7faed23a4740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56418a9afa80 0x56418a9afe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:27.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.147+0000 7faed23a4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418a9b03a0 0x56418a9c3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:27.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.147+0000 7faed23a4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56418a9c3550 0x56418a9c5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:27.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.147+0000 7faed23a4740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56418a915280 con 0x56418a9b03a0 2024-09-19T08:58:27.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.147+0000 7faed23a4740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56418a8bcb10 con 0x56418a9c3550 2024-09-19T08:58:27.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.147+0000 7faed23a4740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56418a911240 con 0x56418a9afa80 2024-09-19T08:58:27.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.147+0000 7faece568640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56418a9c3550 0x56418a9c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:27.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.147+0000 7faece568640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56418a9c3550 0x56418a9c5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:38754/0 (socket says 172.21.15.92:38754) 2024-09-19T08:58:27.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.147+0000 7faece568640 1 -- 172.21.15.92:0/2049411581 learned_addr learned my addr 172.21.15.92:0/2049411581 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:27.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.147+0000 7faecd566640 1 --2- 172.21.15.92:0/2049411581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418a9b03a0 0x56418a9c3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:27.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.147+0000 7faecdd67640 1 --2- 172.21.15.92:0/2049411581 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56418a9afa80 0x56418a9afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:27.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.147+0000 7faece568640 1 -- 172.21.15.92:0/2049411581 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56418a9afa80 msgr2=0x56418a9afe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:27.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.147+0000 7faece568640 1 --2- 172.21.15.92:0/2049411581 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56418a9afa80 0x56418a9afe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:27.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.147+0000 7faece568640 1 -- 172.21.15.92:0/2049411581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418a9b03a0 msgr2=0x56418a9c3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:27.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.147+0000 7faece568640 1 --2- 172.21.15.92:0/2049411581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418a9b03a0 0x56418a9c3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:27.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.147+0000 7faecd566640 1 --2- 172.21.15.92:0/4157002546 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7faeb40a32c0 0x7faeb40a5780 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7faec810fe60 tx=0x7faeb8031690 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:27.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.147+0000 7faece568640 1 -- 172.21.15.92:0/2049411581 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56418a8c91f0 con 0x56418a9c3550 2024-09-19T08:58:27.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.148+0000 7faece568640 1 --2- 172.21.15.92:0/2049411581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56418a9c3550 0x56418a9c5940 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7faec0010750 tx=0x7faec0010c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c46e6be0c9226a5f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:27.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.148+0000 7faeb3fff640 1 -- 172.21.15.92:0/2049411581 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec000ead0 con 0x56418a9c3550 2024-09-19T08:58:27.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.148+0000 7faeb3fff640 1 -- 172.21.15.92:0/2049411581 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faec0010e60 con 0x56418a9c3550 2024-09-19T08:58:27.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.148+0000 7faeb3fff640 1 -- 172.21.15.92:0/2049411581 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec0011640 con 0x56418a9c3550 2024-09-19T08:58:27.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.149+0000 7faed23a4740 1 -- 172.21.15.92:0/2049411581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56418a9c3550 msgr2=0x56418a9c5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:27.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.149+0000 7faed23a4740 1 --2- 172.21.15.92:0/2049411581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56418a9c3550 0x56418a9c5940 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7faec0010750 tx=0x7faec0010c10 comp rx=0 tx=0).stop 2024-09-19T08:58:27.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.149+0000 7faed23a4740 1 -- 172.21.15.92:0/2049411581 shutdown_connections 2024-09-19T08:58:27.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.149+0000 7faed23a4740 1 --2- 172.21.15.92:0/2049411581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56418a9c3550 0x56418a9c5940 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:27.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.149+0000 7faed23a4740 1 --2- 172.21.15.92:0/2049411581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418a9b03a0 0x56418a9c3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:27.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.149+0000 7faed23a4740 1 --2- 172.21.15.92:0/2049411581 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56418a9afa80 0x56418a9afe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:27.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.149+0000 7faed23a4740 1 -- 172.21.15.92:0/2049411581 >> 172.21.15.92:0/2049411581 conn(0x56418a9ac0f0 msgr2=0x56418a9ac4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:27.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.149+0000 7faed23a4740 1 -- 172.21.15.92:0/2049411581 shutdown_connections 2024-09-19T08:58:27.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.149+0000 7faed23a4740 1 -- 172.21.15.92:0/2049411581 wait complete. 2024-09-19T08:58:27.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.150+0000 7faed23a4740 1 -- start start 2024-09-19T08:58:27.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.150+0000 7faed23a4740 1 Processor -- start 2024-09-19T08:58:27.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.151+0000 7faed23a4740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56418a9afa80 0x56418a9c0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:27.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.151+0000 7faed23a4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56418a9b03a0 0x56418a9c09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:27.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.151+0000 7faed23a4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418a9c3550 0x56418a9c0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:27.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.151+0000 7faed23a4740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56418a9c60c0 con 0x56418a9c3550 2024-09-19T08:58:27.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.151+0000 7faed23a4740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56418a8cff10 con 0x56418a9b03a0 2024-09-19T08:58:27.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.151+0000 7faecd566640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56418a9b03a0 0x56418a9c09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:27.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.152+0000 7faecd566640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56418a9b03a0 0x56418a9c09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:38770/0 (socket says 172.21.15.92:38770) 2024-09-19T08:58:27.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.152+0000 7faecd566640 1 -- 172.21.15.92:0/3040158715 learned_addr learned my addr 172.21.15.92:0/3040158715 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:27.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.152+0000 7faed23a4740 1 -- 172.21.15.92:0/3040158715 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56418a9c6240 con 0x56418a9afa80 2024-09-19T08:58:27.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.152+0000 7faecdd67640 1 --2- 172.21.15.92:0/3040158715 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56418a9afa80 0x56418a9c0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:27.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.152+0000 7faed23a4740 10 client.0 _ll_register_callbacks cb 0x56418a898a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:27.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.152+0000 7faecdd67640 1 -- 172.21.15.92:0/3040158715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56418a9b03a0 msgr2=0x56418a9c09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:27.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.152+0000 7faecdd67640 1 --2- 172.21.15.92:0/3040158715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56418a9b03a0 0x56418a9c09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:27.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.152+0000 7faecdd67640 1 -- 172.21.15.92:0/3040158715 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418a9c3550 msgr2=0x56418a9c0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:27.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.152+0000 7faecdd67640 1 --2- 172.21.15.92:0/3040158715 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418a9c3550 0x56418a9c0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:27.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.152+0000 7faecdd67640 1 -- 172.21.15.92:0/3040158715 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56418a6866a0 con 0x56418a9afa80 2024-09-19T08:58:27.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.154+0000 7faecdd67640 1 --2- 172.21.15.92:0/3040158715 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56418a9afa80 0x56418a9c0490 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faec409b730 tx=0x7faec409b680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da28409ca8b674a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:27.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.154+0000 7faeb17fa640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T08:58:27.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.154+0000 7faeb17fa640 1 -- 172.21.15.92:0/3040158715 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec401d040 con 0x56418a9afa80 2024-09-19T08:58:27.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.154+0000 7faeb17fa640 1 -- 172.21.15.92:0/3040158715 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7faec40980a0 con 0x56418a9afa80 2024-09-19T08:58:27.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.154+0000 7faed23a4740 1 -- 172.21.15.92:0/3040158715 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faec0010e60 con 0x56418a9afa80 2024-09-19T08:58:27.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.154+0000 7faeb17fa640 1 -- 172.21.15.92:0/3040158715 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7faec40ba1a0 con 0x56418a9afa80 2024-09-19T08:58:27.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.155+0000 7faed23a4740 10 client.25195 fetch_fsmap learned FSMap version 19 2024-09-19T08:58:27.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.155+0000 7faed23a4740 1 -- 172.21.15.92:0/3040158715 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56418a9d1d70 con 0x56418a9afa80 2024-09-19T08:58:27.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.155+0000 7faeb17fa640 1 -- 172.21.15.92:0/3040158715 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faec0010e60 con 0x56418a9afa80 2024-09-19T08:58:27.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.155+0000 7faeb17fa640 1 -- 172.21.15.92:0/3040158715 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7faec409ae80 con 0x56418a9afa80 2024-09-19T08:58:27.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.155+0000 7faed23a4740 10 client.25195 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:58:27.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.155+0000 7faed23a4740 10 client.25195 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:58:27.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.155+0000 7faed23a4740 20 client.25195 populate_metadata read hostname 'smithi092' 2024-09-19T08:58:27.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.155+0000 7faed23a4740 1 --2- 172.21.15.92:0/3040158715 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56418a9d32d0 0x56418a9d56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:27.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.155+0000 7faed23a4740 4 client.25195 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:58:27.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.155+0000 7faed23a4740 1 -- 172.21.15.92:0/3040158715 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56418a9227f0 con 0x56418a9d32d0 2024-09-19T08:58:27.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.155+0000 7faecd566640 1 --2- 172.21.15.92:0/3040158715 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56418a9d32d0 0x56418a9d56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:27.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.156+0000 7faecd566640 1 --2- 172.21.15.92:0/3040158715 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56418a9d32d0 0x56418a9d56c0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6120922fbe3d4ff server_cookie=3801906a7d5afb08 in_seq=0 out_seq=0 2024-09-19T08:58:27.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.156+0000 7faeb17fa640 10 client.25195 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:27.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.157+0000 7faeb17fa640 1 -- 172.21.15.92:0/3040158715 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56418a9227f0 con 0x56418a9d32d0 2024-09-19T08:58:27.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.157+0000 7faeb17fa640 10 client.25195 handle_command_reply: tid=0 2024-09-19T08:58:27.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.157+0000 7faed23a4740 1 client.25195 shutdown 2024-09-19T08:58:27.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.157+0000 7faed23a4740 1 -- 172.21.15.92:0/3040158715 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56418a9afa80 msgr2=0x56418a9c0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:27.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.157+0000 7faed23a4740 1 --2- 172.21.15.92:0/3040158715 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56418a9afa80 0x56418a9c0490 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faec409b730 tx=0x7faec409b680 comp rx=0 tx=0).stop 2024-09-19T08:58:27.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.157+0000 7faed23a4740 1 -- 172.21.15.92:0/3040158715 shutdown_connections 2024-09-19T08:58:27.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.157+0000 7faed23a4740 1 --2- 172.21.15.92:0/3040158715 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56418a9d32d0 0x56418a9d56c0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:27.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.157+0000 7faed23a4740 1 --2- 172.21.15.92:0/3040158715 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418a9c3550 0x56418a9c0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:27.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.157+0000 7faed23a4740 1 --2- 172.21.15.92:0/3040158715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56418a9b03a0 0x56418a9c09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:27.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.157+0000 7faed23a4740 1 --2- 172.21.15.92:0/3040158715 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56418a9afa80 0x56418a9c0490 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:27.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.157+0000 7faeb17fa640 0 client.25195 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:27.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.157+0000 7faed23a4740 1 -- 172.21.15.92:0/3040158715 >> 172.21.15.92:0/3040158715 conn(0x56418a9ac0f0 msgr2=0x56418a9ab270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:27.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.158+0000 7faed23a4740 1 -- 172.21.15.92:0/3040158715 shutdown_connections 2024-09-19T08:58:27.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.158+0000 7faed23a4740 1 -- 172.21.15.92:0/3040158715 wait complete. 2024-09-19T08:58:27.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.158+0000 7faed23a4740 20 client.25195 trim_cache size 0 max 16384 2024-09-19T08:58:27.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.192+0000 7faed23a4740 1 Processor -- start 2024-09-19T08:58:27.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.192+0000 7faed23a4740 1 -- start start 2024-09-19T08:58:27.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.193+0000 7faed23a4740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56418a9afa80 0x56418a9dafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:27.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.193+0000 7faed23a4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418a9b03a0 0x56418a9db510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:27.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.193+0000 7faed23a4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56418a9c3550 0x56418a9bd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:27.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.194+0000 7faecd566640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418a9b03a0 0x56418a9db510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:27.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.194+0000 7faecd566640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418a9b03a0 0x56418a9db510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59386/0 (socket says 172.21.15.92:59386) 2024-09-19T08:58:27.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.194+0000 7faed23a4740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7faec81a9480 con 0x56418a9b03a0 2024-09-19T08:58:27.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.194+0000 7faed23a4740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7faec81abd00 con 0x56418a9c3550 2024-09-19T08:58:27.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.194+0000 7faed23a4740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7faec81a9af0 con 0x56418a9afa80 2024-09-19T08:58:27.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.194+0000 7faece568640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56418a9c3550 0x56418a9bd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:27.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.194+0000 7faecdd67640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56418a9afa80 0x56418a9dafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:27.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.194+0000 7faece568640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56418a9c3550 0x56418a9bd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:38772/0 (socket says 172.21.15.92:38772) 2024-09-19T08:58:27.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.194+0000 7faece568640 1 -- 172.21.15.92:0/2228085943 learned_addr learned my addr 172.21.15.92:0/2228085943 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:27.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.194+0000 7faece568640 1 -- 172.21.15.92:0/2228085943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56418a9afa80 msgr2=0x56418a9dafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:27.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.194+0000 7faece568640 1 --2- 172.21.15.92:0/2228085943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56418a9afa80 0x56418a9dafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:27.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.194+0000 7faece568640 1 -- 172.21.15.92:0/2228085943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418a9b03a0 msgr2=0x56418a9db510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:27.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.194+0000 7faece568640 1 --2- 172.21.15.92:0/2228085943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418a9b03a0 0x56418a9db510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:27.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.194+0000 7faece568640 1 -- 172.21.15.92:0/2228085943 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56418a9d5d40 con 0x56418a9c3550 2024-09-19T08:58:27.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.195+0000 7faecd566640 1 --2- 172.21.15.92:0/2228085943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418a9b03a0 0x56418a9db510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-19T08:58:27.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.195+0000 7faece568640 1 --2- 172.21.15.92:0/2228085943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56418a9c3550 0x56418a9bd6f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faec00092f0 tx=0x7faec0009e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29ff4c95c7fd5217 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:27.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.195+0000 7faeb37fe640 1 -- 172.21.15.92:0/2228085943 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec0004c10 con 0x56418a9c3550 2024-09-19T08:58:27.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.195+0000 7faeb37fe640 1 -- 172.21.15.92:0/2228085943 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faec000edb0 con 0x56418a9c3550 2024-09-19T08:58:27.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.195+0000 7faeb37fe640 1 -- 172.21.15.92:0/2228085943 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec00059a0 con 0x56418a9c3550 2024-09-19T08:58:27.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.196+0000 7faed23a4740 1 -- 172.21.15.92:0/2228085943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56418a9c3550 msgr2=0x56418a9bd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:27.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.196+0000 7faed23a4740 1 --2- 172.21.15.92:0/2228085943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56418a9c3550 0x56418a9bd6f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faec00092f0 tx=0x7faec0009e70 comp rx=0 tx=0).stop 2024-09-19T08:58:27.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.196+0000 7faed23a4740 1 -- 172.21.15.92:0/2228085943 shutdown_connections 2024-09-19T08:58:27.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.196+0000 7faed23a4740 1 --2- 172.21.15.92:0/2228085943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56418a9c3550 0x56418a9bd6f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:27.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.196+0000 7faed23a4740 1 --2- 172.21.15.92:0/2228085943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418a9b03a0 0x56418a9db510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:27.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.196+0000 7faed23a4740 1 --2- 172.21.15.92:0/2228085943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56418a9afa80 0x56418a9dafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:27.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.196+0000 7faed23a4740 1 -- 172.21.15.92:0/2228085943 >> 172.21.15.92:0/2228085943 conn(0x56418a9ac0f0 msgr2=0x56418a9ab270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:27.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.196+0000 7faed23a4740 1 -- 172.21.15.92:0/2228085943 shutdown_connections 2024-09-19T08:58:27.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.196+0000 7faed23a4740 1 -- 172.21.15.92:0/2228085943 wait complete. 2024-09-19T08:58:27.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.197+0000 7faed23a4740 1 -- start start 2024-09-19T08:58:27.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.197+0000 7faed23a4740 1 Processor -- start 2024-09-19T08:58:27.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.198+0000 7faed23a4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418a9afa80 0x56418a9c7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:27.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.198+0000 7faed23a4740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56418a9b03a0 0x56418a9c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:27.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.198+0000 7faed23a4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56418a9c3550 0x56418a9c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:27.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.198+0000 7faed23a4740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7faec81aa1c0 con 0x56418a9afa80 2024-09-19T08:58:27.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.198+0000 7faed23a4740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7faec81ab630 con 0x56418a9c3550 2024-09-19T08:58:27.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.198+0000 7faed23a4740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7faec81aa890 con 0x56418a9b03a0 2024-09-19T08:58:27.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.199+0000 7faed23a4740 10 client.0 _ll_register_callbacks cb 0x7faec409b390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:27.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.199+0000 7faece568640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56418a9c3550 0x56418a9c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:27.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.199+0000 7faece568640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56418a9c3550 0x56418a9c7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:38778/0 (socket says 172.21.15.92:38778) 2024-09-19T08:58:27.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.199+0000 7faece568640 1 -- 172.21.15.92:0/558914684 learned_addr learned my addr 172.21.15.92:0/558914684 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:27.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.199+0000 7faecdd67640 1 --2- 172.21.15.92:0/558914684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418a9afa80 0x56418a9c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:27.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.200+0000 7faece568640 1 -- 172.21.15.92:0/558914684 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56418a9b03a0 msgr2=0x56418a9c79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:27.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.200+0000 7faece568640 1 --2- 172.21.15.92:0/558914684 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56418a9b03a0 0x56418a9c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:27.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.200+0000 7faece568640 1 -- 172.21.15.92:0/558914684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418a9afa80 msgr2=0x56418a9c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:27.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.200+0000 7faece568640 1 --2- 172.21.15.92:0/558914684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418a9afa80 0x56418a9c7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:27.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.200+0000 7faece568640 1 -- 172.21.15.92:0/558914684 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56418a9b28a0 con 0x56418a9c3550 2024-09-19T08:58:27.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.200+0000 7faece568640 1 --2- 172.21.15.92:0/558914684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56418a9c3550 0x56418a9c7ef0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7faec0005980 tx=0x7faec00059b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1651714a2086c82 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:27.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.201+0000 7faeb17fa640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T08:58:27.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.201+0000 7faeb17fa640 1 -- 172.21.15.92:0/558914684 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec0005050 con 0x56418a9c3550 2024-09-19T08:58:27.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.201+0000 7faeb17fa640 1 -- 172.21.15.92:0/558914684 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7faec0022070 con 0x56418a9c3550 2024-09-19T08:58:27.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.201+0000 7faed23a4740 1 -- 172.21.15.92:0/558914684 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faec000edb0 con 0x56418a9c3550 2024-09-19T08:58:27.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.205+0000 7faeb17fa640 1 -- 172.21.15.92:0/558914684 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7faec0005250 con 0x56418a9c3550 2024-09-19T08:58:27.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.205+0000 7faed23a4740 10 client.25214 fetch_fsmap learned FSMap version 19 2024-09-19T08:58:27.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.205+0000 7faed23a4740 1 -- 172.21.15.92:0/558914684 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56418a9b3b30 con 0x56418a9c3550 2024-09-19T08:58:27.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.206+0000 7faeb17fa640 1 -- 172.21.15.92:0/558914684 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faec000edb0 con 0x56418a9c3550 2024-09-19T08:58:27.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.206+0000 7faeb17fa640 1 -- 172.21.15.92:0/558914684 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7faec0033030 con 0x56418a9c3550 2024-09-19T08:58:27.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.206+0000 7faed23a4740 10 client.25214 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:58:27.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.206+0000 7faed23a4740 10 client.25214 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:58:27.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.206+0000 7faed23a4740 20 client.25214 populate_metadata read hostname 'smithi092' 2024-09-19T08:58:27.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.206+0000 7faed23a4740 1 --2- 172.21.15.92:0/558914684 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56418a9b41c0 0x56418a9b6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:27.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.206+0000 7faed23a4740 4 client.25214 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:58:27.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.206+0000 7faed23a4740 1 -- 172.21.15.92:0/558914684 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56418a91cd00 con 0x56418a9b41c0 2024-09-19T08:58:27.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.207+0000 7faecdd67640 1 --2- 172.21.15.92:0/558914684 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56418a9b41c0 0x56418a9b6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:27.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.207+0000 7faecdd67640 1 --2- 172.21.15.92:0/558914684 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56418a9b41c0 0x56418a9b6600 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e20cef717647c3ab server_cookie=7d85af4a31599409 in_seq=0 out_seq=0 2024-09-19T08:58:27.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.207+0000 7faeb17fa640 10 client.25214 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:27.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.209+0000 7faeb17fa640 1 -- 172.21.15.92:0/558914684 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56418a91cd00 con 0x56418a9b41c0 2024-09-19T08:58:27.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.209+0000 7faeb17fa640 10 client.25214 handle_command_reply: tid=0 2024-09-19T08:58:27.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.209+0000 7faed23a4740 1 client.25214 shutdown 2024-09-19T08:58:27.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.209+0000 7faed23a4740 1 -- 172.21.15.92:0/558914684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56418a9c3550 msgr2=0x56418a9c7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:27.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.209+0000 7faed23a4740 1 --2- 172.21.15.92:0/558914684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56418a9c3550 0x56418a9c7ef0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7faec0005980 tx=0x7faec00059b0 comp rx=0 tx=0).stop 2024-09-19T08:58:27.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.209+0000 7faed23a4740 1 -- 172.21.15.92:0/558914684 shutdown_connections 2024-09-19T08:58:27.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.209+0000 7faed23a4740 1 --2- 172.21.15.92:0/558914684 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56418a9b41c0 0x56418a9b6600 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:27.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.209+0000 7faed23a4740 1 --2- 172.21.15.92:0/558914684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56418a9c3550 0x56418a9c7ef0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:27.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.210+0000 7faed23a4740 1 --2- 172.21.15.92:0/558914684 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56418a9b03a0 0x56418a9c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:27.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.210+0000 7faed23a4740 1 --2- 172.21.15.92:0/558914684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56418a9afa80 0x56418a9c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:27.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.210+0000 7faed23a4740 1 -- 172.21.15.92:0/558914684 >> 172.21.15.92:0/558914684 conn(0x56418a9ac0f0 msgr2=0x56418a9ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:27.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.210+0000 7faeb17fa640 0 client.25214 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:27.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.210+0000 7faed23a4740 1 -- 172.21.15.92:0/558914684 shutdown_connections 2024-09-19T08:58:27.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.210+0000 7faed23a4740 1 -- 172.21.15.92:0/558914684 wait complete. 2024-09-19T08:58:27.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.210+0000 7faed23a4740 20 client.25214 trim_cache size 0 max 16384 2024-09-19T08:58:27.212 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T08:58:27.212 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-19T08:58:27.212 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "0f45d933-f6a6-4f87-b2a6-173229eb24c7", 2024-09-19T08:58:27.212 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-19T08:58:27.212 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T08:58:27.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.212+0000 7faecffcb640 1 -- 172.21.15.92:0/4157002546 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7faeb40a32c0 msgr2=0x7faeb40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:27.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.212+0000 7faecffcb640 1 --2- 172.21.15.92:0/4157002546 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7faeb40a32c0 0x7faeb40a5780 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7faec810fe60 tx=0x7faeb8031690 comp rx=0 tx=0).stop 2024-09-19T08:58:27.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.212+0000 7faecffcb640 1 -- 172.21.15.92:0/4157002546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faec8100a70 msgr2=0x7faec810e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:27.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.212+0000 7faecffcb640 1 --2- 172.21.15.92:0/4157002546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faec8100a70 0x7faec810e3d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faec400c970 tx=0x7faec400ce30 comp rx=0 tx=0).stop 2024-09-19T08:58:27.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.213+0000 7faecffcb640 1 -- 172.21.15.92:0/4157002546 shutdown_connections 2024-09-19T08:58:27.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.213+0000 7faecffcb640 1 --2- 172.21.15.92:0/4157002546 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faec8106a70 0x7faec810ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:27.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.213+0000 7faecffcb640 1 --2- 172.21.15.92:0/4157002546 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7faeb40a32c0 0x7faeb40a5780 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:27.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.213+0000 7faecffcb640 1 --2- 172.21.15.92:0/4157002546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faec8101410 0x7faec810e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:27.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.213+0000 7faecffcb640 1 --2- 172.21.15.92:0/4157002546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faec8100a70 0x7faec810e3d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:27.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.213+0000 7faecffcb640 1 -- 172.21.15.92:0/4157002546 >> 172.21.15.92:0/4157002546 conn(0x7faec80fc7d0 msgr2=0x7faec80fd100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:27.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.213+0000 7faecffcb640 1 -- 172.21.15.92:0/4157002546 shutdown_connections 2024-09-19T08:58:27.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:27.214+0000 7faecffcb640 1 -- 172.21.15.92:0/4157002546 wait complete. 2024-09-19T08:58:27.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:27 smithi092 ceph-mon[31407]: pgmap v389: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 13 MiB/s wr, 872 op/s 2024-09-19T08:58:27.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:27 smithi167 ceph-mon[35359]: pgmap v389: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 13 MiB/s wr, 872 op/s 2024-09-19T08:58:27.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:27 smithi190 ceph-mon[35358]: pgmap v389: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 13 MiB/s wr, 872 op/s 2024-09-19T08:58:28.037 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:58:28.451 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:58:28.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:28 smithi092 ceph-mon[31407]: scrub queued for path: / 2024-09-19T08:58:28.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:28 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T08:58:28.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:28 smithi092 ceph-mon[31407]: scrub summary: active paths [/] 2024-09-19T08:58:28.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:28 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T08:58:28.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:28 smithi167 ceph-mon[35359]: scrub queued for path: / 2024-09-19T08:58:28.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:28 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T08:58:28.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:28 smithi167 ceph-mon[35359]: scrub summary: active paths [/] 2024-09-19T08:58:28.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:28 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T08:58:28.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:28 smithi190 ceph-mon[35358]: scrub queued for path: / 2024-09-19T08:58:28.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:28 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T08:58:28.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:28 smithi190 ceph-mon[35358]: scrub summary: active paths [/] 2024-09-19T08:58:28.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:28 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T08:58:29.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.021+0000 7f934b59e640 1 -- 172.21.15.92:0/3901303799 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f934c101270 msgr2=0x7f934c10d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:29.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.021+0000 7f934b59e640 1 --2- 172.21.15.92:0/3901303799 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f934c101270 0x7f934c10d7a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9344009c10 tx=0x7f934402a6f0 comp rx=0 tx=0).stop 2024-09-19T08:58:29.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.024+0000 7f934b59e640 1 -- 172.21.15.92:0/3901303799 shutdown_connections 2024-09-19T08:58:29.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.024+0000 7f934b59e640 1 --2- 172.21.15.92:0/3901303799 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f934c101270 0x7f934c10d7a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:29.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.024+0000 7f934b59e640 1 --2- 172.21.15.92:0/3901303799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f934c1008d0 0x7f934c100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:29.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.024+0000 7f934b59e640 1 --2- 172.21.15.92:0/3901303799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f934c1068d0 0x7f934c106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:29.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.024+0000 7f934b59e640 1 -- 172.21.15.92:0/3901303799 >> 172.21.15.92:0/3901303799 conn(0x7f934c0fc630 msgr2=0x7f934c0fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:29.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.024+0000 7f934b59e640 1 -- 172.21.15.92:0/3901303799 shutdown_connections 2024-09-19T08:58:29.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.025+0000 7f934b59e640 1 -- 172.21.15.92:0/3901303799 wait complete. 2024-09-19T08:58:29.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.026+0000 7f934b59e640 1 Processor -- start 2024-09-19T08:58:29.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.026+0000 7f934b59e640 1 -- start start 2024-09-19T08:58:29.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.027+0000 7f934b59e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f934c1008d0 0x7f934c1971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:29.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.027+0000 7f934b59e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f934c101270 0x7f934c197730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:29.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.027+0000 7f934b59e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f934c1068d0 0x7f934c19bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:29.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.027+0000 7f934a59c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f934c1008d0 0x7f934c1971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:29.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.027+0000 7f934a59c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f934c1008d0 0x7f934c1971f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:43364/0 (socket says 172.21.15.92:43364) 2024-09-19T08:58:29.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.027+0000 7f9349d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f934c101270 0x7f934c197730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:29.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.027+0000 7f934a59c640 1 -- 172.21.15.92:0/4202278218 learned_addr learned my addr 172.21.15.92:0/4202278218 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:29.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.027+0000 7f934b59e640 1 -- 172.21.15.92:0/4202278218 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f934c110cd0 con 0x7f934c101270 2024-09-19T08:58:29.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.027+0000 7f934b59e640 1 -- 172.21.15.92:0/4202278218 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f934c110b50 con 0x7f934c1068d0 2024-09-19T08:58:29.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.027+0000 7f934ad9d640 1 --2- 172.21.15.92:0/4202278218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f934c1068d0 0x7f934c19bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:29.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.028+0000 7f934b59e640 1 -- 172.21.15.92:0/4202278218 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f934c110e50 con 0x7f934c1008d0 2024-09-19T08:58:29.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.028+0000 7f934a59c640 1 -- 172.21.15.92:0/4202278218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f934c1068d0 msgr2=0x7f934c19bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:29.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.028+0000 7f934a59c640 1 --2- 172.21.15.92:0/4202278218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f934c1068d0 0x7f934c19bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:29.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.028+0000 7f934a59c640 1 -- 172.21.15.92:0/4202278218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f934c101270 msgr2=0x7f934c197730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:29.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.028+0000 7f934a59c640 1 --2- 172.21.15.92:0/4202278218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f934c101270 0x7f934c197730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:29.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.028+0000 7f934a59c640 1 -- 172.21.15.92:0/4202278218 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f934c19c1a0 con 0x7f934c1008d0 2024-09-19T08:58:29.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.028+0000 7f934a59c640 1 --2- 172.21.15.92:0/4202278218 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f934c1008d0 0x7f934c1971f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f933c009e70 tx=0x7f933c00ed90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:29.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.029+0000 7f933b7fe640 1 -- 172.21.15.92:0/4202278218 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933c00ccc0 con 0x7f934c1008d0 2024-09-19T08:58:29.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.029+0000 7f933b7fe640 1 -- 172.21.15.92:0/4202278218 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f933c005500 con 0x7f934c1008d0 2024-09-19T08:58:29.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.029+0000 7f934b59e640 1 -- 172.21.15.92:0/4202278218 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f934c19c490 con 0x7f934c1008d0 2024-09-19T08:58:29.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.029+0000 7f934b59e640 1 -- 172.21.15.92:0/4202278218 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f934c06a790 con 0x7f934c1008d0 2024-09-19T08:58:29.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.029+0000 7f933b7fe640 1 -- 172.21.15.92:0/4202278218 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933c0047a0 con 0x7f934c1008d0 2024-09-19T08:58:29.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.033+0000 7f933b7fe640 1 -- 172.21.15.92:0/4202278218 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f933c005020 con 0x7f934c1008d0 2024-09-19T08:58:29.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.034+0000 7f9352ffd740 1 Processor -- start 2024-09-19T08:58:29.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.034+0000 7f9352ffd740 1 -- start start 2024-09-19T08:58:29.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.034+0000 7f9352ffd740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f40adf590 0x559f40adf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:29.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.034+0000 7f9352ffd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f40adfeb0 0x559f40af2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:29.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.034+0000 7f9352ffd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f40af3060 0x559f40af5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:29.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.034+0000 7f9352ffd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559f40a452e0 con 0x559f40af3060 2024-09-19T08:58:29.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.034+0000 7f9352ffd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559f409ecce0 con 0x559f40adfeb0 2024-09-19T08:58:29.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.034+0000 7f9352ffd740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x559f40a412a0 con 0x559f40adf590 2024-09-19T08:58:29.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.035+0000 7f9349d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f40af3060 0x559f40af5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:29.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.035+0000 7f933b7fe640 1 --2- 172.21.15.92:0/4202278218 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f93340a3450 0x7f93340a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:29.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.035+0000 7f9349d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f40af3060 0x559f40af5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59412/0 (socket says 172.21.15.92:59412) 2024-09-19T08:58:29.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.035+0000 7f9349d9b640 1 -- 172.21.15.92:0/2150914124 learned_addr learned my addr 172.21.15.92:0/2150914124 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:29.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.035+0000 7f934a59c640 1 --2- 172.21.15.92:0/2150914124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f40adfeb0 0x559f40af2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:29.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.035+0000 7f933b7fe640 1 -- 172.21.15.92:0/4202278218 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f933c0d39c0 con 0x7f934c1008d0 2024-09-19T08:58:29.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.035+0000 7f934ad9d640 1 --2- 172.21.15.92:0/4202278218 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f93340a3450 0x7f93340a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:29.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.036+0000 7f934a59c640 1 -- 172.21.15.92:0/2150914124 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f40adf590 msgr2=0x559f40adf970 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T08:58:29.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.036+0000 7f934a59c640 1 --2- 172.21.15.92:0/2150914124 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f40adf590 0x559f40adf970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:29.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.036+0000 7f934a59c640 1 -- 172.21.15.92:0/2150914124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f40af3060 msgr2=0x559f40af5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:29.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.036+0000 7f934a59c640 1 --2- 172.21.15.92:0/2150914124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f40af3060 0x559f40af5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:29.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.036+0000 7f934a59c640 1 -- 172.21.15.92:0/2150914124 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f409d1440 con 0x559f40adfeb0 2024-09-19T08:58:29.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.036+0000 7f934ad9d640 1 --2- 172.21.15.92:0/4202278218 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f93340a3450 0x7f93340a5910 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9344006010 tx=0x7f9344009860 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:29.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.036+0000 7f934a59c640 1 --2- 172.21.15.92:0/2150914124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f40adfeb0 0x559f40af2b20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f933c00c6a0 tx=0x7f933c005310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=532105c06d7e8703 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:29.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.036+0000 7f9338ff9640 1 -- 172.21.15.92:0/2150914124 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933c09fb90 con 0x559f40adfeb0 2024-09-19T08:58:29.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.036+0000 7f9338ff9640 1 -- 172.21.15.92:0/2150914124 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f933c0c0070 con 0x559f40adfeb0 2024-09-19T08:58:29.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.037+0000 7f9338ff9640 1 -- 172.21.15.92:0/2150914124 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933c00ce60 con 0x559f40adfeb0 2024-09-19T08:58:29.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.037+0000 7f9352ffd740 1 -- 172.21.15.92:0/2150914124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f40adfeb0 msgr2=0x559f40af2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:29.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.037+0000 7f9352ffd740 1 --2- 172.21.15.92:0/2150914124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f40adfeb0 0x559f40af2b20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f933c00c6a0 tx=0x7f933c005310 comp rx=0 tx=0).stop 2024-09-19T08:58:29.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.037+0000 7f9352ffd740 1 -- 172.21.15.92:0/2150914124 shutdown_connections 2024-09-19T08:58:29.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.037+0000 7f9352ffd740 1 --2- 172.21.15.92:0/2150914124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f40af3060 0x559f40af5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:29.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.037+0000 7f9352ffd740 1 --2- 172.21.15.92:0/2150914124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f40adfeb0 0x559f40af2b20 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:29.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.038+0000 7f9352ffd740 1 --2- 172.21.15.92:0/2150914124 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f40adf590 0x559f40adf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:29.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.038+0000 7f9352ffd740 1 -- 172.21.15.92:0/2150914124 >> 172.21.15.92:0/2150914124 conn(0x559f40adbc00 msgr2=0x559f40adbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:29.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.039+0000 7f9352ffd740 1 -- 172.21.15.92:0/2150914124 shutdown_connections 2024-09-19T08:58:29.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.039+0000 7f9352ffd740 1 -- 172.21.15.92:0/2150914124 wait complete. 2024-09-19T08:58:29.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.040+0000 7f9352ffd740 1 -- start start 2024-09-19T08:58:29.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.040+0000 7f9352ffd740 1 Processor -- start 2024-09-19T08:58:29.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.041+0000 7f9352ffd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f40adf590 0x559f40af2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:29.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.041+0000 7f9352ffd740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f40adfeb0 0x559f40aefd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:29.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.041+0000 7f9352ffd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f40af3060 0x559f40af0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:29.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.041+0000 7f9352ffd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559f40af5b60 con 0x559f40adf590 2024-09-19T08:58:29.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.041+0000 7f9352ffd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559f40a00050 con 0x559f40af3060 2024-09-19T08:58:29.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.041+0000 7f9352ffd740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x559f40af5ce0 con 0x559f40adfeb0 2024-09-19T08:58:29.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.041+0000 7f9352ffd740 10 client.0 _ll_register_callbacks cb 0x559f40a40160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:29.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.041+0000 7f9349d9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f40adfeb0 0x559f40aefd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:29.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.041+0000 7f9349d9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f40adfeb0 0x559f40aefd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:43370/0 (socket says 172.21.15.92:43370) 2024-09-19T08:58:29.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.041+0000 7f9349d9b640 1 -- 172.21.15.92:0/634698813 learned_addr learned my addr 172.21.15.92:0/634698813 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:29.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.041+0000 7f934a59c640 1 --2- 172.21.15.92:0/634698813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f40adf590 0x559f40af2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:29.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.041+0000 7f934ad9d640 1 --2- 172.21.15.92:0/634698813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f40af3060 0x559f40af0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:29.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.042+0000 7f9349d9b640 1 -- 172.21.15.92:0/634698813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f40af3060 msgr2=0x559f40af0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:29.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.042+0000 7f9349d9b640 1 --2- 172.21.15.92:0/634698813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f40af3060 0x559f40af0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:29.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.042+0000 7f9349d9b640 1 -- 172.21.15.92:0/634698813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f40adf590 msgr2=0x559f40af2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:29.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.042+0000 7f9349d9b640 1 --2- 172.21.15.92:0/634698813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f40adf590 0x559f40af2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:29.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.042+0000 7f9349d9b640 1 -- 172.21.15.92:0/634698813 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f407b63c0 con 0x559f40adfeb0 2024-09-19T08:58:29.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.042+0000 7f934ad9d640 1 --2- 172.21.15.92:0/634698813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f40af3060 0x559f40af0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:58:29.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.042+0000 7f9349d9b640 1 --2- 172.21.15.92:0/634698813 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f40adfeb0 0x559f40aefd70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f934000f680 tx=0x7f934000fb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80b52d97eab603db server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:29.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.042+0000 7f9331ffb640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T08:58:29.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.042+0000 7f9331ffb640 1 -- 172.21.15.92:0/634698813 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9340004250 con 0x559f40adfeb0 2024-09-19T08:58:29.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.042+0000 7f9331ffb640 1 -- 172.21.15.92:0/634698813 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f93400043f0 con 0x559f40adfeb0 2024-09-19T08:58:29.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.042+0000 7f9352ffd740 1 -- 172.21.15.92:0/634698813 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f933c0c0070 con 0x559f40adfeb0 2024-09-19T08:58:29.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.043+0000 7f9331ffb640 1 -- 172.21.15.92:0/634698813 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f934000c830 con 0x559f40adfeb0 2024-09-19T08:58:29.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.043+0000 7f9352ffd740 10 client.25204 fetch_fsmap learned FSMap version 19 2024-09-19T08:58:29.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.043+0000 7f9352ffd740 1 -- 172.21.15.92:0/634698813 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x559f40b01730 con 0x559f40adfeb0 2024-09-19T08:58:29.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.043+0000 7f9331ffb640 1 -- 172.21.15.92:0/634698813 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f933c0c0070 con 0x559f40adfeb0 2024-09-19T08:58:29.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.043+0000 7f9331ffb640 1 -- 172.21.15.92:0/634698813 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f9340019470 con 0x559f40adfeb0 2024-09-19T08:58:29.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.043+0000 7f9352ffd740 10 client.25204 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:58:29.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.043+0000 7f9352ffd740 10 client.25204 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:58:29.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.043+0000 7f9352ffd740 20 client.25204 populate_metadata read hostname 'smithi092' 2024-09-19T08:58:29.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.043+0000 7f9352ffd740 1 --2- 172.21.15.92:0/634698813 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559f40b02c40 0x559f40b05060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:29.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.043+0000 7f9352ffd740 4 client.25204 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:58:29.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.043+0000 7f9352ffd740 1 -- 172.21.15.92:0/634698813 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f40a52850 con 0x559f40b02c40 2024-09-19T08:58:29.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.044+0000 7f934a59c640 1 --2- 172.21.15.92:0/634698813 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559f40b02c40 0x559f40b05060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:29.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.044+0000 7f9331ffb640 10 client.25204 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:29.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.044+0000 7f934a59c640 1 --2- 172.21.15.92:0/634698813 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559f40b02c40 0x559f40b05060 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33b61da723d1bf9d server_cookie=86fcb65c56602099 in_seq=0 out_seq=0 2024-09-19T08:58:29.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.045+0000 7f9331ffb640 1 -- 172.21.15.92:0/634698813 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559f40a52850 con 0x559f40b02c40 2024-09-19T08:58:29.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.045+0000 7f9331ffb640 10 client.25204 handle_command_reply: tid=0 2024-09-19T08:58:29.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.045+0000 7f9352ffd740 1 client.25204 shutdown 2024-09-19T08:58:29.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.045+0000 7f9352ffd740 1 -- 172.21.15.92:0/634698813 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f40adfeb0 msgr2=0x559f40aefd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:29.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.045+0000 7f9352ffd740 1 --2- 172.21.15.92:0/634698813 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f40adfeb0 0x559f40aefd70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f934000f680 tx=0x7f934000fb40 comp rx=0 tx=0).stop 2024-09-19T08:58:29.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.046+0000 7f9352ffd740 1 -- 172.21.15.92:0/634698813 shutdown_connections 2024-09-19T08:58:29.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.046+0000 7f9352ffd740 1 --2- 172.21.15.92:0/634698813 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559f40b02c40 0x559f40b05060 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:29.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.046+0000 7f9352ffd740 1 --2- 172.21.15.92:0/634698813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f40af3060 0x559f40af0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:29.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.046+0000 7f9352ffd740 1 --2- 172.21.15.92:0/634698813 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f40adfeb0 0x559f40aefd70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:29.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.046+0000 7f9352ffd740 1 --2- 172.21.15.92:0/634698813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f40adf590 0x559f40af2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:29.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.046+0000 7f9352ffd740 1 -- 172.21.15.92:0/634698813 >> 172.21.15.92:0/634698813 conn(0x559f40adbc00 msgr2=0x559f40ae1870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:29.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.047+0000 7f9331ffb640 0 client.25204 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:29.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.047+0000 7f9352ffd740 1 -- 172.21.15.92:0/634698813 shutdown_connections 2024-09-19T08:58:29.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.047+0000 7f9352ffd740 1 -- 172.21.15.92:0/634698813 wait complete. 2024-09-19T08:58:29.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.047+0000 7f9352ffd740 20 client.25204 trim_cache size 0 max 16384 2024-09-19T08:58:29.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.079+0000 7f9352ffd740 1 Processor -- start 2024-09-19T08:58:29.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.079+0000 7f9352ffd740 1 -- start start 2024-09-19T08:58:29.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.079+0000 7f9352ffd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f40adf590 0x559f40b0a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:29.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.079+0000 7f9352ffd740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f40adfeb0 0x559f40b0ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:29.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.079+0000 7f9352ffd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f40af3060 0x559f40aeaac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:29.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.079+0000 7f9352ffd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f934c1a9240 con 0x559f40adf590 2024-09-19T08:58:29.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.079+0000 7f9352ffd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f934c1abae0 con 0x559f40af3060 2024-09-19T08:58:29.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.079+0000 7f9352ffd740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f934c1a98d0 con 0x559f40adfeb0 2024-09-19T08:58:29.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.080+0000 7f9349d9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f40adfeb0 0x559f40b0ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:29.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.080+0000 7f9349d9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f40adfeb0 0x559f40b0ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:43374/0 (socket says 172.21.15.92:43374) 2024-09-19T08:58:29.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.080+0000 7f9349d9b640 1 -- 172.21.15.92:0/2777173632 learned_addr learned my addr 172.21.15.92:0/2777173632 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:29.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.080+0000 7f934a59c640 1 --2- 172.21.15.92:0/2777173632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f40adf590 0x559f40b0a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:29.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.081+0000 7f9349d9b640 1 -- 172.21.15.92:0/2777173632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f40af3060 msgr2=0x559f40aeaac0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T08:58:29.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.081+0000 7f9349d9b640 1 --2- 172.21.15.92:0/2777173632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f40af3060 0x559f40aeaac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:29.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.081+0000 7f9349d9b640 1 -- 172.21.15.92:0/2777173632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f40adf590 msgr2=0x559f40b0a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:29.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.081+0000 7f9349d9b640 1 --2- 172.21.15.92:0/2777173632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f40adf590 0x559f40b0a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:29.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.081+0000 7f9349d9b640 1 -- 172.21.15.92:0/2777173632 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f40afee50 con 0x559f40adfeb0 2024-09-19T08:58:29.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.081+0000 7f9349d9b640 1 --2- 172.21.15.92:0/2777173632 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f40adfeb0 0x559f40b0ae30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9340001eb0 tx=0x7f9340009fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3832258c67b67d0e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:29.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.081+0000 7f9333fff640 1 -- 172.21.15.92:0/2777173632 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9340033070 con 0x559f40adfeb0 2024-09-19T08:58:29.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.081+0000 7f9333fff640 1 -- 172.21.15.92:0/2777173632 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f934001e070 con 0x559f40adfeb0 2024-09-19T08:58:29.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.081+0000 7f9333fff640 1 -- 172.21.15.92:0/2777173632 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93400035f0 con 0x559f40adfeb0 2024-09-19T08:58:29.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.082+0000 7f9352ffd740 1 -- 172.21.15.92:0/2777173632 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f40adfeb0 msgr2=0x559f40b0ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:29.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.082+0000 7f9352ffd740 1 --2- 172.21.15.92:0/2777173632 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f40adfeb0 0x559f40b0ae30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9340001eb0 tx=0x7f9340009fd0 comp rx=0 tx=0).stop 2024-09-19T08:58:29.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.083+0000 7f9352ffd740 1 -- 172.21.15.92:0/2777173632 shutdown_connections 2024-09-19T08:58:29.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.083+0000 7f9352ffd740 1 --2- 172.21.15.92:0/2777173632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f40af3060 0x559f40aeaac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:29.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.083+0000 7f9352ffd740 1 --2- 172.21.15.92:0/2777173632 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f40adfeb0 0x559f40b0ae30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:29.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.083+0000 7f9352ffd740 1 --2- 172.21.15.92:0/2777173632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f40adf590 0x559f40b0a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:29.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.083+0000 7f9352ffd740 1 -- 172.21.15.92:0/2777173632 >> 172.21.15.92:0/2777173632 conn(0x559f40adbc00 msgr2=0x559f40aeeea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:29.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.083+0000 7f9352ffd740 1 -- 172.21.15.92:0/2777173632 shutdown_connections 2024-09-19T08:58:29.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.083+0000 7f9352ffd740 1 -- 172.21.15.92:0/2777173632 wait complete. 2024-09-19T08:58:29.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.084+0000 7f9352ffd740 1 -- start start 2024-09-19T08:58:29.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.084+0000 7f9352ffd740 1 Processor -- start 2024-09-19T08:58:29.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.084+0000 7f9352ffd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f40adf590 0x559f40aece50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:29.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.084+0000 7f9352ffd740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f40adfeb0 0x559f40aed390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:29.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.085+0000 7f9352ffd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f40af3060 0x559f40aed8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:29.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.085+0000 7f9352ffd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f934c1a9fa0 con 0x559f40adf590 2024-09-19T08:58:29.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.085+0000 7f9352ffd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f934c1ab410 con 0x559f40af3060 2024-09-19T08:58:29.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.085+0000 7f9352ffd740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f934c1aa670 con 0x559f40adfeb0 2024-09-19T08:58:29.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.085+0000 7f9352ffd740 10 client.0 _ll_register_callbacks cb 0x7f9340009870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:29.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.085+0000 7f9349d9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f40adfeb0 0x559f40aed390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:29.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.085+0000 7f9349d9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f40adfeb0 0x559f40aed390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:43378/0 (socket says 172.21.15.92:43378) 2024-09-19T08:58:29.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.085+0000 7f9349d9b640 1 -- 172.21.15.92:0/1475862639 learned_addr learned my addr 172.21.15.92:0/1475862639 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:29.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.085+0000 7f934ad9d640 1 --2- 172.21.15.92:0/1475862639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f40af3060 0x559f40aed8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:29.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.085+0000 7f9349d9b640 1 -- 172.21.15.92:0/1475862639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f40af3060 msgr2=0x559f40aed8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:29.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.085+0000 7f9349d9b640 1 --2- 172.21.15.92:0/1475862639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f40af3060 0x559f40aed8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:29.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.085+0000 7f9349d9b640 1 -- 172.21.15.92:0/1475862639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f40adf590 msgr2=0x559f40aece50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:29.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.085+0000 7f9349d9b640 1 --2- 172.21.15.92:0/1475862639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f40adf590 0x559f40aece50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:29.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.085+0000 7f9349d9b640 1 -- 172.21.15.92:0/1475862639 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f40b6c970 con 0x559f40adfeb0 2024-09-19T08:58:29.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.087+0000 7f9349d9b640 1 --2- 172.21.15.92:0/1475862639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f40adfeb0 0x559f40aed390 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f934001a000 tx=0x7f9340005860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c6d02989fdacff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:29.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.087+0000 7f9331ffb640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T08:58:29.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.088+0000 7f9331ffb640 1 -- 172.21.15.92:0/1475862639 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9340033040 con 0x559f40adfeb0 2024-09-19T08:58:29.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.088+0000 7f9331ffb640 1 -- 172.21.15.92:0/1475862639 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f934000cbd0 con 0x559f40adfeb0 2024-09-19T08:58:29.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.088+0000 7f9352ffd740 1 -- 172.21.15.92:0/1475862639 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f934001e070 con 0x559f40adfeb0 2024-09-19T08:58:29.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.089+0000 7f9331ffb640 1 -- 172.21.15.92:0/1475862639 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f934000f410 con 0x559f40adfeb0 2024-09-19T08:58:29.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.089+0000 7f9352ffd740 10 client.25210 fetch_fsmap learned FSMap version 19 2024-09-19T08:58:29.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.089+0000 7f9352ffd740 1 -- 172.21.15.92:0/1475862639 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x559f40b6dc60 con 0x559f40adfeb0 2024-09-19T08:58:29.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.093+0000 7f9331ffb640 1 -- 172.21.15.92:0/1475862639 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f934000ce10 con 0x559f40adfeb0 2024-09-19T08:58:29.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.093+0000 7f9331ffb640 1 -- 172.21.15.92:0/1475862639 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f934002b040 con 0x559f40adfeb0 2024-09-19T08:58:29.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.093+0000 7f9352ffd740 10 client.25210 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:58:29.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.093+0000 7f9352ffd740 10 client.25210 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:58:29.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.093+0000 7f9352ffd740 20 client.25210 populate_metadata read hostname 'smithi092' 2024-09-19T08:58:29.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.093+0000 7f9352ffd740 1 --2- 172.21.15.92:0/1475862639 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559f40b6e310 0x559f40b70730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:29.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.093+0000 7f9352ffd740 4 client.25210 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:58:29.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.093+0000 7f9352ffd740 1 -- 172.21.15.92:0/1475862639 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f934001e070 con 0x559f40b6e310 2024-09-19T08:58:29.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.094+0000 7f934a59c640 1 --2- 172.21.15.92:0/1475862639 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559f40b6e310 0x559f40b70730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:29.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.095+0000 7f934a59c640 1 --2- 172.21.15.92:0/1475862639 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559f40b6e310 0x559f40b70730 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b76cdd89bad977e server_cookie=4b027d4e74d8b7bb in_seq=0 out_seq=0 2024-09-19T08:58:29.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.096+0000 7f9331ffb640 10 client.25210 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:29.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.096+0000 7f9331ffb640 1 -- 172.21.15.92:0/1475862639 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f934001e070 con 0x559f40b6e310 2024-09-19T08:58:29.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.096+0000 7f9331ffb640 10 client.25210 handle_command_reply: tid=0 2024-09-19T08:58:29.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.096+0000 7f9352ffd740 1 client.25210 shutdown 2024-09-19T08:58:29.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.102+0000 7f9352ffd740 1 -- 172.21.15.92:0/1475862639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f40adfeb0 msgr2=0x559f40aed390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:29.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.102+0000 7f9352ffd740 1 --2- 172.21.15.92:0/1475862639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f40adfeb0 0x559f40aed390 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f934001a000 tx=0x7f9340005860 comp rx=0 tx=0).stop 2024-09-19T08:58:29.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.103+0000 7f9352ffd740 1 -- 172.21.15.92:0/1475862639 shutdown_connections 2024-09-19T08:58:29.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.103+0000 7f9352ffd740 1 --2- 172.21.15.92:0/1475862639 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559f40b6e310 0x559f40b70730 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:29.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.103+0000 7f9352ffd740 1 --2- 172.21.15.92:0/1475862639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f40af3060 0x559f40aed8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:29.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.103+0000 7f9352ffd740 1 --2- 172.21.15.92:0/1475862639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f40adfeb0 0x559f40aed390 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:29.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.103+0000 7f9352ffd740 1 --2- 172.21.15.92:0/1475862639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f40adf590 0x559f40aece50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:29.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.103+0000 7f9352ffd740 1 -- 172.21.15.92:0/1475862639 >> 172.21.15.92:0/1475862639 conn(0x559f40adbc00 msgr2=0x559f40ada500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:29.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.103+0000 7f9331ffb640 0 client.25210 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:29.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.106+0000 7f9352ffd740 1 -- 172.21.15.92:0/1475862639 shutdown_connections 2024-09-19T08:58:29.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.106+0000 7f9352ffd740 1 -- 172.21.15.92:0/1475862639 wait complete. 2024-09-19T08:58:29.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.106+0000 7f9352ffd740 20 client.25210 trim_cache size 0 max 16384 2024-09-19T08:58:29.106 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T08:58:29.106 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-19T08:58:29.106 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {} 2024-09-19T08:58:29.106 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T08:58:29.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.107+0000 7f934b59e640 1 -- 172.21.15.92:0/4202278218 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f93340a3450 msgr2=0x7f93340a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:29.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.107+0000 7f934b59e640 1 --2- 172.21.15.92:0/4202278218 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f93340a3450 0x7f93340a5910 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9344006010 tx=0x7f9344009860 comp rx=0 tx=0).stop 2024-09-19T08:58:29.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.107+0000 7f934b59e640 1 -- 172.21.15.92:0/4202278218 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f934c1008d0 msgr2=0x7f934c1971f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:29.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.107+0000 7f934b59e640 1 --2- 172.21.15.92:0/4202278218 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f934c1008d0 0x7f934c1971f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f933c009e70 tx=0x7f933c00ed90 comp rx=0 tx=0).stop 2024-09-19T08:58:29.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.107+0000 7f934b59e640 1 -- 172.21.15.92:0/4202278218 shutdown_connections 2024-09-19T08:58:29.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.107+0000 7f934b59e640 1 --2- 172.21.15.92:0/4202278218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f934c1068d0 0x7f934c19bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:29.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.107+0000 7f934b59e640 1 --2- 172.21.15.92:0/4202278218 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f93340a3450 0x7f93340a5910 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:29.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.107+0000 7f934b59e640 1 --2- 172.21.15.92:0/4202278218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f934c101270 0x7f934c197730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:29.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.107+0000 7f934b59e640 1 --2- 172.21.15.92:0/4202278218 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f934c1008d0 0x7f934c1971f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:29.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.107+0000 7f934b59e640 1 -- 172.21.15.92:0/4202278218 >> 172.21.15.92:0/4202278218 conn(0x7f934c0fc630 msgr2=0x7f934c0fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:29.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.107+0000 7f934b59e640 1 -- 172.21.15.92:0/4202278218 shutdown_connections 2024-09-19T08:58:29.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:29.107+0000 7f934b59e640 1 -- 172.21.15.92:0/4202278218 wait complete. 2024-09-19T08:58:29.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:29 smithi092 ceph-mon[31407]: pgmap v390: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 13 MiB/s wr, 936 op/s 2024-09-19T08:58:29.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:29 smithi092 ceph-mon[31407]: scrub summary: idle 2024-09-19T08:58:29.779 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:58:29.780 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:58:29.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:29 smithi167 ceph-mon[35359]: pgmap v390: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 13 MiB/s wr, 936 op/s 2024-09-19T08:58:29.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:29 smithi167 ceph-mon[35359]: scrub summary: idle 2024-09-19T08:58:29.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:29 smithi190 ceph-mon[35358]: pgmap v390: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 13 MiB/s wr, 936 op/s 2024-09-19T08:58:29.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:29 smithi190 ceph-mon[35358]: scrub summary: idle 2024-09-19T08:58:30.215 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:58:30.256 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.255+0000 7f1850938640 1 -- 172.21.15.92:0/313201311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1844093ee0 msgr2=0x7f18440962f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:30.256 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.255+0000 7f1850938640 1 --2- 172.21.15.92:0/313201311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1844093ee0 0x7f18440962f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1840009900 tx=0x7f184002a420 comp rx=0 tx=0).stop 2024-09-19T08:58:30.256 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.256+0000 7f1850938640 1 -- 172.21.15.92:0/313201311 shutdown_connections 2024-09-19T08:58:30.256 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.256+0000 7f1850938640 1 --2- 172.21.15.92:0/313201311 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18440991e0 0x7f1844099690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.256 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.256+0000 7f1850938640 1 --2- 172.21.15.92:0/313201311 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1844096830 0x7f1844098ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.256 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.256+0000 7f1850938640 1 --2- 172.21.15.92:0/313201311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1844093ee0 0x7f18440962f0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.256 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.256+0000 7f1850938640 1 -- 172.21.15.92:0/313201311 >> 172.21.15.92:0/313201311 conn(0x7f184408fcb0 msgr2=0x7f1844092110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:30.256 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.256+0000 7f1850938640 1 -- 172.21.15.92:0/313201311 shutdown_connections 2024-09-19T08:58:30.257 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.256+0000 7f1850938640 1 -- 172.21.15.92:0/313201311 wait complete. 2024-09-19T08:58:30.257 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.257+0000 7f1850938640 1 Processor -- start 2024-09-19T08:58:30.257 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.258+0000 7f1850938640 1 -- start start 2024-09-19T08:58:30.259 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.258+0000 7f1850938640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1844093ee0 0x7f18441320d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:30.259 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.258+0000 7f1850938640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1844096830 0x7f1844132610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:30.259 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.258+0000 7f184b7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1844093ee0 0x7f18441320d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:30.259 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.259+0000 7f184b7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1844093ee0 0x7f18441320d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:43396/0 (socket says 172.21.15.92:43396) 2024-09-19T08:58:30.259 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.259+0000 7f184affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1844096830 0x7f1844132610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:30.259 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.259+0000 7f184affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1844096830 0x7f1844132610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:38842/0 (socket says 172.21.15.92:38842) 2024-09-19T08:58:30.259 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.259+0000 7f184b7fe640 1 -- 172.21.15.92:0/4292500190 learned_addr learned my addr 172.21.15.92:0/4292500190 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:30.259 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.259+0000 7f1850938640 1 --2- 172.21.15.92:0/4292500190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18440991e0 0x7f1844139680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:30.259 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.259+0000 7f1850938640 1 -- 172.21.15.92:0/4292500190 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f18440a79d0 con 0x7f18440991e0 2024-09-19T08:58:30.260 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.259+0000 7f1850938640 1 -- 172.21.15.92:0/4292500190 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f18440a7850 con 0x7f1844096830 2024-09-19T08:58:30.260 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.259+0000 7f1850938640 1 -- 172.21.15.92:0/4292500190 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f18440a7b50 con 0x7f1844093ee0 2024-09-19T08:58:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.260+0000 7f184bfff640 1 --2- 172.21.15.92:0/4292500190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18440991e0 0x7f1844139680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:30.262 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.260+0000 7f184affd640 1 -- 172.21.15.92:0/4292500190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1844093ee0 msgr2=0x7f18441320d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:30.262 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.260+0000 7f184affd640 1 --2- 172.21.15.92:0/4292500190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1844093ee0 0x7f18441320d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.262 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.260+0000 7f184affd640 1 -- 172.21.15.92:0/4292500190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18440991e0 msgr2=0x7f1844139680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:30.262 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.260+0000 7f184affd640 1 --2- 172.21.15.92:0/4292500190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18440991e0 0x7f1844139680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.262 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.260+0000 7f184affd640 1 -- 172.21.15.92:0/4292500190 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1844139cf0 con 0x7f1844096830 2024-09-19T08:58:30.262 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.261+0000 7f184b7fe640 1 --2- 172.21.15.92:0/4292500190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1844093ee0 0x7f18441320d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:58:30.262 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.261+0000 7f184affd640 1 --2- 172.21.15.92:0/4292500190 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1844096830 0x7f1844132610 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1838009fd0 tx=0x7f183800b870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:30.262 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.261+0000 7f1848ff9640 1 -- 172.21.15.92:0/4292500190 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1838015020 con 0x7f1844096830 2024-09-19T08:58:30.262 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.261+0000 7f1848ff9640 1 -- 172.21.15.92:0/4292500190 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1838011d10 con 0x7f1844096830 2024-09-19T08:58:30.262 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.261+0000 7f1848ff9640 1 -- 172.21.15.92:0/4292500190 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1838015020 con 0x7f1844096830 2024-09-19T08:58:30.262 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.261+0000 7f1850938640 1 -- 172.21.15.92:0/4292500190 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1844139fe0 con 0x7f1844096830 2024-09-19T08:58:30.263 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.263+0000 7f1850938640 1 -- 172.21.15.92:0/4292500190 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f184413a470 con 0x7f1844096830 2024-09-19T08:58:30.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.267+0000 7f1854a0e740 1 Processor -- start 2024-09-19T08:58:30.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.267+0000 7f1854a0e740 1 -- start start 2024-09-19T08:58:30.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.267+0000 7f1854a0e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f33ed8b70 0x559f33ed8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:30.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.267+0000 7f1854a0e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f33ed94b0 0x559f33eddf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:30.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.267+0000 7f1854a0e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f33ede540 0x559f33ee0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:30.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.267+0000 7f1854a0e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559f33e3c2f0 con 0x559f33ed94b0 2024-09-19T08:58:30.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.267+0000 7f1854a0e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559f33de4270 con 0x559f33ede540 2024-09-19T08:58:30.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.267+0000 7f1854a0e740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x559f33e382b0 con 0x559f33ed8b70 2024-09-19T08:58:30.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.268+0000 7f184bfff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f33ed8b70 0x559f33ed8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:30.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.268+0000 7f184bfff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f33ed8b70 0x559f33ed8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:43400/0 (socket says 172.21.15.92:43400) 2024-09-19T08:58:30.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.268+0000 7f184bfff640 1 -- 172.21.15.92:0/1456280802 learned_addr learned my addr 172.21.15.92:0/1456280802 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:30.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.268+0000 7f184bfff640 1 -- 172.21.15.92:0/1456280802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f33ede540 msgr2=0x559f33ee0a00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T08:58:30.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.268+0000 7f184bfff640 1 --2- 172.21.15.92:0/1456280802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f33ede540 0x559f33ee0a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.268+0000 7f184bfff640 1 -- 172.21.15.92:0/1456280802 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f33ed94b0 msgr2=0x559f33eddf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:30.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.268+0000 7f184b7fe640 1 --2- 172.21.15.92:0/1456280802 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f33ed94b0 0x559f33eddf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:30.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.268+0000 7f184bfff640 1 --2- 172.21.15.92:0/1456280802 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f33ed94b0 0x559f33eddf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.268+0000 7f184bfff640 1 -- 172.21.15.92:0/1456280802 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f33de3340 con 0x559f33ed8b70 2024-09-19T08:58:30.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.269+0000 7f184b7fe640 1 --2- 172.21.15.92:0/1456280802 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f33ed94b0 0x559f33eddf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:58:30.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.269+0000 7f184bfff640 1 --2- 172.21.15.92:0/1456280802 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f33ed8b70 0x559f33ed8f70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f184c051500 tx=0x7f184c075800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81c6d9db44f85af7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:30.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.270+0000 7f1835ffb640 1 -- 172.21.15.92:0/1456280802 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184c081420 con 0x559f33ed8b70 2024-09-19T08:58:30.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.270+0000 7f1848ff9640 1 -- 172.21.15.92:0/4292500190 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1838018020 con 0x7f1844096830 2024-09-19T08:58:30.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.270+0000 7f1835ffb640 1 -- 172.21.15.92:0/1456280802 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f184c081aa0 con 0x559f33ed8b70 2024-09-19T08:58:30.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.270+0000 7f1835ffb640 1 -- 172.21.15.92:0/1456280802 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184c080770 con 0x559f33ed8b70 2024-09-19T08:58:30.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.271+0000 7f1848ff9640 1 --2- 172.21.15.92:0/4292500190 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f183c0a3640 0x7f183c0a5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:30.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.272+0000 7f1848ff9640 1 -- 172.21.15.92:0/4292500190 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1838011630 con 0x7f1844096830 2024-09-19T08:58:30.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.272+0000 7f184b7fe640 1 --2- 172.21.15.92:0/4292500190 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f183c0a3640 0x7f183c0a5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:30.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.273+0000 7f1854a0e740 1 -- 172.21.15.92:0/1456280802 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f33ed8b70 msgr2=0x559f33ed8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:30.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.273+0000 7f1854a0e740 1 --2- 172.21.15.92:0/1456280802 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f33ed8b70 0x559f33ed8f70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f184c051500 tx=0x7f184c075800 comp rx=0 tx=0).stop 2024-09-19T08:58:30.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.273+0000 7f1854a0e740 1 -- 172.21.15.92:0/1456280802 shutdown_connections 2024-09-19T08:58:30.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.273+0000 7f1854a0e740 1 --2- 172.21.15.92:0/1456280802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f33ede540 0x559f33ee0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.273+0000 7f1854a0e740 1 --2- 172.21.15.92:0/1456280802 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f33ed94b0 0x559f33eddf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.273+0000 7f1854a0e740 1 --2- 172.21.15.92:0/1456280802 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f33ed8b70 0x559f33ed8f70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.273+0000 7f1854a0e740 1 -- 172.21.15.92:0/1456280802 >> 172.21.15.92:0/1456280802 conn(0x559f33ed41e0 msgr2=0x559f33ed45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:30.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.273+0000 7f184b7fe640 1 --2- 172.21.15.92:0/4292500190 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f183c0a3640 0x7f183c0a5b00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1840031440 tx=0x7f18400315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:30.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.274+0000 7f1854a0e740 1 -- 172.21.15.92:0/1456280802 shutdown_connections 2024-09-19T08:58:30.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.274+0000 7f1854a0e740 1 -- 172.21.15.92:0/1456280802 wait complete. 2024-09-19T08:58:30.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.274+0000 7f1854a0e740 1 -- start start 2024-09-19T08:58:30.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.274+0000 7f1854a0e740 1 Processor -- start 2024-09-19T08:58:30.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.275+0000 7f1854a0e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f33ed8b70 0x559f33ee2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:30.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.275+0000 7f1854a0e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f33ed94b0 0x559f33ee3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:30.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.275+0000 7f1854a0e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f33ede540 0x559f33eea340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:30.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.275+0000 7f1854a0e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559f33ee1510 con 0x559f33ed8b70 2024-09-19T08:58:30.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.275+0000 7f184bfff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f33ede540 0x559f33eea340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:30.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.276+0000 7f184b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f33ed8b70 0x559f33ee2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:30.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.276+0000 7f184bfff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f33ede540 0x559f33eea340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:43408/0 (socket says 172.21.15.92:43408) 2024-09-19T08:58:30.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.276+0000 7f184bfff640 1 -- 172.21.15.92:0/2245404979 learned_addr learned my addr 172.21.15.92:0/2245404979 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:30.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.276+0000 7f1854a0e740 1 -- 172.21.15.92:0/2245404979 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559f33dc5290 con 0x559f33ed94b0 2024-09-19T08:58:30.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.276+0000 7f1854a0e740 1 -- 172.21.15.92:0/2245404979 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x559f33ee1690 con 0x559f33ede540 2024-09-19T08:58:30.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.276+0000 7f184bfff640 1 -- 172.21.15.92:0/2245404979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f33ed94b0 msgr2=0x559f33ee3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:30.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.276+0000 7f184affd640 1 --2- 172.21.15.92:0/2245404979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f33ed94b0 0x559f33ee3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:30.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.276+0000 7f184bfff640 1 --2- 172.21.15.92:0/2245404979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f33ed94b0 0x559f33ee3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.276+0000 7f184bfff640 1 -- 172.21.15.92:0/2245404979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f33ed8b70 msgr2=0x559f33ee2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:30.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.276+0000 7f184bfff640 1 --2- 172.21.15.92:0/2245404979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f33ed8b70 0x559f33ee2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.276+0000 7f184bfff640 1 -- 172.21.15.92:0/2245404979 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f33b4f210 con 0x559f33ede540 2024-09-19T08:58:30.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.276+0000 7f1854a0e740 10 client.0 _ll_register_callbacks cb 0x559f33df6140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:30.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.276+0000 7f184bfff640 1 --2- 172.21.15.92:0/2245404979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f33ede540 0x559f33eea340 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f184c050a30 tx=0x7f184c080380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8683219bfc1ce09d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:30.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.277+0000 7f1854a0e740 1 -- 172.21.15.92:0/2245404979 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f184c081aa0 con 0x559f33ede540 2024-09-19T08:58:30.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.277+0000 7f184b7fe640 1 --2- 172.21.15.92:0/2245404979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f33ed8b70 0x559f33ee2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:58:30.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.277+0000 7f182affd640 10 client.25219 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T08:58:30.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.277+0000 7f182affd640 1 -- 172.21.15.92:0/2245404979 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184c08f030 con 0x559f33ede540 2024-09-19T08:58:30.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.277+0000 7f182affd640 1 -- 172.21.15.92:0/2245404979 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f184c07d070 con 0x559f33ede540 2024-09-19T08:58:30.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.278+0000 7f182affd640 1 -- 172.21.15.92:0/2245404979 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f184c081e10 con 0x559f33ede540 2024-09-19T08:58:30.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.278+0000 7f1854a0e740 10 client.25219 fetch_fsmap learned FSMap version 19 2024-09-19T08:58:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.278+0000 7f1854a0e740 1 -- 172.21.15.92:0/2245404979 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({fsmap=19}) -- 0x559f33c1b620 con 0x559f33ede540 2024-09-19T08:58:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.279+0000 7f182affd640 1 -- 172.21.15.92:0/2245404979 <== mon.1 v2:172.21.15.190:3300/0 4 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f184c081630 con 0x559f33ede540 2024-09-19T08:58:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.279+0000 7f1854a0e740 10 client.25219 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:58:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.279+0000 7f1854a0e740 10 client.25219 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T08:58:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.279+0000 7f1854a0e740 20 client.25219 populate_metadata read hostname 'smithi092' 2024-09-19T08:58:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.279+0000 7f1854a0e740 1 --2- 172.21.15.92:0/2245404979 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559f33eeec10 0x559f33ef10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.279+0000 7f1854a0e740 4 client.25219 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:58:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.279+0000 7f1854a0e740 1 -- 172.21.15.92:0/2245404979 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f184c081aa0 con 0x559f33eeec10 2024-09-19T08:58:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.280+0000 7f184b7fe640 1 --2- 172.21.15.92:0/2245404979 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559f33eeec10 0x559f33ef10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.281+0000 7f184b7fe640 1 --2- 172.21.15.92:0/2245404979 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559f33eeec10 0x559f33ef10d0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adbf9669c35c3668 server_cookie=3e8750115116dcff in_seq=0 out_seq=0 2024-09-19T08:58:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.281+0000 7f182affd640 10 client.25219 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.282+0000 7f182affd640 1 -- 172.21.15.92:0/2245404979 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f184c081aa0 con 0x559f33eeec10 2024-09-19T08:58:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.282+0000 7f182affd640 10 client.25219 handle_command_reply: tid=0 2024-09-19T08:58:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.282+0000 7f1854a0e740 1 client.25219 shutdown 2024-09-19T08:58:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.282+0000 7f1854a0e740 1 -- 172.21.15.92:0/2245404979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f33ede540 msgr2=0x559f33eea340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:30.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.282+0000 7f1854a0e740 1 --2- 172.21.15.92:0/2245404979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f33ede540 0x559f33eea340 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f184c050a30 tx=0x7f184c080380 comp rx=0 tx=0).stop 2024-09-19T08:58:30.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.283+0000 7f1854a0e740 1 -- 172.21.15.92:0/2245404979 shutdown_connections 2024-09-19T08:58:30.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.283+0000 7f1854a0e740 1 --2- 172.21.15.92:0/2245404979 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559f33eeec10 0x559f33ef10d0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.283+0000 7f1854a0e740 1 --2- 172.21.15.92:0/2245404979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f33ede540 0x559f33eea340 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.283+0000 7f1854a0e740 1 --2- 172.21.15.92:0/2245404979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f33ed94b0 0x559f33ee3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.283+0000 7f1854a0e740 1 --2- 172.21.15.92:0/2245404979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f33ed8b70 0x559f33ee2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.283+0000 7f1854a0e740 1 -- 172.21.15.92:0/2245404979 >> 172.21.15.92:0/2245404979 conn(0x559f33ed41e0 msgr2=0x559f33ed59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:30.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.283+0000 7f182affd640 0 client.25219 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:30.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.283+0000 7f1854a0e740 1 -- 172.21.15.92:0/2245404979 shutdown_connections 2024-09-19T08:58:30.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.283+0000 7f1854a0e740 1 -- 172.21.15.92:0/2245404979 wait complete. 2024-09-19T08:58:30.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.284+0000 7f1854a0e740 20 client.25219 trim_cache size 0 max 16384 2024-09-19T08:58:30.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.310+0000 7f1854a0e740 1 Processor -- start 2024-09-19T08:58:30.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.311+0000 7f1854a0e740 1 -- start start 2024-09-19T08:58:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.311+0000 7f1854a0e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f33ed8b70 0x559f33ed8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:30.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.311+0000 7f1854a0e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f33ed94b0 0x559f33eea260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:30.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.312+0000 7f184b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f33ed8b70 0x559f33ed8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:30.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.312+0000 7f184b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f33ed8b70 0x559f33ed8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59488/0 (socket says 172.21.15.92:59488) 2024-09-19T08:58:30.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.312+0000 7f184b7fe640 1 -- 172.21.15.92:0/2752101207 learned_addr learned my addr 172.21.15.92:0/2752101207 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:30.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.312+0000 7f1854a0e740 1 --2- 172.21.15.92:0/2752101207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f33ede540 0x559f33ee2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:30.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.312+0000 7f1854a0e740 1 -- 172.21.15.92:0/2752101207 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1844141340 con 0x559f33ed8b70 2024-09-19T08:58:30.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.312+0000 7f1854a0e740 1 -- 172.21.15.92:0/2752101207 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1844143be0 con 0x559f33ede540 2024-09-19T08:58:30.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.312+0000 7f1854a0e740 1 -- 172.21.15.92:0/2752101207 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f18441419d0 con 0x559f33ed94b0 2024-09-19T08:58:30.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.312+0000 7f184bfff640 1 --2- 172.21.15.92:0/2752101207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f33ede540 0x559f33ee2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:30.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.313+0000 7f184b7fe640 1 -- 172.21.15.92:0/2752101207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f33ed94b0 msgr2=0x559f33eea260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T08:58:30.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.313+0000 7f184b7fe640 1 --2- 172.21.15.92:0/2752101207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f33ed94b0 0x559f33eea260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.313+0000 7f184b7fe640 1 -- 172.21.15.92:0/2752101207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f33ede540 msgr2=0x559f33ee2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:30.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.313+0000 7f184b7fe640 1 --2- 172.21.15.92:0/2752101207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f33ede540 0x559f33ee2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.313+0000 7f184b7fe640 1 -- 172.21.15.92:0/2752101207 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f33ed4000 con 0x559f33ed8b70 2024-09-19T08:58:30.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.313+0000 7f184bfff640 1 --2- 172.21.15.92:0/2752101207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f33ede540 0x559f33ee2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:58:30.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.313+0000 7f184b7fe640 1 --2- 172.21.15.92:0/2752101207 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f33ed8b70 0x559f33ed8f50 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f1840051fd0 tx=0x7f1840041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca62fb62a743720f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:30.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.314+0000 7f18357fa640 1 -- 172.21.15.92:0/2752101207 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1840035040 con 0x559f33ed8b70 2024-09-19T08:58:30.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.314+0000 7f18357fa640 1 -- 172.21.15.92:0/2752101207 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1840057070 con 0x559f33ed8b70 2024-09-19T08:58:30.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.314+0000 7f18357fa640 1 -- 172.21.15.92:0/2752101207 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1840051cb0 con 0x559f33ed8b70 2024-09-19T08:58:30.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.315+0000 7f1854a0e740 1 -- 172.21.15.92:0/2752101207 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f33ed8b70 msgr2=0x559f33ed8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:30.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.315+0000 7f1854a0e740 1 --2- 172.21.15.92:0/2752101207 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f33ed8b70 0x559f33ed8f50 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f1840051fd0 tx=0x7f1840041000 comp rx=0 tx=0).stop 2024-09-19T08:58:30.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.315+0000 7f1854a0e740 1 -- 172.21.15.92:0/2752101207 shutdown_connections 2024-09-19T08:58:30.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.315+0000 7f1854a0e740 1 --2- 172.21.15.92:0/2752101207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f33ede540 0x559f33ee2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.315+0000 7f1854a0e740 1 --2- 172.21.15.92:0/2752101207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f33ed94b0 0x559f33eea260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.315+0000 7f1854a0e740 1 --2- 172.21.15.92:0/2752101207 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f33ed8b70 0x559f33ed8f50 secure :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f1840051fd0 tx=0x7f1840041000 comp rx=0 tx=0).stop 2024-09-19T08:58:30.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.315+0000 7f1854a0e740 1 -- 172.21.15.92:0/2752101207 >> 172.21.15.92:0/2752101207 conn(0x559f33ed41e0 msgr2=0x559f33eceed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:30.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.316+0000 7f1854a0e740 1 -- 172.21.15.92:0/2752101207 shutdown_connections 2024-09-19T08:58:30.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.316+0000 7f1854a0e740 1 -- 172.21.15.92:0/2752101207 wait complete. 2024-09-19T08:58:30.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.316+0000 7f1854a0e740 1 -- start start 2024-09-19T08:58:30.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.317+0000 7f1854a0e740 1 Processor -- start 2024-09-19T08:58:30.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.317+0000 7f1854a0e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f33ed94b0 0x559f33eea250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:30.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.317+0000 7f1854a0e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f33ede540 0x559f33ee6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:30.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.317+0000 7f1854a0e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f33ee7230 0x559f33f579a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:30.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.317+0000 7f1854a0e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f18441420a0 con 0x559f33ed94b0 2024-09-19T08:58:30.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.317+0000 7f1854a0e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1844143510 con 0x559f33ee7230 2024-09-19T08:58:30.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.317+0000 7f1854a0e740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1844142770 con 0x559f33ede540 2024-09-19T08:58:30.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.317+0000 7f1854a0e740 10 client.0 _ll_register_callbacks cb 0x7f184c050f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:30.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.317+0000 7f184b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f33ed94b0 0x559f33eea250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:30.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.318+0000 7f184affd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f33ede540 0x559f33ee6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:30.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.318+0000 7f184affd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f33ede540 0x559f33ee6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:43420/0 (socket says 172.21.15.92:43420) 2024-09-19T08:58:30.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.318+0000 7f184affd640 1 -- 172.21.15.92:0/4068397050 learned_addr learned my addr 172.21.15.92:0/4068397050 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:30.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.318+0000 7f184bfff640 1 --2- 172.21.15.92:0/4068397050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f33ee7230 0x559f33f579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:30.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.318+0000 7f184bfff640 1 -- 172.21.15.92:0/4068397050 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f33ede540 msgr2=0x559f33ee6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:30.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.318+0000 7f184bfff640 1 --2- 172.21.15.92:0/4068397050 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f33ede540 0x559f33ee6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.318+0000 7f184bfff640 1 -- 172.21.15.92:0/4068397050 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f33ed94b0 msgr2=0x559f33eea250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:30.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.318+0000 7f184bfff640 1 --2- 172.21.15.92:0/4068397050 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f33ed94b0 0x559f33eea250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.318+0000 7f184bfff640 1 -- 172.21.15.92:0/4068397050 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f33ee7860 con 0x559f33ee7230 2024-09-19T08:58:30.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.318+0000 7f184bfff640 1 --2- 172.21.15.92:0/4068397050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f33ee7230 0x559f33f579a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f184c065a40 tx=0x7f184c077040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d89d9c71c4a0fda3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.318+0000 7f182affd640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T08:58:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.319+0000 7f182affd640 1 -- 172.21.15.92:0/4068397050 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184c08f040 con 0x559f33ee7230 2024-09-19T08:58:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.319+0000 7f1854a0e740 1 -- 172.21.15.92:0/4068397050 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1840057070 con 0x559f33ee7230 2024-09-19T08:58:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.319+0000 7f182affd640 1 -- 172.21.15.92:0/4068397050 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f184c086040 con 0x559f33ee7230 2024-09-19T08:58:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.319+0000 7f182affd640 1 -- 172.21.15.92:0/4068397050 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f184c050520 con 0x559f33ee7230 2024-09-19T08:58:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.319+0000 7f1854a0e740 10 client.25238 fetch_fsmap learned FSMap version 19 2024-09-19T08:58:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.319+0000 7f1854a0e740 1 -- 172.21.15.92:0/4068397050 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x559f33f59010 con 0x559f33ee7230 2024-09-19T08:58:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.320+0000 7f182affd640 1 -- 172.21.15.92:0/4068397050 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1840057070 con 0x559f33ee7230 2024-09-19T08:58:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.320+0000 7f182affd640 1 -- 172.21.15.92:0/4068397050 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f184c08b820 con 0x559f33ee7230 2024-09-19T08:58:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.320+0000 7f1854a0e740 10 client.25238 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:58:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.320+0000 7f1854a0e740 10 client.25238 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T08:58:30.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.320+0000 7f1854a0e740 20 client.25238 populate_metadata read hostname 'smithi092' 2024-09-19T08:58:30.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.320+0000 7f1854a0e740 1 --2- 172.21.15.92:0/4068397050 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559f33f59950 0x559f33f5bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:30.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.320+0000 7f1854a0e740 4 client.25238 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:58:30.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.320+0000 7f1854a0e740 1 -- 172.21.15.92:0/4068397050 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559f33e49a20 con 0x559f33f59950 2024-09-19T08:58:30.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.321+0000 7f184b7fe640 1 --2- 172.21.15.92:0/4068397050 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559f33f59950 0x559f33f5bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:30.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.321+0000 7f182affd640 10 client.25238 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:30.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.321+0000 7f184b7fe640 1 --2- 172.21.15.92:0/4068397050 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559f33f59950 0x559f33f5bd70 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a280968ec64c604 server_cookie=86f8039c6d8c76ba in_seq=0 out_seq=0 2024-09-19T08:58:30.336 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.336+0000 7f182affd640 1 -- 172.21.15.92:0/4068397050 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559f33e49a20 con 0x559f33f59950 2024-09-19T08:58:30.336 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.336+0000 7f182affd640 10 client.25238 handle_command_reply: tid=0 2024-09-19T08:58:30.336 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.336+0000 7f1854a0e740 1 client.25238 shutdown 2024-09-19T08:58:30.338 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.338+0000 7f1854a0e740 1 -- 172.21.15.92:0/4068397050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f33ee7230 msgr2=0x559f33f579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:30.338 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.338+0000 7f1854a0e740 1 --2- 172.21.15.92:0/4068397050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f33ee7230 0x559f33f579a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f184c065a40 tx=0x7f184c077040 comp rx=0 tx=0).stop 2024-09-19T08:58:30.338 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.338+0000 7f1854a0e740 1 -- 172.21.15.92:0/4068397050 shutdown_connections 2024-09-19T08:58:30.338 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.338+0000 7f1854a0e740 1 --2- 172.21.15.92:0/4068397050 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559f33f59950 0x559f33f5bd70 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.338 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.338+0000 7f182affd640 0 client.25238 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:30.338 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.338+0000 7f1854a0e740 1 --2- 172.21.15.92:0/4068397050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559f33ee7230 0x559f33f579a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.339 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.338+0000 7f1854a0e740 1 --2- 172.21.15.92:0/4068397050 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559f33ede540 0x559f33ee6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.339 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.338+0000 7f1854a0e740 1 --2- 172.21.15.92:0/4068397050 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f33ed94b0 0x559f33eea250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.339 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.338+0000 7f1854a0e740 1 -- 172.21.15.92:0/4068397050 >> 172.21.15.92:0/4068397050 conn(0x559f33ed41e0 msgr2=0x559f33ee2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:30.339 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.338+0000 7f1854a0e740 1 -- 172.21.15.92:0/4068397050 shutdown_connections 2024-09-19T08:58:30.339 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.338+0000 7f1854a0e740 1 -- 172.21.15.92:0/4068397050 wait complete. 2024-09-19T08:58:30.339 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.338+0000 7f1854a0e740 20 client.25238 trim_cache size 0 max 16384 2024-09-19T08:58:30.339 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T08:58:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T08:58:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T08:58:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T08:58:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.341+0000 7f1850938640 1 -- 172.21.15.92:0/4292500190 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f183c0a3640 msgr2=0x7f183c0a5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:30.341 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.341+0000 7f1850938640 1 --2- 172.21.15.92:0/4292500190 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f183c0a3640 0x7f183c0a5b00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1840031440 tx=0x7f18400315b0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.341 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.341+0000 7f1850938640 1 -- 172.21.15.92:0/4292500190 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1844096830 msgr2=0x7f1844132610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:30.341 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.341+0000 7f1850938640 1 --2- 172.21.15.92:0/4292500190 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1844096830 0x7f1844132610 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1838009fd0 tx=0x7f183800b870 comp rx=0 tx=0).stop 2024-09-19T08:58:30.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.342+0000 7f1850938640 1 -- 172.21.15.92:0/4292500190 shutdown_connections 2024-09-19T08:58:30.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.342+0000 7f1850938640 1 --2- 172.21.15.92:0/4292500190 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f183c0a3640 0x7f183c0a5b00 secure :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1840031440 tx=0x7f18400315b0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.342+0000 7f1850938640 1 --2- 172.21.15.92:0/4292500190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18440991e0 0x7f1844139680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.342+0000 7f1850938640 1 --2- 172.21.15.92:0/4292500190 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1844096830 0x7f1844132610 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.342+0000 7f1850938640 1 --2- 172.21.15.92:0/4292500190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1844093ee0 0x7f18441320d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.342+0000 7f1850938640 1 -- 172.21.15.92:0/4292500190 >> 172.21.15.92:0/4292500190 conn(0x7f184408fcb0 msgr2=0x7f18440975f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:30.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.343+0000 7f1850938640 1 -- 172.21.15.92:0/4292500190 shutdown_connections 2024-09-19T08:58:30.344 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:30.343+0000 7f1850938640 1 -- 172.21.15.92:0/4292500190 wait complete. 2024-09-19T08:58:30.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.788+0000 7f13bd76e640 1 -- 172.21.15.92:0/897927484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13b8102ef0 msgr2=0x7f13b810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:30.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.788+0000 7f13bd76e640 1 --2- 172.21.15.92:0/897927484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13b8102ef0 0x7f13b810da40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f13b0009c10 tx=0x7f13b002a790 comp rx=0 tx=0).stop 2024-09-19T08:58:30.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.789+0000 7f13bd76e640 1 -- 172.21.15.92:0/897927484 shutdown_connections 2024-09-19T08:58:30.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.789+0000 7f13bd76e640 1 --2- 172.21.15.92:0/897927484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13b8102ef0 0x7f13b810da40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.789+0000 7f13bd76e640 1 --2- 172.21.15.92:0/897927484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13b8102570 0x7f13b81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.789+0000 7f13bd76e640 1 --2- 172.21.15.92:0/897927484 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13b8100e20 0x7f13b8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.789+0000 7f13bd76e640 1 -- 172.21.15.92:0/897927484 >> 172.21.15.92:0/897927484 conn(0x7f13b80fc7d0 msgr2=0x7f13b80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:30.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.789+0000 7f13bd76e640 1 -- 172.21.15.92:0/897927484 shutdown_connections 2024-09-19T08:58:30.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.789+0000 7f13bd76e640 1 -- 172.21.15.92:0/897927484 wait complete. 2024-09-19T08:58:30.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.790+0000 7f13bd76e640 1 Processor -- start 2024-09-19T08:58:30.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.790+0000 7f13bd76e640 1 -- start start 2024-09-19T08:58:30.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.791+0000 7f13bd76e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13b8100e20 0x7f13b8073a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:30.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.791+0000 7f13bd76e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13b8102570 0x7f13b806cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:30.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.791+0000 7f13bd76e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13b8102ef0 0x7f13b806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:30.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.791+0000 7f13bd76e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f13b810fe80 con 0x7f13b8100e20 2024-09-19T08:58:30.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.791+0000 7f13bd76e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f13b810fd00 con 0x7f13b8102570 2024-09-19T08:58:30.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.791+0000 7f13bd76e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f13b8110000 con 0x7f13b8102ef0 2024-09-19T08:58:30.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.791+0000 7f13b6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13b8100e20 0x7f13b8073a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:30.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.791+0000 7f13b6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13b8100e20 0x7f13b8073a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59530/0 (socket says 172.21.15.92:59530) 2024-09-19T08:58:30.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.791+0000 7f13b6ffd640 1 -- 172.21.15.92:0/400935570 learned_addr learned my addr 172.21.15.92:0/400935570 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:30.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.791+0000 7f13b67fc640 1 --2- 172.21.15.92:0/400935570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13b8102570 0x7f13b806cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:30.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.791+0000 7f13b77fe640 1 --2- 172.21.15.92:0/400935570 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13b8102ef0 0x7f13b806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:30.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.791+0000 7f13b67fc640 1 -- 172.21.15.92:0/400935570 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13b8102ef0 msgr2=0x7f13b806cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:30.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.791+0000 7f13b67fc640 1 --2- 172.21.15.92:0/400935570 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13b8102ef0 0x7f13b806cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.791+0000 7f13b67fc640 1 -- 172.21.15.92:0/400935570 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13b8100e20 msgr2=0x7f13b8073a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:30.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.791+0000 7f13b67fc640 1 --2- 172.21.15.92:0/400935570 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13b8100e20 0x7f13b8073a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.791+0000 7f13b67fc640 1 -- 172.21.15.92:0/400935570 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13b806d5e0 con 0x7f13b8102570 2024-09-19T08:58:30.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.792+0000 7f13b67fc640 1 --2- 172.21.15.92:0/400935570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13b8102570 0x7f13b806cab0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f13ac00e9f0 tx=0x7f13ac00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:30.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.792+0000 7f139ffff640 1 -- 172.21.15.92:0/400935570 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ac00ccc0 con 0x7f13b8102570 2024-09-19T08:58:30.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.792+0000 7f139ffff640 1 -- 172.21.15.92:0/400935570 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13ac010910 con 0x7f13b8102570 2024-09-19T08:58:30.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.792+0000 7f139ffff640 1 -- 172.21.15.92:0/400935570 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ac0189c0 con 0x7f13b8102570 2024-09-19T08:58:30.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.792+0000 7f13bd76e640 1 -- 172.21.15.92:0/400935570 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13b806d870 con 0x7f13b8102570 2024-09-19T08:58:30.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.792+0000 7f13bd76e640 1 -- 172.21.15.92:0/400935570 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13b80717e0 con 0x7f13b8102570 2024-09-19T08:58:30.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.794+0000 7f13bd76e640 1 -- 172.21.15.92:0/400935570 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13a4005290 con 0x7f13b8102570 2024-09-19T08:58:30.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 105.0 s, 5658.4 tps, lat 17.639 ms stddev 18.716 2024-09-19T08:58:30.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.795+0000 7f139ffff640 1 -- 172.21.15.92:0/400935570 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f13ac018b60 con 0x7f13b8102570 2024-09-19T08:58:30.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.795+0000 7f139ffff640 1 --2- 172.21.15.92:0/400935570 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f13a00a33d0 0x7f13a00a5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:30.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.796+0000 7f139ffff640 1 -- 172.21.15.92:0/400935570 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f13ac0cfcb0 con 0x7f13b8102570 2024-09-19T08:58:30.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.797+0000 7f13b6ffd640 1 --2- 172.21.15.92:0/400935570 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f13a00a33d0 0x7f13a00a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:30.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.797+0000 7f13b6ffd640 1 --2- 172.21.15.92:0/400935570 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f13a00a33d0 0x7f13a00a5890 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f13a8005c80 tx=0x7f13a8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:30.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:30.799+0000 7f139ffff640 1 -- 172.21.15.92:0/400935570 <== mon.2 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f13ac09ca50 con 0x7f13b8102570 2024-09-19T08:58:31.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:31.174+0000 7f13bd76e640 1 -- 172.21.15.92:0/400935570 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13a4005580 con 0x7f13b8102570 2024-09-19T08:58:31.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:31.175+0000 7f139ffff640 1 -- 172.21.15.92:0/400935570 <== mon.2 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f13ac09c350 con 0x7f13b8102570 2024-09-19T08:58:31.178 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:58:31.178 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T08:58:31.179 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T08:58:31.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:31.178+0000 7f13bd76e640 1 -- 172.21.15.92:0/400935570 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f13a00a33d0 msgr2=0x7f13a00a5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:31.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:31.178+0000 7f13bd76e640 1 --2- 172.21.15.92:0/400935570 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f13a00a33d0 0x7f13a00a5890 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f13a8005c80 tx=0x7f13a8009260 comp rx=0 tx=0).stop 2024-09-19T08:58:31.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:31.178+0000 7f13bd76e640 1 -- 172.21.15.92:0/400935570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13b8102570 msgr2=0x7f13b806cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:31.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:31.178+0000 7f13bd76e640 1 --2- 172.21.15.92:0/400935570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13b8102570 0x7f13b806cab0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f13ac00e9f0 tx=0x7f13ac00eeb0 comp rx=0 tx=0).stop 2024-09-19T08:58:31.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:31.178+0000 7f13bd76e640 1 -- 172.21.15.92:0/400935570 shutdown_connections 2024-09-19T08:58:31.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:31.178+0000 7f13bd76e640 1 --2- 172.21.15.92:0/400935570 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13b8102ef0 0x7f13b806cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:31.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:31.178+0000 7f13bd76e640 1 --2- 172.21.15.92:0/400935570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13b8102570 0x7f13b806cab0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:31.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:31.178+0000 7f13bd76e640 1 --2- 172.21.15.92:0/400935570 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f13a00a33d0 0x7f13a00a5890 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:31.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:31.178+0000 7f13bd76e640 1 --2- 172.21.15.92:0/400935570 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13b8100e20 0x7f13b8073a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:31.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:31.179+0000 7f13bd76e640 1 -- 172.21.15.92:0/400935570 >> 172.21.15.92:0/400935570 conn(0x7f13b80fc7d0 msgr2=0x7f13b81048c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:31.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:31.179+0000 7f13bd76e640 1 -- 172.21.15.92:0/400935570 shutdown_connections 2024-09-19T08:58:31.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:31.179+0000 7f13bd76e640 1 -- 172.21.15.92:0/400935570 wait complete. 2024-09-19T08:58:31.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:31 smithi092 ceph-mon[31407]: pgmap v391: 97 pgs: 97 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 16 MiB/s wr, 1.16k op/s 2024-09-19T08:58:31.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:31 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/400935570' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:58:31.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:31 smithi167 ceph-mon[35359]: pgmap v391: 97 pgs: 97 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 16 MiB/s wr, 1.16k op/s 2024-09-19T08:58:31.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:31 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/400935570' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:58:31.872 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:58:31.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:31 smithi190 ceph-mon[35358]: pgmap v391: 97 pgs: 97 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 16 MiB/s wr, 1.16k op/s 2024-09-19T08:58:31.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:31 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/400935570' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:58:32.375 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:58:32.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.980+0000 7f75bf59e640 1 -- 172.21.15.92:0/3152713221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75c0109730 msgr2=0x7f75c0109bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:32.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.980+0000 7f75bf59e640 1 --2- 172.21.15.92:0/3152713221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75c0109730 0x7f75c0109bb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f75b0009900 tx=0x7f75b002a400 comp rx=0 tx=0).stop 2024-09-19T08:58:32.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.980+0000 7f75bf59e640 1 -- 172.21.15.92:0/3152713221 shutdown_connections 2024-09-19T08:58:32.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.980+0000 7f75bf59e640 1 --2- 172.21.15.92:0/3152713221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75c0109730 0x7f75c0109bb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:32.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.980+0000 7f75bf59e640 1 --2- 172.21.15.92:0/3152713221 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f75c010f3f0 0x7f75c01091f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:32.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.980+0000 7f75bf59e640 1 --2- 172.21.15.92:0/3152713221 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75c010ead0 0x7f75c010eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:32.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.980+0000 7f75bf59e640 1 -- 172.21.15.92:0/3152713221 >> 172.21.15.92:0/3152713221 conn(0x7f75c0073180 msgr2=0x7f75c0073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:32.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.982+0000 7f75bf59e640 1 -- 172.21.15.92:0/3152713221 shutdown_connections 2024-09-19T08:58:32.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.982+0000 7f75bf59e640 1 -- 172.21.15.92:0/3152713221 wait complete. 2024-09-19T08:58:32.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.983+0000 7f75bf59e640 1 Processor -- start 2024-09-19T08:58:32.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.983+0000 7f75bf59e640 1 -- start start 2024-09-19T08:58:32.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.983+0000 7f75bf59e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75c0109730 0x7f75c011ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:32.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.983+0000 7f75bf59e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75c010ead0 0x7f75c0118af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:32.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.983+0000 7f75bf59e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f75c010f3f0 0x7f75c0119030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:32.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.983+0000 7f75bf59e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f75c011c850 con 0x7f75c0109730 2024-09-19T08:58:32.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.983+0000 7f75bf59e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f75c011c6d0 con 0x7f75c010ead0 2024-09-19T08:58:32.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.983+0000 7f75bf59e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f75c011c9d0 con 0x7f75c010f3f0 2024-09-19T08:58:32.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.984+0000 7f75bed9d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f75c010f3f0 0x7f75c0119030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:32.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.984+0000 7f75bed9d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f75c010f3f0 0x7f75c0119030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:43600/0 (socket says 172.21.15.92:43600) 2024-09-19T08:58:32.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.984+0000 7f75bed9d640 1 -- 172.21.15.92:0/1831822335 learned_addr learned my addr 172.21.15.92:0/1831822335 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:32.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.984+0000 7f75bdd9b640 1 --2- 172.21.15.92:0/1831822335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75c010ead0 0x7f75c0118af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:32.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.984+0000 7f75be59c640 1 --2- 172.21.15.92:0/1831822335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75c0109730 0x7f75c011ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:32.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.984+0000 7f75bed9d640 1 -- 172.21.15.92:0/1831822335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75c010ead0 msgr2=0x7f75c0118af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:32.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.984+0000 7f75bed9d640 1 --2- 172.21.15.92:0/1831822335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75c010ead0 0x7f75c0118af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:32.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.984+0000 7f75bed9d640 1 -- 172.21.15.92:0/1831822335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75c0109730 msgr2=0x7f75c011ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:32.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.984+0000 7f75bed9d640 1 --2- 172.21.15.92:0/1831822335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75c0109730 0x7f75c011ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:32.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.984+0000 7f75bed9d640 1 -- 172.21.15.92:0/1831822335 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c01198f0 con 0x7f75c010f3f0 2024-09-19T08:58:32.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.984+0000 7f75bed9d640 1 --2- 172.21.15.92:0/1831822335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f75c010f3f0 0x7f75c0119030 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f75b0006010 tx=0x7f75b0005dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:32.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.985+0000 7f75af7fe640 1 -- 172.21.15.92:0/1831822335 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b003f030 con 0x7f75c010f3f0 2024-09-19T08:58:32.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.985+0000 7f75bf59e640 1 -- 172.21.15.92:0/1831822335 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75c01a8d30 con 0x7f75c010f3f0 2024-09-19T08:58:32.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.985+0000 7f75af7fe640 1 -- 172.21.15.92:0/1831822335 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75b0003de0 con 0x7f75c010f3f0 2024-09-19T08:58:32.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.985+0000 7f75bf59e640 1 -- 172.21.15.92:0/1831822335 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75c01a92c0 con 0x7f75c010f3f0 2024-09-19T08:58:32.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.990+0000 7f75af7fe640 1 -- 172.21.15.92:0/1831822335 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b0035070 con 0x7f75c010f3f0 2024-09-19T08:58:32.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.990+0000 7f75af7fe640 1 -- 172.21.15.92:0/1831822335 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f75b0042030 con 0x7f75c010f3f0 2024-09-19T08:58:32.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.991+0000 7f75af7fe640 1 --2- 172.21.15.92:0/1831822335 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f75a80a3270 0x7f75a80a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:32.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.992+0000 7f75af7fe640 1 -- 172.21.15.92:0/1831822335 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f75b0003a00 con 0x7f75c010f3f0 2024-09-19T08:58:32.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.992+0000 7f75be59c640 1 --2- 172.21.15.92:0/1831822335 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f75a80a3270 0x7f75a80a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:32.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.993+0000 7f75c7287740 1 Processor -- start 2024-09-19T08:58:32.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.993+0000 7f75be59c640 1 --2- 172.21.15.92:0/1831822335 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f75a80a3270 0x7f75a80a5730 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009990 tx=0x7f75b4009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:32.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.993+0000 7f75c7287740 1 -- start start 2024-09-19T08:58:32.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.994+0000 7f75c7287740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55877d3adcf0 0x55877d3ac240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:32.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.994+0000 7f75c7287740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55877d3ac780 0x55877d3acbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:32.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.994+0000 7f75c7287740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55877d3b7520 0x55877d3b9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:32.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.994+0000 7f75c7287740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55877d3122f0 con 0x55877d3ac780 2024-09-19T08:58:32.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.994+0000 7f75c7287740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55877d2b9cf0 con 0x55877d3b7520 2024-09-19T08:58:32.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.994+0000 7f75c7287740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55877d30e2b0 con 0x55877d3adcf0 2024-09-19T08:58:32.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.994+0000 7f75be59c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55877d3adcf0 0x55877d3ac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:32.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.994+0000 7f75be59c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55877d3adcf0 0x55877d3ac240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:43602/0 (socket says 172.21.15.92:43602) 2024-09-19T08:58:32.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.994+0000 7f75be59c640 1 -- 172.21.15.92:0/672762492 learned_addr learned my addr 172.21.15.92:0/672762492 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:32.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.994+0000 7f75bed9d640 1 --2- 172.21.15.92:0/672762492 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55877d3b7520 0x55877d3b9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:32.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.994+0000 7f75bdd9b640 1 --2- 172.21.15.92:0/672762492 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55877d3ac780 0x55877d3acbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:32.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.994+0000 7f75be59c640 1 -- 172.21.15.92:0/672762492 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55877d3b7520 msgr2=0x55877d3b9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:32.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.994+0000 7f75be59c640 1 --2- 172.21.15.92:0/672762492 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55877d3b7520 0x55877d3b9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:32.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.994+0000 7f75be59c640 1 -- 172.21.15.92:0/672762492 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55877d3ac780 msgr2=0x55877d3acbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:32.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.994+0000 7f75be59c640 1 --2- 172.21.15.92:0/672762492 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55877d3ac780 0x55877d3acbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:32.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.994+0000 7f75be59c640 1 -- 172.21.15.92:0/672762492 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55877d29e3a0 con 0x55877d3adcf0 2024-09-19T08:58:32.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.995+0000 7f75be59c640 1 --2- 172.21.15.92:0/672762492 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55877d3adcf0 0x55877d3ac240 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009fd0 tx=0x7f75b4011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1fa9dd591399a26 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:32.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.995+0000 7f75acff9640 1 -- 172.21.15.92:0/672762492 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b401b040 con 0x55877d3adcf0 2024-09-19T08:58:32.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.995+0000 7f75acff9640 1 -- 172.21.15.92:0/672762492 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75b4024070 con 0x55877d3adcf0 2024-09-19T08:58:32.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.995+0000 7f75acff9640 1 -- 172.21.15.92:0/672762492 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b401f650 con 0x55877d3adcf0 2024-09-19T08:58:32.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.998+0000 7f75c7287740 1 -- 172.21.15.92:0/672762492 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55877d3adcf0 msgr2=0x55877d3ac240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:32.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.998+0000 7f75c7287740 1 --2- 172.21.15.92:0/672762492 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55877d3adcf0 0x55877d3ac240 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009fd0 tx=0x7f75b4011000 comp rx=0 tx=0).stop 2024-09-19T08:58:32.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.998+0000 7f75c7287740 1 -- 172.21.15.92:0/672762492 shutdown_connections 2024-09-19T08:58:32.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.998+0000 7f75c7287740 1 --2- 172.21.15.92:0/672762492 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55877d3b7520 0x55877d3b9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:32.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.998+0000 7f75c7287740 1 --2- 172.21.15.92:0/672762492 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55877d3ac780 0x55877d3acbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:32.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.998+0000 7f75c7287740 1 --2- 172.21.15.92:0/672762492 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55877d3adcf0 0x55877d3ac240 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:32.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.998+0000 7f75c7287740 1 -- 172.21.15.92:0/672762492 >> 172.21.15.92:0/672762492 conn(0x55877d375310 msgr2=0x55877d3a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:32.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:32.999+0000 7f75c7287740 1 -- 172.21.15.92:0/672762492 shutdown_connections 2024-09-19T08:58:33.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.001+0000 7f75c7287740 1 -- 172.21.15.92:0/672762492 wait complete. 2024-09-19T08:58:33.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.001+0000 7f75c7287740 1 -- start start 2024-09-19T08:58:33.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.001+0000 7f75c7287740 1 Processor -- start 2024-09-19T08:58:33.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.002+0000 7f75c7287740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55877d3ac780 0x55877d3b6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:33.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.002+0000 7f75c7287740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55877d3adcf0 0x55877d3b4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:33.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.002+0000 7f75c7287740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55877d3b7520 0x55877d3b4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:33.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.002+0000 7f75c7287740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55877d3ba220 con 0x55877d3b7520 2024-09-19T08:58:33.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.002+0000 7f75c7287740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55877d2cd060 con 0x55877d3adcf0 2024-09-19T08:58:33.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.002+0000 7f75c7287740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55877d3ba3a0 con 0x55877d3ac780 2024-09-19T08:58:33.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.002+0000 7f75c7287740 10 client.0 _ll_register_callbacks cb 0x55877d0208c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:33.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.002+0000 7f75bdd9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55877d3adcf0 0x55877d3b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:33.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.002+0000 7f75bdd9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55877d3adcf0 0x55877d3b4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:42012/0 (socket says 172.21.15.92:42012) 2024-09-19T08:58:33.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.002+0000 7f75bdd9b640 1 -- 172.21.15.92:0/2136234130 learned_addr learned my addr 172.21.15.92:0/2136234130 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:33.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.002+0000 7f75be59c640 1 --2- 172.21.15.92:0/2136234130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55877d3ac780 0x55877d3b6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:33.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.002+0000 7f75bed9d640 1 --2- 172.21.15.92:0/2136234130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55877d3b7520 0x55877d3b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:33.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.003+0000 7f75bdd9b640 1 -- 172.21.15.92:0/2136234130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55877d3ac780 msgr2=0x55877d3b6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:33.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.003+0000 7f75bdd9b640 1 --2- 172.21.15.92:0/2136234130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55877d3ac780 0x55877d3b6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.003+0000 7f75bdd9b640 1 -- 172.21.15.92:0/2136234130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55877d3b7520 msgr2=0x55877d3b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:33.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.003+0000 7f75bdd9b640 1 --2- 172.21.15.92:0/2136234130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55877d3b7520 0x55877d3b4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.003+0000 7f75bdd9b640 1 -- 172.21.15.92:0/2136234130 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55877d0833c0 con 0x55877d3adcf0 2024-09-19T08:58:33.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.003+0000 7f75bed9d640 1 --2- 172.21.15.92:0/2136234130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55877d3b7520 0x55877d3b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:58:33.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.003+0000 7f75bdd9b640 1 --2- 172.21.15.92:0/2136234130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55877d3adcf0 0x55877d3b4100 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f75b8012a10 tx=0x7f75b8012ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f259d7c50765f8ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:33.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.004+0000 7f75a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T08:58:33.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.004+0000 7f75a5ffb640 1 -- 172.21.15.92:0/2136234130 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b800f9e0 con 0x55877d3adcf0 2024-09-19T08:58:33.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.004+0000 7f75a5ffb640 1 -- 172.21.15.92:0/2136234130 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f75b800fb80 con 0x55877d3adcf0 2024-09-19T08:58:33.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.004+0000 7f75c7287740 1 -- 172.21.15.92:0/2136234130 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75b4024070 con 0x55877d3adcf0 2024-09-19T08:58:33.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.005+0000 7f75a5ffb640 1 -- 172.21.15.92:0/2136234130 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f75b800fd80 con 0x55877d3adcf0 2024-09-19T08:58:33.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.005+0000 7f75c7287740 10 client.25256 fetch_fsmap learned FSMap version 19 2024-09-19T08:58:33.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.005+0000 7f75c7287740 1 -- 172.21.15.92:0/2136234130 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55877d3c5cd0 con 0x55877d3adcf0 2024-09-19T08:58:33.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.005+0000 7f75a5ffb640 1 -- 172.21.15.92:0/2136234130 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75b4024070 con 0x55877d3adcf0 2024-09-19T08:58:33.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.006+0000 7f75a5ffb640 1 -- 172.21.15.92:0/2136234130 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f75b8010430 con 0x55877d3adcf0 2024-09-19T08:58:33.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.006+0000 7f75c7287740 10 client.25256 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:58:33.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.006+0000 7f75c7287740 10 client.25256 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:58:33.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.006+0000 7f75c7287740 20 client.25256 populate_metadata read hostname 'smithi092' 2024-09-19T08:58:33.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.006+0000 7f75c7287740 1 --2- 172.21.15.92:0/2136234130 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55877d3c70e0 0x55877d3c9500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:33.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.006+0000 7f75c7287740 4 client.25256 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:58:33.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.006+0000 7f75c7287740 1 -- 172.21.15.92:0/2136234130 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55877d31f860 con 0x55877d3c70e0 2024-09-19T08:58:33.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.006+0000 7f75be59c640 1 --2- 172.21.15.92:0/2136234130 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55877d3c70e0 0x55877d3c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:33.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.007+0000 7f75be59c640 1 --2- 172.21.15.92:0/2136234130 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55877d3c70e0 0x55877d3c9500 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed4bd9f26877dd3 server_cookie=8806422b85adba25 in_seq=0 out_seq=0 2024-09-19T08:58:33.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.007+0000 7f75a5ffb640 10 client.25256 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:33.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.008+0000 7f75a5ffb640 1 -- 172.21.15.92:0/2136234130 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55877d31f860 con 0x55877d3c70e0 2024-09-19T08:58:33.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.008+0000 7f75a5ffb640 10 client.25256 handle_command_reply: tid=0 2024-09-19T08:58:33.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.008+0000 7f75c7287740 1 client.25256 shutdown 2024-09-19T08:58:33.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.011+0000 7f75c7287740 1 -- 172.21.15.92:0/2136234130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55877d3adcf0 msgr2=0x55877d3b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:33.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.011+0000 7f75c7287740 1 --2- 172.21.15.92:0/2136234130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55877d3adcf0 0x55877d3b4100 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f75b8012a10 tx=0x7f75b8012ed0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.012+0000 7f75c7287740 1 -- 172.21.15.92:0/2136234130 shutdown_connections 2024-09-19T08:58:33.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.012+0000 7f75c7287740 1 --2- 172.21.15.92:0/2136234130 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55877d3c70e0 0x55877d3c9500 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.012+0000 7f75c7287740 1 --2- 172.21.15.92:0/2136234130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55877d3b7520 0x55877d3b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.012+0000 7f75c7287740 1 --2- 172.21.15.92:0/2136234130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55877d3adcf0 0x55877d3b4100 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.012+0000 7f75c7287740 1 --2- 172.21.15.92:0/2136234130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55877d3ac780 0x55877d3b6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.012+0000 7f75a5ffb640 0 client.25256 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:33.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.012+0000 7f75c7287740 1 -- 172.21.15.92:0/2136234130 >> 172.21.15.92:0/2136234130 conn(0x55877d375310 msgr2=0x55877d3aeae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:33.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.013+0000 7f75c7287740 1 -- 172.21.15.92:0/2136234130 shutdown_connections 2024-09-19T08:58:33.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.014+0000 7f75c7287740 1 -- 172.21.15.92:0/2136234130 wait complete. 2024-09-19T08:58:33.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.014+0000 7f75c7287740 20 client.25256 trim_cache size 0 max 16384 2024-09-19T08:58:33.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.039+0000 7f75c7287740 1 Processor -- start 2024-09-19T08:58:33.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.039+0000 7f75c7287740 1 -- start start 2024-09-19T08:58:33.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.040+0000 7f75c7287740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55877d3ac780 0x55877d3c3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:33.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.040+0000 7f75c7287740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55877d3adcf0 0x55877d3cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:33.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.040+0000 7f75c7287740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55877d3b7520 0x55877d3cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:33.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.040+0000 7f75c7287740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f75a000c470 con 0x55877d3ac780 2024-09-19T08:58:33.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.040+0000 7f75c7287740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f75a000ec40 con 0x55877d3b7520 2024-09-19T08:58:33.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.040+0000 7f75c7287740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f75a000ca30 con 0x55877d3adcf0 2024-09-19T08:58:33.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.040+0000 7f75bdd9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55877d3adcf0 0x55877d3cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:33.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.040+0000 7f75bdd9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55877d3adcf0 0x55877d3cedd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:43610/0 (socket says 172.21.15.92:43610) 2024-09-19T08:58:33.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.040+0000 7f75bdd9b640 1 -- 172.21.15.92:0/1130914877 learned_addr learned my addr 172.21.15.92:0/1130914877 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:33.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.040+0000 7f75be59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55877d3ac780 0x55877d3c3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:33.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.040+0000 7f75bed9d640 1 --2- 172.21.15.92:0/1130914877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55877d3b7520 0x55877d3cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:33.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.040+0000 7f75bdd9b640 1 -- 172.21.15.92:0/1130914877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55877d3b7520 msgr2=0x55877d3cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:33.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.040+0000 7f75bdd9b640 1 --2- 172.21.15.92:0/1130914877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55877d3b7520 0x55877d3cf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.040+0000 7f75bdd9b640 1 -- 172.21.15.92:0/1130914877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55877d3ac780 msgr2=0x55877d3c3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:33.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.040+0000 7f75bdd9b640 1 --2- 172.21.15.92:0/1130914877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55877d3ac780 0x55877d3c3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.040+0000 7f75bdd9b640 1 -- 172.21.15.92:0/1130914877 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55877d3af2d0 con 0x55877d3adcf0 2024-09-19T08:58:33.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.041+0000 7f75bdd9b640 1 --2- 172.21.15.92:0/1130914877 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55877d3adcf0 0x55877d3cedd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f75b80129e0 tx=0x7f75b80092a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81c2a8d61eaca081 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:33.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.041+0000 7f75a7fff640 1 -- 172.21.15.92:0/1130914877 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b8010430 con 0x55877d3adcf0 2024-09-19T08:58:33.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.041+0000 7f75a7fff640 1 -- 172.21.15.92:0/1130914877 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75b802b070 con 0x55877d3adcf0 2024-09-19T08:58:33.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.041+0000 7f75a7fff640 1 -- 172.21.15.92:0/1130914877 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b8010c70 con 0x55877d3adcf0 2024-09-19T08:58:33.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.042+0000 7f75c7287740 1 -- 172.21.15.92:0/1130914877 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55877d3adcf0 msgr2=0x55877d3cedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:33.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.042+0000 7f75c7287740 1 --2- 172.21.15.92:0/1130914877 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55877d3adcf0 0x55877d3cedd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f75b80129e0 tx=0x7f75b80092a0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.042+0000 7f75c7287740 1 -- 172.21.15.92:0/1130914877 shutdown_connections 2024-09-19T08:58:33.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.043+0000 7f75c7287740 1 --2- 172.21.15.92:0/1130914877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55877d3b7520 0x55877d3cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.043+0000 7f75c7287740 1 --2- 172.21.15.92:0/1130914877 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55877d3adcf0 0x55877d3cedd0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.043+0000 7f75c7287740 1 --2- 172.21.15.92:0/1130914877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55877d3ac780 0x55877d3c3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.043+0000 7f75c7287740 1 -- 172.21.15.92:0/1130914877 >> 172.21.15.92:0/1130914877 conn(0x55877d375310 msgr2=0x55877d3b40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:33.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.043+0000 7f75c7287740 1 -- 172.21.15.92:0/1130914877 shutdown_connections 2024-09-19T08:58:33.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.043+0000 7f75c7287740 1 -- 172.21.15.92:0/1130914877 wait complete. 2024-09-19T08:58:33.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.043+0000 7f75c7287740 1 -- start start 2024-09-19T08:58:33.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.043+0000 7f75c7287740 1 Processor -- start 2024-09-19T08:58:33.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.044+0000 7f75c7287740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55877d3ac780 0x55877d3b1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:33.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.044+0000 7f75c7287740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55877d3adcf0 0x55877d3b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:33.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.044+0000 7f75c7287740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55877d3b7520 0x55877d3b1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:33.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.044+0000 7f75bdd9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55877d3adcf0 0x55877d3b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:33.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.044+0000 7f75be59c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55877d3ac780 0x55877d3b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:33.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.044+0000 7f75bdd9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55877d3adcf0 0x55877d3b1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:42032/0 (socket says 172.21.15.92:42032) 2024-09-19T08:58:33.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.044+0000 7f75be59c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55877d3ac780 0x55877d3b1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:43622/0 (socket says 172.21.15.92:43622) 2024-09-19T08:58:33.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.044+0000 7f75c7287740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f75a000d100 con 0x55877d3b7520 2024-09-19T08:58:33.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.044+0000 7f75c7287740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f75a000e570 con 0x55877d3adcf0 2024-09-19T08:58:33.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.044+0000 7f75c7287740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f75a000d7d0 con 0x55877d3ac780 2024-09-19T08:58:33.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.044+0000 7f75bdd9b640 1 -- 172.21.15.92:0/3696901943 learned_addr learned my addr 172.21.15.92:0/3696901943 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:33.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.044+0000 7f75c7287740 10 client.0 _ll_register_callbacks cb 0x7f75b8009c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:33.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.044+0000 7f75bed9d640 1 --2- 172.21.15.92:0/3696901943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55877d3b7520 0x55877d3b1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:33.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.045+0000 7f75bed9d640 1 -- 172.21.15.92:0/3696901943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55877d3ac780 msgr2=0x55877d3b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:33.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.045+0000 7f75bed9d640 1 --2- 172.21.15.92:0/3696901943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55877d3ac780 0x55877d3b1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.045+0000 7f75bed9d640 1 -- 172.21.15.92:0/3696901943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55877d3adcf0 msgr2=0x55877d3b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:33.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.045+0000 7f75bed9d640 1 --2- 172.21.15.92:0/3696901943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55877d3adcf0 0x55877d3b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.045+0000 7f75bed9d640 1 -- 172.21.15.92:0/3696901943 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55877d430e70 con 0x55877d3b7520 2024-09-19T08:58:33.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.045+0000 7f75bed9d640 1 --2- 172.21.15.92:0/3696901943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55877d3b7520 0x55877d3b1c90 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f75b00ed8b0 tx=0x7f75b0003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22520a1f66e57076 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:33.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.045+0000 7f75a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:58:33.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.046+0000 7f75a5ffb640 1 -- 172.21.15.92:0/3696901943 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b0049040 con 0x55877d3b7520 2024-09-19T08:58:33.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.046+0000 7f75c7287740 1 -- 172.21.15.92:0/3696901943 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75b802b070 con 0x55877d3b7520 2024-09-19T08:58:33.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.046+0000 7f75a5ffb640 1 -- 172.21.15.92:0/3696901943 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f75b0031750 con 0x55877d3b7520 2024-09-19T08:58:33.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.046+0000 7f75a5ffb640 1 -- 172.21.15.92:0/3696901943 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f75b0031980 con 0x55877d3b7520 2024-09-19T08:58:33.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.046+0000 7f75c7287740 10 client.15831 fetch_fsmap learned FSMap version 19 2024-09-19T08:58:33.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.046+0000 7f75c7287740 1 -- 172.21.15.92:0/3696901943 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55877d432150 con 0x55877d3b7520 2024-09-19T08:58:33.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.047+0000 7f75a5ffb640 1 -- 172.21.15.92:0/3696901943 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75b802b070 con 0x55877d3b7520 2024-09-19T08:58:33.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.047+0000 7f75a5ffb640 1 -- 172.21.15.92:0/3696901943 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f75b004c060 con 0x55877d3b7520 2024-09-19T08:58:33.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.047+0000 7f75c7287740 10 client.15831 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:58:33.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.047+0000 7f75c7287740 10 client.15831 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:58:33.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.047+0000 7f75c7287740 20 client.15831 populate_metadata read hostname 'smithi092' 2024-09-19T08:58:33.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.047+0000 7f75c7287740 1 --2- 172.21.15.92:0/3696901943 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55877d4329e0 0x55877d434ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:33.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.047+0000 7f75c7287740 4 client.15831 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:58:33.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.047+0000 7f75c7287740 1 -- 172.21.15.92:0/3696901943 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55877d319d70 con 0x55877d4329e0 2024-09-19T08:58:33.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.048+0000 7f75be59c640 1 --2- 172.21.15.92:0/3696901943 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55877d4329e0 0x55877d434ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:33.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.048+0000 7f75a5ffb640 10 client.15831 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:33.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.049+0000 7f75be59c640 1 --2- 172.21.15.92:0/3696901943 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55877d4329e0 0x55877d434ea0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdf785f9331e88bc server_cookie=58269019b6e45689 in_seq=0 out_seq=0 2024-09-19T08:58:33.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.049+0000 7f75a5ffb640 1 -- 172.21.15.92:0/3696901943 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55877d319d70 con 0x55877d4329e0 2024-09-19T08:58:33.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.049+0000 7f75a5ffb640 10 client.15831 handle_command_reply: tid=0 2024-09-19T08:58:33.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.049+0000 7f75c7287740 1 client.15831 shutdown 2024-09-19T08:58:33.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.049+0000 7f75c7287740 1 -- 172.21.15.92:0/3696901943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55877d3b7520 msgr2=0x55877d3b1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:33.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.049+0000 7f75c7287740 1 --2- 172.21.15.92:0/3696901943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55877d3b7520 0x55877d3b1c90 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f75b00ed8b0 tx=0x7f75b0003f90 comp rx=0 tx=0).stop 2024-09-19T08:58:33.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.049+0000 7f75c7287740 1 -- 172.21.15.92:0/3696901943 shutdown_connections 2024-09-19T08:58:33.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.049+0000 7f75c7287740 1 --2- 172.21.15.92:0/3696901943 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55877d4329e0 0x55877d434ea0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.049+0000 7f75c7287740 1 --2- 172.21.15.92:0/3696901943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55877d3b7520 0x55877d3b1c90 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.049+0000 7f75c7287740 1 --2- 172.21.15.92:0/3696901943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55877d3adcf0 0x55877d3b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.049+0000 7f75c7287740 1 --2- 172.21.15.92:0/3696901943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55877d3ac780 0x55877d3b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.049+0000 7f75c7287740 1 -- 172.21.15.92:0/3696901943 >> 172.21.15.92:0/3696901943 conn(0x55877d375310 msgr2=0x55877d3b5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:33.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.050+0000 7f75a5ffb640 0 client.15831 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:33.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.050+0000 7f75c7287740 1 -- 172.21.15.92:0/3696901943 shutdown_connections 2024-09-19T08:58:33.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.050+0000 7f75c7287740 1 -- 172.21.15.92:0/3696901943 wait complete. 2024-09-19T08:58:33.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.050+0000 7f75c7287740 20 client.15831 trim_cache size 0 max 16384 2024-09-19T08:58:33.052 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-19T08:58:33.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.051+0000 7f75bf59e640 1 -- 172.21.15.92:0/1831822335 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f75a80a3270 msgr2=0x7f75a80a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:33.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.051+0000 7f75bf59e640 1 --2- 172.21.15.92:0/1831822335 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f75a80a3270 0x7f75a80a5730 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009990 tx=0x7f75b4009110 comp rx=0 tx=0).stop 2024-09-19T08:58:33.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.051+0000 7f75bf59e640 1 -- 172.21.15.92:0/1831822335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f75c010f3f0 msgr2=0x7f75c0119030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:33.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.051+0000 7f75bf59e640 1 --2- 172.21.15.92:0/1831822335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f75c010f3f0 0x7f75c0119030 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f75b0006010 tx=0x7f75b0005dc0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.051+0000 7f75bf59e640 1 -- 172.21.15.92:0/1831822335 shutdown_connections 2024-09-19T08:58:33.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.051+0000 7f75bf59e640 1 --2- 172.21.15.92:0/1831822335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f75c010f3f0 0x7f75c0119030 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.051+0000 7f75bf59e640 1 --2- 172.21.15.92:0/1831822335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75c010ead0 0x7f75c0118af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.051+0000 7f75bf59e640 1 --2- 172.21.15.92:0/1831822335 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f75a80a3270 0x7f75a80a5730 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.051+0000 7f75bf59e640 1 --2- 172.21.15.92:0/1831822335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75c0109730 0x7f75c011ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.051+0000 7f75bf59e640 1 -- 172.21.15.92:0/1831822335 >> 172.21.15.92:0/1831822335 conn(0x7f75c0073180 msgr2=0x7f75c010caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:33.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.051+0000 7f75bf59e640 1 -- 172.21.15.92:0/1831822335 shutdown_connections 2024-09-19T08:58:33.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:33.051+0000 7f75bf59e640 1 -- 172.21.15.92:0/1831822335 wait complete. 2024-09-19T08:58:33.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:33 smithi092 ceph-mon[31407]: pgmap v392: 97 pgs: 97 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 15 MiB/s wr, 1.13k op/s 2024-09-19T08:58:33.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:33 smithi167 ceph-mon[35359]: pgmap v392: 97 pgs: 97 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 15 MiB/s wr, 1.13k op/s 2024-09-19T08:58:33.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:33 smithi190 ceph-mon[35358]: pgmap v392: 97 pgs: 97 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 15 MiB/s wr, 1.13k op/s 2024-09-19T08:58:34.803 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:58:34.803 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:58:35.221 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:58:35.695 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:35 smithi092 ceph-mon[31407]: pgmap v393: 97 pgs: 97 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 16 MiB/s wr, 1.20k op/s 2024-09-19T08:58:35.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 110.0 s, 5501.2 tps, lat 18.233 ms stddev 19.381 2024-09-19T08:58:35.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.834+0000 7f19e26dc640 1 -- 172.21.15.92:0/1023737436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19dc109830 msgr2=0x7f19dc109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:35.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.834+0000 7f19e26dc640 1 --2- 172.21.15.92:0/1023737436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19dc109830 0x7f19dc109c90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f19cc009900 tx=0x7f19cc02a420 comp rx=0 tx=0).stop 2024-09-19T08:58:35.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.834+0000 7f19e26dc640 1 -- 172.21.15.92:0/1023737436 shutdown_connections 2024-09-19T08:58:35.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.834+0000 7f19e26dc640 1 --2- 172.21.15.92:0/1023737436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19dc11b140 0x7f19dc11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:35.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.834+0000 7f19e26dc640 1 --2- 172.21.15.92:0/1023737436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19dc109830 0x7f19dc109c90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:35.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.834+0000 7f19e26dc640 1 --2- 172.21.15.92:0/1023737436 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19dc109450 0x7f19dc110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:35.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.834+0000 7f19e26dc640 1 -- 172.21.15.92:0/1023737436 >> 172.21.15.92:0/1023737436 conn(0x7f19dc06e140 msgr2=0x7f19dc06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:35.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.834+0000 7f19e26dc640 1 -- 172.21.15.92:0/1023737436 shutdown_connections 2024-09-19T08:58:35.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.834+0000 7f19e26dc640 1 -- 172.21.15.92:0/1023737436 wait complete. 2024-09-19T08:58:35.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.835+0000 7f19e26dc640 1 Processor -- start 2024-09-19T08:58:35.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.835+0000 7f19e26dc640 1 -- start start 2024-09-19T08:58:35.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.836+0000 7f19e26dc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19dc109450 0x7f19dc1a72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:35.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.836+0000 7f19e26dc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19dc109830 0x7f19dc1a77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:35.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.836+0000 7f19e26dc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19dc11b140 0x7f19dc1abb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:35.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.836+0000 7f19e26dc640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f19dc120e30 con 0x7f19dc109450 2024-09-19T08:58:35.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.836+0000 7f19e26dc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f19dc120cb0 con 0x7f19dc109830 2024-09-19T08:58:35.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.836+0000 7f19e26dc640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f19dc120fb0 con 0x7f19dc11b140 2024-09-19T08:58:35.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.836+0000 7f19e0c79640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19dc11b140 0x7f19dc1abb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:35.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.836+0000 7f19e0c79640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19dc11b140 0x7f19dc1abb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:43640/0 (socket says 172.21.15.92:43640) 2024-09-19T08:58:35.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.836+0000 7f19e0c79640 1 -- 172.21.15.92:0/3218550476 learned_addr learned my addr 172.21.15.92:0/3218550476 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:35.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.836+0000 7f19db7fe640 1 --2- 172.21.15.92:0/3218550476 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19dc109830 0x7f19dc1a77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:35.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.836+0000 7f19dbfff640 1 --2- 172.21.15.92:0/3218550476 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19dc109450 0x7f19dc1a72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:35.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.837+0000 7f19e0c79640 1 -- 172.21.15.92:0/3218550476 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19dc109830 msgr2=0x7f19dc1a77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:35.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.837+0000 7f19e0c79640 1 --2- 172.21.15.92:0/3218550476 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19dc109830 0x7f19dc1a77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:35.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.837+0000 7f19e0c79640 1 -- 172.21.15.92:0/3218550476 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19dc109450 msgr2=0x7f19dc1a72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:35.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.837+0000 7f19e0c79640 1 --2- 172.21.15.92:0/3218550476 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19dc109450 0x7f19dc1a72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:35.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.837+0000 7f19e0c79640 1 -- 172.21.15.92:0/3218550476 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19dc1ac260 con 0x7f19dc11b140 2024-09-19T08:58:35.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.837+0000 7f19dbfff640 1 --2- 172.21.15.92:0/3218550476 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19dc109450 0x7f19dc1a72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:58:35.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.837+0000 7f19e0c79640 1 --2- 172.21.15.92:0/3218550476 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19dc11b140 0x7f19dc1abb80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f19d400e9f0 tx=0x7f19d400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:35.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.837+0000 7f19d97fa640 1 -- 172.21.15.92:0/3218550476 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d400cd80 con 0x7f19dc11b140 2024-09-19T08:58:35.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.837+0000 7f19d97fa640 1 -- 172.21.15.92:0/3218550476 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19d4005020 con 0x7f19dc11b140 2024-09-19T08:58:35.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.837+0000 7f19d97fa640 1 -- 172.21.15.92:0/3218550476 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d40116d0 con 0x7f19dc11b140 2024-09-19T08:58:35.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.837+0000 7f19e26dc640 1 -- 172.21.15.92:0/3218550476 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19dc1ac550 con 0x7f19dc11b140 2024-09-19T08:58:35.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.837+0000 7f19e26dc640 1 -- 172.21.15.92:0/3218550476 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19dc112930 con 0x7f19dc11b140 2024-09-19T08:58:35.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.842+0000 7f19e4ab5740 1 Processor -- start 2024-09-19T08:58:35.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.842+0000 7f19d97fa640 1 -- 172.21.15.92:0/3218550476 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f19d40051d0 con 0x7f19dc11b140 2024-09-19T08:58:35.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.842+0000 7f19e4ab5740 1 -- start start 2024-09-19T08:58:35.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.843+0000 7f19e4ab5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559da38eb60 0x5559da38ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:35.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.843+0000 7f19e4ab5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559da38f480 0x5559da399800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:35.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.843+0000 7f19e4ab5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559da399d40 0x5559da39c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:35.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.843+0000 7f19e4ab5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5559da2f4280 con 0x5559da38eb60 2024-09-19T08:58:35.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.843+0000 7f19e4ab5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5559da29bb10 con 0x5559da399d40 2024-09-19T08:58:35.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.843+0000 7f19e4ab5740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5559da2f0240 con 0x5559da38f480 2024-09-19T08:58:35.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.843+0000 7f19db7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559da399d40 0x5559da39c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:35.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.843+0000 7f19db7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559da399d40 0x5559da39c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:42056/0 (socket says 172.21.15.92:42056) 2024-09-19T08:58:35.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.843+0000 7f19db7fe640 1 -- 172.21.15.92:0/325883416 learned_addr learned my addr 172.21.15.92:0/325883416 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:35.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.843+0000 7f19dbfff640 1 --2- 172.21.15.92:0/325883416 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559da38f480 0x5559da399800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:35.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.843+0000 7f19db7fe640 1 -- 172.21.15.92:0/325883416 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559da38f480 msgr2=0x5559da399800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:35.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.843+0000 7f19db7fe640 1 --2- 172.21.15.92:0/325883416 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559da38f480 0x5559da399800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:35.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.843+0000 7f19db7fe640 1 -- 172.21.15.92:0/325883416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559da38eb60 msgr2=0x5559da38ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:35.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.843+0000 7f19db7fe640 1 --2- 172.21.15.92:0/325883416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559da38eb60 0x5559da38ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:35.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.843+0000 7f19db7fe640 1 -- 172.21.15.92:0/325883416 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559da2a81f0 con 0x5559da399d40 2024-09-19T08:58:35.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.844+0000 7f19db7fe640 1 --2- 172.21.15.92:0/325883416 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559da399d40 0x5559da39c130 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f19cc009900 tx=0x7f19cc004180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a662a58113379226 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:35.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.845+0000 7f19c27fc640 1 -- 172.21.15.92:0/325883416 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19cc035070 con 0x5559da399d40 2024-09-19T08:58:35.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.845+0000 7f19c27fc640 1 -- 172.21.15.92:0/325883416 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19cc041070 con 0x5559da399d40 2024-09-19T08:58:35.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.845+0000 7f19c27fc640 1 -- 172.21.15.92:0/325883416 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19cc0035f0 con 0x5559da399d40 2024-09-19T08:58:35.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.845+0000 7f19d97fa640 1 --2- 172.21.15.92:0/3218550476 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f19c40a32c0 0x7f19c40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:35.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.845+0000 7f19d97fa640 1 -- 172.21.15.92:0/3218550476 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f19d40cfb60 con 0x7f19dc11b140 2024-09-19T08:58:35.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.847+0000 7f19dbfff640 1 --2- 172.21.15.92:0/3218550476 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f19c40a32c0 0x7f19c40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:35.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.847+0000 7f19e4ab5740 1 -- 172.21.15.92:0/325883416 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559da399d40 msgr2=0x5559da39c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:35.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.847+0000 7f19e4ab5740 1 --2- 172.21.15.92:0/325883416 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559da399d40 0x5559da39c130 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f19cc009900 tx=0x7f19cc004180 comp rx=0 tx=0).stop 2024-09-19T08:58:35.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.847+0000 7f19e4ab5740 1 -- 172.21.15.92:0/325883416 shutdown_connections 2024-09-19T08:58:35.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.847+0000 7f19e4ab5740 1 --2- 172.21.15.92:0/325883416 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559da399d40 0x5559da39c130 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:35.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.847+0000 7f19e4ab5740 1 --2- 172.21.15.92:0/325883416 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559da38f480 0x5559da399800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:35.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.847+0000 7f19e4ab5740 1 --2- 172.21.15.92:0/325883416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559da38eb60 0x5559da38ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:35.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.847+0000 7f19e4ab5740 1 -- 172.21.15.92:0/325883416 >> 172.21.15.92:0/325883416 conn(0x5559da38b0f0 msgr2=0x5559da38b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:35.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.847+0000 7f19e4ab5740 1 -- 172.21.15.92:0/325883416 shutdown_connections 2024-09-19T08:58:35.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.847+0000 7f19e4ab5740 1 -- 172.21.15.92:0/325883416 wait complete. 2024-09-19T08:58:35.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.847+0000 7f19e4ab5740 1 -- start start 2024-09-19T08:58:35.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.848+0000 7f19e4ab5740 1 Processor -- start 2024-09-19T08:58:35.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.848+0000 7f19dbfff640 1 --2- 172.21.15.92:0/3218550476 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f19c40a32c0 0x7f19c40a5780 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f19d0006fd0 tx=0x7f19d0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:35.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.848+0000 7f19e4ab5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559da38eb60 0x5559da396ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:35.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.849+0000 7f19e4ab5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559da38f480 0x5559da397220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:35.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.849+0000 7f19e4ab5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559da399d40 0x5559da397760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:35.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.849+0000 7f19e4ab5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5559da39c910 con 0x5559da38f480 2024-09-19T08:58:35.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.849+0000 7f19e4ab5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5559da2aef10 con 0x5559da38eb60 2024-09-19T08:58:35.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.849+0000 7f19e4ab5740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5559da39ca90 con 0x5559da399d40 2024-09-19T08:58:35.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.849+0000 7f19e4ab5740 10 client.0 _ll_register_callbacks cb 0x5559da277a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:35.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.849+0000 7f19db7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559da38f480 0x5559da397220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:35.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.849+0000 7f19db7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559da38f480 0x5559da397220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36540/0 (socket says 172.21.15.92:36540) 2024-09-19T08:58:35.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.849+0000 7f19db7fe640 1 -- 172.21.15.92:0/1598265025 learned_addr learned my addr 172.21.15.92:0/1598265025 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:35.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.849+0000 7f19dbfff640 1 --2- 172.21.15.92:0/1598265025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559da38eb60 0x5559da396ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:35.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.849+0000 7f19e0c79640 1 --2- 172.21.15.92:0/1598265025 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559da399d40 0x5559da397760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:35.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.849+0000 7f19e0c79640 1 -- 172.21.15.92:0/1598265025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559da38eb60 msgr2=0x5559da396ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:35.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.849+0000 7f19e0c79640 1 --2- 172.21.15.92:0/1598265025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559da38eb60 0x5559da396ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:35.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.849+0000 7f19e0c79640 1 -- 172.21.15.92:0/1598265025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559da38f480 msgr2=0x5559da397220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:35.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.849+0000 7f19e0c79640 1 --2- 172.21.15.92:0/1598265025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559da38f480 0x5559da397220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:35.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.849+0000 7f19e0c79640 1 -- 172.21.15.92:0/1598265025 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559da0656a0 con 0x5559da399d40 2024-09-19T08:58:35.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.849+0000 7f19dbfff640 1 --2- 172.21.15.92:0/1598265025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559da38eb60 0x5559da396ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:58:35.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.850+0000 7f19e0c79640 1 --2- 172.21.15.92:0/1598265025 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559da399d40 0x5559da397760 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f19d40cd630 tx=0x7f19d409c240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd554caf60e8c8a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:35.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.850+0000 7f19bb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T08:58:35.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.850+0000 7f19bb7fe640 1 -- 172.21.15.92:0/1598265025 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d401f030 con 0x5559da399d40 2024-09-19T08:58:35.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.850+0000 7f19bb7fe640 1 -- 172.21.15.92:0/1598265025 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f19d40987f0 con 0x5559da399d40 2024-09-19T08:58:35.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.850+0000 7f19e4ab5740 1 -- 172.21.15.92:0/1598265025 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19cc041070 con 0x5559da399d40 2024-09-19T08:58:35.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.850+0000 7f19bb7fe640 1 -- 172.21.15.92:0/1598265025 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f19d40bc070 con 0x5559da399d40 2024-09-19T08:58:35.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.851+0000 7f19e4ab5740 10 client.25252 fetch_fsmap learned FSMap version 19 2024-09-19T08:58:35.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.851+0000 7f19e4ab5740 1 -- 172.21.15.92:0/1598265025 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5559da3a8680 con 0x5559da399d40 2024-09-19T08:58:35.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.851+0000 7f19bb7fe640 1 -- 172.21.15.92:0/1598265025 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19cc041070 con 0x5559da399d40 2024-09-19T08:58:35.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:35 smithi167 ceph-mon[35359]: pgmap v393: 97 pgs: 97 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 16 MiB/s wr, 1.20k op/s 2024-09-19T08:58:35.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.851+0000 7f19bb7fe640 1 -- 172.21.15.92:0/1598265025 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f19d400f040 con 0x5559da399d40 2024-09-19T08:58:35.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.851+0000 7f19e4ab5740 10 client.25252 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:58:35.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.851+0000 7f19e4ab5740 10 client.25252 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:58:35.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.851+0000 7f19e4ab5740 20 client.25252 populate_metadata read hostname 'smithi092' 2024-09-19T08:58:35.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.851+0000 7f19e4ab5740 1 --2- 172.21.15.92:0/1598265025 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5559da3a9b40 0x5559da3abf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:35.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.851+0000 7f19e4ab5740 4 client.25252 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:58:35.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.851+0000 7f19e4ab5740 1 -- 172.21.15.92:0/1598265025 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5559da3017f0 con 0x5559da3a9b40 2024-09-19T08:58:35.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.852+0000 7f19dbfff640 1 --2- 172.21.15.92:0/1598265025 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5559da3a9b40 0x5559da3abf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:35.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.854+0000 7f19dbfff640 1 --2- 172.21.15.92:0/1598265025 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5559da3a9b40 0x5559da3abf30 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f31ef73d1f95e3f server_cookie=c8ebebe4cdeb7c22 in_seq=0 out_seq=0 2024-09-19T08:58:35.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.854+0000 7f19bb7fe640 10 client.25252 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:35.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.854+0000 7f19bb7fe640 1 -- 172.21.15.92:0/1598265025 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5559da3017f0 con 0x5559da3a9b40 2024-09-19T08:58:35.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.855+0000 7f19bb7fe640 10 client.25252 handle_command_reply: tid=0 2024-09-19T08:58:35.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.855+0000 7f19e4ab5740 1 client.25252 shutdown 2024-09-19T08:58:35.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.855+0000 7f19e4ab5740 1 -- 172.21.15.92:0/1598265025 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559da399d40 msgr2=0x5559da397760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:35.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.855+0000 7f19e4ab5740 1 --2- 172.21.15.92:0/1598265025 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559da399d40 0x5559da397760 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f19d40cd630 tx=0x7f19d409c240 comp rx=0 tx=0).stop 2024-09-19T08:58:35.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.855+0000 7f19e4ab5740 1 -- 172.21.15.92:0/1598265025 shutdown_connections 2024-09-19T08:58:35.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.855+0000 7f19e4ab5740 1 --2- 172.21.15.92:0/1598265025 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5559da3a9b40 0x5559da3abf30 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:35.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.855+0000 7f19e4ab5740 1 --2- 172.21.15.92:0/1598265025 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559da399d40 0x5559da397760 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:35.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.855+0000 7f19e4ab5740 1 --2- 172.21.15.92:0/1598265025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559da38f480 0x5559da397220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:35.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.855+0000 7f19e4ab5740 1 --2- 172.21.15.92:0/1598265025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559da38eb60 0x5559da396ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:35.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.855+0000 7f19e4ab5740 1 -- 172.21.15.92:0/1598265025 >> 172.21.15.92:0/1598265025 conn(0x5559da38b0f0 msgr2=0x5559da390e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:35.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.856+0000 7f19bb7fe640 0 client.25252 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:35.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.856+0000 7f19e4ab5740 1 -- 172.21.15.92:0/1598265025 shutdown_connections 2024-09-19T08:58:35.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.856+0000 7f19e4ab5740 1 -- 172.21.15.92:0/1598265025 wait complete. 2024-09-19T08:58:35.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.856+0000 7f19e4ab5740 20 client.25252 trim_cache size 0 max 16384 2024-09-19T08:58:35.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:35 smithi190 ceph-mon[35358]: pgmap v393: 97 pgs: 97 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 16 MiB/s wr, 1.20k op/s 2024-09-19T08:58:35.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.892+0000 7f19e4ab5740 1 Processor -- start 2024-09-19T08:58:35.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.894+0000 7f19e4ab5740 1 -- start start 2024-09-19T08:58:35.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.894+0000 7f19e4ab5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559da38eb60 0x5559da3b1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:35.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.894+0000 7f19e4ab5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559da38f480 0x5559da3b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:35.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.894+0000 7f19e4ab5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559da399d40 0x5559da393f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:35.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.895+0000 7f19e4ab5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f19dc118eb0 con 0x5559da38f480 2024-09-19T08:58:35.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.895+0000 7f19e4ab5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f19dc1c5450 con 0x5559da399d40 2024-09-19T08:58:35.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.895+0000 7f19e4ab5740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f19dc1c3240 con 0x5559da38eb60 2024-09-19T08:58:35.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.895+0000 7f19dbfff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559da38eb60 0x5559da3b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:35.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.895+0000 7f19dbfff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559da38eb60 0x5559da3b1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:43666/0 (socket says 172.21.15.92:43666) 2024-09-19T08:58:35.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.895+0000 7f19dbfff640 1 -- 172.21.15.92:0/3919454343 learned_addr learned my addr 172.21.15.92:0/3919454343 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:35.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.895+0000 7f19e0c79640 1 --2- 172.21.15.92:0/3919454343 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559da399d40 0x5559da393f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:35.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.896+0000 7f19e0c79640 1 -- 172.21.15.92:0/3919454343 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559da38eb60 msgr2=0x5559da3b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:35.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.896+0000 7f19e0c79640 1 --2- 172.21.15.92:0/3919454343 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559da38eb60 0x5559da3b1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:35.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.896+0000 7f19e0c79640 1 -- 172.21.15.92:0/3919454343 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559da38f480 msgr2=0x5559da3b1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:35.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.896+0000 7f19e0c79640 1 --2- 172.21.15.92:0/3919454343 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559da38f480 0x5559da3b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:35.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.896+0000 7f19e0c79640 1 -- 172.21.15.92:0/3919454343 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559da39c7f0 con 0x5559da399d40 2024-09-19T08:58:35.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.898+0000 7f19e0c79640 1 --2- 172.21.15.92:0/3919454343 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559da399d40 0x5559da393f80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f19d400c640 tx=0x7f19d40a4f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=446e028313170fa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:35.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.899+0000 7f19c1ffb640 1 -- 172.21.15.92:0/3919454343 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d401f070 con 0x5559da399d40 2024-09-19T08:58:35.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.899+0000 7f19c1ffb640 1 -- 172.21.15.92:0/3919454343 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19d40a0530 con 0x5559da399d40 2024-09-19T08:58:35.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.899+0000 7f19c1ffb640 1 -- 172.21.15.92:0/3919454343 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d409b040 con 0x5559da399d40 2024-09-19T08:58:35.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.900+0000 7f19e4ab5740 1 -- 172.21.15.92:0/3919454343 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559da399d40 msgr2=0x5559da393f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:35.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.901+0000 7f19e4ab5740 1 --2- 172.21.15.92:0/3919454343 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559da399d40 0x5559da393f80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f19d400c640 tx=0x7f19d40a4f70 comp rx=0 tx=0).stop 2024-09-19T08:58:35.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.901+0000 7f19e4ab5740 1 -- 172.21.15.92:0/3919454343 shutdown_connections 2024-09-19T08:58:35.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.901+0000 7f19e4ab5740 1 --2- 172.21.15.92:0/3919454343 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559da399d40 0x5559da393f80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:35.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.901+0000 7f19e4ab5740 1 --2- 172.21.15.92:0/3919454343 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559da38f480 0x5559da3b1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:35.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.901+0000 7f19e4ab5740 1 --2- 172.21.15.92:0/3919454343 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559da38eb60 0x5559da3b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:35.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.901+0000 7f19e4ab5740 1 -- 172.21.15.92:0/3919454343 >> 172.21.15.92:0/3919454343 conn(0x5559da38b0f0 msgr2=0x5559da398c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:35.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.902+0000 7f19e4ab5740 1 -- 172.21.15.92:0/3919454343 shutdown_connections 2024-09-19T08:58:35.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.902+0000 7f19e4ab5740 1 -- 172.21.15.92:0/3919454343 wait complete. 2024-09-19T08:58:35.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.902+0000 7f19e4ab5740 1 -- start start 2024-09-19T08:58:35.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.903+0000 7f19e4ab5740 1 Processor -- start 2024-09-19T08:58:35.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.903+0000 7f19e4ab5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559da38eb60 0x5559da3a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:35.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.903+0000 7f19e4ab5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559da38f480 0x5559da3a2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:35.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.903+0000 7f19e4ab5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559da399d40 0x5559da39ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:35.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.903+0000 7f19e4ab5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f19dc1c3910 con 0x5559da38eb60 2024-09-19T08:58:35.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.903+0000 7f19e4ab5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f19dc1c4d80 con 0x5559da399d40 2024-09-19T08:58:35.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.903+0000 7f19e4ab5740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f19dc1c3fe0 con 0x5559da38f480 2024-09-19T08:58:35.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.903+0000 7f19e4ab5740 10 client.0 _ll_register_callbacks cb 0x7f19d40984a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:35.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.906+0000 7f19db7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559da38f480 0x5559da3a2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:35.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.906+0000 7f19e0c79640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559da399d40 0x5559da39ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:35.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.906+0000 7f19e0c79640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559da399d40 0x5559da39ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:42072/0 (socket says 172.21.15.92:42072) 2024-09-19T08:58:35.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.906+0000 7f19e0c79640 1 -- 172.21.15.92:0/3444506677 learned_addr learned my addr 172.21.15.92:0/3444506677 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:35.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.906+0000 7f19dbfff640 1 --2- 172.21.15.92:0/3444506677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559da38eb60 0x5559da3a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:35.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.907+0000 7f19dbfff640 1 -- 172.21.15.92:0/3444506677 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559da38f480 msgr2=0x5559da3a2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:35.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.907+0000 7f19dbfff640 1 --2- 172.21.15.92:0/3444506677 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559da38f480 0x5559da3a2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:35.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.907+0000 7f19dbfff640 1 -- 172.21.15.92:0/3444506677 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559da399d40 msgr2=0x5559da39ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:35.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.907+0000 7f19dbfff640 1 --2- 172.21.15.92:0/3444506677 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559da399d40 0x5559da39ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:35.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.907+0000 7f19dbfff640 1 -- 172.21.15.92:0/3444506677 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559da39f370 con 0x5559da38eb60 2024-09-19T08:58:35.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.908+0000 7f19dbfff640 1 --2- 172.21.15.92:0/3444506677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559da38eb60 0x5559da3a1ec0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f19d0009670 tx=0x7f19d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b48ae24c41f555ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:35.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.908+0000 7f19bb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:58:35.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.909+0000 7f19bb7fe640 1 -- 172.21.15.92:0/3444506677 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d0030020 con 0x5559da38eb60 2024-09-19T08:58:35.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.909+0000 7f19bb7fe640 1 -- 172.21.15.92:0/3444506677 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f19d0017930 con 0x5559da38eb60 2024-09-19T08:58:35.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.909+0000 7f19e4ab5740 1 -- 172.21.15.92:0/3444506677 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19d40a0530 con 0x5559da38eb60 2024-09-19T08:58:35.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.910+0000 7f19bb7fe640 1 -- 172.21.15.92:0/3444506677 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f19d000f040 con 0x5559da38eb60 2024-09-19T08:58:35.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.911+0000 7f19e4ab5740 10 client.15843 fetch_fsmap learned FSMap version 19 2024-09-19T08:58:35.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.911+0000 7f19e4ab5740 1 -- 172.21.15.92:0/3444506677 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5559da415200 con 0x5559da38eb60 2024-09-19T08:58:35.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.913+0000 7f19bb7fe640 1 -- 172.21.15.92:0/3444506677 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19d40a0530 con 0x5559da38eb60 2024-09-19T08:58:35.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.913+0000 7f19bb7fe640 1 -- 172.21.15.92:0/3444506677 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f19d0012030 con 0x5559da38eb60 2024-09-19T08:58:35.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.913+0000 7f19e4ab5740 10 client.15843 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:58:35.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.913+0000 7f19e4ab5740 10 client.15843 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:58:35.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.913+0000 7f19e4ab5740 20 client.15843 populate_metadata read hostname 'smithi092' 2024-09-19T08:58:35.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.913+0000 7f19e4ab5740 1 --2- 172.21.15.92:0/3444506677 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5559da415950 0x5559da417d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:35.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.913+0000 7f19e4ab5740 4 client.15843 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:58:35.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.913+0000 7f19e4ab5740 1 -- 172.21.15.92:0/3444506677 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5559da2fbd00 con 0x5559da415950 2024-09-19T08:58:35.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.917+0000 7f19db7fe640 1 --2- 172.21.15.92:0/3444506677 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5559da415950 0x5559da417d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:35.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.918+0000 7f19db7fe640 1 --2- 172.21.15.92:0/3444506677 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5559da415950 0x5559da417d70 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8dfac6da5e41a7d7 server_cookie=1e379c79b12609ea in_seq=0 out_seq=0 2024-09-19T08:58:35.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.918+0000 7f19bb7fe640 10 client.15843 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:35.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.919+0000 7f19bb7fe640 1 -- 172.21.15.92:0/3444506677 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5559da2fbd00 con 0x5559da415950 2024-09-19T08:58:35.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.919+0000 7f19bb7fe640 10 client.15843 handle_command_reply: tid=0 2024-09-19T08:58:35.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.919+0000 7f19e4ab5740 1 client.15843 shutdown 2024-09-19T08:58:35.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.919+0000 7f19e4ab5740 1 -- 172.21.15.92:0/3444506677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559da38eb60 msgr2=0x5559da3a1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:35.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.919+0000 7f19e4ab5740 1 --2- 172.21.15.92:0/3444506677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559da38eb60 0x5559da3a1ec0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f19d0009670 tx=0x7f19d0004750 comp rx=0 tx=0).stop 2024-09-19T08:58:35.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.921+0000 7f19e4ab5740 1 -- 172.21.15.92:0/3444506677 shutdown_connections 2024-09-19T08:58:35.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.921+0000 7f19e4ab5740 1 --2- 172.21.15.92:0/3444506677 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5559da415950 0x5559da417d70 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:35.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.921+0000 7f19e4ab5740 1 --2- 172.21.15.92:0/3444506677 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559da399d40 0x5559da39ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:35.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.921+0000 7f19e4ab5740 1 --2- 172.21.15.92:0/3444506677 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559da38f480 0x5559da3a2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:35.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.921+0000 7f19e4ab5740 1 --2- 172.21.15.92:0/3444506677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559da38eb60 0x5559da3a1ec0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:35.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.921+0000 7f19e4ab5740 1 -- 172.21.15.92:0/3444506677 >> 172.21.15.92:0/3444506677 conn(0x5559da38b0f0 msgr2=0x5559da390600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:35.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.921+0000 7f19bb7fe640 0 client.15843 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:35.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.921+0000 7f19e4ab5740 1 -- 172.21.15.92:0/3444506677 shutdown_connections 2024-09-19T08:58:35.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.921+0000 7f19e4ab5740 1 -- 172.21.15.92:0/3444506677 wait complete. 2024-09-19T08:58:35.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.922+0000 7f19e4ab5740 20 client.15843 trim_cache size 0 max 16384 2024-09-19T08:58:35.922 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T08:58:35.923 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-19T08:58:35.923 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "0bfed51a-2cfd-469e-b89f-1ef6e6980c77", 2024-09-19T08:58:35.923 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-19T08:58:35.923 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T08:58:35.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.924+0000 7f19e26dc640 1 -- 172.21.15.92:0/3218550476 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f19c40a32c0 msgr2=0x7f19c40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:35.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.924+0000 7f19e26dc640 1 --2- 172.21.15.92:0/3218550476 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f19c40a32c0 0x7f19c40a5780 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f19d0006fd0 tx=0x7f19d0008040 comp rx=0 tx=0).stop 2024-09-19T08:58:35.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.924+0000 7f19e26dc640 1 -- 172.21.15.92:0/3218550476 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19dc11b140 msgr2=0x7f19dc1abb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:35.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.924+0000 7f19e26dc640 1 --2- 172.21.15.92:0/3218550476 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19dc11b140 0x7f19dc1abb80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f19d400e9f0 tx=0x7f19d400eeb0 comp rx=0 tx=0).stop 2024-09-19T08:58:35.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.924+0000 7f19e26dc640 1 -- 172.21.15.92:0/3218550476 shutdown_connections 2024-09-19T08:58:35.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.924+0000 7f19e26dc640 1 --2- 172.21.15.92:0/3218550476 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19dc11b140 0x7f19dc1abb80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:35.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.924+0000 7f19e26dc640 1 --2- 172.21.15.92:0/3218550476 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19dc109830 0x7f19dc1a77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:35.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.924+0000 7f19e26dc640 1 --2- 172.21.15.92:0/3218550476 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f19c40a32c0 0x7f19c40a5780 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:35.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.924+0000 7f19e26dc640 1 --2- 172.21.15.92:0/3218550476 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19dc109450 0x7f19dc1a72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:35.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.924+0000 7f19e26dc640 1 -- 172.21.15.92:0/3218550476 >> 172.21.15.92:0/3218550476 conn(0x7f19dc06e140 msgr2=0x7f19dc11c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:35.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.924+0000 7f19e26dc640 1 -- 172.21.15.92:0/3218550476 shutdown_connections 2024-09-19T08:58:35.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:35.924+0000 7f19e26dc640 1 -- 172.21.15.92:0/3218550476 wait complete. 2024-09-19T08:58:36.700 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:58:37.126 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:58:37.595 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:37 smithi092 ceph-mon[31407]: scrub queued for path: / 2024-09-19T08:58:37.596 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:37 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T08:58:37.596 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:37 smithi092 ceph-mon[31407]: scrub summary: active paths [/] 2024-09-19T08:58:37.596 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:37 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T08:58:37.596 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:37 smithi092 ceph-mon[31407]: pgmap v394: 97 pgs: 97 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 14 MiB/s wr, 1.10k op/s 2024-09-19T08:58:37.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.626+0000 7f2bfcf16640 1 -- 172.21.15.92:0/3377288434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2bf8101410 msgr2=0x7f2bf810d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:37.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.626+0000 7f2bfcf16640 1 --2- 172.21.15.92:0/3377288434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2bf8101410 0x7f2bf810d940 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0009cd0 tx=0x7f2bf002a8e0 comp rx=0 tx=0).stop 2024-09-19T08:58:37.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.627+0000 7f2bfcf16640 1 -- 172.21.15.92:0/3377288434 shutdown_connections 2024-09-19T08:58:37.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.627+0000 7f2bfcf16640 1 --2- 172.21.15.92:0/3377288434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2bf8101410 0x7f2bf810d940 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:37.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.627+0000 7f2bfcf16640 1 --2- 172.21.15.92:0/3377288434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2bf8100a70 0x7f2bf8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:37.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.627+0000 7f2bfcf16640 1 --2- 172.21.15.92:0/3377288434 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2bf8106a70 0x7f2bf8106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:37.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.627+0000 7f2bfcf16640 1 -- 172.21.15.92:0/3377288434 >> 172.21.15.92:0/3377288434 conn(0x7f2bf80fc7d0 msgr2=0x7f2bf80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:37.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.627+0000 7f2bfcf16640 1 -- 172.21.15.92:0/3377288434 shutdown_connections 2024-09-19T08:58:37.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.627+0000 7f2bfcf16640 1 -- 172.21.15.92:0/3377288434 wait complete. 2024-09-19T08:58:37.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.627+0000 7f2bfcf16640 1 Processor -- start 2024-09-19T08:58:37.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.628+0000 7f2bfcf16640 1 -- start start 2024-09-19T08:58:37.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.628+0000 7f2bfcf16640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2bf8100a70 0x7f2bf8198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:37.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.628+0000 7f2bfcf16640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2bf8101410 0x7f2bf8198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:37.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.628+0000 7f2bfcf16640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2bf8106a70 0x7f2bf819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:37.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.628+0000 7f2bfcf16640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf8110e70 con 0x7f2bf8101410 2024-09-19T08:58:37.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.628+0000 7f2bfcf16640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf8110cf0 con 0x7f2bf8100a70 2024-09-19T08:58:37.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.628+0000 7f2bfcf16640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf8110ff0 con 0x7f2bf8106a70 2024-09-19T08:58:37.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.628+0000 7f2bf5d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2bf8101410 0x7f2bf8198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:37.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.628+0000 7f2bf5d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2bf8101410 0x7f2bf8198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36582/0 (socket says 172.21.15.92:36582) 2024-09-19T08:58:37.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.628+0000 7f2bf5d9b640 1 -- 172.21.15.92:0/635027932 learned_addr learned my addr 172.21.15.92:0/635027932 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:37.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.628+0000 7f2bf6d9d640 1 --2- 172.21.15.92:0/635027932 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2bf8106a70 0x7f2bf819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:37.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.628+0000 7f2bf659c640 1 --2- 172.21.15.92:0/635027932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2bf8100a70 0x7f2bf8198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:37.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.628+0000 7f2bf5d9b640 1 -- 172.21.15.92:0/635027932 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2bf8106a70 msgr2=0x7f2bf819cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:37.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.628+0000 7f2bf5d9b640 1 --2- 172.21.15.92:0/635027932 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2bf8106a70 0x7f2bf819cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:37.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.628+0000 7f2bf5d9b640 1 -- 172.21.15.92:0/635027932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2bf8100a70 msgr2=0x7f2bf8198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:37.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.628+0000 7f2bf5d9b640 1 --2- 172.21.15.92:0/635027932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2bf8100a70 0x7f2bf8198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:37.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.628+0000 7f2bf5d9b640 1 -- 172.21.15.92:0/635027932 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf819d3e0 con 0x7f2bf8101410 2024-09-19T08:58:37.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.628+0000 7f2bf6d9d640 1 --2- 172.21.15.92:0/635027932 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2bf8106a70 0x7f2bf819cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:58:37.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.629+0000 7f2bf5d9b640 1 --2- 172.21.15.92:0/635027932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2bf8101410 0x7f2bf8198970 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00e9f0 tx=0x7f2bec00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:37.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.629+0000 7f2be77fe640 1 -- 172.21.15.92:0/635027932 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec00cd80 con 0x7f2bf8101410 2024-09-19T08:58:37.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.629+0000 7f2bfcf16640 1 -- 172.21.15.92:0/635027932 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bf819d6d0 con 0x7f2bf8101410 2024-09-19T08:58:37.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.629+0000 7f2be77fe640 1 -- 172.21.15.92:0/635027932 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2bec010910 con 0x7f2bf8101410 2024-09-19T08:58:37.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.629+0000 7f2bfcf16640 1 -- 172.21.15.92:0/635027932 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bf81a4fb0 con 0x7f2bf8101410 2024-09-19T08:58:37.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.629+0000 7f2be77fe640 1 -- 172.21.15.92:0/635027932 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec0188f0 con 0x7f2bf8101410 2024-09-19T08:58:37.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.631+0000 7f2be77fe640 1 -- 172.21.15.92:0/635027932 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2bec010ac0 con 0x7f2bf8101410 2024-09-19T08:58:37.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.632+0000 7f2be77fe640 1 --2- 172.21.15.92:0/635027932 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2be00a32c0 0x7f2be00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:37.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.632+0000 7f2be77fe640 1 -- 172.21.15.92:0/635027932 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2bec0cfc90 con 0x7f2bf8101410 2024-09-19T08:58:37.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.632+0000 7f2bf659c640 1 --2- 172.21.15.92:0/635027932 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2be00a32c0 0x7f2be00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:37.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.632+0000 7f2bff2ef740 1 Processor -- start 2024-09-19T08:58:37.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.633+0000 7f2bf659c640 1 --2- 172.21.15.92:0/635027932 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2be00a32c0 0x7f2be00a5780 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2be8009b50 tx=0x7f2be8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:37.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.633+0000 7f2bff2ef740 1 -- start start 2024-09-19T08:58:37.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.633+0000 7f2bff2ef740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e4c0904a0 0x561e4c090880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:37.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.633+0000 7f2bff2ef740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e4c090dc0 0x561e4c09b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:37.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.633+0000 7f2bff2ef740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e4c09b680 0x561e4c09da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:37.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.634+0000 7f2bff2ef740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561e4bff62e0 con 0x561e4c09b680 2024-09-19T08:58:37.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.634+0000 7f2bff2ef740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561e4bf9dce0 con 0x561e4c090dc0 2024-09-19T08:58:37.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.634+0000 7f2bff2ef740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x561e4bff22a0 con 0x561e4c0904a0 2024-09-19T08:58:37.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.634+0000 7f2bf6d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e4c09b680 0x561e4c09da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:37.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.634+0000 7f2bf659c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e4c0904a0 0x561e4c090880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:37.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.634+0000 7f2bf6d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e4c09b680 0x561e4c09da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36588/0 (socket says 172.21.15.92:36588) 2024-09-19T08:58:37.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.634+0000 7f2bf659c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e4c0904a0 0x561e4c090880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:43706/0 (socket says 172.21.15.92:43706) 2024-09-19T08:58:37.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.634+0000 7f2bf6d9d640 1 -- 172.21.15.92:0/1287987891 learned_addr learned my addr 172.21.15.92:0/1287987891 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:37.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.634+0000 7f2bf5d9b640 1 --2- 172.21.15.92:0/1287987891 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e4c090dc0 0x561e4c09b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:37.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.634+0000 7f2bf659c640 1 -- 172.21.15.92:0/1287987891 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e4c090dc0 msgr2=0x561e4c09b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:37.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.634+0000 7f2bf659c640 1 --2- 172.21.15.92:0/1287987891 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e4c090dc0 0x561e4c09b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:37.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.634+0000 7f2bf659c640 1 -- 172.21.15.92:0/1287987891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e4c09b680 msgr2=0x561e4c09da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:37.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.634+0000 7f2bf659c640 1 --2- 172.21.15.92:0/1287987891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e4c09b680 0x561e4c09da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:37.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.634+0000 7f2bf659c640 1 -- 172.21.15.92:0/1287987891 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e4bf82440 con 0x561e4c0904a0 2024-09-19T08:58:37.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.634+0000 7f2bf6d9d640 1 --2- 172.21.15.92:0/1287987891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e4c09b680 0x561e4c09da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:58:37.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.634+0000 7f2bf5d9b640 1 --2- 172.21.15.92:0/1287987891 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e4c090dc0 0x561e4c09b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:58:37.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.634+0000 7f2bf659c640 1 --2- 172.21.15.92:0/1287987891 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e4c0904a0 0x561e4c090880 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2be8009fd0 tx=0x7f2be8014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca8ebd8318403121 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:37.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.634+0000 7f2be4ff9640 1 -- 172.21.15.92:0/1287987891 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be8005020 con 0x561e4c0904a0 2024-09-19T08:58:37.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.635+0000 7f2be4ff9640 1 -- 172.21.15.92:0/1287987891 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2be80047a0 con 0x561e4c0904a0 2024-09-19T08:58:37.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.635+0000 7f2be4ff9640 1 -- 172.21.15.92:0/1287987891 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be802f6d0 con 0x561e4c0904a0 2024-09-19T08:58:37.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.635+0000 7f2bff2ef740 1 -- 172.21.15.92:0/1287987891 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e4c0904a0 msgr2=0x561e4c090880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:37.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.636+0000 7f2bff2ef740 1 --2- 172.21.15.92:0/1287987891 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e4c0904a0 0x561e4c090880 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2be8009fd0 tx=0x7f2be8014000 comp rx=0 tx=0).stop 2024-09-19T08:58:37.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.636+0000 7f2bff2ef740 1 -- 172.21.15.92:0/1287987891 shutdown_connections 2024-09-19T08:58:37.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.636+0000 7f2bff2ef740 1 --2- 172.21.15.92:0/1287987891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e4c09b680 0x561e4c09da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:37.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.636+0000 7f2bff2ef740 1 --2- 172.21.15.92:0/1287987891 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e4c090dc0 0x561e4c09b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:37.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.636+0000 7f2bff2ef740 1 --2- 172.21.15.92:0/1287987891 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e4c0904a0 0x561e4c090880 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:37.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.636+0000 7f2bff2ef740 1 -- 172.21.15.92:0/1287987891 >> 172.21.15.92:0/1287987891 conn(0x561e4c08ca30 msgr2=0x561e4c08ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:37.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.636+0000 7f2bff2ef740 1 -- 172.21.15.92:0/1287987891 shutdown_connections 2024-09-19T08:58:37.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.636+0000 7f2bff2ef740 1 -- 172.21.15.92:0/1287987891 wait complete. 2024-09-19T08:58:37.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.636+0000 7f2bff2ef740 1 -- start start 2024-09-19T08:58:37.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.636+0000 7f2bff2ef740 1 Processor -- start 2024-09-19T08:58:37.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.637+0000 7f2bff2ef740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e4c0904a0 0x561e4c09b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:37.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.637+0000 7f2bff2ef740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e4c090dc0 0x561e4c0982f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:37.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.637+0000 7f2bff2ef740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e4c09b680 0x561e4c0988e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:37.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.637+0000 7f2bff2ef740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561e4c0a2660 con 0x561e4c0904a0 2024-09-19T08:58:37.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.637+0000 7f2bff2ef740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561e4bfb1050 con 0x561e4c090dc0 2024-09-19T08:58:37.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.637+0000 7f2bff2ef740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x561e4c0a27e0 con 0x561e4c09b680 2024-09-19T08:58:37.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.637+0000 7f2bff2ef740 10 client.0 _ll_register_callbacks cb 0x561e4bff1160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:37.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.637+0000 7f2bf659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e4c0904a0 0x561e4c09b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:37.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.637+0000 7f2bf659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e4c0904a0 0x561e4c09b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36602/0 (socket says 172.21.15.92:36602) 2024-09-19T08:58:37.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.637+0000 7f2bf659c640 1 -- 172.21.15.92:0/1302987888 learned_addr learned my addr 172.21.15.92:0/1302987888 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:37.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.637+0000 7f2bf6d9d640 1 --2- 172.21.15.92:0/1302987888 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e4c09b680 0x561e4c0988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:37.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.637+0000 7f2bf659c640 1 -- 172.21.15.92:0/1302987888 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e4c09b680 msgr2=0x561e4c0988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:37.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.637+0000 7f2bf659c640 1 --2- 172.21.15.92:0/1302987888 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e4c09b680 0x561e4c0988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:37.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.637+0000 7f2bf659c640 1 -- 172.21.15.92:0/1302987888 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e4c090dc0 msgr2=0x561e4c0982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:37.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.637+0000 7f2bf659c640 1 --2- 172.21.15.92:0/1302987888 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e4c090dc0 0x561e4c0982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:37.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.637+0000 7f2bf659c640 1 -- 172.21.15.92:0/1302987888 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e4bd673c0 con 0x561e4c0904a0 2024-09-19T08:58:37.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.637+0000 7f2bf659c640 1 --2- 172.21.15.92:0/1302987888 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e4c0904a0 0x561e4c09b040 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2be8004fa0 tx=0x7f2be8005230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2742f7729dfe191 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:37.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.637+0000 7f2bddffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:58:37.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.638+0000 7f2bddffb640 1 -- 172.21.15.92:0/1302987888 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be8047060 con 0x561e4c0904a0 2024-09-19T08:58:37.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.638+0000 7f2bff2ef740 1 -- 172.21.15.92:0/1302987888 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2be80047a0 con 0x561e4c0904a0 2024-09-19T08:58:37.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.639+0000 7f2bddffb640 1 -- 172.21.15.92:0/1302987888 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2be8037400 con 0x561e4c0904a0 2024-09-19T08:58:37.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.639+0000 7f2bddffb640 1 -- 172.21.15.92:0/1302987888 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2be8037620 con 0x561e4c0904a0 2024-09-19T08:58:37.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.639+0000 7f2bff2ef740 10 client.15855 fetch_fsmap learned FSMap version 19 2024-09-19T08:58:37.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.639+0000 7f2bff2ef740 1 -- 172.21.15.92:0/1302987888 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x561e4c0ae080 con 0x561e4c0904a0 2024-09-19T08:58:37.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.640+0000 7f2bddffb640 1 -- 172.21.15.92:0/1302987888 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2be8037ca0 con 0x561e4c0904a0 2024-09-19T08:58:37.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.641+0000 7f2bddffb640 1 -- 172.21.15.92:0/1302987888 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f2be800eae0 con 0x561e4c0904a0 2024-09-19T08:58:37.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.641+0000 7f2bff2ef740 10 client.15855 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:58:37.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.641+0000 7f2bff2ef740 10 client.15855 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:58:37.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.641+0000 7f2bff2ef740 20 client.15855 populate_metadata read hostname 'smithi092' 2024-09-19T08:58:37.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.641+0000 7f2bff2ef740 1 --2- 172.21.15.92:0/1302987888 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561e4c0af480 0x561e4c0b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:37.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.641+0000 7f2bff2ef740 4 client.15855 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:58:37.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.641+0000 7f2bff2ef740 1 -- 172.21.15.92:0/1302987888 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f2be80047a0 con 0x561e4c0af480 2024-09-19T08:58:37.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.641+0000 7f2bf5d9b640 1 --2- 172.21.15.92:0/1302987888 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561e4c0af480 0x561e4c0b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:37.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.642+0000 7f2bddffb640 10 client.15855 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:37.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.642+0000 7f2bf5d9b640 1 --2- 172.21.15.92:0/1302987888 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561e4c0af480 0x561e4c0b1870 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb204282195ece5c server_cookie=1cac83811129a700 in_seq=0 out_seq=0 2024-09-19T08:58:37.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.643+0000 7f2bddffb640 1 -- 172.21.15.92:0/1302987888 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f2be80047a0 con 0x561e4c0af480 2024-09-19T08:58:37.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.643+0000 7f2bddffb640 10 client.15855 handle_command_reply: tid=0 2024-09-19T08:58:37.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.644+0000 7f2bff2ef740 1 client.15855 shutdown 2024-09-19T08:58:37.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.645+0000 7f2bff2ef740 1 -- 172.21.15.92:0/1302987888 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e4c0904a0 msgr2=0x561e4c09b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:37.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.645+0000 7f2bff2ef740 1 --2- 172.21.15.92:0/1302987888 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e4c0904a0 0x561e4c09b040 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2be8004fa0 tx=0x7f2be8005230 comp rx=0 tx=0).stop 2024-09-19T08:58:37.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.645+0000 7f2bff2ef740 1 -- 172.21.15.92:0/1302987888 shutdown_connections 2024-09-19T08:58:37.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.645+0000 7f2bff2ef740 1 --2- 172.21.15.92:0/1302987888 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561e4c0af480 0x561e4c0b1870 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:37.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.645+0000 7f2bff2ef740 1 --2- 172.21.15.92:0/1302987888 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e4c09b680 0x561e4c0988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:37.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.645+0000 7f2bff2ef740 1 --2- 172.21.15.92:0/1302987888 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e4c090dc0 0x561e4c0982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:37.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.645+0000 7f2bff2ef740 1 --2- 172.21.15.92:0/1302987888 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e4c0904a0 0x561e4c09b040 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:37.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.645+0000 7f2bddffb640 0 client.15855 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:37.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.645+0000 7f2bff2ef740 1 -- 172.21.15.92:0/1302987888 >> 172.21.15.92:0/1302987888 conn(0x561e4c08ca30 msgr2=0x561e4c092710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:37.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.645+0000 7f2bff2ef740 1 -- 172.21.15.92:0/1302987888 shutdown_connections 2024-09-19T08:58:37.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.645+0000 7f2bff2ef740 1 -- 172.21.15.92:0/1302987888 wait complete. 2024-09-19T08:58:37.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.646+0000 7f2bff2ef740 20 client.15855 trim_cache size 0 max 16384 2024-09-19T08:58:37.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.667+0000 7f2bff2ef740 1 Processor -- start 2024-09-19T08:58:37.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.667+0000 7f2bff2ef740 1 -- start start 2024-09-19T08:58:37.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.667+0000 7f2bff2ef740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e4c0904a0 0x561e4c0ab8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:37.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.667+0000 7f2bff2ef740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e4c090dc0 0x561e4c08ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:37.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.667+0000 7f2bff2ef740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e4c09b680 0x561e4c0b6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:37.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.667+0000 7f2bff2ef740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf806fec0 con 0x561e4c09b680 2024-09-19T08:58:37.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.667+0000 7f2bff2ef740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf8072760 con 0x561e4c0904a0 2024-09-19T08:58:37.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.667+0000 7f2bff2ef740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf8070550 con 0x561e4c090dc0 2024-09-19T08:58:37.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.668+0000 7f2bf6d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e4c09b680 0x561e4c0b6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:37.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.668+0000 7f2bf6d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e4c09b680 0x561e4c0b6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36614/0 (socket says 172.21.15.92:36614) 2024-09-19T08:58:37.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.668+0000 7f2bf6d9d640 1 -- 172.21.15.92:0/847899433 learned_addr learned my addr 172.21.15.92:0/847899433 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:37.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.668+0000 7f2bf659c640 1 --2- 172.21.15.92:0/847899433 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e4c0904a0 0x561e4c0ab8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:37.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.668+0000 7f2bf5d9b640 1 --2- 172.21.15.92:0/847899433 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e4c090dc0 0x561e4c08ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:37.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.668+0000 7f2bf6d9d640 1 -- 172.21.15.92:0/847899433 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e4c090dc0 msgr2=0x561e4c08ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:37.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.668+0000 7f2bf6d9d640 1 --2- 172.21.15.92:0/847899433 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e4c090dc0 0x561e4c08ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:37.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.668+0000 7f2bf6d9d640 1 -- 172.21.15.92:0/847899433 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e4c0904a0 msgr2=0x561e4c0ab8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:37.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.668+0000 7f2bf6d9d640 1 --2- 172.21.15.92:0/847899433 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e4c0904a0 0x561e4c0ab8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:37.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.668+0000 7f2bf6d9d640 1 -- 172.21.15.92:0/847899433 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e4c0a2540 con 0x561e4c09b680 2024-09-19T08:58:37.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.668+0000 7f2bf6d9d640 1 --2- 172.21.15.92:0/847899433 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e4c09b680 0x561e4c0b6f90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0005e30 tx=0x7f2bf0009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eb9d373b8ec3f2c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:37.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.668+0000 7f2bdffff640 1 -- 172.21.15.92:0/847899433 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf0031940 con 0x561e4c09b680 2024-09-19T08:58:37.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.668+0000 7f2bdffff640 1 -- 172.21.15.92:0/847899433 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2bf0036040 con 0x561e4c09b680 2024-09-19T08:58:37.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.668+0000 7f2bdffff640 1 -- 172.21.15.92:0/847899433 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf0004850 con 0x561e4c09b680 2024-09-19T08:58:37.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.669+0000 7f2bff2ef740 1 -- 172.21.15.92:0/847899433 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e4c09b680 msgr2=0x561e4c0b6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:37.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.669+0000 7f2bff2ef740 1 --2- 172.21.15.92:0/847899433 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e4c09b680 0x561e4c0b6f90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0005e30 tx=0x7f2bf0009a20 comp rx=0 tx=0).stop 2024-09-19T08:58:37.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.669+0000 7f2bff2ef740 1 -- 172.21.15.92:0/847899433 shutdown_connections 2024-09-19T08:58:37.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.669+0000 7f2bff2ef740 1 --2- 172.21.15.92:0/847899433 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e4c09b680 0x561e4c0b6f90 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:37.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.669+0000 7f2bff2ef740 1 --2- 172.21.15.92:0/847899433 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e4c090dc0 0x561e4c08ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:37.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.669+0000 7f2bff2ef740 1 --2- 172.21.15.92:0/847899433 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e4c0904a0 0x561e4c0ab8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:37.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.669+0000 7f2bff2ef740 1 -- 172.21.15.92:0/847899433 >> 172.21.15.92:0/847899433 conn(0x561e4c08ca30 msgr2=0x561e4c08b370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:37.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.669+0000 7f2bff2ef740 1 -- 172.21.15.92:0/847899433 shutdown_connections 2024-09-19T08:58:37.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.669+0000 7f2bff2ef740 1 -- 172.21.15.92:0/847899433 wait complete. 2024-09-19T08:58:37.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.670+0000 7f2bff2ef740 1 -- start start 2024-09-19T08:58:37.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.670+0000 7f2bff2ef740 1 Processor -- start 2024-09-19T08:58:37.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.670+0000 7f2bff2ef740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e4c0904a0 0x561e4c0a3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:37.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.670+0000 7f2bff2ef740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e4c090dc0 0x561e4c0a3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:37.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.670+0000 7f2bff2ef740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e4c09b680 0x561e4c0a4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:37.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.670+0000 7f2bff2ef740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf8070c20 con 0x561e4c0904a0 2024-09-19T08:58:37.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.670+0000 7f2bff2ef740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf8072090 con 0x561e4c09b680 2024-09-19T08:58:37.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.670+0000 7f2bff2ef740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf80712f0 con 0x561e4c090dc0 2024-09-19T08:58:37.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.670+0000 7f2bff2ef740 10 client.0 _ll_register_callbacks cb 0x7f2be8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:37.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.670+0000 7f2bf659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e4c0904a0 0x561e4c0a3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:37.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.670+0000 7f2bf659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e4c0904a0 0x561e4c0a3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36628/0 (socket says 172.21.15.92:36628) 2024-09-19T08:58:37.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.670+0000 7f2bf659c640 1 -- 172.21.15.92:0/3088257164 learned_addr learned my addr 172.21.15.92:0/3088257164 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:37.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.670+0000 7f2bf5d9b640 1 --2- 172.21.15.92:0/3088257164 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e4c090dc0 0x561e4c0a3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:37.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.670+0000 7f2bf6d9d640 1 --2- 172.21.15.92:0/3088257164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e4c09b680 0x561e4c0a4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:37.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.670+0000 7f2bf659c640 1 -- 172.21.15.92:0/3088257164 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e4c090dc0 msgr2=0x561e4c0a3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:37.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.670+0000 7f2bf659c640 1 --2- 172.21.15.92:0/3088257164 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e4c090dc0 0x561e4c0a3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:37.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.670+0000 7f2bf659c640 1 -- 172.21.15.92:0/3088257164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e4c09b680 msgr2=0x561e4c0a4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:37.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.670+0000 7f2bf659c640 1 --2- 172.21.15.92:0/3088257164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e4c09b680 0x561e4c0a4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:37.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.670+0000 7f2bf659c640 1 -- 172.21.15.92:0/3088257164 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e4c1191b0 con 0x561e4c0904a0 2024-09-19T08:58:37.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.671+0000 7f2bf659c640 1 --2- 172.21.15.92:0/3088257164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e4c0904a0 0x561e4c0a3a00 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f2be80118d0 tx=0x7f2be8009960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae38961f51304381 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:37.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.671+0000 7f2bddffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:58:37.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.671+0000 7f2bddffb640 1 -- 172.21.15.92:0/3088257164 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be8050070 con 0x561e4c0904a0 2024-09-19T08:58:37.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.671+0000 7f2bddffb640 1 -- 172.21.15.92:0/3088257164 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2be804b840 con 0x561e4c0904a0 2024-09-19T08:58:37.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.671+0000 7f2bff2ef740 1 -- 172.21.15.92:0/3088257164 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2bf0036040 con 0x561e4c0904a0 2024-09-19T08:58:37.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.671+0000 7f2bddffb640 1 -- 172.21.15.92:0/3088257164 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2be8047070 con 0x561e4c0904a0 2024-09-19T08:58:37.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.671+0000 7f2bff2ef740 10 client.15861 fetch_fsmap learned FSMap version 19 2024-09-19T08:58:37.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.671+0000 7f2bff2ef740 1 -- 172.21.15.92:0/3088257164 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x561e4c11a4c0 con 0x561e4c0904a0 2024-09-19T08:58:37.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.671+0000 7f2bddffb640 1 -- 172.21.15.92:0/3088257164 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2bf0036040 con 0x561e4c0904a0 2024-09-19T08:58:37.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.671+0000 7f2bddffb640 1 -- 172.21.15.92:0/3088257164 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f2be80379d0 con 0x561e4c0904a0 2024-09-19T08:58:37.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.671+0000 7f2bff2ef740 10 client.15861 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:58:37.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.671+0000 7f2bff2ef740 10 client.15861 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:58:37.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.671+0000 7f2bff2ef740 20 client.15861 populate_metadata read hostname 'smithi092' 2024-09-19T08:58:37.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.671+0000 7f2bff2ef740 1 --2- 172.21.15.92:0/3088257164 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561e4c11aac0 0x561e4c11cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:37.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.671+0000 7f2bff2ef740 4 client.15861 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:58:37.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.671+0000 7f2bff2ef740 1 -- 172.21.15.92:0/3088257164 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561e4c003850 con 0x561e4c11aac0 2024-09-19T08:58:37.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.672+0000 7f2bf5d9b640 1 --2- 172.21.15.92:0/3088257164 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561e4c11aac0 0x561e4c11cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:37.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.672+0000 7f2bddffb640 10 client.15861 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:37.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.672+0000 7f2bf5d9b640 1 --2- 172.21.15.92:0/3088257164 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561e4c11aac0 0x561e4c11cf00 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8079bdefef64c50e server_cookie=ce2f59295453667b in_seq=0 out_seq=0 2024-09-19T08:58:37.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.672+0000 7f2bddffb640 1 -- 172.21.15.92:0/3088257164 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x561e4c003850 con 0x561e4c11aac0 2024-09-19T08:58:37.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.672+0000 7f2bddffb640 10 client.15861 handle_command_reply: tid=0 2024-09-19T08:58:37.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.672+0000 7f2bff2ef740 1 client.15861 shutdown 2024-09-19T08:58:37.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.672+0000 7f2bff2ef740 1 -- 172.21.15.92:0/3088257164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e4c0904a0 msgr2=0x561e4c0a3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:37.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.672+0000 7f2bff2ef740 1 --2- 172.21.15.92:0/3088257164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e4c0904a0 0x561e4c0a3a00 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f2be80118d0 tx=0x7f2be8009960 comp rx=0 tx=0).stop 2024-09-19T08:58:37.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.672+0000 7f2bff2ef740 1 -- 172.21.15.92:0/3088257164 shutdown_connections 2024-09-19T08:58:37.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.672+0000 7f2bff2ef740 1 --2- 172.21.15.92:0/3088257164 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561e4c11aac0 0x561e4c11cf00 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:37.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.672+0000 7f2bff2ef740 1 --2- 172.21.15.92:0/3088257164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e4c09b680 0x561e4c0a4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:37.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.672+0000 7f2bff2ef740 1 --2- 172.21.15.92:0/3088257164 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561e4c090dc0 0x561e4c0a3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:37.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.672+0000 7f2bff2ef740 1 --2- 172.21.15.92:0/3088257164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e4c0904a0 0x561e4c0a3a00 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:37.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.672+0000 7f2bff2ef740 1 -- 172.21.15.92:0/3088257164 >> 172.21.15.92:0/3088257164 conn(0x561e4c08ca30 msgr2=0x561e4c099b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:37.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.672+0000 7f2bddffb640 0 client.15861 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:37.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.673+0000 7f2bff2ef740 1 -- 172.21.15.92:0/3088257164 shutdown_connections 2024-09-19T08:58:37.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.673+0000 7f2bff2ef740 1 -- 172.21.15.92:0/3088257164 wait complete. 2024-09-19T08:58:37.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.673+0000 7f2bff2ef740 20 client.15861 trim_cache size 0 max 16384 2024-09-19T08:58:37.679 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T08:58:37.679 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T08:58:37.679 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": { 2024-09-19T08:58:37.679 INFO:teuthology.orchestra.run.smithi092.stdout: "0bfed51a-2cfd-469e-b89f-1ef6e6980c77": { 2024-09-19T08:58:37.679 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-19T08:58:37.679 INFO:teuthology.orchestra.run.smithi092.stdout: "tag": "0bfed51a-2cfd-469e-b89f-1ef6e6980c77", 2024-09-19T08:58:37.679 INFO:teuthology.orchestra.run.smithi092.stdout: "options": "recursive,force" 2024-09-19T08:58:37.679 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:58:37.679 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:58:37.680 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T08:58:37.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.673+0000 7f2bfcf16640 1 -- 172.21.15.92:0/635027932 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2be00a32c0 msgr2=0x7f2be00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:37.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.673+0000 7f2bfcf16640 1 --2- 172.21.15.92:0/635027932 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2be00a32c0 0x7f2be00a5780 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2be8009b50 tx=0x7f2be8005f90 comp rx=0 tx=0).stop 2024-09-19T08:58:37.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.673+0000 7f2bfcf16640 1 -- 172.21.15.92:0/635027932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2bf8101410 msgr2=0x7f2bf8198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:37.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.673+0000 7f2bfcf16640 1 --2- 172.21.15.92:0/635027932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2bf8101410 0x7f2bf8198970 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00e9f0 tx=0x7f2bec00eeb0 comp rx=0 tx=0).stop 2024-09-19T08:58:37.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.673+0000 7f2bfcf16640 1 -- 172.21.15.92:0/635027932 shutdown_connections 2024-09-19T08:58:37.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.673+0000 7f2bfcf16640 1 --2- 172.21.15.92:0/635027932 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2bf8106a70 0x7f2bf819cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:37.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.673+0000 7f2bfcf16640 1 --2- 172.21.15.92:0/635027932 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2be00a32c0 0x7f2be00a5780 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:37.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.673+0000 7f2bfcf16640 1 --2- 172.21.15.92:0/635027932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2bf8101410 0x7f2bf8198970 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:37.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.673+0000 7f2bfcf16640 1 --2- 172.21.15.92:0/635027932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2bf8100a70 0x7f2bf8198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:37.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.673+0000 7f2bfcf16640 1 -- 172.21.15.92:0/635027932 >> 172.21.15.92:0/635027932 conn(0x7f2bf80fc7d0 msgr2=0x7f2bf81048c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:37.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.673+0000 7f2bfcf16640 1 -- 172.21.15.92:0/635027932 shutdown_connections 2024-09-19T08:58:37.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:58:37.673+0000 7f2bfcf16640 1 -- 172.21.15.92:0/635027932 wait complete. 2024-09-19T08:58:37.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:37 smithi167 ceph-mon[35359]: scrub queued for path: / 2024-09-19T08:58:37.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:37 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T08:58:37.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:37 smithi167 ceph-mon[35359]: scrub summary: active paths [/] 2024-09-19T08:58:37.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:37 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T08:58:37.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:37 smithi167 ceph-mon[35359]: pgmap v394: 97 pgs: 97 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 14 MiB/s wr, 1.10k op/s 2024-09-19T08:58:37.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:37 smithi190 ceph-mon[35358]: scrub queued for path: / 2024-09-19T08:58:37.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:37 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T08:58:37.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:37 smithi190 ceph-mon[35358]: scrub summary: active paths [/] 2024-09-19T08:58:37.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:37 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T08:58:37.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:37 smithi190 ceph-mon[35358]: pgmap v394: 97 pgs: 97 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 14 MiB/s wr, 1.10k op/s 2024-09-19T08:58:38.774 INFO:tasks.cephfs.filesystem:scrub status for tag:0bfed51a-2cfd-469e-b89f-1ef6e6980c77 - {'path': '/', 'tag': '0bfed51a-2cfd-469e-b89f-1ef6e6980c77', 'options': 'recursive,force'} 2024-09-19T08:58:39.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:39 smithi092 ceph-mon[31407]: pgmap v395: 97 pgs: 97 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 14 MiB/s wr, 1.11k op/s 2024-09-19T08:58:39.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:39 smithi092 ceph-mon[31407]: scrub summary: idle 2024-09-19T08:58:39.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:39 smithi167 ceph-mon[35359]: pgmap v395: 97 pgs: 97 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 14 MiB/s wr, 1.11k op/s 2024-09-19T08:58:39.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:39 smithi167 ceph-mon[35359]: scrub summary: idle 2024-09-19T08:58:39.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:39 smithi190 ceph-mon[35358]: pgmap v395: 97 pgs: 97 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 14 MiB/s wr, 1.11k op/s 2024-09-19T08:58:39.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:39 smithi190 ceph-mon[35358]: scrub summary: idle 2024-09-19T08:58:40.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 115.0 s, 6135.2 tps, lat 16.298 ms stddev 19.419 2024-09-19T08:58:41.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:41 smithi092 ceph-mon[31407]: pgmap v396: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 14 MiB/s wr, 1.12k op/s 2024-09-19T08:58:41.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:41 smithi167 ceph-mon[35359]: pgmap v396: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 14 MiB/s wr, 1.12k op/s 2024-09-19T08:58:41.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:41 smithi190 ceph-mon[35358]: pgmap v396: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 14 MiB/s wr, 1.12k op/s 2024-09-19T08:58:42.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:42 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:42.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:42 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:42.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:42 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:43.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.510+0000 7f174bfff640 1 -- 172.21.15.92:0/1533912632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f174c078790 msgr2=0x7f174c079030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:43.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.510+0000 7f174bfff640 1 --2- 172.21.15.92:0/1533912632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f174c078790 0x7f174c079030 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1744009be0 tx=0x7f174402a6c0 comp rx=0 tx=0).stop 2024-09-19T08:58:43.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.510+0000 7f174bfff640 1 -- 172.21.15.92:0/1533912632 shutdown_connections 2024-09-19T08:58:43.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.510+0000 7f174bfff640 1 --2- 172.21.15.92:0/1533912632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f174c078790 0x7f174c079030 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:43.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.510+0000 7f174bfff640 1 --2- 172.21.15.92:0/1533912632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f174c077df0 0x7f174c078250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:43.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.510+0000 7f174bfff640 1 --2- 172.21.15.92:0/1533912632 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f174c076bb0 0x7f174c076fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:43.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.510+0000 7f174bfff640 1 -- 172.21.15.92:0/1533912632 >> 172.21.15.92:0/1533912632 conn(0x7f174c0ff2f0 msgr2=0x7f174c101710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:43.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.510+0000 7f174bfff640 1 -- 172.21.15.92:0/1533912632 shutdown_connections 2024-09-19T08:58:43.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.510+0000 7f174bfff640 1 -- 172.21.15.92:0/1533912632 wait complete. 2024-09-19T08:58:43.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.511+0000 7f174bfff640 1 Processor -- start 2024-09-19T08:58:43.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.512+0000 7f174bfff640 1 -- start start 2024-09-19T08:58:43.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.512+0000 7f174bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f174c076bb0 0x7f174c19e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:43.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.512+0000 7f174bfff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f174c077df0 0x7f174c19e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:43.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.512+0000 7f174bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f174c078790 0x7f174c1a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:43.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.512+0000 7f174bfff640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f174c113c40 con 0x7f174c078790 2024-09-19T08:58:43.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.512+0000 7f174bfff640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f174c113ac0 con 0x7f174c076bb0 2024-09-19T08:58:43.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.512+0000 7f174bfff640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f174c113dc0 con 0x7f174c077df0 2024-09-19T08:58:43.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.512+0000 7f174affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f174c076bb0 0x7f174c19e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:43.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.512+0000 7f174affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f174c076bb0 0x7f174c19e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:44388/0 (socket says 172.21.15.92:44388) 2024-09-19T08:58:43.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.512+0000 7f174affd640 1 -- 172.21.15.92:0/450397955 learned_addr learned my addr 172.21.15.92:0/450397955 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:43.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.512+0000 7f174a7fc640 1 --2- 172.21.15.92:0/450397955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f174c077df0 0x7f174c19e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:43.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.513+0000 7f174b7fe640 1 --2- 172.21.15.92:0/450397955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f174c078790 0x7f174c1a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:43.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.513+0000 7f174affd640 1 -- 172.21.15.92:0/450397955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f174c077df0 msgr2=0x7f174c19e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:43.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.513+0000 7f174affd640 1 --2- 172.21.15.92:0/450397955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f174c077df0 0x7f174c19e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:43.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.513+0000 7f174affd640 1 -- 172.21.15.92:0/450397955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f174c078790 msgr2=0x7f174c1a57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:43.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.513+0000 7f174affd640 1 --2- 172.21.15.92:0/450397955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f174c078790 0x7f174c1a57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:43.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.513+0000 7f174affd640 1 -- 172.21.15.92:0/450397955 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f174c1a5e30 con 0x7f174c076bb0 2024-09-19T08:58:43.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.513+0000 7f174b7fe640 1 --2- 172.21.15.92:0/450397955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f174c078790 0x7f174c1a57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:58:43.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.513+0000 7f174affd640 1 --2- 172.21.15.92:0/450397955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f174c076bb0 0x7f174c19e210 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f174000e9c0 tx=0x7f174000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:43.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.514+0000 7f1733fff640 1 -- 172.21.15.92:0/450397955 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174000ccc0 con 0x7f174c076bb0 2024-09-19T08:58:43.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.514+0000 7f1733fff640 1 -- 172.21.15.92:0/450397955 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1740005500 con 0x7f174c076bb0 2024-09-19T08:58:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.515+0000 7f174bfff640 1 -- 172.21.15.92:0/450397955 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f174c1a6120 con 0x7f174c076bb0 2024-09-19T08:58:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.515+0000 7f174bfff640 1 -- 172.21.15.92:0/450397955 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f174c1a66c0 con 0x7f174c076bb0 2024-09-19T08:58:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.515+0000 7f1733fff640 1 -- 172.21.15.92:0/450397955 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1740010430 con 0x7f174c076bb0 2024-09-19T08:58:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.519+0000 7f17540a7740 1 Processor -- start 2024-09-19T08:58:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.519+0000 7f17540a7740 1 -- start start 2024-09-19T08:58:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.519+0000 7f1733fff640 1 -- 172.21.15.92:0/450397955 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1740004660 con 0x7f174c076bb0 2024-09-19T08:58:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.519+0000 7f17540a7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b5e5e5b70 0x561b5e5e5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.519+0000 7f17540a7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b5e5e64b0 0x561b5e5eaf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.519+0000 7f17540a7740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b5e5eb540 0x561b5e5eda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.519+0000 7f17540a7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561b5e5492f0 con 0x561b5e5e5b70 2024-09-19T08:58:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.519+0000 7f17540a7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561b5e4f1270 con 0x561b5e5e64b0 2024-09-19T08:58:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.519+0000 7f17540a7740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x561b5e5452b0 con 0x561b5e5eb540 2024-09-19T08:58:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.520+0000 7f174affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b5e5e64b0 0x561b5e5eaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.520+0000 7f174affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b5e5e64b0 0x561b5e5eaf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:44390/0 (socket says 172.21.15.92:44390) 2024-09-19T08:58:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.520+0000 7f174affd640 1 -- 172.21.15.92:0/2671689885 learned_addr learned my addr 172.21.15.92:0/2671689885 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.520+0000 7f174b7fe640 1 --2- 172.21.15.92:0/2671689885 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b5e5e5b70 0x561b5e5e5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.520+0000 7f174affd640 1 -- 172.21.15.92:0/2671689885 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b5e5eb540 msgr2=0x561b5e5eda00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T08:58:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.520+0000 7f174affd640 1 --2- 172.21.15.92:0/2671689885 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b5e5eb540 0x561b5e5eda00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.520+0000 7f174affd640 1 -- 172.21.15.92:0/2671689885 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b5e5e5b70 msgr2=0x561b5e5e5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.520+0000 7f174affd640 1 --2- 172.21.15.92:0/2671689885 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b5e5e5b70 0x561b5e5e5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.520+0000 7f174affd640 1 -- 172.21.15.92:0/2671689885 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b5e4f0340 con 0x561b5e5e64b0 2024-09-19T08:58:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.521+0000 7f174affd640 1 --2- 172.21.15.92:0/2671689885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b5e5e64b0 0x561b5e5eaf70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f17400d3c10 tx=0x7f17400d86c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afcd43aadaf8d1f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.521+0000 7f17317fa640 1 -- 172.21.15.92:0/2671689885 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17400df070 con 0x561b5e5e64b0 2024-09-19T08:58:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.521+0000 7f1733fff640 1 --2- 172.21.15.92:0/450397955 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f17340a3190 0x7f17340a5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.521+0000 7f17317fa640 1 -- 172.21.15.92:0/2671689885 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f174009c9d0 con 0x561b5e5e64b0 2024-09-19T08:58:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.521+0000 7f17317fa640 1 -- 172.21.15.92:0/2671689885 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17400af900 con 0x561b5e5e64b0 2024-09-19T08:58:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.521+0000 7f174b7fe640 1 --2- 172.21.15.92:0/450397955 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f17340a3190 0x7f17340a5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.521+0000 7f1733fff640 1 -- 172.21.15.92:0/450397955 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f17400cfcf0 con 0x7f174c076bb0 2024-09-19T08:58:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.522+0000 7f17540a7740 1 -- 172.21.15.92:0/2671689885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b5e5e64b0 msgr2=0x561b5e5eaf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.522+0000 7f17540a7740 1 --2- 172.21.15.92:0/2671689885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b5e5e64b0 0x561b5e5eaf70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f17400d3c10 tx=0x7f17400d86c0 comp rx=0 tx=0).stop 2024-09-19T08:58:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.522+0000 7f174b7fe640 1 --2- 172.21.15.92:0/450397955 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f17340a3190 0x7f17340a5650 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1744006010 tx=0x7f1744009840 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.522+0000 7f17540a7740 1 -- 172.21.15.92:0/2671689885 shutdown_connections 2024-09-19T08:58:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.522+0000 7f17540a7740 1 --2- 172.21.15.92:0/2671689885 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b5e5eb540 0x561b5e5eda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.522+0000 7f17540a7740 1 --2- 172.21.15.92:0/2671689885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b5e5e64b0 0x561b5e5eaf70 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.522+0000 7f17540a7740 1 --2- 172.21.15.92:0/2671689885 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b5e5e5b70 0x561b5e5e5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.522+0000 7f17540a7740 1 -- 172.21.15.92:0/2671689885 >> 172.21.15.92:0/2671689885 conn(0x561b5e5e11e0 msgr2=0x561b5e5e15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.522+0000 7f17540a7740 1 -- 172.21.15.92:0/2671689885 shutdown_connections 2024-09-19T08:58:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.523+0000 7f17540a7740 1 -- 172.21.15.92:0/2671689885 wait complete. 2024-09-19T08:58:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.523+0000 7f17540a7740 1 -- start start 2024-09-19T08:58:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.523+0000 7f17540a7740 1 Processor -- start 2024-09-19T08:58:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.523+0000 7f17540a7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b5e5e5b70 0x561b5e5efce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.523+0000 7f17540a7740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b5e5e64b0 0x561b5e5f0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.523+0000 7f17540a7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b5e5eb540 0x561b5e5f7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:43.527 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.523+0000 7f17540a7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561b5e5ee510 con 0x561b5e5eb540 2024-09-19T08:58:43.527 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.523+0000 7f17540a7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561b5e4d2290 con 0x561b5e5e5b70 2024-09-19T08:58:43.527 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.524+0000 7f17540a7740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x561b5e5ee690 con 0x561b5e5e64b0 2024-09-19T08:58:43.527 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.524+0000 7f17540a7740 10 client.0 _ll_register_callbacks cb 0x561b5e503140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:43.527 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.525+0000 7f174affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b5e5e5b70 0x561b5e5efce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:43.527 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.525+0000 7f174affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b5e5e5b70 0x561b5e5efce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:44402/0 (socket says 172.21.15.92:44402) 2024-09-19T08:58:43.527 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.525+0000 7f174affd640 1 -- 172.21.15.92:0/2825645440 learned_addr learned my addr 172.21.15.92:0/2825645440 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:43.527 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.525+0000 7f174a7fc640 1 --2- 172.21.15.92:0/2825645440 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b5e5e64b0 0x561b5e5f0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:43.527 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.525+0000 7f174b7fe640 1 --2- 172.21.15.92:0/2825645440 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b5e5eb540 0x561b5e5f7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:43.528 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.526+0000 7f174a7fc640 1 -- 172.21.15.92:0/2825645440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b5e5e5b70 msgr2=0x561b5e5efce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:43.528 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.526+0000 7f174a7fc640 1 --2- 172.21.15.92:0/2825645440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b5e5e5b70 0x561b5e5efce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:43.528 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.526+0000 7f174a7fc640 1 -- 172.21.15.92:0/2825645440 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b5e5eb540 msgr2=0x561b5e5f7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:43.528 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.526+0000 7f174a7fc640 1 --2- 172.21.15.92:0/2825645440 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b5e5eb540 0x561b5e5f7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:43.528 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.526+0000 7f174a7fc640 1 -- 172.21.15.92:0/2825645440 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b5e25c210 con 0x561b5e5e64b0 2024-09-19T08:58:43.528 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.526+0000 7f174affd640 1 --2- 172.21.15.92:0/2825645440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b5e5e5b70 0x561b5e5efce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:58:43.528 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.526+0000 7f174b7fe640 1 --2- 172.21.15.92:0/2825645440 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b5e5eb540 0x561b5e5f7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:58:43.529 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.526+0000 7f174a7fc640 1 --2- 172.21.15.92:0/2825645440 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b5e5e64b0 0x561b5e5f0220 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f174c19f720 tx=0x7f173c011b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a15824f2be6c64d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:43.529 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.527+0000 7f172eff5640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T08:58:43.529 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.527+0000 7f172eff5640 1 -- 172.21.15.92:0/2825645440 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f173c00f8c0 con 0x561b5e5e64b0 2024-09-19T08:58:43.529 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.527+0000 7f172eff5640 1 -- 172.21.15.92:0/2825645440 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f173c00fa60 con 0x561b5e5e64b0 2024-09-19T08:58:43.529 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.527+0000 7f17540a7740 1 -- 172.21.15.92:0/2825645440 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f174009c9d0 con 0x561b5e5e64b0 2024-09-19T08:58:43.529 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.528+0000 7f172eff5640 1 -- 172.21.15.92:0/2825645440 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f173c00fc60 con 0x561b5e5e64b0 2024-09-19T08:58:43.530 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.529+0000 7f17540a7740 10 client.25282 fetch_fsmap learned FSMap version 19 2024-09-19T08:58:43.530 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.529+0000 7f17540a7740 1 -- 172.21.15.92:0/2825645440 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x561b5e328620 con 0x561b5e5e64b0 2024-09-19T08:58:43.530 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.529+0000 7f172eff5640 1 -- 172.21.15.92:0/2825645440 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f174009c9d0 con 0x561b5e5e64b0 2024-09-19T08:58:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.530+0000 7f172eff5640 1 -- 172.21.15.92:0/2825645440 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f173c018070 con 0x561b5e5e64b0 2024-09-19T08:58:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.530+0000 7f17540a7740 10 client.25282 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:58:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.530+0000 7f17540a7740 10 client.25282 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T08:58:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.530+0000 7f17540a7740 20 client.25282 populate_metadata read hostname 'smithi092' 2024-09-19T08:58:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.530+0000 7f17540a7740 1 --2- 172.21.15.92:0/2825645440 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561b5e60c9c0 0x561b5e60ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.530+0000 7f17540a7740 4 client.25282 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:58:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.530+0000 7f17540a7740 1 -- 172.21.15.92:0/2825645440 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b5e556a20 con 0x561b5e60c9c0 2024-09-19T08:58:43.534 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.533+0000 7f174affd640 1 --2- 172.21.15.92:0/2825645440 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561b5e60c9c0 0x561b5e60ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.536+0000 7f174affd640 1 --2- 172.21.15.92:0/2825645440 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561b5e60c9c0 0x561b5e60ee10 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4498379fb877ff90 server_cookie=a216b767fa6def84 in_seq=0 out_seq=0 2024-09-19T08:58:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.536+0000 7f172eff5640 10 client.25282 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.537+0000 7f172eff5640 1 -- 172.21.15.92:0/2825645440 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561b5e556a20 con 0x561b5e60c9c0 2024-09-19T08:58:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.537+0000 7f172eff5640 10 client.25282 handle_command_reply: tid=0 2024-09-19T08:58:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.537+0000 7f17540a7740 1 client.25282 shutdown 2024-09-19T08:58:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.537+0000 7f17540a7740 1 -- 172.21.15.92:0/2825645440 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b5e5e64b0 msgr2=0x561b5e5f0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.537+0000 7f17540a7740 1 --2- 172.21.15.92:0/2825645440 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b5e5e64b0 0x561b5e5f0220 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f174c19f720 tx=0x7f173c011b50 comp rx=0 tx=0).stop 2024-09-19T08:58:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.537+0000 7f17540a7740 1 -- 172.21.15.92:0/2825645440 shutdown_connections 2024-09-19T08:58:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.537+0000 7f17540a7740 1 --2- 172.21.15.92:0/2825645440 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561b5e60c9c0 0x561b5e60ee10 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.537+0000 7f17540a7740 1 --2- 172.21.15.92:0/2825645440 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b5e5eb540 0x561b5e5f7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.537+0000 7f17540a7740 1 --2- 172.21.15.92:0/2825645440 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b5e5e64b0 0x561b5e5f0220 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.537+0000 7f17540a7740 1 --2- 172.21.15.92:0/2825645440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b5e5e5b70 0x561b5e5efce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.537+0000 7f172eff5640 0 client.25282 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.537+0000 7f17540a7740 1 -- 172.21.15.92:0/2825645440 >> 172.21.15.92:0/2825645440 conn(0x561b5e5e11e0 msgr2=0x561b5e5e29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.537+0000 7f17540a7740 1 -- 172.21.15.92:0/2825645440 shutdown_connections 2024-09-19T08:58:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.537+0000 7f17540a7740 1 -- 172.21.15.92:0/2825645440 wait complete. 2024-09-19T08:58:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.537+0000 7f17540a7740 20 client.25282 trim_cache size 0 max 16384 2024-09-19T08:58:43.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.562+0000 7f17540a7740 1 Processor -- start 2024-09-19T08:58:43.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.562+0000 7f17540a7740 1 -- start start 2024-09-19T08:58:43.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.563+0000 7f17540a7740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b5e5e5b70 0x561b5e5e01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:43.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.563+0000 7f17540a7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b5e5e64b0 0x561b5e5f7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:43.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.563+0000 7f17540a7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b5e5eb540 0x561b5e5e06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:43.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.563+0000 7f17540a7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f174c10a000 con 0x561b5e5eb540 2024-09-19T08:58:43.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.563+0000 7f17540a7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1a74e0 con 0x561b5e5e64b0 2024-09-19T08:58:43.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.563+0000 7f17540a7740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f174c10a690 con 0x561b5e5e5b70 2024-09-19T08:58:43.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.563+0000 7f174b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b5e5eb540 0x561b5e5e06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:43.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.563+0000 7f174b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b5e5eb540 0x561b5e5e06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34716/0 (socket says 172.21.15.92:34716) 2024-09-19T08:58:43.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.563+0000 7f174b7fe640 1 -- 172.21.15.92:0/1264687031 learned_addr learned my addr 172.21.15.92:0/1264687031 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:43.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.563+0000 7f174a7fc640 1 --2- 172.21.15.92:0/1264687031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b5e5e64b0 0x561b5e5f7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:43.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.564+0000 7f174a7fc640 1 -- 172.21.15.92:0/1264687031 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b5e5e5b70 msgr2=0x561b5e5e01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:43.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.564+0000 7f174a7fc640 1 --2- 172.21.15.92:0/1264687031 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b5e5e5b70 0x561b5e5e01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:43.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.564+0000 7f174a7fc640 1 -- 172.21.15.92:0/1264687031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b5e5eb540 msgr2=0x561b5e5e06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:43.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.564+0000 7f174a7fc640 1 --2- 172.21.15.92:0/1264687031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b5e5eb540 0x561b5e5e06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:43.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.564+0000 7f174a7fc640 1 -- 172.21.15.92:0/1264687031 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b5e5e1000 con 0x561b5e5e64b0 2024-09-19T08:58:43.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.564+0000 7f174a7fc640 1 --2- 172.21.15.92:0/1264687031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b5e5e64b0 0x561b5e5f7220 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f173c01a5b0 tx=0x7f173c01a4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8dce3f1987ec30d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:43.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.565+0000 7f1730ff9640 1 -- 172.21.15.92:0/1264687031 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f173c01a9a0 con 0x561b5e5e64b0 2024-09-19T08:58:43.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.565+0000 7f1730ff9640 1 -- 172.21.15.92:0/1264687031 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f173c005bb0 con 0x561b5e5e64b0 2024-09-19T08:58:43.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.565+0000 7f1730ff9640 1 -- 172.21.15.92:0/1264687031 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f173c003d30 con 0x561b5e5e64b0 2024-09-19T08:58:43.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.566+0000 7f17540a7740 1 -- 172.21.15.92:0/1264687031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b5e5e64b0 msgr2=0x561b5e5f7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:43.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.566+0000 7f17540a7740 1 --2- 172.21.15.92:0/1264687031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b5e5e64b0 0x561b5e5f7220 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f173c01a5b0 tx=0x7f173c01a4e0 comp rx=0 tx=0).stop 2024-09-19T08:58:43.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.566+0000 7f17540a7740 1 -- 172.21.15.92:0/1264687031 shutdown_connections 2024-09-19T08:58:43.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.566+0000 7f17540a7740 1 --2- 172.21.15.92:0/1264687031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b5e5eb540 0x561b5e5e06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:43.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.566+0000 7f17540a7740 1 --2- 172.21.15.92:0/1264687031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b5e5e64b0 0x561b5e5f7220 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:43.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.566+0000 7f17540a7740 1 --2- 172.21.15.92:0/1264687031 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b5e5e5b70 0x561b5e5e01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:43.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.566+0000 7f17540a7740 1 -- 172.21.15.92:0/1264687031 >> 172.21.15.92:0/1264687031 conn(0x561b5e5e11e0 msgr2=0x561b5e5dfa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:43.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.567+0000 7f17540a7740 1 -- 172.21.15.92:0/1264687031 shutdown_connections 2024-09-19T08:58:43.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.567+0000 7f17540a7740 1 -- 172.21.15.92:0/1264687031 wait complete. 2024-09-19T08:58:43.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.567+0000 7f17540a7740 1 -- start start 2024-09-19T08:58:43.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.567+0000 7f17540a7740 1 Processor -- start 2024-09-19T08:58:43.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.568+0000 7f17540a7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b5e5e5b70 0x561b5e5f4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:43.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.568+0000 7f17540a7740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b5e5e64b0 0x561b5e5f4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:43.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.568+0000 7f174affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b5e5e5b70 0x561b5e5f4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:43.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.568+0000 7f174affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b5e5e5b70 0x561b5e5f4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34730/0 (socket says 172.21.15.92:34730) 2024-09-19T08:58:43.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.568+0000 7f174affd640 1 -- 172.21.15.92:0/2053338967 learned_addr learned my addr 172.21.15.92:0/2053338967 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:43.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.568+0000 7f17540a7740 1 --2- 172.21.15.92:0/2053338967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b5e5eb540 0x561b5e5f5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:43.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.569+0000 7f17540a7740 1 -- 172.21.15.92:0/2053338967 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f174c10ad60 con 0x561b5e5e5b70 2024-09-19T08:58:43.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.569+0000 7f17540a7740 1 -- 172.21.15.92:0/2053338967 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1a6e10 con 0x561b5e5eb540 2024-09-19T08:58:43.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.569+0000 7f174a7fc640 1 --2- 172.21.15.92:0/2053338967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b5e5e64b0 0x561b5e5f4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:43.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.569+0000 7f17540a7740 1 -- 172.21.15.92:0/2053338967 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f174c10b430 con 0x561b5e5e64b0 2024-09-19T08:58:43.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.569+0000 7f174b7fe640 1 --2- 172.21.15.92:0/2053338967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b5e5eb540 0x561b5e5f5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:43.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.569+0000 7f17540a7740 10 client.0 _ll_register_callbacks cb 0x7f173c0097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:43.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.570+0000 7f174a7fc640 1 -- 172.21.15.92:0/2053338967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b5e5eb540 msgr2=0x561b5e5f5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:43.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.570+0000 7f174a7fc640 1 --2- 172.21.15.92:0/2053338967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b5e5eb540 0x561b5e5f5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:43.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.570+0000 7f174a7fc640 1 -- 172.21.15.92:0/2053338967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b5e5e5b70 msgr2=0x561b5e5f4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:43.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.570+0000 7f174a7fc640 1 --2- 172.21.15.92:0/2053338967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b5e5e5b70 0x561b5e5f4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:43.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.570+0000 7f174a7fc640 1 -- 172.21.15.92:0/2053338967 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b5e5f60e0 con 0x561b5e5e64b0 2024-09-19T08:58:43.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.570+0000 7f174a7fc640 1 --2- 172.21.15.92:0/2053338967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b5e5e64b0 0x561b5e5f4ac0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x561b5e5eac30 tx=0x7f173c01a9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=584af46ae0bec918 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:43.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.570+0000 7f172eff5640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T08:58:43.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.571+0000 7f172eff5640 1 -- 172.21.15.92:0/2053338967 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f173c00fe00 con 0x561b5e5e64b0 2024-09-19T08:58:43.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.571+0000 7f172eff5640 1 -- 172.21.15.92:0/2053338967 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f173c003800 con 0x561b5e5e64b0 2024-09-19T08:58:43.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.571+0000 7f17540a7740 1 -- 172.21.15.92:0/2053338967 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f173c005bb0 con 0x561b5e5e64b0 2024-09-19T08:58:43.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.571+0000 7f172eff5640 1 -- 172.21.15.92:0/2053338967 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f173c003a00 con 0x561b5e5e64b0 2024-09-19T08:58:43.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.572+0000 7f17540a7740 10 client.25285 fetch_fsmap learned FSMap version 19 2024-09-19T08:58:43.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.572+0000 7f17540a7740 1 -- 172.21.15.92:0/2053338967 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x561b5e5f73b0 con 0x561b5e5e64b0 2024-09-19T08:58:43.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.573+0000 7f172eff5640 1 -- 172.21.15.92:0/2053338967 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f173c005bb0 con 0x561b5e5e64b0 2024-09-19T08:58:43.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.573+0000 7f172eff5640 1 -- 172.21.15.92:0/2053338967 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f173c018070 con 0x561b5e5e64b0 2024-09-19T08:58:43.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.573+0000 7f17540a7740 10 client.25285 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:58:43.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.573+0000 7f17540a7740 10 client.25285 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T08:58:43.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.573+0000 7f17540a7740 20 client.25285 populate_metadata read hostname 'smithi092' 2024-09-19T08:58:43.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.573+0000 7f17540a7740 1 --2- 172.21.15.92:0/2053338967 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561b5e677bc0 0x561b5e679fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:43.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.573+0000 7f17540a7740 4 client.25285 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:58:43.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.573+0000 7f17540a7740 1 -- 172.21.15.92:0/2053338967 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561b5e550d70 con 0x561b5e677bc0 2024-09-19T08:58:43.575 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.574+0000 7f174affd640 1 --2- 172.21.15.92:0/2053338967 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561b5e677bc0 0x561b5e679fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:43.575 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.574+0000 7f174affd640 1 --2- 172.21.15.92:0/2053338967 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561b5e677bc0 0x561b5e679fb0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2aec1d813b95b81 server_cookie=c12bab732f5ebee0 in_seq=0 out_seq=0 2024-09-19T08:58:43.575 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.574+0000 7f172eff5640 10 client.25285 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:43.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.589+0000 7f172eff5640 1 -- 172.21.15.92:0/2053338967 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561b5e550d70 con 0x561b5e677bc0 2024-09-19T08:58:43.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.589+0000 7f172eff5640 10 client.25285 handle_command_reply: tid=0 2024-09-19T08:58:43.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.589+0000 7f17540a7740 1 client.25285 shutdown 2024-09-19T08:58:43.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.589+0000 7f17540a7740 1 -- 172.21.15.92:0/2053338967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b5e5e64b0 msgr2=0x561b5e5f4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:43.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.589+0000 7f17540a7740 1 --2- 172.21.15.92:0/2053338967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b5e5e64b0 0x561b5e5f4ac0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x561b5e5eac30 tx=0x7f173c01a9d0 comp rx=0 tx=0).stop 2024-09-19T08:58:43.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.589+0000 7f17540a7740 1 -- 172.21.15.92:0/2053338967 shutdown_connections 2024-09-19T08:58:43.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.589+0000 7f17540a7740 1 --2- 172.21.15.92:0/2053338967 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561b5e677bc0 0x561b5e679fb0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:43.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.589+0000 7f17540a7740 1 --2- 172.21.15.92:0/2053338967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b5e5eb540 0x561b5e5f5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:43.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.589+0000 7f172eff5640 0 client.25285 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:43.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.589+0000 7f17540a7740 1 --2- 172.21.15.92:0/2053338967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b5e5e64b0 0x561b5e5f4ac0 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0x561b5e5eac30 tx=0x7f173c01a9d0 comp rx=0 tx=0).stop 2024-09-19T08:58:43.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.589+0000 7f17540a7740 1 --2- 172.21.15.92:0/2053338967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b5e5e5b70 0x561b5e5f4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:43.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.589+0000 7f17540a7740 1 -- 172.21.15.92:0/2053338967 >> 172.21.15.92:0/2053338967 conn(0x561b5e5e11e0 msgr2=0x561b5e5e02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:43.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.593+0000 7f17540a7740 1 -- 172.21.15.92:0/2053338967 shutdown_connections 2024-09-19T08:58:43.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.593+0000 7f17540a7740 1 -- 172.21.15.92:0/2053338967 wait complete. 2024-09-19T08:58:43.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.593+0000 7f17540a7740 20 client.25285 trim_cache size 0 max 16384 2024-09-19T08:58:43.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T08:58:43.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T08:58:43.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T08:58:43.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T08:58:43.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.594+0000 7f174bfff640 1 -- 172.21.15.92:0/450397955 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f17340a3190 msgr2=0x7f17340a5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:43.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.594+0000 7f174bfff640 1 --2- 172.21.15.92:0/450397955 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f17340a3190 0x7f17340a5650 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1744006010 tx=0x7f1744009840 comp rx=0 tx=0).stop 2024-09-19T08:58:43.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.594+0000 7f174bfff640 1 -- 172.21.15.92:0/450397955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f174c076bb0 msgr2=0x7f174c19e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:43.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.594+0000 7f174bfff640 1 --2- 172.21.15.92:0/450397955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f174c076bb0 0x7f174c19e210 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f174000e9c0 tx=0x7f174000ee80 comp rx=0 tx=0).stop 2024-09-19T08:58:43.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.594+0000 7f174bfff640 1 -- 172.21.15.92:0/450397955 shutdown_connections 2024-09-19T08:58:43.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.594+0000 7f174bfff640 1 --2- 172.21.15.92:0/450397955 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f17340a3190 0x7f17340a5650 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:43.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.594+0000 7f174bfff640 1 --2- 172.21.15.92:0/450397955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f174c078790 0x7f174c1a57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:43.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.594+0000 7f174bfff640 1 --2- 172.21.15.92:0/450397955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f174c077df0 0x7f174c19e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:43.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.594+0000 7f174bfff640 1 --2- 172.21.15.92:0/450397955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f174c076bb0 0x7f174c19e210 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:43.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.594+0000 7f174bfff640 1 -- 172.21.15.92:0/450397955 >> 172.21.15.92:0/450397955 conn(0x7f174c0ff2f0 msgr2=0x7f174c100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:43.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.594+0000 7f174bfff640 1 -- 172.21.15.92:0/450397955 shutdown_connections 2024-09-19T08:58:43.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:43.595+0000 7f174bfff640 1 -- 172.21.15.92:0/450397955 wait complete. 2024-09-19T08:58:43.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:43 smithi092 ceph-mon[31407]: pgmap v397: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 12 MiB/s wr, 1.01k op/s 2024-09-19T08:58:43.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:43 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:58:43.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:43 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:58:43.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:43 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:58:43.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:43 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:58:43.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:43 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:58:43.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:43 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:58:43.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:43 smithi167 ceph-mon[35359]: pgmap v397: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 12 MiB/s wr, 1.01k op/s 2024-09-19T08:58:43.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:43 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:58:43.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:43 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:58:43.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:43 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:58:43.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:43 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:58:43.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:43 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:58:43.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:43 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:58:43.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:43 smithi190 ceph-mon[35358]: pgmap v397: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 12 MiB/s wr, 1.01k op/s 2024-09-19T08:58:43.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:43 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:58:43.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:43 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:58:43.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:43 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:58:43.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:43 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:58:43.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:43 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:58:43.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:43 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:58:44.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:44 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:44.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:44 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:44.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:44 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:58:44.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:44 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:44.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:44 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:44.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:44 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:58:44.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:44 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:44.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:44 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:44.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:44 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:58:45.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:45 smithi092 ceph-mon[31407]: pgmap v398: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 13 MiB/s wr, 1.09k op/s 2024-09-19T08:58:45.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 120.0 s, 5499.8 tps, lat 18.108 ms stddev 19.551 2024-09-19T08:58:45.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:45 smithi167 ceph-mon[35359]: pgmap v398: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 13 MiB/s wr, 1.09k op/s 2024-09-19T08:58:45.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:45 smithi190 ceph-mon[35358]: pgmap v398: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 13 MiB/s wr, 1.09k op/s 2024-09-19T08:58:47.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:47 smithi092 ceph-mon[31407]: pgmap v399: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 13 MiB/s wr, 1.02k op/s 2024-09-19T08:58:47.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:47 smithi167 ceph-mon[35359]: pgmap v399: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 13 MiB/s wr, 1.02k op/s 2024-09-19T08:58:47.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:47 smithi190 ceph-mon[35358]: pgmap v399: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 13 MiB/s wr, 1.02k op/s 2024-09-19T08:58:49.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:49 smithi092 ceph-mon[31407]: pgmap v400: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 13 MiB/s wr, 998 op/s 2024-09-19T08:58:49.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:49 smithi167 ceph-mon[35359]: pgmap v400: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 13 MiB/s wr, 998 op/s 2024-09-19T08:58:49.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:49 smithi190 ceph-mon[35358]: pgmap v400: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 13 MiB/s wr, 998 op/s 2024-09-19T08:58:50.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 125.0 s, 6031.8 tps, lat 16.609 ms stddev 17.501 2024-09-19T08:58:51.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:51 smithi092 ceph-mon[31407]: pgmap v401: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 13 MiB/s wr, 1.01k op/s 2024-09-19T08:58:51.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:51 smithi167 ceph-mon[35359]: pgmap v401: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 13 MiB/s wr, 1.01k op/s 2024-09-19T08:58:51.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:51 smithi190 ceph-mon[35358]: pgmap v401: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 13 MiB/s wr, 1.01k op/s 2024-09-19T08:58:52.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:52 smithi092 ceph-mon[31407]: pgmap v402: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 13 MiB/s wr, 938 op/s 2024-09-19T08:58:52.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:52 smithi167 ceph-mon[35359]: pgmap v402: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 13 MiB/s wr, 938 op/s 2024-09-19T08:58:52.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:52 smithi190 ceph-mon[35358]: pgmap v402: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 13 MiB/s wr, 938 op/s 2024-09-19T08:58:55.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:55 smithi092 ceph-mon[31407]: pgmap v403: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 15 MiB/s wr, 1.06k op/s 2024-09-19T08:58:55.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 130.0 s, 6168.6 tps, lat 16.204 ms stddev 17.613 2024-09-19T08:58:55.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:55 smithi167 ceph-mon[35359]: pgmap v403: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 15 MiB/s wr, 1.06k op/s 2024-09-19T08:58:55.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:55 smithi190 ceph-mon[35358]: pgmap v403: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 15 MiB/s wr, 1.06k op/s 2024-09-19T08:58:56.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.735+0000 7f14df186640 1 -- 172.21.15.92:0/3582548644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14d8100a50 msgr2=0x7f14d8100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:56.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.735+0000 7f14df186640 1 --2- 172.21.15.92:0/3582548644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14d8100a50 0x7f14d8100e50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f14d00081d0 tx=0x7f14d002a420 comp rx=0 tx=0).stop 2024-09-19T08:58:56.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.735+0000 7f14df186640 1 -- 172.21.15.92:0/3582548644 shutdown_connections 2024-09-19T08:58:56.736 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.735+0000 7f14df186640 1 --2- 172.21.15.92:0/3582548644 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14d8102600 0x7f14d8108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:56.736 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.735+0000 7f14df186640 1 --2- 172.21.15.92:0/3582548644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14d8101c40 0x7f14d81020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:56.736 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.735+0000 7f14df186640 1 --2- 172.21.15.92:0/3582548644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14d8100a50 0x7f14d8100e50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:56.736 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.735+0000 7f14df186640 1 -- 172.21.15.92:0/3582548644 >> 172.21.15.92:0/3582548644 conn(0x7f14d80fc1b0 msgr2=0x7f14d80fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:56.736 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.735+0000 7f14df186640 1 -- 172.21.15.92:0/3582548644 shutdown_connections 2024-09-19T08:58:56.736 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.735+0000 7f14df186640 1 -- 172.21.15.92:0/3582548644 wait complete. 2024-09-19T08:58:56.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.736+0000 7f14df186640 1 Processor -- start 2024-09-19T08:58:56.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.736+0000 7f14df186640 1 -- start start 2024-09-19T08:58:56.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.736+0000 7f14df186640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14d8100a50 0x7f14d81a6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:56.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.736+0000 7f14df186640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14d8101c40 0x7f14d81a7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:56.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.736+0000 7f14df186640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14d8102600 0x7f14d81ae180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:56.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.736+0000 7f14df186640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f14d810b5d0 con 0x7f14d8101c40 2024-09-19T08:58:56.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.737+0000 7f14dcf22640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14d8100a50 0x7f14d81a6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:56.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.737+0000 7f14d7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14d8101c40 0x7f14d81a7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:56.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.737+0000 7f14dcf22640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14d8100a50 0x7f14d81a6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:45550/0 (socket says 172.21.15.92:45550) 2024-09-19T08:58:56.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.737+0000 7f14dcf22640 1 -- 172.21.15.92:0/348286254 learned_addr learned my addr 172.21.15.92:0/348286254 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:56.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.737+0000 7f14df186640 1 -- 172.21.15.92:0/348286254 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f14d810b450 con 0x7f14d8102600 2024-09-19T08:58:56.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.737+0000 7f14df186640 1 -- 172.21.15.92:0/348286254 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f14d810b750 con 0x7f14d8100a50 2024-09-19T08:58:56.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.737+0000 7f14dcf22640 1 -- 172.21.15.92:0/348286254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14d8102600 msgr2=0x7f14d81ae180 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T08:58:56.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.737+0000 7f14dcf22640 1 --2- 172.21.15.92:0/348286254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14d8102600 0x7f14d81ae180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:56.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.737+0000 7f14dcf22640 1 -- 172.21.15.92:0/348286254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14d8101c40 msgr2=0x7f14d81a7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:56.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.737+0000 7f14dcf22640 1 --2- 172.21.15.92:0/348286254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14d8101c40 0x7f14d81a7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:56.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.737+0000 7f14dcf22640 1 -- 172.21.15.92:0/348286254 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14d81ae7f0 con 0x7f14d8100a50 2024-09-19T08:58:56.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.738+0000 7f14dcf22640 1 --2- 172.21.15.92:0/348286254 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14d8100a50 0x7f14d81a6bd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f14d002a940 tx=0x7f14d000d510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:56.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.738+0000 7f14d5ffb640 1 -- 172.21.15.92:0/348286254 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d0040020 con 0x7f14d8100a50 2024-09-19T08:58:56.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.738+0000 7f14d5ffb640 1 -- 172.21.15.92:0/348286254 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14d0003b70 con 0x7f14d8100a50 2024-09-19T08:58:56.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.738+0000 7f14d5ffb640 1 -- 172.21.15.92:0/348286254 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d0036040 con 0x7f14d8100a50 2024-09-19T08:58:56.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.738+0000 7f14df186640 1 -- 172.21.15.92:0/348286254 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14d81aea80 con 0x7f14d8100a50 2024-09-19T08:58:56.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.739+0000 7f14df186640 1 -- 172.21.15.92:0/348286254 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14d81aef80 con 0x7f14d8100a50 2024-09-19T08:58:56.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.743+0000 7f14d5ffb640 1 -- 172.21.15.92:0/348286254 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f14d0043020 con 0x7f14d8100a50 2024-09-19T08:58:56.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.744+0000 7f14d5ffb640 1 --2- 172.21.15.92:0/348286254 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f14c00a33f0 0x7f14c00a58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:56.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.744+0000 7f14d5ffb640 1 -- 172.21.15.92:0/348286254 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f14d00f05d0 con 0x7f14d8100a50 2024-09-19T08:58:56.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.745+0000 7f14d7fff640 1 --2- 172.21.15.92:0/348286254 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f14c00a33f0 0x7f14c00a58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:56.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.746+0000 7f14e1ff7740 1 Processor -- start 2024-09-19T08:58:56.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.746+0000 7f14e1ff7740 1 -- start start 2024-09-19T08:58:56.747 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.747+0000 7f14d7fff640 1 --2- 172.21.15.92:0/348286254 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f14c00a33f0 0x7f14c00a58b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f14c80096c0 tx=0x7f14c8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:56.747 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.747+0000 7f14e1ff7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5568a5ad8990 0x5568a5ad8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:56.748 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.747+0000 7f14e1ff7740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5568a5ad92d0 0x5568a5addd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:56.748 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.747+0000 7f14e1ff7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5ade360 0x5568a5ae0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:56.748 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.747+0000 7f14e1ff7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5568a5a3c2f0 con 0x5568a5ade360 2024-09-19T08:58:56.748 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.747+0000 7f14e1ff7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5568a59e4270 con 0x5568a5ad8990 2024-09-19T08:58:56.748 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.747+0000 7f14e1ff7740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5568a5a382b0 con 0x5568a5ad92d0 2024-09-19T08:58:56.750 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.747+0000 7f14dd723640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5ade360 0x5568a5ae0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:56.751 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.747+0000 7f14dd723640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5ade360 0x5568a5ae0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52532/0 (socket says 172.21.15.92:52532) 2024-09-19T08:58:56.751 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.747+0000 7f14dd723640 1 -- 172.21.15.92:0/3866832885 learned_addr learned my addr 172.21.15.92:0/3866832885 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:56.751 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.747+0000 7f14dcf22640 1 --2- 172.21.15.92:0/3866832885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5568a5ad8990 0x5568a5ad8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:56.751 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.748+0000 7f14dd723640 1 -- 172.21.15.92:0/3866832885 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5568a5ad92d0 msgr2=0x5568a5addd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:56.751 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.748+0000 7f14dd723640 1 --2- 172.21.15.92:0/3866832885 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5568a5ad92d0 0x5568a5addd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:56.751 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.748+0000 7f14dd723640 1 -- 172.21.15.92:0/3866832885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5568a5ad8990 msgr2=0x5568a5ad8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:56.751 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.748+0000 7f14dd723640 1 --2- 172.21.15.92:0/3866832885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5568a5ad8990 0x5568a5ad8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:56.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.748+0000 7f14dd723640 1 -- 172.21.15.92:0/3866832885 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568a59e3340 con 0x5568a5ade360 2024-09-19T08:58:56.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.748+0000 7f14dd723640 1 --2- 172.21.15.92:0/3866832885 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5ade360 0x5568a5ae0820 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f14cc00b6d0 tx=0x7f14cc005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45229dd5b2c72dba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:56.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.751+0000 7f14beffd640 1 -- 172.21.15.92:0/3866832885 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14cc004220 con 0x5568a5ade360 2024-09-19T08:58:56.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.751+0000 7f14beffd640 1 -- 172.21.15.92:0/3866832885 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14cc0043c0 con 0x5568a5ade360 2024-09-19T08:58:56.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.751+0000 7f14beffd640 1 -- 172.21.15.92:0/3866832885 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14cc007e60 con 0x5568a5ade360 2024-09-19T08:58:56.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.753+0000 7f14e1ff7740 1 -- 172.21.15.92:0/3866832885 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5ade360 msgr2=0x5568a5ae0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:56.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.753+0000 7f14e1ff7740 1 --2- 172.21.15.92:0/3866832885 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5ade360 0x5568a5ae0820 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f14cc00b6d0 tx=0x7f14cc005f90 comp rx=0 tx=0).stop 2024-09-19T08:58:56.754 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.755+0000 7f14e1ff7740 1 -- 172.21.15.92:0/3866832885 shutdown_connections 2024-09-19T08:58:56.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.755+0000 7f14e1ff7740 1 --2- 172.21.15.92:0/3866832885 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5ade360 0x5568a5ae0820 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:56.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.755+0000 7f14e1ff7740 1 --2- 172.21.15.92:0/3866832885 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5568a5ad92d0 0x5568a5addd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:56.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.755+0000 7f14e1ff7740 1 --2- 172.21.15.92:0/3866832885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5568a5ad8990 0x5568a5ad8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:56.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.755+0000 7f14e1ff7740 1 -- 172.21.15.92:0/3866832885 >> 172.21.15.92:0/3866832885 conn(0x5568a5ad4000 msgr2=0x5568a5ad4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:56.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.755+0000 7f14e1ff7740 1 -- 172.21.15.92:0/3866832885 shutdown_connections 2024-09-19T08:58:56.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.755+0000 7f14e1ff7740 1 -- 172.21.15.92:0/3866832885 wait complete. 2024-09-19T08:58:56.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.755+0000 7f14e1ff7740 1 -- start start 2024-09-19T08:58:56.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.756+0000 7f14e1ff7740 1 Processor -- start 2024-09-19T08:58:56.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.756+0000 7f14e1ff7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5ad8990 0x5568a5ae2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:56.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.756+0000 7f14e1ff7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5568a5ad92d0 0x5568a5ae3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:56.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.756+0000 7f14e1ff7740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5568a5ade360 0x5568a5aea210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.756+0000 7f14e1ff7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5568a5ae1330 con 0x5568a5ad8990 2024-09-19T08:58:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.756+0000 7f14e1ff7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5568a59c5290 con 0x5568a5ad92d0 2024-09-19T08:58:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.756+0000 7f14e1ff7740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5568a5ae14b0 con 0x5568a5ade360 2024-09-19T08:58:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.756+0000 7f14e1ff7740 10 client.0 _ll_register_callbacks cb 0x5568a59f6140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.757+0000 7f14d7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5568a5ad92d0 0x5568a5ae3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.757+0000 7f14d7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5568a5ad92d0 0x5568a5ae3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:53676/0 (socket says 172.21.15.92:53676) 2024-09-19T08:58:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.757+0000 7f14d7fff640 1 -- 172.21.15.92:0/3983774831 learned_addr learned my addr 172.21.15.92:0/3983774831 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.757+0000 7f14dd723640 1 --2- 172.21.15.92:0/3983774831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5568a5ade360 0x5568a5aea210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.757+0000 7f14d7fff640 1 -- 172.21.15.92:0/3983774831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5568a5ade360 msgr2=0x5568a5aea210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.757+0000 7f14d7fff640 1 --2- 172.21.15.92:0/3983774831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5568a5ade360 0x5568a5aea210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.757+0000 7f14d7fff640 1 -- 172.21.15.92:0/3983774831 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5ad8990 msgr2=0x5568a5ae2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:56.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.757+0000 7f14d7fff640 1 --2- 172.21.15.92:0/3983774831 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5ad8990 0x5568a5ae2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:56.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.757+0000 7f14d7fff640 1 -- 172.21.15.92:0/3983774831 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568a574f210 con 0x5568a5ad92d0 2024-09-19T08:58:56.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.757+0000 7f14dd723640 1 --2- 172.21.15.92:0/3983774831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5568a5ade360 0x5568a5aea210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:58:56.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.757+0000 7f14d7fff640 1 --2- 172.21.15.92:0/3983774831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5568a5ad92d0 0x5568a5ae3240 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f14c8012850 tx=0x7f14c80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b99d64e03220d5fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:56.760 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.758+0000 7f14b7fff640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T08:58:56.760 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.758+0000 7f14b7fff640 1 -- 172.21.15.92:0/3983774831 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c800fad0 con 0x5568a5ad92d0 2024-09-19T08:58:56.760 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.758+0000 7f14b7fff640 1 -- 172.21.15.92:0/3983774831 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f14c800fc70 con 0x5568a5ad92d0 2024-09-19T08:58:56.760 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.760+0000 7f14e1ff7740 1 -- 172.21.15.92:0/3983774831 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14cc0043c0 con 0x5568a5ad92d0 2024-09-19T08:58:56.760 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.760+0000 7f14b7fff640 1 -- 172.21.15.92:0/3983774831 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f14c800fe70 con 0x5568a5ad92d0 2024-09-19T08:58:56.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.760+0000 7f14e1ff7740 10 client.25322 fetch_fsmap learned FSMap version 19 2024-09-19T08:58:56.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.760+0000 7f14e1ff7740 1 -- 172.21.15.92:0/3983774831 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5568a581b620 con 0x5568a5ad92d0 2024-09-19T08:58:56.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.761+0000 7f14b7fff640 1 -- 172.21.15.92:0/3983774831 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14cc0043c0 con 0x5568a5ad92d0 2024-09-19T08:58:56.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.761+0000 7f14b7fff640 1 -- 172.21.15.92:0/3983774831 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f14c801f740 con 0x5568a5ad92d0 2024-09-19T08:58:56.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.761+0000 7f14e1ff7740 10 client.25322 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:58:56.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.761+0000 7f14e1ff7740 10 client.25322 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T08:58:56.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.761+0000 7f14e1ff7740 20 client.25322 populate_metadata read hostname 'smithi092' 2024-09-19T08:58:56.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.761+0000 7f14e1ff7740 1 --2- 172.21.15.92:0/3983774831 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5568a5affd80 0x5568a5b02220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:56.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.761+0000 7f14e1ff7740 4 client.25322 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:58:56.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.761+0000 7f14e1ff7740 1 -- 172.21.15.92:0/3983774831 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5568a5a49a20 con 0x5568a5affd80 2024-09-19T08:58:56.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.762+0000 7f14dcf22640 1 --2- 172.21.15.92:0/3983774831 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5568a5affd80 0x5568a5b02220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:56.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.763+0000 7f14dcf22640 1 --2- 172.21.15.92:0/3983774831 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5568a5affd80 0x5568a5b02220 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdeb2b6dbd37ae64 server_cookie=f9f6ea949b6de09c in_seq=0 out_seq=0 2024-09-19T08:58:56.763 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.763+0000 7f14b7fff640 10 client.25322 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:56.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.763+0000 7f14b7fff640 1 -- 172.21.15.92:0/3983774831 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5568a5a49a20 con 0x5568a5affd80 2024-09-19T08:58:56.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.763+0000 7f14b7fff640 10 client.25322 handle_command_reply: tid=0 2024-09-19T08:58:56.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.763+0000 7f14e1ff7740 1 client.25322 shutdown 2024-09-19T08:58:56.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.764+0000 7f14e1ff7740 1 -- 172.21.15.92:0/3983774831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5568a5ad92d0 msgr2=0x5568a5ae3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:56.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.764+0000 7f14e1ff7740 1 --2- 172.21.15.92:0/3983774831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5568a5ad92d0 0x5568a5ae3240 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f14c8012850 tx=0x7f14c80046c0 comp rx=0 tx=0).stop 2024-09-19T08:58:56.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.764+0000 7f14e1ff7740 1 -- 172.21.15.92:0/3983774831 shutdown_connections 2024-09-19T08:58:56.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.764+0000 7f14e1ff7740 1 --2- 172.21.15.92:0/3983774831 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5568a5affd80 0x5568a5b02220 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:56.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.764+0000 7f14e1ff7740 1 --2- 172.21.15.92:0/3983774831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5568a5ade360 0x5568a5aea210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:56.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.764+0000 7f14e1ff7740 1 --2- 172.21.15.92:0/3983774831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5568a5ad92d0 0x5568a5ae3240 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:56.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.764+0000 7f14e1ff7740 1 --2- 172.21.15.92:0/3983774831 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5ad8990 0x5568a5ae2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:56.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.764+0000 7f14b7fff640 0 client.25322 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:56.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.764+0000 7f14e1ff7740 1 -- 172.21.15.92:0/3983774831 >> 172.21.15.92:0/3983774831 conn(0x5568a5ad4000 msgr2=0x5568a5ad5810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:56.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.764+0000 7f14e1ff7740 1 -- 172.21.15.92:0/3983774831 shutdown_connections 2024-09-19T08:58:56.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.764+0000 7f14e1ff7740 1 -- 172.21.15.92:0/3983774831 wait complete. 2024-09-19T08:58:56.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.764+0000 7f14e1ff7740 20 client.25322 trim_cache size 0 max 16384 2024-09-19T08:58:56.788 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.788+0000 7f14e1ff7740 1 Processor -- start 2024-09-19T08:58:56.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.789+0000 7f14e1ff7740 1 -- start start 2024-09-19T08:58:56.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.789+0000 7f14e1ff7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5568a5ad8990 0x5568a5ae2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:56.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.789+0000 7f14e1ff7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5ad92d0 0x5568a5aea1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:56.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.789+0000 7f14e1ff7740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5568a5ade360 0x5568a5ae2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:56.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.789+0000 7f14e1ff7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f14d80729f0 con 0x5568a5ad92d0 2024-09-19T08:58:56.790 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.789+0000 7f14e1ff7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f14d81affc0 con 0x5568a5ad8990 2024-09-19T08:58:56.790 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.789+0000 7f14e1ff7740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f14d8073080 con 0x5568a5ade360 2024-09-19T08:58:56.790 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.790+0000 7f14dcf22640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5568a5ad8990 0x5568a5ae2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:56.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.790+0000 7f14dcf22640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5568a5ad8990 0x5568a5ae2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:53692/0 (socket says 172.21.15.92:53692) 2024-09-19T08:58:56.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.790+0000 7f14dd723640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5568a5ade360 0x5568a5ae2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:56.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.790+0000 7f14dcf22640 1 -- 172.21.15.92:0/3571169059 learned_addr learned my addr 172.21.15.92:0/3571169059 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:56.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.790+0000 7f14d7fff640 1 --2- 172.21.15.92:0/3571169059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5ad92d0 0x5568a5aea1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:56.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.790+0000 7f14dcf22640 1 -- 172.21.15.92:0/3571169059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5568a5ade360 msgr2=0x5568a5ae2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:56.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.790+0000 7f14dcf22640 1 --2- 172.21.15.92:0/3571169059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5568a5ade360 0x5568a5ae2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:56.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.790+0000 7f14dcf22640 1 -- 172.21.15.92:0/3571169059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5ad92d0 msgr2=0x5568a5aea1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:56.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.790+0000 7f14dcf22640 1 --2- 172.21.15.92:0/3571169059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5ad92d0 0x5568a5aea1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:56.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.790+0000 7f14dcf22640 1 -- 172.21.15.92:0/3571169059 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568a5ad3e20 con 0x5568a5ad8990 2024-09-19T08:58:56.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.791+0000 7f14dcf22640 1 --2- 172.21.15.92:0/3571169059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5568a5ad8990 0x5568a5ae2ab0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f14d00b9580 tx=0x7f14d000d700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8e07d98512dee0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:56.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.791+0000 7f14be7fc640 1 -- 172.21.15.92:0/3571169059 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d006f020 con 0x5568a5ad8990 2024-09-19T08:58:56.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.791+0000 7f14be7fc640 1 -- 172.21.15.92:0/3571169059 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14d00c5820 con 0x5568a5ad8990 2024-09-19T08:58:56.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.791+0000 7f14be7fc640 1 -- 172.21.15.92:0/3571169059 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d000b9f0 con 0x5568a5ad8990 2024-09-19T08:58:56.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.792+0000 7f14e1ff7740 1 -- 172.21.15.92:0/3571169059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5568a5ad8990 msgr2=0x5568a5ae2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:56.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.792+0000 7f14e1ff7740 1 --2- 172.21.15.92:0/3571169059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5568a5ad8990 0x5568a5ae2ab0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f14d00b9580 tx=0x7f14d000d700 comp rx=0 tx=0).stop 2024-09-19T08:58:56.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.792+0000 7f14e1ff7740 1 -- 172.21.15.92:0/3571169059 shutdown_connections 2024-09-19T08:58:56.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.792+0000 7f14e1ff7740 1 --2- 172.21.15.92:0/3571169059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5568a5ade360 0x5568a5ae2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:56.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.792+0000 7f14e1ff7740 1 --2- 172.21.15.92:0/3571169059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5ad92d0 0x5568a5aea1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:56.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.792+0000 7f14e1ff7740 1 --2- 172.21.15.92:0/3571169059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5568a5ad8990 0x5568a5ae2ab0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:56.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.792+0000 7f14e1ff7740 1 -- 172.21.15.92:0/3571169059 >> 172.21.15.92:0/3571169059 conn(0x5568a5ad4000 msgr2=0x5568a5ae2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:56.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.792+0000 7f14e1ff7740 1 -- 172.21.15.92:0/3571169059 shutdown_connections 2024-09-19T08:58:56.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.792+0000 7f14e1ff7740 1 -- 172.21.15.92:0/3571169059 wait complete. 2024-09-19T08:58:56.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.792+0000 7f14e1ff7740 1 -- start start 2024-09-19T08:58:56.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.792+0000 7f14e1ff7740 1 Processor -- start 2024-09-19T08:58:56.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.793+0000 7f14e1ff7740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5568a5ad8990 0x5568a5ae7390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:56.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.793+0000 7f14e1ff7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5568a5ad92d0 0x5568a5ae78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:56.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.793+0000 7f14e1ff7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5ade360 0x5568a5ae8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:56.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.793+0000 7f14e1ff7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f14d8073750 con 0x5568a5ade360 2024-09-19T08:58:56.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.793+0000 7f14e1ff7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f14d81af8f0 con 0x5568a5ad92d0 2024-09-19T08:58:56.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.793+0000 7f14e1ff7740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f14d8073e20 con 0x5568a5ad8990 2024-09-19T08:58:56.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.793+0000 7f14e1ff7740 10 client.0 _ll_register_callbacks cb 0x7f14c8009950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:56.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.794+0000 7f14d7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5568a5ad92d0 0x5568a5ae78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:56.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.794+0000 7f14d7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5568a5ad92d0 0x5568a5ae78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:53708/0 (socket says 172.21.15.92:53708) 2024-09-19T08:58:56.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.794+0000 7f14d7fff640 1 -- 172.21.15.92:0/4042799898 learned_addr learned my addr 172.21.15.92:0/4042799898 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:58:56.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.794+0000 7f14dd723640 1 --2- 172.21.15.92:0/4042799898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5ade360 0x5568a5ae8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:56.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.794+0000 7f14dcf22640 1 --2- 172.21.15.92:0/4042799898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5568a5ad8990 0x5568a5ae7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:56.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.794+0000 7f14d7fff640 1 -- 172.21.15.92:0/4042799898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5568a5ad8990 msgr2=0x5568a5ae7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:56.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.794+0000 7f14d7fff640 1 --2- 172.21.15.92:0/4042799898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5568a5ad8990 0x5568a5ae7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:56.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.794+0000 7f14d7fff640 1 -- 172.21.15.92:0/4042799898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5ade360 msgr2=0x5568a5ae8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:56.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.794+0000 7f14d7fff640 1 --2- 172.21.15.92:0/4042799898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5ade360 0x5568a5ae8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:56.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.794+0000 7f14d7fff640 1 -- 172.21.15.92:0/4042799898 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568a5ae8e80 con 0x5568a5ad92d0 2024-09-19T08:58:56.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.794+0000 7f14d7fff640 1 --2- 172.21.15.92:0/4042799898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5568a5ad92d0 0x5568a5ae78d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f14c801fd00 tx=0x7f14c801f6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58ad989df748593b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:56.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.795+0000 7f14b7fff640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T08:58:56.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.795+0000 7f14b7fff640 1 -- 172.21.15.92:0/4042799898 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c8040020 con 0x5568a5ad92d0 2024-09-19T08:58:56.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.795+0000 7f14b7fff640 1 -- 172.21.15.92:0/4042799898 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f14c8031630 con 0x5568a5ad92d0 2024-09-19T08:58:56.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.795+0000 7f14e1ff7740 1 -- 172.21.15.92:0/4042799898 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14d00c5820 con 0x5568a5ad92d0 2024-09-19T08:58:56.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.796+0000 7f14b7fff640 1 -- 172.21.15.92:0/4042799898 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f14c8031870 con 0x5568a5ad92d0 2024-09-19T08:58:56.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.796+0000 7f14e1ff7740 10 client.25328 fetch_fsmap learned FSMap version 19 2024-09-19T08:58:56.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.796+0000 7f14e1ff7740 1 -- 172.21.15.92:0/4042799898 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5568a5aea200 con 0x5568a5ad92d0 2024-09-19T08:58:56.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.796+0000 7f14b7fff640 1 -- 172.21.15.92:0/4042799898 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14d00c5820 con 0x5568a5ad92d0 2024-09-19T08:58:56.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.796+0000 7f14b7fff640 1 -- 172.21.15.92:0/4042799898 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f14c803c9d0 con 0x5568a5ad92d0 2024-09-19T08:58:56.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.796+0000 7f14e1ff7740 10 client.25328 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:58:56.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.796+0000 7f14e1ff7740 10 client.25328 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T08:58:56.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.796+0000 7f14e1ff7740 20 client.25328 populate_metadata read hostname 'smithi092' 2024-09-19T08:58:56.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.796+0000 7f14e1ff7740 1 --2- 172.21.15.92:0/4042799898 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5568a5b6afa0 0x5568a5b6d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:56.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.796+0000 7f14e1ff7740 4 client.25328 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:58:56.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.796+0000 7f14e1ff7740 1 -- 172.21.15.92:0/4042799898 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5568a5a43d70 con 0x5568a5b6afa0 2024-09-19T08:58:56.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.797+0000 7f14dcf22640 1 --2- 172.21.15.92:0/4042799898 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5568a5b6afa0 0x5568a5b6d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:56.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.797+0000 7f14dcf22640 1 --2- 172.21.15.92:0/4042799898 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5568a5b6afa0 0x5568a5b6d3c0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e3c3a560f43812c server_cookie=e93e0b73abcf2b45 in_seq=0 out_seq=0 2024-09-19T08:58:56.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.797+0000 7f14b7fff640 10 client.25328 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:56.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.822+0000 7f14b7fff640 1 -- 172.21.15.92:0/4042799898 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5568a5a43d70 con 0x5568a5b6afa0 2024-09-19T08:58:56.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.822+0000 7f14b7fff640 10 client.25328 handle_command_reply: tid=0 2024-09-19T08:58:56.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.823+0000 7f14e1ff7740 1 client.25328 shutdown 2024-09-19T08:58:56.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.823+0000 7f14e1ff7740 1 -- 172.21.15.92:0/4042799898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5568a5ad92d0 msgr2=0x5568a5ae78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:56.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.823+0000 7f14e1ff7740 1 --2- 172.21.15.92:0/4042799898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5568a5ad92d0 0x5568a5ae78d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f14c801fd00 tx=0x7f14c801f6d0 comp rx=0 tx=0).stop 2024-09-19T08:58:56.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.823+0000 7f14e1ff7740 1 -- 172.21.15.92:0/4042799898 shutdown_connections 2024-09-19T08:58:56.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.823+0000 7f14e1ff7740 1 --2- 172.21.15.92:0/4042799898 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5568a5b6afa0 0x5568a5b6d3c0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:56.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.823+0000 7f14e1ff7740 1 --2- 172.21.15.92:0/4042799898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568a5ade360 0x5568a5ae8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:56.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.823+0000 7f14e1ff7740 1 --2- 172.21.15.92:0/4042799898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5568a5ad92d0 0x5568a5ae78d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:56.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.823+0000 7f14e1ff7740 1 --2- 172.21.15.92:0/4042799898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5568a5ad8990 0x5568a5ae7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:56.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.823+0000 7f14e1ff7740 1 -- 172.21.15.92:0/4042799898 >> 172.21.15.92:0/4042799898 conn(0x5568a5ad4000 msgr2=0x5568a5ae2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:56.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.823+0000 7f14b7fff640 0 client.25328 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:58:56.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.823+0000 7f14e1ff7740 1 -- 172.21.15.92:0/4042799898 shutdown_connections 2024-09-19T08:58:56.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.823+0000 7f14e1ff7740 1 -- 172.21.15.92:0/4042799898 wait complete. 2024-09-19T08:58:56.825 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.823+0000 7f14e1ff7740 20 client.25328 trim_cache size 0 max 16384 2024-09-19T08:58:56.825 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T08:58:56.825 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T08:58:56.825 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T08:58:56.825 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T08:58:56.826 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.824+0000 7f14df186640 1 -- 172.21.15.92:0/348286254 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f14c00a33f0 msgr2=0x7f14c00a58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:56.826 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.824+0000 7f14df186640 1 --2- 172.21.15.92:0/348286254 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f14c00a33f0 0x7f14c00a58b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f14c80096c0 tx=0x7f14c8009260 comp rx=0 tx=0).stop 2024-09-19T08:58:56.826 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.824+0000 7f14df186640 1 -- 172.21.15.92:0/348286254 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14d8100a50 msgr2=0x7f14d81a6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:56.826 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.824+0000 7f14df186640 1 --2- 172.21.15.92:0/348286254 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14d8100a50 0x7f14d81a6bd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f14d002a940 tx=0x7f14d000d510 comp rx=0 tx=0).stop 2024-09-19T08:58:56.826 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.824+0000 7f14df186640 1 -- 172.21.15.92:0/348286254 shutdown_connections 2024-09-19T08:58:56.826 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.824+0000 7f14df186640 1 --2- 172.21.15.92:0/348286254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14d8102600 0x7f14d81ae180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:56.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.824+0000 7f14df186640 1 --2- 172.21.15.92:0/348286254 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f14c00a33f0 0x7f14c00a58b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:56.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.824+0000 7f14df186640 1 --2- 172.21.15.92:0/348286254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14d8101c40 0x7f14d81a7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:56.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.824+0000 7f14df186640 1 --2- 172.21.15.92:0/348286254 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14d8100a50 0x7f14d81a6bd0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:56.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.824+0000 7f14df186640 1 -- 172.21.15.92:0/348286254 >> 172.21.15.92:0/348286254 conn(0x7f14d80fc1b0 msgr2=0x7f14d8105010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:56.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.824+0000 7f14df186640 1 -- 172.21.15.92:0/348286254 shutdown_connections 2024-09-19T08:58:56.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:58:56.824+0000 7f14df186640 1 -- 172.21.15.92:0/348286254 wait complete. 2024-09-19T08:58:57.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:57 smithi092 ceph-mon[31407]: pgmap v404: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 13 MiB/s wr, 927 op/s 2024-09-19T08:58:57.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:57 smithi167 ceph-mon[35359]: pgmap v404: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 13 MiB/s wr, 927 op/s 2024-09-19T08:58:57.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:57 smithi190 ceph-mon[35358]: pgmap v404: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 13 MiB/s wr, 927 op/s 2024-09-19T08:58:59.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:58:59 smithi092 ceph-mon[31407]: pgmap v405: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 13 MiB/s wr, 942 op/s 2024-09-19T08:58:59.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:58:59 smithi167 ceph-mon[35359]: pgmap v405: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 13 MiB/s wr, 942 op/s 2024-09-19T08:58:59.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:58:59 smithi190 ceph-mon[35358]: pgmap v405: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 13 MiB/s wr, 942 op/s 2024-09-19T08:59:00.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 135.0 s, 5310.6 tps, lat 18.791 ms stddev 18.745 2024-09-19T08:59:01.674 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:01 smithi190 ceph-mon[35358]: pgmap v406: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 16 MiB/s wr, 1.06k op/s 2024-09-19T08:59:01.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:01 smithi092 ceph-mon[31407]: pgmap v406: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 16 MiB/s wr, 1.06k op/s 2024-09-19T08:59:01.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:01 smithi167 ceph-mon[35359]: pgmap v406: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 16 MiB/s wr, 1.06k op/s 2024-09-19T08:59:03.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:03 smithi092 ceph-mon[31407]: pgmap v407: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 14 MiB/s wr, 970 op/s 2024-09-19T08:59:03.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:03 smithi167 ceph-mon[35359]: pgmap v407: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 14 MiB/s wr, 970 op/s 2024-09-19T08:59:03.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:03 smithi190 ceph-mon[35358]: pgmap v407: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 14 MiB/s wr, 970 op/s 2024-09-19T08:59:05.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:05 smithi092 ceph-mon[31407]: pgmap v408: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 18 MiB/s wr, 1.17k op/s 2024-09-19T08:59:05.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 140.0 s, 6553.4 tps, lat 15.296 ms stddev 17.185 2024-09-19T08:59:05.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:05 smithi167 ceph-mon[35359]: pgmap v408: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 18 MiB/s wr, 1.17k op/s 2024-09-19T08:59:05.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:05 smithi190 ceph-mon[35358]: pgmap v408: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 18 MiB/s wr, 1.17k op/s 2024-09-19T08:59:07.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:07 smithi092 ceph-mon[31407]: pgmap v409: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 13 MiB/s wr, 884 op/s 2024-09-19T08:59:07.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:07 smithi167 ceph-mon[35359]: pgmap v409: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 13 MiB/s wr, 884 op/s 2024-09-19T08:59:07.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:07 smithi190 ceph-mon[35358]: pgmap v409: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 13 MiB/s wr, 884 op/s 2024-09-19T08:59:08.776 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:59:09.173 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:59:09.570 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:09 smithi092 ceph-mon[31407]: pgmap v410: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 16 MiB/s wr, 1.01k op/s 2024-09-19T08:59:09.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:09 smithi167 ceph-mon[35359]: pgmap v410: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 16 MiB/s wr, 1.01k op/s 2024-09-19T08:59:09.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:09 smithi190 ceph-mon[35358]: pgmap v410: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 16 MiB/s wr, 1.01k op/s 2024-09-19T08:59:09.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.700+0000 7f1fb273b640 1 -- 172.21.15.92:0/1899609757 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fac100e20 msgr2=0x7f1fac101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:09.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.700+0000 7f1fb273b640 1 --2- 172.21.15.92:0/1899609757 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fac100e20 0x7f1fac101200 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c00d940 tx=0x7f1f9c02c430 comp rx=0 tx=0).stop 2024-09-19T08:59:09.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.700+0000 7f1fb273b640 1 -- 172.21.15.92:0/1899609757 shutdown_connections 2024-09-19T08:59:09.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.700+0000 7f1fb273b640 1 --2- 172.21.15.92:0/1899609757 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fac102ef0 0x7f1fac10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.700+0000 7f1fb273b640 1 --2- 172.21.15.92:0/1899609757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1fac102570 0x7f1fac1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.700+0000 7f1fb273b640 1 --2- 172.21.15.92:0/1899609757 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fac100e20 0x7f1fac101200 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.700+0000 7f1fb273b640 1 -- 172.21.15.92:0/1899609757 >> 172.21.15.92:0/1899609757 conn(0x7f1fac0fc7d0 msgr2=0x7f1fac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:09.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.700+0000 7f1fb273b640 1 -- 172.21.15.92:0/1899609757 shutdown_connections 2024-09-19T08:59:09.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.700+0000 7f1fb273b640 1 -- 172.21.15.92:0/1899609757 wait complete. 2024-09-19T08:59:09.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.701+0000 7f1fb273b640 1 Processor -- start 2024-09-19T08:59:09.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.701+0000 7f1fb273b640 1 -- start start 2024-09-19T08:59:09.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.702+0000 7f1fb273b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fac100e20 0x7f1fac196360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.702+0000 7f1fb273b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fac102570 0x7f1fac1968a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.703+0000 7f1fb273b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1fac102ef0 0x7f1fac19ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.703+0000 7f1fb273b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1fac10fec0 con 0x7f1fac100e20 2024-09-19T08:59:09.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.703+0000 7f1fb273b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1fac10fd40 con 0x7f1fac102ef0 2024-09-19T08:59:09.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.703+0000 7f1fb273b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1fac110040 con 0x7f1fac102570 2024-09-19T08:59:09.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.703+0000 7f1fab7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fac102570 0x7f1fac1968a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.703+0000 7f1fabfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fac100e20 0x7f1fac196360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.703+0000 7f1fab7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fac102570 0x7f1fac1968a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:50524/0 (socket says 172.21.15.92:50524) 2024-09-19T08:59:09.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.703+0000 7f1fab7fe640 1 -- 172.21.15.92:0/1717536755 learned_addr learned my addr 172.21.15.92:0/1717536755 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:09.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.703+0000 7f1fb0cd8640 1 --2- 172.21.15.92:0/1717536755 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1fac102ef0 0x7f1fac19ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.703+0000 7f1fab7fe640 1 -- 172.21.15.92:0/1717536755 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1fac102ef0 msgr2=0x7f1fac19ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:09.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.703+0000 7f1fab7fe640 1 --2- 172.21.15.92:0/1717536755 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1fac102ef0 0x7f1fac19ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.703+0000 7f1fab7fe640 1 -- 172.21.15.92:0/1717536755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fac100e20 msgr2=0x7f1fac196360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:09.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.703+0000 7f1fab7fe640 1 --2- 172.21.15.92:0/1717536755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fac100e20 0x7f1fac196360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.703+0000 7f1fab7fe640 1 -- 172.21.15.92:0/1717536755 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fac19b310 con 0x7f1fac102570 2024-09-19T08:59:09.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.703+0000 7f1fb0cd8640 1 --2- 172.21.15.92:0/1717536755 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1fac102ef0 0x7f1fac19ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:59:09.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.703+0000 7f1fab7fe640 1 --2- 172.21.15.92:0/1717536755 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fac102570 0x7f1fac1968a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1fa000e9f0 tx=0x7f1fa000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:09.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.704+0000 7f1fa97fa640 1 -- 172.21.15.92:0/1717536755 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa000cd80 con 0x7f1fac102570 2024-09-19T08:59:09.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.704+0000 7f1fa97fa640 1 -- 172.21.15.92:0/1717536755 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fa0005500 con 0x7f1fac102570 2024-09-19T08:59:09.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.704+0000 7f1fb273b640 1 -- 172.21.15.92:0/1717536755 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fac19b600 con 0x7f1fac102570 2024-09-19T08:59:09.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.704+0000 7f1fa97fa640 1 -- 172.21.15.92:0/1717536755 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa0010690 con 0x7f1fac102570 2024-09-19T08:59:09.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.704+0000 7f1fb273b640 1 -- 172.21.15.92:0/1717536755 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fac1a2ee0 con 0x7f1fac102570 2024-09-19T08:59:09.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.707+0000 7f1fb4b14740 1 Processor -- start 2024-09-19T08:59:09.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.707+0000 7f1fb4b14740 1 -- start start 2024-09-19T08:59:09.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.708+0000 7f1fb4b14740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557cf7596360 0x557cf7596740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.708+0000 7f1fb4b14740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557cf7596c80 0x557cf75a5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.708+0000 7f1fb4b14740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557cf75a5a90 0x557cf75a7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.708+0000 7f1fb4b14740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557cf74fc2e0 con 0x557cf75a5a90 2024-09-19T08:59:09.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.708+0000 7f1fb4b14740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x557cf74a3ce0 con 0x557cf7596c80 2024-09-19T08:59:09.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.708+0000 7f1fb4b14740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x557cf74f82a0 con 0x557cf7596360 2024-09-19T08:59:09.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.708+0000 7f1fabfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557cf7596c80 0x557cf75a5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.708+0000 7f1fabfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557cf7596c80 0x557cf75a5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:44014/0 (socket says 172.21.15.92:44014) 2024-09-19T08:59:09.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.708+0000 7f1fabfff640 1 -- 172.21.15.92:0/4270672197 learned_addr learned my addr 172.21.15.92:0/4270672197 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:09.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.708+0000 7f1fb0cd8640 1 --2- 172.21.15.92:0/4270672197 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557cf7596360 0x557cf7596740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.708+0000 7f1fa97fa640 1 -- 172.21.15.92:0/1717536755 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1fa0004f60 con 0x7f1fac102570 2024-09-19T08:59:09.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.709+0000 7f1fb0cd8640 1 -- 172.21.15.92:0/4270672197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557cf7596c80 msgr2=0x557cf75a5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:09.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.709+0000 7f1fb0cd8640 1 --2- 172.21.15.92:0/4270672197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557cf7596c80 0x557cf75a5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.709+0000 7f1fb0cd8640 1 -- 172.21.15.92:0/4270672197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557cf75a5a90 msgr2=0x557cf75a7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:09.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.709+0000 7f1fb0cd8640 1 --2- 172.21.15.92:0/4270672197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557cf75a5a90 0x557cf75a7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.709+0000 7f1fb0cd8640 1 -- 172.21.15.92:0/4270672197 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cf7488440 con 0x557cf7596360 2024-09-19T08:59:09.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.709+0000 7f1fabfff640 1 --2- 172.21.15.92:0/4270672197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557cf7596c80 0x557cf75a5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:09.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.709+0000 7f1fb0cd8640 1 --2- 172.21.15.92:0/4270672197 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557cf7596360 0x557cf7596740 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4009f40 tx=0x7f1fa400f7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=961f211452ef72f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:09.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.709+0000 7f1f927fc640 1 -- 172.21.15.92:0/4270672197 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa4011640 con 0x557cf7596360 2024-09-19T08:59:09.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.709+0000 7f1f927fc640 1 -- 172.21.15.92:0/4270672197 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fa4017070 con 0x557cf7596360 2024-09-19T08:59:09.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.710+0000 7f1f927fc640 1 -- 172.21.15.92:0/4270672197 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa4010d00 con 0x557cf7596360 2024-09-19T08:59:09.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.710+0000 7f1fa97fa640 1 --2- 172.21.15.92:0/1717536755 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1f940a3340 0x7f1f940a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.710+0000 7f1fa97fa640 1 -- 172.21.15.92:0/1717536755 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1fa00cfda0 con 0x7f1fac102570 2024-09-19T08:59:09.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.710+0000 7f1fabfff640 1 --2- 172.21.15.92:0/1717536755 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1f940a3340 0x7f1f940a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.710+0000 7f1fb4b14740 1 -- 172.21.15.92:0/4270672197 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557cf7596360 msgr2=0x557cf7596740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:09.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.710+0000 7f1fb4b14740 1 --2- 172.21.15.92:0/4270672197 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557cf7596360 0x557cf7596740 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4009f40 tx=0x7f1fa400f7f0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.710+0000 7f1fb4b14740 1 -- 172.21.15.92:0/4270672197 shutdown_connections 2024-09-19T08:59:09.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.710+0000 7f1fb4b14740 1 --2- 172.21.15.92:0/4270672197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557cf75a5a90 0x557cf75a7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.710+0000 7f1fb4b14740 1 --2- 172.21.15.92:0/4270672197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557cf7596c80 0x557cf75a5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.710+0000 7f1fb4b14740 1 --2- 172.21.15.92:0/4270672197 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557cf7596360 0x557cf7596740 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.710+0000 7f1fb4b14740 1 -- 172.21.15.92:0/4270672197 >> 172.21.15.92:0/4270672197 conn(0x557cf7592a30 msgr2=0x557cf7592e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:09.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.711+0000 7f1fb4b14740 1 -- 172.21.15.92:0/4270672197 shutdown_connections 2024-09-19T08:59:09.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.711+0000 7f1fb4b14740 1 -- 172.21.15.92:0/4270672197 wait complete. 2024-09-19T08:59:09.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.711+0000 7f1fabfff640 1 --2- 172.21.15.92:0/1717536755 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1f940a3340 0x7f1f940a5800 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c0057c0 tx=0x7f1f9c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:09.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.711+0000 7f1fb4b14740 1 -- start start 2024-09-19T08:59:09.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.711+0000 7f1fb4b14740 1 Processor -- start 2024-09-19T08:59:09.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.712+0000 7f1fb4b14740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557cf7596360 0x557cf75a5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.712+0000 7f1fb4b14740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557cf7596c80 0x557cf759e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.712+0000 7f1fb4b14740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557cf75a5a90 0x557cf759e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.712+0000 7f1fb4b14740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557cf75a86b0 con 0x557cf7596360 2024-09-19T08:59:09.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.712+0000 7f1fb4b14740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x557cf74b7050 con 0x557cf75a5a90 2024-09-19T08:59:09.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.712+0000 7f1fb4b14740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x557cf75a8830 con 0x557cf7596c80 2024-09-19T08:59:09.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.712+0000 7f1fb4b14740 10 client.0 _ll_register_callbacks cb 0x557cf74f7160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:09.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.713+0000 7f1fab7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557cf7596c80 0x557cf759e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.713+0000 7f1fabfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557cf7596360 0x557cf75a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.713+0000 7f1fabfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557cf7596360 0x557cf75a5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46354/0 (socket says 172.21.15.92:46354) 2024-09-19T08:59:09.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.713+0000 7f1fabfff640 1 -- 172.21.15.92:0/197347028 learned_addr learned my addr 172.21.15.92:0/197347028 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:09.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.713+0000 7f1fb0cd8640 1 --2- 172.21.15.92:0/197347028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557cf75a5a90 0x557cf759e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.713+0000 7f1fb0cd8640 1 -- 172.21.15.92:0/197347028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557cf7596c80 msgr2=0x557cf759e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:09.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.713+0000 7f1fb0cd8640 1 --2- 172.21.15.92:0/197347028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557cf7596c80 0x557cf759e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.713+0000 7f1fb0cd8640 1 -- 172.21.15.92:0/197347028 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557cf7596360 msgr2=0x557cf75a5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:09.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.713+0000 7f1fb0cd8640 1 --2- 172.21.15.92:0/197347028 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557cf7596360 0x557cf75a5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.713+0000 7f1fb0cd8640 1 -- 172.21.15.92:0/197347028 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cf726d3c0 con 0x557cf75a5a90 2024-09-19T08:59:09.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.713+0000 7f1fab7fe640 1 --2- 172.21.15.92:0/197347028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557cf7596c80 0x557cf759e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:09.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.713+0000 7f1fb0cd8640 1 --2- 172.21.15.92:0/197347028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557cf75a5a90 0x557cf759e810 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4010880 tx=0x7f1fa4010600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11ef240a0e91dcf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:09.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.713+0000 7f1f8b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T08:59:09.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.714+0000 7f1f8b7fe640 1 -- 172.21.15.92:0/197347028 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa4010c90 con 0x557cf75a5a90 2024-09-19T08:59:09.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.714+0000 7f1f8b7fe640 1 -- 172.21.15.92:0/197347028 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1fa4004a40 con 0x557cf75a5a90 2024-09-19T08:59:09.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.714+0000 7f1fb4b14740 1 -- 172.21.15.92:0/197347028 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1fa4017070 con 0x557cf75a5a90 2024-09-19T08:59:09.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.714+0000 7f1f8b7fe640 1 -- 172.21.15.92:0/197347028 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1fa4010e30 con 0x557cf75a5a90 2024-09-19T08:59:09.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.714+0000 7f1fb4b14740 10 client.25337 fetch_fsmap learned FSMap version 19 2024-09-19T08:59:09.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.714+0000 7f1fb4b14740 1 -- 172.21.15.92:0/197347028 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x557cf75b8550 con 0x557cf75a5a90 2024-09-19T08:59:09.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.714+0000 7f1f8b7fe640 1 -- 172.21.15.92:0/197347028 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fa4017070 con 0x557cf75a5a90 2024-09-19T08:59:09.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.714+0000 7f1f8b7fe640 1 -- 172.21.15.92:0/197347028 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1fa402f050 con 0x557cf75a5a90 2024-09-19T08:59:09.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.715+0000 7f1fb4b14740 10 client.25337 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:59:09.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.715+0000 7f1fb4b14740 10 client.25337 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:59:09.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.715+0000 7f1fb4b14740 20 client.25337 populate_metadata read hostname 'smithi092' 2024-09-19T08:59:09.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.715+0000 7f1fb4b14740 1 --2- 172.21.15.92:0/197347028 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557cf75b98a0 0x557cf75bbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.715+0000 7f1fb4b14740 4 client.25337 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:59:09.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.715+0000 7f1fb4b14740 1 -- 172.21.15.92:0/197347028 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557cf7509850 con 0x557cf75b98a0 2024-09-19T08:59:09.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.716+0000 7f1fabfff640 1 --2- 172.21.15.92:0/197347028 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557cf75b98a0 0x557cf75bbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.716+0000 7f1f8b7fe640 10 client.25337 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:09.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.716+0000 7f1fabfff640 1 --2- 172.21.15.92:0/197347028 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557cf75b98a0 0x557cf75bbc90 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6603bd4166f0f79 server_cookie=e9093fd118582696 in_seq=0 out_seq=0 2024-09-19T08:59:09.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.717+0000 7f1f8b7fe640 1 -- 172.21.15.92:0/197347028 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557cf7509850 con 0x557cf75b98a0 2024-09-19T08:59:09.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.717+0000 7f1f8b7fe640 10 client.25337 handle_command_reply: tid=0 2024-09-19T08:59:09.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.717+0000 7f1fb4b14740 1 client.25337 shutdown 2024-09-19T08:59:09.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.717+0000 7f1fb4b14740 1 -- 172.21.15.92:0/197347028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557cf75a5a90 msgr2=0x557cf759e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:09.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.717+0000 7f1fb4b14740 1 --2- 172.21.15.92:0/197347028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557cf75a5a90 0x557cf759e810 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4010880 tx=0x7f1fa4010600 comp rx=0 tx=0).stop 2024-09-19T08:59:09.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.717+0000 7f1fb4b14740 1 -- 172.21.15.92:0/197347028 shutdown_connections 2024-09-19T08:59:09.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.717+0000 7f1fb4b14740 1 --2- 172.21.15.92:0/197347028 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557cf75b98a0 0x557cf75bbc90 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.717+0000 7f1fb4b14740 1 --2- 172.21.15.92:0/197347028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557cf75a5a90 0x557cf759e810 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.717+0000 7f1fb4b14740 1 --2- 172.21.15.92:0/197347028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557cf7596c80 0x557cf759e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.717+0000 7f1fb4b14740 1 --2- 172.21.15.92:0/197347028 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557cf7596360 0x557cf75a5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.717+0000 7f1fb4b14740 1 -- 172.21.15.92:0/197347028 >> 172.21.15.92:0/197347028 conn(0x557cf7592a30 msgr2=0x557cf7591b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:09.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.717+0000 7f1f8b7fe640 0 client.25337 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:09.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.718+0000 7f1fb4b14740 1 -- 172.21.15.92:0/197347028 shutdown_connections 2024-09-19T08:59:09.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.718+0000 7f1fb4b14740 1 -- 172.21.15.92:0/197347028 wait complete. 2024-09-19T08:59:09.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.718+0000 7f1fb4b14740 20 client.25337 trim_cache size 0 max 16384 2024-09-19T08:59:09.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.744+0000 7f1fb4b14740 1 Processor -- start 2024-09-19T08:59:09.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.744+0000 7f1fb4b14740 1 -- start start 2024-09-19T08:59:09.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.744+0000 7f1fb4b14740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557cf7596360 0x557cf7597e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.744+0000 7f1fb4b14740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557cf7596c80 0x557cf759b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.744+0000 7f1fb4b14740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557cf75a5a90 0x557cf759ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.745+0000 7f1fab7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557cf7596c80 0x557cf759b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.745+0000 7f1fb4b14740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1fac1a9400 con 0x557cf75a5a90 2024-09-19T08:59:09.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.745+0000 7f1fb4b14740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1fac1abca0 con 0x557cf7596c80 2024-09-19T08:59:09.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.745+0000 7f1fab7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557cf7596c80 0x557cf759b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:44022/0 (socket says 172.21.15.92:44022) 2024-09-19T08:59:09.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.745+0000 7f1fab7fe640 1 -- 172.21.15.92:0/4124386064 learned_addr learned my addr 172.21.15.92:0/4124386064 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:09.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.745+0000 7f1fb4b14740 1 -- 172.21.15.92:0/4124386064 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1fac1a9a90 con 0x557cf7596360 2024-09-19T08:59:09.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.745+0000 7f1fb0cd8640 1 --2- 172.21.15.92:0/4124386064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557cf75a5a90 0x557cf759ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.745+0000 7f1fabfff640 1 --2- 172.21.15.92:0/4124386064 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557cf7596360 0x557cf7597e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.745+0000 7f1fb0cd8640 1 -- 172.21.15.92:0/4124386064 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557cf7596360 msgr2=0x557cf7597e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:09.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.745+0000 7f1fb0cd8640 1 --2- 172.21.15.92:0/4124386064 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557cf7596360 0x557cf7597e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.745+0000 7f1fb0cd8640 1 -- 172.21.15.92:0/4124386064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557cf7596c80 msgr2=0x557cf759b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:09.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.745+0000 7f1fb0cd8640 1 --2- 172.21.15.92:0/4124386064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557cf7596c80 0x557cf759b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.745+0000 7f1fb0cd8640 1 -- 172.21.15.92:0/4124386064 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cf75a5820 con 0x557cf75a5a90 2024-09-19T08:59:09.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.745+0000 7f1fabfff640 1 --2- 172.21.15.92:0/4124386064 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557cf7596360 0x557cf7597e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:59:09.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.745+0000 7f1fb0cd8640 1 --2- 172.21.15.92:0/4124386064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557cf75a5a90 0x557cf759ba70 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f1fa40050c0 tx=0x7f1fa400f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b15ef250dbf604 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:09.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.746+0000 7f1f91ffb640 1 -- 172.21.15.92:0/4124386064 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa4020020 con 0x557cf75a5a90 2024-09-19T08:59:09.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.746+0000 7f1f91ffb640 1 -- 172.21.15.92:0/4124386064 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fa4035020 con 0x557cf75a5a90 2024-09-19T08:59:09.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.746+0000 7f1f91ffb640 1 -- 172.21.15.92:0/4124386064 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa4005140 con 0x557cf75a5a90 2024-09-19T08:59:09.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.746+0000 7f1fb4b14740 1 -- 172.21.15.92:0/4124386064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557cf75a5a90 msgr2=0x557cf759ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:09.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.747+0000 7f1fb4b14740 1 --2- 172.21.15.92:0/4124386064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557cf75a5a90 0x557cf759ba70 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f1fa40050c0 tx=0x7f1fa400f7f0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.747+0000 7f1fb4b14740 1 -- 172.21.15.92:0/4124386064 shutdown_connections 2024-09-19T08:59:09.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.747+0000 7f1fb4b14740 1 --2- 172.21.15.92:0/4124386064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557cf75a5a90 0x557cf759ba70 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.747+0000 7f1fb4b14740 1 --2- 172.21.15.92:0/4124386064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557cf7596c80 0x557cf759b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.747+0000 7f1fb4b14740 1 --2- 172.21.15.92:0/4124386064 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557cf7596360 0x557cf7597e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.747+0000 7f1fb4b14740 1 -- 172.21.15.92:0/4124386064 >> 172.21.15.92:0/4124386064 conn(0x557cf7592a30 msgr2=0x557cf75a2360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:09.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.747+0000 7f1fb4b14740 1 -- 172.21.15.92:0/4124386064 shutdown_connections 2024-09-19T08:59:09.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.747+0000 7f1fb4b14740 1 -- 172.21.15.92:0/4124386064 wait complete. 2024-09-19T08:59:09.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.747+0000 7f1fb4b14740 1 -- start start 2024-09-19T08:59:09.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.747+0000 7f1fb4b14740 1 Processor -- start 2024-09-19T08:59:09.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.748+0000 7f1fb4b14740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557cf7596360 0x557cf75b5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.748+0000 7f1fb4b14740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557cf7596c80 0x557cf75b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.748+0000 7f1fb4b14740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557cf75a5a90 0x557cf761b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.748+0000 7f1fb4b14740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1fac1aa160 con 0x557cf75a5a90 2024-09-19T08:59:09.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.748+0000 7f1fb4b14740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1fac1ab5d0 con 0x557cf7596360 2024-09-19T08:59:09.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.748+0000 7f1fb4b14740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1fac1aa830 con 0x557cf7596c80 2024-09-19T08:59:09.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.748+0000 7f1fb4b14740 10 client.0 _ll_register_callbacks cb 0x7f1fa4015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:09.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.748+0000 7f1fabfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557cf7596360 0x557cf75b5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.748+0000 7f1fab7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557cf7596c80 0x557cf75b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.748+0000 7f1fab7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557cf7596c80 0x557cf75b62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:50552/0 (socket says 172.21.15.92:50552) 2024-09-19T08:59:09.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.748+0000 7f1fab7fe640 1 -- 172.21.15.92:0/3127139234 learned_addr learned my addr 172.21.15.92:0/3127139234 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:09.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.748+0000 7f1fb0cd8640 1 --2- 172.21.15.92:0/3127139234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557cf75a5a90 0x557cf761b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.749+0000 7f1fab7fe640 1 -- 172.21.15.92:0/3127139234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557cf7596360 msgr2=0x557cf75b5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:09.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.749+0000 7f1fab7fe640 1 --2- 172.21.15.92:0/3127139234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557cf7596360 0x557cf75b5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.749+0000 7f1fab7fe640 1 -- 172.21.15.92:0/3127139234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557cf75a5a90 msgr2=0x557cf761b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:09.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.749+0000 7f1fab7fe640 1 --2- 172.21.15.92:0/3127139234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557cf75a5a90 0x557cf761b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.749+0000 7f1fab7fe640 1 -- 172.21.15.92:0/3127139234 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cf761b840 con 0x557cf7596c80 2024-09-19T08:59:09.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.749+0000 7f1fab7fe640 1 --2- 172.21.15.92:0/3127139234 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557cf7596c80 0x557cf75b62d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1fa000c6a0 tx=0x7f1fa009bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d295ffa7a1443a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:09.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.749+0000 7f1f8b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T08:59:09.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.749+0000 7f1f8b7fe640 1 -- 172.21.15.92:0/3127139234 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa00a0730 con 0x557cf7596c80 2024-09-19T08:59:09.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.749+0000 7f1f8b7fe640 1 -- 172.21.15.92:0/3127139234 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1fa00d1040 con 0x557cf7596c80 2024-09-19T08:59:09.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.749+0000 7f1fb4b14740 1 -- 172.21.15.92:0/3127139234 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1fa4035020 con 0x557cf7596c80 2024-09-19T08:59:09.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.749+0000 7f1f8b7fe640 1 -- 172.21.15.92:0/3127139234 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1fa00a4ff0 con 0x557cf7596c80 2024-09-19T08:59:09.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.749+0000 7f1fb4b14740 10 client.25312 fetch_fsmap learned FSMap version 19 2024-09-19T08:59:09.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.749+0000 7f1fb4b14740 1 -- 172.21.15.92:0/3127139234 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x557cf7623d50 con 0x557cf7596c80 2024-09-19T08:59:09.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.749+0000 7f1f8b7fe640 1 -- 172.21.15.92:0/3127139234 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fa0005250 con 0x557cf7596c80 2024-09-19T08:59:09.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.750+0000 7f1f8b7fe640 1 -- 172.21.15.92:0/3127139234 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1fa009b7d0 con 0x557cf7596c80 2024-09-19T08:59:09.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.750+0000 7f1fb4b14740 10 client.25312 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:59:09.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.750+0000 7f1fb4b14740 10 client.25312 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:59:09.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.750+0000 7f1fb4b14740 20 client.25312 populate_metadata read hostname 'smithi092' 2024-09-19T08:59:09.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.750+0000 7f1fb4b14740 1 --2- 172.21.15.92:0/3127139234 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557cf7624500 0x557cf7626920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.750+0000 7f1fb4b14740 4 client.25312 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:59:09.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.750+0000 7f1fb4b14740 1 -- 172.21.15.92:0/3127139234 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f1fa4035020 con 0x557cf7624500 2024-09-19T08:59:09.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.750+0000 7f1fabfff640 1 --2- 172.21.15.92:0/3127139234 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557cf7624500 0x557cf7626920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.751+0000 7f1fabfff640 1 --2- 172.21.15.92:0/3127139234 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557cf7624500 0x557cf7626920 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d482177c7fa2e9f5 server_cookie=8226109919816845 in_seq=0 out_seq=0 2024-09-19T08:59:09.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.751+0000 7f1f8b7fe640 10 client.25312 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:09.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.751+0000 7f1f8b7fe640 1 -- 172.21.15.92:0/3127139234 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f1fa4035020 con 0x557cf7624500 2024-09-19T08:59:09.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.751+0000 7f1f8b7fe640 10 client.25312 handle_command_reply: tid=0 2024-09-19T08:59:09.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.751+0000 7f1fb4b14740 1 client.25312 shutdown 2024-09-19T08:59:09.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.751+0000 7f1fb4b14740 1 -- 172.21.15.92:0/3127139234 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557cf7596c80 msgr2=0x557cf75b62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:09.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.751+0000 7f1fb4b14740 1 --2- 172.21.15.92:0/3127139234 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557cf7596c80 0x557cf75b62d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1fa000c6a0 tx=0x7f1fa009bf80 comp rx=0 tx=0).stop 2024-09-19T08:59:09.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.751+0000 7f1fb4b14740 1 -- 172.21.15.92:0/3127139234 shutdown_connections 2024-09-19T08:59:09.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.751+0000 7f1fb4b14740 1 --2- 172.21.15.92:0/3127139234 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557cf7624500 0x557cf7626920 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.751+0000 7f1fb4b14740 1 --2- 172.21.15.92:0/3127139234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557cf75a5a90 0x557cf761b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.751+0000 7f1fb4b14740 1 --2- 172.21.15.92:0/3127139234 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557cf7596c80 0x557cf75b62d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.751+0000 7f1fb4b14740 1 --2- 172.21.15.92:0/3127139234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557cf7596360 0x557cf75b5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.751+0000 7f1fb4b14740 1 -- 172.21.15.92:0/3127139234 >> 172.21.15.92:0/3127139234 conn(0x557cf7592a30 msgr2=0x557cf75a2360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:09.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.751+0000 7f1f8b7fe640 0 client.25312 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:09.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.752+0000 7f1fb4b14740 1 -- 172.21.15.92:0/3127139234 shutdown_connections 2024-09-19T08:59:09.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.752+0000 7f1fb4b14740 1 -- 172.21.15.92:0/3127139234 wait complete. 2024-09-19T08:59:09.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.752+0000 7f1fb4b14740 20 client.25312 trim_cache size 0 max 16384 2024-09-19T08:59:09.762 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T08:59:09.762 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-19T08:59:09.763 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {} 2024-09-19T08:59:09.763 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T08:59:09.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.752+0000 7f1fb273b640 1 -- 172.21.15.92:0/1717536755 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1f940a3340 msgr2=0x7f1f940a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:09.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.752+0000 7f1fb273b640 1 --2- 172.21.15.92:0/1717536755 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1f940a3340 0x7f1f940a5800 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c0057c0 tx=0x7f1f9c000bc0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.752+0000 7f1fb273b640 1 -- 172.21.15.92:0/1717536755 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fac102570 msgr2=0x7f1fac1968a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:09.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.752+0000 7f1fb273b640 1 --2- 172.21.15.92:0/1717536755 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fac102570 0x7f1fac1968a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1fa000e9f0 tx=0x7f1fa000edf0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.753+0000 7f1fb273b640 1 -- 172.21.15.92:0/1717536755 shutdown_connections 2024-09-19T08:59:09.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.753+0000 7f1fb273b640 1 --2- 172.21.15.92:0/1717536755 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1fac102ef0 0x7f1fac19ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.753+0000 7f1fb273b640 1 --2- 172.21.15.92:0/1717536755 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fac102570 0x7f1fac1968a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.753+0000 7f1fb273b640 1 --2- 172.21.15.92:0/1717536755 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1f940a3340 0x7f1f940a5800 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.753+0000 7f1fb273b640 1 --2- 172.21.15.92:0/1717536755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fac100e20 0x7f1fac196360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.753+0000 7f1fb273b640 1 -- 172.21.15.92:0/1717536755 >> 172.21.15.92:0/1717536755 conn(0x7f1fac0fc7d0 msgr2=0x7f1fac0fcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:09.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.753+0000 7f1fb273b640 1 -- 172.21.15.92:0/1717536755 shutdown_connections 2024-09-19T08:59:09.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:09.754+0000 7f1fb273b640 1 -- 172.21.15.92:0/1717536755 wait complete. 2024-09-19T08:59:09.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.957+0000 7ffb215fd640 1 -- 172.21.15.92:0/2765737775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb1c102d50 msgr2=0x7ffb1c1031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:09.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.957+0000 7ffb215fd640 1 --2- 172.21.15.92:0/2765737775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb1c102d50 0x7ffb1c1031d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ffb14009ca0 tx=0x7ffb1402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.957+0000 7ffb215fd640 1 -- 172.21.15.92:0/2765737775 shutdown_connections 2024-09-19T08:59:09.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.957+0000 7ffb215fd640 1 --2- 172.21.15.92:0/2765737775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb1c103710 0x7ffb1c109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.957+0000 7ffb215fd640 1 --2- 172.21.15.92:0/2765737775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb1c102d50 0x7ffb1c1031d0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.957+0000 7ffb215fd640 1 --2- 172.21.15.92:0/2765737775 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb1c101b60 0x7ffb1c101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.957+0000 7ffb215fd640 1 -- 172.21.15.92:0/2765737775 >> 172.21.15.92:0/2765737775 conn(0x7ffb1c0fd2c0 msgr2=0x7ffb1c0ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.958+0000 7ffb215fd640 1 -- 172.21.15.92:0/2765737775 shutdown_connections 2024-09-19T08:59:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.958+0000 7ffb215fd640 1 -- 172.21.15.92:0/2765737775 wait complete. 2024-09-19T08:59:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.959+0000 7ffb215fd640 1 Processor -- start 2024-09-19T08:59:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.959+0000 7ffb215fd640 1 -- start start 2024-09-19T08:59:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.959+0000 7ffb215fd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb1c101b60 0x7ffb1c075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.959+0000 7ffb215fd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb1c102d50 0x7ffb1c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.959+0000 7ffb215fd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb1c103710 0x7ffb1c074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.959+0000 7ffb215fd640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1c10d830 con 0x7ffb1c101b60 2024-09-19T08:59:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.959+0000 7ffb215fd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1c10d6b0 con 0x7ffb1c103710 2024-09-19T08:59:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.959+0000 7ffb215fd640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1c10d9b0 con 0x7ffb1c102d50 2024-09-19T08:59:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.959+0000 7ffb1a7fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb1c102d50 0x7ffb1c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.959+0000 7ffb1a7fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb1c102d50 0x7ffb1c0745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:50560/0 (socket says 172.21.15.92:50560) 2024-09-19T08:59:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.959+0000 7ffb1a7fc640 1 -- 172.21.15.92:0/1065504419 learned_addr learned my addr 172.21.15.92:0/1065504419 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:09.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.960+0000 7ffb1b7fe640 1 --2- 172.21.15.92:0/1065504419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb1c103710 0x7ffb1c074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.960+0000 7ffb1a7fc640 1 -- 172.21.15.92:0/1065504419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb1c103710 msgr2=0x7ffb1c074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:09.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.960+0000 7ffb1affd640 1 --2- 172.21.15.92:0/1065504419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb1c101b60 0x7ffb1c075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.960+0000 7ffb1a7fc640 1 --2- 172.21.15.92:0/1065504419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb1c103710 0x7ffb1c074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.960+0000 7ffb1a7fc640 1 -- 172.21.15.92:0/1065504419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb1c101b60 msgr2=0x7ffb1c075fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:09.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.960+0000 7ffb1a7fc640 1 --2- 172.21.15.92:0/1065504419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb1c101b60 0x7ffb1c075fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.960+0000 7ffb1a7fc640 1 -- 172.21.15.92:0/1065504419 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb1c075060 con 0x7ffb1c102d50 2024-09-19T08:59:09.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.960+0000 7ffb1b7fe640 1 --2- 172.21.15.92:0/1065504419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb1c103710 0x7ffb1c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:59:09.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.960+0000 7ffb1affd640 1 --2- 172.21.15.92:0/1065504419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb1c101b60 0x7ffb1c075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:59:09.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.960+0000 7ffb1a7fc640 1 --2- 172.21.15.92:0/1065504419 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb1c102d50 0x7ffb1c0745e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ffb1402aeb0 tx=0x7ffb14003f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:09.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.961+0000 7ffb03fff640 1 -- 172.21.15.92:0/1065504419 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb14031650 con 0x7ffb1c102d50 2024-09-19T08:59:09.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.961+0000 7ffb03fff640 1 -- 172.21.15.92:0/1065504419 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb140317f0 con 0x7ffb1c102d50 2024-09-19T08:59:09.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.961+0000 7ffb215fd640 1 -- 172.21.15.92:0/1065504419 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb1c0752f0 con 0x7ffb1c102d50 2024-09-19T08:59:09.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.961+0000 7ffb03fff640 1 -- 172.21.15.92:0/1065504419 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1402fae0 con 0x7ffb1c102d50 2024-09-19T08:59:09.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.961+0000 7ffb215fd640 1 -- 172.21.15.92:0/1065504419 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb1c1a6910 con 0x7ffb1c102d50 2024-09-19T08:59:09.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.964+0000 7ffb2447f740 1 Processor -- start 2024-09-19T08:59:09.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.965+0000 7ffb2447f740 1 -- start start 2024-09-19T08:59:09.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.965+0000 7ffb2447f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559935a0b9a0 0x559935a0bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.965+0000 7ffb2447f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559935a0c2e0 0x559935a10da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.965+0000 7ffb2447f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559935a11370 0x559935a13830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.965+0000 7ffb2447f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55993596f2f0 con 0x559935a0c2e0 2024-09-19T08:59:09.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.965+0000 7ffb2447f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559935917270 con 0x559935a0b9a0 2024-09-19T08:59:09.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.965+0000 7ffb2447f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55993596b2b0 con 0x559935a11370 2024-09-19T08:59:09.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.965+0000 7ffb1b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559935a0b9a0 0x559935a0bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.965+0000 7ffb1affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559935a0c2e0 0x559935a10da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.965+0000 7ffb1b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559935a0b9a0 0x559935a0bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:44046/0 (socket says 172.21.15.92:44046) 2024-09-19T08:59:09.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.965+0000 7ffb1b7fe640 1 -- 172.21.15.92:0/2499330572 learned_addr learned my addr 172.21.15.92:0/2499330572 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:09.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.965+0000 7ffb1a7fc640 1 --2- 172.21.15.92:0/2499330572 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559935a11370 0x559935a13830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.966+0000 7ffb1b7fe640 1 -- 172.21.15.92:0/2499330572 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559935a11370 msgr2=0x559935a13830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:09.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.966+0000 7ffb1b7fe640 1 --2- 172.21.15.92:0/2499330572 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559935a11370 0x559935a13830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.966+0000 7ffb1b7fe640 1 -- 172.21.15.92:0/2499330572 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559935a0c2e0 msgr2=0x559935a10da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:09.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.966+0000 7ffb1b7fe640 1 --2- 172.21.15.92:0/2499330572 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559935a0c2e0 0x559935a10da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.966+0000 7ffb1b7fe640 1 -- 172.21.15.92:0/2499330572 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559935916340 con 0x559935a0b9a0 2024-09-19T08:59:09.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.966+0000 7ffb1affd640 1 --2- 172.21.15.92:0/2499330572 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559935a0c2e0 0x559935a10da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:59:09.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.966+0000 7ffb1a7fc640 1 --2- 172.21.15.92:0/2499330572 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559935a11370 0x559935a13830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:59:09.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.966+0000 7ffb1b7fe640 1 --2- 172.21.15.92:0/2499330572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559935a0b9a0 0x559935a0bda0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ffb10009b80 tx=0x7ffb10010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=faf2e7d656dd9b0d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:09.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.966+0000 7ffb03fff640 1 -- 172.21.15.92:0/1065504419 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ffb1402fce0 con 0x7ffb1c102d50 2024-09-19T08:59:09.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.966+0000 7ffb017fa640 1 -- 172.21.15.92:0/2499330572 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb10005020 con 0x559935a0b9a0 2024-09-19T08:59:09.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.966+0000 7ffb017fa640 1 -- 172.21.15.92:0/2499330572 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb100047a0 con 0x559935a0b9a0 2024-09-19T08:59:09.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.967+0000 7ffb017fa640 1 -- 172.21.15.92:0/2499330572 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb10012740 con 0x559935a0b9a0 2024-09-19T08:59:09.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.967+0000 7ffb2447f740 1 -- 172.21.15.92:0/2499330572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559935a0b9a0 msgr2=0x559935a0bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:09.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.967+0000 7ffb2447f740 1 --2- 172.21.15.92:0/2499330572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559935a0b9a0 0x559935a0bda0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ffb10009b80 tx=0x7ffb10010740 comp rx=0 tx=0).stop 2024-09-19T08:59:09.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.967+0000 7ffb03fff640 1 --2- 172.21.15.92:0/1065504419 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffb040a33f0 0x7ffb040a58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.967+0000 7ffb2447f740 1 -- 172.21.15.92:0/2499330572 shutdown_connections 2024-09-19T08:59:09.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.967+0000 7ffb2447f740 1 --2- 172.21.15.92:0/2499330572 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559935a11370 0x559935a13830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.967+0000 7ffb2447f740 1 --2- 172.21.15.92:0/2499330572 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559935a0c2e0 0x559935a10da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.967+0000 7ffb2447f740 1 --2- 172.21.15.92:0/2499330572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559935a0b9a0 0x559935a0bda0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.967+0000 7ffb2447f740 1 -- 172.21.15.92:0/2499330572 >> 172.21.15.92:0/2499330572 conn(0x559935a07010 msgr2=0x559935a07410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:09.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.967+0000 7ffb03fff640 1 -- 172.21.15.92:0/1065504419 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ffb140f0d90 con 0x7ffb1c102d50 2024-09-19T08:59:09.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.967+0000 7ffb1affd640 1 --2- 172.21.15.92:0/1065504419 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffb040a33f0 0x7ffb040a58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.967+0000 7ffb2447f740 1 -- 172.21.15.92:0/2499330572 shutdown_connections 2024-09-19T08:59:09.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.967+0000 7ffb2447f740 1 -- 172.21.15.92:0/2499330572 wait complete. 2024-09-19T08:59:09.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.968+0000 7ffb2447f740 1 -- start start 2024-09-19T08:59:09.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.968+0000 7ffb2447f740 1 Processor -- start 2024-09-19T08:59:09.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.968+0000 7ffb2447f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559935a0b9a0 0x559935a15c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.968+0000 7ffb2447f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559935a0c2e0 0x559935a16140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.968+0000 7ffb2447f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559935a11370 0x559935a1d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.968+0000 7ffb2447f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559935a143e0 con 0x559935a0c2e0 2024-09-19T08:59:09.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.968+0000 7ffb2447f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5599358f8290 con 0x559935a11370 2024-09-19T08:59:09.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.968+0000 7ffb1affd640 1 --2- 172.21.15.92:0/1065504419 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffb040a33f0 0x7ffb040a58b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x559935a07e90 tx=0x7ffb0c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:09.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.968+0000 7ffb2447f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x559935a14560 con 0x559935a0b9a0 2024-09-19T08:59:09.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.968+0000 7ffb2447f740 10 client.0 _ll_register_callbacks cb 0x559935929140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.969+0000 7ffb1affd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559935a0b9a0 0x559935a15c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.969+0000 7ffb1a7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559935a0c2e0 0x559935a16140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.969+0000 7ffb1a7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559935a0c2e0 0x559935a16140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46396/0 (socket says 172.21.15.92:46396) 2024-09-19T08:59:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.969+0000 7ffb1a7fc640 1 -- 172.21.15.92:0/3327487660 learned_addr learned my addr 172.21.15.92:0/3327487660 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.969+0000 7ffb1affd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559935a0b9a0 0x559935a15c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:50578/0 (socket says 172.21.15.92:50578) 2024-09-19T08:59:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.969+0000 7ffb1b7fe640 1 --2- 172.21.15.92:0/3327487660 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559935a11370 0x559935a1d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.969+0000 7ffb1affd640 1 -- 172.21.15.92:0/3327487660 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559935a11370 msgr2=0x559935a1d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.969+0000 7ffb1affd640 1 --2- 172.21.15.92:0/3327487660 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559935a11370 0x559935a1d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.969+0000 7ffb1affd640 1 -- 172.21.15.92:0/3327487660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559935a0c2e0 msgr2=0x559935a16140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.969+0000 7ffb1affd640 1 --2- 172.21.15.92:0/3327487660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559935a0c2e0 0x559935a16140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.969+0000 7ffb1affd640 1 -- 172.21.15.92:0/3327487660 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559935682210 con 0x559935a0b9a0 2024-09-19T08:59:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.969+0000 7ffb1a7fc640 1 --2- 172.21.15.92:0/3327487660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559935a0c2e0 0x559935a16140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.969+0000 7ffb1b7fe640 1 --2- 172.21.15.92:0/3327487660 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559935a11370 0x559935a1d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:09.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.969+0000 7ffb1affd640 1 --2- 172.21.15.92:0/3327487660 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559935a0b9a0 0x559935a15c00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c102bb0 tx=0x7ffb0c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8fdaa2667684149 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:09.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.969+0000 7ffafeff5640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T08:59:09.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.970+0000 7ffafeff5640 1 -- 172.21.15.92:0/3327487660 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c02a060 con 0x559935a0b9a0 2024-09-19T08:59:09.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.970+0000 7ffb2447f740 1 -- 172.21.15.92:0/3327487660 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb100047a0 con 0x559935a0b9a0 2024-09-19T08:59:09.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.970+0000 7ffafeff5640 1 -- 172.21.15.92:0/3327487660 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ffb0c010750 con 0x559935a0b9a0 2024-09-19T08:59:09.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.970+0000 7ffafeff5640 1 -- 172.21.15.92:0/3327487660 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ffb0c010950 con 0x559935a0b9a0 2024-09-19T08:59:09.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.970+0000 7ffb2447f740 10 client.25321 fetch_fsmap learned FSMap version 19 2024-09-19T08:59:09.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.970+0000 7ffb2447f740 1 -- 172.21.15.92:0/3327487660 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55993574e620 con 0x559935a0b9a0 2024-09-19T08:59:09.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.971+0000 7ffafeff5640 1 -- 172.21.15.92:0/3327487660 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb100047a0 con 0x559935a0b9a0 2024-09-19T08:59:09.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.971+0000 7ffafeff5640 1 -- 172.21.15.92:0/3327487660 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ffb0c02f070 con 0x559935a0b9a0 2024-09-19T08:59:09.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.971+0000 7ffb2447f740 10 client.25321 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:59:09.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.971+0000 7ffb2447f740 10 client.25321 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T08:59:09.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.971+0000 7ffb2447f740 20 client.25321 populate_metadata read hostname 'smithi092' 2024-09-19T08:59:09.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.971+0000 7ffb2447f740 1 --2- 172.21.15.92:0/3327487660 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559935a21870 0x559935a23d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.971+0000 7ffb2447f740 4 client.25321 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:59:09.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.971+0000 7ffb2447f740 1 -- 172.21.15.92:0/3327487660 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55993597ca20 con 0x559935a21870 2024-09-19T08:59:09.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.971+0000 7ffb1a7fc640 1 --2- 172.21.15.92:0/3327487660 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559935a21870 0x559935a23d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.972+0000 7ffb1a7fc640 1 --2- 172.21.15.92:0/3327487660 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559935a21870 0x559935a23d00 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca03f05369219258 server_cookie=97a40945462ba5ae in_seq=0 out_seq=0 2024-09-19T08:59:09.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.972+0000 7ffafeff5640 10 client.25321 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:09.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.973+0000 7ffafeff5640 1 -- 172.21.15.92:0/3327487660 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55993597ca20 con 0x559935a21870 2024-09-19T08:59:09.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.973+0000 7ffafeff5640 10 client.25321 handle_command_reply: tid=0 2024-09-19T08:59:09.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.973+0000 7ffb2447f740 1 client.25321 shutdown 2024-09-19T08:59:09.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.973+0000 7ffb2447f740 1 -- 172.21.15.92:0/3327487660 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559935a0b9a0 msgr2=0x559935a15c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:09.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.973+0000 7ffb2447f740 1 --2- 172.21.15.92:0/3327487660 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559935a0b9a0 0x559935a15c00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c102bb0 tx=0x7ffb0c0046c0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.973+0000 7ffb2447f740 1 -- 172.21.15.92:0/3327487660 shutdown_connections 2024-09-19T08:59:09.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.973+0000 7ffb2447f740 1 --2- 172.21.15.92:0/3327487660 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559935a21870 0x559935a23d00 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.973+0000 7ffb2447f740 1 --2- 172.21.15.92:0/3327487660 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559935a11370 0x559935a1d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.973+0000 7ffb2447f740 1 --2- 172.21.15.92:0/3327487660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559935a0c2e0 0x559935a16140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.973+0000 7ffb2447f740 1 --2- 172.21.15.92:0/3327487660 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559935a0b9a0 0x559935a15c00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.973+0000 7ffb2447f740 1 -- 172.21.15.92:0/3327487660 >> 172.21.15.92:0/3327487660 conn(0x559935a07010 msgr2=0x559935a08820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:09.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.973+0000 7ffafeff5640 0 client.25321 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:09.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.973+0000 7ffb2447f740 1 -- 172.21.15.92:0/3327487660 shutdown_connections 2024-09-19T08:59:09.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.973+0000 7ffb2447f740 1 -- 172.21.15.92:0/3327487660 wait complete. 2024-09-19T08:59:09.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.973+0000 7ffb2447f740 20 client.25321 trim_cache size 0 max 16384 2024-09-19T08:59:09.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.999+0000 7ffb2447f740 1 Processor -- start 2024-09-19T08:59:09.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.999+0000 7ffb2447f740 1 -- start start 2024-09-19T08:59:10.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.999+0000 7ffb2447f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559935a0b9a0 0x559935a161d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:10.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.999+0000 7ffb2447f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559935a0c2e0 0x559935a1d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:10.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.999+0000 7ffb1affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559935a0b9a0 0x559935a161d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:10.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.999+0000 7ffb1affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559935a0b9a0 0x559935a161d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:44054/0 (socket says 172.21.15.92:44054) 2024-09-19T08:59:10.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.999+0000 7ffb1affd640 1 -- 172.21.15.92:0/2887532335 learned_addr learned my addr 172.21.15.92:0/2887532335 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:10.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.999+0000 7ffb2447f740 1 --2- 172.21.15.92:0/2887532335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559935a11370 0x559935a060b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:10.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.999+0000 7ffb2447f740 1 -- 172.21.15.92:0/2887532335 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1c1ad610 con 0x559935a0c2e0 2024-09-19T08:59:10.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.999+0000 7ffb2447f740 1 -- 172.21.15.92:0/2887532335 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1c1afeb0 con 0x559935a0b9a0 2024-09-19T08:59:10.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:09.999+0000 7ffb2447f740 1 -- 172.21.15.92:0/2887532335 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1c1adca0 con 0x559935a11370 2024-09-19T08:59:10.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.000+0000 7ffb1a7fc640 1 --2- 172.21.15.92:0/2887532335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559935a0c2e0 0x559935a1d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:10.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.000+0000 7ffb1b7fe640 1 --2- 172.21.15.92:0/2887532335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559935a11370 0x559935a060b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:10.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.000+0000 7ffb1affd640 1 -- 172.21.15.92:0/2887532335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559935a11370 msgr2=0x559935a060b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:10.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.000+0000 7ffb1affd640 1 --2- 172.21.15.92:0/2887532335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559935a11370 0x559935a060b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.000+0000 7ffb1affd640 1 -- 172.21.15.92:0/2887532335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559935a0c2e0 msgr2=0x559935a1d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:10.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.000+0000 7ffb1affd640 1 --2- 172.21.15.92:0/2887532335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559935a0c2e0 0x559935a1d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.000+0000 7ffb1affd640 1 -- 172.21.15.92:0/2887532335 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559935a145f0 con 0x559935a0b9a0 2024-09-19T08:59:10.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.000+0000 7ffb1b7fe640 1 --2- 172.21.15.92:0/2887532335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559935a11370 0x559935a060b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:59:10.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.000+0000 7ffb1affd640 1 --2- 172.21.15.92:0/2887532335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559935a0b9a0 0x559935a161d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c01beb0 tx=0x7ffb0c0108e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f41d3d9c86feb146 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:10.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.000+0000 7ffb00ff9640 1 -- 172.21.15.92:0/2887532335 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c035020 con 0x559935a0b9a0 2024-09-19T08:59:10.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.000+0000 7ffb00ff9640 1 -- 172.21.15.92:0/2887532335 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb0c005520 con 0x559935a0b9a0 2024-09-19T08:59:10.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.000+0000 7ffb00ff9640 1 -- 172.21.15.92:0/2887532335 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c01b460 con 0x559935a0b9a0 2024-09-19T08:59:10.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.001+0000 7ffb2447f740 1 -- 172.21.15.92:0/2887532335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559935a0b9a0 msgr2=0x559935a161d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:10.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.001+0000 7ffb2447f740 1 --2- 172.21.15.92:0/2887532335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559935a0b9a0 0x559935a161d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c01beb0 tx=0x7ffb0c0108e0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.001+0000 7ffb2447f740 1 -- 172.21.15.92:0/2887532335 shutdown_connections 2024-09-19T08:59:10.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.001+0000 7ffb2447f740 1 --2- 172.21.15.92:0/2887532335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559935a11370 0x559935a060b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.001+0000 7ffb2447f740 1 --2- 172.21.15.92:0/2887532335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559935a0c2e0 0x559935a1d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.001+0000 7ffb2447f740 1 --2- 172.21.15.92:0/2887532335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559935a0b9a0 0x559935a161d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.001+0000 7ffb2447f740 1 -- 172.21.15.92:0/2887532335 >> 172.21.15.92:0/2887532335 conn(0x559935a07010 msgr2=0x559935a059a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:10.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.001+0000 7ffb2447f740 1 -- 172.21.15.92:0/2887532335 shutdown_connections 2024-09-19T08:59:10.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.002+0000 7ffb2447f740 1 -- 172.21.15.92:0/2887532335 wait complete. 2024-09-19T08:59:10.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.002+0000 7ffb2447f740 1 -- start start 2024-09-19T08:59:10.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.002+0000 7ffb2447f740 1 Processor -- start 2024-09-19T08:59:10.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.003+0000 7ffb2447f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559935a0b9a0 0x559935a1a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:10.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.003+0000 7ffb2447f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559935a0c2e0 0x559935a1ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:10.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.003+0000 7ffb2447f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559935a11370 0x559935a1be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:10.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.003+0000 7ffb2447f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1c1ae370 con 0x559935a0c2e0 2024-09-19T08:59:10.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.003+0000 7ffb2447f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1c1af7e0 con 0x559935a11370 2024-09-19T08:59:10.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.003+0000 7ffb2447f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1c1aea40 con 0x559935a0b9a0 2024-09-19T08:59:10.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.003+0000 7ffb2447f740 10 client.0 _ll_register_callbacks cb 0x7ffb0c009820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:10.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.003+0000 7ffb1affd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559935a0b9a0 0x559935a1a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:10.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.003+0000 7ffb1affd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559935a0b9a0 0x559935a1a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:50596/0 (socket says 172.21.15.92:50596) 2024-09-19T08:59:10.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.003+0000 7ffb1affd640 1 -- 172.21.15.92:0/2248446232 learned_addr learned my addr 172.21.15.92:0/2248446232 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:10.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.003+0000 7ffb1b7fe640 1 --2- 172.21.15.92:0/2248446232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559935a11370 0x559935a1be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:10.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.003+0000 7ffb1a7fc640 1 --2- 172.21.15.92:0/2248446232 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559935a0c2e0 0x559935a1ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:10.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.003+0000 7ffb1affd640 1 -- 172.21.15.92:0/2248446232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559935a11370 msgr2=0x559935a1be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:10.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.003+0000 7ffb1affd640 1 --2- 172.21.15.92:0/2248446232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559935a11370 0x559935a1be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.003+0000 7ffb1affd640 1 -- 172.21.15.92:0/2248446232 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559935a0c2e0 msgr2=0x559935a1ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:10.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.003+0000 7ffb1affd640 1 --2- 172.21.15.92:0/2248446232 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559935a0c2e0 0x559935a1ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.003+0000 7ffb1affd640 1 -- 172.21.15.92:0/2248446232 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559935a07cc0 con 0x559935a0b9a0 2024-09-19T08:59:10.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.003+0000 7ffb1b7fe640 1 --2- 172.21.15.92:0/2248446232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559935a11370 0x559935a1be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:10.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.004+0000 7ffb1affd640 1 --2- 172.21.15.92:0/2248446232 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559935a0b9a0 0x559935a1a900 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c0253e0 tx=0x7ffb0c004e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fb60eb0b425e8e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:10.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.004+0000 7ffafeff5640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T08:59:10.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.004+0000 7ffafeff5640 1 -- 172.21.15.92:0/2248446232 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c035030 con 0x559935a0b9a0 2024-09-19T08:59:10.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.004+0000 7ffafeff5640 1 -- 172.21.15.92:0/2248446232 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ffb0c010af0 con 0x559935a0b9a0 2024-09-19T08:59:10.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.004+0000 7ffb2447f740 1 -- 172.21.15.92:0/2248446232 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb0c005520 con 0x559935a0b9a0 2024-09-19T08:59:10.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.004+0000 7ffafeff5640 1 -- 172.21.15.92:0/2248446232 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ffb0c02a040 con 0x559935a0b9a0 2024-09-19T08:59:10.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.004+0000 7ffb2447f740 10 client.25324 fetch_fsmap learned FSMap version 19 2024-09-19T08:59:10.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.004+0000 7ffb2447f740 1 -- 172.21.15.92:0/2248446232 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x559935a8c5e0 con 0x559935a0b9a0 2024-09-19T08:59:10.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.005+0000 7ffafeff5640 1 -- 172.21.15.92:0/2248446232 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb0c010cf0 con 0x559935a0b9a0 2024-09-19T08:59:10.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.005+0000 7ffafeff5640 1 -- 172.21.15.92:0/2248446232 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ffb0c02f040 con 0x559935a0b9a0 2024-09-19T08:59:10.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.005+0000 7ffb2447f740 10 client.25324 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:59:10.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.005+0000 7ffb2447f740 10 client.25324 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T08:59:10.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.005+0000 7ffb2447f740 20 client.25324 populate_metadata read hostname 'smithi092' 2024-09-19T08:59:10.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.005+0000 7ffb2447f740 1 --2- 172.21.15.92:0/2248446232 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559935a8ce20 0x559935a8f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:10.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.005+0000 7ffb2447f740 4 client.25324 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:59:10.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.005+0000 7ffb2447f740 1 -- 172.21.15.92:0/2248446232 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7ffb0c005520 con 0x559935a8ce20 2024-09-19T08:59:10.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.005+0000 7ffb1a7fc640 1 --2- 172.21.15.92:0/2248446232 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559935a8ce20 0x559935a8f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:10.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.006+0000 7ffafeff5640 10 client.25324 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:10.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.006+0000 7ffb1a7fc640 1 --2- 172.21.15.92:0/2248446232 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559935a8ce20 0x559935a8f240 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a0dd02e39876c53 server_cookie=760c8b200ad35895 in_seq=0 out_seq=0 2024-09-19T08:59:10.043 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.044+0000 7ffafeff5640 1 -- 172.21.15.92:0/2248446232 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7ffb0c005520 con 0x559935a8ce20 2024-09-19T08:59:10.044 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.044+0000 7ffafeff5640 10 client.25324 handle_command_reply: tid=0 2024-09-19T08:59:10.044 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.044+0000 7ffb2447f740 1 client.25324 shutdown 2024-09-19T08:59:10.044 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.044+0000 7ffb2447f740 1 -- 172.21.15.92:0/2248446232 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559935a0b9a0 msgr2=0x559935a1a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:10.044 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.044+0000 7ffb2447f740 1 --2- 172.21.15.92:0/2248446232 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559935a0b9a0 0x559935a1a900 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c0253e0 tx=0x7ffb0c004e60 comp rx=0 tx=0).stop 2024-09-19T08:59:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.045+0000 7ffb2447f740 1 -- 172.21.15.92:0/2248446232 shutdown_connections 2024-09-19T08:59:10.046 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.045+0000 7ffb2447f740 1 --2- 172.21.15.92:0/2248446232 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559935a8ce20 0x559935a8f240 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.046 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.045+0000 7ffb2447f740 1 --2- 172.21.15.92:0/2248446232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559935a11370 0x559935a1be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.046 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.045+0000 7ffb2447f740 1 --2- 172.21.15.92:0/2248446232 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559935a0c2e0 0x559935a1ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.046 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.045+0000 7ffb2447f740 1 --2- 172.21.15.92:0/2248446232 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559935a0b9a0 0x559935a1a900 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.046 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.045+0000 7ffb2447f740 1 -- 172.21.15.92:0/2248446232 >> 172.21.15.92:0/2248446232 conn(0x559935a07010 msgr2=0x559935a061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:10.046 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.045+0000 7ffafeff5640 0 client.25324 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:10.046 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.046+0000 7ffb2447f740 1 -- 172.21.15.92:0/2248446232 shutdown_connections 2024-09-19T08:59:10.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.046+0000 7ffb2447f740 1 -- 172.21.15.92:0/2248446232 wait complete. 2024-09-19T08:59:10.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.047+0000 7ffb2447f740 20 client.25324 trim_cache size 0 max 16384 2024-09-19T08:59:10.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T08:59:10.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T08:59:10.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T08:59:10.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T08:59:10.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.048+0000 7ffb215fd640 1 -- 172.21.15.92:0/1065504419 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffb040a33f0 msgr2=0x7ffb040a58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:10.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.048+0000 7ffb215fd640 1 --2- 172.21.15.92:0/1065504419 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffb040a33f0 0x7ffb040a58b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x559935a07e90 tx=0x7ffb0c005f90 comp rx=0 tx=0).stop 2024-09-19T08:59:10.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.048+0000 7ffb215fd640 1 -- 172.21.15.92:0/1065504419 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb1c102d50 msgr2=0x7ffb1c0745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:10.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.048+0000 7ffb215fd640 1 --2- 172.21.15.92:0/1065504419 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb1c102d50 0x7ffb1c0745e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ffb1402aeb0 tx=0x7ffb14003f90 comp rx=0 tx=0).stop 2024-09-19T08:59:10.051 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.051+0000 7ffb215fd640 1 -- 172.21.15.92:0/1065504419 shutdown_connections 2024-09-19T08:59:10.051 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.051+0000 7ffb215fd640 1 --2- 172.21.15.92:0/1065504419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb1c103710 0x7ffb1c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.051+0000 7ffb215fd640 1 --2- 172.21.15.92:0/1065504419 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb1c102d50 0x7ffb1c0745e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.051+0000 7ffb215fd640 1 --2- 172.21.15.92:0/1065504419 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffb040a33f0 0x7ffb040a58b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.051+0000 7ffb215fd640 1 --2- 172.21.15.92:0/1065504419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb1c101b60 0x7ffb1c075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.051+0000 7ffb215fd640 1 -- 172.21.15.92:0/1065504419 >> 172.21.15.92:0/1065504419 conn(0x7ffb1c0fd2c0 msgr2=0x7ffb1c1060c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:10.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.052+0000 7ffb215fd640 1 -- 172.21.15.92:0/1065504419 shutdown_connections 2024-09-19T08:59:10.053 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:10.052+0000 7ffb215fd640 1 -- 172.21.15.92:0/1065504419 wait complete. 2024-09-19T08:59:10.606 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:59:10.606 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:59:10.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 145.0 s, 5080.8 tps, lat 19.672 ms stddev 21.033 2024-09-19T08:59:11.008 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:59:11.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.574+0000 7fc3b0c27640 1 -- 172.21.15.92:0/3269718085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3ac102ef0 msgr2=0x7fc3ac10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:11.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.574+0000 7fc3b0c27640 1 --2- 172.21.15.92:0/3269718085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3ac102ef0 0x7fc3ac10da40 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fc39c009900 tx=0x7fc39c02a480 comp rx=0 tx=0).stop 2024-09-19T08:59:11.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.574+0000 7fc3b0c27640 1 -- 172.21.15.92:0/3269718085 shutdown_connections 2024-09-19T08:59:11.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.574+0000 7fc3b0c27640 1 --2- 172.21.15.92:0/3269718085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3ac102ef0 0x7fc3ac10da40 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:11.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.574+0000 7fc3b0c27640 1 --2- 172.21.15.92:0/3269718085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3ac102570 0x7fc3ac1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:11.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.574+0000 7fc3b0c27640 1 --2- 172.21.15.92:0/3269718085 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc3ac100e20 0x7fc3ac101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:11.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.574+0000 7fc3b0c27640 1 -- 172.21.15.92:0/3269718085 >> 172.21.15.92:0/3269718085 conn(0x7fc3ac0fc7d0 msgr2=0x7fc3ac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:11.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.574+0000 7fc3b0c27640 1 -- 172.21.15.92:0/3269718085 shutdown_connections 2024-09-19T08:59:11.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.574+0000 7fc3b0c27640 1 -- 172.21.15.92:0/3269718085 wait complete. 2024-09-19T08:59:11.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.575+0000 7fc3b0c27640 1 Processor -- start 2024-09-19T08:59:11.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.575+0000 7fc3b0c27640 1 -- start start 2024-09-19T08:59:11.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.576+0000 7fc3b0c27640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc3ac100e20 0x7fc3ac073900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:11.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.576+0000 7fc3b0c27640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3ac102570 0x7fc3ac073e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:11.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.576+0000 7fc3b0c27640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3ac102ef0 0x7fc3ac06cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:11.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.576+0000 7fc3b0c27640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ac10fe20 con 0x7fc3ac102ef0 2024-09-19T08:59:11.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.576+0000 7fc3b0c27640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ac10fca0 con 0x7fc3ac102570 2024-09-19T08:59:11.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.576+0000 7fc3b0c27640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ac10ffa0 con 0x7fc3ac100e20 2024-09-19T08:59:11.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.576+0000 7fc3aad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3ac102ef0 0x7fc3ac06cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:11.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.576+0000 7fc3aad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3ac102ef0 0x7fc3ac06cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33092/0 (socket says 172.21.15.92:33092) 2024-09-19T08:59:11.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.576+0000 7fc3aad9d640 1 -- 172.21.15.92:0/1584375859 learned_addr learned my addr 172.21.15.92:0/1584375859 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:11.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.576+0000 7fc3a9d9b640 1 --2- 172.21.15.92:0/1584375859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3ac102570 0x7fc3ac073e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:11.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.576+0000 7fc3aa59c640 1 --2- 172.21.15.92:0/1584375859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc3ac100e20 0x7fc3ac073900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:11.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.576+0000 7fc3aad9d640 1 -- 172.21.15.92:0/1584375859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc3ac100e20 msgr2=0x7fc3ac073900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:11.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.576+0000 7fc3aad9d640 1 --2- 172.21.15.92:0/1584375859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc3ac100e20 0x7fc3ac073900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:11.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.576+0000 7fc3aad9d640 1 -- 172.21.15.92:0/1584375859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3ac102570 msgr2=0x7fc3ac073e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:11.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.576+0000 7fc3aad9d640 1 --2- 172.21.15.92:0/1584375859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3ac102570 0x7fc3ac073e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:11.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.576+0000 7fc3aad9d640 1 -- 172.21.15.92:0/1584375859 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3ac06d3e0 con 0x7fc3ac102ef0 2024-09-19T08:59:11.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.577+0000 7fc3aad9d640 1 --2- 172.21.15.92:0/1584375859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3ac102ef0 0x7fc3ac06cb20 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fc39c02a9a0 tx=0x7fc39c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:11.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.577+0000 7fc3a37fe640 1 -- 172.21.15.92:0/1584375859 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39c03f070 con 0x7fc3ac102ef0 2024-09-19T08:59:11.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.577+0000 7fc3b0c27640 1 -- 172.21.15.92:0/1584375859 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3ac06d670 con 0x7fc3ac102ef0 2024-09-19T08:59:11.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.577+0000 7fc3b0c27640 1 -- 172.21.15.92:0/1584375859 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3ac071600 con 0x7fc3ac102ef0 2024-09-19T08:59:11.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.577+0000 7fc3a37fe640 1 -- 172.21.15.92:0/1584375859 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc39c031c30 con 0x7fc3ac102ef0 2024-09-19T08:59:11.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.577+0000 7fc3a37fe640 1 -- 172.21.15.92:0/1584375859 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39c035030 con 0x7fc3ac102ef0 2024-09-19T08:59:11.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.578+0000 7fc3b0c27640 1 -- 172.21.15.92:0/1584375859 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3ac1021b0 con 0x7fc3ac102ef0 2024-09-19T08:59:11.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.581+0000 7fc3a37fe640 1 -- 172.21.15.92:0/1584375859 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc39c042070 con 0x7fc3ac102ef0 2024-09-19T08:59:11.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.582+0000 7fc3a37fe640 1 --2- 172.21.15.92:0/1584375859 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc3980a32c0 0x7fc3980a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:11.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.582+0000 7fc3aa59c640 1 --2- 172.21.15.92:0/1584375859 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc3980a32c0 0x7fc3980a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:11.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.582+0000 7fc3a37fe640 1 -- 172.21.15.92:0/1584375859 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc39c0f09b0 con 0x7fc3ac102ef0 2024-09-19T08:59:11.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.584+0000 7fc3aa59c640 1 --2- 172.21.15.92:0/1584375859 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc3980a32c0 0x7fc3980a5780 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc394009b60 tx=0x7fc394005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:11.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.587+0000 7fc3a37fe640 1 -- 172.21.15.92:0/1584375859 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc39c0bd690 con 0x7fc3ac102ef0 2024-09-19T08:59:11.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:11 smithi092 ceph-mon[31407]: pgmap v411: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 16 MiB/s wr, 1.02k op/s 2024-09-19T08:59:11.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:11 smithi167 ceph-mon[35359]: pgmap v411: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 16 MiB/s wr, 1.02k op/s 2024-09-19T08:59:11.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:11 smithi190 ceph-mon[35358]: pgmap v411: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 16 MiB/s wr, 1.02k op/s 2024-09-19T08:59:11.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.947+0000 7fc3b0c27640 1 -- 172.21.15.92:0/1584375859 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc3ac0720e0 con 0x7fc3ac102ef0 2024-09-19T08:59:11.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.948+0000 7fc3a37fe640 1 -- 172.21.15.92:0/1584375859 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7fc39c031de0 con 0x7fc3ac102ef0 2024-09-19T08:59:11.948 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:59:11.948 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T08:59:11.949 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T08:59:11.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.951+0000 7fc3b0c27640 1 -- 172.21.15.92:0/1584375859 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc3980a32c0 msgr2=0x7fc3980a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:11.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.951+0000 7fc3b0c27640 1 --2- 172.21.15.92:0/1584375859 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc3980a32c0 0x7fc3980a5780 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc394009b60 tx=0x7fc394005f90 comp rx=0 tx=0).stop 2024-09-19T08:59:11.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.951+0000 7fc3b0c27640 1 -- 172.21.15.92:0/1584375859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3ac102ef0 msgr2=0x7fc3ac06cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:11.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.951+0000 7fc3b0c27640 1 --2- 172.21.15.92:0/1584375859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3ac102ef0 0x7fc3ac06cb20 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fc39c02a9a0 tx=0x7fc39c003c10 comp rx=0 tx=0).stop 2024-09-19T08:59:11.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.951+0000 7fc3b0c27640 1 -- 172.21.15.92:0/1584375859 shutdown_connections 2024-09-19T08:59:11.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.951+0000 7fc3b0c27640 1 --2- 172.21.15.92:0/1584375859 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc3980a32c0 0x7fc3980a5780 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:11.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.951+0000 7fc3b0c27640 1 --2- 172.21.15.92:0/1584375859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3ac102ef0 0x7fc3ac06cb20 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:11.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.951+0000 7fc3b0c27640 1 --2- 172.21.15.92:0/1584375859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3ac102570 0x7fc3ac073e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:11.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.951+0000 7fc3b0c27640 1 --2- 172.21.15.92:0/1584375859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc3ac100e20 0x7fc3ac073900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:11.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.951+0000 7fc3b0c27640 1 -- 172.21.15.92:0/1584375859 >> 172.21.15.92:0/1584375859 conn(0x7fc3ac0fc7d0 msgr2=0x7fc3ac1068e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:11.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.952+0000 7fc3b0c27640 1 -- 172.21.15.92:0/1584375859 shutdown_connections 2024-09-19T08:59:11.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:11.952+0000 7fc3b0c27640 1 -- 172.21.15.92:0/1584375859 wait complete. 2024-09-19T08:59:12.687 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:12 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1584375859' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:59:12.736 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:59:12.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:12 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/1584375859' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:59:12.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:12 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/1584375859' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:59:13.157 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:59:13.574 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:13 smithi092 ceph-mon[31407]: pgmap v412: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 12 MiB/s wr, 867 op/s 2024-09-19T08:59:13.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.707+0000 7f7f97032640 1 -- 172.21.15.92:0/1268878020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f90106f10 msgr2=0x7f7f9010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:13.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.707+0000 7f7f97032640 1 --2- 172.21.15.92:0/1268878020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f90106f10 0x7f7f9010ea90 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f7f88009ca0 tx=0x7f7f8802a8e0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.707+0000 7f7f97032640 1 -- 172.21.15.92:0/1268878020 shutdown_connections 2024-09-19T08:59:13.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.707+0000 7f7f97032640 1 --2- 172.21.15.92:0/1268878020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f90106f10 0x7f7f9010ea90 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.707+0000 7f7f97032640 1 --2- 172.21.15.92:0/1268878020 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f90102790 0x7f7f901067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.707+0000 7f7f97032640 1 --2- 172.21.15.92:0/1268878020 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f90101de0 0x7f7f901021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.707+0000 7f7f97032640 1 -- 172.21.15.92:0/1268878020 >> 172.21.15.92:0/1268878020 conn(0x7f7f900fd8e0 msgr2=0x7f7f900ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:13.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.708+0000 7f7f97032640 1 -- 172.21.15.92:0/1268878020 shutdown_connections 2024-09-19T08:59:13.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.708+0000 7f7f97032640 1 -- 172.21.15.92:0/1268878020 wait complete. 2024-09-19T08:59:13.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.708+0000 7f7f97032640 1 Processor -- start 2024-09-19T08:59:13.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.709+0000 7f7f97032640 1 -- start start 2024-09-19T08:59:13.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.709+0000 7f7f97032640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f90101de0 0x7f7f90071870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:13.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.709+0000 7f7f97032640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f90102790 0x7f7f90071db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:13.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.709+0000 7f7f97032640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f90106f10 0x7f7f9006c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:13.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.709+0000 7f7f97032640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7f90112000 con 0x7f7f90102790 2024-09-19T08:59:13.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.709+0000 7f7f97032640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7f90111e80 con 0x7f7f90101de0 2024-09-19T08:59:13.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.709+0000 7f7f97032640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7f90112180 con 0x7f7f90106f10 2024-09-19T08:59:13.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.709+0000 7f7f94dce640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f90101de0 0x7f7f90071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:13.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.709+0000 7f7f94dce640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f90101de0 0x7f7f90071870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:50200/0 (socket says 172.21.15.92:50200) 2024-09-19T08:59:13.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.709+0000 7f7f94dce640 1 -- 172.21.15.92:0/3901198848 learned_addr learned my addr 172.21.15.92:0/3901198848 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:13.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.709+0000 7f7f955cf640 1 --2- 172.21.15.92:0/3901198848 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f90106f10 0x7f7f9006c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:13.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.710+0000 7f7f8ffff640 1 --2- 172.21.15.92:0/3901198848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f90102790 0x7f7f90071db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:13.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.710+0000 7f7f8ffff640 1 -- 172.21.15.92:0/3901198848 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f90106f10 msgr2=0x7f7f9006c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:13.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.710+0000 7f7f8ffff640 1 --2- 172.21.15.92:0/3901198848 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f90106f10 0x7f7f9006c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.710+0000 7f7f8ffff640 1 -- 172.21.15.92:0/3901198848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f90101de0 msgr2=0x7f7f90071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:13.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.710+0000 7f7f8ffff640 1 --2- 172.21.15.92:0/3901198848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f90101de0 0x7f7f90071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.711+0000 7f7f8ffff640 1 -- 172.21.15.92:0/3901198848 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f9006d250 con 0x7f7f90102790 2024-09-19T08:59:13.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.711+0000 7f7f8ffff640 1 --2- 172.21.15.92:0/3901198848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f90102790 0x7f7f90071db0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f7f8400d6d0 tx=0x7f7f8400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:13.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.711+0000 7f7f8dffb640 1 -- 172.21.15.92:0/3901198848 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f84017070 con 0x7f7f90102790 2024-09-19T08:59:13.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.711+0000 7f7f8dffb640 1 -- 172.21.15.92:0/3901198848 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f84009820 con 0x7f7f90102790 2024-09-19T08:59:13.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.711+0000 7f7f8dffb640 1 -- 172.21.15.92:0/3901198848 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f84004d00 con 0x7f7f90102790 2024-09-19T08:59:13.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.711+0000 7f7f97032640 1 -- 172.21.15.92:0/3901198848 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f9006d540 con 0x7f7f90102790 2024-09-19T08:59:13.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.712+0000 7f7f97032640 1 -- 172.21.15.92:0/3901198848 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f90075580 con 0x7f7f90102790 2024-09-19T08:59:13.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.715+0000 7f7f8dffb640 1 -- 172.21.15.92:0/3901198848 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7f840099d0 con 0x7f7f90102790 2024-09-19T08:59:13.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.716+0000 7f7f8dffb640 1 --2- 172.21.15.92:0/3901198848 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7f780a3410 0x7f7f780a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:13.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.716+0000 7f7f8dffb640 1 -- 172.21.15.92:0/3901198848 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f7f840cf440 con 0x7f7f90102790 2024-09-19T08:59:13.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.717+0000 7f7f9940b740 1 Processor -- start 2024-09-19T08:59:13.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.717+0000 7f7f9940b740 1 -- start start 2024-09-19T08:59:13.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.717+0000 7f7f9940b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56169a471b40 0x56169a470090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:13.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.717+0000 7f7f9940b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56169a4705d0 0x56169a470a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:13.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.717+0000 7f7f9940b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56169a47b370 0x56169a47d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:13.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.717+0000 7f7f9940b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56169a3d62f0 con 0x56169a4705d0 2024-09-19T08:59:13.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.717+0000 7f7f9940b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56169a37dcf0 con 0x56169a47b370 2024-09-19T08:59:13.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.717+0000 7f7f9940b740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56169a3d22b0 con 0x56169a471b40 2024-09-19T08:59:13.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.717+0000 7f7f94dce640 1 --2- 172.21.15.92:0/3901198848 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7f780a3410 0x7f7f780a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:13.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.717+0000 7f7f8ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56169a4705d0 0x56169a470a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:13.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.717+0000 7f7f94dce640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56169a471b40 0x56169a470090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:13.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.717+0000 7f7f8ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56169a4705d0 0x56169a470a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33116/0 (socket says 172.21.15.92:33116) 2024-09-19T08:59:13.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.718+0000 7f7f8ffff640 1 -- 172.21.15.92:0/4095312060 learned_addr learned my addr 172.21.15.92:0/4095312060 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:13.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.718+0000 7f7f955cf640 1 --2- 172.21.15.92:0/4095312060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56169a47b370 0x56169a47d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:13.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.718+0000 7f7f94dce640 1 -- 172.21.15.92:0/4095312060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56169a47b370 msgr2=0x56169a47d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:13.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.718+0000 7f7f94dce640 1 --2- 172.21.15.92:0/4095312060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56169a47b370 0x56169a47d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.718+0000 7f7f94dce640 1 -- 172.21.15.92:0/4095312060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56169a4705d0 msgr2=0x56169a470a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:13.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.718+0000 7f7f94dce640 1 --2- 172.21.15.92:0/4095312060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56169a4705d0 0x56169a470a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.718+0000 7f7f94dce640 1 -- 172.21.15.92:0/4095312060 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56169a3623a0 con 0x56169a471b40 2024-09-19T08:59:13.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.718+0000 7f7f955cf640 1 --2- 172.21.15.92:0/4095312060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56169a47b370 0x56169a47d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:13.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.718+0000 7f7f94dce640 1 --2- 172.21.15.92:0/3901198848 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7f780a3410 0x7f7f780a58d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7f80009fd0 tx=0x7f7f80009620 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:13.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.719+0000 7f7f94dce640 1 --2- 172.21.15.92:0/4095312060 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56169a471b40 0x56169a470090 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7f80017890 tx=0x7f7f8001a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f4c8997768a171d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:13.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.719+0000 7f7f76ffd640 1 -- 172.21.15.92:0/4095312060 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8001e070 con 0x56169a471b40 2024-09-19T08:59:13.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.719+0000 7f7f76ffd640 1 -- 172.21.15.92:0/4095312060 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f80027070 con 0x56169a471b40 2024-09-19T08:59:13.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.719+0000 7f7f76ffd640 1 -- 172.21.15.92:0/4095312060 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f80022c30 con 0x56169a471b40 2024-09-19T08:59:13.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.720+0000 7f7f9940b740 1 -- 172.21.15.92:0/4095312060 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56169a471b40 msgr2=0x56169a470090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:13.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.720+0000 7f7f9940b740 1 --2- 172.21.15.92:0/4095312060 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56169a471b40 0x56169a470090 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7f80017890 tx=0x7f7f8001a000 comp rx=0 tx=0).stop 2024-09-19T08:59:13.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.720+0000 7f7f9940b740 1 -- 172.21.15.92:0/4095312060 shutdown_connections 2024-09-19T08:59:13.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.720+0000 7f7f9940b740 1 --2- 172.21.15.92:0/4095312060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56169a47b370 0x56169a47d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.720+0000 7f7f9940b740 1 --2- 172.21.15.92:0/4095312060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56169a4705d0 0x56169a470a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.720+0000 7f7f9940b740 1 --2- 172.21.15.92:0/4095312060 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56169a471b40 0x56169a470090 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.720+0000 7f7f9940b740 1 -- 172.21.15.92:0/4095312060 >> 172.21.15.92:0/4095312060 conn(0x56169a439310 msgr2=0x56169a46cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:13.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.721+0000 7f7f9940b740 1 -- 172.21.15.92:0/4095312060 shutdown_connections 2024-09-19T08:59:13.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.722+0000 7f7f9940b740 1 -- 172.21.15.92:0/4095312060 wait complete. 2024-09-19T08:59:13.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.722+0000 7f7f9940b740 1 -- start start 2024-09-19T08:59:13.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.723+0000 7f7f9940b740 1 Processor -- start 2024-09-19T08:59:13.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.723+0000 7f7f9940b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56169a4705d0 0x56169a47acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:13.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.723+0000 7f7f9940b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56169a471b40 0x56169a477ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:13.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.724+0000 7f7f9940b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56169a47b370 0x56169a478600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:13.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.724+0000 7f7f94dce640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56169a4705d0 0x56169a47acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:13.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.724+0000 7f7f94dce640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56169a4705d0 0x56169a47acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33118/0 (socket says 172.21.15.92:33118) 2024-09-19T08:59:13.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.724+0000 7f7f94dce640 1 -- 172.21.15.92:0/1064765549 learned_addr learned my addr 172.21.15.92:0/1064765549 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:13.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.724+0000 7f7f9940b740 1 -- 172.21.15.92:0/1064765549 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56169a47e010 con 0x56169a4705d0 2024-09-19T08:59:13.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.724+0000 7f7f9940b740 1 -- 172.21.15.92:0/1064765549 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56169a391060 con 0x56169a471b40 2024-09-19T08:59:13.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.724+0000 7f7f9940b740 1 -- 172.21.15.92:0/1064765549 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56169a47e190 con 0x56169a47b370 2024-09-19T08:59:13.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.724+0000 7f7f9940b740 10 client.0 _ll_register_callbacks cb 0x56169a0e48c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:13.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.724+0000 7f7f955cf640 1 --2- 172.21.15.92:0/1064765549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56169a47b370 0x56169a478600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:13.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.724+0000 7f7f8ffff640 1 --2- 172.21.15.92:0/1064765549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56169a471b40 0x56169a477ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:13.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.724+0000 7f7f94dce640 1 -- 172.21.15.92:0/1064765549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56169a47b370 msgr2=0x56169a478600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:13.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.724+0000 7f7f94dce640 1 --2- 172.21.15.92:0/1064765549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56169a47b370 0x56169a478600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.724+0000 7f7f94dce640 1 -- 172.21.15.92:0/1064765549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56169a471b40 msgr2=0x56169a477ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:13.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.724+0000 7f7f94dce640 1 --2- 172.21.15.92:0/1064765549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56169a471b40 0x56169a477ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.724+0000 7f7f94dce640 1 -- 172.21.15.92:0/1064765549 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56169a1473c0 con 0x56169a4705d0 2024-09-19T08:59:13.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.725+0000 7f7f94dce640 1 --2- 172.21.15.92:0/1064765549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56169a4705d0 0x56169a47acf0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f7f80006d40 tx=0x7f7f800228d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e74339123fc7894 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:13.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.725+0000 7f7f6ffff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:59:13.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.725+0000 7f7f6ffff640 1 -- 172.21.15.92:0/1064765549 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f800229b0 con 0x56169a4705d0 2024-09-19T08:59:13.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.725+0000 7f7f9940b740 1 -- 172.21.15.92:0/1064765549 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f80027070 con 0x56169a4705d0 2024-09-19T08:59:13.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.725+0000 7f7f6ffff640 1 -- 172.21.15.92:0/1064765549 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f7f80022b50 con 0x56169a4705d0 2024-09-19T08:59:13.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.725+0000 7f7f6ffff640 1 -- 172.21.15.92:0/1064765549 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7f80022d50 con 0x56169a4705d0 2024-09-19T08:59:13.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.725+0000 7f7f9940b740 10 client.15939 fetch_fsmap learned FSMap version 19 2024-09-19T08:59:13.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.725+0000 7f7f9940b740 1 -- 172.21.15.92:0/1064765549 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56169a489a60 con 0x56169a4705d0 2024-09-19T08:59:13.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.726+0000 7f7f6ffff640 1 -- 172.21.15.92:0/1064765549 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f80027070 con 0x56169a4705d0 2024-09-19T08:59:13.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.727+0000 7f7f6ffff640 1 -- 172.21.15.92:0/1064765549 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f7f80004050 con 0x56169a4705d0 2024-09-19T08:59:13.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.727+0000 7f7f9940b740 10 client.15939 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:59:13.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.727+0000 7f7f9940b740 10 client.15939 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:59:13.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.727+0000 7f7f9940b740 20 client.15939 populate_metadata read hostname 'smithi092' 2024-09-19T08:59:13.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.727+0000 7f7f9940b740 1 --2- 172.21.15.92:0/1064765549 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56169a48b140 0x56169a48d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:13.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.727+0000 7f7f9940b740 4 client.15939 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:59:13.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.727+0000 7f7f9940b740 1 -- 172.21.15.92:0/1064765549 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56169a3e3860 con 0x56169a48b140 2024-09-19T08:59:13.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.728+0000 7f7f8ffff640 1 --2- 172.21.15.92:0/1064765549 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56169a48b140 0x56169a48d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:13.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.729+0000 7f7f8ffff640 1 --2- 172.21.15.92:0/1064765549 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56169a48b140 0x56169a48d590 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f9cac682f846652 server_cookie=b45354f54492f5a0 in_seq=0 out_seq=0 2024-09-19T08:59:13.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.729+0000 7f7f6ffff640 10 client.15939 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:13.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.729+0000 7f7f6ffff640 1 -- 172.21.15.92:0/1064765549 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56169a3e3860 con 0x56169a48b140 2024-09-19T08:59:13.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.729+0000 7f7f6ffff640 10 client.15939 handle_command_reply: tid=0 2024-09-19T08:59:13.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.729+0000 7f7f9940b740 1 client.15939 shutdown 2024-09-19T08:59:13.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.730+0000 7f7f9940b740 1 -- 172.21.15.92:0/1064765549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56169a4705d0 msgr2=0x56169a47acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:13.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.730+0000 7f7f9940b740 1 --2- 172.21.15.92:0/1064765549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56169a4705d0 0x56169a47acf0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f7f80006d40 tx=0x7f7f800228d0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.730+0000 7f7f9940b740 1 -- 172.21.15.92:0/1064765549 shutdown_connections 2024-09-19T08:59:13.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.730+0000 7f7f9940b740 1 --2- 172.21.15.92:0/1064765549 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56169a48b140 0x56169a48d590 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.730+0000 7f7f9940b740 1 --2- 172.21.15.92:0/1064765549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56169a47b370 0x56169a478600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.730+0000 7f7f9940b740 1 --2- 172.21.15.92:0/1064765549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56169a471b40 0x56169a477ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.730+0000 7f7f9940b740 1 --2- 172.21.15.92:0/1064765549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56169a4705d0 0x56169a47acf0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.730+0000 7f7f9940b740 1 -- 172.21.15.92:0/1064765549 >> 172.21.15.92:0/1064765549 conn(0x56169a439310 msgr2=0x56169a472960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:13.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.730+0000 7f7f6ffff640 0 client.15939 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:13.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.731+0000 7f7f9940b740 1 -- 172.21.15.92:0/1064765549 shutdown_connections 2024-09-19T08:59:13.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.731+0000 7f7f9940b740 1 -- 172.21.15.92:0/1064765549 wait complete. 2024-09-19T08:59:13.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.731+0000 7f7f9940b740 20 client.15939 trim_cache size 0 max 16384 2024-09-19T08:59:13.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.754+0000 7f7f9940b740 1 Processor -- start 2024-09-19T08:59:13.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.754+0000 7f7f9940b740 1 -- start start 2024-09-19T08:59:13.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.755+0000 7f7f9940b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56169a4705d0 0x56169a473120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:13.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.755+0000 7f7f9940b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56169a471b40 0x56169a473660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:13.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.755+0000 7f7f9940b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56169a47b370 0x56169a492e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:13.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.755+0000 7f7f9940b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7f901ada80 con 0x56169a47b370 2024-09-19T08:59:13.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.755+0000 7f7f9940b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7f901b0250 con 0x56169a4705d0 2024-09-19T08:59:13.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.755+0000 7f7f9940b740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7f901ae040 con 0x56169a471b40 2024-09-19T08:59:13.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.755+0000 7f7f94dce640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56169a4705d0 0x56169a473120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:13.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.755+0000 7f7f94dce640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56169a4705d0 0x56169a473120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:50236/0 (socket says 172.21.15.92:50236) 2024-09-19T08:59:13.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.755+0000 7f7f94dce640 1 -- 172.21.15.92:0/4110001406 learned_addr learned my addr 172.21.15.92:0/4110001406 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:13.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.755+0000 7f7f8ffff640 1 --2- 172.21.15.92:0/4110001406 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56169a471b40 0x56169a473660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:13.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.755+0000 7f7f955cf640 1 --2- 172.21.15.92:0/4110001406 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56169a47b370 0x56169a492e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:13.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.755+0000 7f7f8ffff640 1 -- 172.21.15.92:0/4110001406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56169a4705d0 msgr2=0x56169a473120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:13.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.755+0000 7f7f8ffff640 1 --2- 172.21.15.92:0/4110001406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56169a4705d0 0x56169a473120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.755+0000 7f7f8ffff640 1 -- 172.21.15.92:0/4110001406 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56169a47b370 msgr2=0x56169a492e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:13.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.755+0000 7f7f8ffff640 1 --2- 172.21.15.92:0/4110001406 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56169a47b370 0x56169a492e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.755+0000 7f7f8ffff640 1 -- 172.21.15.92:0/4110001406 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56169a478970 con 0x56169a471b40 2024-09-19T08:59:13.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.755+0000 7f7f955cf640 1 --2- 172.21.15.92:0/4110001406 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56169a47b370 0x56169a492e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:59:13.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.756+0000 7f7f8ffff640 1 --2- 172.21.15.92:0/4110001406 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56169a471b40 0x56169a473660 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7f84005890 tx=0x7f7f84097cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69232f936585ef3a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:13.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.756+0000 7f7f767fc640 1 -- 172.21.15.92:0/4110001406 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f84020040 con 0x56169a471b40 2024-09-19T08:59:13.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.756+0000 7f7f767fc640 1 -- 172.21.15.92:0/4110001406 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f840a4690 con 0x56169a471b40 2024-09-19T08:59:13.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.756+0000 7f7f767fc640 1 -- 172.21.15.92:0/4110001406 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f84098090 con 0x56169a471b40 2024-09-19T08:59:13.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.757+0000 7f7f9940b740 1 -- 172.21.15.92:0/4110001406 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56169a471b40 msgr2=0x56169a473660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:13.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.757+0000 7f7f9940b740 1 --2- 172.21.15.92:0/4110001406 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56169a471b40 0x56169a473660 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7f84005890 tx=0x7f7f84097cc0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.757+0000 7f7f9940b740 1 -- 172.21.15.92:0/4110001406 shutdown_connections 2024-09-19T08:59:13.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.757+0000 7f7f9940b740 1 --2- 172.21.15.92:0/4110001406 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56169a47b370 0x56169a492e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.757+0000 7f7f9940b740 1 --2- 172.21.15.92:0/4110001406 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56169a471b40 0x56169a473660 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.757+0000 7f7f9940b740 1 --2- 172.21.15.92:0/4110001406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56169a4705d0 0x56169a473120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.757+0000 7f7f9940b740 1 -- 172.21.15.92:0/4110001406 >> 172.21.15.92:0/4110001406 conn(0x56169a439310 msgr2=0x56169a46bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:13.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.757+0000 7f7f9940b740 1 -- 172.21.15.92:0/4110001406 shutdown_connections 2024-09-19T08:59:13.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.757+0000 7f7f9940b740 1 -- 172.21.15.92:0/4110001406 wait complete. 2024-09-19T08:59:13.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.758+0000 7f7f9940b740 1 -- start start 2024-09-19T08:59:13.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.758+0000 7f7f9940b740 1 Processor -- start 2024-09-19T08:59:13.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.759+0000 7f7f9940b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56169a4705d0 0x56169a4836b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:13.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.759+0000 7f7f9940b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56169a471b40 0x56169a483bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:13.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.759+0000 7f7f9940b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56169a47b370 0x56169a4748e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:13.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.759+0000 7f7f9940b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7f901ae710 con 0x56169a471b40 2024-09-19T08:59:13.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.759+0000 7f7f9940b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7f901afb80 con 0x56169a47b370 2024-09-19T08:59:13.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.759+0000 7f7f9940b740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7f901aede0 con 0x56169a4705d0 2024-09-19T08:59:13.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.759+0000 7f7f9940b740 10 client.0 _ll_register_callbacks cb 0x7f7f84004ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:13.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.760+0000 7f7f955cf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56169a47b370 0x56169a4748e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:13.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.760+0000 7f7f8ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56169a471b40 0x56169a483bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:13.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.760+0000 7f7f8ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56169a471b40 0x56169a483bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33130/0 (socket says 172.21.15.92:33130) 2024-09-19T08:59:13.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.760+0000 7f7f8ffff640 1 -- 172.21.15.92:0/1810849990 learned_addr learned my addr 172.21.15.92:0/1810849990 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:13.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.760+0000 7f7f94dce640 1 --2- 172.21.15.92:0/1810849990 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56169a4705d0 0x56169a4836b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:13.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.761+0000 7f7f8ffff640 1 -- 172.21.15.92:0/1810849990 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56169a4705d0 msgr2=0x56169a4836b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:13.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.761+0000 7f7f8ffff640 1 --2- 172.21.15.92:0/1810849990 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56169a4705d0 0x56169a4836b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.761+0000 7f7f8ffff640 1 -- 172.21.15.92:0/1810849990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56169a47b370 msgr2=0x56169a4748e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:13.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.761+0000 7f7f8ffff640 1 --2- 172.21.15.92:0/1810849990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56169a47b370 0x56169a4748e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.761+0000 7f7f8ffff640 1 -- 172.21.15.92:0/1810849990 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56169a475110 con 0x56169a471b40 2024-09-19T08:59:13.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.761+0000 7f7f8ffff640 1 --2- 172.21.15.92:0/1810849990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56169a471b40 0x56169a483bf0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f7f840983f0 tx=0x7f7f84097da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca2341eef8f1bbeb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:13.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.761+0000 7f7f6ffff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:59:13.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.761+0000 7f7f6ffff640 1 -- 172.21.15.92:0/1810849990 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f84020050 con 0x56169a471b40 2024-09-19T08:59:13.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.761+0000 7f7f6ffff640 1 -- 172.21.15.92:0/1810849990 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f7f840b9070 con 0x56169a471b40 2024-09-19T08:59:13.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.761+0000 7f7f9940b740 1 -- 172.21.15.92:0/1810849990 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f840a4690 con 0x56169a471b40 2024-09-19T08:59:13.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.761+0000 7f7f6ffff640 1 -- 172.21.15.92:0/1810849990 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7f840ba310 con 0x56169a471b40 2024-09-19T08:59:13.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.761+0000 7f7f9940b740 10 client.15945 fetch_fsmap learned FSMap version 19 2024-09-19T08:59:13.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.761+0000 7f7f9940b740 1 -- 172.21.15.92:0/1810849990 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56169a4f5930 con 0x56169a471b40 2024-09-19T08:59:13.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.762+0000 7f7f6ffff640 1 -- 172.21.15.92:0/1810849990 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f840a4690 con 0x56169a471b40 2024-09-19T08:59:13.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.762+0000 7f7f6ffff640 1 -- 172.21.15.92:0/1810849990 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f7f840ad030 con 0x56169a471b40 2024-09-19T08:59:13.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.762+0000 7f7f9940b740 10 client.15945 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:59:13.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.762+0000 7f7f9940b740 10 client.15945 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:59:13.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.762+0000 7f7f9940b740 20 client.15945 populate_metadata read hostname 'smithi092' 2024-09-19T08:59:13.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.762+0000 7f7f9940b740 1 --2- 172.21.15.92:0/1810849990 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56169a4f5f60 0x56169a4f8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:13.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.762+0000 7f7f9940b740 4 client.15945 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:59:13.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.762+0000 7f7f9940b740 1 -- 172.21.15.92:0/1810849990 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56169a3ddd70 con 0x56169a4f5f60 2024-09-19T08:59:13.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.762+0000 7f7f94dce640 1 --2- 172.21.15.92:0/1810849990 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56169a4f5f60 0x56169a4f8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:13.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.763+0000 7f7f94dce640 1 --2- 172.21.15.92:0/1810849990 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56169a4f5f60 0x56169a4f8380 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=579bfb3624a4e1b8 server_cookie=ae566bd99e2e3963 in_seq=0 out_seq=0 2024-09-19T08:59:13.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.763+0000 7f7f6ffff640 10 client.15945 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:13.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.763+0000 7f7f6ffff640 1 -- 172.21.15.92:0/1810849990 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56169a3ddd70 con 0x56169a4f5f60 2024-09-19T08:59:13.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.764+0000 7f7f6ffff640 10 client.15945 handle_command_reply: tid=0 2024-09-19T08:59:13.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.764+0000 7f7f9940b740 1 client.15945 shutdown 2024-09-19T08:59:13.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.764+0000 7f7f9940b740 1 -- 172.21.15.92:0/1810849990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56169a471b40 msgr2=0x56169a483bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:13.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.764+0000 7f7f9940b740 1 --2- 172.21.15.92:0/1810849990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56169a471b40 0x56169a483bf0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f7f840983f0 tx=0x7f7f84097da0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.764+0000 7f7f9940b740 1 -- 172.21.15.92:0/1810849990 shutdown_connections 2024-09-19T08:59:13.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.764+0000 7f7f9940b740 1 --2- 172.21.15.92:0/1810849990 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56169a4f5f60 0x56169a4f8380 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.764+0000 7f7f9940b740 1 --2- 172.21.15.92:0/1810849990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56169a47b370 0x56169a4748e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.764+0000 7f7f6ffff640 0 client.15945 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:13.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.764+0000 7f7f9940b740 1 --2- 172.21.15.92:0/1810849990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56169a471b40 0x56169a483bf0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.764+0000 7f7f9940b740 1 --2- 172.21.15.92:0/1810849990 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56169a4705d0 0x56169a4836b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.764+0000 7f7f9940b740 1 -- 172.21.15.92:0/1810849990 >> 172.21.15.92:0/1810849990 conn(0x56169a439310 msgr2=0x56169a46b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:13.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.765+0000 7f7f9940b740 1 -- 172.21.15.92:0/1810849990 shutdown_connections 2024-09-19T08:59:13.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.765+0000 7f7f9940b740 1 -- 172.21.15.92:0/1810849990 wait complete. 2024-09-19T08:59:13.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.765+0000 7f7f9940b740 20 client.15945 trim_cache size 0 max 16384 2024-09-19T08:59:13.769 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-19T08:59:13.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.767+0000 7f7f97032640 1 -- 172.21.15.92:0/3901198848 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7f780a3410 msgr2=0x7f7f780a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:13.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.767+0000 7f7f97032640 1 --2- 172.21.15.92:0/3901198848 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7f780a3410 0x7f7f780a58d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7f80009fd0 tx=0x7f7f80009620 comp rx=0 tx=0).stop 2024-09-19T08:59:13.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.767+0000 7f7f97032640 1 -- 172.21.15.92:0/3901198848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f90102790 msgr2=0x7f7f90071db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:13.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.767+0000 7f7f97032640 1 --2- 172.21.15.92:0/3901198848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f90102790 0x7f7f90071db0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f7f8400d6d0 tx=0x7f7f8400db90 comp rx=0 tx=0).stop 2024-09-19T08:59:13.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.767+0000 7f7f97032640 1 -- 172.21.15.92:0/3901198848 shutdown_connections 2024-09-19T08:59:13.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.767+0000 7f7f97032640 1 --2- 172.21.15.92:0/3901198848 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f90106f10 0x7f7f9006c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.767+0000 7f7f97032640 1 --2- 172.21.15.92:0/3901198848 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7f780a3410 0x7f7f780a58d0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.767+0000 7f7f97032640 1 --2- 172.21.15.92:0/3901198848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f90102790 0x7f7f90071db0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.767+0000 7f7f97032640 1 --2- 172.21.15.92:0/3901198848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f90101de0 0x7f7f90071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.767+0000 7f7f97032640 1 -- 172.21.15.92:0/3901198848 >> 172.21.15.92:0/3901198848 conn(0x7f7f900fd8e0 msgr2=0x7f7f900fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:13.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.767+0000 7f7f97032640 1 -- 172.21.15.92:0/3901198848 shutdown_connections 2024-09-19T08:59:13.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:13.767+0000 7f7f97032640 1 -- 172.21.15.92:0/3901198848 wait complete. 2024-09-19T08:59:13.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:13 smithi167 ceph-mon[35359]: pgmap v412: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 12 MiB/s wr, 867 op/s 2024-09-19T08:59:13.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:13 smithi190 ceph-mon[35358]: pgmap v412: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 12 MiB/s wr, 867 op/s 2024-09-19T08:59:15.566 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:59:15.566 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:59:15.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:15 smithi092 ceph-mon[31407]: pgmap v413: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 14 MiB/s wr, 1.01k op/s 2024-09-19T08:59:15.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 150.0 s, 4207.2 tps, lat 23.729 ms stddev 25.831 2024-09-19T08:59:15.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:15 smithi167 ceph-mon[35359]: pgmap v413: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 14 MiB/s wr, 1.01k op/s 2024-09-19T08:59:15.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:15 smithi190 ceph-mon[35358]: pgmap v413: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 14 MiB/s wr, 1.01k op/s 2024-09-19T08:59:15.972 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:59:16.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.516+0000 7fab54569640 1 -- 172.21.15.92:0/766579422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab4c102ef0 msgr2=0x7fab4c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:16.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.516+0000 7fab54569640 1 --2- 172.21.15.92:0/766579422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab4c102ef0 0x7fab4c10da40 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fab44009ca0 tx=0x7fab4402a950 comp rx=0 tx=0).stop 2024-09-19T08:59:16.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.517+0000 7fab54569640 1 -- 172.21.15.92:0/766579422 shutdown_connections 2024-09-19T08:59:16.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.517+0000 7fab54569640 1 --2- 172.21.15.92:0/766579422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab4c102ef0 0x7fab4c10da40 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:16.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.517+0000 7fab54569640 1 --2- 172.21.15.92:0/766579422 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab4c102570 0x7fab4c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:16.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.517+0000 7fab54569640 1 --2- 172.21.15.92:0/766579422 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab4c100e20 0x7fab4c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:16.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.517+0000 7fab54569640 1 -- 172.21.15.92:0/766579422 >> 172.21.15.92:0/766579422 conn(0x7fab4c0fc7d0 msgr2=0x7fab4c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:16.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.517+0000 7fab54569640 1 -- 172.21.15.92:0/766579422 shutdown_connections 2024-09-19T08:59:16.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.517+0000 7fab54569640 1 -- 172.21.15.92:0/766579422 wait complete. 2024-09-19T08:59:16.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.518+0000 7fab54569640 1 Processor -- start 2024-09-19T08:59:16.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.518+0000 7fab54569640 1 -- start start 2024-09-19T08:59:16.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.518+0000 7fab54569640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab4c100e20 0x7fab4c19a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:16.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.518+0000 7fab54569640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab4c102570 0x7fab4c19abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:16.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.518+0000 7fab54569640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab4c102ef0 0x7fab4c19ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:16.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.518+0000 7fab54569640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fab4c1120a0 con 0x7fab4c100e20 2024-09-19T08:59:16.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.518+0000 7fab54569640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fab4c111f20 con 0x7fab4c102570 2024-09-19T08:59:16.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.518+0000 7fab54569640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fab4c112220 con 0x7fab4c102ef0 2024-09-19T08:59:16.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.519+0000 7fab52305640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab4c100e20 0x7fab4c19a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:16.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.519+0000 7fab51b04640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab4c102570 0x7fab4c19abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:16.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.519+0000 7fab52305640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab4c100e20 0x7fab4c19a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33148/0 (socket says 172.21.15.92:33148) 2024-09-19T08:59:16.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.519+0000 7fab52305640 1 -- 172.21.15.92:0/3158281703 learned_addr learned my addr 172.21.15.92:0/3158281703 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:16.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.519+0000 7fab52b06640 1 --2- 172.21.15.92:0/3158281703 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab4c102ef0 0x7fab4c19ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:16.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.519+0000 7fab51b04640 1 -- 172.21.15.92:0/3158281703 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab4c102ef0 msgr2=0x7fab4c19ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:16.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.519+0000 7fab51b04640 1 --2- 172.21.15.92:0/3158281703 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab4c102ef0 0x7fab4c19ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:16.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.519+0000 7fab51b04640 1 -- 172.21.15.92:0/3158281703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab4c100e20 msgr2=0x7fab4c19a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:16.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.519+0000 7fab51b04640 1 --2- 172.21.15.92:0/3158281703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab4c100e20 0x7fab4c19a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:16.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.519+0000 7fab51b04640 1 -- 172.21.15.92:0/3158281703 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab4c19f630 con 0x7fab4c102570 2024-09-19T08:59:16.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.519+0000 7fab52305640 1 --2- 172.21.15.92:0/3158281703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab4c100e20 0x7fab4c19a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:16.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.519+0000 7fab51b04640 1 --2- 172.21.15.92:0/3158281703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab4c102570 0x7fab4c19abc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fab3c00e970 tx=0x7fab3c00ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:16.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.520+0000 7fab437fe640 1 -- 172.21.15.92:0/3158281703 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3c00ccc0 con 0x7fab4c102570 2024-09-19T08:59:16.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.520+0000 7fab54569640 1 -- 172.21.15.92:0/3158281703 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab4c19f920 con 0x7fab4c102570 2024-09-19T08:59:16.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.520+0000 7fab54569640 1 -- 172.21.15.92:0/3158281703 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab4c1a7200 con 0x7fab4c102570 2024-09-19T08:59:16.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.520+0000 7fab437fe640 1 -- 172.21.15.92:0/3158281703 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab3c005020 con 0x7fab4c102570 2024-09-19T08:59:16.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.520+0000 7fab437fe640 1 -- 172.21.15.92:0/3158281703 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3c004a00 con 0x7fab4c102570 2024-09-19T08:59:16.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.522+0000 7fab437fe640 1 -- 172.21.15.92:0/3158281703 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fab3c004ba0 con 0x7fab4c102570 2024-09-19T08:59:16.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.523+0000 7fab437fe640 1 --2- 172.21.15.92:0/3158281703 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fab380a3380 0x7fab380a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:16.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.523+0000 7fab437fe640 1 -- 172.21.15.92:0/3158281703 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fab3c0cf720 con 0x7fab4c102570 2024-09-19T08:59:16.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.524+0000 7fab56942740 1 Processor -- start 2024-09-19T08:59:16.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.524+0000 7fab52305640 1 --2- 172.21.15.92:0/3158281703 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fab380a3380 0x7fab380a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:16.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.524+0000 7fab56942740 1 -- start start 2024-09-19T08:59:16.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.524+0000 7fab56942740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739d4a5370 0x55739d4a5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:16.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.524+0000 7fab56942740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55739d4a5c90 0x55739d4b0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:16.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.524+0000 7fab56942740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55739d4b0550 0x55739d4b2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:16.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.524+0000 7fab56942740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55739d402280 con 0x55739d4b0550 2024-09-19T08:59:16.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.524+0000 7fab56942740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55739d3a9b10 con 0x55739d4a5370 2024-09-19T08:59:16.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.524+0000 7fab56942740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55739d3fe240 con 0x55739d4a5c90 2024-09-19T08:59:16.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.525+0000 7fab52b06640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55739d4b0550 0x55739d4b2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:16.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.525+0000 7fab52b06640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55739d4b0550 0x55739d4b2940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33154/0 (socket says 172.21.15.92:33154) 2024-09-19T08:59:16.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.525+0000 7fab52b06640 1 -- 172.21.15.92:0/54582600 learned_addr learned my addr 172.21.15.92:0/54582600 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:16.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.525+0000 7fab52305640 1 --2- 172.21.15.92:0/54582600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739d4a5370 0x55739d4a5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:16.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.525+0000 7fab52305640 1 -- 172.21.15.92:0/54582600 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55739d4a5c90 msgr2=0x55739d4b0010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T08:59:16.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.525+0000 7fab52305640 1 --2- 172.21.15.92:0/54582600 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55739d4a5c90 0x55739d4b0010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:16.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.525+0000 7fab52305640 1 -- 172.21.15.92:0/54582600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55739d4b0550 msgr2=0x55739d4b2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:16.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.525+0000 7fab52305640 1 --2- 172.21.15.92:0/54582600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55739d4b0550 0x55739d4b2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:16.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.525+0000 7fab52305640 1 -- 172.21.15.92:0/54582600 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55739d3b61f0 con 0x55739d4a5370 2024-09-19T08:59:16.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.525+0000 7fab52b06640 1 --2- 172.21.15.92:0/54582600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55739d4b0550 0x55739d4b2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:16.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.526+0000 7fab52305640 1 --2- 172.21.15.92:0/54582600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739d4a5370 0x55739d4a5750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fab48005fd0 tx=0x7fab480108c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=939ca714d4ca6e07 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:16.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.526+0000 7fab40ff9640 1 -- 172.21.15.92:0/54582600 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab48024070 con 0x55739d4a5370 2024-09-19T08:59:16.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.526+0000 7fab40ff9640 1 -- 172.21.15.92:0/54582600 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab48005530 con 0x55739d4a5370 2024-09-19T08:59:16.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.526+0000 7fab40ff9640 1 -- 172.21.15.92:0/54582600 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab48004990 con 0x55739d4a5370 2024-09-19T08:59:16.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.527+0000 7fab56942740 1 -- 172.21.15.92:0/54582600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739d4a5370 msgr2=0x55739d4a5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:16.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.527+0000 7fab56942740 1 --2- 172.21.15.92:0/54582600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739d4a5370 0x55739d4a5750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fab48005fd0 tx=0x7fab480108c0 comp rx=0 tx=0).stop 2024-09-19T08:59:16.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.527+0000 7fab52305640 1 --2- 172.21.15.92:0/3158281703 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fab380a3380 0x7fab380a5840 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fab480058c0 tx=0x7fab48017000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:16.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.527+0000 7fab56942740 1 -- 172.21.15.92:0/54582600 shutdown_connections 2024-09-19T08:59:16.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.528+0000 7fab56942740 1 --2- 172.21.15.92:0/54582600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55739d4b0550 0x55739d4b2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:16.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.528+0000 7fab56942740 1 --2- 172.21.15.92:0/54582600 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55739d4a5c90 0x55739d4b0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:16.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.528+0000 7fab56942740 1 --2- 172.21.15.92:0/54582600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739d4a5370 0x55739d4a5750 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:16.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.528+0000 7fab56942740 1 -- 172.21.15.92:0/54582600 >> 172.21.15.92:0/54582600 conn(0x55739d4a1900 msgr2=0x55739d4a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:16.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.528+0000 7fab56942740 1 -- 172.21.15.92:0/54582600 shutdown_connections 2024-09-19T08:59:16.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.528+0000 7fab56942740 1 -- 172.21.15.92:0/54582600 wait complete. 2024-09-19T08:59:16.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.528+0000 7fab56942740 1 -- start start 2024-09-19T08:59:16.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.528+0000 7fab56942740 1 Processor -- start 2024-09-19T08:59:16.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.529+0000 7fab56942740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739d4a5370 0x55739d4ad4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:16.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.529+0000 7fab56942740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55739d4a5c90 0x55739d4ad9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:16.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.529+0000 7fab52305640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739d4a5370 0x55739d4ad4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:16.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.529+0000 7fab52305640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739d4a5370 0x55739d4ad4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:50272/0 (socket says 172.21.15.92:50272) 2024-09-19T08:59:16.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.529+0000 7fab52305640 1 -- 172.21.15.92:0/2799539787 learned_addr learned my addr 172.21.15.92:0/2799539787 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:16.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.529+0000 7fab56942740 1 --2- 172.21.15.92:0/2799539787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55739d4b0550 0x55739d4adf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:16.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.529+0000 7fab51b04640 1 --2- 172.21.15.92:0/2799539787 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55739d4a5c90 0x55739d4ad9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:16.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.529+0000 7fab56942740 1 -- 172.21.15.92:0/2799539787 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55739d4b3120 con 0x55739d4b0550 2024-09-19T08:59:16.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.529+0000 7fab56942740 1 -- 172.21.15.92:0/2799539787 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55739d3bcf10 con 0x55739d4a5370 2024-09-19T08:59:16.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.529+0000 7fab56942740 1 -- 172.21.15.92:0/2799539787 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55739d4b32a0 con 0x55739d4a5c90 2024-09-19T08:59:16.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.530+0000 7fab52b06640 1 --2- 172.21.15.92:0/2799539787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55739d4b0550 0x55739d4adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:16.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.530+0000 7fab56942740 10 client.0 _ll_register_callbacks cb 0x55739d385a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:16.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.530+0000 7fab52305640 1 -- 172.21.15.92:0/2799539787 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55739d4a5c90 msgr2=0x55739d4ad9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:16.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.530+0000 7fab52305640 1 --2- 172.21.15.92:0/2799539787 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55739d4a5c90 0x55739d4ad9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:16.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.530+0000 7fab52305640 1 -- 172.21.15.92:0/2799539787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55739d4b0550 msgr2=0x55739d4adf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:16.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.530+0000 7fab52305640 1 --2- 172.21.15.92:0/2799539787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55739d4b0550 0x55739d4adf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:16.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.530+0000 7fab52305640 1 -- 172.21.15.92:0/2799539787 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55739d1736a0 con 0x55739d4a5370 2024-09-19T08:59:16.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.530+0000 7fab52305640 1 --2- 172.21.15.92:0/2799539787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739d4a5370 0x55739d4ad4b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fab48004890 tx=0x7fab4800b480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f6d88da82b2b6bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:16.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.530+0000 7fab35ffb640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T08:59:16.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.530+0000 7fab35ffb640 1 -- 172.21.15.92:0/2799539787 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab48024070 con 0x55739d4a5370 2024-09-19T08:59:16.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.531+0000 7fab35ffb640 1 -- 172.21.15.92:0/2799539787 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fab480048c0 con 0x55739d4a5370 2024-09-19T08:59:16.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.531+0000 7fab56942740 1 -- 172.21.15.92:0/2799539787 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab48005530 con 0x55739d4a5370 2024-09-19T08:59:16.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.531+0000 7fab35ffb640 1 -- 172.21.15.92:0/2799539787 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fab48004ac0 con 0x55739d4a5370 2024-09-19T08:59:16.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.531+0000 7fab56942740 10 client.25394 fetch_fsmap learned FSMap version 19 2024-09-19T08:59:16.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.531+0000 7fab56942740 1 -- 172.21.15.92:0/2799539787 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55739d4bee10 con 0x55739d4a5370 2024-09-19T08:59:16.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.531+0000 7fab35ffb640 1 -- 172.21.15.92:0/2799539787 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab48005530 con 0x55739d4a5370 2024-09-19T08:59:16.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.531+0000 7fab35ffb640 1 -- 172.21.15.92:0/2799539787 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fab48031950 con 0x55739d4a5370 2024-09-19T08:59:16.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.531+0000 7fab56942740 10 client.25394 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:59:16.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.531+0000 7fab56942740 10 client.25394 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:59:16.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.531+0000 7fab56942740 20 client.25394 populate_metadata read hostname 'smithi092' 2024-09-19T08:59:16.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.532+0000 7fab56942740 1 --2- 172.21.15.92:0/2799539787 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55739d4c01c0 0x55739d4c25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:16.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.532+0000 7fab56942740 4 client.25394 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:59:16.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.532+0000 7fab56942740 1 -- 172.21.15.92:0/2799539787 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55739d40f7f0 con 0x55739d4c01c0 2024-09-19T08:59:16.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.532+0000 7fab51b04640 1 --2- 172.21.15.92:0/2799539787 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55739d4c01c0 0x55739d4c25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:16.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.533+0000 7fab51b04640 1 --2- 172.21.15.92:0/2799539787 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55739d4c01c0 0x55739d4c25b0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c122b3fc9624ce3 server_cookie=46cbbca0386bb577 in_seq=0 out_seq=0 2024-09-19T08:59:16.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.533+0000 7fab35ffb640 10 client.25394 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:16.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.533+0000 7fab35ffb640 1 -- 172.21.15.92:0/2799539787 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55739d40f7f0 con 0x55739d4c01c0 2024-09-19T08:59:16.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.533+0000 7fab35ffb640 10 client.25394 handle_command_reply: tid=0 2024-09-19T08:59:16.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.534+0000 7fab56942740 1 client.25394 shutdown 2024-09-19T08:59:16.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.534+0000 7fab56942740 1 -- 172.21.15.92:0/2799539787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739d4a5370 msgr2=0x55739d4ad4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:16.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.534+0000 7fab56942740 1 --2- 172.21.15.92:0/2799539787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739d4a5370 0x55739d4ad4b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fab48004890 tx=0x7fab4800b480 comp rx=0 tx=0).stop 2024-09-19T08:59:16.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.534+0000 7fab56942740 1 -- 172.21.15.92:0/2799539787 shutdown_connections 2024-09-19T08:59:16.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.534+0000 7fab56942740 1 --2- 172.21.15.92:0/2799539787 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55739d4c01c0 0x55739d4c25b0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:16.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.534+0000 7fab35ffb640 0 client.25394 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:16.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.534+0000 7fab56942740 1 --2- 172.21.15.92:0/2799539787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55739d4b0550 0x55739d4adf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:16.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.534+0000 7fab56942740 1 --2- 172.21.15.92:0/2799539787 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55739d4a5c90 0x55739d4ad9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:16.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.534+0000 7fab56942740 1 --2- 172.21.15.92:0/2799539787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739d4a5370 0x55739d4ad4b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:16.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.534+0000 7fab56942740 1 -- 172.21.15.92:0/2799539787 >> 172.21.15.92:0/2799539787 conn(0x55739d4a1900 msgr2=0x55739d498270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:16.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.534+0000 7fab56942740 1 -- 172.21.15.92:0/2799539787 shutdown_connections 2024-09-19T08:59:16.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.534+0000 7fab56942740 1 -- 172.21.15.92:0/2799539787 wait complete. 2024-09-19T08:59:16.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.535+0000 7fab56942740 20 client.25394 trim_cache size 0 max 16384 2024-09-19T08:59:16.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.563+0000 7fab56942740 1 Processor -- start 2024-09-19T08:59:16.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.563+0000 7fab56942740 1 -- start start 2024-09-19T08:59:16.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.563+0000 7fab56942740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55739d4a5370 0x55739d4a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:16.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.563+0000 7fab56942740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55739d4a5c90 0x55739d4c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:16.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.563+0000 7fab56942740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739d4b0550 0x55739d4c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:16.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.563+0000 7fab56942740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fab3000c460 con 0x55739d4a5c90 2024-09-19T08:59:16.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.563+0000 7fab56942740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fab3000ed00 con 0x55739d4b0550 2024-09-19T08:59:16.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.563+0000 7fab56942740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fab3000caf0 con 0x55739d4a5370 2024-09-19T08:59:16.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.564+0000 7fab52305640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55739d4a5370 0x55739d4a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:16.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.564+0000 7fab52b06640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739d4b0550 0x55739d4c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:16.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.564+0000 7fab52305640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55739d4a5370 0x55739d4a7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:32920/0 (socket says 172.21.15.92:32920) 2024-09-19T08:59:16.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.564+0000 7fab52305640 1 -- 172.21.15.92:0/997962363 learned_addr learned my addr 172.21.15.92:0/997962363 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:16.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.564+0000 7fab52305640 1 -- 172.21.15.92:0/997962363 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739d4b0550 msgr2=0x55739d4c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:16.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.564+0000 7fab52305640 1 --2- 172.21.15.92:0/997962363 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739d4b0550 0x55739d4c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:16.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.564+0000 7fab52305640 1 -- 172.21.15.92:0/997962363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55739d4a5c90 msgr2=0x55739d4c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:16.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.564+0000 7fab52305640 1 --2- 172.21.15.92:0/997962363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55739d4a5c90 0x55739d4c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:16.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.564+0000 7fab52305640 1 -- 172.21.15.92:0/997962363 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55739d4a5ac0 con 0x55739d4a5370 2024-09-19T08:59:16.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.564+0000 7fab52305640 1 --2- 172.21.15.92:0/997962363 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55739d4a5370 0x55739d4a7dd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fab48005bd0 tx=0x7fab48014450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78ade815e00a1c64 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:16.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.565+0000 7fab37fff640 1 -- 172.21.15.92:0/997962363 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab48024070 con 0x55739d4a5370 2024-09-19T08:59:16.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.565+0000 7fab37fff640 1 -- 172.21.15.92:0/997962363 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab4802c070 con 0x55739d4a5370 2024-09-19T08:59:16.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.565+0000 7fab37fff640 1 -- 172.21.15.92:0/997962363 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab48004c60 con 0x55739d4a5370 2024-09-19T08:59:16.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.566+0000 7fab56942740 1 -- 172.21.15.92:0/997962363 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55739d4a5370 msgr2=0x55739d4a7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:16.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.566+0000 7fab56942740 1 --2- 172.21.15.92:0/997962363 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55739d4a5370 0x55739d4a7dd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fab48005bd0 tx=0x7fab48014450 comp rx=0 tx=0).stop 2024-09-19T08:59:16.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.566+0000 7fab56942740 1 -- 172.21.15.92:0/997962363 shutdown_connections 2024-09-19T08:59:16.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.566+0000 7fab56942740 1 --2- 172.21.15.92:0/997962363 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739d4b0550 0x55739d4c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:16.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.566+0000 7fab56942740 1 --2- 172.21.15.92:0/997962363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55739d4a5c90 0x55739d4c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:16.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.566+0000 7fab56942740 1 --2- 172.21.15.92:0/997962363 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55739d4a5370 0x55739d4a7dd0 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fab48005bd0 tx=0x7fab48014450 comp rx=0 tx=0).stop 2024-09-19T08:59:16.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.566+0000 7fab56942740 1 -- 172.21.15.92:0/997962363 >> 172.21.15.92:0/997962363 conn(0x55739d4a1900 msgr2=0x55739d498270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:16.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.568+0000 7fab56942740 1 -- 172.21.15.92:0/997962363 shutdown_connections 2024-09-19T08:59:16.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.568+0000 7fab56942740 1 -- 172.21.15.92:0/997962363 wait complete. 2024-09-19T08:59:16.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.568+0000 7fab56942740 1 -- start start 2024-09-19T08:59:16.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.568+0000 7fab56942740 1 Processor -- start 2024-09-19T08:59:16.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.569+0000 7fab56942740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55739d4a5c90 0x55739d4aa680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:16.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.569+0000 7fab56942740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55739d4b0550 0x55739d4aabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:16.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.569+0000 7fab56942740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739d4c01c0 0x55739d4ab100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:16.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.569+0000 7fab56942740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fab3000d1c0 con 0x55739d4b0550 2024-09-19T08:59:16.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.569+0000 7fab52305640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55739d4a5c90 0x55739d4aa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:16.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.569+0000 7fab52305640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55739d4a5c90 0x55739d4aa680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:32922/0 (socket says 172.21.15.92:32922) 2024-09-19T08:59:16.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.569+0000 7fab52305640 1 -- 172.21.15.92:0/691320218 learned_addr learned my addr 172.21.15.92:0/691320218 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:16.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.569+0000 7fab52b06640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739d4c01c0 0x55739d4ab100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:16.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.570+0000 7fab56942740 1 -- 172.21.15.92:0/691320218 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fab3000e630 con 0x55739d4c01c0 2024-09-19T08:59:16.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.570+0000 7fab56942740 1 -- 172.21.15.92:0/691320218 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fab3000d890 con 0x55739d4a5c90 2024-09-19T08:59:16.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.570+0000 7fab56942740 10 client.0 _ll_register_callbacks cb 0x7fab48022070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:16.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.570+0000 7fab52b06640 1 -- 172.21.15.92:0/691320218 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55739d4a5c90 msgr2=0x55739d4aa680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:16.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.570+0000 7fab52b06640 1 --2- 172.21.15.92:0/691320218 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55739d4a5c90 0x55739d4aa680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:16.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.570+0000 7fab52b06640 1 -- 172.21.15.92:0/691320218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55739d4b0550 msgr2=0x55739d4aabc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T08:59:16.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.570+0000 7fab52b06640 1 --2- 172.21.15.92:0/691320218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55739d4b0550 0x55739d4aabc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:16.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.570+0000 7fab52b06640 1 -- 172.21.15.92:0/691320218 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55739d529f40 con 0x55739d4c01c0 2024-09-19T08:59:16.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.571+0000 7fab52b06640 1 --2- 172.21.15.92:0/691320218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739d4c01c0 0x55739d4ab100 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fab44005e30 tx=0x7fab44003ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac9911c438592cf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:16.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.571+0000 7fab35ffb640 10 client.25400 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T08:59:16.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.571+0000 7fab35ffb640 1 -- 172.21.15.92:0/691320218 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab44034040 con 0x55739d4c01c0 2024-09-19T08:59:16.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.571+0000 7fab56942740 1 -- 172.21.15.92:0/691320218 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab4802c070 con 0x55739d4c01c0 2024-09-19T08:59:16.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.571+0000 7fab35ffb640 1 -- 172.21.15.92:0/691320218 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fab4402fb30 con 0x55739d4c01c0 2024-09-19T08:59:16.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.571+0000 7fab35ffb640 1 -- 172.21.15.92:0/691320218 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fab4402fd30 con 0x55739d4c01c0 2024-09-19T08:59:16.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.571+0000 7fab56942740 10 client.25400 fetch_fsmap learned FSMap version 19 2024-09-19T08:59:16.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.571+0000 7fab56942740 1 -- 172.21.15.92:0/691320218 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55739d52b180 con 0x55739d4c01c0 2024-09-19T08:59:16.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.572+0000 7fab35ffb640 1 -- 172.21.15.92:0/691320218 <== mon.2 v2:172.21.15.167:3300/0 4 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fab44004040 con 0x55739d4c01c0 2024-09-19T08:59:16.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.572+0000 7fab56942740 10 client.25400 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:59:16.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.572+0000 7fab56942740 10 client.25400 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:59:16.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.572+0000 7fab56942740 20 client.25400 populate_metadata read hostname 'smithi092' 2024-09-19T08:59:16.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.572+0000 7fab56942740 1 --2- 172.21.15.92:0/691320218 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55739d52b6f0 0x55739d52db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:16.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.572+0000 7fab56942740 4 client.25400 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:59:16.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.572+0000 7fab56942740 1 -- 172.21.15.92:0/691320218 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7fab4802c070 con 0x55739d52b6f0 2024-09-19T08:59:16.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.573+0000 7fab52305640 1 --2- 172.21.15.92:0/691320218 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55739d52b6f0 0x55739d52db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:16.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.573+0000 7fab52305640 1 --2- 172.21.15.92:0/691320218 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55739d52b6f0 0x55739d52db20 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1881b154733bdab7 server_cookie=f2bc21a5ef9d771b in_seq=0 out_seq=0 2024-09-19T08:59:16.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.573+0000 7fab35ffb640 10 client.25400 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:16.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.574+0000 7fab35ffb640 1 -- 172.21.15.92:0/691320218 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7fab4802c070 con 0x55739d52b6f0 2024-09-19T08:59:16.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.574+0000 7fab35ffb640 10 client.25400 handle_command_reply: tid=0 2024-09-19T08:59:16.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.574+0000 7fab56942740 1 client.25400 shutdown 2024-09-19T08:59:16.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.574+0000 7fab56942740 1 -- 172.21.15.92:0/691320218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739d4c01c0 msgr2=0x55739d4ab100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:16.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.574+0000 7fab56942740 1 --2- 172.21.15.92:0/691320218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739d4c01c0 0x55739d4ab100 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fab44005e30 tx=0x7fab44003ce0 comp rx=0 tx=0).stop 2024-09-19T08:59:16.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.574+0000 7fab56942740 1 -- 172.21.15.92:0/691320218 shutdown_connections 2024-09-19T08:59:16.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.574+0000 7fab56942740 1 --2- 172.21.15.92:0/691320218 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55739d52b6f0 0x55739d52db20 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:16.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.574+0000 7fab56942740 1 --2- 172.21.15.92:0/691320218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739d4c01c0 0x55739d4ab100 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:16.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.574+0000 7fab35ffb640 0 client.25400 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:16.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.574+0000 7fab56942740 1 --2- 172.21.15.92:0/691320218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55739d4b0550 0x55739d4aabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:16.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.574+0000 7fab56942740 1 --2- 172.21.15.92:0/691320218 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55739d4a5c90 0x55739d4aa680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:16.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.575+0000 7fab56942740 1 -- 172.21.15.92:0/691320218 >> 172.21.15.92:0/691320218 conn(0x55739d4a1900 msgr2=0x55739d4bb400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:16.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.575+0000 7fab56942740 1 -- 172.21.15.92:0/691320218 shutdown_connections 2024-09-19T08:59:16.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.575+0000 7fab56942740 1 -- 172.21.15.92:0/691320218 wait complete. 2024-09-19T08:59:16.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.575+0000 7fab56942740 20 client.25400 trim_cache size 0 max 16384 2024-09-19T08:59:16.579 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T08:59:16.579 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-19T08:59:16.579 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "9cc697d8-09f9-4265-8e5c-475c166f90e5", 2024-09-19T08:59:16.579 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-19T08:59:16.579 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T08:59:16.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.576+0000 7fab54569640 1 -- 172.21.15.92:0/3158281703 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fab380a3380 msgr2=0x7fab380a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:16.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.576+0000 7fab54569640 1 --2- 172.21.15.92:0/3158281703 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fab380a3380 0x7fab380a5840 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fab480058c0 tx=0x7fab48017000 comp rx=0 tx=0).stop 2024-09-19T08:59:16.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.576+0000 7fab54569640 1 -- 172.21.15.92:0/3158281703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab4c102570 msgr2=0x7fab4c19abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:16.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.576+0000 7fab54569640 1 --2- 172.21.15.92:0/3158281703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab4c102570 0x7fab4c19abc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fab3c00e970 tx=0x7fab3c00ee30 comp rx=0 tx=0).stop 2024-09-19T08:59:16.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.576+0000 7fab54569640 1 -- 172.21.15.92:0/3158281703 shutdown_connections 2024-09-19T08:59:16.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.576+0000 7fab54569640 1 --2- 172.21.15.92:0/3158281703 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab4c102ef0 0x7fab4c19ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:16.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.576+0000 7fab54569640 1 --2- 172.21.15.92:0/3158281703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab4c102570 0x7fab4c19abc0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:16.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.576+0000 7fab54569640 1 --2- 172.21.15.92:0/3158281703 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fab380a3380 0x7fab380a5840 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:16.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.576+0000 7fab54569640 1 --2- 172.21.15.92:0/3158281703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab4c100e20 0x7fab4c19a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:16.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.576+0000 7fab54569640 1 -- 172.21.15.92:0/3158281703 >> 172.21.15.92:0/3158281703 conn(0x7fab4c0fc7d0 msgr2=0x7fab4c105ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:16.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.576+0000 7fab54569640 1 -- 172.21.15.92:0/3158281703 shutdown_connections 2024-09-19T08:59:16.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:16.576+0000 7fab54569640 1 -- 172.21.15.92:0/3158281703 wait complete. 2024-09-19T08:59:17.396 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:59:17.757 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:17 smithi092 ceph-mon[31407]: pgmap v414: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 11 MiB/s wr, 826 op/s 2024-09-19T08:59:17.757 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:17 smithi092 ceph-mon[31407]: scrub queued for path: / 2024-09-19T08:59:17.757 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:17 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T08:59:17.757 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:17 smithi092 ceph-mon[31407]: scrub summary: active paths [/] 2024-09-19T08:59:17.766 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:59:17.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:17 smithi167 ceph-mon[35359]: pgmap v414: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 11 MiB/s wr, 826 op/s 2024-09-19T08:59:17.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:17 smithi167 ceph-mon[35359]: scrub queued for path: / 2024-09-19T08:59:17.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:17 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T08:59:17.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:17 smithi167 ceph-mon[35359]: scrub summary: active paths [/] 2024-09-19T08:59:17.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:17 smithi190 ceph-mon[35358]: pgmap v414: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 11 MiB/s wr, 826 op/s 2024-09-19T08:59:17.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:17 smithi190 ceph-mon[35358]: scrub queued for path: / 2024-09-19T08:59:17.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:17 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T08:59:17.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:17 smithi190 ceph-mon[35358]: scrub summary: active paths [/] 2024-09-19T08:59:18.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.301+0000 7f59a2022640 1 -- 172.21.15.92:0/642503232 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f599c10a560 msgr2=0x7f599c10a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:18.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.301+0000 7f59a2022640 1 --2- 172.21.15.92:0/642503232 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f599c10a560 0x7f599c10a940 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f598c009be0 tx=0x7f598c02a6c0 comp rx=0 tx=0).stop 2024-09-19T08:59:18.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.301+0000 7f59a2022640 1 -- 172.21.15.92:0/642503232 shutdown_connections 2024-09-19T08:59:18.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.301+0000 7f59a2022640 1 --2- 172.21.15.92:0/642503232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f599c113940 0x7f599c115d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:18.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.301+0000 7f59a2022640 1 --2- 172.21.15.92:0/642503232 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f599c10ae80 0x7f599c113370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:18.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.301+0000 7f59a2022640 1 --2- 172.21.15.92:0/642503232 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f599c10a560 0x7f599c10a940 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:18.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.301+0000 7f59a2022640 1 -- 172.21.15.92:0/642503232 >> 172.21.15.92:0/642503232 conn(0x7f599c06e140 msgr2=0x7f599c06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:18.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.301+0000 7f59a2022640 1 -- 172.21.15.92:0/642503232 shutdown_connections 2024-09-19T08:59:18.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.301+0000 7f59a2022640 1 -- 172.21.15.92:0/642503232 wait complete. 2024-09-19T08:59:18.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.302+0000 7f59a2022640 1 Processor -- start 2024-09-19T08:59:18.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.303+0000 7f59a2022640 1 -- start start 2024-09-19T08:59:18.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.303+0000 7f59a2022640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f599c10a560 0x7f599c112e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:18.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.303+0000 7f59a2022640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f599c10ae80 0x7f599c10ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:18.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.303+0000 7f59a2022640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f599c113940 0x7f599c10f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:18.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.303+0000 7f59a2022640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f599c118540 con 0x7f599c10a560 2024-09-19T08:59:18.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.303+0000 7f59a2022640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f599c1183c0 con 0x7f599c113940 2024-09-19T08:59:18.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.303+0000 7f59a2022640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f599c1186c0 con 0x7f599c10ae80 2024-09-19T08:59:18.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.304+0000 7f599b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f599c10a560 0x7f599c112e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:18.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.304+0000 7f599b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f599c10a560 0x7f599c112e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33210/0 (socket says 172.21.15.92:33210) 2024-09-19T08:59:18.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.304+0000 7f599b7fe640 1 -- 172.21.15.92:0/2251068979 learned_addr learned my addr 172.21.15.92:0/2251068979 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:18.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.304+0000 7f599bfff640 1 --2- 172.21.15.92:0/2251068979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f599c113940 0x7f599c10f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:18.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.304+0000 7f5992ffd640 1 --2- 172.21.15.92:0/2251068979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f599c10ae80 0x7f599c10ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:18.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.304+0000 7f599bfff640 1 -- 172.21.15.92:0/2251068979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f599c10ae80 msgr2=0x7f599c10ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:18.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.304+0000 7f599bfff640 1 --2- 172.21.15.92:0/2251068979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f599c10ae80 0x7f599c10ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:18.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.304+0000 7f599bfff640 1 -- 172.21.15.92:0/2251068979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f599c10a560 msgr2=0x7f599c112e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:18.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.304+0000 7f599bfff640 1 --2- 172.21.15.92:0/2251068979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f599c10a560 0x7f599c112e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:18.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.304+0000 7f599bfff640 1 -- 172.21.15.92:0/2251068979 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f599c10f9e0 con 0x7f599c113940 2024-09-19T08:59:18.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.304+0000 7f599bfff640 1 --2- 172.21.15.92:0/2251068979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f599c113940 0x7f599c10f470 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f599400e970 tx=0x7f599400ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:18.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.305+0000 7f59997fa640 1 -- 172.21.15.92:0/2251068979 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f599400ccc0 con 0x7f599c113940 2024-09-19T08:59:18.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.305+0000 7f59997fa640 1 -- 172.21.15.92:0/2251068979 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59940035f0 con 0x7f599c113940 2024-09-19T08:59:18.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.306+0000 7f59997fa640 1 -- 172.21.15.92:0/2251068979 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f599400ce60 con 0x7f599c113940 2024-09-19T08:59:18.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.306+0000 7f59a2022640 1 -- 172.21.15.92:0/2251068979 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f599c10fcd0 con 0x7f599c113940 2024-09-19T08:59:18.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.306+0000 7f59a2022640 1 -- 172.21.15.92:0/2251068979 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f599c1b3cf0 con 0x7f599c113940 2024-09-19T08:59:18.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.309+0000 7f59997fa640 1 -- 172.21.15.92:0/2251068979 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5994004000 con 0x7f599c113940 2024-09-19T08:59:18.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.310+0000 7f59a43fb740 1 Processor -- start 2024-09-19T08:59:18.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.310+0000 7f59a43fb740 1 -- start start 2024-09-19T08:59:18.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.310+0000 7f59a43fb740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564642cdf4a0 0x564642cdf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:18.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.310+0000 7f59a43fb740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564642cdfdc0 0x564642cea140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:18.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.310+0000 7f59a43fb740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564642cea680 0x564642ceca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:18.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.310+0000 7f59a43fb740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564642c452e0 con 0x564642cdfdc0 2024-09-19T08:59:18.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.310+0000 7f59a43fb740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564642becce0 con 0x564642cdf4a0 2024-09-19T08:59:18.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.310+0000 7f59a43fb740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x564642c412a0 con 0x564642cea680 2024-09-19T08:59:18.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.311+0000 7f599b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564642cdfdc0 0x564642cea140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:18.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.311+0000 7f599b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564642cdfdc0 0x564642cea140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33224/0 (socket says 172.21.15.92:33224) 2024-09-19T08:59:18.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.311+0000 7f599b7fe640 1 -- 172.21.15.92:0/2747239603 learned_addr learned my addr 172.21.15.92:0/2747239603 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:18.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.311+0000 7f5992ffd640 1 --2- 172.21.15.92:0/2747239603 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564642cea680 0x564642ceca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:18.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.311+0000 7f5992ffd640 1 --2- 172.21.15.92:0/2747239603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564642cdf4a0 0x564642cdf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:18.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.311+0000 7f599b7fe640 1 -- 172.21.15.92:0/2747239603 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564642cea680 msgr2=0x564642ceca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:18.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.311+0000 7f599b7fe640 1 --2- 172.21.15.92:0/2747239603 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564642cea680 0x564642ceca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:18.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.311+0000 7f599b7fe640 1 -- 172.21.15.92:0/2747239603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564642cdf4a0 msgr2=0x564642cdf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:18.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.311+0000 7f599b7fe640 1 --2- 172.21.15.92:0/2747239603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564642cdf4a0 0x564642cdf880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:18.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.311+0000 7f599b7fe640 1 -- 172.21.15.92:0/2747239603 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564642bd1440 con 0x564642cdfdc0 2024-09-19T08:59:18.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.311+0000 7f5992ffd640 1 --2- 172.21.15.92:0/2747239603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564642cdf4a0 0x564642cdf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:59:18.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.311+0000 7f59997fa640 1 --2- 172.21.15.92:0/2251068979 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f59880a3260 0x7f59880a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:18.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.311+0000 7f599b7fe640 1 --2- 172.21.15.92:0/2747239603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564642cdfdc0 0x564642cea140 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f598c005f00 tx=0x7f598c030aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82e473c0bd4748f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:18.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.311+0000 7f5992ffd640 1 --2- 172.21.15.92:0/2251068979 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f59880a3260 0x7f59880a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:18.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.312+0000 7f5991ffb640 1 -- 172.21.15.92:0/2747239603 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f598c041030 con 0x564642cdfdc0 2024-09-19T08:59:18.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.312+0000 7f5991ffb640 1 -- 172.21.15.92:0/2747239603 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f598c030d00 con 0x564642cdfdc0 2024-09-19T08:59:18.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.312+0000 7f5991ffb640 1 -- 172.21.15.92:0/2747239603 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f598c036040 con 0x564642cdfdc0 2024-09-19T08:59:18.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.312+0000 7f59997fa640 1 -- 172.21.15.92:0/2251068979 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f59940cf960 con 0x7f599c113940 2024-09-19T08:59:18.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.313+0000 7f59a43fb740 1 -- 172.21.15.92:0/2747239603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564642cdfdc0 msgr2=0x564642cea140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:18.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.313+0000 7f59a43fb740 1 --2- 172.21.15.92:0/2747239603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564642cdfdc0 0x564642cea140 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f598c005f00 tx=0x7f598c030aa0 comp rx=0 tx=0).stop 2024-09-19T08:59:18.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.313+0000 7f59a43fb740 1 -- 172.21.15.92:0/2747239603 shutdown_connections 2024-09-19T08:59:18.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.313+0000 7f59a43fb740 1 --2- 172.21.15.92:0/2747239603 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564642cea680 0x564642ceca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:18.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.313+0000 7f59a43fb740 1 --2- 172.21.15.92:0/2747239603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564642cdfdc0 0x564642cea140 secure :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f598c005f00 tx=0x7f598c030aa0 comp rx=0 tx=0).stop 2024-09-19T08:59:18.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.313+0000 7f59a43fb740 1 --2- 172.21.15.92:0/2747239603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564642cdf4a0 0x564642cdf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:18.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.313+0000 7f59a43fb740 1 -- 172.21.15.92:0/2747239603 >> 172.21.15.92:0/2747239603 conn(0x564642cdba30 msgr2=0x564642cdbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:18.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.313+0000 7f5992ffd640 1 --2- 172.21.15.92:0/2251068979 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f59880a3260 0x7f59880a5720 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x564642cdcdb0 tx=0x7f5984013040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:18.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.314+0000 7f59a43fb740 1 -- 172.21.15.92:0/2747239603 shutdown_connections 2024-09-19T08:59:18.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.314+0000 7f59a43fb740 1 -- 172.21.15.92:0/2747239603 wait complete. 2024-09-19T08:59:18.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.315+0000 7f59a43fb740 1 -- start start 2024-09-19T08:59:18.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.315+0000 7f59a43fb740 1 Processor -- start 2024-09-19T08:59:18.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.316+0000 7f59a43fb740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564642cdf4a0 0x564642ce7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:18.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.316+0000 7f59a43fb740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564642cea680 0x564642ce79a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:18.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.316+0000 7f59a43fb740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564642ce7ee0 0x564642cf66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:18.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.316+0000 7f59a43fb740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564642ced250 con 0x564642ce7ee0 2024-09-19T08:59:18.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.316+0000 7f59a43fb740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564642c00050 con 0x564642cdf4a0 2024-09-19T08:59:18.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.316+0000 7f59a43fb740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x564642ced3d0 con 0x564642cea680 2024-09-19T08:59:18.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.316+0000 7f59a43fb740 10 client.0 _ll_register_callbacks cb 0x564642c40160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:18.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.316+0000 7f599bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564642ce7ee0 0x564642cf66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:18.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.316+0000 7f599bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564642ce7ee0 0x564642cf66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33230/0 (socket says 172.21.15.92:33230) 2024-09-19T08:59:18.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.316+0000 7f599bfff640 1 -- 172.21.15.92:0/3995521171 learned_addr learned my addr 172.21.15.92:0/3995521171 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:18.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.316+0000 7f599b7fe640 1 --2- 172.21.15.92:0/3995521171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564642cdf4a0 0x564642ce7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:18.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.316+0000 7f5992ffd640 1 --2- 172.21.15.92:0/3995521171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564642cea680 0x564642ce79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:18.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.317+0000 7f599bfff640 1 -- 172.21.15.92:0/3995521171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564642cea680 msgr2=0x564642ce79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:18.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.317+0000 7f599bfff640 1 --2- 172.21.15.92:0/3995521171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564642cea680 0x564642ce79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:18.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.317+0000 7f599bfff640 1 -- 172.21.15.92:0/3995521171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564642cdf4a0 msgr2=0x564642ce7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:18.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.317+0000 7f599bfff640 1 --2- 172.21.15.92:0/3995521171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564642cdf4a0 0x564642ce7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:18.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.317+0000 7f599bfff640 1 -- 172.21.15.92:0/3995521171 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646429b63c0 con 0x564642ce7ee0 2024-09-19T08:59:18.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.317+0000 7f599bfff640 1 --2- 172.21.15.92:0/3995521171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564642ce7ee0 0x564642cf66f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f59940a46c0 tx=0x7f599409b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b7925676f4517f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:18.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.317+0000 7f597affd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:59:18.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.317+0000 7f597affd640 1 -- 172.21.15.92:0/3995521171 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59940bc070 con 0x564642ce7ee0 2024-09-19T08:59:18.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.317+0000 7f597affd640 1 -- 172.21.15.92:0/3995521171 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f59940985f0 con 0x564642ce7ee0 2024-09-19T08:59:18.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.317+0000 7f59a43fb740 1 -- 172.21.15.92:0/3995521171 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f598c030d00 con 0x564642ce7ee0 2024-09-19T08:59:18.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.318+0000 7f597affd640 1 -- 172.21.15.92:0/3995521171 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f59940a9050 con 0x564642ce7ee0 2024-09-19T08:59:18.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.318+0000 7f59a43fb740 10 client.15969 fetch_fsmap learned FSMap version 19 2024-09-19T08:59:18.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.318+0000 7f59a43fb740 1 -- 172.21.15.92:0/3995521171 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x564642cf9250 con 0x564642ce7ee0 2024-09-19T08:59:18.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.318+0000 7f597affd640 1 -- 172.21.15.92:0/3995521171 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59940b6070 con 0x564642ce7ee0 2024-09-19T08:59:18.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.318+0000 7f597affd640 1 -- 172.21.15.92:0/3995521171 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f599409b3d0 con 0x564642ce7ee0 2024-09-19T08:59:18.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.318+0000 7f59a43fb740 10 client.15969 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:59:18.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.318+0000 7f59a43fb740 10 client.15969 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:59:18.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.318+0000 7f59a43fb740 20 client.15969 populate_metadata read hostname 'smithi092' 2024-09-19T08:59:18.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.318+0000 7f59a43fb740 1 --2- 172.21.15.92:0/3995521171 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564642cfa7b0 0x564642cfcc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:18.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.318+0000 7f59a43fb740 4 client.15969 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:59:18.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.318+0000 7f59a43fb740 1 -- 172.21.15.92:0/3995521171 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f598c030d00 con 0x564642cfa7b0 2024-09-19T08:59:18.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.318+0000 7f599b7fe640 1 --2- 172.21.15.92:0/3995521171 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564642cfa7b0 0x564642cfcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:18.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.319+0000 7f599b7fe640 1 --2- 172.21.15.92:0/3995521171 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564642cfa7b0 0x564642cfcc10 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5570fb538345bee0 server_cookie=8119ae5df5a88f7e in_seq=0 out_seq=0 2024-09-19T08:59:18.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.319+0000 7f597affd640 10 client.15969 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:18.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.320+0000 7f597affd640 1 -- 172.21.15.92:0/3995521171 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f598c030d00 con 0x564642cfa7b0 2024-09-19T08:59:18.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.320+0000 7f597affd640 10 client.15969 handle_command_reply: tid=0 2024-09-19T08:59:18.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.320+0000 7f59a43fb740 1 client.15969 shutdown 2024-09-19T08:59:18.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.320+0000 7f59a43fb740 1 -- 172.21.15.92:0/3995521171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564642ce7ee0 msgr2=0x564642cf66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:18.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.320+0000 7f59a43fb740 1 --2- 172.21.15.92:0/3995521171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564642ce7ee0 0x564642cf66f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f59940a46c0 tx=0x7f599409b8e0 comp rx=0 tx=0).stop 2024-09-19T08:59:18.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.321+0000 7f59a43fb740 1 -- 172.21.15.92:0/3995521171 shutdown_connections 2024-09-19T08:59:18.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.321+0000 7f59a43fb740 1 --2- 172.21.15.92:0/3995521171 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564642cfa7b0 0x564642cfcc10 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:18.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.321+0000 7f59a43fb740 1 --2- 172.21.15.92:0/3995521171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564642ce7ee0 0x564642cf66f0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:18.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.321+0000 7f59a43fb740 1 --2- 172.21.15.92:0/3995521171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564642cea680 0x564642ce79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:18.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.321+0000 7f59a43fb740 1 --2- 172.21.15.92:0/3995521171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564642cdf4a0 0x564642ce7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:18.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.321+0000 7f59a43fb740 1 -- 172.21.15.92:0/3995521171 >> 172.21.15.92:0/3995521171 conn(0x564642cdba30 msgr2=0x564642ce1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:18.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.321+0000 7f597affd640 0 client.15969 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:18.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.321+0000 7f59a43fb740 1 -- 172.21.15.92:0/3995521171 shutdown_connections 2024-09-19T08:59:18.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.321+0000 7f59a43fb740 1 -- 172.21.15.92:0/3995521171 wait complete. 2024-09-19T08:59:18.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.321+0000 7f59a43fb740 20 client.15969 trim_cache size 0 max 16384 2024-09-19T08:59:18.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.339+0000 7f59a43fb740 1 Processor -- start 2024-09-19T08:59:18.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.339+0000 7f59a43fb740 1 -- start start 2024-09-19T08:59:18.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.339+0000 7f59a43fb740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564642cdf4a0 0x564642ce2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:18.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.339+0000 7f59a43fb740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564642ce7ee0 0x564642cf64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:18.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.339+0000 7f59a43fb740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564642cea680 0x564642cf6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:18.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.339+0000 7f59a43fb740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f599c1ba000 con 0x564642cea680 2024-09-19T08:59:18.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.339+0000 7f59a43fb740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f599c1bc8a0 con 0x564642ce7ee0 2024-09-19T08:59:18.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.339+0000 7f59a43fb740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f599c1ba690 con 0x564642cdf4a0 2024-09-19T08:59:18.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.339+0000 7f599bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564642cea680 0x564642cf6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:18.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.339+0000 7f599bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564642cea680 0x564642cf6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33234/0 (socket says 172.21.15.92:33234) 2024-09-19T08:59:18.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.339+0000 7f599bfff640 1 -- 172.21.15.92:0/1937671342 learned_addr learned my addr 172.21.15.92:0/1937671342 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:18.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.340+0000 7f5992ffd640 1 --2- 172.21.15.92:0/1937671342 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564642ce7ee0 0x564642cf64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:18.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.340+0000 7f599b7fe640 1 --2- 172.21.15.92:0/1937671342 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564642cdf4a0 0x564642ce2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:18.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.340+0000 7f599bfff640 1 -- 172.21.15.92:0/1937671342 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564642cdf4a0 msgr2=0x564642ce2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:18.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.340+0000 7f599bfff640 1 --2- 172.21.15.92:0/1937671342 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564642cdf4a0 0x564642ce2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:18.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.340+0000 7f599bfff640 1 -- 172.21.15.92:0/1937671342 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564642ce7ee0 msgr2=0x564642cf64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:18.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.340+0000 7f599bfff640 1 --2- 172.21.15.92:0/1937671342 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564642ce7ee0 0x564642cf64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:18.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.340+0000 7f599bfff640 1 -- 172.21.15.92:0/1937671342 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564642cdc6c0 con 0x564642cea680 2024-09-19T08:59:18.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.340+0000 7f599b7fe640 1 --2- 172.21.15.92:0/1937671342 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564642cdf4a0 0x564642ce2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:59:18.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.340+0000 7f599bfff640 1 --2- 172.21.15.92:0/1937671342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564642cea680 0x564642cf6a20 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f5994098950 tx=0x7f5994098350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde695548314cb9e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:18.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.341+0000 7f59917fa640 1 -- 172.21.15.92:0/1937671342 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59940a0330 con 0x564642cea680 2024-09-19T08:59:18.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.341+0000 7f59917fa640 1 -- 172.21.15.92:0/1937671342 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59940b6070 con 0x564642cea680 2024-09-19T08:59:18.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.341+0000 7f59917fa640 1 -- 172.21.15.92:0/1937671342 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59940985f0 con 0x564642cea680 2024-09-19T08:59:18.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.342+0000 7f59a43fb740 1 -- 172.21.15.92:0/1937671342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564642cea680 msgr2=0x564642cf6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:18.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.342+0000 7f59a43fb740 1 --2- 172.21.15.92:0/1937671342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564642cea680 0x564642cf6a20 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f5994098950 tx=0x7f5994098350 comp rx=0 tx=0).stop 2024-09-19T08:59:18.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.342+0000 7f59a43fb740 1 -- 172.21.15.92:0/1937671342 shutdown_connections 2024-09-19T08:59:18.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.342+0000 7f59a43fb740 1 --2- 172.21.15.92:0/1937671342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564642cea680 0x564642cf6a20 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:18.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.342+0000 7f59a43fb740 1 --2- 172.21.15.92:0/1937671342 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564642ce7ee0 0x564642cf64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:18.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.342+0000 7f59a43fb740 1 --2- 172.21.15.92:0/1937671342 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564642cdf4a0 0x564642ce2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:18.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.342+0000 7f59a43fb740 1 -- 172.21.15.92:0/1937671342 >> 172.21.15.92:0/1937671342 conn(0x564642cdba30 msgr2=0x564642ce9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:18.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.342+0000 7f59a43fb740 1 -- 172.21.15.92:0/1937671342 shutdown_connections 2024-09-19T08:59:18.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.342+0000 7f59a43fb740 1 -- 172.21.15.92:0/1937671342 wait complete. 2024-09-19T08:59:18.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.343+0000 7f59a43fb740 1 -- start start 2024-09-19T08:59:18.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.343+0000 7f59a43fb740 1 Processor -- start 2024-09-19T08:59:18.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.344+0000 7f59a43fb740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564642cdf4a0 0x564642ceecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:18.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.344+0000 7f59a43fb740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564642ce7ee0 0x564642cef210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:18.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.344+0000 7f59a43fb740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564642cea680 0x564642d5e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:18.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.344+0000 7f59a43fb740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f599c1bad60 con 0x564642cea680 2024-09-19T08:59:18.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.344+0000 7f59a43fb740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f599c1bc1d0 con 0x564642ce7ee0 2024-09-19T08:59:18.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.344+0000 7f59a43fb740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f599c1bb430 con 0x564642cdf4a0 2024-09-19T08:59:18.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.344+0000 7f599bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564642cea680 0x564642d5e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:18.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.344+0000 7f59a43fb740 10 client.0 _ll_register_callbacks cb 0x7f5994009490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:18.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.344+0000 7f599bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564642cea680 0x564642d5e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33236/0 (socket says 172.21.15.92:33236) 2024-09-19T08:59:18.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.344+0000 7f599bfff640 1 -- 172.21.15.92:0/742841636 learned_addr learned my addr 172.21.15.92:0/742841636 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:18.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.344+0000 7f5992ffd640 1 --2- 172.21.15.92:0/742841636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564642ce7ee0 0x564642cef210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:18.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.344+0000 7f599b7fe640 1 --2- 172.21.15.92:0/742841636 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564642cdf4a0 0x564642ceecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:18.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.344+0000 7f599bfff640 1 -- 172.21.15.92:0/742841636 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564642cdf4a0 msgr2=0x564642ceecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:18.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.344+0000 7f599bfff640 1 --2- 172.21.15.92:0/742841636 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564642cdf4a0 0x564642ceecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:18.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.344+0000 7f599bfff640 1 -- 172.21.15.92:0/742841636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564642ce7ee0 msgr2=0x564642cef210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:18.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.344+0000 7f599bfff640 1 --2- 172.21.15.92:0/742841636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564642ce7ee0 0x564642cef210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:18.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.344+0000 7f599bfff640 1 -- 172.21.15.92:0/742841636 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564642d5eb30 con 0x564642cea680 2024-09-19T08:59:18.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.345+0000 7f599bfff640 1 --2- 172.21.15.92:0/742841636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564642cea680 0x564642d5e4f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f599409b770 tx=0x7f5994004700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee815c4e23a45f54 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:18.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.345+0000 7f597affd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:59:18.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.345+0000 7f597affd640 1 -- 172.21.15.92:0/742841636 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59940a4bf0 con 0x564642cea680 2024-09-19T08:59:18.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.345+0000 7f597affd640 1 -- 172.21.15.92:0/742841636 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f59940985f0 con 0x564642cea680 2024-09-19T08:59:18.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.345+0000 7f59a43fb740 1 -- 172.21.15.92:0/742841636 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59940b6070 con 0x564642cea680 2024-09-19T08:59:18.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.345+0000 7f597affd640 1 -- 172.21.15.92:0/742841636 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f59940a0330 con 0x564642cea680 2024-09-19T08:59:18.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.346+0000 7f59a43fb740 10 client.15975 fetch_fsmap learned FSMap version 19 2024-09-19T08:59:18.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.346+0000 7f59a43fb740 1 -- 172.21.15.92:0/742841636 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x564642d65e60 con 0x564642cea680 2024-09-19T08:59:18.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.346+0000 7f597affd640 1 -- 172.21.15.92:0/742841636 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f599409b3d0 con 0x564642cea680 2024-09-19T08:59:18.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.346+0000 7f597affd640 1 -- 172.21.15.92:0/742841636 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f59940a15e0 con 0x564642cea680 2024-09-19T08:59:18.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.346+0000 7f59a43fb740 10 client.15975 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:59:18.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.346+0000 7f59a43fb740 10 client.15975 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:59:18.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.346+0000 7f59a43fb740 20 client.15975 populate_metadata read hostname 'smithi092' 2024-09-19T08:59:18.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.346+0000 7f59a43fb740 1 --2- 172.21.15.92:0/742841636 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564642d662e0 0x564642d686d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:18.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.346+0000 7f59a43fb740 4 client.15975 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:59:18.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.346+0000 7f59a43fb740 1 -- 172.21.15.92:0/742841636 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f59940b6070 con 0x564642d662e0 2024-09-19T08:59:18.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.347+0000 7f599b7fe640 1 --2- 172.21.15.92:0/742841636 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564642d662e0 0x564642d686d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:18.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.348+0000 7f599b7fe640 1 --2- 172.21.15.92:0/742841636 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564642d662e0 0x564642d686d0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=105054e152a84012 server_cookie=18d1800e6116cacd in_seq=0 out_seq=0 2024-09-19T08:59:18.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.348+0000 7f597affd640 10 client.15975 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:18.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.348+0000 7f597affd640 1 -- 172.21.15.92:0/742841636 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7f59940b6070 con 0x564642d662e0 2024-09-19T08:59:18.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.348+0000 7f597affd640 10 client.15975 handle_command_reply: tid=0 2024-09-19T08:59:18.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.348+0000 7f59a43fb740 1 client.15975 shutdown 2024-09-19T08:59:18.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.349+0000 7f59a43fb740 1 -- 172.21.15.92:0/742841636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564642cea680 msgr2=0x564642d5e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:18.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.349+0000 7f59a43fb740 1 --2- 172.21.15.92:0/742841636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564642cea680 0x564642d5e4f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f599409b770 tx=0x7f5994004700 comp rx=0 tx=0).stop 2024-09-19T08:59:18.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.349+0000 7f59a43fb740 1 -- 172.21.15.92:0/742841636 shutdown_connections 2024-09-19T08:59:18.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.349+0000 7f59a43fb740 1 --2- 172.21.15.92:0/742841636 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564642d662e0 0x564642d686d0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:18.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.349+0000 7f597affd640 0 client.15975 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:18.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.349+0000 7f59a43fb740 1 --2- 172.21.15.92:0/742841636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564642cea680 0x564642d5e4f0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:18.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.349+0000 7f59a43fb740 1 --2- 172.21.15.92:0/742841636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564642ce7ee0 0x564642cef210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:18.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.349+0000 7f59a43fb740 1 --2- 172.21.15.92:0/742841636 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564642cdf4a0 0x564642ceecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:18.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.349+0000 7f59a43fb740 1 -- 172.21.15.92:0/742841636 >> 172.21.15.92:0/742841636 conn(0x564642cdba30 msgr2=0x564642ce28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:18.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.349+0000 7f59a43fb740 1 -- 172.21.15.92:0/742841636 shutdown_connections 2024-09-19T08:59:18.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.349+0000 7f59a43fb740 1 -- 172.21.15.92:0/742841636 wait complete. 2024-09-19T08:59:18.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.350+0000 7f59a43fb740 20 client.15975 trim_cache size 0 max 16384 2024-09-19T08:59:18.354 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T08:59:18.354 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T08:59:18.354 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": { 2024-09-19T08:59:18.354 INFO:teuthology.orchestra.run.smithi092.stdout: "9cc697d8-09f9-4265-8e5c-475c166f90e5": { 2024-09-19T08:59:18.355 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-19T08:59:18.355 INFO:teuthology.orchestra.run.smithi092.stdout: "tag": "9cc697d8-09f9-4265-8e5c-475c166f90e5", 2024-09-19T08:59:18.355 INFO:teuthology.orchestra.run.smithi092.stdout: "options": "recursive,force" 2024-09-19T08:59:18.355 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:59:18.355 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:59:18.355 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T08:59:18.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.350+0000 7f59a2022640 1 -- 172.21.15.92:0/2251068979 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f59880a3260 msgr2=0x7f59880a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:18.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.350+0000 7f59a2022640 1 --2- 172.21.15.92:0/2251068979 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f59880a3260 0x7f59880a5720 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x564642cdcdb0 tx=0x7f5984013040 comp rx=0 tx=0).stop 2024-09-19T08:59:18.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.350+0000 7f59a2022640 1 -- 172.21.15.92:0/2251068979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f599c113940 msgr2=0x7f599c10f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:18.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.350+0000 7f59a2022640 1 --2- 172.21.15.92:0/2251068979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f599c113940 0x7f599c10f470 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f599400e970 tx=0x7f599400ed70 comp rx=0 tx=0).stop 2024-09-19T08:59:18.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.350+0000 7f59a2022640 1 -- 172.21.15.92:0/2251068979 shutdown_connections 2024-09-19T08:59:18.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.350+0000 7f59a2022640 1 --2- 172.21.15.92:0/2251068979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f599c113940 0x7f599c10f470 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:18.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.350+0000 7f59a2022640 1 --2- 172.21.15.92:0/2251068979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f599c10ae80 0x7f599c10ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:18.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.350+0000 7f59a2022640 1 --2- 172.21.15.92:0/2251068979 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f59880a3260 0x7f59880a5720 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:18.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.350+0000 7f59a2022640 1 --2- 172.21.15.92:0/2251068979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f599c10a560 0x7f599c112e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:18.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.350+0000 7f59a2022640 1 -- 172.21.15.92:0/2251068979 >> 172.21.15.92:0/2251068979 conn(0x7f599c06e140 msgr2=0x7f599c0709a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:18.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.350+0000 7f59a2022640 1 -- 172.21.15.92:0/2251068979 shutdown_connections 2024-09-19T08:59:18.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:18.351+0000 7f59a2022640 1 -- 172.21.15.92:0/2251068979 wait complete. 2024-09-19T08:59:18.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:18 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T08:59:18.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:18 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T08:59:18.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:18 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T08:59:19.498 INFO:tasks.cephfs.filesystem:scrub status for tag:9cc697d8-09f9-4265-8e5c-475c166f90e5 - {'path': '/', 'tag': '9cc697d8-09f9-4265-8e5c-475c166f90e5', 'options': 'recursive,force'} 2024-09-19T08:59:19.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:19 smithi092 ceph-mon[31407]: pgmap v415: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 15 MiB/s wr, 956 op/s 2024-09-19T08:59:19.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:19 smithi092 ceph-mon[31407]: scrub summary: idle 2024-09-19T08:59:19.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:19 smithi167 ceph-mon[35359]: pgmap v415: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 15 MiB/s wr, 956 op/s 2024-09-19T08:59:19.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:19 smithi167 ceph-mon[35359]: scrub summary: idle 2024-09-19T08:59:19.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:19 smithi190 ceph-mon[35358]: pgmap v415: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 15 MiB/s wr, 956 op/s 2024-09-19T08:59:19.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:19 smithi190 ceph-mon[35358]: scrub summary: idle 2024-09-19T08:59:20.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 155.0 s, 3719.0 tps, lat 26.940 ms stddev 34.199 2024-09-19T08:59:21.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:21 smithi092 ceph-mon[31407]: pgmap v416: 97 pgs: 97 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 26 MiB/s wr, 1.02k op/s 2024-09-19T08:59:21.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:21 smithi167 ceph-mon[35359]: pgmap v416: 97 pgs: 97 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 26 MiB/s wr, 1.02k op/s 2024-09-19T08:59:21.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:21 smithi190 ceph-mon[35358]: pgmap v416: 97 pgs: 97 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 26 MiB/s wr, 1.02k op/s 2024-09-19T08:59:23.172 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.172+0000 7f16fb082640 1 -- 172.21.15.92:0/2505487144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16f4102460 msgr2=0x7f16f4104850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:23.172 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.172+0000 7f16fb082640 1 --2- 172.21.15.92:0/2505487144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16f4102460 0x7f16f4104850 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f16f0009860 tx=0x7f16f002a340 comp rx=0 tx=0).stop 2024-09-19T08:59:23.172 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.172+0000 7f16fb082640 1 -- 172.21.15.92:0/2505487144 shutdown_connections 2024-09-19T08:59:23.172 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.172+0000 7f16fb082640 1 --2- 172.21.15.92:0/2505487144 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16f41076c0 0x7f16f4109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:23.172 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.172+0000 7f16fb082640 1 --2- 172.21.15.92:0/2505487144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16f4104d90 0x7f16f4107180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:23.173 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.172+0000 7f16fb082640 1 --2- 172.21.15.92:0/2505487144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16f4102460 0x7f16f4104850 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:23.173 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.172+0000 7f16fb082640 1 -- 172.21.15.92:0/2505487144 >> 172.21.15.92:0/2505487144 conn(0x7f16f40fbfa0 msgr2=0x7f16f40fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:23.173 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.172+0000 7f16fb082640 1 -- 172.21.15.92:0/2505487144 shutdown_connections 2024-09-19T08:59:23.173 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.172+0000 7f16fb082640 1 -- 172.21.15.92:0/2505487144 wait complete. 2024-09-19T08:59:23.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.173+0000 7f16fb082640 1 Processor -- start 2024-09-19T08:59:23.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.173+0000 7f16fb082640 1 -- start start 2024-09-19T08:59:23.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.173+0000 7f16fb082640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16f4102460 0x7f16f4110df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:23.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.173+0000 7f16fb082640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16f4104d90 0x7f16f4111330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:23.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.173+0000 7f16fb082640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16f41076c0 0x7f16f4116390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:23.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.173+0000 7f16fb082640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f16f410b3c0 con 0x7f16f4102460 2024-09-19T08:59:23.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.173+0000 7f16fb082640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f16f410b240 con 0x7f16f4104d90 2024-09-19T08:59:23.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.173+0000 7f16fb082640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f16f410b540 con 0x7f16f41076c0 2024-09-19T08:59:23.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.174+0000 7f16fa080640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16f4102460 0x7f16f4110df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:23.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.174+0000 7f16fa080640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16f4102460 0x7f16f4110df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41112/0 (socket says 172.21.15.92:41112) 2024-09-19T08:59:23.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.174+0000 7f16fa080640 1 -- 172.21.15.92:0/400340287 learned_addr learned my addr 172.21.15.92:0/400340287 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:23.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.174+0000 7f16f987f640 1 --2- 172.21.15.92:0/400340287 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16f4104d90 0x7f16f4111330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:23.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.175+0000 7f16f987f640 1 -- 172.21.15.92:0/400340287 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16f41076c0 msgr2=0x7f16f4116390 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T08:59:23.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.175+0000 7f16f987f640 1 --2- 172.21.15.92:0/400340287 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16f41076c0 0x7f16f4116390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:23.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.175+0000 7f16f987f640 1 -- 172.21.15.92:0/400340287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16f4102460 msgr2=0x7f16f4110df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:23.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.175+0000 7f16f987f640 1 --2- 172.21.15.92:0/400340287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16f4102460 0x7f16f4110df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:23.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.175+0000 7f16f987f640 1 -- 172.21.15.92:0/400340287 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f4116a00 con 0x7f16f4104d90 2024-09-19T08:59:23.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.176+0000 7f16f987f640 1 --2- 172.21.15.92:0/400340287 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16f4104d90 0x7f16f4111330 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f16e400d6a0 tx=0x7f16e400db60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:23.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.176+0000 7f16eb7fe640 1 -- 172.21.15.92:0/400340287 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e4017070 con 0x7f16f4104d90 2024-09-19T08:59:23.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.176+0000 7f16eb7fe640 1 -- 172.21.15.92:0/400340287 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16e4010460 con 0x7f16f4104d90 2024-09-19T08:59:23.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.176+0000 7f16eb7fe640 1 -- 172.21.15.92:0/400340287 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e400f620 con 0x7f16f4104d90 2024-09-19T08:59:23.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.176+0000 7f16fb082640 1 -- 172.21.15.92:0/400340287 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16f4116cf0 con 0x7f16f4104d90 2024-09-19T08:59:23.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.176+0000 7f16fb082640 1 -- 172.21.15.92:0/400340287 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16f41171f0 con 0x7f16f4104d90 2024-09-19T08:59:23.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.181+0000 7f16ff084740 1 Processor -- start 2024-09-19T08:59:23.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.182+0000 7f16ff084740 1 -- start start 2024-09-19T08:59:23.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.182+0000 7f16ff084740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ff1144b70 0x558ff1144f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:23.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.182+0000 7f16ff084740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ff11454b0 0x558ff1149f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:23.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.182+0000 7f16ff084740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff114a540 0x558ff114ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:23.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.182+0000 7f16ff084740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558ff10a82f0 con 0x558ff114a540 2024-09-19T08:59:23.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.182+0000 7f16ff084740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558ff1050270 con 0x558ff11454b0 2024-09-19T08:59:23.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.182+0000 7f16ff084740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x558ff10a42b0 con 0x558ff1144b70 2024-09-19T08:59:23.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.183+0000 7f16fa080640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ff11454b0 0x558ff1149f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:23.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.183+0000 7f16fa080640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ff11454b0 0x558ff1149f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:47984/0 (socket says 172.21.15.92:47984) 2024-09-19T08:59:23.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.183+0000 7f16fa080640 1 -- 172.21.15.92:0/2614077643 learned_addr learned my addr 172.21.15.92:0/2614077643 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:23.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.183+0000 7f16fa881640 1 --2- 172.21.15.92:0/2614077643 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ff1144b70 0x558ff1144f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:23.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.183+0000 7f16fa080640 1 -- 172.21.15.92:0/2614077643 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ff1144b70 msgr2=0x558ff1144f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:23.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.183+0000 7f16fa080640 1 --2- 172.21.15.92:0/2614077643 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ff1144b70 0x558ff1144f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:23.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.183+0000 7f16fa080640 1 -- 172.21.15.92:0/2614077643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff114a540 msgr2=0x558ff114ca00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T08:59:23.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.183+0000 7f16fa080640 1 --2- 172.21.15.92:0/2614077643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff114a540 0x558ff114ca00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:23.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.183+0000 7f16fa080640 1 -- 172.21.15.92:0/2614077643 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ff104f340 con 0x558ff11454b0 2024-09-19T08:59:23.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.183+0000 7f16eb7fe640 1 -- 172.21.15.92:0/400340287 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f16e401a070 con 0x7f16f4104d90 2024-09-19T08:59:23.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.184+0000 7f16fa080640 1 --2- 172.21.15.92:0/2614077643 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ff11454b0 0x558ff1149f70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f16f0009510 tx=0x7f16f0009540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f132b9122d617ebf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:23.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.184+0000 7f16e8bfe640 1 -- 172.21.15.92:0/2614077643 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f0037040 con 0x558ff11454b0 2024-09-19T08:59:23.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.184+0000 7f16e8bfe640 1 -- 172.21.15.92:0/2614077643 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16f0004040 con 0x558ff11454b0 2024-09-19T08:59:23.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.184+0000 7f16e8bfe640 1 -- 172.21.15.92:0/2614077643 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f00046c0 con 0x558ff11454b0 2024-09-19T08:59:23.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.184+0000 7f16eb7fe640 1 --2- 172.21.15.92:0/400340287 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f16e00a3390 0x7f16e00a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:23.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.184+0000 7f16eb7fe640 1 -- 172.21.15.92:0/400340287 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f16e40cf170 con 0x7f16f4104d90 2024-09-19T08:59:23.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.184+0000 7f16fa881640 1 --2- 172.21.15.92:0/400340287 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f16e00a3390 0x7f16e00a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:23.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.185+0000 7f16ff084740 1 -- 172.21.15.92:0/2614077643 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ff11454b0 msgr2=0x558ff1149f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:23.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.185+0000 7f16ff084740 1 --2- 172.21.15.92:0/2614077643 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ff11454b0 0x558ff1149f70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f16f0009510 tx=0x7f16f0009540 comp rx=0 tx=0).stop 2024-09-19T08:59:23.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.185+0000 7f16ff084740 1 -- 172.21.15.92:0/2614077643 shutdown_connections 2024-09-19T08:59:23.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.185+0000 7f16ff084740 1 --2- 172.21.15.92:0/2614077643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff114a540 0x558ff114ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:23.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.185+0000 7f16ff084740 1 --2- 172.21.15.92:0/2614077643 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ff11454b0 0x558ff1149f70 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:23.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.185+0000 7f16ff084740 1 --2- 172.21.15.92:0/2614077643 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ff1144b70 0x558ff1144f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:23.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.185+0000 7f16ff084740 1 -- 172.21.15.92:0/2614077643 >> 172.21.15.92:0/2614077643 conn(0x558ff11401e0 msgr2=0x558ff11405e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:23.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.185+0000 7f16fa881640 1 --2- 172.21.15.92:0/400340287 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f16e00a3390 0x7f16e00a5850 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f16f406a980 tx=0x7f16ec009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:23.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.186+0000 7f16ff084740 1 -- 172.21.15.92:0/2614077643 shutdown_connections 2024-09-19T08:59:23.187 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.186+0000 7f16ff084740 1 -- 172.21.15.92:0/2614077643 wait complete. 2024-09-19T08:59:23.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.186+0000 7f16ff084740 1 -- start start 2024-09-19T08:59:23.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.187+0000 7f16ff084740 1 Processor -- start 2024-09-19T08:59:23.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.187+0000 7f16ff084740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff1144b70 0x558ff114ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:23.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.187+0000 7f16ff084740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ff11454b0 0x558ff114f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:23.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.187+0000 7f16ff084740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ff114a540 0x558ff11562c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:23.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.187+0000 7f16ff084740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558ff114d4b0 con 0x558ff1144b70 2024-09-19T08:59:23.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.187+0000 7f16fa080640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff1144b70 0x558ff114ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:23.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.188+0000 7f16fa080640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff1144b70 0x558ff114ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41120/0 (socket says 172.21.15.92:41120) 2024-09-19T08:59:23.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.188+0000 7f16fa080640 1 -- 172.21.15.92:0/746826562 learned_addr learned my addr 172.21.15.92:0/746826562 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:23.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.188+0000 7f16fa881640 1 --2- 172.21.15.92:0/746826562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ff114a540 0x558ff11562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:23.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.188+0000 7f16ff084740 1 -- 172.21.15.92:0/746826562 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558ff1031290 con 0x558ff114a540 2024-09-19T08:59:23.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.188+0000 7f16ff084740 1 -- 172.21.15.92:0/746826562 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x558ff114d630 con 0x558ff11454b0 2024-09-19T08:59:23.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.188+0000 7f16f987f640 1 --2- 172.21.15.92:0/746826562 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ff11454b0 0x558ff114f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:23.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.188+0000 7f16ff084740 10 client.0 _ll_register_callbacks cb 0x558ff1062140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:23.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.188+0000 7f16fa881640 1 -- 172.21.15.92:0/746826562 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ff11454b0 msgr2=0x558ff114f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:23.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.188+0000 7f16fa881640 1 --2- 172.21.15.92:0/746826562 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ff11454b0 0x558ff114f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:23.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.188+0000 7f16fa881640 1 -- 172.21.15.92:0/746826562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff1144b70 msgr2=0x558ff114ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:23.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.188+0000 7f16fa881640 1 --2- 172.21.15.92:0/746826562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff1144b70 0x558ff114ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:23.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.188+0000 7f16fa881640 1 -- 172.21.15.92:0/746826562 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ff0dbb210 con 0x558ff114a540 2024-09-19T08:59:23.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.188+0000 7f16f987f640 1 --2- 172.21.15.92:0/746826562 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ff11454b0 0x558ff114f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:23.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.189+0000 7f16fa881640 1 --2- 172.21.15.92:0/746826562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ff114a540 0x558ff11562c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f16ec0116c0 tx=0x7f16ec004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d71720f902a8f13 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:23.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.189+0000 7f16ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T08:59:23.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.189+0000 7f16ddffb640 1 -- 172.21.15.92:0/746826562 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ec022070 con 0x558ff114a540 2024-09-19T08:59:23.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.189+0000 7f16ff084740 1 -- 172.21.15.92:0/746826562 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16f0004040 con 0x558ff114a540 2024-09-19T08:59:23.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.189+0000 7f16ddffb640 1 -- 172.21.15.92:0/746826562 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f16ec01e860 con 0x558ff114a540 2024-09-19T08:59:23.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.189+0000 7f16ddffb640 1 -- 172.21.15.92:0/746826562 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f16ec02e050 con 0x558ff114a540 2024-09-19T08:59:23.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.190+0000 7f16ff084740 10 client.25427 fetch_fsmap learned FSMap version 19 2024-09-19T08:59:23.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.190+0000 7f16ff084740 1 -- 172.21.15.92:0/746826562 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x558ff0e87620 con 0x558ff114a540 2024-09-19T08:59:23.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.190+0000 7f16ddffb640 1 -- 172.21.15.92:0/746826562 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16f0004040 con 0x558ff114a540 2024-09-19T08:59:23.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.190+0000 7f16ddffb640 1 -- 172.21.15.92:0/746826562 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f16ec0263b0 con 0x558ff114a540 2024-09-19T08:59:23.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.190+0000 7f16ff084740 10 client.25427 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:59:23.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.190+0000 7f16ff084740 10 client.25427 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T08:59:23.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.190+0000 7f16ff084740 20 client.25427 populate_metadata read hostname 'smithi092' 2024-09-19T08:59:23.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.190+0000 7f16ff084740 1 --2- 172.21.15.92:0/746826562 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558ff115aa10 0x558ff115ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:23.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.190+0000 7f16ff084740 4 client.25427 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:59:23.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.190+0000 7f16ff084740 1 -- 172.21.15.92:0/746826562 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ff10b5a20 con 0x558ff115aa10 2024-09-19T08:59:23.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.191+0000 7f16fa080640 1 --2- 172.21.15.92:0/746826562 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558ff115aa10 0x558ff115ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:23.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.192+0000 7f16fa080640 1 --2- 172.21.15.92:0/746826562 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558ff115aa10 0x558ff115ce40 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe9ba075bc1c9b69 server_cookie=49195dc89c540709 in_seq=0 out_seq=0 2024-09-19T08:59:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.192+0000 7f16ddffb640 10 client.25427 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:23.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.195+0000 7f16ddffb640 1 -- 172.21.15.92:0/746826562 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558ff10b5a20 con 0x558ff115aa10 2024-09-19T08:59:23.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.195+0000 7f16ddffb640 10 client.25427 handle_command_reply: tid=0 2024-09-19T08:59:23.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.195+0000 7f16ff084740 1 client.25427 shutdown 2024-09-19T08:59:23.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.202+0000 7f16ff084740 1 -- 172.21.15.92:0/746826562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ff114a540 msgr2=0x558ff11562c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:23.202 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.202+0000 7f16ff084740 1 --2- 172.21.15.92:0/746826562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ff114a540 0x558ff11562c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f16ec0116c0 tx=0x7f16ec004a40 comp rx=0 tx=0).stop 2024-09-19T08:59:23.203 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.202+0000 7f16ff084740 1 -- 172.21.15.92:0/746826562 shutdown_connections 2024-09-19T08:59:23.203 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.202+0000 7f16ff084740 1 --2- 172.21.15.92:0/746826562 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558ff115aa10 0x558ff115ce40 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:23.203 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.203+0000 7f16ff084740 1 --2- 172.21.15.92:0/746826562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ff114a540 0x558ff11562c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:23.203 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.203+0000 7f16ff084740 1 --2- 172.21.15.92:0/746826562 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ff11454b0 0x558ff114f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:23.203 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.203+0000 7f16ff084740 1 --2- 172.21.15.92:0/746826562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff1144b70 0x558ff114ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:23.203 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.203+0000 7f16ff084740 1 -- 172.21.15.92:0/746826562 >> 172.21.15.92:0/746826562 conn(0x558ff11401e0 msgr2=0x558ff11419f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:23.203 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.203+0000 7f16ddffb640 0 client.25427 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:23.204 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.204+0000 7f16ff084740 1 -- 172.21.15.92:0/746826562 shutdown_connections 2024-09-19T08:59:23.204 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.204+0000 7f16ff084740 1 -- 172.21.15.92:0/746826562 wait complete. 2024-09-19T08:59:23.204 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.204+0000 7f16ff084740 20 client.25427 trim_cache size 0 max 16384 2024-09-19T08:59:23.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.234+0000 7f16ff084740 1 Processor -- start 2024-09-19T08:59:23.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.234+0000 7f16ff084740 1 -- start start 2024-09-19T08:59:23.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.234+0000 7f16ff084740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff1144b70 0x558ff11405c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:23.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.235+0000 7f16ff084740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ff11454b0 0x558ff1156280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:23.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.235+0000 7f16ff084740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ff114a540 0x558ff1140b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:23.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.235+0000 7f16fa080640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff1144b70 0x558ff11405c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.235+0000 7f16fa080640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff1144b70 0x558ff11405c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41136/0 (socket says 172.21.15.92:41136) 2024-09-19T08:59:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.235+0000 7f16fa080640 1 -- 172.21.15.92:0/913420261 learned_addr learned my addr 172.21.15.92:0/913420261 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.235+0000 7f16ff084740 1 -- 172.21.15.92:0/913420261 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f16f41b5d20 con 0x558ff1144b70 2024-09-19T08:59:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.235+0000 7f16fa881640 1 --2- 172.21.15.92:0/913420261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ff114a540 0x558ff1140b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.235+0000 7f16f987f640 1 --2- 172.21.15.92:0/913420261 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ff11454b0 0x558ff1156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.235+0000 7f16ff084740 1 -- 172.21.15.92:0/913420261 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f16f41b85c0 con 0x558ff114a540 2024-09-19T08:59:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.235+0000 7f16ff084740 1 -- 172.21.15.92:0/913420261 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f16f41b63b0 con 0x558ff11454b0 2024-09-19T08:59:23.237 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.236+0000 7f16fa881640 1 -- 172.21.15.92:0/913420261 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ff11454b0 msgr2=0x558ff1156280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:23.237 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.236+0000 7f16fa881640 1 --2- 172.21.15.92:0/913420261 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ff11454b0 0x558ff1156280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:23.237 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.236+0000 7f16fa881640 1 -- 172.21.15.92:0/913420261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff1144b70 msgr2=0x558ff11405c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:23.237 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.236+0000 7f16fa881640 1 --2- 172.21.15.92:0/913420261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff1144b70 0x558ff11405c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:23.237 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.236+0000 7f16fa881640 1 -- 172.21.15.92:0/913420261 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ff1140000 con 0x558ff114a540 2024-09-19T08:59:23.237 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.236+0000 7f16fa881640 1 --2- 172.21.15.92:0/913420261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ff114a540 0x558ff1140b00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f16ec009420 tx=0x7f16ec011650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94a644080ce22655 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:23.237 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.237+0000 7f16dffff640 1 -- 172.21.15.92:0/913420261 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ec036030 con 0x558ff114a540 2024-09-19T08:59:23.237 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.237+0000 7f16dffff640 1 -- 172.21.15.92:0/913420261 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16ec0263b0 con 0x558ff114a540 2024-09-19T08:59:23.237 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.237+0000 7f16dffff640 1 -- 172.21.15.92:0/913420261 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ec022050 con 0x558ff114a540 2024-09-19T08:59:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.238+0000 7f16ff084740 1 -- 172.21.15.92:0/913420261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ff114a540 msgr2=0x558ff1140b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.238+0000 7f16ff084740 1 --2- 172.21.15.92:0/913420261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ff114a540 0x558ff1140b00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f16ec009420 tx=0x7f16ec011650 comp rx=0 tx=0).stop 2024-09-19T08:59:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.238+0000 7f16ff084740 1 -- 172.21.15.92:0/913420261 shutdown_connections 2024-09-19T08:59:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.238+0000 7f16ff084740 1 --2- 172.21.15.92:0/913420261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ff114a540 0x558ff1140b00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.238+0000 7f16ff084740 1 --2- 172.21.15.92:0/913420261 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ff11454b0 0x558ff1156280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.238+0000 7f16ff084740 1 --2- 172.21.15.92:0/913420261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff1144b70 0x558ff11405c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.239+0000 7f16ff084740 1 -- 172.21.15.92:0/913420261 >> 172.21.15.92:0/913420261 conn(0x558ff11401e0 msgr2=0x558ff114ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.239+0000 7f16ff084740 1 -- 172.21.15.92:0/913420261 shutdown_connections 2024-09-19T08:59:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.239+0000 7f16ff084740 1 -- 172.21.15.92:0/913420261 wait complete. 2024-09-19T08:59:23.240 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.240+0000 7f16ff084740 1 -- start start 2024-09-19T08:59:23.240 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.240+0000 7f16ff084740 1 Processor -- start 2024-09-19T08:59:23.241 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.241+0000 7f16ff084740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ff1144b70 0x558ff1152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:23.241 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.241+0000 7f16ff084740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ff11454b0 0x558ff1153300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:23.241 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.241+0000 7f16ff084740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff114a540 0x558ff11d4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:23.241 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.241+0000 7f16ff084740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f16f41b6a80 con 0x558ff114a540 2024-09-19T08:59:23.241 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.241+0000 7f16ff084740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f16f41b7ef0 con 0x558ff1144b70 2024-09-19T08:59:23.241 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.241+0000 7f16ff084740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f16f41b7150 con 0x558ff11454b0 2024-09-19T08:59:23.241 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.241+0000 7f16ff084740 10 client.0 _ll_register_callbacks cb 0x7f16ec015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:23.241 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.241+0000 7f16fa080640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ff1144b70 0x558ff1152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:23.241 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.241+0000 7f16fa080640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ff1144b70 0x558ff1152dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:48002/0 (socket says 172.21.15.92:48002) 2024-09-19T08:59:23.242 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.241+0000 7f16fa080640 1 -- 172.21.15.92:0/2745120866 learned_addr learned my addr 172.21.15.92:0/2745120866 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:23.242 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.241+0000 7f16fa881640 1 --2- 172.21.15.92:0/2745120866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff114a540 0x558ff11d4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:23.242 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.241+0000 7f16f987f640 1 --2- 172.21.15.92:0/2745120866 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ff11454b0 0x558ff1153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.242+0000 7f16fa080640 1 -- 172.21.15.92:0/2745120866 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ff11454b0 msgr2=0x558ff1153300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.242+0000 7f16fa080640 1 --2- 172.21.15.92:0/2745120866 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ff11454b0 0x558ff1153300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.242+0000 7f16fa080640 1 -- 172.21.15.92:0/2745120866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff114a540 msgr2=0x558ff11d4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.242+0000 7f16fa080640 1 --2- 172.21.15.92:0/2745120866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff114a540 0x558ff11d4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.242+0000 7f16fa080640 1 -- 172.21.15.92:0/2745120866 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ff11563f0 con 0x558ff1144b70 2024-09-19T08:59:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.242+0000 7f16fa080640 1 --2- 172.21.15.92:0/2745120866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ff1144b70 0x558ff1152dc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f16f002a930 tx=0x7f16f002a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=620c985ac99c067a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.242+0000 7f16ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T08:59:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.242+0000 7f16ddffb640 1 -- 172.21.15.92:0/2745120866 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f0037040 con 0x558ff1144b70 2024-09-19T08:59:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.243+0000 7f16ff084740 1 -- 172.21.15.92:0/2745120866 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16ec0263b0 con 0x558ff1144b70 2024-09-19T08:59:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.243+0000 7f16ddffb640 1 -- 172.21.15.92:0/2745120866 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f16f0030850 con 0x558ff1144b70 2024-09-19T08:59:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.243+0000 7f16ddffb640 1 -- 172.21.15.92:0/2745120866 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f16f0004040 con 0x558ff1144b70 2024-09-19T08:59:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.243+0000 7f16ff084740 10 client.25433 fetch_fsmap learned FSMap version 19 2024-09-19T08:59:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.243+0000 7f16ff084740 1 -- 172.21.15.92:0/2745120866 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x558ff11d5c20 con 0x558ff1144b70 2024-09-19T08:59:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.244+0000 7f16ddffb640 1 -- 172.21.15.92:0/2745120866 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16ec0263b0 con 0x558ff1144b70 2024-09-19T08:59:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.244+0000 7f16ddffb640 1 -- 172.21.15.92:0/2745120866 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f16f003d480 con 0x558ff1144b70 2024-09-19T08:59:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.244+0000 7f16ff084740 10 client.25433 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:59:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.244+0000 7f16ff084740 10 client.25433 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T08:59:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.244+0000 7f16ff084740 20 client.25433 populate_metadata read hostname 'smithi092' 2024-09-19T08:59:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.244+0000 7f16ff084740 1 --2- 172.21.15.92:0/2745120866 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558ff11d61f0 0x558ff11d8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.244+0000 7f16ff084740 4 client.25433 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:59:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.244+0000 7f16ff084740 1 -- 172.21.15.92:0/2745120866 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558ff10afd70 con 0x558ff11d61f0 2024-09-19T08:59:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.245+0000 7f16f987f640 1 --2- 172.21.15.92:0/2745120866 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558ff11d61f0 0x558ff11d8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.246+0000 7f16ddffb640 10 client.25433 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.246+0000 7f16f987f640 1 --2- 172.21.15.92:0/2745120866 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558ff11d61f0 0x558ff11d8610 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b628a2e573427df server_cookie=f481f9f1307ca140 in_seq=0 out_seq=0 2024-09-19T08:59:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.265+0000 7f16ddffb640 1 -- 172.21.15.92:0/2745120866 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558ff10afd70 con 0x558ff11d61f0 2024-09-19T08:59:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.265+0000 7f16ddffb640 10 client.25433 handle_command_reply: tid=0 2024-09-19T08:59:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.265+0000 7f16ff084740 1 client.25433 shutdown 2024-09-19T08:59:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.265+0000 7f16ff084740 1 -- 172.21.15.92:0/2745120866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ff1144b70 msgr2=0x558ff1152dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.265+0000 7f16ff084740 1 --2- 172.21.15.92:0/2745120866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ff1144b70 0x558ff1152dc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f16f002a930 tx=0x7f16f002a340 comp rx=0 tx=0).stop 2024-09-19T08:59:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.265+0000 7f16ff084740 1 -- 172.21.15.92:0/2745120866 shutdown_connections 2024-09-19T08:59:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.265+0000 7f16ff084740 1 --2- 172.21.15.92:0/2745120866 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558ff11d61f0 0x558ff11d8610 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.265+0000 7f16ff084740 1 --2- 172.21.15.92:0/2745120866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ff114a540 0x558ff11d4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.265+0000 7f16ddffb640 0 client.25433 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.265+0000 7f16ff084740 1 --2- 172.21.15.92:0/2745120866 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ff11454b0 0x558ff1153300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:23.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.265+0000 7f16ff084740 1 --2- 172.21.15.92:0/2745120866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558ff1144b70 0x558ff1152dc0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:23.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.265+0000 7f16ff084740 1 -- 172.21.15.92:0/2745120866 >> 172.21.15.92:0/2745120866 conn(0x558ff11401e0 msgr2=0x558ff113ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:23.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.265+0000 7f16ff084740 1 -- 172.21.15.92:0/2745120866 shutdown_connections 2024-09-19T08:59:23.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.266+0000 7f16ff084740 1 -- 172.21.15.92:0/2745120866 wait complete. 2024-09-19T08:59:23.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.266+0000 7f16ff084740 20 client.25433 trim_cache size 0 max 16384 2024-09-19T08:59:23.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T08:59:23.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T08:59:23.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T08:59:23.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T08:59:23.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.266+0000 7f16fb082640 1 -- 172.21.15.92:0/400340287 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f16e00a3390 msgr2=0x7f16e00a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:23.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.266+0000 7f16fb082640 1 --2- 172.21.15.92:0/400340287 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f16e00a3390 0x7f16e00a5850 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f16f406a980 tx=0x7f16ec009500 comp rx=0 tx=0).stop 2024-09-19T08:59:23.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.266+0000 7f16fb082640 1 -- 172.21.15.92:0/400340287 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16f4104d90 msgr2=0x7f16f4111330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:23.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.266+0000 7f16fb082640 1 --2- 172.21.15.92:0/400340287 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16f4104d90 0x7f16f4111330 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f16e400d6a0 tx=0x7f16e400db60 comp rx=0 tx=0).stop 2024-09-19T08:59:23.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.266+0000 7f16fb082640 1 -- 172.21.15.92:0/400340287 shutdown_connections 2024-09-19T08:59:23.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.266+0000 7f16fb082640 1 --2- 172.21.15.92:0/400340287 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16f41076c0 0x7f16f4116390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:23.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.266+0000 7f16fb082640 1 --2- 172.21.15.92:0/400340287 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16f4104d90 0x7f16f4111330 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:23.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.266+0000 7f16fb082640 1 --2- 172.21.15.92:0/400340287 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f16e00a3390 0x7f16e00a5850 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:23.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.266+0000 7f16fb082640 1 --2- 172.21.15.92:0/400340287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16f4102460 0x7f16f4110df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:23.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.266+0000 7f16fb082640 1 -- 172.21.15.92:0/400340287 >> 172.21.15.92:0/400340287 conn(0x7f16f40fbfa0 msgr2=0x7f16f4102ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:23.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.268+0000 7f16fb082640 1 -- 172.21.15.92:0/400340287 shutdown_connections 2024-09-19T08:59:23.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:23.268+0000 7f16fb082640 1 -- 172.21.15.92:0/400340287 wait complete. 2024-09-19T08:59:23.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:23 smithi092 ceph-mon[31407]: pgmap v417: 97 pgs: 97 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 28 MiB/s wr, 1.01k op/s 2024-09-19T08:59:23.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:23 smithi167 ceph-mon[35359]: pgmap v417: 97 pgs: 97 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 28 MiB/s wr, 1.01k op/s 2024-09-19T08:59:23.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:23 smithi190 ceph-mon[35358]: pgmap v417: 97 pgs: 97 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 28 MiB/s wr, 1.01k op/s 2024-09-19T08:59:25.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:25 smithi092 ceph-mon[31407]: pgmap v418: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 42 MiB/s wr, 1.12k op/s 2024-09-19T08:59:25.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 160.0 s, 4629.8 tps, lat 21.562 ms stddev 25.344 2024-09-19T08:59:25.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:25 smithi167 ceph-mon[35359]: pgmap v418: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 42 MiB/s wr, 1.12k op/s 2024-09-19T08:59:25.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:25 smithi190 ceph-mon[35358]: pgmap v418: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 42 MiB/s wr, 1.12k op/s 2024-09-19T08:59:27.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:27 smithi092 ceph-mon[31407]: pgmap v419: 97 pgs: 97 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 47 MiB/s wr, 1.05k op/s 2024-09-19T08:59:27.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:27 smithi167 ceph-mon[35359]: pgmap v419: 97 pgs: 97 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 47 MiB/s wr, 1.05k op/s 2024-09-19T08:59:27.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:27 smithi190 ceph-mon[35358]: pgmap v419: 97 pgs: 97 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 47 MiB/s wr, 1.05k op/s 2024-09-19T08:59:29.370 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 16.6 2024-09-19T08:59:29.371 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:59:29.747 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:59:29.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:29 smithi092 ceph-mon[31407]: pgmap v420: 97 pgs: 97 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 53 MiB/s wr, 1.08k op/s 2024-09-19T08:59:29.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:29 smithi167 ceph-mon[35359]: pgmap v420: 97 pgs: 97 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 53 MiB/s wr, 1.08k op/s 2024-09-19T08:59:29.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:29 smithi190 ceph-mon[35358]: pgmap v420: 97 pgs: 97 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 53 MiB/s wr, 1.08k op/s 2024-09-19T08:59:30.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.278+0000 7fb0b7a0f640 1 -- 172.21.15.92:0/3394899943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0b0100b40 msgr2=0x7fb0b0100f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:30.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.278+0000 7fb0b7a0f640 1 --2- 172.21.15.92:0/3394899943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0b0100b40 0x7fb0b0100f20 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac009900 tx=0x7fb0ac02a470 comp rx=0 tx=0).stop 2024-09-19T08:59:30.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.278+0000 7fb0b7a0f640 1 -- 172.21.15.92:0/3394899943 shutdown_connections 2024-09-19T08:59:30.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.278+0000 7fb0b7a0f640 1 --2- 172.21.15.92:0/3394899943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0b0105f50 0x7fb0b01063e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:30.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.278+0000 7fb0b7a0f640 1 --2- 172.21.15.92:0/3394899943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0b0101460 0x7fb0b0105930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:30.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.278+0000 7fb0b7a0f640 1 --2- 172.21.15.92:0/3394899943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0b0100b40 0x7fb0b0100f20 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:30.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.278+0000 7fb0b7a0f640 1 -- 172.21.15.92:0/3394899943 >> 172.21.15.92:0/3394899943 conn(0x7fb0b00fc7d0 msgr2=0x7fb0b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:30.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.278+0000 7fb0b7a0f640 1 -- 172.21.15.92:0/3394899943 shutdown_connections 2024-09-19T08:59:30.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.278+0000 7fb0b7a0f640 1 -- 172.21.15.92:0/3394899943 wait complete. 2024-09-19T08:59:30.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.279+0000 7fb0b7a0f640 1 Processor -- start 2024-09-19T08:59:30.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.279+0000 7fb0b7a0f640 1 -- start start 2024-09-19T08:59:30.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.281+0000 7fb0b7a0f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0b0100b40 0x7fb0b01a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:30.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.281+0000 7fb0b7a0f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0b0101460 0x7fb0b01a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:30.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.281+0000 7fb0b7a0f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0b0105f50 0x7fb0b019e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:30.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.281+0000 7fb0b7a0f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b01185b0 con 0x7fb0b0101460 2024-09-19T08:59:30.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.281+0000 7fb0b7a0f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b0118430 con 0x7fb0b0100b40 2024-09-19T08:59:30.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.281+0000 7fb0b7a0f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b0118730 con 0x7fb0b0105f50 2024-09-19T08:59:30.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.281+0000 7fb0b57ab640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0b0100b40 0x7fb0b01a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:30.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.281+0000 7fb0b57ab640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0b0100b40 0x7fb0b01a46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:48020/0 (socket says 172.21.15.92:48020) 2024-09-19T08:59:30.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.281+0000 7fb0b57ab640 1 -- 172.21.15.92:0/4163447662 learned_addr learned my addr 172.21.15.92:0/4163447662 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:30.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.281+0000 7fb0b4faa640 1 --2- 172.21.15.92:0/4163447662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0b0101460 0x7fb0b01a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:30.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.281+0000 7fb0b5fac640 1 --2- 172.21.15.92:0/4163447662 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0b0105f50 0x7fb0b019e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:30.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.281+0000 7fb0b57ab640 1 -- 172.21.15.92:0/4163447662 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0b0105f50 msgr2=0x7fb0b019e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:30.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.281+0000 7fb0b57ab640 1 --2- 172.21.15.92:0/4163447662 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0b0105f50 0x7fb0b019e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:30.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.281+0000 7fb0b57ab640 1 -- 172.21.15.92:0/4163447662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0b0101460 msgr2=0x7fb0b01a4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:30.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.281+0000 7fb0b57ab640 1 --2- 172.21.15.92:0/4163447662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0b0101460 0x7fb0b01a4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:30.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.281+0000 7fb0b57ab640 1 -- 172.21.15.92:0/4163447662 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0b019ef90 con 0x7fb0b0100b40 2024-09-19T08:59:30.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.282+0000 7fb0b57ab640 1 --2- 172.21.15.92:0/4163447662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0b0100b40 0x7fb0b01a46a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac02a9e0 tx=0x7fb0ac003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:30.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.282+0000 7fb0a67fc640 1 -- 172.21.15.92:0/4163447662 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac03f070 con 0x7fb0b0100b40 2024-09-19T08:59:30.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.282+0000 7fb0a67fc640 1 -- 172.21.15.92:0/4163447662 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0ac031c90 con 0x7fb0b0100b40 2024-09-19T08:59:30.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.282+0000 7fb0b7a0f640 1 -- 172.21.15.92:0/4163447662 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0b019f220 con 0x7fb0b0100b40 2024-09-19T08:59:30.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.282+0000 7fb0b7a0f640 1 -- 172.21.15.92:0/4163447662 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0b01ab570 con 0x7fb0b0100b40 2024-09-19T08:59:30.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.283+0000 7fb0a67fc640 1 -- 172.21.15.92:0/4163447662 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac035030 con 0x7fb0b0100b40 2024-09-19T08:59:30.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.283+0000 7fb0b7a0f640 1 -- 172.21.15.92:0/4163447662 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb094005290 con 0x7fb0b0100b40 2024-09-19T08:59:30.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.285+0000 7fb0a67fc640 1 -- 172.21.15.92:0/4163447662 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb0ac042070 con 0x7fb0b0100b40 2024-09-19T08:59:30.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.286+0000 7fb0a67fc640 1 --2- 172.21.15.92:0/4163447662 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb09c0a3240 0x7fb09c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:30.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.286+0000 7fb0a67fc640 1 -- 172.21.15.92:0/4163447662 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb0ac0efff0 con 0x7fb0b0100b40 2024-09-19T08:59:30.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.287+0000 7fb0b4faa640 1 --2- 172.21.15.92:0/4163447662 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb09c0a3240 0x7fb09c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:30.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.287+0000 7fb0b4faa640 1 --2- 172.21.15.92:0/4163447662 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb09c0a3240 0x7fb09c0a5700 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0106640 tx=0x7fb0a0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:30.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.291+0000 7fb0a67fc640 1 -- 172.21.15.92:0/4163447662 <== mon.2 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb0ac0bccd0 con 0x7fb0b0100b40 2024-09-19T08:59:30.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.680+0000 7fb0b7a0f640 1 -- 172.21.15.92:0/4163447662 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb094005580 con 0x7fb0b0100b40 2024-09-19T08:59:30.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.681+0000 7fb0a67fc640 1 -- 172.21.15.92:0/4163447662 <== mon.2 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7fb0ac0bc5d0 con 0x7fb0b0100b40 2024-09-19T08:59:30.681 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:59:30.681 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T08:59:30.682 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T08:59:30.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.685+0000 7fb0b7a0f640 1 -- 172.21.15.92:0/4163447662 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb09c0a3240 msgr2=0x7fb09c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:30.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.685+0000 7fb0b7a0f640 1 --2- 172.21.15.92:0/4163447662 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb09c0a3240 0x7fb09c0a5700 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0106640 tx=0x7fb0a0005f90 comp rx=0 tx=0).stop 2024-09-19T08:59:30.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.685+0000 7fb0b7a0f640 1 -- 172.21.15.92:0/4163447662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0b0100b40 msgr2=0x7fb0b01a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:30.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.685+0000 7fb0b7a0f640 1 --2- 172.21.15.92:0/4163447662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0b0100b40 0x7fb0b01a46a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac02a9e0 tx=0x7fb0ac003b90 comp rx=0 tx=0).stop 2024-09-19T08:59:30.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.685+0000 7fb0b7a0f640 1 -- 172.21.15.92:0/4163447662 shutdown_connections 2024-09-19T08:59:30.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.685+0000 7fb0b7a0f640 1 --2- 172.21.15.92:0/4163447662 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0b0105f50 0x7fb0b019e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:30.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.685+0000 7fb0b7a0f640 1 --2- 172.21.15.92:0/4163447662 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb09c0a3240 0x7fb09c0a5700 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:30.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.685+0000 7fb0b7a0f640 1 --2- 172.21.15.92:0/4163447662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0b0101460 0x7fb0b01a4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:30.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.685+0000 7fb0b7a0f640 1 --2- 172.21.15.92:0/4163447662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0b0100b40 0x7fb0b01a46a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:30.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.685+0000 7fb0b7a0f640 1 -- 172.21.15.92:0/4163447662 >> 172.21.15.92:0/4163447662 conn(0x7fb0b00fc7d0 msgr2=0x7fb0b0103900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:30.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.686+0000 7fb0b7a0f640 1 -- 172.21.15.92:0/4163447662 shutdown_connections 2024-09-19T08:59:30.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:30.686+0000 7fb0b7a0f640 1 -- 172.21.15.92:0/4163447662 wait complete. 2024-09-19T08:59:30.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 165.0 s, 4582.8 tps, lat 21.852 ms stddev 26.826 2024-09-19T08:59:31.500 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 136.6 --await-for 45.0' 2024-09-19T08:59:31.500 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 136.6 --await-for 45.0 2024-09-19T08:59:31.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:31 smithi092 ceph-mon[31407]: pgmap v421: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 56 MiB/s wr, 1.07k op/s 2024-09-19T08:59:31.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:31 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/4163447662' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:59:31.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:31 smithi167 ceph-mon[35359]: pgmap v421: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 56 MiB/s wr, 1.07k op/s 2024-09-19T08:59:31.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:31 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/4163447662' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:59:31.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:31 smithi190 ceph-mon[35358]: pgmap v421: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 56 MiB/s wr, 1.07k op/s 2024-09-19T08:59:31.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:31 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/4163447662' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:59:31.897 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:59:32.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.512+0000 7f86f359e640 1 -- 172.21.15.92:0/2338754727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86ec077040 msgr2=0x7f86ec1124f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:32.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.512+0000 7f86f359e640 1 --2- 172.21.15.92:0/2338754727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86ec077040 0x7f86ec1124f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f86dc009900 tx=0x7f86dc02a410 comp rx=0 tx=0).stop 2024-09-19T08:59:32.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.513+0000 7f86f359e640 1 -- 172.21.15.92:0/2338754727 shutdown_connections 2024-09-19T08:59:32.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.513+0000 7f86f359e640 1 --2- 172.21.15.92:0/2338754727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86ec112a30 0x7f86ec114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:32.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.513+0000 7f86f359e640 1 --2- 172.21.15.92:0/2338754727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86ec077040 0x7f86ec1124f0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:32.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.513+0000 7f86f359e640 1 --2- 172.21.15.92:0/2338754727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86ec076720 0x7f86ec076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:32.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.513+0000 7f86f359e640 1 -- 172.21.15.92:0/2338754727 >> 172.21.15.92:0/2338754727 conn(0x7f86ec0ffa70 msgr2=0x7f86ec101e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:32.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.513+0000 7f86f359e640 1 -- 172.21.15.92:0/2338754727 shutdown_connections 2024-09-19T08:59:32.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.514+0000 7f86f359e640 1 -- 172.21.15.92:0/2338754727 wait complete. 2024-09-19T08:59:32.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.514+0000 7f86f359e640 1 Processor -- start 2024-09-19T08:59:32.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.514+0000 7f86f359e640 1 -- start start 2024-09-19T08:59:32.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.515+0000 7f86f359e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86ec076720 0x7f86ec1a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:32.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.515+0000 7f86f359e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86ec077040 0x7f86ec1a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:32.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.515+0000 7f86f359e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86ec112a30 0x7f86ec19e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:32.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.515+0000 7f86f359e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f86ec1185a0 con 0x7f86ec076720 2024-09-19T08:59:32.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.515+0000 7f86f359e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f86ec118420 con 0x7f86ec077040 2024-09-19T08:59:32.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.515+0000 7f86f359e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f86ec118720 con 0x7f86ec112a30 2024-09-19T08:59:32.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.515+0000 7f86f133a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86ec076720 0x7f86ec1a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:32.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.515+0000 7f86f133a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86ec076720 0x7f86ec1a46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54628/0 (socket says 172.21.15.92:54628) 2024-09-19T08:59:32.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.515+0000 7f86f133a640 1 -- 172.21.15.92:0/1494459950 learned_addr learned my addr 172.21.15.92:0/1494459950 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:32.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.515+0000 7f86f0b39640 1 --2- 172.21.15.92:0/1494459950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86ec077040 0x7f86ec1a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:32.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.515+0000 7f86f1b3b640 1 --2- 172.21.15.92:0/1494459950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86ec112a30 0x7f86ec19e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:32.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.515+0000 7f86f133a640 1 -- 172.21.15.92:0/1494459950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86ec112a30 msgr2=0x7f86ec19e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:32.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.515+0000 7f86f133a640 1 --2- 172.21.15.92:0/1494459950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86ec112a30 0x7f86ec19e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:32.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.515+0000 7f86f133a640 1 -- 172.21.15.92:0/1494459950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86ec077040 msgr2=0x7f86ec1a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:32.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.515+0000 7f86f133a640 1 --2- 172.21.15.92:0/1494459950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86ec077040 0x7f86ec1a4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:32.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.515+0000 7f86f133a640 1 -- 172.21.15.92:0/1494459950 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86ec19efc0 con 0x7f86ec076720 2024-09-19T08:59:32.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.515+0000 7f86f133a640 1 --2- 172.21.15.92:0/1494459950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86ec076720 0x7f86ec1a46d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f86e800e9f0 tx=0x7f86e800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:32.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.516+0000 7f86e27fc640 1 -- 172.21.15.92:0/1494459950 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e800cd80 con 0x7f86ec076720 2024-09-19T08:59:32.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.516+0000 7f86e27fc640 1 -- 172.21.15.92:0/1494459950 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86e8010910 con 0x7f86ec076720 2024-09-19T08:59:32.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.516+0000 7f86e27fc640 1 -- 172.21.15.92:0/1494459950 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e8018990 con 0x7f86ec076720 2024-09-19T08:59:32.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.516+0000 7f86f359e640 1 -- 172.21.15.92:0/1494459950 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86ec19f2b0 con 0x7f86ec076720 2024-09-19T08:59:32.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.516+0000 7f86f359e640 1 -- 172.21.15.92:0/1494459950 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86ec1ab5a0 con 0x7f86ec076720 2024-09-19T08:59:32.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.519+0000 7f86e27fc640 1 -- 172.21.15.92:0/1494459950 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f86e8010ac0 con 0x7f86ec076720 2024-09-19T08:59:32.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.520+0000 7f86e27fc640 1 --2- 172.21.15.92:0/1494459950 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f86d80a3390 0x7f86d80a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:32.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.520+0000 7f86f5977740 1 Processor -- start 2024-09-19T08:59:32.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.521+0000 7f86f5977740 1 -- start start 2024-09-19T08:59:32.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.521+0000 7f86f0b39640 1 --2- 172.21.15.92:0/1494459950 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f86d80a3390 0x7f86d80a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:32.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.521+0000 7f86e27fc640 1 -- 172.21.15.92:0/1494459950 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f86e80cfb50 con 0x7f86ec076720 2024-09-19T08:59:32.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.521+0000 7f86f5977740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604184e0760 0x5604184e0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:32.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.521+0000 7f86f5977740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604184e1080 0x5604184eb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:32.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.521+0000 7f86f5977740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604184eb940 0x5604184edd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:32.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.521+0000 7f86f5977740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5604184462a0 con 0x5604184e0760 2024-09-19T08:59:32.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.521+0000 7f86f5977740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5604183edb10 con 0x5604184e1080 2024-09-19T08:59:32.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.521+0000 7f86f5977740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x560418442260 con 0x5604184eb940 2024-09-19T08:59:32.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.521+0000 7f86f133a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604184e0760 0x5604184e0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:32.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.521+0000 7f86f133a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604184e0760 0x5604184e0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54638/0 (socket says 172.21.15.92:54638) 2024-09-19T08:59:32.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.521+0000 7f86f133a640 1 -- 172.21.15.92:0/3825662815 learned_addr learned my addr 172.21.15.92:0/3825662815 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:32.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.521+0000 7f86f1b3b640 1 --2- 172.21.15.92:0/3825662815 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604184eb940 0x5604184edd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:32.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.521+0000 7f86f0b39640 1 --2- 172.21.15.92:0/3825662815 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604184e1080 0x5604184eb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:32.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.521+0000 7f86f1b3b640 1 -- 172.21.15.92:0/3825662815 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604184e1080 msgr2=0x5604184eb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:32.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.521+0000 7f86f1b3b640 1 --2- 172.21.15.92:0/3825662815 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604184e1080 0x5604184eb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:32.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.521+0000 7f86f1b3b640 1 -- 172.21.15.92:0/3825662815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604184e0760 msgr2=0x5604184e0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:32.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.521+0000 7f86f1b3b640 1 --2- 172.21.15.92:0/3825662815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604184e0760 0x5604184e0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:32.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.521+0000 7f86f1b3b640 1 -- 172.21.15.92:0/3825662815 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604181b7b90 con 0x5604184eb940 2024-09-19T08:59:32.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.521+0000 7f86f133a640 1 --2- 172.21.15.92:0/3825662815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604184e0760 0x5604184e0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:32.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.521+0000 7f86f0b39640 1 --2- 172.21.15.92:0/3825662815 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604184e1080 0x5604184eb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:59:32.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.522+0000 7f86f0b39640 1 --2- 172.21.15.92:0/1494459950 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f86d80a3390 0x7f86d80a5850 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f86dc009230 tx=0x7f86dc005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:32.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.522+0000 7f86f1b3b640 1 --2- 172.21.15.92:0/3825662815 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604184eb940 0x5604184edd30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f86ec07aa10 tx=0x7f86e4011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=421464c08974eb86 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:32.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.522+0000 7f86d77fe640 1 -- 172.21.15.92:0/3825662815 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e4004d20 con 0x5604184eb940 2024-09-19T08:59:32.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.522+0000 7f86d77fe640 1 -- 172.21.15.92:0/3825662815 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86e4004050 con 0x5604184eb940 2024-09-19T08:59:32.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.522+0000 7f86d77fe640 1 -- 172.21.15.92:0/3825662815 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e4005280 con 0x5604184eb940 2024-09-19T08:59:32.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.523+0000 7f86f5977740 1 -- 172.21.15.92:0/3825662815 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604184eb940 msgr2=0x5604184edd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:32.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.523+0000 7f86f5977740 1 --2- 172.21.15.92:0/3825662815 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604184eb940 0x5604184edd30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f86ec07aa10 tx=0x7f86e4011810 comp rx=0 tx=0).stop 2024-09-19T08:59:32.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.524+0000 7f86f5977740 1 -- 172.21.15.92:0/3825662815 shutdown_connections 2024-09-19T08:59:32.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.524+0000 7f86f5977740 1 --2- 172.21.15.92:0/3825662815 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604184eb940 0x5604184edd30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:32.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.524+0000 7f86f5977740 1 --2- 172.21.15.92:0/3825662815 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604184e1080 0x5604184eb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:32.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.524+0000 7f86f5977740 1 --2- 172.21.15.92:0/3825662815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604184e0760 0x5604184e0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:32.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.524+0000 7f86f5977740 1 -- 172.21.15.92:0/3825662815 >> 172.21.15.92:0/3825662815 conn(0x5604184dccf0 msgr2=0x5604184dd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:32.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.524+0000 7f86f5977740 1 -- 172.21.15.92:0/3825662815 shutdown_connections 2024-09-19T08:59:32.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.524+0000 7f86f5977740 1 -- 172.21.15.92:0/3825662815 wait complete. 2024-09-19T08:59:32.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.525+0000 7f86f5977740 1 -- start start 2024-09-19T08:59:32.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.525+0000 7f86f5977740 1 Processor -- start 2024-09-19T08:59:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.525+0000 7f86f5977740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604184e0760 0x5604184e87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.526+0000 7f86f5977740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604184e1080 0x5604184e8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.526+0000 7f86f5977740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604184eb940 0x5604184e9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.526+0000 7f86f133a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604184e0760 0x5604184e87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.526+0000 7f86f133a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604184e0760 0x5604184e87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:45694/0 (socket says 172.21.15.92:45694) 2024-09-19T08:59:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.526+0000 7f86f5977740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5604184ee510 con 0x5604184eb940 2024-09-19T08:59:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.526+0000 7f86f5977740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5604183ce6e0 con 0x5604184e0760 2024-09-19T08:59:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.526+0000 7f86f5977740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5604184ee690 con 0x5604184e1080 2024-09-19T08:59:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.526+0000 7f86f5977740 10 client.0 _ll_register_callbacks cb 0x5604183f2a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.527+0000 7f86f133a640 1 -- 172.21.15.92:0/1440568171 learned_addr learned my addr 172.21.15.92:0/1440568171 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.527+0000 7f86f1b3b640 1 --2- 172.21.15.92:0/1440568171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604184eb940 0x5604184e9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:32.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.528+0000 7f86f1b3b640 1 -- 172.21.15.92:0/1440568171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604184e1080 msgr2=0x5604184e8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:32.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.528+0000 7f86f1b3b640 1 --2- 172.21.15.92:0/1440568171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604184e1080 0x5604184e8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:32.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.528+0000 7f86f1b3b640 1 -- 172.21.15.92:0/1440568171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604184e0760 msgr2=0x5604184e87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:32.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.528+0000 7f86f1b3b640 1 --2- 172.21.15.92:0/1440568171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604184e0760 0x5604184e87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:32.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.528+0000 7f86f1b3b640 1 -- 172.21.15.92:0/1440568171 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604184f7980 con 0x5604184eb940 2024-09-19T08:59:32.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.528+0000 7f86f1b3b640 1 --2- 172.21.15.92:0/1440568171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604184eb940 0x5604184e9230 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x5604184de070 tx=0x7f86e4009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e592fa8012afa69f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:32.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.528+0000 7f86d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:59:32.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.529+0000 7f86d4ff9640 1 -- 172.21.15.92:0/1440568171 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e401d050 con 0x5604184eb940 2024-09-19T08:59:32.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.529+0000 7f86d4ff9640 1 -- 172.21.15.92:0/1440568171 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f86e4004fe0 con 0x5604184eb940 2024-09-19T08:59:32.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.529+0000 7f86f5977740 1 -- 172.21.15.92:0/1440568171 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86e4004050 con 0x5604184eb940 2024-09-19T08:59:32.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.529+0000 7f86d4ff9640 1 -- 172.21.15.92:0/1440568171 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f86e4005220 con 0x5604184eb940 2024-09-19T08:59:32.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.529+0000 7f86f5977740 10 client.16008 fetch_fsmap learned FSMap version 19 2024-09-19T08:59:32.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.529+0000 7f86f5977740 1 -- 172.21.15.92:0/1440568171 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5604184fa280 con 0x5604184eb940 2024-09-19T08:59:32.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.530+0000 7f86d4ff9640 1 -- 172.21.15.92:0/1440568171 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86e4004050 con 0x5604184eb940 2024-09-19T08:59:32.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.530+0000 7f86d4ff9640 1 -- 172.21.15.92:0/1440568171 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f86e40249f0 con 0x5604184eb940 2024-09-19T08:59:32.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.531+0000 7f86f5977740 10 client.16008 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:59:32.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.531+0000 7f86f5977740 10 client.16008 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T08:59:32.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.531+0000 7f86f5977740 20 client.16008 populate_metadata read hostname 'smithi092' 2024-09-19T08:59:32.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.531+0000 7f86f5977740 1 --2- 172.21.15.92:0/1440568171 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5604184fb630 0x5604184fda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:32.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.531+0000 7f86f5977740 4 client.16008 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:59:32.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.531+0000 7f86f5977740 1 -- 172.21.15.92:0/1440568171 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604184539d0 con 0x5604184fb630 2024-09-19T08:59:32.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.531+0000 7f86f133a640 1 --2- 172.21.15.92:0/1440568171 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5604184fb630 0x5604184fda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:32.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.532+0000 7f86d4ff9640 10 client.16008 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:32.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.532+0000 7f86f133a640 1 --2- 172.21.15.92:0/1440568171 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5604184fb630 0x5604184fda20 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3371709deba4072 server_cookie=9e702dd533e3ee47 in_seq=0 out_seq=0 2024-09-19T08:59:32.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.532+0000 7f86d4ff9640 1 -- 172.21.15.92:0/1440568171 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5604184539d0 con 0x5604184fb630 2024-09-19T08:59:32.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.532+0000 7f86d4ff9640 10 client.16008 handle_command_reply: tid=0 2024-09-19T08:59:32.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.532+0000 7f86f5977740 1 client.16008 shutdown 2024-09-19T08:59:32.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.533+0000 7f86f5977740 1 -- 172.21.15.92:0/1440568171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604184eb940 msgr2=0x5604184e9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:32.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.533+0000 7f86f5977740 1 --2- 172.21.15.92:0/1440568171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604184eb940 0x5604184e9230 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x5604184de070 tx=0x7f86e4009ca0 comp rx=0 tx=0).stop 2024-09-19T08:59:32.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.533+0000 7f86f5977740 1 -- 172.21.15.92:0/1440568171 shutdown_connections 2024-09-19T08:59:32.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.533+0000 7f86f5977740 1 --2- 172.21.15.92:0/1440568171 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5604184fb630 0x5604184fda20 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:32.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.533+0000 7f86f5977740 1 --2- 172.21.15.92:0/1440568171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604184eb940 0x5604184e9230 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:32.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.533+0000 7f86f5977740 1 --2- 172.21.15.92:0/1440568171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604184e1080 0x5604184e8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:32.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.533+0000 7f86f5977740 1 --2- 172.21.15.92:0/1440568171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604184e0760 0x5604184e87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:32.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.533+0000 7f86f5977740 1 -- 172.21.15.92:0/1440568171 >> 172.21.15.92:0/1440568171 conn(0x5604184dccf0 msgr2=0x5604184e2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:32.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.533+0000 7f86d4ff9640 0 client.16008 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:32.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.533+0000 7f86f5977740 1 -- 172.21.15.92:0/1440568171 shutdown_connections 2024-09-19T08:59:32.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.533+0000 7f86f5977740 1 -- 172.21.15.92:0/1440568171 wait complete. 2024-09-19T08:59:32.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.534+0000 7f86f5977740 20 client.16008 trim_cache size 0 max 16384 2024-09-19T08:59:32.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.558+0000 7f86f5977740 1 Processor -- start 2024-09-19T08:59:32.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.558+0000 7f86f5977740 1 -- start start 2024-09-19T08:59:32.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.559+0000 7f86f5977740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604184e0760 0x5604184fd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:32.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.559+0000 7f86f5977740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604184e1080 0x5604184e76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:32.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.559+0000 7f86f5977740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604184eb940 0x5604185031b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:32.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.559+0000 7f86f133a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604184e0760 0x5604184fd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:32.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.559+0000 7f86f5977740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f86ec1b1c90 con 0x5604184e0760 2024-09-19T08:59:32.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.559+0000 7f86f5977740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f86ec1b4530 con 0x5604184e1080 2024-09-19T08:59:32.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.559+0000 7f86f5977740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f86ec1b2320 con 0x5604184eb940 2024-09-19T08:59:32.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.559+0000 7f86f133a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604184e0760 0x5604184fd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54664/0 (socket says 172.21.15.92:54664) 2024-09-19T08:59:32.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.559+0000 7f86f133a640 1 -- 172.21.15.92:0/1033270518 learned_addr learned my addr 172.21.15.92:0/1033270518 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:32.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.559+0000 7f86f1b3b640 1 --2- 172.21.15.92:0/1033270518 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604184eb940 0x5604185031b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:32.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.559+0000 7f86f0b39640 1 --2- 172.21.15.92:0/1033270518 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604184e1080 0x5604184e76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:32.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.559+0000 7f86f133a640 1 -- 172.21.15.92:0/1033270518 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604184eb940 msgr2=0x5604185031b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:32.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.559+0000 7f86f133a640 1 --2- 172.21.15.92:0/1033270518 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604184eb940 0x5604185031b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:32.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.559+0000 7f86f133a640 1 -- 172.21.15.92:0/1033270518 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604184e1080 msgr2=0x5604184e76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:32.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.559+0000 7f86f133a640 1 --2- 172.21.15.92:0/1033270518 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604184e1080 0x5604184e76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:32.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.559+0000 7f86f133a640 1 -- 172.21.15.92:0/1033270518 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604184dcb20 con 0x5604184e0760 2024-09-19T08:59:32.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.560+0000 7f86f133a640 1 --2- 172.21.15.92:0/1033270518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604184e0760 0x5604184fd870 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f86e809c170 tx=0x7f86e801a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ea892803fd737f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:32.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.560+0000 7f86d6ffd640 1 -- 172.21.15.92:0/1033270518 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e80b4030 con 0x5604184e0760 2024-09-19T08:59:32.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.560+0000 7f86d6ffd640 1 -- 172.21.15.92:0/1033270518 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86e80cd720 con 0x5604184e0760 2024-09-19T08:59:32.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.560+0000 7f86d6ffd640 1 -- 172.21.15.92:0/1033270518 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e8018b30 con 0x5604184e0760 2024-09-19T08:59:32.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.561+0000 7f86f5977740 1 -- 172.21.15.92:0/1033270518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604184e0760 msgr2=0x5604184fd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:32.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.561+0000 7f86f5977740 1 --2- 172.21.15.92:0/1033270518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604184e0760 0x5604184fd870 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f86e809c170 tx=0x7f86e801a040 comp rx=0 tx=0).stop 2024-09-19T08:59:32.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.561+0000 7f86f5977740 1 -- 172.21.15.92:0/1033270518 shutdown_connections 2024-09-19T08:59:32.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.561+0000 7f86f5977740 1 --2- 172.21.15.92:0/1033270518 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604184eb940 0x5604185031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:32.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.561+0000 7f86f5977740 1 --2- 172.21.15.92:0/1033270518 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604184e1080 0x5604184e76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:32.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.561+0000 7f86f5977740 1 --2- 172.21.15.92:0/1033270518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604184e0760 0x5604184fd870 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:32.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.561+0000 7f86f5977740 1 -- 172.21.15.92:0/1033270518 >> 172.21.15.92:0/1033270518 conn(0x5604184dccf0 msgr2=0x5604184ea830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:32.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.561+0000 7f86f5977740 1 -- 172.21.15.92:0/1033270518 shutdown_connections 2024-09-19T08:59:32.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.561+0000 7f86f5977740 1 -- 172.21.15.92:0/1033270518 wait complete. 2024-09-19T08:59:32.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.562+0000 7f86f5977740 1 -- start start 2024-09-19T08:59:32.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.562+0000 7f86f5977740 1 Processor -- start 2024-09-19T08:59:32.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.562+0000 7f86f5977740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604184e0760 0x5604184ef720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:32.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.562+0000 7f86f5977740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604184e1080 0x5604184efc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:32.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.563+0000 7f86f5977740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604184eb940 0x5604184f01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:32.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.563+0000 7f86f133a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604184e0760 0x5604184ef720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:32.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.563+0000 7f86f133a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604184e0760 0x5604184ef720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54668/0 (socket says 172.21.15.92:54668) 2024-09-19T08:59:32.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.563+0000 7f86f0b39640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604184e1080 0x5604184efc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:32.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.563+0000 7f86f0b39640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604184e1080 0x5604184efc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:58864/0 (socket says 172.21.15.92:58864) 2024-09-19T08:59:32.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.563+0000 7f86f5977740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f86ec1b29f0 con 0x5604184e0760 2024-09-19T08:59:32.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.563+0000 7f86f133a640 1 -- 172.21.15.92:0/288593783 learned_addr learned my addr 172.21.15.92:0/288593783 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:32.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.563+0000 7f86f1b3b640 1 --2- 172.21.15.92:0/288593783 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604184eb940 0x5604184f01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:32.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.563+0000 7f86f5977740 1 -- 172.21.15.92:0/288593783 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f86ec1b3e60 con 0x5604184eb940 2024-09-19T08:59:32.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.563+0000 7f86f5977740 1 -- 172.21.15.92:0/288593783 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f86ec1b30c0 con 0x5604184e1080 2024-09-19T08:59:32.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.563+0000 7f86f5977740 10 client.0 _ll_register_callbacks cb 0x7f86e4004c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:32.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.564+0000 7f86f133a640 1 -- 172.21.15.92:0/288593783 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604184e1080 msgr2=0x5604184efc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:32.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.564+0000 7f86f133a640 1 --2- 172.21.15.92:0/288593783 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604184e1080 0x5604184efc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:32.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.564+0000 7f86f133a640 1 -- 172.21.15.92:0/288593783 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604184eb940 msgr2=0x5604184f01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:32.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.564+0000 7f86f133a640 1 --2- 172.21.15.92:0/288593783 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604184eb940 0x5604184f01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:32.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.564+0000 7f86f133a640 1 -- 172.21.15.92:0/288593783 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604184d8260 con 0x5604184e0760 2024-09-19T08:59:32.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.564+0000 7f86f1b3b640 1 --2- 172.21.15.92:0/288593783 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604184eb940 0x5604184f01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:32.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.566+0000 7f86f133a640 1 --2- 172.21.15.92:0/288593783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604184e0760 0x5604184ef720 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f86e800c6a0 tx=0x7f86e8009770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3699bc94f3f17d60 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:32.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.566+0000 7f86d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:59:32.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.566+0000 7f86d4ff9640 1 -- 172.21.15.92:0/288593783 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e8098850 con 0x5604184e0760 2024-09-19T08:59:32.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.567+0000 7f86d4ff9640 1 -- 172.21.15.92:0/288593783 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f86e8018b30 con 0x5604184e0760 2024-09-19T08:59:32.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.567+0000 7f86f5977740 1 -- 172.21.15.92:0/288593783 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86e80cd720 con 0x5604184e0760 2024-09-19T08:59:32.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.567+0000 7f86d4ff9640 1 -- 172.21.15.92:0/288593783 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f86e80989f0 con 0x5604184e0760 2024-09-19T08:59:32.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.567+0000 7f86f5977740 10 client.16014 fetch_fsmap learned FSMap version 19 2024-09-19T08:59:32.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.567+0000 7f86f5977740 1 -- 172.21.15.92:0/288593783 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x560418566350 con 0x5604184e0760 2024-09-19T08:59:32.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.568+0000 7f86d4ff9640 1 -- 172.21.15.92:0/288593783 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86e80cd720 con 0x5604184e0760 2024-09-19T08:59:32.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.568+0000 7f86d4ff9640 1 -- 172.21.15.92:0/288593783 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f86e8097f30 con 0x5604184e0760 2024-09-19T08:59:32.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.568+0000 7f86f5977740 10 client.16014 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:59:32.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.568+0000 7f86f5977740 10 client.16014 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T08:59:32.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.568+0000 7f86f5977740 20 client.16014 populate_metadata read hostname 'smithi092' 2024-09-19T08:59:32.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.568+0000 7f86f5977740 1 --2- 172.21.15.92:0/288593783 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5604185669a0 0x560418568dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:32.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.568+0000 7f86f5977740 4 client.16014 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.6, "await_for": 45.0}] 2024-09-19T08:59:32.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.568+0000 7f86f5977740 1 -- 172.21.15.92:0/288593783 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.6, "await_for": 45.0}) -- 0x56041844dd20 con 0x5604185669a0 2024-09-19T08:59:32.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.568+0000 7f86f0b39640 1 --2- 172.21.15.92:0/288593783 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5604185669a0 0x560418568dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:32.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.570+0000 7f86f0b39640 1 --2- 172.21.15.92:0/288593783 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5604185669a0 0x560418568dc0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1f3004d0968e51a server_cookie=9bb25a9145ea97c in_seq=0 out_seq=0 2024-09-19T08:59:32.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.570+0000 7f86d4ff9640 10 client.16014 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:32.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.876+0000 7f86d4ff9640 1 -- 172.21.15.92:0/288593783 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56041844dd20 con 0x5604185669a0 2024-09-19T08:59:32.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.876+0000 7f86d4ff9640 10 client.16014 handle_command_reply: tid=0 2024-09-19T08:59:32.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.876+0000 7f86f5977740 1 client.16014 shutdown 2024-09-19T08:59:32.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.876+0000 7f86f5977740 1 -- 172.21.15.92:0/288593783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604184e0760 msgr2=0x5604184ef720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:32.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.876+0000 7f86f5977740 1 --2- 172.21.15.92:0/288593783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604184e0760 0x5604184ef720 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f86e800c6a0 tx=0x7f86e8009770 comp rx=0 tx=0).stop 2024-09-19T08:59:32.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.876+0000 7f86f5977740 1 -- 172.21.15.92:0/288593783 shutdown_connections 2024-09-19T08:59:32.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.876+0000 7f86f5977740 1 --2- 172.21.15.92:0/288593783 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5604185669a0 0x560418568dc0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:32.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.876+0000 7f86f5977740 1 --2- 172.21.15.92:0/288593783 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604184eb940 0x5604184f01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:32.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.876+0000 7f86d4ff9640 0 client.16014 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:32.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.876+0000 7f86f5977740 1 --2- 172.21.15.92:0/288593783 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5604184e1080 0x5604184efc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:32.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.876+0000 7f86f5977740 1 --2- 172.21.15.92:0/288593783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604184e0760 0x5604184ef720 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:32.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.876+0000 7f86f5977740 1 -- 172.21.15.92:0/288593783 >> 172.21.15.92:0/288593783 conn(0x5604184dccf0 msgr2=0x5604184e21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:32.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.876+0000 7f86f5977740 1 -- 172.21.15.92:0/288593783 shutdown_connections 2024-09-19T08:59:32.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.876+0000 7f86f5977740 1 -- 172.21.15.92:0/288593783 wait complete. 2024-09-19T08:59:32.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.876+0000 7f86f5977740 20 client.16014 trim_cache size 0 max 16384 2024-09-19T08:59:32.878 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T08:59:32.878 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 19, 2024-09-19T08:59:32.878 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24472, 2024-09-19T08:59:32.878 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 14, 2024-09-19T08:59:32.879 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-09-19T08:59:32.879 INFO:teuthology.orchestra.run.smithi092.stdout: "4e84b9cf": { 2024-09-19T08:59:32.879 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 14, 2024-09-19T08:59:32.879 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-09-19T08:59:32.879 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T08:59:32.879 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-09-19T08:59:32.879 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T08:59:32.879 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T08:59:32.879 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 90.0, 2024-09-19T08:59:32.879 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 136.6, 2024-09-19T08:59:32.879 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-09-19T08:59:32.879 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-09-19T08:59:32.879 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-09-19T08:59:32.880 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T08:59:32.880 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-09-19T08:59:32.880 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T08:59:32.880 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:59:32.880 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:59:32.880 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:59:32.880 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:59:32.880 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:59:32.880 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T08:59:32.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.877+0000 7f86f359e640 1 -- 172.21.15.92:0/1494459950 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f86d80a3390 msgr2=0x7f86d80a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:32.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.877+0000 7f86f359e640 1 --2- 172.21.15.92:0/1494459950 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f86d80a3390 0x7f86d80a5850 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f86dc009230 tx=0x7f86dc005d50 comp rx=0 tx=0).stop 2024-09-19T08:59:32.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.877+0000 7f86f359e640 1 -- 172.21.15.92:0/1494459950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86ec076720 msgr2=0x7f86ec1a46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:32.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.877+0000 7f86f359e640 1 --2- 172.21.15.92:0/1494459950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86ec076720 0x7f86ec1a46d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f86e800e9f0 tx=0x7f86e800eeb0 comp rx=0 tx=0).stop 2024-09-19T08:59:32.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.877+0000 7f86f359e640 1 -- 172.21.15.92:0/1494459950 shutdown_connections 2024-09-19T08:59:32.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.877+0000 7f86f359e640 1 --2- 172.21.15.92:0/1494459950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86ec112a30 0x7f86ec19e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:32.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.877+0000 7f86f359e640 1 --2- 172.21.15.92:0/1494459950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86ec077040 0x7f86ec1a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:32.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.877+0000 7f86f359e640 1 --2- 172.21.15.92:0/1494459950 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f86d80a3390 0x7f86d80a5850 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:32.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.877+0000 7f86f359e640 1 --2- 172.21.15.92:0/1494459950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86ec076720 0x7f86ec1a46d0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:32.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.877+0000 7f86f359e640 1 -- 172.21.15.92:0/1494459950 >> 172.21.15.92:0/1494459950 conn(0x7f86ec0ffa70 msgr2=0x7f86ec101e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:32.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.877+0000 7f86f359e640 1 -- 172.21.15.92:0/1494459950 shutdown_connections 2024-09-19T08:59:32.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:32.877+0000 7f86f359e640 1 -- 172.21.15.92:0/1494459950 wait complete. 2024-09-19T08:59:33.576 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '4e84b9cf', quiesce took 4.2 seconds. Will release after: 12.400000000000002 2024-09-19T08:59:33.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:33 smithi092 ceph-mon[31407]: pgmap v422: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 54 MiB/s wr, 1.05k op/s 2024-09-19T08:59:33.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:33 smithi167 ceph-mon[35359]: pgmap v422: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 54 MiB/s wr, 1.05k op/s 2024-09-19T08:59:33.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:33 smithi190 ceph-mon[35358]: pgmap v422: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 54 MiB/s wr, 1.05k op/s 2024-09-19T08:59:35.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:35 smithi092 ceph-mon[31407]: pgmap v423: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 70 MiB/s wr, 1.31k op/s 2024-09-19T08:59:35.797 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 170.0 s, 1143.9 tps, lat 32.998 ms stddev 57.996 2024-09-19T08:59:35.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:35 smithi167 ceph-mon[35359]: pgmap v423: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 70 MiB/s wr, 1.31k op/s 2024-09-19T08:59:35.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:35 smithi190 ceph-mon[35358]: pgmap v423: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 70 MiB/s wr, 1.31k op/s 2024-09-19T08:59:36.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.369+0000 7f938cb8d640 1 -- 172.21.15.92:0/2032514223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9388102d50 msgr2=0x7f93881031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:36.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.369+0000 7f938cb8d640 1 --2- 172.21.15.92:0/2032514223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9388102d50 0x7f93881031d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f9370009900 tx=0x7f937002a410 comp rx=0 tx=0).stop 2024-09-19T08:59:36.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.369+0000 7f938cb8d640 1 -- 172.21.15.92:0/2032514223 shutdown_connections 2024-09-19T08:59:36.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.369+0000 7f938cb8d640 1 --2- 172.21.15.92:0/2032514223 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9388103710 0x7f9388109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:36.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.369+0000 7f938cb8d640 1 --2- 172.21.15.92:0/2032514223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9388102d50 0x7f93881031d0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:36.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.369+0000 7f938cb8d640 1 --2- 172.21.15.92:0/2032514223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9388101b60 0x7f9388101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.369+0000 7f938cb8d640 1 -- 172.21.15.92:0/2032514223 >> 172.21.15.92:0/2032514223 conn(0x7f93880fd2e0 msgr2=0x7f93880ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.369+0000 7f938cb8d640 1 -- 172.21.15.92:0/2032514223 shutdown_connections 2024-09-19T08:59:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.369+0000 7f938cb8d640 1 -- 172.21.15.92:0/2032514223 wait complete. 2024-09-19T08:59:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.370+0000 7f938cb8d640 1 Processor -- start 2024-09-19T08:59:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.370+0000 7f938cb8d640 1 -- start start 2024-09-19T08:59:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.370+0000 7f938cb8d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9388101b60 0x7f9388075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.370+0000 7f938cb8d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9388102d50 0x7f93880745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.370+0000 7f938cb8d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9388103710 0x7f9388074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.370+0000 7f938cb8d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f938810d890 con 0x7f9388103710 2024-09-19T08:59:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.370+0000 7f938cb8d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f938810d710 con 0x7f9388102d50 2024-09-19T08:59:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.370+0000 7f938cb8d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f938810da10 con 0x7f9388101b60 2024-09-19T08:59:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.370+0000 7f9386d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9388103710 0x7f9388074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.370+0000 7f938659c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9388101b60 0x7f9388075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:36.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.370+0000 7f9385d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9388102d50 0x7f93880745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:36.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.370+0000 7f9386d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9388103710 0x7f9388074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54692/0 (socket says 172.21.15.92:54692) 2024-09-19T08:59:36.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.370+0000 7f938659c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9388101b60 0x7f9388075fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:58892/0 (socket says 172.21.15.92:58892) 2024-09-19T08:59:36.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.370+0000 7f9386d9d640 1 -- 172.21.15.92:0/3774048120 learned_addr learned my addr 172.21.15.92:0/3774048120 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:36.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.370+0000 7f9386d9d640 1 -- 172.21.15.92:0/3774048120 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9388101b60 msgr2=0x7f9388075fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:36.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.370+0000 7f9386d9d640 1 --2- 172.21.15.92:0/3774048120 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9388101b60 0x7f9388075fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:36.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.370+0000 7f9386d9d640 1 -- 172.21.15.92:0/3774048120 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9388102d50 msgr2=0x7f93880745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:36.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.370+0000 7f9386d9d640 1 --2- 172.21.15.92:0/3774048120 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9388102d50 0x7f93880745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:36.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.370+0000 7f9386d9d640 1 -- 172.21.15.92:0/3774048120 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93880753b0 con 0x7f9388103710 2024-09-19T08:59:36.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.371+0000 7f9386d9d640 1 --2- 172.21.15.92:0/3774048120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9388103710 0x7f9388074b20 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f9380009fd0 tx=0x7f938000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:36.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.371+0000 7f937f7fe640 1 -- 172.21.15.92:0/3774048120 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9380011830 con 0x7f9388103710 2024-09-19T08:59:36.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.371+0000 7f937f7fe640 1 -- 172.21.15.92:0/3774048120 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9380016070 con 0x7f9388103710 2024-09-19T08:59:36.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.371+0000 7f938cb8d640 1 -- 172.21.15.92:0/3774048120 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93881a1fa0 con 0x7f9388103710 2024-09-19T08:59:36.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.371+0000 7f937f7fe640 1 -- 172.21.15.92:0/3774048120 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938000f2e0 con 0x7f9388103710 2024-09-19T08:59:36.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.371+0000 7f938cb8d640 1 -- 172.21.15.92:0/3774048120 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93881a2480 con 0x7f9388103710 2024-09-19T08:59:36.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.373+0000 7f937f7fe640 1 -- 172.21.15.92:0/3774048120 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f93800119d0 con 0x7f9388103710 2024-09-19T08:59:36.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.374+0000 7f938fa07740 1 Processor -- start 2024-09-19T08:59:36.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.374+0000 7f938fa07740 1 -- start start 2024-09-19T08:59:36.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.374+0000 7f938fa07740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1f632b9a0 0x55f1f632bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:36.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.374+0000 7f938fa07740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1f632c2e0 0x55f1f6330da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:36.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.374+0000 7f938fa07740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f1f6331370 0x55f1f6333830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:36.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.374+0000 7f938fa07740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f1f628f2f0 con 0x55f1f632b9a0 2024-09-19T08:59:36.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.374+0000 7f938fa07740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f1f6237270 con 0x55f1f632c2e0 2024-09-19T08:59:36.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.374+0000 7f938fa07740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f1f628b2b0 con 0x55f1f6331370 2024-09-19T08:59:36.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.374+0000 7f9385d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1f632b9a0 0x55f1f632bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:36.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.374+0000 7f9385d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1f632b9a0 0x55f1f632bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54696/0 (socket says 172.21.15.92:54696) 2024-09-19T08:59:36.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.374+0000 7f9385d9b640 1 -- 172.21.15.92:0/3959471335 learned_addr learned my addr 172.21.15.92:0/3959471335 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:36.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.374+0000 7f937f7fe640 1 --2- 172.21.15.92:0/3774048120 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f93740a32f0 0x7f93740a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:36.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.374+0000 7f938659c640 1 --2- 172.21.15.92:0/3959471335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1f632c2e0 0x55f1f6330da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:36.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.374+0000 7f9385d9b640 1 --2- 172.21.15.92:0/3959471335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f1f6331370 0x55f1f6333830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:36.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.375+0000 7f9386d9d640 1 --2- 172.21.15.92:0/3774048120 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f93740a32f0 0x7f93740a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:36.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.375+0000 7f9385d9b640 1 -- 172.21.15.92:0/3959471335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f1f6331370 msgr2=0x55f1f6333830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:36.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.375+0000 7f9385d9b640 1 --2- 172.21.15.92:0/3959471335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f1f6331370 0x55f1f6333830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:36.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.375+0000 7f9385d9b640 1 -- 172.21.15.92:0/3959471335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1f632c2e0 msgr2=0x55f1f6330da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:36.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.375+0000 7f9385d9b640 1 --2- 172.21.15.92:0/3959471335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1f632c2e0 0x55f1f6330da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:36.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.375+0000 7f9385d9b640 1 -- 172.21.15.92:0/3959471335 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1f6236340 con 0x55f1f632b9a0 2024-09-19T08:59:36.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.375+0000 7f938659c640 1 --2- 172.21.15.92:0/3959471335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1f632c2e0 0x55f1f6330da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:59:36.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.375+0000 7f937f7fe640 1 -- 172.21.15.92:0/3774048120 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f93800cee90 con 0x7f9388103710 2024-09-19T08:59:36.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.375+0000 7f9385d9b640 1 --2- 172.21.15.92:0/3959471335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1f632b9a0 0x55f1f632bda0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f9370009230 tx=0x7f9370000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a833622cea1a21bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:36.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.375+0000 7f937cff9640 1 -- 172.21.15.92:0/3959471335 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9370044020 con 0x55f1f632b9a0 2024-09-19T08:59:36.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.375+0000 7f937cff9640 1 -- 172.21.15.92:0/3959471335 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9370004760 con 0x55f1f632b9a0 2024-09-19T08:59:36.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.375+0000 7f937cff9640 1 -- 172.21.15.92:0/3959471335 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9370035040 con 0x55f1f632b9a0 2024-09-19T08:59:36.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.376+0000 7f938fa07740 1 -- 172.21.15.92:0/3959471335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1f632b9a0 msgr2=0x55f1f632bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:36.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.376+0000 7f9386d9d640 1 --2- 172.21.15.92:0/3774048120 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f93740a32f0 0x7f93740a57b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9380097e40 tx=0x7f93800c6240 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:36.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.376+0000 7f938fa07740 1 --2- 172.21.15.92:0/3959471335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1f632b9a0 0x55f1f632bda0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f9370009230 tx=0x7f9370000bc0 comp rx=0 tx=0).stop 2024-09-19T08:59:36.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.376+0000 7f938fa07740 1 -- 172.21.15.92:0/3959471335 shutdown_connections 2024-09-19T08:59:36.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.376+0000 7f938fa07740 1 --2- 172.21.15.92:0/3959471335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f1f6331370 0x55f1f6333830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:36.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.376+0000 7f938fa07740 1 --2- 172.21.15.92:0/3959471335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1f632c2e0 0x55f1f6330da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:36.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.376+0000 7f938fa07740 1 --2- 172.21.15.92:0/3959471335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1f632b9a0 0x55f1f632bda0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:36.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.376+0000 7f938fa07740 1 -- 172.21.15.92:0/3959471335 >> 172.21.15.92:0/3959471335 conn(0x55f1f6327010 msgr2=0x55f1f6327410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:36.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.376+0000 7f938fa07740 1 -- 172.21.15.92:0/3959471335 shutdown_connections 2024-09-19T08:59:36.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.376+0000 7f938fa07740 1 -- 172.21.15.92:0/3959471335 wait complete. 2024-09-19T08:59:36.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.376+0000 7f938fa07740 1 -- start start 2024-09-19T08:59:36.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.376+0000 7f938fa07740 1 Processor -- start 2024-09-19T08:59:36.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.377+0000 7f938fa07740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1f632b9a0 0x55f1f6335b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:36.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.377+0000 7f938fa07740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1f632c2e0 0x55f1f63360d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:36.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.377+0000 7f938fa07740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f1f6331370 0x55f1f633d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:36.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.377+0000 7f938fa07740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f1f63342e0 con 0x55f1f632c2e0 2024-09-19T08:59:36.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.377+0000 7f938fa07740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f1f6218290 con 0x55f1f632b9a0 2024-09-19T08:59:36.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.377+0000 7f938fa07740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f1f6334460 con 0x55f1f6331370 2024-09-19T08:59:36.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.377+0000 7f938fa07740 10 client.0 _ll_register_callbacks cb 0x55f1f6249140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:36.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.377+0000 7f938659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1f632c2e0 0x55f1f63360d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:36.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.377+0000 7f938659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1f632c2e0 0x55f1f63360d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54698/0 (socket says 172.21.15.92:54698) 2024-09-19T08:59:36.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.377+0000 7f938659c640 1 -- 172.21.15.92:0/3206224872 learned_addr learned my addr 172.21.15.92:0/3206224872 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:36.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.377+0000 7f9385d9b640 1 --2- 172.21.15.92:0/3206224872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1f632b9a0 0x55f1f6335b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:36.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.377+0000 7f9385d9b640 1 --2- 172.21.15.92:0/3206224872 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f1f6331370 0x55f1f633d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:36.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.377+0000 7f938659c640 1 -- 172.21.15.92:0/3206224872 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f1f6331370 msgr2=0x55f1f633d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:36.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.377+0000 7f938659c640 1 --2- 172.21.15.92:0/3206224872 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f1f6331370 0x55f1f633d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:36.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.377+0000 7f938659c640 1 -- 172.21.15.92:0/3206224872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1f632b9a0 msgr2=0x55f1f6335b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:36.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.377+0000 7f938659c640 1 --2- 172.21.15.92:0/3206224872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1f632b9a0 0x55f1f6335b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:36.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.377+0000 7f938659c640 1 -- 172.21.15.92:0/3206224872 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1f5fa2210 con 0x55f1f632c2e0 2024-09-19T08:59:36.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.377+0000 7f938659c640 1 --2- 172.21.15.92:0/3206224872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1f632c2e0 0x55f1f63360d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9378012720 tx=0x7f9378012be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8193bc2a120236 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:36.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.377+0000 7f936dffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:59:36.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.377+0000 7f936dffb640 1 -- 172.21.15.92:0/3206224872 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9378004d20 con 0x55f1f632c2e0 2024-09-19T08:59:36.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.377+0000 7f936dffb640 1 -- 172.21.15.92:0/3206224872 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9378010b60 con 0x55f1f632c2e0 2024-09-19T08:59:36.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.377+0000 7f938fa07740 1 -- 172.21.15.92:0/3206224872 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9370004760 con 0x55f1f632c2e0 2024-09-19T08:59:36.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.378+0000 7f936dffb640 1 -- 172.21.15.92:0/3206224872 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9378010d60 con 0x55f1f632c2e0 2024-09-19T08:59:36.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.378+0000 7f938fa07740 10 client.16026 fetch_fsmap learned FSMap version 19 2024-09-19T08:59:36.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.378+0000 7f938fa07740 1 -- 172.21.15.92:0/3206224872 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f1f606e620 con 0x55f1f632c2e0 2024-09-19T08:59:36.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.378+0000 7f936dffb640 1 -- 172.21.15.92:0/3206224872 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9370004760 con 0x55f1f632c2e0 2024-09-19T08:59:36.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.378+0000 7f936dffb640 1 -- 172.21.15.92:0/3206224872 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f9378019030 con 0x55f1f632c2e0 2024-09-19T08:59:36.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.378+0000 7f938fa07740 10 client.16026 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:59:36.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.378+0000 7f938fa07740 10 client.16026 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T08:59:36.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.378+0000 7f938fa07740 20 client.16026 populate_metadata read hostname 'smithi092' 2024-09-19T08:59:36.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.378+0000 7f938fa07740 1 --2- 172.21.15.92:0/3206224872 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f1f6341920 0x55f1f6343d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:36.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.378+0000 7f938fa07740 4 client.16026 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:59:36.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.378+0000 7f938fa07740 1 -- 172.21.15.92:0/3206224872 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1f629ca20 con 0x55f1f6341920 2024-09-19T08:59:36.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.378+0000 7f9385d9b640 1 --2- 172.21.15.92:0/3206224872 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f1f6341920 0x55f1f6343d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:36.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.379+0000 7f9385d9b640 1 --2- 172.21.15.92:0/3206224872 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f1f6341920 0x55f1f6343d60 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f286c201903ea3d7 server_cookie=8075a19c53b5da67 in_seq=0 out_seq=0 2024-09-19T08:59:36.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.379+0000 7f936dffb640 10 client.16026 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:36.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.380+0000 7f936dffb640 1 -- 172.21.15.92:0/3206224872 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f1f629ca20 con 0x55f1f6341920 2024-09-19T08:59:36.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.380+0000 7f936dffb640 10 client.16026 handle_command_reply: tid=0 2024-09-19T08:59:36.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.380+0000 7f938fa07740 1 client.16026 shutdown 2024-09-19T08:59:36.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.380+0000 7f938fa07740 1 -- 172.21.15.92:0/3206224872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1f632c2e0 msgr2=0x55f1f63360d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:36.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.380+0000 7f938fa07740 1 --2- 172.21.15.92:0/3206224872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1f632c2e0 0x55f1f63360d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9378012720 tx=0x7f9378012be0 comp rx=0 tx=0).stop 2024-09-19T08:59:36.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.380+0000 7f938fa07740 1 -- 172.21.15.92:0/3206224872 shutdown_connections 2024-09-19T08:59:36.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.380+0000 7f938fa07740 1 --2- 172.21.15.92:0/3206224872 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f1f6341920 0x55f1f6343d60 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:36.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.380+0000 7f938fa07740 1 --2- 172.21.15.92:0/3206224872 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f1f6331370 0x55f1f633d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:36.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.380+0000 7f938fa07740 1 --2- 172.21.15.92:0/3206224872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1f632c2e0 0x55f1f63360d0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:36.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.380+0000 7f938fa07740 1 --2- 172.21.15.92:0/3206224872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1f632b9a0 0x55f1f6335b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:36.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.380+0000 7f936dffb640 0 client.16026 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:36.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.380+0000 7f938fa07740 1 -- 172.21.15.92:0/3206224872 >> 172.21.15.92:0/3206224872 conn(0x55f1f6327010 msgr2=0x55f1f6328820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:36.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.380+0000 7f938fa07740 1 -- 172.21.15.92:0/3206224872 shutdown_connections 2024-09-19T08:59:36.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.380+0000 7f938fa07740 1 -- 172.21.15.92:0/3206224872 wait complete. 2024-09-19T08:59:36.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.380+0000 7f938fa07740 20 client.16026 trim_cache size 0 max 16384 2024-09-19T08:59:36.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.394+0000 7f938fa07740 1 Processor -- start 2024-09-19T08:59:36.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.394+0000 7f938fa07740 1 -- start start 2024-09-19T08:59:36.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.394+0000 7f938fa07740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f1f632b9a0 0x55f1f6330b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:36.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.394+0000 7f938fa07740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1f632c2e0 0x55f1f633d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:36.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.394+0000 7f938fa07740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1f6331370 0x55f1f63260b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:36.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.394+0000 7f938fa07740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f93881a91f0 con 0x55f1f6331370 2024-09-19T08:59:36.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.394+0000 7f938fa07740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f93881aba90 con 0x55f1f632c2e0 2024-09-19T08:59:36.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.394+0000 7f938fa07740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f93881a9880 con 0x55f1f632b9a0 2024-09-19T08:59:36.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.394+0000 7f9385d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1f6331370 0x55f1f63260b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:36.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.394+0000 7f9385d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1f6331370 0x55f1f63260b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54700/0 (socket says 172.21.15.92:54700) 2024-09-19T08:59:36.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.394+0000 7f9385d9b640 1 -- 172.21.15.92:0/2990256289 learned_addr learned my addr 172.21.15.92:0/2990256289 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:36.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.394+0000 7f938659c640 1 --2- 172.21.15.92:0/2990256289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1f632c2e0 0x55f1f633d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:36.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.395+0000 7f9385d9b640 1 --2- 172.21.15.92:0/2990256289 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f1f632b9a0 0x55f1f6330b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:36.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.395+0000 7f9385d9b640 1 -- 172.21.15.92:0/2990256289 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f1f632b9a0 msgr2=0x55f1f6330b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:36.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.395+0000 7f9385d9b640 1 --2- 172.21.15.92:0/2990256289 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f1f632b9a0 0x55f1f6330b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:36.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.395+0000 7f9385d9b640 1 -- 172.21.15.92:0/2990256289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1f632c2e0 msgr2=0x55f1f633d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:36.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.395+0000 7f9385d9b640 1 --2- 172.21.15.92:0/2990256289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1f632c2e0 0x55f1f633d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:36.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.395+0000 7f9385d9b640 1 -- 172.21.15.92:0/2990256289 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1f632c7c0 con 0x55f1f6331370 2024-09-19T08:59:36.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.395+0000 7f9385d9b640 1 --2- 172.21.15.92:0/2990256289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1f6331370 0x55f1f63260b0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f9370009900 tx=0x7f9370004f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad6e44508ed7afdb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:36.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.395+0000 7f936ffff640 1 -- 172.21.15.92:0/2990256289 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9370035070 con 0x55f1f6331370 2024-09-19T08:59:36.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.395+0000 7f936ffff640 1 -- 172.21.15.92:0/2990256289 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9370004760 con 0x55f1f6331370 2024-09-19T08:59:36.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.395+0000 7f936ffff640 1 -- 172.21.15.92:0/2990256289 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9370044040 con 0x55f1f6331370 2024-09-19T08:59:36.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.395+0000 7f938fa07740 1 -- 172.21.15.92:0/2990256289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1f6331370 msgr2=0x55f1f63260b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:36.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.395+0000 7f938fa07740 1 --2- 172.21.15.92:0/2990256289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1f6331370 0x55f1f63260b0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f9370009900 tx=0x7f9370004f10 comp rx=0 tx=0).stop 2024-09-19T08:59:36.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.396+0000 7f938fa07740 1 -- 172.21.15.92:0/2990256289 shutdown_connections 2024-09-19T08:59:36.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.396+0000 7f938fa07740 1 --2- 172.21.15.92:0/2990256289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1f6331370 0x55f1f63260b0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:36.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.396+0000 7f938fa07740 1 --2- 172.21.15.92:0/2990256289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1f632c2e0 0x55f1f633d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:36.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.396+0000 7f938fa07740 1 --2- 172.21.15.92:0/2990256289 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f1f632b9a0 0x55f1f6330b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:36.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.396+0000 7f938fa07740 1 -- 172.21.15.92:0/2990256289 >> 172.21.15.92:0/2990256289 conn(0x55f1f6327010 msgr2=0x55f1f63259a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:36.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.396+0000 7f938fa07740 1 -- 172.21.15.92:0/2990256289 shutdown_connections 2024-09-19T08:59:36.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.396+0000 7f938fa07740 1 -- 172.21.15.92:0/2990256289 wait complete. 2024-09-19T08:59:36.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.396+0000 7f938fa07740 1 -- start start 2024-09-19T08:59:36.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.396+0000 7f938fa07740 1 Processor -- start 2024-09-19T08:59:36.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.396+0000 7f938fa07740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1f632b9a0 0x55f1f633a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:36.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.396+0000 7f938fa07740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f1f632c2e0 0x55f1f633ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:36.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.396+0000 7f938fa07740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1f6331370 0x55f1f633bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:36.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.396+0000 7f938fa07740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f93881a9f50 con 0x55f1f632b9a0 2024-09-19T08:59:36.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.396+0000 7f938fa07740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f93881ab3c0 con 0x55f1f6331370 2024-09-19T08:59:36.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.396+0000 7f938fa07740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f93881aa620 con 0x55f1f632c2e0 2024-09-19T08:59:36.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.396+0000 7f938fa07740 10 client.0 _ll_register_callbacks cb 0x7f9378009ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:36.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.396+0000 7f9385d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1f632b9a0 0x55f1f633a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:36.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.396+0000 7f9385d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1f632b9a0 0x55f1f633a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54706/0 (socket says 172.21.15.92:54706) 2024-09-19T08:59:36.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.396+0000 7f9385d9b640 1 -- 172.21.15.92:0/872591626 learned_addr learned my addr 172.21.15.92:0/872591626 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:36.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.396+0000 7f938659c640 1 --2- 172.21.15.92:0/872591626 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f1f632c2e0 0x55f1f633ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:36.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.396+0000 7f9385d9b640 1 --2- 172.21.15.92:0/872591626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1f6331370 0x55f1f633bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:36.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.397+0000 7f9385d9b640 1 -- 172.21.15.92:0/872591626 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f1f632c2e0 msgr2=0x55f1f633ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:36.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.397+0000 7f9385d9b640 1 --2- 172.21.15.92:0/872591626 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f1f632c2e0 0x55f1f633ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:36.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.397+0000 7f9385d9b640 1 -- 172.21.15.92:0/872591626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1f6331370 msgr2=0x55f1f633bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:36.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.397+0000 7f9385d9b640 1 --2- 172.21.15.92:0/872591626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1f6331370 0x55f1f633bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:36.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.397+0000 7f9385d9b640 1 -- 172.21.15.92:0/872591626 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1f633c390 con 0x55f1f632b9a0 2024-09-19T08:59:36.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.397+0000 7f9385d9b640 1 --2- 172.21.15.92:0/872591626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1f632b9a0 0x55f1f633a830 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f937002a930 tx=0x7f937002ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c21af0d7e523990 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:36.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.397+0000 7f936dffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:59:36.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.397+0000 7f936dffb640 1 -- 172.21.15.92:0/872591626 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9370035070 con 0x55f1f632b9a0 2024-09-19T08:59:36.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.397+0000 7f936dffb640 1 -- 172.21.15.92:0/872591626 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9370005420 con 0x55f1f632b9a0 2024-09-19T08:59:36.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.397+0000 7f938fa07740 1 -- 172.21.15.92:0/872591626 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9370004760 con 0x55f1f632b9a0 2024-09-19T08:59:36.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.397+0000 7f936dffb640 1 -- 172.21.15.92:0/872591626 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9370044040 con 0x55f1f632b9a0 2024-09-19T08:59:36.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.397+0000 7f938fa07740 10 client.16032 fetch_fsmap learned FSMap version 19 2024-09-19T08:59:36.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.397+0000 7f938fa07740 1 -- 172.21.15.92:0/872591626 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f1f63ac640 con 0x55f1f632b9a0 2024-09-19T08:59:36.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.397+0000 7f936dffb640 1 -- 172.21.15.92:0/872591626 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9370004760 con 0x55f1f632b9a0 2024-09-19T08:59:36.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.397+0000 7f936dffb640 1 -- 172.21.15.92:0/872591626 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f93700036d0 con 0x55f1f632b9a0 2024-09-19T08:59:36.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.397+0000 7f938fa07740 10 client.16032 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:59:36.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.397+0000 7f938fa07740 10 client.16032 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T08:59:36.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.397+0000 7f938fa07740 20 client.16032 populate_metadata read hostname 'smithi092' 2024-09-19T08:59:36.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.398+0000 7f938fa07740 1 --2- 172.21.15.92:0/872591626 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f1f63acbb0 0x55f1f63aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:36.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.398+0000 7f938fa07740 4 client.16032 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:59:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.398+0000 7f938fa07740 1 -- 172.21.15.92:0/872591626 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f1f6296d70 con 0x55f1f63acbb0 2024-09-19T08:59:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.398+0000 7f938659c640 1 --2- 172.21.15.92:0/872591626 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f1f63acbb0 0x55f1f63aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.398+0000 7f936dffb640 10 client.16032 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.398+0000 7f938659c640 1 --2- 172.21.15.92:0/872591626 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f1f63acbb0 0x55f1f63aefd0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b53a09ab15e28ad server_cookie=8e0f6f167650fd44 in_seq=0 out_seq=0 2024-09-19T08:59:36.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.442+0000 7f936dffb640 1 -- 172.21.15.92:0/872591626 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f1f6296d70 con 0x55f1f63acbb0 2024-09-19T08:59:36.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.442+0000 7f936dffb640 10 client.16032 handle_command_reply: tid=0 2024-09-19T08:59:36.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.442+0000 7f938fa07740 1 client.16032 shutdown 2024-09-19T08:59:36.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.443+0000 7f938fa07740 1 -- 172.21.15.92:0/872591626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1f632b9a0 msgr2=0x55f1f633a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:36.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.443+0000 7f938fa07740 1 --2- 172.21.15.92:0/872591626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1f632b9a0 0x55f1f633a830 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f937002a930 tx=0x7f937002ab90 comp rx=0 tx=0).stop 2024-09-19T08:59:36.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.443+0000 7f938fa07740 1 -- 172.21.15.92:0/872591626 shutdown_connections 2024-09-19T08:59:36.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.443+0000 7f938fa07740 1 --2- 172.21.15.92:0/872591626 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f1f63acbb0 0x55f1f63aefd0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:36.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.443+0000 7f938fa07740 1 --2- 172.21.15.92:0/872591626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1f6331370 0x55f1f633bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:36.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.443+0000 7f936dffb640 0 client.16032 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:36.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.443+0000 7f938fa07740 1 --2- 172.21.15.92:0/872591626 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f1f632c2e0 0x55f1f633ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:36.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.443+0000 7f938fa07740 1 --2- 172.21.15.92:0/872591626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1f632b9a0 0x55f1f633a830 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:36.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.443+0000 7f938fa07740 1 -- 172.21.15.92:0/872591626 >> 172.21.15.92:0/872591626 conn(0x55f1f6327010 msgr2=0x55f1f63259a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:36.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.443+0000 7f938fa07740 1 -- 172.21.15.92:0/872591626 shutdown_connections 2024-09-19T08:59:36.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.443+0000 7f938fa07740 1 -- 172.21.15.92:0/872591626 wait complete. 2024-09-19T08:59:36.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.443+0000 7f938fa07740 20 client.16032 trim_cache size 0 max 16384 2024-09-19T08:59:36.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T08:59:36.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T08:59:36.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T08:59:36.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T08:59:36.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.443+0000 7f938cb8d640 1 -- 172.21.15.92:0/3774048120 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f93740a32f0 msgr2=0x7f93740a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:36.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.443+0000 7f938cb8d640 1 --2- 172.21.15.92:0/3774048120 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f93740a32f0 0x7f93740a57b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9380097e40 tx=0x7f93800c6240 comp rx=0 tx=0).stop 2024-09-19T08:59:36.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.443+0000 7f938cb8d640 1 -- 172.21.15.92:0/3774048120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9388103710 msgr2=0x7f9388074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:36.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.443+0000 7f938cb8d640 1 --2- 172.21.15.92:0/3774048120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9388103710 0x7f9388074b20 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f9380009fd0 tx=0x7f938000b8e0 comp rx=0 tx=0).stop 2024-09-19T08:59:36.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.444+0000 7f938cb8d640 1 -- 172.21.15.92:0/3774048120 shutdown_connections 2024-09-19T08:59:36.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.444+0000 7f938cb8d640 1 --2- 172.21.15.92:0/3774048120 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f93740a32f0 0x7f93740a57b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:36.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.444+0000 7f938cb8d640 1 --2- 172.21.15.92:0/3774048120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9388103710 0x7f9388074b20 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:36.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.444+0000 7f938cb8d640 1 --2- 172.21.15.92:0/3774048120 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9388102d50 0x7f93880745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:36.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.444+0000 7f938cb8d640 1 --2- 172.21.15.92:0/3774048120 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9388101b60 0x7f9388075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:36.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.444+0000 7f938cb8d640 1 -- 172.21.15.92:0/3774048120 >> 172.21.15.92:0/3774048120 conn(0x7f93880fd2e0 msgr2=0x7f9388105ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:36.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.444+0000 7f938cb8d640 1 -- 172.21.15.92:0/3774048120 shutdown_connections 2024-09-19T08:59:36.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:36.444+0000 7f938cb8d640 1 -- 172.21.15.92:0/3774048120 wait complete. 2024-09-19T08:59:36.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:36 smithi167 ceph-mon[35359]: pgmap v424: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 70 MiB/s wr, 1.38k op/s 2024-09-19T08:59:36.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:36 smithi190 ceph-mon[35358]: pgmap v424: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 70 MiB/s wr, 1.38k op/s 2024-09-19T08:59:37.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:36 smithi092 ceph-mon[31407]: pgmap v424: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 70 MiB/s wr, 1.38k op/s 2024-09-19T08:59:39.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:39 smithi092 ceph-mon[31407]: pgmap v425: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 62 MiB/s wr, 1.24k op/s 2024-09-19T08:59:39.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:39 smithi167 ceph-mon[35359]: pgmap v425: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 62 MiB/s wr, 1.24k op/s 2024-09-19T08:59:39.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:39 smithi190 ceph-mon[35358]: pgmap v425: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 62 MiB/s wr, 1.24k op/s 2024-09-19T08:59:40.799 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T08:59:41.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:41 smithi092 ceph-mon[31407]: pgmap v426: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 56 MiB/s wr, 1.13k op/s 2024-09-19T08:59:41.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:41 smithi167 ceph-mon[35359]: pgmap v426: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 56 MiB/s wr, 1.13k op/s 2024-09-19T08:59:41.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:41 smithi190 ceph-mon[35358]: pgmap v426: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 56 MiB/s wr, 1.13k op/s 2024-09-19T08:59:43.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:43 smithi092 ceph-mon[31407]: pgmap v427: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 47 MiB/s wr, 947 op/s 2024-09-19T08:59:43.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:43 smithi167 ceph-mon[35359]: pgmap v427: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 47 MiB/s wr, 947 op/s 2024-09-19T08:59:43.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:43 smithi190 ceph-mon[35358]: pgmap v427: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 47 MiB/s wr, 947 op/s 2024-09-19T08:59:44.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:44 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:44.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:44 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:44.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:44 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:44.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:44 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:59:44.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:44 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:44.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:44 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:44.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:44 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:44.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:44 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:59:44.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:44 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:44.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:44 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:44.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:44 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:44.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:44 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T08:59:45.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:45 smithi092 ceph-mon[31407]: pgmap v428: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 34 MiB/s wr, 689 op/s 2024-09-19T08:59:45.799 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T08:59:45.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:45 smithi167 ceph-mon[35359]: pgmap v428: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 34 MiB/s wr, 689 op/s 2024-09-19T08:59:45.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:45 smithi190 ceph-mon[35358]: pgmap v428: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 34 MiB/s wr, 689 op/s 2024-09-19T08:59:45.977 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:59:46.231 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:59:46.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.717+0000 7fad47c8c640 1 -- 172.21.15.92:0/1749735260 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad40102ef0 msgr2=0x7fad4010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:46.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.717+0000 7fad47c8c640 1 --2- 172.21.15.92:0/1749735260 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad40102ef0 0x7fad4010da40 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fad38009ca0 tx=0x7fad3802a950 comp rx=0 tx=0).stop 2024-09-19T08:59:46.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.717+0000 7fad47c8c640 1 -- 172.21.15.92:0/1749735260 shutdown_connections 2024-09-19T08:59:46.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.717+0000 7fad47c8c640 1 --2- 172.21.15.92:0/1749735260 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad40102ef0 0x7fad4010da40 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:46.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.717+0000 7fad47c8c640 1 --2- 172.21.15.92:0/1749735260 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad40102570 0x7fad401029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:46.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.717+0000 7fad47c8c640 1 --2- 172.21.15.92:0/1749735260 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad40100e20 0x7fad40101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:46.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.717+0000 7fad47c8c640 1 -- 172.21.15.92:0/1749735260 >> 172.21.15.92:0/1749735260 conn(0x7fad400fc7d0 msgr2=0x7fad400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:46.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.717+0000 7fad47c8c640 1 -- 172.21.15.92:0/1749735260 shutdown_connections 2024-09-19T08:59:46.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.717+0000 7fad47c8c640 1 -- 172.21.15.92:0/1749735260 wait complete. 2024-09-19T08:59:46.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.718+0000 7fad47c8c640 1 Processor -- start 2024-09-19T08:59:46.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.718+0000 7fad47c8c640 1 -- start start 2024-09-19T08:59:46.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.718+0000 7fad47c8c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad40100e20 0x7fad400fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:46.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.718+0000 7fad47c8c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad40102570 0x7fad400fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:46.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.718+0000 7fad47c8c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad40102ef0 0x7fad400fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:46.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.718+0000 7fad47c8c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fad40110f80 con 0x7fad40102570 2024-09-19T08:59:46.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.718+0000 7fad47c8c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fad40110e00 con 0x7fad40100e20 2024-09-19T08:59:46.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.718+0000 7fad47c8c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fad40111100 con 0x7fad40102ef0 2024-09-19T08:59:46.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.718+0000 7fad45227640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad40102570 0x7fad400fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:46.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.718+0000 7fad45227640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad40102570 0x7fad400fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35812/0 (socket says 172.21.15.92:35812) 2024-09-19T08:59:46.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.718+0000 7fad45a28640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad40100e20 0x7fad400fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:46.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.718+0000 7fad45227640 1 -- 172.21.15.92:0/665367159 learned_addr learned my addr 172.21.15.92:0/665367159 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:46.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.718+0000 7fad46229640 1 --2- 172.21.15.92:0/665367159 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad40102ef0 0x7fad400fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:46.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.719+0000 7fad45227640 1 -- 172.21.15.92:0/665367159 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad40102ef0 msgr2=0x7fad400fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:46.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.719+0000 7fad45227640 1 --2- 172.21.15.92:0/665367159 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad40102ef0 0x7fad400fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:46.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.719+0000 7fad45227640 1 -- 172.21.15.92:0/665367159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad40100e20 msgr2=0x7fad400fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:46.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.719+0000 7fad45227640 1 --2- 172.21.15.92:0/665367159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad40100e20 0x7fad400fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:46.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.719+0000 7fad45227640 1 -- 172.21.15.92:0/665367159 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad401a6950 con 0x7fad40102570 2024-09-19T08:59:46.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.719+0000 7fad45227640 1 --2- 172.21.15.92:0/665367159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad40102570 0x7fad400fd1c0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fad3000d950 tx=0x7fad3000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:46.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.719+0000 7fad36ffd640 1 -- 172.21.15.92:0/665367159 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad30017070 con 0x7fad40102570 2024-09-19T08:59:46.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.719+0000 7fad36ffd640 1 -- 172.21.15.92:0/665367159 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad30009c30 con 0x7fad40102570 2024-09-19T08:59:46.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.719+0000 7fad47c8c640 1 -- 172.21.15.92:0/665367159 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad401a6c40 con 0x7fad40102570 2024-09-19T08:59:46.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.719+0000 7fad36ffd640 1 -- 172.21.15.92:0/665367159 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3000f6b0 con 0x7fad40102570 2024-09-19T08:59:46.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.719+0000 7fad47c8c640 1 -- 172.21.15.92:0/665367159 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad401a7180 con 0x7fad40102570 2024-09-19T08:59:46.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.720+0000 7fad47c8c640 1 -- 172.21.15.92:0/665367159 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad40101200 con 0x7fad40102570 2024-09-19T08:59:46.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.721+0000 7fad36ffd640 1 -- 172.21.15.92:0/665367159 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fad300109d0 con 0x7fad40102570 2024-09-19T08:59:46.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.722+0000 7fad36ffd640 1 --2- 172.21.15.92:0/665367159 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fad2c0a3240 0x7fad2c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:46.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.722+0000 7fad45a28640 1 --2- 172.21.15.92:0/665367159 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fad2c0a3240 0x7fad2c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:46.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.722+0000 7fad36ffd640 1 -- 172.21.15.92:0/665367159 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fad300cf3f0 con 0x7fad40102570 2024-09-19T08:59:46.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.723+0000 7fad45a28640 1 --2- 172.21.15.92:0/665367159 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fad2c0a3240 0x7fad2c0a5700 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fad3c005fd0 tx=0x7fad3c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:46.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.725+0000 7fad36ffd640 1 -- 172.21.15.92:0/665367159 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fad30009de0 con 0x7fad40102570 2024-09-19T08:59:46.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.936+0000 7fad47c8c640 1 -- 172.21.15.92:0/665367159 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fad4010a0d0 con 0x7fad40102570 2024-09-19T08:59:46.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.937+0000 7fad36ffd640 1 -- 172.21.15.92:0/665367159 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7fad3009bac0 con 0x7fad40102570 2024-09-19T08:59:46.938 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:59:46.938 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T08:59:46.939 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T08:59:46.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.939+0000 7fad47c8c640 1 -- 172.21.15.92:0/665367159 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fad2c0a3240 msgr2=0x7fad2c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:46.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.939+0000 7fad47c8c640 1 --2- 172.21.15.92:0/665367159 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fad2c0a3240 0x7fad2c0a5700 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fad3c005fd0 tx=0x7fad3c00b390 comp rx=0 tx=0).stop 2024-09-19T08:59:46.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.939+0000 7fad47c8c640 1 -- 172.21.15.92:0/665367159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad40102570 msgr2=0x7fad400fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:46.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.939+0000 7fad47c8c640 1 --2- 172.21.15.92:0/665367159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad40102570 0x7fad400fd1c0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fad3000d950 tx=0x7fad3000de10 comp rx=0 tx=0).stop 2024-09-19T08:59:46.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.939+0000 7fad47c8c640 1 -- 172.21.15.92:0/665367159 shutdown_connections 2024-09-19T08:59:46.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.939+0000 7fad47c8c640 1 --2- 172.21.15.92:0/665367159 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad40102ef0 0x7fad400fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:46.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.939+0000 7fad47c8c640 1 --2- 172.21.15.92:0/665367159 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fad2c0a3240 0x7fad2c0a5700 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:46.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.939+0000 7fad47c8c640 1 --2- 172.21.15.92:0/665367159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad40102570 0x7fad400fd1c0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:46.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.939+0000 7fad47c8c640 1 --2- 172.21.15.92:0/665367159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad40100e20 0x7fad400fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:46.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.939+0000 7fad47c8c640 1 -- 172.21.15.92:0/665367159 >> 172.21.15.92:0/665367159 conn(0x7fad400fc7d0 msgr2=0x7fad4006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:46.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.939+0000 7fad47c8c640 1 -- 172.21.15.92:0/665367159 shutdown_connections 2024-09-19T08:59:46.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:46.939+0000 7fad47c8c640 1 -- 172.21.15.92:0/665367159 wait complete. 2024-09-19T08:59:47.671 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:47 smithi092 ceph-mon[31407]: pgmap v429: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 MiB/s wr, 293 op/s 2024-09-19T08:59:47.671 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:47 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/665367159' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:59:47.699 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id 4e84b9cf --release --await' 2024-09-19T08:59:47.700 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id 4e84b9cf --release --await 2024-09-19T08:59:47.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:47 smithi167 ceph-mon[35359]: pgmap v429: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 MiB/s wr, 293 op/s 2024-09-19T08:59:47.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:47 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/665367159' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:59:47.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:47 smithi190 ceph-mon[35358]: pgmap v429: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 MiB/s wr, 293 op/s 2024-09-19T08:59:47.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:47 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/665367159' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:59:47.943 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:59:48.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.376+0000 7f8985a87640 1 -- 172.21.15.92:0/1064985399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89801036e0 msgr2=0x7f8980107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:48.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.376+0000 7f8985a87640 1 --2- 172.21.15.92:0/1064985399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89801036e0 0x7f8980107b90 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f8974009930 tx=0x7f897402a420 comp rx=0 tx=0).stop 2024-09-19T08:59:48.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.376+0000 7f8985a87640 1 -- 172.21.15.92:0/1064985399 shutdown_connections 2024-09-19T08:59:48.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.376+0000 7f8985a87640 1 --2- 172.21.15.92:0/1064985399 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f89801082a0 0x7f898010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:48.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.376+0000 7f8985a87640 1 --2- 172.21.15.92:0/1064985399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89801036e0 0x7f8980107b90 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:48.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.376+0000 7f8985a87640 1 --2- 172.21.15.92:0/1064985399 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8980102d30 0x7f8980103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:48.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.376+0000 7f8985a87640 1 -- 172.21.15.92:0/1064985399 >> 172.21.15.92:0/1064985399 conn(0x7f89800fc7d0 msgr2=0x7f89800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:48.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.376+0000 7f8985a87640 1 -- 172.21.15.92:0/1064985399 shutdown_connections 2024-09-19T08:59:48.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.376+0000 7f8985a87640 1 -- 172.21.15.92:0/1064985399 wait complete. 2024-09-19T08:59:48.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.377+0000 7f8985a87640 1 Processor -- start 2024-09-19T08:59:48.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.377+0000 7f8985a87640 1 -- start start 2024-09-19T08:59:48.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.377+0000 7f8985a87640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8980102d30 0x7f8980198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:48.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.377+0000 7f8985a87640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f89801036e0 0x7f8980198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:48.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.377+0000 7f8985a87640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89801082a0 0x7f898019ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:48.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.377+0000 7f8985a87640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f89801120a0 con 0x7f8980102d30 2024-09-19T08:59:48.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.377+0000 7f8985a87640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8980111f20 con 0x7f89801082a0 2024-09-19T08:59:48.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.377+0000 7f8985a87640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8980112220 con 0x7f89801036e0 2024-09-19T08:59:48.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.377+0000 7f897f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8980102d30 0x7f8980198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:48.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.377+0000 7f897f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8980102d30 0x7f8980198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35836/0 (socket says 172.21.15.92:35836) 2024-09-19T08:59:48.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.377+0000 7f897f7fe640 1 -- 172.21.15.92:0/3745110805 learned_addr learned my addr 172.21.15.92:0/3745110805 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:48.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.377+0000 7f897ffff640 1 --2- 172.21.15.92:0/3745110805 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89801082a0 0x7f898019ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:48.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.377+0000 7f897f7fe640 1 -- 172.21.15.92:0/3745110805 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f89801036e0 msgr2=0x7f8980198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:48.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.377+0000 7f897f7fe640 1 --2- 172.21.15.92:0/3745110805 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f89801036e0 0x7f8980198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:48.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.377+0000 7f897f7fe640 1 -- 172.21.15.92:0/3745110805 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89801082a0 msgr2=0x7f898019ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:48.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.377+0000 7f897f7fe640 1 --2- 172.21.15.92:0/3745110805 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89801082a0 0x7f898019ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:48.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.377+0000 7f897f7fe640 1 -- 172.21.15.92:0/3745110805 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f898019d510 con 0x7f8980102d30 2024-09-19T08:59:48.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.378+0000 7f897f7fe640 1 --2- 172.21.15.92:0/3745110805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8980102d30 0x7f8980198560 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f897000d950 tx=0x7f897000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:48.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.378+0000 7f897cff9640 1 -- 172.21.15.92:0/3745110805 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8970017070 con 0x7f8980102d30 2024-09-19T08:59:48.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.378+0000 7f8985a87640 1 -- 172.21.15.92:0/3745110805 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f898019d800 con 0x7f8980102d30 2024-09-19T08:59:48.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.378+0000 7f897cff9640 1 -- 172.21.15.92:0/3745110805 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8970009c30 con 0x7f8980102d30 2024-09-19T08:59:48.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.378+0000 7f897cff9640 1 -- 172.21.15.92:0/3745110805 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f897000f6b0 con 0x7f8980102d30 2024-09-19T08:59:48.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.378+0000 7f8985a87640 1 -- 172.21.15.92:0/3745110805 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89801a50e0 con 0x7f8980102d30 2024-09-19T08:59:48.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.380+0000 7f897cff9640 1 -- 172.21.15.92:0/3745110805 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f89700109d0 con 0x7f8980102d30 2024-09-19T08:59:48.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.380+0000 7f8987e60740 1 Processor -- start 2024-09-19T08:59:48.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.381+0000 7f8987e60740 1 -- start start 2024-09-19T08:59:48.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.381+0000 7f897cff9640 1 --2- 172.21.15.92:0/3745110805 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f89680a3240 0x7f89680a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:48.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.381+0000 7f897ffff640 1 --2- 172.21.15.92:0/3745110805 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f89680a3240 0x7f89680a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:48.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.381+0000 7f897cff9640 1 -- 172.21.15.92:0/3745110805 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f89700cf5e0 con 0x7f8980102d30 2024-09-19T08:59:48.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.381+0000 7f8987e60740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555daf9c9f20 0x555daf9ca300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:48.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.381+0000 7f8987e60740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555daf9ca840 0x555daf9d9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:48.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.381+0000 7f8987e60740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555daf9d9650 0x555daf9dba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:48.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.381+0000 7f8987e60740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555daf92f620 con 0x555daf9c9f20 2024-09-19T08:59:48.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.381+0000 7f8987e60740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x555daf8d6e50 con 0x555daf9ca840 2024-09-19T08:59:48.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.381+0000 7f8987e60740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x555daf92b5e0 con 0x555daf9d9650 2024-09-19T08:59:48.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.381+0000 7f897f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555daf9c9f20 0x555daf9ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:48.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.381+0000 7f897f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555daf9c9f20 0x555daf9ca300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35852/0 (socket says 172.21.15.92:35852) 2024-09-19T08:59:48.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.381+0000 7f897f7fe640 1 -- 172.21.15.92:0/3349575847 learned_addr learned my addr 172.21.15.92:0/3349575847 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:48.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.381+0000 7f897effd640 1 --2- 172.21.15.92:0/3349575847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555daf9ca840 0x555daf9d9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:48.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.381+0000 7f897ffff640 1 --2- 172.21.15.92:0/3745110805 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f89680a3240 0x7f89680a5700 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8978007e00 tx=0x7f8978007520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:48.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.381+0000 7f897f7fe640 1 -- 172.21.15.92:0/3349575847 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555daf9d9650 msgr2=0x555daf9dba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:48.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.381+0000 7f897f7fe640 1 --2- 172.21.15.92:0/3349575847 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555daf9d9650 0x555daf9dba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:48.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.381+0000 7f897f7fe640 1 -- 172.21.15.92:0/3349575847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555daf9ca840 msgr2=0x555daf9d9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:48.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.381+0000 7f897f7fe640 1 --2- 172.21.15.92:0/3349575847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555daf9ca840 0x555daf9d9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:48.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.381+0000 7f897f7fe640 1 -- 172.21.15.92:0/3349575847 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555daf8c7d40 con 0x555daf9c9f20 2024-09-19T08:59:48.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.381+0000 7f897effd640 1 --2- 172.21.15.92:0/3349575847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555daf9ca840 0x555daf9d9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:59:48.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.381+0000 7f897f7fe640 1 --2- 172.21.15.92:0/3349575847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555daf9c9f20 0x555daf9ca300 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8970098020 tx=0x7f8970010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae2a08d6daaf52fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:48.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.382+0000 7f8965ffb640 1 -- 172.21.15.92:0/3349575847 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8970020040 con 0x555daf9c9f20 2024-09-19T08:59:48.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.382+0000 7f8965ffb640 1 -- 172.21.15.92:0/3349575847 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f897009ff70 con 0x555daf9c9f20 2024-09-19T08:59:48.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.382+0000 7f8965ffb640 1 -- 172.21.15.92:0/3349575847 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8970097910 con 0x555daf9c9f20 2024-09-19T08:59:48.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.382+0000 7f8987e60740 1 -- 172.21.15.92:0/3349575847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555daf9c9f20 msgr2=0x555daf9ca300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:48.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.382+0000 7f8987e60740 1 --2- 172.21.15.92:0/3349575847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555daf9c9f20 0x555daf9ca300 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8970098020 tx=0x7f8970010d70 comp rx=0 tx=0).stop 2024-09-19T08:59:48.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.382+0000 7f8987e60740 1 -- 172.21.15.92:0/3349575847 shutdown_connections 2024-09-19T08:59:48.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.382+0000 7f8987e60740 1 --2- 172.21.15.92:0/3349575847 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555daf9d9650 0x555daf9dba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:48.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.382+0000 7f8987e60740 1 --2- 172.21.15.92:0/3349575847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555daf9ca840 0x555daf9d9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:48.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.382+0000 7f8987e60740 1 --2- 172.21.15.92:0/3349575847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555daf9c9f20 0x555daf9ca300 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:48.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.382+0000 7f8987e60740 1 -- 172.21.15.92:0/3349575847 >> 172.21.15.92:0/3349575847 conn(0x555daf9c65f0 msgr2=0x555daf9c69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:48.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.382+0000 7f8987e60740 1 -- 172.21.15.92:0/3349575847 shutdown_connections 2024-09-19T08:59:48.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.382+0000 7f8987e60740 1 -- 172.21.15.92:0/3349575847 wait complete. 2024-09-19T08:59:48.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.383+0000 7f8987e60740 1 -- start start 2024-09-19T08:59:48.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.383+0000 7f8987e60740 1 Processor -- start 2024-09-19T08:59:48.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.383+0000 7f8987e60740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555daf9c9f20 0x555daf9d6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:48.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.383+0000 7f8987e60740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555daf9ca840 0x555daf9d6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:48.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.383+0000 7f8987e60740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555daf9d9650 0x555daf9d70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:48.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.383+0000 7f8987e60740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555daf9dc160 con 0x555daf9c9f20 2024-09-19T08:59:48.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.383+0000 7f8987e60740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x555daf8b7f10 con 0x555daf9d9650 2024-09-19T08:59:48.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.383+0000 7f8987e60740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x555daf9dc2e0 con 0x555daf9ca840 2024-09-19T08:59:48.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.383+0000 7f8987e60740 10 client.0 _ll_register_callbacks cb 0x555daf8dbdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:48.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.383+0000 7f897f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555daf9c9f20 0x555daf9d6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:48.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.383+0000 7f897f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555daf9c9f20 0x555daf9d6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35864/0 (socket says 172.21.15.92:35864) 2024-09-19T08:59:48.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.383+0000 7f897f7fe640 1 -- 172.21.15.92:0/1717770170 learned_addr learned my addr 172.21.15.92:0/1717770170 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:48.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.384+0000 7f897effd640 1 --2- 172.21.15.92:0/1717770170 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555daf9ca840 0x555daf9d6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:48.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.384+0000 7f897ffff640 1 --2- 172.21.15.92:0/1717770170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555daf9d9650 0x555daf9d70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:48.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.384+0000 7f897f7fe640 1 -- 172.21.15.92:0/1717770170 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555daf9ca840 msgr2=0x555daf9d6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:48.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.384+0000 7f897f7fe640 1 --2- 172.21.15.92:0/1717770170 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555daf9ca840 0x555daf9d6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:48.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.384+0000 7f897f7fe640 1 -- 172.21.15.92:0/1717770170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555daf9d9650 msgr2=0x555daf9d70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:48.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.384+0000 7f897f7fe640 1 --2- 172.21.15.92:0/1717770170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555daf9d9650 0x555daf9d70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:48.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.384+0000 7f897f7fe640 1 -- 172.21.15.92:0/1717770170 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555daf63e580 con 0x555daf9c9f20 2024-09-19T08:59:48.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.384+0000 7f897effd640 1 --2- 172.21.15.92:0/1717770170 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555daf9ca840 0x555daf9d6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:59:48.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.384+0000 7f897ffff640 1 --2- 172.21.15.92:0/1717770170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555daf9d9650 0x555daf9d70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:59:48.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.384+0000 7f897f7fe640 1 --2- 172.21.15.92:0/1717770170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555daf9c9f20 0x555daf9d6640 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8970009610 tx=0x7f897009bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc275f050903d4a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:48.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.384+0000 7f895effd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:59:48.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.384+0000 7f895effd640 1 -- 172.21.15.92:0/1717770170 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8970020050 con 0x555daf9c9f20 2024-09-19T08:59:48.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.384+0000 7f895effd640 1 -- 172.21.15.92:0/1717770170 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8970099ec0 con 0x555daf9c9f20 2024-09-19T08:59:48.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.384+0000 7f8987e60740 1 -- 172.21.15.92:0/1717770170 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f897009ff70 con 0x555daf9c9f20 2024-09-19T08:59:48.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.384+0000 7f895effd640 1 -- 172.21.15.92:0/1717770170 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f897009b0f0 con 0x555daf9c9f20 2024-09-19T08:59:48.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.384+0000 7f8987e60740 10 client.16050 fetch_fsmap learned FSMap version 19 2024-09-19T08:59:48.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.384+0000 7f8987e60740 1 -- 172.21.15.92:0/1717770170 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x555daf708960 con 0x555daf9c9f20 2024-09-19T08:59:48.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.384+0000 7f895effd640 1 -- 172.21.15.92:0/1717770170 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f897009ff70 con 0x555daf9c9f20 2024-09-19T08:59:48.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.385+0000 7f895effd640 1 -- 172.21.15.92:0/1717770170 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f897009aa80 con 0x555daf9c9f20 2024-09-19T08:59:48.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.385+0000 7f8987e60740 10 client.16050 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:59:48.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.385+0000 7f8987e60740 10 client.16050 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T08:59:48.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.385+0000 7f8987e60740 20 client.16050 populate_metadata read hostname 'smithi092' 2024-09-19T08:59:48.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.385+0000 7f8987e60740 1 --2- 172.21.15.92:0/1717770170 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555daf9e90d0 0x555daf9eb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:48.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.385+0000 7f8987e60740 4 client.16050 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:59:48.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.385+0000 7f8987e60740 1 -- 172.21.15.92:0/1717770170 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555daf93cb90 con 0x555daf9e90d0 2024-09-19T08:59:48.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.385+0000 7f897effd640 1 --2- 172.21.15.92:0/1717770170 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555daf9e90d0 0x555daf9eb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:48.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.385+0000 7f895effd640 10 client.16050 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:48.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.385+0000 7f897effd640 1 --2- 172.21.15.92:0/1717770170 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555daf9e90d0 0x555daf9eb4c0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b850a6410c661c0a server_cookie=60a81241f1ee76d2 in_seq=0 out_seq=0 2024-09-19T08:59:48.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.386+0000 7f895effd640 1 -- 172.21.15.92:0/1717770170 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555daf93cb90 con 0x555daf9e90d0 2024-09-19T08:59:48.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.386+0000 7f895effd640 10 client.16050 handle_command_reply: tid=0 2024-09-19T08:59:48.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.386+0000 7f8987e60740 1 client.16050 shutdown 2024-09-19T08:59:48.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.386+0000 7f8987e60740 1 -- 172.21.15.92:0/1717770170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555daf9c9f20 msgr2=0x555daf9d6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:48.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.386+0000 7f8987e60740 1 --2- 172.21.15.92:0/1717770170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555daf9c9f20 0x555daf9d6640 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8970009610 tx=0x7f897009bc80 comp rx=0 tx=0).stop 2024-09-19T08:59:48.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.386+0000 7f8987e60740 1 -- 172.21.15.92:0/1717770170 shutdown_connections 2024-09-19T08:59:48.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.386+0000 7f8987e60740 1 --2- 172.21.15.92:0/1717770170 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555daf9e90d0 0x555daf9eb4c0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:48.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.386+0000 7f895effd640 0 client.16050 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:48.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.386+0000 7f8987e60740 1 --2- 172.21.15.92:0/1717770170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555daf9d9650 0x555daf9d70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:48.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.386+0000 7f8987e60740 1 --2- 172.21.15.92:0/1717770170 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555daf9ca840 0x555daf9d6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:48.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.386+0000 7f8987e60740 1 --2- 172.21.15.92:0/1717770170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555daf9c9f20 0x555daf9d6640 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:48.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.386+0000 7f8987e60740 1 -- 172.21.15.92:0/1717770170 >> 172.21.15.92:0/1717770170 conn(0x555daf9c65f0 msgr2=0x555daf9cc350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:48.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.386+0000 7f8987e60740 1 -- 172.21.15.92:0/1717770170 shutdown_connections 2024-09-19T08:59:48.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.386+0000 7f8987e60740 1 -- 172.21.15.92:0/1717770170 wait complete. 2024-09-19T08:59:48.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.387+0000 7f8987e60740 20 client.16050 trim_cache size 0 max 16384 2024-09-19T08:59:48.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.403+0000 7f8987e60740 1 Processor -- start 2024-09-19T08:59:48.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.403+0000 7f8987e60740 1 -- start start 2024-09-19T08:59:48.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.403+0000 7f8987e60740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555daf9c9f20 0x555daf9d1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:48.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.403+0000 7f8987e60740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555daf9ca840 0x555daf9c5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:48.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.403+0000 7f8987e60740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555daf9d9650 0x555daf9d38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:48.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.403+0000 7f8987e60740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f89801a93f0 con 0x555daf9ca840 2024-09-19T08:59:48.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.403+0000 7f8987e60740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f89801abc90 con 0x555daf9c9f20 2024-09-19T08:59:48.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.403+0000 7f8987e60740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f89801a9a80 con 0x555daf9d9650 2024-09-19T08:59:48.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.403+0000 7f897effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555daf9ca840 0x555daf9c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:48.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.403+0000 7f897effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555daf9ca840 0x555daf9c5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35872/0 (socket says 172.21.15.92:35872) 2024-09-19T08:59:48.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.403+0000 7f897effd640 1 -- 172.21.15.92:0/1010669681 learned_addr learned my addr 172.21.15.92:0/1010669681 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:48.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.403+0000 7f897effd640 1 -- 172.21.15.92:0/1010669681 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555daf9d9650 msgr2=0x555daf9d38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:48.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.403+0000 7f897effd640 1 --2- 172.21.15.92:0/1010669681 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555daf9d9650 0x555daf9d38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:48.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.403+0000 7f897effd640 1 -- 172.21.15.92:0/1010669681 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555daf9c9f20 msgr2=0x555daf9d1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:48.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.403+0000 7f897effd640 1 --2- 172.21.15.92:0/1010669681 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555daf9c9f20 0x555daf9d1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:48.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.403+0000 7f897effd640 1 -- 172.21.15.92:0/1010669681 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555daf9e4c50 con 0x555daf9ca840 2024-09-19T08:59:48.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.404+0000 7f897effd640 1 --2- 172.21.15.92:0/1010669681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555daf9ca840 0x555daf9c5640 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8974009900 tx=0x7f8974004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6922b18324e0554 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:48.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.404+0000 7f89657fa640 1 -- 172.21.15.92:0/1010669681 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8974035040 con 0x555daf9ca840 2024-09-19T08:59:48.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.404+0000 7f89657fa640 1 -- 172.21.15.92:0/1010669681 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8974004450 con 0x555daf9ca840 2024-09-19T08:59:48.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.404+0000 7f89657fa640 1 -- 172.21.15.92:0/1010669681 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8974004cd0 con 0x555daf9ca840 2024-09-19T08:59:48.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.404+0000 7f8987e60740 1 -- 172.21.15.92:0/1010669681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555daf9ca840 msgr2=0x555daf9c5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:48.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.404+0000 7f8987e60740 1 --2- 172.21.15.92:0/1010669681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555daf9ca840 0x555daf9c5640 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8974009900 tx=0x7f8974004360 comp rx=0 tx=0).stop 2024-09-19T08:59:48.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.404+0000 7f8987e60740 1 -- 172.21.15.92:0/1010669681 shutdown_connections 2024-09-19T08:59:48.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.404+0000 7f8987e60740 1 --2- 172.21.15.92:0/1010669681 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555daf9d9650 0x555daf9d38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:48.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.404+0000 7f8987e60740 1 --2- 172.21.15.92:0/1010669681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555daf9ca840 0x555daf9c5640 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:48.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.404+0000 7f8987e60740 1 --2- 172.21.15.92:0/1010669681 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555daf9c9f20 0x555daf9d1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:48.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.404+0000 7f8987e60740 1 -- 172.21.15.92:0/1010669681 >> 172.21.15.92:0/1010669681 conn(0x555daf9c65f0 msgr2=0x555daf9c4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:48.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.404+0000 7f8987e60740 1 -- 172.21.15.92:0/1010669681 shutdown_connections 2024-09-19T08:59:48.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.404+0000 7f8987e60740 1 -- 172.21.15.92:0/1010669681 wait complete. 2024-09-19T08:59:48.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.405+0000 7f8987e60740 1 -- start start 2024-09-19T08:59:48.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.405+0000 7f8987e60740 1 Processor -- start 2024-09-19T08:59:48.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.405+0000 7f8987e60740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555daf9c9f20 0x555daf9ec9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:48.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.405+0000 7f8987e60740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555daf9ca840 0x555daf9ecf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:48.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.405+0000 7f8987e60740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555daf9d9650 0x555dafa52a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:48.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.405+0000 7f8987e60740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f89801aa150 con 0x555daf9d9650 2024-09-19T08:59:48.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.405+0000 7f8987e60740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f89801ab5c0 con 0x555daf9c9f20 2024-09-19T08:59:48.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.405+0000 7f8987e60740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f89801aa820 con 0x555daf9ca840 2024-09-19T08:59:48.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.405+0000 7f8987e60740 10 client.0 _ll_register_callbacks cb 0x7f897009c3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:48.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.405+0000 7f897ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555daf9d9650 0x555dafa52a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:48.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.405+0000 7f897ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555daf9d9650 0x555dafa52a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35878/0 (socket says 172.21.15.92:35878) 2024-09-19T08:59:48.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.405+0000 7f897ffff640 1 -- 172.21.15.92:0/406198966 learned_addr learned my addr 172.21.15.92:0/406198966 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:48.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.406+0000 7f897f7fe640 1 --2- 172.21.15.92:0/406198966 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555daf9c9f20 0x555daf9ec9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:48.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.406+0000 7f897effd640 1 --2- 172.21.15.92:0/406198966 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555daf9ca840 0x555daf9ecf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:48.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.406+0000 7f897ffff640 1 -- 172.21.15.92:0/406198966 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555daf9ca840 msgr2=0x555daf9ecf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:48.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.406+0000 7f897ffff640 1 --2- 172.21.15.92:0/406198966 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555daf9ca840 0x555daf9ecf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:48.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.406+0000 7f897ffff640 1 -- 172.21.15.92:0/406198966 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555daf9c9f20 msgr2=0x555daf9ec9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:48.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.406+0000 7f897ffff640 1 --2- 172.21.15.92:0/406198966 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555daf9c9f20 0x555daf9ec9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:48.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.406+0000 7f897ffff640 1 -- 172.21.15.92:0/406198966 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555dafa52f50 con 0x555daf9d9650 2024-09-19T08:59:48.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.406+0000 7f897effd640 1 --2- 172.21.15.92:0/406198966 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555daf9ca840 0x555daf9ecf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:59:48.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.406+0000 7f897ffff640 1 --2- 172.21.15.92:0/406198966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555daf9d9650 0x555dafa52a10 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8978010de0 tx=0x7f897801d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26daa3d89d0bd13c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:48.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.406+0000 7f895effd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:59:48.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.406+0000 7f895effd640 1 -- 172.21.15.92:0/406198966 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8978027430 con 0x555daf9d9650 2024-09-19T08:59:48.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.406+0000 7f895effd640 1 -- 172.21.15.92:0/406198966 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f897801e430 con 0x555daf9d9650 2024-09-19T08:59:48.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.406+0000 7f8987e60740 1 -- 172.21.15.92:0/406198966 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8974004450 con 0x555daf9d9650 2024-09-19T08:59:48.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.406+0000 7f895effd640 1 -- 172.21.15.92:0/406198966 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f897801e630 con 0x555daf9d9650 2024-09-19T08:59:48.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.406+0000 7f8987e60740 10 client.16056 fetch_fsmap learned FSMap version 19 2024-09-19T08:59:48.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.406+0000 7f8987e60740 1 -- 172.21.15.92:0/406198966 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x555dafa542c0 con 0x555daf9d9650 2024-09-19T08:59:48.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.406+0000 7f895effd640 1 -- 172.21.15.92:0/406198966 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8974004450 con 0x555daf9d9650 2024-09-19T08:59:48.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.407+0000 7f895effd640 1 -- 172.21.15.92:0/406198966 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f8978027a30 con 0x555daf9d9650 2024-09-19T08:59:48.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.407+0000 7f8987e60740 10 client.16056 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:59:48.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.407+0000 7f8987e60740 10 client.16056 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T08:59:48.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.407+0000 7f8987e60740 20 client.16056 populate_metadata read hostname 'smithi092' 2024-09-19T08:59:48.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.407+0000 7f8987e60740 1 --2- 172.21.15.92:0/406198966 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555daf9e90d0 0x555dafa56a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:48.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.407+0000 7f8987e60740 4 client.16056 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "4e84b9cf", "release": true, "await": true}] 2024-09-19T08:59:48.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.407+0000 7f8987e60740 1 -- 172.21.15.92:0/406198966 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "quiesce db", "set_id": "4e84b9cf", "release": true, "await": true}) -- 0x555daf9370a0 con 0x555daf9e90d0 2024-09-19T08:59:48.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.407+0000 7f897f7fe640 1 --2- 172.21.15.92:0/406198966 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555daf9e90d0 0x555dafa56a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:48.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.407+0000 7f897f7fe640 1 --2- 172.21.15.92:0/406198966 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555daf9e90d0 0x555dafa56a20 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ced4203fd5d57725 server_cookie=b261ec222c266bfe in_seq=0 out_seq=0 2024-09-19T08:59:48.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.407+0000 7f895effd640 10 client.16056 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:48.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.473+0000 7f895effd640 1 -- 172.21.15.92:0/406198966 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x555daf9370a0 con 0x555daf9e90d0 2024-09-19T08:59:48.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.473+0000 7f895effd640 10 client.16056 handle_command_reply: tid=0 2024-09-19T08:59:48.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.473+0000 7f8987e60740 1 client.16056 shutdown 2024-09-19T08:59:48.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.473+0000 7f8987e60740 1 -- 172.21.15.92:0/406198966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555daf9d9650 msgr2=0x555dafa52a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:48.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.473+0000 7f8987e60740 1 --2- 172.21.15.92:0/406198966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555daf9d9650 0x555dafa52a10 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8978010de0 tx=0x7f897801d790 comp rx=0 tx=0).stop 2024-09-19T08:59:48.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.473+0000 7f8987e60740 1 -- 172.21.15.92:0/406198966 shutdown_connections 2024-09-19T08:59:48.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.473+0000 7f8987e60740 1 --2- 172.21.15.92:0/406198966 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555daf9e90d0 0x555dafa56a20 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:48.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.473+0000 7f8987e60740 1 --2- 172.21.15.92:0/406198966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555daf9d9650 0x555dafa52a10 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:48.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.473+0000 7f8987e60740 1 --2- 172.21.15.92:0/406198966 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555daf9ca840 0x555daf9ecf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:48.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.473+0000 7f895effd640 0 client.16056 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:48.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.473+0000 7f8987e60740 1 --2- 172.21.15.92:0/406198966 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555daf9c9f20 0x555daf9ec9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:48.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.474+0000 7f8987e60740 1 -- 172.21.15.92:0/406198966 >> 172.21.15.92:0/406198966 conn(0x555daf9c65f0 msgr2=0x555daf9c5750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:48.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.474+0000 7f8987e60740 1 -- 172.21.15.92:0/406198966 shutdown_connections 2024-09-19T08:59:48.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.474+0000 7f8987e60740 1 -- 172.21.15.92:0/406198966 wait complete. 2024-09-19T08:59:48.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.474+0000 7f8987e60740 20 client.16056 trim_cache size 0 max 16384 2024-09-19T08:59:48.476 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T08:59:48.476 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 19, 2024-09-19T08:59:48.476 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24472, 2024-09-19T08:59:48.476 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 16, 2024-09-19T08:59:48.476 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-09-19T08:59:48.476 INFO:teuthology.orchestra.run.smithi092.stdout: "4e84b9cf": { 2024-09-19T08:59:48.477 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 16, 2024-09-19T08:59:48.477 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-09-19T08:59:48.477 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T08:59:48.477 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-09-19T08:59:48.477 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T08:59:48.477 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T08:59:48.477 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 90.0, 2024-09-19T08:59:48.477 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 136.6, 2024-09-19T08:59:48.477 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-09-19T08:59:48.477 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-09-19T08:59:48.477 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-09-19T08:59:48.477 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T08:59:48.477 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-09-19T08:59:48.478 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T08:59:48.478 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:59:48.478 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:59:48.478 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:59:48.478 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:59:48.478 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T08:59:48.478 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T08:59:48.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.476+0000 7f8985a87640 1 -- 172.21.15.92:0/3745110805 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f89680a3240 msgr2=0x7f89680a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:48.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.476+0000 7f8985a87640 1 --2- 172.21.15.92:0/3745110805 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f89680a3240 0x7f89680a5700 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8978007e00 tx=0x7f8978007520 comp rx=0 tx=0).stop 2024-09-19T08:59:48.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.476+0000 7f8985a87640 1 -- 172.21.15.92:0/3745110805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8980102d30 msgr2=0x7f8980198560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:48.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.476+0000 7f8985a87640 1 --2- 172.21.15.92:0/3745110805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8980102d30 0x7f8980198560 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f897000d950 tx=0x7f897000de10 comp rx=0 tx=0).stop 2024-09-19T08:59:48.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.480+0000 7f8985a87640 1 -- 172.21.15.92:0/3745110805 shutdown_connections 2024-09-19T08:59:48.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.480+0000 7f8985a87640 1 --2- 172.21.15.92:0/3745110805 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89801082a0 0x7f898019ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:48.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.480+0000 7f8985a87640 1 --2- 172.21.15.92:0/3745110805 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f89801036e0 0x7f8980198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:48.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.480+0000 7f8985a87640 1 --2- 172.21.15.92:0/3745110805 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f89680a3240 0x7f89680a5700 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:48.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.480+0000 7f8985a87640 1 --2- 172.21.15.92:0/3745110805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8980102d30 0x7f8980198560 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:48.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.480+0000 7f8985a87640 1 -- 172.21.15.92:0/3745110805 >> 172.21.15.92:0/3745110805 conn(0x7f89800fc7d0 msgr2=0x7f8980105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:48.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.484+0000 7f8985a87640 1 -- 172.21.15.92:0/3745110805 shutdown_connections 2024-09-19T08:59:48.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:48.484+0000 7f8985a87640 1 -- 172.21.15.92:0/3745110805 wait complete. 2024-09-19T08:59:49.223 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '4e84b9cf', total seconds elapsed: 19.9 2024-09-19T08:59:49.499 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:59:49.502 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:49 smithi092 ceph-mon[31407]: pgmap v430: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 851 KiB/s wr, 92 op/s 2024-09-19T08:59:49.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.577+0000 7fee667fc640 1 -- 172.21.15.92:0/1944739559 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee60036070 con 0x7fee68109d40 2024-09-19T08:59:49.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.578+0000 7fee6dbb7640 1 -- 172.21.15.92:0/1944739559 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee68109d40 msgr2=0x7fee681105d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:49.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.578+0000 7fee6dbb7640 1 --2- 172.21.15.92:0/1944739559 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee68109d40 0x7fee681105d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fee60009be0 tx=0x7fee6002a6e0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.578+0000 7fee6dbb7640 1 -- 172.21.15.92:0/1944739559 shutdown_connections 2024-09-19T08:59:49.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.578+0000 7fee6dbb7640 1 --2- 172.21.15.92:0/1944739559 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee68109d40 0x7fee681105d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.578+0000 7fee6dbb7640 1 --2- 172.21.15.92:0/1944739559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee68109380 0x7fee68109800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.578+0000 7fee6dbb7640 1 --2- 172.21.15.92:0/1944739559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee68108470 0x7fee68108870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.578+0000 7fee6dbb7640 1 -- 172.21.15.92:0/1944739559 >> 172.21.15.92:0/1944739559 conn(0x7fee68077470 msgr2=0x7fee680798b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:49.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.579+0000 7fee6dbb7640 1 -- 172.21.15.92:0/1944739559 shutdown_connections 2024-09-19T08:59:49.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.579+0000 7fee6dbb7640 1 -- 172.21.15.92:0/1944739559 wait complete. 2024-09-19T08:59:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.580+0000 7fee6dbb7640 1 Processor -- start 2024-09-19T08:59:49.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.580+0000 7fee6dbb7640 1 -- start start 2024-09-19T08:59:49.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.581+0000 7fee6dbb7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee68108470 0x7fee680719e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:49.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.581+0000 7fee6dbb7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee68109380 0x7fee68071f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:49.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.581+0000 7fee6dbb7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee68109d40 0x7fee68072f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:49.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.581+0000 7fee6dbb7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fee6806c220 con 0x7fee68108470 2024-09-19T08:59:49.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.581+0000 7fee6dbb7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fee6806c0a0 con 0x7fee68109d40 2024-09-19T08:59:49.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.581+0000 7fee6dbb7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fee6806c3a0 con 0x7fee68109380 2024-09-19T08:59:49.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.581+0000 7fee67fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee68109d40 0x7fee68072f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:49.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.581+0000 7fee67fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee68109d40 0x7fee68072f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:58392/0 (socket says 172.21.15.92:58392) 2024-09-19T08:59:49.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.581+0000 7fee67fff640 1 -- 172.21.15.92:0/3333777642 learned_addr learned my addr 172.21.15.92:0/3333777642 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:49.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.581+0000 7fee66ffd640 1 --2- 172.21.15.92:0/3333777642 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee68109380 0x7fee68071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:49.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.581+0000 7fee677fe640 1 --2- 172.21.15.92:0/3333777642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee68108470 0x7fee680719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:49.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.581+0000 7fee677fe640 1 -- 172.21.15.92:0/3333777642 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee68109380 msgr2=0x7fee68071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:49.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.581+0000 7fee677fe640 1 --2- 172.21.15.92:0/3333777642 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee68109380 0x7fee68071f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.581+0000 7fee677fe640 1 -- 172.21.15.92:0/3333777642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee68109d40 msgr2=0x7fee68072f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:49.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.581+0000 7fee677fe640 1 --2- 172.21.15.92:0/3333777642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee68109d40 0x7fee68072f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.581+0000 7fee677fe640 1 -- 172.21.15.92:0/3333777642 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee680735d0 con 0x7fee68108470 2024-09-19T08:59:49.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.581+0000 7fee66ffd640 1 --2- 172.21.15.92:0/3333777642 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee68109380 0x7fee68071f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:49.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.582+0000 7fee677fe640 1 --2- 172.21.15.92:0/3333777642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee68108470 0x7fee680719e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fee5800d6d0 tx=0x7fee5800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:49.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.582+0000 7fee64ff9640 1 -- 172.21.15.92:0/3333777642 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee58017070 con 0x7fee68108470 2024-09-19T08:59:49.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.582+0000 7fee64ff9640 1 -- 172.21.15.92:0/3333777642 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee58010460 con 0x7fee68108470 2024-09-19T08:59:49.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.582+0000 7fee6dbb7640 1 -- 172.21.15.92:0/3333777642 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee680738c0 con 0x7fee68108470 2024-09-19T08:59:49.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.582+0000 7fee6dbb7640 1 -- 172.21.15.92:0/3333777642 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee68073e10 con 0x7fee68108470 2024-09-19T08:59:49.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.582+0000 7fee64ff9640 1 -- 172.21.15.92:0/3333777642 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5800f620 con 0x7fee68108470 2024-09-19T08:59:49.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.586+0000 7fee70a2d740 1 Processor -- start 2024-09-19T08:59:49.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.586+0000 7fee70a2d740 1 -- start start 2024-09-19T08:59:49.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.586+0000 7fee70a2d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bba82f9a0 0x555bba82fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:49.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.586+0000 7fee70a2d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bba8302e0 0x555bba834da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:49.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.586+0000 7fee70a2d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bba835370 0x555bba837830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:49.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.586+0000 7fee70a2d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555bba7932f0 con 0x555bba835370 2024-09-19T08:59:49.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.586+0000 7fee70a2d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x555bba73b270 con 0x555bba8302e0 2024-09-19T08:59:49.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.586+0000 7fee70a2d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x555bba78f2b0 con 0x555bba82f9a0 2024-09-19T08:59:49.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.587+0000 7fee67fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bba82f9a0 0x555bba82fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:49.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.588+0000 7fee66ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bba835370 0x555bba837830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:49.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.588+0000 7fee66ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bba835370 0x555bba837830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35916/0 (socket says 172.21.15.92:35916) 2024-09-19T08:59:49.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.588+0000 7fee66ffd640 1 -- 172.21.15.92:0/2290846279 learned_addr learned my addr 172.21.15.92:0/2290846279 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:49.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.588+0000 7fee66ffd640 1 -- 172.21.15.92:0/2290846279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bba82f9a0 msgr2=0x555bba82fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:49.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.587+0000 7fee67fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bba82f9a0 0x555bba82fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:37826/0 (socket says 172.21.15.92:37826) 2024-09-19T08:59:49.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.588+0000 7fee66ffd640 1 --2- 172.21.15.92:0/2290846279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bba82f9a0 0x555bba82fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.588+0000 7fee66ffd640 1 -- 172.21.15.92:0/2290846279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bba8302e0 msgr2=0x555bba834da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T08:59:49.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.588+0000 7fee66ffd640 1 --2- 172.21.15.92:0/2290846279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bba8302e0 0x555bba834da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.588+0000 7fee66ffd640 1 -- 172.21.15.92:0/2290846279 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bba73a340 con 0x555bba835370 2024-09-19T08:59:49.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.588+0000 7fee67fff640 1 --2- 172.21.15.92:0/2290846279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bba82f9a0 0x555bba82fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-19T08:59:49.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.589+0000 7fee66ffd640 1 --2- 172.21.15.92:0/2290846279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bba835370 0x555bba837830 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0114f0 tx=0x7fee5c0119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7640ef466937ff6c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:49.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.589+0000 7fee4dffb640 1 -- 172.21.15.92:0/2290846279 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c01e070 con 0x555bba835370 2024-09-19T08:59:49.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.589+0000 7fee4dffb640 1 -- 172.21.15.92:0/2290846279 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee5c0035f0 con 0x555bba835370 2024-09-19T08:59:49.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.589+0000 7fee4dffb640 1 -- 172.21.15.92:0/2290846279 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c00f880 con 0x555bba835370 2024-09-19T08:59:49.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.589+0000 7fee64ff9640 1 -- 172.21.15.92:0/3333777642 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fee5801a070 con 0x7fee68108470 2024-09-19T08:59:49.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.592+0000 7fee70a2d740 1 -- 172.21.15.92:0/2290846279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bba835370 msgr2=0x555bba837830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:49.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.592+0000 7fee70a2d740 1 --2- 172.21.15.92:0/2290846279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bba835370 0x555bba837830 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0114f0 tx=0x7fee5c0119b0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.592+0000 7fee64ff9640 1 --2- 172.21.15.92:0/3333777642 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fee500a3460 0x7fee500a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:49.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.593+0000 7fee64ff9640 1 -- 172.21.15.92:0/3333777642 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fee580cee60 con 0x7fee68108470 2024-09-19T08:59:49.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.593+0000 7fee67fff640 1 --2- 172.21.15.92:0/3333777642 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fee500a3460 0x7fee500a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:49.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.593+0000 7fee70a2d740 1 -- 172.21.15.92:0/2290846279 shutdown_connections 2024-09-19T08:59:49.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.593+0000 7fee70a2d740 1 --2- 172.21.15.92:0/2290846279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bba835370 0x555bba837830 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.593+0000 7fee70a2d740 1 --2- 172.21.15.92:0/2290846279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bba8302e0 0x555bba834da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.593+0000 7fee70a2d740 1 --2- 172.21.15.92:0/2290846279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bba82f9a0 0x555bba82fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.593+0000 7fee70a2d740 1 -- 172.21.15.92:0/2290846279 >> 172.21.15.92:0/2290846279 conn(0x555bba82b010 msgr2=0x555bba82b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:49.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.593+0000 7fee70a2d740 1 -- 172.21.15.92:0/2290846279 shutdown_connections 2024-09-19T08:59:49.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.594+0000 7fee70a2d740 1 -- 172.21.15.92:0/2290846279 wait complete. 2024-09-19T08:59:49.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.594+0000 7fee67fff640 1 --2- 172.21.15.92:0/3333777642 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fee500a3460 0x7fee500a5920 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fee60004af0 tx=0x7fee60004a80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:49.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.594+0000 7fee70a2d740 1 -- start start 2024-09-19T08:59:49.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.595+0000 7fee70a2d740 1 Processor -- start 2024-09-19T08:59:49.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.595+0000 7fee70a2d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bba82f9a0 0x555bba84ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:49.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.595+0000 7fee70a2d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bba8302e0 0x555bba84b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:49.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.595+0000 7fee70a2d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bba835370 0x555bba852210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:49.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.595+0000 7fee70a2d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555bba849350 con 0x555bba835370 2024-09-19T08:59:49.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.595+0000 7fee70a2d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x555bba71c290 con 0x555bba8302e0 2024-09-19T08:59:49.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.595+0000 7fee66ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bba8302e0 0x555bba84b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:49.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.595+0000 7fee66ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bba8302e0 0x555bba84b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:58408/0 (socket says 172.21.15.92:58408) 2024-09-19T08:59:49.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.595+0000 7fee66ffd640 1 -- 172.21.15.92:0/3170270024 learned_addr learned my addr 172.21.15.92:0/3170270024 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.595+0000 7fee70a2d740 1 -- 172.21.15.92:0/3170270024 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x555bba8494d0 con 0x555bba82f9a0 2024-09-19T08:59:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.595+0000 7fee70a2d740 10 client.0 _ll_register_callbacks cb 0x555bba74d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.596+0000 7fee67fff640 1 --2- 172.21.15.92:0/3170270024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bba835370 0x555bba852210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.596+0000 7fee677fe640 1 --2- 172.21.15.92:0/3170270024 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bba82f9a0 0x555bba84ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.596+0000 7fee66ffd640 1 -- 172.21.15.92:0/3170270024 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bba82f9a0 msgr2=0x555bba84ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.596+0000 7fee66ffd640 1 --2- 172.21.15.92:0/3170270024 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bba82f9a0 0x555bba84ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.596+0000 7fee66ffd640 1 -- 172.21.15.92:0/3170270024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bba835370 msgr2=0x555bba852210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.596+0000 7fee66ffd640 1 --2- 172.21.15.92:0/3170270024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bba835370 0x555bba852210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.596+0000 7fee66ffd640 1 -- 172.21.15.92:0/3170270024 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bba4a6210 con 0x555bba8302e0 2024-09-19T08:59:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.596+0000 7fee66ffd640 1 --2- 172.21.15.92:0/3170270024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bba8302e0 0x555bba84b1d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0114c0 tx=0x7fee5c0039d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e019a483e69c9084 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.596+0000 7fee46ffd640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T08:59:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.597+0000 7fee46ffd640 1 -- 172.21.15.92:0/3170270024 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c01e040 con 0x555bba8302e0 2024-09-19T08:59:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.597+0000 7fee46ffd640 1 -- 172.21.15.92:0/3170270024 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fee5c003bc0 con 0x555bba8302e0 2024-09-19T08:59:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.597+0000 7fee70a2d740 1 -- 172.21.15.92:0/3170270024 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee5c0035f0 con 0x555bba8302e0 2024-09-19T08:59:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.597+0000 7fee46ffd640 1 -- 172.21.15.92:0/3170270024 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fee5c005040 con 0x555bba8302e0 2024-09-19T08:59:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.598+0000 7fee70a2d740 10 client.25502 fetch_fsmap learned FSMap version 19 2024-09-19T08:59:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.598+0000 7fee70a2d740 1 -- 172.21.15.92:0/3170270024 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x555bba572620 con 0x555bba8302e0 2024-09-19T08:59:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.599+0000 7fee46ffd640 1 -- 172.21.15.92:0/3170270024 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee5c0035f0 con 0x555bba8302e0 2024-09-19T08:59:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.599+0000 7fee46ffd640 1 -- 172.21.15.92:0/3170270024 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fee5c021070 con 0x555bba8302e0 2024-09-19T08:59:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.599+0000 7fee70a2d740 10 client.25502 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:59:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.599+0000 7fee70a2d740 10 client.25502 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T08:59:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.599+0000 7fee70a2d740 20 client.25502 populate_metadata read hostname 'smithi092' 2024-09-19T08:59:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.599+0000 7fee70a2d740 1 --2- 172.21.15.92:0/3170270024 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555bba856c30 0x555bba859050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.599+0000 7fee70a2d740 4 client.25502 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:59:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.599+0000 7fee70a2d740 1 -- 172.21.15.92:0/3170270024 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555bba7a0a20 con 0x555bba856c30 2024-09-19T08:59:49.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.599+0000 7fee677fe640 1 --2- 172.21.15.92:0/3170270024 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555bba856c30 0x555bba859050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:49.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.600+0000 7fee677fe640 1 --2- 172.21.15.92:0/3170270024 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555bba856c30 0x555bba859050 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94f4c9e352142a99 server_cookie=5cbeaa03e01e96e3 in_seq=0 out_seq=0 2024-09-19T08:59:49.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.600+0000 7fee46ffd640 10 client.25502 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.601+0000 7fee46ffd640 1 -- 172.21.15.92:0/3170270024 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555bba7a0a20 con 0x555bba856c30 2024-09-19T08:59:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.601+0000 7fee46ffd640 10 client.25502 handle_command_reply: tid=0 2024-09-19T08:59:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.601+0000 7fee70a2d740 1 client.25502 shutdown 2024-09-19T08:59:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.601+0000 7fee70a2d740 1 -- 172.21.15.92:0/3170270024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bba8302e0 msgr2=0x555bba84b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.601+0000 7fee70a2d740 1 --2- 172.21.15.92:0/3170270024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bba8302e0 0x555bba84b1d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0114c0 tx=0x7fee5c0039d0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.601+0000 7fee70a2d740 1 -- 172.21.15.92:0/3170270024 shutdown_connections 2024-09-19T08:59:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.601+0000 7fee70a2d740 1 --2- 172.21.15.92:0/3170270024 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555bba856c30 0x555bba859050 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.601+0000 7fee70a2d740 1 --2- 172.21.15.92:0/3170270024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bba835370 0x555bba852210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.603 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.601+0000 7fee70a2d740 1 --2- 172.21.15.92:0/3170270024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bba8302e0 0x555bba84b1d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.603 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.601+0000 7fee70a2d740 1 --2- 172.21.15.92:0/3170270024 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bba82f9a0 0x555bba84ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.603 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.601+0000 7fee70a2d740 1 -- 172.21.15.92:0/3170270024 >> 172.21.15.92:0/3170270024 conn(0x555bba82b010 msgr2=0x555bba82c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:49.603 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.601+0000 7fee46ffd640 0 client.25502 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:49.603 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.601+0000 7fee70a2d740 1 -- 172.21.15.92:0/3170270024 shutdown_connections 2024-09-19T08:59:49.603 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.602+0000 7fee70a2d740 1 -- 172.21.15.92:0/3170270024 wait complete. 2024-09-19T08:59:49.603 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.602+0000 7fee70a2d740 20 client.25502 trim_cache size 0 max 16384 2024-09-19T08:59:49.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.627+0000 7fee70a2d740 1 Processor -- start 2024-09-19T08:59:49.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.627+0000 7fee70a2d740 1 -- start start 2024-09-19T08:59:49.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.627+0000 7fee70a2d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bba82f9a0 0x555bba849e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:49.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.627+0000 7fee70a2d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bba8302e0 0x555bba84a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:49.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.627+0000 7fee70a2d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bba835370 0x555bba8521d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:49.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.627+0000 7fee70a2d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fee5400c480 con 0x555bba82f9a0 2024-09-19T08:59:49.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.628+0000 7fee70a2d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fee5400ed20 con 0x555bba8302e0 2024-09-19T08:59:49.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.628+0000 7fee70a2d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fee5400cb10 con 0x555bba835370 2024-09-19T08:59:49.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.628+0000 7fee677fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bba82f9a0 0x555bba849e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:49.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.628+0000 7fee677fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bba82f9a0 0x555bba849e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35924/0 (socket says 172.21.15.92:35924) 2024-09-19T08:59:49.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.628+0000 7fee66ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bba8302e0 0x555bba84a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:49.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.628+0000 7fee677fe640 1 -- 172.21.15.92:0/3319113914 learned_addr learned my addr 172.21.15.92:0/3319113914 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:49.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.628+0000 7fee67fff640 1 --2- 172.21.15.92:0/3319113914 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bba835370 0x555bba8521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:49.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.628+0000 7fee677fe640 1 -- 172.21.15.92:0/3319113914 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bba835370 msgr2=0x555bba8521d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:49.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.628+0000 7fee677fe640 1 --2- 172.21.15.92:0/3319113914 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bba835370 0x555bba8521d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.628+0000 7fee677fe640 1 -- 172.21.15.92:0/3319113914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bba8302e0 msgr2=0x555bba84a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:49.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.628+0000 7fee677fe640 1 --2- 172.21.15.92:0/3319113914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bba8302e0 0x555bba84a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.628+0000 7fee677fe640 1 -- 172.21.15.92:0/3319113914 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bba8347e0 con 0x555bba82f9a0 2024-09-19T08:59:49.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.628+0000 7fee66ffd640 1 --2- 172.21.15.92:0/3319113914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bba8302e0 0x555bba84a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:49.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.628+0000 7fee677fe640 1 --2- 172.21.15.92:0/3319113914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bba82f9a0 0x555bba849e70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fee58010f30 tx=0x7fee580108f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40bb7369a23fa1fe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:49.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.629+0000 7fee4d7fa640 1 -- 172.21.15.92:0/3319113914 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee58021040 con 0x555bba82f9a0 2024-09-19T08:59:49.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.629+0000 7fee4d7fa640 1 -- 172.21.15.92:0/3319113914 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee580cca70 con 0x555bba82f9a0 2024-09-19T08:59:49.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.629+0000 7fee4d7fa640 1 -- 172.21.15.92:0/3319113914 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee580b4270 con 0x555bba82f9a0 2024-09-19T08:59:49.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.630+0000 7fee70a2d740 1 -- 172.21.15.92:0/3319113914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bba82f9a0 msgr2=0x555bba849e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:49.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.630+0000 7fee70a2d740 1 --2- 172.21.15.92:0/3319113914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bba82f9a0 0x555bba849e70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fee58010f30 tx=0x7fee580108f0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.630+0000 7fee70a2d740 1 -- 172.21.15.92:0/3319113914 shutdown_connections 2024-09-19T08:59:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.630+0000 7fee70a2d740 1 --2- 172.21.15.92:0/3319113914 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bba835370 0x555bba8521d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.630+0000 7fee70a2d740 1 --2- 172.21.15.92:0/3319113914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bba8302e0 0x555bba84a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.630+0000 7fee70a2d740 1 --2- 172.21.15.92:0/3319113914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bba82f9a0 0x555bba849e70 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.630+0000 7fee70a2d740 1 -- 172.21.15.92:0/3319113914 >> 172.21.15.92:0/3319113914 conn(0x555bba82b010 msgr2=0x555bba831520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.630+0000 7fee70a2d740 1 -- 172.21.15.92:0/3319113914 shutdown_connections 2024-09-19T08:59:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.630+0000 7fee70a2d740 1 -- 172.21.15.92:0/3319113914 wait complete. 2024-09-19T08:59:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.630+0000 7fee70a2d740 1 -- start start 2024-09-19T08:59:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.630+0000 7fee70a2d740 1 Processor -- start 2024-09-19T08:59:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.631+0000 7fee70a2d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bba82f9a0 0x555bba84ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.631+0000 7fee70a2d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bba8302e0 0x555bba84f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.631+0000 7fee70a2d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bba835370 0x555bba8bf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.631+0000 7fee70a2d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fee5400d1e0 con 0x555bba82f9a0 2024-09-19T08:59:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.631+0000 7fee70a2d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fee5400e650 con 0x555bba8302e0 2024-09-19T08:59:49.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.631+0000 7fee70a2d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fee5400d8b0 con 0x555bba835370 2024-09-19T08:59:49.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.631+0000 7fee66ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bba8302e0 0x555bba84f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:49.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.631+0000 7fee70a2d740 10 client.0 _ll_register_callbacks cb 0x7fee5c01c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:49.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.631+0000 7fee66ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bba8302e0 0x555bba84f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:58430/0 (socket says 172.21.15.92:58430) 2024-09-19T08:59:49.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.631+0000 7fee66ffd640 1 -- 172.21.15.92:0/3493018849 learned_addr learned my addr 172.21.15.92:0/3493018849 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:49.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.631+0000 7fee67fff640 1 --2- 172.21.15.92:0/3493018849 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bba835370 0x555bba8bf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:49.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.631+0000 7fee677fe640 1 --2- 172.21.15.92:0/3493018849 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bba82f9a0 0x555bba84ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:49.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.631+0000 7fee66ffd640 1 -- 172.21.15.92:0/3493018849 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bba835370 msgr2=0x555bba8bf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:49.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.631+0000 7fee66ffd640 1 --2- 172.21.15.92:0/3493018849 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bba835370 0x555bba8bf920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.631+0000 7fee66ffd640 1 -- 172.21.15.92:0/3493018849 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bba82f9a0 msgr2=0x555bba84ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:49.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.632+0000 7fee66ffd640 1 --2- 172.21.15.92:0/3493018849 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bba82f9a0 0x555bba84ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.632+0000 7fee66ffd640 1 -- 172.21.15.92:0/3493018849 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bba852450 con 0x555bba8302e0 2024-09-19T08:59:49.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.632+0000 7fee677fe640 1 --2- 172.21.15.92:0/3493018849 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bba82f9a0 0x555bba84ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:59:49.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.632+0000 7fee66ffd640 1 --2- 172.21.15.92:0/3493018849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bba8302e0 0x555bba84f360 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0114f0 tx=0x7fee5c009d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9594cc44618c7e47 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:49.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.632+0000 7fee46ffd640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T08:59:49.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.633+0000 7fee46ffd640 1 -- 172.21.15.92:0/3493018849 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c01e040 con 0x555bba8302e0 2024-09-19T08:59:49.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.633+0000 7fee70a2d740 1 -- 172.21.15.92:0/3493018849 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee580cca70 con 0x555bba8302e0 2024-09-19T08:59:49.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.633+0000 7fee46ffd640 1 -- 172.21.15.92:0/3493018849 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fee5c011230 con 0x555bba8302e0 2024-09-19T08:59:49.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.634+0000 7fee46ffd640 1 -- 172.21.15.92:0/3493018849 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fee5c003dd0 con 0x555bba8302e0 2024-09-19T08:59:49.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.634+0000 7fee70a2d740 10 client.25508 fetch_fsmap learned FSMap version 19 2024-09-19T08:59:49.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.634+0000 7fee70a2d740 1 -- 172.21.15.92:0/3493018849 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x555bba8c0eb0 con 0x555bba8302e0 2024-09-19T08:59:49.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.634+0000 7fee46ffd640 1 -- 172.21.15.92:0/3493018849 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee5c027070 con 0x555bba8302e0 2024-09-19T08:59:49.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.634+0000 7fee46ffd640 1 -- 172.21.15.92:0/3493018849 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fee5c021040 con 0x555bba8302e0 2024-09-19T08:59:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.634+0000 7fee70a2d740 10 client.25508 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:59:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.634+0000 7fee70a2d740 10 client.25508 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T08:59:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.634+0000 7fee70a2d740 20 client.25508 populate_metadata read hostname 'smithi092' 2024-09-19T08:59:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.634+0000 7fee70a2d740 1 --2- 172.21.15.92:0/3493018849 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555bba8c17e0 0x555bba8c3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.634+0000 7fee70a2d740 4 client.25508 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:59:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.634+0000 7fee70a2d740 1 -- 172.21.15.92:0/3493018849 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fee580cca70 con 0x555bba8c17e0 2024-09-19T08:59:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.635+0000 7fee677fe640 1 --2- 172.21.15.92:0/3493018849 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555bba8c17e0 0x555bba8c3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.636+0000 7fee677fe640 1 --2- 172.21.15.92:0/3493018849 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555bba8c17e0 0x555bba8c3c00 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93330a14aaebc9f5 server_cookie=48383c6d272e8f2f in_seq=0 out_seq=0 2024-09-19T08:59:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.636+0000 7fee46ffd640 10 client.25508 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:49.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.650+0000 7fee46ffd640 1 -- 172.21.15.92:0/3493018849 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fee580cca70 con 0x555bba8c17e0 2024-09-19T08:59:49.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.650+0000 7fee46ffd640 10 client.25508 handle_command_reply: tid=0 2024-09-19T08:59:49.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.650+0000 7fee70a2d740 1 client.25508 shutdown 2024-09-19T08:59:49.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.651+0000 7fee70a2d740 1 -- 172.21.15.92:0/3493018849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bba8302e0 msgr2=0x555bba84f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:49.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.651+0000 7fee70a2d740 1 --2- 172.21.15.92:0/3493018849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bba8302e0 0x555bba84f360 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0114f0 tx=0x7fee5c009d40 comp rx=0 tx=0).stop 2024-09-19T08:59:49.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.651+0000 7fee70a2d740 1 -- 172.21.15.92:0/3493018849 shutdown_connections 2024-09-19T08:59:49.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.651+0000 7fee70a2d740 1 --2- 172.21.15.92:0/3493018849 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555bba8c17e0 0x555bba8c3c00 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.651+0000 7fee46ffd640 0 client.25508 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:49.653 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.651+0000 7fee70a2d740 1 --2- 172.21.15.92:0/3493018849 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bba835370 0x555bba8bf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.653 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.651+0000 7fee70a2d740 1 --2- 172.21.15.92:0/3493018849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bba8302e0 0x555bba84f360 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.653 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.651+0000 7fee70a2d740 1 --2- 172.21.15.92:0/3493018849 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bba82f9a0 0x555bba84ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.653 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.651+0000 7fee70a2d740 1 -- 172.21.15.92:0/3493018849 >> 172.21.15.92:0/3493018849 conn(0x555bba82b010 msgr2=0x555bba84ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:49.653 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.651+0000 7fee70a2d740 1 -- 172.21.15.92:0/3493018849 shutdown_connections 2024-09-19T08:59:49.653 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.651+0000 7fee70a2d740 1 -- 172.21.15.92:0/3493018849 wait complete. 2024-09-19T08:59:49.653 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.651+0000 7fee70a2d740 20 client.25508 trim_cache size 0 max 16384 2024-09-19T08:59:49.653 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T08:59:49.653 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T08:59:49.654 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T08:59:49.654 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T08:59:49.654 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.652+0000 7fee6dbb7640 1 -- 172.21.15.92:0/3333777642 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fee500a3460 msgr2=0x7fee500a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:49.654 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.652+0000 7fee6dbb7640 1 --2- 172.21.15.92:0/3333777642 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fee500a3460 0x7fee500a5920 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fee60004af0 tx=0x7fee60004a80 comp rx=0 tx=0).stop 2024-09-19T08:59:49.654 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.652+0000 7fee6dbb7640 1 -- 172.21.15.92:0/3333777642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee68108470 msgr2=0x7fee680719e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:49.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.652+0000 7fee6dbb7640 1 --2- 172.21.15.92:0/3333777642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee68108470 0x7fee680719e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fee5800d6d0 tx=0x7fee5800db90 comp rx=0 tx=0).stop 2024-09-19T08:59:49.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.653+0000 7fee6dbb7640 1 -- 172.21.15.92:0/3333777642 shutdown_connections 2024-09-19T08:59:49.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.653+0000 7fee6dbb7640 1 --2- 172.21.15.92:0/3333777642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee68109d40 0x7fee68072f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.653+0000 7fee6dbb7640 1 --2- 172.21.15.92:0/3333777642 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee68109380 0x7fee68071f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.653+0000 7fee6dbb7640 1 --2- 172.21.15.92:0/3333777642 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fee500a3460 0x7fee500a5920 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.653+0000 7fee6dbb7640 1 --2- 172.21.15.92:0/3333777642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee68108470 0x7fee680719e0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.653+0000 7fee6dbb7640 1 -- 172.21.15.92:0/3333777642 >> 172.21.15.92:0/3333777642 conn(0x7fee68077470 msgr2=0x7fee6810c620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:49.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.653+0000 7fee6dbb7640 1 -- 172.21.15.92:0/3333777642 shutdown_connections 2024-09-19T08:59:49.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T08:59:49.653+0000 7fee6dbb7640 1 -- 172.21.15.92:0/3333777642 wait complete. 2024-09-19T08:59:49.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:49 smithi167 ceph-mon[35359]: pgmap v430: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 851 KiB/s wr, 92 op/s 2024-09-19T08:59:49.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:49 smithi190 ceph-mon[35358]: pgmap v430: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 851 KiB/s wr, 92 op/s 2024-09-19T08:59:49.901 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:59:50.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.447+0000 7fc33d3d0640 1 -- 172.21.15.92:0/2648312610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3381049b0 msgr2=0x7fc338108a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:50.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.447+0000 7fc33d3d0640 1 --2- 172.21.15.92:0/2648312610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3381049b0 0x7fc338108a00 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc320009900 tx=0x7fc32002a410 comp rx=0 tx=0).stop 2024-09-19T08:59:50.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.447+0000 7fc33d3d0640 1 -- 172.21.15.92:0/2648312610 shutdown_connections 2024-09-19T08:59:50.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.447+0000 7fc33d3d0640 1 --2- 172.21.15.92:0/2648312610 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc338109130 0x7fc338110cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:50.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.447+0000 7fc33d3d0640 1 --2- 172.21.15.92:0/2648312610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3381049b0 0x7fc338108a00 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:50.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.447+0000 7fc33d3d0640 1 --2- 172.21.15.92:0/2648312610 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc338104000 0x7fc3381043e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:50.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.447+0000 7fc33d3d0640 1 -- 172.21.15.92:0/2648312610 >> 172.21.15.92:0/2648312610 conn(0x7fc3380ffa20 msgr2=0x7fc338101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:50.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.447+0000 7fc33d3d0640 1 -- 172.21.15.92:0/2648312610 shutdown_connections 2024-09-19T08:59:50.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.448+0000 7fc33d3d0640 1 -- 172.21.15.92:0/2648312610 wait complete. 2024-09-19T08:59:50.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.448+0000 7fc33d3d0640 1 Processor -- start 2024-09-19T08:59:50.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.448+0000 7fc33d3d0640 1 -- start start 2024-09-19T08:59:50.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.448+0000 7fc33d3d0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc338104000 0x7fc33819a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:50.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.448+0000 7fc33d3d0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3381049b0 0x7fc33819ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:50.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.448+0000 7fc33d3d0640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc338109130 0x7fc33819ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:50.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.448+0000 7fc33d3d0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc338114180 con 0x7fc338104000 2024-09-19T08:59:50.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.449+0000 7fc33d3d0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc338114000 con 0x7fc3381049b0 2024-09-19T08:59:50.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.449+0000 7fc33d3d0640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc338114300 con 0x7fc338109130 2024-09-19T08:59:50.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.449+0000 7fc336ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc338104000 0x7fc33819a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:50.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.449+0000 7fc32ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3381049b0 0x7fc33819ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:50.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.449+0000 7fc336ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc338104000 0x7fc33819a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35934/0 (socket says 172.21.15.92:35934) 2024-09-19T08:59:50.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.449+0000 7fc32ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3381049b0 0x7fc33819ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:58456/0 (socket says 172.21.15.92:58456) 2024-09-19T08:59:50.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.449+0000 7fc336ffd640 1 -- 172.21.15.92:0/1515778021 learned_addr learned my addr 172.21.15.92:0/1515778021 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:50.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.449+0000 7fc3377fe640 1 --2- 172.21.15.92:0/1515778021 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc338109130 0x7fc33819ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:50.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.449+0000 7fc32ffff640 1 -- 172.21.15.92:0/1515778021 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc338109130 msgr2=0x7fc33819ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:50.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.449+0000 7fc32ffff640 1 --2- 172.21.15.92:0/1515778021 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc338109130 0x7fc33819ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:50.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.449+0000 7fc32ffff640 1 -- 172.21.15.92:0/1515778021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc338104000 msgr2=0x7fc33819a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:50.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.449+0000 7fc32ffff640 1 --2- 172.21.15.92:0/1515778021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc338104000 0x7fc33819a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:50.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.449+0000 7fc32ffff640 1 -- 172.21.15.92:0/1515778021 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc33819f5e0 con 0x7fc3381049b0 2024-09-19T08:59:50.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.450+0000 7fc32ffff640 1 --2- 172.21.15.92:0/1515778021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3381049b0 0x7fc33819ab70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc32002aa00 tx=0x7fc320004530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:50.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.450+0000 7fc334ff9640 1 -- 172.21.15.92:0/1515778021 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32003f070 con 0x7fc3381049b0 2024-09-19T08:59:50.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.450+0000 7fc334ff9640 1 -- 172.21.15.92:0/1515778021 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc320005490 con 0x7fc3381049b0 2024-09-19T08:59:50.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.450+0000 7fc334ff9640 1 -- 172.21.15.92:0/1515778021 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc320035030 con 0x7fc3381049b0 2024-09-19T08:59:50.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.450+0000 7fc33d3d0640 1 -- 172.21.15.92:0/1515778021 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc33819f870 con 0x7fc3381049b0 2024-09-19T08:59:50.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.450+0000 7fc33d3d0640 1 -- 172.21.15.92:0/1515778021 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc33819fcd0 con 0x7fc3381049b0 2024-09-19T08:59:50.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.454+0000 7fc334ff9640 1 -- 172.21.15.92:0/1515778021 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc320042070 con 0x7fc3381049b0 2024-09-19T08:59:50.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.455+0000 7fc334ff9640 1 --2- 172.21.15.92:0/1515778021 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc3240a3380 0x7fc3240a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:50.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.455+0000 7fc33f7a9740 1 Processor -- start 2024-09-19T08:59:50.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.455+0000 7fc336ffd640 1 --2- 172.21.15.92:0/1515778021 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc3240a3380 0x7fc3240a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:50.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.455+0000 7fc33f7a9740 1 -- start start 2024-09-19T08:59:50.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.456+0000 7fc334ff9640 1 -- 172.21.15.92:0/1515778021 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc3200efe60 con 0x7fc3381049b0 2024-09-19T08:59:50.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.456+0000 7fc33f7a9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559abe580cb0 0x559abe581090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:50.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.456+0000 7fc33f7a9740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559abe5815d0 0x559abe58b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:50.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.456+0000 7fc33f7a9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559abe58be90 0x559abe58e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:50.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.456+0000 7fc33f7a9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559abe4de2e0 con 0x559abe580cb0 2024-09-19T08:59:50.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.456+0000 7fc33f7a9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559abe485ce0 con 0x559abe58be90 2024-09-19T08:59:50.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.456+0000 7fc33f7a9740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x559abe4da2a0 con 0x559abe5815d0 2024-09-19T08:59:50.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.456+0000 7fc32ffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559abe5815d0 0x559abe58b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:50.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.456+0000 7fc32ffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559abe5815d0 0x559abe58b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:37880/0 (socket says 172.21.15.92:37880) 2024-09-19T08:59:50.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.456+0000 7fc32ffff640 1 -- 172.21.15.92:0/1179186296 learned_addr learned my addr 172.21.15.92:0/1179186296 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:50.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.456+0000 7fc336ffd640 1 --2- 172.21.15.92:0/1515778021 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc3240a3380 0x7fc3240a5840 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc328009c90 tx=0x7fc328005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:50.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.456+0000 7fc3377fe640 1 --2- 172.21.15.92:0/1179186296 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559abe58be90 0x559abe58e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:50.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.456+0000 7fc336ffd640 1 --2- 172.21.15.92:0/1179186296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559abe580cb0 0x559abe581090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:50.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.457+0000 7fc32ffff640 1 -- 172.21.15.92:0/1179186296 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559abe58be90 msgr2=0x559abe58e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:50.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.457+0000 7fc32ffff640 1 --2- 172.21.15.92:0/1179186296 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559abe58be90 0x559abe58e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:50.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.457+0000 7fc32ffff640 1 -- 172.21.15.92:0/1179186296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559abe580cb0 msgr2=0x559abe581090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:50.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.457+0000 7fc32ffff640 1 --2- 172.21.15.92:0/1179186296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559abe580cb0 0x559abe581090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:50.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.457+0000 7fc32ffff640 1 -- 172.21.15.92:0/1179186296 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559abe46a440 con 0x559abe5815d0 2024-09-19T08:59:50.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.457+0000 7fc336ffd640 1 --2- 172.21.15.92:0/1179186296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559abe580cb0 0x559abe581090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:59:50.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.457+0000 7fc32ffff640 1 --2- 172.21.15.92:0/1179186296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559abe5815d0 0x559abe58b950 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc3200b8ec0 tx=0x7fc3200314a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b81379e72d07cc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:50.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.457+0000 7fc32d7fa640 1 -- 172.21.15.92:0/1179186296 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc320049040 con 0x559abe5815d0 2024-09-19T08:59:50.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.458+0000 7fc32d7fa640 1 -- 172.21.15.92:0/1179186296 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3200c07f0 con 0x559abe5815d0 2024-09-19T08:59:50.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.458+0000 7fc32d7fa640 1 -- 172.21.15.92:0/1179186296 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3200bc750 con 0x559abe5815d0 2024-09-19T08:59:50.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.459+0000 7fc33f7a9740 1 -- 172.21.15.92:0/1179186296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559abe5815d0 msgr2=0x559abe58b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:50.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.459+0000 7fc33f7a9740 1 --2- 172.21.15.92:0/1179186296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559abe5815d0 0x559abe58b950 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc3200b8ec0 tx=0x7fc3200314a0 comp rx=0 tx=0).stop 2024-09-19T08:59:50.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.459+0000 7fc33f7a9740 1 -- 172.21.15.92:0/1179186296 shutdown_connections 2024-09-19T08:59:50.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.459+0000 7fc33f7a9740 1 --2- 172.21.15.92:0/1179186296 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559abe58be90 0x559abe58e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:50.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.459+0000 7fc33f7a9740 1 --2- 172.21.15.92:0/1179186296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559abe5815d0 0x559abe58b950 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:50.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.459+0000 7fc33f7a9740 1 --2- 172.21.15.92:0/1179186296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559abe580cb0 0x559abe581090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:50.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.459+0000 7fc33f7a9740 1 -- 172.21.15.92:0/1179186296 >> 172.21.15.92:0/1179186296 conn(0x559abe57d240 msgr2=0x559abe57d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:50.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.459+0000 7fc33f7a9740 1 -- 172.21.15.92:0/1179186296 shutdown_connections 2024-09-19T08:59:50.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.459+0000 7fc33f7a9740 1 -- 172.21.15.92:0/1179186296 wait complete. 2024-09-19T08:59:50.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.460+0000 7fc33f7a9740 1 -- start start 2024-09-19T08:59:50.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.460+0000 7fc33f7a9740 1 Processor -- start 2024-09-19T08:59:50.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.460+0000 7fc33f7a9740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559abe580cb0 0x559abe58b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:50.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.460+0000 7fc33f7a9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559abe5815d0 0x559abe588b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:50.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.460+0000 7fc33f7a9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559abe58be90 0x559abe589130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:50.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.460+0000 7fc33f7a9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559abe58e820 con 0x559abe5815d0 2024-09-19T08:59:50.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.460+0000 7fc33f7a9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559abe499050 con 0x559abe58be90 2024-09-19T08:59:50.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.460+0000 7fc33f7a9740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x559abe58e9a0 con 0x559abe580cb0 2024-09-19T08:59:50.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.460+0000 7fc33f7a9740 10 client.0 _ll_register_callbacks cb 0x559abe4d9160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:50.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.461+0000 7fc3377fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559abe58be90 0x559abe589130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:50.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.461+0000 7fc32ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559abe5815d0 0x559abe588b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:50.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.461+0000 7fc336ffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559abe580cb0 0x559abe58b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:50.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.461+0000 7fc336ffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559abe580cb0 0x559abe58b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:37894/0 (socket says 172.21.15.92:37894) 2024-09-19T08:59:50.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.461+0000 7fc32ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559abe5815d0 0x559abe588b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35956/0 (socket says 172.21.15.92:35956) 2024-09-19T08:59:50.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.461+0000 7fc336ffd640 1 -- 172.21.15.92:0/1204726729 learned_addr learned my addr 172.21.15.92:0/1204726729 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:50.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.461+0000 7fc336ffd640 1 -- 172.21.15.92:0/1204726729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559abe58be90 msgr2=0x559abe589130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:50.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.461+0000 7fc336ffd640 1 --2- 172.21.15.92:0/1204726729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559abe58be90 0x559abe589130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:50.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.461+0000 7fc336ffd640 1 -- 172.21.15.92:0/1204726729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559abe5815d0 msgr2=0x559abe588b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:50.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.461+0000 7fc336ffd640 1 --2- 172.21.15.92:0/1204726729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559abe5815d0 0x559abe588b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:50.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.461+0000 7fc336ffd640 1 -- 172.21.15.92:0/1204726729 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559abe24f3c0 con 0x559abe580cb0 2024-09-19T08:59:50.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.461+0000 7fc3377fe640 1 --2- 172.21.15.92:0/1204726729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559abe58be90 0x559abe589130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:50.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.462+0000 7fc336ffd640 1 --2- 172.21.15.92:0/1204726729 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559abe580cb0 0x559abe58b890 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc32801b9e0 tx=0x7fc328004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e51acdc6f132ac4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:50.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.462+0000 7fc31e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T08:59:50.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.463+0000 7fc31e7fc640 1 -- 172.21.15.92:0/1204726729 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc328029060 con 0x559abe580cb0 2024-09-19T08:59:50.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.463+0000 7fc31e7fc640 1 -- 172.21.15.92:0/1204726729 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc32800eac0 con 0x559abe580cb0 2024-09-19T08:59:50.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.463+0000 7fc33f7a9740 1 -- 172.21.15.92:0/1204726729 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3200c07f0 con 0x559abe580cb0 2024-09-19T08:59:50.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.463+0000 7fc31e7fc640 1 -- 172.21.15.92:0/1204726729 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc32800ecc0 con 0x559abe580cb0 2024-09-19T08:59:50.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.464+0000 7fc33f7a9740 10 client.25456 fetch_fsmap learned FSMap version 19 2024-09-19T08:59:50.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.464+0000 7fc33f7a9740 1 -- 172.21.15.92:0/1204726729 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x559abe59a1d0 con 0x559abe580cb0 2024-09-19T08:59:50.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.464+0000 7fc31e7fc640 1 -- 172.21.15.92:0/1204726729 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc32802f8c0 con 0x559abe580cb0 2024-09-19T08:59:50.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.464+0000 7fc31e7fc640 1 -- 172.21.15.92:0/1204726729 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fc32802e070 con 0x559abe580cb0 2024-09-19T08:59:50.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.464+0000 7fc33f7a9740 10 client.25456 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:59:50.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.464+0000 7fc33f7a9740 10 client.25456 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:59:50.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.464+0000 7fc33f7a9740 20 client.25456 populate_metadata read hostname 'smithi092' 2024-09-19T08:59:50.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.464+0000 7fc33f7a9740 1 --2- 172.21.15.92:0/1204726729 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559abe59b690 0x559abe59da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:50.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.464+0000 7fc33f7a9740 4 client.25456 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:59:50.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.464+0000 7fc33f7a9740 1 -- 172.21.15.92:0/1204726729 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc3200c07f0 con 0x559abe59b690 2024-09-19T08:59:50.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.465+0000 7fc32ffff640 1 --2- 172.21.15.92:0/1204726729 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559abe59b690 0x559abe59da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:50.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.465+0000 7fc32ffff640 1 --2- 172.21.15.92:0/1204726729 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559abe59b690 0x559abe59da80 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d4165c32bfb3725 server_cookie=ec895540a6566ae8 in_seq=0 out_seq=0 2024-09-19T08:59:50.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.465+0000 7fc31e7fc640 10 client.25456 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:50.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.466+0000 7fc31e7fc640 1 -- 172.21.15.92:0/1204726729 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fc3200c07f0 con 0x559abe59b690 2024-09-19T08:59:50.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.466+0000 7fc31e7fc640 10 client.25456 handle_command_reply: tid=0 2024-09-19T08:59:50.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.466+0000 7fc33f7a9740 1 client.25456 shutdown 2024-09-19T08:59:50.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.468+0000 7fc33f7a9740 1 -- 172.21.15.92:0/1204726729 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559abe580cb0 msgr2=0x559abe58b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:50.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.468+0000 7fc33f7a9740 1 --2- 172.21.15.92:0/1204726729 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559abe580cb0 0x559abe58b890 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc32801b9e0 tx=0x7fc328004730 comp rx=0 tx=0).stop 2024-09-19T08:59:50.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.468+0000 7fc33f7a9740 1 -- 172.21.15.92:0/1204726729 shutdown_connections 2024-09-19T08:59:50.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.468+0000 7fc33f7a9740 1 --2- 172.21.15.92:0/1204726729 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559abe59b690 0x559abe59da80 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:50.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.468+0000 7fc33f7a9740 1 --2- 172.21.15.92:0/1204726729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559abe58be90 0x559abe589130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:50.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.468+0000 7fc33f7a9740 1 --2- 172.21.15.92:0/1204726729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559abe5815d0 0x559abe588b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:50.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.468+0000 7fc31e7fc640 0 client.25456 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:50.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.468+0000 7fc33f7a9740 1 --2- 172.21.15.92:0/1204726729 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559abe580cb0 0x559abe58b890 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:50.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.468+0000 7fc33f7a9740 1 -- 172.21.15.92:0/1204726729 >> 172.21.15.92:0/1204726729 conn(0x559abe57d240 msgr2=0x559abe582f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:50.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.468+0000 7fc33f7a9740 1 -- 172.21.15.92:0/1204726729 shutdown_connections 2024-09-19T08:59:50.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.468+0000 7fc33f7a9740 1 -- 172.21.15.92:0/1204726729 wait complete. 2024-09-19T08:59:50.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.469+0000 7fc33f7a9740 20 client.25456 trim_cache size 0 max 16384 2024-09-19T08:59:50.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.499+0000 7fc33f7a9740 1 Processor -- start 2024-09-19T08:59:50.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.500+0000 7fc33f7a9740 1 -- start start 2024-09-19T08:59:50.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.500+0000 7fc33f7a9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559abe580cb0 0x559abe597940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:50.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.500+0000 7fc33f7a9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559abe5815d0 0x559abe5a32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:50.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.500+0000 7fc33f7a9740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559abe58be90 0x559abe5a3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:50.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.500+0000 7fc33f7a9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc3381a9410 con 0x559abe580cb0 2024-09-19T08:59:50.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.500+0000 7fc33f7a9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc3381abcb0 con 0x559abe5815d0 2024-09-19T08:59:50.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.500+0000 7fc33f7a9740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc3381a9aa0 con 0x559abe58be90 2024-09-19T08:59:50.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.501+0000 7fc32ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559abe5815d0 0x559abe5a32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:50.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.501+0000 7fc3377fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559abe58be90 0x559abe5a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:50.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.501+0000 7fc32ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559abe5815d0 0x559abe5a32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:58472/0 (socket says 172.21.15.92:58472) 2024-09-19T08:59:50.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.501+0000 7fc32ffff640 1 -- 172.21.15.92:0/3676068611 learned_addr learned my addr 172.21.15.92:0/3676068611 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:50.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.501+0000 7fc336ffd640 1 --2- 172.21.15.92:0/3676068611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559abe580cb0 0x559abe597940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:50.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.501+0000 7fc32ffff640 1 -- 172.21.15.92:0/3676068611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559abe58be90 msgr2=0x559abe5a3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:50.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.501+0000 7fc32ffff640 1 --2- 172.21.15.92:0/3676068611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559abe58be90 0x559abe5a3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:50.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.501+0000 7fc32ffff640 1 -- 172.21.15.92:0/3676068611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559abe580cb0 msgr2=0x559abe597940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:50.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.501+0000 7fc32ffff640 1 --2- 172.21.15.92:0/3676068611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559abe580cb0 0x559abe597940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:50.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.501+0000 7fc32ffff640 1 -- 172.21.15.92:0/3676068611 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559abe5894a0 con 0x559abe5815d0 2024-09-19T08:59:50.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.501+0000 7fc32ffff640 1 --2- 172.21.15.92:0/3676068611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559abe5815d0 0x559abe5a32e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc3200bc1f0 tx=0x7fc320003f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9c56c83399c7ada server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:50.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.502+0000 7fc32cff9640 1 -- 172.21.15.92:0/3676068611 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3200da070 con 0x559abe5815d0 2024-09-19T08:59:50.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.502+0000 7fc32cff9640 1 -- 172.21.15.92:0/3676068611 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc320003bd0 con 0x559abe5815d0 2024-09-19T08:59:50.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.502+0000 7fc32cff9640 1 -- 172.21.15.92:0/3676068611 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc320049040 con 0x559abe5815d0 2024-09-19T08:59:50.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.503+0000 7fc33f7a9740 1 -- 172.21.15.92:0/3676068611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559abe5815d0 msgr2=0x559abe5a32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:50.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.503+0000 7fc33f7a9740 1 --2- 172.21.15.92:0/3676068611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559abe5815d0 0x559abe5a32e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc3200bc1f0 tx=0x7fc320003f70 comp rx=0 tx=0).stop 2024-09-19T08:59:50.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.503+0000 7fc33f7a9740 1 -- 172.21.15.92:0/3676068611 shutdown_connections 2024-09-19T08:59:50.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.503+0000 7fc33f7a9740 1 --2- 172.21.15.92:0/3676068611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559abe58be90 0x559abe5a3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:50.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.503+0000 7fc33f7a9740 1 --2- 172.21.15.92:0/3676068611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559abe5815d0 0x559abe5a32e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:50.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.503+0000 7fc33f7a9740 1 --2- 172.21.15.92:0/3676068611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559abe580cb0 0x559abe597940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:50.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.503+0000 7fc33f7a9740 1 -- 172.21.15.92:0/3676068611 >> 172.21.15.92:0/3676068611 conn(0x559abe57d240 msgr2=0x559abe582f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:50.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.503+0000 7fc33f7a9740 1 -- 172.21.15.92:0/3676068611 shutdown_connections 2024-09-19T08:59:50.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.503+0000 7fc33f7a9740 1 -- 172.21.15.92:0/3676068611 wait complete. 2024-09-19T08:59:50.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.504+0000 7fc33f7a9740 1 -- start start 2024-09-19T08:59:50.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.504+0000 7fc33f7a9740 1 Processor -- start 2024-09-19T08:59:50.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.504+0000 7fc33f7a9740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559abe580cb0 0x559abe5941a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:50.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.504+0000 7fc33f7a9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559abe5815d0 0x559abe58f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:50.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.504+0000 7fc33f7a9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559abe58be90 0x559abe58fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:50.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.504+0000 7fc33f7a9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc3381aa170 con 0x559abe5815d0 2024-09-19T08:59:50.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.504+0000 7fc33f7a9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc3381ab5e0 con 0x559abe58be90 2024-09-19T08:59:50.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.504+0000 7fc33f7a9740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc3381aa840 con 0x559abe580cb0 2024-09-19T08:59:50.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.504+0000 7fc33f7a9740 10 client.0 _ll_register_callbacks cb 0x7fc328009a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:50.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.504+0000 7fc336ffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559abe580cb0 0x559abe5941a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:50.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.504+0000 7fc336ffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559abe580cb0 0x559abe5941a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:37912/0 (socket says 172.21.15.92:37912) 2024-09-19T08:59:50.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.504+0000 7fc336ffd640 1 -- 172.21.15.92:0/1914746758 learned_addr learned my addr 172.21.15.92:0/1914746758 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:50.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.505+0000 7fc32ffff640 1 --2- 172.21.15.92:0/1914746758 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559abe5815d0 0x559abe58f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:50.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.505+0000 7fc3377fe640 1 --2- 172.21.15.92:0/1914746758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559abe58be90 0x559abe58fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:50.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.505+0000 7fc336ffd640 1 -- 172.21.15.92:0/1914746758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559abe58be90 msgr2=0x559abe58fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:50.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.505+0000 7fc336ffd640 1 --2- 172.21.15.92:0/1914746758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559abe58be90 0x559abe58fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:50.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.505+0000 7fc336ffd640 1 -- 172.21.15.92:0/1914746758 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559abe5815d0 msgr2=0x559abe58f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:50.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.505+0000 7fc336ffd640 1 --2- 172.21.15.92:0/1914746758 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559abe5815d0 0x559abe58f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:50.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.505+0000 7fc336ffd640 1 -- 172.21.15.92:0/1914746758 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559abe5901f0 con 0x559abe580cb0 2024-09-19T08:59:50.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.505+0000 7fc336ffd640 1 --2- 172.21.15.92:0/1914746758 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559abe580cb0 0x559abe5941a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc32801b9e0 tx=0x7fc328023f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=776aa25e95eb0d8d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:50.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.505+0000 7fc31e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T08:59:50.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.505+0000 7fc31e7fc640 1 -- 172.21.15.92:0/1914746758 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc328034070 con 0x559abe580cb0 2024-09-19T08:59:50.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.505+0000 7fc31e7fc640 1 -- 172.21.15.92:0/1914746758 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc328009040 con 0x559abe580cb0 2024-09-19T08:59:50.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.506+0000 7fc33f7a9740 1 -- 172.21.15.92:0/1914746758 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc320003bd0 con 0x559abe580cb0 2024-09-19T08:59:50.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.506+0000 7fc31e7fc640 1 -- 172.21.15.92:0/1914746758 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc32800ee60 con 0x559abe580cb0 2024-09-19T08:59:50.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.506+0000 7fc33f7a9740 10 client.25462 fetch_fsmap learned FSMap version 19 2024-09-19T08:59:50.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.506+0000 7fc33f7a9740 1 -- 172.21.15.92:0/1914746758 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x559abe606270 con 0x559abe580cb0 2024-09-19T08:59:50.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.507+0000 7fc31e7fc640 1 -- 172.21.15.92:0/1914746758 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc320003bd0 con 0x559abe580cb0 2024-09-19T08:59:50.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.507+0000 7fc31e7fc640 1 -- 172.21.15.92:0/1914746758 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fc32802e040 con 0x559abe580cb0 2024-09-19T08:59:50.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.507+0000 7fc33f7a9740 10 client.25462 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:59:50.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.507+0000 7fc33f7a9740 10 client.25462 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:59:50.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.507+0000 7fc33f7a9740 20 client.25462 populate_metadata read hostname 'smithi092' 2024-09-19T08:59:50.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.507+0000 7fc33f7a9740 1 --2- 172.21.15.92:0/1914746758 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559abe606970 0x559abe608d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:50.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.507+0000 7fc33f7a9740 4 client.25462 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:59:50.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.507+0000 7fc33f7a9740 1 -- 172.21.15.92:0/1914746758 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559abe4eb850 con 0x559abe606970 2024-09-19T08:59:50.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.507+0000 7fc32ffff640 1 --2- 172.21.15.92:0/1914746758 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559abe606970 0x559abe608d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:50.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.508+0000 7fc32ffff640 1 --2- 172.21.15.92:0/1914746758 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559abe606970 0x559abe608d90 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be9004ec48294286 server_cookie=6d78bc09ed21316d in_seq=0 out_seq=0 2024-09-19T08:59:50.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.508+0000 7fc31e7fc640 10 client.25462 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:50.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.508+0000 7fc31e7fc640 1 -- 172.21.15.92:0/1914746758 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x559abe4eb850 con 0x559abe606970 2024-09-19T08:59:50.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.508+0000 7fc31e7fc640 10 client.25462 handle_command_reply: tid=0 2024-09-19T08:59:50.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.508+0000 7fc33f7a9740 1 client.25462 shutdown 2024-09-19T08:59:50.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.510+0000 7fc33f7a9740 1 -- 172.21.15.92:0/1914746758 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559abe580cb0 msgr2=0x559abe5941a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:50.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.510+0000 7fc33f7a9740 1 --2- 172.21.15.92:0/1914746758 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559abe580cb0 0x559abe5941a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc32801b9e0 tx=0x7fc328023f30 comp rx=0 tx=0).stop 2024-09-19T08:59:50.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.510+0000 7fc33f7a9740 1 -- 172.21.15.92:0/1914746758 shutdown_connections 2024-09-19T08:59:50.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.510+0000 7fc33f7a9740 1 --2- 172.21.15.92:0/1914746758 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559abe606970 0x559abe608d90 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:50.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.510+0000 7fc33f7a9740 1 --2- 172.21.15.92:0/1914746758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559abe58be90 0x559abe58fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:50.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.510+0000 7fc33f7a9740 1 --2- 172.21.15.92:0/1914746758 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559abe5815d0 0x559abe58f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:50.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.510+0000 7fc33f7a9740 1 --2- 172.21.15.92:0/1914746758 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559abe580cb0 0x559abe5941a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:50.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.510+0000 7fc31e7fc640 0 client.25462 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:50.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.510+0000 7fc33f7a9740 1 -- 172.21.15.92:0/1914746758 >> 172.21.15.92:0/1914746758 conn(0x559abe57d240 msgr2=0x559abe573350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:50.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.510+0000 7fc33f7a9740 1 -- 172.21.15.92:0/1914746758 shutdown_connections 2024-09-19T08:59:50.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.510+0000 7fc33f7a9740 1 -- 172.21.15.92:0/1914746758 wait complete. 2024-09-19T08:59:50.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.510+0000 7fc33f7a9740 20 client.25462 trim_cache size 0 max 16384 2024-09-19T08:59:50.513 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T08:59:50.513 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-19T08:59:50.513 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {} 2024-09-19T08:59:50.513 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T08:59:50.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.511+0000 7fc33d3d0640 1 -- 172.21.15.92:0/1515778021 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc3240a3380 msgr2=0x7fc3240a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:50.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.511+0000 7fc33d3d0640 1 --2- 172.21.15.92:0/1515778021 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc3240a3380 0x7fc3240a5840 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc328009c90 tx=0x7fc328005f90 comp rx=0 tx=0).stop 2024-09-19T08:59:50.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.511+0000 7fc33d3d0640 1 -- 172.21.15.92:0/1515778021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3381049b0 msgr2=0x7fc33819ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:50.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.512+0000 7fc33d3d0640 1 --2- 172.21.15.92:0/1515778021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3381049b0 0x7fc33819ab70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc32002aa00 tx=0x7fc320004530 comp rx=0 tx=0).stop 2024-09-19T08:59:50.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.512+0000 7fc33d3d0640 1 -- 172.21.15.92:0/1515778021 shutdown_connections 2024-09-19T08:59:50.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.512+0000 7fc33d3d0640 1 --2- 172.21.15.92:0/1515778021 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc338109130 0x7fc33819ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:50.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.512+0000 7fc33d3d0640 1 --2- 172.21.15.92:0/1515778021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3381049b0 0x7fc33819ab70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:50.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.512+0000 7fc33d3d0640 1 --2- 172.21.15.92:0/1515778021 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc3240a3380 0x7fc3240a5840 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:50.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.512+0000 7fc33d3d0640 1 --2- 172.21.15.92:0/1515778021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc338104000 0x7fc33819a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:50.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.512+0000 7fc33d3d0640 1 -- 172.21.15.92:0/1515778021 >> 172.21.15.92:0/1515778021 conn(0x7fc3380ffa20 msgr2=0x7fc338100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:50.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.512+0000 7fc33d3d0640 1 -- 172.21.15.92:0/1515778021 shutdown_connections 2024-09-19T08:59:50.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:50.512+0000 7fc33d3d0640 1 -- 172.21.15.92:0/1515778021 wait complete. 2024-09-19T08:59:50.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 185.0 s, 2364.0 tps, lat 153.340 ms stddev 1450.155 2024-09-19T08:59:51.326 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:59:51.326 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:59:51.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:51 smithi092 ceph-mon[31407]: pgmap v431: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 1.9 MiB/s wr, 231 op/s 2024-09-19T08:59:51.784 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:59:51.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:51 smithi167 ceph-mon[35359]: pgmap v431: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 1.9 MiB/s wr, 231 op/s 2024-09-19T08:59:51.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:51 smithi190 ceph-mon[35358]: pgmap v431: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 1.9 MiB/s wr, 231 op/s 2024-09-19T08:59:52.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.347+0000 7f942017e640 1 -- 172.21.15.92:0/1445070760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94180ffbf0 msgr2=0x7f94180fffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:52.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.347+0000 7f942017e640 1 --2- 172.21.15.92:0/1445070760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94180ffbf0 0x7f94180fffd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9414009860 tx=0x7f941402a3d0 comp rx=0 tx=0).stop 2024-09-19T08:59:52.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.349+0000 7f942017e640 1 -- 172.21.15.92:0/1445070760 shutdown_connections 2024-09-19T08:59:52.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.349+0000 7f942017e640 1 --2- 172.21.15.92:0/1445070760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9418112880 0x7f9418114c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:52.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.349+0000 7f942017e640 1 --2- 172.21.15.92:0/1445070760 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9418100510 0x7f9418112340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:52.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.349+0000 7f942017e640 1 --2- 172.21.15.92:0/1445070760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94180ffbf0 0x7f94180fffd0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:52.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.349+0000 7f942017e640 1 -- 172.21.15.92:0/1445070760 >> 172.21.15.92:0/1445070760 conn(0x7f94180fba90 msgr2=0x7f94180fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:52.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.349+0000 7f942017e640 1 -- 172.21.15.92:0/1445070760 shutdown_connections 2024-09-19T08:59:52.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.349+0000 7f942017e640 1 -- 172.21.15.92:0/1445070760 wait complete. 2024-09-19T08:59:52.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.350+0000 7f942017e640 1 Processor -- start 2024-09-19T08:59:52.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.350+0000 7f942017e640 1 -- start start 2024-09-19T08:59:52.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.351+0000 7f942017e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94180ffbf0 0x7f94181a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:52.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.351+0000 7f942017e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9418100510 0x7f94181a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:52.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.351+0000 7f942017e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9418112880 0x7f941819e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:52.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.351+0000 7f942017e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9418118520 con 0x7f9418112880 2024-09-19T08:59:52.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.351+0000 7f942017e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f94181183a0 con 0x7f94180ffbf0 2024-09-19T08:59:52.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.351+0000 7f942017e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f94181186a0 con 0x7f9418100510 2024-09-19T08:59:52.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.351+0000 7f941df1a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94180ffbf0 0x7f94181a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:52.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.351+0000 7f941df1a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94180ffbf0 0x7f94181a46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:43712/0 (socket says 172.21.15.92:43712) 2024-09-19T08:59:52.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.351+0000 7f941e71b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9418112880 0x7f941819e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:52.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.351+0000 7f941e71b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9418112880 0x7f941819e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50226/0 (socket says 172.21.15.92:50226) 2024-09-19T08:59:52.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.351+0000 7f941e71b640 1 -- 172.21.15.92:0/3015010423 learned_addr learned my addr 172.21.15.92:0/3015010423 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:52.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.352+0000 7f941df1a640 1 -- 172.21.15.92:0/3015010423 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9418100510 msgr2=0x7f94181a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:52.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.352+0000 7f941df1a640 1 --2- 172.21.15.92:0/3015010423 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9418100510 0x7f94181a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:52.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.352+0000 7f941df1a640 1 -- 172.21.15.92:0/3015010423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9418112880 msgr2=0x7f941819e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:52.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.352+0000 7f941df1a640 1 --2- 172.21.15.92:0/3015010423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9418112880 0x7f941819e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:52.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.352+0000 7f941df1a640 1 -- 172.21.15.92:0/3015010423 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f941819efc0 con 0x7f94180ffbf0 2024-09-19T08:59:52.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.352+0000 7f941df1a640 1 --2- 172.21.15.92:0/3015010423 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94180ffbf0 0x7f94181a46d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f941402a8f0 tx=0x7f9414030940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:52.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.353+0000 7f940effd640 1 -- 172.21.15.92:0/3015010423 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9414005460 con 0x7f94180ffbf0 2024-09-19T08:59:52.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.353+0000 7f942017e640 1 -- 172.21.15.92:0/3015010423 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f941819f250 con 0x7f94180ffbf0 2024-09-19T08:59:52.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.353+0000 7f940effd640 1 -- 172.21.15.92:0/3015010423 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9414005600 con 0x7f94180ffbf0 2024-09-19T08:59:52.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.353+0000 7f940effd640 1 -- 172.21.15.92:0/3015010423 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9414005460 con 0x7f94180ffbf0 2024-09-19T08:59:52.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.353+0000 7f942017e640 1 -- 172.21.15.92:0/3015010423 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94181ab5a0 con 0x7f94180ffbf0 2024-09-19T08:59:52.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.355+0000 7f942017e640 1 -- 172.21.15.92:0/3015010423 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9418101080 con 0x7f94180ffbf0 2024-09-19T08:59:52.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.357+0000 7f940effd640 1 -- 172.21.15.92:0/3015010423 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9414039040 con 0x7f94180ffbf0 2024-09-19T08:59:52.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.358+0000 7f940effd640 1 --2- 172.21.15.92:0/3015010423 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f94040a3440 0x7f94040a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:52.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.358+0000 7f940effd640 1 -- 172.21.15.92:0/3015010423 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f94140f0940 con 0x7f94180ffbf0 2024-09-19T08:59:52.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.358+0000 7f941d719640 1 --2- 172.21.15.92:0/3015010423 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f94040a3440 0x7f94040a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:52.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.360+0000 7f941d719640 1 --2- 172.21.15.92:0/3015010423 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f94040a3440 0x7f94040a5900 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9408005fd0 tx=0x7f9408005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:52.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.360+0000 7f940effd640 1 -- 172.21.15.92:0/3015010423 <== mon.2 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9414040030 con 0x7f94180ffbf0 2024-09-19T08:59:52.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.728+0000 7f942017e640 1 -- 172.21.15.92:0/3015010423 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94180fffd0 con 0x7f94180ffbf0 2024-09-19T08:59:52.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.729+0000 7f940effd640 1 -- 172.21.15.92:0/3015010423 <== mon.2 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f94180fffd0 con 0x7f94180ffbf0 2024-09-19T08:59:52.730 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T08:59:52.730 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T08:59:52.730 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T08:59:52.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.733+0000 7f942017e640 1 -- 172.21.15.92:0/3015010423 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f94040a3440 msgr2=0x7f94040a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:52.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.733+0000 7f942017e640 1 --2- 172.21.15.92:0/3015010423 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f94040a3440 0x7f94040a5900 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9408005fd0 tx=0x7f9408005850 comp rx=0 tx=0).stop 2024-09-19T08:59:52.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.733+0000 7f942017e640 1 -- 172.21.15.92:0/3015010423 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94180ffbf0 msgr2=0x7f94181a46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:52.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.733+0000 7f942017e640 1 --2- 172.21.15.92:0/3015010423 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94180ffbf0 0x7f94181a46d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f941402a8f0 tx=0x7f9414030940 comp rx=0 tx=0).stop 2024-09-19T08:59:52.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.737+0000 7f942017e640 1 -- 172.21.15.92:0/3015010423 shutdown_connections 2024-09-19T08:59:52.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.737+0000 7f942017e640 1 --2- 172.21.15.92:0/3015010423 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f94040a3440 0x7f94040a5900 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:52.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.737+0000 7f942017e640 1 --2- 172.21.15.92:0/3015010423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9418112880 0x7f941819e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:52.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.737+0000 7f942017e640 1 --2- 172.21.15.92:0/3015010423 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9418100510 0x7f94181a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:52.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.737+0000 7f942017e640 1 --2- 172.21.15.92:0/3015010423 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94180ffbf0 0x7f94181a46d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:52.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.737+0000 7f942017e640 1 -- 172.21.15.92:0/3015010423 >> 172.21.15.92:0/3015010423 conn(0x7f94180fba90 msgr2=0x7f94181106f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:52.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.737+0000 7f942017e640 1 -- 172.21.15.92:0/3015010423 shutdown_connections 2024-09-19T08:59:52.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:52.737+0000 7f942017e640 1 -- 172.21.15.92:0/3015010423 wait complete. 2024-09-19T08:59:53.511 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:59:53.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:53 smithi092 ceph-mon[31407]: pgmap v432: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 3.2 MiB/s wr, 353 op/s 2024-09-19T08:59:53.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:53 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3015010423' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:59:53.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:53 smithi167 ceph-mon[35359]: pgmap v432: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 3.2 MiB/s wr, 353 op/s 2024-09-19T08:59:53.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:53 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3015010423' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:59:53.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:53 smithi190 ceph-mon[35358]: pgmap v432: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 3.2 MiB/s wr, 353 op/s 2024-09-19T08:59:53.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:53 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3015010423' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:59:53.890 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:59:54.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.432+0000 7fade4a7d640 1 -- 172.21.15.92:0/2252014180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fade0108c30 msgr2=0x7fade010cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:54.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.433+0000 7fade4a7d640 1 --2- 172.21.15.92:0/2252014180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fade0108c30 0x7fade010cc00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fadc8009900 tx=0x7fadc802a3f0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.433+0000 7fade4a7d640 1 -- 172.21.15.92:0/2252014180 shutdown_connections 2024-09-19T08:59:54.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.433+0000 7fade4a7d640 1 --2- 172.21.15.92:0/2252014180 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fade010d330 0x7fade0114eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.433+0000 7fade4a7d640 1 --2- 172.21.15.92:0/2252014180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fade0108c30 0x7fade010cc00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.433+0000 7fade4a7d640 1 --2- 172.21.15.92:0/2252014180 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fade0108280 0x7fade0108660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.433+0000 7fade4a7d640 1 -- 172.21.15.92:0/2252014180 >> 172.21.15.92:0/2252014180 conn(0x7fade0077970 msgr2=0x7fade0079d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:54.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.433+0000 7fade4a7d640 1 -- 172.21.15.92:0/2252014180 shutdown_connections 2024-09-19T08:59:54.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.433+0000 7fade4a7d640 1 -- 172.21.15.92:0/2252014180 wait complete. 2024-09-19T08:59:54.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.434+0000 7fade4a7d640 1 Processor -- start 2024-09-19T08:59:54.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.435+0000 7fade4a7d640 1 -- start start 2024-09-19T08:59:54.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.436+0000 7fade4a7d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fade0108280 0x7fade01a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:54.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.436+0000 7fade4a7d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fade0108c30 0x7fade01a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:54.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.436+0000 7fade4a7d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fade010d330 0x7fade019e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:54.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.436+0000 7fade4a7d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fade0118480 con 0x7fade0108280 2024-09-19T08:59:54.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.436+0000 7fade4a7d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fade0118300 con 0x7fade0108c30 2024-09-19T08:59:54.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.436+0000 7fade4a7d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fade0118600 con 0x7fade010d330 2024-09-19T08:59:54.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.436+0000 7faddeffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fade0108c30 0x7fade01a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:54.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.436+0000 7faddffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fade010d330 0x7fade019e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:54.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.436+0000 7faddeffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fade0108c30 0x7fade01a4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:43738/0 (socket says 172.21.15.92:43738) 2024-09-19T08:59:54.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.436+0000 7faddeffd640 1 -- 172.21.15.92:0/3768887523 learned_addr learned my addr 172.21.15.92:0/3768887523 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:54.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.436+0000 7faddf7fe640 1 --2- 172.21.15.92:0/3768887523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fade0108280 0x7fade01a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:54.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.436+0000 7faddeffd640 1 -- 172.21.15.92:0/3768887523 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fade010d330 msgr2=0x7fade019e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:54.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.436+0000 7faddeffd640 1 --2- 172.21.15.92:0/3768887523 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fade010d330 0x7fade019e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.436+0000 7faddeffd640 1 -- 172.21.15.92:0/3768887523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fade0108280 msgr2=0x7fade01a46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:54.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.436+0000 7faddeffd640 1 --2- 172.21.15.92:0/3768887523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fade0108280 0x7fade01a46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.436+0000 7faddeffd640 1 -- 172.21.15.92:0/3768887523 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade019efd0 con 0x7fade0108c30 2024-09-19T08:59:54.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.438+0000 7faddeffd640 1 --2- 172.21.15.92:0/3768887523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fade0108c30 0x7fade01a4bf0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fadc8005ab0 tx=0x7fadc8003bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:54.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.439+0000 7faddcff9640 1 -- 172.21.15.92:0/3768887523 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc803f070 con 0x7fade0108c30 2024-09-19T08:59:54.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.439+0000 7faddcff9640 1 -- 172.21.15.92:0/3768887523 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fadc803b460 con 0x7fade0108c30 2024-09-19T08:59:54.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.439+0000 7faddcff9640 1 -- 172.21.15.92:0/3768887523 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc8035030 con 0x7fade0108c30 2024-09-19T08:59:54.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.439+0000 7fade4a7d640 1 -- 172.21.15.92:0/3768887523 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade019f260 con 0x7fade0108c30 2024-09-19T08:59:54.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.440+0000 7fade4a7d640 1 -- 172.21.15.92:0/3768887523 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fade01ab510 con 0x7fade0108c30 2024-09-19T08:59:54.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.443+0000 7fade80b8740 1 Processor -- start 2024-09-19T08:59:54.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.445+0000 7fade80b8740 1 -- start start 2024-09-19T08:59:54.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.445+0000 7fade80b8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559278324d20 0x559278323270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:54.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.445+0000 7fade80b8740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5592783237b0 0x559278323bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:54.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.445+0000 7fade80b8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55927832e550 0x559278330940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:54.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.445+0000 7fade80b8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5592782892f0 con 0x55927832e550 2024-09-19T08:59:54.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.445+0000 7fade80b8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559278230cf0 con 0x559278324d20 2024-09-19T08:59:54.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.445+0000 7fade80b8740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5592782852b0 con 0x5592783237b0 2024-09-19T08:59:54.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.446+0000 7faddcff9640 1 -- 172.21.15.92:0/3768887523 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fadc8042070 con 0x7fade0108c30 2024-09-19T08:59:54.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.446+0000 7faddffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559278324d20 0x559278323270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:54.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.446+0000 7faddffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559278324d20 0x559278323270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:43742/0 (socket says 172.21.15.92:43742) 2024-09-19T08:59:54.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.446+0000 7faddffff640 1 -- 172.21.15.92:0/1769535279 learned_addr learned my addr 172.21.15.92:0/1769535279 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:54.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.446+0000 7faddeffd640 1 --2- 172.21.15.92:0/1769535279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55927832e550 0x559278330940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:54.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.447+0000 7faddf7fe640 1 --2- 172.21.15.92:0/1769535279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5592783237b0 0x559278323bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:54.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.447+0000 7faddffff640 1 -- 172.21.15.92:0/1769535279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5592783237b0 msgr2=0x559278323bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:54.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.447+0000 7faddffff640 1 --2- 172.21.15.92:0/1769535279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5592783237b0 0x559278323bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.447+0000 7faddffff640 1 -- 172.21.15.92:0/1769535279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55927832e550 msgr2=0x559278330940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:54.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.447+0000 7faddffff640 1 --2- 172.21.15.92:0/1769535279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55927832e550 0x559278330940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.447+0000 7faddffff640 1 -- 172.21.15.92:0/1769535279 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592782153a0 con 0x559278324d20 2024-09-19T08:59:54.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.448+0000 7faddffff640 1 --2- 172.21.15.92:0/1769535279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559278324d20 0x559278323270 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fadd8009f20 tx=0x7fadd800c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=604f3ad9e205fa67 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:54.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.448+0000 7faddcff9640 1 --2- 172.21.15.92:0/3768887523 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fadcc0a3450 0x7fadcc0a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:54.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.448+0000 7faddf7fe640 1 --2- 172.21.15.92:0/3768887523 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fadcc0a3450 0x7fadcc0a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:54.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.448+0000 7fadd5ffb640 1 -- 172.21.15.92:0/1769535279 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd801a070 con 0x559278324d20 2024-09-19T08:59:54.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.448+0000 7fadd5ffb640 1 -- 172.21.15.92:0/1769535279 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fadd80158f0 con 0x559278324d20 2024-09-19T08:59:54.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.448+0000 7fadd5ffb640 1 -- 172.21.15.92:0/1769535279 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd800a900 con 0x559278324d20 2024-09-19T08:59:54.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.448+0000 7faddcff9640 1 -- 172.21.15.92:0/3768887523 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fadc80f01b0 con 0x7fade0108c30 2024-09-19T08:59:54.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.449+0000 7fade80b8740 1 -- 172.21.15.92:0/1769535279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559278324d20 msgr2=0x559278323270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:54.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.449+0000 7fade80b8740 1 --2- 172.21.15.92:0/1769535279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559278324d20 0x559278323270 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fadd8009f20 tx=0x7fadd800c8b0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.449+0000 7fade80b8740 1 -- 172.21.15.92:0/1769535279 shutdown_connections 2024-09-19T08:59:54.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.449+0000 7fade80b8740 1 --2- 172.21.15.92:0/1769535279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55927832e550 0x559278330940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.449+0000 7fade80b8740 1 --2- 172.21.15.92:0/1769535279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5592783237b0 0x559278323bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.449+0000 7fade80b8740 1 --2- 172.21.15.92:0/1769535279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559278324d20 0x559278323270 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.449+0000 7fade80b8740 1 -- 172.21.15.92:0/1769535279 >> 172.21.15.92:0/1769535279 conn(0x5592782ec310 msgr2=0x55927831fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:54.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.450+0000 7faddf7fe640 1 --2- 172.21.15.92:0/3768887523 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fadcc0a3450 0x7fadcc0a5910 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x559278320ca0 tx=0x7fadd0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:54.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.450+0000 7fade80b8740 1 -- 172.21.15.92:0/1769535279 shutdown_connections 2024-09-19T08:59:54.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.450+0000 7fade80b8740 1 -- 172.21.15.92:0/1769535279 wait complete. 2024-09-19T08:59:54.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.450+0000 7fade80b8740 1 -- start start 2024-09-19T08:59:54.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.451+0000 7fade80b8740 1 Processor -- start 2024-09-19T08:59:54.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.451+0000 7fade80b8740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5592783237b0 0x55927832df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:54.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.451+0000 7fade80b8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559278324d20 0x55927832b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:54.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.451+0000 7fade80b8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55927832e550 0x55927832ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:54.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.451+0000 7fade80b8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559278342260 con 0x55927832e550 2024-09-19T08:59:54.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.452+0000 7fade80b8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559278244060 con 0x559278324d20 2024-09-19T08:59:54.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.452+0000 7fade80b8740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5592783423e0 con 0x5592783237b0 2024-09-19T08:59:54.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.452+0000 7fade80b8740 10 client.0 _ll_register_callbacks cb 0x559277f978c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:54.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.452+0000 7faddf7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5592783237b0 0x55927832df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:54.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.452+0000 7faddf7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5592783237b0 0x55927832df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:47202/0 (socket says 172.21.15.92:47202) 2024-09-19T08:59:54.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.452+0000 7faddf7fe640 1 -- 172.21.15.92:0/3516420243 learned_addr learned my addr 172.21.15.92:0/3516420243 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:54.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.452+0000 7faddffff640 1 --2- 172.21.15.92:0/3516420243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55927832e550 0x55927832ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:54.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.452+0000 7faddeffd640 1 --2- 172.21.15.92:0/3516420243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559278324d20 0x55927832b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:54.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.452+0000 7faddf7fe640 1 -- 172.21.15.92:0/3516420243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559278324d20 msgr2=0x55927832b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:54.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.452+0000 7faddf7fe640 1 --2- 172.21.15.92:0/3516420243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559278324d20 0x55927832b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.452+0000 7faddf7fe640 1 -- 172.21.15.92:0/3516420243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55927832e550 msgr2=0x55927832ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:54.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.452+0000 7faddf7fe640 1 --2- 172.21.15.92:0/3516420243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55927832e550 0x55927832ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.453+0000 7faddf7fe640 1 -- 172.21.15.92:0/3516420243 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559277ffa3c0 con 0x5592783237b0 2024-09-19T08:59:54.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.453+0000 7faddeffd640 1 --2- 172.21.15.92:0/3516420243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559278324d20 0x55927832b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:59:54.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.453+0000 7faddf7fe640 1 --2- 172.21.15.92:0/3516420243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5592783237b0 0x55927832df90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fadd0006fd0 tx=0x7fadd00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72d22633ba4d650e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:54.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.453+0000 7fadbeffd640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T08:59:54.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.453+0000 7fadbeffd640 1 -- 172.21.15.92:0/3516420243 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd0025060 con 0x5592783237b0 2024-09-19T08:59:54.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.453+0000 7fade80b8740 1 -- 172.21.15.92:0/3516420243 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadd80158f0 con 0x5592783237b0 2024-09-19T08:59:54.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.453+0000 7fadbeffd640 1 -- 172.21.15.92:0/3516420243 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fadd0015dd0 con 0x5592783237b0 2024-09-19T08:59:54.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.454+0000 7fadbeffd640 1 -- 172.21.15.92:0/3516420243 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fadd000f040 con 0x5592783237b0 2024-09-19T08:59:54.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.454+0000 7fade80b8740 10 client.25471 fetch_fsmap learned FSMap version 19 2024-09-19T08:59:54.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.454+0000 7fade80b8740 1 -- 172.21.15.92:0/3516420243 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55927834ddf0 con 0x5592783237b0 2024-09-19T08:59:54.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.454+0000 7fadbeffd640 1 -- 172.21.15.92:0/3516420243 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fadd80158f0 con 0x5592783237b0 2024-09-19T08:59:54.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.454+0000 7fadbeffd640 1 -- 172.21.15.92:0/3516420243 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fadd0012030 con 0x5592783237b0 2024-09-19T08:59:54.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.454+0000 7fade80b8740 10 client.25471 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:59:54.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.454+0000 7fade80b8740 10 client.25471 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:59:54.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.454+0000 7fade80b8740 20 client.25471 populate_metadata read hostname 'smithi092' 2024-09-19T08:59:54.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.455+0000 7fade80b8740 1 --2- 172.21.15.92:0/3516420243 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55927834f200 0x559278351650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:54.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.455+0000 7fade80b8740 4 client.25471 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:59:54.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.455+0000 7fade80b8740 1 -- 172.21.15.92:0/3516420243 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559278296860 con 0x55927834f200 2024-09-19T08:59:54.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.455+0000 7faddeffd640 1 --2- 172.21.15.92:0/3516420243 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55927834f200 0x559278351650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:54.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.456+0000 7faddeffd640 1 --2- 172.21.15.92:0/3516420243 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55927834f200 0x559278351650 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d4961f66458caa1 server_cookie=d956f00c4ffb388a in_seq=0 out_seq=0 2024-09-19T08:59:54.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.456+0000 7fadbeffd640 10 client.25471 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:54.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.456+0000 7fadbeffd640 1 -- 172.21.15.92:0/3516420243 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559278296860 con 0x55927834f200 2024-09-19T08:59:54.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.456+0000 7fadbeffd640 10 client.25471 handle_command_reply: tid=0 2024-09-19T08:59:54.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.456+0000 7fade80b8740 1 client.25471 shutdown 2024-09-19T08:59:54.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.457+0000 7fade80b8740 1 -- 172.21.15.92:0/3516420243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5592783237b0 msgr2=0x55927832df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:54.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.457+0000 7fade80b8740 1 --2- 172.21.15.92:0/3516420243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5592783237b0 0x55927832df90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fadd0006fd0 tx=0x7fadd00046c0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.457+0000 7fade80b8740 1 -- 172.21.15.92:0/3516420243 shutdown_connections 2024-09-19T08:59:54.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.457+0000 7fade80b8740 1 --2- 172.21.15.92:0/3516420243 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55927834f200 0x559278351650 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.457+0000 7fade80b8740 1 --2- 172.21.15.92:0/3516420243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55927832e550 0x55927832ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.457+0000 7fade80b8740 1 --2- 172.21.15.92:0/3516420243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559278324d20 0x55927832b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.457+0000 7fade80b8740 1 --2- 172.21.15.92:0/3516420243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5592783237b0 0x55927832df90 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.457+0000 7fade80b8740 1 -- 172.21.15.92:0/3516420243 >> 172.21.15.92:0/3516420243 conn(0x5592782ec310 msgr2=0x559278325b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:54.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.457+0000 7fadbeffd640 0 client.25471 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:54.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.457+0000 7fade80b8740 1 -- 172.21.15.92:0/3516420243 shutdown_connections 2024-09-19T08:59:54.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.458+0000 7fade80b8740 1 -- 172.21.15.92:0/3516420243 wait complete. 2024-09-19T08:59:54.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.458+0000 7fade80b8740 20 client.25471 trim_cache size 0 max 16384 2024-09-19T08:59:54.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.479+0000 7fade80b8740 1 Processor -- start 2024-09-19T08:59:54.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.479+0000 7fade80b8740 1 -- start start 2024-09-19T08:59:54.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.479+0000 7fade80b8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5592783237b0 0x559278326300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:54.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.479+0000 7fade80b8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559278324d20 0x559278326840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:54.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.479+0000 7fade80b8740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55927832e550 0x559278356f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:54.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.479+0000 7fade80b8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fade0080ed0 con 0x559278324d20 2024-09-19T08:59:54.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.479+0000 7fade80b8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fade01abc00 con 0x5592783237b0 2024-09-19T08:59:54.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.479+0000 7fade80b8740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fade0081560 con 0x55927832e550 2024-09-19T08:59:54.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.479+0000 7faddf7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5592783237b0 0x559278326300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:54.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.480+0000 7faddf7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5592783237b0 0x559278326300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:43752/0 (socket says 172.21.15.92:43752) 2024-09-19T08:59:54.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.480+0000 7faddf7fe640 1 -- 172.21.15.92:0/1423203441 learned_addr learned my addr 172.21.15.92:0/1423203441 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:54.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.480+0000 7faddeffd640 1 --2- 172.21.15.92:0/1423203441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559278324d20 0x559278326840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:54.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.480+0000 7faddffff640 1 --2- 172.21.15.92:0/1423203441 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55927832e550 0x559278356f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:54.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.480+0000 7faddf7fe640 1 -- 172.21.15.92:0/1423203441 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55927832e550 msgr2=0x559278356f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:54.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.480+0000 7faddf7fe640 1 --2- 172.21.15.92:0/1423203441 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55927832e550 0x559278356f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.480+0000 7faddf7fe640 1 -- 172.21.15.92:0/1423203441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559278324d20 msgr2=0x559278326840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:54.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.480+0000 7faddf7fe640 1 --2- 172.21.15.92:0/1423203441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559278324d20 0x559278326840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.480+0000 7faddf7fe640 1 -- 172.21.15.92:0/1423203441 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592783234b0 con 0x5592783237b0 2024-09-19T08:59:54.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.480+0000 7faddf7fe640 1 --2- 172.21.15.92:0/1423203441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5592783237b0 0x559278326300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fadd0000c00 tx=0x7fadd00139c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d23620887661617 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:54.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.481+0000 7fadd57fa640 1 -- 172.21.15.92:0/1423203441 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd002f080 con 0x5592783237b0 2024-09-19T08:59:54.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.481+0000 7fadd57fa640 1 -- 172.21.15.92:0/1423203441 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fadd0013e50 con 0x5592783237b0 2024-09-19T08:59:54.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.481+0000 7fadd57fa640 1 -- 172.21.15.92:0/1423203441 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd0006040 con 0x5592783237b0 2024-09-19T08:59:54.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.482+0000 7fade80b8740 1 -- 172.21.15.92:0/1423203441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5592783237b0 msgr2=0x559278326300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:54.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.482+0000 7fade80b8740 1 --2- 172.21.15.92:0/1423203441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5592783237b0 0x559278326300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fadd0000c00 tx=0x7fadd00139c0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.482+0000 7fade80b8740 1 -- 172.21.15.92:0/1423203441 shutdown_connections 2024-09-19T08:59:54.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.482+0000 7fade80b8740 1 --2- 172.21.15.92:0/1423203441 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55927832e550 0x559278356f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.482+0000 7fade80b8740 1 --2- 172.21.15.92:0/1423203441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559278324d20 0x559278326840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.482+0000 7fade80b8740 1 --2- 172.21.15.92:0/1423203441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5592783237b0 0x559278326300 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.482+0000 7fade80b8740 1 -- 172.21.15.92:0/1423203441 >> 172.21.15.92:0/1423203441 conn(0x5592782ec310 msgr2=0x55927832a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:54.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.482+0000 7fade80b8740 1 -- 172.21.15.92:0/1423203441 shutdown_connections 2024-09-19T08:59:54.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.482+0000 7fade80b8740 1 -- 172.21.15.92:0/1423203441 wait complete. 2024-09-19T08:59:54.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.483+0000 7fade80b8740 1 -- start start 2024-09-19T08:59:54.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.483+0000 7fade80b8740 1 Processor -- start 2024-09-19T08:59:54.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.484+0000 7fade80b8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5592783237b0 0x559278347b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:54.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.484+0000 7fade80b8740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559278324d20 0x559278327e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:54.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.484+0000 7fade80b8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55927832e550 0x559278328350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:54.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.484+0000 7fade80b8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fade0081c30 con 0x55927832e550 2024-09-19T08:59:54.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.484+0000 7fade80b8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fade00830a0 con 0x5592783237b0 2024-09-19T08:59:54.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.484+0000 7fade80b8740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fade0082300 con 0x559278324d20 2024-09-19T08:59:54.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.484+0000 7fade80b8740 10 client.0 _ll_register_callbacks cb 0x7fadd000ea30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:54.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.484+0000 7faddeffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559278324d20 0x559278327e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:54.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.484+0000 7faddeffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559278324d20 0x559278327e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:47222/0 (socket says 172.21.15.92:47222) 2024-09-19T08:59:54.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.484+0000 7faddeffd640 1 -- 172.21.15.92:0/2832679112 learned_addr learned my addr 172.21.15.92:0/2832679112 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:54.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.484+0000 7faddf7fe640 1 --2- 172.21.15.92:0/2832679112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5592783237b0 0x559278347b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:54.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.485+0000 7faddffff640 1 --2- 172.21.15.92:0/2832679112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55927832e550 0x559278328350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:54.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.485+0000 7faddeffd640 1 -- 172.21.15.92:0/2832679112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5592783237b0 msgr2=0x559278347b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:54.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.485+0000 7faddeffd640 1 --2- 172.21.15.92:0/2832679112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5592783237b0 0x559278347b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.485+0000 7faddeffd640 1 -- 172.21.15.92:0/2832679112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55927832e550 msgr2=0x559278328350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:54.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.485+0000 7faddeffd640 1 --2- 172.21.15.92:0/2832679112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55927832e550 0x559278328350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.485+0000 7faddeffd640 1 -- 172.21.15.92:0/2832679112 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55927832c230 con 0x559278324d20 2024-09-19T08:59:54.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.485+0000 7faddf7fe640 1 --2- 172.21.15.92:0/2832679112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5592783237b0 0x559278347b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:59:54.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.485+0000 7faddffff640 1 --2- 172.21.15.92:0/2832679112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55927832e550 0x559278328350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:59:54.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.486+0000 7faddeffd640 1 --2- 172.21.15.92:0/2832679112 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559278324d20 0x559278327e10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fadc80b9160 tx=0x7fadc803ffb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9815817af7a385a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:54.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.486+0000 7fadbeffd640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T08:59:54.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.486+0000 7fadbeffd640 1 -- 172.21.15.92:0/2832679112 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc8049040 con 0x559278324d20 2024-09-19T08:59:54.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.486+0000 7fadbeffd640 1 -- 172.21.15.92:0/2832679112 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fadc803b610 con 0x559278324d20 2024-09-19T08:59:54.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.486+0000 7fade80b8740 1 -- 172.21.15.92:0/2832679112 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadd0013e50 con 0x559278324d20 2024-09-19T08:59:54.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.487+0000 7fadbeffd640 1 -- 172.21.15.92:0/2832679112 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fadc80bc0f0 con 0x559278324d20 2024-09-19T08:59:54.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.487+0000 7fade80b8740 10 client.25477 fetch_fsmap learned FSMap version 19 2024-09-19T08:59:54.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.487+0000 7fade80b8740 1 -- 172.21.15.92:0/2832679112 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5592783b9b30 con 0x559278324d20 2024-09-19T08:59:54.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.487+0000 7fadbeffd640 1 -- 172.21.15.92:0/2832679112 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fadd0013e50 con 0x559278324d20 2024-09-19T08:59:54.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.487+0000 7fadbeffd640 1 -- 172.21.15.92:0/2832679112 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fadc80f3ce0 con 0x559278324d20 2024-09-19T08:59:54.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.487+0000 7fade80b8740 10 client.25477 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:59:54.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.487+0000 7fade80b8740 10 client.25477 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:59:54.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.487+0000 7fade80b8740 20 client.25477 populate_metadata read hostname 'smithi092' 2024-09-19T08:59:54.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.487+0000 7fade80b8740 1 --2- 172.21.15.92:0/2832679112 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5592783ba2b0 0x5592783bc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:54.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.487+0000 7fade80b8740 4 client.25477 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:59:54.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.487+0000 7fade80b8740 1 -- 172.21.15.92:0/2832679112 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559278290d70 con 0x5592783ba2b0 2024-09-19T08:59:54.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.488+0000 7faddf7fe640 1 --2- 172.21.15.92:0/2832679112 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5592783ba2b0 0x5592783bc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:54.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.488+0000 7faddf7fe640 1 --2- 172.21.15.92:0/2832679112 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5592783ba2b0 0x5592783bc6d0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84bed8c6081a4ef1 server_cookie=f4b8d4a4d241b3db in_seq=0 out_seq=0 2024-09-19T08:59:54.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.488+0000 7fadbeffd640 10 client.25477 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:54.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.489+0000 7fadbeffd640 1 -- 172.21.15.92:0/2832679112 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559278290d70 con 0x5592783ba2b0 2024-09-19T08:59:54.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.489+0000 7fadbeffd640 10 client.25477 handle_command_reply: tid=0 2024-09-19T08:59:54.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.489+0000 7fade80b8740 1 client.25477 shutdown 2024-09-19T08:59:54.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.489+0000 7fade80b8740 1 -- 172.21.15.92:0/2832679112 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559278324d20 msgr2=0x559278327e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:54.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.489+0000 7fade80b8740 1 --2- 172.21.15.92:0/2832679112 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559278324d20 0x559278327e10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fadc80b9160 tx=0x7fadc803ffb0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.490+0000 7fade80b8740 1 -- 172.21.15.92:0/2832679112 shutdown_connections 2024-09-19T08:59:54.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.490+0000 7fade80b8740 1 --2- 172.21.15.92:0/2832679112 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5592783ba2b0 0x5592783bc6d0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.490+0000 7fadbeffd640 0 client.25477 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:54.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.490+0000 7fade80b8740 1 --2- 172.21.15.92:0/2832679112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55927832e550 0x559278328350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.490+0000 7fade80b8740 1 --2- 172.21.15.92:0/2832679112 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559278324d20 0x559278327e10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.490+0000 7fade80b8740 1 --2- 172.21.15.92:0/2832679112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5592783237b0 0x559278347b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.490+0000 7fade80b8740 1 -- 172.21.15.92:0/2832679112 >> 172.21.15.92:0/2832679112 conn(0x5592782ec310 msgr2=0x55927831e780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:54.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.490+0000 7fade80b8740 1 -- 172.21.15.92:0/2832679112 shutdown_connections 2024-09-19T08:59:54.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.490+0000 7fade80b8740 1 -- 172.21.15.92:0/2832679112 wait complete. 2024-09-19T08:59:54.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.491+0000 7fade80b8740 20 client.25477 trim_cache size 0 max 16384 2024-09-19T08:59:54.492 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-19T08:59:54.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.493+0000 7fade4a7d640 1 -- 172.21.15.92:0/3768887523 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fadcc0a3450 msgr2=0x7fadcc0a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:54.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.493+0000 7fade4a7d640 1 --2- 172.21.15.92:0/3768887523 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fadcc0a3450 0x7fadcc0a5910 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x559278320ca0 tx=0x7fadd0008040 comp rx=0 tx=0).stop 2024-09-19T08:59:54.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.493+0000 7fade4a7d640 1 -- 172.21.15.92:0/3768887523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fade0108c30 msgr2=0x7fade01a4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:54.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.493+0000 7fade4a7d640 1 --2- 172.21.15.92:0/3768887523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fade0108c30 0x7fade01a4bf0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fadc8005ab0 tx=0x7fadc8003bb0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.493+0000 7fade4a7d640 1 -- 172.21.15.92:0/3768887523 shutdown_connections 2024-09-19T08:59:54.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.493+0000 7fade4a7d640 1 --2- 172.21.15.92:0/3768887523 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fade010d330 0x7fade019e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.493+0000 7fade4a7d640 1 --2- 172.21.15.92:0/3768887523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fade0108c30 0x7fade01a4bf0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.493+0000 7fade4a7d640 1 --2- 172.21.15.92:0/3768887523 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fadcc0a3450 0x7fadcc0a5910 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.493+0000 7fade4a7d640 1 --2- 172.21.15.92:0/3768887523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fade0108280 0x7fade01a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.493+0000 7fade4a7d640 1 -- 172.21.15.92:0/3768887523 >> 172.21.15.92:0/3768887523 conn(0x7fade0077970 msgr2=0x7fade0078d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:54.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.493+0000 7fade4a7d640 1 -- 172.21.15.92:0/3768887523 shutdown_connections 2024-09-19T08:59:54.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:54.493+0000 7fade4a7d640 1 -- 172.21.15.92:0/3768887523 wait complete. 2024-09-19T08:59:55.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:55 smithi092 ceph-mon[31407]: pgmap v433: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.7 MiB/s wr, 516 op/s 2024-09-19T08:59:55.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 190.0 s, 5013.0 tps, lat 19.936 ms stddev 23.494 2024-09-19T08:59:55.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:55 smithi167 ceph-mon[35359]: pgmap v433: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.7 MiB/s wr, 516 op/s 2024-09-19T08:59:55.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:55 smithi190 ceph-mon[35358]: pgmap v433: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.7 MiB/s wr, 516 op/s 2024-09-19T08:59:56.519 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:59:56.519 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:59:56.932 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:59:57.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.464+0000 7fc717e80640 1 -- 172.21.15.92:0/835695875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc710101df0 msgr2=0x7fc7101021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:57.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.464+0000 7fc717e80640 1 --2- 172.21.15.92:0/835695875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc710101df0 0x7fc7101021d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc70c009860 tx=0x7fc70c02a340 comp rx=0 tx=0).stop 2024-09-19T08:59:57.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.465+0000 7fc717e80640 1 -- 172.21.15.92:0/835695875 shutdown_connections 2024-09-19T08:59:57.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.465+0000 7fc717e80640 1 --2- 172.21.15.92:0/835695875 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc710106f20 0x7fc71010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:57.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.465+0000 7fc717e80640 1 --2- 172.21.15.92:0/835695875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7101027a0 0x7fc7101067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:57.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.465+0000 7fc717e80640 1 --2- 172.21.15.92:0/835695875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc710101df0 0x7fc7101021d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:57.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.465+0000 7fc717e80640 1 -- 172.21.15.92:0/835695875 >> 172.21.15.92:0/835695875 conn(0x7fc7100fd8f0 msgr2=0x7fc7100ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:57.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.465+0000 7fc717e80640 1 -- 172.21.15.92:0/835695875 shutdown_connections 2024-09-19T08:59:57.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.466+0000 7fc717e80640 1 -- 172.21.15.92:0/835695875 wait complete. 2024-09-19T08:59:57.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.467+0000 7fc717e80640 1 Processor -- start 2024-09-19T08:59:57.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.467+0000 7fc717e80640 1 -- start start 2024-09-19T08:59:57.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.467+0000 7fc717e80640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc710101df0 0x7fc7101983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:57.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.467+0000 7fc717e80640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7101027a0 0x7fc710198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:57.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.467+0000 7fc717e80640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc710106f20 0x7fc71019cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:57.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.467+0000 7fc717e80640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc710111f80 con 0x7fc7101027a0 2024-09-19T08:59:57.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.467+0000 7fc717e80640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc710111e00 con 0x7fc710106f20 2024-09-19T08:59:57.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.467+0000 7fc717e80640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc710112100 con 0x7fc710101df0 2024-09-19T08:59:57.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.467+0000 7fc71641d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc710106f20 0x7fc71019cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:57.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.467+0000 7fc71641d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc710106f20 0x7fc71019cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:43762/0 (socket says 172.21.15.92:43762) 2024-09-19T08:59:57.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.467+0000 7fc71641d640 1 -- 172.21.15.92:0/1956625676 learned_addr learned my addr 172.21.15.92:0/1956625676 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:57.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.468+0000 7fc71641d640 1 -- 172.21.15.92:0/1956625676 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc710101df0 msgr2=0x7fc7101983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:57.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.468+0000 7fc71641d640 1 --2- 172.21.15.92:0/1956625676 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc710101df0 0x7fc7101983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:57.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.468+0000 7fc71641d640 1 -- 172.21.15.92:0/1956625676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7101027a0 msgr2=0x7fc710198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:57.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.468+0000 7fc71641d640 1 --2- 172.21.15.92:0/1956625676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7101027a0 0x7fc710198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:57.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.468+0000 7fc71641d640 1 -- 172.21.15.92:0/1956625676 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc71019d370 con 0x7fc710106f20 2024-09-19T08:59:57.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.468+0000 7fc71641d640 1 --2- 172.21.15.92:0/1956625676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc710106f20 0x7fc71019cc90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc70800cce0 tx=0x7fc70800a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:57.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.469+0000 7fc706ffd640 1 -- 172.21.15.92:0/1956625676 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70800f450 con 0x7fc710106f20 2024-09-19T08:59:57.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.469+0000 7fc706ffd640 1 -- 172.21.15.92:0/1956625676 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc70800fad0 con 0x7fc710106f20 2024-09-19T08:59:57.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.469+0000 7fc706ffd640 1 -- 172.21.15.92:0/1956625676 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70800ebe0 con 0x7fc710106f20 2024-09-19T08:59:57.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.469+0000 7fc717e80640 1 -- 172.21.15.92:0/1956625676 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc71019d660 con 0x7fc710106f20 2024-09-19T08:59:57.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.469+0000 7fc717e80640 1 -- 172.21.15.92:0/1956625676 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc710074420 con 0x7fc710106f20 2024-09-19T08:59:57.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.471+0000 7fc706ffd640 1 -- 172.21.15.92:0/1956625676 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc708018400 con 0x7fc710106f20 2024-09-19T08:59:57.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.472+0000 7fc706ffd640 1 --2- 172.21.15.92:0/1956625676 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc6fc0a3410 0x7fc6fc0a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:57.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.473+0000 7fc706ffd640 1 -- 172.21.15.92:0/1956625676 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc7080cf910 con 0x7fc710106f20 2024-09-19T08:59:57.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.473+0000 7fc715c1c640 1 --2- 172.21.15.92:0/1956625676 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc6fc0a3410 0x7fc6fc0a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:57.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.474+0000 7fc71a259740 1 Processor -- start 2024-09-19T08:59:57.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.474+0000 7fc71a259740 1 -- start start 2024-09-19T08:59:57.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.474+0000 7fc715c1c640 1 --2- 172.21.15.92:0/1956625676 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc6fc0a3410 0x7fc6fc0a58d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc70c02a860 tx=0x7fc70c0058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:57.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.474+0000 7fc71a259740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555b0cfea370 0x555b0cfea750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:57.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.474+0000 7fc71a259740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b0cfeac90 0x555b0cff5010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:57.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.474+0000 7fc71a259740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555b0cff5550 0x555b0cff7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:57.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.474+0000 7fc71a259740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555b0cf47280 con 0x555b0cfeac90 2024-09-19T08:59:57.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.474+0000 7fc71a259740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x555b0ceeeb10 con 0x555b0cfea370 2024-09-19T08:59:57.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.474+0000 7fc71a259740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x555b0cf43240 con 0x555b0cff5550 2024-09-19T08:59:57.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.475+0000 7fc71641d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555b0cff5550 0x555b0cff7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:57.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.475+0000 7fc71641d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555b0cff5550 0x555b0cff7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:47242/0 (socket says 172.21.15.92:47242) 2024-09-19T08:59:57.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.475+0000 7fc71641d640 1 -- 172.21.15.92:0/3121768600 learned_addr learned my addr 172.21.15.92:0/3121768600 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:57.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.475+0000 7fc71641d640 1 -- 172.21.15.92:0/3121768600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555b0cfea370 msgr2=0x555b0cfea750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:57.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.475+0000 7fc71641d640 1 --2- 172.21.15.92:0/3121768600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555b0cfea370 0x555b0cfea750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:57.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.475+0000 7fc71641d640 1 -- 172.21.15.92:0/3121768600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b0cfeac90 msgr2=0x555b0cff5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:57.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.475+0000 7fc71641d640 1 --2- 172.21.15.92:0/3121768600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b0cfeac90 0x555b0cff5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:57.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.475+0000 7fc71641d640 1 -- 172.21.15.92:0/3121768600 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b0cefb1f0 con 0x555b0cff5550 2024-09-19T08:59:57.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.475+0000 7fc71641d640 1 --2- 172.21.15.92:0/3121768600 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555b0cff5550 0x555b0cff7940 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc70809ccd0 tx=0x7fc70809d6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b1026cb56861935 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:57.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.476+0000 7fc6fbfff640 1 -- 172.21.15.92:0/3121768600 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7080b4070 con 0x555b0cff5550 2024-09-19T08:59:57.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.476+0000 7fc6fbfff640 1 -- 172.21.15.92:0/3121768600 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7080a5c40 con 0x555b0cff5550 2024-09-19T08:59:57.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.476+0000 7fc6fbfff640 1 -- 172.21.15.92:0/3121768600 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70800e3b0 con 0x555b0cff5550 2024-09-19T08:59:57.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.477+0000 7fc71a259740 1 -- 172.21.15.92:0/3121768600 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555b0cff5550 msgr2=0x555b0cff7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:57.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.477+0000 7fc71a259740 1 --2- 172.21.15.92:0/3121768600 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555b0cff5550 0x555b0cff7940 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc70809ccd0 tx=0x7fc70809d6d0 comp rx=0 tx=0).stop 2024-09-19T08:59:57.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.477+0000 7fc71a259740 1 -- 172.21.15.92:0/3121768600 shutdown_connections 2024-09-19T08:59:57.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.477+0000 7fc71a259740 1 --2- 172.21.15.92:0/3121768600 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555b0cff5550 0x555b0cff7940 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:57.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.477+0000 7fc71a259740 1 --2- 172.21.15.92:0/3121768600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b0cfeac90 0x555b0cff5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:57.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.477+0000 7fc71a259740 1 --2- 172.21.15.92:0/3121768600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555b0cfea370 0x555b0cfea750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:57.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.477+0000 7fc71a259740 1 -- 172.21.15.92:0/3121768600 >> 172.21.15.92:0/3121768600 conn(0x555b0cfe6900 msgr2=0x555b0cfe6ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:57.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.477+0000 7fc71a259740 1 -- 172.21.15.92:0/3121768600 shutdown_connections 2024-09-19T08:59:57.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.477+0000 7fc71a259740 1 -- 172.21.15.92:0/3121768600 wait complete. 2024-09-19T08:59:57.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.477+0000 7fc71a259740 1 -- start start 2024-09-19T08:59:57.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.478+0000 7fc71a259740 1 Processor -- start 2024-09-19T08:59:57.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.478+0000 7fc71a259740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555b0cfea370 0x555b0cff2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:57.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.478+0000 7fc71a259740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555b0cfeac90 0x555b0cff28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:57.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.478+0000 7fc71a259740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b0cff5550 0x555b0cff2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:57.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.478+0000 7fc71a259740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555b0cff8120 con 0x555b0cff5550 2024-09-19T08:59:57.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.478+0000 7fc71a259740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x555b0cf01f10 con 0x555b0cfeac90 2024-09-19T08:59:57.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.478+0000 7fc71a259740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x555b0cff82a0 con 0x555b0cfea370 2024-09-19T08:59:57.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.478+0000 7fc715c1c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555b0cfea370 0x555b0cff2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:57.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.478+0000 7fc715c1c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555b0cfea370 0x555b0cff2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:47252/0 (socket says 172.21.15.92:47252) 2024-09-19T08:59:57.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.478+0000 7fc715c1c640 1 -- 172.21.15.92:0/3338310229 learned_addr learned my addr 172.21.15.92:0/3338310229 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:57.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.478+0000 7fc71541b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555b0cfeac90 0x555b0cff28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:57.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.478+0000 7fc71641d640 1 --2- 172.21.15.92:0/3338310229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b0cff5550 0x555b0cff2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:57.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.479+0000 7fc71a259740 10 client.0 _ll_register_callbacks cb 0x555b0cecaa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:57.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.479+0000 7fc715c1c640 1 -- 172.21.15.92:0/3338310229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555b0cfeac90 msgr2=0x555b0cff28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:57.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.479+0000 7fc715c1c640 1 --2- 172.21.15.92:0/3338310229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555b0cfeac90 0x555b0cff28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:57.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.479+0000 7fc715c1c640 1 -- 172.21.15.92:0/3338310229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b0cff5550 msgr2=0x555b0cff2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:57.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.479+0000 7fc715c1c640 1 --2- 172.21.15.92:0/3338310229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b0cff5550 0x555b0cff2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:57.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.479+0000 7fc715c1c640 1 -- 172.21.15.92:0/3338310229 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b0ccb86a0 con 0x555b0cfea370 2024-09-19T08:59:57.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.479+0000 7fc71641d640 1 --2- 172.21.15.92:0/3338310229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b0cff5550 0x555b0cff2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:59:57.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.479+0000 7fc71541b640 1 --2- 172.21.15.92:0/3338310229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555b0cfeac90 0x555b0cff28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:57.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.479+0000 7fc715c1c640 1 --2- 172.21.15.92:0/3338310229 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555b0cfea370 0x555b0cff2390 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc70c034000 tx=0x7fc70c004090 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27887670420e3839 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:57.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.479+0000 7fc6f97fa640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T08:59:57.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.479+0000 7fc6f97fa640 1 -- 172.21.15.92:0/3338310229 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c04d060 con 0x555b0cfea370 2024-09-19T08:59:57.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.479+0000 7fc71a259740 1 -- 172.21.15.92:0/3338310229 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7080a5c40 con 0x555b0cfea370 2024-09-19T08:59:57.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.479+0000 7fc6f97fa640 1 -- 172.21.15.92:0/3338310229 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc70c030550 con 0x555b0cfea370 2024-09-19T08:59:57.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.479+0000 7fc6f97fa640 1 -- 172.21.15.92:0/3338310229 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc70c037040 con 0x555b0cfea370 2024-09-19T08:59:57.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.479+0000 7fc71a259740 10 client.25483 fetch_fsmap learned FSMap version 19 2024-09-19T08:59:57.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.479+0000 7fc71a259740 1 -- 172.21.15.92:0/3338310229 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x555b0d003d30 con 0x555b0cfea370 2024-09-19T08:59:57.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.482+0000 7fc6f97fa640 1 -- 172.21.15.92:0/3338310229 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7080a5c40 con 0x555b0cfea370 2024-09-19T08:59:57.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.482+0000 7fc6f97fa640 1 -- 172.21.15.92:0/3338310229 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fc70c03a030 con 0x555b0cfea370 2024-09-19T08:59:57.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.482+0000 7fc71a259740 10 client.25483 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:59:57.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.482+0000 7fc71a259740 10 client.25483 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:59:57.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.482+0000 7fc71a259740 20 client.25483 populate_metadata read hostname 'smithi092' 2024-09-19T08:59:57.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.482+0000 7fc71a259740 1 --2- 172.21.15.92:0/3338310229 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555b0d0051b0 0x555b0d007610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:57.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.482+0000 7fc71a259740 4 client.25483 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:59:57.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.482+0000 7fc71a259740 1 -- 172.21.15.92:0/3338310229 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555b0cf547f0 con 0x555b0d0051b0 2024-09-19T08:59:57.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.483+0000 7fc71541b640 1 --2- 172.21.15.92:0/3338310229 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555b0d0051b0 0x555b0d007610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:57.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.483+0000 7fc6f97fa640 10 client.25483 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:57.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.483+0000 7fc71541b640 1 --2- 172.21.15.92:0/3338310229 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555b0d0051b0 0x555b0d007610 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6ea5c0aacdbb988 server_cookie=4e5a1cbcc2c21af4 in_seq=0 out_seq=0 2024-09-19T08:59:57.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.484+0000 7fc6f97fa640 1 -- 172.21.15.92:0/3338310229 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555b0cf547f0 con 0x555b0d0051b0 2024-09-19T08:59:57.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.484+0000 7fc6f97fa640 10 client.25483 handle_command_reply: tid=0 2024-09-19T08:59:57.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.484+0000 7fc71a259740 1 client.25483 shutdown 2024-09-19T08:59:57.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.485+0000 7fc71a259740 1 -- 172.21.15.92:0/3338310229 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555b0cfea370 msgr2=0x555b0cff2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:57.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.485+0000 7fc71a259740 1 --2- 172.21.15.92:0/3338310229 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555b0cfea370 0x555b0cff2390 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc70c034000 tx=0x7fc70c004090 comp rx=0 tx=0).stop 2024-09-19T08:59:57.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.485+0000 7fc71a259740 1 -- 172.21.15.92:0/3338310229 shutdown_connections 2024-09-19T08:59:57.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.485+0000 7fc71a259740 1 --2- 172.21.15.92:0/3338310229 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555b0d0051b0 0x555b0d007610 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:57.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.485+0000 7fc71a259740 1 --2- 172.21.15.92:0/3338310229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b0cff5550 0x555b0cff2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:57.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.485+0000 7fc71a259740 1 --2- 172.21.15.92:0/3338310229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555b0cfeac90 0x555b0cff28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:57.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.485+0000 7fc71a259740 1 --2- 172.21.15.92:0/3338310229 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555b0cfea370 0x555b0cff2390 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:57.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.485+0000 7fc71a259740 1 -- 172.21.15.92:0/3338310229 >> 172.21.15.92:0/3338310229 conn(0x555b0cfe6900 msgr2=0x555b0cfec630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:57.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.485+0000 7fc6f97fa640 0 client.25483 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:57.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.485+0000 7fc71a259740 1 -- 172.21.15.92:0/3338310229 shutdown_connections 2024-09-19T08:59:57.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.485+0000 7fc71a259740 1 -- 172.21.15.92:0/3338310229 wait complete. 2024-09-19T08:59:57.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.485+0000 7fc71a259740 20 client.25483 trim_cache size 0 max 16384 2024-09-19T08:59:57.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.513+0000 7fc71a259740 1 Processor -- start 2024-09-19T08:59:57.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.513+0000 7fc71a259740 1 -- start start 2024-09-19T08:59:57.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.513+0000 7fc71a259740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555b0cfea370 0x555b0cff1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:57.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.513+0000 7fc71a259740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b0cfeac90 0x555b0d00cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:57.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.513+0000 7fc71a259740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555b0cff5550 0x555b0d00d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:57.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.513+0000 7fc71a259740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f400c4b0 con 0x555b0cfeac90 2024-09-19T08:59:57.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.513+0000 7fc71a259740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f400ed50 con 0x555b0cfea370 2024-09-19T08:59:57.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.513+0000 7fc71a259740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f400cb40 con 0x555b0cff5550 2024-09-19T08:59:57.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.513+0000 7fc715c1c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555b0cfea370 0x555b0cff1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:57.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.513+0000 7fc715c1c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555b0cfea370 0x555b0cff1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:43786/0 (socket says 172.21.15.92:43786) 2024-09-19T08:59:57.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.513+0000 7fc715c1c640 1 -- 172.21.15.92:0/1940689977 learned_addr learned my addr 172.21.15.92:0/1940689977 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:57.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.514+0000 7fc71541b640 1 --2- 172.21.15.92:0/1940689977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b0cfeac90 0x555b0d00cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:57.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.514+0000 7fc71641d640 1 --2- 172.21.15.92:0/1940689977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555b0cff5550 0x555b0d00d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:57.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.514+0000 7fc715c1c640 1 -- 172.21.15.92:0/1940689977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555b0cff5550 msgr2=0x555b0d00d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:57.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.514+0000 7fc715c1c640 1 --2- 172.21.15.92:0/1940689977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555b0cff5550 0x555b0d00d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:57.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.514+0000 7fc715c1c640 1 -- 172.21.15.92:0/1940689977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b0cfeac90 msgr2=0x555b0d00cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:57.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.514+0000 7fc715c1c640 1 --2- 172.21.15.92:0/1940689977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b0cfeac90 0x555b0d00cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:57.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.514+0000 7fc715c1c640 1 -- 172.21.15.92:0/1940689977 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b0cfeaac0 con 0x555b0cfea370 2024-09-19T08:59:57.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.514+0000 7fc715c1c640 1 --2- 172.21.15.92:0/1940689977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555b0cfea370 0x555b0cff1240 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc70c035040 tx=0x7fc70c004180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97ae9eba33b6bf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:57.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.515+0000 7fc6fb7fe640 1 -- 172.21.15.92:0/1940689977 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c057070 con 0x555b0cfea370 2024-09-19T08:59:57.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.515+0000 7fc6fb7fe640 1 -- 172.21.15.92:0/1940689977 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc70c032940 con 0x555b0cfea370 2024-09-19T08:59:57.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.515+0000 7fc6fb7fe640 1 -- 172.21.15.92:0/1940689977 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c04d070 con 0x555b0cfea370 2024-09-19T08:59:57.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.516+0000 7fc71a259740 1 -- 172.21.15.92:0/1940689977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555b0cfea370 msgr2=0x555b0cff1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:57.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.516+0000 7fc71a259740 1 --2- 172.21.15.92:0/1940689977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555b0cfea370 0x555b0cff1240 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc70c035040 tx=0x7fc70c004180 comp rx=0 tx=0).stop 2024-09-19T08:59:57.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.516+0000 7fc71a259740 1 -- 172.21.15.92:0/1940689977 shutdown_connections 2024-09-19T08:59:57.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.516+0000 7fc71a259740 1 --2- 172.21.15.92:0/1940689977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555b0cff5550 0x555b0d00d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:57.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.516+0000 7fc71a259740 1 --2- 172.21.15.92:0/1940689977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b0cfeac90 0x555b0d00cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:57.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.516+0000 7fc71a259740 1 --2- 172.21.15.92:0/1940689977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555b0cfea370 0x555b0cff1240 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:57.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.516+0000 7fc71a259740 1 -- 172.21.15.92:0/1940689977 >> 172.21.15.92:0/1940689977 conn(0x555b0cfe6900 msgr2=0x555b0cff0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:57.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.516+0000 7fc71a259740 1 -- 172.21.15.92:0/1940689977 shutdown_connections 2024-09-19T08:59:57.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.516+0000 7fc71a259740 1 -- 172.21.15.92:0/1940689977 wait complete. 2024-09-19T08:59:57.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.517+0000 7fc71a259740 1 -- start start 2024-09-19T08:59:57.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.517+0000 7fc71a259740 1 Processor -- start 2024-09-19T08:59:57.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.517+0000 7fc71a259740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b0cfea370 0x555b0cffdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:57.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.518+0000 7fc71a259740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555b0cfeac90 0x555b0cff9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:57.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.518+0000 7fc71a259740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555b0cff5550 0x555b0cff95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:57.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.518+0000 7fc71a259740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f400d210 con 0x555b0cfea370 2024-09-19T08:59:57.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.518+0000 7fc71a259740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f400e680 con 0x555b0cff5550 2024-09-19T08:59:57.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.518+0000 7fc71a259740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f400d8e0 con 0x555b0cfeac90 2024-09-19T08:59:57.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.518+0000 7fc71a259740 10 client.0 _ll_register_callbacks cb 0x7fc70c0096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:57.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.518+0000 7fc715c1c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b0cfea370 0x555b0cffdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:57.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.518+0000 7fc71641d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555b0cff5550 0x555b0cff95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:57.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.518+0000 7fc715c1c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b0cfea370 0x555b0cffdd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50322/0 (socket says 172.21.15.92:50322) 2024-09-19T08:59:57.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.518+0000 7fc71641d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555b0cff5550 0x555b0cff95a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:43790/0 (socket says 172.21.15.92:43790) 2024-09-19T08:59:57.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.518+0000 7fc715c1c640 1 -- 172.21.15.92:0/1708760056 learned_addr learned my addr 172.21.15.92:0/1708760056 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:57.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.518+0000 7fc71541b640 1 --2- 172.21.15.92:0/1708760056 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555b0cfeac90 0x555b0cff9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:57.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.518+0000 7fc71641d640 1 -- 172.21.15.92:0/1708760056 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555b0cfeac90 msgr2=0x555b0cff9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:57.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.518+0000 7fc71641d640 1 --2- 172.21.15.92:0/1708760056 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555b0cfeac90 0x555b0cff9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:57.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.518+0000 7fc71641d640 1 -- 172.21.15.92:0/1708760056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b0cfea370 msgr2=0x555b0cffdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:57.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.518+0000 7fc71641d640 1 --2- 172.21.15.92:0/1708760056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b0cfea370 0x555b0cffdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:57.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.518+0000 7fc71641d640 1 -- 172.21.15.92:0/1708760056 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b0cff9dd0 con 0x555b0cff5550 2024-09-19T08:59:57.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.519+0000 7fc71641d640 1 --2- 172.21.15.92:0/1708760056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555b0cff5550 0x555b0cff95a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc7080bc160 tx=0x7fc7080a5d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f96226eed04f6007 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:57.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.519+0000 7fc6f97fa640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T08:59:57.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.519+0000 7fc6f97fa640 1 -- 172.21.15.92:0/1708760056 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7080b4040 con 0x555b0cff5550 2024-09-19T08:59:57.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.519+0000 7fc6f97fa640 1 -- 172.21.15.92:0/1708760056 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc70800e3b0 con 0x555b0cff5550 2024-09-19T08:59:57.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.519+0000 7fc71a259740 1 -- 172.21.15.92:0/1708760056 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555b0cf4ed00 con 0x555b0cff5550 2024-09-19T08:59:57.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.519+0000 7fc6f97fa640 1 -- 172.21.15.92:0/1708760056 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc7080a57b0 con 0x555b0cff5550 2024-09-19T08:59:57.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.519+0000 7fc71a259740 10 client.25559 fetch_fsmap learned FSMap version 19 2024-09-19T08:59:57.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.519+0000 7fc71a259740 1 -- 172.21.15.92:0/1708760056 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x555b0d081020 con 0x555b0cff5550 2024-09-19T08:59:57.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.519+0000 7fc6f97fa640 1 -- 172.21.15.92:0/1708760056 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x555b0cf4ed00 con 0x555b0cff5550 2024-09-19T08:59:57.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.520+0000 7fc6f97fa640 1 -- 172.21.15.92:0/1708760056 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fc70801f020 con 0x555b0cff5550 2024-09-19T08:59:57.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.520+0000 7fc71a259740 10 client.25559 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:59:57.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.520+0000 7fc71a259740 10 client.25559 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:59:57.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.520+0000 7fc71a259740 20 client.25559 populate_metadata read hostname 'smithi092' 2024-09-19T08:59:57.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.520+0000 7fc71a259740 1 --2- 172.21.15.92:0/1708760056 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555b0d081360 0x555b0d083750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:57.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.521+0000 7fc71a259740 4 client.25559 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:59:57.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.521+0000 7fc71a259740 1 -- 172.21.15.92:0/1708760056 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x555b0cecb110 con 0x555b0d081360 2024-09-19T08:59:57.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.521+0000 7fc715c1c640 1 --2- 172.21.15.92:0/1708760056 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555b0d081360 0x555b0d083750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:57.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.521+0000 7fc715c1c640 1 --2- 172.21.15.92:0/1708760056 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555b0d081360 0x555b0d083750 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0d51d7b8bb470f5 server_cookie=ed13dfa5b3341ba8 in_seq=0 out_seq=0 2024-09-19T08:59:57.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.521+0000 7fc6f97fa640 10 client.25559 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:57.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.522+0000 7fc6f97fa640 1 -- 172.21.15.92:0/1708760056 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555b0cecb110 con 0x555b0d081360 2024-09-19T08:59:57.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.522+0000 7fc6f97fa640 10 client.25559 handle_command_reply: tid=0 2024-09-19T08:59:57.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.522+0000 7fc71a259740 1 client.25559 shutdown 2024-09-19T08:59:57.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.523+0000 7fc71a259740 1 -- 172.21.15.92:0/1708760056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555b0cff5550 msgr2=0x555b0cff95a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:57.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.523+0000 7fc71a259740 1 --2- 172.21.15.92:0/1708760056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555b0cff5550 0x555b0cff95a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc7080bc160 tx=0x7fc7080a5d80 comp rx=0 tx=0).stop 2024-09-19T08:59:57.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.523+0000 7fc71a259740 1 -- 172.21.15.92:0/1708760056 shutdown_connections 2024-09-19T08:59:57.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.523+0000 7fc71a259740 1 --2- 172.21.15.92:0/1708760056 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555b0d081360 0x555b0d083750 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:57.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.523+0000 7fc71a259740 1 --2- 172.21.15.92:0/1708760056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555b0cff5550 0x555b0cff95a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:57.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.523+0000 7fc6f97fa640 0 client.25559 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:57.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.523+0000 7fc71a259740 1 --2- 172.21.15.92:0/1708760056 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555b0cfeac90 0x555b0cff9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:57.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.523+0000 7fc71a259740 1 --2- 172.21.15.92:0/1708760056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555b0cfea370 0x555b0cffdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:57.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.523+0000 7fc71a259740 1 -- 172.21.15.92:0/1708760056 >> 172.21.15.92:0/1708760056 conn(0x555b0cfe6900 msgr2=0x555b0cfec630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:57.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.523+0000 7fc71a259740 1 -- 172.21.15.92:0/1708760056 shutdown_connections 2024-09-19T08:59:57.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.523+0000 7fc71a259740 1 -- 172.21.15.92:0/1708760056 wait complete. 2024-09-19T08:59:57.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.525+0000 7fc71a259740 20 client.25559 trim_cache size 0 max 16384 2024-09-19T08:59:57.526 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T08:59:57.526 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-19T08:59:57.526 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "c9bcaf2a-5129-4be1-8e99-02484ad5b586", 2024-09-19T08:59:57.526 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-19T08:59:57.526 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T08:59:57.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.526+0000 7fc717e80640 1 -- 172.21.15.92:0/1956625676 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc6fc0a3410 msgr2=0x7fc6fc0a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:57.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.526+0000 7fc717e80640 1 --2- 172.21.15.92:0/1956625676 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc6fc0a3410 0x7fc6fc0a58d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc70c02a860 tx=0x7fc70c0058b0 comp rx=0 tx=0).stop 2024-09-19T08:59:57.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.526+0000 7fc717e80640 1 -- 172.21.15.92:0/1956625676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc710106f20 msgr2=0x7fc71019cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:57.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.526+0000 7fc717e80640 1 --2- 172.21.15.92:0/1956625676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc710106f20 0x7fc71019cc90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc70800cce0 tx=0x7fc70800a620 comp rx=0 tx=0).stop 2024-09-19T08:59:57.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.526+0000 7fc717e80640 1 -- 172.21.15.92:0/1956625676 shutdown_connections 2024-09-19T08:59:57.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.526+0000 7fc717e80640 1 --2- 172.21.15.92:0/1956625676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc710106f20 0x7fc71019cc90 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:57.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.526+0000 7fc717e80640 1 --2- 172.21.15.92:0/1956625676 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc6fc0a3410 0x7fc6fc0a58d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:57.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.526+0000 7fc717e80640 1 --2- 172.21.15.92:0/1956625676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7101027a0 0x7fc710198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:57.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.526+0000 7fc717e80640 1 --2- 172.21.15.92:0/1956625676 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc710101df0 0x7fc7101983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:57.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.527+0000 7fc717e80640 1 -- 172.21.15.92:0/1956625676 >> 172.21.15.92:0/1956625676 conn(0x7fc7100fd8f0 msgr2=0x7fc7100fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:57.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.527+0000 7fc717e80640 1 -- 172.21.15.92:0/1956625676 shutdown_connections 2024-09-19T08:59:57.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:57.527+0000 7fc717e80640 1 -- 172.21.15.92:0/1956625676 wait complete. 2024-09-19T08:59:57.591 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:57 smithi092 ceph-mon[31407]: pgmap v434: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.1 MiB/s wr, 647 op/s 2024-09-19T08:59:57.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:57 smithi167 ceph-mon[35359]: pgmap v434: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.1 MiB/s wr, 647 op/s 2024-09-19T08:59:57.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:57 smithi190 ceph-mon[35358]: pgmap v434: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.1 MiB/s wr, 647 op/s 2024-09-19T08:59:58.368 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:59:58.752 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:59:58.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:58 smithi092 ceph-mon[31407]: scrub queued for path: / 2024-09-19T08:59:58.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:58 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T08:59:58.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:58 smithi092 ceph-mon[31407]: scrub summary: active paths [/] 2024-09-19T08:59:58.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:58 smithi167 ceph-mon[35359]: scrub queued for path: / 2024-09-19T08:59:58.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:58 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T08:59:58.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:58 smithi167 ceph-mon[35359]: scrub summary: active paths [/] 2024-09-19T08:59:58.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:58 smithi190 ceph-mon[35358]: scrub queued for path: / 2024-09-19T08:59:58.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:58 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T08:59:58.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:58 smithi190 ceph-mon[35358]: scrub summary: active paths [/] 2024-09-19T08:59:59.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.291+0000 7f6dfe694640 1 -- 172.21.15.92:0/246104906 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6df8108e00 msgr2=0x7f6df810ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:59.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.291+0000 7f6dfe694640 1 --2- 172.21.15.92:0/246104906 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6df8108e00 0x7f6df810ce00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6dec009900 tx=0x7f6dec02a3f0 comp rx=0 tx=0).stop 2024-09-19T08:59:59.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.291+0000 7f6dfe694640 1 -- 172.21.15.92:0/246104906 shutdown_connections 2024-09-19T08:59:59.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.291+0000 7f6dfe694640 1 --2- 172.21.15.92:0/246104906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6df810d530 0x7f6df81150b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:59.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.291+0000 7f6dfe694640 1 --2- 172.21.15.92:0/246104906 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6df8108e00 0x7f6df810ce00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:59.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.291+0000 7f6dfe694640 1 --2- 172.21.15.92:0/246104906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6df8108450 0x7f6df8108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:59.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.291+0000 7f6dfe694640 1 -- 172.21.15.92:0/246104906 >> 172.21.15.92:0/246104906 conn(0x7f6df8077ba0 msgr2=0x7f6df8079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:59.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.291+0000 7f6dfe694640 1 -- 172.21.15.92:0/246104906 shutdown_connections 2024-09-19T08:59:59.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.291+0000 7f6dfe694640 1 -- 172.21.15.92:0/246104906 wait complete. 2024-09-19T08:59:59.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.292+0000 7f6dfe694640 1 Processor -- start 2024-09-19T08:59:59.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.292+0000 7f6dfe694640 1 -- start start 2024-09-19T08:59:59.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.292+0000 7f6dfe694640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6df8108450 0x7f6df81a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:59.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.292+0000 7f6dfe694640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6df8108e00 0x7f6df81a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:59.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.293+0000 7f6dfe694640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6df810d530 0x7f6df819e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:59.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.293+0000 7f6dfe694640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6df8118580 con 0x7f6df8108e00 2024-09-19T08:59:59.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.293+0000 7f6dfe694640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6df8118400 con 0x7f6df8108450 2024-09-19T08:59:59.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.293+0000 7f6dfe694640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6df8118700 con 0x7f6df810d530 2024-09-19T08:59:59.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.293+0000 7f6df7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6df8108450 0x7f6df81a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:59.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.293+0000 7f6dfcc31640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6df810d530 0x7f6df819e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:59.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.293+0000 7f6dfcc31640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6df810d530 0x7f6df819e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:47280/0 (socket says 172.21.15.92:47280) 2024-09-19T08:59:59.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.293+0000 7f6df7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6df8108450 0x7f6df81a46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:43794/0 (socket says 172.21.15.92:43794) 2024-09-19T08:59:59.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.293+0000 7f6dfcc31640 1 -- 172.21.15.92:0/2702128078 learned_addr learned my addr 172.21.15.92:0/2702128078 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:59.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.293+0000 7f6df77fe640 1 --2- 172.21.15.92:0/2702128078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6df8108e00 0x7f6df81a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:59.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.293+0000 7f6dfcc31640 1 -- 172.21.15.92:0/2702128078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6df8108450 msgr2=0x7f6df81a46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:59.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.293+0000 7f6dfcc31640 1 --2- 172.21.15.92:0/2702128078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6df8108450 0x7f6df81a46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:59.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.293+0000 7f6dfcc31640 1 -- 172.21.15.92:0/2702128078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6df8108e00 msgr2=0x7f6df81a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:59.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.293+0000 7f6dfcc31640 1 --2- 172.21.15.92:0/2702128078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6df8108e00 0x7f6df81a4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:59.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.293+0000 7f6dfcc31640 1 -- 172.21.15.92:0/2702128078 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df819efc0 con 0x7f6df810d530 2024-09-19T08:59:59.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.293+0000 7f6df77fe640 1 --2- 172.21.15.92:0/2702128078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6df8108e00 0x7f6df81a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:59:59.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.294+0000 7f6dfcc31640 1 --2- 172.21.15.92:0/2702128078 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6df810d530 0x7f6df819e890 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6df000ea60 tx=0x7f6df000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:59.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.294+0000 7f6df57fa640 1 -- 172.21.15.92:0/2702128078 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df000ce40 con 0x7f6df810d530 2024-09-19T08:59:59.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.294+0000 7f6df57fa640 1 -- 172.21.15.92:0/2702128078 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6df0005020 con 0x7f6df810d530 2024-09-19T08:59:59.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.294+0000 7f6df57fa640 1 -- 172.21.15.92:0/2702128078 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df0010690 con 0x7f6df810d530 2024-09-19T08:59:59.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.294+0000 7f6dfe694640 1 -- 172.21.15.92:0/2702128078 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6df819f2b0 con 0x7f6df810d530 2024-09-19T08:59:59.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.294+0000 7f6dfe694640 1 -- 172.21.15.92:0/2702128078 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6df81ab5a0 con 0x7f6df810d530 2024-09-19T08:59:59.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.298+0000 7f6e00a6d740 1 Processor -- start 2024-09-19T08:59:59.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.298+0000 7f6df57fa640 1 -- 172.21.15.92:0/2702128078 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6df0005520 con 0x7f6df810d530 2024-09-19T08:59:59.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.299+0000 7f6e00a6d740 1 -- start start 2024-09-19T08:59:59.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.299+0000 7f6e00a6d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560763184a0 0x556076318880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:59.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.299+0000 7f6e00a6d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556076318dc0 0x556076323140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:59.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.299+0000 7f6e00a6d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556076323680 0x556076325a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:59.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.299+0000 7f6e00a6d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55607627e2e0 con 0x556076318dc0 2024-09-19T08:59:59.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.299+0000 7f6e00a6d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556076225ce0 con 0x5560763184a0 2024-09-19T08:59:59.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.299+0000 7f6e00a6d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55607627a2a0 con 0x556076323680 2024-09-19T08:59:59.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.299+0000 7f6df77fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560763184a0 0x556076318880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:59.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.299+0000 7f6df77fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560763184a0 0x556076318880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:43808/0 (socket says 172.21.15.92:43808) 2024-09-19T08:59:59.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.299+0000 7f6df77fe640 1 -- 172.21.15.92:0/257217394 learned_addr learned my addr 172.21.15.92:0/257217394 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:59.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.299+0000 7f6df77fe640 1 --2- 172.21.15.92:0/257217394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556076323680 0x556076325a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:59.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.299+0000 7f6df7fff640 1 --2- 172.21.15.92:0/257217394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556076318dc0 0x556076323140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:59.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.300+0000 7f6df77fe640 1 -- 172.21.15.92:0/257217394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556076323680 msgr2=0x556076325a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:59.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.300+0000 7f6df77fe640 1 --2- 172.21.15.92:0/257217394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556076323680 0x556076325a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:59.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.300+0000 7f6df77fe640 1 -- 172.21.15.92:0/257217394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556076318dc0 msgr2=0x556076323140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:59.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.300+0000 7f6df77fe640 1 --2- 172.21.15.92:0/257217394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556076318dc0 0x556076323140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:59.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.300+0000 7f6df77fe640 1 -- 172.21.15.92:0/257217394 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55607620a440 con 0x5560763184a0 2024-09-19T08:59:59.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.301+0000 7f6df77fe640 1 --2- 172.21.15.92:0/257217394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560763184a0 0x556076318880 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6dec0096c0 tx=0x7f6dec0056d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a010f11ef05e3b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:59.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.301+0000 7f6dde7fc640 1 -- 172.21.15.92:0/257217394 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec035040 con 0x5560763184a0 2024-09-19T08:59:59.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.301+0000 7f6dde7fc640 1 -- 172.21.15.92:0/257217394 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6dec031c90 con 0x5560763184a0 2024-09-19T08:59:59.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.301+0000 7f6dde7fc640 1 -- 172.21.15.92:0/257217394 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec03dc80 con 0x5560763184a0 2024-09-19T08:59:59.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.301+0000 7f6df57fa640 1 --2- 172.21.15.92:0/2702128078 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6de00a32c0 0x7f6de00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:59.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.302+0000 7f6df7fff640 1 --2- 172.21.15.92:0/2702128078 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6de00a32c0 0x7f6de00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:59.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.302+0000 7f6df57fa640 1 -- 172.21.15.92:0/2702128078 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f6df00cfea0 con 0x7f6df810d530 2024-09-19T08:59:59.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.302+0000 7f6e00a6d740 1 -- 172.21.15.92:0/257217394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560763184a0 msgr2=0x556076318880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:59.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.302+0000 7f6e00a6d740 1 --2- 172.21.15.92:0/257217394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560763184a0 0x556076318880 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6dec0096c0 tx=0x7f6dec0056d0 comp rx=0 tx=0).stop 2024-09-19T08:59:59.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.302+0000 7f6df7fff640 1 --2- 172.21.15.92:0/2702128078 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6de00a32c0 0x7f6de00a5780 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x556076315890 tx=0x7f6de8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:59.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.302+0000 7f6e00a6d740 1 -- 172.21.15.92:0/257217394 shutdown_connections 2024-09-19T08:59:59.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.302+0000 7f6e00a6d740 1 --2- 172.21.15.92:0/257217394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556076323680 0x556076325a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:59.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.302+0000 7f6e00a6d740 1 --2- 172.21.15.92:0/257217394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556076318dc0 0x556076323140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:59.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.302+0000 7f6e00a6d740 1 --2- 172.21.15.92:0/257217394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560763184a0 0x556076318880 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:59.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.302+0000 7f6e00a6d740 1 -- 172.21.15.92:0/257217394 >> 172.21.15.92:0/257217394 conn(0x556076314a30 msgr2=0x556076314e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:59.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.302+0000 7f6e00a6d740 1 -- 172.21.15.92:0/257217394 shutdown_connections 2024-09-19T08:59:59.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.302+0000 7f6e00a6d740 1 -- 172.21.15.92:0/257217394 wait complete. 2024-09-19T08:59:59.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.303+0000 7f6e00a6d740 1 -- start start 2024-09-19T08:59:59.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.304+0000 7f6e00a6d740 1 Processor -- start 2024-09-19T08:59:59.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.304+0000 7f6e00a6d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5560763184a0 0x556076323050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:59.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.304+0000 7f6e00a6d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556076318dc0 0x556076320300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:59.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.304+0000 7f6e00a6d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556076323680 0x5560763208f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:59.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.304+0000 7f6df7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5560763184a0 0x556076323050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:59.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.304+0000 7f6e00a6d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556076326250 con 0x5560763184a0 2024-09-19T08:59:59.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.304+0000 7f6e00a6d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556076239050 con 0x556076318dc0 2024-09-19T08:59:59.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.304+0000 7f6e00a6d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5560763263d0 con 0x556076323680 2024-09-19T08:59:59.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.304+0000 7f6df7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5560763184a0 0x556076323050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50366/0 (socket says 172.21.15.92:50366) 2024-09-19T08:59:59.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.304+0000 7f6df7fff640 1 -- 172.21.15.92:0/240371045 learned_addr learned my addr 172.21.15.92:0/240371045 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:59.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.304+0000 7f6df77fe640 1 --2- 172.21.15.92:0/240371045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556076318dc0 0x556076320300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:59.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.304+0000 7f6dfcc31640 1 --2- 172.21.15.92:0/240371045 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556076323680 0x5560763208f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:59.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.305+0000 7f6e00a6d740 10 client.0 _ll_register_callbacks cb 0x556076279160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:59.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.305+0000 7f6df7fff640 1 -- 172.21.15.92:0/240371045 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556076323680 msgr2=0x5560763208f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:59.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.305+0000 7f6df7fff640 1 --2- 172.21.15.92:0/240371045 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556076323680 0x5560763208f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:59.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.305+0000 7f6df7fff640 1 -- 172.21.15.92:0/240371045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556076318dc0 msgr2=0x556076320300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:59.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.305+0000 7f6df7fff640 1 --2- 172.21.15.92:0/240371045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556076318dc0 0x556076320300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:59.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.305+0000 7f6df7fff640 1 -- 172.21.15.92:0/240371045 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556075fef3c0 con 0x5560763184a0 2024-09-19T08:59:59.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.305+0000 7f6e00a6d740 1 -- 172.21.15.92:0/240371045 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6dec031c90 con 0x5560763184a0 2024-09-19T08:59:59.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.305+0000 7f6df7fff640 1 --2- 172.21.15.92:0/240371045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5560763184a0 0x556076323050 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6de8004650 tx=0x7f6de80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3f4d6ceeeb76b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:59.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.305+0000 7f6dd77fe640 10 client.16128 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T08:59:59.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.306+0000 7f6dd77fe640 1 -- 172.21.15.92:0/240371045 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de8010ce0 con 0x5560763184a0 2024-09-19T08:59:59.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.306+0000 7f6dd77fe640 1 -- 172.21.15.92:0/240371045 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f6de8028400 con 0x5560763184a0 2024-09-19T08:59:59.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.306+0000 7f6dd77fe640 1 -- 172.21.15.92:0/240371045 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6de8028620 con 0x5560763184a0 2024-09-19T08:59:59.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.306+0000 7f6e00a6d740 10 client.16128 fetch_fsmap learned FSMap version 19 2024-09-19T08:59:59.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.306+0000 7f6e00a6d740 1 -- 172.21.15.92:0/240371045 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({fsmap=19}) -- 0x556076331be0 con 0x5560763184a0 2024-09-19T08:59:59.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.306+0000 7f6dd77fe640 1 -- 172.21.15.92:0/240371045 <== mon.0 v2:172.21.15.92:3300/0 4 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f6de8032420 con 0x5560763184a0 2024-09-19T08:59:59.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.306+0000 7f6e00a6d740 10 client.16128 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:59:59.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.306+0000 7f6e00a6d740 10 client.16128 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:59:59.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.306+0000 7f6e00a6d740 20 client.16128 populate_metadata read hostname 'smithi092' 2024-09-19T08:59:59.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.306+0000 7f6e00a6d740 1 --2- 172.21.15.92:0/240371045 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556076333450 0x5560763358c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:59.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.306+0000 7f6e00a6d740 4 client.16128 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:59:59.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.306+0000 7f6e00a6d740 1 -- 172.21.15.92:0/240371045 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55607628b850 con 0x556076333450 2024-09-19T08:59:59.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.307+0000 7f6df77fe640 1 --2- 172.21.15.92:0/240371045 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556076333450 0x5560763358c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:59.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.307+0000 7f6df77fe640 1 --2- 172.21.15.92:0/240371045 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556076333450 0x5560763358c0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d257016fd2e6229f server_cookie=93047623c7c0f4c1 in_seq=0 out_seq=0 2024-09-19T08:59:59.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.307+0000 7f6dd77fe640 10 client.16128 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:59.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.308+0000 7f6dd77fe640 1 -- 172.21.15.92:0/240371045 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55607628b850 con 0x556076333450 2024-09-19T08:59:59.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.308+0000 7f6dd77fe640 10 client.16128 handle_command_reply: tid=0 2024-09-19T08:59:59.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.308+0000 7f6e00a6d740 1 client.16128 shutdown 2024-09-19T08:59:59.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.308+0000 7f6e00a6d740 1 -- 172.21.15.92:0/240371045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5560763184a0 msgr2=0x556076323050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:59.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.308+0000 7f6e00a6d740 1 --2- 172.21.15.92:0/240371045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5560763184a0 0x556076323050 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6de8004650 tx=0x7f6de80046c0 comp rx=0 tx=0).stop 2024-09-19T08:59:59.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.308+0000 7f6e00a6d740 1 -- 172.21.15.92:0/240371045 shutdown_connections 2024-09-19T08:59:59.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.308+0000 7f6e00a6d740 1 --2- 172.21.15.92:0/240371045 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556076333450 0x5560763358c0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:59.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.308+0000 7f6e00a6d740 1 --2- 172.21.15.92:0/240371045 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556076323680 0x5560763208f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:59.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.308+0000 7f6e00a6d740 1 --2- 172.21.15.92:0/240371045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556076318dc0 0x556076320300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:59.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.308+0000 7f6dd77fe640 0 client.16128 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:59.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.308+0000 7f6e00a6d740 1 --2- 172.21.15.92:0/240371045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5560763184a0 0x556076323050 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:59.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.308+0000 7f6e00a6d740 1 -- 172.21.15.92:0/240371045 >> 172.21.15.92:0/240371045 conn(0x556076314a30 msgr2=0x556076313b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:59.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.309+0000 7f6e00a6d740 1 -- 172.21.15.92:0/240371045 shutdown_connections 2024-09-19T08:59:59.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.309+0000 7f6e00a6d740 1 -- 172.21.15.92:0/240371045 wait complete. 2024-09-19T08:59:59.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.309+0000 7f6e00a6d740 20 client.16128 trim_cache size 0 max 16384 2024-09-19T08:59:59.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.335+0000 7f6e00a6d740 1 Processor -- start 2024-09-19T08:59:59.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.335+0000 7f6e00a6d740 1 -- start start 2024-09-19T08:59:59.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.335+0000 7f6e00a6d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560763184a0 0x55607631d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:59.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.335+0000 7f6e00a6d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556076318dc0 0x55607631daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:59.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.335+0000 7f6e00a6d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556076323680 0x55607633af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:59.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.335+0000 7f6e00a6d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6df81b1b90 con 0x556076318dc0 2024-09-19T08:59:59.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.335+0000 7f6e00a6d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6df81b4430 con 0x556076323680 2024-09-19T08:59:59.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.335+0000 7f6e00a6d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6df81b2220 con 0x5560763184a0 2024-09-19T08:59:59.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.335+0000 7f6df77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556076318dc0 0x55607631daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:59.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.336+0000 7f6dfcc31640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556076323680 0x55607633af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:59.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.336+0000 7f6df77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556076318dc0 0x55607631daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50380/0 (socket says 172.21.15.92:50380) 2024-09-19T08:59:59.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.336+0000 7f6df77fe640 1 -- 172.21.15.92:0/173329092 learned_addr learned my addr 172.21.15.92:0/173329092 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:59.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.336+0000 7f6df7fff640 1 --2- 172.21.15.92:0/173329092 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560763184a0 0x55607631d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:59.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.336+0000 7f6dfcc31640 1 -- 172.21.15.92:0/173329092 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560763184a0 msgr2=0x55607631d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:59.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.336+0000 7f6dfcc31640 1 --2- 172.21.15.92:0/173329092 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560763184a0 0x55607631d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:59.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.336+0000 7f6dfcc31640 1 -- 172.21.15.92:0/173329092 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556076318dc0 msgr2=0x55607631daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:59.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.336+0000 7f6dfcc31640 1 --2- 172.21.15.92:0/173329092 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556076318dc0 0x55607631daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:59.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.336+0000 7f6dfcc31640 1 -- 172.21.15.92:0/173329092 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556076318bf0 con 0x556076323680 2024-09-19T08:59:59.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.336+0000 7f6df77fe640 1 --2- 172.21.15.92:0/173329092 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556076318dc0 0x55607631daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:59.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.336+0000 7f6dfcc31640 1 --2- 172.21.15.92:0/173329092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556076323680 0x55607633af80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6df00cd9a0 tx=0x7f6df009c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6d94f3fae61c350 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:59.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.337+0000 7f6dddffb640 1 -- 172.21.15.92:0/173329092 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df00b4070 con 0x556076323680 2024-09-19T08:59:59.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.337+0000 7f6dddffb640 1 -- 172.21.15.92:0/173329092 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6df00a0870 con 0x556076323680 2024-09-19T08:59:59.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.337+0000 7f6dddffb640 1 -- 172.21.15.92:0/173329092 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df00cde60 con 0x556076323680 2024-09-19T08:59:59.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.337+0000 7f6e00a6d740 1 -- 172.21.15.92:0/173329092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556076323680 msgr2=0x55607633af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:59.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.337+0000 7f6e00a6d740 1 --2- 172.21.15.92:0/173329092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556076323680 0x55607633af80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6df00cd9a0 tx=0x7f6df009c3c0 comp rx=0 tx=0).stop 2024-09-19T08:59:59.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.338+0000 7f6e00a6d740 1 -- 172.21.15.92:0/173329092 shutdown_connections 2024-09-19T08:59:59.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.338+0000 7f6e00a6d740 1 --2- 172.21.15.92:0/173329092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556076323680 0x55607633af80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:59.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.338+0000 7f6e00a6d740 1 --2- 172.21.15.92:0/173329092 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556076318dc0 0x55607631daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:59.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.338+0000 7f6e00a6d740 1 --2- 172.21.15.92:0/173329092 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560763184a0 0x55607631d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:59.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.338+0000 7f6e00a6d740 1 -- 172.21.15.92:0/173329092 >> 172.21.15.92:0/173329092 conn(0x556076314a30 msgr2=0x556076313b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:59.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.338+0000 7f6e00a6d740 1 -- 172.21.15.92:0/173329092 shutdown_connections 2024-09-19T08:59:59.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.338+0000 7f6e00a6d740 1 -- 172.21.15.92:0/173329092 wait complete. 2024-09-19T08:59:59.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.338+0000 7f6e00a6d740 1 -- start start 2024-09-19T08:59:59.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.339+0000 7f6e00a6d740 1 Processor -- start 2024-09-19T08:59:59.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.339+0000 7f6e00a6d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5560763184a0 0x556076392020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:59.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.339+0000 7f6e00a6d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556076318dc0 0x556076392560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:59.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.339+0000 7f6e00a6d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556076323680 0x556076392aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:59.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.339+0000 7f6e00a6d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6df81b28f0 con 0x5560763184a0 2024-09-19T08:59:59.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.339+0000 7f6e00a6d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6df81b3d60 con 0x556076318dc0 2024-09-19T08:59:59.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.339+0000 7f6e00a6d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6df81b2fc0 con 0x556076323680 2024-09-19T08:59:59.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.339+0000 7f6e00a6d740 10 client.0 _ll_register_callbacks cb 0x7f6de8009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:59.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.339+0000 7f6df7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5560763184a0 0x556076392020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:59.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.339+0000 7f6df77fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556076318dc0 0x556076392560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:59.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.339+0000 7f6df7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5560763184a0 0x556076392020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50386/0 (socket says 172.21.15.92:50386) 2024-09-19T08:59:59.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.339+0000 7f6df7fff640 1 -- 172.21.15.92:0/3400676450 learned_addr learned my addr 172.21.15.92:0/3400676450 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T08:59:59.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.339+0000 7f6df77fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556076318dc0 0x556076392560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:43840/0 (socket says 172.21.15.92:43840) 2024-09-19T08:59:59.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.339+0000 7f6dfcc31640 1 --2- 172.21.15.92:0/3400676450 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556076323680 0x556076392aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:59.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.340+0000 7f6df77fe640 1 -- 172.21.15.92:0/3400676450 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556076323680 msgr2=0x556076392aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:59.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.340+0000 7f6df77fe640 1 --2- 172.21.15.92:0/3400676450 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556076323680 0x556076392aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:59.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.340+0000 7f6df77fe640 1 -- 172.21.15.92:0/3400676450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5560763184a0 msgr2=0x556076392020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:59.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.340+0000 7f6df77fe640 1 --2- 172.21.15.92:0/3400676450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5560763184a0 0x556076392020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:59.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.340+0000 7f6df77fe640 1 -- 172.21.15.92:0/3400676450 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55607639d250 con 0x556076318dc0 2024-09-19T08:59:59.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.341+0000 7f6df77fe640 1 --2- 172.21.15.92:0/3400676450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556076318dc0 0x556076392560 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6dec009850 tx=0x7f6dec02a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4faf06b59939a78 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:59.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.341+0000 7f6dd77fe640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T08:59:59.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.341+0000 7f6dd77fe640 1 -- 172.21.15.92:0/3400676450 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec035070 con 0x556076318dc0 2024-09-19T08:59:59.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.341+0000 7f6dd77fe640 1 -- 172.21.15.92:0/3400676450 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f6dec0317b0 con 0x556076318dc0 2024-09-19T08:59:59.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.341+0000 7f6e00a6d740 1 -- 172.21.15.92:0/3400676450 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6df00a0870 con 0x556076318dc0 2024-09-19T08:59:59.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.341+0000 7f6dd77fe640 1 -- 172.21.15.92:0/3400676450 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6dec0319b0 con 0x556076318dc0 2024-09-19T08:59:59.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.341+0000 7f6e00a6d740 10 client.25577 fetch_fsmap learned FSMap version 19 2024-09-19T08:59:59.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.341+0000 7f6e00a6d740 1 -- 172.21.15.92:0/3400676450 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55607639e560 con 0x556076318dc0 2024-09-19T08:59:59.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.342+0000 7f6dd77fe640 1 -- 172.21.15.92:0/3400676450 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6df00a0870 con 0x556076318dc0 2024-09-19T08:59:59.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.342+0000 7f6dd77fe640 1 -- 172.21.15.92:0/3400676450 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f6dec03a040 con 0x556076318dc0 2024-09-19T08:59:59.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.342+0000 7f6e00a6d740 10 client.25577 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T08:59:59.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.342+0000 7f6e00a6d740 10 client.25577 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T08:59:59.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.342+0000 7f6e00a6d740 20 client.25577 populate_metadata read hostname 'smithi092' 2024-09-19T08:59:59.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.342+0000 7f6e00a6d740 1 --2- 172.21.15.92:0/3400676450 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55607639e8a0 0x5560763a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:59.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.342+0000 7f6e00a6d740 4 client.25577 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:59:59.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.342+0000 7f6e00a6d740 1 -- 172.21.15.92:0/3400676450 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556076285d60 con 0x55607639e8a0 2024-09-19T08:59:59.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.342+0000 7f6df7fff640 1 --2- 172.21.15.92:0/3400676450 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55607639e8a0 0x5560763a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:59.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.343+0000 7f6dd77fe640 10 client.25577 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:59.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.343+0000 7f6df7fff640 1 --2- 172.21.15.92:0/3400676450 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55607639e8a0 0x5560763a0c90 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e804debe0f675d0d server_cookie=429d35cd33fabf2f in_seq=0 out_seq=0 2024-09-19T08:59:59.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.343+0000 7f6dd77fe640 1 -- 172.21.15.92:0/3400676450 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x556076285d60 con 0x55607639e8a0 2024-09-19T08:59:59.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.343+0000 7f6dd77fe640 10 client.25577 handle_command_reply: tid=0 2024-09-19T08:59:59.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.343+0000 7f6e00a6d740 1 client.25577 shutdown 2024-09-19T08:59:59.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.344+0000 7f6e00a6d740 1 -- 172.21.15.92:0/3400676450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556076318dc0 msgr2=0x556076392560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:59.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.344+0000 7f6e00a6d740 1 --2- 172.21.15.92:0/3400676450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556076318dc0 0x556076392560 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6dec009850 tx=0x7f6dec02a3f0 comp rx=0 tx=0).stop 2024-09-19T08:59:59.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.344+0000 7f6e00a6d740 1 -- 172.21.15.92:0/3400676450 shutdown_connections 2024-09-19T08:59:59.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.344+0000 7f6e00a6d740 1 --2- 172.21.15.92:0/3400676450 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55607639e8a0 0x5560763a0c90 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:59.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.344+0000 7f6e00a6d740 1 --2- 172.21.15.92:0/3400676450 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556076323680 0x556076392aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:59.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.344+0000 7f6e00a6d740 1 --2- 172.21.15.92:0/3400676450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556076318dc0 0x556076392560 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:59.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.344+0000 7f6e00a6d740 1 --2- 172.21.15.92:0/3400676450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5560763184a0 0x556076392020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:59.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.344+0000 7f6e00a6d740 1 -- 172.21.15.92:0/3400676450 >> 172.21.15.92:0/3400676450 conn(0x556076314a30 msgr2=0x556076321b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:59.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.344+0000 7f6dd77fe640 0 client.25577 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T08:59:59.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.344+0000 7f6e00a6d740 1 -- 172.21.15.92:0/3400676450 shutdown_connections 2024-09-19T08:59:59.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.344+0000 7f6e00a6d740 1 -- 172.21.15.92:0/3400676450 wait complete. 2024-09-19T08:59:59.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.344+0000 7f6e00a6d740 20 client.25577 trim_cache size 0 max 16384 2024-09-19T08:59:59.350 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T08:59:59.350 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-19T08:59:59.350 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {} 2024-09-19T08:59:59.350 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T08:59:59.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.345+0000 7f6dfe694640 1 -- 172.21.15.92:0/2702128078 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6de00a32c0 msgr2=0x7f6de00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:59.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.345+0000 7f6dfe694640 1 --2- 172.21.15.92:0/2702128078 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6de00a32c0 0x7f6de00a5780 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x556076315890 tx=0x7f6de8005f90 comp rx=0 tx=0).stop 2024-09-19T08:59:59.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.345+0000 7f6dfe694640 1 -- 172.21.15.92:0/2702128078 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6df810d530 msgr2=0x7f6df819e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:59.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.345+0000 7f6dfe694640 1 --2- 172.21.15.92:0/2702128078 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6df810d530 0x7f6df819e890 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6df000ea60 tx=0x7f6df000ef20 comp rx=0 tx=0).stop 2024-09-19T08:59:59.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.345+0000 7f6dfe694640 1 -- 172.21.15.92:0/2702128078 shutdown_connections 2024-09-19T08:59:59.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.345+0000 7f6dfe694640 1 --2- 172.21.15.92:0/2702128078 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6df810d530 0x7f6df819e890 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:59.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.345+0000 7f6dfe694640 1 --2- 172.21.15.92:0/2702128078 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6de00a32c0 0x7f6de00a5780 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:59.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.346+0000 7f6dfe694640 1 --2- 172.21.15.92:0/2702128078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6df8108e00 0x7f6df81a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:59.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.346+0000 7f6dfe694640 1 --2- 172.21.15.92:0/2702128078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6df8108450 0x7f6df81a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:59.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.346+0000 7f6dfe694640 1 -- 172.21.15.92:0/2702128078 >> 172.21.15.92:0/2702128078 conn(0x7f6df8077ba0 msgr2=0x7f6df8078e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:59.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.346+0000 7f6dfe694640 1 -- 172.21.15.92:0/2702128078 shutdown_connections 2024-09-19T08:59:59.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T08:59:59.346+0000 7f6dfe694640 1 -- 172.21.15.92:0/2702128078 wait complete. 2024-09-19T08:59:59.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:59 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T08:59:59.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:59 smithi092 ceph-mon[31407]: pgmap v435: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 13 MiB/s wr, 855 op/s 2024-09-19T08:59:59.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 08:59:59 smithi092 ceph-mon[31407]: scrub summary: idle 2024-09-19T08:59:59.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:59 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T08:59:59.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:59 smithi167 ceph-mon[35359]: pgmap v435: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 13 MiB/s wr, 855 op/s 2024-09-19T08:59:59.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 08:59:59 smithi167 ceph-mon[35359]: scrub summary: idle 2024-09-19T08:59:59.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:59 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T08:59:59.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:59 smithi190 ceph-mon[35358]: pgmap v435: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 13 MiB/s wr, 855 op/s 2024-09-19T08:59:59.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 08:59:59 smithi190 ceph-mon[35358]: scrub summary: idle 2024-09-19T09:00:00.572 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:00:00.573 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:00:00.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:00 smithi092 ceph-mon[31407]: overall HEALTH_OK 2024-09-19T09:00:00.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 195.0 s, 4333.9 tps, lat 23.034 ms stddev 24.103 2024-09-19T09:00:00.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:00 smithi167 ceph-mon[35359]: overall HEALTH_OK 2024-09-19T09:00:00.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:00 smithi190 ceph-mon[35358]: overall HEALTH_OK 2024-09-19T09:00:00.969 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:01.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.489+0000 7f580152d640 1 -- 172.21.15.92:0/2638972195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57fc102570 msgr2=0x7f57fc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:01.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.489+0000 7f580152d640 1 --2- 172.21.15.92:0/2638972195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57fc102570 0x7f57fc1029b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f57f0009890 tx=0x7f57f002a3f0 comp rx=0 tx=0).stop 2024-09-19T09:00:01.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.490+0000 7f580152d640 1 -- 172.21.15.92:0/2638972195 shutdown_connections 2024-09-19T09:00:01.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.490+0000 7f580152d640 1 --2- 172.21.15.92:0/2638972195 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57fc102ef0 0x7f57fc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:01.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.490+0000 7f580152d640 1 --2- 172.21.15.92:0/2638972195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57fc102570 0x7f57fc1029b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:01.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.490+0000 7f580152d640 1 --2- 172.21.15.92:0/2638972195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57fc100e20 0x7f57fc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:01.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.490+0000 7f580152d640 1 -- 172.21.15.92:0/2638972195 >> 172.21.15.92:0/2638972195 conn(0x7f57fc0fc7d0 msgr2=0x7f57fc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:01.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.490+0000 7f580152d640 1 -- 172.21.15.92:0/2638972195 shutdown_connections 2024-09-19T09:00:01.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.490+0000 7f580152d640 1 -- 172.21.15.92:0/2638972195 wait complete. 2024-09-19T09:00:01.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.491+0000 7f580152d640 1 Processor -- start 2024-09-19T09:00:01.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.492+0000 7f580152d640 1 -- start start 2024-09-19T09:00:01.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.492+0000 7f580152d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57fc100e20 0x7f57fc1975b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:01.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.492+0000 7f580152d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57fc102570 0x7f57fc197af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:01.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.492+0000 7f580152d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57fc102ef0 0x7f57fc19be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:01.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.492+0000 7f580152d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f57fc110fa0 con 0x7f57fc102570 2024-09-19T09:00:01.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.492+0000 7f580152d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f57fc110e20 con 0x7f57fc100e20 2024-09-19T09:00:01.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.492+0000 7f580152d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f57fc111120 con 0x7f57fc102ef0 2024-09-19T09:00:01.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.492+0000 7f57fb7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57fc102ef0 0x7f57fc19be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:01.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.492+0000 7f57fb7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57fc102ef0 0x7f57fc19be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:45724/0 (socket says 172.21.15.92:45724) 2024-09-19T09:00:01.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.492+0000 7f57fa7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57fc102570 0x7f57fc197af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:01.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.492+0000 7f57fb7fe640 1 -- 172.21.15.92:0/3006247519 learned_addr learned my addr 172.21.15.92:0/3006247519 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:01.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.492+0000 7f57faffd640 1 --2- 172.21.15.92:0/3006247519 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57fc100e20 0x7f57fc1975b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:01.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.493+0000 7f57fb7fe640 1 -- 172.21.15.92:0/3006247519 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57fc100e20 msgr2=0x7f57fc1975b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:01.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.493+0000 7f57fb7fe640 1 --2- 172.21.15.92:0/3006247519 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57fc100e20 0x7f57fc1975b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:01.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.493+0000 7f57fb7fe640 1 -- 172.21.15.92:0/3006247519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57fc102570 msgr2=0x7f57fc197af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:01.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.493+0000 7f57fb7fe640 1 --2- 172.21.15.92:0/3006247519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57fc102570 0x7f57fc197af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:01.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.493+0000 7f57fb7fe640 1 -- 172.21.15.92:0/3006247519 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57fc19c560 con 0x7f57fc102ef0 2024-09-19T09:00:01.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.493+0000 7f57fb7fe640 1 --2- 172.21.15.92:0/3006247519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57fc102ef0 0x7f57fc19be80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f57f400efc0 tx=0x7f57f400c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:01.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.493+0000 7f57e3fff640 1 -- 172.21.15.92:0/3006247519 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f4003970 con 0x7f57fc102ef0 2024-09-19T09:00:01.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.493+0000 7f57e3fff640 1 -- 172.21.15.92:0/3006247519 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57f4004020 con 0x7f57fc102ef0 2024-09-19T09:00:01.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.493+0000 7f580152d640 1 -- 172.21.15.92:0/3006247519 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57fc19c850 con 0x7f57fc102ef0 2024-09-19T09:00:01.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.493+0000 7f580152d640 1 -- 172.21.15.92:0/3006247519 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57fc069f70 con 0x7f57fc102ef0 2024-09-19T09:00:01.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.494+0000 7f57e3fff640 1 -- 172.21.15.92:0/3006247519 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f400b9f0 con 0x7f57fc102ef0 2024-09-19T09:00:01.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.495+0000 7f580152d640 1 -- 172.21.15.92:0/3006247519 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57e8005290 con 0x7f57fc102ef0 2024-09-19T09:00:01.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.496+0000 7f57e3fff640 1 -- 172.21.15.92:0/3006247519 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f57f401d020 con 0x7f57fc102ef0 2024-09-19T09:00:01.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.497+0000 7f57e3fff640 1 --2- 172.21.15.92:0/3006247519 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f57e40a3340 0x7f57e40a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:01.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.498+0000 7f57e3fff640 1 -- 172.21.15.92:0/3006247519 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f57f40cf650 con 0x7f57fc102ef0 2024-09-19T09:00:01.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.498+0000 7f57faffd640 1 --2- 172.21.15.92:0/3006247519 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f57e40a3340 0x7f57e40a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:01.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.500+0000 7f57faffd640 1 --2- 172.21.15.92:0/3006247519 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f57e40a3340 0x7f57e40a5800 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f57ec009e40 tx=0x7f57ec0046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:01.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.506+0000 7f57e3fff640 1 -- 172.21.15.92:0/3006247519 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f57f409c330 con 0x7f57fc102ef0 2024-09-19T09:00:01.751 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:01 smithi167 ceph-mon[35359]: pgmap v436: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 14 MiB/s wr, 1.01k op/s 2024-09-19T09:00:01.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:01 smithi092 ceph-mon[31407]: pgmap v436: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 14 MiB/s wr, 1.01k op/s 2024-09-19T09:00:01.774 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:01 smithi190 ceph-mon[35358]: pgmap v436: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 14 MiB/s wr, 1.01k op/s 2024-09-19T09:00:01.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.860+0000 7f580152d640 1 -- 172.21.15.92:0/3006247519 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f57e8005580 con 0x7f57fc102ef0 2024-09-19T09:00:01.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.861+0000 7f57e3fff640 1 -- 172.21.15.92:0/3006247519 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f57f409bc30 con 0x7f57fc102ef0 2024-09-19T09:00:01.861 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:00:01.861 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:00:01.861 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:00:01.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.864+0000 7f580152d640 1 -- 172.21.15.92:0/3006247519 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f57e40a3340 msgr2=0x7f57e40a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:01.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.864+0000 7f580152d640 1 --2- 172.21.15.92:0/3006247519 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f57e40a3340 0x7f57e40a5800 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f57ec009e40 tx=0x7f57ec0046c0 comp rx=0 tx=0).stop 2024-09-19T09:00:01.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.864+0000 7f580152d640 1 -- 172.21.15.92:0/3006247519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57fc102ef0 msgr2=0x7f57fc19be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:01.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.864+0000 7f580152d640 1 --2- 172.21.15.92:0/3006247519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57fc102ef0 0x7f57fc19be80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f57f400efc0 tx=0x7f57f400c800 comp rx=0 tx=0).stop 2024-09-19T09:00:01.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.864+0000 7f580152d640 1 -- 172.21.15.92:0/3006247519 shutdown_connections 2024-09-19T09:00:01.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.864+0000 7f580152d640 1 --2- 172.21.15.92:0/3006247519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57fc102ef0 0x7f57fc19be80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:01.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.864+0000 7f580152d640 1 --2- 172.21.15.92:0/3006247519 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f57e40a3340 0x7f57e40a5800 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:01.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.864+0000 7f580152d640 1 --2- 172.21.15.92:0/3006247519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57fc102570 0x7f57fc197af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:01.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.864+0000 7f580152d640 1 --2- 172.21.15.92:0/3006247519 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57fc100e20 0x7f57fc1975b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:01.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.864+0000 7f580152d640 1 -- 172.21.15.92:0/3006247519 >> 172.21.15.92:0/3006247519 conn(0x7f57fc0fc7d0 msgr2=0x7f57fc104950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:01.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.864+0000 7f580152d640 1 -- 172.21.15.92:0/3006247519 shutdown_connections 2024-09-19T09:00:01.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:01.864+0000 7f580152d640 1 -- 172.21.15.92:0/3006247519 wait complete. 2024-09-19T09:00:02.535 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:00:02.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:02 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3006247519' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:02.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.794+0000 7fb9e2e0e640 1 -- 172.21.15.92:0/3039157877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9dc100a40 msgr2=0x7fb9dc100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:02.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.794+0000 7fb9e2e0e640 1 --2- 172.21.15.92:0/3039157877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9dc100a40 0x7fb9dc100e40 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4009be0 tx=0x7fb9d402a6f0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.797+0000 7fb9e2e0e640 1 -- 172.21.15.92:0/3039157877 shutdown_connections 2024-09-19T09:00:02.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.797+0000 7fb9e2e0e640 1 --2- 172.21.15.92:0/3039157877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9dc1025f0 0x7fb9dc108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.797+0000 7fb9e2e0e640 1 --2- 172.21.15.92:0/3039157877 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9dc101c30 0x7fb9dc1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.797+0000 7fb9e2e0e640 1 --2- 172.21.15.92:0/3039157877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9dc100a40 0x7fb9dc100e40 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.797+0000 7fb9e2e0e640 1 -- 172.21.15.92:0/3039157877 >> 172.21.15.92:0/3039157877 conn(0x7fb9dc0fc1e0 msgr2=0x7fb9dc0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:02.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.806+0000 7fb9e2e0e640 1 -- 172.21.15.92:0/3039157877 shutdown_connections 2024-09-19T09:00:02.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.806+0000 7fb9e2e0e640 1 -- 172.21.15.92:0/3039157877 wait complete. 2024-09-19T09:00:02.807 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.808+0000 7fb9e2e0e640 1 Processor -- start 2024-09-19T09:00:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.810+0000 7fb9e2e0e640 1 -- start start 2024-09-19T09:00:02.811 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.810+0000 7fb9e2e0e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9dc100a40 0x7fb9dc196df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:02.811 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.810+0000 7fb9e2e0e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9dc101c30 0x7fb9dc197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:02.811 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.811+0000 7fb9e2e0e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9dc1025f0 0x7fb9dc19e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:02.811 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.811+0000 7fb9e2e0e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb9dc10c740 con 0x7fb9dc100a40 2024-09-19T09:00:02.811 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.811+0000 7fb9e2e0e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb9dc10c5c0 con 0x7fb9dc1025f0 2024-09-19T09:00:02.811 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.811+0000 7fb9dbfff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9dc101c30 0x7fb9dc197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:02.811 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.811+0000 7fb9dbfff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9dc101c30 0x7fb9dc197330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:45734/0 (socket says 172.21.15.92:45734) 2024-09-19T09:00:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.811+0000 7fb9dbfff640 1 -- 172.21.15.92:0/1208863452 learned_addr learned my addr 172.21.15.92:0/1208863452 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.811+0000 7fb9e2e0e640 1 -- 172.21.15.92:0/1208863452 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb9dc10c8c0 con 0x7fb9dc101c30 2024-09-19T09:00:02.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.812+0000 7fb9e13ab640 1 --2- 172.21.15.92:0/1208863452 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9dc1025f0 0x7fb9dc19e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:02.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.812+0000 7fb9dbfff640 1 -- 172.21.15.92:0/1208863452 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9dc1025f0 msgr2=0x7fb9dc19e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:02.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.812+0000 7fb9dbfff640 1 --2- 172.21.15.92:0/1208863452 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9dc1025f0 0x7fb9dc19e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.812+0000 7fb9dbfff640 1 -- 172.21.15.92:0/1208863452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9dc100a40 msgr2=0x7fb9dc196df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:02.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.812+0000 7fb9dbfff640 1 --2- 172.21.15.92:0/1208863452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9dc100a40 0x7fb9dc196df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.812+0000 7fb9dbfff640 1 -- 172.21.15.92:0/1208863452 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9dc19ea10 con 0x7fb9dc101c30 2024-09-19T09:00:02.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.813+0000 7fb9dbfff640 1 --2- 172.21.15.92:0/1208863452 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9dc101c30 0x7fb9dc197330 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc00bea0 tx=0x7fb9cc00bf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:02.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.815+0000 7fb9d9ffb640 1 -- 172.21.15.92:0/1208863452 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc016070 con 0x7fb9dc101c30 2024-09-19T09:00:02.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.815+0000 7fb9d9ffb640 1 -- 172.21.15.92:0/1208863452 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9cc009c30 con 0x7fb9dc101c30 2024-09-19T09:00:02.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.815+0000 7fb9d9ffb640 1 -- 172.21.15.92:0/1208863452 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc0197b0 con 0x7fb9dc101c30 2024-09-19T09:00:02.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.815+0000 7fb9e2e0e640 1 -- 172.21.15.92:0/1208863452 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9dc069900 con 0x7fb9dc101c30 2024-09-19T09:00:02.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.816+0000 7fb9e2e0e640 1 -- 172.21.15.92:0/1208863452 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9dc069e80 con 0x7fb9dc101c30 2024-09-19T09:00:02.821 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.821+0000 7fb9d9ffb640 1 -- 172.21.15.92:0/1208863452 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb9cc010450 con 0x7fb9dc101c30 2024-09-19T09:00:02.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.823+0000 7fb9d9ffb640 1 --2- 172.21.15.92:0/1208863452 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb9c40a7940 0x7fb9c40a9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:02.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.824+0000 7fb9e0baa640 1 --2- 172.21.15.92:0/1208863452 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb9c40a7940 0x7fb9c40a9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:02.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.824+0000 7fb9d9ffb640 1 -- 172.21.15.92:0/1208863452 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb9cc0cf750 con 0x7fb9dc101c30 2024-09-19T09:00:02.825 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.824+0000 7fb9e0baa640 1 --2- 172.21.15.92:0/1208863452 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb9c40a7940 0x7fb9c40a9e00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb9d40099a0 tx=0x7fb9d4000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.827+0000 7fb9e5c86740 1 Processor -- start 2024-09-19T09:00:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.828+0000 7fb9e5c86740 1 -- start start 2024-09-19T09:00:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.828+0000 7fb9e5c86740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e787f19a0 0x564e787f1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.828+0000 7fb9e5c86740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e787f22e0 0x564e787f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.828+0000 7fb9e0baa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e787f19a0 0x564e787f1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.829+0000 7fb9e0baa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e787f19a0 0x564e787f1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:48322/0 (socket says 172.21.15.92:48322) 2024-09-19T09:00:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.829+0000 7fb9e0baa640 1 -- 172.21.15.92:0/189596727 learned_addr learned my addr 172.21.15.92:0/189596727 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.829+0000 7fb9e5c86740 1 --2- 172.21.15.92:0/189596727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e787f7370 0x564e787f9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.829+0000 7fb9e5c86740 1 -- 172.21.15.92:0/189596727 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564e787552f0 con 0x564e787f22e0 2024-09-19T09:00:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.829+0000 7fb9e5c86740 1 -- 172.21.15.92:0/189596727 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564e786fd270 con 0x564e787f19a0 2024-09-19T09:00:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.829+0000 7fb9e13ab640 1 --2- 172.21.15.92:0/189596727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e787f7370 0x564e787f9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.829+0000 7fb9e5c86740 1 -- 172.21.15.92:0/189596727 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x564e787512b0 con 0x564e787f7370 2024-09-19T09:00:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.830+0000 7fb9dbfff640 1 --2- 172.21.15.92:0/189596727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e787f22e0 0x564e787f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.830+0000 7fb9e0baa640 1 -- 172.21.15.92:0/189596727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e787f7370 msgr2=0x564e787f9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.830+0000 7fb9e0baa640 1 --2- 172.21.15.92:0/189596727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e787f7370 0x564e787f9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.830+0000 7fb9e0baa640 1 -- 172.21.15.92:0/189596727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e787f22e0 msgr2=0x564e787f6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.830+0000 7fb9e0baa640 1 --2- 172.21.15.92:0/189596727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e787f22e0 0x564e787f6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.830+0000 7fb9e0baa640 1 -- 172.21.15.92:0/189596727 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e786fc340 con 0x564e787f19a0 2024-09-19T09:00:02.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.830+0000 7fb9e13ab640 1 --2- 172.21.15.92:0/189596727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e787f7370 0x564e787f9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:00:02.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.830+0000 7fb9dbfff640 1 --2- 172.21.15.92:0/189596727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e787f22e0 0x564e787f6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:00:02.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.831+0000 7fb9e0baa640 1 --2- 172.21.15.92:0/189596727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e787f19a0 0x564e787f1da0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4033000 tx=0x7fb9d403a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b9844f5454ea1f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:02.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.831+0000 7fb9caffd640 1 -- 172.21.15.92:0/189596727 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d404d070 con 0x564e787f19a0 2024-09-19T09:00:02.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.831+0000 7fb9caffd640 1 -- 172.21.15.92:0/189596727 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9d4044040 con 0x564e787f19a0 2024-09-19T09:00:02.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.832+0000 7fb9caffd640 1 -- 172.21.15.92:0/189596727 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4036040 con 0x564e787f19a0 2024-09-19T09:00:02.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.832+0000 7fb9e5c86740 1 -- 172.21.15.92:0/189596727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e787f19a0 msgr2=0x564e787f1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:02.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.832+0000 7fb9e5c86740 1 --2- 172.21.15.92:0/189596727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e787f19a0 0x564e787f1da0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4033000 tx=0x7fb9d403a000 comp rx=0 tx=0).stop 2024-09-19T09:00:02.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.833+0000 7fb9e5c86740 1 -- 172.21.15.92:0/189596727 shutdown_connections 2024-09-19T09:00:02.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.833+0000 7fb9e5c86740 1 --2- 172.21.15.92:0/189596727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e787f7370 0x564e787f9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.833+0000 7fb9e5c86740 1 --2- 172.21.15.92:0/189596727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e787f22e0 0x564e787f6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.833+0000 7fb9e5c86740 1 --2- 172.21.15.92:0/189596727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e787f19a0 0x564e787f1da0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.833+0000 7fb9e5c86740 1 -- 172.21.15.92:0/189596727 >> 172.21.15.92:0/189596727 conn(0x564e787ed010 msgr2=0x564e787ed410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:02.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.833+0000 7fb9e5c86740 1 -- 172.21.15.92:0/189596727 shutdown_connections 2024-09-19T09:00:02.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.833+0000 7fb9e5c86740 1 -- 172.21.15.92:0/189596727 wait complete. 2024-09-19T09:00:02.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.834+0000 7fb9e5c86740 1 -- start start 2024-09-19T09:00:02.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.834+0000 7fb9e5c86740 1 Processor -- start 2024-09-19T09:00:02.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.835+0000 7fb9e5c86740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e787f19a0 0x564e787fbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:02.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.835+0000 7fb9e5c86740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e787f22e0 0x564e787fc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:02.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.835+0000 7fb9e5c86740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e787f7370 0x564e78803140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:02.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.835+0000 7fb9e5c86740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564e787fa330 con 0x564e787f19a0 2024-09-19T09:00:02.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.835+0000 7fb9e5c86740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564e786de290 con 0x564e787f22e0 2024-09-19T09:00:02.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.835+0000 7fb9e5c86740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x564e787fa4b0 con 0x564e787f7370 2024-09-19T09:00:02.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.835+0000 7fb9e5c86740 10 client.0 _ll_register_callbacks cb 0x564e7870f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:02.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.835+0000 7fb9dbfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e787f22e0 0x564e787fc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:02.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.835+0000 7fb9dbfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e787f22e0 0x564e787fc100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:48336/0 (socket says 172.21.15.92:48336) 2024-09-19T09:00:02.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.835+0000 7fb9dbfff640 1 -- 172.21.15.92:0/3448299595 learned_addr learned my addr 172.21.15.92:0/3448299595 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:02.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.835+0000 7fb9e13ab640 1 --2- 172.21.15.92:0/3448299595 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e787f7370 0x564e78803140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:02.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.835+0000 7fb9e0baa640 1 --2- 172.21.15.92:0/3448299595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e787f19a0 0x564e787fbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:02.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.836+0000 7fb9e13ab640 1 -- 172.21.15.92:0/3448299595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e787f22e0 msgr2=0x564e787fc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:02.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.836+0000 7fb9e13ab640 1 --2- 172.21.15.92:0/3448299595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e787f22e0 0x564e787fc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.836+0000 7fb9e13ab640 1 -- 172.21.15.92:0/3448299595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e787f19a0 msgr2=0x564e787fbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:02.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.836+0000 7fb9e13ab640 1 --2- 172.21.15.92:0/3448299595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e787f19a0 0x564e787fbbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.836+0000 7fb9e13ab640 1 -- 172.21.15.92:0/3448299595 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e78468210 con 0x564e787f7370 2024-09-19T09:00:02.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.836+0000 7fb9dbfff640 1 --2- 172.21.15.92:0/3448299595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e787f22e0 0x564e787fc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:02.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.836+0000 7fb9e13ab640 1 --2- 172.21.15.92:0/3448299595 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e787f7370 0x564e78803140 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb9d000bec0 tx=0x7fb9d000d590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3630ff5ebcd82959 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:02.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.836+0000 7fb9bffff640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:00:02.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.836+0000 7fb9bffff640 1 -- 172.21.15.92:0/3448299595 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0016070 con 0x564e787f7370 2024-09-19T09:00:02.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.836+0000 7fb9bffff640 1 -- 172.21.15.92:0/3448299595 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb9d0012660 con 0x564e787f7370 2024-09-19T09:00:02.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.836+0000 7fb9e5c86740 1 -- 172.21.15.92:0/3448299595 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9d4044040 con 0x564e787f7370 2024-09-19T09:00:02.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.836+0000 7fb9bffff640 1 -- 172.21.15.92:0/3448299595 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb9d0022050 con 0x564e787f7370 2024-09-19T09:00:02.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.836+0000 7fb9e5c86740 10 client.25522 fetch_fsmap learned FSMap version 19 2024-09-19T09:00:02.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.836+0000 7fb9e5c86740 1 -- 172.21.15.92:0/3448299595 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x564e78534620 con 0x564e787f7370 2024-09-19T09:00:02.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.837+0000 7fb9bffff640 1 -- 172.21.15.92:0/3448299595 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9d4044040 con 0x564e787f7370 2024-09-19T09:00:02.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.837+0000 7fb9bffff640 1 -- 172.21.15.92:0/3448299595 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fb9d0011ab0 con 0x564e787f7370 2024-09-19T09:00:02.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.837+0000 7fb9e5c86740 10 client.25522 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:00:02.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.837+0000 7fb9e5c86740 10 client.25522 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:00:02.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.837+0000 7fb9e5c86740 20 client.25522 populate_metadata read hostname 'smithi092' 2024-09-19T09:00:02.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.837+0000 7fb9e5c86740 1 --2- 172.21.15.92:0/3448299595 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564e78807850 0x564e78809ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:02.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.837+0000 7fb9e5c86740 4 client.25522 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:00:02.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.837+0000 7fb9e5c86740 1 -- 172.21.15.92:0/3448299595 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e78762a20 con 0x564e78807850 2024-09-19T09:00:02.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.837+0000 7fb9e0baa640 1 --2- 172.21.15.92:0/3448299595 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564e78807850 0x564e78809ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:02.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.837+0000 7fb9bffff640 10 client.25522 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:02.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.838+0000 7fb9e0baa640 1 --2- 172.21.15.92:0/3448299595 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564e78807850 0x564e78809ca0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81816dfaaab450f server_cookie=20b82f88b5913bd1 in_seq=0 out_seq=0 2024-09-19T09:00:02.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.838+0000 7fb9bffff640 1 -- 172.21.15.92:0/3448299595 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564e78762a20 con 0x564e78807850 2024-09-19T09:00:02.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.838+0000 7fb9bffff640 10 client.25522 handle_command_reply: tid=0 2024-09-19T09:00:02.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.838+0000 7fb9e5c86740 1 client.25522 shutdown 2024-09-19T09:00:02.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.838+0000 7fb9e5c86740 1 -- 172.21.15.92:0/3448299595 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e787f7370 msgr2=0x564e78803140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:02.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.838+0000 7fb9e5c86740 1 --2- 172.21.15.92:0/3448299595 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e787f7370 0x564e78803140 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb9d000bec0 tx=0x7fb9d000d590 comp rx=0 tx=0).stop 2024-09-19T09:00:02.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.839+0000 7fb9e5c86740 1 -- 172.21.15.92:0/3448299595 shutdown_connections 2024-09-19T09:00:02.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.839+0000 7fb9e5c86740 1 --2- 172.21.15.92:0/3448299595 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564e78807850 0x564e78809ca0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.839+0000 7fb9bffff640 0 client.25522 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:02.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.839+0000 7fb9e5c86740 1 --2- 172.21.15.92:0/3448299595 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e787f7370 0x564e78803140 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.839+0000 7fb9e5c86740 1 --2- 172.21.15.92:0/3448299595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e787f22e0 0x564e787fc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.839+0000 7fb9e5c86740 1 --2- 172.21.15.92:0/3448299595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e787f19a0 0x564e787fbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.839+0000 7fb9e5c86740 1 -- 172.21.15.92:0/3448299595 >> 172.21.15.92:0/3448299595 conn(0x564e787ed010 msgr2=0x564e787ee820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:02.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.839+0000 7fb9e5c86740 1 -- 172.21.15.92:0/3448299595 shutdown_connections 2024-09-19T09:00:02.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.839+0000 7fb9e5c86740 1 -- 172.21.15.92:0/3448299595 wait complete. 2024-09-19T09:00:02.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.839+0000 7fb9e5c86740 20 client.25522 trim_cache size 0 max 16384 2024-09-19T09:00:02.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:02 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3006247519' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:02.868 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.868+0000 7fb9e5c86740 1 Processor -- start 2024-09-19T09:00:02.868 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.868+0000 7fb9e5c86740 1 -- start start 2024-09-19T09:00:02.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.869+0000 7fb9e5c86740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e787f19a0 0x564e787ed3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:02.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.869+0000 7fb9e5c86740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e787f22e0 0x564e78803100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:02.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.869+0000 7fb9e5c86740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e787f7370 0x564e787ed930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:02.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.869+0000 7fb9e5c86740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb9dc1a4ea0 con 0x564e787f7370 2024-09-19T09:00:02.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.869+0000 7fb9e5c86740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb9dc1a7740 con 0x564e787f22e0 2024-09-19T09:00:02.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.869+0000 7fb9e5c86740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb9dc1a5530 con 0x564e787f19a0 2024-09-19T09:00:02.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.869+0000 7fb9e13ab640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e787f7370 0x564e787ed930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:02.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.869+0000 7fb9dbfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e787f22e0 0x564e78803100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:02.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.869+0000 7fb9e0baa640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e787f19a0 0x564e787ed3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:02.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.869+0000 7fb9e13ab640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e787f7370 0x564e787ed930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38482/0 (socket says 172.21.15.92:38482) 2024-09-19T09:00:02.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.869+0000 7fb9dbfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e787f22e0 0x564e78803100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:48342/0 (socket says 172.21.15.92:48342) 2024-09-19T09:00:02.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.869+0000 7fb9e13ab640 1 -- 172.21.15.92:0/4137133859 learned_addr learned my addr 172.21.15.92:0/4137133859 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:02.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.869+0000 7fb9e13ab640 1 -- 172.21.15.92:0/4137133859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e787f19a0 msgr2=0x564e787ed3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:02.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.869+0000 7fb9e13ab640 1 --2- 172.21.15.92:0/4137133859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e787f19a0 0x564e787ed3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.869+0000 7fb9e13ab640 1 -- 172.21.15.92:0/4137133859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e787f22e0 msgr2=0x564e78803100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:02.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.869+0000 7fb9e13ab640 1 --2- 172.21.15.92:0/4137133859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e787f22e0 0x564e78803100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.869+0000 7fb9e13ab640 1 -- 172.21.15.92:0/4137133859 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e787fb700 con 0x564e787f7370 2024-09-19T09:00:02.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.869+0000 7fb9e0baa640 1 --2- 172.21.15.92:0/4137133859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e787f19a0 0x564e787ed3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:02.871 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.870+0000 7fb9e13ab640 1 --2- 172.21.15.92:0/4137133859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e787f7370 0x564e787ed930 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fb9d000b7b0 tx=0x7fb9d001a450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17dce1c86d633796 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:02.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.870+0000 7fb9ca7fc640 1 -- 172.21.15.92:0/4137133859 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d002b070 con 0x564e787f7370 2024-09-19T09:00:02.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.870+0000 7fb9ca7fc640 1 -- 172.21.15.92:0/4137133859 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9d0004030 con 0x564e787f7370 2024-09-19T09:00:02.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.870+0000 7fb9ca7fc640 1 -- 172.21.15.92:0/4137133859 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0016040 con 0x564e787f7370 2024-09-19T09:00:02.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.871+0000 7fb9e5c86740 1 -- 172.21.15.92:0/4137133859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e787f7370 msgr2=0x564e787ed930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:02.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.871+0000 7fb9e5c86740 1 --2- 172.21.15.92:0/4137133859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e787f7370 0x564e787ed930 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fb9d000b7b0 tx=0x7fb9d001a450 comp rx=0 tx=0).stop 2024-09-19T09:00:02.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.871+0000 7fb9e5c86740 1 -- 172.21.15.92:0/4137133859 shutdown_connections 2024-09-19T09:00:02.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.872+0000 7fb9e5c86740 1 --2- 172.21.15.92:0/4137133859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e787f7370 0x564e787ed930 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.872+0000 7fb9e5c86740 1 --2- 172.21.15.92:0/4137133859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e787f22e0 0x564e78803100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.872+0000 7fb9e5c86740 1 --2- 172.21.15.92:0/4137133859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e787f19a0 0x564e787ed3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.873 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.872+0000 7fb9e5c86740 1 -- 172.21.15.92:0/4137133859 >> 172.21.15.92:0/4137133859 conn(0x564e787ed010 msgr2=0x564e787f6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:02.873 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.872+0000 7fb9e5c86740 1 -- 172.21.15.92:0/4137133859 shutdown_connections 2024-09-19T09:00:02.873 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.872+0000 7fb9e5c86740 1 -- 172.21.15.92:0/4137133859 wait complete. 2024-09-19T09:00:02.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:02 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3006247519' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:02.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.873+0000 7fb9e5c86740 1 -- start start 2024-09-19T09:00:02.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.873+0000 7fb9e5c86740 1 Processor -- start 2024-09-19T09:00:02.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.874+0000 7fb9e5c86740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e787f19a0 0x564e78800010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:02.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.874+0000 7fb9e5c86740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e787f22e0 0x564e78800550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:02.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.874+0000 7fb9e5c86740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e787f7370 0x564e78870570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:02.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.874+0000 7fb9e5c86740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb9dc1a5c00 con 0x564e787f19a0 2024-09-19T09:00:02.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.874+0000 7fb9e5c86740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb9dc1a7070 con 0x564e787f22e0 2024-09-19T09:00:02.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.874+0000 7fb9e5c86740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb9dc1a62d0 con 0x564e787f7370 2024-09-19T09:00:02.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.874+0000 7fb9e5c86740 10 client.0 _ll_register_callbacks cb 0x7fb9d0006e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:02.875 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.874+0000 7fb9dbfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e787f22e0 0x564e78800550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:02.875 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.874+0000 7fb9dbfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e787f22e0 0x564e78800550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:48356/0 (socket says 172.21.15.92:48356) 2024-09-19T09:00:02.875 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.874+0000 7fb9dbfff640 1 -- 172.21.15.92:0/3159495795 learned_addr learned my addr 172.21.15.92:0/3159495795 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:02.875 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.874+0000 7fb9e13ab640 1 --2- 172.21.15.92:0/3159495795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e787f7370 0x564e78870570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:02.875 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.874+0000 7fb9e0baa640 1 --2- 172.21.15.92:0/3159495795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e787f19a0 0x564e78800010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:02.875 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.875+0000 7fb9dbfff640 1 -- 172.21.15.92:0/3159495795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e787f7370 msgr2=0x564e78870570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:02.875 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.875+0000 7fb9dbfff640 1 --2- 172.21.15.92:0/3159495795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e787f7370 0x564e78870570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.875 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.875+0000 7fb9dbfff640 1 -- 172.21.15.92:0/3159495795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e787f19a0 msgr2=0x564e78800010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:02.876 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.875+0000 7fb9dbfff640 1 --2- 172.21.15.92:0/3159495795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e787f19a0 0x564e78800010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.876 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.875+0000 7fb9dbfff640 1 -- 172.21.15.92:0/3159495795 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e787f15e0 con 0x564e787f22e0 2024-09-19T09:00:02.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.876+0000 7fb9dbfff640 1 --2- 172.21.15.92:0/3159495795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e787f22e0 0x564e78800550 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc098190 tx=0x7fb9cc09be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc2cc8434f7042d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:02.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.876+0000 7fb9bffff640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:00:02.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.876+0000 7fb9bffff640 1 -- 172.21.15.92:0/3159495795 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc020d50 con 0x564e787f22e0 2024-09-19T09:00:02.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.876+0000 7fb9bffff640 1 -- 172.21.15.92:0/3159495795 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb9cc0983a0 con 0x564e787f22e0 2024-09-19T09:00:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.876+0000 7fb9e5c86740 1 -- 172.21.15.92:0/3159495795 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9d0004030 con 0x564e787f22e0 2024-09-19T09:00:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.876+0000 7fb9bffff640 1 -- 172.21.15.92:0/3159495795 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb9cc010740 con 0x564e787f22e0 2024-09-19T09:00:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.876+0000 7fb9e5c86740 10 client.25595 fetch_fsmap learned FSMap version 19 2024-09-19T09:00:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.877+0000 7fb9e5c86740 1 -- 172.21.15.92:0/3159495795 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x564e78871c70 con 0x564e787f22e0 2024-09-19T09:00:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.877+0000 7fb9bffff640 1 -- 172.21.15.92:0/3159495795 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9cc0108e0 con 0x564e787f22e0 2024-09-19T09:00:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.877+0000 7fb9bffff640 1 -- 172.21.15.92:0/3159495795 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fb9cc09abf0 con 0x564e787f22e0 2024-09-19T09:00:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.877+0000 7fb9e5c86740 10 client.25595 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:00:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.877+0000 7fb9e5c86740 10 client.25595 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:00:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.877+0000 7fb9e5c86740 20 client.25595 populate_metadata read hostname 'smithi092' 2024-09-19T09:00:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.877+0000 7fb9e5c86740 1 --2- 172.21.15.92:0/3159495795 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564e78872550 0x564e78874970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.878+0000 7fb9e5c86740 4 client.25595 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:00:02.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.878+0000 7fb9e0baa640 1 --2- 172.21.15.92:0/3159495795 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564e78872550 0x564e78874970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:02.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.878+0000 7fb9e5c86740 1 -- 172.21.15.92:0/3159495795 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fb9d0004030 con 0x564e78872550 2024-09-19T09:00:02.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.878+0000 7fb9bffff640 10 client.25595 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:02.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.878+0000 7fb9e0baa640 1 --2- 172.21.15.92:0/3159495795 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564e78872550 0x564e78874970 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b63d3b86832bd080 server_cookie=a01444b2a505e47d in_seq=0 out_seq=0 2024-09-19T09:00:02.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.901+0000 7fb9bffff640 1 -- 172.21.15.92:0/3159495795 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fb9d0004030 con 0x564e78872550 2024-09-19T09:00:02.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.902+0000 7fb9bffff640 10 client.25595 handle_command_reply: tid=0 2024-09-19T09:00:02.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.902+0000 7fb9e5c86740 1 client.25595 shutdown 2024-09-19T09:00:02.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.902+0000 7fb9e5c86740 1 -- 172.21.15.92:0/3159495795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e787f22e0 msgr2=0x564e78800550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:02.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.902+0000 7fb9e5c86740 1 --2- 172.21.15.92:0/3159495795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e787f22e0 0x564e78800550 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc098190 tx=0x7fb9cc09be70 comp rx=0 tx=0).stop 2024-09-19T09:00:02.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.902+0000 7fb9e5c86740 1 -- 172.21.15.92:0/3159495795 shutdown_connections 2024-09-19T09:00:02.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.902+0000 7fb9e5c86740 1 --2- 172.21.15.92:0/3159495795 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564e78872550 0x564e78874970 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.902+0000 7fb9e5c86740 1 --2- 172.21.15.92:0/3159495795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564e787f7370 0x564e78870570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.902+0000 7fb9e5c86740 1 --2- 172.21.15.92:0/3159495795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e787f22e0 0x564e78800550 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.902+0000 7fb9e5c86740 1 --2- 172.21.15.92:0/3159495795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e787f19a0 0x564e78800010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.902+0000 7fb9e5c86740 1 -- 172.21.15.92:0/3159495795 >> 172.21.15.92:0/3159495795 conn(0x564e787ed010 msgr2=0x564e787eb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:02.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.902+0000 7fb9bffff640 0 client.25595 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:02.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.902+0000 7fb9e5c86740 1 -- 172.21.15.92:0/3159495795 shutdown_connections 2024-09-19T09:00:02.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.902+0000 7fb9e5c86740 1 -- 172.21.15.92:0/3159495795 wait complete. 2024-09-19T09:00:02.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.902+0000 7fb9e5c86740 20 client.25595 trim_cache size 0 max 16384 2024-09-19T09:00:02.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:00:02.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:00:02.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:00:02.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:00:02.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.903+0000 7fb9e2e0e640 1 -- 172.21.15.92:0/1208863452 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb9c40a7940 msgr2=0x7fb9c40a9e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.903+0000 7fb9e2e0e640 1 --2- 172.21.15.92:0/1208863452 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb9c40a7940 0x7fb9c40a9e00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb9d40099a0 tx=0x7fb9d4000f40 comp rx=0 tx=0).stop 2024-09-19T09:00:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.903+0000 7fb9e2e0e640 1 -- 172.21.15.92:0/1208863452 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9dc101c30 msgr2=0x7fb9dc197330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.903+0000 7fb9e2e0e640 1 --2- 172.21.15.92:0/1208863452 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9dc101c30 0x7fb9dc197330 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc00bea0 tx=0x7fb9cc00bf90 comp rx=0 tx=0).stop 2024-09-19T09:00:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.903+0000 7fb9e2e0e640 1 -- 172.21.15.92:0/1208863452 shutdown_connections 2024-09-19T09:00:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.903+0000 7fb9e2e0e640 1 --2- 172.21.15.92:0/1208863452 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9dc1025f0 0x7fb9dc19e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.903+0000 7fb9e2e0e640 1 --2- 172.21.15.92:0/1208863452 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9dc101c30 0x7fb9dc197330 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.903+0000 7fb9e2e0e640 1 --2- 172.21.15.92:0/1208863452 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb9c40a7940 0x7fb9c40a9e00 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.903+0000 7fb9e2e0e640 1 --2- 172.21.15.92:0/1208863452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9dc100a40 0x7fb9dc196df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.903+0000 7fb9e2e0e640 1 -- 172.21.15.92:0/1208863452 >> 172.21.15.92:0/1208863452 conn(0x7fb9dc0fc1e0 msgr2=0x7fb9dc105020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.903+0000 7fb9e2e0e640 1 -- 172.21.15.92:0/1208863452 shutdown_connections 2024-09-19T09:00:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:02.903+0000 7fb9e2e0e640 1 -- 172.21.15.92:0/1208863452 wait complete. 2024-09-19T09:00:02.952 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:03.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.511+0000 7f43c9e71640 1 -- 172.21.15.92:0/1023487164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43c41019c0 msgr2=0x7f43c4101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:03.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.511+0000 7f43c9e71640 1 --2- 172.21.15.92:0/1023487164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43c41019c0 0x7f43c4101e20 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f43bc009cd0 tx=0x7f43bc02a8f0 comp rx=0 tx=0).stop 2024-09-19T09:00:03.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.511+0000 7f43c9e71640 1 -- 172.21.15.92:0/1023487164 shutdown_connections 2024-09-19T09:00:03.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.511+0000 7f43c9e71640 1 --2- 172.21.15.92:0/1023487164 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43c4102360 0x7f43c410e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:03.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.511+0000 7f43c9e71640 1 --2- 172.21.15.92:0/1023487164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43c41019c0 0x7f43c4101e20 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:03.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.511+0000 7f43c9e71640 1 --2- 172.21.15.92:0/1023487164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43c41079c0 0x7f43c4107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:03.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.511+0000 7f43c9e71640 1 -- 172.21.15.92:0/1023487164 >> 172.21.15.92:0/1023487164 conn(0x7f43c40fd720 msgr2=0x7f43c40ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:03.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.512+0000 7f43c9e71640 1 -- 172.21.15.92:0/1023487164 shutdown_connections 2024-09-19T09:00:03.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.512+0000 7f43c9e71640 1 -- 172.21.15.92:0/1023487164 wait complete. 2024-09-19T09:00:03.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.512+0000 7f43c9e71640 1 Processor -- start 2024-09-19T09:00:03.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.513+0000 7f43c9e71640 1 -- start start 2024-09-19T09:00:03.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.513+0000 7f43c9e71640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43c41019c0 0x7f43c41088f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:03.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.513+0000 7f43c9e71640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43c4102360 0x7f43c4108e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:03.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.513+0000 7f43c9e71640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43c41079c0 0x7f43c4109370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:03.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.513+0000 7f43c9e71640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f43c4111e10 con 0x7f43c41079c0 2024-09-19T09:00:03.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.513+0000 7f43c9e71640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f43c4111c90 con 0x7f43c4102360 2024-09-19T09:00:03.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.513+0000 7f43c9e71640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f43c4111f90 con 0x7f43c41019c0 2024-09-19T09:00:03.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.513+0000 7f43c8e6f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43c41019c0 0x7f43c41088f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:03.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.513+0000 7f43c8e6f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43c41019c0 0x7f43c41088f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:45782/0 (socket says 172.21.15.92:45782) 2024-09-19T09:00:03.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.513+0000 7f43c8e6f640 1 -- 172.21.15.92:0/1633478277 learned_addr learned my addr 172.21.15.92:0/1633478277 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:03.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.514+0000 7f43c8e6f640 1 -- 172.21.15.92:0/1633478277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43c4102360 msgr2=0x7f43c4108e30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:00:03.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.514+0000 7f43c8e6f640 1 --2- 172.21.15.92:0/1633478277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43c4102360 0x7f43c4108e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:03.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.514+0000 7f43c8e6f640 1 -- 172.21.15.92:0/1633478277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43c41079c0 msgr2=0x7f43c4109370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:03.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.514+0000 7f43c8e6f640 1 --2- 172.21.15.92:0/1633478277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43c41079c0 0x7f43c4109370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:03.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.514+0000 7f43c8e6f640 1 -- 172.21.15.92:0/1633478277 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43c41aab40 con 0x7f43c41019c0 2024-09-19T09:00:03.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.514+0000 7f43c8e6f640 1 --2- 172.21.15.92:0/1633478277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43c41019c0 0x7f43c41088f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f43b800ea20 tx=0x7f43b800eee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:03.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.515+0000 7f43c1ffb640 1 -- 172.21.15.92:0/1633478277 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b800cd80 con 0x7f43c41019c0 2024-09-19T09:00:03.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.515+0000 7f43c1ffb640 1 -- 172.21.15.92:0/1633478277 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43b8010910 con 0x7f43c41019c0 2024-09-19T09:00:03.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.515+0000 7f43c1ffb640 1 -- 172.21.15.92:0/1633478277 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b80188e0 con 0x7f43c41019c0 2024-09-19T09:00:03.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.515+0000 7f43c9e71640 1 -- 172.21.15.92:0/1633478277 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43c41aae30 con 0x7f43c41019c0 2024-09-19T09:00:03.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.515+0000 7f43c9e71640 1 -- 172.21.15.92:0/1633478277 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43c41ab290 con 0x7f43c41019c0 2024-09-19T09:00:03.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.520+0000 7f43c1ffb640 1 -- 172.21.15.92:0/1633478277 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f43b8010ac0 con 0x7f43c41019c0 2024-09-19T09:00:03.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.520+0000 7f43cd4ac740 1 Processor -- start 2024-09-19T09:00:03.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.520+0000 7f43cd4ac740 1 -- start start 2024-09-19T09:00:03.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.521+0000 7f43cd4ac740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ca58e5cf0 0x557ca58e4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:03.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.521+0000 7f43cd4ac740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ca58e4780 0x557ca58e4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:03.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.521+0000 7f43cd4ac740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ca58ef520 0x557ca58f1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:03.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.521+0000 7f43cd4ac740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557ca584a2f0 con 0x557ca58e5cf0 2024-09-19T09:00:03.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.521+0000 7f43cd4ac740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x557ca57f1cf0 con 0x557ca58ef520 2024-09-19T09:00:03.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.521+0000 7f43cd4ac740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x557ca58462b0 con 0x557ca58e4780 2024-09-19T09:00:03.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.521+0000 7f43c9670640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ca58e5cf0 0x557ca58e4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:03.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.521+0000 7f43c8e6f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ca58e4780 0x557ca58e4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:03.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.521+0000 7f43c8e6f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ca58e4780 0x557ca58e4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:45784/0 (socket says 172.21.15.92:45784) 2024-09-19T09:00:03.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.521+0000 7f43c8e6f640 1 -- 172.21.15.92:0/257525425 learned_addr learned my addr 172.21.15.92:0/257525425 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:03.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.521+0000 7f43c3fff640 1 --2- 172.21.15.92:0/257525425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ca58ef520 0x557ca58f1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:03.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.521+0000 7f43c8e6f640 1 -- 172.21.15.92:0/257525425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ca58ef520 msgr2=0x557ca58f1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:03.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.521+0000 7f43c8e6f640 1 --2- 172.21.15.92:0/257525425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ca58ef520 0x557ca58f1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:03.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.521+0000 7f43c8e6f640 1 -- 172.21.15.92:0/257525425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ca58e5cf0 msgr2=0x557ca58e4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:03.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.521+0000 7f43c1ffb640 1 --2- 172.21.15.92:0/1633478277 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f43ac0a3300 0x7f43ac0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:03.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.521+0000 7f43c8e6f640 1 --2- 172.21.15.92:0/257525425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ca58e5cf0 0x557ca58e4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:03.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.521+0000 7f43c8e6f640 1 -- 172.21.15.92:0/257525425 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ca57d63a0 con 0x557ca58e4780 2024-09-19T09:00:03.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.521+0000 7f43c9670640 1 --2- 172.21.15.92:0/1633478277 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f43ac0a3300 0x7f43ac0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:03.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.521+0000 7f43c8e6f640 1 --2- 172.21.15.92:0/257525425 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ca58e4780 0x557ca58e4bc0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f43b8098dd0 tx=0x7f43b80d67f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9618e5c7a0c9e7ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:03.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.522+0000 7f43c1ffb640 1 -- 172.21.15.92:0/1633478277 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f43b80cfde0 con 0x7f43c41019c0 2024-09-19T09:00:03.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.522+0000 7f43aaffd640 1 -- 172.21.15.92:0/257525425 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b80986a0 con 0x557ca58e4780 2024-09-19T09:00:03.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.522+0000 7f43aaffd640 1 -- 172.21.15.92:0/257525425 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43b809c400 con 0x557ca58e4780 2024-09-19T09:00:03.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.524+0000 7f43cd4ac740 1 -- 172.21.15.92:0/257525425 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ca58e4780 msgr2=0x557ca58e4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:03.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.524+0000 7f43cd4ac740 1 --2- 172.21.15.92:0/257525425 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ca58e4780 0x557ca58e4bc0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f43b8098dd0 tx=0x7f43b80d67f0 comp rx=0 tx=0).stop 2024-09-19T09:00:03.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.524+0000 7f43aaffd640 1 -- 172.21.15.92:0/257525425 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b809bd60 con 0x557ca58e4780 2024-09-19T09:00:03.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.524+0000 7f43c9670640 1 --2- 172.21.15.92:0/1633478277 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f43ac0a3300 0x7f43ac0a57c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f43b4009c10 tx=0x7f43b40046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:03.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.524+0000 7f43cd4ac740 1 -- 172.21.15.92:0/257525425 shutdown_connections 2024-09-19T09:00:03.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.524+0000 7f43cd4ac740 1 --2- 172.21.15.92:0/257525425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ca58ef520 0x557ca58f1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:03.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.524+0000 7f43cd4ac740 1 --2- 172.21.15.92:0/257525425 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ca58e4780 0x557ca58e4bc0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:03.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.524+0000 7f43cd4ac740 1 --2- 172.21.15.92:0/257525425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ca58e5cf0 0x557ca58e4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:03.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.524+0000 7f43cd4ac740 1 -- 172.21.15.92:0/257525425 >> 172.21.15.92:0/257525425 conn(0x557ca58ad310 msgr2=0x557ca58e0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:03.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.525+0000 7f43cd4ac740 1 -- 172.21.15.92:0/257525425 shutdown_connections 2024-09-19T09:00:03.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.525+0000 7f43cd4ac740 1 -- 172.21.15.92:0/257525425 wait complete. 2024-09-19T09:00:03.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.526+0000 7f43cd4ac740 1 -- start start 2024-09-19T09:00:03.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.526+0000 7f43cd4ac740 1 Processor -- start 2024-09-19T09:00:03.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.527+0000 7f43cd4ac740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ca58e4780 0x557ca58eed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:03.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.527+0000 7f43cd4ac740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ca58e5cf0 0x557ca58ec090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:03.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.527+0000 7f43cd4ac740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ca58ef520 0x557ca58ec5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:03.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.527+0000 7f43c8e6f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ca58e4780 0x557ca58eed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:03.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.527+0000 7f43c8e6f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ca58e4780 0x557ca58eed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:48388/0 (socket says 172.21.15.92:48388) 2024-09-19T09:00:03.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.527+0000 7f43c3fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ca58e5cf0 0x557ca58ec090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:03.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.527+0000 7f43c3fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ca58e5cf0 0x557ca58ec090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:45796/0 (socket says 172.21.15.92:45796) 2024-09-19T09:00:03.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.528+0000 7f43c9670640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ca58ef520 0x557ca58ec5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:03.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.528+0000 7f43c9670640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ca58ef520 0x557ca58ec5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38522/0 (socket says 172.21.15.92:38522) 2024-09-19T09:00:03.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.528+0000 7f43c9670640 1 -- 172.21.15.92:0/422852269 learned_addr learned my addr 172.21.15.92:0/422852269 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:03.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.528+0000 7f43cd4ac740 1 -- 172.21.15.92:0/422852269 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557ca58f22c0 con 0x557ca58ef520 2024-09-19T09:00:03.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.528+0000 7f43cd4ac740 1 -- 172.21.15.92:0/422852269 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x557ca5805060 con 0x557ca58e4780 2024-09-19T09:00:03.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.528+0000 7f43cd4ac740 1 -- 172.21.15.92:0/422852269 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x557ca58f2440 con 0x557ca58e5cf0 2024-09-19T09:00:03.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.528+0000 7f43cd4ac740 10 client.0 _ll_register_callbacks cb 0x557ca55588c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:03.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.528+0000 7f43c3fff640 1 -- 172.21.15.92:0/422852269 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ca58e4780 msgr2=0x557ca58eed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:03.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.529+0000 7f43c3fff640 1 --2- 172.21.15.92:0/422852269 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ca58e4780 0x557ca58eed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:03.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.529+0000 7f43c3fff640 1 -- 172.21.15.92:0/422852269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ca58ef520 msgr2=0x557ca58ec5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:03.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.529+0000 7f43c3fff640 1 --2- 172.21.15.92:0/422852269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ca58ef520 0x557ca58ec5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:03.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.529+0000 7f43c3fff640 1 -- 172.21.15.92:0/422852269 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ca55bb3c0 con 0x557ca58e5cf0 2024-09-19T09:00:03.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.529+0000 7f43cd4ac740 1 -- 172.21.15.92:0/422852269 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557ca5857860 con 0x557ca58e5cf0 2024-09-19T09:00:03.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.529+0000 7f43c9670640 1 --2- 172.21.15.92:0/422852269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ca58ef520 0x557ca58ec5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:03.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.529+0000 7f43c3fff640 1 --2- 172.21.15.92:0/422852269 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ca58e5cf0 0x557ca58ec090 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f43bc02aee0 tx=0x7f43bc030880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ac6ca89f71b8702 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:03.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.529+0000 7f43a3fff640 10 client.25540 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:00:03.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.529+0000 7f43a3fff640 1 -- 172.21.15.92:0/422852269 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43bc003d80 con 0x557ca58e5cf0 2024-09-19T09:00:03.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.529+0000 7f43a3fff640 1 -- 172.21.15.92:0/422852269 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f43bc030930 con 0x557ca58e5cf0 2024-09-19T09:00:03.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.529+0000 7f43a3fff640 1 -- 172.21.15.92:0/422852269 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f43bc030b70 con 0x557ca58e5cf0 2024-09-19T09:00:03.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.529+0000 7f43cd4ac740 10 client.25540 fetch_fsmap learned FSMap version 19 2024-09-19T09:00:03.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.529+0000 7f43cd4ac740 1 -- 172.21.15.92:0/422852269 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({fsmap=19}) -- 0x557ca58fdc00 con 0x557ca58e5cf0 2024-09-19T09:00:03.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.530+0000 7f43a3fff640 1 -- 172.21.15.92:0/422852269 <== mon.1 v2:172.21.15.190:3300/0 4 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f43bc042070 con 0x557ca58e5cf0 2024-09-19T09:00:03.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.530+0000 7f43cd4ac740 10 client.25540 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:00:03.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.530+0000 7f43cd4ac740 10 client.25540 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:00:03.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.530+0000 7f43cd4ac740 20 client.25540 populate_metadata read hostname 'smithi092' 2024-09-19T09:00:03.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.530+0000 7f43cd4ac740 1 --2- 172.21.15.92:0/422852269 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557ca58ff000 0x557ca59013f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:03.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.530+0000 7f43cd4ac740 4 client.25540 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:00:03.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.530+0000 7f43cd4ac740 1 -- 172.21.15.92:0/422852269 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ca5851d70 con 0x557ca58ff000 2024-09-19T09:00:03.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.530+0000 7f43c8e6f640 1 --2- 172.21.15.92:0/422852269 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557ca58ff000 0x557ca59013f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:03.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.531+0000 7f43a3fff640 10 client.25540 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:03.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.531+0000 7f43c8e6f640 1 --2- 172.21.15.92:0/422852269 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557ca58ff000 0x557ca59013f0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=686bc4a154c6ece4 server_cookie=fda0cbe898d702a6 in_seq=0 out_seq=0 2024-09-19T09:00:03.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.532+0000 7f43a3fff640 1 -- 172.21.15.92:0/422852269 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557ca5851d70 con 0x557ca58ff000 2024-09-19T09:00:03.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.532+0000 7f43a3fff640 10 client.25540 handle_command_reply: tid=0 2024-09-19T09:00:03.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.532+0000 7f43cd4ac740 1 client.25540 shutdown 2024-09-19T09:00:03.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.532+0000 7f43cd4ac740 1 -- 172.21.15.92:0/422852269 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ca58e5cf0 msgr2=0x557ca58ec090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:03.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.532+0000 7f43cd4ac740 1 --2- 172.21.15.92:0/422852269 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ca58e5cf0 0x557ca58ec090 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f43bc02aee0 tx=0x7f43bc030880 comp rx=0 tx=0).stop 2024-09-19T09:00:03.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.532+0000 7f43cd4ac740 1 -- 172.21.15.92:0/422852269 shutdown_connections 2024-09-19T09:00:03.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.532+0000 7f43cd4ac740 1 --2- 172.21.15.92:0/422852269 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557ca58ff000 0x557ca59013f0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:03.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.532+0000 7f43cd4ac740 1 --2- 172.21.15.92:0/422852269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ca58ef520 0x557ca58ec5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:03.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.532+0000 7f43cd4ac740 1 --2- 172.21.15.92:0/422852269 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ca58e5cf0 0x557ca58ec090 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:03.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.532+0000 7f43cd4ac740 1 --2- 172.21.15.92:0/422852269 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ca58e4780 0x557ca58eed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:03.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.532+0000 7f43cd4ac740 1 -- 172.21.15.92:0/422852269 >> 172.21.15.92:0/422852269 conn(0x557ca58ad310 msgr2=0x557ca58e6b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:03.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.532+0000 7f43a3fff640 0 client.25540 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:03.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.532+0000 7f43cd4ac740 1 -- 172.21.15.92:0/422852269 shutdown_connections 2024-09-19T09:00:03.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.533+0000 7f43cd4ac740 1 -- 172.21.15.92:0/422852269 wait complete. 2024-09-19T09:00:03.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.533+0000 7f43cd4ac740 20 client.25540 trim_cache size 0 max 16384 2024-09-19T09:00:03.554 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.554+0000 7f43cd4ac740 1 Processor -- start 2024-09-19T09:00:03.554 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.554+0000 7f43cd4ac740 1 -- start start 2024-09-19T09:00:03.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.555+0000 7f43cd4ac740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ca58e4780 0x557ca58fb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:03.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.555+0000 7f43cd4ac740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ca58e5cf0 0x557ca58e72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:03.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.555+0000 7f43cd4ac740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ca58ef520 0x557ca58e7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:03.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.555+0000 7f43cd4ac740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f43c41b1a90 con 0x557ca58ef520 2024-09-19T09:00:03.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.555+0000 7f43cd4ac740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f43c41b42e0 con 0x557ca58e5cf0 2024-09-19T09:00:03.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.555+0000 7f43cd4ac740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f43c41b20d0 con 0x557ca58e4780 2024-09-19T09:00:03.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.555+0000 7f43c3fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ca58e5cf0 0x557ca58e72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:03.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.555+0000 7f43c8e6f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ca58e4780 0x557ca58fb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:03.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.555+0000 7f43c3fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ca58e5cf0 0x557ca58e72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:48402/0 (socket says 172.21.15.92:48402) 2024-09-19T09:00:03.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.555+0000 7f43c3fff640 1 -- 172.21.15.92:0/2583509895 learned_addr learned my addr 172.21.15.92:0/2583509895 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:03.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.555+0000 7f43c9670640 1 --2- 172.21.15.92:0/2583509895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ca58ef520 0x557ca58e7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:03.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.556+0000 7f43c3fff640 1 -- 172.21.15.92:0/2583509895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ca58e4780 msgr2=0x557ca58fb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:03.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.556+0000 7f43c3fff640 1 --2- 172.21.15.92:0/2583509895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ca58e4780 0x557ca58fb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:03.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.556+0000 7f43c3fff640 1 -- 172.21.15.92:0/2583509895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ca58ef520 msgr2=0x557ca58e7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:03.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.556+0000 7f43c3fff640 1 --2- 172.21.15.92:0/2583509895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ca58ef520 0x557ca58e7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:03.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.556+0000 7f43c3fff640 1 -- 172.21.15.92:0/2583509895 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ca58e12b0 con 0x557ca58e5cf0 2024-09-19T09:00:03.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.556+0000 7f43c3fff640 1 --2- 172.21.15.92:0/2583509895 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ca58e5cf0 0x557ca58e72d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f43bc030af0 tx=0x7f43bc03e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=556dcdbae2058748 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:03.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.556+0000 7f43aa7fc640 1 -- 172.21.15.92:0/2583509895 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43bc044440 con 0x557ca58e5cf0 2024-09-19T09:00:03.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.556+0000 7f43aa7fc640 1 -- 172.21.15.92:0/2583509895 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x557ca5857860 con 0x557ca58e5cf0 2024-09-19T09:00:03.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.556+0000 7f43aa7fc640 1 -- 172.21.15.92:0/2583509895 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43bc0318a0 con 0x557ca58e5cf0 2024-09-19T09:00:03.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.557+0000 7f43cd4ac740 1 -- 172.21.15.92:0/2583509895 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ca58e5cf0 msgr2=0x557ca58e72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:03.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.557+0000 7f43cd4ac740 1 --2- 172.21.15.92:0/2583509895 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ca58e5cf0 0x557ca58e72d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f43bc030af0 tx=0x7f43bc03e000 comp rx=0 tx=0).stop 2024-09-19T09:00:03.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.557+0000 7f43cd4ac740 1 -- 172.21.15.92:0/2583509895 shutdown_connections 2024-09-19T09:00:03.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.557+0000 7f43cd4ac740 1 --2- 172.21.15.92:0/2583509895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ca58ef520 0x557ca58e7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:03.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.557+0000 7f43cd4ac740 1 --2- 172.21.15.92:0/2583509895 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ca58e5cf0 0x557ca58e72d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:03.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.557+0000 7f43cd4ac740 1 --2- 172.21.15.92:0/2583509895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ca58e4780 0x557ca58fb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:03.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.557+0000 7f43cd4ac740 1 -- 172.21.15.92:0/2583509895 >> 172.21.15.92:0/2583509895 conn(0x557ca58ad310 msgr2=0x557ca58ee110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:03.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.558+0000 7f43cd4ac740 1 -- 172.21.15.92:0/2583509895 shutdown_connections 2024-09-19T09:00:03.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.558+0000 7f43cd4ac740 1 -- 172.21.15.92:0/2583509895 wait complete. 2024-09-19T09:00:03.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.558+0000 7f43cd4ac740 1 -- start start 2024-09-19T09:00:03.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.559+0000 7f43cd4ac740 1 Processor -- start 2024-09-19T09:00:03.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.559+0000 7f43cd4ac740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ca58e4780 0x557ca58f7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:03.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.560+0000 7f43cd4ac740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ca58e5cf0 0x557ca58e8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:03.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.560+0000 7f43cd4ac740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ca58ef520 0x557ca58e9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:03.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.560+0000 7f43cd4ac740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f43c41b27a0 con 0x557ca58e4780 2024-09-19T09:00:03.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.560+0000 7f43cd4ac740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f43c41b3c10 con 0x557ca58e5cf0 2024-09-19T09:00:03.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.560+0000 7f43cd4ac740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f43c41b2e70 con 0x557ca58ef520 2024-09-19T09:00:03.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.560+0000 7f43c8e6f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ca58e4780 0x557ca58f7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:03.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.560+0000 7f43cd4ac740 10 client.0 _ll_register_callbacks cb 0x7f43b8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:03.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.560+0000 7f43c9670640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ca58ef520 0x557ca58e9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:03.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.560+0000 7f43c3fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ca58e5cf0 0x557ca58e8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:03.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.560+0000 7f43c9670640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ca58ef520 0x557ca58e9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:45814/0 (socket says 172.21.15.92:45814) 2024-09-19T09:00:03.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.560+0000 7f43c3fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ca58e5cf0 0x557ca58e8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:48416/0 (socket says 172.21.15.92:48416) 2024-09-19T09:00:03.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.560+0000 7f43c9670640 1 -- 172.21.15.92:0/1155920875 learned_addr learned my addr 172.21.15.92:0/1155920875 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:03.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.560+0000 7f43c3fff640 1 -- 172.21.15.92:0/1155920875 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ca58ef520 msgr2=0x557ca58e9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:03.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.560+0000 7f43c3fff640 1 --2- 172.21.15.92:0/1155920875 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ca58ef520 0x557ca58e9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:03.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.560+0000 7f43c3fff640 1 -- 172.21.15.92:0/1155920875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ca58e4780 msgr2=0x557ca58f7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:03.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.560+0000 7f43c3fff640 1 --2- 172.21.15.92:0/1155920875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ca58e4780 0x557ca58f7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:03.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.561+0000 7f43c3fff640 1 -- 172.21.15.92:0/1155920875 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ca58e9790 con 0x557ca58e5cf0 2024-09-19T09:00:03.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.561+0000 7f43c3fff640 1 --2- 172.21.15.92:0/1155920875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ca58e5cf0 0x557ca58e8c10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x557ca58e1c80 tx=0x7f43bc032d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=901e45cf267b7a35 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:03.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.561+0000 7f43a3fff640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:00:03.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.561+0000 7f43a3fff640 1 -- 172.21.15.92:0/1155920875 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43bc030930 con 0x557ca58e5cf0 2024-09-19T09:00:03.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.561+0000 7f43cd4ac740 1 -- 172.21.15.92:0/1155920875 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557ca5857860 con 0x557ca58e5cf0 2024-09-19T09:00:03.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.561+0000 7f43a3fff640 1 -- 172.21.15.92:0/1155920875 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f43bc044440 con 0x557ca58e5cf0 2024-09-19T09:00:03.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.562+0000 7f43a3fff640 1 -- 172.21.15.92:0/1155920875 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f43bc044640 con 0x557ca58e5cf0 2024-09-19T09:00:03.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.562+0000 7f43cd4ac740 10 client.25610 fetch_fsmap learned FSMap version 19 2024-09-19T09:00:03.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.562+0000 7f43cd4ac740 1 -- 172.21.15.92:0/1155920875 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x557ca5969a70 con 0x557ca58e5cf0 2024-09-19T09:00:03.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.563+0000 7f43a3fff640 1 -- 172.21.15.92:0/1155920875 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x557ca5857860 con 0x557ca58e5cf0 2024-09-19T09:00:03.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.563+0000 7f43a3fff640 1 -- 172.21.15.92:0/1155920875 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f43bc062050 con 0x557ca58e5cf0 2024-09-19T09:00:03.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.563+0000 7f43cd4ac740 10 client.25610 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:00:03.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.563+0000 7f43cd4ac740 10 client.25610 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:00:03.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.563+0000 7f43cd4ac740 20 client.25610 populate_metadata read hostname 'smithi092' 2024-09-19T09:00:03.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.563+0000 7f43cd4ac740 1 --2- 172.21.15.92:0/1155920875 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557ca596a070 0x557ca596c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:03.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.563+0000 7f43cd4ac740 4 client.25610 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:00:03.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.563+0000 7f43cd4ac740 1 -- 172.21.15.92:0/1155920875 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557ca57ce170 con 0x557ca596a070 2024-09-19T09:00:03.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.564+0000 7f43c8e6f640 1 --2- 172.21.15.92:0/1155920875 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557ca596a070 0x557ca596c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:03.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.564+0000 7f43c8e6f640 1 --2- 172.21.15.92:0/1155920875 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557ca596a070 0x557ca596c460 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e5705446cdb4cba server_cookie=67357c1d33fa697e in_seq=0 out_seq=0 2024-09-19T09:00:03.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.564+0000 7f43a3fff640 10 client.25610 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:03.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.564+0000 7f43a3fff640 1 -- 172.21.15.92:0/1155920875 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557ca57ce170 con 0x557ca596a070 2024-09-19T09:00:03.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.564+0000 7f43a3fff640 10 client.25610 handle_command_reply: tid=0 2024-09-19T09:00:03.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.565+0000 7f43cd4ac740 1 client.25610 shutdown 2024-09-19T09:00:03.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.565+0000 7f43cd4ac740 1 -- 172.21.15.92:0/1155920875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ca58e5cf0 msgr2=0x557ca58e8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:03.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.565+0000 7f43cd4ac740 1 --2- 172.21.15.92:0/1155920875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ca58e5cf0 0x557ca58e8c10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x557ca58e1c80 tx=0x7f43bc032d00 comp rx=0 tx=0).stop 2024-09-19T09:00:03.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.565+0000 7f43cd4ac740 1 -- 172.21.15.92:0/1155920875 shutdown_connections 2024-09-19T09:00:03.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.565+0000 7f43cd4ac740 1 --2- 172.21.15.92:0/1155920875 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557ca596a070 0x557ca596c460 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:03.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.566+0000 7f43cd4ac740 1 --2- 172.21.15.92:0/1155920875 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557ca58ef520 0x557ca58e9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:03.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.566+0000 7f43cd4ac740 1 --2- 172.21.15.92:0/1155920875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ca58e5cf0 0x557ca58e8c10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:03.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.566+0000 7f43a3fff640 0 client.25610 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:03.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.566+0000 7f43cd4ac740 1 --2- 172.21.15.92:0/1155920875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ca58e4780 0x557ca58f7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:03.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.566+0000 7f43cd4ac740 1 -- 172.21.15.92:0/1155920875 >> 172.21.15.92:0/1155920875 conn(0x557ca58ad310 msgr2=0x557ca58eb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:03.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.566+0000 7f43cd4ac740 1 -- 172.21.15.92:0/1155920875 shutdown_connections 2024-09-19T09:00:03.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.566+0000 7f43cd4ac740 1 -- 172.21.15.92:0/1155920875 wait complete. 2024-09-19T09:00:03.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.566+0000 7f43cd4ac740 20 client.25610 trim_cache size 0 max 16384 2024-09-19T09:00:03.568 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-19T09:00:03.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.567+0000 7f43c9e71640 1 -- 172.21.15.92:0/1633478277 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f43ac0a3300 msgr2=0x7f43ac0a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:03.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.567+0000 7f43c9e71640 1 --2- 172.21.15.92:0/1633478277 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f43ac0a3300 0x7f43ac0a57c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f43b4009c10 tx=0x7f43b40046c0 comp rx=0 tx=0).stop 2024-09-19T09:00:03.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.567+0000 7f43c9e71640 1 -- 172.21.15.92:0/1633478277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43c41019c0 msgr2=0x7f43c41088f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:03.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.567+0000 7f43c9e71640 1 --2- 172.21.15.92:0/1633478277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43c41019c0 0x7f43c41088f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f43b800ea20 tx=0x7f43b800eee0 comp rx=0 tx=0).stop 2024-09-19T09:00:03.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.567+0000 7f43c9e71640 1 -- 172.21.15.92:0/1633478277 shutdown_connections 2024-09-19T09:00:03.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.567+0000 7f43c9e71640 1 --2- 172.21.15.92:0/1633478277 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f43ac0a3300 0x7f43ac0a57c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:03.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.567+0000 7f43c9e71640 1 --2- 172.21.15.92:0/1633478277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43c41079c0 0x7f43c4109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:03.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.567+0000 7f43c9e71640 1 --2- 172.21.15.92:0/1633478277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43c4102360 0x7f43c4108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:03.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.567+0000 7f43c9e71640 1 --2- 172.21.15.92:0/1633478277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43c41019c0 0x7f43c41088f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:03.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.567+0000 7f43c9e71640 1 -- 172.21.15.92:0/1633478277 >> 172.21.15.92:0/1633478277 conn(0x7f43c40fd720 msgr2=0x7f43c410cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:03.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.568+0000 7f43c9e71640 1 -- 172.21.15.92:0/1633478277 shutdown_connections 2024-09-19T09:00:03.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:03.568+0000 7f43c9e71640 1 -- 172.21.15.92:0/1633478277 wait complete. 2024-09-19T09:00:03.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:03 smithi092 ceph-mon[31407]: pgmap v437: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 15 MiB/s wr, 1.02k op/s 2024-09-19T09:00:03.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:03 smithi167 ceph-mon[35359]: pgmap v437: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 15 MiB/s wr, 1.02k op/s 2024-09-19T09:00:03.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:03 smithi190 ceph-mon[35358]: pgmap v437: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 15 MiB/s wr, 1.02k op/s 2024-09-19T09:00:05.513 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:00:05.513 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:00:05.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:05 smithi092 ceph-mon[31407]: pgmap v438: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 16 MiB/s wr, 1.06k op/s 2024-09-19T09:00:05.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 200.0 s, 4188.6 tps, lat 23.892 ms stddev 25.535 2024-09-19T09:00:05.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:05 smithi167 ceph-mon[35359]: pgmap v438: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 16 MiB/s wr, 1.06k op/s 2024-09-19T09:00:05.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:05 smithi190 ceph-mon[35358]: pgmap v438: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 16 MiB/s wr, 1.06k op/s 2024-09-19T09:00:05.929 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:06.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.455+0000 7f83a0a4c640 1 -- 172.21.15.92:0/2066707957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f839c1083f0 msgr2=0x7f839c1087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:06.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.456+0000 7f83a0a4c640 1 --2- 172.21.15.92:0/2066707957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f839c1083f0 0x7f839c1087d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f838c009860 tx=0x7f838c02a340 comp rx=0 tx=0).stop 2024-09-19T09:00:06.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.456+0000 7f83a0a4c640 1 -- 172.21.15.92:0/2066707957 shutdown_connections 2024-09-19T09:00:06.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.456+0000 7f83a0a4c640 1 --2- 172.21.15.92:0/2066707957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f839c10d520 0x7f839c1150a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.456+0000 7f83a0a4c640 1 --2- 172.21.15.92:0/2066707957 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f839c108da0 0x7f839c10cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.456+0000 7f83a0a4c640 1 --2- 172.21.15.92:0/2066707957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f839c1083f0 0x7f839c1087d0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.456+0000 7f83a0a4c640 1 -- 172.21.15.92:0/2066707957 >> 172.21.15.92:0/2066707957 conn(0x7f839c077af0 msgr2=0x7f839c079f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:06.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.458+0000 7f83a0a4c640 1 -- 172.21.15.92:0/2066707957 shutdown_connections 2024-09-19T09:00:06.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.459+0000 7f83a0a4c640 1 -- 172.21.15.92:0/2066707957 wait complete. 2024-09-19T09:00:06.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.460+0000 7f83a0a4c640 1 Processor -- start 2024-09-19T09:00:06.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.460+0000 7f83a0a4c640 1 -- start start 2024-09-19T09:00:06.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.460+0000 7f83a0a4c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f839c1083f0 0x7f839c1a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:06.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.460+0000 7f83a0a4c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f839c108da0 0x7f839c1a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:06.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.460+0000 7f83a0a4c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f839c10d520 0x7f839c19e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:06.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.460+0000 7f83a0a4c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f839c118540 con 0x7f839c1083f0 2024-09-19T09:00:06.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.460+0000 7f83a0a4c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f839c1183c0 con 0x7f839c10d520 2024-09-19T09:00:06.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.460+0000 7f83a0a4c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f839c1186c0 con 0x7f839c108da0 2024-09-19T09:00:06.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.460+0000 7f839a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f839c1083f0 0x7f839c1a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:06.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.461+0000 7f8399d9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f839c108da0 0x7f839c1a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:06.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.461+0000 7f8399d9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f839c108da0 0x7f839c1a4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:45826/0 (socket says 172.21.15.92:45826) 2024-09-19T09:00:06.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.461+0000 7f8399d9b640 1 -- 172.21.15.92:0/377894104 learned_addr learned my addr 172.21.15.92:0/377894104 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:06.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.461+0000 7f839ad9d640 1 --2- 172.21.15.92:0/377894104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f839c10d520 0x7f839c19e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:06.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.461+0000 7f839ad9d640 1 -- 172.21.15.92:0/377894104 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f839c108da0 msgr2=0x7f839c1a4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:06.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.461+0000 7f839ad9d640 1 --2- 172.21.15.92:0/377894104 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f839c108da0 0x7f839c1a4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.461+0000 7f839ad9d640 1 -- 172.21.15.92:0/377894104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f839c1083f0 msgr2=0x7f839c1a46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:06.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.461+0000 7f839ad9d640 1 --2- 172.21.15.92:0/377894104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f839c1083f0 0x7f839c1a46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.461+0000 7f839ad9d640 1 -- 172.21.15.92:0/377894104 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f839c19efd0 con 0x7f839c10d520 2024-09-19T09:00:06.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.462+0000 7f839ad9d640 1 --2- 172.21.15.92:0/377894104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f839c10d520 0x7f839c19e830 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f839400ef00 tx=0x7f839400c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:06.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.462+0000 7f838b7fe640 1 -- 172.21.15.92:0/377894104 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8394004b20 con 0x7f839c10d520 2024-09-19T09:00:06.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.462+0000 7f838b7fe640 1 -- 172.21.15.92:0/377894104 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8394003e50 con 0x7f839c10d520 2024-09-19T09:00:06.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.462+0000 7f838b7fe640 1 -- 172.21.15.92:0/377894104 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839400b570 con 0x7f839c10d520 2024-09-19T09:00:06.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.462+0000 7f83a0a4c640 1 -- 172.21.15.92:0/377894104 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f839c19f2c0 con 0x7f839c10d520 2024-09-19T09:00:06.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.462+0000 7f83a0a4c640 1 -- 172.21.15.92:0/377894104 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f839c1ab510 con 0x7f839c10d520 2024-09-19T09:00:06.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.465+0000 7f838b7fe640 1 -- 172.21.15.92:0/377894104 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f839401d020 con 0x7f839c10d520 2024-09-19T09:00:06.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.466+0000 7f838b7fe640 1 --2- 172.21.15.92:0/377894104 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f83840a3340 0x7f83840a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:06.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.466+0000 7f838b7fe640 1 -- 172.21.15.92:0/377894104 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f83940cf5f0 con 0x7f839c10d520 2024-09-19T09:00:06.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.468+0000 7f839a59c640 1 --2- 172.21.15.92:0/377894104 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f83840a3340 0x7f83840a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:06.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.469+0000 7f83a2e25740 1 Processor -- start 2024-09-19T09:00:06.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.469+0000 7f83a2e25740 1 -- start start 2024-09-19T09:00:06.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.469+0000 7f839a59c640 1 --2- 172.21.15.92:0/377894104 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f83840a3340 0x7f83840a5800 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f838c02a930 tx=0x7f838c0056d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:06.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.470+0000 7f83a2e25740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7219bdb60 0x55f7219bdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:06.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.470+0000 7f83a2e25740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7219be480 0x55f7219c8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:06.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.470+0000 7f839a59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7219bdb60 0x55f7219bdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:06.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.470+0000 7f839a59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7219bdb60 0x55f7219bdf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:48444/0 (socket says 172.21.15.92:48444) 2024-09-19T09:00:06.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.470+0000 7f83a2e25740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7219c8d40 0x55f7219cb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:06.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.470+0000 7f839a59c640 1 -- 172.21.15.92:0/789136235 learned_addr learned my addr 172.21.15.92:0/789136235 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:06.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.470+0000 7f83a2e25740 1 -- 172.21.15.92:0/789136235 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f721923280 con 0x55f7219be480 2024-09-19T09:00:06.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.470+0000 7f83a2e25740 1 -- 172.21.15.92:0/789136235 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f7218cab10 con 0x55f7219bdb60 2024-09-19T09:00:06.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.470+0000 7f83a2e25740 1 -- 172.21.15.92:0/789136235 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f72191f240 con 0x55f7219c8d40 2024-09-19T09:00:06.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.470+0000 7f839ad9d640 1 --2- 172.21.15.92:0/789136235 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7219c8d40 0x55f7219cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:06.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.470+0000 7f8399d9b640 1 --2- 172.21.15.92:0/789136235 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7219be480 0x55f7219c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:06.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.471+0000 7f839ad9d640 1 -- 172.21.15.92:0/789136235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7219bdb60 msgr2=0x55f7219bdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:06.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.471+0000 7f839ad9d640 1 --2- 172.21.15.92:0/789136235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7219bdb60 0x55f7219bdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.471+0000 7f839ad9d640 1 -- 172.21.15.92:0/789136235 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7219be480 msgr2=0x55f7219c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:06.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.471+0000 7f839ad9d640 1 --2- 172.21.15.92:0/789136235 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7219be480 0x55f7219c8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.471+0000 7f839ad9d640 1 -- 172.21.15.92:0/789136235 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7218d71f0 con 0x55f7219c8d40 2024-09-19T09:00:06.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.471+0000 7f839ad9d640 1 --2- 172.21.15.92:0/789136235 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7219c8d40 0x55f7219cb130 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f83940cd0b0 tx=0x7f839409bc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee3b21151f091592 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:06.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.472+0000 7f8388ff9640 1 -- 172.21.15.92:0/789136235 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839401a040 con 0x55f7219c8d40 2024-09-19T09:00:06.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.472+0000 7f8388ff9640 1 -- 172.21.15.92:0/789136235 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83940cd1c0 con 0x55f7219c8d40 2024-09-19T09:00:06.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.472+0000 7f8388ff9640 1 -- 172.21.15.92:0/789136235 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8394086320 con 0x55f7219c8d40 2024-09-19T09:00:06.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.473+0000 7f83a2e25740 1 -- 172.21.15.92:0/789136235 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7219c8d40 msgr2=0x55f7219cb130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:06.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.473+0000 7f83a2e25740 1 --2- 172.21.15.92:0/789136235 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7219c8d40 0x55f7219cb130 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f83940cd0b0 tx=0x7f839409bc90 comp rx=0 tx=0).stop 2024-09-19T09:00:06.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.473+0000 7f83a2e25740 1 -- 172.21.15.92:0/789136235 shutdown_connections 2024-09-19T09:00:06.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.473+0000 7f83a2e25740 1 --2- 172.21.15.92:0/789136235 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7219c8d40 0x55f7219cb130 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.473+0000 7f83a2e25740 1 --2- 172.21.15.92:0/789136235 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7219be480 0x55f7219c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.473+0000 7f83a2e25740 1 --2- 172.21.15.92:0/789136235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7219bdb60 0x55f7219bdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.473+0000 7f83a2e25740 1 -- 172.21.15.92:0/789136235 >> 172.21.15.92:0/789136235 conn(0x55f7219ba0f0 msgr2=0x55f7219ba4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:06.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.473+0000 7f83a2e25740 1 -- 172.21.15.92:0/789136235 shutdown_connections 2024-09-19T09:00:06.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.474+0000 7f83a2e25740 1 -- 172.21.15.92:0/789136235 wait complete. 2024-09-19T09:00:06.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.474+0000 7f83a2e25740 1 -- start start 2024-09-19T09:00:06.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.474+0000 7f83a2e25740 1 Processor -- start 2024-09-19T09:00:06.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.475+0000 7f83a2e25740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7219bdb60 0x55f7219c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:06.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.475+0000 7f83a2e25740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7219be480 0x55f7219c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:06.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.475+0000 7f83a2e25740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7219c8d40 0x55f7219c6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:06.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.475+0000 7f83a2e25740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f7219cb910 con 0x55f7219be480 2024-09-19T09:00:06.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.475+0000 7f83a2e25740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f7218ddf10 con 0x55f7219bdb60 2024-09-19T09:00:06.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.475+0000 7f83a2e25740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f7219cba90 con 0x55f7219c8d40 2024-09-19T09:00:06.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.475+0000 7f83a2e25740 10 client.0 _ll_register_callbacks cb 0x55f7218a6a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:06.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.475+0000 7f839a59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7219bdb60 0x55f7219c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:06.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.475+0000 7f839a59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7219bdb60 0x55f7219c5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:48448/0 (socket says 172.21.15.92:48448) 2024-09-19T09:00:06.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.475+0000 7f839a59c640 1 -- 172.21.15.92:0/2845252303 learned_addr learned my addr 172.21.15.92:0/2845252303 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:06.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.475+0000 7f839ad9d640 1 --2- 172.21.15.92:0/2845252303 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7219c8d40 0x55f7219c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:06.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.476+0000 7f839a59c640 1 -- 172.21.15.92:0/2845252303 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7219c8d40 msgr2=0x55f7219c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:06.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.476+0000 7f839a59c640 1 --2- 172.21.15.92:0/2845252303 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7219c8d40 0x55f7219c6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.476+0000 7f839a59c640 1 -- 172.21.15.92:0/2845252303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7219be480 msgr2=0x55f7219c61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:06.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.476+0000 7f839a59c640 1 --2- 172.21.15.92:0/2845252303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7219be480 0x55f7219c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.476+0000 7f839a59c640 1 -- 172.21.15.92:0/2845252303 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7216946a0 con 0x55f7219bdb60 2024-09-19T09:00:06.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.476+0000 7f839a59c640 1 --2- 172.21.15.92:0/2845252303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7219bdb60 0x55f7219c5c90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f838c034000 tx=0x7f838c005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a6bf42f01295166 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:06.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.477+0000 7f8381ffb640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:00:06.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.477+0000 7f8381ffb640 1 -- 172.21.15.92:0/2845252303 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838c04d070 con 0x55f7219bdb60 2024-09-19T09:00:06.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.477+0000 7f8381ffb640 1 -- 172.21.15.92:0/2845252303 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f838c003a00 con 0x55f7219bdb60 2024-09-19T09:00:06.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.477+0000 7f83a2e25740 1 -- 172.21.15.92:0/2845252303 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83940cd1c0 con 0x55f7219bdb60 2024-09-19T09:00:06.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.477+0000 7f8381ffb640 1 -- 172.21.15.92:0/2845252303 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f838c057050 con 0x55f7219bdb60 2024-09-19T09:00:06.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.477+0000 7f83a2e25740 10 client.25622 fetch_fsmap learned FSMap version 19 2024-09-19T09:00:06.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.478+0000 7f83a2e25740 1 -- 172.21.15.92:0/2845252303 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f7219d7620 con 0x55f7219bdb60 2024-09-19T09:00:06.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.478+0000 7f8381ffb640 1 -- 172.21.15.92:0/2845252303 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f838c003c00 con 0x55f7219bdb60 2024-09-19T09:00:06.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.478+0000 7f8381ffb640 1 -- 172.21.15.92:0/2845252303 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f838c052460 con 0x55f7219bdb60 2024-09-19T09:00:06.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.478+0000 7f83a2e25740 10 client.25622 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:00:06.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.478+0000 7f83a2e25740 10 client.25622 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:00:06.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.478+0000 7f83a2e25740 20 client.25622 populate_metadata read hostname 'smithi092' 2024-09-19T09:00:06.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.478+0000 7f83a2e25740 1 --2- 172.21.15.92:0/2845252303 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f7219d8b80 0x55f7219daf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:06.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.478+0000 7f83a2e25740 4 client.25622 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:00:06.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.478+0000 7f83a2e25740 1 -- 172.21.15.92:0/2845252303 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f83940cd1c0 con 0x55f7219d8b80 2024-09-19T09:00:06.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.478+0000 7f8399d9b640 1 --2- 172.21.15.92:0/2845252303 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f7219d8b80 0x55f7219daf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:06.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.479+0000 7f8381ffb640 10 client.25622 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:06.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.479+0000 7f8399d9b640 1 --2- 172.21.15.92:0/2845252303 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f7219d8b80 0x55f7219daf70 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d7944e1134fbac2 server_cookie=443c179f7976bf32 in_seq=0 out_seq=0 2024-09-19T09:00:06.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.480+0000 7f8381ffb640 1 -- 172.21.15.92:0/2845252303 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f83940cd1c0 con 0x55f7219d8b80 2024-09-19T09:00:06.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.480+0000 7f8381ffb640 10 client.25622 handle_command_reply: tid=0 2024-09-19T09:00:06.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.480+0000 7f83a2e25740 1 client.25622 shutdown 2024-09-19T09:00:06.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.480+0000 7f83a2e25740 1 -- 172.21.15.92:0/2845252303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7219bdb60 msgr2=0x55f7219c5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:06.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.481+0000 7f83a2e25740 1 --2- 172.21.15.92:0/2845252303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7219bdb60 0x55f7219c5c90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f838c034000 tx=0x7f838c005f90 comp rx=0 tx=0).stop 2024-09-19T09:00:06.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.481+0000 7f83a2e25740 1 -- 172.21.15.92:0/2845252303 shutdown_connections 2024-09-19T09:00:06.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.481+0000 7f83a2e25740 1 --2- 172.21.15.92:0/2845252303 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f7219d8b80 0x55f7219daf70 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.481+0000 7f83a2e25740 1 --2- 172.21.15.92:0/2845252303 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7219c8d40 0x55f7219c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.481+0000 7f8381ffb640 0 client.25622 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:06.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.481+0000 7f83a2e25740 1 --2- 172.21.15.92:0/2845252303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7219be480 0x55f7219c61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.481+0000 7f83a2e25740 1 --2- 172.21.15.92:0/2845252303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7219bdb60 0x55f7219c5c90 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.481+0000 7f83a2e25740 1 -- 172.21.15.92:0/2845252303 >> 172.21.15.92:0/2845252303 conn(0x55f7219ba0f0 msgr2=0x55f7219bfe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:06.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.481+0000 7f83a2e25740 1 -- 172.21.15.92:0/2845252303 shutdown_connections 2024-09-19T09:00:06.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.481+0000 7f83a2e25740 1 -- 172.21.15.92:0/2845252303 wait complete. 2024-09-19T09:00:06.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.482+0000 7f83a2e25740 20 client.25622 trim_cache size 0 max 16384 2024-09-19T09:00:06.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.510+0000 7f83a2e25740 1 Processor -- start 2024-09-19T09:00:06.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.510+0000 7f83a2e25740 1 -- start start 2024-09-19T09:00:06.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.510+0000 7f83a2e25740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7219bdb60 0x55f7219c6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:06.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.510+0000 7f83a2e25740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7219be480 0x55f7219e0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:06.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.510+0000 7f83a2e25740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7219c8d40 0x55f7219e0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:06.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.510+0000 7f839a59c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7219bdb60 0x55f7219c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:06.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.510+0000 7f839a59c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7219bdb60 0x55f7219c6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:45852/0 (socket says 172.21.15.92:45852) 2024-09-19T09:00:06.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.511+0000 7f839a59c640 1 -- 172.21.15.92:0/3914469188 learned_addr learned my addr 172.21.15.92:0/3914469188 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:06.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.511+0000 7f83a2e25740 1 -- 172.21.15.92:0/3914469188 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f837c00c570 con 0x55f7219c8d40 2024-09-19T09:00:06.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.511+0000 7f83a2e25740 1 -- 172.21.15.92:0/3914469188 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f837c00ee10 con 0x55f7219be480 2024-09-19T09:00:06.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.511+0000 7f83a2e25740 1 -- 172.21.15.92:0/3914469188 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f837c00cc00 con 0x55f7219bdb60 2024-09-19T09:00:06.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.511+0000 7f839a59c640 1 -- 172.21.15.92:0/3914469188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7219be480 msgr2=0x55f7219e0880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:00:06.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.511+0000 7f839a59c640 1 --2- 172.21.15.92:0/3914469188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7219be480 0x55f7219e0880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.511+0000 7f839a59c640 1 -- 172.21.15.92:0/3914469188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7219c8d40 msgr2=0x55f7219e0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:06.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.511+0000 7f839ad9d640 1 --2- 172.21.15.92:0/3914469188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7219c8d40 0x55f7219e0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:06.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.511+0000 7f839a59c640 1 --2- 172.21.15.92:0/3914469188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7219c8d40 0x55f7219e0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.511+0000 7f839a59c640 1 -- 172.21.15.92:0/3914469188 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7219b9f20 con 0x55f7219bdb60 2024-09-19T09:00:06.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.511+0000 7f839ad9d640 1 --2- 172.21.15.92:0/3914469188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7219c8d40 0x55f7219e0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:00:06.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.512+0000 7f839a59c640 1 --2- 172.21.15.92:0/3914469188 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7219bdb60 0x55f7219c6560 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f838c02d020 tx=0x7f838c030380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14b1887b5428fd14 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:06.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.512+0000 7f8383fff640 1 -- 172.21.15.92:0/3914469188 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838c061070 con 0x55f7219bdb60 2024-09-19T09:00:06.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.512+0000 7f8383fff640 1 -- 172.21.15.92:0/3914469188 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f838c052ca0 con 0x55f7219bdb60 2024-09-19T09:00:06.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.512+0000 7f8383fff640 1 -- 172.21.15.92:0/3914469188 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838c04d040 con 0x55f7219bdb60 2024-09-19T09:00:06.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.513+0000 7f83a2e25740 1 -- 172.21.15.92:0/3914469188 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7219bdb60 msgr2=0x55f7219c6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:06.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.513+0000 7f83a2e25740 1 --2- 172.21.15.92:0/3914469188 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7219bdb60 0x55f7219c6560 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f838c02d020 tx=0x7f838c030380 comp rx=0 tx=0).stop 2024-09-19T09:00:06.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.513+0000 7f83a2e25740 1 -- 172.21.15.92:0/3914469188 shutdown_connections 2024-09-19T09:00:06.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.513+0000 7f83a2e25740 1 --2- 172.21.15.92:0/3914469188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7219c8d40 0x55f7219e0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.513+0000 7f83a2e25740 1 --2- 172.21.15.92:0/3914469188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7219be480 0x55f7219e0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.513+0000 7f83a2e25740 1 --2- 172.21.15.92:0/3914469188 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7219bdb60 0x55f7219c6560 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.513+0000 7f83a2e25740 1 -- 172.21.15.92:0/3914469188 >> 172.21.15.92:0/3914469188 conn(0x55f7219ba0f0 msgr2=0x55f7219bfe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:06.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.514+0000 7f83a2e25740 1 -- 172.21.15.92:0/3914469188 shutdown_connections 2024-09-19T09:00:06.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.514+0000 7f83a2e25740 1 -- 172.21.15.92:0/3914469188 wait complete. 2024-09-19T09:00:06.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.514+0000 7f83a2e25740 1 -- start start 2024-09-19T09:00:06.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.514+0000 7f83a2e25740 1 Processor -- start 2024-09-19T09:00:06.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.515+0000 7f83a2e25740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7219bdb60 0x55f721a3cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:06.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.515+0000 7f83a2e25740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7219be480 0x55f721a3d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:06.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.515+0000 7f83a2e25740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7219c8d40 0x55f7219cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:06.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.515+0000 7f839a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7219bdb60 0x55f721a3cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:06.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.515+0000 7f839a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7219bdb60 0x55f721a3cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38582/0 (socket says 172.21.15.92:38582) 2024-09-19T09:00:06.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.515+0000 7f839a59c640 1 -- 172.21.15.92:0/3767661565 learned_addr learned my addr 172.21.15.92:0/3767661565 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:06.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.515+0000 7f83a2e25740 1 -- 172.21.15.92:0/3767661565 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f837c00d2d0 con 0x55f7219bdb60 2024-09-19T09:00:06.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.515+0000 7f83a2e25740 1 -- 172.21.15.92:0/3767661565 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f837c00e740 con 0x55f7219be480 2024-09-19T09:00:06.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.515+0000 7f83a2e25740 1 -- 172.21.15.92:0/3767661565 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f837c00d9a0 con 0x55f7219c8d40 2024-09-19T09:00:06.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.515+0000 7f8399d9b640 1 --2- 172.21.15.92:0/3767661565 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7219be480 0x55f721a3d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:06.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.515+0000 7f83a2e25740 10 client.0 _ll_register_callbacks cb 0x7f838c0096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:06.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.515+0000 7f839ad9d640 1 --2- 172.21.15.92:0/3767661565 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7219c8d40 0x55f7219cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:06.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.516+0000 7f839a59c640 1 -- 172.21.15.92:0/3767661565 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7219c8d40 msgr2=0x55f7219cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:06.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.516+0000 7f839a59c640 1 --2- 172.21.15.92:0/3767661565 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7219c8d40 0x55f7219cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.516+0000 7f839a59c640 1 -- 172.21.15.92:0/3767661565 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7219be480 msgr2=0x55f721a3d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:06.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.516+0000 7f839a59c640 1 --2- 172.21.15.92:0/3767661565 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7219be480 0x55f721a3d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.516+0000 7f839a59c640 1 -- 172.21.15.92:0/3767661565 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7219cda00 con 0x55f7219bdb60 2024-09-19T09:00:06.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.516+0000 7f839a59c640 1 --2- 172.21.15.92:0/3767661565 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7219bdb60 0x55f721a3cae0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f838c005970 tx=0x7f838c0527d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=205c2a6b0459a86c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:06.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.517+0000 7f8381ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:00:06.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.517+0000 7f8381ffb640 1 -- 172.21.15.92:0/3767661565 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838c061020 con 0x55f7219bdb60 2024-09-19T09:00:06.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.517+0000 7f8381ffb640 1 -- 172.21.15.92:0/3767661565 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f838c03d640 con 0x55f7219bdb60 2024-09-19T09:00:06.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.517+0000 7f83a2e25740 1 -- 172.21.15.92:0/3767661565 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f838c052ca0 con 0x55f7219bdb60 2024-09-19T09:00:06.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.518+0000 7f8381ffb640 1 -- 172.21.15.92:0/3767661565 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f838c04d040 con 0x55f7219bdb60 2024-09-19T09:00:06.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.518+0000 7f83a2e25740 10 client.16176 fetch_fsmap learned FSMap version 19 2024-09-19T09:00:06.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.519+0000 7f83a2e25740 1 -- 172.21.15.92:0/3767661565 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f721a442d0 con 0x55f7219bdb60 2024-09-19T09:00:06.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.519+0000 7f8381ffb640 1 -- 172.21.15.92:0/3767661565 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f838c03dd20 con 0x55f7219bdb60 2024-09-19T09:00:06.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.520+0000 7f8381ffb640 1 -- 172.21.15.92:0/3767661565 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f838c032b40 con 0x55f7219bdb60 2024-09-19T09:00:06.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.520+0000 7f83a2e25740 10 client.16176 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:00:06.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.520+0000 7f83a2e25740 10 client.16176 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:00:06.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.520+0000 7f83a2e25740 20 client.16176 populate_metadata read hostname 'smithi092' 2024-09-19T09:00:06.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.520+0000 7f83a2e25740 1 --2- 172.21.15.92:0/3767661565 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f721a44700 0x55f721a46af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:06.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.520+0000 7f83a2e25740 4 client.16176 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:00:06.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.520+0000 7f83a2e25740 1 -- 172.21.15.92:0/3767661565 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f838c052ca0 con 0x55f721a44700 2024-09-19T09:00:06.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.520+0000 7f8399d9b640 1 --2- 172.21.15.92:0/3767661565 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f721a44700 0x55f721a46af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:06.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.522+0000 7f8381ffb640 10 client.16176 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:06.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.522+0000 7f8399d9b640 1 --2- 172.21.15.92:0/3767661565 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f721a44700 0x55f721a46af0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb7ea9bb837ad036 server_cookie=ebac5fddd4e6140d in_seq=0 out_seq=0 2024-09-19T09:00:06.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.523+0000 7f8381ffb640 1 -- 172.21.15.92:0/3767661565 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f838c052ca0 con 0x55f721a44700 2024-09-19T09:00:06.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.523+0000 7f8381ffb640 10 client.16176 handle_command_reply: tid=0 2024-09-19T09:00:06.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.523+0000 7f83a2e25740 1 client.16176 shutdown 2024-09-19T09:00:06.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.524+0000 7f83a2e25740 1 -- 172.21.15.92:0/3767661565 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7219bdb60 msgr2=0x55f721a3cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:06.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.524+0000 7f83a2e25740 1 --2- 172.21.15.92:0/3767661565 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7219bdb60 0x55f721a3cae0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f838c005970 tx=0x7f838c0527d0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.524+0000 7f83a2e25740 1 -- 172.21.15.92:0/3767661565 shutdown_connections 2024-09-19T09:00:06.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.524+0000 7f83a2e25740 1 --2- 172.21.15.92:0/3767661565 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f721a44700 0x55f721a46af0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.524+0000 7f83a2e25740 1 --2- 172.21.15.92:0/3767661565 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7219c8d40 0x55f7219cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.524+0000 7f83a2e25740 1 --2- 172.21.15.92:0/3767661565 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7219be480 0x55f721a3d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.524+0000 7f83a2e25740 1 --2- 172.21.15.92:0/3767661565 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7219bdb60 0x55f721a3cae0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.524+0000 7f8381ffb640 0 client.16176 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:06.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.524+0000 7f83a2e25740 1 -- 172.21.15.92:0/3767661565 >> 172.21.15.92:0/3767661565 conn(0x55f7219ba0f0 msgr2=0x55f7219b8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:06.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.524+0000 7f83a2e25740 1 -- 172.21.15.92:0/3767661565 shutdown_connections 2024-09-19T09:00:06.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.524+0000 7f83a2e25740 1 -- 172.21.15.92:0/3767661565 wait complete. 2024-09-19T09:00:06.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.524+0000 7f83a2e25740 20 client.16176 trim_cache size 0 max 16384 2024-09-19T09:00:06.525 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:00:06.525 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-19T09:00:06.525 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "3351b46b-50e8-4869-8163-9303afda14f7", 2024-09-19T09:00:06.526 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-19T09:00:06.526 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:00:06.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.526+0000 7f83a0a4c640 1 -- 172.21.15.92:0/377894104 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f83840a3340 msgr2=0x7f83840a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:06.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.526+0000 7f83a0a4c640 1 --2- 172.21.15.92:0/377894104 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f83840a3340 0x7f83840a5800 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f838c02a930 tx=0x7f838c0056d0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.526+0000 7f83a0a4c640 1 -- 172.21.15.92:0/377894104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f839c10d520 msgr2=0x7f839c19e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:06.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.526+0000 7f83a0a4c640 1 --2- 172.21.15.92:0/377894104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f839c10d520 0x7f839c19e830 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f839400ef00 tx=0x7f839400c740 comp rx=0 tx=0).stop 2024-09-19T09:00:06.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.526+0000 7f83a0a4c640 1 -- 172.21.15.92:0/377894104 shutdown_connections 2024-09-19T09:00:06.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.526+0000 7f83a0a4c640 1 --2- 172.21.15.92:0/377894104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f839c10d520 0x7f839c19e830 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.526+0000 7f83a0a4c640 1 --2- 172.21.15.92:0/377894104 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f839c108da0 0x7f839c1a4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.526+0000 7f83a0a4c640 1 --2- 172.21.15.92:0/377894104 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f83840a3340 0x7f83840a5800 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.526+0000 7f83a0a4c640 1 --2- 172.21.15.92:0/377894104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f839c1083f0 0x7f839c1a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.526+0000 7f83a0a4c640 1 -- 172.21.15.92:0/377894104 >> 172.21.15.92:0/377894104 conn(0x7f839c077af0 msgr2=0x7f839c078e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:06.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.526+0000 7f83a0a4c640 1 -- 172.21.15.92:0/377894104 shutdown_connections 2024-09-19T09:00:06.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:06.526+0000 7f83a0a4c640 1 -- 172.21.15.92:0/377894104 wait complete. 2024-09-19T09:00:07.218 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:00:07.628 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:07.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:07 smithi092 ceph-mon[31407]: pgmap v439: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 14 MiB/s wr, 990 op/s 2024-09-19T09:00:07.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:07 smithi092 ceph-mon[31407]: scrub queued for path: / 2024-09-19T09:00:07.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:07 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:00:07.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:07 smithi092 ceph-mon[31407]: scrub summary: active paths [/] 2024-09-19T09:00:07.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:07 smithi167 ceph-mon[35359]: pgmap v439: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 14 MiB/s wr, 990 op/s 2024-09-19T09:00:07.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:07 smithi167 ceph-mon[35359]: scrub queued for path: / 2024-09-19T09:00:07.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:07 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:00:07.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:07 smithi167 ceph-mon[35359]: scrub summary: active paths [/] 2024-09-19T09:00:07.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:07 smithi190 ceph-mon[35358]: pgmap v439: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 14 MiB/s wr, 990 op/s 2024-09-19T09:00:07.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:07 smithi190 ceph-mon[35358]: scrub queued for path: / 2024-09-19T09:00:07.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:07 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:00:07.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:07 smithi190 ceph-mon[35358]: scrub summary: active paths [/] 2024-09-19T09:00:08.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.224+0000 7f88d5f54640 1 -- 172.21.15.92:0/219346340 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88d0100a80 msgr2=0x7f88d0100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:08.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.224+0000 7f88d5f54640 1 --2- 172.21.15.92:0/219346340 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88d0100a80 0x7f88d0100ee0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f88c4009860 tx=0x7f88c402a340 comp rx=0 tx=0).stop 2024-09-19T09:00:08.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.224+0000 7f88d5f54640 1 -- 172.21.15.92:0/219346340 shutdown_connections 2024-09-19T09:00:08.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.224+0000 7f88d5f54640 1 --2- 172.21.15.92:0/219346340 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88d0101420 0x7f88d010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:08.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.224+0000 7f88d5f54640 1 --2- 172.21.15.92:0/219346340 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88d0100a80 0x7f88d0100ee0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:08.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.224+0000 7f88d5f54640 1 --2- 172.21.15.92:0/219346340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88d0106a80 0x7f88d0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:08.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.224+0000 7f88d5f54640 1 -- 172.21.15.92:0/219346340 >> 172.21.15.92:0/219346340 conn(0x7f88d00fc7a0 msgr2=0x7f88d00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:08.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.225+0000 7f88d5f54640 1 -- 172.21.15.92:0/219346340 shutdown_connections 2024-09-19T09:00:08.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.225+0000 7f88d5f54640 1 -- 172.21.15.92:0/219346340 wait complete. 2024-09-19T09:00:08.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.226+0000 7f88d5f54640 1 Processor -- start 2024-09-19T09:00:08.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.226+0000 7f88d5f54640 1 -- start start 2024-09-19T09:00:08.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.226+0000 7f88d5f54640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88d0100a80 0x7f88d019a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:08.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.227+0000 7f88d5f54640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88d0101420 0x7f88d019ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:08.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.228+0000 7f88ceffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88d0101420 0x7f88d019ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:08.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.228+0000 7f88ceffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88d0101420 0x7f88d019ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38600/0 (socket says 172.21.15.92:38600) 2024-09-19T09:00:08.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.228+0000 7f88ceffd640 1 -- 172.21.15.92:0/803952113 learned_addr learned my addr 172.21.15.92:0/803952113 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:08.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.228+0000 7f88d5f54640 1 --2- 172.21.15.92:0/803952113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88d0106a80 0x7f88d019ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:08.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.228+0000 7f88d5f54640 1 -- 172.21.15.92:0/803952113 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f88d010fd40 con 0x7f88d0101420 2024-09-19T09:00:08.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.228+0000 7f88d5f54640 1 -- 172.21.15.92:0/803952113 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f88d010fbc0 con 0x7f88d0106a80 2024-09-19T09:00:08.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.228+0000 7f88d5f54640 1 -- 172.21.15.92:0/803952113 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f88d010fec0 con 0x7f88d0100a80 2024-09-19T09:00:08.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.228+0000 7f88cf7fe640 1 --2- 172.21.15.92:0/803952113 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88d0100a80 0x7f88d019a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:08.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.228+0000 7f88cffff640 1 --2- 172.21.15.92:0/803952113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88d0106a80 0x7f88d019ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:08.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.228+0000 7f88ceffd640 1 -- 172.21.15.92:0/803952113 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88d0100a80 msgr2=0x7f88d019a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:08.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.228+0000 7f88ceffd640 1 --2- 172.21.15.92:0/803952113 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88d0100a80 0x7f88d019a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:08.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.229+0000 7f88ceffd640 1 -- 172.21.15.92:0/803952113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88d0106a80 msgr2=0x7f88d019ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:08.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.229+0000 7f88ceffd640 1 --2- 172.21.15.92:0/803952113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88d0106a80 0x7f88d019ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:08.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.229+0000 7f88ceffd640 1 -- 172.21.15.92:0/803952113 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d019f620 con 0x7f88d0101420 2024-09-19T09:00:08.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.229+0000 7f88ceffd640 1 --2- 172.21.15.92:0/803952113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88d0101420 0x7f88d019ac00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f88c4035040 tx=0x7f88c4033d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:08.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.229+0000 7f88cffff640 1 --2- 172.21.15.92:0/803952113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88d0106a80 0x7f88d019ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:00:08.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.230+0000 7f88ccff9640 1 -- 172.21.15.92:0/803952113 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c4037040 con 0x7f88d0101420 2024-09-19T09:00:08.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.230+0000 7f88ccff9640 1 -- 172.21.15.92:0/803952113 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88c4043070 con 0x7f88d0101420 2024-09-19T09:00:08.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.230+0000 7f88ccff9640 1 -- 172.21.15.92:0/803952113 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c4003850 con 0x7f88d0101420 2024-09-19T09:00:08.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.230+0000 7f88d5f54640 1 -- 172.21.15.92:0/803952113 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88d019f8b0 con 0x7f88d0101420 2024-09-19T09:00:08.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.230+0000 7f88d5f54640 1 -- 172.21.15.92:0/803952113 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88d019fc80 con 0x7f88d0101420 2024-09-19T09:00:08.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.234+0000 7f88d832d740 1 Processor -- start 2024-09-19T09:00:08.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.234+0000 7f88d832d740 1 -- start start 2024-09-19T09:00:08.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.234+0000 7f88d832d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d56c004490 0x55d56c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:08.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.234+0000 7f88d832d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d56c004db0 0x55d56c00f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:08.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.234+0000 7f88d832d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d56c00f670 0x55d56c011a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:08.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.234+0000 7f88d832d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d56bf6a2e0 con 0x55d56c00f670 2024-09-19T09:00:08.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.234+0000 7f88d832d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d56bf11ce0 con 0x55d56c004490 2024-09-19T09:00:08.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.234+0000 7f88d832d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55d56bf662a0 con 0x55d56c004db0 2024-09-19T09:00:08.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.235+0000 7f88cffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d56c004490 0x55d56c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:08.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.235+0000 7f88cffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d56c004490 0x55d56c004870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:48500/0 (socket says 172.21.15.92:48500) 2024-09-19T09:00:08.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.235+0000 7f88cffff640 1 -- 172.21.15.92:0/3278802856 learned_addr learned my addr 172.21.15.92:0/3278802856 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:08.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.235+0000 7f88cf7fe640 1 --2- 172.21.15.92:0/3278802856 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d56c004db0 0x55d56c00f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:08.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.235+0000 7f88cffff640 1 -- 172.21.15.92:0/3278802856 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d56c004db0 msgr2=0x55d56c00f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:08.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.235+0000 7f88cffff640 1 --2- 172.21.15.92:0/3278802856 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d56c004db0 0x55d56c00f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:08.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.235+0000 7f88cffff640 1 -- 172.21.15.92:0/3278802856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d56c00f670 msgr2=0x55d56c011a60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:00:08.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.235+0000 7f88cffff640 1 --2- 172.21.15.92:0/3278802856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d56c00f670 0x55d56c011a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:08.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.235+0000 7f88cffff640 1 -- 172.21.15.92:0/3278802856 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d56bef6440 con 0x55d56c004490 2024-09-19T09:00:08.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.235+0000 7f88ccff9640 1 -- 172.21.15.92:0/803952113 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f88c4030580 con 0x7f88d0101420 2024-09-19T09:00:08.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.236+0000 7f88cffff640 1 --2- 172.21.15.92:0/3278802856 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d56c004490 0x55d56c004870 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f88c800af40 tx=0x7f88c800e7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eeb797da73ca7ba9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:08.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.236+0000 7f88b5ffb640 1 -- 172.21.15.92:0/3278802856 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c8003b70 con 0x55d56c004490 2024-09-19T09:00:08.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.236+0000 7f88b5ffb640 1 -- 172.21.15.92:0/3278802856 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88c8003d10 con 0x55d56c004490 2024-09-19T09:00:08.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.236+0000 7f88b5ffb640 1 -- 172.21.15.92:0/3278802856 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c8010c30 con 0x55d56c004490 2024-09-19T09:00:08.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.236+0000 7f88ccff9640 1 --2- 172.21.15.92:0/803952113 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f88b80a3390 0x7f88b80a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:08.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.237+0000 7f88ccff9640 1 -- 172.21.15.92:0/803952113 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f88c40ef690 con 0x7f88d0101420 2024-09-19T09:00:08.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.237+0000 7f88cf7fe640 1 --2- 172.21.15.92:0/803952113 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f88b80a3390 0x7f88b80a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:08.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.237+0000 7f88d832d740 1 -- 172.21.15.92:0/3278802856 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d56c004490 msgr2=0x55d56c004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:08.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.237+0000 7f88d832d740 1 --2- 172.21.15.92:0/3278802856 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d56c004490 0x55d56c004870 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f88c800af40 tx=0x7f88c800e7e0 comp rx=0 tx=0).stop 2024-09-19T09:00:08.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.237+0000 7f88d832d740 1 -- 172.21.15.92:0/3278802856 shutdown_connections 2024-09-19T09:00:08.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.237+0000 7f88d832d740 1 --2- 172.21.15.92:0/3278802856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d56c00f670 0x55d56c011a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:08.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.237+0000 7f88d832d740 1 --2- 172.21.15.92:0/3278802856 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d56c004db0 0x55d56c00f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:08.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.237+0000 7f88d832d740 1 --2- 172.21.15.92:0/3278802856 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d56c004490 0x55d56c004870 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:08.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.237+0000 7f88d832d740 1 -- 172.21.15.92:0/3278802856 >> 172.21.15.92:0/3278802856 conn(0x55d56c000a20 msgr2=0x55d56c000e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:08.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.238+0000 7f88d832d740 1 -- 172.21.15.92:0/3278802856 shutdown_connections 2024-09-19T09:00:08.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.238+0000 7f88cf7fe640 1 --2- 172.21.15.92:0/803952113 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f88b80a3390 0x7f88b80a5850 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f88c00096c0 tx=0x7f88c0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:08.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.238+0000 7f88d832d740 1 -- 172.21.15.92:0/3278802856 wait complete. 2024-09-19T09:00:08.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.238+0000 7f88d832d740 1 -- start start 2024-09-19T09:00:08.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.239+0000 7f88d832d740 1 Processor -- start 2024-09-19T09:00:08.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.240+0000 7f88d832d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d56c004490 0x55d56c00f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:08.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.240+0000 7f88d832d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d56c004db0 0x55d56c00c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:08.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.240+0000 7f88d832d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d56c00f670 0x55d56c00c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:08.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.241+0000 7f88d832d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d56c023250 con 0x55d56c00f670 2024-09-19T09:00:08.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.241+0000 7f88d832d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d56bf25050 con 0x55d56c004490 2024-09-19T09:00:08.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.241+0000 7f88d832d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55d56c0233d0 con 0x55d56c004db0 2024-09-19T09:00:08.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.241+0000 7f88cffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d56c00f670 0x55d56c00c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:08.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.241+0000 7f88cf7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d56c004490 0x55d56c00f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:08.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.241+0000 7f88cf7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d56c004490 0x55d56c00f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:48502/0 (socket says 172.21.15.92:48502) 2024-09-19T09:00:08.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.241+0000 7f88cffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d56c00f670 0x55d56c00c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38606/0 (socket says 172.21.15.92:38606) 2024-09-19T09:00:08.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.241+0000 7f88cf7fe640 1 -- 172.21.15.92:0/2895049756 learned_addr learned my addr 172.21.15.92:0/2895049756 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:08.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.241+0000 7f88d832d740 10 client.0 _ll_register_callbacks cb 0x55d56bf65160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:08.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.241+0000 7f88ceffd640 1 --2- 172.21.15.92:0/2895049756 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d56c004db0 0x55d56c00c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:08.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.241+0000 7f88cf7fe640 1 -- 172.21.15.92:0/2895049756 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d56c004db0 msgr2=0x55d56c00c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:08.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.241+0000 7f88cf7fe640 1 --2- 172.21.15.92:0/2895049756 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d56c004db0 0x55d56c00c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:08.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.241+0000 7f88cf7fe640 1 -- 172.21.15.92:0/2895049756 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d56c00f670 msgr2=0x55d56c00c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:08.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.241+0000 7f88cf7fe640 1 --2- 172.21.15.92:0/2895049756 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d56c00f670 0x55d56c00c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:08.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.241+0000 7f88cf7fe640 1 -- 172.21.15.92:0/2895049756 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d56bcdb3c0 con 0x55d56c004490 2024-09-19T09:00:08.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.241+0000 7f88ceffd640 1 --2- 172.21.15.92:0/2895049756 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d56c004db0 0x55d56c00c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:00:08.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.241+0000 7f88cf7fe640 1 --2- 172.21.15.92:0/2895049756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d56c004490 0x55d56c00f020 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f88c001d9f0 tx=0x7f88c0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77812480a1041178 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:08.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.241+0000 7f88aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:00:08.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.242+0000 7f88aeffd640 1 -- 172.21.15.92:0/2895049756 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c002d060 con 0x55d56c004490 2024-09-19T09:00:08.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.242+0000 7f88aeffd640 1 -- 172.21.15.92:0/2895049756 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f88c0017030 con 0x55d56c004490 2024-09-19T09:00:08.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.242+0000 7f88d832d740 1 -- 172.21.15.92:0/2895049756 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88c8003d10 con 0x55d56c004490 2024-09-19T09:00:08.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.242+0000 7f88aeffd640 1 -- 172.21.15.92:0/2895049756 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f88c0009e20 con 0x55d56c004490 2024-09-19T09:00:08.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.242+0000 7f88d832d740 10 client.25637 fetch_fsmap learned FSMap version 19 2024-09-19T09:00:08.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.242+0000 7f88d832d740 1 -- 172.21.15.92:0/2895049756 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55d56c02ecc0 con 0x55d56c004490 2024-09-19T09:00:08.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.242+0000 7f88aeffd640 1 -- 172.21.15.92:0/2895049756 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88c8003d10 con 0x55d56c004490 2024-09-19T09:00:08.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.243+0000 7f88aeffd640 1 -- 172.21.15.92:0/2895049756 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f88c000f570 con 0x55d56c004490 2024-09-19T09:00:08.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.243+0000 7f88d832d740 10 client.25637 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:00:08.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.243+0000 7f88d832d740 10 client.25637 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:00:08.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.243+0000 7f88d832d740 20 client.25637 populate_metadata read hostname 'smithi092' 2024-09-19T09:00:08.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.243+0000 7f88d832d740 1 --2- 172.21.15.92:0/2895049756 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d56c0304b0 0x55d56c032910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:08.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.243+0000 7f88d832d740 4 client.25637 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:00:08.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.243+0000 7f88d832d740 1 -- 172.21.15.92:0/2895049756 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d56bf77850 con 0x55d56c0304b0 2024-09-19T09:00:08.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.243+0000 7f88ceffd640 1 --2- 172.21.15.92:0/2895049756 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d56c0304b0 0x55d56c032910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:08.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.244+0000 7f88ceffd640 1 --2- 172.21.15.92:0/2895049756 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d56c0304b0 0x55d56c032910 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3468a3a8b233d34 server_cookie=e33e186c76765018 in_seq=0 out_seq=0 2024-09-19T09:00:08.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.244+0000 7f88aeffd640 10 client.25637 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:08.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.244+0000 7f88aeffd640 1 -- 172.21.15.92:0/2895049756 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d56bf77850 con 0x55d56c0304b0 2024-09-19T09:00:08.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.244+0000 7f88aeffd640 10 client.25637 handle_command_reply: tid=0 2024-09-19T09:00:08.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.245+0000 7f88d832d740 1 client.25637 shutdown 2024-09-19T09:00:08.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.245+0000 7f88d832d740 1 -- 172.21.15.92:0/2895049756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d56c004490 msgr2=0x55d56c00f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:08.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.245+0000 7f88d832d740 1 --2- 172.21.15.92:0/2895049756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d56c004490 0x55d56c00f020 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f88c001d9f0 tx=0x7f88c0004730 comp rx=0 tx=0).stop 2024-09-19T09:00:08.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.246+0000 7f88d832d740 1 -- 172.21.15.92:0/2895049756 shutdown_connections 2024-09-19T09:00:08.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.246+0000 7f88d832d740 1 --2- 172.21.15.92:0/2895049756 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d56c0304b0 0x55d56c032910 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:08.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.246+0000 7f88aeffd640 0 client.25637 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:08.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.246+0000 7f88d832d740 1 --2- 172.21.15.92:0/2895049756 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d56c00f670 0x55d56c00c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:08.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.246+0000 7f88d832d740 1 --2- 172.21.15.92:0/2895049756 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d56c004db0 0x55d56c00c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:08.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.246+0000 7f88d832d740 1 --2- 172.21.15.92:0/2895049756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d56c004490 0x55d56c00f020 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:08.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.246+0000 7f88d832d740 1 -- 172.21.15.92:0/2895049756 >> 172.21.15.92:0/2895049756 conn(0x55d56c000a20 msgr2=0x55d56bfffba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:08.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.246+0000 7f88d832d740 1 -- 172.21.15.92:0/2895049756 shutdown_connections 2024-09-19T09:00:08.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.246+0000 7f88d832d740 1 -- 172.21.15.92:0/2895049756 wait complete. 2024-09-19T09:00:08.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.246+0000 7f88d832d740 20 client.25637 trim_cache size 0 max 16384 2024-09-19T09:00:08.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.278+0000 7f88d832d740 1 Processor -- start 2024-09-19T09:00:08.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.278+0000 7f88d832d740 1 -- start start 2024-09-19T09:00:08.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.279+0000 7f88d832d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d56c004490 0x55d56c02c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:08.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.279+0000 7f88d832d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d56c004db0 0x55d56c0381e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:08.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.279+0000 7f88d832d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d56c00f670 0x55d56c038720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:08.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.279+0000 7f88d832d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f88d01a9470 con 0x55d56c00f670 2024-09-19T09:00:08.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.279+0000 7f88d832d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f88d01abd30 con 0x55d56c004db0 2024-09-19T09:00:08.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.279+0000 7f88d832d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f88d01a9b20 con 0x55d56c004490 2024-09-19T09:00:08.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.279+0000 7f88cffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d56c00f670 0x55d56c038720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:08.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.279+0000 7f88cffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d56c00f670 0x55d56c038720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38608/0 (socket says 172.21.15.92:38608) 2024-09-19T09:00:08.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.279+0000 7f88cffff640 1 -- 172.21.15.92:0/160111705 learned_addr learned my addr 172.21.15.92:0/160111705 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:08.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.279+0000 7f88cf7fe640 1 --2- 172.21.15.92:0/160111705 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d56c004490 0x55d56c02c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:08.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.279+0000 7f88ceffd640 1 --2- 172.21.15.92:0/160111705 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d56c004db0 0x55d56c0381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:08.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.279+0000 7f88cf7fe640 1 -- 172.21.15.92:0/160111705 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d56c004db0 msgr2=0x55d56c0381e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:08.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.279+0000 7f88cf7fe640 1 --2- 172.21.15.92:0/160111705 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d56c004db0 0x55d56c0381e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:08.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.279+0000 7f88cf7fe640 1 -- 172.21.15.92:0/160111705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d56c00f670 msgr2=0x55d56c038720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:08.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.279+0000 7f88cf7fe640 1 --2- 172.21.15.92:0/160111705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d56c00f670 0x55d56c038720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:08.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.279+0000 7f88cf7fe640 1 -- 172.21.15.92:0/160111705 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d56c001b90 con 0x55d56c004490 2024-09-19T09:00:08.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.280+0000 7f88cf7fe640 1 --2- 172.21.15.92:0/160111705 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d56c004490 0x55d56c02c4b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f88c000de40 tx=0x7f88c0005990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f38baa40de882bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:08.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.280+0000 7f88b57fa640 1 -- 172.21.15.92:0/160111705 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c0037080 con 0x55d56c004490 2024-09-19T09:00:08.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.280+0000 7f88b57fa640 1 -- 172.21.15.92:0/160111705 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88c001b3a0 con 0x55d56c004490 2024-09-19T09:00:08.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.280+0000 7f88b57fa640 1 -- 172.21.15.92:0/160111705 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c0037080 con 0x55d56c004490 2024-09-19T09:00:08.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.281+0000 7f88d832d740 1 -- 172.21.15.92:0/160111705 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d56c004490 msgr2=0x55d56c02c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:08.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.281+0000 7f88d832d740 1 --2- 172.21.15.92:0/160111705 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d56c004490 0x55d56c02c4b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f88c000de40 tx=0x7f88c0005990 comp rx=0 tx=0).stop 2024-09-19T09:00:08.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.281+0000 7f88d832d740 1 -- 172.21.15.92:0/160111705 shutdown_connections 2024-09-19T09:00:08.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.281+0000 7f88d832d740 1 --2- 172.21.15.92:0/160111705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d56c00f670 0x55d56c038720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:08.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.281+0000 7f88d832d740 1 --2- 172.21.15.92:0/160111705 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d56c004db0 0x55d56c0381e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:08.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.281+0000 7f88d832d740 1 --2- 172.21.15.92:0/160111705 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d56c004490 0x55d56c02c4b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:08.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.281+0000 7f88d832d740 1 -- 172.21.15.92:0/160111705 >> 172.21.15.92:0/160111705 conn(0x55d56c000a20 msgr2=0x55d56c007860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:08.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.281+0000 7f88d832d740 1 -- 172.21.15.92:0/160111705 shutdown_connections 2024-09-19T09:00:08.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.281+0000 7f88d832d740 1 -- 172.21.15.92:0/160111705 wait complete. 2024-09-19T09:00:08.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.282+0000 7f88d832d740 1 -- start start 2024-09-19T09:00:08.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.282+0000 7f88d832d740 1 Processor -- start 2024-09-19T09:00:08.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.283+0000 7f88d832d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d56c004490 0x55d56c028620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:08.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.283+0000 7f88d832d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d56c004db0 0x55d56c028b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:08.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.283+0000 7f88cf7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d56c004490 0x55d56c028620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:08.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.283+0000 7f88cf7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d56c004490 0x55d56c028620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:45932/0 (socket says 172.21.15.92:45932) 2024-09-19T09:00:08.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.283+0000 7f88cf7fe640 1 -- 172.21.15.92:0/907375901 learned_addr learned my addr 172.21.15.92:0/907375901 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:08.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.284+0000 7f88d832d740 1 --2- 172.21.15.92:0/907375901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d56c00f670 0x55d56c0255f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:08.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.284+0000 7f88d832d740 1 -- 172.21.15.92:0/907375901 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f88d01aa1f0 con 0x55d56c004db0 2024-09-19T09:00:08.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.284+0000 7f88d832d740 1 -- 172.21.15.92:0/907375901 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f88d01ab660 con 0x55d56c00f670 2024-09-19T09:00:08.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.284+0000 7f88d832d740 1 -- 172.21.15.92:0/907375901 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f88d01aa8c0 con 0x55d56c004490 2024-09-19T09:00:08.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.284+0000 7f88cffff640 1 --2- 172.21.15.92:0/907375901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d56c00f670 0x55d56c0255f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:08.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.284+0000 7f88d832d740 10 client.0 _ll_register_callbacks cb 0x7f88c0009a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:08.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.284+0000 7f88cffff640 1 -- 172.21.15.92:0/907375901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d56c004490 msgr2=0x55d56c028620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:08.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.284+0000 7f88cffff640 1 --2- 172.21.15.92:0/907375901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d56c004490 0x55d56c028620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:08.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.285+0000 7f88cffff640 1 -- 172.21.15.92:0/907375901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d56c004db0 msgr2=0x55d56c028b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:08.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.285+0000 7f88cffff640 1 --2- 172.21.15.92:0/907375901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d56c004db0 0x55d56c028b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:08.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.285+0000 7f88cffff640 1 -- 172.21.15.92:0/907375901 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d56bffc000 con 0x55d56c00f670 2024-09-19T09:00:08.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.285+0000 7f88cffff640 1 --2- 172.21.15.92:0/907375901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d56c00f670 0x55d56c0255f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f88c800ece0 tx=0x7f88c8010770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=170c4a0f7373b046 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:08.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.285+0000 7f88aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:00:08.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.286+0000 7f88aeffd640 1 -- 172.21.15.92:0/907375901 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c802b020 con 0x55d56c00f670 2024-09-19T09:00:08.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.286+0000 7f88aeffd640 1 -- 172.21.15.92:0/907375901 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f88c8027880 con 0x55d56c00f670 2024-09-19T09:00:08.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.287+0000 7f88d832d740 1 -- 172.21.15.92:0/907375901 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88c001b3a0 con 0x55d56c00f670 2024-09-19T09:00:08.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.287+0000 7f88aeffd640 1 -- 172.21.15.92:0/907375901 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f88c800ab30 con 0x55d56c00f670 2024-09-19T09:00:08.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.287+0000 7f88d832d740 10 client.25643 fetch_fsmap learned FSMap version 19 2024-09-19T09:00:08.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.287+0000 7f88d832d740 1 -- 172.21.15.92:0/907375901 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55d56c09b590 con 0x55d56c00f670 2024-09-19T09:00:08.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.287+0000 7f88aeffd640 1 -- 172.21.15.92:0/907375901 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88c801a460 con 0x55d56c00f670 2024-09-19T09:00:08.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.287+0000 7f88aeffd640 1 -- 172.21.15.92:0/907375901 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f88c80263d0 con 0x55d56c00f670 2024-09-19T09:00:08.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.287+0000 7f88d832d740 10 client.25643 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:00:08.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.287+0000 7f88d832d740 10 client.25643 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:00:08.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.287+0000 7f88d832d740 20 client.25643 populate_metadata read hostname 'smithi092' 2024-09-19T09:00:08.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.287+0000 7f88d832d740 1 --2- 172.21.15.92:0/907375901 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d56c0304b0 0x55d56c09d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:08.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.288+0000 7f88d832d740 4 client.25643 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:00:08.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.288+0000 7f88d832d740 1 -- 172.21.15.92:0/907375901 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f88c001b3a0 con 0x55d56c0304b0 2024-09-19T09:00:08.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.289+0000 7f88cf7fe640 1 --2- 172.21.15.92:0/907375901 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d56c0304b0 0x55d56c09d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:08.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.289+0000 7f88aeffd640 10 client.25643 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:08.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.289+0000 7f88cf7fe640 1 --2- 172.21.15.92:0/907375901 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d56c0304b0 0x55d56c09d9a0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78076b197df4c53c server_cookie=fd41f894f749effc in_seq=0 out_seq=0 2024-09-19T09:00:08.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.289+0000 7f88aeffd640 1 -- 172.21.15.92:0/907375901 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7f88c001b3a0 con 0x55d56c0304b0 2024-09-19T09:00:08.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.289+0000 7f88aeffd640 10 client.25643 handle_command_reply: tid=0 2024-09-19T09:00:08.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.289+0000 7f88d832d740 1 client.25643 shutdown 2024-09-19T09:00:08.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.290+0000 7f88d832d740 1 -- 172.21.15.92:0/907375901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d56c00f670 msgr2=0x55d56c0255f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:08.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.290+0000 7f88d832d740 1 --2- 172.21.15.92:0/907375901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d56c00f670 0x55d56c0255f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f88c800ece0 tx=0x7f88c8010770 comp rx=0 tx=0).stop 2024-09-19T09:00:08.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.290+0000 7f88d832d740 1 -- 172.21.15.92:0/907375901 shutdown_connections 2024-09-19T09:00:08.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.290+0000 7f88d832d740 1 --2- 172.21.15.92:0/907375901 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d56c0304b0 0x55d56c09d9a0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:08.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.290+0000 7f88d832d740 1 --2- 172.21.15.92:0/907375901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d56c00f670 0x55d56c0255f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:08.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.291+0000 7f88d832d740 1 --2- 172.21.15.92:0/907375901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d56c004db0 0x55d56c028b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:08.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.291+0000 7f88aeffd640 0 client.25643 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:08.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.291+0000 7f88d832d740 1 --2- 172.21.15.92:0/907375901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d56c004490 0x55d56c028620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:08.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.291+0000 7f88d832d740 1 -- 172.21.15.92:0/907375901 >> 172.21.15.92:0/907375901 conn(0x55d56c000a20 msgr2=0x55d56bfff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:08.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.291+0000 7f88d832d740 1 -- 172.21.15.92:0/907375901 shutdown_connections 2024-09-19T09:00:08.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.291+0000 7f88d832d740 1 -- 172.21.15.92:0/907375901 wait complete. 2024-09-19T09:00:08.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.292+0000 7f88d832d740 20 client.25643 trim_cache size 0 max 16384 2024-09-19T09:00:08.292 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:00:08.292 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:00:08.292 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": { 2024-09-19T09:00:08.293 INFO:teuthology.orchestra.run.smithi092.stdout: "3351b46b-50e8-4869-8163-9303afda14f7": { 2024-09-19T09:00:08.293 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-19T09:00:08.293 INFO:teuthology.orchestra.run.smithi092.stdout: "tag": "3351b46b-50e8-4869-8163-9303afda14f7", 2024-09-19T09:00:08.293 INFO:teuthology.orchestra.run.smithi092.stdout: "options": "recursive,force" 2024-09-19T09:00:08.293 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:00:08.293 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:00:08.293 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:00:08.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.292+0000 7f88d5f54640 1 -- 172.21.15.92:0/803952113 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f88b80a3390 msgr2=0x7f88b80a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:08.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.292+0000 7f88d5f54640 1 --2- 172.21.15.92:0/803952113 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f88b80a3390 0x7f88b80a5850 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f88c00096c0 tx=0x7f88c0009260 comp rx=0 tx=0).stop 2024-09-19T09:00:08.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.292+0000 7f88d5f54640 1 -- 172.21.15.92:0/803952113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88d0101420 msgr2=0x7f88d019ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:08.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.292+0000 7f88d5f54640 1 --2- 172.21.15.92:0/803952113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88d0101420 0x7f88d019ac00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f88c4035040 tx=0x7f88c4033d90 comp rx=0 tx=0).stop 2024-09-19T09:00:08.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.293+0000 7f88d5f54640 1 -- 172.21.15.92:0/803952113 shutdown_connections 2024-09-19T09:00:08.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.293+0000 7f88d5f54640 1 --2- 172.21.15.92:0/803952113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88d0106a80 0x7f88d019ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:08.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.293+0000 7f88d5f54640 1 --2- 172.21.15.92:0/803952113 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f88b80a3390 0x7f88b80a5850 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:08.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.293+0000 7f88d5f54640 1 --2- 172.21.15.92:0/803952113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88d0101420 0x7f88d019ac00 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:08.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.293+0000 7f88d5f54640 1 --2- 172.21.15.92:0/803952113 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88d0100a80 0x7f88d019a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:08.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.293+0000 7f88d5f54640 1 -- 172.21.15.92:0/803952113 >> 172.21.15.92:0/803952113 conn(0x7f88d00fc7a0 msgr2=0x7f88d0104590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:08.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.294+0000 7f88d5f54640 1 -- 172.21.15.92:0/803952113 shutdown_connections 2024-09-19T09:00:08.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:08.294+0000 7f88d5f54640 1 -- 172.21.15.92:0/803952113 wait complete. 2024-09-19T09:00:08.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:08 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:00:08.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:08 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:00:08.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:08 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:00:09.079 INFO:tasks.cephfs.filesystem:scrub status for tag:3351b46b-50e8-4869-8163-9303afda14f7 - {'path': '/', 'tag': '3351b46b-50e8-4869-8163-9303afda14f7', 'options': 'recursive,force'} 2024-09-19T09:00:09.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:09 smithi092 ceph-mon[31407]: pgmap v440: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 15 MiB/s wr, 1.06k op/s 2024-09-19T09:00:09.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:09 smithi092 ceph-mon[31407]: scrub summary: idle 2024-09-19T09:00:09.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:09 smithi167 ceph-mon[35359]: pgmap v440: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 15 MiB/s wr, 1.06k op/s 2024-09-19T09:00:09.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:09 smithi167 ceph-mon[35359]: scrub summary: idle 2024-09-19T09:00:09.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:09 smithi190 ceph-mon[35358]: pgmap v440: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 15 MiB/s wr, 1.06k op/s 2024-09-19T09:00:09.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:09 smithi190 ceph-mon[35358]: scrub summary: idle 2024-09-19T09:00:10.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 205.0 s, 5303.4 tps, lat 18.884 ms stddev 19.799 2024-09-19T09:00:11.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:11 smithi167 ceph-mon[35359]: pgmap v441: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 13 MiB/s wr, 1.07k op/s 2024-09-19T09:00:11.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:11 smithi190 ceph-mon[35358]: pgmap v441: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 13 MiB/s wr, 1.07k op/s 2024-09-19T09:00:12.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:11 smithi092 ceph-mon[31407]: pgmap v441: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 13 MiB/s wr, 1.07k op/s 2024-09-19T09:00:13.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:13 smithi167 ceph-mon[35359]: pgmap v442: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 12 MiB/s wr, 947 op/s 2024-09-19T09:00:13.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:13 smithi190 ceph-mon[35358]: pgmap v442: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 12 MiB/s wr, 947 op/s 2024-09-19T09:00:14.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:13 smithi092 ceph-mon[31407]: pgmap v442: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 12 MiB/s wr, 947 op/s 2024-09-19T09:00:14.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:14 smithi167 ceph-mon[35359]: pgmap v443: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 13 MiB/s wr, 988 op/s 2024-09-19T09:00:14.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:14 smithi190 ceph-mon[35358]: pgmap v443: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 13 MiB/s wr, 988 op/s 2024-09-19T09:00:15.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:14 smithi092 ceph-mon[31407]: pgmap v443: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 13 MiB/s wr, 988 op/s 2024-09-19T09:00:15.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 210.0 s, 5639.0 tps, lat 17.717 ms stddev 21.591 2024-09-19T09:00:16.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.048+0000 7fe285fc4640 1 -- 172.21.15.92:0/3853177106 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe280101c30 msgr2=0x7fe2801020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:16.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.048+0000 7fe285fc4640 1 --2- 172.21.15.92:0/3853177106 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe280101c30 0x7fe2801020b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe268009900 tx=0x7fe26802a400 comp rx=0 tx=0).stop 2024-09-19T09:00:16.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.048+0000 7fe285fc4640 1 -- 172.21.15.92:0/3853177106 shutdown_connections 2024-09-19T09:00:16.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.048+0000 7fe285fc4640 1 --2- 172.21.15.92:0/3853177106 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2801025f0 0x7fe280108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.048+0000 7fe285fc4640 1 --2- 172.21.15.92:0/3853177106 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe280101c30 0x7fe2801020b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.048+0000 7fe285fc4640 1 --2- 172.21.15.92:0/3853177106 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe280100a40 0x7fe280100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.048+0000 7fe285fc4640 1 -- 172.21.15.92:0/3853177106 >> 172.21.15.92:0/3853177106 conn(0x7fe2800fc1e0 msgr2=0x7fe2800fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:16.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.048+0000 7fe285fc4640 1 -- 172.21.15.92:0/3853177106 shutdown_connections 2024-09-19T09:00:16.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.048+0000 7fe285fc4640 1 -- 172.21.15.92:0/3853177106 wait complete. 2024-09-19T09:00:16.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.049+0000 7fe285fc4640 1 Processor -- start 2024-09-19T09:00:16.051 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.049+0000 7fe285fc4640 1 -- start start 2024-09-19T09:00:16.051 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.049+0000 7fe285fc4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe280100a40 0x7fe28010b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:16.051 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.050+0000 7fe285fc4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe280101c30 0x7fe280109880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:16.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.050+0000 7fe285fc4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2801025f0 0x7fe280109dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:16.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.050+0000 7fe285fc4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe28010d870 con 0x7fe280101c30 2024-09-19T09:00:16.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.050+0000 7fe285fc4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe28010d6f0 con 0x7fe280100a40 2024-09-19T09:00:16.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.050+0000 7fe285fc4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe28010d9f0 con 0x7fe2801025f0 2024-09-19T09:00:16.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.050+0000 7fe27f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe280100a40 0x7fe28010b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:16.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.050+0000 7fe27ffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2801025f0 0x7fe280109dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:16.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.050+0000 7fe27ffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2801025f0 0x7fe280109dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:35298/0 (socket says 172.21.15.92:35298) 2024-09-19T09:00:16.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.050+0000 7fe27f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe280100a40 0x7fe28010b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:47704/0 (socket says 172.21.15.92:47704) 2024-09-19T09:00:16.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.050+0000 7fe27ffff640 1 -- 172.21.15.92:0/2881916948 learned_addr learned my addr 172.21.15.92:0/2881916948 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:16.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.050+0000 7fe27effd640 1 --2- 172.21.15.92:0/2881916948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe280101c30 0x7fe280109880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:16.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.050+0000 7fe27f7fe640 1 -- 172.21.15.92:0/2881916948 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2801025f0 msgr2=0x7fe280109dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:16.053 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.050+0000 7fe27f7fe640 1 --2- 172.21.15.92:0/2881916948 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2801025f0 0x7fe280109dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.053 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.050+0000 7fe27f7fe640 1 -- 172.21.15.92:0/2881916948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe280101c30 msgr2=0x7fe280109880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:16.053 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.050+0000 7fe27f7fe640 1 --2- 172.21.15.92:0/2881916948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe280101c30 0x7fe280109880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.053 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.050+0000 7fe27f7fe640 1 -- 172.21.15.92:0/2881916948 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe28019bd70 con 0x7fe280100a40 2024-09-19T09:00:16.053 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.051+0000 7fe27f7fe640 1 --2- 172.21.15.92:0/2881916948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe280100a40 0x7fe28010b240 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe27000e9c0 tx=0x7fe27000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:16.053 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.051+0000 7fe27cff9640 1 -- 172.21.15.92:0/2881916948 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27000ccc0 con 0x7fe280100a40 2024-09-19T09:00:16.053 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.051+0000 7fe285fc4640 1 -- 172.21.15.92:0/2881916948 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe28019c060 con 0x7fe280100a40 2024-09-19T09:00:16.053 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.051+0000 7fe27cff9640 1 -- 172.21.15.92:0/2881916948 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2700035f0 con 0x7fe280100a40 2024-09-19T09:00:16.053 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.051+0000 7fe285fc4640 1 -- 172.21.15.92:0/2881916948 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe28019c600 con 0x7fe280100a40 2024-09-19T09:00:16.053 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.051+0000 7fe27cff9640 1 -- 172.21.15.92:0/2881916948 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27000ce60 con 0x7fe280100a40 2024-09-19T09:00:16.055 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.055+0000 7fe27cff9640 1 -- 172.21.15.92:0/2881916948 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe2700037a0 con 0x7fe280100a40 2024-09-19T09:00:16.056 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.056+0000 7fe27cff9640 1 --2- 172.21.15.92:0/2881916948 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe26c0a3370 0x7fe26c0a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:16.056 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.057+0000 7fe27cff9640 1 -- 172.21.15.92:0/2881916948 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe2700cfdb0 con 0x7fe280100a40 2024-09-19T09:00:16.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.057+0000 7fe27effd640 1 --2- 172.21.15.92:0/2881916948 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe26c0a3370 0x7fe26c0a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:16.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.057+0000 7fe288e40740 1 Processor -- start 2024-09-19T09:00:16.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.057+0000 7fe288e40740 1 -- start start 2024-09-19T09:00:16.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.058+0000 7fe288e40740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b9a22179a0 0x55b9a2217da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:16.058 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.058+0000 7fe288e40740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b9a22182e0 0x55b9a221cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:16.058 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.058+0000 7fe288e40740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9a221d370 0x55b9a221f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:16.058 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.058+0000 7fe288e40740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b9a217b2f0 con 0x55b9a221d370 2024-09-19T09:00:16.058 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.058+0000 7fe288e40740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b9a2123270 con 0x55b9a22182e0 2024-09-19T09:00:16.058 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.058+0000 7fe288e40740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55b9a21772b0 con 0x55b9a22179a0 2024-09-19T09:00:16.058 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.058+0000 7fe27effd640 1 --2- 172.21.15.92:0/2881916948 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe26c0a3370 0x7fe26c0a5830 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe268006010 tx=0x7fe268000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:16.059 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.058+0000 7fe27f7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b9a22179a0 0x55b9a2217da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:16.059 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.058+0000 7fe27f7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b9a22179a0 0x55b9a2217da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:35302/0 (socket says 172.21.15.92:35302) 2024-09-19T09:00:16.059 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.058+0000 7fe27f7fe640 1 -- 172.21.15.92:0/3819834346 learned_addr learned my addr 172.21.15.92:0/3819834346 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:16.059 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.058+0000 7fe27effd640 1 --2- 172.21.15.92:0/3819834346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b9a22182e0 0x55b9a221cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:16.059 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.058+0000 7fe27ffff640 1 --2- 172.21.15.92:0/3819834346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9a221d370 0x55b9a221f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:16.059 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.058+0000 7fe27f7fe640 1 -- 172.21.15.92:0/3819834346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b9a22182e0 msgr2=0x55b9a221cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:16.060 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.058+0000 7fe27f7fe640 1 --2- 172.21.15.92:0/3819834346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b9a22182e0 0x55b9a221cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.060 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.059+0000 7fe27f7fe640 1 -- 172.21.15.92:0/3819834346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9a221d370 msgr2=0x55b9a221f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:16.060 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.059+0000 7fe27f7fe640 1 --2- 172.21.15.92:0/3819834346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9a221d370 0x55b9a221f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.060 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.059+0000 7fe27f7fe640 1 -- 172.21.15.92:0/3819834346 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9a2122340 con 0x55b9a22179a0 2024-09-19T09:00:16.060 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.059+0000 7fe27ffff640 1 --2- 172.21.15.92:0/3819834346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9a221d370 0x55b9a221f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:00:16.060 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.059+0000 7fe27f7fe640 1 --2- 172.21.15.92:0/3819834346 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b9a22179a0 0x55b9a2217da0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe2700cd810 tx=0x7fe27009ca90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd3ac501c5cfc7df server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:16.060 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.059+0000 7fe275ffb640 1 -- 172.21.15.92:0/3819834346 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2700a0740 con 0x55b9a22179a0 2024-09-19T09:00:16.060 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.060+0000 7fe275ffb640 1 -- 172.21.15.92:0/3819834346 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2700a5000 con 0x55b9a22179a0 2024-09-19T09:00:16.060 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.060+0000 7fe275ffb640 1 -- 172.21.15.92:0/3819834346 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27009bb10 con 0x55b9a22179a0 2024-09-19T09:00:16.061 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.061+0000 7fe288e40740 1 -- 172.21.15.92:0/3819834346 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b9a22179a0 msgr2=0x55b9a2217da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:16.061 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.061+0000 7fe288e40740 1 --2- 172.21.15.92:0/3819834346 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b9a22179a0 0x55b9a2217da0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe2700cd810 tx=0x7fe27009ca90 comp rx=0 tx=0).stop 2024-09-19T09:00:16.061 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.061+0000 7fe288e40740 1 -- 172.21.15.92:0/3819834346 shutdown_connections 2024-09-19T09:00:16.061 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.061+0000 7fe288e40740 1 --2- 172.21.15.92:0/3819834346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9a221d370 0x55b9a221f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.061 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.061+0000 7fe288e40740 1 --2- 172.21.15.92:0/3819834346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b9a22182e0 0x55b9a221cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.061 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.061+0000 7fe288e40740 1 --2- 172.21.15.92:0/3819834346 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b9a22179a0 0x55b9a2217da0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.061 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.061+0000 7fe288e40740 1 -- 172.21.15.92:0/3819834346 >> 172.21.15.92:0/3819834346 conn(0x55b9a2213010 msgr2=0x55b9a2213410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:16.062 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.062+0000 7fe288e40740 1 -- 172.21.15.92:0/3819834346 shutdown_connections 2024-09-19T09:00:16.062 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.062+0000 7fe288e40740 1 -- 172.21.15.92:0/3819834346 wait complete. 2024-09-19T09:00:16.062 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.062+0000 7fe288e40740 1 -- start start 2024-09-19T09:00:16.063 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.063+0000 7fe288e40740 1 Processor -- start 2024-09-19T09:00:16.063 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.063+0000 7fe288e40740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b9a22179a0 0x55b9a2221be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:16.063 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.063+0000 7fe288e40740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b9a22182e0 0x55b9a2222120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:16.063 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.063+0000 7fe288e40740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9a221d370 0x55b9a2229160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:16.063 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.063+0000 7fe288e40740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b9a22202e0 con 0x55b9a221d370 2024-09-19T09:00:16.063 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.063+0000 7fe288e40740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b9a2104290 con 0x55b9a22182e0 2024-09-19T09:00:16.063 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.063+0000 7fe288e40740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55b9a2220460 con 0x55b9a22179a0 2024-09-19T09:00:16.063 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.063+0000 7fe288e40740 10 client.0 _ll_register_callbacks cb 0x55b9a2135140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:16.063 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.063+0000 7fe27effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b9a22182e0 0x55b9a2222120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:16.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.063+0000 7fe27ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9a221d370 0x55b9a2229160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:16.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.063+0000 7fe27f7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b9a22179a0 0x55b9a2221be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:16.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.063+0000 7fe27effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b9a22182e0 0x55b9a2222120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:47716/0 (socket says 172.21.15.92:47716) 2024-09-19T09:00:16.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.063+0000 7fe27ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9a221d370 0x55b9a2229160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37108/0 (socket says 172.21.15.92:37108) 2024-09-19T09:00:16.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.063+0000 7fe27effd640 1 -- 172.21.15.92:0/3069453122 learned_addr learned my addr 172.21.15.92:0/3069453122 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:16.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.064+0000 7fe27f7fe640 1 -- 172.21.15.92:0/3069453122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b9a22182e0 msgr2=0x55b9a2222120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:16.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.064+0000 7fe27f7fe640 1 --2- 172.21.15.92:0/3069453122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b9a22182e0 0x55b9a2222120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.066 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.064+0000 7fe27f7fe640 1 -- 172.21.15.92:0/3069453122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9a221d370 msgr2=0x55b9a2229160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:16.066 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.064+0000 7fe27f7fe640 1 --2- 172.21.15.92:0/3069453122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9a221d370 0x55b9a2229160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.066 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.064+0000 7fe27f7fe640 1 -- 172.21.15.92:0/3069453122 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9a1e8e210 con 0x55b9a22179a0 2024-09-19T09:00:16.066 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.064+0000 7fe27ffff640 1 --2- 172.21.15.92:0/3069453122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9a221d370 0x55b9a2229160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:16.066 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.065+0000 7fe27f7fe640 1 --2- 172.21.15.92:0/3069453122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b9a22179a0 0x55b9a2221be0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe2700cd810 tx=0x7fe2700a0740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=514405f7ccb8fba5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:16.067 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.065+0000 7fe25effd640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:00:16.067 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.065+0000 7fe25effd640 1 -- 172.21.15.92:0/3069453122 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27009b850 con 0x55b9a22179a0 2024-09-19T09:00:16.067 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.065+0000 7fe288e40740 1 -- 172.21.15.92:0/3069453122 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2700a5000 con 0x55b9a22179a0 2024-09-19T09:00:16.067 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.065+0000 7fe25effd640 1 -- 172.21.15.92:0/3069453122 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe27009b9f0 con 0x55b9a22179a0 2024-09-19T09:00:16.067 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.065+0000 7fe25effd640 1 -- 172.21.15.92:0/3069453122 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe2700980e0 con 0x55b9a22179a0 2024-09-19T09:00:16.067 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.065+0000 7fe288e40740 10 client.25588 fetch_fsmap learned FSMap version 19 2024-09-19T09:00:16.067 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.065+0000 7fe288e40740 1 -- 172.21.15.92:0/3069453122 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55b9a1f5a620 con 0x55b9a22179a0 2024-09-19T09:00:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.066+0000 7fe25effd640 1 -- 172.21.15.92:0/3069453122 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2700a5000 con 0x55b9a22179a0 2024-09-19T09:00:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.066+0000 7fe25effd640 1 -- 172.21.15.92:0/3069453122 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe2700bc0c0 con 0x55b9a22179a0 2024-09-19T09:00:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.066+0000 7fe288e40740 10 client.25588 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:00:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.066+0000 7fe288e40740 10 client.25588 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:00:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.066+0000 7fe288e40740 20 client.25588 populate_metadata read hostname 'smithi092' 2024-09-19T09:00:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.066+0000 7fe288e40740 1 --2- 172.21.15.92:0/3069453122 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b9a223e3e0 0x55b9a22407d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.066+0000 7fe288e40740 4 client.25588 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:00:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.066+0000 7fe288e40740 1 -- 172.21.15.92:0/3069453122 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9a2188a20 con 0x55b9a223e3e0 2024-09-19T09:00:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.068+0000 7fe27effd640 1 --2- 172.21.15.92:0/3069453122 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b9a223e3e0 0x55b9a22407d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.068+0000 7fe27effd640 1 --2- 172.21.15.92:0/3069453122 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b9a223e3e0 0x55b9a22407d0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88bf32d2de4901ce server_cookie=aab69a59c9c726ab in_seq=0 out_seq=0 2024-09-19T09:00:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.068+0000 7fe25effd640 10 client.25588 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.069+0000 7fe25effd640 1 -- 172.21.15.92:0/3069453122 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b9a2188a20 con 0x55b9a223e3e0 2024-09-19T09:00:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.069+0000 7fe25effd640 10 client.25588 handle_command_reply: tid=0 2024-09-19T09:00:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.069+0000 7fe288e40740 1 client.25588 shutdown 2024-09-19T09:00:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.070+0000 7fe288e40740 1 -- 172.21.15.92:0/3069453122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b9a22179a0 msgr2=0x55b9a2221be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.070+0000 7fe288e40740 1 --2- 172.21.15.92:0/3069453122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b9a22179a0 0x55b9a2221be0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe2700cd810 tx=0x7fe2700a0740 comp rx=0 tx=0).stop 2024-09-19T09:00:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.070+0000 7fe288e40740 1 -- 172.21.15.92:0/3069453122 shutdown_connections 2024-09-19T09:00:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.070+0000 7fe288e40740 1 --2- 172.21.15.92:0/3069453122 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b9a223e3e0 0x55b9a22407d0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.070+0000 7fe288e40740 1 --2- 172.21.15.92:0/3069453122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9a221d370 0x55b9a2229160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.070+0000 7fe25effd640 0 client.25588 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.070+0000 7fe288e40740 1 --2- 172.21.15.92:0/3069453122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b9a22182e0 0x55b9a2222120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.070+0000 7fe288e40740 1 --2- 172.21.15.92:0/3069453122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b9a22179a0 0x55b9a2221be0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.070+0000 7fe288e40740 1 -- 172.21.15.92:0/3069453122 >> 172.21.15.92:0/3069453122 conn(0x55b9a2213010 msgr2=0x55b9a2214820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:16.073 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.070+0000 7fe288e40740 1 -- 172.21.15.92:0/3069453122 shutdown_connections 2024-09-19T09:00:16.073 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.070+0000 7fe288e40740 1 -- 172.21.15.92:0/3069453122 wait complete. 2024-09-19T09:00:16.073 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.070+0000 7fe288e40740 20 client.25588 trim_cache size 0 max 16384 2024-09-19T09:00:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.095+0000 7fe288e40740 1 Processor -- start 2024-09-19T09:00:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.095+0000 7fe288e40740 1 -- start start 2024-09-19T09:00:16.096 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.096+0000 7fe288e40740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b9a2213010 0x55b9a22120b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:16.096 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.096+0000 7fe288e40740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b9a22179a0 0x55b9a2229080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:16.096 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.096+0000 7fe288e40740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9a22182e0 0x55b9a2244fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:16.096 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.096+0000 7fe288e40740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe2801a3040 con 0x55b9a22182e0 2024-09-19T09:00:16.096 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.096+0000 7fe288e40740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe28006cd40 con 0x55b9a22179a0 2024-09-19T09:00:16.096 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.096+0000 7fe288e40740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe2801a3690 con 0x55b9a2213010 2024-09-19T09:00:16.096 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.096+0000 7fe27ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9a22182e0 0x55b9a2244fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:16.096 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.096+0000 7fe27f7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b9a2213010 0x55b9a22120b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:16.096 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.096+0000 7fe27effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b9a22179a0 0x55b9a2229080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:16.096 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.096+0000 7fe27f7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b9a2213010 0x55b9a22120b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:35324/0 (socket says 172.21.15.92:35324) 2024-09-19T09:00:16.096 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.096+0000 7fe27f7fe640 1 -- 172.21.15.92:0/4079579183 learned_addr learned my addr 172.21.15.92:0/4079579183 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.096+0000 7fe27effd640 1 -- 172.21.15.92:0/4079579183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b9a2213010 msgr2=0x55b9a22120b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.096+0000 7fe27effd640 1 --2- 172.21.15.92:0/4079579183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b9a2213010 0x55b9a22120b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.096+0000 7fe27effd640 1 -- 172.21.15.92:0/4079579183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9a22182e0 msgr2=0x55b9a2244fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.096+0000 7fe27effd640 1 --2- 172.21.15.92:0/4079579183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9a22182e0 0x55b9a2244fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.096+0000 7fe27effd640 1 -- 172.21.15.92:0/4079579183 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9a22187c0 con 0x55b9a22179a0 2024-09-19T09:00:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.096+0000 7fe27ffff640 1 --2- 172.21.15.92:0/4079579183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9a22182e0 0x55b9a2244fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.097+0000 7fe27effd640 1 --2- 172.21.15.92:0/4079579183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b9a22179a0 0x55b9a2229080 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x55b9a2240f80 tx=0x7fe26803f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aba2865fc7c07359 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.098+0000 7fe2757fa640 1 -- 172.21.15.92:0/4079579183 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe268035050 con 0x55b9a22179a0 2024-09-19T09:00:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.098+0000 7fe2757fa640 1 -- 172.21.15.92:0/4079579183 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2680046c0 con 0x55b9a22179a0 2024-09-19T09:00:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.098+0000 7fe2757fa640 1 -- 172.21.15.92:0/4079579183 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe268003830 con 0x55b9a22179a0 2024-09-19T09:00:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.099+0000 7fe288e40740 1 -- 172.21.15.92:0/4079579183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b9a22179a0 msgr2=0x55b9a2229080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.099+0000 7fe288e40740 1 --2- 172.21.15.92:0/4079579183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b9a22179a0 0x55b9a2229080 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x55b9a2240f80 tx=0x7fe26803f000 comp rx=0 tx=0).stop 2024-09-19T09:00:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.099+0000 7fe288e40740 1 -- 172.21.15.92:0/4079579183 shutdown_connections 2024-09-19T09:00:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.099+0000 7fe288e40740 1 --2- 172.21.15.92:0/4079579183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9a22182e0 0x55b9a2244fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.099+0000 7fe288e40740 1 --2- 172.21.15.92:0/4079579183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b9a22179a0 0x55b9a2229080 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.099+0000 7fe288e40740 1 --2- 172.21.15.92:0/4079579183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b9a2213010 0x55b9a22120b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.099+0000 7fe288e40740 1 -- 172.21.15.92:0/4079579183 >> 172.21.15.92:0/4079579183 conn(0x55b9a2218f10 msgr2=0x55b9a22119a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.099+0000 7fe288e40740 1 -- 172.21.15.92:0/4079579183 shutdown_connections 2024-09-19T09:00:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.099+0000 7fe288e40740 1 -- 172.21.15.92:0/4079579183 wait complete. 2024-09-19T09:00:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.099+0000 7fe288e40740 1 -- start start 2024-09-19T09:00:16.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.100+0000 7fe288e40740 1 Processor -- start 2024-09-19T09:00:16.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.100+0000 7fe288e40740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9a2213010 0x55b9a2226470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:16.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.100+0000 7fe288e40740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b9a22179a0 0x55b9a22269b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:16.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.100+0000 7fe288e40740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b9a22182e0 0x55b9a2227970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:16.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.100+0000 7fe288e40740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe2801a3d60 con 0x55b9a2213010 2024-09-19T09:00:16.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.100+0000 7fe288e40740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe28006c670 con 0x55b9a22182e0 2024-09-19T09:00:16.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.100+0000 7fe288e40740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe2801a4430 con 0x55b9a22179a0 2024-09-19T09:00:16.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.100+0000 7fe288e40740 10 client.0 _ll_register_callbacks cb 0x7fe26803f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:16.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.101+0000 7fe27f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9a2213010 0x55b9a2226470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:16.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.101+0000 7fe27effd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b9a22179a0 0x55b9a22269b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:16.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.101+0000 7fe27f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9a2213010 0x55b9a2226470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37132/0 (socket says 172.21.15.92:37132) 2024-09-19T09:00:16.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.101+0000 7fe27f7fe640 1 -- 172.21.15.92:0/3557919962 learned_addr learned my addr 172.21.15.92:0/3557919962 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:16.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.101+0000 7fe27effd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b9a22179a0 0x55b9a22269b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:35338/0 (socket says 172.21.15.92:35338) 2024-09-19T09:00:16.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.101+0000 7fe27f7fe640 1 -- 172.21.15.92:0/3557919962 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b9a22179a0 msgr2=0x55b9a22269b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:16.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.101+0000 7fe27f7fe640 1 --2- 172.21.15.92:0/3557919962 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b9a22179a0 0x55b9a22269b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.101+0000 7fe27f7fe640 1 -- 172.21.15.92:0/3557919962 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b9a22182e0 msgr2=0x55b9a2227970 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:00:16.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.101+0000 7fe27f7fe640 1 --2- 172.21.15.92:0/3557919962 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b9a22182e0 0x55b9a2227970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.101+0000 7fe27f7fe640 1 -- 172.21.15.92:0/3557919962 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9a2227f80 con 0x55b9a2213010 2024-09-19T09:00:16.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.101+0000 7fe27f7fe640 1 --2- 172.21.15.92:0/3557919962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9a2213010 0x55b9a2226470 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe2700bc4b0 tx=0x7fe27000c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61688f9429b3e8f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:16.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.101+0000 7fe25effd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:00:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.102+0000 7fe25effd640 1 -- 172.21.15.92:0/3557919962 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2700a5000 con 0x55b9a2213010 2024-09-19T09:00:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.102+0000 7fe25effd640 1 -- 172.21.15.92:0/3557919962 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe2700a1b50 con 0x55b9a2213010 2024-09-19T09:00:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.102+0000 7fe288e40740 1 -- 172.21.15.92:0/3557919962 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2680046c0 con 0x55b9a2213010 2024-09-19T09:00:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.102+0000 7fe25effd640 1 -- 172.21.15.92:0/3557919962 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe2700bc0b0 con 0x55b9a2213010 2024-09-19T09:00:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.103+0000 7fe288e40740 10 client.16200 fetch_fsmap learned FSMap version 19 2024-09-19T09:00:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.103+0000 7fe288e40740 1 -- 172.21.15.92:0/3557919962 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55b9a2229290 con 0x55b9a2213010 2024-09-19T09:00:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.103+0000 7fe25effd640 1 -- 172.21.15.92:0/3557919962 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2680046c0 con 0x55b9a2213010 2024-09-19T09:00:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.103+0000 7fe25effd640 1 -- 172.21.15.92:0/3557919962 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe27009b7e0 con 0x55b9a2213010 2024-09-19T09:00:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.103+0000 7fe288e40740 10 client.16200 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:00:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.103+0000 7fe288e40740 10 client.16200 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:00:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.103+0000 7fe288e40740 20 client.16200 populate_metadata read hostname 'smithi092' 2024-09-19T09:00:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.103+0000 7fe288e40740 1 --2- 172.21.15.92:0/3557919962 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b9a221d370 0x55b9a22ab4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.103+0000 7fe288e40740 4 client.16200 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:00:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.103+0000 7fe288e40740 1 -- 172.21.15.92:0/3557919962 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b9a2182d70 con 0x55b9a221d370 2024-09-19T09:00:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.104+0000 7fe27effd640 1 --2- 172.21.15.92:0/3557919962 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b9a221d370 0x55b9a22ab4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.104+0000 7fe27effd640 1 --2- 172.21.15.92:0/3557919962 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b9a221d370 0x55b9a22ab4d0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b53771a3c1471d9 server_cookie=4e54169dabe278f8 in_seq=0 out_seq=0 2024-09-19T09:00:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.105+0000 7fe25effd640 10 client.16200 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.119+0000 7fe25effd640 1 -- 172.21.15.92:0/3557919962 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b9a2182d70 con 0x55b9a221d370 2024-09-19T09:00:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.119+0000 7fe25effd640 10 client.16200 handle_command_reply: tid=0 2024-09-19T09:00:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.119+0000 7fe288e40740 1 client.16200 shutdown 2024-09-19T09:00:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.121+0000 7fe288e40740 1 -- 172.21.15.92:0/3557919962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9a2213010 msgr2=0x55b9a2226470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.121+0000 7fe288e40740 1 --2- 172.21.15.92:0/3557919962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9a2213010 0x55b9a2226470 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe2700bc4b0 tx=0x7fe27000c7d0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.121+0000 7fe288e40740 1 -- 172.21.15.92:0/3557919962 shutdown_connections 2024-09-19T09:00:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.121+0000 7fe288e40740 1 --2- 172.21.15.92:0/3557919962 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b9a221d370 0x55b9a22ab4d0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.121+0000 7fe288e40740 1 --2- 172.21.15.92:0/3557919962 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b9a22182e0 0x55b9a2227970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.121+0000 7fe288e40740 1 --2- 172.21.15.92:0/3557919962 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b9a22179a0 0x55b9a22269b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.121+0000 7fe288e40740 1 --2- 172.21.15.92:0/3557919962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b9a2213010 0x55b9a2226470 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.121+0000 7fe288e40740 1 -- 172.21.15.92:0/3557919962 >> 172.21.15.92:0/3557919962 conn(0x55b9a2218f10 msgr2=0x55b9a22119a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:16.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.121+0000 7fe25effd640 0 client.16200 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:16.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.121+0000 7fe288e40740 1 -- 172.21.15.92:0/3557919962 shutdown_connections 2024-09-19T09:00:16.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.121+0000 7fe288e40740 1 -- 172.21.15.92:0/3557919962 wait complete. 2024-09-19T09:00:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.121+0000 7fe288e40740 20 client.16200 trim_cache size 0 max 16384 2024-09-19T09:00:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:00:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:00:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:00:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:00:16.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.122+0000 7fe285fc4640 1 -- 172.21.15.92:0/2881916948 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe26c0a3370 msgr2=0x7fe26c0a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:16.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.122+0000 7fe285fc4640 1 --2- 172.21.15.92:0/2881916948 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe26c0a3370 0x7fe26c0a5830 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe268006010 tx=0x7fe268000bc0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.122+0000 7fe285fc4640 1 -- 172.21.15.92:0/2881916948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe280100a40 msgr2=0x7fe28010b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:16.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.122+0000 7fe285fc4640 1 --2- 172.21.15.92:0/2881916948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe280100a40 0x7fe28010b240 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe27000e9c0 tx=0x7fe27000ee80 comp rx=0 tx=0).stop 2024-09-19T09:00:16.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.122+0000 7fe285fc4640 1 -- 172.21.15.92:0/2881916948 shutdown_connections 2024-09-19T09:00:16.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.122+0000 7fe285fc4640 1 --2- 172.21.15.92:0/2881916948 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2801025f0 0x7fe280109dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.122+0000 7fe285fc4640 1 --2- 172.21.15.92:0/2881916948 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe26c0a3370 0x7fe26c0a5830 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.125 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.122+0000 7fe285fc4640 1 --2- 172.21.15.92:0/2881916948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe280101c30 0x7fe280109880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.125 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.122+0000 7fe285fc4640 1 --2- 172.21.15.92:0/2881916948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe280100a40 0x7fe28010b240 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.125 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.122+0000 7fe285fc4640 1 -- 172.21.15.92:0/2881916948 >> 172.21.15.92:0/2881916948 conn(0x7fe2800fc1e0 msgr2=0x7fe280104ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:16.125 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.123+0000 7fe285fc4640 1 -- 172.21.15.92:0/2881916948 shutdown_connections 2024-09-19T09:00:16.125 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:16.124+0000 7fe285fc4640 1 -- 172.21.15.92:0/2881916948 wait complete. 2024-09-19T09:00:17.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:17 smithi092 ceph-mon[31407]: pgmap v444: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 12 MiB/s wr, 962 op/s 2024-09-19T09:00:17.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:17 smithi167 ceph-mon[35359]: pgmap v444: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 12 MiB/s wr, 962 op/s 2024-09-19T09:00:17.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:17 smithi190 ceph-mon[35358]: pgmap v444: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 12 MiB/s wr, 962 op/s 2024-09-19T09:00:19.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:19 smithi092 ceph-mon[31407]: pgmap v445: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 11 MiB/s wr, 970 op/s 2024-09-19T09:00:19.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:19 smithi167 ceph-mon[35359]: pgmap v445: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 11 MiB/s wr, 970 op/s 2024-09-19T09:00:19.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:19 smithi190 ceph-mon[35358]: pgmap v445: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 11 MiB/s wr, 970 op/s 2024-09-19T09:00:20.052 INFO:tasks.quiescer.fs.[cephfs]:Total duration (59.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T09:00:20.053 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.8 2024-09-19T09:00:20.053 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:00:20.467 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:20.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 215.0 s, 5485.6 tps, lat 18.243 ms stddev 20.343 2024-09-19T09:00:21.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.393+0000 7fb05cf76640 1 -- 172.21.15.92:0/3591486463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0581011e0 msgr2=0x7fb058105980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:21.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.393+0000 7fb05cf76640 1 --2- 172.21.15.92:0/3591486463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0581011e0 0x7fb058105980 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fb040009900 tx=0x7fb04002a410 comp rx=0 tx=0).stop 2024-09-19T09:00:21.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.393+0000 7fb05cf76640 1 -- 172.21.15.92:0/3591486463 shutdown_connections 2024-09-19T09:00:21.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.393+0000 7fb05cf76640 1 --2- 172.21.15.92:0/3591486463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb058105ec0 0x7fb058106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:21.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.393+0000 7fb05cf76640 1 --2- 172.21.15.92:0/3591486463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0581011e0 0x7fb058105980 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:21.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.393+0000 7fb05cf76640 1 --2- 172.21.15.92:0/3591486463 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0581008c0 0x7fb058100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:21.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.393+0000 7fb05cf76640 1 -- 172.21.15.92:0/3591486463 >> 172.21.15.92:0/3591486463 conn(0x7fb0580fc7d0 msgr2=0x7fb0580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:21.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.393+0000 7fb05cf76640 1 -- 172.21.15.92:0/3591486463 shutdown_connections 2024-09-19T09:00:21.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.393+0000 7fb05cf76640 1 -- 172.21.15.92:0/3591486463 wait complete. 2024-09-19T09:00:21.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.395+0000 7fb05cf76640 1 Processor -- start 2024-09-19T09:00:21.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.395+0000 7fb05cf76640 1 -- start start 2024-09-19T09:00:21.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.396+0000 7fb05cf76640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0581008c0 0x7fb0581a47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:21.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.396+0000 7fb05cf76640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0581011e0 0x7fb0581a4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:21.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.396+0000 7fb05cf76640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb058105ec0 0x7fb05819e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:21.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.396+0000 7fb04ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0581011e0 0x7fb0581a4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:21.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.396+0000 7fb04ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0581011e0 0x7fb0581a4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37154/0 (socket says 172.21.15.92:37154) 2024-09-19T09:00:21.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.396+0000 7fb05659c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0581008c0 0x7fb0581a47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:21.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.396+0000 7fb04ffff640 1 -- 172.21.15.92:0/1257755370 learned_addr learned my addr 172.21.15.92:0/1257755370 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:21.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.396+0000 7fb05cf76640 1 -- 172.21.15.92:0/1257755370 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb058118660 con 0x7fb0581011e0 2024-09-19T09:00:21.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.396+0000 7fb056d9d640 1 --2- 172.21.15.92:0/1257755370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb058105ec0 0x7fb05819e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:21.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.396+0000 7fb05cf76640 1 -- 172.21.15.92:0/1257755370 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb0581184e0 con 0x7fb0581008c0 2024-09-19T09:00:21.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.396+0000 7fb05cf76640 1 -- 172.21.15.92:0/1257755370 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb0581187e0 con 0x7fb058105ec0 2024-09-19T09:00:21.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.397+0000 7fb056d9d640 1 -- 172.21.15.92:0/1257755370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0581008c0 msgr2=0x7fb0581a47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:21.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.397+0000 7fb056d9d640 1 --2- 172.21.15.92:0/1257755370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0581008c0 0x7fb0581a47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:21.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.397+0000 7fb056d9d640 1 -- 172.21.15.92:0/1257755370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0581011e0 msgr2=0x7fb0581a4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:21.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.397+0000 7fb056d9d640 1 --2- 172.21.15.92:0/1257755370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0581011e0 0x7fb0581a4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:21.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.397+0000 7fb056d9d640 1 -- 172.21.15.92:0/1257755370 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb05819f0a0 con 0x7fb058105ec0 2024-09-19T09:00:21.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.397+0000 7fb056d9d640 1 --2- 172.21.15.92:0/1257755370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb058105ec0 0x7fb05819e970 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb050009fd0 tx=0x7fb05000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:21.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.397+0000 7fb05659c640 1 --2- 172.21.15.92:0/1257755370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0581008c0 0x7fb0581a47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:00:21.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.397+0000 7fb04ffff640 1 --2- 172.21.15.92:0/1257755370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0581011e0 0x7fb0581a4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:00:21.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.397+0000 7fb04f7fe640 1 -- 172.21.15.92:0/1257755370 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb05000ce20 con 0x7fb058105ec0 2024-09-19T09:00:21.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.398+0000 7fb04f7fe640 1 -- 172.21.15.92:0/1257755370 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb050005020 con 0x7fb058105ec0 2024-09-19T09:00:21.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.398+0000 7fb04f7fe640 1 -- 172.21.15.92:0/1257755370 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb050010720 con 0x7fb058105ec0 2024-09-19T09:00:21.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.398+0000 7fb05cf76640 1 -- 172.21.15.92:0/1257755370 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb05819f390 con 0x7fb058105ec0 2024-09-19T09:00:21.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.398+0000 7fb05cf76640 1 -- 172.21.15.92:0/1257755370 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0581ab680 con 0x7fb058105ec0 2024-09-19T09:00:21.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.400+0000 7fb05cf76640 1 -- 172.21.15.92:0/1257755370 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb058105980 con 0x7fb058105ec0 2024-09-19T09:00:21.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.401+0000 7fb04f7fe640 1 -- 172.21.15.92:0/1257755370 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb0500051d0 con 0x7fb058105ec0 2024-09-19T09:00:21.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.401+0000 7fb04f7fe640 1 --2- 172.21.15.92:0/1257755370 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb0440a32c0 0x7fb0440a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:21.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.402+0000 7fb04f7fe640 1 -- 172.21.15.92:0/1257755370 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb0500d0180 con 0x7fb058105ec0 2024-09-19T09:00:21.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.402+0000 7fb05659c640 1 --2- 172.21.15.92:0/1257755370 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb0440a32c0 0x7fb0440a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:21.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.403+0000 7fb05659c640 1 --2- 172.21.15.92:0/1257755370 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb0440a32c0 0x7fb0440a5780 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb05819fab0 tx=0x7fb048005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:21.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.406+0000 7fb04f7fe640 1 -- 172.21.15.92:0/1257755370 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb05009cea0 con 0x7fb058105ec0 2024-09-19T09:00:21.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:21 smithi092 ceph-mon[31407]: pgmap v446: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 11 MiB/s wr, 984 op/s 2024-09-19T09:00:21.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.781+0000 7fb05cf76640 1 -- 172.21.15.92:0/1257755370 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0581ab880 con 0x7fb058105ec0 2024-09-19T09:00:21.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.782+0000 7fb04f7fe640 1 -- 172.21.15.92:0/1257755370 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7fb05009c7a0 con 0x7fb058105ec0 2024-09-19T09:00:21.784 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:00:21.784 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:00:21.784 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:00:21.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.786+0000 7fb05cf76640 1 -- 172.21.15.92:0/1257755370 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb0440a32c0 msgr2=0x7fb0440a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:21.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.786+0000 7fb05cf76640 1 --2- 172.21.15.92:0/1257755370 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb0440a32c0 0x7fb0440a5780 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb05819fab0 tx=0x7fb048005f90 comp rx=0 tx=0).stop 2024-09-19T09:00:21.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.786+0000 7fb05cf76640 1 -- 172.21.15.92:0/1257755370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb058105ec0 msgr2=0x7fb05819e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:21.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.786+0000 7fb05cf76640 1 --2- 172.21.15.92:0/1257755370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb058105ec0 0x7fb05819e970 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb050009fd0 tx=0x7fb05000ef10 comp rx=0 tx=0).stop 2024-09-19T09:00:21.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.786+0000 7fb05cf76640 1 -- 172.21.15.92:0/1257755370 shutdown_connections 2024-09-19T09:00:21.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.786+0000 7fb05cf76640 1 --2- 172.21.15.92:0/1257755370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb058105ec0 0x7fb05819e970 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:21.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.786+0000 7fb05cf76640 1 --2- 172.21.15.92:0/1257755370 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb0440a32c0 0x7fb0440a5780 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:21.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.786+0000 7fb05cf76640 1 --2- 172.21.15.92:0/1257755370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0581011e0 0x7fb0581a4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:21.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.786+0000 7fb05cf76640 1 --2- 172.21.15.92:0/1257755370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0581008c0 0x7fb0581a47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:21.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.786+0000 7fb05cf76640 1 -- 172.21.15.92:0/1257755370 >> 172.21.15.92:0/1257755370 conn(0x7fb0580fc7d0 msgr2=0x7fb058103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:21.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.787+0000 7fb05cf76640 1 -- 172.21.15.92:0/1257755370 shutdown_connections 2024-09-19T09:00:21.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:21.787+0000 7fb05cf76640 1 -- 172.21.15.92:0/1257755370 wait complete. 2024-09-19T09:00:21.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:21 smithi167 ceph-mon[35359]: pgmap v446: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 11 MiB/s wr, 984 op/s 2024-09-19T09:00:21.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:21 smithi190 ceph-mon[35358]: pgmap v446: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 11 MiB/s wr, 984 op/s 2024-09-19T09:00:22.535 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0' 2024-09-19T09:00:22.535 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0 2024-09-19T09:00:22.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:22 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1257755370' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:22.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:22 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/1257755370' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:22.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:22 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/1257755370' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:22.943 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:23.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.560+0000 7fdf7c992640 1 -- 172.21.15.92:0/3234619348 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf780742d0 msgr2=0x7fdf78074750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:23.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.560+0000 7fdf7c992640 1 --2- 172.21.15.92:0/3234619348 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf780742d0 0x7fdf78074750 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c009860 tx=0x7fdf6c02a360 comp rx=0 tx=0).stop 2024-09-19T09:00:23.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.561+0000 7fdf7c992640 1 -- 172.21.15.92:0/3234619348 shutdown_connections 2024-09-19T09:00:23.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.561+0000 7fdf7c992640 1 --2- 172.21.15.92:0/3234619348 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf78074c90 0x7fdf78075390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:23.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.561+0000 7fdf7c992640 1 --2- 172.21.15.92:0/3234619348 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf780742d0 0x7fdf78074750 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:23.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.561+0000 7fdf7c992640 1 --2- 172.21.15.92:0/3234619348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf781098a0 0x7fdf78109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:23.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.561+0000 7fdf7c992640 1 -- 172.21.15.92:0/3234619348 >> 172.21.15.92:0/3234619348 conn(0x7fdf7806e140 msgr2=0x7fdf7806e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:23.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.563+0000 7fdf7c992640 1 -- 172.21.15.92:0/3234619348 shutdown_connections 2024-09-19T09:00:23.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.564+0000 7fdf7c992640 1 -- 172.21.15.92:0/3234619348 wait complete. 2024-09-19T09:00:23.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.565+0000 7fdf7c992640 1 Processor -- start 2024-09-19T09:00:23.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.567+0000 7fdf7c992640 1 -- start start 2024-09-19T09:00:23.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.568+0000 7fdf7c992640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf780742d0 0x7fdf78084d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:23.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.568+0000 7fdf7c992640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf78074c90 0x7fdf7807fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:23.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.568+0000 7fdf7c992640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf781098a0 0x7fdf78080310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:23.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.568+0000 7fdf7c992640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7807e860 con 0x7fdf780742d0 2024-09-19T09:00:23.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.568+0000 7fdf7c992640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7807e6e0 con 0x7fdf78074c90 2024-09-19T09:00:23.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.568+0000 7fdf7c992640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7807e9e0 con 0x7fdf781098a0 2024-09-19T09:00:23.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.569+0000 7fdf75d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf78074c90 0x7fdf7807fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:23.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.569+0000 7fdf7659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf780742d0 0x7fdf78084d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:23.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.570+0000 7fdf75d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf78074c90 0x7fdf7807fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:39082/0 (socket says 172.21.15.92:39082) 2024-09-19T09:00:23.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.570+0000 7fdf75d9b640 1 -- 172.21.15.92:0/97396539 learned_addr learned my addr 172.21.15.92:0/97396539 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:23.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.570+0000 7fdf76d9d640 1 --2- 172.21.15.92:0/97396539 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf781098a0 0x7fdf78080310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:23.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.571+0000 7fdf76d9d640 1 -- 172.21.15.92:0/97396539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf78074c90 msgr2=0x7fdf7807fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:23.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.571+0000 7fdf76d9d640 1 --2- 172.21.15.92:0/97396539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf78074c90 0x7fdf7807fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:23.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.571+0000 7fdf76d9d640 1 -- 172.21.15.92:0/97396539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf780742d0 msgr2=0x7fdf78084d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:23.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.571+0000 7fdf76d9d640 1 --2- 172.21.15.92:0/97396539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf780742d0 0x7fdf78084d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:23.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.571+0000 7fdf76d9d640 1 -- 172.21.15.92:0/97396539 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf78080b80 con 0x7fdf781098a0 2024-09-19T09:00:23.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.572+0000 7fdf76d9d640 1 --2- 172.21.15.92:0/97396539 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf781098a0 0x7fdf78080310 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdf7000ed70 tx=0x7fdf7000c6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:23.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.573+0000 7fdf677fe640 1 -- 172.21.15.92:0/97396539 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7000ee60 con 0x7fdf781098a0 2024-09-19T09:00:23.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.573+0000 7fdf7c992640 1 -- 172.21.15.92:0/97396539 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf78137350 con 0x7fdf781098a0 2024-09-19T09:00:23.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.573+0000 7fdf7c992640 1 -- 172.21.15.92:0/97396539 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf78137860 con 0x7fdf781098a0 2024-09-19T09:00:23.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.573+0000 7fdf677fe640 1 -- 172.21.15.92:0/97396539 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf70003b70 con 0x7fdf781098a0 2024-09-19T09:00:23.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.573+0000 7fdf677fe640 1 -- 172.21.15.92:0/97396539 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf70017880 con 0x7fdf781098a0 2024-09-19T09:00:23.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.576+0000 7fdf7ed6b740 1 Processor -- start 2024-09-19T09:00:23.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.578+0000 7fdf677fe640 1 -- 172.21.15.92:0/97396539 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fdf70004020 con 0x7fdf781098a0 2024-09-19T09:00:23.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.578+0000 7fdf7ed6b740 1 -- start start 2024-09-19T09:00:23.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.579+0000 7fdf7ed6b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b1a8c5c760 0x55b1a8c5cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:23.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.579+0000 7fdf7ed6b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1a8c5d080 0x55b1a8c67400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:23.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.579+0000 7fdf7ed6b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1a8c67940 0x55b1a8c69d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:23.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.579+0000 7fdf7ed6b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b1a8bc22a0 con 0x55b1a8c67940 2024-09-19T09:00:23.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.579+0000 7fdf7ed6b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b1a8b69b10 con 0x55b1a8c5d080 2024-09-19T09:00:23.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.579+0000 7fdf7ed6b740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55b1a8bbe260 con 0x55b1a8c5c760 2024-09-19T09:00:23.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.579+0000 7fdf75d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1a8c67940 0x55b1a8c69d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:23.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.579+0000 7fdf75d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1a8c67940 0x55b1a8c69d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54674/0 (socket says 172.21.15.92:54674) 2024-09-19T09:00:23.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.579+0000 7fdf75d9b640 1 -- 172.21.15.92:0/2907524488 learned_addr learned my addr 172.21.15.92:0/2907524488 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:23.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.579+0000 7fdf7659c640 1 --2- 172.21.15.92:0/2907524488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1a8c5d080 0x55b1a8c67400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:23.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.579+0000 7fdf75d9b640 1 --2- 172.21.15.92:0/2907524488 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b1a8c5c760 0x55b1a8c5cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:23.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.579+0000 7fdf7659c640 1 -- 172.21.15.92:0/2907524488 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b1a8c5c760 msgr2=0x55b1a8c5cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:23.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.579+0000 7fdf7659c640 1 --2- 172.21.15.92:0/2907524488 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b1a8c5c760 0x55b1a8c5cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:23.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.579+0000 7fdf7659c640 1 -- 172.21.15.92:0/2907524488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1a8c67940 msgr2=0x55b1a8c69d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:23.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.579+0000 7fdf7659c640 1 --2- 172.21.15.92:0/2907524488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1a8c67940 0x55b1a8c69d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:23.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.579+0000 7fdf7659c640 1 -- 172.21.15.92:0/2907524488 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1a8933b90 con 0x55b1a8c5d080 2024-09-19T09:00:23.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.579+0000 7fdf75d9b640 1 --2- 172.21.15.92:0/2907524488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1a8c67940 0x55b1a8c69d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:23.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.580+0000 7fdf677fe640 1 --2- 172.21.15.92:0/97396539 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdf600a3300 0x7fdf600a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:23.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.580+0000 7fdf7659c640 1 --2- 172.21.15.92:0/2907524488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1a8c5d080 0x55b1a8c67400 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdf6800b760 tx=0x7fdf6800bc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a917fb67a6975d0e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:23.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.580+0000 7fdf75d9b640 1 --2- 172.21.15.92:0/97396539 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdf600a3300 0x7fdf600a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:23.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.580+0000 7fdf64ff9640 1 -- 172.21.15.92:0/2907524488 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf6800d950 con 0x55b1a8c5d080 2024-09-19T09:00:23.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.580+0000 7fdf64ff9640 1 -- 172.21.15.92:0/2907524488 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf68019070 con 0x55b1a8c5d080 2024-09-19T09:00:23.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.580+0000 7fdf64ff9640 1 -- 172.21.15.92:0/2907524488 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf680123e0 con 0x55b1a8c5d080 2024-09-19T09:00:23.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.580+0000 7fdf677fe640 1 -- 172.21.15.92:0/97396539 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fdf700cf840 con 0x7fdf781098a0 2024-09-19T09:00:23.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.582+0000 7fdf7ed6b740 1 -- 172.21.15.92:0/2907524488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1a8c5d080 msgr2=0x55b1a8c67400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:23.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.582+0000 7fdf7ed6b740 1 --2- 172.21.15.92:0/2907524488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1a8c5d080 0x55b1a8c67400 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdf6800b760 tx=0x7fdf6800bc20 comp rx=0 tx=0).stop 2024-09-19T09:00:23.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.582+0000 7fdf75d9b640 1 --2- 172.21.15.92:0/97396539 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdf600a3300 0x7fdf600a57c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x55b1a8c5a070 tx=0x7fdf6c02a360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:23.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.582+0000 7fdf7ed6b740 1 -- 172.21.15.92:0/2907524488 shutdown_connections 2024-09-19T09:00:23.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.582+0000 7fdf7ed6b740 1 --2- 172.21.15.92:0/2907524488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1a8c67940 0x55b1a8c69d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:23.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.582+0000 7fdf7ed6b740 1 --2- 172.21.15.92:0/2907524488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1a8c5d080 0x55b1a8c67400 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:23.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.582+0000 7fdf7ed6b740 1 --2- 172.21.15.92:0/2907524488 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b1a8c5c760 0x55b1a8c5cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:23.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.582+0000 7fdf7ed6b740 1 -- 172.21.15.92:0/2907524488 >> 172.21.15.92:0/2907524488 conn(0x55b1a8c58cf0 msgr2=0x55b1a8c590d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:23.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.582+0000 7fdf7ed6b740 1 -- 172.21.15.92:0/2907524488 shutdown_connections 2024-09-19T09:00:23.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.582+0000 7fdf7ed6b740 1 -- 172.21.15.92:0/2907524488 wait complete. 2024-09-19T09:00:23.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.583+0000 7fdf7ed6b740 1 -- start start 2024-09-19T09:00:23.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.583+0000 7fdf7ed6b740 1 Processor -- start 2024-09-19T09:00:23.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.583+0000 7fdf7ed6b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b1a8c5c760 0x55b1a8c647a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:23.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.583+0000 7fdf7ed6b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1a8c5d080 0x55b1a8c64ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:23.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.583+0000 7fdf7ed6b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1a8c67940 0x55b1a8c65220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:23.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.583+0000 7fdf7ed6b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b1a8c6a510 con 0x55b1a8c5d080 2024-09-19T09:00:23.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.583+0000 7fdf7ed6b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b1a8b4a6e0 con 0x55b1a8c67940 2024-09-19T09:00:23.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.583+0000 7fdf7ed6b740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55b1a8c6a690 con 0x55b1a8c5c760 2024-09-19T09:00:23.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.583+0000 7fdf7ed6b740 10 client.0 _ll_register_callbacks cb 0x55b1a8b6ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:23.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.584+0000 7fdf75d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1a8c5d080 0x55b1a8c64ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:23.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.584+0000 7fdf75d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1a8c5d080 0x55b1a8c64ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54680/0 (socket says 172.21.15.92:54680) 2024-09-19T09:00:23.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.584+0000 7fdf75d9b640 1 -- 172.21.15.92:0/2220451659 learned_addr learned my addr 172.21.15.92:0/2220451659 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:23.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.584+0000 7fdf76d9d640 1 --2- 172.21.15.92:0/2220451659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1a8c67940 0x55b1a8c65220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:23.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.584+0000 7fdf7659c640 1 --2- 172.21.15.92:0/2220451659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b1a8c5c760 0x55b1a8c647a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:23.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.584+0000 7fdf75d9b640 1 -- 172.21.15.92:0/2220451659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b1a8c5c760 msgr2=0x55b1a8c647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:23.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.584+0000 7fdf75d9b640 1 --2- 172.21.15.92:0/2220451659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b1a8c5c760 0x55b1a8c647a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:23.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.584+0000 7fdf75d9b640 1 -- 172.21.15.92:0/2220451659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1a8c67940 msgr2=0x55b1a8c65220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:23.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.584+0000 7fdf75d9b640 1 --2- 172.21.15.92:0/2220451659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1a8c67940 0x55b1a8c65220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:23.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.584+0000 7fdf75d9b640 1 -- 172.21.15.92:0/2220451659 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1a8c73a10 con 0x55b1a8c5d080 2024-09-19T09:00:23.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.584+0000 7fdf76d9d640 1 --2- 172.21.15.92:0/2220451659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1a8c67940 0x55b1a8c65220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:23.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.584+0000 7fdf75d9b640 1 --2- 172.21.15.92:0/2220451659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1a8c5d080 0x55b1a8c64ce0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c0057c0 tx=0x7fdf6c02a860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=657f35316eff652a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:23.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.584+0000 7fdf5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:00:23.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.584+0000 7fdf5dffb640 1 -- 172.21.15.92:0/2220451659 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c04e020 con 0x55b1a8c5d080 2024-09-19T09:00:23.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.584+0000 7fdf7ed6b740 1 -- 172.21.15.92:0/2220451659 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf68019070 con 0x55b1a8c5d080 2024-09-19T09:00:23.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.584+0000 7fdf5dffb640 1 -- 172.21.15.92:0/2220451659 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fdf6c003a00 con 0x55b1a8c5d080 2024-09-19T09:00:23.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.585+0000 7fdf5dffb640 1 -- 172.21.15.92:0/2220451659 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fdf6c037040 con 0x55b1a8c5d080 2024-09-19T09:00:23.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.585+0000 7fdf7ed6b740 10 client.16215 fetch_fsmap learned FSMap version 19 2024-09-19T09:00:23.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.585+0000 7fdf7ed6b740 1 -- 172.21.15.92:0/2220451659 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55b1a8c76410 con 0x55b1a8c5d080 2024-09-19T09:00:23.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.585+0000 7fdf5dffb640 1 -- 172.21.15.92:0/2220451659 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf68019070 con 0x55b1a8c5d080 2024-09-19T09:00:23.592 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:23 smithi092 ceph-mon[31407]: pgmap v447: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 10 MiB/s wr, 890 op/s 2024-09-19T09:00:23.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.585+0000 7fdf5dffb640 1 -- 172.21.15.92:0/2220451659 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fdf6c04a420 con 0x55b1a8c5d080 2024-09-19T09:00:23.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.585+0000 7fdf7ed6b740 10 client.16215 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:00:23.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.585+0000 7fdf7ed6b740 10 client.16215 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:00:23.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.585+0000 7fdf7ed6b740 20 client.16215 populate_metadata read hostname 'smithi092' 2024-09-19T09:00:23.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.585+0000 7fdf7ed6b740 1 --2- 172.21.15.92:0/2220451659 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b1a8c77d90 0x55b1a8c7a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:23.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.585+0000 7fdf7ed6b740 4 client.16215 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:00:23.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.585+0000 7fdf7ed6b740 1 -- 172.21.15.92:0/2220451659 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b1a8bcf9d0 con 0x55b1a8c77d90 2024-09-19T09:00:23.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.585+0000 7fdf7659c640 1 --2- 172.21.15.92:0/2220451659 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b1a8c77d90 0x55b1a8c7a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:23.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.587+0000 7fdf7659c640 1 --2- 172.21.15.92:0/2220451659 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b1a8c77d90 0x55b1a8c7a1b0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1261442015fa65c1 server_cookie=7f2219fcb329c4c9 in_seq=0 out_seq=0 2024-09-19T09:00:23.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.587+0000 7fdf5dffb640 10 client.16215 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:23.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.588+0000 7fdf5dffb640 1 -- 172.21.15.92:0/2220451659 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b1a8bcf9d0 con 0x55b1a8c77d90 2024-09-19T09:00:23.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.588+0000 7fdf5dffb640 10 client.16215 handle_command_reply: tid=0 2024-09-19T09:00:23.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.588+0000 7fdf7ed6b740 1 client.16215 shutdown 2024-09-19T09:00:23.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.588+0000 7fdf7ed6b740 1 -- 172.21.15.92:0/2220451659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1a8c5d080 msgr2=0x55b1a8c64ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:23.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.588+0000 7fdf7ed6b740 1 --2- 172.21.15.92:0/2220451659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1a8c5d080 0x55b1a8c64ce0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c0057c0 tx=0x7fdf6c02a860 comp rx=0 tx=0).stop 2024-09-19T09:00:23.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.588+0000 7fdf7ed6b740 1 -- 172.21.15.92:0/2220451659 shutdown_connections 2024-09-19T09:00:23.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.588+0000 7fdf7ed6b740 1 --2- 172.21.15.92:0/2220451659 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b1a8c77d90 0x55b1a8c7a1b0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:23.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.589+0000 7fdf7ed6b740 1 --2- 172.21.15.92:0/2220451659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1a8c67940 0x55b1a8c65220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:23.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.589+0000 7fdf7ed6b740 1 --2- 172.21.15.92:0/2220451659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1a8c5d080 0x55b1a8c64ce0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:23.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.589+0000 7fdf7ed6b740 1 --2- 172.21.15.92:0/2220451659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b1a8c5c760 0x55b1a8c647a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:23.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.589+0000 7fdf7ed6b740 1 -- 172.21.15.92:0/2220451659 >> 172.21.15.92:0/2220451659 conn(0x55b1a8c58cf0 msgr2=0x55b1a8c5e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:23.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.589+0000 7fdf5dffb640 0 client.16215 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:23.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.589+0000 7fdf7ed6b740 1 -- 172.21.15.92:0/2220451659 shutdown_connections 2024-09-19T09:00:23.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.589+0000 7fdf7ed6b740 1 -- 172.21.15.92:0/2220451659 wait complete. 2024-09-19T09:00:23.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.589+0000 7fdf7ed6b740 20 client.16215 trim_cache size 0 max 16384 2024-09-19T09:00:23.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.620+0000 7fdf7ed6b740 1 Processor -- start 2024-09-19T09:00:23.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.620+0000 7fdf7ed6b740 1 -- start start 2024-09-19T09:00:23.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.620+0000 7fdf7ed6b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1a8c5c760 0x55b1a8c5fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:23.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.621+0000 7fdf7ed6b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b1a8c5d080 0x55b1a8c636e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:23.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.621+0000 7fdf7659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1a8c5c760 0x55b1a8c5fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:23.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.621+0000 7fdf7659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1a8c5c760 0x55b1a8c5fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54684/0 (socket says 172.21.15.92:54684) 2024-09-19T09:00:23.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.621+0000 7fdf7ed6b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1a8c67940 0x55b1a8c7fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:23.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.621+0000 7fdf7659c640 1 -- 172.21.15.92:0/2096147172 learned_addr learned my addr 172.21.15.92:0/2096147172 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:23.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.621+0000 7fdf7ed6b740 1 -- 172.21.15.92:0/2096147172 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5800c410 con 0x55b1a8c5c760 2024-09-19T09:00:23.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.621+0000 7fdf7ed6b740 1 -- 172.21.15.92:0/2096147172 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5800ecb0 con 0x55b1a8c67940 2024-09-19T09:00:23.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.621+0000 7fdf75d9b640 1 --2- 172.21.15.92:0/2096147172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b1a8c5d080 0x55b1a8c636e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:23.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.621+0000 7fdf7ed6b740 1 -- 172.21.15.92:0/2096147172 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5800caa0 con 0x55b1a8c5d080 2024-09-19T09:00:23.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.621+0000 7fdf76d9d640 1 --2- 172.21.15.92:0/2096147172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1a8c67940 0x55b1a8c7fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:23.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.621+0000 7fdf75d9b640 1 -- 172.21.15.92:0/2096147172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1a8c67940 msgr2=0x55b1a8c7fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:23.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.621+0000 7fdf75d9b640 1 --2- 172.21.15.92:0/2096147172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1a8c67940 0x55b1a8c7fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:23.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.621+0000 7fdf75d9b640 1 -- 172.21.15.92:0/2096147172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1a8c5c760 msgr2=0x55b1a8c5fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:23.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.621+0000 7fdf75d9b640 1 --2- 172.21.15.92:0/2096147172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1a8c5c760 0x55b1a8c5fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:23.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.621+0000 7fdf75d9b640 1 -- 172.21.15.92:0/2096147172 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1a8c58b20 con 0x55b1a8c5d080 2024-09-19T09:00:23.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.622+0000 7fdf75d9b640 1 --2- 172.21.15.92:0/2096147172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b1a8c5d080 0x55b1a8c636e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c009980 tx=0x7fdf6c005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4211bae62bfc66f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:23.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.623+0000 7fdf5ffff640 1 -- 172.21.15.92:0/2096147172 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c04e040 con 0x55b1a8c5d080 2024-09-19T09:00:23.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.623+0000 7fdf5ffff640 1 -- 172.21.15.92:0/2096147172 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf6c045040 con 0x55b1a8c5d080 2024-09-19T09:00:23.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.623+0000 7fdf5ffff640 1 -- 172.21.15.92:0/2096147172 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c003800 con 0x55b1a8c5d080 2024-09-19T09:00:23.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.624+0000 7fdf7ed6b740 1 -- 172.21.15.92:0/2096147172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b1a8c5d080 msgr2=0x55b1a8c636e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:23.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.624+0000 7fdf7ed6b740 1 --2- 172.21.15.92:0/2096147172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b1a8c5d080 0x55b1a8c636e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c009980 tx=0x7fdf6c005fd0 comp rx=0 tx=0).stop 2024-09-19T09:00:23.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.624+0000 7fdf7ed6b740 1 -- 172.21.15.92:0/2096147172 shutdown_connections 2024-09-19T09:00:23.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.624+0000 7fdf7ed6b740 1 --2- 172.21.15.92:0/2096147172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1a8c67940 0x55b1a8c7fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:23.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.624+0000 7fdf7ed6b740 1 --2- 172.21.15.92:0/2096147172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b1a8c5d080 0x55b1a8c636e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:23.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.624+0000 7fdf7ed6b740 1 --2- 172.21.15.92:0/2096147172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1a8c5c760 0x55b1a8c5fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:23.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.624+0000 7fdf7ed6b740 1 -- 172.21.15.92:0/2096147172 >> 172.21.15.92:0/2096147172 conn(0x55b1a8c58cf0 msgr2=0x55b1a8c66820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:23.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.624+0000 7fdf7ed6b740 1 -- 172.21.15.92:0/2096147172 shutdown_connections 2024-09-19T09:00:23.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.624+0000 7fdf7ed6b740 1 -- 172.21.15.92:0/2096147172 wait complete. 2024-09-19T09:00:23.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.625+0000 7fdf7ed6b740 1 -- start start 2024-09-19T09:00:23.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.625+0000 7fdf7ed6b740 1 Processor -- start 2024-09-19T09:00:23.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.626+0000 7fdf7ed6b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1a8c5c760 0x55b1a8c70000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:23.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.626+0000 7fdf7ed6b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b1a8c5d080 0x55b1a8c6b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:23.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.626+0000 7fdf7ed6b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1a8c67940 0x55b1a8c6b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:23.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.626+0000 7fdf75d9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b1a8c5d080 0x55b1a8c6b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:23.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.626+0000 7fdf7659c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1a8c5c760 0x55b1a8c70000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:23.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.626+0000 7fdf75d9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b1a8c5d080 0x55b1a8c6b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:43122/0 (socket says 172.21.15.92:43122) 2024-09-19T09:00:23.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.626+0000 7fdf7659c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1a8c5c760 0x55b1a8c70000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:39116/0 (socket says 172.21.15.92:39116) 2024-09-19T09:00:23.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.626+0000 7fdf7659c640 1 -- 172.21.15.92:0/3722954539 learned_addr learned my addr 172.21.15.92:0/3722954539 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:23.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.626+0000 7fdf7ed6b740 1 -- 172.21.15.92:0/3722954539 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5800d170 con 0x55b1a8c67940 2024-09-19T09:00:23.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.626+0000 7fdf7ed6b740 1 -- 172.21.15.92:0/3722954539 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5800e5e0 con 0x55b1a8c5c760 2024-09-19T09:00:23.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.626+0000 7fdf7ed6b740 1 -- 172.21.15.92:0/3722954539 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5800d840 con 0x55b1a8c5d080 2024-09-19T09:00:23.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.626+0000 7fdf7ed6b740 10 client.0 _ll_register_callbacks cb 0x7fdf6c02a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:23.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.627+0000 7fdf7659c640 1 -- 172.21.15.92:0/3722954539 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b1a8c5d080 msgr2=0x55b1a8c6b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:23.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.627+0000 7fdf7659c640 1 --2- 172.21.15.92:0/3722954539 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b1a8c5d080 0x55b1a8c6b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:23.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.627+0000 7fdf7659c640 1 -- 172.21.15.92:0/3722954539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1a8c67940 msgr2=0x55b1a8c6b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:23.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.627+0000 7fdf76d9d640 1 --2- 172.21.15.92:0/3722954539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1a8c67940 0x55b1a8c6b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:23.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.627+0000 7fdf7659c640 1 --2- 172.21.15.92:0/3722954539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1a8c67940 0x55b1a8c6b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:23.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.627+0000 7fdf7659c640 1 -- 172.21.15.92:0/3722954539 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1a8c54260 con 0x55b1a8c5c760 2024-09-19T09:00:23.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.627+0000 7fdf76d9d640 1 --2- 172.21.15.92:0/3722954539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1a8c67940 0x55b1a8c6b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:00:23.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.627+0000 7fdf7659c640 1 --2- 172.21.15.92:0/3722954539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1a8c5c760 0x55b1a8c70000 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdf6800b140 tx=0x7fdf6800b170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5aca2941b18e16ce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:23.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.627+0000 7fdf5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:00:23.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.628+0000 7fdf5dffb640 1 -- 172.21.15.92:0/3722954539 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf6800b260 con 0x55b1a8c5c760 2024-09-19T09:00:23.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.628+0000 7fdf5dffb640 1 -- 172.21.15.92:0/3722954539 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fdf68014db0 con 0x55b1a8c5c760 2024-09-19T09:00:23.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.628+0000 7fdf7ed6b740 1 -- 172.21.15.92:0/3722954539 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf6c045040 con 0x55b1a8c5c760 2024-09-19T09:00:23.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.628+0000 7fdf5dffb640 1 -- 172.21.15.92:0/3722954539 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fdf6800d950 con 0x55b1a8c5c760 2024-09-19T09:00:23.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.628+0000 7fdf7ed6b740 10 client.25676 fetch_fsmap learned FSMap version 19 2024-09-19T09:00:23.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.628+0000 7fdf7ed6b740 1 -- 172.21.15.92:0/3722954539 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55b1a8ce2800 con 0x55b1a8c5c760 2024-09-19T09:00:23.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.628+0000 7fdf5dffb640 1 -- 172.21.15.92:0/3722954539 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf6c045040 con 0x55b1a8c5c760 2024-09-19T09:00:23.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.629+0000 7fdf5dffb640 1 -- 172.21.15.92:0/3722954539 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fdf68013070 con 0x55b1a8c5c760 2024-09-19T09:00:23.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.629+0000 7fdf7ed6b740 10 client.25676 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:00:23.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.629+0000 7fdf7ed6b740 10 client.25676 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:00:23.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.629+0000 7fdf7ed6b740 20 client.25676 populate_metadata read hostname 'smithi092' 2024-09-19T09:00:23.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.629+0000 7fdf7ed6b740 1 --2- 172.21.15.92:0/3722954539 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b1a8ce2e30 0x55b1a8ce5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:23.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.629+0000 7fdf7ed6b740 4 client.25676 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}] 2024-09-19T09:00:23.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.629+0000 7fdf7ed6b740 1 -- 172.21.15.92:0/3722954539 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}) -- 0x55b1a8bc9d20 con 0x55b1a8ce2e30 2024-09-19T09:00:23.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.629+0000 7fdf75d9b640 1 --2- 172.21.15.92:0/3722954539 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b1a8ce2e30 0x55b1a8ce5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:23.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.630+0000 7fdf5dffb640 10 client.25676 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:23.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.630+0000 7fdf75d9b640 1 --2- 172.21.15.92:0/3722954539 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b1a8ce2e30 0x55b1a8ce5250 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b242bf3c2f29bf62 server_cookie=f314357b1b393207 in_seq=0 out_seq=0 2024-09-19T09:00:23.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:23 smithi167 ceph-mon[35359]: pgmap v447: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 10 MiB/s wr, 890 op/s 2024-09-19T09:00:23.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:23 smithi190 ceph-mon[35358]: pgmap v447: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 10 MiB/s wr, 890 op/s 2024-09-19T09:00:23.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.936+0000 7fdf5dffb640 1 -- 172.21.15.92:0/3722954539 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55b1a8bc9d20 con 0x55b1a8ce2e30 2024-09-19T09:00:23.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.936+0000 7fdf5dffb640 10 client.25676 handle_command_reply: tid=0 2024-09-19T09:00:23.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.936+0000 7fdf7ed6b740 1 client.25676 shutdown 2024-09-19T09:00:23.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.936+0000 7fdf7ed6b740 1 -- 172.21.15.92:0/3722954539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1a8c5c760 msgr2=0x55b1a8c70000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:23.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.936+0000 7fdf7ed6b740 1 --2- 172.21.15.92:0/3722954539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1a8c5c760 0x55b1a8c70000 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdf6800b140 tx=0x7fdf6800b170 comp rx=0 tx=0).stop 2024-09-19T09:00:23.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.936+0000 7fdf7ed6b740 1 -- 172.21.15.92:0/3722954539 shutdown_connections 2024-09-19T09:00:23.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.936+0000 7fdf7ed6b740 1 --2- 172.21.15.92:0/3722954539 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b1a8ce2e30 0x55b1a8ce5250 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:23.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.936+0000 7fdf7ed6b740 1 --2- 172.21.15.92:0/3722954539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1a8c67940 0x55b1a8c6b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:23.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.937+0000 7fdf7ed6b740 1 --2- 172.21.15.92:0/3722954539 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b1a8c5d080 0x55b1a8c6b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:23.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.937+0000 7fdf7ed6b740 1 --2- 172.21.15.92:0/3722954539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1a8c5c760 0x55b1a8c70000 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:23.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.937+0000 7fdf5dffb640 0 client.25676 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:23.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.937+0000 7fdf7ed6b740 1 -- 172.21.15.92:0/3722954539 >> 172.21.15.92:0/3722954539 conn(0x55b1a8c58cf0 msgr2=0x55b1a8c66000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:23.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.937+0000 7fdf7ed6b740 1 -- 172.21.15.92:0/3722954539 shutdown_connections 2024-09-19T09:00:23.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.937+0000 7fdf7ed6b740 1 -- 172.21.15.92:0/3722954539 wait complete. 2024-09-19T09:00:23.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.937+0000 7fdf7ed6b740 20 client.25676 trim_cache size 0 max 16384 2024-09-19T09:00:23.940 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:00:23.940 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 19, 2024-09-19T09:00:23.940 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24472, 2024-09-19T09:00:23.940 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 18, 2024-09-19T09:00:23.940 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-09-19T09:00:23.940 INFO:teuthology.orchestra.run.smithi092.stdout: "268050b0": { 2024-09-19T09:00:23.940 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 18, 2024-09-19T09:00:23.940 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-09-19T09:00:23.940 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:00:23.940 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-09-19T09:00:23.940 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:00:23.940 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:00:23.941 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 90.0, 2024-09-19T09:00:23.941 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 149.8, 2024-09-19T09:00:23.941 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-09-19T09:00:23.941 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-09-19T09:00:23.941 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-09-19T09:00:23.941 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:00:23.941 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-09-19T09:00:23.941 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:00:23.941 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:00:23.941 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:00:23.941 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:00:23.941 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:00:23.941 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:00:23.941 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:00:23.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.937+0000 7fdf7c992640 1 -- 172.21.15.92:0/97396539 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdf600a3300 msgr2=0x7fdf600a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:23.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.937+0000 7fdf7c992640 1 --2- 172.21.15.92:0/97396539 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdf600a3300 0x7fdf600a57c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x55b1a8c5a070 tx=0x7fdf6c02a360 comp rx=0 tx=0).stop 2024-09-19T09:00:23.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.937+0000 7fdf7c992640 1 -- 172.21.15.92:0/97396539 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf781098a0 msgr2=0x7fdf78080310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:23.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.937+0000 7fdf7c992640 1 --2- 172.21.15.92:0/97396539 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf781098a0 0x7fdf78080310 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdf7000ed70 tx=0x7fdf7000c6e0 comp rx=0 tx=0).stop 2024-09-19T09:00:23.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.937+0000 7fdf7c992640 1 -- 172.21.15.92:0/97396539 shutdown_connections 2024-09-19T09:00:23.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.937+0000 7fdf7c992640 1 --2- 172.21.15.92:0/97396539 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf781098a0 0x7fdf78080310 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:23.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.937+0000 7fdf7c992640 1 --2- 172.21.15.92:0/97396539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf78074c90 0x7fdf7807fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:23.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.937+0000 7fdf7c992640 1 --2- 172.21.15.92:0/97396539 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdf600a3300 0x7fdf600a57c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:23.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.937+0000 7fdf7c992640 1 --2- 172.21.15.92:0/97396539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf780742d0 0x7fdf78084d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:23.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.937+0000 7fdf7c992640 1 -- 172.21.15.92:0/97396539 >> 172.21.15.92:0/97396539 conn(0x7fdf7806e140 msgr2=0x7fdf7810a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:23.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.937+0000 7fdf7c992640 1 -- 172.21.15.92:0/97396539 shutdown_connections 2024-09-19T09:00:23.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:23.937+0000 7fdf7c992640 1 -- 172.21.15.92:0/97396539 wait complete. 2024-09-19T09:00:24.652 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '268050b0', quiesce took 4.6 seconds. Will release after: 25.200000000000003 2024-09-19T09:00:25.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:25 smithi092 ceph-mon[31407]: pgmap v448: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 12 MiB/s wr, 965 op/s 2024-09-19T09:00:25.796 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 220.0 s, 2952.9 tps, lat 19.975 ms stddev 21.444 2024-09-19T09:00:25.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:25 smithi167 ceph-mon[35359]: pgmap v448: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 12 MiB/s wr, 965 op/s 2024-09-19T09:00:25.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:25 smithi190 ceph-mon[35358]: pgmap v448: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 12 MiB/s wr, 965 op/s 2024-09-19T09:00:27.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:27 smithi092 ceph-mon[31407]: pgmap v449: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 11 MiB/s wr, 872 op/s 2024-09-19T09:00:27.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:27 smithi167 ceph-mon[35359]: pgmap v449: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 11 MiB/s wr, 872 op/s 2024-09-19T09:00:27.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:27 smithi190 ceph-mon[35358]: pgmap v449: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 11 MiB/s wr, 872 op/s 2024-09-19T09:00:29.224 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.221+0000 7f5ba05d6640 1 -- 172.21.15.92:0/3057405732 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b98100a50 msgr2=0x7f5b98100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:29.224 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.221+0000 7f5ba05d6640 1 --2- 172.21.15.92:0/3057405732 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b98100a50 0x7f5b98100e50 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5b94009900 tx=0x7f5b9402a410 comp rx=0 tx=0).stop 2024-09-19T09:00:29.224 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.221+0000 7f5ba05d6640 1 -- 172.21.15.92:0/3057405732 shutdown_connections 2024-09-19T09:00:29.224 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.221+0000 7f5ba05d6640 1 --2- 172.21.15.92:0/3057405732 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5b98102600 0x7f5b98108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.224 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.221+0000 7f5ba05d6640 1 --2- 172.21.15.92:0/3057405732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b98101c40 0x7f5b981020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.224 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.221+0000 7f5ba05d6640 1 --2- 172.21.15.92:0/3057405732 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b98100a50 0x7f5b98100e50 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.224 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.221+0000 7f5ba05d6640 1 -- 172.21.15.92:0/3057405732 >> 172.21.15.92:0/3057405732 conn(0x7f5b980fc1b0 msgr2=0x7f5b980fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:29.224 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.221+0000 7f5ba05d6640 1 -- 172.21.15.92:0/3057405732 shutdown_connections 2024-09-19T09:00:29.224 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.221+0000 7f5ba05d6640 1 -- 172.21.15.92:0/3057405732 wait complete. 2024-09-19T09:00:29.224 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.222+0000 7f5ba05d6640 1 Processor -- start 2024-09-19T09:00:29.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.222+0000 7f5ba05d6640 1 -- start start 2024-09-19T09:00:29.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.222+0000 7f5ba05d6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5b98100a50 0x7f5b98197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:29.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.222+0000 7f5ba05d6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b98101c40 0x7f5b98198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:29.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.222+0000 7f5ba05d6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b98102600 0x7f5b9819f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:29.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.222+0000 7f5ba05d6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9810c6d0 con 0x7f5b98101c40 2024-09-19T09:00:29.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.222+0000 7f5ba05d6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9810c550 con 0x7f5b98102600 2024-09-19T09:00:29.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.222+0000 7f5ba05d6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9810c850 con 0x7f5b98100a50 2024-09-19T09:00:29.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.222+0000 7f5b9db71640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b98101c40 0x7f5b98198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:29.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.222+0000 7f5b9db71640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b98101c40 0x7f5b98198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54716/0 (socket says 172.21.15.92:54716) 2024-09-19T09:00:29.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.222+0000 7f5b9db71640 1 -- 172.21.15.92:0/1498064770 learned_addr learned my addr 172.21.15.92:0/1498064770 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:29.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.222+0000 7f5b9e372640 1 --2- 172.21.15.92:0/1498064770 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5b98100a50 0x7f5b98197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:29.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.223+0000 7f5b9eb73640 1 --2- 172.21.15.92:0/1498064770 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b98102600 0x7f5b9819f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:29.226 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.223+0000 7f5b9db71640 1 -- 172.21.15.92:0/1498064770 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5b98100a50 msgr2=0x7f5b98197dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:29.226 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.223+0000 7f5b9db71640 1 --2- 172.21.15.92:0/1498064770 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5b98100a50 0x7f5b98197dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.226 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.223+0000 7f5b9db71640 1 -- 172.21.15.92:0/1498064770 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b98102600 msgr2=0x7f5b9819f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:29.226 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.223+0000 7f5b9db71640 1 --2- 172.21.15.92:0/1498064770 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b98102600 0x7f5b9819f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.226 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.223+0000 7f5b9db71640 1 -- 172.21.15.92:0/1498064770 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b9819f9e0 con 0x7f5b98101c40 2024-09-19T09:00:29.226 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.223+0000 7f5b9db71640 1 --2- 172.21.15.92:0/1498064770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b98101c40 0x7f5b98198300 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c00d950 tx=0x7f5b8c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:29.226 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.223+0000 7f5b8b7fe640 1 -- 172.21.15.92:0/1498064770 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c017070 con 0x7f5b98101c40 2024-09-19T09:00:29.226 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.223+0000 7f5b8b7fe640 1 -- 172.21.15.92:0/1498064770 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b8c009c30 con 0x7f5b98101c40 2024-09-19T09:00:29.226 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.223+0000 7f5ba05d6640 1 -- 172.21.15.92:0/1498064770 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b9819fcd0 con 0x7f5b98101c40 2024-09-19T09:00:29.226 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.223+0000 7f5b8b7fe640 1 -- 172.21.15.92:0/1498064770 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c00f6b0 con 0x7f5b98101c40 2024-09-19T09:00:29.226 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.223+0000 7f5ba05d6640 1 -- 172.21.15.92:0/1498064770 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b981a01d0 con 0x7f5b98101c40 2024-09-19T09:00:29.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.226+0000 7f5ba3453740 1 Processor -- start 2024-09-19T09:00:29.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.226+0000 7f5b8b7fe640 1 -- 172.21.15.92:0/1498064770 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5b8c0109d0 con 0x7f5b98101c40 2024-09-19T09:00:29.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.227+0000 7f5ba3453740 1 -- start start 2024-09-19T09:00:29.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.227+0000 7f5ba3453740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561522b00db0 0x561522b011b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:29.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.227+0000 7f5ba3453740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561522b016f0 0x561522b061b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:29.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.227+0000 7f5ba3453740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561522b06780 0x561522b08c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:29.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.227+0000 7f5ba3453740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561522a602f0 con 0x561522b00db0 2024-09-19T09:00:29.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.227+0000 7f5ba3453740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561522a08270 con 0x561522b06780 2024-09-19T09:00:29.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.227+0000 7f5ba3453740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x561522a5c2b0 con 0x561522b016f0 2024-09-19T09:00:29.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.227+0000 7f5b9eb73640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561522b00db0 0x561522b011b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:29.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.227+0000 7f5b9eb73640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561522b00db0 0x561522b011b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54730/0 (socket says 172.21.15.92:54730) 2024-09-19T09:00:29.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.227+0000 7f5b9eb73640 1 -- 172.21.15.92:0/1513703905 learned_addr learned my addr 172.21.15.92:0/1513703905 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:29.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.227+0000 7f5b9e372640 1 --2- 172.21.15.92:0/1513703905 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561522b016f0 0x561522b061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:29.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.227+0000 7f5b9db71640 1 --2- 172.21.15.92:0/1513703905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561522b06780 0x561522b08c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:29.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.227+0000 7f5b8b7fe640 1 --2- 172.21.15.92:0/1498064770 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5b840a32f0 0x7f5b840a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:29.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.227+0000 7f5b9eb73640 1 -- 172.21.15.92:0/1513703905 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561522b016f0 msgr2=0x561522b061b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:29.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.227+0000 7f5b9eb73640 1 --2- 172.21.15.92:0/1513703905 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561522b016f0 0x561522b061b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.227+0000 7f5b9eb73640 1 -- 172.21.15.92:0/1513703905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561522b06780 msgr2=0x561522b08c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:29.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.227+0000 7f5b9eb73640 1 --2- 172.21.15.92:0/1513703905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561522b06780 0x561522b08c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.227+0000 7f5b9eb73640 1 -- 172.21.15.92:0/1513703905 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561522a07340 con 0x561522b00db0 2024-09-19T09:00:29.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.227+0000 7f5b9e372640 1 --2- 172.21.15.92:0/1513703905 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561522b016f0 0x561522b061b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:29.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.227+0000 7f5b8b7fe640 1 -- 172.21.15.92:0/1498064770 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f5b8c0cf560 con 0x7f5b98101c40 2024-09-19T09:00:29.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.228+0000 7f5b9eb73640 1 --2- 172.21.15.92:0/1498064770 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5b840a32f0 0x7f5b840a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:29.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.228+0000 7f5b9eb73640 1 --2- 172.21.15.92:0/1513703905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561522b00db0 0x561522b011b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f5b90008dc0 tx=0x7f5b9000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd5cd02ddb990f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:29.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.228+0000 7f5b88bfe640 1 -- 172.21.15.92:0/1513703905 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b90020070 con 0x561522b00db0 2024-09-19T09:00:29.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.228+0000 7f5b88bfe640 1 -- 172.21.15.92:0/1513703905 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b9000f3c0 con 0x561522b00db0 2024-09-19T09:00:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.228+0000 7f5b88bfe640 1 -- 172.21.15.92:0/1513703905 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b90014070 con 0x561522b00db0 2024-09-19T09:00:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.229+0000 7f5ba3453740 1 -- 172.21.15.92:0/1513703905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561522b00db0 msgr2=0x561522b011b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.229+0000 7f5b9eb73640 1 --2- 172.21.15.92:0/1498064770 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5b840a32f0 0x7f5b840a57b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5b9001d000 tx=0x7f5b90020000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.229+0000 7f5ba3453740 1 --2- 172.21.15.92:0/1513703905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561522b00db0 0x561522b011b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f5b90008dc0 tx=0x7f5b9000e720 comp rx=0 tx=0).stop 2024-09-19T09:00:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.229+0000 7f5ba3453740 1 -- 172.21.15.92:0/1513703905 shutdown_connections 2024-09-19T09:00:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.229+0000 7f5ba3453740 1 --2- 172.21.15.92:0/1513703905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561522b06780 0x561522b08c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.229+0000 7f5ba3453740 1 --2- 172.21.15.92:0/1513703905 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561522b016f0 0x561522b061b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.229+0000 7f5ba3453740 1 --2- 172.21.15.92:0/1513703905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561522b00db0 0x561522b011b0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.229+0000 7f5ba3453740 1 -- 172.21.15.92:0/1513703905 >> 172.21.15.92:0/1513703905 conn(0x561522af8010 msgr2=0x561522af8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.229+0000 7f5ba3453740 1 -- 172.21.15.92:0/1513703905 shutdown_connections 2024-09-19T09:00:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.229+0000 7f5ba3453740 1 -- 172.21.15.92:0/1513703905 wait complete. 2024-09-19T09:00:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.229+0000 7f5ba3453740 1 -- start start 2024-09-19T09:00:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.229+0000 7f5ba3453740 1 Processor -- start 2024-09-19T09:00:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.229+0000 7f5ba3453740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561522b00db0 0x561522b0b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.229+0000 7f5ba3453740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561522b016f0 0x561522b0b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.229+0000 7f5ba3453740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561522b06780 0x561522b12580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.229+0000 7f5ba3453740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561522b09750 con 0x561522b06780 2024-09-19T09:00:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.229+0000 7f5ba3453740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5615229e9290 con 0x561522b016f0 2024-09-19T09:00:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.229+0000 7f5ba3453740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x561522b098d0 con 0x561522b00db0 2024-09-19T09:00:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.229+0000 7f5ba3453740 10 client.0 _ll_register_callbacks cb 0x561522a1a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.229+0000 7f5b9eb73640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561522b06780 0x561522b12580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.230+0000 7f5b9db71640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561522b016f0 0x561522b0b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.230+0000 7f5b9eb73640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561522b06780 0x561522b12580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54738/0 (socket says 172.21.15.92:54738) 2024-09-19T09:00:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.230+0000 7f5b9eb73640 1 -- 172.21.15.92:0/2340326924 learned_addr learned my addr 172.21.15.92:0/2340326924 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.230+0000 7f5b9e372640 1 --2- 172.21.15.92:0/2340326924 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561522b00db0 0x561522b0b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.230+0000 7f5b9eb73640 1 -- 172.21.15.92:0/2340326924 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561522b00db0 msgr2=0x561522b0b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.230+0000 7f5b9eb73640 1 --2- 172.21.15.92:0/2340326924 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561522b00db0 0x561522b0b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.230+0000 7f5b9eb73640 1 -- 172.21.15.92:0/2340326924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561522b016f0 msgr2=0x561522b0b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.230+0000 7f5b9eb73640 1 --2- 172.21.15.92:0/2340326924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561522b016f0 0x561522b0b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.230+0000 7f5b9eb73640 1 -- 172.21.15.92:0/2340326924 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561522773210 con 0x561522b06780 2024-09-19T09:00:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.230+0000 7f5b9eb73640 1 --2- 172.21.15.92:0/2340326924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561522b06780 0x561522b12580 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f5b9000f7d0 tx=0x7f5b9000f800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47afdf4fb81d8b9c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.230+0000 7f5b81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:00:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.230+0000 7f5b81ffb640 1 -- 172.21.15.92:0/2340326924 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b90033060 con 0x561522b06780 2024-09-19T09:00:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.230+0000 7f5b81ffb640 1 -- 172.21.15.92:0/2340326924 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f5b9001adf0 con 0x561522b06780 2024-09-19T09:00:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.230+0000 7f5ba3453740 1 -- 172.21.15.92:0/2340326924 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b9000f3c0 con 0x561522b06780 2024-09-19T09:00:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.230+0000 7f5b81ffb640 1 -- 172.21.15.92:0/2340326924 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f5b90014040 con 0x561522b06780 2024-09-19T09:00:29.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.230+0000 7f5ba3453740 10 client.16230 fetch_fsmap learned FSMap version 19 2024-09-19T09:00:29.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.230+0000 7f5ba3453740 1 -- 172.21.15.92:0/2340326924 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56152283f620 con 0x561522b06780 2024-09-19T09:00:29.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.231+0000 7f5b81ffb640 1 -- 172.21.15.92:0/2340326924 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b9000f3c0 con 0x561522b06780 2024-09-19T09:00:29.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.231+0000 7f5b81ffb640 1 -- 172.21.15.92:0/2340326924 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f5b90038070 con 0x561522b06780 2024-09-19T09:00:29.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.231+0000 7f5ba3453740 10 client.16230 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:00:29.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.231+0000 7f5ba3453740 10 client.16230 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:00:29.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.231+0000 7f5ba3453740 20 client.16230 populate_metadata read hostname 'smithi092' 2024-09-19T09:00:29.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.231+0000 7f5ba3453740 1 --2- 172.21.15.92:0/2340326924 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561522b16aa0 0x561522b18e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:29.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.231+0000 7f5ba3453740 4 client.16230 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:00:29.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.231+0000 7f5ba3453740 1 -- 172.21.15.92:0/2340326924 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561522a6da20 con 0x561522b16aa0 2024-09-19T09:00:29.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.231+0000 7f5b9e372640 1 --2- 172.21.15.92:0/2340326924 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561522b16aa0 0x561522b18e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:29.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.231+0000 7f5b81ffb640 10 client.16230 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:29.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.231+0000 7f5b9e372640 1 --2- 172.21.15.92:0/2340326924 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561522b16aa0 0x561522b18e90 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9bf69e3c48765b1 server_cookie=69b2731cde7f13c in_seq=0 out_seq=0 2024-09-19T09:00:29.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.232+0000 7f5b81ffb640 1 -- 172.21.15.92:0/2340326924 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561522a6da20 con 0x561522b16aa0 2024-09-19T09:00:29.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.232+0000 7f5b81ffb640 10 client.16230 handle_command_reply: tid=0 2024-09-19T09:00:29.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.232+0000 7f5ba3453740 1 client.16230 shutdown 2024-09-19T09:00:29.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.232+0000 7f5ba3453740 1 -- 172.21.15.92:0/2340326924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561522b06780 msgr2=0x561522b12580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:29.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.232+0000 7f5ba3453740 1 --2- 172.21.15.92:0/2340326924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561522b06780 0x561522b12580 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f5b9000f7d0 tx=0x7f5b9000f800 comp rx=0 tx=0).stop 2024-09-19T09:00:29.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.232+0000 7f5ba3453740 1 -- 172.21.15.92:0/2340326924 shutdown_connections 2024-09-19T09:00:29.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.232+0000 7f5ba3453740 1 --2- 172.21.15.92:0/2340326924 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561522b16aa0 0x561522b18e90 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.232+0000 7f5ba3453740 1 --2- 172.21.15.92:0/2340326924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561522b06780 0x561522b12580 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.232+0000 7f5ba3453740 1 --2- 172.21.15.92:0/2340326924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561522b016f0 0x561522b0b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.232+0000 7f5b81ffb640 0 client.16230 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:29.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.232+0000 7f5ba3453740 1 --2- 172.21.15.92:0/2340326924 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561522b00db0 0x561522b0b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.232+0000 7f5ba3453740 1 -- 172.21.15.92:0/2340326924 >> 172.21.15.92:0/2340326924 conn(0x561522af8010 msgr2=0x561522af9820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:29.240 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.232+0000 7f5ba3453740 1 -- 172.21.15.92:0/2340326924 shutdown_connections 2024-09-19T09:00:29.240 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.232+0000 7f5ba3453740 1 -- 172.21.15.92:0/2340326924 wait complete. 2024-09-19T09:00:29.240 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.233+0000 7f5ba3453740 20 client.16230 trim_cache size 0 max 16384 2024-09-19T09:00:29.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.246+0000 7f5ba3453740 1 Processor -- start 2024-09-19T09:00:29.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.247+0000 7f5ba3453740 1 -- start start 2024-09-19T09:00:29.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.247+0000 7f5ba3453740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561522b00db0 0x561522af70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:29.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.247+0000 7f5ba3453740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561522b016f0 0x561522b12540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:29.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.247+0000 7f5ba3453740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561522b06780 0x561522af9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:29.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.247+0000 7f5ba3453740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5b981a4de0 con 0x561522b00db0 2024-09-19T09:00:29.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.247+0000 7f5ba3453740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5b981a7680 con 0x561522b016f0 2024-09-19T09:00:29.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.247+0000 7f5ba3453740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5b981a5470 con 0x561522b06780 2024-09-19T09:00:29.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.247+0000 7f5b9e372640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561522b00db0 0x561522af70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:29.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.247+0000 7f5b9e372640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561522b00db0 0x561522af70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54750/0 (socket says 172.21.15.92:54750) 2024-09-19T09:00:29.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.247+0000 7f5b9e372640 1 -- 172.21.15.92:0/2601524085 learned_addr learned my addr 172.21.15.92:0/2601524085 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:29.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.247+0000 7f5b9e372640 1 -- 172.21.15.92:0/2601524085 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561522b06780 msgr2=0x561522af9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:29.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.247+0000 7f5b9e372640 1 --2- 172.21.15.92:0/2601524085 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561522b06780 0x561522af9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.247+0000 7f5b9e372640 1 -- 172.21.15.92:0/2601524085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561522b016f0 msgr2=0x561522b12540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:29.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.247+0000 7f5b9e372640 1 --2- 172.21.15.92:0/2601524085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561522b016f0 0x561522b12540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.247+0000 7f5b9e372640 1 -- 172.21.15.92:0/2601524085 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561522af7e30 con 0x561522b00db0 2024-09-19T09:00:29.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.247+0000 7f5b9e372640 1 --2- 172.21.15.92:0/2601524085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561522b00db0 0x561522af70b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5b940314e0 tx=0x7f5b94000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fc92b51e1534706 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:29.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.247+0000 7f5b83fff640 1 -- 172.21.15.92:0/2601524085 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9404a070 con 0x561522b00db0 2024-09-19T09:00:29.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.247+0000 7f5b83fff640 1 -- 172.21.15.92:0/2601524085 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b94005520 con 0x561522b00db0 2024-09-19T09:00:29.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.247+0000 7f5b83fff640 1 -- 172.21.15.92:0/2601524085 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b94035040 con 0x561522b00db0 2024-09-19T09:00:29.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.248+0000 7f5ba3453740 1 -- 172.21.15.92:0/2601524085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561522b00db0 msgr2=0x561522af70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:29.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.248+0000 7f5ba3453740 1 --2- 172.21.15.92:0/2601524085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561522b00db0 0x561522af70b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5b940314e0 tx=0x7f5b94000bc0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.248+0000 7f5ba3453740 1 -- 172.21.15.92:0/2601524085 shutdown_connections 2024-09-19T09:00:29.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.248+0000 7f5ba3453740 1 --2- 172.21.15.92:0/2601524085 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561522b06780 0x561522af9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.248+0000 7f5ba3453740 1 --2- 172.21.15.92:0/2601524085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561522b016f0 0x561522b12540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.248+0000 7f5ba3453740 1 --2- 172.21.15.92:0/2601524085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561522b00db0 0x561522af70b0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.248+0000 7f5ba3453740 1 -- 172.21.15.92:0/2601524085 >> 172.21.15.92:0/2601524085 conn(0x561522af8010 msgr2=0x561522af69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:29.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.248+0000 7f5ba3453740 1 -- 172.21.15.92:0/2601524085 shutdown_connections 2024-09-19T09:00:29.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.248+0000 7f5ba3453740 1 -- 172.21.15.92:0/2601524085 wait complete. 2024-09-19T09:00:29.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.248+0000 7f5ba3453740 1 -- start start 2024-09-19T09:00:29.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.248+0000 7f5ba3453740 1 Processor -- start 2024-09-19T09:00:29.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.248+0000 7f5ba3453740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561522b00db0 0x561522b0fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:29.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.248+0000 7f5ba3453740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561522b016f0 0x561522b10210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:29.254 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.248+0000 7f5ba3453740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561522b06780 0x561522b11220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:29.254 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.248+0000 7f5ba3453740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5b981a5b40 con 0x561522b00db0 2024-09-19T09:00:29.254 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.248+0000 7f5ba3453740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5b981a6fb0 con 0x561522b06780 2024-09-19T09:00:29.254 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.248+0000 7f5ba3453740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5b981a6210 con 0x561522b016f0 2024-09-19T09:00:29.254 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.249+0000 7f5ba3453740 10 client.0 _ll_register_callbacks cb 0x7f5b9001e070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:29.254 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.249+0000 7f5b9e372640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561522b00db0 0x561522b0fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:29.254 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.249+0000 7f5b9e372640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561522b00db0 0x561522b0fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54760/0 (socket says 172.21.15.92:54760) 2024-09-19T09:00:29.254 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.249+0000 7f5b9e372640 1 -- 172.21.15.92:0/1908062389 learned_addr learned my addr 172.21.15.92:0/1908062389 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:29.254 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.249+0000 7f5b9eb73640 1 --2- 172.21.15.92:0/1908062389 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561522b06780 0x561522b11220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:29.254 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.249+0000 7f5b9db71640 1 --2- 172.21.15.92:0/1908062389 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561522b016f0 0x561522b10210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:29.254 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.249+0000 7f5b9e372640 1 -- 172.21.15.92:0/1908062389 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561522b016f0 msgr2=0x561522b10210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:29.254 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.249+0000 7f5b9e372640 1 --2- 172.21.15.92:0/1908062389 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561522b016f0 0x561522b10210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.254 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.249+0000 7f5b9e372640 1 -- 172.21.15.92:0/1908062389 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561522b06780 msgr2=0x561522b11220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:29.255 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.249+0000 7f5b9e372640 1 --2- 172.21.15.92:0/1908062389 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561522b06780 0x561522b11220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.255 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.249+0000 7f5b9e372640 1 -- 172.21.15.92:0/1908062389 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561522b11830 con 0x561522b00db0 2024-09-19T09:00:29.255 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.249+0000 7f5b9db71640 1 --2- 172.21.15.92:0/1908062389 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561522b016f0 0x561522b10210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:00:29.255 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.249+0000 7f5b9eb73640 1 --2- 172.21.15.92:0/1908062389 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561522b06780 0x561522b11220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:00:29.255 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.249+0000 7f5b9e372640 1 --2- 172.21.15.92:0/1908062389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561522b00db0 0x561522b0fcd0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5b94009850 tx=0x7f5b94005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=187547551567784f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:29.255 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.249+0000 7f5b81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:00:29.255 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.249+0000 7f5b81ffb640 1 -- 172.21.15.92:0/1908062389 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9404a040 con 0x561522b00db0 2024-09-19T09:00:29.255 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.249+0000 7f5b81ffb640 1 -- 172.21.15.92:0/1908062389 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f5b94004c30 con 0x561522b00db0 2024-09-19T09:00:29.255 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.249+0000 7f5ba3453740 1 -- 172.21.15.92:0/1908062389 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b94005520 con 0x561522b00db0 2024-09-19T09:00:29.255 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.249+0000 7f5b81ffb640 1 -- 172.21.15.92:0/1908062389 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f5b94035040 con 0x561522b00db0 2024-09-19T09:00:29.255 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.249+0000 7f5ba3453740 10 client.16236 fetch_fsmap learned FSMap version 19 2024-09-19T09:00:29.255 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.249+0000 7f5ba3453740 1 -- 172.21.15.92:0/1908062389 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x561522b817e0 con 0x561522b00db0 2024-09-19T09:00:29.255 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.250+0000 7f5b81ffb640 1 -- 172.21.15.92:0/1908062389 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b94005520 con 0x561522b00db0 2024-09-19T09:00:29.255 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.250+0000 7f5b81ffb640 1 -- 172.21.15.92:0/1908062389 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f5b94056030 con 0x561522b00db0 2024-09-19T09:00:29.256 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.250+0000 7f5ba3453740 10 client.16236 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:00:29.256 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.250+0000 7f5ba3453740 10 client.16236 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:00:29.256 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.250+0000 7f5ba3453740 20 client.16236 populate_metadata read hostname 'smithi092' 2024-09-19T09:00:29.256 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.250+0000 7f5ba3453740 1 --2- 172.21.15.92:0/1908062389 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561522b82190 0x561522b845b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:29.256 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.250+0000 7f5ba3453740 4 client.16236 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:00:29.256 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.250+0000 7f5ba3453740 1 -- 172.21.15.92:0/1908062389 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561522a67d70 con 0x561522b82190 2024-09-19T09:00:29.256 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.250+0000 7f5b9db71640 1 --2- 172.21.15.92:0/1908062389 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561522b82190 0x561522b845b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:29.256 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.250+0000 7f5b81ffb640 10 client.16236 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:29.256 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.250+0000 7f5b9db71640 1 --2- 172.21.15.92:0/1908062389 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561522b82190 0x561522b845b0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2358b85f1dfe9004 server_cookie=2195a9844b0231e7 in_seq=0 out_seq=0 2024-09-19T09:00:29.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.276+0000 7f5b81ffb640 1 -- 172.21.15.92:0/1908062389 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561522a67d70 con 0x561522b82190 2024-09-19T09:00:29.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.276+0000 7f5b81ffb640 10 client.16236 handle_command_reply: tid=0 2024-09-19T09:00:29.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.276+0000 7f5ba3453740 1 client.16236 shutdown 2024-09-19T09:00:29.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.276+0000 7f5ba3453740 1 -- 172.21.15.92:0/1908062389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561522b00db0 msgr2=0x561522b0fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:29.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.276+0000 7f5ba3453740 1 --2- 172.21.15.92:0/1908062389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561522b00db0 0x561522b0fcd0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5b94009850 tx=0x7f5b94005770 comp rx=0 tx=0).stop 2024-09-19T09:00:29.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.276+0000 7f5ba3453740 1 -- 172.21.15.92:0/1908062389 shutdown_connections 2024-09-19T09:00:29.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.276+0000 7f5ba3453740 1 --2- 172.21.15.92:0/1908062389 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561522b82190 0x561522b845b0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.276+0000 7f5ba3453740 1 --2- 172.21.15.92:0/1908062389 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561522b06780 0x561522b11220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.276+0000 7f5b81ffb640 0 client.16236 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:29.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.276+0000 7f5ba3453740 1 --2- 172.21.15.92:0/1908062389 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561522b016f0 0x561522b10210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.276+0000 7f5ba3453740 1 --2- 172.21.15.92:0/1908062389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561522b00db0 0x561522b0fcd0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.276+0000 7f5ba3453740 1 -- 172.21.15.92:0/1908062389 >> 172.21.15.92:0/1908062389 conn(0x561522af8010 msgr2=0x561522af71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:29.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.276+0000 7f5ba3453740 1 -- 172.21.15.92:0/1908062389 shutdown_connections 2024-09-19T09:00:29.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.276+0000 7f5ba3453740 1 -- 172.21.15.92:0/1908062389 wait complete. 2024-09-19T09:00:29.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.277+0000 7f5ba3453740 20 client.16236 trim_cache size 0 max 16384 2024-09-19T09:00:29.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:00:29.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:00:29.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:00:29.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:00:29.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.277+0000 7f5ba05d6640 1 -- 172.21.15.92:0/1498064770 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5b840a32f0 msgr2=0x7f5b840a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:29.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.277+0000 7f5ba05d6640 1 --2- 172.21.15.92:0/1498064770 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5b840a32f0 0x7f5b840a57b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5b9001d000 tx=0x7f5b90020000 comp rx=0 tx=0).stop 2024-09-19T09:00:29.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.277+0000 7f5ba05d6640 1 -- 172.21.15.92:0/1498064770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b98101c40 msgr2=0x7f5b98198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:29.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.277+0000 7f5ba05d6640 1 --2- 172.21.15.92:0/1498064770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b98101c40 0x7f5b98198300 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c00d950 tx=0x7f5b8c00de10 comp rx=0 tx=0).stop 2024-09-19T09:00:29.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.277+0000 7f5ba05d6640 1 -- 172.21.15.92:0/1498064770 shutdown_connections 2024-09-19T09:00:29.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.277+0000 7f5ba05d6640 1 --2- 172.21.15.92:0/1498064770 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b98102600 0x7f5b9819f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.277+0000 7f5ba05d6640 1 --2- 172.21.15.92:0/1498064770 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5b840a32f0 0x7f5b840a57b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.277+0000 7f5ba05d6640 1 --2- 172.21.15.92:0/1498064770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b98101c40 0x7f5b98198300 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.277+0000 7f5ba05d6640 1 --2- 172.21.15.92:0/1498064770 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5b98100a50 0x7f5b98197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.277+0000 7f5ba05d6640 1 -- 172.21.15.92:0/1498064770 >> 172.21.15.92:0/1498064770 conn(0x7f5b980fc1b0 msgr2=0x7f5b980fdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:29.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.277+0000 7f5ba05d6640 1 -- 172.21.15.92:0/1498064770 shutdown_connections 2024-09-19T09:00:29.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:29.277+0000 7f5ba05d6640 1 -- 172.21.15.92:0/1498064770 wait complete. 2024-09-19T09:00:29.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:29 smithi092 ceph-mon[31407]: pgmap v450: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 9.3 MiB/s wr, 768 op/s 2024-09-19T09:00:29.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:29 smithi167 ceph-mon[35359]: pgmap v450: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 9.3 MiB/s wr, 768 op/s 2024-09-19T09:00:29.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:29 smithi190 ceph-mon[35358]: pgmap v450: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 9.3 MiB/s wr, 768 op/s 2024-09-19T09:00:30.799 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:00:31.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:31 smithi092 ceph-mon[31407]: pgmap v451: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.5 MiB/s wr, 697 op/s 2024-09-19T09:00:31.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:31 smithi167 ceph-mon[35359]: pgmap v451: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.5 MiB/s wr, 697 op/s 2024-09-19T09:00:31.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:31 smithi190 ceph-mon[35358]: pgmap v451: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.5 MiB/s wr, 697 op/s 2024-09-19T09:00:33.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:33 smithi092 ceph-mon[31407]: pgmap v452: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.2 MiB/s wr, 509 op/s 2024-09-19T09:00:33.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:33 smithi167 ceph-mon[35359]: pgmap v452: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.2 MiB/s wr, 509 op/s 2024-09-19T09:00:33.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:33 smithi190 ceph-mon[35358]: pgmap v452: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.2 MiB/s wr, 509 op/s 2024-09-19T09:00:35.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:35 smithi092 ceph-mon[31407]: pgmap v453: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.3 MiB/s wr, 391 op/s 2024-09-19T09:00:35.799 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:00:35.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:35 smithi167 ceph-mon[35359]: pgmap v453: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.3 MiB/s wr, 391 op/s 2024-09-19T09:00:35.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:35 smithi190 ceph-mon[35358]: pgmap v453: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.3 MiB/s wr, 391 op/s 2024-09-19T09:00:37.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:37 smithi092 ceph-mon[31407]: pgmap v454: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.3 MiB/s wr, 226 op/s 2024-09-19T09:00:37.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:37 smithi167 ceph-mon[35359]: pgmap v454: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.3 MiB/s wr, 226 op/s 2024-09-19T09:00:37.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:37 smithi190 ceph-mon[35358]: pgmap v454: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.3 MiB/s wr, 226 op/s 2024-09-19T09:00:39.080 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:00:39.330 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:39.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:39 smithi092 ceph-mon[31407]: pgmap v455: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 1.7 MiB/s wr, 114 op/s 2024-09-19T09:00:39.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.767+0000 7f8ad5ff4640 1 -- 172.21.15.92:0/4035063830 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ad0100e20 msgr2=0x7f8ad0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:39.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.767+0000 7f8ad5ff4640 1 --2- 172.21.15.92:0/4035063830 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ad0100e20 0x7f8ad0101200 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0009900 tx=0x7f8ac002a480 comp rx=0 tx=0).stop 2024-09-19T09:00:39.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.768+0000 7f8ad5ff4640 1 -- 172.21.15.92:0/4035063830 shutdown_connections 2024-09-19T09:00:39.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.768+0000 7f8ad5ff4640 1 --2- 172.21.15.92:0/4035063830 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ad0102ef0 0x7f8ad010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:39.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.768+0000 7f8ad5ff4640 1 --2- 172.21.15.92:0/4035063830 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ad0102570 0x7f8ad01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:39.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.768+0000 7f8ad5ff4640 1 --2- 172.21.15.92:0/4035063830 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ad0100e20 0x7f8ad0101200 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:39.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.768+0000 7f8ad5ff4640 1 -- 172.21.15.92:0/4035063830 >> 172.21.15.92:0/4035063830 conn(0x7f8ad00fc7d0 msgr2=0x7f8ad00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:39.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.768+0000 7f8ad5ff4640 1 -- 172.21.15.92:0/4035063830 shutdown_connections 2024-09-19T09:00:39.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.768+0000 7f8ad5ff4640 1 -- 172.21.15.92:0/4035063830 wait complete. 2024-09-19T09:00:39.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.768+0000 7f8ad5ff4640 1 Processor -- start 2024-09-19T09:00:39.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.768+0000 7f8ad5ff4640 1 -- start start 2024-09-19T09:00:39.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.769+0000 7f8ad5ff4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ad0100e20 0x7f8ad00fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:39.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.769+0000 7f8ad5ff4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ad0102570 0x7f8ad00fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:39.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.769+0000 7f8ad5ff4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ad0102ef0 0x7f8ad00fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:39.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.769+0000 7f8ad5ff4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad0110fa0 con 0x7f8ad0102ef0 2024-09-19T09:00:39.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.769+0000 7f8ad5ff4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad0110e20 con 0x7f8ad0100e20 2024-09-19T09:00:39.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.769+0000 7f8ad5ff4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad0111120 con 0x7f8ad0102570 2024-09-19T09:00:39.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.769+0000 7f8acffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ad0102ef0 0x7f8ad00fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:39.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.769+0000 7f8acffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ad0102ef0 0x7f8ad00fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48248/0 (socket says 172.21.15.92:48248) 2024-09-19T09:00:39.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.769+0000 7f8acffff640 1 -- 172.21.15.92:0/1908592873 learned_addr learned my addr 172.21.15.92:0/1908592873 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:39.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.769+0000 7f8acf7fe640 1 --2- 172.21.15.92:0/1908592873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ad0100e20 0x7f8ad00fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:39.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.769+0000 7f8aceffd640 1 --2- 172.21.15.92:0/1908592873 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ad0102570 0x7f8ad00fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:39.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.769+0000 7f8acffff640 1 -- 172.21.15.92:0/1908592873 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ad0102570 msgr2=0x7f8ad00fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:39.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.769+0000 7f8acffff640 1 --2- 172.21.15.92:0/1908592873 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ad0102570 0x7f8ad00fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:39.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.769+0000 7f8acffff640 1 -- 172.21.15.92:0/1908592873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ad0100e20 msgr2=0x7f8ad00fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:39.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.769+0000 7f8acffff640 1 --2- 172.21.15.92:0/1908592873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ad0100e20 0x7f8ad00fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:39.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.769+0000 7f8acffff640 1 -- 172.21.15.92:0/1908592873 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad01a69f0 con 0x7f8ad0102ef0 2024-09-19T09:00:39.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.769+0000 7f8acffff640 1 --2- 172.21.15.92:0/1908592873 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ad0102ef0 0x7f8ad00fd700 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f8ac800b970 tx=0x7f8ac800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:39.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.769+0000 7f8accff9640 1 -- 172.21.15.92:0/1908592873 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac8019070 con 0x7f8ad0102ef0 2024-09-19T09:00:39.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.770+0000 7f8accff9640 1 -- 172.21.15.92:0/1908592873 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ac800cb40 con 0x7f8ad0102ef0 2024-09-19T09:00:39.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.770+0000 7f8accff9640 1 -- 172.21.15.92:0/1908592873 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac8007650 con 0x7f8ad0102ef0 2024-09-19T09:00:39.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.770+0000 7f8ad5ff4640 1 -- 172.21.15.92:0/1908592873 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ad01a6ce0 con 0x7f8ad0102ef0 2024-09-19T09:00:39.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.770+0000 7f8ad5ff4640 1 -- 172.21.15.92:0/1908592873 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ad01a7220 con 0x7f8ad0102ef0 2024-09-19T09:00:39.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.772+0000 7f8accff9640 1 -- 172.21.15.92:0/1908592873 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8ac801c070 con 0x7f8ad0102ef0 2024-09-19T09:00:39.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.772+0000 7f8ad83cd740 1 Processor -- start 2024-09-19T09:00:39.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.772+0000 7f8ad83cd740 1 -- start start 2024-09-19T09:00:39.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.772+0000 7f8ad83cd740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfc1ac84a0 0x55dfc1ac8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:39.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.772+0000 7f8ad83cd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dfc1ac8dc0 0x55dfc1ad3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:39.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.772+0000 7f8ad83cd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dfc1ad3680 0x55dfc1ad5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:39.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.773+0000 7f8ad83cd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55dfc1a2e2e0 con 0x55dfc1ad3680 2024-09-19T09:00:39.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.773+0000 7f8ad83cd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55dfc19d5ce0 con 0x55dfc1ac8dc0 2024-09-19T09:00:39.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.773+0000 7f8ad83cd740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55dfc1a2a2a0 con 0x55dfc1ac84a0 2024-09-19T09:00:39.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.773+0000 7f8aceffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dfc1ad3680 0x55dfc1ad5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:39.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.773+0000 7f8aceffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dfc1ad3680 0x55dfc1ad5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48264/0 (socket says 172.21.15.92:48264) 2024-09-19T09:00:39.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.773+0000 7f8aceffd640 1 -- 172.21.15.92:0/1287140093 learned_addr learned my addr 172.21.15.92:0/1287140093 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:39.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.773+0000 7f8acf7fe640 1 --2- 172.21.15.92:0/1287140093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dfc1ac8dc0 0x55dfc1ad3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:39.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.773+0000 7f8aceffd640 1 --2- 172.21.15.92:0/1287140093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfc1ac84a0 0x55dfc1ac8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:39.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.773+0000 7f8accff9640 1 --2- 172.21.15.92:0/1908592873 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8ab80a32c0 0x7f8ab80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:39.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.773+0000 7f8aceffd640 1 -- 172.21.15.92:0/1287140093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfc1ac84a0 msgr2=0x55dfc1ac8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:39.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.773+0000 7f8aceffd640 1 --2- 172.21.15.92:0/1287140093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfc1ac84a0 0x55dfc1ac8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:39.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.773+0000 7f8aceffd640 1 -- 172.21.15.92:0/1287140093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dfc1ac8dc0 msgr2=0x55dfc1ad3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:39.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.773+0000 7f8aceffd640 1 --2- 172.21.15.92:0/1287140093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dfc1ac8dc0 0x55dfc1ad3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:39.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.773+0000 7f8aceffd640 1 -- 172.21.15.92:0/1287140093 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfc19ba440 con 0x55dfc1ad3680 2024-09-19T09:00:39.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.773+0000 7f8acf7fe640 1 --2- 172.21.15.92:0/1287140093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dfc1ac8dc0 0x55dfc1ad3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:39.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.773+0000 7f8acffff640 1 --2- 172.21.15.92:0/1908592873 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8ab80a32c0 0x7f8ab80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:39.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.773+0000 7f8accff9640 1 -- 172.21.15.92:0/1908592873 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8ac80cee60 con 0x7f8ad0102ef0 2024-09-19T09:00:39.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.773+0000 7f8aceffd640 1 --2- 172.21.15.92:0/1287140093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dfc1ad3680 0x55dfc1ad5a70 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f8ac40127c0 tx=0x7f8ac400b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a065fe3c0e96e310 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:39.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.773+0000 7f8ab5ffb640 1 -- 172.21.15.92:0/1287140093 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac4012e00 con 0x55dfc1ad3680 2024-09-19T09:00:39.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.773+0000 7f8ab5ffb640 1 -- 172.21.15.92:0/1287140093 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ac4010c50 con 0x55dfc1ad3680 2024-09-19T09:00:39.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.773+0000 7f8ab5ffb640 1 -- 172.21.15.92:0/1287140093 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac401ebc0 con 0x55dfc1ad3680 2024-09-19T09:00:39.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.774+0000 7f8ad83cd740 1 -- 172.21.15.92:0/1287140093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dfc1ad3680 msgr2=0x55dfc1ad5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:39.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.774+0000 7f8acffff640 1 --2- 172.21.15.92:0/1908592873 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8ab80a32c0 0x7f8ab80a5780 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8097990 tx=0x7f8ac8090a10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:39.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.774+0000 7f8ad83cd740 1 --2- 172.21.15.92:0/1287140093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dfc1ad3680 0x55dfc1ad5a70 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f8ac40127c0 tx=0x7f8ac400b7c0 comp rx=0 tx=0).stop 2024-09-19T09:00:39.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.774+0000 7f8ad83cd740 1 -- 172.21.15.92:0/1287140093 shutdown_connections 2024-09-19T09:00:39.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.774+0000 7f8ad83cd740 1 --2- 172.21.15.92:0/1287140093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dfc1ad3680 0x55dfc1ad5a70 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:39.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.774+0000 7f8ad83cd740 1 --2- 172.21.15.92:0/1287140093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dfc1ac8dc0 0x55dfc1ad3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:39.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.774+0000 7f8ad83cd740 1 --2- 172.21.15.92:0/1287140093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfc1ac84a0 0x55dfc1ac8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:39.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.774+0000 7f8ad83cd740 1 -- 172.21.15.92:0/1287140093 >> 172.21.15.92:0/1287140093 conn(0x55dfc1ac4a30 msgr2=0x55dfc1ac4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:39.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.774+0000 7f8ad83cd740 1 -- 172.21.15.92:0/1287140093 shutdown_connections 2024-09-19T09:00:39.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.774+0000 7f8ad83cd740 1 -- 172.21.15.92:0/1287140093 wait complete. 2024-09-19T09:00:39.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.775+0000 7f8ad83cd740 1 -- start start 2024-09-19T09:00:39.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.775+0000 7f8ad83cd740 1 Processor -- start 2024-09-19T09:00:39.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.775+0000 7f8ad83cd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dfc1ac84a0 0x55dfc1ad2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:39.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.775+0000 7f8ad83cd740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfc1ac8dc0 0x55dfc1ad0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:39.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.775+0000 7f8ad83cd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dfc1ad3680 0x55dfc1ad0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:39.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.775+0000 7f8ad83cd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55dfc1ad6250 con 0x55dfc1ac84a0 2024-09-19T09:00:39.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.775+0000 7f8ad83cd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55dfc19e9050 con 0x55dfc1ad3680 2024-09-19T09:00:39.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.775+0000 7f8ad83cd740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55dfc1ad63d0 con 0x55dfc1ac8dc0 2024-09-19T09:00:39.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.775+0000 7f8ad83cd740 10 client.0 _ll_register_callbacks cb 0x55dfc1a29160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:39.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.775+0000 7f8aceffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dfc1ac84a0 0x55dfc1ad2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:39.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.775+0000 7f8aceffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dfc1ac84a0 0x55dfc1ad2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48276/0 (socket says 172.21.15.92:48276) 2024-09-19T09:00:39.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.775+0000 7f8aceffd640 1 -- 172.21.15.92:0/2098704277 learned_addr learned my addr 172.21.15.92:0/2098704277 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:39.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.775+0000 7f8aceffd640 1 -- 172.21.15.92:0/2098704277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfc1ac8dc0 msgr2=0x55dfc1ad0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:39.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.775+0000 7f8acf7fe640 1 --2- 172.21.15.92:0/2098704277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfc1ac8dc0 0x55dfc1ad0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:39.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.775+0000 7f8aceffd640 1 --2- 172.21.15.92:0/2098704277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfc1ac8dc0 0x55dfc1ad0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:39.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.775+0000 7f8aceffd640 1 -- 172.21.15.92:0/2098704277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dfc1ad3680 msgr2=0x55dfc1ad0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:39.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.775+0000 7f8aceffd640 1 --2- 172.21.15.92:0/2098704277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dfc1ad3680 0x55dfc1ad0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:39.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.775+0000 7f8aceffd640 1 -- 172.21.15.92:0/2098704277 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfc179f3c0 con 0x55dfc1ac84a0 2024-09-19T09:00:39.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.776+0000 7f8aceffd640 1 --2- 172.21.15.92:0/2098704277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dfc1ac84a0 0x55dfc1ad2f50 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f8ac401e8e0 tx=0x7f8ac401e540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7460d4b9310e7a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:39.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.776+0000 7f8aaeffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:00:39.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.776+0000 7f8aaeffd640 1 -- 172.21.15.92:0/2098704277 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac4010950 con 0x55dfc1ac84a0 2024-09-19T09:00:39.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.776+0000 7f8aaeffd640 1 -- 172.21.15.92:0/2098704277 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8ac401e980 con 0x55dfc1ac84a0 2024-09-19T09:00:39.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.776+0000 7f8ad83cd740 1 -- 172.21.15.92:0/2098704277 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ac4010c50 con 0x55dfc1ac84a0 2024-09-19T09:00:39.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.776+0000 7f8aaeffd640 1 -- 172.21.15.92:0/2098704277 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8ac401eb80 con 0x55dfc1ac84a0 2024-09-19T09:00:39.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.776+0000 7f8ad83cd740 10 client.16248 fetch_fsmap learned FSMap version 19 2024-09-19T09:00:39.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.776+0000 7f8ad83cd740 1 -- 172.21.15.92:0/2098704277 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55dfc1ae1ba0 con 0x55dfc1ac84a0 2024-09-19T09:00:39.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.776+0000 7f8aaeffd640 1 -- 172.21.15.92:0/2098704277 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ac4010c50 con 0x55dfc1ac84a0 2024-09-19T09:00:39.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.776+0000 7f8aaeffd640 1 -- 172.21.15.92:0/2098704277 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f8ac4004730 con 0x55dfc1ac84a0 2024-09-19T09:00:39.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.776+0000 7f8ad83cd740 10 client.16248 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:00:39.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.776+0000 7f8ad83cd740 10 client.16248 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:00:39.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.776+0000 7f8ad83cd740 20 client.16248 populate_metadata read hostname 'smithi092' 2024-09-19T09:00:39.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.776+0000 7f8ad83cd740 1 --2- 172.21.15.92:0/2098704277 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55dfc1ae2ef0 0x55dfc1ae52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:39.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.776+0000 7f8ad83cd740 4 client.16248 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:00:39.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.776+0000 7f8ad83cd740 1 -- 172.21.15.92:0/2098704277 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dfc1a3b850 con 0x55dfc1ae2ef0 2024-09-19T09:00:39.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.777+0000 7f8acf7fe640 1 --2- 172.21.15.92:0/2098704277 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55dfc1ae2ef0 0x55dfc1ae52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:39.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.777+0000 7f8aaeffd640 10 client.16248 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:39.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.777+0000 7f8acf7fe640 1 --2- 172.21.15.92:0/2098704277 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55dfc1ae2ef0 0x55dfc1ae52e0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98046df93590de19 server_cookie=6d357e2ff10ac224 in_seq=0 out_seq=0 2024-09-19T09:00:39.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.778+0000 7f8aaeffd640 1 -- 172.21.15.92:0/2098704277 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dfc1a3b850 con 0x55dfc1ae2ef0 2024-09-19T09:00:39.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.778+0000 7f8aaeffd640 10 client.16248 handle_command_reply: tid=0 2024-09-19T09:00:39.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.778+0000 7f8ad83cd740 1 client.16248 shutdown 2024-09-19T09:00:39.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.778+0000 7f8ad83cd740 1 -- 172.21.15.92:0/2098704277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dfc1ac84a0 msgr2=0x55dfc1ad2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:39.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.778+0000 7f8ad83cd740 1 --2- 172.21.15.92:0/2098704277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dfc1ac84a0 0x55dfc1ad2f50 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f8ac401e8e0 tx=0x7f8ac401e540 comp rx=0 tx=0).stop 2024-09-19T09:00:39.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.779+0000 7f8ad83cd740 1 -- 172.21.15.92:0/2098704277 shutdown_connections 2024-09-19T09:00:39.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.779+0000 7f8ad83cd740 1 --2- 172.21.15.92:0/2098704277 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55dfc1ae2ef0 0x55dfc1ae52e0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:39.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.779+0000 7f8ad83cd740 1 --2- 172.21.15.92:0/2098704277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dfc1ad3680 0x55dfc1ad0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:39.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.779+0000 7f8aaeffd640 0 client.16248 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:39.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.779+0000 7f8ad83cd740 1 --2- 172.21.15.92:0/2098704277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfc1ac8dc0 0x55dfc1ad0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:39.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.779+0000 7f8ad83cd740 1 --2- 172.21.15.92:0/2098704277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dfc1ac84a0 0x55dfc1ad2f50 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:39.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.779+0000 7f8ad83cd740 1 -- 172.21.15.92:0/2098704277 >> 172.21.15.92:0/2098704277 conn(0x55dfc1ac4a30 msgr2=0x55dfc1aca710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:39.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.779+0000 7f8ad83cd740 1 -- 172.21.15.92:0/2098704277 shutdown_connections 2024-09-19T09:00:39.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.779+0000 7f8ad83cd740 1 -- 172.21.15.92:0/2098704277 wait complete. 2024-09-19T09:00:39.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.779+0000 7f8ad83cd740 20 client.16248 trim_cache size 0 max 16384 2024-09-19T09:00:39.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.796+0000 7f8ad83cd740 1 Processor -- start 2024-09-19T09:00:39.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.796+0000 7f8ad83cd740 1 -- start start 2024-09-19T09:00:39.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.796+0000 7f8ad83cd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dfc1ac84a0 0x55dfc1adf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:39.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.796+0000 7f8ad83cd740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfc1ac8dc0 0x55dfc1aea9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:39.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.796+0000 7f8ad83cd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dfc1ad3680 0x55dfc1aeaf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:39.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.796+0000 7f8ad83cd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad01ad830 con 0x55dfc1ac84a0 2024-09-19T09:00:39.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.796+0000 7f8ad83cd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad01b00d0 con 0x55dfc1ad3680 2024-09-19T09:00:39.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.796+0000 7f8ad83cd740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad01adec0 con 0x55dfc1ac8dc0 2024-09-19T09:00:39.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.796+0000 7f8aceffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dfc1ac84a0 0x55dfc1adf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:39.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.796+0000 7f8aceffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dfc1ac84a0 0x55dfc1adf4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48284/0 (socket says 172.21.15.92:48284) 2024-09-19T09:00:39.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.796+0000 7f8aceffd640 1 -- 172.21.15.92:0/2416868321 learned_addr learned my addr 172.21.15.92:0/2416868321 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:39.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.796+0000 7f8acf7fe640 1 --2- 172.21.15.92:0/2416868321 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfc1ac8dc0 0x55dfc1aea9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:39.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.796+0000 7f8aceffd640 1 -- 172.21.15.92:0/2416868321 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfc1ac8dc0 msgr2=0x55dfc1aea9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:39.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.796+0000 7f8aceffd640 1 --2- 172.21.15.92:0/2416868321 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfc1ac8dc0 0x55dfc1aea9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:39.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.796+0000 7f8aceffd640 1 -- 172.21.15.92:0/2416868321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dfc1ad3680 msgr2=0x55dfc1aeaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:39.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.796+0000 7f8aceffd640 1 --2- 172.21.15.92:0/2416868321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dfc1ad3680 0x55dfc1aeaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:39.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.796+0000 7f8aceffd640 1 -- 172.21.15.92:0/2416868321 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfc1ac4860 con 0x55dfc1ac84a0 2024-09-19T09:00:39.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.796+0000 7f8aceffd640 1 --2- 172.21.15.92:0/2416868321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dfc1ac84a0 0x55dfc1adf4b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f8ac40058c0 tx=0x7f8ac4012780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2316ce095006d0e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:39.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.797+0000 7f8ab57fa640 1 -- 172.21.15.92:0/2416868321 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac4035070 con 0x55dfc1ac84a0 2024-09-19T09:00:39.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.797+0000 7f8ab57fa640 1 -- 172.21.15.92:0/2416868321 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ac4016030 con 0x55dfc1ac84a0 2024-09-19T09:00:39.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.797+0000 7f8ab57fa640 1 -- 172.21.15.92:0/2416868321 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac4010bb0 con 0x55dfc1ac84a0 2024-09-19T09:00:39.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.797+0000 7f8ad83cd740 1 -- 172.21.15.92:0/2416868321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dfc1ac84a0 msgr2=0x55dfc1adf4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:39.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.797+0000 7f8ad83cd740 1 --2- 172.21.15.92:0/2416868321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dfc1ac84a0 0x55dfc1adf4b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f8ac40058c0 tx=0x7f8ac4012780 comp rx=0 tx=0).stop 2024-09-19T09:00:39.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.797+0000 7f8ad83cd740 1 -- 172.21.15.92:0/2416868321 shutdown_connections 2024-09-19T09:00:39.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.797+0000 7f8ad83cd740 1 --2- 172.21.15.92:0/2416868321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dfc1ad3680 0x55dfc1aeaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:39.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.797+0000 7f8ad83cd740 1 --2- 172.21.15.92:0/2416868321 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfc1ac8dc0 0x55dfc1aea9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:39.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.797+0000 7f8ad83cd740 1 --2- 172.21.15.92:0/2416868321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dfc1ac84a0 0x55dfc1adf4b0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:39.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.797+0000 7f8ad83cd740 1 -- 172.21.15.92:0/2416868321 >> 172.21.15.92:0/2416868321 conn(0x55dfc1ac4a30 msgr2=0x55dfc1acb8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:39.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.797+0000 7f8ad83cd740 1 -- 172.21.15.92:0/2416868321 shutdown_connections 2024-09-19T09:00:39.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.797+0000 7f8ad83cd740 1 -- 172.21.15.92:0/2416868321 wait complete. 2024-09-19T09:00:39.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.798+0000 7f8ad83cd740 1 -- start start 2024-09-19T09:00:39.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.798+0000 7f8ad83cd740 1 Processor -- start 2024-09-19T09:00:39.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.798+0000 7f8ad83cd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dfc1ac84a0 0x55dfc1adbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:39.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.798+0000 7f8ad83cd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dfc1ac8dc0 0x55dfc1ad6f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:39.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.798+0000 7f8ad83cd740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfc1ad3680 0x55dfc1ad7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:39.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.798+0000 7f8ad83cd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad01ae590 con 0x55dfc1ac8dc0 2024-09-19T09:00:39.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.798+0000 7f8ad83cd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad01afa00 con 0x55dfc1ac84a0 2024-09-19T09:00:39.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.798+0000 7f8ad83cd740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad01aec60 con 0x55dfc1ad3680 2024-09-19T09:00:39.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.798+0000 7f8ad83cd740 10 client.0 _ll_register_callbacks cb 0x7f8ac0009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:39.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.798+0000 7f8acf7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dfc1ac8dc0 0x55dfc1ad6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:39.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.798+0000 7f8acf7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dfc1ac8dc0 0x55dfc1ad6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48288/0 (socket says 172.21.15.92:48288) 2024-09-19T09:00:39.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.798+0000 7f8acf7fe640 1 -- 172.21.15.92:0/2797073486 learned_addr learned my addr 172.21.15.92:0/2797073486 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:39.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.798+0000 7f8aceffd640 1 --2- 172.21.15.92:0/2797073486 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfc1ad3680 0x55dfc1ad7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:39.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.798+0000 7f8aceffd640 1 --2- 172.21.15.92:0/2797073486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dfc1ac84a0 0x55dfc1adbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:39.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.798+0000 7f8acf7fe640 1 -- 172.21.15.92:0/2797073486 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfc1ad3680 msgr2=0x55dfc1ad7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:39.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.798+0000 7f8acf7fe640 1 --2- 172.21.15.92:0/2797073486 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfc1ad3680 0x55dfc1ad7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:39.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.798+0000 7f8acf7fe640 1 -- 172.21.15.92:0/2797073486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dfc1ac84a0 msgr2=0x55dfc1adbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:39.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.798+0000 7f8acf7fe640 1 --2- 172.21.15.92:0/2797073486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dfc1ac84a0 0x55dfc1adbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:39.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.798+0000 7f8acf7fe640 1 -- 172.21.15.92:0/2797073486 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfc1ac56c0 con 0x55dfc1ac8dc0 2024-09-19T09:00:39.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.799+0000 7f8aceffd640 1 --2- 172.21.15.92:0/2797073486 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfc1ad3680 0x55dfc1ad7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:00:39.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.799+0000 7f8acf7fe640 1 --2- 172.21.15.92:0/2797073486 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dfc1ac8dc0 0x55dfc1ad6f10 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f8ac00314e0 tx=0x7f8ac0004560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea567bba7e53f5eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:39.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.799+0000 7f8aaeffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:00:39.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.799+0000 7f8aaeffd640 1 -- 172.21.15.92:0/2797073486 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac0035040 con 0x55dfc1ac8dc0 2024-09-19T09:00:39.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.799+0000 7f8ad83cd740 1 -- 172.21.15.92:0/2797073486 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ac4016030 con 0x55dfc1ac8dc0 2024-09-19T09:00:39.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.799+0000 7f8aaeffd640 1 -- 172.21.15.92:0/2797073486 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8ac0003ac0 con 0x55dfc1ac8dc0 2024-09-19T09:00:39.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.799+0000 7f8aaeffd640 1 -- 172.21.15.92:0/2797073486 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8ac0003cc0 con 0x55dfc1ac8dc0 2024-09-19T09:00:39.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.799+0000 7f8ad83cd740 10 client.16254 fetch_fsmap learned FSMap version 19 2024-09-19T09:00:39.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.799+0000 7f8ad83cd740 1 -- 172.21.15.92:0/2797073486 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55dfc1b4d6f0 con 0x55dfc1ac8dc0 2024-09-19T09:00:39.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.799+0000 7f8aaeffd640 1 -- 172.21.15.92:0/2797073486 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ac4016030 con 0x55dfc1ac8dc0 2024-09-19T09:00:39.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.799+0000 7f8aaeffd640 1 -- 172.21.15.92:0/2797073486 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f8ac0004bf0 con 0x55dfc1ac8dc0 2024-09-19T09:00:39.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.799+0000 7f8ad83cd740 10 client.16254 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:00:39.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.799+0000 7f8ad83cd740 10 client.16254 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:00:39.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.799+0000 7f8ad83cd740 20 client.16254 populate_metadata read hostname 'smithi092' 2024-09-19T09:00:39.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.799+0000 7f8ad83cd740 1 --2- 172.21.15.92:0/2797073486 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55dfc1b4de50 0x55dfc1b50270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:39.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.799+0000 7f8ad83cd740 4 client.16254 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:00:39.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.799+0000 7f8ad83cd740 1 -- 172.21.15.92:0/2797073486 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55dfc1a35d60 con 0x55dfc1b4de50 2024-09-19T09:00:39.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.800+0000 7f8aceffd640 1 --2- 172.21.15.92:0/2797073486 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55dfc1b4de50 0x55dfc1b50270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:39.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.800+0000 7f8aceffd640 1 --2- 172.21.15.92:0/2797073486 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55dfc1b4de50 0x55dfc1b50270 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=746cd2fad76d2d39 server_cookie=bbc03b62a3f7a165 in_seq=0 out_seq=0 2024-09-19T09:00:39.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.800+0000 7f8aaeffd640 10 client.16254 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:39.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.800+0000 7f8aaeffd640 1 -- 172.21.15.92:0/2797073486 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55dfc1a35d60 con 0x55dfc1b4de50 2024-09-19T09:00:39.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.800+0000 7f8aaeffd640 10 client.16254 handle_command_reply: tid=0 2024-09-19T09:00:39.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.800+0000 7f8ad83cd740 1 client.16254 shutdown 2024-09-19T09:00:39.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.801+0000 7f8ad83cd740 1 -- 172.21.15.92:0/2797073486 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dfc1ac8dc0 msgr2=0x55dfc1ad6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:39.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.801+0000 7f8ad83cd740 1 --2- 172.21.15.92:0/2797073486 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dfc1ac8dc0 0x55dfc1ad6f10 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f8ac00314e0 tx=0x7f8ac0004560 comp rx=0 tx=0).stop 2024-09-19T09:00:39.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.801+0000 7f8ad83cd740 1 -- 172.21.15.92:0/2797073486 shutdown_connections 2024-09-19T09:00:39.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.801+0000 7f8ad83cd740 1 --2- 172.21.15.92:0/2797073486 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55dfc1b4de50 0x55dfc1b50270 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:39.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.801+0000 7f8ad83cd740 1 --2- 172.21.15.92:0/2797073486 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dfc1ad3680 0x55dfc1ad7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:39.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.801+0000 7f8ad83cd740 1 --2- 172.21.15.92:0/2797073486 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dfc1ac8dc0 0x55dfc1ad6f10 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:39.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.801+0000 7f8ad83cd740 1 --2- 172.21.15.92:0/2797073486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dfc1ac84a0 0x55dfc1adbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:39.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.801+0000 7f8ad83cd740 1 -- 172.21.15.92:0/2797073486 >> 172.21.15.92:0/2797073486 conn(0x55dfc1ac4a30 msgr2=0x55dfc1acead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:39.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.801+0000 7f8aaeffd640 0 client.16254 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:39.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.801+0000 7f8ad83cd740 1 -- 172.21.15.92:0/2797073486 shutdown_connections 2024-09-19T09:00:39.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.801+0000 7f8ad83cd740 1 -- 172.21.15.92:0/2797073486 wait complete. 2024-09-19T09:00:39.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.801+0000 7f8ad83cd740 20 client.16254 trim_cache size 0 max 16384 2024-09-19T09:00:39.810 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:00:39.810 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-19T09:00:39.810 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {} 2024-09-19T09:00:39.810 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:00:39.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.801+0000 7f8ad5ff4640 1 -- 172.21.15.92:0/1908592873 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8ab80a32c0 msgr2=0x7f8ab80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:39.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.801+0000 7f8ad5ff4640 1 --2- 172.21.15.92:0/1908592873 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8ab80a32c0 0x7f8ab80a5780 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8097990 tx=0x7f8ac8090a10 comp rx=0 tx=0).stop 2024-09-19T09:00:39.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.801+0000 7f8ad5ff4640 1 -- 172.21.15.92:0/1908592873 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ad0102ef0 msgr2=0x7f8ad00fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:39.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.801+0000 7f8ad5ff4640 1 --2- 172.21.15.92:0/1908592873 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ad0102ef0 0x7f8ad00fd700 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f8ac800b970 tx=0x7f8ac800be30 comp rx=0 tx=0).stop 2024-09-19T09:00:39.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.801+0000 7f8ad5ff4640 1 -- 172.21.15.92:0/1908592873 shutdown_connections 2024-09-19T09:00:39.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.801+0000 7f8ad5ff4640 1 --2- 172.21.15.92:0/1908592873 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8ab80a32c0 0x7f8ab80a5780 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:39.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.801+0000 7f8ad5ff4640 1 --2- 172.21.15.92:0/1908592873 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ad0102ef0 0x7f8ad00fd700 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:39.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.801+0000 7f8ad5ff4640 1 --2- 172.21.15.92:0/1908592873 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ad0102570 0x7f8ad00fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:39.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.801+0000 7f8ad5ff4640 1 --2- 172.21.15.92:0/1908592873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ad0100e20 0x7f8ad00fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:39.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.801+0000 7f8ad5ff4640 1 -- 172.21.15.92:0/1908592873 >> 172.21.15.92:0/1908592873 conn(0x7f8ad00fc7d0 msgr2=0x7f8ad006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:39.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.802+0000 7f8ad5ff4640 1 -- 172.21.15.92:0/1908592873 shutdown_connections 2024-09-19T09:00:39.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:39.802+0000 7f8ad5ff4640 1 -- 172.21.15.92:0/1908592873 wait complete. 2024-09-19T09:00:39.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:39 smithi167 ceph-mon[35359]: pgmap v455: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 1.7 MiB/s wr, 114 op/s 2024-09-19T09:00:39.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:39 smithi190 ceph-mon[35358]: pgmap v455: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 1.7 MiB/s wr, 114 op/s 2024-09-19T09:00:40.486 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:00:40.487 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:00:40.735 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:40.796 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:00:41.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.122+0000 7fcd9656a640 1 -- 172.21.15.92:0/4249709797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd90100a80 msgr2=0x7fcd90100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:41.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.122+0000 7fcd9656a640 1 --2- 172.21.15.92:0/4249709797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd90100a80 0x7fcd90100ee0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fcd78009930 tx=0x7fcd7802a420 comp rx=0 tx=0).stop 2024-09-19T09:00:41.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.122+0000 7fcd9656a640 1 -- 172.21.15.92:0/4249709797 shutdown_connections 2024-09-19T09:00:41.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.122+0000 7fcd9656a640 1 --2- 172.21.15.92:0/4249709797 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd90101420 0x7fcd9010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:41.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.122+0000 7fcd9656a640 1 --2- 172.21.15.92:0/4249709797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd90100a80 0x7fcd90100ee0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:41.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.122+0000 7fcd9656a640 1 --2- 172.21.15.92:0/4249709797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd90106a80 0x7fcd90106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:41.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.122+0000 7fcd9656a640 1 -- 172.21.15.92:0/4249709797 >> 172.21.15.92:0/4249709797 conn(0x7fcd900fc7a0 msgr2=0x7fcd900febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:41.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.122+0000 7fcd9656a640 1 -- 172.21.15.92:0/4249709797 shutdown_connections 2024-09-19T09:00:41.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.122+0000 7fcd9656a640 1 -- 172.21.15.92:0/4249709797 wait complete. 2024-09-19T09:00:41.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.122+0000 7fcd9656a640 1 Processor -- start 2024-09-19T09:00:41.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.123+0000 7fcd9656a640 1 -- start start 2024-09-19T09:00:41.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.123+0000 7fcd9656a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd90100a80 0x7fcd900fccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:41.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.123+0000 7fcd9656a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd90101420 0x7fcd900fd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:41.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.123+0000 7fcd9656a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd90106a80 0x7fcd900fd770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:41.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.123+0000 7fcd9656a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcd90110e40 con 0x7fcd90101420 2024-09-19T09:00:41.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.123+0000 7fcd9656a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcd90110cc0 con 0x7fcd90106a80 2024-09-19T09:00:41.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.123+0000 7fcd9656a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fcd90110fc0 con 0x7fcd90100a80 2024-09-19T09:00:41.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.123+0000 7fcd87fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd90101420 0x7fcd900fd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:41.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.123+0000 7fcd87fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd90101420 0x7fcd900fd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48302/0 (socket says 172.21.15.92:48302) 2024-09-19T09:00:41.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.123+0000 7fcd87fff640 1 -- 172.21.15.92:0/2057103833 learned_addr learned my addr 172.21.15.92:0/2057103833 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:41.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.123+0000 7fcd8ffff640 1 --2- 172.21.15.92:0/2057103833 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd90100a80 0x7fcd900fccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:41.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.123+0000 7fcd87fff640 1 -- 172.21.15.92:0/2057103833 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd90100a80 msgr2=0x7fcd900fccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:41.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.123+0000 7fcd87fff640 1 --2- 172.21.15.92:0/2057103833 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd90100a80 0x7fcd900fccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:41.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.123+0000 7fcd94b07640 1 --2- 172.21.15.92:0/2057103833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd90106a80 0x7fcd900fd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:41.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.123+0000 7fcd87fff640 1 -- 172.21.15.92:0/2057103833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd90106a80 msgr2=0x7fcd900fd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:41.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.123+0000 7fcd87fff640 1 --2- 172.21.15.92:0/2057103833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd90106a80 0x7fcd900fd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:41.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.123+0000 7fcd87fff640 1 -- 172.21.15.92:0/2057103833 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd901a68f0 con 0x7fcd90101420 2024-09-19T09:00:41.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.123+0000 7fcd8ffff640 1 --2- 172.21.15.92:0/2057103833 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd90100a80 0x7fcd900fccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:00:41.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.123+0000 7fcd87fff640 1 --2- 172.21.15.92:0/2057103833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd90101420 0x7fcd900fd230 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fcd78009230 tx=0x7fcd78004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:41.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.123+0000 7fcd8dffb640 1 -- 172.21.15.92:0/2057103833 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7803f030 con 0x7fcd90101420 2024-09-19T09:00:41.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.124+0000 7fcd9656a640 1 -- 172.21.15.92:0/2057103833 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd901a6b80 con 0x7fcd90101420 2024-09-19T09:00:41.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.124+0000 7fcd8dffb640 1 -- 172.21.15.92:0/2057103833 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd78003ad0 con 0x7fcd90101420 2024-09-19T09:00:41.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.124+0000 7fcd8dffb640 1 -- 172.21.15.92:0/2057103833 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd78035070 con 0x7fcd90101420 2024-09-19T09:00:41.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.124+0000 7fcd9656a640 1 -- 172.21.15.92:0/2057103833 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd901a7060 con 0x7fcd90101420 2024-09-19T09:00:41.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.125+0000 7fcd9656a640 1 -- 172.21.15.92:0/2057103833 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd90100ee0 con 0x7fcd90101420 2024-09-19T09:00:41.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.127+0000 7fcd8dffb640 1 -- 172.21.15.92:0/2057103833 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fcd78042030 con 0x7fcd90101420 2024-09-19T09:00:41.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.127+0000 7fcd8dffb640 1 --2- 172.21.15.92:0/2057103833 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcd7c0a3240 0x7fcd7c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:41.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.127+0000 7fcd8ffff640 1 --2- 172.21.15.92:0/2057103833 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcd7c0a3240 0x7fcd7c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:41.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.127+0000 7fcd8dffb640 1 -- 172.21.15.92:0/2057103833 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcd780f0270 con 0x7fcd90101420 2024-09-19T09:00:41.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.128+0000 7fcd8ffff640 1 --2- 172.21.15.92:0/2057103833 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcd7c0a3240 0x7fcd7c0a5700 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcd8000baa0 tx=0x7fcd80005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:41.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.131+0000 7fcd8dffb640 1 -- 172.21.15.92:0/2057103833 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcd780bcf90 con 0x7fcd90101420 2024-09-19T09:00:41.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.330+0000 7fcd9656a640 1 -- 172.21.15.92:0/2057103833 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcd9010a050 con 0x7fcd90101420 2024-09-19T09:00:41.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.330+0000 7fcd8dffb640 1 -- 172.21.15.92:0/2057103833 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7fcd780bc890 con 0x7fcd90101420 2024-09-19T09:00:41.331 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:00:41.331 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:00:41.331 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:00:41.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.332+0000 7fcd9656a640 1 -- 172.21.15.92:0/2057103833 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcd7c0a3240 msgr2=0x7fcd7c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:41.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.332+0000 7fcd9656a640 1 --2- 172.21.15.92:0/2057103833 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcd7c0a3240 0x7fcd7c0a5700 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcd8000baa0 tx=0x7fcd80005d20 comp rx=0 tx=0).stop 2024-09-19T09:00:41.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.332+0000 7fcd9656a640 1 -- 172.21.15.92:0/2057103833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd90101420 msgr2=0x7fcd900fd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:41.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.332+0000 7fcd9656a640 1 --2- 172.21.15.92:0/2057103833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd90101420 0x7fcd900fd230 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fcd78009230 tx=0x7fcd78004270 comp rx=0 tx=0).stop 2024-09-19T09:00:41.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.332+0000 7fcd9656a640 1 -- 172.21.15.92:0/2057103833 shutdown_connections 2024-09-19T09:00:41.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.332+0000 7fcd9656a640 1 --2- 172.21.15.92:0/2057103833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd90106a80 0x7fcd900fd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:41.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.332+0000 7fcd9656a640 1 --2- 172.21.15.92:0/2057103833 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcd7c0a3240 0x7fcd7c0a5700 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:41.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.332+0000 7fcd9656a640 1 --2- 172.21.15.92:0/2057103833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd90101420 0x7fcd900fd230 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:41.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.332+0000 7fcd9656a640 1 --2- 172.21.15.92:0/2057103833 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd90100a80 0x7fcd900fccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:41.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.332+0000 7fcd9656a640 1 -- 172.21.15.92:0/2057103833 >> 172.21.15.92:0/2057103833 conn(0x7fcd900fc7a0 msgr2=0x7fcd9006aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:41.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.333+0000 7fcd9656a640 1 -- 172.21.15.92:0/2057103833 shutdown_connections 2024-09-19T09:00:41.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:41.333+0000 7fcd9656a640 1 -- 172.21.15.92:0/2057103833 wait complete. 2024-09-19T09:00:41.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:41 smithi092 ceph-mon[31407]: pgmap v456: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.3 MiB/s wr, 71 op/s 2024-09-19T09:00:41.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:41 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/2057103833' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:41.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:41 smithi167 ceph-mon[35359]: pgmap v456: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.3 MiB/s wr, 71 op/s 2024-09-19T09:00:41.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:41 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/2057103833' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:41.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:41 smithi190 ceph-mon[35358]: pgmap v456: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.3 MiB/s wr, 71 op/s 2024-09-19T09:00:41.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:41 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/2057103833' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:41.977 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:00:42.221 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.365+0000 7f3de149b640 1 -- 172.21.15.92:0/3857122920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ddc100a40 msgr2=0x7f3ddc100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:42.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.365+0000 7f3de149b640 1 --2- 172.21.15.92:0/3857122920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ddc100a40 0x7f3ddc100e40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc009900 tx=0x7f3dcc02a410 comp rx=0 tx=0).stop 2024-09-19T09:00:42.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.365+0000 7f3de149b640 1 -- 172.21.15.92:0/3857122920 shutdown_connections 2024-09-19T09:00:42.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.365+0000 7f3de149b640 1 --2- 172.21.15.92:0/3857122920 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3ddc1025f0 0x7f3ddc108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.365+0000 7f3de149b640 1 --2- 172.21.15.92:0/3857122920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ddc101c30 0x7f3ddc1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.365+0000 7f3de149b640 1 --2- 172.21.15.92:0/3857122920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ddc100a40 0x7f3ddc100e40 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.365+0000 7f3de149b640 1 -- 172.21.15.92:0/3857122920 >> 172.21.15.92:0/3857122920 conn(0x7f3ddc0fc1e0 msgr2=0x7f3ddc0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:42.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.365+0000 7f3de149b640 1 -- 172.21.15.92:0/3857122920 shutdown_connections 2024-09-19T09:00:42.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.365+0000 7f3de149b640 1 -- 172.21.15.92:0/3857122920 wait complete. 2024-09-19T09:00:42.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.366+0000 7f3de149b640 1 Processor -- start 2024-09-19T09:00:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.366+0000 7f3de149b640 1 -- start start 2024-09-19T09:00:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.366+0000 7f3de149b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ddc100a40 0x7f3ddc196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.366+0000 7f3de149b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3ddc101c30 0x7f3ddc197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.366+0000 7f3de149b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ddc1025f0 0x7f3ddc19e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.366+0000 7f3de149b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3ddc10c6a0 con 0x7f3ddc100a40 2024-09-19T09:00:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.366+0000 7f3de149b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3ddc10c520 con 0x7f3ddc1025f0 2024-09-19T09:00:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.366+0000 7f3de149b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3ddc10c820 con 0x7f3ddc101c30 2024-09-19T09:00:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.366+0000 7f3ddaffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ddc100a40 0x7f3ddc196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.366+0000 7f3ddaffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ddc100a40 0x7f3ddc196d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41064/0 (socket says 172.21.15.92:41064) 2024-09-19T09:00:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.366+0000 7f3ddaffd640 1 -- 172.21.15.92:0/1433670381 learned_addr learned my addr 172.21.15.92:0/1433670381 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.366+0000 7f3ddb7fe640 1 --2- 172.21.15.92:0/1433670381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ddc1025f0 0x7f3ddc19e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.367+0000 7f3ddaffd640 1 -- 172.21.15.92:0/1433670381 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3ddc101c30 msgr2=0x7f3ddc197250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.367+0000 7f3ddaffd640 1 --2- 172.21.15.92:0/1433670381 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3ddc101c30 0x7f3ddc197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.367+0000 7f3ddaffd640 1 -- 172.21.15.92:0/1433670381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ddc1025f0 msgr2=0x7f3ddc19e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.367+0000 7f3ddaffd640 1 --2- 172.21.15.92:0/1433670381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ddc1025f0 0x7f3ddc19e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.367+0000 7f3ddaffd640 1 -- 172.21.15.92:0/1433670381 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ddc19e920 con 0x7f3ddc100a40 2024-09-19T09:00:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.367+0000 7f3ddb7fe640 1 --2- 172.21.15.92:0/1433670381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ddc1025f0 0x7f3ddc19e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:00:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.367+0000 7f3ddaffd640 1 --2- 172.21.15.92:0/1433670381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ddc100a40 0x7f3ddc196d10 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc031610 tx=0x7f3dcc0043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.367+0000 7f3dd8ff9640 1 -- 172.21.15.92:0/1433670381 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc03f030 con 0x7f3ddc100a40 2024-09-19T09:00:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.367+0000 7f3dd8ff9640 1 -- 172.21.15.92:0/1433670381 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dcc003ce0 con 0x7f3ddc100a40 2024-09-19T09:00:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.367+0000 7f3de149b640 1 -- 172.21.15.92:0/1433670381 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ddc19ebb0 con 0x7f3ddc100a40 2024-09-19T09:00:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.367+0000 7f3dd8ff9640 1 -- 172.21.15.92:0/1433670381 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc035070 con 0x7f3ddc100a40 2024-09-19T09:00:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.367+0000 7f3de149b640 1 -- 172.21.15.92:0/1433670381 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ddc19f0a0 con 0x7f3ddc100a40 2024-09-19T09:00:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.369+0000 7f3dd8ff9640 1 -- 172.21.15.92:0/1433670381 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3dcc042030 con 0x7f3ddc100a40 2024-09-19T09:00:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.369+0000 7f3de4234740 1 Processor -- start 2024-09-19T09:00:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.370+0000 7f3de4234740 1 -- start start 2024-09-19T09:00:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.370+0000 7f3de4234740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e761ee5bb0 0x55e761ee5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.370+0000 7f3de4234740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e761ee64f0 0x55e761eeafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.370+0000 7f3de4234740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e761eeb580 0x55e761eeda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.370+0000 7f3de4234740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e761e472f0 con 0x55e761ee64f0 2024-09-19T09:00:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.370+0000 7f3de4234740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e761def270 con 0x55e761ee5bb0 2024-09-19T09:00:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.370+0000 7f3de4234740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e761e432b0 con 0x55e761eeb580 2024-09-19T09:00:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.370+0000 7f3ddaffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e761ee64f0 0x55e761eeafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:42.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.370+0000 7f3ddaffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e761ee64f0 0x55e761eeafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41074/0 (socket says 172.21.15.92:41074) 2024-09-19T09:00:42.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.370+0000 7f3ddaffd640 1 -- 172.21.15.92:0/211033928 learned_addr learned my addr 172.21.15.92:0/211033928 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:42.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.370+0000 7f3ddb7fe640 1 --2- 172.21.15.92:0/211033928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e761ee5bb0 0x55e761ee5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:42.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.370+0000 7f3dd8ff9640 1 --2- 172.21.15.92:0/1433670381 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3dc80a32f0 0x7f3dc80a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:42.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.370+0000 7f3dd3fff640 1 --2- 172.21.15.92:0/211033928 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e761eeb580 0x55e761eeda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:42.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.370+0000 7f3ddb7fe640 1 --2- 172.21.15.92:0/1433670381 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3dc80a32f0 0x7f3dc80a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:42.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.370+0000 7f3ddaffd640 1 -- 172.21.15.92:0/211033928 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e761eeb580 msgr2=0x55e761eeda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:42.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.370+0000 7f3ddaffd640 1 --2- 172.21.15.92:0/211033928 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e761eeb580 0x55e761eeda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.370+0000 7f3ddaffd640 1 -- 172.21.15.92:0/211033928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e761ee5bb0 msgr2=0x55e761ee5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:42.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.370+0000 7f3ddaffd640 1 --2- 172.21.15.92:0/211033928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e761ee5bb0 0x55e761ee5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.370+0000 7f3dd8ff9640 1 -- 172.21.15.92:0/1433670381 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3dcc0efff0 con 0x7f3ddc100a40 2024-09-19T09:00:42.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.370+0000 7f3ddaffd640 1 -- 172.21.15.92:0/211033928 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e761dee340 con 0x55e761ee64f0 2024-09-19T09:00:42.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.371+0000 7f3ddaffd640 1 --2- 172.21.15.92:0/211033928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e761ee64f0 0x55e761eeafb0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc0bc310 tx=0x7f3dcc02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aee6c64aa651c9a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:42.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.371+0000 7f3ddb7fe640 1 --2- 172.21.15.92:0/1433670381 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3dc80a32f0 0x7f3dc80a57b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4005fd0 tx=0x7f3dd4004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:42.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.371+0000 7f3dd17fa640 1 -- 172.21.15.92:0/211033928 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc049070 con 0x55e761ee64f0 2024-09-19T09:00:42.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.371+0000 7f3dd17fa640 1 -- 172.21.15.92:0/211033928 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dcc0bcd10 con 0x55e761ee64f0 2024-09-19T09:00:42.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.371+0000 7f3dd17fa640 1 -- 172.21.15.92:0/211033928 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc0c09c0 con 0x55e761ee64f0 2024-09-19T09:00:42.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.372+0000 7f3de4234740 1 -- 172.21.15.92:0/211033928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e761ee64f0 msgr2=0x55e761eeafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:42.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.372+0000 7f3de4234740 1 --2- 172.21.15.92:0/211033928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e761ee64f0 0x55e761eeafb0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc0bc310 tx=0x7f3dcc02a410 comp rx=0 tx=0).stop 2024-09-19T09:00:42.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.372+0000 7f3de4234740 1 -- 172.21.15.92:0/211033928 shutdown_connections 2024-09-19T09:00:42.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.372+0000 7f3de4234740 1 --2- 172.21.15.92:0/211033928 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e761eeb580 0x55e761eeda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.372+0000 7f3de4234740 1 --2- 172.21.15.92:0/211033928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e761ee64f0 0x55e761eeafb0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.372+0000 7f3de4234740 1 --2- 172.21.15.92:0/211033928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e761ee5bb0 0x55e761ee5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.372+0000 7f3de4234740 1 -- 172.21.15.92:0/211033928 >> 172.21.15.92:0/211033928 conn(0x55e761edf010 msgr2=0x55e761edf410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:42.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.372+0000 7f3de4234740 1 -- 172.21.15.92:0/211033928 shutdown_connections 2024-09-19T09:00:42.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.372+0000 7f3de4234740 1 -- 172.21.15.92:0/211033928 wait complete. 2024-09-19T09:00:42.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.372+0000 7f3de4234740 1 -- start start 2024-09-19T09:00:42.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.372+0000 7f3de4234740 1 Processor -- start 2024-09-19T09:00:42.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.372+0000 7f3de4234740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e761ee5bb0 0x55e761eefa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:42.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.372+0000 7f3de4234740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e761ee64f0 0x55e761eeff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:42.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.372+0000 7f3de4234740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e761eeb580 0x55e761ef6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:42.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.372+0000 7f3de4234740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e761eee310 con 0x55e761eeb580 2024-09-19T09:00:42.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.372+0000 7f3de4234740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e761dd0290 con 0x55e761ee64f0 2024-09-19T09:00:42.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.372+0000 7f3de4234740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e761eee490 con 0x55e761ee5bb0 2024-09-19T09:00:42.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.372+0000 7f3de4234740 10 client.0 _ll_register_callbacks cb 0x55e761e01140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:42.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.372+0000 7f3ddb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e761eeb580 0x55e761ef6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:42.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.372+0000 7f3ddb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e761eeb580 0x55e761ef6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41090/0 (socket says 172.21.15.92:41090) 2024-09-19T09:00:42.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.372+0000 7f3ddb7fe640 1 -- 172.21.15.92:0/4013062404 learned_addr learned my addr 172.21.15.92:0/4013062404 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:42.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.373+0000 7f3ddaffd640 1 --2- 172.21.15.92:0/4013062404 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e761ee5bb0 0x55e761eefa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:42.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.373+0000 7f3dd3fff640 1 --2- 172.21.15.92:0/4013062404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e761ee64f0 0x55e761eeff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:42.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.373+0000 7f3ddb7fe640 1 -- 172.21.15.92:0/4013062404 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e761ee5bb0 msgr2=0x55e761eefa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:42.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.373+0000 7f3ddb7fe640 1 --2- 172.21.15.92:0/4013062404 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e761ee5bb0 0x55e761eefa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.373+0000 7f3ddb7fe640 1 -- 172.21.15.92:0/4013062404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e761ee64f0 msgr2=0x55e761eeff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:42.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.373+0000 7f3ddb7fe640 1 --2- 172.21.15.92:0/4013062404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e761ee64f0 0x55e761eeff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.373+0000 7f3ddb7fe640 1 -- 172.21.15.92:0/4013062404 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e761b5a210 con 0x55e761eeb580 2024-09-19T09:00:42.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.373+0000 7f3dd3fff640 1 --2- 172.21.15.92:0/4013062404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e761ee64f0 0x55e761eeff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:00:42.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.373+0000 7f3ddb7fe640 1 --2- 172.21.15.92:0/4013062404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e761eeb580 0x55e761ef6fb0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4011ed0 tx=0x7f3dd4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe283092087cd8b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:42.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.373+0000 7f3dc27fc640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:00:42.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.373+0000 7f3dc27fc640 1 -- 172.21.15.92:0/4013062404 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd4024020 con 0x55e761eeb580 2024-09-19T09:00:42.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.373+0000 7f3de4234740 1 -- 172.21.15.92:0/4013062404 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3dcc0bcd10 con 0x55e761eeb580 2024-09-19T09:00:42.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.373+0000 7f3dc27fc640 1 -- 172.21.15.92:0/4013062404 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3dd400e470 con 0x55e761eeb580 2024-09-19T09:00:42.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.373+0000 7f3dc27fc640 1 -- 172.21.15.92:0/4013062404 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3dd401c040 con 0x55e761eeb580 2024-09-19T09:00:42.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.373+0000 7f3de4234740 10 client.16272 fetch_fsmap learned FSMap version 19 2024-09-19T09:00:42.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.373+0000 7f3de4234740 1 -- 172.21.15.92:0/4013062404 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e761c26620 con 0x55e761eeb580 2024-09-19T09:00:42.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.373+0000 7f3dc27fc640 1 -- 172.21.15.92:0/4013062404 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dcc0bcd10 con 0x55e761eeb580 2024-09-19T09:00:42.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.373+0000 7f3dc27fc640 1 -- 172.21.15.92:0/4013062404 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f3dd401f030 con 0x55e761eeb580 2024-09-19T09:00:42.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.374+0000 7f3de4234740 10 client.16272 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:00:42.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.374+0000 7f3de4234740 10 client.16272 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:00:42.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.374+0000 7f3de4234740 20 client.16272 populate_metadata read hostname 'smithi092' 2024-09-19T09:00:42.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.374+0000 7f3de4234740 1 --2- 172.21.15.92:0/4013062404 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e761efb7e0 0x55e761efdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:42.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.374+0000 7f3de4234740 4 client.16272 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:00:42.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.374+0000 7f3de4234740 1 -- 172.21.15.92:0/4013062404 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e761e54a20 con 0x55e761efb7e0 2024-09-19T09:00:42.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.374+0000 7f3ddaffd640 1 --2- 172.21.15.92:0/4013062404 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e761efb7e0 0x55e761efdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:42.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.374+0000 7f3dc27fc640 10 client.16272 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:42.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.374+0000 7f3ddaffd640 1 --2- 172.21.15.92:0/4013062404 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e761efb7e0 0x55e761efdbf0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db70d9942df95402 server_cookie=e6fd6ab1f2ddac87 in_seq=0 out_seq=0 2024-09-19T09:00:42.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.375+0000 7f3dc27fc640 1 -- 172.21.15.92:0/4013062404 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e761e54a20 con 0x55e761efb7e0 2024-09-19T09:00:42.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.375+0000 7f3dc27fc640 10 client.16272 handle_command_reply: tid=0 2024-09-19T09:00:42.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.375+0000 7f3de4234740 1 client.16272 shutdown 2024-09-19T09:00:42.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.375+0000 7f3de4234740 1 -- 172.21.15.92:0/4013062404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e761eeb580 msgr2=0x55e761ef6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:42.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.375+0000 7f3de4234740 1 --2- 172.21.15.92:0/4013062404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e761eeb580 0x55e761ef6fb0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4011ed0 tx=0x7f3dd4004a40 comp rx=0 tx=0).stop 2024-09-19T09:00:42.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.375+0000 7f3de4234740 1 -- 172.21.15.92:0/4013062404 shutdown_connections 2024-09-19T09:00:42.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.375+0000 7f3de4234740 1 --2- 172.21.15.92:0/4013062404 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e761efb7e0 0x55e761efdbf0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.375+0000 7f3de4234740 1 --2- 172.21.15.92:0/4013062404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e761eeb580 0x55e761ef6fb0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.375+0000 7f3de4234740 1 --2- 172.21.15.92:0/4013062404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e761ee64f0 0x55e761eeff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.375+0000 7f3dc27fc640 0 client.16272 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:42.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.375+0000 7f3de4234740 1 --2- 172.21.15.92:0/4013062404 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e761ee5bb0 0x55e761eefa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.375+0000 7f3de4234740 1 -- 172.21.15.92:0/4013062404 >> 172.21.15.92:0/4013062404 conn(0x55e761edf010 msgr2=0x55e761ee0820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:42.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.375+0000 7f3de4234740 1 -- 172.21.15.92:0/4013062404 shutdown_connections 2024-09-19T09:00:42.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.376+0000 7f3de4234740 1 -- 172.21.15.92:0/4013062404 wait complete. 2024-09-19T09:00:42.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.376+0000 7f3de4234740 20 client.16272 trim_cache size 0 max 16384 2024-09-19T09:00:42.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.390+0000 7f3de4234740 1 Processor -- start 2024-09-19T09:00:42.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.390+0000 7f3de4234740 1 -- start start 2024-09-19T09:00:42.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.390+0000 7f3de4234740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e761ee5bb0 0x55e761eeee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:42.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.390+0000 7f3de4234740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e761ee64f0 0x55e761ef6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:42.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.390+0000 7f3de4234740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e761eeb580 0x55e761edfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:42.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.390+0000 7f3de4234740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3ddc1a4df0 con 0x55e761eeb580 2024-09-19T09:00:42.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.390+0000 7f3de4234740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3ddc1a7690 con 0x55e761ee64f0 2024-09-19T09:00:42.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.390+0000 7f3de4234740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3ddc1a5480 con 0x55e761ee5bb0 2024-09-19T09:00:42.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.390+0000 7f3ddb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e761eeb580 0x55e761edfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:42.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.390+0000 7f3ddb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e761eeb580 0x55e761edfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41106/0 (socket says 172.21.15.92:41106) 2024-09-19T09:00:42.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.390+0000 7f3ddb7fe640 1 -- 172.21.15.92:0/3641983520 learned_addr learned my addr 172.21.15.92:0/3641983520 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:42.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.391+0000 7f3dd3fff640 1 --2- 172.21.15.92:0/3641983520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e761ee64f0 0x55e761ef6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:42.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.391+0000 7f3ddb7fe640 1 -- 172.21.15.92:0/3641983520 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e761ee5bb0 msgr2=0x55e761eeee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:42.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.391+0000 7f3ddb7fe640 1 --2- 172.21.15.92:0/3641983520 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e761ee5bb0 0x55e761eeee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.391+0000 7f3ddb7fe640 1 -- 172.21.15.92:0/3641983520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e761ee64f0 msgr2=0x55e761ef6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:42.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.391+0000 7f3ddb7fe640 1 --2- 172.21.15.92:0/3641983520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e761ee64f0 0x55e761ef6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.391+0000 7f3ddb7fe640 1 -- 172.21.15.92:0/3641983520 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e761efa070 con 0x55e761eeb580 2024-09-19T09:00:42.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.391+0000 7f3ddb7fe640 1 --2- 172.21.15.92:0/3641983520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e761eeb580 0x55e761edfec0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4008a20 tx=0x7f3dd4008390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a175734dc5fa053 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:42.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.391+0000 7f3dd0ff9640 1 -- 172.21.15.92:0/3641983520 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd4024040 con 0x55e761eeb580 2024-09-19T09:00:42.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.391+0000 7f3dd0ff9640 1 -- 172.21.15.92:0/3641983520 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dd403a070 con 0x55e761eeb580 2024-09-19T09:00:42.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.391+0000 7f3dd0ff9640 1 -- 172.21.15.92:0/3641983520 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd4034bc0 con 0x55e761eeb580 2024-09-19T09:00:42.395 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.392+0000 7f3de4234740 1 -- 172.21.15.92:0/3641983520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e761eeb580 msgr2=0x55e761edfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:42.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.392+0000 7f3de4234740 1 --2- 172.21.15.92:0/3641983520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e761eeb580 0x55e761edfec0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4008a20 tx=0x7f3dd4008390 comp rx=0 tx=0).stop 2024-09-19T09:00:42.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.392+0000 7f3de4234740 1 -- 172.21.15.92:0/3641983520 shutdown_connections 2024-09-19T09:00:42.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.392+0000 7f3de4234740 1 --2- 172.21.15.92:0/3641983520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e761eeb580 0x55e761edfec0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.392+0000 7f3de4234740 1 --2- 172.21.15.92:0/3641983520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e761ee64f0 0x55e761ef6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.392+0000 7f3de4234740 1 --2- 172.21.15.92:0/3641983520 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e761ee5bb0 0x55e761eeee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.392+0000 7f3de4234740 1 -- 172.21.15.92:0/3641983520 >> 172.21.15.92:0/3641983520 conn(0x55e761edf010 msgr2=0x55e761eee780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:42.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.392+0000 7f3de4234740 1 -- 172.21.15.92:0/3641983520 shutdown_connections 2024-09-19T09:00:42.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.392+0000 7f3de4234740 1 -- 172.21.15.92:0/3641983520 wait complete. 2024-09-19T09:00:42.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.392+0000 7f3de4234740 1 -- start start 2024-09-19T09:00:42.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.392+0000 7f3de4234740 1 Processor -- start 2024-09-19T09:00:42.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.392+0000 7f3de4234740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e761ee5bb0 0x55e761ef47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:42.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.392+0000 7f3de4234740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e761ee64f0 0x55e761ef4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:42.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.392+0000 7f3de4234740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e761eeb580 0x55e761ef5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:42.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.392+0000 7f3de4234740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3ddc1a5b50 con 0x55e761ee64f0 2024-09-19T09:00:42.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.392+0000 7f3de4234740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3ddc1a6fc0 con 0x55e761ee5bb0 2024-09-19T09:00:42.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.392+0000 7f3de4234740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3ddc1a6220 con 0x55e761eeb580 2024-09-19T09:00:42.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.392+0000 7f3de4234740 10 client.0 _ll_register_callbacks cb 0x7f3dd4014f90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:42.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.392+0000 7f3dd3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e761ee64f0 0x55e761ef4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:42.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.392+0000 7f3dd3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e761ee64f0 0x55e761ef4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41120/0 (socket says 172.21.15.92:41120) 2024-09-19T09:00:42.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.392+0000 7f3dd3fff640 1 -- 172.21.15.92:0/3264129630 learned_addr learned my addr 172.21.15.92:0/3264129630 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:42.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.392+0000 7f3ddaffd640 1 --2- 172.21.15.92:0/3264129630 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e761ee5bb0 0x55e761ef47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:42.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.393+0000 7f3ddb7fe640 1 --2- 172.21.15.92:0/3264129630 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e761eeb580 0x55e761ef5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:42.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.393+0000 7f3dd3fff640 1 -- 172.21.15.92:0/3264129630 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e761eeb580 msgr2=0x55e761ef5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:42.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.393+0000 7f3dd3fff640 1 --2- 172.21.15.92:0/3264129630 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e761eeb580 0x55e761ef5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.393+0000 7f3dd3fff640 1 -- 172.21.15.92:0/3264129630 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e761ee5bb0 msgr2=0x55e761ef47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:42.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.393+0000 7f3dd3fff640 1 --2- 172.21.15.92:0/3264129630 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e761ee5bb0 0x55e761ef47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.393+0000 7f3dd3fff640 1 -- 172.21.15.92:0/3264129630 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e761ef6300 con 0x55e761ee64f0 2024-09-19T09:00:42.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.393+0000 7f3dd3fff640 1 --2- 172.21.15.92:0/3264129630 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e761ee64f0 0x55e761ef4ce0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3dc40039b0 tx=0x7f3dc4003e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5123dfb4cfda268 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:42.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.393+0000 7f3dc27fc640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:00:42.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.393+0000 7f3dc27fc640 1 -- 172.21.15.92:0/3264129630 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4012450 con 0x55e761ee64f0 2024-09-19T09:00:42.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.393+0000 7f3dc27fc640 1 -- 172.21.15.92:0/3264129630 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3dc40125f0 con 0x55e761ee64f0 2024-09-19T09:00:42.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.393+0000 7f3de4234740 1 -- 172.21.15.92:0/3264129630 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3dd403a070 con 0x55e761ee64f0 2024-09-19T09:00:42.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.393+0000 7f3dc27fc640 1 -- 172.21.15.92:0/3264129630 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3dc40127f0 con 0x55e761ee64f0 2024-09-19T09:00:42.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.393+0000 7f3de4234740 10 client.16278 fetch_fsmap learned FSMap version 19 2024-09-19T09:00:42.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.393+0000 7f3de4234740 1 -- 172.21.15.92:0/3264129630 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e761f666e0 con 0x55e761ee64f0 2024-09-19T09:00:42.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.393+0000 7f3dc27fc640 1 -- 172.21.15.92:0/3264129630 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dd403a070 con 0x55e761ee64f0 2024-09-19T09:00:42.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.393+0000 7f3dc27fc640 1 -- 172.21.15.92:0/3264129630 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f3dc401a020 con 0x55e761ee64f0 2024-09-19T09:00:42.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.393+0000 7f3de4234740 10 client.16278 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:00:42.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.393+0000 7f3de4234740 10 client.16278 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:00:42.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.393+0000 7f3de4234740 20 client.16278 populate_metadata read hostname 'smithi092' 2024-09-19T09:00:42.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.393+0000 7f3de4234740 1 --2- 172.21.15.92:0/3264129630 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e761f670f0 0x55e761f69510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:42.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.393+0000 7f3de4234740 4 client.16278 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:00:42.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.393+0000 7f3de4234740 1 -- 172.21.15.92:0/3264129630 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e761e4ed70 con 0x55e761f670f0 2024-09-19T09:00:42.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.394+0000 7f3ddaffd640 1 --2- 172.21.15.92:0/3264129630 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e761f670f0 0x55e761f69510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:42.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.394+0000 7f3ddaffd640 1 --2- 172.21.15.92:0/3264129630 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e761f670f0 0x55e761f69510 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bde647023ae99e34 server_cookie=d838c5ca8da33a50 in_seq=0 out_seq=0 2024-09-19T09:00:42.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.394+0000 7f3dc27fc640 10 client.16278 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:42.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.412+0000 7f3dc27fc640 1 -- 172.21.15.92:0/3264129630 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e761e4ed70 con 0x55e761f670f0 2024-09-19T09:00:42.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.412+0000 7f3dc27fc640 10 client.16278 handle_command_reply: tid=0 2024-09-19T09:00:42.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.412+0000 7f3de4234740 1 client.16278 shutdown 2024-09-19T09:00:42.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.412+0000 7f3de4234740 1 -- 172.21.15.92:0/3264129630 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e761ee64f0 msgr2=0x55e761ef4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:42.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.412+0000 7f3de4234740 1 --2- 172.21.15.92:0/3264129630 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e761ee64f0 0x55e761ef4ce0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3dc40039b0 tx=0x7f3dc4003e70 comp rx=0 tx=0).stop 2024-09-19T09:00:42.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.412+0000 7f3de4234740 1 -- 172.21.15.92:0/3264129630 shutdown_connections 2024-09-19T09:00:42.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.412+0000 7f3de4234740 1 --2- 172.21.15.92:0/3264129630 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e761f670f0 0x55e761f69510 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.412+0000 7f3de4234740 1 --2- 172.21.15.92:0/3264129630 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e761eeb580 0x55e761ef5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.412+0000 7f3de4234740 1 --2- 172.21.15.92:0/3264129630 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e761ee64f0 0x55e761ef4ce0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.412+0000 7f3dc27fc640 0 client.16278 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:42.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.412+0000 7f3de4234740 1 --2- 172.21.15.92:0/3264129630 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e761ee5bb0 0x55e761ef47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.412+0000 7f3de4234740 1 -- 172.21.15.92:0/3264129630 >> 172.21.15.92:0/3264129630 conn(0x55e761edf010 msgr2=0x55e761eeefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:42.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.412+0000 7f3de4234740 1 -- 172.21.15.92:0/3264129630 shutdown_connections 2024-09-19T09:00:42.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.412+0000 7f3de4234740 1 -- 172.21.15.92:0/3264129630 wait complete. 2024-09-19T09:00:42.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.412+0000 7f3de4234740 20 client.16278 trim_cache size 0 max 16384 2024-09-19T09:00:42.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:00:42.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:00:42.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:00:42.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:00:42.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.413+0000 7f3de149b640 1 -- 172.21.15.92:0/1433670381 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3dc80a32f0 msgr2=0x7f3dc80a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:42.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.413+0000 7f3de149b640 1 --2- 172.21.15.92:0/1433670381 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3dc80a32f0 0x7f3dc80a57b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4005fd0 tx=0x7f3dd4004ab0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.413+0000 7f3de149b640 1 -- 172.21.15.92:0/1433670381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ddc100a40 msgr2=0x7f3ddc196d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:42.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.413+0000 7f3de149b640 1 --2- 172.21.15.92:0/1433670381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ddc100a40 0x7f3ddc196d10 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc031610 tx=0x7f3dcc0043b0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.413+0000 7f3de149b640 1 -- 172.21.15.92:0/1433670381 shutdown_connections 2024-09-19T09:00:42.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.413+0000 7f3de149b640 1 --2- 172.21.15.92:0/1433670381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ddc1025f0 0x7f3ddc19e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.413+0000 7f3de149b640 1 --2- 172.21.15.92:0/1433670381 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3ddc101c30 0x7f3ddc197250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.413+0000 7f3de149b640 1 --2- 172.21.15.92:0/1433670381 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3dc80a32f0 0x7f3dc80a57b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.413+0000 7f3de149b640 1 --2- 172.21.15.92:0/1433670381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ddc100a40 0x7f3ddc196d10 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.413+0000 7f3de149b640 1 -- 172.21.15.92:0/1433670381 >> 172.21.15.92:0/1433670381 conn(0x7f3ddc0fc1e0 msgr2=0x7f3ddc104f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:42.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.413+0000 7f3de149b640 1 -- 172.21.15.92:0/1433670381 shutdown_connections 2024-09-19T09:00:42.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:42.413+0000 7f3de149b640 1 -- 172.21.15.92:0/1433670381 wait complete. 2024-09-19T09:00:42.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.657+0000 7f067bd77640 1 -- 172.21.15.92:0/1339744981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0674101de0 msgr2=0x7f06741021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:42.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.657+0000 7f067bd77640 1 --2- 172.21.15.92:0/1339744981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0674101de0 0x7f06741021c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f0670009900 tx=0x7f067002a410 comp rx=0 tx=0).stop 2024-09-19T09:00:42.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.657+0000 7f067bd77640 1 -- 172.21.15.92:0/1339744981 shutdown_connections 2024-09-19T09:00:42.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.657+0000 7f067bd77640 1 --2- 172.21.15.92:0/1339744981 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0674106f10 0x7f067410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.657+0000 7f067bd77640 1 --2- 172.21.15.92:0/1339744981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0674102790 0x7f06741067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.657+0000 7f067bd77640 1 --2- 172.21.15.92:0/1339744981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0674101de0 0x7f06741021c0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.657+0000 7f067bd77640 1 -- 172.21.15.92:0/1339744981 >> 172.21.15.92:0/1339744981 conn(0x7f06740fd8e0 msgr2=0x7f06740ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:42.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.657+0000 7f067bd77640 1 -- 172.21.15.92:0/1339744981 shutdown_connections 2024-09-19T09:00:42.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.657+0000 7f067bd77640 1 -- 172.21.15.92:0/1339744981 wait complete. 2024-09-19T09:00:42.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.658+0000 7f067bd77640 1 Processor -- start 2024-09-19T09:00:42.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.658+0000 7f067bd77640 1 -- start start 2024-09-19T09:00:42.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.658+0000 7f067bd77640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0674101de0 0x7f0674198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:42.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.658+0000 7f067bd77640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0674102790 0x7f0674198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:42.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.658+0000 7f067bd77640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0674106f10 0x7f067419ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:42.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.658+0000 7f067bd77640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0674111f90 con 0x7f0674102790 2024-09-19T09:00:42.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.658+0000 7f067bd77640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0674111e10 con 0x7f0674101de0 2024-09-19T09:00:42.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.658+0000 7f067bd77640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0674112110 con 0x7f0674106f10 2024-09-19T09:00:42.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.658+0000 7f0679312640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0674102790 0x7f0674198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:42.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.658+0000 7f0679312640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0674102790 0x7f0674198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41148/0 (socket says 172.21.15.92:41148) 2024-09-19T09:00:42.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.658+0000 7f0679312640 1 -- 172.21.15.92:0/2683618101 learned_addr learned my addr 172.21.15.92:0/2683618101 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:42.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.658+0000 7f067a314640 1 --2- 172.21.15.92:0/2683618101 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0674106f10 0x7f067419ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:42.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.658+0000 7f0679b13640 1 --2- 172.21.15.92:0/2683618101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0674101de0 0x7f0674198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:42.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.658+0000 7f0679312640 1 -- 172.21.15.92:0/2683618101 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0674106f10 msgr2=0x7f067419ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:42.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.658+0000 7f0679312640 1 --2- 172.21.15.92:0/2683618101 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0674106f10 0x7f067419ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.658+0000 7f0679312640 1 -- 172.21.15.92:0/2683618101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0674101de0 msgr2=0x7f0674198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:42.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.658+0000 7f0679312640 1 --2- 172.21.15.92:0/2683618101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0674101de0 0x7f0674198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.658+0000 7f0679312640 1 -- 172.21.15.92:0/2683618101 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f067419d500 con 0x7f0674102790 2024-09-19T09:00:42.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.658+0000 7f0679b13640 1 --2- 172.21.15.92:0/2683618101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0674101de0 0x7f0674198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:00:42.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.659+0000 7f0679312640 1 --2- 172.21.15.92:0/2683618101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0674102790 0x7f0674198a90 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f066400b4a0 tx=0x7f066400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:42.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.659+0000 7f066affd640 1 -- 172.21.15.92:0/2683618101 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0664014070 con 0x7f0674102790 2024-09-19T09:00:42.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.659+0000 7f066affd640 1 -- 172.21.15.92:0/2683618101 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0664010af0 con 0x7f0674102790 2024-09-19T09:00:42.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.659+0000 7f067bd77640 1 -- 172.21.15.92:0/2683618101 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f067419d7f0 con 0x7f0674102790 2024-09-19T09:00:42.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.659+0000 7f066affd640 1 -- 172.21.15.92:0/2683618101 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0664017d10 con 0x7f0674102790 2024-09-19T09:00:42.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.659+0000 7f067bd77640 1 -- 172.21.15.92:0/2683618101 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06741a50d0 con 0x7f0674102790 2024-09-19T09:00:42.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.661+0000 7f066affd640 1 -- 172.21.15.92:0/2683618101 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0664017070 con 0x7f0674102790 2024-09-19T09:00:42.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.661+0000 7f067e150740 1 Processor -- start 2024-09-19T09:00:42.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.661+0000 7f067e150740 1 -- start start 2024-09-19T09:00:42.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.662+0000 7f067e150740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56041a7a2b40 0x56041a7a1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:42.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.662+0000 7f067e150740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56041a7a15d0 0x56041a7a1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:42.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.662+0000 7f067e150740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56041a7b0780 0x56041a7b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:42.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.662+0000 7f067e150740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56041a7072f0 con 0x56041a7a2b40 2024-09-19T09:00:42.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.662+0000 7f067e150740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56041a6aecf0 con 0x56041a7a15d0 2024-09-19T09:00:42.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.662+0000 7f067e150740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56041a7032b0 con 0x56041a7b0780 2024-09-19T09:00:42.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.662+0000 7f067a314640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56041a7a2b40 0x56041a7a1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:42.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.662+0000 7f067a314640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56041a7a2b40 0x56041a7a1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41164/0 (socket says 172.21.15.92:41164) 2024-09-19T09:00:42.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.662+0000 7f067a314640 1 -- 172.21.15.92:0/2267653950 learned_addr learned my addr 172.21.15.92:0/2267653950 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:42.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.662+0000 7f066affd640 1 --2- 172.21.15.92:0/2683618101 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f06600a32c0 0x7f06600a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:42.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.662+0000 7f0679312640 1 --2- 172.21.15.92:0/2267653950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56041a7b0780 0x56041a7b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:42.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.662+0000 7f0679b13640 1 --2- 172.21.15.92:0/2267653950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56041a7a15d0 0x56041a7a1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:42.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.662+0000 7f067a314640 1 --2- 172.21.15.92:0/2683618101 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f06600a32c0 0x7f06600a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:42.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.662+0000 7f067a314640 1 -- 172.21.15.92:0/2267653950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56041a7b0780 msgr2=0x56041a7b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:42.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.662+0000 7f067a314640 1 --2- 172.21.15.92:0/2267653950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56041a7b0780 0x56041a7b2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.662+0000 7f067a314640 1 -- 172.21.15.92:0/2267653950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56041a7a15d0 msgr2=0x56041a7a1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:42.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.662+0000 7f067a314640 1 --2- 172.21.15.92:0/2267653950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56041a7a15d0 0x56041a7a1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.662+0000 7f067a314640 1 -- 172.21.15.92:0/2267653950 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56041a6933a0 con 0x56041a7a2b40 2024-09-19T09:00:42.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.662+0000 7f0679b13640 1 --2- 172.21.15.92:0/2267653950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56041a7a15d0 0x56041a7a1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:00:42.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.662+0000 7f0679312640 1 --2- 172.21.15.92:0/2267653950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56041a7b0780 0x56041a7b2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:00:42.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.662+0000 7f066affd640 1 -- 172.21.15.92:0/2683618101 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f06640cec40 con 0x7f0674102790 2024-09-19T09:00:42.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.662+0000 7f067a314640 1 --2- 172.21.15.92:0/2267653950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56041a7a2b40 0x56041a7a1090 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f066c013a50 tx=0x7f066c013f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba709845828e200 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:42.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.663+0000 7f065ffff640 1 -- 172.21.15.92:0/2267653950 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066c013050 con 0x56041a7a2b40 2024-09-19T09:00:42.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.663+0000 7f065ffff640 1 -- 172.21.15.92:0/2267653950 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f066c022070 con 0x56041a7a2b40 2024-09-19T09:00:42.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.663+0000 7f065ffff640 1 -- 172.21.15.92:0/2267653950 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066c0126b0 con 0x56041a7a2b40 2024-09-19T09:00:42.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.663+0000 7f067e150740 1 -- 172.21.15.92:0/2267653950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56041a7a2b40 msgr2=0x56041a7a1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:42.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.663+0000 7f067a314640 1 --2- 172.21.15.92:0/2683618101 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f06600a32c0 0x7f06600a5780 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f066c021000 tx=0x7f066c01f000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:42.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.663+0000 7f067e150740 1 --2- 172.21.15.92:0/2267653950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56041a7a2b40 0x56041a7a1090 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f066c013a50 tx=0x7f066c013f10 comp rx=0 tx=0).stop 2024-09-19T09:00:42.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.663+0000 7f067e150740 1 -- 172.21.15.92:0/2267653950 shutdown_connections 2024-09-19T09:00:42.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.663+0000 7f067e150740 1 --2- 172.21.15.92:0/2267653950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56041a7b0780 0x56041a7b2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.663+0000 7f067e150740 1 --2- 172.21.15.92:0/2267653950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56041a7a15d0 0x56041a7a1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.663+0000 7f067e150740 1 --2- 172.21.15.92:0/2267653950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56041a7a2b40 0x56041a7a1090 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.663+0000 7f067e150740 1 -- 172.21.15.92:0/2267653950 >> 172.21.15.92:0/2267653950 conn(0x56041a76a310 msgr2=0x56041a79dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:42.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.664+0000 7f067e150740 1 -- 172.21.15.92:0/2267653950 shutdown_connections 2024-09-19T09:00:42.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.664+0000 7f067e150740 1 -- 172.21.15.92:0/2267653950 wait complete. 2024-09-19T09:00:42.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.664+0000 7f067e150740 1 -- start start 2024-09-19T09:00:42.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.664+0000 7f067e150740 1 Processor -- start 2024-09-19T09:00:42.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.664+0000 7f067e150740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56041a7a15d0 0x56041a7b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:42.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.664+0000 7f067e150740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56041a7a2b40 0x56041a7ad470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:42.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.664+0000 7f067e150740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56041a7b0780 0x56041a7adc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:42.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.664+0000 7f067e150740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56041a7b3480 con 0x56041a7a15d0 2024-09-19T09:00:42.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.664+0000 7f067e150740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56041a6c2060 con 0x56041a7b0780 2024-09-19T09:00:42.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.664+0000 7f067e150740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56041a7b3600 con 0x56041a7a2b40 2024-09-19T09:00:42.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.664+0000 7f067e150740 10 client.0 _ll_register_callbacks cb 0x56041a4158c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:42.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.665+0000 7f0679b13640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56041a7a15d0 0x56041a7b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:42.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.665+0000 7f0679b13640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56041a7a15d0 0x56041a7b01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41166/0 (socket says 172.21.15.92:41166) 2024-09-19T09:00:42.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.665+0000 7f0679b13640 1 -- 172.21.15.92:0/488235817 learned_addr learned my addr 172.21.15.92:0/488235817 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:42.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.665+0000 7f067a314640 1 --2- 172.21.15.92:0/488235817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56041a7b0780 0x56041a7adc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:42.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.665+0000 7f0679312640 1 --2- 172.21.15.92:0/488235817 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56041a7a2b40 0x56041a7ad470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:42.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.665+0000 7f0679b13640 1 -- 172.21.15.92:0/488235817 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56041a7a2b40 msgr2=0x56041a7ad470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:42.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.665+0000 7f0679b13640 1 --2- 172.21.15.92:0/488235817 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56041a7a2b40 0x56041a7ad470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.665+0000 7f0679b13640 1 -- 172.21.15.92:0/488235817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56041a7b0780 msgr2=0x56041a7adc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:42.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.665+0000 7f0679b13640 1 --2- 172.21.15.92:0/488235817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56041a7b0780 0x56041a7adc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.665+0000 7f0679b13640 1 -- 172.21.15.92:0/488235817 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56041a4783c0 con 0x56041a7a15d0 2024-09-19T09:00:42.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.665+0000 7f0679b13640 1 --2- 172.21.15.92:0/488235817 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56041a7a15d0 0x56041a7b01c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f0670009900 tx=0x7f06700319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7caac1e16a9437ce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:42.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.665+0000 7f065d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:00:42.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.665+0000 7f065d7fa640 1 -- 172.21.15.92:0/488235817 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067003f070 con 0x56041a7a15d0 2024-09-19T09:00:42.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.665+0000 7f065d7fa640 1 -- 172.21.15.92:0/488235817 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f0670004450 con 0x56041a7a15d0 2024-09-19T09:00:42.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.665+0000 7f067e150740 1 -- 172.21.15.92:0/488235817 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f066c022070 con 0x56041a7a15d0 2024-09-19T09:00:42.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.665+0000 7f065d7fa640 1 -- 172.21.15.92:0/488235817 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f0670035070 con 0x56041a7a15d0 2024-09-19T09:00:42.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.665+0000 7f067e150740 10 client.16290 fetch_fsmap learned FSMap version 19 2024-09-19T09:00:42.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.665+0000 7f067e150740 1 -- 172.21.15.92:0/488235817 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56041a7bef70 con 0x56041a7a15d0 2024-09-19T09:00:42.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.666+0000 7f065d7fa640 1 -- 172.21.15.92:0/488235817 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f066c022070 con 0x56041a7a15d0 2024-09-19T09:00:42.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.666+0000 7f065d7fa640 1 -- 172.21.15.92:0/488235817 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f06700035f0 con 0x56041a7a15d0 2024-09-19T09:00:42.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.666+0000 7f067e150740 10 client.16290 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:00:42.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.666+0000 7f067e150740 10 client.16290 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:00:42.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.666+0000 7f067e150740 20 client.16290 populate_metadata read hostname 'smithi092' 2024-09-19T09:00:42.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.666+0000 7f067e150740 1 --2- 172.21.15.92:0/488235817 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56041a7c0430 0x56041a7c2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:42.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.666+0000 7f067e150740 4 client.16290 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:00:42.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.666+0000 7f067e150740 1 -- 172.21.15.92:0/488235817 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56041a714860 con 0x56041a7c0430 2024-09-19T09:00:42.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.666+0000 7f0679312640 1 --2- 172.21.15.92:0/488235817 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56041a7c0430 0x56041a7c2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:42.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.667+0000 7f0679312640 1 --2- 172.21.15.92:0/488235817 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56041a7c0430 0x56041a7c2840 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2133198bbed86a2d server_cookie=87bc7061a9fcb775 in_seq=0 out_seq=0 2024-09-19T09:00:42.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.667+0000 7f065d7fa640 10 client.16290 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:42.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.667+0000 7f065d7fa640 1 -- 172.21.15.92:0/488235817 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f0664079e50 con 0x56041a7c0430 2024-09-19T09:00:42.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.667+0000 7f065d7fa640 10 client.16290 handle_command_reply: tid=0 2024-09-19T09:00:42.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.667+0000 7f067e150740 1 client.16290 shutdown 2024-09-19T09:00:42.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.667+0000 7f067e150740 1 -- 172.21.15.92:0/488235817 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56041a7a15d0 msgr2=0x56041a7b01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:42.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.667+0000 7f067e150740 1 --2- 172.21.15.92:0/488235817 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56041a7a15d0 0x56041a7b01c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f0670009900 tx=0x7f06700319a0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.668+0000 7f067e150740 1 -- 172.21.15.92:0/488235817 shutdown_connections 2024-09-19T09:00:42.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.668+0000 7f067e150740 1 --2- 172.21.15.92:0/488235817 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56041a7c0430 0x56041a7c2840 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.668+0000 7f067e150740 1 --2- 172.21.15.92:0/488235817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56041a7b0780 0x56041a7adc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.668+0000 7f067e150740 1 --2- 172.21.15.92:0/488235817 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56041a7a2b40 0x56041a7ad470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.668+0000 7f065d7fa640 0 client.16290 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:42.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.668+0000 7f067e150740 1 --2- 172.21.15.92:0/488235817 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56041a7a15d0 0x56041a7b01c0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.668+0000 7f067e150740 1 -- 172.21.15.92:0/488235817 >> 172.21.15.92:0/488235817 conn(0x56041a76a310 msgr2=0x56041a7a3960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:42.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.668+0000 7f067e150740 1 -- 172.21.15.92:0/488235817 shutdown_connections 2024-09-19T09:00:42.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.668+0000 7f067e150740 1 -- 172.21.15.92:0/488235817 wait complete. 2024-09-19T09:00:42.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.668+0000 7f067e150740 20 client.16290 trim_cache size 0 max 16384 2024-09-19T09:00:42.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.680+0000 7f067e150740 1 Processor -- start 2024-09-19T09:00:42.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.680+0000 7f067e150740 1 -- start start 2024-09-19T09:00:42.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.680+0000 7f067e150740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56041a7a15d0 0x56041a7acd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:42.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.680+0000 7f067e150740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56041a7a2b40 0x56041a7ac450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:42.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.680+0000 7f067e150740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56041a7b0780 0x56041a7c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:42.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.681+0000 7f067e150740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f06741a9390 con 0x56041a7a2b40 2024-09-19T09:00:42.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.681+0000 7f067e150740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f06741abc30 con 0x56041a7b0780 2024-09-19T09:00:42.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.681+0000 7f067e150740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f06741a9a20 con 0x56041a7a15d0 2024-09-19T09:00:42.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.681+0000 7f0679312640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56041a7a2b40 0x56041a7ac450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:42.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.681+0000 7f0679312640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56041a7a2b40 0x56041a7ac450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41176/0 (socket says 172.21.15.92:41176) 2024-09-19T09:00:42.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.681+0000 7f0679312640 1 -- 172.21.15.92:0/500290187 learned_addr learned my addr 172.21.15.92:0/500290187 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:42.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.681+0000 7f067a314640 1 --2- 172.21.15.92:0/500290187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56041a7b0780 0x56041a7c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:42.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.681+0000 7f0679312640 1 -- 172.21.15.92:0/500290187 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56041a7a15d0 msgr2=0x56041a7acd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:42.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.681+0000 7f0679b13640 1 --2- 172.21.15.92:0/500290187 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56041a7a15d0 0x56041a7acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:42.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.681+0000 7f0679312640 1 --2- 172.21.15.92:0/500290187 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56041a7a15d0 0x56041a7acd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.681+0000 7f0679312640 1 -- 172.21.15.92:0/500290187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56041a7b0780 msgr2=0x56041a7c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:42.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.681+0000 7f0679312640 1 --2- 172.21.15.92:0/500290187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56041a7b0780 0x56041a7c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.681+0000 7f0679312640 1 -- 172.21.15.92:0/500290187 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56041a7ab9c0 con 0x56041a7a2b40 2024-09-19T09:00:42.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.681+0000 7f067a314640 1 --2- 172.21.15.92:0/500290187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56041a7b0780 0x56041a7c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:00:42.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.681+0000 7f0679b13640 1 --2- 172.21.15.92:0/500290187 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56041a7a15d0 0x56041a7acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:00:42.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.681+0000 7f0679312640 1 --2- 172.21.15.92:0/500290187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56041a7a2b40 0x56041a7ac450 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f0664009420 tx=0x7f06640bb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d1870db4b0ab25 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:42.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.681+0000 7f065f7fe640 1 -- 172.21.15.92:0/500290187 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066401e040 con 0x56041a7a2b40 2024-09-19T09:00:42.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.681+0000 7f065f7fe640 1 -- 172.21.15.92:0/500290187 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x56041a714860 con 0x56041a7a2b40 2024-09-19T09:00:42.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.681+0000 7f065f7fe640 1 -- 172.21.15.92:0/500290187 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06640b9e60 con 0x56041a7a2b40 2024-09-19T09:00:42.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.682+0000 7f067e150740 1 -- 172.21.15.92:0/500290187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56041a7a2b40 msgr2=0x56041a7ac450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:42.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.682+0000 7f067e150740 1 --2- 172.21.15.92:0/500290187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56041a7a2b40 0x56041a7ac450 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f0664009420 tx=0x7f06640bb040 comp rx=0 tx=0).stop 2024-09-19T09:00:42.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.682+0000 7f067e150740 1 -- 172.21.15.92:0/500290187 shutdown_connections 2024-09-19T09:00:42.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.682+0000 7f067e150740 1 --2- 172.21.15.92:0/500290187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56041a7b0780 0x56041a7c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.682+0000 7f067e150740 1 --2- 172.21.15.92:0/500290187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56041a7a2b40 0x56041a7ac450 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.682+0000 7f067e150740 1 --2- 172.21.15.92:0/500290187 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56041a7a15d0 0x56041a7acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.682+0000 7f067e150740 1 -- 172.21.15.92:0/500290187 >> 172.21.15.92:0/500290187 conn(0x56041a76a310 msgr2=0x56041a7abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:42.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.682+0000 7f067e150740 1 -- 172.21.15.92:0/500290187 shutdown_connections 2024-09-19T09:00:42.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.682+0000 7f067e150740 1 -- 172.21.15.92:0/500290187 wait complete. 2024-09-19T09:00:42.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.682+0000 7f067e150740 1 -- start start 2024-09-19T09:00:42.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.682+0000 7f067e150740 1 Processor -- start 2024-09-19T09:00:42.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.683+0000 7f067e150740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56041a7a15d0 0x56041a7b9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:42.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.683+0000 7f067e150740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56041a7a2b40 0x56041a7b4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:42.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.683+0000 7f067e150740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56041a7b0780 0x56041a7b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:42.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.683+0000 7f067e150740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f06741aa0f0 con 0x56041a7a15d0 2024-09-19T09:00:42.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.683+0000 7f067e150740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f06741ab560 con 0x56041a7a2b40 2024-09-19T09:00:42.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.683+0000 7f067e150740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f06741aa7c0 con 0x56041a7b0780 2024-09-19T09:00:42.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.683+0000 7f067e150740 10 client.0 _ll_register_callbacks cb 0x7f0670009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:42.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.683+0000 7f0679b13640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56041a7a15d0 0x56041a7b9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:42.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.683+0000 7f0679b13640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56041a7a15d0 0x56041a7b9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41190/0 (socket says 172.21.15.92:41190) 2024-09-19T09:00:42.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.683+0000 7f0679b13640 1 -- 172.21.15.92:0/2493490107 learned_addr learned my addr 172.21.15.92:0/2493490107 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:42.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.683+0000 7f0679312640 1 --2- 172.21.15.92:0/2493490107 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56041a7a2b40 0x56041a7b4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:42.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.683+0000 7f0679b13640 1 -- 172.21.15.92:0/2493490107 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56041a7b0780 msgr2=0x56041a7b4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:42.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.683+0000 7f0679b13640 1 --2- 172.21.15.92:0/2493490107 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56041a7b0780 0x56041a7b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.683+0000 7f0679b13640 1 -- 172.21.15.92:0/2493490107 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56041a7a2b40 msgr2=0x56041a7b4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:42.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.683+0000 7f0679b13640 1 --2- 172.21.15.92:0/2493490107 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56041a7a2b40 0x56041a7b4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.683+0000 7f0679b13640 1 -- 172.21.15.92:0/2493490107 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56041a7b5250 con 0x56041a7a15d0 2024-09-19T09:00:42.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.683+0000 7f0679312640 1 --2- 172.21.15.92:0/2493490107 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56041a7a2b40 0x56041a7b4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:00:42.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.683+0000 7f0679b13640 1 --2- 172.21.15.92:0/2493490107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56041a7a15d0 0x56041a7b9100 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f0670005ab0 tx=0x7f0670003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6527a99d89445008 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:42.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.683+0000 7f065d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:00:42.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.683+0000 7f065d7fa640 1 -- 172.21.15.92:0/2493490107 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067003f070 con 0x56041a7a15d0 2024-09-19T09:00:42.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.683+0000 7f065d7fa640 1 -- 172.21.15.92:0/2493490107 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f0670031a10 con 0x56041a7a15d0 2024-09-19T09:00:42.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.683+0000 7f067e150740 1 -- 172.21.15.92:0/2493490107 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56041a714860 con 0x56041a7a15d0 2024-09-19T09:00:42.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.684+0000 7f065d7fa640 1 -- 172.21.15.92:0/2493490107 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f0670031c10 con 0x56041a7a15d0 2024-09-19T09:00:42.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.684+0000 7f067e150740 10 client.16296 fetch_fsmap learned FSMap version 19 2024-09-19T09:00:42.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.684+0000 7f067e150740 1 -- 172.21.15.92:0/2493490107 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56041a82b160 con 0x56041a7a15d0 2024-09-19T09:00:42.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.684+0000 7f065d7fa640 1 -- 172.21.15.92:0/2493490107 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x56041a714860 con 0x56041a7a15d0 2024-09-19T09:00:42.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.684+0000 7f065d7fa640 1 -- 172.21.15.92:0/2493490107 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f0670005130 con 0x56041a7a15d0 2024-09-19T09:00:42.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.684+0000 7f067e150740 10 client.16296 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:00:42.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.684+0000 7f067e150740 10 client.16296 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:00:42.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.684+0000 7f067e150740 20 client.16296 populate_metadata read hostname 'smithi092' 2024-09-19T09:00:42.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.684+0000 7f067e150740 1 --2- 172.21.15.92:0/2493490107 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56041a7c0430 0x56041a82d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:42.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.684+0000 7f067e150740 4 client.16296 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:00:42.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.684+0000 7f067e150740 1 -- 172.21.15.92:0/2493490107 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56041a70ed70 con 0x56041a7c0430 2024-09-19T09:00:42.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.684+0000 7f0679312640 1 --2- 172.21.15.92:0/2493490107 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56041a7c0430 0x56041a82d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:42.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.685+0000 7f065d7fa640 10 client.16296 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:42.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.685+0000 7f0679312640 1 --2- 172.21.15.92:0/2493490107 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56041a7c0430 0x56041a82d970 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70d1038d113de9b9 server_cookie=49023c9b3faa274a in_seq=0 out_seq=0 2024-09-19T09:00:42.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.685+0000 7f065d7fa640 1 -- 172.21.15.92:0/2493490107 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56041a70ed70 con 0x56041a7c0430 2024-09-19T09:00:42.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.685+0000 7f065d7fa640 10 client.16296 handle_command_reply: tid=0 2024-09-19T09:00:42.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.685+0000 7f067e150740 1 client.16296 shutdown 2024-09-19T09:00:42.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.685+0000 7f067e150740 1 -- 172.21.15.92:0/2493490107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56041a7a15d0 msgr2=0x56041a7b9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:42.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.685+0000 7f067e150740 1 --2- 172.21.15.92:0/2493490107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56041a7a15d0 0x56041a7b9100 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f0670005ab0 tx=0x7f0670003f60 comp rx=0 tx=0).stop 2024-09-19T09:00:42.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.685+0000 7f067e150740 1 -- 172.21.15.92:0/2493490107 shutdown_connections 2024-09-19T09:00:42.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.685+0000 7f067e150740 1 --2- 172.21.15.92:0/2493490107 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56041a7c0430 0x56041a82d970 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.685+0000 7f067e150740 1 --2- 172.21.15.92:0/2493490107 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56041a7b0780 0x56041a7b4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.685+0000 7f067e150740 1 --2- 172.21.15.92:0/2493490107 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56041a7a2b40 0x56041a7b4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.685+0000 7f067e150740 1 --2- 172.21.15.92:0/2493490107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56041a7a15d0 0x56041a7b9100 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.685+0000 7f065d7fa640 0 client.16296 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:42.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.685+0000 7f067e150740 1 -- 172.21.15.92:0/2493490107 >> 172.21.15.92:0/2493490107 conn(0x56041a76a310 msgr2=0x56041a79cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:42.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.685+0000 7f067e150740 1 -- 172.21.15.92:0/2493490107 shutdown_connections 2024-09-19T09:00:42.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.685+0000 7f067e150740 1 -- 172.21.15.92:0/2493490107 wait complete. 2024-09-19T09:00:42.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.685+0000 7f067e150740 20 client.16296 trim_cache size 0 max 16384 2024-09-19T09:00:42.691 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-19T09:00:42.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.686+0000 7f067bd77640 1 -- 172.21.15.92:0/2683618101 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f06600a32c0 msgr2=0x7f06600a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:42.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.686+0000 7f067bd77640 1 --2- 172.21.15.92:0/2683618101 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f06600a32c0 0x7f06600a5780 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f066c021000 tx=0x7f066c01f000 comp rx=0 tx=0).stop 2024-09-19T09:00:42.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.686+0000 7f067bd77640 1 -- 172.21.15.92:0/2683618101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0674102790 msgr2=0x7f0674198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:42.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.686+0000 7f067bd77640 1 --2- 172.21.15.92:0/2683618101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0674102790 0x7f0674198a90 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f066400b4a0 tx=0x7f066400b960 comp rx=0 tx=0).stop 2024-09-19T09:00:42.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.686+0000 7f067bd77640 1 -- 172.21.15.92:0/2683618101 shutdown_connections 2024-09-19T09:00:42.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.686+0000 7f067bd77640 1 --2- 172.21.15.92:0/2683618101 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0674106f10 0x7f067419ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.686+0000 7f067bd77640 1 --2- 172.21.15.92:0/2683618101 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f06600a32c0 0x7f06600a5780 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.686+0000 7f067bd77640 1 --2- 172.21.15.92:0/2683618101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0674102790 0x7f0674198a90 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.686+0000 7f067bd77640 1 --2- 172.21.15.92:0/2683618101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0674101de0 0x7f0674198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.686+0000 7f067bd77640 1 -- 172.21.15.92:0/2683618101 >> 172.21.15.92:0/2683618101 conn(0x7f06740fd8e0 msgr2=0x7f06740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:42.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.686+0000 7f067bd77640 1 -- 172.21.15.92:0/2683618101 shutdown_connections 2024-09-19T09:00:42.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:42.686+0000 7f067bd77640 1 -- 172.21.15.92:0/2683618101 wait complete. 2024-09-19T09:00:43.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:43 smithi092 ceph-mon[31407]: pgmap v457: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 960 KiB/s wr, 37 op/s 2024-09-19T09:00:43.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:43 smithi167 ceph-mon[35359]: pgmap v457: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 960 KiB/s wr, 37 op/s 2024-09-19T09:00:43.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:43 smithi190 ceph-mon[35358]: pgmap v457: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 960 KiB/s wr, 37 op/s 2024-09-19T09:00:44.467 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:00:44.467 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:00:44.737 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:44.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:44 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:00:44.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:44 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:00:44.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:44 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:00:45.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.203+0000 7f9f1390a640 1 -- 172.21.15.92:0/3486918721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f0c106f10 msgr2=0x7f9f0c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:45.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.203+0000 7f9f1390a640 1 --2- 172.21.15.92:0/3486918721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f0c106f10 0x7f9f0c10ea90 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f9f04009ca0 tx=0x7f9f0402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.203+0000 7f9f1390a640 1 -- 172.21.15.92:0/3486918721 shutdown_connections 2024-09-19T09:00:45.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.203+0000 7f9f1390a640 1 --2- 172.21.15.92:0/3486918721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f0c106f10 0x7f9f0c10ea90 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.203+0000 7f9f1390a640 1 --2- 172.21.15.92:0/3486918721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f0c102790 0x7f9f0c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.203+0000 7f9f1390a640 1 --2- 172.21.15.92:0/3486918721 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f0c101de0 0x7f9f0c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.203+0000 7f9f1390a640 1 -- 172.21.15.92:0/3486918721 >> 172.21.15.92:0/3486918721 conn(0x7f9f0c0fd8c0 msgr2=0x7f9f0c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:45.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.203+0000 7f9f1390a640 1 -- 172.21.15.92:0/3486918721 shutdown_connections 2024-09-19T09:00:45.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.203+0000 7f9f1390a640 1 -- 172.21.15.92:0/3486918721 wait complete. 2024-09-19T09:00:45.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.204+0000 7f9f1390a640 1 Processor -- start 2024-09-19T09:00:45.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.204+0000 7f9f1390a640 1 -- start start 2024-09-19T09:00:45.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.204+0000 7f9f1390a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f0c101de0 0x7f9f0c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.204+0000 7f9f1390a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f0c102790 0x7f9f0c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.204+0000 7f9f1390a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f0c106f10 0x7f9f0c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.204+0000 7f9f1390a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c111f90 con 0x7f9f0c106f10 2024-09-19T09:00:45.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.204+0000 7f9f1390a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c111e10 con 0x7f9f0c101de0 2024-09-19T09:00:45.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.204+0000 7f9f1390a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c112110 con 0x7f9f0c102790 2024-09-19T09:00:45.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.204+0000 7f9f11ea7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f0c106f10 0x7f9f0c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.204+0000 7f9f11ea7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f0c106f10 0x7f9f0c074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41198/0 (socket says 172.21.15.92:41198) 2024-09-19T09:00:45.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.204+0000 7f9f11ea7640 1 -- 172.21.15.92:0/820944797 learned_addr learned my addr 172.21.15.92:0/820944797 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:45.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.204+0000 7f9f10ea5640 1 --2- 172.21.15.92:0/820944797 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f0c102790 0x7f9f0c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.204+0000 7f9f116a6640 1 --2- 172.21.15.92:0/820944797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f0c101de0 0x7f9f0c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.204+0000 7f9f11ea7640 1 -- 172.21.15.92:0/820944797 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f0c102790 msgr2=0x7f9f0c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:45.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.204+0000 7f9f11ea7640 1 --2- 172.21.15.92:0/820944797 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f0c102790 0x7f9f0c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.204+0000 7f9f11ea7640 1 -- 172.21.15.92:0/820944797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f0c101de0 msgr2=0x7f9f0c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:45.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.204+0000 7f9f11ea7640 1 --2- 172.21.15.92:0/820944797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f0c101de0 0x7f9f0c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.204+0000 7f9f11ea7640 1 -- 172.21.15.92:0/820944797 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f0c1a68d0 con 0x7f9f0c106f10 2024-09-19T09:00:45.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.205+0000 7f9f11ea7640 1 --2- 172.21.15.92:0/820944797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f0c106f10 0x7f9f0c074f70 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f9f04031a60 tx=0x7f9f04031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:45.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.205+0000 7f9f027fc640 1 -- 172.21.15.92:0/820944797 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f04003b70 con 0x7f9f0c106f10 2024-09-19T09:00:45.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.205+0000 7f9f027fc640 1 -- 172.21.15.92:0/820944797 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f04003d10 con 0x7f9f0c106f10 2024-09-19T09:00:45.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.205+0000 7f9f1390a640 1 -- 172.21.15.92:0/820944797 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f0c1a6b60 con 0x7f9f0c106f10 2024-09-19T09:00:45.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.205+0000 7f9f027fc640 1 -- 172.21.15.92:0/820944797 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f04004770 con 0x7f9f0c106f10 2024-09-19T09:00:45.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.205+0000 7f9f1390a640 1 -- 172.21.15.92:0/820944797 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f0c1a70a0 con 0x7f9f0c106f10 2024-09-19T09:00:45.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.207+0000 7f9f027fc640 1 -- 172.21.15.92:0/820944797 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9f0402f790 con 0x7f9f0c106f10 2024-09-19T09:00:45.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.207+0000 7f9f15ce3740 1 Processor -- start 2024-09-19T09:00:45.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.207+0000 7f9f15ce3740 1 -- start start 2024-09-19T09:00:45.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.208+0000 7f9f027fc640 1 --2- 172.21.15.92:0/820944797 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9ef80a3240 0x7f9ef80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.208+0000 7f9f15ce3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e961d2bb60 0x55e961d2bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.208+0000 7f9f15ce3740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e961d2c480 0x55e961d36800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.208+0000 7f9f15ce3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e961d36d40 0x55e961d39130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.208+0000 7f9f15ce3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e961c91280 con 0x55e961d2bb60 2024-09-19T09:00:45.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.208+0000 7f9f15ce3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e961c38b10 con 0x55e961d36d40 2024-09-19T09:00:45.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.208+0000 7f9f15ce3740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e961c8d240 con 0x55e961d2c480 2024-09-19T09:00:45.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.208+0000 7f9f10ea5640 1 --2- 172.21.15.92:0/820944797 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9ef80a3240 0x7f9ef80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.208+0000 7f9f027fc640 1 -- 172.21.15.92:0/820944797 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9f040f0bc0 con 0x7f9f0c106f10 2024-09-19T09:00:45.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.208+0000 7f9f116a6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e961d2bb60 0x55e961d2bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.208+0000 7f9f116a6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e961d2bb60 0x55e961d2bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41200/0 (socket says 172.21.15.92:41200) 2024-09-19T09:00:45.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.208+0000 7f9f116a6640 1 -- 172.21.15.92:0/2648704859 learned_addr learned my addr 172.21.15.92:0/2648704859 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:45.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.208+0000 7f9f10ea5640 1 --2- 172.21.15.92:0/2648704859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e961d2c480 0x55e961d36800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.208+0000 7f9f11ea7640 1 --2- 172.21.15.92:0/2648704859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e961d36d40 0x55e961d39130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.208+0000 7f9f116a6640 1 -- 172.21.15.92:0/2648704859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e961d2c480 msgr2=0x55e961d36800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:45.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.208+0000 7f9f116a6640 1 --2- 172.21.15.92:0/2648704859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e961d2c480 0x55e961d36800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.208+0000 7f9f116a6640 1 -- 172.21.15.92:0/2648704859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e961d36d40 msgr2=0x55e961d39130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:45.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.208+0000 7f9f116a6640 1 --2- 172.21.15.92:0/2648704859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e961d36d40 0x55e961d39130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.208+0000 7f9f116a6640 1 -- 172.21.15.92:0/2648704859 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e961c451f0 con 0x55e961d2bb60 2024-09-19T09:00:45.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.208+0000 7f9f10ea5640 1 --2- 172.21.15.92:0/820944797 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9ef80a3240 0x7f9ef80a5700 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9efc0058c0 tx=0x7f9efc0138f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:45.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.208+0000 7f9f116a6640 1 --2- 172.21.15.92:0/2648704859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e961d2bb60 0x55e961d2bf40 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f9f08009a70 tx=0x7f9f08009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f9fb2b61c9ed769 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:45.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.209+0000 7f9ef77fe640 1 -- 172.21.15.92:0/2648704859 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f08017070 con 0x55e961d2bb60 2024-09-19T09:00:45.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.209+0000 7f9ef77fe640 1 -- 172.21.15.92:0/2648704859 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f08013470 con 0x55e961d2bb60 2024-09-19T09:00:45.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.209+0000 7f9ef77fe640 1 -- 172.21.15.92:0/2648704859 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f08012630 con 0x55e961d2bb60 2024-09-19T09:00:45.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.209+0000 7f9f15ce3740 1 -- 172.21.15.92:0/2648704859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e961d2bb60 msgr2=0x55e961d2bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:45.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.209+0000 7f9f15ce3740 1 --2- 172.21.15.92:0/2648704859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e961d2bb60 0x55e961d2bf40 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f9f08009a70 tx=0x7f9f08009f30 comp rx=0 tx=0).stop 2024-09-19T09:00:45.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.209+0000 7f9f15ce3740 1 -- 172.21.15.92:0/2648704859 shutdown_connections 2024-09-19T09:00:45.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.209+0000 7f9f15ce3740 1 --2- 172.21.15.92:0/2648704859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e961d36d40 0x55e961d39130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.209+0000 7f9f15ce3740 1 --2- 172.21.15.92:0/2648704859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e961d2c480 0x55e961d36800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.209+0000 7f9f15ce3740 1 --2- 172.21.15.92:0/2648704859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e961d2bb60 0x55e961d2bf40 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.209+0000 7f9f15ce3740 1 -- 172.21.15.92:0/2648704859 >> 172.21.15.92:0/2648704859 conn(0x55e961d280f0 msgr2=0x55e961d284d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:45.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.209+0000 7f9f15ce3740 1 -- 172.21.15.92:0/2648704859 shutdown_connections 2024-09-19T09:00:45.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.210+0000 7f9f15ce3740 1 -- 172.21.15.92:0/2648704859 wait complete. 2024-09-19T09:00:45.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.210+0000 7f9f15ce3740 1 -- start start 2024-09-19T09:00:45.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.210+0000 7f9f15ce3740 1 Processor -- start 2024-09-19T09:00:45.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.210+0000 7f9f15ce3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e961d2bb60 0x55e961d33bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.210+0000 7f9f15ce3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e961d2c480 0x55e961d340f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.210+0000 7f9f15ce3740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e961d36d40 0x55e961d34630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.210+0000 7f9f15ce3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e961d39910 con 0x55e961d2c480 2024-09-19T09:00:45.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.210+0000 7f9f15ce3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e961c4bf10 con 0x55e961d2bb60 2024-09-19T09:00:45.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.210+0000 7f9f15ce3740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e961d39a90 con 0x55e961d36d40 2024-09-19T09:00:45.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.210+0000 7f9f15ce3740 10 client.0 _ll_register_callbacks cb 0x55e961c14a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:45.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.210+0000 7f9f10ea5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e961d2c480 0x55e961d340f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.210+0000 7f9f10ea5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e961d2c480 0x55e961d340f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41202/0 (socket says 172.21.15.92:41202) 2024-09-19T09:00:45.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.210+0000 7f9f10ea5640 1 -- 172.21.15.92:0/2876344930 learned_addr learned my addr 172.21.15.92:0/2876344930 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:45.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.211+0000 7f9f116a6640 1 --2- 172.21.15.92:0/2876344930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e961d2bb60 0x55e961d33bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.211+0000 7f9f11ea7640 1 --2- 172.21.15.92:0/2876344930 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e961d36d40 0x55e961d34630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.211+0000 7f9f116a6640 1 -- 172.21.15.92:0/2876344930 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e961d36d40 msgr2=0x55e961d34630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:45.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.211+0000 7f9f116a6640 1 --2- 172.21.15.92:0/2876344930 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e961d36d40 0x55e961d34630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.211+0000 7f9f116a6640 1 -- 172.21.15.92:0/2876344930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e961d2c480 msgr2=0x55e961d340f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:45.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.211+0000 7f9f116a6640 1 --2- 172.21.15.92:0/2876344930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e961d2c480 0x55e961d340f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.211+0000 7f9f116a6640 1 -- 172.21.15.92:0/2876344930 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e961a026a0 con 0x55e961d2bb60 2024-09-19T09:00:45.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.211+0000 7f9f11ea7640 1 --2- 172.21.15.92:0/2876344930 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e961d36d40 0x55e961d34630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:00:45.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.211+0000 7f9f10ea5640 1 --2- 172.21.15.92:0/2876344930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e961d2c480 0x55e961d340f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:45.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.211+0000 7f9f116a6640 1 --2- 172.21.15.92:0/2876344930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e961d2bb60 0x55e961d33bb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9f08009a70 tx=0x7f9f0800ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b3cef3cce0b254a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:45.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.211+0000 7f9ef4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:00:45.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.211+0000 7f9ef4ff9640 1 -- 172.21.15.92:0/2876344930 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f08029060 con 0x55e961d2bb60 2024-09-19T09:00:45.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.211+0000 7f9ef4ff9640 1 -- 172.21.15.92:0/2876344930 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9f08013830 con 0x55e961d2bb60 2024-09-19T09:00:45.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.211+0000 7f9f15ce3740 1 -- 172.21.15.92:0/2876344930 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f08013470 con 0x55e961d2bb60 2024-09-19T09:00:45.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.211+0000 7f9ef4ff9640 1 -- 172.21.15.92:0/2876344930 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9f08017040 con 0x55e961d2bb60 2024-09-19T09:00:45.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.211+0000 7f9f15ce3740 10 client.25730 fetch_fsmap learned FSMap version 19 2024-09-19T09:00:45.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.211+0000 7f9f15ce3740 1 -- 172.21.15.92:0/2876344930 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e961d454a0 con 0x55e961d2bb60 2024-09-19T09:00:45.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.212+0000 7f9ef4ff9640 1 -- 172.21.15.92:0/2876344930 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f08013470 con 0x55e961d2bb60 2024-09-19T09:00:45.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.212+0000 7f9ef4ff9640 1 -- 172.21.15.92:0/2876344930 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f9f0802e070 con 0x55e961d2bb60 2024-09-19T09:00:45.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.212+0000 7f9f15ce3740 10 client.25730 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:00:45.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.212+0000 7f9f15ce3740 10 client.25730 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:00:45.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.212+0000 7f9f15ce3740 20 client.25730 populate_metadata read hostname 'smithi092' 2024-09-19T09:00:45.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.212+0000 7f9f15ce3740 1 --2- 172.21.15.92:0/2876344930 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e961d467f0 0x55e961d48be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.212+0000 7f9f15ce3740 4 client.25730 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:00:45.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.212+0000 7f9f15ce3740 1 -- 172.21.15.92:0/2876344930 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e961c9e7f0 con 0x55e961d467f0 2024-09-19T09:00:45.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.212+0000 7f9f10ea5640 1 --2- 172.21.15.92:0/2876344930 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e961d467f0 0x55e961d48be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.213+0000 7f9ef4ff9640 10 client.25730 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:45.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.213+0000 7f9f10ea5640 1 --2- 172.21.15.92:0/2876344930 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e961d467f0 0x55e961d48be0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94c4f6694b099b24 server_cookie=f044e540b53f156 in_seq=0 out_seq=0 2024-09-19T09:00:45.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.213+0000 7f9ef4ff9640 1 -- 172.21.15.92:0/2876344930 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e961c9e7f0 con 0x55e961d467f0 2024-09-19T09:00:45.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.213+0000 7f9ef4ff9640 10 client.25730 handle_command_reply: tid=0 2024-09-19T09:00:45.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.213+0000 7f9f15ce3740 1 client.25730 shutdown 2024-09-19T09:00:45.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.213+0000 7f9f15ce3740 1 -- 172.21.15.92:0/2876344930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e961d2bb60 msgr2=0x55e961d33bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:45.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.213+0000 7f9f15ce3740 1 --2- 172.21.15.92:0/2876344930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e961d2bb60 0x55e961d33bb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9f08009a70 tx=0x7f9f0800ecf0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.213+0000 7f9f15ce3740 1 -- 172.21.15.92:0/2876344930 shutdown_connections 2024-09-19T09:00:45.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.213+0000 7f9f15ce3740 1 --2- 172.21.15.92:0/2876344930 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e961d467f0 0x55e961d48be0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.213+0000 7f9f15ce3740 1 --2- 172.21.15.92:0/2876344930 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e961d36d40 0x55e961d34630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.213+0000 7f9f15ce3740 1 --2- 172.21.15.92:0/2876344930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e961d2c480 0x55e961d340f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.213+0000 7f9ef4ff9640 0 client.25730 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:45.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.213+0000 7f9f15ce3740 1 --2- 172.21.15.92:0/2876344930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e961d2bb60 0x55e961d33bb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.213+0000 7f9f15ce3740 1 -- 172.21.15.92:0/2876344930 >> 172.21.15.92:0/2876344930 conn(0x55e961d280f0 msgr2=0x55e961d27270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:45.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.214+0000 7f9f15ce3740 1 -- 172.21.15.92:0/2876344930 shutdown_connections 2024-09-19T09:00:45.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.214+0000 7f9f15ce3740 1 -- 172.21.15.92:0/2876344930 wait complete. 2024-09-19T09:00:45.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.214+0000 7f9f15ce3740 20 client.25730 trim_cache size 0 max 16384 2024-09-19T09:00:45.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.231+0000 7f9f15ce3740 1 Processor -- start 2024-09-19T09:00:45.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.231+0000 7f9f15ce3740 1 -- start start 2024-09-19T09:00:45.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.231+0000 7f9f15ce3740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e961d2bb60 0x55e961d32a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.231+0000 7f9f15ce3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e961d2c480 0x55e961d4e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.231+0000 7f9f15ce3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e961d36d40 0x55e961d4e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.231+0000 7f9f15ce3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c1ad700 con 0x55e961d36d40 2024-09-19T09:00:45.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.231+0000 7f9f15ce3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c1affa0 con 0x55e961d2c480 2024-09-19T09:00:45.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.231+0000 7f9f15ce3740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c1add90 con 0x55e961d2bb60 2024-09-19T09:00:45.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.231+0000 7f9f11ea7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e961d36d40 0x55e961d4e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.231+0000 7f9f11ea7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e961d36d40 0x55e961d4e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41216/0 (socket says 172.21.15.92:41216) 2024-09-19T09:00:45.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.231+0000 7f9f11ea7640 1 -- 172.21.15.92:0/4291157197 learned_addr learned my addr 172.21.15.92:0/4291157197 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:45.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.231+0000 7f9f116a6640 1 --2- 172.21.15.92:0/4291157197 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e961d2bb60 0x55e961d32a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.231+0000 7f9f10ea5640 1 --2- 172.21.15.92:0/4291157197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e961d2c480 0x55e961d4e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.231+0000 7f9f11ea7640 1 -- 172.21.15.92:0/4291157197 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e961d2bb60 msgr2=0x55e961d32a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:45.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.231+0000 7f9f11ea7640 1 --2- 172.21.15.92:0/4291157197 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e961d2bb60 0x55e961d32a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.231+0000 7f9f11ea7640 1 -- 172.21.15.92:0/4291157197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e961d2c480 msgr2=0x55e961d4e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:45.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.231+0000 7f9f11ea7640 1 --2- 172.21.15.92:0/4291157197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e961d2c480 0x55e961d4e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.231+0000 7f9f11ea7640 1 -- 172.21.15.92:0/4291157197 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e961d27f20 con 0x55e961d36d40 2024-09-19T09:00:45.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.231+0000 7f9f10ea5640 1 --2- 172.21.15.92:0/4291157197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e961d2c480 0x55e961d4e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:00:45.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.232+0000 7f9f11ea7640 1 --2- 172.21.15.92:0/4291157197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e961d36d40 0x55e961d4e860 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f9f04009430 tx=0x7f9f04033040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f89a8aacf1b06e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:45.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.232+0000 7f9ef6ffd640 1 -- 172.21.15.92:0/4291157197 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f040bd8a0 con 0x55e961d36d40 2024-09-19T09:00:45.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.232+0000 7f9ef6ffd640 1 -- 172.21.15.92:0/4291157197 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f04036040 con 0x55e961d36d40 2024-09-19T09:00:45.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.232+0000 7f9ef6ffd640 1 -- 172.21.15.92:0/4291157197 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f040ee790 con 0x55e961d36d40 2024-09-19T09:00:45.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.232+0000 7f9f15ce3740 1 -- 172.21.15.92:0/4291157197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e961d36d40 msgr2=0x55e961d4e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:45.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.232+0000 7f9f15ce3740 1 --2- 172.21.15.92:0/4291157197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e961d36d40 0x55e961d4e860 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f9f04009430 tx=0x7f9f04033040 comp rx=0 tx=0).stop 2024-09-19T09:00:45.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.232+0000 7f9f15ce3740 1 -- 172.21.15.92:0/4291157197 shutdown_connections 2024-09-19T09:00:45.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.232+0000 7f9f15ce3740 1 --2- 172.21.15.92:0/4291157197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e961d36d40 0x55e961d4e860 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.232+0000 7f9f15ce3740 1 --2- 172.21.15.92:0/4291157197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e961d2c480 0x55e961d4e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.232+0000 7f9f15ce3740 1 --2- 172.21.15.92:0/4291157197 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e961d2bb60 0x55e961d32a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.232+0000 7f9f15ce3740 1 -- 172.21.15.92:0/4291157197 >> 172.21.15.92:0/4291157197 conn(0x55e961d280f0 msgr2=0x55e961d32350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:45.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.232+0000 7f9f15ce3740 1 -- 172.21.15.92:0/4291157197 shutdown_connections 2024-09-19T09:00:45.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.232+0000 7f9f15ce3740 1 -- 172.21.15.92:0/4291157197 wait complete. 2024-09-19T09:00:45.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.233+0000 7f9f15ce3740 1 -- start start 2024-09-19T09:00:45.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.233+0000 7f9f15ce3740 1 Processor -- start 2024-09-19T09:00:45.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.233+0000 7f9f15ce3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e961d2bb60 0x55e961d3f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.233+0000 7f9f15ce3740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e961d2c480 0x55e961d3a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.233+0000 7f9f15ce3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e961d36d40 0x55e961d3b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.233+0000 7f9f15ce3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c1ae460 con 0x55e961d36d40 2024-09-19T09:00:45.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.233+0000 7f9f15ce3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c1af8d0 con 0x55e961d2bb60 2024-09-19T09:00:45.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.233+0000 7f9f15ce3740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c1aeb30 con 0x55e961d2c480 2024-09-19T09:00:45.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.233+0000 7f9f15ce3740 10 client.0 _ll_register_callbacks cb 0x7f9f04042ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:45.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.233+0000 7f9f11ea7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e961d36d40 0x55e961d3b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.233+0000 7f9f11ea7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e961d36d40 0x55e961d3b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41228/0 (socket says 172.21.15.92:41228) 2024-09-19T09:00:45.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.233+0000 7f9f11ea7640 1 -- 172.21.15.92:0/872521283 learned_addr learned my addr 172.21.15.92:0/872521283 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:45.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.233+0000 7f9f116a6640 1 --2- 172.21.15.92:0/872521283 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e961d2bb60 0x55e961d3f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.233+0000 7f9f10ea5640 1 --2- 172.21.15.92:0/872521283 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e961d2c480 0x55e961d3a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.234+0000 7f9f11ea7640 1 -- 172.21.15.92:0/872521283 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e961d2c480 msgr2=0x55e961d3a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:45.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.234+0000 7f9f11ea7640 1 --2- 172.21.15.92:0/872521283 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e961d2c480 0x55e961d3a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.234+0000 7f9f11ea7640 1 -- 172.21.15.92:0/872521283 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e961d2bb60 msgr2=0x55e961d3f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:45.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.234+0000 7f9f11ea7640 1 --2- 172.21.15.92:0/872521283 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e961d2bb60 0x55e961d3f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.234+0000 7f9f11ea7640 1 -- 172.21.15.92:0/872521283 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e961d2e9d0 con 0x55e961d36d40 2024-09-19T09:00:45.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.234+0000 7f9f10ea5640 1 --2- 172.21.15.92:0/872521283 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e961d2c480 0x55e961d3a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:00:45.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.234+0000 7f9f116a6640 1 --2- 172.21.15.92:0/872521283 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e961d2bb60 0x55e961d3f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:00:45.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.234+0000 7f9f11ea7640 1 --2- 172.21.15.92:0/872521283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e961d36d40 0x55e961d3b050 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f9f04031b50 tx=0x7f9f04004980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f1fc251df9ed557 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:45.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.234+0000 7f9ef4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:00:45.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.234+0000 7f9ef4ff9640 1 -- 172.21.15.92:0/872521283 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f040db020 con 0x55e961d36d40 2024-09-19T09:00:45.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.234+0000 7f9ef4ff9640 1 -- 172.21.15.92:0/872521283 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9f040881f0 con 0x55e961d36d40 2024-09-19T09:00:45.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.234+0000 7f9f15ce3740 1 -- 172.21.15.92:0/872521283 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f04036040 con 0x55e961d36d40 2024-09-19T09:00:45.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.234+0000 7f9ef4ff9640 1 -- 172.21.15.92:0/872521283 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9f040c1550 con 0x55e961d36d40 2024-09-19T09:00:45.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.234+0000 7f9f15ce3740 10 client.16314 fetch_fsmap learned FSMap version 19 2024-09-19T09:00:45.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.234+0000 7f9f15ce3740 1 -- 172.21.15.92:0/872521283 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e961db12c0 con 0x55e961d36d40 2024-09-19T09:00:45.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.234+0000 7f9ef4ff9640 1 -- 172.21.15.92:0/872521283 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f04036040 con 0x55e961d36d40 2024-09-19T09:00:45.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.234+0000 7f9ef4ff9640 1 -- 172.21.15.92:0/872521283 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f9f040dd0b0 con 0x55e961d36d40 2024-09-19T09:00:45.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.234+0000 7f9f15ce3740 10 client.16314 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:00:45.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.234+0000 7f9f15ce3740 10 client.16314 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:00:45.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.234+0000 7f9f15ce3740 20 client.16314 populate_metadata read hostname 'smithi092' 2024-09-19T09:00:45.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.234+0000 7f9f15ce3740 1 --2- 172.21.15.92:0/872521283 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e961db1980 0x55e961db3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.234+0000 7f9f15ce3740 4 client.16314 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:00:45.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.234+0000 7f9f15ce3740 1 -- 172.21.15.92:0/872521283 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e961c98d00 con 0x55e961db1980 2024-09-19T09:00:45.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.235+0000 7f9f116a6640 1 --2- 172.21.15.92:0/872521283 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e961db1980 0x55e961db3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.235+0000 7f9f116a6640 1 --2- 172.21.15.92:0/872521283 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e961db1980 0x55e961db3d70 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53cfea6f1f11eda7 server_cookie=990772ca8be7368c in_seq=0 out_seq=0 2024-09-19T09:00:45.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.235+0000 7f9ef4ff9640 10 client.16314 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:45.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.236+0000 7f9ef4ff9640 1 -- 172.21.15.92:0/872521283 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e961c98d00 con 0x55e961db1980 2024-09-19T09:00:45.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.236+0000 7f9ef4ff9640 10 client.16314 handle_command_reply: tid=0 2024-09-19T09:00:45.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.236+0000 7f9f15ce3740 1 client.16314 shutdown 2024-09-19T09:00:45.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.236+0000 7f9f15ce3740 1 -- 172.21.15.92:0/872521283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e961d36d40 msgr2=0x55e961d3b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:45.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.236+0000 7f9f15ce3740 1 --2- 172.21.15.92:0/872521283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e961d36d40 0x55e961d3b050 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f9f04031b50 tx=0x7f9f04004980 comp rx=0 tx=0).stop 2024-09-19T09:00:45.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.236+0000 7f9f15ce3740 1 -- 172.21.15.92:0/872521283 shutdown_connections 2024-09-19T09:00:45.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.236+0000 7f9f15ce3740 1 --2- 172.21.15.92:0/872521283 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e961db1980 0x55e961db3d70 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.236+0000 7f9f15ce3740 1 --2- 172.21.15.92:0/872521283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e961d36d40 0x55e961d3b050 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.236+0000 7f9f15ce3740 1 --2- 172.21.15.92:0/872521283 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e961d2c480 0x55e961d3a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.236+0000 7f9f15ce3740 1 --2- 172.21.15.92:0/872521283 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e961d2bb60 0x55e961d3f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.236+0000 7f9ef4ff9640 0 client.16314 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:45.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.236+0000 7f9f15ce3740 1 -- 172.21.15.92:0/872521283 >> 172.21.15.92:0/872521283 conn(0x55e961d280f0 msgr2=0x55e961d27270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:45.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.236+0000 7f9f15ce3740 1 -- 172.21.15.92:0/872521283 shutdown_connections 2024-09-19T09:00:45.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.236+0000 7f9f15ce3740 1 -- 172.21.15.92:0/872521283 wait complete. 2024-09-19T09:00:45.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.237+0000 7f9f15ce3740 20 client.16314 trim_cache size 0 max 16384 2024-09-19T09:00:45.242 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:00:45.242 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-19T09:00:45.242 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "b4c1f6eb-837f-4584-8b1d-505cc8aec8ed", 2024-09-19T09:00:45.242 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-19T09:00:45.242 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:00:45.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.237+0000 7f9f1390a640 1 -- 172.21.15.92:0/820944797 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9ef80a3240 msgr2=0x7f9ef80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:45.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.237+0000 7f9f1390a640 1 --2- 172.21.15.92:0/820944797 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9ef80a3240 0x7f9ef80a5700 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9efc0058c0 tx=0x7f9efc0138f0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.237+0000 7f9f1390a640 1 -- 172.21.15.92:0/820944797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f0c106f10 msgr2=0x7f9f0c074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:45.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.237+0000 7f9f1390a640 1 --2- 172.21.15.92:0/820944797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f0c106f10 0x7f9f0c074f70 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f9f04031a60 tx=0x7f9f04031a90 comp rx=0 tx=0).stop 2024-09-19T09:00:45.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.237+0000 7f9f1390a640 1 -- 172.21.15.92:0/820944797 shutdown_connections 2024-09-19T09:00:45.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.237+0000 7f9f1390a640 1 --2- 172.21.15.92:0/820944797 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9ef80a3240 0x7f9ef80a5700 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.237+0000 7f9f1390a640 1 --2- 172.21.15.92:0/820944797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f0c106f10 0x7f9f0c074f70 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.237+0000 7f9f1390a640 1 --2- 172.21.15.92:0/820944797 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f0c102790 0x7f9f0c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.237+0000 7f9f1390a640 1 --2- 172.21.15.92:0/820944797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f0c101de0 0x7f9f0c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.237+0000 7f9f1390a640 1 -- 172.21.15.92:0/820944797 >> 172.21.15.92:0/820944797 conn(0x7f9f0c0fd8c0 msgr2=0x7f9f0c0ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:45.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.237+0000 7f9f1390a640 1 -- 172.21.15.92:0/820944797 shutdown_connections 2024-09-19T09:00:45.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:45.237+0000 7f9f1390a640 1 -- 172.21.15.92:0/820944797 wait complete. 2024-09-19T09:00:45.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:45 smithi092 ceph-mon[31407]: pgmap v458: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 621 KiB/s wr, 12 op/s 2024-09-19T09:00:45.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:45 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:45.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:45 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:00:45.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:45 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:00:45.798 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:00:45.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:45 smithi167 ceph-mon[35359]: pgmap v458: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 621 KiB/s wr, 12 op/s 2024-09-19T09:00:45.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:45 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:45.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:45 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:00:45.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:45 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:00:45.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:45 smithi190 ceph-mon[35358]: pgmap v458: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 621 KiB/s wr, 12 op/s 2024-09-19T09:00:45.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:45 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:45.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:45 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:00:45.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:45 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:00:45.954 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:00:46.200 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:46.574 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:46 smithi092 ceph-mon[31407]: scrub queued for path: / 2024-09-19T09:00:46.574 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:46 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:00:46.574 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:46 smithi092 ceph-mon[31407]: scrub summary: active paths [/] 2024-09-19T09:00:46.574 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:46 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:00:46.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.652+0000 7fc144ea6640 1 -- 172.21.15.92:0/2449586877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc140102d90 msgr2=0x7fc140103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:46.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.652+0000 7fc144ea6640 1 --2- 172.21.15.92:0/2449586877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc140102d90 0x7fc140103170 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fc130009cd0 tx=0x7fc13002a8e0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.652+0000 7fc144ea6640 1 -- 172.21.15.92:0/2449586877 shutdown_connections 2024-09-19T09:00:46.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.652+0000 7fc144ea6640 1 --2- 172.21.15.92:0/2449586877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc140108290 0x7fc14010ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.652+0000 7fc144ea6640 1 --2- 172.21.15.92:0/2449586877 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc140103740 0x7fc140107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.652+0000 7fc144ea6640 1 --2- 172.21.15.92:0/2449586877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc140102d90 0x7fc140103170 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.652+0000 7fc144ea6640 1 -- 172.21.15.92:0/2449586877 >> 172.21.15.92:0/2449586877 conn(0x7fc1400fc7d0 msgr2=0x7fc1400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:46.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.652+0000 7fc144ea6640 1 -- 172.21.15.92:0/2449586877 shutdown_connections 2024-09-19T09:00:46.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.652+0000 7fc144ea6640 1 -- 172.21.15.92:0/2449586877 wait complete. 2024-09-19T09:00:46.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.653+0000 7fc144ea6640 1 Processor -- start 2024-09-19T09:00:46.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.653+0000 7fc144ea6640 1 -- start start 2024-09-19T09:00:46.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.653+0000 7fc144ea6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc140102d90 0x7fc1401984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.653+0000 7fc144ea6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc140103740 0x7fc140198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.653+0000 7fc144ea6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc140108290 0x7fc14019cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.653+0000 7fc144ea6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc140112090 con 0x7fc140103740 2024-09-19T09:00:46.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.653+0000 7fc144ea6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc140111f10 con 0x7fc140102d90 2024-09-19T09:00:46.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.653+0000 7fc144ea6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc140112210 con 0x7fc140108290 2024-09-19T09:00:46.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.653+0000 7fc13dd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc140103740 0x7fc140198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:46.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.653+0000 7fc13dd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc140103740 0x7fc140198a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41242/0 (socket says 172.21.15.92:41242) 2024-09-19T09:00:46.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.653+0000 7fc13dd9b640 1 -- 172.21.15.92:0/2900445268 learned_addr learned my addr 172.21.15.92:0/2900445268 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:46.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.653+0000 7fc13ed9d640 1 --2- 172.21.15.92:0/2900445268 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc140108290 0x7fc14019cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:46.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.653+0000 7fc13e59c640 1 --2- 172.21.15.92:0/2900445268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc140102d90 0x7fc1401984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:46.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.653+0000 7fc13dd9b640 1 -- 172.21.15.92:0/2900445268 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc140108290 msgr2=0x7fc14019cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:46.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.653+0000 7fc13dd9b640 1 --2- 172.21.15.92:0/2900445268 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc140108290 0x7fc14019cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.653+0000 7fc13dd9b640 1 -- 172.21.15.92:0/2900445268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc140102d90 msgr2=0x7fc1401984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:46.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.653+0000 7fc13dd9b640 1 --2- 172.21.15.92:0/2900445268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc140102d90 0x7fc1401984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.653+0000 7fc13dd9b640 1 -- 172.21.15.92:0/2900445268 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc14019d4a0 con 0x7fc140103740 2024-09-19T09:00:46.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.653+0000 7fc13dd9b640 1 --2- 172.21.15.92:0/2900445268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc140103740 0x7fc140198a30 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fc13400c970 tx=0x7fc13400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:46.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.654+0000 7fc12f7fe640 1 -- 172.21.15.92:0/2900445268 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc134014070 con 0x7fc140103740 2024-09-19T09:00:46.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.654+0000 7fc144ea6640 1 -- 172.21.15.92:0/2900445268 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc14019d790 con 0x7fc140103740 2024-09-19T09:00:46.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.654+0000 7fc12f7fe640 1 -- 172.21.15.92:0/2900445268 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc134004440 con 0x7fc140103740 2024-09-19T09:00:46.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.654+0000 7fc12f7fe640 1 -- 172.21.15.92:0/2900445268 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc13400f450 con 0x7fc140103740 2024-09-19T09:00:46.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.654+0000 7fc144ea6640 1 -- 172.21.15.92:0/2900445268 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1401a5070 con 0x7fc140103740 2024-09-19T09:00:46.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.656+0000 7fc12f7fe640 1 -- 172.21.15.92:0/2900445268 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc134017070 con 0x7fc140103740 2024-09-19T09:00:46.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.656+0000 7fc14727f740 1 Processor -- start 2024-09-19T09:00:46.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.657+0000 7fc14727f740 1 -- start start 2024-09-19T09:00:46.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.657+0000 7fc12f7fe640 1 --2- 172.21.15.92:0/2900445268 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc1280a3240 0x7fc1280a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.657+0000 7fc14727f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd762584a0 0x55fd76258880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.657+0000 7fc14727f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd76258dc0 0x55fd76263140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.657+0000 7fc14727f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd76263680 0x55fd76265a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.657+0000 7fc14727f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55fd761be2e0 con 0x55fd76258dc0 2024-09-19T09:00:46.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.657+0000 7fc14727f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55fd76165ce0 con 0x55fd762584a0 2024-09-19T09:00:46.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.657+0000 7fc14727f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55fd761ba2a0 con 0x55fd76263680 2024-09-19T09:00:46.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.657+0000 7fc13ed9d640 1 --2- 172.21.15.92:0/2900445268 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc1280a3240 0x7fc1280a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:46.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.657+0000 7fc12f7fe640 1 -- 172.21.15.92:0/2900445268 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc1340cf6e0 con 0x7fc140103740 2024-09-19T09:00:46.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.657+0000 7fc13dd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd76258dc0 0x55fd76263140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:46.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.657+0000 7fc13dd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd76258dc0 0x55fd76263140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41248/0 (socket says 172.21.15.92:41248) 2024-09-19T09:00:46.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.657+0000 7fc13dd9b640 1 -- 172.21.15.92:0/2109605736 learned_addr learned my addr 172.21.15.92:0/2109605736 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:46.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.657+0000 7fc13ed9d640 1 --2- 172.21.15.92:0/2109605736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd76263680 0x55fd76265a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:46.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.657+0000 7fc13e59c640 1 --2- 172.21.15.92:0/2109605736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd762584a0 0x55fd76258880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:46.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.657+0000 7fc13dd9b640 1 -- 172.21.15.92:0/2109605736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd76263680 msgr2=0x55fd76265a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:46.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.657+0000 7fc13dd9b640 1 --2- 172.21.15.92:0/2109605736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd76263680 0x55fd76265a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.657+0000 7fc13dd9b640 1 -- 172.21.15.92:0/2109605736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd762584a0 msgr2=0x55fd76258880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:46.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.657+0000 7fc13dd9b640 1 --2- 172.21.15.92:0/2109605736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd762584a0 0x55fd76258880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.657+0000 7fc13ed9d640 1 --2- 172.21.15.92:0/2900445268 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc1280a3240 0x7fc1280a5700 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc13800b970 tx=0x7fc13800bd70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:46.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.657+0000 7fc13dd9b640 1 -- 172.21.15.92:0/2109605736 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd7614a440 con 0x55fd76258dc0 2024-09-19T09:00:46.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.658+0000 7fc13dd9b640 1 --2- 172.21.15.92:0/2109605736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd76258dc0 0x55fd76263140 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fc1340a4400 tx=0x7fc134000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed2127bf02efff95 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:46.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.658+0000 7fc12cff9640 1 -- 172.21.15.92:0/2109605736 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc13409bcc0 con 0x55fd76258dc0 2024-09-19T09:00:46.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.658+0000 7fc12cff9640 1 -- 172.21.15.92:0/2109605736 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1340a0070 con 0x55fd76258dc0 2024-09-19T09:00:46.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.658+0000 7fc12cff9640 1 -- 172.21.15.92:0/2109605736 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc134098330 con 0x55fd76258dc0 2024-09-19T09:00:46.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.658+0000 7fc14727f740 1 -- 172.21.15.92:0/2109605736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd76258dc0 msgr2=0x55fd76263140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:46.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.658+0000 7fc14727f740 1 --2- 172.21.15.92:0/2109605736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd76258dc0 0x55fd76263140 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fc1340a4400 tx=0x7fc134000bc0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.658+0000 7fc14727f740 1 -- 172.21.15.92:0/2109605736 shutdown_connections 2024-09-19T09:00:46.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.658+0000 7fc14727f740 1 --2- 172.21.15.92:0/2109605736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd76263680 0x55fd76265a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.658+0000 7fc14727f740 1 --2- 172.21.15.92:0/2109605736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd76258dc0 0x55fd76263140 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.659+0000 7fc14727f740 1 --2- 172.21.15.92:0/2109605736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd762584a0 0x55fd76258880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.659+0000 7fc14727f740 1 -- 172.21.15.92:0/2109605736 >> 172.21.15.92:0/2109605736 conn(0x55fd76254a30 msgr2=0x55fd76254e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:46.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.659+0000 7fc14727f740 1 -- 172.21.15.92:0/2109605736 shutdown_connections 2024-09-19T09:00:46.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.659+0000 7fc14727f740 1 -- 172.21.15.92:0/2109605736 wait complete. 2024-09-19T09:00:46.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.659+0000 7fc14727f740 1 -- start start 2024-09-19T09:00:46.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.659+0000 7fc14727f740 1 Processor -- start 2024-09-19T09:00:46.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.659+0000 7fc14727f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd762584a0 0x55fd76262f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.659+0000 7fc14727f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd76258dc0 0x55fd76260220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.659+0000 7fc14727f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd76263680 0x55fd76260760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.659+0000 7fc14727f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55fd76266250 con 0x55fd762584a0 2024-09-19T09:00:46.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.659+0000 7fc14727f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55fd76179050 con 0x55fd76263680 2024-09-19T09:00:46.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.659+0000 7fc14727f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55fd762663d0 con 0x55fd76258dc0 2024-09-19T09:00:46.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.659+0000 7fc14727f740 10 client.0 _ll_register_callbacks cb 0x55fd761b9160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:46.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.659+0000 7fc13e59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd762584a0 0x55fd76262f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:46.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.659+0000 7fc13e59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd762584a0 0x55fd76262f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41256/0 (socket says 172.21.15.92:41256) 2024-09-19T09:00:46.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.659+0000 7fc13e59c640 1 -- 172.21.15.92:0/737788548 learned_addr learned my addr 172.21.15.92:0/737788548 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:46.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.659+0000 7fc13ed9d640 1 --2- 172.21.15.92:0/737788548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd76263680 0x55fd76260760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:46.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.659+0000 7fc13dd9b640 1 --2- 172.21.15.92:0/737788548 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd76258dc0 0x55fd76260220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:46.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.660+0000 7fc13e59c640 1 -- 172.21.15.92:0/737788548 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd76258dc0 msgr2=0x55fd76260220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:46.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.660+0000 7fc13e59c640 1 --2- 172.21.15.92:0/737788548 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd76258dc0 0x55fd76260220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.660+0000 7fc13e59c640 1 -- 172.21.15.92:0/737788548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd76263680 msgr2=0x55fd76260760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:46.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.660+0000 7fc13e59c640 1 --2- 172.21.15.92:0/737788548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd76263680 0x55fd76260760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.660+0000 7fc13e59c640 1 -- 172.21.15.92:0/737788548 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd75f2f3c0 con 0x55fd762584a0 2024-09-19T09:00:46.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.660+0000 7fc13e59c640 1 --2- 172.21.15.92:0/737788548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd762584a0 0x55fd76262f70 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc130009cd0 tx=0x7fc130031cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=295fbf0ff473185d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:46.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.660+0000 7fc125ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:00:46.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.660+0000 7fc125ffb640 1 -- 172.21.15.92:0/737788548 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc130049060 con 0x55fd762584a0 2024-09-19T09:00:46.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.660+0000 7fc125ffb640 1 -- 172.21.15.92:0/737788548 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc130003b80 con 0x55fd762584a0 2024-09-19T09:00:46.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.660+0000 7fc14727f740 1 -- 172.21.15.92:0/737788548 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1340a0070 con 0x55fd762584a0 2024-09-19T09:00:46.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.660+0000 7fc125ffb640 1 -- 172.21.15.92:0/737788548 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc130003d80 con 0x55fd762584a0 2024-09-19T09:00:46.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.660+0000 7fc14727f740 10 client.16326 fetch_fsmap learned FSMap version 19 2024-09-19T09:00:46.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.660+0000 7fc14727f740 1 -- 172.21.15.92:0/737788548 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55fd76275fd0 con 0x55fd762584a0 2024-09-19T09:00:46.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.660+0000 7fc125ffb640 1 -- 172.21.15.92:0/737788548 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1340a0070 con 0x55fd762584a0 2024-09-19T09:00:46.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.661+0000 7fc125ffb640 1 -- 172.21.15.92:0/737788548 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fc13004e070 con 0x55fd762584a0 2024-09-19T09:00:46.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.661+0000 7fc14727f740 10 client.16326 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:00:46.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.661+0000 7fc14727f740 10 client.16326 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:00:46.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.661+0000 7fc14727f740 20 client.16326 populate_metadata read hostname 'smithi092' 2024-09-19T09:00:46.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.661+0000 7fc14727f740 1 --2- 172.21.15.92:0/737788548 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55fd76277490 0x55fd762798c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.661+0000 7fc14727f740 4 client.16326 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:00:46.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.661+0000 7fc14727f740 1 -- 172.21.15.92:0/737788548 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd761cb850 con 0x55fd76277490 2024-09-19T09:00:46.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.661+0000 7fc13dd9b640 1 --2- 172.21.15.92:0/737788548 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55fd76277490 0x55fd762798c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:46.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.661+0000 7fc13dd9b640 1 --2- 172.21.15.92:0/737788548 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55fd76277490 0x55fd762798c0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98775efda81fd75c server_cookie=fd55e5fd2f8909c6 in_seq=0 out_seq=0 2024-09-19T09:00:46.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.661+0000 7fc125ffb640 10 client.16326 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:46.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.662+0000 7fc125ffb640 1 -- 172.21.15.92:0/737788548 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fd761cb850 con 0x55fd76277490 2024-09-19T09:00:46.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.662+0000 7fc125ffb640 10 client.16326 handle_command_reply: tid=0 2024-09-19T09:00:46.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.662+0000 7fc14727f740 1 client.16326 shutdown 2024-09-19T09:00:46.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.662+0000 7fc14727f740 1 -- 172.21.15.92:0/737788548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd762584a0 msgr2=0x55fd76262f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:46.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.662+0000 7fc14727f740 1 --2- 172.21.15.92:0/737788548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd762584a0 0x55fd76262f70 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc130009cd0 tx=0x7fc130031cc0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.662+0000 7fc14727f740 1 -- 172.21.15.92:0/737788548 shutdown_connections 2024-09-19T09:00:46.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.662+0000 7fc14727f740 1 --2- 172.21.15.92:0/737788548 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55fd76277490 0x55fd762798c0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.662+0000 7fc14727f740 1 --2- 172.21.15.92:0/737788548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd76263680 0x55fd76260760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.662+0000 7fc14727f740 1 --2- 172.21.15.92:0/737788548 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd76258dc0 0x55fd76260220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.662+0000 7fc14727f740 1 --2- 172.21.15.92:0/737788548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd762584a0 0x55fd76262f70 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.662+0000 7fc14727f740 1 -- 172.21.15.92:0/737788548 >> 172.21.15.92:0/737788548 conn(0x55fd76254a30 msgr2=0x55fd7625a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:46.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.662+0000 7fc125ffb640 0 client.16326 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:46.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.662+0000 7fc14727f740 1 -- 172.21.15.92:0/737788548 shutdown_connections 2024-09-19T09:00:46.672 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.662+0000 7fc14727f740 1 -- 172.21.15.92:0/737788548 wait complete. 2024-09-19T09:00:46.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.662+0000 7fc14727f740 20 client.16326 trim_cache size 0 max 16384 2024-09-19T09:00:46.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.679+0000 7fc14727f740 1 Processor -- start 2024-09-19T09:00:46.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.679+0000 7fc14727f740 1 -- start start 2024-09-19T09:00:46.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.679+0000 7fc14727f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd762584a0 0x55fd7627f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.679+0000 7fc14727f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd76258dc0 0x55fd7627f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.679+0000 7fc14727f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd76263680 0x55fd7625d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.679+0000 7fc14727f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc1401a92f0 con 0x55fd76263680 2024-09-19T09:00:46.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.679+0000 7fc14727f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc1401abb90 con 0x55fd76258dc0 2024-09-19T09:00:46.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.679+0000 7fc14727f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc1401a9980 con 0x55fd762584a0 2024-09-19T09:00:46.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.679+0000 7fc13ed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd76263680 0x55fd7625d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:46.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.679+0000 7fc13ed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd76263680 0x55fd7625d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41258/0 (socket says 172.21.15.92:41258) 2024-09-19T09:00:46.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.679+0000 7fc13ed9d640 1 -- 172.21.15.92:0/4272877860 learned_addr learned my addr 172.21.15.92:0/4272877860 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:46.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.680+0000 7fc13dd9b640 1 --2- 172.21.15.92:0/4272877860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd76258dc0 0x55fd7627f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:46.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.680+0000 7fc13ed9d640 1 -- 172.21.15.92:0/4272877860 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd762584a0 msgr2=0x55fd7627f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:46.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.680+0000 7fc13ed9d640 1 --2- 172.21.15.92:0/4272877860 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd762584a0 0x55fd7627f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.680+0000 7fc13ed9d640 1 -- 172.21.15.92:0/4272877860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd76258dc0 msgr2=0x55fd7627f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:46.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.680+0000 7fc13ed9d640 1 --2- 172.21.15.92:0/4272877860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd76258dc0 0x55fd7627f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.680+0000 7fc13ed9d640 1 -- 172.21.15.92:0/4272877860 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd762542e0 con 0x55fd76263680 2024-09-19T09:00:46.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.680+0000 7fc13dd9b640 1 --2- 172.21.15.92:0/4272877860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd76258dc0 0x55fd7627f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:00:46.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.680+0000 7fc13ed9d640 1 --2- 172.21.15.92:0/4272877860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd76263680 0x55fd7625d480 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fc13801f450 tx=0x7fc13801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f5b55c4ad4cb6e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:46.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.680+0000 7fc127fff640 1 -- 172.21.15.92:0/4272877860 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1380124b0 con 0x55fd76263680 2024-09-19T09:00:46.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.680+0000 7fc127fff640 1 -- 172.21.15.92:0/4272877860 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc13801fe50 con 0x55fd76263680 2024-09-19T09:00:46.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.680+0000 7fc127fff640 1 -- 172.21.15.92:0/4272877860 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1380299d0 con 0x55fd76263680 2024-09-19T09:00:46.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.681+0000 7fc14727f740 1 -- 172.21.15.92:0/4272877860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd76263680 msgr2=0x55fd7625d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:46.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.681+0000 7fc14727f740 1 --2- 172.21.15.92:0/4272877860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd76263680 0x55fd7625d480 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fc13801f450 tx=0x7fc13801d000 comp rx=0 tx=0).stop 2024-09-19T09:00:46.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.681+0000 7fc14727f740 1 -- 172.21.15.92:0/4272877860 shutdown_connections 2024-09-19T09:00:46.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.681+0000 7fc14727f740 1 --2- 172.21.15.92:0/4272877860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd76263680 0x55fd7625d480 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.681+0000 7fc14727f740 1 --2- 172.21.15.92:0/4272877860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd76258dc0 0x55fd7627f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.681+0000 7fc14727f740 1 --2- 172.21.15.92:0/4272877860 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd762584a0 0x55fd7627f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.681+0000 7fc14727f740 1 -- 172.21.15.92:0/4272877860 >> 172.21.15.92:0/4272877860 conn(0x55fd76254a30 msgr2=0x55fd76253b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:46.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.681+0000 7fc14727f740 1 -- 172.21.15.92:0/4272877860 shutdown_connections 2024-09-19T09:00:46.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.681+0000 7fc14727f740 1 -- 172.21.15.92:0/4272877860 wait complete. 2024-09-19T09:00:46.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.681+0000 7fc14727f740 1 -- start start 2024-09-19T09:00:46.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.681+0000 7fc14727f740 1 Processor -- start 2024-09-19T09:00:46.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.681+0000 7fc14727f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd762584a0 0x55fd76269320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.681+0000 7fc14727f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd76258dc0 0x55fd76269860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.681+0000 7fc14727f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd76263680 0x55fd76269da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.681+0000 7fc14727f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc1401aa050 con 0x55fd762584a0 2024-09-19T09:00:46.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.681+0000 7fc14727f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc1401ab4c0 con 0x55fd76263680 2024-09-19T09:00:46.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.681+0000 7fc14727f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc1401aa720 con 0x55fd76258dc0 2024-09-19T09:00:46.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.681+0000 7fc14727f740 10 client.0 _ll_register_callbacks cb 0x7fc1300098e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:46.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.681+0000 7fc13e59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd762584a0 0x55fd76269320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:46.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.681+0000 7fc13e59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd762584a0 0x55fd76269320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41260/0 (socket says 172.21.15.92:41260) 2024-09-19T09:00:46.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.681+0000 7fc13e59c640 1 -- 172.21.15.92:0/1800682468 learned_addr learned my addr 172.21.15.92:0/1800682468 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:46.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.681+0000 7fc13ed9d640 1 --2- 172.21.15.92:0/1800682468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd76263680 0x55fd76269da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:46.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.682+0000 7fc13e59c640 1 -- 172.21.15.92:0/1800682468 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd76258dc0 msgr2=0x55fd76269860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:46.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.682+0000 7fc13e59c640 1 --2- 172.21.15.92:0/1800682468 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd76258dc0 0x55fd76269860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.682+0000 7fc13e59c640 1 -- 172.21.15.92:0/1800682468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd76263680 msgr2=0x55fd76269da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:46.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.682+0000 7fc13e59c640 1 --2- 172.21.15.92:0/1800682468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd76263680 0x55fd76269da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.682+0000 7fc13e59c640 1 -- 172.21.15.92:0/1800682468 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd762e1170 con 0x55fd762584a0 2024-09-19T09:00:46.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.682+0000 7fc13e59c640 1 --2- 172.21.15.92:0/1800682468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd762584a0 0x55fd76269320 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc130002230 tx=0x7fc130009990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf6e842e43c3956 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:46.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.682+0000 7fc125ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:00:46.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.682+0000 7fc125ffb640 1 -- 172.21.15.92:0/1800682468 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc130054020 con 0x55fd762584a0 2024-09-19T09:00:46.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.682+0000 7fc125ffb640 1 -- 172.21.15.92:0/1800682468 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc130041030 con 0x55fd762584a0 2024-09-19T09:00:46.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.682+0000 7fc14727f740 1 -- 172.21.15.92:0/1800682468 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc13801fe50 con 0x55fd762584a0 2024-09-19T09:00:46.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.682+0000 7fc125ffb640 1 -- 172.21.15.92:0/1800682468 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc130049070 con 0x55fd762584a0 2024-09-19T09:00:46.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.682+0000 7fc14727f740 10 client.16332 fetch_fsmap learned FSMap version 19 2024-09-19T09:00:46.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.682+0000 7fc14727f740 1 -- 172.21.15.92:0/1800682468 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55fd762e23e0 con 0x55fd762584a0 2024-09-19T09:00:46.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.682+0000 7fc125ffb640 1 -- 172.21.15.92:0/1800682468 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc13801fe50 con 0x55fd762584a0 2024-09-19T09:00:46.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.682+0000 7fc125ffb640 1 -- 172.21.15.92:0/1800682468 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fc13004e070 con 0x55fd762584a0 2024-09-19T09:00:46.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.682+0000 7fc14727f740 10 client.16332 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:00:46.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.682+0000 7fc14727f740 10 client.16332 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:00:46.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.682+0000 7fc14727f740 20 client.16332 populate_metadata read hostname 'smithi092' 2024-09-19T09:00:46.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.683+0000 7fc14727f740 1 --2- 172.21.15.92:0/1800682468 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55fd762e2b60 0x55fd762e4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.683+0000 7fc14727f740 4 client.16332 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:00:46.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.683+0000 7fc14727f740 1 -- 172.21.15.92:0/1800682468 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fd76260af0 con 0x55fd762e2b60 2024-09-19T09:00:46.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.683+0000 7fc13dd9b640 1 --2- 172.21.15.92:0/1800682468 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55fd762e2b60 0x55fd762e4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:46.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.683+0000 7fc125ffb640 10 client.16332 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:46.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.683+0000 7fc13dd9b640 1 --2- 172.21.15.92:0/1800682468 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55fd762e2b60 0x55fd762e4f80 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de4b5a0d50e064e9 server_cookie=3feaeff4b2b480af in_seq=0 out_seq=0 2024-09-19T09:00:46.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.683+0000 7fc125ffb640 1 -- 172.21.15.92:0/1800682468 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55fd76260af0 con 0x55fd762e2b60 2024-09-19T09:00:46.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.683+0000 7fc125ffb640 10 client.16332 handle_command_reply: tid=0 2024-09-19T09:00:46.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.683+0000 7fc14727f740 1 client.16332 shutdown 2024-09-19T09:00:46.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.683+0000 7fc14727f740 1 -- 172.21.15.92:0/1800682468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd762584a0 msgr2=0x55fd76269320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:46.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.684+0000 7fc14727f740 1 --2- 172.21.15.92:0/1800682468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd762584a0 0x55fd76269320 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc130002230 tx=0x7fc130009990 comp rx=0 tx=0).stop 2024-09-19T09:00:46.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.684+0000 7fc14727f740 1 -- 172.21.15.92:0/1800682468 shutdown_connections 2024-09-19T09:00:46.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.684+0000 7fc14727f740 1 --2- 172.21.15.92:0/1800682468 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55fd762e2b60 0x55fd762e4f80 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.684+0000 7fc14727f740 1 --2- 172.21.15.92:0/1800682468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd76263680 0x55fd76269da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.684+0000 7fc14727f740 1 --2- 172.21.15.92:0/1800682468 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd76258dc0 0x55fd76269860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.684+0000 7fc125ffb640 0 client.16332 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:46.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.684+0000 7fc14727f740 1 --2- 172.21.15.92:0/1800682468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd762584a0 0x55fd76269320 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.684+0000 7fc14727f740 1 -- 172.21.15.92:0/1800682468 >> 172.21.15.92:0/1800682468 conn(0x55fd76254a30 msgr2=0x55fd76261a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:46.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.684+0000 7fc14727f740 1 -- 172.21.15.92:0/1800682468 shutdown_connections 2024-09-19T09:00:46.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.684+0000 7fc14727f740 1 -- 172.21.15.92:0/1800682468 wait complete. 2024-09-19T09:00:46.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.684+0000 7fc14727f740 20 client.16332 trim_cache size 0 max 16384 2024-09-19T09:00:46.691 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:00:46.691 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:00:46.691 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": { 2024-09-19T09:00:46.691 INFO:teuthology.orchestra.run.smithi092.stdout: "b4c1f6eb-837f-4584-8b1d-505cc8aec8ed": { 2024-09-19T09:00:46.692 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-19T09:00:46.692 INFO:teuthology.orchestra.run.smithi092.stdout: "tag": "b4c1f6eb-837f-4584-8b1d-505cc8aec8ed", 2024-09-19T09:00:46.692 INFO:teuthology.orchestra.run.smithi092.stdout: "options": "recursive,force" 2024-09-19T09:00:46.692 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:00:46.692 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:00:46.692 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:00:46.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.684+0000 7fc144ea6640 1 -- 172.21.15.92:0/2900445268 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc1280a3240 msgr2=0x7fc1280a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:46.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.684+0000 7fc144ea6640 1 --2- 172.21.15.92:0/2900445268 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc1280a3240 0x7fc1280a5700 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc13800b970 tx=0x7fc13800bd70 comp rx=0 tx=0).stop 2024-09-19T09:00:46.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.684+0000 7fc144ea6640 1 -- 172.21.15.92:0/2900445268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc140103740 msgr2=0x7fc140198a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:46.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.684+0000 7fc144ea6640 1 --2- 172.21.15.92:0/2900445268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc140103740 0x7fc140198a30 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fc13400c970 tx=0x7fc13400ce30 comp rx=0 tx=0).stop 2024-09-19T09:00:46.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.684+0000 7fc144ea6640 1 -- 172.21.15.92:0/2900445268 shutdown_connections 2024-09-19T09:00:46.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.684+0000 7fc144ea6640 1 --2- 172.21.15.92:0/2900445268 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc140108290 0x7fc14019cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.684+0000 7fc144ea6640 1 --2- 172.21.15.92:0/2900445268 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc1280a3240 0x7fc1280a5700 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.684+0000 7fc144ea6640 1 --2- 172.21.15.92:0/2900445268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc140103740 0x7fc140198a30 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.684+0000 7fc144ea6640 1 --2- 172.21.15.92:0/2900445268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc140102d90 0x7fc1401984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.684+0000 7fc144ea6640 1 -- 172.21.15.92:0/2900445268 >> 172.21.15.92:0/2900445268 conn(0x7fc1400fc7d0 msgr2=0x7fc140105d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:46.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.684+0000 7fc144ea6640 1 -- 172.21.15.92:0/2900445268 shutdown_connections 2024-09-19T09:00:46.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:46.684+0000 7fc144ea6640 1 -- 172.21.15.92:0/2900445268 wait complete. 2024-09-19T09:00:46.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:46 smithi167 ceph-mon[35359]: scrub queued for path: / 2024-09-19T09:00:46.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:46 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:00:46.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:46 smithi167 ceph-mon[35359]: scrub summary: active paths [/] 2024-09-19T09:00:46.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:46 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:00:46.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:46 smithi190 ceph-mon[35358]: scrub queued for path: / 2024-09-19T09:00:46.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:46 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:00:46.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:46 smithi190 ceph-mon[35358]: scrub summary: active paths [/] 2024-09-19T09:00:46.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:46 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:00:47.487 INFO:tasks.cephfs.filesystem:scrub status for tag:b4c1f6eb-837f-4584-8b1d-505cc8aec8ed - {'path': '/', 'tag': 'b4c1f6eb-837f-4584-8b1d-505cc8aec8ed', 'options': 'recursive,force'} 2024-09-19T09:00:47.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:47 smithi092 ceph-mon[31407]: pgmap v459: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 76 KiB/s wr, 16 op/s 2024-09-19T09:00:47.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:47 smithi167 ceph-mon[35359]: pgmap v459: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 76 KiB/s wr, 16 op/s 2024-09-19T09:00:47.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:47 smithi190 ceph-mon[35358]: pgmap v459: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 76 KiB/s wr, 16 op/s 2024-09-19T09:00:49.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:49 smithi092 ceph-mon[31407]: pgmap v460: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 306 KiB/s wr, 52 op/s 2024-09-19T09:00:49.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:49 smithi092 ceph-mon[31407]: scrub summary: idle 2024-09-19T09:00:49.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:49 smithi167 ceph-mon[35359]: pgmap v460: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 306 KiB/s wr, 52 op/s 2024-09-19T09:00:49.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:49 smithi167 ceph-mon[35359]: scrub summary: idle 2024-09-19T09:00:49.853 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:00:49.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:49 smithi190 ceph-mon[35358]: pgmap v460: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 306 KiB/s wr, 52 op/s 2024-09-19T09:00:49.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:49 smithi190 ceph-mon[35358]: scrub summary: idle 2024-09-19T09:00:50.102 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:50.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.567+0000 7fc35e3dc640 1 -- 172.21.15.92:0/893028730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3581008e0 msgr2=0x7fc358100cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:50.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.567+0000 7fc35e3dc640 1 --2- 172.21.15.92:0/893028730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3581008e0 0x7fc358100cc0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fc348009930 tx=0x7fc34802a420 comp rx=0 tx=0).stop 2024-09-19T09:00:50.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.567+0000 7fc35e3dc640 1 -- 172.21.15.92:0/893028730 shutdown_connections 2024-09-19T09:00:50.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.567+0000 7fc35e3dc640 1 --2- 172.21.15.92:0/893028730 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc358108160 0x7fc35810eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:50.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.567+0000 7fc35e3dc640 1 --2- 172.21.15.92:0/893028730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc358101290 0x7fc358107a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:50.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.567+0000 7fc35e3dc640 1 --2- 172.21.15.92:0/893028730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3581008e0 0x7fc358100cc0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:50.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.567+0000 7fc35e3dc640 1 -- 172.21.15.92:0/893028730 >> 172.21.15.92:0/893028730 conn(0x7fc358077210 msgr2=0x7fc358077620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:50.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.567+0000 7fc35e3dc640 1 -- 172.21.15.92:0/893028730 shutdown_connections 2024-09-19T09:00:50.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.567+0000 7fc35e3dc640 1 -- 172.21.15.92:0/893028730 wait complete. 2024-09-19T09:00:50.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.568+0000 7fc35e3dc640 1 Processor -- start 2024-09-19T09:00:50.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.568+0000 7fc35e3dc640 1 -- start start 2024-09-19T09:00:50.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.568+0000 7fc35e3dc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3581008e0 0x7fc358198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:50.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.568+0000 7fc35e3dc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc358101290 0x7fc358198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:50.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.568+0000 7fc35e3dc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc358108160 0x7fc35819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:50.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.568+0000 7fc35e3dc640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc358111fd0 con 0x7fc358108160 2024-09-19T09:00:50.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.568+0000 7fc35e3dc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc358111e50 con 0x7fc3581008e0 2024-09-19T09:00:50.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.568+0000 7fc35e3dc640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc358112150 con 0x7fc358101290 2024-09-19T09:00:50.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.568+0000 7fc35c979640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc358108160 0x7fc35819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:50.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.568+0000 7fc35c979640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc358108160 0x7fc35819cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41276/0 (socket says 172.21.15.92:41276) 2024-09-19T09:00:50.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.568+0000 7fc35c979640 1 -- 172.21.15.92:0/1610313577 learned_addr learned my addr 172.21.15.92:0/1610313577 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:50.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.568+0000 7fc357fff640 1 --2- 172.21.15.92:0/1610313577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3581008e0 0x7fc358198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:50.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.568+0000 7fc35c979640 1 -- 172.21.15.92:0/1610313577 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc358101290 msgr2=0x7fc358198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:50.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.568+0000 7fc35c979640 1 --2- 172.21.15.92:0/1610313577 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc358101290 0x7fc358198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:50.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.568+0000 7fc35c979640 1 -- 172.21.15.92:0/1610313577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3581008e0 msgr2=0x7fc358198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:50.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.568+0000 7fc35c979640 1 --2- 172.21.15.92:0/1610313577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3581008e0 0x7fc358198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:50.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.568+0000 7fc35c979640 1 -- 172.21.15.92:0/1610313577 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc35819d400 con 0x7fc358108160 2024-09-19T09:00:50.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.569+0000 7fc35c979640 1 --2- 172.21.15.92:0/1610313577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc358108160 0x7fc35819cd20 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fc35000cce0 tx=0x7fc35000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:50.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.569+0000 7fc355ffb640 1 -- 172.21.15.92:0/1610313577 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc35000f450 con 0x7fc358108160 2024-09-19T09:00:50.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.569+0000 7fc355ffb640 1 -- 172.21.15.92:0/1610313577 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc35000fad0 con 0x7fc358108160 2024-09-19T09:00:50.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.569+0000 7fc35e3dc640 1 -- 172.21.15.92:0/1610313577 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc35819d6f0 con 0x7fc358108160 2024-09-19T09:00:50.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.569+0000 7fc355ffb640 1 -- 172.21.15.92:0/1610313577 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc350018c10 con 0x7fc358108160 2024-09-19T09:00:50.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.569+0000 7fc35e3dc640 1 -- 172.21.15.92:0/1610313577 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3581a4fd0 con 0x7fc358108160 2024-09-19T09:00:50.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.570+0000 7fc35e3dc640 1 -- 172.21.15.92:0/1610313577 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc358100cc0 con 0x7fc358108160 2024-09-19T09:00:50.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.571+0000 7fc355ffb640 1 -- 172.21.15.92:0/1610313577 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc35000f5f0 con 0x7fc358108160 2024-09-19T09:00:50.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.571+0000 7fc355ffb640 1 --2- 172.21.15.92:0/1610313577 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc3440a3240 0x7fc3440a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:50.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.572+0000 7fc357fff640 1 --2- 172.21.15.92:0/1610313577 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc3440a3240 0x7fc3440a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:50.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.572+0000 7fc355ffb640 1 -- 172.21.15.92:0/1610313577 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc3500cff40 con 0x7fc358108160 2024-09-19T09:00:50.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.572+0000 7fc357fff640 1 --2- 172.21.15.92:0/1610313577 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc3440a3240 0x7fc3440a5700 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc348009900 tx=0x7fc3480058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:50.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.576+0000 7fc355ffb640 1 -- 172.21.15.92:0/1610313577 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc350014030 con 0x7fc358108160 2024-09-19T09:00:50.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.780+0000 7fc35e3dc640 1 -- 172.21.15.92:0/1610313577 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc3581997b0 con 0x7fc358108160 2024-09-19T09:00:50.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.780+0000 7fc355ffb640 1 -- 172.21.15.92:0/1610313577 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7fc35009cc60 con 0x7fc358108160 2024-09-19T09:00:50.781 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:00:50.781 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:00:50.781 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:00:50.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.782+0000 7fc35e3dc640 1 -- 172.21.15.92:0/1610313577 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc3440a3240 msgr2=0x7fc3440a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:50.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.782+0000 7fc35e3dc640 1 --2- 172.21.15.92:0/1610313577 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc3440a3240 0x7fc3440a5700 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc348009900 tx=0x7fc3480058d0 comp rx=0 tx=0).stop 2024-09-19T09:00:50.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.782+0000 7fc35e3dc640 1 -- 172.21.15.92:0/1610313577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc358108160 msgr2=0x7fc35819cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:50.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.782+0000 7fc35e3dc640 1 --2- 172.21.15.92:0/1610313577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc358108160 0x7fc35819cd20 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fc35000cce0 tx=0x7fc35000a620 comp rx=0 tx=0).stop 2024-09-19T09:00:50.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.782+0000 7fc35e3dc640 1 -- 172.21.15.92:0/1610313577 shutdown_connections 2024-09-19T09:00:50.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.782+0000 7fc35e3dc640 1 --2- 172.21.15.92:0/1610313577 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc3440a3240 0x7fc3440a5700 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:50.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.782+0000 7fc35e3dc640 1 --2- 172.21.15.92:0/1610313577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc358108160 0x7fc35819cd20 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:50.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.782+0000 7fc35e3dc640 1 --2- 172.21.15.92:0/1610313577 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc358101290 0x7fc358198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:50.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.782+0000 7fc35e3dc640 1 --2- 172.21.15.92:0/1610313577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3581008e0 0x7fc358198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:50.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.782+0000 7fc35e3dc640 1 -- 172.21.15.92:0/1610313577 >> 172.21.15.92:0/1610313577 conn(0x7fc358077210 msgr2=0x7fc3580ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:50.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.783+0000 7fc35e3dc640 1 -- 172.21.15.92:0/1610313577 shutdown_connections 2024-09-19T09:00:50.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:50.783+0000 7fc35e3dc640 1 -- 172.21.15.92:0/1610313577 wait complete. 2024-09-19T09:00:50.798 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:00:51.428 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id 268050b0 --release --await' 2024-09-19T09:00:51.428 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id 268050b0 --release --await 2024-09-19T09:00:51.677 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:51.792 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:51 smithi092 ceph-mon[31407]: pgmap v461: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 1.1 MiB/s wr, 133 op/s 2024-09-19T09:00:51.793 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:51 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1610313577' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:51.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:51 smithi167 ceph-mon[35359]: pgmap v461: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 1.1 MiB/s wr, 133 op/s 2024-09-19T09:00:51.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:51 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/1610313577' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:51.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:51 smithi190 ceph-mon[35358]: pgmap v461: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 1.1 MiB/s wr, 133 op/s 2024-09-19T09:00:51.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:51 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/1610313577' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:52.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.065+0000 7f9440b49640 1 -- 172.21.15.92:0/27235858 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f943c100a80 msgr2=0x7f943c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:52.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.065+0000 7f9440b49640 1 --2- 172.21.15.92:0/27235858 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f943c100a80 0x7f943c100ee0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f9430009930 tx=0x7f943002a420 comp rx=0 tx=0).stop 2024-09-19T09:00:52.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.065+0000 7f9440b49640 1 -- 172.21.15.92:0/27235858 shutdown_connections 2024-09-19T09:00:52.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.065+0000 7f9440b49640 1 --2- 172.21.15.92:0/27235858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f943c101420 0x7f943c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.065+0000 7f9440b49640 1 --2- 172.21.15.92:0/27235858 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f943c100a80 0x7f943c100ee0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.065+0000 7f9440b49640 1 --2- 172.21.15.92:0/27235858 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f943c106a80 0x7f943c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.065+0000 7f9440b49640 1 -- 172.21.15.92:0/27235858 >> 172.21.15.92:0/27235858 conn(0x7f943c0fc7a0 msgr2=0x7f943c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:52.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.065+0000 7f9440b49640 1 -- 172.21.15.92:0/27235858 shutdown_connections 2024-09-19T09:00:52.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.065+0000 7f9440b49640 1 -- 172.21.15.92:0/27235858 wait complete. 2024-09-19T09:00:52.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.066+0000 7f9440b49640 1 Processor -- start 2024-09-19T09:00:52.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.066+0000 7f9440b49640 1 -- start start 2024-09-19T09:00:52.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.066+0000 7f9440b49640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f943c100a80 0x7f943c198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:52.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.066+0000 7f9440b49640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f943c101420 0x7f943c198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:52.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.066+0000 7f9440b49640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f943c106a80 0x7f943c19ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:52.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.066+0000 7f9440b49640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f943c110f20 con 0x7f943c100a80 2024-09-19T09:00:52.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.066+0000 7f9440b49640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f943c110da0 con 0x7f943c101420 2024-09-19T09:00:52.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.066+0000 7f9440b49640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f943c1110a0 con 0x7f943c106a80 2024-09-19T09:00:52.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.066+0000 7f943a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f943c100a80 0x7f943c198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:52.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.066+0000 7f943a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f943c100a80 0x7f943c198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50348/0 (socket says 172.21.15.92:50348) 2024-09-19T09:00:52.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.066+0000 7f943a59c640 1 -- 172.21.15.92:0/1081779538 learned_addr learned my addr 172.21.15.92:0/1081779538 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:52.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.066+0000 7f9439d9b640 1 --2- 172.21.15.92:0/1081779538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f943c101420 0x7f943c198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:52.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.066+0000 7f943ad9d640 1 --2- 172.21.15.92:0/1081779538 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f943c106a80 0x7f943c19ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:52.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.066+0000 7f943a59c640 1 -- 172.21.15.92:0/1081779538 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f943c106a80 msgr2=0x7f943c19ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:52.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.066+0000 7f943a59c640 1 --2- 172.21.15.92:0/1081779538 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f943c106a80 0x7f943c19ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.066+0000 7f943a59c640 1 -- 172.21.15.92:0/1081779538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f943c101420 msgr2=0x7f943c198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:52.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.066+0000 7f943a59c640 1 --2- 172.21.15.92:0/1081779538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f943c101420 0x7f943c198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.066+0000 7f943a59c640 1 -- 172.21.15.92:0/1081779538 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f943c19d4f0 con 0x7f943c100a80 2024-09-19T09:00:52.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.066+0000 7f9439d9b640 1 --2- 172.21.15.92:0/1081779538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f943c101420 0x7f943c198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:00:52.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.066+0000 7f943ad9d640 1 --2- 172.21.15.92:0/1081779538 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f943c106a80 0x7f943c19ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:00:52.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.067+0000 7f943a59c640 1 --2- 172.21.15.92:0/1081779538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f943c100a80 0x7f943c198540 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f942c00b4a0 tx=0x7f942c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:52.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.067+0000 7f942b7fe640 1 -- 172.21.15.92:0/1081779538 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942c014070 con 0x7f943c100a80 2024-09-19T09:00:52.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.067+0000 7f942b7fe640 1 -- 172.21.15.92:0/1081779538 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f942c010af0 con 0x7f943c100a80 2024-09-19T09:00:52.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.067+0000 7f9440b49640 1 -- 172.21.15.92:0/1081779538 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f943c19d7e0 con 0x7f943c100a80 2024-09-19T09:00:52.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.067+0000 7f9440b49640 1 -- 172.21.15.92:0/1081779538 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f943c0fcdc0 con 0x7f943c100a80 2024-09-19T09:00:52.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.067+0000 7f942b7fe640 1 -- 172.21.15.92:0/1081779538 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942c017d10 con 0x7f943c100a80 2024-09-19T09:00:52.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.069+0000 7f942b7fe640 1 -- 172.21.15.92:0/1081779538 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f942c017070 con 0x7f943c100a80 2024-09-19T09:00:52.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.069+0000 7f9442f22740 1 Processor -- start 2024-09-19T09:00:52.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.069+0000 7f9442f22740 1 -- start start 2024-09-19T09:00:52.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.070+0000 7f9442f22740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0d0afd060 0x55f0d0afd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:52.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.070+0000 7f9442f22740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f0d0afd980 0x55f0d0b07d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:52.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.070+0000 7f9442f22740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0d0b08240 0x55f0d0b0a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:52.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.070+0000 7f9442f22740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f0d0a62620 con 0x55f0d0b08240 2024-09-19T09:00:52.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.070+0000 7f9442f22740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f0d0a09e50 con 0x55f0d0afd060 2024-09-19T09:00:52.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.070+0000 7f9442f22740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f0d0a5e5e0 con 0x55f0d0afd980 2024-09-19T09:00:52.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.070+0000 7f9439d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0d0b08240 0x55f0d0b0a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:52.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.070+0000 7f9439d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0d0b08240 0x55f0d0b0a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50362/0 (socket says 172.21.15.92:50362) 2024-09-19T09:00:52.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.070+0000 7f9439d9b640 1 -- 172.21.15.92:0/1117009015 learned_addr learned my addr 172.21.15.92:0/1117009015 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:52.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.070+0000 7f943a59c640 1 --2- 172.21.15.92:0/1117009015 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f0d0afd980 0x55f0d0b07d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:52.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.070+0000 7f943ad9d640 1 --2- 172.21.15.92:0/1117009015 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0d0afd060 0x55f0d0afd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:52.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.070+0000 7f942b7fe640 1 --2- 172.21.15.92:0/1081779538 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f94240a3240 0x7f94240a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:52.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.070+0000 7f9439d9b640 1 -- 172.21.15.92:0/1117009015 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f0d0afd980 msgr2=0x55f0d0b07d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:52.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.070+0000 7f9439d9b640 1 --2- 172.21.15.92:0/1117009015 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f0d0afd980 0x55f0d0b07d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.070+0000 7f943ad9d640 1 --2- 172.21.15.92:0/1081779538 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f94240a3240 0x7f94240a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:52.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.070+0000 7f9439d9b640 1 -- 172.21.15.92:0/1117009015 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0d0afd060 msgr2=0x55f0d0afd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:52.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.070+0000 7f9439d9b640 1 --2- 172.21.15.92:0/1117009015 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0d0afd060 0x55f0d0afd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.070+0000 7f9439d9b640 1 -- 172.21.15.92:0/1117009015 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0d09fad40 con 0x55f0d0b08240 2024-09-19T09:00:52.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.070+0000 7f942b7fe640 1 -- 172.21.15.92:0/1081779538 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f942c0ced10 con 0x7f943c100a80 2024-09-19T09:00:52.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.071+0000 7f9439d9b640 1 --2- 172.21.15.92:0/1117009015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0d0b08240 0x55f0d0b0a630 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f943002a940 tx=0x7f94300316e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0bd7236683757ad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:52.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.071+0000 7f943ad9d640 1 --2- 172.21.15.92:0/1081779538 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f94240a3240 0x7f94240a5700 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9434013870 tx=0x7f9434004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:52.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.071+0000 7f9428ff9640 1 -- 172.21.15.92:0/1117009015 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943003f070 con 0x55f0d0b08240 2024-09-19T09:00:52.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.071+0000 7f9428ff9640 1 -- 172.21.15.92:0/1117009015 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94300035f0 con 0x55f0d0b08240 2024-09-19T09:00:52.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.071+0000 7f9428ff9640 1 -- 172.21.15.92:0/1117009015 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9430035070 con 0x55f0d0b08240 2024-09-19T09:00:52.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.071+0000 7f9442f22740 1 -- 172.21.15.92:0/1117009015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0d0b08240 msgr2=0x55f0d0b0a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:52.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.071+0000 7f9442f22740 1 --2- 172.21.15.92:0/1117009015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0d0b08240 0x55f0d0b0a630 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f943002a940 tx=0x7f94300316e0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.072+0000 7f9442f22740 1 -- 172.21.15.92:0/1117009015 shutdown_connections 2024-09-19T09:00:52.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.072+0000 7f9442f22740 1 --2- 172.21.15.92:0/1117009015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0d0b08240 0x55f0d0b0a630 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.072+0000 7f9442f22740 1 --2- 172.21.15.92:0/1117009015 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f0d0afd980 0x55f0d0b07d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.072+0000 7f9442f22740 1 --2- 172.21.15.92:0/1117009015 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0d0afd060 0x55f0d0afd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.072+0000 7f9442f22740 1 -- 172.21.15.92:0/1117009015 >> 172.21.15.92:0/1117009015 conn(0x55f0d0af95f0 msgr2=0x55f0d0af99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:52.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.072+0000 7f9442f22740 1 -- 172.21.15.92:0/1117009015 shutdown_connections 2024-09-19T09:00:52.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.072+0000 7f9442f22740 1 -- 172.21.15.92:0/1117009015 wait complete. 2024-09-19T09:00:52.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.072+0000 7f9442f22740 1 -- start start 2024-09-19T09:00:52.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.072+0000 7f9442f22740 1 Processor -- start 2024-09-19T09:00:52.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.072+0000 7f9442f22740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f0d0afd060 0x55f0d0b05160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:52.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.072+0000 7f9442f22740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0d0afd980 0x55f0d0b056a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:52.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.072+0000 7f9442f22740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0d0b08240 0x55f0d0b05be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:52.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.072+0000 7f9442f22740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f0d0b0ae10 con 0x55f0d0afd980 2024-09-19T09:00:52.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.072+0000 7f9442f22740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f0d09eaf10 con 0x55f0d0b08240 2024-09-19T09:00:52.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.072+0000 7f9442f22740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f0d0b0af90 con 0x55f0d0afd060 2024-09-19T09:00:52.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.072+0000 7f9442f22740 10 client.0 _ll_register_callbacks cb 0x55f0d0a0edb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:52.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.072+0000 7f9439d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0d0afd980 0x55f0d0b056a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:52.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.072+0000 7f9439d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0d0afd980 0x55f0d0b056a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50378/0 (socket says 172.21.15.92:50378) 2024-09-19T09:00:52.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.072+0000 7f9439d9b640 1 -- 172.21.15.92:0/825910296 learned_addr learned my addr 172.21.15.92:0/825910296 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:52.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.072+0000 7f943a59c640 1 --2- 172.21.15.92:0/825910296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f0d0afd060 0x55f0d0b05160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:52.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.073+0000 7f943ad9d640 1 --2- 172.21.15.92:0/825910296 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0d0b08240 0x55f0d0b05be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:52.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.073+0000 7f9439d9b640 1 -- 172.21.15.92:0/825910296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f0d0afd060 msgr2=0x55f0d0b05160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:52.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.073+0000 7f9439d9b640 1 --2- 172.21.15.92:0/825910296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f0d0afd060 0x55f0d0b05160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.073+0000 7f9439d9b640 1 -- 172.21.15.92:0/825910296 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0d0b08240 msgr2=0x55f0d0b05be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:52.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.073+0000 7f9439d9b640 1 --2- 172.21.15.92:0/825910296 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0d0b08240 0x55f0d0b05be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.073+0000 7f9439d9b640 1 -- 172.21.15.92:0/825910296 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0d0771580 con 0x55f0d0afd980 2024-09-19T09:00:52.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.073+0000 7f943ad9d640 1 --2- 172.21.15.92:0/825910296 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0d0b08240 0x55f0d0b05be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:00:52.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.073+0000 7f9439d9b640 1 --2- 172.21.15.92:0/825910296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0d0afd980 0x55f0d0b056a0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f9430005940 tx=0x7f9430004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfd4ade5687a1a83 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:52.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.073+0000 7f9421ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:00:52.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.073+0000 7f9421ffb640 1 -- 172.21.15.92:0/825910296 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9430035070 con 0x55f0d0afd980 2024-09-19T09:00:52.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.073+0000 7f9421ffb640 1 -- 172.21.15.92:0/825910296 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9430003bb0 con 0x55f0d0afd980 2024-09-19T09:00:52.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.073+0000 7f9442f22740 1 -- 172.21.15.92:0/825910296 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94300035f0 con 0x55f0d0afd980 2024-09-19T09:00:52.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.073+0000 7f9421ffb640 1 -- 172.21.15.92:0/825910296 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f943003f040 con 0x55f0d0afd980 2024-09-19T09:00:52.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.073+0000 7f9442f22740 10 client.16350 fetch_fsmap learned FSMap version 19 2024-09-19T09:00:52.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.073+0000 7f9442f22740 1 -- 172.21.15.92:0/825910296 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f0d083b960 con 0x55f0d0afd980 2024-09-19T09:00:52.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.073+0000 7f9421ffb640 1 -- 172.21.15.92:0/825910296 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94300035f0 con 0x55f0d0afd980 2024-09-19T09:00:52.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.074+0000 7f9421ffb640 1 -- 172.21.15.92:0/825910296 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f9430050590 con 0x55f0d0afd980 2024-09-19T09:00:52.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.074+0000 7f9442f22740 10 client.16350 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:00:52.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.074+0000 7f9442f22740 10 client.16350 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:00:52.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.074+0000 7f9442f22740 20 client.16350 populate_metadata read hostname 'smithi092' 2024-09-19T09:00:52.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.074+0000 7f9442f22740 1 --2- 172.21.15.92:0/825910296 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f0d0b17c70 0x55f0d0b1a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:52.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.074+0000 7f9442f22740 4 client.16350 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:00:52.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.074+0000 7f9442f22740 1 -- 172.21.15.92:0/825910296 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f0d0a6fb90 con 0x55f0d0b17c70 2024-09-19T09:00:52.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.074+0000 7f943a59c640 1 --2- 172.21.15.92:0/825910296 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f0d0b17c70 0x55f0d0b1a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:52.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.074+0000 7f9421ffb640 10 client.16350 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:52.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.074+0000 7f943a59c640 1 --2- 172.21.15.92:0/825910296 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f0d0b17c70 0x55f0d0b1a060 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=414ef6ee49307462 server_cookie=c0849bab8201180a in_seq=0 out_seq=0 2024-09-19T09:00:52.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.075+0000 7f9421ffb640 1 -- 172.21.15.92:0/825910296 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f0d0a6fb90 con 0x55f0d0b17c70 2024-09-19T09:00:52.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.075+0000 7f9421ffb640 10 client.16350 handle_command_reply: tid=0 2024-09-19T09:00:52.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.075+0000 7f9442f22740 1 client.16350 shutdown 2024-09-19T09:00:52.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.075+0000 7f9442f22740 1 -- 172.21.15.92:0/825910296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0d0afd980 msgr2=0x55f0d0b056a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:52.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.075+0000 7f9442f22740 1 --2- 172.21.15.92:0/825910296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0d0afd980 0x55f0d0b056a0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f9430005940 tx=0x7f9430004610 comp rx=0 tx=0).stop 2024-09-19T09:00:52.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.075+0000 7f9442f22740 1 -- 172.21.15.92:0/825910296 shutdown_connections 2024-09-19T09:00:52.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.075+0000 7f9442f22740 1 --2- 172.21.15.92:0/825910296 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f0d0b17c70 0x55f0d0b1a060 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.075+0000 7f9442f22740 1 --2- 172.21.15.92:0/825910296 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0d0b08240 0x55f0d0b05be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.075+0000 7f9442f22740 1 --2- 172.21.15.92:0/825910296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0d0afd980 0x55f0d0b056a0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.075+0000 7f9442f22740 1 --2- 172.21.15.92:0/825910296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f0d0afd060 0x55f0d0b05160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.075+0000 7f9442f22740 1 -- 172.21.15.92:0/825910296 >> 172.21.15.92:0/825910296 conn(0x55f0d0af95f0 msgr2=0x55f0d0aff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:52.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.075+0000 7f9421ffb640 0 client.16350 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:52.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.075+0000 7f9442f22740 1 -- 172.21.15.92:0/825910296 shutdown_connections 2024-09-19T09:00:52.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.075+0000 7f9442f22740 1 -- 172.21.15.92:0/825910296 wait complete. 2024-09-19T09:00:52.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.075+0000 7f9442f22740 20 client.16350 trim_cache size 0 max 16384 2024-09-19T09:00:52.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.092+0000 7f9442f22740 1 Processor -- start 2024-09-19T09:00:52.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.092+0000 7f9442f22740 1 -- start start 2024-09-19T09:00:52.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.092+0000 7f9442f22740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0d0afd060 0x55f0d0b040a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:52.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.092+0000 7f9442f22740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0d0b08240 0x55f0d0b1f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:52.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.092+0000 7f9442f22740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f0d0b1fb70 0x55f0d0b023c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:52.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.092+0000 7f9442f22740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f943c1ad850 con 0x55f0d0afd060 2024-09-19T09:00:52.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.092+0000 7f9442f22740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f943c1b00f0 con 0x55f0d0b08240 2024-09-19T09:00:52.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.092+0000 7f9442f22740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f943c1adee0 con 0x55f0d0b1fb70 2024-09-19T09:00:52.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.092+0000 7f943a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0d0afd060 0x55f0d0b040a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:52.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.092+0000 7f943a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0d0afd060 0x55f0d0b040a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50392/0 (socket says 172.21.15.92:50392) 2024-09-19T09:00:52.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.092+0000 7f943a59c640 1 -- 172.21.15.92:0/1101288389 learned_addr learned my addr 172.21.15.92:0/1101288389 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:52.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.092+0000 7f9439d9b640 1 --2- 172.21.15.92:0/1101288389 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0d0b08240 0x55f0d0b1f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:52.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.092+0000 7f943ad9d640 1 --2- 172.21.15.92:0/1101288389 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f0d0b1fb70 0x55f0d0b023c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:52.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.093+0000 7f943a59c640 1 -- 172.21.15.92:0/1101288389 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f0d0b1fb70 msgr2=0x55f0d0b023c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:52.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.093+0000 7f943a59c640 1 --2- 172.21.15.92:0/1101288389 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f0d0b1fb70 0x55f0d0b023c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.093+0000 7f943a59c640 1 -- 172.21.15.92:0/1101288389 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0d0b08240 msgr2=0x55f0d0b1f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:52.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.093+0000 7f943a59c640 1 --2- 172.21.15.92:0/1101288389 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0d0b08240 0x55f0d0b1f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.093+0000 7f943a59c640 1 -- 172.21.15.92:0/1101288389 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0d0afd7b0 con 0x55f0d0afd060 2024-09-19T09:00:52.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.093+0000 7f9439d9b640 1 --2- 172.21.15.92:0/1101288389 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0d0b08240 0x55f0d0b1f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:00:52.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.093+0000 7f943ad9d640 1 --2- 172.21.15.92:0/1101288389 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f0d0b1fb70 0x55f0d0b023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:00:52.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.093+0000 7f943a59c640 1 --2- 172.21.15.92:0/1101288389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0d0afd060 0x55f0d0b040a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f942c00be60 tx=0x7f942c009390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be610d7cb1fc4b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:52.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.093+0000 7f9423fff640 1 -- 172.21.15.92:0/1101288389 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942c01e040 con 0x55f0d0afd060 2024-09-19T09:00:52.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.093+0000 7f9423fff640 1 -- 172.21.15.92:0/1101288389 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f942c09b330 con 0x55f0d0afd060 2024-09-19T09:00:52.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.093+0000 7f9423fff640 1 -- 172.21.15.92:0/1101288389 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942c010ca0 con 0x55f0d0afd060 2024-09-19T09:00:52.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.093+0000 7f9442f22740 1 -- 172.21.15.92:0/1101288389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0d0afd060 msgr2=0x55f0d0b040a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:52.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.093+0000 7f9442f22740 1 --2- 172.21.15.92:0/1101288389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0d0afd060 0x55f0d0b040a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f942c00be60 tx=0x7f942c009390 comp rx=0 tx=0).stop 2024-09-19T09:00:52.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.094+0000 7f9442f22740 1 -- 172.21.15.92:0/1101288389 shutdown_connections 2024-09-19T09:00:52.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.094+0000 7f9442f22740 1 --2- 172.21.15.92:0/1101288389 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f0d0b1fb70 0x55f0d0b023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.094+0000 7f9442f22740 1 --2- 172.21.15.92:0/1101288389 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0d0b08240 0x55f0d0b1f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.094+0000 7f9442f22740 1 --2- 172.21.15.92:0/1101288389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0d0afd060 0x55f0d0b040a0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.094+0000 7f9442f22740 1 -- 172.21.15.92:0/1101288389 >> 172.21.15.92:0/1101288389 conn(0x55f0d0af95f0 msgr2=0x55f0d0b071e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:52.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.094+0000 7f9442f22740 1 -- 172.21.15.92:0/1101288389 shutdown_connections 2024-09-19T09:00:52.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.094+0000 7f9442f22740 1 -- 172.21.15.92:0/1101288389 wait complete. 2024-09-19T09:00:52.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.094+0000 7f9442f22740 1 -- start start 2024-09-19T09:00:52.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.094+0000 7f9442f22740 1 Processor -- start 2024-09-19T09:00:52.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.094+0000 7f9442f22740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f0d0afd060 0x55f0d0b0c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:52.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.094+0000 7f9442f22740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0d0b08240 0x55f0d0b0ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:52.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.094+0000 7f9442f22740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0d0b1fb70 0x55f0d0b0ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:52.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.094+0000 7f9442f22740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f943c1ae5b0 con 0x55f0d0b1fb70 2024-09-19T09:00:52.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.094+0000 7f9442f22740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f943c1afa20 con 0x55f0d0b08240 2024-09-19T09:00:52.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.094+0000 7f9442f22740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f943c1aec80 con 0x55f0d0afd060 2024-09-19T09:00:52.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.094+0000 7f9442f22740 10 client.0 _ll_register_callbacks cb 0x7f94300315b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:52.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.094+0000 7f943ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0d0b1fb70 0x55f0d0b0ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:52.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.094+0000 7f943ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0d0b1fb70 0x55f0d0b0ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50408/0 (socket says 172.21.15.92:50408) 2024-09-19T09:00:52.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.094+0000 7f943ad9d640 1 -- 172.21.15.92:0/2454331257 learned_addr learned my addr 172.21.15.92:0/2454331257 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:52.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.095+0000 7f943a59c640 1 --2- 172.21.15.92:0/2454331257 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f0d0afd060 0x55f0d0b0c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:52.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.095+0000 7f9439d9b640 1 --2- 172.21.15.92:0/2454331257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0d0b08240 0x55f0d0b0ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:52.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.095+0000 7f943ad9d640 1 -- 172.21.15.92:0/2454331257 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f0d0afd060 msgr2=0x55f0d0b0c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:52.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.095+0000 7f943ad9d640 1 --2- 172.21.15.92:0/2454331257 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f0d0afd060 0x55f0d0b0c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.095+0000 7f943ad9d640 1 -- 172.21.15.92:0/2454331257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0d0b08240 msgr2=0x55f0d0b0ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:52.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.095+0000 7f943ad9d640 1 --2- 172.21.15.92:0/2454331257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0d0b08240 0x55f0d0b0ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.095+0000 7f943ad9d640 1 -- 172.21.15.92:0/2454331257 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0d0b105f0 con 0x55f0d0b1fb70 2024-09-19T09:00:52.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.095+0000 7f943ad9d640 1 --2- 172.21.15.92:0/2454331257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0d0b1fb70 0x55f0d0b0ff80 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f9434010e90 tx=0x7f9434004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f7639af17b2e3c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:52.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.095+0000 7f9421ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:00:52.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.095+0000 7f9421ffb640 1 -- 172.21.15.92:0/2454331257 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9434024030 con 0x55f0d0b1fb70 2024-09-19T09:00:52.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.095+0000 7f9421ffb640 1 -- 172.21.15.92:0/2454331257 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9434020480 con 0x55f0d0b1fb70 2024-09-19T09:00:52.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.095+0000 7f9442f22740 1 -- 172.21.15.92:0/2454331257 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f942c09b330 con 0x55f0d0b1fb70 2024-09-19T09:00:52.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.095+0000 7f9421ffb640 1 -- 172.21.15.92:0/2454331257 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9434020680 con 0x55f0d0b1fb70 2024-09-19T09:00:52.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.095+0000 7f9442f22740 10 client.16356 fetch_fsmap learned FSMap version 19 2024-09-19T09:00:52.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.095+0000 7f9442f22740 1 -- 172.21.15.92:0/2454331257 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f0d0b83160 con 0x55f0d0b1fb70 2024-09-19T09:00:52.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.095+0000 7f9421ffb640 1 -- 172.21.15.92:0/2454331257 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f942c09b330 con 0x55f0d0b1fb70 2024-09-19T09:00:52.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.096+0000 7f9421ffb640 1 -- 172.21.15.92:0/2454331257 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f943401d050 con 0x55f0d0b1fb70 2024-09-19T09:00:52.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.096+0000 7f9442f22740 10 client.16356 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:00:52.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.096+0000 7f9442f22740 10 client.16356 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:00:52.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.096+0000 7f9442f22740 20 client.16356 populate_metadata read hostname 'smithi092' 2024-09-19T09:00:52.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.096+0000 7f9442f22740 1 --2- 172.21.15.92:0/2454331257 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f0d0b838d0 0x55f0d0b85cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:52.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.096+0000 7f9442f22740 4 client.16356 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "268050b0", "release": true, "await": true}] 2024-09-19T09:00:52.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.096+0000 7f9442f22740 1 -- 172.21.15.92:0/2454331257 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "quiesce db", "set_id": "268050b0", "release": true, "await": true}) -- 0x55f0d0a6a0a0 con 0x55f0d0b838d0 2024-09-19T09:00:52.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.096+0000 7f943a59c640 1 --2- 172.21.15.92:0/2454331257 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f0d0b838d0 0x55f0d0b85cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:52.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.096+0000 7f943a59c640 1 --2- 172.21.15.92:0/2454331257 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f0d0b838d0 0x55f0d0b85cf0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf445844e2f0380a server_cookie=55a5c4ee95b256e4 in_seq=0 out_seq=0 2024-09-19T09:00:52.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.096+0000 7f9421ffb640 10 client.16356 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:52.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.171+0000 7f9421ffb640 1 -- 172.21.15.92:0/2454331257 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55f0d0a6a0a0 con 0x55f0d0b838d0 2024-09-19T09:00:52.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.171+0000 7f9421ffb640 10 client.16356 handle_command_reply: tid=0 2024-09-19T09:00:52.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.171+0000 7f9442f22740 1 client.16356 shutdown 2024-09-19T09:00:52.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.172+0000 7f9442f22740 1 -- 172.21.15.92:0/2454331257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0d0b1fb70 msgr2=0x55f0d0b0ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:52.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.172+0000 7f9442f22740 1 --2- 172.21.15.92:0/2454331257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0d0b1fb70 0x55f0d0b0ff80 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f9434010e90 tx=0x7f9434004b50 comp rx=0 tx=0).stop 2024-09-19T09:00:52.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.172+0000 7f9442f22740 1 -- 172.21.15.92:0/2454331257 shutdown_connections 2024-09-19T09:00:52.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.172+0000 7f9442f22740 1 --2- 172.21.15.92:0/2454331257 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f0d0b838d0 0x55f0d0b85cf0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.172+0000 7f9442f22740 1 --2- 172.21.15.92:0/2454331257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f0d0b1fb70 0x55f0d0b0ff80 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.172+0000 7f9421ffb640 0 client.16356 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:52.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.172+0000 7f9442f22740 1 --2- 172.21.15.92:0/2454331257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0d0b08240 0x55f0d0b0ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.172+0000 7f9442f22740 1 --2- 172.21.15.92:0/2454331257 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f0d0afd060 0x55f0d0b0c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.172+0000 7f9442f22740 1 -- 172.21.15.92:0/2454331257 >> 172.21.15.92:0/2454331257 conn(0x55f0d0af95f0 msgr2=0x55f0d0af7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:52.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.172+0000 7f9442f22740 1 -- 172.21.15.92:0/2454331257 shutdown_connections 2024-09-19T09:00:52.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.172+0000 7f9442f22740 1 -- 172.21.15.92:0/2454331257 wait complete. 2024-09-19T09:00:52.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.172+0000 7f9442f22740 20 client.16356 trim_cache size 0 max 16384 2024-09-19T09:00:52.174 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:00:52.174 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 19, 2024-09-19T09:00:52.174 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24472, 2024-09-19T09:00:52.174 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 20, 2024-09-19T09:00:52.174 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-09-19T09:00:52.174 INFO:teuthology.orchestra.run.smithi092.stdout: "268050b0": { 2024-09-19T09:00:52.174 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 20, 2024-09-19T09:00:52.174 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-09-19T09:00:52.174 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:00:52.174 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-09-19T09:00:52.175 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:00:52.175 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:00:52.175 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 90.0, 2024-09-19T09:00:52.175 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 149.8, 2024-09-19T09:00:52.175 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-09-19T09:00:52.175 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-09-19T09:00:52.175 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-09-19T09:00:52.175 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:00:52.175 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-09-19T09:00:52.175 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:00:52.175 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:00:52.175 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:00:52.175 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:00:52.176 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:00:52.176 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:00:52.176 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:00:52.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.173+0000 7f9440b49640 1 -- 172.21.15.92:0/1081779538 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f94240a3240 msgr2=0x7f94240a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:52.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.173+0000 7f9440b49640 1 --2- 172.21.15.92:0/1081779538 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f94240a3240 0x7f94240a5700 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9434013870 tx=0x7f9434004a40 comp rx=0 tx=0).stop 2024-09-19T09:00:52.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.173+0000 7f9440b49640 1 -- 172.21.15.92:0/1081779538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f943c100a80 msgr2=0x7f943c198540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:52.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.173+0000 7f9440b49640 1 --2- 172.21.15.92:0/1081779538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f943c100a80 0x7f943c198540 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f942c00b4a0 tx=0x7f942c00b960 comp rx=0 tx=0).stop 2024-09-19T09:00:52.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.176+0000 7f9440b49640 1 -- 172.21.15.92:0/1081779538 shutdown_connections 2024-09-19T09:00:52.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.176+0000 7f9440b49640 1 --2- 172.21.15.92:0/1081779538 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f943c106a80 0x7f943c19ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.176+0000 7f9440b49640 1 --2- 172.21.15.92:0/1081779538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f943c101420 0x7f943c198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.176+0000 7f9440b49640 1 --2- 172.21.15.92:0/1081779538 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f94240a3240 0x7f94240a5700 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.176+0000 7f9440b49640 1 --2- 172.21.15.92:0/1081779538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f943c100a80 0x7f943c198540 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:52.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.176+0000 7f9440b49640 1 -- 172.21.15.92:0/1081779538 >> 172.21.15.92:0/1081779538 conn(0x7f943c0fc7a0 msgr2=0x7f943c06aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:52.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.176+0000 7f9440b49640 1 -- 172.21.15.92:0/1081779538 shutdown_connections 2024-09-19T09:00:52.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:52.177+0000 7f9440b49640 1 -- 172.21.15.92:0/1081779538 wait complete. 2024-09-19T09:00:53.055 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '268050b0', total seconds elapsed: 33.0 2024-09-19T09:00:53.055 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.8 2024-09-19T09:00:53.055 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:00:53.473 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:53.767 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:53 smithi092 ceph-mon[31407]: pgmap v462: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 1.4 MiB/s wr, 163 op/s 2024-09-19T09:00:53.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:53 smithi167 ceph-mon[35359]: pgmap v462: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 1.4 MiB/s wr, 163 op/s 2024-09-19T09:00:53.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:53 smithi190 ceph-mon[35358]: pgmap v462: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 1.4 MiB/s wr, 163 op/s 2024-09-19T09:00:54.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.019+0000 7fcba68ef640 1 -- 172.21.15.92:0/2437266517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcba0100ca0 msgr2=0x7fcba0106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:54.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.019+0000 7fcba68ef640 1 --2- 172.21.15.92:0/2437266517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcba0100ca0 0x7fcba0106840 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcb94009930 tx=0x7fcb9402a420 comp rx=0 tx=0).stop 2024-09-19T09:00:54.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.020+0000 7fcba68ef640 1 -- 172.21.15.92:0/2437266517 shutdown_connections 2024-09-19T09:00:54.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.020+0000 7fcba68ef640 1 --2- 172.21.15.92:0/2437266517 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcba0106f50 0x7fcba010eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:54.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.020+0000 7fcba68ef640 1 --2- 172.21.15.92:0/2437266517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcba0100ca0 0x7fcba0106840 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:54.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.020+0000 7fcba68ef640 1 --2- 172.21.15.92:0/2437266517 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcba01002f0 0x7fcba01006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:54.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.020+0000 7fcba68ef640 1 -- 172.21.15.92:0/2437266517 >> 172.21.15.92:0/2437266517 conn(0x7fcba0077210 msgr2=0x7fcba00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:54.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.020+0000 7fcba68ef640 1 -- 172.21.15.92:0/2437266517 shutdown_connections 2024-09-19T09:00:54.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.020+0000 7fcba68ef640 1 -- 172.21.15.92:0/2437266517 wait complete. 2024-09-19T09:00:54.023 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.021+0000 7fcba68ef640 1 Processor -- start 2024-09-19T09:00:54.023 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.021+0000 7fcba68ef640 1 -- start start 2024-09-19T09:00:54.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.021+0000 7fcba68ef640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcba01002f0 0x7fcba0101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:54.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.021+0000 7fcba68ef640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcba0100ca0 0x7fcba01017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:54.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.021+0000 7fcba68ef640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcba0106f50 0x7fcba0101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:54.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.021+0000 7fcba68ef640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcba0111fb0 con 0x7fcba0106f50 2024-09-19T09:00:54.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.021+0000 7fcba68ef640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcba0111e30 con 0x7fcba0100ca0 2024-09-19T09:00:54.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.021+0000 7fcba68ef640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fcba0112130 con 0x7fcba01002f0 2024-09-19T09:00:54.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.021+0000 7fcb9ffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcba01002f0 0x7fcba0101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:54.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.021+0000 7fcb9ffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcba01002f0 0x7fcba0101270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:49582/0 (socket says 172.21.15.92:49582) 2024-09-19T09:00:54.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.021+0000 7fcb9ffff640 1 -- 172.21.15.92:0/3484108890 learned_addr learned my addr 172.21.15.92:0/3484108890 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:54.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.021+0000 7fcb9f7fe640 1 --2- 172.21.15.92:0/3484108890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcba0100ca0 0x7fcba01017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:54.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.022+0000 7fcba4e8c640 1 --2- 172.21.15.92:0/3484108890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcba0106f50 0x7fcba0101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:54.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.022+0000 7fcb9ffff640 1 -- 172.21.15.92:0/3484108890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcba0100ca0 msgr2=0x7fcba01017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:54.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.022+0000 7fcb9ffff640 1 --2- 172.21.15.92:0/3484108890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcba0100ca0 0x7fcba01017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:54.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.022+0000 7fcb9ffff640 1 -- 172.21.15.92:0/3484108890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcba0106f50 msgr2=0x7fcba0101cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:54.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.022+0000 7fcb9ffff640 1 --2- 172.21.15.92:0/3484108890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcba0106f50 0x7fcba0101cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:54.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.022+0000 7fcb9ffff640 1 -- 172.21.15.92:0/3484108890 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcba01aaf00 con 0x7fcba01002f0 2024-09-19T09:00:54.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.022+0000 7fcb9ffff640 1 --2- 172.21.15.92:0/3484108890 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcba01002f0 0x7fcba0101270 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcb9000d950 tx=0x7fcb9000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:54.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.023+0000 7fcb9d7fa640 1 -- 172.21.15.92:0/3484108890 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb90017070 con 0x7fcba01002f0 2024-09-19T09:00:54.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.023+0000 7fcb9d7fa640 1 -- 172.21.15.92:0/3484108890 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb90009c30 con 0x7fcba01002f0 2024-09-19T09:00:54.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.024+0000 7fcb9d7fa640 1 -- 172.21.15.92:0/3484108890 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb9000f6b0 con 0x7fcba01002f0 2024-09-19T09:00:54.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.024+0000 7fcba68ef640 1 -- 172.21.15.92:0/3484108890 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcba01ab130 con 0x7fcba01002f0 2024-09-19T09:00:54.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.024+0000 7fcba68ef640 1 -- 172.21.15.92:0/3484108890 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcba01ab590 con 0x7fcba01002f0 2024-09-19T09:00:54.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.026+0000 7fcba68ef640 1 -- 172.21.15.92:0/3484108890 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcba01006d0 con 0x7fcba01002f0 2024-09-19T09:00:54.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.027+0000 7fcb9d7fa640 1 -- 172.21.15.92:0/3484108890 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fcb900109d0 con 0x7fcba01002f0 2024-09-19T09:00:54.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.028+0000 7fcb9d7fa640 1 --2- 172.21.15.92:0/3484108890 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcb880a3410 0x7fcb880a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:54.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.028+0000 7fcb9d7fa640 1 -- 172.21.15.92:0/3484108890 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcb900cf410 con 0x7fcba01002f0 2024-09-19T09:00:54.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.028+0000 7fcb9f7fe640 1 --2- 172.21.15.92:0/3484108890 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcb880a3410 0x7fcb880a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:54.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.029+0000 7fcb9f7fe640 1 --2- 172.21.15.92:0/3484108890 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcb880a3410 0x7fcb880a58d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcb94009900 tx=0x7fcb94000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:54.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.031+0000 7fcb9d7fa640 1 -- 172.21.15.92:0/3484108890 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcb90009de0 con 0x7fcba01002f0 2024-09-19T09:00:54.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.383+0000 7fcba68ef640 1 -- 172.21.15.92:0/3484108890 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcba01032e0 con 0x7fcba01002f0 2024-09-19T09:00:54.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.387+0000 7fcb9d7fa640 1 -- 172.21.15.92:0/3484108890 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7fcb9009c1f0 con 0x7fcba01002f0 2024-09-19T09:00:54.388 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:00:54.388 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:00:54.388 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:00:54.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.390+0000 7fcba68ef640 1 -- 172.21.15.92:0/3484108890 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcb880a3410 msgr2=0x7fcb880a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:54.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.390+0000 7fcba68ef640 1 --2- 172.21.15.92:0/3484108890 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcb880a3410 0x7fcb880a58d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcb94009900 tx=0x7fcb94000bc0 comp rx=0 tx=0).stop 2024-09-19T09:00:54.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.390+0000 7fcba68ef640 1 -- 172.21.15.92:0/3484108890 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcba01002f0 msgr2=0x7fcba0101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:54.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.390+0000 7fcba68ef640 1 --2- 172.21.15.92:0/3484108890 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcba01002f0 0x7fcba0101270 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcb9000d950 tx=0x7fcb9000de10 comp rx=0 tx=0).stop 2024-09-19T09:00:54.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.390+0000 7fcba68ef640 1 -- 172.21.15.92:0/3484108890 shutdown_connections 2024-09-19T09:00:54.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.390+0000 7fcba68ef640 1 --2- 172.21.15.92:0/3484108890 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcb880a3410 0x7fcb880a58d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:54.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.390+0000 7fcba68ef640 1 --2- 172.21.15.92:0/3484108890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcba0106f50 0x7fcba0101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:54.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.390+0000 7fcba68ef640 1 --2- 172.21.15.92:0/3484108890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcba0100ca0 0x7fcba01017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:54.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.390+0000 7fcba68ef640 1 --2- 172.21.15.92:0/3484108890 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcba01002f0 0x7fcba0101270 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:54.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.390+0000 7fcba68ef640 1 -- 172.21.15.92:0/3484108890 >> 172.21.15.92:0/3484108890 conn(0x7fcba0077210 msgr2=0x7fcba00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:54.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.391+0000 7fcba68ef640 1 -- 172.21.15.92:0/3484108890 shutdown_connections 2024-09-19T09:00:54.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:54.391+0000 7fcba68ef640 1 -- 172.21.15.92:0/3484108890 wait complete. 2024-09-19T09:00:54.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:54 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3484108890' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:54.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:54 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3484108890' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:54.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:54 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3484108890' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:55.172 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0' 2024-09-19T09:00:55.172 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0 2024-09-19T09:00:55.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.569+0000 7f9f0eaa8640 1 -- 172.21.15.92:0/2865154397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f000a4070 msgr2=0x7f9f000a44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:55.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.569+0000 7f9f0eaa8640 1 --2- 172.21.15.92:0/2865154397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f000a4070 0x7f9f000a44f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f9ef80074e0 tx=0x7f9ef802b070 comp rx=0 tx=0).stop 2024-09-19T09:00:55.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.571+0000 7f9f0eaa8640 1 -- 172.21.15.92:0/2865154397 shutdown_connections 2024-09-19T09:00:55.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.571+0000 7f9f0eaa8640 1 --2- 172.21.15.92:0/2865154397 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f000a4a30 0x7f9f0000b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.571+0000 7f9f0eaa8640 1 --2- 172.21.15.92:0/2865154397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f000a4070 0x7f9f000a44f0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.571+0000 7f9f0eaa8640 1 --2- 172.21.15.92:0/2865154397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f000a5a40 0x7f9f000a5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.571+0000 7f9f0eaa8640 1 -- 172.21.15.92:0/2865154397 >> 172.21.15.92:0/2865154397 conn(0x7f9f0009fba0 msgr2=0x7f9f000a2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:55.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.573+0000 7f9f0eaa8640 1 -- 172.21.15.92:0/2865154397 shutdown_connections 2024-09-19T09:00:55.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.573+0000 7f9f0eaa8640 1 -- 172.21.15.92:0/2865154397 wait complete. 2024-09-19T09:00:55.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.573+0000 7f9f0eaa8640 1 Processor -- start 2024-09-19T09:00:55.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.575+0000 7f9f0eaa8640 1 -- start start 2024-09-19T09:00:55.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.576+0000 7f9f0eaa8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f000a4070 0x7f9f0000b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.576+0000 7f9f0eaa8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f000a4a30 0x7f9f00009d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.576+0000 7f9f0eaa8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f000a5a40 0x7f9f0000a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.576+0000 7f9f0eaa8640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0000ed50 con 0x7f9f000a4a30 2024-09-19T09:00:55.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.576+0000 7f9f0eaa8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0000ebd0 con 0x7f9f000a4070 2024-09-19T09:00:55.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.576+0000 7f9f0eaa8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0000eed0 con 0x7f9f000a5a40 2024-09-19T09:00:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.576+0000 7f9f0d2a5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f000a4a30 0x7f9f00009d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.576+0000 7f9f0d2a5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f000a4a30 0x7f9f00009d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50428/0 (socket says 172.21.15.92:50428) 2024-09-19T09:00:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.576+0000 7f9f0d2a5640 1 -- 172.21.15.92:0/2039296248 learned_addr learned my addr 172.21.15.92:0/2039296248 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.576+0000 7f9f0e2a7640 1 --2- 172.21.15.92:0/2039296248 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f000a5a40 0x7f9f0000a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.576+0000 7f9f0daa6640 1 --2- 172.21.15.92:0/2039296248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f000a4070 0x7f9f0000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.576+0000 7f9f0e2a7640 1 -- 172.21.15.92:0/2039296248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f000a4070 msgr2=0x7f9f0000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:55.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.576+0000 7f9f0e2a7640 1 --2- 172.21.15.92:0/2039296248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f000a4070 0x7f9f0000b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.576+0000 7f9f0e2a7640 1 -- 172.21.15.92:0/2039296248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f000a4a30 msgr2=0x7f9f00009d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:55.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.576+0000 7f9f0e2a7640 1 --2- 172.21.15.92:0/2039296248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f000a4a30 0x7f9f00009d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.576+0000 7f9f0e2a7640 1 -- 172.21.15.92:0/2039296248 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f0015bdd0 con 0x7f9f000a5a40 2024-09-19T09:00:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.577+0000 7f9f0e2a7640 1 --2- 172.21.15.92:0/2039296248 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f000a5a40 0x7f9f0000a330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9f08051790 tx=0x7f9f0806f4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.577+0000 7f9efeffd640 1 -- 172.21.15.92:0/2039296248 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0807a020 con 0x7f9f000a5a40 2024-09-19T09:00:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.577+0000 7f9efeffd640 1 -- 172.21.15.92:0/2039296248 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f08050800 con 0x7f9f000a5a40 2024-09-19T09:00:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.577+0000 7f9efeffd640 1 -- 172.21.15.92:0/2039296248 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f08076cc0 con 0x7f9f000a5a40 2024-09-19T09:00:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.579+0000 7f9f0eaa8640 1 -- 172.21.15.92:0/2039296248 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f0015bfa0 con 0x7f9f000a5a40 2024-09-19T09:00:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.579+0000 7f9f0eaa8640 1 -- 172.21.15.92:0/2039296248 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f0015c3b0 con 0x7f9f000a5a40 2024-09-19T09:00:55.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.583+0000 7f9f12a9f740 1 Processor -- start 2024-09-19T09:00:55.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.583+0000 7f9efeffd640 1 -- 172.21.15.92:0/2039296248 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9f0807d020 con 0x7f9f000a5a40 2024-09-19T09:00:55.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.584+0000 7f9efeffd640 1 --2- 172.21.15.92:0/2039296248 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9ef40a32d0 0x7f9ef40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.585+0000 7f9efeffd640 1 -- 172.21.15.92:0/2039296248 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9f08132790 con 0x7f9f000a5a40 2024-09-19T09:00:55.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.585+0000 7f9f0d2a5640 1 --2- 172.21.15.92:0/2039296248 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9ef40a32d0 0x7f9ef40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.586+0000 7f9f12a9f740 1 -- start start 2024-09-19T09:00:55.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.586+0000 7f9f12a9f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3f2f6bb70 0x55e3f2f6bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.586+0000 7f9f12a9f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f2f6c4b0 0x55e3f2f70f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.586+0000 7f9f12a9f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3f2f71540 0x55e3f2f73a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.586+0000 7f9f12a9f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e3f2ecf2f0 con 0x55e3f2f6c4b0 2024-09-19T09:00:55.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.586+0000 7f9f12a9f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e3f2e77270 con 0x55e3f2f6bb70 2024-09-19T09:00:55.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.586+0000 7f9f12a9f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e3f2ecb2b0 con 0x55e3f2f71540 2024-09-19T09:00:55.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.587+0000 7f9f0d2a5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f2f6c4b0 0x55e3f2f70f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.587+0000 7f9f0d2a5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f2f6c4b0 0x55e3f2f70f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50436/0 (socket says 172.21.15.92:50436) 2024-09-19T09:00:55.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.587+0000 7f9f0d2a5640 1 -- 172.21.15.92:0/2733220048 learned_addr learned my addr 172.21.15.92:0/2733220048 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:55.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.587+0000 7f9f0e2a7640 1 --2- 172.21.15.92:0/2733220048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3f2f71540 0x55e3f2f73a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.587+0000 7f9f0daa6640 1 --2- 172.21.15.92:0/2733220048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3f2f6bb70 0x55e3f2f6bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.587+0000 7f9f0d2a5640 1 -- 172.21.15.92:0/2733220048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3f2f71540 msgr2=0x55e3f2f73a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:55.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.587+0000 7f9f0d2a5640 1 --2- 172.21.15.92:0/2733220048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3f2f71540 0x55e3f2f73a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.587+0000 7f9f0d2a5640 1 -- 172.21.15.92:0/2733220048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3f2f6bb70 msgr2=0x55e3f2f6bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:55.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.587+0000 7f9f0d2a5640 1 --2- 172.21.15.92:0/2733220048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3f2f6bb70 0x55e3f2f6bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.587+0000 7f9f0d2a5640 1 -- 172.21.15.92:0/2733220048 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3f2e76340 con 0x55e3f2f6c4b0 2024-09-19T09:00:55.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.588+0000 7f9f0d2a5640 1 --2- 172.21.15.92:0/2039296248 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9ef40a32d0 0x7f9ef40a5790 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8007d60 tx=0x7f9ef803f000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:55.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.588+0000 7f9f0d2a5640 1 --2- 172.21.15.92:0/2733220048 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f2f6c4b0 0x55e3f2f70f70 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f9ef802b590 tx=0x7f9ef8007cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c247ea6a75c15869 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:55.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.589+0000 7f9ef3fff640 1 -- 172.21.15.92:0/2733220048 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef804e070 con 0x55e3f2f6c4b0 2024-09-19T09:00:55.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.589+0000 7f9ef3fff640 1 -- 172.21.15.92:0/2733220048 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ef80054e0 con 0x55e3f2f6c4b0 2024-09-19T09:00:55.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.589+0000 7f9ef3fff640 1 -- 172.21.15.92:0/2733220048 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef800a5b0 con 0x55e3f2f6c4b0 2024-09-19T09:00:55.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.590+0000 7f9f12a9f740 1 -- 172.21.15.92:0/2733220048 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f2f6c4b0 msgr2=0x55e3f2f70f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:55.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.590+0000 7f9f12a9f740 1 --2- 172.21.15.92:0/2733220048 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f2f6c4b0 0x55e3f2f70f70 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f9ef802b590 tx=0x7f9ef8007cf0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.590+0000 7f9f12a9f740 1 -- 172.21.15.92:0/2733220048 shutdown_connections 2024-09-19T09:00:55.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.590+0000 7f9f12a9f740 1 --2- 172.21.15.92:0/2733220048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3f2f71540 0x55e3f2f73a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.590+0000 7f9f12a9f740 1 --2- 172.21.15.92:0/2733220048 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f2f6c4b0 0x55e3f2f70f70 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.590+0000 7f9f12a9f740 1 --2- 172.21.15.92:0/2733220048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3f2f6bb70 0x55e3f2f6bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.590+0000 7f9f12a9f740 1 -- 172.21.15.92:0/2733220048 >> 172.21.15.92:0/2733220048 conn(0x55e3f2f671e0 msgr2=0x55e3f2f675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:55.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.591+0000 7f9f12a9f740 1 -- 172.21.15.92:0/2733220048 shutdown_connections 2024-09-19T09:00:55.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.591+0000 7f9f12a9f740 1 -- 172.21.15.92:0/2733220048 wait complete. 2024-09-19T09:00:55.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.591+0000 7f9f12a9f740 1 -- start start 2024-09-19T09:00:55.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.591+0000 7f9f12a9f740 1 Processor -- start 2024-09-19T09:00:55.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.592+0000 7f9f12a9f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3f2f6bb70 0x55e3f2f75d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.592+0000 7f9f12a9f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f2f6c4b0 0x55e3f2f762d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.592+0000 7f9f12a9f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3f2f71540 0x55e3f2f7d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.592+0000 7f9f12a9f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e3f2f744b0 con 0x55e3f2f6c4b0 2024-09-19T09:00:55.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.592+0000 7f9f12a9f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e3f2e58290 con 0x55e3f2f71540 2024-09-19T09:00:55.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.592+0000 7f9f12a9f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e3f2f74630 con 0x55e3f2f6bb70 2024-09-19T09:00:55.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.592+0000 7f9f0d2a5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f2f6c4b0 0x55e3f2f762d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.592+0000 7f9f0d2a5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f2f6c4b0 0x55e3f2f762d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50442/0 (socket says 172.21.15.92:50442) 2024-09-19T09:00:55.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.592+0000 7f9f0d2a5640 1 -- 172.21.15.92:0/3098627700 learned_addr learned my addr 172.21.15.92:0/3098627700 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:55.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.592+0000 7f9f12a9f740 10 client.0 _ll_register_callbacks cb 0x55e3f2e89140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:55.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.592+0000 7f9f0e2a7640 1 --2- 172.21.15.92:0/3098627700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3f2f71540 0x55e3f2f7d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.592+0000 7f9f0daa6640 1 --2- 172.21.15.92:0/3098627700 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3f2f6bb70 0x55e3f2f75d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.593+0000 7f9f0e2a7640 1 -- 172.21.15.92:0/3098627700 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3f2f6bb70 msgr2=0x55e3f2f75d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:55.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.593+0000 7f9f0e2a7640 1 --2- 172.21.15.92:0/3098627700 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3f2f6bb70 0x55e3f2f75d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.593+0000 7f9f0e2a7640 1 -- 172.21.15.92:0/3098627700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f2f6c4b0 msgr2=0x55e3f2f762d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:55.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.593+0000 7f9f0e2a7640 1 --2- 172.21.15.92:0/3098627700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f2f6c4b0 0x55e3f2f762d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.593+0000 7f9f0e2a7640 1 -- 172.21.15.92:0/3098627700 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3f2be2210 con 0x55e3f2f71540 2024-09-19T09:00:55.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.593+0000 7f9f0daa6640 1 --2- 172.21.15.92:0/3098627700 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3f2f6bb70 0x55e3f2f75d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:55.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.594+0000 7f9f0e2a7640 1 --2- 172.21.15.92:0/3098627700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3f2f71540 0x55e3f2f7d310 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9f08051220 tx=0x7f9f080fecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55934b8c1c3dd8d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:55.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.594+0000 7f9ef17fa640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:00:55.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.594+0000 7f9ef17fa640 1 -- 172.21.15.92:0/3098627700 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f08076e60 con 0x55e3f2f71540 2024-09-19T09:00:55.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.594+0000 7f9ef17fa640 1 -- 172.21.15.92:0/3098627700 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9f0806fb30 con 0x55e3f2f71540 2024-09-19T09:00:55.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.594+0000 7f9f12a9f740 1 -- 172.21.15.92:0/3098627700 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ef80054e0 con 0x55e3f2f71540 2024-09-19T09:00:55.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.594+0000 7f9ef17fa640 1 -- 172.21.15.92:0/3098627700 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9f080fb420 con 0x55e3f2f71540 2024-09-19T09:00:55.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.594+0000 7f9f12a9f740 10 client.25784 fetch_fsmap learned FSMap version 19 2024-09-19T09:00:55.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.594+0000 7f9f12a9f740 1 -- 172.21.15.92:0/3098627700 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e3f2cae620 con 0x55e3f2f71540 2024-09-19T09:00:55.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.595+0000 7f9ef17fa640 1 -- 172.21.15.92:0/3098627700 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ef80054e0 con 0x55e3f2f71540 2024-09-19T09:00:55.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.595+0000 7f9ef17fa640 1 -- 172.21.15.92:0/3098627700 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f9f080fac10 con 0x55e3f2f71540 2024-09-19T09:00:55.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.595+0000 7f9f12a9f740 10 client.25784 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:00:55.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.595+0000 7f9f12a9f740 10 client.25784 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:00:55.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.595+0000 7f9f12a9f740 20 client.25784 populate_metadata read hostname 'smithi092' 2024-09-19T09:00:55.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.595+0000 7f9f12a9f740 1 --2- 172.21.15.92:0/3098627700 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e3f2f81a60 0x55e3f2f83e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.595+0000 7f9f12a9f740 4 client.25784 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:00:55.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.595+0000 7f9f12a9f740 1 -- 172.21.15.92:0/3098627700 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e3f2edca20 con 0x55e3f2f81a60 2024-09-19T09:00:55.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.595+0000 7f9f0daa6640 1 --2- 172.21.15.92:0/3098627700 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e3f2f81a60 0x55e3f2f83e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.596+0000 7f9f0daa6640 1 --2- 172.21.15.92:0/3098627700 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e3f2f81a60 0x55e3f2f83e70 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=799f9461d110cf54 server_cookie=b27840339f9fada4 in_seq=0 out_seq=0 2024-09-19T09:00:55.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.596+0000 7f9ef17fa640 10 client.25784 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:55.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.597+0000 7f9ef17fa640 1 -- 172.21.15.92:0/3098627700 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e3f2edca20 con 0x55e3f2f81a60 2024-09-19T09:00:55.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.597+0000 7f9ef17fa640 10 client.25784 handle_command_reply: tid=0 2024-09-19T09:00:55.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.597+0000 7f9f12a9f740 1 client.25784 shutdown 2024-09-19T09:00:55.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.597+0000 7f9f12a9f740 1 -- 172.21.15.92:0/3098627700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3f2f71540 msgr2=0x55e3f2f7d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:55.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.597+0000 7f9f12a9f740 1 --2- 172.21.15.92:0/3098627700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3f2f71540 0x55e3f2f7d310 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9f08051220 tx=0x7f9f080fecb0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.598+0000 7f9f12a9f740 1 -- 172.21.15.92:0/3098627700 shutdown_connections 2024-09-19T09:00:55.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.598+0000 7f9f12a9f740 1 --2- 172.21.15.92:0/3098627700 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e3f2f81a60 0x55e3f2f83e70 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.598+0000 7f9f12a9f740 1 --2- 172.21.15.92:0/3098627700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3f2f71540 0x55e3f2f7d310 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.598+0000 7f9f12a9f740 1 --2- 172.21.15.92:0/3098627700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f2f6c4b0 0x55e3f2f762d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.598+0000 7f9f12a9f740 1 --2- 172.21.15.92:0/3098627700 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3f2f6bb70 0x55e3f2f75d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.598+0000 7f9f12a9f740 1 -- 172.21.15.92:0/3098627700 >> 172.21.15.92:0/3098627700 conn(0x55e3f2f671e0 msgr2=0x55e3f2f689f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:55.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.598+0000 7f9ef17fa640 0 client.25784 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:55.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.598+0000 7f9f12a9f740 1 -- 172.21.15.92:0/3098627700 shutdown_connections 2024-09-19T09:00:55.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.599+0000 7f9f12a9f740 1 -- 172.21.15.92:0/3098627700 wait complete. 2024-09-19T09:00:55.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.599+0000 7f9f12a9f740 20 client.25784 trim_cache size 0 max 16384 2024-09-19T09:00:55.601 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.624+0000 7f9f12a9f740 1 Processor -- start 2024-09-19T09:00:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.624+0000 7f9f12a9f740 1 -- start start 2024-09-19T09:00:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.625+0000 7f9f12a9f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3f2f6bb70 0x55e3f2f68090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.625+0000 7f9f12a9f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3f2f6c4b0 0x55e3f2f7d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.625+0000 7f9f12a9f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f2f71540 0x55e3f2f685d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.625+0000 7f9f12a9f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9f001631b0 con 0x55e3f2f71540 2024-09-19T09:00:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.625+0000 7f9f12a9f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9f00165a50 con 0x55e3f2f6bb70 2024-09-19T09:00:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.625+0000 7f9f12a9f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9f00163840 con 0x55e3f2f6c4b0 2024-09-19T09:00:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.625+0000 7f9f0daa6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3f2f6bb70 0x55e3f2f68090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.625+0000 7f9f0daa6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3f2f6bb70 0x55e3f2f68090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:59286/0 (socket says 172.21.15.92:59286) 2024-09-19T09:00:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.625+0000 7f9f0daa6640 1 -- 172.21.15.92:0/3384675152 learned_addr learned my addr 172.21.15.92:0/3384675152 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:55.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.625+0000 7f9f0d2a5640 1 --2- 172.21.15.92:0/3384675152 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3f2f6c4b0 0x55e3f2f7d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.625+0000 7f9f0daa6640 1 -- 172.21.15.92:0/3384675152 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3f2f6c4b0 msgr2=0x55e3f2f7d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:55.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.625+0000 7f9f0daa6640 1 --2- 172.21.15.92:0/3384675152 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3f2f6c4b0 0x55e3f2f7d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.625+0000 7f9f0daa6640 1 -- 172.21.15.92:0/3384675152 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f2f71540 msgr2=0x55e3f2f685d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:55.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.625+0000 7f9f0daa6640 1 --2- 172.21.15.92:0/3384675152 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f2f71540 0x55e3f2f685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.625+0000 7f9f0daa6640 1 -- 172.21.15.92:0/3384675152 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3f2f67000 con 0x55e3f2f6bb70 2024-09-19T09:00:55.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.626+0000 7f9f0daa6640 1 --2- 172.21.15.92:0/3384675152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3f2f6bb70 0x55e3f2f68090 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9f04005b60 tx=0x7f9f04005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc05ef4f6330b021 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:55.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.626+0000 7f9ef37fe640 1 -- 172.21.15.92:0/3384675152 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f04012450 con 0x55e3f2f6bb70 2024-09-19T09:00:55.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.626+0000 7f9ef37fe640 1 -- 172.21.15.92:0/3384675152 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f04012ad0 con 0x55e3f2f6bb70 2024-09-19T09:00:55.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.626+0000 7f9ef37fe640 1 -- 172.21.15.92:0/3384675152 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0401db00 con 0x55e3f2f6bb70 2024-09-19T09:00:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.628+0000 7f9f12a9f740 1 -- 172.21.15.92:0/3384675152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3f2f6bb70 msgr2=0x55e3f2f68090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.628+0000 7f9f12a9f740 1 --2- 172.21.15.92:0/3384675152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3f2f6bb70 0x55e3f2f68090 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9f04005b60 tx=0x7f9f04005f90 comp rx=0 tx=0).stop 2024-09-19T09:00:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.628+0000 7f9f12a9f740 1 -- 172.21.15.92:0/3384675152 shutdown_connections 2024-09-19T09:00:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.628+0000 7f9f12a9f740 1 --2- 172.21.15.92:0/3384675152 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f2f71540 0x55e3f2f685d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.628+0000 7f9f12a9f740 1 --2- 172.21.15.92:0/3384675152 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3f2f6c4b0 0x55e3f2f7d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.628+0000 7f9f12a9f740 1 --2- 172.21.15.92:0/3384675152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3f2f6bb70 0x55e3f2f68090 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.628+0000 7f9f12a9f740 1 -- 172.21.15.92:0/3384675152 >> 172.21.15.92:0/3384675152 conn(0x55e3f2f671e0 msgr2=0x55e3f2f6d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:55.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.628+0000 7f9f12a9f740 1 -- 172.21.15.92:0/3384675152 shutdown_connections 2024-09-19T09:00:55.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.628+0000 7f9f12a9f740 1 -- 172.21.15.92:0/3384675152 wait complete. 2024-09-19T09:00:55.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.629+0000 7f9f12a9f740 1 -- start start 2024-09-19T09:00:55.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.630+0000 7f9f12a9f740 1 Processor -- start 2024-09-19T09:00:55.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.630+0000 7f9f12a9f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f2f6bb70 0x55e3f2f79ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.630+0000 7f9f12a9f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3f2f6c4b0 0x55e3f2f7a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.631+0000 7f9f0daa6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f2f6bb70 0x55e3f2f79ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.631+0000 7f9f0daa6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f2f6bb70 0x55e3f2f79ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50454/0 (socket says 172.21.15.92:50454) 2024-09-19T09:00:55.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.631+0000 7f9f0daa6640 1 -- 172.21.15.92:0/2521164172 learned_addr learned my addr 172.21.15.92:0/2521164172 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:55.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.631+0000 7f9f12a9f740 1 --2- 172.21.15.92:0/2521164172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3f2f71540 0x55e3f2fea740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.631+0000 7f9f12a9f740 1 -- 172.21.15.92:0/2521164172 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9f00163f10 con 0x55e3f2f6bb70 2024-09-19T09:00:55.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.631+0000 7f9f12a9f740 1 -- 172.21.15.92:0/2521164172 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9f00165380 con 0x55e3f2f71540 2024-09-19T09:00:55.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.631+0000 7f9f0d2a5640 1 --2- 172.21.15.92:0/2521164172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3f2f6c4b0 0x55e3f2f7a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.631+0000 7f9f12a9f740 1 -- 172.21.15.92:0/2521164172 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9f001645e0 con 0x55e3f2f6c4b0 2024-09-19T09:00:55.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.631+0000 7f9f0e2a7640 1 --2- 172.21.15.92:0/2521164172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3f2f71540 0x55e3f2fea740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.632+0000 7f9f12a9f740 10 client.0 _ll_register_callbacks cb 0x7f9f080fb050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.632+0000 7f9f0e2a7640 1 -- 172.21.15.92:0/2521164172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3f2f6c4b0 msgr2=0x55e3f2f7a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.632+0000 7f9f0e2a7640 1 --2- 172.21.15.92:0/2521164172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3f2f6c4b0 0x55e3f2f7a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.632+0000 7f9f0e2a7640 1 -- 172.21.15.92:0/2521164172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f2f6bb70 msgr2=0x55e3f2f79ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.632+0000 7f9f0e2a7640 1 --2- 172.21.15.92:0/2521164172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f2f6bb70 0x55e3f2f79ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.632+0000 7f9f0e2a7640 1 -- 172.21.15.92:0/2521164172 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3f2f7d4f0 con 0x55e3f2f71540 2024-09-19T09:00:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.632+0000 7f9f0d2a5640 1 --2- 172.21.15.92:0/2521164172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3f2f6c4b0 0x55e3f2f7a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:00:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.632+0000 7f9f0e2a7640 1 --2- 172.21.15.92:0/2521164172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3f2f71540 0x55e3f2fea740 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9f080fb780 tx=0x7f9f08067e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a97ac09e4e0f42b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.632+0000 7f9ef17fa640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:00:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.632+0000 7f9ef17fa640 1 -- 172.21.15.92:0/2521164172 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f08076e60 con 0x55e3f2f71540 2024-09-19T09:00:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.632+0000 7f9ef17fa640 1 -- 172.21.15.92:0/2521164172 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9f080fe200 con 0x55e3f2f71540 2024-09-19T09:00:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.632+0000 7f9f12a9f740 1 -- 172.21.15.92:0/2521164172 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f04012ad0 con 0x55e3f2f71540 2024-09-19T09:00:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.633+0000 7f9ef17fa640 1 -- 172.21.15.92:0/2521164172 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9f080e2080 con 0x55e3f2f71540 2024-09-19T09:00:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.633+0000 7f9f12a9f740 10 client.25790 fetch_fsmap learned FSMap version 19 2024-09-19T09:00:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.633+0000 7f9f12a9f740 1 -- 172.21.15.92:0/2521164172 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55e3f2feba80 con 0x55e3f2f71540 2024-09-19T09:00:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.633+0000 7f9ef17fa640 1 -- 172.21.15.92:0/2521164172 <== mon.2 v2:172.21.15.167:3300/0 4 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f9f08076420 con 0x55e3f2f71540 2024-09-19T09:00:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.633+0000 7f9f12a9f740 10 client.25790 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:00:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.633+0000 7f9f12a9f740 10 client.25790 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:00:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.634+0000 7f9f12a9f740 20 client.25790 populate_metadata read hostname 'smithi092' 2024-09-19T09:00:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.634+0000 7f9f12a9f740 1 --2- 172.21.15.92:0/2521164172 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e3f2fec320 0x55e3f2fee740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.634+0000 7f9f12a9f740 4 client.25790 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:00:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.634+0000 7f9f12a9f740 1 -- 172.21.15.92:0/2521164172 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f9f04012ad0 con 0x55e3f2fec320 2024-09-19T09:00:55.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.635+0000 7f9f0daa6640 1 --2- 172.21.15.92:0/2521164172 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e3f2fec320 0x55e3f2fee740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.635+0000 7f9ef17fa640 10 client.25790 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:55.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.635+0000 7f9f0daa6640 1 --2- 172.21.15.92:0/2521164172 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e3f2fec320 0x55e3f2fee740 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92061358d1aa840e server_cookie=5f8fdab0bc7f32c9 in_seq=0 out_seq=0 2024-09-19T09:00:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.654+0000 7f9ef17fa640 1 -- 172.21.15.92:0/2521164172 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f9f04012ad0 con 0x55e3f2fec320 2024-09-19T09:00:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.654+0000 7f9ef17fa640 10 client.25790 handle_command_reply: tid=0 2024-09-19T09:00:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.654+0000 7f9f12a9f740 1 client.25790 shutdown 2024-09-19T09:00:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.655+0000 7f9f12a9f740 1 -- 172.21.15.92:0/2521164172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3f2f71540 msgr2=0x55e3f2fea740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.655+0000 7f9f12a9f740 1 --2- 172.21.15.92:0/2521164172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3f2f71540 0x55e3f2fea740 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9f080fb780 tx=0x7f9f08067e40 comp rx=0 tx=0).stop 2024-09-19T09:00:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.655+0000 7f9f12a9f740 1 -- 172.21.15.92:0/2521164172 shutdown_connections 2024-09-19T09:00:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.655+0000 7f9f12a9f740 1 --2- 172.21.15.92:0/2521164172 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e3f2fec320 0x55e3f2fee740 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.655+0000 7f9f12a9f740 1 --2- 172.21.15.92:0/2521164172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3f2f71540 0x55e3f2fea740 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.655+0000 7f9f12a9f740 1 --2- 172.21.15.92:0/2521164172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3f2f6c4b0 0x55e3f2f7a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.655+0000 7f9f12a9f740 1 --2- 172.21.15.92:0/2521164172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3f2f6bb70 0x55e3f2f79ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.655+0000 7f9f12a9f740 1 -- 172.21.15.92:0/2521164172 >> 172.21.15.92:0/2521164172 conn(0x55e3f2f671e0 msgr2=0x55e3f2f74a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:55.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.655+0000 7f9ef17fa640 0 client.25790 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:55.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.655+0000 7f9f12a9f740 1 -- 172.21.15.92:0/2521164172 shutdown_connections 2024-09-19T09:00:55.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.655+0000 7f9f12a9f740 1 -- 172.21.15.92:0/2521164172 wait complete. 2024-09-19T09:00:55.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.655+0000 7f9f12a9f740 20 client.25790 trim_cache size 0 max 16384 2024-09-19T09:00:55.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:00:55.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:00:55.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:00:55.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:00:55.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.656+0000 7f9f0eaa8640 1 -- 172.21.15.92:0/2039296248 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9ef40a32d0 msgr2=0x7f9ef40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:55.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.656+0000 7f9f0eaa8640 1 --2- 172.21.15.92:0/2039296248 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9ef40a32d0 0x7f9ef40a5790 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8007d60 tx=0x7f9ef803f000 comp rx=0 tx=0).stop 2024-09-19T09:00:55.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.656+0000 7f9f0eaa8640 1 -- 172.21.15.92:0/2039296248 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f000a5a40 msgr2=0x7f9f0000a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:55.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.656+0000 7f9f0eaa8640 1 --2- 172.21.15.92:0/2039296248 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f000a5a40 0x7f9f0000a330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9f08051790 tx=0x7f9f0806f4b0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.656+0000 7f9f0eaa8640 1 -- 172.21.15.92:0/2039296248 shutdown_connections 2024-09-19T09:00:55.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.656+0000 7f9f0eaa8640 1 --2- 172.21.15.92:0/2039296248 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f000a5a40 0x7f9f0000a330 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.656+0000 7f9f0eaa8640 1 --2- 172.21.15.92:0/2039296248 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9ef40a32d0 0x7f9ef40a5790 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.656+0000 7f9f0eaa8640 1 --2- 172.21.15.92:0/2039296248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f000a4a30 0x7f9f00009d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.656+0000 7f9f0eaa8640 1 --2- 172.21.15.92:0/2039296248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f000a4070 0x7f9f0000b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.656+0000 7f9f0eaa8640 1 -- 172.21.15.92:0/2039296248 >> 172.21.15.92:0/2039296248 conn(0x7f9f0009fba0 msgr2=0x7f9f00014fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.656+0000 7f9f0eaa8640 1 -- 172.21.15.92:0/2039296248 shutdown_connections 2024-09-19T09:00:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:00:55.656+0000 7f9f0eaa8640 1 -- 172.21.15.92:0/2039296248 wait complete. 2024-09-19T09:00:55.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 250.0 s, 3262.9 tps, lat 196.615 ms stddev 2222.469 2024-09-19T09:00:55.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:55 smithi167 ceph-mon[35359]: pgmap v463: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 3.1 MiB/s wr, 251 op/s 2024-09-19T09:00:55.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:55 smithi190 ceph-mon[35358]: pgmap v463: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 3.1 MiB/s wr, 251 op/s 2024-09-19T09:00:55.878 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:55 smithi092 ceph-mon[31407]: pgmap v463: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 3.1 MiB/s wr, 251 op/s 2024-09-19T09:00:56.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.161+0000 7f70767fc640 1 -- 172.21.15.92:0/3430432666 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706c035020 con 0x7f7078108450 2024-09-19T09:00:56.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.161+0000 7f707e233640 1 -- 172.21.15.92:0/3430432666 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7078108450 msgr2=0x7f7078108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:56.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.161+0000 7f707e233640 1 --2- 172.21.15.92:0/3430432666 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7078108450 0x7f7078108830 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f706c009900 tx=0x7f706c02a3f0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.161+0000 7f707e233640 1 -- 172.21.15.92:0/3430432666 shutdown_connections 2024-09-19T09:00:56.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.161+0000 7f707e233640 1 --2- 172.21.15.92:0/3430432666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f707810d530 0x7f70781150b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.161+0000 7f707e233640 1 --2- 172.21.15.92:0/3430432666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7078108e00 0x7f707810ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.161+0000 7f707e233640 1 --2- 172.21.15.92:0/3430432666 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7078108450 0x7f7078108830 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.161+0000 7f707e233640 1 -- 172.21.15.92:0/3430432666 >> 172.21.15.92:0/3430432666 conn(0x7f7078077ba0 msgr2=0x7f7078079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:56.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.163+0000 7f707e233640 1 -- 172.21.15.92:0/3430432666 shutdown_connections 2024-09-19T09:00:56.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.163+0000 7f707e233640 1 -- 172.21.15.92:0/3430432666 wait complete. 2024-09-19T09:00:56.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.164+0000 7f707e233640 1 Processor -- start 2024-09-19T09:00:56.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.164+0000 7f707e233640 1 -- start start 2024-09-19T09:00:56.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.164+0000 7f707e233640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7078108450 0x7f707819eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:56.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.164+0000 7f707e233640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7078108e00 0x7f707819f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:56.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.164+0000 7f707e233640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f707810d530 0x7f70781a3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:56.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.164+0000 7f707e233640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7078118600 con 0x7f7078108e00 2024-09-19T09:00:56.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.164+0000 7f707e233640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7078118480 con 0x7f7078108450 2024-09-19T09:00:56.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.164+0000 7f707e233640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7078118780 con 0x7f707810d530 2024-09-19T09:00:56.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.164+0000 7f70777fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7078108450 0x7f707819eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:56.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.164+0000 7f7077fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f707810d530 0x7f70781a3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:56.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.164+0000 7f7076ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7078108e00 0x7f707819f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:56.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.165+0000 7f7077fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f707810d530 0x7f70781a3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:49650/0 (socket says 172.21.15.92:49650) 2024-09-19T09:00:56.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.165+0000 7f70777fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7078108450 0x7f707819eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:59314/0 (socket says 172.21.15.92:59314) 2024-09-19T09:00:56.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.165+0000 7f7077fff640 1 -- 172.21.15.92:0/3279673482 learned_addr learned my addr 172.21.15.92:0/3279673482 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:56.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.165+0000 7f7077fff640 1 -- 172.21.15.92:0/3279673482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7078108450 msgr2=0x7f707819eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:56.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.165+0000 7f7077fff640 1 --2- 172.21.15.92:0/3279673482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7078108450 0x7f707819eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.165+0000 7f7077fff640 1 -- 172.21.15.92:0/3279673482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7078108e00 msgr2=0x7f707819f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:56.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.165+0000 7f7077fff640 1 --2- 172.21.15.92:0/3279673482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7078108e00 0x7f707819f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.165+0000 7f7077fff640 1 -- 172.21.15.92:0/3279673482 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70781a3b50 con 0x7f707810d530 2024-09-19T09:00:56.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.165+0000 7f7077fff640 1 --2- 172.21.15.92:0/3279673482 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f707810d530 0x7f70781a3420 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f706800e970 tx=0x7f706800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:56.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.165+0000 7f7074ff9640 1 -- 172.21.15.92:0/3279673482 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706800ccc0 con 0x7f707810d530 2024-09-19T09:00:56.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.165+0000 7f7074ff9640 1 -- 172.21.15.92:0/3279673482 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f706800ce60 con 0x7f707810d530 2024-09-19T09:00:56.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.166+0000 7f7074ff9640 1 -- 172.21.15.92:0/3279673482 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7068010430 con 0x7f707810d530 2024-09-19T09:00:56.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.166+0000 7f707e233640 1 -- 172.21.15.92:0/3279673482 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70781a3e40 con 0x7f707810d530 2024-09-19T09:00:56.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.166+0000 7f707e233640 1 -- 172.21.15.92:0/3279673482 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70781ab6d0 con 0x7f707810d530 2024-09-19T09:00:56.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.168+0000 7f7074ff9640 1 -- 172.21.15.92:0/3279673482 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7068005020 con 0x7f707810d530 2024-09-19T09:00:56.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.169+0000 7f7074ff9640 1 --2- 172.21.15.92:0/3279673482 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f70600a3240 0x7f70600a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:56.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.169+0000 7f7074ff9640 1 -- 172.21.15.92:0/3279673482 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f70680cfc90 con 0x7f707810d530 2024-09-19T09:00:56.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.169+0000 7f70777fe640 1 --2- 172.21.15.92:0/3279673482 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f70600a3240 0x7f70600a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:56.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.169+0000 7f708060c740 1 Processor -- start 2024-09-19T09:00:56.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.170+0000 7f708060c740 1 -- start start 2024-09-19T09:00:56.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.170+0000 7f708060c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562cae172760 0x562cae172b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:56.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.170+0000 7f708060c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562cae173080 0x562cae17d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:56.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.170+0000 7f708060c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562cae17d940 0x562cae17fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:56.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.170+0000 7f70777fe640 1 --2- 172.21.15.92:0/3279673482 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f70600a3240 0x7f70600a5700 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f706c006010 tx=0x7f706c009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:56.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.170+0000 7f708060c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562cae0d82a0 con 0x562cae17d940 2024-09-19T09:00:56.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.170+0000 7f708060c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x562cae07fb10 con 0x562cae172760 2024-09-19T09:00:56.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.170+0000 7f708060c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x562cae0d4260 con 0x562cae173080 2024-09-19T09:00:56.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.170+0000 7f70777fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562cae172760 0x562cae172b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:56.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.170+0000 7f70777fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562cae172760 0x562cae172b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:59320/0 (socket says 172.21.15.92:59320) 2024-09-19T09:00:56.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.170+0000 7f7076ffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562cae173080 0x562cae17d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:56.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.170+0000 7f7077fff640 1 --2- 172.21.15.92:0/1247900509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562cae17d940 0x562cae17fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:56.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.170+0000 7f70777fe640 1 -- 172.21.15.92:0/1247900509 learned_addr learned my addr 172.21.15.92:0/1247900509 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:56.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.171+0000 7f7077fff640 1 -- 172.21.15.92:0/1247900509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562cae173080 msgr2=0x562cae17d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:56.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.171+0000 7f7077fff640 1 --2- 172.21.15.92:0/1247900509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562cae173080 0x562cae17d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.171+0000 7f7077fff640 1 -- 172.21.15.92:0/1247900509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562cae172760 msgr2=0x562cae172b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:56.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.171+0000 7f7077fff640 1 --2- 172.21.15.92:0/1247900509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562cae172760 0x562cae172b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.171+0000 7f7077fff640 1 -- 172.21.15.92:0/1247900509 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cade49b90 con 0x562cae17d940 2024-09-19T09:00:56.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.171+0000 7f70777fe640 1 --2- 172.21.15.92:0/1247900509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562cae172760 0x562cae172b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:56.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.171+0000 7f7077fff640 1 --2- 172.21.15.92:0/1247900509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562cae17d940 0x562cae17fd30 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f706800d010 tx=0x7f706809bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d0321e77d42a96c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:56.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.171+0000 7f705dffb640 1 -- 172.21.15.92:0/1247900509 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70680a4f20 con 0x562cae17d940 2024-09-19T09:00:56.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.171+0000 7f705dffb640 1 -- 172.21.15.92:0/1247900509 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f706809a350 con 0x562cae17d940 2024-09-19T09:00:56.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.171+0000 7f705dffb640 1 -- 172.21.15.92:0/1247900509 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70680a4a90 con 0x562cae17d940 2024-09-19T09:00:56.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.172+0000 7f708060c740 1 -- 172.21.15.92:0/1247900509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562cae17d940 msgr2=0x562cae17fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:56.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.172+0000 7f708060c740 1 --2- 172.21.15.92:0/1247900509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562cae17d940 0x562cae17fd30 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f706800d010 tx=0x7f706809bcd0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.172+0000 7f708060c740 1 -- 172.21.15.92:0/1247900509 shutdown_connections 2024-09-19T09:00:56.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.172+0000 7f708060c740 1 --2- 172.21.15.92:0/1247900509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562cae17d940 0x562cae17fd30 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.172+0000 7f708060c740 1 --2- 172.21.15.92:0/1247900509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562cae173080 0x562cae17d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.172+0000 7f708060c740 1 --2- 172.21.15.92:0/1247900509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562cae172760 0x562cae172b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.172+0000 7f708060c740 1 -- 172.21.15.92:0/1247900509 >> 172.21.15.92:0/1247900509 conn(0x562cae16ecf0 msgr2=0x562cae16f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:56.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.172+0000 7f708060c740 1 -- 172.21.15.92:0/1247900509 shutdown_connections 2024-09-19T09:00:56.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.172+0000 7f708060c740 1 -- 172.21.15.92:0/1247900509 wait complete. 2024-09-19T09:00:56.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.173+0000 7f708060c740 1 -- start start 2024-09-19T09:00:56.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.173+0000 7f708060c740 1 Processor -- start 2024-09-19T09:00:56.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.173+0000 7f708060c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562cae172760 0x562cae17a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:56.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.173+0000 7f708060c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562cae173080 0x562cae17ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:56.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.173+0000 7f708060c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562cae17d940 0x562cae17b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:56.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.174+0000 7f708060c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562cae180510 con 0x562cae172760 2024-09-19T09:00:56.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.174+0000 7f708060c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x562cae0606e0 con 0x562cae173080 2024-09-19T09:00:56.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.174+0000 7f708060c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x562cae180690 con 0x562cae17d940 2024-09-19T09:00:56.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.174+0000 7f7077fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562cae17d940 0x562cae17b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:56.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.174+0000 7f7077fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562cae17d940 0x562cae17b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:49660/0 (socket says 172.21.15.92:49660) 2024-09-19T09:00:56.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.174+0000 7f7077fff640 1 -- 172.21.15.92:0/2657509293 learned_addr learned my addr 172.21.15.92:0/2657509293 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:56.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.174+0000 7f70777fe640 1 --2- 172.21.15.92:0/2657509293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562cae172760 0x562cae17a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:56.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.174+0000 7f7076ffd640 1 --2- 172.21.15.92:0/2657509293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562cae173080 0x562cae17ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:56.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.174+0000 7f708060c740 10 client.0 _ll_register_callbacks cb 0x562cae084a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:56.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.174+0000 7f7077fff640 1 -- 172.21.15.92:0/2657509293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562cae173080 msgr2=0x562cae17ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:56.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.174+0000 7f7077fff640 1 --2- 172.21.15.92:0/2657509293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562cae173080 0x562cae17ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.174+0000 7f7077fff640 1 -- 172.21.15.92:0/2657509293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562cae172760 msgr2=0x562cae17a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:56.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.174+0000 7f7077fff640 1 --2- 172.21.15.92:0/2657509293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562cae172760 0x562cae17a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.174+0000 7f7077fff640 1 -- 172.21.15.92:0/2657509293 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cae189a00 con 0x562cae17d940 2024-09-19T09:00:56.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.174+0000 7f708060c740 1 -- 172.21.15.92:0/2657509293 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f706809a350 con 0x562cae17d940 2024-09-19T09:00:56.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.175+0000 7f7077fff640 1 --2- 172.21.15.92:0/2657509293 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562cae17d940 0x562cae17b2b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f70680a49f0 tx=0x7f706809bd40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff29ffefc01fa33f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:56.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.175+0000 7f7056ffd640 10 client.25720 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:00:56.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.175+0000 7f7056ffd640 1 -- 172.21.15.92:0/2657509293 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70680a4f20 con 0x562cae17d940 2024-09-19T09:00:56.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.175+0000 7f7056ffd640 1 -- 172.21.15.92:0/2657509293 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f7068098920 con 0x562cae17d940 2024-09-19T09:00:56.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.175+0000 7f7056ffd640 1 -- 172.21.15.92:0/2657509293 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7068005380 con 0x562cae17d940 2024-09-19T09:00:56.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.175+0000 7f708060c740 10 client.25720 fetch_fsmap learned FSMap version 19 2024-09-19T09:00:56.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.175+0000 7f708060c740 1 -- 172.21.15.92:0/2657509293 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({fsmap=19}) -- 0x562cae180560 con 0x562cae17d940 2024-09-19T09:00:56.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.175+0000 7f7056ffd640 1 -- 172.21.15.92:0/2657509293 <== mon.1 v2:172.21.15.190:3300/0 4 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f70680a0170 con 0x562cae17d940 2024-09-19T09:00:56.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.175+0000 7f708060c740 10 client.25720 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:00:56.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.175+0000 7f708060c740 10 client.25720 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:00:56.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.175+0000 7f708060c740 20 client.25720 populate_metadata read hostname 'smithi092' 2024-09-19T09:00:56.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.176+0000 7f708060c740 1 --2- 172.21.15.92:0/2657509293 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562cae18d370 0x562cae18f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:56.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.176+0000 7f708060c740 4 client.25720 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:00:56.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.176+0000 7f708060c740 1 -- 172.21.15.92:0/2657509293 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f706809a350 con 0x562cae18d370 2024-09-19T09:00:56.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.176+0000 7f70777fe640 1 --2- 172.21.15.92:0/2657509293 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562cae18d370 0x562cae18f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:56.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.176+0000 7f70777fe640 1 --2- 172.21.15.92:0/2657509293 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562cae18d370 0x562cae18f760 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19654fa0af08c33e server_cookie=a60aaa727450941b in_seq=0 out_seq=0 2024-09-19T09:00:56.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.176+0000 7f7056ffd640 10 client.25720 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:56.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.177+0000 7f7056ffd640 1 -- 172.21.15.92:0/2657509293 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f706809a350 con 0x562cae18d370 2024-09-19T09:00:56.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.177+0000 7f7056ffd640 10 client.25720 handle_command_reply: tid=0 2024-09-19T09:00:56.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.177+0000 7f708060c740 1 client.25720 shutdown 2024-09-19T09:00:56.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.177+0000 7f708060c740 1 -- 172.21.15.92:0/2657509293 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562cae17d940 msgr2=0x562cae17b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:56.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.177+0000 7f708060c740 1 --2- 172.21.15.92:0/2657509293 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562cae17d940 0x562cae17b2b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f70680a49f0 tx=0x7f706809bd40 comp rx=0 tx=0).stop 2024-09-19T09:00:56.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.178+0000 7f708060c740 1 -- 172.21.15.92:0/2657509293 shutdown_connections 2024-09-19T09:00:56.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.178+0000 7f708060c740 1 --2- 172.21.15.92:0/2657509293 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562cae18d370 0x562cae18f760 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.178+0000 7f7056ffd640 0 client.25720 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:56.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.178+0000 7f708060c740 1 --2- 172.21.15.92:0/2657509293 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562cae17d940 0x562cae17b2b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.178+0000 7f708060c740 1 --2- 172.21.15.92:0/2657509293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562cae173080 0x562cae17ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.178+0000 7f708060c740 1 --2- 172.21.15.92:0/2657509293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562cae172760 0x562cae17a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.178+0000 7f708060c740 1 -- 172.21.15.92:0/2657509293 >> 172.21.15.92:0/2657509293 conn(0x562cae16ecf0 msgr2=0x562cae16de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:56.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.178+0000 7f708060c740 1 -- 172.21.15.92:0/2657509293 shutdown_connections 2024-09-19T09:00:56.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.178+0000 7f708060c740 1 -- 172.21.15.92:0/2657509293 wait complete. 2024-09-19T09:00:56.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.178+0000 7f708060c740 20 client.25720 trim_cache size 0 max 16384 2024-09-19T09:00:56.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.206+0000 7f708060c740 1 Processor -- start 2024-09-19T09:00:56.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.206+0000 7f708060c740 1 -- start start 2024-09-19T09:00:56.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.206+0000 7f708060c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562cae172760 0x562cae194e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:56.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.206+0000 7f708060c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562cae173080 0x562cae1953c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:56.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.206+0000 7f708060c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562cae17d940 0x562cae177ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:56.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.206+0000 7f708060c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f70781b1c50 con 0x562cae173080 2024-09-19T09:00:56.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.206+0000 7f708060c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f70781b44f0 con 0x562cae172760 2024-09-19T09:00:56.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.206+0000 7f708060c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f70781b22e0 con 0x562cae17d940 2024-09-19T09:00:56.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.207+0000 7f70777fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562cae172760 0x562cae194e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:56.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.207+0000 7f70777fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562cae172760 0x562cae194e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:59334/0 (socket says 172.21.15.92:59334) 2024-09-19T09:00:56.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.207+0000 7f70777fe640 1 -- 172.21.15.92:0/2136929736 learned_addr learned my addr 172.21.15.92:0/2136929736 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:56.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.207+0000 7f7077fff640 1 --2- 172.21.15.92:0/2136929736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562cae17d940 0x562cae177ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:56.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.207+0000 7f70777fe640 1 -- 172.21.15.92:0/2136929736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562cae17d940 msgr2=0x562cae177ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:56.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.207+0000 7f70777fe640 1 --2- 172.21.15.92:0/2136929736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562cae17d940 0x562cae177ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.207+0000 7f70777fe640 1 -- 172.21.15.92:0/2136929736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562cae173080 msgr2=0x562cae1953c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:56.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.207+0000 7f70777fe640 1 --2- 172.21.15.92:0/2136929736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562cae173080 0x562cae1953c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.207+0000 7f70777fe640 1 -- 172.21.15.92:0/2136929736 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cae16a260 con 0x562cae172760 2024-09-19T09:00:56.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.207+0000 7f7077fff640 1 --2- 172.21.15.92:0/2136929736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562cae17d940 0x562cae177ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:00:56.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.207+0000 7f70777fe640 1 --2- 172.21.15.92:0/2136929736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562cae172760 0x562cae194e80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f706c02a910 tx=0x7f706c040000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a4e42be46c7339d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:56.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.208+0000 7f705d7fa640 1 -- 172.21.15.92:0/2136929736 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706c035040 con 0x562cae172760 2024-09-19T09:00:56.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.208+0000 7f705d7fa640 1 -- 172.21.15.92:0/2136929736 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f706c031cb0 con 0x562cae172760 2024-09-19T09:00:56.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.208+0000 7f705d7fa640 1 -- 172.21.15.92:0/2136929736 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706c04b5a0 con 0x562cae172760 2024-09-19T09:00:56.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.209+0000 7f708060c740 1 -- 172.21.15.92:0/2136929736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562cae172760 msgr2=0x562cae194e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:56.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.209+0000 7f708060c740 1 --2- 172.21.15.92:0/2136929736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562cae172760 0x562cae194e80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f706c02a910 tx=0x7f706c040000 comp rx=0 tx=0).stop 2024-09-19T09:00:56.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.209+0000 7f708060c740 1 -- 172.21.15.92:0/2136929736 shutdown_connections 2024-09-19T09:00:56.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.209+0000 7f708060c740 1 --2- 172.21.15.92:0/2136929736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562cae17d940 0x562cae177ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.209+0000 7f708060c740 1 --2- 172.21.15.92:0/2136929736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562cae173080 0x562cae1953c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.209+0000 7f708060c740 1 --2- 172.21.15.92:0/2136929736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562cae172760 0x562cae194e80 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.209+0000 7f708060c740 1 -- 172.21.15.92:0/2136929736 >> 172.21.15.92:0/2136929736 conn(0x562cae16ecf0 msgr2=0x562cae17c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:56.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.209+0000 7f708060c740 1 -- 172.21.15.92:0/2136929736 shutdown_connections 2024-09-19T09:00:56.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.209+0000 7f708060c740 1 -- 172.21.15.92:0/2136929736 wait complete. 2024-09-19T09:00:56.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.209+0000 7f708060c740 1 -- start start 2024-09-19T09:00:56.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.210+0000 7f708060c740 1 Processor -- start 2024-09-19T09:00:56.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.210+0000 7f708060c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562cae172760 0x562cae185ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:56.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.210+0000 7f708060c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562cae173080 0x562cae186000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:56.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.210+0000 7f708060c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562cae17d940 0x562cae1828b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:56.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.210+0000 7f708060c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f70781b29b0 con 0x562cae173080 2024-09-19T09:00:56.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.210+0000 7f708060c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f70781b3e20 con 0x562cae17d940 2024-09-19T09:00:56.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.210+0000 7f708060c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f70781b3080 con 0x562cae172760 2024-09-19T09:00:56.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.210+0000 7f708060c740 10 client.0 _ll_register_callbacks cb 0x7f706809bdf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:56.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.210+0000 7f7077fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562cae17d940 0x562cae1828b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:56.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.210+0000 7f7077fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562cae17d940 0x562cae1828b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:59350/0 (socket says 172.21.15.92:59350) 2024-09-19T09:00:56.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.210+0000 7f7077fff640 1 -- 172.21.15.92:0/2983262899 learned_addr learned my addr 172.21.15.92:0/2983262899 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:00:56.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.211+0000 7f7076ffd640 1 --2- 172.21.15.92:0/2983262899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562cae173080 0x562cae186000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:56.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.211+0000 7f70777fe640 1 --2- 172.21.15.92:0/2983262899 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562cae172760 0x562cae185ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:56.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.211+0000 7f7077fff640 1 -- 172.21.15.92:0/2983262899 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562cae172760 msgr2=0x562cae185ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:56.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.211+0000 7f7077fff640 1 --2- 172.21.15.92:0/2983262899 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562cae172760 0x562cae185ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.211+0000 7f7077fff640 1 -- 172.21.15.92:0/2983262899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562cae173080 msgr2=0x562cae186000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:56.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.211+0000 7f7077fff640 1 --2- 172.21.15.92:0/2983262899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562cae173080 0x562cae186000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.211+0000 7f7077fff640 1 -- 172.21.15.92:0/2983262899 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cae1830e0 con 0x562cae17d940 2024-09-19T09:00:56.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.211+0000 7f7076ffd640 1 --2- 172.21.15.92:0/2983262899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562cae173080 0x562cae186000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:00:56.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.212+0000 7f7077fff640 1 --2- 172.21.15.92:0/2983262899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562cae17d940 0x562cae1828b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7068005350 tx=0x7f7068009f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e66e0e10ed1dd87 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:56.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.212+0000 7f7056ffd640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:00:56.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.212+0000 7f7056ffd640 1 -- 172.21.15.92:0/2983262899 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70680a6070 con 0x562cae17d940 2024-09-19T09:00:56.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.212+0000 7f7056ffd640 1 -- 172.21.15.92:0/2983262899 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f70680bc0a0 con 0x562cae17d940 2024-09-19T09:00:56.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.212+0000 7f708060c740 1 -- 172.21.15.92:0/2983262899 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f706c031cb0 con 0x562cae17d940 2024-09-19T09:00:56.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.212+0000 7f7056ffd640 1 -- 172.21.15.92:0/2983262899 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f70680a4f20 con 0x562cae17d940 2024-09-19T09:00:56.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.212+0000 7f708060c740 10 client.25808 fetch_fsmap learned FSMap version 19 2024-09-19T09:00:56.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.212+0000 7f708060c740 1 -- 172.21.15.92:0/2983262899 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x562cae1f88d0 con 0x562cae17d940 2024-09-19T09:00:56.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.213+0000 7f7056ffd640 1 -- 172.21.15.92:0/2983262899 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70680ba070 con 0x562cae17d940 2024-09-19T09:00:56.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.213+0000 7f7056ffd640 1 -- 172.21.15.92:0/2983262899 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f706809b800 con 0x562cae17d940 2024-09-19T09:00:56.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.213+0000 7f708060c740 10 client.25808 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:00:56.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.213+0000 7f708060c740 10 client.25808 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:00:56.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.213+0000 7f708060c740 20 client.25808 populate_metadata read hostname 'smithi092' 2024-09-19T09:00:56.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.213+0000 7f708060c740 1 --2- 172.21.15.92:0/2983262899 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562cae1f8e70 0x562cae1fb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:56.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.213+0000 7f708060c740 4 client.25808 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}] 2024-09-19T09:00:56.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.213+0000 7f708060c740 1 -- 172.21.15.92:0/2983262899 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}) -- 0x7f706c031cb0 con 0x562cae1f8e70 2024-09-19T09:00:56.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.215+0000 7f70777fe640 1 --2- 172.21.15.92:0/2983262899 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562cae1f8e70 0x562cae1fb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:56.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.215+0000 7f70777fe640 1 --2- 172.21.15.92:0/2983262899 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562cae1f8e70 0x562cae1fb260 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67af4ef7ae172ca4 server_cookie=e469ee56bb98e4ef in_seq=0 out_seq=0 2024-09-19T09:00:56.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.215+0000 7f7056ffd640 10 client.25808 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:56.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.473+0000 7f7056ffd640 1 -- 172.21.15.92:0/2983262899 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7f706c031cb0 con 0x562cae1f8e70 2024-09-19T09:00:56.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.473+0000 7f7056ffd640 10 client.25808 handle_command_reply: tid=0 2024-09-19T09:00:56.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.473+0000 7f708060c740 1 client.25808 shutdown 2024-09-19T09:00:56.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.473+0000 7f708060c740 1 -- 172.21.15.92:0/2983262899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562cae17d940 msgr2=0x562cae1828b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:56.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.473+0000 7f708060c740 1 --2- 172.21.15.92:0/2983262899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562cae17d940 0x562cae1828b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7068005350 tx=0x7f7068009f50 comp rx=0 tx=0).stop 2024-09-19T09:00:56.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.473+0000 7f708060c740 1 -- 172.21.15.92:0/2983262899 shutdown_connections 2024-09-19T09:00:56.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.473+0000 7f708060c740 1 --2- 172.21.15.92:0/2983262899 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562cae1f8e70 0x562cae1fb260 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.473+0000 7f708060c740 1 --2- 172.21.15.92:0/2983262899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562cae17d940 0x562cae1828b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.473+0000 7f7056ffd640 0 client.25808 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:00:56.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.473+0000 7f708060c740 1 --2- 172.21.15.92:0/2983262899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562cae173080 0x562cae186000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.473+0000 7f708060c740 1 --2- 172.21.15.92:0/2983262899 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562cae172760 0x562cae185ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.473+0000 7f708060c740 1 -- 172.21.15.92:0/2983262899 >> 172.21.15.92:0/2983262899 conn(0x562cae16ecf0 msgr2=0x562cae17c090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:56.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.473+0000 7f708060c740 1 -- 172.21.15.92:0/2983262899 shutdown_connections 2024-09-19T09:00:56.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.473+0000 7f708060c740 1 -- 172.21.15.92:0/2983262899 wait complete. 2024-09-19T09:00:56.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.473+0000 7f708060c740 20 client.25808 trim_cache size 0 max 16384 2024-09-19T09:00:56.475 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:00:56.475 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 19, 2024-09-19T09:00:56.475 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24472, 2024-09-19T09:00:56.475 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 22, 2024-09-19T09:00:56.476 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-09-19T09:00:56.476 INFO:teuthology.orchestra.run.smithi092.stdout: "73785ebf": { 2024-09-19T09:00:56.476 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 22, 2024-09-19T09:00:56.476 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-09-19T09:00:56.476 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:00:56.476 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-09-19T09:00:56.476 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:00:56.476 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:00:56.476 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 90.0, 2024-09-19T09:00:56.476 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 149.8, 2024-09-19T09:00:56.476 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-09-19T09:00:56.476 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-09-19T09:00:56.476 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-09-19T09:00:56.477 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:00:56.477 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-09-19T09:00:56.477 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:00:56.477 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:00:56.477 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:00:56.477 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:00:56.477 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:00:56.477 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:00:56.477 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:00:56.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.473+0000 7f707e233640 1 -- 172.21.15.92:0/3279673482 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f70600a3240 msgr2=0x7f70600a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:56.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.473+0000 7f707e233640 1 --2- 172.21.15.92:0/3279673482 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f70600a3240 0x7f70600a5700 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f706c006010 tx=0x7f706c009560 comp rx=0 tx=0).stop 2024-09-19T09:00:56.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.473+0000 7f707e233640 1 -- 172.21.15.92:0/3279673482 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f707810d530 msgr2=0x7f70781a3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:56.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.473+0000 7f707e233640 1 --2- 172.21.15.92:0/3279673482 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f707810d530 0x7f70781a3420 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f706800e970 tx=0x7f706800ee30 comp rx=0 tx=0).stop 2024-09-19T09:00:56.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.473+0000 7f707e233640 1 -- 172.21.15.92:0/3279673482 shutdown_connections 2024-09-19T09:00:56.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.473+0000 7f707e233640 1 --2- 172.21.15.92:0/3279673482 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f707810d530 0x7f70781a3420 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.473+0000 7f707e233640 1 --2- 172.21.15.92:0/3279673482 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f70600a3240 0x7f70600a5700 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.473+0000 7f707e233640 1 --2- 172.21.15.92:0/3279673482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7078108e00 0x7f707819f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.473+0000 7f707e233640 1 --2- 172.21.15.92:0/3279673482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7078108450 0x7f707819eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.474+0000 7f707e233640 1 -- 172.21.15.92:0/3279673482 >> 172.21.15.92:0/3279673482 conn(0x7f7078077ba0 msgr2=0x7f7078078e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:56.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.474+0000 7f707e233640 1 -- 172.21.15.92:0/3279673482 shutdown_connections 2024-09-19T09:00:56.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:00:56.474+0000 7f707e233640 1 -- 172.21.15.92:0/3279673482 wait complete. 2024-09-19T09:00:56.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:56 smithi092 ceph-mon[31407]: pgmap v464: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 3.5 MiB/s wr, 290 op/s 2024-09-19T09:00:56.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:56 smithi167 ceph-mon[35359]: pgmap v464: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 3.5 MiB/s wr, 290 op/s 2024-09-19T09:00:56.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:56 smithi190 ceph-mon[35358]: pgmap v464: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 3.5 MiB/s wr, 290 op/s 2024-09-19T09:00:57.320 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '73785ebf', quiesce took 4.3 seconds. Will release after: 25.5 2024-09-19T09:00:59.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:00:59 smithi092 ceph-mon[31407]: pgmap v465: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 4.9 MiB/s wr, 378 op/s 2024-09-19T09:00:59.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:00:59 smithi167 ceph-mon[35359]: pgmap v465: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 4.9 MiB/s wr, 378 op/s 2024-09-19T09:00:59.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:00:59 smithi190 ceph-mon[35358]: pgmap v465: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 4.9 MiB/s wr, 378 op/s 2024-09-19T09:01:00.796 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 255.0 s, 488.0 tps, lat 21.995 ms stddev 23.626 2024-09-19T09:01:01.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:01 smithi092 ceph-mon[31407]: pgmap v466: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 6.0 MiB/s wr, 447 op/s 2024-09-19T09:01:01.790 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:01 smithi167 ceph-mon[35359]: pgmap v466: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 6.0 MiB/s wr, 447 op/s 2024-09-19T09:01:01.847 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:01 smithi190 ceph-mon[35358]: pgmap v466: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 6.0 MiB/s wr, 447 op/s 2024-09-19T09:01:03.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:03 smithi092 ceph-mon[31407]: pgmap v467: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 5.6 MiB/s wr, 396 op/s 2024-09-19T09:01:03.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:03 smithi167 ceph-mon[35359]: pgmap v467: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 5.6 MiB/s wr, 396 op/s 2024-09-19T09:01:03.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:03 smithi190 ceph-mon[35358]: pgmap v467: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 5.6 MiB/s wr, 396 op/s 2024-09-19T09:01:05.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:05 smithi092 ceph-mon[31407]: pgmap v468: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 5.4 MiB/s wr, 377 op/s 2024-09-19T09:01:05.799 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:01:05.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:05 smithi167 ceph-mon[35359]: pgmap v468: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 5.4 MiB/s wr, 377 op/s 2024-09-19T09:01:05.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:05 smithi190 ceph-mon[35358]: pgmap v468: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 5.4 MiB/s wr, 377 op/s 2024-09-19T09:01:07.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:07 smithi092 ceph-mon[31407]: pgmap v469: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 3.6 MiB/s wr, 289 op/s 2024-09-19T09:01:07.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:07 smithi167 ceph-mon[35359]: pgmap v469: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 3.6 MiB/s wr, 289 op/s 2024-09-19T09:01:07.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:07 smithi190 ceph-mon[35358]: pgmap v469: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 3.6 MiB/s wr, 289 op/s 2024-09-19T09:01:08.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.751+0000 7fe690d03640 1 -- 172.21.15.92:0/2951602551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe68c102d50 msgr2=0x7fe68c1031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:08.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.751+0000 7fe690d03640 1 --2- 172.21.15.92:0/2951602551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe68c102d50 0x7fe68c1031d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fe67c009900 tx=0x7fe67c02a410 comp rx=0 tx=0).stop 2024-09-19T09:01:08.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.752+0000 7fe690d03640 1 -- 172.21.15.92:0/2951602551 shutdown_connections 2024-09-19T09:01:08.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.752+0000 7fe690d03640 1 --2- 172.21.15.92:0/2951602551 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe68c103710 0x7fe68c109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.752+0000 7fe690d03640 1 --2- 172.21.15.92:0/2951602551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe68c102d50 0x7fe68c1031d0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.752+0000 7fe690d03640 1 --2- 172.21.15.92:0/2951602551 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe68c101b60 0x7fe68c101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.752+0000 7fe690d03640 1 -- 172.21.15.92:0/2951602551 >> 172.21.15.92:0/2951602551 conn(0x7fe68c0fd2e0 msgr2=0x7fe68c0ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:08.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.752+0000 7fe690d03640 1 -- 172.21.15.92:0/2951602551 shutdown_connections 2024-09-19T09:01:08.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.752+0000 7fe690d03640 1 -- 172.21.15.92:0/2951602551 wait complete. 2024-09-19T09:01:08.754 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.753+0000 7fe690d03640 1 Processor -- start 2024-09-19T09:01:08.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.753+0000 7fe690d03640 1 -- start start 2024-09-19T09:01:08.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.753+0000 7fe690d03640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe68c101b60 0x7fe68c197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:08.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.753+0000 7fe690d03640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe68c102d50 0x7fe68c198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:08.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.753+0000 7fe690d03640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe68c103710 0x7fe68c19f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:08.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.753+0000 7fe690d03640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe68c10d7e0 con 0x7fe68c101b60 2024-09-19T09:01:08.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.753+0000 7fe690d03640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe68c10d660 con 0x7fe68c103710 2024-09-19T09:01:08.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.753+0000 7fe690d03640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe68c10d960 con 0x7fe68c102d50 2024-09-19T09:01:08.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.753+0000 7fe68a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe68c101b60 0x7fe68c197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:08.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.753+0000 7fe68a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe68c101b60 0x7fe68c197e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52618/0 (socket says 172.21.15.92:52618) 2024-09-19T09:01:08.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.753+0000 7fe68a59c640 1 -- 172.21.15.92:0/2637922634 learned_addr learned my addr 172.21.15.92:0/2637922634 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:08.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.753+0000 7fe68ad9d640 1 --2- 172.21.15.92:0/2637922634 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe68c103710 0x7fe68c19f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:08.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.753+0000 7fe689d9b640 1 --2- 172.21.15.92:0/2637922634 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe68c102d50 0x7fe68c198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:08.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.753+0000 7fe68a59c640 1 -- 172.21.15.92:0/2637922634 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe68c102d50 msgr2=0x7fe68c198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:08.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.753+0000 7fe68a59c640 1 --2- 172.21.15.92:0/2637922634 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe68c102d50 0x7fe68c198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.753+0000 7fe68a59c640 1 -- 172.21.15.92:0/2637922634 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe68c103710 msgr2=0x7fe68c19f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:08.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.753+0000 7fe68a59c640 1 --2- 172.21.15.92:0/2637922634 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe68c103710 0x7fe68c19f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.753+0000 7fe68a59c640 1 -- 172.21.15.92:0/2637922634 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe68c19fa20 con 0x7fe68c101b60 2024-09-19T09:01:08.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.753+0000 7fe68a59c640 1 --2- 172.21.15.92:0/2637922634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe68c101b60 0x7fe68c197e00 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fe68000d950 tx=0x7fe68000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:08.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.754+0000 7fe67b7fe640 1 -- 172.21.15.92:0/2637922634 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe680017070 con 0x7fe68c101b60 2024-09-19T09:01:08.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.754+0000 7fe690d03640 1 -- 172.21.15.92:0/2637922634 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe68c19fd10 con 0x7fe68c101b60 2024-09-19T09:01:08.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.754+0000 7fe67b7fe640 1 -- 172.21.15.92:0/2637922634 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe680009c30 con 0x7fe68c101b60 2024-09-19T09:01:08.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.754+0000 7fe67b7fe640 1 -- 172.21.15.92:0/2637922634 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe68000f600 con 0x7fe68c101b60 2024-09-19T09:01:08.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.754+0000 7fe690d03640 1 -- 172.21.15.92:0/2637922634 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe68c1a0180 con 0x7fe68c101b60 2024-09-19T09:01:08.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.756+0000 7fe67b7fe640 1 -- 172.21.15.92:0/2637922634 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe68001a070 con 0x7fe68c101b60 2024-09-19T09:01:08.763 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.756+0000 7fe693a98740 1 Processor -- start 2024-09-19T09:01:08.763 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.756+0000 7fe693a98740 1 -- start start 2024-09-19T09:01:08.763 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.757+0000 7fe693a98740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daecdc69a0 0x55daecdc6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:08.763 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.757+0000 7fe693a98740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55daecdc72e0 0x55daecdcbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:08.763 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.757+0000 7fe693a98740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55daecdcc370 0x55daecdce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:08.763 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.757+0000 7fe693a98740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55daecd2a2f0 con 0x55daecdc72e0 2024-09-19T09:01:08.763 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.757+0000 7fe693a98740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55daeccd2270 con 0x55daecdc69a0 2024-09-19T09:01:08.763 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.757+0000 7fe693a98740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55daecd262b0 con 0x55daecdcc370 2024-09-19T09:01:08.763 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.757+0000 7fe68a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55daecdc72e0 0x55daecdcbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:08.763 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.757+0000 7fe689d9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55daecdcc370 0x55daecdce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:08.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.757+0000 7fe68a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55daecdc72e0 0x55daecdcbda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52626/0 (socket says 172.21.15.92:52626) 2024-09-19T09:01:08.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.757+0000 7fe68a59c640 1 -- 172.21.15.92:0/667220518 learned_addr learned my addr 172.21.15.92:0/667220518 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:08.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.757+0000 7fe67b7fe640 1 --2- 172.21.15.92:0/2637922634 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe6740a32f0 0x7fe6740a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:08.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.757+0000 7fe68ad9d640 1 --2- 172.21.15.92:0/667220518 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daecdc69a0 0x55daecdc6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:08.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.757+0000 7fe68ad9d640 1 --2- 172.21.15.92:0/2637922634 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe6740a32f0 0x7fe6740a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:08.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.757+0000 7fe689d9b640 1 -- 172.21.15.92:0/667220518 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daecdc69a0 msgr2=0x55daecdc6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:08.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.757+0000 7fe689d9b640 1 --2- 172.21.15.92:0/667220518 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daecdc69a0 0x55daecdc6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.757+0000 7fe689d9b640 1 -- 172.21.15.92:0/667220518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55daecdc72e0 msgr2=0x55daecdcbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:08.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.757+0000 7fe689d9b640 1 --2- 172.21.15.92:0/667220518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55daecdc72e0 0x55daecdcbda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.757+0000 7fe689d9b640 1 -- 172.21.15.92:0/667220518 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55daeccd1340 con 0x55daecdcc370 2024-09-19T09:01:08.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.757+0000 7fe68a59c640 1 --2- 172.21.15.92:0/667220518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55daecdc72e0 0x55daecdcbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:01:08.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.757+0000 7fe67b7fe640 1 -- 172.21.15.92:0/2637922634 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe6800cf3b0 con 0x7fe68c101b60 2024-09-19T09:01:08.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.757+0000 7fe689d9b640 1 --2- 172.21.15.92:0/667220518 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55daecdcc370 0x55daecdce830 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe67c031440 tx=0x7fe67c005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34e57389b473bd73 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:08.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.758+0000 7fe68ad9d640 1 --2- 172.21.15.92:0/2637922634 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe6740a32f0 0x7fe6740a57b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe684005fd0 tx=0x7fe684009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:08.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.758+0000 7fe678ff9640 1 -- 172.21.15.92:0/667220518 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67c040070 con 0x55daecdcc370 2024-09-19T09:01:08.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.758+0000 7fe678ff9640 1 -- 172.21.15.92:0/667220518 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe67c0318b0 con 0x55daecdcc370 2024-09-19T09:01:08.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.758+0000 7fe678ff9640 1 -- 172.21.15.92:0/667220518 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67c035040 con 0x55daecdcc370 2024-09-19T09:01:08.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.758+0000 7fe693a98740 1 -- 172.21.15.92:0/667220518 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55daecdcc370 msgr2=0x55daecdce830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:08.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.758+0000 7fe693a98740 1 --2- 172.21.15.92:0/667220518 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55daecdcc370 0x55daecdce830 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe67c031440 tx=0x7fe67c005c00 comp rx=0 tx=0).stop 2024-09-19T09:01:08.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.758+0000 7fe693a98740 1 -- 172.21.15.92:0/667220518 shutdown_connections 2024-09-19T09:01:08.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.758+0000 7fe693a98740 1 --2- 172.21.15.92:0/667220518 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55daecdcc370 0x55daecdce830 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.758+0000 7fe693a98740 1 --2- 172.21.15.92:0/667220518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55daecdc72e0 0x55daecdcbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.758+0000 7fe693a98740 1 --2- 172.21.15.92:0/667220518 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daecdc69a0 0x55daecdc6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.758+0000 7fe693a98740 1 -- 172.21.15.92:0/667220518 >> 172.21.15.92:0/667220518 conn(0x55daecdc2010 msgr2=0x55daecdc2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:08.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.758+0000 7fe693a98740 1 -- 172.21.15.92:0/667220518 shutdown_connections 2024-09-19T09:01:08.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.758+0000 7fe693a98740 1 -- 172.21.15.92:0/667220518 wait complete. 2024-09-19T09:01:08.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.759+0000 7fe693a98740 1 -- start start 2024-09-19T09:01:08.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.759+0000 7fe693a98740 1 Processor -- start 2024-09-19T09:01:08.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.759+0000 7fe693a98740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daecdc69a0 0x55daecdd0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:08.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.759+0000 7fe693a98740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55daecdc72e0 0x55daecdd10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:08.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.759+0000 7fe693a98740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55daecdcc370 0x55daecdd8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:08.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.759+0000 7fe693a98740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55daecdcf2e0 con 0x55daecdcc370 2024-09-19T09:01:08.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.759+0000 7fe693a98740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55daeccb3290 con 0x55daecdc69a0 2024-09-19T09:01:08.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.759+0000 7fe693a98740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55daecdcf460 con 0x55daecdc72e0 2024-09-19T09:01:08.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.759+0000 7fe693a98740 10 client.0 _ll_register_callbacks cb 0x55daecce4140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:08.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.759+0000 7fe68ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55daecdcc370 0x55daecdd8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:08.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.759+0000 7fe68ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55daecdcc370 0x55daecdd8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52632/0 (socket says 172.21.15.92:52632) 2024-09-19T09:01:08.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.759+0000 7fe68ad9d640 1 -- 172.21.15.92:0/2553980214 learned_addr learned my addr 172.21.15.92:0/2553980214 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:08.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.759+0000 7fe689d9b640 1 --2- 172.21.15.92:0/2553980214 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55daecdc72e0 0x55daecdd10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:08.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.759+0000 7fe68a59c640 1 --2- 172.21.15.92:0/2553980214 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daecdc69a0 0x55daecdd0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:08.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.759+0000 7fe68ad9d640 1 -- 172.21.15.92:0/2553980214 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55daecdc72e0 msgr2=0x55daecdd10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:08.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.759+0000 7fe68ad9d640 1 --2- 172.21.15.92:0/2553980214 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55daecdc72e0 0x55daecdd10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.759+0000 7fe68ad9d640 1 -- 172.21.15.92:0/2553980214 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daecdc69a0 msgr2=0x55daecdd0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:08.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.759+0000 7fe68ad9d640 1 --2- 172.21.15.92:0/2553980214 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daecdc69a0 0x55daecdd0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.759+0000 7fe68ad9d640 1 -- 172.21.15.92:0/2553980214 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55daeca3d210 con 0x55daecdcc370 2024-09-19T09:01:08.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.760+0000 7fe689d9b640 1 --2- 172.21.15.92:0/2553980214 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55daecdc72e0 0x55daecdd10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:08.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.760+0000 7fe68ad9d640 1 --2- 172.21.15.92:0/2553980214 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55daecdcc370 0x55daecdd8120 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fe684010a10 tx=0x7fe684004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be32573a3d32f6b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:08.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.760+0000 7fe671ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:01:08.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.760+0000 7fe671ffb640 1 -- 172.21.15.92:0/2553980214 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe684025070 con 0x55daecdcc370 2024-09-19T09:01:08.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.760+0000 7fe693a98740 1 -- 172.21.15.92:0/2553980214 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe67c0318b0 con 0x55daecdcc370 2024-09-19T09:01:08.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.760+0000 7fe671ffb640 1 -- 172.21.15.92:0/2553980214 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe684004d20 con 0x55daecdcc370 2024-09-19T09:01:08.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.760+0000 7fe671ffb640 1 -- 172.21.15.92:0/2553980214 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe684030050 con 0x55daecdcc370 2024-09-19T09:01:08.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.760+0000 7fe693a98740 10 client.16401 fetch_fsmap learned FSMap version 19 2024-09-19T09:01:08.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.760+0000 7fe693a98740 1 -- 172.21.15.92:0/2553980214 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55daecb09620 con 0x55daecdcc370 2024-09-19T09:01:08.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.760+0000 7fe671ffb640 1 -- 172.21.15.92:0/2553980214 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe67c0318b0 con 0x55daecdcc370 2024-09-19T09:01:08.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.760+0000 7fe671ffb640 1 -- 172.21.15.92:0/2553980214 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe68400f040 con 0x55daecdcc370 2024-09-19T09:01:08.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.760+0000 7fe693a98740 10 client.16401 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:01:08.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.760+0000 7fe693a98740 10 client.16401 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:01:08.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.760+0000 7fe693a98740 20 client.16401 populate_metadata read hostname 'smithi092' 2024-09-19T09:01:08.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.760+0000 7fe693a98740 1 --2- 172.21.15.92:0/2553980214 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55daecddc8e0 0x55daecddecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:08.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.760+0000 7fe693a98740 4 client.16401 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:01:08.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.760+0000 7fe693a98740 1 -- 172.21.15.92:0/2553980214 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55daecd37a20 con 0x55daecddc8e0 2024-09-19T09:01:08.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.761+0000 7fe68a59c640 1 --2- 172.21.15.92:0/2553980214 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55daecddc8e0 0x55daecddecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:08.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.761+0000 7fe68a59c640 1 --2- 172.21.15.92:0/2553980214 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55daecddc8e0 0x55daecddecd0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bab44617b7fd57a4 server_cookie=da4c12a00788b2a8 in_seq=0 out_seq=0 2024-09-19T09:01:08.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.761+0000 7fe671ffb640 10 client.16401 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:08.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.762+0000 7fe671ffb640 1 -- 172.21.15.92:0/2553980214 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55daecd37a20 con 0x55daecddc8e0 2024-09-19T09:01:08.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.762+0000 7fe671ffb640 10 client.16401 handle_command_reply: tid=0 2024-09-19T09:01:08.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.762+0000 7fe693a98740 1 client.16401 shutdown 2024-09-19T09:01:08.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.762+0000 7fe693a98740 1 -- 172.21.15.92:0/2553980214 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55daecdcc370 msgr2=0x55daecdd8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:08.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.762+0000 7fe693a98740 1 --2- 172.21.15.92:0/2553980214 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55daecdcc370 0x55daecdd8120 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fe684010a10 tx=0x7fe684004a40 comp rx=0 tx=0).stop 2024-09-19T09:01:08.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.762+0000 7fe693a98740 1 -- 172.21.15.92:0/2553980214 shutdown_connections 2024-09-19T09:01:08.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.762+0000 7fe693a98740 1 --2- 172.21.15.92:0/2553980214 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55daecddc8e0 0x55daecddecd0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.762+0000 7fe693a98740 1 --2- 172.21.15.92:0/2553980214 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55daecdcc370 0x55daecdd8120 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.762+0000 7fe693a98740 1 --2- 172.21.15.92:0/2553980214 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55daecdc72e0 0x55daecdd10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.762+0000 7fe671ffb640 0 client.16401 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:08.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.762+0000 7fe693a98740 1 --2- 172.21.15.92:0/2553980214 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daecdc69a0 0x55daecdd0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.762+0000 7fe693a98740 1 -- 172.21.15.92:0/2553980214 >> 172.21.15.92:0/2553980214 conn(0x55daecdc2010 msgr2=0x55daecdc3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:08.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.762+0000 7fe693a98740 1 -- 172.21.15.92:0/2553980214 shutdown_connections 2024-09-19T09:01:08.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.762+0000 7fe693a98740 1 -- 172.21.15.92:0/2553980214 wait complete. 2024-09-19T09:01:08.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.762+0000 7fe693a98740 20 client.16401 trim_cache size 0 max 16384 2024-09-19T09:01:08.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.776+0000 7fe693a98740 1 Processor -- start 2024-09-19T09:01:08.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.776+0000 7fe693a98740 1 -- start start 2024-09-19T09:01:08.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.776+0000 7fe693a98740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daecdc69a0 0x55daecdc6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:08.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.776+0000 7fe693a98740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55daecdc72e0 0x55daecdd80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:08.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.776+0000 7fe693a98740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55daecdcc370 0x55daecdc10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:08.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.776+0000 7fe693a98740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe68c1a6f30 con 0x55daecdc72e0 2024-09-19T09:01:08.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.776+0000 7fe693a98740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe68c1a97d0 con 0x55daecdc69a0 2024-09-19T09:01:08.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.776+0000 7fe693a98740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe68c1a75c0 con 0x55daecdcc370 2024-09-19T09:01:08.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.776+0000 7fe689d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55daecdc72e0 0x55daecdd80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:08.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.776+0000 7fe689d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55daecdc72e0 0x55daecdd80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52638/0 (socket says 172.21.15.92:52638) 2024-09-19T09:01:08.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.776+0000 7fe689d9b640 1 -- 172.21.15.92:0/3559902621 learned_addr learned my addr 172.21.15.92:0/3559902621 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:08.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.776+0000 7fe68a59c640 1 --2- 172.21.15.92:0/3559902621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daecdc69a0 0x55daecdc6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:08.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.776+0000 7fe68ad9d640 1 --2- 172.21.15.92:0/3559902621 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55daecdcc370 0x55daecdc10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:08.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.777+0000 7fe689d9b640 1 -- 172.21.15.92:0/3559902621 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55daecdcc370 msgr2=0x55daecdc10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:08.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.777+0000 7fe689d9b640 1 --2- 172.21.15.92:0/3559902621 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55daecdcc370 0x55daecdc10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.777+0000 7fe689d9b640 1 -- 172.21.15.92:0/3559902621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daecdc69a0 msgr2=0x55daecdc6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:08.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.777+0000 7fe689d9b640 1 --2- 172.21.15.92:0/3559902621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daecdc69a0 0x55daecdc6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.777+0000 7fe689d9b640 1 -- 172.21.15.92:0/3559902621 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55daecdc1e30 con 0x55daecdc72e0 2024-09-19T09:01:08.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.777+0000 7fe689d9b640 1 --2- 172.21.15.92:0/3559902621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55daecdc72e0 0x55daecdd80e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe67c031440 tx=0x7fe67c02ab50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42124f3ff7d9f2df server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:08.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.777+0000 7fe673fff640 1 -- 172.21.15.92:0/3559902621 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67c035040 con 0x55daecdc72e0 2024-09-19T09:01:08.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.777+0000 7fe673fff640 1 -- 172.21.15.92:0/3559902621 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe67c005040 con 0x55daecdc72e0 2024-09-19T09:01:08.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.777+0000 7fe673fff640 1 -- 172.21.15.92:0/3559902621 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67c040040 con 0x55daecdc72e0 2024-09-19T09:01:08.782 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.778+0000 7fe693a98740 1 -- 172.21.15.92:0/3559902621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55daecdc72e0 msgr2=0x55daecdd80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:08.782 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.778+0000 7fe693a98740 1 --2- 172.21.15.92:0/3559902621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55daecdc72e0 0x55daecdd80e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe67c031440 tx=0x7fe67c02ab50 comp rx=0 tx=0).stop 2024-09-19T09:01:08.782 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.778+0000 7fe693a98740 1 -- 172.21.15.92:0/3559902621 shutdown_connections 2024-09-19T09:01:08.782 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.778+0000 7fe693a98740 1 --2- 172.21.15.92:0/3559902621 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55daecdcc370 0x55daecdc10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.782 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.778+0000 7fe693a98740 1 --2- 172.21.15.92:0/3559902621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55daecdc72e0 0x55daecdd80e0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.782 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.778+0000 7fe693a98740 1 --2- 172.21.15.92:0/3559902621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daecdc69a0 0x55daecdc6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.782 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.778+0000 7fe693a98740 1 -- 172.21.15.92:0/3559902621 >> 172.21.15.92:0/3559902621 conn(0x55daecdc2010 msgr2=0x55daecdc09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:08.782 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.778+0000 7fe693a98740 1 -- 172.21.15.92:0/3559902621 shutdown_connections 2024-09-19T09:01:08.782 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.778+0000 7fe693a98740 1 -- 172.21.15.92:0/3559902621 wait complete. 2024-09-19T09:01:08.782 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.778+0000 7fe693a98740 1 -- start start 2024-09-19T09:01:08.782 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.778+0000 7fe693a98740 1 Processor -- start 2024-09-19T09:01:08.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.778+0000 7fe693a98740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55daecdc69a0 0x55daecdd58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:08.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.778+0000 7fe693a98740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daecdc72e0 0x55daecdd5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:08.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.778+0000 7fe693a98740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55daecdcc370 0x55daecdd6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:08.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.778+0000 7fe693a98740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe68c1a7c90 con 0x55daecdc69a0 2024-09-19T09:01:08.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.778+0000 7fe693a98740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe68c1a9100 con 0x55daecdc72e0 2024-09-19T09:01:08.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.778+0000 7fe693a98740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe68c1a8360 con 0x55daecdcc370 2024-09-19T09:01:08.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.778+0000 7fe693a98740 10 client.0 _ll_register_callbacks cb 0x7fe6840106c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:08.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.778+0000 7fe68a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55daecdc69a0 0x55daecdd58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:08.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.778+0000 7fe68a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55daecdc69a0 0x55daecdd58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52642/0 (socket says 172.21.15.92:52642) 2024-09-19T09:01:08.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.778+0000 7fe68a59c640 1 -- 172.21.15.92:0/1839071480 learned_addr learned my addr 172.21.15.92:0/1839071480 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:08.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.778+0000 7fe689d9b640 1 --2- 172.21.15.92:0/1839071480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daecdc72e0 0x55daecdd5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:08.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.779+0000 7fe68a59c640 1 -- 172.21.15.92:0/1839071480 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55daecdcc370 msgr2=0x55daecdd6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:08.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.779+0000 7fe68a59c640 1 --2- 172.21.15.92:0/1839071480 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55daecdcc370 0x55daecdd6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.779+0000 7fe68a59c640 1 -- 172.21.15.92:0/1839071480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daecdc72e0 msgr2=0x55daecdd5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:08.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.779+0000 7fe68a59c640 1 --2- 172.21.15.92:0/1839071480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daecdc72e0 0x55daecdd5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.779+0000 7fe68a59c640 1 -- 172.21.15.92:0/1839071480 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55daecdd7400 con 0x55daecdc69a0 2024-09-19T09:01:08.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.779+0000 7fe68a59c640 1 --2- 172.21.15.92:0/1839071480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55daecdc69a0 0x55daecdd58a0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x55daecdc7d10 tx=0x7fe680009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e975539585b36b52 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:08.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.779+0000 7fe671ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:01:08.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.779+0000 7fe671ffb640 1 -- 172.21.15.92:0/1839071480 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe680021040 con 0x55daecdc69a0 2024-09-19T09:01:08.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.779+0000 7fe671ffb640 1 -- 172.21.15.92:0/1839071480 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe6800ccf80 con 0x55daecdc69a0 2024-09-19T09:01:08.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.779+0000 7fe693a98740 1 -- 172.21.15.92:0/1839071480 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe67c005040 con 0x55daecdc69a0 2024-09-19T09:01:08.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.779+0000 7fe671ffb640 1 -- 172.21.15.92:0/1839071480 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe6800a4600 con 0x55daecdc69a0 2024-09-19T09:01:08.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.779+0000 7fe693a98740 10 client.16407 fetch_fsmap learned FSMap version 19 2024-09-19T09:01:08.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.779+0000 7fe693a98740 1 -- 172.21.15.92:0/1839071480 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55daece47680 con 0x55daecdc69a0 2024-09-19T09:01:08.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.779+0000 7fe671ffb640 1 -- 172.21.15.92:0/1839071480 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe67c005040 con 0x55daecdc69a0 2024-09-19T09:01:08.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.779+0000 7fe671ffb640 1 -- 172.21.15.92:0/1839071480 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe68009ae90 con 0x55daecdc69a0 2024-09-19T09:01:08.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.779+0000 7fe693a98740 10 client.16407 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:01:08.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.779+0000 7fe693a98740 10 client.16407 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:01:08.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.779+0000 7fe693a98740 20 client.16407 populate_metadata read hostname 'smithi092' 2024-09-19T09:01:08.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.779+0000 7fe693a98740 1 --2- 172.21.15.92:0/1839071480 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55daece48060 0x55daece4a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:08.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.779+0000 7fe693a98740 4 client.16407 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:01:08.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.779+0000 7fe693a98740 1 -- 172.21.15.92:0/1839071480 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55daecd31d70 con 0x55daece48060 2024-09-19T09:01:08.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.780+0000 7fe689d9b640 1 --2- 172.21.15.92:0/1839071480 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55daece48060 0x55daece4a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:08.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.780+0000 7fe671ffb640 10 client.16407 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:08.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.780+0000 7fe689d9b640 1 --2- 172.21.15.92:0/1839071480 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55daece48060 0x55daece4a480 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31d87ca5b05d6ec4 server_cookie=3fe7f7632ca6321d in_seq=0 out_seq=0 2024-09-19T09:01:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.796+0000 7fe671ffb640 1 -- 172.21.15.92:0/1839071480 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55daecd31d70 con 0x55daece48060 2024-09-19T09:01:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.796+0000 7fe671ffb640 10 client.16407 handle_command_reply: tid=0 2024-09-19T09:01:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.796+0000 7fe693a98740 1 client.16407 shutdown 2024-09-19T09:01:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.796+0000 7fe693a98740 1 -- 172.21.15.92:0/1839071480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55daecdc69a0 msgr2=0x55daecdd58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.796+0000 7fe693a98740 1 --2- 172.21.15.92:0/1839071480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55daecdc69a0 0x55daecdd58a0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x55daecdc7d10 tx=0x7fe680009ea0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.796+0000 7fe693a98740 1 -- 172.21.15.92:0/1839071480 shutdown_connections 2024-09-19T09:01:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.796+0000 7fe693a98740 1 --2- 172.21.15.92:0/1839071480 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55daece48060 0x55daece4a480 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.796+0000 7fe693a98740 1 --2- 172.21.15.92:0/1839071480 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55daecdcc370 0x55daecdd6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.796+0000 7fe671ffb640 0 client.16407 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:08.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.796+0000 7fe693a98740 1 --2- 172.21.15.92:0/1839071480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daecdc72e0 0x55daecdd5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.796+0000 7fe693a98740 1 --2- 172.21.15.92:0/1839071480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55daecdc69a0 0x55daecdd58a0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.796+0000 7fe693a98740 1 -- 172.21.15.92:0/1839071480 >> 172.21.15.92:0/1839071480 conn(0x55daecdc2010 msgr2=0x55daecdc34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.796+0000 7fe693a98740 1 -- 172.21.15.92:0/1839071480 shutdown_connections 2024-09-19T09:01:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.796+0000 7fe693a98740 1 -- 172.21.15.92:0/1839071480 wait complete. 2024-09-19T09:01:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.797+0000 7fe693a98740 20 client.16407 trim_cache size 0 max 16384 2024-09-19T09:01:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:01:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:01:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:01:08.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:01:08.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.797+0000 7fe690d03640 1 -- 172.21.15.92:0/2637922634 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe6740a32f0 msgr2=0x7fe6740a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:08.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.797+0000 7fe690d03640 1 --2- 172.21.15.92:0/2637922634 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe6740a32f0 0x7fe6740a57b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe684005fd0 tx=0x7fe684009600 comp rx=0 tx=0).stop 2024-09-19T09:01:08.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.797+0000 7fe690d03640 1 -- 172.21.15.92:0/2637922634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe68c101b60 msgr2=0x7fe68c197e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:08.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.797+0000 7fe690d03640 1 --2- 172.21.15.92:0/2637922634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe68c101b60 0x7fe68c197e00 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fe68000d950 tx=0x7fe68000de10 comp rx=0 tx=0).stop 2024-09-19T09:01:08.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.797+0000 7fe690d03640 1 -- 172.21.15.92:0/2637922634 shutdown_connections 2024-09-19T09:01:08.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.797+0000 7fe690d03640 1 --2- 172.21.15.92:0/2637922634 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe68c103710 0x7fe68c19f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.797+0000 7fe690d03640 1 --2- 172.21.15.92:0/2637922634 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe68c102d50 0x7fe68c198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.797+0000 7fe690d03640 1 --2- 172.21.15.92:0/2637922634 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe6740a32f0 0x7fe6740a57b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.797+0000 7fe690d03640 1 --2- 172.21.15.92:0/2637922634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe68c101b60 0x7fe68c197e00 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.797+0000 7fe690d03640 1 -- 172.21.15.92:0/2637922634 >> 172.21.15.92:0/2637922634 conn(0x7fe68c0fd2e0 msgr2=0x7fe68c1060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:08.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.797+0000 7fe690d03640 1 -- 172.21.15.92:0/2637922634 shutdown_connections 2024-09-19T09:01:08.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:08.797+0000 7fe690d03640 1 -- 172.21.15.92:0/2637922634 wait complete. 2024-09-19T09:01:09.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:09 smithi092 ceph-mon[31407]: pgmap v470: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.3 MiB/s wr, 248 op/s 2024-09-19T09:01:09.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:09 smithi167 ceph-mon[35359]: pgmap v470: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.3 MiB/s wr, 248 op/s 2024-09-19T09:01:09.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:09 smithi190 ceph-mon[35358]: pgmap v470: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.3 MiB/s wr, 248 op/s 2024-09-19T09:01:10.797 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:01:11.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:11 smithi092 ceph-mon[31407]: pgmap v471: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.1 MiB/s wr, 157 op/s 2024-09-19T09:01:11.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:11 smithi167 ceph-mon[35359]: pgmap v471: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.1 MiB/s wr, 157 op/s 2024-09-19T09:01:11.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:11 smithi190 ceph-mon[35358]: pgmap v471: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.1 MiB/s wr, 157 op/s 2024-09-19T09:01:13.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:13 smithi092 ceph-mon[31407]: pgmap v472: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.0 MiB/s wr, 70 op/s 2024-09-19T09:01:13.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:13 smithi167 ceph-mon[35359]: pgmap v472: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.0 MiB/s wr, 70 op/s 2024-09-19T09:01:13.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:13 smithi190 ceph-mon[35358]: pgmap v472: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.0 MiB/s wr, 70 op/s 2024-09-19T09:01:15.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:15 smithi092 ceph-mon[31407]: pgmap v473: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.2 MiB/s wr, 53 op/s 2024-09-19T09:01:15.799 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:01:15.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:15 smithi167 ceph-mon[35359]: pgmap v473: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.2 MiB/s wr, 53 op/s 2024-09-19T09:01:15.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:15 smithi190 ceph-mon[35358]: pgmap v473: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.2 MiB/s wr, 53 op/s 2024-09-19T09:01:17.488 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:01:17.745 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:17.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:17 smithi092 ceph-mon[31407]: pgmap v474: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.0 MiB/s wr, 42 op/s 2024-09-19T09:01:17.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:17 smithi167 ceph-mon[35359]: pgmap v474: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.0 MiB/s wr, 42 op/s 2024-09-19T09:01:17.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:17 smithi190 ceph-mon[35358]: pgmap v474: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.0 MiB/s wr, 42 op/s 2024-09-19T09:01:18.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.189+0000 7f87edd18640 1 -- 172.21.15.92:0/597070773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87e8106a80 msgr2=0x7f87e8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:18.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.189+0000 7f87edd18640 1 --2- 172.21.15.92:0/597070773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87e8106a80 0x7f87e8106e60 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f87d8009930 tx=0x7f87d802a420 comp rx=0 tx=0).stop 2024-09-19T09:01:18.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.189+0000 7f87edd18640 1 -- 172.21.15.92:0/597070773 shutdown_connections 2024-09-19T09:01:18.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.189+0000 7f87edd18640 1 --2- 172.21.15.92:0/597070773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87e8101420 0x7f87e810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.189+0000 7f87edd18640 1 --2- 172.21.15.92:0/597070773 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f87e8100a80 0x7f87e8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.189+0000 7f87edd18640 1 --2- 172.21.15.92:0/597070773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87e8106a80 0x7f87e8106e60 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.189+0000 7f87edd18640 1 -- 172.21.15.92:0/597070773 >> 172.21.15.92:0/597070773 conn(0x7f87e80fc7a0 msgr2=0x7f87e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:18.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.189+0000 7f87edd18640 1 -- 172.21.15.92:0/597070773 shutdown_connections 2024-09-19T09:01:18.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.189+0000 7f87edd18640 1 -- 172.21.15.92:0/597070773 wait complete. 2024-09-19T09:01:18.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.189+0000 7f87edd18640 1 Processor -- start 2024-09-19T09:01:18.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.190+0000 7f87edd18640 1 -- start start 2024-09-19T09:01:18.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.190+0000 7f87edd18640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87e8100a80 0x7f87e8197140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:18.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.190+0000 7f87edd18640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f87e8101420 0x7f87e8197680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:18.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.190+0000 7f87edd18640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87e8106a80 0x7f87e819c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:18.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.190+0000 7f87edd18640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f87e8110ea0 con 0x7f87e8106a80 2024-09-19T09:01:18.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.190+0000 7f87edd18640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f87e8110d20 con 0x7f87e8100a80 2024-09-19T09:01:18.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.190+0000 7f87edd18640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f87e8111020 con 0x7f87e8101420 2024-09-19T09:01:18.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.190+0000 7f87e7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87e8106a80 0x7f87e819c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:18.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.190+0000 7f87e7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87e8106a80 0x7f87e819c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50542/0 (socket says 172.21.15.92:50542) 2024-09-19T09:01:18.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.190+0000 7f87e7fff640 1 -- 172.21.15.92:0/2887902328 learned_addr learned my addr 172.21.15.92:0/2887902328 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:18.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.190+0000 7f87e77fe640 1 --2- 172.21.15.92:0/2887902328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87e8100a80 0x7f87e8197140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:18.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.190+0000 7f87e6ffd640 1 --2- 172.21.15.92:0/2887902328 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f87e8101420 0x7f87e8197680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:18.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.190+0000 7f87e7fff640 1 -- 172.21.15.92:0/2887902328 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f87e8101420 msgr2=0x7f87e8197680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:18.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.190+0000 7f87e7fff640 1 --2- 172.21.15.92:0/2887902328 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f87e8101420 0x7f87e8197680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.190+0000 7f87e7fff640 1 -- 172.21.15.92:0/2887902328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87e8100a80 msgr2=0x7f87e8197140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:18.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.190+0000 7f87e7fff640 1 --2- 172.21.15.92:0/2887902328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87e8100a80 0x7f87e8197140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.190+0000 7f87e7fff640 1 -- 172.21.15.92:0/2887902328 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87e819c6d0 con 0x7f87e8106a80 2024-09-19T09:01:18.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.190+0000 7f87e7fff640 1 --2- 172.21.15.92:0/2887902328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87e8106a80 0x7f87e819c190 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f87e000cad0 tx=0x7f87e000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:18.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.191+0000 7f87e4ff9640 1 -- 172.21.15.92:0/2887902328 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e000ae20 con 0x7f87e8106a80 2024-09-19T09:01:18.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.191+0000 7f87edd18640 1 -- 172.21.15.92:0/2887902328 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87e819c9c0 con 0x7f87e8106a80 2024-09-19T09:01:18.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.191+0000 7f87e4ff9640 1 -- 172.21.15.92:0/2887902328 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87e0005020 con 0x7f87e8106a80 2024-09-19T09:01:18.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.191+0000 7f87e4ff9640 1 -- 172.21.15.92:0/2887902328 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e000f6f0 con 0x7f87e8106a80 2024-09-19T09:01:18.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.191+0000 7f87edd18640 1 -- 172.21.15.92:0/2887902328 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87e819cf00 con 0x7f87e8106a80 2024-09-19T09:01:18.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.193+0000 7f87e4ff9640 1 -- 172.21.15.92:0/2887902328 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f87e00051d0 con 0x7f87e8106a80 2024-09-19T09:01:18.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.193+0000 7f87f00f1740 1 Processor -- start 2024-09-19T09:01:18.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.193+0000 7f87f00f1740 1 -- start start 2024-09-19T09:01:18.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.194+0000 7f87e4ff9640 1 --2- 172.21.15.92:0/2887902328 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f87d00a3240 0x7f87d00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:18.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.194+0000 7f87f00f1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7de05a4a0 0x55a7de05a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:18.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.194+0000 7f87f00f1740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7de05adc0 0x55a7de065140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:18.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.194+0000 7f87f00f1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7de065680 0x55a7de067a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:18.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.194+0000 7f87f00f1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a7ddfc02e0 con 0x55a7de05a4a0 2024-09-19T09:01:18.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.194+0000 7f87f00f1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a7ddf67ce0 con 0x55a7de065680 2024-09-19T09:01:18.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.194+0000 7f87f00f1740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55a7ddfbc2a0 con 0x55a7de05adc0 2024-09-19T09:01:18.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.194+0000 7f87e77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7de05a4a0 0x55a7de05a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:18.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.194+0000 7f87e6ffd640 1 --2- 172.21.15.92:0/2887902328 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f87d00a3240 0x7f87d00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:18.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.194+0000 7f87e77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7de05a4a0 0x55a7de05a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50546/0 (socket says 172.21.15.92:50546) 2024-09-19T09:01:18.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.194+0000 7f87e77fe640 1 -- 172.21.15.92:0/3231578438 learned_addr learned my addr 172.21.15.92:0/3231578438 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:18.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.194+0000 7f87e6ffd640 1 --2- 172.21.15.92:0/3231578438 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7de05adc0 0x55a7de065140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:18.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.194+0000 7f87e4ff9640 1 -- 172.21.15.92:0/2887902328 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f87e00cfa90 con 0x7f87e8106a80 2024-09-19T09:01:18.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.194+0000 7f87e7fff640 1 --2- 172.21.15.92:0/3231578438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7de065680 0x55a7de067a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:18.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.194+0000 7f87e77fe640 1 -- 172.21.15.92:0/3231578438 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7de05adc0 msgr2=0x55a7de065140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:18.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.194+0000 7f87e77fe640 1 --2- 172.21.15.92:0/3231578438 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7de05adc0 0x55a7de065140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.194+0000 7f87e77fe640 1 -- 172.21.15.92:0/3231578438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7de065680 msgr2=0x55a7de067a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:18.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.194+0000 7f87e77fe640 1 --2- 172.21.15.92:0/3231578438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7de065680 0x55a7de067a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.194+0000 7f87e77fe640 1 -- 172.21.15.92:0/3231578438 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7ddf4c440 con 0x55a7de05a4a0 2024-09-19T09:01:18.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.194+0000 7f87e7fff640 1 --2- 172.21.15.92:0/3231578438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7de065680 0x55a7de067a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:01:18.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.194+0000 7f87e77fe640 1 --2- 172.21.15.92:0/3231578438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7de05a4a0 0x55a7de05a880 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f87d8005ab0 tx=0x7f87d8031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=212c7587d6fef4fe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:18.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.194+0000 7f87e6ffd640 1 --2- 172.21.15.92:0/2887902328 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f87d00a3240 0x7f87d00a5700 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f87dc009fd0 tx=0x7f87dc0092c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:18.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.194+0000 7f87cdffb640 1 -- 172.21.15.92:0/3231578438 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d803f070 con 0x55a7de05a4a0 2024-09-19T09:01:18.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.194+0000 7f87cdffb640 1 -- 172.21.15.92:0/3231578438 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87d8031a20 con 0x55a7de05a4a0 2024-09-19T09:01:18.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.194+0000 7f87cdffb640 1 -- 172.21.15.92:0/3231578438 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d8035070 con 0x55a7de05a4a0 2024-09-19T09:01:18.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.195+0000 7f87f00f1740 1 -- 172.21.15.92:0/3231578438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7de05a4a0 msgr2=0x55a7de05a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:18.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.195+0000 7f87f00f1740 1 --2- 172.21.15.92:0/3231578438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7de05a4a0 0x55a7de05a880 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f87d8005ab0 tx=0x7f87d8031630 comp rx=0 tx=0).stop 2024-09-19T09:01:18.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.195+0000 7f87f00f1740 1 -- 172.21.15.92:0/3231578438 shutdown_connections 2024-09-19T09:01:18.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.195+0000 7f87f00f1740 1 --2- 172.21.15.92:0/3231578438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7de065680 0x55a7de067a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.195+0000 7f87f00f1740 1 --2- 172.21.15.92:0/3231578438 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7de05adc0 0x55a7de065140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.195+0000 7f87f00f1740 1 --2- 172.21.15.92:0/3231578438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7de05a4a0 0x55a7de05a880 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.195+0000 7f87f00f1740 1 -- 172.21.15.92:0/3231578438 >> 172.21.15.92:0/3231578438 conn(0x55a7de056a30 msgr2=0x55a7de056e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:18.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.195+0000 7f87f00f1740 1 -- 172.21.15.92:0/3231578438 shutdown_connections 2024-09-19T09:01:18.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.195+0000 7f87f00f1740 1 -- 172.21.15.92:0/3231578438 wait complete. 2024-09-19T09:01:18.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.196+0000 7f87f00f1740 1 -- start start 2024-09-19T09:01:18.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.196+0000 7f87f00f1740 1 Processor -- start 2024-09-19T09:01:18.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.196+0000 7f87f00f1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7de05a4a0 0x55a7de064f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:18.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.196+0000 7f87f00f1740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7de05adc0 0x55a7de062240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:18.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.196+0000 7f87f00f1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7de065680 0x55a7de062780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:18.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.196+0000 7f87f00f1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a7de068250 con 0x55a7de065680 2024-09-19T09:01:18.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.196+0000 7f87f00f1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a7ddf7b050 con 0x55a7de05a4a0 2024-09-19T09:01:18.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.196+0000 7f87f00f1740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55a7de0683d0 con 0x55a7de05adc0 2024-09-19T09:01:18.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.196+0000 7f87f00f1740 10 client.0 _ll_register_callbacks cb 0x55a7ddfbb160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:18.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.196+0000 7f87e7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7de065680 0x55a7de062780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:18.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.196+0000 7f87e7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7de065680 0x55a7de062780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50554/0 (socket says 172.21.15.92:50554) 2024-09-19T09:01:18.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.196+0000 7f87e7fff640 1 -- 172.21.15.92:0/2782475808 learned_addr learned my addr 172.21.15.92:0/2782475808 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:18.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.196+0000 7f87e6ffd640 1 --2- 172.21.15.92:0/2782475808 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7de05adc0 0x55a7de062240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:18.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.196+0000 7f87e77fe640 1 --2- 172.21.15.92:0/2782475808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7de05a4a0 0x55a7de064f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:18.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.196+0000 7f87e7fff640 1 -- 172.21.15.92:0/2782475808 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7de05adc0 msgr2=0x55a7de062240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:18.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.196+0000 7f87e7fff640 1 --2- 172.21.15.92:0/2782475808 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7de05adc0 0x55a7de062240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.196+0000 7f87e7fff640 1 -- 172.21.15.92:0/2782475808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7de05a4a0 msgr2=0x55a7de064f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:18.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.196+0000 7f87e7fff640 1 --2- 172.21.15.92:0/2782475808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7de05a4a0 0x55a7de064f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.196+0000 7f87e7fff640 1 -- 172.21.15.92:0/2782475808 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7ddd313c0 con 0x55a7de065680 2024-09-19T09:01:18.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.197+0000 7f87e7fff640 1 --2- 172.21.15.92:0/2782475808 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7de065680 0x55a7de062780 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f87e00cd550 tx=0x7f87e009bac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b35d3dbc921e4e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:18.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.197+0000 7f87c6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:01:18.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.197+0000 7f87c6ffd640 1 -- 172.21.15.92:0/2782475808 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e001d040 con 0x55a7de065680 2024-09-19T09:01:18.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.197+0000 7f87c6ffd640 1 -- 172.21.15.92:0/2782475808 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f87e0005560 con 0x55a7de065680 2024-09-19T09:01:18.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.197+0000 7f87f00f1740 1 -- 172.21.15.92:0/2782475808 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87d8031a20 con 0x55a7de065680 2024-09-19T09:01:18.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.197+0000 7f87c6ffd640 1 -- 172.21.15.92:0/2782475808 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f87e00a0420 con 0x55a7de065680 2024-09-19T09:01:18.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.197+0000 7f87f00f1740 10 client.16419 fetch_fsmap learned FSMap version 19 2024-09-19T09:01:18.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.197+0000 7f87f00f1740 1 -- 172.21.15.92:0/2782475808 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55a7de073bd0 con 0x55a7de065680 2024-09-19T09:01:18.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.197+0000 7f87c6ffd640 1 -- 172.21.15.92:0/2782475808 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87d8031a20 con 0x55a7de065680 2024-09-19T09:01:18.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.197+0000 7f87c6ffd640 1 -- 172.21.15.92:0/2782475808 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f87e00a4850 con 0x55a7de065680 2024-09-19T09:01:18.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.197+0000 7f87f00f1740 10 client.16419 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:01:18.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.197+0000 7f87f00f1740 10 client.16419 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:01:18.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.197+0000 7f87f00f1740 20 client.16419 populate_metadata read hostname 'smithi092' 2024-09-19T09:01:18.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.197+0000 7f87f00f1740 1 --2- 172.21.15.92:0/2782475808 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a7de075080 0x55a7de077500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:18.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.197+0000 7f87f00f1740 4 client.16419 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:01:18.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.197+0000 7f87f00f1740 1 -- 172.21.15.92:0/2782475808 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7ddfcd850 con 0x55a7de075080 2024-09-19T09:01:18.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.198+0000 7f87e77fe640 1 --2- 172.21.15.92:0/2782475808 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a7de075080 0x55a7de077500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:18.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.198+0000 7f87e77fe640 1 --2- 172.21.15.92:0/2782475808 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a7de075080 0x55a7de077500 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b4bc9328bdf5a86 server_cookie=7ef967a85424fab2 in_seq=0 out_seq=0 2024-09-19T09:01:18.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.198+0000 7f87c6ffd640 10 client.16419 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:18.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.199+0000 7f87c6ffd640 1 -- 172.21.15.92:0/2782475808 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a7ddfcd850 con 0x55a7de075080 2024-09-19T09:01:18.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.199+0000 7f87c6ffd640 10 client.16419 handle_command_reply: tid=0 2024-09-19T09:01:18.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.199+0000 7f87f00f1740 1 client.16419 shutdown 2024-09-19T09:01:18.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.199+0000 7f87f00f1740 1 -- 172.21.15.92:0/2782475808 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7de065680 msgr2=0x55a7de062780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:18.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.199+0000 7f87f00f1740 1 --2- 172.21.15.92:0/2782475808 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7de065680 0x55a7de062780 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f87e00cd550 tx=0x7f87e009bac0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.199+0000 7f87f00f1740 1 -- 172.21.15.92:0/2782475808 shutdown_connections 2024-09-19T09:01:18.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.199+0000 7f87f00f1740 1 --2- 172.21.15.92:0/2782475808 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a7de075080 0x55a7de077500 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.199+0000 7f87f00f1740 1 --2- 172.21.15.92:0/2782475808 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7de065680 0x55a7de062780 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.199+0000 7f87f00f1740 1 --2- 172.21.15.92:0/2782475808 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7de05adc0 0x55a7de062240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.199+0000 7f87f00f1740 1 --2- 172.21.15.92:0/2782475808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7de05a4a0 0x55a7de064f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.199+0000 7f87f00f1740 1 -- 172.21.15.92:0/2782475808 >> 172.21.15.92:0/2782475808 conn(0x55a7de056a30 msgr2=0x55a7de05c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:18.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.199+0000 7f87c6ffd640 0 client.16419 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:18.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.199+0000 7f87f00f1740 1 -- 172.21.15.92:0/2782475808 shutdown_connections 2024-09-19T09:01:18.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.199+0000 7f87f00f1740 1 -- 172.21.15.92:0/2782475808 wait complete. 2024-09-19T09:01:18.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.199+0000 7f87f00f1740 20 client.16419 trim_cache size 0 max 16384 2024-09-19T09:01:18.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.216+0000 7f87f00f1740 1 Processor -- start 2024-09-19T09:01:18.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.216+0000 7f87f00f1740 1 -- start start 2024-09-19T09:01:18.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.216+0000 7f87f00f1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7de05a4a0 0x55a7de0641b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:18.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.216+0000 7f87f00f1740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7de05adc0 0x55a7de07cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:18.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.216+0000 7f87f00f1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7de065680 0x55a7de07d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:18.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.216+0000 7f87f00f1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f87e81b1c20 con 0x55a7de05a4a0 2024-09-19T09:01:18.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.216+0000 7f87f00f1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f87e81b44c0 con 0x55a7de065680 2024-09-19T09:01:18.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.216+0000 7f87f00f1740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f87e81b22b0 con 0x55a7de05adc0 2024-09-19T09:01:18.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.216+0000 7f87e77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7de05a4a0 0x55a7de0641b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:18.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.216+0000 7f87e77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7de05a4a0 0x55a7de0641b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50560/0 (socket says 172.21.15.92:50560) 2024-09-19T09:01:18.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.216+0000 7f87e77fe640 1 -- 172.21.15.92:0/674396331 learned_addr learned my addr 172.21.15.92:0/674396331 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:18.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.216+0000 7f87e6ffd640 1 --2- 172.21.15.92:0/674396331 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7de05adc0 0x55a7de07cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:18.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.216+0000 7f87e77fe640 1 -- 172.21.15.92:0/674396331 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7de05adc0 msgr2=0x55a7de07cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:18.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.216+0000 7f87e7fff640 1 --2- 172.21.15.92:0/674396331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7de065680 0x55a7de07d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:18.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.216+0000 7f87e77fe640 1 --2- 172.21.15.92:0/674396331 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7de05adc0 0x55a7de07cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.216+0000 7f87e77fe640 1 -- 172.21.15.92:0/674396331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7de065680 msgr2=0x55a7de07d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:18.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.216+0000 7f87e77fe640 1 --2- 172.21.15.92:0/674396331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7de065680 0x55a7de07d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.217+0000 7f87e77fe640 1 -- 172.21.15.92:0/674396331 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7de05a2d0 con 0x55a7de05a4a0 2024-09-19T09:01:18.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.217+0000 7f87e6ffd640 1 --2- 172.21.15.92:0/674396331 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7de05adc0 0x55a7de07cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:01:18.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.217+0000 7f87e77fe640 1 --2- 172.21.15.92:0/674396331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7de05a4a0 0x55a7de0641b0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f87d8031550 tx=0x7f87d802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f22b539c2c5725b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:18.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.217+0000 7f87cd7fa640 1 -- 172.21.15.92:0/674396331 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d8035050 con 0x55a7de05a4a0 2024-09-19T09:01:18.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.217+0000 7f87cd7fa640 1 -- 172.21.15.92:0/674396331 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87d8005020 con 0x55a7de05a4a0 2024-09-19T09:01:18.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.217+0000 7f87cd7fa640 1 -- 172.21.15.92:0/674396331 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d803f040 con 0x55a7de05a4a0 2024-09-19T09:01:18.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.217+0000 7f87f00f1740 1 -- 172.21.15.92:0/674396331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7de05a4a0 msgr2=0x55a7de0641b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:18.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.217+0000 7f87f00f1740 1 --2- 172.21.15.92:0/674396331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7de05a4a0 0x55a7de0641b0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f87d8031550 tx=0x7f87d802a420 comp rx=0 tx=0).stop 2024-09-19T09:01:18.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.218+0000 7f87f00f1740 1 -- 172.21.15.92:0/674396331 shutdown_connections 2024-09-19T09:01:18.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.218+0000 7f87f00f1740 1 --2- 172.21.15.92:0/674396331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7de065680 0x55a7de07d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.218+0000 7f87f00f1740 1 --2- 172.21.15.92:0/674396331 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7de05adc0 0x55a7de07cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.218+0000 7f87f00f1740 1 --2- 172.21.15.92:0/674396331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7de05a4a0 0x55a7de0641b0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.218+0000 7f87f00f1740 1 -- 172.21.15.92:0/674396331 >> 172.21.15.92:0/674396331 conn(0x55a7de056a30 msgr2=0x55a7de063aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:18.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.218+0000 7f87f00f1740 1 -- 172.21.15.92:0/674396331 shutdown_connections 2024-09-19T09:01:18.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.218+0000 7f87f00f1740 1 -- 172.21.15.92:0/674396331 wait complete. 2024-09-19T09:01:18.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.218+0000 7f87f00f1740 1 -- start start 2024-09-19T09:01:18.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.218+0000 7f87f00f1740 1 Processor -- start 2024-09-19T09:01:18.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.218+0000 7f87f00f1740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7de05a4a0 0x55a7de06ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:18.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.218+0000 7f87f00f1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7de05adc0 0x55a7de06b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:18.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.218+0000 7f87f00f1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7de065680 0x55a7de0d6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:18.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.218+0000 7f87f00f1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f87e81b2980 con 0x55a7de05adc0 2024-09-19T09:01:18.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.218+0000 7f87f00f1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f87e81b3df0 con 0x55a7de065680 2024-09-19T09:01:18.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.218+0000 7f87f00f1740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f87e81b3050 con 0x55a7de05a4a0 2024-09-19T09:01:18.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.218+0000 7f87f00f1740 10 client.0 _ll_register_callbacks cb 0x7f87e009bc60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:18.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.218+0000 7f87e6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7de05adc0 0x55a7de06b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:18.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.218+0000 7f87e6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7de05adc0 0x55a7de06b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50574/0 (socket says 172.21.15.92:50574) 2024-09-19T09:01:18.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.219+0000 7f87e6ffd640 1 -- 172.21.15.92:0/845955593 learned_addr learned my addr 172.21.15.92:0/845955593 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:18.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.218+0000 7f87e77fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7de05a4a0 0x55a7de06ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:18.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.219+0000 7f87e7fff640 1 --2- 172.21.15.92:0/845955593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7de065680 0x55a7de0d6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:18.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.219+0000 7f87e6ffd640 1 -- 172.21.15.92:0/845955593 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7de05a4a0 msgr2=0x55a7de06ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:18.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.219+0000 7f87e6ffd640 1 --2- 172.21.15.92:0/845955593 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7de05a4a0 0x55a7de06ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.219+0000 7f87e6ffd640 1 -- 172.21.15.92:0/845955593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7de065680 msgr2=0x55a7de0d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:18.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.219+0000 7f87e6ffd640 1 --2- 172.21.15.92:0/845955593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7de065680 0x55a7de0d6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.219+0000 7f87e6ffd640 1 -- 172.21.15.92:0/845955593 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7de0d7400 con 0x55a7de05adc0 2024-09-19T09:01:18.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.219+0000 7f87e77fe640 1 --2- 172.21.15.92:0/845955593 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7de05a4a0 0x55a7de06ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:18.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.219+0000 7f87e6ffd640 1 --2- 172.21.15.92:0/845955593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7de05adc0 0x55a7de06b3c0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f87dc006e10 tx=0x7f87dc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c9047511635be33 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:18.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.219+0000 7f87c6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:01:18.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.219+0000 7f87c6ffd640 1 -- 172.21.15.92:0/845955593 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87dc017e60 con 0x55a7de05adc0 2024-09-19T09:01:18.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.219+0000 7f87f00f1740 1 -- 172.21.15.92:0/845955593 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87d8005020 con 0x55a7de05adc0 2024-09-19T09:01:18.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.219+0000 7f87c6ffd640 1 -- 172.21.15.92:0/845955593 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f87dc024480 con 0x55a7de05adc0 2024-09-19T09:01:18.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.219+0000 7f87c6ffd640 1 -- 172.21.15.92:0/845955593 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f87dc0059c0 con 0x55a7de05adc0 2024-09-19T09:01:18.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.219+0000 7f87f00f1740 10 client.16425 fetch_fsmap learned FSMap version 19 2024-09-19T09:01:18.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.219+0000 7f87f00f1740 1 -- 172.21.15.92:0/845955593 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55a7de0df940 con 0x55a7de05adc0 2024-09-19T09:01:18.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.219+0000 7f87c6ffd640 1 -- 172.21.15.92:0/845955593 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87d8005020 con 0x55a7de05adc0 2024-09-19T09:01:18.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.220+0000 7f87c6ffd640 1 -- 172.21.15.92:0/845955593 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f87dc005cd0 con 0x55a7de05adc0 2024-09-19T09:01:18.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.220+0000 7f87f00f1740 10 client.16425 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:01:18.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.220+0000 7f87f00f1740 10 client.16425 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:01:18.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.220+0000 7f87f00f1740 20 client.16425 populate_metadata read hostname 'smithi092' 2024-09-19T09:01:18.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.220+0000 7f87f00f1740 1 --2- 172.21.15.92:0/845955593 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a7de0e0170 0x55a7de0e2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:18.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.220+0000 7f87f00f1740 4 client.16425 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:01:18.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.220+0000 7f87f00f1740 1 -- 172.21.15.92:0/845955593 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a7ddfc7d60 con 0x55a7de0e0170 2024-09-19T09:01:18.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.220+0000 7f87e77fe640 1 --2- 172.21.15.92:0/845955593 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a7de0e0170 0x55a7de0e2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:18.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.220+0000 7f87c6ffd640 10 client.16425 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:18.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.220+0000 7f87e77fe640 1 --2- 172.21.15.92:0/845955593 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a7de0e0170 0x55a7de0e2590 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cda1a92aaa4f0933 server_cookie=b22b26bf955244b in_seq=0 out_seq=0 2024-09-19T09:01:18.238 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:01:18.238 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-19T09:01:18.239 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {} 2024-09-19T09:01:18.239 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:01:18.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.221+0000 7f87c6ffd640 1 -- 172.21.15.92:0/845955593 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a7ddfc7d60 con 0x55a7de0e0170 2024-09-19T09:01:18.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.221+0000 7f87c6ffd640 10 client.16425 handle_command_reply: tid=0 2024-09-19T09:01:18.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.221+0000 7f87f00f1740 1 client.16425 shutdown 2024-09-19T09:01:18.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.221+0000 7f87f00f1740 1 -- 172.21.15.92:0/845955593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7de05adc0 msgr2=0x55a7de06b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:18.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.221+0000 7f87f00f1740 1 --2- 172.21.15.92:0/845955593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7de05adc0 0x55a7de06b3c0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f87dc006e10 tx=0x7f87dc008040 comp rx=0 tx=0).stop 2024-09-19T09:01:18.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.221+0000 7f87f00f1740 1 -- 172.21.15.92:0/845955593 shutdown_connections 2024-09-19T09:01:18.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.221+0000 7f87f00f1740 1 --2- 172.21.15.92:0/845955593 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a7de0e0170 0x55a7de0e2590 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.221+0000 7f87f00f1740 1 --2- 172.21.15.92:0/845955593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7de065680 0x55a7de0d6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.221+0000 7f87f00f1740 1 --2- 172.21.15.92:0/845955593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7de05adc0 0x55a7de06b3c0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.221+0000 7f87f00f1740 1 --2- 172.21.15.92:0/845955593 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7de05a4a0 0x55a7de06ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.221+0000 7f87c6ffd640 0 client.16425 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:18.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.221+0000 7f87f00f1740 1 -- 172.21.15.92:0/845955593 >> 172.21.15.92:0/845955593 conn(0x55a7de056a30 msgr2=0x55a7de055350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:18.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.221+0000 7f87f00f1740 1 -- 172.21.15.92:0/845955593 shutdown_connections 2024-09-19T09:01:18.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.221+0000 7f87f00f1740 1 -- 172.21.15.92:0/845955593 wait complete. 2024-09-19T09:01:18.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.221+0000 7f87f00f1740 20 client.16425 trim_cache size 0 max 16384 2024-09-19T09:01:18.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.221+0000 7f87edd18640 1 -- 172.21.15.92:0/2887902328 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f87d00a3240 msgr2=0x7f87d00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:18.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.221+0000 7f87edd18640 1 --2- 172.21.15.92:0/2887902328 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f87d00a3240 0x7f87d00a5700 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f87dc009fd0 tx=0x7f87dc0092c0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.221+0000 7f87edd18640 1 -- 172.21.15.92:0/2887902328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87e8106a80 msgr2=0x7f87e819c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:18.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.221+0000 7f87edd18640 1 --2- 172.21.15.92:0/2887902328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87e8106a80 0x7f87e819c190 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f87e000cad0 tx=0x7f87e000cf90 comp rx=0 tx=0).stop 2024-09-19T09:01:18.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.222+0000 7f87edd18640 1 -- 172.21.15.92:0/2887902328 shutdown_connections 2024-09-19T09:01:18.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.222+0000 7f87edd18640 1 --2- 172.21.15.92:0/2887902328 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f87d00a3240 0x7f87d00a5700 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.222+0000 7f87edd18640 1 --2- 172.21.15.92:0/2887902328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87e8106a80 0x7f87e819c190 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.222+0000 7f87edd18640 1 --2- 172.21.15.92:0/2887902328 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f87e8101420 0x7f87e8197680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.222+0000 7f87edd18640 1 --2- 172.21.15.92:0/2887902328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87e8100a80 0x7f87e8197140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.222+0000 7f87edd18640 1 -- 172.21.15.92:0/2887902328 >> 172.21.15.92:0/2887902328 conn(0x7f87e80fc7a0 msgr2=0x7f87e80fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:18.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.222+0000 7f87edd18640 1 -- 172.21.15.92:0/2887902328 shutdown_connections 2024-09-19T09:01:18.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:18.222+0000 7f87edd18640 1 -- 172.21.15.92:0/2887902328 wait complete. 2024-09-19T09:01:18.988 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:01:18.988 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:01:19.235 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:19.660 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:19 smithi092 ceph-mon[31407]: pgmap v475: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.0 MiB/s wr, 43 op/s 2024-09-19T09:01:19.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.660+0000 7fa2ff9a2640 1 -- 172.21.15.92:0/1658570482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2f8101dd0 msgr2=0x7fa2f81021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:19.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.660+0000 7fa2ff9a2640 1 --2- 172.21.15.92:0/1658570482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2f8101dd0 0x7fa2f81021b0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4009900 tx=0x7fa2f402a410 comp rx=0 tx=0).stop 2024-09-19T09:01:19.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.660+0000 7fa2ff9a2640 1 -- 172.21.15.92:0/1658570482 shutdown_connections 2024-09-19T09:01:19.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.660+0000 7fa2ff9a2640 1 --2- 172.21.15.92:0/1658570482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2f8106f00 0x7fa2f810ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:19.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.660+0000 7fa2ff9a2640 1 --2- 172.21.15.92:0/1658570482 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa2f8102780 0x7fa2f81067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:19.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.660+0000 7fa2ff9a2640 1 --2- 172.21.15.92:0/1658570482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2f8101dd0 0x7fa2f81021b0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:19.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.660+0000 7fa2ff9a2640 1 -- 172.21.15.92:0/1658570482 >> 172.21.15.92:0/1658570482 conn(0x7fa2f80fd890 msgr2=0x7fa2f80ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:19.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.660+0000 7fa2ff9a2640 1 -- 172.21.15.92:0/1658570482 shutdown_connections 2024-09-19T09:01:19.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.660+0000 7fa2ff9a2640 1 -- 172.21.15.92:0/1658570482 wait complete. 2024-09-19T09:01:19.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.660+0000 7fa2ff9a2640 1 Processor -- start 2024-09-19T09:01:19.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.661+0000 7fa2ff9a2640 1 -- start start 2024-09-19T09:01:19.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.661+0000 7fa2ff9a2640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa2f8101dd0 0x7fa2f8198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:19.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.661+0000 7fa2ff9a2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2f8102780 0x7fa2f81989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:19.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.661+0000 7fa2ff9a2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2f8106f00 0x7fa2f819cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:19.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.661+0000 7fa2ff9a2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f8111f60 con 0x7fa2f8102780 2024-09-19T09:01:19.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.661+0000 7fa2ff9a2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f8111de0 con 0x7fa2f8106f00 2024-09-19T09:01:19.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.661+0000 7fa2ff9a2640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f81120e0 con 0x7fa2f8101dd0 2024-09-19T09:01:19.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.661+0000 7fa2fcf3d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2f8102780 0x7fa2f81989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:19.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.661+0000 7fa2fcf3d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2f8102780 0x7fa2f81989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50602/0 (socket says 172.21.15.92:50602) 2024-09-19T09:01:19.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.661+0000 7fa2fcf3d640 1 -- 172.21.15.92:0/1410370519 learned_addr learned my addr 172.21.15.92:0/1410370519 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:19.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.661+0000 7fa2fd73e640 1 --2- 172.21.15.92:0/1410370519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa2f8101dd0 0x7fa2f8198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:19.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.661+0000 7fa2fcf3d640 1 -- 172.21.15.92:0/1410370519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa2f8101dd0 msgr2=0x7fa2f8198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:19.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.661+0000 7fa2fcf3d640 1 --2- 172.21.15.92:0/1410370519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa2f8101dd0 0x7fa2f8198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:19.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.661+0000 7fa2fdf3f640 1 --2- 172.21.15.92:0/1410370519 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2f8106f00 0x7fa2f819cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:19.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.661+0000 7fa2fcf3d640 1 -- 172.21.15.92:0/1410370519 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2f8106f00 msgr2=0x7fa2f819cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:19.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.661+0000 7fa2fcf3d640 1 --2- 172.21.15.92:0/1410370519 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2f8106f00 0x7fa2f819cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:19.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.661+0000 7fa2fcf3d640 1 -- 172.21.15.92:0/1410370519 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f819d430 con 0x7fa2f8102780 2024-09-19T09:01:19.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.661+0000 7fa2fd73e640 1 --2- 172.21.15.92:0/1410370519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa2f8101dd0 0x7fa2f8198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:01:19.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.661+0000 7fa2fdf3f640 1 --2- 172.21.15.92:0/1410370519 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2f8106f00 0x7fa2f819cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:01:19.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.661+0000 7fa2fcf3d640 1 --2- 172.21.15.92:0/1410370519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2f8102780 0x7fa2f81989c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fa2e800d770 tx=0x7fa2e800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:19.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.662+0000 7fa2ee7fc640 1 -- 172.21.15.92:0/1410370519 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e8017070 con 0x7fa2f8102780 2024-09-19T09:01:19.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.662+0000 7fa2ee7fc640 1 -- 172.21.15.92:0/1410370519 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2e8005500 con 0x7fa2f8102780 2024-09-19T09:01:19.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.662+0000 7fa2ee7fc640 1 -- 172.21.15.92:0/1410370519 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e8004e00 con 0x7fa2f8102780 2024-09-19T09:01:19.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.662+0000 7fa2ff9a2640 1 -- 172.21.15.92:0/1410370519 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2f819d720 con 0x7fa2f8102780 2024-09-19T09:01:19.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.662+0000 7fa2ff9a2640 1 -- 172.21.15.92:0/1410370519 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2f81a5000 con 0x7fa2f8102780 2024-09-19T09:01:19.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.663+0000 7fa2ff9a2640 1 -- 172.21.15.92:0/1410370519 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2f81021b0 con 0x7fa2f8102780 2024-09-19T09:01:19.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.664+0000 7fa2ee7fc640 1 -- 172.21.15.92:0/1410370519 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa2e8004fa0 con 0x7fa2f8102780 2024-09-19T09:01:19.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.664+0000 7fa2ee7fc640 1 --2- 172.21.15.92:0/1410370519 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa2e40a3240 0x7fa2e40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:19.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.665+0000 7fa2fd73e640 1 --2- 172.21.15.92:0/1410370519 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa2e40a3240 0x7fa2e40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:19.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.665+0000 7fa2ee7fc640 1 -- 172.21.15.92:0/1410370519 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa2e80cf110 con 0x7fa2f8102780 2024-09-19T09:01:19.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.665+0000 7fa2fd73e640 1 --2- 172.21.15.92:0/1410370519 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa2e40a3240 0x7fa2e40a5700 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4005ab0 tx=0x7fa2f4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:19.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.669+0000 7fa2ee7fc640 1 -- 172.21.15.92:0/1410370519 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa2e809be30 con 0x7fa2f8102780 2024-09-19T09:01:19.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:19 smithi167 ceph-mon[35359]: pgmap v475: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.0 MiB/s wr, 43 op/s 2024-09-19T09:01:19.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.871+0000 7fa2ff9a2640 1 -- 172.21.15.92:0/1410370519 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa2f8109b50 con 0x7fa2f8102780 2024-09-19T09:01:19.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.872+0000 7fa2ee7fc640 1 -- 172.21.15.92:0/1410370519 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7fa2e809b730 con 0x7fa2f8102780 2024-09-19T09:01:19.872 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:01:19.872 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:01:19.873 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:01:19.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:19 smithi190 ceph-mon[35358]: pgmap v475: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.0 MiB/s wr, 43 op/s 2024-09-19T09:01:19.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.874+0000 7fa2ff9a2640 1 -- 172.21.15.92:0/1410370519 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa2e40a3240 msgr2=0x7fa2e40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:19.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.874+0000 7fa2ff9a2640 1 --2- 172.21.15.92:0/1410370519 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa2e40a3240 0x7fa2e40a5700 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4005ab0 tx=0x7fa2f4005a20 comp rx=0 tx=0).stop 2024-09-19T09:01:19.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.874+0000 7fa2ff9a2640 1 -- 172.21.15.92:0/1410370519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2f8102780 msgr2=0x7fa2f81989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:19.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.874+0000 7fa2ff9a2640 1 --2- 172.21.15.92:0/1410370519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2f8102780 0x7fa2f81989c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fa2e800d770 tx=0x7fa2e800dc30 comp rx=0 tx=0).stop 2024-09-19T09:01:19.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.874+0000 7fa2ff9a2640 1 -- 172.21.15.92:0/1410370519 shutdown_connections 2024-09-19T09:01:19.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.874+0000 7fa2ff9a2640 1 --2- 172.21.15.92:0/1410370519 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2f8106f00 0x7fa2f819cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:19.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.874+0000 7fa2ff9a2640 1 --2- 172.21.15.92:0/1410370519 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa2e40a3240 0x7fa2e40a5700 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:19.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.874+0000 7fa2ff9a2640 1 --2- 172.21.15.92:0/1410370519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2f8102780 0x7fa2f81989c0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:19.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.874+0000 7fa2ff9a2640 1 --2- 172.21.15.92:0/1410370519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa2f8101dd0 0x7fa2f8198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:19.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.874+0000 7fa2ff9a2640 1 -- 172.21.15.92:0/1410370519 >> 172.21.15.92:0/1410370519 conn(0x7fa2f80fd890 msgr2=0x7fa2f80fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:19.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.874+0000 7fa2ff9a2640 1 -- 172.21.15.92:0/1410370519 shutdown_connections 2024-09-19T09:01:19.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:19.874+0000 7fa2ff9a2640 1 -- 172.21.15.92:0/1410370519 wait complete. 2024-09-19T09:01:20.466 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:01:20.710 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:20.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:20 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1410370519' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:20.796 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:01:20.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:20 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/1410370519' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:20.876 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:20 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/1410370519' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:21.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.154+0000 7f3188860640 1 -- 172.21.15.92:0/2179906869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3184106a80 msgr2=0x7f3184106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:21.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.154+0000 7f3188860640 1 --2- 172.21.15.92:0/2179906869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3184106a80 0x7f3184106e60 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f3174009930 tx=0x7f317402a420 comp rx=0 tx=0).stop 2024-09-19T09:01:21.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.154+0000 7f3188860640 1 -- 172.21.15.92:0/2179906869 shutdown_connections 2024-09-19T09:01:21.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.154+0000 7f3188860640 1 --2- 172.21.15.92:0/2179906869 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3184101420 0x7f318410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.154+0000 7f3188860640 1 --2- 172.21.15.92:0/2179906869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3184100a80 0x7f3184100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.154+0000 7f3188860640 1 --2- 172.21.15.92:0/2179906869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3184106a80 0x7f3184106e60 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.154+0000 7f3188860640 1 -- 172.21.15.92:0/2179906869 >> 172.21.15.92:0/2179906869 conn(0x7f31840fc7a0 msgr2=0x7f31840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:21.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.154+0000 7f3188860640 1 -- 172.21.15.92:0/2179906869 shutdown_connections 2024-09-19T09:01:21.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.154+0000 7f3188860640 1 -- 172.21.15.92:0/2179906869 wait complete. 2024-09-19T09:01:21.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.155+0000 7f3188860640 1 Processor -- start 2024-09-19T09:01:21.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.155+0000 7f3188860640 1 -- start start 2024-09-19T09:01:21.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.155+0000 7f3188860640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3184100a80 0x7f3184198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:21.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.155+0000 7f3188860640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3184101420 0x7f31841989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:21.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.155+0000 7f3188860640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3184106a80 0x7f318419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:21.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.155+0000 7f3188860640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3184110ea0 con 0x7f3184100a80 2024-09-19T09:01:21.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.155+0000 7f3188860640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3184110d20 con 0x7f3184106a80 2024-09-19T09:01:21.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.155+0000 7f3188860640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3184111020 con 0x7f3184101420 2024-09-19T09:01:21.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.155+0000 7f318259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3184100a80 0x7f3184198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:21.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.156+0000 7f318259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3184100a80 0x7f3184198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50624/0 (socket says 172.21.15.92:50624) 2024-09-19T09:01:21.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.156+0000 7f318259c640 1 -- 172.21.15.92:0/1657495004 learned_addr learned my addr 172.21.15.92:0/1657495004 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:21.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.156+0000 7f3182d9d640 1 --2- 172.21.15.92:0/1657495004 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3184106a80 0x7f318419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:21.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.156+0000 7f3181d9b640 1 --2- 172.21.15.92:0/1657495004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3184101420 0x7f31841989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:21.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.156+0000 7f318259c640 1 -- 172.21.15.92:0/1657495004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3184101420 msgr2=0x7f31841989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:21.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.156+0000 7f318259c640 1 --2- 172.21.15.92:0/1657495004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3184101420 0x7f31841989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.156+0000 7f318259c640 1 -- 172.21.15.92:0/1657495004 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3184106a80 msgr2=0x7f318419cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:21.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.156+0000 7f318259c640 1 --2- 172.21.15.92:0/1657495004 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3184106a80 0x7f318419cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.156+0000 7f318259c640 1 -- 172.21.15.92:0/1657495004 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f318419d440 con 0x7f3184100a80 2024-09-19T09:01:21.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.156+0000 7f318259c640 1 --2- 172.21.15.92:0/1657495004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3184100a80 0x7f3184198490 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f3174009230 tx=0x7f3174004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:21.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.156+0000 7f31737fe640 1 -- 172.21.15.92:0/1657495004 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317403f030 con 0x7f3184100a80 2024-09-19T09:01:21.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.156+0000 7f31737fe640 1 -- 172.21.15.92:0/1657495004 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3174003ad0 con 0x7f3184100a80 2024-09-19T09:01:21.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.156+0000 7f3188860640 1 -- 172.21.15.92:0/1657495004 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f318419d6d0 con 0x7f3184100a80 2024-09-19T09:01:21.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.156+0000 7f31737fe640 1 -- 172.21.15.92:0/1657495004 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3174035070 con 0x7f3184100a80 2024-09-19T09:01:21.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.156+0000 7f3188860640 1 -- 172.21.15.92:0/1657495004 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31841a5010 con 0x7f3184100a80 2024-09-19T09:01:21.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.159+0000 7f31737fe640 1 -- 172.21.15.92:0/1657495004 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3174042030 con 0x7f3184100a80 2024-09-19T09:01:21.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.159+0000 7f31737fe640 1 --2- 172.21.15.92:0/1657495004 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f316c0a3240 0x7f316c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:21.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.159+0000 7f318ac39740 1 Processor -- start 2024-09-19T09:01:21.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.159+0000 7f3181d9b640 1 --2- 172.21.15.92:0/1657495004 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f316c0a3240 0x7f316c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:21.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.159+0000 7f31737fe640 1 -- 172.21.15.92:0/1657495004 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f31740efd30 con 0x7f3184100a80 2024-09-19T09:01:21.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.160+0000 7f318ac39740 1 -- start start 2024-09-19T09:01:21.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.160+0000 7f318ac39740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b71b0b40 0x5640b71af090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:21.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.160+0000 7f318ac39740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640b71af5d0 0x5640b71afa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:21.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.160+0000 7f318ac39740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640b71ba370 0x5640b71bc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:21.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.160+0000 7f318ac39740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5640b71152f0 con 0x5640b71b0b40 2024-09-19T09:01:21.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.160+0000 7f318ac39740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5640b70bccf0 con 0x5640b71af5d0 2024-09-19T09:01:21.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.160+0000 7f318ac39740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5640b71112b0 con 0x5640b71ba370 2024-09-19T09:01:21.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.160+0000 7f3181d9b640 1 --2- 172.21.15.92:0/1657495004 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f316c0a3240 0x7f316c0a5700 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f318406b870 tx=0x7f317800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:21.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.160+0000 7f318259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b71b0b40 0x5640b71af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:21.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.160+0000 7f318259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b71b0b40 0x5640b71af090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50626/0 (socket says 172.21.15.92:50626) 2024-09-19T09:01:21.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.160+0000 7f318259c640 1 -- 172.21.15.92:0/393089387 learned_addr learned my addr 172.21.15.92:0/393089387 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:21.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.160+0000 7f318259c640 1 -- 172.21.15.92:0/393089387 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640b71ba370 msgr2=0x5640b71bc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:21.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.160+0000 7f318259c640 1 --2- 172.21.15.92:0/393089387 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640b71ba370 0x5640b71bc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.160+0000 7f318259c640 1 -- 172.21.15.92:0/393089387 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640b71af5d0 msgr2=0x5640b71afa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:21.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.160+0000 7f318259c640 1 --2- 172.21.15.92:0/393089387 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640b71af5d0 0x5640b71afa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.160+0000 7f318259c640 1 -- 172.21.15.92:0/393089387 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640b70a13a0 con 0x5640b71b0b40 2024-09-19T09:01:21.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.160+0000 7f318259c640 1 --2- 172.21.15.92:0/393089387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b71b0b40 0x5640b71af090 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f31740b8860 tx=0x7f317402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95803676d2f1084b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:21.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.160+0000 7f3170ff9640 1 -- 172.21.15.92:0/393089387 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3174049050 con 0x5640b71b0b40 2024-09-19T09:01:21.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.161+0000 7f3170ff9640 1 -- 172.21.15.92:0/393089387 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31740ba700 con 0x5640b71b0b40 2024-09-19T09:01:21.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.161+0000 7f3170ff9640 1 -- 172.21.15.92:0/393089387 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31740bc860 con 0x5640b71b0b40 2024-09-19T09:01:21.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.161+0000 7f318ac39740 1 -- 172.21.15.92:0/393089387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b71b0b40 msgr2=0x5640b71af090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:21.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.161+0000 7f318ac39740 1 --2- 172.21.15.92:0/393089387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b71b0b40 0x5640b71af090 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f31740b8860 tx=0x7f317402a420 comp rx=0 tx=0).stop 2024-09-19T09:01:21.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.161+0000 7f318ac39740 1 -- 172.21.15.92:0/393089387 shutdown_connections 2024-09-19T09:01:21.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.161+0000 7f318ac39740 1 --2- 172.21.15.92:0/393089387 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640b71ba370 0x5640b71bc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.161+0000 7f318ac39740 1 --2- 172.21.15.92:0/393089387 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640b71af5d0 0x5640b71afa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.161+0000 7f318ac39740 1 --2- 172.21.15.92:0/393089387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b71b0b40 0x5640b71af090 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.161+0000 7f318ac39740 1 -- 172.21.15.92:0/393089387 >> 172.21.15.92:0/393089387 conn(0x5640b7178310 msgr2=0x5640b71abc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:21.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.161+0000 7f318ac39740 1 -- 172.21.15.92:0/393089387 shutdown_connections 2024-09-19T09:01:21.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.161+0000 7f318ac39740 1 -- 172.21.15.92:0/393089387 wait complete. 2024-09-19T09:01:21.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.162+0000 7f318ac39740 1 -- start start 2024-09-19T09:01:21.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.162+0000 7f318ac39740 1 Processor -- start 2024-09-19T09:01:21.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.162+0000 7f318ac39740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640b71af5d0 0x5640b71b9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:21.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.162+0000 7f318ac39740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640b71b0b40 0x5640b71b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:21.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.162+0000 7f318ac39740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b71ba370 0x5640b71b7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:21.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.162+0000 7f318ac39740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5640b71bce30 con 0x5640b71ba370 2024-09-19T09:01:21.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.162+0000 7f318ac39740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5640b70d0060 con 0x5640b71af5d0 2024-09-19T09:01:21.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.162+0000 7f318ac39740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5640b71bcfb0 con 0x5640b71b0b40 2024-09-19T09:01:21.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.162+0000 7f318ac39740 10 client.0 _ll_register_callbacks cb 0x5640b6e238c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:21.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.162+0000 7f3182d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b71ba370 0x5640b71b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:21.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.162+0000 7f3182d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b71ba370 0x5640b71b7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50634/0 (socket says 172.21.15.92:50634) 2024-09-19T09:01:21.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.162+0000 7f3182d9d640 1 -- 172.21.15.92:0/247250979 learned_addr learned my addr 172.21.15.92:0/247250979 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:21.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.162+0000 7f3181d9b640 1 --2- 172.21.15.92:0/247250979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640b71b0b40 0x5640b71b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:21.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.162+0000 7f318259c640 1 --2- 172.21.15.92:0/247250979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640b71af5d0 0x5640b71b9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:21.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.162+0000 7f3182d9d640 1 -- 172.21.15.92:0/247250979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640b71b0b40 msgr2=0x5640b71b70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:21.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.162+0000 7f3182d9d640 1 --2- 172.21.15.92:0/247250979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640b71b0b40 0x5640b71b70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.162+0000 7f3182d9d640 1 -- 172.21.15.92:0/247250979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640b71af5d0 msgr2=0x5640b71b9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:21.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.162+0000 7f3182d9d640 1 --2- 172.21.15.92:0/247250979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640b71af5d0 0x5640b71b9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.163+0000 7f3182d9d640 1 -- 172.21.15.92:0/247250979 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640b6e863c0 con 0x5640b71ba370 2024-09-19T09:01:21.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.163+0000 7f318259c640 1 --2- 172.21.15.92:0/247250979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640b71af5d0 0x5640b71b9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:01:21.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.163+0000 7f3182d9d640 1 --2- 172.21.15.92:0/247250979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b71ba370 0x5640b71b7850 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f317c00ab40 tx=0x7f317c00af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c519c2cf2bab3c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:21.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.163+0000 7f3169ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:01:21.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.163+0000 7f3169ffb640 1 -- 172.21.15.92:0/247250979 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317c018020 con 0x5640b71ba370 2024-09-19T09:01:21.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.163+0000 7f3169ffb640 1 -- 172.21.15.92:0/247250979 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f317c00ec10 con 0x5640b71ba370 2024-09-19T09:01:21.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.163+0000 7f318ac39740 1 -- 172.21.15.92:0/247250979 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31740ba700 con 0x5640b71ba370 2024-09-19T09:01:21.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.163+0000 7f3169ffb640 1 -- 172.21.15.92:0/247250979 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f317c00ee10 con 0x5640b71ba370 2024-09-19T09:01:21.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.163+0000 7f318ac39740 10 client.16443 fetch_fsmap learned FSMap version 19 2024-09-19T09:01:21.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.163+0000 7f318ac39740 1 -- 172.21.15.92:0/247250979 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5640b71c88d0 con 0x5640b71ba370 2024-09-19T09:01:21.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.163+0000 7f3169ffb640 1 -- 172.21.15.92:0/247250979 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31740ba700 con 0x5640b71ba370 2024-09-19T09:01:21.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.163+0000 7f3169ffb640 1 -- 172.21.15.92:0/247250979 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f317c0145c0 con 0x5640b71ba370 2024-09-19T09:01:21.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.163+0000 7f318ac39740 10 client.16443 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:01:21.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.163+0000 7f318ac39740 10 client.16443 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:01:21.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.163+0000 7f318ac39740 20 client.16443 populate_metadata read hostname 'smithi092' 2024-09-19T09:01:21.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.163+0000 7f318ac39740 1 --2- 172.21.15.92:0/247250979 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5640b71c9d90 0x5640b71cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:21.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.163+0000 7f318ac39740 4 client.16443 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:01:21.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.163+0000 7f318ac39740 1 -- 172.21.15.92:0/247250979 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640b7122860 con 0x5640b71c9d90 2024-09-19T09:01:21.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.164+0000 7f318259c640 1 --2- 172.21.15.92:0/247250979 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5640b71c9d90 0x5640b71cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:21.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.164+0000 7f3169ffb640 10 client.16443 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:21.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.164+0000 7f318259c640 1 --2- 172.21.15.92:0/247250979 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5640b71c9d90 0x5640b71cc1b0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70d0abdf6446c912 server_cookie=443a46e58b217d2 in_seq=0 out_seq=0 2024-09-19T09:01:21.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.165+0000 7f3169ffb640 1 -- 172.21.15.92:0/247250979 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5640b7122860 con 0x5640b71c9d90 2024-09-19T09:01:21.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.165+0000 7f3169ffb640 10 client.16443 handle_command_reply: tid=0 2024-09-19T09:01:21.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.165+0000 7f318ac39740 1 client.16443 shutdown 2024-09-19T09:01:21.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.165+0000 7f318ac39740 1 -- 172.21.15.92:0/247250979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b71ba370 msgr2=0x5640b71b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:21.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.165+0000 7f318ac39740 1 --2- 172.21.15.92:0/247250979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b71ba370 0x5640b71b7850 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f317c00ab40 tx=0x7f317c00af40 comp rx=0 tx=0).stop 2024-09-19T09:01:21.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.165+0000 7f318ac39740 1 -- 172.21.15.92:0/247250979 shutdown_connections 2024-09-19T09:01:21.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.165+0000 7f318ac39740 1 --2- 172.21.15.92:0/247250979 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5640b71c9d90 0x5640b71cc1b0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.165+0000 7f318ac39740 1 --2- 172.21.15.92:0/247250979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b71ba370 0x5640b71b7850 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.165+0000 7f318ac39740 1 --2- 172.21.15.92:0/247250979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640b71b0b40 0x5640b71b70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.165+0000 7f318ac39740 1 --2- 172.21.15.92:0/247250979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640b71af5d0 0x5640b71b9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.165+0000 7f318ac39740 1 -- 172.21.15.92:0/247250979 >> 172.21.15.92:0/247250979 conn(0x5640b7178310 msgr2=0x5640b71b1990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:21.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.165+0000 7f3169ffb640 0 client.16443 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:21.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.165+0000 7f318ac39740 1 -- 172.21.15.92:0/247250979 shutdown_connections 2024-09-19T09:01:21.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.165+0000 7f318ac39740 1 -- 172.21.15.92:0/247250979 wait complete. 2024-09-19T09:01:21.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.165+0000 7f318ac39740 20 client.16443 trim_cache size 0 max 16384 2024-09-19T09:01:21.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.178+0000 7f318ac39740 1 Processor -- start 2024-09-19T09:01:21.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.178+0000 7f318ac39740 1 -- start start 2024-09-19T09:01:21.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.178+0000 7f318ac39740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b71af5d0 0x5640b71b7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:21.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.178+0000 7f318ac39740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640b71b0b40 0x5640b71d1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:21.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.178+0000 7f318ac39740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640b71ba370 0x5640b71d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:21.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.178+0000 7f318ac39740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f31841ab6a0 con 0x5640b71af5d0 2024-09-19T09:01:21.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.178+0000 7f318ac39740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f31841adf40 con 0x5640b71ba370 2024-09-19T09:01:21.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.178+0000 7f318ac39740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f31841abd30 con 0x5640b71b0b40 2024-09-19T09:01:21.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.179+0000 7f318259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b71af5d0 0x5640b71b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:21.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.179+0000 7f318259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b71af5d0 0x5640b71b7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50644/0 (socket says 172.21.15.92:50644) 2024-09-19T09:01:21.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.179+0000 7f318259c640 1 -- 172.21.15.92:0/2922929555 learned_addr learned my addr 172.21.15.92:0/2922929555 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:21.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.179+0000 7f318259c640 1 -- 172.21.15.92:0/2922929555 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640b71b0b40 msgr2=0x5640b71d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:21.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.179+0000 7f318259c640 1 --2- 172.21.15.92:0/2922929555 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640b71b0b40 0x5640b71d1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.179+0000 7f318259c640 1 -- 172.21.15.92:0/2922929555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640b71ba370 msgr2=0x5640b71d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:21.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.179+0000 7f318259c640 1 --2- 172.21.15.92:0/2922929555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640b71ba370 0x5640b71d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.179+0000 7f318259c640 1 -- 172.21.15.92:0/2922929555 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640b71c6000 con 0x5640b71af5d0 2024-09-19T09:01:21.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.179+0000 7f318259c640 1 --2- 172.21.15.92:0/2922929555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b71af5d0 0x5640b71b7090 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f31740b8dd0 tx=0x7f31740bc580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad646cc002b06e8c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:21.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.179+0000 7f316bfff640 1 -- 172.21.15.92:0/2922929555 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3174049070 con 0x5640b71af5d0 2024-09-19T09:01:21.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.179+0000 7f316bfff640 1 -- 172.21.15.92:0/2922929555 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3174003c80 con 0x5640b71af5d0 2024-09-19T09:01:21.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.179+0000 7f316bfff640 1 -- 172.21.15.92:0/2922929555 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3174031e30 con 0x5640b71af5d0 2024-09-19T09:01:21.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.180+0000 7f318ac39740 1 -- 172.21.15.92:0/2922929555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b71af5d0 msgr2=0x5640b71b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:21.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.180+0000 7f318ac39740 1 --2- 172.21.15.92:0/2922929555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b71af5d0 0x5640b71b7090 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f31740b8dd0 tx=0x7f31740bc580 comp rx=0 tx=0).stop 2024-09-19T09:01:21.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.180+0000 7f318ac39740 1 -- 172.21.15.92:0/2922929555 shutdown_connections 2024-09-19T09:01:21.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.180+0000 7f318ac39740 1 --2- 172.21.15.92:0/2922929555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640b71ba370 0x5640b71d1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.180+0000 7f318ac39740 1 --2- 172.21.15.92:0/2922929555 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640b71b0b40 0x5640b71d1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.180+0000 7f318ac39740 1 --2- 172.21.15.92:0/2922929555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b71af5d0 0x5640b71b7090 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.180+0000 7f318ac39740 1 -- 172.21.15.92:0/2922929555 >> 172.21.15.92:0/2922929555 conn(0x5640b7178310 msgr2=0x5640b71b6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:21.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.180+0000 7f318ac39740 1 -- 172.21.15.92:0/2922929555 shutdown_connections 2024-09-19T09:01:21.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.180+0000 7f318ac39740 1 -- 172.21.15.92:0/2922929555 wait complete. 2024-09-19T09:01:21.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.180+0000 7f318ac39740 1 -- start start 2024-09-19T09:01:21.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.180+0000 7f318ac39740 1 Processor -- start 2024-09-19T09:01:21.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.181+0000 7f318ac39740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b71af5d0 0x5640b71c2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:21.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.181+0000 7f318ac39740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640b71b0b40 0x5640b71bdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:21.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.181+0000 7f318ac39740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640b71ba370 0x5640b71be140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:21.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.181+0000 7f318ac39740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f31841ac400 con 0x5640b71af5d0 2024-09-19T09:01:21.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.181+0000 7f318ac39740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f31841ad870 con 0x5640b71ba370 2024-09-19T09:01:21.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.181+0000 7f318ac39740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f31841acad0 con 0x5640b71b0b40 2024-09-19T09:01:21.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.181+0000 7f318ac39740 10 client.0 _ll_register_callbacks cb 0x7f317c009990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:21.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.181+0000 7f318259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b71af5d0 0x5640b71c2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:21.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.181+0000 7f318259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b71af5d0 0x5640b71c2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50658/0 (socket says 172.21.15.92:50658) 2024-09-19T09:01:21.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.181+0000 7f318259c640 1 -- 172.21.15.92:0/2366949306 learned_addr learned my addr 172.21.15.92:0/2366949306 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:21.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.181+0000 7f3181d9b640 1 --2- 172.21.15.92:0/2366949306 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640b71b0b40 0x5640b71bdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:21.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.181+0000 7f3182d9d640 1 --2- 172.21.15.92:0/2366949306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640b71ba370 0x5640b71be140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:21.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.181+0000 7f318259c640 1 -- 172.21.15.92:0/2366949306 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640b71b0b40 msgr2=0x5640b71bdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:21.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.181+0000 7f318259c640 1 --2- 172.21.15.92:0/2366949306 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640b71b0b40 0x5640b71bdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.181+0000 7f318259c640 1 -- 172.21.15.92:0/2366949306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640b71ba370 msgr2=0x5640b71be140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:21.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.181+0000 7f318259c640 1 --2- 172.21.15.92:0/2366949306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640b71ba370 0x5640b71be140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.181+0000 7f318259c640 1 -- 172.21.15.92:0/2366949306 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640b71be940 con 0x5640b71af5d0 2024-09-19T09:01:21.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.181+0000 7f3182d9d640 1 --2- 172.21.15.92:0/2366949306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640b71ba370 0x5640b71be140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:01:21.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.181+0000 7f318259c640 1 --2- 172.21.15.92:0/2366949306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b71af5d0 0x5640b71c2880 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f3174046040 tx=0x7f31740ba640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a808abf1028871b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:21.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.181+0000 7f3169ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:01:21.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.181+0000 7f3169ffb640 1 -- 172.21.15.92:0/2366949306 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3174049040 con 0x5640b71af5d0 2024-09-19T09:01:21.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.181+0000 7f3169ffb640 1 -- 172.21.15.92:0/2366949306 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f31740d5280 con 0x5640b71af5d0 2024-09-19T09:01:21.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.181+0000 7f318ac39740 1 -- 172.21.15.92:0/2366949306 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3174003c80 con 0x5640b71af5d0 2024-09-19T09:01:21.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.181+0000 7f3169ffb640 1 -- 172.21.15.92:0/2366949306 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f31740b8a70 con 0x5640b71af5d0 2024-09-19T09:01:21.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.181+0000 7f318ac39740 10 client.16449 fetch_fsmap learned FSMap version 19 2024-09-19T09:01:21.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.181+0000 7f318ac39740 1 -- 172.21.15.92:0/2366949306 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5640b7234a20 con 0x5640b71af5d0 2024-09-19T09:01:21.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.182+0000 7f3169ffb640 1 -- 172.21.15.92:0/2366949306 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3174003c80 con 0x5640b71af5d0 2024-09-19T09:01:21.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.182+0000 7f3169ffb640 1 -- 172.21.15.92:0/2366949306 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f31740c4c30 con 0x5640b71af5d0 2024-09-19T09:01:21.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.182+0000 7f318ac39740 10 client.16449 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:01:21.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.182+0000 7f318ac39740 10 client.16449 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:01:21.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.182+0000 7f318ac39740 20 client.16449 populate_metadata read hostname 'smithi092' 2024-09-19T09:01:21.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.182+0000 7f318ac39740 1 --2- 172.21.15.92:0/2366949306 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5640b7234d50 0x5640b7237140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:21.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.182+0000 7f318ac39740 4 client.16449 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:01:21.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.182+0000 7f318ac39740 1 -- 172.21.15.92:0/2366949306 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5640b711cd70 con 0x5640b7234d50 2024-09-19T09:01:21.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.182+0000 7f3181d9b640 1 --2- 172.21.15.92:0/2366949306 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5640b7234d50 0x5640b7237140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:21.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.182+0000 7f3181d9b640 1 --2- 172.21.15.92:0/2366949306 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5640b7234d50 0x5640b7237140 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f61333e3f51e7a74 server_cookie=da5094f2d786d7ab in_seq=0 out_seq=0 2024-09-19T09:01:21.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.182+0000 7f3169ffb640 10 client.16449 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:21.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.183+0000 7f3169ffb640 1 -- 172.21.15.92:0/2366949306 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5640b711cd70 con 0x5640b7234d50 2024-09-19T09:01:21.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.183+0000 7f3169ffb640 10 client.16449 handle_command_reply: tid=0 2024-09-19T09:01:21.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.183+0000 7f318ac39740 1 client.16449 shutdown 2024-09-19T09:01:21.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.183+0000 7f318ac39740 1 -- 172.21.15.92:0/2366949306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b71af5d0 msgr2=0x5640b71c2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:21.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.183+0000 7f318ac39740 1 --2- 172.21.15.92:0/2366949306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b71af5d0 0x5640b71c2880 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f3174046040 tx=0x7f31740ba640 comp rx=0 tx=0).stop 2024-09-19T09:01:21.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.183+0000 7f318ac39740 1 -- 172.21.15.92:0/2366949306 shutdown_connections 2024-09-19T09:01:21.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.183+0000 7f318ac39740 1 --2- 172.21.15.92:0/2366949306 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5640b7234d50 0x5640b7237140 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.183+0000 7f3169ffb640 0 client.16449 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:21.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.183+0000 7f318ac39740 1 --2- 172.21.15.92:0/2366949306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640b71ba370 0x5640b71be140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.183+0000 7f318ac39740 1 --2- 172.21.15.92:0/2366949306 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5640b71b0b40 0x5640b71bdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.183+0000 7f318ac39740 1 --2- 172.21.15.92:0/2366949306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b71af5d0 0x5640b71c2880 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.183+0000 7f318ac39740 1 -- 172.21.15.92:0/2366949306 >> 172.21.15.92:0/2366949306 conn(0x5640b7178310 msgr2=0x5640b71b5990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:21.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.183+0000 7f318ac39740 1 -- 172.21.15.92:0/2366949306 shutdown_connections 2024-09-19T09:01:21.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.183+0000 7f318ac39740 1 -- 172.21.15.92:0/2366949306 wait complete. 2024-09-19T09:01:21.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.183+0000 7f318ac39740 20 client.16449 trim_cache size 0 max 16384 2024-09-19T09:01:21.190 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-19T09:01:21.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.183+0000 7f3188860640 1 -- 172.21.15.92:0/1657495004 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f316c0a3240 msgr2=0x7f316c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:21.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.183+0000 7f3188860640 1 --2- 172.21.15.92:0/1657495004 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f316c0a3240 0x7f316c0a5700 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f318406b870 tx=0x7f317800b390 comp rx=0 tx=0).stop 2024-09-19T09:01:21.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.183+0000 7f3188860640 1 -- 172.21.15.92:0/1657495004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3184100a80 msgr2=0x7f3184198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:21.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.183+0000 7f3188860640 1 --2- 172.21.15.92:0/1657495004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3184100a80 0x7f3184198490 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f3174009230 tx=0x7f3174004270 comp rx=0 tx=0).stop 2024-09-19T09:01:21.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.183+0000 7f3188860640 1 -- 172.21.15.92:0/1657495004 shutdown_connections 2024-09-19T09:01:21.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.183+0000 7f3188860640 1 --2- 172.21.15.92:0/1657495004 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3184106a80 0x7f318419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.183+0000 7f3188860640 1 --2- 172.21.15.92:0/1657495004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3184101420 0x7f31841989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.183+0000 7f3188860640 1 --2- 172.21.15.92:0/1657495004 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f316c0a3240 0x7f316c0a5700 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.183+0000 7f3188860640 1 --2- 172.21.15.92:0/1657495004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3184100a80 0x7f3184198490 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.183+0000 7f3188860640 1 -- 172.21.15.92:0/1657495004 >> 172.21.15.92:0/1657495004 conn(0x7f31840fc7a0 msgr2=0x7f3184104830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:21.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.184+0000 7f3188860640 1 -- 172.21.15.92:0/1657495004 shutdown_connections 2024-09-19T09:01:21.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:21.184+0000 7f3188860640 1 -- 172.21.15.92:0/1657495004 wait complete. 2024-09-19T09:01:21.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:21 smithi092 ceph-mon[31407]: pgmap v476: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.0 MiB/s wr, 42 op/s 2024-09-19T09:01:21.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:21 smithi167 ceph-mon[35359]: pgmap v476: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.0 MiB/s wr, 42 op/s 2024-09-19T09:01:21.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:21 smithi190 ceph-mon[35358]: pgmap v476: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.0 MiB/s wr, 42 op/s 2024-09-19T09:01:21.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.889+0000 7f61de96d640 1 -- 172.21.15.92:0/3025657698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61d81025f0 msgr2=0x7f61d8108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:21.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.889+0000 7f61de96d640 1 --2- 172.21.15.92:0/3025657698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61d81025f0 0x7f61d8108e80 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f61d0009ca0 tx=0x7f61d002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.889+0000 7f61de96d640 1 -- 172.21.15.92:0/3025657698 shutdown_connections 2024-09-19T09:01:21.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.889+0000 7f61de96d640 1 --2- 172.21.15.92:0/3025657698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61d81025f0 0x7f61d8108e80 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.889+0000 7f61de96d640 1 --2- 172.21.15.92:0/3025657698 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61d8101c30 0x7f61d81020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.889+0000 7f61de96d640 1 --2- 172.21.15.92:0/3025657698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61d8100a40 0x7f61d8100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.889+0000 7f61de96d640 1 -- 172.21.15.92:0/3025657698 >> 172.21.15.92:0/3025657698 conn(0x7f61d80fc1e0 msgr2=0x7f61d80fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:21.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.889+0000 7f61de96d640 1 -- 172.21.15.92:0/3025657698 shutdown_connections 2024-09-19T09:01:21.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.889+0000 7f61de96d640 1 -- 172.21.15.92:0/3025657698 wait complete. 2024-09-19T09:01:21.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.889+0000 7f61de96d640 1 Processor -- start 2024-09-19T09:01:21.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.889+0000 7f61de96d640 1 -- start start 2024-09-19T09:01:21.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.890+0000 7f61de96d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61d8100a40 0x7f61d806a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.890+0000 7f61de96d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61d8101c30 0x7f61d819caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.890+0000 7f61de96d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61d81025f0 0x7f61d819f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.890+0000 7f61de96d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f61d810c6f0 con 0x7f61d8100a40 2024-09-19T09:01:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.890+0000 7f61de96d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f61d810c570 con 0x7f61d8101c30 2024-09-19T09:01:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.890+0000 7f61de96d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f61d810c870 con 0x7f61d81025f0 2024-09-19T09:01:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.890+0000 7f61d7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61d8100a40 0x7f61d806a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.890+0000 7f61d7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61d8100a40 0x7f61d806a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59152/0 (socket says 172.21.15.92:59152) 2024-09-19T09:01:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.890+0000 7f61d7fff640 1 -- 172.21.15.92:0/1035852862 learned_addr learned my addr 172.21.15.92:0/1035852862 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.890+0000 7f61dcf0a640 1 --2- 172.21.15.92:0/1035852862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61d81025f0 0x7f61d819f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.890+0000 7f61d77fe640 1 --2- 172.21.15.92:0/1035852862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61d8101c30 0x7f61d819caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.890+0000 7f61d7fff640 1 -- 172.21.15.92:0/1035852862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61d81025f0 msgr2=0x7f61d819f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.890+0000 7f61d7fff640 1 --2- 172.21.15.92:0/1035852862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61d81025f0 0x7f61d819f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.890+0000 7f61d7fff640 1 -- 172.21.15.92:0/1035852862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61d8101c30 msgr2=0x7f61d819caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:21.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.890+0000 7f61d7fff640 1 --2- 172.21.15.92:0/1035852862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61d8101c30 0x7f61d819caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.890+0000 7f61d7fff640 1 -- 172.21.15.92:0/1035852862 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d819f9d0 con 0x7f61d8100a40 2024-09-19T09:01:21.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.890+0000 7f61d7fff640 1 --2- 172.21.15.92:0/1035852862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61d8100a40 0x7f61d806a410 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f61c800d950 tx=0x7f61c800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:21.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.890+0000 7f61d57fa640 1 -- 172.21.15.92:0/1035852862 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c8017020 con 0x7f61d8100a40 2024-09-19T09:01:21.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.891+0000 7f61d57fa640 1 -- 172.21.15.92:0/1035852862 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61c8009c30 con 0x7f61d8100a40 2024-09-19T09:01:21.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.891+0000 7f61de96d640 1 -- 172.21.15.92:0/1035852862 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61d819fc60 con 0x7f61d8100a40 2024-09-19T09:01:21.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.891+0000 7f61d57fa640 1 -- 172.21.15.92:0/1035852862 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c800f740 con 0x7f61d8100a40 2024-09-19T09:01:21.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.891+0000 7f61de96d640 1 -- 172.21.15.92:0/1035852862 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61d81a01b0 con 0x7f61d8100a40 2024-09-19T09:01:21.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.894+0000 7f61d57fa640 1 -- 172.21.15.92:0/1035852862 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f61c801a020 con 0x7f61d8100a40 2024-09-19T09:01:21.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.894+0000 7f61e17e6740 1 Processor -- start 2024-09-19T09:01:21.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.894+0000 7f61e17e6740 1 -- start start 2024-09-19T09:01:21.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.894+0000 7f61e17e6740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588250a5db0 0x5588250a61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.894+0000 7f61e17e6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588250a66f0 0x5588250ab1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.894+0000 7f61e17e6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588250ab780 0x5588250adc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.894+0000 7f61e17e6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5588250052f0 con 0x5588250a66f0 2024-09-19T09:01:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.894+0000 7f61e17e6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558824fad270 con 0x5588250ab780 2024-09-19T09:01:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.894+0000 7f61e17e6740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5588250012b0 con 0x5588250a5db0 2024-09-19T09:01:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.894+0000 7f61d7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588250a66f0 0x5588250ab1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.894+0000 7f61d7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588250a66f0 0x5588250ab1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59156/0 (socket says 172.21.15.92:59156) 2024-09-19T09:01:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.894+0000 7f61d7fff640 1 -- 172.21.15.92:0/997682474 learned_addr learned my addr 172.21.15.92:0/997682474 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.894+0000 7f61d77fe640 1 --2- 172.21.15.92:0/997682474 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588250ab780 0x5588250adc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.894+0000 7f61dcf0a640 1 --2- 172.21.15.92:0/997682474 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588250a5db0 0x5588250a61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.894+0000 7f61d57fa640 1 --2- 172.21.15.92:0/1035852862 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f61c00a32f0 0x7f61c00a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.895+0000 7f61dcf0a640 1 --2- 172.21.15.92:0/1035852862 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f61c00a32f0 0x7f61c00a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.895+0000 7f61d7fff640 1 -- 172.21.15.92:0/997682474 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588250a5db0 msgr2=0x5588250a61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:21.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.895+0000 7f61d7fff640 1 --2- 172.21.15.92:0/997682474 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588250a5db0 0x5588250a61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.895+0000 7f61d7fff640 1 -- 172.21.15.92:0/997682474 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588250ab780 msgr2=0x5588250adc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:21.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.895+0000 7f61d7fff640 1 --2- 172.21.15.92:0/997682474 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588250ab780 0x5588250adc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.895+0000 7f61d57fa640 1 -- 172.21.15.92:0/1035852862 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f61c80cf330 con 0x7f61d8100a40 2024-09-19T09:01:21.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.895+0000 7f61d7fff640 1 -- 172.21.15.92:0/997682474 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558824fac340 con 0x5588250a66f0 2024-09-19T09:01:21.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.895+0000 7f61d77fe640 1 --2- 172.21.15.92:0/997682474 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588250ab780 0x5588250adc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:21.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.895+0000 7f61d7fff640 1 --2- 172.21.15.92:0/997682474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588250a66f0 0x5588250ab1b0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f61c8098320 tx=0x7f61c800bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7db2d1cad745fb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:21.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.895+0000 7f61dcf0a640 1 --2- 172.21.15.92:0/1035852862 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f61c00a32f0 0x7f61c00a57b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f61d0005e30 tx=0x7f61d002a8c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:21.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.895+0000 7f61be7fc640 1 -- 172.21.15.92:0/997682474 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c8009de0 con 0x5588250a66f0 2024-09-19T09:01:21.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.895+0000 7f61be7fc640 1 -- 172.21.15.92:0/997682474 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61c809c050 con 0x5588250a66f0 2024-09-19T09:01:21.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.895+0000 7f61be7fc640 1 -- 172.21.15.92:0/997682474 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c8099ce0 con 0x5588250a66f0 2024-09-19T09:01:21.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.896+0000 7f61e17e6740 1 -- 172.21.15.92:0/997682474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588250a66f0 msgr2=0x5588250ab1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:21.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.896+0000 7f61e17e6740 1 --2- 172.21.15.92:0/997682474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588250a66f0 0x5588250ab1b0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f61c8098320 tx=0x7f61c800bf60 comp rx=0 tx=0).stop 2024-09-19T09:01:21.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.896+0000 7f61e17e6740 1 -- 172.21.15.92:0/997682474 shutdown_connections 2024-09-19T09:01:21.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.896+0000 7f61e17e6740 1 --2- 172.21.15.92:0/997682474 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588250ab780 0x5588250adc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.896+0000 7f61e17e6740 1 --2- 172.21.15.92:0/997682474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588250a66f0 0x5588250ab1b0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.896+0000 7f61e17e6740 1 --2- 172.21.15.92:0/997682474 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588250a5db0 0x5588250a61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.896+0000 7f61e17e6740 1 -- 172.21.15.92:0/997682474 >> 172.21.15.92:0/997682474 conn(0x5588250a1420 msgr2=0x5588250a1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:21.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.896+0000 7f61e17e6740 1 -- 172.21.15.92:0/997682474 shutdown_connections 2024-09-19T09:01:21.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.896+0000 7f61e17e6740 1 -- 172.21.15.92:0/997682474 wait complete. 2024-09-19T09:01:21.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.896+0000 7f61e17e6740 1 -- start start 2024-09-19T09:01:21.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.897+0000 7f61e17e6740 1 Processor -- start 2024-09-19T09:01:21.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.897+0000 7f61e17e6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588250a5db0 0x5588250aff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:21.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.897+0000 7f61e17e6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588250a66f0 0x5588250b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:21.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.897+0000 7f61e17e6740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588250ab780 0x5588250b7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:21.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.897+0000 7f61e17e6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5588250ae690 con 0x5588250a66f0 2024-09-19T09:01:21.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.897+0000 7f61e17e6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558824f8e290 con 0x5588250a5db0 2024-09-19T09:01:21.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.897+0000 7f61e17e6740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5588250ae810 con 0x5588250ab780 2024-09-19T09:01:21.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.897+0000 7f61e17e6740 10 client.0 _ll_register_callbacks cb 0x558824fbf140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:21.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.897+0000 7f61d77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588250a66f0 0x5588250b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:21.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.897+0000 7f61d77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588250a66f0 0x5588250b04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59158/0 (socket says 172.21.15.92:59158) 2024-09-19T09:01:21.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.897+0000 7f61d77fe640 1 -- 172.21.15.92:0/1940142636 learned_addr learned my addr 172.21.15.92:0/1940142636 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:21.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.897+0000 7f61d7fff640 1 --2- 172.21.15.92:0/1940142636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588250a5db0 0x5588250aff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:21.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.897+0000 7f61dcf0a640 1 --2- 172.21.15.92:0/1940142636 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588250ab780 0x5588250b7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:21.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.897+0000 7f61d77fe640 1 -- 172.21.15.92:0/1940142636 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588250ab780 msgr2=0x5588250b7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:21.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.897+0000 7f61d77fe640 1 --2- 172.21.15.92:0/1940142636 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588250ab780 0x5588250b7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.897+0000 7f61d77fe640 1 -- 172.21.15.92:0/1940142636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588250a5db0 msgr2=0x5588250aff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:21.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.897+0000 7f61d77fe640 1 --2- 172.21.15.92:0/1940142636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588250a5db0 0x5588250aff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.897+0000 7f61d77fe640 1 -- 172.21.15.92:0/1940142636 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558824d18210 con 0x5588250a66f0 2024-09-19T09:01:21.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.897+0000 7f61d7fff640 1 --2- 172.21.15.92:0/1940142636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588250a5db0 0x5588250aff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:01:21.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.897+0000 7f61d77fe640 1 --2- 172.21.15.92:0/1940142636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588250a66f0 0x5588250b04b0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f61cc012700 tx=0x7f61cc012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=369f69f9dd504b98 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:21.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.897+0000 7f61b77fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:01:21.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.898+0000 7f61b77fe640 1 -- 172.21.15.92:0/1940142636 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61cc011bb0 con 0x5588250a66f0 2024-09-19T09:01:21.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.898+0000 7f61b77fe640 1 -- 172.21.15.92:0/1940142636 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f61cc011d50 con 0x5588250a66f0 2024-09-19T09:01:21.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.898+0000 7f61e17e6740 1 -- 172.21.15.92:0/1940142636 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61c809c050 con 0x5588250a66f0 2024-09-19T09:01:21.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.898+0000 7f61b77fe640 1 -- 172.21.15.92:0/1940142636 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f61cc00f460 con 0x5588250a66f0 2024-09-19T09:01:21.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.898+0000 7f61e17e6740 10 client.16461 fetch_fsmap learned FSMap version 19 2024-09-19T09:01:21.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.898+0000 7f61e17e6740 1 -- 172.21.15.92:0/1940142636 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x558824de4620 con 0x5588250a66f0 2024-09-19T09:01:21.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.898+0000 7f61b77fe640 1 -- 172.21.15.92:0/1940142636 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61c809c050 con 0x5588250a66f0 2024-09-19T09:01:21.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.898+0000 7f61b77fe640 1 -- 172.21.15.92:0/1940142636 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f61cc01c780 con 0x5588250a66f0 2024-09-19T09:01:21.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.898+0000 7f61e17e6740 10 client.16461 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:01:21.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.898+0000 7f61e17e6740 10 client.16461 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:01:21.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.898+0000 7f61e17e6740 20 client.16461 populate_metadata read hostname 'smithi092' 2024-09-19T09:01:21.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.898+0000 7f61e17e6740 1 --2- 172.21.15.92:0/1940142636 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5588250bbba0 0x5588250bdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:21.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.898+0000 7f61e17e6740 4 client.16461 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:01:21.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.898+0000 7f61e17e6740 1 -- 172.21.15.92:0/1940142636 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558825012a20 con 0x5588250bbba0 2024-09-19T09:01:21.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.899+0000 7f61d7fff640 1 --2- 172.21.15.92:0/1940142636 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5588250bbba0 0x5588250bdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:21.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.899+0000 7f61b77fe640 10 client.16461 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:21.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.899+0000 7f61d7fff640 1 --2- 172.21.15.92:0/1940142636 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5588250bbba0 0x5588250bdff0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd9b3017387bc391 server_cookie=d4a29bf02cd04df9 in_seq=0 out_seq=0 2024-09-19T09:01:21.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.900+0000 7f61b77fe640 1 -- 172.21.15.92:0/1940142636 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558825012a20 con 0x5588250bbba0 2024-09-19T09:01:21.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.900+0000 7f61b77fe640 10 client.16461 handle_command_reply: tid=0 2024-09-19T09:01:21.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.900+0000 7f61e17e6740 1 client.16461 shutdown 2024-09-19T09:01:21.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.900+0000 7f61e17e6740 1 -- 172.21.15.92:0/1940142636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588250a66f0 msgr2=0x5588250b04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:21.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.900+0000 7f61e17e6740 1 --2- 172.21.15.92:0/1940142636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588250a66f0 0x5588250b04b0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f61cc012700 tx=0x7f61cc012bc0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.900+0000 7f61e17e6740 1 -- 172.21.15.92:0/1940142636 shutdown_connections 2024-09-19T09:01:21.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.900+0000 7f61e17e6740 1 --2- 172.21.15.92:0/1940142636 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5588250bbba0 0x5588250bdff0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.900+0000 7f61e17e6740 1 --2- 172.21.15.92:0/1940142636 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588250ab780 0x5588250b7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.900+0000 7f61e17e6740 1 --2- 172.21.15.92:0/1940142636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588250a66f0 0x5588250b04b0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.900+0000 7f61b77fe640 0 client.16461 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:21.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.900+0000 7f61e17e6740 1 --2- 172.21.15.92:0/1940142636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588250a5db0 0x5588250aff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.900+0000 7f61e17e6740 1 -- 172.21.15.92:0/1940142636 >> 172.21.15.92:0/1940142636 conn(0x5588250a1420 msgr2=0x55882509c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:21.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.900+0000 7f61e17e6740 1 -- 172.21.15.92:0/1940142636 shutdown_connections 2024-09-19T09:01:21.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.900+0000 7f61e17e6740 1 -- 172.21.15.92:0/1940142636 wait complete. 2024-09-19T09:01:21.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.900+0000 7f61e17e6740 20 client.16461 trim_cache size 0 max 16384 2024-09-19T09:01:21.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.925+0000 7f61e17e6740 1 Processor -- start 2024-09-19T09:01:21.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.925+0000 7f61e17e6740 1 -- start start 2024-09-19T09:01:21.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.925+0000 7f61e17e6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588250a5db0 0x5588250af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:21.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.925+0000 7f61e17e6740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588250a66f0 0x5588250b7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:21.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.925+0000 7f61e17e6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588250ab780 0x55882509c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:21.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.925+0000 7f61e17e6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f61d81a4de0 con 0x5588250a5db0 2024-09-19T09:01:21.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.925+0000 7f61e17e6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f61d81a7680 con 0x5588250ab780 2024-09-19T09:01:21.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.925+0000 7f61e17e6740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f61d81a5470 con 0x5588250a66f0 2024-09-19T09:01:21.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.926+0000 7f61d7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588250a5db0 0x5588250af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:21.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.926+0000 7f61d7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588250a5db0 0x5588250af4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59174/0 (socket says 172.21.15.92:59174) 2024-09-19T09:01:21.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.926+0000 7f61d7fff640 1 -- 172.21.15.92:0/670627169 learned_addr learned my addr 172.21.15.92:0/670627169 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:21.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.926+0000 7f61d77fe640 1 --2- 172.21.15.92:0/670627169 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588250a66f0 0x5588250b7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:21.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.926+0000 7f61dcf0a640 1 --2- 172.21.15.92:0/670627169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588250ab780 0x55882509c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:21.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.926+0000 7f61d7fff640 1 -- 172.21.15.92:0/670627169 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588250a66f0 msgr2=0x5588250b7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:21.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.926+0000 7f61d7fff640 1 --2- 172.21.15.92:0/670627169 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588250a66f0 0x5588250b7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.926+0000 7f61d7fff640 1 -- 172.21.15.92:0/670627169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588250ab780 msgr2=0x55882509c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:21.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.926+0000 7f61d7fff640 1 --2- 172.21.15.92:0/670627169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588250ab780 0x55882509c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.926+0000 7f61d7fff640 1 -- 172.21.15.92:0/670627169 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588250aef40 con 0x5588250a5db0 2024-09-19T09:01:21.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.926+0000 7f61d7fff640 1 --2- 172.21.15.92:0/670627169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588250a5db0 0x5588250af4d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f61c8097db0 tx=0x7f61c80d2db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc6bcfe74290aff2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:21.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.926+0000 7f61bdffb640 1 -- 172.21.15.92:0/670627169 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c80b3020 con 0x5588250a5db0 2024-09-19T09:01:21.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.926+0000 7f61bdffb640 1 -- 172.21.15.92:0/670627169 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61c809c050 con 0x5588250a5db0 2024-09-19T09:01:21.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.926+0000 7f61bdffb640 1 -- 172.21.15.92:0/670627169 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c80cceb0 con 0x5588250a5db0 2024-09-19T09:01:21.931 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.927+0000 7f61e17e6740 1 -- 172.21.15.92:0/670627169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588250a5db0 msgr2=0x5588250af4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:21.931 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.927+0000 7f61e17e6740 1 --2- 172.21.15.92:0/670627169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588250a5db0 0x5588250af4d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f61c8097db0 tx=0x7f61c80d2db0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.931 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.927+0000 7f61e17e6740 1 -- 172.21.15.92:0/670627169 shutdown_connections 2024-09-19T09:01:21.931 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.927+0000 7f61e17e6740 1 --2- 172.21.15.92:0/670627169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588250ab780 0x55882509c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.927+0000 7f61e17e6740 1 --2- 172.21.15.92:0/670627169 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588250a66f0 0x5588250b7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.927+0000 7f61e17e6740 1 --2- 172.21.15.92:0/670627169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588250a5db0 0x5588250af4d0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.927+0000 7f61e17e6740 1 -- 172.21.15.92:0/670627169 >> 172.21.15.92:0/670627169 conn(0x5588250a1420 msgr2=0x55882509b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.927+0000 7f61e17e6740 1 -- 172.21.15.92:0/670627169 shutdown_connections 2024-09-19T09:01:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.927+0000 7f61e17e6740 1 -- 172.21.15.92:0/670627169 wait complete. 2024-09-19T09:01:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.927+0000 7f61e17e6740 1 -- start start 2024-09-19T09:01:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.928+0000 7f61e17e6740 1 Processor -- start 2024-09-19T09:01:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.928+0000 7f61e17e6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588250a5db0 0x5588250b4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.928+0000 7f61e17e6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588250a66f0 0x5588250b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.928+0000 7f61e17e6740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588250ab780 0x5588250b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.928+0000 7f61e17e6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f61d81a5b40 con 0x5588250a5db0 2024-09-19T09:01:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.928+0000 7f61e17e6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f61d81a6fb0 con 0x5588250a66f0 2024-09-19T09:01:21.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.928+0000 7f61e17e6740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f61d81a6210 con 0x5588250ab780 2024-09-19T09:01:21.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.928+0000 7f61e17e6740 10 client.0 _ll_register_callbacks cb 0x7f61cc009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:21.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.928+0000 7f61d7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588250a5db0 0x5588250b4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:21.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.928+0000 7f61d7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588250a5db0 0x5588250b4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59180/0 (socket says 172.21.15.92:59180) 2024-09-19T09:01:21.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.928+0000 7f61d7fff640 1 -- 172.21.15.92:0/2753329193 learned_addr learned my addr 172.21.15.92:0/2753329193 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:21.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.928+0000 7f61dcf0a640 1 --2- 172.21.15.92:0/2753329193 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588250ab780 0x5588250b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:21.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.928+0000 7f61d77fe640 1 --2- 172.21.15.92:0/2753329193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588250a66f0 0x5588250b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:21.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.928+0000 7f61d7fff640 1 -- 172.21.15.92:0/2753329193 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588250ab780 msgr2=0x5588250b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:21.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.928+0000 7f61d7fff640 1 --2- 172.21.15.92:0/2753329193 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588250ab780 0x5588250b5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.928+0000 7f61d7fff640 1 -- 172.21.15.92:0/2753329193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588250a66f0 msgr2=0x5588250b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:21.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.928+0000 7f61d7fff640 1 --2- 172.21.15.92:0/2753329193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588250a66f0 0x5588250b4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.928+0000 7f61d7fff640 1 -- 172.21.15.92:0/2753329193 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588250b60b0 con 0x5588250a5db0 2024-09-19T09:01:21.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.928+0000 7f61d7fff640 1 --2- 172.21.15.92:0/2753329193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588250a5db0 0x5588250b4550 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f61c809b8e0 tx=0x7f61c800bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f93f04fd4bcc92b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:21.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.928+0000 7f61b77fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:01:21.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.928+0000 7f61b77fe640 1 -- 172.21.15.92:0/2753329193 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c80b3050 con 0x5588250a5db0 2024-09-19T09:01:21.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.928+0000 7f61e17e6740 1 -- 172.21.15.92:0/2753329193 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61c809c050 con 0x5588250a5db0 2024-09-19T09:01:21.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.928+0000 7f61b77fe640 1 -- 172.21.15.92:0/2753329193 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f61c80ba2b0 con 0x5588250a5db0 2024-09-19T09:01:21.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.929+0000 7f61b77fe640 1 -- 172.21.15.92:0/2753329193 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f61c801adf0 con 0x5588250a5db0 2024-09-19T09:01:21.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.929+0000 7f61e17e6740 10 client.16467 fetch_fsmap learned FSMap version 19 2024-09-19T09:01:21.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.929+0000 7f61e17e6740 1 -- 172.21.15.92:0/2753329193 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5588250b73c0 con 0x5588250a5db0 2024-09-19T09:01:21.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.929+0000 7f61b77fe640 1 -- 172.21.15.92:0/2753329193 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61c809c050 con 0x5588250a5db0 2024-09-19T09:01:21.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.929+0000 7f61b77fe640 1 -- 172.21.15.92:0/2753329193 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f61c80ce020 con 0x5588250a5db0 2024-09-19T09:01:21.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.929+0000 7f61e17e6740 10 client.16467 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:01:21.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.929+0000 7f61e17e6740 10 client.16467 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:01:21.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.929+0000 7f61e17e6740 20 client.16467 populate_metadata read hostname 'smithi092' 2024-09-19T09:01:21.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.929+0000 7f61e17e6740 1 --2- 172.21.15.92:0/2753329193 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5588250bbba0 0x5588251288e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:21.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.929+0000 7f61e17e6740 4 client.16467 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:01:21.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.929+0000 7f61e17e6740 1 -- 172.21.15.92:0/2753329193 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55882500cd70 con 0x5588250bbba0 2024-09-19T09:01:21.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.929+0000 7f61d77fe640 1 --2- 172.21.15.92:0/2753329193 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5588250bbba0 0x5588251288e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:21.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.930+0000 7f61b77fe640 10 client.16467 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:21.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.930+0000 7f61d77fe640 1 --2- 172.21.15.92:0/2753329193 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5588250bbba0 0x5588251288e0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6089b3b15ec32f6e server_cookie=7b6ce34065c578fe in_seq=0 out_seq=0 2024-09-19T09:01:21.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.939+0000 7f61b77fe640 1 -- 172.21.15.92:0/2753329193 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55882500cd70 con 0x5588250bbba0 2024-09-19T09:01:21.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.939+0000 7f61b77fe640 10 client.16467 handle_command_reply: tid=0 2024-09-19T09:01:21.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.939+0000 7f61e17e6740 1 client.16467 shutdown 2024-09-19T09:01:21.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.940+0000 7f61e17e6740 1 -- 172.21.15.92:0/2753329193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588250a5db0 msgr2=0x5588250b4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:21.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.940+0000 7f61e17e6740 1 --2- 172.21.15.92:0/2753329193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588250a5db0 0x5588250b4550 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f61c809b8e0 tx=0x7f61c800bf60 comp rx=0 tx=0).stop 2024-09-19T09:01:21.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.940+0000 7f61e17e6740 1 -- 172.21.15.92:0/2753329193 shutdown_connections 2024-09-19T09:01:21.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.940+0000 7f61e17e6740 1 --2- 172.21.15.92:0/2753329193 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5588250bbba0 0x5588251288e0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.940+0000 7f61e17e6740 1 --2- 172.21.15.92:0/2753329193 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588250ab780 0x5588250b5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.940+0000 7f61e17e6740 1 --2- 172.21.15.92:0/2753329193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588250a66f0 0x5588250b4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.940+0000 7f61b77fe640 0 client.16467 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:21.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.940+0000 7f61e17e6740 1 --2- 172.21.15.92:0/2753329193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588250a5db0 0x5588250b4550 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.940+0000 7f61e17e6740 1 -- 172.21.15.92:0/2753329193 >> 172.21.15.92:0/2753329193 conn(0x5588250a1420 msgr2=0x55882509c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:21.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.940+0000 7f61e17e6740 1 -- 172.21.15.92:0/2753329193 shutdown_connections 2024-09-19T09:01:21.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.940+0000 7f61e17e6740 1 -- 172.21.15.92:0/2753329193 wait complete. 2024-09-19T09:01:21.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.940+0000 7f61e17e6740 20 client.16467 trim_cache size 0 max 16384 2024-09-19T09:01:21.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:01:21.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:01:21.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:01:21.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:01:21.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.940+0000 7f61de96d640 1 -- 172.21.15.92:0/1035852862 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f61c00a32f0 msgr2=0x7f61c00a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:21.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.940+0000 7f61de96d640 1 --2- 172.21.15.92:0/1035852862 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f61c00a32f0 0x7f61c00a57b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f61d0005e30 tx=0x7f61d002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.940+0000 7f61de96d640 1 -- 172.21.15.92:0/1035852862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61d8100a40 msgr2=0x7f61d806a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:21.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.940+0000 7f61de96d640 1 --2- 172.21.15.92:0/1035852862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61d8100a40 0x7f61d806a410 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f61c800d950 tx=0x7f61c800de10 comp rx=0 tx=0).stop 2024-09-19T09:01:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.940+0000 7f61de96d640 1 -- 172.21.15.92:0/1035852862 shutdown_connections 2024-09-19T09:01:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.940+0000 7f61de96d640 1 --2- 172.21.15.92:0/1035852862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61d81025f0 0x7f61d819f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.940+0000 7f61de96d640 1 --2- 172.21.15.92:0/1035852862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61d8101c30 0x7f61d819caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.940+0000 7f61de96d640 1 --2- 172.21.15.92:0/1035852862 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f61c00a32f0 0x7f61c00a57b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.940+0000 7f61de96d640 1 --2- 172.21.15.92:0/1035852862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61d8100a40 0x7f61d806a410 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.940+0000 7f61de96d640 1 -- 172.21.15.92:0/1035852862 >> 172.21.15.92:0/1035852862 conn(0x7f61d80fc1e0 msgr2=0x7f61d8104ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.940+0000 7f61de96d640 1 -- 172.21.15.92:0/1035852862 shutdown_connections 2024-09-19T09:01:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:21.941+0000 7f61de96d640 1 -- 172.21.15.92:0/1035852862 wait complete. 2024-09-19T09:01:22.821 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:01:22.924 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:01:22.925 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:01:23.084 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:23.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.528+0000 7f23150df640 1 -- 172.21.15.92:0/158904639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2310102ef0 msgr2=0x7f231010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:23.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.528+0000 7f23150df640 1 --2- 172.21.15.92:0/158904639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2310102ef0 0x7f231010da40 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f2308009ca0 tx=0x7f230802a950 comp rx=0 tx=0).stop 2024-09-19T09:01:23.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.528+0000 7f23150df640 1 -- 172.21.15.92:0/158904639 shutdown_connections 2024-09-19T09:01:23.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.528+0000 7f23150df640 1 --2- 172.21.15.92:0/158904639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2310102ef0 0x7f231010da40 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:23.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.528+0000 7f23150df640 1 --2- 172.21.15.92:0/158904639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2310102570 0x7f23101029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:23.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.528+0000 7f23150df640 1 --2- 172.21.15.92:0/158904639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2310100e20 0x7f2310101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:23.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.528+0000 7f23150df640 1 -- 172.21.15.92:0/158904639 >> 172.21.15.92:0/158904639 conn(0x7f23100fc7d0 msgr2=0x7f23100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:23.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.528+0000 7f23150df640 1 -- 172.21.15.92:0/158904639 shutdown_connections 2024-09-19T09:01:23.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.528+0000 7f23150df640 1 -- 172.21.15.92:0/158904639 wait complete. 2024-09-19T09:01:23.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.529+0000 7f23150df640 1 Processor -- start 2024-09-19T09:01:23.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.529+0000 7f23150df640 1 -- start start 2024-09-19T09:01:23.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.529+0000 7f23150df640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2310100e20 0x7f23101973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:23.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.529+0000 7f23150df640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2310102570 0x7f2310197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:23.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.529+0000 7f23150df640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2310102ef0 0x7f231019bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:23.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.529+0000 7f23150df640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2310110fa0 con 0x7f2310100e20 2024-09-19T09:01:23.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.529+0000 7f23150df640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2310110e20 con 0x7f2310102ef0 2024-09-19T09:01:23.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.529+0000 7f23150df640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2310111120 con 0x7f2310102570 2024-09-19T09:01:23.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.529+0000 7f230ed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2310100e20 0x7f23101973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:23.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.530+0000 7f230ed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2310100e20 0x7f23101973e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59208/0 (socket says 172.21.15.92:59208) 2024-09-19T09:01:23.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.530+0000 7f230ed9d640 1 -- 172.21.15.92:0/942036221 learned_addr learned my addr 172.21.15.92:0/942036221 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:23.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.530+0000 7f230f59e640 1 --2- 172.21.15.92:0/942036221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2310102ef0 0x7f231019bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:23.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.530+0000 7f230e59c640 1 --2- 172.21.15.92:0/942036221 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2310102570 0x7f2310197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:23.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.530+0000 7f230ed9d640 1 -- 172.21.15.92:0/942036221 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2310102570 msgr2=0x7f2310197920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:23.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.530+0000 7f230ed9d640 1 --2- 172.21.15.92:0/942036221 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2310102570 0x7f2310197920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:23.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.530+0000 7f230ed9d640 1 -- 172.21.15.92:0/942036221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2310102ef0 msgr2=0x7f231019bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:23.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.530+0000 7f230ed9d640 1 --2- 172.21.15.92:0/942036221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2310102ef0 0x7f231019bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:23.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.530+0000 7f230ed9d640 1 -- 172.21.15.92:0/942036221 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f231019c390 con 0x7f2310100e20 2024-09-19T09:01:23.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.530+0000 7f230ed9d640 1 --2- 172.21.15.92:0/942036221 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2310100e20 0x7f23101973e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f2300009970 tx=0x7f2300009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:23.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.530+0000 7f22f7fff640 1 -- 172.21.15.92:0/942036221 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230000d020 con 0x7f2310100e20 2024-09-19T09:01:23.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.530+0000 7f22f7fff640 1 -- 172.21.15.92:0/942036221 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f230000d1c0 con 0x7f2310100e20 2024-09-19T09:01:23.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.530+0000 7f22f7fff640 1 -- 172.21.15.92:0/942036221 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230000cc10 con 0x7f2310100e20 2024-09-19T09:01:23.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.531+0000 7f23150df640 1 -- 172.21.15.92:0/942036221 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f231019c680 con 0x7f2310100e20 2024-09-19T09:01:23.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.531+0000 7f23150df640 1 -- 172.21.15.92:0/942036221 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2310069f70 con 0x7f2310100e20 2024-09-19T09:01:23.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.532+0000 7f23150df640 1 -- 172.21.15.92:0/942036221 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2310101200 con 0x7f2310100e20 2024-09-19T09:01:23.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.533+0000 7f22f7fff640 1 -- 172.21.15.92:0/942036221 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f23000077a0 con 0x7f2310100e20 2024-09-19T09:01:23.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.534+0000 7f22f7fff640 1 --2- 172.21.15.92:0/942036221 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f22f80a32c0 0x7f22f80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:23.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.534+0000 7f230e59c640 1 --2- 172.21.15.92:0/942036221 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f22f80a32c0 0x7f22f80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:23.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.534+0000 7f22f7fff640 1 -- 172.21.15.92:0/942036221 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f23000d0c90 con 0x7f2310100e20 2024-09-19T09:01:23.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.534+0000 7f230e59c640 1 --2- 172.21.15.92:0/942036221 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f22f80a32c0 0x7f22f80a5780 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f23100fec10 tx=0x7f2304009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:23.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.538+0000 7f22f7fff640 1 -- 172.21.15.92:0/942036221 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f230009d9b0 con 0x7f2310100e20 2024-09-19T09:01:23.560 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:23.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.748+0000 7f23150df640 1 -- 172.21.15.92:0/942036221 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f231006a1d0 con 0x7f2310100e20 2024-09-19T09:01:23.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:23 smithi092 ceph-mon[31407]: pgmap v477: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 930 KiB/s wr, 35 op/s 2024-09-19T09:01:23.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.748+0000 7f22f7fff640 1 -- 172.21.15.92:0/942036221 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f2300097e20 con 0x7f2310100e20 2024-09-19T09:01:23.749 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:01:23.749 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:01:23.749 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:01:23.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.751+0000 7f23150df640 1 -- 172.21.15.92:0/942036221 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f22f80a32c0 msgr2=0x7f22f80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:23.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.751+0000 7f23150df640 1 --2- 172.21.15.92:0/942036221 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f22f80a32c0 0x7f22f80a5780 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f23100fec10 tx=0x7f2304009110 comp rx=0 tx=0).stop 2024-09-19T09:01:23.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.751+0000 7f23150df640 1 -- 172.21.15.92:0/942036221 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2310100e20 msgr2=0x7f23101973e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:23.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.751+0000 7f23150df640 1 --2- 172.21.15.92:0/942036221 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2310100e20 0x7f23101973e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f2300009970 tx=0x7f2300009d70 comp rx=0 tx=0).stop 2024-09-19T09:01:23.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.751+0000 7f23150df640 1 -- 172.21.15.92:0/942036221 shutdown_connections 2024-09-19T09:01:23.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.751+0000 7f23150df640 1 --2- 172.21.15.92:0/942036221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2310102ef0 0x7f231019bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:23.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.751+0000 7f23150df640 1 --2- 172.21.15.92:0/942036221 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2310102570 0x7f2310197920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:23.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.751+0000 7f23150df640 1 --2- 172.21.15.92:0/942036221 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f22f80a32c0 0x7f22f80a5780 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:23.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.751+0000 7f23150df640 1 --2- 172.21.15.92:0/942036221 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2310100e20 0x7f23101973e0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:23.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.751+0000 7f23150df640 1 -- 172.21.15.92:0/942036221 >> 172.21.15.92:0/942036221 conn(0x7f23100fc7d0 msgr2=0x7f2310106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:23.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.751+0000 7f23150df640 1 -- 172.21.15.92:0/942036221 shutdown_connections 2024-09-19T09:01:23.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:23.751+0000 7f23150df640 1 -- 172.21.15.92:0/942036221 wait complete. 2024-09-19T09:01:23.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:23 smithi167 ceph-mon[35359]: pgmap v477: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 930 KiB/s wr, 35 op/s 2024-09-19T09:01:23.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:23 smithi190 ceph-mon[35358]: pgmap v477: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 930 KiB/s wr, 35 op/s 2024-09-19T09:01:24.431 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id 73785ebf --release --await' 2024-09-19T09:01:24.431 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id 73785ebf --release --await 2024-09-19T09:01:24.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.628+0000 7f0c565b3640 1 -- 172.21.15.92:0/2298099358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c50106f20 msgr2=0x7f0c5010eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:24.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.628+0000 7f0c565b3640 1 --2- 172.21.15.92:0/2298099358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c50106f20 0x7f0c5010eaa0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f0c48009ca0 tx=0x7f0c4802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.628+0000 7f0c565b3640 1 -- 172.21.15.92:0/2298099358 shutdown_connections 2024-09-19T09:01:24.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.628+0000 7f0c565b3640 1 --2- 172.21.15.92:0/2298099358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c50106f20 0x7f0c5010eaa0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.628+0000 7f0c565b3640 1 --2- 172.21.15.92:0/2298099358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c501027a0 0x7f0c501067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.628+0000 7f0c565b3640 1 --2- 172.21.15.92:0/2298099358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c50101df0 0x7f0c501021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.628+0000 7f0c565b3640 1 -- 172.21.15.92:0/2298099358 >> 172.21.15.92:0/2298099358 conn(0x7f0c500fd8f0 msgr2=0x7f0c500ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:24.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.628+0000 7f0c565b3640 1 -- 172.21.15.92:0/2298099358 shutdown_connections 2024-09-19T09:01:24.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.628+0000 7f0c565b3640 1 -- 172.21.15.92:0/2298099358 wait complete. 2024-09-19T09:01:24.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.629+0000 7f0c565b3640 1 Processor -- start 2024-09-19T09:01:24.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.629+0000 7f0c565b3640 1 -- start start 2024-09-19T09:01:24.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.629+0000 7f0c565b3640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c50101df0 0x7f0c50198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:24.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.629+0000 7f0c565b3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c501027a0 0x7f0c50198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:24.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.629+0000 7f0c565b3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c50106f20 0x7f0c5019ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:24.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.629+0000 7f0c565b3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0c50111f80 con 0x7f0c501027a0 2024-09-19T09:01:24.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.629+0000 7f0c565b3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0c50111e00 con 0x7f0c50106f20 2024-09-19T09:01:24.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.629+0000 7f0c565b3640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0c50112100 con 0x7f0c50101df0 2024-09-19T09:01:24.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.629+0000 7f0c4f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c501027a0 0x7f0c50198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:24.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.629+0000 7f0c4f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c501027a0 0x7f0c50198940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59224/0 (socket says 172.21.15.92:59224) 2024-09-19T09:01:24.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.629+0000 7f0c4f7fe640 1 -- 172.21.15.92:0/701321709 learned_addr learned my addr 172.21.15.92:0/701321709 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:24.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.629+0000 7f0c4ffff640 1 --2- 172.21.15.92:0/701321709 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c50101df0 0x7f0c50198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:24.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.629+0000 7f0c54b50640 1 --2- 172.21.15.92:0/701321709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c50106f20 0x7f0c5019ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:24.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.630+0000 7f0c4f7fe640 1 -- 172.21.15.92:0/701321709 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c50101df0 msgr2=0x7f0c50198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:24.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.630+0000 7f0c4f7fe640 1 --2- 172.21.15.92:0/701321709 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c50101df0 0x7f0c50198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.630+0000 7f0c4f7fe640 1 -- 172.21.15.92:0/701321709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c50106f20 msgr2=0x7f0c5019ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:24.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.630+0000 7f0c4f7fe640 1 --2- 172.21.15.92:0/701321709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c50106f20 0x7f0c5019ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.630+0000 7f0c4f7fe640 1 -- 172.21.15.92:0/701321709 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c5019d3b0 con 0x7f0c501027a0 2024-09-19T09:01:24.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.630+0000 7f0c4f7fe640 1 --2- 172.21.15.92:0/701321709 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c501027a0 0x7f0c50198940 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f0c4400e9f0 tx=0x7f0c4400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:24.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.630+0000 7f0c4d7fa640 1 -- 172.21.15.92:0/701321709 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4400cd80 con 0x7f0c501027a0 2024-09-19T09:01:24.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.630+0000 7f0c565b3640 1 -- 172.21.15.92:0/701321709 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c5019d6a0 con 0x7f0c501027a0 2024-09-19T09:01:24.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.630+0000 7f0c4d7fa640 1 -- 172.21.15.92:0/701321709 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c44005500 con 0x7f0c501027a0 2024-09-19T09:01:24.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.630+0000 7f0c4d7fa640 1 -- 172.21.15.92:0/701321709 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c44010690 con 0x7f0c501027a0 2024-09-19T09:01:24.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.630+0000 7f0c565b3640 1 -- 172.21.15.92:0/701321709 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c501a4f80 con 0x7f0c501027a0 2024-09-19T09:01:24.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.632+0000 7f0c4d7fa640 1 -- 172.21.15.92:0/701321709 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0c440046c0 con 0x7f0c501027a0 2024-09-19T09:01:24.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.633+0000 7f0c5898c740 1 Processor -- start 2024-09-19T09:01:24.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.633+0000 7f0c5898c740 1 -- start start 2024-09-19T09:01:24.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.633+0000 7f0c4d7fa640 1 --2- 172.21.15.92:0/701321709 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f0c380a3240 0x7f0c380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:24.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.633+0000 7f0c54b50640 1 --2- 172.21.15.92:0/701321709 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f0c380a3240 0x7f0c380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:24.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.633+0000 7f0c4d7fa640 1 -- 172.21.15.92:0/701321709 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f0c440cfcf0 con 0x7f0c501027a0 2024-09-19T09:01:24.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.633+0000 7f0c5898c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8e3bcba20 0x55d8e3bcbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:24.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.633+0000 7f0c5898c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8e3bcc340 0x55d8e3bdac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:24.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.633+0000 7f0c5898c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8e3bdb150 0x55d8e3bdd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:24.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.633+0000 7f0c5898c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d8e3b31280 con 0x55d8e3bdb150 2024-09-19T09:01:24.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.633+0000 7f0c5898c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d8e3ad8b10 con 0x55d8e3bcba20 2024-09-19T09:01:24.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.633+0000 7f0c5898c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55d8e3b2d240 con 0x55d8e3bcc340 2024-09-19T09:01:24.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.634+0000 7f0c4ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8e3bcba20 0x55d8e3bcbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:24.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.634+0000 7f0c4ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8e3bcba20 0x55d8e3bcbe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:33308/0 (socket says 172.21.15.92:33308) 2024-09-19T09:01:24.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.634+0000 7f0c4ffff640 1 -- 172.21.15.92:0/879846480 learned_addr learned my addr 172.21.15.92:0/879846480 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:24.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.634+0000 7f0c54b50640 1 --2- 172.21.15.92:0/879846480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8e3bdb150 0x55d8e3bdd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:24.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.634+0000 7f0c4f7fe640 1 --2- 172.21.15.92:0/879846480 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8e3bcc340 0x55d8e3bdac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:24.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.634+0000 7f0c4ffff640 1 -- 172.21.15.92:0/879846480 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8e3bcc340 msgr2=0x55d8e3bdac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:24.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.634+0000 7f0c4ffff640 1 --2- 172.21.15.92:0/879846480 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8e3bcc340 0x55d8e3bdac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.634+0000 7f0c4ffff640 1 -- 172.21.15.92:0/879846480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8e3bdb150 msgr2=0x55d8e3bdd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:24.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.634+0000 7f0c4ffff640 1 --2- 172.21.15.92:0/879846480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8e3bdb150 0x55d8e3bdd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.634+0000 7f0c4ffff640 1 -- 172.21.15.92:0/879846480 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8e3ae51f0 con 0x55d8e3bcba20 2024-09-19T09:01:24.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.634+0000 7f0c54b50640 1 --2- 172.21.15.92:0/701321709 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f0c380a3240 0x7f0c380a5700 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0c48004af0 tx=0x7f0c48031c30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:24.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.634+0000 7f0c4ffff640 1 --2- 172.21.15.92:0/879846480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8e3bcba20 0x55d8e3bcbe00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0c40009cf0 tx=0x7f0c40011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66683caa712e7a13 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:24.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.634+0000 7f0c367fc640 1 -- 172.21.15.92:0/879846480 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c40004230 con 0x55d8e3bcba20 2024-09-19T09:01:24.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.634+0000 7f0c367fc640 1 -- 172.21.15.92:0/879846480 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c400043d0 con 0x55d8e3bcba20 2024-09-19T09:01:24.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.634+0000 7f0c367fc640 1 -- 172.21.15.92:0/879846480 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c40019840 con 0x55d8e3bcba20 2024-09-19T09:01:24.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.635+0000 7f0c5898c740 1 -- 172.21.15.92:0/879846480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8e3bcba20 msgr2=0x55d8e3bcbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:24.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.635+0000 7f0c5898c740 1 --2- 172.21.15.92:0/879846480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8e3bcba20 0x55d8e3bcbe00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0c40009cf0 tx=0x7f0c40011810 comp rx=0 tx=0).stop 2024-09-19T09:01:24.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.635+0000 7f0c5898c740 1 -- 172.21.15.92:0/879846480 shutdown_connections 2024-09-19T09:01:24.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.635+0000 7f0c5898c740 1 --2- 172.21.15.92:0/879846480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8e3bdb150 0x55d8e3bdd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.635+0000 7f0c5898c740 1 --2- 172.21.15.92:0/879846480 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8e3bcc340 0x55d8e3bdac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.635+0000 7f0c5898c740 1 --2- 172.21.15.92:0/879846480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8e3bcba20 0x55d8e3bcbe00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.635+0000 7f0c5898c740 1 -- 172.21.15.92:0/879846480 >> 172.21.15.92:0/879846480 conn(0x55d8e3bc80f0 msgr2=0x55d8e3bc84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:24.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.635+0000 7f0c5898c740 1 -- 172.21.15.92:0/879846480 shutdown_connections 2024-09-19T09:01:24.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.635+0000 7f0c5898c740 1 -- 172.21.15.92:0/879846480 wait complete. 2024-09-19T09:01:24.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.635+0000 7f0c5898c740 1 -- start start 2024-09-19T09:01:24.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.636+0000 7f0c5898c740 1 Processor -- start 2024-09-19T09:01:24.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.636+0000 7f0c5898c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8e3bcba20 0x55d8e3bda920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:24.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.636+0000 7f0c5898c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8e3bcc340 0x55d8e3bd3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:24.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.636+0000 7f0c5898c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8e3bdb150 0x55d8e3bd4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:24.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.636+0000 7f0c5898c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d8e3bddd20 con 0x55d8e3bdb150 2024-09-19T09:01:24.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.636+0000 7f0c5898c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d8e3aebf10 con 0x55d8e3bcc340 2024-09-19T09:01:24.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.636+0000 7f0c5898c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55d8e3bddea0 con 0x55d8e3bcba20 2024-09-19T09:01:24.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.636+0000 7f0c5898c740 10 client.0 _ll_register_callbacks cb 0x55d8e3ab4a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:24.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.636+0000 7f0c4ffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8e3bcba20 0x55d8e3bda920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:24.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.636+0000 7f0c4ffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8e3bcba20 0x55d8e3bda920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:55426/0 (socket says 172.21.15.92:55426) 2024-09-19T09:01:24.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.636+0000 7f0c4ffff640 1 -- 172.21.15.92:0/1055177293 learned_addr learned my addr 172.21.15.92:0/1055177293 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:24.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.636+0000 7f0c54b50640 1 --2- 172.21.15.92:0/1055177293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8e3bdb150 0x55d8e3bd4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:24.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.636+0000 7f0c4f7fe640 1 --2- 172.21.15.92:0/1055177293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8e3bcc340 0x55d8e3bd3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:24.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.636+0000 7f0c4ffff640 1 -- 172.21.15.92:0/1055177293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8e3bcc340 msgr2=0x55d8e3bd3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:24.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.636+0000 7f0c4ffff640 1 --2- 172.21.15.92:0/1055177293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8e3bcc340 0x55d8e3bd3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.636+0000 7f0c4ffff640 1 -- 172.21.15.92:0/1055177293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8e3bdb150 msgr2=0x55d8e3bd4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:24.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.636+0000 7f0c4ffff640 1 --2- 172.21.15.92:0/1055177293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8e3bdb150 0x55d8e3bd4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.636+0000 7f0c4ffff640 1 -- 172.21.15.92:0/1055177293 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8e38a26a0 con 0x55d8e3bcba20 2024-09-19T09:01:24.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.637+0000 7f0c4ffff640 1 --2- 172.21.15.92:0/1055177293 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8e3bcba20 0x55d8e3bda920 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0c400096e0 tx=0x7f0c40003820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=339502592946f0ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:24.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.637+0000 7f0c2f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:01:24.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.637+0000 7f0c2f7fe640 1 -- 172.21.15.92:0/1055177293 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c40027070 con 0x55d8e3bcba20 2024-09-19T09:01:24.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.637+0000 7f0c2f7fe640 1 -- 172.21.15.92:0/1055177293 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f0c40005240 con 0x55d8e3bcba20 2024-09-19T09:01:24.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.637+0000 7f0c5898c740 1 -- 172.21.15.92:0/1055177293 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c400043d0 con 0x55d8e3bcba20 2024-09-19T09:01:24.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.637+0000 7f0c2f7fe640 1 -- 172.21.15.92:0/1055177293 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f0c40033050 con 0x55d8e3bcba20 2024-09-19T09:01:24.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.637+0000 7f0c5898c740 10 client.25795 fetch_fsmap learned FSMap version 19 2024-09-19T09:01:24.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.637+0000 7f0c5898c740 1 -- 172.21.15.92:0/1055177293 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55d8e3bd91d0 con 0x55d8e3bcba20 2024-09-19T09:01:24.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.637+0000 7f0c2f7fe640 1 -- 172.21.15.92:0/1055177293 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c400043d0 con 0x55d8e3bcba20 2024-09-19T09:01:24.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.637+0000 7f0c2f7fe640 1 -- 172.21.15.92:0/1055177293 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f0c40004ba0 con 0x55d8e3bcba20 2024-09-19T09:01:24.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.637+0000 7f0c5898c740 10 client.25795 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:01:24.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.637+0000 7f0c5898c740 10 client.25795 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:01:24.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.637+0000 7f0c5898c740 20 client.25795 populate_metadata read hostname 'smithi092' 2024-09-19T09:01:24.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.637+0000 7f0c5898c740 1 --2- 172.21.15.92:0/1055177293 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d8e3bef1b0 0x55d8e3bf15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:24.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.637+0000 7f0c5898c740 4 client.25795 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:01:24.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.637+0000 7f0c5898c740 1 -- 172.21.15.92:0/1055177293 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8e3b3e7f0 con 0x55d8e3bef1b0 2024-09-19T09:01:24.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.638+0000 7f0c4f7fe640 1 --2- 172.21.15.92:0/1055177293 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d8e3bef1b0 0x55d8e3bf15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:24.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.638+0000 7f0c4f7fe640 1 --2- 172.21.15.92:0/1055177293 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d8e3bef1b0 0x55d8e3bf15a0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6668a76f28257cf server_cookie=7a256e92f668f507 in_seq=0 out_seq=0 2024-09-19T09:01:24.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.638+0000 7f0c2f7fe640 10 client.25795 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:24.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.639+0000 7f0c2f7fe640 1 -- 172.21.15.92:0/1055177293 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d8e3b3e7f0 con 0x55d8e3bef1b0 2024-09-19T09:01:24.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.639+0000 7f0c2f7fe640 10 client.25795 handle_command_reply: tid=0 2024-09-19T09:01:24.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.639+0000 7f0c5898c740 1 client.25795 shutdown 2024-09-19T09:01:24.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.639+0000 7f0c5898c740 1 -- 172.21.15.92:0/1055177293 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8e3bcba20 msgr2=0x55d8e3bda920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:24.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.639+0000 7f0c5898c740 1 --2- 172.21.15.92:0/1055177293 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8e3bcba20 0x55d8e3bda920 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0c400096e0 tx=0x7f0c40003820 comp rx=0 tx=0).stop 2024-09-19T09:01:24.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.639+0000 7f0c5898c740 1 -- 172.21.15.92:0/1055177293 shutdown_connections 2024-09-19T09:01:24.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.639+0000 7f0c5898c740 1 --2- 172.21.15.92:0/1055177293 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d8e3bef1b0 0x55d8e3bf15a0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.639+0000 7f0c5898c740 1 --2- 172.21.15.92:0/1055177293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8e3bdb150 0x55d8e3bd4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.639+0000 7f0c5898c740 1 --2- 172.21.15.92:0/1055177293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8e3bcc340 0x55d8e3bd3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.639+0000 7f0c5898c740 1 --2- 172.21.15.92:0/1055177293 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8e3bcba20 0x55d8e3bda920 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.639+0000 7f0c2f7fe640 0 client.25795 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:24.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.639+0000 7f0c5898c740 1 -- 172.21.15.92:0/1055177293 >> 172.21.15.92:0/1055177293 conn(0x55d8e3bc80f0 msgr2=0x55d8e3bcde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:24.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.639+0000 7f0c5898c740 1 -- 172.21.15.92:0/1055177293 shutdown_connections 2024-09-19T09:01:24.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.639+0000 7f0c5898c740 1 -- 172.21.15.92:0/1055177293 wait complete. 2024-09-19T09:01:24.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.639+0000 7f0c5898c740 20 client.25795 trim_cache size 0 max 16384 2024-09-19T09:01:24.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.658+0000 7f0c5898c740 1 Processor -- start 2024-09-19T09:01:24.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.658+0000 7f0c5898c740 1 -- start start 2024-09-19T09:01:24.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.658+0000 7f0c5898c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8e3bcba20 0x55d8e3bc7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:24.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.658+0000 7f0c5898c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8e3bcc340 0x55d8e3bf6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:24.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.658+0000 7f0c5898c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8e3bdb150 0x55d8e3bf7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:24.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.658+0000 7f0c5898c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0c501a9420 con 0x55d8e3bdb150 2024-09-19T09:01:24.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.658+0000 7f0c5898c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0c501abcc0 con 0x55d8e3bcc340 2024-09-19T09:01:24.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.658+0000 7f0c5898c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0c501a9ab0 con 0x55d8e3bcba20 2024-09-19T09:01:24.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.658+0000 7f0c4f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8e3bcc340 0x55d8e3bf6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:24.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.658+0000 7f0c54b50640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8e3bdb150 0x55d8e3bf7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:24.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.658+0000 7f0c4f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8e3bcc340 0x55d8e3bf6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:33316/0 (socket says 172.21.15.92:33316) 2024-09-19T09:01:24.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.658+0000 7f0c54b50640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8e3bdb150 0x55d8e3bf7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59260/0 (socket says 172.21.15.92:59260) 2024-09-19T09:01:24.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.658+0000 7f0c4f7fe640 1 -- 172.21.15.92:0/4115686883 learned_addr learned my addr 172.21.15.92:0/4115686883 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:24.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.658+0000 7f0c4ffff640 1 --2- 172.21.15.92:0/4115686883 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8e3bcba20 0x55d8e3bc7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:24.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.658+0000 7f0c4f7fe640 1 -- 172.21.15.92:0/4115686883 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8e3bcba20 msgr2=0x55d8e3bc7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:24.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.658+0000 7f0c4f7fe640 1 --2- 172.21.15.92:0/4115686883 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8e3bcba20 0x55d8e3bc7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.658+0000 7f0c4f7fe640 1 -- 172.21.15.92:0/4115686883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8e3bdb150 msgr2=0x55d8e3bf7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:24.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.658+0000 7f0c4f7fe640 1 --2- 172.21.15.92:0/4115686883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8e3bdb150 0x55d8e3bf7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.658+0000 7f0c4f7fe640 1 -- 172.21.15.92:0/4115686883 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8e3bdac90 con 0x55d8e3bcc340 2024-09-19T09:01:24.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.658+0000 7f0c4ffff640 1 --2- 172.21.15.92:0/4115686883 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8e3bcba20 0x55d8e3bc7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:24.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.659+0000 7f0c4f7fe640 1 --2- 172.21.15.92:0/4115686883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8e3bcc340 0x55d8e3bf6cc0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0c440cd7b0 tx=0x7f0c4401a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fe3b26d1c20b30d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:24.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.659+0000 7f0c35ffb640 1 -- 172.21.15.92:0/4115686883 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c440a0680 con 0x55d8e3bcc340 2024-09-19T09:01:24.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.659+0000 7f0c35ffb640 1 -- 172.21.15.92:0/4115686883 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c440a4f40 con 0x55d8e3bcc340 2024-09-19T09:01:24.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.659+0000 7f0c35ffb640 1 -- 172.21.15.92:0/4115686883 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c440a4ab0 con 0x55d8e3bcc340 2024-09-19T09:01:24.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.660+0000 7f0c5898c740 1 -- 172.21.15.92:0/4115686883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8e3bcc340 msgr2=0x55d8e3bf6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:24.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.660+0000 7f0c5898c740 1 --2- 172.21.15.92:0/4115686883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8e3bcc340 0x55d8e3bf6cc0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0c440cd7b0 tx=0x7f0c4401a040 comp rx=0 tx=0).stop 2024-09-19T09:01:24.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.660+0000 7f0c5898c740 1 -- 172.21.15.92:0/4115686883 shutdown_connections 2024-09-19T09:01:24.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.660+0000 7f0c5898c740 1 --2- 172.21.15.92:0/4115686883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8e3bdb150 0x55d8e3bf7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.660+0000 7f0c5898c740 1 --2- 172.21.15.92:0/4115686883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8e3bcc340 0x55d8e3bf6cc0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.660+0000 7f0c5898c740 1 --2- 172.21.15.92:0/4115686883 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8e3bcba20 0x55d8e3bc7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.660+0000 7f0c5898c740 1 -- 172.21.15.92:0/4115686883 >> 172.21.15.92:0/4115686883 conn(0x55d8e3bc80f0 msgr2=0x55d8e3bc6a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:24.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.660+0000 7f0c5898c740 1 -- 172.21.15.92:0/4115686883 shutdown_connections 2024-09-19T09:01:24.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.660+0000 7f0c5898c740 1 -- 172.21.15.92:0/4115686883 wait complete. 2024-09-19T09:01:24.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.660+0000 7f0c5898c740 1 -- start start 2024-09-19T09:01:24.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.661+0000 7f0c5898c740 1 Processor -- start 2024-09-19T09:01:24.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.661+0000 7f0c5898c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8e3bcba20 0x55d8e3bec410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:24.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.661+0000 7f0c5898c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8e3bcc340 0x55d8e3be7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:24.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.661+0000 7f0c5898c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8e3bdb150 0x55d8e3be7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:24.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.661+0000 7f0c5898c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0c501aa180 con 0x55d8e3bdb150 2024-09-19T09:01:24.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.661+0000 7f0c5898c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0c501ab5f0 con 0x55d8e3bcc340 2024-09-19T09:01:24.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.661+0000 7f0c5898c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0c501aa850 con 0x55d8e3bcba20 2024-09-19T09:01:24.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.661+0000 7f0c4f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8e3bcc340 0x55d8e3be7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:24.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.661+0000 7f0c4ffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8e3bcba20 0x55d8e3bec410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:24.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.661+0000 7f0c54b50640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8e3bdb150 0x55d8e3be7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:24.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.661+0000 7f0c4f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8e3bcc340 0x55d8e3be7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:33318/0 (socket says 172.21.15.92:33318) 2024-09-19T09:01:24.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.661+0000 7f0c4f7fe640 1 -- 172.21.15.92:0/2562811006 learned_addr learned my addr 172.21.15.92:0/2562811006 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:24.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.662+0000 7f0c5898c740 10 client.0 _ll_register_callbacks cb 0x7f0c44005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:24.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.662+0000 7f0c4f7fe640 1 -- 172.21.15.92:0/2562811006 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8e3bcba20 msgr2=0x55d8e3bec410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:24.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.662+0000 7f0c4f7fe640 1 --2- 172.21.15.92:0/2562811006 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8e3bcba20 0x55d8e3bec410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.662+0000 7f0c4f7fe640 1 -- 172.21.15.92:0/2562811006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8e3bdb150 msgr2=0x55d8e3be7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:24.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.662+0000 7f0c4f7fe640 1 --2- 172.21.15.92:0/2562811006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8e3bdb150 0x55d8e3be7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.662+0000 7f0c4f7fe640 1 -- 172.21.15.92:0/2562811006 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8e3c58c90 con 0x55d8e3bcc340 2024-09-19T09:01:24.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.662+0000 7f0c5898c740 1 -- 172.21.15.92:0/2562811006 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c440a4f40 con 0x55d8e3bcc340 2024-09-19T09:01:24.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.662+0000 7f0c4f7fe640 1 --2- 172.21.15.92:0/2562811006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8e3bcc340 0x55d8e3be7740 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0c4400c6a0 tx=0x7f0c4400cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3ee02f3ce527c49 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:24.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.662+0000 7f0c2f7fe640 10 client.25889 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:01:24.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.662+0000 7f0c2f7fe640 1 -- 172.21.15.92:0/2562811006 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4409a5d0 con 0x55d8e3bcc340 2024-09-19T09:01:24.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.662+0000 7f0c2f7fe640 1 -- 172.21.15.92:0/2562811006 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f0c440b5130 con 0x55d8e3bcc340 2024-09-19T09:01:24.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.662+0000 7f0c2f7fe640 1 -- 172.21.15.92:0/2562811006 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f0c440a4ab0 con 0x55d8e3bcc340 2024-09-19T09:01:24.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.662+0000 7f0c5898c740 10 client.25889 fetch_fsmap learned FSMap version 19 2024-09-19T09:01:24.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.662+0000 7f0c5898c740 1 -- 172.21.15.92:0/2562811006 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55d8e3c59ce0 con 0x55d8e3bcc340 2024-09-19T09:01:24.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.663+0000 7f0c2f7fe640 1 -- 172.21.15.92:0/2562811006 <== mon.2 v2:172.21.15.167:3300/0 4 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f0c440a0160 con 0x55d8e3bcc340 2024-09-19T09:01:24.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.663+0000 7f0c5898c740 10 client.25889 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:01:24.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.663+0000 7f0c5898c740 10 client.25889 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:01:24.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.663+0000 7f0c5898c740 20 client.25889 populate_metadata read hostname 'smithi092' 2024-09-19T09:01:24.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.663+0000 7f0c5898c740 1 --2- 172.21.15.92:0/2562811006 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d8e3c5a300 0x55d8e3c5c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:24.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.663+0000 7f0c5898c740 4 client.25889 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:01:24.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.664+0000 7f0c5898c740 1 -- 172.21.15.92:0/2562811006 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d8e3b38d00 con 0x55d8e3c5a300 2024-09-19T09:01:24.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.664+0000 7f0c4ffff640 1 --2- 172.21.15.92:0/2562811006 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d8e3c5a300 0x55d8e3c5c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:24.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.664+0000 7f0c2f7fe640 10 client.25889 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:24.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.664+0000 7f0c4ffff640 1 --2- 172.21.15.92:0/2562811006 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d8e3c5a300 0x55d8e3c5c720 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5e6410b67da7799 server_cookie=6931081c7f54a1e2 in_seq=0 out_seq=0 2024-09-19T09:01:24.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.665+0000 7f0c2f7fe640 1 -- 172.21.15.92:0/2562811006 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d8e3b38d00 con 0x55d8e3c5a300 2024-09-19T09:01:24.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.665+0000 7f0c2f7fe640 10 client.25889 handle_command_reply: tid=0 2024-09-19T09:01:24.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.665+0000 7f0c5898c740 1 client.25889 shutdown 2024-09-19T09:01:24.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.665+0000 7f0c5898c740 1 -- 172.21.15.92:0/2562811006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8e3bcc340 msgr2=0x55d8e3be7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:24.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.665+0000 7f0c5898c740 1 --2- 172.21.15.92:0/2562811006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8e3bcc340 0x55d8e3be7740 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0c4400c6a0 tx=0x7f0c4400cf20 comp rx=0 tx=0).stop 2024-09-19T09:01:24.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.665+0000 7f0c5898c740 1 -- 172.21.15.92:0/2562811006 shutdown_connections 2024-09-19T09:01:24.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.665+0000 7f0c5898c740 1 --2- 172.21.15.92:0/2562811006 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d8e3c5a300 0x55d8e3c5c720 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.665+0000 7f0c5898c740 1 --2- 172.21.15.92:0/2562811006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8e3bdb150 0x55d8e3be7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.665+0000 7f0c5898c740 1 --2- 172.21.15.92:0/2562811006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8e3bcc340 0x55d8e3be7740 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.665+0000 7f0c5898c740 1 --2- 172.21.15.92:0/2562811006 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8e3bcba20 0x55d8e3bec410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.665+0000 7f0c5898c740 1 -- 172.21.15.92:0/2562811006 >> 172.21.15.92:0/2562811006 conn(0x55d8e3bc80f0 msgr2=0x55d8e3bc7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:24.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.665+0000 7f0c2f7fe640 0 client.25889 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:24.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.666+0000 7f0c5898c740 1 -- 172.21.15.92:0/2562811006 shutdown_connections 2024-09-19T09:01:24.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.666+0000 7f0c5898c740 1 -- 172.21.15.92:0/2562811006 wait complete. 2024-09-19T09:01:24.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.666+0000 7f0c5898c740 20 client.25889 trim_cache size 0 max 16384 2024-09-19T09:01:24.671 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:01:24.672 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-19T09:01:24.672 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "5a32ff6e-d36c-4719-9151-bd9bd873f188", 2024-09-19T09:01:24.672 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-19T09:01:24.672 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:01:24.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.666+0000 7f0c565b3640 1 -- 172.21.15.92:0/701321709 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f0c380a3240 msgr2=0x7f0c380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:24.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.666+0000 7f0c565b3640 1 --2- 172.21.15.92:0/701321709 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f0c380a3240 0x7f0c380a5700 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0c48004af0 tx=0x7f0c48031c30 comp rx=0 tx=0).stop 2024-09-19T09:01:24.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.666+0000 7f0c565b3640 1 -- 172.21.15.92:0/701321709 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c501027a0 msgr2=0x7f0c50198940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:24.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.666+0000 7f0c565b3640 1 --2- 172.21.15.92:0/701321709 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c501027a0 0x7f0c50198940 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f0c4400e9f0 tx=0x7f0c4400edf0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.667+0000 7f0c565b3640 1 -- 172.21.15.92:0/701321709 shutdown_connections 2024-09-19T09:01:24.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.667+0000 7f0c565b3640 1 --2- 172.21.15.92:0/701321709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c50106f20 0x7f0c5019ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.667+0000 7f0c565b3640 1 --2- 172.21.15.92:0/701321709 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f0c380a3240 0x7f0c380a5700 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.667+0000 7f0c565b3640 1 --2- 172.21.15.92:0/701321709 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c501027a0 0x7f0c50198940 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.667+0000 7f0c565b3640 1 --2- 172.21.15.92:0/701321709 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c50101df0 0x7f0c50198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.667+0000 7f0c565b3640 1 -- 172.21.15.92:0/701321709 >> 172.21.15.92:0/701321709 conn(0x7f0c500fd8f0 msgr2=0x7f0c500fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:24.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.667+0000 7f0c565b3640 1 -- 172.21.15.92:0/701321709 shutdown_connections 2024-09-19T09:01:24.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:24.667+0000 7f0c565b3640 1 -- 172.21.15.92:0/701321709 wait complete. 2024-09-19T09:01:24.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:24 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/942036221' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:24.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:24 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/942036221' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:24.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:24 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/942036221' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:24.950 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:25.390 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:01:25.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:25 smithi092 ceph-mon[31407]: pgmap v478: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 810 KiB/s wr, 21 op/s 2024-09-19T09:01:25.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.797+0000 7fec06a3d640 1 -- 172.21.15.92:0/922009711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec00100e20 msgr2=0x7fec00101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:25.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.797+0000 7fec06a3d640 1 --2- 172.21.15.92:0/922009711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec00100e20 0x7fec00101200 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7febe8009900 tx=0x7febe802a480 comp rx=0 tx=0).stop 2024-09-19T09:01:25.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.797+0000 7fec06a3d640 1 -- 172.21.15.92:0/922009711 shutdown_connections 2024-09-19T09:01:25.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.797+0000 7fec06a3d640 1 --2- 172.21.15.92:0/922009711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec00102ef0 0x7fec0010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.797+0000 7fec06a3d640 1 --2- 172.21.15.92:0/922009711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec00102570 0x7fec001029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.797+0000 7fec06a3d640 1 --2- 172.21.15.92:0/922009711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec00100e20 0x7fec00101200 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.797+0000 7fec06a3d640 1 -- 172.21.15.92:0/922009711 >> 172.21.15.92:0/922009711 conn(0x7fec000fc7d0 msgr2=0x7fec000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:25.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.797+0000 7fec06a3d640 1 -- 172.21.15.92:0/922009711 shutdown_connections 2024-09-19T09:01:25.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.797+0000 7fec06a3d640 1 -- 172.21.15.92:0/922009711 wait complete. 2024-09-19T09:01:25.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.797+0000 7fec06a3d640 1 Processor -- start 2024-09-19T09:01:25.799 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:01:25.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.798+0000 7fec06a3d640 1 -- start start 2024-09-19T09:01:25.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.798+0000 7fec06a3d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec00100e20 0x7fec00198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:25.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.798+0000 7fec06a3d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec00102570 0x7fec00198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:25.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.798+0000 7fec06a3d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec00102ef0 0x7fec0019ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:25.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.798+0000 7fec06a3d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fec00110f80 con 0x7fec00102570 2024-09-19T09:01:25.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.798+0000 7fec06a3d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fec00110e00 con 0x7fec00102ef0 2024-09-19T09:01:25.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.798+0000 7fec06a3d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fec00111100 con 0x7fec00100e20 2024-09-19T09:01:25.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.798+0000 7febff7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec00102570 0x7fec00198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:25.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.798+0000 7febff7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec00102570 0x7fec00198aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59286/0 (socket says 172.21.15.92:59286) 2024-09-19T09:01:25.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.798+0000 7febff7fe640 1 -- 172.21.15.92:0/2509613733 learned_addr learned my addr 172.21.15.92:0/2509613733 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:25.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.798+0000 7fec04fda640 1 --2- 172.21.15.92:0/2509613733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec00102ef0 0x7fec0019ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:25.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.798+0000 7febfffff640 1 --2- 172.21.15.92:0/2509613733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec00100e20 0x7fec00198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:25.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.798+0000 7febff7fe640 1 -- 172.21.15.92:0/2509613733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec00100e20 msgr2=0x7fec00198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:25.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.798+0000 7febff7fe640 1 --2- 172.21.15.92:0/2509613733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec00100e20 0x7fec00198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.798+0000 7febff7fe640 1 -- 172.21.15.92:0/2509613733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec00102ef0 msgr2=0x7fec0019ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:25.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.798+0000 7febff7fe640 1 --2- 172.21.15.92:0/2509613733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec00102ef0 0x7fec0019ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.798+0000 7febff7fe640 1 -- 172.21.15.92:0/2509613733 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec0019d510 con 0x7fec00102570 2024-09-19T09:01:25.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.799+0000 7febfffff640 1 --2- 172.21.15.92:0/2509613733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec00100e20 0x7fec00198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:01:25.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.799+0000 7febff7fe640 1 --2- 172.21.15.92:0/2509613733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec00102570 0x7fec00198aa0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7febf000d950 tx=0x7febf000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:25.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.799+0000 7febfd7fa640 1 -- 172.21.15.92:0/2509613733 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf0017030 con 0x7fec00102570 2024-09-19T09:01:25.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.799+0000 7fec06a3d640 1 -- 172.21.15.92:0/2509613733 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec0019d800 con 0x7fec00102570 2024-09-19T09:01:25.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.799+0000 7febfd7fa640 1 -- 172.21.15.92:0/2509613733 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febf0004020 con 0x7fec00102570 2024-09-19T09:01:25.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.799+0000 7febfd7fa640 1 -- 172.21.15.92:0/2509613733 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf00047a0 con 0x7fec00102570 2024-09-19T09:01:25.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.799+0000 7fec06a3d640 1 -- 172.21.15.92:0/2509613733 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec001a50e0 con 0x7fec00102570 2024-09-19T09:01:25.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.801+0000 7febfd7fa640 1 -- 172.21.15.92:0/2509613733 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7febf00041d0 con 0x7fec00102570 2024-09-19T09:01:25.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.802+0000 7fec08e16740 1 Processor -- start 2024-09-19T09:01:25.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.802+0000 7fec08e16740 1 -- start start 2024-09-19T09:01:25.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.802+0000 7febfd7fa640 1 --2- 172.21.15.92:0/2509613733 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7febec0a3240 0x7febec0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:25.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.802+0000 7fec08e16740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628505d62a0 0x5628505d6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:25.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.802+0000 7fec08e16740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628505d6bc0 0x5628505d0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:25.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.802+0000 7fec08e16740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628505d1260 0x5628505d16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:25.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.802+0000 7fec08e16740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56285052c620 con 0x5628505d6bc0 2024-09-19T09:01:25.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.802+0000 7fec08e16740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5628504d3e50 con 0x5628505d1260 2024-09-19T09:01:25.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.802+0000 7fec08e16740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5628505285e0 con 0x5628505d62a0 2024-09-19T09:01:25.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.802+0000 7fec04fda640 1 --2- 172.21.15.92:0/2509613733 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7febec0a3240 0x7febec0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:25.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.802+0000 7febfd7fa640 1 -- 172.21.15.92:0/2509613733 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7febf00cf2f0 con 0x7fec00102570 2024-09-19T09:01:25.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.803+0000 7febfffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628505d62a0 0x5628505d6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:25.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.803+0000 7febfffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628505d62a0 0x5628505d6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:55476/0 (socket says 172.21.15.92:55476) 2024-09-19T09:01:25.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.803+0000 7febfffff640 1 -- 172.21.15.92:0/50175740 learned_addr learned my addr 172.21.15.92:0/50175740 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:25.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.803+0000 7fec04fda640 1 --2- 172.21.15.92:0/50175740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628505d1260 0x5628505d16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:25.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.803+0000 7febff7fe640 1 --2- 172.21.15.92:0/50175740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628505d6bc0 0x5628505d0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:25.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.803+0000 7febfffff640 1 -- 172.21.15.92:0/50175740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628505d1260 msgr2=0x5628505d16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:25.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.803+0000 7febfffff640 1 --2- 172.21.15.92:0/50175740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628505d1260 0x5628505d16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.803+0000 7febfffff640 1 -- 172.21.15.92:0/50175740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628505d6bc0 msgr2=0x5628505d0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:25.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.803+0000 7febfffff640 1 --2- 172.21.15.92:0/50175740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628505d6bc0 0x5628505d0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.803+0000 7febfffff640 1 -- 172.21.15.92:0/50175740 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628504c4d40 con 0x5628505d62a0 2024-09-19T09:01:25.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.803+0000 7febff7fe640 1 --2- 172.21.15.92:0/50175740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628505d6bc0 0x5628505d0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:01:25.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.803+0000 7fec04fda640 1 --2- 172.21.15.92:0/2509613733 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7febec0a3240 0x7febec0a5700 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7febf8005fd0 tx=0x7febf8014b70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:25.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.803+0000 7febfffff640 1 --2- 172.21.15.92:0/50175740 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628505d62a0 0x5628505d6680 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7febe8033000 tx=0x7febe80040f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e6a9940b73da52d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:25.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.803+0000 7febf67fc640 1 -- 172.21.15.92:0/50175740 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe8035030 con 0x5628505d62a0 2024-09-19T09:01:25.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.804+0000 7febf67fc640 1 -- 172.21.15.92:0/50175740 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febe8004490 con 0x5628505d62a0 2024-09-19T09:01:25.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.804+0000 7febf67fc640 1 -- 172.21.15.92:0/50175740 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe80035f0 con 0x5628505d62a0 2024-09-19T09:01:25.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.804+0000 7fec08e16740 1 -- 172.21.15.92:0/50175740 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628505d62a0 msgr2=0x5628505d6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:25.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.804+0000 7fec08e16740 1 --2- 172.21.15.92:0/50175740 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628505d62a0 0x5628505d6680 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7febe8033000 tx=0x7febe80040f0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.804+0000 7fec08e16740 1 -- 172.21.15.92:0/50175740 shutdown_connections 2024-09-19T09:01:25.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.804+0000 7fec08e16740 1 --2- 172.21.15.92:0/50175740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628505d1260 0x5628505d16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.804+0000 7fec08e16740 1 --2- 172.21.15.92:0/50175740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628505d6bc0 0x5628505d0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.804+0000 7fec08e16740 1 --2- 172.21.15.92:0/50175740 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628505d62a0 0x5628505d6680 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.804+0000 7fec08e16740 1 -- 172.21.15.92:0/50175740 >> 172.21.15.92:0/50175740 conn(0x5628505c30a0 msgr2=0x5628505c3480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:25.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.804+0000 7fec08e16740 1 -- 172.21.15.92:0/50175740 shutdown_connections 2024-09-19T09:01:25.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.804+0000 7fec08e16740 1 -- 172.21.15.92:0/50175740 wait complete. 2024-09-19T09:01:25.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.805+0000 7fec08e16740 1 -- start start 2024-09-19T09:01:25.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.805+0000 7fec08e16740 1 Processor -- start 2024-09-19T09:01:25.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.805+0000 7fec08e16740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628505d1260 0x5628505da130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:25.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.805+0000 7fec08e16740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628505d62a0 0x5628505da670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:25.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.805+0000 7fec08e16740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628505d6bc0 0x5628505dabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:25.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.805+0000 7fec08e16740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5628505dd580 con 0x5628505d6bc0 2024-09-19T09:01:25.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.805+0000 7fec08e16740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5628504b4f10 con 0x5628505d1260 2024-09-19T09:01:25.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.805+0000 7fec08e16740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5628505dd700 con 0x5628505d62a0 2024-09-19T09:01:25.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.805+0000 7fec08e16740 10 client.0 _ll_register_callbacks cb 0x5628504d8db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:25.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.805+0000 7fec04fda640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628505d6bc0 0x5628505dabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:25.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.805+0000 7fec04fda640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628505d6bc0 0x5628505dabb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59294/0 (socket says 172.21.15.92:59294) 2024-09-19T09:01:25.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.805+0000 7fec04fda640 1 -- 172.21.15.92:0/3603184589 learned_addr learned my addr 172.21.15.92:0/3603184589 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:25.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.805+0000 7febfffff640 1 --2- 172.21.15.92:0/3603184589 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628505d1260 0x5628505da130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:25.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.806+0000 7febff7fe640 1 --2- 172.21.15.92:0/3603184589 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628505d62a0 0x5628505da670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:25.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.806+0000 7fec04fda640 1 -- 172.21.15.92:0/3603184589 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628505d62a0 msgr2=0x5628505da670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:25.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.806+0000 7fec04fda640 1 --2- 172.21.15.92:0/3603184589 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628505d62a0 0x5628505da670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.806+0000 7fec04fda640 1 -- 172.21.15.92:0/3603184589 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628505d1260 msgr2=0x5628505da130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:25.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.806+0000 7fec04fda640 1 --2- 172.21.15.92:0/3603184589 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628505d1260 0x5628505da130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.806+0000 7fec04fda640 1 -- 172.21.15.92:0/3603184589 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56285023b580 con 0x5628505d6bc0 2024-09-19T09:01:25.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.806+0000 7fec04fda640 1 --2- 172.21.15.92:0/3603184589 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628505d6bc0 0x5628505dabb0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7febf8012f60 tx=0x7febf8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70acb20b710915a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:25.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.806+0000 7febdf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:01:25.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.806+0000 7febdf7fe640 1 -- 172.21.15.92:0/3603184589 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf8020440 con 0x5628505d6bc0 2024-09-19T09:01:25.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.806+0000 7fec08e16740 1 -- 172.21.15.92:0/3603184589 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febe8004490 con 0x5628505d6bc0 2024-09-19T09:01:25.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.806+0000 7febdf7fe640 1 -- 172.21.15.92:0/3603184589 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7febf80205e0 con 0x5628505d6bc0 2024-09-19T09:01:25.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.806+0000 7febdf7fe640 1 -- 172.21.15.92:0/3603184589 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7febf80207e0 con 0x5628505d6bc0 2024-09-19T09:01:25.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.806+0000 7fec08e16740 10 client.16503 fetch_fsmap learned FSMap version 19 2024-09-19T09:01:25.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.806+0000 7fec08e16740 1 -- 172.21.15.92:0/3603184589 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x562850305960 con 0x5628505d6bc0 2024-09-19T09:01:25.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.807+0000 7febdf7fe640 1 -- 172.21.15.92:0/3603184589 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febe8004490 con 0x5628505d6bc0 2024-09-19T09:01:25.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.807+0000 7febdf7fe640 1 -- 172.21.15.92:0/3603184589 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7febf800f040 con 0x5628505d6bc0 2024-09-19T09:01:25.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.807+0000 7fec08e16740 10 client.16503 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:01:25.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.807+0000 7fec08e16740 10 client.16503 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:01:25.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.807+0000 7fec08e16740 20 client.16503 populate_metadata read hostname 'smithi092' 2024-09-19T09:01:25.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.807+0000 7fec08e16740 1 --2- 172.21.15.92:0/3603184589 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5628505ea5e0 0x5628505ec9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:25.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.807+0000 7fec08e16740 4 client.16503 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:01:25.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.807+0000 7fec08e16740 1 -- 172.21.15.92:0/3603184589 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562850539b90 con 0x5628505ea5e0 2024-09-19T09:01:25.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.807+0000 7febfffff640 1 --2- 172.21.15.92:0/3603184589 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5628505ea5e0 0x5628505ec9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:25.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.808+0000 7febdf7fe640 10 client.16503 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:25.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.808+0000 7febfffff640 1 --2- 172.21.15.92:0/3603184589 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5628505ea5e0 0x5628505ec9f0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f884e17a55ceadf7 server_cookie=d9a96e7d9e87da2e in_seq=0 out_seq=0 2024-09-19T09:01:25.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.808+0000 7febdf7fe640 1 -- 172.21.15.92:0/3603184589 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562850539b90 con 0x5628505ea5e0 2024-09-19T09:01:25.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.808+0000 7febdf7fe640 10 client.16503 handle_command_reply: tid=0 2024-09-19T09:01:25.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.808+0000 7fec08e16740 1 client.16503 shutdown 2024-09-19T09:01:25.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.809+0000 7fec08e16740 1 -- 172.21.15.92:0/3603184589 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628505d6bc0 msgr2=0x5628505dabb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:25.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.809+0000 7fec08e16740 1 --2- 172.21.15.92:0/3603184589 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628505d6bc0 0x5628505dabb0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7febf8012f60 tx=0x7febf8004ab0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.809+0000 7fec08e16740 1 -- 172.21.15.92:0/3603184589 shutdown_connections 2024-09-19T09:01:25.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.809+0000 7fec08e16740 1 --2- 172.21.15.92:0/3603184589 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5628505ea5e0 0x5628505ec9f0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.809+0000 7febdf7fe640 0 client.16503 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:25.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.809+0000 7fec08e16740 1 --2- 172.21.15.92:0/3603184589 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628505d6bc0 0x5628505dabb0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.809+0000 7fec08e16740 1 --2- 172.21.15.92:0/3603184589 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628505d62a0 0x5628505da670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.809+0000 7fec08e16740 1 --2- 172.21.15.92:0/3603184589 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628505d1260 0x5628505da130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.809+0000 7fec08e16740 1 -- 172.21.15.92:0/3603184589 >> 172.21.15.92:0/3603184589 conn(0x5628505c30a0 msgr2=0x5628505c2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:25.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.809+0000 7fec08e16740 1 -- 172.21.15.92:0/3603184589 shutdown_connections 2024-09-19T09:01:25.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.809+0000 7fec08e16740 1 -- 172.21.15.92:0/3603184589 wait complete. 2024-09-19T09:01:25.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.809+0000 7fec08e16740 20 client.16503 trim_cache size 0 max 16384 2024-09-19T09:01:25.828 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:25.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.832+0000 7fec08e16740 1 Processor -- start 2024-09-19T09:01:25.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.832+0000 7fec08e16740 1 -- start start 2024-09-19T09:01:25.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.833+0000 7fec08e16740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628505d1260 0x5628505d0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:25.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.833+0000 7fec08e16740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628505d62a0 0x5628505d5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:25.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.833+0000 7fec08e16740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628505d6bc0 0x5628505dc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:25.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.833+0000 7fec08e16740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fec001a9400 con 0x5628505d6bc0 2024-09-19T09:01:25.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.833+0000 7fec08e16740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fec001abca0 con 0x5628505d1260 2024-09-19T09:01:25.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.833+0000 7fec08e16740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fec001a9a90 con 0x5628505d62a0 2024-09-19T09:01:25.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.833+0000 7fec04fda640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628505d6bc0 0x5628505dc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:25.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.833+0000 7fec04fda640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628505d6bc0 0x5628505dc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59298/0 (socket says 172.21.15.92:59298) 2024-09-19T09:01:25.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.833+0000 7fec04fda640 1 -- 172.21.15.92:0/3792223013 learned_addr learned my addr 172.21.15.92:0/3792223013 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:25.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.833+0000 7febfffff640 1 --2- 172.21.15.92:0/3792223013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628505d1260 0x5628505d0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:25.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.833+0000 7febff7fe640 1 --2- 172.21.15.92:0/3792223013 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628505d62a0 0x5628505d5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:25.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.833+0000 7febfffff640 1 -- 172.21.15.92:0/3792223013 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628505d62a0 msgr2=0x5628505d5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:25.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.833+0000 7febfffff640 1 --2- 172.21.15.92:0/3792223013 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628505d62a0 0x5628505d5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.833+0000 7febfffff640 1 -- 172.21.15.92:0/3792223013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628505d6bc0 msgr2=0x5628505dc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:25.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.833+0000 7febfffff640 1 --2- 172.21.15.92:0/3792223013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628505d6bc0 0x5628505dc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.833+0000 7febfffff640 1 -- 172.21.15.92:0/3792223013 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628505da7d0 con 0x5628505d1260 2024-09-19T09:01:25.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.833+0000 7febfffff640 1 --2- 172.21.15.92:0/3792223013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628505d1260 0x5628505d0bf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7febe8004160 tx=0x7febe8004c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f418c50f3c260e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:25.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.834+0000 7febf5ffb640 1 -- 172.21.15.92:0/3792223013 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe8053070 con 0x5628505d1260 2024-09-19T09:01:25.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.834+0000 7febf5ffb640 1 -- 172.21.15.92:0/3792223013 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x562850539b90 con 0x5628505d1260 2024-09-19T09:01:25.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.834+0000 7febf5ffb640 1 -- 172.21.15.92:0/3792223013 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe8035040 con 0x5628505d1260 2024-09-19T09:01:25.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.834+0000 7fec08e16740 1 -- 172.21.15.92:0/3792223013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628505d1260 msgr2=0x5628505d0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:25.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.834+0000 7fec08e16740 1 --2- 172.21.15.92:0/3792223013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628505d1260 0x5628505d0bf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7febe8004160 tx=0x7febe8004c40 comp rx=0 tx=0).stop 2024-09-19T09:01:25.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.834+0000 7fec08e16740 1 -- 172.21.15.92:0/3792223013 shutdown_connections 2024-09-19T09:01:25.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.834+0000 7fec08e16740 1 --2- 172.21.15.92:0/3792223013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628505d6bc0 0x5628505dc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.834+0000 7fec08e16740 1 --2- 172.21.15.92:0/3792223013 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628505d62a0 0x5628505d5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.834+0000 7fec08e16740 1 --2- 172.21.15.92:0/3792223013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628505d1260 0x5628505d0bf0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.834+0000 7fec08e16740 1 -- 172.21.15.92:0/3792223013 >> 172.21.15.92:0/3792223013 conn(0x5628505c30a0 msgr2=0x5628505db990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:25.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.834+0000 7fec08e16740 1 -- 172.21.15.92:0/3792223013 shutdown_connections 2024-09-19T09:01:25.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.834+0000 7fec08e16740 1 -- 172.21.15.92:0/3792223013 wait complete. 2024-09-19T09:01:25.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.835+0000 7fec08e16740 1 -- start start 2024-09-19T09:01:25.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.835+0000 7fec08e16740 1 Processor -- start 2024-09-19T09:01:25.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.835+0000 7fec08e16740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628505d1260 0x5628505e2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:25.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.835+0000 7fec08e16740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628505d62a0 0x5628505df960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:25.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.835+0000 7fec08e16740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628505d6bc0 0x5628505dfea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:25.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.835+0000 7fec08e16740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fec001aa160 con 0x5628505d1260 2024-09-19T09:01:25.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.835+0000 7fec08e16740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fec001ab5d0 con 0x5628505d6bc0 2024-09-19T09:01:25.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.835+0000 7fec08e16740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fec001aa830 con 0x5628505d62a0 2024-09-19T09:01:25.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.835+0000 7fec08e16740 10 client.0 _ll_register_callbacks cb 0x7febf8012df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:25.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.835+0000 7febfffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628505d1260 0x5628505e2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:25.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.835+0000 7febfffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628505d1260 0x5628505e2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59304/0 (socket says 172.21.15.92:59304) 2024-09-19T09:01:25.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.835+0000 7fec04fda640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628505d6bc0 0x5628505dfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:25.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.835+0000 7febfffff640 1 -- 172.21.15.92:0/3785126529 learned_addr learned my addr 172.21.15.92:0/3785126529 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:25.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.836+0000 7febff7fe640 1 --2- 172.21.15.92:0/3785126529 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628505d62a0 0x5628505df960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:25.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.836+0000 7fec04fda640 1 -- 172.21.15.92:0/3785126529 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628505d62a0 msgr2=0x5628505df960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:25.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.836+0000 7fec04fda640 1 --2- 172.21.15.92:0/3785126529 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628505d62a0 0x5628505df960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.836+0000 7fec04fda640 1 -- 172.21.15.92:0/3785126529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628505d1260 msgr2=0x5628505e2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:25.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.836+0000 7fec04fda640 1 --2- 172.21.15.92:0/3785126529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628505d1260 0x5628505e2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.836+0000 7fec04fda640 1 -- 172.21.15.92:0/3785126529 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628505e0590 con 0x5628505d6bc0 2024-09-19T09:01:25.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.836+0000 7febff7fe640 1 --2- 172.21.15.92:0/3785126529 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628505d62a0 0x5628505df960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:01:25.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.836+0000 7fec04fda640 1 --2- 172.21.15.92:0/3785126529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628505d6bc0 0x5628505dfea0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7febf8000f80 tx=0x7febf8020670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56ac087896117bd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:25.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.836+0000 7febdf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:01:25.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.836+0000 7febdf7fe640 1 -- 172.21.15.92:0/3785126529 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf8032600 con 0x5628505d6bc0 2024-09-19T09:01:25.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.836+0000 7febdf7fe640 1 -- 172.21.15.92:0/3785126529 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7febf8014040 con 0x5628505d6bc0 2024-09-19T09:01:25.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.836+0000 7fec08e16740 1 -- 172.21.15.92:0/3785126529 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562850539b90 con 0x5628505d6bc0 2024-09-19T09:01:25.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.836+0000 7febdf7fe640 1 -- 172.21.15.92:0/3785126529 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7febf8043050 con 0x5628505d6bc0 2024-09-19T09:01:25.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.837+0000 7fec08e16740 10 client.25907 fetch_fsmap learned FSMap version 19 2024-09-19T09:01:25.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.837+0000 7fec08e16740 1 -- 172.21.15.92:0/3785126529 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5628506561c0 con 0x5628505d6bc0 2024-09-19T09:01:25.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.837+0000 7febdf7fe640 1 -- 172.21.15.92:0/3785126529 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x562850539b90 con 0x5628505d6bc0 2024-09-19T09:01:25.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.837+0000 7febdf7fe640 1 -- 172.21.15.92:0/3785126529 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7febf800f040 con 0x5628505d6bc0 2024-09-19T09:01:25.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.837+0000 7fec08e16740 10 client.25907 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:01:25.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.837+0000 7fec08e16740 10 client.25907 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:01:25.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.837+0000 7fec08e16740 20 client.25907 populate_metadata read hostname 'smithi092' 2024-09-19T09:01:25.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.837+0000 7fec08e16740 1 --2- 172.21.15.92:0/3785126529 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562850656880 0x562850658c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:25.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.837+0000 7fec08e16740 4 client.25907 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "73785ebf", "release": true, "await": true}] 2024-09-19T09:01:25.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.837+0000 7fec08e16740 1 -- 172.21.15.92:0/3785126529 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "quiesce db", "set_id": "73785ebf", "release": true, "await": true}) -- 0x5628505daf40 con 0x562850656880 2024-09-19T09:01:25.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.838+0000 7febfffff640 1 --2- 172.21.15.92:0/3785126529 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562850656880 0x562850658c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:25.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.838+0000 7febdf7fe640 10 client.25907 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:25.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.838+0000 7febfffff640 1 --2- 172.21.15.92:0/3785126529 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562850656880 0x562850658c70 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9fe3d68dcee4deb server_cookie=8d135121aa1bf46f in_seq=0 out_seq=0 2024-09-19T09:01:25.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:25 smithi167 ceph-mon[35359]: pgmap v478: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 810 KiB/s wr, 21 op/s 2024-09-19T09:01:25.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:25 smithi190 ceph-mon[35358]: pgmap v478: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 810 KiB/s wr, 21 op/s 2024-09-19T09:01:25.925 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:01:25.925 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 19, 2024-09-19T09:01:25.925 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24472, 2024-09-19T09:01:25.925 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 24, 2024-09-19T09:01:25.925 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-09-19T09:01:25.925 INFO:teuthology.orchestra.run.smithi092.stdout: "73785ebf": { 2024-09-19T09:01:25.925 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 24, 2024-09-19T09:01:25.925 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-09-19T09:01:25.925 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:01:25.925 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-09-19T09:01:25.925 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:01:25.926 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:01:25.926 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 90.0, 2024-09-19T09:01:25.926 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 149.8, 2024-09-19T09:01:25.926 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-09-19T09:01:25.926 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-09-19T09:01:25.926 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-09-19T09:01:25.926 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:01:25.926 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-09-19T09:01:25.926 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:01:25.926 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:01:25.927 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:01:25.927 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:01:25.927 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:01:25.927 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:01:25.927 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:01:25.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.917+0000 7febdf7fe640 1 -- 172.21.15.92:0/3785126529 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5628505daf40 con 0x562850656880 2024-09-19T09:01:25.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.917+0000 7febdf7fe640 10 client.25907 handle_command_reply: tid=0 2024-09-19T09:01:25.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.917+0000 7fec08e16740 1 client.25907 shutdown 2024-09-19T09:01:25.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.918+0000 7fec08e16740 1 -- 172.21.15.92:0/3785126529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628505d6bc0 msgr2=0x5628505dfea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:25.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.918+0000 7fec08e16740 1 --2- 172.21.15.92:0/3785126529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628505d6bc0 0x5628505dfea0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7febf8000f80 tx=0x7febf8020670 comp rx=0 tx=0).stop 2024-09-19T09:01:25.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.918+0000 7fec08e16740 1 -- 172.21.15.92:0/3785126529 shutdown_connections 2024-09-19T09:01:25.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.918+0000 7fec08e16740 1 --2- 172.21.15.92:0/3785126529 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562850656880 0x562850658c70 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.918+0000 7fec08e16740 1 --2- 172.21.15.92:0/3785126529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628505d6bc0 0x5628505dfea0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.918+0000 7fec08e16740 1 --2- 172.21.15.92:0/3785126529 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628505d62a0 0x5628505df960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.918+0000 7fec08e16740 1 --2- 172.21.15.92:0/3785126529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628505d1260 0x5628505e2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.918+0000 7fec08e16740 1 -- 172.21.15.92:0/3785126529 >> 172.21.15.92:0/3785126529 conn(0x5628505c30a0 msgr2=0x5628505c2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:25.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.918+0000 7febdf7fe640 0 client.25907 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:25.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.918+0000 7fec08e16740 1 -- 172.21.15.92:0/3785126529 shutdown_connections 2024-09-19T09:01:25.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.918+0000 7fec08e16740 1 -- 172.21.15.92:0/3785126529 wait complete. 2024-09-19T09:01:25.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.918+0000 7fec08e16740 20 client.25907 trim_cache size 0 max 16384 2024-09-19T09:01:25.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.920+0000 7fec06a3d640 1 -- 172.21.15.92:0/2509613733 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7febec0a3240 msgr2=0x7febec0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:25.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.920+0000 7fec06a3d640 1 --2- 172.21.15.92:0/2509613733 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7febec0a3240 0x7febec0a5700 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7febf8005fd0 tx=0x7febf8014b70 comp rx=0 tx=0).stop 2024-09-19T09:01:25.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.920+0000 7fec06a3d640 1 -- 172.21.15.92:0/2509613733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec00102570 msgr2=0x7fec00198aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:25.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.920+0000 7fec06a3d640 1 --2- 172.21.15.92:0/2509613733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec00102570 0x7fec00198aa0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7febf000d950 tx=0x7febf000de10 comp rx=0 tx=0).stop 2024-09-19T09:01:25.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.920+0000 7fec06a3d640 1 -- 172.21.15.92:0/2509613733 shutdown_connections 2024-09-19T09:01:25.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.920+0000 7fec06a3d640 1 --2- 172.21.15.92:0/2509613733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec00102ef0 0x7fec0019ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.920+0000 7fec06a3d640 1 --2- 172.21.15.92:0/2509613733 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7febec0a3240 0x7febec0a5700 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.920+0000 7fec06a3d640 1 --2- 172.21.15.92:0/2509613733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec00102570 0x7fec00198aa0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.920+0000 7fec06a3d640 1 --2- 172.21.15.92:0/2509613733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec00100e20 0x7fec00198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:25.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.920+0000 7fec06a3d640 1 -- 172.21.15.92:0/2509613733 >> 172.21.15.92:0/2509613733 conn(0x7fec000fc7d0 msgr2=0x7fec0006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:25.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.924+0000 7fec06a3d640 1 -- 172.21.15.92:0/2509613733 shutdown_connections 2024-09-19T09:01:25.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:25.926+0000 7fec06a3d640 1 -- 172.21.15.92:0/2509613733 wait complete. 2024-09-19T09:01:26.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:26 smithi092 ceph-mon[31407]: scrub queued for path: / 2024-09-19T09:01:26.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:26 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:01:26.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:26 smithi092 ceph-mon[31407]: scrub summary: active paths [/] 2024-09-19T09:01:26.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:26 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:01:26.647 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '73785ebf', total seconds elapsed: 33.6 2024-09-19T09:01:26.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:26 smithi167 ceph-mon[35359]: scrub queued for path: / 2024-09-19T09:01:26.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:26 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:01:26.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:26 smithi167 ceph-mon[35359]: scrub summary: active paths [/] 2024-09-19T09:01:26.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:26 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:01:26.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:26 smithi190 ceph-mon[35358]: scrub queued for path: / 2024-09-19T09:01:26.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:26 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:01:26.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:26 smithi190 ceph-mon[35358]: scrub summary: active paths [/] 2024-09-19T09:01:26.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:26 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:01:27.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.060+0000 7f7be19bc640 1 -- 172.21.15.92:0/654408898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7bdc108e00 msgr2=0x7f7bdc10ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:27.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.060+0000 7f7be19bc640 1 --2- 172.21.15.92:0/654408898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7bdc108e00 0x7f7bdc10ce00 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0009900 tx=0x7f7bd002a3f0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.061+0000 7f7be19bc640 1 -- 172.21.15.92:0/654408898 shutdown_connections 2024-09-19T09:01:27.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.061+0000 7f7be19bc640 1 --2- 172.21.15.92:0/654408898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bdc10d530 0x7f7bdc1150b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.061+0000 7f7be19bc640 1 --2- 172.21.15.92:0/654408898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7bdc108e00 0x7f7bdc10ce00 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.061+0000 7f7be19bc640 1 --2- 172.21.15.92:0/654408898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7bdc108450 0x7f7bdc108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.061+0000 7f7be19bc640 1 -- 172.21.15.92:0/654408898 >> 172.21.15.92:0/654408898 conn(0x7f7bdc077ba0 msgr2=0x7f7bdc079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:27.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.061+0000 7f7be19bc640 1 -- 172.21.15.92:0/654408898 shutdown_connections 2024-09-19T09:01:27.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.061+0000 7f7be19bc640 1 -- 172.21.15.92:0/654408898 wait complete. 2024-09-19T09:01:27.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.062+0000 7f7be19bc640 1 Processor -- start 2024-09-19T09:01:27.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.062+0000 7f7be19bc640 1 -- start start 2024-09-19T09:01:27.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.063+0000 7f7be19bc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7bdc108450 0x7f7bdc06d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:27.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.063+0000 7f7be19bc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7bdc108e00 0x7f7bdc06dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:27.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.063+0000 7f7be19bc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bdc10d530 0x7f7bdc071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:27.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.063+0000 7f7be19bc640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7bdc06bfa0 con 0x7f7bdc108e00 2024-09-19T09:01:27.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.063+0000 7f7be19bc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7bdc06be20 con 0x7f7bdc10d530 2024-09-19T09:01:27.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.063+0000 7f7be19bc640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7bdc06c120 con 0x7f7bdc108450 2024-09-19T09:01:27.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.063+0000 7f7bdaffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7bdc108450 0x7f7bdc06d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:27.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.063+0000 7f7bdaffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7bdc108450 0x7f7bdc06d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:55514/0 (socket says 172.21.15.92:55514) 2024-09-19T09:01:27.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.063+0000 7f7bdaffd640 1 -- 172.21.15.92:0/3001601596 learned_addr learned my addr 172.21.15.92:0/3001601596 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:27.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.063+0000 7f7bda7fc640 1 --2- 172.21.15.92:0/3001601596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7bdc108e00 0x7f7bdc06dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:27.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.064+0000 7f7bdb7fe640 1 --2- 172.21.15.92:0/3001601596 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bdc10d530 0x7f7bdc071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:27.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.064+0000 7f7bdaffd640 1 -- 172.21.15.92:0/3001601596 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bdc10d530 msgr2=0x7f7bdc071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:27.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.064+0000 7f7bdaffd640 1 --2- 172.21.15.92:0/3001601596 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bdc10d530 0x7f7bdc071fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.064+0000 7f7bdaffd640 1 -- 172.21.15.92:0/3001601596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7bdc108e00 msgr2=0x7f7bdc06dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:27.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.064+0000 7f7bdaffd640 1 --2- 172.21.15.92:0/3001601596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7bdc108e00 0x7f7bdc06dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.064+0000 7f7bdaffd640 1 -- 172.21.15.92:0/3001601596 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bdc072580 con 0x7f7bdc108450 2024-09-19T09:01:27.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.064+0000 7f7bdaffd640 1 --2- 172.21.15.92:0/3001601596 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7bdc108450 0x7f7bdc06d740 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc00d770 tx=0x7f7bcc00dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:27.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.064+0000 7f7be09ba640 1 -- 172.21.15.92:0/3001601596 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc017070 con 0x7f7bdc108450 2024-09-19T09:01:27.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.065+0000 7f7be09ba640 1 -- 172.21.15.92:0/3001601596 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bcc005500 con 0x7f7bdc108450 2024-09-19T09:01:27.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.065+0000 7f7be09ba640 1 -- 172.21.15.92:0/3001601596 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc004e00 con 0x7f7bdc108450 2024-09-19T09:01:27.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.065+0000 7f7be19bc640 1 -- 172.21.15.92:0/3001601596 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bdc072870 con 0x7f7bdc108450 2024-09-19T09:01:27.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.065+0000 7f7be19bc640 1 -- 172.21.15.92:0/3001601596 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bdc072d30 con 0x7f7bdc108450 2024-09-19T09:01:27.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.069+0000 7f7be09ba640 1 -- 172.21.15.92:0/3001601596 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7bcc010460 con 0x7f7bdc108450 2024-09-19T09:01:27.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.069+0000 7f7be3d95740 1 Processor -- start 2024-09-19T09:01:27.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.071+0000 7f7be09ba640 1 --2- 172.21.15.92:0/3001601596 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7bc40a32c0 0x7f7bc40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:27.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.071+0000 7f7be3d95740 1 -- start start 2024-09-19T09:01:27.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.071+0000 7f7be09ba640 1 -- 172.21.15.92:0/3001601596 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f7bcc0cf330 con 0x7f7bdc108450 2024-09-19T09:01:27.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.071+0000 7f7bdb7fe640 1 --2- 172.21.15.92:0/3001601596 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7bc40a32c0 0x7f7bc40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:27.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.071+0000 7f7be3d95740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559665d34a0 0x5559665d3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:27.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.071+0000 7f7be3d95740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559665d3dc0 0x5559665de140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:27.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.072+0000 7f7be3d95740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559665de680 0x5559665e0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:27.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.072+0000 7f7be3d95740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5559665392e0 con 0x5559665de680 2024-09-19T09:01:27.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.072+0000 7f7be3d95740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5559664e0ce0 con 0x5559665d34a0 2024-09-19T09:01:27.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.072+0000 7f7bda7fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559665d3dc0 0x5559665de140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:27.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.072+0000 7f7bda7fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559665d3dc0 0x5559665de140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:55516/0 (socket says 172.21.15.92:55516) 2024-09-19T09:01:27.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.072+0000 7f7bda7fc640 1 -- 172.21.15.92:0/3234808062 learned_addr learned my addr 172.21.15.92:0/3234808062 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:27.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.072+0000 7f7bdaffd640 1 --2- 172.21.15.92:0/3234808062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559665d34a0 0x5559665d3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:27.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.072+0000 7f7bdb7fe640 1 --2- 172.21.15.92:0/3234808062 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559665de680 0x5559665e0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:27.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.072+0000 7f7be3d95740 1 -- 172.21.15.92:0/3234808062 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5559665352a0 con 0x5559665d3dc0 2024-09-19T09:01:27.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.073+0000 7f7bdb7fe640 1 --2- 172.21.15.92:0/3001601596 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7bc40a32c0 0x7f7bc40a5780 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4005fd0 tx=0x7f7bd4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:27.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.073+0000 7f7bdaffd640 1 -- 172.21.15.92:0/3234808062 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559665d3dc0 msgr2=0x5559665de140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:27.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.073+0000 7f7bdaffd640 1 --2- 172.21.15.92:0/3234808062 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559665d3dc0 0x5559665de140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.073+0000 7f7bdaffd640 1 -- 172.21.15.92:0/3234808062 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559665de680 msgr2=0x5559665e0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:27.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.073+0000 7f7bdaffd640 1 --2- 172.21.15.92:0/3234808062 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559665de680 0x5559665e0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.073+0000 7f7bdaffd640 1 -- 172.21.15.92:0/3234808062 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559664c5440 con 0x5559665d34a0 2024-09-19T09:01:27.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.073+0000 7f7bdb7fe640 1 --2- 172.21.15.92:0/3234808062 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559665de680 0x5559665e0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:27.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.073+0000 7f7bdaffd640 1 --2- 172.21.15.92:0/3234808062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559665d34a0 0x5559665d3880 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc0cce30 tx=0x7f7bcc097d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99b34fc82fab12a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:27.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.073+0000 7f7bc1ffb640 1 -- 172.21.15.92:0/3234808062 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc020070 con 0x5559665d34a0 2024-09-19T09:01:27.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.073+0000 7f7bc1ffb640 1 -- 172.21.15.92:0/3234808062 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bcc09fd00 con 0x5559665d34a0 2024-09-19T09:01:27.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.073+0000 7f7bc1ffb640 1 -- 172.21.15.92:0/3234808062 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc020070 con 0x5559665d34a0 2024-09-19T09:01:27.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.075+0000 7f7be3d95740 1 -- 172.21.15.92:0/3234808062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559665d34a0 msgr2=0x5559665d3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:27.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.075+0000 7f7be3d95740 1 --2- 172.21.15.92:0/3234808062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559665d34a0 0x5559665d3880 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc0cce30 tx=0x7f7bcc097d60 comp rx=0 tx=0).stop 2024-09-19T09:01:27.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.075+0000 7f7be3d95740 1 -- 172.21.15.92:0/3234808062 shutdown_connections 2024-09-19T09:01:27.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.075+0000 7f7be3d95740 1 --2- 172.21.15.92:0/3234808062 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559665de680 0x5559665e0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.075+0000 7f7be3d95740 1 --2- 172.21.15.92:0/3234808062 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559665d3dc0 0x5559665de140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.075+0000 7f7be3d95740 1 --2- 172.21.15.92:0/3234808062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559665d34a0 0x5559665d3880 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.075+0000 7f7be3d95740 1 -- 172.21.15.92:0/3234808062 >> 172.21.15.92:0/3234808062 conn(0x5559665cfa30 msgr2=0x5559665cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:27.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.075+0000 7f7be3d95740 1 -- 172.21.15.92:0/3234808062 shutdown_connections 2024-09-19T09:01:27.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.075+0000 7f7be3d95740 1 -- 172.21.15.92:0/3234808062 wait complete. 2024-09-19T09:01:27.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.076+0000 7f7be3d95740 1 -- start start 2024-09-19T09:01:27.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.076+0000 7f7be3d95740 1 Processor -- start 2024-09-19T09:01:27.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.076+0000 7f7be3d95740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559665d34a0 0x5559665ddf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:27.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.077+0000 7f7be3d95740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559665d3dc0 0x5559665db1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:27.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.077+0000 7f7be3d95740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559665de680 0x5559665db6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:27.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.077+0000 7f7bda7fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559665d3dc0 0x5559665db1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:27.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.077+0000 7f7bda7fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559665d3dc0 0x5559665db1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:55530/0 (socket says 172.21.15.92:55530) 2024-09-19T09:01:27.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.077+0000 7f7bda7fc640 1 -- 172.21.15.92:0/3468062567 learned_addr learned my addr 172.21.15.92:0/3468062567 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:27.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.077+0000 7f7bdb7fe640 1 --2- 172.21.15.92:0/3468062567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559665de680 0x5559665db6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:27.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.077+0000 7f7be3d95740 1 -- 172.21.15.92:0/3468062567 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5559665e1250 con 0x5559665d34a0 2024-09-19T09:01:27.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.077+0000 7f7be3d95740 1 -- 172.21.15.92:0/3468062567 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5559664f4050 con 0x5559665de680 2024-09-19T09:01:27.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.077+0000 7f7be3d95740 1 -- 172.21.15.92:0/3468062567 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5559665e13d0 con 0x5559665d3dc0 2024-09-19T09:01:27.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.077+0000 7f7be3d95740 10 client.0 _ll_register_callbacks cb 0x555966534160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:27.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.077+0000 7f7bdaffd640 1 --2- 172.21.15.92:0/3468062567 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559665d34a0 0x5559665ddf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:27.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.078+0000 7f7bdb7fe640 1 -- 172.21.15.92:0/3468062567 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559665d3dc0 msgr2=0x5559665db1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:27.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.078+0000 7f7bdb7fe640 1 --2- 172.21.15.92:0/3468062567 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559665d3dc0 0x5559665db1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.078+0000 7f7bdb7fe640 1 -- 172.21.15.92:0/3468062567 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559665d34a0 msgr2=0x5559665ddf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:27.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.078+0000 7f7bdb7fe640 1 --2- 172.21.15.92:0/3468062567 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559665d34a0 0x5559665ddf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.078+0000 7f7bdb7fe640 1 -- 172.21.15.92:0/3468062567 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559662aa3c0 con 0x5559665de680 2024-09-19T09:01:27.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.078+0000 7f7bdaffd640 1 --2- 172.21.15.92:0/3468062567 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559665d34a0 0x5559665ddf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:01:27.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.078+0000 7f7bdb7fe640 1 --2- 172.21.15.92:0/3468062567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559665de680 0x5559665db6f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7bd400fbc0 tx=0x7f7bd4004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21a1f86a1af0b270 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:27.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.078+0000 7f7bbaffd640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:01:27.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.079+0000 7f7bbaffd640 1 -- 172.21.15.92:0/3468062567 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd4027440 con 0x5559665de680 2024-09-19T09:01:27.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.079+0000 7f7bbaffd640 1 -- 172.21.15.92:0/3468062567 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f7bd40263e0 con 0x5559665de680 2024-09-19T09:01:27.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.079+0000 7f7be3d95740 1 -- 172.21.15.92:0/3468062567 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7bcc09fd00 con 0x5559665de680 2024-09-19T09:01:27.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.079+0000 7f7bbaffd640 1 -- 172.21.15.92:0/3468062567 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7bd4026620 con 0x5559665de680 2024-09-19T09:01:27.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.080+0000 7f7be3d95740 10 client.25916 fetch_fsmap learned FSMap version 19 2024-09-19T09:01:27.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.080+0000 7f7be3d95740 1 -- 172.21.15.92:0/3468062567 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5559665ecc30 con 0x5559665de680 2024-09-19T09:01:27.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.080+0000 7f7bbaffd640 1 -- 172.21.15.92:0/3468062567 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bcc09fd00 con 0x5559665de680 2024-09-19T09:01:27.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.081+0000 7f7bbaffd640 1 -- 172.21.15.92:0/3468062567 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f7bd4025070 con 0x5559665de680 2024-09-19T09:01:27.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.081+0000 7f7be3d95740 10 client.25916 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:01:27.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.081+0000 7f7be3d95740 10 client.25916 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:01:27.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.081+0000 7f7be3d95740 20 client.25916 populate_metadata read hostname 'smithi092' 2024-09-19T09:01:27.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.081+0000 7f7be3d95740 1 --2- 172.21.15.92:0/3468062567 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5559665ee0e0 0x5559665f0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:27.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.081+0000 7f7be3d95740 4 client.25916 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:01:27.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.081+0000 7f7be3d95740 1 -- 172.21.15.92:0/3468062567 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555966546850 con 0x5559665ee0e0 2024-09-19T09:01:27.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.081+0000 7f7bdaffd640 1 --2- 172.21.15.92:0/3468062567 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5559665ee0e0 0x5559665f0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:27.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.082+0000 7f7bdaffd640 1 --2- 172.21.15.92:0/3468062567 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5559665ee0e0 0x5559665f0580 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8192bdab0b7ba4e2 server_cookie=dbf09151adea69cc in_seq=0 out_seq=0 2024-09-19T09:01:27.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.082+0000 7f7bbaffd640 10 client.25916 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:27.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.083+0000 7f7bbaffd640 1 -- 172.21.15.92:0/3468062567 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555966546850 con 0x5559665ee0e0 2024-09-19T09:01:27.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.083+0000 7f7bbaffd640 10 client.25916 handle_command_reply: tid=0 2024-09-19T09:01:27.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.083+0000 7f7be3d95740 1 client.25916 shutdown 2024-09-19T09:01:27.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.083+0000 7f7be3d95740 1 -- 172.21.15.92:0/3468062567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559665de680 msgr2=0x5559665db6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:27.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.083+0000 7f7be3d95740 1 --2- 172.21.15.92:0/3468062567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559665de680 0x5559665db6f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7bd400fbc0 tx=0x7f7bd4004a40 comp rx=0 tx=0).stop 2024-09-19T09:01:27.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.083+0000 7f7be3d95740 1 -- 172.21.15.92:0/3468062567 shutdown_connections 2024-09-19T09:01:27.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.083+0000 7f7be3d95740 1 --2- 172.21.15.92:0/3468062567 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5559665ee0e0 0x5559665f0580 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.083+0000 7f7be3d95740 1 --2- 172.21.15.92:0/3468062567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559665de680 0x5559665db6f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.083+0000 7f7be3d95740 1 --2- 172.21.15.92:0/3468062567 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559665d3dc0 0x5559665db1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.083+0000 7f7be3d95740 1 --2- 172.21.15.92:0/3468062567 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559665d34a0 0x5559665ddf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.083+0000 7f7be3d95740 1 -- 172.21.15.92:0/3468062567 >> 172.21.15.92:0/3468062567 conn(0x5559665cfa30 msgr2=0x5559665d5710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:27.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.083+0000 7f7bbaffd640 0 client.25916 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:27.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.084+0000 7f7be3d95740 1 -- 172.21.15.92:0/3468062567 shutdown_connections 2024-09-19T09:01:27.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.084+0000 7f7be3d95740 1 -- 172.21.15.92:0/3468062567 wait complete. 2024-09-19T09:01:27.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.084+0000 7f7be3d95740 20 client.25916 trim_cache size 0 max 16384 2024-09-19T09:01:27.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.114+0000 7f7be3d95740 1 Processor -- start 2024-09-19T09:01:27.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.114+0000 7f7be3d95740 1 -- start start 2024-09-19T09:01:27.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.114+0000 7f7be3d95740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559665d34a0 0x5559665dd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:27.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.114+0000 7f7be3d95740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559665d3dc0 0x5559665f5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:27.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.114+0000 7f7be3d95740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559665de680 0x5559665f6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:27.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.114+0000 7f7be3d95740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc800c520 con 0x5559665de680 2024-09-19T09:01:27.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.114+0000 7f7be3d95740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc800edc0 con 0x5559665d3dc0 2024-09-19T09:01:27.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.114+0000 7f7be3d95740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc800cbb0 con 0x5559665d34a0 2024-09-19T09:01:27.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.114+0000 7f7bda7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559665d3dc0 0x5559665f5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:27.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.114+0000 7f7bda7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559665d3dc0 0x5559665f5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:33394/0 (socket says 172.21.15.92:33394) 2024-09-19T09:01:27.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.114+0000 7f7bda7fc640 1 -- 172.21.15.92:0/3576577434 learned_addr learned my addr 172.21.15.92:0/3576577434 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:27.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.114+0000 7f7bdb7fe640 1 --2- 172.21.15.92:0/3576577434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559665de680 0x5559665f6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:27.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.114+0000 7f7bdaffd640 1 --2- 172.21.15.92:0/3576577434 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559665d34a0 0x5559665dd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:27.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.115+0000 7f7bda7fc640 1 -- 172.21.15.92:0/3576577434 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559665d34a0 msgr2=0x5559665dd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:27.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.115+0000 7f7bda7fc640 1 --2- 172.21.15.92:0/3576577434 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559665d34a0 0x5559665dd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.115+0000 7f7bda7fc640 1 -- 172.21.15.92:0/3576577434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559665de680 msgr2=0x5559665f6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:27.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.115+0000 7f7bda7fc640 1 --2- 172.21.15.92:0/3576577434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559665de680 0x5559665f6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.115+0000 7f7bda7fc640 1 -- 172.21.15.92:0/3576577434 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559665cf860 con 0x5559665d3dc0 2024-09-19T09:01:27.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.115+0000 7f7bda7fc640 1 --2- 172.21.15.92:0/3576577434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559665d3dc0 0x5559665f5e50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0009230 tx=0x7f7bd0031660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89aae2f93d8d5fbb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:27.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.115+0000 7f7bc17fa640 1 -- 172.21.15.92:0/3576577434 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd0035020 con 0x5559665d3dc0 2024-09-19T09:01:27.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.116+0000 7f7bc17fa640 1 -- 172.21.15.92:0/3576577434 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bd0005350 con 0x5559665d3dc0 2024-09-19T09:01:27.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.116+0000 7f7bc17fa640 1 -- 172.21.15.92:0/3576577434 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd0031da0 con 0x5559665d3dc0 2024-09-19T09:01:27.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.117+0000 7f7be3d95740 1 -- 172.21.15.92:0/3576577434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559665d3dc0 msgr2=0x5559665f5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:27.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.117+0000 7f7be3d95740 1 --2- 172.21.15.92:0/3576577434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559665d3dc0 0x5559665f5e50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0009230 tx=0x7f7bd0031660 comp rx=0 tx=0).stop 2024-09-19T09:01:27.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.117+0000 7f7be3d95740 1 -- 172.21.15.92:0/3576577434 shutdown_connections 2024-09-19T09:01:27.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.117+0000 7f7be3d95740 1 --2- 172.21.15.92:0/3576577434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559665de680 0x5559665f6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.117+0000 7f7be3d95740 1 --2- 172.21.15.92:0/3576577434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559665d3dc0 0x5559665f5e50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.117+0000 7f7be3d95740 1 --2- 172.21.15.92:0/3576577434 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559665d34a0 0x5559665dd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.117+0000 7f7be3d95740 1 -- 172.21.15.92:0/3576577434 >> 172.21.15.92:0/3576577434 conn(0x5559665cfa30 msgr2=0x5559665ceb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:27.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.117+0000 7f7be3d95740 1 -- 172.21.15.92:0/3576577434 shutdown_connections 2024-09-19T09:01:27.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.117+0000 7f7be3d95740 1 -- 172.21.15.92:0/3576577434 wait complete. 2024-09-19T09:01:27.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.117+0000 7f7be3d95740 1 -- start start 2024-09-19T09:01:27.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.118+0000 7f7be3d95740 1 Processor -- start 2024-09-19T09:01:27.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.118+0000 7f7be3d95740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559665d34a0 0x5559665e6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:27.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.118+0000 7f7be3d95740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559665d3dc0 0x5559665e4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:27.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.118+0000 7f7be3d95740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559665de680 0x5559665e4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:27.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.118+0000 7f7be3d95740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc800d280 con 0x5559665d34a0 2024-09-19T09:01:27.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.118+0000 7f7be3d95740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc800e6f0 con 0x5559665d3dc0 2024-09-19T09:01:27.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.118+0000 7f7be3d95740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc800d950 con 0x5559665de680 2024-09-19T09:01:27.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.118+0000 7f7be3d95740 10 client.0 _ll_register_callbacks cb 0x7f7bdc06b600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:27.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.118+0000 7f7bdaffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559665d34a0 0x5559665e6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:27.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.118+0000 7f7bdaffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559665d34a0 0x5559665e6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59352/0 (socket says 172.21.15.92:59352) 2024-09-19T09:01:27.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.118+0000 7f7bdaffd640 1 -- 172.21.15.92:0/1802647717 learned_addr learned my addr 172.21.15.92:0/1802647717 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:27.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.118+0000 7f7bdb7fe640 1 --2- 172.21.15.92:0/1802647717 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559665de680 0x5559665e4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:27.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.118+0000 7f7bda7fc640 1 --2- 172.21.15.92:0/1802647717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559665d3dc0 0x5559665e4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:27.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.119+0000 7f7bdb7fe640 1 -- 172.21.15.92:0/1802647717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559665d3dc0 msgr2=0x5559665e4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:27.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.119+0000 7f7bdb7fe640 1 --2- 172.21.15.92:0/1802647717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559665d3dc0 0x5559665e4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.119+0000 7f7bdb7fe640 1 -- 172.21.15.92:0/1802647717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559665d34a0 msgr2=0x5559665e6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:27.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.119+0000 7f7bdb7fe640 1 --2- 172.21.15.92:0/1802647717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559665d34a0 0x5559665e6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.119+0000 7f7bdb7fe640 1 -- 172.21.15.92:0/1802647717 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555966657e30 con 0x5559665de680 2024-09-19T09:01:27.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.120+0000 7f7bdb7fe640 1 --2- 172.21.15.92:0/1802647717 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559665de680 0x5559665e4a00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4011810 tx=0x7f7bd401e370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50fc3e75fce1c9c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:27.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.120+0000 7f7bbaffd640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:01:27.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.120+0000 7f7bbaffd640 1 -- 172.21.15.92:0/1802647717 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd4035070 con 0x5559665de680 2024-09-19T09:01:27.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.120+0000 7f7be3d95740 1 -- 172.21.15.92:0/1802647717 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7bd0005350 con 0x5559665de680 2024-09-19T09:01:27.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.120+0000 7f7bbaffd640 1 -- 172.21.15.92:0/1802647717 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f7bd40267c0 con 0x5559665de680 2024-09-19T09:01:27.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.120+0000 7f7bbaffd640 1 -- 172.21.15.92:0/1802647717 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7bd4041050 con 0x5559665de680 2024-09-19T09:01:27.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.120+0000 7f7be3d95740 10 client.25837 fetch_fsmap learned FSMap version 19 2024-09-19T09:01:27.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.120+0000 7f7be3d95740 1 -- 172.21.15.92:0/1802647717 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x555966658ff0 con 0x5559665de680 2024-09-19T09:01:27.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.121+0000 7f7bbaffd640 1 -- 172.21.15.92:0/1802647717 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bd0005350 con 0x5559665de680 2024-09-19T09:01:27.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.121+0000 7f7bbaffd640 1 -- 172.21.15.92:0/1802647717 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f7bd4025050 con 0x5559665de680 2024-09-19T09:01:27.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.121+0000 7f7be3d95740 10 client.25837 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:01:27.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.121+0000 7f7be3d95740 10 client.25837 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:01:27.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.121+0000 7f7be3d95740 20 client.25837 populate_metadata read hostname 'smithi092' 2024-09-19T09:01:27.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.121+0000 7f7be3d95740 1 --2- 172.21.15.92:0/1802647717 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555966659710 0x55596665bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:27.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.121+0000 7f7be3d95740 4 client.25837 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:01:27.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.121+0000 7f7be3d95740 1 -- 172.21.15.92:0/1802647717 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555966540d60 con 0x555966659710 2024-09-19T09:01:27.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.121+0000 7f7bdaffd640 1 --2- 172.21.15.92:0/1802647717 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555966659710 0x55596665bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:27.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.122+0000 7f7bbaffd640 10 client.25837 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:27.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.122+0000 7f7bdaffd640 1 --2- 172.21.15.92:0/1802647717 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555966659710 0x55596665bb30 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=167983f12da51104 server_cookie=bbf2aeac038b4fb2 in_seq=0 out_seq=0 2024-09-19T09:01:27.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.122+0000 7f7bbaffd640 1 -- 172.21.15.92:0/1802647717 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x555966540d60 con 0x555966659710 2024-09-19T09:01:27.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.122+0000 7f7bbaffd640 10 client.25837 handle_command_reply: tid=0 2024-09-19T09:01:27.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.122+0000 7f7be3d95740 1 client.25837 shutdown 2024-09-19T09:01:27.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.122+0000 7f7be3d95740 1 -- 172.21.15.92:0/1802647717 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559665de680 msgr2=0x5559665e4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:27.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.122+0000 7f7be3d95740 1 --2- 172.21.15.92:0/1802647717 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559665de680 0x5559665e4a00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4011810 tx=0x7f7bd401e370 comp rx=0 tx=0).stop 2024-09-19T09:01:27.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.123+0000 7f7be3d95740 1 -- 172.21.15.92:0/1802647717 shutdown_connections 2024-09-19T09:01:27.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.123+0000 7f7be3d95740 1 --2- 172.21.15.92:0/1802647717 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555966659710 0x55596665bb30 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.123+0000 7f7be3d95740 1 --2- 172.21.15.92:0/1802647717 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5559665de680 0x5559665e4a00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.123+0000 7f7be3d95740 1 --2- 172.21.15.92:0/1802647717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5559665d3dc0 0x5559665e4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.123+0000 7f7bbaffd640 0 client.25837 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:27.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.123+0000 7f7be3d95740 1 --2- 172.21.15.92:0/1802647717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559665d34a0 0x5559665e6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.123+0000 7f7be3d95740 1 -- 172.21.15.92:0/1802647717 >> 172.21.15.92:0/1802647717 conn(0x5559665cfa30 msgr2=0x5559665daa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:27.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.123+0000 7f7be3d95740 1 -- 172.21.15.92:0/1802647717 shutdown_connections 2024-09-19T09:01:27.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.123+0000 7f7be3d95740 1 -- 172.21.15.92:0/1802647717 wait complete. 2024-09-19T09:01:27.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.123+0000 7f7be3d95740 20 client.25837 trim_cache size 0 max 16384 2024-09-19T09:01:27.127 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:01:27.128 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:01:27.128 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": { 2024-09-19T09:01:27.128 INFO:teuthology.orchestra.run.smithi092.stdout: "5a32ff6e-d36c-4719-9151-bd9bd873f188": { 2024-09-19T09:01:27.128 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-19T09:01:27.128 INFO:teuthology.orchestra.run.smithi092.stdout: "tag": "5a32ff6e-d36c-4719-9151-bd9bd873f188", 2024-09-19T09:01:27.128 INFO:teuthology.orchestra.run.smithi092.stdout: "options": "recursive,force" 2024-09-19T09:01:27.128 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:01:27.128 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:01:27.128 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:01:27.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.124+0000 7f7be19bc640 1 -- 172.21.15.92:0/3001601596 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7bc40a32c0 msgr2=0x7f7bc40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:27.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.124+0000 7f7be19bc640 1 --2- 172.21.15.92:0/3001601596 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7bc40a32c0 0x7f7bc40a5780 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4005fd0 tx=0x7f7bd4009500 comp rx=0 tx=0).stop 2024-09-19T09:01:27.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.124+0000 7f7be19bc640 1 -- 172.21.15.92:0/3001601596 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7bdc108450 msgr2=0x7f7bdc06d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:27.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.124+0000 7f7be19bc640 1 --2- 172.21.15.92:0/3001601596 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7bdc108450 0x7f7bdc06d740 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc00d770 tx=0x7f7bcc00dc30 comp rx=0 tx=0).stop 2024-09-19T09:01:27.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.124+0000 7f7be19bc640 1 -- 172.21.15.92:0/3001601596 shutdown_connections 2024-09-19T09:01:27.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.124+0000 7f7be19bc640 1 --2- 172.21.15.92:0/3001601596 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bdc10d530 0x7f7bdc071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.124+0000 7f7be19bc640 1 --2- 172.21.15.92:0/3001601596 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7bc40a32c0 0x7f7bc40a5780 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.124+0000 7f7be19bc640 1 --2- 172.21.15.92:0/3001601596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7bdc108e00 0x7f7bdc06dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.124+0000 7f7be19bc640 1 --2- 172.21.15.92:0/3001601596 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7bdc108450 0x7f7bdc06d740 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:27.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.124+0000 7f7be19bc640 1 -- 172.21.15.92:0/3001601596 >> 172.21.15.92:0/3001601596 conn(0x7f7bdc077ba0 msgr2=0x7f7bdc078ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:27.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.124+0000 7f7be19bc640 1 -- 172.21.15.92:0/3001601596 shutdown_connections 2024-09-19T09:01:27.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:27.124+0000 7f7be19bc640 1 -- 172.21.15.92:0/3001601596 wait complete. 2024-09-19T09:01:27.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:27 smithi092 ceph-mon[31407]: pgmap v479: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.5 MiB/s wr, 59 op/s 2024-09-19T09:01:27.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:27 smithi167 ceph-mon[35359]: pgmap v479: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.5 MiB/s wr, 59 op/s 2024-09-19T09:01:27.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:27 smithi190 ceph-mon[35358]: pgmap v479: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.5 MiB/s wr, 59 op/s 2024-09-19T09:01:27.922 INFO:tasks.cephfs.filesystem:scrub status for tag:5a32ff6e-d36c-4719-9151-bd9bd873f188 - {'path': '/', 'tag': '5a32ff6e-d36c-4719-9151-bd9bd873f188', 'options': 'recursive,force'} 2024-09-19T09:01:29.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:29 smithi167 ceph-mon[35359]: pgmap v480: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 7.6 MiB/s wr, 160 op/s 2024-09-19T09:01:29.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:29 smithi167 ceph-mon[35359]: scrub summary: idle 2024-09-19T09:01:29.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:29 smithi190 ceph-mon[35358]: pgmap v480: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 7.6 MiB/s wr, 160 op/s 2024-09-19T09:01:29.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:29 smithi190 ceph-mon[35358]: scrub summary: idle 2024-09-19T09:01:30.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:29 smithi092 ceph-mon[31407]: pgmap v480: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 7.6 MiB/s wr, 160 op/s 2024-09-19T09:01:30.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:29 smithi092 ceph-mon[31407]: scrub summary: idle 2024-09-19T09:01:30.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 285.0 s, 4585.3 tps, lat 150.302 ms stddev 1953.960 2024-09-19T09:01:31.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:31 smithi167 ceph-mon[35359]: pgmap v481: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 12 MiB/s wr, 340 op/s 2024-09-19T09:01:31.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:31 smithi190 ceph-mon[35358]: pgmap v481: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 12 MiB/s wr, 340 op/s 2024-09-19T09:01:32.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:31 smithi092 ceph-mon[31407]: pgmap v481: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 12 MiB/s wr, 340 op/s 2024-09-19T09:01:33.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:33 smithi167 ceph-mon[35359]: pgmap v482: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 14 MiB/s wr, 448 op/s 2024-09-19T09:01:33.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:33 smithi190 ceph-mon[35358]: pgmap v482: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 14 MiB/s wr, 448 op/s 2024-09-19T09:01:34.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:33 smithi092 ceph-mon[31407]: pgmap v482: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 14 MiB/s wr, 448 op/s 2024-09-19T09:01:35.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.072+0000 7ff78d035640 1 -- 172.21.15.92:0/2721211930 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7780319b0 con 0x7ff788101c30 2024-09-19T09:01:35.073 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.073+0000 7ff79029b640 1 -- 172.21.15.92:0/2721211930 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff788101c30 msgr2=0x7ff7881020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:35.073 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.073+0000 7ff79029b640 1 --2- 172.21.15.92:0/2721211930 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff788101c30 0x7ff7881020b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff778009900 tx=0x7ff77802a410 comp rx=0 tx=0).stop 2024-09-19T09:01:35.073 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.073+0000 7ff79029b640 1 -- 172.21.15.92:0/2721211930 shutdown_connections 2024-09-19T09:01:35.074 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.073+0000 7ff79029b640 1 --2- 172.21.15.92:0/2721211930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7881025f0 0x7ff788108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.074 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.073+0000 7ff79029b640 1 --2- 172.21.15.92:0/2721211930 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff788101c30 0x7ff7881020b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.074 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.073+0000 7ff79029b640 1 --2- 172.21.15.92:0/2721211930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff788100a40 0x7ff788100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.074 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.073+0000 7ff79029b640 1 -- 172.21.15.92:0/2721211930 >> 172.21.15.92:0/2721211930 conn(0x7ff7880fc1e0 msgr2=0x7ff7880fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:35.074 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.073+0000 7ff79029b640 1 -- 172.21.15.92:0/2721211930 shutdown_connections 2024-09-19T09:01:35.074 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.073+0000 7ff79029b640 1 -- 172.21.15.92:0/2721211930 wait complete. 2024-09-19T09:01:35.074 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.074+0000 7ff79029b640 1 Processor -- start 2024-09-19T09:01:35.074 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.074+0000 7ff79029b640 1 -- start start 2024-09-19T09:01:35.075 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.075+0000 7ff79029b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff788100a40 0x7ff78819e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.075 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.075+0000 7ff79029b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff788101c30 0x7ff78819e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.075 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.075+0000 7ff79029b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7881025f0 0x7ff7881a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.075 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.075+0000 7ff79029b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff78810b5e0 con 0x7ff788101c30 2024-09-19T09:01:35.075 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.075+0000 7ff79029b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff78810b460 con 0x7ff7881025f0 2024-09-19T09:01:35.075 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.075+0000 7ff79029b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff78810b760 con 0x7ff788100a40 2024-09-19T09:01:35.076 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.075+0000 7ff78e838640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7881025f0 0x7ff7881a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.076 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.075+0000 7ff78e037640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff788100a40 0x7ff78819e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.076 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.075+0000 7ff78e838640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7881025f0 0x7ff7881a5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:51826/0 (socket says 172.21.15.92:51826) 2024-09-19T09:01:35.076 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.075+0000 7ff78e838640 1 -- 172.21.15.92:0/83608093 learned_addr learned my addr 172.21.15.92:0/83608093 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:35.076 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.075+0000 7ff78d836640 1 --2- 172.21.15.92:0/83608093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff788101c30 0x7ff78819e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.076 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.075+0000 7ff78e838640 1 -- 172.21.15.92:0/83608093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff788100a40 msgr2=0x7ff78819e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:35.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.075+0000 7ff78e838640 1 --2- 172.21.15.92:0/83608093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff788100a40 0x7ff78819e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.075+0000 7ff78e838640 1 -- 172.21.15.92:0/83608093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff788101c30 msgr2=0x7ff78819e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:35.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.075+0000 7ff78e838640 1 --2- 172.21.15.92:0/83608093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff788101c30 0x7ff78819e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.075+0000 7ff78e838640 1 -- 172.21.15.92:0/83608093 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7881a5fe0 con 0x7ff7881025f0 2024-09-19T09:01:35.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.076+0000 7ff78e838640 1 --2- 172.21.15.92:0/83608093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7881025f0 0x7ff7881a5970 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff78400d950 tx=0x7ff78400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:35.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.076+0000 7ff77f7fe640 1 -- 172.21.15.92:0/83608093 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff784017030 con 0x7ff7881025f0 2024-09-19T09:01:35.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.076+0000 7ff79029b640 1 -- 172.21.15.92:0/83608093 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7881a62d0 con 0x7ff7881025f0 2024-09-19T09:01:35.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.076+0000 7ff77f7fe640 1 -- 172.21.15.92:0/83608093 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff784004020 con 0x7ff7881025f0 2024-09-19T09:01:35.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.076+0000 7ff77f7fe640 1 -- 172.21.15.92:0/83608093 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff784003c00 con 0x7ff7881025f0 2024-09-19T09:01:35.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.076+0000 7ff79029b640 1 -- 172.21.15.92:0/83608093 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7881a67f0 con 0x7ff7881025f0 2024-09-19T09:01:35.079 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.079+0000 7ff77f7fe640 1 -- 172.21.15.92:0/83608093 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff78401a070 con 0x7ff7881025f0 2024-09-19T09:01:35.079 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.079+0000 7ff793032740 1 Processor -- start 2024-09-19T09:01:35.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.080+0000 7ff793032740 1 -- start start 2024-09-19T09:01:35.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.080+0000 7ff793032740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55988d5f19a0 0x55988d5f1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.080+0000 7ff793032740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55988d5f22e0 0x55988d5f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.080+0000 7ff793032740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55988d5f7370 0x55988d5f9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.080+0000 7ff793032740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55988d5552f0 con 0x55988d5f22e0 2024-09-19T09:01:35.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.080+0000 7ff793032740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55988d4fd270 con 0x55988d5f19a0 2024-09-19T09:01:35.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.080+0000 7ff793032740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55988d5512b0 con 0x55988d5f7370 2024-09-19T09:01:35.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.081+0000 7ff78d836640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55988d5f19a0 0x55988d5f1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.083 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.081+0000 7ff78d836640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55988d5f19a0 0x55988d5f1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:51830/0 (socket says 172.21.15.92:51830) 2024-09-19T09:01:35.083 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.081+0000 7ff78d836640 1 -- 172.21.15.92:0/299873619 learned_addr learned my addr 172.21.15.92:0/299873619 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:35.083 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.081+0000 7ff78e037640 1 --2- 172.21.15.92:0/299873619 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55988d5f22e0 0x55988d5f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.083 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.081+0000 7ff78d836640 1 --2- 172.21.15.92:0/299873619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55988d5f7370 0x55988d5f9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.083 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.081+0000 7ff77f7fe640 1 --2- 172.21.15.92:0/83608093 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff7740a3370 0x7ff7740a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.083 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.082+0000 7ff78e838640 1 --2- 172.21.15.92:0/83608093 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff7740a3370 0x7ff7740a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.083 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.082+0000 7ff77f7fe640 1 -- 172.21.15.92:0/83608093 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff7840cf450 con 0x7ff7881025f0 2024-09-19T09:01:35.083 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.082+0000 7ff78e037640 1 -- 172.21.15.92:0/299873619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55988d5f7370 msgr2=0x55988d5f9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:35.083 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.082+0000 7ff78e037640 1 --2- 172.21.15.92:0/299873619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55988d5f7370 0x55988d5f9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.083 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.082+0000 7ff78e037640 1 -- 172.21.15.92:0/299873619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55988d5f19a0 msgr2=0x55988d5f1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:35.083 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.082+0000 7ff78e037640 1 --2- 172.21.15.92:0/299873619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55988d5f19a0 0x55988d5f1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.084 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.082+0000 7ff78e037640 1 -- 172.21.15.92:0/299873619 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55988d4fc340 con 0x55988d5f22e0 2024-09-19T09:01:35.084 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.082+0000 7ff78e037640 1 --2- 172.21.15.92:0/299873619 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55988d5f22e0 0x55988d5f6da0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ff780005fd0 tx=0x7ff7800118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=365aad729cf875a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:35.087 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.082+0000 7ff78e838640 1 --2- 172.21.15.92:0/83608093 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff7740a3370 0x7ff7740a5830 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff78409b770 tx=0x7ff784066400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:35.087 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.082+0000 7ff77cbfe640 1 -- 172.21.15.92:0/299873619 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff780004d20 con 0x55988d5f22e0 2024-09-19T09:01:35.087 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.082+0000 7ff77cbfe640 1 -- 172.21.15.92:0/299873619 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff780003e50 con 0x55988d5f22e0 2024-09-19T09:01:35.087 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.083+0000 7ff77cbfe640 1 -- 172.21.15.92:0/299873619 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78000f7a0 con 0x55988d5f22e0 2024-09-19T09:01:35.087 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.083+0000 7ff793032740 1 -- 172.21.15.92:0/299873619 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55988d5f22e0 msgr2=0x55988d5f6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:35.087 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.083+0000 7ff793032740 1 --2- 172.21.15.92:0/299873619 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55988d5f22e0 0x55988d5f6da0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ff780005fd0 tx=0x7ff7800118d0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.087 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.083+0000 7ff793032740 1 -- 172.21.15.92:0/299873619 shutdown_connections 2024-09-19T09:01:35.087 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.083+0000 7ff793032740 1 --2- 172.21.15.92:0/299873619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55988d5f7370 0x55988d5f9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.087 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.083+0000 7ff793032740 1 --2- 172.21.15.92:0/299873619 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55988d5f22e0 0x55988d5f6da0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.083+0000 7ff793032740 1 --2- 172.21.15.92:0/299873619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55988d5f19a0 0x55988d5f1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.083+0000 7ff793032740 1 -- 172.21.15.92:0/299873619 >> 172.21.15.92:0/299873619 conn(0x55988d5ed010 msgr2=0x55988d5ed410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.084+0000 7ff793032740 1 -- 172.21.15.92:0/299873619 shutdown_connections 2024-09-19T09:01:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.084+0000 7ff793032740 1 -- 172.21.15.92:0/299873619 wait complete. 2024-09-19T09:01:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.084+0000 7ff793032740 1 -- start start 2024-09-19T09:01:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.084+0000 7ff793032740 1 Processor -- start 2024-09-19T09:01:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.085+0000 7ff793032740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55988d5f19a0 0x55988d5fbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.085+0000 7ff793032740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55988d5f22e0 0x55988d5fc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.085+0000 7ff793032740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55988d5f7370 0x55988d6031b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.085+0000 7ff793032740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55988d5fa3e0 con 0x55988d5f19a0 2024-09-19T09:01:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.085+0000 7ff793032740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55988d4de290 con 0x55988d5f7370 2024-09-19T09:01:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.085+0000 7ff793032740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55988d5fa560 con 0x55988d5f22e0 2024-09-19T09:01:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.085+0000 7ff793032740 10 client.0 _ll_register_callbacks cb 0x55988d50f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.085+0000 7ff78d836640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55988d5f19a0 0x55988d5fbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.085+0000 7ff78d836640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55988d5f19a0 0x55988d5fbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37938/0 (socket says 172.21.15.92:37938) 2024-09-19T09:01:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.085+0000 7ff78d836640 1 -- 172.21.15.92:0/1377493290 learned_addr learned my addr 172.21.15.92:0/1377493290 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.085+0000 7ff78e037640 1 --2- 172.21.15.92:0/1377493290 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55988d5f22e0 0x55988d5fc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.085+0000 7ff78d836640 1 --2- 172.21.15.92:0/1377493290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55988d5f7370 0x55988d6031b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.085+0000 7ff78d836640 1 -- 172.21.15.92:0/1377493290 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55988d5f22e0 msgr2=0x55988d5fc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.085+0000 7ff78d836640 1 --2- 172.21.15.92:0/1377493290 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55988d5f22e0 0x55988d5fc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.085+0000 7ff78d836640 1 -- 172.21.15.92:0/1377493290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55988d5f7370 msgr2=0x55988d6031b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:35.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.085+0000 7ff78d836640 1 --2- 172.21.15.92:0/1377493290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55988d5f7370 0x55988d6031b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.085+0000 7ff78d836640 1 -- 172.21.15.92:0/1377493290 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55988d268210 con 0x55988d5f19a0 2024-09-19T09:01:35.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.085+0000 7ff78e037640 1 --2- 172.21.15.92:0/1377493290 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55988d5f22e0 0x55988d5fc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:35.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.085+0000 7ff78d836640 1 --2- 172.21.15.92:0/1377493290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55988d5f19a0 0x55988d5fbc30 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7ff77802a930 tx=0x7ff778040040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476744de7c18d21 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:35.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.085+0000 7ff771ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:01:35.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.086+0000 7ff771ffb640 1 -- 172.21.15.92:0/1377493290 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff778035040 con 0x55988d5f19a0 2024-09-19T09:01:35.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.086+0000 7ff793032740 1 -- 172.21.15.92:0/1377493290 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff780003e50 con 0x55988d5f19a0 2024-09-19T09:01:35.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.086+0000 7ff771ffb640 1 -- 172.21.15.92:0/1377493290 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff778005020 con 0x55988d5f19a0 2024-09-19T09:01:35.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.087+0000 7ff771ffb640 1 -- 172.21.15.92:0/1377493290 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff778052050 con 0x55988d5f19a0 2024-09-19T09:01:35.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.087+0000 7ff793032740 10 client.16539 fetch_fsmap learned FSMap version 19 2024-09-19T09:01:35.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.087+0000 7ff793032740 1 -- 172.21.15.92:0/1377493290 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55988d334620 con 0x55988d5f19a0 2024-09-19T09:01:35.092 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.087+0000 7ff771ffb640 1 -- 172.21.15.92:0/1377493290 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff780003e50 con 0x55988d5f19a0 2024-09-19T09:01:35.092 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.087+0000 7ff771ffb640 1 -- 172.21.15.92:0/1377493290 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff77803a040 con 0x55988d5f19a0 2024-09-19T09:01:35.092 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.088+0000 7ff793032740 10 client.16539 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:01:35.092 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.088+0000 7ff793032740 10 client.16539 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:01:35.093 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.088+0000 7ff793032740 20 client.16539 populate_metadata read hostname 'smithi092' 2024-09-19T09:01:35.093 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.088+0000 7ff793032740 1 --2- 172.21.15.92:0/1377493290 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55988d607830 0x55988d609c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.093 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.088+0000 7ff793032740 4 client.16539 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:01:35.093 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.088+0000 7ff793032740 1 -- 172.21.15.92:0/1377493290 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55988d562a20 con 0x55988d607830 2024-09-19T09:01:35.093 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.088+0000 7ff78e037640 1 --2- 172.21.15.92:0/1377493290 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55988d607830 0x55988d609c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.093 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.089+0000 7ff78e037640 1 --2- 172.21.15.92:0/1377493290 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55988d607830 0x55988d609c80 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3848d71a0b21388c server_cookie=be808f72da94a43 in_seq=0 out_seq=0 2024-09-19T09:01:35.093 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.089+0000 7ff771ffb640 10 client.16539 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:35.093 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.090+0000 7ff771ffb640 1 -- 172.21.15.92:0/1377493290 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55988d562a20 con 0x55988d607830 2024-09-19T09:01:35.093 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.090+0000 7ff771ffb640 10 client.16539 handle_command_reply: tid=0 2024-09-19T09:01:35.093 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.090+0000 7ff793032740 1 client.16539 shutdown 2024-09-19T09:01:35.094 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.090+0000 7ff793032740 1 -- 172.21.15.92:0/1377493290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55988d5f19a0 msgr2=0x55988d5fbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:35.094 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.090+0000 7ff793032740 1 --2- 172.21.15.92:0/1377493290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55988d5f19a0 0x55988d5fbc30 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7ff77802a930 tx=0x7ff778040040 comp rx=0 tx=0).stop 2024-09-19T09:01:35.094 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.090+0000 7ff793032740 1 -- 172.21.15.92:0/1377493290 shutdown_connections 2024-09-19T09:01:35.094 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.090+0000 7ff793032740 1 --2- 172.21.15.92:0/1377493290 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55988d607830 0x55988d609c80 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.094 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.090+0000 7ff793032740 1 --2- 172.21.15.92:0/1377493290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55988d5f7370 0x55988d6031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.094 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.090+0000 7ff793032740 1 --2- 172.21.15.92:0/1377493290 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55988d5f22e0 0x55988d5fc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.094 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.090+0000 7ff793032740 1 --2- 172.21.15.92:0/1377493290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55988d5f19a0 0x55988d5fbc30 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.094 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.090+0000 7ff793032740 1 -- 172.21.15.92:0/1377493290 >> 172.21.15.92:0/1377493290 conn(0x55988d5ed010 msgr2=0x55988d5ee820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:35.094 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.090+0000 7ff771ffb640 0 client.16539 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:35.094 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.090+0000 7ff793032740 1 -- 172.21.15.92:0/1377493290 shutdown_connections 2024-09-19T09:01:35.094 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.090+0000 7ff793032740 1 -- 172.21.15.92:0/1377493290 wait complete. 2024-09-19T09:01:35.094 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.090+0000 7ff793032740 20 client.16539 trim_cache size 0 max 16384 2024-09-19T09:01:35.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.112+0000 7ff793032740 1 Processor -- start 2024-09-19T09:01:35.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.112+0000 7ff793032740 1 -- start start 2024-09-19T09:01:35.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.112+0000 7ff793032740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55988d5f19a0 0x55988d5ec0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.112+0000 7ff793032740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55988d5f22e0 0x55988d603170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.113+0000 7ff78d836640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55988d5f19a0 0x55988d5ec0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.113+0000 7ff78d836640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55988d5f19a0 0x55988d5ec0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37944/0 (socket says 172.21.15.92:37944) 2024-09-19T09:01:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.112+0000 7ff793032740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55988d5f7370 0x55988d60e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.113+0000 7ff78d836640 1 -- 172.21.15.92:0/447446996 learned_addr learned my addr 172.21.15.92:0/447446996 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.113+0000 7ff78e037640 1 --2- 172.21.15.92:0/447446996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55988d5f22e0 0x55988d603170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.113+0000 7ff793032740 1 -- 172.21.15.92:0/447446996 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff7881ad5e0 con 0x55988d5f19a0 2024-09-19T09:01:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.113+0000 7ff793032740 1 -- 172.21.15.92:0/447446996 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff7881afe80 con 0x55988d5f22e0 2024-09-19T09:01:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.113+0000 7ff793032740 1 -- 172.21.15.92:0/447446996 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff7881adc70 con 0x55988d5f7370 2024-09-19T09:01:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.113+0000 7ff78d836640 1 --2- 172.21.15.92:0/447446996 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55988d5f7370 0x55988d60e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.113+0000 7ff78e037640 1 -- 172.21.15.92:0/447446996 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55988d5f7370 msgr2=0x55988d60e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.113+0000 7ff78e037640 1 --2- 172.21.15.92:0/447446996 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55988d5f7370 0x55988d60e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.113+0000 7ff78e037640 1 -- 172.21.15.92:0/447446996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55988d5f19a0 msgr2=0x55988d5ec0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:35.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.113+0000 7ff78e037640 1 --2- 172.21.15.92:0/447446996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55988d5f19a0 0x55988d5ec0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.113+0000 7ff78e037640 1 -- 172.21.15.92:0/447446996 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55988d5f2f70 con 0x55988d5f22e0 2024-09-19T09:01:35.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.114+0000 7ff78e037640 1 --2- 172.21.15.92:0/447446996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55988d5f22e0 0x55988d603170 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff78001b040 tx=0x7ff780009990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b09fdbfcdbeb204 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:35.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.114+0000 7ff773fff640 1 -- 172.21.15.92:0/447446996 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78002f020 con 0x55988d5f22e0 2024-09-19T09:01:35.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.114+0000 7ff773fff640 1 -- 172.21.15.92:0/447446996 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff780004590 con 0x55988d5f22e0 2024-09-19T09:01:35.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.114+0000 7ff773fff640 1 -- 172.21.15.92:0/447446996 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78001d040 con 0x55988d5f22e0 2024-09-19T09:01:35.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.115+0000 7ff793032740 1 -- 172.21.15.92:0/447446996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55988d5f22e0 msgr2=0x55988d603170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:35.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.115+0000 7ff793032740 1 --2- 172.21.15.92:0/447446996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55988d5f22e0 0x55988d603170 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff78001b040 tx=0x7ff780009990 comp rx=0 tx=0).stop 2024-09-19T09:01:35.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.115+0000 7ff793032740 1 -- 172.21.15.92:0/447446996 shutdown_connections 2024-09-19T09:01:35.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.115+0000 7ff793032740 1 --2- 172.21.15.92:0/447446996 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55988d5f7370 0x55988d60e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.115+0000 7ff793032740 1 --2- 172.21.15.92:0/447446996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55988d5f22e0 0x55988d603170 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.115+0000 7ff793032740 1 --2- 172.21.15.92:0/447446996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55988d5f19a0 0x55988d5ec0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.115+0000 7ff793032740 1 -- 172.21.15.92:0/447446996 >> 172.21.15.92:0/447446996 conn(0x55988d5ed010 msgr2=0x55988d5eb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:35.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.115+0000 7ff793032740 1 -- 172.21.15.92:0/447446996 shutdown_connections 2024-09-19T09:01:35.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.115+0000 7ff793032740 1 -- 172.21.15.92:0/447446996 wait complete. 2024-09-19T09:01:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.116+0000 7ff793032740 1 -- start start 2024-09-19T09:01:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.116+0000 7ff793032740 1 Processor -- start 2024-09-19T09:01:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.116+0000 7ff793032740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55988d5f19a0 0x55988d600590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.116+0000 7ff793032740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55988d5f22e0 0x55988d600ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.116+0000 7ff793032740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55988d5f7370 0x55988d601a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.116+0000 7ff78e037640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55988d5f22e0 0x55988d600ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.116+0000 7ff78e037640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55988d5f22e0 0x55988d600ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:60812/0 (socket says 172.21.15.92:60812) 2024-09-19T09:01:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.117+0000 7ff78d836640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55988d5f19a0 0x55988d600590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.117+0000 7ff78d836640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55988d5f19a0 0x55988d600590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37950/0 (socket says 172.21.15.92:37950) 2024-09-19T09:01:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.117+0000 7ff78e037640 1 -- 172.21.15.92:0/1717456789 learned_addr learned my addr 172.21.15.92:0/1717456789 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.117+0000 7ff793032740 1 -- 172.21.15.92:0/1717456789 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff7881ae340 con 0x55988d5f19a0 2024-09-19T09:01:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.117+0000 7ff793032740 1 -- 172.21.15.92:0/1717456789 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff7881af7b0 con 0x55988d5f7370 2024-09-19T09:01:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.117+0000 7ff793032740 1 -- 172.21.15.92:0/1717456789 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff7881aea10 con 0x55988d5f22e0 2024-09-19T09:01:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.117+0000 7ff793032740 10 client.0 _ll_register_callbacks cb 0x7ff7780317c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.117+0000 7ff78d836640 1 --2- 172.21.15.92:0/1717456789 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55988d5f7370 0x55988d601a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.117+0000 7ff78e037640 1 -- 172.21.15.92:0/1717456789 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55988d5f7370 msgr2=0x55988d601a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.117+0000 7ff78e037640 1 --2- 172.21.15.92:0/1717456789 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55988d5f7370 0x55988d601a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.117+0000 7ff78e037640 1 -- 172.21.15.92:0/1717456789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55988d5f19a0 msgr2=0x55988d600590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.117+0000 7ff78e037640 1 --2- 172.21.15.92:0/1717456789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55988d5f19a0 0x55988d600590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.117+0000 7ff78e037640 1 -- 172.21.15.92:0/1717456789 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55988d602080 con 0x55988d5f22e0 2024-09-19T09:01:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.117+0000 7ff78d836640 1 --2- 172.21.15.92:0/1717456789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55988d5f19a0 0x55988d600590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.117+0000 7ff78e037640 1 --2- 172.21.15.92:0/1717456789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55988d5f22e0 0x55988d600ad0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff780009370 tx=0x7ff780005aa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6e9eff2b56bd01f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.117+0000 7ff771ffb640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:01:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.118+0000 7ff771ffb640 1 -- 172.21.15.92:0/1717456789 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78001d070 con 0x55988d5f22e0 2024-09-19T09:01:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.118+0000 7ff771ffb640 1 -- 172.21.15.92:0/1717456789 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff780003d30 con 0x55988d5f22e0 2024-09-19T09:01:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.118+0000 7ff793032740 1 -- 172.21.15.92:0/1717456789 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff780004590 con 0x55988d5f22e0 2024-09-19T09:01:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.118+0000 7ff771ffb640 1 -- 172.21.15.92:0/1717456789 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff78002f040 con 0x55988d5f22e0 2024-09-19T09:01:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.118+0000 7ff793032740 10 client.25855 fetch_fsmap learned FSMap version 19 2024-09-19T09:01:35.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.118+0000 7ff793032740 1 -- 172.21.15.92:0/1717456789 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55988d603370 con 0x55988d5f22e0 2024-09-19T09:01:35.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.119+0000 7ff771ffb640 1 -- 172.21.15.92:0/1717456789 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7800039f0 con 0x55988d5f22e0 2024-09-19T09:01:35.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.119+0000 7ff771ffb640 1 -- 172.21.15.92:0/1717456789 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff7800347b0 con 0x55988d5f22e0 2024-09-19T09:01:35.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.119+0000 7ff793032740 10 client.25855 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:01:35.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.119+0000 7ff793032740 10 client.25855 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:01:35.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.119+0000 7ff793032740 20 client.25855 populate_metadata read hostname 'smithi092' 2024-09-19T09:01:35.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.119+0000 7ff793032740 1 --2- 172.21.15.92:0/1717456789 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55988d6729e0 0x55988d674dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.119+0000 7ff793032740 4 client.25855 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:01:35.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.119+0000 7ff793032740 1 -- 172.21.15.92:0/1717456789 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7ff780004590 con 0x55988d6729e0 2024-09-19T09:01:35.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.120+0000 7ff78d836640 1 --2- 172.21.15.92:0/1717456789 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55988d6729e0 0x55988d674dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.120+0000 7ff78d836640 1 --2- 172.21.15.92:0/1717456789 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55988d6729e0 0x55988d674dd0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=476cd312d578cab5 server_cookie=25f4ded6c6d0d7bc in_seq=0 out_seq=0 2024-09-19T09:01:35.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.120+0000 7ff771ffb640 10 client.25855 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:35.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.137+0000 7ff771ffb640 1 -- 172.21.15.92:0/1717456789 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7ff780004590 con 0x55988d6729e0 2024-09-19T09:01:35.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.137+0000 7ff771ffb640 10 client.25855 handle_command_reply: tid=0 2024-09-19T09:01:35.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.137+0000 7ff793032740 1 client.25855 shutdown 2024-09-19T09:01:35.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.138+0000 7ff793032740 1 -- 172.21.15.92:0/1717456789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55988d5f22e0 msgr2=0x55988d600ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:35.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.138+0000 7ff793032740 1 --2- 172.21.15.92:0/1717456789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55988d5f22e0 0x55988d600ad0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff780009370 tx=0x7ff780005aa0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.138+0000 7ff793032740 1 -- 172.21.15.92:0/1717456789 shutdown_connections 2024-09-19T09:01:35.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.138+0000 7ff793032740 1 --2- 172.21.15.92:0/1717456789 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55988d6729e0 0x55988d674dd0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.138+0000 7ff793032740 1 --2- 172.21.15.92:0/1717456789 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55988d5f7370 0x55988d601a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.138+0000 7ff793032740 1 --2- 172.21.15.92:0/1717456789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55988d5f22e0 0x55988d600ad0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.138+0000 7ff793032740 1 --2- 172.21.15.92:0/1717456789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55988d5f19a0 0x55988d600590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.138+0000 7ff793032740 1 -- 172.21.15.92:0/1717456789 >> 172.21.15.92:0/1717456789 conn(0x55988d5ed010 msgr2=0x55988d5ec1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:35.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.138+0000 7ff771ffb640 0 client.25855 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:35.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.138+0000 7ff793032740 1 -- 172.21.15.92:0/1717456789 shutdown_connections 2024-09-19T09:01:35.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.138+0000 7ff793032740 1 -- 172.21.15.92:0/1717456789 wait complete. 2024-09-19T09:01:35.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.139+0000 7ff793032740 20 client.25855 trim_cache size 0 max 16384 2024-09-19T09:01:35.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:01:35.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:01:35.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:01:35.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:01:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.139+0000 7ff79029b640 1 -- 172.21.15.92:0/83608093 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff7740a3370 msgr2=0x7ff7740a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.139+0000 7ff79029b640 1 --2- 172.21.15.92:0/83608093 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff7740a3370 0x7ff7740a5830 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff78409b770 tx=0x7ff784066400 comp rx=0 tx=0).stop 2024-09-19T09:01:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.139+0000 7ff79029b640 1 -- 172.21.15.92:0/83608093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7881025f0 msgr2=0x7ff7881a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.139+0000 7ff79029b640 1 --2- 172.21.15.92:0/83608093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7881025f0 0x7ff7881a5970 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff78400d950 tx=0x7ff78400de10 comp rx=0 tx=0).stop 2024-09-19T09:01:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.139+0000 7ff79029b640 1 -- 172.21.15.92:0/83608093 shutdown_connections 2024-09-19T09:01:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.140+0000 7ff79029b640 1 --2- 172.21.15.92:0/83608093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7881025f0 0x7ff7881a5970 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.140+0000 7ff79029b640 1 --2- 172.21.15.92:0/83608093 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff7740a3370 0x7ff7740a5830 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.140+0000 7ff79029b640 1 --2- 172.21.15.92:0/83608093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff788101c30 0x7ff78819e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.140+0000 7ff79029b640 1 --2- 172.21.15.92:0/83608093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff788100a40 0x7ff78819e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.140+0000 7ff79029b640 1 -- 172.21.15.92:0/83608093 >> 172.21.15.92:0/83608093 conn(0x7ff7880fc1e0 msgr2=0x7ff78810e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:35.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.140+0000 7ff79029b640 1 -- 172.21.15.92:0/83608093 shutdown_connections 2024-09-19T09:01:35.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:35.140+0000 7ff79029b640 1 -- 172.21.15.92:0/83608093 wait complete. 2024-09-19T09:01:35.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 290.0 s, 4445.5 tps, lat 22.633 ms stddev 25.258 2024-09-19T09:01:35.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:35 smithi167 ceph-mon[35359]: pgmap v483: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 16 MiB/s wr, 615 op/s 2024-09-19T09:01:35.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:35 smithi190 ceph-mon[35358]: pgmap v483: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 16 MiB/s wr, 615 op/s 2024-09-19T09:01:36.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:35 smithi092 ceph-mon[31407]: pgmap v483: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 16 MiB/s wr, 615 op/s 2024-09-19T09:01:37.805 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:37 smithi092 ceph-mon[31407]: pgmap v484: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 17 MiB/s wr, 747 op/s 2024-09-19T09:01:37.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:37 smithi167 ceph-mon[35359]: pgmap v484: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 17 MiB/s wr, 747 op/s 2024-09-19T09:01:37.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:37 smithi190 ceph-mon[35358]: pgmap v484: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 17 MiB/s wr, 747 op/s 2024-09-19T09:01:39.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:39 smithi167 ceph-mon[35359]: pgmap v485: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 15 MiB/s wr, 857 op/s 2024-09-19T09:01:39.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:39 smithi190 ceph-mon[35358]: pgmap v485: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 15 MiB/s wr, 857 op/s 2024-09-19T09:01:40.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:39 smithi092 ceph-mon[31407]: pgmap v485: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 15 MiB/s wr, 857 op/s 2024-09-19T09:01:40.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 295.0 s, 3699.2 tps, lat 26.968 ms stddev 28.676 2024-09-19T09:01:41.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:41 smithi167 ceph-mon[35359]: pgmap v486: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 13 MiB/s wr, 871 op/s 2024-09-19T09:01:41.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:41 smithi190 ceph-mon[35358]: pgmap v486: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 13 MiB/s wr, 871 op/s 2024-09-19T09:01:42.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:41 smithi092 ceph-mon[31407]: pgmap v486: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 13 MiB/s wr, 871 op/s 2024-09-19T09:01:43.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:43 smithi167 ceph-mon[35359]: pgmap v487: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.7 MiB/s wr, 764 op/s 2024-09-19T09:01:43.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:43 smithi190 ceph-mon[35358]: pgmap v487: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.7 MiB/s wr, 764 op/s 2024-09-19T09:01:44.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:43 smithi092 ceph-mon[31407]: pgmap v487: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.7 MiB/s wr, 764 op/s 2024-09-19T09:01:44.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:44 smithi167 ceph-mon[35359]: pgmap v488: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.4 MiB/s wr, 851 op/s 2024-09-19T09:01:44.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:44 smithi190 ceph-mon[35358]: pgmap v488: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.4 MiB/s wr, 851 op/s 2024-09-19T09:01:45.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:44 smithi092 ceph-mon[31407]: pgmap v488: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.4 MiB/s wr, 851 op/s 2024-09-19T09:01:45.797 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 300.0 s, 3704.4 tps, lat 27.018 ms stddev 29.628 2024-09-19T09:01:45.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:45 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:01:45.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:45 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:45.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:45 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:01:45.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:45 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:01:45.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:45 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:01:45.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:45 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:45.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:45 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:01:45.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:45 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:01:46.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:45 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:01:46.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:45 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:46.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:45 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:01:46.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:45 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:01:46.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:46 smithi167 ceph-mon[35359]: pgmap v489: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.8 MiB/s wr, 756 op/s 2024-09-19T09:01:46.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:46 smithi190 ceph-mon[35358]: pgmap v489: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.8 MiB/s wr, 756 op/s 2024-09-19T09:01:47.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:46 smithi092 ceph-mon[31407]: pgmap v489: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.8 MiB/s wr, 756 op/s 2024-09-19T09:01:48.263 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.263+0000 7f13230d7640 1 -- 172.21.15.92:0/3003186147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f131c100a40 msgr2=0x7f131c100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:48.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.263+0000 7f13230d7640 1 --2- 172.21.15.92:0/3003186147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f131c100a40 0x7f131c100e40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1310009900 tx=0x7f131002a410 comp rx=0 tx=0).stop 2024-09-19T09:01:48.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.263+0000 7f13230d7640 1 -- 172.21.15.92:0/3003186147 shutdown_connections 2024-09-19T09:01:48.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.263+0000 7f13230d7640 1 --2- 172.21.15.92:0/3003186147 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f131c1025f0 0x7f131c0698a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.263+0000 7f13230d7640 1 --2- 172.21.15.92:0/3003186147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f131c101c30 0x7f131c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.263+0000 7f13230d7640 1 --2- 172.21.15.92:0/3003186147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f131c100a40 0x7f131c100e40 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.263+0000 7f13230d7640 1 -- 172.21.15.92:0/3003186147 >> 172.21.15.92:0/3003186147 conn(0x7f131c0fc1e0 msgr2=0x7f131c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:48.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.263+0000 7f13230d7640 1 -- 172.21.15.92:0/3003186147 shutdown_connections 2024-09-19T09:01:48.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.263+0000 7f13230d7640 1 -- 172.21.15.92:0/3003186147 wait complete. 2024-09-19T09:01:48.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.263+0000 7f13230d7640 1 Processor -- start 2024-09-19T09:01:48.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.264+0000 7f13230d7640 1 -- start start 2024-09-19T09:01:48.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.264+0000 7f13230d7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f131c100a40 0x7f131c19a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:48.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.264+0000 7f13230d7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f131c101c30 0x7f131c19a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:48.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.264+0000 7f13230d7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f131c1025f0 0x7f131c1a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:48.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.264+0000 7f13230d7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f131c10fa00 con 0x7f131c1025f0 2024-09-19T09:01:48.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.264+0000 7f13230d7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f131c10f880 con 0x7f131c101c30 2024-09-19T09:01:48.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.264+0000 7f13230d7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f131c10fb80 con 0x7f131c100a40 2024-09-19T09:01:48.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.264+0000 7f131bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f131c101c30 0x7f131c19a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:48.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.264+0000 7f131bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f131c101c30 0x7f131c19a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:32882/0 (socket says 172.21.15.92:32882) 2024-09-19T09:01:48.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.264+0000 7f131bfff640 1 -- 172.21.15.92:0/2104916597 learned_addr learned my addr 172.21.15.92:0/2104916597 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:48.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.264+0000 7f1320e73640 1 --2- 172.21.15.92:0/2104916597 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f131c100a40 0x7f131c19a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:48.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.264+0000 7f131bfff640 1 -- 172.21.15.92:0/2104916597 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f131c100a40 msgr2=0x7f131c19a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:48.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.264+0000 7f131bfff640 1 --2- 172.21.15.92:0/2104916597 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f131c100a40 0x7f131c19a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.264+0000 7f131bfff640 1 -- 172.21.15.92:0/2104916597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f131c1025f0 msgr2=0x7f131c1a15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:48.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.264+0000 7f1321674640 1 --2- 172.21.15.92:0/2104916597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f131c1025f0 0x7f131c1a15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:48.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.264+0000 7f131bfff640 1 --2- 172.21.15.92:0/2104916597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f131c1025f0 0x7f131c1a15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.265+0000 7f131bfff640 1 -- 172.21.15.92:0/2104916597 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f131c1a1c30 con 0x7f131c101c30 2024-09-19T09:01:48.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.265+0000 7f1321674640 1 --2- 172.21.15.92:0/2104916597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f131c1025f0 0x7f131c1a15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:01:48.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.265+0000 7f131bfff640 1 --2- 172.21.15.92:0/2104916597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f131c101c30 0x7f131c19a550 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f130800c970 tx=0x7f130800ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:48.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.265+0000 7f1319ffb640 1 -- 172.21.15.92:0/2104916597 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1308007bb0 con 0x7f131c101c30 2024-09-19T09:01:48.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.265+0000 7f13230d7640 1 -- 172.21.15.92:0/2104916597 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f131c1a1f20 con 0x7f131c101c30 2024-09-19T09:01:48.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.265+0000 7f1319ffb640 1 -- 172.21.15.92:0/2104916597 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1308007d50 con 0x7f131c101c30 2024-09-19T09:01:48.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.265+0000 7f1319ffb640 1 -- 172.21.15.92:0/2104916597 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f130800f450 con 0x7f131c101c30 2024-09-19T09:01:48.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.266+0000 7f13230d7640 1 -- 172.21.15.92:0/2104916597 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f131c1a23e0 con 0x7f131c101c30 2024-09-19T09:01:48.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.268+0000 7f1319ffb640 1 -- 172.21.15.92:0/2104916597 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1308005020 con 0x7f131c101c30 2024-09-19T09:01:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.270+0000 7f1319ffb640 1 --2- 172.21.15.92:0/2104916597 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f130c0a3370 0x7f130c0a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.270+0000 7f1325e71740 1 Processor -- start 2024-09-19T09:01:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.270+0000 7f1325e71740 1 -- start start 2024-09-19T09:01:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.270+0000 7f1319ffb640 1 -- 172.21.15.92:0/2104916597 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f13080cf6c0 con 0x7f131c101c30 2024-09-19T09:01:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.270+0000 7f1320e73640 1 --2- 172.21.15.92:0/2104916597 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f130c0a3370 0x7f130c0a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.270+0000 7f1325e71740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df403a49a0 0x55df403a4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.270+0000 7f1325e71740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df403a52e0 0x55df403a9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.270+0000 7f1325e71740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55df403aa370 0x55df403ac830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.270+0000 7f1325e71740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55df403082f0 con 0x55df403a49a0 2024-09-19T09:01:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.270+0000 7f1325e71740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55df402b0270 con 0x55df403a52e0 2024-09-19T09:01:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.270+0000 7f1325e71740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55df403042b0 con 0x55df403aa370 2024-09-19T09:01:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.270+0000 7f1320e73640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df403a49a0 0x55df403a4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.270+0000 7f131bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df403a52e0 0x55df403a9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.270+0000 7f1320e73640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df403a49a0 0x55df403a4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54852/0 (socket says 172.21.15.92:54852) 2024-09-19T09:01:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.270+0000 7f1320e73640 1 -- 172.21.15.92:0/986709441 learned_addr learned my addr 172.21.15.92:0/986709441 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.270+0000 7f1321674640 1 --2- 172.21.15.92:0/986709441 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55df403aa370 0x55df403ac830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.270+0000 7f1321674640 1 -- 172.21.15.92:0/986709441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df403a52e0 msgr2=0x55df403a9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.270+0000 7f1321674640 1 --2- 172.21.15.92:0/986709441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df403a52e0 0x55df403a9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.271+0000 7f1321674640 1 -- 172.21.15.92:0/986709441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df403a49a0 msgr2=0x55df403a4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.271+0000 7f1321674640 1 --2- 172.21.15.92:0/986709441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df403a49a0 0x55df403a4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.271+0000 7f1321674640 1 -- 172.21.15.92:0/986709441 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df402af340 con 0x55df403aa370 2024-09-19T09:01:48.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.271+0000 7f1320e73640 1 --2- 172.21.15.92:0/2104916597 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f130c0a3370 0x7f130c0a5830 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f13100314e0 tx=0x7f1310032c30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:48.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.271+0000 7f1321674640 1 --2- 172.21.15.92:0/986709441 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55df403aa370 0x55df403ac830 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1314009ec0 tx=0x7f131400f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e16f5bb0261f4a40 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:48.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.271+0000 7f1306ffd640 1 -- 172.21.15.92:0/986709441 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1314003b70 con 0x55df403aa370 2024-09-19T09:01:48.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.271+0000 7f1306ffd640 1 -- 172.21.15.92:0/986709441 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1314003d10 con 0x55df403aa370 2024-09-19T09:01:48.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.271+0000 7f1306ffd640 1 -- 172.21.15.92:0/986709441 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13140119a0 con 0x55df403aa370 2024-09-19T09:01:48.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.272+0000 7f1325e71740 1 -- 172.21.15.92:0/986709441 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55df403aa370 msgr2=0x55df403ac830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:48.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.272+0000 7f1325e71740 1 --2- 172.21.15.92:0/986709441 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55df403aa370 0x55df403ac830 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1314009ec0 tx=0x7f131400f730 comp rx=0 tx=0).stop 2024-09-19T09:01:48.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.272+0000 7f1325e71740 1 -- 172.21.15.92:0/986709441 shutdown_connections 2024-09-19T09:01:48.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.272+0000 7f1325e71740 1 --2- 172.21.15.92:0/986709441 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55df403aa370 0x55df403ac830 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.272+0000 7f1325e71740 1 --2- 172.21.15.92:0/986709441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df403a52e0 0x55df403a9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.272+0000 7f1325e71740 1 --2- 172.21.15.92:0/986709441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df403a49a0 0x55df403a4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.272+0000 7f1325e71740 1 -- 172.21.15.92:0/986709441 >> 172.21.15.92:0/986709441 conn(0x55df403a0010 msgr2=0x55df403a0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:48.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.272+0000 7f1325e71740 1 -- 172.21.15.92:0/986709441 shutdown_connections 2024-09-19T09:01:48.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.273+0000 7f1325e71740 1 -- 172.21.15.92:0/986709441 wait complete. 2024-09-19T09:01:48.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.273+0000 7f1325e71740 1 -- start start 2024-09-19T09:01:48.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.273+0000 7f1325e71740 1 Processor -- start 2024-09-19T09:01:48.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.274+0000 7f1325e71740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df403a49a0 0x55df403b7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:48.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.274+0000 7f1325e71740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df403a52e0 0x55df403b7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:48.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.274+0000 7f1325e71740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55df403aa370 0x55df403be920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:48.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.274+0000 7f131bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df403a52e0 0x55df403b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:48.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.274+0000 7f1325e71740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55df403b5b50 con 0x55df403a52e0 2024-09-19T09:01:48.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.274+0000 7f131bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df403a52e0 0x55df403b7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54858/0 (socket says 172.21.15.92:54858) 2024-09-19T09:01:48.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.274+0000 7f131bfff640 1 -- 172.21.15.92:0/695958246 learned_addr learned my addr 172.21.15.92:0/695958246 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:48.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.274+0000 7f1325e71740 1 -- 172.21.15.92:0/695958246 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55df40291290 con 0x55df403a49a0 2024-09-19T09:01:48.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.274+0000 7f1320e73640 1 --2- 172.21.15.92:0/695958246 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df403a49a0 0x55df403b7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:48.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.274+0000 7f1325e71740 1 -- 172.21.15.92:0/695958246 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55df403b5cd0 con 0x55df403aa370 2024-09-19T09:01:48.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.274+0000 7f1325e71740 10 client.0 _ll_register_callbacks cb 0x55df402c2140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:48.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.274+0000 7f1321674640 1 --2- 172.21.15.92:0/695958246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55df403aa370 0x55df403be920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:48.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.274+0000 7f1320e73640 1 -- 172.21.15.92:0/695958246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55df403aa370 msgr2=0x55df403be920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:48.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.274+0000 7f1320e73640 1 --2- 172.21.15.92:0/695958246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55df403aa370 0x55df403be920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.274+0000 7f1320e73640 1 -- 172.21.15.92:0/695958246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df403a52e0 msgr2=0x55df403b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:48.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.274+0000 7f1320e73640 1 --2- 172.21.15.92:0/695958246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df403a52e0 0x55df403b7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.274+0000 7f1320e73640 1 -- 172.21.15.92:0/695958246 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df4001b210 con 0x55df403a49a0 2024-09-19T09:01:48.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.274+0000 7f131bfff640 1 --2- 172.21.15.92:0/695958246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df403a52e0 0x55df403b7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:48.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.274+0000 7f1320e73640 1 --2- 172.21.15.92:0/695958246 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df403a49a0 0x55df403b7410 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1310031610 tx=0x7f131002a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8969871eb8e3814 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:48.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.274+0000 7f12fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:01:48.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.275+0000 7f12fbfff640 1 -- 172.21.15.92:0/695958246 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f131004f070 con 0x55df403a49a0 2024-09-19T09:01:48.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.275+0000 7f12fbfff640 1 -- 172.21.15.92:0/695958246 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1310005450 con 0x55df403a49a0 2024-09-19T09:01:48.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.275+0000 7f1325e71740 1 -- 172.21.15.92:0/695958246 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1314003d10 con 0x55df403a49a0 2024-09-19T09:01:48.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.275+0000 7f12fbfff640 1 -- 172.21.15.92:0/695958246 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1310059050 con 0x55df403a49a0 2024-09-19T09:01:48.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.275+0000 7f1325e71740 10 client.25952 fetch_fsmap learned FSMap version 19 2024-09-19T09:01:48.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.275+0000 7f1325e71740 1 -- 172.21.15.92:0/695958246 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55df400e7620 con 0x55df403a49a0 2024-09-19T09:01:48.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.276+0000 7f12fbfff640 1 -- 172.21.15.92:0/695958246 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1310005650 con 0x55df403a49a0 2024-09-19T09:01:48.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.276+0000 7f12fbfff640 1 -- 172.21.15.92:0/695958246 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1310003960 con 0x55df403a49a0 2024-09-19T09:01:48.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.276+0000 7f1325e71740 10 client.25952 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:01:48.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.276+0000 7f1325e71740 10 client.25952 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:01:48.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.276+0000 7f1325e71740 20 client.25952 populate_metadata read hostname 'smithi092' 2024-09-19T09:01:48.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.276+0000 7f1325e71740 1 --2- 172.21.15.92:0/695958246 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55df403c3040 0x55df403c5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:48.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.276+0000 7f1325e71740 4 client.25952 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:01:48.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.276+0000 7f1325e71740 1 -- 172.21.15.92:0/695958246 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1314003d10 con 0x55df403c3040 2024-09-19T09:01:48.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.276+0000 7f131bfff640 1 --2- 172.21.15.92:0/695958246 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55df403c3040 0x55df403c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:48.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.277+0000 7f12fbfff640 10 client.25952 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:48.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.277+0000 7f131bfff640 1 --2- 172.21.15.92:0/695958246 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55df403c3040 0x55df403c5430 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c899012247d7bc6 server_cookie=cb1d8a72d4663f14 in_seq=0 out_seq=0 2024-09-19T09:01:48.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.278+0000 7f12fbfff640 1 -- 172.21.15.92:0/695958246 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f1314003d10 con 0x55df403c3040 2024-09-19T09:01:48.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.278+0000 7f12fbfff640 10 client.25952 handle_command_reply: tid=0 2024-09-19T09:01:48.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.278+0000 7f1325e71740 1 client.25952 shutdown 2024-09-19T09:01:48.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.278+0000 7f1325e71740 1 -- 172.21.15.92:0/695958246 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df403a49a0 msgr2=0x55df403b7410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:48.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.278+0000 7f1325e71740 1 --2- 172.21.15.92:0/695958246 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df403a49a0 0x55df403b7410 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1310031610 tx=0x7f131002a410 comp rx=0 tx=0).stop 2024-09-19T09:01:48.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.278+0000 7f1325e71740 1 -- 172.21.15.92:0/695958246 shutdown_connections 2024-09-19T09:01:48.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.278+0000 7f1325e71740 1 --2- 172.21.15.92:0/695958246 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55df403c3040 0x55df403c5430 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.278+0000 7f1325e71740 1 --2- 172.21.15.92:0/695958246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55df403aa370 0x55df403be920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.278+0000 7f12fbfff640 0 client.25952 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:48.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.278+0000 7f1325e71740 1 --2- 172.21.15.92:0/695958246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df403a52e0 0x55df403b7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.278+0000 7f1325e71740 1 --2- 172.21.15.92:0/695958246 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df403a49a0 0x55df403b7410 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.278+0000 7f1325e71740 1 -- 172.21.15.92:0/695958246 >> 172.21.15.92:0/695958246 conn(0x55df403a0010 msgr2=0x55df403a1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:48.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.278+0000 7f1325e71740 1 -- 172.21.15.92:0/695958246 shutdown_connections 2024-09-19T09:01:48.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.278+0000 7f1325e71740 1 -- 172.21.15.92:0/695958246 wait complete. 2024-09-19T09:01:48.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.278+0000 7f1325e71740 20 client.25952 trim_cache size 0 max 16384 2024-09-19T09:01:48.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.300+0000 7f1325e71740 1 Processor -- start 2024-09-19T09:01:48.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.300+0000 7f1325e71740 1 -- start start 2024-09-19T09:01:48.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.300+0000 7f1325e71740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df403a49a0 0x55df403b7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:48.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.300+0000 7f1325e71740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55df403a52e0 0x55df403be8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:48.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.300+0000 7f1325e71740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df403aa370 0x55df403c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:48.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.300+0000 7f1325e71740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f131c1a4dd0 con 0x55df403a49a0 2024-09-19T09:01:48.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.300+0000 7f1325e71740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f131c1a7670 con 0x55df403aa370 2024-09-19T09:01:48.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.300+0000 7f1325e71740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f131c1a5460 con 0x55df403a52e0 2024-09-19T09:01:48.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.301+0000 7f131bfff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55df403a52e0 0x55df403be8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:48.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.301+0000 7f1321674640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df403aa370 0x55df403c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:48.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.301+0000 7f1321674640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df403aa370 0x55df403c9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:32918/0 (socket says 172.21.15.92:32918) 2024-09-19T09:01:48.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.301+0000 7f131bfff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55df403a52e0 0x55df403be8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:57534/0 (socket says 172.21.15.92:57534) 2024-09-19T09:01:48.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.301+0000 7f1321674640 1 -- 172.21.15.92:0/2415158229 learned_addr learned my addr 172.21.15.92:0/2415158229 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:48.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.301+0000 7f1320e73640 1 --2- 172.21.15.92:0/2415158229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df403a49a0 0x55df403b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:48.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.301+0000 7f1321674640 1 -- 172.21.15.92:0/2415158229 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55df403a52e0 msgr2=0x55df403be8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:48.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.301+0000 7f1321674640 1 --2- 172.21.15.92:0/2415158229 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55df403a52e0 0x55df403be8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.301+0000 7f1321674640 1 -- 172.21.15.92:0/2415158229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df403a49a0 msgr2=0x55df403b7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:48.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.301+0000 7f1321674640 1 --2- 172.21.15.92:0/2415158229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df403a49a0 0x55df403b7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.301+0000 7f1321674640 1 -- 172.21.15.92:0/2415158229 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df4039fe30 con 0x55df403aa370 2024-09-19T09:01:48.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.301+0000 7f131bfff640 1 --2- 172.21.15.92:0/2415158229 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55df403a52e0 0x55df403be8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:48.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.301+0000 7f1321674640 1 --2- 172.21.15.92:0/2415158229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df403aa370 0x55df403c9d30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1314009ec0 tx=0x7f1314009c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d166f13e3537dd34 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:48.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.301+0000 7f13067fc640 1 -- 172.21.15.92:0/2415158229 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1314004a70 con 0x55df403aa370 2024-09-19T09:01:48.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.301+0000 7f13067fc640 1 -- 172.21.15.92:0/2415158229 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1314004c10 con 0x55df403aa370 2024-09-19T09:01:48.304 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.301+0000 7f13067fc640 1 -- 172.21.15.92:0/2415158229 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1314005330 con 0x55df403aa370 2024-09-19T09:01:48.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.302+0000 7f1325e71740 1 -- 172.21.15.92:0/2415158229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df403aa370 msgr2=0x55df403c9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:48.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.302+0000 7f1325e71740 1 --2- 172.21.15.92:0/2415158229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df403aa370 0x55df403c9d30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1314009ec0 tx=0x7f1314009c10 comp rx=0 tx=0).stop 2024-09-19T09:01:48.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.303+0000 7f1325e71740 1 -- 172.21.15.92:0/2415158229 shutdown_connections 2024-09-19T09:01:48.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.303+0000 7f1325e71740 1 --2- 172.21.15.92:0/2415158229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df403aa370 0x55df403c9d30 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.303+0000 7f1325e71740 1 --2- 172.21.15.92:0/2415158229 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55df403a52e0 0x55df403be8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.303+0000 7f1325e71740 1 --2- 172.21.15.92:0/2415158229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df403a49a0 0x55df403b7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.303+0000 7f1325e71740 1 -- 172.21.15.92:0/2415158229 >> 172.21.15.92:0/2415158229 conn(0x55df403a0010 msgr2=0x55df4039f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:48.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.303+0000 7f1325e71740 1 -- 172.21.15.92:0/2415158229 shutdown_connections 2024-09-19T09:01:48.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.303+0000 7f1325e71740 1 -- 172.21.15.92:0/2415158229 wait complete. 2024-09-19T09:01:48.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.303+0000 7f1325e71740 1 -- start start 2024-09-19T09:01:48.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.304+0000 7f1325e71740 1 Processor -- start 2024-09-19T09:01:48.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.304+0000 7f1325e71740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df403a49a0 0x55df403bc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:48.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.304+0000 7f1325e71740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df403a52e0 0x55df403bcb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:48.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.304+0000 7f1325e71740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55df403aa370 0x55df403bdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:48.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.304+0000 7f1325e71740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f131c1a5b30 con 0x55df403a52e0 2024-09-19T09:01:48.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.304+0000 7f1325e71740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f131c1a6fa0 con 0x55df403a49a0 2024-09-19T09:01:48.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.304+0000 7f1325e71740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f131c1a6200 con 0x55df403aa370 2024-09-19T09:01:48.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.304+0000 7f1325e71740 10 client.0 _ll_register_callbacks cb 0x7f1310005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:48.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.304+0000 7f131bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df403a52e0 0x55df403bcb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:48.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.304+0000 7f131bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df403a52e0 0x55df403bcb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54874/0 (socket says 172.21.15.92:54874) 2024-09-19T09:01:48.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.304+0000 7f131bfff640 1 -- 172.21.15.92:0/423175253 learned_addr learned my addr 172.21.15.92:0/423175253 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:48.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.304+0000 7f1320e73640 1 --2- 172.21.15.92:0/423175253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df403a49a0 0x55df403bc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:48.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.304+0000 7f1321674640 1 --2- 172.21.15.92:0/423175253 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55df403aa370 0x55df403bdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:48.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.304+0000 7f131bfff640 1 -- 172.21.15.92:0/423175253 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55df403aa370 msgr2=0x55df403bdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:48.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.304+0000 7f131bfff640 1 --2- 172.21.15.92:0/423175253 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55df403aa370 0x55df403bdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.304+0000 7f131bfff640 1 -- 172.21.15.92:0/423175253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df403a49a0 msgr2=0x55df403bc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:48.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.304+0000 7f131bfff640 1 --2- 172.21.15.92:0/423175253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df403a49a0 0x55df403bc5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.304+0000 7f131bfff640 1 -- 172.21.15.92:0/423175253 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df403be140 con 0x55df403a52e0 2024-09-19T09:01:48.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.304+0000 7f1320e73640 1 --2- 172.21.15.92:0/423175253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df403a49a0 0x55df403bc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:48.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.305+0000 7f131bfff640 1 --2- 172.21.15.92:0/423175253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df403a52e0 0x55df403bcb20 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f130809cfd0 tx=0x7f13080cd050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4cf4c6c380a1176 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:48.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.305+0000 7f12fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:01:48.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.305+0000 7f12fbfff640 1 -- 172.21.15.92:0/423175253 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f130807f060 con 0x55df403a52e0 2024-09-19T09:01:48.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.305+0000 7f12fbfff640 1 -- 172.21.15.92:0/423175253 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1308099fa0 con 0x55df403a52e0 2024-09-19T09:01:48.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.305+0000 7f1325e71740 1 -- 172.21.15.92:0/423175253 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1314004c10 con 0x55df403a52e0 2024-09-19T09:01:48.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.305+0000 7f12fbfff640 1 -- 172.21.15.92:0/423175253 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f130801d040 con 0x55df403a52e0 2024-09-19T09:01:48.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.305+0000 7f1325e71740 10 client.16557 fetch_fsmap learned FSMap version 19 2024-09-19T09:01:48.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.305+0000 7f1325e71740 1 -- 172.21.15.92:0/423175253 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55df4042e410 con 0x55df403a52e0 2024-09-19T09:01:48.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.305+0000 7f12fbfff640 1 -- 172.21.15.92:0/423175253 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1314004c10 con 0x55df403a52e0 2024-09-19T09:01:48.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.305+0000 7f12fbfff640 1 -- 172.21.15.92:0/423175253 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1308084070 con 0x55df403a52e0 2024-09-19T09:01:48.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.305+0000 7f1325e71740 10 client.16557 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:01:48.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.305+0000 7f1325e71740 10 client.16557 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:01:48.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.305+0000 7f1325e71740 20 client.16557 populate_metadata read hostname 'smithi092' 2024-09-19T09:01:48.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.305+0000 7f1325e71740 1 --2- 172.21.15.92:0/423175253 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55df4042ed40 0x55df40431160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:48.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.305+0000 7f1325e71740 4 client.16557 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:01:48.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.305+0000 7f1325e71740 1 -- 172.21.15.92:0/423175253 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55df40315a20 con 0x55df4042ed40 2024-09-19T09:01:48.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.306+0000 7f1320e73640 1 --2- 172.21.15.92:0/423175253 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55df4042ed40 0x55df40431160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:48.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.307+0000 7f1320e73640 1 --2- 172.21.15.92:0/423175253 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55df4042ed40 0x55df40431160 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcb3cfe10f5d4a70 server_cookie=1a549e16695b92aa in_seq=0 out_seq=0 2024-09-19T09:01:48.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.307+0000 7f12fbfff640 10 client.16557 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:48.328 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.328+0000 7f12fbfff640 1 -- 172.21.15.92:0/423175253 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55df40315a20 con 0x55df4042ed40 2024-09-19T09:01:48.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.328+0000 7f12fbfff640 10 client.16557 handle_command_reply: tid=0 2024-09-19T09:01:48.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.328+0000 7f1325e71740 1 client.16557 shutdown 2024-09-19T09:01:48.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.328+0000 7f1325e71740 1 -- 172.21.15.92:0/423175253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df403a52e0 msgr2=0x55df403bcb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:48.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.328+0000 7f1325e71740 1 --2- 172.21.15.92:0/423175253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df403a52e0 0x55df403bcb20 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f130809cfd0 tx=0x7f13080cd050 comp rx=0 tx=0).stop 2024-09-19T09:01:48.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.328+0000 7f1325e71740 1 -- 172.21.15.92:0/423175253 shutdown_connections 2024-09-19T09:01:48.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.328+0000 7f1325e71740 1 --2- 172.21.15.92:0/423175253 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55df4042ed40 0x55df40431160 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.328+0000 7f1325e71740 1 --2- 172.21.15.92:0/423175253 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55df403aa370 0x55df403bdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.328+0000 7f1325e71740 1 --2- 172.21.15.92:0/423175253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55df403a52e0 0x55df403bcb20 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.328+0000 7f1325e71740 1 --2- 172.21.15.92:0/423175253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df403a49a0 0x55df403bc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.328+0000 7f1325e71740 1 -- 172.21.15.92:0/423175253 >> 172.21.15.92:0/423175253 conn(0x55df403a0010 msgr2=0x55df4039f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:48.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.328+0000 7f12fbfff640 0 client.16557 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:48.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.328+0000 7f1325e71740 1 -- 172.21.15.92:0/423175253 shutdown_connections 2024-09-19T09:01:48.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.328+0000 7f1325e71740 1 -- 172.21.15.92:0/423175253 wait complete. 2024-09-19T09:01:48.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.328+0000 7f1325e71740 20 client.16557 trim_cache size 0 max 16384 2024-09-19T09:01:48.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:01:48.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:01:48.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:01:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:01:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.329+0000 7f13230d7640 1 -- 172.21.15.92:0/2104916597 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f130c0a3370 msgr2=0x7f130c0a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.329+0000 7f13230d7640 1 --2- 172.21.15.92:0/2104916597 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f130c0a3370 0x7f130c0a5830 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f13100314e0 tx=0x7f1310032c30 comp rx=0 tx=0).stop 2024-09-19T09:01:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.329+0000 7f13230d7640 1 -- 172.21.15.92:0/2104916597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f131c101c30 msgr2=0x7f131c19a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:48.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.329+0000 7f13230d7640 1 --2- 172.21.15.92:0/2104916597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f131c101c30 0x7f131c19a550 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f130800c970 tx=0x7f130800ce30 comp rx=0 tx=0).stop 2024-09-19T09:01:48.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.329+0000 7f13230d7640 1 -- 172.21.15.92:0/2104916597 shutdown_connections 2024-09-19T09:01:48.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.329+0000 7f13230d7640 1 --2- 172.21.15.92:0/2104916597 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f130c0a3370 0x7f130c0a5830 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.329+0000 7f13230d7640 1 --2- 172.21.15.92:0/2104916597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f131c1025f0 0x7f131c1a15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.329+0000 7f13230d7640 1 --2- 172.21.15.92:0/2104916597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f131c101c30 0x7f131c19a550 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.329+0000 7f13230d7640 1 --2- 172.21.15.92:0/2104916597 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f131c100a40 0x7f131c19a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:48.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.329+0000 7f13230d7640 1 -- 172.21.15.92:0/2104916597 >> 172.21.15.92:0/2104916597 conn(0x7f131c0fc1e0 msgr2=0x7f131c0fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:48.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.329+0000 7f13230d7640 1 -- 172.21.15.92:0/2104916597 shutdown_connections 2024-09-19T09:01:48.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:01:48.329+0000 7f13230d7640 1 -- 172.21.15.92:0/2104916597 wait complete. 2024-09-19T09:01:49.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:49 smithi092 ceph-mon[31407]: pgmap v490: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.9 MiB/s wr, 704 op/s 2024-09-19T09:01:49.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:49 smithi167 ceph-mon[35359]: pgmap v490: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.9 MiB/s wr, 704 op/s 2024-09-19T09:01:49.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:49 smithi190 ceph-mon[35358]: pgmap v490: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.9 MiB/s wr, 704 op/s 2024-09-19T09:01:50.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 305.0 s, 3667.2 tps, lat 27.194 ms stddev 29.513 2024-09-19T09:01:51.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:51 smithi092 ceph-mon[31407]: pgmap v491: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 7.2 MiB/s wr, 746 op/s 2024-09-19T09:01:51.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:51 smithi167 ceph-mon[35359]: pgmap v491: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 7.2 MiB/s wr, 746 op/s 2024-09-19T09:01:51.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:51 smithi190 ceph-mon[35358]: pgmap v491: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 7.2 MiB/s wr, 746 op/s 2024-09-19T09:01:53.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:53 smithi092 ceph-mon[31407]: pgmap v492: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.6 MiB/s wr, 758 op/s 2024-09-19T09:01:53.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:53 smithi167 ceph-mon[35359]: pgmap v492: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.6 MiB/s wr, 758 op/s 2024-09-19T09:01:53.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:53 smithi190 ceph-mon[35358]: pgmap v492: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.6 MiB/s wr, 758 op/s 2024-09-19T09:01:55.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:55 smithi092 ceph-mon[31407]: pgmap v493: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.0 MiB/s wr, 792 op/s 2024-09-19T09:01:55.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 310.0 s, 4232.2 tps, lat 23.681 ms stddev 24.965 2024-09-19T09:01:55.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:55 smithi167 ceph-mon[35359]: pgmap v493: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.0 MiB/s wr, 792 op/s 2024-09-19T09:01:55.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:55 smithi190 ceph-mon[35358]: pgmap v493: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.0 MiB/s wr, 792 op/s 2024-09-19T09:01:57.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:57 smithi092 ceph-mon[31407]: pgmap v494: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.2 MiB/s wr, 737 op/s 2024-09-19T09:01:57.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:57 smithi167 ceph-mon[35359]: pgmap v494: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.2 MiB/s wr, 737 op/s 2024-09-19T09:01:57.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:57 smithi190 ceph-mon[35358]: pgmap v494: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.2 MiB/s wr, 737 op/s 2024-09-19T09:01:57.923 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:01:58.317 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:58.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.849+0000 7fe5e62a6640 1 -- 172.21.15.92:0/751123732 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe5e0101df0 msgr2=0x7fe5e01021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:58.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.849+0000 7fe5e62a6640 1 --2- 172.21.15.92:0/751123732 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe5e0101df0 0x7fe5e01021d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0009860 tx=0x7fe5d002a340 comp rx=0 tx=0).stop 2024-09-19T09:01:58.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.849+0000 7fe5e62a6640 1 -- 172.21.15.92:0/751123732 shutdown_connections 2024-09-19T09:01:58.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.849+0000 7fe5e62a6640 1 --2- 172.21.15.92:0/751123732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe5e0106f20 0x7fe5e010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.849+0000 7fe5e62a6640 1 --2- 172.21.15.92:0/751123732 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5e01027a0 0x7fe5e01067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.849+0000 7fe5e62a6640 1 --2- 172.21.15.92:0/751123732 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe5e0101df0 0x7fe5e01021d0 secure :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0009860 tx=0x7fe5d002a340 comp rx=0 tx=0).stop 2024-09-19T09:01:58.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.849+0000 7fe5e62a6640 1 -- 172.21.15.92:0/751123732 >> 172.21.15.92:0/751123732 conn(0x7fe5e00fd8b0 msgr2=0x7fe5e00ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:58.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.851+0000 7fe5e62a6640 1 -- 172.21.15.92:0/751123732 shutdown_connections 2024-09-19T09:01:58.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.851+0000 7fe5e62a6640 1 -- 172.21.15.92:0/751123732 wait complete. 2024-09-19T09:01:58.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.852+0000 7fe5e62a6640 1 Processor -- start 2024-09-19T09:01:58.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.852+0000 7fe5e62a6640 1 -- start start 2024-09-19T09:01:58.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.852+0000 7fe5e62a6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe5e01027a0 0x7fe5e00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:58.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.852+0000 7fe5e62a6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5e0106f20 0x7fe5e0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:58.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.852+0000 7fe5e62a6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe5e0074f70 0x7fe5e01a67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:58.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.852+0000 7fe5e62a6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e0111f80 con 0x7fe5e0106f20 2024-09-19T09:01:58.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.852+0000 7fe5e62a6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e0111e00 con 0x7fe5e0074f70 2024-09-19T09:01:58.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.852+0000 7fe5e62a6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e0112100 con 0x7fe5e01027a0 2024-09-19T09:01:58.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.853+0000 7fe5dffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe5e01027a0 0x7fe5e00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:58.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.853+0000 7fe5df7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5e0106f20 0x7fe5e0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:58.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.853+0000 7fe5dffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe5e01027a0 0x7fe5e00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:55366/0 (socket says 172.21.15.92:55366) 2024-09-19T09:01:58.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.853+0000 7fe5df7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5e0106f20 0x7fe5e0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52280/0 (socket says 172.21.15.92:52280) 2024-09-19T09:01:58.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.853+0000 7fe5df7fe640 1 -- 172.21.15.92:0/4182699599 learned_addr learned my addr 172.21.15.92:0/4182699599 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:58.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.853+0000 7fe5e4843640 1 --2- 172.21.15.92:0/4182699599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe5e0074f70 0x7fe5e01a67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:58.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.853+0000 7fe5df7fe640 1 -- 172.21.15.92:0/4182699599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe5e01027a0 msgr2=0x7fe5e00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:58.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.853+0000 7fe5df7fe640 1 --2- 172.21.15.92:0/4182699599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe5e01027a0 0x7fe5e00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.853+0000 7fe5df7fe640 1 -- 172.21.15.92:0/4182699599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe5e0074f70 msgr2=0x7fe5e01a67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:58.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.853+0000 7fe5df7fe640 1 --2- 172.21.15.92:0/4182699599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe5e0074f70 0x7fe5e01a67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.853+0000 7fe5df7fe640 1 -- 172.21.15.92:0/4182699599 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5e01a6ea0 con 0x7fe5e0106f20 2024-09-19T09:01:58.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.853+0000 7fe5df7fe640 1 --2- 172.21.15.92:0/4182699599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5e0106f20 0x7fe5e0074a30 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fe5d400d950 tx=0x7fe5d400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:58.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.854+0000 7fe5dd7fa640 1 -- 172.21.15.92:0/4182699599 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d4017030 con 0x7fe5e0106f20 2024-09-19T09:01:58.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.855+0000 7fe5dd7fa640 1 -- 172.21.15.92:0/4182699599 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5d4004020 con 0x7fe5e0106f20 2024-09-19T09:01:58.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.855+0000 7fe5dd7fa640 1 -- 172.21.15.92:0/4182699599 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d40047a0 con 0x7fe5e0106f20 2024-09-19T09:01:58.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.855+0000 7fe5e62a6640 1 -- 172.21.15.92:0/4182699599 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5e01a7190 con 0x7fe5e0106f20 2024-09-19T09:01:58.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.855+0000 7fe5e62a6640 1 -- 172.21.15.92:0/4182699599 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5e01a7620 con 0x7fe5e0106f20 2024-09-19T09:01:58.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.858+0000 7fe5e867f740 1 Processor -- start 2024-09-19T09:01:58.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.858+0000 7fe5dd7fa640 1 -- 172.21.15.92:0/4182699599 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe5d40041d0 con 0x7fe5e0106f20 2024-09-19T09:01:58.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.858+0000 7fe5e867f740 1 -- start start 2024-09-19T09:01:58.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.859+0000 7fe5e867f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d9c0f94a0 0x556d9c0f9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:58.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.859+0000 7fe5e867f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d9c0f9dc0 0x556d9c104140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:58.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.859+0000 7fe5e867f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d9c104680 0x556d9c106a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:58.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.859+0000 7fe5e867f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556d9c05f2e0 con 0x556d9c0f94a0 2024-09-19T09:01:58.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.859+0000 7fe5e867f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556d9c006ce0 con 0x556d9c104680 2024-09-19T09:01:58.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.859+0000 7fe5e867f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x556d9c05b2a0 con 0x556d9c0f9dc0 2024-09-19T09:01:58.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.859+0000 7fe5e4843640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d9c0f94a0 0x556d9c0f9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:58.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.859+0000 7fe5e4843640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d9c0f94a0 0x556d9c0f9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52284/0 (socket says 172.21.15.92:52284) 2024-09-19T09:01:58.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.859+0000 7fe5e4843640 1 -- 172.21.15.92:0/2104844329 learned_addr learned my addr 172.21.15.92:0/2104844329 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:58.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.860+0000 7fe5dffff640 1 --2- 172.21.15.92:0/2104844329 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d9c0f9dc0 0x556d9c104140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:58.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.860+0000 7fe5df7fe640 1 --2- 172.21.15.92:0/2104844329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d9c104680 0x556d9c106a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:58.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.860+0000 7fe5dffff640 1 -- 172.21.15.92:0/2104844329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d9c104680 msgr2=0x556d9c106a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:58.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.860+0000 7fe5dffff640 1 --2- 172.21.15.92:0/2104844329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d9c104680 0x556d9c106a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.860+0000 7fe5dffff640 1 -- 172.21.15.92:0/2104844329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d9c0f94a0 msgr2=0x556d9c0f9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:58.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.860+0000 7fe5dffff640 1 --2- 172.21.15.92:0/2104844329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d9c0f94a0 0x556d9c0f9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.860+0000 7fe5dffff640 1 -- 172.21.15.92:0/2104844329 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d9bfeb440 con 0x556d9c0f9dc0 2024-09-19T09:01:58.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.861+0000 7fe5df7fe640 1 --2- 172.21.15.92:0/2104844329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d9c104680 0x556d9c106a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:58.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.861+0000 7fe5dffff640 1 --2- 172.21.15.92:0/2104844329 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d9c0f9dc0 0x556d9c104140 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0008000 tx=0x7fe5d0009510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=885f89454ede545f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:58.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.861+0000 7fe5c67fc640 1 -- 172.21.15.92:0/2104844329 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d0041020 con 0x556d9c0f9dc0 2024-09-19T09:01:58.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.861+0000 7fe5c67fc640 1 -- 172.21.15.92:0/2104844329 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5d0030e50 con 0x556d9c0f9dc0 2024-09-19T09:01:58.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.861+0000 7fe5c67fc640 1 -- 172.21.15.92:0/2104844329 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d0037040 con 0x556d9c0f9dc0 2024-09-19T09:01:58.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.861+0000 7fe5dd7fa640 1 --2- 172.21.15.92:0/4182699599 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe5c80a3340 0x7fe5c80a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:58.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.861+0000 7fe5e4843640 1 --2- 172.21.15.92:0/4182699599 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe5c80a3340 0x7fe5c80a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:58.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.862+0000 7fe5dd7fa640 1 -- 172.21.15.92:0/4182699599 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe5d40cf210 con 0x7fe5e0106f20 2024-09-19T09:01:58.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.862+0000 7fe5e867f740 1 -- 172.21.15.92:0/2104844329 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d9c0f9dc0 msgr2=0x556d9c104140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:58.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.862+0000 7fe5e867f740 1 --2- 172.21.15.92:0/2104844329 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d9c0f9dc0 0x556d9c104140 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0008000 tx=0x7fe5d0009510 comp rx=0 tx=0).stop 2024-09-19T09:01:58.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.862+0000 7fe5e867f740 1 -- 172.21.15.92:0/2104844329 shutdown_connections 2024-09-19T09:01:58.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.862+0000 7fe5e867f740 1 --2- 172.21.15.92:0/2104844329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d9c104680 0x556d9c106a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.863+0000 7fe5e867f740 1 --2- 172.21.15.92:0/2104844329 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d9c0f9dc0 0x556d9c104140 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.863+0000 7fe5e867f740 1 --2- 172.21.15.92:0/2104844329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d9c0f94a0 0x556d9c0f9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.863+0000 7fe5e867f740 1 -- 172.21.15.92:0/2104844329 >> 172.21.15.92:0/2104844329 conn(0x556d9c0f5a30 msgr2=0x556d9c0f5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:58.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.863+0000 7fe5e4843640 1 --2- 172.21.15.92:0/4182699599 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe5c80a3340 0x7fe5c80a5800 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe5d8018a50 tx=0x7fe5d8010040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:58.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.863+0000 7fe5e867f740 1 -- 172.21.15.92:0/2104844329 shutdown_connections 2024-09-19T09:01:58.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.864+0000 7fe5e867f740 1 -- 172.21.15.92:0/2104844329 wait complete. 2024-09-19T09:01:58.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.864+0000 7fe5e867f740 1 -- start start 2024-09-19T09:01:58.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.864+0000 7fe5e867f740 1 Processor -- start 2024-09-19T09:01:58.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.865+0000 7fe5e867f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d9c0f94a0 0x556d9c103f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:58.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.865+0000 7fe5e867f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d9c0f9dc0 0x556d9c1011d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:58.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.865+0000 7fe5e867f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d9c104680 0x556d9c101710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:58.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.865+0000 7fe5e867f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556d9c107250 con 0x556d9c0f9dc0 2024-09-19T09:01:58.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.865+0000 7fe5e867f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556d9c01a050 con 0x556d9c0f94a0 2024-09-19T09:01:58.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.865+0000 7fe5e867f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x556d9c1073d0 con 0x556d9c104680 2024-09-19T09:01:58.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.865+0000 7fe5e867f740 10 client.0 _ll_register_callbacks cb 0x556d9c05a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:58.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.865+0000 7fe5e4843640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d9c104680 0x556d9c101710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:58.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.865+0000 7fe5df7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d9c0f9dc0 0x556d9c1011d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:58.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.865+0000 7fe5e4843640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d9c104680 0x556d9c101710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:55388/0 (socket says 172.21.15.92:55388) 2024-09-19T09:01:58.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.865+0000 7fe5e4843640 1 -- 172.21.15.92:0/204432428 learned_addr learned my addr 172.21.15.92:0/204432428 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:58.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.865+0000 7fe5dffff640 1 --2- 172.21.15.92:0/204432428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d9c0f94a0 0x556d9c103f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:58.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.865+0000 7fe5dffff640 1 -- 172.21.15.92:0/204432428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d9c104680 msgr2=0x556d9c101710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:58.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.865+0000 7fe5dffff640 1 --2- 172.21.15.92:0/204432428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d9c104680 0x556d9c101710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.865+0000 7fe5dffff640 1 -- 172.21.15.92:0/204432428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d9c0f9dc0 msgr2=0x556d9c1011d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:58.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.865+0000 7fe5dffff640 1 --2- 172.21.15.92:0/204432428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d9c0f9dc0 0x556d9c1011d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.865+0000 7fe5dffff640 1 -- 172.21.15.92:0/204432428 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d9bdd03c0 con 0x556d9c0f94a0 2024-09-19T09:01:58.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.865+0000 7fe5df7fe640 1 --2- 172.21.15.92:0/204432428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d9c0f9dc0 0x556d9c1011d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:58.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.865+0000 7fe5e4843640 1 --2- 172.21.15.92:0/204432428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d9c104680 0x556d9c101710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:58.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.866+0000 7fe5dffff640 1 --2- 172.21.15.92:0/204432428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d9c0f94a0 0x556d9c103f20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0005e00 tx=0x7fe5d0005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a91a313948c5201f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:58.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.866+0000 7fe5bf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:01:58.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.866+0000 7fe5bf7fe640 1 -- 172.21.15.92:0/204432428 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d004d070 con 0x556d9c0f94a0 2024-09-19T09:01:58.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.866+0000 7fe5bf7fe640 1 -- 172.21.15.92:0/204432428 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe5d0004250 con 0x556d9c0f94a0 2024-09-19T09:01:58.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.866+0000 7fe5e867f740 1 -- 172.21.15.92:0/204432428 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5d0030e50 con 0x556d9c0f94a0 2024-09-19T09:01:58.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.866+0000 7fe5bf7fe640 1 -- 172.21.15.92:0/204432428 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe5d0037040 con 0x556d9c0f94a0 2024-09-19T09:01:58.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.866+0000 7fe5e867f740 10 client.25970 fetch_fsmap learned FSMap version 19 2024-09-19T09:01:58.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.866+0000 7fe5e867f740 1 -- 172.21.15.92:0/204432428 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x556d9c112b70 con 0x556d9c0f94a0 2024-09-19T09:01:58.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.866+0000 7fe5bf7fe640 1 -- 172.21.15.92:0/204432428 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5d0030e50 con 0x556d9c0f94a0 2024-09-19T09:01:58.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.867+0000 7fe5bf7fe640 1 -- 172.21.15.92:0/204432428 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe5d0050020 con 0x556d9c0f94a0 2024-09-19T09:01:58.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.867+0000 7fe5e867f740 10 client.25970 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:01:58.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.867+0000 7fe5e867f740 10 client.25970 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:01:58.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.867+0000 7fe5e867f740 20 client.25970 populate_metadata read hostname 'smithi092' 2024-09-19T09:01:58.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.867+0000 7fe5e867f740 1 --2- 172.21.15.92:0/204432428 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556d9c113ec0 0x556d9c1162b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:58.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.867+0000 7fe5e867f740 4 client.25970 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:01:58.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.867+0000 7fe5e867f740 1 -- 172.21.15.92:0/204432428 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d9c06c850 con 0x556d9c113ec0 2024-09-19T09:01:58.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.868+0000 7fe5df7fe640 1 --2- 172.21.15.92:0/204432428 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556d9c113ec0 0x556d9c1162b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:58.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.869+0000 7fe5bf7fe640 10 client.25970 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:58.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.869+0000 7fe5df7fe640 1 --2- 172.21.15.92:0/204432428 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556d9c113ec0 0x556d9c1162b0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b56893c8f3dd5a5f server_cookie=6247b4959a2460c5 in_seq=0 out_seq=0 2024-09-19T09:01:58.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.869+0000 7fe5bf7fe640 1 -- 172.21.15.92:0/204432428 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556d9c06c850 con 0x556d9c113ec0 2024-09-19T09:01:58.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.869+0000 7fe5bf7fe640 10 client.25970 handle_command_reply: tid=0 2024-09-19T09:01:58.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.869+0000 7fe5e867f740 1 client.25970 shutdown 2024-09-19T09:01:58.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.869+0000 7fe5e867f740 1 -- 172.21.15.92:0/204432428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d9c0f94a0 msgr2=0x556d9c103f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:58.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.869+0000 7fe5e867f740 1 --2- 172.21.15.92:0/204432428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d9c0f94a0 0x556d9c103f20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0005e00 tx=0x7fe5d0005f90 comp rx=0 tx=0).stop 2024-09-19T09:01:58.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.870+0000 7fe5e867f740 1 -- 172.21.15.92:0/204432428 shutdown_connections 2024-09-19T09:01:58.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.870+0000 7fe5e867f740 1 --2- 172.21.15.92:0/204432428 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556d9c113ec0 0x556d9c1162b0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.870+0000 7fe5e867f740 1 --2- 172.21.15.92:0/204432428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d9c104680 0x556d9c101710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.870+0000 7fe5e867f740 1 --2- 172.21.15.92:0/204432428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d9c0f9dc0 0x556d9c1011d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.870+0000 7fe5e867f740 1 --2- 172.21.15.92:0/204432428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d9c0f94a0 0x556d9c103f20 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.870+0000 7fe5e867f740 1 -- 172.21.15.92:0/204432428 >> 172.21.15.92:0/204432428 conn(0x556d9c0f5a30 msgr2=0x556d9c0fb710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:58.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.870+0000 7fe5bf7fe640 0 client.25970 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:58.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.870+0000 7fe5e867f740 1 -- 172.21.15.92:0/204432428 shutdown_connections 2024-09-19T09:01:58.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.870+0000 7fe5e867f740 1 -- 172.21.15.92:0/204432428 wait complete. 2024-09-19T09:01:58.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.870+0000 7fe5e867f740 20 client.25970 trim_cache size 0 max 16384 2024-09-19T09:01:58.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.900+0000 7fe5e867f740 1 Processor -- start 2024-09-19T09:01:58.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.900+0000 7fe5e867f740 1 -- start start 2024-09-19T09:01:58.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.900+0000 7fe5e867f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d9c0f94a0 0x556d9c1104b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:58.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.900+0000 7fe5e867f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d9c0f9dc0 0x556d9c11b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:58.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.900+0000 7fe5e867f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d9c104680 0x556d9c11bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:58.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.901+0000 7fe5e867f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e01a9910 con 0x556d9c0f9dc0 2024-09-19T09:01:58.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.901+0000 7fe5e867f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e01ac190 con 0x556d9c104680 2024-09-19T09:01:58.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.901+0000 7fe5e867f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e01a9f80 con 0x556d9c0f94a0 2024-09-19T09:01:58.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.901+0000 7fe5dffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d9c0f94a0 0x556d9c1104b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:58.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.901+0000 7fe5df7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d9c0f9dc0 0x556d9c11b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:58.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.901+0000 7fe5dffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d9c0f94a0 0x556d9c1104b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:55400/0 (socket says 172.21.15.92:55400) 2024-09-19T09:01:58.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.901+0000 7fe5dffff640 1 -- 172.21.15.92:0/1792693314 learned_addr learned my addr 172.21.15.92:0/1792693314 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:58.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.901+0000 7fe5e4843640 1 --2- 172.21.15.92:0/1792693314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d9c104680 0x556d9c11bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:58.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.901+0000 7fe5df7fe640 1 -- 172.21.15.92:0/1792693314 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d9c0f94a0 msgr2=0x556d9c1104b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:58.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.901+0000 7fe5df7fe640 1 --2- 172.21.15.92:0/1792693314 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d9c0f94a0 0x556d9c1104b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.901+0000 7fe5df7fe640 1 -- 172.21.15.92:0/1792693314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d9c104680 msgr2=0x556d9c11bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:58.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.901+0000 7fe5df7fe640 1 --2- 172.21.15.92:0/1792693314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d9c104680 0x556d9c11bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.901+0000 7fe5df7fe640 1 -- 172.21.15.92:0/1792693314 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d9c0f65e0 con 0x556d9c0f9dc0 2024-09-19T09:01:58.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.901+0000 7fe5df7fe640 1 --2- 172.21.15.92:0/1792693314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d9c0f9dc0 0x556d9c11b8b0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fe5d40ccca0 tx=0x7fe5d4086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a7cb8f4bab3951d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:58.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.901+0000 7fe5c5ffb640 1 -- 172.21.15.92:0/1792693314 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d4097a90 con 0x556d9c0f9dc0 2024-09-19T09:01:58.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.901+0000 7fe5c5ffb640 1 -- 172.21.15.92:0/1792693314 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5d409bef0 con 0x556d9c0f9dc0 2024-09-19T09:01:58.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.902+0000 7fe5c5ffb640 1 -- 172.21.15.92:0/1792693314 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d409b150 con 0x556d9c0f9dc0 2024-09-19T09:01:58.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.902+0000 7fe5e867f740 1 -- 172.21.15.92:0/1792693314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d9c0f9dc0 msgr2=0x556d9c11b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:58.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.902+0000 7fe5e867f740 1 --2- 172.21.15.92:0/1792693314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d9c0f9dc0 0x556d9c11b8b0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fe5d40ccca0 tx=0x7fe5d4086040 comp rx=0 tx=0).stop 2024-09-19T09:01:58.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.902+0000 7fe5e867f740 1 -- 172.21.15.92:0/1792693314 shutdown_connections 2024-09-19T09:01:58.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.902+0000 7fe5e867f740 1 --2- 172.21.15.92:0/1792693314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d9c104680 0x556d9c11bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.902+0000 7fe5e867f740 1 --2- 172.21.15.92:0/1792693314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d9c0f9dc0 0x556d9c11b8b0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.902+0000 7fe5e867f740 1 --2- 172.21.15.92:0/1792693314 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d9c0f94a0 0x556d9c1104b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.902+0000 7fe5e867f740 1 -- 172.21.15.92:0/1792693314 >> 172.21.15.92:0/1792693314 conn(0x556d9c0f5a30 msgr2=0x556d9c1002c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:58.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.903+0000 7fe5e867f740 1 -- 172.21.15.92:0/1792693314 shutdown_connections 2024-09-19T09:01:58.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.903+0000 7fe5e867f740 1 -- 172.21.15.92:0/1792693314 wait complete. 2024-09-19T09:01:58.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.903+0000 7fe5e867f740 1 -- start start 2024-09-19T09:01:58.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.903+0000 7fe5e867f740 1 Processor -- start 2024-09-19T09:01:58.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.904+0000 7fe5e867f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d9c0f94a0 0x556d9c109650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:58.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.904+0000 7fe5e867f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d9c0f9dc0 0x556d9c109b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:58.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.904+0000 7fe5e867f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d9c104680 0x556d9c10a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:58.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.904+0000 7fe5e867f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e01aa650 con 0x556d9c0f9dc0 2024-09-19T09:01:58.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.904+0000 7fe5e867f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e01abac0 con 0x556d9c104680 2024-09-19T09:01:58.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.904+0000 7fe5e867f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e01aad20 con 0x556d9c0f94a0 2024-09-19T09:01:58.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.904+0000 7fe5e867f740 10 client.0 _ll_register_callbacks cb 0x7fe5d8009c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:58.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.904+0000 7fe5e4843640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d9c104680 0x556d9c10a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:58.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.904+0000 7fe5e4843640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d9c104680 0x556d9c10a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:48844/0 (socket says 172.21.15.92:48844) 2024-09-19T09:01:58.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.904+0000 7fe5e4843640 1 -- 172.21.15.92:0/1166894007 learned_addr learned my addr 172.21.15.92:0/1166894007 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:01:58.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.905+0000 7fe5e4843640 1 -- 172.21.15.92:0/1166894007 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d9c0f94a0 msgr2=0x556d9c109650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:01:58.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.905+0000 7fe5e4843640 1 --2- 172.21.15.92:0/1166894007 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d9c0f94a0 0x556d9c109650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.905+0000 7fe5e4843640 1 -- 172.21.15.92:0/1166894007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d9c0f9dc0 msgr2=0x556d9c109b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:58.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.905+0000 7fe5e4843640 1 --2- 172.21.15.92:0/1166894007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d9c0f9dc0 0x556d9c109b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.905+0000 7fe5e4843640 1 -- 172.21.15.92:0/1166894007 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d9c104290 con 0x556d9c104680 2024-09-19T09:01:58.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.905+0000 7fe5e4843640 1 --2- 172.21.15.92:0/1166894007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d9c104680 0x556d9c10a0d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe5d8024c10 tx=0x7fe5d8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28716b5c3ab9c960 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:58.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.905+0000 7fe5bf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:01:58.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.905+0000 7fe5bf7fe640 1 -- 172.21.15.92:0/1166894007 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d8034060 con 0x556d9c104680 2024-09-19T09:01:58.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.905+0000 7fe5bf7fe640 1 -- 172.21.15.92:0/1166894007 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe5d8023990 con 0x556d9c104680 2024-09-19T09:01:58.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.905+0000 7fe5e867f740 1 -- 172.21.15.92:0/1166894007 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5d409bef0 con 0x556d9c104680 2024-09-19T09:01:58.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.906+0000 7fe5bf7fe640 1 -- 172.21.15.92:0/1166894007 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe5d8023b90 con 0x556d9c104680 2024-09-19T09:01:58.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.906+0000 7fe5e867f740 10 client.25976 fetch_fsmap learned FSMap version 19 2024-09-19T09:01:58.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.906+0000 7fe5e867f740 1 -- 172.21.15.92:0/1166894007 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x556d9c17dcc0 con 0x556d9c104680 2024-09-19T09:01:58.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.906+0000 7fe5bf7fe640 1 -- 172.21.15.92:0/1166894007 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5d409bef0 con 0x556d9c104680 2024-09-19T09:01:58.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.906+0000 7fe5bf7fe640 1 -- 172.21.15.92:0/1166894007 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe5d8039070 con 0x556d9c104680 2024-09-19T09:01:58.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.906+0000 7fe5e867f740 10 client.25976 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:01:58.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.906+0000 7fe5e867f740 10 client.25976 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:01:58.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.906+0000 7fe5e867f740 20 client.25976 populate_metadata read hostname 'smithi092' 2024-09-19T09:01:58.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.906+0000 7fe5e867f740 1 --2- 172.21.15.92:0/1166894007 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556d9c17e410 0x556d9c180890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:58.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.906+0000 7fe5e867f740 4 client.25976 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:01:58.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.906+0000 7fe5e867f740 1 -- 172.21.15.92:0/1166894007 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556d9c066d60 con 0x556d9c17e410 2024-09-19T09:01:58.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.907+0000 7fe5dffff640 1 --2- 172.21.15.92:0/1166894007 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556d9c17e410 0x556d9c180890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:58.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.907+0000 7fe5bf7fe640 10 client.25976 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:58.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.907+0000 7fe5dffff640 1 --2- 172.21.15.92:0/1166894007 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556d9c17e410 0x556d9c180890 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62d932adb7b91c4a server_cookie=1f090384956874ef in_seq=0 out_seq=0 2024-09-19T09:01:58.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.907+0000 7fe5bf7fe640 1 -- 172.21.15.92:0/1166894007 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x556d9c066d60 con 0x556d9c17e410 2024-09-19T09:01:58.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.907+0000 7fe5bf7fe640 10 client.25976 handle_command_reply: tid=0 2024-09-19T09:01:58.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.907+0000 7fe5e867f740 1 client.25976 shutdown 2024-09-19T09:01:58.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.907+0000 7fe5e867f740 1 -- 172.21.15.92:0/1166894007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d9c104680 msgr2=0x556d9c10a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:58.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.908+0000 7fe5e867f740 1 --2- 172.21.15.92:0/1166894007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d9c104680 0x556d9c10a0d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe5d8024c10 tx=0x7fe5d8004a40 comp rx=0 tx=0).stop 2024-09-19T09:01:58.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.908+0000 7fe5e867f740 1 -- 172.21.15.92:0/1166894007 shutdown_connections 2024-09-19T09:01:58.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.908+0000 7fe5e867f740 1 --2- 172.21.15.92:0/1166894007 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556d9c17e410 0x556d9c180890 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.908+0000 7fe5e867f740 1 --2- 172.21.15.92:0/1166894007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556d9c104680 0x556d9c10a0d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.908+0000 7fe5bf7fe640 0 client.25976 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:01:58.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.908+0000 7fe5e867f740 1 --2- 172.21.15.92:0/1166894007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d9c0f9dc0 0x556d9c109b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.908+0000 7fe5e867f740 1 --2- 172.21.15.92:0/1166894007 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d9c0f94a0 0x556d9c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.908+0000 7fe5e867f740 1 -- 172.21.15.92:0/1166894007 >> 172.21.15.92:0/1166894007 conn(0x556d9c0f5a30 msgr2=0x556d9c0f4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:58.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.908+0000 7fe5e867f740 1 -- 172.21.15.92:0/1166894007 shutdown_connections 2024-09-19T09:01:58.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.908+0000 7fe5e867f740 1 -- 172.21.15.92:0/1166894007 wait complete. 2024-09-19T09:01:58.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.908+0000 7fe5e867f740 20 client.25976 trim_cache size 0 max 16384 2024-09-19T09:01:58.914 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:01:58.914 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-19T09:01:58.914 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {} 2024-09-19T09:01:58.914 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:01:58.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.909+0000 7fe5e62a6640 1 -- 172.21.15.92:0/4182699599 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe5c80a3340 msgr2=0x7fe5c80a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:58.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.909+0000 7fe5e62a6640 1 --2- 172.21.15.92:0/4182699599 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe5c80a3340 0x7fe5c80a5800 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe5d8018a50 tx=0x7fe5d8010040 comp rx=0 tx=0).stop 2024-09-19T09:01:58.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.909+0000 7fe5e62a6640 1 -- 172.21.15.92:0/4182699599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5e0106f20 msgr2=0x7fe5e0074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:58.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.909+0000 7fe5e62a6640 1 --2- 172.21.15.92:0/4182699599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5e0106f20 0x7fe5e0074a30 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fe5d400d950 tx=0x7fe5d400de10 comp rx=0 tx=0).stop 2024-09-19T09:01:58.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.910+0000 7fe5e62a6640 1 -- 172.21.15.92:0/4182699599 shutdown_connections 2024-09-19T09:01:58.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.910+0000 7fe5e62a6640 1 --2- 172.21.15.92:0/4182699599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe5e0074f70 0x7fe5e01a67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.910+0000 7fe5e62a6640 1 --2- 172.21.15.92:0/4182699599 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe5c80a3340 0x7fe5c80a5800 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.910+0000 7fe5e62a6640 1 --2- 172.21.15.92:0/4182699599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5e0106f20 0x7fe5e0074a30 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.910+0000 7fe5e62a6640 1 --2- 172.21.15.92:0/4182699599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe5e01027a0 0x7fe5e00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.910+0000 7fe5e62a6640 1 -- 172.21.15.92:0/4182699599 >> 172.21.15.92:0/4182699599 conn(0x7fe5e00fd8b0 msgr2=0x7fe5e00fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:58.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.910+0000 7fe5e62a6640 1 -- 172.21.15.92:0/4182699599 shutdown_connections 2024-09-19T09:01:58.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:01:58.910+0000 7fe5e62a6640 1 -- 172.21.15.92:0/4182699599 wait complete. 2024-09-19T09:01:59.623 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:01:59 smithi092 ceph-mon[31407]: pgmap v495: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 8.0 MiB/s wr, 774 op/s 2024-09-19T09:01:59.830 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:01:59.830 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:01:59.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:01:59 smithi167 ceph-mon[35359]: pgmap v495: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 8.0 MiB/s wr, 774 op/s 2024-09-19T09:01:59.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:01:59 smithi190 ceph-mon[35358]: pgmap v495: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 8.0 MiB/s wr, 774 op/s 2024-09-19T09:02:00.212 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:00.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:00.770+0000 7f70998fb640 1 -- 172.21.15.92:0/1591490470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f709410ddc0 msgr2=0x7f7094115940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:00.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:00.770+0000 7f70998fb640 1 --2- 172.21.15.92:0/1591490470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f709410ddc0 0x7f7094115940 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f708c00adb0 tx=0x7f708c02b7a0 comp rx=0 tx=0).stop 2024-09-19T09:02:00.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:00.770+0000 7f70998fb640 1 -- 172.21.15.92:0/1591490470 shutdown_connections 2024-09-19T09:02:00.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:00.770+0000 7f70998fb640 1 --2- 172.21.15.92:0/1591490470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f709410ddc0 0x7f7094115940 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:00.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:00.770+0000 7f70998fb640 1 --2- 172.21.15.92:0/1591490470 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7094109e00 0x7f709410d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:00.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:00.770+0000 7f70998fb640 1 --2- 172.21.15.92:0/1591490470 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7094109450 0x7f7094109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:00.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:00.770+0000 7f70998fb640 1 -- 172.21.15.92:0/1591490470 >> 172.21.15.92:0/1591490470 conn(0x7f709406e140 msgr2=0x7f709406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:00.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:00.770+0000 7f70998fb640 1 -- 172.21.15.92:0/1591490470 shutdown_connections 2024-09-19T09:02:00.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:00.770+0000 7f70998fb640 1 -- 172.21.15.92:0/1591490470 wait complete. 2024-09-19T09:02:00.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:00.771+0000 7f70998fb640 1 Processor -- start 2024-09-19T09:02:00.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:00.771+0000 7f70998fb640 1 -- start start 2024-09-19T09:02:00.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:00.772+0000 7f70998fb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7094109450 0x7f70941a6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:00.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:00.772+0000 7f70998fb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7094109e00 0x7f70941a6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:00.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:00.772+0000 7f70998fb640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f709410ddc0 0x7f70941a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:00.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:00.772+0000 7f70998fb640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f70941185a0 con 0x7f7094109e00 2024-09-19T09:02:00.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:00.772+0000 7f70998fb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7094118420 con 0x7f7094109450 2024-09-19T09:02:00.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:00.772+0000 7f70998fb640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7094118720 con 0x7f709410ddc0 2024-09-19T09:02:00.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:00.772+0000 7f70937fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f709410ddc0 0x7f70941a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:00.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:00.772+0000 7f70937fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f709410ddc0 0x7f70941a0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:55420/0 (socket says 172.21.15.92:55420) 2024-09-19T09:02:00.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:00.772+0000 7f70937fe640 1 -- 172.21.15.92:0/3862510563 learned_addr learned my addr 172.21.15.92:0/3862510563 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:00.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:00.773+0000 7f70937fe640 1 -- 172.21.15.92:0/3862510563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7094109450 msgr2=0x7f70941a6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:00.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:00.773+0000 7f70937fe640 1 --2- 172.21.15.92:0/3862510563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7094109450 0x7f70941a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:00.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:00.773+0000 7f70937fe640 1 -- 172.21.15.92:0/3862510563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7094109e00 msgr2=0x7f70941a6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:00.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:00.773+0000 7f70937fe640 1 --2- 172.21.15.92:0/3862510563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7094109e00 0x7f70941a6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:00.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:00.773+0000 7f70937fe640 1 -- 172.21.15.92:0/3862510563 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70941a1160 con 0x7f709410ddc0 2024-09-19T09:02:00.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:00.773+0000 7f70937fe640 1 --2- 172.21.15.92:0/3862510563 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f709410ddc0 0x7f70941a0a30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f708c003f80 tx=0x7f708c032400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:00.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:00.774+0000 7f70988f9640 1 -- 172.21.15.92:0/3862510563 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708c040070 con 0x7f709410ddc0 2024-09-19T09:02:00.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:00.774+0000 7f70988f9640 1 -- 172.21.15.92:0/3862510563 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f708c0309f0 con 0x7f709410ddc0 2024-09-19T09:02:00.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:00.774+0000 7f70988f9640 1 -- 172.21.15.92:0/3862510563 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708c045460 con 0x7f709410ddc0 2024-09-19T09:02:00.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:00.774+0000 7f70998fb640 1 -- 172.21.15.92:0/3862510563 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70941a13f0 con 0x7f709410ddc0 2024-09-19T09:02:00.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:00.774+0000 7f70998fb640 1 -- 172.21.15.92:0/3862510563 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f709419e750 con 0x7f709410ddc0 2024-09-19T09:02:00.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:00.775+0000 7f70998fb640 1 -- 172.21.15.92:0/3862510563 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f709410a200 con 0x7f709410ddc0 2024-09-19T09:02:00.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:00.777+0000 7f70988f9640 1 -- 172.21.15.92:0/3862510563 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f708c004040 con 0x7f709410ddc0 2024-09-19T09:02:00.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:00.778+0000 7f70988f9640 1 --2- 172.21.15.92:0/3862510563 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f707c0a7820 0x7f707c0a9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:00.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:00.779+0000 7f7092ffd640 1 --2- 172.21.15.92:0/3862510563 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f707c0a7820 0x7f707c0a9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:00.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:00.779+0000 7f70988f9640 1 -- 172.21.15.92:0/3862510563 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f708c0f10d0 con 0x7f709410ddc0 2024-09-19T09:02:00.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:00.779+0000 7f7092ffd640 1 --2- 172.21.15.92:0/3862510563 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f707c0a7820 0x7f707c0a9ce0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7088005fd0 tx=0x7f7088005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:00.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:00.780+0000 7f70988f9640 1 -- 172.21.15.92:0/3862510563 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f708c0bde30 con 0x7f709410ddc0 2024-09-19T09:02:00.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 315.0 s, 3605.4 tps, lat 27.694 ms stddev 34.500 2024-09-19T09:02:01.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:01.120+0000 7f70998fb640 1 -- 172.21.15.92:0/3862510563 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7094109830 con 0x7f709410ddc0 2024-09-19T09:02:01.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:01.121+0000 7f70988f9640 1 -- 172.21.15.92:0/3862510563 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f7094109830 con 0x7f709410ddc0 2024-09-19T09:02:01.124 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:02:01.124 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:02:01.125 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:02:01.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:01.123+0000 7f70998fb640 1 -- 172.21.15.92:0/3862510563 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f707c0a7820 msgr2=0x7f707c0a9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:01.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:01.123+0000 7f70998fb640 1 --2- 172.21.15.92:0/3862510563 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f707c0a7820 0x7f707c0a9ce0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7088005fd0 tx=0x7f7088005c70 comp rx=0 tx=0).stop 2024-09-19T09:02:01.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:01.123+0000 7f70998fb640 1 -- 172.21.15.92:0/3862510563 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f709410ddc0 msgr2=0x7f70941a0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:01.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:01.123+0000 7f70998fb640 1 --2- 172.21.15.92:0/3862510563 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f709410ddc0 0x7f70941a0a30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f708c003f80 tx=0x7f708c032400 comp rx=0 tx=0).stop 2024-09-19T09:02:01.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:01.124+0000 7f70998fb640 1 -- 172.21.15.92:0/3862510563 shutdown_connections 2024-09-19T09:02:01.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:01.124+0000 7f70998fb640 1 --2- 172.21.15.92:0/3862510563 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f709410ddc0 0x7f70941a0a30 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:01.124+0000 7f70998fb640 1 --2- 172.21.15.92:0/3862510563 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f707c0a7820 0x7f707c0a9ce0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:01.124+0000 7f70998fb640 1 --2- 172.21.15.92:0/3862510563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7094109e00 0x7f70941a6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:01.124+0000 7f70998fb640 1 --2- 172.21.15.92:0/3862510563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7094109450 0x7f70941a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:01.124+0000 7f70998fb640 1 -- 172.21.15.92:0/3862510563 >> 172.21.15.92:0/3862510563 conn(0x7f709406e140 msgr2=0x7f7094071ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:01.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:01.124+0000 7f70998fb640 1 -- 172.21.15.92:0/3862510563 shutdown_connections 2024-09-19T09:02:01.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:01.124+0000 7f70998fb640 1 -- 172.21.15.92:0/3862510563 wait complete. 2024-09-19T09:02:01.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.461+0000 7f30fbc4c640 1 -- 172.21.15.92:0/1411452931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30f4102000 msgr2=0x7f30f4102400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:01.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.461+0000 7f30fbc4c640 1 --2- 172.21.15.92:0/1411452931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30f4102000 0x7f30f4102400 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f30f0009900 tx=0x7f30f002a410 comp rx=0 tx=0).stop 2024-09-19T09:02:01.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.461+0000 7f30fbc4c640 1 -- 172.21.15.92:0/1411452931 shutdown_connections 2024-09-19T09:02:01.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.461+0000 7f30fbc4c640 1 --2- 172.21.15.92:0/1411452931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30f41015f0 0x7f30f4108eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.461+0000 7f30fbc4c640 1 --2- 172.21.15.92:0/1411452931 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f30f4100c50 0x7f30f41010b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.461+0000 7f30fbc4c640 1 --2- 172.21.15.92:0/1411452931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30f4102000 0x7f30f4102400 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.461+0000 7f30fbc4c640 1 -- 172.21.15.92:0/1411452931 >> 172.21.15.92:0/1411452931 conn(0x7f30f40fb930 msgr2=0x7f30f40fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:01.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.461+0000 7f30fbc4c640 1 -- 172.21.15.92:0/1411452931 shutdown_connections 2024-09-19T09:02:01.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.461+0000 7f30fbc4c640 1 -- 172.21.15.92:0/1411452931 wait complete. 2024-09-19T09:02:01.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.462+0000 7f30fbc4c640 1 Processor -- start 2024-09-19T09:02:01.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.462+0000 7f30fbc4c640 1 -- start start 2024-09-19T09:02:01.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.462+0000 7f30fbc4c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30f4100c50 0x7f30f4195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:01.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.463+0000 7f30fbc4c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30f41015f0 0x7f30f4196110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:01.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.463+0000 7f30fbc4c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f30f4102000 0x7f30f419d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:01.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.463+0000 7f30fbc4c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f30f410b5d0 con 0x7f30f4100c50 2024-09-19T09:02:01.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.463+0000 7f30fbc4c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f30f410b450 con 0x7f30f41015f0 2024-09-19T09:02:01.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.463+0000 7f30fbc4c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f30f410b750 con 0x7f30f4102000 2024-09-19T09:02:01.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.463+0000 7f30f99e8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30f4100c50 0x7f30f4195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:01.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.463+0000 7f30f99e8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30f4100c50 0x7f30f4195bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52352/0 (socket says 172.21.15.92:52352) 2024-09-19T09:02:01.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.463+0000 7f30f99e8640 1 -- 172.21.15.92:0/1847276210 learned_addr learned my addr 172.21.15.92:0/1847276210 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:01.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.463+0000 7f30f91e7640 1 --2- 172.21.15.92:0/1847276210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30f41015f0 0x7f30f4196110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:01.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.463+0000 7f30fa1e9640 1 --2- 172.21.15.92:0/1847276210 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f30f4102000 0x7f30f419d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:01.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.463+0000 7f30f91e7640 1 -- 172.21.15.92:0/1847276210 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f30f4102000 msgr2=0x7f30f419d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:01.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.463+0000 7f30f91e7640 1 --2- 172.21.15.92:0/1847276210 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f30f4102000 0x7f30f419d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.463+0000 7f30f91e7640 1 -- 172.21.15.92:0/1847276210 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30f4100c50 msgr2=0x7f30f4195bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:01.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.463+0000 7f30f91e7640 1 --2- 172.21.15.92:0/1847276210 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30f4100c50 0x7f30f4195bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.463+0000 7f30f91e7640 1 -- 172.21.15.92:0/1847276210 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f419d7f0 con 0x7f30f41015f0 2024-09-19T09:02:01.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.464+0000 7f30f91e7640 1 --2- 172.21.15.92:0/1847276210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30f41015f0 0x7f30f4196110 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f30e4007860 tx=0x7f30e4007d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:01.469 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.468+0000 7f30eaffd640 1 -- 172.21.15.92:0/1847276210 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e400b280 con 0x7f30f41015f0 2024-09-19T09:02:01.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.469+0000 7f30eaffd640 1 -- 172.21.15.92:0/1847276210 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30e4005020 con 0x7f30f41015f0 2024-09-19T09:02:01.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.469+0000 7f30eaffd640 1 -- 172.21.15.92:0/1847276210 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e4004ba0 con 0x7f30f41015f0 2024-09-19T09:02:01.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.470+0000 7f30fbc4c640 1 -- 172.21.15.92:0/1847276210 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30f406bc70 con 0x7f30f41015f0 2024-09-19T09:02:01.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.471+0000 7f30fbc4c640 1 -- 172.21.15.92:0/1847276210 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30f406c080 con 0x7f30f41015f0 2024-09-19T09:02:01.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.474+0000 7f30fe9e7740 1 Processor -- start 2024-09-19T09:02:01.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.479+0000 7f30fe9e7740 1 -- start start 2024-09-19T09:02:01.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.479+0000 7f30fe9e7740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556dcfe979a0 0x556dcfe97da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:01.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.479+0000 7f30fe9e7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556dcfe982e0 0x556dcfe9cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:01.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.479+0000 7f30fe9e7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556dcfe9d370 0x556dcfe9f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:01.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.479+0000 7f30fe9e7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556dcfdfb2f0 con 0x556dcfe9d370 2024-09-19T09:02:01.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.479+0000 7f30fe9e7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556dcfda3270 con 0x556dcfe982e0 2024-09-19T09:02:01.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.479+0000 7f30fe9e7740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x556dcfdf72b0 con 0x556dcfe979a0 2024-09-19T09:02:01.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.481+0000 7f30fa1e9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556dcfe979a0 0x556dcfe97da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:01.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.481+0000 7f30f91e7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556dcfe9d370 0x556dcfe9f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:01.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.481+0000 7f30f91e7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556dcfe9d370 0x556dcfe9f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46194/0 (socket says 172.21.15.92:46194) 2024-09-19T09:02:01.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.482+0000 7f30f91e7640 1 -- 172.21.15.92:0/1574215528 learned_addr learned my addr 172.21.15.92:0/1574215528 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:01.484 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.482+0000 7f30f91e7640 1 -- 172.21.15.92:0/1574215528 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556dcfe979a0 msgr2=0x556dcfe97da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:01.484 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.482+0000 7f30f91e7640 1 --2- 172.21.15.92:0/1574215528 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556dcfe979a0 0x556dcfe97da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.484 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.482+0000 7f30f91e7640 1 -- 172.21.15.92:0/1574215528 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556dcfe982e0 msgr2=0x556dcfe9cda0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:02:01.484 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.482+0000 7f30f91e7640 1 --2- 172.21.15.92:0/1574215528 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556dcfe982e0 0x556dcfe9cda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.484 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.482+0000 7f30f91e7640 1 -- 172.21.15.92:0/1574215528 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dcfda2340 con 0x556dcfe9d370 2024-09-19T09:02:01.484 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.482+0000 7f30f91e7640 1 --2- 172.21.15.92:0/1574215528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556dcfe9d370 0x556dcfe9f830 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f30e40ee630 tx=0x7f30e40eeaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=758f67dd5d9c1f5c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:01.484 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.483+0000 7f30dffff640 1 -- 172.21.15.92:0/1574215528 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e40fa020 con 0x556dcfe9d370 2024-09-19T09:02:01.485 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.483+0000 7f30dffff640 1 -- 172.21.15.92:0/1574215528 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30e40f6d50 con 0x556dcfe9d370 2024-09-19T09:02:01.486 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.483+0000 7f30dffff640 1 -- 172.21.15.92:0/1574215528 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e40f5380 con 0x556dcfe9d370 2024-09-19T09:02:01.486 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.485+0000 7f30fe9e7740 1 -- 172.21.15.92:0/1574215528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556dcfe9d370 msgr2=0x556dcfe9f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.485+0000 7f30fe9e7740 1 --2- 172.21.15.92:0/1574215528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556dcfe9d370 0x556dcfe9f830 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f30e40ee630 tx=0x7f30e40eeaf0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.487+0000 7f30fe9e7740 1 -- 172.21.15.92:0/1574215528 shutdown_connections 2024-09-19T09:02:01.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.487+0000 7f30fe9e7740 1 --2- 172.21.15.92:0/1574215528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556dcfe9d370 0x556dcfe9f830 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.487+0000 7f30fe9e7740 1 --2- 172.21.15.92:0/1574215528 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556dcfe982e0 0x556dcfe9cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.487+0000 7f30fe9e7740 1 --2- 172.21.15.92:0/1574215528 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556dcfe979a0 0x556dcfe97da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.487+0000 7f30fe9e7740 1 -- 172.21.15.92:0/1574215528 >> 172.21.15.92:0/1574215528 conn(0x556dcfe93010 msgr2=0x556dcfe93410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:01.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.488+0000 7f30fe9e7740 1 -- 172.21.15.92:0/1574215528 shutdown_connections 2024-09-19T09:02:01.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.488+0000 7f30fe9e7740 1 -- 172.21.15.92:0/1574215528 wait complete. 2024-09-19T09:02:01.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.488+0000 7f30fe9e7740 1 -- start start 2024-09-19T09:02:01.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.488+0000 7f30eaffd640 1 -- 172.21.15.92:0/1847276210 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f30e40051d0 con 0x7f30f41015f0 2024-09-19T09:02:01.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.488+0000 7f30fe9e7740 1 Processor -- start 2024-09-19T09:02:01.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.490+0000 7f30eaffd640 1 --2- 172.21.15.92:0/1847276210 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f30e00a33a0 0x7f30e00a5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:01.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.490+0000 7f30eaffd640 1 -- 172.21.15.92:0/1847276210 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f30e40e1ec0 con 0x7f30f41015f0 2024-09-19T09:02:01.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.490+0000 7f30fa1e9640 1 --2- 172.21.15.92:0/1847276210 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f30e00a33a0 0x7f30e00a5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:01.499 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.497+0000 7f30fa1e9640 1 --2- 172.21.15.92:0/1847276210 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f30e00a33a0 0x7f30e00a5860 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f30ec005fd0 tx=0x7f30ec00f040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:01.499 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.498+0000 7f30fe9e7740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556dcfe979a0 0x556dcfea1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:01.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.498+0000 7f30fe9e7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556dcfe982e0 0x556dcfea2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:01.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.498+0000 7f30fe9e7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556dcfe9d370 0x556dcfea91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:01.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.498+0000 7f30fe9e7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556dcfea0340 con 0x556dcfe982e0 2024-09-19T09:02:01.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.498+0000 7f30fe9e7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556dcfd84290 con 0x556dcfe9d370 2024-09-19T09:02:01.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.498+0000 7f30fe9e7740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x556dcfea04c0 con 0x556dcfe979a0 2024-09-19T09:02:01.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.498+0000 7f30fe9e7740 10 client.0 _ll_register_callbacks cb 0x556dcfdb5140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:01.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.498+0000 7f30f99e8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556dcfe979a0 0x556dcfea1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:01.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.499+0000 7f30f99e8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556dcfe979a0 0x556dcfea1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:44978/0 (socket says 172.21.15.92:44978) 2024-09-19T09:02:01.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.499+0000 7f30f99e8640 1 -- 172.21.15.92:0/2039308669 learned_addr learned my addr 172.21.15.92:0/2039308669 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:01.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.499+0000 7f30f91e7640 1 --2- 172.21.15.92:0/2039308669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556dcfe982e0 0x556dcfea2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.499+0000 7f30fa1e9640 1 --2- 172.21.15.92:0/2039308669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556dcfe9d370 0x556dcfea91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.499+0000 7f30f99e8640 1 -- 172.21.15.92:0/2039308669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556dcfe9d370 msgr2=0x556dcfea91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.499+0000 7f30f99e8640 1 --2- 172.21.15.92:0/2039308669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556dcfe9d370 0x556dcfea91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.499+0000 7f30f99e8640 1 -- 172.21.15.92:0/2039308669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556dcfe982e0 msgr2=0x556dcfea2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.499+0000 7f30f99e8640 1 --2- 172.21.15.92:0/2039308669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556dcfe982e0 0x556dcfea2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.499+0000 7f30f99e8640 1 -- 172.21.15.92:0/2039308669 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556dcfb0e210 con 0x556dcfe979a0 2024-09-19T09:02:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.500+0000 7f30f99e8640 1 --2- 172.21.15.92:0/2039308669 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556dcfe979a0 0x556dcfea1c20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f30f0005940 tx=0x7f30f00318e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f037522fbf0fd8c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.500+0000 7f30dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:02:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.500+0000 7f30dd7fa640 1 -- 172.21.15.92:0/2039308669 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f003f070 con 0x556dcfe979a0 2024-09-19T09:02:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.500+0000 7f30dd7fa640 1 -- 172.21.15.92:0/2039308669 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f30f0004450 con 0x556dcfe979a0 2024-09-19T09:02:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.501+0000 7f30fe9e7740 1 -- 172.21.15.92:0/2039308669 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30e40f6d50 con 0x556dcfe979a0 2024-09-19T09:02:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.501+0000 7f30dd7fa640 1 -- 172.21.15.92:0/2039308669 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f30f0035070 con 0x556dcfe979a0 2024-09-19T09:02:01.503 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.502+0000 7f30fe9e7740 10 client.25906 fetch_fsmap learned FSMap version 19 2024-09-19T09:02:01.503 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.502+0000 7f30fe9e7740 1 -- 172.21.15.92:0/2039308669 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x556dcfbda620 con 0x556dcfe979a0 2024-09-19T09:02:01.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.503+0000 7f30dd7fa640 1 -- 172.21.15.92:0/2039308669 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30e40f6d50 con 0x556dcfe979a0 2024-09-19T09:02:01.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.503+0000 7f30dd7fa640 1 -- 172.21.15.92:0/2039308669 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f30f0004bd0 con 0x556dcfe979a0 2024-09-19T09:02:01.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.503+0000 7f30fe9e7740 10 client.25906 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:02:01.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.503+0000 7f30fe9e7740 10 client.25906 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:02:01.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.503+0000 7f30fe9e7740 20 client.25906 populate_metadata read hostname 'smithi092' 2024-09-19T09:02:01.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.503+0000 7f30fe9e7740 1 --2- 172.21.15.92:0/2039308669 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556dcfead8e0 0x556dcfeafcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:01.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.503+0000 7f30fe9e7740 4 client.25906 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:02:01.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.503+0000 7f30fe9e7740 1 -- 172.21.15.92:0/2039308669 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556dcfe08a20 con 0x556dcfead8e0 2024-09-19T09:02:01.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.503+0000 7f30f91e7640 1 --2- 172.21.15.92:0/2039308669 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556dcfead8e0 0x556dcfeafcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:01.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.504+0000 7f30f91e7640 1 --2- 172.21.15.92:0/2039308669 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556dcfead8e0 0x556dcfeafcd0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f7b915e151d2bd4 server_cookie=48e37996f8fabc03 in_seq=0 out_seq=0 2024-09-19T09:02:01.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.504+0000 7f30dd7fa640 10 client.25906 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:01.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.505+0000 7f30dd7fa640 1 -- 172.21.15.92:0/2039308669 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556dcfe08a20 con 0x556dcfead8e0 2024-09-19T09:02:01.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.505+0000 7f30dd7fa640 10 client.25906 handle_command_reply: tid=0 2024-09-19T09:02:01.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.505+0000 7f30fe9e7740 1 client.25906 shutdown 2024-09-19T09:02:01.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.508+0000 7f30fe9e7740 1 -- 172.21.15.92:0/2039308669 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556dcfe979a0 msgr2=0x556dcfea1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:01.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.508+0000 7f30fe9e7740 1 --2- 172.21.15.92:0/2039308669 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556dcfe979a0 0x556dcfea1c20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f30f0005940 tx=0x7f30f00318e0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.509+0000 7f30fe9e7740 1 -- 172.21.15.92:0/2039308669 shutdown_connections 2024-09-19T09:02:01.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.509+0000 7f30fe9e7740 1 --2- 172.21.15.92:0/2039308669 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556dcfead8e0 0x556dcfeafcd0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.509+0000 7f30fe9e7740 1 --2- 172.21.15.92:0/2039308669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556dcfe9d370 0x556dcfea91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.509+0000 7f30fe9e7740 1 --2- 172.21.15.92:0/2039308669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556dcfe982e0 0x556dcfea2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.509+0000 7f30fe9e7740 1 --2- 172.21.15.92:0/2039308669 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556dcfe979a0 0x556dcfea1c20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.509+0000 7f30fe9e7740 1 -- 172.21.15.92:0/2039308669 >> 172.21.15.92:0/2039308669 conn(0x556dcfe93010 msgr2=0x556dcfe94820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:01.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.509+0000 7f30dd7fa640 0 client.25906 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:01.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.509+0000 7f30fe9e7740 1 -- 172.21.15.92:0/2039308669 shutdown_connections 2024-09-19T09:02:01.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.509+0000 7f30fe9e7740 1 -- 172.21.15.92:0/2039308669 wait complete. 2024-09-19T09:02:01.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.509+0000 7f30fe9e7740 20 client.25906 trim_cache size 0 max 16384 2024-09-19T09:02:01.535 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.533+0000 7f30fe9e7740 1 Processor -- start 2024-09-19T09:02:01.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.533+0000 7f30fe9e7740 1 -- start start 2024-09-19T09:02:01.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.533+0000 7f30fe9e7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556dcfe979a0 0x556dcfe929b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:01.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.533+0000 7f30fe9e7740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556dcfe982e0 0x556dcfea9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:01.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.533+0000 7f30fe9e7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556dcfe9d370 0x556dcfe94630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:01.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.533+0000 7f30fe9e7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f30f4073050 con 0x556dcfe979a0 2024-09-19T09:02:01.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.533+0000 7f30fe9e7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f30f419ee90 con 0x556dcfe9d370 2024-09-19T09:02:01.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.533+0000 7f30fe9e7740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f30f40736e0 con 0x556dcfe982e0 2024-09-19T09:02:01.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.534+0000 7f30f91e7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556dcfe982e0 0x556dcfea9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:01.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.534+0000 7f30f91e7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556dcfe982e0 0x556dcfea9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:44984/0 (socket says 172.21.15.92:44984) 2024-09-19T09:02:01.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.534+0000 7f30f91e7640 1 -- 172.21.15.92:0/3399919371 learned_addr learned my addr 172.21.15.92:0/3399919371 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:01.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.534+0000 7f30f99e8640 1 --2- 172.21.15.92:0/3399919371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556dcfe979a0 0x556dcfe929b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:01.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.534+0000 7f30fa1e9640 1 --2- 172.21.15.92:0/3399919371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556dcfe9d370 0x556dcfe94630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:01.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.534+0000 7f30f91e7640 1 -- 172.21.15.92:0/3399919371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556dcfe9d370 msgr2=0x556dcfe94630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:01.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.534+0000 7f30f91e7640 1 --2- 172.21.15.92:0/3399919371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556dcfe9d370 0x556dcfe94630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.534+0000 7f30f91e7640 1 -- 172.21.15.92:0/3399919371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556dcfe979a0 msgr2=0x556dcfe929b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:01.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.534+0000 7f30f91e7640 1 --2- 172.21.15.92:0/3399919371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556dcfe979a0 0x556dcfe929b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.534+0000 7f30f91e7640 1 -- 172.21.15.92:0/3399919371 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dcfe987c0 con 0x556dcfe982e0 2024-09-19T09:02:01.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.534+0000 7f30f91e7640 1 --2- 172.21.15.92:0/3399919371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556dcfe982e0 0x556dcfea9160 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f30e40aa900 tx=0x7f30e40057e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f286093eb17d7278 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:01.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.534+0000 7f30df7fe640 1 -- 172.21.15.92:0/3399919371 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e40fa040 con 0x556dcfe982e0 2024-09-19T09:02:01.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.534+0000 7f30df7fe640 1 -- 172.21.15.92:0/3399919371 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30e40ee220 con 0x556dcfe982e0 2024-09-19T09:02:01.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.534+0000 7f30df7fe640 1 -- 172.21.15.92:0/3399919371 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e40b2850 con 0x556dcfe982e0 2024-09-19T09:02:01.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.535+0000 7f30fe9e7740 1 -- 172.21.15.92:0/3399919371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556dcfe982e0 msgr2=0x556dcfea9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:01.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.535+0000 7f30fe9e7740 1 --2- 172.21.15.92:0/3399919371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556dcfe982e0 0x556dcfea9160 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f30e40aa900 tx=0x7f30e40057e0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.536+0000 7f30fe9e7740 1 -- 172.21.15.92:0/3399919371 shutdown_connections 2024-09-19T09:02:01.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.536+0000 7f30fe9e7740 1 --2- 172.21.15.92:0/3399919371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556dcfe9d370 0x556dcfe94630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.536+0000 7f30fe9e7740 1 --2- 172.21.15.92:0/3399919371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556dcfe982e0 0x556dcfea9160 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.536+0000 7f30fe9e7740 1 --2- 172.21.15.92:0/3399919371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556dcfe979a0 0x556dcfe929b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.536+0000 7f30fe9e7740 1 -- 172.21.15.92:0/3399919371 >> 172.21.15.92:0/3399919371 conn(0x556dcfe93010 msgr2=0x556dcfe93f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:01.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.537+0000 7f30fe9e7740 1 -- 172.21.15.92:0/3399919371 shutdown_connections 2024-09-19T09:02:01.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.537+0000 7f30fe9e7740 1 -- 172.21.15.92:0/3399919371 wait complete. 2024-09-19T09:02:01.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.537+0000 7f30fe9e7740 1 -- start start 2024-09-19T09:02:01.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.537+0000 7f30fe9e7740 1 Processor -- start 2024-09-19T09:02:01.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.537+0000 7f30fe9e7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556dcfe979a0 0x556dcfea69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:01.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.537+0000 7f30fe9e7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556dcfe982e0 0x556dcfea6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:01.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.537+0000 7f30fe9e7740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556dcfe9d370 0x556dcfea7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:01.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.537+0000 7f30fe9e7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f30f4073db0 con 0x556dcfe982e0 2024-09-19T09:02:01.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.537+0000 7f30fe9e7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f30f419e7c0 con 0x556dcfe979a0 2024-09-19T09:02:01.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.537+0000 7f30fe9e7740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f30f419da40 con 0x556dcfe9d370 2024-09-19T09:02:01.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.537+0000 7f30fe9e7740 10 client.0 _ll_register_callbacks cb 0x7f30ec00d7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:01.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.538+0000 7f30f91e7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556dcfe982e0 0x556dcfea6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:01.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.538+0000 7f30f99e8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556dcfe979a0 0x556dcfea69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:01.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.538+0000 7f30f91e7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556dcfe982e0 0x556dcfea6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46226/0 (socket says 172.21.15.92:46226) 2024-09-19T09:02:01.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.538+0000 7f30f91e7640 1 -- 172.21.15.92:0/3065554127 learned_addr learned my addr 172.21.15.92:0/3065554127 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:01.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.538+0000 7f30fa1e9640 1 --2- 172.21.15.92:0/3065554127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556dcfe9d370 0x556dcfea7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:01.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.538+0000 7f30f99e8640 1 -- 172.21.15.92:0/3065554127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556dcfe9d370 msgr2=0x556dcfea7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:01.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.538+0000 7f30f99e8640 1 --2- 172.21.15.92:0/3065554127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556dcfe9d370 0x556dcfea7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.538+0000 7f30f99e8640 1 -- 172.21.15.92:0/3065554127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556dcfe982e0 msgr2=0x556dcfea6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:01.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.538+0000 7f30f99e8640 1 --2- 172.21.15.92:0/3065554127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556dcfe982e0 0x556dcfea6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.538+0000 7f30f99e8640 1 -- 172.21.15.92:0/3065554127 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556dcfea8520 con 0x556dcfe979a0 2024-09-19T09:02:01.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.538+0000 7f30f99e8640 1 --2- 172.21.15.92:0/3065554127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556dcfe979a0 0x556dcfea69c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f30f0009a20 tx=0x7f30f0000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecbd396946759 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:01.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.538+0000 7f30dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:02:01.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.538+0000 7f30dd7fa640 1 -- 172.21.15.92:0/3065554127 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f003f070 con 0x556dcfe979a0 2024-09-19T09:02:01.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.538+0000 7f30dd7fa640 1 -- 172.21.15.92:0/3065554127 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f30f0004450 con 0x556dcfe979a0 2024-09-19T09:02:01.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.538+0000 7f30fe9e7740 1 -- 172.21.15.92:0/3065554127 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30e40ee220 con 0x556dcfe979a0 2024-09-19T09:02:01.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.539+0000 7f30dd7fa640 1 -- 172.21.15.92:0/3065554127 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f30f0053040 con 0x556dcfe979a0 2024-09-19T09:02:01.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.539+0000 7f30fe9e7740 10 client.25994 fetch_fsmap learned FSMap version 19 2024-09-19T09:02:01.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.539+0000 7f30fe9e7740 1 -- 172.21.15.92:0/3065554127 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x556dcff186d0 con 0x556dcfe979a0 2024-09-19T09:02:01.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.539+0000 7f30dd7fa640 1 -- 172.21.15.92:0/3065554127 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30e40ee220 con 0x556dcfe979a0 2024-09-19T09:02:01.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.539+0000 7f30dd7fa640 1 -- 172.21.15.92:0/3065554127 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f30f0004750 con 0x556dcfe979a0 2024-09-19T09:02:01.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.539+0000 7f30fe9e7740 10 client.25994 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:02:01.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.539+0000 7f30fe9e7740 10 client.25994 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:02:01.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.539+0000 7f30fe9e7740 20 client.25994 populate_metadata read hostname 'smithi092' 2024-09-19T09:02:01.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.539+0000 7f30fe9e7740 1 --2- 172.21.15.92:0/3065554127 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556dcff19050 0x556dcff1b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:01.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.539+0000 7f30fe9e7740 4 client.25994 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:02:01.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.539+0000 7f30fe9e7740 1 -- 172.21.15.92:0/3065554127 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556dcfe02d70 con 0x556dcff19050 2024-09-19T09:02:01.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.541+0000 7f30f91e7640 1 --2- 172.21.15.92:0/3065554127 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556dcff19050 0x556dcff1b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:01.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.541+0000 7f30f91e7640 1 --2- 172.21.15.92:0/3065554127 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556dcff19050 0x556dcff1b470 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=794d73f332bae38f server_cookie=e1f711823f644f7f in_seq=0 out_seq=0 2024-09-19T09:02:01.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.541+0000 7f30dd7fa640 10 client.25994 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:01.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.567+0000 7f30dd7fa640 1 -- 172.21.15.92:0/3065554127 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556dcfe02d70 con 0x556dcff19050 2024-09-19T09:02:01.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.567+0000 7f30dd7fa640 10 client.25994 handle_command_reply: tid=0 2024-09-19T09:02:01.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.567+0000 7f30fe9e7740 1 client.25994 shutdown 2024-09-19T09:02:01.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.567+0000 7f30fe9e7740 1 -- 172.21.15.92:0/3065554127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556dcfe979a0 msgr2=0x556dcfea69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:01.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.567+0000 7f30fe9e7740 1 --2- 172.21.15.92:0/3065554127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556dcfe979a0 0x556dcfea69c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f30f0009a20 tx=0x7f30f0000bc0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.567+0000 7f30fe9e7740 1 -- 172.21.15.92:0/3065554127 shutdown_connections 2024-09-19T09:02:01.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.567+0000 7f30fe9e7740 1 --2- 172.21.15.92:0/3065554127 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556dcff19050 0x556dcff1b470 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.567+0000 7f30fe9e7740 1 --2- 172.21.15.92:0/3065554127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556dcfe9d370 0x556dcfea7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.567+0000 7f30fe9e7740 1 --2- 172.21.15.92:0/3065554127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556dcfe982e0 0x556dcfea6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.567+0000 7f30fe9e7740 1 --2- 172.21.15.92:0/3065554127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556dcfe979a0 0x556dcfea69c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.567+0000 7f30dd7fa640 0 client.25994 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:01.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.567+0000 7f30fe9e7740 1 -- 172.21.15.92:0/3065554127 >> 172.21.15.92:0/3065554127 conn(0x556dcfe93010 msgr2=0x556dcfe94740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:01.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.567+0000 7f30fe9e7740 1 -- 172.21.15.92:0/3065554127 shutdown_connections 2024-09-19T09:02:01.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.567+0000 7f30fe9e7740 1 -- 172.21.15.92:0/3065554127 wait complete. 2024-09-19T09:02:01.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:02:01.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:02:01.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:02:01.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:02:01.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.567+0000 7f30fe9e7740 20 client.25994 trim_cache size 0 max 16384 2024-09-19T09:02:01.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.568+0000 7f30fbc4c640 1 -- 172.21.15.92:0/1847276210 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f30e00a33a0 msgr2=0x7f30e00a5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:01.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.568+0000 7f30fbc4c640 1 --2- 172.21.15.92:0/1847276210 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f30e00a33a0 0x7f30e00a5860 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f30ec005fd0 tx=0x7f30ec00f040 comp rx=0 tx=0).stop 2024-09-19T09:02:01.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.568+0000 7f30fbc4c640 1 -- 172.21.15.92:0/1847276210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30f41015f0 msgr2=0x7f30f4196110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:01.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.568+0000 7f30fbc4c640 1 --2- 172.21.15.92:0/1847276210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30f41015f0 0x7f30f4196110 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f30e4007860 tx=0x7f30e4007d20 comp rx=0 tx=0).stop 2024-09-19T09:02:01.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.568+0000 7f30fbc4c640 1 -- 172.21.15.92:0/1847276210 shutdown_connections 2024-09-19T09:02:01.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.568+0000 7f30fbc4c640 1 --2- 172.21.15.92:0/1847276210 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f30f4102000 0x7f30f419d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.568+0000 7f30fbc4c640 1 --2- 172.21.15.92:0/1847276210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30f41015f0 0x7f30f4196110 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.568+0000 7f30fbc4c640 1 --2- 172.21.15.92:0/1847276210 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f30e00a33a0 0x7f30e00a5860 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.568+0000 7f30fbc4c640 1 --2- 172.21.15.92:0/1847276210 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30f4100c50 0x7f30f4195bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:01.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.568+0000 7f30fbc4c640 1 -- 172.21.15.92:0/1847276210 >> 172.21.15.92:0/1847276210 conn(0x7f30f40fb930 msgr2=0x7f30f4104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:01.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.569+0000 7f30fbc4c640 1 -- 172.21.15.92:0/1847276210 shutdown_connections 2024-09-19T09:02:01.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:01.569+0000 7f30fbc4c640 1 -- 172.21.15.92:0/1847276210 wait complete. 2024-09-19T09:02:01.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:01 smithi092 ceph-mon[31407]: pgmap v496: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 9.6 MiB/s wr, 898 op/s 2024-09-19T09:02:01.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:01 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3862510563' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:02:01.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:01 smithi167 ceph-mon[35359]: pgmap v496: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 9.6 MiB/s wr, 898 op/s 2024-09-19T09:02:01.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:01 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3862510563' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:02:01.870 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:02:01.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:01 smithi190 ceph-mon[35358]: pgmap v496: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 9.6 MiB/s wr, 898 op/s 2024-09-19T09:02:01.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:01 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3862510563' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:02:02.269 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:02.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.834+0000 7f9e5b1fc640 1 -- 172.21.15.92:0/4012710456 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e54103ff0 msgr2=0x7f9e541043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:02.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.834+0000 7f9e5b1fc640 1 --2- 172.21.15.92:0/4012710456 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e54103ff0 0x7f9e541043d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9e44009900 tx=0x7f9e4402a410 comp rx=0 tx=0).stop 2024-09-19T09:02:02.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.834+0000 7f9e5b1fc640 1 -- 172.21.15.92:0/4012710456 shutdown_connections 2024-09-19T09:02:02.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.834+0000 7f9e5b1fc640 1 --2- 172.21.15.92:0/4012710456 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e54109120 0x7f9e54110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.834+0000 7f9e5b1fc640 1 --2- 172.21.15.92:0/4012710456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e541049a0 0x7f9e541089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.834+0000 7f9e5b1fc640 1 --2- 172.21.15.92:0/4012710456 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e54103ff0 0x7f9e541043d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.834+0000 7f9e5b1fc640 1 -- 172.21.15.92:0/4012710456 >> 172.21.15.92:0/4012710456 conn(0x7f9e540ffab0 msgr2=0x7f9e54101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:02.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.834+0000 7f9e5b1fc640 1 -- 172.21.15.92:0/4012710456 shutdown_connections 2024-09-19T09:02:02.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.834+0000 7f9e5b1fc640 1 -- 172.21.15.92:0/4012710456 wait complete. 2024-09-19T09:02:02.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.834+0000 7f9e5b1fc640 1 Processor -- start 2024-09-19T09:02:02.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.835+0000 7f9e5b1fc640 1 -- start start 2024-09-19T09:02:02.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.835+0000 7f9e5b1fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e54103ff0 0x7f9e5419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:02.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.835+0000 7f9e5b1fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e541049a0 0x7f9e5419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:02.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.835+0000 7f9e58f98640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e54103ff0 0x7f9e5419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:02.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.835+0000 7f9e58f98640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e54103ff0 0x7f9e5419a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:45006/0 (socket says 172.21.15.92:45006) 2024-09-19T09:02:02.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.835+0000 7f9e58f98640 1 -- 172.21.15.92:0/4190884439 learned_addr learned my addr 172.21.15.92:0/4190884439 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:02.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.835+0000 7f9e5b1fc640 1 --2- 172.21.15.92:0/4190884439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e54109120 0x7f9e5419eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:02.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.836+0000 7f9e5b1fc640 1 -- 172.21.15.92:0/4190884439 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9e541141a0 con 0x7f9e541049a0 2024-09-19T09:02:02.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.836+0000 7f9e5b1fc640 1 -- 172.21.15.92:0/4190884439 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9e54114020 con 0x7f9e54109120 2024-09-19T09:02:02.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.836+0000 7f9e5b1fc640 1 -- 172.21.15.92:0/4190884439 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9e54114320 con 0x7f9e54103ff0 2024-09-19T09:02:02.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.836+0000 7f9e59799640 1 --2- 172.21.15.92:0/4190884439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e54109120 0x7f9e5419eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:02.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.836+0000 7f9e53fff640 1 --2- 172.21.15.92:0/4190884439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e541049a0 0x7f9e5419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:02.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.836+0000 7f9e59799640 1 -- 172.21.15.92:0/4190884439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e54103ff0 msgr2=0x7f9e5419a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:02.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.836+0000 7f9e59799640 1 --2- 172.21.15.92:0/4190884439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e54103ff0 0x7f9e5419a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.836+0000 7f9e59799640 1 -- 172.21.15.92:0/4190884439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e541049a0 msgr2=0x7f9e5419ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:02.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.836+0000 7f9e59799640 1 --2- 172.21.15.92:0/4190884439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e541049a0 0x7f9e5419ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.836+0000 7f9e59799640 1 -- 172.21.15.92:0/4190884439 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e5419f5b0 con 0x7f9e54109120 2024-09-19T09:02:02.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.836+0000 7f9e58f98640 1 --2- 172.21.15.92:0/4190884439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e54103ff0 0x7f9e5419a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:02:02.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.837+0000 7f9e59799640 1 --2- 172.21.15.92:0/4190884439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e54109120 0x7f9e5419eed0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c009fd0 tx=0x7f9e4c00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:02.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.837+0000 7f9e51ffb640 1 -- 172.21.15.92:0/4190884439 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c00ce20 con 0x7f9e54109120 2024-09-19T09:02:02.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.838+0000 7f9e51ffb640 1 -- 172.21.15.92:0/4190884439 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e4c005020 con 0x7f9e54109120 2024-09-19T09:02:02.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.838+0000 7f9e5b1fc640 1 -- 172.21.15.92:0/4190884439 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e5419f8a0 con 0x7f9e54109120 2024-09-19T09:02:02.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.838+0000 7f9e51ffb640 1 -- 172.21.15.92:0/4190884439 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c010720 con 0x7f9e54109120 2024-09-19T09:02:02.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.838+0000 7f9e5b1fc640 1 -- 172.21.15.92:0/4190884439 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e541a7180 con 0x7f9e54109120 2024-09-19T09:02:02.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.841+0000 7f9e51ffb640 1 -- 172.21.15.92:0/4190884439 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9e4c005540 con 0x7f9e54109120 2024-09-19T09:02:02.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.843+0000 7f9e5d5d5740 1 Processor -- start 2024-09-19T09:02:02.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.843+0000 7f9e5d5d5740 1 -- start start 2024-09-19T09:02:02.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.844+0000 7f9e5d5d5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee24060350 0x55ee2405e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:02.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.844+0000 7f9e5d5d5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee2405ede0 0x55ee2405f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:02.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.844+0000 7f9e5d5d5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee24069b80 0x55ee2406bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:02.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.844+0000 7f9e5d5d5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ee23fbc2f0 con 0x55ee2405ede0 2024-09-19T09:02:02.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.844+0000 7f9e5d5d5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ee23f63cf0 con 0x55ee24060350 2024-09-19T09:02:02.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.844+0000 7f9e53fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee24060350 0x55ee2405e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:02.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.844+0000 7f9e53fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee24060350 0x55ee2405e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:60744/0 (socket says 172.21.15.92:60744) 2024-09-19T09:02:02.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.844+0000 7f9e53fff640 1 -- 172.21.15.92:0/551327663 learned_addr learned my addr 172.21.15.92:0/551327663 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:02.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.844+0000 7f9e51ffb640 1 --2- 172.21.15.92:0/4190884439 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9e3c0a3390 0x7f9e3c0a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:02.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.844+0000 7f9e58f98640 1 --2- 172.21.15.92:0/551327663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee2405ede0 0x55ee2405f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:02.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.844+0000 7f9e5d5d5740 1 -- 172.21.15.92:0/551327663 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ee23fb82b0 con 0x55ee24069b80 2024-09-19T09:02:02.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.844+0000 7f9e51ffb640 1 -- 172.21.15.92:0/4190884439 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9e4c0cfe80 con 0x7f9e54109120 2024-09-19T09:02:02.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.844+0000 7f9e53fff640 1 --2- 172.21.15.92:0/551327663 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee24069b80 0x55ee2406bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:02.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.845+0000 7f9e58f98640 1 -- 172.21.15.92:0/551327663 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee24069b80 msgr2=0x55ee2406bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:02.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.845+0000 7f9e58f98640 1 --2- 172.21.15.92:0/551327663 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee24069b80 0x55ee2406bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.845+0000 7f9e58f98640 1 -- 172.21.15.92:0/551327663 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee24060350 msgr2=0x55ee2405e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:02.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.845+0000 7f9e58f98640 1 --2- 172.21.15.92:0/551327663 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee24060350 0x55ee2405e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.845+0000 7f9e58f98640 1 -- 172.21.15.92:0/551327663 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee23f483a0 con 0x55ee2405ede0 2024-09-19T09:02:02.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.845+0000 7f9e53fff640 1 --2- 172.21.15.92:0/551327663 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee24069b80 0x55ee2406bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:02.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.846+0000 7f9e58f98640 1 --2- 172.21.15.92:0/551327663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee2405ede0 0x55ee2405f220 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f9e44031550 tx=0x7f9e44005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a8d62db4675a54f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:02.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.846+0000 7f9e59799640 1 --2- 172.21.15.92:0/4190884439 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9e3c0a3390 0x7f9e3c0a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:02.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.846+0000 7f9e3affd640 1 -- 172.21.15.92:0/551327663 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e44040070 con 0x55ee2405ede0 2024-09-19T09:02:02.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.846+0000 7f9e3affd640 1 -- 172.21.15.92:0/551327663 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e440047a0 con 0x55ee2405ede0 2024-09-19T09:02:02.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.846+0000 7f9e3affd640 1 -- 172.21.15.92:0/551327663 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e44035040 con 0x55ee2405ede0 2024-09-19T09:02:02.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.847+0000 7f9e59799640 1 --2- 172.21.15.92:0/4190884439 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9e3c0a3390 0x7f9e3c0a5850 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c005fd0 tx=0x7f9e4c005940 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:02.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.847+0000 7f9e5d5d5740 1 -- 172.21.15.92:0/551327663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee2405ede0 msgr2=0x55ee2405f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:02.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.847+0000 7f9e5d5d5740 1 --2- 172.21.15.92:0/551327663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee2405ede0 0x55ee2405f220 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f9e44031550 tx=0x7f9e44005dd0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.847+0000 7f9e5d5d5740 1 -- 172.21.15.92:0/551327663 shutdown_connections 2024-09-19T09:02:02.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.847+0000 7f9e5d5d5740 1 --2- 172.21.15.92:0/551327663 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee24069b80 0x55ee2406bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.847+0000 7f9e5d5d5740 1 --2- 172.21.15.92:0/551327663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee2405ede0 0x55ee2405f220 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.847+0000 7f9e5d5d5740 1 --2- 172.21.15.92:0/551327663 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee24060350 0x55ee2405e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.847+0000 7f9e5d5d5740 1 -- 172.21.15.92:0/551327663 >> 172.21.15.92:0/551327663 conn(0x55ee2401f310 msgr2=0x55ee2405b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:02.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.849+0000 7f9e5d5d5740 1 -- 172.21.15.92:0/551327663 shutdown_connections 2024-09-19T09:02:02.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.849+0000 7f9e5d5d5740 1 -- 172.21.15.92:0/551327663 wait complete. 2024-09-19T09:02:02.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.849+0000 7f9e5d5d5740 1 -- start start 2024-09-19T09:02:02.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.849+0000 7f9e5d5d5740 1 Processor -- start 2024-09-19T09:02:02.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.850+0000 7f9e5d5d5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee2405ede0 0x55ee24069540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:02.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.850+0000 7f9e5d5d5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee24060350 0x55ee240667f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:02.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.850+0000 7f9e5d5d5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee24069b80 0x55ee24066de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:02.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.850+0000 7f9e5d5d5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ee2406c820 con 0x55ee2405ede0 2024-09-19T09:02:02.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.850+0000 7f9e5d5d5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ee23f77060 con 0x55ee24060350 2024-09-19T09:02:02.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.850+0000 7f9e5d5d5740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ee2406c9a0 con 0x55ee24069b80 2024-09-19T09:02:02.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.850+0000 7f9e5d5d5740 10 client.0 _ll_register_callbacks cb 0x55ee23cca8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:02.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.850+0000 7f9e53fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee2405ede0 0x55ee24069540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:02.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.851+0000 7f9e58f98640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee24060350 0x55ee240667f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:02.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.851+0000 7f9e53fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee2405ede0 0x55ee24069540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46280/0 (socket says 172.21.15.92:46280) 2024-09-19T09:02:02.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.851+0000 7f9e53fff640 1 -- 172.21.15.92:0/1002179308 learned_addr learned my addr 172.21.15.92:0/1002179308 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:02.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.851+0000 7f9e53fff640 1 --2- 172.21.15.92:0/1002179308 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee24069b80 0x55ee24066de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:02.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.851+0000 7f9e58f98640 1 -- 172.21.15.92:0/1002179308 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee24069b80 msgr2=0x55ee24066de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:02.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.851+0000 7f9e58f98640 1 --2- 172.21.15.92:0/1002179308 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee24069b80 0x55ee24066de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.851+0000 7f9e58f98640 1 -- 172.21.15.92:0/1002179308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee2405ede0 msgr2=0x55ee24069540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:02.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.851+0000 7f9e58f98640 1 --2- 172.21.15.92:0/1002179308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee2405ede0 0x55ee24069540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.851+0000 7f9e58f98640 1 -- 172.21.15.92:0/1002179308 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee23d2d3c0 con 0x55ee24060350 2024-09-19T09:02:02.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.852+0000 7f9e58f98640 1 --2- 172.21.15.92:0/1002179308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee24060350 0x55ee240667f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9e44004770 tx=0x7f9e44003900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0a211925dda82c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:02.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.852+0000 7f9e33fff640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:02:02.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.852+0000 7f9e33fff640 1 -- 172.21.15.92:0/1002179308 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e4404c020 con 0x55ee24060350 2024-09-19T09:02:02.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.852+0000 7f9e5d5d5740 1 -- 172.21.15.92:0/1002179308 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e440047a0 con 0x55ee24060350 2024-09-19T09:02:02.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.852+0000 7f9e33fff640 1 -- 172.21.15.92:0/1002179308 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9e440315b0 con 0x55ee24060350 2024-09-19T09:02:02.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.852+0000 7f9e33fff640 1 -- 172.21.15.92:0/1002179308 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9e44040070 con 0x55ee24060350 2024-09-19T09:02:02.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.852+0000 7f9e5d5d5740 10 client.26006 fetch_fsmap learned FSMap version 19 2024-09-19T09:02:02.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.852+0000 7f9e5d5d5740 1 -- 172.21.15.92:0/1002179308 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ee24078230 con 0x55ee24060350 2024-09-19T09:02:02.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.853+0000 7f9e33fff640 1 -- 172.21.15.92:0/1002179308 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e440047a0 con 0x55ee24060350 2024-09-19T09:02:02.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.853+0000 7f9e33fff640 1 -- 172.21.15.92:0/1002179308 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f9e4403c680 con 0x55ee24060350 2024-09-19T09:02:02.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.853+0000 7f9e5d5d5740 10 client.26006 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:02:02.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.853+0000 7f9e5d5d5740 10 client.26006 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:02:02.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.853+0000 7f9e5d5d5740 20 client.26006 populate_metadata read hostname 'smithi092' 2024-09-19T09:02:02.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.853+0000 7f9e5d5d5740 1 --2- 172.21.15.92:0/1002179308 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ee24079580 0x55ee2407b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:02.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.853+0000 7f9e5d5d5740 4 client.26006 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:02:02.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.853+0000 7f9e5d5d5740 1 -- 172.21.15.92:0/1002179308 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee23fc9860 con 0x55ee24079580 2024-09-19T09:02:02.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.853+0000 7f9e53fff640 1 --2- 172.21.15.92:0/1002179308 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ee24079580 0x55ee2407b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:02.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.854+0000 7f9e33fff640 10 client.26006 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:02.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.854+0000 7f9e53fff640 1 --2- 172.21.15.92:0/1002179308 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ee24079580 0x55ee2407b970 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b525a2a89f200535 server_cookie=cccef35a1a5cc896 in_seq=0 out_seq=0 2024-09-19T09:02:02.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.855+0000 7f9e33fff640 1 -- 172.21.15.92:0/1002179308 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ee23fc9860 con 0x55ee24079580 2024-09-19T09:02:02.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.855+0000 7f9e33fff640 10 client.26006 handle_command_reply: tid=0 2024-09-19T09:02:02.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.855+0000 7f9e5d5d5740 1 client.26006 shutdown 2024-09-19T09:02:02.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.858+0000 7f9e5d5d5740 1 -- 172.21.15.92:0/1002179308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee24060350 msgr2=0x55ee240667f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:02.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.858+0000 7f9e5d5d5740 1 --2- 172.21.15.92:0/1002179308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee24060350 0x55ee240667f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9e44004770 tx=0x7f9e44003900 comp rx=0 tx=0).stop 2024-09-19T09:02:02.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.858+0000 7f9e5d5d5740 1 -- 172.21.15.92:0/1002179308 shutdown_connections 2024-09-19T09:02:02.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.858+0000 7f9e5d5d5740 1 --2- 172.21.15.92:0/1002179308 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ee24079580 0x55ee2407b970 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.858+0000 7f9e5d5d5740 1 --2- 172.21.15.92:0/1002179308 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee24069b80 0x55ee24066de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.858+0000 7f9e5d5d5740 1 --2- 172.21.15.92:0/1002179308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee24060350 0x55ee240667f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.858+0000 7f9e5d5d5740 1 --2- 172.21.15.92:0/1002179308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee2405ede0 0x55ee24069540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.858+0000 7f9e5d5d5740 1 -- 172.21.15.92:0/1002179308 >> 172.21.15.92:0/1002179308 conn(0x55ee2401f310 msgr2=0x55ee24061140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:02.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.858+0000 7f9e33fff640 0 client.26006 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:02.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.858+0000 7f9e5d5d5740 1 -- 172.21.15.92:0/1002179308 shutdown_connections 2024-09-19T09:02:02.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.858+0000 7f9e5d5d5740 1 -- 172.21.15.92:0/1002179308 wait complete. 2024-09-19T09:02:02.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.858+0000 7f9e5d5d5740 20 client.26006 trim_cache size 0 max 16384 2024-09-19T09:02:02.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.883+0000 7f9e5d5d5740 1 Processor -- start 2024-09-19T09:02:02.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.883+0000 7f9e5d5d5740 1 -- start start 2024-09-19T09:02:02.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.884+0000 7f9e5d5d5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee2405ede0 0x55ee240667c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:02.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.884+0000 7f9e5d5d5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee24060350 0x55ee2406af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:02.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.884+0000 7f9e5d5d5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee24069b80 0x55ee2406b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:02.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.884+0000 7f9e5d5d5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9e541a92f0 con 0x55ee24069b80 2024-09-19T09:02:02.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.884+0000 7f9e5d5d5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9e541abb90 con 0x55ee2405ede0 2024-09-19T09:02:02.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.884+0000 7f9e5d5d5740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9e541a9980 con 0x55ee24060350 2024-09-19T09:02:02.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.884+0000 7f9e58f98640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee24060350 0x55ee2406af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:02.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.884+0000 7f9e58f98640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee24060350 0x55ee2406af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:45038/0 (socket says 172.21.15.92:45038) 2024-09-19T09:02:02.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.884+0000 7f9e58f98640 1 -- 172.21.15.92:0/730275296 learned_addr learned my addr 172.21.15.92:0/730275296 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:02.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.885+0000 7f9e53fff640 1 --2- 172.21.15.92:0/730275296 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee2405ede0 0x55ee240667c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:02.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.885+0000 7f9e53fff640 1 --2- 172.21.15.92:0/730275296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee24069b80 0x55ee2406b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:02.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.885+0000 7f9e58f98640 1 -- 172.21.15.92:0/730275296 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee2405ede0 msgr2=0x55ee240667c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:02.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.885+0000 7f9e58f98640 1 --2- 172.21.15.92:0/730275296 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee2405ede0 0x55ee240667c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.885+0000 7f9e58f98640 1 -- 172.21.15.92:0/730275296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee24069b80 msgr2=0x55ee2406b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:02.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.885+0000 7f9e58f98640 1 --2- 172.21.15.92:0/730275296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee24069b80 0x55ee2406b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.885+0000 7f9e58f98640 1 -- 172.21.15.92:0/730275296 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee2405b6e0 con 0x55ee24060350 2024-09-19T09:02:02.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.885+0000 7f9e53fff640 1 --2- 172.21.15.92:0/730275296 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee2405ede0 0x55ee240667c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:02.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.885+0000 7f9e58f98640 1 --2- 172.21.15.92:0/730275296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee24060350 0x55ee2406af70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9e44006010 tx=0x7f9e4402a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d701f1c4256aeb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:02.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.886+0000 7f9e3a7fc640 1 -- 172.21.15.92:0/730275296 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e4404c040 con 0x55ee24060350 2024-09-19T09:02:02.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.886+0000 7f9e3a7fc640 1 -- 172.21.15.92:0/730275296 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e44005850 con 0x55ee24060350 2024-09-19T09:02:02.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.886+0000 7f9e3a7fc640 1 -- 172.21.15.92:0/730275296 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e44035040 con 0x55ee24060350 2024-09-19T09:02:02.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.887+0000 7f9e5d5d5740 1 -- 172.21.15.92:0/730275296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee24060350 msgr2=0x55ee2406af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:02.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.887+0000 7f9e5d5d5740 1 --2- 172.21.15.92:0/730275296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee24060350 0x55ee2406af70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9e44006010 tx=0x7f9e4402a410 comp rx=0 tx=0).stop 2024-09-19T09:02:02.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.888+0000 7f9e5d5d5740 1 -- 172.21.15.92:0/730275296 shutdown_connections 2024-09-19T09:02:02.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.888+0000 7f9e5d5d5740 1 --2- 172.21.15.92:0/730275296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee24069b80 0x55ee2406b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.888+0000 7f9e5d5d5740 1 --2- 172.21.15.92:0/730275296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee24060350 0x55ee2406af70 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.888+0000 7f9e5d5d5740 1 --2- 172.21.15.92:0/730275296 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee2405ede0 0x55ee240667c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.888+0000 7f9e5d5d5740 1 -- 172.21.15.92:0/730275296 >> 172.21.15.92:0/730275296 conn(0x55ee2401f310 msgr2=0x55ee240660b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:02.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.888+0000 7f9e5d5d5740 1 -- 172.21.15.92:0/730275296 shutdown_connections 2024-09-19T09:02:02.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.888+0000 7f9e5d5d5740 1 -- 172.21.15.92:0/730275296 wait complete. 2024-09-19T09:02:02.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.889+0000 7f9e5d5d5740 1 -- start start 2024-09-19T09:02:02.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.889+0000 7f9e5d5d5740 1 Processor -- start 2024-09-19T09:02:02.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.890+0000 7f9e5d5d5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee2405ede0 0x55ee2407a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:02.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.890+0000 7f9e5d5d5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee24060350 0x55ee2407a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:02.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.890+0000 7f9e5d5d5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee24069b80 0x55ee240dbee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:02.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.891+0000 7f9e5d5d5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9e541aa050 con 0x55ee24069b80 2024-09-19T09:02:02.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.891+0000 7f9e5d5d5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9e541ab4c0 con 0x55ee2405ede0 2024-09-19T09:02:02.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.891+0000 7f9e5d5d5740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9e541aa720 con 0x55ee24060350 2024-09-19T09:02:02.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.891+0000 7f9e5d5d5740 10 client.0 _ll_register_callbacks cb 0x7f9e480097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:02.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.891+0000 7f9e53fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee2405ede0 0x55ee2407a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:02.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.891+0000 7f9e53fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee2405ede0 0x55ee2407a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:60778/0 (socket says 172.21.15.92:60778) 2024-09-19T09:02:02.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.891+0000 7f9e53fff640 1 -- 172.21.15.92:0/3799113416 learned_addr learned my addr 172.21.15.92:0/3799113416 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:02.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.891+0000 7f9e58f98640 1 --2- 172.21.15.92:0/3799113416 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee24060350 0x55ee2407a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:02.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.891+0000 7f9e53fff640 1 --2- 172.21.15.92:0/3799113416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee24069b80 0x55ee240dbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:02.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.891+0000 7f9e58f98640 1 -- 172.21.15.92:0/3799113416 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee2405ede0 msgr2=0x55ee2407a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:02.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.891+0000 7f9e58f98640 1 --2- 172.21.15.92:0/3799113416 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee2405ede0 0x55ee2407a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.891+0000 7f9e58f98640 1 -- 172.21.15.92:0/3799113416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee24069b80 msgr2=0x55ee240dbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:02.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.891+0000 7f9e58f98640 1 --2- 172.21.15.92:0/3799113416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee24069b80 0x55ee240dbee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.891+0000 7f9e58f98640 1 -- 172.21.15.92:0/3799113416 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee240dc520 con 0x55ee24060350 2024-09-19T09:02:02.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.892+0000 7f9e58f98640 1 --2- 172.21.15.92:0/3799113416 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee24060350 0x55ee2407a5e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x55ee23f77140 tx=0x7f9e440046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45ce3d6a370c4cd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:02.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.892+0000 7f9e33fff640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:02:02.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.892+0000 7f9e33fff640 1 -- 172.21.15.92:0/3799113416 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e44061060 con 0x55ee24060350 2024-09-19T09:02:02.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.892+0000 7f9e33fff640 1 -- 172.21.15.92:0/3799113416 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9e4403c650 con 0x55ee24060350 2024-09-19T09:02:02.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.892+0000 7f9e5d5d5740 1 -- 172.21.15.92:0/3799113416 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e44005850 con 0x55ee24060350 2024-09-19T09:02:02.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.892+0000 7f9e33fff640 1 -- 172.21.15.92:0/3799113416 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9e44035030 con 0x55ee24060350 2024-09-19T09:02:02.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.892+0000 7f9e5d5d5740 10 client.25927 fetch_fsmap learned FSMap version 19 2024-09-19T09:02:02.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.893+0000 7f9e5d5d5740 1 -- 172.21.15.92:0/3799113416 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ee240e38d0 con 0x55ee24060350 2024-09-19T09:02:02.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.893+0000 7f9e33fff640 1 -- 172.21.15.92:0/3799113416 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e44004c50 con 0x55ee24060350 2024-09-19T09:02:02.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.893+0000 7f9e33fff640 1 -- 172.21.15.92:0/3799113416 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f9e4405a020 con 0x55ee24060350 2024-09-19T09:02:02.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.893+0000 7f9e5d5d5740 10 client.25927 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:02:02.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.893+0000 7f9e5d5d5740 10 client.25927 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:02:02.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.893+0000 7f9e5d5d5740 20 client.25927 populate_metadata read hostname 'smithi092' 2024-09-19T09:02:02.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.893+0000 7f9e5d5d5740 1 --2- 172.21.15.92:0/3799113416 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ee240e3da0 0x55ee240e6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:02.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.893+0000 7f9e5d5d5740 4 client.25927 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:02:02.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.893+0000 7f9e5d5d5740 1 -- 172.21.15.92:0/3799113416 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f9e44005850 con 0x55ee240e3da0 2024-09-19T09:02:02.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.894+0000 7f9e53fff640 1 --2- 172.21.15.92:0/3799113416 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ee240e3da0 0x55ee240e6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:02.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.894+0000 7f9e53fff640 1 --2- 172.21.15.92:0/3799113416 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ee240e3da0 0x55ee240e6190 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e22fbb67ceb5dc90 server_cookie=da9a3a799c84c5fd in_seq=0 out_seq=0 2024-09-19T09:02:02.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.894+0000 7f9e33fff640 10 client.25927 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:02.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.895+0000 7f9e33fff640 1 -- 172.21.15.92:0/3799113416 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f9e44005850 con 0x55ee240e3da0 2024-09-19T09:02:02.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.895+0000 7f9e33fff640 10 client.25927 handle_command_reply: tid=0 2024-09-19T09:02:02.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.895+0000 7f9e5d5d5740 1 client.25927 shutdown 2024-09-19T09:02:02.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.895+0000 7f9e5d5d5740 1 -- 172.21.15.92:0/3799113416 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee24060350 msgr2=0x55ee2407a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:02.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.895+0000 7f9e5d5d5740 1 --2- 172.21.15.92:0/3799113416 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee24060350 0x55ee2407a5e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x55ee23f77140 tx=0x7f9e440046c0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.896+0000 7f9e5d5d5740 1 -- 172.21.15.92:0/3799113416 shutdown_connections 2024-09-19T09:02:02.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.896+0000 7f9e5d5d5740 1 --2- 172.21.15.92:0/3799113416 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ee240e3da0 0x55ee240e6190 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.896+0000 7f9e5d5d5740 1 --2- 172.21.15.92:0/3799113416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ee24069b80 0x55ee240dbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.896+0000 7f9e5d5d5740 1 --2- 172.21.15.92:0/3799113416 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ee24060350 0x55ee2407a5e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.896+0000 7f9e33fff640 0 client.25927 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:02.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.896+0000 7f9e5d5d5740 1 --2- 172.21.15.92:0/3799113416 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ee2405ede0 0x55ee2407a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.896+0000 7f9e5d5d5740 1 -- 172.21.15.92:0/3799113416 >> 172.21.15.92:0/3799113416 conn(0x55ee2401f310 msgr2=0x55ee240514e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:02.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.896+0000 7f9e5d5d5740 1 -- 172.21.15.92:0/3799113416 shutdown_connections 2024-09-19T09:02:02.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.896+0000 7f9e5d5d5740 1 -- 172.21.15.92:0/3799113416 wait complete. 2024-09-19T09:02:02.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.897+0000 7f9e5d5d5740 20 client.25927 trim_cache size 0 max 16384 2024-09-19T09:02:02.900 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-19T09:02:02.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.898+0000 7f9e5b1fc640 1 -- 172.21.15.92:0/4190884439 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9e3c0a3390 msgr2=0x7f9e3c0a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:02.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.898+0000 7f9e5b1fc640 1 --2- 172.21.15.92:0/4190884439 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9e3c0a3390 0x7f9e3c0a5850 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c005fd0 tx=0x7f9e4c005940 comp rx=0 tx=0).stop 2024-09-19T09:02:02.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.898+0000 7f9e5b1fc640 1 -- 172.21.15.92:0/4190884439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e54109120 msgr2=0x7f9e5419eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:02.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.898+0000 7f9e5b1fc640 1 --2- 172.21.15.92:0/4190884439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e54109120 0x7f9e5419eed0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c009fd0 tx=0x7f9e4c00ef10 comp rx=0 tx=0).stop 2024-09-19T09:02:02.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.898+0000 7f9e5b1fc640 1 -- 172.21.15.92:0/4190884439 shutdown_connections 2024-09-19T09:02:02.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.898+0000 7f9e5b1fc640 1 --2- 172.21.15.92:0/4190884439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e54109120 0x7f9e5419eed0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.898+0000 7f9e5b1fc640 1 --2- 172.21.15.92:0/4190884439 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9e3c0a3390 0x7f9e3c0a5850 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.898+0000 7f9e5b1fc640 1 --2- 172.21.15.92:0/4190884439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e541049a0 0x7f9e5419ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.898+0000 7f9e5b1fc640 1 --2- 172.21.15.92:0/4190884439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e54103ff0 0x7f9e5419a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.898+0000 7f9e5b1fc640 1 -- 172.21.15.92:0/4190884439 >> 172.21.15.92:0/4190884439 conn(0x7f9e540ffab0 msgr2=0x7f9e54100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:02.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.898+0000 7f9e5b1fc640 1 -- 172.21.15.92:0/4190884439 shutdown_connections 2024-09-19T09:02:02.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:02.899+0000 7f9e5b1fc640 1 -- 172.21.15.92:0/4190884439 wait complete. 2024-09-19T09:02:03.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:03 smithi092 ceph-mon[31407]: pgmap v497: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 8.5 MiB/s wr, 788 op/s 2024-09-19T09:02:03.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:03 smithi167 ceph-mon[35359]: pgmap v497: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 8.5 MiB/s wr, 788 op/s 2024-09-19T09:02:03.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:03 smithi190 ceph-mon[35358]: pgmap v497: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 8.5 MiB/s wr, 788 op/s 2024-09-19T09:02:04.643 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:02:04.643 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:02:05.050 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:05.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.578+0000 7efc296ed640 1 -- 172.21.15.92:0/1466702997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc24102570 msgr2=0x7efc241029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:05.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.578+0000 7efc296ed640 1 --2- 172.21.15.92:0/1466702997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc24102570 0x7efc241029b0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7efc18009900 tx=0x7efc1802a4a0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.578+0000 7efc296ed640 1 -- 172.21.15.92:0/1466702997 shutdown_connections 2024-09-19T09:02:05.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.578+0000 7efc296ed640 1 --2- 172.21.15.92:0/1466702997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc24102ef0 0x7efc24069f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.578+0000 7efc296ed640 1 --2- 172.21.15.92:0/1466702997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc24102570 0x7efc241029b0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.578+0000 7efc296ed640 1 --2- 172.21.15.92:0/1466702997 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc24100e20 0x7efc24101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.578+0000 7efc296ed640 1 -- 172.21.15.92:0/1466702997 >> 172.21.15.92:0/1466702997 conn(0x7efc240fc7d0 msgr2=0x7efc240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:05.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.578+0000 7efc296ed640 1 -- 172.21.15.92:0/1466702997 shutdown_connections 2024-09-19T09:02:05.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.578+0000 7efc296ed640 1 -- 172.21.15.92:0/1466702997 wait complete. 2024-09-19T09:02:05.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.579+0000 7efc296ed640 1 Processor -- start 2024-09-19T09:02:05.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.579+0000 7efc296ed640 1 -- start start 2024-09-19T09:02:05.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.580+0000 7efc296ed640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc24100e20 0x7efc2410f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:05.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.580+0000 7efc296ed640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc24102570 0x7efc2410a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:05.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.580+0000 7efc296ed640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc24102ef0 0x7efc2410a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:05.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.580+0000 7efc296ed640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efc241120d0 con 0x7efc24100e20 2024-09-19T09:02:05.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.580+0000 7efc296ed640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efc24111f50 con 0x7efc24102570 2024-09-19T09:02:05.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.580+0000 7efc296ed640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7efc24112250 con 0x7efc24102ef0 2024-09-19T09:02:05.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.580+0000 7efc22ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc24100e20 0x7efc2410f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:05.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.580+0000 7efc22ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc24100e20 0x7efc2410f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46312/0 (socket says 172.21.15.92:46312) 2024-09-19T09:02:05.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.580+0000 7efc22ffd640 1 -- 172.21.15.92:0/2914345332 learned_addr learned my addr 172.21.15.92:0/2914345332 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:05.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.580+0000 7efc227fc640 1 --2- 172.21.15.92:0/2914345332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc24102570 0x7efc2410a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:05.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.580+0000 7efc237fe640 1 --2- 172.21.15.92:0/2914345332 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc24102ef0 0x7efc2410a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:05.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.580+0000 7efc22ffd640 1 -- 172.21.15.92:0/2914345332 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc24102ef0 msgr2=0x7efc2410a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:05.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.580+0000 7efc22ffd640 1 --2- 172.21.15.92:0/2914345332 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc24102ef0 0x7efc2410a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.581+0000 7efc22ffd640 1 -- 172.21.15.92:0/2914345332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc24102570 msgr2=0x7efc2410a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:05.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.581+0000 7efc22ffd640 1 --2- 172.21.15.92:0/2914345332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc24102570 0x7efc2410a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.581+0000 7efc22ffd640 1 -- 172.21.15.92:0/2914345332 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc2410b0b0 con 0x7efc24100e20 2024-09-19T09:02:05.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.581+0000 7efc22ffd640 1 --2- 172.21.15.92:0/2914345332 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc24100e20 0x7efc2410f3b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7efc1400d950 tx=0x7efc1400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:05.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.582+0000 7efc0bfff640 1 -- 172.21.15.92:0/2914345332 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc14017070 con 0x7efc24100e20 2024-09-19T09:02:05.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.582+0000 7efc0bfff640 1 -- 172.21.15.92:0/2914345332 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc14009c30 con 0x7efc24100e20 2024-09-19T09:02:05.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.583+0000 7efc0bfff640 1 -- 172.21.15.92:0/2914345332 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc1400f6b0 con 0x7efc24100e20 2024-09-19T09:02:05.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.583+0000 7efc296ed640 1 -- 172.21.15.92:0/2914345332 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc241a29f0 con 0x7efc24100e20 2024-09-19T09:02:05.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.583+0000 7efc296ed640 1 -- 172.21.15.92:0/2914345332 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc241a2eb0 con 0x7efc24100e20 2024-09-19T09:02:05.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.587+0000 7efc2bac6740 1 Processor -- start 2024-09-19T09:02:05.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.587+0000 7efc2bac6740 1 -- start start 2024-09-19T09:02:05.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.587+0000 7efc2bac6740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b079f6bb60 0x55b079f6bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:05.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.587+0000 7efc2bac6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b079f6c480 0x55b079f76800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:05.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.587+0000 7efc2bac6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b079f76d40 0x55b079f79130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:05.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.587+0000 7efc2bac6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b079ed1280 con 0x55b079f6c480 2024-09-19T09:02:05.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.587+0000 7efc2bac6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b079e78b10 con 0x55b079f76d40 2024-09-19T09:02:05.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.587+0000 7efc2bac6740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55b079ecd240 con 0x55b079f6bb60 2024-09-19T09:02:05.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.588+0000 7efc227fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b079f76d40 0x55b079f79130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:05.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.588+0000 7efc227fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b079f76d40 0x55b079f79130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:60806/0 (socket says 172.21.15.92:60806) 2024-09-19T09:02:05.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.588+0000 7efc227fc640 1 -- 172.21.15.92:0/3077849058 learned_addr learned my addr 172.21.15.92:0/3077849058 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:05.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.588+0000 7efc237fe640 1 --2- 172.21.15.92:0/3077849058 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b079f6bb60 0x55b079f6bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:05.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.588+0000 7efc227fc640 1 -- 172.21.15.92:0/3077849058 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b079f6bb60 msgr2=0x55b079f6bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:05.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.588+0000 7efc227fc640 1 --2- 172.21.15.92:0/3077849058 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b079f6bb60 0x55b079f6bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.588+0000 7efc227fc640 1 -- 172.21.15.92:0/3077849058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b079f6c480 msgr2=0x55b079f76800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:02:05.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.588+0000 7efc227fc640 1 --2- 172.21.15.92:0/3077849058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b079f6c480 0x55b079f76800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.588+0000 7efc227fc640 1 -- 172.21.15.92:0/3077849058 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b079e851f0 con 0x55b079f76d40 2024-09-19T09:02:05.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.588+0000 7efc227fc640 1 --2- 172.21.15.92:0/3077849058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b079f76d40 0x55b079f79130 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efc18009900 tx=0x7efc18005220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=500a825303bb7db1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:05.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.589+0000 7efc097fa640 1 -- 172.21.15.92:0/3077849058 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc18035020 con 0x55b079f76d40 2024-09-19T09:02:05.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.589+0000 7efc097fa640 1 -- 172.21.15.92:0/3077849058 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc18041070 con 0x55b079f76d40 2024-09-19T09:02:05.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.589+0000 7efc097fa640 1 -- 172.21.15.92:0/3077849058 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc18004780 con 0x55b079f76d40 2024-09-19T09:02:05.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.590+0000 7efc0bfff640 1 -- 172.21.15.92:0/2914345332 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7efc140109d0 con 0x7efc24100e20 2024-09-19T09:02:05.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.590+0000 7efc2bac6740 1 -- 172.21.15.92:0/3077849058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b079f76d40 msgr2=0x55b079f79130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:05.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.590+0000 7efc2bac6740 1 --2- 172.21.15.92:0/3077849058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b079f76d40 0x55b079f79130 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efc18009900 tx=0x7efc18005220 comp rx=0 tx=0).stop 2024-09-19T09:02:05.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.591+0000 7efc2bac6740 1 -- 172.21.15.92:0/3077849058 shutdown_connections 2024-09-19T09:02:05.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.591+0000 7efc2bac6740 1 --2- 172.21.15.92:0/3077849058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b079f76d40 0x55b079f79130 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.591+0000 7efc2bac6740 1 --2- 172.21.15.92:0/3077849058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b079f6c480 0x55b079f76800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.591+0000 7efc2bac6740 1 --2- 172.21.15.92:0/3077849058 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b079f6bb60 0x55b079f6bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.591+0000 7efc2bac6740 1 -- 172.21.15.92:0/3077849058 >> 172.21.15.92:0/3077849058 conn(0x55b079f680f0 msgr2=0x55b079f684d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:05.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.591+0000 7efc0bfff640 1 --2- 172.21.15.92:0/2914345332 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efc0c0a3330 0x7efc0c0a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:05.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.591+0000 7efc0bfff640 1 -- 172.21.15.92:0/2914345332 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7efc140cf400 con 0x7efc24100e20 2024-09-19T09:02:05.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.591+0000 7efc227fc640 1 --2- 172.21.15.92:0/2914345332 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efc0c0a3330 0x7efc0c0a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:05.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.592+0000 7efc2bac6740 1 -- 172.21.15.92:0/3077849058 shutdown_connections 2024-09-19T09:02:05.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.592+0000 7efc2bac6740 1 -- 172.21.15.92:0/3077849058 wait complete. 2024-09-19T09:02:05.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.592+0000 7efc2bac6740 1 -- start start 2024-09-19T09:02:05.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.592+0000 7efc2bac6740 1 Processor -- start 2024-09-19T09:02:05.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.593+0000 7efc227fc640 1 --2- 172.21.15.92:0/2914345332 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efc0c0a3330 0x7efc0c0a57f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7efc180316a0 tx=0x7efc1802a4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:05.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.593+0000 7efc2bac6740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b079f6bb60 0x55b079f73cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:05.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.593+0000 7efc2bac6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b079f6c480 0x55b079f74230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:05.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.593+0000 7efc2bac6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b079f76d40 0x55b079f74770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:05.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.593+0000 7efc2bac6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b079f79910 con 0x55b079f6c480 2024-09-19T09:02:05.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.593+0000 7efc2bac6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b079e8bf10 con 0x55b079f76d40 2024-09-19T09:02:05.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.593+0000 7efc2bac6740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55b079f79a90 con 0x55b079f6bb60 2024-09-19T09:02:05.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.593+0000 7efc227fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b079f6c480 0x55b079f74230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:05.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.593+0000 7efc2bac6740 10 client.0 _ll_register_callbacks cb 0x55b079e54a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:05.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.593+0000 7efc227fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b079f6c480 0x55b079f74230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46328/0 (socket says 172.21.15.92:46328) 2024-09-19T09:02:05.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.593+0000 7efc227fc640 1 -- 172.21.15.92:0/3969692805 learned_addr learned my addr 172.21.15.92:0/3969692805 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:05.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.593+0000 7efc22ffd640 1 --2- 172.21.15.92:0/3969692805 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b079f6bb60 0x55b079f73cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:05.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.593+0000 7efc237fe640 1 --2- 172.21.15.92:0/3969692805 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b079f76d40 0x55b079f74770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:05.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.594+0000 7efc237fe640 1 -- 172.21.15.92:0/3969692805 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b079f6bb60 msgr2=0x55b079f73cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:05.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.594+0000 7efc237fe640 1 --2- 172.21.15.92:0/3969692805 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b079f6bb60 0x55b079f73cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.594+0000 7efc237fe640 1 -- 172.21.15.92:0/3969692805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b079f6c480 msgr2=0x55b079f74230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:05.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.594+0000 7efc237fe640 1 --2- 172.21.15.92:0/3969692805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b079f6c480 0x55b079f74230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.594+0000 7efc237fe640 1 -- 172.21.15.92:0/3969692805 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b079c426a0 con 0x55b079f76d40 2024-09-19T09:02:05.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.594+0000 7efc22ffd640 1 --2- 172.21.15.92:0/3969692805 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b079f6bb60 0x55b079f73cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:05.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.594+0000 7efc237fe640 1 --2- 172.21.15.92:0/3969692805 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b079f76d40 0x55b079f74770 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efc1c00ab50 tx=0x7efc1c011580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f622dadcfc2a6bc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:05.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.594+0000 7efc06ff5640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:02:05.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.594+0000 7efc06ff5640 1 -- 172.21.15.92:0/3969692805 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc1c01a070 con 0x55b079f76d40 2024-09-19T09:02:05.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.594+0000 7efc06ff5640 1 -- 172.21.15.92:0/3969692805 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7efc1c016650 con 0x55b079f76d40 2024-09-19T09:02:05.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.594+0000 7efc2bac6740 1 -- 172.21.15.92:0/3969692805 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc18041070 con 0x55b079f76d40 2024-09-19T09:02:05.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.595+0000 7efc06ff5640 1 -- 172.21.15.92:0/3969692805 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7efc1c026050 con 0x55b079f76d40 2024-09-19T09:02:05.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.595+0000 7efc2bac6740 10 client.26021 fetch_fsmap learned FSMap version 19 2024-09-19T09:02:05.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.595+0000 7efc2bac6740 1 -- 172.21.15.92:0/3969692805 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55b079f85650 con 0x55b079f76d40 2024-09-19T09:02:05.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.595+0000 7efc06ff5640 1 -- 172.21.15.92:0/3969692805 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc18041070 con 0x55b079f76d40 2024-09-19T09:02:05.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.595+0000 7efc06ff5640 1 -- 172.21.15.92:0/3969692805 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7efc1c01e6f0 con 0x55b079f76d40 2024-09-19T09:02:05.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.595+0000 7efc2bac6740 10 client.26021 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:02:05.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.595+0000 7efc2bac6740 10 client.26021 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:02:05.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.595+0000 7efc2bac6740 20 client.26021 populate_metadata read hostname 'smithi092' 2024-09-19T09:02:05.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.595+0000 7efc2bac6740 1 --2- 172.21.15.92:0/3969692805 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b079f86ed0 0x55b079f89350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:05.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.595+0000 7efc2bac6740 4 client.26021 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:02:05.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.595+0000 7efc2bac6740 1 -- 172.21.15.92:0/3969692805 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b079ede7f0 con 0x55b079f86ed0 2024-09-19T09:02:05.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.595+0000 7efc22ffd640 1 --2- 172.21.15.92:0/3969692805 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b079f86ed0 0x55b079f89350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:05.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.597+0000 7efc22ffd640 1 --2- 172.21.15.92:0/3969692805 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b079f86ed0 0x55b079f89350 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb7d861bedecec32 server_cookie=c1ff4532b4362f94 in_seq=0 out_seq=0 2024-09-19T09:02:05.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.597+0000 7efc06ff5640 10 client.26021 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:05.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.598+0000 7efc06ff5640 1 -- 172.21.15.92:0/3969692805 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b079ede7f0 con 0x55b079f86ed0 2024-09-19T09:02:05.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.598+0000 7efc06ff5640 10 client.26021 handle_command_reply: tid=0 2024-09-19T09:02:05.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.598+0000 7efc2bac6740 1 client.26021 shutdown 2024-09-19T09:02:05.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.598+0000 7efc2bac6740 1 -- 172.21.15.92:0/3969692805 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b079f76d40 msgr2=0x55b079f74770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:05.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.598+0000 7efc2bac6740 1 --2- 172.21.15.92:0/3969692805 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b079f76d40 0x55b079f74770 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efc1c00ab50 tx=0x7efc1c011580 comp rx=0 tx=0).stop 2024-09-19T09:02:05.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.598+0000 7efc2bac6740 1 -- 172.21.15.92:0/3969692805 shutdown_connections 2024-09-19T09:02:05.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.598+0000 7efc2bac6740 1 --2- 172.21.15.92:0/3969692805 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b079f86ed0 0x55b079f89350 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.598+0000 7efc2bac6740 1 --2- 172.21.15.92:0/3969692805 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b079f76d40 0x55b079f74770 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.598+0000 7efc2bac6740 1 --2- 172.21.15.92:0/3969692805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b079f6c480 0x55b079f74230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.598+0000 7efc2bac6740 1 --2- 172.21.15.92:0/3969692805 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b079f6bb60 0x55b079f73cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.598+0000 7efc2bac6740 1 -- 172.21.15.92:0/3969692805 >> 172.21.15.92:0/3969692805 conn(0x55b079f680f0 msgr2=0x55b079f6de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:05.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.598+0000 7efc06ff5640 0 client.26021 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:05.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.598+0000 7efc2bac6740 1 -- 172.21.15.92:0/3969692805 shutdown_connections 2024-09-19T09:02:05.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.599+0000 7efc2bac6740 1 -- 172.21.15.92:0/3969692805 wait complete. 2024-09-19T09:02:05.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.599+0000 7efc2bac6740 20 client.26021 trim_cache size 0 max 16384 2024-09-19T09:02:05.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.630+0000 7efc2bac6740 1 Processor -- start 2024-09-19T09:02:05.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.630+0000 7efc2bac6740 1 -- start start 2024-09-19T09:02:05.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.630+0000 7efc2bac6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b079f6bb60 0x55b079f8ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:05.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.630+0000 7efc2bac6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b079f6c480 0x55b079f8f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:05.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.630+0000 7efc2bac6740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b079f76d40 0x55b079f6d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:05.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.630+0000 7efc2bac6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efc24101200 con 0x55b079f6bb60 2024-09-19T09:02:05.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.630+0000 7efc2bac6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efc241abe20 con 0x55b079f6c480 2024-09-19T09:02:05.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.630+0000 7efc2bac6740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7efc241a9c10 con 0x55b079f76d40 2024-09-19T09:02:05.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.630+0000 7efc22ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b079f6bb60 0x55b079f8ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:05.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.630+0000 7efc22ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b079f6bb60 0x55b079f8ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46342/0 (socket says 172.21.15.92:46342) 2024-09-19T09:02:05.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.630+0000 7efc22ffd640 1 -- 172.21.15.92:0/3372707203 learned_addr learned my addr 172.21.15.92:0/3372707203 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:05.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.630+0000 7efc227fc640 1 --2- 172.21.15.92:0/3372707203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b079f6c480 0x55b079f8f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:05.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.630+0000 7efc237fe640 1 --2- 172.21.15.92:0/3372707203 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b079f76d40 0x55b079f6d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:05.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.631+0000 7efc22ffd640 1 -- 172.21.15.92:0/3372707203 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b079f76d40 msgr2=0x55b079f6d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:05.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.631+0000 7efc22ffd640 1 --2- 172.21.15.92:0/3372707203 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b079f76d40 0x55b079f6d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.631+0000 7efc22ffd640 1 -- 172.21.15.92:0/3372707203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b079f6c480 msgr2=0x55b079f8f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:05.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.631+0000 7efc22ffd640 1 --2- 172.21.15.92:0/3372707203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b079f6c480 0x55b079f8f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.631+0000 7efc22ffd640 1 -- 172.21.15.92:0/3372707203 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b079f79a20 con 0x55b079f6bb60 2024-09-19T09:02:05.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.631+0000 7efc22ffd640 1 --2- 172.21.15.92:0/3372707203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b079f6bb60 0x55b079f8ec60 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7efc14098460 tx=0x7efc14010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24233e3f7b0b2539 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:05.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.631+0000 7efc08ff9640 1 -- 172.21.15.92:0/3372707203 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc14020040 con 0x55b079f6bb60 2024-09-19T09:02:05.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.632+0000 7efc08ff9640 1 -- 172.21.15.92:0/3372707203 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc14015030 con 0x55b079f6bb60 2024-09-19T09:02:05.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.632+0000 7efc08ff9640 1 -- 172.21.15.92:0/3372707203 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc1409b140 con 0x55b079f6bb60 2024-09-19T09:02:05.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.632+0000 7efc2bac6740 1 -- 172.21.15.92:0/3372707203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b079f6bb60 msgr2=0x55b079f8ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:05.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.632+0000 7efc2bac6740 1 --2- 172.21.15.92:0/3372707203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b079f6bb60 0x55b079f8ec60 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7efc14098460 tx=0x7efc14010d70 comp rx=0 tx=0).stop 2024-09-19T09:02:05.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.633+0000 7efc2bac6740 1 -- 172.21.15.92:0/3372707203 shutdown_connections 2024-09-19T09:02:05.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.633+0000 7efc2bac6740 1 --2- 172.21.15.92:0/3372707203 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b079f76d40 0x55b079f6d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.633+0000 7efc2bac6740 1 --2- 172.21.15.92:0/3372707203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b079f6c480 0x55b079f8f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.633+0000 7efc2bac6740 1 --2- 172.21.15.92:0/3372707203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b079f6bb60 0x55b079f8ec60 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.633+0000 7efc2bac6740 1 -- 172.21.15.92:0/3372707203 >> 172.21.15.92:0/3372707203 conn(0x55b079f680f0 msgr2=0x55b079f725c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:05.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.633+0000 7efc2bac6740 1 -- 172.21.15.92:0/3372707203 shutdown_connections 2024-09-19T09:02:05.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.633+0000 7efc2bac6740 1 -- 172.21.15.92:0/3372707203 wait complete. 2024-09-19T09:02:05.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.633+0000 7efc2bac6740 1 -- start start 2024-09-19T09:02:05.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.633+0000 7efc2bac6740 1 Processor -- start 2024-09-19T09:02:05.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.634+0000 7efc2bac6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b079f6bb60 0x55b079f7f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:05.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.634+0000 7efc2bac6740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b079f6c480 0x55b079f7a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:05.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.634+0000 7efc2bac6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b079f76d40 0x55b079f7acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:05.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.634+0000 7efc22ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b079f6bb60 0x55b079f7f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:05.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.634+0000 7efc2bac6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efc241aa2e0 con 0x55b079f6bb60 2024-09-19T09:02:05.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.634+0000 7efc2bac6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efc241ab750 con 0x55b079f76d40 2024-09-19T09:02:05.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.634+0000 7efc2bac6740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7efc241aa9b0 con 0x55b079f6c480 2024-09-19T09:02:05.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.634+0000 7efc2bac6740 10 client.0 _ll_register_callbacks cb 0x7efc1c009b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:05.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.634+0000 7efc237fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b079f76d40 0x55b079f7acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:05.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.634+0000 7efc22ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b079f6bb60 0x55b079f7f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46344/0 (socket says 172.21.15.92:46344) 2024-09-19T09:02:05.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.634+0000 7efc22ffd640 1 -- 172.21.15.92:0/555537711 learned_addr learned my addr 172.21.15.92:0/555537711 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:05.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.635+0000 7efc227fc640 1 --2- 172.21.15.92:0/555537711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b079f6c480 0x55b079f7a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:05.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.635+0000 7efc237fe640 1 -- 172.21.15.92:0/555537711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b079f6c480 msgr2=0x55b079f7a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:05.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.635+0000 7efc237fe640 1 --2- 172.21.15.92:0/555537711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b079f6c480 0x55b079f7a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.635+0000 7efc237fe640 1 -- 172.21.15.92:0/555537711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b079f6bb60 msgr2=0x55b079f7f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:05.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.635+0000 7efc237fe640 1 --2- 172.21.15.92:0/555537711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b079f6bb60 0x55b079f7f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.635+0000 7efc237fe640 1 -- 172.21.15.92:0/555537711 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b079f7b520 con 0x55b079f76d40 2024-09-19T09:02:05.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.635+0000 7efc237fe640 1 --2- 172.21.15.92:0/555537711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b079f76d40 0x55b079f7acf0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efc1c01eac0 tx=0x7efc1c01ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bf07359de8a2d64 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:05.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.635+0000 7efc06ff5640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:02:05.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.635+0000 7efc06ff5640 1 -- 172.21.15.92:0/555537711 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc1c01a040 con 0x55b079f76d40 2024-09-19T09:02:05.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.635+0000 7efc06ff5640 1 -- 172.21.15.92:0/555537711 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7efc1c003c20 con 0x55b079f76d40 2024-09-19T09:02:05.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.635+0000 7efc2bac6740 1 -- 172.21.15.92:0/555537711 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc14015030 con 0x55b079f76d40 2024-09-19T09:02:05.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.636+0000 7efc06ff5640 1 -- 172.21.15.92:0/555537711 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7efc1c003e20 con 0x55b079f76d40 2024-09-19T09:02:05.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.636+0000 7efc2bac6740 10 client.26027 fetch_fsmap learned FSMap version 19 2024-09-19T09:02:05.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.636+0000 7efc2bac6740 1 -- 172.21.15.92:0/555537711 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55b079ff1cd0 con 0x55b079f76d40 2024-09-19T09:02:05.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.637+0000 7efc06ff5640 1 -- 172.21.15.92:0/555537711 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc1c00ae50 con 0x55b079f76d40 2024-09-19T09:02:05.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.637+0000 7efc06ff5640 1 -- 172.21.15.92:0/555537711 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7efc1c0045e0 con 0x55b079f76d40 2024-09-19T09:02:05.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.637+0000 7efc2bac6740 10 client.26027 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:02:05.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.637+0000 7efc2bac6740 10 client.26027 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:02:05.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.637+0000 7efc2bac6740 20 client.26027 populate_metadata read hostname 'smithi092' 2024-09-19T09:02:05.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.637+0000 7efc2bac6740 1 --2- 172.21.15.92:0/555537711 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b079ff2330 0x55b079ff4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:05.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.637+0000 7efc2bac6740 4 client.26027 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:02:05.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.637+0000 7efc2bac6740 1 -- 172.21.15.92:0/555537711 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7efc14015030 con 0x55b079ff2330 2024-09-19T09:02:05.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.638+0000 7efc22ffd640 1 --2- 172.21.15.92:0/555537711 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b079ff2330 0x55b079ff4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:05.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.639+0000 7efc06ff5640 10 client.26027 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:05.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.639+0000 7efc22ffd640 1 --2- 172.21.15.92:0/555537711 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b079ff2330 0x55b079ff4720 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9f83466e4933a6f server_cookie=91254ade8a19e03e in_seq=0 out_seq=0 2024-09-19T09:02:05.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.641+0000 7efc06ff5640 1 -- 172.21.15.92:0/555537711 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7efc14015030 con 0x55b079ff2330 2024-09-19T09:02:05.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.641+0000 7efc06ff5640 10 client.26027 handle_command_reply: tid=0 2024-09-19T09:02:05.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.641+0000 7efc2bac6740 1 client.26027 shutdown 2024-09-19T09:02:05.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.641+0000 7efc2bac6740 1 -- 172.21.15.92:0/555537711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b079f76d40 msgr2=0x55b079f7acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:05.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.641+0000 7efc2bac6740 1 --2- 172.21.15.92:0/555537711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b079f76d40 0x55b079f7acf0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efc1c01eac0 tx=0x7efc1c01ef60 comp rx=0 tx=0).stop 2024-09-19T09:02:05.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.641+0000 7efc2bac6740 1 -- 172.21.15.92:0/555537711 shutdown_connections 2024-09-19T09:02:05.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.641+0000 7efc2bac6740 1 --2- 172.21.15.92:0/555537711 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b079ff2330 0x55b079ff4720 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.641+0000 7efc2bac6740 1 --2- 172.21.15.92:0/555537711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b079f76d40 0x55b079f7acf0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.641+0000 7efc2bac6740 1 --2- 172.21.15.92:0/555537711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b079f6c480 0x55b079f7a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.641+0000 7efc2bac6740 1 --2- 172.21.15.92:0/555537711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b079f6bb60 0x55b079f7f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.641+0000 7efc2bac6740 1 -- 172.21.15.92:0/555537711 >> 172.21.15.92:0/555537711 conn(0x55b079f680f0 msgr2=0x55b079f66a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:05.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.641+0000 7efc06ff5640 0 client.26027 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:05.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.641+0000 7efc2bac6740 1 -- 172.21.15.92:0/555537711 shutdown_connections 2024-09-19T09:02:05.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.642+0000 7efc2bac6740 1 -- 172.21.15.92:0/555537711 wait complete. 2024-09-19T09:02:05.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.642+0000 7efc2bac6740 20 client.26027 trim_cache size 0 max 16384 2024-09-19T09:02:05.644 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:02:05.644 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-19T09:02:05.644 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "641224ed-729e-4cd3-acfa-8723f8c74236", 2024-09-19T09:02:05.644 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-19T09:02:05.644 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:02:05.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.643+0000 7efc296ed640 1 -- 172.21.15.92:0/2914345332 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efc0c0a3330 msgr2=0x7efc0c0a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:05.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.643+0000 7efc296ed640 1 --2- 172.21.15.92:0/2914345332 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efc0c0a3330 0x7efc0c0a57f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7efc180316a0 tx=0x7efc1802a4a0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.643+0000 7efc296ed640 1 -- 172.21.15.92:0/2914345332 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc24100e20 msgr2=0x7efc2410f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:05.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.643+0000 7efc296ed640 1 --2- 172.21.15.92:0/2914345332 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc24100e20 0x7efc2410f3b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7efc1400d950 tx=0x7efc1400de10 comp rx=0 tx=0).stop 2024-09-19T09:02:05.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.643+0000 7efc296ed640 1 -- 172.21.15.92:0/2914345332 shutdown_connections 2024-09-19T09:02:05.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.643+0000 7efc296ed640 1 --2- 172.21.15.92:0/2914345332 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc24102ef0 0x7efc2410a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.643+0000 7efc296ed640 1 --2- 172.21.15.92:0/2914345332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc24102570 0x7efc2410a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.643+0000 7efc296ed640 1 --2- 172.21.15.92:0/2914345332 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efc0c0a3330 0x7efc0c0a57f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.643+0000 7efc296ed640 1 --2- 172.21.15.92:0/2914345332 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc24100e20 0x7efc2410f3b0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.643+0000 7efc296ed640 1 -- 172.21.15.92:0/2914345332 >> 172.21.15.92:0/2914345332 conn(0x7efc240fc7d0 msgr2=0x7efc24105ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:05.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.643+0000 7efc296ed640 1 -- 172.21.15.92:0/2914345332 shutdown_connections 2024-09-19T09:02:05.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:05.644+0000 7efc296ed640 1 -- 172.21.15.92:0/2914345332 wait complete. 2024-09-19T09:02:05.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:05 smithi092 ceph-mon[31407]: pgmap v498: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 10 MiB/s wr, 865 op/s 2024-09-19T09:02:05.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 320.0 s, 5134.8 tps, lat 19.532 ms stddev 23.444 2024-09-19T09:02:05.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:05 smithi167 ceph-mon[35359]: pgmap v498: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 10 MiB/s wr, 865 op/s 2024-09-19T09:02:05.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:05 smithi190 ceph-mon[35358]: pgmap v498: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 10 MiB/s wr, 865 op/s 2024-09-19T09:02:06.566 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:02:06.957 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:07.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.494+0000 7fd66442a640 1 -- 172.21.15.92:0/3001887413 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd65c1027a0 msgr2=0x7fd65c1067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:07.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.494+0000 7fd66442a640 1 --2- 172.21.15.92:0/3001887413 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd65c1027a0 0x7fd65c1067f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd64c013080 tx=0x7fd64c032710 comp rx=0 tx=0).stop 2024-09-19T09:02:07.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.494+0000 7fd66442a640 1 -- 172.21.15.92:0/3001887413 shutdown_connections 2024-09-19T09:02:07.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.494+0000 7fd66442a640 1 --2- 172.21.15.92:0/3001887413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd65c106f20 0x7fd65c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.494+0000 7fd66442a640 1 --2- 172.21.15.92:0/3001887413 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd65c1027a0 0x7fd65c1067f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.494+0000 7fd66442a640 1 --2- 172.21.15.92:0/3001887413 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd65c101df0 0x7fd65c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.494+0000 7fd66442a640 1 -- 172.21.15.92:0/3001887413 >> 172.21.15.92:0/3001887413 conn(0x7fd65c0fd8f0 msgr2=0x7fd65c0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:07.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.494+0000 7fd66442a640 1 -- 172.21.15.92:0/3001887413 shutdown_connections 2024-09-19T09:02:07.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.494+0000 7fd66442a640 1 -- 172.21.15.92:0/3001887413 wait complete. 2024-09-19T09:02:07.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.496+0000 7fd66442a640 1 Processor -- start 2024-09-19T09:02:07.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.497+0000 7fd66442a640 1 -- start start 2024-09-19T09:02:07.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.497+0000 7fd66442a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd65c101df0 0x7fd65c196310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:07.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.497+0000 7fd66442a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd65c1027a0 0x7fd65c196850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:07.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.497+0000 7fd66442a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd65c106f20 0x7fd65c19abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:07.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.497+0000 7fd66442a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd65c10fdb0 con 0x7fd65c1027a0 2024-09-19T09:02:07.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.497+0000 7fd66442a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd65c10fc30 con 0x7fd65c101df0 2024-09-19T09:02:07.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.497+0000 7fd66442a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd65c10ff30 con 0x7fd65c106f20 2024-09-19T09:02:07.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.497+0000 7fd6619c5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd65c1027a0 0x7fd65c196850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:07.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.497+0000 7fd6621c6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd65c101df0 0x7fd65c196310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:07.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.497+0000 7fd6621c6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd65c101df0 0x7fd65c196310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:60842/0 (socket says 172.21.15.92:60842) 2024-09-19T09:02:07.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.497+0000 7fd6621c6640 1 -- 172.21.15.92:0/1869724870 learned_addr learned my addr 172.21.15.92:0/1869724870 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:07.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.497+0000 7fd6619c5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd65c1027a0 0x7fd65c196850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46364/0 (socket says 172.21.15.92:46364) 2024-09-19T09:02:07.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.497+0000 7fd6629c7640 1 --2- 172.21.15.92:0/1869724870 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd65c106f20 0x7fd65c19abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:07.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.498+0000 7fd6621c6640 1 -- 172.21.15.92:0/1869724870 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd65c106f20 msgr2=0x7fd65c19abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:07.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.498+0000 7fd6621c6640 1 --2- 172.21.15.92:0/1869724870 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd65c106f20 0x7fd65c19abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.498+0000 7fd6621c6640 1 -- 172.21.15.92:0/1869724870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd65c1027a0 msgr2=0x7fd65c196850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:07.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.498+0000 7fd6621c6640 1 --2- 172.21.15.92:0/1869724870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd65c1027a0 0x7fd65c196850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.498+0000 7fd6621c6640 1 -- 172.21.15.92:0/1869724870 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd65c19b2c0 con 0x7fd65c101df0 2024-09-19T09:02:07.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.498+0000 7fd6629c7640 1 --2- 172.21.15.92:0/1869724870 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd65c106f20 0x7fd65c19abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:02:07.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.498+0000 7fd6619c5640 1 --2- 172.21.15.92:0/1869724870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd65c1027a0 0x7fd65c196850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:02:07.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.498+0000 7fd6621c6640 1 --2- 172.21.15.92:0/1869724870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd65c101df0 0x7fd65c196310 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd65800e9c0 tx=0x7fd65800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:07.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.499+0000 7fd6537fe640 1 -- 172.21.15.92:0/1869724870 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd65800ccc0 con 0x7fd65c101df0 2024-09-19T09:02:07.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.499+0000 7fd6537fe640 1 -- 172.21.15.92:0/1869724870 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd658005500 con 0x7fd65c101df0 2024-09-19T09:02:07.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.499+0000 7fd66442a640 1 -- 172.21.15.92:0/1869724870 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd65c19b5b0 con 0x7fd65c101df0 2024-09-19T09:02:07.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.499+0000 7fd6537fe640 1 -- 172.21.15.92:0/1869724870 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd65800ccc0 con 0x7fd65c101df0 2024-09-19T09:02:07.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.499+0000 7fd66442a640 1 -- 172.21.15.92:0/1869724870 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd65c1a2e90 con 0x7fd65c101df0 2024-09-19T09:02:07.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.503+0000 7fd666803740 1 Processor -- start 2024-09-19T09:02:07.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.503+0000 7fd666803740 1 -- start start 2024-09-19T09:02:07.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.503+0000 7fd666803740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de732554a0 0x55de73255880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:07.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.503+0000 7fd666803740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de73255dc0 0x55de73260140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:07.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.503+0000 7fd666803740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55de73260680 0x55de73262a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:07.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.503+0000 7fd666803740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55de731bb2e0 con 0x55de732554a0 2024-09-19T09:02:07.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.503+0000 7fd666803740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55de73162ce0 con 0x55de73255dc0 2024-09-19T09:02:07.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.503+0000 7fd666803740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55de731b72a0 con 0x55de73260680 2024-09-19T09:02:07.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.503+0000 7fd6629c7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de732554a0 0x55de73255880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:07.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.503+0000 7fd6629c7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de732554a0 0x55de73255880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46368/0 (socket says 172.21.15.92:46368) 2024-09-19T09:02:07.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.503+0000 7fd6629c7640 1 -- 172.21.15.92:0/1699293110 learned_addr learned my addr 172.21.15.92:0/1699293110 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:07.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.503+0000 7fd6619c5640 1 --2- 172.21.15.92:0/1699293110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55de73260680 0x55de73262a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:07.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.504+0000 7fd6537fe640 1 -- 172.21.15.92:0/1869724870 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd658018430 con 0x7fd65c101df0 2024-09-19T09:02:07.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.504+0000 7fd6621c6640 1 --2- 172.21.15.92:0/1699293110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de73255dc0 0x55de73260140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:07.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.504+0000 7fd6619c5640 1 -- 172.21.15.92:0/1699293110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de73255dc0 msgr2=0x55de73260140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:07.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.504+0000 7fd6619c5640 1 --2- 172.21.15.92:0/1699293110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de73255dc0 0x55de73260140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.504+0000 7fd6619c5640 1 -- 172.21.15.92:0/1699293110 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de732554a0 msgr2=0x55de73255880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:07.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.504+0000 7fd6619c5640 1 --2- 172.21.15.92:0/1699293110 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de732554a0 0x55de73255880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.504+0000 7fd6619c5640 1 -- 172.21.15.92:0/1699293110 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de73147440 con 0x55de73260680 2024-09-19T09:02:07.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.504+0000 7fd6629c7640 1 --2- 172.21.15.92:0/1699293110 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de732554a0 0x55de73255880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:02:07.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.504+0000 7fd6621c6640 1 --2- 172.21.15.92:0/1699293110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de73255dc0 0x55de73260140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:07.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.505+0000 7fd6537fe640 1 --2- 172.21.15.92:0/1869724870 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd6480a3440 0x7fd6480a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:07.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.505+0000 7fd6537fe640 1 -- 172.21.15.92:0/1869724870 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd6580cf900 con 0x7fd65c101df0 2024-09-19T09:02:07.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.505+0000 7fd6619c5640 1 --2- 172.21.15.92:0/1699293110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55de73260680 0x55de73262a70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd64c014090 tx=0x7fd64c010bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75e502b24495e046 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:07.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.505+0000 7fd6629c7640 1 --2- 172.21.15.92:0/1869724870 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd6480a3440 0x7fd6480a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:07.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.505+0000 7fd650dea640 1 -- 172.21.15.92:0/1699293110 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd64c03e070 con 0x55de73260680 2024-09-19T09:02:07.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.505+0000 7fd650dea640 1 -- 172.21.15.92:0/1699293110 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd64c03f040 con 0x55de73260680 2024-09-19T09:02:07.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.505+0000 7fd650dea640 1 -- 172.21.15.92:0/1699293110 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd64c005540 con 0x55de73260680 2024-09-19T09:02:07.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.506+0000 7fd666803740 1 -- 172.21.15.92:0/1699293110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55de73260680 msgr2=0x55de73262a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:07.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.506+0000 7fd666803740 1 --2- 172.21.15.92:0/1699293110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55de73260680 0x55de73262a70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd64c014090 tx=0x7fd64c010bf0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.506+0000 7fd6629c7640 1 --2- 172.21.15.92:0/1869724870 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd6480a3440 0x7fd6480a5900 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd654009fd0 tx=0x7fd65400d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:07.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.506+0000 7fd666803740 1 -- 172.21.15.92:0/1699293110 shutdown_connections 2024-09-19T09:02:07.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.506+0000 7fd666803740 1 --2- 172.21.15.92:0/1699293110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55de73260680 0x55de73262a70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.506+0000 7fd666803740 1 --2- 172.21.15.92:0/1699293110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de73255dc0 0x55de73260140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.506+0000 7fd666803740 1 --2- 172.21.15.92:0/1699293110 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de732554a0 0x55de73255880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.506+0000 7fd666803740 1 -- 172.21.15.92:0/1699293110 >> 172.21.15.92:0/1699293110 conn(0x55de73251a30 msgr2=0x55de73251e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:07.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.506+0000 7fd666803740 1 -- 172.21.15.92:0/1699293110 shutdown_connections 2024-09-19T09:02:07.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.507+0000 7fd666803740 1 -- 172.21.15.92:0/1699293110 wait complete. 2024-09-19T09:02:07.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.507+0000 7fd666803740 1 -- start start 2024-09-19T09:02:07.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.507+0000 7fd666803740 1 Processor -- start 2024-09-19T09:02:07.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.508+0000 7fd666803740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55de732554a0 0x55de7325ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:07.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.508+0000 7fd666803740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de73255dc0 0x55de7325d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:07.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.508+0000 7fd666803740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de73260680 0x55de7325d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:07.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.508+0000 7fd666803740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55de732631f0 con 0x55de73255dc0 2024-09-19T09:02:07.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.509+0000 7fd6619c5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de73255dc0 0x55de7325d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:07.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.509+0000 7fd6629c7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de73260680 0x55de7325d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:07.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.509+0000 7fd6619c5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de73255dc0 0x55de7325d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46374/0 (socket says 172.21.15.92:46374) 2024-09-19T09:02:07.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.509+0000 7fd6629c7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de73260680 0x55de7325d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:60864/0 (socket says 172.21.15.92:60864) 2024-09-19T09:02:07.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.509+0000 7fd6619c5640 1 -- 172.21.15.92:0/3331327415 learned_addr learned my addr 172.21.15.92:0/3331327415 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:07.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.509+0000 7fd666803740 1 -- 172.21.15.92:0/3331327415 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55de73176050 con 0x55de73260680 2024-09-19T09:02:07.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.509+0000 7fd666803740 1 -- 172.21.15.92:0/3331327415 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55de73263370 con 0x55de732554a0 2024-09-19T09:02:07.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.510+0000 7fd666803740 10 client.0 _ll_register_callbacks cb 0x55de731b6160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:07.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.510+0000 7fd6619c5640 1 -- 172.21.15.92:0/3331327415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55de732554a0 msgr2=0x55de7325ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:07.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.510+0000 7fd6619c5640 1 --2- 172.21.15.92:0/3331327415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55de732554a0 0x55de7325ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.510+0000 7fd6619c5640 1 -- 172.21.15.92:0/3331327415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de73260680 msgr2=0x55de7325d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:07.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.510+0000 7fd6619c5640 1 --2- 172.21.15.92:0/3331327415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de73260680 0x55de7325d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.510+0000 7fd6619c5640 1 -- 172.21.15.92:0/3331327415 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de72f2c3c0 con 0x55de73255dc0 2024-09-19T09:02:07.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.510+0000 7fd666803740 1 -- 172.21.15.92:0/3331327415 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd64c03f040 con 0x55de73255dc0 2024-09-19T09:02:07.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.511+0000 7fd6619c5640 1 --2- 172.21.15.92:0/3331327415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de73255dc0 0x55de7325d210 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fd64c011f90 tx=0x7fd64c005490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d546a8374e8471cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:07.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.511+0000 7fd645ffb640 10 client.16638 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:02:07.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.511+0000 7fd645ffb640 1 -- 172.21.15.92:0/3331327415 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd64c03e040 con 0x55de73255dc0 2024-09-19T09:02:07.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.511+0000 7fd645ffb640 1 -- 172.21.15.92:0/3331327415 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd64c039a00 con 0x55de73255dc0 2024-09-19T09:02:07.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.511+0000 7fd645ffb640 1 -- 172.21.15.92:0/3331327415 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd64c039c00 con 0x55de73255dc0 2024-09-19T09:02:07.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.511+0000 7fd666803740 10 client.16638 fetch_fsmap learned FSMap version 19 2024-09-19T09:02:07.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.511+0000 7fd666803740 1 -- 172.21.15.92:0/3331327415 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55de7326e9f0 con 0x55de73255dc0 2024-09-19T09:02:07.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.512+0000 7fd645ffb640 1 -- 172.21.15.92:0/3331327415 <== mon.0 v2:172.21.15.92:3300/0 4 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fd64c004040 con 0x55de73255dc0 2024-09-19T09:02:07.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.512+0000 7fd666803740 10 client.16638 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:02:07.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.512+0000 7fd666803740 10 client.16638 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:02:07.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.512+0000 7fd666803740 20 client.16638 populate_metadata read hostname 'smithi092' 2024-09-19T09:02:07.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.512+0000 7fd666803740 1 --2- 172.21.15.92:0/3331327415 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55de7326fd40 0x55de73272130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:07.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.512+0000 7fd666803740 4 client.16638 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:02:07.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.512+0000 7fd666803740 1 -- 172.21.15.92:0/3331327415 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de731c8850 con 0x55de7326fd40 2024-09-19T09:02:07.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.512+0000 7fd6621c6640 1 --2- 172.21.15.92:0/3331327415 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55de7326fd40 0x55de73272130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:07.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.513+0000 7fd645ffb640 10 client.16638 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:07.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.513+0000 7fd6621c6640 1 --2- 172.21.15.92:0/3331327415 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55de7326fd40 0x55de73272130 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83e354a0f4072c5e server_cookie=8c2691093f5fe2e7 in_seq=0 out_seq=0 2024-09-19T09:02:07.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.513+0000 7fd645ffb640 1 -- 172.21.15.92:0/3331327415 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55de731c8850 con 0x55de7326fd40 2024-09-19T09:02:07.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.513+0000 7fd645ffb640 10 client.16638 handle_command_reply: tid=0 2024-09-19T09:02:07.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.513+0000 7fd666803740 1 client.16638 shutdown 2024-09-19T09:02:07.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.514+0000 7fd666803740 1 -- 172.21.15.92:0/3331327415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de73255dc0 msgr2=0x55de7325d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:07.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.514+0000 7fd666803740 1 --2- 172.21.15.92:0/3331327415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de73255dc0 0x55de7325d210 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fd64c011f90 tx=0x7fd64c005490 comp rx=0 tx=0).stop 2024-09-19T09:02:07.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.514+0000 7fd666803740 1 -- 172.21.15.92:0/3331327415 shutdown_connections 2024-09-19T09:02:07.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.514+0000 7fd666803740 1 --2- 172.21.15.92:0/3331327415 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55de7326fd40 0x55de73272130 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.514+0000 7fd666803740 1 --2- 172.21.15.92:0/3331327415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de73260680 0x55de7325d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.514+0000 7fd666803740 1 --2- 172.21.15.92:0/3331327415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de73255dc0 0x55de7325d210 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.514+0000 7fd666803740 1 --2- 172.21.15.92:0/3331327415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55de732554a0 0x55de7325ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.514+0000 7fd645ffb640 0 client.16638 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:07.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.514+0000 7fd666803740 1 -- 172.21.15.92:0/3331327415 >> 172.21.15.92:0/3331327415 conn(0x55de73251a30 msgr2=0x55de73257760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:07.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.514+0000 7fd666803740 1 -- 172.21.15.92:0/3331327415 shutdown_connections 2024-09-19T09:02:07.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.514+0000 7fd666803740 1 -- 172.21.15.92:0/3331327415 wait complete. 2024-09-19T09:02:07.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.514+0000 7fd666803740 20 client.16638 trim_cache size 0 max 16384 2024-09-19T09:02:07.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.542+0000 7fd666803740 1 Processor -- start 2024-09-19T09:02:07.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.542+0000 7fd666803740 1 -- start start 2024-09-19T09:02:07.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.543+0000 7fd666803740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de732554a0 0x55de73275160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:07.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.543+0000 7fd666803740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55de73255dc0 0x55de732756a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:07.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.543+0000 7fd666803740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de73260680 0x55de7325a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:07.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.543+0000 7fd666803740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd65c1a93a0 con 0x55de73260680 2024-09-19T09:02:07.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.543+0000 7fd6621c6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de732554a0 0x55de73275160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:07.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.543+0000 7fd6629c7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de73260680 0x55de7325a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:07.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.543+0000 7fd6629c7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de73260680 0x55de7325a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46380/0 (socket says 172.21.15.92:46380) 2024-09-19T09:02:07.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.543+0000 7fd6629c7640 1 -- 172.21.15.92:0/3894385194 learned_addr learned my addr 172.21.15.92:0/3894385194 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:07.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.543+0000 7fd6619c5640 1 --2- 172.21.15.92:0/3894385194 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55de73255dc0 0x55de732756a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:07.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.544+0000 7fd666803740 1 -- 172.21.15.92:0/3894385194 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd65c1abc40 con 0x55de732554a0 2024-09-19T09:02:07.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.544+0000 7fd666803740 1 -- 172.21.15.92:0/3894385194 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd65c1a9a30 con 0x55de73255dc0 2024-09-19T09:02:07.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.544+0000 7fd6619c5640 1 -- 172.21.15.92:0/3894385194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de732554a0 msgr2=0x55de73275160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:07.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.544+0000 7fd6619c5640 1 --2- 172.21.15.92:0/3894385194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de732554a0 0x55de73275160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.544+0000 7fd6619c5640 1 -- 172.21.15.92:0/3894385194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de73260680 msgr2=0x55de7325a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:07.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.544+0000 7fd6619c5640 1 --2- 172.21.15.92:0/3894385194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de73260680 0x55de7325a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.544+0000 7fd6619c5640 1 -- 172.21.15.92:0/3894385194 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de73263240 con 0x55de73255dc0 2024-09-19T09:02:07.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.544+0000 7fd6619c5640 1 --2- 172.21.15.92:0/3894385194 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55de73255dc0 0x55de732756a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd64c014090 tx=0x7fd64c04f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=894d4eaa3f9d5bd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:07.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.545+0000 7fd647fff640 1 -- 172.21.15.92:0/3894385194 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd64c03e030 con 0x55de73255dc0 2024-09-19T09:02:07.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.545+0000 7fd647fff640 1 -- 172.21.15.92:0/3894385194 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd64c03f040 con 0x55de73255dc0 2024-09-19T09:02:07.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.545+0000 7fd647fff640 1 -- 172.21.15.92:0/3894385194 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd64c05e060 con 0x55de73255dc0 2024-09-19T09:02:07.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.546+0000 7fd666803740 1 -- 172.21.15.92:0/3894385194 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55de73255dc0 msgr2=0x55de732756a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:07.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.546+0000 7fd666803740 1 --2- 172.21.15.92:0/3894385194 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55de73255dc0 0x55de732756a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd64c014090 tx=0x7fd64c04f000 comp rx=0 tx=0).stop 2024-09-19T09:02:07.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.546+0000 7fd666803740 1 -- 172.21.15.92:0/3894385194 shutdown_connections 2024-09-19T09:02:07.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.546+0000 7fd666803740 1 --2- 172.21.15.92:0/3894385194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de73260680 0x55de7325a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.546+0000 7fd666803740 1 --2- 172.21.15.92:0/3894385194 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55de73255dc0 0x55de732756a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.546+0000 7fd666803740 1 --2- 172.21.15.92:0/3894385194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de732554a0 0x55de73275160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.546+0000 7fd666803740 1 -- 172.21.15.92:0/3894385194 >> 172.21.15.92:0/3894385194 conn(0x55de73251a30 msgr2=0x55de7325f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:07.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.546+0000 7fd666803740 1 -- 172.21.15.92:0/3894385194 shutdown_connections 2024-09-19T09:02:07.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.547+0000 7fd666803740 1 -- 172.21.15.92:0/3894385194 wait complete. 2024-09-19T09:02:07.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.547+0000 7fd666803740 1 -- start start 2024-09-19T09:02:07.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.548+0000 7fd666803740 1 Processor -- start 2024-09-19T09:02:07.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.548+0000 7fd666803740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de732554a0 0x55de732ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:07.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.548+0000 7fd666803740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de73255dc0 0x55de732ced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:07.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.548+0000 7fd6621c6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de732554a0 0x55de732ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:07.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.549+0000 7fd6621c6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de732554a0 0x55de732ce7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:60870/0 (socket says 172.21.15.92:60870) 2024-09-19T09:02:07.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.549+0000 7fd6619c5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de73255dc0 0x55de732ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:07.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.549+0000 7fd6619c5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de73255dc0 0x55de732ced30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46390/0 (socket says 172.21.15.92:46390) 2024-09-19T09:02:07.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.549+0000 7fd6621c6640 1 -- 172.21.15.92:0/2745711834 learned_addr learned my addr 172.21.15.92:0/2745711834 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:07.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.549+0000 7fd666803740 1 --2- 172.21.15.92:0/2745711834 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55de73260680 0x55de732d9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:07.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.550+0000 7fd666803740 1 -- 172.21.15.92:0/2745711834 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd65c1aa100 con 0x55de73255dc0 2024-09-19T09:02:07.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.550+0000 7fd666803740 1 -- 172.21.15.92:0/2745711834 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd65c1ab570 con 0x55de732554a0 2024-09-19T09:02:07.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.550+0000 7fd666803740 1 -- 172.21.15.92:0/2745711834 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd65c1aa7d0 con 0x55de73260680 2024-09-19T09:02:07.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.550+0000 7fd666803740 10 client.0 _ll_register_callbacks cb 0x7fd654009e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:07.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.550+0000 7fd6629c7640 1 --2- 172.21.15.92:0/2745711834 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55de73260680 0x55de732d9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:07.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.550+0000 7fd6621c6640 1 -- 172.21.15.92:0/2745711834 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55de73260680 msgr2=0x55de732d9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:07.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.550+0000 7fd6621c6640 1 --2- 172.21.15.92:0/2745711834 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55de73260680 0x55de732d9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.550+0000 7fd6621c6640 1 -- 172.21.15.92:0/2745711834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de73255dc0 msgr2=0x55de732ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:07.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.550+0000 7fd6621c6640 1 --2- 172.21.15.92:0/2745711834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de73255dc0 0x55de732ced30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.550+0000 7fd6621c6640 1 -- 172.21.15.92:0/2745711834 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de732d9c50 con 0x55de732554a0 2024-09-19T09:02:07.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.551+0000 7fd6621c6640 1 --2- 172.21.15.92:0/2745711834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de732554a0 0x55de732ce7f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd65809beb0 tx=0x7fd658004b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5c629aa729e1906 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:07.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.551+0000 7fd645ffb640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:02:07.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.551+0000 7fd645ffb640 1 -- 172.21.15.92:0/2745711834 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd658004e60 con 0x55de732554a0 2024-09-19T09:02:07.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.551+0000 7fd645ffb640 1 -- 172.21.15.92:0/2745711834 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd6580bab60 con 0x55de732554a0 2024-09-19T09:02:07.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.551+0000 7fd666803740 1 -- 172.21.15.92:0/2745711834 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd64c03f040 con 0x55de732554a0 2024-09-19T09:02:07.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.551+0000 7fd645ffb640 1 -- 172.21.15.92:0/2745711834 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd65809c620 con 0x55de732554a0 2024-09-19T09:02:07.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.551+0000 7fd666803740 10 client.26039 fetch_fsmap learned FSMap version 19 2024-09-19T09:02:07.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.551+0000 7fd666803740 1 -- 172.21.15.92:0/2745711834 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55de732daf40 con 0x55de732554a0 2024-09-19T09:02:07.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.551+0000 7fd645ffb640 1 -- 172.21.15.92:0/2745711834 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd64c03f040 con 0x55de732554a0 2024-09-19T09:02:07.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.552+0000 7fd645ffb640 1 -- 172.21.15.92:0/2745711834 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fd6580ba030 con 0x55de732554a0 2024-09-19T09:02:07.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.552+0000 7fd666803740 10 client.26039 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:02:07.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.552+0000 7fd666803740 10 client.26039 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:02:07.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.552+0000 7fd666803740 20 client.26039 populate_metadata read hostname 'smithi092' 2024-09-19T09:02:07.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.552+0000 7fd666803740 1 --2- 172.21.15.92:0/2745711834 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55de732db6b0 0x55de732ddaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:07.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.552+0000 7fd666803740 4 client.26039 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:02:07.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.552+0000 7fd666803740 1 -- 172.21.15.92:0/2745711834 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55de731c2d60 con 0x55de732db6b0 2024-09-19T09:02:07.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.552+0000 7fd6619c5640 1 --2- 172.21.15.92:0/2745711834 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55de732db6b0 0x55de732ddaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:07.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.553+0000 7fd645ffb640 10 client.26039 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:07.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.553+0000 7fd6619c5640 1 --2- 172.21.15.92:0/2745711834 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55de732db6b0 0x55de732ddaa0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93a9139733e8934d server_cookie=3ffae2c5e091a429 in_seq=0 out_seq=0 2024-09-19T09:02:07.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.554+0000 7fd645ffb640 1 -- 172.21.15.92:0/2745711834 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55de731c2d60 con 0x55de732db6b0 2024-09-19T09:02:07.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.554+0000 7fd645ffb640 10 client.26039 handle_command_reply: tid=0 2024-09-19T09:02:07.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.554+0000 7fd666803740 1 client.26039 shutdown 2024-09-19T09:02:07.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.554+0000 7fd666803740 1 -- 172.21.15.92:0/2745711834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de732554a0 msgr2=0x55de732ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:07.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.554+0000 7fd666803740 1 --2- 172.21.15.92:0/2745711834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de732554a0 0x55de732ce7f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd65809beb0 tx=0x7fd658004b00 comp rx=0 tx=0).stop 2024-09-19T09:02:07.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.554+0000 7fd666803740 1 -- 172.21.15.92:0/2745711834 shutdown_connections 2024-09-19T09:02:07.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.554+0000 7fd666803740 1 --2- 172.21.15.92:0/2745711834 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55de732db6b0 0x55de732ddaa0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.554+0000 7fd666803740 1 --2- 172.21.15.92:0/2745711834 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55de73260680 0x55de732d9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.554+0000 7fd666803740 1 --2- 172.21.15.92:0/2745711834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55de73255dc0 0x55de732ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.554+0000 7fd666803740 1 --2- 172.21.15.92:0/2745711834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de732554a0 0x55de732ce7f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.554+0000 7fd666803740 1 -- 172.21.15.92:0/2745711834 >> 172.21.15.92:0/2745711834 conn(0x55de73251a30 msgr2=0x55de73250350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:07.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.554+0000 7fd645ffb640 0 client.26039 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:07.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.554+0000 7fd666803740 1 -- 172.21.15.92:0/2745711834 shutdown_connections 2024-09-19T09:02:07.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.554+0000 7fd666803740 1 -- 172.21.15.92:0/2745711834 wait complete. 2024-09-19T09:02:07.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.555+0000 7fd666803740 20 client.26039 trim_cache size 0 max 16384 2024-09-19T09:02:07.557 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:02:07.558 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:02:07.558 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": { 2024-09-19T09:02:07.558 INFO:teuthology.orchestra.run.smithi092.stdout: "641224ed-729e-4cd3-acfa-8723f8c74236": { 2024-09-19T09:02:07.558 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-19T09:02:07.558 INFO:teuthology.orchestra.run.smithi092.stdout: "tag": "641224ed-729e-4cd3-acfa-8723f8c74236", 2024-09-19T09:02:07.558 INFO:teuthology.orchestra.run.smithi092.stdout: "options": "recursive,force" 2024-09-19T09:02:07.558 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:02:07.558 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:02:07.558 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:02:07.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.556+0000 7fd66442a640 1 -- 172.21.15.92:0/1869724870 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd6480a3440 msgr2=0x7fd6480a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:07.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.556+0000 7fd66442a640 1 --2- 172.21.15.92:0/1869724870 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd6480a3440 0x7fd6480a5900 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd654009fd0 tx=0x7fd65400d040 comp rx=0 tx=0).stop 2024-09-19T09:02:07.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.556+0000 7fd66442a640 1 -- 172.21.15.92:0/1869724870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd65c101df0 msgr2=0x7fd65c196310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:07.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.556+0000 7fd66442a640 1 --2- 172.21.15.92:0/1869724870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd65c101df0 0x7fd65c196310 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd65800e9c0 tx=0x7fd65800ee80 comp rx=0 tx=0).stop 2024-09-19T09:02:07.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.556+0000 7fd66442a640 1 -- 172.21.15.92:0/1869724870 shutdown_connections 2024-09-19T09:02:07.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.556+0000 7fd66442a640 1 --2- 172.21.15.92:0/1869724870 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd65c106f20 0x7fd65c19abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.556+0000 7fd66442a640 1 --2- 172.21.15.92:0/1869724870 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd6480a3440 0x7fd6480a5900 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.556+0000 7fd66442a640 1 --2- 172.21.15.92:0/1869724870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd65c1027a0 0x7fd65c196850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.556+0000 7fd66442a640 1 --2- 172.21.15.92:0/1869724870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd65c101df0 0x7fd65c196310 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.556+0000 7fd66442a640 1 -- 172.21.15.92:0/1869724870 >> 172.21.15.92:0/1869724870 conn(0x7fd65c0fd8f0 msgr2=0x7fd65c0fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:07.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.556+0000 7fd66442a640 1 -- 172.21.15.92:0/1869724870 shutdown_connections 2024-09-19T09:02:07.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:07.556+0000 7fd66442a640 1 -- 172.21.15.92:0/1869724870 wait complete. 2024-09-19T09:02:07.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:07 smithi092 ceph-mon[31407]: scrub queued for path: / 2024-09-19T09:02:07.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:07 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:02:07.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:07 smithi092 ceph-mon[31407]: scrub summary: active paths [/] 2024-09-19T09:02:07.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:07 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:02:07.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:07 smithi092 ceph-mon[31407]: pgmap v499: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 10 MiB/s wr, 846 op/s 2024-09-19T09:02:07.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:07 smithi167 ceph-mon[35359]: scrub queued for path: / 2024-09-19T09:02:07.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:07 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:02:07.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:07 smithi167 ceph-mon[35359]: scrub summary: active paths [/] 2024-09-19T09:02:07.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:07 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:02:07.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:07 smithi167 ceph-mon[35359]: pgmap v499: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 10 MiB/s wr, 846 op/s 2024-09-19T09:02:07.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:07 smithi190 ceph-mon[35358]: scrub queued for path: / 2024-09-19T09:02:07.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:07 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:02:07.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:07 smithi190 ceph-mon[35358]: scrub summary: active paths [/] 2024-09-19T09:02:07.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:07 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:02:07.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:07 smithi190 ceph-mon[35358]: pgmap v499: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 10 MiB/s wr, 846 op/s 2024-09-19T09:02:08.275 INFO:tasks.cephfs.filesystem:scrub status for tag:641224ed-729e-4cd3-acfa-8723f8c74236 - {'path': '/', 'tag': '641224ed-729e-4cd3-acfa-8723f8c74236', 'options': 'recursive,force'} 2024-09-19T09:02:09.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:09 smithi092 ceph-mon[31407]: pgmap v500: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 10 MiB/s wr, 870 op/s 2024-09-19T09:02:09.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:09 smithi092 ceph-mon[31407]: scrub summary: idle 2024-09-19T09:02:09.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:09 smithi167 ceph-mon[35359]: pgmap v500: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 10 MiB/s wr, 870 op/s 2024-09-19T09:02:09.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:09 smithi167 ceph-mon[35359]: scrub summary: idle 2024-09-19T09:02:09.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:09 smithi190 ceph-mon[35358]: pgmap v500: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 10 MiB/s wr, 870 op/s 2024-09-19T09:02:09.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:09 smithi190 ceph-mon[35358]: scrub summary: idle 2024-09-19T09:02:10.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 325.0 s, 5299.8 tps, lat 18.850 ms stddev 21.410 2024-09-19T09:02:11.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:11 smithi092 ceph-mon[31407]: pgmap v501: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 12 MiB/s wr, 1.01k op/s 2024-09-19T09:02:11.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:11 smithi167 ceph-mon[35359]: pgmap v501: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 12 MiB/s wr, 1.01k op/s 2024-09-19T09:02:11.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:11 smithi190 ceph-mon[35358]: pgmap v501: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 12 MiB/s wr, 1.01k op/s 2024-09-19T09:02:13.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:13 smithi092 ceph-mon[31407]: pgmap v502: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 11 MiB/s wr, 947 op/s 2024-09-19T09:02:13.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:13 smithi167 ceph-mon[35359]: pgmap v502: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 11 MiB/s wr, 947 op/s 2024-09-19T09:02:13.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:13 smithi190 ceph-mon[35358]: pgmap v502: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 11 MiB/s wr, 947 op/s 2024-09-19T09:02:14.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.712+0000 7f5ddea5e640 1 -- 172.21.15.92:0/4163400743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5dd81025f0 msgr2=0x7f5dd80698a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:14.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.712+0000 7f5ddea5e640 1 --2- 172.21.15.92:0/4163400743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5dd81025f0 0x7f5dd80698a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0009ca0 tx=0x7f5dd002a8d0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.712+0000 7f5ddea5e640 1 -- 172.21.15.92:0/4163400743 shutdown_connections 2024-09-19T09:02:14.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.712+0000 7f5ddea5e640 1 --2- 172.21.15.92:0/4163400743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5dd81025f0 0x7f5dd80698a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.712+0000 7f5ddea5e640 1 --2- 172.21.15.92:0/4163400743 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5dd8101c30 0x7f5dd81020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.712+0000 7f5ddea5e640 1 --2- 172.21.15.92:0/4163400743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dd8100a40 0x7f5dd8100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.712+0000 7f5ddea5e640 1 -- 172.21.15.92:0/4163400743 >> 172.21.15.92:0/4163400743 conn(0x7f5dd80fc1e0 msgr2=0x7f5dd80fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:14.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.713+0000 7f5ddea5e640 1 -- 172.21.15.92:0/4163400743 shutdown_connections 2024-09-19T09:02:14.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.713+0000 7f5ddea5e640 1 -- 172.21.15.92:0/4163400743 wait complete. 2024-09-19T09:02:14.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.713+0000 7f5ddea5e640 1 Processor -- start 2024-09-19T09:02:14.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.713+0000 7f5ddea5e640 1 -- start start 2024-09-19T09:02:14.717 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.714+0000 7f5ddea5e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dd8100a40 0x7f5dd819e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:14.717 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.714+0000 7f5ddea5e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5dd8101c30 0x7f5dd819e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:14.717 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.714+0000 7f5ddea5e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5dd81025f0 0x7f5dd81a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:14.717 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.714+0000 7f5ddea5e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd810b640 con 0x7f5dd8100a40 2024-09-19T09:02:14.717 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.714+0000 7f5ddea5e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd810b4c0 con 0x7f5dd8101c30 2024-09-19T09:02:14.717 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.714+0000 7f5ddea5e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd810b7c0 con 0x7f5dd81025f0 2024-09-19T09:02:14.717 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.714+0000 7f5dd77fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5dd8101c30 0x7f5dd819e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.714+0000 7f5dd77fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5dd8101c30 0x7f5dd819e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:57172/0 (socket says 172.21.15.92:57172) 2024-09-19T09:02:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.714+0000 7f5dd77fe640 1 -- 172.21.15.92:0/3858412115 learned_addr learned my addr 172.21.15.92:0/3858412115 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.714+0000 7f5ddcffb640 1 --2- 172.21.15.92:0/3858412115 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5dd81025f0 0x7f5dd81a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.714+0000 7f5dd7fff640 1 --2- 172.21.15.92:0/3858412115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dd8100a40 0x7f5dd819e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.715+0000 7f5dd77fe640 1 -- 172.21.15.92:0/3858412115 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5dd81025f0 msgr2=0x7f5dd81a59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.715+0000 7f5dd77fe640 1 --2- 172.21.15.92:0/3858412115 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5dd81025f0 0x7f5dd81a59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.715+0000 7f5dd77fe640 1 -- 172.21.15.92:0/3858412115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dd8100a40 msgr2=0x7f5dd819e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.715+0000 7f5dd77fe640 1 --2- 172.21.15.92:0/3858412115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dd8100a40 0x7f5dd819e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.715+0000 7f5dd77fe640 1 -- 172.21.15.92:0/3858412115 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd81a6030 con 0x7f5dd8101c30 2024-09-19T09:02:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.715+0000 7f5dd77fe640 1 --2- 172.21.15.92:0/3858412115 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5dd8101c30 0x7f5dd819e950 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00b450 tx=0x7f5dcc00b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.715+0000 7f5dd57fa640 1 -- 172.21.15.92:0/3858412115 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc015020 con 0x7f5dd8101c30 2024-09-19T09:02:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.715+0000 7f5ddea5e640 1 -- 172.21.15.92:0/3858412115 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dd806bc70 con 0x7f5dd8101c30 2024-09-19T09:02:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.715+0000 7f5ddea5e640 1 -- 172.21.15.92:0/3858412115 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dd806c290 con 0x7f5dd8101c30 2024-09-19T09:02:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.715+0000 7f5dd57fa640 1 -- 172.21.15.92:0/3858412115 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dcc011d70 con 0x7f5dd8101c30 2024-09-19T09:02:14.719 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.716+0000 7f5dd57fa640 1 -- 172.21.15.92:0/3858412115 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc00f340 con 0x7f5dd8101c30 2024-09-19T09:02:14.720 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.719+0000 7f5de17fa740 1 Processor -- start 2024-09-19T09:02:14.720 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.719+0000 7f5dd57fa640 1 -- 172.21.15.92:0/3858412115 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5dcc018020 con 0x7f5dd8101c30 2024-09-19T09:02:14.720 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.719+0000 7f5de17fa740 1 -- start start 2024-09-19T09:02:14.720 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.719+0000 7f5de17fa740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bbced4e9a0 0x55bbced4eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:14.720 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.719+0000 7f5de17fa740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbced4f2e0 0x55bbced53da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:14.720 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.719+0000 7f5de17fa740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbced54370 0x55bbced56830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:14.720 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.719+0000 7f5de17fa740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55bbcecb22f0 con 0x55bbced4f2e0 2024-09-19T09:02:14.720 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.719+0000 7f5de17fa740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55bbcec5a270 con 0x55bbced54370 2024-09-19T09:02:14.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.719+0000 7f5de17fa740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55bbcecae2b0 con 0x55bbced4e9a0 2024-09-19T09:02:14.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.719+0000 7f5ddcffb640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bbced4e9a0 0x55bbced4eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:14.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.719+0000 7f5ddcffb640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bbced4e9a0 0x55bbced4eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:49508/0 (socket says 172.21.15.92:49508) 2024-09-19T09:02:14.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.719+0000 7f5ddcffb640 1 -- 172.21.15.92:0/442646703 learned_addr learned my addr 172.21.15.92:0/442646703 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:14.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.720+0000 7f5ddcffb640 1 -- 172.21.15.92:0/442646703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbced54370 msgr2=0x55bbced56830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:14.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.720+0000 7f5dd77fe640 1 --2- 172.21.15.92:0/442646703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbced54370 0x55bbced56830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:14.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.720+0000 7f5dd7fff640 1 --2- 172.21.15.92:0/442646703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbced4f2e0 0x55bbced53da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:14.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.721+0000 7f5dd57fa640 1 --2- 172.21.15.92:0/3858412115 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5dc00a3370 0x7f5dc00a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:14.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.721+0000 7f5dd57fa640 1 -- 172.21.15.92:0/3858412115 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f5dcc0cf1c0 con 0x7f5dd8101c30 2024-09-19T09:02:14.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.722+0000 7f5ddcffb640 1 --2- 172.21.15.92:0/442646703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbced54370 0x55bbced56830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.722+0000 7f5ddcffb640 1 -- 172.21.15.92:0/442646703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbced4f2e0 msgr2=0x55bbced53da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:14.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.722+0000 7f5ddcffb640 1 --2- 172.21.15.92:0/442646703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbced4f2e0 0x55bbced53da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.722+0000 7f5ddcffb640 1 -- 172.21.15.92:0/442646703 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbcec59340 con 0x55bbced4e9a0 2024-09-19T09:02:14.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.722+0000 7f5dd7fff640 1 --2- 172.21.15.92:0/442646703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbced4f2e0 0x55bbced53da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:14.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.722+0000 7f5dd77fe640 1 --2- 172.21.15.92:0/442646703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbced54370 0x55bbced56830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:14.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.722+0000 7f5ddcffb640 1 --2- 172.21.15.92:0/3858412115 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5dc00a3370 0x7f5dc00a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:14.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.722+0000 7f5ddcffb640 1 --2- 172.21.15.92:0/442646703 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bbced4e9a0 0x55bbced4eda0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0009ca0 tx=0x7f5dd0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b02e2f408f9365c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:14.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.722+0000 7f5dbe7fc640 1 -- 172.21.15.92:0/442646703 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd00307b0 con 0x55bbced4e9a0 2024-09-19T09:02:14.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.723+0000 7f5dbe7fc640 1 -- 172.21.15.92:0/442646703 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dd0036030 con 0x55bbced4e9a0 2024-09-19T09:02:14.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.723+0000 7f5dbe7fc640 1 -- 172.21.15.92:0/442646703 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd00043c0 con 0x55bbced4e9a0 2024-09-19T09:02:14.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.724+0000 7f5de17fa740 1 -- 172.21.15.92:0/442646703 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bbced4e9a0 msgr2=0x55bbced4eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:14.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.724+0000 7f5de17fa740 1 --2- 172.21.15.92:0/442646703 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bbced4e9a0 0x55bbced4eda0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0009ca0 tx=0x7f5dd0009780 comp rx=0 tx=0).stop 2024-09-19T09:02:14.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.724+0000 7f5ddcffb640 1 --2- 172.21.15.92:0/3858412115 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5dc00a3370 0x7f5dc00a5830 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5dd005b000 tx=0x7f5dd005c000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:14.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.724+0000 7f5de17fa740 1 -- 172.21.15.92:0/442646703 shutdown_connections 2024-09-19T09:02:14.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.724+0000 7f5de17fa740 1 --2- 172.21.15.92:0/442646703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbced54370 0x55bbced56830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.724+0000 7f5de17fa740 1 --2- 172.21.15.92:0/442646703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbced4f2e0 0x55bbced53da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.724+0000 7f5de17fa740 1 --2- 172.21.15.92:0/442646703 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bbced4e9a0 0x55bbced4eda0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.724+0000 7f5de17fa740 1 -- 172.21.15.92:0/442646703 >> 172.21.15.92:0/442646703 conn(0x55bbced4a010 msgr2=0x55bbced4a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:14.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.725+0000 7f5de17fa740 1 -- 172.21.15.92:0/442646703 shutdown_connections 2024-09-19T09:02:14.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.725+0000 7f5de17fa740 1 -- 172.21.15.92:0/442646703 wait complete. 2024-09-19T09:02:14.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.725+0000 7f5de17fa740 1 -- start start 2024-09-19T09:02:14.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.725+0000 7f5de17fa740 1 Processor -- start 2024-09-19T09:02:14.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.726+0000 7f5de17fa740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbced4e9a0 0x55bbced58b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:14.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.726+0000 7f5de17fa740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbced4f2e0 0x55bbced590a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:14.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.726+0000 7f5de17fa740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bbced54370 0x55bbced600e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.726+0000 7f5de17fa740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55bbced57340 con 0x55bbced4e9a0 2024-09-19T09:02:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.726+0000 7f5de17fa740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55bbcec3b290 con 0x55bbced4f2e0 2024-09-19T09:02:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.726+0000 7f5de17fa740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55bbced574c0 con 0x55bbced54370 2024-09-19T09:02:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.726+0000 7f5de17fa740 10 client.0 _ll_register_callbacks cb 0x55bbcec6c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.727+0000 7f5dd7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbced4e9a0 0x55bbced58b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.727+0000 7f5dd7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbced4e9a0 0x55bbced58b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56596/0 (socket says 172.21.15.92:56596) 2024-09-19T09:02:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.727+0000 7f5dd7fff640 1 -- 172.21.15.92:0/129728793 learned_addr learned my addr 172.21.15.92:0/129728793 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.727+0000 7f5ddcffb640 1 --2- 172.21.15.92:0/129728793 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bbced54370 0x55bbced600e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.727+0000 7f5dd77fe640 1 --2- 172.21.15.92:0/129728793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbced4f2e0 0x55bbced590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.727+0000 7f5dd7fff640 1 -- 172.21.15.92:0/129728793 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bbced54370 msgr2=0x55bbced600e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.727+0000 7f5dd7fff640 1 --2- 172.21.15.92:0/129728793 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bbced54370 0x55bbced600e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.727+0000 7f5dd7fff640 1 -- 172.21.15.92:0/129728793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbced4f2e0 msgr2=0x55bbced590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.727+0000 7f5dd7fff640 1 --2- 172.21.15.92:0/129728793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbced4f2e0 0x55bbced590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.727+0000 7f5dd7fff640 1 -- 172.21.15.92:0/129728793 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbce9c5210 con 0x55bbced4e9a0 2024-09-19T09:02:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.727+0000 7f5dd7fff640 1 --2- 172.21.15.92:0/129728793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbced4e9a0 0x55bbced58b60 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f5dc800beb0 tx=0x7f5dc80117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b33eb800e88d9c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.727+0000 7f5db77fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:02:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.728+0000 7f5db77fe640 1 -- 172.21.15.92:0/129728793 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8004230 con 0x55bbced4e9a0 2024-09-19T09:02:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.728+0000 7f5db77fe640 1 -- 172.21.15.92:0/129728793 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f5dc80043d0 con 0x55bbced4e9a0 2024-09-19T09:02:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.728+0000 7f5de17fa740 1 -- 172.21.15.92:0/129728793 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5dd0036030 con 0x55bbced4e9a0 2024-09-19T09:02:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.728+0000 7f5db77fe640 1 -- 172.21.15.92:0/129728793 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f5dc8012660 con 0x55bbced4e9a0 2024-09-19T09:02:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.728+0000 7f5de17fa740 10 client.16653 fetch_fsmap learned FSMap version 19 2024-09-19T09:02:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.728+0000 7f5de17fa740 1 -- 172.21.15.92:0/129728793 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55bbcea91620 con 0x55bbced4e9a0 2024-09-19T09:02:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.728+0000 7f5db77fe640 1 -- 172.21.15.92:0/129728793 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dd0036030 con 0x55bbced4e9a0 2024-09-19T09:02:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.728+0000 7f5db77fe640 1 -- 172.21.15.92:0/129728793 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f5dc8003b20 con 0x55bbced4e9a0 2024-09-19T09:02:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.728+0000 7f5de17fa740 10 client.16653 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:02:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.728+0000 7f5de17fa740 10 client.16653 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:02:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.728+0000 7f5de17fa740 20 client.16653 populate_metadata read hostname 'smithi092' 2024-09-19T09:02:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.728+0000 7f5de17fa740 1 --2- 172.21.15.92:0/129728793 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55bbced647d0 0x55bbced66c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.728+0000 7f5de17fa740 4 client.16653 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:02:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.728+0000 7f5de17fa740 1 -- 172.21.15.92:0/129728793 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bbcecbfa20 con 0x55bbced647d0 2024-09-19T09:02:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.729+0000 7f5dd77fe640 1 --2- 172.21.15.92:0/129728793 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55bbced647d0 0x55bbced66c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.730+0000 7f5dd77fe640 1 --2- 172.21.15.92:0/129728793 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55bbced647d0 0x55bbced66c70 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a91f0257c12c2e75 server_cookie=b8a0e7d4b527cd25 in_seq=0 out_seq=0 2024-09-19T09:02:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.730+0000 7f5db77fe640 10 client.16653 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:14.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.731+0000 7f5db77fe640 1 -- 172.21.15.92:0/129728793 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bbcecbfa20 con 0x55bbced647d0 2024-09-19T09:02:14.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.731+0000 7f5db77fe640 10 client.16653 handle_command_reply: tid=0 2024-09-19T09:02:14.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.731+0000 7f5de17fa740 1 client.16653 shutdown 2024-09-19T09:02:14.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.732+0000 7f5de17fa740 1 -- 172.21.15.92:0/129728793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbced4e9a0 msgr2=0x55bbced58b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:14.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.732+0000 7f5de17fa740 1 --2- 172.21.15.92:0/129728793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbced4e9a0 0x55bbced58b60 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f5dc800beb0 tx=0x7f5dc80117b0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.732+0000 7f5de17fa740 1 -- 172.21.15.92:0/129728793 shutdown_connections 2024-09-19T09:02:14.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.732+0000 7f5de17fa740 1 --2- 172.21.15.92:0/129728793 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55bbced647d0 0x55bbced66c70 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.732+0000 7f5de17fa740 1 --2- 172.21.15.92:0/129728793 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bbced54370 0x55bbced600e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.732+0000 7f5db77fe640 0 client.16653 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:14.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.732+0000 7f5de17fa740 1 --2- 172.21.15.92:0/129728793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbced4f2e0 0x55bbced590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.732+0000 7f5de17fa740 1 --2- 172.21.15.92:0/129728793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbced4e9a0 0x55bbced58b60 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.732+0000 7f5de17fa740 1 -- 172.21.15.92:0/129728793 >> 172.21.15.92:0/129728793 conn(0x55bbced4a010 msgr2=0x55bbced4b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:14.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.732+0000 7f5de17fa740 1 -- 172.21.15.92:0/129728793 shutdown_connections 2024-09-19T09:02:14.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.732+0000 7f5de17fa740 1 -- 172.21.15.92:0/129728793 wait complete. 2024-09-19T09:02:14.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.732+0000 7f5de17fa740 20 client.16653 trim_cache size 0 max 16384 2024-09-19T09:02:14.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.759+0000 7f5de17fa740 1 Processor -- start 2024-09-19T09:02:14.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.759+0000 7f5de17fa740 1 -- start start 2024-09-19T09:02:14.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.759+0000 7f5de17fa740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbced4e9a0 0x55bbced59020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:14.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.759+0000 7f5de17fa740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbced4f2e0 0x55bbced60070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:14.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.759+0000 7f5de17fa740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bbced54370 0x55bbced4a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:14.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.759+0000 7f5de17fa740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc400c490 con 0x55bbced4f2e0 2024-09-19T09:02:14.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.759+0000 7f5de17fa740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc400ed30 con 0x55bbced4e9a0 2024-09-19T09:02:14.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.759+0000 7f5de17fa740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc400cb20 con 0x55bbced54370 2024-09-19T09:02:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.759+0000 7f5dd77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbced4f2e0 0x55bbced60070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.759+0000 7f5ddcffb640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bbced54370 0x55bbced4a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.759+0000 7f5dd77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbced4f2e0 0x55bbced60070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56602/0 (socket says 172.21.15.92:56602) 2024-09-19T09:02:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.759+0000 7f5dd77fe640 1 -- 172.21.15.92:0/3478985545 learned_addr learned my addr 172.21.15.92:0/3478985545 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.759+0000 7f5ddcffb640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bbced54370 0x55bbced4a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:49530/0 (socket says 172.21.15.92:49530) 2024-09-19T09:02:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.760+0000 7f5dd7fff640 1 --2- 172.21.15.92:0/3478985545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbced4e9a0 0x55bbced59020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.760+0000 7f5ddcffb640 1 -- 172.21.15.92:0/3478985545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbced4e9a0 msgr2=0x55bbced59020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.760+0000 7f5ddcffb640 1 --2- 172.21.15.92:0/3478985545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbced4e9a0 0x55bbced59020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.760+0000 7f5ddcffb640 1 -- 172.21.15.92:0/3478985545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbced4f2e0 msgr2=0x55bbced60070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.760+0000 7f5ddcffb640 1 --2- 172.21.15.92:0/3478985545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbced4f2e0 0x55bbced60070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.760+0000 7f5ddcffb640 1 -- 172.21.15.92:0/3478985545 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbced63110 con 0x55bbced54370 2024-09-19T09:02:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.760+0000 7f5dd77fe640 1 --2- 172.21.15.92:0/3478985545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbced4f2e0 0x55bbced60070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:02:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.760+0000 7f5ddcffb640 1 --2- 172.21.15.92:0/3478985545 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bbced54370 0x55bbced4a3f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0009a00 tx=0x7f5dd0061000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e116edb9cc70d47 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.760+0000 7f5dbdffb640 1 -- 172.21.15.92:0/3478985545 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd0004670 con 0x55bbced54370 2024-09-19T09:02:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.760+0000 7f5dbdffb640 1 -- 172.21.15.92:0/3478985545 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dd0069070 con 0x55bbced54370 2024-09-19T09:02:14.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.761+0000 7f5de17fa740 1 -- 172.21.15.92:0/3478985545 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bbced54370 msgr2=0x55bbced4a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:14.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.761+0000 7f5de17fa740 1 --2- 172.21.15.92:0/3478985545 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bbced54370 0x55bbced4a3f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0009a00 tx=0x7f5dd0061000 comp rx=0 tx=0).stop 2024-09-19T09:02:14.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.761+0000 7f5de17fa740 1 -- 172.21.15.92:0/3478985545 shutdown_connections 2024-09-19T09:02:14.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.761+0000 7f5de17fa740 1 --2- 172.21.15.92:0/3478985545 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bbced54370 0x55bbced4a3f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.761+0000 7f5de17fa740 1 --2- 172.21.15.92:0/3478985545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbced4f2e0 0x55bbced60070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.761+0000 7f5de17fa740 1 --2- 172.21.15.92:0/3478985545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbced4e9a0 0x55bbced59020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.761+0000 7f5de17fa740 1 -- 172.21.15.92:0/3478985545 >> 172.21.15.92:0/3478985545 conn(0x55bbced4a010 msgr2=0x55bbced58910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:14.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.762+0000 7f5de17fa740 1 -- 172.21.15.92:0/3478985545 shutdown_connections 2024-09-19T09:02:14.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.762+0000 7f5de17fa740 1 -- 172.21.15.92:0/3478985545 wait complete. 2024-09-19T09:02:14.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.762+0000 7f5de17fa740 1 -- start start 2024-09-19T09:02:14.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.763+0000 7f5de17fa740 1 Processor -- start 2024-09-19T09:02:14.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.763+0000 7f5de17fa740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bbced4e9a0 0x55bbced5d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:14.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.763+0000 7f5de17fa740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbced4f2e0 0x55bbced5dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:14.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.763+0000 7f5de17fa740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbced54370 0x55bbced5eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:14.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.763+0000 7f5de17fa740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc400d1f0 con 0x55bbced4f2e0 2024-09-19T09:02:14.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.763+0000 7f5de17fa740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc400e660 con 0x55bbced54370 2024-09-19T09:02:14.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.763+0000 7f5de17fa740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc400d8c0 con 0x55bbced4e9a0 2024-09-19T09:02:14.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.763+0000 7f5de17fa740 10 client.0 _ll_register_callbacks cb 0x7f5dc800b690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:14.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.763+0000 7f5ddcffb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbced54370 0x55bbced5eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:14.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.763+0000 7f5dd77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbced4f2e0 0x55bbced5dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:14.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.763+0000 7f5ddcffb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbced54370 0x55bbced5eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:57200/0 (socket says 172.21.15.92:57200) 2024-09-19T09:02:14.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.763+0000 7f5ddcffb640 1 -- 172.21.15.92:0/279983817 learned_addr learned my addr 172.21.15.92:0/279983817 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:14.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.763+0000 7f5dd7fff640 1 --2- 172.21.15.92:0/279983817 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bbced4e9a0 0x55bbced5d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:14.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.764+0000 7f5ddcffb640 1 -- 172.21.15.92:0/279983817 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bbced4e9a0 msgr2=0x55bbced5d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:14.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.764+0000 7f5ddcffb640 1 --2- 172.21.15.92:0/279983817 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bbced4e9a0 0x55bbced5d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.764+0000 7f5ddcffb640 1 -- 172.21.15.92:0/279983817 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbced4f2e0 msgr2=0x55bbced5dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:14.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.764+0000 7f5ddcffb640 1 --2- 172.21.15.92:0/279983817 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbced4f2e0 0x55bbced5dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.764+0000 7f5ddcffb640 1 -- 172.21.15.92:0/279983817 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbced5f0d0 con 0x55bbced54370 2024-09-19T09:02:14.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.764+0000 7f5ddcffb640 1 --2- 172.21.15.92:0/279983817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbced54370 0x55bbced5eac0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5dd00049a0 tx=0x7f5dd0030d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=506697f1bd69d960 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:14.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.764+0000 7f5db77fe640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:02:14.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.764+0000 7f5db77fe640 1 -- 172.21.15.92:0/279983817 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd0004210 con 0x55bbced54370 2024-09-19T09:02:14.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.764+0000 7f5de17fa740 1 -- 172.21.15.92:0/279983817 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5dd0069070 con 0x55bbced54370 2024-09-19T09:02:14.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.765+0000 7f5db77fe640 1 -- 172.21.15.92:0/279983817 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f5dd002f590 con 0x55bbced54370 2024-09-19T09:02:14.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.765+0000 7f5db77fe640 1 -- 172.21.15.92:0/279983817 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f5dd0030690 con 0x55bbced54370 2024-09-19T09:02:14.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.765+0000 7f5de17fa740 10 client.26051 fetch_fsmap learned FSMap version 19 2024-09-19T09:02:14.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.765+0000 7f5de17fa740 1 -- 172.21.15.92:0/279983817 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55bbced603e0 con 0x55bbced54370 2024-09-19T09:02:14.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.765+0000 7f5db77fe640 1 -- 172.21.15.92:0/279983817 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dd0069070 con 0x55bbced54370 2024-09-19T09:02:14.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.765+0000 7f5db77fe640 1 -- 172.21.15.92:0/279983817 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f5dd0079940 con 0x55bbced54370 2024-09-19T09:02:14.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.766+0000 7f5de17fa740 10 client.26051 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:02:14.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.766+0000 7f5de17fa740 10 client.26051 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:02:14.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.766+0000 7f5de17fa740 20 client.26051 populate_metadata read hostname 'smithi092' 2024-09-19T09:02:14.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.766+0000 7f5de17fa740 1 --2- 172.21.15.92:0/279983817 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55bbcedcf780 0x55bbcedd1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:14.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.766+0000 7f5de17fa740 4 client.26051 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:02:14.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.766+0000 7f5de17fa740 1 -- 172.21.15.92:0/279983817 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bbcecb9d70 con 0x55bbcedcf780 2024-09-19T09:02:14.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.766+0000 7f5dd7fff640 1 --2- 172.21.15.92:0/279983817 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55bbcedcf780 0x55bbcedd1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:14.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.766+0000 7f5db77fe640 10 client.26051 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:14.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.766+0000 7f5dd7fff640 1 --2- 172.21.15.92:0/279983817 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55bbcedcf780 0x55bbcedd1b70 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8001ef53fe09377b server_cookie=2e580ca6f3edd01c in_seq=0 out_seq=0 2024-09-19T09:02:14.788 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.788+0000 7f5db77fe640 1 -- 172.21.15.92:0/279983817 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bbcecb9d70 con 0x55bbcedcf780 2024-09-19T09:02:14.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.788+0000 7f5db77fe640 10 client.26051 handle_command_reply: tid=0 2024-09-19T09:02:14.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.788+0000 7f5de17fa740 1 client.26051 shutdown 2024-09-19T09:02:14.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.788+0000 7f5de17fa740 1 -- 172.21.15.92:0/279983817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbced54370 msgr2=0x55bbced5eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:14.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.788+0000 7f5de17fa740 1 --2- 172.21.15.92:0/279983817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbced54370 0x55bbced5eac0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5dd00049a0 tx=0x7f5dd0030d60 comp rx=0 tx=0).stop 2024-09-19T09:02:14.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.788+0000 7f5de17fa740 1 -- 172.21.15.92:0/279983817 shutdown_connections 2024-09-19T09:02:14.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.788+0000 7f5de17fa740 1 --2- 172.21.15.92:0/279983817 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55bbcedcf780 0x55bbcedd1b70 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.788+0000 7f5de17fa740 1 --2- 172.21.15.92:0/279983817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbced54370 0x55bbced5eac0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.788+0000 7f5de17fa740 1 --2- 172.21.15.92:0/279983817 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bbced4f2e0 0x55bbced5dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.788+0000 7f5de17fa740 1 --2- 172.21.15.92:0/279983817 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bbced4e9a0 0x55bbced5d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.788+0000 7f5db77fe640 0 client.26051 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:14.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.788+0000 7f5de17fa740 1 -- 172.21.15.92:0/279983817 >> 172.21.15.92:0/279983817 conn(0x55bbced4a010 msgr2=0x55bbced489a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:14.790 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.788+0000 7f5de17fa740 1 -- 172.21.15.92:0/279983817 shutdown_connections 2024-09-19T09:02:14.790 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.788+0000 7f5de17fa740 1 -- 172.21.15.92:0/279983817 wait complete. 2024-09-19T09:02:14.790 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.789+0000 7f5de17fa740 20 client.26051 trim_cache size 0 max 16384 2024-09-19T09:02:14.790 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:02:14.790 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:02:14.790 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:02:14.790 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:02:14.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.789+0000 7f5ddea5e640 1 -- 172.21.15.92:0/3858412115 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5dc00a3370 msgr2=0x7f5dc00a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:14.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.789+0000 7f5ddea5e640 1 --2- 172.21.15.92:0/3858412115 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5dc00a3370 0x7f5dc00a5830 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5dd005b000 tx=0x7f5dd005c000 comp rx=0 tx=0).stop 2024-09-19T09:02:14.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.790+0000 7f5ddea5e640 1 -- 172.21.15.92:0/3858412115 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5dd8101c30 msgr2=0x7f5dd819e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:14.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.790+0000 7f5ddea5e640 1 --2- 172.21.15.92:0/3858412115 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5dd8101c30 0x7f5dd819e950 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00b450 tx=0x7f5dcc00b910 comp rx=0 tx=0).stop 2024-09-19T09:02:14.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.790+0000 7f5ddea5e640 1 -- 172.21.15.92:0/3858412115 shutdown_connections 2024-09-19T09:02:14.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.790+0000 7f5ddea5e640 1 --2- 172.21.15.92:0/3858412115 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5dd81025f0 0x7f5dd81a59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.790+0000 7f5ddea5e640 1 --2- 172.21.15.92:0/3858412115 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5dd8101c30 0x7f5dd819e950 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.790+0000 7f5ddea5e640 1 --2- 172.21.15.92:0/3858412115 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f5dc00a3370 0x7f5dc00a5830 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.790+0000 7f5ddea5e640 1 --2- 172.21.15.92:0/3858412115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dd8100a40 0x7f5dd819e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:14.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.790+0000 7f5ddea5e640 1 -- 172.21.15.92:0/3858412115 >> 172.21.15.92:0/3858412115 conn(0x7f5dd80fc1e0 msgr2=0x7f5dd810c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:14.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.790+0000 7f5ddea5e640 1 -- 172.21.15.92:0/3858412115 shutdown_connections 2024-09-19T09:02:14.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:14.791+0000 7f5ddea5e640 1 -- 172.21.15.92:0/3858412115 wait complete. 2024-09-19T09:02:15.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:15 smithi092 ceph-mon[31407]: pgmap v503: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 12 MiB/s wr, 1.05k op/s 2024-09-19T09:02:15.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 330.0 s, 4549.0 tps, lat 21.954 ms stddev 24.194 2024-09-19T09:02:15.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:15 smithi167 ceph-mon[35359]: pgmap v503: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 12 MiB/s wr, 1.05k op/s 2024-09-19T09:02:15.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:15 smithi190 ceph-mon[35358]: pgmap v503: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 12 MiB/s wr, 1.05k op/s 2024-09-19T09:02:17.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:17 smithi092 ceph-mon[31407]: pgmap v504: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 9.5 MiB/s wr, 929 op/s 2024-09-19T09:02:17.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:17 smithi167 ceph-mon[35359]: pgmap v504: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 9.5 MiB/s wr, 929 op/s 2024-09-19T09:02:17.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:17 smithi190 ceph-mon[35358]: pgmap v504: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 9.5 MiB/s wr, 929 op/s 2024-09-19T09:02:19.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:19 smithi092 ceph-mon[31407]: pgmap v505: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 12 MiB/s wr, 1.01k op/s 2024-09-19T09:02:19.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:19 smithi167 ceph-mon[35359]: pgmap v505: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 12 MiB/s wr, 1.01k op/s 2024-09-19T09:02:19.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:19 smithi190 ceph-mon[35358]: pgmap v505: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 12 MiB/s wr, 1.01k op/s 2024-09-19T09:02:20.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 335.0 s, 3600.6 tps, lat 27.794 ms stddev 30.281 2024-09-19T09:02:21.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:21 smithi092 ceph-mon[31407]: pgmap v506: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 16 MiB/s wr, 1.05k op/s 2024-09-19T09:02:21.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:21 smithi167 ceph-mon[35359]: pgmap v506: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 16 MiB/s wr, 1.05k op/s 2024-09-19T09:02:21.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:21 smithi190 ceph-mon[35358]: pgmap v506: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 16 MiB/s wr, 1.05k op/s 2024-09-19T09:02:23.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:23 smithi167 ceph-mon[35359]: pgmap v507: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 17 MiB/s wr, 920 op/s 2024-09-19T09:02:23.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:23 smithi190 ceph-mon[35358]: pgmap v507: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 17 MiB/s wr, 920 op/s 2024-09-19T09:02:24.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:23 smithi092 ceph-mon[31407]: pgmap v507: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 17 MiB/s wr, 920 op/s 2024-09-19T09:02:25.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 340.0 s, 3996.0 tps, lat 24.990 ms stddev 27.639 2024-09-19T09:02:25.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:25 smithi167 ceph-mon[35359]: pgmap v508: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 23 MiB/s wr, 950 op/s 2024-09-19T09:02:25.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:25 smithi190 ceph-mon[35358]: pgmap v508: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 23 MiB/s wr, 950 op/s 2024-09-19T09:02:26.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:25 smithi092 ceph-mon[31407]: pgmap v508: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 23 MiB/s wr, 950 op/s 2024-09-19T09:02:27.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:27 smithi167 ceph-mon[35359]: pgmap v509: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 841 op/s 2024-09-19T09:02:27.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:27 smithi190 ceph-mon[35358]: pgmap v509: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 841 op/s 2024-09-19T09:02:27.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.923+0000 7fd039047640 1 -- 172.21.15.92:0/162778714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd034101c30 msgr2=0x7fd0341020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:27.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.923+0000 7fd039047640 1 --2- 172.21.15.92:0/162778714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd034101c30 0x7fd0341020b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd028009900 tx=0x7fd02802a410 comp rx=0 tx=0).stop 2024-09-19T09:02:27.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.923+0000 7fd039047640 1 -- 172.21.15.92:0/162778714 shutdown_connections 2024-09-19T09:02:27.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.923+0000 7fd039047640 1 --2- 172.21.15.92:0/162778714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0341025f0 0x7fd034108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.923+0000 7fd039047640 1 --2- 172.21.15.92:0/162778714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd034101c30 0x7fd0341020b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.923+0000 7fd039047640 1 --2- 172.21.15.92:0/162778714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd034100a40 0x7fd034100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.923+0000 7fd039047640 1 -- 172.21.15.92:0/162778714 >> 172.21.15.92:0/162778714 conn(0x7fd0340fc1e0 msgr2=0x7fd0340fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:27.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.923+0000 7fd039047640 1 -- 172.21.15.92:0/162778714 shutdown_connections 2024-09-19T09:02:27.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.923+0000 7fd039047640 1 -- 172.21.15.92:0/162778714 wait complete. 2024-09-19T09:02:27.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.924+0000 7fd039047640 1 Processor -- start 2024-09-19T09:02:27.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.924+0000 7fd039047640 1 -- start start 2024-09-19T09:02:27.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.925+0000 7fd039047640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd034100a40 0x7fd03419a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:27.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.925+0000 7fd039047640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd034101c30 0x7fd03419a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:27.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.925+0000 7fd039047640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0341025f0 0x7fd0341a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:27.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.925+0000 7fd039047640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd03410b600 con 0x7fd0341025f0 2024-09-19T09:02:27.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.925+0000 7fd039047640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd03410b480 con 0x7fd034100a40 2024-09-19T09:02:27.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.925+0000 7fd039047640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd03410b780 con 0x7fd034101c30 2024-09-19T09:02:27.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.925+0000 7fd032d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd034100a40 0x7fd03419a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:27.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.925+0000 7fd032d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd034100a40 0x7fd03419a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:44730/0 (socket says 172.21.15.92:44730) 2024-09-19T09:02:27.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.925+0000 7fd032d9d640 1 -- 172.21.15.92:0/1225530632 learned_addr learned my addr 172.21.15.92:0/1225530632 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:27.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.925+0000 7fd03359e640 1 --2- 172.21.15.92:0/1225530632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0341025f0 0x7fd0341a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:27.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.925+0000 7fd03259c640 1 --2- 172.21.15.92:0/1225530632 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd034101c30 0x7fd03419a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:27.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.925+0000 7fd03359e640 1 -- 172.21.15.92:0/1225530632 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd034101c30 msgr2=0x7fd03419a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:27.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.925+0000 7fd03359e640 1 --2- 172.21.15.92:0/1225530632 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd034101c30 0x7fd03419a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.925+0000 7fd03359e640 1 -- 172.21.15.92:0/1225530632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd034100a40 msgr2=0x7fd03419a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:27.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.925+0000 7fd03359e640 1 --2- 172.21.15.92:0/1225530632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd034100a40 0x7fd03419a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.925+0000 7fd03359e640 1 -- 172.21.15.92:0/1225530632 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0341a1c20 con 0x7fd0341025f0 2024-09-19T09:02:27.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.926+0000 7fd03359e640 1 --2- 172.21.15.92:0/1225530632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0341025f0 0x7fd0341a15b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd02c00ec50 tx=0x7fd02c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:27.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.926+0000 7fd01bfff640 1 -- 172.21.15.92:0/1225530632 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd02c003b70 con 0x7fd0341025f0 2024-09-19T09:02:27.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.926+0000 7fd01bfff640 1 -- 172.21.15.92:0/1225530632 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd02c003d10 con 0x7fd0341025f0 2024-09-19T09:02:27.930 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.926+0000 7fd039047640 1 -- 172.21.15.92:0/1225530632 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0341a1f10 con 0x7fd0341025f0 2024-09-19T09:02:27.930 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.926+0000 7fd039047640 1 -- 172.21.15.92:0/1225530632 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0341a23d0 con 0x7fd0341025f0 2024-09-19T09:02:27.930 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.926+0000 7fd01bfff640 1 -- 172.21.15.92:0/1225530632 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd02c010890 con 0x7fd0341025f0 2024-09-19T09:02:27.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.930+0000 7fd01bfff640 1 -- 172.21.15.92:0/1225530632 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd02c003fc0 con 0x7fd0341025f0 2024-09-19T09:02:27.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.930+0000 7fd03bddc740 1 Processor -- start 2024-09-19T09:02:27.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.930+0000 7fd03bddc740 1 -- start start 2024-09-19T09:02:27.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.930+0000 7fd03bddc740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae918f69a0 0x55ae918f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:27.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.930+0000 7fd03bddc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae918f72e0 0x55ae918fbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:27.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.930+0000 7fd03bddc740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae918fc370 0x55ae918fe830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:27.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.930+0000 7fd03bddc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ae9185a2f0 con 0x55ae918f72e0 2024-09-19T09:02:27.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.930+0000 7fd03bddc740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ae91802270 con 0x55ae918fc370 2024-09-19T09:02:27.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.930+0000 7fd03bddc740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ae918562b0 con 0x55ae918f69a0 2024-09-19T09:02:27.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.930+0000 7fd03259c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae918fc370 0x55ae918fe830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:27.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.930+0000 7fd032d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae918f72e0 0x55ae918fbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:27.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.930+0000 7fd03259c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae918fc370 0x55ae918fe830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:44744/0 (socket says 172.21.15.92:44744) 2024-09-19T09:02:27.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.930+0000 7fd032d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae918f72e0 0x55ae918fbda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37488/0 (socket says 172.21.15.92:37488) 2024-09-19T09:02:27.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.930+0000 7fd03259c640 1 -- 172.21.15.92:0/3098654102 learned_addr learned my addr 172.21.15.92:0/3098654102 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:27.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.930+0000 7fd03259c640 1 --2- 172.21.15.92:0/3098654102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae918f69a0 0x55ae918f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:27.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.931+0000 7fd01bfff640 1 --2- 172.21.15.92:0/1225530632 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd01c0a33c0 0x7fd01c0a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:27.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.931+0000 7fd03259c640 1 -- 172.21.15.92:0/3098654102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae918f69a0 msgr2=0x55ae918f6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:27.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.931+0000 7fd03259c640 1 --2- 172.21.15.92:0/3098654102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae918f69a0 0x55ae918f6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.931+0000 7fd03259c640 1 -- 172.21.15.92:0/3098654102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae918f72e0 msgr2=0x55ae918fbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:27.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.931+0000 7fd03259c640 1 --2- 172.21.15.92:0/3098654102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae918f72e0 0x55ae918fbda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.931+0000 7fd03259c640 1 -- 172.21.15.92:0/3098654102 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae91801340 con 0x55ae918fc370 2024-09-19T09:02:27.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.931+0000 7fd03259c640 1 --2- 172.21.15.92:0/3098654102 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae918fc370 0x55ae918fe830 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd0280314e0 tx=0x7fd028005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd94114e11aafbd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:27.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.931+0000 7fd01bfff640 1 -- 172.21.15.92:0/1225530632 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd02c0cfe00 con 0x7fd0341025f0 2024-09-19T09:02:27.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.931+0000 7fd03359e640 1 --2- 172.21.15.92:0/1225530632 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd01c0a33c0 0x7fd01c0a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:27.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.931+0000 7fd0197fa640 1 -- 172.21.15.92:0/3098654102 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd028035030 con 0x55ae918fc370 2024-09-19T09:02:27.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.931+0000 7fd0197fa640 1 -- 172.21.15.92:0/3098654102 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd028045070 con 0x55ae918fc370 2024-09-19T09:02:27.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.931+0000 7fd0197fa640 1 -- 172.21.15.92:0/3098654102 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd028003d50 con 0x55ae918fc370 2024-09-19T09:02:27.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.932+0000 7fd03bddc740 1 -- 172.21.15.92:0/3098654102 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae918fc370 msgr2=0x55ae918fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:27.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.932+0000 7fd03bddc740 1 --2- 172.21.15.92:0/3098654102 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae918fc370 0x55ae918fe830 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd0280314e0 tx=0x7fd028005fd0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.932+0000 7fd03359e640 1 --2- 172.21.15.92:0/1225530632 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd01c0a33c0 0x7fd01c0a5880 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd02c00cba0 tx=0x7fd02c096f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:27.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.932+0000 7fd03bddc740 1 -- 172.21.15.92:0/3098654102 shutdown_connections 2024-09-19T09:02:27.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.932+0000 7fd03bddc740 1 --2- 172.21.15.92:0/3098654102 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae918fc370 0x55ae918fe830 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.932+0000 7fd03bddc740 1 --2- 172.21.15.92:0/3098654102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae918f72e0 0x55ae918fbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.932+0000 7fd03bddc740 1 --2- 172.21.15.92:0/3098654102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae918f69a0 0x55ae918f6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.932+0000 7fd03bddc740 1 -- 172.21.15.92:0/3098654102 >> 172.21.15.92:0/3098654102 conn(0x55ae918f2010 msgr2=0x55ae918f2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:27.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.933+0000 7fd03bddc740 1 -- 172.21.15.92:0/3098654102 shutdown_connections 2024-09-19T09:02:27.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.933+0000 7fd03bddc740 1 -- 172.21.15.92:0/3098654102 wait complete. 2024-09-19T09:02:27.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.934+0000 7fd03bddc740 1 -- start start 2024-09-19T09:02:27.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.934+0000 7fd03bddc740 1 Processor -- start 2024-09-19T09:02:27.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.934+0000 7fd03bddc740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae918f69a0 0x55ae91900bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:27.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.934+0000 7fd03bddc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae918f72e0 0x55ae91901130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:27.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.934+0000 7fd03bddc740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae918fc370 0x55ae91908100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:27.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.934+0000 7fd03bddc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ae918ff2e0 con 0x55ae918f72e0 2024-09-19T09:02:27.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.934+0000 7fd03bddc740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ae917e3290 con 0x55ae918f69a0 2024-09-19T09:02:27.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.934+0000 7fd03bddc740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ae918ff460 con 0x55ae918fc370 2024-09-19T09:02:27.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.934+0000 7fd03bddc740 10 client.0 _ll_register_callbacks cb 0x55ae91814140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:27.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.934+0000 7fd032d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae918f72e0 0x55ae91901130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:27.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.934+0000 7fd03259c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae918f69a0 0x55ae91900bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:27.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.934+0000 7fd03259c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae918f69a0 0x55ae91900bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:44760/0 (socket says 172.21.15.92:44760) 2024-09-19T09:02:27.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.934+0000 7fd03259c640 1 -- 172.21.15.92:0/1672012564 learned_addr learned my addr 172.21.15.92:0/1672012564 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:27.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.934+0000 7fd03259c640 1 --2- 172.21.15.92:0/1672012564 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae918fc370 0x55ae91908100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:27.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.935+0000 7fd03259c640 1 -- 172.21.15.92:0/1672012564 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae918fc370 msgr2=0x55ae91908100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:27.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.935+0000 7fd03259c640 1 --2- 172.21.15.92:0/1672012564 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae918fc370 0x55ae91908100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.935+0000 7fd03259c640 1 -- 172.21.15.92:0/1672012564 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae918f72e0 msgr2=0x55ae91901130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:27.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.935+0000 7fd03259c640 1 --2- 172.21.15.92:0/1672012564 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae918f72e0 0x55ae91901130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.935+0000 7fd03259c640 1 -- 172.21.15.92:0/1672012564 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae9156d210 con 0x55ae918f69a0 2024-09-19T09:02:27.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.935+0000 7fd032d9d640 1 --2- 172.21.15.92:0/1672012564 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae918f72e0 0x55ae91901130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:02:27.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.935+0000 7fd03259c640 1 --2- 172.21.15.92:0/1672012564 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae918f69a0 0x55ae91900bf0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd02802aa00 tx=0x7fd028004120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84044baedbfa7ee6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:27.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.935+0000 7fd016ff5640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:02:27.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.935+0000 7fd016ff5640 1 -- 172.21.15.92:0/1672012564 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd028050020 con 0x55ae918f69a0 2024-09-19T09:02:27.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.935+0000 7fd03bddc740 1 -- 172.21.15.92:0/1672012564 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd028045070 con 0x55ae918f69a0 2024-09-19T09:02:27.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.935+0000 7fd016ff5640 1 -- 172.21.15.92:0/1672012564 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd02803d450 con 0x55ae918f69a0 2024-09-19T09:02:27.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.935+0000 7fd016ff5640 1 -- 172.21.15.92:0/1672012564 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd028035040 con 0x55ae918f69a0 2024-09-19T09:02:27.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.935+0000 7fd03bddc740 10 client.26063 fetch_fsmap learned FSMap version 19 2024-09-19T09:02:27.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.935+0000 7fd03bddc740 1 -- 172.21.15.92:0/1672012564 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ae91639620 con 0x55ae918f69a0 2024-09-19T09:02:27.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.936+0000 7fd016ff5640 1 -- 172.21.15.92:0/1672012564 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd028045070 con 0x55ae918f69a0 2024-09-19T09:02:27.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.936+0000 7fd016ff5640 1 -- 172.21.15.92:0/1672012564 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fd02803da70 con 0x55ae918f69a0 2024-09-19T09:02:27.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.936+0000 7fd03bddc740 10 client.26063 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:02:27.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.936+0000 7fd03bddc740 10 client.26063 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:02:27.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.936+0000 7fd03bddc740 20 client.26063 populate_metadata read hostname 'smithi092' 2024-09-19T09:02:27.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.936+0000 7fd03bddc740 1 --2- 172.21.15.92:0/1672012564 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ae9190c400 0x55ae9190e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:27.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.936+0000 7fd03bddc740 4 client.26063 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:02:27.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.936+0000 7fd03bddc740 1 -- 172.21.15.92:0/1672012564 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae91867a20 con 0x55ae9190c400 2024-09-19T09:02:27.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.936+0000 7fd032d9d640 1 --2- 172.21.15.92:0/1672012564 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ae9190c400 0x55ae9190e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:27.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.937+0000 7fd016ff5640 10 client.26063 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:27.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.937+0000 7fd032d9d640 1 --2- 172.21.15.92:0/1672012564 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ae9190c400 0x55ae9190e7f0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=873549a2da17c6b4 server_cookie=e040245625263b05 in_seq=0 out_seq=0 2024-09-19T09:02:27.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.938+0000 7fd016ff5640 1 -- 172.21.15.92:0/1672012564 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ae91867a20 con 0x55ae9190c400 2024-09-19T09:02:27.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.938+0000 7fd016ff5640 10 client.26063 handle_command_reply: tid=0 2024-09-19T09:02:27.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.938+0000 7fd03bddc740 1 client.26063 shutdown 2024-09-19T09:02:27.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.938+0000 7fd03bddc740 1 -- 172.21.15.92:0/1672012564 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae918f69a0 msgr2=0x55ae91900bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:27.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.938+0000 7fd03bddc740 1 --2- 172.21.15.92:0/1672012564 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae918f69a0 0x55ae91900bf0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd02802aa00 tx=0x7fd028004120 comp rx=0 tx=0).stop 2024-09-19T09:02:27.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.938+0000 7fd03bddc740 1 -- 172.21.15.92:0/1672012564 shutdown_connections 2024-09-19T09:02:27.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.938+0000 7fd03bddc740 1 --2- 172.21.15.92:0/1672012564 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ae9190c400 0x55ae9190e7f0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.938+0000 7fd016ff5640 0 client.26063 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:27.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.938+0000 7fd03bddc740 1 --2- 172.21.15.92:0/1672012564 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae918fc370 0x55ae91908100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.938+0000 7fd03bddc740 1 --2- 172.21.15.92:0/1672012564 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae918f72e0 0x55ae91901130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.938+0000 7fd03bddc740 1 --2- 172.21.15.92:0/1672012564 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae918f69a0 0x55ae91900bf0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.938+0000 7fd03bddc740 1 -- 172.21.15.92:0/1672012564 >> 172.21.15.92:0/1672012564 conn(0x55ae918f2010 msgr2=0x55ae918f3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:27.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.939+0000 7fd03bddc740 1 -- 172.21.15.92:0/1672012564 shutdown_connections 2024-09-19T09:02:27.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.939+0000 7fd03bddc740 1 -- 172.21.15.92:0/1672012564 wait complete. 2024-09-19T09:02:27.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.939+0000 7fd03bddc740 20 client.26063 trim_cache size 0 max 16384 2024-09-19T09:02:27.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.959+0000 7fd03bddc740 1 Processor -- start 2024-09-19T09:02:27.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.959+0000 7fd03bddc740 1 -- start start 2024-09-19T09:02:27.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.959+0000 7fd03bddc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae918f2010 0x55ae918f6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:27.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.959+0000 7fd03bddc740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae918f69a0 0x55ae91908020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:27.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.959+0000 7fd03bddc740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae918f72e0 0x55ae918f10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:27.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.959+0000 7fd03bddc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd02000c490 con 0x55ae918f2010 2024-09-19T09:02:27.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.959+0000 7fd03259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae918f2010 0x55ae918f6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:27.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.959+0000 7fd03bddc740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd02000ed30 con 0x55ae918f69a0 2024-09-19T09:02:27.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.959+0000 7fd03bddc740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd02000cb20 con 0x55ae918f72e0 2024-09-19T09:02:27.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.959+0000 7fd03259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae918f2010 0x55ae918f6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37512/0 (socket says 172.21.15.92:37512) 2024-09-19T09:02:27.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.959+0000 7fd03259c640 1 -- 172.21.15.92:0/1292208958 learned_addr learned my addr 172.21.15.92:0/1292208958 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:27.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.959+0000 7fd032d9d640 1 --2- 172.21.15.92:0/1292208958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae918f69a0 0x55ae91908020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:27.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.959+0000 7fd03259c640 1 --2- 172.21.15.92:0/1292208958 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae918f72e0 0x55ae918f10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:27.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.959+0000 7fd03259c640 1 -- 172.21.15.92:0/1292208958 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae918f72e0 msgr2=0x55ae918f10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:27.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.959+0000 7fd03259c640 1 --2- 172.21.15.92:0/1292208958 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae918f72e0 0x55ae918f10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.959+0000 7fd03259c640 1 -- 172.21.15.92:0/1292208958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae918f69a0 msgr2=0x55ae91908020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:27.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.960+0000 7fd03259c640 1 --2- 172.21.15.92:0/1292208958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae918f69a0 0x55ae91908020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.960+0000 7fd03259c640 1 -- 172.21.15.92:0/1292208958 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae91900730 con 0x55ae918f2010 2024-09-19T09:02:27.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.960+0000 7fd03259c640 1 --2- 172.21.15.92:0/1292208958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae918f2010 0x55ae918f6d80 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd02803de90 tx=0x7fd028005990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec5796e323c7ce9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:27.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.960+0000 7fd018ff9640 1 -- 172.21.15.92:0/1292208958 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd028050040 con 0x55ae918f2010 2024-09-19T09:02:27.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.960+0000 7fd018ff9640 1 -- 172.21.15.92:0/1292208958 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd028045070 con 0x55ae918f2010 2024-09-19T09:02:27.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.960+0000 7fd018ff9640 1 -- 172.21.15.92:0/1292208958 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd02803cdd0 con 0x55ae918f2010 2024-09-19T09:02:27.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.961+0000 7fd03bddc740 1 -- 172.21.15.92:0/1292208958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae918f2010 msgr2=0x55ae918f6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:27.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.961+0000 7fd03bddc740 1 --2- 172.21.15.92:0/1292208958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae918f2010 0x55ae918f6d80 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd02803de90 tx=0x7fd028005990 comp rx=0 tx=0).stop 2024-09-19T09:02:27.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.962+0000 7fd03bddc740 1 -- 172.21.15.92:0/1292208958 shutdown_connections 2024-09-19T09:02:27.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.962+0000 7fd03bddc740 1 --2- 172.21.15.92:0/1292208958 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae918f72e0 0x55ae918f10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.962+0000 7fd03bddc740 1 --2- 172.21.15.92:0/1292208958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae918f69a0 0x55ae91908020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.962+0000 7fd03bddc740 1 --2- 172.21.15.92:0/1292208958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae918f2010 0x55ae918f6d80 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.962+0000 7fd03bddc740 1 -- 172.21.15.92:0/1292208958 >> 172.21.15.92:0/1292208958 conn(0x55ae918fbe90 msgr2=0x55ae918f09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:27.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.962+0000 7fd03bddc740 1 -- 172.21.15.92:0/1292208958 shutdown_connections 2024-09-19T09:02:27.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.963+0000 7fd03bddc740 1 -- 172.21.15.92:0/1292208958 wait complete. 2024-09-19T09:02:27.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.963+0000 7fd03bddc740 1 -- start start 2024-09-19T09:02:27.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.963+0000 7fd03bddc740 1 Processor -- start 2024-09-19T09:02:27.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.963+0000 7fd03bddc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae918f2010 0x55ae919053d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:27.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.963+0000 7fd03bddc740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae918f69a0 0x55ae91905910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:27.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.963+0000 7fd03bddc740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae918f72e0 0x55ae91906920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:27.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.963+0000 7fd03bddc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd02000d1f0 con 0x55ae918f2010 2024-09-19T09:02:27.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.963+0000 7fd03bddc740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd02000e660 con 0x55ae918f69a0 2024-09-19T09:02:27.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.963+0000 7fd03bddc740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd02000d8c0 con 0x55ae918f72e0 2024-09-19T09:02:27.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.964+0000 7fd03bddc740 10 client.0 _ll_register_callbacks cb 0x7fd024009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:27.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.964+0000 7fd03259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae918f2010 0x55ae919053d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:27.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.964+0000 7fd03259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae918f2010 0x55ae919053d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37518/0 (socket says 172.21.15.92:37518) 2024-09-19T09:02:27.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.964+0000 7fd03259c640 1 -- 172.21.15.92:0/1689948777 learned_addr learned my addr 172.21.15.92:0/1689948777 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:27.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.964+0000 7fd03259c640 1 --2- 172.21.15.92:0/1689948777 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae918f72e0 0x55ae91906920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:27.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.964+0000 7fd032d9d640 1 --2- 172.21.15.92:0/1689948777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae918f69a0 0x55ae91905910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:27.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.964+0000 7fd03259c640 1 -- 172.21.15.92:0/1689948777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae918f69a0 msgr2=0x55ae91905910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:27.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.964+0000 7fd03259c640 1 --2- 172.21.15.92:0/1689948777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae918f69a0 0x55ae91905910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.964+0000 7fd03259c640 1 -- 172.21.15.92:0/1689948777 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae918f2010 msgr2=0x55ae919053d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:27.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.964+0000 7fd03259c640 1 --2- 172.21.15.92:0/1689948777 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae918f2010 0x55ae919053d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.964+0000 7fd03259c640 1 -- 172.21.15.92:0/1689948777 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae9190edd0 con 0x55ae918f72e0 2024-09-19T09:02:27.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.964+0000 7fd03259c640 1 --2- 172.21.15.92:0/1689948777 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae918f72e0 0x55ae91906920 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd028031610 tx=0x7fd02802a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b098f0494f4fef6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:27.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.964+0000 7fd016ff5640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:02:27.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.965+0000 7fd016ff5640 1 -- 172.21.15.92:0/1689948777 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd02806b060 con 0x55ae918f72e0 2024-09-19T09:02:27.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.965+0000 7fd016ff5640 1 -- 172.21.15.92:0/1689948777 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd02803cd70 con 0x55ae918f72e0 2024-09-19T09:02:27.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.965+0000 7fd03bddc740 1 -- 172.21.15.92:0/1689948777 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd028045070 con 0x55ae918f72e0 2024-09-19T09:02:27.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.965+0000 7fd016ff5640 1 -- 172.21.15.92:0/1689948777 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd028050070 con 0x55ae918f72e0 2024-09-19T09:02:27.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.965+0000 7fd03bddc740 10 client.25990 fetch_fsmap learned FSMap version 19 2024-09-19T09:02:27.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.965+0000 7fd03bddc740 1 -- 172.21.15.92:0/1689948777 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ae91908070 con 0x55ae918f72e0 2024-09-19T09:02:27.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.966+0000 7fd016ff5640 1 -- 172.21.15.92:0/1689948777 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd028045070 con 0x55ae918f72e0 2024-09-19T09:02:27.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.966+0000 7fd016ff5640 1 -- 172.21.15.92:0/1689948777 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fd02803d730 con 0x55ae918f72e0 2024-09-19T09:02:27.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.966+0000 7fd03bddc740 10 client.25990 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:02:27.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.966+0000 7fd03bddc740 10 client.25990 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:02:27.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.967+0000 7fd03bddc740 20 client.25990 populate_metadata read hostname 'smithi092' 2024-09-19T09:02:27.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.967+0000 7fd03bddc740 1 --2- 172.21.15.92:0/1689948777 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ae918fc370 0x55ae919793b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:27.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.967+0000 7fd03bddc740 4 client.25990 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:02:27.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.967+0000 7fd03bddc740 1 -- 172.21.15.92:0/1689948777 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ae91861d70 con 0x55ae918fc370 2024-09-19T09:02:27.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.967+0000 7fd032d9d640 1 --2- 172.21.15.92:0/1689948777 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ae918fc370 0x55ae919793b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:27.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.967+0000 7fd016ff5640 10 client.25990 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:27.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.967+0000 7fd032d9d640 1 --2- 172.21.15.92:0/1689948777 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ae918fc370 0x55ae919793b0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba5e43b09be5f086 server_cookie=a5a6b156aef13d9c in_seq=0 out_seq=0 2024-09-19T09:02:27.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.987+0000 7fd016ff5640 1 -- 172.21.15.92:0/1689948777 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ae91861d70 con 0x55ae918fc370 2024-09-19T09:02:27.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.987+0000 7fd016ff5640 10 client.25990 handle_command_reply: tid=0 2024-09-19T09:02:27.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.987+0000 7fd03bddc740 1 client.25990 shutdown 2024-09-19T09:02:27.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.988+0000 7fd03bddc740 1 -- 172.21.15.92:0/1689948777 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae918f72e0 msgr2=0x55ae91906920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:27.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.988+0000 7fd03bddc740 1 --2- 172.21.15.92:0/1689948777 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae918f72e0 0x55ae91906920 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd028031610 tx=0x7fd02802a410 comp rx=0 tx=0).stop 2024-09-19T09:02:27.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.988+0000 7fd03bddc740 1 -- 172.21.15.92:0/1689948777 shutdown_connections 2024-09-19T09:02:27.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.988+0000 7fd03bddc740 1 --2- 172.21.15.92:0/1689948777 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ae918fc370 0x55ae919793b0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.988+0000 7fd03bddc740 1 --2- 172.21.15.92:0/1689948777 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae918f72e0 0x55ae91906920 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.988+0000 7fd016ff5640 0 client.25990 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:27.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.988+0000 7fd03bddc740 1 --2- 172.21.15.92:0/1689948777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae918f69a0 0x55ae91905910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.988+0000 7fd03bddc740 1 --2- 172.21.15.92:0/1689948777 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae918f2010 0x55ae919053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.988+0000 7fd03bddc740 1 -- 172.21.15.92:0/1689948777 >> 172.21.15.92:0/1689948777 conn(0x55ae918fbe90 msgr2=0x55ae918f36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:27.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.988+0000 7fd03bddc740 1 -- 172.21.15.92:0/1689948777 shutdown_connections 2024-09-19T09:02:27.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.988+0000 7fd03bddc740 1 -- 172.21.15.92:0/1689948777 wait complete. 2024-09-19T09:02:27.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.988+0000 7fd03bddc740 20 client.25990 trim_cache size 0 max 16384 2024-09-19T09:02:27.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:02:27.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:02:27.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:02:27.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:02:27.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.988+0000 7fd039047640 1 -- 172.21.15.92:0/1225530632 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd01c0a33c0 msgr2=0x7fd01c0a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:27.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.988+0000 7fd039047640 1 --2- 172.21.15.92:0/1225530632 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd01c0a33c0 0x7fd01c0a5880 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd02c00cba0 tx=0x7fd02c096f90 comp rx=0 tx=0).stop 2024-09-19T09:02:27.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.988+0000 7fd039047640 1 -- 172.21.15.92:0/1225530632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0341025f0 msgr2=0x7fd0341a15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:27.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.988+0000 7fd039047640 1 --2- 172.21.15.92:0/1225530632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0341025f0 0x7fd0341a15b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd02c00ec50 tx=0x7fd02c00c6a0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.989+0000 7fd039047640 1 -- 172.21.15.92:0/1225530632 shutdown_connections 2024-09-19T09:02:27.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.989+0000 7fd039047640 1 --2- 172.21.15.92:0/1225530632 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd01c0a33c0 0x7fd01c0a5880 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.989+0000 7fd039047640 1 --2- 172.21.15.92:0/1225530632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0341025f0 0x7fd0341a15b0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.989+0000 7fd039047640 1 --2- 172.21.15.92:0/1225530632 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd034101c30 0x7fd03419a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.989+0000 7fd039047640 1 --2- 172.21.15.92:0/1225530632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd034100a40 0x7fd03419a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:27.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.989+0000 7fd039047640 1 -- 172.21.15.92:0/1225530632 >> 172.21.15.92:0/1225530632 conn(0x7fd0340fc1e0 msgr2=0x7fd0340fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:27.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.989+0000 7fd039047640 1 -- 172.21.15.92:0/1225530632 shutdown_connections 2024-09-19T09:02:27.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:27.989+0000 7fd039047640 1 -- 172.21.15.92:0/1225530632 wait complete. 2024-09-19T09:02:28.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:27 smithi092 ceph-mon[31407]: pgmap v509: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 841 op/s 2024-09-19T09:02:29.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:29 smithi167 ceph-mon[35359]: pgmap v510: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 899 op/s 2024-09-19T09:02:29.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:29 smithi190 ceph-mon[35358]: pgmap v510: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 899 op/s 2024-09-19T09:02:30.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:29 smithi092 ceph-mon[31407]: pgmap v510: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 899 op/s 2024-09-19T09:02:30.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 345.0 s, 3513.6 tps, lat 28.295 ms stddev 31.332 2024-09-19T09:02:30.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:30 smithi167 ceph-mon[35359]: pgmap v511: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 29 MiB/s wr, 920 op/s 2024-09-19T09:02:30.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:30 smithi190 ceph-mon[35358]: pgmap v511: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 29 MiB/s wr, 920 op/s 2024-09-19T09:02:31.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:30 smithi092 ceph-mon[31407]: pgmap v511: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 29 MiB/s wr, 920 op/s 2024-09-19T09:02:33.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:33 smithi092 ceph-mon[31407]: pgmap v512: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 25 MiB/s wr, 835 op/s 2024-09-19T09:02:33.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:33 smithi167 ceph-mon[35359]: pgmap v512: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 25 MiB/s wr, 835 op/s 2024-09-19T09:02:33.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:33 smithi190 ceph-mon[35358]: pgmap v512: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 25 MiB/s wr, 835 op/s 2024-09-19T09:02:35.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:35 smithi092 ceph-mon[31407]: pgmap v513: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 27 MiB/s wr, 907 op/s 2024-09-19T09:02:35.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 350.0 s, 3357.6 tps, lat 29.943 ms stddev 45.450 2024-09-19T09:02:35.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:35 smithi167 ceph-mon[35359]: pgmap v513: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 27 MiB/s wr, 907 op/s 2024-09-19T09:02:35.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:35 smithi190 ceph-mon[35358]: pgmap v513: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 27 MiB/s wr, 907 op/s 2024-09-19T09:02:37.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:37 smithi092 ceph-mon[31407]: pgmap v514: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 MiB/s wr, 1.08k op/s 2024-09-19T09:02:37.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:37 smithi167 ceph-mon[35359]: pgmap v514: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 MiB/s wr, 1.08k op/s 2024-09-19T09:02:37.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:37 smithi190 ceph-mon[35358]: pgmap v514: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 MiB/s wr, 1.08k op/s 2024-09-19T09:02:38.276 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:02:38.661 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:39.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.222+0000 7fe48d858640 1 -- 172.21.15.92:0/3321802268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe488106f10 msgr2=0x7fe48810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:39.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.222+0000 7fe48d858640 1 --2- 172.21.15.92:0/3321802268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe488106f10 0x7fe48810ea90 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fe480009ca0 tx=0x7fe48002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.222+0000 7fe48d858640 1 -- 172.21.15.92:0/3321802268 shutdown_connections 2024-09-19T09:02:39.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.222+0000 7fe48d858640 1 --2- 172.21.15.92:0/3321802268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe488106f10 0x7fe48810ea90 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.222+0000 7fe48d858640 1 --2- 172.21.15.92:0/3321802268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe488102790 0x7fe4881067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.222+0000 7fe48d858640 1 --2- 172.21.15.92:0/3321802268 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe488101de0 0x7fe4881021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.222+0000 7fe48d858640 1 -- 172.21.15.92:0/3321802268 >> 172.21.15.92:0/3321802268 conn(0x7fe4880fd8c0 msgr2=0x7fe4880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:39.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.222+0000 7fe48d858640 1 -- 172.21.15.92:0/3321802268 shutdown_connections 2024-09-19T09:02:39.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.222+0000 7fe48d858640 1 -- 172.21.15.92:0/3321802268 wait complete. 2024-09-19T09:02:39.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.223+0000 7fe48d858640 1 Processor -- start 2024-09-19T09:02:39.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.223+0000 7fe48d858640 1 -- start start 2024-09-19T09:02:39.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.223+0000 7fe48d858640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe488101de0 0x7fe48819ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:39.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.223+0000 7fe48d858640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe488102790 0x7fe48819b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:39.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.223+0000 7fe48d858640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe488106f10 0x7fe48819eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:39.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.223+0000 7fe48d858640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe4880748d0 con 0x7fe488102790 2024-09-19T09:02:39.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.223+0000 7fe48d858640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe488074750 con 0x7fe488106f10 2024-09-19T09:02:39.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.223+0000 7fe48d858640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe488074a50 con 0x7fe488101de0 2024-09-19T09:02:39.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.224+0000 7fe4867fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe488102790 0x7fe48819b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:39.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.224+0000 7fe4867fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe488102790 0x7fe48819b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52464/0 (socket says 172.21.15.92:52464) 2024-09-19T09:02:39.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.224+0000 7fe4867fc640 1 -- 172.21.15.92:0/3583449204 learned_addr learned my addr 172.21.15.92:0/3583449204 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:39.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.224+0000 7fe486ffd640 1 --2- 172.21.15.92:0/3583449204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe488101de0 0x7fe48819ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:39.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.224+0000 7fe4877fe640 1 --2- 172.21.15.92:0/3583449204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe488106f10 0x7fe48819eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:39.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.224+0000 7fe4867fc640 1 -- 172.21.15.92:0/3583449204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe488101de0 msgr2=0x7fe48819ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:39.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.224+0000 7fe4867fc640 1 --2- 172.21.15.92:0/3583449204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe488101de0 0x7fe48819ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.224+0000 7fe4867fc640 1 -- 172.21.15.92:0/3583449204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe488106f10 msgr2=0x7fe48819eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:39.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.224+0000 7fe4867fc640 1 --2- 172.21.15.92:0/3583449204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe488106f10 0x7fe48819eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.224+0000 7fe4867fc640 1 -- 172.21.15.92:0/3583449204 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe48819f5b0 con 0x7fe488102790 2024-09-19T09:02:39.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.224+0000 7fe486ffd640 1 --2- 172.21.15.92:0/3583449204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe488101de0 0x7fe48819ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:02:39.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.225+0000 7fe4867fc640 1 --2- 172.21.15.92:0/3583449204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe488102790 0x7fe48819b340 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fe47c00e9f0 tx=0x7fe47c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:39.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.226+0000 7fe48c856640 1 -- 172.21.15.92:0/3583449204 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47c00cd80 con 0x7fe488102790 2024-09-19T09:02:39.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.226+0000 7fe48c856640 1 -- 172.21.15.92:0/3583449204 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe47c010910 con 0x7fe488102790 2024-09-19T09:02:39.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.227+0000 7fe48c856640 1 -- 172.21.15.92:0/3583449204 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47c018990 con 0x7fe488102790 2024-09-19T09:02:39.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.227+0000 7fe48d858640 1 -- 172.21.15.92:0/3583449204 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe48819f8a0 con 0x7fe488102790 2024-09-19T09:02:39.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.227+0000 7fe48d858640 1 -- 172.21.15.92:0/3583449204 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4881a7180 con 0x7fe488102790 2024-09-19T09:02:39.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.230+0000 7fe48c856640 1 -- 172.21.15.92:0/3583449204 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe47c010ac0 con 0x7fe488102790 2024-09-19T09:02:39.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.231+0000 7fe48fc31740 1 Processor -- start 2024-09-19T09:02:39.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.231+0000 7fe48fc31740 1 -- start start 2024-09-19T09:02:39.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.231+0000 7fe48fc31740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994bdaa4a0 0x55994bdaa880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:39.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.231+0000 7fe48fc31740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55994bdaadc0 0x55994bdb5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:39.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.231+0000 7fe48fc31740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55994bdb5680 0x55994bdb7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:39.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.231+0000 7fe48fc31740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55994bd102e0 con 0x55994bdb5680 2024-09-19T09:02:39.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.231+0000 7fe48fc31740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55994bcb7ce0 con 0x55994bdaa4a0 2024-09-19T09:02:39.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.231+0000 7fe48fc31740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55994bd0c2a0 con 0x55994bdaadc0 2024-09-19T09:02:39.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.231+0000 7fe486ffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55994bdaadc0 0x55994bdb5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:39.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.231+0000 7fe4867fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55994bdb5680 0x55994bdb7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:39.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.231+0000 7fe486ffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55994bdaadc0 0x55994bdb5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:50476/0 (socket says 172.21.15.92:50476) 2024-09-19T09:02:39.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.231+0000 7fe486ffd640 1 -- 172.21.15.92:0/697174726 learned_addr learned my addr 172.21.15.92:0/697174726 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:39.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.232+0000 7fe4877fe640 1 --2- 172.21.15.92:0/697174726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994bdaa4a0 0x55994bdaa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:39.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.232+0000 7fe4877fe640 1 -- 172.21.15.92:0/697174726 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55994bdaadc0 msgr2=0x55994bdb5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:39.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.232+0000 7fe4877fe640 1 --2- 172.21.15.92:0/697174726 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55994bdaadc0 0x55994bdb5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.232+0000 7fe4877fe640 1 -- 172.21.15.92:0/697174726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55994bdb5680 msgr2=0x55994bdb7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:39.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.232+0000 7fe4877fe640 1 --2- 172.21.15.92:0/697174726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55994bdb5680 0x55994bdb7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.232+0000 7fe4877fe640 1 -- 172.21.15.92:0/697174726 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55994bc9c440 con 0x55994bdaa4a0 2024-09-19T09:02:39.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.232+0000 7fe48c856640 1 --2- 172.21.15.92:0/3583449204 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe4700a3340 0x7fe4700a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:39.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.232+0000 7fe4867fc640 1 --2- 172.21.15.92:0/697174726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55994bdb5680 0x55994bdb7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:39.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.232+0000 7fe4877fe640 1 --2- 172.21.15.92:0/697174726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994bdaa4a0 0x55994bdaa880 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe480005e30 tx=0x7fe48002f3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70582bc597e4732 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:39.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.232+0000 7fe4877fe640 1 --2- 172.21.15.92:0/3583449204 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe4700a3340 0x7fe4700a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:39.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.232+0000 7fe46dffb640 1 -- 172.21.15.92:0/697174726 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe48004a040 con 0x55994bdaa4a0 2024-09-19T09:02:39.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.232+0000 7fe46dffb640 1 -- 172.21.15.92:0/697174726 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe480036030 con 0x55994bdaa4a0 2024-09-19T09:02:39.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.232+0000 7fe46dffb640 1 -- 172.21.15.92:0/697174726 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe480004310 con 0x55994bdaa4a0 2024-09-19T09:02:39.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.232+0000 7fe48c856640 1 -- 172.21.15.92:0/3583449204 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe47c0cfb20 con 0x7fe488102790 2024-09-19T09:02:39.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.233+0000 7fe4877fe640 1 --2- 172.21.15.92:0/3583449204 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe4700a3340 0x7fe4700a5800 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe480004af0 tx=0x7fe48002f660 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:39.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.233+0000 7fe48fc31740 1 -- 172.21.15.92:0/697174726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994bdaa4a0 msgr2=0x55994bdaa880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:39.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.233+0000 7fe48fc31740 1 --2- 172.21.15.92:0/697174726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994bdaa4a0 0x55994bdaa880 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe480005e30 tx=0x7fe48002f3c0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.234+0000 7fe48fc31740 1 -- 172.21.15.92:0/697174726 shutdown_connections 2024-09-19T09:02:39.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.234+0000 7fe48fc31740 1 --2- 172.21.15.92:0/697174726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55994bdb5680 0x55994bdb7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.234+0000 7fe48fc31740 1 --2- 172.21.15.92:0/697174726 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55994bdaadc0 0x55994bdb5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.234+0000 7fe48fc31740 1 --2- 172.21.15.92:0/697174726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994bdaa4a0 0x55994bdaa880 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.234+0000 7fe48fc31740 1 -- 172.21.15.92:0/697174726 >> 172.21.15.92:0/697174726 conn(0x55994bda6a30 msgr2=0x55994bda6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:39.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.234+0000 7fe48fc31740 1 -- 172.21.15.92:0/697174726 shutdown_connections 2024-09-19T09:02:39.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.234+0000 7fe48fc31740 1 -- 172.21.15.92:0/697174726 wait complete. 2024-09-19T09:02:39.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.234+0000 7fe48fc31740 1 -- start start 2024-09-19T09:02:39.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.234+0000 7fe48fc31740 1 Processor -- start 2024-09-19T09:02:39.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.235+0000 7fe48fc31740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55994bdaa4a0 0x55994bdb4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:39.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.235+0000 7fe48fc31740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994bdaadc0 0x55994bdb21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:39.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.235+0000 7fe48fc31740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55994bdb5680 0x55994bdb26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:39.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.235+0000 7fe48fc31740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55994bdb80d0 con 0x55994bdb5680 2024-09-19T09:02:39.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.235+0000 7fe48fc31740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55994bccb050 con 0x55994bdaadc0 2024-09-19T09:02:39.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.235+0000 7fe486ffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55994bdaa4a0 0x55994bdb4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:39.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.235+0000 7fe4877fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55994bdb5680 0x55994bdb26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:39.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.235+0000 7fe486ffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55994bdaa4a0 0x55994bdb4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:50490/0 (socket says 172.21.15.92:50490) 2024-09-19T09:02:39.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.235+0000 7fe486ffd640 1 -- 172.21.15.92:0/1952944799 learned_addr learned my addr 172.21.15.92:0/1952944799 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:39.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.235+0000 7fe4867fc640 1 --2- 172.21.15.92:0/1952944799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994bdaadc0 0x55994bdb21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:39.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.235+0000 7fe48fc31740 1 -- 172.21.15.92:0/1952944799 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55994bdb8250 con 0x55994bdaa4a0 2024-09-19T09:02:39.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.236+0000 7fe48fc31740 10 client.0 _ll_register_callbacks cb 0x55994bd0b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:39.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.236+0000 7fe4877fe640 1 -- 172.21.15.92:0/1952944799 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55994bdaa4a0 msgr2=0x55994bdb4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:39.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.236+0000 7fe4877fe640 1 --2- 172.21.15.92:0/1952944799 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55994bdaa4a0 0x55994bdb4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.236+0000 7fe4877fe640 1 -- 172.21.15.92:0/1952944799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994bdaadc0 msgr2=0x55994bdb21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:39.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.236+0000 7fe4877fe640 1 --2- 172.21.15.92:0/1952944799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994bdaadc0 0x55994bdb21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.236+0000 7fe4877fe640 1 -- 172.21.15.92:0/1952944799 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55994ba813c0 con 0x55994bdb5680 2024-09-19T09:02:39.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.236+0000 7fe486ffd640 1 --2- 172.21.15.92:0/1952944799 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55994bdaa4a0 0x55994bdb4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:39.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.236+0000 7fe4867fc640 1 --2- 172.21.15.92:0/1952944799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994bdaadc0 0x55994bdb21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:39.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.236+0000 7fe4877fe640 1 --2- 172.21.15.92:0/1952944799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55994bdb5680 0x55994bdb26f0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fe480006010 tx=0x7fe480043000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d973d1af1fee7ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:39.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.236+0000 7fe466ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:02:39.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.236+0000 7fe466ffd640 1 -- 172.21.15.92:0/1952944799 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe48005e020 con 0x55994bdb5680 2024-09-19T09:02:39.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.236+0000 7fe466ffd640 1 -- 172.21.15.92:0/1952944799 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe4800040b0 con 0x55994bdb5680 2024-09-19T09:02:39.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.236+0000 7fe48fc31740 1 -- 172.21.15.92:0/1952944799 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe480036030 con 0x55994bdb5680 2024-09-19T09:02:39.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.237+0000 7fe466ffd640 1 -- 172.21.15.92:0/1952944799 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe480056040 con 0x55994bdb5680 2024-09-19T09:02:39.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.237+0000 7fe48fc31740 10 client.16689 fetch_fsmap learned FSMap version 19 2024-09-19T09:02:39.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.237+0000 7fe48fc31740 1 -- 172.21.15.92:0/1952944799 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55994bdb80d0 con 0x55994bdb5680 2024-09-19T09:02:39.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.238+0000 7fe466ffd640 1 -- 172.21.15.92:0/1952944799 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe480036030 con 0x55994bdb5680 2024-09-19T09:02:39.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.238+0000 7fe466ffd640 1 -- 172.21.15.92:0/1952944799 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe480059030 con 0x55994bdb5680 2024-09-19T09:02:39.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.238+0000 7fe48fc31740 10 client.16689 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:02:39.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.238+0000 7fe48fc31740 10 client.16689 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:02:39.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.238+0000 7fe48fc31740 20 client.16689 populate_metadata read hostname 'smithi092' 2024-09-19T09:02:39.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.238+0000 7fe48fc31740 1 --2- 172.21.15.92:0/1952944799 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55994bdc4c00 0x55994bdc7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:39.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.238+0000 7fe48fc31740 4 client.16689 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:02:39.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.238+0000 7fe48fc31740 1 -- 172.21.15.92:0/1952944799 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55994bd1d850 con 0x55994bdc4c00 2024-09-19T09:02:39.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.238+0000 7fe486ffd640 1 --2- 172.21.15.92:0/1952944799 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55994bdc4c00 0x55994bdc7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:39.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.239+0000 7fe486ffd640 1 --2- 172.21.15.92:0/1952944799 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55994bdc4c00 0x55994bdc7050 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b948df4bd972ed4 server_cookie=dc0126f32f474f0c in_seq=0 out_seq=0 2024-09-19T09:02:39.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.239+0000 7fe466ffd640 10 client.16689 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:39.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.240+0000 7fe466ffd640 1 -- 172.21.15.92:0/1952944799 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55994bd1d850 con 0x55994bdc4c00 2024-09-19T09:02:39.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.240+0000 7fe466ffd640 10 client.16689 handle_command_reply: tid=0 2024-09-19T09:02:39.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.240+0000 7fe48fc31740 1 client.16689 shutdown 2024-09-19T09:02:39.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.240+0000 7fe48fc31740 1 -- 172.21.15.92:0/1952944799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55994bdb5680 msgr2=0x55994bdb26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:39.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.240+0000 7fe48fc31740 1 --2- 172.21.15.92:0/1952944799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55994bdb5680 0x55994bdb26f0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fe480006010 tx=0x7fe480043000 comp rx=0 tx=0).stop 2024-09-19T09:02:39.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.240+0000 7fe48fc31740 1 -- 172.21.15.92:0/1952944799 shutdown_connections 2024-09-19T09:02:39.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.240+0000 7fe48fc31740 1 --2- 172.21.15.92:0/1952944799 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55994bdc4c00 0x55994bdc7050 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.240+0000 7fe466ffd640 0 client.16689 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:39.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.240+0000 7fe48fc31740 1 --2- 172.21.15.92:0/1952944799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55994bdb5680 0x55994bdb26f0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.240+0000 7fe48fc31740 1 --2- 172.21.15.92:0/1952944799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994bdaadc0 0x55994bdb21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.240+0000 7fe48fc31740 1 --2- 172.21.15.92:0/1952944799 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55994bdaa4a0 0x55994bdb4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.240+0000 7fe48fc31740 1 -- 172.21.15.92:0/1952944799 >> 172.21.15.92:0/1952944799 conn(0x55994bda6a30 msgr2=0x55994bdac760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:39.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.240+0000 7fe48fc31740 1 -- 172.21.15.92:0/1952944799 shutdown_connections 2024-09-19T09:02:39.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.240+0000 7fe48fc31740 1 -- 172.21.15.92:0/1952944799 wait complete. 2024-09-19T09:02:39.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.240+0000 7fe48fc31740 20 client.16689 trim_cache size 0 max 16384 2024-09-19T09:02:39.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.268+0000 7fe48fc31740 1 Processor -- start 2024-09-19T09:02:39.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.268+0000 7fe48fc31740 1 -- start start 2024-09-19T09:02:39.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.269+0000 7fe48fc31740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55994bdaa4a0 0x55994bda6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:39.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.269+0000 7fe48fc31740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994bdaadc0 0x55994bdb4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:39.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.269+0000 7fe48fc31740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55994bdb5680 0x55994bdcc920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:39.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.269+0000 7fe48fc31740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe4881ad6d0 con 0x55994bdaa4a0 2024-09-19T09:02:39.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.269+0000 7fe48fc31740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe4881aff70 con 0x55994bdaadc0 2024-09-19T09:02:39.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.269+0000 7fe48fc31740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe4881add60 con 0x55994bdb5680 2024-09-19T09:02:39.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.269+0000 7fe4867fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994bdaadc0 0x55994bdb4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:39.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.269+0000 7fe4867fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994bdaadc0 0x55994bdb4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:54978/0 (socket says 172.21.15.92:54978) 2024-09-19T09:02:39.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.269+0000 7fe4867fc640 1 -- 172.21.15.92:0/1167967986 learned_addr learned my addr 172.21.15.92:0/1167967986 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:39.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.269+0000 7fe486ffd640 1 --2- 172.21.15.92:0/1167967986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55994bdaa4a0 0x55994bda6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:39.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.269+0000 7fe4877fe640 1 --2- 172.21.15.92:0/1167967986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55994bdb5680 0x55994bdcc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:39.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.270+0000 7fe4867fc640 1 -- 172.21.15.92:0/1167967986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55994bdb5680 msgr2=0x55994bdcc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:39.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.270+0000 7fe4867fc640 1 --2- 172.21.15.92:0/1167967986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55994bdb5680 0x55994bdcc920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.270+0000 7fe4867fc640 1 -- 172.21.15.92:0/1167967986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55994bdaa4a0 msgr2=0x55994bda6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:39.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.270+0000 7fe4867fc640 1 --2- 172.21.15.92:0/1167967986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55994bdaa4a0 0x55994bda6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.270+0000 7fe4867fc640 1 -- 172.21.15.92:0/1167967986 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55994bdb5270 con 0x55994bdaadc0 2024-09-19T09:02:39.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.271+0000 7fe4867fc640 1 --2- 172.21.15.92:0/1167967986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994bdaadc0 0x55994bdb4120 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe47c09c140 tx=0x7fe47c000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a532fdc1d89a1513 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:39.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.272+0000 7fe46d7fa640 1 -- 172.21.15.92:0/1167967986 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47c0a04b0 con 0x55994bdaadc0 2024-09-19T09:02:39.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.272+0000 7fe46d7fa640 1 -- 172.21.15.92:0/1167967986 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe47c0d3010 con 0x55994bdaadc0 2024-09-19T09:02:39.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.272+0000 7fe46d7fa640 1 -- 172.21.15.92:0/1167967986 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47c018b30 con 0x55994bdaadc0 2024-09-19T09:02:39.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.273+0000 7fe48fc31740 1 -- 172.21.15.92:0/1167967986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994bdaadc0 msgr2=0x55994bdb4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:39.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.273+0000 7fe48fc31740 1 --2- 172.21.15.92:0/1167967986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994bdaadc0 0x55994bdb4120 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe47c09c140 tx=0x7fe47c000bc0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.273+0000 7fe48fc31740 1 -- 172.21.15.92:0/1167967986 shutdown_connections 2024-09-19T09:02:39.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.273+0000 7fe48fc31740 1 --2- 172.21.15.92:0/1167967986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55994bdb5680 0x55994bdcc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.273+0000 7fe48fc31740 1 --2- 172.21.15.92:0/1167967986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994bdaadc0 0x55994bdb4120 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.273+0000 7fe48fc31740 1 --2- 172.21.15.92:0/1167967986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55994bdaa4a0 0x55994bda6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.273+0000 7fe48fc31740 1 -- 172.21.15.92:0/1167967986 >> 172.21.15.92:0/1167967986 conn(0x55994bda6a30 msgr2=0x55994bdb3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:39.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.273+0000 7fe48fc31740 1 -- 172.21.15.92:0/1167967986 shutdown_connections 2024-09-19T09:02:39.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.273+0000 7fe48fc31740 1 -- 172.21.15.92:0/1167967986 wait complete. 2024-09-19T09:02:39.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.274+0000 7fe48fc31740 1 -- start start 2024-09-19T09:02:39.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.274+0000 7fe48fc31740 1 Processor -- start 2024-09-19T09:02:39.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.274+0000 7fe48fc31740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55994bdaa4a0 0x55994bdbda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:39.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.274+0000 7fe48fc31740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55994bdaadc0 0x55994bdbadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:39.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.274+0000 7fe48fc31740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994bdb5680 0x55994bdbb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:39.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.274+0000 7fe4867fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55994bdaadc0 0x55994bdbadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:39.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.275+0000 7fe4867fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55994bdaadc0 0x55994bdbadb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52502/0 (socket says 172.21.15.92:52502) 2024-09-19T09:02:39.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.275+0000 7fe4867fc640 1 -- 172.21.15.92:0/3906188657 learned_addr learned my addr 172.21.15.92:0/3906188657 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:39.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.275+0000 7fe48fc31740 1 -- 172.21.15.92:0/3906188657 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe4881ae430 con 0x55994bdaadc0 2024-09-19T09:02:39.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.275+0000 7fe48fc31740 1 -- 172.21.15.92:0/3906188657 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe4881af8a0 con 0x55994bdb5680 2024-09-19T09:02:39.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.275+0000 7fe48fc31740 1 -- 172.21.15.92:0/3906188657 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe4881aeb00 con 0x55994bdaa4a0 2024-09-19T09:02:39.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.275+0000 7fe48fc31740 10 client.0 _ll_register_callbacks cb 0x7fe47800bb20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:39.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.275+0000 7fe486ffd640 1 --2- 172.21.15.92:0/3906188657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55994bdaa4a0 0x55994bdbda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:39.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.275+0000 7fe4867fc640 1 -- 172.21.15.92:0/3906188657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55994bdaa4a0 msgr2=0x55994bdbda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:39.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.275+0000 7fe4867fc640 1 --2- 172.21.15.92:0/3906188657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55994bdaa4a0 0x55994bdbda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.275+0000 7fe4867fc640 1 -- 172.21.15.92:0/3906188657 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994bdb5680 msgr2=0x55994bdbb2f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:02:39.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.275+0000 7fe4867fc640 1 --2- 172.21.15.92:0/3906188657 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994bdb5680 0x55994bdbb2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.275+0000 7fe4867fc640 1 -- 172.21.15.92:0/3906188657 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55994bdbb960 con 0x55994bdaadc0 2024-09-19T09:02:39.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.275+0000 7fe4867fc640 1 --2- 172.21.15.92:0/3906188657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55994bdaadc0 0x55994bdbadb0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fe47c0cfe50 tx=0x7fe47c0a04b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e5518140fec36aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:39.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.275+0000 7fe466ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:02:39.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.275+0000 7fe466ffd640 1 -- 172.21.15.92:0/3906188657 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47c0b5060 con 0x55994bdaadc0 2024-09-19T09:02:39.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.275+0000 7fe466ffd640 1 -- 172.21.15.92:0/3906188657 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe47c0a00d0 con 0x55994bdaadc0 2024-09-19T09:02:39.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.275+0000 7fe48fc31740 1 -- 172.21.15.92:0/3906188657 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55994bd17d60 con 0x55994bdaadc0 2024-09-19T09:02:39.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.276+0000 7fe466ffd640 1 -- 172.21.15.92:0/3906188657 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe47c018b30 con 0x55994bdaadc0 2024-09-19T09:02:39.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.276+0000 7fe48fc31740 10 client.16695 fetch_fsmap learned FSMap version 19 2024-09-19T09:02:39.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.276+0000 7fe48fc31740 1 -- 172.21.15.92:0/3906188657 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55994be37f90 con 0x55994bdaadc0 2024-09-19T09:02:39.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.276+0000 7fe466ffd640 1 -- 172.21.15.92:0/3906188657 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55994bd17d60 con 0x55994bdaadc0 2024-09-19T09:02:39.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.276+0000 7fe466ffd640 1 -- 172.21.15.92:0/3906188657 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe47c097f00 con 0x55994bdaadc0 2024-09-19T09:02:39.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.276+0000 7fe48fc31740 10 client.16695 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:02:39.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.276+0000 7fe48fc31740 10 client.16695 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:02:39.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.276+0000 7fe48fc31740 20 client.16695 populate_metadata read hostname 'smithi092' 2024-09-19T09:02:39.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.276+0000 7fe48fc31740 1 --2- 172.21.15.92:0/3906188657 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55994bdc4c00 0x55994be3a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:39.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.276+0000 7fe48fc31740 4 client.16695 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:02:39.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.276+0000 7fe48fc31740 1 -- 172.21.15.92:0/3906188657 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55994bc94210 con 0x55994bdc4c00 2024-09-19T09:02:39.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.276+0000 7fe486ffd640 1 --2- 172.21.15.92:0/3906188657 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55994bdc4c00 0x55994be3a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:39.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.279+0000 7fe486ffd640 1 --2- 172.21.15.92:0/3906188657 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55994bdc4c00 0x55994be3a690 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dacffdefaf16324 server_cookie=75090e98f7184385 in_seq=0 out_seq=0 2024-09-19T09:02:39.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.279+0000 7fe466ffd640 10 client.16695 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:39.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.279+0000 7fe466ffd640 1 -- 172.21.15.92:0/3906188657 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55994bc94210 con 0x55994bdc4c00 2024-09-19T09:02:39.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.279+0000 7fe466ffd640 10 client.16695 handle_command_reply: tid=0 2024-09-19T09:02:39.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.279+0000 7fe48fc31740 1 client.16695 shutdown 2024-09-19T09:02:39.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.280+0000 7fe48fc31740 1 -- 172.21.15.92:0/3906188657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55994bdaadc0 msgr2=0x55994bdbadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:39.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.280+0000 7fe48fc31740 1 --2- 172.21.15.92:0/3906188657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55994bdaadc0 0x55994bdbadb0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fe47c0cfe50 tx=0x7fe47c0a04b0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.280+0000 7fe48fc31740 1 -- 172.21.15.92:0/3906188657 shutdown_connections 2024-09-19T09:02:39.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.280+0000 7fe48fc31740 1 --2- 172.21.15.92:0/3906188657 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55994bdc4c00 0x55994be3a690 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.280+0000 7fe466ffd640 0 client.16695 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:39.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.280+0000 7fe48fc31740 1 --2- 172.21.15.92:0/3906188657 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55994bdb5680 0x55994bdbb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.280+0000 7fe48fc31740 1 --2- 172.21.15.92:0/3906188657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55994bdaadc0 0x55994bdbadb0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.280+0000 7fe48fc31740 1 --2- 172.21.15.92:0/3906188657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55994bdaa4a0 0x55994bdbda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.280+0000 7fe48fc31740 1 -- 172.21.15.92:0/3906188657 >> 172.21.15.92:0/3906188657 conn(0x55994bda6a30 msgr2=0x55994bdb4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:39.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.280+0000 7fe48fc31740 1 -- 172.21.15.92:0/3906188657 shutdown_connections 2024-09-19T09:02:39.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.280+0000 7fe48fc31740 1 -- 172.21.15.92:0/3906188657 wait complete. 2024-09-19T09:02:39.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.280+0000 7fe48fc31740 20 client.16695 trim_cache size 0 max 16384 2024-09-19T09:02:39.283 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:02:39.283 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-19T09:02:39.284 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {} 2024-09-19T09:02:39.284 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:02:39.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.281+0000 7fe48d858640 1 -- 172.21.15.92:0/3583449204 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe4700a3340 msgr2=0x7fe4700a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:39.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.281+0000 7fe48d858640 1 --2- 172.21.15.92:0/3583449204 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe4700a3340 0x7fe4700a5800 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe480004af0 tx=0x7fe48002f660 comp rx=0 tx=0).stop 2024-09-19T09:02:39.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.281+0000 7fe48d858640 1 -- 172.21.15.92:0/3583449204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe488102790 msgr2=0x7fe48819b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:39.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.281+0000 7fe48d858640 1 --2- 172.21.15.92:0/3583449204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe488102790 0x7fe48819b340 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fe47c00e9f0 tx=0x7fe47c00eeb0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.281+0000 7fe48d858640 1 -- 172.21.15.92:0/3583449204 shutdown_connections 2024-09-19T09:02:39.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.281+0000 7fe48d858640 1 --2- 172.21.15.92:0/3583449204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe488106f10 0x7fe48819eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.281+0000 7fe48d858640 1 --2- 172.21.15.92:0/3583449204 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe4700a3340 0x7fe4700a5800 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.281+0000 7fe48d858640 1 --2- 172.21.15.92:0/3583449204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe488102790 0x7fe48819b340 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.281+0000 7fe48d858640 1 --2- 172.21.15.92:0/3583449204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe488101de0 0x7fe48819ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.281+0000 7fe48d858640 1 -- 172.21.15.92:0/3583449204 >> 172.21.15.92:0/3583449204 conn(0x7fe4880fd8c0 msgr2=0x7fe4881057c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:39.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.281+0000 7fe48d858640 1 -- 172.21.15.92:0/3583449204 shutdown_connections 2024-09-19T09:02:39.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:39.281+0000 7fe48d858640 1 -- 172.21.15.92:0/3583449204 wait complete. 2024-09-19T09:02:39.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:39 smithi092 ceph-mon[31407]: pgmap v515: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 45 MiB/s wr, 1.36k op/s 2024-09-19T09:02:39.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:39 smithi167 ceph-mon[35359]: pgmap v515: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 45 MiB/s wr, 1.36k op/s 2024-09-19T09:02:39.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:39 smithi190 ceph-mon[35358]: pgmap v515: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 45 MiB/s wr, 1.36k op/s 2024-09-19T09:02:39.972 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:02:39.972 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:02:40.372 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:40.795 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 355.0 s, 3272.6 tps, lat 30.582 ms stddev 34.082 2024-09-19T09:02:40.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.939+0000 7f0c5049b640 1 -- 172.21.15.92:0/1576624474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c481049a0 msgr2=0x7f0c481089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:40.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.939+0000 7f0c5049b640 1 --2- 172.21.15.92:0/1576624474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c481049a0 0x7f0c481089f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f0c38009900 tx=0x7f0c3802a410 comp rx=0 tx=0).stop 2024-09-19T09:02:40.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.939+0000 7f0c5049b640 1 -- 172.21.15.92:0/1576624474 shutdown_connections 2024-09-19T09:02:40.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.939+0000 7f0c5049b640 1 --2- 172.21.15.92:0/1576624474 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c48109120 0x7f0c48110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.939+0000 7f0c5049b640 1 --2- 172.21.15.92:0/1576624474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c481049a0 0x7f0c481089f0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.939+0000 7f0c5049b640 1 --2- 172.21.15.92:0/1576624474 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c48103ff0 0x7f0c481043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.939+0000 7f0c5049b640 1 -- 172.21.15.92:0/1576624474 >> 172.21.15.92:0/1576624474 conn(0x7f0c480ffa70 msgr2=0x7f0c48101e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:40.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.939+0000 7f0c5049b640 1 -- 172.21.15.92:0/1576624474 shutdown_connections 2024-09-19T09:02:40.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.939+0000 7f0c5049b640 1 -- 172.21.15.92:0/1576624474 wait complete. 2024-09-19T09:02:40.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.940+0000 7f0c5049b640 1 Processor -- start 2024-09-19T09:02:40.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.940+0000 7f0c5049b640 1 -- start start 2024-09-19T09:02:40.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.940+0000 7f0c5049b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c48103ff0 0x7f0c48073b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:40.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.940+0000 7f0c5049b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c481049a0 0x7f0c4806dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:40.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.940+0000 7f0c5049b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c48109120 0x7f0c4806e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:40.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.940+0000 7f0c5049b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4806c660 con 0x7f0c48103ff0 2024-09-19T09:02:40.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.940+0000 7f0c5049b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4806c4e0 con 0x7f0c481049a0 2024-09-19T09:02:40.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.940+0000 7f0c5049b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4806c7e0 con 0x7f0c48109120 2024-09-19T09:02:40.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.940+0000 7f0c4e237640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c48103ff0 0x7f0c48073b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:40.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.940+0000 7f0c4da36640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c481049a0 0x7f0c4806dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:40.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.940+0000 7f0c4e237640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c48103ff0 0x7f0c48073b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52518/0 (socket says 172.21.15.92:52518) 2024-09-19T09:02:40.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.941+0000 7f0c4e237640 1 -- 172.21.15.92:0/838654261 learned_addr learned my addr 172.21.15.92:0/838654261 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:40.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.941+0000 7f0c4da36640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c481049a0 0x7f0c4806dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:55014/0 (socket says 172.21.15.92:55014) 2024-09-19T09:02:40.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.941+0000 7f0c4ea38640 1 --2- 172.21.15.92:0/838654261 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c48109120 0x7f0c4806e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:40.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.941+0000 7f0c4da36640 1 -- 172.21.15.92:0/838654261 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c48109120 msgr2=0x7f0c4806e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:40.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.941+0000 7f0c4da36640 1 --2- 172.21.15.92:0/838654261 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c48109120 0x7f0c4806e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.941+0000 7f0c4da36640 1 -- 172.21.15.92:0/838654261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c48103ff0 msgr2=0x7f0c48073b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:40.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.941+0000 7f0c4da36640 1 --2- 172.21.15.92:0/838654261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c48103ff0 0x7f0c48073b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.941+0000 7f0c4da36640 1 -- 172.21.15.92:0/838654261 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c4807a860 con 0x7f0c481049a0 2024-09-19T09:02:40.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.941+0000 7f0c4e237640 1 --2- 172.21.15.92:0/838654261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c48103ff0 0x7f0c48073b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:02:40.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.941+0000 7f0c4da36640 1 --2- 172.21.15.92:0/838654261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c481049a0 0x7f0c4806dc10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0c3802aa00 tx=0x7f0c38003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:40.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.942+0000 7f0c3f7fe640 1 -- 172.21.15.92:0/838654261 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3803f070 con 0x7f0c481049a0 2024-09-19T09:02:40.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.942+0000 7f0c3f7fe640 1 -- 172.21.15.92:0/838654261 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c38031c90 con 0x7f0c481049a0 2024-09-19T09:02:40.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.942+0000 7f0c3f7fe640 1 -- 172.21.15.92:0/838654261 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c38035030 con 0x7f0c481049a0 2024-09-19T09:02:40.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.942+0000 7f0c5049b640 1 -- 172.21.15.92:0/838654261 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c4806e750 con 0x7f0c481049a0 2024-09-19T09:02:40.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.942+0000 7f0c5049b640 1 -- 172.21.15.92:0/838654261 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c481a9460 con 0x7f0c481049a0 2024-09-19T09:02:40.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.945+0000 7f0c5049b640 1 -- 172.21.15.92:0/838654261 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c481054d0 con 0x7f0c481049a0 2024-09-19T09:02:40.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.945+0000 7f0c3f7fe640 1 -- 172.21.15.92:0/838654261 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0c38042070 con 0x7f0c481049a0 2024-09-19T09:02:40.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.946+0000 7f0c3f7fe640 1 --2- 172.21.15.92:0/838654261 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f0c340a3380 0x7f0c340a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:40.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.946+0000 7f0c3f7fe640 1 -- 172.21.15.92:0/838654261 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f0c380efbd0 con 0x7f0c481049a0 2024-09-19T09:02:40.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.947+0000 7f0c4e237640 1 --2- 172.21.15.92:0/838654261 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f0c340a3380 0x7f0c340a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:40.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.948+0000 7f0c4e237640 1 --2- 172.21.15.92:0/838654261 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f0c340a3380 0x7f0c340a5840 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0c44011550 tx=0x7f0c44005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:40.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:40.951+0000 7f0c3f7fe640 1 -- 172.21.15.92:0/838654261 <== mon.2 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0c4807a860 con 0x7f0c481049a0 2024-09-19T09:02:41.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.122+0000 7fc6f61d8640 1 -- 172.21.15.92:0/2537231582 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6f01056b0 msgr2=0x7fc6f0105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:41.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.122+0000 7fc6f61d8640 1 --2- 172.21.15.92:0/2537231582 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6f01056b0 0x7fc6f0105b60 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8009ca0 tx=0x7fc6e802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.122+0000 7fc6f61d8640 1 -- 172.21.15.92:0/2537231582 shutdown_connections 2024-09-19T09:02:41.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.122+0000 7fc6f61d8640 1 --2- 172.21.15.92:0/2537231582 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6f01056b0 0x7fc6f0105b60 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.122+0000 7fc6f61d8640 1 --2- 172.21.15.92:0/2537231582 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc6f0102d00 0x7fc6f0105170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.122+0000 7fc6f61d8640 1 --2- 172.21.15.92:0/2537231582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6f01003b0 0x7fc6f01027c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.122+0000 7fc6f61d8640 1 -- 172.21.15.92:0/2537231582 >> 172.21.15.92:0/2537231582 conn(0x7fc6f00fc1e0 msgr2=0x7fc6f00fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:41.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.122+0000 7fc6f61d8640 1 -- 172.21.15.92:0/2537231582 shutdown_connections 2024-09-19T09:02:41.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.122+0000 7fc6f61d8640 1 -- 172.21.15.92:0/2537231582 wait complete. 2024-09-19T09:02:41.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.123+0000 7fc6f61d8640 1 Processor -- start 2024-09-19T09:02:41.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.123+0000 7fc6f61d8640 1 -- start start 2024-09-19T09:02:41.125 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.123+0000 7fc6f61d8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6f01003b0 0x7fc6f019e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:41.125 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.124+0000 7fc6f61d8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc6f0102d00 0x7fc6f019e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:41.125 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.124+0000 7fc6f61d8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6f01056b0 0x7fc6f01a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:41.125 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.124+0000 7fc6f61d8640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f0113df0 con 0x7fc6f01003b0 2024-09-19T09:02:41.125 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.124+0000 7fc6f61d8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f0113c70 con 0x7fc6f01056b0 2024-09-19T09:02:41.125 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.124+0000 7fc6f61d8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f0113f70 con 0x7fc6f0102d00 2024-09-19T09:02:41.125 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.124+0000 7fc6ef7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6f01003b0 0x7fc6f019e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:41.126 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.124+0000 7fc6effff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6f01056b0 0x7fc6f01a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:41.126 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.124+0000 7fc6ef7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6f01003b0 0x7fc6f019e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52536/0 (socket says 172.21.15.92:52536) 2024-09-19T09:02:41.126 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.124+0000 7fc6ef7fe640 1 -- 172.21.15.92:0/339960363 learned_addr learned my addr 172.21.15.92:0/339960363 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:41.126 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.124+0000 7fc6effff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6f01056b0 0x7fc6f01a58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:55032/0 (socket says 172.21.15.92:55032) 2024-09-19T09:02:41.126 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.124+0000 7fc6e6ffd640 1 --2- 172.21.15.92:0/339960363 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc6f0102d00 0x7fc6f019e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:41.126 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.124+0000 7fc6ef7fe640 1 -- 172.21.15.92:0/339960363 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc6f0102d00 msgr2=0x7fc6f019e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:41.126 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.124+0000 7fc6ef7fe640 1 --2- 172.21.15.92:0/339960363 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc6f0102d00 0x7fc6f019e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.126 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.124+0000 7fc6ef7fe640 1 -- 172.21.15.92:0/339960363 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6f01056b0 msgr2=0x7fc6f01a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:41.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.124+0000 7fc6ef7fe640 1 --2- 172.21.15.92:0/339960363 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6f01056b0 0x7fc6f01a58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.124+0000 7fc6ef7fe640 1 -- 172.21.15.92:0/339960363 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f01a5f50 con 0x7fc6f01003b0 2024-09-19T09:02:41.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.125+0000 7fc6ef7fe640 1 --2- 172.21.15.92:0/339960363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6f01003b0 0x7fc6f019e330 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fc6e000ea60 tx=0x7fc6e000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:41.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.126+0000 7fc6ed7fa640 1 -- 172.21.15.92:0/339960363 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e000cde0 con 0x7fc6f01003b0 2024-09-19T09:02:41.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.126+0000 7fc6ed7fa640 1 -- 172.21.15.92:0/339960363 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6e00035f0 con 0x7fc6f01003b0 2024-09-19T09:02:41.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.126+0000 7fc6ed7fa640 1 -- 172.21.15.92:0/339960363 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0010670 con 0x7fc6f01003b0 2024-09-19T09:02:41.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.126+0000 7fc6f61d8640 1 -- 172.21.15.92:0/339960363 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6f01a6240 con 0x7fc6f01003b0 2024-09-19T09:02:41.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.126+0000 7fc6f61d8640 1 -- 172.21.15.92:0/339960363 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6f01a66e0 con 0x7fc6f01003b0 2024-09-19T09:02:41.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.131+0000 7fc6ed7fa640 1 -- 172.21.15.92:0/339960363 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc6e00037a0 con 0x7fc6f01003b0 2024-09-19T09:02:41.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.132+0000 7fc6f904b740 1 Processor -- start 2024-09-19T09:02:41.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.132+0000 7fc6ed7fa640 1 --2- 172.21.15.92:0/339960363 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc6dc0a34e0 0x7fc6dc0a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:41.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.132+0000 7fc6ed7fa640 1 -- 172.21.15.92:0/339960363 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc6e00cfb40 con 0x7fc6f01003b0 2024-09-19T09:02:41.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.132+0000 7fc6f904b740 1 -- start start 2024-09-19T09:02:41.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.133+0000 7fc6f904b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e600cc69a0 0x55e600cc6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:41.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.133+0000 7fc6f904b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e600cc72e0 0x55e600ccbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:41.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.133+0000 7fc6f904b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e600ccc370 0x55e600cce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:41.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.133+0000 7fc6f904b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e600c2a2f0 con 0x55e600cc72e0 2024-09-19T09:02:41.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.133+0000 7fc6f904b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e600bd2270 con 0x55e600cc69a0 2024-09-19T09:02:41.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.133+0000 7fc6f904b740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e600c262b0 con 0x55e600ccc370 2024-09-19T09:02:41.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.133+0000 7fc6effff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e600ccc370 0x55e600cce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:41.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.133+0000 7fc6ef7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e600cc69a0 0x55e600cc6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:41.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.133+0000 7fc6ef7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e600cc69a0 0x55e600cc6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:55044/0 (socket says 172.21.15.92:55044) 2024-09-19T09:02:41.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.133+0000 7fc6ef7fe640 1 -- 172.21.15.92:0/4016168417 learned_addr learned my addr 172.21.15.92:0/4016168417 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:41.138 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.134+0000 7fc6e6ffd640 1 --2- 172.21.15.92:0/4016168417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e600cc72e0 0x55e600ccbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:41.138 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.134+0000 7fc6effff640 1 --2- 172.21.15.92:0/339960363 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc6dc0a34e0 0x7fc6dc0a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:41.138 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.134+0000 7fc6ef7fe640 1 -- 172.21.15.92:0/4016168417 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e600ccc370 msgr2=0x55e600cce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:41.138 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.134+0000 7fc6ef7fe640 1 --2- 172.21.15.92:0/4016168417 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e600ccc370 0x55e600cce830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.138 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.134+0000 7fc6ef7fe640 1 -- 172.21.15.92:0/4016168417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e600cc72e0 msgr2=0x55e600ccbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:41.138 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.134+0000 7fc6ef7fe640 1 --2- 172.21.15.92:0/4016168417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e600cc72e0 0x55e600ccbda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.138 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.134+0000 7fc6ef7fe640 1 -- 172.21.15.92:0/4016168417 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e600bd1340 con 0x55e600cc69a0 2024-09-19T09:02:41.138 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.134+0000 7fc6e6ffd640 1 --2- 172.21.15.92:0/4016168417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e600cc72e0 0x55e600ccbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:02:41.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.135+0000 7fc6ef7fe640 1 --2- 172.21.15.92:0/4016168417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e600cc69a0 0x55e600cc6da0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc6e00a4860 tx=0x7fc6e009bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a18350f4e285c87 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:41.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.135+0000 7fc6effff640 1 --2- 172.21.15.92:0/339960363 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc6dc0a34e0 0x7fc6dc0a59a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8005cc0 tx=0x7fc6e802a8c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:41.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.135+0000 7fc6e5ffb640 1 -- 172.21.15.92:0/4016168417 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e009c120 con 0x55e600cc69a0 2024-09-19T09:02:41.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.135+0000 7fc6e5ffb640 1 -- 172.21.15.92:0/4016168417 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6e00a04d0 con 0x55e600cc69a0 2024-09-19T09:02:41.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.135+0000 7fc6e5ffb640 1 -- 172.21.15.92:0/4016168417 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e00bc070 con 0x55e600cc69a0 2024-09-19T09:02:41.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.136+0000 7fc6f904b740 1 -- 172.21.15.92:0/4016168417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e600cc69a0 msgr2=0x55e600cc6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:41.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.136+0000 7fc6f904b740 1 --2- 172.21.15.92:0/4016168417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e600cc69a0 0x55e600cc6da0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc6e00a4860 tx=0x7fc6e009bff0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.136+0000 7fc6f904b740 1 -- 172.21.15.92:0/4016168417 shutdown_connections 2024-09-19T09:02:41.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.136+0000 7fc6f904b740 1 --2- 172.21.15.92:0/4016168417 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e600ccc370 0x55e600cce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.136+0000 7fc6f904b740 1 --2- 172.21.15.92:0/4016168417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e600cc72e0 0x55e600ccbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.136+0000 7fc6f904b740 1 --2- 172.21.15.92:0/4016168417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e600cc69a0 0x55e600cc6da0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.136+0000 7fc6f904b740 1 -- 172.21.15.92:0/4016168417 >> 172.21.15.92:0/4016168417 conn(0x55e600cc2010 msgr2=0x55e600cc2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:41.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.136+0000 7fc6f904b740 1 -- 172.21.15.92:0/4016168417 shutdown_connections 2024-09-19T09:02:41.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.136+0000 7fc6f904b740 1 -- 172.21.15.92:0/4016168417 wait complete. 2024-09-19T09:02:41.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.137+0000 7fc6f904b740 1 -- start start 2024-09-19T09:02:41.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.137+0000 7fc6f904b740 1 Processor -- start 2024-09-19T09:02:41.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.137+0000 7fc6f904b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e600cc69a0 0x55e600cd0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:41.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.137+0000 7fc6f904b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e600cc72e0 0x55e600cd1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:41.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.137+0000 7fc6f904b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e600ccc370 0x55e600cd8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:41.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.137+0000 7fc6f904b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e600ccf340 con 0x55e600ccc370 2024-09-19T09:02:41.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.137+0000 7fc6f904b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e600bb3290 con 0x55e600cc72e0 2024-09-19T09:02:41.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.137+0000 7fc6f904b740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e600ccf4c0 con 0x55e600cc69a0 2024-09-19T09:02:41.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.137+0000 7fc6f904b740 10 client.0 _ll_register_callbacks cb 0x55e600be4140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:41.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.138+0000 7fc6ef7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e600cc69a0 0x55e600cd0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:41.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.138+0000 7fc6ef7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e600cc69a0 0x55e600cd0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:50562/0 (socket says 172.21.15.92:50562) 2024-09-19T09:02:41.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.138+0000 7fc6ef7fe640 1 -- 172.21.15.92:0/3590504580 learned_addr learned my addr 172.21.15.92:0/3590504580 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:41.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.138+0000 7fc6effff640 1 --2- 172.21.15.92:0/3590504580 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e600ccc370 0x55e600cd8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:41.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.138+0000 7fc6e6ffd640 1 --2- 172.21.15.92:0/3590504580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e600cc72e0 0x55e600cd1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:41.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.138+0000 7fc6ef7fe640 1 -- 172.21.15.92:0/3590504580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e600cc72e0 msgr2=0x55e600cd1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:41.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.138+0000 7fc6ef7fe640 1 --2- 172.21.15.92:0/3590504580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e600cc72e0 0x55e600cd1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.138+0000 7fc6ef7fe640 1 -- 172.21.15.92:0/3590504580 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e600ccc370 msgr2=0x55e600cd8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:41.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.138+0000 7fc6ef7fe640 1 --2- 172.21.15.92:0/3590504580 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e600ccc370 0x55e600cd8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.138+0000 7fc6ef7fe640 1 -- 172.21.15.92:0/3590504580 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e60093d210 con 0x55e600cc69a0 2024-09-19T09:02:41.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.138+0000 7fc6e6ffd640 1 --2- 172.21.15.92:0/3590504580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e600cc72e0 0x55e600cd1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:41.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.139+0000 7fc6ef7fe640 1 --2- 172.21.15.92:0/3590504580 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e600cc69a0 0x55e600cd0c50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc6e009c060 tx=0x7fc6e00cd5e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22c6e83ad655b761 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:41.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.139+0000 7fc6ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:02:41.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.139+0000 7fc6ceffd640 1 -- 172.21.15.92:0/3590504580 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e009c120 con 0x55e600cc69a0 2024-09-19T09:02:41.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.139+0000 7fc6ceffd640 1 -- 172.21.15.92:0/3590504580 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc6e00bc0c0 con 0x55e600cc69a0 2024-09-19T09:02:41.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.139+0000 7fc6f904b740 1 -- 172.21.15.92:0/3590504580 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6e00a04d0 con 0x55e600cc69a0 2024-09-19T09:02:41.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.139+0000 7fc6ceffd640 1 -- 172.21.15.92:0/3590504580 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc6e0098790 con 0x55e600cc69a0 2024-09-19T09:02:41.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.139+0000 7fc6f904b740 10 client.26023 fetch_fsmap learned FSMap version 19 2024-09-19T09:02:41.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.139+0000 7fc6f904b740 1 -- 172.21.15.92:0/3590504580 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e600a09620 con 0x55e600cc69a0 2024-09-19T09:02:41.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.140+0000 7fc6ceffd640 1 -- 172.21.15.92:0/3590504580 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6e00a04d0 con 0x55e600cc69a0 2024-09-19T09:02:41.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.140+0000 7fc6ceffd640 1 -- 172.21.15.92:0/3590504580 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fc6e0097f00 con 0x55e600cc69a0 2024-09-19T09:02:41.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.140+0000 7fc6f904b740 10 client.26023 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:02:41.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.140+0000 7fc6f904b740 10 client.26023 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:02:41.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.140+0000 7fc6f904b740 20 client.26023 populate_metadata read hostname 'smithi092' 2024-09-19T09:02:41.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.140+0000 7fc6f904b740 1 --2- 172.21.15.92:0/3590504580 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e600cdc460 0x55e600cde850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:41.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.140+0000 7fc6f904b740 4 client.26023 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:02:41.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.140+0000 7fc6f904b740 1 -- 172.21.15.92:0/3590504580 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e600c37a20 con 0x55e600cdc460 2024-09-19T09:02:41.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.140+0000 7fc6e6ffd640 1 --2- 172.21.15.92:0/3590504580 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e600cdc460 0x55e600cde850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:41.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.140+0000 7fc6ceffd640 10 client.26023 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:41.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.141+0000 7fc6e6ffd640 1 --2- 172.21.15.92:0/3590504580 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e600cdc460 0x55e600cde850 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96756a9993814cb server_cookie=8028587730f0c666 in_seq=0 out_seq=0 2024-09-19T09:02:41.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.141+0000 7fc6ceffd640 1 -- 172.21.15.92:0/3590504580 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e600c37a20 con 0x55e600cdc460 2024-09-19T09:02:41.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.141+0000 7fc6ceffd640 10 client.26023 handle_command_reply: tid=0 2024-09-19T09:02:41.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.141+0000 7fc6f904b740 1 client.26023 shutdown 2024-09-19T09:02:41.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.142+0000 7fc6f904b740 1 -- 172.21.15.92:0/3590504580 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e600cc69a0 msgr2=0x55e600cd0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:41.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.142+0000 7fc6f904b740 1 --2- 172.21.15.92:0/3590504580 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e600cc69a0 0x55e600cd0c50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc6e009c060 tx=0x7fc6e00cd5e0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.142+0000 7fc6f904b740 1 -- 172.21.15.92:0/3590504580 shutdown_connections 2024-09-19T09:02:41.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.142+0000 7fc6f904b740 1 --2- 172.21.15.92:0/3590504580 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e600cdc460 0x55e600cde850 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.142+0000 7fc6f904b740 1 --2- 172.21.15.92:0/3590504580 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e600ccc370 0x55e600cd8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.142+0000 7fc6f904b740 1 --2- 172.21.15.92:0/3590504580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e600cc72e0 0x55e600cd1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.142+0000 7fc6f904b740 1 --2- 172.21.15.92:0/3590504580 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e600cc69a0 0x55e600cd0c50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.142+0000 7fc6f904b740 1 -- 172.21.15.92:0/3590504580 >> 172.21.15.92:0/3590504580 conn(0x55e600cc2010 msgr2=0x55e600cc3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:41.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.142+0000 7fc6ceffd640 0 client.26023 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:41.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.143+0000 7fc6f904b740 1 -- 172.21.15.92:0/3590504580 shutdown_connections 2024-09-19T09:02:41.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.143+0000 7fc6f904b740 1 -- 172.21.15.92:0/3590504580 wait complete. 2024-09-19T09:02:41.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.144+0000 7fc6f904b740 20 client.26023 trim_cache size 0 max 16384 2024-09-19T09:02:41.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.167+0000 7fc6f904b740 1 Processor -- start 2024-09-19T09:02:41.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.167+0000 7fc6f904b740 1 -- start start 2024-09-19T09:02:41.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.167+0000 7fc6f904b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e600cc69a0 0x55e600cd1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:41.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.167+0000 7fc6f904b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e600cc72e0 0x55e600cd80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:41.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.167+0000 7fc6f904b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e600ccc370 0x55e600cc2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:41.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.167+0000 7fc6f904b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f01ad6c0 con 0x55e600ccc370 2024-09-19T09:02:41.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.167+0000 7fc6f904b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f01aff60 con 0x55e600cc69a0 2024-09-19T09:02:41.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.167+0000 7fc6f904b740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f01add50 con 0x55e600cc72e0 2024-09-19T09:02:41.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.167+0000 7fc6effff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e600ccc370 0x55e600cc2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:41.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.167+0000 7fc6effff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e600ccc370 0x55e600cc2ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52580/0 (socket says 172.21.15.92:52580) 2024-09-19T09:02:41.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.167+0000 7fc6e6ffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e600cc72e0 0x55e600cd80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:41.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.167+0000 7fc6effff640 1 -- 172.21.15.92:0/2128631261 learned_addr learned my addr 172.21.15.92:0/2128631261 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:41.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.167+0000 7fc6ef7fe640 1 --2- 172.21.15.92:0/2128631261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e600cc69a0 0x55e600cd1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:41.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.168+0000 7fc6ef7fe640 1 -- 172.21.15.92:0/2128631261 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e600cc72e0 msgr2=0x55e600cd80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:41.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.168+0000 7fc6ef7fe640 1 --2- 172.21.15.92:0/2128631261 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e600cc72e0 0x55e600cd80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.171 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.168+0000 7fc6ef7fe640 1 -- 172.21.15.92:0/2128631261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e600ccc370 msgr2=0x55e600cc2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:41.171 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.168+0000 7fc6ef7fe640 1 --2- 172.21.15.92:0/2128631261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e600ccc370 0x55e600cc2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.171 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.168+0000 7fc6ef7fe640 1 -- 172.21.15.92:0/2128631261 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e600cc1e30 con 0x55e600cc69a0 2024-09-19T09:02:41.171 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.168+0000 7fc6ef7fe640 1 --2- 172.21.15.92:0/2128631261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e600cc69a0 0x55e600cd1110 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0003ee0 tx=0x7fc6e0003f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c82a79069838ad30 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:41.171 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.169+0000 7fc6e57fa640 1 -- 172.21.15.92:0/2128631261 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e009c120 con 0x55e600cc69a0 2024-09-19T09:02:41.171 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.169+0000 7fc6e57fa640 1 -- 172.21.15.92:0/2128631261 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6e00a04d0 con 0x55e600cc69a0 2024-09-19T09:02:41.171 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.169+0000 7fc6e57fa640 1 -- 172.21.15.92:0/2128631261 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0098930 con 0x55e600cc69a0 2024-09-19T09:02:41.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.169+0000 7fc6f904b740 1 -- 172.21.15.92:0/2128631261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e600cc69a0 msgr2=0x55e600cd1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:41.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.170+0000 7fc6f904b740 1 --2- 172.21.15.92:0/2128631261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e600cc69a0 0x55e600cd1110 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0003ee0 tx=0x7fc6e0003f30 comp rx=0 tx=0).stop 2024-09-19T09:02:41.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.170+0000 7fc6f904b740 1 -- 172.21.15.92:0/2128631261 shutdown_connections 2024-09-19T09:02:41.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.170+0000 7fc6f904b740 1 --2- 172.21.15.92:0/2128631261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e600ccc370 0x55e600cc2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.170+0000 7fc6f904b740 1 --2- 172.21.15.92:0/2128631261 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e600cc72e0 0x55e600cd80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.170+0000 7fc6f904b740 1 --2- 172.21.15.92:0/2128631261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e600cc69a0 0x55e600cd1110 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.170+0000 7fc6f904b740 1 -- 172.21.15.92:0/2128631261 >> 172.21.15.92:0/2128631261 conn(0x55e600cc2010 msgr2=0x55e600cd0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:41.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.170+0000 7fc6f904b740 1 -- 172.21.15.92:0/2128631261 shutdown_connections 2024-09-19T09:02:41.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.170+0000 7fc6f904b740 1 -- 172.21.15.92:0/2128631261 wait complete. 2024-09-19T09:02:41.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.170+0000 7fc6f904b740 1 -- start start 2024-09-19T09:02:41.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.170+0000 7fc6f904b740 1 Processor -- start 2024-09-19T09:02:41.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.171+0000 7fc6f904b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e600cc69a0 0x55e600cd4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:41.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.171+0000 7fc6f904b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e600cc72e0 0x55e600cd5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:41.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.171+0000 7fc6f904b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e600ccc370 0x55e600d44fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:41.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.171+0000 7fc6f904b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f01ae420 con 0x55e600cc72e0 2024-09-19T09:02:41.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.171+0000 7fc6f904b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f01af890 con 0x55e600cc69a0 2024-09-19T09:02:41.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.171+0000 7fc6f904b740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f01aeaf0 con 0x55e600ccc370 2024-09-19T09:02:41.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.171+0000 7fc6f904b740 10 client.0 _ll_register_callbacks cb 0x7fc6d8009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:41.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.171+0000 7fc6e6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e600cc72e0 0x55e600cd5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:41.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.171+0000 7fc6ef7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e600cc69a0 0x55e600cd4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:41.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.171+0000 7fc6e6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e600cc72e0 0x55e600cd5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52582/0 (socket says 172.21.15.92:52582) 2024-09-19T09:02:41.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.171+0000 7fc6e6ffd640 1 -- 172.21.15.92:0/1005548562 learned_addr learned my addr 172.21.15.92:0/1005548562 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:41.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.171+0000 7fc6effff640 1 --2- 172.21.15.92:0/1005548562 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e600ccc370 0x55e600d44fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:41.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.171+0000 7fc6e6ffd640 1 -- 172.21.15.92:0/1005548562 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e600ccc370 msgr2=0x55e600d44fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:41.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.171+0000 7fc6e6ffd640 1 --2- 172.21.15.92:0/1005548562 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e600ccc370 0x55e600d44fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.171+0000 7fc6e6ffd640 1 -- 172.21.15.92:0/1005548562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e600cc69a0 msgr2=0x55e600cd4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:41.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.171+0000 7fc6e6ffd640 1 --2- 172.21.15.92:0/1005548562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e600cc69a0 0x55e600cd4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.171+0000 7fc6e6ffd640 1 -- 172.21.15.92:0/1005548562 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e600cd8470 con 0x55e600cc72e0 2024-09-19T09:02:41.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.171+0000 7fc6e6ffd640 1 --2- 172.21.15.92:0/1005548562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e600cc72e0 0x55e600cd5380 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8009540 tx=0x7fc6d8004b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94b6305ab76aef64 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:41.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.171+0000 7fc6ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:02:41.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.172+0000 7fc6ceffd640 1 -- 172.21.15.92:0/1005548562 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8010630 con 0x55e600cc72e0 2024-09-19T09:02:41.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.172+0000 7fc6ceffd640 1 -- 172.21.15.92:0/1005548562 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc6d80107d0 con 0x55e600cc72e0 2024-09-19T09:02:41.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.172+0000 7fc6f904b740 1 -- 172.21.15.92:0/1005548562 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6e00a04d0 con 0x55e600cc72e0 2024-09-19T09:02:41.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.172+0000 7fc6ceffd640 1 -- 172.21.15.92:0/1005548562 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc6d80109d0 con 0x55e600cc72e0 2024-09-19T09:02:41.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.172+0000 7fc6f904b740 10 client.16719 fetch_fsmap learned FSMap version 19 2024-09-19T09:02:41.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.172+0000 7fc6f904b740 1 -- 172.21.15.92:0/1005548562 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e600d46600 con 0x55e600cc72e0 2024-09-19T09:02:41.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.172+0000 7fc6ceffd640 1 -- 172.21.15.92:0/1005548562 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6e00a04d0 con 0x55e600cc72e0 2024-09-19T09:02:41.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.172+0000 7fc6ceffd640 1 -- 172.21.15.92:0/1005548562 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fc6d802e050 con 0x55e600cc72e0 2024-09-19T09:02:41.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.173+0000 7fc6f904b740 10 client.16719 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:02:41.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.173+0000 7fc6f904b740 10 client.16719 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:02:41.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.174+0000 7fc6f904b740 20 client.16719 populate_metadata read hostname 'smithi092' 2024-09-19T09:02:41.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.174+0000 7fc6f904b740 1 --2- 172.21.15.92:0/1005548562 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e600d46f50 0x55e600d49370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:41.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.174+0000 7fc6f904b740 4 client.16719 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:02:41.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.174+0000 7fc6f904b740 1 -- 172.21.15.92:0/1005548562 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e600c31d70 con 0x55e600d46f50 2024-09-19T09:02:41.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.175+0000 7fc6ef7fe640 1 --2- 172.21.15.92:0/1005548562 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e600d46f50 0x55e600d49370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:41.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.175+0000 7fc6ef7fe640 1 --2- 172.21.15.92:0/1005548562 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e600d46f50 0x55e600d49370 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=905b5e90fbcfe888 server_cookie=628a8f176347cef8 in_seq=0 out_seq=0 2024-09-19T09:02:41.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.175+0000 7fc6ceffd640 10 client.16719 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:41.214 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.212+0000 7fc6ceffd640 1 -- 172.21.15.92:0/1005548562 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e600c31d70 con 0x55e600d46f50 2024-09-19T09:02:41.214 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.212+0000 7fc6ceffd640 10 client.16719 handle_command_reply: tid=0 2024-09-19T09:02:41.214 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.212+0000 7fc6f904b740 1 client.16719 shutdown 2024-09-19T09:02:41.215 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.212+0000 7fc6f904b740 1 -- 172.21.15.92:0/1005548562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e600cc72e0 msgr2=0x55e600cd5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:41.215 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.212+0000 7fc6f904b740 1 --2- 172.21.15.92:0/1005548562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e600cc72e0 0x55e600cd5380 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8009540 tx=0x7fc6d8004b70 comp rx=0 tx=0).stop 2024-09-19T09:02:41.215 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.212+0000 7fc6f904b740 1 -- 172.21.15.92:0/1005548562 shutdown_connections 2024-09-19T09:02:41.215 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.212+0000 7fc6f904b740 1 --2- 172.21.15.92:0/1005548562 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e600d46f50 0x55e600d49370 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.216 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.212+0000 7fc6f904b740 1 --2- 172.21.15.92:0/1005548562 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e600ccc370 0x55e600d44fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.216 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.212+0000 7fc6f904b740 1 --2- 172.21.15.92:0/1005548562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e600cc72e0 0x55e600cd5380 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.216 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.212+0000 7fc6ceffd640 0 client.16719 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:41.216 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.212+0000 7fc6f904b740 1 --2- 172.21.15.92:0/1005548562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e600cc69a0 0x55e600cd4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.216 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.212+0000 7fc6f904b740 1 -- 172.21.15.92:0/1005548562 >> 172.21.15.92:0/1005548562 conn(0x55e600cc2010 msgr2=0x55e600cc09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:41.217 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.212+0000 7fc6f904b740 1 -- 172.21.15.92:0/1005548562 shutdown_connections 2024-09-19T09:02:41.217 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.212+0000 7fc6f904b740 1 -- 172.21.15.92:0/1005548562 wait complete. 2024-09-19T09:02:41.217 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.212+0000 7fc6f904b740 20 client.16719 trim_cache size 0 max 16384 2024-09-19T09:02:41.217 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:02:41.218 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:02:41.218 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:02:41.218 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:02:41.219 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.213+0000 7fc6f61d8640 1 -- 172.21.15.92:0/339960363 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc6dc0a34e0 msgr2=0x7fc6dc0a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:41.219 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.213+0000 7fc6f61d8640 1 --2- 172.21.15.92:0/339960363 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc6dc0a34e0 0x7fc6dc0a59a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8005cc0 tx=0x7fc6e802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.219 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.213+0000 7fc6f61d8640 1 -- 172.21.15.92:0/339960363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6f01003b0 msgr2=0x7fc6f019e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:41.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.213+0000 7fc6f61d8640 1 --2- 172.21.15.92:0/339960363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6f01003b0 0x7fc6f019e330 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fc6e000ea60 tx=0x7fc6e000ef20 comp rx=0 tx=0).stop 2024-09-19T09:02:41.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.213+0000 7fc6f61d8640 1 -- 172.21.15.92:0/339960363 shutdown_connections 2024-09-19T09:02:41.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.213+0000 7fc6f61d8640 1 --2- 172.21.15.92:0/339960363 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6f01056b0 0x7fc6f01a58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.213+0000 7fc6f61d8640 1 --2- 172.21.15.92:0/339960363 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc6f0102d00 0x7fc6f019e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.213+0000 7fc6f61d8640 1 --2- 172.21.15.92:0/339960363 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc6dc0a34e0 0x7fc6dc0a59a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.213+0000 7fc6f61d8640 1 --2- 172.21.15.92:0/339960363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6f01003b0 0x7fc6f019e330 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.213+0000 7fc6f61d8640 1 -- 172.21.15.92:0/339960363 >> 172.21.15.92:0/339960363 conn(0x7fc6f00fc1e0 msgr2=0x7fc6f0103980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:41.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.213+0000 7fc6f61d8640 1 -- 172.21.15.92:0/339960363 shutdown_connections 2024-09-19T09:02:41.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:41.213+0000 7fc6f61d8640 1 -- 172.21.15.92:0/339960363 wait complete. 2024-09-19T09:02:41.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:41.297+0000 7f0c5049b640 1 -- 172.21.15.92:0/838654261 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c4810c360 con 0x7f0c481049a0 2024-09-19T09:02:41.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:41.298+0000 7f0c3f7fe640 1 -- 172.21.15.92:0/838654261 <== mon.2 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f0c380bc260 con 0x7f0c481049a0 2024-09-19T09:02:41.299 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:02:41.299 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:02:41.299 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:02:41.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:41.302+0000 7f0c5049b640 1 -- 172.21.15.92:0/838654261 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f0c340a3380 msgr2=0x7f0c340a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:41.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:41.302+0000 7f0c5049b640 1 --2- 172.21.15.92:0/838654261 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f0c340a3380 0x7f0c340a5840 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0c44011550 tx=0x7f0c44005f90 comp rx=0 tx=0).stop 2024-09-19T09:02:41.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:41.302+0000 7f0c5049b640 1 -- 172.21.15.92:0/838654261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c481049a0 msgr2=0x7f0c4806dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:41.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:41.302+0000 7f0c5049b640 1 --2- 172.21.15.92:0/838654261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c481049a0 0x7f0c4806dc10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0c3802aa00 tx=0x7f0c38003b90 comp rx=0 tx=0).stop 2024-09-19T09:02:41.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:41.302+0000 7f0c5049b640 1 -- 172.21.15.92:0/838654261 shutdown_connections 2024-09-19T09:02:41.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:41.302+0000 7f0c5049b640 1 --2- 172.21.15.92:0/838654261 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c48109120 0x7f0c4806e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:41.302+0000 7f0c5049b640 1 --2- 172.21.15.92:0/838654261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c481049a0 0x7f0c4806dc10 secure :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0c3802aa00 tx=0x7f0c38003b90 comp rx=0 tx=0).stop 2024-09-19T09:02:41.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:41.302+0000 7f0c5049b640 1 --2- 172.21.15.92:0/838654261 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f0c340a3380 0x7f0c340a5840 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:41.302+0000 7f0c5049b640 1 --2- 172.21.15.92:0/838654261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c48103ff0 0x7f0c48073b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:41.302+0000 7f0c5049b640 1 -- 172.21.15.92:0/838654261 >> 172.21.15.92:0/838654261 conn(0x7f0c480ffa70 msgr2=0x7f0c48100d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:41.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:41.303+0000 7f0c5049b640 1 -- 172.21.15.92:0/838654261 shutdown_connections 2024-09-19T09:02:41.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:41.303+0000 7f0c5049b640 1 -- 172.21.15.92:0/838654261 wait complete. 2024-09-19T09:02:41.627 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:41 smithi092 ceph-mon[31407]: pgmap v516: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 52 MiB/s wr, 1.57k op/s 2024-09-19T09:02:41.628 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:41 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/838654261' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:02:41.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:41 smithi167 ceph-mon[35359]: pgmap v516: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 52 MiB/s wr, 1.57k op/s 2024-09-19T09:02:41.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:41 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/838654261' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:02:41.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:41 smithi190 ceph-mon[35358]: pgmap v516: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 52 MiB/s wr, 1.57k op/s 2024-09-19T09:02:41.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:41 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/838654261' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:02:42.088 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:02:42.504 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:43.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.051+0000 7f3a3bc11640 1 -- 172.21.15.92:0/1821054895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a341083f0 msgr2=0x7f3a341087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:43.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.051+0000 7f3a3bc11640 1 --2- 172.21.15.92:0/1821054895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a341083f0 0x7f3a341087d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f3a30009900 tx=0x7f3a3002a3f0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.052+0000 7f3a3bc11640 1 -- 172.21.15.92:0/1821054895 shutdown_connections 2024-09-19T09:02:43.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.052+0000 7f3a3bc11640 1 --2- 172.21.15.92:0/1821054895 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a3410d520 0x7f3a341150a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.052+0000 7f3a3bc11640 1 --2- 172.21.15.92:0/1821054895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a34108da0 0x7f3a3410cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.052+0000 7f3a3bc11640 1 --2- 172.21.15.92:0/1821054895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a341083f0 0x7f3a341087d0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.052+0000 7f3a3bc11640 1 -- 172.21.15.92:0/1821054895 >> 172.21.15.92:0/1821054895 conn(0x7f3a34077af0 msgr2=0x7f3a34079f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:43.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.052+0000 7f3a3bc11640 1 -- 172.21.15.92:0/1821054895 shutdown_connections 2024-09-19T09:02:43.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.052+0000 7f3a3bc11640 1 -- 172.21.15.92:0/1821054895 wait complete. 2024-09-19T09:02:43.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.053+0000 7f3a3bc11640 1 Processor -- start 2024-09-19T09:02:43.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.054+0000 7f3a3bc11640 1 -- start start 2024-09-19T09:02:43.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.054+0000 7f3a3bc11640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a341083f0 0x7f3a341a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:43.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.054+0000 7f3a3bc11640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a34108da0 0x7f3a341a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:43.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.054+0000 7f3a3bc11640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a3410d520 0x7f3a3419e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:43.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.054+0000 7f3a3bc11640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3a34118560 con 0x7f3a34108da0 2024-09-19T09:02:43.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.054+0000 7f3a3bc11640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3a341183e0 con 0x7f3a3410d520 2024-09-19T09:02:43.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.054+0000 7f3a3bc11640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3a341186e0 con 0x7f3a341083f0 2024-09-19T09:02:43.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.054+0000 7f3a399ad640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a341083f0 0x7f3a341a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:43.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.055+0000 7f3a399ad640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a341083f0 0x7f3a341a46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:47146/0 (socket says 172.21.15.92:47146) 2024-09-19T09:02:43.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.055+0000 7f3a399ad640 1 -- 172.21.15.92:0/247527949 learned_addr learned my addr 172.21.15.92:0/247527949 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:43.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.055+0000 7f3a3a1ae640 1 --2- 172.21.15.92:0/247527949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a3410d520 0x7f3a3419e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:43.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.055+0000 7f3a391ac640 1 --2- 172.21.15.92:0/247527949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a34108da0 0x7f3a341a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:43.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.055+0000 7f3a3a1ae640 1 -- 172.21.15.92:0/247527949 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a341083f0 msgr2=0x7f3a341a46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:43.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.055+0000 7f3a3a1ae640 1 --2- 172.21.15.92:0/247527949 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a341083f0 0x7f3a341a46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.055+0000 7f3a3a1ae640 1 -- 172.21.15.92:0/247527949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a34108da0 msgr2=0x7f3a341a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:43.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.055+0000 7f3a3a1ae640 1 --2- 172.21.15.92:0/247527949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a34108da0 0x7f3a341a4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.055+0000 7f3a3a1ae640 1 -- 172.21.15.92:0/247527949 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a3419eff0 con 0x7f3a3410d520 2024-09-19T09:02:43.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.055+0000 7f3a399ad640 1 --2- 172.21.15.92:0/247527949 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a341083f0 0x7f3a341a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:02:43.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.055+0000 7f3a391ac640 1 --2- 172.21.15.92:0/247527949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a34108da0 0x7f3a341a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:02:43.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.055+0000 7f3a3a1ae640 1 --2- 172.21.15.92:0/247527949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a3410d520 0x7f3a3419e850 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c00e940 tx=0x7f3a2c00ee00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:43.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.056+0000 7f3a2affd640 1 -- 172.21.15.92:0/247527949 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c004d20 con 0x7f3a3410d520 2024-09-19T09:02:43.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.056+0000 7f3a2affd640 1 -- 172.21.15.92:0/247527949 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a2c005020 con 0x7f3a3410d520 2024-09-19T09:02:43.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.056+0000 7f3a3bc11640 1 -- 172.21.15.92:0/247527949 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a3419f2e0 con 0x7f3a3410d520 2024-09-19T09:02:43.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.056+0000 7f3a2affd640 1 -- 172.21.15.92:0/247527949 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c0116b0 con 0x7f3a3410d520 2024-09-19T09:02:43.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.056+0000 7f3a3bc11640 1 -- 172.21.15.92:0/247527949 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a341ab530 con 0x7f3a3410d520 2024-09-19T09:02:43.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.059+0000 7f3a2affd640 1 -- 172.21.15.92:0/247527949 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3a2c011850 con 0x7f3a3410d520 2024-09-19T09:02:43.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.060+0000 7f3a2affd640 1 --2- 172.21.15.92:0/247527949 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3a200a32c0 0x7f3a200a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:43.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.060+0000 7f3a2affd640 1 -- 172.21.15.92:0/247527949 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3a2c0d09a0 con 0x7f3a3410d520 2024-09-19T09:02:43.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.060+0000 7f3a399ad640 1 --2- 172.21.15.92:0/247527949 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3a200a32c0 0x7f3a200a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:43.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.061+0000 7f3a3dfea740 1 Processor -- start 2024-09-19T09:02:43.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.061+0000 7f3a399ad640 1 --2- 172.21.15.92:0/247527949 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3a200a32c0 0x7f3a200a5780 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3a300096c0 tx=0x7f3a30005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:43.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.061+0000 7f3a3dfea740 1 -- start start 2024-09-19T09:02:43.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.061+0000 7f3a3dfea740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8a18eb40 0x562a8a18d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:43.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.061+0000 7f3a3dfea740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a8a18d5d0 0x562a8a18da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:43.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.061+0000 7f3a3dfea740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a8a198370 0x562a8a19a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:43.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.062+0000 7f3a399ad640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8a18eb40 0x562a8a18d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:43.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.061+0000 7f3a3dfea740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562a8a0f32f0 con 0x562a8a18eb40 2024-09-19T09:02:43.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.062+0000 7f3a399ad640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8a18eb40 0x562a8a18d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51524/0 (socket says 172.21.15.92:51524) 2024-09-19T09:02:43.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.062+0000 7f3a399ad640 1 -- 172.21.15.92:0/3589877841 learned_addr learned my addr 172.21.15.92:0/3589877841 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:43.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.062+0000 7f3a3dfea740 1 -- 172.21.15.92:0/3589877841 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x562a8a09acf0 con 0x562a8a18d5d0 2024-09-19T09:02:43.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.062+0000 7f3a3dfea740 1 -- 172.21.15.92:0/3589877841 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x562a8a0ef2b0 con 0x562a8a198370 2024-09-19T09:02:43.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.062+0000 7f3a3a1ae640 1 --2- 172.21.15.92:0/3589877841 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a8a198370 0x562a8a19a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:43.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.062+0000 7f3a391ac640 1 --2- 172.21.15.92:0/3589877841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a8a18d5d0 0x562a8a18da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:43.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.062+0000 7f3a399ad640 1 -- 172.21.15.92:0/3589877841 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a8a198370 msgr2=0x562a8a19a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:43.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.062+0000 7f3a399ad640 1 --2- 172.21.15.92:0/3589877841 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a8a198370 0x562a8a19a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.062+0000 7f3a399ad640 1 -- 172.21.15.92:0/3589877841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a8a18d5d0 msgr2=0x562a8a18da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:43.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.062+0000 7f3a399ad640 1 --2- 172.21.15.92:0/3589877841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a8a18d5d0 0x562a8a18da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.062+0000 7f3a399ad640 1 -- 172.21.15.92:0/3589877841 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a8a07f3a0 con 0x562a8a18eb40 2024-09-19T09:02:43.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.062+0000 7f3a399ad640 1 --2- 172.21.15.92:0/3589877841 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8a18eb40 0x562a8a18d090 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f3a30009a20 tx=0x7f3a3003d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c984a0ed1eb32ab4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:43.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.063+0000 7f3a1ffff640 1 -- 172.21.15.92:0/3589877841 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a30035040 con 0x562a8a18eb40 2024-09-19T09:02:43.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.063+0000 7f3a1ffff640 1 -- 172.21.15.92:0/3589877841 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a3004d070 con 0x562a8a18eb40 2024-09-19T09:02:43.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.063+0000 7f3a1ffff640 1 -- 172.21.15.92:0/3589877841 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a300035f0 con 0x562a8a18eb40 2024-09-19T09:02:43.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.064+0000 7f3a3dfea740 1 -- 172.21.15.92:0/3589877841 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8a18eb40 msgr2=0x562a8a18d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:43.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.064+0000 7f3a3dfea740 1 --2- 172.21.15.92:0/3589877841 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8a18eb40 0x562a8a18d090 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f3a30009a20 tx=0x7f3a3003d000 comp rx=0 tx=0).stop 2024-09-19T09:02:43.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.064+0000 7f3a3dfea740 1 -- 172.21.15.92:0/3589877841 shutdown_connections 2024-09-19T09:02:43.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.064+0000 7f3a3dfea740 1 --2- 172.21.15.92:0/3589877841 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a8a198370 0x562a8a19a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.064+0000 7f3a3dfea740 1 --2- 172.21.15.92:0/3589877841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a8a18d5d0 0x562a8a18da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.064+0000 7f3a3dfea740 1 --2- 172.21.15.92:0/3589877841 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8a18eb40 0x562a8a18d090 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.064+0000 7f3a3dfea740 1 -- 172.21.15.92:0/3589877841 >> 172.21.15.92:0/3589877841 conn(0x562a8a156310 msgr2=0x562a8a189c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:43.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.065+0000 7f3a3dfea740 1 -- 172.21.15.92:0/3589877841 shutdown_connections 2024-09-19T09:02:43.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.065+0000 7f3a3dfea740 1 -- 172.21.15.92:0/3589877841 wait complete. 2024-09-19T09:02:43.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.065+0000 7f3a3dfea740 1 -- start start 2024-09-19T09:02:43.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.065+0000 7f3a3dfea740 1 Processor -- start 2024-09-19T09:02:43.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.066+0000 7f3a3dfea740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8a18d5d0 0x562a8a197da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:43.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.066+0000 7f3a3dfea740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a8a18eb40 0x562a8a195050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:43.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.066+0000 7f3a3dfea740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a8a198370 0x562a8a1957e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:43.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.066+0000 7f3a3dfea740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562a8a19b010 con 0x562a8a18d5d0 2024-09-19T09:02:43.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.066+0000 7f3a3dfea740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x562a8a0ae060 con 0x562a8a198370 2024-09-19T09:02:43.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.066+0000 7f3a3dfea740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x562a8a19b190 con 0x562a8a18eb40 2024-09-19T09:02:43.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.066+0000 7f3a3dfea740 10 client.0 _ll_register_callbacks cb 0x562a89e018c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:43.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.066+0000 7f3a399ad640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8a18d5d0 0x562a8a197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:43.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.066+0000 7f3a399ad640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8a18d5d0 0x562a8a197da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51536/0 (socket says 172.21.15.92:51536) 2024-09-19T09:02:43.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.066+0000 7f3a399ad640 1 -- 172.21.15.92:0/907954576 learned_addr learned my addr 172.21.15.92:0/907954576 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:43.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.066+0000 7f3a391ac640 1 --2- 172.21.15.92:0/907954576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a8a18eb40 0x562a8a195050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:43.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.066+0000 7f3a3a1ae640 1 --2- 172.21.15.92:0/907954576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a8a198370 0x562a8a1957e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:43.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.067+0000 7f3a399ad640 1 -- 172.21.15.92:0/907954576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a8a18eb40 msgr2=0x562a8a195050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:43.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.067+0000 7f3a399ad640 1 --2- 172.21.15.92:0/907954576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a8a18eb40 0x562a8a195050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.067+0000 7f3a399ad640 1 -- 172.21.15.92:0/907954576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a8a198370 msgr2=0x562a8a1957e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:43.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.067+0000 7f3a399ad640 1 --2- 172.21.15.92:0/907954576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a8a198370 0x562a8a1957e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.067+0000 7f3a399ad640 1 -- 172.21.15.92:0/907954576 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a89e643c0 con 0x562a8a18d5d0 2024-09-19T09:02:43.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.067+0000 7f3a3a1ae640 1 --2- 172.21.15.92:0/907954576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a8a198370 0x562a8a1957e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:43.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.067+0000 7f3a391ac640 1 --2- 172.21.15.92:0/907954576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a8a18eb40 0x562a8a195050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:43.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.067+0000 7f3a399ad640 1 --2- 172.21.15.92:0/907954576 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8a18d5d0 0x562a8a197da0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f3a30000c00 tx=0x7f3a30004f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a779ee93ce783ed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:43.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.067+0000 7f3a1d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:02:43.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.068+0000 7f3a1d7fa640 1 -- 172.21.15.92:0/907954576 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a30035070 con 0x562a8a18d5d0 2024-09-19T09:02:43.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.068+0000 7f3a1d7fa640 1 -- 172.21.15.92:0/907954576 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3a30005460 con 0x562a8a18d5d0 2024-09-19T09:02:43.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.068+0000 7f3a3dfea740 1 -- 172.21.15.92:0/907954576 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a3004d070 con 0x562a8a18d5d0 2024-09-19T09:02:43.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.068+0000 7f3a1d7fa640 1 -- 172.21.15.92:0/907954576 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3a30005d50 con 0x562a8a18d5d0 2024-09-19T09:02:43.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.068+0000 7f3a3dfea740 10 client.16731 fetch_fsmap learned FSMap version 19 2024-09-19T09:02:43.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.068+0000 7f3a3dfea740 1 -- 172.21.15.92:0/907954576 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x562a8a1a6af0 con 0x562a8a18d5d0 2024-09-19T09:02:43.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.068+0000 7f3a1d7fa640 1 -- 172.21.15.92:0/907954576 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a3004d070 con 0x562a8a18d5d0 2024-09-19T09:02:43.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.069+0000 7f3a1d7fa640 1 -- 172.21.15.92:0/907954576 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f3a30048500 con 0x562a8a18d5d0 2024-09-19T09:02:43.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.069+0000 7f3a3dfea740 10 client.16731 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:02:43.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.069+0000 7f3a3dfea740 10 client.16731 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:02:43.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.069+0000 7f3a3dfea740 20 client.16731 populate_metadata read hostname 'smithi092' 2024-09-19T09:02:43.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.069+0000 7f3a3dfea740 1 --2- 172.21.15.92:0/907954576 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562a8a1a7e40 0x562a8a1aa230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:43.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.069+0000 7f3a3dfea740 4 client.16731 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:02:43.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.069+0000 7f3a3dfea740 1 -- 172.21.15.92:0/907954576 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a8a100860 con 0x562a8a1a7e40 2024-09-19T09:02:43.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.069+0000 7f3a391ac640 1 --2- 172.21.15.92:0/907954576 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562a8a1a7e40 0x562a8a1aa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:43.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.070+0000 7f3a391ac640 1 --2- 172.21.15.92:0/907954576 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562a8a1a7e40 0x562a8a1aa230 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9812cc7c1414f760 server_cookie=c54841148033a847 in_seq=0 out_seq=0 2024-09-19T09:02:43.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.070+0000 7f3a1d7fa640 10 client.16731 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:43.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.071+0000 7f3a1d7fa640 1 -- 172.21.15.92:0/907954576 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562a8a100860 con 0x562a8a1a7e40 2024-09-19T09:02:43.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.071+0000 7f3a1d7fa640 10 client.16731 handle_command_reply: tid=0 2024-09-19T09:02:43.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.071+0000 7f3a3dfea740 1 client.16731 shutdown 2024-09-19T09:02:43.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.071+0000 7f3a3dfea740 1 -- 172.21.15.92:0/907954576 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8a18d5d0 msgr2=0x562a8a197da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:43.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.071+0000 7f3a3dfea740 1 --2- 172.21.15.92:0/907954576 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8a18d5d0 0x562a8a197da0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f3a30000c00 tx=0x7f3a30004f00 comp rx=0 tx=0).stop 2024-09-19T09:02:43.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.071+0000 7f3a3dfea740 1 -- 172.21.15.92:0/907954576 shutdown_connections 2024-09-19T09:02:43.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.071+0000 7f3a3dfea740 1 --2- 172.21.15.92:0/907954576 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562a8a1a7e40 0x562a8a1aa230 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.071+0000 7f3a3dfea740 1 --2- 172.21.15.92:0/907954576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a8a198370 0x562a8a1957e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.071+0000 7f3a1d7fa640 0 client.16731 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:43.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.071+0000 7f3a3dfea740 1 --2- 172.21.15.92:0/907954576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a8a18eb40 0x562a8a195050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.072+0000 7f3a3dfea740 1 --2- 172.21.15.92:0/907954576 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8a18d5d0 0x562a8a197da0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.072+0000 7f3a3dfea740 1 -- 172.21.15.92:0/907954576 >> 172.21.15.92:0/907954576 conn(0x562a8a156310 msgr2=0x562a8a18f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:43.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.072+0000 7f3a3dfea740 1 -- 172.21.15.92:0/907954576 shutdown_connections 2024-09-19T09:02:43.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.072+0000 7f3a3dfea740 1 -- 172.21.15.92:0/907954576 wait complete. 2024-09-19T09:02:43.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.072+0000 7f3a3dfea740 20 client.16731 trim_cache size 0 max 16384 2024-09-19T09:02:43.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.091+0000 7f3a3dfea740 1 Processor -- start 2024-09-19T09:02:43.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.092+0000 7f3a3dfea740 1 -- start start 2024-09-19T09:02:43.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.092+0000 7f3a3dfea740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a8a18d5d0 0x562a8a190120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:43.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.092+0000 7f3a3dfea740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8a18eb40 0x562a8a190660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:43.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.092+0000 7f3a3dfea740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a8a198370 0x562a8a1ad250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:43.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.092+0000 7f3a3dfea740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3a341b1b40 con 0x562a8a18eb40 2024-09-19T09:02:43.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.092+0000 7f3a3dfea740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3a341b43e0 con 0x562a8a18d5d0 2024-09-19T09:02:43.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.092+0000 7f3a3dfea740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3a341b21d0 con 0x562a8a198370 2024-09-19T09:02:43.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.092+0000 7f3a3a1ae640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a8a198370 0x562a8a1ad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:43.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.092+0000 7f3a3a1ae640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a8a198370 0x562a8a1ad250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:47170/0 (socket says 172.21.15.92:47170) 2024-09-19T09:02:43.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.092+0000 7f3a3a1ae640 1 -- 172.21.15.92:0/914235628 learned_addr learned my addr 172.21.15.92:0/914235628 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:43.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.093+0000 7f3a391ac640 1 --2- 172.21.15.92:0/914235628 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8a18eb40 0x562a8a190660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:43.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.093+0000 7f3a3a1ae640 1 -- 172.21.15.92:0/914235628 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a8a18d5d0 msgr2=0x562a8a190120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:43.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.093+0000 7f3a399ad640 1 --2- 172.21.15.92:0/914235628 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a8a18d5d0 0x562a8a190120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:43.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.093+0000 7f3a3a1ae640 1 --2- 172.21.15.92:0/914235628 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a8a18d5d0 0x562a8a190120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.093+0000 7f3a3a1ae640 1 -- 172.21.15.92:0/914235628 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8a18eb40 msgr2=0x562a8a190660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:43.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.093+0000 7f3a3a1ae640 1 --2- 172.21.15.92:0/914235628 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8a18eb40 0x562a8a190660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.093+0000 7f3a3a1ae640 1 -- 172.21.15.92:0/914235628 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a8a1a4790 con 0x562a8a198370 2024-09-19T09:02:43.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.093+0000 7f3a391ac640 1 --2- 172.21.15.92:0/914235628 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8a18eb40 0x562a8a190660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:43.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.093+0000 7f3a3a1ae640 1 --2- 172.21.15.92:0/914235628 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a8a198370 0x562a8a1ad250 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c0ce460 tx=0x7f3a2c0bd040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5f7fdc8e08face3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:43.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.093+0000 7f3a1f7fe640 1 -- 172.21.15.92:0/914235628 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c01f070 con 0x562a8a198370 2024-09-19T09:02:43.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.093+0000 7f3a1f7fe640 1 -- 172.21.15.92:0/914235628 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a2c0b7070 con 0x562a8a198370 2024-09-19T09:02:43.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.093+0000 7f3a1f7fe640 1 -- 172.21.15.92:0/914235628 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c0bbbc0 con 0x562a8a198370 2024-09-19T09:02:43.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.094+0000 7f3a3dfea740 1 -- 172.21.15.92:0/914235628 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a8a198370 msgr2=0x562a8a1ad250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:43.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.094+0000 7f3a3dfea740 1 --2- 172.21.15.92:0/914235628 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a8a198370 0x562a8a1ad250 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c0ce460 tx=0x7f3a2c0bd040 comp rx=0 tx=0).stop 2024-09-19T09:02:43.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.095+0000 7f3a3dfea740 1 -- 172.21.15.92:0/914235628 shutdown_connections 2024-09-19T09:02:43.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.095+0000 7f3a3dfea740 1 --2- 172.21.15.92:0/914235628 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a8a198370 0x562a8a1ad250 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.095+0000 7f3a3dfea740 1 --2- 172.21.15.92:0/914235628 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8a18eb40 0x562a8a190660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.095+0000 7f3a3dfea740 1 --2- 172.21.15.92:0/914235628 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a8a18d5d0 0x562a8a190120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.095+0000 7f3a3dfea740 1 -- 172.21.15.92:0/914235628 >> 172.21.15.92:0/914235628 conn(0x562a8a156310 msgr2=0x562a8a1941a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:43.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.095+0000 7f3a3dfea740 1 -- 172.21.15.92:0/914235628 shutdown_connections 2024-09-19T09:02:43.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.095+0000 7f3a3dfea740 1 -- 172.21.15.92:0/914235628 wait complete. 2024-09-19T09:02:43.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.096+0000 7f3a3dfea740 1 -- start start 2024-09-19T09:02:43.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.096+0000 7f3a3dfea740 1 Processor -- start 2024-09-19T09:02:43.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.096+0000 7f3a3dfea740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a8a18d5d0 0x562a8a1ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:43.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.096+0000 7f3a3dfea740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a8a18eb40 0x562a8a1aac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:43.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.096+0000 7f3a3dfea740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8a198370 0x562a8a1ab190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:43.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.096+0000 7f3a3dfea740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3a341b28a0 con 0x562a8a198370 2024-09-19T09:02:43.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.096+0000 7f3a3dfea740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3a341b3d10 con 0x562a8a18eb40 2024-09-19T09:02:43.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.096+0000 7f3a3dfea740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3a341b2f70 con 0x562a8a18d5d0 2024-09-19T09:02:43.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.096+0000 7f3a3dfea740 10 client.0 _ll_register_callbacks cb 0x7f3a24009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:43.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.097+0000 7f3a399ad640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a8a18d5d0 0x562a8a1ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:43.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.097+0000 7f3a399ad640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a8a18d5d0 0x562a8a1ad8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:47180/0 (socket says 172.21.15.92:47180) 2024-09-19T09:02:43.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.097+0000 7f3a399ad640 1 -- 172.21.15.92:0/1601825019 learned_addr learned my addr 172.21.15.92:0/1601825019 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:43.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.097+0000 7f3a3a1ae640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8a198370 0x562a8a1ab190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:43.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.097+0000 7f3a391ac640 1 --2- 172.21.15.92:0/1601825019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a8a18eb40 0x562a8a1aac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:43.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.097+0000 7f3a399ad640 1 -- 172.21.15.92:0/1601825019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a8a18eb40 msgr2=0x562a8a1aac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:43.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.097+0000 7f3a399ad640 1 --2- 172.21.15.92:0/1601825019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a8a18eb40 0x562a8a1aac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.097+0000 7f3a399ad640 1 -- 172.21.15.92:0/1601825019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8a198370 msgr2=0x562a8a1ab190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:43.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.097+0000 7f3a399ad640 1 --2- 172.21.15.92:0/1601825019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8a198370 0x562a8a1ab190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.097+0000 7f3a399ad640 1 -- 172.21.15.92:0/1601825019 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a8a1ab9c0 con 0x562a8a18d5d0 2024-09-19T09:02:43.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.097+0000 7f3a399ad640 1 --2- 172.21.15.92:0/1601825019 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a8a18d5d0 0x562a8a1ad8b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3a30031550 tx=0x7f3a30004c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80a622cb33d63f2f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:43.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.098+0000 7f3a1d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:02:43.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.098+0000 7f3a1d7fa640 1 -- 172.21.15.92:0/1601825019 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a30035030 con 0x562a8a18d5d0 2024-09-19T09:02:43.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.098+0000 7f3a1d7fa640 1 -- 172.21.15.92:0/1601825019 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3a30048670 con 0x562a8a18d5d0 2024-09-19T09:02:43.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.098+0000 7f3a3dfea740 1 -- 172.21.15.92:0/1601825019 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a2c0b7070 con 0x562a8a18d5d0 2024-09-19T09:02:43.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.099+0000 7f3a1d7fa640 1 -- 172.21.15.92:0/1601825019 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3a30040040 con 0x562a8a18d5d0 2024-09-19T09:02:43.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.100+0000 7f3a3dfea740 10 client.26047 fetch_fsmap learned FSMap version 19 2024-09-19T09:02:43.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.100+0000 7f3a3dfea740 1 -- 172.21.15.92:0/1601825019 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x562a8a212680 con 0x562a8a18d5d0 2024-09-19T09:02:43.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.100+0000 7f3a1d7fa640 1 -- 172.21.15.92:0/1601825019 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a3004d050 con 0x562a8a18d5d0 2024-09-19T09:02:43.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.101+0000 7f3a1d7fa640 1 -- 172.21.15.92:0/1601825019 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f3a30003bd0 con 0x562a8a18d5d0 2024-09-19T09:02:43.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.101+0000 7f3a3dfea740 10 client.26047 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:02:43.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.102+0000 7f3a3dfea740 10 client.26047 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:02:43.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.102+0000 7f3a3dfea740 20 client.26047 populate_metadata read hostname 'smithi092' 2024-09-19T09:02:43.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.102+0000 7f3a3dfea740 1 --2- 172.21.15.92:0/1601825019 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562a8a212d50 0x562a8a215140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:43.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.102+0000 7f3a3dfea740 4 client.26047 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:02:43.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.102+0000 7f3a3dfea740 1 -- 172.21.15.92:0/1601825019 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f3a2c0b7070 con 0x562a8a212d50 2024-09-19T09:02:43.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.102+0000 7f3a391ac640 1 --2- 172.21.15.92:0/1601825019 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562a8a212d50 0x562a8a215140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:43.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.102+0000 7f3a391ac640 1 --2- 172.21.15.92:0/1601825019 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562a8a212d50 0x562a8a215140 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d2bd7a65e08f664 server_cookie=fa36cc805e80b170 in_seq=0 out_seq=0 2024-09-19T09:02:43.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.102+0000 7f3a1d7fa640 10 client.26047 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:43.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.102+0000 7f3a1d7fa640 1 -- 172.21.15.92:0/1601825019 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f3a2c0b7070 con 0x562a8a212d50 2024-09-19T09:02:43.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.102+0000 7f3a1d7fa640 10 client.26047 handle_command_reply: tid=0 2024-09-19T09:02:43.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.102+0000 7f3a3dfea740 1 client.26047 shutdown 2024-09-19T09:02:43.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.103+0000 7f3a3dfea740 1 -- 172.21.15.92:0/1601825019 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a8a18d5d0 msgr2=0x562a8a1ad8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:43.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.103+0000 7f3a3dfea740 1 --2- 172.21.15.92:0/1601825019 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a8a18d5d0 0x562a8a1ad8b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3a30031550 tx=0x7f3a30004c20 comp rx=0 tx=0).stop 2024-09-19T09:02:43.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.103+0000 7f3a3dfea740 1 -- 172.21.15.92:0/1601825019 shutdown_connections 2024-09-19T09:02:43.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.103+0000 7f3a3dfea740 1 --2- 172.21.15.92:0/1601825019 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562a8a212d50 0x562a8a215140 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.103+0000 7f3a3dfea740 1 --2- 172.21.15.92:0/1601825019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8a198370 0x562a8a1ab190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.103+0000 7f3a1d7fa640 0 client.26047 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:43.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.103+0000 7f3a3dfea740 1 --2- 172.21.15.92:0/1601825019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a8a18eb40 0x562a8a1aac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.103+0000 7f3a3dfea740 1 --2- 172.21.15.92:0/1601825019 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a8a18d5d0 0x562a8a1ad8b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.103+0000 7f3a3dfea740 1 -- 172.21.15.92:0/1601825019 >> 172.21.15.92:0/1601825019 conn(0x562a8a156310 msgr2=0x562a8a1a3420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:43.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.103+0000 7f3a3dfea740 1 -- 172.21.15.92:0/1601825019 shutdown_connections 2024-09-19T09:02:43.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.103+0000 7f3a3dfea740 1 -- 172.21.15.92:0/1601825019 wait complete. 2024-09-19T09:02:43.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.103+0000 7f3a3dfea740 20 client.26047 trim_cache size 0 max 16384 2024-09-19T09:02:43.106 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-19T09:02:43.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.106+0000 7f3a3bc11640 1 -- 172.21.15.92:0/247527949 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3a200a32c0 msgr2=0x7f3a200a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:43.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.106+0000 7f3a3bc11640 1 --2- 172.21.15.92:0/247527949 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3a200a32c0 0x7f3a200a5780 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3a300096c0 tx=0x7f3a30005a20 comp rx=0 tx=0).stop 2024-09-19T09:02:43.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.106+0000 7f3a3bc11640 1 -- 172.21.15.92:0/247527949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a3410d520 msgr2=0x7f3a3419e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:43.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.106+0000 7f3a3bc11640 1 --2- 172.21.15.92:0/247527949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a3410d520 0x7f3a3419e850 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c00e940 tx=0x7f3a2c00ee00 comp rx=0 tx=0).stop 2024-09-19T09:02:43.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.106+0000 7f3a3bc11640 1 -- 172.21.15.92:0/247527949 shutdown_connections 2024-09-19T09:02:43.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.106+0000 7f3a3bc11640 1 --2- 172.21.15.92:0/247527949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a3410d520 0x7f3a3419e850 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.106+0000 7f3a3bc11640 1 --2- 172.21.15.92:0/247527949 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3a200a32c0 0x7f3a200a5780 secure :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3a300096c0 tx=0x7f3a30005a20 comp rx=0 tx=0).stop 2024-09-19T09:02:43.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.106+0000 7f3a3bc11640 1 --2- 172.21.15.92:0/247527949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a34108da0 0x7f3a341a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.106+0000 7f3a3bc11640 1 --2- 172.21.15.92:0/247527949 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a341083f0 0x7f3a341a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:43.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.106+0000 7f3a3bc11640 1 -- 172.21.15.92:0/247527949 >> 172.21.15.92:0/247527949 conn(0x7f3a34077af0 msgr2=0x7f3a34078e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:43.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.107+0000 7f3a3bc11640 1 -- 172.21.15.92:0/247527949 shutdown_connections 2024-09-19T09:02:43.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:43.107+0000 7f3a3bc11640 1 -- 172.21.15.92:0/247527949 wait complete. 2024-09-19T09:02:43.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:43 smithi092 ceph-mon[31407]: pgmap v517: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 48 MiB/s wr, 1.48k op/s 2024-09-19T09:02:43.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:43 smithi167 ceph-mon[35359]: pgmap v517: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 48 MiB/s wr, 1.48k op/s 2024-09-19T09:02:43.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:43 smithi190 ceph-mon[35358]: pgmap v517: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 48 MiB/s wr, 1.48k op/s 2024-09-19T09:02:45.022 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:02:45.022 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:02:45.419 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:45.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:45 smithi092 ceph-mon[31407]: pgmap v518: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 48 MiB/s wr, 1.52k op/s 2024-09-19T09:02:45.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 360.0 s, 3187.6 tps, lat 31.201 ms stddev 33.224 2024-09-19T09:02:45.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:45 smithi167 ceph-mon[35359]: pgmap v518: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 48 MiB/s wr, 1.52k op/s 2024-09-19T09:02:45.880 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:45 smithi190 ceph-mon[35358]: pgmap v518: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 48 MiB/s wr, 1.52k op/s 2024-09-19T09:02:45.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:45.996+0000 7f434d16d640 1 -- 172.21.15.92:0/1918845102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4348102790 msgr2=0x7f43481067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:45.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:45.996+0000 7f434d16d640 1 --2- 172.21.15.92:0/1918845102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4348102790 0x7f43481067e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f433c009860 tx=0x7f433c02a360 comp rx=0 tx=0).stop 2024-09-19T09:02:45.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:45.996+0000 7f434d16d640 1 -- 172.21.15.92:0/1918845102 shutdown_connections 2024-09-19T09:02:45.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:45.996+0000 7f434d16d640 1 --2- 172.21.15.92:0/1918845102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4348106f10 0x7f434810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:45.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:45.996+0000 7f434d16d640 1 --2- 172.21.15.92:0/1918845102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4348102790 0x7f43481067e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:45.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:45.996+0000 7f434d16d640 1 --2- 172.21.15.92:0/1918845102 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4348101de0 0x7f43481021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:45.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:45.996+0000 7f434d16d640 1 -- 172.21.15.92:0/1918845102 >> 172.21.15.92:0/1918845102 conn(0x7f43480fd8e0 msgr2=0x7f43480ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:45.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:45.996+0000 7f434d16d640 1 -- 172.21.15.92:0/1918845102 shutdown_connections 2024-09-19T09:02:45.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:45.996+0000 7f434d16d640 1 -- 172.21.15.92:0/1918845102 wait complete. 2024-09-19T09:02:45.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:45.997+0000 7f434d16d640 1 Processor -- start 2024-09-19T09:02:45.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:45.998+0000 7f434d16d640 1 -- start start 2024-09-19T09:02:45.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:45.998+0000 7f434d16d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4348101de0 0x7f43481a4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:45.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:45.998+0000 7f434d16d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4348102790 0x7f43481a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:45.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:45.998+0000 7f434d16d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4348106f10 0x7f434810dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:45.998+0000 7f434d16d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4348111fb0 con 0x7f4348102790 2024-09-19T09:02:46.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:45.998+0000 7f434d16d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4348111e30 con 0x7f4348101de0 2024-09-19T09:02:46.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:45.998+0000 7f434d16d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4348112130 con 0x7f4348106f10 2024-09-19T09:02:46.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:45.998+0000 7f4346d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4348101de0 0x7f43481a4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:45.999+0000 7f4346d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4348101de0 0x7f43481a4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:39000/0 (socket says 172.21.15.92:39000) 2024-09-19T09:02:46.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:45.999+0000 7f4346d9d640 1 -- 172.21.15.92:0/4185182761 learned_addr learned my addr 172.21.15.92:0/4185182761 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:46.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:45.999+0000 7f434759e640 1 --2- 172.21.15.92:0/4185182761 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4348106f10 0x7f434810dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:45.999+0000 7f434759e640 1 -- 172.21.15.92:0/4185182761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4348101de0 msgr2=0x7f43481a4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:46.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:45.999+0000 7f434759e640 1 --2- 172.21.15.92:0/4185182761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4348101de0 0x7f43481a4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:45.999+0000 7f434759e640 1 -- 172.21.15.92:0/4185182761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4348102790 msgr2=0x7f43481a4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:46.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:45.999+0000 7f434759e640 1 --2- 172.21.15.92:0/4185182761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4348102790 0x7f43481a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:45.999+0000 7f434759e640 1 -- 172.21.15.92:0/4185182761 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f434810e3f0 con 0x7f4348106f10 2024-09-19T09:02:46.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.000+0000 7f434759e640 1 --2- 172.21.15.92:0/4185182761 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4348106f10 0x7f434810dc70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f434000efc0 tx=0x7f434000c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:46.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.000+0000 7f432ffff640 1 -- 172.21.15.92:0/4185182761 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434002b020 con 0x7f4348106f10 2024-09-19T09:02:46.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.000+0000 7f434d16d640 1 -- 172.21.15.92:0/4185182761 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f434810e6e0 con 0x7f4348106f10 2024-09-19T09:02:46.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.000+0000 7f432ffff640 1 -- 172.21.15.92:0/4185182761 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4340003b70 con 0x7f4348106f10 2024-09-19T09:02:46.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.000+0000 7f434d16d640 1 -- 172.21.15.92:0/4185182761 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f434806bc10 con 0x7f4348106f10 2024-09-19T09:02:46.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.001+0000 7f432ffff640 1 -- 172.21.15.92:0/4185182761 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43400277e0 con 0x7f4348106f10 2024-09-19T09:02:46.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.004+0000 7f434f546740 1 Processor -- start 2024-09-19T09:02:46.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.005+0000 7f434f546740 1 -- start start 2024-09-19T09:02:46.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.005+0000 7f434f546740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55825b4cfb60 0x55825b4cff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.005+0000 7f432ffff640 1 -- 172.21.15.92:0/4185182761 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4340004020 con 0x7f4348106f10 2024-09-19T09:02:46.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.005+0000 7f434659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55825b4cfb60 0x55825b4cff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.006+0000 7f434659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55825b4cfb60 0x55825b4cff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51574/0 (socket says 172.21.15.92:51574) 2024-09-19T09:02:46.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.006+0000 7f434659c640 1 -- 172.21.15.92:0/3446751074 learned_addr learned my addr 172.21.15.92:0/3446751074 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:46.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.006+0000 7f434f546740 1 --2- 172.21.15.92:0/3446751074 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55825b4d0480 0x55825b4da800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.006+0000 7f434f546740 1 --2- 172.21.15.92:0/3446751074 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55825b4dad40 0x55825b4dd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.006+0000 7f434f546740 1 -- 172.21.15.92:0/3446751074 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55825b435280 con 0x55825b4cfb60 2024-09-19T09:02:46.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.006+0000 7f434f546740 1 -- 172.21.15.92:0/3446751074 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55825b3dcb10 con 0x55825b4dad40 2024-09-19T09:02:46.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.006+0000 7f434f546740 1 -- 172.21.15.92:0/3446751074 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55825b431240 con 0x55825b4d0480 2024-09-19T09:02:46.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.006+0000 7f4346d9d640 1 --2- 172.21.15.92:0/3446751074 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55825b4d0480 0x55825b4da800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.006+0000 7f434659c640 1 --2- 172.21.15.92:0/3446751074 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55825b4dad40 0x55825b4dd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.006+0000 7f4346d9d640 1 -- 172.21.15.92:0/3446751074 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55825b4dad40 msgr2=0x55825b4dd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:46.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.006+0000 7f4346d9d640 1 --2- 172.21.15.92:0/3446751074 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55825b4dad40 0x55825b4dd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.006+0000 7f4346d9d640 1 -- 172.21.15.92:0/3446751074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55825b4cfb60 msgr2=0x55825b4cff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:46.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.006+0000 7f4346d9d640 1 --2- 172.21.15.92:0/3446751074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55825b4cfb60 0x55825b4cff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.006+0000 7f4346d9d640 1 -- 172.21.15.92:0/3446751074 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55825b3e91f0 con 0x55825b4d0480 2024-09-19T09:02:46.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.007+0000 7f4346d9d640 1 --2- 172.21.15.92:0/3446751074 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55825b4d0480 0x55825b4da800 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4338009a40 tx=0x7f4338009f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=561e901a88949618 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:46.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.007+0000 7f432ffff640 1 --2- 172.21.15.92:0/4185182761 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f43300a3410 0x7f43300a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.008+0000 7f432ffff640 1 -- 172.21.15.92:0/4185182761 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f43400e0c20 con 0x7f4348106f10 2024-09-19T09:02:46.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.007+0000 7f432d7fa640 1 -- 172.21.15.92:0/3446751074 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4338017070 con 0x55825b4d0480 2024-09-19T09:02:46.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.008+0000 7f432d7fa640 1 -- 172.21.15.92:0/3446751074 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4338013470 con 0x55825b4d0480 2024-09-19T09:02:46.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.008+0000 7f432d7fa640 1 -- 172.21.15.92:0/3446751074 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4338012630 con 0x55825b4d0480 2024-09-19T09:02:46.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.009+0000 7f434659c640 1 --2- 172.21.15.92:0/4185182761 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f43300a3410 0x7f43300a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.010+0000 7f434f546740 1 -- 172.21.15.92:0/3446751074 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55825b4d0480 msgr2=0x55825b4da800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:46.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.010+0000 7f434f546740 1 --2- 172.21.15.92:0/3446751074 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55825b4d0480 0x55825b4da800 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4338009a40 tx=0x7f4338009f00 comp rx=0 tx=0).stop 2024-09-19T09:02:46.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.010+0000 7f434659c640 1 --2- 172.21.15.92:0/4185182761 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f43300a3410 0x7f43300a58d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f433c009830 tx=0x7f433c005b00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:46.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.010+0000 7f434f546740 1 -- 172.21.15.92:0/3446751074 shutdown_connections 2024-09-19T09:02:46.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.010+0000 7f434f546740 1 --2- 172.21.15.92:0/3446751074 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55825b4dad40 0x55825b4dd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.010+0000 7f434f546740 1 --2- 172.21.15.92:0/3446751074 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55825b4d0480 0x55825b4da800 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.010+0000 7f434f546740 1 --2- 172.21.15.92:0/3446751074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55825b4cfb60 0x55825b4cff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.010+0000 7f434f546740 1 -- 172.21.15.92:0/3446751074 >> 172.21.15.92:0/3446751074 conn(0x55825b4cc0f0 msgr2=0x55825b4cc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:46.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.010+0000 7f434f546740 1 -- 172.21.15.92:0/3446751074 shutdown_connections 2024-09-19T09:02:46.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.010+0000 7f434f546740 1 -- 172.21.15.92:0/3446751074 wait complete. 2024-09-19T09:02:46.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.010+0000 7f434f546740 1 -- start start 2024-09-19T09:02:46.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.011+0000 7f434f546740 1 Processor -- start 2024-09-19T09:02:46.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.011+0000 7f434f546740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55825b4cfb60 0x55825b4d7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.011+0000 7f434f546740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55825b4d0480 0x55825b4d80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.011+0000 7f434f546740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55825b4dad40 0x55825b4d8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.012+0000 7f434f546740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55825b4dd910 con 0x55825b4cfb60 2024-09-19T09:02:46.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.012+0000 7f434f546740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55825b3eff10 con 0x55825b4d0480 2024-09-19T09:02:46.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.012+0000 7f434f546740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55825b4dda90 con 0x55825b4dad40 2024-09-19T09:02:46.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.012+0000 7f434659c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55825b4d0480 0x55825b4d80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.012+0000 7f434659c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55825b4d0480 0x55825b4d80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:39028/0 (socket says 172.21.15.92:39028) 2024-09-19T09:02:46.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.012+0000 7f434659c640 1 -- 172.21.15.92:0/563102180 learned_addr learned my addr 172.21.15.92:0/563102180 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:46.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.012+0000 7f434759e640 1 --2- 172.21.15.92:0/563102180 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55825b4dad40 0x55825b4d8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.012+0000 7f434759e640 1 -- 172.21.15.92:0/563102180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55825b4d0480 msgr2=0x55825b4d80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:46.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.012+0000 7f434759e640 1 --2- 172.21.15.92:0/563102180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55825b4d0480 0x55825b4d80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.012+0000 7f434759e640 1 -- 172.21.15.92:0/563102180 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55825b4cfb60 msgr2=0x55825b4d7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:46.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.012+0000 7f434759e640 1 --2- 172.21.15.92:0/563102180 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55825b4cfb60 0x55825b4d7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.012+0000 7f434759e640 1 -- 172.21.15.92:0/563102180 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55825b1a66a0 con 0x55825b4dad40 2024-09-19T09:02:46.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.012+0000 7f434f546740 10 client.0 _ll_register_callbacks cb 0x55825b3b8a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:46.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.012+0000 7f434759e640 1 --2- 172.21.15.92:0/563102180 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55825b4dad40 0x55825b4d8610 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f43400de6e0 tx=0x7f43400acec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5bacc8e9eaed44a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:46.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.013+0000 7f432aff5640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:02:46.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.013+0000 7f434f546740 1 -- 172.21.15.92:0/563102180 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4338013470 con 0x55825b4dad40 2024-09-19T09:02:46.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.013+0000 7f432aff5640 1 -- 172.21.15.92:0/563102180 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43400c6060 con 0x55825b4dad40 2024-09-19T09:02:46.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.013+0000 7f432aff5640 1 -- 172.21.15.92:0/563102180 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f43400cd0c0 con 0x55825b4dad40 2024-09-19T09:02:46.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.013+0000 7f432aff5640 1 -- 172.21.15.92:0/563102180 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f43400c6200 con 0x55825b4dad40 2024-09-19T09:02:46.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.013+0000 7f434f546740 10 client.26059 fetch_fsmap learned FSMap version 19 2024-09-19T09:02:46.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.013+0000 7f434f546740 1 -- 172.21.15.92:0/563102180 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55825b4e94b0 con 0x55825b4dad40 2024-09-19T09:02:46.016 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.014+0000 7f432aff5640 1 -- 172.21.15.92:0/563102180 <== mon.1 v2:172.21.15.190:3300/0 4 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f434000b040 con 0x55825b4dad40 2024-09-19T09:02:46.016 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.015+0000 7f434f546740 10 client.26059 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:02:46.016 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.015+0000 7f434f546740 10 client.26059 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:02:46.016 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.015+0000 7f434f546740 20 client.26059 populate_metadata read hostname 'smithi092' 2024-09-19T09:02:46.016 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.015+0000 7f434f546740 1 --2- 172.21.15.92:0/563102180 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55825b4ea800 0x55825b4ecc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.016 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.015+0000 7f434f546740 4 client.26059 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:02:46.016 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.015+0000 7f434f546740 1 -- 172.21.15.92:0/563102180 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4338013470 con 0x55825b4ea800 2024-09-19T09:02:46.016 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.016+0000 7f4346d9d640 1 --2- 172.21.15.92:0/563102180 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55825b4ea800 0x55825b4ecc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.016+0000 7f432aff5640 10 client.26059 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:46.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.016+0000 7f4346d9d640 1 --2- 172.21.15.92:0/563102180 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55825b4ea800 0x55825b4ecc70 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e2d4e39a8210dd8 server_cookie=dab78b2f254afb12 in_seq=0 out_seq=0 2024-09-19T09:02:46.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.017+0000 7f432aff5640 1 -- 172.21.15.92:0/563102180 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f4338013470 con 0x55825b4ea800 2024-09-19T09:02:46.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.017+0000 7f432aff5640 10 client.26059 handle_command_reply: tid=0 2024-09-19T09:02:46.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.017+0000 7f434f546740 1 client.26059 shutdown 2024-09-19T09:02:46.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.018+0000 7f434f546740 1 -- 172.21.15.92:0/563102180 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55825b4dad40 msgr2=0x55825b4d8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:46.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.018+0000 7f434f546740 1 --2- 172.21.15.92:0/563102180 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55825b4dad40 0x55825b4d8610 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f43400de6e0 tx=0x7f43400acec0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.018+0000 7f434f546740 1 -- 172.21.15.92:0/563102180 shutdown_connections 2024-09-19T09:02:46.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.018+0000 7f434f546740 1 --2- 172.21.15.92:0/563102180 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55825b4ea800 0x55825b4ecc70 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.018+0000 7f432aff5640 0 client.26059 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:46.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.018+0000 7f434f546740 1 --2- 172.21.15.92:0/563102180 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55825b4dad40 0x55825b4d8610 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.018+0000 7f434f546740 1 --2- 172.21.15.92:0/563102180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55825b4d0480 0x55825b4d80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.018+0000 7f434f546740 1 --2- 172.21.15.92:0/563102180 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55825b4cfb60 0x55825b4d7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.018+0000 7f434f546740 1 -- 172.21.15.92:0/563102180 >> 172.21.15.92:0/563102180 conn(0x55825b4cc0f0 msgr2=0x55825b4cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:46.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.019+0000 7f434f546740 1 -- 172.21.15.92:0/563102180 shutdown_connections 2024-09-19T09:02:46.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.019+0000 7f434f546740 1 -- 172.21.15.92:0/563102180 wait complete. 2024-09-19T09:02:46.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.019+0000 7f434f546740 20 client.26059 trim_cache size 0 max 16384 2024-09-19T09:02:46.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.047+0000 7f434f546740 1 Processor -- start 2024-09-19T09:02:46.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.047+0000 7f434f546740 1 -- start start 2024-09-19T09:02:46.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.048+0000 7f434f546740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55825b4cfb60 0x55825b4d8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.048+0000 7f434f546740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55825b4d0480 0x55825b4d99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.048+0000 7f434f546740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55825b4dad40 0x55825b4f2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.048+0000 7f434f546740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f433400c490 con 0x55825b4cfb60 2024-09-19T09:02:46.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.048+0000 7f434f546740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f433400ed30 con 0x55825b4d0480 2024-09-19T09:02:46.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.048+0000 7f434f546740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f433400cb20 con 0x55825b4dad40 2024-09-19T09:02:46.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.048+0000 7f434759e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55825b4dad40 0x55825b4f2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.048+0000 7f434759e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55825b4dad40 0x55825b4f2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:47216/0 (socket says 172.21.15.92:47216) 2024-09-19T09:02:46.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.048+0000 7f434759e640 1 -- 172.21.15.92:0/4066036865 learned_addr learned my addr 172.21.15.92:0/4066036865 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:46.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.048+0000 7f434659c640 1 --2- 172.21.15.92:0/4066036865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55825b4d0480 0x55825b4d99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.048+0000 7f4346d9d640 1 --2- 172.21.15.92:0/4066036865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55825b4cfb60 0x55825b4d8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.048+0000 7f434759e640 1 -- 172.21.15.92:0/4066036865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55825b4d0480 msgr2=0x55825b4d99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:46.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.048+0000 7f434759e640 1 --2- 172.21.15.92:0/4066036865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55825b4d0480 0x55825b4d99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.048+0000 7f434759e640 1 -- 172.21.15.92:0/4066036865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55825b4cfb60 msgr2=0x55825b4d8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:46.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.048+0000 7f434759e640 1 --2- 172.21.15.92:0/4066036865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55825b4cfb60 0x55825b4d8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.049+0000 7f434759e640 1 -- 172.21.15.92:0/4066036865 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55825b4d02b0 con 0x55825b4dad40 2024-09-19T09:02:46.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.049+0000 7f434759e640 1 --2- 172.21.15.92:0/4066036865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55825b4dad40 0x55825b4f2540 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f43400a9c10 tx=0x7f43400b3000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55e2b93bd855a4b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:46.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.049+0000 7f432cff9640 1 -- 172.21.15.92:0/4066036865 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43400c6060 con 0x55825b4dad40 2024-09-19T09:02:46.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.049+0000 7f432cff9640 1 -- 172.21.15.92:0/4066036865 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43400b5e70 con 0x55825b4dad40 2024-09-19T09:02:46.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.049+0000 7f432cff9640 1 -- 172.21.15.92:0/4066036865 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43400b1690 con 0x55825b4dad40 2024-09-19T09:02:46.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.050+0000 7f434f546740 1 -- 172.21.15.92:0/4066036865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55825b4dad40 msgr2=0x55825b4f2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:46.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.050+0000 7f434f546740 1 --2- 172.21.15.92:0/4066036865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55825b4dad40 0x55825b4f2540 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f43400a9c10 tx=0x7f43400b3000 comp rx=0 tx=0).stop 2024-09-19T09:02:46.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.050+0000 7f434f546740 1 -- 172.21.15.92:0/4066036865 shutdown_connections 2024-09-19T09:02:46.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.050+0000 7f434f546740 1 --2- 172.21.15.92:0/4066036865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55825b4dad40 0x55825b4f2540 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.050+0000 7f434f546740 1 --2- 172.21.15.92:0/4066036865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55825b4d0480 0x55825b4d99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.050+0000 7f434f546740 1 --2- 172.21.15.92:0/4066036865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55825b4cfb60 0x55825b4d8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.050+0000 7f434f546740 1 -- 172.21.15.92:0/4066036865 >> 172.21.15.92:0/4066036865 conn(0x55825b4cc0f0 msgr2=0x55825b4d92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:46.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.051+0000 7f434f546740 1 -- 172.21.15.92:0/4066036865 shutdown_connections 2024-09-19T09:02:46.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.051+0000 7f434f546740 1 -- 172.21.15.92:0/4066036865 wait complete. 2024-09-19T09:02:46.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.051+0000 7f434f546740 1 -- start start 2024-09-19T09:02:46.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.051+0000 7f434f546740 1 Processor -- start 2024-09-19T09:02:46.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.052+0000 7f434f546740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55825b4cfb60 0x55825b4d4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.052+0000 7f434f546740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55825b4d0480 0x55825b4d50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.052+0000 7f4346d9d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55825b4cfb60 0x55825b4d4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.052+0000 7f434f546740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55825b4dad40 0x55825b4d5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.052+0000 7f434f546740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f433400d1f0 con 0x55825b4dad40 2024-09-19T09:02:46.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.052+0000 7f434f546740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f433400e660 con 0x55825b4d0480 2024-09-19T09:02:46.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.052+0000 7f4346d9d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55825b4cfb60 0x55825b4d4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:47230/0 (socket says 172.21.15.92:47230) 2024-09-19T09:02:46.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.052+0000 7f434f546740 1 -- 172.21.15.92:0/361618769 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f433400d8c0 con 0x55825b4cfb60 2024-09-19T09:02:46.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.052+0000 7f4346d9d640 1 -- 172.21.15.92:0/361618769 learned_addr learned my addr 172.21.15.92:0/361618769 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:46.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.052+0000 7f434f546740 10 client.0 _ll_register_callbacks cb 0x7f434000cf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:46.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.052+0000 7f434659c640 1 --2- 172.21.15.92:0/361618769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55825b4d0480 0x55825b4d50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.053+0000 7f434759e640 1 --2- 172.21.15.92:0/361618769 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55825b4dad40 0x55825b4d5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.053+0000 7f4346d9d640 1 -- 172.21.15.92:0/361618769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55825b4d0480 msgr2=0x55825b4d50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:46.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.053+0000 7f4346d9d640 1 --2- 172.21.15.92:0/361618769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55825b4d0480 0x55825b4d50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.053+0000 7f4346d9d640 1 -- 172.21.15.92:0/361618769 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55825b4dad40 msgr2=0x55825b4d5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:46.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.053+0000 7f4346d9d640 1 --2- 172.21.15.92:0/361618769 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55825b4dad40 0x55825b4d5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.053+0000 7f4346d9d640 1 -- 172.21.15.92:0/361618769 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55825b554510 con 0x55825b4cfb60 2024-09-19T09:02:46.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.054+0000 7f4346d9d640 1 --2- 172.21.15.92:0/361618769 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55825b4cfb60 0x55825b4d4b80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f433800e660 tx=0x7f4338013e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fb06400ac2a2feb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:46.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.054+0000 7f432aff5640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:02:46.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.054+0000 7f432aff5640 1 -- 172.21.15.92:0/361618769 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4338017040 con 0x55825b4cfb60 2024-09-19T09:02:46.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.054+0000 7f432aff5640 1 -- 172.21.15.92:0/361618769 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4338022070 con 0x55825b4cfb60 2024-09-19T09:02:46.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.054+0000 7f434f546740 1 -- 172.21.15.92:0/361618769 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43400b5e70 con 0x55825b4cfb60 2024-09-19T09:02:46.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.054+0000 7f432aff5640 1 -- 172.21.15.92:0/361618769 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f433800ebc0 con 0x55825b4cfb60 2024-09-19T09:02:46.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.054+0000 7f434f546740 10 client.26065 fetch_fsmap learned FSMap version 19 2024-09-19T09:02:46.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.054+0000 7f434f546740 1 -- 172.21.15.92:0/361618769 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55825b555810 con 0x55825b4cfb60 2024-09-19T09:02:46.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.055+0000 7f432aff5640 1 -- 172.21.15.92:0/361618769 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43400b5e70 con 0x55825b4cfb60 2024-09-19T09:02:46.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.055+0000 7f432aff5640 1 -- 172.21.15.92:0/361618769 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f433802d030 con 0x55825b4cfb60 2024-09-19T09:02:46.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.055+0000 7f434f546740 10 client.26065 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:02:46.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.055+0000 7f434f546740 10 client.26065 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:02:46.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.055+0000 7f434f546740 20 client.26065 populate_metadata read hostname 'smithi092' 2024-09-19T09:02:46.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.055+0000 7f434f546740 1 --2- 172.21.15.92:0/361618769 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55825b4ea800 0x55825b557c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.055+0000 7f434f546740 4 client.26065 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:02:46.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.055+0000 7f434f546740 1 -- 172.21.15.92:0/361618769 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55825b4427f0 con 0x55825b4ea800 2024-09-19T09:02:46.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.055+0000 7f434659c640 1 --2- 172.21.15.92:0/361618769 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55825b4ea800 0x55825b557c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.056+0000 7f434659c640 1 --2- 172.21.15.92:0/361618769 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55825b4ea800 0x55825b557c20 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72e12803ec915b3d server_cookie=d14a2deaf4f3ee19 in_seq=0 out_seq=0 2024-09-19T09:02:46.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.056+0000 7f432aff5640 10 client.26065 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:46.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.057+0000 7f432aff5640 1 -- 172.21.15.92:0/361618769 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55825b4427f0 con 0x55825b4ea800 2024-09-19T09:02:46.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.058+0000 7f432aff5640 10 client.26065 handle_command_reply: tid=0 2024-09-19T09:02:46.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.058+0000 7f434f546740 1 client.26065 shutdown 2024-09-19T09:02:46.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.058+0000 7f434f546740 1 -- 172.21.15.92:0/361618769 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55825b4cfb60 msgr2=0x55825b4d4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:46.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.058+0000 7f434f546740 1 --2- 172.21.15.92:0/361618769 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55825b4cfb60 0x55825b4d4b80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f433800e660 tx=0x7f4338013e20 comp rx=0 tx=0).stop 2024-09-19T09:02:46.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.058+0000 7f434f546740 1 -- 172.21.15.92:0/361618769 shutdown_connections 2024-09-19T09:02:46.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.058+0000 7f434f546740 1 --2- 172.21.15.92:0/361618769 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55825b4ea800 0x55825b557c20 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.058+0000 7f434f546740 1 --2- 172.21.15.92:0/361618769 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55825b4dad40 0x55825b4d5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.058+0000 7f434f546740 1 --2- 172.21.15.92:0/361618769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55825b4d0480 0x55825b4d50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.058+0000 7f434f546740 1 --2- 172.21.15.92:0/361618769 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55825b4cfb60 0x55825b4d4b80 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.058+0000 7f434f546740 1 -- 172.21.15.92:0/361618769 >> 172.21.15.92:0/361618769 conn(0x55825b4cc0f0 msgr2=0x55825b4cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:46.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.058+0000 7f432aff5640 0 client.26065 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:46.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.059+0000 7f434f546740 1 -- 172.21.15.92:0/361618769 shutdown_connections 2024-09-19T09:02:46.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.059+0000 7f434f546740 1 -- 172.21.15.92:0/361618769 wait complete. 2024-09-19T09:02:46.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.059+0000 7f434f546740 20 client.26065 trim_cache size 0 max 16384 2024-09-19T09:02:46.061 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:02:46.062 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-19T09:02:46.062 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "500f4e8b-e9f8-4089-ace6-188fb2507ec7", 2024-09-19T09:02:46.062 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-19T09:02:46.062 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:02:46.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.060+0000 7f434d16d640 1 -- 172.21.15.92:0/4185182761 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f43300a3410 msgr2=0x7f43300a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:46.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.060+0000 7f434d16d640 1 --2- 172.21.15.92:0/4185182761 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f43300a3410 0x7f43300a58d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f433c009830 tx=0x7f433c005b00 comp rx=0 tx=0).stop 2024-09-19T09:02:46.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.060+0000 7f434d16d640 1 -- 172.21.15.92:0/4185182761 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4348106f10 msgr2=0x7f434810dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:46.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.060+0000 7f434d16d640 1 --2- 172.21.15.92:0/4185182761 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4348106f10 0x7f434810dc70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f434000efc0 tx=0x7f434000c800 comp rx=0 tx=0).stop 2024-09-19T09:02:46.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.060+0000 7f434d16d640 1 -- 172.21.15.92:0/4185182761 shutdown_connections 2024-09-19T09:02:46.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.060+0000 7f434d16d640 1 --2- 172.21.15.92:0/4185182761 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4348106f10 0x7f434810dc70 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.060+0000 7f434d16d640 1 --2- 172.21.15.92:0/4185182761 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f43300a3410 0x7f43300a58d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.060+0000 7f434d16d640 1 --2- 172.21.15.92:0/4185182761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4348102790 0x7f43481a4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.060+0000 7f434d16d640 1 --2- 172.21.15.92:0/4185182761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4348101de0 0x7f43481a4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.060+0000 7f434d16d640 1 -- 172.21.15.92:0/4185182761 >> 172.21.15.92:0/4185182761 conn(0x7f43480fd8e0 msgr2=0x7f43480ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:46.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.061+0000 7f434d16d640 1 -- 172.21.15.92:0/4185182761 shutdown_connections 2024-09-19T09:02:46.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:46.061+0000 7f434d16d640 1 -- 172.21.15.92:0/4185182761 wait complete. 2024-09-19T09:02:46.841 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:46 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:02:46.841 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:46 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:02:46.841 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:46 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:02:46.841 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:46 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:02:46.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:46 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:02:46.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:46 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:02:46.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:46 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:02:46.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:46 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:02:46.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:46 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:02:46.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:46 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:02:46.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:46 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:02:46.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:46 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:02:46.884 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:02:47.271 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:47.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:47 smithi092 ceph-mon[31407]: scrub queued for path: / 2024-09-19T09:02:47.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:47 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:02:47.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:47 smithi092 ceph-mon[31407]: scrub summary: active paths [/] 2024-09-19T09:02:47.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:47 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:02:47.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:47 smithi092 ceph-mon[31407]: pgmap v519: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 44 MiB/s wr, 1.41k op/s 2024-09-19T09:02:47.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:47 smithi167 ceph-mon[35359]: scrub queued for path: / 2024-09-19T09:02:47.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:47 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:02:47.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:47 smithi167 ceph-mon[35359]: scrub summary: active paths [/] 2024-09-19T09:02:47.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:47 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:02:47.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:47 smithi167 ceph-mon[35359]: pgmap v519: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 44 MiB/s wr, 1.41k op/s 2024-09-19T09:02:47.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:47 smithi190 ceph-mon[35358]: scrub queued for path: / 2024-09-19T09:02:47.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:47 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:02:47.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:47 smithi190 ceph-mon[35358]: scrub summary: active paths [/] 2024-09-19T09:02:47.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:47 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:02:47.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:47 smithi190 ceph-mon[35358]: pgmap v519: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 44 MiB/s wr, 1.41k op/s 2024-09-19T09:02:48.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.047+0000 7f5246827640 1 -- 172.21.15.92:0/4285342779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5240108280 msgr2=0x7f5240108660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:48.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.047+0000 7f5246827640 1 --2- 172.21.15.92:0/4285342779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5240108280 0x7f5240108660 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5230009860 tx=0x7f523002a340 comp rx=0 tx=0).stop 2024-09-19T09:02:48.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.048+0000 7f5246827640 1 -- 172.21.15.92:0/4285342779 shutdown_connections 2024-09-19T09:02:48.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.048+0000 7f5246827640 1 --2- 172.21.15.92:0/4285342779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f524010d4b0 0x7f5240115030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.048+0000 7f5246827640 1 --2- 172.21.15.92:0/4285342779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5240108c30 0x7f524010cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.048+0000 7f5246827640 1 --2- 172.21.15.92:0/4285342779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5240108280 0x7f5240108660 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.048+0000 7f5246827640 1 -- 172.21.15.92:0/4285342779 >> 172.21.15.92:0/4285342779 conn(0x7f5240077a10 msgr2=0x7f5240079e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:48.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.048+0000 7f5246827640 1 -- 172.21.15.92:0/4285342779 shutdown_connections 2024-09-19T09:02:48.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.048+0000 7f5246827640 1 -- 172.21.15.92:0/4285342779 wait complete. 2024-09-19T09:02:48.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.049+0000 7f5246827640 1 Processor -- start 2024-09-19T09:02:48.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.049+0000 7f5246827640 1 -- start start 2024-09-19T09:02:48.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.050+0000 7f5246827640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5240108280 0x7f52401a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.050+0000 7f5246827640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5240108c30 0x7f52401a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.050+0000 7f5246827640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f524010d4b0 0x7f524019e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.050+0000 7f523ffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5240108280 0x7f52401a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:48.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.050+0000 7f523ffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5240108280 0x7f52401a46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:47248/0 (socket says 172.21.15.92:47248) 2024-09-19T09:02:48.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.050+0000 7f523f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5240108c30 0x7f52401a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:48.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.050+0000 7f523f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5240108c30 0x7f52401a4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:39076/0 (socket says 172.21.15.92:39076) 2024-09-19T09:02:48.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.051+0000 7f5246827640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5240118500 con 0x7f524010d4b0 2024-09-19T09:02:48.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.051+0000 7f5244dc4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f524010d4b0 0x7f524019e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:48.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.051+0000 7f5246827640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5240118380 con 0x7f5240108c30 2024-09-19T09:02:48.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.051+0000 7f5246827640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5240118680 con 0x7f5240108280 2024-09-19T09:02:48.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.051+0000 7f5244dc4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f524010d4b0 0x7f524019e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51608/0 (socket says 172.21.15.92:51608) 2024-09-19T09:02:48.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.051+0000 7f5244dc4640 1 -- 172.21.15.92:0/2523701746 learned_addr learned my addr 172.21.15.92:0/2523701746 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:48.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.052+0000 7f5244dc4640 1 -- 172.21.15.92:0/2523701746 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5240108280 msgr2=0x7f52401a46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:48.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.052+0000 7f5244dc4640 1 --2- 172.21.15.92:0/2523701746 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5240108280 0x7f52401a46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.052+0000 7f5244dc4640 1 -- 172.21.15.92:0/2523701746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5240108c30 msgr2=0x7f52401a4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:48.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.052+0000 7f5244dc4640 1 --2- 172.21.15.92:0/2523701746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5240108c30 0x7f52401a4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.052+0000 7f5244dc4640 1 -- 172.21.15.92:0/2523701746 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f524019efd0 con 0x7f524010d4b0 2024-09-19T09:02:48.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.052+0000 7f523ffff640 1 --2- 172.21.15.92:0/2523701746 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5240108280 0x7f52401a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:02:48.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.052+0000 7f5244dc4640 1 --2- 172.21.15.92:0/2523701746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f524010d4b0 0x7f524019e830 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f523800eee0 tx=0x7f523800c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:48.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.052+0000 7f523d7fa640 1 -- 172.21.15.92:0/2523701746 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5238004b20 con 0x7f524010d4b0 2024-09-19T09:02:48.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.052+0000 7f523d7fa640 1 -- 172.21.15.92:0/2523701746 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5238003e50 con 0x7f524010d4b0 2024-09-19T09:02:48.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.052+0000 7f523d7fa640 1 -- 172.21.15.92:0/2523701746 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5238005280 con 0x7f524010d4b0 2024-09-19T09:02:48.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.053+0000 7f5246827640 1 -- 172.21.15.92:0/2523701746 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f524019f2c0 con 0x7f524010d4b0 2024-09-19T09:02:48.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.053+0000 7f5246827640 1 -- 172.21.15.92:0/2523701746 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52401ab510 con 0x7f524010d4b0 2024-09-19T09:02:48.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.056+0000 7f523d7fa640 1 -- 172.21.15.92:0/2523701746 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f523801d020 con 0x7f524010d4b0 2024-09-19T09:02:48.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.056+0000 7f5248c00740 1 Processor -- start 2024-09-19T09:02:48.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.057+0000 7f5248c00740 1 -- start start 2024-09-19T09:02:48.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.057+0000 7f5248c00740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56207dfc0670 0x56207dfc0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.057+0000 7f5248c00740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56207dfc0f90 0x56207dfcb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.057+0000 7f5248c00740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56207dfcb850 0x56207dfcdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.057+0000 7f5248c00740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56207df262e0 con 0x56207dfc0670 2024-09-19T09:02:48.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.057+0000 7f5248c00740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56207decdce0 con 0x56207dfcb850 2024-09-19T09:02:48.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.057+0000 7f5248c00740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56207df222a0 con 0x56207dfc0f90 2024-09-19T09:02:48.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.058+0000 7f523ffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56207dfc0f90 0x56207dfcb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:48.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.058+0000 7f523f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56207dfcb850 0x56207dfcdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:48.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.058+0000 7f523f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56207dfc0670 0x56207dfc0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:48.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.058+0000 7f523d7fa640 1 --2- 172.21.15.92:0/2523701746 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f52280a3300 0x7f52280a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.058+0000 7f523f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56207dfc0670 0x56207dfc0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51620/0 (socket says 172.21.15.92:51620) 2024-09-19T09:02:48.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.058+0000 7f523f7fe640 1 -- 172.21.15.92:0/3523186945 learned_addr learned my addr 172.21.15.92:0/3523186945 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:48.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.058+0000 7f523d7fa640 1 -- 172.21.15.92:0/2523701746 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f52380cf910 con 0x7f524010d4b0 2024-09-19T09:02:48.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.058+0000 7f5244dc4640 1 --2- 172.21.15.92:0/2523701746 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f52280a3300 0x7f52280a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:48.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.058+0000 7f523ffff640 1 -- 172.21.15.92:0/3523186945 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56207dfcb850 msgr2=0x56207dfcdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:48.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.058+0000 7f523ffff640 1 --2- 172.21.15.92:0/3523186945 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56207dfcb850 0x56207dfcdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.058+0000 7f523ffff640 1 -- 172.21.15.92:0/3523186945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56207dfc0670 msgr2=0x56207dfc0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:48.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.058+0000 7f523ffff640 1 --2- 172.21.15.92:0/3523186945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56207dfc0670 0x56207dfc0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.059+0000 7f523ffff640 1 -- 172.21.15.92:0/3523186945 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56207deb2440 con 0x56207dfc0f90 2024-09-19T09:02:48.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.059+0000 7f5244dc4640 1 --2- 172.21.15.92:0/2523701746 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f52280a3300 0x7f52280a57c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f52380cd410 tx=0x7f52380bc040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:48.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.059+0000 7f523ffff640 1 --2- 172.21.15.92:0/3523186945 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56207dfc0f90 0x56207dfcb310 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f523002a8b0 tx=0x7f5230030420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71290d8c37ce4ac9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:48.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.059+0000 7f52267fc640 1 -- 172.21.15.92:0/3523186945 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5230041020 con 0x56207dfc0f90 2024-09-19T09:02:48.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.059+0000 7f52267fc640 1 -- 172.21.15.92:0/3523186945 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5230004300 con 0x56207dfc0f90 2024-09-19T09:02:48.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.059+0000 7f52267fc640 1 -- 172.21.15.92:0/3523186945 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5230037040 con 0x56207dfc0f90 2024-09-19T09:02:48.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.060+0000 7f5248c00740 1 -- 172.21.15.92:0/3523186945 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56207dfc0f90 msgr2=0x56207dfcb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:48.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.060+0000 7f5248c00740 1 --2- 172.21.15.92:0/3523186945 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56207dfc0f90 0x56207dfcb310 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f523002a8b0 tx=0x7f5230030420 comp rx=0 tx=0).stop 2024-09-19T09:02:48.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.060+0000 7f5248c00740 1 -- 172.21.15.92:0/3523186945 shutdown_connections 2024-09-19T09:02:48.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.060+0000 7f5248c00740 1 --2- 172.21.15.92:0/3523186945 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56207dfcb850 0x56207dfcdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.060+0000 7f5248c00740 1 --2- 172.21.15.92:0/3523186945 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56207dfc0f90 0x56207dfcb310 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.060+0000 7f5248c00740 1 --2- 172.21.15.92:0/3523186945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56207dfc0670 0x56207dfc0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.060+0000 7f5248c00740 1 -- 172.21.15.92:0/3523186945 >> 172.21.15.92:0/3523186945 conn(0x56207dfbcc00 msgr2=0x56207dfbcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:48.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.061+0000 7f5248c00740 1 -- 172.21.15.92:0/3523186945 shutdown_connections 2024-09-19T09:02:48.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.061+0000 7f5248c00740 1 -- 172.21.15.92:0/3523186945 wait complete. 2024-09-19T09:02:48.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.061+0000 7f5248c00740 1 -- start start 2024-09-19T09:02:48.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.062+0000 7f5248c00740 1 Processor -- start 2024-09-19T09:02:48.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.062+0000 7f5248c00740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56207dfc0670 0x56207dfcb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.062+0000 7f5248c00740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56207dfc0f90 0x56207dfc8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.062+0000 7f5248c00740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56207dfcb850 0x56207dfc89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.062+0000 7f5248c00740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56207dfdf430 con 0x56207dfc0670 2024-09-19T09:02:48.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.062+0000 7f5248c00740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56207dee1050 con 0x56207dfc0f90 2024-09-19T09:02:48.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.062+0000 7f5248c00740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56207dfdf5b0 con 0x56207dfcb850 2024-09-19T09:02:48.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.062+0000 7f523ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56207dfc0f90 0x56207dfc8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:48.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.062+0000 7f523f7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56207dfcb850 0x56207dfc89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:48.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.062+0000 7f523ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56207dfc0f90 0x56207dfc8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:39100/0 (socket says 172.21.15.92:39100) 2024-09-19T09:02:48.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.062+0000 7f523f7fe640 1 --2- 172.21.15.92:0/2617458662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56207dfc0670 0x56207dfcb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:48.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.062+0000 7f523ffff640 1 -- 172.21.15.92:0/2617458662 learned_addr learned my addr 172.21.15.92:0/2617458662 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:48.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.063+0000 7f5248c00740 10 client.0 _ll_register_callbacks cb 0x56207df21160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:48.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.063+0000 7f523ffff640 1 -- 172.21.15.92:0/2617458662 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56207dfcb850 msgr2=0x56207dfc89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:48.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.063+0000 7f523ffff640 1 --2- 172.21.15.92:0/2617458662 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56207dfcb850 0x56207dfc89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.063+0000 7f523ffff640 1 -- 172.21.15.92:0/2617458662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56207dfc0670 msgr2=0x56207dfcb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:48.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.063+0000 7f523ffff640 1 --2- 172.21.15.92:0/2617458662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56207dfc0670 0x56207dfcb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.063+0000 7f523ffff640 1 -- 172.21.15.92:0/2617458662 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56207dc973c0 con 0x56207dfc0f90 2024-09-19T09:02:48.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.063+0000 7f523ffff640 1 --2- 172.21.15.92:0/2617458662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56207dfc0f90 0x56207dfc8470 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5230035040 tx=0x7f523002aac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84800742d0bb742d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:48.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.063+0000 7f521f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:02:48.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.064+0000 7f521f7fe640 1 -- 172.21.15.92:0/2617458662 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f523004c070 con 0x56207dfc0f90 2024-09-19T09:02:48.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.064+0000 7f521f7fe640 1 -- 172.21.15.92:0/2617458662 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f5230003cd0 con 0x56207dfc0f90 2024-09-19T09:02:48.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.064+0000 7f5248c00740 1 -- 172.21.15.92:0/2617458662 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5230004300 con 0x56207dfc0f90 2024-09-19T09:02:48.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.064+0000 7f521f7fe640 1 -- 172.21.15.92:0/2617458662 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f5230056050 con 0x56207dfc0f90 2024-09-19T09:02:48.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.064+0000 7f5248c00740 10 client.26141 fetch_fsmap learned FSMap version 19 2024-09-19T09:02:48.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.064+0000 7f5248c00740 1 -- 172.21.15.92:0/2617458662 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56207dfeade0 con 0x56207dfc0f90 2024-09-19T09:02:48.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.065+0000 7f521f7fe640 1 -- 172.21.15.92:0/2617458662 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f523003d480 con 0x56207dfc0f90 2024-09-19T09:02:48.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.065+0000 7f521f7fe640 1 -- 172.21.15.92:0/2617458662 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f5230046450 con 0x56207dfc0f90 2024-09-19T09:02:48.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.065+0000 7f5248c00740 10 client.26141 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:02:48.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.065+0000 7f5248c00740 10 client.26141 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:02:48.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.065+0000 7f5248c00740 20 client.26141 populate_metadata read hostname 'smithi092' 2024-09-19T09:02:48.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.065+0000 7f5248c00740 1 --2- 172.21.15.92:0/2617458662 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56207dfec130 0x56207dfee520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.065+0000 7f5248c00740 4 client.26141 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:02:48.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.065+0000 7f5248c00740 1 -- 172.21.15.92:0/2617458662 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f5230004300 con 0x56207dfec130 2024-09-19T09:02:48.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.065+0000 7f523f7fe640 1 --2- 172.21.15.92:0/2617458662 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56207dfec130 0x56207dfee520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:48.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.066+0000 7f523f7fe640 1 --2- 172.21.15.92:0/2617458662 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56207dfec130 0x56207dfee520 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cae38da11773eb server_cookie=7372258dc83843b6 in_seq=0 out_seq=0 2024-09-19T09:02:48.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.066+0000 7f521f7fe640 10 client.26141 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:48.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.066+0000 7f521f7fe640 1 -- 172.21.15.92:0/2617458662 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f5230004300 con 0x56207dfec130 2024-09-19T09:02:48.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.066+0000 7f521f7fe640 10 client.26141 handle_command_reply: tid=0 2024-09-19T09:02:48.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.066+0000 7f5248c00740 1 client.26141 shutdown 2024-09-19T09:02:48.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.067+0000 7f5248c00740 1 -- 172.21.15.92:0/2617458662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56207dfc0f90 msgr2=0x56207dfc8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:48.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.067+0000 7f5248c00740 1 --2- 172.21.15.92:0/2617458662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56207dfc0f90 0x56207dfc8470 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5230035040 tx=0x7f523002aac0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.067+0000 7f5248c00740 1 -- 172.21.15.92:0/2617458662 shutdown_connections 2024-09-19T09:02:48.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.067+0000 7f5248c00740 1 --2- 172.21.15.92:0/2617458662 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56207dfec130 0x56207dfee520 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.067+0000 7f5248c00740 1 --2- 172.21.15.92:0/2617458662 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56207dfcb850 0x56207dfc89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.067+0000 7f5248c00740 1 --2- 172.21.15.92:0/2617458662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56207dfc0f90 0x56207dfc8470 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.067+0000 7f5248c00740 1 --2- 172.21.15.92:0/2617458662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56207dfc0670 0x56207dfcb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.067+0000 7f5248c00740 1 -- 172.21.15.92:0/2617458662 >> 172.21.15.92:0/2617458662 conn(0x56207dfbcc00 msgr2=0x56207dfc2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:48.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.067+0000 7f521f7fe640 0 client.26141 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:48.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.068+0000 7f5248c00740 1 -- 172.21.15.92:0/2617458662 shutdown_connections 2024-09-19T09:02:48.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.068+0000 7f5248c00740 1 -- 172.21.15.92:0/2617458662 wait complete. 2024-09-19T09:02:48.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.068+0000 7f5248c00740 20 client.26141 trim_cache size 0 max 16384 2024-09-19T09:02:48.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.098+0000 7f5248c00740 1 Processor -- start 2024-09-19T09:02:48.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.098+0000 7f5248c00740 1 -- start start 2024-09-19T09:02:48.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.099+0000 7f5248c00740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56207dfc0670 0x56207dfe8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.099+0000 7f5248c00740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56207dfc0f90 0x56207dff3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.099+0000 7f5248c00740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56207dfcb850 0x56207dff4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.099+0000 7f5248c00740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5240080db0 con 0x56207dfc0f90 2024-09-19T09:02:48.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.099+0000 7f5248c00740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f52401abaf0 con 0x56207dfcb850 2024-09-19T09:02:48.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.099+0000 7f5248c00740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5240081440 con 0x56207dfc0670 2024-09-19T09:02:48.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.099+0000 7f523ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56207dfc0f90 0x56207dff3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:48.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.099+0000 7f523f7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56207dfc0670 0x56207dfe8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:48.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.099+0000 7f523ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56207dfc0f90 0x56207dff3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51630/0 (socket says 172.21.15.92:51630) 2024-09-19T09:02:48.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.099+0000 7f523ffff640 1 -- 172.21.15.92:0/3293924625 learned_addr learned my addr 172.21.15.92:0/3293924625 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:48.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.099+0000 7f523f7fe640 1 --2- 172.21.15.92:0/3293924625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56207dfcb850 0x56207dff4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:48.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.099+0000 7f523ffff640 1 -- 172.21.15.92:0/3293924625 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56207dfc0670 msgr2=0x56207dfe8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:48.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.099+0000 7f523ffff640 1 --2- 172.21.15.92:0/3293924625 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56207dfc0670 0x56207dfe8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.099+0000 7f523ffff640 1 -- 172.21.15.92:0/3293924625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56207dfcb850 msgr2=0x56207dff4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:48.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.099+0000 7f523ffff640 1 --2- 172.21.15.92:0/3293924625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56207dfcb850 0x56207dff4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.099+0000 7f523ffff640 1 -- 172.21.15.92:0/3293924625 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56207dfc8d40 con 0x56207dfc0f90 2024-09-19T09:02:48.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.100+0000 7f523ffff640 1 --2- 172.21.15.92:0/3293924625 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56207dfc0f90 0x56207dff3ac0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f5230009780 tx=0x7f52300096f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ade64bd51d7dd8e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:48.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.100+0000 7f5225ffb640 1 -- 172.21.15.92:0/3293924625 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f523004c070 con 0x56207dfc0f90 2024-09-19T09:02:48.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.100+0000 7f5225ffb640 1 -- 172.21.15.92:0/3293924625 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5230046c90 con 0x56207dfc0f90 2024-09-19T09:02:48.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.100+0000 7f5225ffb640 1 -- 172.21.15.92:0/3293924625 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5230041050 con 0x56207dfc0f90 2024-09-19T09:02:48.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.101+0000 7f5248c00740 1 -- 172.21.15.92:0/3293924625 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56207dfc0f90 msgr2=0x56207dff3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:48.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.101+0000 7f5248c00740 1 --2- 172.21.15.92:0/3293924625 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56207dfc0f90 0x56207dff3ac0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f5230009780 tx=0x7f52300096f0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.101+0000 7f5248c00740 1 -- 172.21.15.92:0/3293924625 shutdown_connections 2024-09-19T09:02:48.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.101+0000 7f5248c00740 1 --2- 172.21.15.92:0/3293924625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56207dfcb850 0x56207dff4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.101+0000 7f5248c00740 1 --2- 172.21.15.92:0/3293924625 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56207dfc0f90 0x56207dff3ac0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.101+0000 7f5248c00740 1 --2- 172.21.15.92:0/3293924625 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56207dfc0670 0x56207dfe8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.101+0000 7f5248c00740 1 -- 172.21.15.92:0/3293924625 >> 172.21.15.92:0/3293924625 conn(0x56207dfbcc00 msgr2=0x56207dfca4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:48.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.101+0000 7f5248c00740 1 -- 172.21.15.92:0/3293924625 shutdown_connections 2024-09-19T09:02:48.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.102+0000 7f5248c00740 1 -- 172.21.15.92:0/3293924625 wait complete. 2024-09-19T09:02:48.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.102+0000 7f5248c00740 1 -- start start 2024-09-19T09:02:48.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.102+0000 7f5248c00740 1 Processor -- start 2024-09-19T09:02:48.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.103+0000 7f5248c00740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56207dfc0670 0x56207dfe5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.103+0000 7f5248c00740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56207dfc0f90 0x56207dfc5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.103+0000 7f5248c00740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56207dfcb850 0x56207dfc5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.103+0000 7f523f7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56207dfc0670 0x56207dfe5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:48.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.103+0000 7f523f7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56207dfc0670 0x56207dfe5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:47290/0 (socket says 172.21.15.92:47290) 2024-09-19T09:02:48.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.103+0000 7f523ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56207dfc0f90 0x56207dfc5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:48.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.103+0000 7f523ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56207dfc0f90 0x56207dfc5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:39120/0 (socket says 172.21.15.92:39120) 2024-09-19T09:02:48.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.103+0000 7f523f7fe640 1 -- 172.21.15.92:0/55076669 learned_addr learned my addr 172.21.15.92:0/55076669 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:48.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.103+0000 7f5248c00740 1 -- 172.21.15.92:0/55076669 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5240081b10 con 0x56207dfcb850 2024-09-19T09:02:48.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.103+0000 7f5248c00740 1 -- 172.21.15.92:0/55076669 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5240082f80 con 0x56207dfc0f90 2024-09-19T09:02:48.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.103+0000 7f5248c00740 1 -- 172.21.15.92:0/55076669 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f52400821e0 con 0x56207dfc0670 2024-09-19T09:02:48.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.103+0000 7f5248c00740 10 client.0 _ll_register_callbacks cb 0x7f5234009a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:48.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.103+0000 7f523f7fe640 1 --2- 172.21.15.92:0/55076669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56207dfcb850 0x56207dfc5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:48.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.103+0000 7f523ffff640 1 -- 172.21.15.92:0/55076669 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56207dfc0670 msgr2=0x56207dfe5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:48.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.104+0000 7f523ffff640 1 --2- 172.21.15.92:0/55076669 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56207dfc0670 0x56207dfe5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.104+0000 7f523ffff640 1 -- 172.21.15.92:0/55076669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56207dfcb850 msgr2=0x56207dfc5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:48.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.104+0000 7f523ffff640 1 --2- 172.21.15.92:0/55076669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56207dfcb850 0x56207dfc5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.104+0000 7f523ffff640 1 -- 172.21.15.92:0/55076669 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56207dfc6090 con 0x56207dfc0f90 2024-09-19T09:02:48.106 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.104+0000 7f523ffff640 1 --2- 172.21.15.92:0/55076669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56207dfc0f90 0x56207dfc5290 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f52300057c0 tx=0x7f5230030780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6f17072ae58c736 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:48.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.105+0000 7f521f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:02:48.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.105+0000 7f521f7fe640 1 -- 172.21.15.92:0/55076669 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5230062060 con 0x56207dfc0f90 2024-09-19T09:02:48.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.105+0000 7f521f7fe640 1 -- 172.21.15.92:0/55076669 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f5230005030 con 0x56207dfc0f90 2024-09-19T09:02:48.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.105+0000 7f5248c00740 1 -- 172.21.15.92:0/55076669 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5230046c90 con 0x56207dfc0f90 2024-09-19T09:02:48.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.105+0000 7f521f7fe640 1 -- 172.21.15.92:0/55076669 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f5230041040 con 0x56207dfc0f90 2024-09-19T09:02:48.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.105+0000 7f5248c00740 10 client.26147 fetch_fsmap learned FSMap version 19 2024-09-19T09:02:48.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.105+0000 7f5248c00740 1 -- 172.21.15.92:0/55076669 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56207e056ba0 con 0x56207dfc0f90 2024-09-19T09:02:48.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.105+0000 7f521f7fe640 1 -- 172.21.15.92:0/55076669 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5230003900 con 0x56207dfc0f90 2024-09-19T09:02:48.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.106+0000 7f521f7fe640 1 -- 172.21.15.92:0/55076669 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f5230067070 con 0x56207dfc0f90 2024-09-19T09:02:48.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.107+0000 7f5248c00740 10 client.26147 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:02:48.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.107+0000 7f5248c00740 10 client.26147 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:02:48.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.107+0000 7f5248c00740 20 client.26147 populate_metadata read hostname 'smithi092' 2024-09-19T09:02:48.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.107+0000 7f5248c00740 1 --2- 172.21.15.92:0/55076669 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56207e057160 0x56207e059550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.107+0000 7f5248c00740 4 client.26147 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:02:48.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.107+0000 7f5248c00740 1 -- 172.21.15.92:0/55076669 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f5230046c90 con 0x56207e057160 2024-09-19T09:02:48.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.107+0000 7f523f7fe640 1 --2- 172.21.15.92:0/55076669 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56207e057160 0x56207e059550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:48.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.108+0000 7f523f7fe640 1 --2- 172.21.15.92:0/55076669 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56207e057160 0x56207e059550 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fc81472d24d86f7 server_cookie=2e85b2bedd1e1b3b in_seq=0 out_seq=0 2024-09-19T09:02:48.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.108+0000 7f521f7fe640 10 client.26147 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:48.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.108+0000 7f521f7fe640 1 -- 172.21.15.92:0/55076669 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7f5230046c90 con 0x56207e057160 2024-09-19T09:02:48.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.108+0000 7f521f7fe640 10 client.26147 handle_command_reply: tid=0 2024-09-19T09:02:48.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.108+0000 7f5248c00740 1 client.26147 shutdown 2024-09-19T09:02:48.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.109+0000 7f5248c00740 1 -- 172.21.15.92:0/55076669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56207dfc0f90 msgr2=0x56207dfc5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:48.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.109+0000 7f5248c00740 1 --2- 172.21.15.92:0/55076669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56207dfc0f90 0x56207dfc5290 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f52300057c0 tx=0x7f5230030780 comp rx=0 tx=0).stop 2024-09-19T09:02:48.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.109+0000 7f5248c00740 1 -- 172.21.15.92:0/55076669 shutdown_connections 2024-09-19T09:02:48.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.110+0000 7f5248c00740 1 --2- 172.21.15.92:0/55076669 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56207e057160 0x56207e059550 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.110+0000 7f5248c00740 1 --2- 172.21.15.92:0/55076669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56207dfcb850 0x56207dfc5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.110+0000 7f521f7fe640 0 client.26147 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:48.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.110+0000 7f5248c00740 1 --2- 172.21.15.92:0/55076669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56207dfc0f90 0x56207dfc5290 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.110+0000 7f5248c00740 1 --2- 172.21.15.92:0/55076669 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56207dfc0670 0x56207dfe5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.110+0000 7f5248c00740 1 -- 172.21.15.92:0/55076669 >> 172.21.15.92:0/55076669 conn(0x56207dfbcc00 msgr2=0x56207dfc7d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:48.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.110+0000 7f5248c00740 1 -- 172.21.15.92:0/55076669 shutdown_connections 2024-09-19T09:02:48.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.110+0000 7f5248c00740 1 -- 172.21.15.92:0/55076669 wait complete. 2024-09-19T09:02:48.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.110+0000 7f5248c00740 20 client.26147 trim_cache size 0 max 16384 2024-09-19T09:02:48.112 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:02:48.112 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:02:48.112 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": { 2024-09-19T09:02:48.112 INFO:teuthology.orchestra.run.smithi092.stdout: "500f4e8b-e9f8-4089-ace6-188fb2507ec7": { 2024-09-19T09:02:48.112 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-19T09:02:48.112 INFO:teuthology.orchestra.run.smithi092.stdout: "tag": "500f4e8b-e9f8-4089-ace6-188fb2507ec7", 2024-09-19T09:02:48.112 INFO:teuthology.orchestra.run.smithi092.stdout: "options": "recursive,force" 2024-09-19T09:02:48.112 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:02:48.112 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:02:48.112 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:02:48.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.111+0000 7f5246827640 1 -- 172.21.15.92:0/2523701746 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f52280a3300 msgr2=0x7f52280a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:48.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.111+0000 7f5246827640 1 --2- 172.21.15.92:0/2523701746 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f52280a3300 0x7f52280a57c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f52380cd410 tx=0x7f52380bc040 comp rx=0 tx=0).stop 2024-09-19T09:02:48.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.111+0000 7f5246827640 1 -- 172.21.15.92:0/2523701746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f524010d4b0 msgr2=0x7f524019e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:48.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.111+0000 7f5246827640 1 --2- 172.21.15.92:0/2523701746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f524010d4b0 0x7f524019e830 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f523800eee0 tx=0x7f523800c740 comp rx=0 tx=0).stop 2024-09-19T09:02:48.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.111+0000 7f5246827640 1 -- 172.21.15.92:0/2523701746 shutdown_connections 2024-09-19T09:02:48.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.111+0000 7f5246827640 1 --2- 172.21.15.92:0/2523701746 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f52280a3300 0x7f52280a57c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.111+0000 7f5246827640 1 --2- 172.21.15.92:0/2523701746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f524010d4b0 0x7f524019e830 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.111+0000 7f5246827640 1 --2- 172.21.15.92:0/2523701746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5240108c30 0x7f52401a4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.111+0000 7f5246827640 1 --2- 172.21.15.92:0/2523701746 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5240108280 0x7f52401a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.111+0000 7f5246827640 1 -- 172.21.15.92:0/2523701746 >> 172.21.15.92:0/2523701746 conn(0x7f5240077a10 msgr2=0x7f5240078d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:48.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.112+0000 7f5246827640 1 -- 172.21.15.92:0/2523701746 shutdown_connections 2024-09-19T09:02:48.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:02:48.112+0000 7f5246827640 1 -- 172.21.15.92:0/2523701746 wait complete. 2024-09-19T09:02:48.967 INFO:tasks.cephfs.filesystem:scrub status for tag:500f4e8b-e9f8-4089-ace6-188fb2507ec7 - {'path': '/', 'tag': '500f4e8b-e9f8-4089-ace6-188fb2507ec7', 'options': 'recursive,force'} 2024-09-19T09:02:49.757 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:49 smithi092 ceph-mon[31407]: pgmap v520: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 31 MiB/s wr, 1.17k op/s 2024-09-19T09:02:49.757 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:49 smithi092 ceph-mon[31407]: scrub summary: idle 2024-09-19T09:02:49.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:49 smithi167 ceph-mon[35359]: pgmap v520: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 31 MiB/s wr, 1.17k op/s 2024-09-19T09:02:49.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:49 smithi167 ceph-mon[35359]: scrub summary: idle 2024-09-19T09:02:49.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:49 smithi190 ceph-mon[35358]: pgmap v520: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 31 MiB/s wr, 1.17k op/s 2024-09-19T09:02:49.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:49 smithi190 ceph-mon[35358]: scrub summary: idle 2024-09-19T09:02:50.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 365.0 s, 3740.6 tps, lat 26.940 ms stddev 30.870 2024-09-19T09:02:51.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:51 smithi167 ceph-mon[35359]: pgmap v521: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 22 MiB/s wr, 1.06k op/s 2024-09-19T09:02:51.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:51 smithi190 ceph-mon[35358]: pgmap v521: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 22 MiB/s wr, 1.06k op/s 2024-09-19T09:02:52.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:51 smithi092 ceph-mon[31407]: pgmap v521: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 22 MiB/s wr, 1.06k op/s 2024-09-19T09:02:53.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:53 smithi167 ceph-mon[35359]: pgmap v522: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 11 MiB/s wr, 816 op/s 2024-09-19T09:02:53.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:53 smithi190 ceph-mon[35358]: pgmap v522: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 11 MiB/s wr, 816 op/s 2024-09-19T09:02:54.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:53 smithi092 ceph-mon[31407]: pgmap v522: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 11 MiB/s wr, 816 op/s 2024-09-19T09:02:54.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.350+0000 7f8a14277640 1 -- 172.21.15.92:0/2636339329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a0c102600 msgr2=0x7f8a0c108e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:54.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.350+0000 7f8a14277640 1 --2- 172.21.15.92:0/2636339329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a0c102600 0x7f8a0c108e90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009be0 tx=0x7f8a0402a6c0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.350+0000 7f8a14277640 1 -- 172.21.15.92:0/2636339329 shutdown_connections 2024-09-19T09:02:54.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.350+0000 7f8a14277640 1 --2- 172.21.15.92:0/2636339329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a0c102600 0x7f8a0c108e90 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.350+0000 7f8a14277640 1 --2- 172.21.15.92:0/2636339329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a0c101c40 0x7f8a0c1020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.350+0000 7f8a14277640 1 --2- 172.21.15.92:0/2636339329 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a0c100a50 0x7f8a0c100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.350+0000 7f8a14277640 1 -- 172.21.15.92:0/2636339329 >> 172.21.15.92:0/2636339329 conn(0x7f8a0c0fc1b0 msgr2=0x7f8a0c0fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:54.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.350+0000 7f8a14277640 1 -- 172.21.15.92:0/2636339329 shutdown_connections 2024-09-19T09:02:54.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.350+0000 7f8a14277640 1 -- 172.21.15.92:0/2636339329 wait complete. 2024-09-19T09:02:54.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.351+0000 7f8a14277640 1 Processor -- start 2024-09-19T09:02:54.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.351+0000 7f8a14277640 1 -- start start 2024-09-19T09:02:54.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.351+0000 7f8a14277640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a0c100a50 0x7f8a0c195c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:54.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.351+0000 7f8a14277640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a0c101c40 0x7f8a0c1961b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:54.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.351+0000 7f8a14277640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a0c102600 0x7f8a0c19d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:54.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.351+0000 7f8a14277640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c10b650 con 0x7f8a0c100a50 2024-09-19T09:02:54.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.351+0000 7f8a14277640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c10b4d0 con 0x7f8a0c101c40 2024-09-19T09:02:54.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.352+0000 7f8a14277640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c10b7d0 con 0x7f8a0c102600 2024-09-19T09:02:54.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.352+0000 7f8a11812640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a0c101c40 0x7f8a0c1961b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:54.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.352+0000 7f8a11812640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a0c101c40 0x7f8a0c1961b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:46604/0 (socket says 172.21.15.92:46604) 2024-09-19T09:02:54.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.352+0000 7f8a11812640 1 -- 172.21.15.92:0/1575481150 learned_addr learned my addr 172.21.15.92:0/1575481150 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:54.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.352+0000 7f8a12814640 1 --2- 172.21.15.92:0/1575481150 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a0c102600 0x7f8a0c19d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:54.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.352+0000 7f8a11812640 1 -- 172.21.15.92:0/1575481150 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a0c102600 msgr2=0x7f8a0c19d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:54.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.352+0000 7f8a11812640 1 --2- 172.21.15.92:0/1575481150 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a0c102600 0x7f8a0c19d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.352+0000 7f8a11812640 1 -- 172.21.15.92:0/1575481150 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a0c100a50 msgr2=0x7f8a0c195c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:54.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.352+0000 7f8a11812640 1 --2- 172.21.15.92:0/1575481150 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a0c100a50 0x7f8a0c195c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.352+0000 7f8a11812640 1 -- 172.21.15.92:0/1575481150 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a0c19d8b0 con 0x7f8a0c101c40 2024-09-19T09:02:54.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.353+0000 7f8a11812640 1 --2- 172.21.15.92:0/1575481150 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a0c101c40 0x7f8a0c1961b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f89fc00e9c0 tx=0x7f89fc00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:54.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.353+0000 7f8a037fe640 1 -- 172.21.15.92:0/1575481150 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89fc00cde0 con 0x7f8a0c101c40 2024-09-19T09:02:54.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.353+0000 7f8a14277640 1 -- 172.21.15.92:0/1575481150 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a0c19dba0 con 0x7f8a0c101c40 2024-09-19T09:02:54.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.353+0000 7f8a037fe640 1 -- 172.21.15.92:0/1575481150 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89fc0035f0 con 0x7f8a0c101c40 2024-09-19T09:02:54.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.353+0000 7f8a037fe640 1 -- 172.21.15.92:0/1575481150 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89fc010690 con 0x7f8a0c101c40 2024-09-19T09:02:54.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.353+0000 7f8a14277640 1 -- 172.21.15.92:0/1575481150 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a0c19e0e0 con 0x7f8a0c101c40 2024-09-19T09:02:54.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.356+0000 7f8a037fe640 1 -- 172.21.15.92:0/1575481150 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f89fc004020 con 0x7f8a0c101c40 2024-09-19T09:02:54.357 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.357+0000 7f8a17009740 1 Processor -- start 2024-09-19T09:02:54.357 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.357+0000 7f8a17009740 1 -- start start 2024-09-19T09:02:54.357 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.357+0000 7f8a17009740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffcd8bd9a0 0x55ffcd8bdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:54.358 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.357+0000 7f8a17009740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffcd8be2e0 0x55ffcd8c2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:54.358 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.357+0000 7f8a17009740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffcd8c3370 0x55ffcd8c5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:54.358 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.357+0000 7f8a17009740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ffcd8212f0 con 0x55ffcd8be2e0 2024-09-19T09:02:54.358 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.357+0000 7f8a17009740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ffcd7c9270 con 0x55ffcd8bd9a0 2024-09-19T09:02:54.358 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.357+0000 7f8a17009740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ffcd81d2b0 con 0x55ffcd8c3370 2024-09-19T09:02:54.358 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.357+0000 7f8a12013640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffcd8be2e0 0x55ffcd8c2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:54.358 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.357+0000 7f8a12814640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffcd8bd9a0 0x55ffcd8bdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:54.358 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.357+0000 7f8a11812640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffcd8c3370 0x55ffcd8c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:54.358 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.357+0000 7f8a12814640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffcd8bd9a0 0x55ffcd8bdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:46606/0 (socket says 172.21.15.92:46606) 2024-09-19T09:02:54.358 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.357+0000 7f8a12814640 1 -- 172.21.15.92:0/2939513469 learned_addr learned my addr 172.21.15.92:0/2939513469 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.358+0000 7f8a037fe640 1 --2- 172.21.15.92:0/1575481150 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f89f80a55d0 0x7f89f80a7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.358+0000 7f8a12013640 1 -- 172.21.15.92:0/2939513469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffcd8c3370 msgr2=0x55ffcd8c5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.358+0000 7f8a12013640 1 --2- 172.21.15.92:0/2939513469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffcd8c3370 0x55ffcd8c5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.358+0000 7f8a12013640 1 -- 172.21.15.92:0/2939513469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffcd8bd9a0 msgr2=0x55ffcd8bdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:54.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.358+0000 7f8a12013640 1 --2- 172.21.15.92:0/2939513469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffcd8bd9a0 0x55ffcd8bdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.358+0000 7f8a12013640 1 -- 172.21.15.92:0/2939513469 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffcd7c8340 con 0x55ffcd8be2e0 2024-09-19T09:02:54.362 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.358+0000 7f8a12814640 1 --2- 172.21.15.92:0/1575481150 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f89f80a55d0 0x7f89f80a7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:54.362 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.358+0000 7f8a037fe640 1 -- 172.21.15.92:0/1575481150 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f89fc0cfcd0 con 0x7f8a0c101c40 2024-09-19T09:02:54.362 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.358+0000 7f8a12013640 1 --2- 172.21.15.92:0/2939513469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffcd8be2e0 0x55ffcd8c2da0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c101aa0 tx=0x7f8a08009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b55a3f3f9a768e11 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:54.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.358+0000 7f8a00bfe640 1 -- 172.21.15.92:0/2939513469 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a08015020 con 0x55ffcd8be2e0 2024-09-19T09:02:54.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.359+0000 7f8a00bfe640 1 -- 172.21.15.92:0/2939513469 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a0800bdb0 con 0x55ffcd8be2e0 2024-09-19T09:02:54.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.359+0000 7f8a00bfe640 1 -- 172.21.15.92:0/2939513469 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a08010380 con 0x55ffcd8be2e0 2024-09-19T09:02:54.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.359+0000 7f8a17009740 1 -- 172.21.15.92:0/2939513469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffcd8be2e0 msgr2=0x55ffcd8c2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:54.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.359+0000 7f8a17009740 1 --2- 172.21.15.92:0/2939513469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffcd8be2e0 0x55ffcd8c2da0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c101aa0 tx=0x7f8a08009bb0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.360+0000 7f8a12814640 1 --2- 172.21.15.92:0/1575481150 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f89f80a55d0 0x7f89f80a7a90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8a04005f00 tx=0x7f8a04009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:54.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.360+0000 7f8a17009740 1 -- 172.21.15.92:0/2939513469 shutdown_connections 2024-09-19T09:02:54.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.360+0000 7f8a17009740 1 --2- 172.21.15.92:0/2939513469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffcd8c3370 0x55ffcd8c5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.360+0000 7f8a17009740 1 --2- 172.21.15.92:0/2939513469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffcd8be2e0 0x55ffcd8c2da0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.360+0000 7f8a17009740 1 --2- 172.21.15.92:0/2939513469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffcd8bd9a0 0x55ffcd8bdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.360+0000 7f8a17009740 1 -- 172.21.15.92:0/2939513469 >> 172.21.15.92:0/2939513469 conn(0x55ffcd8b9010 msgr2=0x55ffcd8b9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:54.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.360+0000 7f8a17009740 1 -- 172.21.15.92:0/2939513469 shutdown_connections 2024-09-19T09:02:54.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.361+0000 7f8a17009740 1 -- 172.21.15.92:0/2939513469 wait complete. 2024-09-19T09:02:54.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.361+0000 7f8a17009740 1 -- start start 2024-09-19T09:02:54.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.361+0000 7f8a17009740 1 Processor -- start 2024-09-19T09:02:54.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.361+0000 7f8a17009740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffcd8bd9a0 0x55ffcd8c7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:54.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.362+0000 7f8a17009740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffcd8be2e0 0x55ffcd8c8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:54.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.362+0000 7f8a17009740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffcd8c3370 0x55ffcd8cf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:54.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.362+0000 7f8a12013640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffcd8bd9a0 0x55ffcd8c7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:54.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.362+0000 7f8a17009740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ffcd8c6390 con 0x55ffcd8bd9a0 2024-09-19T09:02:54.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.362+0000 7f8a12013640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffcd8bd9a0 0x55ffcd8c7c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42386/0 (socket says 172.21.15.92:42386) 2024-09-19T09:02:54.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.362+0000 7f8a12013640 1 -- 172.21.15.92:0/1087281678 learned_addr learned my addr 172.21.15.92:0/1087281678 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:54.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.362+0000 7f8a17009740 1 -- 172.21.15.92:0/1087281678 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ffcd7aa290 con 0x55ffcd8be2e0 2024-09-19T09:02:54.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.362+0000 7f8a17009740 1 -- 172.21.15.92:0/1087281678 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ffcd8c6510 con 0x55ffcd8c3370 2024-09-19T09:02:54.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.362+0000 7f8a17009740 10 client.0 _ll_register_callbacks cb 0x55ffcd7db140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:54.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.362+0000 7f8a11812640 1 --2- 172.21.15.92:0/1087281678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffcd8be2e0 0x55ffcd8c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:54.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.362+0000 7f8a12814640 1 --2- 172.21.15.92:0/1087281678 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffcd8c3370 0x55ffcd8cf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:54.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.362+0000 7f8a11812640 1 -- 172.21.15.92:0/1087281678 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffcd8c3370 msgr2=0x55ffcd8cf1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:54.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.362+0000 7f8a11812640 1 --2- 172.21.15.92:0/1087281678 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffcd8c3370 0x55ffcd8cf1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.362+0000 7f8a11812640 1 -- 172.21.15.92:0/1087281678 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffcd8bd9a0 msgr2=0x55ffcd8c7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:54.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.362+0000 7f8a11812640 1 --2- 172.21.15.92:0/1087281678 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffcd8bd9a0 0x55ffcd8c7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.362+0000 7f8a11812640 1 -- 172.21.15.92:0/1087281678 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffcd534210 con 0x55ffcd8be2e0 2024-09-19T09:02:54.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.362+0000 7f8a11812640 1 --2- 172.21.15.92:0/1087281678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffcd8be2e0 0x55ffcd8c8160 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f89fc098cc0 tx=0x7f89fc098960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=506f709046d4a69 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:54.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.363+0000 7f89f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:02:54.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.363+0000 7f89f5ffb640 1 -- 172.21.15.92:0/1087281678 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89fc09be30 con 0x55ffcd8be2e0 2024-09-19T09:02:54.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.363+0000 7f8a17009740 1 -- 172.21.15.92:0/1087281678 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a0800bdb0 con 0x55ffcd8be2e0 2024-09-19T09:02:54.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.363+0000 7f89f5ffb640 1 -- 172.21.15.92:0/1087281678 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f89fc003b10 con 0x55ffcd8be2e0 2024-09-19T09:02:54.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.363+0000 7f89f5ffb640 1 -- 172.21.15.92:0/1087281678 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f89fc09bc50 con 0x55ffcd8be2e0 2024-09-19T09:02:54.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.363+0000 7f8a17009740 10 client.26159 fetch_fsmap learned FSMap version 19 2024-09-19T09:02:54.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.363+0000 7f8a17009740 1 -- 172.21.15.92:0/1087281678 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ffcd600620 con 0x55ffcd8be2e0 2024-09-19T09:02:54.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.363+0000 7f89f5ffb640 1 -- 172.21.15.92:0/1087281678 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a0800bdb0 con 0x55ffcd8be2e0 2024-09-19T09:02:54.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.363+0000 7f89f5ffb640 1 -- 172.21.15.92:0/1087281678 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f89fc0d5070 con 0x55ffcd8be2e0 2024-09-19T09:02:54.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.363+0000 7f8a17009740 10 client.26159 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:02:54.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.363+0000 7f8a17009740 10 client.26159 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:02:54.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.363+0000 7f8a17009740 20 client.26159 populate_metadata read hostname 'smithi092' 2024-09-19T09:02:54.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.363+0000 7f8a17009740 1 --2- 172.21.15.92:0/1087281678 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ffcd8d3870 0x55ffcd8d5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:54.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.363+0000 7f8a17009740 4 client.26159 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:02:54.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.363+0000 7f8a17009740 1 -- 172.21.15.92:0/1087281678 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ffcd82ea20 con 0x55ffcd8d3870 2024-09-19T09:02:54.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.364+0000 7f8a12013640 1 --2- 172.21.15.92:0/1087281678 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ffcd8d3870 0x55ffcd8d5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:54.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.364+0000 7f89f5ffb640 10 client.26159 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:54.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.364+0000 7f8a12013640 1 --2- 172.21.15.92:0/1087281678 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ffcd8d3870 0x55ffcd8d5c60 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dab5bc6a37f6a8d server_cookie=2dd48cc7037b38d5 in_seq=0 out_seq=0 2024-09-19T09:02:54.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.365+0000 7f89f5ffb640 1 -- 172.21.15.92:0/1087281678 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ffcd82ea20 con 0x55ffcd8d3870 2024-09-19T09:02:54.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.365+0000 7f89f5ffb640 10 client.26159 handle_command_reply: tid=0 2024-09-19T09:02:54.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.365+0000 7f8a17009740 1 client.26159 shutdown 2024-09-19T09:02:54.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.365+0000 7f8a17009740 1 -- 172.21.15.92:0/1087281678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffcd8be2e0 msgr2=0x55ffcd8c8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:54.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.365+0000 7f8a17009740 1 --2- 172.21.15.92:0/1087281678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffcd8be2e0 0x55ffcd8c8160 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f89fc098cc0 tx=0x7f89fc098960 comp rx=0 tx=0).stop 2024-09-19T09:02:54.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.365+0000 7f8a17009740 1 -- 172.21.15.92:0/1087281678 shutdown_connections 2024-09-19T09:02:54.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.365+0000 7f8a17009740 1 --2- 172.21.15.92:0/1087281678 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ffcd8d3870 0x55ffcd8d5c60 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.365+0000 7f8a17009740 1 --2- 172.21.15.92:0/1087281678 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffcd8c3370 0x55ffcd8cf1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.365+0000 7f89f5ffb640 0 client.26159 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:54.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.365+0000 7f8a17009740 1 --2- 172.21.15.92:0/1087281678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffcd8be2e0 0x55ffcd8c8160 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.365+0000 7f8a17009740 1 --2- 172.21.15.92:0/1087281678 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffcd8bd9a0 0x55ffcd8c7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.365+0000 7f8a17009740 1 -- 172.21.15.92:0/1087281678 >> 172.21.15.92:0/1087281678 conn(0x55ffcd8b9010 msgr2=0x55ffcd8ba820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:54.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.366+0000 7f8a17009740 1 -- 172.21.15.92:0/1087281678 shutdown_connections 2024-09-19T09:02:54.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.366+0000 7f8a17009740 1 -- 172.21.15.92:0/1087281678 wait complete. 2024-09-19T09:02:54.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.366+0000 7f8a17009740 20 client.26159 trim_cache size 0 max 16384 2024-09-19T09:02:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.388+0000 7f8a17009740 1 Processor -- start 2024-09-19T09:02:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.388+0000 7f8a17009740 1 -- start start 2024-09-19T09:02:54.390 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.388+0000 7f8a17009740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffcd8bd9a0 0x55ffcd8ba400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:54.390 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.388+0000 7f8a17009740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffcd8be2e0 0x55ffcd8cf160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:54.390 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.388+0000 7f8a17009740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffcd8c3370 0x55ffcd8ba940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:54.390 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.388+0000 7f8a17009740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c1ad6b0 con 0x55ffcd8c3370 2024-09-19T09:02:54.390 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.388+0000 7f8a17009740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c1aff50 con 0x55ffcd8be2e0 2024-09-19T09:02:54.390 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.388+0000 7f8a17009740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c1add40 con 0x55ffcd8bd9a0 2024-09-19T09:02:54.390 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.389+0000 7f8a11812640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffcd8be2e0 0x55ffcd8cf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:54.390 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.389+0000 7f8a12013640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffcd8bd9a0 0x55ffcd8ba400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:54.390 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.389+0000 7f8a12814640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffcd8c3370 0x55ffcd8ba940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:54.390 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.389+0000 7f8a11812640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffcd8be2e0 0x55ffcd8cf160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:46618/0 (socket says 172.21.15.92:46618) 2024-09-19T09:02:54.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.389+0000 7f8a11812640 1 -- 172.21.15.92:0/2337137472 learned_addr learned my addr 172.21.15.92:0/2337137472 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:54.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.389+0000 7f8a12814640 1 -- 172.21.15.92:0/2337137472 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffcd8bd9a0 msgr2=0x55ffcd8ba400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:54.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.389+0000 7f8a12814640 1 --2- 172.21.15.92:0/2337137472 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffcd8bd9a0 0x55ffcd8ba400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.389+0000 7f8a12814640 1 -- 172.21.15.92:0/2337137472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffcd8be2e0 msgr2=0x55ffcd8cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:54.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.389+0000 7f8a12814640 1 --2- 172.21.15.92:0/2337137472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffcd8be2e0 0x55ffcd8cf160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.389+0000 7f8a12814640 1 -- 172.21.15.92:0/2337137472 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffcd8bae80 con 0x55ffcd8c3370 2024-09-19T09:02:54.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.389+0000 7f8a12814640 1 --2- 172.21.15.92:0/2337137472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffcd8c3370 0x55ffcd8ba940 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f8a04034040 tx=0x7f8a0403f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=878e4e38812bdc6c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:54.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.389+0000 7f89f7fff640 1 -- 172.21.15.92:0/2337137472 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a04036040 con 0x55ffcd8c3370 2024-09-19T09:02:54.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.389+0000 7f89f7fff640 1 -- 172.21.15.92:0/2337137472 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a04052070 con 0x55ffcd8c3370 2024-09-19T09:02:54.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.389+0000 7f89f7fff640 1 -- 172.21.15.92:0/2337137472 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0403f6e0 con 0x55ffcd8c3370 2024-09-19T09:02:54.394 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.390+0000 7f8a17009740 1 -- 172.21.15.92:0/2337137472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffcd8c3370 msgr2=0x55ffcd8ba940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:54.394 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.390+0000 7f8a17009740 1 --2- 172.21.15.92:0/2337137472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffcd8c3370 0x55ffcd8ba940 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f8a04034040 tx=0x7f8a0403f000 comp rx=0 tx=0).stop 2024-09-19T09:02:54.394 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.390+0000 7f8a17009740 1 -- 172.21.15.92:0/2337137472 shutdown_connections 2024-09-19T09:02:54.394 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.390+0000 7f8a17009740 1 --2- 172.21.15.92:0/2337137472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffcd8c3370 0x55ffcd8ba940 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.395 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.390+0000 7f8a17009740 1 --2- 172.21.15.92:0/2337137472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffcd8be2e0 0x55ffcd8cf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.395 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.390+0000 7f8a17009740 1 --2- 172.21.15.92:0/2337137472 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffcd8bd9a0 0x55ffcd8ba400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.395 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.390+0000 7f8a17009740 1 -- 172.21.15.92:0/2337137472 >> 172.21.15.92:0/2337137472 conn(0x55ffcd8b9010 msgr2=0x55ffcd8b81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:54.395 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.390+0000 7f8a17009740 1 -- 172.21.15.92:0/2337137472 shutdown_connections 2024-09-19T09:02:54.395 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.390+0000 7f8a17009740 1 -- 172.21.15.92:0/2337137472 wait complete. 2024-09-19T09:02:54.395 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.391+0000 7f8a17009740 1 -- start start 2024-09-19T09:02:54.395 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.391+0000 7f8a17009740 1 Processor -- start 2024-09-19T09:02:54.395 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.391+0000 7f8a17009740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffcd8bd9a0 0x55ffcd8ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:54.395 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.391+0000 7f8a17009740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffcd8be2e0 0x55ffcd8cd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:54.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.391+0000 7f8a17009740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffcd8c3370 0x55ffcd8ce280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:54.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.391+0000 7f8a17009740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c1ae410 con 0x55ffcd8bd9a0 2024-09-19T09:02:54.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.391+0000 7f8a17009740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c1af880 con 0x55ffcd8be2e0 2024-09-19T09:02:54.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.391+0000 7f8a17009740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c1aeae0 con 0x55ffcd8c3370 2024-09-19T09:02:54.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.391+0000 7f8a17009740 10 client.0 _ll_register_callbacks cb 0x7f89fc097e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:54.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.391+0000 7f8a12013640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffcd8bd9a0 0x55ffcd8ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:54.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.391+0000 7f8a12013640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffcd8bd9a0 0x55ffcd8ccd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42410/0 (socket says 172.21.15.92:42410) 2024-09-19T09:02:54.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.391+0000 7f8a12013640 1 -- 172.21.15.92:0/452186216 learned_addr learned my addr 172.21.15.92:0/452186216 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:02:54.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.391+0000 7f8a12814640 1 --2- 172.21.15.92:0/452186216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffcd8c3370 0x55ffcd8ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:54.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.391+0000 7f8a11812640 1 --2- 172.21.15.92:0/452186216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffcd8be2e0 0x55ffcd8cd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:54.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.392+0000 7f8a12814640 1 -- 172.21.15.92:0/452186216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffcd8be2e0 msgr2=0x55ffcd8cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:54.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.392+0000 7f8a12814640 1 --2- 172.21.15.92:0/452186216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffcd8be2e0 0x55ffcd8cd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.392+0000 7f8a12814640 1 -- 172.21.15.92:0/452186216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffcd8bd9a0 msgr2=0x55ffcd8ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:54.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.392+0000 7f8a12814640 1 --2- 172.21.15.92:0/452186216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffcd8bd9a0 0x55ffcd8ccd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.392+0000 7f8a12814640 1 -- 172.21.15.92:0/452186216 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffcd8ce890 con 0x55ffcd8c3370 2024-09-19T09:02:54.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.392+0000 7f8a12814640 1 --2- 172.21.15.92:0/452186216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffcd8c3370 0x55ffcd8ce280 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009b30 tx=0x7f8a040092a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18e29a5a267d48d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:54.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.392+0000 7f89f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:02:54.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.392+0000 7f89f5ffb640 1 -- 172.21.15.92:0/452186216 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a04036030 con 0x55ffcd8c3370 2024-09-19T09:02:54.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.392+0000 7f89f5ffb640 1 -- 172.21.15.92:0/452186216 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8a04004240 con 0x55ffcd8c3370 2024-09-19T09:02:54.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.392+0000 7f8a17009740 1 -- 172.21.15.92:0/452186216 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a04052070 con 0x55ffcd8c3370 2024-09-19T09:02:54.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.393+0000 7f89f5ffb640 1 -- 172.21.15.92:0/452186216 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8a04004440 con 0x55ffcd8c3370 2024-09-19T09:02:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.393+0000 7f8a17009740 10 client.26098 fetch_fsmap learned FSMap version 19 2024-09-19T09:02:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.393+0000 7f8a17009740 1 -- 172.21.15.92:0/452186216 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ffcd93ea40 con 0x55ffcd8c3370 2024-09-19T09:02:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.394+0000 7f89f5ffb640 1 -- 172.21.15.92:0/452186216 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a04052070 con 0x55ffcd8c3370 2024-09-19T09:02:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.394+0000 7f89f5ffb640 1 -- 172.21.15.92:0/452186216 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f8a04031440 con 0x55ffcd8c3370 2024-09-19T09:02:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.394+0000 7f8a17009740 10 client.26098 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:02:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.394+0000 7f8a17009740 10 client.26098 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:02:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.394+0000 7f8a17009740 20 client.26098 populate_metadata read hostname 'smithi092' 2024-09-19T09:02:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.394+0000 7f8a17009740 1 --2- 172.21.15.92:0/452186216 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ffcd8d3870 0x55ffcd9413e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.394+0000 7f8a17009740 4 client.26098 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:02:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.394+0000 7f8a17009740 1 -- 172.21.15.92:0/452186216 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ffcd828d70 con 0x55ffcd8d3870 2024-09-19T09:02:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.394+0000 7f8a12013640 1 --2- 172.21.15.92:0/452186216 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ffcd8d3870 0x55ffcd9413e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:54.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.395+0000 7f89f5ffb640 10 client.26098 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:54.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.395+0000 7f8a12013640 1 --2- 172.21.15.92:0/452186216 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ffcd8d3870 0x55ffcd9413e0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ae0a8189af673fc server_cookie=2d5ae2e19e5fab81 in_seq=0 out_seq=0 2024-09-19T09:02:54.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.416+0000 7f89f5ffb640 1 -- 172.21.15.92:0/452186216 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ffcd828d70 con 0x55ffcd8d3870 2024-09-19T09:02:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.416+0000 7f89f5ffb640 10 client.26098 handle_command_reply: tid=0 2024-09-19T09:02:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.416+0000 7f8a17009740 1 client.26098 shutdown 2024-09-19T09:02:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.416+0000 7f8a17009740 1 -- 172.21.15.92:0/452186216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffcd8c3370 msgr2=0x55ffcd8ce280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.416+0000 7f8a17009740 1 --2- 172.21.15.92:0/452186216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffcd8c3370 0x55ffcd8ce280 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009b30 tx=0x7f8a040092a0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.416+0000 7f8a17009740 1 -- 172.21.15.92:0/452186216 shutdown_connections 2024-09-19T09:02:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.416+0000 7f8a17009740 1 --2- 172.21.15.92:0/452186216 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ffcd8d3870 0x55ffcd9413e0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.416+0000 7f8a17009740 1 --2- 172.21.15.92:0/452186216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ffcd8c3370 0x55ffcd8ce280 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.416+0000 7f8a17009740 1 --2- 172.21.15.92:0/452186216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffcd8be2e0 0x55ffcd8cd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.416+0000 7f8a17009740 1 --2- 172.21.15.92:0/452186216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffcd8bd9a0 0x55ffcd8ccd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.416+0000 7f8a17009740 1 -- 172.21.15.92:0/452186216 >> 172.21.15.92:0/452186216 conn(0x55ffcd8b9010 msgr2=0x55ffcd8b81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.416+0000 7f89f5ffb640 0 client.26098 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:02:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.416+0000 7f8a17009740 1 -- 172.21.15.92:0/452186216 shutdown_connections 2024-09-19T09:02:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.416+0000 7f8a17009740 1 -- 172.21.15.92:0/452186216 wait complete. 2024-09-19T09:02:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.416+0000 7f8a17009740 20 client.26098 trim_cache size 0 max 16384 2024-09-19T09:02:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:02:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:02:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:02:54.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:02:54.420 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.417+0000 7f8a14277640 1 -- 172.21.15.92:0/1575481150 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f89f80a55d0 msgr2=0x7f89f80a7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:54.420 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.417+0000 7f8a14277640 1 --2- 172.21.15.92:0/1575481150 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f89f80a55d0 0x7f89f80a7a90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8a04005f00 tx=0x7f8a04009500 comp rx=0 tx=0).stop 2024-09-19T09:02:54.420 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.417+0000 7f8a14277640 1 -- 172.21.15.92:0/1575481150 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a0c101c40 msgr2=0x7f8a0c1961b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:54.420 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.417+0000 7f8a14277640 1 --2- 172.21.15.92:0/1575481150 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a0c101c40 0x7f8a0c1961b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f89fc00e9c0 tx=0x7f89fc00ee80 comp rx=0 tx=0).stop 2024-09-19T09:02:54.420 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.417+0000 7f8a14277640 1 -- 172.21.15.92:0/1575481150 shutdown_connections 2024-09-19T09:02:54.420 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.417+0000 7f8a14277640 1 --2- 172.21.15.92:0/1575481150 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a0c102600 0x7f8a0c19d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.420 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.417+0000 7f8a14277640 1 --2- 172.21.15.92:0/1575481150 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a0c101c40 0x7f8a0c1961b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.420 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.417+0000 7f8a14277640 1 --2- 172.21.15.92:0/1575481150 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f89f80a55d0 0x7f89f80a7a90 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.417+0000 7f8a14277640 1 --2- 172.21.15.92:0/1575481150 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a0c100a50 0x7f8a0c195c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.417+0000 7f8a14277640 1 -- 172.21.15.92:0/1575481150 >> 172.21.15.92:0/1575481150 conn(0x7f8a0c0fc1b0 msgr2=0x7f8a0c104f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:54.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.417+0000 7f8a14277640 1 -- 172.21.15.92:0/1575481150 shutdown_connections 2024-09-19T09:02:54.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:02:54.417+0000 7f8a14277640 1 -- 172.21.15.92:0/1575481150 wait complete. 2024-09-19T09:02:55.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 370.0 s, 4228.7 tps, lat 23.498 ms stddev 26.808 2024-09-19T09:02:55.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:55 smithi167 ceph-mon[35359]: pgmap v523: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 11 MiB/s wr, 864 op/s 2024-09-19T09:02:55.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:55 smithi190 ceph-mon[35358]: pgmap v523: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 11 MiB/s wr, 864 op/s 2024-09-19T09:02:56.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:55 smithi092 ceph-mon[31407]: pgmap v523: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 11 MiB/s wr, 864 op/s 2024-09-19T09:02:57.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:57 smithi167 ceph-mon[35359]: pgmap v524: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 9.9 MiB/s wr, 807 op/s 2024-09-19T09:02:57.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:57 smithi190 ceph-mon[35358]: pgmap v524: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 9.9 MiB/s wr, 807 op/s 2024-09-19T09:02:58.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:57 smithi092 ceph-mon[31407]: pgmap v524: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 9.9 MiB/s wr, 807 op/s 2024-09-19T09:02:59.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:02:59 smithi167 ceph-mon[35359]: pgmap v525: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 11 MiB/s wr, 855 op/s 2024-09-19T09:02:59.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:02:59 smithi190 ceph-mon[35358]: pgmap v525: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 11 MiB/s wr, 855 op/s 2024-09-19T09:03:00.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:02:59 smithi092 ceph-mon[31407]: pgmap v525: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 11 MiB/s wr, 855 op/s 2024-09-19T09:03:00.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 375.0 s, 3324.4 tps, lat 30.128 ms stddev 32.750 2024-09-19T09:03:01.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:01 smithi167 ceph-mon[35359]: pgmap v526: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 13 MiB/s wr, 951 op/s 2024-09-19T09:03:01.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:01 smithi190 ceph-mon[35358]: pgmap v526: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 13 MiB/s wr, 951 op/s 2024-09-19T09:03:02.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:01 smithi092 ceph-mon[31407]: pgmap v526: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 13 MiB/s wr, 951 op/s 2024-09-19T09:03:03.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:03 smithi167 ceph-mon[35359]: pgmap v527: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 10 MiB/s wr, 783 op/s 2024-09-19T09:03:03.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:03 smithi190 ceph-mon[35358]: pgmap v527: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 10 MiB/s wr, 783 op/s 2024-09-19T09:03:04.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:03 smithi092 ceph-mon[31407]: pgmap v527: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 10 MiB/s wr, 783 op/s 2024-09-19T09:03:04.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:04 smithi167 ceph-mon[35359]: pgmap v528: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 12 MiB/s wr, 870 op/s 2024-09-19T09:03:04.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:04 smithi190 ceph-mon[35358]: pgmap v528: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 12 MiB/s wr, 870 op/s 2024-09-19T09:03:05.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:04 smithi092 ceph-mon[31407]: pgmap v528: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 12 MiB/s wr, 870 op/s 2024-09-19T09:03:05.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 380.0 s, 4296.0 tps, lat 23.341 ms stddev 29.593 2024-09-19T09:03:07.554 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.553+0000 7f4d9d44a640 1 -- 172.21.15.92:0/2114039594 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d981023c0 msgr2=0x7f4d981047b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.553+0000 7f4d9d44a640 1 --2- 172.21.15.92:0/2114039594 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d981023c0 0x7f4d981047b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f4d88009900 tx=0x7f4d8802a410 comp rx=0 tx=0).stop 2024-09-19T09:03:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.553+0000 7f4d9d44a640 1 -- 172.21.15.92:0/2114039594 shutdown_connections 2024-09-19T09:03:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.553+0000 7f4d9d44a640 1 --2- 172.21.15.92:0/2114039594 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d98107620 0x7f4d98109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.553+0000 7f4d9d44a640 1 --2- 172.21.15.92:0/2114039594 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d98104cf0 0x7f4d981070e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.553+0000 7f4d9d44a640 1 --2- 172.21.15.92:0/2114039594 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d981023c0 0x7f4d981047b0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.553+0000 7f4d9d44a640 1 -- 172.21.15.92:0/2114039594 >> 172.21.15.92:0/2114039594 conn(0x7f4d980fbfa0 msgr2=0x7f4d980fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.553+0000 7f4d9d44a640 1 -- 172.21.15.92:0/2114039594 shutdown_connections 2024-09-19T09:03:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.553+0000 7f4d9d44a640 1 -- 172.21.15.92:0/2114039594 wait complete. 2024-09-19T09:03:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.554+0000 7f4d9d44a640 1 Processor -- start 2024-09-19T09:03:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.554+0000 7f4d9d44a640 1 -- start start 2024-09-19T09:03:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.555+0000 7f4d9d44a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d981023c0 0x7f4d98101d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.555+0000 7f4d9d44a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d98104cf0 0x7f4d98100370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.555+0000 7f4d9d44a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d98107620 0x7f4d981008b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.555+0000 7f4d97fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d981023c0 0x7f4d98101d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.555+0000 7f4d9d44a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9810d600 con 0x7f4d981023c0 2024-09-19T09:03:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.555+0000 7f4d9d44a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9810d480 con 0x7f4d98104cf0 2024-09-19T09:03:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.555+0000 7f4d9d44a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9810d780 con 0x7f4d98107620 2024-09-19T09:03:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.555+0000 7f4d97fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d981023c0 0x7f4d98101d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34830/0 (socket says 172.21.15.92:34830) 2024-09-19T09:03:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.555+0000 7f4d97fff640 1 -- 172.21.15.92:0/479634902 learned_addr learned my addr 172.21.15.92:0/479634902 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.555+0000 7f4d977fe640 1 --2- 172.21.15.92:0/479634902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d98104cf0 0x7f4d98100370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.555+0000 7f4d9cc49640 1 --2- 172.21.15.92:0/479634902 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d98107620 0x7f4d981008b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.556+0000 7f4d97fff640 1 -- 172.21.15.92:0/479634902 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d98107620 msgr2=0x7f4d981008b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:07.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.556+0000 7f4d97fff640 1 --2- 172.21.15.92:0/479634902 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d98107620 0x7f4d981008b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.556+0000 7f4d97fff640 1 -- 172.21.15.92:0/479634902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d98104cf0 msgr2=0x7f4d98100370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:07.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.556+0000 7f4d97fff640 1 --2- 172.21.15.92:0/479634902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d98104cf0 0x7f4d98100370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.556+0000 7f4d97fff640 1 -- 172.21.15.92:0/479634902 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d98100df0 con 0x7f4d981023c0 2024-09-19T09:03:07.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.556+0000 7f4d977fe640 1 --2- 172.21.15.92:0/479634902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d98104cf0 0x7f4d98100370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.556+0000 7f4d97fff640 1 --2- 172.21.15.92:0/479634902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d981023c0 0x7f4d98101d30 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f4d88009230 tx=0x7f4d880042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.557+0000 7f4d957fa640 1 -- 172.21.15.92:0/479634902 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8803f030 con 0x7f4d981023c0 2024-09-19T09:03:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.557+0000 7f4d957fa640 1 -- 172.21.15.92:0/479634902 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d88003ce0 con 0x7f4d981023c0 2024-09-19T09:03:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.557+0000 7f4d9d44a640 1 -- 172.21.15.92:0/479634902 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d98101080 con 0x7f4d981023c0 2024-09-19T09:03:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.557+0000 7f4d957fa640 1 -- 172.21.15.92:0/479634902 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d88035070 con 0x7f4d981023c0 2024-09-19T09:03:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.557+0000 7f4d9d44a640 1 -- 172.21.15.92:0/479634902 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d981a6710 con 0x7f4d981023c0 2024-09-19T09:03:07.562 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.561+0000 7f4da144b740 1 Processor -- start 2024-09-19T09:03:07.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.561+0000 7f4d957fa640 1 -- 172.21.15.92:0/479634902 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4d88042030 con 0x7f4d981023c0 2024-09-19T09:03:07.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.561+0000 7f4da144b740 1 -- start start 2024-09-19T09:03:07.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.561+0000 7f4da144b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bcdfe7b70 0x556bcdfe7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.561+0000 7f4da144b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556bcdfe84b0 0x556bcdfecf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.562+0000 7f4da144b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bcdfed540 0x556bcdfefa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.562+0000 7f4da144b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556bcdf4b2f0 con 0x556bcdfe84b0 2024-09-19T09:03:07.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.562+0000 7f4da144b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556bcdef3270 con 0x556bcdfe7b70 2024-09-19T09:03:07.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.562+0000 7f4da144b740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x556bcdf472b0 con 0x556bcdfed540 2024-09-19T09:03:07.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.562+0000 7f4d97fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556bcdfe84b0 0x556bcdfecf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.562+0000 7f4d977fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bcdfed540 0x556bcdfefa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.562+0000 7f4d97fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556bcdfe84b0 0x556bcdfecf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34836/0 (socket says 172.21.15.92:34836) 2024-09-19T09:03:07.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.562+0000 7f4d97fff640 1 -- 172.21.15.92:0/1174546682 learned_addr learned my addr 172.21.15.92:0/1174546682 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:07.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.562+0000 7f4d977fe640 1 -- 172.21.15.92:0/1174546682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bcdfe7b70 msgr2=0x556bcdfe7f70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:03:07.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.562+0000 7f4d977fe640 1 --2- 172.21.15.92:0/1174546682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bcdfe7b70 0x556bcdfe7f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.562+0000 7f4d977fe640 1 -- 172.21.15.92:0/1174546682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556bcdfe84b0 msgr2=0x556bcdfecf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:07.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.562+0000 7f4d977fe640 1 --2- 172.21.15.92:0/1174546682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556bcdfe84b0 0x556bcdfecf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.562+0000 7f4d977fe640 1 -- 172.21.15.92:0/1174546682 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bcdef2340 con 0x556bcdfed540 2024-09-19T09:03:07.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.562+0000 7f4d957fa640 1 --2- 172.21.15.92:0/479634902 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4d800a32c0 0x7f4d800a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.563+0000 7f4d957fa640 1 -- 172.21.15.92:0/479634902 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4d880ef3b0 con 0x7f4d981023c0 2024-09-19T09:03:07.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.563+0000 7f4d977fe640 1 --2- 172.21.15.92:0/1174546682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bcdfed540 0x556bcdfefa00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4d9806ac20 tx=0x7f4d8c0118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22d8723cd506a207 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:07.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.563+0000 7f4d7e7fc640 1 -- 172.21.15.92:0/1174546682 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c01e070 con 0x556bcdfed540 2024-09-19T09:03:07.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.563+0000 7f4d7e7fc640 1 -- 172.21.15.92:0/1174546682 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d8c0035f0 con 0x556bcdfed540 2024-09-19T09:03:07.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.563+0000 7f4d7e7fc640 1 -- 172.21.15.92:0/1174546682 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c00f7a0 con 0x556bcdfed540 2024-09-19T09:03:07.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.564+0000 7f4d9cc49640 1 --2- 172.21.15.92:0/479634902 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4d800a32c0 0x7f4d800a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.564+0000 7f4d9cc49640 1 --2- 172.21.15.92:0/479634902 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4d800a32c0 0x7f4d800a5780 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4d9806b1a0 tx=0x7f4d90009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:07.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.564+0000 7f4da144b740 1 -- 172.21.15.92:0/1174546682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bcdfed540 msgr2=0x556bcdfefa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:07.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.564+0000 7f4da144b740 1 --2- 172.21.15.92:0/1174546682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bcdfed540 0x556bcdfefa00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4d9806ac20 tx=0x7f4d8c0118d0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.564+0000 7f4da144b740 1 -- 172.21.15.92:0/1174546682 shutdown_connections 2024-09-19T09:03:07.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.565+0000 7f4da144b740 1 --2- 172.21.15.92:0/1174546682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bcdfed540 0x556bcdfefa00 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.565+0000 7f4da144b740 1 --2- 172.21.15.92:0/1174546682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556bcdfe84b0 0x556bcdfecf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.565+0000 7f4da144b740 1 --2- 172.21.15.92:0/1174546682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bcdfe7b70 0x556bcdfe7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.565+0000 7f4da144b740 1 -- 172.21.15.92:0/1174546682 >> 172.21.15.92:0/1174546682 conn(0x556bcdfe31e0 msgr2=0x556bcdfe35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:07.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.565+0000 7f4da144b740 1 -- 172.21.15.92:0/1174546682 shutdown_connections 2024-09-19T09:03:07.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.565+0000 7f4da144b740 1 -- 172.21.15.92:0/1174546682 wait complete. 2024-09-19T09:03:07.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.566+0000 7f4da144b740 1 -- start start 2024-09-19T09:03:07.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.566+0000 7f4da144b740 1 Processor -- start 2024-09-19T09:03:07.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.567+0000 7f4da144b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556bcdfe7b70 0x556bcdff1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.567+0000 7f4da144b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bcdfe84b0 0x556bcdff22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.567+0000 7f4da144b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bcdfed540 0x556bcdff9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.567+0000 7f4da144b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556bcdff0510 con 0x556bcdfe7b70 2024-09-19T09:03:07.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.567+0000 7f4da144b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556bcded4290 con 0x556bcdfed540 2024-09-19T09:03:07.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.567+0000 7f4da144b740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x556bcdff0690 con 0x556bcdfe84b0 2024-09-19T09:03:07.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.567+0000 7f4d9cc49640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bcdfed540 0x556bcdff9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.567+0000 7f4da144b740 10 client.0 _ll_register_callbacks cb 0x556bcdf05140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:07.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.567+0000 7f4d9cc49640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bcdfed540 0x556bcdff9320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:50164/0 (socket says 172.21.15.92:50164) 2024-09-19T09:03:07.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.567+0000 7f4d9cc49640 1 -- 172.21.15.92:0/1588180624 learned_addr learned my addr 172.21.15.92:0/1588180624 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:07.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.567+0000 7f4d97fff640 1 --2- 172.21.15.92:0/1588180624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556bcdfe7b70 0x556bcdff1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.568+0000 7f4d977fe640 1 --2- 172.21.15.92:0/1588180624 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bcdfe84b0 0x556bcdff22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.568+0000 7f4d9cc49640 1 -- 172.21.15.92:0/1588180624 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bcdfe84b0 msgr2=0x556bcdff22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:07.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.568+0000 7f4d9cc49640 1 --2- 172.21.15.92:0/1588180624 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bcdfe84b0 0x556bcdff22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.568+0000 7f4d9cc49640 1 -- 172.21.15.92:0/1588180624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556bcdfe7b70 msgr2=0x556bcdff1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:07.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.568+0000 7f4d9cc49640 1 --2- 172.21.15.92:0/1588180624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556bcdfe7b70 0x556bcdff1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.568+0000 7f4d9cc49640 1 -- 172.21.15.92:0/1588180624 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bcdc5e210 con 0x556bcdfed540 2024-09-19T09:03:07.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.568+0000 7f4d977fe640 1 --2- 172.21.15.92:0/1588180624 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bcdfe84b0 0x556bcdff22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:07.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.568+0000 7f4d9cc49640 1 --2- 172.21.15.92:0/1588180624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bcdfed540 0x556bcdff9320 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4d90005f40 tx=0x7f4d90004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da8d5a9082378ff0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:07.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.568+0000 7f4d777fe640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:03:07.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.569+0000 7f4d777fe640 1 -- 172.21.15.92:0/1588180624 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9000fd50 con 0x556bcdfed540 2024-09-19T09:03:07.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.569+0000 7f4d777fe640 1 -- 172.21.15.92:0/1588180624 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4d9001e420 con 0x556bcdfed540 2024-09-19T09:03:07.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.569+0000 7f4da144b740 1 -- 172.21.15.92:0/1588180624 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d8c0035f0 con 0x556bcdfed540 2024-09-19T09:03:07.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.569+0000 7f4d777fe640 1 -- 172.21.15.92:0/1588180624 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4d90004830 con 0x556bcdfed540 2024-09-19T09:03:07.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.569+0000 7f4da144b740 10 client.26174 fetch_fsmap learned FSMap version 19 2024-09-19T09:03:07.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.569+0000 7f4da144b740 1 -- 172.21.15.92:0/1588180624 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x556bcdd2a620 con 0x556bcdfed540 2024-09-19T09:03:07.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.570+0000 7f4d777fe640 1 -- 172.21.15.92:0/1588180624 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d9001eb00 con 0x556bcdfed540 2024-09-19T09:03:07.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.570+0000 7f4d777fe640 1 -- 172.21.15.92:0/1588180624 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f4d90031930 con 0x556bcdfed540 2024-09-19T09:03:07.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.570+0000 7f4da144b740 10 client.26174 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:03:07.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.570+0000 7f4da144b740 10 client.26174 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:03:07.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.570+0000 7f4da144b740 20 client.26174 populate_metadata read hostname 'smithi092' 2024-09-19T09:03:07.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.570+0000 7f4da144b740 1 --2- 172.21.15.92:0/1588180624 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556bcdffda90 0x556bcdfffec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.570+0000 7f4da144b740 4 client.26174 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:07.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.570+0000 7f4da144b740 1 -- 172.21.15.92:0/1588180624 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4d8c0035f0 con 0x556bcdffda90 2024-09-19T09:03:07.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.570+0000 7f4d97fff640 1 --2- 172.21.15.92:0/1588180624 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556bcdffda90 0x556bcdfffec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.571+0000 7f4d777fe640 10 client.26174 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:07.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.571+0000 7f4d97fff640 1 --2- 172.21.15.92:0/1588180624 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556bcdffda90 0x556bcdfffec0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2f3e8818a7f4547 server_cookie=84a93f5374565c42 in_seq=0 out_seq=0 2024-09-19T09:03:07.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.572+0000 7f4d777fe640 1 -- 172.21.15.92:0/1588180624 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f4d8c0035f0 con 0x556bcdffda90 2024-09-19T09:03:07.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.572+0000 7f4d777fe640 10 client.26174 handle_command_reply: tid=0 2024-09-19T09:03:07.575 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.572+0000 7f4da144b740 1 client.26174 shutdown 2024-09-19T09:03:07.575 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.573+0000 7f4da144b740 1 -- 172.21.15.92:0/1588180624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bcdfed540 msgr2=0x556bcdff9320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:07.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.573+0000 7f4da144b740 1 --2- 172.21.15.92:0/1588180624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bcdfed540 0x556bcdff9320 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4d90005f40 tx=0x7f4d90004ab0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.573+0000 7f4da144b740 1 -- 172.21.15.92:0/1588180624 shutdown_connections 2024-09-19T09:03:07.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.573+0000 7f4da144b740 1 --2- 172.21.15.92:0/1588180624 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556bcdffda90 0x556bcdfffec0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.573+0000 7f4da144b740 1 --2- 172.21.15.92:0/1588180624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bcdfed540 0x556bcdff9320 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.573+0000 7f4da144b740 1 --2- 172.21.15.92:0/1588180624 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bcdfe84b0 0x556bcdff22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.573+0000 7f4da144b740 1 --2- 172.21.15.92:0/1588180624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556bcdfe7b70 0x556bcdff1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.573+0000 7f4da144b740 1 -- 172.21.15.92:0/1588180624 >> 172.21.15.92:0/1588180624 conn(0x556bcdfe31e0 msgr2=0x556bcdfe49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:07.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.573+0000 7f4d777fe640 0 client.26174 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:07.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.573+0000 7f4da144b740 1 -- 172.21.15.92:0/1588180624 shutdown_connections 2024-09-19T09:03:07.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.573+0000 7f4da144b740 1 -- 172.21.15.92:0/1588180624 wait complete. 2024-09-19T09:03:07.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.573+0000 7f4da144b740 20 client.26174 trim_cache size 0 max 16384 2024-09-19T09:03:07.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.597+0000 7f4da144b740 1 Processor -- start 2024-09-19T09:03:07.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.597+0000 7f4da144b740 1 -- start start 2024-09-19T09:03:07.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.598+0000 7f4da144b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556bcdfe7b70 0x556bcdfe47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.598+0000 7f4da144b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bcdfe84b0 0x556bcdfe4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.598+0000 7f4da144b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bcdfed540 0x556bcdff92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.598+0000 7f4da144b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4d981ad5b0 con 0x556bcdfe7b70 2024-09-19T09:03:07.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.598+0000 7f4da144b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4d981afe50 con 0x556bcdfe84b0 2024-09-19T09:03:07.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.598+0000 7f4da144b740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4d981adc40 con 0x556bcdfed540 2024-09-19T09:03:07.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.598+0000 7f4d97fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556bcdfe7b70 0x556bcdfe47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.598+0000 7f4d977fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bcdfe84b0 0x556bcdfe4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.598+0000 7f4d97fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556bcdfe7b70 0x556bcdfe47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34858/0 (socket says 172.21.15.92:34858) 2024-09-19T09:03:07.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.598+0000 7f4d977fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bcdfe84b0 0x556bcdfe4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:50170/0 (socket says 172.21.15.92:50170) 2024-09-19T09:03:07.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.598+0000 7f4d97fff640 1 -- 172.21.15.92:0/3891651970 learned_addr learned my addr 172.21.15.92:0/3891651970 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:07.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.598+0000 7f4d9cc49640 1 --2- 172.21.15.92:0/3891651970 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bcdfed540 0x556bcdff92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.599+0000 7f4d977fe640 1 -- 172.21.15.92:0/3891651970 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bcdfed540 msgr2=0x556bcdff92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:07.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.599+0000 7f4d977fe640 1 --2- 172.21.15.92:0/3891651970 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bcdfed540 0x556bcdff92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.599+0000 7f4d977fe640 1 -- 172.21.15.92:0/3891651970 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556bcdfe7b70 msgr2=0x556bcdfe47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:07.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.599+0000 7f4d977fe640 1 --2- 172.21.15.92:0/3891651970 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556bcdfe7b70 0x556bcdfe47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.599+0000 7f4d977fe640 1 -- 172.21.15.92:0/3891651970 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bcdfe9140 con 0x556bcdfe84b0 2024-09-19T09:03:07.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.599+0000 7f4d9cc49640 1 --2- 172.21.15.92:0/3891651970 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bcdfed540 0x556bcdff92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:07.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.599+0000 7f4d97fff640 1 --2- 172.21.15.92:0/3891651970 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556bcdfe7b70 0x556bcdfe47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:07.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.599+0000 7f4d977fe640 1 --2- 172.21.15.92:0/3891651970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bcdfe84b0 0x556bcdfe4ce0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c009ef0 tx=0x7f4d8c0050b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a070c93617937d5f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:07.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.599+0000 7f4d7dffb640 1 -- 172.21.15.92:0/3891651970 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c01e040 con 0x556bcdfe84b0 2024-09-19T09:03:07.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.599+0000 7f4d7dffb640 1 -- 172.21.15.92:0/3891651970 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d8c0035f0 con 0x556bcdfe84b0 2024-09-19T09:03:07.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.599+0000 7f4d7dffb640 1 -- 172.21.15.92:0/3891651970 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c00f540 con 0x556bcdfe84b0 2024-09-19T09:03:07.604 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.600+0000 7f4da144b740 1 -- 172.21.15.92:0/3891651970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bcdfe84b0 msgr2=0x556bcdfe4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:07.604 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.600+0000 7f4da144b740 1 --2- 172.21.15.92:0/3891651970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bcdfe84b0 0x556bcdfe4ce0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c009ef0 tx=0x7f4d8c0050b0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.604 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.600+0000 7f4da144b740 1 -- 172.21.15.92:0/3891651970 shutdown_connections 2024-09-19T09:03:07.604 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.601+0000 7f4da144b740 1 --2- 172.21.15.92:0/3891651970 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bcdfed540 0x556bcdff92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.604 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.601+0000 7f4da144b740 1 --2- 172.21.15.92:0/3891651970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bcdfe84b0 0x556bcdfe4ce0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.604 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.601+0000 7f4da144b740 1 --2- 172.21.15.92:0/3891651970 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556bcdfe7b70 0x556bcdfe47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.601+0000 7f4da144b740 1 -- 172.21.15.92:0/3891651970 >> 172.21.15.92:0/3891651970 conn(0x556bcdfe31e0 msgr2=0x556bcdfe4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:07.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.601+0000 7f4da144b740 1 -- 172.21.15.92:0/3891651970 shutdown_connections 2024-09-19T09:03:07.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.601+0000 7f4da144b740 1 -- 172.21.15.92:0/3891651970 wait complete. 2024-09-19T09:03:07.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.601+0000 7f4da144b740 1 -- start start 2024-09-19T09:03:07.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.602+0000 7f4da144b740 1 Processor -- start 2024-09-19T09:03:07.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.602+0000 7f4da144b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bcdfe7b70 0x556bcdff65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.602+0000 7f4da144b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bcdfe84b0 0x556bcdff6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.602+0000 7f4d97fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bcdfe7b70 0x556bcdff65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.602+0000 7f4d97fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bcdfe7b70 0x556bcdff65d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:50184/0 (socket says 172.21.15.92:50184) 2024-09-19T09:03:07.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.602+0000 7f4d97fff640 1 -- 172.21.15.92:0/3522655938 learned_addr learned my addr 172.21.15.92:0/3522655938 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:07.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.602+0000 7f4d977fe640 1 --2- 172.21.15.92:0/3522655938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bcdfe84b0 0x556bcdff6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.602+0000 7f4da144b740 1 --2- 172.21.15.92:0/3522655938 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556bcdfed540 0x556bcdff7b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.603+0000 7f4da144b740 1 -- 172.21.15.92:0/3522655938 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4d981ae310 con 0x556bcdfed540 2024-09-19T09:03:07.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.603+0000 7f4d9cc49640 1 --2- 172.21.15.92:0/3522655938 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556bcdfed540 0x556bcdff7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.603+0000 7f4da144b740 1 -- 172.21.15.92:0/3522655938 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4d981af780 con 0x556bcdfe7b70 2024-09-19T09:03:07.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.603+0000 7f4da144b740 1 -- 172.21.15.92:0/3522655938 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4d981ae9e0 con 0x556bcdfe84b0 2024-09-19T09:03:07.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.603+0000 7f4da144b740 10 client.0 _ll_register_callbacks cb 0x7f4d90009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:07.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.603+0000 7f4d97fff640 1 -- 172.21.15.92:0/3522655938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bcdfe84b0 msgr2=0x556bcdff6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:07.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.603+0000 7f4d97fff640 1 --2- 172.21.15.92:0/3522655938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bcdfe84b0 0x556bcdff6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.603+0000 7f4d97fff640 1 -- 172.21.15.92:0/3522655938 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556bcdfed540 msgr2=0x556bcdff7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:07.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.603+0000 7f4d97fff640 1 --2- 172.21.15.92:0/3522655938 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556bcdfed540 0x556bcdff7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.603+0000 7f4d97fff640 1 -- 172.21.15.92:0/3522655938 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bcdff8130 con 0x556bcdfe7b70 2024-09-19T09:03:07.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.603+0000 7f4d977fe640 1 --2- 172.21.15.92:0/3522655938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bcdfe84b0 0x556bcdff6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:07.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.603+0000 7f4d9cc49640 1 --2- 172.21.15.92:0/3522655938 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556bcdfed540 0x556bcdff7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:07.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.604+0000 7f4d97fff640 1 --2- 172.21.15.92:0/3522655938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bcdfe7b70 0x556bcdff65d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4d880096c0 tx=0x7f4d8802a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94b5194ca84dd9b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:07.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.604+0000 7f4d777fe640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:03:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.604+0000 7f4d777fe640 1 -- 172.21.15.92:0/3522655938 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d880044e0 con 0x556bcdfe7b70 2024-09-19T09:03:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.604+0000 7f4da144b740 1 -- 172.21.15.92:0/3522655938 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d8c0035f0 con 0x556bcdfe7b70 2024-09-19T09:03:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.604+0000 7f4d777fe640 1 -- 172.21.15.92:0/3522655938 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4d8803b460 con 0x556bcdfe7b70 2024-09-19T09:03:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.604+0000 7f4d777fe640 1 -- 172.21.15.92:0/3522655938 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4d880d9050 con 0x556bcdfe7b70 2024-09-19T09:03:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.604+0000 7f4da144b740 10 client.26180 fetch_fsmap learned FSMap version 19 2024-09-19T09:03:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.604+0000 7f4da144b740 1 -- 172.21.15.92:0/3522655938 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x556bcdff9510 con 0x556bcdfe7b70 2024-09-19T09:03:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.605+0000 7f4d777fe640 1 -- 172.21.15.92:0/3522655938 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d880bb850 con 0x556bcdfe7b70 2024-09-19T09:03:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.605+0000 7f4d777fe640 1 -- 172.21.15.92:0/3522655938 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f4d8803bc10 con 0x556bcdfe7b70 2024-09-19T09:03:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.605+0000 7f4da144b740 10 client.26180 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:03:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.605+0000 7f4da144b740 10 client.26180 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:03:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.605+0000 7f4da144b740 20 client.26180 populate_metadata read hostname 'smithi092' 2024-09-19T09:03:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.605+0000 7f4da144b740 1 --2- 172.21.15.92:0/3522655938 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556bce068d40 0x556bce06b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.605+0000 7f4da144b740 4 client.26180 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:03:07.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.605+0000 7f4da144b740 1 -- 172.21.15.92:0/3522655938 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f4d8c0035f0 con 0x556bce068d40 2024-09-19T09:03:07.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.605+0000 7f4d977fe640 1 --2- 172.21.15.92:0/3522655938 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556bce068d40 0x556bce06b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.606+0000 7f4d977fe640 1 --2- 172.21.15.92:0/3522655938 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556bce068d40 0x556bce06b160 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=187e5afcbd161ee9 server_cookie=f57371568661d469 in_seq=0 out_seq=0 2024-09-19T09:03:07.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.606+0000 7f4d777fe640 10 client.26180 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:07.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.629+0000 7f4d777fe640 1 -- 172.21.15.92:0/3522655938 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f4d8c0035f0 con 0x556bce068d40 2024-09-19T09:03:07.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.629+0000 7f4d777fe640 10 client.26180 handle_command_reply: tid=0 2024-09-19T09:03:07.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.629+0000 7f4da144b740 1 client.26180 shutdown 2024-09-19T09:03:07.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.629+0000 7f4da144b740 1 -- 172.21.15.92:0/3522655938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bcdfe7b70 msgr2=0x556bcdff65d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:07.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.629+0000 7f4da144b740 1 --2- 172.21.15.92:0/3522655938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bcdfe7b70 0x556bcdff65d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4d880096c0 tx=0x7f4d8802a410 comp rx=0 tx=0).stop 2024-09-19T09:03:07.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.629+0000 7f4da144b740 1 -- 172.21.15.92:0/3522655938 shutdown_connections 2024-09-19T09:03:07.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.629+0000 7f4da144b740 1 --2- 172.21.15.92:0/3522655938 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556bce068d40 0x556bce06b160 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.629+0000 7f4da144b740 1 --2- 172.21.15.92:0/3522655938 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556bcdfed540 0x556bcdff7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.629+0000 7f4d777fe640 0 client.26180 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:07.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.629+0000 7f4da144b740 1 --2- 172.21.15.92:0/3522655938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556bcdfe84b0 0x556bcdff6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.629+0000 7f4da144b740 1 --2- 172.21.15.92:0/3522655938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bcdfe7b70 0x556bcdff65d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.629+0000 7f4da144b740 1 -- 172.21.15.92:0/3522655938 >> 172.21.15.92:0/3522655938 conn(0x556bcdfe31e0 msgr2=0x556bcdfe22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:07.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.630+0000 7f4da144b740 1 -- 172.21.15.92:0/3522655938 shutdown_connections 2024-09-19T09:03:07.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.630+0000 7f4da144b740 1 -- 172.21.15.92:0/3522655938 wait complete. 2024-09-19T09:03:07.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.630+0000 7f4da144b740 20 client.26180 trim_cache size 0 max 16384 2024-09-19T09:03:07.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:03:07.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:03:07.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:03:07.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:03:07.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.630+0000 7f4d9d44a640 1 -- 172.21.15.92:0/479634902 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4d800a32c0 msgr2=0x7f4d800a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:07.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.630+0000 7f4d9d44a640 1 --2- 172.21.15.92:0/479634902 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4d800a32c0 0x7f4d800a5780 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4d9806b1a0 tx=0x7f4d90009500 comp rx=0 tx=0).stop 2024-09-19T09:03:07.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.630+0000 7f4d9d44a640 1 -- 172.21.15.92:0/479634902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d981023c0 msgr2=0x7f4d98101d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:07.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.630+0000 7f4d9d44a640 1 --2- 172.21.15.92:0/479634902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d981023c0 0x7f4d98101d30 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f4d88009230 tx=0x7f4d880042f0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.630+0000 7f4d9d44a640 1 -- 172.21.15.92:0/479634902 shutdown_connections 2024-09-19T09:03:07.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.630+0000 7f4d9d44a640 1 --2- 172.21.15.92:0/479634902 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d98107620 0x7f4d981008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.630+0000 7f4d9d44a640 1 --2- 172.21.15.92:0/479634902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d98104cf0 0x7f4d98100370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.630+0000 7f4d9d44a640 1 --2- 172.21.15.92:0/479634902 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4d800a32c0 0x7f4d800a5780 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.630+0000 7f4d9d44a640 1 --2- 172.21.15.92:0/479634902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d981023c0 0x7f4d98101d30 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.630+0000 7f4d9d44a640 1 -- 172.21.15.92:0/479634902 >> 172.21.15.92:0/479634902 conn(0x7f4d980fbfa0 msgr2=0x7f4d98102e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:07.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.630+0000 7f4d9d44a640 1 -- 172.21.15.92:0/479634902 shutdown_connections 2024-09-19T09:03:07.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:07.630+0000 7f4d9d44a640 1 -- 172.21.15.92:0/479634902 wait complete. 2024-09-19T09:03:07.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:07 smithi092 ceph-mon[31407]: pgmap v529: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 848 op/s 2024-09-19T09:03:07.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:07 smithi167 ceph-mon[35359]: pgmap v529: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 848 op/s 2024-09-19T09:03:07.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:07 smithi190 ceph-mon[35358]: pgmap v529: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 848 op/s 2024-09-19T09:03:09.450 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:09 smithi092 ceph-mon[31407]: pgmap v530: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 847 op/s 2024-09-19T09:03:09.601 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:09 smithi167 ceph-mon[35359]: pgmap v530: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 847 op/s 2024-09-19T09:03:09.623 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:09 smithi190 ceph-mon[35358]: pgmap v530: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 847 op/s 2024-09-19T09:03:10.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 385.0 s, 3738.6 tps, lat 26.769 ms stddev 29.191 2024-09-19T09:03:11.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:11 smithi092 ceph-mon[31407]: pgmap v531: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 955 op/s 2024-09-19T09:03:11.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:11 smithi167 ceph-mon[35359]: pgmap v531: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 955 op/s 2024-09-19T09:03:11.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:11 smithi190 ceph-mon[35358]: pgmap v531: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 955 op/s 2024-09-19T09:03:13.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:13 smithi092 ceph-mon[31407]: pgmap v532: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 11 MiB/s wr, 853 op/s 2024-09-19T09:03:13.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:13 smithi167 ceph-mon[35359]: pgmap v532: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 11 MiB/s wr, 853 op/s 2024-09-19T09:03:13.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:13 smithi190 ceph-mon[35358]: pgmap v532: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 11 MiB/s wr, 853 op/s 2024-09-19T09:03:15.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:15 smithi092 ceph-mon[31407]: pgmap v533: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 MiB/s wr, 891 op/s 2024-09-19T09:03:15.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 390.0 s, 3675.6 tps, lat 27.102 ms stddev 29.492 2024-09-19T09:03:15.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:15 smithi167 ceph-mon[35359]: pgmap v533: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 MiB/s wr, 891 op/s 2024-09-19T09:03:15.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:15 smithi190 ceph-mon[35358]: pgmap v533: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 MiB/s wr, 891 op/s 2024-09-19T09:03:17.334 INFO:tasks.quiescer.fs.[cephfs]:Total duration (51.5) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T09:03:17.334 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.75 2024-09-19T09:03:17.335 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:03:17.723 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:17.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:17 smithi092 ceph-mon[31407]: pgmap v534: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 10 MiB/s wr, 786 op/s 2024-09-19T09:03:17.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:17 smithi167 ceph-mon[35359]: pgmap v534: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 10 MiB/s wr, 786 op/s 2024-09-19T09:03:17.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:17 smithi190 ceph-mon[35358]: pgmap v534: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 10 MiB/s wr, 786 op/s 2024-09-19T09:03:18.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.341+0000 7fe21f02d640 1 -- 172.21.15.92:0/603201982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe218108300 msgr2=0x7fe21810ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:18.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.341+0000 7fe21f02d640 1 --2- 172.21.15.92:0/603201982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe218108300 0x7fe21810ec70 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fe20c009930 tx=0x7fe20c02a420 comp rx=0 tx=0).stop 2024-09-19T09:03:18.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.341+0000 7fe21f02d640 1 -- 172.21.15.92:0/603201982 shutdown_connections 2024-09-19T09:03:18.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.341+0000 7fe21f02d640 1 --2- 172.21.15.92:0/603201982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe218108300 0x7fe21810ec70 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.341+0000 7fe21f02d640 1 --2- 172.21.15.92:0/603201982 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe218103780 0x7fe218107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.341+0000 7fe21f02d640 1 --2- 172.21.15.92:0/603201982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe218102dd0 0x7fe2181031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.341+0000 7fe21f02d640 1 -- 172.21.15.92:0/603201982 >> 172.21.15.92:0/603201982 conn(0x7fe2180fc7d0 msgr2=0x7fe2180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:18.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.341+0000 7fe21f02d640 1 -- 172.21.15.92:0/603201982 shutdown_connections 2024-09-19T09:03:18.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.341+0000 7fe21f02d640 1 -- 172.21.15.92:0/603201982 wait complete. 2024-09-19T09:03:18.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.342+0000 7fe21f02d640 1 Processor -- start 2024-09-19T09:03:18.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.343+0000 7fe21f02d640 1 -- start start 2024-09-19T09:03:18.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.343+0000 7fe21f02d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe218102dd0 0x7fe2180739e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:18.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.343+0000 7fe21f02d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe218103780 0x7fe21806ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:18.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.343+0000 7fe21f02d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe218108300 0x7fe21806cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:18.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.343+0000 7fe21f02d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe2181120d0 con 0x7fe218102dd0 2024-09-19T09:03:18.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.343+0000 7fe21f02d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe218111f50 con 0x7fe218103780 2024-09-19T09:03:18.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.343+0000 7fe21f02d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe218112250 con 0x7fe218108300 2024-09-19T09:03:18.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.344+0000 7fe21cdc9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe218102dd0 0x7fe2180739e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:18.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.344+0000 7fe21cdc9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe218102dd0 0x7fe2180739e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51604/0 (socket says 172.21.15.92:51604) 2024-09-19T09:03:18.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.344+0000 7fe21cdc9640 1 -- 172.21.15.92:0/40625645 learned_addr learned my addr 172.21.15.92:0/40625645 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:18.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.344+0000 7fe21d5ca640 1 --2- 172.21.15.92:0/40625645 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe218108300 0x7fe21806cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:18.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.344+0000 7fe217fff640 1 --2- 172.21.15.92:0/40625645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe218103780 0x7fe21806ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:18.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.344+0000 7fe217fff640 1 -- 172.21.15.92:0/40625645 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe218108300 msgr2=0x7fe21806cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:18.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.344+0000 7fe217fff640 1 --2- 172.21.15.92:0/40625645 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe218108300 0x7fe21806cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.344+0000 7fe217fff640 1 -- 172.21.15.92:0/40625645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe218102dd0 msgr2=0x7fe2180739e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:18.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.344+0000 7fe217fff640 1 --2- 172.21.15.92:0/40625645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe218102dd0 0x7fe2180739e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.344+0000 7fe217fff640 1 -- 172.21.15.92:0/40625645 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe21806d570 con 0x7fe218103780 2024-09-19T09:03:18.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.344+0000 7fe217fff640 1 --2- 172.21.15.92:0/40625645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe218103780 0x7fe21806ca70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe2180697d0 tx=0x7fe20800ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:18.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.344+0000 7fe215ffb640 1 -- 172.21.15.92:0/40625645 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20800cc40 con 0x7fe218103780 2024-09-19T09:03:18.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.344+0000 7fe215ffb640 1 -- 172.21.15.92:0/40625645 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe20800cde0 con 0x7fe218103780 2024-09-19T09:03:18.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.344+0000 7fe21f02d640 1 -- 172.21.15.92:0/40625645 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe21806d860 con 0x7fe218103780 2024-09-19T09:03:18.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.344+0000 7fe215ffb640 1 -- 172.21.15.92:0/40625645 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe208004a00 con 0x7fe218103780 2024-09-19T09:03:18.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.345+0000 7fe21f02d640 1 -- 172.21.15.92:0/40625645 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe218071830 con 0x7fe218103780 2024-09-19T09:03:18.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.346+0000 7fe21f02d640 1 -- 172.21.15.92:0/40625645 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe21806a7b0 con 0x7fe218103780 2024-09-19T09:03:18.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.349+0000 7fe215ffb640 1 -- 172.21.15.92:0/40625645 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe208004ba0 con 0x7fe218103780 2024-09-19T09:03:18.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.350+0000 7fe215ffb640 1 --2- 172.21.15.92:0/40625645 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe2000a76d0 0x7fe2000a9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:18.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.350+0000 7fe215ffb640 1 -- 172.21.15.92:0/40625645 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe2080cf780 con 0x7fe218103780 2024-09-19T09:03:18.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.350+0000 7fe21cdc9640 1 --2- 172.21.15.92:0/40625645 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe2000a76d0 0x7fe2000a9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:18.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.351+0000 7fe21cdc9640 1 --2- 172.21.15.92:0/40625645 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe2000a76d0 0x7fe2000a9b90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe210009fd0 tx=0x7fe210009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:18.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.356+0000 7fe215ffb640 1 -- 172.21.15.92:0/40625645 <== mon.2 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe20809c4a0 con 0x7fe218103780 2024-09-19T09:03:18.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.702+0000 7fe21f02d640 1 -- 172.21.15.92:0/40625645 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe2180722b0 con 0x7fe218103780 2024-09-19T09:03:18.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.704+0000 7fe215ffb640 1 -- 172.21.15.92:0/40625645 <== mon.2 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7fe20809bda0 con 0x7fe218103780 2024-09-19T09:03:18.704 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:03:18.705 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:03:18.705 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:03:18.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.707+0000 7fe21f02d640 1 -- 172.21.15.92:0/40625645 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe2000a76d0 msgr2=0x7fe2000a9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:18.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.707+0000 7fe21f02d640 1 --2- 172.21.15.92:0/40625645 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe2000a76d0 0x7fe2000a9b90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe210009fd0 tx=0x7fe210009500 comp rx=0 tx=0).stop 2024-09-19T09:03:18.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.708+0000 7fe21f02d640 1 -- 172.21.15.92:0/40625645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe218103780 msgr2=0x7fe21806ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:18.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.708+0000 7fe21f02d640 1 --2- 172.21.15.92:0/40625645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe218103780 0x7fe21806ca70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe2180697d0 tx=0x7fe20800ee50 comp rx=0 tx=0).stop 2024-09-19T09:03:18.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.711+0000 7fe21f02d640 1 -- 172.21.15.92:0/40625645 shutdown_connections 2024-09-19T09:03:18.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.711+0000 7fe21f02d640 1 --2- 172.21.15.92:0/40625645 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe218108300 0x7fe21806cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.711+0000 7fe21f02d640 1 --2- 172.21.15.92:0/40625645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe218103780 0x7fe21806ca70 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.711+0000 7fe21f02d640 1 --2- 172.21.15.92:0/40625645 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe2000a76d0 0x7fe2000a9b90 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.711+0000 7fe21f02d640 1 --2- 172.21.15.92:0/40625645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe218102dd0 0x7fe2180739e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.711+0000 7fe21f02d640 1 -- 172.21.15.92:0/40625645 >> 172.21.15.92:0/40625645 conn(0x7fe2180fc7d0 msgr2=0x7fe218105e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:18.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.712+0000 7fe21f02d640 1 -- 172.21.15.92:0/40625645 shutdown_connections 2024-09-19T09:03:18.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:18.712+0000 7fe21f02d640 1 -- 172.21.15.92:0/40625645 wait complete. 2024-09-19T09:03:18.968 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:03:19.675 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 145.75 --await-for 45.0' 2024-09-19T09:03:19.676 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 145.75 --await-for 45.0 2024-09-19T09:03:19.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:19 smithi092 ceph-mon[31407]: pgmap v535: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 11 MiB/s wr, 812 op/s 2024-09-19T09:03:19.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:19 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/40625645' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:19.813 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:19.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:19 smithi167 ceph-mon[35359]: pgmap v535: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 11 MiB/s wr, 812 op/s 2024-09-19T09:03:19.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:19 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/40625645' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:19.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:19 smithi190 ceph-mon[35358]: pgmap v535: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 11 MiB/s wr, 812 op/s 2024-09-19T09:03:19.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:19 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/40625645' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:20.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.376+0000 7fdb7f3f7640 1 -- 172.21.15.92:0/3150610016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb781083f0 msgr2=0x7fdb781087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:20.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.376+0000 7fdb7f3f7640 1 --2- 172.21.15.92:0/3150610016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb781083f0 0x7fdb781087d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdb74009900 tx=0x7fdb7402a420 comp rx=0 tx=0).stop 2024-09-19T09:03:20.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.377+0000 7fdb7f3f7640 1 -- 172.21.15.92:0/3150610016 shutdown_connections 2024-09-19T09:03:20.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.377+0000 7fdb7f3f7640 1 --2- 172.21.15.92:0/3150610016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb7810d520 0x7fdb781150a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.377+0000 7fdb7f3f7640 1 --2- 172.21.15.92:0/3150610016 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdb78108da0 0x7fdb7810cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.377+0000 7fdb7f3f7640 1 --2- 172.21.15.92:0/3150610016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb781083f0 0x7fdb781087d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.377+0000 7fdb7f3f7640 1 -- 172.21.15.92:0/3150610016 >> 172.21.15.92:0/3150610016 conn(0x7fdb78077af0 msgr2=0x7fdb78079f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:20.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.378+0000 7fdb7f3f7640 1 -- 172.21.15.92:0/3150610016 shutdown_connections 2024-09-19T09:03:20.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.378+0000 7fdb7f3f7640 1 -- 172.21.15.92:0/3150610016 wait complete. 2024-09-19T09:03:20.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.379+0000 7fdb7f3f7640 1 Processor -- start 2024-09-19T09:03:20.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.379+0000 7fdb7f3f7640 1 -- start start 2024-09-19T09:03:20.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.379+0000 7fdb7f3f7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb781083f0 0x7fdb78073b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:20.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.379+0000 7fdb7f3f7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb78108da0 0x7fdb7806cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:20.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.379+0000 7fdb7d193640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb781083f0 0x7fdb78073b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:20.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.380+0000 7fdb7d193640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb781083f0 0x7fdb78073b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51632/0 (socket says 172.21.15.92:51632) 2024-09-19T09:03:20.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.380+0000 7fdb7d193640 1 -- 172.21.15.92:0/2416546963 learned_addr learned my addr 172.21.15.92:0/2416546963 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:20.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.380+0000 7fdb7f3f7640 1 --2- 172.21.15.92:0/2416546963 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdb7810d520 0x7fdb7806d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:20.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.380+0000 7fdb7c992640 1 --2- 172.21.15.92:0/2416546963 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb78108da0 0x7fdb7806cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:20.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.380+0000 7fdb7f3f7640 1 -- 172.21.15.92:0/2416546963 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdb78118690 con 0x7fdb781083f0 2024-09-19T09:03:20.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.380+0000 7fdb7f3f7640 1 -- 172.21.15.92:0/2416546963 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdb78118510 con 0x7fdb78108da0 2024-09-19T09:03:20.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.380+0000 7fdb7d994640 1 --2- 172.21.15.92:0/2416546963 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdb7810d520 0x7fdb7806d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:20.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.380+0000 7fdb7f3f7640 1 -- 172.21.15.92:0/2416546963 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fdb78118810 con 0x7fdb7810d520 2024-09-19T09:03:20.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.381+0000 7fdb7d994640 1 -- 172.21.15.92:0/2416546963 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb78108da0 msgr2=0x7fdb7806cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:20.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.381+0000 7fdb7d994640 1 --2- 172.21.15.92:0/2416546963 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb78108da0 0x7fdb7806cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.381+0000 7fdb7d994640 1 -- 172.21.15.92:0/2416546963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb781083f0 msgr2=0x7fdb78073b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:20.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.381+0000 7fdb7d994640 1 --2- 172.21.15.92:0/2416546963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb781083f0 0x7fdb78073b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.381+0000 7fdb7d994640 1 -- 172.21.15.92:0/2416546963 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb7806d860 con 0x7fdb7810d520 2024-09-19T09:03:20.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.381+0000 7fdb7d994640 1 --2- 172.21.15.92:0/2416546963 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdb7810d520 0x7fdb7806d130 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdb7000be20 tx=0x7fdb70009ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:20.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.382+0000 7fdb6e7fc640 1 -- 172.21.15.92:0/2416546963 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb70019070 con 0x7fdb7810d520 2024-09-19T09:03:20.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.382+0000 7fdb6e7fc640 1 -- 172.21.15.92:0/2416546963 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb7000cd70 con 0x7fdb7810d520 2024-09-19T09:03:20.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.382+0000 7fdb6e7fc640 1 -- 172.21.15.92:0/2416546963 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb70012860 con 0x7fdb7810d520 2024-09-19T09:03:20.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.382+0000 7fdb7f3f7640 1 -- 172.21.15.92:0/2416546963 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb78071690 con 0x7fdb7810d520 2024-09-19T09:03:20.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.382+0000 7fdb7f3f7640 1 -- 172.21.15.92:0/2416546963 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb78071b70 con 0x7fdb7810d520 2024-09-19T09:03:20.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.387+0000 7fdb6e7fc640 1 -- 172.21.15.92:0/2416546963 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fdb7001c070 con 0x7fdb7810d520 2024-09-19T09:03:20.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.387+0000 7fdb817d0740 1 Processor -- start 2024-09-19T09:03:20.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.388+0000 7fdb817d0740 1 -- start start 2024-09-19T09:03:20.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.388+0000 7fdb817d0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628edcb24a0 0x5628edcb2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:20.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.388+0000 7fdb817d0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628edcb2dc0 0x5628edcbd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:20.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.388+0000 7fdb817d0740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628edcbd680 0x5628edcbfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:20.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.388+0000 7fdb7d193640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628edcb2dc0 0x5628edcbd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:20.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.389+0000 7fdb7d193640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628edcb2dc0 0x5628edcbd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:55224/0 (socket says 172.21.15.92:55224) 2024-09-19T09:03:20.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.389+0000 7fdb7d193640 1 -- 172.21.15.92:0/1949248287 learned_addr learned my addr 172.21.15.92:0/1949248287 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:20.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.389+0000 7fdb6e7fc640 1 --2- 172.21.15.92:0/2416546963 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdb640a3410 0x7fdb640a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:20.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.389+0000 7fdb6e7fc640 1 -- 172.21.15.92:0/2416546963 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fdb70014440 con 0x7fdb7810d520 2024-09-19T09:03:20.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.389+0000 7fdb7c992640 1 --2- 172.21.15.92:0/1949248287 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628edcbd680 0x5628edcbfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:20.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.389+0000 7fdb7c992640 1 --2- 172.21.15.92:0/1949248287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628edcb24a0 0x5628edcb2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:20.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.389+0000 7fdb817d0740 1 -- 172.21.15.92:0/1949248287 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5628edc182e0 con 0x5628edcb24a0 2024-09-19T09:03:20.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.390+0000 7fdb817d0740 1 -- 172.21.15.92:0/1949248287 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5628edbbfce0 con 0x5628edcb2dc0 2024-09-19T09:03:20.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.390+0000 7fdb817d0740 1 -- 172.21.15.92:0/1949248287 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5628edc142a0 con 0x5628edcbd680 2024-09-19T09:03:20.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.390+0000 7fdb7d994640 1 --2- 172.21.15.92:0/2416546963 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdb640a3410 0x7fdb640a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:20.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.390+0000 7fdb7c992640 1 -- 172.21.15.92:0/1949248287 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628edcb2dc0 msgr2=0x5628edcbd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:20.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.390+0000 7fdb7c992640 1 --2- 172.21.15.92:0/1949248287 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628edcb2dc0 0x5628edcbd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.390+0000 7fdb7c992640 1 -- 172.21.15.92:0/1949248287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628edcb24a0 msgr2=0x5628edcb2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:20.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.390+0000 7fdb7c992640 1 --2- 172.21.15.92:0/1949248287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628edcb24a0 0x5628edcb2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.390+0000 7fdb7c992640 1 -- 172.21.15.92:0/1949248287 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628edba4440 con 0x5628edcbd680 2024-09-19T09:03:20.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.391+0000 7fdb7c992640 1 --2- 172.21.15.92:0/1949248287 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628edcbd680 0x5628edcbfa70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdb7806e3b0 tx=0x7fdb68006a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e94eae84b41a433 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:20.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.391+0000 7fdb7d994640 1 --2- 172.21.15.92:0/2416546963 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdb640a3410 0x7fdb640a58d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdb70014a30 tx=0x7fdb7000e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:20.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.391+0000 7fdb637fe640 1 -- 172.21.15.92:0/1949248287 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb680157e0 con 0x5628edcbd680 2024-09-19T09:03:20.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.391+0000 7fdb637fe640 1 -- 172.21.15.92:0/1949248287 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb6801d070 con 0x5628edcbd680 2024-09-19T09:03:20.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.391+0000 7fdb637fe640 1 -- 172.21.15.92:0/1949248287 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb680157e0 con 0x5628edcbd680 2024-09-19T09:03:20.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.392+0000 7fdb817d0740 1 -- 172.21.15.92:0/1949248287 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628edcbd680 msgr2=0x5628edcbfa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:20.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.392+0000 7fdb817d0740 1 --2- 172.21.15.92:0/1949248287 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628edcbd680 0x5628edcbfa70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdb7806e3b0 tx=0x7fdb68006a30 comp rx=0 tx=0).stop 2024-09-19T09:03:20.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.393+0000 7fdb817d0740 1 -- 172.21.15.92:0/1949248287 shutdown_connections 2024-09-19T09:03:20.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.393+0000 7fdb817d0740 1 --2- 172.21.15.92:0/1949248287 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628edcbd680 0x5628edcbfa70 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.393+0000 7fdb817d0740 1 --2- 172.21.15.92:0/1949248287 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628edcb2dc0 0x5628edcbd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.393+0000 7fdb817d0740 1 --2- 172.21.15.92:0/1949248287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628edcb24a0 0x5628edcb2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.393+0000 7fdb817d0740 1 -- 172.21.15.92:0/1949248287 >> 172.21.15.92:0/1949248287 conn(0x5628edcaea30 msgr2=0x5628edcaee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:20.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.393+0000 7fdb817d0740 1 -- 172.21.15.92:0/1949248287 shutdown_connections 2024-09-19T09:03:20.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.393+0000 7fdb817d0740 1 -- 172.21.15.92:0/1949248287 wait complete. 2024-09-19T09:03:20.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.394+0000 7fdb817d0740 1 -- start start 2024-09-19T09:03:20.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.394+0000 7fdb817d0740 1 Processor -- start 2024-09-19T09:03:20.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.394+0000 7fdb817d0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628edcb24a0 0x5628edcbcf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:20.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.395+0000 7fdb817d0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628edcb2dc0 0x5628edcba1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:20.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.395+0000 7fdb817d0740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628edcbd680 0x5628edcba720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:20.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.395+0000 7fdb817d0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5628edcc0250 con 0x5628edcb2dc0 2024-09-19T09:03:20.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.395+0000 7fdb817d0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5628edbd3050 con 0x5628edcb24a0 2024-09-19T09:03:20.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.395+0000 7fdb817d0740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5628edcc03d0 con 0x5628edcbd680 2024-09-19T09:03:20.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.395+0000 7fdb817d0740 10 client.0 _ll_register_callbacks cb 0x5628edc13160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:20.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.395+0000 7fdb7d193640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628edcb2dc0 0x5628edcba1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:20.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.395+0000 7fdb7c992640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628edcb24a0 0x5628edcbcf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:20.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.395+0000 7fdb7d193640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628edcb2dc0 0x5628edcba1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51640/0 (socket says 172.21.15.92:51640) 2024-09-19T09:03:20.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.395+0000 7fdb7d193640 1 -- 172.21.15.92:0/1390526476 learned_addr learned my addr 172.21.15.92:0/1390526476 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:20.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.395+0000 7fdb7c992640 1 --2- 172.21.15.92:0/1390526476 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628edcbd680 0x5628edcba720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:20.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.395+0000 7fdb7c992640 1 -- 172.21.15.92:0/1390526476 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628edcbd680 msgr2=0x5628edcba720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:20.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.395+0000 7fdb7c992640 1 --2- 172.21.15.92:0/1390526476 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628edcbd680 0x5628edcba720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.395+0000 7fdb7c992640 1 -- 172.21.15.92:0/1390526476 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628edcb2dc0 msgr2=0x5628edcba1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:20.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.395+0000 7fdb7c992640 1 --2- 172.21.15.92:0/1390526476 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628edcb2dc0 0x5628edcba1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.395+0000 7fdb7c992640 1 -- 172.21.15.92:0/1390526476 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628ed9893c0 con 0x5628edcb24a0 2024-09-19T09:03:20.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.396+0000 7fdb7c992640 1 --2- 172.21.15.92:0/1390526476 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628edcb24a0 0x5628edcbcf30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdb68006aa0 tx=0x7fdb68008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f41cd40950eae0a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:20.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.396+0000 7fdb60ff9640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:03:20.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.396+0000 7fdb60ff9640 1 -- 172.21.15.92:0/1390526476 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb680157e0 con 0x5628edcb24a0 2024-09-19T09:03:20.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.396+0000 7fdb60ff9640 1 -- 172.21.15.92:0/1390526476 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fdb68015980 con 0x5628edcb24a0 2024-09-19T09:03:20.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.396+0000 7fdb817d0740 1 -- 172.21.15.92:0/1390526476 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb6801d070 con 0x5628edcb24a0 2024-09-19T09:03:20.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.397+0000 7fdb60ff9640 1 -- 172.21.15.92:0/1390526476 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fdb68019ea0 con 0x5628edcb24a0 2024-09-19T09:03:20.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.397+0000 7fdb817d0740 10 client.26198 fetch_fsmap learned FSMap version 19 2024-09-19T09:03:20.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.397+0000 7fdb817d0740 1 -- 172.21.15.92:0/1390526476 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5628edccbc00 con 0x5628edcb24a0 2024-09-19T09:03:20.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.397+0000 7fdb60ff9640 1 -- 172.21.15.92:0/1390526476 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb68018de0 con 0x5628edcb24a0 2024-09-19T09:03:20.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.397+0000 7fdb60ff9640 1 -- 172.21.15.92:0/1390526476 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fdb68019250 con 0x5628edcb24a0 2024-09-19T09:03:20.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.398+0000 7fdb817d0740 10 client.26198 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:03:20.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.398+0000 7fdb817d0740 10 client.26198 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:03:20.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.398+0000 7fdb817d0740 20 client.26198 populate_metadata read hostname 'smithi092' 2024-09-19T09:03:20.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.398+0000 7fdb817d0740 1 --2- 172.21.15.92:0/1390526476 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5628edccd000 0x5628edccf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:20.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.398+0000 7fdb817d0740 4 client.26198 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:20.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.398+0000 7fdb817d0740 1 -- 172.21.15.92:0/1390526476 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fdb6801d070 con 0x5628edccd000 2024-09-19T09:03:20.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.398+0000 7fdb7d193640 1 --2- 172.21.15.92:0/1390526476 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5628edccd000 0x5628edccf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:20.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.399+0000 7fdb7d193640 1 --2- 172.21.15.92:0/1390526476 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5628edccd000 0x5628edccf3f0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=487dea8ee36e4b4b server_cookie=a13fb27cb4c20014 in_seq=0 out_seq=0 2024-09-19T09:03:20.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.399+0000 7fdb60ff9640 10 client.26198 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:20.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.400+0000 7fdb60ff9640 1 -- 172.21.15.92:0/1390526476 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fdb6801d070 con 0x5628edccd000 2024-09-19T09:03:20.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.400+0000 7fdb60ff9640 10 client.26198 handle_command_reply: tid=0 2024-09-19T09:03:20.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.400+0000 7fdb817d0740 1 client.26198 shutdown 2024-09-19T09:03:20.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.401+0000 7fdb817d0740 1 -- 172.21.15.92:0/1390526476 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628edcb24a0 msgr2=0x5628edcbcf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:20.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.401+0000 7fdb817d0740 1 --2- 172.21.15.92:0/1390526476 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628edcb24a0 0x5628edcbcf30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdb68006aa0 tx=0x7fdb68008040 comp rx=0 tx=0).stop 2024-09-19T09:03:20.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.401+0000 7fdb817d0740 1 -- 172.21.15.92:0/1390526476 shutdown_connections 2024-09-19T09:03:20.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.401+0000 7fdb817d0740 1 --2- 172.21.15.92:0/1390526476 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5628edccd000 0x5628edccf3f0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.401+0000 7fdb817d0740 1 --2- 172.21.15.92:0/1390526476 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628edcbd680 0x5628edcba720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.401+0000 7fdb817d0740 1 --2- 172.21.15.92:0/1390526476 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628edcb2dc0 0x5628edcba1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.401+0000 7fdb817d0740 1 --2- 172.21.15.92:0/1390526476 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628edcb24a0 0x5628edcbcf30 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.401+0000 7fdb817d0740 1 -- 172.21.15.92:0/1390526476 >> 172.21.15.92:0/1390526476 conn(0x5628edcaea30 msgr2=0x5628edcb4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:20.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.401+0000 7fdb60ff9640 0 client.26198 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:20.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.401+0000 7fdb817d0740 1 -- 172.21.15.92:0/1390526476 shutdown_connections 2024-09-19T09:03:20.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.401+0000 7fdb817d0740 1 -- 172.21.15.92:0/1390526476 wait complete. 2024-09-19T09:03:20.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.401+0000 7fdb817d0740 20 client.26198 trim_cache size 0 max 16384 2024-09-19T09:03:20.405 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:20.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.433+0000 7fdb817d0740 1 Processor -- start 2024-09-19T09:03:20.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.433+0000 7fdb817d0740 1 -- start start 2024-09-19T09:03:20.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.433+0000 7fdb817d0740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628edcb24a0 0x5628edcc9540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:20.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.433+0000 7fdb817d0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628edcb2dc0 0x5628edcd4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:20.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.433+0000 7fdb817d0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628edcbd680 0x5628edcd4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:20.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.433+0000 7fdb817d0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5c00c460 con 0x5628edcb2dc0 2024-09-19T09:03:20.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.433+0000 7fdb817d0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5c00ed00 con 0x5628edcbd680 2024-09-19T09:03:20.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.433+0000 7fdb817d0740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5c00caf0 con 0x5628edcb24a0 2024-09-19T09:03:20.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.433+0000 7fdb7c992640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628edcb24a0 0x5628edcc9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:20.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.433+0000 7fdb7d193640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628edcb2dc0 0x5628edcd4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:20.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.433+0000 7fdb7d193640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628edcb2dc0 0x5628edcd4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51646/0 (socket says 172.21.15.92:51646) 2024-09-19T09:03:20.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.433+0000 7fdb7c992640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628edcb24a0 0x5628edcc9540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:38036/0 (socket says 172.21.15.92:38036) 2024-09-19T09:03:20.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.433+0000 7fdb7d193640 1 -- 172.21.15.92:0/730637568 learned_addr learned my addr 172.21.15.92:0/730637568 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:20.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.434+0000 7fdb7c992640 1 --2- 172.21.15.92:0/730637568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628edcbd680 0x5628edcd4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:20.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.434+0000 7fdb7d193640 1 -- 172.21.15.92:0/730637568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628edcb24a0 msgr2=0x5628edcc9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:20.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.434+0000 7fdb7d193640 1 --2- 172.21.15.92:0/730637568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628edcb24a0 0x5628edcc9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.434+0000 7fdb7d193640 1 -- 172.21.15.92:0/730637568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628edcbd680 msgr2=0x5628edcd4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:20.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.434+0000 7fdb7d193640 1 --2- 172.21.15.92:0/730637568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628edcbd680 0x5628edcd4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.434+0000 7fdb7d193640 1 -- 172.21.15.92:0/730637568 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628edcae860 con 0x5628edcb2dc0 2024-09-19T09:03:20.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.434+0000 7fdb7d193640 1 --2- 172.21.15.92:0/730637568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628edcb2dc0 0x5628edcd4aa0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fdb7402aa10 tx=0x7fdb74031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1519256577681722 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:20.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.435+0000 7fdb62ffd640 1 -- 172.21.15.92:0/730637568 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb74049030 con 0x5628edcb2dc0 2024-09-19T09:03:20.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.435+0000 7fdb62ffd640 1 -- 172.21.15.92:0/730637568 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb74005500 con 0x5628edcb2dc0 2024-09-19T09:03:20.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.435+0000 7fdb62ffd640 1 -- 172.21.15.92:0/730637568 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb74035040 con 0x5628edcb2dc0 2024-09-19T09:03:20.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.436+0000 7fdb817d0740 1 -- 172.21.15.92:0/730637568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628edcb2dc0 msgr2=0x5628edcd4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:20.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.436+0000 7fdb817d0740 1 --2- 172.21.15.92:0/730637568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628edcb2dc0 0x5628edcd4aa0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fdb7402aa10 tx=0x7fdb74031400 comp rx=0 tx=0).stop 2024-09-19T09:03:20.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.437+0000 7fdb817d0740 1 -- 172.21.15.92:0/730637568 shutdown_connections 2024-09-19T09:03:20.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.437+0000 7fdb817d0740 1 --2- 172.21.15.92:0/730637568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628edcbd680 0x5628edcd4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.437+0000 7fdb817d0740 1 --2- 172.21.15.92:0/730637568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628edcb2dc0 0x5628edcd4aa0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.437+0000 7fdb817d0740 1 --2- 172.21.15.92:0/730637568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628edcb24a0 0x5628edcc9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.437+0000 7fdb817d0740 1 -- 172.21.15.92:0/730637568 >> 172.21.15.92:0/730637568 conn(0x5628edcaea30 msgr2=0x5628edcb5890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:20.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.437+0000 7fdb817d0740 1 -- 172.21.15.92:0/730637568 shutdown_connections 2024-09-19T09:03:20.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.437+0000 7fdb817d0740 1 -- 172.21.15.92:0/730637568 wait complete. 2024-09-19T09:03:20.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.438+0000 7fdb817d0740 1 -- start start 2024-09-19T09:03:20.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.438+0000 7fdb817d0740 1 Processor -- start 2024-09-19T09:03:20.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.439+0000 7fdb817d0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628edcb24a0 0x5628edcc59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:20.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.439+0000 7fdb817d0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628edcb2dc0 0x5628edcc5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:20.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.439+0000 7fdb7c992640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628edcb24a0 0x5628edcc59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:20.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.439+0000 7fdb817d0740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628edcbd680 0x5628edcc0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:20.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.439+0000 7fdb817d0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5c00d1c0 con 0x5628edcb24a0 2024-09-19T09:03:20.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.439+0000 7fdb7c992640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628edcb24a0 0x5628edcc59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51650/0 (socket says 172.21.15.92:51650) 2024-09-19T09:03:20.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.439+0000 7fdb7c992640 1 -- 172.21.15.92:0/3623230649 learned_addr learned my addr 172.21.15.92:0/3623230649 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:20.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.439+0000 7fdb817d0740 1 -- 172.21.15.92:0/3623230649 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5c00e630 con 0x5628edcb2dc0 2024-09-19T09:03:20.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.439+0000 7fdb817d0740 1 -- 172.21.15.92:0/3623230649 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5c00d890 con 0x5628edcbd680 2024-09-19T09:03:20.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.439+0000 7fdb817d0740 10 client.0 _ll_register_callbacks cb 0x7fdb68009c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:20.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.440+0000 7fdb7d193640 1 --2- 172.21.15.92:0/3623230649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628edcb2dc0 0x5628edcc5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:20.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.440+0000 7fdb7c992640 1 --2- 172.21.15.92:0/3623230649 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628edcbd680 0x5628edcc0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:20.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.440+0000 7fdb7c992640 1 -- 172.21.15.92:0/3623230649 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628edcbd680 msgr2=0x5628edcc0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:20.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.440+0000 7fdb7c992640 1 --2- 172.21.15.92:0/3623230649 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628edcbd680 0x5628edcc0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.440+0000 7fdb7c992640 1 -- 172.21.15.92:0/3623230649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628edcb2dc0 msgr2=0x5628edcc5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:20.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.440+0000 7fdb7c992640 1 --2- 172.21.15.92:0/3623230649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628edcb2dc0 0x5628edcc5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.440+0000 7fdb7c992640 1 -- 172.21.15.92:0/3623230649 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628edcc00d0 con 0x5628edcb24a0 2024-09-19T09:03:20.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.441+0000 7fdb7d193640 1 --2- 172.21.15.92:0/3623230649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628edcb2dc0 0x5628edcc5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:20.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.441+0000 7fdb7c992640 1 --2- 172.21.15.92:0/3623230649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628edcb24a0 0x5628edcc59a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fdb68019860 tx=0x7fdb68008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b75597ffcb88b93f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:20.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.441+0000 7fdb60ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:03:20.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.441+0000 7fdb60ff9640 1 -- 172.21.15.92:0/3623230649 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb68015e20 con 0x5628edcb24a0 2024-09-19T09:03:20.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.441+0000 7fdb60ff9640 1 -- 172.21.15.92:0/3623230649 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fdb68024420 con 0x5628edcb24a0 2024-09-19T09:03:20.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.441+0000 7fdb817d0740 1 -- 172.21.15.92:0/3623230649 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb74005500 con 0x5628edcb24a0 2024-09-19T09:03:20.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.442+0000 7fdb60ff9640 1 -- 172.21.15.92:0/3623230649 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fdb68006d60 con 0x5628edcb24a0 2024-09-19T09:03:20.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.442+0000 7fdb817d0740 10 client.16821 fetch_fsmap learned FSMap version 19 2024-09-19T09:03:20.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.442+0000 7fdb817d0740 1 -- 172.21.15.92:0/3623230649 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5628edd37440 con 0x5628edcb24a0 2024-09-19T09:03:20.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.443+0000 7fdb60ff9640 1 -- 172.21.15.92:0/3623230649 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb74005500 con 0x5628edcb24a0 2024-09-19T09:03:20.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.443+0000 7fdb60ff9640 1 -- 172.21.15.92:0/3623230649 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fdb68048070 con 0x5628edcb24a0 2024-09-19T09:03:20.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.444+0000 7fdb817d0740 10 client.16821 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:03:20.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.444+0000 7fdb817d0740 10 client.16821 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:03:20.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.444+0000 7fdb817d0740 20 client.16821 populate_metadata read hostname 'smithi092' 2024-09-19T09:03:20.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.444+0000 7fdb817d0740 1 --2- 172.21.15.92:0/3623230649 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5628edd37b10 0x5628edd39f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:20.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.444+0000 7fdb817d0740 4 client.16821 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:03:20.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.444+0000 7fdb817d0740 1 -- 172.21.15.92:0/3623230649 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5628edcbaab0 con 0x5628edd37b10 2024-09-19T09:03:20.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.444+0000 7fdb7d193640 1 --2- 172.21.15.92:0/3623230649 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5628edd37b10 0x5628edd39f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:20.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.445+0000 7fdb60ff9640 10 client.16821 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:20.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.445+0000 7fdb7d193640 1 --2- 172.21.15.92:0/3623230649 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5628edd37b10 0x5628edd39f30 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2f400a6b6e0bc17 server_cookie=7e9f4d9a1ec4484a in_seq=0 out_seq=0 2024-09-19T09:03:20.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.445+0000 7fdb60ff9640 1 -- 172.21.15.92:0/3623230649 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5628edcbaab0 con 0x5628edd37b10 2024-09-19T09:03:20.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.445+0000 7fdb60ff9640 10 client.16821 handle_command_reply: tid=0 2024-09-19T09:03:20.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.445+0000 7fdb817d0740 1 client.16821 shutdown 2024-09-19T09:03:20.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.445+0000 7fdb817d0740 1 -- 172.21.15.92:0/3623230649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628edcb24a0 msgr2=0x5628edcc59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:20.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.445+0000 7fdb817d0740 1 --2- 172.21.15.92:0/3623230649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628edcb24a0 0x5628edcc59a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fdb68019860 tx=0x7fdb68008040 comp rx=0 tx=0).stop 2024-09-19T09:03:20.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.445+0000 7fdb817d0740 1 -- 172.21.15.92:0/3623230649 shutdown_connections 2024-09-19T09:03:20.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.445+0000 7fdb817d0740 1 --2- 172.21.15.92:0/3623230649 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5628edd37b10 0x5628edd39f30 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.445+0000 7fdb817d0740 1 --2- 172.21.15.92:0/3623230649 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5628edcbd680 0x5628edcc0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.445+0000 7fdb817d0740 1 --2- 172.21.15.92:0/3623230649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628edcb2dc0 0x5628edcc5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.445+0000 7fdb817d0740 1 --2- 172.21.15.92:0/3623230649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628edcb24a0 0x5628edcc59a0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.445+0000 7fdb817d0740 1 -- 172.21.15.92:0/3623230649 >> 172.21.15.92:0/3623230649 conn(0x5628edcaea30 msgr2=0x5628edcb3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:20.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.445+0000 7fdb60ff9640 0 client.16821 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:20.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.446+0000 7fdb817d0740 1 -- 172.21.15.92:0/3623230649 shutdown_connections 2024-09-19T09:03:20.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.446+0000 7fdb817d0740 1 -- 172.21.15.92:0/3623230649 wait complete. 2024-09-19T09:03:20.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.446+0000 7fdb817d0740 20 client.16821 trim_cache size 0 max 16384 2024-09-19T09:03:20.447 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:03:20.447 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-19T09:03:20.448 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {} 2024-09-19T09:03:20.448 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:03:20.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.446+0000 7fdb7f3f7640 1 -- 172.21.15.92:0/2416546963 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdb640a3410 msgr2=0x7fdb640a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:20.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.446+0000 7fdb7f3f7640 1 --2- 172.21.15.92:0/2416546963 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdb640a3410 0x7fdb640a58d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdb70014a30 tx=0x7fdb7000e040 comp rx=0 tx=0).stop 2024-09-19T09:03:20.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.446+0000 7fdb7f3f7640 1 -- 172.21.15.92:0/2416546963 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdb7810d520 msgr2=0x7fdb7806d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:20.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.446+0000 7fdb7f3f7640 1 --2- 172.21.15.92:0/2416546963 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdb7810d520 0x7fdb7806d130 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdb7000be20 tx=0x7fdb70009ed0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.447+0000 7fdb7f3f7640 1 -- 172.21.15.92:0/2416546963 shutdown_connections 2024-09-19T09:03:20.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.447+0000 7fdb7f3f7640 1 --2- 172.21.15.92:0/2416546963 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdb7810d520 0x7fdb7806d130 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.447+0000 7fdb7f3f7640 1 --2- 172.21.15.92:0/2416546963 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb78108da0 0x7fdb7806cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.447+0000 7fdb7f3f7640 1 --2- 172.21.15.92:0/2416546963 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdb640a3410 0x7fdb640a58d0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.447+0000 7fdb7f3f7640 1 --2- 172.21.15.92:0/2416546963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb781083f0 0x7fdb78073b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.447+0000 7fdb7f3f7640 1 -- 172.21.15.92:0/2416546963 >> 172.21.15.92:0/2416546963 conn(0x7fdb78077af0 msgr2=0x7fdb78078f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:20.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.447+0000 7fdb7f3f7640 1 -- 172.21.15.92:0/2416546963 shutdown_connections 2024-09-19T09:03:20.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:20.447+0000 7fdb7f3f7640 1 -- 172.21.15.92:0/2416546963 wait complete. 2024-09-19T09:03:20.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.755+0000 7f73b5733640 1 -- 172.21.15.92:0/3907237071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73b0102630 msgr2=0x7f73b0104a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:20.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.755+0000 7f73b5733640 1 --2- 172.21.15.92:0/3907237071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73b0102630 0x7f73b0104a20 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f73a0009900 tx=0x7f73a002a410 comp rx=0 tx=0).stop 2024-09-19T09:03:20.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.756+0000 7f73b5733640 1 -- 172.21.15.92:0/3907237071 shutdown_connections 2024-09-19T09:03:20.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.756+0000 7f73b5733640 1 --2- 172.21.15.92:0/3907237071 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f73b0107890 0x7f73b0109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.756+0000 7f73b5733640 1 --2- 172.21.15.92:0/3907237071 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73b0104f60 0x7f73b0107350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.756+0000 7f73b5733640 1 --2- 172.21.15.92:0/3907237071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73b0102630 0x7f73b0104a20 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.756+0000 7f73b5733640 1 -- 172.21.15.92:0/3907237071 >> 172.21.15.92:0/3907237071 conn(0x7f73b00fc1b0 msgr2=0x7f73b00fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:20.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.756+0000 7f73b5733640 1 -- 172.21.15.92:0/3907237071 shutdown_connections 2024-09-19T09:03:20.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.756+0000 7f73b5733640 1 -- 172.21.15.92:0/3907237071 wait complete. 2024-09-19T09:03:20.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.757+0000 7f73b5733640 1 Processor -- start 2024-09-19T09:03:20.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.757+0000 7f73b5733640 1 -- start start 2024-09-19T09:03:20.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.757+0000 7f73b5733640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73b0102630 0x7f73b0197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:20.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.757+0000 7f73b5733640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f73b0104f60 0x7f73b01983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:20.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.757+0000 7f73b5733640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73b0107890 0x7f73b019f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:20.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.757+0000 7f73b5733640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f73b010d890 con 0x7f73b0102630 2024-09-19T09:03:20.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.757+0000 7f73b5733640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f73b010d710 con 0x7f73b0107890 2024-09-19T09:03:20.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.757+0000 7f73b5733640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f73b010da10 con 0x7f73b0104f60 2024-09-19T09:03:20.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.757+0000 7f73aeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73b0102630 0x7f73b0197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:20.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.757+0000 7f73aeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73b0102630 0x7f73b0197e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51662/0 (socket says 172.21.15.92:51662) 2024-09-19T09:03:20.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.757+0000 7f73aeffd640 1 -- 172.21.15.92:0/3417189979 learned_addr learned my addr 172.21.15.92:0/3417189979 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:20.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.757+0000 7f73ae7fc640 1 --2- 172.21.15.92:0/3417189979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f73b0104f60 0x7f73b01983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:20.760 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.757+0000 7f73af7fe640 1 --2- 172.21.15.92:0/3417189979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73b0107890 0x7f73b019f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:20.760 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.758+0000 7f73af7fe640 1 -- 172.21.15.92:0/3417189979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f73b0104f60 msgr2=0x7f73b01983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:20.760 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.758+0000 7f73af7fe640 1 --2- 172.21.15.92:0/3417189979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f73b0104f60 0x7f73b01983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.760 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.758+0000 7f73af7fe640 1 -- 172.21.15.92:0/3417189979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73b0102630 msgr2=0x7f73b0197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:20.760 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.758+0000 7f73af7fe640 1 --2- 172.21.15.92:0/3417189979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73b0102630 0x7f73b0197e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.760 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.758+0000 7f73af7fe640 1 -- 172.21.15.92:0/3417189979 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73b019fa80 con 0x7f73b0107890 2024-09-19T09:03:20.760 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.758+0000 7f73ae7fc640 1 --2- 172.21.15.92:0/3417189979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f73b0104f60 0x7f73b01983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:20.760 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.758+0000 7f73aeffd640 1 --2- 172.21.15.92:0/3417189979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73b0102630 0x7f73b0197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:20.760 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.758+0000 7f73af7fe640 1 --2- 172.21.15.92:0/3417189979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73b0107890 0x7f73b019f410 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f73a8005fd0 tx=0x7f73a800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:20.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.758+0000 7f7397fff640 1 -- 172.21.15.92:0/3417189979 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a800cdf0 con 0x7f73b0107890 2024-09-19T09:03:20.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.758+0000 7f7397fff640 1 -- 172.21.15.92:0/3417189979 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73a8005020 con 0x7f73b0107890 2024-09-19T09:03:20.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.759+0000 7f7397fff640 1 -- 172.21.15.92:0/3417189979 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a80106d0 con 0x7f73b0107890 2024-09-19T09:03:20.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.759+0000 7f73b5733640 1 -- 172.21.15.92:0/3417189979 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73b019fd70 con 0x7f73b0107890 2024-09-19T09:03:20.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.759+0000 7f73b5733640 1 -- 172.21.15.92:0/3417189979 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73b01a0200 con 0x7f73b0107890 2024-09-19T09:03:20.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.762+0000 7f7397fff640 1 -- 172.21.15.92:0/3417189979 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f73a80054d0 con 0x7f73b0107890 2024-09-19T09:03:20.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.762+0000 7f7397fff640 1 --2- 172.21.15.92:0/3417189979 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f73980a34b0 0x7f73980a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:20.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.762+0000 7f7397fff640 1 -- 172.21.15.92:0/3417189979 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f73a80cfed0 con 0x7f73b0107890 2024-09-19T09:03:20.763 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.763+0000 7f73aeffd640 1 --2- 172.21.15.92:0/3417189979 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f73980a34b0 0x7f73980a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:20.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.765+0000 7f73b84c8740 1 Processor -- start 2024-09-19T09:03:20.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.765+0000 7f73b84c8740 1 -- start start 2024-09-19T09:03:20.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.765+0000 7f73aeffd640 1 --2- 172.21.15.92:0/3417189979 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f73980a34b0 0x7f73980a5970 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f73a0005ab0 tx=0x7f73a0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:20.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.765+0000 7f73b84c8740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55886029c850 0x55886029b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:20.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.765+0000 7f73b84c8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55886029b5d0 0x55886029ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:20.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.765+0000 7f73b84c8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588602abd50 0x5588602ae140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:20.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.765+0000 7f73b84c8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5588602012f0 con 0x55886029b5d0 2024-09-19T09:03:20.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.765+0000 7f73b84c8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5588601a9270 con 0x5588602abd50 2024-09-19T09:03:20.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.765+0000 7f73b84c8740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5588601fd2b0 con 0x55886029c850 2024-09-19T09:03:20.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.765+0000 7f73ae7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55886029b5d0 0x55886029ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:20.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.765+0000 7f73aeffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55886029c850 0x55886029b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:20.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.765+0000 7f73ae7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55886029b5d0 0x55886029ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51666/0 (socket says 172.21.15.92:51666) 2024-09-19T09:03:20.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.765+0000 7f73ae7fc640 1 -- 172.21.15.92:0/596279630 learned_addr learned my addr 172.21.15.92:0/596279630 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:20.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.765+0000 7f73af7fe640 1 --2- 172.21.15.92:0/596279630 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588602abd50 0x5588602ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:20.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.766+0000 7f73af7fe640 1 -- 172.21.15.92:0/596279630 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55886029c850 msgr2=0x55886029b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:20.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.766+0000 7f73af7fe640 1 --2- 172.21.15.92:0/596279630 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55886029c850 0x55886029b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.766+0000 7f73af7fe640 1 -- 172.21.15.92:0/596279630 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55886029b5d0 msgr2=0x55886029ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:20.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.766+0000 7f73af7fe640 1 --2- 172.21.15.92:0/596279630 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55886029b5d0 0x55886029ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.766+0000 7f73af7fe640 1 -- 172.21.15.92:0/596279630 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588601a8340 con 0x5588602abd50 2024-09-19T09:03:20.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.766+0000 7f73aeffd640 1 --2- 172.21.15.92:0/596279630 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55886029c850 0x55886029b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:20.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.766+0000 7f73af7fe640 1 --2- 172.21.15.92:0/596279630 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588602abd50 0x5588602ae140 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f73a801b000 tx=0x7f73a8005440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d008ea53b27fdc84 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:20.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.766+0000 7f73957fa640 1 -- 172.21.15.92:0/596279630 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a80b4020 con 0x5588602abd50 2024-09-19T09:03:20.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.766+0000 7f73957fa640 1 -- 172.21.15.92:0/596279630 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73a80a5160 con 0x5588602abd50 2024-09-19T09:03:20.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.766+0000 7f73957fa640 1 -- 172.21.15.92:0/596279630 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a809c970 con 0x5588602abd50 2024-09-19T09:03:20.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.767+0000 7f73b84c8740 1 -- 172.21.15.92:0/596279630 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588602abd50 msgr2=0x5588602ae140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:20.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.767+0000 7f73b84c8740 1 --2- 172.21.15.92:0/596279630 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588602abd50 0x5588602ae140 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f73a801b000 tx=0x7f73a8005440 comp rx=0 tx=0).stop 2024-09-19T09:03:20.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.767+0000 7f73b84c8740 1 -- 172.21.15.92:0/596279630 shutdown_connections 2024-09-19T09:03:20.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.767+0000 7f73b84c8740 1 --2- 172.21.15.92:0/596279630 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588602abd50 0x5588602ae140 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.767+0000 7f73b84c8740 1 --2- 172.21.15.92:0/596279630 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55886029b5d0 0x55886029ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.767+0000 7f73b84c8740 1 --2- 172.21.15.92:0/596279630 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55886029c850 0x55886029b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.767+0000 7f73b84c8740 1 -- 172.21.15.92:0/596279630 >> 172.21.15.92:0/596279630 conn(0x55886029d420 msgr2=0x55886029d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:20.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.767+0000 7f73b84c8740 1 -- 172.21.15.92:0/596279630 shutdown_connections 2024-09-19T09:03:20.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.767+0000 7f73b84c8740 1 -- 172.21.15.92:0/596279630 wait complete. 2024-09-19T09:03:20.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.768+0000 7f73b84c8740 1 -- start start 2024-09-19T09:03:20.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.768+0000 7f73b84c8740 1 Processor -- start 2024-09-19T09:03:20.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.768+0000 7f73b84c8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55886029b5d0 0x5588602b0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:20.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.768+0000 7f73b84c8740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55886029c850 0x5588602b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:20.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.768+0000 7f73b84c8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588602abd50 0x5588602b7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:20.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.768+0000 7f73b84c8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5588602aeb70 con 0x5588602abd50 2024-09-19T09:03:20.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.768+0000 7f73b84c8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55886018a290 con 0x55886029b5d0 2024-09-19T09:03:20.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.768+0000 7f73b84c8740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5588602aecf0 con 0x55886029c850 2024-09-19T09:03:20.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.769+0000 7f73b84c8740 10 client.0 _ll_register_callbacks cb 0x5588601bb140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:20.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.769+0000 7f73aeffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55886029b5d0 0x5588602b0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:20.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.769+0000 7f73aeffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55886029b5d0 0x5588602b0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:55264/0 (socket says 172.21.15.92:55264) 2024-09-19T09:03:20.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.769+0000 7f73aeffd640 1 -- 172.21.15.92:0/2553100112 learned_addr learned my addr 172.21.15.92:0/2553100112 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:20.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.769+0000 7f73af7fe640 1 --2- 172.21.15.92:0/2553100112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588602abd50 0x5588602b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:20.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.770+0000 7f73ae7fc640 1 --2- 172.21.15.92:0/2553100112 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55886029c850 0x5588602b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:20.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.770+0000 7f73af7fe640 1 -- 172.21.15.92:0/2553100112 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55886029c850 msgr2=0x5588602b08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:20.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.770+0000 7f73af7fe640 1 --2- 172.21.15.92:0/2553100112 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55886029c850 0x5588602b08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.770+0000 7f73af7fe640 1 -- 172.21.15.92:0/2553100112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55886029b5d0 msgr2=0x5588602b0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:20.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.770+0000 7f73af7fe640 1 --2- 172.21.15.92:0/2553100112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55886029b5d0 0x5588602b0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.770+0000 7f73af7fe640 1 -- 172.21.15.92:0/2553100112 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55885ff14210 con 0x5588602abd50 2024-09-19T09:03:20.773 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.770+0000 7f73af7fe640 1 --2- 172.21.15.92:0/2553100112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588602abd50 0x5588602b7910 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f73a8098950 tx=0x7f73a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78268963737364c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:20.773 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.771+0000 7f7392ff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:03:20.773 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.771+0000 7f7392ff5640 1 -- 172.21.15.92:0/2553100112 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a80ab060 con 0x5588602abd50 2024-09-19T09:03:20.773 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.771+0000 7f7392ff5640 1 -- 172.21.15.92:0/2553100112 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f73a80a4ed0 con 0x5588602abd50 2024-09-19T09:03:20.773 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.773+0000 7f73b84c8740 1 -- 172.21.15.92:0/2553100112 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73a80a5160 con 0x5588602abd50 2024-09-19T09:03:20.773 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.773+0000 7f7392ff5640 1 -- 172.21.15.92:0/2553100112 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f73a80b4070 con 0x5588602abd50 2024-09-19T09:03:20.774 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.774+0000 7f73b84c8740 10 client.16833 fetch_fsmap learned FSMap version 19 2024-09-19T09:03:20.774 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.774+0000 7f73b84c8740 1 -- 172.21.15.92:0/2553100112 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55885ffe0620 con 0x5588602abd50 2024-09-19T09:03:20.775 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.775+0000 7f7392ff5640 1 -- 172.21.15.92:0/2553100112 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73a80b5220 con 0x5588602abd50 2024-09-19T09:03:20.775 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.775+0000 7f7392ff5640 1 -- 172.21.15.92:0/2553100112 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f73a807f020 con 0x5588602abd50 2024-09-19T09:03:20.776 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.775+0000 7f73b84c8740 10 client.16833 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:03:20.776 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.775+0000 7f73b84c8740 10 client.16833 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:03:20.776 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.775+0000 7f73b84c8740 20 client.16833 populate_metadata read hostname 'smithi092' 2024-09-19T09:03:20.776 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.775+0000 7f73b84c8740 1 --2- 172.21.15.92:0/2553100112 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5588602bbc10 0x5588602be000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:20.776 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.775+0000 7f73b84c8740 4 client.16833 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:20.776 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.775+0000 7f73b84c8740 1 -- 172.21.15.92:0/2553100112 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f73a80a5160 con 0x5588602bbc10 2024-09-19T09:03:20.776 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.776+0000 7f73aeffd640 1 --2- 172.21.15.92:0/2553100112 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5588602bbc10 0x5588602be000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:20.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.783+0000 7f73aeffd640 1 --2- 172.21.15.92:0/2553100112 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5588602bbc10 0x5588602be000 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85be129d6c7a4ec2 server_cookie=58167306735af455 in_seq=0 out_seq=0 2024-09-19T09:03:20.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.783+0000 7f7392ff5640 10 client.16833 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:20.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.784+0000 7f7392ff5640 1 -- 172.21.15.92:0/2553100112 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f73a80a5160 con 0x5588602bbc10 2024-09-19T09:03:20.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.784+0000 7f7392ff5640 10 client.16833 handle_command_reply: tid=0 2024-09-19T09:03:20.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.784+0000 7f73b84c8740 1 client.16833 shutdown 2024-09-19T09:03:20.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.791+0000 7f73b84c8740 1 -- 172.21.15.92:0/2553100112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588602abd50 msgr2=0x5588602b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.791+0000 7f73b84c8740 1 --2- 172.21.15.92:0/2553100112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588602abd50 0x5588602b7910 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f73a8098950 tx=0x7f73a8005830 comp rx=0 tx=0).stop 2024-09-19T09:03:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.792+0000 7f73b84c8740 1 -- 172.21.15.92:0/2553100112 shutdown_connections 2024-09-19T09:03:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.792+0000 7f73b84c8740 1 --2- 172.21.15.92:0/2553100112 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5588602bbc10 0x5588602be000 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.792+0000 7f73b84c8740 1 --2- 172.21.15.92:0/2553100112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588602abd50 0x5588602b7910 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.792+0000 7f73b84c8740 1 --2- 172.21.15.92:0/2553100112 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55886029c850 0x5588602b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.792+0000 7f73b84c8740 1 --2- 172.21.15.92:0/2553100112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55886029b5d0 0x5588602b0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.792+0000 7f73b84c8740 1 -- 172.21.15.92:0/2553100112 >> 172.21.15.92:0/2553100112 conn(0x55886029d420 msgr2=0x55886029ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.792+0000 7f7392ff5640 0 client.16833 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.793+0000 7f73b84c8740 1 -- 172.21.15.92:0/2553100112 shutdown_connections 2024-09-19T09:03:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.793+0000 7f73b84c8740 1 -- 172.21.15.92:0/2553100112 wait complete. 2024-09-19T09:03:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.794+0000 7f73b84c8740 20 client.16833 trim_cache size 0 max 16384 2024-09-19T09:03:20.795 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 395.0 s, 3653.9 tps, lat 27.183 ms stddev 30.661 2024-09-19T09:03:20.826 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.825+0000 7f73b84c8740 1 Processor -- start 2024-09-19T09:03:20.826 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.825+0000 7f73b84c8740 1 -- start start 2024-09-19T09:03:20.826 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.825+0000 7f73b84c8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55886029b5d0 0x5588602bdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:20.826 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.825+0000 7f73b84c8740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55886029c850 0x5588602b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:20.826 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.825+0000 7f73aeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55886029b5d0 0x5588602bdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:20.826 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.825+0000 7f73aeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55886029b5d0 0x5588602bdc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51684/0 (socket says 172.21.15.92:51684) 2024-09-19T09:03:20.826 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.825+0000 7f73aeffd640 1 -- 172.21.15.92:0/3254363877 learned_addr learned my addr 172.21.15.92:0/3254363877 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.825+0000 7f73b84c8740 1 --2- 172.21.15.92:0/3254363877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588602abd50 0x5588602be160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.825+0000 7f73ae7fc640 1 --2- 172.21.15.92:0/3254363877 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55886029c850 0x5588602b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.825+0000 7f73b84c8740 1 -- 172.21.15.92:0/3254363877 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f73b01a4ec0 con 0x55886029b5d0 2024-09-19T09:03:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.826+0000 7f73b84c8740 1 -- 172.21.15.92:0/3254363877 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f73b01a7760 con 0x5588602abd50 2024-09-19T09:03:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.826+0000 7f73b84c8740 1 -- 172.21.15.92:0/3254363877 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f73b01a5550 con 0x55886029c850 2024-09-19T09:03:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.826+0000 7f73af7fe640 1 --2- 172.21.15.92:0/3254363877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588602abd50 0x5588602be160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:20.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.826+0000 7f73af7fe640 1 -- 172.21.15.92:0/3254363877 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55886029c850 msgr2=0x5588602b78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:20.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.826+0000 7f73af7fe640 1 --2- 172.21.15.92:0/3254363877 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55886029c850 0x5588602b78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.826+0000 7f73af7fe640 1 -- 172.21.15.92:0/3254363877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55886029b5d0 msgr2=0x5588602bdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.826+0000 7f73af7fe640 1 --2- 172.21.15.92:0/3254363877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55886029b5d0 0x5588602bdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.826+0000 7f73af7fe640 1 -- 172.21.15.92:0/3254363877 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588602ab1c0 con 0x5588602abd50 2024-09-19T09:03:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.826+0000 7f73af7fe640 1 --2- 172.21.15.92:0/3254363877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588602abd50 0x5588602be160 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f73a8005c40 tx=0x7f73a8005440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4edfcbd5520083b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.827+0000 7f7394ff9640 1 -- 172.21.15.92:0/3254363877 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a80ab070 con 0x5588602abd50 2024-09-19T09:03:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.827+0000 7f7394ff9640 1 -- 172.21.15.92:0/3254363877 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73a8098040 con 0x5588602abd50 2024-09-19T09:03:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.827+0000 7f7394ff9640 1 -- 172.21.15.92:0/3254363877 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a80a4f30 con 0x5588602abd50 2024-09-19T09:03:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.828+0000 7f73b84c8740 1 -- 172.21.15.92:0/3254363877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588602abd50 msgr2=0x5588602be160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:20.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.828+0000 7f73b84c8740 1 --2- 172.21.15.92:0/3254363877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588602abd50 0x5588602be160 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f73a8005c40 tx=0x7f73a8005440 comp rx=0 tx=0).stop 2024-09-19T09:03:20.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.828+0000 7f73b84c8740 1 -- 172.21.15.92:0/3254363877 shutdown_connections 2024-09-19T09:03:20.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.828+0000 7f73b84c8740 1 --2- 172.21.15.92:0/3254363877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588602abd50 0x5588602be160 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.828+0000 7f73b84c8740 1 --2- 172.21.15.92:0/3254363877 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55886029c850 0x5588602b78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.828+0000 7f73b84c8740 1 --2- 172.21.15.92:0/3254363877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55886029b5d0 0x5588602bdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.828+0000 7f73b84c8740 1 -- 172.21.15.92:0/3254363877 >> 172.21.15.92:0/3254363877 conn(0x55886029d420 msgr2=0x5588602b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:20.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.828+0000 7f73b84c8740 1 -- 172.21.15.92:0/3254363877 shutdown_connections 2024-09-19T09:03:20.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.828+0000 7f73b84c8740 1 -- 172.21.15.92:0/3254363877 wait complete. 2024-09-19T09:03:20.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.830+0000 7f73b84c8740 1 -- start start 2024-09-19T09:03:20.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.830+0000 7f73b84c8740 1 Processor -- start 2024-09-19T09:03:20.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.830+0000 7f73b84c8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55886029b5d0 0x5588602b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:20.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.831+0000 7f73b84c8740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55886029c850 0x5588602b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:20.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.831+0000 7f73aeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55886029b5d0 0x5588602b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:20.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.831+0000 7f73aeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55886029b5d0 0x5588602b4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51694/0 (socket says 172.21.15.92:51694) 2024-09-19T09:03:20.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.831+0000 7f73aeffd640 1 -- 172.21.15.92:0/3191982443 learned_addr learned my addr 172.21.15.92:0/3191982443 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:20.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.831+0000 7f73b84c8740 1 --2- 172.21.15.92:0/3191982443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588602abd50 0x5588602b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:20.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.831+0000 7f73ae7fc640 1 --2- 172.21.15.92:0/3191982443 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55886029c850 0x5588602b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:20.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.831+0000 7f73b84c8740 1 -- 172.21.15.92:0/3191982443 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f73b01a5c20 con 0x55886029b5d0 2024-09-19T09:03:20.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.831+0000 7f73b84c8740 1 -- 172.21.15.92:0/3191982443 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f73b01a7090 con 0x5588602abd50 2024-09-19T09:03:20.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.831+0000 7f73b84c8740 1 -- 172.21.15.92:0/3191982443 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f73b01a62f0 con 0x55886029c850 2024-09-19T09:03:20.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.831+0000 7f73af7fe640 1 --2- 172.21.15.92:0/3191982443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588602abd50 0x5588602b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:20.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.832+0000 7f73b84c8740 10 client.0 _ll_register_callbacks cb 0x7f73a4009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:20.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.832+0000 7f73aeffd640 1 -- 172.21.15.92:0/3191982443 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55886029c850 msgr2=0x5588602b52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:20.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.832+0000 7f73aeffd640 1 --2- 172.21.15.92:0/3191982443 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55886029c850 0x5588602b52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.832+0000 7f73aeffd640 1 -- 172.21.15.92:0/3191982443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588602abd50 msgr2=0x5588602b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:20.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.832+0000 7f73aeffd640 1 --2- 172.21.15.92:0/3191982443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588602abd50 0x5588602b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.832+0000 7f73aeffd640 1 -- 172.21.15.92:0/3191982443 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588602b6870 con 0x55886029b5d0 2024-09-19T09:03:20.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.832+0000 7f73b84c8740 1 -- 172.21.15.92:0/3191982443 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55886020ea20 con 0x55886029b5d0 2024-09-19T09:03:20.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.832+0000 7f73aeffd640 1 --2- 172.21.15.92:0/3191982443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55886029b5d0 0x5588602b4d80 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f73a002aa00 tx=0x7f73a0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee128f3a50b13dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:20.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.832+0000 7f7392ff5640 10 client.16839 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:03:20.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.832+0000 7f7392ff5640 1 -- 172.21.15.92:0/3191982443 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a0035040 con 0x55886029b5d0 2024-09-19T09:03:20.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.833+0000 7f7392ff5640 1 -- 172.21.15.92:0/3191982443 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f73a0032990 con 0x55886029b5d0 2024-09-19T09:03:20.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.833+0000 7f7392ff5640 1 -- 172.21.15.92:0/3191982443 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f73a0032bd0 con 0x55886029b5d0 2024-09-19T09:03:20.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.833+0000 7f73b84c8740 10 client.16839 fetch_fsmap learned FSMap version 19 2024-09-19T09:03:20.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.833+0000 7f73b84c8740 1 -- 172.21.15.92:0/3191982443 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5588602b7b50 con 0x55886029b5d0 2024-09-19T09:03:20.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.834+0000 7f7392ff5640 1 -- 172.21.15.92:0/3191982443 <== mon.0 v2:172.21.15.92:3300/0 4 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f73a0004700 con 0x55886029b5d0 2024-09-19T09:03:20.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.834+0000 7f73b84c8740 10 client.16839 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:03:20.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.834+0000 7f73b84c8740 10 client.16839 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:03:20.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.834+0000 7f73b84c8740 20 client.16839 populate_metadata read hostname 'smithi092' 2024-09-19T09:03:20.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.834+0000 7f73b84c8740 1 --2- 172.21.15.92:0/3191982443 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558860326d60 0x558860329180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:20.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.834+0000 7f73b84c8740 4 client.16839 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:03:20.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.834+0000 7f73b84c8740 1 -- 172.21.15.92:0/3191982443 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558860208d70 con 0x558860326d60 2024-09-19T09:03:20.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.834+0000 7f73ae7fc640 1 --2- 172.21.15.92:0/3191982443 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558860326d60 0x558860329180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:20.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.835+0000 7f73ae7fc640 1 --2- 172.21.15.92:0/3191982443 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558860326d60 0x558860329180 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=128faf28e42af18b server_cookie=fd3021c7d136f1a8 in_seq=0 out_seq=0 2024-09-19T09:03:20.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.835+0000 7f7392ff5640 10 client.16839 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:20.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.845+0000 7f7392ff5640 1 -- 172.21.15.92:0/3191982443 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558860208d70 con 0x558860326d60 2024-09-19T09:03:20.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.845+0000 7f7392ff5640 10 client.16839 handle_command_reply: tid=0 2024-09-19T09:03:20.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.845+0000 7f73b84c8740 1 client.16839 shutdown 2024-09-19T09:03:20.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.846+0000 7f73b84c8740 1 -- 172.21.15.92:0/3191982443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55886029b5d0 msgr2=0x5588602b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:20.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.846+0000 7f73b84c8740 1 --2- 172.21.15.92:0/3191982443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55886029b5d0 0x5588602b4d80 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f73a002aa00 tx=0x7f73a0009260 comp rx=0 tx=0).stop 2024-09-19T09:03:20.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.846+0000 7f73b84c8740 1 -- 172.21.15.92:0/3191982443 shutdown_connections 2024-09-19T09:03:20.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.846+0000 7f73b84c8740 1 --2- 172.21.15.92:0/3191982443 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558860326d60 0x558860329180 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.846+0000 7f73b84c8740 1 --2- 172.21.15.92:0/3191982443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588602abd50 0x5588602b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.846+0000 7f73b84c8740 1 --2- 172.21.15.92:0/3191982443 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55886029c850 0x5588602b52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.846+0000 7f73b84c8740 1 --2- 172.21.15.92:0/3191982443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55886029b5d0 0x5588602b4d80 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.846+0000 7f73b84c8740 1 -- 172.21.15.92:0/3191982443 >> 172.21.15.92:0/3191982443 conn(0x55886029d420 msgr2=0x5588602b0330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:20.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.846+0000 7f7392ff5640 0 client.16839 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:20.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.846+0000 7f73b84c8740 1 -- 172.21.15.92:0/3191982443 shutdown_connections 2024-09-19T09:03:20.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.846+0000 7f73b84c8740 1 -- 172.21.15.92:0/3191982443 wait complete. 2024-09-19T09:03:20.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.846+0000 7f73b84c8740 20 client.16839 trim_cache size 0 max 16384 2024-09-19T09:03:20.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:03:20.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:03:20.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:03:20.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:03:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.847+0000 7f73b5733640 1 -- 172.21.15.92:0/3417189979 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f73980a34b0 msgr2=0x7f73980a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.847+0000 7f73b5733640 1 --2- 172.21.15.92:0/3417189979 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f73980a34b0 0x7f73980a5970 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f73a0005ab0 tx=0x7f73a0005a20 comp rx=0 tx=0).stop 2024-09-19T09:03:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.847+0000 7f73b5733640 1 -- 172.21.15.92:0/3417189979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73b0107890 msgr2=0x7f73b019f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.847+0000 7f73b5733640 1 --2- 172.21.15.92:0/3417189979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73b0107890 0x7f73b019f410 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f73a8005fd0 tx=0x7f73a800ef10 comp rx=0 tx=0).stop 2024-09-19T09:03:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.847+0000 7f73b5733640 1 -- 172.21.15.92:0/3417189979 shutdown_connections 2024-09-19T09:03:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.847+0000 7f73b5733640 1 --2- 172.21.15.92:0/3417189979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73b0107890 0x7f73b019f410 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.847+0000 7f73b5733640 1 --2- 172.21.15.92:0/3417189979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f73b0104f60 0x7f73b01983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.847+0000 7f73b5733640 1 --2- 172.21.15.92:0/3417189979 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f73980a34b0 0x7f73980a5970 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.847+0000 7f73b5733640 1 --2- 172.21.15.92:0/3417189979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73b0102630 0x7f73b0197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.847+0000 7f73b5733640 1 -- 172.21.15.92:0/3417189979 >> 172.21.15.92:0/3417189979 conn(0x7f73b00fc1b0 msgr2=0x7f73b0102ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.847+0000 7f73b5733640 1 -- 172.21.15.92:0/3417189979 shutdown_connections 2024-09-19T09:03:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:20.847+0000 7f73b5733640 1 -- 172.21.15.92:0/3417189979 wait complete. 2024-09-19T09:03:21.504 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:03:21.505 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:03:21.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:21 smithi092 ceph-mon[31407]: pgmap v536: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 11 MiB/s wr, 815 op/s 2024-09-19T09:03:21.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.761+0000 7fb43f59e640 1 -- 172.21.15.92:0/2006785249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4401068d0 msgr2=0x7fb440106cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:21.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.761+0000 7fb43f59e640 1 --2- 172.21.15.92:0/2006785249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4401068d0 0x7fb440106cb0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fb428009930 tx=0x7fb42802e830 comp rx=0 tx=0).stop 2024-09-19T09:03:21.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.762+0000 7fb43f59e640 1 -- 172.21.15.92:0/2006785249 shutdown_connections 2024-09-19T09:03:21.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.762+0000 7fb43f59e640 1 --2- 172.21.15.92:0/2006785249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb440101270 0x7fb44010d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.762+0000 7fb43f59e640 1 --2- 172.21.15.92:0/2006785249 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb4401008d0 0x7fb440100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.762+0000 7fb43f59e640 1 --2- 172.21.15.92:0/2006785249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4401068d0 0x7fb440106cb0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.762+0000 7fb43f59e640 1 -- 172.21.15.92:0/2006785249 >> 172.21.15.92:0/2006785249 conn(0x7fb4400fc610 msgr2=0x7fb4400fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:21.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.762+0000 7fb43f59e640 1 -- 172.21.15.92:0/2006785249 shutdown_connections 2024-09-19T09:03:21.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.762+0000 7fb43f59e640 1 -- 172.21.15.92:0/2006785249 wait complete. 2024-09-19T09:03:21.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.763+0000 7fb43f59e640 1 Processor -- start 2024-09-19T09:03:21.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.764+0000 7fb43f59e640 1 -- start start 2024-09-19T09:03:21.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.764+0000 7fb43f59e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb4401008d0 0x7fb4401961e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.764+0000 7fb43f59e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb440101270 0x7fb440196720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.764+0000 7fb43f59e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4401068d0 0x7fb44019aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.764+0000 7fb43dd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb440101270 0x7fb440196720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:21.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.764+0000 7fb43e59c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb4401008d0 0x7fb4401961e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:21.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.764+0000 7fb43dd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb440101270 0x7fb440196720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48244/0 (socket says 172.21.15.92:48244) 2024-09-19T09:03:21.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.764+0000 7fb43e59c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb4401008d0 0x7fb4401961e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:54820/0 (socket says 172.21.15.92:54820) 2024-09-19T09:03:21.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.765+0000 7fb43dd9b640 1 -- 172.21.15.92:0/195059723 learned_addr learned my addr 172.21.15.92:0/195059723 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:21.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.765+0000 7fb43f59e640 1 -- 172.21.15.92:0/195059723 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb44010fc20 con 0x7fb440101270 2024-09-19T09:03:21.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.765+0000 7fb43f59e640 1 -- 172.21.15.92:0/195059723 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb44010faa0 con 0x7fb4401068d0 2024-09-19T09:03:21.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.765+0000 7fb43ed9d640 1 --2- 172.21.15.92:0/195059723 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4401068d0 0x7fb44019aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:21.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.765+0000 7fb43f59e640 1 -- 172.21.15.92:0/195059723 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb44010fda0 con 0x7fb4401008d0 2024-09-19T09:03:21.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.765+0000 7fb43dd9b640 1 -- 172.21.15.92:0/195059723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb4401008d0 msgr2=0x7fb4401961e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:21.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.765+0000 7fb43dd9b640 1 --2- 172.21.15.92:0/195059723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb4401008d0 0x7fb4401961e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.765+0000 7fb43dd9b640 1 -- 172.21.15.92:0/195059723 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4401068d0 msgr2=0x7fb44019aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:21.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.765+0000 7fb43dd9b640 1 --2- 172.21.15.92:0/195059723 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4401068d0 0x7fb44019aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.765+0000 7fb43dd9b640 1 -- 172.21.15.92:0/195059723 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb44019b190 con 0x7fb440101270 2024-09-19T09:03:21.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.766+0000 7fb43dd9b640 1 --2- 172.21.15.92:0/195059723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb440101270 0x7fb440196720 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fb43000bfd0 tx=0x7fb43000ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:21.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.766+0000 7fb4377fe640 1 -- 172.21.15.92:0/195059723 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb430019070 con 0x7fb440101270 2024-09-19T09:03:21.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.766+0000 7fb4377fe640 1 -- 172.21.15.92:0/195059723 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb430014410 con 0x7fb440101270 2024-09-19T09:03:21.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.766+0000 7fb4377fe640 1 -- 172.21.15.92:0/195059723 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb430013610 con 0x7fb440101270 2024-09-19T09:03:21.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.766+0000 7fb43f59e640 1 -- 172.21.15.92:0/195059723 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb44019b480 con 0x7fb440101270 2024-09-19T09:03:21.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.766+0000 7fb43f59e640 1 -- 172.21.15.92:0/195059723 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4401a2d60 con 0x7fb440101270 2024-09-19T09:03:21.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.771+0000 7fb446bdc740 1 Processor -- start 2024-09-19T09:03:21.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.772+0000 7fb446bdc740 1 -- start start 2024-09-19T09:03:21.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.772+0000 7fb446bdc740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609ef8faa20 0x5609ef8fae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.772+0000 7fb446bdc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609ef8fb340 0x5609ef9056c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.772+0000 7fb446bdc740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609ef905c00 0x5609ef907ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.772+0000 7fb446bdc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5609ef85f160 con 0x5609ef8fb340 2024-09-19T09:03:21.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.772+0000 7fb446bdc740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5609ef806720 con 0x5609ef905c00 2024-09-19T09:03:21.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.772+0000 7fb446bdc740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5609ef85b120 con 0x5609ef8faa20 2024-09-19T09:03:21.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.772+0000 7fb4377fe640 1 -- 172.21.15.92:0/195059723 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb43001c070 con 0x7fb440101270 2024-09-19T09:03:21.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.772+0000 7fb43e59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609ef8fb340 0x5609ef9056c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:21.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.772+0000 7fb43e59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609ef8fb340 0x5609ef9056c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48260/0 (socket says 172.21.15.92:48260) 2024-09-19T09:03:21.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.772+0000 7fb43e59c640 1 -- 172.21.15.92:0/2148735881 learned_addr learned my addr 172.21.15.92:0/2148735881 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:21.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.772+0000 7fb43ed9d640 1 --2- 172.21.15.92:0/2148735881 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609ef8faa20 0x5609ef8fae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:21.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.772+0000 7fb43dd9b640 1 --2- 172.21.15.92:0/2148735881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609ef905c00 0x5609ef907ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:21.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.773+0000 7fb43ed9d640 1 -- 172.21.15.92:0/2148735881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609ef905c00 msgr2=0x5609ef907ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:21.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.773+0000 7fb43ed9d640 1 --2- 172.21.15.92:0/2148735881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609ef905c00 0x5609ef907ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.773+0000 7fb43ed9d640 1 -- 172.21.15.92:0/2148735881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609ef8fb340 msgr2=0x5609ef9056c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:21.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.773+0000 7fb43ed9d640 1 --2- 172.21.15.92:0/2148735881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609ef8fb340 0x5609ef9056c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.773+0000 7fb43ed9d640 1 -- 172.21.15.92:0/2148735881 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609ef5d0ba0 con 0x5609ef8faa20 2024-09-19T09:03:21.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.773+0000 7fb4377fe640 1 --2- 172.21.15.92:0/195059723 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb42c0a3300 0x7fb42c0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.773+0000 7fb4377fe640 1 -- 172.21.15.92:0/195059723 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb4300ceb10 con 0x7fb440101270 2024-09-19T09:03:21.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.773+0000 7fb43e59c640 1 --2- 172.21.15.92:0/195059723 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb42c0a3300 0x7fb42c0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:21.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.774+0000 7fb43e59c640 1 --2- 172.21.15.92:0/195059723 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb42c0a3300 0x7fb42c0a57c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x5609ef8f7e10 tx=0x7fb42802ed30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:21.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.774+0000 7fb43ed9d640 1 --2- 172.21.15.92:0/2148735881 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609ef8faa20 0x5609ef8fae00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb438009f10 tx=0x7fb438011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=567efa687ad93b07 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:21.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.774+0000 7fb434ff9640 1 -- 172.21.15.92:0/2148735881 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb438004d20 con 0x5609ef8faa20 2024-09-19T09:03:21.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.774+0000 7fb434ff9640 1 -- 172.21.15.92:0/2148735881 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb438004050 con 0x5609ef8faa20 2024-09-19T09:03:21.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.774+0000 7fb434ff9640 1 -- 172.21.15.92:0/2148735881 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb438005260 con 0x5609ef8faa20 2024-09-19T09:03:21.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.775+0000 7fb446bdc740 1 -- 172.21.15.92:0/2148735881 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609ef8faa20 msgr2=0x5609ef8fae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:21.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.775+0000 7fb446bdc740 1 --2- 172.21.15.92:0/2148735881 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609ef8faa20 0x5609ef8fae00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb438009f10 tx=0x7fb438011810 comp rx=0 tx=0).stop 2024-09-19T09:03:21.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.775+0000 7fb446bdc740 1 -- 172.21.15.92:0/2148735881 shutdown_connections 2024-09-19T09:03:21.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.775+0000 7fb446bdc740 1 --2- 172.21.15.92:0/2148735881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609ef905c00 0x5609ef907ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.775+0000 7fb446bdc740 1 --2- 172.21.15.92:0/2148735881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609ef8fb340 0x5609ef9056c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.775+0000 7fb446bdc740 1 --2- 172.21.15.92:0/2148735881 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609ef8faa20 0x5609ef8fae00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.775+0000 7fb446bdc740 1 -- 172.21.15.92:0/2148735881 >> 172.21.15.92:0/2148735881 conn(0x5609ef8f6fb0 msgr2=0x5609ef8f7390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:21.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.776+0000 7fb446bdc740 1 -- 172.21.15.92:0/2148735881 shutdown_connections 2024-09-19T09:03:21.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.776+0000 7fb446bdc740 1 -- 172.21.15.92:0/2148735881 wait complete. 2024-09-19T09:03:21.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.776+0000 7fb446bdc740 1 -- start start 2024-09-19T09:03:21.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.776+0000 7fb446bdc740 1 Processor -- start 2024-09-19T09:03:21.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.776+0000 7fb446bdc740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609ef8faa20 0x5609ef902b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.776+0000 7fb446bdc740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609ef8fb340 0x5609ef9030b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.776+0000 7fb446bdc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609ef905c00 0x5609ef9035f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.777+0000 7fb43dd9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609ef8fb340 0x5609ef9030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:21.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.777+0000 7fb43ed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609ef905c00 0x5609ef9035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:21.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.777+0000 7fb43dd9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609ef8fb340 0x5609ef9030b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:54834/0 (socket says 172.21.15.92:54834) 2024-09-19T09:03:21.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.777+0000 7fb43e59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609ef8faa20 0x5609ef902b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:21.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.777+0000 7fb43e59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609ef8faa20 0x5609ef902b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:43418/0 (socket says 172.21.15.92:43418) 2024-09-19T09:03:21.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.777+0000 7fb43ed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609ef905c00 0x5609ef9035f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48264/0 (socket says 172.21.15.92:48264) 2024-09-19T09:03:21.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.777+0000 7fb446bdc740 1 -- 172.21.15.92:0/552472449 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5609ef9087d0 con 0x5609ef905c00 2024-09-19T09:03:21.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.777+0000 7fb43dd9b640 1 -- 172.21.15.92:0/552472449 learned_addr learned my addr 172.21.15.92:0/552472449 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:21.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.777+0000 7fb446bdc740 1 -- 172.21.15.92:0/552472449 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5609ef7e7900 con 0x5609ef8faa20 2024-09-19T09:03:21.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.777+0000 7fb446bdc740 1 -- 172.21.15.92:0/552472449 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5609ef908950 con 0x5609ef8fb340 2024-09-19T09:03:21.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.777+0000 7fb446bdc740 10 client.0 _ll_register_callbacks cb 0x5609ef7e5780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:21.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.777+0000 7fb43dd9b640 1 -- 172.21.15.92:0/552472449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609ef8faa20 msgr2=0x5609ef902b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:21.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.777+0000 7fb43dd9b640 1 --2- 172.21.15.92:0/552472449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609ef8faa20 0x5609ef902b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.777+0000 7fb43dd9b640 1 -- 172.21.15.92:0/552472449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609ef905c00 msgr2=0x5609ef9035f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:21.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.777+0000 7fb43dd9b640 1 --2- 172.21.15.92:0/552472449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609ef905c00 0x5609ef9035f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.777+0000 7fb43dd9b640 1 -- 172.21.15.92:0/552472449 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609ef827c50 con 0x5609ef8fb340 2024-09-19T09:03:21.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.777+0000 7fb43ed9d640 1 --2- 172.21.15.92:0/552472449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609ef905c00 0x5609ef9035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:21.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.777+0000 7fb43dd9b640 1 --2- 172.21.15.92:0/552472449 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609ef8fb340 0x5609ef9030b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb4300058c0 tx=0x7fb4300d20c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2700153e5122919 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:21.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.778+0000 7fb425ffb640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:03:21.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.778+0000 7fb425ffb640 1 -- 172.21.15.92:0/552472449 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43009aa90 con 0x5609ef8fb340 2024-09-19T09:03:21.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.778+0000 7fb425ffb640 1 -- 172.21.15.92:0/552472449 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb430014950 con 0x5609ef8fb340 2024-09-19T09:03:21.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.780+0000 7fb446bdc740 1 -- 172.21.15.92:0/552472449 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb438004050 con 0x5609ef8fb340 2024-09-19T09:03:21.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.780+0000 7fb425ffb640 1 -- 172.21.15.92:0/552472449 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb43009b830 con 0x5609ef8fb340 2024-09-19T09:03:21.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.780+0000 7fb446bdc740 10 client.26161 fetch_fsmap learned FSMap version 19 2024-09-19T09:03:21.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.780+0000 7fb446bdc740 1 -- 172.21.15.92:0/552472449 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5609ef9144e0 con 0x5609ef8fb340 2024-09-19T09:03:21.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.781+0000 7fb425ffb640 1 -- 172.21.15.92:0/552472449 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb438004050 con 0x5609ef8fb340 2024-09-19T09:03:21.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.781+0000 7fb425ffb640 1 -- 172.21.15.92:0/552472449 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fb4300145c0 con 0x5609ef8fb340 2024-09-19T09:03:21.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.781+0000 7fb446bdc740 10 client.26161 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:03:21.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.781+0000 7fb446bdc740 10 client.26161 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:03:21.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.781+0000 7fb446bdc740 20 client.26161 populate_metadata read hostname 'smithi092' 2024-09-19T09:03:21.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.781+0000 7fb446bdc740 1 --2- 172.21.15.92:0/552472449 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5609ef9159a0 0x5609ef917d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.781+0000 7fb446bdc740 4 client.26161 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:21.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.781+0000 7fb446bdc740 1 -- 172.21.15.92:0/552472449 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5609ef86c890 con 0x5609ef9159a0 2024-09-19T09:03:21.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.781+0000 7fb43e59c640 1 --2- 172.21.15.92:0/552472449 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5609ef9159a0 0x5609ef917d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:21.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.782+0000 7fb425ffb640 10 client.26161 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:21.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.782+0000 7fb43e59c640 1 --2- 172.21.15.92:0/552472449 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5609ef9159a0 0x5609ef917d90 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93d73fc1e1dc5f9 server_cookie=19494266cc28425d in_seq=0 out_seq=0 2024-09-19T09:03:21.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.782+0000 7fb425ffb640 1 -- 172.21.15.92:0/552472449 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5609ef86c890 con 0x5609ef9159a0 2024-09-19T09:03:21.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.782+0000 7fb425ffb640 10 client.26161 handle_command_reply: tid=0 2024-09-19T09:03:21.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.782+0000 7fb446bdc740 1 client.26161 shutdown 2024-09-19T09:03:21.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.783+0000 7fb446bdc740 1 -- 172.21.15.92:0/552472449 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609ef8fb340 msgr2=0x5609ef9030b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:21.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.783+0000 7fb446bdc740 1 --2- 172.21.15.92:0/552472449 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609ef8fb340 0x5609ef9030b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb4300058c0 tx=0x7fb4300d20c0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.783+0000 7fb446bdc740 1 -- 172.21.15.92:0/552472449 shutdown_connections 2024-09-19T09:03:21.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.783+0000 7fb446bdc740 1 --2- 172.21.15.92:0/552472449 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5609ef9159a0 0x5609ef917d90 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.783+0000 7fb425ffb640 0 client.26161 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:21.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.783+0000 7fb446bdc740 1 --2- 172.21.15.92:0/552472449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609ef905c00 0x5609ef9035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.783+0000 7fb446bdc740 1 --2- 172.21.15.92:0/552472449 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609ef8fb340 0x5609ef9030b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.783+0000 7fb446bdc740 1 --2- 172.21.15.92:0/552472449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609ef8faa20 0x5609ef902b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.783+0000 7fb446bdc740 1 -- 172.21.15.92:0/552472449 >> 172.21.15.92:0/552472449 conn(0x5609ef8f6fb0 msgr2=0x5609ef8fcce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:21.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.783+0000 7fb446bdc740 1 -- 172.21.15.92:0/552472449 shutdown_connections 2024-09-19T09:03:21.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.783+0000 7fb446bdc740 1 -- 172.21.15.92:0/552472449 wait complete. 2024-09-19T09:03:21.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.783+0000 7fb446bdc740 20 client.26161 trim_cache size 0 max 16384 2024-09-19T09:03:21.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.810+0000 7fb446bdc740 1 Processor -- start 2024-09-19T09:03:21.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.810+0000 7fb446bdc740 1 -- start start 2024-09-19T09:03:21.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.810+0000 7fb446bdc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609ef8faa20 0x5609ef91d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.810+0000 7fb446bdc740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609ef8fb340 0x5609ef91db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.810+0000 7fb446bdc740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609ef905c00 0x5609ef8ffe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.811+0000 7fb446bdc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb4401a9390 con 0x5609ef8faa20 2024-09-19T09:03:21.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.811+0000 7fb446bdc740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb4401abc30 con 0x5609ef8fb340 2024-09-19T09:03:21.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.811+0000 7fb446bdc740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb4401a9a20 con 0x5609ef905c00 2024-09-19T09:03:21.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.811+0000 7fb43e59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609ef8faa20 0x5609ef91d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:21.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.811+0000 7fb43ed9d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609ef905c00 0x5609ef8ffe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:21.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.811+0000 7fb43e59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609ef8faa20 0x5609ef91d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48272/0 (socket says 172.21.15.92:48272) 2024-09-19T09:03:21.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.811+0000 7fb43e59c640 1 -- 172.21.15.92:0/2785054655 learned_addr learned my addr 172.21.15.92:0/2785054655 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:21.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.811+0000 7fb43dd9b640 1 --2- 172.21.15.92:0/2785054655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609ef8fb340 0x5609ef91db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:21.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.811+0000 7fb43e59c640 1 -- 172.21.15.92:0/2785054655 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609ef905c00 msgr2=0x5609ef8ffe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:21.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.811+0000 7fb43e59c640 1 --2- 172.21.15.92:0/2785054655 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609ef905c00 0x5609ef8ffe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.811+0000 7fb43e59c640 1 -- 172.21.15.92:0/2785054655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609ef8fb340 msgr2=0x5609ef91db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:21.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.811+0000 7fb43e59c640 1 --2- 172.21.15.92:0/2785054655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609ef8fb340 0x5609ef91db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.811+0000 7fb43e59c640 1 -- 172.21.15.92:0/2785054655 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609ef8f8060 con 0x5609ef8faa20 2024-09-19T09:03:21.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.811+0000 7fb43dd9b640 1 --2- 172.21.15.92:0/2785054655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609ef8fb340 0x5609ef91db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:21.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.812+0000 7fb43e59c640 1 --2- 172.21.15.92:0/2785054655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609ef8faa20 0x5609ef91d5c0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fb428009230 tx=0x7fb428044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b8924890391f34 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:21.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.812+0000 7fb427fff640 1 -- 172.21.15.92:0/2785054655 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42805d070 con 0x5609ef8faa20 2024-09-19T09:03:21.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.812+0000 7fb427fff640 1 -- 172.21.15.92:0/2785054655 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5609ef86c890 con 0x5609ef8faa20 2024-09-19T09:03:21.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.812+0000 7fb427fff640 1 -- 172.21.15.92:0/2785054655 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb428048070 con 0x5609ef8faa20 2024-09-19T09:03:21.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.813+0000 7fb446bdc740 1 -- 172.21.15.92:0/2785054655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609ef8faa20 msgr2=0x5609ef91d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:21.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.813+0000 7fb446bdc740 1 --2- 172.21.15.92:0/2785054655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609ef8faa20 0x5609ef91d5c0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fb428009230 tx=0x7fb428044000 comp rx=0 tx=0).stop 2024-09-19T09:03:21.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.813+0000 7fb446bdc740 1 -- 172.21.15.92:0/2785054655 shutdown_connections 2024-09-19T09:03:21.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.813+0000 7fb446bdc740 1 --2- 172.21.15.92:0/2785054655 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609ef905c00 0x5609ef8ffe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.813+0000 7fb446bdc740 1 --2- 172.21.15.92:0/2785054655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609ef8fb340 0x5609ef91db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.813+0000 7fb446bdc740 1 --2- 172.21.15.92:0/2785054655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609ef8faa20 0x5609ef91d5c0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.814+0000 7fb446bdc740 1 -- 172.21.15.92:0/2785054655 >> 172.21.15.92:0/2785054655 conn(0x5609ef8f6fb0 msgr2=0x5609ef8fcc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:21.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.814+0000 7fb446bdc740 1 -- 172.21.15.92:0/2785054655 shutdown_connections 2024-09-19T09:03:21.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.814+0000 7fb446bdc740 1 -- 172.21.15.92:0/2785054655 wait complete. 2024-09-19T09:03:21.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.815+0000 7fb446bdc740 1 -- start start 2024-09-19T09:03:21.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.815+0000 7fb446bdc740 1 Processor -- start 2024-09-19T09:03:21.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.815+0000 7fb446bdc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609ef8faa20 0x5609ef90dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.815+0000 7fb446bdc740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609ef8fb340 0x5609ef90e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.815+0000 7fb446bdc740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609ef905c00 0x5609ef90ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.815+0000 7fb446bdc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb4401aa0f0 con 0x5609ef8faa20 2024-09-19T09:03:21.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.815+0000 7fb446bdc740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb4401ab560 con 0x5609ef905c00 2024-09-19T09:03:21.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.815+0000 7fb446bdc740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb4401aa7c0 con 0x5609ef8fb340 2024-09-19T09:03:21.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.816+0000 7fb446bdc740 10 client.0 _ll_register_callbacks cb 0x7fb4300d2280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:21.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.816+0000 7fb43dd9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609ef8fb340 0x5609ef90e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:21.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.816+0000 7fb43dd9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609ef8fb340 0x5609ef90e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:54850/0 (socket says 172.21.15.92:54850) 2024-09-19T09:03:21.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.816+0000 7fb43ed9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609ef905c00 0x5609ef90ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:21.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.816+0000 7fb43dd9b640 1 -- 172.21.15.92:0/3410144501 learned_addr learned my addr 172.21.15.92:0/3410144501 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:21.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.816+0000 7fb43dd9b640 1 -- 172.21.15.92:0/3410144501 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609ef905c00 msgr2=0x5609ef90ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:21.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.816+0000 7fb43dd9b640 1 --2- 172.21.15.92:0/3410144501 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609ef905c00 0x5609ef90ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.816+0000 7fb43dd9b640 1 -- 172.21.15.92:0/3410144501 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609ef8faa20 msgr2=0x5609ef90dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:21.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.816+0000 7fb43dd9b640 1 --2- 172.21.15.92:0/3410144501 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609ef8faa20 0x5609ef90dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.816+0000 7fb43dd9b640 1 -- 172.21.15.92:0/3410144501 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609ef90b1e0 con 0x5609ef8fb340 2024-09-19T09:03:21.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.817+0000 7fb43dd9b640 1 --2- 172.21.15.92:0/3410144501 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609ef8fb340 0x5609ef90e2c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb430007590 tx=0x7fb4300b4240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f789dedb1ae80ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:21.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.817+0000 7fb425ffb640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:03:21.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.817+0000 7fb425ffb640 1 -- 172.21.15.92:0/3410144501 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4300973d0 con 0x5609ef8fb340 2024-09-19T09:03:21.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.817+0000 7fb425ffb640 1 -- 172.21.15.92:0/3410144501 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb43009a7d0 con 0x5609ef8fb340 2024-09-19T09:03:21.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.817+0000 7fb446bdc740 1 -- 172.21.15.92:0/3410144501 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5609ef86c890 con 0x5609ef8fb340 2024-09-19T09:03:21.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.817+0000 7fb425ffb640 1 -- 172.21.15.92:0/3410144501 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb43009b130 con 0x5609ef8fb340 2024-09-19T09:03:21.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.817+0000 7fb446bdc740 10 client.26167 fetch_fsmap learned FSMap version 19 2024-09-19T09:03:21.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.817+0000 7fb446bdc740 1 -- 172.21.15.92:0/3410144501 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5609ef980ee0 con 0x5609ef8fb340 2024-09-19T09:03:21.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.818+0000 7fb425ffb640 1 -- 172.21.15.92:0/3410144501 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb43009f4e0 con 0x5609ef8fb340 2024-09-19T09:03:21.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.818+0000 7fb425ffb640 1 -- 172.21.15.92:0/3410144501 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fb43009a080 con 0x5609ef8fb340 2024-09-19T09:03:21.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.818+0000 7fb446bdc740 10 client.26167 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:03:21.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.818+0000 7fb446bdc740 10 client.26167 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:03:21.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.818+0000 7fb446bdc740 20 client.26167 populate_metadata read hostname 'smithi092' 2024-09-19T09:03:21.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.818+0000 7fb446bdc740 1 --2- 172.21.15.92:0/3410144501 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5609ef9159a0 0x5609ef983650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.818+0000 7fb446bdc740 4 client.26167 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.75, "await_for": 45.0}] 2024-09-19T09:03:21.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.818+0000 7fb446bdc740 1 -- 172.21.15.92:0/3410144501 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.75, "await_for": 45.0}) -- 0x5609ef86c890 con 0x5609ef9159a0 2024-09-19T09:03:21.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.819+0000 7fb43e59c640 1 --2- 172.21.15.92:0/3410144501 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5609ef9159a0 0x5609ef983650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:21.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.820+0000 7fb43e59c640 1 --2- 172.21.15.92:0/3410144501 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5609ef9159a0 0x5609ef983650 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5550e8fd10d615a server_cookie=82ce8e670296307e in_seq=0 out_seq=0 2024-09-19T09:03:21.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:21.820+0000 7fb425ffb640 10 client.26167 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:21.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:21 smithi167 ceph-mon[35359]: pgmap v536: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 11 MiB/s wr, 815 op/s 2024-09-19T09:03:21.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:21 smithi190 ceph-mon[35358]: pgmap v536: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 11 MiB/s wr, 815 op/s 2024-09-19T09:03:21.881 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:22.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.132+0000 7fb425ffb640 1 -- 172.21.15.92:0/3410144501 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x5609ef86c890 con 0x5609ef9159a0 2024-09-19T09:03:22.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.132+0000 7fb425ffb640 10 client.26167 handle_command_reply: tid=0 2024-09-19T09:03:22.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.133+0000 7fb446bdc740 1 client.26167 shutdown 2024-09-19T09:03:22.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.133+0000 7fb446bdc740 1 -- 172.21.15.92:0/3410144501 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609ef8fb340 msgr2=0x5609ef90e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:22.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.133+0000 7fb446bdc740 1 --2- 172.21.15.92:0/3410144501 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609ef8fb340 0x5609ef90e2c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb430007590 tx=0x7fb4300b4240 comp rx=0 tx=0).stop 2024-09-19T09:03:22.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.133+0000 7fb446bdc740 1 -- 172.21.15.92:0/3410144501 shutdown_connections 2024-09-19T09:03:22.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.133+0000 7fb446bdc740 1 --2- 172.21.15.92:0/3410144501 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5609ef9159a0 0x5609ef983650 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.133+0000 7fb446bdc740 1 --2- 172.21.15.92:0/3410144501 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609ef905c00 0x5609ef90ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.133+0000 7fb446bdc740 1 --2- 172.21.15.92:0/3410144501 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609ef8fb340 0x5609ef90e2c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.133+0000 7fb446bdc740 1 --2- 172.21.15.92:0/3410144501 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609ef8faa20 0x5609ef90dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.133+0000 7fb425ffb640 0 client.26167 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:22.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.133+0000 7fb446bdc740 1 -- 172.21.15.92:0/3410144501 >> 172.21.15.92:0/3410144501 conn(0x5609ef8f6fb0 msgr2=0x5609ef8fc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:22.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.133+0000 7fb446bdc740 1 -- 172.21.15.92:0/3410144501 shutdown_connections 2024-09-19T09:03:22.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.133+0000 7fb446bdc740 1 -- 172.21.15.92:0/3410144501 wait complete. 2024-09-19T09:03:22.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.133+0000 7fb446bdc740 20 client.26167 trim_cache size 0 max 16384 2024-09-19T09:03:22.135 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:03:22.135 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 19, 2024-09-19T09:03:22.135 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24472, 2024-09-19T09:03:22.135 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 26, 2024-09-19T09:03:22.135 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-09-19T09:03:22.135 INFO:teuthology.orchestra.run.smithi092.stdout: "1858207": { 2024-09-19T09:03:22.135 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 26, 2024-09-19T09:03:22.135 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-09-19T09:03:22.135 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:03:22.135 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-09-19T09:03:22.136 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:03:22.136 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:03:22.136 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 90.0, 2024-09-19T09:03:22.136 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 145.8, 2024-09-19T09:03:22.136 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-09-19T09:03:22.136 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-09-19T09:03:22.136 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-09-19T09:03:22.136 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:03:22.136 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-09-19T09:03:22.136 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:03:22.136 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:03:22.136 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:03:22.136 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:03:22.137 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:03:22.137 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:03:22.137 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:03:22.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.133+0000 7fb43f59e640 1 -- 172.21.15.92:0/195059723 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb42c0a3300 msgr2=0x7fb42c0a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:22.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.133+0000 7fb43f59e640 1 --2- 172.21.15.92:0/195059723 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb42c0a3300 0x7fb42c0a57c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x5609ef8f7e10 tx=0x7fb42802ed30 comp rx=0 tx=0).stop 2024-09-19T09:03:22.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.133+0000 7fb43f59e640 1 -- 172.21.15.92:0/195059723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb440101270 msgr2=0x7fb440196720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:22.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.134+0000 7fb43f59e640 1 --2- 172.21.15.92:0/195059723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb440101270 0x7fb440196720 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fb43000bfd0 tx=0x7fb43000ad50 comp rx=0 tx=0).stop 2024-09-19T09:03:22.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.134+0000 7fb43f59e640 1 -- 172.21.15.92:0/195059723 shutdown_connections 2024-09-19T09:03:22.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.134+0000 7fb43f59e640 1 --2- 172.21.15.92:0/195059723 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4401068d0 0x7fb44019aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.134+0000 7fb43f59e640 1 --2- 172.21.15.92:0/195059723 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb42c0a3300 0x7fb42c0a57c0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.134+0000 7fb43f59e640 1 --2- 172.21.15.92:0/195059723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb440101270 0x7fb440196720 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.134+0000 7fb43f59e640 1 --2- 172.21.15.92:0/195059723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb4401008d0 0x7fb4401961e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.134+0000 7fb43f59e640 1 -- 172.21.15.92:0/195059723 >> 172.21.15.92:0/195059723 conn(0x7fb4400fc610 msgr2=0x7fb4400fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:22.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.134+0000 7fb43f59e640 1 -- 172.21.15.92:0/195059723 shutdown_connections 2024-09-19T09:03:22.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.134+0000 7fb43f59e640 1 -- 172.21.15.92:0/195059723 wait complete. 2024-09-19T09:03:22.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.581+0000 7f6df89d4640 1 -- 172.21.15.92:0/812913123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6df4100e20 msgr2=0x7f6df4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:22.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.581+0000 7f6df89d4640 1 --2- 172.21.15.92:0/812913123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6df4100e20 0x7f6df4101200 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f6de4009ca0 tx=0x7f6de402a950 comp rx=0 tx=0).stop 2024-09-19T09:03:22.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.581+0000 7f6df89d4640 1 -- 172.21.15.92:0/812913123 shutdown_connections 2024-09-19T09:03:22.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.581+0000 7f6df89d4640 1 --2- 172.21.15.92:0/812913123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6df4102ef0 0x7f6df410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.581+0000 7f6df89d4640 1 --2- 172.21.15.92:0/812913123 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6df4102570 0x7f6df41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.581+0000 7f6df89d4640 1 --2- 172.21.15.92:0/812913123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6df4100e20 0x7f6df4101200 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.581+0000 7f6df89d4640 1 -- 172.21.15.92:0/812913123 >> 172.21.15.92:0/812913123 conn(0x7f6df40fc7d0 msgr2=0x7f6df40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:22.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.581+0000 7f6df89d4640 1 -- 172.21.15.92:0/812913123 shutdown_connections 2024-09-19T09:03:22.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.581+0000 7f6df89d4640 1 -- 172.21.15.92:0/812913123 wait complete. 2024-09-19T09:03:22.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.582+0000 7f6df89d4640 1 Processor -- start 2024-09-19T09:03:22.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.582+0000 7f6df89d4640 1 -- start start 2024-09-19T09:03:22.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.582+0000 7f6df89d4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6df4100e20 0x7f6df419a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:22.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.582+0000 7f6df89d4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6df4102570 0x7f6df419ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:22.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.582+0000 7f6df89d4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6df4102ef0 0x7f6df419ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:22.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.582+0000 7f6df89d4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6df4110f50 con 0x7f6df4102ef0 2024-09-19T09:03:22.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.582+0000 7f6df89d4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6df4110dd0 con 0x7f6df4100e20 2024-09-19T09:03:22.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.582+0000 7f6df89d4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6df41110d0 con 0x7f6df4102570 2024-09-19T09:03:22.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.583+0000 7f6df2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6df4102ef0 0x7f6df419ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:22.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.583+0000 7f6df2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6df4102ef0 0x7f6df419ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48278/0 (socket says 172.21.15.92:48278) 2024-09-19T09:03:22.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.583+0000 7f6df2d9d640 1 -- 172.21.15.92:0/794061243 learned_addr learned my addr 172.21.15.92:0/794061243 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:22.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.583+0000 7f6df1d9b640 1 --2- 172.21.15.92:0/794061243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6df4102570 0x7f6df419ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:22.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.583+0000 7f6df259c640 1 --2- 172.21.15.92:0/794061243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6df4100e20 0x7f6df419a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:22.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.583+0000 7f6df2d9d640 1 -- 172.21.15.92:0/794061243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6df4102570 msgr2=0x7f6df419ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:22.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.583+0000 7f6df2d9d640 1 --2- 172.21.15.92:0/794061243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6df4102570 0x7f6df419ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.583+0000 7f6df2d9d640 1 -- 172.21.15.92:0/794061243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6df4100e20 msgr2=0x7f6df419a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:22.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.583+0000 7f6df2d9d640 1 --2- 172.21.15.92:0/794061243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6df4100e20 0x7f6df419a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.583+0000 7f6df2d9d640 1 -- 172.21.15.92:0/794061243 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df419f600 con 0x7f6df4102ef0 2024-09-19T09:03:22.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.583+0000 7f6df259c640 1 --2- 172.21.15.92:0/794061243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6df4100e20 0x7f6df419a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:22.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.583+0000 7f6df2d9d640 1 --2- 172.21.15.92:0/794061243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6df4102ef0 0x7f6df419ef20 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f6dec00d950 tx=0x7f6dec00dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:22.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.583+0000 7f6de37fe640 1 -- 172.21.15.92:0/794061243 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec017030 con 0x7f6df4102ef0 2024-09-19T09:03:22.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.583+0000 7f6de37fe640 1 -- 172.21.15.92:0/794061243 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6dec004020 con 0x7f6df4102ef0 2024-09-19T09:03:22.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.583+0000 7f6df89d4640 1 -- 172.21.15.92:0/794061243 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6df419f8f0 con 0x7f6df4102ef0 2024-09-19T09:03:22.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.583+0000 7f6de37fe640 1 -- 172.21.15.92:0/794061243 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec003b70 con 0x7f6df4102ef0 2024-09-19T09:03:22.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.583+0000 7f6df89d4640 1 -- 172.21.15.92:0/794061243 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6df41a71d0 con 0x7f6df4102ef0 2024-09-19T09:03:22.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.584+0000 7f6df89d4640 1 -- 172.21.15.92:0/794061243 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6df4101200 con 0x7f6df4102ef0 2024-09-19T09:03:22.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.586+0000 7f6de37fe640 1 -- 172.21.15.92:0/794061243 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6dec01a070 con 0x7f6df4102ef0 2024-09-19T09:03:22.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.586+0000 7f6de37fe640 1 --2- 172.21.15.92:0/794061243 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6ddc0a3240 0x7f6ddc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:22.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.587+0000 7f6df259c640 1 --2- 172.21.15.92:0/794061243 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6ddc0a3240 0x7f6ddc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:22.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.587+0000 7f6de37fe640 1 -- 172.21.15.92:0/794061243 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f6dec0cf770 con 0x7f6df4102ef0 2024-09-19T09:03:22.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.587+0000 7f6df259c640 1 --2- 172.21.15.92:0/794061243 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6ddc0a3240 0x7f6ddc0a5700 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6de4030040 tx=0x7f6de4005c30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:22.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.590+0000 7f6de37fe640 1 -- 172.21.15.92:0/794061243 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6dec09c490 con 0x7f6df4102ef0 2024-09-19T09:03:22.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.799+0000 7f6df89d4640 1 -- 172.21.15.92:0/794061243 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6df419b9b0 con 0x7f6df4102ef0 2024-09-19T09:03:22.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.799+0000 7f6de37fe640 1 -- 172.21.15.92:0/794061243 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f6df419b9b0 con 0x7f6df4102ef0 2024-09-19T09:03:22.800 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:03:22.800 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:03:22.800 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:03:22.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.801+0000 7f6df89d4640 1 -- 172.21.15.92:0/794061243 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6ddc0a3240 msgr2=0x7f6ddc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:22.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.801+0000 7f6df89d4640 1 --2- 172.21.15.92:0/794061243 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6ddc0a3240 0x7f6ddc0a5700 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6de4030040 tx=0x7f6de4005c30 comp rx=0 tx=0).stop 2024-09-19T09:03:22.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.801+0000 7f6df89d4640 1 -- 172.21.15.92:0/794061243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6df4102ef0 msgr2=0x7f6df419ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:22.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.801+0000 7f6df89d4640 1 --2- 172.21.15.92:0/794061243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6df4102ef0 0x7f6df419ef20 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f6dec00d950 tx=0x7f6dec00dd50 comp rx=0 tx=0).stop 2024-09-19T09:03:22.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.801+0000 7f6df89d4640 1 -- 172.21.15.92:0/794061243 shutdown_connections 2024-09-19T09:03:22.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.801+0000 7f6df89d4640 1 --2- 172.21.15.92:0/794061243 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6ddc0a3240 0x7f6ddc0a5700 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.801+0000 7f6df89d4640 1 --2- 172.21.15.92:0/794061243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6df4102ef0 0x7f6df419ef20 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.801+0000 7f6df89d4640 1 --2- 172.21.15.92:0/794061243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6df4102570 0x7f6df419ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.801+0000 7f6df89d4640 1 --2- 172.21.15.92:0/794061243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6df4100e20 0x7f6df419a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.802+0000 7f6df89d4640 1 -- 172.21.15.92:0/794061243 >> 172.21.15.92:0/794061243 conn(0x7f6df40fc7d0 msgr2=0x7f6df406a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:22.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.802+0000 7f6df89d4640 1 -- 172.21.15.92:0/794061243 shutdown_connections 2024-09-19T09:03:22.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:22.802+0000 7f6df89d4640 1 -- 172.21.15.92:0/794061243 wait complete. 2024-09-19T09:03:23.051 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '1858207', quiesce took 5.7 seconds. Will release after: 20.05 2024-09-19T09:03:23.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:23 smithi092 ceph-mon[31407]: pgmap v537: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8.1 MiB/s wr, 714 op/s 2024-09-19T09:03:23.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:23 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/794061243' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:23.802 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:03:23.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:23 smithi167 ceph-mon[35359]: pgmap v537: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8.1 MiB/s wr, 714 op/s 2024-09-19T09:03:23.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:23 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/794061243' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:23.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:23 smithi190 ceph-mon[35358]: pgmap v537: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8.1 MiB/s wr, 714 op/s 2024-09-19T09:03:23.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:23 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/794061243' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:24.049 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:24.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.445+0000 7feaa303c640 1 -- 172.21.15.92:0/141874363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea9c101420 msgr2=0x7fea9c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:24.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.445+0000 7feaa303c640 1 --2- 172.21.15.92:0/141874363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea9c101420 0x7fea9c10d950 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fea94009cd0 tx=0x7fea9402a8e0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.445+0000 7feaa303c640 1 -- 172.21.15.92:0/141874363 shutdown_connections 2024-09-19T09:03:24.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.445+0000 7feaa303c640 1 --2- 172.21.15.92:0/141874363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea9c101420 0x7fea9c10d950 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.445+0000 7feaa303c640 1 --2- 172.21.15.92:0/141874363 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea9c100a80 0x7fea9c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.445+0000 7feaa303c640 1 --2- 172.21.15.92:0/141874363 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea9c106a80 0x7fea9c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.445+0000 7feaa303c640 1 -- 172.21.15.92:0/141874363 >> 172.21.15.92:0/141874363 conn(0x7fea9c0fc7a0 msgr2=0x7fea9c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:24.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.445+0000 7feaa303c640 1 -- 172.21.15.92:0/141874363 shutdown_connections 2024-09-19T09:03:24.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.445+0000 7feaa303c640 1 -- 172.21.15.92:0/141874363 wait complete. 2024-09-19T09:03:24.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.446+0000 7feaa303c640 1 Processor -- start 2024-09-19T09:03:24.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.446+0000 7feaa303c640 1 -- start start 2024-09-19T09:03:24.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.446+0000 7feaa303c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea9c100a80 0x7fea9c1985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:24.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.446+0000 7feaa303c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea9c101420 0x7fea9c198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:24.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.446+0000 7feaa303c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea9c106a80 0x7fea9c19ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:24.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.446+0000 7feaa303c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fea9c112020 con 0x7fea9c101420 2024-09-19T09:03:24.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.446+0000 7feaa303c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fea9c111ea0 con 0x7fea9c106a80 2024-09-19T09:03:24.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.446+0000 7feaa303c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fea9c1121a0 con 0x7fea9c100a80 2024-09-19T09:03:24.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.446+0000 7fea9bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea9c101420 0x7fea9c198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:24.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.446+0000 7fea9bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea9c101420 0x7fea9c198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48298/0 (socket says 172.21.15.92:48298) 2024-09-19T09:03:24.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.446+0000 7fea9bfff640 1 -- 172.21.15.92:0/2941165271 learned_addr learned my addr 172.21.15.92:0/2941165271 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:24.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.446+0000 7feaa0dd8640 1 --2- 172.21.15.92:0/2941165271 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea9c100a80 0x7fea9c1985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:24.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.446+0000 7feaa15d9640 1 --2- 172.21.15.92:0/2941165271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea9c106a80 0x7fea9c19ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:24.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.447+0000 7fea9bfff640 1 -- 172.21.15.92:0/2941165271 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea9c100a80 msgr2=0x7fea9c1985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:24.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.447+0000 7fea9bfff640 1 --2- 172.21.15.92:0/2941165271 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea9c100a80 0x7fea9c1985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.447+0000 7fea9bfff640 1 -- 172.21.15.92:0/2941165271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea9c106a80 msgr2=0x7fea9c19ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:24.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.447+0000 7fea9bfff640 1 --2- 172.21.15.92:0/2941165271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea9c106a80 0x7fea9c19ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.447+0000 7fea9bfff640 1 -- 172.21.15.92:0/2941165271 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea9c19d550 con 0x7fea9c101420 2024-09-19T09:03:24.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.447+0000 7feaa0dd8640 1 --2- 172.21.15.92:0/2941165271 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea9c100a80 0x7fea9c1985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:24.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.447+0000 7feaa15d9640 1 --2- 172.21.15.92:0/2941165271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea9c106a80 0x7fea9c19ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:24.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.447+0000 7fea9bfff640 1 --2- 172.21.15.92:0/2941165271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea9c101420 0x7fea9c198ae0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fea8800b4a0 tx=0x7fea8800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:24.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.447+0000 7fea99ffb640 1 -- 172.21.15.92:0/2941165271 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea88014070 con 0x7fea9c101420 2024-09-19T09:03:24.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.447+0000 7fea99ffb640 1 -- 172.21.15.92:0/2941165271 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea88010af0 con 0x7fea9c101420 2024-09-19T09:03:24.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.447+0000 7fea99ffb640 1 -- 172.21.15.92:0/2941165271 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea88017d10 con 0x7fea9c101420 2024-09-19T09:03:24.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.448+0000 7feaa303c640 1 -- 172.21.15.92:0/2941165271 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea9c19d840 con 0x7fea9c101420 2024-09-19T09:03:24.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.448+0000 7feaa303c640 1 -- 172.21.15.92:0/2941165271 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea9c1a5120 con 0x7fea9c101420 2024-09-19T09:03:24.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.450+0000 7fea99ffb640 1 -- 172.21.15.92:0/2941165271 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fea88017070 con 0x7fea9c101420 2024-09-19T09:03:24.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.450+0000 7feaa5415740 1 Processor -- start 2024-09-19T09:03:24.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.451+0000 7feaa5415740 1 -- start start 2024-09-19T09:03:24.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.451+0000 7feaa5415740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eeb7837b40 0x55eeb7836090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:24.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.451+0000 7feaa5415740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eeb78365d0 0x55eeb7836a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:24.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.451+0000 7feaa5415740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eeb7845780 0x55eeb7847b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:24.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.451+0000 7feaa5415740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55eeb779c2f0 con 0x55eeb7837b40 2024-09-19T09:03:24.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.451+0000 7feaa5415740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55eeb7743cf0 con 0x55eeb7845780 2024-09-19T09:03:24.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.451+0000 7feaa5415740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55eeb77982b0 con 0x55eeb78365d0 2024-09-19T09:03:24.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.451+0000 7fea99ffb640 1 --2- 172.21.15.92:0/2941165271 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fea8c0a32c0 0x7fea8c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:24.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.451+0000 7feaa15d9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eeb7837b40 0x55eeb7836090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:24.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.451+0000 7feaa15d9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eeb7837b40 0x55eeb7836090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48306/0 (socket says 172.21.15.92:48306) 2024-09-19T09:03:24.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.451+0000 7feaa15d9640 1 -- 172.21.15.92:0/2591896921 learned_addr learned my addr 172.21.15.92:0/2591896921 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:24.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.451+0000 7feaa15d9640 1 --2- 172.21.15.92:0/2941165271 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fea8c0a32c0 0x7fea8c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:24.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.451+0000 7fea99ffb640 1 -- 172.21.15.92:0/2941165271 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fea880ce6c0 con 0x7fea9c101420 2024-09-19T09:03:24.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.451+0000 7fea9bfff640 1 --2- 172.21.15.92:0/2591896921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eeb7845780 0x55eeb7847b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:24.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.451+0000 7feaa0dd8640 1 --2- 172.21.15.92:0/2591896921 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eeb78365d0 0x55eeb7836a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:24.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.451+0000 7feaa15d9640 1 -- 172.21.15.92:0/2591896921 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eeb78365d0 msgr2=0x55eeb7836a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:24.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.451+0000 7feaa15d9640 1 --2- 172.21.15.92:0/2591896921 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eeb78365d0 0x55eeb7836a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.451+0000 7feaa15d9640 1 -- 172.21.15.92:0/2591896921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eeb7845780 msgr2=0x55eeb7847b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:24.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.451+0000 7feaa15d9640 1 --2- 172.21.15.92:0/2591896921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eeb7845780 0x55eeb7847b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.451+0000 7feaa15d9640 1 -- 172.21.15.92:0/2591896921 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeb77283a0 con 0x55eeb7837b40 2024-09-19T09:03:24.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.451+0000 7fea9bfff640 1 --2- 172.21.15.92:0/2591896921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eeb7845780 0x55eeb7847b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:24.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.452+0000 7feaa15d9640 1 --2- 172.21.15.92:0/2591896921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eeb7837b40 0x55eeb7836090 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fea94031d00 tx=0x7fea94031d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=371b5b26ed8e0a19 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:24.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.452+0000 7feaa15d9640 1 --2- 172.21.15.92:0/2941165271 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fea8c0a32c0 0x7fea8c0a5780 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fea94031da0 tx=0x7fea94048000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:24.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.452+0000 7fea86ffd640 1 -- 172.21.15.92:0/2591896921 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9404e070 con 0x55eeb7837b40 2024-09-19T09:03:24.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.452+0000 7fea86ffd640 1 -- 172.21.15.92:0/2591896921 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea94036040 con 0x55eeb7837b40 2024-09-19T09:03:24.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.452+0000 7fea86ffd640 1 -- 172.21.15.92:0/2591896921 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea940307e0 con 0x55eeb7837b40 2024-09-19T09:03:24.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.453+0000 7feaa5415740 1 -- 172.21.15.92:0/2591896921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eeb7837b40 msgr2=0x55eeb7836090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:24.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.453+0000 7feaa5415740 1 --2- 172.21.15.92:0/2591896921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eeb7837b40 0x55eeb7836090 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fea94031d00 tx=0x7fea94031d30 comp rx=0 tx=0).stop 2024-09-19T09:03:24.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.453+0000 7feaa5415740 1 -- 172.21.15.92:0/2591896921 shutdown_connections 2024-09-19T09:03:24.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.453+0000 7feaa5415740 1 --2- 172.21.15.92:0/2591896921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eeb7845780 0x55eeb7847b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.453+0000 7feaa5415740 1 --2- 172.21.15.92:0/2591896921 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eeb78365d0 0x55eeb7836a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.453+0000 7feaa5415740 1 --2- 172.21.15.92:0/2591896921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eeb7837b40 0x55eeb7836090 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.453+0000 7feaa5415740 1 -- 172.21.15.92:0/2591896921 >> 172.21.15.92:0/2591896921 conn(0x55eeb77ff310 msgr2=0x55eeb7832c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:24.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.453+0000 7feaa5415740 1 -- 172.21.15.92:0/2591896921 shutdown_connections 2024-09-19T09:03:24.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.453+0000 7feaa5415740 1 -- 172.21.15.92:0/2591896921 wait complete. 2024-09-19T09:03:24.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.453+0000 7feaa5415740 1 -- start start 2024-09-19T09:03:24.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.453+0000 7feaa5415740 1 Processor -- start 2024-09-19T09:03:24.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.454+0000 7feaa5415740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eeb78365d0 0x55eeb78451b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:24.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.454+0000 7feaa5415740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eeb7837b40 0x55eeb7842460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:24.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.454+0000 7feaa5415740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eeb7845780 0x55eeb7842bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:24.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.454+0000 7feaa5415740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55eeb7848420 con 0x55eeb7837b40 2024-09-19T09:03:24.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.454+0000 7feaa5415740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55eeb7757060 con 0x55eeb78365d0 2024-09-19T09:03:24.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.454+0000 7feaa5415740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55eeb78485a0 con 0x55eeb7845780 2024-09-19T09:03:24.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.454+0000 7feaa5415740 10 client.0 _ll_register_callbacks cb 0x55eeb74aa8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:24.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.454+0000 7fea9bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eeb7837b40 0x55eeb7842460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:24.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.454+0000 7fea9bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eeb7837b40 0x55eeb7842460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48320/0 (socket says 172.21.15.92:48320) 2024-09-19T09:03:24.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.454+0000 7fea9bfff640 1 -- 172.21.15.92:0/1764595082 learned_addr learned my addr 172.21.15.92:0/1764595082 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:24.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.454+0000 7feaa0dd8640 1 --2- 172.21.15.92:0/1764595082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eeb78365d0 0x55eeb78451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:24.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.454+0000 7feaa15d9640 1 --2- 172.21.15.92:0/1764595082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eeb7845780 0x55eeb7842bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:24.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.454+0000 7fea9bfff640 1 -- 172.21.15.92:0/1764595082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eeb7845780 msgr2=0x55eeb7842bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:24.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.454+0000 7fea9bfff640 1 --2- 172.21.15.92:0/1764595082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eeb7845780 0x55eeb7842bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.454+0000 7fea9bfff640 1 -- 172.21.15.92:0/1764595082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eeb78365d0 msgr2=0x55eeb78451b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:24.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.454+0000 7fea9bfff640 1 --2- 172.21.15.92:0/1764595082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eeb78365d0 0x55eeb78451b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.454+0000 7fea9bfff640 1 -- 172.21.15.92:0/1764595082 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eeb750d3c0 con 0x55eeb7837b40 2024-09-19T09:03:24.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.454+0000 7feaa15d9640 1 --2- 172.21.15.92:0/1764595082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eeb7845780 0x55eeb7842bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:24.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.454+0000 7fea9bfff640 1 --2- 172.21.15.92:0/1764595082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eeb7837b40 0x55eeb7842460 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fea88012040 tx=0x7fea880047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a725fa58c01a2b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:24.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.454+0000 7fea7bfff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:03:24.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.454+0000 7fea7bfff640 1 -- 172.21.15.92:0/1764595082 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8801e040 con 0x55eeb7837b40 2024-09-19T09:03:24.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.454+0000 7fea7bfff640 1 -- 172.21.15.92:0/1764595082 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fea88097350 con 0x55eeb7837b40 2024-09-19T09:03:24.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.454+0000 7feaa5415740 1 -- 172.21.15.92:0/1764595082 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea94036040 con 0x55eeb7837b40 2024-09-19T09:03:24.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.455+0000 7fea7bfff640 1 -- 172.21.15.92:0/1764595082 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fea8809f090 con 0x55eeb7837b40 2024-09-19T09:03:24.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.455+0000 7feaa5415740 10 client.16872 fetch_fsmap learned FSMap version 19 2024-09-19T09:03:24.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.455+0000 7feaa5415740 1 -- 172.21.15.92:0/1764595082 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55eeb7853ed0 con 0x55eeb7837b40 2024-09-19T09:03:24.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.455+0000 7fea7bfff640 1 -- 172.21.15.92:0/1764595082 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea94036040 con 0x55eeb7837b40 2024-09-19T09:03:24.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.455+0000 7fea7bfff640 1 -- 172.21.15.92:0/1764595082 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fea880b2030 con 0x55eeb7837b40 2024-09-19T09:03:24.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.455+0000 7feaa5415740 10 client.16872 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:03:24.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.455+0000 7feaa5415740 10 client.16872 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:03:24.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.455+0000 7feaa5415740 20 client.16872 populate_metadata read hostname 'smithi092' 2024-09-19T09:03:24.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.455+0000 7feaa5415740 1 --2- 172.21.15.92:0/1764595082 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55eeb7855330 0x55eeb7857740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:24.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.455+0000 7feaa5415740 4 client.16872 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:24.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.455+0000 7feaa5415740 1 -- 172.21.15.92:0/1764595082 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eeb77a9860 con 0x55eeb7855330 2024-09-19T09:03:24.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.455+0000 7feaa0dd8640 1 --2- 172.21.15.92:0/1764595082 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55eeb7855330 0x55eeb7857740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:24.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.456+0000 7feaa0dd8640 1 --2- 172.21.15.92:0/1764595082 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55eeb7855330 0x55eeb7857740 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2fac85851069bfc server_cookie=e6c57dd1c47c51e8 in_seq=0 out_seq=0 2024-09-19T09:03:24.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.456+0000 7fea7bfff640 10 client.16872 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:24.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.456+0000 7fea7bfff640 1 -- 172.21.15.92:0/1764595082 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eeb77a9860 con 0x55eeb7855330 2024-09-19T09:03:24.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.456+0000 7fea7bfff640 10 client.16872 handle_command_reply: tid=0 2024-09-19T09:03:24.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.457+0000 7feaa5415740 1 client.16872 shutdown 2024-09-19T09:03:24.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.457+0000 7feaa5415740 1 -- 172.21.15.92:0/1764595082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eeb7837b40 msgr2=0x55eeb7842460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:24.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.457+0000 7feaa5415740 1 --2- 172.21.15.92:0/1764595082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eeb7837b40 0x55eeb7842460 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fea88012040 tx=0x7fea880047d0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.457+0000 7feaa5415740 1 -- 172.21.15.92:0/1764595082 shutdown_connections 2024-09-19T09:03:24.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.457+0000 7feaa5415740 1 --2- 172.21.15.92:0/1764595082 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55eeb7855330 0x55eeb7857740 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.457+0000 7feaa5415740 1 --2- 172.21.15.92:0/1764595082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eeb7845780 0x55eeb7842bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.457+0000 7feaa5415740 1 --2- 172.21.15.92:0/1764595082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eeb7837b40 0x55eeb7842460 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.457+0000 7fea7bfff640 0 client.16872 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:24.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.457+0000 7feaa5415740 1 --2- 172.21.15.92:0/1764595082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eeb78365d0 0x55eeb78451b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.457+0000 7feaa5415740 1 -- 172.21.15.92:0/1764595082 >> 172.21.15.92:0/1764595082 conn(0x55eeb77ff310 msgr2=0x55eeb7838960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:24.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.457+0000 7feaa5415740 1 -- 172.21.15.92:0/1764595082 shutdown_connections 2024-09-19T09:03:24.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.457+0000 7feaa5415740 1 -- 172.21.15.92:0/1764595082 wait complete. 2024-09-19T09:03:24.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.457+0000 7feaa5415740 20 client.16872 trim_cache size 0 max 16384 2024-09-19T09:03:24.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.470+0000 7feaa5415740 1 Processor -- start 2024-09-19T09:03:24.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.470+0000 7feaa5415740 1 -- start start 2024-09-19T09:03:24.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.470+0000 7feaa5415740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eeb78365d0 0x55eeb785d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:24.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.470+0000 7feaa5415740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eeb7837b40 0x55eeb785d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:24.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.470+0000 7feaa5415740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eeb7845780 0x55eeb783f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:24.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.470+0000 7feaa5415740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fea9c1a9410 con 0x55eeb7845780 2024-09-19T09:03:24.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.470+0000 7feaa5415740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fea9c1abcb0 con 0x55eeb78365d0 2024-09-19T09:03:24.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.470+0000 7feaa5415740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fea9c1a9aa0 con 0x55eeb7837b40 2024-09-19T09:03:24.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.470+0000 7feaa15d9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eeb7845780 0x55eeb783f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:24.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.470+0000 7feaa15d9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eeb7845780 0x55eeb783f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48322/0 (socket says 172.21.15.92:48322) 2024-09-19T09:03:24.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.470+0000 7feaa15d9640 1 -- 172.21.15.92:0/454332621 learned_addr learned my addr 172.21.15.92:0/454332621 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:24.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.470+0000 7feaa15d9640 1 -- 172.21.15.92:0/454332621 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eeb7837b40 msgr2=0x55eeb785d550 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:03:24.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.470+0000 7feaa15d9640 1 --2- 172.21.15.92:0/454332621 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eeb7837b40 0x55eeb785d550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.470+0000 7feaa15d9640 1 -- 172.21.15.92:0/454332621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eeb78365d0 msgr2=0x55eeb785d010 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:03:24.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.470+0000 7feaa15d9640 1 --2- 172.21.15.92:0/454332621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eeb78365d0 0x55eeb785d010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.470+0000 7feaa15d9640 1 -- 172.21.15.92:0/454332621 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeb7847ee0 con 0x55eeb7845780 2024-09-19T09:03:24.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.470+0000 7feaa15d9640 1 --2- 172.21.15.92:0/454332621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eeb7845780 0x55eeb783f740 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fea94005ef0 tx=0x7fea94005f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8389d6290e713552 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:24.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.470+0000 7fea867fc640 1 -- 172.21.15.92:0/454332621 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea94058070 con 0x55eeb7845780 2024-09-19T09:03:24.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.471+0000 7fea867fc640 1 -- 172.21.15.92:0/454332621 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea94036040 con 0x55eeb7845780 2024-09-19T09:03:24.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.471+0000 7fea867fc640 1 -- 172.21.15.92:0/454332621 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9404e040 con 0x55eeb7845780 2024-09-19T09:03:24.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.471+0000 7feaa5415740 1 -- 172.21.15.92:0/454332621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eeb7845780 msgr2=0x55eeb783f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:24.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.471+0000 7feaa5415740 1 --2- 172.21.15.92:0/454332621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eeb7845780 0x55eeb783f740 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fea94005ef0 tx=0x7fea94005f20 comp rx=0 tx=0).stop 2024-09-19T09:03:24.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.471+0000 7feaa5415740 1 -- 172.21.15.92:0/454332621 shutdown_connections 2024-09-19T09:03:24.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.471+0000 7feaa5415740 1 --2- 172.21.15.92:0/454332621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eeb7845780 0x55eeb783f740 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.471+0000 7feaa5415740 1 --2- 172.21.15.92:0/454332621 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eeb7837b40 0x55eeb785d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.471+0000 7feaa5415740 1 --2- 172.21.15.92:0/454332621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eeb78365d0 0x55eeb785d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.471+0000 7feaa5415740 1 -- 172.21.15.92:0/454332621 >> 172.21.15.92:0/454332621 conn(0x55eeb77ff310 msgr2=0x55eeb78415b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:24.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.471+0000 7feaa5415740 1 -- 172.21.15.92:0/454332621 shutdown_connections 2024-09-19T09:03:24.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.471+0000 7feaa5415740 1 -- 172.21.15.92:0/454332621 wait complete. 2024-09-19T09:03:24.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.471+0000 7feaa5415740 1 -- start start 2024-09-19T09:03:24.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.472+0000 7feaa5415740 1 Processor -- start 2024-09-19T09:03:24.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.472+0000 7feaa5415740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eeb78365d0 0x55eeb784d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:24.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.472+0000 7feaa5415740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eeb7837b40 0x55eeb784dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:24.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.472+0000 7feaa5415740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eeb7845780 0x55eeb784a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:24.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.472+0000 7feaa5415740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fea9c1aa170 con 0x55eeb7837b40 2024-09-19T09:03:24.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.472+0000 7feaa5415740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fea9c1ab5e0 con 0x55eeb78365d0 2024-09-19T09:03:24.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.472+0000 7feaa5415740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fea9c1aa840 con 0x55eeb7845780 2024-09-19T09:03:24.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.472+0000 7feaa5415740 10 client.0 _ll_register_callbacks cb 0x7fea880092b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:24.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.472+0000 7fea9bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eeb7837b40 0x55eeb784dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:24.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.472+0000 7fea9bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eeb7837b40 0x55eeb784dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48332/0 (socket says 172.21.15.92:48332) 2024-09-19T09:03:24.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.472+0000 7fea9bfff640 1 -- 172.21.15.92:0/1495491104 learned_addr learned my addr 172.21.15.92:0/1495491104 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:24.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.472+0000 7feaa0dd8640 1 --2- 172.21.15.92:0/1495491104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eeb78365d0 0x55eeb784d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:24.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.472+0000 7feaa15d9640 1 --2- 172.21.15.92:0/1495491104 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eeb7845780 0x55eeb784a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:24.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.472+0000 7fea9bfff640 1 -- 172.21.15.92:0/1495491104 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eeb7845780 msgr2=0x55eeb784a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:24.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.472+0000 7fea9bfff640 1 --2- 172.21.15.92:0/1495491104 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eeb7845780 0x55eeb784a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.472+0000 7fea9bfff640 1 -- 172.21.15.92:0/1495491104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eeb78365d0 msgr2=0x55eeb784d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:24.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.472+0000 7fea9bfff640 1 --2- 172.21.15.92:0/1495491104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eeb78365d0 0x55eeb784d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.472+0000 7fea9bfff640 1 -- 172.21.15.92:0/1495491104 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eeb784e3e0 con 0x55eeb7837b40 2024-09-19T09:03:24.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.472+0000 7feaa0dd8640 1 --2- 172.21.15.92:0/1495491104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eeb78365d0 0x55eeb784d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:24.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.472+0000 7feaa15d9640 1 --2- 172.21.15.92:0/1495491104 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eeb7845780 0x55eeb784a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:24.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.473+0000 7fea9bfff640 1 --2- 172.21.15.92:0/1495491104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eeb7837b40 0x55eeb784dd70 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fea8809a9e0 tx=0x7fea88017590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d6d4665ac9d4dcb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:24.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.473+0000 7fea7bfff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:03:24.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.473+0000 7fea7bfff640 1 -- 172.21.15.92:0/1495491104 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8801e070 con 0x55eeb7837b40 2024-09-19T09:03:24.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.473+0000 7fea7bfff640 1 -- 172.21.15.92:0/1495491104 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fea8809a130 con 0x55eeb7837b40 2024-09-19T09:03:24.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.473+0000 7feaa5415740 1 -- 172.21.15.92:0/1495491104 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea94036040 con 0x55eeb7837b40 2024-09-19T09:03:24.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.473+0000 7fea7bfff640 1 -- 172.21.15.92:0/1495491104 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fea8809a820 con 0x55eeb7837b40 2024-09-19T09:03:24.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.473+0000 7feaa5415740 10 client.16878 fetch_fsmap learned FSMap version 19 2024-09-19T09:03:24.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.473+0000 7feaa5415740 1 -- 172.21.15.92:0/1495491104 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55eeb78c0560 con 0x55eeb7837b40 2024-09-19T09:03:24.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.473+0000 7fea7bfff640 1 -- 172.21.15.92:0/1495491104 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea94036040 con 0x55eeb7837b40 2024-09-19T09:03:24.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.473+0000 7fea7bfff640 1 -- 172.21.15.92:0/1495491104 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fea880b2070 con 0x55eeb7837b40 2024-09-19T09:03:24.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.473+0000 7feaa5415740 10 client.16878 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:03:24.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.473+0000 7feaa5415740 10 client.16878 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:03:24.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.473+0000 7feaa5415740 20 client.16878 populate_metadata read hostname 'smithi092' 2024-09-19T09:03:24.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.473+0000 7feaa5415740 1 --2- 172.21.15.92:0/1495491104 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55eeb78c0b30 0x55eeb78c2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:24.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.473+0000 7feaa5415740 4 client.16878 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:03:24.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.473+0000 7feaa5415740 1 -- 172.21.15.92:0/1495491104 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55eeb77a3d70 con 0x55eeb78c0b30 2024-09-19T09:03:24.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.474+0000 7feaa0dd8640 1 --2- 172.21.15.92:0/1495491104 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55eeb78c0b30 0x55eeb78c2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:24.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.474+0000 7feaa0dd8640 1 --2- 172.21.15.92:0/1495491104 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55eeb78c0b30 0x55eeb78c2f50 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf73fef43301a1c0 server_cookie=8c7db688f0c13a41 in_seq=0 out_seq=0 2024-09-19T09:03:24.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.474+0000 7fea7bfff640 10 client.16878 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:24.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.474+0000 7fea7bfff640 1 -- 172.21.15.92:0/1495491104 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55eeb77a3d70 con 0x55eeb78c0b30 2024-09-19T09:03:24.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.474+0000 7fea7bfff640 10 client.16878 handle_command_reply: tid=0 2024-09-19T09:03:24.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.474+0000 7feaa5415740 1 client.16878 shutdown 2024-09-19T09:03:24.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.474+0000 7feaa5415740 1 -- 172.21.15.92:0/1495491104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eeb7837b40 msgr2=0x55eeb784dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:24.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.474+0000 7feaa5415740 1 --2- 172.21.15.92:0/1495491104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eeb7837b40 0x55eeb784dd70 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fea8809a9e0 tx=0x7fea88017590 comp rx=0 tx=0).stop 2024-09-19T09:03:24.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.474+0000 7feaa5415740 1 -- 172.21.15.92:0/1495491104 shutdown_connections 2024-09-19T09:03:24.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.474+0000 7feaa5415740 1 --2- 172.21.15.92:0/1495491104 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55eeb78c0b30 0x55eeb78c2f50 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.474+0000 7feaa5415740 1 --2- 172.21.15.92:0/1495491104 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eeb7845780 0x55eeb784a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.474+0000 7fea7bfff640 0 client.16878 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:24.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.474+0000 7feaa5415740 1 --2- 172.21.15.92:0/1495491104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eeb7837b40 0x55eeb784dd70 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.474+0000 7feaa5415740 1 --2- 172.21.15.92:0/1495491104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eeb78365d0 0x55eeb784d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.474+0000 7feaa5415740 1 -- 172.21.15.92:0/1495491104 >> 172.21.15.92:0/1495491104 conn(0x55eeb77ff310 msgr2=0x55eeb7843cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:24.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.475+0000 7feaa5415740 1 -- 172.21.15.92:0/1495491104 shutdown_connections 2024-09-19T09:03:24.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.475+0000 7feaa5415740 1 -- 172.21.15.92:0/1495491104 wait complete. 2024-09-19T09:03:24.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.475+0000 7feaa5415740 20 client.16878 trim_cache size 0 max 16384 2024-09-19T09:03:24.484 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-19T09:03:24.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.475+0000 7feaa303c640 1 -- 172.21.15.92:0/2941165271 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fea8c0a32c0 msgr2=0x7fea8c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:24.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.475+0000 7feaa303c640 1 --2- 172.21.15.92:0/2941165271 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fea8c0a32c0 0x7fea8c0a5780 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fea94031da0 tx=0x7fea94048000 comp rx=0 tx=0).stop 2024-09-19T09:03:24.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.475+0000 7feaa303c640 1 -- 172.21.15.92:0/2941165271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea9c101420 msgr2=0x7fea9c198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:24.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.475+0000 7feaa303c640 1 --2- 172.21.15.92:0/2941165271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea9c101420 0x7fea9c198ae0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fea8800b4a0 tx=0x7fea8800b960 comp rx=0 tx=0).stop 2024-09-19T09:03:24.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.475+0000 7feaa303c640 1 -- 172.21.15.92:0/2941165271 shutdown_connections 2024-09-19T09:03:24.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.475+0000 7feaa303c640 1 --2- 172.21.15.92:0/2941165271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea9c106a80 0x7fea9c19ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.475+0000 7feaa303c640 1 --2- 172.21.15.92:0/2941165271 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fea8c0a32c0 0x7fea8c0a5780 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.475+0000 7feaa303c640 1 --2- 172.21.15.92:0/2941165271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea9c101420 0x7fea9c198ae0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.475+0000 7feaa303c640 1 --2- 172.21.15.92:0/2941165271 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea9c100a80 0x7fea9c1985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.475+0000 7feaa303c640 1 -- 172.21.15.92:0/2941165271 >> 172.21.15.92:0/2941165271 conn(0x7fea9c0fc7a0 msgr2=0x7fea9c0fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:24.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.475+0000 7feaa303c640 1 -- 172.21.15.92:0/2941165271 shutdown_connections 2024-09-19T09:03:24.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:24.475+0000 7feaa303c640 1 -- 172.21.15.92:0/2941165271 wait complete. 2024-09-19T09:03:25.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:25 smithi092 ceph-mon[31407]: pgmap v538: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.7 MiB/s wr, 727 op/s 2024-09-19T09:03:25.798 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 400.0 s, 468.8 tps, lat 45.867 ms stddev 47.030 2024-09-19T09:03:25.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:25 smithi167 ceph-mon[35359]: pgmap v538: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.7 MiB/s wr, 727 op/s 2024-09-19T09:03:25.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:25 smithi190 ceph-mon[35358]: pgmap v538: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.7 MiB/s wr, 727 op/s 2024-09-19T09:03:26.196 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:03:26.197 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:03:26.446 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:26.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.964+0000 7f664e36e640 1 -- 172.21.15.92:0/999550020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6648106b80 msgr2=0x7f6648106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:26.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.964+0000 7f664e36e640 1 --2- 172.21.15.92:0/999550020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6648106b80 0x7f6648106f60 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f6638009900 tx=0x7f663802a410 comp rx=0 tx=0).stop 2024-09-19T09:03:26.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.964+0000 7f664e36e640 1 -- 172.21.15.92:0/999550020 shutdown_connections 2024-09-19T09:03:26.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.964+0000 7f664e36e640 1 --2- 172.21.15.92:0/999550020 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6648100aa0 0x7f664810ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.964+0000 7f664e36e640 1 --2- 172.21.15.92:0/999550020 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6648100100 0x7f6648100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.964+0000 7f664e36e640 1 --2- 172.21.15.92:0/999550020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6648106b80 0x7f6648106f60 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.964+0000 7f664e36e640 1 -- 172.21.15.92:0/999550020 >> 172.21.15.92:0/999550020 conn(0x7f6648077230 msgr2=0x7f66480fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:26.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.964+0000 7f664e36e640 1 -- 172.21.15.92:0/999550020 shutdown_connections 2024-09-19T09:03:26.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.964+0000 7f664e36e640 1 -- 172.21.15.92:0/999550020 wait complete. 2024-09-19T09:03:26.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.965+0000 7f664e36e640 1 Processor -- start 2024-09-19T09:03:26.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.965+0000 7f664e36e640 1 -- start start 2024-09-19T09:03:26.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.965+0000 7f664e36e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6648100100 0x7f664819a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:26.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.965+0000 7f664e36e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6648100aa0 0x7f664819ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:26.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.965+0000 7f664e36e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6648106b80 0x7f664819efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:26.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.965+0000 7f664e36e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6648112050 con 0x7f6648106b80 2024-09-19T09:03:26.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.965+0000 7f664e36e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6648111ed0 con 0x7f6648100100 2024-09-19T09:03:26.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.965+0000 7f664e36e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f66481121d0 con 0x7f6648100aa0 2024-09-19T09:03:26.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.965+0000 7f664c90b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6648106b80 0x7f664819efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:26.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.965+0000 7f664c90b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6648106b80 0x7f664819efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48346/0 (socket says 172.21.15.92:48346) 2024-09-19T09:03:26.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.965+0000 7f664c90b640 1 -- 172.21.15.92:0/764716108 learned_addr learned my addr 172.21.15.92:0/764716108 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:26.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.965+0000 7f6647fff640 1 --2- 172.21.15.92:0/764716108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6648100100 0x7f664819a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:26.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.965+0000 7f663ffff640 1 --2- 172.21.15.92:0/764716108 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6648100aa0 0x7f664819ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:26.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.966+0000 7f664c90b640 1 -- 172.21.15.92:0/764716108 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6648100aa0 msgr2=0x7f664819ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:26.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.966+0000 7f664c90b640 1 --2- 172.21.15.92:0/764716108 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6648100aa0 0x7f664819ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.966+0000 7f664c90b640 1 -- 172.21.15.92:0/764716108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6648100100 msgr2=0x7f664819a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:26.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.966+0000 7f664c90b640 1 --2- 172.21.15.92:0/764716108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6648100100 0x7f664819a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.966+0000 7f664c90b640 1 -- 172.21.15.92:0/764716108 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f664819f680 con 0x7f6648106b80 2024-09-19T09:03:26.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.966+0000 7f664c90b640 1 --2- 172.21.15.92:0/764716108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6648106b80 0x7f664819efa0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f664000cad0 tx=0x7f664000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:26.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.966+0000 7f6645ffb640 1 -- 172.21.15.92:0/764716108 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664000ae20 con 0x7f6648106b80 2024-09-19T09:03:26.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.966+0000 7f664e36e640 1 -- 172.21.15.92:0/764716108 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f664819f970 con 0x7f6648106b80 2024-09-19T09:03:26.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.966+0000 7f6645ffb640 1 -- 172.21.15.92:0/764716108 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6640004030 con 0x7f6648106b80 2024-09-19T09:03:26.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.966+0000 7f6645ffb640 1 -- 172.21.15.92:0/764716108 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664000f7c0 con 0x7f6648106b80 2024-09-19T09:03:26.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.966+0000 7f664e36e640 1 -- 172.21.15.92:0/764716108 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66481a7250 con 0x7f6648106b80 2024-09-19T09:03:26.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.969+0000 7f6645ffb640 1 -- 172.21.15.92:0/764716108 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f66400041e0 con 0x7f6648106b80 2024-09-19T09:03:26.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.969+0000 7f6650747740 1 Processor -- start 2024-09-19T09:03:26.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.969+0000 7f6650747740 1 -- start start 2024-09-19T09:03:26.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.969+0000 7f6650747740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab70755b60 0x55ab70755f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:26.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.969+0000 7f6650747740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab70756480 0x55ab70760800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:26.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.969+0000 7f6650747740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab70760d40 0x55ab70763130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:26.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.969+0000 7f6650747740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ab706bb280 con 0x55ab70755b60 2024-09-19T09:03:26.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.969+0000 7f6650747740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ab70662b10 con 0x55ab70756480 2024-09-19T09:03:26.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.969+0000 7f6650747740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ab706b7240 con 0x55ab70760d40 2024-09-19T09:03:26.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.969+0000 7f663ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab70755b60 0x55ab70755f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:26.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.970+0000 7f663ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab70755b60 0x55ab70755f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48352/0 (socket says 172.21.15.92:48352) 2024-09-19T09:03:26.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.970+0000 7f663ffff640 1 -- 172.21.15.92:0/1598066289 learned_addr learned my addr 172.21.15.92:0/1598066289 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:26.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.970+0000 7f6647fff640 1 --2- 172.21.15.92:0/1598066289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab70756480 0x55ab70760800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:26.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.970+0000 7f663ffff640 1 --2- 172.21.15.92:0/1598066289 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab70760d40 0x55ab70763130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:26.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.970+0000 7f663ffff640 1 -- 172.21.15.92:0/1598066289 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab70760d40 msgr2=0x55ab70763130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:26.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.970+0000 7f663ffff640 1 --2- 172.21.15.92:0/1598066289 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab70760d40 0x55ab70763130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.970+0000 7f663ffff640 1 -- 172.21.15.92:0/1598066289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab70756480 msgr2=0x55ab70760800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:26.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.970+0000 7f663ffff640 1 --2- 172.21.15.92:0/1598066289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab70756480 0x55ab70760800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.970+0000 7f6645ffb640 1 --2- 172.21.15.92:0/764716108 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f66340a32c0 0x7f66340a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:26.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.970+0000 7f663ffff640 1 -- 172.21.15.92:0/1598066289 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab7066f1f0 con 0x55ab70755b60 2024-09-19T09:03:26.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.970+0000 7f6645ffb640 1 -- 172.21.15.92:0/764716108 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f66400cfb60 con 0x7f6648106b80 2024-09-19T09:03:26.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.970+0000 7f663ffff640 1 --2- 172.21.15.92:0/1598066289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab70755b60 0x55ab70755f40 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f66300058a0 tx=0x7f663000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e2e3ce2c2a9b80 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:26.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.970+0000 7f663ffff640 1 --2- 172.21.15.92:0/764716108 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f66340a32c0 0x7f66340a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:26.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.970+0000 7f663e7fc640 1 -- 172.21.15.92:0/1598066289 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6630010460 con 0x55ab70755b60 2024-09-19T09:03:26.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.970+0000 7f663e7fc640 1 -- 172.21.15.92:0/1598066289 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6630010ca0 con 0x55ab70755b60 2024-09-19T09:03:26.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.970+0000 7f663e7fc640 1 -- 172.21.15.92:0/1598066289 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663001e650 con 0x55ab70755b60 2024-09-19T09:03:26.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.971+0000 7f6650747740 1 -- 172.21.15.92:0/1598066289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab70755b60 msgr2=0x55ab70755f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:26.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.971+0000 7f663ffff640 1 --2- 172.21.15.92:0/764716108 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f66340a32c0 0x7f66340a5780 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f66300059f0 tx=0x7f663001e9a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:26.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.971+0000 7f6650747740 1 --2- 172.21.15.92:0/1598066289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab70755b60 0x55ab70755f40 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f66300058a0 tx=0x7f663000b840 comp rx=0 tx=0).stop 2024-09-19T09:03:26.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.971+0000 7f6650747740 1 -- 172.21.15.92:0/1598066289 shutdown_connections 2024-09-19T09:03:26.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.971+0000 7f6650747740 1 --2- 172.21.15.92:0/1598066289 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab70760d40 0x55ab70763130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.971+0000 7f6650747740 1 --2- 172.21.15.92:0/1598066289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab70756480 0x55ab70760800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.971+0000 7f6650747740 1 --2- 172.21.15.92:0/1598066289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab70755b60 0x55ab70755f40 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.971+0000 7f6650747740 1 -- 172.21.15.92:0/1598066289 >> 172.21.15.92:0/1598066289 conn(0x55ab707520f0 msgr2=0x55ab707524d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:26.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.971+0000 7f6650747740 1 -- 172.21.15.92:0/1598066289 shutdown_connections 2024-09-19T09:03:26.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.971+0000 7f6650747740 1 -- 172.21.15.92:0/1598066289 wait complete. 2024-09-19T09:03:26.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.971+0000 7f6650747740 1 -- start start 2024-09-19T09:03:26.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.972+0000 7f6650747740 1 Processor -- start 2024-09-19T09:03:26.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.972+0000 7f6650747740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab70755b60 0x55ab707607f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:26.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.972+0000 7f6650747740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab70756480 0x55ab7075db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:26.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.972+0000 7f6650747740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab70760d40 0x55ab7075e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:26.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.972+0000 7f6650747740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ab70763910 con 0x55ab70755b60 2024-09-19T09:03:26.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.972+0000 7f6650747740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ab70675f10 con 0x55ab70756480 2024-09-19T09:03:26.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.972+0000 7f6650747740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ab70763a90 con 0x55ab70760d40 2024-09-19T09:03:26.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.972+0000 7f6650747740 10 client.0 _ll_register_callbacks cb 0x55ab7063ea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:26.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.972+0000 7f6647fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab70755b60 0x55ab707607f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:26.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.972+0000 7f6647fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab70755b60 0x55ab707607f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48368/0 (socket says 172.21.15.92:48368) 2024-09-19T09:03:26.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.972+0000 7f6647fff640 1 -- 172.21.15.92:0/3554588280 learned_addr learned my addr 172.21.15.92:0/3554588280 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:26.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.972+0000 7f664c90b640 1 --2- 172.21.15.92:0/3554588280 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab70760d40 0x55ab7075e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:26.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.972+0000 7f663ffff640 1 --2- 172.21.15.92:0/3554588280 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab70756480 0x55ab7075db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:26.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.972+0000 7f6647fff640 1 -- 172.21.15.92:0/3554588280 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab70760d40 msgr2=0x55ab7075e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:26.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.972+0000 7f6647fff640 1 --2- 172.21.15.92:0/3554588280 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab70760d40 0x55ab7075e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.972+0000 7f6647fff640 1 -- 172.21.15.92:0/3554588280 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab70756480 msgr2=0x55ab7075db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:26.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.972+0000 7f6647fff640 1 --2- 172.21.15.92:0/3554588280 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab70756480 0x55ab7075db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.972+0000 7f6647fff640 1 -- 172.21.15.92:0/3554588280 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab7042c6a0 con 0x55ab70755b60 2024-09-19T09:03:26.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.972+0000 7f663ffff640 1 --2- 172.21.15.92:0/3554588280 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab70756480 0x55ab7075db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:26.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.973+0000 7f6647fff640 1 --2- 172.21.15.92:0/3554588280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab70755b60 0x55ab707607f0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f6638009900 tx=0x7f66380319b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cf78ac56b9389bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:26.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.973+0000 7f66277fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:03:26.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.973+0000 7f66277fe640 1 -- 172.21.15.92:0/3554588280 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6638035040 con 0x55ab70755b60 2024-09-19T09:03:26.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.973+0000 7f66277fe640 1 -- 172.21.15.92:0/3554588280 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f6638004300 con 0x55ab70755b60 2024-09-19T09:03:26.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.973+0000 7f6650747740 1 -- 172.21.15.92:0/3554588280 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6630010ca0 con 0x55ab70755b60 2024-09-19T09:03:26.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.973+0000 7f66277fe640 1 -- 172.21.15.92:0/3554588280 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6638005020 con 0x55ab70755b60 2024-09-19T09:03:26.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.973+0000 7f6650747740 10 client.16890 fetch_fsmap learned FSMap version 19 2024-09-19T09:03:26.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.973+0000 7f6650747740 1 -- 172.21.15.92:0/3554588280 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ab7076f440 con 0x55ab70755b60 2024-09-19T09:03:26.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.973+0000 7f66277fe640 1 -- 172.21.15.92:0/3554588280 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6630010ca0 con 0x55ab70755b60 2024-09-19T09:03:26.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.973+0000 7f66277fe640 1 -- 172.21.15.92:0/3554588280 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f66380035f0 con 0x55ab70755b60 2024-09-19T09:03:26.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.973+0000 7f6650747740 10 client.16890 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:03:26.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.973+0000 7f6650747740 10 client.16890 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:03:26.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.973+0000 7f6650747740 20 client.16890 populate_metadata read hostname 'smithi092' 2024-09-19T09:03:26.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.973+0000 7f6650747740 1 --2- 172.21.15.92:0/3554588280 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ab70770900 0x55ab70772dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:26.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.973+0000 7f6650747740 4 client.16890 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:26.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.973+0000 7f6650747740 1 -- 172.21.15.92:0/3554588280 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab706c87f0 con 0x55ab70770900 2024-09-19T09:03:26.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.974+0000 7f663ffff640 1 --2- 172.21.15.92:0/3554588280 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ab70770900 0x55ab70772dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:26.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.974+0000 7f663ffff640 1 --2- 172.21.15.92:0/3554588280 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ab70770900 0x55ab70772dc0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b94f6a9934a6437 server_cookie=e5cd856d98b35802 in_seq=0 out_seq=0 2024-09-19T09:03:26.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.974+0000 7f66277fe640 10 client.16890 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:26.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.975+0000 7f66277fe640 1 -- 172.21.15.92:0/3554588280 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ab706c87f0 con 0x55ab70770900 2024-09-19T09:03:26.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.975+0000 7f66277fe640 10 client.16890 handle_command_reply: tid=0 2024-09-19T09:03:26.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.975+0000 7f6650747740 1 client.16890 shutdown 2024-09-19T09:03:26.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.975+0000 7f6650747740 1 -- 172.21.15.92:0/3554588280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab70755b60 msgr2=0x55ab707607f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:26.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.975+0000 7f6650747740 1 --2- 172.21.15.92:0/3554588280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab70755b60 0x55ab707607f0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f6638009900 tx=0x7f66380319b0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.975+0000 7f6650747740 1 -- 172.21.15.92:0/3554588280 shutdown_connections 2024-09-19T09:03:26.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.975+0000 7f6650747740 1 --2- 172.21.15.92:0/3554588280 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ab70770900 0x55ab70772dc0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.975+0000 7f6650747740 1 --2- 172.21.15.92:0/3554588280 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab70760d40 0x55ab7075e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.975+0000 7f6650747740 1 --2- 172.21.15.92:0/3554588280 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab70756480 0x55ab7075db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.975+0000 7f6650747740 1 --2- 172.21.15.92:0/3554588280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab70755b60 0x55ab707607f0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.975+0000 7f66277fe640 0 client.16890 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:26.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.975+0000 7f6650747740 1 -- 172.21.15.92:0/3554588280 >> 172.21.15.92:0/3554588280 conn(0x55ab707520f0 msgr2=0x55ab70757e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:26.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.975+0000 7f6650747740 1 -- 172.21.15.92:0/3554588280 shutdown_connections 2024-09-19T09:03:26.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.975+0000 7f6650747740 1 -- 172.21.15.92:0/3554588280 wait complete. 2024-09-19T09:03:26.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.975+0000 7f6650747740 20 client.16890 trim_cache size 0 max 16384 2024-09-19T09:03:26.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.993+0000 7f6650747740 1 Processor -- start 2024-09-19T09:03:26.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.993+0000 7f6650747740 1 -- start start 2024-09-19T09:03:26.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.993+0000 7f6650747740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab70755b60 0x55ab7075cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:26.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.993+0000 7f6650747740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab70756480 0x55ab70778690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:26.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.993+0000 7f6650747740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab70760d40 0x55ab70778bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:26.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.993+0000 7f6650747740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f66481ad7e0 con 0x55ab70756480 2024-09-19T09:03:26.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.993+0000 7f6650747740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f66481b0080 con 0x55ab70760d40 2024-09-19T09:03:26.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.993+0000 7f6650747740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f66481ade70 con 0x55ab70755b60 2024-09-19T09:03:26.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.993+0000 7f663ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab70756480 0x55ab70778690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:26.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.993+0000 7f663ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab70756480 0x55ab70778690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48380/0 (socket says 172.21.15.92:48380) 2024-09-19T09:03:26.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.993+0000 7f663ffff640 1 -- 172.21.15.92:0/51616407 learned_addr learned my addr 172.21.15.92:0/51616407 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:26.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.993+0000 7f663ffff640 1 -- 172.21.15.92:0/51616407 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab70755b60 msgr2=0x55ab7075cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:26.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.993+0000 7f663ffff640 1 --2- 172.21.15.92:0/51616407 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab70755b60 0x55ab7075cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.993+0000 7f663ffff640 1 -- 172.21.15.92:0/51616407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab70760d40 msgr2=0x55ab70778bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:26.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.993+0000 7f663ffff640 1 --2- 172.21.15.92:0/51616407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab70760d40 0x55ab70778bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.993+0000 7f663ffff640 1 -- 172.21.15.92:0/51616407 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab7075e640 con 0x55ab70756480 2024-09-19T09:03:26.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.993+0000 7f663ffff640 1 --2- 172.21.15.92:0/51616407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab70756480 0x55ab70778690 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x55ab7075d3d0 tx=0x7f6630025000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6092bcb900fee3c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:26.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.994+0000 7f663dffb640 1 -- 172.21.15.92:0/51616407 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66300120d0 con 0x55ab70756480 2024-09-19T09:03:26.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.994+0000 7f663dffb640 1 -- 172.21.15.92:0/51616407 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f663003b020 con 0x55ab70756480 2024-09-19T09:03:26.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.994+0000 7f663dffb640 1 -- 172.21.15.92:0/51616407 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66300053d0 con 0x55ab70756480 2024-09-19T09:03:26.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.994+0000 7f6650747740 1 -- 172.21.15.92:0/51616407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab70756480 msgr2=0x55ab70778690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:26.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.994+0000 7f6650747740 1 --2- 172.21.15.92:0/51616407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab70756480 0x55ab70778690 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x55ab7075d3d0 tx=0x7f6630025000 comp rx=0 tx=0).stop 2024-09-19T09:03:26.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.994+0000 7f6650747740 1 -- 172.21.15.92:0/51616407 shutdown_connections 2024-09-19T09:03:26.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.994+0000 7f6650747740 1 --2- 172.21.15.92:0/51616407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab70760d40 0x55ab70778bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.994+0000 7f6650747740 1 --2- 172.21.15.92:0/51616407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab70756480 0x55ab70778690 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.994+0000 7f6650747740 1 --2- 172.21.15.92:0/51616407 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab70755b60 0x55ab7075cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.994+0000 7f6650747740 1 -- 172.21.15.92:0/51616407 >> 172.21.15.92:0/51616407 conn(0x55ab707520f0 msgr2=0x55ab7075c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:26.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.994+0000 7f6650747740 1 -- 172.21.15.92:0/51616407 shutdown_connections 2024-09-19T09:03:26.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.994+0000 7f6650747740 1 -- 172.21.15.92:0/51616407 wait complete. 2024-09-19T09:03:26.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.995+0000 7f6650747740 1 -- start start 2024-09-19T09:03:26.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.995+0000 7f6650747740 1 Processor -- start 2024-09-19T09:03:26.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.995+0000 7f6650747740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab70755b60 0x55ab70764950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:26.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.995+0000 7f6650747740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab70756480 0x55ab70764e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:26.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.995+0000 7f6650747740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab70760d40 0x55ab707653d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:26.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.995+0000 7f6650747740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f66481ae540 con 0x55ab70756480 2024-09-19T09:03:26.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.995+0000 7f6650747740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f66481af9b0 con 0x55ab70760d40 2024-09-19T09:03:26.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.995+0000 7f6650747740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f66481aec10 con 0x55ab70755b60 2024-09-19T09:03:26.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.995+0000 7f6650747740 10 client.0 _ll_register_callbacks cb 0x7f6638031640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:26.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.995+0000 7f663ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab70756480 0x55ab70764e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:26.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.995+0000 7f663ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab70756480 0x55ab70764e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48396/0 (socket says 172.21.15.92:48396) 2024-09-19T09:03:26.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.995+0000 7f663ffff640 1 -- 172.21.15.92:0/1067294388 learned_addr learned my addr 172.21.15.92:0/1067294388 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:26.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.995+0000 7f664c90b640 1 --2- 172.21.15.92:0/1067294388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab70760d40 0x55ab707653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:27.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.996+0000 7f6647fff640 1 --2- 172.21.15.92:0/1067294388 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab70755b60 0x55ab70764950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:27.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.996+0000 7f663ffff640 1 -- 172.21.15.92:0/1067294388 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab70755b60 msgr2=0x55ab70764950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:27.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.996+0000 7f663ffff640 1 --2- 172.21.15.92:0/1067294388 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab70755b60 0x55ab70764950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.996+0000 7f663ffff640 1 -- 172.21.15.92:0/1067294388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab70760d40 msgr2=0x55ab707653d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:27.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.996+0000 7f663ffff640 1 --2- 172.21.15.92:0/1067294388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab70760d40 0x55ab707653d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.996+0000 7f663ffff640 1 -- 172.21.15.92:0/1067294388 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab707da660 con 0x55ab70756480 2024-09-19T09:03:27.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.996+0000 7f663ffff640 1 --2- 172.21.15.92:0/1067294388 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab70756480 0x55ab70764e90 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f6630012450 tx=0x7f6630012530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ae562b3c7d21847 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:27.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.996+0000 7f66277fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:03:27.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.996+0000 7f66277fe640 1 -- 172.21.15.92:0/1067294388 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663001e3f0 con 0x55ab70756480 2024-09-19T09:03:27.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.996+0000 7f66277fe640 1 -- 172.21.15.92:0/1067294388 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f663001e590 con 0x55ab70756480 2024-09-19T09:03:27.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.996+0000 7f6650747740 1 -- 172.21.15.92:0/1067294388 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f663003b020 con 0x55ab70756480 2024-09-19T09:03:27.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.996+0000 7f66277fe640 1 -- 172.21.15.92:0/1067294388 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6630010460 con 0x55ab70756480 2024-09-19T09:03:27.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.996+0000 7f6650747740 10 client.16896 fetch_fsmap learned FSMap version 19 2024-09-19T09:03:27.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.996+0000 7f6650747740 1 -- 172.21.15.92:0/1067294388 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ab707db8a0 con 0x55ab70756480 2024-09-19T09:03:27.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.996+0000 7f66277fe640 1 -- 172.21.15.92:0/1067294388 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f663003b020 con 0x55ab70756480 2024-09-19T09:03:27.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.996+0000 7f66277fe640 1 -- 172.21.15.92:0/1067294388 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f6630049020 con 0x55ab70756480 2024-09-19T09:03:27.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.996+0000 7f6650747740 10 client.16896 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:03:27.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.996+0000 7f6650747740 10 client.16896 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:03:27.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.996+0000 7f6650747740 20 client.16896 populate_metadata read hostname 'smithi092' 2024-09-19T09:03:27.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.996+0000 7f6650747740 1 --2- 172.21.15.92:0/1067294388 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ab707dbdc0 0x55ab707de1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:27.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.997+0000 7f6650747740 4 client.16896 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:03:27.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.997+0000 7f6650747740 1 -- 172.21.15.92:0/1067294388 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ab706c2d00 con 0x55ab707dbdc0 2024-09-19T09:03:27.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.997+0000 7f6647fff640 1 --2- 172.21.15.92:0/1067294388 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ab707dbdc0 0x55ab707de1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:27.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.997+0000 7f66277fe640 10 client.16896 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:27.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.997+0000 7f6647fff640 1 --2- 172.21.15.92:0/1067294388 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ab707dbdc0 0x55ab707de1e0 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf46a0b60eaafbb6 server_cookie=13b848b8807bc4b6 in_seq=0 out_seq=0 2024-09-19T09:03:27.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.998+0000 7f66277fe640 1 -- 172.21.15.92:0/1067294388 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ab706c2d00 con 0x55ab707dbdc0 2024-09-19T09:03:27.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.998+0000 7f66277fe640 10 client.16896 handle_command_reply: tid=0 2024-09-19T09:03:27.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.998+0000 7f6650747740 1 client.16896 shutdown 2024-09-19T09:03:27.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.998+0000 7f6650747740 1 -- 172.21.15.92:0/1067294388 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab70756480 msgr2=0x55ab70764e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:27.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.998+0000 7f6650747740 1 --2- 172.21.15.92:0/1067294388 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab70756480 0x55ab70764e90 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f6630012450 tx=0x7f6630012530 comp rx=0 tx=0).stop 2024-09-19T09:03:27.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.998+0000 7f6650747740 1 -- 172.21.15.92:0/1067294388 shutdown_connections 2024-09-19T09:03:27.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.998+0000 7f6650747740 1 --2- 172.21.15.92:0/1067294388 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ab707dbdc0 0x55ab707de1e0 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.998+0000 7f6650747740 1 --2- 172.21.15.92:0/1067294388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab70760d40 0x55ab707653d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.998+0000 7f6650747740 1 --2- 172.21.15.92:0/1067294388 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab70756480 0x55ab70764e90 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.998+0000 7f66277fe640 0 client.16896 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:27.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.998+0000 7f6650747740 1 --2- 172.21.15.92:0/1067294388 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab70755b60 0x55ab70764950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.998+0000 7f6650747740 1 -- 172.21.15.92:0/1067294388 >> 172.21.15.92:0/1067294388 conn(0x55ab707520f0 msgr2=0x55ab7075cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:27.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.998+0000 7f6650747740 1 -- 172.21.15.92:0/1067294388 shutdown_connections 2024-09-19T09:03:27.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.998+0000 7f6650747740 1 -- 172.21.15.92:0/1067294388 wait complete. 2024-09-19T09:03:27.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.998+0000 7f6650747740 20 client.16896 trim_cache size 0 max 16384 2024-09-19T09:03:27.004 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:03:27.004 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-19T09:03:27.004 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "c6de2da4-4eb0-41ec-8458-19885aeb7d48", 2024-09-19T09:03:27.004 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-19T09:03:27.004 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:03:27.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.999+0000 7f664e36e640 1 -- 172.21.15.92:0/764716108 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f66340a32c0 msgr2=0x7f66340a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:27.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.999+0000 7f664e36e640 1 --2- 172.21.15.92:0/764716108 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f66340a32c0 0x7f66340a5780 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f66300059f0 tx=0x7f663001e9a0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.999+0000 7f664e36e640 1 -- 172.21.15.92:0/764716108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6648106b80 msgr2=0x7f664819efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:27.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.999+0000 7f664e36e640 1 --2- 172.21.15.92:0/764716108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6648106b80 0x7f664819efa0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f664000cad0 tx=0x7f664000cf90 comp rx=0 tx=0).stop 2024-09-19T09:03:27.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.999+0000 7f664e36e640 1 -- 172.21.15.92:0/764716108 shutdown_connections 2024-09-19T09:03:27.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.999+0000 7f664e36e640 1 --2- 172.21.15.92:0/764716108 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f66340a32c0 0x7f66340a5780 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.999+0000 7f664e36e640 1 --2- 172.21.15.92:0/764716108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6648106b80 0x7f664819efa0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.999+0000 7f664e36e640 1 --2- 172.21.15.92:0/764716108 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6648100aa0 0x7f664819ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.999+0000 7f664e36e640 1 --2- 172.21.15.92:0/764716108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6648100100 0x7f664819a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.999+0000 7f664e36e640 1 -- 172.21.15.92:0/764716108 >> 172.21.15.92:0/764716108 conn(0x7f6648077230 msgr2=0x7f6648104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:27.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.999+0000 7f664e36e640 1 -- 172.21.15.92:0/764716108 shutdown_connections 2024-09-19T09:03:27.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:26.999+0000 7f664e36e640 1 -- 172.21.15.92:0/764716108 wait complete. 2024-09-19T09:03:27.775 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:27 smithi092 ceph-mon[31407]: pgmap v539: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.4 MiB/s wr, 621 op/s 2024-09-19T09:03:27.804 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:03:27.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:27 smithi167 ceph-mon[35359]: pgmap v539: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.4 MiB/s wr, 621 op/s 2024-09-19T09:03:27.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:27 smithi190 ceph-mon[35358]: pgmap v539: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.4 MiB/s wr, 621 op/s 2024-09-19T09:03:28.047 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:28.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.604+0000 7f91902e6640 1 -- 172.21.15.92:0/3854647542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9188100e20 msgr2=0x7f9188101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:28.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.604+0000 7f91902e6640 1 --2- 172.21.15.92:0/3854647542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9188100e20 0x7f9188101200 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f9184009900 tx=0x7f918402a480 comp rx=0 tx=0).stop 2024-09-19T09:03:28.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.604+0000 7f91902e6640 1 -- 172.21.15.92:0/3854647542 shutdown_connections 2024-09-19T09:03:28.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.604+0000 7f91902e6640 1 --2- 172.21.15.92:0/3854647542 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9188102ef0 0x7f918810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.604+0000 7f91902e6640 1 --2- 172.21.15.92:0/3854647542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9188102570 0x7f91881029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.604+0000 7f91902e6640 1 --2- 172.21.15.92:0/3854647542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9188100e20 0x7f9188101200 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.604+0000 7f91902e6640 1 -- 172.21.15.92:0/3854647542 >> 172.21.15.92:0/3854647542 conn(0x7f91880fc7d0 msgr2=0x7f91880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:28.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.604+0000 7f91902e6640 1 -- 172.21.15.92:0/3854647542 shutdown_connections 2024-09-19T09:03:28.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.604+0000 7f91902e6640 1 -- 172.21.15.92:0/3854647542 wait complete. 2024-09-19T09:03:28.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.605+0000 7f91902e6640 1 Processor -- start 2024-09-19T09:03:28.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.605+0000 7f91902e6640 1 -- start start 2024-09-19T09:03:28.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.605+0000 7f91902e6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9188100e20 0x7f91881985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.605+0000 7f91902e6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9188102570 0x7f9188198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.605+0000 7f91902e6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9188102ef0 0x7f918819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.605+0000 7f91902e6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9188110f80 con 0x7f9188102ef0 2024-09-19T09:03:28.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.605+0000 7f91902e6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9188110e00 con 0x7f9188100e20 2024-09-19T09:03:28.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.605+0000 7f91902e6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9188111100 con 0x7f9188102570 2024-09-19T09:03:28.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.605+0000 7f918e883640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9188102ef0 0x7f918819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.605+0000 7f918e883640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9188102ef0 0x7f918819ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48424/0 (socket says 172.21.15.92:48424) 2024-09-19T09:03:28.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.605+0000 7f918e883640 1 -- 172.21.15.92:0/1405285191 learned_addr learned my addr 172.21.15.92:0/1405285191 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:28.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.605+0000 7f918e082640 1 --2- 172.21.15.92:0/1405285191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9188100e20 0x7f91881985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.605+0000 7f918d881640 1 --2- 172.21.15.92:0/1405285191 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9188102570 0x7f9188198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.605+0000 7f918e883640 1 -- 172.21.15.92:0/1405285191 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9188102570 msgr2=0x7f9188198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:28.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.605+0000 7f918e883640 1 --2- 172.21.15.92:0/1405285191 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9188102570 0x7f9188198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.605+0000 7f918e883640 1 -- 172.21.15.92:0/1405285191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9188100e20 msgr2=0x7f91881985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:28.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.605+0000 7f918e883640 1 --2- 172.21.15.92:0/1405285191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9188100e20 0x7f91881985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.605+0000 7f918e883640 1 -- 172.21.15.92:0/1405285191 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f918819d550 con 0x7f9188102ef0 2024-09-19T09:03:28.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.606+0000 7f918e883640 1 --2- 172.21.15.92:0/1405285191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9188102ef0 0x7f918819ce70 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f918000eaa0 tx=0x7f918000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:28.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.606+0000 7f917b7fe640 1 -- 172.21.15.92:0/1405285191 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918000cdb0 con 0x7f9188102ef0 2024-09-19T09:03:28.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.606+0000 7f917b7fe640 1 -- 172.21.15.92:0/1405285191 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9180005020 con 0x7f9188102ef0 2024-09-19T09:03:28.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.606+0000 7f91902e6640 1 -- 172.21.15.92:0/1405285191 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f918819d840 con 0x7f9188102ef0 2024-09-19T09:03:28.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.606+0000 7f917b7fe640 1 -- 172.21.15.92:0/1405285191 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91800116b0 con 0x7f9188102ef0 2024-09-19T09:03:28.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.606+0000 7f91902e6640 1 -- 172.21.15.92:0/1405285191 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91881a5120 con 0x7f9188102ef0 2024-09-19T09:03:28.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.608+0000 7f917b7fe640 1 -- 172.21.15.92:0/1405285191 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9180005560 con 0x7f9188102ef0 2024-09-19T09:03:28.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.608+0000 7f91926bf740 1 Processor -- start 2024-09-19T09:03:28.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.608+0000 7f91926bf740 1 -- start start 2024-09-19T09:03:28.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.609+0000 7f91926bf740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609bca754a0 0x5609bca75880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.609+0000 7f91926bf740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609bca75dc0 0x5609bca80140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.609+0000 7f91926bf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609bca80680 0x5609bca82a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.609+0000 7f91926bf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5609bc9db2e0 con 0x5609bca80680 2024-09-19T09:03:28.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.609+0000 7f91926bf740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5609bc982ce0 con 0x5609bca754a0 2024-09-19T09:03:28.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.609+0000 7f91926bf740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5609bc9d72a0 con 0x5609bca75dc0 2024-09-19T09:03:28.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.609+0000 7f918d881640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609bca80680 0x5609bca82a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.609+0000 7f918e082640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609bca75dc0 0x5609bca80140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.609+0000 7f918d881640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609bca80680 0x5609bca82a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48430/0 (socket says 172.21.15.92:48430) 2024-09-19T09:03:28.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.609+0000 7f918d881640 1 -- 172.21.15.92:0/4079767027 learned_addr learned my addr 172.21.15.92:0/4079767027 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:28.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.609+0000 7f918d881640 1 --2- 172.21.15.92:0/4079767027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609bca754a0 0x5609bca75880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.609+0000 7f917b7fe640 1 --2- 172.21.15.92:0/1405285191 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f91740a3240 0x7f91740a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.609+0000 7f918e883640 1 --2- 172.21.15.92:0/1405285191 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f91740a3240 0x7f91740a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.609+0000 7f918e082640 1 -- 172.21.15.92:0/4079767027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609bca754a0 msgr2=0x5609bca75880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:28.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.609+0000 7f918e082640 1 --2- 172.21.15.92:0/4079767027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609bca754a0 0x5609bca75880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.609+0000 7f918e082640 1 -- 172.21.15.92:0/4079767027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609bca80680 msgr2=0x5609bca82a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:28.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.609+0000 7f918e082640 1 --2- 172.21.15.92:0/4079767027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609bca80680 0x5609bca82a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.609+0000 7f918e082640 1 -- 172.21.15.92:0/4079767027 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609bc967440 con 0x5609bca75dc0 2024-09-19T09:03:28.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.609+0000 7f918d881640 1 --2- 172.21.15.92:0/4079767027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609bca80680 0x5609bca82a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:28.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.609+0000 7f917b7fe640 1 -- 172.21.15.92:0/1405285191 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f91800cfb30 con 0x7f9188102ef0 2024-09-19T09:03:28.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.610+0000 7f918e082640 1 --2- 172.21.15.92:0/4079767027 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609bca75dc0 0x5609bca80140 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9184005940 tx=0x7f91840040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b3cdc87e473b1ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:28.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.610+0000 7f918e883640 1 --2- 172.21.15.92:0/1405285191 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f91740a3240 0x7f91740a5700 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f918006ef60 tx=0x7f918006ef90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:28.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.610+0000 7f9178dea640 1 -- 172.21.15.92:0/4079767027 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9184035030 con 0x5609bca75dc0 2024-09-19T09:03:28.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.610+0000 7f9178dea640 1 -- 172.21.15.92:0/4079767027 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9184040070 con 0x5609bca75dc0 2024-09-19T09:03:28.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.610+0000 7f9178dea640 1 -- 172.21.15.92:0/4079767027 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9184031540 con 0x5609bca75dc0 2024-09-19T09:03:28.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.610+0000 7f91926bf740 1 -- 172.21.15.92:0/4079767027 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609bca75dc0 msgr2=0x5609bca80140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:28.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.610+0000 7f91926bf740 1 --2- 172.21.15.92:0/4079767027 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609bca75dc0 0x5609bca80140 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9184005940 tx=0x7f91840040c0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.611+0000 7f91926bf740 1 -- 172.21.15.92:0/4079767027 shutdown_connections 2024-09-19T09:03:28.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.611+0000 7f91926bf740 1 --2- 172.21.15.92:0/4079767027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609bca80680 0x5609bca82a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.611+0000 7f91926bf740 1 --2- 172.21.15.92:0/4079767027 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609bca75dc0 0x5609bca80140 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.611+0000 7f91926bf740 1 --2- 172.21.15.92:0/4079767027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609bca754a0 0x5609bca75880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.611+0000 7f91926bf740 1 -- 172.21.15.92:0/4079767027 >> 172.21.15.92:0/4079767027 conn(0x5609bca71a30 msgr2=0x5609bca71e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:28.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.611+0000 7f91926bf740 1 -- 172.21.15.92:0/4079767027 shutdown_connections 2024-09-19T09:03:28.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.611+0000 7f91926bf740 1 -- 172.21.15.92:0/4079767027 wait complete. 2024-09-19T09:03:28.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.611+0000 7f91926bf740 1 -- start start 2024-09-19T09:03:28.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.611+0000 7f91926bf740 1 Processor -- start 2024-09-19T09:03:28.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.611+0000 7f91926bf740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609bca754a0 0x5609bca800a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.611+0000 7f91926bf740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609bca75dc0 0x5609bca7d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.611+0000 7f91926bf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609bca80680 0x5609bca7d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.611+0000 7f91926bf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5609bca83250 con 0x5609bca80680 2024-09-19T09:03:28.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.611+0000 7f91926bf740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5609bc996050 con 0x5609bca75dc0 2024-09-19T09:03:28.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.611+0000 7f91926bf740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5609bca833d0 con 0x5609bca754a0 2024-09-19T09:03:28.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.611+0000 7f91926bf740 10 client.0 _ll_register_callbacks cb 0x5609bc9d6160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:28.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.612+0000 7f918d881640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609bca80680 0x5609bca7d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.612+0000 7f918d881640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609bca80680 0x5609bca7d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48436/0 (socket says 172.21.15.92:48436) 2024-09-19T09:03:28.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.612+0000 7f918d881640 1 -- 172.21.15.92:0/1299977688 learned_addr learned my addr 172.21.15.92:0/1299977688 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:28.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.612+0000 7f918d881640 1 --2- 172.21.15.92:0/1299977688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609bca754a0 0x5609bca800a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.612+0000 7f918e082640 1 --2- 172.21.15.92:0/1299977688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609bca75dc0 0x5609bca7d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.612+0000 7f918d881640 1 -- 172.21.15.92:0/1299977688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609bca754a0 msgr2=0x5609bca800a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:28.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.612+0000 7f918d881640 1 --2- 172.21.15.92:0/1299977688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609bca754a0 0x5609bca800a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.612+0000 7f918d881640 1 -- 172.21.15.92:0/1299977688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609bca75dc0 msgr2=0x5609bca7d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:28.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.612+0000 7f918d881640 1 --2- 172.21.15.92:0/1299977688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609bca75dc0 0x5609bca7d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.612+0000 7f918d881640 1 -- 172.21.15.92:0/1299977688 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609bc74c3c0 con 0x5609bca80680 2024-09-19T09:03:28.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.612+0000 7f918e082640 1 --2- 172.21.15.92:0/1299977688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609bca75dc0 0x5609bca7d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:28.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.612+0000 7f918d881640 1 --2- 172.21.15.92:0/1299977688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609bca80680 0x5609bca7d960 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f917c014f80 tx=0x7f917c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f0308142403454d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:28.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.612+0000 7f9171ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:03:28.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.612+0000 7f9171ffb640 1 -- 172.21.15.92:0/1299977688 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917c004030 con 0x5609bca80680 2024-09-19T09:03:28.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.612+0000 7f9171ffb640 1 -- 172.21.15.92:0/1299977688 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f917c0041d0 con 0x5609bca80680 2024-09-19T09:03:28.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.612+0000 7f91926bf740 1 -- 172.21.15.92:0/1299977688 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9184040070 con 0x5609bca80680 2024-09-19T09:03:28.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.612+0000 7f9171ffb640 1 -- 172.21.15.92:0/1299977688 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f917c0043d0 con 0x5609bca80680 2024-09-19T09:03:28.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.612+0000 7f91926bf740 10 client.16908 fetch_fsmap learned FSMap version 19 2024-09-19T09:03:28.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.612+0000 7f91926bf740 1 -- 172.21.15.92:0/1299977688 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5609bca8ed40 con 0x5609bca80680 2024-09-19T09:03:28.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.613+0000 7f9171ffb640 1 -- 172.21.15.92:0/1299977688 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9184040070 con 0x5609bca80680 2024-09-19T09:03:28.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.613+0000 7f9171ffb640 1 -- 172.21.15.92:0/1299977688 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f917c0035f0 con 0x5609bca80680 2024-09-19T09:03:28.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.613+0000 7f91926bf740 10 client.16908 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:03:28.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.613+0000 7f91926bf740 10 client.16908 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:03:28.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.613+0000 7f91926bf740 20 client.16908 populate_metadata read hostname 'smithi092' 2024-09-19T09:03:28.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.613+0000 7f91926bf740 1 --2- 172.21.15.92:0/1299977688 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5609bca90200 0x5609bca925f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.613+0000 7f91926bf740 4 client.16908 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:28.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.613+0000 7f91926bf740 1 -- 172.21.15.92:0/1299977688 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5609bc9e8850 con 0x5609bca90200 2024-09-19T09:03:28.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.613+0000 7f918e082640 1 --2- 172.21.15.92:0/1299977688 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5609bca90200 0x5609bca925f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.613+0000 7f918e082640 1 --2- 172.21.15.92:0/1299977688 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5609bca90200 0x5609bca925f0 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb29eb1c8d70175 server_cookie=f337736dae1c31c4 in_seq=0 out_seq=0 2024-09-19T09:03:28.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.613+0000 7f9171ffb640 10 client.16908 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:28.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.614+0000 7f9171ffb640 1 -- 172.21.15.92:0/1299977688 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5609bc9e8850 con 0x5609bca90200 2024-09-19T09:03:28.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.614+0000 7f9171ffb640 10 client.16908 handle_command_reply: tid=0 2024-09-19T09:03:28.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.614+0000 7f91926bf740 1 client.16908 shutdown 2024-09-19T09:03:28.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.614+0000 7f91926bf740 1 -- 172.21.15.92:0/1299977688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609bca80680 msgr2=0x5609bca7d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:28.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.614+0000 7f91926bf740 1 --2- 172.21.15.92:0/1299977688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609bca80680 0x5609bca7d960 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f917c014f80 tx=0x7f917c00cc10 comp rx=0 tx=0).stop 2024-09-19T09:03:28.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.614+0000 7f91926bf740 1 -- 172.21.15.92:0/1299977688 shutdown_connections 2024-09-19T09:03:28.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.614+0000 7f91926bf740 1 --2- 172.21.15.92:0/1299977688 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5609bca90200 0x5609bca925f0 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.614+0000 7f91926bf740 1 --2- 172.21.15.92:0/1299977688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609bca80680 0x5609bca7d960 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.614+0000 7f91926bf740 1 --2- 172.21.15.92:0/1299977688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609bca75dc0 0x5609bca7d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.614+0000 7f91926bf740 1 --2- 172.21.15.92:0/1299977688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609bca754a0 0x5609bca800a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.614+0000 7f91926bf740 1 -- 172.21.15.92:0/1299977688 >> 172.21.15.92:0/1299977688 conn(0x5609bca71a30 msgr2=0x5609bca77710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:28.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.614+0000 7f9171ffb640 0 client.16908 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:28.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.614+0000 7f91926bf740 1 -- 172.21.15.92:0/1299977688 shutdown_connections 2024-09-19T09:03:28.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.614+0000 7f91926bf740 1 -- 172.21.15.92:0/1299977688 wait complete. 2024-09-19T09:03:28.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.615+0000 7f91926bf740 20 client.16908 trim_cache size 0 max 16384 2024-09-19T09:03:28.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.631+0000 7f91926bf740 1 Processor -- start 2024-09-19T09:03:28.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.631+0000 7f91926bf740 1 -- start start 2024-09-19T09:03:28.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.631+0000 7f91926bf740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609bca754a0 0x5609bca71e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.631+0000 7f91926bf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609bca75dc0 0x5609bca7f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.631+0000 7f91926bf740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609bca80680 0x5609bca97e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.631+0000 7f91926bf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f91881ab660 con 0x5609bca75dc0 2024-09-19T09:03:28.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.631+0000 7f91926bf740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f91881adf00 con 0x5609bca80680 2024-09-19T09:03:28.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.631+0000 7f91926bf740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f91881abcf0 con 0x5609bca754a0 2024-09-19T09:03:28.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.632+0000 7f918e082640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609bca75dc0 0x5609bca7f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.632+0000 7f918e082640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609bca75dc0 0x5609bca7f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48452/0 (socket says 172.21.15.92:48452) 2024-09-19T09:03:28.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.632+0000 7f918e082640 1 -- 172.21.15.92:0/497230865 learned_addr learned my addr 172.21.15.92:0/497230865 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:28.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.632+0000 7f918d881640 1 --2- 172.21.15.92:0/497230865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609bca754a0 0x5609bca71e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.632+0000 7f918e082640 1 -- 172.21.15.92:0/497230865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609bca754a0 msgr2=0x5609bca71e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:28.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.632+0000 7f918e082640 1 --2- 172.21.15.92:0/497230865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609bca754a0 0x5609bca71e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.632+0000 7f918e082640 1 -- 172.21.15.92:0/497230865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609bca80680 msgr2=0x5609bca97e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:28.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.632+0000 7f918e082640 1 --2- 172.21.15.92:0/497230865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609bca80680 0x5609bca97e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.632+0000 7f918e082640 1 -- 172.21.15.92:0/497230865 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609bca7c300 con 0x5609bca75dc0 2024-09-19T09:03:28.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.632+0000 7f918d881640 1 --2- 172.21.15.92:0/497230865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609bca754a0 0x5609bca71e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:28.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.632+0000 7f918e082640 1 --2- 172.21.15.92:0/497230865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609bca75dc0 0x5609bca7f2c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f9184006010 tx=0x7f9184004a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716b4221abd9fec4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:28.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.632+0000 7f9173fff640 1 -- 172.21.15.92:0/497230865 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9184035040 con 0x5609bca75dc0 2024-09-19T09:03:28.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.632+0000 7f9173fff640 1 -- 172.21.15.92:0/497230865 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9184054070 con 0x5609bca75dc0 2024-09-19T09:03:28.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.632+0000 7f9173fff640 1 -- 172.21.15.92:0/497230865 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9184003850 con 0x5609bca75dc0 2024-09-19T09:03:28.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.633+0000 7f91926bf740 1 -- 172.21.15.92:0/497230865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609bca75dc0 msgr2=0x5609bca7f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:28.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.633+0000 7f91926bf740 1 --2- 172.21.15.92:0/497230865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609bca75dc0 0x5609bca7f2c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f9184006010 tx=0x7f9184004a70 comp rx=0 tx=0).stop 2024-09-19T09:03:28.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.633+0000 7f91926bf740 1 -- 172.21.15.92:0/497230865 shutdown_connections 2024-09-19T09:03:28.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.633+0000 7f91926bf740 1 --2- 172.21.15.92:0/497230865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609bca80680 0x5609bca97e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.633+0000 7f91926bf740 1 --2- 172.21.15.92:0/497230865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609bca75dc0 0x5609bca7f2c0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.633+0000 7f91926bf740 1 --2- 172.21.15.92:0/497230865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609bca754a0 0x5609bca71e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.633+0000 7f91926bf740 1 -- 172.21.15.92:0/497230865 >> 172.21.15.92:0/497230865 conn(0x5609bca71a30 msgr2=0x5609bca7ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:28.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.633+0000 7f91926bf740 1 -- 172.21.15.92:0/497230865 shutdown_connections 2024-09-19T09:03:28.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.633+0000 7f91926bf740 1 -- 172.21.15.92:0/497230865 wait complete. 2024-09-19T09:03:28.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.633+0000 7f91926bf740 1 -- start start 2024-09-19T09:03:28.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.633+0000 7f91926bf740 1 Processor -- start 2024-09-19T09:03:28.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.633+0000 7f91926bf740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609bca754a0 0x5609bca88be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.633+0000 7f91926bf740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609bca75dc0 0x5609bca85f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.633+0000 7f91926bf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609bca80680 0x5609bca86470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.633+0000 7f91926bf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f91881ac3c0 con 0x5609bca80680 2024-09-19T09:03:28.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.633+0000 7f91926bf740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f91881ad830 con 0x5609bca754a0 2024-09-19T09:03:28.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.633+0000 7f91926bf740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f91881aca90 con 0x5609bca75dc0 2024-09-19T09:03:28.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.634+0000 7f91926bf740 10 client.0 _ll_register_callbacks cb 0x7f917c00ce10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:28.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.634+0000 7f918d881640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609bca80680 0x5609bca86470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.634+0000 7f918d881640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609bca80680 0x5609bca86470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48454/0 (socket says 172.21.15.92:48454) 2024-09-19T09:03:28.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.634+0000 7f918d881640 1 -- 172.21.15.92:0/1330495493 learned_addr learned my addr 172.21.15.92:0/1330495493 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:28.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.634+0000 7f918e082640 1 --2- 172.21.15.92:0/1330495493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609bca75dc0 0x5609bca85f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.634+0000 7f918d881640 1 --2- 172.21.15.92:0/1330495493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609bca754a0 0x5609bca88be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.634+0000 7f918d881640 1 -- 172.21.15.92:0/1330495493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609bca75dc0 msgr2=0x5609bca85f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:28.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.634+0000 7f918d881640 1 --2- 172.21.15.92:0/1330495493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609bca75dc0 0x5609bca85f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.634+0000 7f918d881640 1 -- 172.21.15.92:0/1330495493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609bca754a0 msgr2=0x5609bca88be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:28.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.634+0000 7f918d881640 1 --2- 172.21.15.92:0/1330495493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609bca754a0 0x5609bca88be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.634+0000 7f918d881640 1 -- 172.21.15.92:0/1330495493 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609bca80410 con 0x5609bca80680 2024-09-19T09:03:28.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.634+0000 7f918d881640 1 --2- 172.21.15.92:0/1330495493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609bca80680 0x5609bca86470 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f917c005fd0 tx=0x7f917c011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=160960aaab2dcab0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:28.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.634+0000 7f9171ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:03:28.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.634+0000 7f9171ffb640 1 -- 172.21.15.92:0/1330495493 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917c00c6d0 con 0x5609bca80680 2024-09-19T09:03:28.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.634+0000 7f9171ffb640 1 -- 172.21.15.92:0/1330495493 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f917c00c870 con 0x5609bca80680 2024-09-19T09:03:28.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.634+0000 7f91926bf740 1 -- 172.21.15.92:0/1330495493 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9184054070 con 0x5609bca80680 2024-09-19T09:03:28.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.634+0000 7f9171ffb640 1 -- 172.21.15.92:0/1330495493 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f917c005020 con 0x5609bca80680 2024-09-19T09:03:28.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.634+0000 7f91926bf740 10 client.16914 fetch_fsmap learned FSMap version 19 2024-09-19T09:03:28.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.634+0000 7f91926bf740 1 -- 172.21.15.92:0/1330495493 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5609bcafaa60 con 0x5609bca80680 2024-09-19T09:03:28.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.635+0000 7f9171ffb640 1 -- 172.21.15.92:0/1330495493 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9184054070 con 0x5609bca80680 2024-09-19T09:03:28.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.635+0000 7f9171ffb640 1 -- 172.21.15.92:0/1330495493 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f917c03a020 con 0x5609bca80680 2024-09-19T09:03:28.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.635+0000 7f91926bf740 10 client.16914 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:03:28.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.635+0000 7f91926bf740 10 client.16914 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:03:28.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.635+0000 7f91926bf740 20 client.16914 populate_metadata read hostname 'smithi092' 2024-09-19T09:03:28.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.635+0000 7f91926bf740 1 --2- 172.21.15.92:0/1330495493 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5609bcafb1b0 0x5609bcafd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.635+0000 7f91926bf740 4 client.16914 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:03:28.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.635+0000 7f91926bf740 1 -- 172.21.15.92:0/1330495493 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5609bc9e2d60 con 0x5609bcafb1b0 2024-09-19T09:03:28.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.635+0000 7f918e082640 1 --2- 172.21.15.92:0/1330495493 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5609bcafb1b0 0x5609bcafd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.636+0000 7f918e082640 1 --2- 172.21.15.92:0/1330495493 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5609bcafb1b0 0x5609bcafd5d0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cf1e6e4a7155322 server_cookie=4a8db8c612860e4e in_seq=0 out_seq=0 2024-09-19T09:03:28.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.636+0000 7f9171ffb640 10 client.16914 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:28.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.636+0000 7f9171ffb640 1 -- 172.21.15.92:0/1330495493 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5609bc9e2d60 con 0x5609bcafb1b0 2024-09-19T09:03:28.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.636+0000 7f9171ffb640 10 client.16914 handle_command_reply: tid=0 2024-09-19T09:03:28.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.636+0000 7f91926bf740 1 client.16914 shutdown 2024-09-19T09:03:28.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.636+0000 7f91926bf740 1 -- 172.21.15.92:0/1330495493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609bca80680 msgr2=0x5609bca86470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:28.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.636+0000 7f91926bf740 1 --2- 172.21.15.92:0/1330495493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609bca80680 0x5609bca86470 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f917c005fd0 tx=0x7f917c011f80 comp rx=0 tx=0).stop 2024-09-19T09:03:28.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.636+0000 7f91926bf740 1 -- 172.21.15.92:0/1330495493 shutdown_connections 2024-09-19T09:03:28.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.636+0000 7f91926bf740 1 --2- 172.21.15.92:0/1330495493 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5609bcafb1b0 0x5609bcafd5d0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.636+0000 7f91926bf740 1 --2- 172.21.15.92:0/1330495493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5609bca80680 0x5609bca86470 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.636+0000 7f9171ffb640 0 client.16914 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:28.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.636+0000 7f91926bf740 1 --2- 172.21.15.92:0/1330495493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5609bca75dc0 0x5609bca85f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.636+0000 7f91926bf740 1 --2- 172.21.15.92:0/1330495493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609bca754a0 0x5609bca88be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.636+0000 7f91926bf740 1 -- 172.21.15.92:0/1330495493 >> 172.21.15.92:0/1330495493 conn(0x5609bca71a30 msgr2=0x5609bca7f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:28.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.636+0000 7f91926bf740 1 -- 172.21.15.92:0/1330495493 shutdown_connections 2024-09-19T09:03:28.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.636+0000 7f91926bf740 1 -- 172.21.15.92:0/1330495493 wait complete. 2024-09-19T09:03:28.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.636+0000 7f91926bf740 20 client.16914 trim_cache size 0 max 16384 2024-09-19T09:03:28.643 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:03:28.643 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-19T09:03:28.643 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {} 2024-09-19T09:03:28.643 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:03:28.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.637+0000 7f91902e6640 1 -- 172.21.15.92:0/1405285191 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f91740a3240 msgr2=0x7f91740a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:28.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.637+0000 7f91902e6640 1 --2- 172.21.15.92:0/1405285191 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f91740a3240 0x7f91740a5700 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f918006ef60 tx=0x7f918006ef90 comp rx=0 tx=0).stop 2024-09-19T09:03:28.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.637+0000 7f91902e6640 1 -- 172.21.15.92:0/1405285191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9188102ef0 msgr2=0x7f918819ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:28.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.637+0000 7f91902e6640 1 --2- 172.21.15.92:0/1405285191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9188102ef0 0x7f918819ce70 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f918000eaa0 tx=0x7f918000ef60 comp rx=0 tx=0).stop 2024-09-19T09:03:28.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.637+0000 7f91902e6640 1 -- 172.21.15.92:0/1405285191 shutdown_connections 2024-09-19T09:03:28.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.637+0000 7f91902e6640 1 --2- 172.21.15.92:0/1405285191 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f91740a3240 0x7f91740a5700 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.637+0000 7f91902e6640 1 --2- 172.21.15.92:0/1405285191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9188102ef0 0x7f918819ce70 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.637+0000 7f91902e6640 1 --2- 172.21.15.92:0/1405285191 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9188102570 0x7f9188198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.637+0000 7f91902e6640 1 --2- 172.21.15.92:0/1405285191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9188100e20 0x7f91881985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.637+0000 7f91902e6640 1 -- 172.21.15.92:0/1405285191 >> 172.21.15.92:0/1405285191 conn(0x7f91880fc7d0 msgr2=0x7f9188069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:28.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.637+0000 7f91902e6640 1 -- 172.21.15.92:0/1405285191 shutdown_connections 2024-09-19T09:03:28.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:28.637+0000 7f91902e6640 1 -- 172.21.15.92:0/1405285191 wait complete. 2024-09-19T09:03:28.780 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:28 smithi092 ceph-mon[31407]: scrub queued for path: / 2024-09-19T09:03:28.780 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:28 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:28.780 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:28 smithi092 ceph-mon[31407]: scrub summary: active paths [/] 2024-09-19T09:03:28.780 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:28 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:28.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:28 smithi167 ceph-mon[35359]: scrub queued for path: / 2024-09-19T09:03:28.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:28 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:28.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:28 smithi167 ceph-mon[35359]: scrub summary: active paths [/] 2024-09-19T09:03:28.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:28 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:28.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:28 smithi190 ceph-mon[35358]: scrub queued for path: / 2024-09-19T09:03:28.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:28 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:28.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:28 smithi190 ceph-mon[35358]: scrub summary: active paths [/] 2024-09-19T09:03:28.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:28 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:29.356 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:03:29.356 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:03:29.599 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:29.712 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:29 smithi092 ceph-mon[31407]: pgmap v540: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 6.0 MiB/s wr, 567 op/s 2024-09-19T09:03:29.712 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:29 smithi092 ceph-mon[31407]: scrub summary: idle 2024-09-19T09:03:29.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:29 smithi167 ceph-mon[35359]: pgmap v540: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 6.0 MiB/s wr, 567 op/s 2024-09-19T09:03:29.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:29 smithi167 ceph-mon[35359]: scrub summary: idle 2024-09-19T09:03:29.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:29 smithi190 ceph-mon[35358]: pgmap v540: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 6.0 MiB/s wr, 567 op/s 2024-09-19T09:03:29.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:29 smithi190 ceph-mon[35358]: scrub summary: idle 2024-09-19T09:03:30.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.010+0000 7f4ae9c72640 1 -- 172.21.15.92:0/3419502245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ae4106a80 msgr2=0x7f4ae4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:30.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.010+0000 7f4ae9c72640 1 --2- 172.21.15.92:0/3419502245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ae4106a80 0x7f4ae4106e60 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4009930 tx=0x7f4ad402a420 comp rx=0 tx=0).stop 2024-09-19T09:03:30.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.010+0000 7f4ae9c72640 1 -- 172.21.15.92:0/3419502245 shutdown_connections 2024-09-19T09:03:30.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.010+0000 7f4ae9c72640 1 --2- 172.21.15.92:0/3419502245 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ae4101420 0x7f4ae410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:30.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.010+0000 7f4ae9c72640 1 --2- 172.21.15.92:0/3419502245 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ae4100a80 0x7f4ae4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:30.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.010+0000 7f4ae9c72640 1 --2- 172.21.15.92:0/3419502245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ae4106a80 0x7f4ae4106e60 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:30.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.010+0000 7f4ae9c72640 1 -- 172.21.15.92:0/3419502245 >> 172.21.15.92:0/3419502245 conn(0x7f4ae40fc7a0 msgr2=0x7f4ae40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:30.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.010+0000 7f4ae9c72640 1 -- 172.21.15.92:0/3419502245 shutdown_connections 2024-09-19T09:03:30.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.010+0000 7f4ae9c72640 1 -- 172.21.15.92:0/3419502245 wait complete. 2024-09-19T09:03:30.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.011+0000 7f4ae9c72640 1 Processor -- start 2024-09-19T09:03:30.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.011+0000 7f4ae9c72640 1 -- start start 2024-09-19T09:03:30.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.011+0000 7f4ae9c72640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ae4100a80 0x7f4ae4197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:30.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.011+0000 7f4ae9c72640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ae4101420 0x7f4ae4197790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:30.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.011+0000 7f4ae9c72640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ae4106a80 0x7f4ae4197cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:30.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.011+0000 7f4ae9c72640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae4110f20 con 0x7f4ae4100a80 2024-09-19T09:03:30.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.011+0000 7f4ae9c72640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae4110da0 con 0x7f4ae4101420 2024-09-19T09:03:30.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.011+0000 7f4ae9c72640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae41110a0 con 0x7f4ae4106a80 2024-09-19T09:03:30.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.011+0000 7f4ae37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ae4100a80 0x7f4ae4197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:30.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.011+0000 7f4ae37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ae4100a80 0x7f4ae4197250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48474/0 (socket says 172.21.15.92:48474) 2024-09-19T09:03:30.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.011+0000 7f4ae37fe640 1 -- 172.21.15.92:0/1148950731 learned_addr learned my addr 172.21.15.92:0/1148950731 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:30.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.011+0000 7f4ae37fe640 1 -- 172.21.15.92:0/1148950731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ae4106a80 msgr2=0x7f4ae4197cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:30.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.011+0000 7f4ae37fe640 1 --2- 172.21.15.92:0/1148950731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ae4106a80 0x7f4ae4197cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:30.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.011+0000 7f4ae37fe640 1 -- 172.21.15.92:0/1148950731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ae4101420 msgr2=0x7f4ae4197790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:30.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.011+0000 7f4ae37fe640 1 --2- 172.21.15.92:0/1148950731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ae4101420 0x7f4ae4197790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:30.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.011+0000 7f4ae37fe640 1 -- 172.21.15.92:0/1148950731 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae41a6ac0 con 0x7f4ae4100a80 2024-09-19T09:03:30.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.012+0000 7f4ae37fe640 1 --2- 172.21.15.92:0/1148950731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ae4100a80 0x7f4ae4197250 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4009a50 tx=0x7f4ad4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:30.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.012+0000 7f4ae0ff9640 1 -- 172.21.15.92:0/1148950731 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad403f030 con 0x7f4ae4100a80 2024-09-19T09:03:30.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.012+0000 7f4ae0ff9640 1 -- 172.21.15.92:0/1148950731 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ad4003ce0 con 0x7f4ae4100a80 2024-09-19T09:03:30.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.012+0000 7f4ae9c72640 1 -- 172.21.15.92:0/1148950731 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ae41a6d50 con 0x7f4ae4100a80 2024-09-19T09:03:30.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.012+0000 7f4ae0ff9640 1 -- 172.21.15.92:0/1148950731 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad4035070 con 0x7f4ae4100a80 2024-09-19T09:03:30.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.012+0000 7f4ae9c72640 1 -- 172.21.15.92:0/1148950731 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ae41a71d0 con 0x7f4ae4100a80 2024-09-19T09:03:30.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.013+0000 7f4ae9c72640 1 -- 172.21.15.92:0/1148950731 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ae4100f60 con 0x7f4ae4100a80 2024-09-19T09:03:30.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.014+0000 7f4ae0ff9640 1 -- 172.21.15.92:0/1148950731 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4ad4042030 con 0x7f4ae4100a80 2024-09-19T09:03:30.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.014+0000 7f4ae0ff9640 1 --2- 172.21.15.92:0/1148950731 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4acc0a3240 0x7f4acc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:30.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.014+0000 7f4ae2ffd640 1 --2- 172.21.15.92:0/1148950731 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4acc0a3240 0x7f4acc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:30.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.015+0000 7f4ae0ff9640 1 -- 172.21.15.92:0/1148950731 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4ad40eff80 con 0x7f4ae4100a80 2024-09-19T09:03:30.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.015+0000 7f4ae2ffd640 1 --2- 172.21.15.92:0/1148950731 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4acc0a3240 0x7f4acc0a5700 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4ae41993b0 tx=0x7f4ad8006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:30.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.019+0000 7f4ae0ff9640 1 -- 172.21.15.92:0/1148950731 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4ad40bcca0 con 0x7f4ae4100a80 2024-09-19T09:03:30.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.217+0000 7f4ae9c72640 1 -- 172.21.15.92:0/1148950731 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ae402d7c0 con 0x7f4ae4100a80 2024-09-19T09:03:30.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.218+0000 7f4ae0ff9640 1 -- 172.21.15.92:0/1148950731 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f4ad40bc5a0 con 0x7f4ae4100a80 2024-09-19T09:03:30.218 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:03:30.219 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:03:30.219 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:03:30.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.220+0000 7f4ae9c72640 1 -- 172.21.15.92:0/1148950731 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4acc0a3240 msgr2=0x7f4acc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:30.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.220+0000 7f4ae9c72640 1 --2- 172.21.15.92:0/1148950731 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4acc0a3240 0x7f4acc0a5700 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4ae41993b0 tx=0x7f4ad8006c90 comp rx=0 tx=0).stop 2024-09-19T09:03:30.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.220+0000 7f4ae9c72640 1 -- 172.21.15.92:0/1148950731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ae4100a80 msgr2=0x7f4ae4197250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:30.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.220+0000 7f4ae9c72640 1 --2- 172.21.15.92:0/1148950731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ae4100a80 0x7f4ae4197250 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4009a50 tx=0x7f4ad4004270 comp rx=0 tx=0).stop 2024-09-19T09:03:30.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.220+0000 7f4ae9c72640 1 -- 172.21.15.92:0/1148950731 shutdown_connections 2024-09-19T09:03:30.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.220+0000 7f4ae9c72640 1 --2- 172.21.15.92:0/1148950731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ae4106a80 0x7f4ae4197cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:30.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.220+0000 7f4ae9c72640 1 --2- 172.21.15.92:0/1148950731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ae4101420 0x7f4ae4197790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:30.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.220+0000 7f4ae9c72640 1 --2- 172.21.15.92:0/1148950731 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4acc0a3240 0x7f4acc0a5700 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:30.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.220+0000 7f4ae9c72640 1 --2- 172.21.15.92:0/1148950731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ae4100a80 0x7f4ae4197250 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:30.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.220+0000 7f4ae9c72640 1 -- 172.21.15.92:0/1148950731 >> 172.21.15.92:0/1148950731 conn(0x7f4ae40fc7a0 msgr2=0x7f4ae40fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:30.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.220+0000 7f4ae9c72640 1 -- 172.21.15.92:0/1148950731 shutdown_connections 2024-09-19T09:03:30.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:30.220+0000 7f4ae9c72640 1 -- 172.21.15.92:0/1148950731 wait complete. 2024-09-19T09:03:30.799 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:03:30.826 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:30 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1148950731' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:30.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:30 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/1148950731' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:30.854 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:03:30.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:30 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/1148950731' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:31.099 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:31.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.461+0000 7f3a90b82640 1 -- 172.21.15.92:0/307085123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a8c106a80 msgr2=0x7f3a8c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:31.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.461+0000 7f3a90b82640 1 --2- 172.21.15.92:0/307085123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a8c106a80 0x7f3a8c106e60 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f3a80009930 tx=0x7f3a8002a420 comp rx=0 tx=0).stop 2024-09-19T09:03:31.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.461+0000 7f3a90b82640 1 -- 172.21.15.92:0/307085123 shutdown_connections 2024-09-19T09:03:31.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.461+0000 7f3a90b82640 1 --2- 172.21.15.92:0/307085123 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a8c101420 0x7f3a8c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.461+0000 7f3a90b82640 1 --2- 172.21.15.92:0/307085123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a8c100a80 0x7f3a8c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.461+0000 7f3a90b82640 1 --2- 172.21.15.92:0/307085123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a8c106a80 0x7f3a8c106e60 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.461+0000 7f3a90b82640 1 -- 172.21.15.92:0/307085123 >> 172.21.15.92:0/307085123 conn(0x7f3a8c0fc7a0 msgr2=0x7f3a8c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:31.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.461+0000 7f3a90b82640 1 -- 172.21.15.92:0/307085123 shutdown_connections 2024-09-19T09:03:31.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.461+0000 7f3a90b82640 1 -- 172.21.15.92:0/307085123 wait complete. 2024-09-19T09:03:31.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.462+0000 7f3a90b82640 1 Processor -- start 2024-09-19T09:03:31.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.462+0000 7f3a90b82640 1 -- start start 2024-09-19T09:03:31.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.462+0000 7f3a90b82640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a8c100a80 0x7f3a8c1992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:31.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.462+0000 7f3a90b82640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a8c101420 0x7f3a8c199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:31.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.462+0000 7f3a90b82640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a8c106a80 0x7f3a8c1a4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:31.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.462+0000 7f3a90b82640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3a8c110ef0 con 0x7f3a8c106a80 2024-09-19T09:03:31.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.462+0000 7f3a90b82640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3a8c110d70 con 0x7f3a8c101420 2024-09-19T09:03:31.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.462+0000 7f3a90b82640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3a8c111070 con 0x7f3a8c100a80 2024-09-19T09:03:31.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.462+0000 7f3a8ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a8c106a80 0x7f3a8c1a4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:31.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.462+0000 7f3a8ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a8c106a80 0x7f3a8c1a4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48494/0 (socket says 172.21.15.92:48494) 2024-09-19T09:03:31.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.462+0000 7f3a8ad9d640 1 -- 172.21.15.92:0/3184390171 learned_addr learned my addr 172.21.15.92:0/3184390171 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:31.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.463+0000 7f3a8a59c640 1 --2- 172.21.15.92:0/3184390171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a8c100a80 0x7f3a8c1992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:31.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.463+0000 7f3a89d9b640 1 --2- 172.21.15.92:0/3184390171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a8c101420 0x7f3a8c199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:31.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.463+0000 7f3a8ad9d640 1 -- 172.21.15.92:0/3184390171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a8c100a80 msgr2=0x7f3a8c1992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:31.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.463+0000 7f3a8ad9d640 1 --2- 172.21.15.92:0/3184390171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a8c100a80 0x7f3a8c1992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.463+0000 7f3a8ad9d640 1 -- 172.21.15.92:0/3184390171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a8c101420 msgr2=0x7f3a8c199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:31.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.463+0000 7f3a8ad9d640 1 --2- 172.21.15.92:0/3184390171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a8c101420 0x7f3a8c199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.463+0000 7f3a8ad9d640 1 -- 172.21.15.92:0/3184390171 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a8c1a4880 con 0x7f3a8c106a80 2024-09-19T09:03:31.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.463+0000 7f3a8ad9d640 1 --2- 172.21.15.92:0/3184390171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a8c106a80 0x7f3a8c1a4340 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f3a84009fd0 tx=0x7f3a8400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:31.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.463+0000 7f3a7b7fe640 1 -- 172.21.15.92:0/3184390171 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a84011830 con 0x7f3a8c106a80 2024-09-19T09:03:31.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.463+0000 7f3a90b82640 1 -- 172.21.15.92:0/3184390171 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a8c1a4a50 con 0x7f3a8c106a80 2024-09-19T09:03:31.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.463+0000 7f3a7b7fe640 1 -- 172.21.15.92:0/3184390171 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a84016070 con 0x7f3a8c106a80 2024-09-19T09:03:31.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.463+0000 7f3a7b7fe640 1 -- 172.21.15.92:0/3184390171 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a8400f2e0 con 0x7f3a8c106a80 2024-09-19T09:03:31.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.463+0000 7f3a90b82640 1 -- 172.21.15.92:0/3184390171 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a8c1a4f60 con 0x7f3a8c106a80 2024-09-19T09:03:31.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.466+0000 7f3a7b7fe640 1 -- 172.21.15.92:0/3184390171 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3a840119d0 con 0x7f3a8c106a80 2024-09-19T09:03:31.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.466+0000 7f3a92f5b740 1 Processor -- start 2024-09-19T09:03:31.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.466+0000 7f3a92f5b740 1 -- start start 2024-09-19T09:03:31.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.466+0000 7f3a92f5b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559fc0da9b40 0x559fc0da8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:31.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.466+0000 7f3a92f5b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559fc0da85d0 0x559fc0da8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:31.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.466+0000 7f3a92f5b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fc0db7780 0x559fc0db9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:31.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.466+0000 7f3a92f5b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559fc0d0e2f0 con 0x559fc0db7780 2024-09-19T09:03:31.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.466+0000 7f3a7b7fe640 1 --2- 172.21.15.92:0/3184390171 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3a740a3240 0x7f3a740a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:31.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.466+0000 7f3a92f5b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559fc0cb5cf0 con 0x559fc0da85d0 2024-09-19T09:03:31.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.466+0000 7f3a92f5b740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x559fc0d0a2b0 con 0x559fc0da9b40 2024-09-19T09:03:31.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.467+0000 7f3a89d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fc0db7780 0x559fc0db9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:31.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.467+0000 7f3a8ad9d640 1 --2- 172.21.15.92:0/3184390171 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3a740a3240 0x7f3a740a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:31.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.467+0000 7f3a89d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fc0db7780 0x559fc0db9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48496/0 (socket says 172.21.15.92:48496) 2024-09-19T09:03:31.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.467+0000 7f3a89d9b640 1 -- 172.21.15.92:0/67925820 learned_addr learned my addr 172.21.15.92:0/67925820 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:31.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.467+0000 7f3a7b7fe640 1 -- 172.21.15.92:0/3184390171 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3a840ceeb0 con 0x7f3a8c106a80 2024-09-19T09:03:31.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.467+0000 7f3a8a59c640 1 --2- 172.21.15.92:0/67925820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559fc0da85d0 0x559fc0da8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:31.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.467+0000 7f3a89d9b640 1 --2- 172.21.15.92:0/67925820 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559fc0da9b40 0x559fc0da8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:31.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.467+0000 7f3a89d9b640 1 -- 172.21.15.92:0/67925820 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559fc0da9b40 msgr2=0x559fc0da8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:31.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.467+0000 7f3a89d9b640 1 --2- 172.21.15.92:0/67925820 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559fc0da9b40 0x559fc0da8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.467+0000 7f3a89d9b640 1 -- 172.21.15.92:0/67925820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559fc0da85d0 msgr2=0x559fc0da8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:31.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.467+0000 7f3a89d9b640 1 --2- 172.21.15.92:0/67925820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559fc0da85d0 0x559fc0da8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.467+0000 7f3a89d9b640 1 -- 172.21.15.92:0/67925820 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fc0c9a3a0 con 0x559fc0db7780 2024-09-19T09:03:31.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.467+0000 7f3a8ad9d640 1 --2- 172.21.15.92:0/3184390171 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3a740a3240 0x7f3a740a5700 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3a84000c00 tx=0x7f3a840158f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:31.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.467+0000 7f3a89d9b640 1 --2- 172.21.15.92:0/67925820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fc0db7780 0x559fc0db9b70 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c0078a0 tx=0x7f3a7c007af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b403f0e00d82ab7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:31.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.467+0000 7f3a78ff9640 1 -- 172.21.15.92:0/67925820 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c019030 con 0x559fc0db7780 2024-09-19T09:03:31.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.467+0000 7f3a78ff9640 1 -- 172.21.15.92:0/67925820 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a7c013020 con 0x559fc0db7780 2024-09-19T09:03:31.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.467+0000 7f3a78ff9640 1 -- 172.21.15.92:0/67925820 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c012b90 con 0x559fc0db7780 2024-09-19T09:03:31.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.468+0000 7f3a92f5b740 1 -- 172.21.15.92:0/67925820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fc0db7780 msgr2=0x559fc0db9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:31.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.468+0000 7f3a92f5b740 1 --2- 172.21.15.92:0/67925820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fc0db7780 0x559fc0db9b70 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c0078a0 tx=0x7f3a7c007af0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.468+0000 7f3a92f5b740 1 -- 172.21.15.92:0/67925820 shutdown_connections 2024-09-19T09:03:31.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.468+0000 7f3a92f5b740 1 --2- 172.21.15.92:0/67925820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fc0db7780 0x559fc0db9b70 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.468+0000 7f3a92f5b740 1 --2- 172.21.15.92:0/67925820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559fc0da85d0 0x559fc0da8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.468+0000 7f3a92f5b740 1 --2- 172.21.15.92:0/67925820 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559fc0da9b40 0x559fc0da8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.468+0000 7f3a92f5b740 1 -- 172.21.15.92:0/67925820 >> 172.21.15.92:0/67925820 conn(0x559fc0d71310 msgr2=0x559fc0da4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:31.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.468+0000 7f3a92f5b740 1 -- 172.21.15.92:0/67925820 shutdown_connections 2024-09-19T09:03:31.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.468+0000 7f3a92f5b740 1 -- 172.21.15.92:0/67925820 wait complete. 2024-09-19T09:03:31.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.469+0000 7f3a92f5b740 1 -- start start 2024-09-19T09:03:31.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.469+0000 7f3a92f5b740 1 Processor -- start 2024-09-19T09:03:31.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.469+0000 7f3a92f5b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559fc0da85d0 0x559fc0db7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:31.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.469+0000 7f3a92f5b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fc0da9b40 0x559fc0db4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:31.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.469+0000 7f3a92f5b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559fc0db7780 0x559fc0db49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:31.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.469+0000 7f3a92f5b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559fc0dba480 con 0x559fc0da9b40 2024-09-19T09:03:31.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.469+0000 7f3a92f5b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559fc0cc9060 con 0x559fc0da85d0 2024-09-19T09:03:31.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.469+0000 7f3a92f5b740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x559fc0dba600 con 0x559fc0db7780 2024-09-19T09:03:31.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.469+0000 7f3a92f5b740 10 client.0 _ll_register_callbacks cb 0x559fc0a1c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:31.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.469+0000 7f3a8a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fc0da9b40 0x559fc0db4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:31.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.469+0000 7f3a8a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fc0da9b40 0x559fc0db4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48500/0 (socket says 172.21.15.92:48500) 2024-09-19T09:03:31.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.469+0000 7f3a8a59c640 1 -- 172.21.15.92:0/3672644291 learned_addr learned my addr 172.21.15.92:0/3672644291 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:31.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.469+0000 7f3a89d9b640 1 --2- 172.21.15.92:0/3672644291 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559fc0da85d0 0x559fc0db7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:31.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.469+0000 7f3a89d9b640 1 --2- 172.21.15.92:0/3672644291 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559fc0db7780 0x559fc0db49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:31.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.469+0000 7f3a8a59c640 1 -- 172.21.15.92:0/3672644291 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559fc0db7780 msgr2=0x559fc0db49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:31.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.469+0000 7f3a8a59c640 1 --2- 172.21.15.92:0/3672644291 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559fc0db7780 0x559fc0db49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.469+0000 7f3a8a59c640 1 -- 172.21.15.92:0/3672644291 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559fc0da85d0 msgr2=0x559fc0db7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:31.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.469+0000 7f3a8a59c640 1 --2- 172.21.15.92:0/3672644291 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559fc0da85d0 0x559fc0db7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.469+0000 7f3a8a59c640 1 -- 172.21.15.92:0/3672644291 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fc0a7f3c0 con 0x559fc0da9b40 2024-09-19T09:03:31.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.470+0000 7f3a8a59c640 1 --2- 172.21.15.92:0/3672644291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fc0da9b40 0x559fc0db4410 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f3a80009930 tx=0x7f3a80004510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf76a327adce976 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:31.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.470+0000 7f3a71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:03:31.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.470+0000 7f3a71ffb640 1 -- 172.21.15.92:0/3672644291 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a80035040 con 0x559fc0da9b40 2024-09-19T09:03:31.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.470+0000 7f3a71ffb640 1 -- 172.21.15.92:0/3672644291 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3a80005220 con 0x559fc0da9b40 2024-09-19T09:03:31.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.470+0000 7f3a92f5b740 1 -- 172.21.15.92:0/3672644291 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a7c013020 con 0x559fc0da9b40 2024-09-19T09:03:31.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.470+0000 7f3a71ffb640 1 -- 172.21.15.92:0/3672644291 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3a80005420 con 0x559fc0da9b40 2024-09-19T09:03:31.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.470+0000 7f3a92f5b740 10 client.16932 fetch_fsmap learned FSMap version 19 2024-09-19T09:03:31.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.470+0000 7f3a92f5b740 1 -- 172.21.15.92:0/3672644291 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x559fc0dc5f00 con 0x559fc0da9b40 2024-09-19T09:03:31.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.470+0000 7f3a71ffb640 1 -- 172.21.15.92:0/3672644291 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a7c013020 con 0x559fc0da9b40 2024-09-19T09:03:31.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.470+0000 7f3a71ffb640 1 -- 172.21.15.92:0/3672644291 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f3a80003ab0 con 0x559fc0da9b40 2024-09-19T09:03:31.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.470+0000 7f3a92f5b740 10 client.16932 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:03:31.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.470+0000 7f3a92f5b740 10 client.16932 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:03:31.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.470+0000 7f3a92f5b740 20 client.16932 populate_metadata read hostname 'smithi092' 2024-09-19T09:03:31.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.470+0000 7f3a92f5b740 1 --2- 172.21.15.92:0/3672644291 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559fc0dc7410 0x559fc0dc9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:31.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.470+0000 7f3a92f5b740 4 client.16932 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:31.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.470+0000 7f3a92f5b740 1 -- 172.21.15.92:0/3672644291 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559fc0d1b860 con 0x559fc0dc7410 2024-09-19T09:03:31.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.471+0000 7f3a89d9b640 1 --2- 172.21.15.92:0/3672644291 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559fc0dc7410 0x559fc0dc9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:31.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.471+0000 7f3a71ffb640 10 client.16932 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:31.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.471+0000 7f3a89d9b640 1 --2- 172.21.15.92:0/3672644291 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559fc0dc7410 0x559fc0dc9830 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14645bcdbffd4a1e server_cookie=3995476808b19a6d in_seq=0 out_seq=0 2024-09-19T09:03:31.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.472+0000 7f3a71ffb640 1 -- 172.21.15.92:0/3672644291 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559fc0d1b860 con 0x559fc0dc7410 2024-09-19T09:03:31.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.472+0000 7f3a71ffb640 10 client.16932 handle_command_reply: tid=0 2024-09-19T09:03:31.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.472+0000 7f3a92f5b740 1 client.16932 shutdown 2024-09-19T09:03:31.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.472+0000 7f3a92f5b740 1 -- 172.21.15.92:0/3672644291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fc0da9b40 msgr2=0x559fc0db4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:31.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.472+0000 7f3a92f5b740 1 --2- 172.21.15.92:0/3672644291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fc0da9b40 0x559fc0db4410 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f3a80009930 tx=0x7f3a80004510 comp rx=0 tx=0).stop 2024-09-19T09:03:31.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.472+0000 7f3a92f5b740 1 -- 172.21.15.92:0/3672644291 shutdown_connections 2024-09-19T09:03:31.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.472+0000 7f3a92f5b740 1 --2- 172.21.15.92:0/3672644291 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559fc0dc7410 0x559fc0dc9830 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.472+0000 7f3a92f5b740 1 --2- 172.21.15.92:0/3672644291 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559fc0db7780 0x559fc0db49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.472+0000 7f3a71ffb640 0 client.16932 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:31.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.472+0000 7f3a92f5b740 1 --2- 172.21.15.92:0/3672644291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fc0da9b40 0x559fc0db4410 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.472+0000 7f3a92f5b740 1 --2- 172.21.15.92:0/3672644291 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559fc0da85d0 0x559fc0db7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.472+0000 7f3a92f5b740 1 -- 172.21.15.92:0/3672644291 >> 172.21.15.92:0/3672644291 conn(0x559fc0d71310 msgr2=0x559fc0daa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:31.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.472+0000 7f3a92f5b740 1 -- 172.21.15.92:0/3672644291 shutdown_connections 2024-09-19T09:03:31.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.472+0000 7f3a92f5b740 1 -- 172.21.15.92:0/3672644291 wait complete. 2024-09-19T09:03:31.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.472+0000 7f3a92f5b740 20 client.16932 trim_cache size 0 max 16384 2024-09-19T09:03:31.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.485+0000 7f3a92f5b740 1 Processor -- start 2024-09-19T09:03:31.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.485+0000 7f3a92f5b740 1 -- start start 2024-09-19T09:03:31.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.485+0000 7f3a92f5b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559fc0da85d0 0x559fc0db43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:31.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.485+0000 7f3a92f5b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fc0da9b40 0x559fc0dc3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:31.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.485+0000 7f3a92f5b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559fc0db7780 0x559fc0db8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:31.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.485+0000 7f3a92f5b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3a8c1a9350 con 0x559fc0da9b40 2024-09-19T09:03:31.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.485+0000 7f3a92f5b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3a8c1abbf0 con 0x559fc0db7780 2024-09-19T09:03:31.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.485+0000 7f3a92f5b740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3a8c1a99e0 con 0x559fc0da85d0 2024-09-19T09:03:31.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.485+0000 7f3a8a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fc0da9b40 0x559fc0dc3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:31.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.485+0000 7f3a8a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fc0da9b40 0x559fc0dc3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46838/0 (socket says 172.21.15.92:46838) 2024-09-19T09:03:31.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.485+0000 7f3a8a59c640 1 -- 172.21.15.92:0/4127756374 learned_addr learned my addr 172.21.15.92:0/4127756374 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:31.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.486+0000 7f3a89d9b640 1 --2- 172.21.15.92:0/4127756374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559fc0db7780 0x559fc0db8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:31.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.486+0000 7f3a8a59c640 1 -- 172.21.15.92:0/4127756374 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559fc0da85d0 msgr2=0x559fc0db43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:31.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.486+0000 7f3a89d9b640 1 --2- 172.21.15.92:0/4127756374 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559fc0da85d0 0x559fc0db43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:31.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.486+0000 7f3a8a59c640 1 --2- 172.21.15.92:0/4127756374 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559fc0da85d0 0x559fc0db43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.486+0000 7f3a8a59c640 1 -- 172.21.15.92:0/4127756374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559fc0db7780 msgr2=0x559fc0db8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:31.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.486+0000 7f3a8a59c640 1 --2- 172.21.15.92:0/4127756374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559fc0db7780 0x559fc0db8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.486+0000 7f3a8a59c640 1 -- 172.21.15.92:0/4127756374 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fc0da4ed0 con 0x559fc0da9b40 2024-09-19T09:03:31.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.486+0000 7f3a8a59c640 1 --2- 172.21.15.92:0/4127756374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fc0da9b40 0x559fc0dc3720 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f3a80003f00 tx=0x7f3a8002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2944122dc2fb3747 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:31.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.486+0000 7f3a73fff640 1 -- 172.21.15.92:0/4127756374 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a80035030 con 0x559fc0da9b40 2024-09-19T09:03:31.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.486+0000 7f3a73fff640 1 -- 172.21.15.92:0/4127756374 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a800055c0 con 0x559fc0da9b40 2024-09-19T09:03:31.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.486+0000 7f3a73fff640 1 -- 172.21.15.92:0/4127756374 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a80003910 con 0x559fc0da9b40 2024-09-19T09:03:31.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.487+0000 7f3a92f5b740 1 -- 172.21.15.92:0/4127756374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fc0da9b40 msgr2=0x559fc0dc3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:31.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.487+0000 7f3a92f5b740 1 --2- 172.21.15.92:0/4127756374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fc0da9b40 0x559fc0dc3720 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f3a80003f00 tx=0x7f3a8002a420 comp rx=0 tx=0).stop 2024-09-19T09:03:31.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.487+0000 7f3a92f5b740 1 -- 172.21.15.92:0/4127756374 shutdown_connections 2024-09-19T09:03:31.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.487+0000 7f3a92f5b740 1 --2- 172.21.15.92:0/4127756374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559fc0db7780 0x559fc0db8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.487+0000 7f3a92f5b740 1 --2- 172.21.15.92:0/4127756374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fc0da9b40 0x559fc0dc3720 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.487+0000 7f3a92f5b740 1 --2- 172.21.15.92:0/4127756374 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559fc0da85d0 0x559fc0db43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.487+0000 7f3a92f5b740 1 -- 172.21.15.92:0/4127756374 >> 172.21.15.92:0/4127756374 conn(0x559fc0d71310 msgr2=0x559fc0db3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:31.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.487+0000 7f3a92f5b740 1 -- 172.21.15.92:0/4127756374 shutdown_connections 2024-09-19T09:03:31.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.487+0000 7f3a92f5b740 1 -- 172.21.15.92:0/4127756374 wait complete. 2024-09-19T09:03:31.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.487+0000 7f3a92f5b740 1 -- start start 2024-09-19T09:03:31.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.487+0000 7f3a92f5b740 1 Processor -- start 2024-09-19T09:03:31.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.487+0000 7f3a92f5b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fc0da85d0 0x559fc0dbfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:31.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.487+0000 7f3a92f5b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559fc0da9b40 0x559fc0dc00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:31.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.487+0000 7f3a92f5b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559fc0db7780 0x559fc0dce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:31.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.487+0000 7f3a92f5b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3a8c1aa0b0 con 0x559fc0da85d0 2024-09-19T09:03:31.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.487+0000 7f3a92f5b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3a8c1ab520 con 0x559fc0db7780 2024-09-19T09:03:31.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.487+0000 7f3a92f5b740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3a8c1aa780 con 0x559fc0da9b40 2024-09-19T09:03:31.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.487+0000 7f3a92f5b740 10 client.0 _ll_register_callbacks cb 0x7f3a80009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:31.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.487+0000 7f3a89d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fc0da85d0 0x559fc0dbfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:31.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.487+0000 7f3a89d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fc0da85d0 0x559fc0dbfb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46840/0 (socket says 172.21.15.92:46840) 2024-09-19T09:03:31.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.487+0000 7f3a89d9b640 1 -- 172.21.15.92:0/3403315431 learned_addr learned my addr 172.21.15.92:0/3403315431 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:31.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.488+0000 7f3a8a59c640 1 --2- 172.21.15.92:0/3403315431 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559fc0da9b40 0x559fc0dc00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:31.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.488+0000 7f3a89d9b640 1 --2- 172.21.15.92:0/3403315431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559fc0db7780 0x559fc0dce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:31.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.488+0000 7f3a89d9b640 1 -- 172.21.15.92:0/3403315431 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559fc0da9b40 msgr2=0x559fc0dc00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:31.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.488+0000 7f3a89d9b640 1 --2- 172.21.15.92:0/3403315431 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559fc0da9b40 0x559fc0dc00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.488+0000 7f3a89d9b640 1 -- 172.21.15.92:0/3403315431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559fc0db7780 msgr2=0x559fc0dce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:31.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.488+0000 7f3a89d9b640 1 --2- 172.21.15.92:0/3403315431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559fc0db7780 0x559fc0dce800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.488+0000 7f3a89d9b640 1 -- 172.21.15.92:0/3403315431 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fc0dcf030 con 0x559fc0da85d0 2024-09-19T09:03:31.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.488+0000 7f3a89d9b640 1 --2- 172.21.15.92:0/3403315431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fc0da85d0 0x559fc0dbfb80 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c0117b0 tx=0x7f3a80005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65e39df4eda1b894 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:31.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.488+0000 7f3a71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:03:31.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.488+0000 7f3a71ffb640 1 -- 172.21.15.92:0/3403315431 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c019040 con 0x559fc0da85d0 2024-09-19T09:03:31.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.488+0000 7f3a71ffb640 1 -- 172.21.15.92:0/3403315431 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3a7c013220 con 0x559fc0da85d0 2024-09-19T09:03:31.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.488+0000 7f3a92f5b740 1 -- 172.21.15.92:0/3403315431 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a800055c0 con 0x559fc0da85d0 2024-09-19T09:03:31.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.488+0000 7f3a71ffb640 1 -- 172.21.15.92:0/3403315431 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3a7c0049e0 con 0x559fc0da85d0 2024-09-19T09:03:31.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.488+0000 7f3a92f5b740 10 client.16938 fetch_fsmap learned FSMap version 19 2024-09-19T09:03:31.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.488+0000 7f3a92f5b740 1 -- 172.21.15.92:0/3403315431 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x559fc0dbf3f0 con 0x559fc0da85d0 2024-09-19T09:03:31.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.488+0000 7f3a71ffb640 1 -- 172.21.15.92:0/3403315431 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a800055c0 con 0x559fc0da85d0 2024-09-19T09:03:31.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.489+0000 7f3a71ffb640 1 -- 172.21.15.92:0/3403315431 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f3a7c02aae0 con 0x559fc0da85d0 2024-09-19T09:03:31.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.489+0000 7f3a92f5b740 10 client.16938 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:03:31.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.489+0000 7f3a92f5b740 10 client.16938 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:03:31.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.489+0000 7f3a92f5b740 20 client.16938 populate_metadata read hostname 'smithi092' 2024-09-19T09:03:31.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.489+0000 7f3a92f5b740 1 --2- 172.21.15.92:0/3403315431 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559fc0e320b0 0x559fc0e344a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:31.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.489+0000 7f3a92f5b740 4 client.16938 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:03:31.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.489+0000 7f3a92f5b740 1 -- 172.21.15.92:0/3403315431 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559fc0d15d70 con 0x559fc0e320b0 2024-09-19T09:03:31.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.489+0000 7f3a8a59c640 1 --2- 172.21.15.92:0/3403315431 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559fc0e320b0 0x559fc0e344a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:31.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.489+0000 7f3a71ffb640 10 client.16938 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:31.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.489+0000 7f3a8a59c640 1 --2- 172.21.15.92:0/3403315431 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559fc0e320b0 0x559fc0e344a0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9e7070b959f7c server_cookie=7315aabadaa2c959 in_seq=0 out_seq=0 2024-09-19T09:03:31.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.490+0000 7f3a71ffb640 1 -- 172.21.15.92:0/3403315431 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559fc0d15d70 con 0x559fc0e320b0 2024-09-19T09:03:31.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.490+0000 7f3a71ffb640 10 client.16938 handle_command_reply: tid=0 2024-09-19T09:03:31.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.490+0000 7f3a92f5b740 1 client.16938 shutdown 2024-09-19T09:03:31.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.490+0000 7f3a92f5b740 1 -- 172.21.15.92:0/3403315431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fc0da85d0 msgr2=0x559fc0dbfb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:31.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.490+0000 7f3a92f5b740 1 --2- 172.21.15.92:0/3403315431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fc0da85d0 0x559fc0dbfb80 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c0117b0 tx=0x7f3a80005c00 comp rx=0 tx=0).stop 2024-09-19T09:03:31.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.490+0000 7f3a92f5b740 1 -- 172.21.15.92:0/3403315431 shutdown_connections 2024-09-19T09:03:31.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.490+0000 7f3a92f5b740 1 --2- 172.21.15.92:0/3403315431 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559fc0e320b0 0x559fc0e344a0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.490+0000 7f3a92f5b740 1 --2- 172.21.15.92:0/3403315431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559fc0db7780 0x559fc0dce800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.490+0000 7f3a92f5b740 1 --2- 172.21.15.92:0/3403315431 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559fc0da9b40 0x559fc0dc00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.490+0000 7f3a92f5b740 1 --2- 172.21.15.92:0/3403315431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559fc0da85d0 0x559fc0dbfb80 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.490+0000 7f3a92f5b740 1 -- 172.21.15.92:0/3403315431 >> 172.21.15.92:0/3403315431 conn(0x559fc0d71310 msgr2=0x559fc0db6490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:31.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.490+0000 7f3a71ffb640 0 client.16938 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:31.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.490+0000 7f3a92f5b740 1 -- 172.21.15.92:0/3403315431 shutdown_connections 2024-09-19T09:03:31.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.490+0000 7f3a92f5b740 1 -- 172.21.15.92:0/3403315431 wait complete. 2024-09-19T09:03:31.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.490+0000 7f3a92f5b740 20 client.16938 trim_cache size 0 max 16384 2024-09-19T09:03:31.502 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-19T09:03:31.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.490+0000 7f3a90b82640 1 -- 172.21.15.92:0/3184390171 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3a740a3240 msgr2=0x7f3a740a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:31.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.490+0000 7f3a90b82640 1 --2- 172.21.15.92:0/3184390171 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3a740a3240 0x7f3a740a5700 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3a84000c00 tx=0x7f3a840158f0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.490+0000 7f3a90b82640 1 -- 172.21.15.92:0/3184390171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a8c106a80 msgr2=0x7f3a8c1a4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:31.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.490+0000 7f3a90b82640 1 --2- 172.21.15.92:0/3184390171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a8c106a80 0x7f3a8c1a4340 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f3a84009fd0 tx=0x7f3a8400b8e0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.491+0000 7f3a90b82640 1 -- 172.21.15.92:0/3184390171 shutdown_connections 2024-09-19T09:03:31.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.491+0000 7f3a90b82640 1 --2- 172.21.15.92:0/3184390171 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3a740a3240 0x7f3a740a5700 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.491+0000 7f3a90b82640 1 --2- 172.21.15.92:0/3184390171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a8c106a80 0x7f3a8c1a4340 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.491+0000 7f3a90b82640 1 --2- 172.21.15.92:0/3184390171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a8c101420 0x7f3a8c199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.491+0000 7f3a90b82640 1 --2- 172.21.15.92:0/3184390171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a8c100a80 0x7f3a8c1992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.491+0000 7f3a90b82640 1 -- 172.21.15.92:0/3184390171 >> 172.21.15.92:0/3184390171 conn(0x7f3a8c0fc7a0 msgr2=0x7f3a8c0fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:31.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.491+0000 7f3a90b82640 1 -- 172.21.15.92:0/3184390171 shutdown_connections 2024-09-19T09:03:31.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:31.491+0000 7f3a90b82640 1 -- 172.21.15.92:0/3184390171 wait complete. 2024-09-19T09:03:31.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:31 smithi092 ceph-mon[31407]: pgmap v541: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 4.4 MiB/s wr, 468 op/s 2024-09-19T09:03:31.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:31 smithi167 ceph-mon[35359]: pgmap v541: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 4.4 MiB/s wr, 468 op/s 2024-09-19T09:03:31.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:31 smithi190 ceph-mon[35358]: pgmap v541: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 4.4 MiB/s wr, 468 op/s 2024-09-19T09:03:33.170 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:03:33.171 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:03:33.424 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:33.786 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:33 smithi092 ceph-mon[31407]: pgmap v542: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 3.8 MiB/s wr, 399 op/s 2024-09-19T09:03:33.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:33 smithi167 ceph-mon[35359]: pgmap v542: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 3.8 MiB/s wr, 399 op/s 2024-09-19T09:03:33.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.870+0000 7f3ba21b9640 1 -- 172.21.15.92:0/1187393778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b9c101430 msgr2=0x7f3b9c10d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:33.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.870+0000 7f3ba21b9640 1 --2- 172.21.15.92:0/1187393778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b9c101430 0x7f3b9c10d960 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f3b94009cd0 tx=0x7f3b9402a8e0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.870+0000 7f3ba21b9640 1 -- 172.21.15.92:0/1187393778 shutdown_connections 2024-09-19T09:03:33.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.870+0000 7f3ba21b9640 1 --2- 172.21.15.92:0/1187393778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b9c101430 0x7f3b9c10d960 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.870+0000 7f3ba21b9640 1 --2- 172.21.15.92:0/1187393778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b9c100a90 0x7f3b9c100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.870+0000 7f3ba21b9640 1 --2- 172.21.15.92:0/1187393778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b9c106a90 0x7f3b9c106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.870+0000 7f3ba21b9640 1 -- 172.21.15.92:0/1187393778 >> 172.21.15.92:0/1187393778 conn(0x7f3b9c0fc7d0 msgr2=0x7f3b9c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:33.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.870+0000 7f3ba21b9640 1 -- 172.21.15.92:0/1187393778 shutdown_connections 2024-09-19T09:03:33.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.870+0000 7f3ba21b9640 1 -- 172.21.15.92:0/1187393778 wait complete. 2024-09-19T09:03:33.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.871+0000 7f3ba21b9640 1 Processor -- start 2024-09-19T09:03:33.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.871+0000 7f3ba21b9640 1 -- start start 2024-09-19T09:03:33.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.871+0000 7f3ba21b9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b9c100a90 0x7f3b9c1984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.871+0000 7f3ba21b9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b9c101430 0x7f3b9c198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.871+0000 7f3ba21b9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b9c106a90 0x7f3b9c19cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.871+0000 7f3ba21b9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3b9c110e90 con 0x7f3b9c106a90 2024-09-19T09:03:33.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.871+0000 7f3ba21b9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3b9c110d10 con 0x7f3b9c101430 2024-09-19T09:03:33.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.871+0000 7f3ba21b9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3b9c111010 con 0x7f3b9c100a90 2024-09-19T09:03:33.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.871+0000 7f3b9bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b9c106a90 0x7f3b9c19cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.871+0000 7f3b9bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b9c106a90 0x7f3b9c19cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46852/0 (socket says 172.21.15.92:46852) 2024-09-19T09:03:33.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.871+0000 7f3b9bfff640 1 -- 172.21.15.92:0/3049515144 learned_addr learned my addr 172.21.15.92:0/3049515144 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:33.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.871+0000 7f3b9affd640 1 --2- 172.21.15.92:0/3049515144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b9c101430 0x7f3b9c198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.871+0000 7f3b9b7fe640 1 --2- 172.21.15.92:0/3049515144 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b9c100a90 0x7f3b9c1984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.872+0000 7f3b9bfff640 1 -- 172.21.15.92:0/3049515144 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b9c100a90 msgr2=0x7f3b9c1984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:33.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.872+0000 7f3b9bfff640 1 --2- 172.21.15.92:0/3049515144 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b9c100a90 0x7f3b9c1984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.872+0000 7f3b9bfff640 1 -- 172.21.15.92:0/3049515144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b9c101430 msgr2=0x7f3b9c198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:33.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.872+0000 7f3b9bfff640 1 --2- 172.21.15.92:0/3049515144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b9c101430 0x7f3b9c198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.872+0000 7f3b9bfff640 1 -- 172.21.15.92:0/3049515144 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b9c19d490 con 0x7f3b9c106a90 2024-09-19T09:03:33.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.872+0000 7f3b9bfff640 1 --2- 172.21.15.92:0/3049515144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b9c106a90 0x7f3b9c19cdb0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f3b94005cc0 tx=0x7f3b94003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:33.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.872+0000 7f3b98ff9640 1 -- 172.21.15.92:0/3049515144 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b94004040 con 0x7f3b9c106a90 2024-09-19T09:03:33.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.872+0000 7f3ba21b9640 1 -- 172.21.15.92:0/3049515144 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b9c19d720 con 0x7f3b9c106a90 2024-09-19T09:03:33.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.872+0000 7f3ba21b9640 1 -- 172.21.15.92:0/3049515144 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b9c1a5060 con 0x7f3b9c106a90 2024-09-19T09:03:33.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.872+0000 7f3b98ff9640 1 -- 172.21.15.92:0/3049515144 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b940046c0 con 0x7f3b9c106a90 2024-09-19T09:03:33.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.872+0000 7f3b98ff9640 1 -- 172.21.15.92:0/3049515144 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b94030e70 con 0x7f3b9c106a90 2024-09-19T09:03:33.879 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:33 smithi190 ceph-mon[35358]: pgmap v542: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 3.8 MiB/s wr, 399 op/s 2024-09-19T09:03:33.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.874+0000 7f3b98ff9640 1 -- 172.21.15.92:0/3049515144 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3b940305a0 con 0x7f3b9c106a90 2024-09-19T09:03:33.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.875+0000 7f3b98ff9640 1 --2- 172.21.15.92:0/3049515144 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3b840a32c0 0x7f3b840a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.875+0000 7f3b9b7fe640 1 --2- 172.21.15.92:0/3049515144 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3b840a32c0 0x7f3b840a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.875+0000 7f3b98ff9640 1 -- 172.21.15.92:0/3049515144 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3b9402e030 con 0x7f3b9c106a90 2024-09-19T09:03:33.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.875+0000 7f3b9b7fe640 1 --2- 172.21.15.92:0/3049515144 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3b840a32c0 0x7f3b840a5780 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3b90005fd0 tx=0x7f3b90005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:33.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.876+0000 7f3ba4592740 1 Processor -- start 2024-09-19T09:03:33.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.876+0000 7f3ba4592740 1 -- start start 2024-09-19T09:03:33.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.876+0000 7f3ba4592740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55748e53eb60 0x55748e53ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.876+0000 7f3ba4592740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55748e53f480 0x55748e549800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.876+0000 7f3ba4592740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55748e549d40 0x55748e54c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.876+0000 7f3ba4592740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55748e4a4280 con 0x55748e53eb60 2024-09-19T09:03:33.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.876+0000 7f3ba4592740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55748e44bb10 con 0x55748e53f480 2024-09-19T09:03:33.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.876+0000 7f3ba4592740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55748e4a0240 con 0x55748e549d40 2024-09-19T09:03:33.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.876+0000 7f3b9b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55748e53eb60 0x55748e53ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.876+0000 7f3b9b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55748e53eb60 0x55748e53ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46862/0 (socket says 172.21.15.92:46862) 2024-09-19T09:03:33.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.876+0000 7f3b9b7fe640 1 -- 172.21.15.92:0/1136489748 learned_addr learned my addr 172.21.15.92:0/1136489748 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:33.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.876+0000 7f3b9affd640 1 --2- 172.21.15.92:0/1136489748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55748e53f480 0x55748e549800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.876+0000 7f3b9bfff640 1 --2- 172.21.15.92:0/1136489748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55748e549d40 0x55748e54c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.876+0000 7f3b9b7fe640 1 -- 172.21.15.92:0/1136489748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55748e549d40 msgr2=0x55748e54c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:33.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.876+0000 7f3b9b7fe640 1 --2- 172.21.15.92:0/1136489748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55748e549d40 0x55748e54c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.876+0000 7f3b9b7fe640 1 -- 172.21.15.92:0/1136489748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55748e53f480 msgr2=0x55748e549800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:33.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.876+0000 7f3b9b7fe640 1 --2- 172.21.15.92:0/1136489748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55748e53f480 0x55748e549800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.876+0000 7f3b9b7fe640 1 -- 172.21.15.92:0/1136489748 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55748e4581f0 con 0x55748e53eb60 2024-09-19T09:03:33.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.877+0000 7f3b9b7fe640 1 --2- 172.21.15.92:0/1136489748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55748e53eb60 0x55748e53ef40 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000fe50 tx=0x7f3b90012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=814dfb684835832 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:33.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.877+0000 7f3b81ffb640 1 -- 172.21.15.92:0/1136489748 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b90022070 con 0x55748e53eb60 2024-09-19T09:03:33.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.877+0000 7f3b81ffb640 1 -- 172.21.15.92:0/1136489748 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b9000fe80 con 0x55748e53eb60 2024-09-19T09:03:33.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.877+0000 7f3b81ffb640 1 -- 172.21.15.92:0/1136489748 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b90010a20 con 0x55748e53eb60 2024-09-19T09:03:33.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.878+0000 7f3ba4592740 1 -- 172.21.15.92:0/1136489748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55748e53eb60 msgr2=0x55748e53ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:33.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.878+0000 7f3ba4592740 1 --2- 172.21.15.92:0/1136489748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55748e53eb60 0x55748e53ef40 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000fe50 tx=0x7f3b90012000 comp rx=0 tx=0).stop 2024-09-19T09:03:33.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.878+0000 7f3ba4592740 1 -- 172.21.15.92:0/1136489748 shutdown_connections 2024-09-19T09:03:33.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.878+0000 7f3ba4592740 1 --2- 172.21.15.92:0/1136489748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55748e549d40 0x55748e54c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.878+0000 7f3ba4592740 1 --2- 172.21.15.92:0/1136489748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55748e53f480 0x55748e549800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.878+0000 7f3ba4592740 1 --2- 172.21.15.92:0/1136489748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55748e53eb60 0x55748e53ef40 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.878+0000 7f3ba4592740 1 -- 172.21.15.92:0/1136489748 >> 172.21.15.92:0/1136489748 conn(0x55748e53b0f0 msgr2=0x55748e53b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:33.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.878+0000 7f3ba4592740 1 -- 172.21.15.92:0/1136489748 shutdown_connections 2024-09-19T09:03:33.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.878+0000 7f3ba4592740 1 -- 172.21.15.92:0/1136489748 wait complete. 2024-09-19T09:03:33.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.878+0000 7f3ba4592740 1 -- start start 2024-09-19T09:03:33.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.878+0000 7f3ba4592740 1 Processor -- start 2024-09-19T09:03:33.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.879+0000 7f3ba4592740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55748e53eb60 0x55748e546b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.879+0000 7f3ba4592740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55748e53f480 0x55748e5470a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.879+0000 7f3ba4592740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55748e549d40 0x55748e5475e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.879+0000 7f3ba4592740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55748e54c910 con 0x55748e53eb60 2024-09-19T09:03:33.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.879+0000 7f3ba4592740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55748e45ef10 con 0x55748e549d40 2024-09-19T09:03:33.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.879+0000 7f3ba4592740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55748e54ca90 con 0x55748e53f480 2024-09-19T09:03:33.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.879+0000 7f3b9b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55748e53eb60 0x55748e546b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.879+0000 7f3ba4592740 10 client.0 _ll_register_callbacks cb 0x55748e427a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:33.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.879+0000 7f3b9b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55748e53eb60 0x55748e546b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46866/0 (socket says 172.21.15.92:46866) 2024-09-19T09:03:33.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.879+0000 7f3b9b7fe640 1 -- 172.21.15.92:0/3645743221 learned_addr learned my addr 172.21.15.92:0/3645743221 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:33.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.879+0000 7f3b9affd640 1 --2- 172.21.15.92:0/3645743221 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55748e53f480 0x55748e5470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.879+0000 7f3b9bfff640 1 --2- 172.21.15.92:0/3645743221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55748e549d40 0x55748e5475e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.879+0000 7f3b9b7fe640 1 -- 172.21.15.92:0/3645743221 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55748e53f480 msgr2=0x55748e5470a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:33.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.879+0000 7f3b9b7fe640 1 --2- 172.21.15.92:0/3645743221 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55748e53f480 0x55748e5470a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.879+0000 7f3b9b7fe640 1 -- 172.21.15.92:0/3645743221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55748e549d40 msgr2=0x55748e5475e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:33.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.879+0000 7f3b9b7fe640 1 --2- 172.21.15.92:0/3645743221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55748e549d40 0x55748e5475e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.879+0000 7f3b9b7fe640 1 -- 172.21.15.92:0/3645743221 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55748e2156a0 con 0x55748e53eb60 2024-09-19T09:03:33.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.879+0000 7f3b9bfff640 1 --2- 172.21.15.92:0/3645743221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55748e549d40 0x55748e5475e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:33.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.879+0000 7f3b9b7fe640 1 --2- 172.21.15.92:0/3645743221 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55748e53eb60 0x55748e546b60 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000bfd0 tx=0x7f3b90010950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ec2e2d79e6b823d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:33.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.879+0000 7f3b7affd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:03:33.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.880+0000 7f3b7affd640 1 -- 172.21.15.92:0/3645743221 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b90036060 con 0x55748e53eb60 2024-09-19T09:03:33.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.880+0000 7f3b7affd640 1 -- 172.21.15.92:0/3645743221 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3b90010cd0 con 0x55748e53eb60 2024-09-19T09:03:33.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.880+0000 7f3ba4592740 1 -- 172.21.15.92:0/3645743221 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55748e4b17f0 con 0x55748e53eb60 2024-09-19T09:03:33.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.880+0000 7f3b7affd640 1 -- 172.21.15.92:0/3645743221 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3b90022050 con 0x55748e53eb60 2024-09-19T09:03:33.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.880+0000 7f3ba4592740 10 client.16950 fetch_fsmap learned FSMap version 19 2024-09-19T09:03:33.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.880+0000 7f3ba4592740 1 -- 172.21.15.92:0/3645743221 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55748e558550 con 0x55748e53eb60 2024-09-19T09:03:33.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.880+0000 7f3b7affd640 1 -- 172.21.15.92:0/3645743221 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b9001e930 con 0x55748e53eb60 2024-09-19T09:03:33.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.880+0000 7f3b7affd640 1 -- 172.21.15.92:0/3645743221 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f3b9003b070 con 0x55748e53eb60 2024-09-19T09:03:33.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.880+0000 7f3ba4592740 10 client.16950 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:03:33.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.880+0000 7f3ba4592740 10 client.16950 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:03:33.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.880+0000 7f3ba4592740 20 client.16950 populate_metadata read hostname 'smithi092' 2024-09-19T09:03:33.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.880+0000 7f3ba4592740 1 --2- 172.21.15.92:0/3645743221 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55748e559a10 0x55748e55be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.880+0000 7f3ba4592740 4 client.16950 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:33.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.880+0000 7f3ba4592740 1 -- 172.21.15.92:0/3645743221 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55748e4b17f0 con 0x55748e559a10 2024-09-19T09:03:33.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.881+0000 7f3b9affd640 1 --2- 172.21.15.92:0/3645743221 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55748e559a10 0x55748e55be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.881+0000 7f3b9affd640 1 --2- 172.21.15.92:0/3645743221 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55748e559a10 0x55748e55be00 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5bbef19b3b139b7 server_cookie=9080f10dc0a237d1 in_seq=0 out_seq=0 2024-09-19T09:03:33.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.881+0000 7f3b7affd640 10 client.16950 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:33.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.882+0000 7f3b7affd640 1 -- 172.21.15.92:0/3645743221 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55748e4b17f0 con 0x55748e559a10 2024-09-19T09:03:33.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.882+0000 7f3b7affd640 10 client.16950 handle_command_reply: tid=0 2024-09-19T09:03:33.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.882+0000 7f3ba4592740 1 client.16950 shutdown 2024-09-19T09:03:33.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.882+0000 7f3ba4592740 1 -- 172.21.15.92:0/3645743221 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55748e53eb60 msgr2=0x55748e546b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:33.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.882+0000 7f3ba4592740 1 --2- 172.21.15.92:0/3645743221 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55748e53eb60 0x55748e546b60 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000bfd0 tx=0x7f3b90010950 comp rx=0 tx=0).stop 2024-09-19T09:03:33.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.882+0000 7f3ba4592740 1 -- 172.21.15.92:0/3645743221 shutdown_connections 2024-09-19T09:03:33.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.882+0000 7f3ba4592740 1 --2- 172.21.15.92:0/3645743221 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55748e559a10 0x55748e55be00 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.882+0000 7f3ba4592740 1 --2- 172.21.15.92:0/3645743221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55748e549d40 0x55748e5475e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.882+0000 7f3ba4592740 1 --2- 172.21.15.92:0/3645743221 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55748e53f480 0x55748e5470a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.882+0000 7f3ba4592740 1 --2- 172.21.15.92:0/3645743221 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55748e53eb60 0x55748e546b60 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.882+0000 7f3ba4592740 1 -- 172.21.15.92:0/3645743221 >> 172.21.15.92:0/3645743221 conn(0x55748e53b0f0 msgr2=0x55748e53a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:33.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.882+0000 7f3b7affd640 0 client.16950 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:33.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.882+0000 7f3ba4592740 1 -- 172.21.15.92:0/3645743221 shutdown_connections 2024-09-19T09:03:33.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.882+0000 7f3ba4592740 1 -- 172.21.15.92:0/3645743221 wait complete. 2024-09-19T09:03:33.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.882+0000 7f3ba4592740 20 client.16950 trim_cache size 0 max 16384 2024-09-19T09:03:33.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.899+0000 7f3ba4592740 1 Processor -- start 2024-09-19T09:03:33.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.899+0000 7f3ba4592740 1 -- start start 2024-09-19T09:03:33.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.900+0000 7f3ba4592740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55748e53eb60 0x55748e5614f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.900+0000 7f3ba4592740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55748e53f480 0x55748e561a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.900+0000 7f3ba4592740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55748e549d40 0x55748e554bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.900+0000 7f3ba4592740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8800c460 con 0x55748e549d40 2024-09-19T09:03:33.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.900+0000 7f3ba4592740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8800ed00 con 0x55748e53eb60 2024-09-19T09:03:33.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.900+0000 7f3ba4592740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8800caf0 con 0x55748e53f480 2024-09-19T09:03:33.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.900+0000 7f3b9bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55748e549d40 0x55748e554bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.900+0000 7f3b9bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55748e549d40 0x55748e554bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46882/0 (socket says 172.21.15.92:46882) 2024-09-19T09:03:33.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.900+0000 7f3b9bfff640 1 -- 172.21.15.92:0/1378765514 learned_addr learned my addr 172.21.15.92:0/1378765514 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:33.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.900+0000 7f3b9affd640 1 --2- 172.21.15.92:0/1378765514 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55748e53f480 0x55748e561a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.900+0000 7f3b9b7fe640 1 --2- 172.21.15.92:0/1378765514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55748e53eb60 0x55748e5614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.900+0000 7f3b9bfff640 1 -- 172.21.15.92:0/1378765514 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55748e53f480 msgr2=0x55748e561a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:33.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.900+0000 7f3b9bfff640 1 --2- 172.21.15.92:0/1378765514 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55748e53f480 0x55748e561a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.900+0000 7f3b9bfff640 1 -- 172.21.15.92:0/1378765514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55748e53eb60 msgr2=0x55748e5614f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:33.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.900+0000 7f3b9bfff640 1 --2- 172.21.15.92:0/1378765514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55748e53eb60 0x55748e5614f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.900+0000 7f3b9bfff640 1 -- 172.21.15.92:0/1378765514 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55748e53af20 con 0x55748e549d40 2024-09-19T09:03:33.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.900+0000 7f3b9bfff640 1 --2- 172.21.15.92:0/1378765514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55748e549d40 0x55748e554bc0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f3b940bcb10 tx=0x7f3b9403d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=492a797ae2726034 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:33.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.900+0000 7f3b817fa640 1 -- 172.21.15.92:0/1378765514 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b940098b0 con 0x55748e549d40 2024-09-19T09:03:33.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.901+0000 7f3b817fa640 1 -- 172.21.15.92:0/1378765514 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b94036040 con 0x55748e549d40 2024-09-19T09:03:33.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.901+0000 7f3b817fa640 1 -- 172.21.15.92:0/1378765514 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b940bc260 con 0x55748e549d40 2024-09-19T09:03:33.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.901+0000 7f3ba4592740 1 -- 172.21.15.92:0/1378765514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55748e549d40 msgr2=0x55748e554bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:33.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.901+0000 7f3ba4592740 1 --2- 172.21.15.92:0/1378765514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55748e549d40 0x55748e554bc0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f3b940bcb10 tx=0x7f3b9403d040 comp rx=0 tx=0).stop 2024-09-19T09:03:33.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.901+0000 7f3ba4592740 1 -- 172.21.15.92:0/1378765514 shutdown_connections 2024-09-19T09:03:33.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.901+0000 7f3ba4592740 1 --2- 172.21.15.92:0/1378765514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55748e549d40 0x55748e554bc0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.901+0000 7f3ba4592740 1 --2- 172.21.15.92:0/1378765514 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55748e53f480 0x55748e561a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.901+0000 7f3ba4592740 1 --2- 172.21.15.92:0/1378765514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55748e53eb60 0x55748e5614f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.901+0000 7f3ba4592740 1 -- 172.21.15.92:0/1378765514 >> 172.21.15.92:0/1378765514 conn(0x55748e53b0f0 msgr2=0x55748e545c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:33.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.901+0000 7f3ba4592740 1 -- 172.21.15.92:0/1378765514 shutdown_connections 2024-09-19T09:03:33.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.901+0000 7f3ba4592740 1 -- 172.21.15.92:0/1378765514 wait complete. 2024-09-19T09:03:33.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.902+0000 7f3ba4592740 1 -- start start 2024-09-19T09:03:33.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.902+0000 7f3ba4592740 1 Processor -- start 2024-09-19T09:03:33.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.902+0000 7f3ba4592740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55748e53eb60 0x55748e552350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.902+0000 7f3ba4592740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55748e53f480 0x55748e543820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.902+0000 7f3ba4592740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55748e549d40 0x55748e543d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.902+0000 7f3ba4592740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8800d1c0 con 0x55748e53eb60 2024-09-19T09:03:33.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.902+0000 7f3ba4592740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8800e630 con 0x55748e549d40 2024-09-19T09:03:33.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.902+0000 7f3ba4592740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8800d890 con 0x55748e53f480 2024-09-19T09:03:33.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.902+0000 7f3ba4592740 10 client.0 _ll_register_callbacks cb 0x7f3b8c00a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:33.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.902+0000 7f3b9b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55748e53eb60 0x55748e552350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.902+0000 7f3b9b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55748e53eb60 0x55748e552350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46898/0 (socket says 172.21.15.92:46898) 2024-09-19T09:03:33.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.902+0000 7f3b9b7fe640 1 -- 172.21.15.92:0/3515264733 learned_addr learned my addr 172.21.15.92:0/3515264733 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:33.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.903+0000 7f3b9affd640 1 --2- 172.21.15.92:0/3515264733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55748e53f480 0x55748e543820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.903+0000 7f3b9bfff640 1 --2- 172.21.15.92:0/3515264733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55748e549d40 0x55748e543d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.903+0000 7f3b9b7fe640 1 -- 172.21.15.92:0/3515264733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55748e53f480 msgr2=0x55748e543820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:33.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.903+0000 7f3b9b7fe640 1 --2- 172.21.15.92:0/3515264733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55748e53f480 0x55748e543820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.903+0000 7f3b9b7fe640 1 -- 172.21.15.92:0/3515264733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55748e549d40 msgr2=0x55748e543d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:33.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.903+0000 7f3b9b7fe640 1 --2- 172.21.15.92:0/3515264733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55748e549d40 0x55748e543d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.903+0000 7f3b9b7fe640 1 -- 172.21.15.92:0/3515264733 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55748e544470 con 0x55748e53eb60 2024-09-19T09:03:33.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.903+0000 7f3b9bfff640 1 --2- 172.21.15.92:0/3515264733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55748e549d40 0x55748e543d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:33.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.903+0000 7f3b9b7fe640 1 --2- 172.21.15.92:0/3515264733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55748e53eb60 0x55748e552350 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000b8e0 tx=0x7f3b9000fde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=577b76bbf773e6ad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:33.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.903+0000 7f3b7affd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:03:33.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.903+0000 7f3b7affd640 1 -- 172.21.15.92:0/3515264733 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b90041070 con 0x55748e53eb60 2024-09-19T09:03:33.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.903+0000 7f3b7affd640 1 -- 172.21.15.92:0/3515264733 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3b90031b50 con 0x55748e53eb60 2024-09-19T09:03:33.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.903+0000 7f3ba4592740 1 -- 172.21.15.92:0/3515264733 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b94036040 con 0x55748e53eb60 2024-09-19T09:03:33.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.903+0000 7f3b7affd640 1 -- 172.21.15.92:0/3515264733 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3b9004c050 con 0x55748e53eb60 2024-09-19T09:03:33.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.903+0000 7f3ba4592740 10 client.16956 fetch_fsmap learned FSMap version 19 2024-09-19T09:03:33.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.903+0000 7f3ba4592740 1 -- 172.21.15.92:0/3515264733 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55748e5c4440 con 0x55748e53eb60 2024-09-19T09:03:33.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.904+0000 7f3b7affd640 1 -- 172.21.15.92:0/3515264733 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b94036040 con 0x55748e53eb60 2024-09-19T09:03:33.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.904+0000 7f3b7affd640 1 -- 172.21.15.92:0/3515264733 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f3b9003b040 con 0x55748e53eb60 2024-09-19T09:03:33.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.904+0000 7f3ba4592740 10 client.16956 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:03:33.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.904+0000 7f3ba4592740 10 client.16956 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:03:33.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.904+0000 7f3ba4592740 20 client.16956 populate_metadata read hostname 'smithi092' 2024-09-19T09:03:33.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.904+0000 7f3ba4592740 1 --2- 172.21.15.92:0/3515264733 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55748e5c4aa0 0x55748e5c6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.904+0000 7f3ba4592740 4 client.16956 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:03:33.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.904+0000 7f3ba4592740 1 -- 172.21.15.92:0/3515264733 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55748e4abd00 con 0x55748e5c4aa0 2024-09-19T09:03:33.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.904+0000 7f3b9affd640 1 --2- 172.21.15.92:0/3515264733 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55748e5c4aa0 0x55748e5c6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.905+0000 7f3b9affd640 1 --2- 172.21.15.92:0/3515264733 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55748e5c4aa0 0x55748e5c6ec0 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47e9ffea079a0801 server_cookie=eff6aa17165ab7ed in_seq=0 out_seq=0 2024-09-19T09:03:33.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.905+0000 7f3b7affd640 10 client.16956 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:33.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.906+0000 7f3b7affd640 1 -- 172.21.15.92:0/3515264733 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55748e4abd00 con 0x55748e5c4aa0 2024-09-19T09:03:33.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.906+0000 7f3b7affd640 10 client.16956 handle_command_reply: tid=0 2024-09-19T09:03:33.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.906+0000 7f3ba4592740 1 client.16956 shutdown 2024-09-19T09:03:33.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.906+0000 7f3ba4592740 1 -- 172.21.15.92:0/3515264733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55748e53eb60 msgr2=0x55748e552350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:33.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.906+0000 7f3ba4592740 1 --2- 172.21.15.92:0/3515264733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55748e53eb60 0x55748e552350 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000b8e0 tx=0x7f3b9000fde0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.906+0000 7f3ba4592740 1 -- 172.21.15.92:0/3515264733 shutdown_connections 2024-09-19T09:03:33.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.906+0000 7f3ba4592740 1 --2- 172.21.15.92:0/3515264733 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55748e5c4aa0 0x55748e5c6ec0 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.906+0000 7f3ba4592740 1 --2- 172.21.15.92:0/3515264733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55748e549d40 0x55748e543d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.906+0000 7f3ba4592740 1 --2- 172.21.15.92:0/3515264733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55748e53f480 0x55748e543820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.906+0000 7f3b7affd640 0 client.16956 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:33.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.906+0000 7f3ba4592740 1 --2- 172.21.15.92:0/3515264733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55748e53eb60 0x55748e552350 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.906+0000 7f3ba4592740 1 -- 172.21.15.92:0/3515264733 >> 172.21.15.92:0/3515264733 conn(0x55748e53b0f0 msgr2=0x55748e5405b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:33.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.906+0000 7f3ba4592740 1 -- 172.21.15.92:0/3515264733 shutdown_connections 2024-09-19T09:03:33.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.906+0000 7f3ba4592740 1 -- 172.21.15.92:0/3515264733 wait complete. 2024-09-19T09:03:33.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.906+0000 7f3ba4592740 20 client.16956 trim_cache size 0 max 16384 2024-09-19T09:03:33.914 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:03:33.915 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-19T09:03:33.915 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "bc17e676-4781-4f5b-a4d7-09ca51b1ff10", 2024-09-19T09:03:33.915 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-19T09:03:33.915 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:03:33.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.907+0000 7f3ba21b9640 1 -- 172.21.15.92:0/3049515144 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3b840a32c0 msgr2=0x7f3b840a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:33.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.907+0000 7f3ba21b9640 1 --2- 172.21.15.92:0/3049515144 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3b840a32c0 0x7f3b840a5780 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3b90005fd0 tx=0x7f3b90005850 comp rx=0 tx=0).stop 2024-09-19T09:03:33.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.907+0000 7f3ba21b9640 1 -- 172.21.15.92:0/3049515144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b9c106a90 msgr2=0x7f3b9c19cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:33.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.907+0000 7f3ba21b9640 1 --2- 172.21.15.92:0/3049515144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b9c106a90 0x7f3b9c19cdb0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f3b94005cc0 tx=0x7f3b94003970 comp rx=0 tx=0).stop 2024-09-19T09:03:33.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.907+0000 7f3ba21b9640 1 -- 172.21.15.92:0/3049515144 shutdown_connections 2024-09-19T09:03:33.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.907+0000 7f3ba21b9640 1 --2- 172.21.15.92:0/3049515144 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3b840a32c0 0x7f3b840a5780 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.907+0000 7f3ba21b9640 1 --2- 172.21.15.92:0/3049515144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b9c106a90 0x7f3b9c19cdb0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.907+0000 7f3ba21b9640 1 --2- 172.21.15.92:0/3049515144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b9c101430 0x7f3b9c198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.907+0000 7f3ba21b9640 1 --2- 172.21.15.92:0/3049515144 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b9c100a90 0x7f3b9c1984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.907+0000 7f3ba21b9640 1 -- 172.21.15.92:0/3049515144 >> 172.21.15.92:0/3049515144 conn(0x7f3b9c0fc7d0 msgr2=0x7f3b9c06aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:33.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.907+0000 7f3ba21b9640 1 -- 172.21.15.92:0/3049515144 shutdown_connections 2024-09-19T09:03:33.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:33.907+0000 7f3ba21b9640 1 -- 172.21.15.92:0/3049515144 wait complete. 2024-09-19T09:03:33.952 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.950+0000 7fde66827640 1 -- 172.21.15.92:0/4168745884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde60100a40 msgr2=0x7fde60100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:33.952 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.950+0000 7fde66827640 1 --2- 172.21.15.92:0/4168745884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde60100a40 0x7fde60100e40 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fde50009900 tx=0x7fde5002a410 comp rx=0 tx=0).stop 2024-09-19T09:03:33.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.950+0000 7fde66827640 1 -- 172.21.15.92:0/4168745884 shutdown_connections 2024-09-19T09:03:33.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.950+0000 7fde66827640 1 --2- 172.21.15.92:0/4168745884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde601025f0 0x7fde60108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.950+0000 7fde66827640 1 --2- 172.21.15.92:0/4168745884 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde60101c30 0x7fde601020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.950+0000 7fde66827640 1 --2- 172.21.15.92:0/4168745884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde60100a40 0x7fde60100e40 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.950+0000 7fde66827640 1 -- 172.21.15.92:0/4168745884 >> 172.21.15.92:0/4168745884 conn(0x7fde600fc1e0 msgr2=0x7fde600fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:33.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.950+0000 7fde66827640 1 -- 172.21.15.92:0/4168745884 shutdown_connections 2024-09-19T09:03:33.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.950+0000 7fde66827640 1 -- 172.21.15.92:0/4168745884 wait complete. 2024-09-19T09:03:33.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.950+0000 7fde66827640 1 Processor -- start 2024-09-19T09:03:33.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.950+0000 7fde66827640 1 -- start start 2024-09-19T09:03:33.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.951+0000 7fde66827640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde60100a40 0x7fde60196d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.951+0000 7fde66827640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde60101c30 0x7fde60197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.951+0000 7fde66827640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde601025f0 0x7fde6019e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.951+0000 7fde66827640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fde6010c6c0 con 0x7fde60100a40 2024-09-19T09:03:33.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.951+0000 7fde66827640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fde6010c540 con 0x7fde60101c30 2024-09-19T09:03:33.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.951+0000 7fde66827640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fde6010c840 con 0x7fde601025f0 2024-09-19T09:03:33.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.951+0000 7fde5ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde60100a40 0x7fde60196d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.951+0000 7fde5ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde60100a40 0x7fde60196d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46914/0 (socket says 172.21.15.92:46914) 2024-09-19T09:03:33.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.951+0000 7fde5ffff640 1 -- 172.21.15.92:0/3879681167 learned_addr learned my addr 172.21.15.92:0/3879681167 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:33.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.951+0000 7fde5f7fe640 1 --2- 172.21.15.92:0/3879681167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde60101c30 0x7fde60197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.951+0000 7fde64dc4640 1 --2- 172.21.15.92:0/3879681167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde601025f0 0x7fde6019e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.951+0000 7fde5ffff640 1 -- 172.21.15.92:0/3879681167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde601025f0 msgr2=0x7fde6019e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:33.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.951+0000 7fde5ffff640 1 --2- 172.21.15.92:0/3879681167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde601025f0 0x7fde6019e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.951+0000 7fde5ffff640 1 -- 172.21.15.92:0/3879681167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde60101c30 msgr2=0x7fde60197270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:33.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.951+0000 7fde5ffff640 1 --2- 172.21.15.92:0/3879681167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde60101c30 0x7fde60197270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.951+0000 7fde5ffff640 1 -- 172.21.15.92:0/3879681167 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde6019e940 con 0x7fde60100a40 2024-09-19T09:03:33.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.952+0000 7fde5ffff640 1 --2- 172.21.15.92:0/3879681167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde60100a40 0x7fde60196d30 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fde50031610 tx=0x7fde50004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:33.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.952+0000 7fde5d7fa640 1 -- 172.21.15.92:0/3879681167 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde5003f030 con 0x7fde60100a40 2024-09-19T09:03:33.955 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.952+0000 7fde5d7fa640 1 -- 172.21.15.92:0/3879681167 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde50003ad0 con 0x7fde60100a40 2024-09-19T09:03:33.955 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.952+0000 7fde66827640 1 -- 172.21.15.92:0/3879681167 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde6019ebd0 con 0x7fde60100a40 2024-09-19T09:03:33.955 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.952+0000 7fde5d7fa640 1 -- 172.21.15.92:0/3879681167 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde50035070 con 0x7fde60100a40 2024-09-19T09:03:33.955 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.952+0000 7fde66827640 1 -- 172.21.15.92:0/3879681167 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde600698a0 con 0x7fde60100a40 2024-09-19T09:03:33.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.954+0000 7fde5d7fa640 1 -- 172.21.15.92:0/3879681167 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fde50042030 con 0x7fde60100a40 2024-09-19T09:03:33.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.954+0000 7fde695c3740 1 Processor -- start 2024-09-19T09:03:33.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.955+0000 7fde695c3740 1 -- start start 2024-09-19T09:03:33.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.955+0000 7fde695c3740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55661a3419a0 0x55661a341da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.955+0000 7fde695c3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661a3422e0 0x55661a346da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.955+0000 7fde695c3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661a347370 0x55661a349830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.955+0000 7fde695c3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55661a2a52f0 con 0x55661a347370 2024-09-19T09:03:33.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.955+0000 7fde695c3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55661a24d270 con 0x55661a3422e0 2024-09-19T09:03:33.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.955+0000 7fde695c3740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55661a2a12b0 con 0x55661a3419a0 2024-09-19T09:03:33.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.955+0000 7fde5ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661a3422e0 0x55661a346da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.955+0000 7fde64dc4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55661a3419a0 0x55661a341da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.955+0000 7fde5f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661a347370 0x55661a349830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.955+0000 7fde64dc4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55661a3419a0 0x55661a341da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:41312/0 (socket says 172.21.15.92:41312) 2024-09-19T09:03:33.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.955+0000 7fde64dc4640 1 -- 172.21.15.92:0/408300395 learned_addr learned my addr 172.21.15.92:0/408300395 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:33.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.955+0000 7fde5d7fa640 1 --2- 172.21.15.92:0/3879681167 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fde480a32f0 0x7fde480a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.955+0000 7fde5f7fe640 1 -- 172.21.15.92:0/408300395 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55661a3419a0 msgr2=0x55661a341da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:33.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.955+0000 7fde5f7fe640 1 --2- 172.21.15.92:0/408300395 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55661a3419a0 0x55661a341da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.955+0000 7fde5f7fe640 1 -- 172.21.15.92:0/408300395 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661a3422e0 msgr2=0x55661a346da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:33.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.955+0000 7fde5f7fe640 1 --2- 172.21.15.92:0/408300395 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661a3422e0 0x55661a346da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.955+0000 7fde5f7fe640 1 -- 172.21.15.92:0/408300395 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55661a24c340 con 0x55661a347370 2024-09-19T09:03:33.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.955+0000 7fde64dc4640 1 --2- 172.21.15.92:0/408300395 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55661a3419a0 0x55661a341da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:33.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.956+0000 7fde5ffff640 1 --2- 172.21.15.92:0/408300395 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661a3422e0 0x55661a346da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:33.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.956+0000 7fde64dc4640 1 --2- 172.21.15.92:0/3879681167 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fde480a32f0 0x7fde480a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.956+0000 7fde5d7fa640 1 -- 172.21.15.92:0/3879681167 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fde500eff50 con 0x7fde60100a40 2024-09-19T09:03:33.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.956+0000 7fde5f7fe640 1 --2- 172.21.15.92:0/408300395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661a347370 0x55661a349830 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fde54009c00 tx=0x7fde54011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b232fdd39ac4725 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:33.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.956+0000 7fde467fc640 1 -- 172.21.15.92:0/408300395 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde54004230 con 0x55661a347370 2024-09-19T09:03:33.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.956+0000 7fde467fc640 1 -- 172.21.15.92:0/408300395 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde540043d0 con 0x55661a347370 2024-09-19T09:03:33.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.956+0000 7fde467fc640 1 -- 172.21.15.92:0/408300395 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde54004d90 con 0x55661a347370 2024-09-19T09:03:33.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.957+0000 7fde695c3740 1 -- 172.21.15.92:0/408300395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661a347370 msgr2=0x55661a349830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:33.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.957+0000 7fde64dc4640 1 --2- 172.21.15.92:0/3879681167 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fde480a32f0 0x7fde480a57b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fde58003dd0 tx=0x7fde58004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:33.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.957+0000 7fde695c3740 1 --2- 172.21.15.92:0/408300395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661a347370 0x55661a349830 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fde54009c00 tx=0x7fde54011810 comp rx=0 tx=0).stop 2024-09-19T09:03:33.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.957+0000 7fde695c3740 1 -- 172.21.15.92:0/408300395 shutdown_connections 2024-09-19T09:03:33.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.957+0000 7fde695c3740 1 --2- 172.21.15.92:0/408300395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661a347370 0x55661a349830 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.957+0000 7fde695c3740 1 --2- 172.21.15.92:0/408300395 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661a3422e0 0x55661a346da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.957+0000 7fde695c3740 1 --2- 172.21.15.92:0/408300395 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55661a3419a0 0x55661a341da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.957+0000 7fde695c3740 1 -- 172.21.15.92:0/408300395 >> 172.21.15.92:0/408300395 conn(0x55661a33d010 msgr2=0x55661a33d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:33.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.957+0000 7fde695c3740 1 -- 172.21.15.92:0/408300395 shutdown_connections 2024-09-19T09:03:33.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.957+0000 7fde695c3740 1 -- 172.21.15.92:0/408300395 wait complete. 2024-09-19T09:03:33.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.957+0000 7fde695c3740 1 -- start start 2024-09-19T09:03:33.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.958+0000 7fde695c3740 1 Processor -- start 2024-09-19T09:03:33.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.958+0000 7fde695c3740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55661a3419a0 0x55661a34bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.958+0000 7fde695c3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661a3422e0 0x55661a34c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.958+0000 7fde695c3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661a347370 0x55661a3530b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.958+0000 7fde695c3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55661a34a340 con 0x55661a3422e0 2024-09-19T09:03:33.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.958+0000 7fde695c3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55661a22e290 con 0x55661a347370 2024-09-19T09:03:33.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.958+0000 7fde695c3740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55661a34a4c0 con 0x55661a3419a0 2024-09-19T09:03:33.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.958+0000 7fde695c3740 10 client.0 _ll_register_callbacks cb 0x55661a25f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:33.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.958+0000 7fde5f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661a3422e0 0x55661a34c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.958+0000 7fde5f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661a3422e0 0x55661a34c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46928/0 (socket says 172.21.15.92:46928) 2024-09-19T09:03:33.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.958+0000 7fde5ffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55661a3419a0 0x55661a34bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.958+0000 7fde5f7fe640 1 -- 172.21.15.92:0/2062187999 learned_addr learned my addr 172.21.15.92:0/2062187999 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:33.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.958+0000 7fde64dc4640 1 --2- 172.21.15.92:0/2062187999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661a347370 0x55661a3530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.958+0000 7fde5f7fe640 1 -- 172.21.15.92:0/2062187999 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55661a3419a0 msgr2=0x55661a34bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.958+0000 7fde5f7fe640 1 --2- 172.21.15.92:0/2062187999 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55661a3419a0 0x55661a34bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.958+0000 7fde5f7fe640 1 -- 172.21.15.92:0/2062187999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661a347370 msgr2=0x55661a3530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.958+0000 7fde5f7fe640 1 --2- 172.21.15.92:0/2062187999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661a347370 0x55661a3530b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.958+0000 7fde5f7fe640 1 -- 172.21.15.92:0/2062187999 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556619fb8210 con 0x55661a3422e0 2024-09-19T09:03:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.958+0000 7fde5f7fe640 1 --2- 172.21.15.92:0/2062187999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661a3422e0 0x55661a34c070 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fde54005890 tx=0x7fde54019af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5fcba4f6e675158 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.958+0000 7fde3f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:03:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.959+0000 7fde3f7fe640 1 -- 172.21.15.92:0/2062187999 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde54028020 con 0x55661a3422e0 2024-09-19T09:03:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.959+0000 7fde3f7fe640 1 -- 172.21.15.92:0/2062187999 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fde54024620 con 0x55661a3422e0 2024-09-19T09:03:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.959+0000 7fde695c3740 1 -- 172.21.15.92:0/2062187999 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde540043d0 con 0x55661a3422e0 2024-09-19T09:03:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.959+0000 7fde3f7fe640 1 -- 172.21.15.92:0/2062187999 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fde54009e70 con 0x55661a3422e0 2024-09-19T09:03:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.959+0000 7fde695c3740 10 client.16968 fetch_fsmap learned FSMap version 19 2024-09-19T09:03:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.959+0000 7fde695c3740 1 -- 172.21.15.92:0/2062187999 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55661a084620 con 0x55661a3422e0 2024-09-19T09:03:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.959+0000 7fde3f7fe640 1 -- 172.21.15.92:0/2062187999 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde540043d0 con 0x55661a3422e0 2024-09-19T09:03:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.959+0000 7fde3f7fe640 1 -- 172.21.15.92:0/2062187999 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fde54018070 con 0x55661a3422e0 2024-09-19T09:03:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.959+0000 7fde695c3740 10 client.16968 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:03:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.959+0000 7fde695c3740 10 client.16968 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:03:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.959+0000 7fde695c3740 20 client.16968 populate_metadata read hostname 'smithi092' 2024-09-19T09:03:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.959+0000 7fde695c3740 1 --2- 172.21.15.92:0/2062187999 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55661a357580 0x55661a359970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.959+0000 7fde695c3740 4 client.16968 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.959+0000 7fde695c3740 1 -- 172.21.15.92:0/2062187999 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55661a2b2a20 con 0x55661a357580 2024-09-19T09:03:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.959+0000 7fde5ffff640 1 --2- 172.21.15.92:0/2062187999 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55661a357580 0x55661a359970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.960+0000 7fde5ffff640 1 --2- 172.21.15.92:0/2062187999 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55661a357580 0x55661a359970 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1e6edb798686137 server_cookie=a2122e6ba7052102 in_seq=0 out_seq=0 2024-09-19T09:03:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.960+0000 7fde3f7fe640 10 client.16968 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.961+0000 7fde3f7fe640 1 -- 172.21.15.92:0/2062187999 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55661a2b2a20 con 0x55661a357580 2024-09-19T09:03:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.961+0000 7fde3f7fe640 10 client.16968 handle_command_reply: tid=0 2024-09-19T09:03:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.961+0000 7fde695c3740 1 client.16968 shutdown 2024-09-19T09:03:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.961+0000 7fde695c3740 1 -- 172.21.15.92:0/2062187999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661a3422e0 msgr2=0x55661a34c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.961+0000 7fde695c3740 1 --2- 172.21.15.92:0/2062187999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661a3422e0 0x55661a34c070 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fde54005890 tx=0x7fde54019af0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.961+0000 7fde695c3740 1 -- 172.21.15.92:0/2062187999 shutdown_connections 2024-09-19T09:03:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.961+0000 7fde695c3740 1 --2- 172.21.15.92:0/2062187999 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55661a357580 0x55661a359970 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.961+0000 7fde695c3740 1 --2- 172.21.15.92:0/2062187999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661a347370 0x55661a3530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.961+0000 7fde695c3740 1 --2- 172.21.15.92:0/2062187999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661a3422e0 0x55661a34c070 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.961+0000 7fde695c3740 1 --2- 172.21.15.92:0/2062187999 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55661a3419a0 0x55661a34bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.961+0000 7fde695c3740 1 -- 172.21.15.92:0/2062187999 >> 172.21.15.92:0/2062187999 conn(0x55661a33d010 msgr2=0x55661a33e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.961+0000 7fde3f7fe640 0 client.16968 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.961+0000 7fde695c3740 1 -- 172.21.15.92:0/2062187999 shutdown_connections 2024-09-19T09:03:33.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.961+0000 7fde695c3740 1 -- 172.21.15.92:0/2062187999 wait complete. 2024-09-19T09:03:33.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.962+0000 7fde695c3740 20 client.16968 trim_cache size 0 max 16384 2024-09-19T09:03:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.979+0000 7fde695c3740 1 Processor -- start 2024-09-19T09:03:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.979+0000 7fde695c3740 1 -- start start 2024-09-19T09:03:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.979+0000 7fde695c3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661a3419a0 0x55661a33c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.979+0000 7fde695c3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661a3422e0 0x55661a353070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.979+0000 7fde695c3740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55661a347370 0x55661a33e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.979+0000 7fde695c3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fde601a4db0 con 0x55661a3419a0 2024-09-19T09:03:33.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.979+0000 7fde695c3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fde601a7650 con 0x55661a3422e0 2024-09-19T09:03:33.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.979+0000 7fde695c3740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fde601a5440 con 0x55661a347370 2024-09-19T09:03:33.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.979+0000 7fde5ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661a3419a0 0x55661a33c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.979+0000 7fde5ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661a3419a0 0x55661a33c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46938/0 (socket says 172.21.15.92:46938) 2024-09-19T09:03:33.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.979+0000 7fde5ffff640 1 -- 172.21.15.92:0/165455089 learned_addr learned my addr 172.21.15.92:0/165455089 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:33.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.979+0000 7fde5f7fe640 1 --2- 172.21.15.92:0/165455089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661a3422e0 0x55661a353070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.979+0000 7fde64dc4640 1 --2- 172.21.15.92:0/165455089 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55661a347370 0x55661a33e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.979+0000 7fde5ffff640 1 -- 172.21.15.92:0/165455089 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55661a347370 msgr2=0x55661a33e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:33.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.979+0000 7fde5ffff640 1 --2- 172.21.15.92:0/165455089 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55661a347370 0x55661a33e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.979+0000 7fde5ffff640 1 -- 172.21.15.92:0/165455089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661a3422e0 msgr2=0x55661a353070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:33.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.979+0000 7fde5ffff640 1 --2- 172.21.15.92:0/165455089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661a3422e0 0x55661a353070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.979+0000 7fde5ffff640 1 -- 172.21.15.92:0/165455089 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55661a346710 con 0x55661a3419a0 2024-09-19T09:03:33.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.980+0000 7fde5f7fe640 1 --2- 172.21.15.92:0/165455089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661a3422e0 0x55661a353070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:33.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.980+0000 7fde5ffff640 1 --2- 172.21.15.92:0/165455089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661a3419a0 0x55661a33c0b0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fde500bc500 tx=0x7fde5002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e34706090ab8645 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:33.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.980+0000 7fde45ffb640 1 -- 172.21.15.92:0/165455089 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde50049050 con 0x55661a3419a0 2024-09-19T09:03:33.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.980+0000 7fde45ffb640 1 -- 172.21.15.92:0/165455089 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde500bcc70 con 0x55661a3419a0 2024-09-19T09:03:33.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.980+0000 7fde45ffb640 1 -- 172.21.15.92:0/165455089 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde500c51e0 con 0x55661a3419a0 2024-09-19T09:03:33.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.981+0000 7fde695c3740 1 -- 172.21.15.92:0/165455089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661a3419a0 msgr2=0x55661a33c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:33.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.981+0000 7fde695c3740 1 --2- 172.21.15.92:0/165455089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661a3419a0 0x55661a33c0b0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fde500bc500 tx=0x7fde5002a410 comp rx=0 tx=0).stop 2024-09-19T09:03:33.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.981+0000 7fde695c3740 1 -- 172.21.15.92:0/165455089 shutdown_connections 2024-09-19T09:03:33.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.981+0000 7fde695c3740 1 --2- 172.21.15.92:0/165455089 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55661a347370 0x55661a33e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.981+0000 7fde695c3740 1 --2- 172.21.15.92:0/165455089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661a3422e0 0x55661a353070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.981+0000 7fde695c3740 1 --2- 172.21.15.92:0/165455089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661a3419a0 0x55661a33c0b0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.981+0000 7fde695c3740 1 -- 172.21.15.92:0/165455089 >> 172.21.15.92:0/165455089 conn(0x55661a33d010 msgr2=0x55661a33b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:33.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.981+0000 7fde695c3740 1 -- 172.21.15.92:0/165455089 shutdown_connections 2024-09-19T09:03:33.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.981+0000 7fde695c3740 1 -- 172.21.15.92:0/165455089 wait complete. 2024-09-19T09:03:33.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.981+0000 7fde695c3740 1 -- start start 2024-09-19T09:03:33.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.982+0000 7fde695c3740 1 Processor -- start 2024-09-19T09:03:33.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.982+0000 7fde695c3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661a3419a0 0x55661a3505d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.982+0000 7fde695c3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661a3422e0 0x55661a350b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.982+0000 7fde695c3740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55661a347370 0x55661a351b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.982+0000 7fde695c3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fde601a5b10 con 0x55661a3419a0 2024-09-19T09:03:33.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.982+0000 7fde695c3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fde601a6f80 con 0x55661a3422e0 2024-09-19T09:03:33.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.982+0000 7fde695c3740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fde601a61e0 con 0x55661a347370 2024-09-19T09:03:33.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.982+0000 7fde5ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661a3419a0 0x55661a3505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.982+0000 7fde5ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661a3419a0 0x55661a3505d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46940/0 (socket says 172.21.15.92:46940) 2024-09-19T09:03:33.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.982+0000 7fde5ffff640 1 -- 172.21.15.92:0/2216643361 learned_addr learned my addr 172.21.15.92:0/2216643361 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:33.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.982+0000 7fde5f7fe640 1 --2- 172.21.15.92:0/2216643361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661a3422e0 0x55661a350b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.982+0000 7fde64dc4640 1 --2- 172.21.15.92:0/2216643361 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55661a347370 0x55661a351b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.982+0000 7fde695c3740 10 client.0 _ll_register_callbacks cb 0x7fde500f38a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:33.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.982+0000 7fde5ffff640 1 -- 172.21.15.92:0/2216643361 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55661a347370 msgr2=0x55661a351b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:33.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.982+0000 7fde5ffff640 1 --2- 172.21.15.92:0/2216643361 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55661a347370 0x55661a351b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.982+0000 7fde5ffff640 1 -- 172.21.15.92:0/2216643361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661a3422e0 msgr2=0x55661a350b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:33.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.982+0000 7fde5ffff640 1 --2- 172.21.15.92:0/2216643361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661a3422e0 0x55661a350b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.982+0000 7fde5ffff640 1 -- 172.21.15.92:0/2216643361 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55661a352130 con 0x55661a3419a0 2024-09-19T09:03:33.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.983+0000 7fde5ffff640 1 --2- 172.21.15.92:0/2216643361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661a3419a0 0x55661a3505d0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fde500f3450 tx=0x7fde500ed9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78a2fe02c71ab9db server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:33.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.983+0000 7fde3f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:03:33.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.983+0000 7fde3f7fe640 1 -- 172.21.15.92:0/2216643361 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde500ba6b0 con 0x55661a3419a0 2024-09-19T09:03:33.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.983+0000 7fde3f7fe640 1 -- 172.21.15.92:0/2216643361 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fde5003bd60 con 0x55661a3419a0 2024-09-19T09:03:33.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.983+0000 7fde695c3740 1 -- 172.21.15.92:0/2216643361 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde500bcc70 con 0x55661a3419a0 2024-09-19T09:03:33.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.983+0000 7fde3f7fe640 1 -- 172.21.15.92:0/2216643361 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fde50049030 con 0x55661a3419a0 2024-09-19T09:03:33.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.983+0000 7fde695c3740 10 client.16974 fetch_fsmap learned FSMap version 19 2024-09-19T09:03:33.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.983+0000 7fde695c3740 1 -- 172.21.15.92:0/2216643361 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55661a3c2250 con 0x55661a3419a0 2024-09-19T09:03:33.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.983+0000 7fde3f7fe640 1 -- 172.21.15.92:0/2216643361 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde500bcc70 con 0x55661a3419a0 2024-09-19T09:03:33.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.984+0000 7fde3f7fe640 1 -- 172.21.15.92:0/2216643361 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fde500b8b50 con 0x55661a3419a0 2024-09-19T09:03:33.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.984+0000 7fde695c3740 10 client.16974 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:03:33.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.984+0000 7fde695c3740 10 client.16974 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:03:33.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.984+0000 7fde695c3740 20 client.16974 populate_metadata read hostname 'smithi092' 2024-09-19T09:03:33.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.984+0000 7fde695c3740 1 --2- 172.21.15.92:0/2216643361 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55661a3c27d0 0x55661a3c4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.984+0000 7fde695c3740 4 client.16974 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:03:33.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.984+0000 7fde695c3740 1 -- 172.21.15.92:0/2216643361 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55661a2acd70 con 0x55661a3c27d0 2024-09-19T09:03:33.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.984+0000 7fde5f7fe640 1 --2- 172.21.15.92:0/2216643361 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55661a3c27d0 0x55661a3c4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.984+0000 7fde3f7fe640 10 client.16974 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:33.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:33.984+0000 7fde5f7fe640 1 --2- 172.21.15.92:0/2216643361 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55661a3c27d0 0x55661a3c4c30 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed3c267fdb1a667b server_cookie=54c6fa2ed38bbc25 in_seq=0 out_seq=0 2024-09-19T09:03:34.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:34.008+0000 7fde3f7fe640 1 -- 172.21.15.92:0/2216643361 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55661a2acd70 con 0x55661a3c27d0 2024-09-19T09:03:34.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:34.008+0000 7fde3f7fe640 10 client.16974 handle_command_reply: tid=0 2024-09-19T09:03:34.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:34.008+0000 7fde695c3740 1 client.16974 shutdown 2024-09-19T09:03:34.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:34.008+0000 7fde695c3740 1 -- 172.21.15.92:0/2216643361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661a3419a0 msgr2=0x55661a3505d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:34.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:34.008+0000 7fde695c3740 1 --2- 172.21.15.92:0/2216643361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661a3419a0 0x55661a3505d0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fde500f3450 tx=0x7fde500ed9f0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:34.008+0000 7fde695c3740 1 -- 172.21.15.92:0/2216643361 shutdown_connections 2024-09-19T09:03:34.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:34.008+0000 7fde695c3740 1 --2- 172.21.15.92:0/2216643361 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55661a3c27d0 0x55661a3c4c30 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:34.008+0000 7fde695c3740 1 --2- 172.21.15.92:0/2216643361 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55661a347370 0x55661a351b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:34.008+0000 7fde695c3740 1 --2- 172.21.15.92:0/2216643361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661a3422e0 0x55661a350b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:34.008+0000 7fde3f7fe640 0 client.16974 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:34.008+0000 7fde695c3740 1 --2- 172.21.15.92:0/2216643361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661a3419a0 0x55661a3505d0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:34.008+0000 7fde695c3740 1 -- 172.21.15.92:0/2216643361 >> 172.21.15.92:0/2216643361 conn(0x55661a33d010 msgr2=0x55661a33c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:34.008+0000 7fde695c3740 1 -- 172.21.15.92:0/2216643361 shutdown_connections 2024-09-19T09:03:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:34.008+0000 7fde695c3740 1 -- 172.21.15.92:0/2216643361 wait complete. 2024-09-19T09:03:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:34.008+0000 7fde695c3740 20 client.16974 trim_cache size 0 max 16384 2024-09-19T09:03:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:03:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:03:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:03:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:03:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:34.009+0000 7fde66827640 1 -- 172.21.15.92:0/3879681167 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fde480a32f0 msgr2=0x7fde480a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:34.009+0000 7fde66827640 1 --2- 172.21.15.92:0/3879681167 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fde480a32f0 0x7fde480a57b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fde58003dd0 tx=0x7fde58004a40 comp rx=0 tx=0).stop 2024-09-19T09:03:34.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:34.009+0000 7fde66827640 1 -- 172.21.15.92:0/3879681167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde60100a40 msgr2=0x7fde60196d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:34.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:34.009+0000 7fde66827640 1 --2- 172.21.15.92:0/3879681167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde60100a40 0x7fde60196d30 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fde50031610 tx=0x7fde50004270 comp rx=0 tx=0).stop 2024-09-19T09:03:34.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:34.009+0000 7fde66827640 1 -- 172.21.15.92:0/3879681167 shutdown_connections 2024-09-19T09:03:34.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:34.009+0000 7fde66827640 1 --2- 172.21.15.92:0/3879681167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde601025f0 0x7fde6019e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:34.009+0000 7fde66827640 1 --2- 172.21.15.92:0/3879681167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde60101c30 0x7fde60197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:34.009+0000 7fde66827640 1 --2- 172.21.15.92:0/3879681167 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fde480a32f0 0x7fde480a57b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:34.009+0000 7fde66827640 1 --2- 172.21.15.92:0/3879681167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde60100a40 0x7fde60196d30 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:34.009+0000 7fde66827640 1 -- 172.21.15.92:0/3879681167 >> 172.21.15.92:0/3879681167 conn(0x7fde600fc1e0 msgr2=0x7fde60105000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:34.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:34.009+0000 7fde66827640 1 -- 172.21.15.92:0/3879681167 shutdown_connections 2024-09-19T09:03:34.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:34.009+0000 7fde66827640 1 -- 172.21.15.92:0/3879681167 wait complete. 2024-09-19T09:03:34.662 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:03:34.906 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:35.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.334+0000 7fc4fdb5f640 1 -- 172.21.15.92:0/2439152917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4f8100970 msgr2=0x7fc4f810ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:35.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.334+0000 7fc4fdb5f640 1 --2- 172.21.15.92:0/2439152917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4f8100970 0x7fc4f810ea50 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fc4f0009ca0 tx=0x7fc4f002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.334+0000 7fc4fdb5f640 1 -- 172.21.15.92:0/2439152917 shutdown_connections 2024-09-19T09:03:35.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.334+0000 7fc4fdb5f640 1 --2- 172.21.15.92:0/2439152917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4f8100970 0x7fc4f810ea50 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.334+0000 7fc4fdb5f640 1 --2- 172.21.15.92:0/2439152917 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc4f80fffd0 0x7fc4f8100430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.334+0000 7fc4fdb5f640 1 --2- 172.21.15.92:0/2439152917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4f8106bb0 0x7fc4f8106f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.334+0000 7fc4fdb5f640 1 -- 172.21.15.92:0/2439152917 >> 172.21.15.92:0/2439152917 conn(0x7fc4f80fbee0 msgr2=0x7fc4f80fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:35.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.334+0000 7fc4fdb5f640 1 -- 172.21.15.92:0/2439152917 shutdown_connections 2024-09-19T09:03:35.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.334+0000 7fc4fdb5f640 1 -- 172.21.15.92:0/2439152917 wait complete. 2024-09-19T09:03:35.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.335+0000 7fc4fdb5f640 1 Processor -- start 2024-09-19T09:03:35.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.335+0000 7fc4fdb5f640 1 -- start start 2024-09-19T09:03:35.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.335+0000 7fc4fdb5f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc4f80fffd0 0x7fc4f81011b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:35.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.335+0000 7fc4fdb5f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4f8100970 0x7fc4f81016f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:35.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.335+0000 7fc4fdb5f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4f8106bb0 0x7fc4f8101c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:35.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.335+0000 7fc4fdb5f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f8112120 con 0x7fc4f8106bb0 2024-09-19T09:03:35.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.335+0000 7fc4fdb5f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f8111fa0 con 0x7fc4f8100970 2024-09-19T09:03:35.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.335+0000 7fc4fdb5f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f81122a0 con 0x7fc4f80fffd0 2024-09-19T09:03:35.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.335+0000 7fc4f7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4f8106bb0 0x7fc4f8101c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:35.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.335+0000 7fc4f6ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4f8100970 0x7fc4f81016f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:35.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.335+0000 7fc4f7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4f8106bb0 0x7fc4f8101c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46962/0 (socket says 172.21.15.92:46962) 2024-09-19T09:03:35.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.335+0000 7fc4f7fff640 1 -- 172.21.15.92:0/379432279 learned_addr learned my addr 172.21.15.92:0/379432279 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:35.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.335+0000 7fc4f77fe640 1 --2- 172.21.15.92:0/379432279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc4f80fffd0 0x7fc4f81011b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:35.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.336+0000 7fc4f7fff640 1 -- 172.21.15.92:0/379432279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc4f80fffd0 msgr2=0x7fc4f81011b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:35.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.336+0000 7fc4f7fff640 1 --2- 172.21.15.92:0/379432279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc4f80fffd0 0x7fc4f81011b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.336+0000 7fc4f7fff640 1 -- 172.21.15.92:0/379432279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4f8100970 msgr2=0x7fc4f81016f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:35.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.336+0000 7fc4f7fff640 1 --2- 172.21.15.92:0/379432279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4f8100970 0x7fc4f81016f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.336+0000 7fc4f7fff640 1 -- 172.21.15.92:0/379432279 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4f81a6a60 con 0x7fc4f8106bb0 2024-09-19T09:03:35.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.336+0000 7fc4f6ffd640 1 --2- 172.21.15.92:0/379432279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4f8100970 0x7fc4f81016f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:35.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.336+0000 7fc4f7fff640 1 --2- 172.21.15.92:0/379432279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4f8106bb0 0x7fc4f8101c30 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fc4f0031f80 tx=0x7fc4f0031a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:35.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.336+0000 7fc4f4ff9640 1 -- 172.21.15.92:0/379432279 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f0003b70 con 0x7fc4f8106bb0 2024-09-19T09:03:35.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.336+0000 7fc4f4ff9640 1 -- 172.21.15.92:0/379432279 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4f0003d10 con 0x7fc4f8106bb0 2024-09-19T09:03:35.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.336+0000 7fc4fdb5f640 1 -- 172.21.15.92:0/379432279 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4f81a6cf0 con 0x7fc4f8106bb0 2024-09-19T09:03:35.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.336+0000 7fc4f4ff9640 1 -- 172.21.15.92:0/379432279 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f0004760 con 0x7fc4f8106bb0 2024-09-19T09:03:35.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.336+0000 7fc4fdb5f640 1 -- 172.21.15.92:0/379432279 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4f81a7230 con 0x7fc4f8106bb0 2024-09-19T09:03:35.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.338+0000 7fc4f4ff9640 1 -- 172.21.15.92:0/379432279 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc4f002f710 con 0x7fc4f8106bb0 2024-09-19T09:03:35.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.339+0000 7fc4fff38740 1 Processor -- start 2024-09-19T09:03:35.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.339+0000 7fc4fff38740 1 -- start start 2024-09-19T09:03:35.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.339+0000 7fc4f4ff9640 1 --2- 172.21.15.92:0/379432279 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc4e00a3240 0x7fc4e00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:35.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.339+0000 7fc4fff38740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9117624a0 0x55f911762880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:35.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.339+0000 7fc4fff38740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f911762dc0 0x55f91176d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:35.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.339+0000 7fc4fff38740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f91176d680 0x55f91176fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:35.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.339+0000 7fc4fff38740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f9116c82e0 con 0x55f9117624a0 2024-09-19T09:03:35.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.339+0000 7fc4fff38740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f91166fce0 con 0x55f91176d680 2024-09-19T09:03:35.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.339+0000 7fc4fff38740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f9116c42a0 con 0x55f911762dc0 2024-09-19T09:03:35.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.339+0000 7fc4f4ff9640 1 -- 172.21.15.92:0/379432279 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc4f00f0b00 con 0x7fc4f8106bb0 2024-09-19T09:03:35.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.339+0000 7fc4f77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9117624a0 0x55f911762880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:35.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.339+0000 7fc4f77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9117624a0 0x55f911762880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46966/0 (socket says 172.21.15.92:46966) 2024-09-19T09:03:35.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.339+0000 7fc4f77fe640 1 -- 172.21.15.92:0/1427641021 learned_addr learned my addr 172.21.15.92:0/1427641021 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:35.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.339+0000 7fc4f6ffd640 1 --2- 172.21.15.92:0/379432279 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc4e00a3240 0x7fc4e00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:35.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.339+0000 7fc4f7fff640 1 --2- 172.21.15.92:0/1427641021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f91176d680 0x55f91176fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:35.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.339+0000 7fc4f6ffd640 1 --2- 172.21.15.92:0/1427641021 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f911762dc0 0x55f91176d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:35.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.339+0000 7fc4f77fe640 1 -- 172.21.15.92:0/1427641021 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f911762dc0 msgr2=0x55f91176d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:35.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.339+0000 7fc4f77fe640 1 --2- 172.21.15.92:0/1427641021 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f911762dc0 0x55f91176d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.339+0000 7fc4f77fe640 1 -- 172.21.15.92:0/1427641021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f91176d680 msgr2=0x55f91176fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:35.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.340+0000 7fc4f77fe640 1 --2- 172.21.15.92:0/1427641021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f91176d680 0x55f91176fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.340+0000 7fc4f77fe640 1 -- 172.21.15.92:0/1427641021 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f911654440 con 0x55f9117624a0 2024-09-19T09:03:35.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.340+0000 7fc4f6ffd640 1 --2- 172.21.15.92:0/1427641021 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f911762dc0 0x55f91176d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:35.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.340+0000 7fc4f7fff640 1 --2- 172.21.15.92:0/1427641021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f91176d680 0x55f91176fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:35.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.340+0000 7fc4f77fe640 1 --2- 172.21.15.92:0/1427641021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9117624a0 0x55f911762880 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8009a70 tx=0x7fc4e8009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=529a11e937b50553 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:35.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.340+0000 7fc4f6ffd640 1 --2- 172.21.15.92:0/379432279 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc4e00a3240 0x7fc4e00a5700 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x55f91175f890 tx=0x7fc4ec0098f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:35.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.340+0000 7fc4ddffb640 1 -- 172.21.15.92:0/1427641021 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e8017070 con 0x55f9117624a0 2024-09-19T09:03:35.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.340+0000 7fc4ddffb640 1 -- 172.21.15.92:0/1427641021 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4e8013470 con 0x55f9117624a0 2024-09-19T09:03:35.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.340+0000 7fc4ddffb640 1 -- 172.21.15.92:0/1427641021 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e80125f0 con 0x55f9117624a0 2024-09-19T09:03:35.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.341+0000 7fc4fff38740 1 -- 172.21.15.92:0/1427641021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9117624a0 msgr2=0x55f911762880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:35.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.341+0000 7fc4fff38740 1 --2- 172.21.15.92:0/1427641021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9117624a0 0x55f911762880 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8009a70 tx=0x7fc4e8009f30 comp rx=0 tx=0).stop 2024-09-19T09:03:35.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.341+0000 7fc4fff38740 1 -- 172.21.15.92:0/1427641021 shutdown_connections 2024-09-19T09:03:35.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.341+0000 7fc4fff38740 1 --2- 172.21.15.92:0/1427641021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f91176d680 0x55f91176fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.341+0000 7fc4fff38740 1 --2- 172.21.15.92:0/1427641021 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f911762dc0 0x55f91176d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.341+0000 7fc4fff38740 1 --2- 172.21.15.92:0/1427641021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9117624a0 0x55f911762880 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.341+0000 7fc4fff38740 1 -- 172.21.15.92:0/1427641021 >> 172.21.15.92:0/1427641021 conn(0x55f91175ea30 msgr2=0x55f91175ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:35.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.341+0000 7fc4fff38740 1 -- 172.21.15.92:0/1427641021 shutdown_connections 2024-09-19T09:03:35.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.341+0000 7fc4fff38740 1 -- 172.21.15.92:0/1427641021 wait complete. 2024-09-19T09:03:35.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.341+0000 7fc4fff38740 1 -- start start 2024-09-19T09:03:35.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.341+0000 7fc4fff38740 1 Processor -- start 2024-09-19T09:03:35.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.342+0000 7fc4fff38740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9117624a0 0x55f91176cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:35.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.342+0000 7fc4fff38740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f911762dc0 0x55f91176a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:35.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.342+0000 7fc4fff38740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f91176d680 0x55f91176a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:35.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.342+0000 7fc4fff38740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f911770250 con 0x55f91176d680 2024-09-19T09:03:35.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.342+0000 7fc4fff38740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f911683050 con 0x55f9117624a0 2024-09-19T09:03:35.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.342+0000 7fc4fff38740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f9117703d0 con 0x55f911762dc0 2024-09-19T09:03:35.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.342+0000 7fc4fff38740 10 client.0 _ll_register_callbacks cb 0x55f9116c3160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:35.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.342+0000 7fc4f7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f91176d680 0x55f91176a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:35.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.342+0000 7fc4f7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f91176d680 0x55f91176a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46974/0 (socket says 172.21.15.92:46974) 2024-09-19T09:03:35.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.342+0000 7fc4f7fff640 1 -- 172.21.15.92:0/1962840978 learned_addr learned my addr 172.21.15.92:0/1962840978 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:35.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.342+0000 7fc4f77fe640 1 --2- 172.21.15.92:0/1962840978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9117624a0 0x55f91176cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:35.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.342+0000 7fc4f6ffd640 1 --2- 172.21.15.92:0/1962840978 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f911762dc0 0x55f91176a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:35.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.342+0000 7fc4f7fff640 1 -- 172.21.15.92:0/1962840978 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f911762dc0 msgr2=0x55f91176a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:35.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.342+0000 7fc4f7fff640 1 --2- 172.21.15.92:0/1962840978 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f911762dc0 0x55f91176a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.342+0000 7fc4f7fff640 1 -- 172.21.15.92:0/1962840978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9117624a0 msgr2=0x55f91176cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:35.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.342+0000 7fc4f7fff640 1 --2- 172.21.15.92:0/1962840978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9117624a0 0x55f91176cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.342+0000 7fc4f7fff640 1 -- 172.21.15.92:0/1962840978 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9114393c0 con 0x55f91176d680 2024-09-19T09:03:35.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.342+0000 7fc4f7fff640 1 --2- 172.21.15.92:0/1962840978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f91176d680 0x55f91176a730 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fc4f00b9c10 tx=0x7fc4f002ff40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=971433cf025c4d59 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:35.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.342+0000 7fc4d6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:03:35.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.342+0000 7fc4d6ffd640 1 -- 172.21.15.92:0/1962840978 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f00bd240 con 0x55f91176d680 2024-09-19T09:03:35.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.342+0000 7fc4d6ffd640 1 -- 172.21.15.92:0/1962840978 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc4f00bb540 con 0x55f91176d680 2024-09-19T09:03:35.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.342+0000 7fc4fff38740 1 -- 172.21.15.92:0/1962840978 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4e8013470 con 0x55f91176d680 2024-09-19T09:03:35.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.343+0000 7fc4d6ffd640 1 -- 172.21.15.92:0/1962840978 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc4f00c15f0 con 0x55f91176d680 2024-09-19T09:03:35.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.343+0000 7fc4fff38740 10 client.16986 fetch_fsmap learned FSMap version 19 2024-09-19T09:03:35.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.343+0000 7fc4fff38740 1 -- 172.21.15.92:0/1962840978 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f911770250 con 0x55f91176d680 2024-09-19T09:03:35.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.343+0000 7fc4d6ffd640 1 -- 172.21.15.92:0/1962840978 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4e8013470 con 0x55f91176d680 2024-09-19T09:03:35.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.343+0000 7fc4d6ffd640 1 -- 172.21.15.92:0/1962840978 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fc4f00c11b0 con 0x55f91176d680 2024-09-19T09:03:35.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.343+0000 7fc4fff38740 10 client.16986 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:03:35.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.343+0000 7fc4fff38740 10 client.16986 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:03:35.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.343+0000 7fc4fff38740 20 client.16986 populate_metadata read hostname 'smithi092' 2024-09-19T09:03:35.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.343+0000 7fc4fff38740 1 --2- 172.21.15.92:0/1962840978 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f91177cf70 0x55f91177f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:35.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.343+0000 7fc4fff38740 4 client.16986 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:35.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.343+0000 7fc4fff38740 1 -- 172.21.15.92:0/1962840978 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9116d5850 con 0x55f91177cf70 2024-09-19T09:03:35.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.343+0000 7fc4f77fe640 1 --2- 172.21.15.92:0/1962840978 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f91177cf70 0x55f91177f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:35.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.344+0000 7fc4d6ffd640 10 client.16986 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:35.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.344+0000 7fc4f77fe640 1 --2- 172.21.15.92:0/1962840978 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f91177cf70 0x55f91177f3c0 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c3be1490d983b2f server_cookie=85d8e21eac694d27 in_seq=0 out_seq=0 2024-09-19T09:03:35.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.344+0000 7fc4d6ffd640 1 -- 172.21.15.92:0/1962840978 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f9116d5850 con 0x55f91177cf70 2024-09-19T09:03:35.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.344+0000 7fc4d6ffd640 10 client.16986 handle_command_reply: tid=0 2024-09-19T09:03:35.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.344+0000 7fc4fff38740 1 client.16986 shutdown 2024-09-19T09:03:35.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.345+0000 7fc4fff38740 1 -- 172.21.15.92:0/1962840978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f91176d680 msgr2=0x55f91176a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:35.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.345+0000 7fc4fff38740 1 --2- 172.21.15.92:0/1962840978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f91176d680 0x55f91176a730 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fc4f00b9c10 tx=0x7fc4f002ff40 comp rx=0 tx=0).stop 2024-09-19T09:03:35.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.345+0000 7fc4fff38740 1 -- 172.21.15.92:0/1962840978 shutdown_connections 2024-09-19T09:03:35.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.345+0000 7fc4fff38740 1 --2- 172.21.15.92:0/1962840978 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f91177cf70 0x55f91177f3c0 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.345+0000 7fc4fff38740 1 --2- 172.21.15.92:0/1962840978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f91176d680 0x55f91176a730 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.345+0000 7fc4fff38740 1 --2- 172.21.15.92:0/1962840978 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f911762dc0 0x55f91176a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.345+0000 7fc4fff38740 1 --2- 172.21.15.92:0/1962840978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9117624a0 0x55f91176cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.345+0000 7fc4d6ffd640 0 client.16986 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:35.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.345+0000 7fc4fff38740 1 -- 172.21.15.92:0/1962840978 >> 172.21.15.92:0/1962840978 conn(0x55f91175ea30 msgr2=0x55f911764710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:35.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.345+0000 7fc4fff38740 1 -- 172.21.15.92:0/1962840978 shutdown_connections 2024-09-19T09:03:35.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.345+0000 7fc4fff38740 1 -- 172.21.15.92:0/1962840978 wait complete. 2024-09-19T09:03:35.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.345+0000 7fc4fff38740 20 client.16986 trim_cache size 0 max 16384 2024-09-19T09:03:35.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.361+0000 7fc4fff38740 1 Processor -- start 2024-09-19T09:03:35.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.361+0000 7fc4fff38740 1 -- start start 2024-09-19T09:03:35.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.362+0000 7fc4fff38740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f91175ea30 0x55f91176a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:35.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.362+0000 7fc4fff38740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9117624a0 0x55f91176c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:35.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.362+0000 7fc4fff38740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f911762dc0 0x55f911784ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:35.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.362+0000 7fc4fff38740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f81ad870 con 0x55f9117624a0 2024-09-19T09:03:35.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.362+0000 7fc4fff38740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f81b0110 con 0x55f91175ea30 2024-09-19T09:03:35.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.362+0000 7fc4fff38740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f81adf00 con 0x55f911762dc0 2024-09-19T09:03:35.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.362+0000 7fc4f6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9117624a0 0x55f91176c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:35.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.362+0000 7fc4f6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9117624a0 0x55f91176c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46986/0 (socket says 172.21.15.92:46986) 2024-09-19T09:03:35.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.362+0000 7fc4f6ffd640 1 -- 172.21.15.92:0/2240364267 learned_addr learned my addr 172.21.15.92:0/2240364267 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:35.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.362+0000 7fc4f77fe640 1 --2- 172.21.15.92:0/2240364267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f91175ea30 0x55f91176a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:35.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.362+0000 7fc4f6ffd640 1 -- 172.21.15.92:0/2240364267 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f911762dc0 msgr2=0x55f911784ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:35.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.362+0000 7fc4f7fff640 1 --2- 172.21.15.92:0/2240364267 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f911762dc0 0x55f911784ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:35.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.362+0000 7fc4f6ffd640 1 --2- 172.21.15.92:0/2240364267 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f911762dc0 0x55f911784ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.362+0000 7fc4f6ffd640 1 -- 172.21.15.92:0/2240364267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f91175ea30 msgr2=0x55f91176a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:35.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.362+0000 7fc4f6ffd640 1 --2- 172.21.15.92:0/2240364267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f91175ea30 0x55f91176a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.362+0000 7fc4f6ffd640 1 -- 172.21.15.92:0/2240364267 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f91176d2b0 con 0x55f9117624a0 2024-09-19T09:03:35.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.362+0000 7fc4f7fff640 1 --2- 172.21.15.92:0/2240364267 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f911762dc0 0x55f911784ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:35.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.362+0000 7fc4f6ffd640 1 --2- 172.21.15.92:0/2240364267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9117624a0 0x55f91176c160 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec010fb0 tx=0x7fc4ec00e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54dd56204b0ee48b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:35.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.362+0000 7fc4dd7fa640 1 -- 172.21.15.92:0/2240364267 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec01d040 con 0x55f9117624a0 2024-09-19T09:03:35.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.363+0000 7fc4dd7fa640 1 -- 172.21.15.92:0/2240364267 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4ec023b20 con 0x55f9117624a0 2024-09-19T09:03:35.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.363+0000 7fc4dd7fa640 1 -- 172.21.15.92:0/2240364267 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec022b70 con 0x55f9117624a0 2024-09-19T09:03:35.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.363+0000 7fc4fff38740 1 -- 172.21.15.92:0/2240364267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9117624a0 msgr2=0x55f91176c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:35.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.363+0000 7fc4fff38740 1 --2- 172.21.15.92:0/2240364267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9117624a0 0x55f91176c160 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec010fb0 tx=0x7fc4ec00e000 comp rx=0 tx=0).stop 2024-09-19T09:03:35.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.363+0000 7fc4fff38740 1 -- 172.21.15.92:0/2240364267 shutdown_connections 2024-09-19T09:03:35.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.363+0000 7fc4fff38740 1 --2- 172.21.15.92:0/2240364267 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f911762dc0 0x55f911784ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.363+0000 7fc4fff38740 1 --2- 172.21.15.92:0/2240364267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9117624a0 0x55f91176c160 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.363+0000 7fc4fff38740 1 --2- 172.21.15.92:0/2240364267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f91175ea30 0x55f91176a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.363+0000 7fc4fff38740 1 -- 172.21.15.92:0/2240364267 >> 172.21.15.92:0/2240364267 conn(0x55f91176a890 msgr2=0x55f91176ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:35.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.363+0000 7fc4fff38740 1 -- 172.21.15.92:0/2240364267 shutdown_connections 2024-09-19T09:03:35.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.363+0000 7fc4fff38740 1 -- 172.21.15.92:0/2240364267 wait complete. 2024-09-19T09:03:35.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.364+0000 7fc4fff38740 1 -- start start 2024-09-19T09:03:35.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.364+0000 7fc4fff38740 1 Processor -- start 2024-09-19T09:03:35.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.364+0000 7fc4fff38740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f91175ea30 0x55f9117732c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:35.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.364+0000 7fc4fff38740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9117624a0 0x55f911773800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:35.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.364+0000 7fc4fff38740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f911762dc0 0x55f911773d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:35.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.364+0000 7fc4fff38740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f81ae5d0 con 0x55f911762dc0 2024-09-19T09:03:35.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.364+0000 7fc4fff38740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f81afa40 con 0x55f91175ea30 2024-09-19T09:03:35.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.364+0000 7fc4fff38740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f81aeca0 con 0x55f9117624a0 2024-09-19T09:03:35.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.364+0000 7fc4fff38740 10 client.0 _ll_register_callbacks cb 0x7fc4f0003ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:35.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.364+0000 7fc4f7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f911762dc0 0x55f911773d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:35.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.364+0000 7fc4f7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f911762dc0 0x55f911773d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47000/0 (socket says 172.21.15.92:47000) 2024-09-19T09:03:35.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.364+0000 7fc4f7fff640 1 -- 172.21.15.92:0/525534838 learned_addr learned my addr 172.21.15.92:0/525534838 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:35.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.364+0000 7fc4f77fe640 1 --2- 172.21.15.92:0/525534838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f91175ea30 0x55f9117732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:35.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.364+0000 7fc4f6ffd640 1 --2- 172.21.15.92:0/525534838 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9117624a0 0x55f911773800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:35.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.364+0000 7fc4f7fff640 1 -- 172.21.15.92:0/525534838 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9117624a0 msgr2=0x55f911773800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:35.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.364+0000 7fc4f7fff640 1 --2- 172.21.15.92:0/525534838 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9117624a0 0x55f911773800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.365+0000 7fc4f7fff640 1 -- 172.21.15.92:0/525534838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f91175ea30 msgr2=0x55f9117732c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:35.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.365+0000 7fc4f7fff640 1 --2- 172.21.15.92:0/525534838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f91175ea30 0x55f9117732c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.365+0000 7fc4f7fff640 1 -- 172.21.15.92:0/525534838 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9117e6c80 con 0x55f911762dc0 2024-09-19T09:03:35.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.365+0000 7fc4f6ffd640 1 --2- 172.21.15.92:0/525534838 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9117624a0 0x55f911773800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:35.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.365+0000 7fc4f77fe640 1 --2- 172.21.15.92:0/525534838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f91175ea30 0x55f9117732c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:35.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.365+0000 7fc4f7fff640 1 --2- 172.21.15.92:0/525534838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f911762dc0 0x55f911773d40 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fc4f00c5980 tx=0x7fc4f00041a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59ed3ff4664ffd04 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:35.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.365+0000 7fc4d6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:03:35.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.365+0000 7fc4d6ffd640 1 -- 172.21.15.92:0/525534838 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f00bd240 con 0x55f911762dc0 2024-09-19T09:03:35.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.365+0000 7fc4d6ffd640 1 -- 172.21.15.92:0/525534838 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc4f00c11b0 con 0x55f911762dc0 2024-09-19T09:03:35.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.365+0000 7fc4fff38740 1 -- 172.21.15.92:0/525534838 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4ec023b20 con 0x55f911762dc0 2024-09-19T09:03:35.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.365+0000 7fc4d6ffd640 1 -- 172.21.15.92:0/525534838 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc4f00b94e0 con 0x55f911762dc0 2024-09-19T09:03:35.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.365+0000 7fc4fff38740 10 client.16992 fetch_fsmap learned FSMap version 19 2024-09-19T09:03:35.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.365+0000 7fc4fff38740 1 -- 172.21.15.92:0/525534838 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f9117e7e00 con 0x55f911762dc0 2024-09-19T09:03:35.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.365+0000 7fc4d6ffd640 1 -- 172.21.15.92:0/525534838 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4ec023b20 con 0x55f911762dc0 2024-09-19T09:03:35.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.365+0000 7fc4d6ffd640 1 -- 172.21.15.92:0/525534838 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fc4f0004b40 con 0x55f911762dc0 2024-09-19T09:03:35.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.365+0000 7fc4fff38740 10 client.16992 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:03:35.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.365+0000 7fc4fff38740 10 client.16992 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:03:35.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.365+0000 7fc4fff38740 20 client.16992 populate_metadata read hostname 'smithi092' 2024-09-19T09:03:35.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.365+0000 7fc4fff38740 1 --2- 172.21.15.92:0/525534838 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f91176d680 0x55f9117ea340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:35.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.365+0000 7fc4fff38740 4 client.16992 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:03:35.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.365+0000 7fc4fff38740 1 -- 172.21.15.92:0/525534838 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f9116cfd60 con 0x55f91176d680 2024-09-19T09:03:35.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.366+0000 7fc4f77fe640 1 --2- 172.21.15.92:0/525534838 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f91176d680 0x55f9117ea340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:35.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.366+0000 7fc4f77fe640 1 --2- 172.21.15.92:0/525534838 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f91176d680 0x55f9117ea340 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=398d58d97753b9b4 server_cookie=b8374138865b8dfb in_seq=0 out_seq=0 2024-09-19T09:03:35.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.366+0000 7fc4d6ffd640 10 client.16992 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:35.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.366+0000 7fc4d6ffd640 1 -- 172.21.15.92:0/525534838 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55f9116cfd60 con 0x55f91176d680 2024-09-19T09:03:35.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.366+0000 7fc4d6ffd640 10 client.16992 handle_command_reply: tid=0 2024-09-19T09:03:35.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.366+0000 7fc4fff38740 1 client.16992 shutdown 2024-09-19T09:03:35.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.366+0000 7fc4fff38740 1 -- 172.21.15.92:0/525534838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f911762dc0 msgr2=0x55f911773d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:35.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.366+0000 7fc4fff38740 1 --2- 172.21.15.92:0/525534838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f911762dc0 0x55f911773d40 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fc4f00c5980 tx=0x7fc4f00041a0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.367+0000 7fc4fff38740 1 -- 172.21.15.92:0/525534838 shutdown_connections 2024-09-19T09:03:35.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.367+0000 7fc4fff38740 1 --2- 172.21.15.92:0/525534838 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f91176d680 0x55f9117ea340 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.367+0000 7fc4fff38740 1 --2- 172.21.15.92:0/525534838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f911762dc0 0x55f911773d40 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.367+0000 7fc4fff38740 1 --2- 172.21.15.92:0/525534838 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f9117624a0 0x55f911773800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.367+0000 7fc4fff38740 1 --2- 172.21.15.92:0/525534838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f91175ea30 0x55f9117732c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.367+0000 7fc4fff38740 1 -- 172.21.15.92:0/525534838 >> 172.21.15.92:0/525534838 conn(0x55f91176a890 msgr2=0x55f91176c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:35.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.367+0000 7fc4d6ffd640 0 client.16992 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:35.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.367+0000 7fc4fff38740 1 -- 172.21.15.92:0/525534838 shutdown_connections 2024-09-19T09:03:35.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.367+0000 7fc4fff38740 1 -- 172.21.15.92:0/525534838 wait complete. 2024-09-19T09:03:35.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.367+0000 7fc4fff38740 20 client.16992 trim_cache size 0 max 16384 2024-09-19T09:03:35.373 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:03:35.374 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:03:35.374 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": { 2024-09-19T09:03:35.374 INFO:teuthology.orchestra.run.smithi092.stdout: "bc17e676-4781-4f5b-a4d7-09ca51b1ff10": { 2024-09-19T09:03:35.374 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-19T09:03:35.374 INFO:teuthology.orchestra.run.smithi092.stdout: "tag": "bc17e676-4781-4f5b-a4d7-09ca51b1ff10", 2024-09-19T09:03:35.374 INFO:teuthology.orchestra.run.smithi092.stdout: "options": "recursive,force" 2024-09-19T09:03:35.374 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:03:35.374 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:03:35.374 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:03:35.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.367+0000 7fc4fdb5f640 1 -- 172.21.15.92:0/379432279 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc4e00a3240 msgr2=0x7fc4e00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:35.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.367+0000 7fc4fdb5f640 1 --2- 172.21.15.92:0/379432279 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc4e00a3240 0x7fc4e00a5700 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x55f91175f890 tx=0x7fc4ec0098f0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.367+0000 7fc4fdb5f640 1 -- 172.21.15.92:0/379432279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4f8106bb0 msgr2=0x7fc4f8101c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:35.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.367+0000 7fc4fdb5f640 1 --2- 172.21.15.92:0/379432279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4f8106bb0 0x7fc4f8101c30 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fc4f0031f80 tx=0x7fc4f0031a60 comp rx=0 tx=0).stop 2024-09-19T09:03:35.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.367+0000 7fc4fdb5f640 1 -- 172.21.15.92:0/379432279 shutdown_connections 2024-09-19T09:03:35.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.367+0000 7fc4fdb5f640 1 --2- 172.21.15.92:0/379432279 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc4e00a3240 0x7fc4e00a5700 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.367+0000 7fc4fdb5f640 1 --2- 172.21.15.92:0/379432279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4f8106bb0 0x7fc4f8101c30 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.367+0000 7fc4fdb5f640 1 --2- 172.21.15.92:0/379432279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4f8100970 0x7fc4f81016f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.367+0000 7fc4fdb5f640 1 --2- 172.21.15.92:0/379432279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc4f80fffd0 0x7fc4f81011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.367+0000 7fc4fdb5f640 1 -- 172.21.15.92:0/379432279 >> 172.21.15.92:0/379432279 conn(0x7fc4f80fbee0 msgr2=0x7fc4f80fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:35.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.367+0000 7fc4fdb5f640 1 -- 172.21.15.92:0/379432279 shutdown_connections 2024-09-19T09:03:35.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:35.367+0000 7fc4fdb5f640 1 -- 172.21.15.92:0/379432279 wait complete. 2024-09-19T09:03:35.657 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:35 smithi092 ceph-mon[31407]: scrub queued for path: / 2024-09-19T09:03:35.657 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:35 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:35.658 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:35 smithi092 ceph-mon[31407]: scrub summary: active paths [/] 2024-09-19T09:03:35.658 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:35 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:35.658 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:35 smithi092 ceph-mon[31407]: pgmap v543: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 2.4 MiB/s wr, 289 op/s 2024-09-19T09:03:35.795 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:03:35.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:35 smithi167 ceph-mon[35359]: scrub queued for path: / 2024-09-19T09:03:35.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:35 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:35.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:35 smithi167 ceph-mon[35359]: scrub summary: active paths [/] 2024-09-19T09:03:35.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:35 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:35.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:35 smithi167 ceph-mon[35359]: pgmap v543: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 2.4 MiB/s wr, 289 op/s 2024-09-19T09:03:35.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:35 smithi190 ceph-mon[35358]: scrub queued for path: / 2024-09-19T09:03:35.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:35 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:35.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:35 smithi190 ceph-mon[35358]: scrub summary: active paths [/] 2024-09-19T09:03:35.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:35 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:35.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:35 smithi190 ceph-mon[35358]: pgmap v543: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 2.4 MiB/s wr, 289 op/s 2024-09-19T09:03:36.128 INFO:tasks.cephfs.filesystem:scrub status for tag:bc17e676-4781-4f5b-a4d7-09ca51b1ff10 - {'path': '/', 'tag': 'bc17e676-4781-4f5b-a4d7-09ca51b1ff10', 'options': 'recursive,force'} 2024-09-19T09:03:37.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:37 smithi167 ceph-mon[35359]: pgmap v544: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 1.6 MiB/s wr, 226 op/s 2024-09-19T09:03:37.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:37 smithi190 ceph-mon[35358]: pgmap v544: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 1.6 MiB/s wr, 226 op/s 2024-09-19T09:03:38.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:37 smithi092 ceph-mon[31407]: pgmap v544: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 1.6 MiB/s wr, 226 op/s 2024-09-19T09:03:39.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:39 smithi092 ceph-mon[31407]: pgmap v545: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 3.8 MiB/s wr, 302 op/s 2024-09-19T09:03:39.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:39 smithi092 ceph-mon[31407]: scrub summary: idle 2024-09-19T09:03:39.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:39 smithi167 ceph-mon[35359]: pgmap v545: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 3.8 MiB/s wr, 302 op/s 2024-09-19T09:03:39.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:39 smithi167 ceph-mon[35359]: scrub summary: idle 2024-09-19T09:03:39.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:39 smithi190 ceph-mon[35358]: pgmap v545: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 3.8 MiB/s wr, 302 op/s 2024-09-19T09:03:39.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:39 smithi190 ceph-mon[35358]: scrub summary: idle 2024-09-19T09:03:40.800 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:03:41.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:41 smithi167 ceph-mon[35359]: pgmap v546: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 9.6 MiB/s wr, 466 op/s 2024-09-19T09:03:41.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:41 smithi190 ceph-mon[35358]: pgmap v546: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 9.6 MiB/s wr, 466 op/s 2024-09-19T09:03:42.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:41 smithi092 ceph-mon[31407]: pgmap v546: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 9.6 MiB/s wr, 466 op/s 2024-09-19T09:03:43.103 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:03:43.361 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:43.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:43 smithi092 ceph-mon[31407]: pgmap v547: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 13 MiB/s wr, 522 op/s 2024-09-19T09:03:43.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.767+0000 7f57bd3f0640 1 -- 172.21.15.92:0/2857179590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57b8101420 msgr2=0x7f57b810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:43.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.767+0000 7f57bd3f0640 1 --2- 172.21.15.92:0/2857179590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57b8101420 0x7f57b810d950 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f57b0009cd0 tx=0x7f57b002a8e0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.768+0000 7f57bd3f0640 1 -- 172.21.15.92:0/2857179590 shutdown_connections 2024-09-19T09:03:43.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.768+0000 7f57bd3f0640 1 --2- 172.21.15.92:0/2857179590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57b8101420 0x7f57b810d950 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.768+0000 7f57bd3f0640 1 --2- 172.21.15.92:0/2857179590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57b8100a80 0x7f57b8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.768+0000 7f57bd3f0640 1 --2- 172.21.15.92:0/2857179590 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57b8106a80 0x7f57b8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.768+0000 7f57bd3f0640 1 -- 172.21.15.92:0/2857179590 >> 172.21.15.92:0/2857179590 conn(0x7f57b80fc7a0 msgr2=0x7f57b80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:43.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.768+0000 7f57bd3f0640 1 -- 172.21.15.92:0/2857179590 shutdown_connections 2024-09-19T09:03:43.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.768+0000 7f57bd3f0640 1 -- 172.21.15.92:0/2857179590 wait complete. 2024-09-19T09:03:43.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.768+0000 7f57bd3f0640 1 Processor -- start 2024-09-19T09:03:43.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.768+0000 7f57bd3f0640 1 -- start start 2024-09-19T09:03:43.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.769+0000 7f57bd3f0640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57b8100a80 0x7f57b8197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:43.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.769+0000 7f57bd3f0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57b8101420 0x7f57b81977a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:43.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.769+0000 7f57bd3f0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57b8106a80 0x7f57b819bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:43.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.769+0000 7f57bd3f0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f57b8110e80 con 0x7f57b8101420 2024-09-19T09:03:43.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.769+0000 7f57bd3f0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f57b8110d00 con 0x7f57b8106a80 2024-09-19T09:03:43.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.769+0000 7f57bd3f0640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f57b8111000 con 0x7f57b8100a80 2024-09-19T09:03:43.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.769+0000 7f57b67fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57b8101420 0x7f57b81977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:43.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.769+0000 7f57b67fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57b8101420 0x7f57b81977a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35488/0 (socket says 172.21.15.92:35488) 2024-09-19T09:03:43.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.769+0000 7f57b67fc640 1 -- 172.21.15.92:0/1206335162 learned_addr learned my addr 172.21.15.92:0/1206335162 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:43.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.769+0000 7f57b77fe640 1 --2- 172.21.15.92:0/1206335162 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57b8106a80 0x7f57b819bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:43.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.769+0000 7f57b6ffd640 1 --2- 172.21.15.92:0/1206335162 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57b8100a80 0x7f57b8197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:43.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.769+0000 7f57b67fc640 1 -- 172.21.15.92:0/1206335162 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57b8100a80 msgr2=0x7f57b8197260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:43.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.769+0000 7f57b67fc640 1 --2- 172.21.15.92:0/1206335162 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57b8100a80 0x7f57b8197260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.769+0000 7f57b67fc640 1 -- 172.21.15.92:0/1206335162 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57b8106a80 msgr2=0x7f57b819bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:43.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.769+0000 7f57b67fc640 1 --2- 172.21.15.92:0/1206335162 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57b8106a80 0x7f57b819bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.769+0000 7f57b67fc640 1 -- 172.21.15.92:0/1206335162 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b819c210 con 0x7f57b8101420 2024-09-19T09:03:43.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.769+0000 7f57b67fc640 1 --2- 172.21.15.92:0/1206335162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57b8101420 0x7f57b81977a0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f57ac00d770 tx=0x7f57ac00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:43.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.769+0000 7f579ffff640 1 -- 172.21.15.92:0/1206335162 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ac017070 con 0x7f57b8101420 2024-09-19T09:03:43.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.769+0000 7f57bd3f0640 1 -- 172.21.15.92:0/1206335162 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57b819c500 con 0x7f57b8101420 2024-09-19T09:03:43.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.769+0000 7f579ffff640 1 -- 172.21.15.92:0/1206335162 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57ac005500 con 0x7f57b8101420 2024-09-19T09:03:43.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.769+0000 7f579ffff640 1 -- 172.21.15.92:0/1206335162 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ac004e00 con 0x7f57b8101420 2024-09-19T09:03:43.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.770+0000 7f57bd3f0640 1 -- 172.21.15.92:0/1206335162 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57b81a3de0 con 0x7f57b8101420 2024-09-19T09:03:43.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.770+0000 7f57bd3f0640 1 -- 172.21.15.92:0/1206335162 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57b8100ee0 con 0x7f57b8101420 2024-09-19T09:03:43.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.772+0000 7f579ffff640 1 -- 172.21.15.92:0/1206335162 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f57ac004fa0 con 0x7f57b8101420 2024-09-19T09:03:43.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.772+0000 7f579ffff640 1 --2- 172.21.15.92:0/1206335162 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f57a00a3240 0x7f57a00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:43.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.773+0000 7f57b6ffd640 1 --2- 172.21.15.92:0/1206335162 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f57a00a3240 0x7f57a00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:43.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.773+0000 7f579ffff640 1 -- 172.21.15.92:0/1206335162 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f57ac0cf390 con 0x7f57b8101420 2024-09-19T09:03:43.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.773+0000 7f57b6ffd640 1 --2- 172.21.15.92:0/1206335162 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f57a00a3240 0x7f57a00a5700 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f57a800cac0 tx=0x7f57a800c4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:43.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.777+0000 7f579ffff640 1 -- 172.21.15.92:0/1206335162 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f57ac09c0b0 con 0x7f57b8101420 2024-09-19T09:03:43.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:43 smithi167 ceph-mon[35359]: pgmap v547: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 13 MiB/s wr, 522 op/s 2024-09-19T09:03:43.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:43 smithi190 ceph-mon[35358]: pgmap v547: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 13 MiB/s wr, 522 op/s 2024-09-19T09:03:43.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.976+0000 7f57bd3f0640 1 -- 172.21.15.92:0/1206335162 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f57b81a4040 con 0x7f57b8101420 2024-09-19T09:03:43.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.977+0000 7f579ffff640 1 -- 172.21.15.92:0/1206335162 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f57ac09b9b0 con 0x7f57b8101420 2024-09-19T09:03:43.979 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:03:43.979 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:03:43.979 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:03:43.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.979+0000 7f57bd3f0640 1 -- 172.21.15.92:0/1206335162 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f57a00a3240 msgr2=0x7f57a00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:43.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.979+0000 7f57bd3f0640 1 --2- 172.21.15.92:0/1206335162 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f57a00a3240 0x7f57a00a5700 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f57a800cac0 tx=0x7f57a800c4a0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.979+0000 7f57bd3f0640 1 -- 172.21.15.92:0/1206335162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57b8101420 msgr2=0x7f57b81977a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:43.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.979+0000 7f57bd3f0640 1 --2- 172.21.15.92:0/1206335162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57b8101420 0x7f57b81977a0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f57ac00d770 tx=0x7f57ac00dc30 comp rx=0 tx=0).stop 2024-09-19T09:03:43.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.979+0000 7f57bd3f0640 1 -- 172.21.15.92:0/1206335162 shutdown_connections 2024-09-19T09:03:43.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.979+0000 7f57bd3f0640 1 --2- 172.21.15.92:0/1206335162 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57b8106a80 0x7f57b819bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.979+0000 7f57bd3f0640 1 --2- 172.21.15.92:0/1206335162 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f57a00a3240 0x7f57a00a5700 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.979+0000 7f57bd3f0640 1 --2- 172.21.15.92:0/1206335162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57b8101420 0x7f57b81977a0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.979+0000 7f57bd3f0640 1 --2- 172.21.15.92:0/1206335162 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57b8100a80 0x7f57b8197260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.979+0000 7f57bd3f0640 1 -- 172.21.15.92:0/1206335162 >> 172.21.15.92:0/1206335162 conn(0x7f57b80fc7a0 msgr2=0x7f57b80fcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:43.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.980+0000 7f57bd3f0640 1 -- 172.21.15.92:0/1206335162 shutdown_connections 2024-09-19T09:03:43.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:43.980+0000 7f57bd3f0640 1 -- 172.21.15.92:0/1206335162 wait complete. 2024-09-19T09:03:44.728 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id 1858207 --release --await' 2024-09-19T09:03:44.728 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id 1858207 --release --await 2024-09-19T09:03:44.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:44 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1206335162' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:44.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:44 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/1206335162' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:44.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:44 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/1206335162' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:44.973 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:45.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.430+0000 7fa404b1f640 1 -- 172.21.15.92:0/2104354612 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa400106a80 msgr2=0x7fa400106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:45.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.430+0000 7fa404b1f640 1 --2- 172.21.15.92:0/2104354612 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa400106a80 0x7fa400106e60 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0009930 tx=0x7fa3f002a420 comp rx=0 tx=0).stop 2024-09-19T09:03:45.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.430+0000 7fa404b1f640 1 -- 172.21.15.92:0/2104354612 shutdown_connections 2024-09-19T09:03:45.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.430+0000 7fa404b1f640 1 --2- 172.21.15.92:0/2104354612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa400101420 0x7fa40010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.430+0000 7fa404b1f640 1 --2- 172.21.15.92:0/2104354612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa400100a80 0x7fa400100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.430+0000 7fa404b1f640 1 --2- 172.21.15.92:0/2104354612 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa400106a80 0x7fa400106e60 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.430+0000 7fa404b1f640 1 -- 172.21.15.92:0/2104354612 >> 172.21.15.92:0/2104354612 conn(0x7fa4000fc7a0 msgr2=0x7fa4000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:45.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.430+0000 7fa404b1f640 1 -- 172.21.15.92:0/2104354612 shutdown_connections 2024-09-19T09:03:45.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.430+0000 7fa404b1f640 1 -- 172.21.15.92:0/2104354612 wait complete. 2024-09-19T09:03:45.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.431+0000 7fa404b1f640 1 Processor -- start 2024-09-19T09:03:45.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.431+0000 7fa404b1f640 1 -- start start 2024-09-19T09:03:45.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.431+0000 7fa404b1f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa400100a80 0x7fa400199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:45.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.431+0000 7fa404b1f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa400101420 0x7fa4001997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:45.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.431+0000 7fa404b1f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa400106a80 0x7fa4001a4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:45.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.431+0000 7fa404b1f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa400110ea0 con 0x7fa400101420 2024-09-19T09:03:45.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.431+0000 7fa404b1f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa400110d20 con 0x7fa400100a80 2024-09-19T09:03:45.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.431+0000 7fa404b1f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa400111020 con 0x7fa400106a80 2024-09-19T09:03:45.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.431+0000 7fa3fdd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa400101420 0x7fa4001997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:45.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.431+0000 7fa3fdd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa400101420 0x7fa4001997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35504/0 (socket says 172.21.15.92:35504) 2024-09-19T09:03:45.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.431+0000 7fa3fdd9b640 1 -- 172.21.15.92:0/666487951 learned_addr learned my addr 172.21.15.92:0/666487951 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:45.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.431+0000 7fa3fed9d640 1 --2- 172.21.15.92:0/666487951 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa400106a80 0x7fa4001a4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:45.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.431+0000 7fa3fe59c640 1 --2- 172.21.15.92:0/666487951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa400100a80 0x7fa400199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:45.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.432+0000 7fa3fdd9b640 1 -- 172.21.15.92:0/666487951 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa400106a80 msgr2=0x7fa4001a4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:45.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.432+0000 7fa3fdd9b640 1 --2- 172.21.15.92:0/666487951 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa400106a80 0x7fa4001a4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.432+0000 7fa3fdd9b640 1 -- 172.21.15.92:0/666487951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa400100a80 msgr2=0x7fa400199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:45.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.432+0000 7fa3fdd9b640 1 --2- 172.21.15.92:0/666487951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa400100a80 0x7fa400199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.432+0000 7fa3fdd9b640 1 -- 172.21.15.92:0/666487951 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4001a4850 con 0x7fa400101420 2024-09-19T09:03:45.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.432+0000 7fa3fe59c640 1 --2- 172.21.15.92:0/666487951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa400100a80 0x7fa400199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:45.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.432+0000 7fa3fdd9b640 1 --2- 172.21.15.92:0/666487951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa400101420 0x7fa4001997d0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fa3f400c920 tx=0x7fa3f400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:45.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.432+0000 7fa3ef7fe640 1 -- 172.21.15.92:0/666487951 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f4007c70 con 0x7fa400101420 2024-09-19T09:03:45.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.432+0000 7fa3ef7fe640 1 -- 172.21.15.92:0/666487951 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3f4007e10 con 0x7fa400101420 2024-09-19T09:03:45.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.432+0000 7fa404b1f640 1 -- 172.21.15.92:0/666487951 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4001a4a20 con 0x7fa400101420 2024-09-19T09:03:45.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.432+0000 7fa3ef7fe640 1 -- 172.21.15.92:0/666487951 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f4018890 con 0x7fa400101420 2024-09-19T09:03:45.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.432+0000 7fa404b1f640 1 -- 172.21.15.92:0/666487951 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4001a4f30 con 0x7fa400101420 2024-09-19T09:03:45.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.434+0000 7fa3ef7fe640 1 -- 172.21.15.92:0/666487951 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa3f4018a70 con 0x7fa400101420 2024-09-19T09:03:45.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.435+0000 7fa406ef8740 1 Processor -- start 2024-09-19T09:03:45.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.435+0000 7fa406ef8740 1 -- start start 2024-09-19T09:03:45.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.435+0000 7fa406ef8740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556657eb4060 0x556657eb4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:45.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.435+0000 7fa406ef8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556657eb4980 0x556657ebed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:45.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.435+0000 7fa406ef8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556657ebf240 0x556657ec1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:45.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.435+0000 7fa406ef8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556657e19620 con 0x556657ebf240 2024-09-19T09:03:45.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.435+0000 7fa406ef8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556657dc0e50 con 0x556657eb4980 2024-09-19T09:03:45.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.435+0000 7fa406ef8740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x556657e155e0 con 0x556657eb4060 2024-09-19T09:03:45.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.435+0000 7fa3fdd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556657ebf240 0x556657ec1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:45.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.435+0000 7fa3fdd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556657ebf240 0x556657ec1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35520/0 (socket says 172.21.15.92:35520) 2024-09-19T09:03:45.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.435+0000 7fa3fdd9b640 1 -- 172.21.15.92:0/3344665307 learned_addr learned my addr 172.21.15.92:0/3344665307 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:45.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.435+0000 7fa3ef7fe640 1 --2- 172.21.15.92:0/666487951 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa3e80a3240 0x7fa3e80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:45.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.435+0000 7fa3fe59c640 1 --2- 172.21.15.92:0/3344665307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556657eb4980 0x556657ebed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:45.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.435+0000 7fa3fed9d640 1 --2- 172.21.15.92:0/3344665307 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556657eb4060 0x556657eb4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:45.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.435+0000 7fa3fed9d640 1 --2- 172.21.15.92:0/666487951 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa3e80a3240 0x7fa3e80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:45.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.436+0000 7fa3ef7fe640 1 -- 172.21.15.92:0/666487951 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa3f40cfa60 con 0x7fa400101420 2024-09-19T09:03:45.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.436+0000 7fa3fdd9b640 1 -- 172.21.15.92:0/3344665307 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556657eb4060 msgr2=0x556657eb4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:45.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.436+0000 7fa3fdd9b640 1 --2- 172.21.15.92:0/3344665307 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556657eb4060 0x556657eb4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.436+0000 7fa3fdd9b640 1 -- 172.21.15.92:0/3344665307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556657eb4980 msgr2=0x556657ebed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:45.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.436+0000 7fa3fdd9b640 1 --2- 172.21.15.92:0/3344665307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556657eb4980 0x556657ebed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.436+0000 7fa3fdd9b640 1 -- 172.21.15.92:0/3344665307 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556657db1d40 con 0x556657ebf240 2024-09-19T09:03:45.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.436+0000 7fa3fe59c640 1 --2- 172.21.15.92:0/3344665307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556657eb4980 0x556657ebed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:45.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.436+0000 7fa3fdd9b640 1 --2- 172.21.15.92:0/3344665307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556657ebf240 0x556657ec1630 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40cd560 tx=0x7fa3f400ff30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3318ca17f4956aa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:45.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.436+0000 7fa3fed9d640 1 --2- 172.21.15.92:0/666487951 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa3e80a3240 0x7fa3e80a5700 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8009900 tx=0x7fa3f8009650 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:45.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.436+0000 7fa3ecff9640 1 -- 172.21.15.92:0/3344665307 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f409c780 con 0x556657ebf240 2024-09-19T09:03:45.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.436+0000 7fa3ecff9640 1 -- 172.21.15.92:0/3344665307 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3f409c080 con 0x556657ebf240 2024-09-19T09:03:45.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.436+0000 7fa3ecff9640 1 -- 172.21.15.92:0/3344665307 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f40a0110 con 0x556657ebf240 2024-09-19T09:03:45.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.437+0000 7fa406ef8740 1 -- 172.21.15.92:0/3344665307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556657ebf240 msgr2=0x556657ec1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:45.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.437+0000 7fa406ef8740 1 --2- 172.21.15.92:0/3344665307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556657ebf240 0x556657ec1630 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40cd560 tx=0x7fa3f400ff30 comp rx=0 tx=0).stop 2024-09-19T09:03:45.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.437+0000 7fa406ef8740 1 -- 172.21.15.92:0/3344665307 shutdown_connections 2024-09-19T09:03:45.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.437+0000 7fa406ef8740 1 --2- 172.21.15.92:0/3344665307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556657ebf240 0x556657ec1630 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.437+0000 7fa406ef8740 1 --2- 172.21.15.92:0/3344665307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556657eb4980 0x556657ebed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.437+0000 7fa406ef8740 1 --2- 172.21.15.92:0/3344665307 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556657eb4060 0x556657eb4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.437+0000 7fa406ef8740 1 -- 172.21.15.92:0/3344665307 >> 172.21.15.92:0/3344665307 conn(0x556657eb05f0 msgr2=0x556657eb09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:45.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.437+0000 7fa406ef8740 1 -- 172.21.15.92:0/3344665307 shutdown_connections 2024-09-19T09:03:45.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.437+0000 7fa406ef8740 1 -- 172.21.15.92:0/3344665307 wait complete. 2024-09-19T09:03:45.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.437+0000 7fa406ef8740 1 -- start start 2024-09-19T09:03:45.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.437+0000 7fa406ef8740 1 Processor -- start 2024-09-19T09:03:45.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.438+0000 7fa406ef8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556657eb4060 0x556657ebc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:45.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.438+0000 7fa406ef8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556657eb4980 0x556657ebc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:45.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.438+0000 7fa406ef8740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556657ebf240 0x556657ebcc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:45.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.438+0000 7fa406ef8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556657ec1e10 con 0x556657eb4980 2024-09-19T09:03:45.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.438+0000 7fa406ef8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556657da1f10 con 0x556657eb4060 2024-09-19T09:03:45.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.438+0000 7fa406ef8740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x556657ec1f90 con 0x556657ebf240 2024-09-19T09:03:45.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.438+0000 7fa406ef8740 10 client.0 _ll_register_callbacks cb 0x556657dc5db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:45.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.438+0000 7fa3fdd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556657eb4980 0x556657ebc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:45.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.438+0000 7fa3fdd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556657eb4980 0x556657ebc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35534/0 (socket says 172.21.15.92:35534) 2024-09-19T09:03:45.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.438+0000 7fa3fdd9b640 1 -- 172.21.15.92:0/3047438383 learned_addr learned my addr 172.21.15.92:0/3047438383 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:45.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.438+0000 7fa3fe59c640 1 --2- 172.21.15.92:0/3047438383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556657eb4060 0x556657ebc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:45.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.438+0000 7fa3fed9d640 1 --2- 172.21.15.92:0/3047438383 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556657ebf240 0x556657ebcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:45.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.438+0000 7fa3fdd9b640 1 -- 172.21.15.92:0/3047438383 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556657ebf240 msgr2=0x556657ebcc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:45.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.438+0000 7fa3fdd9b640 1 --2- 172.21.15.92:0/3047438383 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556657ebf240 0x556657ebcc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.438+0000 7fa3fdd9b640 1 -- 172.21.15.92:0/3047438383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556657eb4060 msgr2=0x556657ebc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:45.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.438+0000 7fa3fdd9b640 1 --2- 172.21.15.92:0/3047438383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556657eb4060 0x556657ebc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.438+0000 7fa3fdd9b640 1 -- 172.21.15.92:0/3047438383 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556657b28580 con 0x556657eb4980 2024-09-19T09:03:45.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.438+0000 7fa3fe59c640 1 --2- 172.21.15.92:0/3047438383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556657eb4060 0x556657ebc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:45.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.438+0000 7fa3fdd9b640 1 --2- 172.21.15.92:0/3047438383 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556657eb4980 0x556657ebc6e0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40a47c0 tx=0x7fa3f4098930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c07be68b0e7edb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:45.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.438+0000 7fa3e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:03:45.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.438+0000 7fa3e5ffb640 1 -- 172.21.15.92:0/3047438383 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f407e020 con 0x556657eb4980 2024-09-19T09:03:45.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.438+0000 7fa3e5ffb640 1 -- 172.21.15.92:0/3047438383 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa3f4018d60 con 0x556657eb4980 2024-09-19T09:03:45.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.438+0000 7fa406ef8740 1 -- 172.21.15.92:0/3047438383 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3f409c080 con 0x556657eb4980 2024-09-19T09:03:45.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.439+0000 7fa3e5ffb640 1 -- 172.21.15.92:0/3047438383 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa3f409c780 con 0x556657eb4980 2024-09-19T09:03:45.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.439+0000 7fa406ef8740 10 client.17010 fetch_fsmap learned FSMap version 19 2024-09-19T09:03:45.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.439+0000 7fa406ef8740 1 -- 172.21.15.92:0/3047438383 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x556657bf2960 con 0x556657eb4980 2024-09-19T09:03:45.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.439+0000 7fa3e5ffb640 1 -- 172.21.15.92:0/3047438383 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3f409c080 con 0x556657eb4980 2024-09-19T09:03:45.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.439+0000 7fa3e5ffb640 1 -- 172.21.15.92:0/3047438383 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fa3f409b4d0 con 0x556657eb4980 2024-09-19T09:03:45.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.439+0000 7fa406ef8740 10 client.17010 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:03:45.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.439+0000 7fa406ef8740 10 client.17010 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:03:45.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.439+0000 7fa406ef8740 20 client.17010 populate_metadata read hostname 'smithi092' 2024-09-19T09:03:45.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.439+0000 7fa406ef8740 1 --2- 172.21.15.92:0/3047438383 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556657ececc0 0x556657ed10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:45.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.439+0000 7fa406ef8740 4 client.17010 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:45.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.439+0000 7fa406ef8740 1 -- 172.21.15.92:0/3047438383 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556657e26b90 con 0x556657ececc0 2024-09-19T09:03:45.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.439+0000 7fa3fe59c640 1 --2- 172.21.15.92:0/3047438383 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556657ececc0 0x556657ed10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:45.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.440+0000 7fa3fe59c640 1 --2- 172.21.15.92:0/3047438383 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556657ececc0 0x556657ed10b0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae8cfe2f9ad68877 server_cookie=a41c3af3e2565a69 in_seq=0 out_seq=0 2024-09-19T09:03:45.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.440+0000 7fa3e5ffb640 10 client.17010 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:45.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.440+0000 7fa3e5ffb640 1 -- 172.21.15.92:0/3047438383 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556657e26b90 con 0x556657ececc0 2024-09-19T09:03:45.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.440+0000 7fa3e5ffb640 10 client.17010 handle_command_reply: tid=0 2024-09-19T09:03:45.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.441+0000 7fa406ef8740 1 client.17010 shutdown 2024-09-19T09:03:45.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.441+0000 7fa406ef8740 1 -- 172.21.15.92:0/3047438383 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556657eb4980 msgr2=0x556657ebc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:45.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.441+0000 7fa406ef8740 1 --2- 172.21.15.92:0/3047438383 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556657eb4980 0x556657ebc6e0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40a47c0 tx=0x7fa3f4098930 comp rx=0 tx=0).stop 2024-09-19T09:03:45.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.441+0000 7fa406ef8740 1 -- 172.21.15.92:0/3047438383 shutdown_connections 2024-09-19T09:03:45.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.441+0000 7fa406ef8740 1 --2- 172.21.15.92:0/3047438383 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556657ececc0 0x556657ed10b0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.441+0000 7fa406ef8740 1 --2- 172.21.15.92:0/3047438383 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556657ebf240 0x556657ebcc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.441+0000 7fa406ef8740 1 --2- 172.21.15.92:0/3047438383 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556657eb4980 0x556657ebc6e0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.441+0000 7fa406ef8740 1 --2- 172.21.15.92:0/3047438383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556657eb4060 0x556657ebc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.441+0000 7fa406ef8740 1 -- 172.21.15.92:0/3047438383 >> 172.21.15.92:0/3047438383 conn(0x556657eb05f0 msgr2=0x556657eb62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:45.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.441+0000 7fa3e5ffb640 0 client.17010 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:45.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.441+0000 7fa406ef8740 1 -- 172.21.15.92:0/3047438383 shutdown_connections 2024-09-19T09:03:45.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.441+0000 7fa406ef8740 1 -- 172.21.15.92:0/3047438383 wait complete. 2024-09-19T09:03:45.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.441+0000 7fa406ef8740 20 client.17010 trim_cache size 0 max 16384 2024-09-19T09:03:45.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.458+0000 7fa406ef8740 1 Processor -- start 2024-09-19T09:03:45.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.458+0000 7fa406ef8740 1 -- start start 2024-09-19T09:03:45.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.458+0000 7fa406ef8740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556657eb4060 0x556657ebe110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:45.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.458+0000 7fa406ef8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556657eb4980 0x556657ed40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:45.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.458+0000 7fa406ef8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556657ebf240 0x556657ed4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:45.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.458+0000 7fa406ef8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa4001ab580 con 0x556657eb4980 2024-09-19T09:03:45.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.458+0000 7fa406ef8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa4001ade20 con 0x556657ebf240 2024-09-19T09:03:45.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.458+0000 7fa406ef8740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa4001abc10 con 0x556657eb4060 2024-09-19T09:03:45.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.458+0000 7fa3fdd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556657eb4980 0x556657ed40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:45.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.458+0000 7fa3fdd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556657eb4980 0x556657ed40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35538/0 (socket says 172.21.15.92:35538) 2024-09-19T09:03:45.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.458+0000 7fa3fdd9b640 1 -- 172.21.15.92:0/1551759100 learned_addr learned my addr 172.21.15.92:0/1551759100 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:45.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.458+0000 7fa3fe59c640 1 --2- 172.21.15.92:0/1551759100 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556657eb4060 0x556657ebe110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:45.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.458+0000 7fa3fed9d640 1 --2- 172.21.15.92:0/1551759100 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556657ebf240 0x556657ed4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:45.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.458+0000 7fa3fdd9b640 1 -- 172.21.15.92:0/1551759100 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556657eb4060 msgr2=0x556657ebe110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:45.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.458+0000 7fa3fdd9b640 1 --2- 172.21.15.92:0/1551759100 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556657eb4060 0x556657ebe110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.458+0000 7fa3fdd9b640 1 -- 172.21.15.92:0/1551759100 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556657ebf240 msgr2=0x556657ed4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:45.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.458+0000 7fa3fdd9b640 1 --2- 172.21.15.92:0/1551759100 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556657ebf240 0x556657ed4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.458+0000 7fa3fdd9b640 1 -- 172.21.15.92:0/1551759100 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556657ebb150 con 0x556657eb4980 2024-09-19T09:03:45.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.458+0000 7fa3fdd9b640 1 --2- 172.21.15.92:0/1551759100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556657eb4980 0x556657ed40e0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4098900 tx=0x7fa3f40cfce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b916080e46808abc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:45.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.459+0000 7fa3e7fff640 1 -- 172.21.15.92:0/1551759100 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f407e070 con 0x556657eb4980 2024-09-19T09:03:45.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.459+0000 7fa3e7fff640 1 -- 172.21.15.92:0/1551759100 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3f409c080 con 0x556657eb4980 2024-09-19T09:03:45.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.459+0000 7fa3e7fff640 1 -- 172.21.15.92:0/1551759100 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f409b4d0 con 0x556657eb4980 2024-09-19T09:03:45.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.459+0000 7fa406ef8740 1 -- 172.21.15.92:0/1551759100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556657eb4980 msgr2=0x556657ed40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:45.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.459+0000 7fa406ef8740 1 --2- 172.21.15.92:0/1551759100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556657eb4980 0x556657ed40e0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4098900 tx=0x7fa3f40cfce0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.459+0000 7fa406ef8740 1 -- 172.21.15.92:0/1551759100 shutdown_connections 2024-09-19T09:03:45.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.459+0000 7fa406ef8740 1 --2- 172.21.15.92:0/1551759100 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556657ebf240 0x556657ed4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.459+0000 7fa406ef8740 1 --2- 172.21.15.92:0/1551759100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556657eb4980 0x556657ed40e0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.459+0000 7fa406ef8740 1 --2- 172.21.15.92:0/1551759100 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556657eb4060 0x556657ebe110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.459+0000 7fa406ef8740 1 -- 172.21.15.92:0/1551759100 >> 172.21.15.92:0/1551759100 conn(0x556657eb05f0 msgr2=0x556657ebda00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:45.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.459+0000 7fa406ef8740 1 -- 172.21.15.92:0/1551759100 shutdown_connections 2024-09-19T09:03:45.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.459+0000 7fa406ef8740 1 -- 172.21.15.92:0/1551759100 wait complete. 2024-09-19T09:03:45.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.460+0000 7fa406ef8740 1 -- start start 2024-09-19T09:03:45.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.460+0000 7fa406ef8740 1 Processor -- start 2024-09-19T09:03:45.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.460+0000 7fa406ef8740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556657eb4060 0x556657f315b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:45.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.460+0000 7fa406ef8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556657eb4980 0x556657f31af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:45.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.460+0000 7fa406ef8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556657ebf240 0x556657f32050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:45.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.460+0000 7fa406ef8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa4001ac2e0 con 0x556657eb4980 2024-09-19T09:03:45.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.460+0000 7fa406ef8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa4001ad750 con 0x556657ebf240 2024-09-19T09:03:45.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.460+0000 7fa406ef8740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa4001ac9b0 con 0x556657eb4060 2024-09-19T09:03:45.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.460+0000 7fa406ef8740 10 client.0 _ll_register_callbacks cb 0x7fa3f400cf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:45.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.460+0000 7fa3fdd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556657eb4980 0x556657f31af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:45.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.460+0000 7fa3fdd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556657eb4980 0x556657f31af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35554/0 (socket says 172.21.15.92:35554) 2024-09-19T09:03:45.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.460+0000 7fa3fdd9b640 1 -- 172.21.15.92:0/3034214525 learned_addr learned my addr 172.21.15.92:0/3034214525 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:45.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.460+0000 7fa3fed9d640 1 --2- 172.21.15.92:0/3034214525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556657ebf240 0x556657f32050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:45.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.460+0000 7fa3fe59c640 1 --2- 172.21.15.92:0/3034214525 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556657eb4060 0x556657f315b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:45.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.460+0000 7fa3fdd9b640 1 -- 172.21.15.92:0/3034214525 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556657eb4060 msgr2=0x556657f315b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:45.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.460+0000 7fa3fdd9b640 1 --2- 172.21.15.92:0/3034214525 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556657eb4060 0x556657f315b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.460+0000 7fa3fdd9b640 1 -- 172.21.15.92:0/3034214525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556657ebf240 msgr2=0x556657f32050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:45.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.460+0000 7fa3fdd9b640 1 --2- 172.21.15.92:0/3034214525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556657ebf240 0x556657f32050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.460+0000 7fa3fdd9b640 1 -- 172.21.15.92:0/3034214525 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556657f3c900 con 0x556657eb4980 2024-09-19T09:03:45.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.460+0000 7fa3fe59c640 1 --2- 172.21.15.92:0/3034214525 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556657eb4060 0x556657f315b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:45.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.461+0000 7fa3fdd9b640 1 --2- 172.21.15.92:0/3034214525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556657eb4980 0x556657f31af0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40984e0 tx=0x7fa3f40cfd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17572624d7b64f4a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:45.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.461+0000 7fa3e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:03:45.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.461+0000 7fa3e5ffb640 1 -- 172.21.15.92:0/3034214525 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f4084030 con 0x556657eb4980 2024-09-19T09:03:45.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.461+0000 7fa3e5ffb640 1 -- 172.21.15.92:0/3034214525 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa3f409b4d0 con 0x556657eb4980 2024-09-19T09:03:45.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.461+0000 7fa406ef8740 1 -- 172.21.15.92:0/3034214525 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3f409c080 con 0x556657eb4980 2024-09-19T09:03:45.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.461+0000 7fa3e5ffb640 1 -- 172.21.15.92:0/3034214525 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa3f407e070 con 0x556657eb4980 2024-09-19T09:03:45.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.461+0000 7fa406ef8740 10 client.17016 fetch_fsmap learned FSMap version 19 2024-09-19T09:03:45.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.461+0000 7fa406ef8740 1 -- 172.21.15.92:0/3034214525 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x556657f3c900 con 0x556657eb4980 2024-09-19T09:03:45.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.461+0000 7fa3e5ffb640 1 -- 172.21.15.92:0/3034214525 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3f409c080 con 0x556657eb4980 2024-09-19T09:03:45.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.461+0000 7fa3e5ffb640 1 -- 172.21.15.92:0/3034214525 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fa3f40a15c0 con 0x556657eb4980 2024-09-19T09:03:45.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.461+0000 7fa406ef8740 10 client.17016 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:03:45.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.461+0000 7fa406ef8740 10 client.17016 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:03:45.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.461+0000 7fa406ef8740 20 client.17016 populate_metadata read hostname 'smithi092' 2024-09-19T09:03:45.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.461+0000 7fa406ef8740 1 --2- 172.21.15.92:0/3034214525 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556657f3df90 0x556657f40380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:45.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.461+0000 7fa406ef8740 4 client.17016 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "1858207", "release": true, "await": true}] 2024-09-19T09:03:45.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.461+0000 7fa406ef8740 1 -- 172.21.15.92:0/3034214525 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "quiesce db", "set_id": "1858207", "release": true, "await": true}) -- 0x556657e210a0 con 0x556657f3df90 2024-09-19T09:03:45.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.462+0000 7fa3fe59c640 1 --2- 172.21.15.92:0/3034214525 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556657f3df90 0x556657f40380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:45.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.462+0000 7fa3e5ffb640 10 client.17016 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:45.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.462+0000 7fa3fe59c640 1 --2- 172.21.15.92:0/3034214525 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556657f3df90 0x556657f40380 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac0ba3c7302eea30 server_cookie=634b1b95a2d527cf in_seq=0 out_seq=0 2024-09-19T09:03:45.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.521+0000 7fa3e5ffb640 1 -- 172.21.15.92:0/3034214525 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x556657e210a0 con 0x556657f3df90 2024-09-19T09:03:45.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.521+0000 7fa3e5ffb640 10 client.17016 handle_command_reply: tid=0 2024-09-19T09:03:45.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.521+0000 7fa406ef8740 1 client.17016 shutdown 2024-09-19T09:03:45.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.521+0000 7fa406ef8740 1 -- 172.21.15.92:0/3034214525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556657eb4980 msgr2=0x556657f31af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:45.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.521+0000 7fa406ef8740 1 --2- 172.21.15.92:0/3034214525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556657eb4980 0x556657f31af0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40984e0 tx=0x7fa3f40cfd50 comp rx=0 tx=0).stop 2024-09-19T09:03:45.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.521+0000 7fa406ef8740 1 -- 172.21.15.92:0/3034214525 shutdown_connections 2024-09-19T09:03:45.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.521+0000 7fa406ef8740 1 --2- 172.21.15.92:0/3034214525 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556657f3df90 0x556657f40380 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.521+0000 7fa3e5ffb640 0 client.17016 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:45.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.521+0000 7fa406ef8740 1 --2- 172.21.15.92:0/3034214525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556657ebf240 0x556657f32050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.521+0000 7fa406ef8740 1 --2- 172.21.15.92:0/3034214525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556657eb4980 0x556657f31af0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.521+0000 7fa406ef8740 1 --2- 172.21.15.92:0/3034214525 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556657eb4060 0x556657f315b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.521+0000 7fa406ef8740 1 -- 172.21.15.92:0/3034214525 >> 172.21.15.92:0/3034214525 conn(0x556657eb05f0 msgr2=0x556657ecaa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:45.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.522+0000 7fa406ef8740 1 -- 172.21.15.92:0/3034214525 shutdown_connections 2024-09-19T09:03:45.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.522+0000 7fa406ef8740 1 -- 172.21.15.92:0/3034214525 wait complete. 2024-09-19T09:03:45.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.522+0000 7fa406ef8740 20 client.17016 trim_cache size 0 max 16384 2024-09-19T09:03:45.524 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:03:45.524 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 19, 2024-09-19T09:03:45.524 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24472, 2024-09-19T09:03:45.524 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 28, 2024-09-19T09:03:45.524 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-09-19T09:03:45.524 INFO:teuthology.orchestra.run.smithi092.stdout: "1858207": { 2024-09-19T09:03:45.524 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 28, 2024-09-19T09:03:45.524 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-09-19T09:03:45.525 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:03:45.525 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-09-19T09:03:45.525 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:03:45.525 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:03:45.525 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 90.0, 2024-09-19T09:03:45.525 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 145.8, 2024-09-19T09:03:45.525 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-09-19T09:03:45.525 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-09-19T09:03:45.525 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-09-19T09:03:45.525 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:03:45.525 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-09-19T09:03:45.526 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:03:45.526 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:03:45.526 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:03:45.526 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:03:45.526 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:03:45.526 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:03:45.526 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:03:45.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.523+0000 7fa404b1f640 1 -- 172.21.15.92:0/666487951 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa3e80a3240 msgr2=0x7fa3e80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:45.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.523+0000 7fa404b1f640 1 --2- 172.21.15.92:0/666487951 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa3e80a3240 0x7fa3e80a5700 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8009900 tx=0x7fa3f8009650 comp rx=0 tx=0).stop 2024-09-19T09:03:45.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.523+0000 7fa404b1f640 1 -- 172.21.15.92:0/666487951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa400101420 msgr2=0x7fa4001997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:45.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.523+0000 7fa404b1f640 1 --2- 172.21.15.92:0/666487951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa400101420 0x7fa4001997d0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fa3f400c920 tx=0x7fa3f400cde0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.523+0000 7fa404b1f640 1 -- 172.21.15.92:0/666487951 shutdown_connections 2024-09-19T09:03:45.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.523+0000 7fa404b1f640 1 --2- 172.21.15.92:0/666487951 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa400106a80 0x7fa4001a4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.523+0000 7fa404b1f640 1 --2- 172.21.15.92:0/666487951 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa3e80a3240 0x7fa3e80a5700 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.523+0000 7fa404b1f640 1 --2- 172.21.15.92:0/666487951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa400101420 0x7fa4001997d0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.523+0000 7fa404b1f640 1 --2- 172.21.15.92:0/666487951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa400100a80 0x7fa400199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.523+0000 7fa404b1f640 1 -- 172.21.15.92:0/666487951 >> 172.21.15.92:0/666487951 conn(0x7fa4000fc7a0 msgr2=0x7fa4000fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:45.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.523+0000 7fa404b1f640 1 -- 172.21.15.92:0/666487951 shutdown_connections 2024-09-19T09:03:45.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:45.523+0000 7fa404b1f640 1 -- 172.21.15.92:0/666487951 wait complete. 2024-09-19T09:03:45.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:45 smithi092 ceph-mon[31407]: pgmap v548: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 12 MiB/s wr, 493 op/s 2024-09-19T09:03:45.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 420.0 s, 105.1 tps, lat 4558.851 ms stddev 9324.783 2024-09-19T09:03:45.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:45 smithi167 ceph-mon[35359]: pgmap v548: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 12 MiB/s wr, 493 op/s 2024-09-19T09:03:45.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:45 smithi190 ceph-mon[35358]: pgmap v548: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 12 MiB/s wr, 493 op/s 2024-09-19T09:03:46.234 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '1858207', total seconds elapsed: 28.9 2024-09-19T09:03:46.234 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.75 2024-09-19T09:03:46.234 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:03:46.678 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:46.814 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:46 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:03:46.814 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:46 smithi092 ceph-mon[31407]: pgmap v549: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 12 MiB/s wr, 458 op/s 2024-09-19T09:03:46.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:46 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:03:46.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:46 smithi167 ceph-mon[35359]: pgmap v549: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 12 MiB/s wr, 458 op/s 2024-09-19T09:03:46.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:46 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:03:46.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:46 smithi190 ceph-mon[35358]: pgmap v549: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 12 MiB/s wr, 458 op/s 2024-09-19T09:03:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.138+0000 7faa24c8f640 1 -- 172.21.15.92:0/1492244852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa201023f0 msgr2=0x7faa20108c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.138+0000 7faa24c8f640 1 --2- 172.21.15.92:0/1492244852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa201023f0 0x7faa20108c80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faa18009be0 tx=0x7faa1802a6c0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.139+0000 7faa24c8f640 1 -- 172.21.15.92:0/1492244852 shutdown_connections 2024-09-19T09:03:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.139+0000 7faa24c8f640 1 --2- 172.21.15.92:0/1492244852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa201023f0 0x7faa20108c80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.139+0000 7faa24c8f640 1 --2- 172.21.15.92:0/1492244852 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa20101a30 0x7faa20101eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.139+0000 7faa24c8f640 1 --2- 172.21.15.92:0/1492244852 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa20100840 0x7faa20100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.139+0000 7faa24c8f640 1 -- 172.21.15.92:0/1492244852 >> 172.21.15.92:0/1492244852 conn(0x7faa200fbfa0 msgr2=0x7faa200fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.139+0000 7faa24c8f640 1 -- 172.21.15.92:0/1492244852 shutdown_connections 2024-09-19T09:03:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.139+0000 7faa24c8f640 1 -- 172.21.15.92:0/1492244852 wait complete. 2024-09-19T09:03:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.140+0000 7faa24c8f640 1 Processor -- start 2024-09-19T09:03:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.141+0000 7faa24c8f640 1 -- start start 2024-09-19T09:03:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.141+0000 7faa24c8f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa20100840 0x7faa2019e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.141+0000 7faa24c8f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa20101a30 0x7faa2019e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.141+0000 7faa24c8f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa201023f0 0x7faa201a5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.141+0000 7faa24c8f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7faa2010a3c0 con 0x7faa20101a30 2024-09-19T09:03:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.141+0000 7faa24c8f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7faa2010a240 con 0x7faa20100840 2024-09-19T09:03:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.141+0000 7faa24c8f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7faa2010a540 con 0x7faa201023f0 2024-09-19T09:03:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.141+0000 7faa1ffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa201023f0 0x7faa201a5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.141+0000 7faa1ffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa201023f0 0x7faa201a5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:47050/0 (socket says 172.21.15.92:47050) 2024-09-19T09:03:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.141+0000 7faa1ffff640 1 -- 172.21.15.92:0/1981104577 learned_addr learned my addr 172.21.15.92:0/1981104577 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.142+0000 7faa1f7fe640 1 --2- 172.21.15.92:0/1981104577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa20100840 0x7faa2019e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.142+0000 7faa1effd640 1 --2- 172.21.15.92:0/1981104577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa20101a30 0x7faa2019e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.142+0000 7faa1ffff640 1 -- 172.21.15.92:0/1981104577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa20100840 msgr2=0x7faa2019e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.142+0000 7faa1ffff640 1 --2- 172.21.15.92:0/1981104577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa20100840 0x7faa2019e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.142+0000 7faa1ffff640 1 -- 172.21.15.92:0/1981104577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa20101a30 msgr2=0x7faa2019e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.142+0000 7faa1ffff640 1 --2- 172.21.15.92:0/1981104577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa20101a30 0x7faa2019e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.142+0000 7faa1ffff640 1 -- 172.21.15.92:0/1981104577 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa201a5e90 con 0x7faa201023f0 2024-09-19T09:03:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.142+0000 7faa1effd640 1 --2- 172.21.15.92:0/1981104577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa20101a30 0x7faa2019e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.142+0000 7faa1ffff640 1 --2- 172.21.15.92:0/1981104577 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa201023f0 0x7faa201a5820 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7faa18034040 tx=0x7faa180305b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.142+0000 7faa1cff9640 1 -- 172.21.15.92:0/1981104577 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa18041020 con 0x7faa201023f0 2024-09-19T09:03:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.142+0000 7faa1cff9640 1 -- 172.21.15.92:0/1981104577 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa18003e50 con 0x7faa201023f0 2024-09-19T09:03:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.142+0000 7faa1cff9640 1 -- 172.21.15.92:0/1981104577 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa18036040 con 0x7faa201023f0 2024-09-19T09:03:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.142+0000 7faa24c8f640 1 -- 172.21.15.92:0/1981104577 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa201a6120 con 0x7faa201023f0 2024-09-19T09:03:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.142+0000 7faa24c8f640 1 -- 172.21.15.92:0/1981104577 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa201a6660 con 0x7faa201023f0 2024-09-19T09:03:47.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.146+0000 7faa1cff9640 1 -- 172.21.15.92:0/1981104577 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7faa18044020 con 0x7faa201023f0 2024-09-19T09:03:47.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.146+0000 7faa28c91740 1 Processor -- start 2024-09-19T09:03:47.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.147+0000 7faa28c91740 1 -- start start 2024-09-19T09:03:47.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.147+0000 7faa28c91740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec2326fb70 0x55ec2326ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:47.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.147+0000 7faa28c91740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec232704b0 0x55ec23274f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:47.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.147+0000 7faa28c91740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec23275540 0x55ec23277a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:47.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.147+0000 7faa28c91740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ec231d32f0 con 0x55ec2326fb70 2024-09-19T09:03:47.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.147+0000 7faa28c91740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ec2317b270 con 0x55ec232704b0 2024-09-19T09:03:47.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.147+0000 7faa28c91740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ec231cf2b0 con 0x55ec23275540 2024-09-19T09:03:47.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.147+0000 7faa1cff9640 1 --2- 172.21.15.92:0/1981104577 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7faa080a3300 0x7faa080a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:47.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.147+0000 7faa1f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec232704b0 0x55ec23274f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:47.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.147+0000 7faa1cff9640 1 -- 172.21.15.92:0/1981104577 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7faa180f0680 con 0x7faa201023f0 2024-09-19T09:03:47.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.147+0000 7faa1f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec232704b0 0x55ec23274f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:51202/0 (socket says 172.21.15.92:51202) 2024-09-19T09:03:47.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.147+0000 7faa1f7fe640 1 -- 172.21.15.92:0/2983141929 learned_addr learned my addr 172.21.15.92:0/2983141929 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:47.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.147+0000 7faa1effd640 1 --2- 172.21.15.92:0/2983141929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec2326fb70 0x55ec2326ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:47.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.147+0000 7faa1effd640 1 --2- 172.21.15.92:0/2983141929 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec23275540 0x55ec23277a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:47.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.148+0000 7faa1f7fe640 1 -- 172.21.15.92:0/2983141929 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec23275540 msgr2=0x55ec23277a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:47.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.148+0000 7faa1f7fe640 1 --2- 172.21.15.92:0/2983141929 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec23275540 0x55ec23277a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.148+0000 7faa1f7fe640 1 -- 172.21.15.92:0/2983141929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec2326fb70 msgr2=0x55ec2326ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:47.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.148+0000 7faa1f7fe640 1 --2- 172.21.15.92:0/2983141929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec2326fb70 0x55ec2326ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.148+0000 7faa1f7fe640 1 -- 172.21.15.92:0/2983141929 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec2317a340 con 0x55ec232704b0 2024-09-19T09:03:47.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.148+0000 7faa1ffff640 1 --2- 172.21.15.92:0/1981104577 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7faa080a3300 0x7faa080a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:47.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.148+0000 7faa1f7fe640 1 --2- 172.21.15.92:0/2983141929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec232704b0 0x55ec23274f70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7faa10009ca0 tx=0x7faa10011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98b8eb5fc5e891f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:47.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.149+0000 7faa05ffb640 1 -- 172.21.15.92:0/2983141929 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa10009e50 con 0x55ec232704b0 2024-09-19T09:03:47.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.149+0000 7faa05ffb640 1 -- 172.21.15.92:0/2983141929 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa10005020 con 0x55ec232704b0 2024-09-19T09:03:47.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.149+0000 7faa05ffb640 1 -- 172.21.15.92:0/2983141929 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa10004b80 con 0x55ec232704b0 2024-09-19T09:03:47.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.150+0000 7faa1ffff640 1 --2- 172.21.15.92:0/1981104577 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7faa080a3300 0x7faa080a57c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7faa1802ac80 tx=0x7faa18009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:47.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.150+0000 7faa28c91740 1 -- 172.21.15.92:0/2983141929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec232704b0 msgr2=0x55ec23274f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:47.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.150+0000 7faa28c91740 1 --2- 172.21.15.92:0/2983141929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec232704b0 0x55ec23274f70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7faa10009ca0 tx=0x7faa10011810 comp rx=0 tx=0).stop 2024-09-19T09:03:47.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.151+0000 7faa28c91740 1 -- 172.21.15.92:0/2983141929 shutdown_connections 2024-09-19T09:03:47.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.151+0000 7faa28c91740 1 --2- 172.21.15.92:0/2983141929 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec23275540 0x55ec23277a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.151+0000 7faa28c91740 1 --2- 172.21.15.92:0/2983141929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec232704b0 0x55ec23274f70 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.151+0000 7faa28c91740 1 --2- 172.21.15.92:0/2983141929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec2326fb70 0x55ec2326ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.151+0000 7faa28c91740 1 -- 172.21.15.92:0/2983141929 >> 172.21.15.92:0/2983141929 conn(0x55ec2326b1e0 msgr2=0x55ec2326b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:47.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.152+0000 7faa28c91740 1 -- 172.21.15.92:0/2983141929 shutdown_connections 2024-09-19T09:03:47.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.152+0000 7faa28c91740 1 -- 172.21.15.92:0/2983141929 wait complete. 2024-09-19T09:03:47.153 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.153+0000 7faa28c91740 1 -- start start 2024-09-19T09:03:47.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.153+0000 7faa28c91740 1 Processor -- start 2024-09-19T09:03:47.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.153+0000 7faa28c91740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec2326fb70 0x55ec23279e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:47.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.153+0000 7faa28c91740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec232704b0 0x55ec2327a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:47.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.154+0000 7faa28c91740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec23275540 0x55ec232813d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:47.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.154+0000 7faa1effd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec2326fb70 0x55ec23279e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:47.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.154+0000 7faa1effd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec2326fb70 0x55ec23279e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:47060/0 (socket says 172.21.15.92:47060) 2024-09-19T09:03:47.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.154+0000 7faa1effd640 1 -- 172.21.15.92:0/1893921678 learned_addr learned my addr 172.21.15.92:0/1893921678 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:47.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.154+0000 7faa28c91740 1 -- 172.21.15.92:0/1893921678 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ec23278510 con 0x55ec232704b0 2024-09-19T09:03:47.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.154+0000 7faa28c91740 1 -- 172.21.15.92:0/1893921678 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ec2315c290 con 0x55ec23275540 2024-09-19T09:03:47.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.154+0000 7faa28c91740 1 -- 172.21.15.92:0/1893921678 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ec23278690 con 0x55ec2326fb70 2024-09-19T09:03:47.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.154+0000 7faa28c91740 10 client.0 _ll_register_callbacks cb 0x55ec2318d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:47.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.154+0000 7faa1f7fe640 1 --2- 172.21.15.92:0/1893921678 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec232704b0 0x55ec2327a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:47.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.154+0000 7faa1effd640 1 -- 172.21.15.92:0/1893921678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec23275540 msgr2=0x55ec232813d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:47.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.154+0000 7faa1effd640 1 --2- 172.21.15.92:0/1893921678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec23275540 0x55ec232813d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.154+0000 7faa1effd640 1 -- 172.21.15.92:0/1893921678 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec232704b0 msgr2=0x55ec2327a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:47.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.154+0000 7faa1effd640 1 --2- 172.21.15.92:0/1893921678 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec232704b0 0x55ec2327a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.154+0000 7faa1effd640 1 -- 172.21.15.92:0/1893921678 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec22ee6210 con 0x55ec2326fb70 2024-09-19T09:03:47.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.155+0000 7faa1effd640 1 --2- 172.21.15.92:0/1893921678 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec2326fb70 0x55ec23279e50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faa14005bc0 tx=0x7faa14014d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=882920e167b93ce5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:47.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.155+0000 7fa9feffd640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:03:47.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.155+0000 7fa9feffd640 1 -- 172.21.15.92:0/1893921678 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa14012da0 con 0x55ec2326fb70 2024-09-19T09:03:47.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.155+0000 7faa28c91740 1 -- 172.21.15.92:0/1893921678 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa10005020 con 0x55ec2326fb70 2024-09-19T09:03:47.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.155+0000 7fa9feffd640 1 -- 172.21.15.92:0/1893921678 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7faa14004030 con 0x55ec2326fb70 2024-09-19T09:03:47.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.155+0000 7fa9feffd640 1 -- 172.21.15.92:0/1893921678 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7faa14027050 con 0x55ec2326fb70 2024-09-19T09:03:47.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.156+0000 7faa28c91740 10 client.26278 fetch_fsmap learned FSMap version 19 2024-09-19T09:03:47.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.156+0000 7faa28c91740 1 -- 172.21.15.92:0/1893921678 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ec22fb2620 con 0x55ec2326fb70 2024-09-19T09:03:47.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.156+0000 7fa9feffd640 1 -- 172.21.15.92:0/1893921678 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa14004230 con 0x55ec2326fb70 2024-09-19T09:03:47.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.156+0000 7fa9feffd640 1 -- 172.21.15.92:0/1893921678 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7faa1401e070 con 0x55ec2326fb70 2024-09-19T09:03:47.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.156+0000 7faa28c91740 10 client.26278 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:03:47.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.156+0000 7faa28c91740 10 client.26278 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:03:47.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.156+0000 7faa28c91740 20 client.26278 populate_metadata read hostname 'smithi092' 2024-09-19T09:03:47.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.156+0000 7faa28c91740 1 --2- 172.21.15.92:0/1893921678 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ec23296f10 0x55ec23299370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:47.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.156+0000 7faa28c91740 4 client.26278 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:47.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.157+0000 7faa28c91740 1 -- 172.21.15.92:0/1893921678 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7faa10005020 con 0x55ec23296f10 2024-09-19T09:03:47.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.157+0000 7faa1f7fe640 1 --2- 172.21.15.92:0/1893921678 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ec23296f10 0x55ec23299370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:47.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.157+0000 7faa1f7fe640 1 --2- 172.21.15.92:0/1893921678 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ec23296f10 0x55ec23299370 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee49f7cd3b334ed1 server_cookie=a5e353fc47b2f231 in_seq=0 out_seq=0 2024-09-19T09:03:47.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.157+0000 7fa9feffd640 10 client.26278 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:47.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.158+0000 7fa9feffd640 1 -- 172.21.15.92:0/1893921678 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7faa10005020 con 0x55ec23296f10 2024-09-19T09:03:47.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.158+0000 7fa9feffd640 10 client.26278 handle_command_reply: tid=0 2024-09-19T09:03:47.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.158+0000 7faa28c91740 1 client.26278 shutdown 2024-09-19T09:03:47.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.158+0000 7faa28c91740 1 -- 172.21.15.92:0/1893921678 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec2326fb70 msgr2=0x55ec23279e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:47.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.158+0000 7faa28c91740 1 --2- 172.21.15.92:0/1893921678 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec2326fb70 0x55ec23279e50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faa14005bc0 tx=0x7faa14014d90 comp rx=0 tx=0).stop 2024-09-19T09:03:47.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.158+0000 7faa28c91740 1 -- 172.21.15.92:0/1893921678 shutdown_connections 2024-09-19T09:03:47.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.158+0000 7faa28c91740 1 --2- 172.21.15.92:0/1893921678 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ec23296f10 0x55ec23299370 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.159+0000 7faa28c91740 1 --2- 172.21.15.92:0/1893921678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec23275540 0x55ec232813d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.159+0000 7faa28c91740 1 --2- 172.21.15.92:0/1893921678 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec232704b0 0x55ec2327a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.159+0000 7faa28c91740 1 --2- 172.21.15.92:0/1893921678 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec2326fb70 0x55ec23279e50 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.159+0000 7faa28c91740 1 -- 172.21.15.92:0/1893921678 >> 172.21.15.92:0/1893921678 conn(0x55ec2326b1e0 msgr2=0x55ec2326c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:47.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.159+0000 7fa9feffd640 0 client.26278 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:47.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.160+0000 7faa28c91740 1 -- 172.21.15.92:0/1893921678 shutdown_connections 2024-09-19T09:03:47.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.160+0000 7faa28c91740 1 -- 172.21.15.92:0/1893921678 wait complete. 2024-09-19T09:03:47.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.161+0000 7faa28c91740 20 client.26278 trim_cache size 0 max 16384 2024-09-19T09:03:47.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.190+0000 7faa28c91740 1 Processor -- start 2024-09-19T09:03:47.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.194+0000 7faa28c91740 1 -- start start 2024-09-19T09:03:47.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.194+0000 7faa28c91740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec2326fb70 0x55ec23269a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:47.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.194+0000 7faa28c91740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec232704b0 0x55ec23281390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:47.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.194+0000 7faa28c91740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec23275540 0x55ec23269fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:47.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.194+0000 7faa28c91740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7faa20117700 con 0x55ec23275540 2024-09-19T09:03:47.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.194+0000 7faa28c91740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7faa201a7540 con 0x55ec2326fb70 2024-09-19T09:03:47.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.194+0000 7faa1effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec2326fb70 0x55ec23269a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:47.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.194+0000 7faa1effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec2326fb70 0x55ec23269a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:51230/0 (socket says 172.21.15.92:51230) 2024-09-19T09:03:47.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.194+0000 7faa1effd640 1 -- 172.21.15.92:0/2493861497 learned_addr learned my addr 172.21.15.92:0/2493861497 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:47.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.194+0000 7faa1f7fe640 1 --2- 172.21.15.92:0/2493861497 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec232704b0 0x55ec23281390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:47.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.194+0000 7faa28c91740 1 -- 172.21.15.92:0/2493861497 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7faa20117d90 con 0x55ec232704b0 2024-09-19T09:03:47.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.195+0000 7faa1effd640 1 --2- 172.21.15.92:0/2493861497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec23275540 0x55ec23269fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:47.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.195+0000 7faa1f7fe640 1 -- 172.21.15.92:0/2493861497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec2326fb70 msgr2=0x55ec23269a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:47.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.195+0000 7faa1f7fe640 1 --2- 172.21.15.92:0/2493861497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec2326fb70 0x55ec23269a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.195+0000 7faa1f7fe640 1 -- 172.21.15.92:0/2493861497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec23275540 msgr2=0x55ec23269fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:47.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.195+0000 7faa1f7fe640 1 --2- 172.21.15.92:0/2493861497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec23275540 0x55ec23269fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.195+0000 7faa1f7fe640 1 -- 172.21.15.92:0/2493861497 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec2326b000 con 0x55ec232704b0 2024-09-19T09:03:47.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.195+0000 7faa1f7fe640 1 --2- 172.21.15.92:0/2493861497 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec232704b0 0x55ec23281390 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7faa10006010 tx=0x7faa10009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf2adec652675ddf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:47.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.198+0000 7faa057fa640 1 -- 172.21.15.92:0/2493861497 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa10004210 con 0x55ec232704b0 2024-09-19T09:03:47.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.198+0000 7faa057fa640 1 -- 172.21.15.92:0/2493861497 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa10005520 con 0x55ec232704b0 2024-09-19T09:03:47.200 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.199+0000 7faa28c91740 1 -- 172.21.15.92:0/2493861497 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec232704b0 msgr2=0x55ec23281390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:47.200 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.199+0000 7faa28c91740 1 --2- 172.21.15.92:0/2493861497 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec232704b0 0x55ec23281390 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7faa10006010 tx=0x7faa10009260 comp rx=0 tx=0).stop 2024-09-19T09:03:47.200 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.199+0000 7faa28c91740 1 -- 172.21.15.92:0/2493861497 shutdown_connections 2024-09-19T09:03:47.200 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.199+0000 7faa28c91740 1 --2- 172.21.15.92:0/2493861497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec23275540 0x55ec23269fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.200+0000 7faa28c91740 1 --2- 172.21.15.92:0/2493861497 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec232704b0 0x55ec23281390 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.200+0000 7faa28c91740 1 --2- 172.21.15.92:0/2493861497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec2326fb70 0x55ec23269a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.200+0000 7faa28c91740 1 -- 172.21.15.92:0/2493861497 >> 172.21.15.92:0/2493861497 conn(0x55ec2326b1e0 msgr2=0x55ec23271730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:47.204 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.204+0000 7faa28c91740 1 -- 172.21.15.92:0/2493861497 shutdown_connections 2024-09-19T09:03:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.206+0000 7faa28c91740 1 -- 172.21.15.92:0/2493861497 wait complete. 2024-09-19T09:03:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.206+0000 7faa28c91740 1 -- start start 2024-09-19T09:03:47.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.207+0000 7faa28c91740 1 Processor -- start 2024-09-19T09:03:47.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.207+0000 7faa28c91740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec2326fb70 0x55ec23281240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:47.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.207+0000 7faa28c91740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec232704b0 0x55ec2327dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:47.208 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.207+0000 7faa28c91740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec23275540 0x55ec2327e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:47.208 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.208+0000 7faa28c91740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7faa20118460 con 0x55ec2326fb70 2024-09-19T09:03:47.208 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.208+0000 7faa1f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec232704b0 0x55ec2327dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:47.208 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.208+0000 7faa1f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec232704b0 0x55ec2327dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:51240/0 (socket says 172.21.15.92:51240) 2024-09-19T09:03:47.208 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.208+0000 7faa1f7fe640 1 -- 172.21.15.92:0/847009788 learned_addr learned my addr 172.21.15.92:0/847009788 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:47.209 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.208+0000 7faa28c91740 1 -- 172.21.15.92:0/847009788 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7faa201a6e70 con 0x55ec232704b0 2024-09-19T09:03:47.209 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.208+0000 7faa28c91740 1 -- 172.21.15.92:0/847009788 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7faa20118b30 con 0x55ec23275540 2024-09-19T09:03:47.209 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.208+0000 7faa28c91740 10 client.0 _ll_register_callbacks cb 0x7faa1400ce10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:47.209 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.209+0000 7faa1f7fe640 1 -- 172.21.15.92:0/847009788 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec23275540 msgr2=0x55ec2327e220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:03:47.209 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.209+0000 7faa1f7fe640 1 --2- 172.21.15.92:0/847009788 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec23275540 0x55ec2327e220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.209 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.209+0000 7faa1f7fe640 1 -- 172.21.15.92:0/847009788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec2326fb70 msgr2=0x55ec23281240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:03:47.209 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.209+0000 7faa1f7fe640 1 --2- 172.21.15.92:0/847009788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec2326fb70 0x55ec23281240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.210 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.209+0000 7faa1f7fe640 1 -- 172.21.15.92:0/847009788 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec23285930 con 0x55ec232704b0 2024-09-19T09:03:47.213 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.213+0000 7faa1f7fe640 1 --2- 172.21.15.92:0/847009788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec232704b0 0x55ec2327dce0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7faa10005780 tx=0x7faa10005970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2a0d99bd1dc2d74 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:47.213 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.213+0000 7fa9feffd640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:03:47.214 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.213+0000 7fa9feffd640 1 -- 172.21.15.92:0/847009788 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1005b060 con 0x55ec232704b0 2024-09-19T09:03:47.214 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.214+0000 7faa28c91740 1 -- 172.21.15.92:0/847009788 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa10005520 con 0x55ec232704b0 2024-09-19T09:03:47.214 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.214+0000 7fa9feffd640 1 -- 172.21.15.92:0/847009788 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7faa10005300 con 0x55ec232704b0 2024-09-19T09:03:47.214 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.214+0000 7fa9feffd640 1 -- 172.21.15.92:0/847009788 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7faa10052040 con 0x55ec232704b0 2024-09-19T09:03:47.214 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.214+0000 7faa28c91740 10 client.26381 fetch_fsmap learned FSMap version 19 2024-09-19T09:03:47.214 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.214+0000 7faa28c91740 1 -- 172.21.15.92:0/847009788 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ec23286c20 con 0x55ec232704b0 2024-09-19T09:03:47.215 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.215+0000 7fa9feffd640 1 -- 172.21.15.92:0/847009788 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa10005520 con 0x55ec232704b0 2024-09-19T09:03:47.215 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.215+0000 7fa9feffd640 1 -- 172.21.15.92:0/847009788 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7faa10060070 con 0x55ec232704b0 2024-09-19T09:03:47.215 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.215+0000 7faa28c91740 10 client.26381 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:03:47.215 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.215+0000 7faa28c91740 10 client.26381 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:03:47.216 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.215+0000 7faa28c91740 20 client.26381 populate_metadata read hostname 'smithi092' 2024-09-19T09:03:47.216 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.215+0000 7faa28c91740 1 --2- 172.21.15.92:0/847009788 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ec23287510 0x55ec23289930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:47.216 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.215+0000 7faa28c91740 4 client.26381 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:03:47.216 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.215+0000 7faa28c91740 1 -- 172.21.15.92:0/847009788 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ec231e0a20 con 0x55ec23287510 2024-09-19T09:03:47.217 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.216+0000 7faa1effd640 1 --2- 172.21.15.92:0/847009788 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ec23287510 0x55ec23289930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:47.217 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.216+0000 7fa9feffd640 10 client.26381 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:47.217 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.216+0000 7faa1effd640 1 --2- 172.21.15.92:0/847009788 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ec23287510 0x55ec23289930 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9902f5003e3c7c24 server_cookie=6adddb76eb710b43 in_seq=0 out_seq=0 2024-09-19T09:03:47.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.231+0000 7fa777c5f640 1 -- 172.21.15.92:0/2566393470 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa770109120 msgr2=0x7fa770110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:47.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.231+0000 7fa777c5f640 1 --2- 172.21.15.92:0/2566393470 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa770109120 0x7fa770110ca0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa768009ca0 tx=0x7fa76802a8d0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.231+0000 7fa777c5f640 1 -- 172.21.15.92:0/2566393470 shutdown_connections 2024-09-19T09:03:47.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.231+0000 7fa777c5f640 1 --2- 172.21.15.92:0/2566393470 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa770109120 0x7fa770110ca0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.231+0000 7fa777c5f640 1 --2- 172.21.15.92:0/2566393470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7701049a0 0x7fa7701089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.231+0000 7fa777c5f640 1 --2- 172.21.15.92:0/2566393470 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa770103ff0 0x7fa7701043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.231+0000 7fa777c5f640 1 -- 172.21.15.92:0/2566393470 >> 172.21.15.92:0/2566393470 conn(0x7fa7700ffa70 msgr2=0x7fa770101e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:47.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.232+0000 7fa777c5f640 1 -- 172.21.15.92:0/2566393470 shutdown_connections 2024-09-19T09:03:47.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.232+0000 7fa777c5f640 1 -- 172.21.15.92:0/2566393470 wait complete. 2024-09-19T09:03:47.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.233+0000 7fa777c5f640 1 Processor -- start 2024-09-19T09:03:47.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.233+0000 7fa777c5f640 1 -- start start 2024-09-19T09:03:47.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.233+0000 7fa777c5f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa770103ff0 0x7fa77019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:47.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.233+0000 7fa777c5f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7701049a0 0x7fa77019aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:47.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.234+0000 7fa777c5f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa770109120 0x7fa77019ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:47.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.234+0000 7fa777c5f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa7701141a0 con 0x7fa770103ff0 2024-09-19T09:03:47.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.234+0000 7fa777c5f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa770114020 con 0x7fa7701049a0 2024-09-19T09:03:47.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.234+0000 7fa777c5f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa770114320 con 0x7fa770109120 2024-09-19T09:03:47.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.234+0000 7fa7759fb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa770103ff0 0x7fa77019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:47.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.234+0000 7fa7759fb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa770103ff0 0x7fa77019a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35626/0 (socket says 172.21.15.92:35626) 2024-09-19T09:03:47.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.234+0000 7fa7759fb640 1 -- 172.21.15.92:0/1099003478 learned_addr learned my addr 172.21.15.92:0/1099003478 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:47.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.234+0000 7fa7761fc640 1 --2- 172.21.15.92:0/1099003478 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa770109120 0x7fa77019ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:47.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.234+0000 7fa7751fa640 1 --2- 172.21.15.92:0/1099003478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7701049a0 0x7fa77019aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:47.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.234+0000 7fa7759fb640 1 -- 172.21.15.92:0/1099003478 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa770109120 msgr2=0x7fa77019ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:47.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.234+0000 7fa7759fb640 1 --2- 172.21.15.92:0/1099003478 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa770109120 0x7fa77019ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.234+0000 7fa7759fb640 1 -- 172.21.15.92:0/1099003478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7701049a0 msgr2=0x7fa77019aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:47.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.234+0000 7fa7759fb640 1 --2- 172.21.15.92:0/1099003478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7701049a0 0x7fa77019aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.234+0000 7fa7759fb640 1 -- 172.21.15.92:0/1099003478 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa77019f610 con 0x7fa770103ff0 2024-09-19T09:03:47.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.234+0000 7fa7751fa640 1 --2- 172.21.15.92:0/1099003478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7701049a0 0x7fa77019aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:47.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.234+0000 7fa7761fc640 1 --2- 172.21.15.92:0/1099003478 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa770109120 0x7fa77019ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:47.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.235+0000 7fa7759fb640 1 --2- 172.21.15.92:0/1099003478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa770103ff0 0x7fa77019a660 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fa76c00b4a0 tx=0x7fa76c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:47.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.235+0000 7fa766ffd640 1 -- 172.21.15.92:0/1099003478 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76c014070 con 0x7fa770103ff0 2024-09-19T09:03:47.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.235+0000 7fa777c5f640 1 -- 172.21.15.92:0/1099003478 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa77019f900 con 0x7fa770103ff0 2024-09-19T09:03:47.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.235+0000 7fa777c5f640 1 -- 172.21.15.92:0/1099003478 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7701a71e0 con 0x7fa770103ff0 2024-09-19T09:03:47.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.236+0000 7fa766ffd640 1 -- 172.21.15.92:0/1099003478 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa76c010af0 con 0x7fa770103ff0 2024-09-19T09:03:47.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.236+0000 7fa766ffd640 1 -- 172.21.15.92:0/1099003478 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76c017c40 con 0x7fa770103ff0 2024-09-19T09:03:47.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.237+0000 7fa777c5f640 1 -- 172.21.15.92:0/1099003478 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa754005290 con 0x7fa770103ff0 2024-09-19T09:03:47.240 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.238+0000 7fa9feffd640 1 -- 172.21.15.92:0/847009788 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ec231e0a20 con 0x55ec23287510 2024-09-19T09:03:47.240 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.238+0000 7fa9feffd640 10 client.26381 handle_command_reply: tid=0 2024-09-19T09:03:47.240 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.238+0000 7faa28c91740 1 client.26381 shutdown 2024-09-19T09:03:47.240 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.238+0000 7faa28c91740 1 -- 172.21.15.92:0/847009788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec232704b0 msgr2=0x55ec2327dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:47.240 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.238+0000 7faa28c91740 1 --2- 172.21.15.92:0/847009788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec232704b0 0x55ec2327dce0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7faa10005780 tx=0x7faa10005970 comp rx=0 tx=0).stop 2024-09-19T09:03:47.240 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.239+0000 7faa28c91740 1 -- 172.21.15.92:0/847009788 shutdown_connections 2024-09-19T09:03:47.240 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.239+0000 7faa28c91740 1 --2- 172.21.15.92:0/847009788 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ec23287510 0x55ec23289930 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.239+0000 7faa28c91740 1 --2- 172.21.15.92:0/847009788 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec23275540 0x55ec2327e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.239+0000 7faa28c91740 1 --2- 172.21.15.92:0/847009788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec232704b0 0x55ec2327dce0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.239+0000 7fa9feffd640 0 client.26381 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.239+0000 7faa28c91740 1 --2- 172.21.15.92:0/847009788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec2326fb70 0x55ec23281240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.239+0000 7faa28c91740 1 -- 172.21.15.92:0/847009788 >> 172.21.15.92:0/847009788 conn(0x55ec2326b1e0 msgr2=0x55ec23269a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.239+0000 7faa28c91740 1 -- 172.21.15.92:0/847009788 shutdown_connections 2024-09-19T09:03:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.240+0000 7faa28c91740 1 -- 172.21.15.92:0/847009788 wait complete. 2024-09-19T09:03:47.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.240+0000 7fa766ffd640 1 -- 172.21.15.92:0/1099003478 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa76c017070 con 0x7fa770103ff0 2024-09-19T09:03:47.243 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.240+0000 7faa28c91740 20 client.26381 trim_cache size 0 max 16384 2024-09-19T09:03:47.243 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:03:47.243 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:03:47.243 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:03:47.244 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:03:47.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.240+0000 7fa766ffd640 1 --2- 172.21.15.92:0/1099003478 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa75c0a3380 0x7fa75c0a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:47.244 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.241+0000 7faa24c8f640 1 -- 172.21.15.92:0/1981104577 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7faa080a3300 msgr2=0x7faa080a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:47.244 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.241+0000 7faa24c8f640 1 --2- 172.21.15.92:0/1981104577 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7faa080a3300 0x7faa080a57c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7faa1802ac80 tx=0x7faa18009500 comp rx=0 tx=0).stop 2024-09-19T09:03:47.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.241+0000 7fa766ffd640 1 -- 172.21.15.92:0/1099003478 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa76c0ceef0 con 0x7fa770103ff0 2024-09-19T09:03:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.241+0000 7faa24c8f640 1 -- 172.21.15.92:0/1981104577 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa201023f0 msgr2=0x7faa201a5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.241+0000 7faa24c8f640 1 --2- 172.21.15.92:0/1981104577 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa201023f0 0x7faa201a5820 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7faa18034040 tx=0x7faa180305b0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.241+0000 7fa7751fa640 1 --2- 172.21.15.92:0/1099003478 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa75c0a3380 0x7fa75c0a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.241+0000 7faa24c8f640 1 -- 172.21.15.92:0/1981104577 shutdown_connections 2024-09-19T09:03:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.241+0000 7faa24c8f640 1 --2- 172.21.15.92:0/1981104577 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa201023f0 0x7faa201a5820 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.241+0000 7faa24c8f640 1 --2- 172.21.15.92:0/1981104577 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7faa080a3300 0x7faa080a57c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.241+0000 7faa24c8f640 1 --2- 172.21.15.92:0/1981104577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa20101a30 0x7faa2019e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.241+0000 7faa24c8f640 1 --2- 172.21.15.92:0/1981104577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa20100840 0x7faa2019e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.241+0000 7faa24c8f640 1 -- 172.21.15.92:0/1981104577 >> 172.21.15.92:0/1981104577 conn(0x7faa200fbfa0 msgr2=0x7faa200fd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.241+0000 7faa24c8f640 1 -- 172.21.15.92:0/1981104577 shutdown_connections 2024-09-19T09:03:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:03:47.241+0000 7faa24c8f640 1 -- 172.21.15.92:0/1981104577 wait complete. 2024-09-19T09:03:47.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.241+0000 7fa7751fa640 1 --2- 172.21.15.92:0/1099003478 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa75c0a3380 0x7fa75c0a5840 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa77010a5f0 tx=0x7fa760005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:47.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.247+0000 7fa766ffd640 1 -- 172.21.15.92:0/1099003478 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa76c09b580 con 0x7fa770103ff0 2024-09-19T09:03:47.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.584+0000 7fa777c5f640 1 -- 172.21.15.92:0/1099003478 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa754005580 con 0x7fa770103ff0 2024-09-19T09:03:47.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.585+0000 7fa766ffd640 1 -- 172.21.15.92:0/1099003478 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7fa76c09f880 con 0x7fa770103ff0 2024-09-19T09:03:47.586 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:03:47.586 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:03:47.586 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:03:47.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.588+0000 7fa777c5f640 1 -- 172.21.15.92:0/1099003478 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa75c0a3380 msgr2=0x7fa75c0a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:47.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.588+0000 7fa777c5f640 1 --2- 172.21.15.92:0/1099003478 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa75c0a3380 0x7fa75c0a5840 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa77010a5f0 tx=0x7fa760005f90 comp rx=0 tx=0).stop 2024-09-19T09:03:47.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.588+0000 7fa777c5f640 1 -- 172.21.15.92:0/1099003478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa770103ff0 msgr2=0x7fa77019a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:47.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.588+0000 7fa777c5f640 1 --2- 172.21.15.92:0/1099003478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa770103ff0 0x7fa77019a660 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fa76c00b4a0 tx=0x7fa76c00b960 comp rx=0 tx=0).stop 2024-09-19T09:03:47.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.588+0000 7fa777c5f640 1 -- 172.21.15.92:0/1099003478 shutdown_connections 2024-09-19T09:03:47.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.588+0000 7fa777c5f640 1 --2- 172.21.15.92:0/1099003478 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa770109120 0x7fa77019ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.588+0000 7fa777c5f640 1 --2- 172.21.15.92:0/1099003478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7701049a0 0x7fa77019aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.588+0000 7fa777c5f640 1 --2- 172.21.15.92:0/1099003478 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa75c0a3380 0x7fa75c0a5840 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.588+0000 7fa777c5f640 1 --2- 172.21.15.92:0/1099003478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa770103ff0 0x7fa77019a660 secure :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fa76c00b4a0 tx=0x7fa76c00b960 comp rx=0 tx=0).stop 2024-09-19T09:03:47.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.588+0000 7fa777c5f640 1 -- 172.21.15.92:0/1099003478 >> 172.21.15.92:0/1099003478 conn(0x7fa7700ffa70 msgr2=0x7fa770100d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:47.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.589+0000 7fa777c5f640 1 -- 172.21.15.92:0/1099003478 shutdown_connections 2024-09-19T09:03:47.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:47.589+0000 7fa777c5f640 1 -- 172.21.15.92:0/1099003478 wait complete. 2024-09-19T09:03:47.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:47 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:47.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:47 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:47.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:47 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:47.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:47 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:47.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:47 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:47.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:47 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:47.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:47 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:47.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:47 smithi167 ceph-mon[35359]: Adjusting osd_memory_target on smithi190 to 176.0M 2024-09-19T09:03:47.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:47 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:47.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:47 smithi167 ceph-mon[35359]: Adjusting osd_memory_target on smithi167 to 176.0M 2024-09-19T09:03:47.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:47 smithi167 ceph-mon[35359]: Unable to set osd_memory_target on smithi190 to 184596787: error parsing value: Value '184596787' is below minimum 939524096 2024-09-19T09:03:47.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:47 smithi167 ceph-mon[35359]: Unable to set osd_memory_target on smithi167 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-19T09:03:47.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:47 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:47.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:47 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:47.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:47 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:47.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:47 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:47.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:47 smithi167 ceph-mon[35359]: Adjusting osd_memory_target on smithi092 to 176.0M 2024-09-19T09:03:47.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:47 smithi167 ceph-mon[35359]: Unable to set osd_memory_target on smithi092 to 184576716: error parsing value: Value '184576716' is below minimum 939524096 2024-09-19T09:03:47.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:47 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:03:47.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:47 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:03:47.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:47 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:03:47.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:47 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:47.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:47 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:47.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:47 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:47.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:47 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:47.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:47 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:47.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:47 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:47.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:47 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:47.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:47 smithi190 ceph-mon[35358]: Adjusting osd_memory_target on smithi190 to 176.0M 2024-09-19T09:03:47.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:47 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:47.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:47 smithi190 ceph-mon[35358]: Adjusting osd_memory_target on smithi167 to 176.0M 2024-09-19T09:03:47.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:47 smithi190 ceph-mon[35358]: Unable to set osd_memory_target on smithi190 to 184596787: error parsing value: Value '184596787' is below minimum 939524096 2024-09-19T09:03:47.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:47 smithi190 ceph-mon[35358]: Unable to set osd_memory_target on smithi167 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-19T09:03:47.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:47 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:47.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:47 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:47.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:47 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:47.876 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:47 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:47.876 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:47 smithi190 ceph-mon[35358]: Adjusting osd_memory_target on smithi092 to 176.0M 2024-09-19T09:03:47.876 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:47 smithi190 ceph-mon[35358]: Unable to set osd_memory_target on smithi092 to 184576716: error parsing value: Value '184576716' is below minimum 939524096 2024-09-19T09:03:47.876 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:47 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:03:47.876 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:47 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:03:47.876 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:47 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:03:47.945 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:47 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:47.945 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:47 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:47.945 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:47 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:47.945 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:47 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:47.945 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:47 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:47.946 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:47 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:47.946 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:47 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:47.946 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:47 smithi092 ceph-mon[31407]: Adjusting osd_memory_target on smithi190 to 176.0M 2024-09-19T09:03:47.946 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:47 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:47.946 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:47 smithi092 ceph-mon[31407]: Adjusting osd_memory_target on smithi167 to 176.0M 2024-09-19T09:03:47.946 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:47 smithi092 ceph-mon[31407]: Unable to set osd_memory_target on smithi190 to 184596787: error parsing value: Value '184596787' is below minimum 939524096 2024-09-19T09:03:47.946 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:47 smithi092 ceph-mon[31407]: Unable to set osd_memory_target on smithi167 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-19T09:03:47.946 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:47 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:47.946 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:47 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:47.946 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:47 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:47.946 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:47 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:03:47.946 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:47 smithi092 ceph-mon[31407]: Adjusting osd_memory_target on smithi092 to 176.0M 2024-09-19T09:03:47.946 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:47 smithi092 ceph-mon[31407]: Unable to set osd_memory_target on smithi092 to 184576716: error parsing value: Value '184576716' is below minimum 939524096 2024-09-19T09:03:47.946 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:47 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:03:47.947 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:47 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:03:47.947 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:47 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:03:48.300 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 145.75 --await-for 45.0' 2024-09-19T09:03:48.300 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 145.75 --await-for 45.0 2024-09-19T09:03:48.740 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:48.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:48 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/1099003478' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:48.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:48 smithi167 ceph-mon[35359]: pgmap v550: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 12 MiB/s wr, 445 op/s 2024-09-19T09:03:48.869 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:48 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1099003478' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:48.869 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:48 smithi092 ceph-mon[31407]: pgmap v550: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 12 MiB/s wr, 445 op/s 2024-09-19T09:03:48.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:48 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/1099003478' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:48.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:48 smithi190 ceph-mon[35358]: pgmap v550: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 12 MiB/s wr, 445 op/s 2024-09-19T09:03:49.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.457+0000 7f3dd8d1e640 1 -- 172.21.15.92:0/140635371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3dd4101dd0 msgr2=0x7f3dd41021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:49.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.458+0000 7f3dd8d1e640 1 --2- 172.21.15.92:0/140635371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3dd4101dd0 0x7f3dd41021b0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4009900 tx=0x7f3dc402a410 comp rx=0 tx=0).stop 2024-09-19T09:03:49.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.458+0000 7f3dd8d1e640 1 -- 172.21.15.92:0/140635371 shutdown_connections 2024-09-19T09:03:49.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.458+0000 7f3dd8d1e640 1 --2- 172.21.15.92:0/140635371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3dd4106f00 0x7f3dd410ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.458+0000 7f3dd8d1e640 1 --2- 172.21.15.92:0/140635371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dd4102780 0x7f3dd41067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.458+0000 7f3dd8d1e640 1 --2- 172.21.15.92:0/140635371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3dd4101dd0 0x7f3dd41021b0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.458+0000 7f3dd8d1e640 1 -- 172.21.15.92:0/140635371 >> 172.21.15.92:0/140635371 conn(0x7f3dd40fd8b0 msgr2=0x7f3dd40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:49.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.458+0000 7f3dd8d1e640 1 -- 172.21.15.92:0/140635371 shutdown_connections 2024-09-19T09:03:49.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.458+0000 7f3dd8d1e640 1 -- 172.21.15.92:0/140635371 wait complete. 2024-09-19T09:03:49.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.459+0000 7f3dd8d1e640 1 Processor -- start 2024-09-19T09:03:49.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.459+0000 7f3dd8d1e640 1 -- start start 2024-09-19T09:03:49.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.460+0000 7f3dd8d1e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3dd4101dd0 0x7f3dd41983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.460+0000 7f3dd8d1e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dd4102780 0x7f3dd4198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.460+0000 7f3dd8d1e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3dd4106f00 0x7f3dd419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.460+0000 7f3dd8d1e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd4111fb0 con 0x7f3dd4101dd0 2024-09-19T09:03:49.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.460+0000 7f3dd8d1e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd4111e30 con 0x7f3dd4102780 2024-09-19T09:03:49.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.460+0000 7f3dd1d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dd4102780 0x7f3dd4198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:49.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.460+0000 7f3dd1d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dd4102780 0x7f3dd4198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:51274/0 (socket says 172.21.15.92:51274) 2024-09-19T09:03:49.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.460+0000 7f3dd1d9b640 1 -- 172.21.15.92:0/2781421612 learned_addr learned my addr 172.21.15.92:0/2781421612 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:49.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.460+0000 7f3dd8d1e640 1 -- 172.21.15.92:0/2781421612 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd4112130 con 0x7f3dd4106f00 2024-09-19T09:03:49.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.460+0000 7f3dd259c640 1 --2- 172.21.15.92:0/2781421612 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3dd4101dd0 0x7f3dd41983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:49.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.460+0000 7f3dd2d9d640 1 --2- 172.21.15.92:0/2781421612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3dd4106f00 0x7f3dd419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:49.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.461+0000 7f3dd2d9d640 1 -- 172.21.15.92:0/2781421612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dd4102780 msgr2=0x7f3dd4198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:49.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.461+0000 7f3dd2d9d640 1 --2- 172.21.15.92:0/2781421612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dd4102780 0x7f3dd4198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.461+0000 7f3dd2d9d640 1 -- 172.21.15.92:0/2781421612 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3dd4101dd0 msgr2=0x7f3dd41983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:49.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.461+0000 7f3dd2d9d640 1 --2- 172.21.15.92:0/2781421612 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3dd4101dd0 0x7f3dd41983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.461+0000 7f3dd2d9d640 1 -- 172.21.15.92:0/2781421612 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd419d3a0 con 0x7f3dd4106f00 2024-09-19T09:03:49.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.461+0000 7f3dd2d9d640 1 --2- 172.21.15.92:0/2781421612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3dd4106f00 0x7f3dd419ccc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc009fd0 tx=0x7f3dcc00ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:49.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.461+0000 7f3dd259c640 1 --2- 172.21.15.92:0/2781421612 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3dd4101dd0 0x7f3dd41983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:49.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.462+0000 7f3dc37fe640 1 -- 172.21.15.92:0/2781421612 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc00ce20 con 0x7f3dd4106f00 2024-09-19T09:03:49.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.462+0000 7f3dc37fe640 1 -- 172.21.15.92:0/2781421612 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dcc005020 con 0x7f3dd4106f00 2024-09-19T09:03:49.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.462+0000 7f3dc37fe640 1 -- 172.21.15.92:0/2781421612 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc010720 con 0x7f3dd4106f00 2024-09-19T09:03:49.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.462+0000 7f3dd8d1e640 1 -- 172.21.15.92:0/2781421612 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dd419d690 con 0x7f3dd4106f00 2024-09-19T09:03:49.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.462+0000 7f3dd8d1e640 1 -- 172.21.15.92:0/2781421612 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dd4074420 con 0x7f3dd4106f00 2024-09-19T09:03:49.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.467+0000 7f3dc37fe640 1 -- 172.21.15.92:0/2781421612 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3dcc0051d0 con 0x7f3dd4106f00 2024-09-19T09:03:49.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.467+0000 7f3ddb0f7740 1 Processor -- start 2024-09-19T09:03:49.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.468+0000 7f3ddb0f7740 1 -- start start 2024-09-19T09:03:49.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.468+0000 7f3ddb0f7740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c04e3de850 0x55c04e3dec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.468+0000 7f3ddb0f7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c04e3df170 0x55c04e3e94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.468+0000 7f3ddb0f7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c04e3e9a30 0x55c04e3ebe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.468+0000 7f3ddb0f7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c04e343160 con 0x55c04e3e9a30 2024-09-19T09:03:49.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.468+0000 7f3ddb0f7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55c04e2ea720 con 0x55c04e3df170 2024-09-19T09:03:49.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.468+0000 7f3ddb0f7740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55c04e33f120 con 0x55c04e3de850 2024-09-19T09:03:49.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.468+0000 7f3dd1d9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c04e3de850 0x55c04e3dec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:49.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.468+0000 7f3dd1d9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c04e3de850 0x55c04e3dec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:47118/0 (socket says 172.21.15.92:47118) 2024-09-19T09:03:49.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.468+0000 7f3dd1d9b640 1 -- 172.21.15.92:0/3050167171 learned_addr learned my addr 172.21.15.92:0/3050167171 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:49.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.468+0000 7f3dd259c640 1 --2- 172.21.15.92:0/3050167171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c04e3df170 0x55c04e3e94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:49.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.469+0000 7f3dd1d9b640 1 --2- 172.21.15.92:0/3050167171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c04e3e9a30 0x55c04e3ebe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:49.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.469+0000 7f3dd1d9b640 1 -- 172.21.15.92:0/3050167171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c04e3df170 msgr2=0x55c04e3e94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:49.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.469+0000 7f3dd1d9b640 1 --2- 172.21.15.92:0/3050167171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c04e3df170 0x55c04e3e94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.469+0000 7f3dd1d9b640 1 -- 172.21.15.92:0/3050167171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c04e3e9a30 msgr2=0x55c04e3ebe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:49.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.469+0000 7f3dd1d9b640 1 --2- 172.21.15.92:0/3050167171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c04e3e9a30 0x55c04e3ebe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.469+0000 7f3dd1d9b640 1 -- 172.21.15.92:0/3050167171 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c04e0b4ba0 con 0x55c04e3de850 2024-09-19T09:03:49.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.469+0000 7f3dd1d9b640 1 --2- 172.21.15.92:0/3050167171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c04e3de850 0x55c04e3dec30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8004650 tx=0x7f3dc80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d01dfb6a80559240 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:49.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.470+0000 7f3dc37fe640 1 --2- 172.21.15.92:0/2781421612 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3dbc0a77e0 0x7f3dbc0a9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.470+0000 7f3dc0ff9640 1 -- 172.21.15.92:0/3050167171 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8005020 con 0x55c04e3de850 2024-09-19T09:03:49.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.470+0000 7f3dc0ff9640 1 -- 172.21.15.92:0/3050167171 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dc80047a0 con 0x55c04e3de850 2024-09-19T09:03:49.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.470+0000 7f3dc0ff9640 1 -- 172.21.15.92:0/3050167171 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc801e760 con 0x55c04e3de850 2024-09-19T09:03:49.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.470+0000 7f3dd259c640 1 --2- 172.21.15.92:0/2781421612 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3dbc0a77e0 0x7f3dbc0a9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:49.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.471+0000 7f3dc37fe640 1 -- 172.21.15.92:0/2781421612 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3dcc0cfeb0 con 0x7f3dd4106f00 2024-09-19T09:03:49.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.471+0000 7f3ddb0f7740 1 -- 172.21.15.92:0/3050167171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c04e3de850 msgr2=0x55c04e3dec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:49.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.471+0000 7f3ddb0f7740 1 --2- 172.21.15.92:0/3050167171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c04e3de850 0x55c04e3dec30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8004650 tx=0x7f3dc80046c0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.471+0000 7f3dd259c640 1 --2- 172.21.15.92:0/2781421612 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3dbc0a77e0 0x7f3dbc0a9ca0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4000c00 tx=0x7f3dc4005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:49.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.472+0000 7f3ddb0f7740 1 -- 172.21.15.92:0/3050167171 shutdown_connections 2024-09-19T09:03:49.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.472+0000 7f3ddb0f7740 1 --2- 172.21.15.92:0/3050167171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c04e3e9a30 0x55c04e3ebe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.472+0000 7f3ddb0f7740 1 --2- 172.21.15.92:0/3050167171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c04e3df170 0x55c04e3e94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.472+0000 7f3ddb0f7740 1 --2- 172.21.15.92:0/3050167171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c04e3de850 0x55c04e3dec30 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.472+0000 7f3ddb0f7740 1 -- 172.21.15.92:0/3050167171 >> 172.21.15.92:0/3050167171 conn(0x55c04e3dade0 msgr2=0x55c04e3db1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:49.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.472+0000 7f3ddb0f7740 1 -- 172.21.15.92:0/3050167171 shutdown_connections 2024-09-19T09:03:49.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.472+0000 7f3ddb0f7740 1 -- 172.21.15.92:0/3050167171 wait complete. 2024-09-19T09:03:49.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.472+0000 7f3ddb0f7740 1 -- start start 2024-09-19T09:03:49.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.473+0000 7f3ddb0f7740 1 Processor -- start 2024-09-19T09:03:49.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.473+0000 7f3ddb0f7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c04e3de850 0x55c04e3e6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.473+0000 7f3ddb0f7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c04e3df170 0x55c04e3e6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.473+0000 7f3ddb0f7740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c04e3e9a30 0x55c04e3e7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.473+0000 7f3ddb0f7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c04e3ec600 con 0x55c04e3de850 2024-09-19T09:03:49.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.473+0000 7f3ddb0f7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55c04e2cb900 con 0x55c04e3df170 2024-09-19T09:03:49.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.473+0000 7f3ddb0f7740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55c04e3ec780 con 0x55c04e3e9a30 2024-09-19T09:03:49.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.473+0000 7f3ddb0f7740 10 client.0 _ll_register_callbacks cb 0x55c04e2c9780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:49.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.473+0000 7f3dd1d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c04e3df170 0x55c04e3e6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:49.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.473+0000 7f3dd259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c04e3de850 0x55c04e3e6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:49.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.473+0000 7f3dd259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c04e3de850 0x55c04e3e6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35666/0 (socket says 172.21.15.92:35666) 2024-09-19T09:03:49.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.473+0000 7f3dd259c640 1 -- 172.21.15.92:0/4181849535 learned_addr learned my addr 172.21.15.92:0/4181849535 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:49.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.473+0000 7f3dd2d9d640 1 --2- 172.21.15.92:0/4181849535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c04e3e9a30 0x55c04e3e7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:49.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.474+0000 7f3dd1d9b640 1 -- 172.21.15.92:0/4181849535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c04e3e9a30 msgr2=0x55c04e3e7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:49.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.474+0000 7f3dd1d9b640 1 --2- 172.21.15.92:0/4181849535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c04e3e9a30 0x55c04e3e7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.474+0000 7f3dd1d9b640 1 -- 172.21.15.92:0/4181849535 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c04e3de850 msgr2=0x55c04e3e6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:49.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.474+0000 7f3dd1d9b640 1 --2- 172.21.15.92:0/4181849535 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c04e3de850 0x55c04e3e6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.474+0000 7f3dd1d9b640 1 -- 172.21.15.92:0/4181849535 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c04e30bc50 con 0x55c04e3df170 2024-09-19T09:03:49.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.474+0000 7f3dd1d9b640 1 --2- 172.21.15.92:0/4181849535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c04e3df170 0x55c04e3e6f50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8004600 tx=0x7f3dc80052d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb66ebaf565dbca6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:49.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.475+0000 7f3db9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:03:49.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.475+0000 7f3db9ffb640 1 -- 172.21.15.92:0/4181849535 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc801e4e0 con 0x55c04e3df170 2024-09-19T09:03:49.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.475+0000 7f3db9ffb640 1 -- 172.21.15.92:0/4181849535 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3dc801e680 con 0x55c04e3df170 2024-09-19T09:03:49.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.475+0000 7f3ddb0f7740 1 -- 172.21.15.92:0/4181849535 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3dc80047a0 con 0x55c04e3df170 2024-09-19T09:03:49.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.475+0000 7f3db9ffb640 1 -- 172.21.15.92:0/4181849535 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3dc801e880 con 0x55c04e3df170 2024-09-19T09:03:49.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.475+0000 7f3ddb0f7740 10 client.26399 fetch_fsmap learned FSMap version 19 2024-09-19T09:03:49.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.476+0000 7f3ddb0f7740 1 -- 172.21.15.92:0/4181849535 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55c04e409420 con 0x55c04e3df170 2024-09-19T09:03:49.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.476+0000 7f3db9ffb640 1 -- 172.21.15.92:0/4181849535 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dc8027410 con 0x55c04e3df170 2024-09-19T09:03:49.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.476+0000 7f3db9ffb640 1 -- 172.21.15.92:0/4181849535 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f3dc8030400 con 0x55c04e3df170 2024-09-19T09:03:49.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.476+0000 7f3ddb0f7740 10 client.26399 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:03:49.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.476+0000 7f3ddb0f7740 10 client.26399 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:03:49.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.476+0000 7f3ddb0f7740 20 client.26399 populate_metadata read hostname 'smithi092' 2024-09-19T09:03:49.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.476+0000 7f3ddb0f7740 1 --2- 172.21.15.92:0/4181849535 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55c04e40a7d0 0x55c04e40cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.476+0000 7f3ddb0f7740 4 client.26399 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:49.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.476+0000 7f3ddb0f7740 1 -- 172.21.15.92:0/4181849535 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3dc80047a0 con 0x55c04e40a7d0 2024-09-19T09:03:49.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.477+0000 7f3dd259c640 1 --2- 172.21.15.92:0/4181849535 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55c04e40a7d0 0x55c04e40cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:49.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.477+0000 7f3db9ffb640 10 client.26399 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:49.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.477+0000 7f3dd259c640 1 --2- 172.21.15.92:0/4181849535 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55c04e40a7d0 0x55c04e40cbc0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=865edef86387b10f server_cookie=5dbe2cece9f7aa43 in_seq=0 out_seq=0 2024-09-19T09:03:49.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.478+0000 7f3db9ffb640 1 -- 172.21.15.92:0/4181849535 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f3dc80047a0 con 0x55c04e40a7d0 2024-09-19T09:03:49.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.478+0000 7f3db9ffb640 10 client.26399 handle_command_reply: tid=0 2024-09-19T09:03:49.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.478+0000 7f3ddb0f7740 1 client.26399 shutdown 2024-09-19T09:03:49.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.479+0000 7f3ddb0f7740 1 -- 172.21.15.92:0/4181849535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c04e3df170 msgr2=0x55c04e3e6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:49.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.479+0000 7f3ddb0f7740 1 --2- 172.21.15.92:0/4181849535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c04e3df170 0x55c04e3e6f50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8004600 tx=0x7f3dc80052d0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.479+0000 7f3ddb0f7740 1 -- 172.21.15.92:0/4181849535 shutdown_connections 2024-09-19T09:03:49.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.479+0000 7f3ddb0f7740 1 --2- 172.21.15.92:0/4181849535 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55c04e40a7d0 0x55c04e40cbc0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.479+0000 7f3ddb0f7740 1 --2- 172.21.15.92:0/4181849535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c04e3e9a30 0x55c04e3e7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.479+0000 7f3ddb0f7740 1 --2- 172.21.15.92:0/4181849535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c04e3df170 0x55c04e3e6f50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.479+0000 7f3ddb0f7740 1 --2- 172.21.15.92:0/4181849535 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c04e3de850 0x55c04e3e6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.479+0000 7f3ddb0f7740 1 -- 172.21.15.92:0/4181849535 >> 172.21.15.92:0/4181849535 conn(0x55c04e3dade0 msgr2=0x55c04e3e0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:49.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.479+0000 7f3db9ffb640 0 client.26399 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:49.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.479+0000 7f3ddb0f7740 1 -- 172.21.15.92:0/4181849535 shutdown_connections 2024-09-19T09:03:49.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.479+0000 7f3ddb0f7740 1 -- 172.21.15.92:0/4181849535 wait complete. 2024-09-19T09:03:49.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.479+0000 7f3ddb0f7740 20 client.26399 trim_cache size 0 max 16384 2024-09-19T09:03:49.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.507+0000 7f3ddb0f7740 1 Processor -- start 2024-09-19T09:03:49.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.507+0000 7f3ddb0f7740 1 -- start start 2024-09-19T09:03:49.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.507+0000 7f3ddb0f7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c04e3de850 0x55c04e3e0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.507+0000 7f3ddb0f7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c04e3df170 0x55c04e3e72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.507+0000 7f3ddb0f7740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c04e3e9a30 0x55c04e4122e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.507+0000 7f3ddb0f7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd41a9410 con 0x55c04e3df170 2024-09-19T09:03:49.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.508+0000 7f3ddb0f7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd41abcb0 con 0x55c04e3de850 2024-09-19T09:03:49.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.508+0000 7f3ddb0f7740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd41a9aa0 con 0x55c04e3e9a30 2024-09-19T09:03:49.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.508+0000 7f3dd1d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c04e3df170 0x55c04e3e72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:49.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.508+0000 7f3dd2d9d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c04e3e9a30 0x55c04e4122e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:49.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.508+0000 7f3dd2d9d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c04e3e9a30 0x55c04e4122e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:47136/0 (socket says 172.21.15.92:47136) 2024-09-19T09:03:49.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.508+0000 7f3dd2d9d640 1 -- 172.21.15.92:0/3244930818 learned_addr learned my addr 172.21.15.92:0/3244930818 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:49.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.508+0000 7f3dd1d9b640 1 -- 172.21.15.92:0/3244930818 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c04e3e9a30 msgr2=0x55c04e4122e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:49.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.508+0000 7f3dd1d9b640 1 --2- 172.21.15.92:0/3244930818 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c04e3e9a30 0x55c04e4122e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.508+0000 7f3dd1d9b640 1 -- 172.21.15.92:0/3244930818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c04e3de850 msgr2=0x55c04e3e0910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:03:49.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.508+0000 7f3dd1d9b640 1 --2- 172.21.15.92:0/3244930818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c04e3de850 0x55c04e3e0910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.508+0000 7f3dd1d9b640 1 -- 172.21.15.92:0/3244930818 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c04e3defa0 con 0x55c04e3df170 2024-09-19T09:03:49.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.508+0000 7f3dd1d9b640 1 --2- 172.21.15.92:0/3244930818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c04e3df170 0x55c04e3e72e0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8011ef0 tx=0x7f3dc8005440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de5c8be7a25b9da4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:49.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.509+0000 7f3dbbfff640 1 -- 172.21.15.92:0/3244930818 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8038070 con 0x55c04e3df170 2024-09-19T09:03:49.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.509+0000 7f3dbbfff640 1 -- 172.21.15.92:0/3244930818 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dc8004c60 con 0x55c04e3df170 2024-09-19T09:03:49.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.509+0000 7f3dbbfff640 1 -- 172.21.15.92:0/3244930818 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc801e470 con 0x55c04e3df170 2024-09-19T09:03:49.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.511+0000 7f3ddb0f7740 1 -- 172.21.15.92:0/3244930818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c04e3df170 msgr2=0x55c04e3e72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:49.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.511+0000 7f3ddb0f7740 1 --2- 172.21.15.92:0/3244930818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c04e3df170 0x55c04e3e72e0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8011ef0 tx=0x7f3dc8005440 comp rx=0 tx=0).stop 2024-09-19T09:03:49.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.513+0000 7f3ddb0f7740 1 -- 172.21.15.92:0/3244930818 shutdown_connections 2024-09-19T09:03:49.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.513+0000 7f3ddb0f7740 1 --2- 172.21.15.92:0/3244930818 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c04e3e9a30 0x55c04e4122e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.513+0000 7f3ddb0f7740 1 --2- 172.21.15.92:0/3244930818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c04e3df170 0x55c04e3e72e0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.513+0000 7f3ddb0f7740 1 --2- 172.21.15.92:0/3244930818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c04e3de850 0x55c04e3e0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.513+0000 7f3ddb0f7740 1 -- 172.21.15.92:0/3244930818 >> 172.21.15.92:0/3244930818 conn(0x55c04e3dade0 msgr2=0x55c04e3e8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:49.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.513+0000 7f3ddb0f7740 1 -- 172.21.15.92:0/3244930818 shutdown_connections 2024-09-19T09:03:49.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.515+0000 7f3ddb0f7740 1 -- 172.21.15.92:0/3244930818 wait complete. 2024-09-19T09:03:49.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.515+0000 7f3ddb0f7740 1 -- start start 2024-09-19T09:03:49.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.515+0000 7f3ddb0f7740 1 Processor -- start 2024-09-19T09:03:49.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.516+0000 7f3ddb0f7740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c04e3de850 0x55c04e3f3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.516+0000 7f3ddb0f7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c04e3df170 0x55c04e3ee340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.516+0000 7f3ddb0f7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c04e3e9a30 0x55c04e3ee880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.516+0000 7f3ddb0f7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd41aa170 con 0x55c04e3e9a30 2024-09-19T09:03:49.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.516+0000 7f3ddb0f7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd41ab5e0 con 0x55c04e3df170 2024-09-19T09:03:49.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.516+0000 7f3ddb0f7740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd41aa840 con 0x55c04e3de850 2024-09-19T09:03:49.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.516+0000 7f3ddb0f7740 10 client.0 _ll_register_callbacks cb 0x7f3dc8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:49.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.517+0000 7f3dd2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c04e3e9a30 0x55c04e3ee880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:49.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.517+0000 7f3dd2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c04e3e9a30 0x55c04e3ee880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35696/0 (socket says 172.21.15.92:35696) 2024-09-19T09:03:49.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.517+0000 7f3dd2d9d640 1 -- 172.21.15.92:0/1507213112 learned_addr learned my addr 172.21.15.92:0/1507213112 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:03:49.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.517+0000 7f3dd259c640 1 --2- 172.21.15.92:0/1507213112 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c04e3de850 0x55c04e3f3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:49.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.519+0000 7f3dd1d9b640 1 --2- 172.21.15.92:0/1507213112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c04e3df170 0x55c04e3ee340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:49.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.521+0000 7f3dd2d9d640 1 -- 172.21.15.92:0/1507213112 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c04e3de850 msgr2=0x55c04e3f3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:49.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.521+0000 7f3dd2d9d640 1 --2- 172.21.15.92:0/1507213112 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c04e3de850 0x55c04e3f3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.521+0000 7f3dd2d9d640 1 -- 172.21.15.92:0/1507213112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c04e3df170 msgr2=0x55c04e3ee340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:49.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.521+0000 7f3dd2d9d640 1 --2- 172.21.15.92:0/1507213112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c04e3df170 0x55c04e3ee340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.521+0000 7f3dd2d9d640 1 -- 172.21.15.92:0/1507213112 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c04e3eedc0 con 0x55c04e3e9a30 2024-09-19T09:03:49.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.521+0000 7f3dd2d9d640 1 --2- 172.21.15.92:0/1507213112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c04e3e9a30 0x55c04e3ee880 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc0cd940 tx=0x7f3dcc09cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa435b222f1d79aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:49.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.521+0000 7f3db9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:03:49.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.522+0000 7f3db9ffb640 1 -- 172.21.15.92:0/1507213112 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc0a5100 con 0x55c04e3e9a30 2024-09-19T09:03:49.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.522+0000 7f3db9ffb640 1 -- 172.21.15.92:0/1507213112 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3dcc005520 con 0x55c04e3e9a30 2024-09-19T09:03:49.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.522+0000 7f3ddb0f7740 1 -- 172.21.15.92:0/1507213112 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3dc8004c60 con 0x55c04e3e9a30 2024-09-19T09:03:49.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.523+0000 7f3db9ffb640 1 -- 172.21.15.92:0/1507213112 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3dcc0b5260 con 0x55c04e3e9a30 2024-09-19T09:03:49.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.523+0000 7f3ddb0f7740 10 client.17049 fetch_fsmap learned FSMap version 19 2024-09-19T09:03:49.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.523+0000 7f3ddb0f7740 1 -- 172.21.15.92:0/1507213112 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55c04e475050 con 0x55c04e3e9a30 2024-09-19T09:03:49.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.524+0000 7f3db9ffb640 1 -- 172.21.15.92:0/1507213112 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dcc0b5400 con 0x55c04e3e9a30 2024-09-19T09:03:49.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.524+0000 7f3db9ffb640 1 -- 172.21.15.92:0/1507213112 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f3dcc0b03e0 con 0x55c04e3e9a30 2024-09-19T09:03:49.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.524+0000 7f3ddb0f7740 10 client.17049 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:03:49.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.524+0000 7f3ddb0f7740 10 client.17049 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:03:49.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.524+0000 7f3ddb0f7740 20 client.17049 populate_metadata read hostname 'smithi092' 2024-09-19T09:03:49.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.524+0000 7f3ddb0f7740 1 --2- 172.21.15.92:0/1507213112 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55c04e475790 0x55c04e477b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.525+0000 7f3ddb0f7740 4 client.17049 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.75, "await_for": 45.0}] 2024-09-19T09:03:49.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.525+0000 7f3ddb0f7740 1 -- 172.21.15.92:0/1507213112 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.75, "await_for": 45.0}) -- 0x7f3dc8004c60 con 0x55c04e475790 2024-09-19T09:03:49.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.525+0000 7f3dd259c640 1 --2- 172.21.15.92:0/1507213112 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55c04e475790 0x55c04e477b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:49.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.536+0000 7f3dd259c640 1 --2- 172.21.15.92:0/1507213112 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55c04e475790 0x55c04e477b80 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff8c757b3ebc0077 server_cookie=8212d0c13a456bc1 in_seq=0 out_seq=0 2024-09-19T09:03:49.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.536+0000 7f3db9ffb640 10 client.17049 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:49.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.772+0000 7f3db9ffb640 1 -- 172.21.15.92:0/1507213112 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7f3dc8004c60 con 0x55c04e475790 2024-09-19T09:03:49.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.772+0000 7f3db9ffb640 10 client.17049 handle_command_reply: tid=0 2024-09-19T09:03:49.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.772+0000 7f3ddb0f7740 1 client.17049 shutdown 2024-09-19T09:03:49.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.772+0000 7f3ddb0f7740 1 -- 172.21.15.92:0/1507213112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c04e3e9a30 msgr2=0x55c04e3ee880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:49.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.772+0000 7f3ddb0f7740 1 --2- 172.21.15.92:0/1507213112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c04e3e9a30 0x55c04e3ee880 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc0cd940 tx=0x7f3dcc09cc50 comp rx=0 tx=0).stop 2024-09-19T09:03:49.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.772+0000 7f3ddb0f7740 1 -- 172.21.15.92:0/1507213112 shutdown_connections 2024-09-19T09:03:49.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.772+0000 7f3ddb0f7740 1 --2- 172.21.15.92:0/1507213112 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55c04e475790 0x55c04e477b80 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.772+0000 7f3db9ffb640 0 client.17049 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:03:49.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.772+0000 7f3ddb0f7740 1 --2- 172.21.15.92:0/1507213112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c04e3e9a30 0x55c04e3ee880 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.772+0000 7f3ddb0f7740 1 --2- 172.21.15.92:0/1507213112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c04e3df170 0x55c04e3ee340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.772+0000 7f3ddb0f7740 1 --2- 172.21.15.92:0/1507213112 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c04e3de850 0x55c04e3f3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.772+0000 7f3ddb0f7740 1 -- 172.21.15.92:0/1507213112 >> 172.21.15.92:0/1507213112 conn(0x55c04e3dade0 msgr2=0x55c04e3e4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:49.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.772+0000 7f3ddb0f7740 1 -- 172.21.15.92:0/1507213112 shutdown_connections 2024-09-19T09:03:49.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.772+0000 7f3ddb0f7740 1 -- 172.21.15.92:0/1507213112 wait complete. 2024-09-19T09:03:49.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.772+0000 7f3ddb0f7740 20 client.17049 trim_cache size 0 max 16384 2024-09-19T09:03:49.774 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:03:49.775 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 19, 2024-09-19T09:03:49.775 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24472, 2024-09-19T09:03:49.775 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 30, 2024-09-19T09:03:49.775 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-09-19T09:03:49.775 INFO:teuthology.orchestra.run.smithi092.stdout: "432ba889": { 2024-09-19T09:03:49.775 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 30, 2024-09-19T09:03:49.775 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-09-19T09:03:49.775 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:03:49.775 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-09-19T09:03:49.775 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:03:49.775 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:03:49.775 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 90.0, 2024-09-19T09:03:49.775 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 145.8, 2024-09-19T09:03:49.775 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-09-19T09:03:49.776 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-09-19T09:03:49.776 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-09-19T09:03:49.776 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:03:49.776 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-09-19T09:03:49.776 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:03:49.776 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:03:49.776 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:03:49.776 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:03:49.776 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:03:49.776 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:03:49.776 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:03:49.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.773+0000 7f3dd8d1e640 1 -- 172.21.15.92:0/2781421612 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3dbc0a77e0 msgr2=0x7f3dbc0a9ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:49.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.773+0000 7f3dd8d1e640 1 --2- 172.21.15.92:0/2781421612 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3dbc0a77e0 0x7f3dbc0a9ca0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4000c00 tx=0x7f3dc4005d50 comp rx=0 tx=0).stop 2024-09-19T09:03:49.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.773+0000 7f3dd8d1e640 1 -- 172.21.15.92:0/2781421612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3dd4106f00 msgr2=0x7f3dd419ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:49.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.773+0000 7f3dd8d1e640 1 --2- 172.21.15.92:0/2781421612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3dd4106f00 0x7f3dd419ccc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc009fd0 tx=0x7f3dcc00ef10 comp rx=0 tx=0).stop 2024-09-19T09:03:49.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.773+0000 7f3dd8d1e640 1 -- 172.21.15.92:0/2781421612 shutdown_connections 2024-09-19T09:03:49.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.773+0000 7f3dd8d1e640 1 --2- 172.21.15.92:0/2781421612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3dd4106f00 0x7f3dd419ccc0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.773+0000 7f3dd8d1e640 1 --2- 172.21.15.92:0/2781421612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dd4102780 0x7f3dd4198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.773+0000 7f3dd8d1e640 1 --2- 172.21.15.92:0/2781421612 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3dbc0a77e0 0x7f3dbc0a9ca0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.773+0000 7f3dd8d1e640 1 --2- 172.21.15.92:0/2781421612 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3dd4101dd0 0x7f3dd41983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.773+0000 7f3dd8d1e640 1 -- 172.21.15.92:0/2781421612 >> 172.21.15.92:0/2781421612 conn(0x7f3dd40fd8b0 msgr2=0x7f3dd40feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:49.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.773+0000 7f3dd8d1e640 1 -- 172.21.15.92:0/2781421612 shutdown_connections 2024-09-19T09:03:49.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:03:49.773+0000 7f3dd8d1e640 1 -- 172.21.15.92:0/2781421612 wait complete. 2024-09-19T09:03:50.414 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '432ba889', quiesce took 4.2 seconds. Will release after: 21.55 2024-09-19T09:03:50.796 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 425.0 s, 2521.8 tps, lat 30.770 ms stddev 37.912 2024-09-19T09:03:51.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:51 smithi092 ceph-mon[31407]: pgmap v551: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 11 MiB/s wr, 476 op/s 2024-09-19T09:03:51.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:51 smithi167 ceph-mon[35359]: pgmap v551: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 11 MiB/s wr, 476 op/s 2024-09-19T09:03:51.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:51 smithi190 ceph-mon[35358]: pgmap v551: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 11 MiB/s wr, 476 op/s 2024-09-19T09:03:53.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:53 smithi092 ceph-mon[31407]: pgmap v552: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 5.6 MiB/s wr, 331 op/s 2024-09-19T09:03:53.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:53 smithi167 ceph-mon[35359]: pgmap v552: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 5.6 MiB/s wr, 331 op/s 2024-09-19T09:03:53.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:53 smithi190 ceph-mon[35358]: pgmap v552: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 5.6 MiB/s wr, 331 op/s 2024-09-19T09:03:55.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:55 smithi092 ceph-mon[31407]: pgmap v553: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.6 MiB/s wr, 260 op/s 2024-09-19T09:03:55.799 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:03:55.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:55 smithi167 ceph-mon[35359]: pgmap v553: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.6 MiB/s wr, 260 op/s 2024-09-19T09:03:55.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:55 smithi190 ceph-mon[35358]: pgmap v553: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.6 MiB/s wr, 260 op/s 2024-09-19T09:03:57.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:57 smithi092 ceph-mon[31407]: pgmap v554: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.6 MiB/s wr, 260 op/s 2024-09-19T09:03:57.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:57 smithi167 ceph-mon[35359]: pgmap v554: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.6 MiB/s wr, 260 op/s 2024-09-19T09:03:57.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:57 smithi190 ceph-mon[35358]: pgmap v554: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.6 MiB/s wr, 260 op/s 2024-09-19T09:03:59.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:03:59 smithi092 ceph-mon[31407]: pgmap v555: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.7 MiB/s wr, 261 op/s 2024-09-19T09:03:59.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:03:59 smithi167 ceph-mon[35359]: pgmap v555: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.7 MiB/s wr, 261 op/s 2024-09-19T09:03:59.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:03:59 smithi190 ceph-mon[35358]: pgmap v555: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.7 MiB/s wr, 261 op/s 2024-09-19T09:04:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.341+0000 7f190e465640 1 -- 172.21.15.92:0/3786198516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1908100d10 msgr2=0x7f1908101170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.341+0000 7f190e465640 1 --2- 172.21.15.92:0/3786198516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1908100d10 0x7f1908101170 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f18fc009900 tx=0x7f18fc02a410 comp rx=0 tx=0).stop 2024-09-19T09:04:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.342+0000 7f190e465640 1 -- 172.21.15.92:0/3786198516 shutdown_connections 2024-09-19T09:04:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.342+0000 7f190e465640 1 --2- 172.21.15.92:0/3786198516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19081016b0 0x7f1908101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.342+0000 7f190e465640 1 --2- 172.21.15.92:0/3786198516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1908100d10 0x7f1908101170 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.342+0000 7f190e465640 1 --2- 172.21.15.92:0/3786198516 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19081003d0 0x7f19081007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.342+0000 7f190e465640 1 -- 172.21.15.92:0/3786198516 >> 172.21.15.92:0/3786198516 conn(0x7f19080fc1e0 msgr2=0x7f19080fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.342+0000 7f190e465640 1 -- 172.21.15.92:0/3786198516 shutdown_connections 2024-09-19T09:04:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.342+0000 7f190e465640 1 -- 172.21.15.92:0/3786198516 wait complete. 2024-09-19T09:04:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.342+0000 7f190e465640 1 Processor -- start 2024-09-19T09:04:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.342+0000 7f190e465640 1 -- start start 2024-09-19T09:04:00.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.343+0000 7f190e465640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19081003d0 0x7f190819a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:00.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.343+0000 7f190e465640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1908100d10 0x7f190819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:00.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.343+0000 7f190e465640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19081016b0 0x7f19081a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:00.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.343+0000 7f190e465640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f190810fa30 con 0x7f1908100d10 2024-09-19T09:04:00.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.343+0000 7f190e465640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f190810f8b0 con 0x7f19081003d0 2024-09-19T09:04:00.346 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.343+0000 7f190e465640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f190810fbb0 con 0x7f19081016b0 2024-09-19T09:04:00.346 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.343+0000 7f19077fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1908100d10 0x7f190819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:00.346 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.343+0000 7f19077fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1908100d10 0x7f190819a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54742/0 (socket says 172.21.15.92:54742) 2024-09-19T09:04:00.346 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.343+0000 7f19077fe640 1 -- 172.21.15.92:0/1045505663 learned_addr learned my addr 172.21.15.92:0/1045505663 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:00.346 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.343+0000 7f1907fff640 1 --2- 172.21.15.92:0/1045505663 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19081003d0 0x7f190819a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:00.346 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.343+0000 7f190ca02640 1 --2- 172.21.15.92:0/1045505663 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19081016b0 0x7f19081a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:00.346 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.343+0000 7f19077fe640 1 -- 172.21.15.92:0/1045505663 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19081016b0 msgr2=0x7f19081a1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:00.346 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.343+0000 7f19077fe640 1 --2- 172.21.15.92:0/1045505663 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19081016b0 0x7f19081a1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.346 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.343+0000 7f19077fe640 1 -- 172.21.15.92:0/1045505663 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19081003d0 msgr2=0x7f190819a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:00.346 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.343+0000 7f19077fe640 1 --2- 172.21.15.92:0/1045505663 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19081003d0 0x7f190819a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.346 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.343+0000 7f19077fe640 1 -- 172.21.15.92:0/1045505663 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19081a1cd0 con 0x7f1908100d10 2024-09-19T09:04:00.346 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.343+0000 7f1907fff640 1 --2- 172.21.15.92:0/1045505663 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19081003d0 0x7f190819a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.343+0000 7f190ca02640 1 --2- 172.21.15.92:0/1045505663 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19081016b0 0x7f19081a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.343+0000 7f19077fe640 1 --2- 172.21.15.92:0/1045505663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1908100d10 0x7f190819a5f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f18fc009230 tx=0x7f18fc004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.343+0000 7f19057fa640 1 -- 172.21.15.92:0/1045505663 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18fc03f030 con 0x7f1908100d10 2024-09-19T09:04:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.343+0000 7f19057fa640 1 -- 172.21.15.92:0/1045505663 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18fc003ce0 con 0x7f1908100d10 2024-09-19T09:04:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.343+0000 7f190e465640 1 -- 172.21.15.92:0/1045505663 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19081a1f60 con 0x7f1908100d10 2024-09-19T09:04:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.343+0000 7f19057fa640 1 -- 172.21.15.92:0/1045505663 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18fc035070 con 0x7f1908100d10 2024-09-19T09:04:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.344+0000 7f190e465640 1 -- 172.21.15.92:0/1045505663 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19081a2440 con 0x7f1908100d10 2024-09-19T09:04:00.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.346+0000 7f19057fa640 1 -- 172.21.15.92:0/1045505663 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f18fc042030 con 0x7f1908100d10 2024-09-19T09:04:00.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.346+0000 7f1911200740 1 Processor -- start 2024-09-19T09:04:00.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.346+0000 7f1911200740 1 -- start start 2024-09-19T09:04:00.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.347+0000 7f1911200740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e180ff39a0 0x55e180ff3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:00.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.347+0000 7f1911200740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e180ff42e0 0x55e180ff8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:00.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.347+0000 7f1911200740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e180ff9370 0x55e180ffb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:00.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.347+0000 7f1911200740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e180f572f0 con 0x55e180ff9370 2024-09-19T09:04:00.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.347+0000 7f1911200740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e180eff270 con 0x55e180ff42e0 2024-09-19T09:04:00.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.347+0000 7f1911200740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e180f532b0 con 0x55e180ff39a0 2024-09-19T09:04:00.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.347+0000 7f19057fa640 1 --2- 172.21.15.92:0/1045505663 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f18f00a32f0 0x7f18f00a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:00.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.347+0000 7f19077fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e180ff9370 0x55e180ffb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:00.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.347+0000 7f19077fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e180ff9370 0x55e180ffb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54744/0 (socket says 172.21.15.92:54744) 2024-09-19T09:04:00.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.347+0000 7f19077fe640 1 -- 172.21.15.92:0/3061461576 learned_addr learned my addr 172.21.15.92:0/3061461576 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:00.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.347+0000 7f190ca02640 1 --2- 172.21.15.92:0/3061461576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e180ff39a0 0x55e180ff3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:00.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.347+0000 7f1907fff640 1 --2- 172.21.15.92:0/3061461576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e180ff42e0 0x55e180ff8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:00.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.347+0000 7f190ca02640 1 --2- 172.21.15.92:0/1045505663 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f18f00a32f0 0x7f18f00a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:00.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.347+0000 7f19057fa640 1 -- 172.21.15.92:0/1045505663 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f18fc0f0150 con 0x7f1908100d10 2024-09-19T09:04:00.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.347+0000 7f19077fe640 1 -- 172.21.15.92:0/3061461576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e180ff39a0 msgr2=0x55e180ff3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:00.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.347+0000 7f19077fe640 1 --2- 172.21.15.92:0/3061461576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e180ff39a0 0x55e180ff3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.347+0000 7f19077fe640 1 -- 172.21.15.92:0/3061461576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e180ff42e0 msgr2=0x55e180ff8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:00.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.347+0000 7f19077fe640 1 --2- 172.21.15.92:0/3061461576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e180ff42e0 0x55e180ff8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.347+0000 7f19077fe640 1 -- 172.21.15.92:0/3061461576 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e180efe340 con 0x55e180ff9370 2024-09-19T09:04:00.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.347+0000 7f1907fff640 1 --2- 172.21.15.92:0/3061461576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e180ff42e0 0x55e180ff8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:00.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.347+0000 7f190ca02640 1 --2- 172.21.15.92:0/1045505663 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f18f00a32f0 0x7f18f00a57b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f18f80127d0 tx=0x7f18f8005b00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:00.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.347+0000 7f19077fe640 1 --2- 172.21.15.92:0/3061461576 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e180ff9370 0x55e180ffb830 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f18fc031ba0 tx=0x7f18fc040fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=439e5dc995c684b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:00.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.348+0000 7f18ee7fc640 1 -- 172.21.15.92:0/3061461576 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18fc049070 con 0x55e180ff9370 2024-09-19T09:04:00.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.348+0000 7f18ee7fc640 1 -- 172.21.15.92:0/3061461576 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18fc0c0ae0 con 0x55e180ff9370 2024-09-19T09:04:00.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.348+0000 7f18ee7fc640 1 -- 172.21.15.92:0/3061461576 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18fc0bc990 con 0x55e180ff9370 2024-09-19T09:04:00.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.348+0000 7f1911200740 1 -- 172.21.15.92:0/3061461576 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e180ff9370 msgr2=0x55e180ffb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:00.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.348+0000 7f1911200740 1 --2- 172.21.15.92:0/3061461576 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e180ff9370 0x55e180ffb830 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f18fc031ba0 tx=0x7f18fc040fb0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.348+0000 7f1911200740 1 -- 172.21.15.92:0/3061461576 shutdown_connections 2024-09-19T09:04:00.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.348+0000 7f1911200740 1 --2- 172.21.15.92:0/3061461576 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e180ff9370 0x55e180ffb830 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.348+0000 7f1911200740 1 --2- 172.21.15.92:0/3061461576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e180ff42e0 0x55e180ff8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.348+0000 7f1911200740 1 --2- 172.21.15.92:0/3061461576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e180ff39a0 0x55e180ff3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.348+0000 7f1911200740 1 -- 172.21.15.92:0/3061461576 >> 172.21.15.92:0/3061461576 conn(0x55e180fef010 msgr2=0x55e180fef410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:00.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.348+0000 7f1911200740 1 -- 172.21.15.92:0/3061461576 shutdown_connections 2024-09-19T09:04:00.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.348+0000 7f1911200740 1 -- 172.21.15.92:0/3061461576 wait complete. 2024-09-19T09:04:00.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.349+0000 7f1911200740 1 -- start start 2024-09-19T09:04:00.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.349+0000 7f1911200740 1 Processor -- start 2024-09-19T09:04:00.357 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.349+0000 7f1911200740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e180ff39a0 0x55e180ffd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:00.357 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.349+0000 7f1911200740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e180ff42e0 0x55e180ffde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:00.357 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.349+0000 7f1911200740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e180ff9370 0x55e181004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:00.357 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.349+0000 7f1911200740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e180ffc100 con 0x55e180ff42e0 2024-09-19T09:04:00.357 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.349+0000 7f1911200740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e180ee0290 con 0x55e180ff9370 2024-09-19T09:04:00.357 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.349+0000 7f1911200740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e180ffc280 con 0x55e180ff39a0 2024-09-19T09:04:00.357 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.349+0000 7f1911200740 10 client.0 _ll_register_callbacks cb 0x55e180f11140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:00.357 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.349+0000 7f19077fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e180ff42e0 0x55e180ffde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:00.357 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.349+0000 7f19077fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e180ff42e0 0x55e180ffde00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54756/0 (socket says 172.21.15.92:54756) 2024-09-19T09:04:00.357 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.349+0000 7f19077fe640 1 -- 172.21.15.92:0/2024475125 learned_addr learned my addr 172.21.15.92:0/2024475125 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:00.357 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.350+0000 7f1907fff640 1 --2- 172.21.15.92:0/2024475125 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e180ff39a0 0x55e180ffd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:00.357 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.350+0000 7f190ca02640 1 --2- 172.21.15.92:0/2024475125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e180ff9370 0x55e181004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:00.358 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.350+0000 7f19077fe640 1 -- 172.21.15.92:0/2024475125 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e180ff39a0 msgr2=0x55e180ffd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:00.358 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.350+0000 7f19077fe640 1 --2- 172.21.15.92:0/2024475125 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e180ff39a0 0x55e180ffd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.358 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.350+0000 7f19077fe640 1 -- 172.21.15.92:0/2024475125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e180ff9370 msgr2=0x55e181004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:00.358 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.350+0000 7f19077fe640 1 --2- 172.21.15.92:0/2024475125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e180ff9370 0x55e181004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.358 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.350+0000 7f19077fe640 1 -- 172.21.15.92:0/2024475125 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e180c6a210 con 0x55e180ff42e0 2024-09-19T09:04:00.358 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.350+0000 7f19077fe640 1 --2- 172.21.15.92:0/2024475125 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e180ff42e0 0x55e180ffde00 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f18fc0b8b90 tx=0x7f18fc0092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f32bd578b8ec6b8c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:00.358 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.350+0000 7f18e77fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:04:00.358 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.350+0000 7f18e77fe640 1 -- 172.21.15.92:0/2024475125 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18fc049070 con 0x55e180ff42e0 2024-09-19T09:04:00.358 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.350+0000 7f18e77fe640 1 -- 172.21.15.92:0/2024475125 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f18fc0bcba0 con 0x55e180ff42e0 2024-09-19T09:04:00.358 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.350+0000 7f1911200740 1 -- 172.21.15.92:0/2024475125 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18fc0c0ae0 con 0x55e180ff42e0 2024-09-19T09:04:00.358 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.350+0000 7f18e77fe640 1 -- 172.21.15.92:0/2024475125 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f18fc0c4f10 con 0x55e180ff42e0 2024-09-19T09:04:00.358 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.350+0000 7f1911200740 10 client.17061 fetch_fsmap learned FSMap version 19 2024-09-19T09:04:00.358 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.350+0000 7f1911200740 1 -- 172.21.15.92:0/2024475125 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e180d36620 con 0x55e180ff42e0 2024-09-19T09:04:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.350+0000 7f18e77fe640 1 -- 172.21.15.92:0/2024475125 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18fc0c0ae0 con 0x55e180ff42e0 2024-09-19T09:04:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.350+0000 7f18e77fe640 1 -- 172.21.15.92:0/2024475125 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f18fc0b8510 con 0x55e180ff42e0 2024-09-19T09:04:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.351+0000 7f1911200740 10 client.17061 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:04:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.351+0000 7f1911200740 10 client.17061 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:04:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.351+0000 7f1911200740 20 client.17061 populate_metadata read hostname 'smithi092' 2024-09-19T09:04:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.351+0000 7f1911200740 1 --2- 172.21.15.92:0/2024475125 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e181009350 0x55e18100b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.351+0000 7f1911200740 4 client.17061 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.351+0000 7f1911200740 1 -- 172.21.15.92:0/2024475125 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e180f64a20 con 0x55e181009350 2024-09-19T09:04:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.351+0000 7f1907fff640 1 --2- 172.21.15.92:0/2024475125 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e181009350 0x55e18100b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.351+0000 7f18e77fe640 10 client.17061 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.351+0000 7f1907fff640 1 --2- 172.21.15.92:0/2024475125 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e181009350 0x55e18100b760 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f89987bd6cdb066a server_cookie=74f73fad550ff0e0 in_seq=0 out_seq=0 2024-09-19T09:04:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.352+0000 7f18e77fe640 1 -- 172.21.15.92:0/2024475125 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e180f64a20 con 0x55e181009350 2024-09-19T09:04:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.352+0000 7f18e77fe640 10 client.17061 handle_command_reply: tid=0 2024-09-19T09:04:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.352+0000 7f1911200740 1 client.17061 shutdown 2024-09-19T09:04:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.352+0000 7f1911200740 1 -- 172.21.15.92:0/2024475125 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e180ff42e0 msgr2=0x55e180ffde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.352+0000 7f1911200740 1 --2- 172.21.15.92:0/2024475125 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e180ff42e0 0x55e180ffde00 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f18fc0b8b90 tx=0x7f18fc0092d0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.352+0000 7f1911200740 1 -- 172.21.15.92:0/2024475125 shutdown_connections 2024-09-19T09:04:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.352+0000 7f1911200740 1 --2- 172.21.15.92:0/2024475125 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e181009350 0x55e18100b760 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.352+0000 7f1911200740 1 --2- 172.21.15.92:0/2024475125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e180ff9370 0x55e181004e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.352+0000 7f18e77fe640 0 client.17061 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.352+0000 7f1911200740 1 --2- 172.21.15.92:0/2024475125 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e180ff42e0 0x55e180ffde00 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.352+0000 7f1911200740 1 --2- 172.21.15.92:0/2024475125 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e180ff39a0 0x55e180ffd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.352+0000 7f1911200740 1 -- 172.21.15.92:0/2024475125 >> 172.21.15.92:0/2024475125 conn(0x55e180fef010 msgr2=0x55e180ff0820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.352+0000 7f1911200740 1 -- 172.21.15.92:0/2024475125 shutdown_connections 2024-09-19T09:04:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.352+0000 7f1911200740 1 -- 172.21.15.92:0/2024475125 wait complete. 2024-09-19T09:04:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.352+0000 7f1911200740 20 client.17061 trim_cache size 0 max 16384 2024-09-19T09:04:00.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.366+0000 7f1911200740 1 Processor -- start 2024-09-19T09:04:00.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.366+0000 7f1911200740 1 -- start start 2024-09-19T09:04:00.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.366+0000 7f1911200740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e180ff39a0 0x55e180ffd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:00.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.367+0000 7f1911200740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e180ff42e0 0x55e181004e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:00.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.367+0000 7f1911200740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e180ff9370 0x55e180ffde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:00.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.367+0000 7f1911200740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f19081a9260 con 0x55e180ff42e0 2024-09-19T09:04:00.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.367+0000 7f1911200740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f19081abb00 con 0x55e180ff39a0 2024-09-19T09:04:00.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.367+0000 7f1911200740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f19081a98f0 con 0x55e180ff9370 2024-09-19T09:04:00.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.367+0000 7f19077fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e180ff42e0 0x55e181004e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:00.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.367+0000 7f19077fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e180ff42e0 0x55e181004e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54764/0 (socket says 172.21.15.92:54764) 2024-09-19T09:04:00.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.367+0000 7f19077fe640 1 -- 172.21.15.92:0/1267540461 learned_addr learned my addr 172.21.15.92:0/1267540461 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:00.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.367+0000 7f1907fff640 1 --2- 172.21.15.92:0/1267540461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e180ff39a0 0x55e180ffd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:00.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.367+0000 7f19077fe640 1 -- 172.21.15.92:0/1267540461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e180ff9370 msgr2=0x55e180ffde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:00.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.367+0000 7f19077fe640 1 --2- 172.21.15.92:0/1267540461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e180ff9370 0x55e180ffde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.367+0000 7f19077fe640 1 -- 172.21.15.92:0/1267540461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e180ff39a0 msgr2=0x55e180ffd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:00.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.367+0000 7f19077fe640 1 --2- 172.21.15.92:0/1267540461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e180ff39a0 0x55e180ffd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.367+0000 7f19077fe640 1 -- 172.21.15.92:0/1267540461 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e18100bde0 con 0x55e180ff42e0 2024-09-19T09:04:00.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.367+0000 7f19077fe640 1 --2- 172.21.15.92:0/1267540461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e180ff42e0 0x55e181004e00 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f18fc0b9100 tx=0x7f18fc009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a422037ed9a54c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:00.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.367+0000 7f18edffb640 1 -- 172.21.15.92:0/1267540461 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18fc049070 con 0x55e180ff42e0 2024-09-19T09:04:00.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.367+0000 7f18edffb640 1 -- 172.21.15.92:0/1267540461 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18fc0c53a0 con 0x55e180ff42e0 2024-09-19T09:04:00.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.367+0000 7f18edffb640 1 -- 172.21.15.92:0/1267540461 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18fc0b86c0 con 0x55e180ff42e0 2024-09-19T09:04:00.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.368+0000 7f1911200740 1 -- 172.21.15.92:0/1267540461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e180ff42e0 msgr2=0x55e181004e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:00.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.368+0000 7f1911200740 1 --2- 172.21.15.92:0/1267540461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e180ff42e0 0x55e181004e00 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f18fc0b9100 tx=0x7f18fc009680 comp rx=0 tx=0).stop 2024-09-19T09:04:00.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.368+0000 7f1911200740 1 -- 172.21.15.92:0/1267540461 shutdown_connections 2024-09-19T09:04:00.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.368+0000 7f1911200740 1 --2- 172.21.15.92:0/1267540461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e180ff9370 0x55e180ffde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.368+0000 7f1911200740 1 --2- 172.21.15.92:0/1267540461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e180ff42e0 0x55e181004e00 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.368+0000 7f1911200740 1 --2- 172.21.15.92:0/1267540461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e180ff39a0 0x55e180ffd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.368+0000 7f1911200740 1 -- 172.21.15.92:0/1267540461 >> 172.21.15.92:0/1267540461 conn(0x55e180fef010 msgr2=0x55e180ff8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.368+0000 7f1911200740 1 -- 172.21.15.92:0/1267540461 shutdown_connections 2024-09-19T09:04:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.368+0000 7f1911200740 1 -- 172.21.15.92:0/1267540461 wait complete. 2024-09-19T09:04:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.368+0000 7f1911200740 1 -- start start 2024-09-19T09:04:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.368+0000 7f1911200740 1 Processor -- start 2024-09-19T09:04:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.369+0000 7f1911200740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e180ff39a0 0x55e181002240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.369+0000 7f1911200740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e180ff42e0 0x55e181002780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.369+0000 7f1911200740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e180ff9370 0x55e181003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.369+0000 7f1911200740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f19081a9fc0 con 0x55e180ff9370 2024-09-19T09:04:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.369+0000 7f1911200740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f19081ab430 con 0x55e180ff39a0 2024-09-19T09:04:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.369+0000 7f1911200740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f19081aa690 con 0x55e180ff42e0 2024-09-19T09:04:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.369+0000 7f1911200740 10 client.0 _ll_register_callbacks cb 0x7f18f800da30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.369+0000 7f190ca02640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e180ff9370 0x55e181003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.369+0000 7f190ca02640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e180ff9370 0x55e181003720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54780/0 (socket says 172.21.15.92:54780) 2024-09-19T09:04:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.369+0000 7f190ca02640 1 -- 172.21.15.92:0/3593901142 learned_addr learned my addr 172.21.15.92:0/3593901142 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.369+0000 7f1907fff640 1 --2- 172.21.15.92:0/3593901142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e180ff39a0 0x55e181002240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.369+0000 7f19077fe640 1 --2- 172.21.15.92:0/3593901142 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e180ff42e0 0x55e181002780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.369+0000 7f190ca02640 1 -- 172.21.15.92:0/3593901142 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e180ff42e0 msgr2=0x55e181002780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.369+0000 7f190ca02640 1 --2- 172.21.15.92:0/3593901142 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e180ff42e0 0x55e181002780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.369+0000 7f190ca02640 1 -- 172.21.15.92:0/3593901142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e180ff39a0 msgr2=0x55e181002240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.369+0000 7f190ca02640 1 --2- 172.21.15.92:0/3593901142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e180ff39a0 0x55e181002240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.369+0000 7f190ca02640 1 -- 172.21.15.92:0/3593901142 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e181003d30 con 0x55e180ff9370 2024-09-19T09:04:00.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.369+0000 7f19077fe640 1 --2- 172.21.15.92:0/3593901142 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e180ff42e0 0x55e181002780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:00.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.369+0000 7f190ca02640 1 --2- 172.21.15.92:0/3593901142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e180ff9370 0x55e181003720 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f18f800fa80 tx=0x7f18f800d5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4044460e0396b291 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:00.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.369+0000 7f18e77fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:04:00.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.369+0000 7f18e77fe640 1 -- 172.21.15.92:0/3593901142 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f801dd50 con 0x55e180ff9370 2024-09-19T09:04:00.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.369+0000 7f18e77fe640 1 -- 172.21.15.92:0/3593901142 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f18f80273f0 con 0x55e180ff9370 2024-09-19T09:04:00.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.369+0000 7f1911200740 1 -- 172.21.15.92:0/3593901142 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18fc0c53a0 con 0x55e180ff9370 2024-09-19T09:04:00.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.369+0000 7f18e77fe640 1 -- 172.21.15.92:0/3593901142 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f18f80275f0 con 0x55e180ff9370 2024-09-19T09:04:00.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.369+0000 7f1911200740 10 client.17067 fetch_fsmap learned FSMap version 19 2024-09-19T09:04:00.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.370+0000 7f1911200740 1 -- 172.21.15.92:0/3593901142 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e1810050b0 con 0x55e180ff9370 2024-09-19T09:04:00.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.370+0000 7f18e77fe640 1 -- 172.21.15.92:0/3593901142 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18fc0c53a0 con 0x55e180ff9370 2024-09-19T09:04:00.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.370+0000 7f18e77fe640 1 -- 172.21.15.92:0/3593901142 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f18f8030050 con 0x55e180ff9370 2024-09-19T09:04:00.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.370+0000 7f1911200740 10 client.17067 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:04:00.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.370+0000 7f1911200740 10 client.17067 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:04:00.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.370+0000 7f1911200740 20 client.17067 populate_metadata read hostname 'smithi092' 2024-09-19T09:04:00.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.370+0000 7f1911200740 1 --2- 172.21.15.92:0/3593901142 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e181074740 0x55e181076b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:00.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.370+0000 7f1911200740 4 client.17067 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:04:00.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.370+0000 7f1911200740 1 -- 172.21.15.92:0/3593901142 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e180f5ed70 con 0x55e181074740 2024-09-19T09:04:00.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.370+0000 7f1907fff640 1 --2- 172.21.15.92:0/3593901142 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e181074740 0x55e181076b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:00.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.371+0000 7f18e77fe640 10 client.17067 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:00.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.371+0000 7f1907fff640 1 --2- 172.21.15.92:0/3593901142 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e181074740 0x55e181076b60 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e8f04262477580a server_cookie=e390835d3b024b71 in_seq=0 out_seq=0 2024-09-19T09:04:00.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.386+0000 7f18e77fe640 1 -- 172.21.15.92:0/3593901142 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e180f5ed70 con 0x55e181074740 2024-09-19T09:04:00.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.386+0000 7f18e77fe640 10 client.17067 handle_command_reply: tid=0 2024-09-19T09:04:00.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.386+0000 7f1911200740 1 client.17067 shutdown 2024-09-19T09:04:00.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.386+0000 7f1911200740 1 -- 172.21.15.92:0/3593901142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e180ff9370 msgr2=0x55e181003720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:00.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.386+0000 7f1911200740 1 --2- 172.21.15.92:0/3593901142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e180ff9370 0x55e181003720 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f18f800fa80 tx=0x7f18f800d5a0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.386+0000 7f1911200740 1 -- 172.21.15.92:0/3593901142 shutdown_connections 2024-09-19T09:04:00.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.386+0000 7f1911200740 1 --2- 172.21.15.92:0/3593901142 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e181074740 0x55e181076b60 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.386+0000 7f1911200740 1 --2- 172.21.15.92:0/3593901142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e180ff9370 0x55e181003720 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.386+0000 7f1911200740 1 --2- 172.21.15.92:0/3593901142 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e180ff42e0 0x55e181002780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.386+0000 7f18e77fe640 0 client.17067 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:00.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.386+0000 7f1911200740 1 --2- 172.21.15.92:0/3593901142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e180ff39a0 0x55e181002240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.386+0000 7f1911200740 1 -- 172.21.15.92:0/3593901142 >> 172.21.15.92:0/3593901142 conn(0x55e180fef010 msgr2=0x55e180ff86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:00.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.386+0000 7f1911200740 1 -- 172.21.15.92:0/3593901142 shutdown_connections 2024-09-19T09:04:00.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.386+0000 7f1911200740 1 -- 172.21.15.92:0/3593901142 wait complete. 2024-09-19T09:04:00.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.386+0000 7f1911200740 20 client.17067 trim_cache size 0 max 16384 2024-09-19T09:04:00.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:04:00.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:04:00.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:04:00.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:04:00.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.387+0000 7f190e465640 1 -- 172.21.15.92:0/1045505663 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f18f00a32f0 msgr2=0x7f18f00a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:00.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.387+0000 7f190e465640 1 --2- 172.21.15.92:0/1045505663 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f18f00a32f0 0x7f18f00a57b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f18f80127d0 tx=0x7f18f8005b00 comp rx=0 tx=0).stop 2024-09-19T09:04:00.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.387+0000 7f190e465640 1 -- 172.21.15.92:0/1045505663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1908100d10 msgr2=0x7f190819a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:00.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.387+0000 7f190e465640 1 --2- 172.21.15.92:0/1045505663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1908100d10 0x7f190819a5f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f18fc009230 tx=0x7f18fc004430 comp rx=0 tx=0).stop 2024-09-19T09:04:00.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.387+0000 7f190e465640 1 -- 172.21.15.92:0/1045505663 shutdown_connections 2024-09-19T09:04:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.387+0000 7f190e465640 1 --2- 172.21.15.92:0/1045505663 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19081016b0 0x7f19081a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.387+0000 7f190e465640 1 --2- 172.21.15.92:0/1045505663 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f18f00a32f0 0x7f18f00a57b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.387+0000 7f190e465640 1 --2- 172.21.15.92:0/1045505663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1908100d10 0x7f190819a5f0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.387+0000 7f190e465640 1 --2- 172.21.15.92:0/1045505663 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19081003d0 0x7f190819a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.387+0000 7f190e465640 1 -- 172.21.15.92:0/1045505663 >> 172.21.15.92:0/1045505663 conn(0x7f19080fc1e0 msgr2=0x7f19080fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.387+0000 7f190e465640 1 -- 172.21.15.92:0/1045505663 shutdown_connections 2024-09-19T09:04:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:00.387+0000 7f190e465640 1 -- 172.21.15.92:0/1045505663 wait complete. 2024-09-19T09:04:00.799 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:04:01.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:01 smithi092 ceph-mon[31407]: pgmap v556: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.5 MiB/s wr, 237 op/s 2024-09-19T09:04:01.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:01 smithi167 ceph-mon[35359]: pgmap v556: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.5 MiB/s wr, 237 op/s 2024-09-19T09:04:01.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:01 smithi190 ceph-mon[35358]: pgmap v556: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.5 MiB/s wr, 237 op/s 2024-09-19T09:04:03.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:03 smithi167 ceph-mon[35359]: pgmap v557: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.6 MiB/s wr, 112 op/s 2024-09-19T09:04:03.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:03 smithi190 ceph-mon[35358]: pgmap v557: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.6 MiB/s wr, 112 op/s 2024-09-19T09:04:04.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:03 smithi092 ceph-mon[31407]: pgmap v557: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.6 MiB/s wr, 112 op/s 2024-09-19T09:04:05.799 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:04:05.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:05 smithi167 ceph-mon[35359]: pgmap v558: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.2 MiB/s wr, 65 op/s 2024-09-19T09:04:05.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:05 smithi190 ceph-mon[35358]: pgmap v558: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.2 MiB/s wr, 65 op/s 2024-09-19T09:04:06.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:05 smithi092 ceph-mon[31407]: pgmap v558: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.2 MiB/s wr, 65 op/s 2024-09-19T09:04:06.130 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:04:06.400 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:06.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.861+0000 7feb636c4640 1 -- 172.21.15.92:0/3719937785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb5c102b50 msgr2=0x7feb5c100090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:06.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.861+0000 7feb636c4640 1 --2- 172.21.15.92:0/3719937785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb5c102b50 0x7feb5c100090 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7feb58009900 tx=0x7feb5802a400 comp rx=0 tx=0).stop 2024-09-19T09:04:06.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.862+0000 7feb636c4640 1 -- 172.21.15.92:0/3719937785 shutdown_connections 2024-09-19T09:04:06.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.862+0000 7feb636c4640 1 --2- 172.21.15.92:0/3719937785 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb5c10e810 0x7feb5c110c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.862+0000 7feb636c4640 1 --2- 172.21.15.92:0/3719937785 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb5c102fc0 0x7feb5c1005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.862+0000 7feb636c4640 1 --2- 172.21.15.92:0/3719937785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb5c102b50 0x7feb5c100090 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.862+0000 7feb636c4640 1 -- 172.21.15.92:0/3719937785 >> 172.21.15.92:0/3719937785 conn(0x7feb5c077210 msgr2=0x7feb5c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:06.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.862+0000 7feb636c4640 1 -- 172.21.15.92:0/3719937785 shutdown_connections 2024-09-19T09:04:06.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.862+0000 7feb636c4640 1 -- 172.21.15.92:0/3719937785 wait complete. 2024-09-19T09:04:06.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.862+0000 7feb636c4640 1 Processor -- start 2024-09-19T09:04:06.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.862+0000 7feb636c4640 1 -- start start 2024-09-19T09:04:06.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.862+0000 7feb636c4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb5c102b50 0x7feb5c1a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:06.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.862+0000 7feb636c4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb5c10e810 0x7feb5c1a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:06.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.863+0000 7feb636c4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb5c19a5c0 0x7feb5c19aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:06.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.863+0000 7feb636c4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7feb5c114290 con 0x7feb5c102b50 2024-09-19T09:04:06.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.863+0000 7feb636c4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7feb5c114110 con 0x7feb5c10e810 2024-09-19T09:04:06.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.863+0000 7feb636c4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7feb5c114410 con 0x7feb5c19a5c0 2024-09-19T09:04:06.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.863+0000 7feb61460640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb5c102b50 0x7feb5c1a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:06.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.863+0000 7feb61460640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb5c102b50 0x7feb5c1a0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34554/0 (socket says 172.21.15.92:34554) 2024-09-19T09:04:06.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.863+0000 7feb61460640 1 -- 172.21.15.92:0/2820907193 learned_addr learned my addr 172.21.15.92:0/2820907193 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:06.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.863+0000 7feb60c5f640 1 --2- 172.21.15.92:0/2820907193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb5c10e810 0x7feb5c1a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:06.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.863+0000 7feb61c61640 1 --2- 172.21.15.92:0/2820907193 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb5c19a5c0 0x7feb5c19aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:06.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.863+0000 7feb61460640 1 -- 172.21.15.92:0/2820907193 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb5c19a5c0 msgr2=0x7feb5c19aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:06.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.863+0000 7feb61460640 1 --2- 172.21.15.92:0/2820907193 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb5c19a5c0 0x7feb5c19aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.863+0000 7feb61460640 1 -- 172.21.15.92:0/2820907193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb5c10e810 msgr2=0x7feb5c1a0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:06.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.863+0000 7feb61460640 1 --2- 172.21.15.92:0/2820907193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb5c10e810 0x7feb5c1a0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.863+0000 7feb61460640 1 -- 172.21.15.92:0/2820907193 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb5c19b0e0 con 0x7feb5c102b50 2024-09-19T09:04:06.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.863+0000 7feb61c61640 1 --2- 172.21.15.92:0/2820907193 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb5c19a5c0 0x7feb5c19aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:06.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.863+0000 7feb61460640 1 --2- 172.21.15.92:0/2820907193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb5c102b50 0x7feb5c1a0400 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7feb58005ab0 tx=0x7feb580042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:06.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.863+0000 7feb527fc640 1 -- 172.21.15.92:0/2820907193 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5803f030 con 0x7feb5c102b50 2024-09-19T09:04:06.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.863+0000 7feb527fc640 1 -- 172.21.15.92:0/2820907193 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb58003ce0 con 0x7feb5c102b50 2024-09-19T09:04:06.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.863+0000 7feb636c4640 1 -- 172.21.15.92:0/2820907193 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb5c19b370 con 0x7feb5c102b50 2024-09-19T09:04:06.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.863+0000 7feb527fc640 1 -- 172.21.15.92:0/2820907193 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb58035070 con 0x7feb5c102b50 2024-09-19T09:04:06.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.863+0000 7feb636c4640 1 -- 172.21.15.92:0/2820907193 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb5c1a7630 con 0x7feb5c102b50 2024-09-19T09:04:06.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.866+0000 7feb527fc640 1 -- 172.21.15.92:0/2820907193 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7feb58042030 con 0x7feb5c102b50 2024-09-19T09:04:06.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.866+0000 7feb65a9d740 1 Processor -- start 2024-09-19T09:04:06.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.866+0000 7feb65a9d740 1 -- start start 2024-09-19T09:04:06.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.866+0000 7feb65a9d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558f0e0654a0 0x558f0e065880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:06.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.866+0000 7feb65a9d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558f0e065dc0 0x558f0e070140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:06.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.866+0000 7feb65a9d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f0e070680 0x558f0e072a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:06.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.866+0000 7feb65a9d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558f0dfcb2e0 con 0x558f0e070680 2024-09-19T09:04:06.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.866+0000 7feb65a9d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558f0df72ce0 con 0x558f0e0654a0 2024-09-19T09:04:06.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.866+0000 7feb65a9d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x558f0dfc72a0 con 0x558f0e065dc0 2024-09-19T09:04:06.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.866+0000 7feb60c5f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f0e070680 0x558f0e072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.866+0000 7feb60c5f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f0e070680 0x558f0e072a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34568/0 (socket says 172.21.15.92:34568) 2024-09-19T09:04:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.866+0000 7feb60c5f640 1 -- 172.21.15.92:0/788159702 learned_addr learned my addr 172.21.15.92:0/788159702 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.867+0000 7feb527fc640 1 --2- 172.21.15.92:0/2820907193 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7feb480a32f0 0x7feb480a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.867+0000 7feb61c61640 1 --2- 172.21.15.92:0/788159702 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558f0e0654a0 0x558f0e065880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.867+0000 7feb61460640 1 --2- 172.21.15.92:0/788159702 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558f0e065dc0 0x558f0e070140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.867+0000 7feb61c61640 1 --2- 172.21.15.92:0/2820907193 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7feb480a32f0 0x7feb480a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.867+0000 7feb60c5f640 1 -- 172.21.15.92:0/788159702 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558f0e065dc0 msgr2=0x558f0e070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.867+0000 7feb60c5f640 1 --2- 172.21.15.92:0/788159702 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558f0e065dc0 0x558f0e070140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.867+0000 7feb60c5f640 1 -- 172.21.15.92:0/788159702 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558f0e0654a0 msgr2=0x558f0e065880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.867+0000 7feb527fc640 1 -- 172.21.15.92:0/2820907193 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7feb580efe80 con 0x7feb5c102b50 2024-09-19T09:04:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.867+0000 7feb60c5f640 1 --2- 172.21.15.92:0/788159702 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558f0e0654a0 0x558f0e065880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.867+0000 7feb60c5f640 1 -- 172.21.15.92:0/788159702 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f0df57440 con 0x558f0e070680 2024-09-19T09:04:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.867+0000 7feb61460640 1 --2- 172.21.15.92:0/788159702 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558f0e065dc0 0x558f0e070140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.867+0000 7feb60c5f640 1 --2- 172.21.15.92:0/788159702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f0e070680 0x558f0e072a70 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7feb4c00b760 tx=0x7feb4c00bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd1f90b1f22e4c59 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.867+0000 7feb61c61640 1 --2- 172.21.15.92:0/2820907193 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7feb480a32f0 0x7feb480a57b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7feb54009fd0 tx=0x7feb54008220 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.867+0000 7feb477fe640 1 -- 172.21.15.92:0/788159702 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4c00d950 con 0x558f0e070680 2024-09-19T09:04:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.867+0000 7feb477fe640 1 -- 172.21.15.92:0/788159702 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb4c019070 con 0x558f0e070680 2024-09-19T09:04:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.867+0000 7feb477fe640 1 -- 172.21.15.92:0/788159702 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4c014e50 con 0x558f0e070680 2024-09-19T09:04:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.868+0000 7feb65a9d740 1 -- 172.21.15.92:0/788159702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f0e070680 msgr2=0x558f0e072a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.868+0000 7feb65a9d740 1 --2- 172.21.15.92:0/788159702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f0e070680 0x558f0e072a70 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7feb4c00b760 tx=0x7feb4c00bc20 comp rx=0 tx=0).stop 2024-09-19T09:04:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.868+0000 7feb65a9d740 1 -- 172.21.15.92:0/788159702 shutdown_connections 2024-09-19T09:04:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.868+0000 7feb65a9d740 1 --2- 172.21.15.92:0/788159702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f0e070680 0x558f0e072a70 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.868+0000 7feb65a9d740 1 --2- 172.21.15.92:0/788159702 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558f0e065dc0 0x558f0e070140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.868+0000 7feb65a9d740 1 --2- 172.21.15.92:0/788159702 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558f0e0654a0 0x558f0e065880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.868+0000 7feb65a9d740 1 -- 172.21.15.92:0/788159702 >> 172.21.15.92:0/788159702 conn(0x558f0e061a30 msgr2=0x558f0e061e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:06.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.868+0000 7feb65a9d740 1 -- 172.21.15.92:0/788159702 shutdown_connections 2024-09-19T09:04:06.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.868+0000 7feb65a9d740 1 -- 172.21.15.92:0/788159702 wait complete. 2024-09-19T09:04:06.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.868+0000 7feb65a9d740 1 -- start start 2024-09-19T09:04:06.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.868+0000 7feb65a9d740 1 Processor -- start 2024-09-19T09:04:06.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.869+0000 7feb65a9d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f0e0654a0 0x558f0e06feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:06.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.869+0000 7feb65a9d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558f0e065dc0 0x558f0e06d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:06.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.869+0000 7feb65a9d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558f0e070680 0x558f0e06d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:06.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.869+0000 7feb65a9d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558f0e073250 con 0x558f0e0654a0 2024-09-19T09:04:06.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.869+0000 7feb65a9d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558f0df86050 con 0x558f0e065dc0 2024-09-19T09:04:06.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.869+0000 7feb65a9d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x558f0e0733d0 con 0x558f0e070680 2024-09-19T09:04:06.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.869+0000 7feb65a9d740 10 client.0 _ll_register_callbacks cb 0x558f0dfc6160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:06.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.869+0000 7feb61460640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f0e0654a0 0x558f0e06feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:06.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.869+0000 7feb61460640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f0e0654a0 0x558f0e06feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34584/0 (socket says 172.21.15.92:34584) 2024-09-19T09:04:06.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.869+0000 7feb61460640 1 -- 172.21.15.92:0/2227411795 learned_addr learned my addr 172.21.15.92:0/2227411795 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:06.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.869+0000 7feb61c61640 1 --2- 172.21.15.92:0/2227411795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558f0e070680 0x558f0e06d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:06.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.869+0000 7feb60c5f640 1 --2- 172.21.15.92:0/2227411795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558f0e065dc0 0x558f0e06d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:06.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.869+0000 7feb61460640 1 -- 172.21.15.92:0/2227411795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558f0e070680 msgr2=0x558f0e06d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:06.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.869+0000 7feb61460640 1 --2- 172.21.15.92:0/2227411795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558f0e070680 0x558f0e06d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.869+0000 7feb61460640 1 -- 172.21.15.92:0/2227411795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558f0e065dc0 msgr2=0x558f0e06d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:06.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.869+0000 7feb61460640 1 --2- 172.21.15.92:0/2227411795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558f0e065dc0 0x558f0e06d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.869+0000 7feb61460640 1 -- 172.21.15.92:0/2227411795 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f0dd3c3c0 con 0x558f0e0654a0 2024-09-19T09:04:06.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.869+0000 7feb60c5f640 1 --2- 172.21.15.92:0/2227411795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558f0e065dc0 0x558f0e06d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:06.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.869+0000 7feb61460640 1 --2- 172.21.15.92:0/2227411795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f0e0654a0 0x558f0e06feb0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7feb580bc160 tx=0x7feb580045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=142d0f3563cf1c50 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:06.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.869+0000 7feb44ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:04:06.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.869+0000 7feb44ff9640 1 -- 172.21.15.92:0/2227411795 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb580bbdc0 con 0x558f0e0654a0 2024-09-19T09:04:06.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.870+0000 7feb44ff9640 1 -- 172.21.15.92:0/2227411795 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7feb5803bd30 con 0x558f0e0654a0 2024-09-19T09:04:06.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.870+0000 7feb65a9d740 1 -- 172.21.15.92:0/2227411795 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb4c019070 con 0x558f0e0654a0 2024-09-19T09:04:06.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.870+0000 7feb44ff9640 1 -- 172.21.15.92:0/2227411795 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7feb58049030 con 0x558f0e0654a0 2024-09-19T09:04:06.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.870+0000 7feb65a9d740 10 client.17079 fetch_fsmap learned FSMap version 19 2024-09-19T09:04:06.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.870+0000 7feb65a9d740 1 -- 172.21.15.92:0/2227411795 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x558f0e07eaa0 con 0x558f0e0654a0 2024-09-19T09:04:06.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.870+0000 7feb44ff9640 1 -- 172.21.15.92:0/2227411795 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb4c019070 con 0x558f0e0654a0 2024-09-19T09:04:06.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.870+0000 7feb44ff9640 1 -- 172.21.15.92:0/2227411795 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7feb58003800 con 0x558f0e0654a0 2024-09-19T09:04:06.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.870+0000 7feb65a9d740 10 client.17079 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:04:06.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.870+0000 7feb65a9d740 10 client.17079 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:04:06.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.870+0000 7feb65a9d740 20 client.17079 populate_metadata read hostname 'smithi092' 2024-09-19T09:04:06.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.870+0000 7feb65a9d740 1 --2- 172.21.15.92:0/2227411795 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558f0e07ffe0 0x558f0e082470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:06.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.870+0000 7feb65a9d740 4 client.17079 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:06.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.870+0000 7feb65a9d740 1 -- 172.21.15.92:0/2227411795 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558f0dfd8850 con 0x558f0e07ffe0 2024-09-19T09:04:06.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.870+0000 7feb60c5f640 1 --2- 172.21.15.92:0/2227411795 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558f0e07ffe0 0x558f0e082470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:06.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.871+0000 7feb60c5f640 1 --2- 172.21.15.92:0/2227411795 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558f0e07ffe0 0x558f0e082470 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cba3c803acf455 server_cookie=4521faef5f3c2398 in_seq=0 out_seq=0 2024-09-19T09:04:06.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.871+0000 7feb44ff9640 10 client.17079 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:06.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.871+0000 7feb44ff9640 1 -- 172.21.15.92:0/2227411795 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558f0dfd8850 con 0x558f0e07ffe0 2024-09-19T09:04:06.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.871+0000 7feb44ff9640 10 client.17079 handle_command_reply: tid=0 2024-09-19T09:04:06.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.871+0000 7feb65a9d740 1 client.17079 shutdown 2024-09-19T09:04:06.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.872+0000 7feb65a9d740 1 -- 172.21.15.92:0/2227411795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f0e0654a0 msgr2=0x558f0e06feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:06.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.872+0000 7feb65a9d740 1 --2- 172.21.15.92:0/2227411795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f0e0654a0 0x558f0e06feb0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7feb580bc160 tx=0x7feb580045e0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.872+0000 7feb65a9d740 1 -- 172.21.15.92:0/2227411795 shutdown_connections 2024-09-19T09:04:06.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.872+0000 7feb65a9d740 1 --2- 172.21.15.92:0/2227411795 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558f0e07ffe0 0x558f0e082470 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.872+0000 7feb65a9d740 1 --2- 172.21.15.92:0/2227411795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558f0e070680 0x558f0e06d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.872+0000 7feb65a9d740 1 --2- 172.21.15.92:0/2227411795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558f0e065dc0 0x558f0e06d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.872+0000 7feb44ff9640 0 client.17079 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.872+0000 7feb65a9d740 1 --2- 172.21.15.92:0/2227411795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f0e0654a0 0x558f0e06feb0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.872+0000 7feb65a9d740 1 -- 172.21.15.92:0/2227411795 >> 172.21.15.92:0/2227411795 conn(0x558f0e061a30 msgr2=0x558f0e067710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.872+0000 7feb65a9d740 1 -- 172.21.15.92:0/2227411795 shutdown_connections 2024-09-19T09:04:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.872+0000 7feb65a9d740 1 -- 172.21.15.92:0/2227411795 wait complete. 2024-09-19T09:04:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.872+0000 7feb65a9d740 20 client.17079 trim_cache size 0 max 16384 2024-09-19T09:04:06.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.889+0000 7feb65a9d740 1 Processor -- start 2024-09-19T09:04:06.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.889+0000 7feb65a9d740 1 -- start start 2024-09-19T09:04:06.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.889+0000 7feb65a9d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f0e061a30 0x558f0e087cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:06.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.889+0000 7feb65a9d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558f0e0654a0 0x558f0e088230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:06.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.889+0000 7feb65a9d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558f0e065dc0 0x558f0e06a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:06.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.889+0000 7feb65a9d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7feb5c1ad7e0 con 0x558f0e061a30 2024-09-19T09:04:06.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.889+0000 7feb65a9d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7feb5c1b0080 con 0x558f0e065dc0 2024-09-19T09:04:06.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.889+0000 7feb65a9d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7feb5c1ade70 con 0x558f0e0654a0 2024-09-19T09:04:06.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.889+0000 7feb61460640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f0e061a30 0x558f0e087cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:06.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.889+0000 7feb61460640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f0e061a30 0x558f0e087cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34600/0 (socket says 172.21.15.92:34600) 2024-09-19T09:04:06.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.889+0000 7feb61460640 1 -- 172.21.15.92:0/4020218970 learned_addr learned my addr 172.21.15.92:0/4020218970 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:06.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.889+0000 7feb61c61640 1 --2- 172.21.15.92:0/4020218970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558f0e065dc0 0x558f0e06a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:06.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.889+0000 7feb61460640 1 -- 172.21.15.92:0/4020218970 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558f0e0654a0 msgr2=0x558f0e088230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:06.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.889+0000 7feb60c5f640 1 --2- 172.21.15.92:0/4020218970 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558f0e0654a0 0x558f0e088230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:06.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.889+0000 7feb61460640 1 --2- 172.21.15.92:0/4020218970 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558f0e0654a0 0x558f0e088230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.889+0000 7feb61460640 1 -- 172.21.15.92:0/4020218970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558f0e065dc0 msgr2=0x558f0e06a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:06.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.889+0000 7feb61460640 1 --2- 172.21.15.92:0/4020218970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558f0e065dc0 0x558f0e06a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.889+0000 7feb61460640 1 -- 172.21.15.92:0/4020218970 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f0e061860 con 0x558f0e061a30 2024-09-19T09:04:06.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.889+0000 7feb61460640 1 --2- 172.21.15.92:0/4020218970 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f0e061a30 0x558f0e087cf0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7feb58005ec0 tx=0x7feb580b7fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29d6ce1b839054aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:06.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.890+0000 7feb46ffd640 1 -- 172.21.15.92:0/4020218970 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb580bcb60 con 0x558f0e061a30 2024-09-19T09:04:06.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.890+0000 7feb46ffd640 1 -- 172.21.15.92:0/4020218970 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb580bc460 con 0x558f0e061a30 2024-09-19T09:04:06.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.890+0000 7feb46ffd640 1 -- 172.21.15.92:0/4020218970 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb58003800 con 0x558f0e061a30 2024-09-19T09:04:06.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.890+0000 7feb65a9d740 1 -- 172.21.15.92:0/4020218970 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f0e061a30 msgr2=0x558f0e087cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:06.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.890+0000 7feb65a9d740 1 --2- 172.21.15.92:0/4020218970 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f0e061a30 0x558f0e087cf0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7feb58005ec0 tx=0x7feb580b7fe0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.890+0000 7feb65a9d740 1 -- 172.21.15.92:0/4020218970 shutdown_connections 2024-09-19T09:04:06.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.890+0000 7feb65a9d740 1 --2- 172.21.15.92:0/4020218970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558f0e065dc0 0x558f0e06a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.890+0000 7feb65a9d740 1 --2- 172.21.15.92:0/4020218970 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558f0e0654a0 0x558f0e088230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.890+0000 7feb65a9d740 1 --2- 172.21.15.92:0/4020218970 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f0e061a30 0x558f0e087cf0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.890+0000 7feb65a9d740 1 -- 172.21.15.92:0/4020218970 >> 172.21.15.92:0/4020218970 conn(0x558f0e06d800 msgr2=0x558f0e06ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:06.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.890+0000 7feb65a9d740 1 -- 172.21.15.92:0/4020218970 shutdown_connections 2024-09-19T09:04:06.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.890+0000 7feb65a9d740 1 -- 172.21.15.92:0/4020218970 wait complete. 2024-09-19T09:04:06.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.891+0000 7feb65a9d740 1 -- start start 2024-09-19T09:04:06.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.891+0000 7feb65a9d740 1 Processor -- start 2024-09-19T09:04:06.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.891+0000 7feb65a9d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f0e061a30 0x558f0e06a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:06.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.891+0000 7feb65a9d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558f0e0654a0 0x558f0e06a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:06.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.891+0000 7feb65a9d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558f0e065dc0 0x558f0e06ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:06.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.891+0000 7feb65a9d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7feb5c1ae540 con 0x558f0e061a30 2024-09-19T09:04:06.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.891+0000 7feb65a9d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7feb5c1af9b0 con 0x558f0e065dc0 2024-09-19T09:04:06.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.891+0000 7feb65a9d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7feb5c1aec10 con 0x558f0e0654a0 2024-09-19T09:04:06.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.891+0000 7feb65a9d740 10 client.0 _ll_register_callbacks cb 0x7feb58005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:06.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.891+0000 7feb61460640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f0e061a30 0x558f0e06a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:06.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.891+0000 7feb61460640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f0e061a30 0x558f0e06a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34604/0 (socket says 172.21.15.92:34604) 2024-09-19T09:04:06.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.891+0000 7feb61460640 1 -- 172.21.15.92:0/1738980894 learned_addr learned my addr 172.21.15.92:0/1738980894 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:06.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.891+0000 7feb61c61640 1 --2- 172.21.15.92:0/1738980894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558f0e065dc0 0x558f0e06ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:06.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.892+0000 7feb60c5f640 1 --2- 172.21.15.92:0/1738980894 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558f0e0654a0 0x558f0e06a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:06.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.892+0000 7feb61460640 1 -- 172.21.15.92:0/1738980894 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558f0e0654a0 msgr2=0x558f0e06a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:06.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.892+0000 7feb61460640 1 --2- 172.21.15.92:0/1738980894 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558f0e0654a0 0x558f0e06a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.892+0000 7feb61460640 1 -- 172.21.15.92:0/1738980894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558f0e065dc0 msgr2=0x558f0e06ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:06.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.892+0000 7feb61460640 1 --2- 172.21.15.92:0/1738980894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558f0e065dc0 0x558f0e06ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.892+0000 7feb61460640 1 -- 172.21.15.92:0/1738980894 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f0e076f60 con 0x558f0e061a30 2024-09-19T09:04:06.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.892+0000 7feb61460640 1 --2- 172.21.15.92:0/1738980894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f0e061a30 0x558f0e06a2e0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7feb580b8e30 tx=0x7feb5802a400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d72985e8718a1be6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:06.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.892+0000 7feb44ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:04:06.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.892+0000 7feb44ff9640 1 -- 172.21.15.92:0/1738980894 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb580bcb60 con 0x558f0e061a30 2024-09-19T09:04:06.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.892+0000 7feb44ff9640 1 -- 172.21.15.92:0/1738980894 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7feb580ede00 con 0x558f0e061a30 2024-09-19T09:04:06.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.892+0000 7feb65a9d740 1 -- 172.21.15.92:0/1738980894 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb580bc460 con 0x558f0e061a30 2024-09-19T09:04:06.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.892+0000 7feb44ff9640 1 -- 172.21.15.92:0/1738980894 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7feb580c50d0 con 0x558f0e061a30 2024-09-19T09:04:06.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.892+0000 7feb65a9d740 10 client.17085 fetch_fsmap learned FSMap version 19 2024-09-19T09:04:06.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.892+0000 7feb65a9d740 1 -- 172.21.15.92:0/1738980894 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x558f0e076f60 con 0x558f0e061a30 2024-09-19T09:04:06.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.892+0000 7feb44ff9640 1 -- 172.21.15.92:0/1738980894 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb580bc460 con 0x558f0e061a30 2024-09-19T09:04:06.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.893+0000 7feb44ff9640 1 -- 172.21.15.92:0/1738980894 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7feb58031ca0 con 0x558f0e061a30 2024-09-19T09:04:06.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.893+0000 7feb65a9d740 10 client.17085 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:04:06.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.893+0000 7feb65a9d740 10 client.17085 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:04:06.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.893+0000 7feb65a9d740 20 client.17085 populate_metadata read hostname 'smithi092' 2024-09-19T09:04:06.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.893+0000 7feb65a9d740 1 --2- 172.21.15.92:0/1738980894 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558f0e070680 0x558f0e0ed410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:06.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.893+0000 7feb65a9d740 4 client.17085 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:04:06.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.893+0000 7feb65a9d740 1 -- 172.21.15.92:0/1738980894 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558f0dfd2d60 con 0x558f0e070680 2024-09-19T09:04:06.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.893+0000 7feb60c5f640 1 --2- 172.21.15.92:0/1738980894 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558f0e070680 0x558f0e0ed410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:06.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.893+0000 7feb44ff9640 10 client.17085 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:06.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.893+0000 7feb60c5f640 1 --2- 172.21.15.92:0/1738980894 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558f0e070680 0x558f0e0ed410 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6b792e6c13f7463 server_cookie=a4eb526897340210 in_seq=0 out_seq=0 2024-09-19T09:04:06.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.894+0000 7feb44ff9640 1 -- 172.21.15.92:0/1738980894 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x558f0dfd2d60 con 0x558f0e070680 2024-09-19T09:04:06.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.894+0000 7feb44ff9640 10 client.17085 handle_command_reply: tid=0 2024-09-19T09:04:06.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.894+0000 7feb65a9d740 1 client.17085 shutdown 2024-09-19T09:04:06.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.894+0000 7feb65a9d740 1 -- 172.21.15.92:0/1738980894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f0e061a30 msgr2=0x558f0e06a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:06.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.894+0000 7feb65a9d740 1 --2- 172.21.15.92:0/1738980894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f0e061a30 0x558f0e06a2e0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7feb580b8e30 tx=0x7feb5802a400 comp rx=0 tx=0).stop 2024-09-19T09:04:06.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.894+0000 7feb65a9d740 1 -- 172.21.15.92:0/1738980894 shutdown_connections 2024-09-19T09:04:06.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.894+0000 7feb65a9d740 1 --2- 172.21.15.92:0/1738980894 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558f0e070680 0x558f0e0ed410 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.894+0000 7feb44ff9640 0 client.17085 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:06.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.894+0000 7feb65a9d740 1 --2- 172.21.15.92:0/1738980894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558f0e065dc0 0x558f0e06ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.894+0000 7feb65a9d740 1 --2- 172.21.15.92:0/1738980894 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558f0e0654a0 0x558f0e06a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.894+0000 7feb65a9d740 1 --2- 172.21.15.92:0/1738980894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f0e061a30 0x558f0e06a2e0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.894+0000 7feb65a9d740 1 -- 172.21.15.92:0/1738980894 >> 172.21.15.92:0/1738980894 conn(0x558f0e06d800 msgr2=0x558f0e06be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:06.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.894+0000 7feb65a9d740 1 -- 172.21.15.92:0/1738980894 shutdown_connections 2024-09-19T09:04:06.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.894+0000 7feb65a9d740 1 -- 172.21.15.92:0/1738980894 wait complete. 2024-09-19T09:04:06.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.894+0000 7feb65a9d740 20 client.17085 trim_cache size 0 max 16384 2024-09-19T09:04:06.902 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:04:06.902 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-19T09:04:06.902 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {} 2024-09-19T09:04:06.902 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:04:06.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.894+0000 7feb636c4640 1 -- 172.21.15.92:0/2820907193 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7feb480a32f0 msgr2=0x7feb480a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:06.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.894+0000 7feb636c4640 1 --2- 172.21.15.92:0/2820907193 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7feb480a32f0 0x7feb480a57b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7feb54009fd0 tx=0x7feb54008220 comp rx=0 tx=0).stop 2024-09-19T09:04:06.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.894+0000 7feb636c4640 1 -- 172.21.15.92:0/2820907193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb5c102b50 msgr2=0x7feb5c1a0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:06.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.894+0000 7feb636c4640 1 --2- 172.21.15.92:0/2820907193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb5c102b50 0x7feb5c1a0400 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7feb58005ab0 tx=0x7feb580042f0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.895+0000 7feb636c4640 1 -- 172.21.15.92:0/2820907193 shutdown_connections 2024-09-19T09:04:06.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.895+0000 7feb636c4640 1 --2- 172.21.15.92:0/2820907193 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb5c19a5c0 0x7feb5c19aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.895+0000 7feb636c4640 1 --2- 172.21.15.92:0/2820907193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb5c10e810 0x7feb5c1a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.895+0000 7feb636c4640 1 --2- 172.21.15.92:0/2820907193 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7feb480a32f0 0x7feb480a57b0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.895+0000 7feb636c4640 1 --2- 172.21.15.92:0/2820907193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb5c102b50 0x7feb5c1a0400 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.895+0000 7feb636c4640 1 -- 172.21.15.92:0/2820907193 >> 172.21.15.92:0/2820907193 conn(0x7feb5c077210 msgr2=0x7feb5c10fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:06.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.895+0000 7feb636c4640 1 -- 172.21.15.92:0/2820907193 shutdown_connections 2024-09-19T09:04:06.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:06.895+0000 7feb636c4640 1 -- 172.21.15.92:0/2820907193 wait complete. 2024-09-19T09:04:07.494 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:04:07.495 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:04:07.738 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:07.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:07 smithi092 ceph-mon[31407]: pgmap v559: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 718 KiB/s wr, 23 op/s 2024-09-19T09:04:07.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:07 smithi167 ceph-mon[35359]: pgmap v559: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 718 KiB/s wr, 23 op/s 2024-09-19T09:04:07.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:07 smithi190 ceph-mon[35358]: pgmap v559: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 718 KiB/s wr, 23 op/s 2024-09-19T09:04:08.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.166+0000 7f3c882d3640 1 -- 172.21.15.92:0/971435730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c80100a90 msgr2=0x7f3c80100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:08.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.166+0000 7f3c882d3640 1 --2- 172.21.15.92:0/971435730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c80100a90 0x7f3c80100ef0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f3c70009930 tx=0x7f3c7002a420 comp rx=0 tx=0).stop 2024-09-19T09:04:08.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.166+0000 7f3c882d3640 1 -- 172.21.15.92:0/971435730 shutdown_connections 2024-09-19T09:04:08.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.166+0000 7f3c882d3640 1 --2- 172.21.15.92:0/971435730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c80101430 0x7f3c8010d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.166+0000 7f3c882d3640 1 --2- 172.21.15.92:0/971435730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c80100a90 0x7f3c80100ef0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.166+0000 7f3c882d3640 1 --2- 172.21.15.92:0/971435730 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c80106a90 0x7f3c80106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.166+0000 7f3c882d3640 1 -- 172.21.15.92:0/971435730 >> 172.21.15.92:0/971435730 conn(0x7f3c800fc7d0 msgr2=0x7f3c800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:08.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.166+0000 7f3c882d3640 1 -- 172.21.15.92:0/971435730 shutdown_connections 2024-09-19T09:04:08.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.166+0000 7f3c882d3640 1 -- 172.21.15.92:0/971435730 wait complete. 2024-09-19T09:04:08.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.167+0000 7f3c882d3640 1 Processor -- start 2024-09-19T09:04:08.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.167+0000 7f3c882d3640 1 -- start start 2024-09-19T09:04:08.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.167+0000 7f3c882d3640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c80100a90 0x7f3c80198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.167+0000 7f3c882d3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c80101430 0x7f3c801989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.167+0000 7f3c882d3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c80106a90 0x7f3c8019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.167+0000 7f3c882d3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3c80111fb0 con 0x7f3c80106a90 2024-09-19T09:04:08.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.167+0000 7f3c882d3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3c80111e30 con 0x7f3c80101430 2024-09-19T09:04:08.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.167+0000 7f3c882d3640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3c80112130 con 0x7f3c80100a90 2024-09-19T09:04:08.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.168+0000 7f3c86870640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c80106a90 0x7f3c8019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.168+0000 7f3c86870640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c80106a90 0x7f3c8019cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34626/0 (socket says 172.21.15.92:34626) 2024-09-19T09:04:08.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.168+0000 7f3c86870640 1 -- 172.21.15.92:0/6038694 learned_addr learned my addr 172.21.15.92:0/6038694 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:08.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.168+0000 7f3c8586e640 1 --2- 172.21.15.92:0/6038694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c80101430 0x7f3c801989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.168+0000 7f3c8606f640 1 --2- 172.21.15.92:0/6038694 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c80100a90 0x7f3c80198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.168+0000 7f3c86870640 1 -- 172.21.15.92:0/6038694 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c80100a90 msgr2=0x7f3c80198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:08.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.168+0000 7f3c86870640 1 --2- 172.21.15.92:0/6038694 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c80100a90 0x7f3c80198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.168+0000 7f3c86870640 1 -- 172.21.15.92:0/6038694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c80101430 msgr2=0x7f3c801989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:08.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.168+0000 7f3c86870640 1 --2- 172.21.15.92:0/6038694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c80101430 0x7f3c801989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.168+0000 7f3c86870640 1 -- 172.21.15.92:0/6038694 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c8019d440 con 0x7f3c80106a90 2024-09-19T09:04:08.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.168+0000 7f3c86870640 1 --2- 172.21.15.92:0/6038694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c80106a90 0x7f3c8019cd60 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f3c7800eaa0 tx=0x7f3c7800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:08.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.168+0000 7f3c777fe640 1 -- 172.21.15.92:0/6038694 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c7800cdb0 con 0x7f3c80106a90 2024-09-19T09:04:08.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.168+0000 7f3c777fe640 1 -- 172.21.15.92:0/6038694 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c78005020 con 0x7f3c80106a90 2024-09-19T09:04:08.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.168+0000 7f3c882d3640 1 -- 172.21.15.92:0/6038694 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c8019d730 con 0x7f3c80106a90 2024-09-19T09:04:08.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.168+0000 7f3c777fe640 1 -- 172.21.15.92:0/6038694 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c780116b0 con 0x7f3c80106a90 2024-09-19T09:04:08.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.168+0000 7f3c882d3640 1 -- 172.21.15.92:0/6038694 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c801a5010 con 0x7f3c80106a90 2024-09-19T09:04:08.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.170+0000 7f3c882d3640 1 -- 172.21.15.92:0/6038694 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c80100ef0 con 0x7f3c80106a90 2024-09-19T09:04:08.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.171+0000 7f3c777fe640 1 -- 172.21.15.92:0/6038694 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3c78005560 con 0x7f3c80106a90 2024-09-19T09:04:08.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.171+0000 7f3c777fe640 1 --2- 172.21.15.92:0/6038694 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3c6c0a3240 0x7f3c6c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.171+0000 7f3c777fe640 1 -- 172.21.15.92:0/6038694 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3c780cfb90 con 0x7f3c80106a90 2024-09-19T09:04:08.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.172+0000 7f3c8606f640 1 --2- 172.21.15.92:0/6038694 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3c6c0a3240 0x7f3c6c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.172+0000 7f3c8606f640 1 --2- 172.21.15.92:0/6038694 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3c6c0a3240 0x7f3c6c0a5700 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c005fd0 tx=0x7f3c7c00b510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:08.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.176+0000 7f3c777fe640 1 -- 172.21.15.92:0/6038694 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3c78016030 con 0x7f3c80106a90 2024-09-19T09:04:08.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.386+0000 7f3c882d3640 1 -- 172.21.15.92:0/6038694 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3c80108a70 con 0x7f3c80106a90 2024-09-19T09:04:08.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.387+0000 7f3c777fe640 1 -- 172.21.15.92:0/6038694 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f3c7809c8b0 con 0x7f3c80106a90 2024-09-19T09:04:08.387 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:04:08.387 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:04:08.388 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:04:08.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.389+0000 7f3c882d3640 1 -- 172.21.15.92:0/6038694 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3c6c0a3240 msgr2=0x7f3c6c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:08.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.389+0000 7f3c882d3640 1 --2- 172.21.15.92:0/6038694 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3c6c0a3240 0x7f3c6c0a5700 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c005fd0 tx=0x7f3c7c00b510 comp rx=0 tx=0).stop 2024-09-19T09:04:08.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.389+0000 7f3c882d3640 1 -- 172.21.15.92:0/6038694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c80106a90 msgr2=0x7f3c8019cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:08.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.389+0000 7f3c882d3640 1 --2- 172.21.15.92:0/6038694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c80106a90 0x7f3c8019cd60 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f3c7800eaa0 tx=0x7f3c7800ef60 comp rx=0 tx=0).stop 2024-09-19T09:04:08.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.389+0000 7f3c882d3640 1 -- 172.21.15.92:0/6038694 shutdown_connections 2024-09-19T09:04:08.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.389+0000 7f3c882d3640 1 --2- 172.21.15.92:0/6038694 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3c6c0a3240 0x7f3c6c0a5700 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.389+0000 7f3c882d3640 1 --2- 172.21.15.92:0/6038694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c80106a90 0x7f3c8019cd60 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.389+0000 7f3c882d3640 1 --2- 172.21.15.92:0/6038694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c80101430 0x7f3c801989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.389+0000 7f3c882d3640 1 --2- 172.21.15.92:0/6038694 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c80100a90 0x7f3c80198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.389+0000 7f3c882d3640 1 -- 172.21.15.92:0/6038694 >> 172.21.15.92:0/6038694 conn(0x7f3c800fc7d0 msgr2=0x7f3c800fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:08.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.389+0000 7f3c882d3640 1 -- 172.21.15.92:0/6038694 shutdown_connections 2024-09-19T09:04:08.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:08.389+0000 7f3c882d3640 1 -- 172.21.15.92:0/6038694 wait complete. 2024-09-19T09:04:08.683 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:08 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/6038694' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:08.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:08 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/6038694' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:08.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:08 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/6038694' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:09.019 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:04:09.270 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:09.661 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:09 smithi092 ceph-mon[31407]: pgmap v560: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 715 KiB/s wr, 23 op/s 2024-09-19T09:04:09.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.743+0000 7fe4307c5640 1 -- 172.21.15.92:0/2090213711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe428106a80 msgr2=0x7fe428106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:09.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.743+0000 7fe4307c5640 1 --2- 172.21.15.92:0/2090213711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe428106a80 0x7fe428106e60 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fe424009930 tx=0x7fe42402a420 comp rx=0 tx=0).stop 2024-09-19T09:04:09.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.743+0000 7fe4307c5640 1 -- 172.21.15.92:0/2090213711 shutdown_connections 2024-09-19T09:04:09.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.743+0000 7fe4307c5640 1 --2- 172.21.15.92:0/2090213711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe428101420 0x7fe42810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.743+0000 7fe4307c5640 1 --2- 172.21.15.92:0/2090213711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe428100a80 0x7fe428100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.743+0000 7fe4307c5640 1 --2- 172.21.15.92:0/2090213711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe428106a80 0x7fe428106e60 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.743+0000 7fe4307c5640 1 -- 172.21.15.92:0/2090213711 >> 172.21.15.92:0/2090213711 conn(0x7fe4280fc7a0 msgr2=0x7fe4280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:09.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.743+0000 7fe4307c5640 1 -- 172.21.15.92:0/2090213711 shutdown_connections 2024-09-19T09:04:09.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.743+0000 7fe4307c5640 1 -- 172.21.15.92:0/2090213711 wait complete. 2024-09-19T09:04:09.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.744+0000 7fe4307c5640 1 Processor -- start 2024-09-19T09:04:09.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.744+0000 7fe4307c5640 1 -- start start 2024-09-19T09:04:09.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.744+0000 7fe4307c5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe428100a80 0x7fe428102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:09.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.744+0000 7fe4307c5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe428101420 0x7fe428102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:09.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.744+0000 7fe4307c5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe428106a80 0x7fe4281030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:09.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.744+0000 7fe4307c5640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe428110f20 con 0x7fe428106a80 2024-09-19T09:04:09.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.744+0000 7fe4307c5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe428110da0 con 0x7fe428101420 2024-09-19T09:04:09.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.744+0000 7fe4307c5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe4281110a0 con 0x7fe428100a80 2024-09-19T09:04:09.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.744+0000 7fe42ed62640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe428106a80 0x7fe4281030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:09.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.744+0000 7fe42ed62640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe428106a80 0x7fe4281030d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34646/0 (socket says 172.21.15.92:34646) 2024-09-19T09:04:09.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.744+0000 7fe42ed62640 1 -- 172.21.15.92:0/2721707502 learned_addr learned my addr 172.21.15.92:0/2721707502 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:09.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.744+0000 7fe42e561640 1 --2- 172.21.15.92:0/2721707502 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe428100a80 0x7fe428102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:09.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.745+0000 7fe42dd60640 1 --2- 172.21.15.92:0/2721707502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe428101420 0x7fe428102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:09.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.745+0000 7fe42ed62640 1 -- 172.21.15.92:0/2721707502 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe428100a80 msgr2=0x7fe428102650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:09.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.745+0000 7fe42ed62640 1 --2- 172.21.15.92:0/2721707502 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe428100a80 0x7fe428102650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.745+0000 7fe42ed62640 1 -- 172.21.15.92:0/2721707502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe428101420 msgr2=0x7fe428102b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:09.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.745+0000 7fe42ed62640 1 --2- 172.21.15.92:0/2721707502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe428101420 0x7fe428102b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.745+0000 7fe42ed62640 1 -- 172.21.15.92:0/2721707502 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4281a6a60 con 0x7fe428106a80 2024-09-19T09:04:09.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.745+0000 7fe42ed62640 1 --2- 172.21.15.92:0/2721707502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe428106a80 0x7fe4281030d0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fe42000b970 tx=0x7fe42000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:09.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.745+0000 7fe41f7fe640 1 -- 172.21.15.92:0/2721707502 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe420019070 con 0x7fe428106a80 2024-09-19T09:04:09.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.745+0000 7fe41f7fe640 1 -- 172.21.15.92:0/2721707502 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe420014440 con 0x7fe428106a80 2024-09-19T09:04:09.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.745+0000 7fe4307c5640 1 -- 172.21.15.92:0/2721707502 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4281a6d50 con 0x7fe428106a80 2024-09-19T09:04:09.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.745+0000 7fe41f7fe640 1 -- 172.21.15.92:0/2721707502 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4200075d0 con 0x7fe428106a80 2024-09-19T09:04:09.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.745+0000 7fe4307c5640 1 -- 172.21.15.92:0/2721707502 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4281a7240 con 0x7fe428106a80 2024-09-19T09:04:09.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.747+0000 7fe41f7fe640 1 -- 172.21.15.92:0/2721707502 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe42001c070 con 0x7fe428106a80 2024-09-19T09:04:09.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.748+0000 7fe432b9e740 1 Processor -- start 2024-09-19T09:04:09.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.748+0000 7fe432b9e740 1 -- start start 2024-09-19T09:04:09.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.748+0000 7fe432b9e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd05e9cb40 0x55fd05e9b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:09.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.748+0000 7fe432b9e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd05e9b5d0 0x55fd05e9ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:09.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.748+0000 7fe432b9e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd05ea6370 0x55fd05ea8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:09.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.748+0000 7fe432b9e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55fd05e012f0 con 0x55fd05ea6370 2024-09-19T09:04:09.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.748+0000 7fe432b9e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55fd05da8cf0 con 0x55fd05e9b5d0 2024-09-19T09:04:09.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.748+0000 7fe432b9e740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55fd05dfd2b0 con 0x55fd05e9cb40 2024-09-19T09:04:09.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.748+0000 7fe41f7fe640 1 --2- 172.21.15.92:0/2721707502 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe4140a3240 0x7fe4140a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:09.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.748+0000 7fe42dd60640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd05ea6370 0x55fd05ea8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:09.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.748+0000 7fe42e561640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd05e9b5d0 0x55fd05e9ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:09.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.748+0000 7fe42dd60640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd05ea6370 0x55fd05ea8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34662/0 (socket says 172.21.15.92:34662) 2024-09-19T09:04:09.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.748+0000 7fe42dd60640 1 -- 172.21.15.92:0/3703580407 learned_addr learned my addr 172.21.15.92:0/3703580407 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:09.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.748+0000 7fe42ed62640 1 --2- 172.21.15.92:0/2721707502 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe4140a3240 0x7fe4140a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:09.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.749+0000 7fe41f7fe640 1 -- 172.21.15.92:0/2721707502 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe4200cee90 con 0x7fe428106a80 2024-09-19T09:04:09.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.749+0000 7fe42dd60640 1 --2- 172.21.15.92:0/3703580407 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd05e9cb40 0x55fd05e9b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:09.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.749+0000 7fe42e561640 1 -- 172.21.15.92:0/3703580407 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd05e9cb40 msgr2=0x55fd05e9b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:09.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.749+0000 7fe42e561640 1 --2- 172.21.15.92:0/3703580407 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd05e9cb40 0x55fd05e9b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.749+0000 7fe42e561640 1 -- 172.21.15.92:0/3703580407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd05ea6370 msgr2=0x55fd05ea8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:09.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.749+0000 7fe42e561640 1 --2- 172.21.15.92:0/3703580407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd05ea6370 0x55fd05ea8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.749+0000 7fe42e561640 1 -- 172.21.15.92:0/3703580407 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd05d8d3a0 con 0x55fd05e9b5d0 2024-09-19T09:04:09.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.749+0000 7fe42ed62640 1 --2- 172.21.15.92:0/2721707502 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe4140a3240 0x7fe4140a5700 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe42000b940 tx=0x7fe420090a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:09.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.749+0000 7fe42e561640 1 --2- 172.21.15.92:0/3703580407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd05e9b5d0 0x55fd05e9ba10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe424005940 tx=0x7fe4240316e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a52b5910ed25da0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:09.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.749+0000 7fe41cff9640 1 -- 172.21.15.92:0/3703580407 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe424040070 con 0x55fd05e9b5d0 2024-09-19T09:04:09.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.749+0000 7fe41cff9640 1 -- 172.21.15.92:0/3703580407 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe424005020 con 0x55fd05e9b5d0 2024-09-19T09:04:09.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.749+0000 7fe41cff9640 1 -- 172.21.15.92:0/3703580407 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe424035040 con 0x55fd05e9b5d0 2024-09-19T09:04:09.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.750+0000 7fe432b9e740 1 -- 172.21.15.92:0/3703580407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd05e9b5d0 msgr2=0x55fd05e9ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:09.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.750+0000 7fe432b9e740 1 --2- 172.21.15.92:0/3703580407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd05e9b5d0 0x55fd05e9ba10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe424005940 tx=0x7fe4240316e0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.750+0000 7fe432b9e740 1 -- 172.21.15.92:0/3703580407 shutdown_connections 2024-09-19T09:04:09.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.750+0000 7fe432b9e740 1 --2- 172.21.15.92:0/3703580407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd05ea6370 0x55fd05ea8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.750+0000 7fe432b9e740 1 --2- 172.21.15.92:0/3703580407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd05e9b5d0 0x55fd05e9ba10 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.750+0000 7fe432b9e740 1 --2- 172.21.15.92:0/3703580407 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd05e9cb40 0x55fd05e9b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.750+0000 7fe432b9e740 1 -- 172.21.15.92:0/3703580407 >> 172.21.15.92:0/3703580407 conn(0x55fd05e64310 msgr2=0x55fd05e97c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:09.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.750+0000 7fe432b9e740 1 -- 172.21.15.92:0/3703580407 shutdown_connections 2024-09-19T09:04:09.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.750+0000 7fe432b9e740 1 -- 172.21.15.92:0/3703580407 wait complete. 2024-09-19T09:04:09.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.750+0000 7fe432b9e740 1 -- start start 2024-09-19T09:04:09.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.751+0000 7fe432b9e740 1 Processor -- start 2024-09-19T09:04:09.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.751+0000 7fe432b9e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd05e9b5d0 0x55fd05ea5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:09.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.751+0000 7fe432b9e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd05e9cb40 0x55fd05ea2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:09.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.751+0000 7fe432b9e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd05ea6370 0x55fd05ea34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:09.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.751+0000 7fe432b9e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55fd05ea9010 con 0x55fd05e9cb40 2024-09-19T09:04:09.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.751+0000 7fe432b9e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55fd05dbc060 con 0x55fd05e9b5d0 2024-09-19T09:04:09.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.751+0000 7fe432b9e740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55fd05ea9190 con 0x55fd05ea6370 2024-09-19T09:04:09.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.751+0000 7fe432b9e740 10 client.0 _ll_register_callbacks cb 0x55fd05b0f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:09.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.751+0000 7fe42e561640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd05e9cb40 0x55fd05ea2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:09.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.751+0000 7fe42e561640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd05e9cb40 0x55fd05ea2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34676/0 (socket says 172.21.15.92:34676) 2024-09-19T09:04:09.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.751+0000 7fe42e561640 1 -- 172.21.15.92:0/3091584742 learned_addr learned my addr 172.21.15.92:0/3091584742 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:09.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.751+0000 7fe42dd60640 1 --2- 172.21.15.92:0/3091584742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd05e9b5d0 0x55fd05ea5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:09.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.751+0000 7fe42dd60640 1 --2- 172.21.15.92:0/3091584742 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd05ea6370 0x55fd05ea34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:09.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.751+0000 7fe42e561640 1 -- 172.21.15.92:0/3091584742 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd05ea6370 msgr2=0x55fd05ea34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:09.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.751+0000 7fe42e561640 1 --2- 172.21.15.92:0/3091584742 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd05ea6370 0x55fd05ea34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.751+0000 7fe42e561640 1 -- 172.21.15.92:0/3091584742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd05e9b5d0 msgr2=0x55fd05ea5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:09.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.751+0000 7fe42e561640 1 --2- 172.21.15.92:0/3091584742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd05e9b5d0 0x55fd05ea5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.751+0000 7fe42e561640 1 -- 172.21.15.92:0/3091584742 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd05b723c0 con 0x55fd05e9cb40 2024-09-19T09:04:09.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.751+0000 7fe42e561640 1 --2- 172.21.15.92:0/3091584742 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd05e9cb40 0x55fd05ea2f80 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fe424009a50 tx=0x7fe424000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac7961d1f844337 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:09.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.751+0000 7fe411ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:04:09.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.752+0000 7fe411ffb640 1 -- 172.21.15.92:0/3091584742 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe424040030 con 0x55fd05e9cb40 2024-09-19T09:04:09.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.752+0000 7fe432b9e740 1 -- 172.21.15.92:0/3091584742 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe424005020 con 0x55fd05e9cb40 2024-09-19T09:04:09.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.752+0000 7fe411ffb640 1 -- 172.21.15.92:0/3091584742 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe424004300 con 0x55fd05e9cb40 2024-09-19T09:04:09.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.752+0000 7fe411ffb640 1 -- 172.21.15.92:0/3091584742 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe424035070 con 0x55fd05e9cb40 2024-09-19T09:04:09.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.752+0000 7fe432b9e740 10 client.17103 fetch_fsmap learned FSMap version 19 2024-09-19T09:04:09.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.752+0000 7fe432b9e740 1 -- 172.21.15.92:0/3091584742 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55fd05eb4a50 con 0x55fd05e9cb40 2024-09-19T09:04:09.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.752+0000 7fe411ffb640 1 -- 172.21.15.92:0/3091584742 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe424005020 con 0x55fd05e9cb40 2024-09-19T09:04:09.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.752+0000 7fe411ffb640 1 -- 172.21.15.92:0/3091584742 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe4240035f0 con 0x55fd05e9cb40 2024-09-19T09:04:09.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.752+0000 7fe432b9e740 10 client.17103 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:04:09.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.752+0000 7fe432b9e740 10 client.17103 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:04:09.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.752+0000 7fe432b9e740 20 client.17103 populate_metadata read hostname 'smithi092' 2024-09-19T09:04:09.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.752+0000 7fe432b9e740 1 --2- 172.21.15.92:0/3091584742 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55fd05eb5da0 0x55fd05eb8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:09.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.752+0000 7fe432b9e740 4 client.17103 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:09.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.752+0000 7fe432b9e740 1 -- 172.21.15.92:0/3091584742 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd05e0e860 con 0x55fd05eb5da0 2024-09-19T09:04:09.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.753+0000 7fe42dd60640 1 --2- 172.21.15.92:0/3091584742 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55fd05eb5da0 0x55fd05eb8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:09.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.753+0000 7fe42dd60640 1 --2- 172.21.15.92:0/3091584742 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55fd05eb5da0 0x55fd05eb8190 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6aea4c4cccf8a96 server_cookie=7f0668eaff8c5f78 in_seq=0 out_seq=0 2024-09-19T09:04:09.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.753+0000 7fe411ffb640 10 client.17103 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:09.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.754+0000 7fe411ffb640 1 -- 172.21.15.92:0/3091584742 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fd05e0e860 con 0x55fd05eb5da0 2024-09-19T09:04:09.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.754+0000 7fe411ffb640 10 client.17103 handle_command_reply: tid=0 2024-09-19T09:04:09.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.754+0000 7fe432b9e740 1 client.17103 shutdown 2024-09-19T09:04:09.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.754+0000 7fe432b9e740 1 -- 172.21.15.92:0/3091584742 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd05e9cb40 msgr2=0x55fd05ea2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:09.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.754+0000 7fe432b9e740 1 --2- 172.21.15.92:0/3091584742 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd05e9cb40 0x55fd05ea2f80 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fe424009a50 tx=0x7fe424000bc0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.754+0000 7fe432b9e740 1 -- 172.21.15.92:0/3091584742 shutdown_connections 2024-09-19T09:04:09.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.754+0000 7fe432b9e740 1 --2- 172.21.15.92:0/3091584742 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55fd05eb5da0 0x55fd05eb8190 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.754+0000 7fe411ffb640 0 client.17103 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:09.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.754+0000 7fe432b9e740 1 --2- 172.21.15.92:0/3091584742 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd05ea6370 0x55fd05ea34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.754+0000 7fe432b9e740 1 --2- 172.21.15.92:0/3091584742 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd05e9cb40 0x55fd05ea2f80 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.754+0000 7fe432b9e740 1 --2- 172.21.15.92:0/3091584742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd05e9b5d0 0x55fd05ea5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.754+0000 7fe432b9e740 1 -- 172.21.15.92:0/3091584742 >> 172.21.15.92:0/3091584742 conn(0x55fd05e64310 msgr2=0x55fd05e9d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:09.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.754+0000 7fe432b9e740 1 -- 172.21.15.92:0/3091584742 shutdown_connections 2024-09-19T09:04:09.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.754+0000 7fe432b9e740 1 -- 172.21.15.92:0/3091584742 wait complete. 2024-09-19T09:04:09.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.754+0000 7fe432b9e740 20 client.17103 trim_cache size 0 max 16384 2024-09-19T09:04:09.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.767+0000 7fe432b9e740 1 Processor -- start 2024-09-19T09:04:09.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.767+0000 7fe432b9e740 1 -- start start 2024-09-19T09:04:09.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.767+0000 7fe432b9e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd05e9b5d0 0x55fd05eb22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:09.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.767+0000 7fe432b9e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd05e9cb40 0x55fd05ea7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:09.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.767+0000 7fe432b9e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd05ea6370 0x55fd05ea7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:09.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.767+0000 7fe432b9e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe4281ad800 con 0x55fd05e9b5d0 2024-09-19T09:04:09.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.767+0000 7fe432b9e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe4281b00a0 con 0x55fd05ea6370 2024-09-19T09:04:09.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.767+0000 7fe432b9e740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe4281ade90 con 0x55fd05e9cb40 2024-09-19T09:04:09.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.767+0000 7fe42dd60640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd05e9b5d0 0x55fd05eb22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:09.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.767+0000 7fe42dd60640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd05e9b5d0 0x55fd05eb22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34678/0 (socket says 172.21.15.92:34678) 2024-09-19T09:04:09.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.767+0000 7fe42dd60640 1 -- 172.21.15.92:0/3780645246 learned_addr learned my addr 172.21.15.92:0/3780645246 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:09.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.767+0000 7fe42dd60640 1 -- 172.21.15.92:0/3780645246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd05e9cb40 msgr2=0x55fd05ea7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:09.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.767+0000 7fe42dd60640 1 --2- 172.21.15.92:0/3780645246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd05e9cb40 0x55fd05ea7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.767+0000 7fe42dd60640 1 -- 172.21.15.92:0/3780645246 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd05ea6370 msgr2=0x55fd05ea7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:09.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.767+0000 7fe42dd60640 1 --2- 172.21.15.92:0/3780645246 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd05ea6370 0x55fd05ea7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.767+0000 7fe42dd60640 1 -- 172.21.15.92:0/3780645246 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd05ea8ba0 con 0x55fd05e9b5d0 2024-09-19T09:04:09.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.767+0000 7fe42dd60640 1 --2- 172.21.15.92:0/3780645246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd05e9b5d0 0x55fd05eb22e0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x55fd05e9c070 tx=0x7fe4180047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f265aa3917822a40 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:09.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.767+0000 7fe413fff640 1 -- 172.21.15.92:0/3780645246 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4180188a0 con 0x55fd05e9b5d0 2024-09-19T09:04:09.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.768+0000 7fe413fff640 1 -- 172.21.15.92:0/3780645246 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe418023350 con 0x55fd05e9b5d0 2024-09-19T09:04:09.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.768+0000 7fe413fff640 1 -- 172.21.15.92:0/3780645246 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4180163d0 con 0x55fd05e9b5d0 2024-09-19T09:04:09.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.768+0000 7fe432b9e740 1 -- 172.21.15.92:0/3780645246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd05e9b5d0 msgr2=0x55fd05eb22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:09.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.768+0000 7fe432b9e740 1 --2- 172.21.15.92:0/3780645246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd05e9b5d0 0x55fd05eb22e0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x55fd05e9c070 tx=0x7fe4180047d0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.768+0000 7fe432b9e740 1 -- 172.21.15.92:0/3780645246 shutdown_connections 2024-09-19T09:04:09.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.768+0000 7fe432b9e740 1 --2- 172.21.15.92:0/3780645246 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd05ea6370 0x55fd05ea7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.768+0000 7fe432b9e740 1 --2- 172.21.15.92:0/3780645246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd05e9cb40 0x55fd05ea7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.768+0000 7fe432b9e740 1 --2- 172.21.15.92:0/3780645246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd05e9b5d0 0x55fd05eb22e0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.768+0000 7fe432b9e740 1 -- 172.21.15.92:0/3780645246 >> 172.21.15.92:0/3780645246 conn(0x55fd05e64310 msgr2=0x55fd05ea2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:09.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.768+0000 7fe432b9e740 1 -- 172.21.15.92:0/3780645246 shutdown_connections 2024-09-19T09:04:09.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.768+0000 7fe432b9e740 1 -- 172.21.15.92:0/3780645246 wait complete. 2024-09-19T09:04:09.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.768+0000 7fe432b9e740 1 -- start start 2024-09-19T09:04:09.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.768+0000 7fe432b9e740 1 Processor -- start 2024-09-19T09:04:09.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.769+0000 7fe432b9e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd05e9b5d0 0x55fd05ebd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:09.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.769+0000 7fe432b9e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd05e9cb40 0x55fd05ebd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:09.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.769+0000 7fe432b9e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd05ea6370 0x55fd05ebdd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:09.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.769+0000 7fe432b9e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe4281ae560 con 0x55fd05e9b5d0 2024-09-19T09:04:09.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.769+0000 7fe432b9e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe4281af9d0 con 0x55fd05ea6370 2024-09-19T09:04:09.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.769+0000 7fe432b9e740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe4281aec30 con 0x55fd05e9cb40 2024-09-19T09:04:09.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.769+0000 7fe432b9e740 10 client.0 _ll_register_callbacks cb 0x7fe418009510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:09.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.769+0000 7fe42dd60640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd05e9b5d0 0x55fd05ebd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:09.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.769+0000 7fe42dd60640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd05e9b5d0 0x55fd05ebd2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34684/0 (socket says 172.21.15.92:34684) 2024-09-19T09:04:09.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.769+0000 7fe42dd60640 1 -- 172.21.15.92:0/352419422 learned_addr learned my addr 172.21.15.92:0/352419422 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:09.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.769+0000 7fe42e561640 1 --2- 172.21.15.92:0/352419422 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd05e9cb40 0x55fd05ebd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:09.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.769+0000 7fe42dd60640 1 -- 172.21.15.92:0/352419422 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd05e9cb40 msgr2=0x55fd05ebd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:09.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.769+0000 7fe42dd60640 1 --2- 172.21.15.92:0/352419422 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd05e9cb40 0x55fd05ebd820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.769+0000 7fe42dd60640 1 -- 172.21.15.92:0/352419422 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd05ea6370 msgr2=0x55fd05ebdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:09.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.769+0000 7fe42dd60640 1 --2- 172.21.15.92:0/352419422 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd05ea6370 0x55fd05ebdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.769+0000 7fe42dd60640 1 -- 172.21.15.92:0/352419422 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd05eac8e0 con 0x55fd05e9b5d0 2024-09-19T09:04:09.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.769+0000 7fe42dd60640 1 --2- 172.21.15.92:0/352419422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd05e9b5d0 0x55fd05ebd2e0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fe418009ed0 tx=0x7fe418005bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f584d77ff2c978e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:09.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.769+0000 7fe411ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:04:09.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.769+0000 7fe411ffb640 1 -- 172.21.15.92:0/352419422 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4180188a0 con 0x55fd05e9b5d0 2024-09-19T09:04:09.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.769+0000 7fe411ffb640 1 -- 172.21.15.92:0/352419422 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe41800f040 con 0x55fd05e9b5d0 2024-09-19T09:04:09.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.769+0000 7fe432b9e740 1 -- 172.21.15.92:0/352419422 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe418023350 con 0x55fd05e9b5d0 2024-09-19T09:04:09.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.770+0000 7fe411ffb640 1 -- 172.21.15.92:0/352419422 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe418018c50 con 0x55fd05e9b5d0 2024-09-19T09:04:09.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.770+0000 7fe432b9e740 10 client.17109 fetch_fsmap learned FSMap version 19 2024-09-19T09:04:09.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.770+0000 7fe432b9e740 1 -- 172.21.15.92:0/352419422 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55fd05f20990 con 0x55fd05e9b5d0 2024-09-19T09:04:09.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.770+0000 7fe411ffb640 1 -- 172.21.15.92:0/352419422 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe418023350 con 0x55fd05e9b5d0 2024-09-19T09:04:09.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.770+0000 7fe411ffb640 1 -- 172.21.15.92:0/352419422 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe4180064f0 con 0x55fd05e9b5d0 2024-09-19T09:04:09.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.770+0000 7fe432b9e740 10 client.17109 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:04:09.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.770+0000 7fe432b9e740 10 client.17109 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:04:09.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.770+0000 7fe432b9e740 20 client.17109 populate_metadata read hostname 'smithi092' 2024-09-19T09:04:09.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.770+0000 7fe432b9e740 1 --2- 172.21.15.92:0/352419422 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55fd05f20ff0 0x55fd05f23410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:09.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.770+0000 7fe432b9e740 4 client.17109 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:04:09.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.770+0000 7fe432b9e740 1 -- 172.21.15.92:0/352419422 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fd05e08d70 con 0x55fd05f20ff0 2024-09-19T09:04:09.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.770+0000 7fe42e561640 1 --2- 172.21.15.92:0/352419422 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55fd05f20ff0 0x55fd05f23410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:09.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.771+0000 7fe411ffb640 10 client.17109 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:09.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.771+0000 7fe42e561640 1 --2- 172.21.15.92:0/352419422 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55fd05f20ff0 0x55fd05f23410 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99b1a0d8d2a9f2ec server_cookie=ecb018af078c7481 in_seq=0 out_seq=0 2024-09-19T09:04:09.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.771+0000 7fe411ffb640 1 -- 172.21.15.92:0/352419422 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fd05e08d70 con 0x55fd05f20ff0 2024-09-19T09:04:09.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.771+0000 7fe411ffb640 10 client.17109 handle_command_reply: tid=0 2024-09-19T09:04:09.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.771+0000 7fe432b9e740 1 client.17109 shutdown 2024-09-19T09:04:09.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.771+0000 7fe432b9e740 1 -- 172.21.15.92:0/352419422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd05e9b5d0 msgr2=0x55fd05ebd2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:09.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.771+0000 7fe432b9e740 1 --2- 172.21.15.92:0/352419422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd05e9b5d0 0x55fd05ebd2e0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fe418009ed0 tx=0x7fe418005bf0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.771+0000 7fe432b9e740 1 -- 172.21.15.92:0/352419422 shutdown_connections 2024-09-19T09:04:09.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.771+0000 7fe432b9e740 1 --2- 172.21.15.92:0/352419422 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55fd05f20ff0 0x55fd05f23410 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.771+0000 7fe432b9e740 1 --2- 172.21.15.92:0/352419422 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd05ea6370 0x55fd05ebdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.771+0000 7fe432b9e740 1 --2- 172.21.15.92:0/352419422 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fd05e9cb40 0x55fd05ebd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.771+0000 7fe432b9e740 1 --2- 172.21.15.92:0/352419422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fd05e9b5d0 0x55fd05ebd2e0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.771+0000 7fe432b9e740 1 -- 172.21.15.92:0/352419422 >> 172.21.15.92:0/352419422 conn(0x55fd05e64310 msgr2=0x55fd05ea47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:09.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.771+0000 7fe411ffb640 0 client.17109 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:09.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.771+0000 7fe432b9e740 1 -- 172.21.15.92:0/352419422 shutdown_connections 2024-09-19T09:04:09.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.771+0000 7fe432b9e740 1 -- 172.21.15.92:0/352419422 wait complete. 2024-09-19T09:04:09.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.771+0000 7fe432b9e740 20 client.17109 trim_cache size 0 max 16384 2024-09-19T09:04:09.778 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-19T09:04:09.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.772+0000 7fe4307c5640 1 -- 172.21.15.92:0/2721707502 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe4140a3240 msgr2=0x7fe4140a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:09.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.772+0000 7fe4307c5640 1 --2- 172.21.15.92:0/2721707502 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe4140a3240 0x7fe4140a5700 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe42000b940 tx=0x7fe420090a40 comp rx=0 tx=0).stop 2024-09-19T09:04:09.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.772+0000 7fe4307c5640 1 -- 172.21.15.92:0/2721707502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe428106a80 msgr2=0x7fe4281030d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:09.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.772+0000 7fe4307c5640 1 --2- 172.21.15.92:0/2721707502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe428106a80 0x7fe4281030d0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fe42000b970 tx=0x7fe42000bd70 comp rx=0 tx=0).stop 2024-09-19T09:04:09.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.772+0000 7fe4307c5640 1 -- 172.21.15.92:0/2721707502 shutdown_connections 2024-09-19T09:04:09.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.772+0000 7fe4307c5640 1 --2- 172.21.15.92:0/2721707502 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe4140a3240 0x7fe4140a5700 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.772+0000 7fe4307c5640 1 --2- 172.21.15.92:0/2721707502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe428106a80 0x7fe4281030d0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.772+0000 7fe4307c5640 1 --2- 172.21.15.92:0/2721707502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe428101420 0x7fe428102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.772+0000 7fe4307c5640 1 --2- 172.21.15.92:0/2721707502 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe428100a80 0x7fe428102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.772+0000 7fe4307c5640 1 -- 172.21.15.92:0/2721707502 >> 172.21.15.92:0/2721707502 conn(0x7fe4280fc7a0 msgr2=0x7fe4281048d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:09.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.772+0000 7fe4307c5640 1 -- 172.21.15.92:0/2721707502 shutdown_connections 2024-09-19T09:04:09.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:09.772+0000 7fe4307c5640 1 -- 172.21.15.92:0/2721707502 wait complete. 2024-09-19T09:04:09.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:09 smithi167 ceph-mon[35359]: pgmap v560: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 715 KiB/s wr, 23 op/s 2024-09-19T09:04:09.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:09 smithi190 ceph-mon[35358]: pgmap v560: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 715 KiB/s wr, 23 op/s 2024-09-19T09:04:10.799 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:04:11.547 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:04:11.547 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:04:11.811 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:11.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:11 smithi167 ceph-mon[35359]: pgmap v561: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 669 KiB/s wr, 22 op/s 2024-09-19T09:04:11.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:11 smithi190 ceph-mon[35358]: pgmap v561: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 669 KiB/s wr, 22 op/s 2024-09-19T09:04:11.925 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:11 smithi092 ceph-mon[31407]: pgmap v561: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 669 KiB/s wr, 22 op/s 2024-09-19T09:04:11.965 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:04:12.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.272+0000 7efcbb304640 1 -- 172.21.15.92:0/3932176917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efcb4106a80 msgr2=0x7efcb4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:12.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.272+0000 7efcbb304640 1 --2- 172.21.15.92:0/3932176917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efcb4106a80 0x7efcb4106e60 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7efcb0009930 tx=0x7efcb002a420 comp rx=0 tx=0).stop 2024-09-19T09:04:12.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.272+0000 7efcbb304640 1 -- 172.21.15.92:0/3932176917 shutdown_connections 2024-09-19T09:04:12.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.272+0000 7efcbb304640 1 --2- 172.21.15.92:0/3932176917 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcb4101420 0x7efcb410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:12.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.272+0000 7efcbb304640 1 --2- 172.21.15.92:0/3932176917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcb4100a80 0x7efcb4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:12.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.272+0000 7efcbb304640 1 --2- 172.21.15.92:0/3932176917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efcb4106a80 0x7efcb4106e60 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:12.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.272+0000 7efcbb304640 1 -- 172.21.15.92:0/3932176917 >> 172.21.15.92:0/3932176917 conn(0x7efcb40fc7a0 msgr2=0x7efcb40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:12.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.272+0000 7efcbb304640 1 -- 172.21.15.92:0/3932176917 shutdown_connections 2024-09-19T09:04:12.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.272+0000 7efcbb304640 1 -- 172.21.15.92:0/3932176917 wait complete. 2024-09-19T09:04:12.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.273+0000 7efcbb304640 1 Processor -- start 2024-09-19T09:04:12.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.273+0000 7efcbb304640 1 -- start start 2024-09-19T09:04:12.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.273+0000 7efcbb304640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcb4100a80 0x7efcb4199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:12.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.273+0000 7efcbb304640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efcb4101420 0x7efcb41997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:12.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.273+0000 7efcbb304640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcb4106a80 0x7efcb41a4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:12.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.273+0000 7efcbb304640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efcb4110ea0 con 0x7efcb4101420 2024-09-19T09:04:12.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.273+0000 7efcbb304640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efcb4110d20 con 0x7efcb4100a80 2024-09-19T09:04:12.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.273+0000 7efcbb304640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7efcb4111020 con 0x7efcb4106a80 2024-09-19T09:04:12.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.273+0000 7efcb889f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efcb4101420 0x7efcb41997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:12.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.273+0000 7efcb889f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efcb4101420 0x7efcb41997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56466/0 (socket says 172.21.15.92:56466) 2024-09-19T09:04:12.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.273+0000 7efcb889f640 1 -- 172.21.15.92:0/3916693909 learned_addr learned my addr 172.21.15.92:0/3916693909 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:12.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.273+0000 7efcb98a1640 1 --2- 172.21.15.92:0/3916693909 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcb4106a80 0x7efcb41a4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:12.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.273+0000 7efcb90a0640 1 --2- 172.21.15.92:0/3916693909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcb4100a80 0x7efcb4199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:12.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.274+0000 7efcb889f640 1 -- 172.21.15.92:0/3916693909 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcb4106a80 msgr2=0x7efcb41a4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:12.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.274+0000 7efcb889f640 1 --2- 172.21.15.92:0/3916693909 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcb4106a80 0x7efcb41a4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:12.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.274+0000 7efcb889f640 1 -- 172.21.15.92:0/3916693909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcb4100a80 msgr2=0x7efcb4199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:12.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.274+0000 7efcb889f640 1 --2- 172.21.15.92:0/3916693909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcb4100a80 0x7efcb4199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:12.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.274+0000 7efcb889f640 1 -- 172.21.15.92:0/3916693909 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb41a4850 con 0x7efcb4101420 2024-09-19T09:04:12.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.274+0000 7efcb90a0640 1 --2- 172.21.15.92:0/3916693909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcb4100a80 0x7efcb4199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:12.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.274+0000 7efcb889f640 1 --2- 172.21.15.92:0/3916693909 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efcb4101420 0x7efcb41997d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7efca400c920 tx=0x7efca400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:12.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.274+0000 7efcaa7fc640 1 -- 172.21.15.92:0/3916693909 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca4007c70 con 0x7efcb4101420 2024-09-19T09:04:12.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.274+0000 7efcbb304640 1 -- 172.21.15.92:0/3916693909 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcb41a4a20 con 0x7efcb4101420 2024-09-19T09:04:12.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.274+0000 7efcaa7fc640 1 -- 172.21.15.92:0/3916693909 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efca4007e10 con 0x7efcb4101420 2024-09-19T09:04:12.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.274+0000 7efcbb304640 1 -- 172.21.15.92:0/3916693909 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcb41a4f60 con 0x7efcb4101420 2024-09-19T09:04:12.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.275+0000 7efcaa7fc640 1 -- 172.21.15.92:0/3916693909 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca4018890 con 0x7efcb4101420 2024-09-19T09:04:12.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.277+0000 7efcaa7fc640 1 -- 172.21.15.92:0/3916693909 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7efca4018b10 con 0x7efcb4101420 2024-09-19T09:04:12.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.277+0000 7efcbd6dd740 1 Processor -- start 2024-09-19T09:04:12.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.278+0000 7efcbd6dd740 1 -- start start 2024-09-19T09:04:12.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.278+0000 7efcbd6dd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f97f30b60 0x557f97f30f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:12.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.278+0000 7efcbd6dd740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f97f31480 0x557f97f3b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:12.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.278+0000 7efcbd6dd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f97f3bd40 0x557f97f3e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:12.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.278+0000 7efcbd6dd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557f97e96280 con 0x557f97f30b60 2024-09-19T09:04:12.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.278+0000 7efcbd6dd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x557f97e3db10 con 0x557f97f3bd40 2024-09-19T09:04:12.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.278+0000 7efcbd6dd740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x557f97e92240 con 0x557f97f31480 2024-09-19T09:04:12.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.278+0000 7efcb98a1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f97f30b60 0x557f97f30f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:12.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.278+0000 7efcb98a1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f97f30b60 0x557f97f30f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56470/0 (socket says 172.21.15.92:56470) 2024-09-19T09:04:12.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.278+0000 7efcb98a1640 1 -- 172.21.15.92:0/306350850 learned_addr learned my addr 172.21.15.92:0/306350850 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:12.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.278+0000 7efcb90a0640 1 --2- 172.21.15.92:0/306350850 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f97f31480 0x557f97f3b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:12.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.278+0000 7efcaa7fc640 1 --2- 172.21.15.92:0/3916693909 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efca00a3240 0x7efca00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:12.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.278+0000 7efcb98a1640 1 --2- 172.21.15.92:0/3916693909 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efca00a3240 0x7efca00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:12.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.278+0000 7efcb889f640 1 --2- 172.21.15.92:0/306350850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f97f3bd40 0x557f97f3e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:12.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.278+0000 7efcb90a0640 1 -- 172.21.15.92:0/306350850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f97f3bd40 msgr2=0x557f97f3e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:12.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.279+0000 7efcb90a0640 1 --2- 172.21.15.92:0/306350850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f97f3bd40 0x557f97f3e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:12.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.279+0000 7efcb90a0640 1 -- 172.21.15.92:0/306350850 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f97f30b60 msgr2=0x557f97f30f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:12.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.279+0000 7efcaa7fc640 1 -- 172.21.15.92:0/3916693909 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7efca40cfb00 con 0x7efcb4101420 2024-09-19T09:04:12.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.279+0000 7efcb90a0640 1 --2- 172.21.15.92:0/306350850 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f97f30b60 0x557f97f30f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:12.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.279+0000 7efcb90a0640 1 -- 172.21.15.92:0/306350850 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f97e4a1f0 con 0x557f97f31480 2024-09-19T09:04:12.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.279+0000 7efcb889f640 1 --2- 172.21.15.92:0/306350850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f97f3bd40 0x557f97f3e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:12.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.279+0000 7efcb98a1640 1 --2- 172.21.15.92:0/3916693909 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efca00a3240 0x7efca00a5700 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7efcac009fd0 tx=0x7efcac004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:12.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.279+0000 7efcb90a0640 1 --2- 172.21.15.92:0/306350850 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f97f31480 0x557f97f3b800 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efcb0006010 tx=0x7efcb0009680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f298d7a2569ab10 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:12.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.279+0000 7efc9f7fe640 1 -- 172.21.15.92:0/306350850 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb003f070 con 0x557f97f31480 2024-09-19T09:04:12.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.279+0000 7efc9f7fe640 1 -- 172.21.15.92:0/306350850 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efcb00317b0 con 0x557f97f31480 2024-09-19T09:04:12.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.279+0000 7efc9f7fe640 1 -- 172.21.15.92:0/306350850 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb0035070 con 0x557f97f31480 2024-09-19T09:04:12.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.280+0000 7efcbd6dd740 1 -- 172.21.15.92:0/306350850 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f97f31480 msgr2=0x557f97f3b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:12.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.280+0000 7efcbd6dd740 1 --2- 172.21.15.92:0/306350850 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f97f31480 0x557f97f3b800 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efcb0006010 tx=0x7efcb0009680 comp rx=0 tx=0).stop 2024-09-19T09:04:12.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.280+0000 7efcbd6dd740 1 -- 172.21.15.92:0/306350850 shutdown_connections 2024-09-19T09:04:12.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.280+0000 7efcbd6dd740 1 --2- 172.21.15.92:0/306350850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f97f3bd40 0x557f97f3e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:12.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.280+0000 7efcbd6dd740 1 --2- 172.21.15.92:0/306350850 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f97f31480 0x557f97f3b800 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:12.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.280+0000 7efcbd6dd740 1 --2- 172.21.15.92:0/306350850 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f97f30b60 0x557f97f30f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:12.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.280+0000 7efcbd6dd740 1 -- 172.21.15.92:0/306350850 >> 172.21.15.92:0/306350850 conn(0x557f97f2d0f0 msgr2=0x557f97f2d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:12.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.280+0000 7efcbd6dd740 1 -- 172.21.15.92:0/306350850 shutdown_connections 2024-09-19T09:04:12.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.280+0000 7efcbd6dd740 1 -- 172.21.15.92:0/306350850 wait complete. 2024-09-19T09:04:12.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.280+0000 7efcbd6dd740 1 -- start start 2024-09-19T09:04:12.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.281+0000 7efcbd6dd740 1 Processor -- start 2024-09-19T09:04:12.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.281+0000 7efcbd6dd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f97f30b60 0x557f97f38c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:12.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.281+0000 7efcbd6dd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f97f31480 0x557f97f39160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:12.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.281+0000 7efcbd6dd740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f97f3bd40 0x557f97f396a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:12.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.281+0000 7efcbd6dd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557f97f42d20 con 0x557f97f31480 2024-09-19T09:04:12.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.281+0000 7efcbd6dd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x557f97e50f10 con 0x557f97f30b60 2024-09-19T09:04:12.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.281+0000 7efcbd6dd740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x557f97f42ea0 con 0x557f97f3bd40 2024-09-19T09:04:12.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.281+0000 7efcbd6dd740 10 client.0 _ll_register_callbacks cb 0x557f97e19a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:12.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.281+0000 7efcb889f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f97f31480 0x557f97f39160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:12.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.281+0000 7efcb889f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f97f31480 0x557f97f39160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56476/0 (socket says 172.21.15.92:56476) 2024-09-19T09:04:12.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.281+0000 7efcb889f640 1 -- 172.21.15.92:0/1796942207 learned_addr learned my addr 172.21.15.92:0/1796942207 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:12.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.281+0000 7efcb98a1640 1 --2- 172.21.15.92:0/1796942207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f97f3bd40 0x557f97f396a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:12.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.281+0000 7efcb90a0640 1 --2- 172.21.15.92:0/1796942207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f97f30b60 0x557f97f38c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:12.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.282+0000 7efcb889f640 1 -- 172.21.15.92:0/1796942207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f97f3bd40 msgr2=0x557f97f396a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:12.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.282+0000 7efcb889f640 1 --2- 172.21.15.92:0/1796942207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f97f3bd40 0x557f97f396a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:12.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.282+0000 7efcb889f640 1 -- 172.21.15.92:0/1796942207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f97f30b60 msgr2=0x557f97f38c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:12.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.282+0000 7efcb889f640 1 --2- 172.21.15.92:0/1796942207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f97f30b60 0x557f97f38c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:12.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.282+0000 7efcb889f640 1 -- 172.21.15.92:0/1796942207 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f97c076a0 con 0x557f97f31480 2024-09-19T09:04:12.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.282+0000 7efcb889f640 1 --2- 172.21.15.92:0/1796942207 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f97f31480 0x557f97f39160 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7efca4098af0 tx=0x7efca40a04d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ffc081216fdea70 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:12.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.282+0000 7efc9cff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:04:12.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.282+0000 7efc9cff9640 1 -- 172.21.15.92:0/1796942207 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca40b5060 con 0x557f97f31480 2024-09-19T09:04:12.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.282+0000 7efc9cff9640 1 -- 172.21.15.92:0/1796942207 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7efca400fb30 con 0x557f97f31480 2024-09-19T09:04:12.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.282+0000 7efcbd6dd740 1 -- 172.21.15.92:0/1796942207 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efcb00317b0 con 0x557f97f31480 2024-09-19T09:04:12.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.282+0000 7efc9cff9640 1 -- 172.21.15.92:0/1796942207 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7efca409c120 con 0x557f97f31480 2024-09-19T09:04:12.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.282+0000 7efcbd6dd740 10 client.17121 fetch_fsmap learned FSMap version 19 2024-09-19T09:04:12.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.282+0000 7efcbd6dd740 1 -- 172.21.15.92:0/1796942207 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x557f97f4e8f0 con 0x557f97f31480 2024-09-19T09:04:12.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.282+0000 7efc9cff9640 1 -- 172.21.15.92:0/1796942207 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efcb00317b0 con 0x557f97f31480 2024-09-19T09:04:12.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.283+0000 7efc9cff9640 1 -- 172.21.15.92:0/1796942207 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7efca409b570 con 0x557f97f31480 2024-09-19T09:04:12.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.283+0000 7efcbd6dd740 10 client.17121 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:04:12.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.283+0000 7efcbd6dd740 10 client.17121 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:04:12.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.283+0000 7efcbd6dd740 20 client.17121 populate_metadata read hostname 'smithi092' 2024-09-19T09:04:12.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.283+0000 7efcbd6dd740 1 --2- 172.21.15.92:0/1796942207 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557f97f4fdb0 0x557f97f521a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:12.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.283+0000 7efcbd6dd740 4 client.17121 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:12.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.283+0000 7efcbd6dd740 1 -- 172.21.15.92:0/1796942207 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f97ea37f0 con 0x557f97f4fdb0 2024-09-19T09:04:12.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.283+0000 7efcb90a0640 1 --2- 172.21.15.92:0/1796942207 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557f97f4fdb0 0x557f97f521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:12.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.283+0000 7efcb90a0640 1 --2- 172.21.15.92:0/1796942207 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557f97f4fdb0 0x557f97f521a0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24bd0086d5e7a35c server_cookie=3dbd6ce8c77d78fb in_seq=0 out_seq=0 2024-09-19T09:04:12.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.283+0000 7efc9cff9640 10 client.17121 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:12.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.284+0000 7efc9cff9640 1 -- 172.21.15.92:0/1796942207 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557f97ea37f0 con 0x557f97f4fdb0 2024-09-19T09:04:12.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.284+0000 7efc9cff9640 10 client.17121 handle_command_reply: tid=0 2024-09-19T09:04:12.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.284+0000 7efcbd6dd740 1 client.17121 shutdown 2024-09-19T09:04:12.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.284+0000 7efcbd6dd740 1 -- 172.21.15.92:0/1796942207 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f97f31480 msgr2=0x557f97f39160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:12.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.284+0000 7efcbd6dd740 1 --2- 172.21.15.92:0/1796942207 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f97f31480 0x557f97f39160 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7efca4098af0 tx=0x7efca40a04d0 comp rx=0 tx=0).stop 2024-09-19T09:04:12.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.284+0000 7efcbd6dd740 1 -- 172.21.15.92:0/1796942207 shutdown_connections 2024-09-19T09:04:12.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.284+0000 7efcbd6dd740 1 --2- 172.21.15.92:0/1796942207 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557f97f4fdb0 0x557f97f521a0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:12.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.284+0000 7efcbd6dd740 1 --2- 172.21.15.92:0/1796942207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f97f3bd40 0x557f97f396a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:12.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.284+0000 7efcbd6dd740 1 --2- 172.21.15.92:0/1796942207 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f97f31480 0x557f97f39160 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:12.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.284+0000 7efcbd6dd740 1 --2- 172.21.15.92:0/1796942207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f97f30b60 0x557f97f38c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:12.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.284+0000 7efc9cff9640 0 client.17121 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:12.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.284+0000 7efcbd6dd740 1 -- 172.21.15.92:0/1796942207 >> 172.21.15.92:0/1796942207 conn(0x557f97f2d0f0 msgr2=0x557f97f32e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:12.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.285+0000 7efcbd6dd740 1 -- 172.21.15.92:0/1796942207 shutdown_connections 2024-09-19T09:04:12.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.285+0000 7efcbd6dd740 1 -- 172.21.15.92:0/1796942207 wait complete. 2024-09-19T09:04:12.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.285+0000 7efcbd6dd740 20 client.17121 trim_cache size 0 max 16384 2024-09-19T09:04:12.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.303+0000 7efcbd6dd740 1 Processor -- start 2024-09-19T09:04:12.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.303+0000 7efcbd6dd740 1 -- start start 2024-09-19T09:04:12.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.303+0000 7efcbd6dd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f97f30b60 0x557f97f3aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:12.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.303+0000 7efcbd6dd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f97f3bd40 0x557f97f57a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:12.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.303+0000 7efcbd6dd740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f97f37d10 0x557f97f57f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:12.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.303+0000 7efcbd6dd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efcb41a93c0 con 0x557f97f3bd40 2024-09-19T09:04:12.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.303+0000 7efcbd6dd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efcb41abc60 con 0x557f97f30b60 2024-09-19T09:04:12.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.303+0000 7efcbd6dd740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7efcb41a9a50 con 0x557f97f37d10 2024-09-19T09:04:12.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.304+0000 7efcb889f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f97f3bd40 0x557f97f57a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:12.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.304+0000 7efcb889f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f97f3bd40 0x557f97f57a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56482/0 (socket says 172.21.15.92:56482) 2024-09-19T09:04:12.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.304+0000 7efcb889f640 1 -- 172.21.15.92:0/2660622940 learned_addr learned my addr 172.21.15.92:0/2660622940 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:12.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.304+0000 7efcb90a0640 1 --2- 172.21.15.92:0/2660622940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f97f30b60 0x557f97f3aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:12.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.304+0000 7efcb889f640 1 -- 172.21.15.92:0/2660622940 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f97f37d10 msgr2=0x557f97f57f60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:04:12.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.304+0000 7efcb889f640 1 --2- 172.21.15.92:0/2660622940 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f97f37d10 0x557f97f57f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:12.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.304+0000 7efcb889f640 1 -- 172.21.15.92:0/2660622940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f97f30b60 msgr2=0x557f97f3aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:12.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.304+0000 7efcb889f640 1 --2- 172.21.15.92:0/2660622940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f97f30b60 0x557f97f3aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:12.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.304+0000 7efcb889f640 1 -- 172.21.15.92:0/2660622940 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f97f3b4f0 con 0x557f97f3bd40 2024-09-19T09:04:12.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.304+0000 7efcb889f640 1 --2- 172.21.15.92:0/2660622940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f97f3bd40 0x557f97f57a20 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7efca409c0b0 tx=0x7efca400ff30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45d077795b66c22f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:12.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.304+0000 7efc9effd640 1 -- 172.21.15.92:0/2660622940 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca40b5060 con 0x557f97f3bd40 2024-09-19T09:04:12.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.304+0000 7efc9effd640 1 -- 172.21.15.92:0/2660622940 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efca400fb30 con 0x557f97f3bd40 2024-09-19T09:04:12.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.304+0000 7efc9effd640 1 -- 172.21.15.92:0/2660622940 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca40a4900 con 0x557f97f3bd40 2024-09-19T09:04:12.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.305+0000 7efcbd6dd740 1 -- 172.21.15.92:0/2660622940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f97f3bd40 msgr2=0x557f97f57a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:12.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.305+0000 7efcbd6dd740 1 --2- 172.21.15.92:0/2660622940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f97f3bd40 0x557f97f57a20 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7efca409c0b0 tx=0x7efca400ff30 comp rx=0 tx=0).stop 2024-09-19T09:04:12.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.305+0000 7efcbd6dd740 1 -- 172.21.15.92:0/2660622940 shutdown_connections 2024-09-19T09:04:12.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.305+0000 7efcbd6dd740 1 --2- 172.21.15.92:0/2660622940 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f97f37d10 0x557f97f57f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:12.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.305+0000 7efcbd6dd740 1 --2- 172.21.15.92:0/2660622940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f97f3bd40 0x557f97f57a20 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:12.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.305+0000 7efcbd6dd740 1 --2- 172.21.15.92:0/2660622940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f97f30b60 0x557f97f3aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:12.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.305+0000 7efcbd6dd740 1 -- 172.21.15.92:0/2660622940 >> 172.21.15.92:0/2660622940 conn(0x557f97f2d0f0 msgr2=0x557f97f3a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:12.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.305+0000 7efcbd6dd740 1 -- 172.21.15.92:0/2660622940 shutdown_connections 2024-09-19T09:04:12.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.305+0000 7efcbd6dd740 1 -- 172.21.15.92:0/2660622940 wait complete. 2024-09-19T09:04:12.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.306+0000 7efcbd6dd740 1 -- start start 2024-09-19T09:04:12.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.306+0000 7efcbd6dd740 1 Processor -- start 2024-09-19T09:04:12.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.306+0000 7efcbd6dd740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f97f30b60 0x557f97f486b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:12.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.306+0000 7efcbd6dd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f97f37d10 0x557f97f449f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:12.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.306+0000 7efcbd6dd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f97f3bd40 0x557f97f44f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:12.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.306+0000 7efcbd6dd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efcb41aa120 con 0x557f97f3bd40 2024-09-19T09:04:12.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.306+0000 7efcbd6dd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efcb41ab590 con 0x557f97f37d10 2024-09-19T09:04:12.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.306+0000 7efcbd6dd740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7efcb41aa7f0 con 0x557f97f30b60 2024-09-19T09:04:12.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.306+0000 7efcbd6dd740 10 client.0 _ll_register_callbacks cb 0x7efca400a560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:12.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.306+0000 7efcb98a1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f97f3bd40 0x557f97f44f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:12.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.306+0000 7efcb889f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f97f37d10 0x557f97f449f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:12.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.306+0000 7efcb98a1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f97f3bd40 0x557f97f44f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56488/0 (socket says 172.21.15.92:56488) 2024-09-19T09:04:12.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.306+0000 7efcb98a1640 1 -- 172.21.15.92:0/2710432178 learned_addr learned my addr 172.21.15.92:0/2710432178 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:12.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.306+0000 7efcb889f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f97f37d10 0x557f97f449f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:48418/0 (socket says 172.21.15.92:48418) 2024-09-19T09:04:12.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.307+0000 7efcb90a0640 1 --2- 172.21.15.92:0/2710432178 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f97f30b60 0x557f97f486b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:12.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.307+0000 7efcb98a1640 1 -- 172.21.15.92:0/2710432178 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f97f30b60 msgr2=0x557f97f486b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:12.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.307+0000 7efcb98a1640 1 --2- 172.21.15.92:0/2710432178 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f97f30b60 0x557f97f486b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:12.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.307+0000 7efcb98a1640 1 -- 172.21.15.92:0/2710432178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f97f37d10 msgr2=0x557f97f449f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:12.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.307+0000 7efcb98a1640 1 --2- 172.21.15.92:0/2710432178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f97f37d10 0x557f97f449f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:12.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.307+0000 7efcb98a1640 1 -- 172.21.15.92:0/2710432178 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f97f455a0 con 0x557f97f3bd40 2024-09-19T09:04:12.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.307+0000 7efcb90a0640 1 --2- 172.21.15.92:0/2710432178 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f97f30b60 0x557f97f486b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:12.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.307+0000 7efcb889f640 1 --2- 172.21.15.92:0/2710432178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f97f37d10 0x557f97f449f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:12.311 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:12.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.307+0000 7efcb98a1640 1 --2- 172.21.15.92:0/2710432178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f97f3bd40 0x557f97f44f30 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7efcac00c3f0 tx=0x7efcac004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f257ff1594fb876f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:12.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.307+0000 7efc9cff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:04:12.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.307+0000 7efc9cff9640 1 -- 172.21.15.92:0/2710432178 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcac02b060 con 0x557f97f3bd40 2024-09-19T09:04:12.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.307+0000 7efc9cff9640 1 -- 172.21.15.92:0/2710432178 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7efcac01ed60 con 0x557f97f3bd40 2024-09-19T09:04:12.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.307+0000 7efcbd6dd740 1 -- 172.21.15.92:0/2710432178 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efca400fb30 con 0x557f97f3bd40 2024-09-19T09:04:12.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.307+0000 7efc9cff9640 1 -- 172.21.15.92:0/2710432178 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7efcac015070 con 0x557f97f3bd40 2024-09-19T09:04:12.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.307+0000 7efcbd6dd740 10 client.17127 fetch_fsmap learned FSMap version 19 2024-09-19T09:04:12.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.307+0000 7efcbd6dd740 1 -- 172.21.15.92:0/2710432178 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x557f97fbb910 con 0x557f97f3bd40 2024-09-19T09:04:12.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.308+0000 7efc9cff9640 1 -- 172.21.15.92:0/2710432178 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efca400fb30 con 0x557f97f3bd40 2024-09-19T09:04:12.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.308+0000 7efc9cff9640 1 -- 172.21.15.92:0/2710432178 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7efcac030070 con 0x557f97f3bd40 2024-09-19T09:04:12.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.308+0000 7efcbd6dd740 10 client.17127 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:04:12.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.308+0000 7efcbd6dd740 10 client.17127 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:04:12.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.308+0000 7efcbd6dd740 20 client.17127 populate_metadata read hostname 'smithi092' 2024-09-19T09:04:12.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.308+0000 7efcbd6dd740 1 --2- 172.21.15.92:0/2710432178 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557f97fbc060 0x557f97fbe480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:12.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.308+0000 7efcbd6dd740 4 client.17127 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:04:12.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.308+0000 7efcbd6dd740 1 -- 172.21.15.92:0/2710432178 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557f97e9dd00 con 0x557f97fbc060 2024-09-19T09:04:12.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.308+0000 7efcb90a0640 1 --2- 172.21.15.92:0/2710432178 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557f97fbc060 0x557f97fbe480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:12.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.309+0000 7efc9cff9640 10 client.17127 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:12.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.309+0000 7efcb90a0640 1 --2- 172.21.15.92:0/2710432178 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557f97fbc060 0x557f97fbe480 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d2f7510d8a14228 server_cookie=a4bb31b2e88d6b42 in_seq=0 out_seq=0 2024-09-19T09:04:12.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.310+0000 7efc9cff9640 1 -- 172.21.15.92:0/2710432178 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557f97e9dd00 con 0x557f97fbc060 2024-09-19T09:04:12.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.310+0000 7efc9cff9640 10 client.17127 handle_command_reply: tid=0 2024-09-19T09:04:12.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.310+0000 7efcbd6dd740 1 client.17127 shutdown 2024-09-19T09:04:12.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.310+0000 7efcbd6dd740 1 -- 172.21.15.92:0/2710432178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f97f3bd40 msgr2=0x557f97f44f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:12.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.310+0000 7efcbd6dd740 1 --2- 172.21.15.92:0/2710432178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f97f3bd40 0x557f97f44f30 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7efcac00c3f0 tx=0x7efcac004b50 comp rx=0 tx=0).stop 2024-09-19T09:04:12.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.310+0000 7efcbd6dd740 1 -- 172.21.15.92:0/2710432178 shutdown_connections 2024-09-19T09:04:12.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.310+0000 7efcbd6dd740 1 --2- 172.21.15.92:0/2710432178 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557f97fbc060 0x557f97fbe480 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:12.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.310+0000 7efc9cff9640 0 client.17127 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:12.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.310+0000 7efcbd6dd740 1 --2- 172.21.15.92:0/2710432178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557f97f3bd40 0x557f97f44f30 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:12.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.310+0000 7efcbd6dd740 1 --2- 172.21.15.92:0/2710432178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f97f37d10 0x557f97f449f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:12.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.310+0000 7efcbd6dd740 1 --2- 172.21.15.92:0/2710432178 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f97f30b60 0x557f97f486b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:12.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.310+0000 7efcbd6dd740 1 -- 172.21.15.92:0/2710432178 >> 172.21.15.92:0/2710432178 conn(0x557f97f2d0f0 msgr2=0x557f97f2c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:12.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.310+0000 7efcbd6dd740 1 -- 172.21.15.92:0/2710432178 shutdown_connections 2024-09-19T09:04:12.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.310+0000 7efcbd6dd740 1 -- 172.21.15.92:0/2710432178 wait complete. 2024-09-19T09:04:12.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.310+0000 7efcbd6dd740 20 client.17127 trim_cache size 0 max 16384 2024-09-19T09:04:12.316 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:04:12.316 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-19T09:04:12.316 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "ab957761-6267-41cb-892b-35aed7acfede", 2024-09-19T09:04:12.316 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-19T09:04:12.316 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:04:12.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.311+0000 7efcbb304640 1 -- 172.21.15.92:0/3916693909 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efca00a3240 msgr2=0x7efca00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:12.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.311+0000 7efcbb304640 1 --2- 172.21.15.92:0/3916693909 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efca00a3240 0x7efca00a5700 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7efcac009fd0 tx=0x7efcac004a40 comp rx=0 tx=0).stop 2024-09-19T09:04:12.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.311+0000 7efcbb304640 1 -- 172.21.15.92:0/3916693909 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efcb4101420 msgr2=0x7efcb41997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:12.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.311+0000 7efcbb304640 1 --2- 172.21.15.92:0/3916693909 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efcb4101420 0x7efcb41997d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7efca400c920 tx=0x7efca400cde0 comp rx=0 tx=0).stop 2024-09-19T09:04:12.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.311+0000 7efcbb304640 1 -- 172.21.15.92:0/3916693909 shutdown_connections 2024-09-19T09:04:12.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.311+0000 7efcbb304640 1 --2- 172.21.15.92:0/3916693909 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcb4106a80 0x7efcb41a4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:12.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.311+0000 7efcbb304640 1 --2- 172.21.15.92:0/3916693909 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efca00a3240 0x7efca00a5700 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:12.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.311+0000 7efcbb304640 1 --2- 172.21.15.92:0/3916693909 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efcb4101420 0x7efcb41997d0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:12.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.311+0000 7efcbb304640 1 --2- 172.21.15.92:0/3916693909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcb4100a80 0x7efcb4199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:12.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.311+0000 7efcbb304640 1 -- 172.21.15.92:0/3916693909 >> 172.21.15.92:0/3916693909 conn(0x7efcb40fc7a0 msgr2=0x7efcb40fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:12.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.312+0000 7efcbb304640 1 -- 172.21.15.92:0/3916693909 shutdown_connections 2024-09-19T09:04:12.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:12.312+0000 7efcbb304640 1 -- 172.21.15.92:0/3916693909 wait complete. 2024-09-19T09:04:13.010 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:04:13.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.458+0000 7f27d0114640 1 -- 172.21.15.92:0/2004588726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27c8100e20 msgr2=0x7f27c8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:13.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.458+0000 7f27d0114640 1 --2- 172.21.15.92:0/2004588726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27c8100e20 0x7f27c8101200 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f27b8009900 tx=0x7f27b802a480 comp rx=0 tx=0).stop 2024-09-19T09:04:13.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.459+0000 7f27d0114640 1 -- 172.21.15.92:0/2004588726 shutdown_connections 2024-09-19T09:04:13.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.459+0000 7f27d0114640 1 --2- 172.21.15.92:0/2004588726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c8102ef0 0x7f27c810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.459+0000 7f27d0114640 1 --2- 172.21.15.92:0/2004588726 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27c8102570 0x7f27c81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.459+0000 7f27d0114640 1 --2- 172.21.15.92:0/2004588726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27c8100e20 0x7f27c8101200 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.459+0000 7f27d0114640 1 -- 172.21.15.92:0/2004588726 >> 172.21.15.92:0/2004588726 conn(0x7f27c80fc7d0 msgr2=0x7f27c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:13.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.459+0000 7f27d0114640 1 -- 172.21.15.92:0/2004588726 shutdown_connections 2024-09-19T09:04:13.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.459+0000 7f27d0114640 1 -- 172.21.15.92:0/2004588726 wait complete. 2024-09-19T09:04:13.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.459+0000 7f27d0114640 1 Processor -- start 2024-09-19T09:04:13.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.459+0000 7f27d0114640 1 -- start start 2024-09-19T09:04:13.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.460+0000 7f27d0114640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c8100e20 0x7f27c8103750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:13.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.460+0000 7f27d0114640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27c8102570 0x7f27c8103c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:13.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.460+0000 7f27d0114640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27c8102ef0 0x7f27c81041d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:13.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.460+0000 7f27d0114640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f27c8110f80 con 0x7f27c8102570 2024-09-19T09:04:13.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.460+0000 7f27d0114640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f27c8110e00 con 0x7f27c8100e20 2024-09-19T09:04:13.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.460+0000 7f27d0114640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f27c8111100 con 0x7f27c8102ef0 2024-09-19T09:04:13.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.460+0000 7f27cd6af640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27c8102570 0x7f27c8103c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:13.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.460+0000 7f27cdeb0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c8100e20 0x7f27c8103750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:13.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.460+0000 7f27cd6af640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27c8102570 0x7f27c8103c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56506/0 (socket says 172.21.15.92:56506) 2024-09-19T09:04:13.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.460+0000 7f27cd6af640 1 -- 172.21.15.92:0/3600503155 learned_addr learned my addr 172.21.15.92:0/3600503155 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:13.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.460+0000 7f27ce6b1640 1 --2- 172.21.15.92:0/3600503155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27c8102ef0 0x7f27c81041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:13.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.460+0000 7f27cd6af640 1 -- 172.21.15.92:0/3600503155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27c8102ef0 msgr2=0x7f27c81041d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:13.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.460+0000 7f27cd6af640 1 --2- 172.21.15.92:0/3600503155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27c8102ef0 0x7f27c81041d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.460+0000 7f27cd6af640 1 -- 172.21.15.92:0/3600503155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c8100e20 msgr2=0x7f27c8103750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:13.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.460+0000 7f27cd6af640 1 --2- 172.21.15.92:0/3600503155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c8100e20 0x7f27c8103750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.460+0000 7f27cd6af640 1 -- 172.21.15.92:0/3600503155 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27c81aae60 con 0x7f27c8102570 2024-09-19T09:04:13.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.460+0000 7f27cd6af640 1 --2- 172.21.15.92:0/3600503155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27c8102570 0x7f27c8103c90 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f27c400c970 tx=0x7f27c400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:13.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.461+0000 7f27beffd640 1 -- 172.21.15.92:0/3600503155 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c4007bb0 con 0x7f27c8102570 2024-09-19T09:04:13.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.461+0000 7f27d0114640 1 -- 172.21.15.92:0/3600503155 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27c81ab090 con 0x7f27c8102570 2024-09-19T09:04:13.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.461+0000 7f27beffd640 1 -- 172.21.15.92:0/3600503155 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27c4007d50 con 0x7f27c8102570 2024-09-19T09:04:13.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.461+0000 7f27beffd640 1 -- 172.21.15.92:0/3600503155 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c400f450 con 0x7f27c8102570 2024-09-19T09:04:13.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.461+0000 7f27d0114640 1 -- 172.21.15.92:0/3600503155 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27c81ab5d0 con 0x7f27c8102570 2024-09-19T09:04:13.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.462+0000 7f27d0114640 1 -- 172.21.15.92:0/3600503155 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27c81021b0 con 0x7f27c8102570 2024-09-19T09:04:13.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.463+0000 7f27beffd640 1 -- 172.21.15.92:0/3600503155 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f27c4005020 con 0x7f27c8102570 2024-09-19T09:04:13.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.464+0000 7f27beffd640 1 --2- 172.21.15.92:0/3600503155 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f27b40a32c0 0x7f27b40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:13.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.464+0000 7f27cdeb0640 1 --2- 172.21.15.92:0/3600503155 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f27b40a32c0 0x7f27b40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:13.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.464+0000 7f27beffd640 1 -- 172.21.15.92:0/3600503155 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f27c40cf610 con 0x7f27c8102570 2024-09-19T09:04:13.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.464+0000 7f27cdeb0640 1 --2- 172.21.15.92:0/3600503155 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f27b40a32c0 0x7f27b40a5780 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f27b8000c00 tx=0x7f27b80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:13.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.469+0000 7f27beffd640 1 -- 172.21.15.92:0/3600503155 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f27c4014030 con 0x7f27c8102570 2024-09-19T09:04:13.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.476+0000 7f8a3a92c640 1 -- 172.21.15.92:0/2715896741 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a34104f30 msgr2=0x7f8a34107320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:13.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.476+0000 7f8a3a92c640 1 --2- 172.21.15.92:0/2715896741 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a34104f30 0x7f8a34107320 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c009900 tx=0x7f8a1c02a410 comp rx=0 tx=0).stop 2024-09-19T09:04:13.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.476+0000 7f8a3a92c640 1 -- 172.21.15.92:0/2715896741 shutdown_connections 2024-09-19T09:04:13.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.476+0000 7f8a3a92c640 1 --2- 172.21.15.92:0/2715896741 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a34107860 0x7f8a34109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.476+0000 7f8a3a92c640 1 --2- 172.21.15.92:0/2715896741 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a34104f30 0x7f8a34107320 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.476+0000 7f8a3a92c640 1 --2- 172.21.15.92:0/2715896741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a34102600 0x7f8a341049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.476+0000 7f8a3a92c640 1 -- 172.21.15.92:0/2715896741 >> 172.21.15.92:0/2715896741 conn(0x7f8a340fc1e0 msgr2=0x7f8a340fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:13.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.476+0000 7f8a3a92c640 1 -- 172.21.15.92:0/2715896741 shutdown_connections 2024-09-19T09:04:13.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.476+0000 7f8a3a92c640 1 -- 172.21.15.92:0/2715896741 wait complete. 2024-09-19T09:04:13.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.477+0000 7f8a3a92c640 1 Processor -- start 2024-09-19T09:04:13.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.477+0000 7f8a3a92c640 1 -- start start 2024-09-19T09:04:13.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.477+0000 7f8a3a92c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a34102600 0x7f8a34197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:13.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.477+0000 7f8a3a92c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a34104f30 0x7f8a34198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:13.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.477+0000 7f8a3a92c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a34107860 0x7f8a3419f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:13.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.477+0000 7f8a3a92c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3410d7e0 con 0x7f8a34102600 2024-09-19T09:04:13.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.477+0000 7f8a3a92c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3410d660 con 0x7f8a34104f30 2024-09-19T09:04:13.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.477+0000 7f8a3a92c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3410d960 con 0x7f8a34107860 2024-09-19T09:04:13.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.477+0000 7f8a33fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a34102600 0x7f8a34197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:13.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.477+0000 7f8a33fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a34102600 0x7f8a34197e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56524/0 (socket says 172.21.15.92:56524) 2024-09-19T09:04:13.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.477+0000 7f8a33fff640 1 -- 172.21.15.92:0/1498226064 learned_addr learned my addr 172.21.15.92:0/1498226064 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:13.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.477+0000 7f8a38ec9640 1 --2- 172.21.15.92:0/1498226064 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a34107860 0x7f8a3419f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:13.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.477+0000 7f8a337fe640 1 --2- 172.21.15.92:0/1498226064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a34104f30 0x7f8a34198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:13.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.478+0000 7f8a33fff640 1 -- 172.21.15.92:0/1498226064 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a34107860 msgr2=0x7f8a3419f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:13.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.478+0000 7f8a33fff640 1 --2- 172.21.15.92:0/1498226064 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a34107860 0x7f8a3419f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.478+0000 7f8a33fff640 1 -- 172.21.15.92:0/1498226064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a34104f30 msgr2=0x7f8a34198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:13.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.478+0000 7f8a33fff640 1 --2- 172.21.15.92:0/1498226064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a34104f30 0x7f8a34198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.478+0000 7f8a33fff640 1 -- 172.21.15.92:0/1498226064 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a3419fa30 con 0x7f8a34102600 2024-09-19T09:04:13.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.478+0000 7f8a33fff640 1 --2- 172.21.15.92:0/1498226064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a34102600 0x7f8a34197e10 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f8a2400d950 tx=0x7f8a2400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:13.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.478+0000 7f8a317fa640 1 -- 172.21.15.92:0/1498226064 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a24017070 con 0x7f8a34102600 2024-09-19T09:04:13.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.478+0000 7f8a317fa640 1 -- 172.21.15.92:0/1498226064 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a24009c30 con 0x7f8a34102600 2024-09-19T09:04:13.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.478+0000 7f8a3a92c640 1 -- 172.21.15.92:0/1498226064 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a3419fd20 con 0x7f8a34102600 2024-09-19T09:04:13.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.478+0000 7f8a317fa640 1 -- 172.21.15.92:0/1498226064 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2400f6b0 con 0x7f8a34102600 2024-09-19T09:04:13.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.478+0000 7f8a3a92c640 1 -- 172.21.15.92:0/1498226064 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a341a0190 con 0x7f8a34102600 2024-09-19T09:04:13.487 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.480+0000 7f8a317fa640 1 -- 172.21.15.92:0/1498226064 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8a240109d0 con 0x7f8a34102600 2024-09-19T09:04:13.487 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.481+0000 7f8a3d6bf740 1 Processor -- start 2024-09-19T09:04:13.487 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.481+0000 7f8a3d6bf740 1 -- start start 2024-09-19T09:04:13.487 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.481+0000 7f8a3d6bf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558fb53809a0 0x558fb5380da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:13.487 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.481+0000 7f8a3d6bf740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fb53812e0 0x558fb5385da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:13.487 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.481+0000 7f8a3d6bf740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558fb5386370 0x558fb5388830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:13.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.481+0000 7f8a3d6bf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558fb52e42f0 con 0x558fb53809a0 2024-09-19T09:04:13.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.481+0000 7f8a3d6bf740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558fb528c270 con 0x558fb53812e0 2024-09-19T09:04:13.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.481+0000 7f8a3d6bf740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x558fb52e02b0 con 0x558fb5386370 2024-09-19T09:04:13.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.481+0000 7f8a38ec9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558fb53809a0 0x558fb5380da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:13.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.481+0000 7f8a38ec9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558fb53809a0 0x558fb5380da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56530/0 (socket says 172.21.15.92:56530) 2024-09-19T09:04:13.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.481+0000 7f8a38ec9640 1 -- 172.21.15.92:0/3558244130 learned_addr learned my addr 172.21.15.92:0/3558244130 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:13.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.481+0000 7f8a337fe640 1 --2- 172.21.15.92:0/3558244130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558fb5386370 0x558fb5388830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:13.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.481+0000 7f8a33fff640 1 --2- 172.21.15.92:0/3558244130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fb53812e0 0x558fb5385da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:13.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.481+0000 7f8a317fa640 1 --2- 172.21.15.92:0/1498226064 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8a200a32f0 0x7f8a200a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:13.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.481+0000 7f8a38ec9640 1 -- 172.21.15.92:0/3558244130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558fb5386370 msgr2=0x558fb5388830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:13.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.481+0000 7f8a38ec9640 1 --2- 172.21.15.92:0/3558244130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558fb5386370 0x558fb5388830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.481+0000 7f8a38ec9640 1 -- 172.21.15.92:0/3558244130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fb53812e0 msgr2=0x558fb5385da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:13.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.481+0000 7f8a38ec9640 1 --2- 172.21.15.92:0/3558244130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fb53812e0 0x558fb5385da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.481+0000 7f8a38ec9640 1 -- 172.21.15.92:0/3558244130 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fb528b340 con 0x558fb53809a0 2024-09-19T09:04:13.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.481+0000 7f8a337fe640 1 --2- 172.21.15.92:0/3558244130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558fb5386370 0x558fb5388830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:13.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.481+0000 7f8a317fa640 1 -- 172.21.15.92:0/1498226064 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8a240cf5a0 con 0x7f8a34102600 2024-09-19T09:04:13.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.482+0000 7f8a38ec9640 1 --2- 172.21.15.92:0/1498226064 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8a200a32f0 0x7f8a200a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:13.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.482+0000 7f8a38ec9640 1 --2- 172.21.15.92:0/3558244130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558fb53809a0 0x558fb5380da0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c010540 tx=0x7f8a2c010a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b9d98b1a0b469a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:13.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.482+0000 7f8a2a7fc640 1 -- 172.21.15.92:0/3558244130 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c004b20 con 0x558fb53809a0 2024-09-19T09:04:13.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.482+0000 7f8a2a7fc640 1 -- 172.21.15.92:0/3558244130 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a2c004cc0 con 0x558fb53809a0 2024-09-19T09:04:13.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.482+0000 7f8a2a7fc640 1 -- 172.21.15.92:0/3558244130 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c01d640 con 0x558fb53809a0 2024-09-19T09:04:13.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.483+0000 7f8a3d6bf740 1 -- 172.21.15.92:0/3558244130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558fb53809a0 msgr2=0x558fb5380da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:13.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.483+0000 7f8a3d6bf740 1 --2- 172.21.15.92:0/3558244130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558fb53809a0 0x558fb5380da0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c010540 tx=0x7f8a2c010a00 comp rx=0 tx=0).stop 2024-09-19T09:04:13.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.483+0000 7f8a38ec9640 1 --2- 172.21.15.92:0/1498226064 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8a200a32f0 0x7f8a200a57b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c021000 tx=0x7f8a2c01e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:13.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.483+0000 7f8a3d6bf740 1 -- 172.21.15.92:0/3558244130 shutdown_connections 2024-09-19T09:04:13.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.483+0000 7f8a3d6bf740 1 --2- 172.21.15.92:0/3558244130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558fb5386370 0x558fb5388830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.483+0000 7f8a3d6bf740 1 --2- 172.21.15.92:0/3558244130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fb53812e0 0x558fb5385da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.483+0000 7f8a3d6bf740 1 --2- 172.21.15.92:0/3558244130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558fb53809a0 0x558fb5380da0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.483+0000 7f8a3d6bf740 1 -- 172.21.15.92:0/3558244130 >> 172.21.15.92:0/3558244130 conn(0x558fb537c010 msgr2=0x558fb537c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:13.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.483+0000 7f8a3d6bf740 1 -- 172.21.15.92:0/3558244130 shutdown_connections 2024-09-19T09:04:13.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.483+0000 7f8a3d6bf740 1 -- 172.21.15.92:0/3558244130 wait complete. 2024-09-19T09:04:13.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.483+0000 7f8a3d6bf740 1 -- start start 2024-09-19T09:04:13.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.483+0000 7f8a3d6bf740 1 Processor -- start 2024-09-19T09:04:13.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.483+0000 7f8a3d6bf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558fb53809a0 0x558fb538ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:13.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.483+0000 7f8a3d6bf740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fb53812e0 0x558fb538b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:13.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.483+0000 7f8a3d6bf740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558fb5386370 0x558fb5392170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:13.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.484+0000 7f8a3d6bf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558fb5389340 con 0x558fb53809a0 2024-09-19T09:04:13.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.484+0000 7f8a3d6bf740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558fb526d290 con 0x558fb53812e0 2024-09-19T09:04:13.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.484+0000 7f8a3d6bf740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x558fb53894c0 con 0x558fb5386370 2024-09-19T09:04:13.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.484+0000 7f8a3d6bf740 10 client.0 _ll_register_callbacks cb 0x558fb529e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:13.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.484+0000 7f8a33fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558fb53809a0 0x558fb538ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:13.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.484+0000 7f8a33fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558fb53809a0 0x558fb538ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56536/0 (socket says 172.21.15.92:56536) 2024-09-19T09:04:13.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.484+0000 7f8a33fff640 1 -- 172.21.15.92:0/445711394 learned_addr learned my addr 172.21.15.92:0/445711394 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:13.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.484+0000 7f8a337fe640 1 --2- 172.21.15.92:0/445711394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fb53812e0 0x558fb538b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:13.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.484+0000 7f8a38ec9640 1 --2- 172.21.15.92:0/445711394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558fb5386370 0x558fb5392170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:13.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.484+0000 7f8a33fff640 1 -- 172.21.15.92:0/445711394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558fb5386370 msgr2=0x558fb5392170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:13.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.484+0000 7f8a33fff640 1 --2- 172.21.15.92:0/445711394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558fb5386370 0x558fb5392170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.484+0000 7f8a33fff640 1 -- 172.21.15.92:0/445711394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fb53812e0 msgr2=0x558fb538b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:13.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.484+0000 7f8a33fff640 1 --2- 172.21.15.92:0/445711394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fb53812e0 0x558fb538b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.484+0000 7f8a33fff640 1 -- 172.21.15.92:0/445711394 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fb4ff7210 con 0x558fb53809a0 2024-09-19T09:04:13.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.484+0000 7f8a337fe640 1 --2- 172.21.15.92:0/445711394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fb53812e0 0x558fb538b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:13.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.484+0000 7f8a38ec9640 1 --2- 172.21.15.92:0/445711394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558fb5386370 0x558fb5392170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:13.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.484+0000 7f8a33fff640 1 --2- 172.21.15.92:0/445711394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558fb53809a0 0x558fb538ac60 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f8a24098020 tx=0x7f8a240d2c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb48e8b0f229aa0e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:13.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.484+0000 7f8a137fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:04:13.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.484+0000 7f8a137fe640 1 -- 172.21.15.92:0/445711394 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a24020040 con 0x558fb53809a0 2024-09-19T09:04:13.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.484+0000 7f8a3d6bf740 1 -- 172.21.15.92:0/445711394 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a2c004cc0 con 0x558fb53809a0 2024-09-19T09:04:13.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.484+0000 7f8a137fe640 1 -- 172.21.15.92:0/445711394 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8a240860c0 con 0x558fb53809a0 2024-09-19T09:04:13.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.484+0000 7f8a137fe640 1 -- 172.21.15.92:0/445711394 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8a2409b520 con 0x558fb53809a0 2024-09-19T09:04:13.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.484+0000 7f8a3d6bf740 10 client.17145 fetch_fsmap learned FSMap version 19 2024-09-19T09:04:13.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.484+0000 7f8a3d6bf740 1 -- 172.21.15.92:0/445711394 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x558fb50c3620 con 0x558fb53809a0 2024-09-19T09:04:13.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.485+0000 7f8a137fe640 1 -- 172.21.15.92:0/445711394 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a2c004cc0 con 0x558fb53809a0 2024-09-19T09:04:13.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.485+0000 7f8a137fe640 1 -- 172.21.15.92:0/445711394 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f8a240cf0d0 con 0x558fb53809a0 2024-09-19T09:04:13.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.485+0000 7f8a3d6bf740 10 client.17145 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:04:13.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.485+0000 7f8a3d6bf740 10 client.17145 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:04:13.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.485+0000 7f8a3d6bf740 20 client.17145 populate_metadata read hostname 'smithi092' 2024-09-19T09:04:13.493 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.485+0000 7f8a3d6bf740 1 --2- 172.21.15.92:0/445711394 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558fb53968b0 0x558fb5398d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:13.493 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.485+0000 7f8a3d6bf740 4 client.17145 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:13.493 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.485+0000 7f8a3d6bf740 1 -- 172.21.15.92:0/445711394 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558fb52f1a20 con 0x558fb53968b0 2024-09-19T09:04:13.493 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.485+0000 7f8a337fe640 1 --2- 172.21.15.92:0/445711394 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558fb53968b0 0x558fb5398d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:13.493 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.486+0000 7f8a337fe640 1 --2- 172.21.15.92:0/445711394 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558fb53968b0 0x558fb5398d00 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d12069620965112 server_cookie=1e02090f3739ed6a in_seq=0 out_seq=0 2024-09-19T09:04:13.493 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.486+0000 7f8a137fe640 10 client.17145 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:13.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.486+0000 7f8a137fe640 1 -- 172.21.15.92:0/445711394 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558fb52f1a20 con 0x558fb53968b0 2024-09-19T09:04:13.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.486+0000 7f8a137fe640 10 client.17145 handle_command_reply: tid=0 2024-09-19T09:04:13.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.487+0000 7f8a3d6bf740 1 client.17145 shutdown 2024-09-19T09:04:13.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.487+0000 7f8a3d6bf740 1 -- 172.21.15.92:0/445711394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558fb53809a0 msgr2=0x558fb538ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:13.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.487+0000 7f8a3d6bf740 1 --2- 172.21.15.92:0/445711394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558fb53809a0 0x558fb538ac60 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f8a24098020 tx=0x7f8a240d2c20 comp rx=0 tx=0).stop 2024-09-19T09:04:13.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.487+0000 7f8a3d6bf740 1 -- 172.21.15.92:0/445711394 shutdown_connections 2024-09-19T09:04:13.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.487+0000 7f8a3d6bf740 1 --2- 172.21.15.92:0/445711394 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558fb53968b0 0x558fb5398d00 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.487+0000 7f8a3d6bf740 1 --2- 172.21.15.92:0/445711394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558fb5386370 0x558fb5392170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.487+0000 7f8a3d6bf740 1 --2- 172.21.15.92:0/445711394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fb53812e0 0x558fb538b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.487+0000 7f8a137fe640 0 client.17145 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:13.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.487+0000 7f8a3d6bf740 1 --2- 172.21.15.92:0/445711394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558fb53809a0 0x558fb538ac60 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.487+0000 7f8a3d6bf740 1 -- 172.21.15.92:0/445711394 >> 172.21.15.92:0/445711394 conn(0x558fb537c010 msgr2=0x558fb537d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:13.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.487+0000 7f8a3d6bf740 1 -- 172.21.15.92:0/445711394 shutdown_connections 2024-09-19T09:04:13.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.487+0000 7f8a3d6bf740 1 -- 172.21.15.92:0/445711394 wait complete. 2024-09-19T09:04:13.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.487+0000 7f8a3d6bf740 20 client.17145 trim_cache size 0 max 16384 2024-09-19T09:04:13.503 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.501+0000 7f8a3d6bf740 1 Processor -- start 2024-09-19T09:04:13.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.501+0000 7f8a3d6bf740 1 -- start start 2024-09-19T09:04:13.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.501+0000 7f8a3d6bf740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558fb53809a0 0x558fb538b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:13.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.501+0000 7f8a3d6bf740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fb53812e0 0x558fb5392130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:13.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.501+0000 7f8a3d6bf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558fb5386370 0x558fb537f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:13.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.501+0000 7f8a3d6bf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8a341a6f40 con 0x558fb5386370 2024-09-19T09:04:13.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.501+0000 7f8a3d6bf740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8a341a97e0 con 0x558fb53812e0 2024-09-19T09:04:13.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.501+0000 7f8a3d6bf740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8a341a75d0 con 0x558fb53809a0 2024-09-19T09:04:13.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.501+0000 7f8a38ec9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558fb5386370 0x558fb537f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:13.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.501+0000 7f8a38ec9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558fb5386370 0x558fb537f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56548/0 (socket says 172.21.15.92:56548) 2024-09-19T09:04:13.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.501+0000 7f8a38ec9640 1 -- 172.21.15.92:0/2145276949 learned_addr learned my addr 172.21.15.92:0/2145276949 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:13.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.502+0000 7f8a33fff640 1 --2- 172.21.15.92:0/2145276949 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558fb53809a0 0x558fb538b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:13.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.502+0000 7f8a337fe640 1 --2- 172.21.15.92:0/2145276949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fb53812e0 0x558fb5392130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:13.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.502+0000 7f8a38ec9640 1 -- 172.21.15.92:0/2145276949 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558fb53809a0 msgr2=0x558fb538b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:13.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.502+0000 7f8a38ec9640 1 --2- 172.21.15.92:0/2145276949 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558fb53809a0 0x558fb538b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.502+0000 7f8a38ec9640 1 -- 172.21.15.92:0/2145276949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fb53812e0 msgr2=0x558fb5392130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:13.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.502+0000 7f8a38ec9640 1 --2- 172.21.15.92:0/2145276949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fb53812e0 0x558fb5392130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.502+0000 7f8a38ec9640 1 -- 172.21.15.92:0/2145276949 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fb538a7a0 con 0x558fb5386370 2024-09-19T09:04:13.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.502+0000 7f8a38ec9640 1 --2- 172.21.15.92:0/2145276949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558fb5386370 0x558fb537f410 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c011010 tx=0x7f8a2c028000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8187f344030734c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:13.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.502+0000 7f8a29ffb640 1 -- 172.21.15.92:0/2145276949 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c037070 con 0x558fb5386370 2024-09-19T09:04:13.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.502+0000 7f8a29ffb640 1 -- 172.21.15.92:0/2145276949 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a2c02e040 con 0x558fb5386370 2024-09-19T09:04:13.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.502+0000 7f8a29ffb640 1 -- 172.21.15.92:0/2145276949 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c005690 con 0x558fb5386370 2024-09-19T09:04:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.503+0000 7f8a3d6bf740 1 -- 172.21.15.92:0/2145276949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558fb5386370 msgr2=0x558fb537f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.503+0000 7f8a3d6bf740 1 --2- 172.21.15.92:0/2145276949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558fb5386370 0x558fb537f410 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c011010 tx=0x7f8a2c028000 comp rx=0 tx=0).stop 2024-09-19T09:04:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.503+0000 7f8a3d6bf740 1 -- 172.21.15.92:0/2145276949 shutdown_connections 2024-09-19T09:04:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.503+0000 7f8a3d6bf740 1 --2- 172.21.15.92:0/2145276949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558fb5386370 0x558fb537f410 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.503+0000 7f8a3d6bf740 1 --2- 172.21.15.92:0/2145276949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fb53812e0 0x558fb5392130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.503+0000 7f8a3d6bf740 1 --2- 172.21.15.92:0/2145276949 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558fb53809a0 0x558fb538b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.503+0000 7f8a3d6bf740 1 -- 172.21.15.92:0/2145276949 >> 172.21.15.92:0/2145276949 conn(0x558fb537c010 msgr2=0x558fb537b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.503+0000 7f8a3d6bf740 1 -- 172.21.15.92:0/2145276949 shutdown_connections 2024-09-19T09:04:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.503+0000 7f8a3d6bf740 1 -- 172.21.15.92:0/2145276949 wait complete. 2024-09-19T09:04:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.503+0000 7f8a3d6bf740 1 -- start start 2024-09-19T09:04:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.504+0000 7f8a3d6bf740 1 Processor -- start 2024-09-19T09:04:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.504+0000 7f8a3d6bf740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fb53809a0 0x558fb538f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.504+0000 7f8a3d6bf740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558fb53812e0 0x558fb538feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.504+0000 7f8a3d6bf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558fb5386370 0x558fb5390e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.504+0000 7f8a3d6bf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8a341a7ca0 con 0x558fb5386370 2024-09-19T09:04:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.504+0000 7f8a3d6bf740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8a341a9110 con 0x558fb53809a0 2024-09-19T09:04:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.504+0000 7f8a3d6bf740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8a341a8370 con 0x558fb53812e0 2024-09-19T09:04:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.504+0000 7f8a3d6bf740 10 client.0 _ll_register_callbacks cb 0x7f8a240d2b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.504+0000 7f8a38ec9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558fb5386370 0x558fb5390e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.504+0000 7f8a38ec9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558fb5386370 0x558fb5390e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56550/0 (socket says 172.21.15.92:56550) 2024-09-19T09:04:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.504+0000 7f8a38ec9640 1 -- 172.21.15.92:0/2008035347 learned_addr learned my addr 172.21.15.92:0/2008035347 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.504+0000 7f8a337fe640 1 --2- 172.21.15.92:0/2008035347 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558fb53812e0 0x558fb538feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.504+0000 7f8a33fff640 1 --2- 172.21.15.92:0/2008035347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fb53809a0 0x558fb538f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.504+0000 7f8a38ec9640 1 -- 172.21.15.92:0/2008035347 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558fb53812e0 msgr2=0x558fb538feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.504+0000 7f8a38ec9640 1 --2- 172.21.15.92:0/2008035347 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558fb53812e0 0x558fb538feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.504+0000 7f8a38ec9640 1 -- 172.21.15.92:0/2008035347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fb53809a0 msgr2=0x558fb538f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.504+0000 7f8a38ec9640 1 --2- 172.21.15.92:0/2008035347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fb53809a0 0x558fb538f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.504+0000 7f8a38ec9640 1 -- 172.21.15.92:0/2008035347 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fb5391480 con 0x558fb5386370 2024-09-19T09:04:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.504+0000 7f8a337fe640 1 --2- 172.21.15.92:0/2008035347 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558fb53812e0 0x558fb538feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.504+0000 7f8a33fff640 1 --2- 172.21.15.92:0/2008035347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fb53809a0 0x558fb538f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.504+0000 7f8a38ec9640 1 --2- 172.21.15.92:0/2008035347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558fb5386370 0x558fb5390e70 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c013590 tx=0x7f8a2c005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7815aa364c5edaad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.504+0000 7f8a137fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:04:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.505+0000 7f8a137fe640 1 -- 172.21.15.92:0/2008035347 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c040020 con 0x558fb5386370 2024-09-19T09:04:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.505+0000 7f8a137fe640 1 -- 172.21.15.92:0/2008035347 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8a2c032840 con 0x558fb5386370 2024-09-19T09:04:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.505+0000 7f8a3d6bf740 1 -- 172.21.15.92:0/2008035347 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a2c02e040 con 0x558fb5386370 2024-09-19T09:04:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.505+0000 7f8a137fe640 1 -- 172.21.15.92:0/2008035347 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8a2c037070 con 0x558fb5386370 2024-09-19T09:04:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.505+0000 7f8a3d6bf740 10 client.17151 fetch_fsmap learned FSMap version 19 2024-09-19T09:04:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.505+0000 7f8a3d6bf740 1 -- 172.21.15.92:0/2008035347 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x558fb5401700 con 0x558fb5386370 2024-09-19T09:04:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.505+0000 7f8a137fe640 1 -- 172.21.15.92:0/2008035347 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a2c02e040 con 0x558fb5386370 2024-09-19T09:04:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.505+0000 7f8a137fe640 1 -- 172.21.15.92:0/2008035347 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f8a2c00f040 con 0x558fb5386370 2024-09-19T09:04:13.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.505+0000 7f8a3d6bf740 10 client.17151 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:04:13.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.505+0000 7f8a3d6bf740 10 client.17151 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:04:13.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.505+0000 7f8a3d6bf740 20 client.17151 populate_metadata read hostname 'smithi092' 2024-09-19T09:04:13.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.505+0000 7f8a3d6bf740 1 --2- 172.21.15.92:0/2008035347 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558fb5401e80 0x558fb54042a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:13.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.505+0000 7f8a3d6bf740 4 client.17151 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:04:13.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.505+0000 7f8a3d6bf740 1 -- 172.21.15.92:0/2008035347 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558fb52ebd70 con 0x558fb5401e80 2024-09-19T09:04:13.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.506+0000 7f8a33fff640 1 --2- 172.21.15.92:0/2008035347 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558fb5401e80 0x558fb54042a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:13.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.506+0000 7f8a137fe640 10 client.17151 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:13.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.506+0000 7f8a33fff640 1 --2- 172.21.15.92:0/2008035347 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558fb5401e80 0x558fb54042a0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86d9f67884254b7 server_cookie=5eed04c7b9f721c8 in_seq=0 out_seq=0 2024-09-19T09:04:13.523 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.521+0000 7f8a137fe640 1 -- 172.21.15.92:0/2008035347 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558fb52ebd70 con 0x558fb5401e80 2024-09-19T09:04:13.523 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.521+0000 7f8a137fe640 10 client.17151 handle_command_reply: tid=0 2024-09-19T09:04:13.523 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.521+0000 7f8a3d6bf740 1 client.17151 shutdown 2024-09-19T09:04:13.523 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.522+0000 7f8a3d6bf740 1 -- 172.21.15.92:0/2008035347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558fb5386370 msgr2=0x558fb5390e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:13.523 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.522+0000 7f8a3d6bf740 1 --2- 172.21.15.92:0/2008035347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558fb5386370 0x558fb5390e70 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c013590 tx=0x7f8a2c005740 comp rx=0 tx=0).stop 2024-09-19T09:04:13.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.522+0000 7f8a3d6bf740 1 -- 172.21.15.92:0/2008035347 shutdown_connections 2024-09-19T09:04:13.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.522+0000 7f8a3d6bf740 1 --2- 172.21.15.92:0/2008035347 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558fb5401e80 0x558fb54042a0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.522+0000 7f8a3d6bf740 1 --2- 172.21.15.92:0/2008035347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558fb5386370 0x558fb5390e70 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.522+0000 7f8a3d6bf740 1 --2- 172.21.15.92:0/2008035347 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558fb53812e0 0x558fb538feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.522+0000 7f8a3d6bf740 1 --2- 172.21.15.92:0/2008035347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fb53809a0 0x558fb538f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.522+0000 7f8a3d6bf740 1 -- 172.21.15.92:0/2008035347 >> 172.21.15.92:0/2008035347 conn(0x558fb537c010 msgr2=0x558fb537e400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:13.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.522+0000 7f8a137fe640 0 client.17151 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:13.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.522+0000 7f8a3d6bf740 1 -- 172.21.15.92:0/2008035347 shutdown_connections 2024-09-19T09:04:13.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.522+0000 7f8a3d6bf740 1 -- 172.21.15.92:0/2008035347 wait complete. 2024-09-19T09:04:13.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.522+0000 7f8a3d6bf740 20 client.17151 trim_cache size 0 max 16384 2024-09-19T09:04:13.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:04:13.525 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:04:13.525 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:04:13.525 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:04:13.525 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.523+0000 7f8a3a92c640 1 -- 172.21.15.92:0/1498226064 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8a200a32f0 msgr2=0x7f8a200a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:13.526 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.523+0000 7f8a3a92c640 1 --2- 172.21.15.92:0/1498226064 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8a200a32f0 0x7f8a200a57b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c021000 tx=0x7f8a2c01e000 comp rx=0 tx=0).stop 2024-09-19T09:04:13.526 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.523+0000 7f8a3a92c640 1 -- 172.21.15.92:0/1498226064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a34102600 msgr2=0x7f8a34197e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:13.526 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.523+0000 7f8a3a92c640 1 --2- 172.21.15.92:0/1498226064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a34102600 0x7f8a34197e10 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f8a2400d950 tx=0x7f8a2400de10 comp rx=0 tx=0).stop 2024-09-19T09:04:13.526 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.523+0000 7f8a3a92c640 1 -- 172.21.15.92:0/1498226064 shutdown_connections 2024-09-19T09:04:13.526 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.523+0000 7f8a3a92c640 1 --2- 172.21.15.92:0/1498226064 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a34107860 0x7f8a3419f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.526 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.523+0000 7f8a3a92c640 1 --2- 172.21.15.92:0/1498226064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a34104f30 0x7f8a34198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.526 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.523+0000 7f8a3a92c640 1 --2- 172.21.15.92:0/1498226064 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8a200a32f0 0x7f8a200a57b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.526 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.523+0000 7f8a3a92c640 1 --2- 172.21.15.92:0/1498226064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a34102600 0x7f8a34197e10 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.526 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.523+0000 7f8a3a92c640 1 -- 172.21.15.92:0/1498226064 >> 172.21.15.92:0/1498226064 conn(0x7f8a340fc1e0 msgr2=0x7f8a34102f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:13.526 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.523+0000 7f8a3a92c640 1 -- 172.21.15.92:0/1498226064 shutdown_connections 2024-09-19T09:04:13.526 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:13.523+0000 7f8a3a92c640 1 -- 172.21.15.92:0/1498226064 wait complete. 2024-09-19T09:04:13.554 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:13.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.689+0000 7f27d0114640 1 -- 172.21.15.92:0/3600503155 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f27c81ab8f0 con 0x7f27c8102570 2024-09-19T09:04:13.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.689+0000 7f27beffd640 1 -- 172.21.15.92:0/3600503155 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f27c409bce0 con 0x7f27c8102570 2024-09-19T09:04:13.691 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:04:13.691 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:04:13.691 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:04:13.692 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:13 smithi092 ceph-mon[31407]: scrub queued for path: / 2024-09-19T09:04:13.692 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:13 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:04:13.692 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:13 smithi092 ceph-mon[31407]: scrub summary: active paths [/] 2024-09-19T09:04:13.692 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:13 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:04:13.692 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:13 smithi092 ceph-mon[31407]: pgmap v562: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 579 KiB/s wr, 23 op/s 2024-09-19T09:04:13.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.692+0000 7f27d0114640 1 -- 172.21.15.92:0/3600503155 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f27b40a32c0 msgr2=0x7f27b40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:13.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.692+0000 7f27d0114640 1 --2- 172.21.15.92:0/3600503155 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f27b40a32c0 0x7f27b40a5780 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f27b8000c00 tx=0x7f27b80058d0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.692+0000 7f27d0114640 1 -- 172.21.15.92:0/3600503155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27c8102570 msgr2=0x7f27c8103c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:13.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.692+0000 7f27d0114640 1 --2- 172.21.15.92:0/3600503155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27c8102570 0x7f27c8103c90 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f27c400c970 tx=0x7f27c400ce30 comp rx=0 tx=0).stop 2024-09-19T09:04:13.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.692+0000 7f27d0114640 1 -- 172.21.15.92:0/3600503155 shutdown_connections 2024-09-19T09:04:13.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.692+0000 7f27d0114640 1 --2- 172.21.15.92:0/3600503155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27c8102ef0 0x7f27c81041d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.692+0000 7f27d0114640 1 --2- 172.21.15.92:0/3600503155 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f27b40a32c0 0x7f27b40a5780 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.692+0000 7f27d0114640 1 --2- 172.21.15.92:0/3600503155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27c8102570 0x7f27c8103c90 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.692+0000 7f27d0114640 1 --2- 172.21.15.92:0/3600503155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c8100e20 0x7f27c8103750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.692+0000 7f27d0114640 1 -- 172.21.15.92:0/3600503155 >> 172.21.15.92:0/3600503155 conn(0x7f27c80fc7d0 msgr2=0x7f27c806a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:13.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.692+0000 7f27d0114640 1 -- 172.21.15.92:0/3600503155 shutdown_connections 2024-09-19T09:04:13.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:13.692+0000 7f27d0114640 1 -- 172.21.15.92:0/3600503155 wait complete. 2024-09-19T09:04:13.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:13 smithi167 ceph-mon[35359]: scrub queued for path: / 2024-09-19T09:04:13.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:13 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:04:13.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:13 smithi167 ceph-mon[35359]: scrub summary: active paths [/] 2024-09-19T09:04:13.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:13 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:04:13.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:13 smithi167 ceph-mon[35359]: pgmap v562: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 579 KiB/s wr, 23 op/s 2024-09-19T09:04:13.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:13 smithi190 ceph-mon[35358]: scrub queued for path: / 2024-09-19T09:04:13.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:13 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:04:13.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:13 smithi190 ceph-mon[35358]: scrub summary: active paths [/] 2024-09-19T09:04:13.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:13 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:04:13.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:13 smithi190 ceph-mon[35358]: pgmap v562: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 579 KiB/s wr, 23 op/s 2024-09-19T09:04:14.431 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id 432ba889 --release --await' 2024-09-19T09:04:14.432 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id 432ba889 --release --await 2024-09-19T09:04:14.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.602+0000 7fbee4110640 1 -- 172.21.15.92:0/425663898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbedc105ec0 msgr2=0x7fbedc106340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:14.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.602+0000 7fbee4110640 1 --2- 172.21.15.92:0/425663898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbedc105ec0 0x7fbedc106340 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fbed4009ca0 tx=0x7fbed402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.602+0000 7fbee4110640 1 -- 172.21.15.92:0/425663898 shutdown_connections 2024-09-19T09:04:14.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.602+0000 7fbee4110640 1 --2- 172.21.15.92:0/425663898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbedc105ec0 0x7fbedc106340 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.602+0000 7fbee4110640 1 --2- 172.21.15.92:0/425663898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbedc1011e0 0x7fbedc105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.602+0000 7fbee4110640 1 --2- 172.21.15.92:0/425663898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbedc1008c0 0x7fbedc100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.602+0000 7fbee4110640 1 -- 172.21.15.92:0/425663898 >> 172.21.15.92:0/425663898 conn(0x7fbedc0fc7d0 msgr2=0x7fbedc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:14.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.602+0000 7fbee4110640 1 -- 172.21.15.92:0/425663898 shutdown_connections 2024-09-19T09:04:14.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.602+0000 7fbee4110640 1 -- 172.21.15.92:0/425663898 wait complete. 2024-09-19T09:04:14.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.603+0000 7fbee4110640 1 Processor -- start 2024-09-19T09:04:14.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.603+0000 7fbee4110640 1 -- start start 2024-09-19T09:04:14.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.603+0000 7fbee4110640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbedc1008c0 0x7fbedc1a4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:14.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.603+0000 7fbee4110640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbedc1011e0 0x7fbedc1a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:14.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.603+0000 7fbee4110640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbedc105ec0 0x7fbedc19e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:14.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.603+0000 7fbee4110640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc118690 con 0x7fbedc1008c0 2024-09-19T09:04:14.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.603+0000 7fbee4110640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc118510 con 0x7fbedc105ec0 2024-09-19T09:04:14.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.603+0000 7fbee4110640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc118810 con 0x7fbedc1011e0 2024-09-19T09:04:14.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.603+0000 7fbee1eac640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbedc1008c0 0x7fbedc1a4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:14.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.603+0000 7fbee1eac640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbedc1008c0 0x7fbedc1a4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56570/0 (socket says 172.21.15.92:56570) 2024-09-19T09:04:14.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.603+0000 7fbee1eac640 1 -- 172.21.15.92:0/1169979288 learned_addr learned my addr 172.21.15.92:0/1169979288 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:14.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.603+0000 7fbee16ab640 1 --2- 172.21.15.92:0/1169979288 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbedc1011e0 0x7fbedc1a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:14.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.603+0000 7fbee26ad640 1 --2- 172.21.15.92:0/1169979288 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbedc105ec0 0x7fbedc19e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:14.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.604+0000 7fbee1eac640 1 -- 172.21.15.92:0/1169979288 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbedc1011e0 msgr2=0x7fbedc1a4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:14.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.604+0000 7fbee1eac640 1 --2- 172.21.15.92:0/1169979288 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbedc1011e0 0x7fbedc1a4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.604+0000 7fbee1eac640 1 -- 172.21.15.92:0/1169979288 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbedc105ec0 msgr2=0x7fbedc19e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:14.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.604+0000 7fbee1eac640 1 --2- 172.21.15.92:0/1169979288 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbedc105ec0 0x7fbedc19e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.604+0000 7fbee1eac640 1 -- 172.21.15.92:0/1169979288 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbedc19f0f0 con 0x7fbedc1008c0 2024-09-19T09:04:14.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.604+0000 7fbee1eac640 1 --2- 172.21.15.92:0/1169979288 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbedc1008c0 0x7fbedc1a4800 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fbed800c890 tx=0x7fbed800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:14.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.604+0000 7fbed2ffd640 1 -- 172.21.15.92:0/1169979288 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed8004220 con 0x7fbedc1008c0 2024-09-19T09:04:14.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.604+0000 7fbee4110640 1 -- 172.21.15.92:0/1169979288 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbedc19f3e0 con 0x7fbedc1008c0 2024-09-19T09:04:14.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.604+0000 7fbed2ffd640 1 -- 172.21.15.92:0/1169979288 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbed80043c0 con 0x7fbedc1008c0 2024-09-19T09:04:14.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.604+0000 7fbed2ffd640 1 -- 172.21.15.92:0/1169979288 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed8004a00 con 0x7fbedc1008c0 2024-09-19T09:04:14.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.604+0000 7fbee4110640 1 -- 172.21.15.92:0/1169979288 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbedc1ab6d0 con 0x7fbedc1008c0 2024-09-19T09:04:14.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.606+0000 7fbed2ffd640 1 -- 172.21.15.92:0/1169979288 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fbed80079b0 con 0x7fbedc1008c0 2024-09-19T09:04:14.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.607+0000 7fbee64e9740 1 Processor -- start 2024-09-19T09:04:14.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.607+0000 7fbee64e9740 1 -- start start 2024-09-19T09:04:14.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.607+0000 7fbee64e9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bc508d4a0 0x555bc508d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:14.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.607+0000 7fbee64e9740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bc508ddc0 0x555bc5098140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:14.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.607+0000 7fbee64e9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bc5098680 0x555bc509aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:14.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.607+0000 7fbee64e9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555bc4ff32e0 con 0x555bc5098680 2024-09-19T09:04:14.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.607+0000 7fbee64e9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x555bc4f9ace0 con 0x555bc508d4a0 2024-09-19T09:04:14.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.607+0000 7fbee64e9740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x555bc4fef2a0 con 0x555bc508ddc0 2024-09-19T09:04:14.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.608+0000 7fbee16ab640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bc5098680 0x555bc509aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:14.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.608+0000 7fbee16ab640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bc5098680 0x555bc509aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56580/0 (socket says 172.21.15.92:56580) 2024-09-19T09:04:14.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.608+0000 7fbee16ab640 1 -- 172.21.15.92:0/333930685 learned_addr learned my addr 172.21.15.92:0/333930685 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:14.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.608+0000 7fbed2ffd640 1 --2- 172.21.15.92:0/1169979288 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fbec80a3240 0x7fbec80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:14.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.608+0000 7fbee1eac640 1 --2- 172.21.15.92:0/333930685 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bc508ddc0 0x555bc5098140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:14.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.608+0000 7fbee26ad640 1 --2- 172.21.15.92:0/333930685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bc508d4a0 0x555bc508d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:14.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.608+0000 7fbee26ad640 1 --2- 172.21.15.92:0/1169979288 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fbec80a3240 0x7fbec80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:14.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.608+0000 7fbed2ffd640 1 -- 172.21.15.92:0/1169979288 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fbed80cf620 con 0x7fbedc1008c0 2024-09-19T09:04:14.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.608+0000 7fbee16ab640 1 -- 172.21.15.92:0/333930685 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bc508ddc0 msgr2=0x555bc5098140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:14.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.608+0000 7fbee16ab640 1 --2- 172.21.15.92:0/333930685 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bc508ddc0 0x555bc5098140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.608+0000 7fbee16ab640 1 -- 172.21.15.92:0/333930685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bc508d4a0 msgr2=0x555bc508d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:14.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.608+0000 7fbee16ab640 1 --2- 172.21.15.92:0/333930685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bc508d4a0 0x555bc508d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.608+0000 7fbee16ab640 1 -- 172.21.15.92:0/333930685 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bc4f7f440 con 0x555bc5098680 2024-09-19T09:04:14.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.608+0000 7fbee26ad640 1 --2- 172.21.15.92:0/333930685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bc508d4a0 0x555bc508d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:14.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.608+0000 7fbee16ab640 1 --2- 172.21.15.92:0/333930685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bc5098680 0x555bc509aa70 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009a00 tx=0x7fbecc009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6c97b0a50366729 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:14.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.608+0000 7fbee26ad640 1 --2- 172.21.15.92:0/1169979288 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fbec80a3240 0x7fbec80a5700 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fbed4009a60 tx=0x7fbed40095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:14.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.608+0000 7fbec7fff640 1 -- 172.21.15.92:0/333930685 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbecc017070 con 0x555bc5098680 2024-09-19T09:04:14.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.609+0000 7fbec7fff640 1 -- 172.21.15.92:0/333930685 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbecc013470 con 0x555bc5098680 2024-09-19T09:04:14.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.609+0000 7fbec7fff640 1 -- 172.21.15.92:0/333930685 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbecc012610 con 0x555bc5098680 2024-09-19T09:04:14.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.610+0000 7fbee64e9740 1 -- 172.21.15.92:0/333930685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bc5098680 msgr2=0x555bc509aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:14.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.610+0000 7fbee64e9740 1 --2- 172.21.15.92:0/333930685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bc5098680 0x555bc509aa70 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009a00 tx=0x7fbecc009ec0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.610+0000 7fbee64e9740 1 -- 172.21.15.92:0/333930685 shutdown_connections 2024-09-19T09:04:14.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.610+0000 7fbee64e9740 1 --2- 172.21.15.92:0/333930685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bc5098680 0x555bc509aa70 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.610+0000 7fbee64e9740 1 --2- 172.21.15.92:0/333930685 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bc508ddc0 0x555bc5098140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.610+0000 7fbee64e9740 1 --2- 172.21.15.92:0/333930685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bc508d4a0 0x555bc508d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.610+0000 7fbee64e9740 1 -- 172.21.15.92:0/333930685 >> 172.21.15.92:0/333930685 conn(0x555bc5089a30 msgr2=0x555bc5089e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:14.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.610+0000 7fbee64e9740 1 -- 172.21.15.92:0/333930685 shutdown_connections 2024-09-19T09:04:14.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.610+0000 7fbee64e9740 1 -- 172.21.15.92:0/333930685 wait complete. 2024-09-19T09:04:14.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.610+0000 7fbee64e9740 1 -- start start 2024-09-19T09:04:14.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.611+0000 7fbee64e9740 1 Processor -- start 2024-09-19T09:04:14.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.611+0000 7fbee64e9740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bc508d4a0 0x555bc5095400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:14.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.611+0000 7fbee64e9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bc508ddc0 0x555bc5095940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:14.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.611+0000 7fbee64e9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bc5095e80 0x555bc50a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:14.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.611+0000 7fbee64e9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555bc509b250 con 0x555bc5095e80 2024-09-19T09:04:14.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.611+0000 7fbee64e9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x555bc4fae050 con 0x555bc508ddc0 2024-09-19T09:04:14.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.611+0000 7fbee64e9740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x555bc509b3d0 con 0x555bc508d4a0 2024-09-19T09:04:14.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.611+0000 7fbee64e9740 10 client.0 _ll_register_callbacks cb 0x555bc4fee160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:14.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.611+0000 7fbee26ad640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bc5095e80 0x555bc50a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:14.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.611+0000 7fbee26ad640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bc5095e80 0x555bc50a46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56590/0 (socket says 172.21.15.92:56590) 2024-09-19T09:04:14.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.611+0000 7fbee26ad640 1 -- 172.21.15.92:0/444380778 learned_addr learned my addr 172.21.15.92:0/444380778 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:14.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.611+0000 7fbee1eac640 1 --2- 172.21.15.92:0/444380778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bc508d4a0 0x555bc5095400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:14.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.611+0000 7fbee16ab640 1 --2- 172.21.15.92:0/444380778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bc508ddc0 0x555bc5095940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:14.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.612+0000 7fbee26ad640 1 -- 172.21.15.92:0/444380778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bc508d4a0 msgr2=0x555bc5095400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:14.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.612+0000 7fbee26ad640 1 --2- 172.21.15.92:0/444380778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bc508d4a0 0x555bc5095400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.612+0000 7fbee26ad640 1 -- 172.21.15.92:0/444380778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bc508ddc0 msgr2=0x555bc5095940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:14.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.612+0000 7fbee26ad640 1 --2- 172.21.15.92:0/444380778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bc508ddc0 0x555bc5095940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.612+0000 7fbee26ad640 1 -- 172.21.15.92:0/444380778 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bc4d643c0 con 0x555bc5095e80 2024-09-19T09:04:14.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.612+0000 7fbee16ab640 1 --2- 172.21.15.92:0/444380778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bc508ddc0 0x555bc5095940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:14.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.612+0000 7fbee26ad640 1 --2- 172.21.15.92:0/444380778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bc5095e80 0x555bc50a46f0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fbed4035000 tx=0x7fbed402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=530756d5418fb5fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:14.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.612+0000 7fbec57fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:04:14.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.612+0000 7fbec57fa640 1 -- 172.21.15.92:0/444380778 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed4003e20 con 0x555bc5095e80 2024-09-19T09:04:14.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.612+0000 7fbec57fa640 1 -- 172.21.15.92:0/444380778 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fbed40305c0 con 0x555bc5095e80 2024-09-19T09:04:14.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.612+0000 7fbee64e9740 1 -- 172.21.15.92:0/444380778 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbecc013470 con 0x555bc5095e80 2024-09-19T09:04:14.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.612+0000 7fbec57fa640 1 -- 172.21.15.92:0/444380778 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fbed40307c0 con 0x555bc5095e80 2024-09-19T09:04:14.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.612+0000 7fbee64e9740 10 client.17163 fetch_fsmap learned FSMap version 19 2024-09-19T09:04:14.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.612+0000 7fbee64e9740 1 -- 172.21.15.92:0/444380778 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x555bc50a7190 con 0x555bc5095e80 2024-09-19T09:04:14.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.612+0000 7fbec57fa640 1 -- 172.21.15.92:0/444380778 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbecc013470 con 0x555bc5095e80 2024-09-19T09:04:14.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.613+0000 7fbec57fa640 1 -- 172.21.15.92:0/444380778 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fbed402fc90 con 0x555bc5095e80 2024-09-19T09:04:14.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.613+0000 7fbee64e9740 10 client.17163 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:04:14.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.613+0000 7fbee64e9740 10 client.17163 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:04:14.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.613+0000 7fbee64e9740 20 client.17163 populate_metadata read hostname 'smithi092' 2024-09-19T09:04:14.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.613+0000 7fbee64e9740 1 --2- 172.21.15.92:0/444380778 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555bc50a85a0 0x555bc50aaa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:14.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.613+0000 7fbee64e9740 4 client.17163 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:14.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.613+0000 7fbee64e9740 1 -- 172.21.15.92:0/444380778 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555bc5000850 con 0x555bc50a85a0 2024-09-19T09:04:14.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.613+0000 7fbee1eac640 1 --2- 172.21.15.92:0/444380778 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555bc50a85a0 0x555bc50aaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:14.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.614+0000 7fbec57fa640 10 client.17163 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:14.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.614+0000 7fbee1eac640 1 --2- 172.21.15.92:0/444380778 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555bc50a85a0 0x555bc50aaa40 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a64f44ea2330616c server_cookie=28059df17172e8a9 in_seq=0 out_seq=0 2024-09-19T09:04:14.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.614+0000 7fbec57fa640 1 -- 172.21.15.92:0/444380778 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555bc5000850 con 0x555bc50a85a0 2024-09-19T09:04:14.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.614+0000 7fbec57fa640 10 client.17163 handle_command_reply: tid=0 2024-09-19T09:04:14.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.614+0000 7fbee64e9740 1 client.17163 shutdown 2024-09-19T09:04:14.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.615+0000 7fbee64e9740 1 -- 172.21.15.92:0/444380778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bc5095e80 msgr2=0x555bc50a46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:14.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.615+0000 7fbee64e9740 1 --2- 172.21.15.92:0/444380778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bc5095e80 0x555bc50a46f0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fbed4035000 tx=0x7fbed402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.615+0000 7fbee64e9740 1 -- 172.21.15.92:0/444380778 shutdown_connections 2024-09-19T09:04:14.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.615+0000 7fbee64e9740 1 --2- 172.21.15.92:0/444380778 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555bc50a85a0 0x555bc50aaa40 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.615+0000 7fbee64e9740 1 --2- 172.21.15.92:0/444380778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bc5095e80 0x555bc50a46f0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.615+0000 7fbec57fa640 0 client.17163 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:14.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.615+0000 7fbee64e9740 1 --2- 172.21.15.92:0/444380778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bc508ddc0 0x555bc5095940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.615+0000 7fbee64e9740 1 --2- 172.21.15.92:0/444380778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bc508d4a0 0x555bc5095400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.615+0000 7fbee64e9740 1 -- 172.21.15.92:0/444380778 >> 172.21.15.92:0/444380778 conn(0x555bc5089a30 msgr2=0x555bc508f790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:14.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.615+0000 7fbee64e9740 1 -- 172.21.15.92:0/444380778 shutdown_connections 2024-09-19T09:04:14.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.615+0000 7fbee64e9740 1 -- 172.21.15.92:0/444380778 wait complete. 2024-09-19T09:04:14.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.615+0000 7fbee64e9740 20 client.17163 trim_cache size 0 max 16384 2024-09-19T09:04:14.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.642+0000 7fbee64e9740 1 Processor -- start 2024-09-19T09:04:14.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.642+0000 7fbee64e9740 1 -- start start 2024-09-19T09:04:14.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.642+0000 7fbee64e9740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bc508d4a0 0x555bc5093cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:14.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.642+0000 7fbee64e9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bc508ddc0 0x555bc50a44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:14.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.642+0000 7fbee64e9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bc5095e80 0x555bc50a4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:14.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.642+0000 7fbee64e9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc1b1bd0 con 0x555bc5095e80 2024-09-19T09:04:14.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.642+0000 7fbee64e9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc1b4470 con 0x555bc508ddc0 2024-09-19T09:04:14.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.642+0000 7fbee64e9740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc1b2260 con 0x555bc508d4a0 2024-09-19T09:04:14.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.642+0000 7fbee26ad640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bc5095e80 0x555bc50a4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:14.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.642+0000 7fbee26ad640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bc5095e80 0x555bc50a4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56604/0 (socket says 172.21.15.92:56604) 2024-09-19T09:04:14.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.642+0000 7fbee26ad640 1 -- 172.21.15.92:0/1569173208 learned_addr learned my addr 172.21.15.92:0/1569173208 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:14.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.642+0000 7fbee16ab640 1 --2- 172.21.15.92:0/1569173208 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bc508ddc0 0x555bc50a44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:14.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.642+0000 7fbee1eac640 1 --2- 172.21.15.92:0/1569173208 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bc508d4a0 0x555bc5093cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:14.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.642+0000 7fbee26ad640 1 -- 172.21.15.92:0/1569173208 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bc508d4a0 msgr2=0x555bc5093cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:14.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.642+0000 7fbee26ad640 1 --2- 172.21.15.92:0/1569173208 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bc508d4a0 0x555bc5093cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.642+0000 7fbee26ad640 1 -- 172.21.15.92:0/1569173208 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bc508ddc0 msgr2=0x555bc50a44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:14.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.642+0000 7fbee26ad640 1 --2- 172.21.15.92:0/1569173208 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bc508ddc0 0x555bc50a44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.642+0000 7fbee26ad640 1 -- 172.21.15.92:0/1569173208 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bc50943b0 con 0x555bc5095e80 2024-09-19T09:04:14.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.643+0000 7fbee26ad640 1 --2- 172.21.15.92:0/1569173208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bc5095e80 0x555bc50a4a20 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fbed4009630 tx=0x7fbed4009660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caea68971b4ae147 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:14.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.643+0000 7fbec77fe640 1 -- 172.21.15.92:0/1569173208 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed4003c80 con 0x555bc5095e80 2024-09-19T09:04:14.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.643+0000 7fbec77fe640 1 -- 172.21.15.92:0/1569173208 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbed4036040 con 0x555bc5095e80 2024-09-19T09:04:14.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.643+0000 7fbec77fe640 1 -- 172.21.15.92:0/1569173208 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed402fd20 con 0x555bc5095e80 2024-09-19T09:04:14.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.644+0000 7fbee64e9740 1 -- 172.21.15.92:0/1569173208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bc5095e80 msgr2=0x555bc50a4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:14.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.644+0000 7fbee64e9740 1 --2- 172.21.15.92:0/1569173208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bc5095e80 0x555bc50a4a20 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fbed4009630 tx=0x7fbed4009660 comp rx=0 tx=0).stop 2024-09-19T09:04:14.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.644+0000 7fbee64e9740 1 -- 172.21.15.92:0/1569173208 shutdown_connections 2024-09-19T09:04:14.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.644+0000 7fbee64e9740 1 --2- 172.21.15.92:0/1569173208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bc5095e80 0x555bc50a4a20 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.644+0000 7fbee64e9740 1 --2- 172.21.15.92:0/1569173208 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bc508ddc0 0x555bc50a44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.644+0000 7fbee64e9740 1 --2- 172.21.15.92:0/1569173208 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bc508d4a0 0x555bc5093cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.644+0000 7fbee64e9740 1 -- 172.21.15.92:0/1569173208 >> 172.21.15.92:0/1569173208 conn(0x555bc5089a30 msgr2=0x555bc5097480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:14.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.644+0000 7fbee64e9740 1 -- 172.21.15.92:0/1569173208 shutdown_connections 2024-09-19T09:04:14.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.644+0000 7fbee64e9740 1 -- 172.21.15.92:0/1569173208 wait complete. 2024-09-19T09:04:14.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.644+0000 7fbee64e9740 1 -- start start 2024-09-19T09:04:14.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.644+0000 7fbee64e9740 1 Processor -- start 2024-09-19T09:04:14.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.645+0000 7fbee64e9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bc508d4a0 0x555bc509c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:14.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.645+0000 7fbee64e9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bc508ddc0 0x555bc509c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:14.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.645+0000 7fbee64e9740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bc5095e80 0x555bc509cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:14.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.645+0000 7fbee64e9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc1b2930 con 0x555bc508ddc0 2024-09-19T09:04:14.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.645+0000 7fbee64e9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc1b3da0 con 0x555bc508d4a0 2024-09-19T09:04:14.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.645+0000 7fbee64e9740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc1b3000 con 0x555bc5095e80 2024-09-19T09:04:14.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.645+0000 7fbee64e9740 10 client.0 _ll_register_callbacks cb 0x7fbed4009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:14.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.645+0000 7fbee16ab640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bc508ddc0 0x555bc509c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:14.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.645+0000 7fbee16ab640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bc508ddc0 0x555bc509c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56610/0 (socket says 172.21.15.92:56610) 2024-09-19T09:04:14.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.645+0000 7fbee16ab640 1 -- 172.21.15.92:0/4030873967 learned_addr learned my addr 172.21.15.92:0/4030873967 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:14.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.645+0000 7fbee26ad640 1 --2- 172.21.15.92:0/4030873967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bc5095e80 0x555bc509cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:14.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.645+0000 7fbee1eac640 1 --2- 172.21.15.92:0/4030873967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bc508d4a0 0x555bc509c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:14.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.645+0000 7fbee16ab640 1 -- 172.21.15.92:0/4030873967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bc5095e80 msgr2=0x555bc509cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:14.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.645+0000 7fbee16ab640 1 --2- 172.21.15.92:0/4030873967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bc5095e80 0x555bc509cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.645+0000 7fbee16ab640 1 -- 172.21.15.92:0/4030873967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bc508d4a0 msgr2=0x555bc509c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:14.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.645+0000 7fbee16ab640 1 --2- 172.21.15.92:0/4030873967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bc508d4a0 0x555bc509c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.645+0000 7fbee16ab640 1 -- 172.21.15.92:0/4030873967 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bc51122e0 con 0x555bc508ddc0 2024-09-19T09:04:14.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.645+0000 7fbee1eac640 1 --2- 172.21.15.92:0/4030873967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bc508d4a0 0x555bc509c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:14.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.645+0000 7fbee16ab640 1 --2- 172.21.15.92:0/4030873967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bc508ddc0 0x555bc509c8b0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fbecc019000 tx=0x7fbecc009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4363435c462ad850 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:14.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.645+0000 7fbec57fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:04:14.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.645+0000 7fbec57fa640 1 -- 172.21.15.92:0/4030873967 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbecc017040 con 0x555bc508ddc0 2024-09-19T09:04:14.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.646+0000 7fbec57fa640 1 -- 172.21.15.92:0/4030873967 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fbecc013940 con 0x555bc508ddc0 2024-09-19T09:04:14.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.646+0000 7fbee64e9740 1 -- 172.21.15.92:0/4030873967 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbed4036040 con 0x555bc508ddc0 2024-09-19T09:04:14.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.646+0000 7fbec57fa640 1 -- 172.21.15.92:0/4030873967 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fbecc013b40 con 0x555bc508ddc0 2024-09-19T09:04:14.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.646+0000 7fbee64e9740 10 client.17169 fetch_fsmap learned FSMap version 19 2024-09-19T09:04:14.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.646+0000 7fbee64e9740 1 -- 172.21.15.92:0/4030873967 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x555bc51135a0 con 0x555bc508ddc0 2024-09-19T09:04:14.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.646+0000 7fbec57fa640 1 -- 172.21.15.92:0/4030873967 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbecc013ce0 con 0x555bc508ddc0 2024-09-19T09:04:14.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.646+0000 7fbec57fa640 1 -- 172.21.15.92:0/4030873967 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fbecc027550 con 0x555bc508ddc0 2024-09-19T09:04:14.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.646+0000 7fbee64e9740 10 client.17169 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:04:14.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.646+0000 7fbee64e9740 10 client.17169 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:04:14.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.646+0000 7fbee64e9740 20 client.17169 populate_metadata read hostname 'smithi092' 2024-09-19T09:04:14.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.646+0000 7fbee64e9740 1 --2- 172.21.15.92:0/4030873967 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555bc50a85a0 0x555bc5115aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:14.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.646+0000 7fbee64e9740 4 client.17169 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:04:14.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.646+0000 7fbee64e9740 1 -- 172.21.15.92:0/4030873967 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fbed4036040 con 0x555bc50a85a0 2024-09-19T09:04:14.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.647+0000 7fbee1eac640 1 --2- 172.21.15.92:0/4030873967 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555bc50a85a0 0x555bc5115aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:14.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.647+0000 7fbec57fa640 10 client.17169 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:14.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.647+0000 7fbee1eac640 1 --2- 172.21.15.92:0/4030873967 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555bc50a85a0 0x555bc5115aa0 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf4d6f54ec5d7efd server_cookie=e978f510626209e4 in_seq=0 out_seq=0 2024-09-19T09:04:14.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.647+0000 7fbec57fa640 1 -- 172.21.15.92:0/4030873967 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7fbed4036040 con 0x555bc50a85a0 2024-09-19T09:04:14.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.647+0000 7fbec57fa640 10 client.17169 handle_command_reply: tid=0 2024-09-19T09:04:14.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.647+0000 7fbee64e9740 1 client.17169 shutdown 2024-09-19T09:04:14.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.647+0000 7fbee64e9740 1 -- 172.21.15.92:0/4030873967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bc508ddc0 msgr2=0x555bc509c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:14.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.647+0000 7fbee64e9740 1 --2- 172.21.15.92:0/4030873967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bc508ddc0 0x555bc509c8b0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fbecc019000 tx=0x7fbecc009900 comp rx=0 tx=0).stop 2024-09-19T09:04:14.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.648+0000 7fbee64e9740 1 -- 172.21.15.92:0/4030873967 shutdown_connections 2024-09-19T09:04:14.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.648+0000 7fbee64e9740 1 --2- 172.21.15.92:0/4030873967 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555bc50a85a0 0x555bc5115aa0 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.648+0000 7fbee64e9740 1 --2- 172.21.15.92:0/4030873967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555bc5095e80 0x555bc509cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.648+0000 7fbec57fa640 0 client.17169 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:14.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.648+0000 7fbee64e9740 1 --2- 172.21.15.92:0/4030873967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555bc508ddc0 0x555bc509c8b0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.648+0000 7fbee64e9740 1 --2- 172.21.15.92:0/4030873967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555bc508d4a0 0x555bc509c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.648+0000 7fbee64e9740 1 -- 172.21.15.92:0/4030873967 >> 172.21.15.92:0/4030873967 conn(0x555bc5089a30 msgr2=0x555bc5097480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:14.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.648+0000 7fbee64e9740 1 -- 172.21.15.92:0/4030873967 shutdown_connections 2024-09-19T09:04:14.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.648+0000 7fbee64e9740 1 -- 172.21.15.92:0/4030873967 wait complete. 2024-09-19T09:04:14.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.648+0000 7fbee64e9740 20 client.17169 trim_cache size 0 max 16384 2024-09-19T09:04:14.654 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:04:14.654 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-19T09:04:14.654 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {} 2024-09-19T09:04:14.655 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:04:14.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.649+0000 7fbee4110640 1 -- 172.21.15.92:0/1169979288 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fbec80a3240 msgr2=0x7fbec80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:14.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.649+0000 7fbee4110640 1 --2- 172.21.15.92:0/1169979288 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fbec80a3240 0x7fbec80a5700 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fbed4009a60 tx=0x7fbed40095c0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.649+0000 7fbee4110640 1 -- 172.21.15.92:0/1169979288 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbedc1008c0 msgr2=0x7fbedc1a4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:14.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.649+0000 7fbee4110640 1 --2- 172.21.15.92:0/1169979288 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbedc1008c0 0x7fbedc1a4800 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fbed800c890 tx=0x7fbed800cc90 comp rx=0 tx=0).stop 2024-09-19T09:04:14.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.649+0000 7fbee4110640 1 -- 172.21.15.92:0/1169979288 shutdown_connections 2024-09-19T09:04:14.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.649+0000 7fbee4110640 1 --2- 172.21.15.92:0/1169979288 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbedc105ec0 0x7fbedc19e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.649+0000 7fbee4110640 1 --2- 172.21.15.92:0/1169979288 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbedc1011e0 0x7fbedc1a4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.649+0000 7fbee4110640 1 --2- 172.21.15.92:0/1169979288 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fbec80a3240 0x7fbec80a5700 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.649+0000 7fbee4110640 1 --2- 172.21.15.92:0/1169979288 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbedc1008c0 0x7fbedc1a4800 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.649+0000 7fbee4110640 1 -- 172.21.15.92:0/1169979288 >> 172.21.15.92:0/1169979288 conn(0x7fbedc0fc7d0 msgr2=0x7fbedc103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:14.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.649+0000 7fbee4110640 1 -- 172.21.15.92:0/1169979288 shutdown_connections 2024-09-19T09:04:14.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:14.649+0000 7fbee4110640 1 -- 172.21.15.92:0/1169979288 wait complete. 2024-09-19T09:04:14.660 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:14 smithi092 ceph-mon[31407]: scrub summary: idle 2024-09-19T09:04:14.660 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:14 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3600503155' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:14.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:14 smithi167 ceph-mon[35359]: scrub summary: idle 2024-09-19T09:04:14.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:14 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3600503155' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:14.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:14 smithi190 ceph-mon[35358]: scrub summary: idle 2024-09-19T09:04:14.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:14 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3600503155' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:15.355 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:04:15.355 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:04:15.362 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:15.621 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:15 smithi092 ceph-mon[31407]: pgmap v563: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 11 KiB/s wr, 71 op/s 2024-09-19T09:04:15.799 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:04:15.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.838+0000 7f50a1f93640 1 -- 172.21.15.92:0/3242301744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f509c106b80 msgr2=0x7f509c106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:15.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.838+0000 7f50a1f93640 1 --2- 172.21.15.92:0/3242301744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f509c106b80 0x7f509c106f60 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f508c009900 tx=0x7f508c02a410 comp rx=0 tx=0).stop 2024-09-19T09:04:15.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.838+0000 7f50a1f93640 1 -- 172.21.15.92:0/3242301744 shutdown_connections 2024-09-19T09:04:15.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.838+0000 7f50a1f93640 1 --2- 172.21.15.92:0/3242301744 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f509c100500 0x7f509c10ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.838+0000 7f50a1f93640 1 --2- 172.21.15.92:0/3242301744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f509c0ffb60 0x7f509c0fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.838+0000 7f50a1f93640 1 --2- 172.21.15.92:0/3242301744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f509c106b80 0x7f509c106f60 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.838+0000 7f50a1f93640 1 -- 172.21.15.92:0/3242301744 >> 172.21.15.92:0/3242301744 conn(0x7f509c0fba90 msgr2=0x7f509c0fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:15.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.838+0000 7f50a1f93640 1 -- 172.21.15.92:0/3242301744 shutdown_connections 2024-09-19T09:04:15.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.838+0000 7f50a1f93640 1 -- 172.21.15.92:0/3242301744 wait complete. 2024-09-19T09:04:15.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.839+0000 7f50a1f93640 1 Processor -- start 2024-09-19T09:04:15.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.839+0000 7f50a1f93640 1 -- start start 2024-09-19T09:04:15.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.839+0000 7f50a1f93640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f509c0ffb60 0x7f509c1985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:15.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.839+0000 7f50a1f93640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f509c100500 0x7f509c198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:15.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.839+0000 7f50a1f93640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f509c106b80 0x7f509c19ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:15.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.839+0000 7f50a1f93640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f509c112020 con 0x7f509c106b80 2024-09-19T09:04:15.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.839+0000 7f50a1f93640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f509c111ea0 con 0x7f509c0ffb60 2024-09-19T09:04:15.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.839+0000 7f50a1f93640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f509c1121a0 con 0x7f509c100500 2024-09-19T09:04:15.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.839+0000 7f509bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f509c106b80 0x7f509c19ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:15.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.839+0000 7f509bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f509c106b80 0x7f509c19ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56624/0 (socket says 172.21.15.92:56624) 2024-09-19T09:04:15.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.839+0000 7f509bfff640 1 -- 172.21.15.92:0/1324953604 learned_addr learned my addr 172.21.15.92:0/1324953604 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:15.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.839+0000 7f509b7fe640 1 --2- 172.21.15.92:0/1324953604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f509c0ffb60 0x7f509c1985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:15.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.839+0000 7f5093fff640 1 --2- 172.21.15.92:0/1324953604 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f509c100500 0x7f509c198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:15.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.840+0000 7f509bfff640 1 -- 172.21.15.92:0/1324953604 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f509c100500 msgr2=0x7f509c198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:15.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.840+0000 7f509bfff640 1 --2- 172.21.15.92:0/1324953604 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f509c100500 0x7f509c198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.840+0000 7f509bfff640 1 -- 172.21.15.92:0/1324953604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f509c0ffb60 msgr2=0x7f509c1985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:15.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.840+0000 7f509bfff640 1 --2- 172.21.15.92:0/1324953604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f509c0ffb60 0x7f509c1985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.840+0000 7f509bfff640 1 -- 172.21.15.92:0/1324953604 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f509c19d550 con 0x7f509c106b80 2024-09-19T09:04:15.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.840+0000 7f509bfff640 1 --2- 172.21.15.92:0/1324953604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f509c106b80 0x7f509c19ce70 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f509400b9e0 tx=0x7f509400bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:15.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.840+0000 7f50997fa640 1 -- 172.21.15.92:0/1324953604 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5094019070 con 0x7f509c106b80 2024-09-19T09:04:15.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.840+0000 7f50997fa640 1 -- 172.21.15.92:0/1324953604 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5094014440 con 0x7f509c106b80 2024-09-19T09:04:15.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.840+0000 7f50a1f93640 1 -- 172.21.15.92:0/1324953604 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f509c19d840 con 0x7f509c106b80 2024-09-19T09:04:15.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.840+0000 7f50a1f93640 1 -- 172.21.15.92:0/1324953604 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f509c1a5120 con 0x7f509c106b80 2024-09-19T09:04:15.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.840+0000 7f50997fa640 1 -- 172.21.15.92:0/1324953604 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50940126b0 con 0x7f509c106b80 2024-09-19T09:04:15.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.842+0000 7f50997fa640 1 -- 172.21.15.92:0/1324953604 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f509401c070 con 0x7f509c106b80 2024-09-19T09:04:15.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.842+0000 7f50a436c740 1 Processor -- start 2024-09-19T09:04:15.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.843+0000 7f50a436c740 1 -- start start 2024-09-19T09:04:15.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.843+0000 7f50a436c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561946a40f40 0x561946a41320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:15.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.843+0000 7f50a436c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561946a41860 0x561946a50110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:15.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.843+0000 7f50a436c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561946a50650 0x561946a52a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:15.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.843+0000 7f50a436c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5619469a6620 con 0x561946a41860 2024-09-19T09:04:15.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.843+0000 7f50a436c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56194694de50 con 0x561946a50650 2024-09-19T09:04:15.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.843+0000 7f50a436c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5619469a25e0 con 0x561946a40f40 2024-09-19T09:04:15.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.843+0000 7f509b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561946a41860 0x561946a50110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:15.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.843+0000 7f509b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561946a41860 0x561946a50110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56636/0 (socket says 172.21.15.92:56636) 2024-09-19T09:04:15.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.843+0000 7f509b7fe640 1 -- 172.21.15.92:0/40453542 learned_addr learned my addr 172.21.15.92:0/40453542 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:15.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.843+0000 7f5093fff640 1 --2- 172.21.15.92:0/40453542 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561946a40f40 0x561946a41320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:15.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.843+0000 7f5093fff640 1 --2- 172.21.15.92:0/40453542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561946a50650 0x561946a52a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:15.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.843+0000 7f50997fa640 1 --2- 172.21.15.92:0/1324953604 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f50880a3240 0x7f50880a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:15.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.843+0000 7f509b7fe640 1 -- 172.21.15.92:0/40453542 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561946a40f40 msgr2=0x561946a41320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:15.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.843+0000 7f509b7fe640 1 --2- 172.21.15.92:0/40453542 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561946a40f40 0x561946a41320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.843+0000 7f509b7fe640 1 -- 172.21.15.92:0/40453542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561946a50650 msgr2=0x561946a52a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:15.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.843+0000 7f509b7fe640 1 --2- 172.21.15.92:0/40453542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561946a50650 0x561946a52a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.843+0000 7f509b7fe640 1 -- 172.21.15.92:0/40453542 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56194693ed40 con 0x561946a41860 2024-09-19T09:04:15.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.844+0000 7f5093fff640 1 --2- 172.21.15.92:0/40453542 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561946a40f40 0x561946a41320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:15.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.844+0000 7f509bfff640 1 --2- 172.21.15.92:0/1324953604 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f50880a3240 0x7f50880a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:15.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.844+0000 7f509b7fe640 1 --2- 172.21.15.92:0/40453542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561946a41860 0x561946a50110 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f508c009900 tx=0x7f508c004200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e2df82cdf87025 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:15.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.844+0000 7f50997fa640 1 -- 172.21.15.92:0/1324953604 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f50940cee10 con 0x7f509c106b80 2024-09-19T09:04:15.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.844+0000 7f5091ffb640 1 -- 172.21.15.92:0/40453542 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c035030 con 0x561946a41860 2024-09-19T09:04:15.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.844+0000 7f5091ffb640 1 -- 172.21.15.92:0/40453542 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f508c040070 con 0x561946a41860 2024-09-19T09:04:15.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.844+0000 7f5091ffb640 1 -- 172.21.15.92:0/40453542 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c031b70 con 0x561946a41860 2024-09-19T09:04:15.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.845+0000 7f50a436c740 1 -- 172.21.15.92:0/40453542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561946a41860 msgr2=0x561946a50110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:15.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.845+0000 7f509bfff640 1 --2- 172.21.15.92:0/1324953604 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f50880a3240 0x7f50880a5700 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5094012fd0 tx=0x7f509406e270 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:15.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.845+0000 7f50a436c740 1 --2- 172.21.15.92:0/40453542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561946a41860 0x561946a50110 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f508c009900 tx=0x7f508c004200 comp rx=0 tx=0).stop 2024-09-19T09:04:15.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.845+0000 7f50a436c740 1 -- 172.21.15.92:0/40453542 shutdown_connections 2024-09-19T09:04:15.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.845+0000 7f50a436c740 1 --2- 172.21.15.92:0/40453542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561946a50650 0x561946a52a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.845+0000 7f50a436c740 1 --2- 172.21.15.92:0/40453542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561946a41860 0x561946a50110 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.845+0000 7f50a436c740 1 --2- 172.21.15.92:0/40453542 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561946a40f40 0x561946a41320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.845+0000 7f50a436c740 1 -- 172.21.15.92:0/40453542 >> 172.21.15.92:0/40453542 conn(0x561946a3d5f0 msgr2=0x561946a3d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:15.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.845+0000 7f50a436c740 1 -- 172.21.15.92:0/40453542 shutdown_connections 2024-09-19T09:04:15.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.845+0000 7f50a436c740 1 -- 172.21.15.92:0/40453542 wait complete. 2024-09-19T09:04:15.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.845+0000 7f50a436c740 1 -- start start 2024-09-19T09:04:15.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.846+0000 7f50a436c740 1 Processor -- start 2024-09-19T09:04:15.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.846+0000 7f50a436c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561946a40f40 0x561946a4d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:15.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.846+0000 7f50a436c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561946a41860 0x561946a4da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:15.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.846+0000 7f50a436c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561946a50650 0x561946a4dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:15.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.846+0000 7f50a436c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561946a53220 con 0x561946a50650 2024-09-19T09:04:15.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.846+0000 7f50a436c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56194692ef10 con 0x561946a41860 2024-09-19T09:04:15.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.846+0000 7f50a436c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x561946a533a0 con 0x561946a40f40 2024-09-19T09:04:15.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.846+0000 7f50a436c740 10 client.0 _ll_register_callbacks cb 0x561946952db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:15.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.846+0000 7f5093fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561946a50650 0x561946a4dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:15.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.846+0000 7f5093fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561946a50650 0x561946a4dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56640/0 (socket says 172.21.15.92:56640) 2024-09-19T09:04:15.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.846+0000 7f5093fff640 1 -- 172.21.15.92:0/2912279531 learned_addr learned my addr 172.21.15.92:0/2912279531 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:15.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.846+0000 7f509b7fe640 1 --2- 172.21.15.92:0/2912279531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561946a41860 0x561946a4da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:15.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.846+0000 7f5093fff640 1 --2- 172.21.15.92:0/2912279531 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561946a40f40 0x561946a4d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:15.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.846+0000 7f5093fff640 1 -- 172.21.15.92:0/2912279531 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561946a40f40 msgr2=0x561946a4d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:15.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.846+0000 7f5093fff640 1 --2- 172.21.15.92:0/2912279531 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561946a40f40 0x561946a4d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.846+0000 7f5093fff640 1 -- 172.21.15.92:0/2912279531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561946a41860 msgr2=0x561946a4da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:15.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.846+0000 7f5093fff640 1 --2- 172.21.15.92:0/2912279531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561946a41860 0x561946a4da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.846+0000 7f5093fff640 1 -- 172.21.15.92:0/2912279531 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619466b5580 con 0x561946a50650 2024-09-19T09:04:15.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.847+0000 7f5093fff640 1 --2- 172.21.15.92:0/2912279531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561946a50650 0x561946a4dfb0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f5084019b00 tx=0x7f5084008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a40f5b034ac3af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:15.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.847+0000 7f507affd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:04:15.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.847+0000 7f507affd640 1 -- 172.21.15.92:0/2912279531 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508401f030 con 0x561946a50650 2024-09-19T09:04:15.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.847+0000 7f507affd640 1 -- 172.21.15.92:0/2912279531 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f508400f040 con 0x561946a50650 2024-09-19T09:04:15.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.847+0000 7f50a436c740 1 -- 172.21.15.92:0/2912279531 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f508c040070 con 0x561946a50650 2024-09-19T09:04:15.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.847+0000 7f507affd640 1 -- 172.21.15.92:0/2912279531 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f5084015bf0 con 0x561946a50650 2024-09-19T09:04:15.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.847+0000 7f50a436c740 10 client.17181 fetch_fsmap learned FSMap version 19 2024-09-19T09:04:15.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.847+0000 7f50a436c740 1 -- 172.21.15.92:0/2912279531 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56194677f960 con 0x561946a50650 2024-09-19T09:04:15.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.847+0000 7f507affd640 1 -- 172.21.15.92:0/2912279531 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f508c040070 con 0x561946a50650 2024-09-19T09:04:15.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.848+0000 7f507affd640 1 -- 172.21.15.92:0/2912279531 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f5084006580 con 0x561946a50650 2024-09-19T09:04:15.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.848+0000 7f50a436c740 10 client.17181 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:04:15.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.848+0000 7f50a436c740 10 client.17181 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:04:15.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.848+0000 7f50a436c740 20 client.17181 populate_metadata read hostname 'smithi092' 2024-09-19T09:04:15.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.848+0000 7f50a436c740 1 --2- 172.21.15.92:0/2912279531 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561946a60290 0x561946a62700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:15.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.848+0000 7f50a436c740 4 client.17181 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:15.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.848+0000 7f50a436c740 1 -- 172.21.15.92:0/2912279531 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5619469b3b90 con 0x561946a60290 2024-09-19T09:04:15.855 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:15 smithi167 ceph-mon[35359]: pgmap v563: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 11 KiB/s wr, 71 op/s 2024-09-19T09:04:15.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.848+0000 7f509b7fe640 1 --2- 172.21.15.92:0/2912279531 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561946a60290 0x561946a62700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:15.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.848+0000 7f507affd640 10 client.17181 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:15.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.848+0000 7f509b7fe640 1 --2- 172.21.15.92:0/2912279531 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561946a60290 0x561946a62700 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=429960b23cd2545d server_cookie=4f5645aa1497791e in_seq=0 out_seq=0 2024-09-19T09:04:15.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.849+0000 7f507affd640 1 -- 172.21.15.92:0/2912279531 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5619469b3b90 con 0x561946a60290 2024-09-19T09:04:15.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.849+0000 7f507affd640 10 client.17181 handle_command_reply: tid=0 2024-09-19T09:04:15.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.849+0000 7f50a436c740 1 client.17181 shutdown 2024-09-19T09:04:15.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.849+0000 7f50a436c740 1 -- 172.21.15.92:0/2912279531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561946a50650 msgr2=0x561946a4dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:15.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.849+0000 7f50a436c740 1 --2- 172.21.15.92:0/2912279531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561946a50650 0x561946a4dfb0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f5084019b00 tx=0x7f5084008040 comp rx=0 tx=0).stop 2024-09-19T09:04:15.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.850+0000 7f50a436c740 1 -- 172.21.15.92:0/2912279531 shutdown_connections 2024-09-19T09:04:15.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.850+0000 7f50a436c740 1 --2- 172.21.15.92:0/2912279531 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561946a60290 0x561946a62700 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.850+0000 7f50a436c740 1 --2- 172.21.15.92:0/2912279531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561946a50650 0x561946a4dfb0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.850+0000 7f50a436c740 1 --2- 172.21.15.92:0/2912279531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561946a41860 0x561946a4da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.850+0000 7f507affd640 0 client.17181 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:15.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.850+0000 7f50a436c740 1 --2- 172.21.15.92:0/2912279531 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561946a40f40 0x561946a4d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.850+0000 7f50a436c740 1 -- 172.21.15.92:0/2912279531 >> 172.21.15.92:0/2912279531 conn(0x561946a3d5f0 msgr2=0x561946a43350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:15.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.850+0000 7f50a436c740 1 -- 172.21.15.92:0/2912279531 shutdown_connections 2024-09-19T09:04:15.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.850+0000 7f50a436c740 1 -- 172.21.15.92:0/2912279531 wait complete. 2024-09-19T09:04:15.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.850+0000 7f50a436c740 20 client.17181 trim_cache size 0 max 16384 2024-09-19T09:04:15.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.871+0000 7f50a436c740 1 Processor -- start 2024-09-19T09:04:15.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.871+0000 7f50a436c740 1 -- start start 2024-09-19T09:04:15.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.872+0000 7f50a436c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561946a40f40 0x561946a4f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:15.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.872+0000 7f50a436c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561946a41860 0x561946a68010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:15.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.872+0000 7f50a436c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561946a68550 0x561946a586b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:15.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.872+0000 7f50a436c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f507c00c490 con 0x561946a40f40 2024-09-19T09:04:15.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.872+0000 7f50a436c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f507c00ed30 con 0x561946a41860 2024-09-19T09:04:15.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.872+0000 7f50a436c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f507c00cb20 con 0x561946a68550 2024-09-19T09:04:15.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.872+0000 7f5093fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561946a40f40 0x561946a4f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:15.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.872+0000 7f5093fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561946a40f40 0x561946a4f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56654/0 (socket says 172.21.15.92:56654) 2024-09-19T09:04:15.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.872+0000 7f5093fff640 1 -- 172.21.15.92:0/3934285854 learned_addr learned my addr 172.21.15.92:0/3934285854 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:15.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.872+0000 7f509b7fe640 1 --2- 172.21.15.92:0/3934285854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561946a41860 0x561946a68010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:15.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.872+0000 7f5093fff640 1 --2- 172.21.15.92:0/3934285854 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561946a68550 0x561946a586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:15.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.872+0000 7f5093fff640 1 -- 172.21.15.92:0/3934285854 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561946a68550 msgr2=0x561946a586b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:15.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.872+0000 7f5093fff640 1 --2- 172.21.15.92:0/3934285854 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561946a68550 0x561946a586b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.872+0000 7f5093fff640 1 -- 172.21.15.92:0/3934285854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561946a41860 msgr2=0x561946a68010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:15.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.872+0000 7f5093fff640 1 --2- 172.21.15.92:0/3934285854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561946a41860 0x561946a68010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.872+0000 7f5093fff640 1 -- 172.21.15.92:0/3934285854 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561946a4ea20 con 0x561946a40f40 2024-09-19T09:04:15.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.873+0000 7f5093fff640 1 --2- 172.21.15.92:0/3934285854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561946a40f40 0x561946a4f400 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f508400a010 tx=0x7f50840096e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c2a413043930810 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:15.876 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:15 smithi190 ceph-mon[35358]: pgmap v563: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 11 KiB/s wr, 71 op/s 2024-09-19T09:04:15.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.873+0000 7f50917fa640 1 -- 172.21.15.92:0/3934285854 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508401f070 con 0x561946a40f40 2024-09-19T09:04:15.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.873+0000 7f50917fa640 1 -- 172.21.15.92:0/3934285854 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5084036070 con 0x561946a40f40 2024-09-19T09:04:15.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.873+0000 7f50917fa640 1 -- 172.21.15.92:0/3934285854 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508402e700 con 0x561946a40f40 2024-09-19T09:04:15.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.874+0000 7f50a436c740 1 -- 172.21.15.92:0/3934285854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561946a40f40 msgr2=0x561946a4f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:15.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.874+0000 7f50a436c740 1 --2- 172.21.15.92:0/3934285854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561946a40f40 0x561946a4f400 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f508400a010 tx=0x7f50840096e0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.874+0000 7f50a436c740 1 -- 172.21.15.92:0/3934285854 shutdown_connections 2024-09-19T09:04:15.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.874+0000 7f50a436c740 1 --2- 172.21.15.92:0/3934285854 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561946a68550 0x561946a586b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.874+0000 7f50a436c740 1 --2- 172.21.15.92:0/3934285854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561946a41860 0x561946a68010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.874+0000 7f50a436c740 1 --2- 172.21.15.92:0/3934285854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561946a40f40 0x561946a4f400 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.874+0000 7f50a436c740 1 -- 172.21.15.92:0/3934285854 >> 172.21.15.92:0/3934285854 conn(0x561946a3d5f0 msgr2=0x561946a3c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:15.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.874+0000 7f50a436c740 1 -- 172.21.15.92:0/3934285854 shutdown_connections 2024-09-19T09:04:15.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.874+0000 7f50a436c740 1 -- 172.21.15.92:0/3934285854 wait complete. 2024-09-19T09:04:15.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.874+0000 7f50a436c740 1 -- start start 2024-09-19T09:04:15.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.875+0000 7f50a436c740 1 Processor -- start 2024-09-19T09:04:15.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.875+0000 7f50a436c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561946a40f40 0x561946a476e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:15.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.875+0000 7f50a436c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561946a41860 0x561946a45a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:15.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.875+0000 7f50a436c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561946a68550 0x561946a45fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:15.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.875+0000 7f50a436c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f507c00d1f0 con 0x561946a40f40 2024-09-19T09:04:15.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.875+0000 7f50a436c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f507c00e660 con 0x561946a68550 2024-09-19T09:04:15.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.875+0000 7f50a436c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f507c00d8c0 con 0x561946a41860 2024-09-19T09:04:15.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.875+0000 7f50a436c740 10 client.0 _ll_register_callbacks cb 0x7f5084019740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:15.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.875+0000 7f5093fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561946a40f40 0x561946a476e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:15.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.875+0000 7f5093fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561946a40f40 0x561946a476e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56670/0 (socket says 172.21.15.92:56670) 2024-09-19T09:04:15.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.875+0000 7f5093fff640 1 -- 172.21.15.92:0/2211466217 learned_addr learned my addr 172.21.15.92:0/2211466217 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:15.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.875+0000 7f509b7fe640 1 --2- 172.21.15.92:0/2211466217 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561946a41860 0x561946a45a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:15.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.875+0000 7f5093fff640 1 --2- 172.21.15.92:0/2211466217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561946a68550 0x561946a45fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:15.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.875+0000 7f5093fff640 1 -- 172.21.15.92:0/2211466217 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561946a41860 msgr2=0x561946a45a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:15.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.875+0000 7f5093fff640 1 --2- 172.21.15.92:0/2211466217 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561946a41860 0x561946a45a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.875+0000 7f5093fff640 1 -- 172.21.15.92:0/2211466217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561946a68550 msgr2=0x561946a45fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:15.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.875+0000 7f5093fff640 1 --2- 172.21.15.92:0/2211466217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561946a68550 0x561946a45fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.875+0000 7f5093fff640 1 -- 172.21.15.92:0/2211466217 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561946a46590 con 0x561946a40f40 2024-09-19T09:04:15.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.875+0000 7f509b7fe640 1 --2- 172.21.15.92:0/2211466217 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561946a41860 0x561946a45a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:15.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.876+0000 7f5093fff640 1 --2- 172.21.15.92:0/2211466217 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561946a40f40 0x561946a476e0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f5084009ec0 tx=0x7f5084006b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d768a6aad32456 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:15.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.876+0000 7f507affd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:04:15.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.876+0000 7f507affd640 1 -- 172.21.15.92:0/2211466217 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5084042060 con 0x561946a40f40 2024-09-19T09:04:15.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.876+0000 7f507affd640 1 -- 172.21.15.92:0/2211466217 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f508402e410 con 0x561946a40f40 2024-09-19T09:04:15.881 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:15.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.876+0000 7f50a436c740 1 -- 172.21.15.92:0/2211466217 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5084036070 con 0x561946a40f40 2024-09-19T09:04:15.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.876+0000 7f507affd640 1 -- 172.21.15.92:0/2211466217 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f508401f040 con 0x561946a40f40 2024-09-19T09:04:15.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.876+0000 7f50a436c740 10 client.17187 fetch_fsmap learned FSMap version 19 2024-09-19T09:04:15.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.876+0000 7f50a436c740 1 -- 172.21.15.92:0/2211466217 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x561946a584f0 con 0x561946a40f40 2024-09-19T09:04:15.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.876+0000 7f507affd640 1 -- 172.21.15.92:0/2211466217 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5084020040 con 0x561946a40f40 2024-09-19T09:04:15.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.877+0000 7f507affd640 1 -- 172.21.15.92:0/2211466217 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f5084047070 con 0x561946a40f40 2024-09-19T09:04:15.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.877+0000 7f50a436c740 10 client.17187 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:04:15.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.877+0000 7f50a436c740 10 client.17187 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:04:15.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.877+0000 7f50a436c740 20 client.17187 populate_metadata read hostname 'smithi092' 2024-09-19T09:04:15.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.877+0000 7f50a436c740 1 --2- 172.21.15.92:0/2211466217 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561946a58b70 0x561946a58f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:15.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.877+0000 7f50a436c740 4 client.17187 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "432ba889", "release": true, "await": true}] 2024-09-19T09:04:15.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.877+0000 7f50a436c740 1 -- 172.21.15.92:0/2211466217 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "quiesce db", "set_id": "432ba889", "release": true, "await": true}) -- 0x7f5084036070 con 0x561946a58b70 2024-09-19T09:04:15.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.877+0000 7f509b7fe640 1 --2- 172.21.15.92:0/2211466217 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561946a58b70 0x561946a58f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:15.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.878+0000 7f507affd640 10 client.17187 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:15.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.878+0000 7f509b7fe640 1 --2- 172.21.15.92:0/2211466217 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561946a58b70 0x561946a58f50 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86feefd57a6dea3b server_cookie=d72b875978ec89 in_seq=0 out_seq=0 2024-09-19T09:04:15.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.928+0000 7f507affd640 1 -- 172.21.15.92:0/2211466217 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7f5084036070 con 0x561946a58b70 2024-09-19T09:04:15.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.928+0000 7f507affd640 10 client.17187 handle_command_reply: tid=0 2024-09-19T09:04:15.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.928+0000 7f50a436c740 1 client.17187 shutdown 2024-09-19T09:04:15.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.931+0000 7f50a436c740 1 -- 172.21.15.92:0/2211466217 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561946a40f40 msgr2=0x561946a476e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:15.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.931+0000 7f50a436c740 1 --2- 172.21.15.92:0/2211466217 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561946a40f40 0x561946a476e0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f5084009ec0 tx=0x7f5084006b10 comp rx=0 tx=0).stop 2024-09-19T09:04:15.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.931+0000 7f50a436c740 1 -- 172.21.15.92:0/2211466217 shutdown_connections 2024-09-19T09:04:15.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.931+0000 7f50a436c740 1 --2- 172.21.15.92:0/2211466217 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561946a58b70 0x561946a58f50 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.931+0000 7f50a436c740 1 --2- 172.21.15.92:0/2211466217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561946a68550 0x561946a45fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.931+0000 7f50a436c740 1 --2- 172.21.15.92:0/2211466217 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561946a41860 0x561946a45a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.931+0000 7f50a436c740 1 --2- 172.21.15.92:0/2211466217 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561946a40f40 0x561946a476e0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.931+0000 7f50a436c740 1 -- 172.21.15.92:0/2211466217 >> 172.21.15.92:0/2211466217 conn(0x561946a3d5f0 msgr2=0x561946a42a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:15.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.931+0000 7f507affd640 0 client.17187 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:15.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.932+0000 7f50a436c740 1 -- 172.21.15.92:0/2211466217 shutdown_connections 2024-09-19T09:04:15.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.932+0000 7f50a436c740 1 -- 172.21.15.92:0/2211466217 wait complete. 2024-09-19T09:04:15.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.932+0000 7f50a436c740 20 client.17187 trim_cache size 0 max 16384 2024-09-19T09:04:15.936 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:04:15.936 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 19, 2024-09-19T09:04:15.936 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24472, 2024-09-19T09:04:15.936 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 32, 2024-09-19T09:04:15.936 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-09-19T09:04:15.936 INFO:teuthology.orchestra.run.smithi092.stdout: "432ba889": { 2024-09-19T09:04:15.936 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 32, 2024-09-19T09:04:15.936 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-09-19T09:04:15.936 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:04:15.936 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-09-19T09:04:15.937 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:04:15.937 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:04:15.937 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 90.0, 2024-09-19T09:04:15.937 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 145.8, 2024-09-19T09:04:15.937 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-09-19T09:04:15.937 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-09-19T09:04:15.937 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-09-19T09:04:15.937 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:04:15.937 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-09-19T09:04:15.937 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:04:15.937 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:04:15.937 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:04:15.937 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:04:15.938 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:04:15.938 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:04:15.938 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:04:15.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.935+0000 7f50a1f93640 1 -- 172.21.15.92:0/1324953604 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f50880a3240 msgr2=0x7f50880a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:15.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.935+0000 7f50a1f93640 1 --2- 172.21.15.92:0/1324953604 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f50880a3240 0x7f50880a5700 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5094012fd0 tx=0x7f509406e270 comp rx=0 tx=0).stop 2024-09-19T09:04:15.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.935+0000 7f50a1f93640 1 -- 172.21.15.92:0/1324953604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f509c106b80 msgr2=0x7f509c19ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:15.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.935+0000 7f50a1f93640 1 --2- 172.21.15.92:0/1324953604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f509c106b80 0x7f509c19ce70 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f509400b9e0 tx=0x7f509400bde0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.939+0000 7f50a1f93640 1 -- 172.21.15.92:0/1324953604 shutdown_connections 2024-09-19T09:04:15.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.939+0000 7f50a1f93640 1 --2- 172.21.15.92:0/1324953604 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f50880a3240 0x7f50880a5700 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.939+0000 7f50a1f93640 1 --2- 172.21.15.92:0/1324953604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f509c106b80 0x7f509c19ce70 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.939+0000 7f50a1f93640 1 --2- 172.21.15.92:0/1324953604 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f509c100500 0x7f509c198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.939+0000 7f50a1f93640 1 --2- 172.21.15.92:0/1324953604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f509c0ffb60 0x7f509c1985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.939+0000 7f50a1f93640 1 -- 172.21.15.92:0/1324953604 >> 172.21.15.92:0/1324953604 conn(0x7f509c0fba90 msgr2=0x7f509c0fc430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:15.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.939+0000 7f50a1f93640 1 -- 172.21.15.92:0/1324953604 shutdown_connections 2024-09-19T09:04:15.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:15.939+0000 7f50a1f93640 1 -- 172.21.15.92:0/1324953604 wait complete. 2024-09-19T09:04:16.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.580+0000 7f1a5c0fc640 1 -- 172.21.15.92:0/1689347423 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a54106a80 msgr2=0x7f1a54106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:16.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.580+0000 7f1a5c0fc640 1 --2- 172.21.15.92:0/1689347423 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a54106a80 0x7f1a54106e60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c00bc30 tx=0x7f1a4c009260 comp rx=0 tx=0).stop 2024-09-19T09:04:16.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.583+0000 7f1a5c0fc640 1 -- 172.21.15.92:0/1689347423 shutdown_connections 2024-09-19T09:04:16.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.583+0000 7f1a5c0fc640 1 --2- 172.21.15.92:0/1689347423 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a54101420 0x7f1a5410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.583+0000 7f1a5c0fc640 1 --2- 172.21.15.92:0/1689347423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a54100a80 0x7f1a54100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.583+0000 7f1a5c0fc640 1 --2- 172.21.15.92:0/1689347423 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a54106a80 0x7f1a54106e60 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.583+0000 7f1a5c0fc640 1 -- 172.21.15.92:0/1689347423 >> 172.21.15.92:0/1689347423 conn(0x7f1a540fc7a0 msgr2=0x7f1a540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:16.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.584+0000 7f1a5c0fc640 1 -- 172.21.15.92:0/1689347423 shutdown_connections 2024-09-19T09:04:16.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.584+0000 7f1a5c0fc640 1 -- 172.21.15.92:0/1689347423 wait complete. 2024-09-19T09:04:16.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.585+0000 7f1a5c0fc640 1 Processor -- start 2024-09-19T09:04:16.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.585+0000 7f1a5c0fc640 1 -- start start 2024-09-19T09:04:16.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.585+0000 7f1a5c0fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a54100a80 0x7f1a541a71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:16.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.585+0000 7f1a5c0fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a54101420 0x7f1a541a7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:16.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.585+0000 7f1a5c0fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a54106a80 0x7f1a541aba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:16.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.585+0000 7f1a5c0fc640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5410fdd0 con 0x7f1a54101420 2024-09-19T09:04:16.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.585+0000 7f1a5c0fc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5410fc50 con 0x7f1a54100a80 2024-09-19T09:04:16.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.585+0000 7f1a5c0fc640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5410ff50 con 0x7f1a54106a80 2024-09-19T09:04:16.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.586+0000 7f1a5a699640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a54106a80 0x7f1a541aba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:16.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.586+0000 7f1a5a699640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a54106a80 0x7f1a541aba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:37644/0 (socket says 172.21.15.92:37644) 2024-09-19T09:04:16.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.586+0000 7f1a5a699640 1 -- 172.21.15.92:0/3363017020 learned_addr learned my addr 172.21.15.92:0/3363017020 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:16.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.586+0000 7f1a5a699640 1 -- 172.21.15.92:0/3363017020 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a54100a80 msgr2=0x7f1a541a71c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:04:16.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.586+0000 7f1a5a699640 1 --2- 172.21.15.92:0/3363017020 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a54100a80 0x7f1a541a71c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.586+0000 7f1a5a699640 1 -- 172.21.15.92:0/3363017020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a54101420 msgr2=0x7f1a541a7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:16.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.586+0000 7f1a5a699640 1 --2- 172.21.15.92:0/3363017020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a54101420 0x7f1a541a7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.586+0000 7f1a5a699640 1 -- 172.21.15.92:0/3363017020 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a541ac170 con 0x7f1a54106a80 2024-09-19T09:04:16.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.587+0000 7f1a5a699640 1 --2- 172.21.15.92:0/3363017020 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a54106a80 0x7f1a541aba90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1a5000bbf0 tx=0x7f1a50008600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:16.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.588+0000 7f1a4affd640 1 -- 172.21.15.92:0/3363017020 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a50019020 con 0x7f1a54106a80 2024-09-19T09:04:16.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.588+0000 7f1a5c0fc640 1 -- 172.21.15.92:0/3363017020 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a541ac460 con 0x7f1a54106a80 2024-09-19T09:04:16.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.588+0000 7f1a4affd640 1 -- 172.21.15.92:0/3363017020 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a50005500 con 0x7f1a54106a80 2024-09-19T09:04:16.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.589+0000 7f1a4affd640 1 -- 172.21.15.92:0/3363017020 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a50004e30 con 0x7f1a54106a80 2024-09-19T09:04:16.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.591+0000 7f1a5c0fc640 1 -- 172.21.15.92:0/3363017020 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a541b3d40 con 0x7f1a54106a80 2024-09-19T09:04:16.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.594+0000 7f1a4affd640 1 -- 172.21.15.92:0/3363017020 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1a5000bce0 con 0x7f1a54106a80 2024-09-19T09:04:16.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.594+0000 7f1a5c0fc640 1 -- 172.21.15.92:0/3363017020 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a541021c0 con 0x7f1a54106a80 2024-09-19T09:04:16.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.597+0000 7f1a4affd640 1 --2- 172.21.15.92:0/3363017020 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1a400a31f0 0x7f1a400a56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:16.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.597+0000 7f1a4affd640 1 -- 172.21.15.92:0/3363017020 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1a500cf790 con 0x7f1a54106a80 2024-09-19T09:04:16.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.599+0000 7f1a59e98640 1 --2- 172.21.15.92:0/3363017020 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1a400a31f0 0x7f1a400a56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:16.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.600+0000 7f1a59e98640 1 --2- 172.21.15.92:0/3363017020 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1a400a31f0 0x7f1a400a56b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c034040 tx=0x7f1a4c005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:16.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.601+0000 7f1a4affd640 1 -- 172.21.15.92:0/3363017020 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1a5009c470 con 0x7f1a54106a80 2024-09-19T09:04:16.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.985+0000 7f1a5c0fc640 1 -- 172.21.15.92:0/3363017020 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1a541b3f10 con 0x7f1a54106a80 2024-09-19T09:04:16.988 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:04:16.988 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:04:16.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.986+0000 7f1a4affd640 1 -- 172.21.15.92:0/3363017020 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f1a5009bd70 con 0x7f1a54106a80 2024-09-19T09:04:16.989 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:04:16.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.992+0000 7f1a5c0fc640 1 -- 172.21.15.92:0/3363017020 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1a400a31f0 msgr2=0x7f1a400a56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:16.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.992+0000 7f1a5c0fc640 1 --2- 172.21.15.92:0/3363017020 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1a400a31f0 0x7f1a400a56b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c034040 tx=0x7f1a4c005fd0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.992+0000 7f1a5c0fc640 1 -- 172.21.15.92:0/3363017020 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a54106a80 msgr2=0x7f1a541aba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:16.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.992+0000 7f1a5c0fc640 1 --2- 172.21.15.92:0/3363017020 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a54106a80 0x7f1a541aba90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1a5000bbf0 tx=0x7f1a50008600 comp rx=0 tx=0).stop 2024-09-19T09:04:16.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.992+0000 7f1a5c0fc640 1 -- 172.21.15.92:0/3363017020 shutdown_connections 2024-09-19T09:04:16.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.992+0000 7f1a5c0fc640 1 --2- 172.21.15.92:0/3363017020 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a54106a80 0x7f1a541aba90 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.992+0000 7f1a5c0fc640 1 --2- 172.21.15.92:0/3363017020 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1a400a31f0 0x7f1a400a56b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.992+0000 7f1a5c0fc640 1 --2- 172.21.15.92:0/3363017020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a54101420 0x7f1a541a7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.992+0000 7f1a5c0fc640 1 --2- 172.21.15.92:0/3363017020 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a54100a80 0x7f1a541a71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.992+0000 7f1a5c0fc640 1 -- 172.21.15.92:0/3363017020 >> 172.21.15.92:0/3363017020 conn(0x7f1a540fc7a0 msgr2=0x7f1a540fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:16.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.993+0000 7f1a5c0fc640 1 -- 172.21.15.92:0/3363017020 shutdown_connections 2024-09-19T09:04:16.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:16.993+0000 7f1a5c0fc640 1 -- 172.21.15.92:0/3363017020 wait complete. 2024-09-19T09:04:17.150 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '432ba889', total seconds elapsed: 30.9 2024-09-19T09:04:17.801 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:17 smithi092 ceph-mon[31407]: pgmap v564: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 8.8 KiB/s wr, 84 op/s 2024-09-19T09:04:17.801 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:17 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3363017020' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:17.806 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:04:17.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:17 smithi167 ceph-mon[35359]: pgmap v564: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 8.8 KiB/s wr, 84 op/s 2024-09-19T09:04:17.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:17 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3363017020' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:17.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:17 smithi190 ceph-mon[35358]: pgmap v564: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 8.8 KiB/s wr, 84 op/s 2024-09-19T09:04:17.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:17 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3363017020' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:18.175 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:18.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.725+0000 7fd88bc78640 1 -- 172.21.15.92:0/2498306524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd884106a80 msgr2=0x7fd884106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:18.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.725+0000 7fd88bc78640 1 --2- 172.21.15.92:0/2498306524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd884106a80 0x7fd884106e60 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fd874009930 tx=0x7fd87402a420 comp rx=0 tx=0).stop 2024-09-19T09:04:18.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.725+0000 7fd88bc78640 1 -- 172.21.15.92:0/2498306524 shutdown_connections 2024-09-19T09:04:18.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.725+0000 7fd88bc78640 1 --2- 172.21.15.92:0/2498306524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd884101420 0x7fd88410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.725+0000 7fd88bc78640 1 --2- 172.21.15.92:0/2498306524 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd884100a80 0x7fd884100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.725+0000 7fd88bc78640 1 --2- 172.21.15.92:0/2498306524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd884106a80 0x7fd884106e60 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.725+0000 7fd88bc78640 1 -- 172.21.15.92:0/2498306524 >> 172.21.15.92:0/2498306524 conn(0x7fd8840fc7a0 msgr2=0x7fd8840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:18.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.726+0000 7fd88bc78640 1 -- 172.21.15.92:0/2498306524 shutdown_connections 2024-09-19T09:04:18.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.726+0000 7fd88bc78640 1 -- 172.21.15.92:0/2498306524 wait complete. 2024-09-19T09:04:18.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.727+0000 7fd88bc78640 1 Processor -- start 2024-09-19T09:04:18.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.727+0000 7fd88bc78640 1 -- start start 2024-09-19T09:04:18.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.727+0000 7fd88bc78640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd884100a80 0x7fd884199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:18.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.727+0000 7fd88bc78640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd884101420 0x7fd8841998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:18.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.727+0000 7fd88bc78640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd884106a80 0x7fd8841a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:18.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.727+0000 7fd88bc78640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd884110ef0 con 0x7fd884106a80 2024-09-19T09:04:18.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.727+0000 7fd88bc78640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd884110d70 con 0x7fd884101420 2024-09-19T09:04:18.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.727+0000 7fd88bc78640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd884111070 con 0x7fd884100a80 2024-09-19T09:04:18.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.728+0000 7fd889213640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd884101420 0x7fd8841998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:18.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.728+0000 7fd889213640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd884101420 0x7fd8841998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:48656/0 (socket says 172.21.15.92:48656) 2024-09-19T09:04:18.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.728+0000 7fd88a215640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd884106a80 0x7fd8841a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:18.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.728+0000 7fd889213640 1 -- 172.21.15.92:0/3120122570 learned_addr learned my addr 172.21.15.92:0/3120122570 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:18.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.728+0000 7fd889a14640 1 --2- 172.21.15.92:0/3120122570 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd884100a80 0x7fd884199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:18.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.728+0000 7fd889213640 1 -- 172.21.15.92:0/3120122570 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd884100a80 msgr2=0x7fd884199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:18.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.728+0000 7fd889213640 1 --2- 172.21.15.92:0/3120122570 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd884100a80 0x7fd884199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.728+0000 7fd889213640 1 -- 172.21.15.92:0/3120122570 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd884106a80 msgr2=0x7fd8841a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:18.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.728+0000 7fd889213640 1 --2- 172.21.15.92:0/3120122570 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd884106a80 0x7fd8841a43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.728+0000 7fd889213640 1 -- 172.21.15.92:0/3120122570 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8841a4920 con 0x7fd884101420 2024-09-19T09:04:18.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.728+0000 7fd88a215640 1 --2- 172.21.15.92:0/3120122570 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd884106a80 0x7fd8841a43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:18.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.728+0000 7fd889213640 1 --2- 172.21.15.92:0/3120122570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd884101420 0x7fd8841998a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd87c00ba50 tx=0x7fd87c00bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:18.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.728+0000 7fd87affd640 1 -- 172.21.15.92:0/3120122570 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87c019070 con 0x7fd884101420 2024-09-19T09:04:18.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.729+0000 7fd87affd640 1 -- 172.21.15.92:0/3120122570 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd87c00cbe0 con 0x7fd884101420 2024-09-19T09:04:18.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.729+0000 7fd87affd640 1 -- 172.21.15.92:0/3120122570 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87c0076e0 con 0x7fd884101420 2024-09-19T09:04:18.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.729+0000 7fd88bc78640 1 -- 172.21.15.92:0/3120122570 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8841a4af0 con 0x7fd884101420 2024-09-19T09:04:18.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.729+0000 7fd88bc78640 1 -- 172.21.15.92:0/3120122570 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8841a4f80 con 0x7fd884101420 2024-09-19T09:04:18.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.732+0000 7fd87affd640 1 -- 172.21.15.92:0/3120122570 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd87c01c070 con 0x7fd884101420 2024-09-19T09:04:18.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.732+0000 7fd88e051740 1 Processor -- start 2024-09-19T09:04:18.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.732+0000 7fd88e051740 1 -- start start 2024-09-19T09:04:18.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.732+0000 7fd88e051740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5082d3b40 0x55f5082d2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:18.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.733+0000 7fd88e051740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5082d25d0 0x55f5082d2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:18.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.733+0000 7fd88e051740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5082dd370 0x55f5082df760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:18.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.733+0000 7fd88e051740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f5082382f0 con 0x55f5082dd370 2024-09-19T09:04:18.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.733+0000 7fd88e051740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f5081dfcf0 con 0x55f5082d3b40 2024-09-19T09:04:18.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.733+0000 7fd88e051740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f5082342b0 con 0x55f5082d25d0 2024-09-19T09:04:18.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.733+0000 7fd889213640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5082dd370 0x55f5082df760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:18.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.733+0000 7fd889a14640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5082d25d0 0x55f5082d2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:18.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.733+0000 7fd88a215640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5082d3b40 0x55f5082d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:18.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.733+0000 7fd889a14640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5082d25d0 0x55f5082d2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:37674/0 (socket says 172.21.15.92:37674) 2024-09-19T09:04:18.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.733+0000 7fd889213640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5082dd370 0x55f5082df760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56724/0 (socket says 172.21.15.92:56724) 2024-09-19T09:04:18.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.733+0000 7fd889a14640 1 -- 172.21.15.92:0/1828403897 learned_addr learned my addr 172.21.15.92:0/1828403897 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:18.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.733+0000 7fd87affd640 1 --2- 172.21.15.92:0/3120122570 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd8700a3300 0x7fd8700a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:18.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.733+0000 7fd88a215640 1 -- 172.21.15.92:0/1828403897 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5082d25d0 msgr2=0x55f5082d2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:18.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.733+0000 7fd88a215640 1 --2- 172.21.15.92:0/1828403897 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5082d25d0 0x55f5082d2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.733+0000 7fd87affd640 1 -- 172.21.15.92:0/3120122570 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd87c0ceea0 con 0x7fd884101420 2024-09-19T09:04:18.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.733+0000 7fd88a215640 1 -- 172.21.15.92:0/1828403897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5082dd370 msgr2=0x55f5082df760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:18.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.733+0000 7fd88a215640 1 --2- 172.21.15.92:0/1828403897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5082dd370 0x55f5082df760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.733+0000 7fd88a215640 1 -- 172.21.15.92:0/1828403897 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5081c43a0 con 0x55f5082d3b40 2024-09-19T09:04:18.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.733+0000 7fd889213640 1 --2- 172.21.15.92:0/1828403897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5082dd370 0x55f5082df760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:18.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.733+0000 7fd88a215640 1 --2- 172.21.15.92:0/3120122570 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd8700a3300 0x7fd8700a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:18.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.734+0000 7fd88a215640 1 --2- 172.21.15.92:0/1828403897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5082d3b40 0x55f5082d2090 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd8800114c0 tx=0x7fd8800118c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e2127a6ece1b4e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:18.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.734+0000 7fd86ffff640 1 -- 172.21.15.92:0/1828403897 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd880017070 con 0x55f5082d3b40 2024-09-19T09:04:18.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.734+0000 7fd86ffff640 1 -- 172.21.15.92:0/1828403897 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd88000fbc0 con 0x55f5082d3b40 2024-09-19T09:04:18.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.734+0000 7fd86ffff640 1 -- 172.21.15.92:0/1828403897 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd88001caa0 con 0x55f5082d3b40 2024-09-19T09:04:18.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.735+0000 7fd88e051740 1 -- 172.21.15.92:0/1828403897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5082d3b40 msgr2=0x55f5082d2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:18.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.735+0000 7fd88e051740 1 --2- 172.21.15.92:0/1828403897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5082d3b40 0x55f5082d2090 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd8800114c0 tx=0x7fd8800118c0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.735+0000 7fd88a215640 1 --2- 172.21.15.92:0/3120122570 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd8700a3300 0x7fd8700a57c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd880023000 tx=0x7fd880024000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:18.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.736+0000 7fd88e051740 1 -- 172.21.15.92:0/1828403897 shutdown_connections 2024-09-19T09:04:18.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.736+0000 7fd88e051740 1 --2- 172.21.15.92:0/1828403897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5082dd370 0x55f5082df760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.736+0000 7fd88e051740 1 --2- 172.21.15.92:0/1828403897 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5082d25d0 0x55f5082d2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.736+0000 7fd88e051740 1 --2- 172.21.15.92:0/1828403897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5082d3b40 0x55f5082d2090 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.736+0000 7fd88e051740 1 -- 172.21.15.92:0/1828403897 >> 172.21.15.92:0/1828403897 conn(0x55f50829b310 msgr2=0x55f5082cec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:18.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.736+0000 7fd88e051740 1 -- 172.21.15.92:0/1828403897 shutdown_connections 2024-09-19T09:04:18.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.736+0000 7fd88e051740 1 -- 172.21.15.92:0/1828403897 wait complete. 2024-09-19T09:04:18.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.737+0000 7fd88e051740 1 -- start start 2024-09-19T09:04:18.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.737+0000 7fd88e051740 1 Processor -- start 2024-09-19T09:04:18.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.738+0000 7fd88e051740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5082d25d0 0x55f5082d6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:18.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.738+0000 7fd88e051740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5082d3b40 0x55f5082d67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:18.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.738+0000 7fd88e051740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5082dd370 0x55f5082d6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:18.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.738+0000 7fd88e051740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f5082dfee0 con 0x55f5082d3b40 2024-09-19T09:04:18.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.738+0000 7fd88e051740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f5081f3060 con 0x55f5082d25d0 2024-09-19T09:04:18.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.738+0000 7fd88e051740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f5082e0060 con 0x55f5082dd370 2024-09-19T09:04:18.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.738+0000 7fd88e051740 10 client.0 _ll_register_callbacks cb 0x55f507f468c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:18.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.738+0000 7fd889a14640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5082d25d0 0x55f5082d6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:18.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.738+0000 7fd889213640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5082d3b40 0x55f5082d67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:18.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.738+0000 7fd889a14640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5082d25d0 0x55f5082d6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:48676/0 (socket says 172.21.15.92:48676) 2024-09-19T09:04:18.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.738+0000 7fd889a14640 1 -- 172.21.15.92:0/347264028 learned_addr learned my addr 172.21.15.92:0/347264028 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:18.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.738+0000 7fd88a215640 1 --2- 172.21.15.92:0/347264028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5082dd370 0x55f5082d6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:18.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.738+0000 7fd88a215640 1 -- 172.21.15.92:0/347264028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5082d25d0 msgr2=0x55f5082d6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:18.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.738+0000 7fd88a215640 1 --2- 172.21.15.92:0/347264028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5082d25d0 0x55f5082d6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.738+0000 7fd88a215640 1 -- 172.21.15.92:0/347264028 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5082d3b40 msgr2=0x55f5082d67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:18.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.738+0000 7fd88a215640 1 --2- 172.21.15.92:0/347264028 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5082d3b40 0x55f5082d67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.738+0000 7fd88a215640 1 -- 172.21.15.92:0/347264028 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f507fa93c0 con 0x55f5082dd370 2024-09-19T09:04:18.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.738+0000 7fd889213640 1 --2- 172.21.15.92:0/347264028 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5082d3b40 0x55f5082d67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:18.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.739+0000 7fd88a215640 1 --2- 172.21.15.92:0/347264028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5082dd370 0x55f5082d6d10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd880011490 tx=0x7fd88001c620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99445537c55eb2f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:18.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.739+0000 7fd86d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:04:18.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.739+0000 7fd86d7fa640 1 -- 172.21.15.92:0/347264028 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd880017040 con 0x55f5082dd370 2024-09-19T09:04:18.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.739+0000 7fd86d7fa640 1 -- 172.21.15.92:0/347264028 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd88001c840 con 0x55f5082dd370 2024-09-19T09:04:18.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.739+0000 7fd88e051740 1 -- 172.21.15.92:0/347264028 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd88000fbc0 con 0x55f5082dd370 2024-09-19T09:04:18.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.739+0000 7fd86d7fa640 1 -- 172.21.15.92:0/347264028 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd88001c430 con 0x55f5082dd370 2024-09-19T09:04:18.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.739+0000 7fd88e051740 10 client.26407 fetch_fsmap learned FSMap version 19 2024-09-19T09:04:18.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.739+0000 7fd88e051740 1 -- 172.21.15.92:0/347264028 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f5082f4310 con 0x55f5082dd370 2024-09-19T09:04:18.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.739+0000 7fd86d7fa640 1 -- 172.21.15.92:0/347264028 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd88000fbc0 con 0x55f5082dd370 2024-09-19T09:04:18.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.740+0000 7fd86d7fa640 1 -- 172.21.15.92:0/347264028 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fd88001b070 con 0x55f5082dd370 2024-09-19T09:04:18.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.740+0000 7fd88e051740 10 client.26407 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:04:18.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.740+0000 7fd88e051740 10 client.26407 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:04:18.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.740+0000 7fd88e051740 20 client.26407 populate_metadata read hostname 'smithi092' 2024-09-19T09:04:18.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.740+0000 7fd88e051740 1 --2- 172.21.15.92:0/347264028 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f5082f5720 0x55f5082f7b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:18.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.740+0000 7fd88e051740 4 client.26407 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:18.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.740+0000 7fd88e051740 1 -- 172.21.15.92:0/347264028 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f508245860 con 0x55f5082f5720 2024-09-19T09:04:18.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.740+0000 7fd889a14640 1 --2- 172.21.15.92:0/347264028 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f5082f5720 0x55f5082f7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:18.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.741+0000 7fd889a14640 1 --2- 172.21.15.92:0/347264028 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f5082f5720 0x55f5082f7b10 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=690e327721ef2f67 server_cookie=b622053e8e874794 in_seq=0 out_seq=0 2024-09-19T09:04:18.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.741+0000 7fd86d7fa640 10 client.26407 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:18.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.742+0000 7fd86d7fa640 1 -- 172.21.15.92:0/347264028 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f508245860 con 0x55f5082f5720 2024-09-19T09:04:18.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.742+0000 7fd86d7fa640 10 client.26407 handle_command_reply: tid=0 2024-09-19T09:04:18.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.742+0000 7fd88e051740 1 client.26407 shutdown 2024-09-19T09:04:18.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.742+0000 7fd88e051740 1 -- 172.21.15.92:0/347264028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5082dd370 msgr2=0x55f5082d6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:18.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.742+0000 7fd88e051740 1 --2- 172.21.15.92:0/347264028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5082dd370 0x55f5082d6d10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd880011490 tx=0x7fd88001c620 comp rx=0 tx=0).stop 2024-09-19T09:04:18.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.742+0000 7fd88e051740 1 -- 172.21.15.92:0/347264028 shutdown_connections 2024-09-19T09:04:18.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.742+0000 7fd88e051740 1 --2- 172.21.15.92:0/347264028 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f5082f5720 0x55f5082f7b10 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.742+0000 7fd88e051740 1 --2- 172.21.15.92:0/347264028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5082dd370 0x55f5082d6d10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.742+0000 7fd86d7fa640 0 client.26407 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:18.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.742+0000 7fd88e051740 1 --2- 172.21.15.92:0/347264028 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5082d3b40 0x55f5082d67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.742+0000 7fd88e051740 1 --2- 172.21.15.92:0/347264028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5082d25d0 0x55f5082d6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.742+0000 7fd88e051740 1 -- 172.21.15.92:0/347264028 >> 172.21.15.92:0/347264028 conn(0x55f50829b310 msgr2=0x55f5082d4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:18.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.742+0000 7fd88e051740 1 -- 172.21.15.92:0/347264028 shutdown_connections 2024-09-19T09:04:18.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.742+0000 7fd88e051740 1 -- 172.21.15.92:0/347264028 wait complete. 2024-09-19T09:04:18.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.743+0000 7fd88e051740 20 client.26407 trim_cache size 0 max 16384 2024-09-19T09:04:18.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.765+0000 7fd88e051740 1 Processor -- start 2024-09-19T09:04:18.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.765+0000 7fd88e051740 1 -- start start 2024-09-19T09:04:18.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.766+0000 7fd88e051740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f50829b310 0x55f5082d6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:18.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.766+0000 7fd88e051740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5082d25d0 0x55f5082d5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:18.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.766+0000 7fd88e051740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5082d3b40 0x55f5082fd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:18.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.766+0000 7fd88e051740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd8841a93e0 con 0x55f5082d3b40 2024-09-19T09:04:18.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.766+0000 7fd88e051740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd8841abc80 con 0x55f5082d25d0 2024-09-19T09:04:18.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.766+0000 7fd88e051740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd8841a9a70 con 0x55f50829b310 2024-09-19T09:04:18.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.766+0000 7fd889213640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5082d25d0 0x55f5082d5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:18.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.766+0000 7fd889213640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5082d25d0 0x55f5082d5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:48692/0 (socket says 172.21.15.92:48692) 2024-09-19T09:04:18.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.766+0000 7fd889213640 1 -- 172.21.15.92:0/1685018122 learned_addr learned my addr 172.21.15.92:0/1685018122 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:18.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.766+0000 7fd889a14640 1 --2- 172.21.15.92:0/1685018122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f50829b310 0x55f5082d6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:18.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.766+0000 7fd88a215640 1 --2- 172.21.15.92:0/1685018122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5082d3b40 0x55f5082fd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:18.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.766+0000 7fd889213640 1 -- 172.21.15.92:0/1685018122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f50829b310 msgr2=0x55f5082d6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:18.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.766+0000 7fd889213640 1 --2- 172.21.15.92:0/1685018122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f50829b310 0x55f5082d6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.766+0000 7fd889213640 1 -- 172.21.15.92:0/1685018122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5082d3b40 msgr2=0x55f5082fd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:18.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.766+0000 7fd889213640 1 --2- 172.21.15.92:0/1685018122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5082d3b40 0x55f5082fd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.766+0000 7fd889213640 1 -- 172.21.15.92:0/1685018122 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5082cf960 con 0x55f5082d25d0 2024-09-19T09:04:18.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.768+0000 7fd889213640 1 --2- 172.21.15.92:0/1685018122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5082d25d0 0x55f5082d5120 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd87c00ba20 tx=0x7fd87c004b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=883f0af724d7e7b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:18.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.768+0000 7fd86f7fe640 1 -- 172.21.15.92:0/1685018122 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87c0b3070 con 0x55f5082d25d0 2024-09-19T09:04:18.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.768+0000 7fd86f7fe640 1 -- 172.21.15.92:0/1685018122 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd87c0a40f0 con 0x55f5082d25d0 2024-09-19T09:04:18.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.768+0000 7fd86f7fe640 1 -- 172.21.15.92:0/1685018122 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87c0a3ec0 con 0x55f5082d25d0 2024-09-19T09:04:18.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.769+0000 7fd88e051740 1 -- 172.21.15.92:0/1685018122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5082d25d0 msgr2=0x55f5082d5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:18.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.769+0000 7fd88e051740 1 --2- 172.21.15.92:0/1685018122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5082d25d0 0x55f5082d5120 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd87c00ba20 tx=0x7fd87c004b50 comp rx=0 tx=0).stop 2024-09-19T09:04:18.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.769+0000 7fd88e051740 1 -- 172.21.15.92:0/1685018122 shutdown_connections 2024-09-19T09:04:18.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.769+0000 7fd88e051740 1 --2- 172.21.15.92:0/1685018122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5082d3b40 0x55f5082fd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.769+0000 7fd88e051740 1 --2- 172.21.15.92:0/1685018122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5082d25d0 0x55f5082d5120 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.769+0000 7fd88e051740 1 --2- 172.21.15.92:0/1685018122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f50829b310 0x55f5082d6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.769+0000 7fd88e051740 1 -- 172.21.15.92:0/1685018122 >> 172.21.15.92:0/1685018122 conn(0x55f5082e3c60 msgr2=0x55f5082cdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:18.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.769+0000 7fd88e051740 1 -- 172.21.15.92:0/1685018122 shutdown_connections 2024-09-19T09:04:18.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.769+0000 7fd88e051740 1 -- 172.21.15.92:0/1685018122 wait complete. 2024-09-19T09:04:18.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.769+0000 7fd88e051740 1 -- start start 2024-09-19T09:04:18.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.770+0000 7fd88e051740 1 Processor -- start 2024-09-19T09:04:18.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.770+0000 7fd88e051740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f50829b310 0x55f5082f1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:18.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.770+0000 7fd88e051740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5082d25d0 0x55f5082f22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:18.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.770+0000 7fd88e051740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5082d3b40 0x55f5082ed130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:18.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.770+0000 7fd88e051740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd8841aa140 con 0x55f5082d25d0 2024-09-19T09:04:18.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.770+0000 7fd88e051740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd8841ab5b0 con 0x55f50829b310 2024-09-19T09:04:18.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.770+0000 7fd88e051740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd8841aa810 con 0x55f5082d3b40 2024-09-19T09:04:18.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.770+0000 7fd88e051740 10 client.0 _ll_register_callbacks cb 0x7fd874009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:18.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.770+0000 7fd88a215640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5082d3b40 0x55f5082ed130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:18.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.770+0000 7fd88a215640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5082d3b40 0x55f5082ed130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:37686/0 (socket says 172.21.15.92:37686) 2024-09-19T09:04:18.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.770+0000 7fd88a215640 1 -- 172.21.15.92:0/1479707621 learned_addr learned my addr 172.21.15.92:0/1479707621 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:18.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.772+0000 7fd889213640 1 --2- 172.21.15.92:0/1479707621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5082d25d0 0x55f5082f22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:18.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.772+0000 7fd889a14640 1 --2- 172.21.15.92:0/1479707621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f50829b310 0x55f5082f1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:18.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.772+0000 7fd88a215640 1 -- 172.21.15.92:0/1479707621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f50829b310 msgr2=0x55f5082f1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:18.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.772+0000 7fd88a215640 1 --2- 172.21.15.92:0/1479707621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f50829b310 0x55f5082f1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.772+0000 7fd88a215640 1 -- 172.21.15.92:0/1479707621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5082d25d0 msgr2=0x55f5082f22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:18.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.772+0000 7fd88a215640 1 --2- 172.21.15.92:0/1479707621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5082d25d0 0x55f5082f22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.772+0000 7fd88a215640 1 -- 172.21.15.92:0/1479707621 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5082ed960 con 0x55f5082d3b40 2024-09-19T09:04:18.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.772+0000 7fd88a215640 1 --2- 172.21.15.92:0/1479707621 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5082d3b40 0x55f5082ed130 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd880009ef0 tx=0x7fd880005fa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b51fd4a32505a718 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:18.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.772+0000 7fd86d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:04:18.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.772+0000 7fd86d7fa640 1 -- 172.21.15.92:0/1479707621 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd880017040 con 0x55f5082d3b40 2024-09-19T09:04:18.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.772+0000 7fd86d7fa640 1 -- 172.21.15.92:0/1479707621 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd88001c9e0 con 0x55f5082d3b40 2024-09-19T09:04:18.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.772+0000 7fd88e051740 1 -- 172.21.15.92:0/1479707621 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd87c0a40f0 con 0x55f5082d3b40 2024-09-19T09:04:18.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.772+0000 7fd86d7fa640 1 -- 172.21.15.92:0/1479707621 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd880004270 con 0x55f5082d3b40 2024-09-19T09:04:18.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.774+0000 7fd88e051740 10 client.26413 fetch_fsmap learned FSMap version 19 2024-09-19T09:04:18.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.774+0000 7fd88e051740 1 -- 172.21.15.92:0/1479707621 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f50835fd60 con 0x55f5082d3b40 2024-09-19T09:04:18.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.774+0000 7fd86d7fa640 1 -- 172.21.15.92:0/1479707621 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd88000fb80 con 0x55f5082d3b40 2024-09-19T09:04:18.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.774+0000 7fd86d7fa640 1 -- 172.21.15.92:0/1479707621 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fd880046020 con 0x55f5082d3b40 2024-09-19T09:04:18.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.774+0000 7fd88e051740 10 client.26413 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:04:18.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.774+0000 7fd88e051740 10 client.26413 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:04:18.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.774+0000 7fd88e051740 20 client.26413 populate_metadata read hostname 'smithi092' 2024-09-19T09:04:18.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.775+0000 7fd88e051740 1 --2- 172.21.15.92:0/1479707621 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f5082dd370 0x55f508362380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:18.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.775+0000 7fd88e051740 4 client.26413 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:04:18.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.775+0000 7fd88e051740 1 -- 172.21.15.92:0/1479707621 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fd87c0a40f0 con 0x55f5082dd370 2024-09-19T09:04:18.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.775+0000 7fd889a14640 1 --2- 172.21.15.92:0/1479707621 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f5082dd370 0x55f508362380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:18.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.775+0000 7fd86d7fa640 10 client.26413 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:18.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.775+0000 7fd889a14640 1 --2- 172.21.15.92:0/1479707621 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f5082dd370 0x55f508362380 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea11724a968aeb5 server_cookie=7a8781e3c2a4fdd6 in_seq=0 out_seq=0 2024-09-19T09:04:18.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.776+0000 7fd86d7fa640 1 -- 172.21.15.92:0/1479707621 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fd87c0a40f0 con 0x55f5082dd370 2024-09-19T09:04:18.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.776+0000 7fd86d7fa640 10 client.26413 handle_command_reply: tid=0 2024-09-19T09:04:18.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.776+0000 7fd88e051740 1 client.26413 shutdown 2024-09-19T09:04:18.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.776+0000 7fd88e051740 1 -- 172.21.15.92:0/1479707621 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5082d3b40 msgr2=0x55f5082ed130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:18.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.776+0000 7fd88e051740 1 --2- 172.21.15.92:0/1479707621 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5082d3b40 0x55f5082ed130 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd880009ef0 tx=0x7fd880005fa0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.776+0000 7fd88e051740 1 -- 172.21.15.92:0/1479707621 shutdown_connections 2024-09-19T09:04:18.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.776+0000 7fd88e051740 1 --2- 172.21.15.92:0/1479707621 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f5082dd370 0x55f508362380 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.776+0000 7fd88e051740 1 --2- 172.21.15.92:0/1479707621 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f5082d3b40 0x55f5082ed130 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.776+0000 7fd88e051740 1 --2- 172.21.15.92:0/1479707621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5082d25d0 0x55f5082f22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.776+0000 7fd88e051740 1 --2- 172.21.15.92:0/1479707621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f50829b310 0x55f5082f1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.776+0000 7fd88e051740 1 -- 172.21.15.92:0/1479707621 >> 172.21.15.92:0/1479707621 conn(0x55f5082e3c60 msgr2=0x55f5082d9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:18.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.776+0000 7fd86d7fa640 0 client.26413 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:18.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.776+0000 7fd88e051740 1 -- 172.21.15.92:0/1479707621 shutdown_connections 2024-09-19T09:04:18.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.776+0000 7fd88e051740 1 -- 172.21.15.92:0/1479707621 wait complete. 2024-09-19T09:04:18.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.776+0000 7fd88e051740 20 client.26413 trim_cache size 0 max 16384 2024-09-19T09:04:18.780 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-19T09:04:18.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.777+0000 7fd88bc78640 1 -- 172.21.15.92:0/3120122570 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd8700a3300 msgr2=0x7fd8700a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:18.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.777+0000 7fd88bc78640 1 --2- 172.21.15.92:0/3120122570 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd8700a3300 0x7fd8700a57c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd880023000 tx=0x7fd880024000 comp rx=0 tx=0).stop 2024-09-19T09:04:18.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.777+0000 7fd88bc78640 1 -- 172.21.15.92:0/3120122570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd884101420 msgr2=0x7fd8841998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:18.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.777+0000 7fd88bc78640 1 --2- 172.21.15.92:0/3120122570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd884101420 0x7fd8841998a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd87c00ba50 tx=0x7fd87c00bf10 comp rx=0 tx=0).stop 2024-09-19T09:04:18.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.777+0000 7fd88bc78640 1 -- 172.21.15.92:0/3120122570 shutdown_connections 2024-09-19T09:04:18.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.777+0000 7fd88bc78640 1 --2- 172.21.15.92:0/3120122570 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd8700a3300 0x7fd8700a57c0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.777+0000 7fd88bc78640 1 --2- 172.21.15.92:0/3120122570 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd884106a80 0x7fd8841a43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.778+0000 7fd88bc78640 1 --2- 172.21.15.92:0/3120122570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd884101420 0x7fd8841998a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.778+0000 7fd88bc78640 1 --2- 172.21.15.92:0/3120122570 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd884100a80 0x7fd884199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.778+0000 7fd88bc78640 1 -- 172.21.15.92:0/3120122570 >> 172.21.15.92:0/3120122570 conn(0x7fd8840fc7a0 msgr2=0x7fd8840fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:18.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.778+0000 7fd88bc78640 1 -- 172.21.15.92:0/3120122570 shutdown_connections 2024-09-19T09:04:18.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:18.778+0000 7fd88bc78640 1 -- 172.21.15.92:0/3120122570 wait complete. 2024-09-19T09:04:19.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:19 smithi092 ceph-mon[31407]: pgmap v565: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 720 KiB/s wr, 153 op/s 2024-09-19T09:04:19.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:19 smithi167 ceph-mon[35359]: pgmap v565: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 720 KiB/s wr, 153 op/s 2024-09-19T09:04:19.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:19 smithi190 ceph-mon[35358]: pgmap v565: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 720 KiB/s wr, 153 op/s 2024-09-19T09:04:20.573 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:04:20.573 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:04:20.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 455.0 s, 3996.0 tps, lat 156.021 ms stddev 1859.020 2024-09-19T09:04:20.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:20 smithi190 ceph-mon[35358]: pgmap v566: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 2.5 MiB/s wr, 284 op/s 2024-09-19T09:04:20.987 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:21.005 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:20 smithi092 ceph-mon[31407]: pgmap v566: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 2.5 MiB/s wr, 284 op/s 2024-09-19T09:04:21.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:20 smithi167 ceph-mon[35359]: pgmap v566: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 2.5 MiB/s wr, 284 op/s 2024-09-19T09:04:21.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.544+0000 7fd4fa252640 1 -- 172.21.15.92:0/2748571803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4f406ea30 msgr2=0x7fd4f406ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:21.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.544+0000 7fd4fa252640 1 --2- 172.21.15.92:0/2748571803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4f406ea30 0x7fd4f406ee70 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4009900 tx=0x7fd4e402a3f0 comp rx=0 tx=0).stop 2024-09-19T09:04:21.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.544+0000 7fd4fa252640 1 -- 172.21.15.92:0/2748571803 shutdown_connections 2024-09-19T09:04:21.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.544+0000 7fd4fa252640 1 --2- 172.21.15.92:0/2748571803 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd4f411b140 0x7fd4f411d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:21.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.544+0000 7fd4fa252640 1 --2- 172.21.15.92:0/2748571803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4f406ea30 0x7fd4f406ee70 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:21.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.544+0000 7fd4fa252640 1 --2- 172.21.15.92:0/2748571803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4f4110190 0x7fd4f406e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:21.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.544+0000 7fd4fa252640 1 -- 172.21.15.92:0/2748571803 >> 172.21.15.92:0/2748571803 conn(0x7fd4f4073180 msgr2=0x7fd4f4073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:21.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.545+0000 7fd4fa252640 1 -- 172.21.15.92:0/2748571803 shutdown_connections 2024-09-19T09:04:21.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.545+0000 7fd4fa252640 1 -- 172.21.15.92:0/2748571803 wait complete. 2024-09-19T09:04:21.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.545+0000 7fd4fa252640 1 Processor -- start 2024-09-19T09:04:21.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.545+0000 7fd4fa252640 1 -- start start 2024-09-19T09:04:21.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.546+0000 7fd4fa252640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4f406ea30 0x7fd4f41a70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:21.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.546+0000 7fd4fa252640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4f4110190 0x7fd4f41a7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:21.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.546+0000 7fd4fa252640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd4f411b140 0x7fd4f41ab9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:21.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.546+0000 7fd4fa252640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f4120be0 con 0x7fd4f4110190 2024-09-19T09:04:21.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.546+0000 7fd4fa252640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f4120a60 con 0x7fd4f406ea30 2024-09-19T09:04:21.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.546+0000 7fd4fa252640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f4120d60 con 0x7fd4f411b140 2024-09-19T09:04:21.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.546+0000 7fd4f9a51640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd4f411b140 0x7fd4f41ab9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:21.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.546+0000 7fd4f9a51640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd4f411b140 0x7fd4f41ab9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:43788/0 (socket says 172.21.15.92:43788) 2024-09-19T09:04:21.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.546+0000 7fd4f9a51640 1 -- 172.21.15.92:0/1058196504 learned_addr learned my addr 172.21.15.92:0/1058196504 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:21.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.546+0000 7fd4f9250640 1 --2- 172.21.15.92:0/1058196504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4f406ea30 0x7fd4f41a70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:21.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.546+0000 7fd4f9a51640 1 -- 172.21.15.92:0/1058196504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4f406ea30 msgr2=0x7fd4f41a70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:21.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.546+0000 7fd4f9a51640 1 --2- 172.21.15.92:0/1058196504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4f406ea30 0x7fd4f41a70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:21.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.546+0000 7fd4f9a51640 1 -- 172.21.15.92:0/1058196504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4f4110190 msgr2=0x7fd4f41a7620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:04:21.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.546+0000 7fd4f9a51640 1 --2- 172.21.15.92:0/1058196504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4f4110190 0x7fd4f41a7620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:21.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.546+0000 7fd4f9a51640 1 -- 172.21.15.92:0/1058196504 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f41ac090 con 0x7fd4f411b140 2024-09-19T09:04:21.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.547+0000 7fd4f9a51640 1 --2- 172.21.15.92:0/1058196504 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd4f411b140 0x7fd4f41ab9b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec00eab0 tx=0x7fd4ec009f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:21.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.547+0000 7fd4ea7fc640 1 -- 172.21.15.92:0/1058196504 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec00ce40 con 0x7fd4f411b140 2024-09-19T09:04:21.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.547+0000 7fd4ea7fc640 1 -- 172.21.15.92:0/1058196504 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4ec005020 con 0x7fd4f411b140 2024-09-19T09:04:21.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.547+0000 7fd4ea7fc640 1 -- 172.21.15.92:0/1058196504 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec010760 con 0x7fd4f411b140 2024-09-19T09:04:21.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.547+0000 7fd4fa252640 1 -- 172.21.15.92:0/1058196504 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4f41ac380 con 0x7fd4f411b140 2024-09-19T09:04:21.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.547+0000 7fd4fa252640 1 -- 172.21.15.92:0/1058196504 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4f41b3c60 con 0x7fd4f411b140 2024-09-19T09:04:21.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.552+0000 7fd4ea7fc640 1 -- 172.21.15.92:0/1058196504 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd4ec010900 con 0x7fd4f411b140 2024-09-19T09:04:21.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.552+0000 7fd4fd88d740 1 Processor -- start 2024-09-19T09:04:21.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.554+0000 7fd4fd88d740 1 -- start start 2024-09-19T09:04:21.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.554+0000 7fd4fd88d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2158fdd70 0x55d2158fe150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:21.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.554+0000 7fd4fd88d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2158fe690 0x55d215908a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:21.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.554+0000 7fd4fd88d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d215908f50 0x55d21590b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:21.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.554+0000 7fd4fd88d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d215863280 con 0x55d2158fdd70 2024-09-19T09:04:21.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.554+0000 7fd4fd88d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d21580ab10 con 0x55d2158fe690 2024-09-19T09:04:21.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.554+0000 7fd4fd88d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55d21585f240 con 0x55d215908f50 2024-09-19T09:04:21.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.554+0000 7fd4f8a4f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2158fdd70 0x55d2158fe150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:21.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.554+0000 7fd4f8a4f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2158fdd70 0x55d2158fe150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50046/0 (socket says 172.21.15.92:50046) 2024-09-19T09:04:21.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.554+0000 7fd4f8a4f640 1 -- 172.21.15.92:0/3065748549 learned_addr learned my addr 172.21.15.92:0/3065748549 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:21.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.554+0000 7fd4f8a4f640 1 --2- 172.21.15.92:0/3065748549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d215908f50 0x55d21590b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:21.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.555+0000 7fd4f9250640 1 --2- 172.21.15.92:0/3065748549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2158fe690 0x55d215908a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:21.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.555+0000 7fd4f8a4f640 1 -- 172.21.15.92:0/3065748549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d215908f50 msgr2=0x55d21590b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:21.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.555+0000 7fd4f8a4f640 1 --2- 172.21.15.92:0/3065748549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d215908f50 0x55d21590b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:21.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.555+0000 7fd4f8a4f640 1 -- 172.21.15.92:0/3065748549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2158fe690 msgr2=0x55d215908a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:21.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.555+0000 7fd4f8a4f640 1 --2- 172.21.15.92:0/3065748549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2158fe690 0x55d215908a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:21.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.555+0000 7fd4f8a4f640 1 -- 172.21.15.92:0/3065748549 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2158171f0 con 0x55d2158fdd70 2024-09-19T09:04:21.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.555+0000 7fd4f9250640 1 --2- 172.21.15.92:0/3065748549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2158fe690 0x55d215908a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:21.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.555+0000 7fd4f8a4f640 1 --2- 172.21.15.92:0/3065748549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2158fdd70 0x55d2158fe150 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fd4e40096c0 tx=0x7fd4e4005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=603368701d4f2b4c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:21.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.555+0000 7fd4df7fe640 1 -- 172.21.15.92:0/3065748549 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e4046070 con 0x55d2158fdd70 2024-09-19T09:04:21.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.555+0000 7fd4df7fe640 1 -- 172.21.15.92:0/3065748549 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4e40044c0 con 0x55d2158fdd70 2024-09-19T09:04:21.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.555+0000 7fd4df7fe640 1 -- 172.21.15.92:0/3065748549 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e4035040 con 0x55d2158fdd70 2024-09-19T09:04:21.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.556+0000 7fd4ea7fc640 1 --2- 172.21.15.92:0/1058196504 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd4e00a33d0 0x7fd4e00a5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:21.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.556+0000 7fd4ea7fc640 1 -- 172.21.15.92:0/1058196504 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd4ec0cff70 con 0x7fd4f411b140 2024-09-19T09:04:21.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.557+0000 7fd4fd88d740 1 -- 172.21.15.92:0/3065748549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2158fdd70 msgr2=0x55d2158fe150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:21.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.557+0000 7fd4fd88d740 1 --2- 172.21.15.92:0/3065748549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2158fdd70 0x55d2158fe150 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fd4e40096c0 tx=0x7fd4e4005d50 comp rx=0 tx=0).stop 2024-09-19T09:04:21.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.557+0000 7fd4f9250640 1 --2- 172.21.15.92:0/1058196504 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd4e00a33d0 0x7fd4e00a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:21.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.557+0000 7fd4fd88d740 1 -- 172.21.15.92:0/3065748549 shutdown_connections 2024-09-19T09:04:21.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.557+0000 7fd4fd88d740 1 --2- 172.21.15.92:0/3065748549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d215908f50 0x55d21590b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:21.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.557+0000 7fd4fd88d740 1 --2- 172.21.15.92:0/3065748549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2158fe690 0x55d215908a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:21.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.557+0000 7fd4fd88d740 1 --2- 172.21.15.92:0/3065748549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2158fdd70 0x55d2158fe150 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:21.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.557+0000 7fd4fd88d740 1 -- 172.21.15.92:0/3065748549 >> 172.21.15.92:0/3065748549 conn(0x55d2158fa300 msgr2=0x55d2158fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:21.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.558+0000 7fd4fd88d740 1 -- 172.21.15.92:0/3065748549 shutdown_connections 2024-09-19T09:04:21.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.558+0000 7fd4fd88d740 1 -- 172.21.15.92:0/3065748549 wait complete. 2024-09-19T09:04:21.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.558+0000 7fd4f9250640 1 --2- 172.21.15.92:0/1058196504 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd4e00a33d0 0x7fd4e00a5890 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x55d2158fb160 tx=0x7fd4f0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:21.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.558+0000 7fd4fd88d740 1 -- start start 2024-09-19T09:04:21.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.558+0000 7fd4fd88d740 1 Processor -- start 2024-09-19T09:04:21.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.559+0000 7fd4fd88d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2158fdd70 0x55d215905f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:21.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.559+0000 7fd4fd88d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d2158fe690 0x55d215906450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:21.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.559+0000 7fd4fd88d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d215908f50 0x55d215906990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:21.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.559+0000 7fd4f8a4f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d2158fe690 0x55d215906450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:21.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.559+0000 7fd4f8a4f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d2158fe690 0x55d215906450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:43804/0 (socket says 172.21.15.92:43804) 2024-09-19T09:04:21.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.560+0000 7fd4f8a4f640 1 -- 172.21.15.92:0/195975136 learned_addr learned my addr 172.21.15.92:0/195975136 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:21.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.560+0000 7fd4fd88d740 1 -- 172.21.15.92:0/195975136 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d21590bb20 con 0x55d2158fdd70 2024-09-19T09:04:21.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.560+0000 7fd4fd88d740 1 -- 172.21.15.92:0/195975136 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d21581df10 con 0x55d215908f50 2024-09-19T09:04:21.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.560+0000 7fd4fd88d740 1 -- 172.21.15.92:0/195975136 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55d21590bca0 con 0x55d2158fe690 2024-09-19T09:04:21.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.560+0000 7fd4f9a51640 1 --2- 172.21.15.92:0/195975136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d215908f50 0x55d215906990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:21.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.560+0000 7fd4fd88d740 10 client.0 _ll_register_callbacks cb 0x55d2157e6a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:21.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.561+0000 7fd4f8a4f640 1 -- 172.21.15.92:0/195975136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d215908f50 msgr2=0x55d215906990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:21.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.561+0000 7fd4f8a4f640 1 --2- 172.21.15.92:0/195975136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d215908f50 0x55d215906990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:21.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.561+0000 7fd4f8a4f640 1 -- 172.21.15.92:0/195975136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2158fdd70 msgr2=0x55d215905f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:21.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.561+0000 7fd4f8a4f640 1 --2- 172.21.15.92:0/195975136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2158fdd70 0x55d215905f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:21.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.561+0000 7fd4f8a4f640 1 -- 172.21.15.92:0/195975136 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2155d46a0 con 0x55d2158fe690 2024-09-19T09:04:21.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.561+0000 7fd4f8a4f640 1 --2- 172.21.15.92:0/195975136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d2158fe690 0x55d215906450 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4000c00 tx=0x7fd4e4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e868d5bcd3b0fe84 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:21.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.561+0000 7fd4dcff9640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:04:21.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.561+0000 7fd4dcff9640 1 -- 172.21.15.92:0/195975136 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e4035070 con 0x55d2158fe690 2024-09-19T09:04:21.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.561+0000 7fd4dcff9640 1 -- 172.21.15.92:0/195975136 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd4e40051c0 con 0x55d2158fe690 2024-09-19T09:04:21.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.561+0000 7fd4fd88d740 1 -- 172.21.15.92:0/195975136 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d2158707f0 con 0x55d2158fe690 2024-09-19T09:04:21.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.562+0000 7fd4dcff9640 1 -- 172.21.15.92:0/195975136 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd4e4046050 con 0x55d2158fe690 2024-09-19T09:04:21.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.562+0000 7fd4fd88d740 10 client.26425 fetch_fsmap learned FSMap version 19 2024-09-19T09:04:21.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.562+0000 7fd4fd88d740 1 -- 172.21.15.92:0/195975136 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55d21590bb20 con 0x55d2158fe690 2024-09-19T09:04:21.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.562+0000 7fd4dcff9640 1 -- 172.21.15.92:0/195975136 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55d2158707f0 con 0x55d2158fe690 2024-09-19T09:04:21.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.562+0000 7fd4dcff9640 1 -- 172.21.15.92:0/195975136 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fd4e40035f0 con 0x55d2158fe690 2024-09-19T09:04:21.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.562+0000 7fd4fd88d740 10 client.26425 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:04:21.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.562+0000 7fd4fd88d740 10 client.26425 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:04:21.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.562+0000 7fd4fd88d740 20 client.26425 populate_metadata read hostname 'smithi092' 2024-09-19T09:04:21.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.562+0000 7fd4fd88d740 1 --2- 172.21.15.92:0/195975136 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d215918c40 0x55d21591b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:21.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.562+0000 7fd4fd88d740 4 client.26425 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:21.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.562+0000 7fd4fd88d740 1 -- 172.21.15.92:0/195975136 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d21586ad00 con 0x55d215918c40 2024-09-19T09:04:21.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.562+0000 7fd4f9250640 1 --2- 172.21.15.92:0/195975136 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d215918c40 0x55d21591b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:21.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.563+0000 7fd4dcff9640 10 client.26425 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:21.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.563+0000 7fd4f9250640 1 --2- 172.21.15.92:0/195975136 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d215918c40 0x55d21591b0b0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa463756a69ffe5a server_cookie=907eeefd38feebe4 in_seq=0 out_seq=0 2024-09-19T09:04:21.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.564+0000 7fd4dcff9640 1 -- 172.21.15.92:0/195975136 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d21586ad00 con 0x55d215918c40 2024-09-19T09:04:21.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.564+0000 7fd4dcff9640 10 client.26425 handle_command_reply: tid=0 2024-09-19T09:04:21.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.564+0000 7fd4fd88d740 1 client.26425 shutdown 2024-09-19T09:04:21.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.564+0000 7fd4fd88d740 1 -- 172.21.15.92:0/195975136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d2158fe690 msgr2=0x55d215906450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:21.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.564+0000 7fd4fd88d740 1 --2- 172.21.15.92:0/195975136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d2158fe690 0x55d215906450 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4000c00 tx=0x7fd4e4004ad0 comp rx=0 tx=0).stop 2024-09-19T09:04:21.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.565+0000 7fd4fd88d740 1 -- 172.21.15.92:0/195975136 shutdown_connections 2024-09-19T09:04:21.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.565+0000 7fd4fd88d740 1 --2- 172.21.15.92:0/195975136 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d215918c40 0x55d21591b0b0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:21.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.565+0000 7fd4fd88d740 1 --2- 172.21.15.92:0/195975136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d215908f50 0x55d215906990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:21.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.565+0000 7fd4fd88d740 1 --2- 172.21.15.92:0/195975136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d2158fe690 0x55d215906450 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:21.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.565+0000 7fd4dcff9640 0 client.26425 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:21.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.565+0000 7fd4fd88d740 1 --2- 172.21.15.92:0/195975136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2158fdd70 0x55d215905f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:21.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.565+0000 7fd4fd88d740 1 -- 172.21.15.92:0/195975136 >> 172.21.15.92:0/195975136 conn(0x55d2158fa300 msgr2=0x55d215900030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:21.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.565+0000 7fd4fd88d740 1 -- 172.21.15.92:0/195975136 shutdown_connections 2024-09-19T09:04:21.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.565+0000 7fd4fd88d740 1 -- 172.21.15.92:0/195975136 wait complete. 2024-09-19T09:04:21.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.565+0000 7fd4fd88d740 20 client.26425 trim_cache size 0 max 16384 2024-09-19T09:04:21.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.596+0000 7fd4fd88d740 1 Processor -- start 2024-09-19T09:04:21.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.597+0000 7fd4fd88d740 1 -- start start 2024-09-19T09:04:21.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.597+0000 7fd4fd88d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2158fdd70 0x55d2159007d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:21.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.597+0000 7fd4fd88d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d2158fe690 0x55d2159209c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:21.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.597+0000 7fd4fd88d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d215908f50 0x55d215920f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:21.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.597+0000 7fd4fd88d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f41ba0d0 con 0x55d215908f50 2024-09-19T09:04:21.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.598+0000 7fd4fd88d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f41bc970 con 0x55d2158fdd70 2024-09-19T09:04:21.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.598+0000 7fd4fd88d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f41ba760 con 0x55d2158fe690 2024-09-19T09:04:21.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.598+0000 7fd4f9a51640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d215908f50 0x55d215920f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:21.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.598+0000 7fd4f9a51640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d215908f50 0x55d215920f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50060/0 (socket says 172.21.15.92:50060) 2024-09-19T09:04:21.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.598+0000 7fd4f9a51640 1 -- 172.21.15.92:0/2198787328 learned_addr learned my addr 172.21.15.92:0/2198787328 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:21.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.598+0000 7fd4f8a4f640 1 --2- 172.21.15.92:0/2198787328 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d2158fe690 0x55d2159209c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:21.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.598+0000 7fd4f9a51640 1 -- 172.21.15.92:0/2198787328 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d2158fe690 msgr2=0x55d2159209c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:21.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.598+0000 7fd4f9a51640 1 --2- 172.21.15.92:0/2198787328 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d2158fe690 0x55d2159209c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:21.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.598+0000 7fd4f9a51640 1 -- 172.21.15.92:0/2198787328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2158fdd70 msgr2=0x55d2159007d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:21.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.598+0000 7fd4f9a51640 1 --2- 172.21.15.92:0/2198787328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2158fdd70 0x55d2159007d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:21.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.598+0000 7fd4f9a51640 1 -- 172.21.15.92:0/2198787328 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2159087e0 con 0x55d215908f50 2024-09-19T09:04:21.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.599+0000 7fd4f9a51640 1 --2- 172.21.15.92:0/2198787328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d215908f50 0x55d215920f00 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec0989a0 tx=0x7fd4ec09cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ca32d1fe7431c56 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:21.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.600+0000 7fd4deffd640 1 -- 172.21.15.92:0/2198787328 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec0b4070 con 0x55d215908f50 2024-09-19T09:04:21.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.600+0000 7fd4deffd640 1 -- 172.21.15.92:0/2198787328 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4ec0a5200 con 0x55d215908f50 2024-09-19T09:04:21.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.601+0000 7fd4fd88d740 1 -- 172.21.15.92:0/2198787328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d215908f50 msgr2=0x55d215920f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:21.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.601+0000 7fd4fd88d740 1 --2- 172.21.15.92:0/2198787328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d215908f50 0x55d215920f00 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec0989a0 tx=0x7fd4ec09cd50 comp rx=0 tx=0).stop 2024-09-19T09:04:21.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.601+0000 7fd4fd88d740 1 -- 172.21.15.92:0/2198787328 shutdown_connections 2024-09-19T09:04:21.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.601+0000 7fd4fd88d740 1 --2- 172.21.15.92:0/2198787328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d215908f50 0x55d215920f00 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:21.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.601+0000 7fd4fd88d740 1 --2- 172.21.15.92:0/2198787328 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d2158fe690 0x55d2159209c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:21.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.601+0000 7fd4fd88d740 1 --2- 172.21.15.92:0/2198787328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2158fdd70 0x55d2159007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:21.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.601+0000 7fd4fd88d740 1 -- 172.21.15.92:0/2198787328 >> 172.21.15.92:0/2198787328 conn(0x55d2158fa300 msgr2=0x55d215907e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:21.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.605+0000 7fd4fd88d740 1 -- 172.21.15.92:0/2198787328 shutdown_connections 2024-09-19T09:04:21.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.605+0000 7fd4fd88d740 1 -- 172.21.15.92:0/2198787328 wait complete. 2024-09-19T09:04:21.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.605+0000 7fd4fd88d740 1 -- start start 2024-09-19T09:04:21.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.605+0000 7fd4fd88d740 1 Processor -- start 2024-09-19T09:04:21.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.606+0000 7fd4fd88d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d2158fdd70 0x55d21590cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:21.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.606+0000 7fd4fd88d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2158fe690 0x55d21590d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:21.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.606+0000 7fd4fd88d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d215908f50 0x55d21590d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:21.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.606+0000 7fd4fd88d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f41bae30 con 0x55d2158fe690 2024-09-19T09:04:21.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.606+0000 7fd4fd88d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f41bc2a0 con 0x55d215908f50 2024-09-19T09:04:21.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.606+0000 7fd4fd88d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f41bb500 con 0x55d2158fdd70 2024-09-19T09:04:21.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.606+0000 7fd4fd88d740 10 client.0 _ll_register_callbacks cb 0x7fd4e4044070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:21.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.607+0000 7fd4f8a4f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2158fe690 0x55d21590d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:21.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.607+0000 7fd4f8a4f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2158fe690 0x55d21590d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50068/0 (socket says 172.21.15.92:50068) 2024-09-19T09:04:21.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.607+0000 7fd4f8a4f640 1 -- 172.21.15.92:0/215043989 learned_addr learned my addr 172.21.15.92:0/215043989 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:21.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.607+0000 7fd4f9a51640 1 --2- 172.21.15.92:0/215043989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d215908f50 0x55d21590d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:21.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.607+0000 7fd4f9250640 1 --2- 172.21.15.92:0/215043989 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d2158fdd70 0x55d21590cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:21.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.607+0000 7fd4f9a51640 1 -- 172.21.15.92:0/215043989 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d2158fdd70 msgr2=0x55d21590cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:21.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.607+0000 7fd4f9a51640 1 --2- 172.21.15.92:0/215043989 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d2158fdd70 0x55d21590cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:21.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.607+0000 7fd4f9a51640 1 -- 172.21.15.92:0/215043989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2158fe690 msgr2=0x55d21590d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:21.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.607+0000 7fd4f9a51640 1 --2- 172.21.15.92:0/215043989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2158fe690 0x55d21590d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:21.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.608+0000 7fd4f9a51640 1 -- 172.21.15.92:0/215043989 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d215993b10 con 0x55d215908f50 2024-09-19T09:04:21.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.608+0000 7fd4f9a51640 1 --2- 172.21.15.92:0/215043989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d215908f50 0x55d21590d830 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec098f60 tx=0x7fd4ec0cda10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=487571968b1429ed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:21.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.608+0000 7fd4dcff9640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:04:21.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.608+0000 7fd4dcff9640 1 -- 172.21.15.92:0/215043989 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec0b4070 con 0x55d215908f50 2024-09-19T09:04:21.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.609+0000 7fd4fd88d740 1 -- 172.21.15.92:0/215043989 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4ec0a5200 con 0x55d215908f50 2024-09-19T09:04:21.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.609+0000 7fd4dcff9640 1 -- 172.21.15.92:0/215043989 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd4ec0a4f10 con 0x55d215908f50 2024-09-19T09:04:21.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.609+0000 7fd4dcff9640 1 -- 172.21.15.92:0/215043989 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd4ec0051d0 con 0x55d215908f50 2024-09-19T09:04:21.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.609+0000 7fd4fd88d740 10 client.26531 fetch_fsmap learned FSMap version 19 2024-09-19T09:04:21.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.609+0000 7fd4fd88d740 1 -- 172.21.15.92:0/215043989 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55d215994e10 con 0x55d215908f50 2024-09-19T09:04:21.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.609+0000 7fd4dcff9640 1 -- 172.21.15.92:0/215043989 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4ec0a5200 con 0x55d215908f50 2024-09-19T09:04:21.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.610+0000 7fd4dcff9640 1 -- 172.21.15.92:0/215043989 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fd4ec0ad030 con 0x55d215908f50 2024-09-19T09:04:21.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.610+0000 7fd4fd88d740 10 client.26531 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:04:21.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.610+0000 7fd4fd88d740 10 client.26531 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:04:21.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.610+0000 7fd4fd88d740 20 client.26531 populate_metadata read hostname 'smithi092' 2024-09-19T09:04:21.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.610+0000 7fd4fd88d740 1 --2- 172.21.15.92:0/215043989 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d215918c40 0x55d215997630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:21.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.610+0000 7fd4fd88d740 4 client.26531 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:04:21.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.610+0000 7fd4fd88d740 1 -- 172.21.15.92:0/215043989 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d2157e7110 con 0x55d215918c40 2024-09-19T09:04:21.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.610+0000 7fd4f9250640 1 --2- 172.21.15.92:0/215043989 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d215918c40 0x55d215997630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:21.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.611+0000 7fd4dcff9640 10 client.26531 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:21.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.611+0000 7fd4f9250640 1 --2- 172.21.15.92:0/215043989 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d215918c40 0x55d215997630 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=882976621392b58a server_cookie=fab6f93f1a735e2a in_seq=0 out_seq=0 2024-09-19T09:04:21.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.612+0000 7fd4dcff9640 1 -- 172.21.15.92:0/215043989 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d2157e7110 con 0x55d215918c40 2024-09-19T09:04:21.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.612+0000 7fd4dcff9640 10 client.26531 handle_command_reply: tid=0 2024-09-19T09:04:21.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.612+0000 7fd4fd88d740 1 client.26531 shutdown 2024-09-19T09:04:21.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.613+0000 7fd4fd88d740 1 -- 172.21.15.92:0/215043989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d215908f50 msgr2=0x55d21590d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:21.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.613+0000 7fd4fd88d740 1 --2- 172.21.15.92:0/215043989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d215908f50 0x55d21590d830 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec098f60 tx=0x7fd4ec0cda10 comp rx=0 tx=0).stop 2024-09-19T09:04:21.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.613+0000 7fd4fd88d740 1 -- 172.21.15.92:0/215043989 shutdown_connections 2024-09-19T09:04:21.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.613+0000 7fd4fd88d740 1 --2- 172.21.15.92:0/215043989 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d215918c40 0x55d215997630 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:21.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.613+0000 7fd4fd88d740 1 --2- 172.21.15.92:0/215043989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d215908f50 0x55d21590d830 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:21.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.613+0000 7fd4fd88d740 1 --2- 172.21.15.92:0/215043989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2158fe690 0x55d21590d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:21.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.614+0000 7fd4fd88d740 1 --2- 172.21.15.92:0/215043989 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d2158fdd70 0x55d21590cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:21.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.614+0000 7fd4fd88d740 1 -- 172.21.15.92:0/215043989 >> 172.21.15.92:0/215043989 conn(0x55d2158fa300 msgr2=0x55d2158f8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:21.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.614+0000 7fd4dcff9640 0 client.26531 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:21.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.614+0000 7fd4fd88d740 1 -- 172.21.15.92:0/215043989 shutdown_connections 2024-09-19T09:04:21.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.614+0000 7fd4fd88d740 1 -- 172.21.15.92:0/215043989 wait complete. 2024-09-19T09:04:21.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.614+0000 7fd4fd88d740 20 client.26531 trim_cache size 0 max 16384 2024-09-19T09:04:21.616 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:04:21.616 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-19T09:04:21.616 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "d126d8dc-c524-48b4-96ad-975c0743fac6", 2024-09-19T09:04:21.616 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-19T09:04:21.617 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:04:21.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.615+0000 7fd4fa252640 1 -- 172.21.15.92:0/1058196504 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd4e00a33d0 msgr2=0x7fd4e00a5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:21.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.615+0000 7fd4fa252640 1 --2- 172.21.15.92:0/1058196504 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd4e00a33d0 0x7fd4e00a5890 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x55d2158fb160 tx=0x7fd4f0005f90 comp rx=0 tx=0).stop 2024-09-19T09:04:21.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.615+0000 7fd4fa252640 1 -- 172.21.15.92:0/1058196504 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd4f411b140 msgr2=0x7fd4f41ab9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:21.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.615+0000 7fd4fa252640 1 --2- 172.21.15.92:0/1058196504 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd4f411b140 0x7fd4f41ab9b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec00eab0 tx=0x7fd4ec009f80 comp rx=0 tx=0).stop 2024-09-19T09:04:21.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.615+0000 7fd4fa252640 1 -- 172.21.15.92:0/1058196504 shutdown_connections 2024-09-19T09:04:21.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.616+0000 7fd4fa252640 1 --2- 172.21.15.92:0/1058196504 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd4f411b140 0x7fd4f41ab9b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:21.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.616+0000 7fd4fa252640 1 --2- 172.21.15.92:0/1058196504 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd4e00a33d0 0x7fd4e00a5890 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:21.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.616+0000 7fd4fa252640 1 --2- 172.21.15.92:0/1058196504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4f4110190 0x7fd4f41a7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:21.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.616+0000 7fd4fa252640 1 --2- 172.21.15.92:0/1058196504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4f406ea30 0x7fd4f41a70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:21.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.616+0000 7fd4fa252640 1 -- 172.21.15.92:0/1058196504 >> 172.21.15.92:0/1058196504 conn(0x7fd4f4073180 msgr2=0x7fd4f4119310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:21.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.616+0000 7fd4fa252640 1 -- 172.21.15.92:0/1058196504 shutdown_connections 2024-09-19T09:04:21.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:21.618+0000 7fd4fa252640 1 -- 172.21.15.92:0/1058196504 wait complete. 2024-09-19T09:04:22.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:21 smithi092 ceph-mon[31407]: scrub queued for path: / 2024-09-19T09:04:22.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:21 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:04:22.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:21 smithi092 ceph-mon[31407]: scrub summary: active paths [/] 2024-09-19T09:04:22.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:21 smithi167 ceph-mon[35359]: scrub queued for path: / 2024-09-19T09:04:22.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:21 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:04:22.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:21 smithi167 ceph-mon[35359]: scrub summary: active paths [/] 2024-09-19T09:04:22.123 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:21 smithi190 ceph-mon[35358]: scrub queued for path: / 2024-09-19T09:04:22.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:21 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:04:22.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:21 smithi190 ceph-mon[35358]: scrub summary: active paths [/] 2024-09-19T09:04:22.620 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:04:23.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:22 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:04:23.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:22 smithi092 ceph-mon[31407]: pgmap v567: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 3.6 MiB/s wr, 396 op/s 2024-09-19T09:04:23.064 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:23.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:22 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:04:23.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:22 smithi167 ceph-mon[35359]: pgmap v567: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 3.6 MiB/s wr, 396 op/s 2024-09-19T09:04:23.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:22 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:04:23.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:22 smithi190 ceph-mon[35358]: pgmap v567: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 3.6 MiB/s wr, 396 op/s 2024-09-19T09:04:23.834 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:23 smithi092 ceph-mon[31407]: scrub summary: idle 2024-09-19T09:04:23.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.651+0000 7fd3a61bf640 1 -- 172.21.15.92:0/1938024644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3a0106f00 msgr2=0x7fd3a010ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:23.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.651+0000 7fd3a61bf640 1 --2- 172.21.15.92:0/1938024644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3a0106f00 0x7fd3a010ea80 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fd398009ca0 tx=0x7fd39802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:04:23.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.651+0000 7fd3a61bf640 1 -- 172.21.15.92:0/1938024644 shutdown_connections 2024-09-19T09:04:23.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.651+0000 7fd3a61bf640 1 --2- 172.21.15.92:0/1938024644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3a0106f00 0x7fd3a010ea80 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:23.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.651+0000 7fd3a61bf640 1 --2- 172.21.15.92:0/1938024644 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3a0102780 0x7fd3a01067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:23.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.651+0000 7fd3a61bf640 1 --2- 172.21.15.92:0/1938024644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3a0101dd0 0x7fd3a01021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:23.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.651+0000 7fd3a61bf640 1 -- 172.21.15.92:0/1938024644 >> 172.21.15.92:0/1938024644 conn(0x7fd3a00fd870 msgr2=0x7fd3a00ffc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:23.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.651+0000 7fd3a61bf640 1 -- 172.21.15.92:0/1938024644 shutdown_connections 2024-09-19T09:04:23.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.651+0000 7fd3a61bf640 1 -- 172.21.15.92:0/1938024644 wait complete. 2024-09-19T09:04:23.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.651+0000 7fd3a61bf640 1 Processor -- start 2024-09-19T09:04:23.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.652+0000 7fd3a61bf640 1 -- start start 2024-09-19T09:04:23.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.652+0000 7fd3a61bf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3a0101dd0 0x7fd3a00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:23.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.652+0000 7fd3a61bf640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3a0102780 0x7fd3a0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:23.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.652+0000 7fd3a61bf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3a0106f00 0x7fd3a0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:23.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.652+0000 7fd3a61bf640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a0111fb0 con 0x7fd3a0106f00 2024-09-19T09:04:23.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.652+0000 7fd3a61bf640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a0111e30 con 0x7fd3a0101dd0 2024-09-19T09:04:23.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.652+0000 7fd3a61bf640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a0112130 con 0x7fd3a0102780 2024-09-19T09:04:23.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.652+0000 7fd39ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3a0106f00 0x7fd3a0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:23.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.652+0000 7fd39effd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3a0102780 0x7fd3a0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:23.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.652+0000 7fd39effd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3a0102780 0x7fd3a0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:43832/0 (socket says 172.21.15.92:43832) 2024-09-19T09:04:23.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.652+0000 7fd39ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3a0106f00 0x7fd3a0074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50084/0 (socket says 172.21.15.92:50084) 2024-09-19T09:04:23.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.652+0000 7fd39effd640 1 -- 172.21.15.92:0/4285263572 learned_addr learned my addr 172.21.15.92:0/4285263572 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:23.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.652+0000 7fd39f7fe640 1 --2- 172.21.15.92:0/4285263572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3a0101dd0 0x7fd3a00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:23.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.653+0000 7fd39effd640 1 -- 172.21.15.92:0/4285263572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3a0101dd0 msgr2=0x7fd3a00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:23.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.653+0000 7fd39effd640 1 --2- 172.21.15.92:0/4285263572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3a0101dd0 0x7fd3a00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:23.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.653+0000 7fd39effd640 1 -- 172.21.15.92:0/4285263572 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3a0106f00 msgr2=0x7fd3a0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:23.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.653+0000 7fd39effd640 1 --2- 172.21.15.92:0/4285263572 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3a0106f00 0x7fd3a0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:23.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.653+0000 7fd39effd640 1 -- 172.21.15.92:0/4285263572 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3a01a6890 con 0x7fd3a0102780 2024-09-19T09:04:23.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.654+0000 7fd39ffff640 1 --2- 172.21.15.92:0/4285263572 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3a0106f00 0x7fd3a0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:23.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.656+0000 7fd39effd640 1 --2- 172.21.15.92:0/4285263572 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3a0102780 0x7fd3a0074a30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd39400d770 tx=0x7fd39400dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:23.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.656+0000 7fd39cff9640 1 -- 172.21.15.92:0/4285263572 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd394017070 con 0x7fd3a0102780 2024-09-19T09:04:23.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.656+0000 7fd39cff9640 1 -- 172.21.15.92:0/4285263572 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd394005500 con 0x7fd3a0102780 2024-09-19T09:04:23.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.656+0000 7fd3a61bf640 1 -- 172.21.15.92:0/4285263572 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3a01a6b80 con 0x7fd3a0102780 2024-09-19T09:04:23.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.656+0000 7fd39cff9640 1 -- 172.21.15.92:0/4285263572 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd394004e00 con 0x7fd3a0102780 2024-09-19T09:04:23.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.656+0000 7fd3a61bf640 1 -- 172.21.15.92:0/4285263572 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3a01a70c0 con 0x7fd3a0102780 2024-09-19T09:04:23.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.659+0000 7fd39cff9640 1 -- 172.21.15.92:0/4285263572 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd394004fa0 con 0x7fd3a0102780 2024-09-19T09:04:23.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.660+0000 7fd39cff9640 1 --2- 172.21.15.92:0/4285263572 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd3880a32c0 0x7fd3880a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:23.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.660+0000 7fd39cff9640 1 -- 172.21.15.92:0/4285263572 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd3940cf1b0 con 0x7fd3a0102780 2024-09-19T09:04:23.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.660+0000 7fd39f7fe640 1 --2- 172.21.15.92:0/4285263572 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd3880a32c0 0x7fd3880a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:23.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.660+0000 7fd3a8598740 1 Processor -- start 2024-09-19T09:04:23.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.660+0000 7fd3a8598740 1 -- start start 2024-09-19T09:04:23.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.661+0000 7fd39f7fe640 1 --2- 172.21.15.92:0/4285263572 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd3880a32c0 0x7fd3880a5780 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd390005d00 tx=0x7fd39000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:23.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.661+0000 7fd3a8598740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae795f14a0 0x55ae795f1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:23.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.661+0000 7fd3a8598740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae795f1dc0 0x55ae795fc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:23.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.661+0000 7fd3a8598740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae795fc680 0x55ae795fea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:23.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.661+0000 7fd3a8598740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ae795572e0 con 0x55ae795fc680 2024-09-19T09:04:23.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.661+0000 7fd3a8598740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ae794fece0 con 0x55ae795f14a0 2024-09-19T09:04:23.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.661+0000 7fd3a8598740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ae795532a0 con 0x55ae795f1dc0 2024-09-19T09:04:23.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.661+0000 7fd39f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae795f14a0 0x55ae795f1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:23.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.661+0000 7fd39effd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae795f1dc0 0x55ae795fc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:23.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.661+0000 7fd39f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae795f14a0 0x55ae795f1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:48946/0 (socket says 172.21.15.92:48946) 2024-09-19T09:04:23.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.661+0000 7fd39f7fe640 1 -- 172.21.15.92:0/3130487289 learned_addr learned my addr 172.21.15.92:0/3130487289 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:23.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.661+0000 7fd39effd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae795f1dc0 0x55ae795fc140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:43846/0 (socket says 172.21.15.92:43846) 2024-09-19T09:04:23.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.661+0000 7fd39ffff640 1 --2- 172.21.15.92:0/3130487289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae795fc680 0x55ae795fea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:23.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.662+0000 7fd39f7fe640 1 -- 172.21.15.92:0/3130487289 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae795f1dc0 msgr2=0x55ae795fc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:23.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.662+0000 7fd39f7fe640 1 --2- 172.21.15.92:0/3130487289 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae795f1dc0 0x55ae795fc140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:23.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.662+0000 7fd39f7fe640 1 -- 172.21.15.92:0/3130487289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae795fc680 msgr2=0x55ae795fea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:23.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.662+0000 7fd39f7fe640 1 --2- 172.21.15.92:0/3130487289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae795fc680 0x55ae795fea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:23.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.662+0000 7fd39f7fe640 1 -- 172.21.15.92:0/3130487289 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae794e3440 con 0x55ae795f14a0 2024-09-19T09:04:23.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.662+0000 7fd39ffff640 1 --2- 172.21.15.92:0/3130487289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae795fc680 0x55ae795fea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:23.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.662+0000 7fd39f7fe640 1 --2- 172.21.15.92:0/3130487289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae795f14a0 0x55ae795f1880 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd390011010 tx=0x7fd390013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44e3c6ddf89c636f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:23.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.663+0000 7fd385ffb640 1 -- 172.21.15.92:0/3130487289 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd39001e620 con 0x55ae795f14a0 2024-09-19T09:04:23.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.663+0000 7fd385ffb640 1 -- 172.21.15.92:0/3130487289 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd39001eca0 con 0x55ae795f14a0 2024-09-19T09:04:23.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.663+0000 7fd385ffb640 1 -- 172.21.15.92:0/3130487289 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd390026d70 con 0x55ae795f14a0 2024-09-19T09:04:23.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.664+0000 7fd3a8598740 1 -- 172.21.15.92:0/3130487289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae795f14a0 msgr2=0x55ae795f1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:23.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.664+0000 7fd3a8598740 1 --2- 172.21.15.92:0/3130487289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae795f14a0 0x55ae795f1880 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd390011010 tx=0x7fd390013000 comp rx=0 tx=0).stop 2024-09-19T09:04:23.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.664+0000 7fd3a8598740 1 -- 172.21.15.92:0/3130487289 shutdown_connections 2024-09-19T09:04:23.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.664+0000 7fd3a8598740 1 --2- 172.21.15.92:0/3130487289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae795fc680 0x55ae795fea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:23.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.664+0000 7fd3a8598740 1 --2- 172.21.15.92:0/3130487289 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae795f1dc0 0x55ae795fc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:23.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.664+0000 7fd3a8598740 1 --2- 172.21.15.92:0/3130487289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae795f14a0 0x55ae795f1880 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:23.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.664+0000 7fd3a8598740 1 -- 172.21.15.92:0/3130487289 >> 172.21.15.92:0/3130487289 conn(0x55ae795eda30 msgr2=0x55ae795ede10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:23.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.664+0000 7fd3a8598740 1 -- 172.21.15.92:0/3130487289 shutdown_connections 2024-09-19T09:04:23.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.664+0000 7fd3a8598740 1 -- 172.21.15.92:0/3130487289 wait complete. 2024-09-19T09:04:23.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.665+0000 7fd3a8598740 1 -- start start 2024-09-19T09:04:23.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.665+0000 7fd3a8598740 1 Processor -- start 2024-09-19T09:04:23.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.666+0000 7fd3a8598740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae795f14a0 0x55ae795fc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:23.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.666+0000 7fd3a8598740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae795f1dc0 0x55ae795f9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:23.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.666+0000 7fd3a8598740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae795fc680 0x55ae795f98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:23.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.666+0000 7fd3a8598740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ae795ff250 con 0x55ae795f14a0 2024-09-19T09:04:23.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.666+0000 7fd39f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae795f14a0 0x55ae795fc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:23.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.666+0000 7fd3a8598740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ae79512050 con 0x55ae795fc680 2024-09-19T09:04:23.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.666+0000 7fd3a8598740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ae795ff3d0 con 0x55ae795f1dc0 2024-09-19T09:04:23.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.666+0000 7fd3a8598740 10 client.0 _ll_register_callbacks cb 0x55ae79552160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:23.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.666+0000 7fd39effd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae795f1dc0 0x55ae795f9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:23.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.666+0000 7fd39effd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae795f1dc0 0x55ae795f9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:43852/0 (socket says 172.21.15.92:43852) 2024-09-19T09:04:23.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.666+0000 7fd39effd640 1 -- 172.21.15.92:0/408376659 learned_addr learned my addr 172.21.15.92:0/408376659 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:23.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.666+0000 7fd39ffff640 1 --2- 172.21.15.92:0/408376659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae795fc680 0x55ae795f98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:23.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.667+0000 7fd39effd640 1 -- 172.21.15.92:0/408376659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae795fc680 msgr2=0x55ae795f98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:23.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.667+0000 7fd39effd640 1 --2- 172.21.15.92:0/408376659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae795fc680 0x55ae795f98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:23.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.667+0000 7fd39effd640 1 -- 172.21.15.92:0/408376659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae795f14a0 msgr2=0x55ae795fc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:23.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.667+0000 7fd39effd640 1 --2- 172.21.15.92:0/408376659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae795f14a0 0x55ae795fc050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:23.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.667+0000 7fd39effd640 1 -- 172.21.15.92:0/408376659 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae792c83c0 con 0x55ae795f1dc0 2024-09-19T09:04:23.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.667+0000 7fd39effd640 1 --2- 172.21.15.92:0/408376659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae795f1dc0 0x55ae795f9300 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd3940cccb0 tx=0x7fd39409b2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ca09b34f5db6886 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:23.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.667+0000 7fd37effd640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:04:23.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.667+0000 7fd37effd640 1 -- 172.21.15.92:0/408376659 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3940b4060 con 0x55ae795f1dc0 2024-09-19T09:04:23.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.667+0000 7fd37effd640 1 -- 172.21.15.92:0/408376659 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd394009cc0 con 0x55ae795f1dc0 2024-09-19T09:04:23.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.667+0000 7fd3a8598740 1 -- 172.21.15.92:0/408376659 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd39001eca0 con 0x55ae795f1dc0 2024-09-19T09:04:23.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.667+0000 7fd37effd640 1 -- 172.21.15.92:0/408376659 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd3940ce040 con 0x55ae795f1dc0 2024-09-19T09:04:23.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.667+0000 7fd3a8598740 10 client.26443 fetch_fsmap learned FSMap version 19 2024-09-19T09:04:23.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.667+0000 7fd3a8598740 1 -- 172.21.15.92:0/408376659 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ae7960ac30 con 0x55ae795f1dc0 2024-09-19T09:04:23.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.668+0000 7fd37effd640 1 -- 172.21.15.92:0/408376659 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd39001eca0 con 0x55ae795f1dc0 2024-09-19T09:04:23.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.669+0000 7fd37effd640 1 -- 172.21.15.92:0/408376659 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fd394097ef0 con 0x55ae795f1dc0 2024-09-19T09:04:23.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.669+0000 7fd3a8598740 10 client.26443 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:04:23.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.669+0000 7fd3a8598740 10 client.26443 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:04:23.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.669+0000 7fd3a8598740 20 client.26443 populate_metadata read hostname 'smithi092' 2024-09-19T09:04:23.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.669+0000 7fd3a8598740 1 --2- 172.21.15.92:0/408376659 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ae7960c0f0 0x55ae7960e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:23.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.669+0000 7fd3a8598740 4 client.26443 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:23.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.669+0000 7fd3a8598740 1 -- 172.21.15.92:0/408376659 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae79564850 con 0x55ae7960c0f0 2024-09-19T09:04:23.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.669+0000 7fd39f7fe640 1 --2- 172.21.15.92:0/408376659 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ae7960c0f0 0x55ae7960e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:23.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.669+0000 7fd39f7fe640 1 --2- 172.21.15.92:0/408376659 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ae7960c0f0 0x55ae7960e570 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e1db81869cc2120 server_cookie=257a6990796b748 in_seq=0 out_seq=0 2024-09-19T09:04:23.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.669+0000 7fd37effd640 10 client.26443 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:23.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.670+0000 7fd37effd640 1 -- 172.21.15.92:0/408376659 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ae79564850 con 0x55ae7960c0f0 2024-09-19T09:04:23.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.670+0000 7fd37effd640 10 client.26443 handle_command_reply: tid=0 2024-09-19T09:04:23.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.670+0000 7fd3a8598740 1 client.26443 shutdown 2024-09-19T09:04:23.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.673+0000 7fd3a8598740 1 -- 172.21.15.92:0/408376659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae795f1dc0 msgr2=0x55ae795f9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:23.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.673+0000 7fd3a8598740 1 --2- 172.21.15.92:0/408376659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae795f1dc0 0x55ae795f9300 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd3940cccb0 tx=0x7fd39409b2a0 comp rx=0 tx=0).stop 2024-09-19T09:04:23.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.673+0000 7fd3a8598740 1 -- 172.21.15.92:0/408376659 shutdown_connections 2024-09-19T09:04:23.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.673+0000 7fd3a8598740 1 --2- 172.21.15.92:0/408376659 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ae7960c0f0 0x55ae7960e570 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:23.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.673+0000 7fd3a8598740 1 --2- 172.21.15.92:0/408376659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae795fc680 0x55ae795f98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:23.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.673+0000 7fd3a8598740 1 --2- 172.21.15.92:0/408376659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae795f1dc0 0x55ae795f9300 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:23.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.673+0000 7fd3a8598740 1 --2- 172.21.15.92:0/408376659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae795f14a0 0x55ae795fc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:23.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.673+0000 7fd3a8598740 1 -- 172.21.15.92:0/408376659 >> 172.21.15.92:0/408376659 conn(0x55ae795eda30 msgr2=0x55ae795ecb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:23.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.673+0000 7fd37effd640 0 client.26443 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:23.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.674+0000 7fd3a8598740 1 -- 172.21.15.92:0/408376659 shutdown_connections 2024-09-19T09:04:23.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.674+0000 7fd3a8598740 1 -- 172.21.15.92:0/408376659 wait complete. 2024-09-19T09:04:23.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.674+0000 7fd3a8598740 20 client.26443 trim_cache size 0 max 16384 2024-09-19T09:04:23.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.701+0000 7fd3a8598740 1 Processor -- start 2024-09-19T09:04:23.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.701+0000 7fd3a8598740 1 -- start start 2024-09-19T09:04:23.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.701+0000 7fd3a8598740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae795f14a0 0x55ae796084b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:23.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.701+0000 7fd3a8598740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae795f1dc0 0x55ae79613e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:23.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.701+0000 7fd3a8598740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae795fc680 0x55ae79614380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:23.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.701+0000 7fd3a8598740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a01a9420 con 0x55ae795f1dc0 2024-09-19T09:04:23.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.701+0000 7fd3a8598740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a01abcc0 con 0x55ae795f14a0 2024-09-19T09:04:23.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.701+0000 7fd3a8598740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a01a9ab0 con 0x55ae795fc680 2024-09-19T09:04:23.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.701+0000 7fd39ffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae795fc680 0x55ae79614380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:23.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.701+0000 7fd39ffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae795fc680 0x55ae79614380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:43856/0 (socket says 172.21.15.92:43856) 2024-09-19T09:04:23.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.701+0000 7fd39ffff640 1 -- 172.21.15.92:0/4093692754 learned_addr learned my addr 172.21.15.92:0/4093692754 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:23.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.701+0000 7fd39f7fe640 1 --2- 172.21.15.92:0/4093692754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae795f14a0 0x55ae796084b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:23.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.701+0000 7fd39ffff640 1 -- 172.21.15.92:0/4093692754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae795f14a0 msgr2=0x55ae796084b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:23.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.701+0000 7fd39ffff640 1 --2- 172.21.15.92:0/4093692754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae795f14a0 0x55ae796084b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:23.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.701+0000 7fd39ffff640 1 -- 172.21.15.92:0/4093692754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae795f1dc0 msgr2=0x55ae79613e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:23.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.701+0000 7fd39ffff640 1 --2- 172.21.15.92:0/4093692754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae795f1dc0 0x55ae79613e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:23.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.701+0000 7fd39ffff640 1 -- 172.21.15.92:0/4093692754 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae795f7850 con 0x55ae795fc680 2024-09-19T09:04:23.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.702+0000 7fd39ffff640 1 --2- 172.21.15.92:0/4093692754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae795fc680 0x55ae79614380 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd398033040 tx=0x7fd398009a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4eeae5bf8378bf67 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:23.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.702+0000 7fd3857fa640 1 -- 172.21.15.92:0/4093692754 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd398003d30 con 0x55ae795fc680 2024-09-19T09:04:23.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.702+0000 7fd3857fa640 1 -- 172.21.15.92:0/4093692754 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd398054070 con 0x55ae795fc680 2024-09-19T09:04:23.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.702+0000 7fd3857fa640 1 -- 172.21.15.92:0/4093692754 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd39802f610 con 0x55ae795fc680 2024-09-19T09:04:23.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.703+0000 7fd3a8598740 1 -- 172.21.15.92:0/4093692754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae795fc680 msgr2=0x55ae79614380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:23.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.703+0000 7fd3a8598740 1 --2- 172.21.15.92:0/4093692754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae795fc680 0x55ae79614380 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd398033040 tx=0x7fd398009a00 comp rx=0 tx=0).stop 2024-09-19T09:04:23.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.703+0000 7fd3a8598740 1 -- 172.21.15.92:0/4093692754 shutdown_connections 2024-09-19T09:04:23.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.703+0000 7fd3a8598740 1 --2- 172.21.15.92:0/4093692754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae795fc680 0x55ae79614380 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:23.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.703+0000 7fd3a8598740 1 --2- 172.21.15.92:0/4093692754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae795f1dc0 0x55ae79613e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:23.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.703+0000 7fd3a8598740 1 --2- 172.21.15.92:0/4093692754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae795f14a0 0x55ae796084b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:23.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.703+0000 7fd3a8598740 1 -- 172.21.15.92:0/4093692754 >> 172.21.15.92:0/4093692754 conn(0x55ae795eda30 msgr2=0x55ae795f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:23.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.704+0000 7fd3a8598740 1 -- 172.21.15.92:0/4093692754 shutdown_connections 2024-09-19T09:04:23.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.704+0000 7fd3a8598740 1 -- 172.21.15.92:0/4093692754 wait complete. 2024-09-19T09:04:23.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.704+0000 7fd3a8598740 1 -- start start 2024-09-19T09:04:23.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.704+0000 7fd3a8598740 1 Processor -- start 2024-09-19T09:04:23.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.704+0000 7fd3a8598740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae795f14a0 0x55ae79604aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:23.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.704+0000 7fd3a8598740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae795f1dc0 0x55ae795f5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:23.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.704+0000 7fd3a8598740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae795fc680 0x55ae795f62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:23.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.704+0000 7fd3a8598740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a01aa180 con 0x55ae795f1dc0 2024-09-19T09:04:23.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.704+0000 7fd3a8598740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a01ab5f0 con 0x55ae795fc680 2024-09-19T09:04:23.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.704+0000 7fd3a8598740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a01aa850 con 0x55ae795f14a0 2024-09-19T09:04:23.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.704+0000 7fd3a8598740 10 client.0 _ll_register_callbacks cb 0x7fd39400d6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:23.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.705+0000 7fd39ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae795fc680 0x55ae795f62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:23.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.705+0000 7fd39f7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae795f14a0 0x55ae79604aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:23.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.705+0000 7fd39ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae795fc680 0x55ae795f62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:48978/0 (socket says 172.21.15.92:48978) 2024-09-19T09:04:23.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.705+0000 7fd39ffff640 1 -- 172.21.15.92:0/2810627290 learned_addr learned my addr 172.21.15.92:0/2810627290 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:23.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.705+0000 7fd39effd640 1 --2- 172.21.15.92:0/2810627290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae795f1dc0 0x55ae795f5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:23.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.705+0000 7fd39ffff640 1 -- 172.21.15.92:0/2810627290 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae795f14a0 msgr2=0x55ae79604aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:23.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.705+0000 7fd39ffff640 1 --2- 172.21.15.92:0/2810627290 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae795f14a0 0x55ae79604aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:23.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.705+0000 7fd39ffff640 1 -- 172.21.15.92:0/2810627290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae795f1dc0 msgr2=0x55ae795f5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:23.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.705+0000 7fd39ffff640 1 --2- 172.21.15.92:0/2810627290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae795f1dc0 0x55ae795f5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:23.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.705+0000 7fd39ffff640 1 -- 172.21.15.92:0/2810627290 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae795f67f0 con 0x55ae795fc680 2024-09-19T09:04:23.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.705+0000 7fd39ffff640 1 --2- 172.21.15.92:0/2810627290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae795fc680 0x55ae795f62b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd39802aeb0 tx=0x7fd398004210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbce4c3cfaa8a22d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:23.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.705+0000 7fd37effd640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:04:23.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.706+0000 7fd37effd640 1 -- 172.21.15.92:0/2810627290 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd398031450 con 0x55ae795fc680 2024-09-19T09:04:23.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.706+0000 7fd3a8598740 1 -- 172.21.15.92:0/2810627290 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd398054070 con 0x55ae795fc680 2024-09-19T09:04:23.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.706+0000 7fd37effd640 1 -- 172.21.15.92:0/2810627290 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd3980315f0 con 0x55ae795fc680 2024-09-19T09:04:23.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.706+0000 7fd37effd640 1 -- 172.21.15.92:0/2810627290 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd3980317f0 con 0x55ae795fc680 2024-09-19T09:04:23.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.706+0000 7fd3a8598740 10 client.26549 fetch_fsmap learned FSMap version 19 2024-09-19T09:04:23.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.706+0000 7fd3a8598740 1 -- 172.21.15.92:0/2810627290 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ae79676b70 con 0x55ae795fc680 2024-09-19T09:04:23.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.707+0000 7fd37effd640 1 -- 172.21.15.92:0/2810627290 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd398054070 con 0x55ae795fc680 2024-09-19T09:04:23.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.707+0000 7fd37effd640 1 -- 172.21.15.92:0/2810627290 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fd3980305c0 con 0x55ae795fc680 2024-09-19T09:04:23.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.708+0000 7fd3a8598740 10 client.26549 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:04:23.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.708+0000 7fd3a8598740 10 client.26549 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:04:23.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.708+0000 7fd3a8598740 20 client.26549 populate_metadata read hostname 'smithi092' 2024-09-19T09:04:23.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.708+0000 7fd3a8598740 1 --2- 172.21.15.92:0/2810627290 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ae796772a0 0x55ae796796c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:23.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.708+0000 7fd3a8598740 4 client.26549 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:04:23.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.708+0000 7fd3a8598740 1 -- 172.21.15.92:0/2810627290 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ae7955ed60 con 0x55ae796772a0 2024-09-19T09:04:23.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.713+0000 7fd39f7fe640 1 --2- 172.21.15.92:0/2810627290 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ae796772a0 0x55ae796796c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:23.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.718+0000 7fd39f7fe640 1 --2- 172.21.15.92:0/2810627290 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ae796772a0 0x55ae796796c0 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eda6d84d12edb32a server_cookie=c9baf383faaa4f92 in_seq=0 out_seq=0 2024-09-19T09:04:23.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.718+0000 7fd37effd640 10 client.26549 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:23.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.721+0000 7fd37effd640 1 -- 172.21.15.92:0/2810627290 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ae7955ed60 con 0x55ae796772a0 2024-09-19T09:04:23.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.721+0000 7fd37effd640 10 client.26549 handle_command_reply: tid=0 2024-09-19T09:04:23.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.722+0000 7fd3a8598740 1 client.26549 shutdown 2024-09-19T09:04:23.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.724+0000 7fd3a8598740 1 -- 172.21.15.92:0/2810627290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae795fc680 msgr2=0x55ae795f62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:23.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.724+0000 7fd3a8598740 1 --2- 172.21.15.92:0/2810627290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae795fc680 0x55ae795f62b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd39802aeb0 tx=0x7fd398004210 comp rx=0 tx=0).stop 2024-09-19T09:04:23.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.724+0000 7fd3a8598740 1 -- 172.21.15.92:0/2810627290 shutdown_connections 2024-09-19T09:04:23.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.724+0000 7fd3a8598740 1 --2- 172.21.15.92:0/2810627290 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ae796772a0 0x55ae796796c0 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:23.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.725+0000 7fd3a8598740 1 --2- 172.21.15.92:0/2810627290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae795fc680 0x55ae795f62b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:23.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.725+0000 7fd3a8598740 1 --2- 172.21.15.92:0/2810627290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae795f1dc0 0x55ae795f5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:23.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.725+0000 7fd3a8598740 1 --2- 172.21.15.92:0/2810627290 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae795f14a0 0x55ae79604aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:23.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.725+0000 7fd3a8598740 1 -- 172.21.15.92:0/2810627290 >> 172.21.15.92:0/2810627290 conn(0x55ae795eda30 msgr2=0x55ae795f3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:23.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.728+0000 7fd37effd640 0 client.26549 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:23.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.729+0000 7fd3a8598740 1 -- 172.21.15.92:0/2810627290 shutdown_connections 2024-09-19T09:04:23.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.732+0000 7fd3a8598740 1 -- 172.21.15.92:0/2810627290 wait complete. 2024-09-19T09:04:23.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.732+0000 7fd3a8598740 20 client.26549 trim_cache size 0 max 16384 2024-09-19T09:04:23.852 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:04:23.852 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-19T09:04:23.852 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {} 2024-09-19T09:04:23.852 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:04:23.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.736+0000 7fd3a61bf640 1 -- 172.21.15.92:0/4285263572 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd3880a32c0 msgr2=0x7fd3880a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:23.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.736+0000 7fd3a61bf640 1 --2- 172.21.15.92:0/4285263572 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd3880a32c0 0x7fd3880a5780 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd390005d00 tx=0x7fd39000b410 comp rx=0 tx=0).stop 2024-09-19T09:04:23.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.737+0000 7fd3a61bf640 1 -- 172.21.15.92:0/4285263572 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3a0102780 msgr2=0x7fd3a0074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:23.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.737+0000 7fd3a61bf640 1 --2- 172.21.15.92:0/4285263572 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3a0102780 0x7fd3a0074a30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd39400d770 tx=0x7fd39400dc30 comp rx=0 tx=0).stop 2024-09-19T09:04:23.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.737+0000 7fd3a61bf640 1 -- 172.21.15.92:0/4285263572 shutdown_connections 2024-09-19T09:04:23.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.737+0000 7fd3a61bf640 1 --2- 172.21.15.92:0/4285263572 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd3880a32c0 0x7fd3880a5780 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:23.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.737+0000 7fd3a61bf640 1 --2- 172.21.15.92:0/4285263572 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3a0106f00 0x7fd3a0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:23.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.737+0000 7fd3a61bf640 1 --2- 172.21.15.92:0/4285263572 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3a0102780 0x7fd3a0074a30 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:23.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.737+0000 7fd3a61bf640 1 --2- 172.21.15.92:0/4285263572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3a0101dd0 0x7fd3a00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:23.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.737+0000 7fd3a61bf640 1 -- 172.21.15.92:0/4285263572 >> 172.21.15.92:0/4285263572 conn(0x7fd3a00fd870 msgr2=0x7fd3a00feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:23.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.737+0000 7fd3a61bf640 1 -- 172.21.15.92:0/4285263572 shutdown_connections 2024-09-19T09:04:23.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:23.737+0000 7fd3a61bf640 1 -- 172.21.15.92:0/4285263572 wait complete. 2024-09-19T09:04:24.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:23 smithi167 ceph-mon[35359]: scrub summary: idle 2024-09-19T09:04:24.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:23 smithi190 ceph-mon[35358]: scrub summary: idle 2024-09-19T09:04:24.530 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:04:24.530 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:04:24.917 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:25.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:24 smithi092 ceph-mon[31407]: pgmap v568: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 6.1 MiB/s wr, 639 op/s 2024-09-19T09:04:25.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:24 smithi167 ceph-mon[35359]: pgmap v568: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 6.1 MiB/s wr, 639 op/s 2024-09-19T09:04:25.123 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:24 smithi190 ceph-mon[35358]: pgmap v568: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 6.1 MiB/s wr, 639 op/s 2024-09-19T09:04:25.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.435+0000 7fc8d6b56640 1 -- 172.21.15.92:0/3562166630 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8d0114ab0 msgr2=0x7fc8d0116ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:25.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.435+0000 7fc8d6b56640 1 --2- 172.21.15.92:0/3562166630 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8d0114ab0 0x7fc8d0116ea0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8009ca0 tx=0x7fc8c802a960 comp rx=0 tx=0).stop 2024-09-19T09:04:25.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.435+0000 7fc8d6b56640 1 -- 172.21.15.92:0/3562166630 shutdown_connections 2024-09-19T09:04:25.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.435+0000 7fc8d6b56640 1 --2- 172.21.15.92:0/3562166630 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8d0114ab0 0x7fc8d0116ea0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:25.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.435+0000 7fc8d6b56640 1 --2- 172.21.15.92:0/3562166630 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8d0109b10 0x7fc8d0114570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:25.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.435+0000 7fc8d6b56640 1 --2- 172.21.15.92:0/3562166630 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8d01091f0 0x7fc8d01095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:25.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.435+0000 7fc8d6b56640 1 -- 172.21.15.92:0/3562166630 >> 172.21.15.92:0/3562166630 conn(0x7fc8d006e140 msgr2=0x7fc8d006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:25.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.438+0000 7fc8d6b56640 1 -- 172.21.15.92:0/3562166630 shutdown_connections 2024-09-19T09:04:25.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.438+0000 7fc8d6b56640 1 -- 172.21.15.92:0/3562166630 wait complete. 2024-09-19T09:04:25.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.439+0000 7fc8d6b56640 1 Processor -- start 2024-09-19T09:04:25.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.440+0000 7fc8d6b56640 1 -- start start 2024-09-19T09:04:25.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.440+0000 7fc8d6b56640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8d01091f0 0x7fc8d019eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:25.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.440+0000 7fc8d6b56640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8d0109b10 0x7fc8d019f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:25.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.440+0000 7fc8d6b56640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8d0114ab0 0x7fc8d01a3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:25.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.440+0000 7fc8d6b56640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d01185e0 con 0x7fc8d01091f0 2024-09-19T09:04:25.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.440+0000 7fc8d6b56640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d0118460 con 0x7fc8d0114ab0 2024-09-19T09:04:25.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.440+0000 7fc8d6b56640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d0118760 con 0x7fc8d0109b10 2024-09-19T09:04:25.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.441+0000 7fc8cffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8d0109b10 0x7fc8d019f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:25.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.441+0000 7fc8cffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8d0109b10 0x7fc8d019f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:43880/0 (socket says 172.21.15.92:43880) 2024-09-19T09:04:25.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.441+0000 7fc8cffff640 1 -- 172.21.15.92:0/4046521606 learned_addr learned my addr 172.21.15.92:0/4046521606 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:25.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.441+0000 7fc8d50f3640 1 --2- 172.21.15.92:0/4046521606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8d0114ab0 0x7fc8d01a3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:25.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.442+0000 7fc8d48f2640 1 --2- 172.21.15.92:0/4046521606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8d01091f0 0x7fc8d019eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:25.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.442+0000 7fc8d50f3640 1 -- 172.21.15.92:0/4046521606 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8d0109b10 msgr2=0x7fc8d019f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:25.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.442+0000 7fc8d50f3640 1 --2- 172.21.15.92:0/4046521606 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8d0109b10 0x7fc8d019f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:25.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.442+0000 7fc8d50f3640 1 -- 172.21.15.92:0/4046521606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8d01091f0 msgr2=0x7fc8d019eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:25.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.442+0000 7fc8d50f3640 1 --2- 172.21.15.92:0/4046521606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8d01091f0 0x7fc8d019eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:25.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.442+0000 7fc8d50f3640 1 -- 172.21.15.92:0/4046521606 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8d01a3b90 con 0x7fc8d0114ab0 2024-09-19T09:04:25.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.443+0000 7fc8d50f3640 1 --2- 172.21.15.92:0/4046521606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8d0114ab0 0x7fc8d01a3460 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc8c802af50 tx=0x7fc8c8003f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:25.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.445+0000 7fc8cdffb640 1 -- 172.21.15.92:0/4046521606 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8034030 con 0x7fc8d0114ab0 2024-09-19T09:04:25.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.445+0000 7fc8cdffb640 1 -- 172.21.15.92:0/4046521606 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8c8030b40 con 0x7fc8d0114ab0 2024-09-19T09:04:25.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.445+0000 7fc8d6b56640 1 -- 172.21.15.92:0/4046521606 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8d01a3e20 con 0x7fc8d0114ab0 2024-09-19T09:04:25.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.445+0000 7fc8d6b56640 1 -- 172.21.15.92:0/4046521606 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8d01a4240 con 0x7fc8d0114ab0 2024-09-19T09:04:25.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.447+0000 7fc8cdffb640 1 -- 172.21.15.92:0/4046521606 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8004720 con 0x7fc8d0114ab0 2024-09-19T09:04:25.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.448+0000 7fc8cdffb640 1 -- 172.21.15.92:0/4046521606 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc8c8037020 con 0x7fc8d0114ab0 2024-09-19T09:04:25.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.450+0000 7fc8d6b56640 1 -- 172.21.15.92:0/4046521606 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8d01095d0 con 0x7fc8d0114ab0 2024-09-19T09:04:25.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.450+0000 7fc8cdffb640 1 --2- 172.21.15.92:0/4046521606 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc8b80abc60 0x7fc8b80ae120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:25.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.451+0000 7fc8cdffb640 1 -- 172.21.15.92:0/4046521606 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc8c80f03a0 con 0x7fc8d0114ab0 2024-09-19T09:04:25.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.451+0000 7fc8d48f2640 1 --2- 172.21.15.92:0/4046521606 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc8b80abc60 0x7fc8b80ae120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:25.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.453+0000 7fc8d48f2640 1 --2- 172.21.15.92:0/4046521606 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc8b80abc60 0x7fc8b80ae120 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0006fd0 tx=0x7fc8c00090e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:25.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.459+0000 7fc8cdffb640 1 -- 172.21.15.92:0/4046521606 <== mon.2 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc8c80bdf80 con 0x7fc8d0114ab0 2024-09-19T09:04:25.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 460.0 s, 3561.6 tps, lat 28.175 ms stddev 31.969 2024-09-19T09:04:25.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.806+0000 7fc8d6b56640 1 -- 172.21.15.92:0/4046521606 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc8d01ab770 con 0x7fc8d0114ab0 2024-09-19T09:04:25.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.807+0000 7fc8cdffb640 1 -- 172.21.15.92:0/4046521606 <== mon.2 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7fc8c80098b0 con 0x7fc8d0114ab0 2024-09-19T09:04:25.807 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:04:25.808 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:04:25.808 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:04:25.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.810+0000 7fc8d6b56640 1 -- 172.21.15.92:0/4046521606 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc8b80abc60 msgr2=0x7fc8b80ae120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:25.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.810+0000 7fc8d6b56640 1 --2- 172.21.15.92:0/4046521606 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc8b80abc60 0x7fc8b80ae120 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0006fd0 tx=0x7fc8c00090e0 comp rx=0 tx=0).stop 2024-09-19T09:04:25.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.810+0000 7fc8d6b56640 1 -- 172.21.15.92:0/4046521606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8d0114ab0 msgr2=0x7fc8d01a3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:25.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.810+0000 7fc8d6b56640 1 --2- 172.21.15.92:0/4046521606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8d0114ab0 0x7fc8d01a3460 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc8c802af50 tx=0x7fc8c8003f80 comp rx=0 tx=0).stop 2024-09-19T09:04:25.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.810+0000 7fc8d6b56640 1 -- 172.21.15.92:0/4046521606 shutdown_connections 2024-09-19T09:04:25.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.810+0000 7fc8d6b56640 1 --2- 172.21.15.92:0/4046521606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8d0114ab0 0x7fc8d01a3460 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:25.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.810+0000 7fc8d6b56640 1 --2- 172.21.15.92:0/4046521606 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8d0109b10 0x7fc8d019f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:25.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.810+0000 7fc8d6b56640 1 --2- 172.21.15.92:0/4046521606 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc8b80abc60 0x7fc8b80ae120 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:25.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.810+0000 7fc8d6b56640 1 --2- 172.21.15.92:0/4046521606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8d01091f0 0x7fc8d019eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:25.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.810+0000 7fc8d6b56640 1 -- 172.21.15.92:0/4046521606 >> 172.21.15.92:0/4046521606 conn(0x7fc8d006e140 msgr2=0x7fc8d0070940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:25.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.811+0000 7fc8d6b56640 1 -- 172.21.15.92:0/4046521606 shutdown_connections 2024-09-19T09:04:25.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:25.811+0000 7fc8d6b56640 1 -- 172.21.15.92:0/4046521606 wait complete. 2024-09-19T09:04:26.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:25 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/4046521606' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:26.139 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:25 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/4046521606' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:26.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:25 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/4046521606' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:26.498 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:04:26.649 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.647+0000 7f77d3bc4640 1 -- 172.21.15.92:0/3348732342 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77cc101530 msgr2=0x7f77cc105dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:26.649 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.647+0000 7f77d3bc4640 1 --2- 172.21.15.92:0/3348732342 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77cc101530 0x7f77cc105dd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f77c4009ca0 tx=0x7f77c402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:04:26.649 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.647+0000 7f77d3bc4640 1 -- 172.21.15.92:0/3348732342 shutdown_connections 2024-09-19T09:04:26.649 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.647+0000 7f77d3bc4640 1 --2- 172.21.15.92:0/3348732342 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77cc101530 0x7f77cc105dd0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:26.650 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.647+0000 7f77d3bc4640 1 --2- 172.21.15.92:0/3348732342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77cc100b70 0x7f77cc100ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:26.650 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.647+0000 7f77d3bc4640 1 --2- 172.21.15.92:0/3348732342 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77cc0ffe10 0x7f77cc100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:26.650 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.647+0000 7f77d3bc4640 1 -- 172.21.15.92:0/3348732342 >> 172.21.15.92:0/3348732342 conn(0x7f77cc0fb930 msgr2=0x7f77cc0fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:26.650 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.647+0000 7f77d3bc4640 1 -- 172.21.15.92:0/3348732342 shutdown_connections 2024-09-19T09:04:26.650 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.647+0000 7f77d3bc4640 1 -- 172.21.15.92:0/3348732342 wait complete. 2024-09-19T09:04:26.650 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.648+0000 7f77d3bc4640 1 Processor -- start 2024-09-19T09:04:26.650 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.648+0000 7f77d3bc4640 1 -- start start 2024-09-19T09:04:26.650 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.648+0000 7f77d3bc4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77cc0ffe10 0x7f77cc19e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:26.650 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.648+0000 7f77d3bc4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77cc100b70 0x7f77cc19e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:26.650 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.648+0000 7f77d3bc4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77cc101530 0x7f77cc1a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:26.650 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.648+0000 7f77d3bc4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f77cc113e40 con 0x7f77cc100b70 2024-09-19T09:04:26.650 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.648+0000 7f77d3bc4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f77cc113cc0 con 0x7f77cc101530 2024-09-19T09:04:26.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.648+0000 7f77d3bc4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f77cc113fc0 con 0x7f77cc0ffe10 2024-09-19T09:04:26.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.648+0000 7f77d115f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77cc100b70 0x7f77cc19e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:26.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.648+0000 7f77d1960640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77cc0ffe10 0x7f77cc19e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:26.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.648+0000 7f77d115f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77cc100b70 0x7f77cc19e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50164/0 (socket says 172.21.15.92:50164) 2024-09-19T09:04:26.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.648+0000 7f77d115f640 1 -- 172.21.15.92:0/3625395354 learned_addr learned my addr 172.21.15.92:0/3625395354 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:26.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.648+0000 7f77d2161640 1 --2- 172.21.15.92:0/3625395354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77cc101530 0x7f77cc1a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:26.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.649+0000 7f77d115f640 1 -- 172.21.15.92:0/3625395354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77cc0ffe10 msgr2=0x7f77cc19e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:26.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.649+0000 7f77d115f640 1 --2- 172.21.15.92:0/3625395354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77cc0ffe10 0x7f77cc19e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:26.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.649+0000 7f77d115f640 1 -- 172.21.15.92:0/3625395354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77cc101530 msgr2=0x7f77cc1a5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:26.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.649+0000 7f77d115f640 1 --2- 172.21.15.92:0/3625395354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77cc101530 0x7f77cc1a5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:26.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.649+0000 7f77d115f640 1 -- 172.21.15.92:0/3625395354 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77cc1a5f70 con 0x7f77cc100b70 2024-09-19T09:04:26.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.649+0000 7f77d1960640 1 --2- 172.21.15.92:0/3625395354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77cc0ffe10 0x7f77cc19e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:26.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.649+0000 7f77d2161640 1 --2- 172.21.15.92:0/3625395354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77cc101530 0x7f77cc1a5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:26.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.649+0000 7f77d115f640 1 --2- 172.21.15.92:0/3625395354 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77cc100b70 0x7f77cc19e890 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f77bc00e9c0 tx=0x7f77bc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:26.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.649+0000 7f77c2ffd640 1 -- 172.21.15.92:0/3625395354 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77bc00ccc0 con 0x7f77cc100b70 2024-09-19T09:04:26.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.649+0000 7f77c2ffd640 1 -- 172.21.15.92:0/3625395354 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77bc0035f0 con 0x7f77cc100b70 2024-09-19T09:04:26.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.649+0000 7f77d3bc4640 1 -- 172.21.15.92:0/3625395354 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77cc1a6260 con 0x7f77cc100b70 2024-09-19T09:04:26.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.649+0000 7f77c2ffd640 1 -- 172.21.15.92:0/3625395354 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77bc00ce60 con 0x7f77cc100b70 2024-09-19T09:04:26.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.649+0000 7f77d3bc4640 1 -- 172.21.15.92:0/3625395354 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77cc1a67b0 con 0x7f77cc100b70 2024-09-19T09:04:26.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.654+0000 7f77c2ffd640 1 -- 172.21.15.92:0/3625395354 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f77bc0037a0 con 0x7f77cc100b70 2024-09-19T09:04:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.654+0000 7f77d6a3e740 1 Processor -- start 2024-09-19T09:04:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.654+0000 7f77d6a3e740 1 -- start start 2024-09-19T09:04:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.655+0000 7f77d6a3e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e431a739a0 0x55e431a73da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.655+0000 7f77d6a3e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e431a742e0 0x55e431a78da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.655+0000 7f77d6a3e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e431a79370 0x55e431a7b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.655+0000 7f77d6a3e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e4319d72f0 con 0x55e431a739a0 2024-09-19T09:04:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.655+0000 7f77d6a3e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e43197f270 con 0x55e431a742e0 2024-09-19T09:04:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.655+0000 7f77d6a3e740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e4319d32b0 con 0x55e431a79370 2024-09-19T09:04:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.655+0000 7f77d1960640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e431a742e0 0x55e431a78da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.655+0000 7f77d2161640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e431a739a0 0x55e431a73da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.655+0000 7f77d1960640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e431a742e0 0x55e431a78da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:49030/0 (socket says 172.21.15.92:49030) 2024-09-19T09:04:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.655+0000 7f77d1960640 1 -- 172.21.15.92:0/2029861371 learned_addr learned my addr 172.21.15.92:0/2029861371 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.655+0000 7f77d115f640 1 --2- 172.21.15.92:0/2029861371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e431a79370 0x55e431a7b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.655+0000 7f77d1960640 1 -- 172.21.15.92:0/2029861371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e431a79370 msgr2=0x55e431a7b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.655+0000 7f77d1960640 1 --2- 172.21.15.92:0/2029861371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e431a79370 0x55e431a7b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.655+0000 7f77d1960640 1 -- 172.21.15.92:0/2029861371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e431a739a0 msgr2=0x55e431a73da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.655+0000 7f77d1960640 1 --2- 172.21.15.92:0/2029861371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e431a739a0 0x55e431a73da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:26.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.655+0000 7f77d1960640 1 -- 172.21.15.92:0/2029861371 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e43197e340 con 0x55e431a742e0 2024-09-19T09:04:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.655+0000 7f77c2ffd640 1 --2- 172.21.15.92:0/3625395354 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f77b80a3340 0x7f77b80a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.656+0000 7f77d2161640 1 --2- 172.21.15.92:0/3625395354 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f77b80a3340 0x7f77b80a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.656+0000 7f77d1960640 1 --2- 172.21.15.92:0/2029861371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e431a742e0 0x55e431a78da0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f77c80104d0 tx=0x7f77c8010990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5feb77fd38b0768 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.656+0000 7f77c2ffd640 1 -- 172.21.15.92:0/3625395354 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f77bc0cfb80 con 0x7f77cc100b70 2024-09-19T09:04:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.656+0000 7f77b7fff640 1 -- 172.21.15.92:0/2029861371 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c8004220 con 0x55e431a742e0 2024-09-19T09:04:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.656+0000 7f77b7fff640 1 -- 172.21.15.92:0/2029861371 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77c80043c0 con 0x55e431a742e0 2024-09-19T09:04:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.656+0000 7f77b7fff640 1 -- 172.21.15.92:0/2029861371 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c8011aa0 con 0x55e431a742e0 2024-09-19T09:04:26.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.657+0000 7f77d2161640 1 --2- 172.21.15.92:0/3625395354 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f77b80a3340 0x7f77b80a5800 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f77c4004ab0 tx=0x7f77c4004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:26.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.657+0000 7f77d6a3e740 1 -- 172.21.15.92:0/2029861371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e431a742e0 msgr2=0x55e431a78da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:26.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.657+0000 7f77d6a3e740 1 --2- 172.21.15.92:0/2029861371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e431a742e0 0x55e431a78da0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f77c80104d0 tx=0x7f77c8010990 comp rx=0 tx=0).stop 2024-09-19T09:04:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.657+0000 7f77d6a3e740 1 -- 172.21.15.92:0/2029861371 shutdown_connections 2024-09-19T09:04:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.657+0000 7f77d6a3e740 1 --2- 172.21.15.92:0/2029861371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e431a79370 0x55e431a7b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.657+0000 7f77d6a3e740 1 --2- 172.21.15.92:0/2029861371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e431a742e0 0x55e431a78da0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.657+0000 7f77d6a3e740 1 --2- 172.21.15.92:0/2029861371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e431a739a0 0x55e431a73da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.657+0000 7f77d6a3e740 1 -- 172.21.15.92:0/2029861371 >> 172.21.15.92:0/2029861371 conn(0x55e431a6f010 msgr2=0x55e431a6f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.657+0000 7f77d6a3e740 1 -- 172.21.15.92:0/2029861371 shutdown_connections 2024-09-19T09:04:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.657+0000 7f77d6a3e740 1 -- 172.21.15.92:0/2029861371 wait complete. 2024-09-19T09:04:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.658+0000 7f77d6a3e740 1 -- start start 2024-09-19T09:04:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.658+0000 7f77d6a3e740 1 Processor -- start 2024-09-19T09:04:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.658+0000 7f77d6a3e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e431a739a0 0x55e431a7dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.658+0000 7f77d6a3e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e431a742e0 0x55e431a7e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.658+0000 7f77d6a3e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e431a79370 0x55e431a851a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.658+0000 7f77d6a3e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e431a7c340 con 0x55e431a79370 2024-09-19T09:04:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.658+0000 7f77d6a3e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e431960290 con 0x55e431a739a0 2024-09-19T09:04:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.658+0000 7f77d6a3e740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e431a7c4c0 con 0x55e431a742e0 2024-09-19T09:04:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.658+0000 7f77d6a3e740 10 client.0 _ll_register_callbacks cb 0x55e431991140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.658+0000 7f77d115f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e431a742e0 0x55e431a7e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.659+0000 7f77d115f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e431a742e0 0x55e431a7e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:43918/0 (socket says 172.21.15.92:43918) 2024-09-19T09:04:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.659+0000 7f77d115f640 1 -- 172.21.15.92:0/1529169309 learned_addr learned my addr 172.21.15.92:0/1529169309 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.659+0000 7f77d2161640 1 --2- 172.21.15.92:0/1529169309 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e431a79370 0x55e431a851a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.659+0000 7f77d1960640 1 --2- 172.21.15.92:0/1529169309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e431a739a0 0x55e431a7dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.659+0000 7f77d115f640 1 -- 172.21.15.92:0/1529169309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e431a739a0 msgr2=0x55e431a7dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.659+0000 7f77d115f640 1 --2- 172.21.15.92:0/1529169309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e431a739a0 0x55e431a7dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.659+0000 7f77d115f640 1 -- 172.21.15.92:0/1529169309 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e431a79370 msgr2=0x55e431a851a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.659+0000 7f77d115f640 1 --2- 172.21.15.92:0/1529169309 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e431a79370 0x55e431a851a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.659+0000 7f77d115f640 1 -- 172.21.15.92:0/1529169309 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4316ea210 con 0x55e431a742e0 2024-09-19T09:04:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.659+0000 7f77d115f640 1 --2- 172.21.15.92:0/1529169309 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e431a742e0 0x55e431a7e160 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f77bc09c130 tx=0x7f77bc09c030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=baa87c102c331aed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.659+0000 7f77b57fa640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:04:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.659+0000 7f77b57fa640 1 -- 172.21.15.92:0/1529169309 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77bc09c1a0 con 0x55e431a742e0 2024-09-19T09:04:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.659+0000 7f77b57fa640 1 -- 172.21.15.92:0/1529169309 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f77bc0a0120 con 0x55e431a742e0 2024-09-19T09:04:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.659+0000 7f77d6a3e740 1 -- 172.21.15.92:0/1529169309 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77c80043c0 con 0x55e431a742e0 2024-09-19T09:04:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.659+0000 7f77b57fa640 1 -- 172.21.15.92:0/1529169309 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f77bc0b51a0 con 0x55e431a742e0 2024-09-19T09:04:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.659+0000 7f77d6a3e740 10 client.26467 fetch_fsmap learned FSMap version 19 2024-09-19T09:04:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.659+0000 7f77d6a3e740 1 -- 172.21.15.92:0/1529169309 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e4317b6620 con 0x55e431a742e0 2024-09-19T09:04:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.660+0000 7f77b57fa640 1 -- 172.21.15.92:0/1529169309 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77c80043c0 con 0x55e431a742e0 2024-09-19T09:04:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.660+0000 7f77b57fa640 1 -- 172.21.15.92:0/1529169309 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f77bc09c490 con 0x55e431a742e0 2024-09-19T09:04:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.660+0000 7f77d6a3e740 10 client.26467 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:04:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.660+0000 7f77d6a3e740 10 client.26467 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:04:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.660+0000 7f77d6a3e740 20 client.26467 populate_metadata read hostname 'smithi092' 2024-09-19T09:04:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.660+0000 7f77d6a3e740 1 --2- 172.21.15.92:0/1529169309 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e431a89960 0x55e431a8bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.660+0000 7f77d6a3e740 4 client.26467 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.660+0000 7f77d6a3e740 1 -- 172.21.15.92:0/1529169309 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e4319e4a20 con 0x55e431a89960 2024-09-19T09:04:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.660+0000 7f77d1960640 1 --2- 172.21.15.92:0/1529169309 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e431a89960 0x55e431a8bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.661+0000 7f77d1960640 1 --2- 172.21.15.92:0/1529169309 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e431a89960 0x55e431a8bd50 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5612fe1e19882d8f server_cookie=2a752b793b1e2ad3 in_seq=0 out_seq=0 2024-09-19T09:04:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.661+0000 7f77b57fa640 10 client.26467 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.661+0000 7f77b57fa640 1 -- 172.21.15.92:0/1529169309 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e4319e4a20 con 0x55e431a89960 2024-09-19T09:04:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.661+0000 7f77b57fa640 10 client.26467 handle_command_reply: tid=0 2024-09-19T09:04:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.661+0000 7f77d6a3e740 1 client.26467 shutdown 2024-09-19T09:04:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.662+0000 7f77d6a3e740 1 -- 172.21.15.92:0/1529169309 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e431a742e0 msgr2=0x55e431a7e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.662+0000 7f77d6a3e740 1 --2- 172.21.15.92:0/1529169309 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e431a742e0 0x55e431a7e160 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f77bc09c130 tx=0x7f77bc09c030 comp rx=0 tx=0).stop 2024-09-19T09:04:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.662+0000 7f77d6a3e740 1 -- 172.21.15.92:0/1529169309 shutdown_connections 2024-09-19T09:04:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.662+0000 7f77d6a3e740 1 --2- 172.21.15.92:0/1529169309 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e431a89960 0x55e431a8bd50 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.662+0000 7f77d6a3e740 1 --2- 172.21.15.92:0/1529169309 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e431a79370 0x55e431a851a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.662+0000 7f77d6a3e740 1 --2- 172.21.15.92:0/1529169309 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e431a742e0 0x55e431a7e160 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.662+0000 7f77b57fa640 0 client.26467 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.662+0000 7f77d6a3e740 1 --2- 172.21.15.92:0/1529169309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e431a739a0 0x55e431a7dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.662+0000 7f77d6a3e740 1 -- 172.21.15.92:0/1529169309 >> 172.21.15.92:0/1529169309 conn(0x55e431a6f010 msgr2=0x55e431a70820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:26.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.663+0000 7f77d6a3e740 1 -- 172.21.15.92:0/1529169309 shutdown_connections 2024-09-19T09:04:26.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.663+0000 7f77d6a3e740 1 -- 172.21.15.92:0/1529169309 wait complete. 2024-09-19T09:04:26.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.664+0000 7f77d6a3e740 20 client.26467 trim_cache size 0 max 16384 2024-09-19T09:04:26.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.695+0000 7f77d6a3e740 1 Processor -- start 2024-09-19T09:04:26.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.703+0000 7f77d6a3e740 1 -- start start 2024-09-19T09:04:26.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.703+0000 7f77d6a3e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e431a739a0 0x55e431a6fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:26.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.703+0000 7f77d6a3e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e431a742e0 0x55e431a85160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:26.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.703+0000 7f77d6a3e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e431a79370 0x55e431a70400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:26.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.703+0000 7f77d6a3e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f77cc1ad630 con 0x55e431a79370 2024-09-19T09:04:26.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.703+0000 7f77d6a3e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f77cc1afed0 con 0x55e431a739a0 2024-09-19T09:04:26.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.703+0000 7f77d6a3e740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f77cc1adcc0 con 0x55e431a742e0 2024-09-19T09:04:26.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.703+0000 7f77d115f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e431a742e0 0x55e431a85160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:26.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.703+0000 7f77d115f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e431a742e0 0x55e431a85160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:43928/0 (socket says 172.21.15.92:43928) 2024-09-19T09:04:26.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.703+0000 7f77d115f640 1 -- 172.21.15.92:0/3949709515 learned_addr learned my addr 172.21.15.92:0/3949709515 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:26.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.704+0000 7f77d2161640 1 --2- 172.21.15.92:0/3949709515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e431a79370 0x55e431a70400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:26.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.704+0000 7f77d115f640 1 -- 172.21.15.92:0/3949709515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e431a739a0 msgr2=0x55e431a6fec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:04:26.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.704+0000 7f77d115f640 1 --2- 172.21.15.92:0/3949709515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e431a739a0 0x55e431a6fec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:26.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.704+0000 7f77d115f640 1 -- 172.21.15.92:0/3949709515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e431a79370 msgr2=0x55e431a70400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:26.710 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.704+0000 7f77d115f640 1 --2- 172.21.15.92:0/3949709515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e431a79370 0x55e431a70400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:26.710 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.704+0000 7f77d115f640 1 -- 172.21.15.92:0/3949709515 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e431a89780 con 0x55e431a742e0 2024-09-19T09:04:26.710 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.706+0000 7f77d115f640 1 --2- 172.21.15.92:0/3949709515 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e431a742e0 0x55e431a85160 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f77bc098b70 tx=0x7f77bc09a6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9b775a4103ebfb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:26.710 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.706+0000 7f77b77fe640 1 -- 172.21.15.92:0/3949709515 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77bc0ba070 con 0x55e431a742e0 2024-09-19T09:04:26.710 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.710+0000 7f77b77fe640 1 -- 172.21.15.92:0/3949709515 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77bc0a4e10 con 0x55e431a742e0 2024-09-19T09:04:26.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.711+0000 7f77d6a3e740 1 -- 172.21.15.92:0/3949709515 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e431a742e0 msgr2=0x55e431a85160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:26.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.711+0000 7f77d6a3e740 1 --2- 172.21.15.92:0/3949709515 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e431a742e0 0x55e431a85160 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f77bc098b70 tx=0x7f77bc09a6b0 comp rx=0 tx=0).stop 2024-09-19T09:04:26.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.711+0000 7f77d6a3e740 1 -- 172.21.15.92:0/3949709515 shutdown_connections 2024-09-19T09:04:26.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.711+0000 7f77d6a3e740 1 --2- 172.21.15.92:0/3949709515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e431a79370 0x55e431a70400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:26.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.711+0000 7f77d6a3e740 1 --2- 172.21.15.92:0/3949709515 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e431a742e0 0x55e431a85160 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:26.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.711+0000 7f77d6a3e740 1 --2- 172.21.15.92:0/3949709515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e431a739a0 0x55e431a6fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:26.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.711+0000 7f77d6a3e740 1 -- 172.21.15.92:0/3949709515 >> 172.21.15.92:0/3949709515 conn(0x55e431a6f010 msgr2=0x55e431a754c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:26.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.713+0000 7f77d6a3e740 1 -- 172.21.15.92:0/3949709515 shutdown_connections 2024-09-19T09:04:26.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.713+0000 7f77d6a3e740 1 -- 172.21.15.92:0/3949709515 wait complete. 2024-09-19T09:04:26.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.713+0000 7f77d6a3e740 1 -- start start 2024-09-19T09:04:26.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.713+0000 7f77d6a3e740 1 Processor -- start 2024-09-19T09:04:26.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.714+0000 7f77d6a3e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e431a739a0 0x55e431a82820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:26.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.714+0000 7f77d6a3e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e431a79370 0x55e431a82d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:26.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.714+0000 7f77d6a3e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e431a83d70 0x55e431a841d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:26.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.714+0000 7f77d6a3e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f77cc1ae390 con 0x55e431a83d70 2024-09-19T09:04:26.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.714+0000 7f77d6a3e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f77cc1af800 con 0x55e431a739a0 2024-09-19T09:04:26.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.714+0000 7f77d6a3e740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f77cc1aea60 con 0x55e431a79370 2024-09-19T09:04:26.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.714+0000 7f77d6a3e740 10 client.0 _ll_register_callbacks cb 0x7f77bc003e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:26.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.714+0000 7f77d1960640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e431a739a0 0x55e431a82820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:26.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.714+0000 7f77d1960640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e431a739a0 0x55e431a82820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:49034/0 (socket says 172.21.15.92:49034) 2024-09-19T09:04:26.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.714+0000 7f77d1960640 1 -- 172.21.15.92:0/3416860286 learned_addr learned my addr 172.21.15.92:0/3416860286 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:26.716 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.715+0000 7f77d2161640 1 --2- 172.21.15.92:0/3416860286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e431a83d70 0x55e431a841d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:26.716 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.715+0000 7f77d115f640 1 --2- 172.21.15.92:0/3416860286 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e431a79370 0x55e431a82d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:26.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.715+0000 7f77d1960640 1 -- 172.21.15.92:0/3416860286 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e431a79370 msgr2=0x55e431a82d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:26.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.715+0000 7f77d1960640 1 --2- 172.21.15.92:0/3416860286 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e431a79370 0x55e431a82d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:26.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.715+0000 7f77d1960640 1 -- 172.21.15.92:0/3416860286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e431a83d70 msgr2=0x55e431a841d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:26.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.715+0000 7f77d1960640 1 --2- 172.21.15.92:0/3416860286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e431a83d70 0x55e431a841d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:26.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.715+0000 7f77d1960640 1 -- 172.21.15.92:0/3416860286 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e431a84760 con 0x55e431a739a0 2024-09-19T09:04:26.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.715+0000 7f77d2161640 1 --2- 172.21.15.92:0/3416860286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e431a83d70 0x55e431a841d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:26.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.725+0000 7f77d1960640 1 --2- 172.21.15.92:0/3416860286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e431a739a0 0x55e431a82820 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f77c80104a0 tx=0x7f77c800bc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2d68c947bf7650f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:26.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.725+0000 7f77b57fa640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:04:26.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.726+0000 7f77b57fa640 1 -- 172.21.15.92:0/3416860286 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c8005240 con 0x55e431a739a0 2024-09-19T09:04:26.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.726+0000 7f77d6a3e740 1 -- 172.21.15.92:0/3416860286 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e431a790f0 con 0x55e431a739a0 2024-09-19T09:04:26.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.726+0000 7f77b57fa640 1 -- 172.21.15.92:0/3416860286 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f77c80053e0 con 0x55e431a739a0 2024-09-19T09:04:26.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.726+0000 7f77b57fa640 1 -- 172.21.15.92:0/3416860286 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f77c8036050 con 0x55e431a739a0 2024-09-19T09:04:26.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.727+0000 7f77d6a3e740 10 client.26567 fetch_fsmap learned FSMap version 19 2024-09-19T09:04:26.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.727+0000 7f77d6a3e740 1 -- 172.21.15.92:0/3416860286 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e431af4a40 con 0x55e431a739a0 2024-09-19T09:04:26.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.728+0000 7f77b57fa640 1 -- 172.21.15.92:0/3416860286 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55e431a790f0 con 0x55e431a739a0 2024-09-19T09:04:26.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.728+0000 7f77b57fa640 1 -- 172.21.15.92:0/3416860286 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f77c8004660 con 0x55e431a739a0 2024-09-19T09:04:26.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.729+0000 7f77d6a3e740 10 client.26567 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:04:26.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.729+0000 7f77d6a3e740 10 client.26567 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:04:26.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.729+0000 7f77d6a3e740 20 client.26567 populate_metadata read hostname 'smithi092' 2024-09-19T09:04:26.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.729+0000 7f77d6a3e740 1 --2- 172.21.15.92:0/3416860286 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e431af5110 0x55e431af7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:26.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.729+0000 7f77d6a3e740 4 client.26567 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:04:26.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.729+0000 7f77d6a3e740 1 -- 172.21.15.92:0/3416860286 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e4319ded70 con 0x55e431af5110 2024-09-19T09:04:26.732 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.732+0000 7f77d115f640 1 --2- 172.21.15.92:0/3416860286 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e431af5110 0x55e431af7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:26.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.733+0000 7f77d115f640 1 --2- 172.21.15.92:0/3416860286 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e431af5110 0x55e431af7500 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84c1df4e95520be9 server_cookie=2ad29fde28b17f65 in_seq=0 out_seq=0 2024-09-19T09:04:26.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.733+0000 7f77b57fa640 10 client.26567 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:26.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.758+0000 7f77b57fa640 1 -- 172.21.15.92:0/3416860286 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e4319ded70 con 0x55e431af5110 2024-09-19T09:04:26.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.758+0000 7f77b57fa640 10 client.26567 handle_command_reply: tid=0 2024-09-19T09:04:26.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.758+0000 7f77d6a3e740 1 client.26567 shutdown 2024-09-19T09:04:26.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.758+0000 7f77d6a3e740 1 -- 172.21.15.92:0/3416860286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e431a739a0 msgr2=0x55e431a82820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:26.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.758+0000 7f77d6a3e740 1 --2- 172.21.15.92:0/3416860286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e431a739a0 0x55e431a82820 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f77c80104a0 tx=0x7f77c800bc90 comp rx=0 tx=0).stop 2024-09-19T09:04:26.760 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.758+0000 7f77d6a3e740 1 -- 172.21.15.92:0/3416860286 shutdown_connections 2024-09-19T09:04:26.760 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.758+0000 7f77d6a3e740 1 --2- 172.21.15.92:0/3416860286 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e431af5110 0x55e431af7500 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:26.760 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.759+0000 7f77d6a3e740 1 --2- 172.21.15.92:0/3416860286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e431a83d70 0x55e431a841d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:26.760 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.759+0000 7f77b57fa640 0 client.26567 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:26.760 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.759+0000 7f77d6a3e740 1 --2- 172.21.15.92:0/3416860286 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e431a79370 0x55e431a82d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:26.760 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.759+0000 7f77d6a3e740 1 --2- 172.21.15.92:0/3416860286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e431a739a0 0x55e431a82820 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:26.760 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.759+0000 7f77d6a3e740 1 -- 172.21.15.92:0/3416860286 >> 172.21.15.92:0/3416860286 conn(0x55e431a6f010 msgr2=0x55e431a6d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:26.760 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.759+0000 7f77d6a3e740 1 -- 172.21.15.92:0/3416860286 shutdown_connections 2024-09-19T09:04:26.760 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.759+0000 7f77d6a3e740 1 -- 172.21.15.92:0/3416860286 wait complete. 2024-09-19T09:04:26.760 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.759+0000 7f77d6a3e740 20 client.26567 trim_cache size 0 max 16384 2024-09-19T09:04:26.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:04:26.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:04:26.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:04:26.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:04:26.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.760+0000 7f77d3bc4640 1 -- 172.21.15.92:0/3625395354 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f77b80a3340 msgr2=0x7f77b80a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:26.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.760+0000 7f77d3bc4640 1 --2- 172.21.15.92:0/3625395354 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f77b80a3340 0x7f77b80a5800 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f77c4004ab0 tx=0x7f77c4004a40 comp rx=0 tx=0).stop 2024-09-19T09:04:26.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.760+0000 7f77d3bc4640 1 -- 172.21.15.92:0/3625395354 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77cc100b70 msgr2=0x7f77cc19e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:26.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.760+0000 7f77d3bc4640 1 --2- 172.21.15.92:0/3625395354 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77cc100b70 0x7f77cc19e890 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f77bc00e9c0 tx=0x7f77bc00ee80 comp rx=0 tx=0).stop 2024-09-19T09:04:26.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.760+0000 7f77d3bc4640 1 -- 172.21.15.92:0/3625395354 shutdown_connections 2024-09-19T09:04:26.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.760+0000 7f77d3bc4640 1 --2- 172.21.15.92:0/3625395354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77cc101530 0x7f77cc1a5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:26.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.760+0000 7f77d3bc4640 1 --2- 172.21.15.92:0/3625395354 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f77b80a3340 0x7f77b80a5800 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:26.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.760+0000 7f77d3bc4640 1 --2- 172.21.15.92:0/3625395354 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77cc100b70 0x7f77cc19e890 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:26.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.760+0000 7f77d3bc4640 1 --2- 172.21.15.92:0/3625395354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77cc0ffe10 0x7f77cc19e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:26.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.760+0000 7f77d3bc4640 1 -- 172.21.15.92:0/3625395354 >> 172.21.15.92:0/3625395354 conn(0x7f77cc0fb930 msgr2=0x7f77cc101d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:26.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.761+0000 7f77d3bc4640 1 -- 172.21.15.92:0/3625395354 shutdown_connections 2024-09-19T09:04:26.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:26.761+0000 7f77d3bc4640 1 -- 172.21.15.92:0/3625395354 wait complete. 2024-09-19T09:04:26.881 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:27.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:26 smithi190 ceph-mon[35358]: pgmap v569: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 7.3 MiB/s wr, 683 op/s 2024-09-19T09:04:27.155 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:26 smithi092 ceph-mon[31407]: pgmap v569: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 7.3 MiB/s wr, 683 op/s 2024-09-19T09:04:27.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:26 smithi167 ceph-mon[35359]: pgmap v569: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 7.3 MiB/s wr, 683 op/s 2024-09-19T09:04:27.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.437+0000 7f52252c0640 1 -- 172.21.15.92:0/1523520771 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f522010c180 msgr2=0x7f522010e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:27.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.437+0000 7f52252c0640 1 --2- 172.21.15.92:0/1523520771 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f522010c180 0x7f522010e620 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f5218009ca0 tx=0x7f521802a940 comp rx=0 tx=0).stop 2024-09-19T09:04:27.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.437+0000 7f52252c0640 1 -- 172.21.15.92:0/1523520771 shutdown_connections 2024-09-19T09:04:27.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.437+0000 7f52252c0640 1 --2- 172.21.15.92:0/1523520771 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f522010c180 0x7f522010e620 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.437+0000 7f52252c0640 1 --2- 172.21.15.92:0/1523520771 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5220103670 0x7f522010bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.437+0000 7f52252c0640 1 --2- 172.21.15.92:0/1523520771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5220102d50 0x7f5220103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.437+0000 7f52252c0640 1 -- 172.21.15.92:0/1523520771 >> 172.21.15.92:0/1523520771 conn(0x7f52200fc7d0 msgr2=0x7f52200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:27.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.437+0000 7f52252c0640 1 -- 172.21.15.92:0/1523520771 shutdown_connections 2024-09-19T09:04:27.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.437+0000 7f52252c0640 1 -- 172.21.15.92:0/1523520771 wait complete. 2024-09-19T09:04:27.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.438+0000 7f52252c0640 1 Processor -- start 2024-09-19T09:04:27.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.438+0000 7f52252c0640 1 -- start start 2024-09-19T09:04:27.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.439+0000 7f52252c0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5220102d50 0x7f52201009b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:27.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.439+0000 7f52252c0640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5220103670 0x7f5220100ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:27.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.439+0000 7f52252c0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f522010c180 0x7f5220101430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:27.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.439+0000 7f52252c0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5220111f80 con 0x7f522010c180 2024-09-19T09:04:27.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.439+0000 7f52252c0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5220111e00 con 0x7f5220102d50 2024-09-19T09:04:27.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.439+0000 7f52252c0640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5220112100 con 0x7f5220103670 2024-09-19T09:04:27.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.439+0000 7f521f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f522010c180 0x7f5220101430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:27.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.439+0000 7f521f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f522010c180 0x7f5220101430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50212/0 (socket says 172.21.15.92:50212) 2024-09-19T09:04:27.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.439+0000 7f521f7fe640 1 -- 172.21.15.92:0/3716482216 learned_addr learned my addr 172.21.15.92:0/3716482216 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:27.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.439+0000 7f521e7fc640 1 --2- 172.21.15.92:0/3716482216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5220103670 0x7f5220100ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:27.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.439+0000 7f521effd640 1 --2- 172.21.15.92:0/3716482216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5220102d50 0x7f52201009b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:27.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.439+0000 7f521f7fe640 1 -- 172.21.15.92:0/3716482216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5220103670 msgr2=0x7f5220100ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:27.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.439+0000 7f521f7fe640 1 --2- 172.21.15.92:0/3716482216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5220103670 0x7f5220100ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.439+0000 7f521f7fe640 1 -- 172.21.15.92:0/3716482216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5220102d50 msgr2=0x7f52201009b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:27.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.439+0000 7f521f7fe640 1 --2- 172.21.15.92:0/3716482216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5220102d50 0x7f52201009b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.439+0000 7f521f7fe640 1 -- 172.21.15.92:0/3716482216 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52201a68a0 con 0x7f522010c180 2024-09-19T09:04:27.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.440+0000 7f521f7fe640 1 --2- 172.21.15.92:0/3716482216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f522010c180 0x7f5220101430 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f5218005e30 tx=0x7f521802f630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:27.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.440+0000 7f5207fff640 1 -- 172.21.15.92:0/3716482216 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5218034040 con 0x7f522010c180 2024-09-19T09:04:27.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.440+0000 7f5207fff640 1 -- 172.21.15.92:0/3716482216 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5218003e50 con 0x7f522010c180 2024-09-19T09:04:27.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.440+0000 7f52252c0640 1 -- 172.21.15.92:0/3716482216 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52201a6b30 con 0x7f522010c180 2024-09-19T09:04:27.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.440+0000 7f5207fff640 1 -- 172.21.15.92:0/3716482216 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52180046c0 con 0x7f522010c180 2024-09-19T09:04:27.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.440+0000 7f52252c0640 1 -- 172.21.15.92:0/3716482216 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52201a7010 con 0x7f522010c180 2024-09-19T09:04:27.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.443+0000 7f5227699740 1 Processor -- start 2024-09-19T09:04:27.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.444+0000 7f5207fff640 1 -- 172.21.15.92:0/3716482216 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5218037020 con 0x7f522010c180 2024-09-19T09:04:27.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.444+0000 7f5227699740 1 -- start start 2024-09-19T09:04:27.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.444+0000 7f5227699740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e800f4b10 0x557e800f3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:27.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.444+0000 7f5227699740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557e800f35a0 0x557e800f39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:27.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.444+0000 7f5227699740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e800fe340 0x557e80100730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:27.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.444+0000 7f5227699740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557e800592f0 con 0x557e800fe340 2024-09-19T09:04:27.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.444+0000 7f5227699740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x557e80000cf0 con 0x557e800f4b10 2024-09-19T09:04:27.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.444+0000 7f5227699740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x557e800552b0 con 0x557e800f35a0 2024-09-19T09:04:27.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.444+0000 7f521e7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e800fe340 0x557e80100730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:27.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.444+0000 7f521e7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e800fe340 0x557e80100730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50224/0 (socket says 172.21.15.92:50224) 2024-09-19T09:04:27.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.444+0000 7f521e7fc640 1 -- 172.21.15.92:0/851145900 learned_addr learned my addr 172.21.15.92:0/851145900 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:27.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.444+0000 7f521effd640 1 --2- 172.21.15.92:0/851145900 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557e800f35a0 0x557e800f39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:27.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.444+0000 7f521e7fc640 1 --2- 172.21.15.92:0/851145900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e800f4b10 0x557e800f3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:27.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.445+0000 7f521effd640 1 -- 172.21.15.92:0/851145900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e800f4b10 msgr2=0x557e800f3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:27.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.445+0000 7f521effd640 1 --2- 172.21.15.92:0/851145900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e800f4b10 0x557e800f3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.445+0000 7f521effd640 1 -- 172.21.15.92:0/851145900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e800fe340 msgr2=0x557e80100730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:27.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.445+0000 7f521effd640 1 --2- 172.21.15.92:0/851145900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e800fe340 0x557e80100730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.445+0000 7f521effd640 1 -- 172.21.15.92:0/851145900 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e7ffe53a0 con 0x557e800f35a0 2024-09-19T09:04:27.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.445+0000 7f521effd640 1 --2- 172.21.15.92:0/851145900 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557e800f35a0 0x557e800f39e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5210005fd0 tx=0x7f52100107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6818f258db3b0a1a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:27.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.445+0000 7f52057fa640 1 -- 172.21.15.92:0/851145900 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f521001c480 con 0x557e800f35a0 2024-09-19T09:04:27.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.445+0000 7f52057fa640 1 -- 172.21.15.92:0/851145900 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f521001cb00 con 0x557e800f35a0 2024-09-19T09:04:27.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.445+0000 7f52057fa640 1 -- 172.21.15.92:0/851145900 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5210011c10 con 0x557e800f35a0 2024-09-19T09:04:27.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.445+0000 7f5207fff640 1 --2- 172.21.15.92:0/3716482216 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f52080a3390 0x7f52080a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:27.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.446+0000 7f521e7fc640 1 --2- 172.21.15.92:0/3716482216 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f52080a3390 0x7f52080a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:27.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.446+0000 7f5207fff640 1 -- 172.21.15.92:0/3716482216 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f52180f0750 con 0x7f522010c180 2024-09-19T09:04:27.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.446+0000 7f5227699740 1 -- 172.21.15.92:0/851145900 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557e800f35a0 msgr2=0x557e800f39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:27.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.446+0000 7f5227699740 1 --2- 172.21.15.92:0/851145900 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557e800f35a0 0x557e800f39e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5210005fd0 tx=0x7f52100107a0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.446+0000 7f521e7fc640 1 --2- 172.21.15.92:0/3716482216 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f52080a3390 0x7f52080a5850 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x557e800f4040 tx=0x7f52140096c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:27.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.447+0000 7f5227699740 1 -- 172.21.15.92:0/851145900 shutdown_connections 2024-09-19T09:04:27.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.447+0000 7f5227699740 1 --2- 172.21.15.92:0/851145900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e800fe340 0x557e80100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.447+0000 7f5227699740 1 --2- 172.21.15.92:0/851145900 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557e800f35a0 0x557e800f39e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.447+0000 7f5227699740 1 --2- 172.21.15.92:0/851145900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e800f4b10 0x557e800f3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.447+0000 7f5227699740 1 -- 172.21.15.92:0/851145900 >> 172.21.15.92:0/851145900 conn(0x557e800bc310 msgr2=0x557e800efc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:27.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.447+0000 7f5227699740 1 -- 172.21.15.92:0/851145900 shutdown_connections 2024-09-19T09:04:27.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.447+0000 7f5227699740 1 -- 172.21.15.92:0/851145900 wait complete. 2024-09-19T09:04:27.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.447+0000 7f5227699740 1 -- start start 2024-09-19T09:04:27.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.447+0000 7f5227699740 1 Processor -- start 2024-09-19T09:04:27.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.447+0000 7f5227699740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e800f35a0 0x557e800fdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:27.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.448+0000 7f5227699740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557e800f4b10 0x557e800fafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:27.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.448+0000 7f5227699740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e800fe340 0x557e800fb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:27.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.448+0000 7f5227699740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557e801010e0 con 0x557e800f35a0 2024-09-19T09:04:27.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.448+0000 7f5227699740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x557e80014060 con 0x557e800fe340 2024-09-19T09:04:27.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.448+0000 7f5227699740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x557e80101260 con 0x557e800f4b10 2024-09-19T09:04:27.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.448+0000 7f521effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e800f35a0 0x557e800fdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:27.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.448+0000 7f521e7fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557e800f4b10 0x557e800fafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:27.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.448+0000 7f521effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e800f35a0 0x557e800fdd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50228/0 (socket says 172.21.15.92:50228) 2024-09-19T09:04:27.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.448+0000 7f521effd640 1 -- 172.21.15.92:0/385242957 learned_addr learned my addr 172.21.15.92:0/385242957 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:27.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.448+0000 7f5227699740 10 client.0 _ll_register_callbacks cb 0x557e7fd678c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:27.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.448+0000 7f521f7fe640 1 --2- 172.21.15.92:0/385242957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e800fe340 0x557e800fb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:27.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.448+0000 7f521effd640 1 -- 172.21.15.92:0/385242957 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557e800f4b10 msgr2=0x557e800fafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:27.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.448+0000 7f521effd640 1 --2- 172.21.15.92:0/385242957 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557e800f4b10 0x557e800fafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.448+0000 7f521effd640 1 -- 172.21.15.92:0/385242957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e800fe340 msgr2=0x557e800fb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:27.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.448+0000 7f521effd640 1 --2- 172.21.15.92:0/385242957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e800fe340 0x557e800fb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.448+0000 7f521effd640 1 -- 172.21.15.92:0/385242957 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e7fdca3c0 con 0x557e800f35a0 2024-09-19T09:04:27.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.448+0000 7f521e7fc640 1 --2- 172.21.15.92:0/385242957 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557e800f4b10 0x557e800fafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:27.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.448+0000 7f521effd640 1 --2- 172.21.15.92:0/385242957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e800f35a0 0x557e800fdd00 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f521000bf50 tx=0x7f5210005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d57b0df3adc9364 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:27.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.448+0000 7f5202ff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:04:27.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.449+0000 7f5202ff5640 1 -- 172.21.15.92:0/385242957 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f521002b060 con 0x557e800f35a0 2024-09-19T09:04:27.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.449+0000 7f5202ff5640 1 -- 172.21.15.92:0/385242957 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f521001c690 con 0x557e800f35a0 2024-09-19T09:04:27.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.449+0000 7f5227699740 1 -- 172.21.15.92:0/385242957 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f521001cb00 con 0x557e800f35a0 2024-09-19T09:04:27.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.449+0000 7f5202ff5640 1 -- 172.21.15.92:0/385242957 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f521001c890 con 0x557e800f35a0 2024-09-19T09:04:27.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.449+0000 7f5227699740 10 client.17262 fetch_fsmap learned FSMap version 19 2024-09-19T09:04:27.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.449+0000 7f5227699740 1 -- 172.21.15.92:0/385242957 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x557e8010cb20 con 0x557e800f35a0 2024-09-19T09:04:27.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.449+0000 7f5202ff5640 1 -- 172.21.15.92:0/385242957 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5210011df0 con 0x557e800f35a0 2024-09-19T09:04:27.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.449+0000 7f5202ff5640 1 -- 172.21.15.92:0/385242957 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f5210030070 con 0x557e800f35a0 2024-09-19T09:04:27.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.449+0000 7f5227699740 10 client.17262 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:04:27.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.449+0000 7f5227699740 10 client.17262 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:04:27.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.449+0000 7f5227699740 20 client.17262 populate_metadata read hostname 'smithi092' 2024-09-19T09:04:27.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.449+0000 7f5227699740 1 --2- 172.21.15.92:0/385242957 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557e8010df20 0x557e80110310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:27.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.450+0000 7f5227699740 4 client.17262 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:27.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.450+0000 7f5227699740 1 -- 172.21.15.92:0/385242957 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f521001cb00 con 0x557e8010df20 2024-09-19T09:04:27.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.450+0000 7f521e7fc640 1 --2- 172.21.15.92:0/385242957 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557e8010df20 0x557e80110310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:27.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.452+0000 7f521e7fc640 1 --2- 172.21.15.92:0/385242957 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557e8010df20 0x557e80110310 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bce53eafe97dde1 server_cookie=98b7c2ddadd8565e in_seq=0 out_seq=0 2024-09-19T09:04:27.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.452+0000 7f5202ff5640 10 client.17262 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:27.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.453+0000 7f5202ff5640 1 -- 172.21.15.92:0/385242957 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f521001cb00 con 0x557e8010df20 2024-09-19T09:04:27.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.453+0000 7f5202ff5640 10 client.17262 handle_command_reply: tid=0 2024-09-19T09:04:27.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.453+0000 7f5227699740 1 client.17262 shutdown 2024-09-19T09:04:27.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.453+0000 7f5227699740 1 -- 172.21.15.92:0/385242957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e800f35a0 msgr2=0x557e800fdd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:27.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.453+0000 7f5227699740 1 --2- 172.21.15.92:0/385242957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e800f35a0 0x557e800fdd00 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f521000bf50 tx=0x7f5210005850 comp rx=0 tx=0).stop 2024-09-19T09:04:27.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.453+0000 7f5227699740 1 -- 172.21.15.92:0/385242957 shutdown_connections 2024-09-19T09:04:27.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.453+0000 7f5227699740 1 --2- 172.21.15.92:0/385242957 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557e8010df20 0x557e80110310 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.453+0000 7f5227699740 1 --2- 172.21.15.92:0/385242957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e800fe340 0x557e800fb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.453+0000 7f5202ff5640 0 client.17262 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:27.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.454+0000 7f5227699740 1 --2- 172.21.15.92:0/385242957 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557e800f4b10 0x557e800fafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.454+0000 7f5227699740 1 --2- 172.21.15.92:0/385242957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e800f35a0 0x557e800fdd00 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.454+0000 7f5227699740 1 -- 172.21.15.92:0/385242957 >> 172.21.15.92:0/385242957 conn(0x557e800bc310 msgr2=0x557e800f5930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:27.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.454+0000 7f5227699740 1 -- 172.21.15.92:0/385242957 shutdown_connections 2024-09-19T09:04:27.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.454+0000 7f5227699740 1 -- 172.21.15.92:0/385242957 wait complete. 2024-09-19T09:04:27.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.454+0000 7f5227699740 20 client.17262 trim_cache size 0 max 16384 2024-09-19T09:04:27.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.472+0000 7f5227699740 1 Processor -- start 2024-09-19T09:04:27.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.473+0000 7f5227699740 1 -- start start 2024-09-19T09:04:27.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.473+0000 7f5227699740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e800f35a0 0x557e8010a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:27.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.473+0000 7f5227699740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e800f4b10 0x557e800fa870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:27.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.473+0000 7f5227699740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557e800fe340 0x557e800ff730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:27.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.473+0000 7f5227699740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f52201ad750 con 0x557e800f4b10 2024-09-19T09:04:27.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.473+0000 7f5227699740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f52201afff0 con 0x557e800f35a0 2024-09-19T09:04:27.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.473+0000 7f5227699740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f52201adde0 con 0x557e800fe340 2024-09-19T09:04:27.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.473+0000 7f521e7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e800f4b10 0x557e800fa870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:27.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.473+0000 7f521e7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e800f4b10 0x557e800fa870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50244/0 (socket says 172.21.15.92:50244) 2024-09-19T09:04:27.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.473+0000 7f521e7fc640 1 -- 172.21.15.92:0/817195626 learned_addr learned my addr 172.21.15.92:0/817195626 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:27.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.473+0000 7f521effd640 1 --2- 172.21.15.92:0/817195626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e800f35a0 0x557e8010a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:27.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.473+0000 7f521f7fe640 1 --2- 172.21.15.92:0/817195626 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557e800fe340 0x557e800ff730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:27.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.474+0000 7f521e7fc640 1 -- 172.21.15.92:0/817195626 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557e800fe340 msgr2=0x557e800ff730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:27.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.474+0000 7f521e7fc640 1 --2- 172.21.15.92:0/817195626 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557e800fe340 0x557e800ff730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.474+0000 7f521e7fc640 1 -- 172.21.15.92:0/817195626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e800f35a0 msgr2=0x557e8010a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:27.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.474+0000 7f521e7fc640 1 --2- 172.21.15.92:0/817195626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e800f35a0 0x557e8010a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.474+0000 7f521e7fc640 1 -- 172.21.15.92:0/817195626 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e800f0da0 con 0x557e800f4b10 2024-09-19T09:04:27.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.474+0000 7f521f7fe640 1 --2- 172.21.15.92:0/817195626 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557e800fe340 0x557e800ff730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:27.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.474+0000 7f521e7fc640 1 --2- 172.21.15.92:0/817195626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e800f4b10 0x557e800fa870 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f5214009730 tx=0x7f5214013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8de4a4b70498b44 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:27.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.474+0000 7f5204ff9640 1 -- 172.21.15.92:0/817195626 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5214005020 con 0x557e800f4b10 2024-09-19T09:04:27.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.475+0000 7f5204ff9640 1 -- 172.21.15.92:0/817195626 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52140047a0 con 0x557e800f4b10 2024-09-19T09:04:27.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.475+0000 7f5204ff9640 1 -- 172.21.15.92:0/817195626 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f521402c530 con 0x557e800f4b10 2024-09-19T09:04:27.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.475+0000 7f5227699740 1 -- 172.21.15.92:0/817195626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e800f4b10 msgr2=0x557e800fa870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:27.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.475+0000 7f5227699740 1 --2- 172.21.15.92:0/817195626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e800f4b10 0x557e800fa870 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f5214009730 tx=0x7f5214013040 comp rx=0 tx=0).stop 2024-09-19T09:04:27.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.476+0000 7f5227699740 1 -- 172.21.15.92:0/817195626 shutdown_connections 2024-09-19T09:04:27.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.476+0000 7f5227699740 1 --2- 172.21.15.92:0/817195626 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557e800fe340 0x557e800ff730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.476+0000 7f5227699740 1 --2- 172.21.15.92:0/817195626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e800f4b10 0x557e800fa870 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.476+0000 7f5227699740 1 --2- 172.21.15.92:0/817195626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e800f35a0 0x557e8010a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.476+0000 7f5227699740 1 -- 172.21.15.92:0/817195626 >> 172.21.15.92:0/817195626 conn(0x557e800bc310 msgr2=0x557e800f62e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:27.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.476+0000 7f5227699740 1 -- 172.21.15.92:0/817195626 shutdown_connections 2024-09-19T09:04:27.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.476+0000 7f5227699740 1 -- 172.21.15.92:0/817195626 wait complete. 2024-09-19T09:04:27.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.476+0000 7f5227699740 1 -- start start 2024-09-19T09:04:27.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.476+0000 7f5227699740 1 Processor -- start 2024-09-19T09:04:27.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.477+0000 7f5227699740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557e800f35a0 0x557e800ff140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:27.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.477+0000 7f5227699740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e800f4b10 0x557e800ff680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:27.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.477+0000 7f5227699740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e800fe340 0x557e801054f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:27.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.477+0000 7f521e7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e800f4b10 0x557e800ff680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:27.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.477+0000 7f521e7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e800f4b10 0x557e800ff680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50252/0 (socket says 172.21.15.92:50252) 2024-09-19T09:04:27.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.477+0000 7f521effd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557e800f35a0 0x557e800ff140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:27.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.477+0000 7f521effd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557e800f35a0 0x557e800ff140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:44008/0 (socket says 172.21.15.92:44008) 2024-09-19T09:04:27.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.478+0000 7f521f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e800fe340 0x557e801054f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:27.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.478+0000 7f521f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e800fe340 0x557e801054f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:49094/0 (socket says 172.21.15.92:49094) 2024-09-19T09:04:27.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.478+0000 7f521e7fc640 1 -- 172.21.15.92:0/1603032002 learned_addr learned my addr 172.21.15.92:0/1603032002 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:27.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.478+0000 7f5227699740 1 -- 172.21.15.92:0/1603032002 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f52201ae4b0 con 0x557e800f4b10 2024-09-19T09:04:27.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.478+0000 7f5227699740 1 -- 172.21.15.92:0/1603032002 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f52201af920 con 0x557e800fe340 2024-09-19T09:04:27.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.478+0000 7f5227699740 1 -- 172.21.15.92:0/1603032002 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f52201aeb80 con 0x557e800f35a0 2024-09-19T09:04:27.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.478+0000 7f5227699740 10 client.0 _ll_register_callbacks cb 0x7f5214009a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:27.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.478+0000 7f521e7fc640 1 -- 172.21.15.92:0/1603032002 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557e800f35a0 msgr2=0x557e800ff140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:27.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.478+0000 7f521e7fc640 1 --2- 172.21.15.92:0/1603032002 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557e800f35a0 0x557e800ff140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.478+0000 7f521e7fc640 1 -- 172.21.15.92:0/1603032002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e800fe340 msgr2=0x557e801054f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:27.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.478+0000 7f521e7fc640 1 --2- 172.21.15.92:0/1603032002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e800fe340 0x557e801054f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.478+0000 7f521e7fc640 1 -- 172.21.15.92:0/1603032002 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e800f0930 con 0x557e800f4b10 2024-09-19T09:04:27.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.478+0000 7f521f7fe640 1 --2- 172.21.15.92:0/1603032002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e800fe340 0x557e801054f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:27.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.478+0000 7f521effd640 1 --2- 172.21.15.92:0/1603032002 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557e800f35a0 0x557e800ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:27.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.481+0000 7f521e7fc640 1 --2- 172.21.15.92:0/1603032002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e800f4b10 0x557e800ff680 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f5214030000 tx=0x7f52140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7451d93b81d3fd42 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:27.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.481+0000 7f5202ff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:04:27.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.482+0000 7f5202ff5640 1 -- 172.21.15.92:0/1603032002 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5214004b60 con 0x557e800f4b10 2024-09-19T09:04:27.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.482+0000 7f5202ff5640 1 -- 172.21.15.92:0/1603032002 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f5214009040 con 0x557e800f4b10 2024-09-19T09:04:27.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.482+0000 7f5227699740 1 -- 172.21.15.92:0/1603032002 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52140047a0 con 0x557e800f4b10 2024-09-19T09:04:27.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.482+0000 7f5202ff5640 1 -- 172.21.15.92:0/1603032002 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f5214004d00 con 0x557e800f4b10 2024-09-19T09:04:27.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.482+0000 7f5227699740 10 client.17268 fetch_fsmap learned FSMap version 19 2024-09-19T09:04:27.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.482+0000 7f5227699740 1 -- 172.21.15.92:0/1603032002 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x557e80106b60 con 0x557e800f4b10 2024-09-19T09:04:27.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.483+0000 7f5202ff5640 1 -- 172.21.15.92:0/1603032002 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52140047a0 con 0x557e800f4b10 2024-09-19T09:04:27.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.483+0000 7f5202ff5640 1 -- 172.21.15.92:0/1603032002 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f5214048070 con 0x557e800f4b10 2024-09-19T09:04:27.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.483+0000 7f5227699740 10 client.17268 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:04:27.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.483+0000 7f5227699740 10 client.17268 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:04:27.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.483+0000 7f5227699740 20 client.17268 populate_metadata read hostname 'smithi092' 2024-09-19T09:04:27.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.483+0000 7f5227699740 1 --2- 172.21.15.92:0/1603032002 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557e8010df20 0x557e8017a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:27.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.483+0000 7f5227699740 4 client.17268 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:04:27.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.483+0000 7f5227699740 1 -- 172.21.15.92:0/1603032002 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557e80066860 con 0x557e8010df20 2024-09-19T09:04:27.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.483+0000 7f521effd640 1 --2- 172.21.15.92:0/1603032002 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557e8010df20 0x557e8017a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:27.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.483+0000 7f521effd640 1 --2- 172.21.15.92:0/1603032002 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557e8010df20 0x557e8017a8f0 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f15d691a91e2456 server_cookie=6e2699d297e0e794 in_seq=0 out_seq=0 2024-09-19T09:04:27.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.483+0000 7f5202ff5640 10 client.17268 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:27.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.484+0000 7f5202ff5640 1 -- 172.21.15.92:0/1603032002 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557e80066860 con 0x557e8010df20 2024-09-19T09:04:27.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.484+0000 7f5202ff5640 10 client.17268 handle_command_reply: tid=0 2024-09-19T09:04:27.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.484+0000 7f5227699740 1 client.17268 shutdown 2024-09-19T09:04:27.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.484+0000 7f5227699740 1 -- 172.21.15.92:0/1603032002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e800f4b10 msgr2=0x557e800ff680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:27.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.484+0000 7f5227699740 1 --2- 172.21.15.92:0/1603032002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e800f4b10 0x557e800ff680 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f5214030000 tx=0x7f52140046c0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.484+0000 7f5227699740 1 -- 172.21.15.92:0/1603032002 shutdown_connections 2024-09-19T09:04:27.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.484+0000 7f5227699740 1 --2- 172.21.15.92:0/1603032002 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557e8010df20 0x557e8017a8f0 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.484+0000 7f5227699740 1 --2- 172.21.15.92:0/1603032002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e800fe340 0x557e801054f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.484+0000 7f5202ff5640 0 client.17268 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:27.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.484+0000 7f5227699740 1 --2- 172.21.15.92:0/1603032002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e800f4b10 0x557e800ff680 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.484+0000 7f5227699740 1 --2- 172.21.15.92:0/1603032002 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557e800f35a0 0x557e800ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.484+0000 7f5227699740 1 -- 172.21.15.92:0/1603032002 >> 172.21.15.92:0/1603032002 conn(0x557e800bc310 msgr2=0x557e800ee4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:27.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.484+0000 7f5227699740 1 -- 172.21.15.92:0/1603032002 shutdown_connections 2024-09-19T09:04:27.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.484+0000 7f5227699740 1 -- 172.21.15.92:0/1603032002 wait complete. 2024-09-19T09:04:27.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.484+0000 7f5227699740 20 client.17268 trim_cache size 0 max 16384 2024-09-19T09:04:27.488 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-19T09:04:27.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.485+0000 7f52252c0640 1 -- 172.21.15.92:0/3716482216 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f52080a3390 msgr2=0x7f52080a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:27.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.485+0000 7f52252c0640 1 --2- 172.21.15.92:0/3716482216 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f52080a3390 0x7f52080a5850 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x557e800f4040 tx=0x7f52140096c0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.485+0000 7f52252c0640 1 -- 172.21.15.92:0/3716482216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f522010c180 msgr2=0x7f5220101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:27.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.485+0000 7f52252c0640 1 --2- 172.21.15.92:0/3716482216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f522010c180 0x7f5220101430 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f5218005e30 tx=0x7f521802f630 comp rx=0 tx=0).stop 2024-09-19T09:04:27.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.485+0000 7f52252c0640 1 -- 172.21.15.92:0/3716482216 shutdown_connections 2024-09-19T09:04:27.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.485+0000 7f52252c0640 1 --2- 172.21.15.92:0/3716482216 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f52080a3390 0x7f52080a5850 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.485+0000 7f52252c0640 1 --2- 172.21.15.92:0/3716482216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f522010c180 0x7f5220101430 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.485+0000 7f52252c0640 1 --2- 172.21.15.92:0/3716482216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5220103670 0x7f5220100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.485+0000 7f52252c0640 1 --2- 172.21.15.92:0/3716482216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5220102d50 0x7f52201009b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.485+0000 7f52252c0640 1 -- 172.21.15.92:0/3716482216 >> 172.21.15.92:0/3716482216 conn(0x7f52200fc7d0 msgr2=0x7f52200fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:27.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.486+0000 7f52252c0640 1 -- 172.21.15.92:0/3716482216 shutdown_connections 2024-09-19T09:04:27.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:27.486+0000 7f52252c0640 1 -- 172.21.15.92:0/3716482216 wait complete. 2024-09-19T09:04:29.233 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:04:29.233 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:04:29.616 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:29.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:29 smithi092 ceph-mon[31407]: pgmap v570: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 8.6 MiB/s wr, 765 op/s 2024-09-19T09:04:29.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:29 smithi167 ceph-mon[35359]: pgmap v570: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 8.6 MiB/s wr, 765 op/s 2024-09-19T09:04:29.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:29 smithi190 ceph-mon[35358]: pgmap v570: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 8.6 MiB/s wr, 765 op/s 2024-09-19T09:04:30.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.241+0000 7fb8072c8640 1 -- 172.21.15.92:0/3138709999 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb80010e500 msgr2=0x7fb800110910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:30.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.241+0000 7fb8072c8640 1 --2- 172.21.15.92:0/3138709999 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb80010e500 0x7fb800110910 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8009ca0 tx=0x7fb7f802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:04:30.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.241+0000 7fb8072c8640 1 -- 172.21.15.92:0/3138709999 shutdown_connections 2024-09-19T09:04:30.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.241+0000 7fb8072c8640 1 --2- 172.21.15.92:0/3138709999 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb80010e500 0x7fb800110910 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:30.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.241+0000 7fb8072c8640 1 --2- 172.21.15.92:0/3138709999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb800101440 0x7fb80010df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:30.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.241+0000 7fb8072c8640 1 --2- 172.21.15.92:0/3138709999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb800100b20 0x7fb800100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:30.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.241+0000 7fb8072c8640 1 -- 172.21.15.92:0/3138709999 >> 172.21.15.92:0/3138709999 conn(0x7fb8000fc7d0 msgr2=0x7fb8000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:30.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.241+0000 7fb8072c8640 1 -- 172.21.15.92:0/3138709999 shutdown_connections 2024-09-19T09:04:30.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.241+0000 7fb8072c8640 1 -- 172.21.15.92:0/3138709999 wait complete. 2024-09-19T09:04:30.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.242+0000 7fb8072c8640 1 Processor -- start 2024-09-19T09:04:30.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.242+0000 7fb8072c8640 1 -- start start 2024-09-19T09:04:30.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.242+0000 7fb8072c8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb800100b20 0x7fb80010ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:30.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.243+0000 7fb8072c8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb800101440 0x7fb80010aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:30.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.243+0000 7fb8072c8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb80010e500 0x7fb80010b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:30.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.243+0000 7fb805064640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb800100b20 0x7fb80010ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:30.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.243+0000 7fb805064640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb800100b20 0x7fb80010ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:49122/0 (socket says 172.21.15.92:49122) 2024-09-19T09:04:30.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.243+0000 7fb805064640 1 -- 172.21.15.92:0/3730367193 learned_addr learned my addr 172.21.15.92:0/3730367193 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:30.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.243+0000 7fb8072c8640 1 -- 172.21.15.92:0/3730367193 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb8001142a0 con 0x7fb800101440 2024-09-19T09:04:30.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.243+0000 7fb8072c8640 1 -- 172.21.15.92:0/3730367193 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb800114120 con 0x7fb800100b20 2024-09-19T09:04:30.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.243+0000 7fb8072c8640 1 -- 172.21.15.92:0/3730367193 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb800114420 con 0x7fb80010e500 2024-09-19T09:04:30.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.243+0000 7fb805865640 1 --2- 172.21.15.92:0/3730367193 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb80010e500 0x7fb80010b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:30.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.243+0000 7fb804863640 1 --2- 172.21.15.92:0/3730367193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb800101440 0x7fb80010aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:30.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.243+0000 7fb805064640 1 -- 172.21.15.92:0/3730367193 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb80010e500 msgr2=0x7fb80010b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:30.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.243+0000 7fb805064640 1 --2- 172.21.15.92:0/3730367193 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb80010e500 0x7fb80010b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:30.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.243+0000 7fb805064640 1 -- 172.21.15.92:0/3730367193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb800101440 msgr2=0x7fb80010aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:30.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.243+0000 7fb805064640 1 --2- 172.21.15.92:0/3730367193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb800101440 0x7fb80010aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:30.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.243+0000 7fb805064640 1 -- 172.21.15.92:0/3730367193 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb80010bd10 con 0x7fb800100b20 2024-09-19T09:04:30.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.243+0000 7fb805865640 1 --2- 172.21.15.92:0/3730367193 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb80010e500 0x7fb80010b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:30.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.244+0000 7fb805064640 1 --2- 172.21.15.92:0/3730367193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb800100b20 0x7fb80010ddd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc00e9f0 tx=0x7fb7fc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:30.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.245+0000 7fb7f67fc640 1 -- 172.21.15.92:0/3730367193 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc00cd80 con 0x7fb800100b20 2024-09-19T09:04:30.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.245+0000 7fb7f67fc640 1 -- 172.21.15.92:0/3730367193 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7fc010910 con 0x7fb800100b20 2024-09-19T09:04:30.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.245+0000 7fb8072c8640 1 -- 172.21.15.92:0/3730367193 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8001ab100 con 0x7fb800100b20 2024-09-19T09:04:30.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.245+0000 7fb7f67fc640 1 -- 172.21.15.92:0/3730367193 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc018990 con 0x7fb800100b20 2024-09-19T09:04:30.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.245+0000 7fb8072c8640 1 -- 172.21.15.92:0/3730367193 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8001ab610 con 0x7fb800100b20 2024-09-19T09:04:30.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.249+0000 7fb8096a1740 1 Processor -- start 2024-09-19T09:04:30.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.249+0000 7fb7f67fc640 1 -- 172.21.15.92:0/3730367193 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb7fc010ac0 con 0x7fb800100b20 2024-09-19T09:04:30.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.250+0000 7fb8096a1740 1 -- start start 2024-09-19T09:04:30.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.250+0000 7fb8096a1740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ccea134b60 0x55ccea134f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:30.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.250+0000 7fb8096a1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ccea135480 0x55ccea13f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:30.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.250+0000 7fb8096a1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ccea13fd40 0x55ccea142130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:30.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.250+0000 7fb8096a1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ccea09a280 con 0x55ccea13fd40 2024-09-19T09:04:30.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.250+0000 7fb8096a1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ccea041b10 con 0x55ccea135480 2024-09-19T09:04:30.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.250+0000 7fb8096a1740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ccea096240 con 0x55ccea134b60 2024-09-19T09:04:30.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.250+0000 7fb805064640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ccea135480 0x55ccea13f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:30.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.250+0000 7fb805865640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ccea134b60 0x55ccea134f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:30.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.250+0000 7fb805865640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ccea134b60 0x55ccea134f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:44034/0 (socket says 172.21.15.92:44034) 2024-09-19T09:04:30.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.250+0000 7fb805865640 1 -- 172.21.15.92:0/3843062410 learned_addr learned my addr 172.21.15.92:0/3843062410 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:30.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.250+0000 7fb804863640 1 --2- 172.21.15.92:0/3843062410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ccea13fd40 0x55ccea142130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:30.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.252+0000 7fb805064640 1 -- 172.21.15.92:0/3843062410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ccea134b60 msgr2=0x55ccea134f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:30.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.252+0000 7fb805064640 1 --2- 172.21.15.92:0/3843062410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ccea134b60 0x55ccea134f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:30.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.252+0000 7fb805064640 1 -- 172.21.15.92:0/3843062410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ccea13fd40 msgr2=0x55ccea142130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:30.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.252+0000 7fb805064640 1 --2- 172.21.15.92:0/3843062410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ccea13fd40 0x55ccea142130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:30.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.252+0000 7fb805064640 1 -- 172.21.15.92:0/3843062410 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ccea04e1f0 con 0x55ccea135480 2024-09-19T09:04:30.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.253+0000 7fb805064640 1 --2- 172.21.15.92:0/3843062410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ccea135480 0x55ccea13f800 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc0cd670 tx=0x7fb7fc0d85e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b02ae67a605a10ce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:30.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.253+0000 7fb7f67fc640 1 --2- 172.21.15.92:0/3730367193 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb7ec0a3410 0x7fb7ec0a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:30.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.253+0000 7fb7eb7fe640 1 -- 172.21.15.92:0/3843062410 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc0d5050 con 0x55ccea135480 2024-09-19T09:04:30.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.253+0000 7fb7eb7fe640 1 -- 172.21.15.92:0/3843062410 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7fc0e1070 con 0x55ccea135480 2024-09-19T09:04:30.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.253+0000 7fb7eb7fe640 1 -- 172.21.15.92:0/3843062410 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc09bd30 con 0x55ccea135480 2024-09-19T09:04:30.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.253+0000 7fb7f67fc640 1 -- 172.21.15.92:0/3730367193 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb7fc0cfc10 con 0x7fb800100b20 2024-09-19T09:04:30.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.254+0000 7fb805865640 1 --2- 172.21.15.92:0/3730367193 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb7ec0a3410 0x7fb7ec0a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:30.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.254+0000 7fb8096a1740 1 -- 172.21.15.92:0/3843062410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ccea135480 msgr2=0x55ccea13f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:30.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.254+0000 7fb8096a1740 1 --2- 172.21.15.92:0/3843062410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ccea135480 0x55ccea13f800 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc0cd670 tx=0x7fb7fc0d85e0 comp rx=0 tx=0).stop 2024-09-19T09:04:30.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.254+0000 7fb8096a1740 1 -- 172.21.15.92:0/3843062410 shutdown_connections 2024-09-19T09:04:30.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.254+0000 7fb8096a1740 1 --2- 172.21.15.92:0/3843062410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ccea13fd40 0x55ccea142130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:30.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.254+0000 7fb8096a1740 1 --2- 172.21.15.92:0/3843062410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ccea135480 0x55ccea13f800 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:30.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.254+0000 7fb8096a1740 1 --2- 172.21.15.92:0/3843062410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ccea134b60 0x55ccea134f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:30.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.254+0000 7fb8096a1740 1 -- 172.21.15.92:0/3843062410 >> 172.21.15.92:0/3843062410 conn(0x55ccea1310f0 msgr2=0x55ccea1314d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:30.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.254+0000 7fb8096a1740 1 -- 172.21.15.92:0/3843062410 shutdown_connections 2024-09-19T09:04:30.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.254+0000 7fb8096a1740 1 -- 172.21.15.92:0/3843062410 wait complete. 2024-09-19T09:04:30.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.255+0000 7fb8096a1740 1 -- start start 2024-09-19T09:04:30.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.255+0000 7fb8096a1740 1 Processor -- start 2024-09-19T09:04:30.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.255+0000 7fb805865640 1 --2- 172.21.15.92:0/3730367193 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb7ec0a3410 0x7fb7ec0a58d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8006010 tx=0x7fb7f8005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:30.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.256+0000 7fb8096a1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ccea134b60 0x55ccea13cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:30.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.256+0000 7fb8096a1740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ccea135480 0x55ccea13d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:30.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.256+0000 7fb8096a1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ccea13fd40 0x55ccea13d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:30.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.256+0000 7fb8096a1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ccea142910 con 0x55ccea13fd40 2024-09-19T09:04:30.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.256+0000 7fb8096a1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ccea054f10 con 0x55ccea134b60 2024-09-19T09:04:30.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.256+0000 7fb8096a1740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ccea142a90 con 0x55ccea135480 2024-09-19T09:04:30.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.256+0000 7fb8096a1740 10 client.0 _ll_register_callbacks cb 0x55ccea01da40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:30.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.256+0000 7fb804863640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ccea135480 0x55ccea13d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:30.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.256+0000 7fb805064640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ccea134b60 0x55ccea13cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:30.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.256+0000 7fb805064640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ccea134b60 0x55ccea13cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:49140/0 (socket says 172.21.15.92:49140) 2024-09-19T09:04:30.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.256+0000 7fb805064640 1 -- 172.21.15.92:0/1076425320 learned_addr learned my addr 172.21.15.92:0/1076425320 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:30.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.256+0000 7fb805064640 1 -- 172.21.15.92:0/1076425320 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ccea135480 msgr2=0x55ccea13d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:30.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.256+0000 7fb805064640 1 --2- 172.21.15.92:0/1076425320 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ccea135480 0x55ccea13d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:30.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.256+0000 7fb805064640 1 -- 172.21.15.92:0/1076425320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ccea13fd40 msgr2=0x55ccea13d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:30.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.256+0000 7fb805865640 1 --2- 172.21.15.92:0/1076425320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ccea13fd40 0x55ccea13d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:30.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.256+0000 7fb805064640 1 --2- 172.21.15.92:0/1076425320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ccea13fd40 0x55ccea13d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:30.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.256+0000 7fb805064640 1 -- 172.21.15.92:0/1076425320 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cce9e0b6a0 con 0x55ccea134b60 2024-09-19T09:04:30.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.257+0000 7fb805064640 1 --2- 172.21.15.92:0/1076425320 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ccea134b60 0x55ccea13cbf0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc0b25b0 tx=0x7fb7fc00cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f26bb15aaee65e75 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:30.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.257+0000 7fb7e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:04:30.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.257+0000 7fb7e8ff9640 1 -- 172.21.15.92:0/1076425320 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc0b55d0 con 0x55ccea134b60 2024-09-19T09:04:30.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.257+0000 7fb7e8ff9640 1 -- 172.21.15.92:0/1076425320 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb7fc0bc070 con 0x55ccea134b60 2024-09-19T09:04:30.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.258+0000 7fb8096a1740 1 -- 172.21.15.92:0/1076425320 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7fc0e1070 con 0x55ccea134b60 2024-09-19T09:04:30.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.258+0000 7fb7e8ff9640 1 -- 172.21.15.92:0/1076425320 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb7fc0b3820 con 0x55ccea134b60 2024-09-19T09:04:30.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.258+0000 7fb8096a1740 10 client.26597 fetch_fsmap learned FSMap version 19 2024-09-19T09:04:30.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.258+0000 7fb8096a1740 1 -- 172.21.15.92:0/1076425320 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ccea14e510 con 0x55ccea134b60 2024-09-19T09:04:30.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.258+0000 7fb7e8ff9640 1 -- 172.21.15.92:0/1076425320 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7fc0e1070 con 0x55ccea134b60 2024-09-19T09:04:30.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.258+0000 7fb7e8ff9640 1 -- 172.21.15.92:0/1076425320 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fb7fc0db070 con 0x55ccea134b60 2024-09-19T09:04:30.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.258+0000 7fb8096a1740 10 client.26597 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:04:30.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.258+0000 7fb8096a1740 10 client.26597 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:04:30.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.258+0000 7fb8096a1740 20 client.26597 populate_metadata read hostname 'smithi092' 2024-09-19T09:04:30.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.258+0000 7fb8096a1740 1 --2- 172.21.15.92:0/1076425320 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ccea14f9f0 0x55ccea151e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:30.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.258+0000 7fb8096a1740 4 client.26597 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:30.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.258+0000 7fb8096a1740 1 -- 172.21.15.92:0/1076425320 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ccea0a77f0 con 0x55ccea14f9f0 2024-09-19T09:04:30.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.259+0000 7fb804863640 1 --2- 172.21.15.92:0/1076425320 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ccea14f9f0 0x55ccea151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:30.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.260+0000 7fb7e8ff9640 10 client.26597 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:30.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.260+0000 7fb804863640 1 --2- 172.21.15.92:0/1076425320 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ccea14f9f0 0x55ccea151e10 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6097a8ea07483cf7 server_cookie=f89184d4510cf408 in_seq=0 out_seq=0 2024-09-19T09:04:30.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.264+0000 7fb7e8ff9640 1 -- 172.21.15.92:0/1076425320 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ccea0a77f0 con 0x55ccea14f9f0 2024-09-19T09:04:30.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.264+0000 7fb7e8ff9640 10 client.26597 handle_command_reply: tid=0 2024-09-19T09:04:30.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.265+0000 7fb8096a1740 1 client.26597 shutdown 2024-09-19T09:04:30.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.272+0000 7fb8096a1740 1 -- 172.21.15.92:0/1076425320 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ccea134b60 msgr2=0x55ccea13cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:30.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.272+0000 7fb8096a1740 1 --2- 172.21.15.92:0/1076425320 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ccea134b60 0x55ccea13cbf0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc0b25b0 tx=0x7fb7fc00cf20 comp rx=0 tx=0).stop 2024-09-19T09:04:30.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.274+0000 7fb8096a1740 1 -- 172.21.15.92:0/1076425320 shutdown_connections 2024-09-19T09:04:30.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.274+0000 7fb8096a1740 1 --2- 172.21.15.92:0/1076425320 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ccea14f9f0 0x55ccea151e10 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:30.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.274+0000 7fb8096a1740 1 --2- 172.21.15.92:0/1076425320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ccea13fd40 0x55ccea13d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:30.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.274+0000 7fb8096a1740 1 --2- 172.21.15.92:0/1076425320 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ccea135480 0x55ccea13d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:30.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.274+0000 7fb8096a1740 1 --2- 172.21.15.92:0/1076425320 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ccea134b60 0x55ccea13cbf0 secure :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc0b25b0 tx=0x7fb7fc00cf20 comp rx=0 tx=0).stop 2024-09-19T09:04:30.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.274+0000 7fb8096a1740 1 -- 172.21.15.92:0/1076425320 >> 172.21.15.92:0/1076425320 conn(0x55ccea1310f0 msgr2=0x55ccea130270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:30.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.274+0000 7fb7e8ff9640 0 client.26597 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:30.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.278+0000 7fb8096a1740 1 -- 172.21.15.92:0/1076425320 shutdown_connections 2024-09-19T09:04:30.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.280+0000 7fb8096a1740 1 -- 172.21.15.92:0/1076425320 wait complete. 2024-09-19T09:04:30.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.281+0000 7fb8096a1740 20 client.26597 trim_cache size 0 max 16384 2024-09-19T09:04:30.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.313+0000 7fb8096a1740 1 Processor -- start 2024-09-19T09:04:30.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.313+0000 7fb8096a1740 1 -- start start 2024-09-19T09:04:30.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.313+0000 7fb8096a1740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ccea135480 0x55ccea1375c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:30.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.313+0000 7fb8096a1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ccea13fd40 0x55ccea157700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:30.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.314+0000 7fb8096a1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ccea157c40 0x55ccea139e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:30.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.314+0000 7fb8096a1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb8001b1ba0 con 0x55ccea13fd40 2024-09-19T09:04:30.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.314+0000 7fb8096a1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb8001b4440 con 0x55ccea157c40 2024-09-19T09:04:30.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.314+0000 7fb8096a1740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb8001b2230 con 0x55ccea135480 2024-09-19T09:04:30.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.314+0000 7fb804863640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ccea13fd40 0x55ccea157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:30.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.314+0000 7fb804863640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ccea13fd40 0x55ccea157700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50290/0 (socket says 172.21.15.92:50290) 2024-09-19T09:04:30.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.314+0000 7fb804863640 1 -- 172.21.15.92:0/914469843 learned_addr learned my addr 172.21.15.92:0/914469843 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:30.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.314+0000 7fb805865640 1 --2- 172.21.15.92:0/914469843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ccea157c40 0x55ccea139e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:30.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.314+0000 7fb805064640 1 --2- 172.21.15.92:0/914469843 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ccea135480 0x55ccea1375c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:30.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.314+0000 7fb804863640 1 -- 172.21.15.92:0/914469843 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ccea135480 msgr2=0x55ccea1375c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:30.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.314+0000 7fb804863640 1 --2- 172.21.15.92:0/914469843 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ccea135480 0x55ccea1375c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:30.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.314+0000 7fb804863640 1 -- 172.21.15.92:0/914469843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ccea157c40 msgr2=0x55ccea139e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:30.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.314+0000 7fb804863640 1 --2- 172.21.15.92:0/914469843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ccea157c40 0x55ccea139e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:30.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.314+0000 7fb804863640 1 -- 172.21.15.92:0/914469843 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ccea152470 con 0x55ccea13fd40 2024-09-19T09:04:30.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.314+0000 7fb805064640 1 --2- 172.21.15.92:0/914469843 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ccea135480 0x55ccea1375c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:30.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.314+0000 7fb804863640 1 --2- 172.21.15.92:0/914469843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ccea13fd40 0x55ccea157700 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x55ccea132470 tx=0x7fb7f0014840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4506b6eae38c2caf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:30.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.315+0000 7fb7eaffd640 1 -- 172.21.15.92:0/914469843 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f0023070 con 0x55ccea13fd40 2024-09-19T09:04:30.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.315+0000 7fb7eaffd640 1 -- 172.21.15.92:0/914469843 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7f0012930 con 0x55ccea13fd40 2024-09-19T09:04:30.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.315+0000 7fb7eaffd640 1 -- 172.21.15.92:0/914469843 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f001da10 con 0x55ccea13fd40 2024-09-19T09:04:30.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.316+0000 7fb8096a1740 1 -- 172.21.15.92:0/914469843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ccea13fd40 msgr2=0x55ccea157700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:30.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.316+0000 7fb8096a1740 1 --2- 172.21.15.92:0/914469843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ccea13fd40 0x55ccea157700 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x55ccea132470 tx=0x7fb7f0014840 comp rx=0 tx=0).stop 2024-09-19T09:04:30.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.316+0000 7fb8096a1740 1 -- 172.21.15.92:0/914469843 shutdown_connections 2024-09-19T09:04:30.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.316+0000 7fb8096a1740 1 --2- 172.21.15.92:0/914469843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ccea157c40 0x55ccea139e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:30.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.316+0000 7fb8096a1740 1 --2- 172.21.15.92:0/914469843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ccea13fd40 0x55ccea157700 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:30.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.316+0000 7fb8096a1740 1 --2- 172.21.15.92:0/914469843 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ccea135480 0x55ccea1375c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:30.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.316+0000 7fb8096a1740 1 -- 172.21.15.92:0/914469843 >> 172.21.15.92:0/914469843 conn(0x55ccea1310f0 msgr2=0x55ccea13eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:30.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.316+0000 7fb8096a1740 1 -- 172.21.15.92:0/914469843 shutdown_connections 2024-09-19T09:04:30.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.316+0000 7fb8096a1740 1 -- 172.21.15.92:0/914469843 wait complete. 2024-09-19T09:04:30.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.316+0000 7fb8096a1740 1 -- start start 2024-09-19T09:04:30.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.316+0000 7fb8096a1740 1 Processor -- start 2024-09-19T09:04:30.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.317+0000 7fb8096a1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ccea135480 0x55ccea147d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:30.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.317+0000 7fb8096a1740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ccea13fd40 0x55ccea148250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:30.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.317+0000 7fb8096a1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ccea157c40 0x55ccea144ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:30.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.317+0000 7fb805064640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ccea135480 0x55ccea147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:30.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.317+0000 7fb805064640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ccea135480 0x55ccea147d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50294/0 (socket says 172.21.15.92:50294) 2024-09-19T09:04:30.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.317+0000 7fb805064640 1 -- 172.21.15.92:0/1721429827 learned_addr learned my addr 172.21.15.92:0/1721429827 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:30.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.317+0000 7fb8096a1740 1 -- 172.21.15.92:0/1721429827 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb8001b2900 con 0x55ccea135480 2024-09-19T09:04:30.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.317+0000 7fb804863640 1 --2- 172.21.15.92:0/1721429827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ccea13fd40 0x55ccea148250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:30.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.317+0000 7fb8096a1740 1 -- 172.21.15.92:0/1721429827 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb8001b3d70 con 0x55ccea157c40 2024-09-19T09:04:30.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.317+0000 7fb8096a1740 1 -- 172.21.15.92:0/1721429827 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb8001b2fd0 con 0x55ccea13fd40 2024-09-19T09:04:30.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.317+0000 7fb805865640 1 --2- 172.21.15.92:0/1721429827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ccea157c40 0x55ccea144ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:30.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.318+0000 7fb8096a1740 10 client.0 _ll_register_callbacks cb 0x7fb7f0005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:30.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.318+0000 7fb805865640 1 -- 172.21.15.92:0/1721429827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ccea13fd40 msgr2=0x55ccea148250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:30.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.318+0000 7fb805865640 1 --2- 172.21.15.92:0/1721429827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ccea13fd40 0x55ccea148250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:30.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.318+0000 7fb805865640 1 -- 172.21.15.92:0/1721429827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ccea135480 msgr2=0x55ccea147d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:30.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.318+0000 7fb805865640 1 --2- 172.21.15.92:0/1721429827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ccea135480 0x55ccea147d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:30.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.318+0000 7fb805865640 1 -- 172.21.15.92:0/1721429827 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ccea1452a0 con 0x55ccea157c40 2024-09-19T09:04:30.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.318+0000 7fb805865640 1 --2- 172.21.15.92:0/1721429827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ccea157c40 0x55ccea144ce0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb7f802aeb0 tx=0x7fb7f802a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af88fa5a55b76ee8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:30.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.318+0000 7fb7e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:04:30.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.319+0000 7fb7e8ff9640 1 -- 172.21.15.92:0/1721429827 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8004040 con 0x55ccea157c40 2024-09-19T09:04:30.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.319+0000 7fb7e8ff9640 1 -- 172.21.15.92:0/1721429827 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb7f8043030 con 0x55ccea157c40 2024-09-19T09:04:30.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.319+0000 7fb8096a1740 1 -- 172.21.15.92:0/1721429827 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7f0012930 con 0x55ccea157c40 2024-09-19T09:04:30.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.319+0000 7fb7e8ff9640 1 -- 172.21.15.92:0/1721429827 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb7f80041e0 con 0x55ccea157c40 2024-09-19T09:04:30.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.320+0000 7fb8096a1740 10 client.26603 fetch_fsmap learned FSMap version 19 2024-09-19T09:04:30.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.320+0000 7fb8096a1740 1 -- 172.21.15.92:0/1721429827 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ccea1b2f70 con 0x55ccea157c40 2024-09-19T09:04:30.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.320+0000 7fb7e8ff9640 1 -- 172.21.15.92:0/1721429827 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7f8036040 con 0x55ccea157c40 2024-09-19T09:04:30.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.320+0000 7fb7e8ff9640 1 -- 172.21.15.92:0/1721429827 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fb7f80305c0 con 0x55ccea157c40 2024-09-19T09:04:30.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.320+0000 7fb8096a1740 10 client.26603 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:04:30.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.320+0000 7fb8096a1740 10 client.26603 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:04:30.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.320+0000 7fb8096a1740 20 client.26603 populate_metadata read hostname 'smithi092' 2024-09-19T09:04:30.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.320+0000 7fb8096a1740 1 --2- 172.21.15.92:0/1721429827 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ccea1b3620 0x55ccea1b5a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:30.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.320+0000 7fb8096a1740 4 client.26603 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:04:30.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.320+0000 7fb8096a1740 1 -- 172.21.15.92:0/1721429827 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7fb7f0012930 con 0x55ccea1b3620 2024-09-19T09:04:30.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.320+0000 7fb805064640 1 --2- 172.21.15.92:0/1721429827 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ccea1b3620 0x55ccea1b5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:30.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.322+0000 7fb805064640 1 --2- 172.21.15.92:0/1721429827 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ccea1b3620 0x55ccea1b5a40 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3682dd3239058350 server_cookie=2c43e8228b6b722d in_seq=0 out_seq=0 2024-09-19T09:04:30.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.322+0000 7fb7e8ff9640 10 client.26603 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:30.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.323+0000 7fb7e8ff9640 1 -- 172.21.15.92:0/1721429827 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7fb7f0012930 con 0x55ccea1b3620 2024-09-19T09:04:30.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.323+0000 7fb7e8ff9640 10 client.26603 handle_command_reply: tid=0 2024-09-19T09:04:30.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.323+0000 7fb8096a1740 1 client.26603 shutdown 2024-09-19T09:04:30.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.324+0000 7fb8096a1740 1 -- 172.21.15.92:0/1721429827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ccea157c40 msgr2=0x55ccea144ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:30.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.324+0000 7fb8096a1740 1 --2- 172.21.15.92:0/1721429827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ccea157c40 0x55ccea144ce0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb7f802aeb0 tx=0x7fb7f802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:04:30.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.324+0000 7fb8096a1740 1 -- 172.21.15.92:0/1721429827 shutdown_connections 2024-09-19T09:04:30.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.324+0000 7fb8096a1740 1 --2- 172.21.15.92:0/1721429827 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ccea1b3620 0x55ccea1b5a40 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:30.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.324+0000 7fb8096a1740 1 --2- 172.21.15.92:0/1721429827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ccea157c40 0x55ccea144ce0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:30.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.324+0000 7fb7e8ff9640 0 client.26603 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:30.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.324+0000 7fb8096a1740 1 --2- 172.21.15.92:0/1721429827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ccea13fd40 0x55ccea148250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:30.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.324+0000 7fb8096a1740 1 --2- 172.21.15.92:0/1721429827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ccea135480 0x55ccea147d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:30.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.324+0000 7fb8096a1740 1 -- 172.21.15.92:0/1721429827 >> 172.21.15.92:0/1721429827 conn(0x55ccea1310f0 msgr2=0x55ccea13cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:30.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.324+0000 7fb8096a1740 1 -- 172.21.15.92:0/1721429827 shutdown_connections 2024-09-19T09:04:30.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.324+0000 7fb8096a1740 1 -- 172.21.15.92:0/1721429827 wait complete. 2024-09-19T09:04:30.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.325+0000 7fb8096a1740 20 client.26603 trim_cache size 0 max 16384 2024-09-19T09:04:30.327 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:04:30.327 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-19T09:04:30.327 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "10f4335b-a595-4959-94cc-37afb8208db3", 2024-09-19T09:04:30.327 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-19T09:04:30.327 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:04:30.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.327+0000 7fb8072c8640 1 -- 172.21.15.92:0/3730367193 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb7ec0a3410 msgr2=0x7fb7ec0a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:30.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.327+0000 7fb8072c8640 1 --2- 172.21.15.92:0/3730367193 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb7ec0a3410 0x7fb7ec0a58d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8006010 tx=0x7fb7f8005d80 comp rx=0 tx=0).stop 2024-09-19T09:04:30.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.327+0000 7fb8072c8640 1 -- 172.21.15.92:0/3730367193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb800100b20 msgr2=0x7fb80010ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:30.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.327+0000 7fb8072c8640 1 --2- 172.21.15.92:0/3730367193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb800100b20 0x7fb80010ddd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc00e9f0 tx=0x7fb7fc00eeb0 comp rx=0 tx=0).stop 2024-09-19T09:04:30.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.327+0000 7fb8072c8640 1 -- 172.21.15.92:0/3730367193 shutdown_connections 2024-09-19T09:04:30.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.327+0000 7fb8072c8640 1 --2- 172.21.15.92:0/3730367193 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb80010e500 0x7fb80010b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:30.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.327+0000 7fb8072c8640 1 --2- 172.21.15.92:0/3730367193 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb7ec0a3410 0x7fb7ec0a58d0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:30.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.327+0000 7fb8072c8640 1 --2- 172.21.15.92:0/3730367193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb800101440 0x7fb80010aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:30.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.327+0000 7fb8072c8640 1 --2- 172.21.15.92:0/3730367193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb800100b20 0x7fb80010ddd0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:30.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.327+0000 7fb8072c8640 1 -- 172.21.15.92:0/3730367193 >> 172.21.15.92:0/3730367193 conn(0x7fb8000fc7d0 msgr2=0x7fb8000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:30.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.328+0000 7fb8072c8640 1 -- 172.21.15.92:0/3730367193 shutdown_connections 2024-09-19T09:04:30.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:30.328+0000 7fb8072c8640 1 -- 172.21.15.92:0/3730367193 wait complete. 2024-09-19T09:04:30.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 465.0 s, 3140.8 tps, lat 31.846 ms stddev 38.410 2024-09-19T09:04:31.057 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:04:31.450 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:31.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:31 smithi092 ceph-mon[31407]: scrub queued for path: / 2024-09-19T09:04:31.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:31 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:04:31.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:31 smithi092 ceph-mon[31407]: scrub summary: active paths [/] 2024-09-19T09:04:31.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:31 smithi092 ceph-mon[31407]: pgmap v571: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 9.3 MiB/s wr, 834 op/s 2024-09-19T09:04:31.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:31 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:04:31.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:31 smithi167 ceph-mon[35359]: scrub queued for path: / 2024-09-19T09:04:31.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:31 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:04:31.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:31 smithi167 ceph-mon[35359]: scrub summary: active paths [/] 2024-09-19T09:04:31.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:31 smithi167 ceph-mon[35359]: pgmap v571: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 9.3 MiB/s wr, 834 op/s 2024-09-19T09:04:31.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:31 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:04:31.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:31 smithi190 ceph-mon[35358]: scrub queued for path: / 2024-09-19T09:04:31.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:31 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:04:31.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:31 smithi190 ceph-mon[35358]: scrub summary: active paths [/] 2024-09-19T09:04:31.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:31 smithi190 ceph-mon[35358]: pgmap v571: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 9.3 MiB/s wr, 834 op/s 2024-09-19T09:04:31.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:31 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:04:32.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.222+0000 7fcb93fff640 1 -- 172.21.15.92:0/3212992212 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb94109450 msgr2=0x7fcb94109830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:32.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.222+0000 7fcb93fff640 1 --2- 172.21.15.92:0/3212992212 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb94109450 0x7fcb94109830 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcb840085a0 tx=0x7fcb8402a220 comp rx=0 tx=0).stop 2024-09-19T09:04:32.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.223+0000 7fcb93fff640 1 -- 172.21.15.92:0/3212992212 shutdown_connections 2024-09-19T09:04:32.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.223+0000 7fcb93fff640 1 --2- 172.21.15.92:0/3212992212 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb9410ea10 0x7fcb94115360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.223+0000 7fcb93fff640 1 --2- 172.21.15.92:0/3212992212 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb94109e00 0x7fcb9410e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.223+0000 7fcb93fff640 1 --2- 172.21.15.92:0/3212992212 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb94109450 0x7fcb94109830 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.223+0000 7fcb93fff640 1 -- 172.21.15.92:0/3212992212 >> 172.21.15.92:0/3212992212 conn(0x7fcb94073660 msgr2=0x7fcb94073a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:32.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.223+0000 7fcb93fff640 1 -- 172.21.15.92:0/3212992212 shutdown_connections 2024-09-19T09:04:32.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.223+0000 7fcb93fff640 1 -- 172.21.15.92:0/3212992212 wait complete. 2024-09-19T09:04:32.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.224+0000 7fcb93fff640 1 Processor -- start 2024-09-19T09:04:32.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.224+0000 7fcb93fff640 1 -- start start 2024-09-19T09:04:32.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.225+0000 7fcb93fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb94109450 0x7fcb941a70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.225+0000 7fcb93fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb94109e00 0x7fcb941a75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.225+0000 7fcb93fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb9410ea10 0x7fcb941ab980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.225+0000 7fcb93fff640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcb94120bd0 con 0x7fcb94109e00 2024-09-19T09:04:32.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.225+0000 7fcb93fff640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcb94120a50 con 0x7fcb9410ea10 2024-09-19T09:04:32.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.225+0000 7fcb93fff640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fcb94120d50 con 0x7fcb94109450 2024-09-19T09:04:32.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.225+0000 7fcb927fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb94109e00 0x7fcb941a75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:32.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.225+0000 7fcb927fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb94109e00 0x7fcb941a75f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36884/0 (socket says 172.21.15.92:36884) 2024-09-19T09:04:32.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.225+0000 7fcb927fc640 1 -- 172.21.15.92:0/2181313030 learned_addr learned my addr 172.21.15.92:0/2181313030 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:32.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.226+0000 7fcb927fc640 1 -- 172.21.15.92:0/2181313030 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb94109450 msgr2=0x7fcb941a70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:32.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.226+0000 7fcb927fc640 1 --2- 172.21.15.92:0/2181313030 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb94109450 0x7fcb941a70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.226+0000 7fcb927fc640 1 -- 172.21.15.92:0/2181313030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb9410ea10 msgr2=0x7fcb941ab980 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:04:32.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.226+0000 7fcb927fc640 1 --2- 172.21.15.92:0/2181313030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb9410ea10 0x7fcb941ab980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.226+0000 7fcb927fc640 1 -- 172.21.15.92:0/2181313030 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb941ac060 con 0x7fcb94109e00 2024-09-19T09:04:32.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.226+0000 7fcb927fc640 1 --2- 172.21.15.92:0/2181313030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb94109e00 0x7fcb941a75f0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c00eab0 tx=0x7fcb8c00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:32.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.226+0000 7fcb7bfff640 1 -- 172.21.15.92:0/2181313030 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c00ce40 con 0x7fcb94109e00 2024-09-19T09:04:32.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.226+0000 7fcb93fff640 1 -- 172.21.15.92:0/2181313030 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb941ac350 con 0x7fcb94109e00 2024-09-19T09:04:32.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.226+0000 7fcb93fff640 1 -- 172.21.15.92:0/2181313030 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb941b3c30 con 0x7fcb94109e00 2024-09-19T09:04:32.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.227+0000 7fcb7bfff640 1 -- 172.21.15.92:0/2181313030 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb8c011950 con 0x7fcb94109e00 2024-09-19T09:04:32.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.228+0000 7fcb7bfff640 1 -- 172.21.15.92:0/2181313030 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c01ab70 con 0x7fcb94109e00 2024-09-19T09:04:32.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.231+0000 7fcb7bfff640 1 -- 172.21.15.92:0/2181313030 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fcb8c011b00 con 0x7fcb94109e00 2024-09-19T09:04:32.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.232+0000 7fcb7bfff640 1 --2- 172.21.15.92:0/2181313030 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcb7c0a32e0 0x7fcb7c0a57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.233+0000 7fcb7bfff640 1 -- 172.21.15.92:0/2181313030 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcb8c0cfd60 con 0x7fcb94109e00 2024-09-19T09:04:32.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.233+0000 7fcb9b653740 1 Processor -- start 2024-09-19T09:04:32.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.233+0000 7fcb9b653740 1 -- start start 2024-09-19T09:04:32.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.234+0000 7fcb9b653740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9d93e6670 0x55a9d93e6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.234+0000 7fcb9b653740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9d93e6f90 0x55a9d93f1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.234+0000 7fcb9b653740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9d93f1850 0x55a9d93f3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.234+0000 7fcb9b653740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a9d934c2e0 con 0x55a9d93e6670 2024-09-19T09:04:32.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.234+0000 7fcb9b653740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a9d92f3ce0 con 0x55a9d93e6f90 2024-09-19T09:04:32.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.234+0000 7fcb9b653740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55a9d93482a0 con 0x55a9d93f1850 2024-09-19T09:04:32.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.234+0000 7fcb92ffd640 1 --2- 172.21.15.92:0/2181313030 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcb7c0a32e0 0x7fcb7c0a57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:32.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.234+0000 7fcb92ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9d93e6670 0x55a9d93e6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:32.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.234+0000 7fcb92ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9d93e6670 0x55a9d93e6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36896/0 (socket says 172.21.15.92:36896) 2024-09-19T09:04:32.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.234+0000 7fcb92ffd640 1 -- 172.21.15.92:0/3107361747 learned_addr learned my addr 172.21.15.92:0/3107361747 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:32.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.234+0000 7fcb937fe640 1 --2- 172.21.15.92:0/3107361747 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9d93f1850 0x55a9d93f3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:32.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.234+0000 7fcb927fc640 1 --2- 172.21.15.92:0/3107361747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9d93e6f90 0x55a9d93f1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:32.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.235+0000 7fcb937fe640 1 -- 172.21.15.92:0/3107361747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9d93e6f90 msgr2=0x55a9d93f1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:32.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.235+0000 7fcb937fe640 1 --2- 172.21.15.92:0/3107361747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9d93e6f90 0x55a9d93f1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.235+0000 7fcb937fe640 1 -- 172.21.15.92:0/3107361747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9d93e6670 msgr2=0x55a9d93e6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:32.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.235+0000 7fcb937fe640 1 --2- 172.21.15.92:0/3107361747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9d93e6670 0x55a9d93e6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.235+0000 7fcb937fe640 1 -- 172.21.15.92:0/3107361747 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9d92d8440 con 0x55a9d93f1850 2024-09-19T09:04:32.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.235+0000 7fcb92ffd640 1 --2- 172.21.15.92:0/2181313030 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcb7c0a32e0 0x7fcb7c0a57a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fcb8400aed0 tx=0x7fcb84009d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:32.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.237+0000 7fcb937fe640 1 --2- 172.21.15.92:0/3107361747 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9d93f1850 0x55a9d93f3c40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcb8800ded0 tx=0x7fcb88005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c580f02a122e4538 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:32.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.237+0000 7fcb797fa640 1 -- 172.21.15.92:0/3107361747 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb8800d9e0 con 0x55a9d93f1850 2024-09-19T09:04:32.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.237+0000 7fcb797fa640 1 -- 172.21.15.92:0/3107361747 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb8800be50 con 0x55a9d93f1850 2024-09-19T09:04:32.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.237+0000 7fcb797fa640 1 -- 172.21.15.92:0/3107361747 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb88004a90 con 0x55a9d93f1850 2024-09-19T09:04:32.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.238+0000 7fcb9b653740 1 -- 172.21.15.92:0/3107361747 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9d93f1850 msgr2=0x55a9d93f3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:32.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.238+0000 7fcb9b653740 1 --2- 172.21.15.92:0/3107361747 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9d93f1850 0x55a9d93f3c40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcb8800ded0 tx=0x7fcb88005f90 comp rx=0 tx=0).stop 2024-09-19T09:04:32.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.238+0000 7fcb9b653740 1 -- 172.21.15.92:0/3107361747 shutdown_connections 2024-09-19T09:04:32.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.238+0000 7fcb9b653740 1 --2- 172.21.15.92:0/3107361747 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9d93f1850 0x55a9d93f3c40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.238+0000 7fcb9b653740 1 --2- 172.21.15.92:0/3107361747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9d93e6f90 0x55a9d93f1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.238+0000 7fcb9b653740 1 --2- 172.21.15.92:0/3107361747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9d93e6670 0x55a9d93e6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.238+0000 7fcb9b653740 1 -- 172.21.15.92:0/3107361747 >> 172.21.15.92:0/3107361747 conn(0x55a9d93e2c00 msgr2=0x55a9d93e2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:32.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.239+0000 7fcb9b653740 1 -- 172.21.15.92:0/3107361747 shutdown_connections 2024-09-19T09:04:32.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.239+0000 7fcb9b653740 1 -- 172.21.15.92:0/3107361747 wait complete. 2024-09-19T09:04:32.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.239+0000 7fcb9b653740 1 -- start start 2024-09-19T09:04:32.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.240+0000 7fcb9b653740 1 Processor -- start 2024-09-19T09:04:32.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.240+0000 7fcb9b653740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9d93e6670 0x55a9d93f11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.240+0000 7fcb9b653740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9d93e6f90 0x55a9d93ee490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.240+0000 7fcb9b653740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9d93f1850 0x55a9d93eea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.240+0000 7fcb9b653740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a9d93f4420 con 0x55a9d93e6f90 2024-09-19T09:04:32.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.240+0000 7fcb9b653740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a9d9307050 con 0x55a9d93f1850 2024-09-19T09:04:32.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.240+0000 7fcb9b653740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55a9d93f45a0 con 0x55a9d93e6670 2024-09-19T09:04:32.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.240+0000 7fcb92ffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9d93e6670 0x55a9d93f11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:32.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.240+0000 7fcb9b653740 10 client.0 _ll_register_callbacks cb 0x55a9d9347160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:32.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.240+0000 7fcb92ffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9d93e6670 0x55a9d93f11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:32942/0 (socket says 172.21.15.92:32942) 2024-09-19T09:04:32.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.240+0000 7fcb92ffd640 1 -- 172.21.15.92:0/3620778310 learned_addr learned my addr 172.21.15.92:0/3620778310 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:32.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.241+0000 7fcb937fe640 1 --2- 172.21.15.92:0/3620778310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9d93f1850 0x55a9d93eea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:32.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.241+0000 7fcb92ffd640 1 -- 172.21.15.92:0/3620778310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9d93f1850 msgr2=0x55a9d93eea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:32.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.241+0000 7fcb92ffd640 1 --2- 172.21.15.92:0/3620778310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9d93f1850 0x55a9d93eea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.241+0000 7fcb92ffd640 1 -- 172.21.15.92:0/3620778310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9d93e6f90 msgr2=0x55a9d93ee490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:32.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.241+0000 7fcb92ffd640 1 --2- 172.21.15.92:0/3620778310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9d93e6f90 0x55a9d93ee490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.241+0000 7fcb92ffd640 1 -- 172.21.15.92:0/3620778310 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9d90bd3c0 con 0x55a9d93e6670 2024-09-19T09:04:32.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.242+0000 7fcb92ffd640 1 --2- 172.21.15.92:0/3620778310 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9d93e6670 0x55a9d93f11e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcb8400a300 tx=0x7fcb84000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efe511879034b9d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:32.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.242+0000 7fcb76ff5640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:04:32.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.242+0000 7fcb76ff5640 1 -- 172.21.15.92:0/3620778310 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb84044030 con 0x55a9d93e6670 2024-09-19T09:04:32.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.242+0000 7fcb76ff5640 1 -- 172.21.15.92:0/3620778310 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcb84040480 con 0x55a9d93e6670 2024-09-19T09:04:32.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.242+0000 7fcb9b653740 1 -- 172.21.15.92:0/3620778310 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb8800be50 con 0x55a9d93e6670 2024-09-19T09:04:32.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.243+0000 7fcb76ff5640 1 -- 172.21.15.92:0/3620778310 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fcb84037040 con 0x55a9d93e6670 2024-09-19T09:04:32.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.243+0000 7fcb9b653740 10 client.26518 fetch_fsmap learned FSMap version 19 2024-09-19T09:04:32.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.243+0000 7fcb9b653740 1 -- 172.21.15.92:0/3620778310 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55a9d93ffe70 con 0x55a9d93e6670 2024-09-19T09:04:32.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.243+0000 7fcb76ff5640 1 -- 172.21.15.92:0/3620778310 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb8800be50 con 0x55a9d93e6670 2024-09-19T09:04:32.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.243+0000 7fcb76ff5640 1 -- 172.21.15.92:0/3620778310 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fcb84049600 con 0x55a9d93e6670 2024-09-19T09:04:32.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.243+0000 7fcb9b653740 10 client.26518 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:04:32.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.243+0000 7fcb9b653740 10 client.26518 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:04:32.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.243+0000 7fcb9b653740 20 client.26518 populate_metadata read hostname 'smithi092' 2024-09-19T09:04:32.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.243+0000 7fcb9b653740 1 --2- 172.21.15.92:0/3620778310 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a9d9401380 0x55a9d94037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.243+0000 7fcb9b653740 4 client.26518 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:32.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.243+0000 7fcb9b653740 1 -- 172.21.15.92:0/3620778310 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a9d9359850 con 0x55a9d9401380 2024-09-19T09:04:32.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.243+0000 7fcb927fc640 1 --2- 172.21.15.92:0/3620778310 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a9d9401380 0x55a9d94037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:32.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.244+0000 7fcb76ff5640 10 client.26518 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:32.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.244+0000 7fcb927fc640 1 --2- 172.21.15.92:0/3620778310 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a9d9401380 0x55a9d94037d0 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f391ce3604af0996 server_cookie=885a930a436ef64c in_seq=0 out_seq=0 2024-09-19T09:04:32.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.245+0000 7fcb76ff5640 1 -- 172.21.15.92:0/3620778310 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a9d9359850 con 0x55a9d9401380 2024-09-19T09:04:32.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.245+0000 7fcb76ff5640 10 client.26518 handle_command_reply: tid=0 2024-09-19T09:04:32.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.245+0000 7fcb9b653740 1 client.26518 shutdown 2024-09-19T09:04:32.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.245+0000 7fcb9b653740 1 -- 172.21.15.92:0/3620778310 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9d93e6670 msgr2=0x55a9d93f11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:32.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.245+0000 7fcb9b653740 1 --2- 172.21.15.92:0/3620778310 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9d93e6670 0x55a9d93f11e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcb8400a300 tx=0x7fcb84000bc0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.246+0000 7fcb9b653740 1 -- 172.21.15.92:0/3620778310 shutdown_connections 2024-09-19T09:04:32.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.246+0000 7fcb9b653740 1 --2- 172.21.15.92:0/3620778310 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a9d9401380 0x55a9d94037d0 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.246+0000 7fcb9b653740 1 --2- 172.21.15.92:0/3620778310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9d93f1850 0x55a9d93eea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.246+0000 7fcb9b653740 1 --2- 172.21.15.92:0/3620778310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9d93e6f90 0x55a9d93ee490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.246+0000 7fcb9b653740 1 --2- 172.21.15.92:0/3620778310 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9d93e6670 0x55a9d93f11e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.246+0000 7fcb76ff5640 0 client.26518 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:32.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.246+0000 7fcb9b653740 1 -- 172.21.15.92:0/3620778310 >> 172.21.15.92:0/3620778310 conn(0x55a9d93e2c00 msgr2=0x55a9d93e8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:32.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.246+0000 7fcb9b653740 1 -- 172.21.15.92:0/3620778310 shutdown_connections 2024-09-19T09:04:32.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.246+0000 7fcb9b653740 1 -- 172.21.15.92:0/3620778310 wait complete. 2024-09-19T09:04:32.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.246+0000 7fcb9b653740 20 client.26518 trim_cache size 0 max 16384 2024-09-19T09:04:32.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.276+0000 7fcb9b653740 1 Processor -- start 2024-09-19T09:04:32.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.276+0000 7fcb9b653740 1 -- start start 2024-09-19T09:04:32.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.276+0000 7fcb9b653740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9d93e6670 0x55a9d93fd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.276+0000 7fcb9b653740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9d93e6f90 0x55a9d9409090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.276+0000 7fcb9b653740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9d93f1850 0x55a9d94095d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.276+0000 7fcb9b653740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8000c520 con 0x55a9d93e6670 2024-09-19T09:04:32.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.276+0000 7fcb9b653740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8000edc0 con 0x55a9d93f1850 2024-09-19T09:04:32.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.276+0000 7fcb9b653740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8000cbb0 con 0x55a9d93e6f90 2024-09-19T09:04:32.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.276+0000 7fcb92ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9d93e6670 0x55a9d93fd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:32.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.277+0000 7fcb937fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9d93f1850 0x55a9d94095d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:32.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.277+0000 7fcb937fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9d93f1850 0x55a9d94095d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:34966/0 (socket says 172.21.15.92:34966) 2024-09-19T09:04:32.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.277+0000 7fcb937fe640 1 -- 172.21.15.92:0/2652358445 learned_addr learned my addr 172.21.15.92:0/2652358445 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:32.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.277+0000 7fcb937fe640 1 -- 172.21.15.92:0/2652358445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9d93e6f90 msgr2=0x55a9d9409090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:32.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.277+0000 7fcb937fe640 1 --2- 172.21.15.92:0/2652358445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9d93e6f90 0x55a9d9409090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.277+0000 7fcb937fe640 1 -- 172.21.15.92:0/2652358445 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9d93e6670 msgr2=0x55a9d93fd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:32.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.277+0000 7fcb937fe640 1 --2- 172.21.15.92:0/2652358445 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9d93e6670 0x55a9d93fd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.277+0000 7fcb937fe640 1 -- 172.21.15.92:0/2652358445 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9d93f1550 con 0x55a9d93f1850 2024-09-19T09:04:32.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.277+0000 7fcb937fe640 1 --2- 172.21.15.92:0/2652358445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9d93f1850 0x55a9d94095d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcb8800ded0 tx=0x7fcb88005a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee980ae1c588508e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:32.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.277+0000 7fcb78ff9640 1 -- 172.21.15.92:0/2652358445 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb88027070 con 0x55a9d93f1850 2024-09-19T09:04:32.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.278+0000 7fcb78ff9640 1 -- 172.21.15.92:0/2652358445 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb8800bc50 con 0x55a9d93f1850 2024-09-19T09:04:32.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.278+0000 7fcb78ff9640 1 -- 172.21.15.92:0/2652358445 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb88003d90 con 0x55a9d93f1850 2024-09-19T09:04:32.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.279+0000 7fcb9b653740 1 -- 172.21.15.92:0/2652358445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9d93f1850 msgr2=0x55a9d94095d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:32.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.279+0000 7fcb9b653740 1 --2- 172.21.15.92:0/2652358445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9d93f1850 0x55a9d94095d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcb8800ded0 tx=0x7fcb88005a70 comp rx=0 tx=0).stop 2024-09-19T09:04:32.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.279+0000 7fcb9b653740 1 -- 172.21.15.92:0/2652358445 shutdown_connections 2024-09-19T09:04:32.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.279+0000 7fcb9b653740 1 --2- 172.21.15.92:0/2652358445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9d93f1850 0x55a9d94095d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.279+0000 7fcb9b653740 1 --2- 172.21.15.92:0/2652358445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9d93e6f90 0x55a9d9409090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.279+0000 7fcb9b653740 1 --2- 172.21.15.92:0/2652358445 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9d93e6670 0x55a9d93fd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.279+0000 7fcb9b653740 1 -- 172.21.15.92:0/2652358445 >> 172.21.15.92:0/2652358445 conn(0x55a9d93e2c00 msgr2=0x55a9d93e9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:32.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.279+0000 7fcb9b653740 1 -- 172.21.15.92:0/2652358445 shutdown_connections 2024-09-19T09:04:32.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.279+0000 7fcb9b653740 1 -- 172.21.15.92:0/2652358445 wait complete. 2024-09-19T09:04:32.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.279+0000 7fcb9b653740 1 -- start start 2024-09-19T09:04:32.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.280+0000 7fcb9b653740 1 Processor -- start 2024-09-19T09:04:32.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.280+0000 7fcb9b653740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9d93e6670 0x55a9d93f5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.280+0000 7fcb9b653740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9d93e6f90 0x55a9d93f6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.280+0000 7fcb9b653740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9d93f1850 0x55a9d946b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.280+0000 7fcb9b653740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8000d280 con 0x55a9d93e6670 2024-09-19T09:04:32.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.280+0000 7fcb9b653740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8000e6f0 con 0x55a9d93e6f90 2024-09-19T09:04:32.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.280+0000 7fcb9b653740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8000d950 con 0x55a9d93f1850 2024-09-19T09:04:32.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.280+0000 7fcb92ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9d93e6670 0x55a9d93f5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:32.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.280+0000 7fcb92ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9d93e6670 0x55a9d93f5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36934/0 (socket says 172.21.15.92:36934) 2024-09-19T09:04:32.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.280+0000 7fcb9b653740 10 client.0 _ll_register_callbacks cb 0x7fcb88005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:32.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.280+0000 7fcb92ffd640 1 -- 172.21.15.92:0/213210289 learned_addr learned my addr 172.21.15.92:0/213210289 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:32.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.280+0000 7fcb937fe640 1 --2- 172.21.15.92:0/213210289 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9d93f1850 0x55a9d946b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:32.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.280+0000 7fcb927fc640 1 --2- 172.21.15.92:0/213210289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9d93e6f90 0x55a9d93f6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:32.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.281+0000 7fcb937fe640 1 -- 172.21.15.92:0/213210289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9d93e6f90 msgr2=0x55a9d93f6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:32.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.281+0000 7fcb937fe640 1 --2- 172.21.15.92:0/213210289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9d93e6f90 0x55a9d93f6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.281+0000 7fcb937fe640 1 -- 172.21.15.92:0/213210289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9d93e6670 msgr2=0x55a9d93f5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:32.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.281+0000 7fcb937fe640 1 --2- 172.21.15.92:0/213210289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9d93e6670 0x55a9d93f5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.281+0000 7fcb937fe640 1 -- 172.21.15.92:0/213210289 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9d946b5a0 con 0x55a9d93f1850 2024-09-19T09:04:32.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.281+0000 7fcb937fe640 1 --2- 172.21.15.92:0/213210289 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9d93f1850 0x55a9d946b060 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x55a9d93e6f60 tx=0x7fcb88003820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfe5f86ae69c0615 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:32.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.281+0000 7fcb76ff5640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:04:32.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.281+0000 7fcb76ff5640 1 -- 172.21.15.92:0/213210289 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb88027070 con 0x55a9d93f1850 2024-09-19T09:04:32.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.281+0000 7fcb76ff5640 1 -- 172.21.15.92:0/213210289 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcb88022480 con 0x55a9d93f1850 2024-09-19T09:04:32.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.281+0000 7fcb9b653740 1 -- 172.21.15.92:0/213210289 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb8800bc50 con 0x55a9d93f1850 2024-09-19T09:04:32.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.282+0000 7fcb76ff5640 1 -- 172.21.15.92:0/213210289 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fcb88022680 con 0x55a9d93f1850 2024-09-19T09:04:32.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.282+0000 7fcb9b653740 10 client.26521 fetch_fsmap learned FSMap version 19 2024-09-19T09:04:32.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.282+0000 7fcb9b653740 1 -- 172.21.15.92:0/213210289 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55a9d946c830 con 0x55a9d93f1850 2024-09-19T09:04:32.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.282+0000 7fcb76ff5640 1 -- 172.21.15.92:0/213210289 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb88022d00 con 0x55a9d93f1850 2024-09-19T09:04:32.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.282+0000 7fcb76ff5640 1 -- 172.21.15.92:0/213210289 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fcb8802bae0 con 0x55a9d93f1850 2024-09-19T09:04:32.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.282+0000 7fcb9b653740 10 client.26521 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:04:32.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.282+0000 7fcb9b653740 10 client.26521 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:04:32.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.282+0000 7fcb9b653740 20 client.26521 populate_metadata read hostname 'smithi092' 2024-09-19T09:04:32.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.282+0000 7fcb9b653740 1 --2- 172.21.15.92:0/213210289 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a9d946ccb0 0x55a9d946f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.282+0000 7fcb9b653740 4 client.26521 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:04:32.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.282+0000 7fcb9b653740 1 -- 172.21.15.92:0/213210289 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fcb8800bc50 con 0x55a9d946ccb0 2024-09-19T09:04:32.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.282+0000 7fcb92ffd640 1 --2- 172.21.15.92:0/213210289 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a9d946ccb0 0x55a9d946f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:32.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.284+0000 7fcb92ffd640 1 --2- 172.21.15.92:0/213210289 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a9d946ccb0 0x55a9d946f0a0 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad9d14cc910f67e3 server_cookie=8157e79edef15f88 in_seq=0 out_seq=0 2024-09-19T09:04:32.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.284+0000 7fcb76ff5640 10 client.26521 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:32.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.284+0000 7fcb76ff5640 1 -- 172.21.15.92:0/213210289 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7fcb8800bc50 con 0x55a9d946ccb0 2024-09-19T09:04:32.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.284+0000 7fcb76ff5640 10 client.26521 handle_command_reply: tid=0 2024-09-19T09:04:32.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.284+0000 7fcb9b653740 1 client.26521 shutdown 2024-09-19T09:04:32.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.285+0000 7fcb9b653740 1 -- 172.21.15.92:0/213210289 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9d93f1850 msgr2=0x55a9d946b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:32.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.285+0000 7fcb9b653740 1 --2- 172.21.15.92:0/213210289 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9d93f1850 0x55a9d946b060 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x55a9d93e6f60 tx=0x7fcb88003820 comp rx=0 tx=0).stop 2024-09-19T09:04:32.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.285+0000 7fcb9b653740 1 -- 172.21.15.92:0/213210289 shutdown_connections 2024-09-19T09:04:32.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.285+0000 7fcb9b653740 1 --2- 172.21.15.92:0/213210289 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a9d946ccb0 0x55a9d946f0a0 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.285+0000 7fcb76ff5640 0 client.26521 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:32.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.285+0000 7fcb9b653740 1 --2- 172.21.15.92:0/213210289 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9d93f1850 0x55a9d946b060 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.285+0000 7fcb9b653740 1 --2- 172.21.15.92:0/213210289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9d93e6f90 0x55a9d93f6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.285+0000 7fcb9b653740 1 --2- 172.21.15.92:0/213210289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a9d93e6670 0x55a9d93f5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.285+0000 7fcb9b653740 1 -- 172.21.15.92:0/213210289 >> 172.21.15.92:0/213210289 conn(0x55a9d93e2c00 msgr2=0x55a9d93e1500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:32.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.285+0000 7fcb9b653740 1 -- 172.21.15.92:0/213210289 shutdown_connections 2024-09-19T09:04:32.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.285+0000 7fcb9b653740 1 -- 172.21.15.92:0/213210289 wait complete. 2024-09-19T09:04:32.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.285+0000 7fcb9b653740 20 client.26521 trim_cache size 0 max 16384 2024-09-19T09:04:32.289 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:04:32.289 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:04:32.289 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": { 2024-09-19T09:04:32.289 INFO:teuthology.orchestra.run.smithi092.stdout: "10f4335b-a595-4959-94cc-37afb8208db3": { 2024-09-19T09:04:32.289 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-19T09:04:32.289 INFO:teuthology.orchestra.run.smithi092.stdout: "tag": "10f4335b-a595-4959-94cc-37afb8208db3", 2024-09-19T09:04:32.289 INFO:teuthology.orchestra.run.smithi092.stdout: "options": "recursive,force" 2024-09-19T09:04:32.289 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:04:32.290 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:04:32.290 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:04:32.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.286+0000 7fcb93fff640 1 -- 172.21.15.92:0/2181313030 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcb7c0a32e0 msgr2=0x7fcb7c0a57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:32.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.286+0000 7fcb93fff640 1 --2- 172.21.15.92:0/2181313030 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcb7c0a32e0 0x7fcb7c0a57a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fcb8400aed0 tx=0x7fcb84009d80 comp rx=0 tx=0).stop 2024-09-19T09:04:32.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.286+0000 7fcb93fff640 1 -- 172.21.15.92:0/2181313030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb94109e00 msgr2=0x7fcb941a75f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:32.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.286+0000 7fcb93fff640 1 --2- 172.21.15.92:0/2181313030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb94109e00 0x7fcb941a75f0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c00eab0 tx=0x7fcb8c00ef70 comp rx=0 tx=0).stop 2024-09-19T09:04:32.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.286+0000 7fcb93fff640 1 -- 172.21.15.92:0/2181313030 shutdown_connections 2024-09-19T09:04:32.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.286+0000 7fcb93fff640 1 --2- 172.21.15.92:0/2181313030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb9410ea10 0x7fcb941ab980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.286+0000 7fcb93fff640 1 --2- 172.21.15.92:0/2181313030 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcb7c0a32e0 0x7fcb7c0a57a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.286+0000 7fcb93fff640 1 --2- 172.21.15.92:0/2181313030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb94109e00 0x7fcb941a75f0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.286+0000 7fcb93fff640 1 --2- 172.21.15.92:0/2181313030 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb94109450 0x7fcb941a70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.286+0000 7fcb93fff640 1 -- 172.21.15.92:0/2181313030 >> 172.21.15.92:0/2181313030 conn(0x7fcb94073660 msgr2=0x7fcb9410c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:32.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.287+0000 7fcb93fff640 1 -- 172.21.15.92:0/2181313030 shutdown_connections 2024-09-19T09:04:32.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:04:32.287+0000 7fcb93fff640 1 -- 172.21.15.92:0/2181313030 wait complete. 2024-09-19T09:04:33.230 INFO:tasks.cephfs.filesystem:scrub status for tag:10f4335b-a595-4959-94cc-37afb8208db3 - {'path': '/', 'tag': '10f4335b-a595-4959-94cc-37afb8208db3', 'options': 'recursive,force'} 2024-09-19T09:04:33.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:33 smithi167 ceph-mon[35359]: pgmap v572: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 8.5 MiB/s wr, 823 op/s 2024-09-19T09:04:33.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:33 smithi190 ceph-mon[35358]: pgmap v572: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 8.5 MiB/s wr, 823 op/s 2024-09-19T09:04:34.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:33 smithi092 ceph-mon[31407]: pgmap v572: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 8.5 MiB/s wr, 823 op/s 2024-09-19T09:04:34.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:34 smithi167 ceph-mon[35359]: scrub summary: idle 2024-09-19T09:04:34.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:34 smithi190 ceph-mon[35358]: scrub summary: idle 2024-09-19T09:04:35.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:34 smithi092 ceph-mon[31407]: scrub summary: idle 2024-09-19T09:04:35.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 470.0 s, 4768.2 tps, lat 20.940 ms stddev 23.132 2024-09-19T09:04:35.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:35 smithi167 ceph-mon[35359]: pgmap v573: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 10 MiB/s wr, 1.02k op/s 2024-09-19T09:04:35.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:35 smithi190 ceph-mon[35358]: pgmap v573: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 10 MiB/s wr, 1.02k op/s 2024-09-19T09:04:36.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:35 smithi092 ceph-mon[31407]: pgmap v573: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 10 MiB/s wr, 1.02k op/s 2024-09-19T09:04:37.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:37 smithi167 ceph-mon[35359]: pgmap v574: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 8.4 MiB/s wr, 831 op/s 2024-09-19T09:04:37.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:37 smithi190 ceph-mon[35358]: pgmap v574: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 8.4 MiB/s wr, 831 op/s 2024-09-19T09:04:38.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:37 smithi092 ceph-mon[31407]: pgmap v574: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 8.4 MiB/s wr, 831 op/s 2024-09-19T09:04:39.805 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:39 smithi092 ceph-mon[31407]: pgmap v575: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 8.9 MiB/s wr, 879 op/s 2024-09-19T09:04:39.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:39 smithi167 ceph-mon[35359]: pgmap v575: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 8.9 MiB/s wr, 879 op/s 2024-09-19T09:04:39.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:39 smithi190 ceph-mon[35358]: pgmap v575: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 8.9 MiB/s wr, 879 op/s 2024-09-19T09:04:39.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.894+0000 7f4f2805c640 1 -- 172.21.15.92:0/1513379165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f20109cd0 msgr2=0x7f4f2010a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:39.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.894+0000 7f4f2805c640 1 --2- 172.21.15.92:0/1513379165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f20109cd0 0x7f4f2010a180 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4f18009ca0 tx=0x7f4f1802cad0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.895+0000 7f4f2805c640 1 -- 172.21.15.92:0/1513379165 shutdown_connections 2024-09-19T09:04:39.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.895+0000 7f4f2805c640 1 --2- 172.21.15.92:0/1513379165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f20109cd0 0x7f4f2010a180 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.895+0000 7f4f2805c640 1 --2- 172.21.15.92:0/1513379165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f2006aa80 0x7f4f20109790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.895+0000 7f4f2805c640 1 --2- 172.21.15.92:0/1513379165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f20073730 0x7f4f20073b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.895+0000 7f4f2805c640 1 -- 172.21.15.92:0/1513379165 >> 172.21.15.92:0/1513379165 conn(0x7f4f2006ef20 msgr2=0x7f4f20071360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:39.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.895+0000 7f4f2805c640 1 -- 172.21.15.92:0/1513379165 shutdown_connections 2024-09-19T09:04:39.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.895+0000 7f4f2805c640 1 -- 172.21.15.92:0/1513379165 wait complete. 2024-09-19T09:04:39.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.896+0000 7f4f2805c640 1 Processor -- start 2024-09-19T09:04:39.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.896+0000 7f4f2805c640 1 -- start start 2024-09-19T09:04:39.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.896+0000 7f4f2805c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f2006aa80 0x7f4f2019e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:39.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.896+0000 7f4f2805c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f20073730 0x7f4f2019e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:39.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.896+0000 7f4f2805c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f20109cd0 0x7f4f201a5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:39.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.896+0000 7f4f2805c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4f20113dd0 con 0x7f4f20073730 2024-09-19T09:04:39.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.896+0000 7f4f2805c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4f20113c50 con 0x7f4f20109cd0 2024-09-19T09:04:39.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.896+0000 7f4f2805c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4f20113f50 con 0x7f4f2006aa80 2024-09-19T09:04:39.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.896+0000 7f4f25df8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f2006aa80 0x7f4f2019e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:39.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.896+0000 7f4f25df8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f2006aa80 0x7f4f2019e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:32980/0 (socket says 172.21.15.92:32980) 2024-09-19T09:04:39.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.896+0000 7f4f25df8640 1 -- 172.21.15.92:0/36554760 learned_addr learned my addr 172.21.15.92:0/36554760 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:39.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.896+0000 7f4f255f7640 1 --2- 172.21.15.92:0/36554760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f20073730 0x7f4f2019e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:39.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.896+0000 7f4f265f9640 1 --2- 172.21.15.92:0/36554760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f20109cd0 0x7f4f201a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:39.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.896+0000 7f4f25df8640 1 -- 172.21.15.92:0/36554760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f20109cd0 msgr2=0x7f4f201a5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:39.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.896+0000 7f4f25df8640 1 --2- 172.21.15.92:0/36554760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f20109cd0 0x7f4f201a5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.896+0000 7f4f25df8640 1 -- 172.21.15.92:0/36554760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f20073730 msgr2=0x7f4f2019e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:39.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.896+0000 7f4f25df8640 1 --2- 172.21.15.92:0/36554760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f20073730 0x7f4f2019e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.896+0000 7f4f25df8640 1 -- 172.21.15.92:0/36554760 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f201a5fb0 con 0x7f4f2006aa80 2024-09-19T09:04:39.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.897+0000 7f4f25df8640 1 --2- 172.21.15.92:0/36554760 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f2006aa80 0x7f4f2019e390 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c00e9c0 tx=0x7f4f1c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:39.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.897+0000 7f4f16ffd640 1 -- 172.21.15.92:0/36554760 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c00cd80 con 0x7f4f2006aa80 2024-09-19T09:04:39.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.897+0000 7f4f16ffd640 1 -- 172.21.15.92:0/36554760 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f1c0035f0 con 0x7f4f2006aa80 2024-09-19T09:04:39.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.897+0000 7f4f16ffd640 1 -- 172.21.15.92:0/36554760 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c0186d0 con 0x7f4f2006aa80 2024-09-19T09:04:39.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.897+0000 7f4f2805c640 1 -- 172.21.15.92:0/36554760 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f201a62a0 con 0x7f4f2006aa80 2024-09-19T09:04:39.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.897+0000 7f4f2805c640 1 -- 172.21.15.92:0/36554760 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f201a6740 con 0x7f4f2006aa80 2024-09-19T09:04:39.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.900+0000 7f4f16ffd640 1 -- 172.21.15.92:0/36554760 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4f1c0037a0 con 0x7f4f2006aa80 2024-09-19T09:04:39.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.901+0000 7f4f16ffd640 1 --2- 172.21.15.92:0/36554760 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4f0c0a3370 0x7f4f0c0a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:39.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.901+0000 7f4f16ffd640 1 -- 172.21.15.92:0/36554760 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4f1c0cfdc0 con 0x7f4f2006aa80 2024-09-19T09:04:39.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.901+0000 7f4f255f7640 1 --2- 172.21.15.92:0/36554760 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4f0c0a3370 0x7f4f0c0a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:39.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.902+0000 7f4f255f7640 1 --2- 172.21.15.92:0/36554760 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4f0c0a3370 0x7f4f0c0a5830 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4f2019f8a0 tx=0x7f4f10005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:39.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.903+0000 7f4f2aded740 1 Processor -- start 2024-09-19T09:04:39.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.903+0000 7f4f2aded740 1 -- start start 2024-09-19T09:04:39.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.903+0000 7f4f2aded740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a0b57cf9a0 0x55a0b57cfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:39.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.903+0000 7f4f2aded740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0b57d02e0 0x55a0b57d4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:39.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.903+0000 7f4f2aded740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0b57d5370 0x55a0b57d7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:39.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.903+0000 7f4f2aded740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a0b57332f0 con 0x55a0b57d5370 2024-09-19T09:04:39.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.903+0000 7f4f2aded740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a0b56db270 con 0x55a0b57d02e0 2024-09-19T09:04:39.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.903+0000 7f4f2aded740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55a0b572f2b0 con 0x55a0b57cf9a0 2024-09-19T09:04:39.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.903+0000 7f4f255f7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0b57d02e0 0x55a0b57d4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:39.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.903+0000 7f4f25df8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a0b57cf9a0 0x55a0b57cfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:39.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.903+0000 7f4f265f9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0b57d5370 0x55a0b57d7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:39.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.903+0000 7f4f255f7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0b57d02e0 0x55a0b57d4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:35016/0 (socket says 172.21.15.92:35016) 2024-09-19T09:04:39.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.903+0000 7f4f255f7640 1 -- 172.21.15.92:0/831177054 learned_addr learned my addr 172.21.15.92:0/831177054 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:39.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.903+0000 7f4f25df8640 1 -- 172.21.15.92:0/831177054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0b57d02e0 msgr2=0x55a0b57d4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:39.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.903+0000 7f4f25df8640 1 --2- 172.21.15.92:0/831177054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0b57d02e0 0x55a0b57d4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.903+0000 7f4f25df8640 1 -- 172.21.15.92:0/831177054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0b57d5370 msgr2=0x55a0b57d7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:39.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.903+0000 7f4f25df8640 1 --2- 172.21.15.92:0/831177054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0b57d5370 0x55a0b57d7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.903+0000 7f4f25df8640 1 -- 172.21.15.92:0/831177054 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0b56da340 con 0x55a0b57cf9a0 2024-09-19T09:04:39.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.904+0000 7f4f255f7640 1 --2- 172.21.15.92:0/831177054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0b57d02e0 0x55a0b57d4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:39.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.904+0000 7f4f25df8640 1 --2- 172.21.15.92:0/831177054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a0b57cf9a0 0x55a0b57cfda0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c0058c0 tx=0x7f4f1c09caa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc6e11420aa935ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:39.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.904+0000 7f4f0bfff640 1 -- 172.21.15.92:0/831177054 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c0b4020 con 0x55a0b57cf9a0 2024-09-19T09:04:39.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.904+0000 7f4f0bfff640 1 -- 172.21.15.92:0/831177054 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f1c0a5010 con 0x55a0b57cf9a0 2024-09-19T09:04:39.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.904+0000 7f4f0bfff640 1 -- 172.21.15.92:0/831177054 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c0a4b80 con 0x55a0b57cf9a0 2024-09-19T09:04:39.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.905+0000 7f4f2aded740 1 -- 172.21.15.92:0/831177054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a0b57cf9a0 msgr2=0x55a0b57cfda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:39.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.905+0000 7f4f2aded740 1 --2- 172.21.15.92:0/831177054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a0b57cf9a0 0x55a0b57cfda0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c0058c0 tx=0x7f4f1c09caa0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.905+0000 7f4f2aded740 1 -- 172.21.15.92:0/831177054 shutdown_connections 2024-09-19T09:04:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.905+0000 7f4f2aded740 1 --2- 172.21.15.92:0/831177054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0b57d5370 0x55a0b57d7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.905+0000 7f4f2aded740 1 --2- 172.21.15.92:0/831177054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0b57d02e0 0x55a0b57d4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.905+0000 7f4f2aded740 1 --2- 172.21.15.92:0/831177054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a0b57cf9a0 0x55a0b57cfda0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.905+0000 7f4f2aded740 1 -- 172.21.15.92:0/831177054 >> 172.21.15.92:0/831177054 conn(0x55a0b57cb010 msgr2=0x55a0b57cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.905+0000 7f4f2aded740 1 -- 172.21.15.92:0/831177054 shutdown_connections 2024-09-19T09:04:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.905+0000 7f4f2aded740 1 -- 172.21.15.92:0/831177054 wait complete. 2024-09-19T09:04:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.906+0000 7f4f2aded740 1 -- start start 2024-09-19T09:04:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.906+0000 7f4f2aded740 1 Processor -- start 2024-09-19T09:04:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.906+0000 7f4f2aded740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0b57cf9a0 0x55a0b57d9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.907+0000 7f4f2aded740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0b57d02e0 0x55a0b57da190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.907+0000 7f4f2aded740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a0b57d5370 0x55a0b57e1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.907+0000 7f4f2aded740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a0b57d8340 con 0x55a0b57d02e0 2024-09-19T09:04:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.907+0000 7f4f2aded740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a0b56bc290 con 0x55a0b57cf9a0 2024-09-19T09:04:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.907+0000 7f4f2aded740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55a0b57d84c0 con 0x55a0b57d5370 2024-09-19T09:04:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.907+0000 7f4f25df8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0b57cf9a0 0x55a0b57d9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.907+0000 7f4f255f7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0b57d02e0 0x55a0b57da190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.907+0000 7f4f25df8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0b57cf9a0 0x55a0b57d9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:35022/0 (socket says 172.21.15.92:35022) 2024-09-19T09:04:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.907+0000 7f4f25df8640 1 -- 172.21.15.92:0/1955846336 learned_addr learned my addr 172.21.15.92:0/1955846336 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.907+0000 7f4f265f9640 1 --2- 172.21.15.92:0/1955846336 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a0b57d5370 0x55a0b57e1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.907+0000 7f4f2aded740 10 client.0 _ll_register_callbacks cb 0x55a0b56ed140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.907+0000 7f4f25df8640 1 -- 172.21.15.92:0/1955846336 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a0b57d5370 msgr2=0x55a0b57e1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.907+0000 7f4f25df8640 1 --2- 172.21.15.92:0/1955846336 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a0b57d5370 0x55a0b57e1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.907+0000 7f4f25df8640 1 -- 172.21.15.92:0/1955846336 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0b57d02e0 msgr2=0x55a0b57da190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.907+0000 7f4f25df8640 1 --2- 172.21.15.92:0/1955846336 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0b57d02e0 0x55a0b57da190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.907+0000 7f4f25df8640 1 -- 172.21.15.92:0/1955846336 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0b5446210 con 0x55a0b57cf9a0 2024-09-19T09:04:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.907+0000 7f4f25df8640 1 --2- 172.21.15.92:0/1955846336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0b57cf9a0 0x55a0b57d9c50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c09c0a0 tx=0x7f4f1c0b5440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77f8052b98588460 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.907+0000 7f4f097fa640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:04:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.907+0000 7f4f097fa640 1 -- 172.21.15.92:0/1955846336 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c0b9070 con 0x55a0b57cf9a0 2024-09-19T09:04:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.908+0000 7f4f097fa640 1 -- 172.21.15.92:0/1955846336 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4f1c0a4d80 con 0x55a0b57cf9a0 2024-09-19T09:04:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.908+0000 7f4f2aded740 1 -- 172.21.15.92:0/1955846336 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f1c0a5010 con 0x55a0b57cf9a0 2024-09-19T09:04:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.908+0000 7f4f097fa640 1 -- 172.21.15.92:0/1955846336 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4f1c0b4070 con 0x55a0b57cf9a0 2024-09-19T09:04:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.908+0000 7f4f2aded740 10 client.26630 fetch_fsmap learned FSMap version 19 2024-09-19T09:04:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.908+0000 7f4f2aded740 1 -- 172.21.15.92:0/1955846336 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55a0b5512620 con 0x55a0b57cf9a0 2024-09-19T09:04:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.908+0000 7f4f097fa640 1 -- 172.21.15.92:0/1955846336 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f1c09b7f0 con 0x55a0b57cf9a0 2024-09-19T09:04:39.913 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.908+0000 7f4f097fa640 1 -- 172.21.15.92:0/1955846336 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f4f1c09b260 con 0x55a0b57cf9a0 2024-09-19T09:04:39.913 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.909+0000 7f4f2aded740 10 client.26630 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:04:39.913 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.909+0000 7f4f2aded740 10 client.26630 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:04:39.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.909+0000 7f4f2aded740 20 client.26630 populate_metadata read hostname 'smithi092' 2024-09-19T09:04:39.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.909+0000 7f4f2aded740 1 --2- 172.21.15.92:0/1955846336 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a0b57e5440 0x55a0b57e7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:39.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.909+0000 7f4f2aded740 4 client.26630 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:39.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.909+0000 7f4f2aded740 1 -- 172.21.15.92:0/1955846336 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4f1c0a5010 con 0x55a0b57e5440 2024-09-19T09:04:39.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.910+0000 7f4f255f7640 1 --2- 172.21.15.92:0/1955846336 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a0b57e5440 0x55a0b57e7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:39.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.911+0000 7f4f255f7640 1 --2- 172.21.15.92:0/1955846336 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a0b57e5440 0x55a0b57e7830 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c9c6c43509e3503 server_cookie=29adb8617191debc in_seq=0 out_seq=0 2024-09-19T09:04:39.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.911+0000 7f4f097fa640 10 client.26630 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:39.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.911+0000 7f4f097fa640 1 -- 172.21.15.92:0/1955846336 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f4f1c0a5010 con 0x55a0b57e5440 2024-09-19T09:04:39.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.911+0000 7f4f097fa640 10 client.26630 handle_command_reply: tid=0 2024-09-19T09:04:39.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.911+0000 7f4f2aded740 1 client.26630 shutdown 2024-09-19T09:04:39.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.912+0000 7f4f2aded740 1 -- 172.21.15.92:0/1955846336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0b57cf9a0 msgr2=0x55a0b57d9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:39.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.912+0000 7f4f2aded740 1 --2- 172.21.15.92:0/1955846336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0b57cf9a0 0x55a0b57d9c50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c09c0a0 tx=0x7f4f1c0b5440 comp rx=0 tx=0).stop 2024-09-19T09:04:39.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.912+0000 7f4f2aded740 1 -- 172.21.15.92:0/1955846336 shutdown_connections 2024-09-19T09:04:39.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.912+0000 7f4f2aded740 1 --2- 172.21.15.92:0/1955846336 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a0b57e5440 0x55a0b57e7830 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.912+0000 7f4f2aded740 1 --2- 172.21.15.92:0/1955846336 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a0b57d5370 0x55a0b57e1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.912+0000 7f4f097fa640 0 client.26630 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:39.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.912+0000 7f4f2aded740 1 --2- 172.21.15.92:0/1955846336 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0b57d02e0 0x55a0b57da190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.912+0000 7f4f2aded740 1 --2- 172.21.15.92:0/1955846336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0b57cf9a0 0x55a0b57d9c50 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.912+0000 7f4f2aded740 1 -- 172.21.15.92:0/1955846336 >> 172.21.15.92:0/1955846336 conn(0x55a0b57cb010 msgr2=0x55a0b57cc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:39.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.912+0000 7f4f2aded740 1 -- 172.21.15.92:0/1955846336 shutdown_connections 2024-09-19T09:04:39.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.912+0000 7f4f2aded740 1 -- 172.21.15.92:0/1955846336 wait complete. 2024-09-19T09:04:39.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.912+0000 7f4f2aded740 20 client.26630 trim_cache size 0 max 16384 2024-09-19T09:04:39.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.932+0000 7f4f2aded740 1 Processor -- start 2024-09-19T09:04:39.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.932+0000 7f4f2aded740 1 -- start start 2024-09-19T09:04:39.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.933+0000 7f4f2aded740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0b57cf9a0 0x55a0b57da070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:39.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.933+0000 7f4f2aded740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0b57d02e0 0x55a0b57e10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:39.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.933+0000 7f4f2aded740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a0b57d5370 0x55a0b57cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:39.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.933+0000 7f4f2aded740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4f201ad610 con 0x55a0b57cf9a0 2024-09-19T09:04:39.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.933+0000 7f4f2aded740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4f201afeb0 con 0x55a0b57d02e0 2024-09-19T09:04:39.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.933+0000 7f4f2aded740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4f201adca0 con 0x55a0b57d5370 2024-09-19T09:04:39.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.933+0000 7f4f25df8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0b57cf9a0 0x55a0b57da070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:39.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.933+0000 7f4f25df8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0b57cf9a0 0x55a0b57da070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36974/0 (socket says 172.21.15.92:36974) 2024-09-19T09:04:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.933+0000 7f4f25df8640 1 -- 172.21.15.92:0/2885409033 learned_addr learned my addr 172.21.15.92:0/2885409033 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.933+0000 7f4f265f9640 1 --2- 172.21.15.92:0/2885409033 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a0b57d5370 0x55a0b57cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.933+0000 7f4f255f7640 1 --2- 172.21.15.92:0/2885409033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0b57d02e0 0x55a0b57e10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.933+0000 7f4f25df8640 1 -- 172.21.15.92:0/2885409033 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a0b57d5370 msgr2=0x55a0b57cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.933+0000 7f4f25df8640 1 --2- 172.21.15.92:0/2885409033 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a0b57d5370 0x55a0b57cc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.933+0000 7f4f25df8640 1 -- 172.21.15.92:0/2885409033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0b57d02e0 msgr2=0x55a0b57e10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.933+0000 7f4f25df8640 1 --2- 172.21.15.92:0/2885409033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0b57d02e0 0x55a0b57e10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.933+0000 7f4f25df8640 1 -- 172.21.15.92:0/2885409033 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0b57ca8d0 con 0x55a0b57cf9a0 2024-09-19T09:04:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.933+0000 7f4f25df8640 1 --2- 172.21.15.92:0/2885409033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0b57cf9a0 0x55a0b57da070 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c098d70 tx=0x7f4f1c003ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef85e5b94145da4d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.933+0000 7f4f0b7fe640 1 -- 172.21.15.92:0/2885409033 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c0b9070 con 0x55a0b57cf9a0 2024-09-19T09:04:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.934+0000 7f4f0b7fe640 1 -- 172.21.15.92:0/2885409033 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f1c0a5010 con 0x55a0b57cf9a0 2024-09-19T09:04:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.934+0000 7f4f0b7fe640 1 -- 172.21.15.92:0/2885409033 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c09b260 con 0x55a0b57cf9a0 2024-09-19T09:04:39.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.935+0000 7f4f2aded740 1 -- 172.21.15.92:0/2885409033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0b57cf9a0 msgr2=0x55a0b57da070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:39.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.935+0000 7f4f2aded740 1 --2- 172.21.15.92:0/2885409033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0b57cf9a0 0x55a0b57da070 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c098d70 tx=0x7f4f1c003ea0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.935+0000 7f4f2aded740 1 -- 172.21.15.92:0/2885409033 shutdown_connections 2024-09-19T09:04:39.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.935+0000 7f4f2aded740 1 --2- 172.21.15.92:0/2885409033 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a0b57d5370 0x55a0b57cc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.935+0000 7f4f2aded740 1 --2- 172.21.15.92:0/2885409033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0b57d02e0 0x55a0b57e10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.935+0000 7f4f2aded740 1 --2- 172.21.15.92:0/2885409033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0b57cf9a0 0x55a0b57da070 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.935+0000 7f4f2aded740 1 -- 172.21.15.92:0/2885409033 >> 172.21.15.92:0/2885409033 conn(0x55a0b57cb010 msgr2=0x55a0b57ca1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:39.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.935+0000 7f4f2aded740 1 -- 172.21.15.92:0/2885409033 shutdown_connections 2024-09-19T09:04:39.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.935+0000 7f4f2aded740 1 -- 172.21.15.92:0/2885409033 wait complete. 2024-09-19T09:04:39.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.935+0000 7f4f2aded740 1 -- start start 2024-09-19T09:04:39.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.935+0000 7f4f2aded740 1 Processor -- start 2024-09-19T09:04:39.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.936+0000 7f4f2aded740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0b57cf9a0 0x55a0b57deab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:39.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.936+0000 7f4f2aded740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a0b57d02e0 0x55a0b57deff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:39.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.936+0000 7f4f2aded740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0b57d5370 0x55a0b57e0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:39.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.936+0000 7f4f2aded740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4f201ae370 con 0x55a0b57cf9a0 2024-09-19T09:04:39.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.936+0000 7f4f2aded740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4f201af7e0 con 0x55a0b57d5370 2024-09-19T09:04:39.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.936+0000 7f4f2aded740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4f201aea40 con 0x55a0b57d02e0 2024-09-19T09:04:39.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.936+0000 7f4f2aded740 10 client.0 _ll_register_callbacks cb 0x7f4f1c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:39.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.936+0000 7f4f25df8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0b57cf9a0 0x55a0b57deab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:39.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.936+0000 7f4f25df8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0b57cf9a0 0x55a0b57deab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36990/0 (socket says 172.21.15.92:36990) 2024-09-19T09:04:39.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.936+0000 7f4f255f7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a0b57d02e0 0x55a0b57deff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:39.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.936+0000 7f4f25df8640 1 -- 172.21.15.92:0/4294068979 learned_addr learned my addr 172.21.15.92:0/4294068979 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:39.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.936+0000 7f4f265f9640 1 --2- 172.21.15.92:0/4294068979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0b57d5370 0x55a0b57e0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:39.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.936+0000 7f4f255f7640 1 -- 172.21.15.92:0/4294068979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0b57d5370 msgr2=0x55a0b57e0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:39.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.936+0000 7f4f255f7640 1 --2- 172.21.15.92:0/4294068979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0b57d5370 0x55a0b57e0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.936+0000 7f4f255f7640 1 -- 172.21.15.92:0/4294068979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0b57cf9a0 msgr2=0x55a0b57deab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:39.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.936+0000 7f4f255f7640 1 --2- 172.21.15.92:0/4294068979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0b57cf9a0 0x55a0b57deab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.936+0000 7f4f255f7640 1 -- 172.21.15.92:0/4294068979 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0b57e0610 con 0x55a0b57d02e0 2024-09-19T09:04:39.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.936+0000 7f4f25df8640 1 --2- 172.21.15.92:0/4294068979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0b57cf9a0 0x55a0b57deab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:39.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.936+0000 7f4f255f7640 1 --2- 172.21.15.92:0/4294068979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a0b57d02e0 0x55a0b57deff0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x55a0b57e7f70 tx=0x7f4f10004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4cc4608aae654c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:39.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.936+0000 7f4f097fa640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:04:39.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.937+0000 7f4f097fa640 1 -- 172.21.15.92:0/4294068979 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1003a060 con 0x55a0b57d02e0 2024-09-19T09:04:39.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.937+0000 7f4f097fa640 1 -- 172.21.15.92:0/4294068979 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4f10035480 con 0x55a0b57d02e0 2024-09-19T09:04:39.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.937+0000 7f4f2aded740 1 -- 172.21.15.92:0/4294068979 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f1c0a5010 con 0x55a0b57d02e0 2024-09-19T09:04:39.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.937+0000 7f4f097fa640 1 -- 172.21.15.92:0/4294068979 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4f1002ece0 con 0x55a0b57d02e0 2024-09-19T09:04:39.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.937+0000 7f4f2aded740 10 client.26539 fetch_fsmap learned FSMap version 19 2024-09-19T09:04:39.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.937+0000 7f4f2aded740 1 -- 172.21.15.92:0/4294068979 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55a0b58503a0 con 0x55a0b57d02e0 2024-09-19T09:04:39.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.937+0000 7f4f097fa640 1 -- 172.21.15.92:0/4294068979 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f1c0a5010 con 0x55a0b57d02e0 2024-09-19T09:04:39.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.937+0000 7f4f097fa640 1 -- 172.21.15.92:0/4294068979 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f4f1003f070 con 0x55a0b57d02e0 2024-09-19T09:04:39.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.937+0000 7f4f2aded740 10 client.26539 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:04:39.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.937+0000 7f4f2aded740 10 client.26539 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:04:39.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.937+0000 7f4f2aded740 20 client.26539 populate_metadata read hostname 'smithi092' 2024-09-19T09:04:39.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.937+0000 7f4f2aded740 1 --2- 172.21.15.92:0/4294068979 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a0b57e5440 0x55a0b5852d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:39.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.937+0000 7f4f2aded740 4 client.26539 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:04:39.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.937+0000 7f4f2aded740 1 -- 172.21.15.92:0/4294068979 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a0b5740a20 con 0x55a0b57e5440 2024-09-19T09:04:39.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.938+0000 7f4f25df8640 1 --2- 172.21.15.92:0/4294068979 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a0b57e5440 0x55a0b5852d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:39.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.938+0000 7f4f097fa640 10 client.26539 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:39.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.938+0000 7f4f25df8640 1 --2- 172.21.15.92:0/4294068979 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a0b57e5440 0x55a0b5852d10 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d328d3bc6e2a1313 server_cookie=ea0b126751a1c8fa in_seq=0 out_seq=0 2024-09-19T09:04:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.960+0000 7f4f097fa640 1 -- 172.21.15.92:0/4294068979 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a0b5740a20 con 0x55a0b57e5440 2024-09-19T09:04:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.960+0000 7f4f097fa640 10 client.26539 handle_command_reply: tid=0 2024-09-19T09:04:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.960+0000 7f4f2aded740 1 client.26539 shutdown 2024-09-19T09:04:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.960+0000 7f4f2aded740 1 -- 172.21.15.92:0/4294068979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a0b57d02e0 msgr2=0x55a0b57deff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.960+0000 7f4f2aded740 1 --2- 172.21.15.92:0/4294068979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a0b57d02e0 0x55a0b57deff0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x55a0b57e7f70 tx=0x7f4f10004730 comp rx=0 tx=0).stop 2024-09-19T09:04:39.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.960+0000 7f4f2aded740 1 -- 172.21.15.92:0/4294068979 shutdown_connections 2024-09-19T09:04:39.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.961+0000 7f4f2aded740 1 --2- 172.21.15.92:0/4294068979 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a0b57e5440 0x55a0b5852d10 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.961+0000 7f4f2aded740 1 --2- 172.21.15.92:0/4294068979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0b57d5370 0x55a0b57e0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.961+0000 7f4f2aded740 1 --2- 172.21.15.92:0/4294068979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a0b57d02e0 0x55a0b57deff0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.961+0000 7f4f2aded740 1 --2- 172.21.15.92:0/4294068979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0b57cf9a0 0x55a0b57deab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.961+0000 7f4f097fa640 0 client.26539 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:39.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.961+0000 7f4f2aded740 1 -- 172.21.15.92:0/4294068979 >> 172.21.15.92:0/4294068979 conn(0x55a0b57cb010 msgr2=0x55a0b57cb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:39.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.961+0000 7f4f2aded740 1 -- 172.21.15.92:0/4294068979 shutdown_connections 2024-09-19T09:04:39.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.961+0000 7f4f2aded740 1 -- 172.21.15.92:0/4294068979 wait complete. 2024-09-19T09:04:39.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.961+0000 7f4f2aded740 20 client.26539 trim_cache size 0 max 16384 2024-09-19T09:04:39.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:04:39.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:04:39.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:04:39.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:04:39.964 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.961+0000 7f4f2805c640 1 -- 172.21.15.92:0/36554760 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4f0c0a3370 msgr2=0x7f4f0c0a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:39.964 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.961+0000 7f4f2805c640 1 --2- 172.21.15.92:0/36554760 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4f0c0a3370 0x7f4f0c0a5830 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4f2019f8a0 tx=0x7f4f10005f90 comp rx=0 tx=0).stop 2024-09-19T09:04:39.964 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.961+0000 7f4f2805c640 1 -- 172.21.15.92:0/36554760 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f2006aa80 msgr2=0x7f4f2019e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:39.964 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.961+0000 7f4f2805c640 1 --2- 172.21.15.92:0/36554760 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f2006aa80 0x7f4f2019e390 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c00e9c0 tx=0x7f4f1c00ee80 comp rx=0 tx=0).stop 2024-09-19T09:04:39.964 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.961+0000 7f4f2805c640 1 -- 172.21.15.92:0/36554760 shutdown_connections 2024-09-19T09:04:39.964 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.961+0000 7f4f2805c640 1 --2- 172.21.15.92:0/36554760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f20109cd0 0x7f4f201a5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.964 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.961+0000 7f4f2805c640 1 --2- 172.21.15.92:0/36554760 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4f0c0a3370 0x7f4f0c0a5830 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.964 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.961+0000 7f4f2805c640 1 --2- 172.21.15.92:0/36554760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f20073730 0x7f4f2019e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.964 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.961+0000 7f4f2805c640 1 --2- 172.21.15.92:0/36554760 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f2006aa80 0x7f4f2019e390 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.964 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.961+0000 7f4f2805c640 1 -- 172.21.15.92:0/36554760 >> 172.21.15.92:0/36554760 conn(0x7f4f2006ef20 msgr2=0x7f4f200709b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:39.964 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.961+0000 7f4f2805c640 1 -- 172.21.15.92:0/36554760 shutdown_connections 2024-09-19T09:04:39.964 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:39.962+0000 7f4f2805c640 1 -- 172.21.15.92:0/36554760 wait complete. 2024-09-19T09:04:40.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 475.0 s, 3087.6 tps, lat 32.285 ms stddev 35.357 2024-09-19T09:04:41.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:41 smithi092 ceph-mon[31407]: pgmap v576: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 9.2 MiB/s wr, 934 op/s 2024-09-19T09:04:41.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:41 smithi167 ceph-mon[35359]: pgmap v576: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 9.2 MiB/s wr, 934 op/s 2024-09-19T09:04:41.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:41 smithi190 ceph-mon[35358]: pgmap v576: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 9.2 MiB/s wr, 934 op/s 2024-09-19T09:04:43.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:43 smithi167 ceph-mon[35359]: pgmap v577: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 8.3 MiB/s wr, 868 op/s 2024-09-19T09:04:43.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:43 smithi190 ceph-mon[35358]: pgmap v577: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 8.3 MiB/s wr, 868 op/s 2024-09-19T09:04:44.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:43 smithi092 ceph-mon[31407]: pgmap v577: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 8.3 MiB/s wr, 868 op/s 2024-09-19T09:04:45.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 480.0 s, 2446.6 tps, lat 40.915 ms stddev 46.667 2024-09-19T09:04:45.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:45 smithi167 ceph-mon[35359]: pgmap v578: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 9.1 MiB/s wr, 927 op/s 2024-09-19T09:04:45.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:45 smithi190 ceph-mon[35358]: pgmap v578: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 9.1 MiB/s wr, 927 op/s 2024-09-19T09:04:46.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:45 smithi092 ceph-mon[31407]: pgmap v578: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 9.1 MiB/s wr, 927 op/s 2024-09-19T09:04:47.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:47 smithi167 ceph-mon[35359]: pgmap v579: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 6.4 MiB/s wr, 673 op/s 2024-09-19T09:04:47.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:47 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:04:47.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:47 smithi190 ceph-mon[35358]: pgmap v579: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 6.4 MiB/s wr, 673 op/s 2024-09-19T09:04:47.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:47 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:04:48.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:47 smithi092 ceph-mon[31407]: pgmap v579: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 6.4 MiB/s wr, 673 op/s 2024-09-19T09:04:48.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:47 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:04:48.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:48 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:04:48.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:48 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:04:48.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:48 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:04:48.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:48 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:04:48.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:48 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:04:48.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:48 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:04:49.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:48 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:04:49.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:48 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:04:49.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:48 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:04:49.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:49 smithi167 ceph-mon[35359]: pgmap v580: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6.5 MiB/s wr, 674 op/s 2024-09-19T09:04:49.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:49 smithi190 ceph-mon[35358]: pgmap v580: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6.5 MiB/s wr, 674 op/s 2024-09-19T09:04:50.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:49 smithi092 ceph-mon[31407]: pgmap v580: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6.5 MiB/s wr, 674 op/s 2024-09-19T09:04:50.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 485.0 s, 2746.8 tps, lat 36.153 ms stddev 38.015 2024-09-19T09:04:51.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:51 smithi167 ceph-mon[35359]: pgmap v581: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 6.8 MiB/s wr, 711 op/s 2024-09-19T09:04:51.873 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:51 smithi092 ceph-mon[31407]: pgmap v581: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 6.8 MiB/s wr, 711 op/s 2024-09-19T09:04:51.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:51 smithi190 ceph-mon[35358]: pgmap v581: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 6.8 MiB/s wr, 711 op/s 2024-09-19T09:04:53.091 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.089+0000 7fede5453640 1 -- 172.21.15.92:0/1522866764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fede0101d90 msgr2=0x7fede0108620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:53.091 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.089+0000 7fede5453640 1 --2- 172.21.15.92:0/1522866764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fede0101d90 0x7fede0108620 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fedd001a910 tx=0x7fedd003b420 comp rx=0 tx=0).stop 2024-09-19T09:04:53.096 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.095+0000 7fede5453640 1 -- 172.21.15.92:0/1522866764 shutdown_connections 2024-09-19T09:04:53.096 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.095+0000 7fede5453640 1 --2- 172.21.15.92:0/1522866764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fede0101d90 0x7fede0108620 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.096 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.095+0000 7fede5453640 1 --2- 172.21.15.92:0/1522866764 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fede01013d0 0x7fede0101850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.096 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.095+0000 7fede5453640 1 --2- 172.21.15.92:0/1522866764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fede01001e0 0x7fede01005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.096 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.095+0000 7fede5453640 1 -- 172.21.15.92:0/1522866764 >> 172.21.15.92:0/1522866764 conn(0x7fede00fb980 msgr2=0x7fede00fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:53.097 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.097+0000 7fede5453640 1 -- 172.21.15.92:0/1522866764 shutdown_connections 2024-09-19T09:04:53.097 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.097+0000 7fede5453640 1 -- 172.21.15.92:0/1522866764 wait complete. 2024-09-19T09:04:53.098 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.098+0000 7fede5453640 1 Processor -- start 2024-09-19T09:04:53.099 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.098+0000 7fede5453640 1 -- start start 2024-09-19T09:04:53.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.098+0000 7fede5453640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fede01001e0 0x7fede010b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:53.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.098+0000 7fede5453640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fede01013d0 0x7fede010d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:53.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.098+0000 7fede5453640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fede0101d90 0x7fede010fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:53.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.098+0000 7fede5453640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fede0072490 con 0x7fede01001e0 2024-09-19T09:04:53.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.098+0000 7fede5453640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fede0072310 con 0x7fede0101d90 2024-09-19T09:04:53.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.098+0000 7fede5453640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fede0072610 con 0x7fede01013d0 2024-09-19T09:04:53.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.099+0000 7feddeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fede01001e0 0x7fede010b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:53.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.099+0000 7feddeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fede01001e0 0x7fede010b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52730/0 (socket says 172.21.15.92:52730) 2024-09-19T09:04:53.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.099+0000 7feddeffd640 1 -- 172.21.15.92:0/3447810048 learned_addr learned my addr 172.21.15.92:0/3447810048 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:53.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.099+0000 7fedde7fc640 1 --2- 172.21.15.92:0/3447810048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fede01013d0 0x7fede010d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:53.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.099+0000 7feddf7fe640 1 --2- 172.21.15.92:0/3447810048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fede0101d90 0x7fede010fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:53.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.099+0000 7fedde7fc640 1 -- 172.21.15.92:0/3447810048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fede0101d90 msgr2=0x7fede010fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:53.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.099+0000 7fedde7fc640 1 --2- 172.21.15.92:0/3447810048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fede0101d90 0x7fede010fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.099+0000 7fedde7fc640 1 -- 172.21.15.92:0/3447810048 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fede01001e0 msgr2=0x7fede010b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:53.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.099+0000 7fedde7fc640 1 --2- 172.21.15.92:0/3447810048 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fede01001e0 0x7fede010b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.099+0000 7fedde7fc640 1 -- 172.21.15.92:0/3447810048 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede0110360 con 0x7fede01013d0 2024-09-19T09:04:53.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.100+0000 7fedde7fc640 1 --2- 172.21.15.92:0/3447810048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fede01013d0 0x7fede010d7d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fedd800e9f0 tx=0x7fedd800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:53.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.100+0000 7fedc7fff640 1 -- 172.21.15.92:0/3447810048 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd800cd80 con 0x7fede01013d0 2024-09-19T09:04:53.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.100+0000 7fedc7fff640 1 -- 172.21.15.92:0/3447810048 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fedd8005020 con 0x7fede01013d0 2024-09-19T09:04:53.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.100+0000 7fedc7fff640 1 -- 172.21.15.92:0/3447810048 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd80116b0 con 0x7fede01013d0 2024-09-19T09:04:53.103 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.101+0000 7fede5453640 1 -- 172.21.15.92:0/3447810048 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fede0110650 con 0x7fede01013d0 2024-09-19T09:04:53.103 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.101+0000 7fede5453640 1 -- 172.21.15.92:0/3447810048 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fede0110bd0 con 0x7fede01013d0 2024-09-19T09:04:53.104 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.104+0000 7fedc7fff640 1 -- 172.21.15.92:0/3447810048 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fedd8011910 con 0x7fede01013d0 2024-09-19T09:04:53.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.105+0000 7fede81ef740 1 Processor -- start 2024-09-19T09:04:53.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.105+0000 7fede81ef740 1 -- start start 2024-09-19T09:04:53.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.105+0000 7fede81ef740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c08cfe9a0 0x557c08cfeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:53.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.105+0000 7fede81ef740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c08cff2e0 0x557c08d03da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:53.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.105+0000 7fede81ef740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557c08d04370 0x557c08d06830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:53.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.105+0000 7fede81ef740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557c08c622f0 con 0x557c08cfe9a0 2024-09-19T09:04:53.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.105+0000 7fede81ef740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x557c08c0a270 con 0x557c08cff2e0 2024-09-19T09:04:53.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.105+0000 7fede81ef740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x557c08c5e2b0 con 0x557c08d04370 2024-09-19T09:04:53.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.106+0000 7fedde7fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557c08d04370 0x557c08d06830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:53.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.106+0000 7fedde7fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557c08d04370 0x557c08d06830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:39358/0 (socket says 172.21.15.92:39358) 2024-09-19T09:04:53.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.106+0000 7fedde7fc640 1 -- 172.21.15.92:0/2106641786 learned_addr learned my addr 172.21.15.92:0/2106641786 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:53.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.106+0000 7feddeffd640 1 --2- 172.21.15.92:0/2106641786 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c08cff2e0 0x557c08d03da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:53.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.106+0000 7fedc7fff640 1 --2- 172.21.15.92:0/3447810048 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fedc80a34a0 0x7fedc80a5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:53.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.106+0000 7feddf7fe640 1 --2- 172.21.15.92:0/2106641786 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c08cfe9a0 0x557c08cfeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:53.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.106+0000 7fedde7fc640 1 -- 172.21.15.92:0/2106641786 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c08cff2e0 msgr2=0x557c08d03da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:53.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.106+0000 7fedde7fc640 1 --2- 172.21.15.92:0/2106641786 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c08cff2e0 0x557c08d03da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.106+0000 7fedde7fc640 1 -- 172.21.15.92:0/2106641786 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c08cfe9a0 msgr2=0x557c08cfeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:53.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.106+0000 7fedde7fc640 1 --2- 172.21.15.92:0/2106641786 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c08cfe9a0 0x557c08cfeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.106+0000 7fedde7fc640 1 -- 172.21.15.92:0/2106641786 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c08c09340 con 0x557c08d04370 2024-09-19T09:04:53.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.106+0000 7fedde7fc640 1 --2- 172.21.15.92:0/2106641786 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557c08d04370 0x557c08d06830 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fedd80d5c20 tx=0x7fedd80d7670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a826656f4103d8c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:53.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.107+0000 7fedc57fa640 1 -- 172.21.15.92:0/2106641786 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd8098120 con 0x557c08d04370 2024-09-19T09:04:53.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.107+0000 7feddf7fe640 1 --2- 172.21.15.92:0/3447810048 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fedc80a34a0 0x7fedc80a5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:53.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.107+0000 7fedc57fa640 1 -- 172.21.15.92:0/2106641786 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fedd809c580 con 0x557c08d04370 2024-09-19T09:04:53.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.107+0000 7fedc7fff640 1 -- 172.21.15.92:0/3447810048 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fedd80cf8a0 con 0x7fede01013d0 2024-09-19T09:04:53.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.107+0000 7fedc57fa640 1 -- 172.21.15.92:0/2106641786 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd80b8c70 con 0x557c08d04370 2024-09-19T09:04:53.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.107+0000 7fede81ef740 1 -- 172.21.15.92:0/2106641786 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557c08d04370 msgr2=0x557c08d06830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:53.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.107+0000 7feddf7fe640 1 --2- 172.21.15.92:0/3447810048 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fedc80a34a0 0x7fedc80a5960 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fedd0006010 tx=0x7fedd001a270 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:53.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.108+0000 7fede81ef740 1 --2- 172.21.15.92:0/2106641786 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557c08d04370 0x557c08d06830 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fedd80d5c20 tx=0x7fedd80d7670 comp rx=0 tx=0).stop 2024-09-19T09:04:53.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.108+0000 7fede81ef740 1 -- 172.21.15.92:0/2106641786 shutdown_connections 2024-09-19T09:04:53.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.108+0000 7fede81ef740 1 --2- 172.21.15.92:0/2106641786 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557c08d04370 0x557c08d06830 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.108+0000 7fede81ef740 1 --2- 172.21.15.92:0/2106641786 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c08cff2e0 0x557c08d03da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.118 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.108+0000 7fede81ef740 1 --2- 172.21.15.92:0/2106641786 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c08cfe9a0 0x557c08cfeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.118 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.108+0000 7fede81ef740 1 -- 172.21.15.92:0/2106641786 >> 172.21.15.92:0/2106641786 conn(0x557c08cfa010 msgr2=0x557c08cfa410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:53.118 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.108+0000 7fede81ef740 1 -- 172.21.15.92:0/2106641786 shutdown_connections 2024-09-19T09:04:53.118 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.108+0000 7fede81ef740 1 -- 172.21.15.92:0/2106641786 wait complete. 2024-09-19T09:04:53.118 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.108+0000 7fede81ef740 1 -- start start 2024-09-19T09:04:53.118 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.108+0000 7fede81ef740 1 Processor -- start 2024-09-19T09:04:53.118 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.109+0000 7fede81ef740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557c08cfe9a0 0x557c08d08bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:53.118 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.109+0000 7fede81ef740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c08cff2e0 0x557c08d090f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:53.118 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.109+0000 7fede81ef740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c08d04370 0x557c08d10130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:53.118 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.109+0000 7fede81ef740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557c08d07380 con 0x557c08cff2e0 2024-09-19T09:04:53.118 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.109+0000 7fede81ef740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x557c08beb290 con 0x557c08d04370 2024-09-19T09:04:53.118 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.109+0000 7fede81ef740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x557c08d07500 con 0x557c08cfe9a0 2024-09-19T09:04:53.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.109+0000 7fede81ef740 10 client.0 _ll_register_callbacks cb 0x557c08c1c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:53.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.109+0000 7feddeffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557c08cfe9a0 0x557c08d08bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:53.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.109+0000 7feddeffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557c08cfe9a0 0x557c08d08bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:39366/0 (socket says 172.21.15.92:39366) 2024-09-19T09:04:53.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.109+0000 7feddeffd640 1 -- 172.21.15.92:0/1187020780 learned_addr learned my addr 172.21.15.92:0/1187020780 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:53.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.109+0000 7feddf7fe640 1 --2- 172.21.15.92:0/1187020780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c08d04370 0x557c08d10130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:53.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.109+0000 7feddeffd640 1 -- 172.21.15.92:0/1187020780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c08d04370 msgr2=0x557c08d10130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:53.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.109+0000 7feddeffd640 1 --2- 172.21.15.92:0/1187020780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c08d04370 0x557c08d10130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.109+0000 7feddeffd640 1 -- 172.21.15.92:0/1187020780 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c08cff2e0 msgr2=0x557c08d090f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:53.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.109+0000 7fedde7fc640 1 --2- 172.21.15.92:0/1187020780 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c08cff2e0 0x557c08d090f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:53.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.109+0000 7feddeffd640 1 --2- 172.21.15.92:0/1187020780 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c08cff2e0 0x557c08d090f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.109+0000 7feddeffd640 1 -- 172.21.15.92:0/1187020780 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c08975210 con 0x557c08cfe9a0 2024-09-19T09:04:53.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.110+0000 7fedde7fc640 1 --2- 172.21.15.92:0/1187020780 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c08cff2e0 0x557c08d090f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:53.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.110+0000 7feddeffd640 1 --2- 172.21.15.92:0/1187020780 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557c08cfe9a0 0x557c08d08bb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fedd4010500 tx=0x7fedd40109c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22196ec05f06e9c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:53.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.110+0000 7fedc2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:04:53.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.110+0000 7fedc2ff5640 1 -- 172.21.15.92:0/1187020780 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd4018070 con 0x557c08cfe9a0 2024-09-19T09:04:53.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.110+0000 7fede81ef740 1 -- 172.21.15.92:0/1187020780 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fedd809c580 con 0x557c08cfe9a0 2024-09-19T09:04:53.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.110+0000 7fedc2ff5640 1 -- 172.21.15.92:0/1187020780 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fedd4014640 con 0x557c08cfe9a0 2024-09-19T09:04:53.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.110+0000 7fedc2ff5640 1 -- 172.21.15.92:0/1187020780 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fedd4024050 con 0x557c08cfe9a0 2024-09-19T09:04:53.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.110+0000 7fede81ef740 10 client.26551 fetch_fsmap learned FSMap version 19 2024-09-19T09:04:53.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.110+0000 7fede81ef740 1 -- 172.21.15.92:0/1187020780 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x557c08a41620 con 0x557c08cfe9a0 2024-09-19T09:04:53.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.110+0000 7fedc2ff5640 1 -- 172.21.15.92:0/1187020780 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fedd809c580 con 0x557c08cfe9a0 2024-09-19T09:04:53.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.110+0000 7fedc2ff5640 1 -- 172.21.15.92:0/1187020780 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fedd4012a70 con 0x557c08cfe9a0 2024-09-19T09:04:53.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.110+0000 7fede81ef740 10 client.26551 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:04:53.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.110+0000 7fede81ef740 10 client.26551 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:04:53.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.111+0000 7fede81ef740 20 client.26551 populate_metadata read hostname 'smithi092' 2024-09-19T09:04:53.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.111+0000 7fede81ef740 1 --2- 172.21.15.92:0/1187020780 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557c08d148d0 0x557c08d16d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:53.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.111+0000 7fede81ef740 4 client.26551 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:53.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.111+0000 7fede81ef740 1 -- 172.21.15.92:0/1187020780 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c08c6fa20 con 0x557c08d148d0 2024-09-19T09:04:53.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.112+0000 7fedde7fc640 1 --2- 172.21.15.92:0/1187020780 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557c08d148d0 0x557c08d16d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:53.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.112+0000 7fedde7fc640 1 --2- 172.21.15.92:0/1187020780 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557c08d148d0 0x557c08d16d70 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78f858848d172821 server_cookie=a02b29a662ccad77 in_seq=0 out_seq=0 2024-09-19T09:04:53.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.112+0000 7fedc2ff5640 10 client.26551 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:53.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.113+0000 7fedc2ff5640 1 -- 172.21.15.92:0/1187020780 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557c08c6fa20 con 0x557c08d148d0 2024-09-19T09:04:53.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.113+0000 7fedc2ff5640 10 client.26551 handle_command_reply: tid=0 2024-09-19T09:04:53.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.113+0000 7fede81ef740 1 client.26551 shutdown 2024-09-19T09:04:53.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.113+0000 7fede81ef740 1 -- 172.21.15.92:0/1187020780 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557c08cfe9a0 msgr2=0x557c08d08bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:53.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.113+0000 7fede81ef740 1 --2- 172.21.15.92:0/1187020780 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557c08cfe9a0 0x557c08d08bb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fedd4010500 tx=0x7fedd40109c0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.113+0000 7fede81ef740 1 -- 172.21.15.92:0/1187020780 shutdown_connections 2024-09-19T09:04:53.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.113+0000 7fede81ef740 1 --2- 172.21.15.92:0/1187020780 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557c08d148d0 0x557c08d16d70 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.113+0000 7fede81ef740 1 --2- 172.21.15.92:0/1187020780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c08d04370 0x557c08d10130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.113+0000 7fede81ef740 1 --2- 172.21.15.92:0/1187020780 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c08cff2e0 0x557c08d090f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.113+0000 7fedc2ff5640 0 client.26551 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:53.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.113+0000 7fede81ef740 1 --2- 172.21.15.92:0/1187020780 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557c08cfe9a0 0x557c08d08bb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.113+0000 7fede81ef740 1 -- 172.21.15.92:0/1187020780 >> 172.21.15.92:0/1187020780 conn(0x557c08cfa010 msgr2=0x557c08cfb820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:53.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.113+0000 7fede81ef740 1 -- 172.21.15.92:0/1187020780 shutdown_connections 2024-09-19T09:04:53.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.113+0000 7fede81ef740 1 -- 172.21.15.92:0/1187020780 wait complete. 2024-09-19T09:04:53.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.113+0000 7fede81ef740 20 client.26551 trim_cache size 0 max 16384 2024-09-19T09:04:53.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.133+0000 7fede81ef740 1 Processor -- start 2024-09-19T09:04:53.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.133+0000 7fede81ef740 1 -- start start 2024-09-19T09:04:53.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.133+0000 7fede81ef740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c08cfe9a0 0x557c08d08960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:53.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.133+0000 7fede81ef740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c08cff2e0 0x557c08d100f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:53.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.133+0000 7fede81ef740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557c08d04370 0x557c08d08ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:53.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.134+0000 7fedde7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c08cff2e0 0x557c08d100f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:53.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.134+0000 7feddeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c08cfe9a0 0x557c08d08960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:53.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.134+0000 7fedde7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c08cff2e0 0x557c08d100f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:35910/0 (socket says 172.21.15.92:35910) 2024-09-19T09:04:53.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.134+0000 7feddeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c08cfe9a0 0x557c08d08960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52768/0 (socket says 172.21.15.92:52768) 2024-09-19T09:04:53.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.134+0000 7fede81ef740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fedcc00c490 con 0x557c08cfe9a0 2024-09-19T09:04:53.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.134+0000 7fede81ef740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fedcc00ed30 con 0x557c08cff2e0 2024-09-19T09:04:53.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.134+0000 7fede81ef740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fedcc00cb20 con 0x557c08d04370 2024-09-19T09:04:53.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.134+0000 7fedde7fc640 1 -- 172.21.15.92:0/886672401 learned_addr learned my addr 172.21.15.92:0/886672401 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:53.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.134+0000 7feddf7fe640 1 --2- 172.21.15.92:0/886672401 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557c08d04370 0x557c08d08ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:53.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.134+0000 7fedde7fc640 1 -- 172.21.15.92:0/886672401 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557c08d04370 msgr2=0x557c08d08ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:53.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.134+0000 7fedde7fc640 1 --2- 172.21.15.92:0/886672401 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557c08d04370 0x557c08d08ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.134+0000 7fedde7fc640 1 -- 172.21.15.92:0/886672401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c08cfe9a0 msgr2=0x557c08d08960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:53.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.134+0000 7fedde7fc640 1 --2- 172.21.15.92:0/886672401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c08cfe9a0 0x557c08d08960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.134+0000 7fedde7fc640 1 -- 172.21.15.92:0/886672401 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c08cff7c0 con 0x557c08cff2e0 2024-09-19T09:04:53.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.134+0000 7feddeffd640 1 --2- 172.21.15.92:0/886672401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c08cfe9a0 0x557c08d08960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:53.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.134+0000 7feddf7fe640 1 --2- 172.21.15.92:0/886672401 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557c08d04370 0x557c08d08ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:53.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.135+0000 7fedde7fc640 1 --2- 172.21.15.92:0/886672401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c08cff2e0 0x557c08d100f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fedd80d5bf0 tx=0x7fedd80bc040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f0eed3cbdb73c8e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:53.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.135+0000 7fedc4ff9640 1 -- 172.21.15.92:0/886672401 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd801f040 con 0x557c08cff2e0 2024-09-19T09:04:53.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.135+0000 7fedc4ff9640 1 -- 172.21.15.92:0/886672401 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fedd809c580 con 0x557c08cff2e0 2024-09-19T09:04:53.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.135+0000 7fedc4ff9640 1 -- 172.21.15.92:0/886672401 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd80b79d0 con 0x557c08cff2e0 2024-09-19T09:04:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.136+0000 7fede81ef740 1 -- 172.21.15.92:0/886672401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c08cff2e0 msgr2=0x557c08d100f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.136+0000 7fede81ef740 1 --2- 172.21.15.92:0/886672401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c08cff2e0 0x557c08d100f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fedd80d5bf0 tx=0x7fedd80bc040 comp rx=0 tx=0).stop 2024-09-19T09:04:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.136+0000 7fede81ef740 1 -- 172.21.15.92:0/886672401 shutdown_connections 2024-09-19T09:04:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.136+0000 7fede81ef740 1 --2- 172.21.15.92:0/886672401 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557c08d04370 0x557c08d08ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.136+0000 7fede81ef740 1 --2- 172.21.15.92:0/886672401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c08cff2e0 0x557c08d100f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.136+0000 7fede81ef740 1 --2- 172.21.15.92:0/886672401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c08cfe9a0 0x557c08d08960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.136+0000 7fede81ef740 1 -- 172.21.15.92:0/886672401 >> 172.21.15.92:0/886672401 conn(0x557c08cfa010 msgr2=0x557c08d003c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.136+0000 7fede81ef740 1 -- 172.21.15.92:0/886672401 shutdown_connections 2024-09-19T09:04:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.136+0000 7fede81ef740 1 -- 172.21.15.92:0/886672401 wait complete. 2024-09-19T09:04:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.136+0000 7fede81ef740 1 -- start start 2024-09-19T09:04:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.137+0000 7fede81ef740 1 Processor -- start 2024-09-19T09:04:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.137+0000 7fede81ef740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c08cfe9a0 0x557c08d0b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.137+0000 7fede81ef740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c08cff2e0 0x557c08d0ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.137+0000 7fede81ef740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557c08d04370 0x557c08d0e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.137+0000 7fede81ef740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fedcc00d1f0 con 0x557c08cfe9a0 2024-09-19T09:04:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.137+0000 7fede81ef740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fedcc00e660 con 0x557c08cff2e0 2024-09-19T09:04:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.137+0000 7fede81ef740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fedcc00d8c0 con 0x557c08d04370 2024-09-19T09:04:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.137+0000 7fede81ef740 10 client.0 _ll_register_callbacks cb 0x7fedd4007510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.137+0000 7feddeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c08cfe9a0 0x557c08d0b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.137+0000 7fedde7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c08cff2e0 0x557c08d0ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.137+0000 7feddeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c08cfe9a0 0x557c08d0b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52784/0 (socket says 172.21.15.92:52784) 2024-09-19T09:04:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.137+0000 7feddeffd640 1 -- 172.21.15.92:0/1514870986 learned_addr learned my addr 172.21.15.92:0/1514870986 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:04:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.137+0000 7feddf7fe640 1 --2- 172.21.15.92:0/1514870986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557c08d04370 0x557c08d0e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.137+0000 7feddeffd640 1 -- 172.21.15.92:0/1514870986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557c08d04370 msgr2=0x557c08d0e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.137+0000 7feddeffd640 1 --2- 172.21.15.92:0/1514870986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557c08d04370 0x557c08d0e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.137+0000 7feddeffd640 1 -- 172.21.15.92:0/1514870986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c08cff2e0 msgr2=0x557c08d0ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.137+0000 7feddeffd640 1 --2- 172.21.15.92:0/1514870986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c08cff2e0 0x557c08d0ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.137+0000 7feddeffd640 1 -- 172.21.15.92:0/1514870986 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c08d0ef90 con 0x557c08cfe9a0 2024-09-19T09:04:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.137+0000 7fedde7fc640 1 --2- 172.21.15.92:0/1514870986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c08cff2e0 0x557c08d0ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.137+0000 7feddeffd640 1 --2- 172.21.15.92:0/1514870986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c08cfe9a0 0x557c08d0b4e0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fedd4012e10 tx=0x7fedd4006d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82c447b83d7483c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.137+0000 7fedc2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:04:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.138+0000 7fedc2ff5640 1 -- 172.21.15.92:0/1514870986 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd402d060 con 0x557c08cfe9a0 2024-09-19T09:04:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.138+0000 7fede81ef740 1 -- 172.21.15.92:0/1514870986 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fedd809c580 con 0x557c08cfe9a0 2024-09-19T09:04:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.138+0000 7fedc2ff5640 1 -- 172.21.15.92:0/1514870986 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fedd4013720 con 0x557c08cfe9a0 2024-09-19T09:04:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.138+0000 7fedc2ff5640 1 -- 172.21.15.92:0/1514870986 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fedd4018070 con 0x557c08cfe9a0 2024-09-19T09:04:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.138+0000 7fede81ef740 10 client.17331 fetch_fsmap learned FSMap version 19 2024-09-19T09:04:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.138+0000 7fede81ef740 1 -- 172.21.15.92:0/1514870986 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x557c08d10370 con 0x557c08cfe9a0 2024-09-19T09:04:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.139+0000 7fedc2ff5640 1 -- 172.21.15.92:0/1514870986 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fedd809c580 con 0x557c08cfe9a0 2024-09-19T09:04:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.139+0000 7fedc2ff5640 1 -- 172.21.15.92:0/1514870986 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fedd4032070 con 0x557c08cfe9a0 2024-09-19T09:04:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.139+0000 7fede81ef740 10 client.17331 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:04:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.139+0000 7fede81ef740 10 client.17331 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:04:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.139+0000 7fede81ef740 20 client.17331 populate_metadata read hostname 'smithi092' 2024-09-19T09:04:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.139+0000 7fede81ef740 1 --2- 172.21.15.92:0/1514870986 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557c08d7fd40 0x557c08d82160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.139+0000 7fede81ef740 4 client.17331 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:04:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.139+0000 7fede81ef740 1 -- 172.21.15.92:0/1514870986 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557c08c69d70 con 0x557c08d7fd40 2024-09-19T09:04:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.140+0000 7fedde7fc640 1 --2- 172.21.15.92:0/1514870986 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557c08d7fd40 0x557c08d82160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.140+0000 7fedde7fc640 1 --2- 172.21.15.92:0/1514870986 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557c08d7fd40 0x557c08d82160 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd6e800ced7b0df8 server_cookie=4620be5706ded8ae in_seq=0 out_seq=0 2024-09-19T09:04:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.140+0000 7fedc2ff5640 10 client.17331 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:53.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.166+0000 7fedc2ff5640 1 -- 172.21.15.92:0/1514870986 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557c08c69d70 con 0x557c08d7fd40 2024-09-19T09:04:53.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.166+0000 7fedc2ff5640 10 client.17331 handle_command_reply: tid=0 2024-09-19T09:04:53.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.166+0000 7fede81ef740 1 client.17331 shutdown 2024-09-19T09:04:53.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.166+0000 7fede81ef740 1 -- 172.21.15.92:0/1514870986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c08cfe9a0 msgr2=0x557c08d0b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.166+0000 7fede81ef740 1 --2- 172.21.15.92:0/1514870986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c08cfe9a0 0x557c08d0b4e0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fedd4012e10 tx=0x7fedd4006d90 comp rx=0 tx=0).stop 2024-09-19T09:04:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.166+0000 7fede81ef740 1 -- 172.21.15.92:0/1514870986 shutdown_connections 2024-09-19T09:04:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.166+0000 7fede81ef740 1 --2- 172.21.15.92:0/1514870986 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557c08d7fd40 0x557c08d82160 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.166+0000 7fede81ef740 1 --2- 172.21.15.92:0/1514870986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557c08d04370 0x557c08d0e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.166+0000 7fede81ef740 1 --2- 172.21.15.92:0/1514870986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c08cff2e0 0x557c08d0ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.166+0000 7fedc2ff5640 0 client.17331 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:04:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.166+0000 7fede81ef740 1 --2- 172.21.15.92:0/1514870986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557c08cfe9a0 0x557c08d0b4e0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.167+0000 7fede81ef740 1 -- 172.21.15.92:0/1514870986 >> 172.21.15.92:0/1514870986 conn(0x557c08cfa010 msgr2=0x557c08d08960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.167+0000 7fede81ef740 1 -- 172.21.15.92:0/1514870986 shutdown_connections 2024-09-19T09:04:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.167+0000 7fede81ef740 1 -- 172.21.15.92:0/1514870986 wait complete. 2024-09-19T09:04:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.167+0000 7fede81ef740 20 client.17331 trim_cache size 0 max 16384 2024-09-19T09:04:53.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:04:53.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:04:53.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:04:53.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:04:53.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.167+0000 7fede5453640 1 -- 172.21.15.92:0/3447810048 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fedc80a34a0 msgr2=0x7fedc80a5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:53.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.167+0000 7fede5453640 1 --2- 172.21.15.92:0/3447810048 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fedc80a34a0 0x7fedc80a5960 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fedd0006010 tx=0x7fedd001a270 comp rx=0 tx=0).stop 2024-09-19T09:04:53.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.167+0000 7fede5453640 1 -- 172.21.15.92:0/3447810048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fede01013d0 msgr2=0x7fede010d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:53.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.167+0000 7fede5453640 1 --2- 172.21.15.92:0/3447810048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fede01013d0 0x7fede010d7d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fedd800e9f0 tx=0x7fedd800eeb0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.167+0000 7fede5453640 1 -- 172.21.15.92:0/3447810048 shutdown_connections 2024-09-19T09:04:53.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.168+0000 7fede5453640 1 --2- 172.21.15.92:0/3447810048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fede0101d90 0x7fede010fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.168+0000 7fede5453640 1 --2- 172.21.15.92:0/3447810048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fede01013d0 0x7fede010d7d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.168+0000 7fede5453640 1 --2- 172.21.15.92:0/3447810048 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fedc80a34a0 0x7fedc80a5960 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.168+0000 7fede5453640 1 --2- 172.21.15.92:0/3447810048 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fede01001e0 0x7fede010b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.171 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.168+0000 7fede5453640 1 -- 172.21.15.92:0/3447810048 >> 172.21.15.92:0/3447810048 conn(0x7fede00fb980 msgr2=0x7fede00fc580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:53.171 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.168+0000 7fede5453640 1 -- 172.21.15.92:0/3447810048 shutdown_connections 2024-09-19T09:04:53.171 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:04:53.168+0000 7fede5453640 1 -- 172.21.15.92:0/3447810048 wait complete. 2024-09-19T09:04:53.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:53 smithi167 ceph-mon[35359]: pgmap v582: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6.1 MiB/s wr, 647 op/s 2024-09-19T09:04:53.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:53 smithi190 ceph-mon[35358]: pgmap v582: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6.1 MiB/s wr, 647 op/s 2024-09-19T09:04:54.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:53 smithi092 ceph-mon[31407]: pgmap v582: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6.1 MiB/s wr, 647 op/s 2024-09-19T09:04:55.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 490.0 s, 3882.8 tps, lat 25.995 ms stddev 30.323 2024-09-19T09:04:55.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:55 smithi167 ceph-mon[35359]: pgmap v583: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.4 MiB/s wr, 811 op/s 2024-09-19T09:04:55.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:55 smithi190 ceph-mon[35358]: pgmap v583: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.4 MiB/s wr, 811 op/s 2024-09-19T09:04:56.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:55 smithi092 ceph-mon[31407]: pgmap v583: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.4 MiB/s wr, 811 op/s 2024-09-19T09:04:57.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:57 smithi167 ceph-mon[35359]: pgmap v584: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.3 MiB/s wr, 685 op/s 2024-09-19T09:04:57.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:57 smithi190 ceph-mon[35358]: pgmap v584: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.3 MiB/s wr, 685 op/s 2024-09-19T09:04:58.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:57 smithi092 ceph-mon[31407]: pgmap v584: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.3 MiB/s wr, 685 op/s 2024-09-19T09:04:59.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:04:59 smithi167 ceph-mon[35359]: pgmap v585: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.8 MiB/s wr, 795 op/s 2024-09-19T09:04:59.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:04:59 smithi190 ceph-mon[35358]: pgmap v585: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.8 MiB/s wr, 795 op/s 2024-09-19T09:05:00.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:04:59 smithi092 ceph-mon[31407]: pgmap v585: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.8 MiB/s wr, 795 op/s 2024-09-19T09:05:00.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 495.0 s, 3048.8 tps, lat 32.666 ms stddev 37.048 2024-09-19T09:05:01.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:01 smithi167 ceph-mon[35359]: pgmap v586: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 9.5 MiB/s wr, 848 op/s 2024-09-19T09:05:01.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:01 smithi190 ceph-mon[35358]: pgmap v586: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 9.5 MiB/s wr, 848 op/s 2024-09-19T09:05:02.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:01 smithi092 ceph-mon[31407]: pgmap v586: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 9.5 MiB/s wr, 848 op/s 2024-09-19T09:05:03.232 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:05:03.597 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:03.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:03 smithi167 ceph-mon[35359]: pgmap v587: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.0 MiB/s wr, 729 op/s 2024-09-19T09:05:03.871 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:03 smithi092 ceph-mon[31407]: pgmap v587: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.0 MiB/s wr, 729 op/s 2024-09-19T09:05:03.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:03 smithi190 ceph-mon[35358]: pgmap v587: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.0 MiB/s wr, 729 op/s 2024-09-19T09:05:04.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.150+0000 7fb72d3bf640 1 -- 172.21.15.92:0/885403286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb728102570 msgr2=0x7fb7281029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:04.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.150+0000 7fb72d3bf640 1 --2- 172.21.15.92:0/885403286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb728102570 0x7fb7281029b0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fb71c01a910 tx=0x7fb71c03b4e0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.150+0000 7fb72d3bf640 1 -- 172.21.15.92:0/885403286 shutdown_connections 2024-09-19T09:05:04.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.150+0000 7fb72d3bf640 1 --2- 172.21.15.92:0/885403286 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb728102ef0 0x7fb72810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.150+0000 7fb72d3bf640 1 --2- 172.21.15.92:0/885403286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb728102570 0x7fb7281029b0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.150+0000 7fb72d3bf640 1 --2- 172.21.15.92:0/885403286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb728100e20 0x7fb728101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.150+0000 7fb72d3bf640 1 -- 172.21.15.92:0/885403286 >> 172.21.15.92:0/885403286 conn(0x7fb7280fc7d0 msgr2=0x7fb7280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:04.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.150+0000 7fb72d3bf640 1 -- 172.21.15.92:0/885403286 shutdown_connections 2024-09-19T09:05:04.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.150+0000 7fb72d3bf640 1 -- 172.21.15.92:0/885403286 wait complete. 2024-09-19T09:05:04.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.151+0000 7fb72d3bf640 1 Processor -- start 2024-09-19T09:05:04.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.151+0000 7fb72d3bf640 1 -- start start 2024-09-19T09:05:04.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.152+0000 7fb72d3bf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb728100e20 0x7fb72810d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:04.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.152+0000 7fb72d3bf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb728102570 0x7fb728108880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:04.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.152+0000 7fb72d3bf640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb728102ef0 0x7fb728108dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:04.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.152+0000 7fb726ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb728100e20 0x7fb72810d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:04.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.152+0000 7fb72d3bf640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb72806e670 con 0x7fb728100e20 2024-09-19T09:05:04.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.152+0000 7fb72d3bf640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb72806e4f0 con 0x7fb728102570 2024-09-19T09:05:04.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.152+0000 7fb72d3bf640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb72806e7f0 con 0x7fb728102ef0 2024-09-19T09:05:04.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.152+0000 7fb726ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb728100e20 0x7fb72810d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55190/0 (socket says 172.21.15.92:55190) 2024-09-19T09:05:04.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.152+0000 7fb726ffd640 1 -- 172.21.15.92:0/1458915587 learned_addr learned my addr 172.21.15.92:0/1458915587 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:04.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.152+0000 7fb7267fc640 1 --2- 172.21.15.92:0/1458915587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb728102570 0x7fb728108880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:04.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.152+0000 7fb7277fe640 1 --2- 172.21.15.92:0/1458915587 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb728102ef0 0x7fb728108dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:04.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.152+0000 7fb726ffd640 1 -- 172.21.15.92:0/1458915587 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb728102ef0 msgr2=0x7fb728108dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:04.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.152+0000 7fb726ffd640 1 --2- 172.21.15.92:0/1458915587 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb728102ef0 0x7fb728108dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.152+0000 7fb726ffd640 1 -- 172.21.15.92:0/1458915587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb728102570 msgr2=0x7fb728108880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:04.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.152+0000 7fb726ffd640 1 --2- 172.21.15.92:0/1458915587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb728102570 0x7fb728108880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.153+0000 7fb726ffd640 1 -- 172.21.15.92:0/1458915587 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb728109660 con 0x7fb728100e20 2024-09-19T09:05:04.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.153+0000 7fb726ffd640 1 --2- 172.21.15.92:0/1458915587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb728100e20 0x7fb72810d7f0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fb71800b450 tx=0x7fb71800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:04.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.153+0000 7fb70ffff640 1 -- 172.21.15.92:0/1458915587 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb718015020 con 0x7fb728100e20 2024-09-19T09:05:04.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.153+0000 7fb72d3bf640 1 -- 172.21.15.92:0/1458915587 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7281a2b90 con 0x7fb728100e20 2024-09-19T09:05:04.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.153+0000 7fb72d3bf640 1 -- 172.21.15.92:0/1458915587 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7281a30f0 con 0x7fb728100e20 2024-09-19T09:05:04.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.153+0000 7fb70ffff640 1 -- 172.21.15.92:0/1458915587 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb718011d70 con 0x7fb728100e20 2024-09-19T09:05:04.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.153+0000 7fb70ffff640 1 -- 172.21.15.92:0/1458915587 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71800f340 con 0x7fb728100e20 2024-09-19T09:05:04.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.156+0000 7fb70ffff640 1 -- 172.21.15.92:0/1458915587 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb718018020 con 0x7fb728100e20 2024-09-19T09:05:04.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.157+0000 7fb72f798740 1 Processor -- start 2024-09-19T09:05:04.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.157+0000 7fb72f798740 1 -- start start 2024-09-19T09:05:04.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.157+0000 7fb72f798740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563230c054a0 0x563230c05880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:04.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.157+0000 7fb72f798740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563230c05dc0 0x563230c10140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:04.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.157+0000 7fb72f798740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563230c10680 0x563230c12a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:04.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.157+0000 7fb72f798740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563230b6b2e0 con 0x563230c10680 2024-09-19T09:05:04.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.157+0000 7fb72f798740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563230b12ce0 con 0x563230c054a0 2024-09-19T09:05:04.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.157+0000 7fb72f798740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x563230b672a0 con 0x563230c05dc0 2024-09-19T09:05:04.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.157+0000 7fb726ffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563230c05dc0 0x563230c10140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:04.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.157+0000 7fb726ffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563230c05dc0 0x563230c10140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:52536/0 (socket says 172.21.15.92:52536) 2024-09-19T09:05:04.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.157+0000 7fb726ffd640 1 -- 172.21.15.92:0/2279895798 learned_addr learned my addr 172.21.15.92:0/2279895798 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:04.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.158+0000 7fb7277fe640 1 --2- 172.21.15.92:0/2279895798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563230c054a0 0x563230c05880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:04.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.158+0000 7fb726ffd640 1 -- 172.21.15.92:0/2279895798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563230c054a0 msgr2=0x563230c05880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:04.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.158+0000 7fb70ffff640 1 --2- 172.21.15.92:0/1458915587 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb7100a32c0 0x7fb7100a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:04.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.159+0000 7fb7267fc640 1 --2- 172.21.15.92:0/2279895798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563230c10680 0x563230c12a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:04.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.159+0000 7fb726ffd640 1 --2- 172.21.15.92:0/2279895798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563230c054a0 0x563230c05880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.159+0000 7fb726ffd640 1 -- 172.21.15.92:0/2279895798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563230c10680 msgr2=0x563230c12a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:04.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.159+0000 7fb726ffd640 1 --2- 172.21.15.92:0/2279895798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563230c10680 0x563230c12a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.159+0000 7fb726ffd640 1 -- 172.21.15.92:0/2279895798 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563230af7440 con 0x563230c05dc0 2024-09-19T09:05:04.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.159+0000 7fb70ffff640 1 -- 172.21.15.92:0/1458915587 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb7180cf340 con 0x7fb728100e20 2024-09-19T09:05:04.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.159+0000 7fb7277fe640 1 --2- 172.21.15.92:0/2279895798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563230c054a0 0x563230c05880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:04.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.160+0000 7fb726ffd640 1 --2- 172.21.15.92:0/2279895798 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563230c05dc0 0x563230c10140 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb71805ec70 tx=0x7fb71800e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63aeee4cd483b61b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:04.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.160+0000 7fb7277fe640 1 --2- 172.21.15.92:0/1458915587 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb7100a32c0 0x7fb7100a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:04.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.160+0000 7fb70d7fa640 1 -- 172.21.15.92:0/2279895798 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71809b6f0 con 0x563230c05dc0 2024-09-19T09:05:04.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.160+0000 7fb70d7fa640 1 -- 172.21.15.92:0/2279895798 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb71805f240 con 0x563230c05dc0 2024-09-19T09:05:04.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.160+0000 7fb70d7fa640 1 -- 172.21.15.92:0/2279895798 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71809b280 con 0x563230c05dc0 2024-09-19T09:05:04.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.161+0000 7fb7267fc640 1 --2- 172.21.15.92:0/2279895798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563230c10680 0x563230c12a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:05:04.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.161+0000 7fb72f798740 1 -- 172.21.15.92:0/2279895798 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563230c05dc0 msgr2=0x563230c10140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:04.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.161+0000 7fb72f798740 1 --2- 172.21.15.92:0/2279895798 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563230c05dc0 0x563230c10140 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb71805ec70 tx=0x7fb71800e000 comp rx=0 tx=0).stop 2024-09-19T09:05:04.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.161+0000 7fb7277fe640 1 --2- 172.21.15.92:0/1458915587 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb7100a32c0 0x7fb7100a5780 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb72000a4c0 tx=0x7fb72000c040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:04.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.161+0000 7fb72f798740 1 -- 172.21.15.92:0/2279895798 shutdown_connections 2024-09-19T09:05:04.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.161+0000 7fb72f798740 1 --2- 172.21.15.92:0/2279895798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563230c10680 0x563230c12a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.161+0000 7fb72f798740 1 --2- 172.21.15.92:0/2279895798 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563230c05dc0 0x563230c10140 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.161+0000 7fb72f798740 1 --2- 172.21.15.92:0/2279895798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563230c054a0 0x563230c05880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.161+0000 7fb72f798740 1 -- 172.21.15.92:0/2279895798 >> 172.21.15.92:0/2279895798 conn(0x563230c01a30 msgr2=0x563230c01e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:04.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.162+0000 7fb72f798740 1 -- 172.21.15.92:0/2279895798 shutdown_connections 2024-09-19T09:05:04.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.162+0000 7fb72f798740 1 -- 172.21.15.92:0/2279895798 wait complete. 2024-09-19T09:05:04.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.163+0000 7fb72f798740 1 -- start start 2024-09-19T09:05:04.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.163+0000 7fb72f798740 1 Processor -- start 2024-09-19T09:05:04.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.163+0000 7fb72f798740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563230c054a0 0x563230c0ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:04.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.163+0000 7fb72f798740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563230c05dc0 0x563230c0d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:04.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.163+0000 7fb72f798740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563230c10680 0x563230c0d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:04.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.163+0000 7fb72f798740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563230c13250 con 0x563230c05dc0 2024-09-19T09:05:04.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.163+0000 7fb72f798740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563230b26050 con 0x563230c10680 2024-09-19T09:05:04.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.163+0000 7fb72f798740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x563230c133d0 con 0x563230c054a0 2024-09-19T09:05:04.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.163+0000 7fb72f798740 10 client.0 _ll_register_callbacks cb 0x563230b66160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:04.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.163+0000 7fb7267fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563230c05dc0 0x563230c0d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:04.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.164+0000 7fb7267fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563230c05dc0 0x563230c0d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55220/0 (socket says 172.21.15.92:55220) 2024-09-19T09:05:04.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.164+0000 7fb7267fc640 1 -- 172.21.15.92:0/3666256783 learned_addr learned my addr 172.21.15.92:0/3666256783 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:04.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.164+0000 7fb726ffd640 1 --2- 172.21.15.92:0/3666256783 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563230c054a0 0x563230c0ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:04.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.164+0000 7fb7277fe640 1 --2- 172.21.15.92:0/3666256783 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563230c10680 0x563230c0d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:04.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.164+0000 7fb726ffd640 1 -- 172.21.15.92:0/3666256783 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563230c10680 msgr2=0x563230c0d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:04.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.164+0000 7fb726ffd640 1 --2- 172.21.15.92:0/3666256783 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563230c10680 0x563230c0d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.164+0000 7fb726ffd640 1 -- 172.21.15.92:0/3666256783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563230c05dc0 msgr2=0x563230c0d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:04.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.164+0000 7fb726ffd640 1 --2- 172.21.15.92:0/3666256783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563230c05dc0 0x563230c0d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.164+0000 7fb726ffd640 1 -- 172.21.15.92:0/3666256783 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632308dc3c0 con 0x563230c054a0 2024-09-19T09:05:04.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.164+0000 7fb7267fc640 1 --2- 172.21.15.92:0/3666256783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563230c05dc0 0x563230c0d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:05:04.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.164+0000 7fb726ffd640 1 --2- 172.21.15.92:0/3666256783 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563230c054a0 0x563230c0ffa0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb7180cce00 tx=0x7fb7180d7140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8482037cd591478 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:04.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.164+0000 7fb70aff5640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:05:04.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.164+0000 7fb70aff5640 1 -- 172.21.15.92:0/3666256783 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71809b460 con 0x563230c054a0 2024-09-19T09:05:04.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.164+0000 7fb70aff5640 1 -- 172.21.15.92:0/3666256783 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb718099c20 con 0x563230c054a0 2024-09-19T09:05:04.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.164+0000 7fb72f798740 1 -- 172.21.15.92:0/3666256783 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563230b78850 con 0x563230c054a0 2024-09-19T09:05:04.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.165+0000 7fb70aff5640 1 -- 172.21.15.92:0/3666256783 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb71809b6f0 con 0x563230c054a0 2024-09-19T09:05:04.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.165+0000 7fb72f798740 10 client.26566 fetch_fsmap learned FSMap version 19 2024-09-19T09:05:04.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.165+0000 7fb72f798740 1 -- 172.21.15.92:0/3666256783 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x563230c13250 con 0x563230c054a0 2024-09-19T09:05:04.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.165+0000 7fb70aff5640 1 -- 172.21.15.92:0/3666256783 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x563230b78850 con 0x563230c054a0 2024-09-19T09:05:04.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.165+0000 7fb70aff5640 1 -- 172.21.15.92:0/3666256783 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fb7180cce80 con 0x563230c054a0 2024-09-19T09:05:04.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.165+0000 7fb72f798740 10 client.26566 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:05:04.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.165+0000 7fb72f798740 10 client.26566 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:05:04.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.165+0000 7fb72f798740 20 client.26566 populate_metadata read hostname 'smithi092' 2024-09-19T09:05:04.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.165+0000 7fb72f798740 1 --2- 172.21.15.92:0/3666256783 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x563230c1fd20 0x563230c22110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:04.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.165+0000 7fb72f798740 4 client.26566 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:05:04.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.165+0000 7fb72f798740 1 -- 172.21.15.92:0/3666256783 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563230b72d60 con 0x563230c1fd20 2024-09-19T09:05:04.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.166+0000 7fb7267fc640 1 --2- 172.21.15.92:0/3666256783 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x563230c1fd20 0x563230c22110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:04.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.166+0000 7fb70aff5640 10 client.26566 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:04.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.166+0000 7fb7267fc640 1 --2- 172.21.15.92:0/3666256783 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x563230c1fd20 0x563230c22110 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ca1def19be0a6fa server_cookie=d84155b071bf84d5 in_seq=0 out_seq=0 2024-09-19T09:05:04.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.167+0000 7fb70aff5640 1 -- 172.21.15.92:0/3666256783 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563230b72d60 con 0x563230c1fd20 2024-09-19T09:05:04.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.167+0000 7fb70aff5640 10 client.26566 handle_command_reply: tid=0 2024-09-19T09:05:04.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.167+0000 7fb72f798740 1 client.26566 shutdown 2024-09-19T09:05:04.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.167+0000 7fb72f798740 1 -- 172.21.15.92:0/3666256783 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563230c054a0 msgr2=0x563230c0ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:04.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.167+0000 7fb72f798740 1 --2- 172.21.15.92:0/3666256783 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563230c054a0 0x563230c0ffa0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb7180cce00 tx=0x7fb7180d7140 comp rx=0 tx=0).stop 2024-09-19T09:05:04.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.167+0000 7fb72f798740 1 -- 172.21.15.92:0/3666256783 shutdown_connections 2024-09-19T09:05:04.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.167+0000 7fb72f798740 1 --2- 172.21.15.92:0/3666256783 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x563230c1fd20 0x563230c22110 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.167+0000 7fb72f798740 1 --2- 172.21.15.92:0/3666256783 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563230c10680 0x563230c0d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.167+0000 7fb70aff5640 0 client.26566 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:04.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.167+0000 7fb72f798740 1 --2- 172.21.15.92:0/3666256783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563230c05dc0 0x563230c0d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.167+0000 7fb72f798740 1 --2- 172.21.15.92:0/3666256783 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563230c054a0 0x563230c0ffa0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.167+0000 7fb72f798740 1 -- 172.21.15.92:0/3666256783 >> 172.21.15.92:0/3666256783 conn(0x563230c01a30 msgr2=0x563230c00b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:04.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.167+0000 7fb72f798740 1 -- 172.21.15.92:0/3666256783 shutdown_connections 2024-09-19T09:05:04.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.167+0000 7fb72f798740 1 -- 172.21.15.92:0/3666256783 wait complete. 2024-09-19T09:05:04.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.167+0000 7fb72f798740 20 client.26566 trim_cache size 0 max 16384 2024-09-19T09:05:04.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.194+0000 7fb72f798740 1 Processor -- start 2024-09-19T09:05:04.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.194+0000 7fb72f798740 1 -- start start 2024-09-19T09:05:04.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.195+0000 7fb72f798740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563230c054a0 0x563230c1c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:04.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.195+0000 7fb72f798740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563230c05dc0 0x563230c0bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:04.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.195+0000 7fb72f798740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563230c10680 0x563230c27830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:04.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.195+0000 7fb72f798740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb71400c410 con 0x563230c10680 2024-09-19T09:05:04.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.195+0000 7fb72f798740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb71400ecb0 con 0x563230c05dc0 2024-09-19T09:05:04.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.195+0000 7fb72f798740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb71400caa0 con 0x563230c054a0 2024-09-19T09:05:04.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.195+0000 7fb7277fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563230c10680 0x563230c27830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:04.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.195+0000 7fb7277fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563230c10680 0x563230c27830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55230/0 (socket says 172.21.15.92:55230) 2024-09-19T09:05:04.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.195+0000 7fb7277fe640 1 -- 172.21.15.92:0/3423781072 learned_addr learned my addr 172.21.15.92:0/3423781072 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:04.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.195+0000 7fb726ffd640 1 --2- 172.21.15.92:0/3423781072 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563230c054a0 0x563230c1c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:04.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.195+0000 7fb7267fc640 1 --2- 172.21.15.92:0/3423781072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563230c05dc0 0x563230c0bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:04.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.195+0000 7fb7277fe640 1 -- 172.21.15.92:0/3423781072 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563230c054a0 msgr2=0x563230c1c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:04.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.195+0000 7fb7277fe640 1 --2- 172.21.15.92:0/3423781072 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563230c054a0 0x563230c1c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.195+0000 7fb7277fe640 1 -- 172.21.15.92:0/3423781072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563230c05dc0 msgr2=0x563230c0bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:04.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.195+0000 7fb7277fe640 1 --2- 172.21.15.92:0/3423781072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563230c05dc0 0x563230c0bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.195+0000 7fb7277fe640 1 -- 172.21.15.92:0/3423781072 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563230c0c200 con 0x563230c10680 2024-09-19T09:05:04.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.195+0000 7fb7277fe640 1 --2- 172.21.15.92:0/3423781072 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563230c10680 0x563230c27830 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fb7200187c0 tx=0x7fb720014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb3968ce9f3d5823 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:04.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.196+0000 7fb70cff9640 1 -- 172.21.15.92:0/3423781072 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7200182d0 con 0x563230c10680 2024-09-19T09:05:04.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.196+0000 7fb70cff9640 1 -- 172.21.15.92:0/3423781072 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb720027070 con 0x563230c10680 2024-09-19T09:05:04.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.196+0000 7fb70cff9640 1 -- 172.21.15.92:0/3423781072 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7200228c0 con 0x563230c10680 2024-09-19T09:05:04.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.197+0000 7fb72f798740 1 -- 172.21.15.92:0/3423781072 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563230c10680 msgr2=0x563230c27830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:04.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.197+0000 7fb72f798740 1 --2- 172.21.15.92:0/3423781072 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563230c10680 0x563230c27830 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fb7200187c0 tx=0x7fb720014000 comp rx=0 tx=0).stop 2024-09-19T09:05:04.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.197+0000 7fb72f798740 1 -- 172.21.15.92:0/3423781072 shutdown_connections 2024-09-19T09:05:04.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.197+0000 7fb72f798740 1 --2- 172.21.15.92:0/3423781072 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563230c10680 0x563230c27830 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.197+0000 7fb72f798740 1 --2- 172.21.15.92:0/3423781072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563230c05dc0 0x563230c0bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.197+0000 7fb72f798740 1 --2- 172.21.15.92:0/3423781072 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563230c054a0 0x563230c1c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.197+0000 7fb72f798740 1 -- 172.21.15.92:0/3423781072 >> 172.21.15.92:0/3423781072 conn(0x563230c01a30 msgr2=0x563230c07710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:04.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.197+0000 7fb72f798740 1 -- 172.21.15.92:0/3423781072 shutdown_connections 2024-09-19T09:05:04.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.197+0000 7fb72f798740 1 -- 172.21.15.92:0/3423781072 wait complete. 2024-09-19T09:05:04.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.197+0000 7fb72f798740 1 -- start start 2024-09-19T09:05:04.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.197+0000 7fb72f798740 1 Processor -- start 2024-09-19T09:05:04.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.197+0000 7fb72f798740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563230c054a0 0x563230c18d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:04.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.197+0000 7fb72f798740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563230c05dc0 0x563230c14090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:04.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.197+0000 7fb72f798740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563230c10680 0x563230c145d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:04.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.197+0000 7fb72f798740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb71400d170 con 0x563230c10680 2024-09-19T09:05:04.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.198+0000 7fb72f798740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb71400e5e0 con 0x563230c054a0 2024-09-19T09:05:04.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.198+0000 7fb72f798740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb71400d840 con 0x563230c05dc0 2024-09-19T09:05:04.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.198+0000 7fb7277fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563230c10680 0x563230c145d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:04.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.198+0000 7fb7277fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563230c10680 0x563230c145d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55242/0 (socket says 172.21.15.92:55242) 2024-09-19T09:05:04.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.198+0000 7fb7277fe640 1 -- 172.21.15.92:0/3746454877 learned_addr learned my addr 172.21.15.92:0/3746454877 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:04.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.198+0000 7fb72f798740 10 client.0 _ll_register_callbacks cb 0x7fb7180d7320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:04.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.198+0000 7fb7267fc640 1 --2- 172.21.15.92:0/3746454877 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563230c05dc0 0x563230c14090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:04.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.198+0000 7fb726ffd640 1 --2- 172.21.15.92:0/3746454877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563230c054a0 0x563230c18d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:04.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.199+0000 7fb7267fc640 1 -- 172.21.15.92:0/3746454877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563230c054a0 msgr2=0x563230c18d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:04.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.199+0000 7fb7267fc640 1 --2- 172.21.15.92:0/3746454877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563230c054a0 0x563230c18d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.199+0000 7fb7267fc640 1 -- 172.21.15.92:0/3746454877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563230c10680 msgr2=0x563230c145d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:04.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.199+0000 7fb7267fc640 1 --2- 172.21.15.92:0/3746454877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563230c10680 0x563230c145d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.199+0000 7fb7267fc640 1 -- 172.21.15.92:0/3746454877 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563230c14db0 con 0x563230c05dc0 2024-09-19T09:05:04.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.200+0000 7fb7267fc640 1 --2- 172.21.15.92:0/3746454877 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563230c05dc0 0x563230c14090 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x563230c0cae0 tx=0x7fb71c005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60ee869f13d7f2a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:04.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.201+0000 7fb70aff5640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:05:04.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.201+0000 7fb70aff5640 1 -- 172.21.15.92:0/3746454877 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71c046040 con 0x563230c05dc0 2024-09-19T09:05:04.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.201+0000 7fb70aff5640 1 -- 172.21.15.92:0/3746454877 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb71c004800 con 0x563230c05dc0 2024-09-19T09:05:04.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.201+0000 7fb72f798740 1 -- 172.21.15.92:0/3746454877 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb720027070 con 0x563230c05dc0 2024-09-19T09:05:04.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.202+0000 7fb70aff5640 1 -- 172.21.15.92:0/3746454877 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb71c004a00 con 0x563230c05dc0 2024-09-19T09:05:04.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.202+0000 7fb72f798740 10 client.26572 fetch_fsmap learned FSMap version 19 2024-09-19T09:05:04.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.202+0000 7fb72f798740 1 -- 172.21.15.92:0/3746454877 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x563230c8a760 con 0x563230c05dc0 2024-09-19T09:05:04.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.202+0000 7fb70aff5640 1 -- 172.21.15.92:0/3746454877 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb720027070 con 0x563230c05dc0 2024-09-19T09:05:04.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.202+0000 7fb70aff5640 1 -- 172.21.15.92:0/3746454877 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fb71c05f470 con 0x563230c05dc0 2024-09-19T09:05:04.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.202+0000 7fb72f798740 10 client.26572 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:05:04.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.202+0000 7fb72f798740 10 client.26572 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:05:04.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.202+0000 7fb72f798740 20 client.26572 populate_metadata read hostname 'smithi092' 2024-09-19T09:05:04.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.202+0000 7fb72f798740 1 --2- 172.21.15.92:0/3746454877 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x563230c1fd20 0x563230c8ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:04.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.202+0000 7fb72f798740 4 client.26572 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:05:04.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.202+0000 7fb72f798740 1 -- 172.21.15.92:0/3746454877 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563230aef210 con 0x563230c1fd20 2024-09-19T09:05:04.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.203+0000 7fb726ffd640 1 --2- 172.21.15.92:0/3746454877 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x563230c1fd20 0x563230c8ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:04.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.203+0000 7fb70aff5640 10 client.26572 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:04.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.203+0000 7fb726ffd640 1 --2- 172.21.15.92:0/3746454877 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x563230c1fd20 0x563230c8ce80 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71c772d9736e3c53 server_cookie=9666793b69aae384 in_seq=0 out_seq=0 2024-09-19T09:05:04.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.203+0000 7fb70aff5640 1 -- 172.21.15.92:0/3746454877 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x563230aef210 con 0x563230c1fd20 2024-09-19T09:05:04.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.203+0000 7fb70aff5640 10 client.26572 handle_command_reply: tid=0 2024-09-19T09:05:04.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.203+0000 7fb72f798740 1 client.26572 shutdown 2024-09-19T09:05:04.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.204+0000 7fb72f798740 1 -- 172.21.15.92:0/3746454877 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563230c05dc0 msgr2=0x563230c14090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:04.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.204+0000 7fb72f798740 1 --2- 172.21.15.92:0/3746454877 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563230c05dc0 0x563230c14090 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x563230c0cae0 tx=0x7fb71c005fd0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.204+0000 7fb72f798740 1 -- 172.21.15.92:0/3746454877 shutdown_connections 2024-09-19T09:05:04.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.204+0000 7fb72f798740 1 --2- 172.21.15.92:0/3746454877 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x563230c1fd20 0x563230c8ce80 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.204+0000 7fb72f798740 1 --2- 172.21.15.92:0/3746454877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563230c10680 0x563230c145d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.204+0000 7fb72f798740 1 --2- 172.21.15.92:0/3746454877 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563230c05dc0 0x563230c14090 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.204+0000 7fb70aff5640 0 client.26572 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:04.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.204+0000 7fb72f798740 1 --2- 172.21.15.92:0/3746454877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563230c054a0 0x563230c18d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.204+0000 7fb72f798740 1 -- 172.21.15.92:0/3746454877 >> 172.21.15.92:0/3746454877 conn(0x563230c01a30 msgr2=0x563230c07710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:04.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.204+0000 7fb72f798740 1 -- 172.21.15.92:0/3746454877 shutdown_connections 2024-09-19T09:05:04.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.204+0000 7fb72f798740 1 -- 172.21.15.92:0/3746454877 wait complete. 2024-09-19T09:05:04.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.204+0000 7fb72f798740 20 client.26572 trim_cache size 0 max 16384 2024-09-19T09:05:04.208 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:05:04.208 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-19T09:05:04.208 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {} 2024-09-19T09:05:04.208 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:05:04.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.205+0000 7fb72d3bf640 1 -- 172.21.15.92:0/1458915587 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb7100a32c0 msgr2=0x7fb7100a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:04.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.205+0000 7fb72d3bf640 1 --2- 172.21.15.92:0/1458915587 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb7100a32c0 0x7fb7100a5780 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb72000a4c0 tx=0x7fb72000c040 comp rx=0 tx=0).stop 2024-09-19T09:05:04.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.205+0000 7fb72d3bf640 1 -- 172.21.15.92:0/1458915587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb728100e20 msgr2=0x7fb72810d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:04.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.205+0000 7fb72d3bf640 1 --2- 172.21.15.92:0/1458915587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb728100e20 0x7fb72810d7f0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fb71800b450 tx=0x7fb71800b910 comp rx=0 tx=0).stop 2024-09-19T09:05:04.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.205+0000 7fb72d3bf640 1 -- 172.21.15.92:0/1458915587 shutdown_connections 2024-09-19T09:05:04.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.205+0000 7fb72d3bf640 1 --2- 172.21.15.92:0/1458915587 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb728102ef0 0x7fb728108dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.205+0000 7fb72d3bf640 1 --2- 172.21.15.92:0/1458915587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb728102570 0x7fb728108880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.205+0000 7fb72d3bf640 1 --2- 172.21.15.92:0/1458915587 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb7100a32c0 0x7fb7100a5780 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.205+0000 7fb72d3bf640 1 --2- 172.21.15.92:0/1458915587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb728100e20 0x7fb72810d7f0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.205+0000 7fb72d3bf640 1 -- 172.21.15.92:0/1458915587 >> 172.21.15.92:0/1458915587 conn(0x7fb7280fc7d0 msgr2=0x7fb728103a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:04.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.205+0000 7fb72d3bf640 1 -- 172.21.15.92:0/1458915587 shutdown_connections 2024-09-19T09:05:04.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:04.205+0000 7fb72d3bf640 1 -- 172.21.15.92:0/1458915587 wait complete. 2024-09-19T09:05:04.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:04 smithi167 ceph-mon[35359]: pgmap v588: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.8 MiB/s wr, 858 op/s 2024-09-19T09:05:04.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:04 smithi190 ceph-mon[35358]: pgmap v588: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.8 MiB/s wr, 858 op/s 2024-09-19T09:05:04.917 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:04 smithi092 ceph-mon[31407]: pgmap v588: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.8 MiB/s wr, 858 op/s 2024-09-19T09:05:05.057 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:05:05.057 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:05:05.456 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:05.795 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 500.0 s, 2095.8 tps, lat 47.470 ms stddev 52.380 2024-09-19T09:05:06.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.054+0000 7f20b83cb640 1 -- 172.21.15.92:0/4084141753 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20b010c180 msgr2=0x7f20b010e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:06.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.054+0000 7f20b83cb640 1 --2- 172.21.15.92:0/4084141753 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20b010c180 0x7f20b010e620 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f20a8009ca0 tx=0x7f20a802a950 comp rx=0 tx=0).stop 2024-09-19T09:05:06.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.056+0000 7f20b83cb640 1 -- 172.21.15.92:0/4084141753 shutdown_connections 2024-09-19T09:05:06.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.056+0000 7f20b83cb640 1 --2- 172.21.15.92:0/4084141753 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20b010c180 0x7f20b010e620 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.056+0000 7f20b83cb640 1 --2- 172.21.15.92:0/4084141753 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f20b0103670 0x7f20b010bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.056+0000 7f20b83cb640 1 --2- 172.21.15.92:0/4084141753 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20b0102d50 0x7f20b0103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.056+0000 7f20b83cb640 1 -- 172.21.15.92:0/4084141753 >> 172.21.15.92:0/4084141753 conn(0x7f20b00fc7d0 msgr2=0x7f20b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:06.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.056+0000 7f20b83cb640 1 -- 172.21.15.92:0/4084141753 shutdown_connections 2024-09-19T09:05:06.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.056+0000 7f20b83cb640 1 -- 172.21.15.92:0/4084141753 wait complete. 2024-09-19T09:05:06.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.057+0000 7f20b83cb640 1 Processor -- start 2024-09-19T09:05:06.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.057+0000 7f20b83cb640 1 -- start start 2024-09-19T09:05:06.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.057+0000 7f20b83cb640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f20b0102d50 0x7f20b01009b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.057+0000 7f20b83cb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20b0103670 0x7f20b0100ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.057+0000 7f20b83cb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20b010c180 0x7f20b0101430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.057+0000 7f20b83cb640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f20b0111f60 con 0x7f20b0103670 2024-09-19T09:05:06.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.057+0000 7f20b83cb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f20b0111de0 con 0x7f20b010c180 2024-09-19T09:05:06.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.057+0000 7f20b83cb640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f20b01120e0 con 0x7f20b0102d50 2024-09-19T09:05:06.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.057+0000 7f20b5966640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20b0103670 0x7f20b0100ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:06.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.057+0000 7f20b5966640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20b0103670 0x7f20b0100ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55262/0 (socket says 172.21.15.92:55262) 2024-09-19T09:05:06.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.058+0000 7f20b5966640 1 -- 172.21.15.92:0/464142780 learned_addr learned my addr 172.21.15.92:0/464142780 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:06.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.058+0000 7f20b6167640 1 --2- 172.21.15.92:0/464142780 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f20b0102d50 0x7f20b01009b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:06.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.058+0000 7f20b6968640 1 --2- 172.21.15.92:0/464142780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20b010c180 0x7f20b0101430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:06.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.058+0000 7f20b6167640 1 -- 172.21.15.92:0/464142780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20b010c180 msgr2=0x7f20b0101430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:06.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.058+0000 7f20b6167640 1 --2- 172.21.15.92:0/464142780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20b010c180 0x7f20b0101430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.058+0000 7f20b6167640 1 -- 172.21.15.92:0/464142780 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20b0103670 msgr2=0x7f20b0100ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:06.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.058+0000 7f20b6167640 1 --2- 172.21.15.92:0/464142780 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20b0103670 0x7f20b0100ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.058+0000 7f20b6167640 1 -- 172.21.15.92:0/464142780 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20b01a6900 con 0x7f20b0102d50 2024-09-19T09:05:06.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.058+0000 7f20b5966640 1 --2- 172.21.15.92:0/464142780 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20b0103670 0x7f20b0100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:05:06.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.058+0000 7f20b6167640 1 --2- 172.21.15.92:0/464142780 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f20b0102d50 0x7f20b01009b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f20ac00d6d0 tx=0x7f20ac00db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:06.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.058+0000 7f20a77fe640 1 -- 172.21.15.92:0/464142780 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ac017070 con 0x7f20b0102d50 2024-09-19T09:05:06.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.058+0000 7f20b83cb640 1 -- 172.21.15.92:0/464142780 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20b01a6bf0 con 0x7f20b0102d50 2024-09-19T09:05:06.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.058+0000 7f20a77fe640 1 -- 172.21.15.92:0/464142780 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20ac009820 con 0x7f20b0102d50 2024-09-19T09:05:06.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.059+0000 7f20a77fe640 1 -- 172.21.15.92:0/464142780 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ac004d00 con 0x7f20b0102d50 2024-09-19T09:05:06.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.059+0000 7f20b83cb640 1 -- 172.21.15.92:0/464142780 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20b01a7180 con 0x7f20b0102d50 2024-09-19T09:05:06.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.060+0000 7f20b83cb640 1 -- 172.21.15.92:0/464142780 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20b0103130 con 0x7f20b0102d50 2024-09-19T09:05:06.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.061+0000 7f20a77fe640 1 -- 172.21.15.92:0/464142780 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f20ac005220 con 0x7f20b0102d50 2024-09-19T09:05:06.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.062+0000 7f20a77fe640 1 --2- 172.21.15.92:0/464142780 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f209c0a32c0 0x7f209c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.062+0000 7f20b5966640 1 --2- 172.21.15.92:0/464142780 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f209c0a32c0 0x7f209c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:06.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.062+0000 7f20a77fe640 1 -- 172.21.15.92:0/464142780 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f20ac0cf360 con 0x7f20b0102d50 2024-09-19T09:05:06.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.062+0000 7f20b5966640 1 --2- 172.21.15.92:0/464142780 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f209c0a32c0 0x7f209c0a5780 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f20b0102440 tx=0x7f20a0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:06.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.067+0000 7f20a77fe640 1 -- 172.21.15.92:0/464142780 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f20ac09ba30 con 0x7f20b0102d50 2024-09-19T09:05:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.302+0000 7ff45c61e640 1 -- 172.21.15.92:0/3251189024 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4541025f0 msgr2=0x7ff454108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.302+0000 7ff45c61e640 1 --2- 172.21.15.92:0/3251189024 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4541025f0 0x7ff454108e80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff44c009ca0 tx=0x7ff44c02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.302+0000 7ff45c61e640 1 -- 172.21.15.92:0/3251189024 shutdown_connections 2024-09-19T09:05:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.302+0000 7ff45c61e640 1 --2- 172.21.15.92:0/3251189024 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4541025f0 0x7ff454108e80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.302+0000 7ff45c61e640 1 --2- 172.21.15.92:0/3251189024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff454101c30 0x7ff4541020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.302+0000 7ff45c61e640 1 --2- 172.21.15.92:0/3251189024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff454100a40 0x7ff454100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.302+0000 7ff45c61e640 1 -- 172.21.15.92:0/3251189024 >> 172.21.15.92:0/3251189024 conn(0x7ff4540fc1e0 msgr2=0x7ff4540fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:06.304 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.303+0000 7ff45c61e640 1 -- 172.21.15.92:0/3251189024 shutdown_connections 2024-09-19T09:05:06.304 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.303+0000 7ff45c61e640 1 -- 172.21.15.92:0/3251189024 wait complete. 2024-09-19T09:05:06.305 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.304+0000 7ff45c61e640 1 Processor -- start 2024-09-19T09:05:06.305 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.304+0000 7ff45c61e640 1 -- start start 2024-09-19T09:05:06.305 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.304+0000 7ff45c61e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff454100a40 0x7ff454195c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.305 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.304+0000 7ff45c61e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff454101c30 0x7ff454196150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.305 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.304+0000 7ff45c61e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4541025f0 0x7ff45419d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.305 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.305+0000 7ff45a3ba640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff454100a40 0x7ff454195c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:06.305 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.305+0000 7ff45c61e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff45410c740 con 0x7ff4541025f0 2024-09-19T09:05:06.305 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.305+0000 7ff459bb9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff454101c30 0x7ff454196150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:06.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.305+0000 7ff45c61e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff45410c5c0 con 0x7ff454101c30 2024-09-19T09:05:06.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.305+0000 7ff45c61e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff45410c8c0 con 0x7ff454100a40 2024-09-19T09:05:06.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.305+0000 7ff459bb9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff454101c30 0x7ff454196150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:45096/0 (socket says 172.21.15.92:45096) 2024-09-19T09:05:06.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.305+0000 7ff459bb9640 1 -- 172.21.15.92:0/3618117120 learned_addr learned my addr 172.21.15.92:0/3618117120 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:06.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.305+0000 7ff45abbb640 1 --2- 172.21.15.92:0/3618117120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4541025f0 0x7ff45419d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:06.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.305+0000 7ff459bb9640 1 -- 172.21.15.92:0/3618117120 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff454100a40 msgr2=0x7ff454195c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:06.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.305+0000 7ff459bb9640 1 --2- 172.21.15.92:0/3618117120 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff454100a40 0x7ff454195c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.305+0000 7ff459bb9640 1 -- 172.21.15.92:0/3618117120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4541025f0 msgr2=0x7ff45419d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:06.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.305+0000 7ff459bb9640 1 --2- 172.21.15.92:0/3618117120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4541025f0 0x7ff45419d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.305+0000 7ff459bb9640 1 -- 172.21.15.92:0/3618117120 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff45419d830 con 0x7ff454101c30 2024-09-19T09:05:06.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.306+0000 7ff459bb9640 1 --2- 172.21.15.92:0/3618117120 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff454101c30 0x7ff454196150 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff44400ea60 tx=0x7ff44400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:06.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.307+0000 7ff44b7fe640 1 -- 172.21.15.92:0/3618117120 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44400cde0 con 0x7ff454101c30 2024-09-19T09:05:06.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.308+0000 7ff44b7fe640 1 -- 172.21.15.92:0/3618117120 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4440035f0 con 0x7ff454101c30 2024-09-19T09:05:06.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.308+0000 7ff44b7fe640 1 -- 172.21.15.92:0/3618117120 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff444010670 con 0x7ff454101c30 2024-09-19T09:05:06.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.308+0000 7ff45c61e640 1 -- 172.21.15.92:0/3618117120 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff45419db20 con 0x7ff454101c30 2024-09-19T09:05:06.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.308+0000 7ff45c61e640 1 -- 172.21.15.92:0/3618117120 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff45419e0a0 con 0x7ff454101c30 2024-09-19T09:05:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.311+0000 7ff45f490740 1 Processor -- start 2024-09-19T09:05:06.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.311+0000 7ff45f490740 1 -- start start 2024-09-19T09:05:06.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.311+0000 7ff45f490740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5560430f99a0 0x5560430f9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.312+0000 7ff45f490740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560430fa2e0 0x5560430feda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.312+0000 7ff45f490740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560430ff370 0x556043101830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.312+0000 7ff45f490740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55604305d2f0 con 0x5560430f99a0 2024-09-19T09:05:06.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.312+0000 7ff45f490740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556043005270 con 0x5560430fa2e0 2024-09-19T09:05:06.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.312+0000 7ff45f490740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5560430592b0 con 0x5560430ff370 2024-09-19T09:05:06.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.312+0000 7ff45abbb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5560430f99a0 0x5560430f9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:06.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.312+0000 7ff45abbb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5560430f99a0 0x5560430f9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55280/0 (socket says 172.21.15.92:55280) 2024-09-19T09:05:06.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.312+0000 7ff45abbb640 1 -- 172.21.15.92:0/1655986513 learned_addr learned my addr 172.21.15.92:0/1655986513 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:06.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.312+0000 7ff45a3ba640 1 --2- 172.21.15.92:0/1655986513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560430fa2e0 0x5560430feda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:06.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.312+0000 7ff45abbb640 1 -- 172.21.15.92:0/1655986513 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560430ff370 msgr2=0x556043101830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:05:06.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.312+0000 7ff45abbb640 1 --2- 172.21.15.92:0/1655986513 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560430ff370 0x556043101830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.312+0000 7ff45abbb640 1 -- 172.21.15.92:0/1655986513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560430fa2e0 msgr2=0x5560430feda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:06.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.312+0000 7ff45abbb640 1 --2- 172.21.15.92:0/1655986513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560430fa2e0 0x5560430feda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.312+0000 7ff45abbb640 1 -- 172.21.15.92:0/1655986513 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556043004340 con 0x5560430f99a0 2024-09-19T09:05:06.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.314+0000 7ff44b7fe640 1 -- 172.21.15.92:0/3618117120 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff444004020 con 0x7ff454101c30 2024-09-19T09:05:06.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.314+0000 7ff45abbb640 1 --2- 172.21.15.92:0/1655986513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5560430f99a0 0x5560430f9da0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7ff44c035000 tx=0x7ff44c031470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6c5c25fe7ad850 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:06.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.315+0000 7ff44b7fe640 1 --2- 172.21.15.92:0/3618117120 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff4400a3530 0x7ff4400a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.315+0000 7ff44b7fe640 1 -- 172.21.15.92:0/3618117120 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff4440cfbe0 con 0x7ff454101c30 2024-09-19T09:05:06.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.315+0000 7ff448bfe640 1 -- 172.21.15.92:0/1655986513 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c031d00 con 0x5560430f99a0 2024-09-19T09:05:06.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.315+0000 7ff448bfe640 1 -- 172.21.15.92:0/1655986513 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff44c036040 con 0x5560430f99a0 2024-09-19T09:05:06.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.315+0000 7ff45a3ba640 1 --2- 172.21.15.92:0/3618117120 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff4400a3530 0x7ff4400a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:06.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.315+0000 7ff448bfe640 1 -- 172.21.15.92:0/1655986513 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c004800 con 0x5560430f99a0 2024-09-19T09:05:06.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.316+0000 7ff45f490740 1 -- 172.21.15.92:0/1655986513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5560430f99a0 msgr2=0x5560430f9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:06.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.316+0000 7ff45f490740 1 --2- 172.21.15.92:0/1655986513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5560430f99a0 0x5560430f9da0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7ff44c035000 tx=0x7ff44c031470 comp rx=0 tx=0).stop 2024-09-19T09:05:06.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.316+0000 7ff45a3ba640 1 --2- 172.21.15.92:0/3618117120 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff4400a3530 0x7ff4400a59f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x5560430fad10 tx=0x7ff4500090e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:06.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.316+0000 7ff45f490740 1 -- 172.21.15.92:0/1655986513 shutdown_connections 2024-09-19T09:05:06.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.316+0000 7ff45f490740 1 --2- 172.21.15.92:0/1655986513 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560430ff370 0x556043101830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.316+0000 7ff45f490740 1 --2- 172.21.15.92:0/1655986513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560430fa2e0 0x5560430feda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.316+0000 7ff45f490740 1 --2- 172.21.15.92:0/1655986513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5560430f99a0 0x5560430f9da0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.316+0000 7ff45f490740 1 -- 172.21.15.92:0/1655986513 >> 172.21.15.92:0/1655986513 conn(0x5560430f5010 msgr2=0x5560430f5410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:06.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.316+0000 7ff45f490740 1 -- 172.21.15.92:0/1655986513 shutdown_connections 2024-09-19T09:05:06.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.316+0000 7ff45f490740 1 -- 172.21.15.92:0/1655986513 wait complete. 2024-09-19T09:05:06.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.317+0000 7ff45f490740 1 -- start start 2024-09-19T09:05:06.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.317+0000 7ff45f490740 1 Processor -- start 2024-09-19T09:05:06.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.317+0000 7ff45f490740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560430f99a0 0x556043103c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.317+0000 7ff45f490740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560430fa2e0 0x556043104160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.317+0000 7ff45f490740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5560430ff370 0x55604310b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.317+0000 7ff45f490740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556043102330 con 0x5560430ff370 2024-09-19T09:05:06.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.317+0000 7ff45abbb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5560430ff370 0x55604310b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:06.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.317+0000 7ff45abbb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5560430ff370 0x55604310b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55284/0 (socket says 172.21.15.92:55284) 2024-09-19T09:05:06.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.317+0000 7ff45abbb640 1 -- 172.21.15.92:0/2946164494 learned_addr learned my addr 172.21.15.92:0/2946164494 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:06.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.317+0000 7ff45f490740 1 -- 172.21.15.92:0/2946164494 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556042fe6290 con 0x5560430fa2e0 2024-09-19T09:05:06.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.317+0000 7ff45f490740 1 -- 172.21.15.92:0/2946164494 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5560431024b0 con 0x5560430f99a0 2024-09-19T09:05:06.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.318+0000 7ff459bb9640 1 --2- 172.21.15.92:0/2946164494 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560430fa2e0 0x556043104160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:06.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.318+0000 7ff45f490740 10 client.0 _ll_register_callbacks cb 0x556043017140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:06.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.318+0000 7ff459bb9640 1 -- 172.21.15.92:0/2946164494 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560430f99a0 msgr2=0x556043103c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:05:06.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.318+0000 7ff459bb9640 1 --2- 172.21.15.92:0/2946164494 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560430f99a0 0x556043103c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.318+0000 7ff459bb9640 1 -- 172.21.15.92:0/2946164494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5560430ff370 msgr2=0x55604310b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:06.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.318+0000 7ff459bb9640 1 --2- 172.21.15.92:0/2946164494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5560430ff370 0x55604310b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.318+0000 7ff459bb9640 1 -- 172.21.15.92:0/2946164494 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556042d70210 con 0x5560430fa2e0 2024-09-19T09:05:06.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.318+0000 7ff459bb9640 1 --2- 172.21.15.92:0/2946164494 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560430fa2e0 0x556043104160 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff44400ea30 tx=0x7ff44409be00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47bbacccc5ade8ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:06.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.319+0000 7ff43dffb640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:05:06.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.319+0000 7ff43dffb640 1 -- 172.21.15.92:0/2946164494 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4440a0570 con 0x5560430fa2e0 2024-09-19T09:05:06.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.319+0000 7ff43dffb640 1 -- 172.21.15.92:0/2946164494 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff444003b30 con 0x5560430fa2e0 2024-09-19T09:05:06.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.319+0000 7ff45f490740 1 -- 172.21.15.92:0/2946164494 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff44c036040 con 0x5560430fa2e0 2024-09-19T09:05:06.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.319+0000 7ff43dffb640 1 -- 172.21.15.92:0/2946164494 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff4440a4e30 con 0x5560430fa2e0 2024-09-19T09:05:06.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.319+0000 7ff45f490740 10 client.26684 fetch_fsmap learned FSMap version 19 2024-09-19T09:05:06.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.319+0000 7ff45f490740 1 -- 172.21.15.92:0/2946164494 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x556042e3c620 con 0x5560430fa2e0 2024-09-19T09:05:06.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.319+0000 7ff43dffb640 1 -- 172.21.15.92:0/2946164494 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff44c036040 con 0x5560430fa2e0 2024-09-19T09:05:06.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.319+0000 7ff43dffb640 1 -- 172.21.15.92:0/2946164494 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff4440037a0 con 0x5560430fa2e0 2024-09-19T09:05:06.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.320+0000 7ff45f490740 10 client.26684 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:05:06.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.320+0000 7ff45f490740 10 client.26684 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:05:06.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.320+0000 7ff45f490740 20 client.26684 populate_metadata read hostname 'smithi092' 2024-09-19T09:05:06.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.320+0000 7ff45f490740 1 --2- 172.21.15.92:0/2946164494 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55604310fd40 0x556043112190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.320+0000 7ff45f490740 4 client.26684 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:05:06.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.320+0000 7ff45f490740 1 -- 172.21.15.92:0/2946164494 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55604306aa20 con 0x55604310fd40 2024-09-19T09:05:06.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.320+0000 7ff45a3ba640 1 --2- 172.21.15.92:0/2946164494 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55604310fd40 0x556043112190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:06.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.320+0000 7ff43dffb640 10 client.26684 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:06.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.320+0000 7ff45a3ba640 1 --2- 172.21.15.92:0/2946164494 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55604310fd40 0x556043112190 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d854db73f4dbd7a server_cookie=d400c6eaae06e93c in_seq=0 out_seq=0 2024-09-19T09:05:06.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.321+0000 7ff43dffb640 1 -- 172.21.15.92:0/2946164494 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55604306aa20 con 0x55604310fd40 2024-09-19T09:05:06.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.322+0000 7ff43dffb640 10 client.26684 handle_command_reply: tid=0 2024-09-19T09:05:06.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.322+0000 7ff45f490740 1 client.26684 shutdown 2024-09-19T09:05:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.324+0000 7ff45f490740 1 -- 172.21.15.92:0/2946164494 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560430fa2e0 msgr2=0x556043104160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.324+0000 7ff45f490740 1 --2- 172.21.15.92:0/2946164494 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560430fa2e0 0x556043104160 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff44400ea30 tx=0x7ff44409be00 comp rx=0 tx=0).stop 2024-09-19T09:05:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.325+0000 7ff45f490740 1 -- 172.21.15.92:0/2946164494 shutdown_connections 2024-09-19T09:05:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.325+0000 7ff45f490740 1 --2- 172.21.15.92:0/2946164494 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55604310fd40 0x556043112190 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.325+0000 7ff45f490740 1 --2- 172.21.15.92:0/2946164494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5560430ff370 0x55604310b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.325+0000 7ff45f490740 1 --2- 172.21.15.92:0/2946164494 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560430fa2e0 0x556043104160 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.325+0000 7ff45f490740 1 --2- 172.21.15.92:0/2946164494 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560430f99a0 0x556043103c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.325+0000 7ff45f490740 1 -- 172.21.15.92:0/2946164494 >> 172.21.15.92:0/2946164494 conn(0x5560430f5010 msgr2=0x5560430f6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.325+0000 7ff43dffb640 0 client.26684 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.325+0000 7ff45f490740 1 -- 172.21.15.92:0/2946164494 shutdown_connections 2024-09-19T09:05:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.325+0000 7ff45f490740 1 -- 172.21.15.92:0/2946164494 wait complete. 2024-09-19T09:05:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.325+0000 7ff45f490740 20 client.26684 trim_cache size 0 max 16384 2024-09-19T09:05:06.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.366+0000 7ff45f490740 1 Processor -- start 2024-09-19T09:05:06.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.366+0000 7ff45f490740 1 -- start start 2024-09-19T09:05:06.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.366+0000 7ff45f490740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560430f99a0 0x5560430f39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.367+0000 7ff45f490740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560430fa2e0 0x55604310b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.367+0000 7ff45f490740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5560430ff370 0x5560430f3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.367+0000 7ff45a3ba640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560430f99a0 0x5560430f39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:06.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.367+0000 7ff45f490740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff4541b5e30 con 0x5560430ff370 2024-09-19T09:05:06.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.367+0000 7ff45f490740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff4541b86d0 con 0x5560430fa2e0 2024-09-19T09:05:06.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.367+0000 7ff45f490740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff4541b64c0 con 0x5560430f99a0 2024-09-19T09:05:06.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.367+0000 7ff459bb9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560430fa2e0 0x55604310b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:06.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.367+0000 7ff459bb9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560430fa2e0 0x55604310b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:45126/0 (socket says 172.21.15.92:45126) 2024-09-19T09:05:06.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.367+0000 7ff459bb9640 1 -- 172.21.15.92:0/2367663063 learned_addr learned my addr 172.21.15.92:0/2367663063 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:06.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.368+0000 7ff45abbb640 1 --2- 172.21.15.92:0/2367663063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5560430ff370 0x5560430f3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:06.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.371+0000 7ff459bb9640 1 -- 172.21.15.92:0/2367663063 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560430f99a0 msgr2=0x5560430f39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:06.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.371+0000 7ff459bb9640 1 --2- 172.21.15.92:0/2367663063 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560430f99a0 0x5560430f39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.371+0000 7ff459bb9640 1 -- 172.21.15.92:0/2367663063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5560430ff370 msgr2=0x5560430f3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:06.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.371+0000 7ff459bb9640 1 --2- 172.21.15.92:0/2367663063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5560430ff370 0x5560430f3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.371+0000 7ff459bb9640 1 -- 172.21.15.92:0/2367663063 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560431127e0 con 0x5560430fa2e0 2024-09-19T09:05:06.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.372+0000 7ff459bb9640 1 --2- 172.21.15.92:0/2367663063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560430fa2e0 0x55604310b160 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff444003ee0 tx=0x7ff44409c340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce52bf827bee8759 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:06.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.375+0000 7ff45abbb640 1 --2- 172.21.15.92:0/2367663063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5560430ff370 0x5560430f3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:06.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.378+0000 7ff43ffff640 1 -- 172.21.15.92:0/2367663063 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4440a8070 con 0x5560430fa2e0 2024-09-19T09:05:06.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.379+0000 7ff43ffff640 1 -- 172.21.15.92:0/2367663063 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff44409c8c0 con 0x5560430fa2e0 2024-09-19T09:05:06.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.379+0000 7ff43ffff640 1 -- 172.21.15.92:0/2367663063 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff444098830 con 0x5560430fa2e0 2024-09-19T09:05:06.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.380+0000 7ff45f490740 1 -- 172.21.15.92:0/2367663063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560430fa2e0 msgr2=0x55604310b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:06.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.380+0000 7ff45f490740 1 --2- 172.21.15.92:0/2367663063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560430fa2e0 0x55604310b160 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff444003ee0 tx=0x7ff44409c340 comp rx=0 tx=0).stop 2024-09-19T09:05:06.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.381+0000 7ff45f490740 1 -- 172.21.15.92:0/2367663063 shutdown_connections 2024-09-19T09:05:06.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.381+0000 7ff45f490740 1 --2- 172.21.15.92:0/2367663063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5560430ff370 0x5560430f3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.381+0000 7ff45f490740 1 --2- 172.21.15.92:0/2367663063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560430fa2e0 0x55604310b160 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.381+0000 7ff45f490740 1 --2- 172.21.15.92:0/2367663063 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560430f99a0 0x5560430f39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.381+0000 7ff45f490740 1 -- 172.21.15.92:0/2367663063 >> 172.21.15.92:0/2367663063 conn(0x5560430f5010 msgr2=0x556043103c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.383+0000 7ff45f490740 1 -- 172.21.15.92:0/2367663063 shutdown_connections 2024-09-19T09:05:06.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.386+0000 7ff45f490740 1 -- 172.21.15.92:0/2367663063 wait complete. 2024-09-19T09:05:06.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.387+0000 7ff45f490740 1 -- start start 2024-09-19T09:05:06.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.387+0000 7ff45f490740 1 Processor -- start 2024-09-19T09:05:06.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.387+0000 7ff45f490740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560430f99a0 0x556043108770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.387+0000 7ff45f490740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5560430fa2e0 0x556043108cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.387+0000 7ff45f490740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560430ff370 0x556043109c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.387+0000 7ff45f490740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff4541b6b90 con 0x5560430fa2e0 2024-09-19T09:05:06.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.387+0000 7ff45f490740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff4541b8000 con 0x5560430ff370 2024-09-19T09:05:06.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.387+0000 7ff45f490740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff4541b7260 con 0x5560430f99a0 2024-09-19T09:05:06.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.387+0000 7ff45f490740 10 client.0 _ll_register_callbacks cb 0x7ff444003e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:06.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.388+0000 7ff45abbb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560430ff370 0x556043109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.388+0000 7ff45abbb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560430ff370 0x556043109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:45138/0 (socket says 172.21.15.92:45138) 2024-09-19T09:05:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.388+0000 7ff45abbb640 1 -- 172.21.15.92:0/2744821259 learned_addr learned my addr 172.21.15.92:0/2744821259 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.388+0000 7ff45a3ba640 1 --2- 172.21.15.92:0/2744821259 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560430f99a0 0x556043108770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.388+0000 7ff459bb9640 1 --2- 172.21.15.92:0/2744821259 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5560430fa2e0 0x556043108cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.389+0000 7ff45a3ba640 1 -- 172.21.15.92:0/2744821259 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560430ff370 msgr2=0x556043109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.389+0000 7ff45a3ba640 1 --2- 172.21.15.92:0/2744821259 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560430ff370 0x556043109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.389+0000 7ff45a3ba640 1 -- 172.21.15.92:0/2744821259 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5560430fa2e0 msgr2=0x556043108cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.389+0000 7ff45a3ba640 1 --2- 172.21.15.92:0/2744821259 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5560430fa2e0 0x556043108cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.389+0000 7ff45a3ba640 1 -- 172.21.15.92:0/2744821259 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560430f5ca0 con 0x5560430f99a0 2024-09-19T09:05:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.390+0000 7ff45a3ba640 1 --2- 172.21.15.92:0/2744821259 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560430f99a0 0x556043108770 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x5560431129b0 tx=0x7ff450004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e6da3166628160e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.390+0000 7ff43dffb640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:05:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.390+0000 7ff43dffb640 1 -- 172.21.15.92:0/2744821259 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff450030030 con 0x5560430f99a0 2024-09-19T09:05:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.390+0000 7ff43dffb640 1 -- 172.21.15.92:0/2744821259 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff45000f040 con 0x5560430f99a0 2024-09-19T09:05:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.391+0000 7ff45f490740 1 -- 172.21.15.92:0/2744821259 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff44409c8c0 con 0x5560430f99a0 2024-09-19T09:05:06.394 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.393+0000 7ff43dffb640 1 -- 172.21.15.92:0/2744821259 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff450023cf0 con 0x5560430f99a0 2024-09-19T09:05:06.394 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.393+0000 7ff45f490740 10 client.26590 fetch_fsmap learned FSMap version 19 2024-09-19T09:05:06.394 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.393+0000 7ff45f490740 1 -- 172.21.15.92:0/2744821259 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55604310b490 con 0x5560430f99a0 2024-09-19T09:05:06.395 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.395+0000 7ff43dffb640 1 -- 172.21.15.92:0/2744821259 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff44409c8c0 con 0x5560430f99a0 2024-09-19T09:05:06.395 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.395+0000 7ff43dffb640 1 -- 172.21.15.92:0/2744821259 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff45002a040 con 0x5560430f99a0 2024-09-19T09:05:06.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.395+0000 7ff45f490740 10 client.26590 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:05:06.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.395+0000 7ff45f490740 10 client.26590 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:05:06.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.395+0000 7ff45f490740 20 client.26590 populate_metadata read hostname 'smithi092' 2024-09-19T09:05:06.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.395+0000 7ff45f490740 1 --2- 172.21.15.92:0/2744821259 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55604318c230 0x55604318e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.395+0000 7ff45f490740 4 client.26590 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:05:06.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.395+0000 7ff45f490740 1 -- 172.21.15.92:0/2744821259 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556043064d70 con 0x55604318c230 2024-09-19T09:05:06.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.397+0000 7ff459bb9640 1 --2- 172.21.15.92:0/2744821259 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55604318c230 0x55604318e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:06.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.398+0000 7ff459bb9640 1 --2- 172.21.15.92:0/2744821259 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55604318c230 0x55604318e650 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2960466a3a121a0 server_cookie=9fb6d7983b2fcaf4 in_seq=0 out_seq=0 2024-09-19T09:05:06.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.398+0000 7ff43dffb640 10 client.26590 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:06.432 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.430+0000 7ff43dffb640 1 -- 172.21.15.92:0/2744821259 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556043064d70 con 0x55604318c230 2024-09-19T09:05:06.432 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.430+0000 7ff43dffb640 10 client.26590 handle_command_reply: tid=0 2024-09-19T09:05:06.432 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.430+0000 7ff45f490740 1 client.26590 shutdown 2024-09-19T09:05:06.432 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.431+0000 7ff45f490740 1 -- 172.21.15.92:0/2744821259 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560430f99a0 msgr2=0x556043108770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:06.432 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.431+0000 7ff45f490740 1 --2- 172.21.15.92:0/2744821259 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560430f99a0 0x556043108770 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x5560431129b0 tx=0x7ff450004770 comp rx=0 tx=0).stop 2024-09-19T09:05:06.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.431+0000 7ff45f490740 1 -- 172.21.15.92:0/2744821259 shutdown_connections 2024-09-19T09:05:06.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.431+0000 7ff45f490740 1 --2- 172.21.15.92:0/2744821259 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55604318c230 0x55604318e650 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.431+0000 7ff45f490740 1 --2- 172.21.15.92:0/2744821259 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5560430ff370 0x556043109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.431+0000 7ff45f490740 1 --2- 172.21.15.92:0/2744821259 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5560430fa2e0 0x556043108cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.431+0000 7ff45f490740 1 --2- 172.21.15.92:0/2744821259 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560430f99a0 0x556043108770 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.431+0000 7ff45f490740 1 -- 172.21.15.92:0/2744821259 >> 172.21.15.92:0/2744821259 conn(0x5560430f5010 msgr2=0x5560430f39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:06.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.431+0000 7ff43dffb640 0 client.26590 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:06.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.431+0000 7ff45f490740 1 -- 172.21.15.92:0/2744821259 shutdown_connections 2024-09-19T09:05:06.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.431+0000 7ff45f490740 1 -- 172.21.15.92:0/2744821259 wait complete. 2024-09-19T09:05:06.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.431+0000 7ff45f490740 20 client.26590 trim_cache size 0 max 16384 2024-09-19T09:05:06.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:05:06.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:05:06.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:05:06.435 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:05:06.435 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.432+0000 7ff45c61e640 1 -- 172.21.15.92:0/3618117120 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff4400a3530 msgr2=0x7ff4400a59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:06.435 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.432+0000 7ff45c61e640 1 --2- 172.21.15.92:0/3618117120 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff4400a3530 0x7ff4400a59f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x5560430fad10 tx=0x7ff4500090e0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.432+0000 7f20b83cb640 1 -- 172.21.15.92:0/464142780 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20b0107220 con 0x7f20b0102d50 2024-09-19T09:05:06.437 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.432+0000 7ff45c61e640 1 -- 172.21.15.92:0/3618117120 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff454101c30 msgr2=0x7ff454196150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:06.437 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.432+0000 7ff45c61e640 1 --2- 172.21.15.92:0/3618117120 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff454101c30 0x7ff454196150 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff44400ea60 tx=0x7ff44400ef20 comp rx=0 tx=0).stop 2024-09-19T09:05:06.437 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.433+0000 7ff45c61e640 1 -- 172.21.15.92:0/3618117120 shutdown_connections 2024-09-19T09:05:06.437 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.433+0000 7ff45c61e640 1 --2- 172.21.15.92:0/3618117120 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff4400a3530 0x7ff4400a59f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.437 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.433+0000 7ff45c61e640 1 --2- 172.21.15.92:0/3618117120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4541025f0 0x7ff45419d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.437 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.433+0000 7ff45c61e640 1 --2- 172.21.15.92:0/3618117120 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff454101c30 0x7ff454196150 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.437 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.433+0000 7ff45c61e640 1 --2- 172.21.15.92:0/3618117120 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff454100a40 0x7ff454195c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.437 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.433+0000 7ff45c61e640 1 -- 172.21.15.92:0/3618117120 >> 172.21.15.92:0/3618117120 conn(0x7ff4540fc1e0 msgr2=0x7ff4540fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.433+0000 7ff45c61e640 1 -- 172.21.15.92:0/3618117120 shutdown_connections 2024-09-19T09:05:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:06.433+0000 7ff45c61e640 1 -- 172.21.15.92:0/3618117120 wait complete. 2024-09-19T09:05:06.438 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:05:06.438 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:05:06.439 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:05:06.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.434+0000 7f20a77fe640 1 -- 172.21.15.92:0/464142780 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f20ac09fd30 con 0x7f20b0102d50 2024-09-19T09:05:06.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.437+0000 7f20b83cb640 1 -- 172.21.15.92:0/464142780 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f209c0a32c0 msgr2=0x7f209c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:06.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.437+0000 7f20b83cb640 1 --2- 172.21.15.92:0/464142780 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f209c0a32c0 0x7f209c0a5780 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f20b0102440 tx=0x7f20a0005f90 comp rx=0 tx=0).stop 2024-09-19T09:05:06.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.437+0000 7f20b83cb640 1 -- 172.21.15.92:0/464142780 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f20b0102d50 msgr2=0x7f20b01009b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:06.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.437+0000 7f20b83cb640 1 --2- 172.21.15.92:0/464142780 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f20b0102d50 0x7f20b01009b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f20ac00d6d0 tx=0x7f20ac00db90 comp rx=0 tx=0).stop 2024-09-19T09:05:06.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.438+0000 7f20b83cb640 1 -- 172.21.15.92:0/464142780 shutdown_connections 2024-09-19T09:05:06.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.438+0000 7f20b83cb640 1 --2- 172.21.15.92:0/464142780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20b010c180 0x7f20b0101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.438+0000 7f20b83cb640 1 --2- 172.21.15.92:0/464142780 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f209c0a32c0 0x7f209c0a5780 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.438+0000 7f20b83cb640 1 --2- 172.21.15.92:0/464142780 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20b0103670 0x7f20b0100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.438+0000 7f20b83cb640 1 --2- 172.21.15.92:0/464142780 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f20b0102d50 0x7f20b01009b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.438+0000 7f20b83cb640 1 -- 172.21.15.92:0/464142780 >> 172.21.15.92:0/464142780 conn(0x7f20b00fc7d0 msgr2=0x7f20b00fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:06.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.438+0000 7f20b83cb640 1 -- 172.21.15.92:0/464142780 shutdown_connections 2024-09-19T09:05:06.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:06.438+0000 7f20b83cb640 1 -- 172.21.15.92:0/464142780 wait complete. 2024-09-19T09:05:06.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:06 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/464142780' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:05:06.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:06 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/464142780' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:05:06.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:06 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/464142780' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:05:07.240 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:05:07.651 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:07.781 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:07 smithi092 ceph-mon[31407]: pgmap v589: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.3 MiB/s wr, 658 op/s 2024-09-19T09:05:07.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:07 smithi167 ceph-mon[35359]: pgmap v589: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.3 MiB/s wr, 658 op/s 2024-09-19T09:05:07.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:07 smithi190 ceph-mon[35358]: pgmap v589: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.3 MiB/s wr, 658 op/s 2024-09-19T09:05:08.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.186+0000 7fb88587a640 1 -- 172.21.15.92:0/2505202111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb88010ea80 msgr2=0x7fb8801154f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:08.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.186+0000 7fb88587a640 1 --2- 172.21.15.92:0/2505202111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb88010ea80 0x7fb8801154f0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fb878005fd0 tx=0x7fb87802a2e0 comp rx=0 tx=0).stop 2024-09-19T09:05:08.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.186+0000 7fb88587a640 1 -- 172.21.15.92:0/2505202111 shutdown_connections 2024-09-19T09:05:08.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.186+0000 7fb88587a640 1 --2- 172.21.15.92:0/2505202111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb88010ea80 0x7fb8801154f0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:08.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.186+0000 7fb88587a640 1 --2- 172.21.15.92:0/2505202111 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb880109e00 0x7fb88010e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:08.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.186+0000 7fb88587a640 1 --2- 172.21.15.92:0/2505202111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb880109450 0x7fb880109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:08.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.186+0000 7fb88587a640 1 -- 172.21.15.92:0/2505202111 >> 172.21.15.92:0/2505202111 conn(0x7fb88006e2d0 msgr2=0x7fb88006e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:08.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.186+0000 7fb88587a640 1 -- 172.21.15.92:0/2505202111 shutdown_connections 2024-09-19T09:05:08.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.186+0000 7fb88587a640 1 -- 172.21.15.92:0/2505202111 wait complete. 2024-09-19T09:05:08.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.187+0000 7fb88587a640 1 Processor -- start 2024-09-19T09:05:08.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.188+0000 7fb88587a640 1 -- start start 2024-09-19T09:05:08.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.188+0000 7fb88587a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb880109450 0x7fb8801a71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:08.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.189+0000 7fb88587a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb880109e00 0x7fb8801a7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:08.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.189+0000 7fb88587a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb88010ea80 0x7fb8801aba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:08.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.189+0000 7fb88587a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb880120d80 con 0x7fb88010ea80 2024-09-19T09:05:08.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.189+0000 7fb88587a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb880120c00 con 0x7fb880109450 2024-09-19T09:05:08.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.189+0000 7fb88587a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb880120f00 con 0x7fb880109e00 2024-09-19T09:05:08.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.189+0000 7fb87effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb880109450 0x7fb8801a71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:08.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.189+0000 7fb87effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb880109450 0x7fb8801a71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:45146/0 (socket says 172.21.15.92:45146) 2024-09-19T09:05:08.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.189+0000 7fb87effd640 1 -- 172.21.15.92:0/4105457370 learned_addr learned my addr 172.21.15.92:0/4105457370 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:08.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.189+0000 7fb87f7fe640 1 --2- 172.21.15.92:0/4105457370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb88010ea80 0x7fb8801aba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:08.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.189+0000 7fb87e7fc640 1 --2- 172.21.15.92:0/4105457370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb880109e00 0x7fb8801a7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:08.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.189+0000 7fb87effd640 1 -- 172.21.15.92:0/4105457370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb880109e00 msgr2=0x7fb8801a7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:08.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.189+0000 7fb87effd640 1 --2- 172.21.15.92:0/4105457370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb880109e00 0x7fb8801a7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:08.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.189+0000 7fb87effd640 1 -- 172.21.15.92:0/4105457370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb88010ea80 msgr2=0x7fb8801aba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:08.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.189+0000 7fb87effd640 1 --2- 172.21.15.92:0/4105457370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb88010ea80 0x7fb8801aba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:08.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.189+0000 7fb87effd640 1 -- 172.21.15.92:0/4105457370 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8801ac170 con 0x7fb880109450 2024-09-19T09:05:08.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.190+0000 7fb87effd640 1 --2- 172.21.15.92:0/4105457370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb880109450 0x7fb8801a71c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb870009990 tx=0x7fb870009e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:08.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.191+0000 7fb884878640 1 -- 172.21.15.92:0/4105457370 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87001b070 con 0x7fb880109450 2024-09-19T09:05:08.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.191+0000 7fb884878640 1 -- 172.21.15.92:0/4105457370 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb870016410 con 0x7fb880109450 2024-09-19T09:05:08.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.191+0000 7fb884878640 1 -- 172.21.15.92:0/4105457370 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb870015610 con 0x7fb880109450 2024-09-19T09:05:08.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.191+0000 7fb88587a640 1 -- 172.21.15.92:0/4105457370 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8801ac460 con 0x7fb880109450 2024-09-19T09:05:08.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.191+0000 7fb88587a640 1 -- 172.21.15.92:0/4105457370 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8801b3d40 con 0x7fb880109450 2024-09-19T09:05:08.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.195+0000 7fb884878640 1 -- 172.21.15.92:0/4105457370 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb87001e070 con 0x7fb880109450 2024-09-19T09:05:08.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.195+0000 7fb887c53740 1 Processor -- start 2024-09-19T09:05:08.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.195+0000 7fb887c53740 1 -- start start 2024-09-19T09:05:08.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.196+0000 7fb887c53740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56244db43b40 0x56244db42090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:08.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.196+0000 7fb887c53740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56244db425d0 0x56244db42a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:08.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.196+0000 7fb887c53740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56244db4d370 0x56244db4f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:08.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.196+0000 7fb887c53740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56244daa82f0 con 0x56244db43b40 2024-09-19T09:05:08.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.196+0000 7fb887c53740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56244da4fcf0 con 0x56244db4d370 2024-09-19T09:05:08.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.196+0000 7fb887c53740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56244daa42b0 con 0x56244db425d0 2024-09-19T09:05:08.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.196+0000 7fb87effd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56244db425d0 0x56244db42a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:08.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.196+0000 7fb87effd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56244db425d0 0x56244db42a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:52632/0 (socket says 172.21.15.92:52632) 2024-09-19T09:05:08.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.196+0000 7fb87effd640 1 -- 172.21.15.92:0/660321205 learned_addr learned my addr 172.21.15.92:0/660321205 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:08.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.196+0000 7fb87e7fc640 1 --2- 172.21.15.92:0/660321205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56244db4d370 0x56244db4f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:08.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.196+0000 7fb87f7fe640 1 --2- 172.21.15.92:0/660321205 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56244db43b40 0x56244db42090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:08.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.196+0000 7fb884878640 1 --2- 172.21.15.92:0/4105457370 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb8640a3380 0x7fb8640a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:08.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.196+0000 7fb87f7fe640 1 --2- 172.21.15.92:0/4105457370 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb8640a3380 0x7fb8640a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:08.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.197+0000 7fb884878640 1 -- 172.21.15.92:0/4105457370 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb8700cec50 con 0x7fb880109450 2024-09-19T09:05:08.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.197+0000 7fb87e7fc640 1 -- 172.21.15.92:0/660321205 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56244db425d0 msgr2=0x56244db42a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:08.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.197+0000 7fb87e7fc640 1 --2- 172.21.15.92:0/660321205 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56244db425d0 0x56244db42a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:08.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.197+0000 7fb87e7fc640 1 -- 172.21.15.92:0/660321205 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56244db43b40 msgr2=0x56244db42090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:08.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.197+0000 7fb87e7fc640 1 --2- 172.21.15.92:0/660321205 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56244db43b40 0x56244db42090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:08.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.197+0000 7fb87e7fc640 1 -- 172.21.15.92:0/660321205 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56244da343a0 con 0x56244db4d370 2024-09-19T09:05:08.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.197+0000 7fb87e7fc640 1 --2- 172.21.15.92:0/660321205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56244db4d370 0x56244db4f760 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb880073a60 tx=0x7fb86c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=856abcc42f7572c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:08.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.198+0000 7fb87f7fe640 1 --2- 172.21.15.92:0/4105457370 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb8640a3380 0x7fb8640a5840 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb87800d090 tx=0x7fb87802a2e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:08.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.199+0000 7fb875ffb640 1 -- 172.21.15.92:0/660321205 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb86c009d50 con 0x56244db4d370 2024-09-19T09:05:08.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.199+0000 7fb875ffb640 1 -- 172.21.15.92:0/660321205 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb86c005020 con 0x56244db4d370 2024-09-19T09:05:08.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.200+0000 7fb875ffb640 1 -- 172.21.15.92:0/660321205 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb86c009d50 con 0x56244db4d370 2024-09-19T09:05:08.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.200+0000 7fb887c53740 1 -- 172.21.15.92:0/660321205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56244db4d370 msgr2=0x56244db4f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:08.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.200+0000 7fb887c53740 1 --2- 172.21.15.92:0/660321205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56244db4d370 0x56244db4f760 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb880073a60 tx=0x7fb86c011810 comp rx=0 tx=0).stop 2024-09-19T09:05:08.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.200+0000 7fb887c53740 1 -- 172.21.15.92:0/660321205 shutdown_connections 2024-09-19T09:05:08.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.200+0000 7fb887c53740 1 --2- 172.21.15.92:0/660321205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56244db4d370 0x56244db4f760 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:08.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.200+0000 7fb887c53740 1 --2- 172.21.15.92:0/660321205 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56244db425d0 0x56244db42a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:08.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.200+0000 7fb887c53740 1 --2- 172.21.15.92:0/660321205 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56244db43b40 0x56244db42090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:08.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.200+0000 7fb887c53740 1 -- 172.21.15.92:0/660321205 >> 172.21.15.92:0/660321205 conn(0x56244db0b310 msgr2=0x56244db3ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:08.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.200+0000 7fb887c53740 1 -- 172.21.15.92:0/660321205 shutdown_connections 2024-09-19T09:05:08.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.200+0000 7fb887c53740 1 -- 172.21.15.92:0/660321205 wait complete. 2024-09-19T09:05:08.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.201+0000 7fb887c53740 1 -- start start 2024-09-19T09:05:08.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.201+0000 7fb887c53740 1 Processor -- start 2024-09-19T09:05:08.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.202+0000 7fb887c53740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56244db425d0 0x56244db4cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:08.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.202+0000 7fb887c53740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56244db43b40 0x56244db49e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:08.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.202+0000 7fb887c53740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56244db4d370 0x56244db4a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:08.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.202+0000 7fb887c53740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56244db500c0 con 0x56244db4d370 2024-09-19T09:05:08.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.202+0000 7fb887c53740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56244da63060 con 0x56244db43b40 2024-09-19T09:05:08.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.202+0000 7fb887c53740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56244db50240 con 0x56244db425d0 2024-09-19T09:05:08.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.202+0000 7fb887c53740 10 client.0 _ll_register_callbacks cb 0x56244d7b68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:08.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.202+0000 7fb87f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56244db4d370 0x56244db4a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:08.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.202+0000 7fb87effd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56244db425d0 0x56244db4cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:08.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.202+0000 7fb87e7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56244db43b40 0x56244db49e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:08.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.202+0000 7fb87f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56244db4d370 0x56244db4a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55350/0 (socket says 172.21.15.92:55350) 2024-09-19T09:05:08.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.202+0000 7fb87effd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56244db425d0 0x56244db4cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:52642/0 (socket says 172.21.15.92:52642) 2024-09-19T09:05:08.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.202+0000 7fb87f7fe640 1 -- 172.21.15.92:0/2888423377 learned_addr learned my addr 172.21.15.92:0/2888423377 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:08.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.202+0000 7fb87e7fc640 1 -- 172.21.15.92:0/2888423377 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56244db425d0 msgr2=0x56244db4cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:08.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.202+0000 7fb87e7fc640 1 --2- 172.21.15.92:0/2888423377 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56244db425d0 0x56244db4cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:08.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.202+0000 7fb87e7fc640 1 -- 172.21.15.92:0/2888423377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56244db4d370 msgr2=0x56244db4a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:08.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.202+0000 7fb87e7fc640 1 --2- 172.21.15.92:0/2888423377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56244db4d370 0x56244db4a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:08.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.202+0000 7fb87e7fc640 1 -- 172.21.15.92:0/2888423377 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56244d8193c0 con 0x56244db43b40 2024-09-19T09:05:08.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.203+0000 7fb87e7fc640 1 --2- 172.21.15.92:0/2888423377 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56244db43b40 0x56244db49e90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb86c0096e0 tx=0x7fb86c0098b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8a0c4a1a31b8dff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:08.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.203+0000 7fb862ffd640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:05:08.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.203+0000 7fb862ffd640 1 -- 172.21.15.92:0/2888423377 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb86c029020 con 0x56244db43b40 2024-09-19T09:05:08.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.204+0000 7fb862ffd640 1 -- 172.21.15.92:0/2888423377 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb86c004a20 con 0x56244db43b40 2024-09-19T09:05:08.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.204+0000 7fb887c53740 1 -- 172.21.15.92:0/2888423377 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb86c005020 con 0x56244db43b40 2024-09-19T09:05:08.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.204+0000 7fb862ffd640 1 -- 172.21.15.92:0/2888423377 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb86c004c20 con 0x56244db43b40 2024-09-19T09:05:08.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.204+0000 7fb887c53740 10 client.26702 fetch_fsmap learned FSMap version 19 2024-09-19T09:05:08.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.204+0000 7fb887c53740 1 -- 172.21.15.92:0/2888423377 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56244db5ba70 con 0x56244db43b40 2024-09-19T09:05:08.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.205+0000 7fb862ffd640 1 -- 172.21.15.92:0/2888423377 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb86c005020 con 0x56244db43b40 2024-09-19T09:05:08.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.205+0000 7fb862ffd640 1 -- 172.21.15.92:0/2888423377 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fb86c023420 con 0x56244db43b40 2024-09-19T09:05:08.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.205+0000 7fb887c53740 10 client.26702 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:05:08.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.205+0000 7fb887c53740 10 client.26702 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:05:08.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.205+0000 7fb887c53740 20 client.26702 populate_metadata read hostname 'smithi092' 2024-09-19T09:05:08.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.205+0000 7fb887c53740 1 --2- 172.21.15.92:0/2888423377 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56244db5ce20 0x56244db5f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:08.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.205+0000 7fb887c53740 4 client.26702 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:05:08.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.205+0000 7fb887c53740 1 -- 172.21.15.92:0/2888423377 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56244dab5860 con 0x56244db5ce20 2024-09-19T09:05:08.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.207+0000 7fb87effd640 1 --2- 172.21.15.92:0/2888423377 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56244db5ce20 0x56244db5f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:08.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.208+0000 7fb87effd640 1 --2- 172.21.15.92:0/2888423377 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56244db5ce20 0x56244db5f210 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34980578fec24d1 server_cookie=540be403e11f51f7 in_seq=0 out_seq=0 2024-09-19T09:05:08.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.208+0000 7fb862ffd640 10 client.26702 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:08.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.209+0000 7fb862ffd640 1 -- 172.21.15.92:0/2888423377 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56244dab5860 con 0x56244db5ce20 2024-09-19T09:05:08.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.209+0000 7fb862ffd640 10 client.26702 handle_command_reply: tid=0 2024-09-19T09:05:08.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.209+0000 7fb887c53740 1 client.26702 shutdown 2024-09-19T09:05:08.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.209+0000 7fb887c53740 1 -- 172.21.15.92:0/2888423377 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56244db43b40 msgr2=0x56244db49e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:08.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.209+0000 7fb887c53740 1 --2- 172.21.15.92:0/2888423377 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56244db43b40 0x56244db49e90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb86c0096e0 tx=0x7fb86c0098b0 comp rx=0 tx=0).stop 2024-09-19T09:05:08.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.210+0000 7fb887c53740 1 -- 172.21.15.92:0/2888423377 shutdown_connections 2024-09-19T09:05:08.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.210+0000 7fb887c53740 1 --2- 172.21.15.92:0/2888423377 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56244db5ce20 0x56244db5f210 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:08.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.210+0000 7fb887c53740 1 --2- 172.21.15.92:0/2888423377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56244db4d370 0x56244db4a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:08.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.210+0000 7fb887c53740 1 --2- 172.21.15.92:0/2888423377 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56244db43b40 0x56244db49e90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:08.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.210+0000 7fb887c53740 1 --2- 172.21.15.92:0/2888423377 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56244db425d0 0x56244db4cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:08.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.210+0000 7fb887c53740 1 -- 172.21.15.92:0/2888423377 >> 172.21.15.92:0/2888423377 conn(0x56244db0b310 msgr2=0x56244db44930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:08.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.210+0000 7fb862ffd640 0 client.26702 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:08.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.210+0000 7fb887c53740 1 -- 172.21.15.92:0/2888423377 shutdown_connections 2024-09-19T09:05:08.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.210+0000 7fb887c53740 1 -- 172.21.15.92:0/2888423377 wait complete. 2024-09-19T09:05:08.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.211+0000 7fb887c53740 20 client.26702 trim_cache size 0 max 16384 2024-09-19T09:05:08.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.239+0000 7fb887c53740 1 Processor -- start 2024-09-19T09:05:08.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.239+0000 7fb887c53740 1 -- start start 2024-09-19T09:05:08.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.239+0000 7fb887c53740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56244db425d0 0x56244db45310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:08.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.240+0000 7fb887c53740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56244db43b40 0x56244db48e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:08.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.240+0000 7fb887c53740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56244db4d370 0x56244db648d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:08.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.240+0000 7fb87effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56244db425d0 0x56244db45310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:08.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.240+0000 7fb87effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56244db425d0 0x56244db45310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:45182/0 (socket says 172.21.15.92:45182) 2024-09-19T09:05:08.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.240+0000 7fb87e7fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56244db43b40 0x56244db48e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:08.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.240+0000 7fb87e7fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56244db43b40 0x56244db48e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:52644/0 (socket says 172.21.15.92:52644) 2024-09-19T09:05:08.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.240+0000 7fb87effd640 1 -- 172.21.15.92:0/3257180285 learned_addr learned my addr 172.21.15.92:0/3257180285 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:08.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.240+0000 7fb887c53740 1 -- 172.21.15.92:0/3257180285 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb8801ba440 con 0x56244db4d370 2024-09-19T09:05:08.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.240+0000 7fb887c53740 1 -- 172.21.15.92:0/3257180285 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb8801bcce0 con 0x56244db425d0 2024-09-19T09:05:08.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.240+0000 7fb887c53740 1 -- 172.21.15.92:0/3257180285 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb8801baad0 con 0x56244db43b40 2024-09-19T09:05:08.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.241+0000 7fb87f7fe640 1 --2- 172.21.15.92:0/3257180285 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56244db4d370 0x56244db648d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:08.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.241+0000 7fb87effd640 1 -- 172.21.15.92:0/3257180285 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56244db43b40 msgr2=0x56244db48e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:08.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.241+0000 7fb87effd640 1 --2- 172.21.15.92:0/3257180285 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56244db43b40 0x56244db48e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:08.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.241+0000 7fb87effd640 1 -- 172.21.15.92:0/3257180285 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56244db4d370 msgr2=0x56244db648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:08.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.241+0000 7fb87effd640 1 --2- 172.21.15.92:0/3257180285 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56244db4d370 0x56244db648d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:08.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.241+0000 7fb87effd640 1 -- 172.21.15.92:0/3257180285 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56244db3fdf0 con 0x56244db425d0 2024-09-19T09:05:08.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.241+0000 7fb87effd640 1 --2- 172.21.15.92:0/3257180285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56244db425d0 0x56244db45310 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb870009960 tx=0x7fb87000f040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb7f75dd0c2b8a1c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:08.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.245+0000 7fb8757fa640 1 -- 172.21.15.92:0/3257180285 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8700af070 con 0x56244db425d0 2024-09-19T09:05:08.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.245+0000 7fb8757fa640 1 -- 172.21.15.92:0/3257180285 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb870095e50 con 0x56244db425d0 2024-09-19T09:05:08.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.245+0000 7fb8757fa640 1 -- 172.21.15.92:0/3257180285 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8700165c0 con 0x56244db425d0 2024-09-19T09:05:08.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.246+0000 7fb887c53740 1 -- 172.21.15.92:0/3257180285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56244db425d0 msgr2=0x56244db45310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:08.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.246+0000 7fb887c53740 1 --2- 172.21.15.92:0/3257180285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56244db425d0 0x56244db45310 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb870009960 tx=0x7fb87000f040 comp rx=0 tx=0).stop 2024-09-19T09:05:08.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.248+0000 7fb887c53740 1 -- 172.21.15.92:0/3257180285 shutdown_connections 2024-09-19T09:05:08.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.248+0000 7fb887c53740 1 --2- 172.21.15.92:0/3257180285 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56244db4d370 0x56244db648d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:08.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.248+0000 7fb887c53740 1 --2- 172.21.15.92:0/3257180285 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56244db43b40 0x56244db48e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:08.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.248+0000 7fb887c53740 1 --2- 172.21.15.92:0/3257180285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56244db425d0 0x56244db45310 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:08.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.248+0000 7fb887c53740 1 -- 172.21.15.92:0/3257180285 >> 172.21.15.92:0/3257180285 conn(0x56244db0b310 msgr2=0x56244db48760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:08.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.251+0000 7fb887c53740 1 -- 172.21.15.92:0/3257180285 shutdown_connections 2024-09-19T09:05:08.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.251+0000 7fb887c53740 1 -- 172.21.15.92:0/3257180285 wait complete. 2024-09-19T09:05:08.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.251+0000 7fb887c53740 1 -- start start 2024-09-19T09:05:08.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.251+0000 7fb887c53740 1 Processor -- start 2024-09-19T09:05:08.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.252+0000 7fb887c53740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56244db425d0 0x56244db46ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:08.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.252+0000 7fb887c53740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56244db43b40 0x56244db47410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:08.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.252+0000 7fb887c53740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56244db4d370 0x56244db47950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:08.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.252+0000 7fb87effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56244db425d0 0x56244db46ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:08.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.252+0000 7fb87effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56244db425d0 0x56244db46ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:45190/0 (socket says 172.21.15.92:45190) 2024-09-19T09:05:08.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.252+0000 7fb87effd640 1 -- 172.21.15.92:0/2493450187 learned_addr learned my addr 172.21.15.92:0/2493450187 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:08.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.252+0000 7fb887c53740 1 -- 172.21.15.92:0/2493450187 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb8801bb1a0 con 0x56244db43b40 2024-09-19T09:05:08.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.252+0000 7fb887c53740 1 -- 172.21.15.92:0/2493450187 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb8801bc610 con 0x56244db425d0 2024-09-19T09:05:08.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.252+0000 7fb887c53740 1 -- 172.21.15.92:0/2493450187 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb8801bb870 con 0x56244db4d370 2024-09-19T09:05:08.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.252+0000 7fb87f7fe640 1 --2- 172.21.15.92:0/2493450187 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56244db4d370 0x56244db47950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:08.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.252+0000 7fb887c53740 10 client.0 _ll_register_callbacks cb 0x7fb86c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:08.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.254+0000 7fb87effd640 1 -- 172.21.15.92:0/2493450187 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56244db4d370 msgr2=0x56244db47950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:08.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.254+0000 7fb87effd640 1 --2- 172.21.15.92:0/2493450187 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56244db4d370 0x56244db47950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:08.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.254+0000 7fb87effd640 1 -- 172.21.15.92:0/2493450187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56244db43b40 msgr2=0x56244db47410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:08.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.254+0000 7fb87effd640 1 --2- 172.21.15.92:0/2493450187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56244db43b40 0x56244db47410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:08.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.254+0000 7fb87effd640 1 -- 172.21.15.92:0/2493450187 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56244dbc68f0 con 0x56244db425d0 2024-09-19T09:05:08.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.254+0000 7fb87effd640 1 --2- 172.21.15.92:0/2493450187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56244db425d0 0x56244db46ed0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb8700ce040 tx=0x7fb870016d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cebad5bd5d67f80 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:08.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.254+0000 7fb862ffd640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:05:08.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.255+0000 7fb862ffd640 1 -- 172.21.15.92:0/2493450187 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8700b3070 con 0x56244db425d0 2024-09-19T09:05:08.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.255+0000 7fb887c53740 1 -- 172.21.15.92:0/2493450187 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb870095e50 con 0x56244db425d0 2024-09-19T09:05:08.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.255+0000 7fb862ffd640 1 -- 172.21.15.92:0/2493450187 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb870097950 con 0x56244db425d0 2024-09-19T09:05:08.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.255+0000 7fb862ffd640 1 -- 172.21.15.92:0/2493450187 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb8700af050 con 0x56244db425d0 2024-09-19T09:05:08.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.257+0000 7fb887c53740 10 client.26708 fetch_fsmap learned FSMap version 19 2024-09-19T09:05:08.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.257+0000 7fb887c53740 1 -- 172.21.15.92:0/2493450187 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56244dbc7bb0 con 0x56244db425d0 2024-09-19T09:05:08.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.260+0000 7fb862ffd640 1 -- 172.21.15.92:0/2493450187 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb870095e50 con 0x56244db425d0 2024-09-19T09:05:08.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.261+0000 7fb862ffd640 1 -- 172.21.15.92:0/2493450187 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fb8700ccbd0 con 0x56244db425d0 2024-09-19T09:05:08.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.262+0000 7fb887c53740 10 client.26708 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:05:08.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.262+0000 7fb887c53740 10 client.26708 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:05:08.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.262+0000 7fb887c53740 20 client.26708 populate_metadata read hostname 'smithi092' 2024-09-19T09:05:08.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.262+0000 7fb887c53740 1 --2- 172.21.15.92:0/2493450187 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56244dbc8230 0x56244dbca650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:08.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.262+0000 7fb887c53740 4 client.26708 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:05:08.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.262+0000 7fb887c53740 1 -- 172.21.15.92:0/2493450187 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56244daafd70 con 0x56244dbc8230 2024-09-19T09:05:08.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.262+0000 7fb87e7fc640 1 --2- 172.21.15.92:0/2493450187 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56244dbc8230 0x56244dbca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:08.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.264+0000 7fb87e7fc640 1 --2- 172.21.15.92:0/2493450187 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56244dbc8230 0x56244dbca650 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e0b68da25f48f8b server_cookie=7b13d695ba8c8fda in_seq=0 out_seq=0 2024-09-19T09:05:08.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.264+0000 7fb862ffd640 10 client.26708 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:08.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.264+0000 7fb862ffd640 1 -- 172.21.15.92:0/2493450187 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56244daafd70 con 0x56244dbc8230 2024-09-19T09:05:08.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.264+0000 7fb862ffd640 10 client.26708 handle_command_reply: tid=0 2024-09-19T09:05:08.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.264+0000 7fb887c53740 1 client.26708 shutdown 2024-09-19T09:05:08.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.267+0000 7fb887c53740 1 -- 172.21.15.92:0/2493450187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56244db425d0 msgr2=0x56244db46ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:08.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.267+0000 7fb887c53740 1 --2- 172.21.15.92:0/2493450187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56244db425d0 0x56244db46ed0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb8700ce040 tx=0x7fb870016d30 comp rx=0 tx=0).stop 2024-09-19T09:05:08.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.267+0000 7fb887c53740 1 -- 172.21.15.92:0/2493450187 shutdown_connections 2024-09-19T09:05:08.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.267+0000 7fb887c53740 1 --2- 172.21.15.92:0/2493450187 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56244dbc8230 0x56244dbca650 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:08.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.267+0000 7fb887c53740 1 --2- 172.21.15.92:0/2493450187 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56244db4d370 0x56244db47950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:08.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.267+0000 7fb887c53740 1 --2- 172.21.15.92:0/2493450187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56244db43b40 0x56244db47410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:08.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.267+0000 7fb887c53740 1 --2- 172.21.15.92:0/2493450187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56244db425d0 0x56244db46ed0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:08.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.267+0000 7fb887c53740 1 -- 172.21.15.92:0/2493450187 >> 172.21.15.92:0/2493450187 conn(0x56244db0b310 msgr2=0x56244db48f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:08.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.267+0000 7fb862ffd640 0 client.26708 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:08.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.267+0000 7fb887c53740 1 -- 172.21.15.92:0/2493450187 shutdown_connections 2024-09-19T09:05:08.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.267+0000 7fb887c53740 1 -- 172.21.15.92:0/2493450187 wait complete. 2024-09-19T09:05:08.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.268+0000 7fb887c53740 20 client.26708 trim_cache size 0 max 16384 2024-09-19T09:05:08.271 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-19T09:05:08.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.271+0000 7fb88587a640 1 -- 172.21.15.92:0/4105457370 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb8640a3380 msgr2=0x7fb8640a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:08.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.271+0000 7fb88587a640 1 --2- 172.21.15.92:0/4105457370 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb8640a3380 0x7fb8640a5840 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb87800d090 tx=0x7fb87802a2e0 comp rx=0 tx=0).stop 2024-09-19T09:05:08.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.271+0000 7fb88587a640 1 -- 172.21.15.92:0/4105457370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb880109450 msgr2=0x7fb8801a71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:08.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.271+0000 7fb88587a640 1 --2- 172.21.15.92:0/4105457370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb880109450 0x7fb8801a71c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb870009990 tx=0x7fb870009e50 comp rx=0 tx=0).stop 2024-09-19T09:05:08.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.271+0000 7fb88587a640 1 -- 172.21.15.92:0/4105457370 shutdown_connections 2024-09-19T09:05:08.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.271+0000 7fb88587a640 1 --2- 172.21.15.92:0/4105457370 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb8640a3380 0x7fb8640a5840 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:08.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.271+0000 7fb88587a640 1 --2- 172.21.15.92:0/4105457370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb88010ea80 0x7fb8801aba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:08.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.271+0000 7fb88587a640 1 --2- 172.21.15.92:0/4105457370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb880109e00 0x7fb8801a7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:08.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.271+0000 7fb88587a640 1 --2- 172.21.15.92:0/4105457370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb880109450 0x7fb8801a71c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:08.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.271+0000 7fb88587a640 1 -- 172.21.15.92:0/4105457370 >> 172.21.15.92:0/4105457370 conn(0x7fb88006e2d0 msgr2=0x7fb88010c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:08.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.271+0000 7fb88587a640 1 -- 172.21.15.92:0/4105457370 shutdown_connections 2024-09-19T09:05:08.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:08.272+0000 7fb88587a640 1 -- 172.21.15.92:0/4105457370 wait complete. 2024-09-19T09:05:09.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:09 smithi167 ceph-mon[35359]: pgmap v590: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.7 MiB/s wr, 708 op/s 2024-09-19T09:05:09.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:09 smithi190 ceph-mon[35358]: pgmap v590: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.7 MiB/s wr, 708 op/s 2024-09-19T09:05:10.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:09 smithi092 ceph-mon[31407]: pgmap v590: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.7 MiB/s wr, 708 op/s 2024-09-19T09:05:10.277 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:05:10.277 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:05:10.685 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:10.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 505.0 s, 3400.0 tps, lat 29.576 ms stddev 34.409 2024-09-19T09:05:11.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.254+0000 7f501d03b640 1 -- 172.21.15.92:0/574699205 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50181138b0 msgr2=0x7f5018115ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:11.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.254+0000 7f501d03b640 1 --2- 172.21.15.92:0/574699205 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50181138b0 0x7f5018115ca0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f500c009900 tx=0x7f500c02a480 comp rx=0 tx=0).stop 2024-09-19T09:05:11.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.254+0000 7f501d03b640 1 -- 172.21.15.92:0/574699205 shutdown_connections 2024-09-19T09:05:11.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.254+0000 7f501d03b640 1 --2- 172.21.15.92:0/574699205 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50181138b0 0x7f5018115ca0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.254+0000 7f501d03b640 1 --2- 172.21.15.92:0/574699205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f501810ac20 0x7f5018113370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.254+0000 7f501d03b640 1 --2- 172.21.15.92:0/574699205 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f501810a300 0x7f501810a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.254+0000 7f501d03b640 1 -- 172.21.15.92:0/574699205 >> 172.21.15.92:0/574699205 conn(0x7f50180735f0 msgr2=0x7f5018073a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:11.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.254+0000 7f501d03b640 1 -- 172.21.15.92:0/574699205 shutdown_connections 2024-09-19T09:05:11.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.254+0000 7f501d03b640 1 -- 172.21.15.92:0/574699205 wait complete. 2024-09-19T09:05:11.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.255+0000 7f501d03b640 1 Processor -- start 2024-09-19T09:05:11.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.256+0000 7f501d03b640 1 -- start start 2024-09-19T09:05:11.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.256+0000 7f501d03b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f501810a300 0x7f50181a8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:11.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.256+0000 7f501d03b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f501810ac20 0x7f50181a8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:11.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.257+0000 7f5016d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f501810a300 0x7f50181a8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:11.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.257+0000 7f5016d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f501810a300 0x7f50181a8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:45216/0 (socket says 172.21.15.92:45216) 2024-09-19T09:05:11.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.257+0000 7f501d03b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50181138b0 0x7f50181a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:11.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.257+0000 7f501d03b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5018119520 con 0x7f501810ac20 2024-09-19T09:05:11.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.257+0000 7f501d03b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f50181193a0 con 0x7f501810a300 2024-09-19T09:05:11.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.257+0000 7f501d03b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f50181196a0 con 0x7f50181138b0 2024-09-19T09:05:11.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.257+0000 7f5016d9d640 1 -- 172.21.15.92:0/341034485 learned_addr learned my addr 172.21.15.92:0/341034485 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:11.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.257+0000 7f5016d9d640 1 -- 172.21.15.92:0/341034485 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50181138b0 msgr2=0x7f50181a2b00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:05:11.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.257+0000 7f5016d9d640 1 --2- 172.21.15.92:0/341034485 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50181138b0 0x7f50181a2b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.257+0000 7f5016d9d640 1 -- 172.21.15.92:0/341034485 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f501810ac20 msgr2=0x7f50181a8e80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:05:11.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.257+0000 7f5016d9d640 1 --2- 172.21.15.92:0/341034485 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f501810ac20 0x7f50181a8e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.257+0000 7f5016d9d640 1 -- 172.21.15.92:0/341034485 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50181a3230 con 0x7f501810a300 2024-09-19T09:05:11.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.258+0000 7f5016d9d640 1 --2- 172.21.15.92:0/341034485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f501810a300 0x7f50181a8940 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f501000ba50 tx=0x7f501000bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:11.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.258+0000 7f4ffffff640 1 -- 172.21.15.92:0/341034485 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5010019070 con 0x7f501810a300 2024-09-19T09:05:11.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.258+0000 7f4ffffff640 1 -- 172.21.15.92:0/341034485 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f501000cbe0 con 0x7f501810a300 2024-09-19T09:05:11.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.258+0000 7f4ffffff640 1 -- 172.21.15.92:0/341034485 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50100076e0 con 0x7f501810a300 2024-09-19T09:05:11.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.259+0000 7f501d03b640 1 -- 172.21.15.92:0/341034485 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50181a3520 con 0x7f501810a300 2024-09-19T09:05:11.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.259+0000 7f501d03b640 1 -- 172.21.15.92:0/341034485 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50181af810 con 0x7f501810a300 2024-09-19T09:05:11.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.263+0000 7f4ffffff640 1 -- 172.21.15.92:0/341034485 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f501001c070 con 0x7f501810a300 2024-09-19T09:05:11.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.263+0000 7f501f414740 1 Processor -- start 2024-09-19T09:05:11.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.263+0000 7f501f414740 1 -- start start 2024-09-19T09:05:11.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.264+0000 7f501f414740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561942f55d70 0x561942f56150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:11.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.264+0000 7f501f414740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561942f56690 0x561942f60a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:11.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.264+0000 7f501f414740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561942f60f50 0x561942f63340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:11.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.264+0000 7f501f414740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561942ebb280 con 0x561942f55d70 2024-09-19T09:05:11.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.264+0000 7f501f414740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561942e62b10 con 0x561942f60f50 2024-09-19T09:05:11.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.264+0000 7f501f414740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x561942eb7240 con 0x561942f56690 2024-09-19T09:05:11.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.264+0000 7f5016d9d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561942f56690 0x561942f60a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:11.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.264+0000 7f5016d9d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561942f56690 0x561942f60a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:52692/0 (socket says 172.21.15.92:52692) 2024-09-19T09:05:11.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.264+0000 7f5016d9d640 1 -- 172.21.15.92:0/184805674 learned_addr learned my addr 172.21.15.92:0/184805674 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:11.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.264+0000 7f501659c640 1 --2- 172.21.15.92:0/184805674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561942f60f50 0x561942f63340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:11.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.264+0000 7f4ffffff640 1 --2- 172.21.15.92:0/341034485 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f50000a3410 0x7f50000a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:11.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.265+0000 7f501659c640 1 -- 172.21.15.92:0/184805674 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561942f56690 msgr2=0x561942f60a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:11.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.265+0000 7f501659c640 1 --2- 172.21.15.92:0/184805674 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561942f56690 0x561942f60a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.265+0000 7f501759e640 1 --2- 172.21.15.92:0/184805674 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561942f55d70 0x561942f56150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:11.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.265+0000 7f501659c640 1 -- 172.21.15.92:0/184805674 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561942f55d70 msgr2=0x561942f56150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:11.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.265+0000 7f501659c640 1 --2- 172.21.15.92:0/184805674 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561942f55d70 0x561942f56150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.265+0000 7f501659c640 1 -- 172.21.15.92:0/184805674 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561942e6f1f0 con 0x561942f60f50 2024-09-19T09:05:11.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.265+0000 7f501759e640 1 --2- 172.21.15.92:0/184805674 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561942f55d70 0x561942f56150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:05:11.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.265+0000 7f4ffffff640 1 -- 172.21.15.92:0/341034485 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f50100ceeb0 con 0x7f501810a300 2024-09-19T09:05:11.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.265+0000 7f501759e640 1 --2- 172.21.15.92:0/341034485 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f50000a3410 0x7f50000a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:11.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.265+0000 7f501659c640 1 --2- 172.21.15.92:0/184805674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561942f60f50 0x561942f63340 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f50181a3c40 tx=0x7f5008009f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76ad3652f0dfeef8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:11.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.265+0000 7f4ffd7fa640 1 -- 172.21.15.92:0/184805674 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500800ece0 con 0x561942f60f50 2024-09-19T09:05:11.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.266+0000 7f4ffd7fa640 1 -- 172.21.15.92:0/184805674 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f500800ee80 con 0x561942f60f50 2024-09-19T09:05:11.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.266+0000 7f4ffd7fa640 1 -- 172.21.15.92:0/184805674 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5008010690 con 0x561942f60f50 2024-09-19T09:05:11.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.266+0000 7f501f414740 1 -- 172.21.15.92:0/184805674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561942f60f50 msgr2=0x561942f63340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:11.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.266+0000 7f501f414740 1 --2- 172.21.15.92:0/184805674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561942f60f50 0x561942f63340 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f50181a3c40 tx=0x7f5008009f50 comp rx=0 tx=0).stop 2024-09-19T09:05:11.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.268+0000 7f501f414740 1 -- 172.21.15.92:0/184805674 shutdown_connections 2024-09-19T09:05:11.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.268+0000 7f501f414740 1 --2- 172.21.15.92:0/184805674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561942f60f50 0x561942f63340 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.268+0000 7f501f414740 1 --2- 172.21.15.92:0/184805674 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561942f56690 0x561942f60a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.268+0000 7f501f414740 1 --2- 172.21.15.92:0/184805674 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561942f55d70 0x561942f56150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.268+0000 7f501f414740 1 -- 172.21.15.92:0/184805674 >> 172.21.15.92:0/184805674 conn(0x561942f52300 msgr2=0x561942f526e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:11.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.268+0000 7f501f414740 1 -- 172.21.15.92:0/184805674 shutdown_connections 2024-09-19T09:05:11.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.268+0000 7f501759e640 1 --2- 172.21.15.92:0/341034485 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f50000a3410 0x7f50000a58d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f500c02a9a0 tx=0x7f500c02a480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:11.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.268+0000 7f501f414740 1 -- 172.21.15.92:0/184805674 wait complete. 2024-09-19T09:05:11.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.269+0000 7f501f414740 1 -- start start 2024-09-19T09:05:11.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.269+0000 7f501f414740 1 Processor -- start 2024-09-19T09:05:11.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.270+0000 7f501f414740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561942f55d70 0x561942f5de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:11.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.270+0000 7f501f414740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561942f56690 0x561942f5e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:11.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.270+0000 7f5016d9d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561942f55d70 0x561942f5de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:11.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.270+0000 7f5016d9d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561942f55d70 0x561942f5de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:52704/0 (socket says 172.21.15.92:52704) 2024-09-19T09:05:11.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.270+0000 7f501659c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561942f56690 0x561942f5e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:11.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.270+0000 7f501659c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561942f56690 0x561942f5e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:45240/0 (socket says 172.21.15.92:45240) 2024-09-19T09:05:11.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.270+0000 7f501f414740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561942f60f50 0x561942f5e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:11.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.270+0000 7f501f414740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561942f63b20 con 0x561942f60f50 2024-09-19T09:05:11.392 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:05:11.392 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-19T09:05:11.392 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "4d8d7bb6-ffb8-413b-a5f1-1923dfb67bc0", 2024-09-19T09:05:11.393 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-19T09:05:11.393 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:05:11.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.270+0000 7f501f414740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561942e75f10 con 0x561942f56690 2024-09-19T09:05:11.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.270+0000 7f501f414740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x561942f63ca0 con 0x561942f55d70 2024-09-19T09:05:11.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.270+0000 7f501f414740 10 client.0 _ll_register_callbacks cb 0x561942e3ea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:11.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.270+0000 7f5016d9d640 1 -- 172.21.15.92:0/3717804793 learned_addr learned my addr 172.21.15.92:0/3717804793 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:11.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.271+0000 7f501659c640 1 -- 172.21.15.92:0/3717804793 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561942f55d70 msgr2=0x561942f5de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:11.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.271+0000 7f501659c640 1 --2- 172.21.15.92:0/3717804793 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561942f55d70 0x561942f5de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.271+0000 7f501659c640 1 -- 172.21.15.92:0/3717804793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561942f60f50 msgr2=0x561942f5e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:11.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.271+0000 7f501659c640 1 --2- 172.21.15.92:0/3717804793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561942f60f50 0x561942f5e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.271+0000 7f501659c640 1 -- 172.21.15.92:0/3717804793 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561942c2c6a0 con 0x561942f56690 2024-09-19T09:05:11.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.271+0000 7f501659c640 1 --2- 172.21.15.92:0/3717804793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561942f56690 0x561942f5e350 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f50181a3c40 tx=0x7f50080048f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f194809e52c21341 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:11.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.271+0000 7f4ffaff5640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:05:11.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.272+0000 7f4ffaff5640 1 -- 172.21.15.92:0/3717804793 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5008028060 con 0x561942f56690 2024-09-19T09:05:11.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.272+0000 7f501f414740 1 -- 172.21.15.92:0/3717804793 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561942ec87f0 con 0x561942f56690 2024-09-19T09:05:11.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.272+0000 7f4ffaff5640 1 -- 172.21.15.92:0/3717804793 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f5008005220 con 0x561942f56690 2024-09-19T09:05:11.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.272+0000 7f4ffaff5640 1 -- 172.21.15.92:0/3717804793 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f500801d040 con 0x561942f56690 2024-09-19T09:05:11.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.272+0000 7f501f414740 10 client.26720 fetch_fsmap learned FSMap version 19 2024-09-19T09:05:11.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.272+0000 7f501f414740 1 -- 172.21.15.92:0/3717804793 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x561942f6f6a0 con 0x561942f56690 2024-09-19T09:05:11.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.273+0000 7f4ffaff5640 1 -- 172.21.15.92:0/3717804793 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x561942ec87f0 con 0x561942f56690 2024-09-19T09:05:11.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.274+0000 7f4ffaff5640 1 -- 172.21.15.92:0/3717804793 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f500802d070 con 0x561942f56690 2024-09-19T09:05:11.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.274+0000 7f501f414740 10 client.26720 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:05:11.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.274+0000 7f501f414740 10 client.26720 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:05:11.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.274+0000 7f501f414740 20 client.26720 populate_metadata read hostname 'smithi092' 2024-09-19T09:05:11.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.274+0000 7f501f414740 1 --2- 172.21.15.92:0/3717804793 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561942f70f20 0x561942f73380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:11.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.274+0000 7f501f414740 4 client.26720 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:05:11.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.274+0000 7f501f414740 1 -- 172.21.15.92:0/3717804793 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561942ec2d00 con 0x561942f70f20 2024-09-19T09:05:11.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.275+0000 7f5016d9d640 1 --2- 172.21.15.92:0/3717804793 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561942f70f20 0x561942f73380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:11.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.275+0000 7f4ffaff5640 10 client.26720 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:11.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.275+0000 7f5016d9d640 1 --2- 172.21.15.92:0/3717804793 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561942f70f20 0x561942f73380 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=735d7ae9aeecc293 server_cookie=5c025ac4cd2270ec in_seq=0 out_seq=0 2024-09-19T09:05:11.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.276+0000 7f4ffaff5640 1 -- 172.21.15.92:0/3717804793 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561942ec2d00 con 0x561942f70f20 2024-09-19T09:05:11.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.276+0000 7f4ffaff5640 10 client.26720 handle_command_reply: tid=0 2024-09-19T09:05:11.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.277+0000 7f501f414740 1 client.26720 shutdown 2024-09-19T09:05:11.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.277+0000 7f501f414740 1 -- 172.21.15.92:0/3717804793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561942f56690 msgr2=0x561942f5e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:11.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.277+0000 7f501f414740 1 --2- 172.21.15.92:0/3717804793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561942f56690 0x561942f5e350 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f50181a3c40 tx=0x7f50080048f0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.277+0000 7f501f414740 1 -- 172.21.15.92:0/3717804793 shutdown_connections 2024-09-19T09:05:11.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.277+0000 7f501f414740 1 --2- 172.21.15.92:0/3717804793 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561942f70f20 0x561942f73380 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.277+0000 7f501f414740 1 --2- 172.21.15.92:0/3717804793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561942f60f50 0x561942f5e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.277+0000 7f501f414740 1 --2- 172.21.15.92:0/3717804793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561942f56690 0x561942f5e350 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.277+0000 7f501f414740 1 --2- 172.21.15.92:0/3717804793 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561942f55d70 0x561942f5de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.277+0000 7f501f414740 1 -- 172.21.15.92:0/3717804793 >> 172.21.15.92:0/3717804793 conn(0x561942f52300 msgr2=0x561942f58030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:11.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.277+0000 7f4ffaff5640 0 client.26720 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:11.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.277+0000 7f501f414740 1 -- 172.21.15.92:0/3717804793 shutdown_connections 2024-09-19T09:05:11.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.277+0000 7f501f414740 1 -- 172.21.15.92:0/3717804793 wait complete. 2024-09-19T09:05:11.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.277+0000 7f501f414740 20 client.26720 trim_cache size 0 max 16384 2024-09-19T09:05:11.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.307+0000 7f501f414740 1 Processor -- start 2024-09-19T09:05:11.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.307+0000 7f501f414740 1 -- start start 2024-09-19T09:05:11.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.307+0000 7f501f414740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561942f55d70 0x561942f587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:11.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.307+0000 7f501f414740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561942f56690 0x561942f5e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:11.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.307+0000 7f501f414740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561942f60f50 0x561942f78c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:11.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.307+0000 7f501f414740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f50181b5f20 con 0x561942f55d70 2024-09-19T09:05:11.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.307+0000 7f501f414740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f50181b87c0 con 0x561942f56690 2024-09-19T09:05:11.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.307+0000 7f501f414740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f50181b65b0 con 0x561942f60f50 2024-09-19T09:05:11.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.307+0000 7f5016d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561942f55d70 0x561942f587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:11.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.307+0000 7f501759e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561942f60f50 0x561942f78c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:11.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.307+0000 7f5016d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561942f55d70 0x561942f587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55420/0 (socket says 172.21.15.92:55420) 2024-09-19T09:05:11.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.307+0000 7f5016d9d640 1 -- 172.21.15.92:0/2493969985 learned_addr learned my addr 172.21.15.92:0/2493969985 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:11.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.307+0000 7f501659c640 1 --2- 172.21.15.92:0/2493969985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561942f56690 0x561942f5e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:11.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.308+0000 7f5016d9d640 1 -- 172.21.15.92:0/2493969985 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561942f60f50 msgr2=0x561942f78c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:11.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.308+0000 7f5016d9d640 1 --2- 172.21.15.92:0/2493969985 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561942f60f50 0x561942f78c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.308+0000 7f5016d9d640 1 -- 172.21.15.92:0/2493969985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561942f56690 msgr2=0x561942f5e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:11.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.308+0000 7f5016d9d640 1 --2- 172.21.15.92:0/2493969985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561942f56690 0x561942f5e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.308+0000 7f5016d9d640 1 -- 172.21.15.92:0/2493969985 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561942f564c0 con 0x561942f55d70 2024-09-19T09:05:11.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.308+0000 7f5016d9d640 1 --2- 172.21.15.92:0/2493969985 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561942f55d70 0x561942f587d0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f5010097e60 tx=0x7f50100d1280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=867fa0d0b0318346 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:11.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.309+0000 7f4ffcff9640 1 -- 172.21.15.92:0/2493969985 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f501009f840 con 0x561942f55d70 2024-09-19T09:05:11.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.309+0000 7f4ffcff9640 1 -- 172.21.15.92:0/2493969985 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50100a4100 con 0x561942f55d70 2024-09-19T09:05:11.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.309+0000 7f4ffcff9640 1 -- 172.21.15.92:0/2493969985 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5010099820 con 0x561942f55d70 2024-09-19T09:05:11.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.310+0000 7f501f414740 1 -- 172.21.15.92:0/2493969985 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561942f55d70 msgr2=0x561942f587d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:11.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.310+0000 7f501f414740 1 --2- 172.21.15.92:0/2493969985 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561942f55d70 0x561942f587d0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f5010097e60 tx=0x7f50100d1280 comp rx=0 tx=0).stop 2024-09-19T09:05:11.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.310+0000 7f501f414740 1 -- 172.21.15.92:0/2493969985 shutdown_connections 2024-09-19T09:05:11.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.310+0000 7f501f414740 1 --2- 172.21.15.92:0/2493969985 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561942f60f50 0x561942f78c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.310+0000 7f501f414740 1 --2- 172.21.15.92:0/2493969985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561942f56690 0x561942f5e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.310+0000 7f501f414740 1 --2- 172.21.15.92:0/2493969985 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561942f55d70 0x561942f587d0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.310+0000 7f501f414740 1 -- 172.21.15.92:0/2493969985 >> 172.21.15.92:0/2493969985 conn(0x561942f52300 msgr2=0x561942f5cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:11.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.310+0000 7f501f414740 1 -- 172.21.15.92:0/2493969985 shutdown_connections 2024-09-19T09:05:11.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.310+0000 7f501f414740 1 -- 172.21.15.92:0/2493969985 wait complete. 2024-09-19T09:05:11.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.310+0000 7f501f414740 1 -- start start 2024-09-19T09:05:11.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.311+0000 7f501f414740 1 Processor -- start 2024-09-19T09:05:11.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.311+0000 7f501f414740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561942f55d70 0x561942f5b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:11.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.311+0000 7f501f414740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561942f56690 0x561942f68f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:11.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.311+0000 7f501f414740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561942f60f50 0x561942f694a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:11.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.311+0000 7f501f414740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f50181b6c80 con 0x561942f56690 2024-09-19T09:05:11.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.311+0000 7f501f414740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f50181b80f0 con 0x561942f55d70 2024-09-19T09:05:11.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.311+0000 7f501f414740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f50181b7350 con 0x561942f60f50 2024-09-19T09:05:11.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.311+0000 7f501f414740 10 client.0 _ll_register_callbacks cb 0x7f5010097730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:11.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.311+0000 7f5016d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561942f55d70 0x561942f5b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:11.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.311+0000 7f501659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561942f56690 0x561942f68f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:11.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.311+0000 7f501659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561942f56690 0x561942f68f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55424/0 (socket says 172.21.15.92:55424) 2024-09-19T09:05:11.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.311+0000 7f501659c640 1 -- 172.21.15.92:0/1512069576 learned_addr learned my addr 172.21.15.92:0/1512069576 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:11.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.312+0000 7f501759e640 1 --2- 172.21.15.92:0/1512069576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561942f60f50 0x561942f694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:11.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.312+0000 7f5016d9d640 1 -- 172.21.15.92:0/1512069576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561942f60f50 msgr2=0x561942f694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:11.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.312+0000 7f5016d9d640 1 --2- 172.21.15.92:0/1512069576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561942f60f50 0x561942f694a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.312+0000 7f5016d9d640 1 -- 172.21.15.92:0/1512069576 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561942f56690 msgr2=0x561942f68f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:11.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.312+0000 7f5016d9d640 1 --2- 172.21.15.92:0/1512069576 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561942f56690 0x561942f68f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.312+0000 7f5016d9d640 1 -- 172.21.15.92:0/1512069576 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561942fd6c40 con 0x561942f55d70 2024-09-19T09:05:11.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.312+0000 7f5016d9d640 1 --2- 172.21.15.92:0/1512069576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561942f55d70 0x561942f5b9f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f501000ba20 tx=0x7f5010097860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5154ca6fe650855 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:11.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.313+0000 7f4ffaff5640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:05:11.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.313+0000 7f4ffaff5640 1 -- 172.21.15.92:0/1512069576 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50100b9060 con 0x561942f55d70 2024-09-19T09:05:11.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.313+0000 7f4ffaff5640 1 -- 172.21.15.92:0/1512069576 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f5010099790 con 0x561942f55d70 2024-09-19T09:05:11.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.313+0000 7f501f414740 1 -- 172.21.15.92:0/1512069576 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50100a4100 con 0x561942f55d70 2024-09-19T09:05:11.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.314+0000 7f4ffaff5640 1 -- 172.21.15.92:0/1512069576 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f501009f840 con 0x561942f55d70 2024-09-19T09:05:11.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.314+0000 7f501f414740 10 client.26726 fetch_fsmap learned FSMap version 19 2024-09-19T09:05:11.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.314+0000 7f501f414740 1 -- 172.21.15.92:0/1512069576 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x561942f5a300 con 0x561942f55d70 2024-09-19T09:05:11.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.314+0000 7f4ffaff5640 1 -- 172.21.15.92:0/1512069576 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50100a4100 con 0x561942f55d70 2024-09-19T09:05:11.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.314+0000 7f4ffaff5640 1 -- 172.21.15.92:0/1512069576 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f50100d2020 con 0x561942f55d70 2024-09-19T09:05:11.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.314+0000 7f501f414740 10 client.26726 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:05:11.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.314+0000 7f501f414740 10 client.26726 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:05:11.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.314+0000 7f501f414740 20 client.26726 populate_metadata read hostname 'smithi092' 2024-09-19T09:05:11.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.314+0000 7f501f414740 1 --2- 172.21.15.92:0/1512069576 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561942f5a9b0 0x561942fe6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:11.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.314+0000 7f501f414740 4 client.26726 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:05:11.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.314+0000 7f501f414740 1 -- 172.21.15.92:0/1512069576 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x561942e3f110 con 0x561942f5a9b0 2024-09-19T09:05:11.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.315+0000 7f501659c640 1 --2- 172.21.15.92:0/1512069576 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561942f5a9b0 0x561942fe6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:11.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.315+0000 7f4ffaff5640 10 client.26726 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:11.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.315+0000 7f501659c640 1 --2- 172.21.15.92:0/1512069576 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561942f5a9b0 0x561942fe6480 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b4b402385936478 server_cookie=1cc37260d4071232 in_seq=0 out_seq=0 2024-09-19T09:05:11.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.317+0000 7f4ffaff5640 1 -- 172.21.15.92:0/1512069576 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561942e3f110 con 0x561942f5a9b0 2024-09-19T09:05:11.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.317+0000 7f4ffaff5640 10 client.26726 handle_command_reply: tid=0 2024-09-19T09:05:11.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.317+0000 7f501f414740 1 client.26726 shutdown 2024-09-19T09:05:11.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.317+0000 7f501f414740 1 -- 172.21.15.92:0/1512069576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561942f55d70 msgr2=0x561942f5b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:11.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.317+0000 7f501f414740 1 --2- 172.21.15.92:0/1512069576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561942f55d70 0x561942f5b9f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f501000ba20 tx=0x7f5010097860 comp rx=0 tx=0).stop 2024-09-19T09:05:11.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.318+0000 7f501f414740 1 -- 172.21.15.92:0/1512069576 shutdown_connections 2024-09-19T09:05:11.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.318+0000 7f501f414740 1 --2- 172.21.15.92:0/1512069576 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561942f5a9b0 0x561942fe6480 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.318+0000 7f501f414740 1 --2- 172.21.15.92:0/1512069576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561942f60f50 0x561942f694a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.318+0000 7f501f414740 1 --2- 172.21.15.92:0/1512069576 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561942f56690 0x561942f68f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.318+0000 7f501f414740 1 --2- 172.21.15.92:0/1512069576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561942f55d70 0x561942f5b9f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.318+0000 7f501f414740 1 -- 172.21.15.92:0/1512069576 >> 172.21.15.92:0/1512069576 conn(0x561942f52300 msgr2=0x561942f50bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:11.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.318+0000 7f4ffaff5640 0 client.26726 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:11.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.318+0000 7f501f414740 1 -- 172.21.15.92:0/1512069576 shutdown_connections 2024-09-19T09:05:11.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.318+0000 7f501f414740 1 -- 172.21.15.92:0/1512069576 wait complete. 2024-09-19T09:05:11.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.318+0000 7f501f414740 20 client.26726 trim_cache size 0 max 16384 2024-09-19T09:05:11.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.319+0000 7f501d03b640 1 -- 172.21.15.92:0/341034485 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f50000a3410 msgr2=0x7f50000a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:11.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.319+0000 7f501d03b640 1 --2- 172.21.15.92:0/341034485 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f50000a3410 0x7f50000a58d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f500c02a9a0 tx=0x7f500c02a480 comp rx=0 tx=0).stop 2024-09-19T09:05:11.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.320+0000 7f501d03b640 1 -- 172.21.15.92:0/341034485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f501810a300 msgr2=0x7f50181a8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:11.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.320+0000 7f501d03b640 1 --2- 172.21.15.92:0/341034485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f501810a300 0x7f50181a8940 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f501000ba50 tx=0x7f501000bf10 comp rx=0 tx=0).stop 2024-09-19T09:05:11.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.320+0000 7f501d03b640 1 -- 172.21.15.92:0/341034485 shutdown_connections 2024-09-19T09:05:11.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.320+0000 7f501d03b640 1 --2- 172.21.15.92:0/341034485 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50181138b0 0x7f50181a2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.320+0000 7f501d03b640 1 --2- 172.21.15.92:0/341034485 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f50000a3410 0x7f50000a58d0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.320+0000 7f501d03b640 1 --2- 172.21.15.92:0/341034485 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f501810ac20 0x7f50181a8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.320+0000 7f501d03b640 1 --2- 172.21.15.92:0/341034485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f501810a300 0x7f50181a8940 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.320+0000 7f501d03b640 1 -- 172.21.15.92:0/341034485 >> 172.21.15.92:0/341034485 conn(0x7f50180735f0 msgr2=0x7f5018109290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:11.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.320+0000 7f501d03b640 1 -- 172.21.15.92:0/341034485 shutdown_connections 2024-09-19T09:05:11.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:11.320+0000 7f501d03b640 1 -- 172.21.15.92:0/341034485 wait complete. 2024-09-19T09:05:11.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:11 smithi092 ceph-mon[31407]: pgmap v591: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.2 MiB/s wr, 697 op/s 2024-09-19T09:05:11.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:11 smithi167 ceph-mon[35359]: pgmap v591: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.2 MiB/s wr, 697 op/s 2024-09-19T09:05:11.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:11 smithi190 ceph-mon[35358]: pgmap v591: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.2 MiB/s wr, 697 op/s 2024-09-19T09:05:12.495 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:05:12.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:12 smithi092 ceph-mon[31407]: scrub queued for path: / 2024-09-19T09:05:12.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:12 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:05:12.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:12 smithi092 ceph-mon[31407]: scrub summary: active paths [/] 2024-09-19T09:05:12.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:12 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:05:12.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:12 smithi167 ceph-mon[35359]: scrub queued for path: / 2024-09-19T09:05:12.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:12 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:05:12.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:12 smithi167 ceph-mon[35359]: scrub summary: active paths [/] 2024-09-19T09:05:12.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:12 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:05:12.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:12 smithi190 ceph-mon[35358]: scrub queued for path: / 2024-09-19T09:05:12.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:12 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:05:12.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:12 smithi190 ceph-mon[35358]: scrub summary: active paths [/] 2024-09-19T09:05:12.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:12 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:05:12.924 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:13.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.478+0000 7f1aab9d6640 1 -- 172.21.15.92:0/1872903195 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1aa4100e20 msgr2=0x7f1aa4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:13.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.478+0000 7f1aab9d6640 1 --2- 172.21.15.92:0/1872903195 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1aa4100e20 0x7f1aa4101200 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0009900 tx=0x7f1aa002a4b0 comp rx=0 tx=0).stop 2024-09-19T09:05:13.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.478+0000 7f1aab9d6640 1 -- 172.21.15.92:0/1872903195 shutdown_connections 2024-09-19T09:05:13.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.478+0000 7f1aab9d6640 1 --2- 172.21.15.92:0/1872903195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1aa4102ef0 0x7f1aa4069f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:13.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.478+0000 7f1aab9d6640 1 --2- 172.21.15.92:0/1872903195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1aa4102570 0x7f1aa41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:13.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.478+0000 7f1aab9d6640 1 --2- 172.21.15.92:0/1872903195 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1aa4100e20 0x7f1aa4101200 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:13.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.478+0000 7f1aab9d6640 1 -- 172.21.15.92:0/1872903195 >> 172.21.15.92:0/1872903195 conn(0x7f1aa40fc7d0 msgr2=0x7f1aa40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:13.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.479+0000 7f1aab9d6640 1 -- 172.21.15.92:0/1872903195 shutdown_connections 2024-09-19T09:05:13.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.479+0000 7f1aab9d6640 1 -- 172.21.15.92:0/1872903195 wait complete. 2024-09-19T09:05:13.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.480+0000 7f1aab9d6640 1 Processor -- start 2024-09-19T09:05:13.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.480+0000 7f1aab9d6640 1 -- start start 2024-09-19T09:05:13.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.480+0000 7f1aab9d6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1aa4100e20 0x7f1aa4073960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:13.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.480+0000 7f1aab9d6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1aa4102570 0x7f1aa4073ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:13.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.480+0000 7f1aab9d6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1aa4102ef0 0x7f1aa406cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:13.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.480+0000 7f1aab9d6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa410fec0 con 0x7f1aa4100e20 2024-09-19T09:05:13.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.480+0000 7f1aab9d6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa410fd40 con 0x7f1aa4102ef0 2024-09-19T09:05:13.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.480+0000 7f1aab9d6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa4110040 con 0x7f1aa4102570 2024-09-19T09:05:13.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.481+0000 7f1aa9772640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1aa4100e20 0x7f1aa4073960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:13.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.481+0000 7f1aa9772640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1aa4100e20 0x7f1aa4073960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47486/0 (socket says 172.21.15.92:47486) 2024-09-19T09:05:13.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.481+0000 7f1aa9772640 1 -- 172.21.15.92:0/1736981186 learned_addr learned my addr 172.21.15.92:0/1736981186 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:13.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.481+0000 7f1aa9f73640 1 --2- 172.21.15.92:0/1736981186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1aa4102ef0 0x7f1aa406cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:13.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.481+0000 7f1aa8f71640 1 --2- 172.21.15.92:0/1736981186 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1aa4102570 0x7f1aa4073ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:13.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.481+0000 7f1aa9772640 1 -- 172.21.15.92:0/1736981186 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1aa4102570 msgr2=0x7f1aa4073ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:13.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.481+0000 7f1aa9772640 1 --2- 172.21.15.92:0/1736981186 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1aa4102570 0x7f1aa4073ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:13.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.481+0000 7f1aa9772640 1 -- 172.21.15.92:0/1736981186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1aa4102ef0 msgr2=0x7f1aa406cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:13.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.481+0000 7f1aa9772640 1 --2- 172.21.15.92:0/1736981186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1aa4102ef0 0x7f1aa406cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:13.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.481+0000 7f1aa9772640 1 -- 172.21.15.92:0/1736981186 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa406d490 con 0x7f1aa4100e20 2024-09-19T09:05:13.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.481+0000 7f1aa9f73640 1 --2- 172.21.15.92:0/1736981186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1aa4102ef0 0x7f1aa406cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:05:13.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.482+0000 7f1aa9772640 1 --2- 172.21.15.92:0/1736981186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1aa4100e20 0x7f1aa4073960 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0006010 tx=0x7f1aa00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:13.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.482+0000 7f1a9a7fc640 1 -- 172.21.15.92:0/1736981186 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa003f030 con 0x7f1aa4100e20 2024-09-19T09:05:13.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.482+0000 7f1a9a7fc640 1 -- 172.21.15.92:0/1736981186 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1aa0003ce0 con 0x7f1aa4100e20 2024-09-19T09:05:13.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.482+0000 7f1a9a7fc640 1 -- 172.21.15.92:0/1736981186 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0035070 con 0x7f1aa4100e20 2024-09-19T09:05:13.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.482+0000 7f1aab9d6640 1 -- 172.21.15.92:0/1736981186 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aa406d720 con 0x7f1aa4100e20 2024-09-19T09:05:13.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.483+0000 7f1aab9d6640 1 -- 172.21.15.92:0/1736981186 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aa4071660 con 0x7f1aa4100e20 2024-09-19T09:05:13.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.488+0000 7f1a9a7fc640 1 -- 172.21.15.92:0/1736981186 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1aa0042030 con 0x7f1aa4100e20 2024-09-19T09:05:13.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.491+0000 7f1aaddaf740 1 Processor -- start 2024-09-19T09:05:13.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.491+0000 7f1aaddaf740 1 -- start start 2024-09-19T09:05:13.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.491+0000 7f1a9a7fc640 1 --2- 172.21.15.92:0/1736981186 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1a900a32c0 0x7f1a900a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:13.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.492+0000 7f1aaddaf740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7d7c644a0 0x55f7d7c64880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:13.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.492+0000 7f1a9a7fc640 1 -- 172.21.15.92:0/1736981186 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1aa00efd90 con 0x7f1aa4100e20 2024-09-19T09:05:13.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.492+0000 7f1aaddaf740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d7c64dc0 0x55f7d7c6f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:13.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.492+0000 7f1aa9f73640 1 --2- 172.21.15.92:0/1736981186 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1a900a32c0 0x7f1a900a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:13.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.492+0000 7f1aaddaf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7d7c6f680 0x55f7d7c71a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:13.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.492+0000 7f1aaddaf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f7d7bca2e0 con 0x55f7d7c6f680 2024-09-19T09:05:13.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.492+0000 7f1aa9772640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7d7c644a0 0x55f7d7c64880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:13.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.492+0000 7f1aa9772640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7d7c644a0 0x55f7d7c64880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:48746/0 (socket says 172.21.15.92:48746) 2024-09-19T09:05:13.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.492+0000 7f1aa9772640 1 -- 172.21.15.92:0/3919608798 learned_addr learned my addr 172.21.15.92:0/3919608798 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:13.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.492+0000 7f1aa9f73640 1 --2- 172.21.15.92:0/3919608798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7d7c6f680 0x55f7d7c71a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:13.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.492+0000 7f1aaddaf740 1 -- 172.21.15.92:0/3919608798 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f7d7b71ce0 con 0x55f7d7c64dc0 2024-09-19T09:05:13.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.492+0000 7f1aaddaf740 1 -- 172.21.15.92:0/3919608798 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f7d7bc62a0 con 0x55f7d7c644a0 2024-09-19T09:05:13.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.492+0000 7f1aa8f71640 1 --2- 172.21.15.92:0/3919608798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d7c64dc0 0x55f7d7c6f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:13.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.493+0000 7f1aa9772640 1 -- 172.21.15.92:0/3919608798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d7c64dc0 msgr2=0x55f7d7c6f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:13.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.493+0000 7f1aa9772640 1 --2- 172.21.15.92:0/3919608798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d7c64dc0 0x55f7d7c6f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:13.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.493+0000 7f1aa9772640 1 -- 172.21.15.92:0/3919608798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7d7c6f680 msgr2=0x55f7d7c71a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:13.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.493+0000 7f1aa9772640 1 --2- 172.21.15.92:0/3919608798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7d7c6f680 0x55f7d7c71a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:13.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.493+0000 7f1aa9772640 1 -- 172.21.15.92:0/3919608798 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7d7b56440 con 0x55f7d7c644a0 2024-09-19T09:05:13.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.493+0000 7f1aa9772640 1 --2- 172.21.15.92:0/3919608798 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7d7c644a0 0x55f7d7c64880 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0032b90 tx=0x7f1aa0031ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b2c94834ae3ad0b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:13.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.493+0000 7f1aa9f73640 1 --2- 172.21.15.92:0/1736981186 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1a900a32c0 0x7f1a900a5780 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c009fd0 tx=0x7f1a9c0125b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:13.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.494+0000 7f1a8f7fe640 1 -- 172.21.15.92:0/3919608798 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0049070 con 0x55f7d7c644a0 2024-09-19T09:05:13.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.494+0000 7f1a8f7fe640 1 -- 172.21.15.92:0/3919608798 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1aa00bc3b0 con 0x55f7d7c644a0 2024-09-19T09:05:13.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.495+0000 7f1a8f7fe640 1 -- 172.21.15.92:0/3919608798 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa003bc90 con 0x55f7d7c644a0 2024-09-19T09:05:13.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.495+0000 7f1aaddaf740 1 -- 172.21.15.92:0/3919608798 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7d7c644a0 msgr2=0x55f7d7c64880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:13.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.495+0000 7f1aaddaf740 1 --2- 172.21.15.92:0/3919608798 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7d7c644a0 0x55f7d7c64880 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0032b90 tx=0x7f1aa0031ab0 comp rx=0 tx=0).stop 2024-09-19T09:05:13.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.496+0000 7f1aaddaf740 1 -- 172.21.15.92:0/3919608798 shutdown_connections 2024-09-19T09:05:13.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.496+0000 7f1aaddaf740 1 --2- 172.21.15.92:0/3919608798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7d7c6f680 0x55f7d7c71a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:13.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.496+0000 7f1aaddaf740 1 --2- 172.21.15.92:0/3919608798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d7c64dc0 0x55f7d7c6f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:13.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.496+0000 7f1aaddaf740 1 --2- 172.21.15.92:0/3919608798 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7d7c644a0 0x55f7d7c64880 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:13.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.496+0000 7f1aaddaf740 1 -- 172.21.15.92:0/3919608798 >> 172.21.15.92:0/3919608798 conn(0x55f7d7c60a30 msgr2=0x55f7d7c60e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:13.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.496+0000 7f1aaddaf740 1 -- 172.21.15.92:0/3919608798 shutdown_connections 2024-09-19T09:05:13.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.496+0000 7f1aaddaf740 1 -- 172.21.15.92:0/3919608798 wait complete. 2024-09-19T09:05:13.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.497+0000 7f1aaddaf740 1 -- start start 2024-09-19T09:05:13.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.497+0000 7f1aaddaf740 1 Processor -- start 2024-09-19T09:05:13.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.497+0000 7f1aaddaf740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7d7c644a0 0x55f7d7c6eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:13.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.497+0000 7f1aaddaf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7d7c64dc0 0x55f7d7c6c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:13.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.497+0000 7f1aaddaf740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d7c6f680 0x55f7d7c6c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:13.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.497+0000 7f1aaddaf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f7d7c72010 con 0x55f7d7c64dc0 2024-09-19T09:05:13.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.497+0000 7f1aaddaf740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f7d7b85050 con 0x55f7d7c6f680 2024-09-19T09:05:13.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.497+0000 7f1aaddaf740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f7d7c72190 con 0x55f7d7c644a0 2024-09-19T09:05:13.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.497+0000 7f1aaddaf740 10 client.0 _ll_register_callbacks cb 0x55f7d7bc5160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:13.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.497+0000 7f1aa9772640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7d7c644a0 0x55f7d7c6eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:13.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.497+0000 7f1aa9772640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7d7c644a0 0x55f7d7c6eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:48762/0 (socket says 172.21.15.92:48762) 2024-09-19T09:05:13.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.497+0000 7f1aa9772640 1 -- 172.21.15.92:0/3059006595 learned_addr learned my addr 172.21.15.92:0/3059006595 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:13.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.498+0000 7f1aa9f73640 1 --2- 172.21.15.92:0/3059006595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d7c6f680 0x55f7d7c6c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:13.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.498+0000 7f1aa9772640 1 -- 172.21.15.92:0/3059006595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d7c6f680 msgr2=0x55f7d7c6c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:13.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.498+0000 7f1aa9772640 1 --2- 172.21.15.92:0/3059006595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d7c6f680 0x55f7d7c6c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:13.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.498+0000 7f1aa9772640 1 -- 172.21.15.92:0/3059006595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7d7c64dc0 msgr2=0x55f7d7c6c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:13.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.498+0000 7f1aa9772640 1 --2- 172.21.15.92:0/3059006595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7d7c64dc0 0x55f7d7c6c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:13.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.498+0000 7f1aa9772640 1 -- 172.21.15.92:0/3059006595 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7d793b3c0 con 0x55f7d7c644a0 2024-09-19T09:05:13.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.498+0000 7f1aa9f73640 1 --2- 172.21.15.92:0/3059006595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d7c6f680 0x55f7d7c6c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:13.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.498+0000 7f1aa9772640 1 --2- 172.21.15.92:0/3059006595 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7d7c644a0 0x55f7d7c6eff0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1aa00c4af0 tx=0x7f1aa0004570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dde63508f1b263b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:13.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.498+0000 7f1a8cff9640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:05:13.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.498+0000 7f1a8cff9640 1 -- 172.21.15.92:0/3059006595 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0049070 con 0x55f7d7c644a0 2024-09-19T09:05:13.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.498+0000 7f1a8cff9640 1 -- 172.21.15.92:0/3059006595 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1aa00d5220 con 0x55f7d7c644a0 2024-09-19T09:05:13.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.499+0000 7f1aaddaf740 1 -- 172.21.15.92:0/3059006595 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1aa00bc3b0 con 0x55f7d7c644a0 2024-09-19T09:05:13.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.499+0000 7f1a8cff9640 1 -- 172.21.15.92:0/3059006595 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1aa00c0760 con 0x55f7d7c644a0 2024-09-19T09:05:13.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.499+0000 7f1aaddaf740 10 client.26635 fetch_fsmap learned FSMap version 19 2024-09-19T09:05:13.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.499+0000 7f1aaddaf740 1 -- 172.21.15.92:0/3059006595 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f7d7c72010 con 0x55f7d7c644a0 2024-09-19T09:05:13.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.500+0000 7f1a8cff9640 1 -- 172.21.15.92:0/3059006595 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1aa00bc3b0 con 0x55f7d7c644a0 2024-09-19T09:05:13.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.500+0000 7f1a8cff9640 1 -- 172.21.15.92:0/3059006595 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1aa00bb800 con 0x55f7d7c644a0 2024-09-19T09:05:13.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.500+0000 7f1aaddaf740 10 client.26635 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:05:13.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.500+0000 7f1aaddaf740 10 client.26635 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:05:13.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.500+0000 7f1aaddaf740 20 client.26635 populate_metadata read hostname 'smithi092' 2024-09-19T09:05:13.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.500+0000 7f1aaddaf740 1 --2- 172.21.15.92:0/3059006595 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f7d7c7eca0 0x55f7d7c810f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:13.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.500+0000 7f1aaddaf740 4 client.26635 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:05:13.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.500+0000 7f1aaddaf740 1 -- 172.21.15.92:0/3059006595 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f7d7bd7850 con 0x55f7d7c7eca0 2024-09-19T09:05:13.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.500+0000 7f1aa8f71640 1 --2- 172.21.15.92:0/3059006595 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f7d7c7eca0 0x55f7d7c810f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:13.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.501+0000 7f1a8cff9640 10 client.26635 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:13.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.501+0000 7f1aa8f71640 1 --2- 172.21.15.92:0/3059006595 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f7d7c7eca0 0x55f7d7c810f0 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53e42c6102abd3b0 server_cookie=5bf3d2b0d94cdf15 in_seq=0 out_seq=0 2024-09-19T09:05:13.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.503+0000 7f1a8cff9640 1 -- 172.21.15.92:0/3059006595 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f7d7bd7850 con 0x55f7d7c7eca0 2024-09-19T09:05:13.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.503+0000 7f1a8cff9640 10 client.26635 handle_command_reply: tid=0 2024-09-19T09:05:13.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.503+0000 7f1aaddaf740 1 client.26635 shutdown 2024-09-19T09:05:13.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.503+0000 7f1aaddaf740 1 -- 172.21.15.92:0/3059006595 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7d7c644a0 msgr2=0x55f7d7c6eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:13.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.503+0000 7f1aaddaf740 1 --2- 172.21.15.92:0/3059006595 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7d7c644a0 0x55f7d7c6eff0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1aa00c4af0 tx=0x7f1aa0004570 comp rx=0 tx=0).stop 2024-09-19T09:05:13.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.503+0000 7f1aaddaf740 1 -- 172.21.15.92:0/3059006595 shutdown_connections 2024-09-19T09:05:13.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.503+0000 7f1aaddaf740 1 --2- 172.21.15.92:0/3059006595 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f7d7c7eca0 0x55f7d7c810f0 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:13.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.503+0000 7f1aaddaf740 1 --2- 172.21.15.92:0/3059006595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d7c6f680 0x55f7d7c6c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:13.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.503+0000 7f1aaddaf740 1 --2- 172.21.15.92:0/3059006595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7d7c64dc0 0x55f7d7c6c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:13.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.503+0000 7f1aaddaf740 1 --2- 172.21.15.92:0/3059006595 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7d7c644a0 0x55f7d7c6eff0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:13.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.503+0000 7f1a8cff9640 0 client.26635 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:13.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.503+0000 7f1aaddaf740 1 -- 172.21.15.92:0/3059006595 >> 172.21.15.92:0/3059006595 conn(0x55f7d7c60a30 msgr2=0x55f7d7c66710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:13.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.504+0000 7f1aaddaf740 1 -- 172.21.15.92:0/3059006595 shutdown_connections 2024-09-19T09:05:13.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.504+0000 7f1aaddaf740 1 -- 172.21.15.92:0/3059006595 wait complete. 2024-09-19T09:05:13.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.504+0000 7f1aaddaf740 20 client.26635 trim_cache size 0 max 16384 2024-09-19T09:05:13.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.537+0000 7f1aaddaf740 1 Processor -- start 2024-09-19T09:05:13.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.537+0000 7f1aaddaf740 1 -- start start 2024-09-19T09:05:13.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.537+0000 7f1aaddaf740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d7c644a0 0x55f7d7c869c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:13.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.537+0000 7f1aaddaf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7d7c64dc0 0x55f7d7c86f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:13.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.537+0000 7f1aaddaf740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7d7c6f680 0x55f7d7c69520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:13.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.537+0000 7f1aaddaf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa411c040 con 0x55f7d7c64dc0 2024-09-19T09:05:13.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.537+0000 7f1aaddaf740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa41c5610 con 0x55f7d7c644a0 2024-09-19T09:05:13.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.537+0000 7f1aaddaf740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa411c6d0 con 0x55f7d7c6f680 2024-09-19T09:05:13.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.538+0000 7f1aa9f73640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7d7c6f680 0x55f7d7c69520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:13.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.538+0000 7f1aa9f73640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7d7c6f680 0x55f7d7c69520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:48774/0 (socket says 172.21.15.92:48774) 2024-09-19T09:05:13.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.538+0000 7f1aa9f73640 1 -- 172.21.15.92:0/3173179159 learned_addr learned my addr 172.21.15.92:0/3173179159 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:13.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.539+0000 7f1aa8f71640 1 --2- 172.21.15.92:0/3173179159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7d7c64dc0 0x55f7d7c86f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:13.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.540+0000 7f1aa9772640 1 --2- 172.21.15.92:0/3173179159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d7c644a0 0x55f7d7c869c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:13.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.542+0000 7f1aa8f71640 1 -- 172.21.15.92:0/3173179159 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7d7c6f680 msgr2=0x55f7d7c69520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:13.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.542+0000 7f1aa8f71640 1 --2- 172.21.15.92:0/3173179159 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7d7c6f680 0x55f7d7c69520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:13.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.542+0000 7f1aa8f71640 1 -- 172.21.15.92:0/3173179159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d7c644a0 msgr2=0x55f7d7c869c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:13.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.542+0000 7f1aa8f71640 1 --2- 172.21.15.92:0/3173179159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d7c644a0 0x55f7d7c869c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:13.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.542+0000 7f1aa8f71640 1 -- 172.21.15.92:0/3173179159 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7d7c642b0 con 0x55f7d7c64dc0 2024-09-19T09:05:13.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.543+0000 7f1aa8f71640 1 --2- 172.21.15.92:0/3173179159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7d7c64dc0 0x55f7d7c86f00 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x55f7d7c61890 tx=0x7f1a940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8bf631cf70ddbca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:13.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.543+0000 7f1a8effd640 1 -- 172.21.15.92:0/3173179159 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9401d070 con 0x55f7d7c64dc0 2024-09-19T09:05:13.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.543+0000 7f1a8effd640 1 -- 172.21.15.92:0/3173179159 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55f7d7bd7850 con 0x55f7d7c64dc0 2024-09-19T09:05:13.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.543+0000 7f1a8effd640 1 -- 172.21.15.92:0/3173179159 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a940195e0 con 0x55f7d7c64dc0 2024-09-19T09:05:13.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.544+0000 7f1aaddaf740 1 -- 172.21.15.92:0/3173179159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7d7c64dc0 msgr2=0x55f7d7c86f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:13.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.544+0000 7f1aaddaf740 1 --2- 172.21.15.92:0/3173179159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7d7c64dc0 0x55f7d7c86f00 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x55f7d7c61890 tx=0x7f1a940046c0 comp rx=0 tx=0).stop 2024-09-19T09:05:13.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.544+0000 7f1aaddaf740 1 -- 172.21.15.92:0/3173179159 shutdown_connections 2024-09-19T09:05:13.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.544+0000 7f1aaddaf740 1 --2- 172.21.15.92:0/3173179159 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7d7c6f680 0x55f7d7c69520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:13.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.544+0000 7f1aaddaf740 1 --2- 172.21.15.92:0/3173179159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7d7c64dc0 0x55f7d7c86f00 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:13.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.544+0000 7f1aaddaf740 1 --2- 172.21.15.92:0/3173179159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d7c644a0 0x55f7d7c869c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:13.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.544+0000 7f1aaddaf740 1 -- 172.21.15.92:0/3173179159 >> 172.21.15.92:0/3173179159 conn(0x55f7d7c60a30 msgr2=0x55f7d7c6e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:13.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.545+0000 7f1aaddaf740 1 -- 172.21.15.92:0/3173179159 shutdown_connections 2024-09-19T09:05:13.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.545+0000 7f1aaddaf740 1 -- 172.21.15.92:0/3173179159 wait complete. 2024-09-19T09:05:13.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.545+0000 7f1aaddaf740 1 -- start start 2024-09-19T09:05:13.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.546+0000 7f1aaddaf740 1 Processor -- start 2024-09-19T09:05:13.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.550+0000 7f1aaddaf740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d7c644a0 0x55f7d7c77d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:13.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.550+0000 7f1aaddaf740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7d7c6f680 0x55f7d7c75020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:13.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.550+0000 7f1aaddaf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7d7c756c0 0x55f7d7ce89a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:13.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.550+0000 7f1aaddaf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa41c3ad0 con 0x55f7d7c756c0 2024-09-19T09:05:13.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.550+0000 7f1aaddaf740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa41c4f40 con 0x55f7d7c644a0 2024-09-19T09:05:13.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.550+0000 7f1aaddaf740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa41c41a0 con 0x55f7d7c6f680 2024-09-19T09:05:13.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.550+0000 7f1aaddaf740 10 client.0 _ll_register_callbacks cb 0x7f1a9400c2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:13.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.551+0000 7f1aa9772640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d7c644a0 0x55f7d7c77d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:13.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.551+0000 7f1aa8f71640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7d7c6f680 0x55f7d7c75020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:13.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.551+0000 7f1aa9772640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d7c644a0 0x55f7d7c77d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:43380/0 (socket says 172.21.15.92:43380) 2024-09-19T09:05:13.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.551+0000 7f1aa9772640 1 -- 172.21.15.92:0/1565675394 learned_addr learned my addr 172.21.15.92:0/1565675394 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:13.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.552+0000 7f1aa9772640 1 -- 172.21.15.92:0/1565675394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7d7c6f680 msgr2=0x55f7d7c75020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:13.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.552+0000 7f1aa9772640 1 --2- 172.21.15.92:0/1565675394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7d7c6f680 0x55f7d7c75020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:13.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.552+0000 7f1aa9772640 1 -- 172.21.15.92:0/1565675394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7d7c756c0 msgr2=0x55f7d7ce89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:13.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.552+0000 7f1aa9772640 1 --2- 172.21.15.92:0/1565675394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7d7c756c0 0x55f7d7ce89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:13.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.552+0000 7f1aa9772640 1 -- 172.21.15.92:0/1565675394 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7d7c75e30 con 0x55f7d7c644a0 2024-09-19T09:05:13.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.552+0000 7f1aa9772640 1 --2- 172.21.15.92:0/1565675394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d7c644a0 0x55f7d7c77d20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1aa00b8810 tx=0x7f1aa003b720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bf19c99b6fb776d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:13.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.555+0000 7f1a8cff9640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:05:13.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.557+0000 7f1a8cff9640 1 -- 172.21.15.92:0/1565675394 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0049070 con 0x55f7d7c644a0 2024-09-19T09:05:13.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.557+0000 7f1aaddaf740 1 -- 172.21.15.92:0/1565675394 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f7d7bd7850 con 0x55f7d7c644a0 2024-09-19T09:05:13.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.557+0000 7f1a8cff9640 1 -- 172.21.15.92:0/1565675394 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1aa00bba00 con 0x55f7d7c644a0 2024-09-19T09:05:13.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.564+0000 7f1a8cff9640 1 -- 172.21.15.92:0/1565675394 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1aa00bc3b0 con 0x55f7d7c644a0 2024-09-19T09:05:13.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.564+0000 7f1aaddaf740 10 client.26744 fetch_fsmap learned FSMap version 19 2024-09-19T09:05:13.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.564+0000 7f1aaddaf740 1 -- 172.21.15.92:0/1565675394 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f7d7c75e30 con 0x55f7d7c644a0 2024-09-19T09:05:13.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.566+0000 7f1a8cff9640 1 -- 172.21.15.92:0/1565675394 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55f7d7bd7850 con 0x55f7d7c644a0 2024-09-19T09:05:13.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.567+0000 7f1a8cff9640 1 -- 172.21.15.92:0/1565675394 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1aa00bb270 con 0x55f7d7c644a0 2024-09-19T09:05:13.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.567+0000 7f1aaddaf740 10 client.26744 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:05:13.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.567+0000 7f1aaddaf740 10 client.26744 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:05:13.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.567+0000 7f1aaddaf740 20 client.26744 populate_metadata read hostname 'smithi092' 2024-09-19T09:05:13.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.567+0000 7f1aaddaf740 1 --2- 172.21.15.92:0/1565675394 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f7d7cea1d0 0x55f7d7cec5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:13.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.567+0000 7f1aaddaf740 4 client.26744 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:05:13.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.567+0000 7f1aaddaf740 1 -- 172.21.15.92:0/1565675394 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f7d7bd1d60 con 0x55f7d7cea1d0 2024-09-19T09:05:13.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.568+0000 7f1aa8f71640 1 --2- 172.21.15.92:0/1565675394 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f7d7cea1d0 0x55f7d7cec5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:13.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.568+0000 7f1aa8f71640 1 --2- 172.21.15.92:0/1565675394 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f7d7cea1d0 0x55f7d7cec5f0 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6b104518464505b server_cookie=c6adae7e4e8246b4 in_seq=0 out_seq=0 2024-09-19T09:05:13.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.568+0000 7f1a8cff9640 10 client.26744 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:13.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.569+0000 7f1a8cff9640 1 -- 172.21.15.92:0/1565675394 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55f7d7bd1d60 con 0x55f7d7cea1d0 2024-09-19T09:05:13.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.569+0000 7f1a8cff9640 10 client.26744 handle_command_reply: tid=0 2024-09-19T09:05:13.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.569+0000 7f1aaddaf740 1 client.26744 shutdown 2024-09-19T09:05:13.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.571+0000 7f1aaddaf740 1 -- 172.21.15.92:0/1565675394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d7c644a0 msgr2=0x55f7d7c77d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:13.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.571+0000 7f1aaddaf740 1 --2- 172.21.15.92:0/1565675394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d7c644a0 0x55f7d7c77d20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1aa00b8810 tx=0x7f1aa003b720 comp rx=0 tx=0).stop 2024-09-19T09:05:13.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.574+0000 7f1aaddaf740 1 -- 172.21.15.92:0/1565675394 shutdown_connections 2024-09-19T09:05:13.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.574+0000 7f1aaddaf740 1 --2- 172.21.15.92:0/1565675394 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f7d7cea1d0 0x55f7d7cec5f0 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:13.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.574+0000 7f1aaddaf740 1 --2- 172.21.15.92:0/1565675394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7d7c756c0 0x55f7d7ce89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:13.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.574+0000 7f1aaddaf740 1 --2- 172.21.15.92:0/1565675394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f7d7c6f680 0x55f7d7c75020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:13.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.574+0000 7f1aaddaf740 1 --2- 172.21.15.92:0/1565675394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d7c644a0 0x55f7d7c77d20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:13.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.574+0000 7f1aaddaf740 1 -- 172.21.15.92:0/1565675394 >> 172.21.15.92:0/1565675394 conn(0x55f7d7c60a30 msgr2=0x55f7d7c5f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:13.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.574+0000 7f1a8cff9640 0 client.26744 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:13.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.575+0000 7f1aaddaf740 1 -- 172.21.15.92:0/1565675394 shutdown_connections 2024-09-19T09:05:13.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.575+0000 7f1aaddaf740 1 -- 172.21.15.92:0/1565675394 wait complete. 2024-09-19T09:05:13.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.576+0000 7f1aaddaf740 20 client.26744 trim_cache size 0 max 16384 2024-09-19T09:05:13.577 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:05:13.577 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:05:13.577 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": { 2024-09-19T09:05:13.577 INFO:teuthology.orchestra.run.smithi092.stdout: "4d8d7bb6-ffb8-413b-a5f1-1923dfb67bc0": { 2024-09-19T09:05:13.577 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-19T09:05:13.577 INFO:teuthology.orchestra.run.smithi092.stdout: "tag": "4d8d7bb6-ffb8-413b-a5f1-1923dfb67bc0", 2024-09-19T09:05:13.577 INFO:teuthology.orchestra.run.smithi092.stdout: "options": "recursive,force" 2024-09-19T09:05:13.578 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:05:13.578 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:05:13.578 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:05:13.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.577+0000 7f1aab9d6640 1 -- 172.21.15.92:0/1736981186 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1a900a32c0 msgr2=0x7f1a900a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:13.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.577+0000 7f1aab9d6640 1 --2- 172.21.15.92:0/1736981186 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1a900a32c0 0x7f1a900a5780 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c009fd0 tx=0x7f1a9c0125b0 comp rx=0 tx=0).stop 2024-09-19T09:05:13.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.577+0000 7f1aab9d6640 1 -- 172.21.15.92:0/1736981186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1aa4100e20 msgr2=0x7f1aa4073960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:13.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.577+0000 7f1aab9d6640 1 --2- 172.21.15.92:0/1736981186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1aa4100e20 0x7f1aa4073960 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0006010 tx=0x7f1aa00042f0 comp rx=0 tx=0).stop 2024-09-19T09:05:13.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.577+0000 7f1aab9d6640 1 -- 172.21.15.92:0/1736981186 shutdown_connections 2024-09-19T09:05:13.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.578+0000 7f1aab9d6640 1 --2- 172.21.15.92:0/1736981186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1aa4102ef0 0x7f1aa406cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:13.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.578+0000 7f1aab9d6640 1 --2- 172.21.15.92:0/1736981186 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1aa4102570 0x7f1aa4073ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:13.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.578+0000 7f1aab9d6640 1 --2- 172.21.15.92:0/1736981186 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1a900a32c0 0x7f1a900a5780 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:13.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.578+0000 7f1aab9d6640 1 --2- 172.21.15.92:0/1736981186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1aa4100e20 0x7f1aa4073960 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:13.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.578+0000 7f1aab9d6640 1 -- 172.21.15.92:0/1736981186 >> 172.21.15.92:0/1736981186 conn(0x7f1aa40fc7d0 msgr2=0x7f1aa4106fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:13.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.578+0000 7f1aab9d6640 1 -- 172.21.15.92:0/1736981186 shutdown_connections 2024-09-19T09:05:13.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:13.578+0000 7f1aab9d6640 1 -- 172.21.15.92:0/1736981186 wait complete. 2024-09-19T09:05:13.596 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:13 smithi092 ceph-mon[31407]: pgmap v592: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.5 MiB/s wr, 668 op/s 2024-09-19T09:05:13.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:13 smithi167 ceph-mon[35359]: pgmap v592: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.5 MiB/s wr, 668 op/s 2024-09-19T09:05:13.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:13 smithi190 ceph-mon[35358]: pgmap v592: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.5 MiB/s wr, 668 op/s 2024-09-19T09:05:14.574 INFO:tasks.cephfs.filesystem:scrub status for tag:4d8d7bb6-ffb8-413b-a5f1-1923dfb67bc0 - {'path': '/', 'tag': '4d8d7bb6-ffb8-413b-a5f1-1923dfb67bc0', 'options': 'recursive,force'} 2024-09-19T09:05:14.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:14 smithi167 ceph-mon[35359]: scrub summary: idle 2024-09-19T09:05:14.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:14 smithi190 ceph-mon[35358]: scrub summary: idle 2024-09-19T09:05:15.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:14 smithi092 ceph-mon[31407]: scrub summary: idle 2024-09-19T09:05:15.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 510.0 s, 4729.0 tps, lat 21.216 ms stddev 24.484 2024-09-19T09:05:15.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:15 smithi167 ceph-mon[35359]: pgmap v593: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 8.6 MiB/s wr, 909 op/s 2024-09-19T09:05:15.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:15 smithi190 ceph-mon[35358]: pgmap v593: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 8.6 MiB/s wr, 909 op/s 2024-09-19T09:05:16.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:15 smithi092 ceph-mon[31407]: pgmap v593: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 8.6 MiB/s wr, 909 op/s 2024-09-19T09:05:17.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:17 smithi167 ceph-mon[35359]: pgmap v594: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 6.3 MiB/s wr, 739 op/s 2024-09-19T09:05:17.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:17 smithi190 ceph-mon[35358]: pgmap v594: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 6.3 MiB/s wr, 739 op/s 2024-09-19T09:05:18.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:17 smithi092 ceph-mon[31407]: pgmap v594: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 6.3 MiB/s wr, 739 op/s 2024-09-19T09:05:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.572+0000 7ff84effd640 1 -- 172.21.15.92:0/3252157111 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8400319b0 con 0x7ff8501025f0 2024-09-19T09:05:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.572+0000 7ff8567f6640 1 -- 172.21.15.92:0/3252157111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8501025f0 msgr2=0x7ff850108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.572+0000 7ff8567f6640 1 --2- 172.21.15.92:0/3252157111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8501025f0 0x7ff850108e80 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7ff840009900 tx=0x7ff84002a410 comp rx=0 tx=0).stop 2024-09-19T09:05:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.573+0000 7ff8567f6640 1 -- 172.21.15.92:0/3252157111 shutdown_connections 2024-09-19T09:05:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.573+0000 7ff8567f6640 1 --2- 172.21.15.92:0/3252157111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8501025f0 0x7ff850108e80 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.573+0000 7ff8567f6640 1 --2- 172.21.15.92:0/3252157111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff850101c30 0x7ff8501020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.573+0000 7ff8567f6640 1 --2- 172.21.15.92:0/3252157111 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff850100a40 0x7ff850100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.573+0000 7ff8567f6640 1 -- 172.21.15.92:0/3252157111 >> 172.21.15.92:0/3252157111 conn(0x7ff8500fc1e0 msgr2=0x7ff8500fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.574+0000 7ff8567f6640 1 -- 172.21.15.92:0/3252157111 shutdown_connections 2024-09-19T09:05:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.574+0000 7ff8567f6640 1 -- 172.21.15.92:0/3252157111 wait complete. 2024-09-19T09:05:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.574+0000 7ff8567f6640 1 Processor -- start 2024-09-19T09:05:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.574+0000 7ff8567f6640 1 -- start start 2024-09-19T09:05:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.575+0000 7ff8567f6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff850100a40 0x7ff850110ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.575+0000 7ff8567f6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff850101c30 0x7ff8501111e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.575+0000 7ff8567f6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8501025f0 0x7ff850118250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.575+0000 7ff8567f6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff85010b610 con 0x7ff850100a40 2024-09-19T09:05:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.575+0000 7ff8567f6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff85010b490 con 0x7ff8501025f0 2024-09-19T09:05:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.575+0000 7ff8567f6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff85010b790 con 0x7ff850101c30 2024-09-19T09:05:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.575+0000 7ff84ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff850100a40 0x7ff850110ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.575+0000 7ff84ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff850100a40 0x7ff850110ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47540/0 (socket says 172.21.15.92:47540) 2024-09-19T09:05:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.575+0000 7ff84ffff640 1 -- 172.21.15.92:0/279108916 learned_addr learned my addr 172.21.15.92:0/279108916 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.575+0000 7ff854d93640 1 --2- 172.21.15.92:0/279108916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8501025f0 0x7ff850118250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.575+0000 7ff84f7fe640 1 --2- 172.21.15.92:0/279108916 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff850101c30 0x7ff8501111e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.576+0000 7ff84ffff640 1 -- 172.21.15.92:0/279108916 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff850101c30 msgr2=0x7ff8501111e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.576+0000 7ff84ffff640 1 --2- 172.21.15.92:0/279108916 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff850101c30 0x7ff8501111e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.576+0000 7ff84ffff640 1 -- 172.21.15.92:0/279108916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8501025f0 msgr2=0x7ff850118250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.576+0000 7ff84ffff640 1 --2- 172.21.15.92:0/279108916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8501025f0 0x7ff850118250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.576+0000 7ff84ffff640 1 -- 172.21.15.92:0/279108916 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8501188c0 con 0x7ff850100a40 2024-09-19T09:05:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.576+0000 7ff854d93640 1 --2- 172.21.15.92:0/279108916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8501025f0 0x7ff850118250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:05:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.576+0000 7ff84f7fe640 1 --2- 172.21.15.92:0/279108916 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff850101c30 0x7ff8501111e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:05:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.576+0000 7ff84ffff640 1 --2- 172.21.15.92:0/279108916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff850100a40 0x7ff850110ca0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7ff84800eb70 tx=0x7ff84800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.576+0000 7ff84d7fa640 1 -- 172.21.15.92:0/279108916 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff848003b70 con 0x7ff850100a40 2024-09-19T09:05:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.576+0000 7ff8567f6640 1 -- 172.21.15.92:0/279108916 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff850118bb0 con 0x7ff850100a40 2024-09-19T09:05:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.576+0000 7ff84d7fa640 1 -- 172.21.15.92:0/279108916 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff84800ee70 con 0x7ff850100a40 2024-09-19T09:05:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.576+0000 7ff8567f6640 1 -- 172.21.15.92:0/279108916 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8501190a0 con 0x7ff850100a40 2024-09-19T09:05:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.576+0000 7ff84d7fa640 1 -- 172.21.15.92:0/279108916 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8480107a0 con 0x7ff850100a40 2024-09-19T09:05:19.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.579+0000 7ff84d7fa640 1 -- 172.21.15.92:0/279108916 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff848010940 con 0x7ff850100a40 2024-09-19T09:05:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.580+0000 7ff84d7fa640 1 --2- 172.21.15.92:0/279108916 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff8380a3370 0x7ff8380a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.581+0000 7ff859669740 1 Processor -- start 2024-09-19T09:05:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.581+0000 7ff84f7fe640 1 --2- 172.21.15.92:0/279108916 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff8380a3370 0x7ff8380a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.581+0000 7ff84d7fa640 1 -- 172.21.15.92:0/279108916 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff8480d0f10 con 0x7ff850100a40 2024-09-19T09:05:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.581+0000 7ff859669740 1 -- start start 2024-09-19T09:05:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.582+0000 7ff859669740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e44fa4e9a0 0x55e44fa4eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.582+0000 7ff859669740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e44fa4f2e0 0x55e44fa53da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.582+0000 7ff859669740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e44fa54370 0x55e44fa56830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.582+0000 7ff859669740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e44f9b22f0 con 0x55e44fa4e9a0 2024-09-19T09:05:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.582+0000 7ff859669740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e44f95a270 con 0x55e44fa4f2e0 2024-09-19T09:05:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.582+0000 7ff859669740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e44f9ae2b0 con 0x55e44fa54370 2024-09-19T09:05:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.582+0000 7ff84f7fe640 1 --2- 172.21.15.92:0/279108916 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff8380a3370 0x7ff8380a5830 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff8501121b0 tx=0x7ff844005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.582+0000 7ff854d93640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e44fa54370 0x55e44fa56830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:19.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.582+0000 7ff84f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e44fa4f2e0 0x55e44fa53da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:19.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.582+0000 7ff854d93640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e44fa54370 0x55e44fa56830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:48810/0 (socket says 172.21.15.92:48810) 2024-09-19T09:05:19.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.582+0000 7ff854d93640 1 -- 172.21.15.92:0/1067017184 learned_addr learned my addr 172.21.15.92:0/1067017184 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:19.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.582+0000 7ff84ffff640 1 --2- 172.21.15.92:0/1067017184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e44fa4e9a0 0x55e44fa4eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:19.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.582+0000 7ff854d93640 1 -- 172.21.15.92:0/1067017184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e44fa4f2e0 msgr2=0x55e44fa53da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:19.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.582+0000 7ff854d93640 1 --2- 172.21.15.92:0/1067017184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e44fa4f2e0 0x55e44fa53da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.582+0000 7ff854d93640 1 -- 172.21.15.92:0/1067017184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e44fa4e9a0 msgr2=0x55e44fa4eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:19.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.582+0000 7ff854d93640 1 --2- 172.21.15.92:0/1067017184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e44fa4e9a0 0x55e44fa4eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.582+0000 7ff854d93640 1 -- 172.21.15.92:0/1067017184 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e44f959340 con 0x55e44fa54370 2024-09-19T09:05:19.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.582+0000 7ff854d93640 1 --2- 172.21.15.92:0/1067017184 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e44fa54370 0x55e44fa56830 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff840009900 tx=0x7ff840005a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75890cc81b29ca9e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:19.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.583+0000 7ff8367fc640 1 -- 172.21.15.92:0/1067017184 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff840040070 con 0x55e44fa54370 2024-09-19T09:05:19.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.583+0000 7ff8367fc640 1 -- 172.21.15.92:0/1067017184 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff840005020 con 0x55e44fa54370 2024-09-19T09:05:19.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.583+0000 7ff8367fc640 1 -- 172.21.15.92:0/1067017184 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff840035040 con 0x55e44fa54370 2024-09-19T09:05:19.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.584+0000 7ff859669740 1 -- 172.21.15.92:0/1067017184 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e44fa54370 msgr2=0x55e44fa56830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:19.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.584+0000 7ff859669740 1 --2- 172.21.15.92:0/1067017184 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e44fa54370 0x55e44fa56830 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff840009900 tx=0x7ff840005a20 comp rx=0 tx=0).stop 2024-09-19T09:05:19.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.585+0000 7ff859669740 1 -- 172.21.15.92:0/1067017184 shutdown_connections 2024-09-19T09:05:19.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.585+0000 7ff859669740 1 --2- 172.21.15.92:0/1067017184 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e44fa54370 0x55e44fa56830 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.585+0000 7ff859669740 1 --2- 172.21.15.92:0/1067017184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e44fa4f2e0 0x55e44fa53da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.585+0000 7ff859669740 1 --2- 172.21.15.92:0/1067017184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e44fa4e9a0 0x55e44fa4eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.585+0000 7ff859669740 1 -- 172.21.15.92:0/1067017184 >> 172.21.15.92:0/1067017184 conn(0x55e44fa4a010 msgr2=0x55e44fa4a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:19.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.585+0000 7ff859669740 1 -- 172.21.15.92:0/1067017184 shutdown_connections 2024-09-19T09:05:19.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.585+0000 7ff859669740 1 -- 172.21.15.92:0/1067017184 wait complete. 2024-09-19T09:05:19.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.586+0000 7ff859669740 1 -- start start 2024-09-19T09:05:19.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.586+0000 7ff859669740 1 Processor -- start 2024-09-19T09:05:19.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.586+0000 7ff859669740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e44fa4e9a0 0x55e44fa58ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:19.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.586+0000 7ff859669740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e44fa4f2e0 0x55e44fa59020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:19.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.586+0000 7ff859669740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e44fa54370 0x55e44fa60060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:19.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.586+0000 7ff859669740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e44fa572e0 con 0x55e44fa54370 2024-09-19T09:05:19.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.586+0000 7ff859669740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e44f93b290 con 0x55e44fa4e9a0 2024-09-19T09:05:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.586+0000 7ff859669740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e44fa57460 con 0x55e44fa4f2e0 2024-09-19T09:05:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.586+0000 7ff859669740 10 client.0 _ll_register_callbacks cb 0x55e44f96c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.587+0000 7ff854d93640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e44fa54370 0x55e44fa60060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.587+0000 7ff854d93640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e44fa54370 0x55e44fa60060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47562/0 (socket says 172.21.15.92:47562) 2024-09-19T09:05:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.587+0000 7ff854d93640 1 -- 172.21.15.92:0/3275948827 learned_addr learned my addr 172.21.15.92:0/3275948827 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.587+0000 7ff84f7fe640 1 --2- 172.21.15.92:0/3275948827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e44fa4f2e0 0x55e44fa59020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.587+0000 7ff84ffff640 1 --2- 172.21.15.92:0/3275948827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e44fa4e9a0 0x55e44fa58ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.587+0000 7ff854d93640 1 -- 172.21.15.92:0/3275948827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e44fa4f2e0 msgr2=0x55e44fa59020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.587+0000 7ff854d93640 1 --2- 172.21.15.92:0/3275948827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e44fa4f2e0 0x55e44fa59020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.587+0000 7ff854d93640 1 -- 172.21.15.92:0/3275948827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e44fa4e9a0 msgr2=0x55e44fa58ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.587+0000 7ff854d93640 1 --2- 172.21.15.92:0/3275948827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e44fa4e9a0 0x55e44fa58ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.587+0000 7ff854d93640 1 -- 172.21.15.92:0/3275948827 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e44f6c5210 con 0x55e44fa54370 2024-09-19T09:05:19.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.587+0000 7ff854d93640 1 --2- 172.21.15.92:0/3275948827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e44fa54370 0x55e44fa60060 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7ff84002a930 tx=0x7ff840005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9471b54d98a774b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:19.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.587+0000 7ff82f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:05:19.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.588+0000 7ff82f7fe640 1 -- 172.21.15.92:0/3275948827 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84004c030 con 0x55e44fa54370 2024-09-19T09:05:19.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.588+0000 7ff82f7fe640 1 -- 172.21.15.92:0/3275948827 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff840031830 con 0x55e44fa54370 2024-09-19T09:05:19.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.588+0000 7ff859669740 1 -- 172.21.15.92:0/3275948827 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff840005020 con 0x55e44fa54370 2024-09-19T09:05:19.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.588+0000 7ff82f7fe640 1 -- 172.21.15.92:0/3275948827 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff840040070 con 0x55e44fa54370 2024-09-19T09:05:19.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.588+0000 7ff859669740 10 client.17406 fetch_fsmap learned FSMap version 19 2024-09-19T09:05:19.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.588+0000 7ff859669740 1 -- 172.21.15.92:0/3275948827 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e44f791620 con 0x55e44fa54370 2024-09-19T09:05:19.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.588+0000 7ff82f7fe640 1 -- 172.21.15.92:0/3275948827 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff840005020 con 0x55e44fa54370 2024-09-19T09:05:19.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.588+0000 7ff82f7fe640 1 -- 172.21.15.92:0/3275948827 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff84003c9d0 con 0x55e44fa54370 2024-09-19T09:05:19.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.588+0000 7ff859669740 10 client.17406 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:05:19.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.588+0000 7ff859669740 10 client.17406 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:05:19.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.588+0000 7ff859669740 20 client.17406 populate_metadata read hostname 'smithi092' 2024-09-19T09:05:19.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.588+0000 7ff859669740 1 --2- 172.21.15.92:0/3275948827 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e44fa64360 0x55e44fa66750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:19.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.589+0000 7ff859669740 4 client.17406 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:05:19.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.589+0000 7ff859669740 1 -- 172.21.15.92:0/3275948827 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e44f9bfa20 con 0x55e44fa64360 2024-09-19T09:05:19.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.589+0000 7ff84ffff640 1 --2- 172.21.15.92:0/3275948827 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e44fa64360 0x55e44fa66750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.591+0000 7ff84ffff640 1 --2- 172.21.15.92:0/3275948827 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e44fa64360 0x55e44fa66750 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edd6aeb29b779d32 server_cookie=503d4c858fe1c7fe in_seq=0 out_seq=0 2024-09-19T09:05:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.591+0000 7ff82f7fe640 10 client.17406 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.591+0000 7ff82f7fe640 1 -- 172.21.15.92:0/3275948827 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e44f9bfa20 con 0x55e44fa64360 2024-09-19T09:05:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.591+0000 7ff82f7fe640 10 client.17406 handle_command_reply: tid=0 2024-09-19T09:05:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.592+0000 7ff859669740 1 client.17406 shutdown 2024-09-19T09:05:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.592+0000 7ff859669740 1 -- 172.21.15.92:0/3275948827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e44fa54370 msgr2=0x55e44fa60060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:19.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.592+0000 7ff859669740 1 --2- 172.21.15.92:0/3275948827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e44fa54370 0x55e44fa60060 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7ff84002a930 tx=0x7ff840005fd0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.592+0000 7ff859669740 1 -- 172.21.15.92:0/3275948827 shutdown_connections 2024-09-19T09:05:19.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.592+0000 7ff859669740 1 --2- 172.21.15.92:0/3275948827 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e44fa64360 0x55e44fa66750 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.592+0000 7ff859669740 1 --2- 172.21.15.92:0/3275948827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e44fa54370 0x55e44fa60060 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.592+0000 7ff859669740 1 --2- 172.21.15.92:0/3275948827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e44fa4f2e0 0x55e44fa59020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.592+0000 7ff859669740 1 --2- 172.21.15.92:0/3275948827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e44fa4e9a0 0x55e44fa58ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.592+0000 7ff859669740 1 -- 172.21.15.92:0/3275948827 >> 172.21.15.92:0/3275948827 conn(0x55e44fa4a010 msgr2=0x55e44fa4b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:19.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.592+0000 7ff82f7fe640 0 client.17406 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:19.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.592+0000 7ff859669740 1 -- 172.21.15.92:0/3275948827 shutdown_connections 2024-09-19T09:05:19.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.593+0000 7ff859669740 1 -- 172.21.15.92:0/3275948827 wait complete. 2024-09-19T09:05:19.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.593+0000 7ff859669740 20 client.17406 trim_cache size 0 max 16384 2024-09-19T09:05:19.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.616+0000 7ff859669740 1 Processor -- start 2024-09-19T09:05:19.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.616+0000 7ff859669740 1 -- start start 2024-09-19T09:05:19.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.616+0000 7ff859669740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e44fa4e9a0 0x55e44fa4a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:19.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.616+0000 7ff859669740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e44fa4f2e0 0x55e44fa60020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:19.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.616+0000 7ff859669740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e44fa54370 0x55e44fa4a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:19.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.616+0000 7ff859669740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff8501b5de0 con 0x55e44fa4f2e0 2024-09-19T09:05:19.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.616+0000 7ff859669740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff8501b8680 con 0x55e44fa4e9a0 2024-09-19T09:05:19.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.616+0000 7ff859669740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff8501b6470 con 0x55e44fa54370 2024-09-19T09:05:19.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.616+0000 7ff84f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e44fa4f2e0 0x55e44fa60020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:19.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.616+0000 7ff84f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e44fa4f2e0 0x55e44fa60020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47574/0 (socket says 172.21.15.92:47574) 2024-09-19T09:05:19.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.616+0000 7ff84f7fe640 1 -- 172.21.15.92:0/2159691987 learned_addr learned my addr 172.21.15.92:0/2159691987 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:19.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.616+0000 7ff84ffff640 1 --2- 172.21.15.92:0/2159691987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e44fa4e9a0 0x55e44fa4a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:19.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.617+0000 7ff854d93640 1 --2- 172.21.15.92:0/2159691987 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e44fa54370 0x55e44fa4a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:19.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.617+0000 7ff854d93640 1 -- 172.21.15.92:0/2159691987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e44fa4e9a0 msgr2=0x55e44fa4a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:19.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.617+0000 7ff854d93640 1 --2- 172.21.15.92:0/2159691987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e44fa4e9a0 0x55e44fa4a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.617+0000 7ff854d93640 1 -- 172.21.15.92:0/2159691987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e44fa4f2e0 msgr2=0x55e44fa60020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:19.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.617+0000 7ff854d93640 1 --2- 172.21.15.92:0/2159691987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e44fa4f2e0 0x55e44fa60020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.617+0000 7ff854d93640 1 -- 172.21.15.92:0/2159691987 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e44fa575a0 con 0x55e44fa54370 2024-09-19T09:05:19.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.617+0000 7ff84f7fe640 1 --2- 172.21.15.92:0/2159691987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e44fa4f2e0 0x55e44fa60020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:05:19.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.617+0000 7ff854d93640 1 --2- 172.21.15.92:0/2159691987 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e44fa54370 0x55e44fa4a930 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff840009230 tx=0x7ff84003f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6acba96516c0da3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:19.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.617+0000 7ff835ffb640 1 -- 172.21.15.92:0/2159691987 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84004c040 con 0x55e44fa54370 2024-09-19T09:05:19.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.617+0000 7ff835ffb640 1 -- 172.21.15.92:0/2159691987 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff840009520 con 0x55e44fa54370 2024-09-19T09:05:19.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.618+0000 7ff835ffb640 1 -- 172.21.15.92:0/2159691987 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff840035040 con 0x55e44fa54370 2024-09-19T09:05:19.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.618+0000 7ff859669740 1 -- 172.21.15.92:0/2159691987 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e44fa54370 msgr2=0x55e44fa4a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:19.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.618+0000 7ff859669740 1 --2- 172.21.15.92:0/2159691987 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e44fa54370 0x55e44fa4a930 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff840009230 tx=0x7ff84003f000 comp rx=0 tx=0).stop 2024-09-19T09:05:19.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.618+0000 7ff859669740 1 -- 172.21.15.92:0/2159691987 shutdown_connections 2024-09-19T09:05:19.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.618+0000 7ff859669740 1 --2- 172.21.15.92:0/2159691987 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e44fa54370 0x55e44fa4a930 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.618+0000 7ff859669740 1 --2- 172.21.15.92:0/2159691987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e44fa4f2e0 0x55e44fa60020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.618+0000 7ff859669740 1 --2- 172.21.15.92:0/2159691987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e44fa4e9a0 0x55e44fa4a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.618+0000 7ff859669740 1 -- 172.21.15.92:0/2159691987 >> 172.21.15.92:0/2159691987 conn(0x55e44fa4a010 msgr2=0x55e44fa50420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:19.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.618+0000 7ff859669740 1 -- 172.21.15.92:0/2159691987 shutdown_connections 2024-09-19T09:05:19.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.618+0000 7ff859669740 1 -- 172.21.15.92:0/2159691987 wait complete. 2024-09-19T09:05:19.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.619+0000 7ff859669740 1 -- start start 2024-09-19T09:05:19.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.619+0000 7ff859669740 1 Processor -- start 2024-09-19T09:05:19.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.619+0000 7ff859669740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e44fa4e9a0 0x55e44fa5d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:19.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.619+0000 7ff859669740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e44fa4f2e0 0x55e44fa5d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:19.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.619+0000 7ff859669740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e44fa54370 0x55e44fade030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:19.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.619+0000 7ff859669740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff8501b6b40 con 0x55e44fa54370 2024-09-19T09:05:19.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.619+0000 7ff859669740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff8501b7fb0 con 0x55e44fa4f2e0 2024-09-19T09:05:19.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.619+0000 7ff859669740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff8501b7210 con 0x55e44fa4e9a0 2024-09-19T09:05:19.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.619+0000 7ff859669740 10 client.0 _ll_register_callbacks cb 0x7ff844009db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:19.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.619+0000 7ff854d93640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e44fa54370 0x55e44fade030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:19.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.619+0000 7ff854d93640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e44fa54370 0x55e44fade030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47584/0 (socket says 172.21.15.92:47584) 2024-09-19T09:05:19.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.619+0000 7ff854d93640 1 -- 172.21.15.92:0/3032999714 learned_addr learned my addr 172.21.15.92:0/3032999714 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:19.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.619+0000 7ff84ffff640 1 --2- 172.21.15.92:0/3032999714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e44fa4e9a0 0x55e44fa5d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:19.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.620+0000 7ff84ffff640 1 -- 172.21.15.92:0/3032999714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e44fa4f2e0 msgr2=0x55e44fa5d580 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:05:19.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.620+0000 7ff84ffff640 1 --2- 172.21.15.92:0/3032999714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e44fa4f2e0 0x55e44fa5d580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.620+0000 7ff84ffff640 1 -- 172.21.15.92:0/3032999714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e44fa54370 msgr2=0x55e44fade030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:19.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.620+0000 7ff84ffff640 1 --2- 172.21.15.92:0/3032999714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e44fa54370 0x55e44fade030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.620+0000 7ff84ffff640 1 -- 172.21.15.92:0/3032999714 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e44fa452d0 con 0x55e44fa4e9a0 2024-09-19T09:05:19.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.621+0000 7ff84ffff640 1 --2- 172.21.15.92:0/3032999714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e44fa4e9a0 0x55e44fa5d040 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff848099ec0 tx=0x7ff848004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b990b9bab2e32c97 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:19.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.621+0000 7ff82f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:05:19.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.621+0000 7ff82f7fe640 1 -- 172.21.15.92:0/3032999714 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8480bb060 con 0x55e44fa4e9a0 2024-09-19T09:05:19.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.621+0000 7ff82f7fe640 1 -- 172.21.15.92:0/3032999714 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff848099b60 con 0x55e44fa4e9a0 2024-09-19T09:05:19.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.621+0000 7ff859669740 1 -- 172.21.15.92:0/3032999714 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff840009520 con 0x55e44fa4e9a0 2024-09-19T09:05:19.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.621+0000 7ff82f7fe640 1 -- 172.21.15.92:0/3032999714 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff84807e030 con 0x55e44fa4e9a0 2024-09-19T09:05:19.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.622+0000 7ff859669740 10 client.26659 fetch_fsmap learned FSMap version 19 2024-09-19T09:05:19.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.622+0000 7ff859669740 1 -- 172.21.15.92:0/3032999714 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e44fadf780 con 0x55e44fa4e9a0 2024-09-19T09:05:19.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.622+0000 7ff82f7fe640 1 -- 172.21.15.92:0/3032999714 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff840009520 con 0x55e44fa4e9a0 2024-09-19T09:05:19.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.622+0000 7ff82f7fe640 1 -- 172.21.15.92:0/3032999714 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff8480a5cd0 con 0x55e44fa4e9a0 2024-09-19T09:05:19.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.622+0000 7ff859669740 10 client.26659 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:05:19.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.622+0000 7ff859669740 10 client.26659 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:05:19.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.623+0000 7ff859669740 20 client.26659 populate_metadata read hostname 'smithi092' 2024-09-19T09:05:19.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.623+0000 7ff859669740 1 --2- 172.21.15.92:0/3032999714 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e44fae00c0 0x55e44fae2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:19.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.623+0000 7ff859669740 4 client.26659 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:05:19.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.623+0000 7ff859669740 1 -- 172.21.15.92:0/3032999714 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e44f9b9d70 con 0x55e44fae00c0 2024-09-19T09:05:19.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.623+0000 7ff84f7fe640 1 --2- 172.21.15.92:0/3032999714 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e44fae00c0 0x55e44fae2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:19.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.623+0000 7ff84f7fe640 1 --2- 172.21.15.92:0/3032999714 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e44fae00c0 0x55e44fae2500 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc562f514b23d48f server_cookie=f4de86382705417f in_seq=0 out_seq=0 2024-09-19T09:05:19.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.623+0000 7ff82f7fe640 10 client.26659 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:19.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.639+0000 7ff82f7fe640 1 -- 172.21.15.92:0/3032999714 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e44f9b9d70 con 0x55e44fae00c0 2024-09-19T09:05:19.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.639+0000 7ff82f7fe640 10 client.26659 handle_command_reply: tid=0 2024-09-19T09:05:19.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.639+0000 7ff859669740 1 client.26659 shutdown 2024-09-19T09:05:19.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.640+0000 7ff859669740 1 -- 172.21.15.92:0/3032999714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e44fa4e9a0 msgr2=0x55e44fa5d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:19.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.640+0000 7ff859669740 1 --2- 172.21.15.92:0/3032999714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e44fa4e9a0 0x55e44fa5d040 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff848099ec0 tx=0x7ff848004750 comp rx=0 tx=0).stop 2024-09-19T09:05:19.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.640+0000 7ff859669740 1 -- 172.21.15.92:0/3032999714 shutdown_connections 2024-09-19T09:05:19.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.640+0000 7ff859669740 1 --2- 172.21.15.92:0/3032999714 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e44fae00c0 0x55e44fae2500 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.640+0000 7ff859669740 1 --2- 172.21.15.92:0/3032999714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e44fa54370 0x55e44fade030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.640+0000 7ff859669740 1 --2- 172.21.15.92:0/3032999714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e44fa4f2e0 0x55e44fa5d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.640+0000 7ff859669740 1 --2- 172.21.15.92:0/3032999714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e44fa4e9a0 0x55e44fa5d040 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.640+0000 7ff82f7fe640 0 client.26659 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:19.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.640+0000 7ff859669740 1 -- 172.21.15.92:0/3032999714 >> 172.21.15.92:0/3032999714 conn(0x55e44fa4a010 msgr2=0x55e44fa489a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:19.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.640+0000 7ff859669740 1 -- 172.21.15.92:0/3032999714 shutdown_connections 2024-09-19T09:05:19.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.640+0000 7ff859669740 1 -- 172.21.15.92:0/3032999714 wait complete. 2024-09-19T09:05:19.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.640+0000 7ff859669740 20 client.26659 trim_cache size 0 max 16384 2024-09-19T09:05:19.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:05:19.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:05:19.643 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:05:19.643 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:05:19.643 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.641+0000 7ff8567f6640 1 -- 172.21.15.92:0/279108916 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff8380a3370 msgr2=0x7ff8380a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:19.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.641+0000 7ff8567f6640 1 --2- 172.21.15.92:0/279108916 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff8380a3370 0x7ff8380a5830 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff8501121b0 tx=0x7ff844005f90 comp rx=0 tx=0).stop 2024-09-19T09:05:19.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.641+0000 7ff8567f6640 1 -- 172.21.15.92:0/279108916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff850100a40 msgr2=0x7ff850110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:19.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.641+0000 7ff8567f6640 1 --2- 172.21.15.92:0/279108916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff850100a40 0x7ff850110ca0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7ff84800eb70 tx=0x7ff84800c6a0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.641+0000 7ff8567f6640 1 -- 172.21.15.92:0/279108916 shutdown_connections 2024-09-19T09:05:19.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.641+0000 7ff8567f6640 1 --2- 172.21.15.92:0/279108916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8501025f0 0x7ff850118250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.641+0000 7ff8567f6640 1 --2- 172.21.15.92:0/279108916 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff850101c30 0x7ff8501111e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.641+0000 7ff8567f6640 1 --2- 172.21.15.92:0/279108916 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff8380a3370 0x7ff8380a5830 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.641+0000 7ff8567f6640 1 --2- 172.21.15.92:0/279108916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff850100a40 0x7ff850110ca0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.641+0000 7ff8567f6640 1 -- 172.21.15.92:0/279108916 >> 172.21.15.92:0/279108916 conn(0x7ff8500fc1e0 msgr2=0x7ff8500fdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:19.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.641+0000 7ff8567f6640 1 -- 172.21.15.92:0/279108916 shutdown_connections 2024-09-19T09:05:19.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:19.641+0000 7ff8567f6640 1 -- 172.21.15.92:0/279108916 wait complete. 2024-09-19T09:05:19.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:19 smithi167 ceph-mon[35359]: pgmap v595: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 7.2 MiB/s wr, 819 op/s 2024-09-19T09:05:19.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:19 smithi190 ceph-mon[35358]: pgmap v595: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 7.2 MiB/s wr, 819 op/s 2024-09-19T09:05:20.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:19 smithi092 ceph-mon[31407]: pgmap v595: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 7.2 MiB/s wr, 819 op/s 2024-09-19T09:05:20.795 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 515.0 s, 3260.0 tps, lat 30.569 ms stddev 34.123 2024-09-19T09:05:21.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:21 smithi167 ceph-mon[35359]: pgmap v596: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 8.3 MiB/s wr, 911 op/s 2024-09-19T09:05:21.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:21 smithi190 ceph-mon[35358]: pgmap v596: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 8.3 MiB/s wr, 911 op/s 2024-09-19T09:05:22.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:21 smithi092 ceph-mon[31407]: pgmap v596: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 8.3 MiB/s wr, 911 op/s 2024-09-19T09:05:23.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:23 smithi167 ceph-mon[35359]: pgmap v597: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 7.6 MiB/s wr, 838 op/s 2024-09-19T09:05:23.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:23 smithi190 ceph-mon[35358]: pgmap v597: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 7.6 MiB/s wr, 838 op/s 2024-09-19T09:05:24.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:23 smithi092 ceph-mon[31407]: pgmap v597: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 7.6 MiB/s wr, 838 op/s 2024-09-19T09:05:25.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 520.0 s, 3833.4 tps, lat 26.074 ms stddev 29.241 2024-09-19T09:05:25.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:25 smithi167 ceph-mon[35359]: pgmap v598: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 9.0 MiB/s wr, 956 op/s 2024-09-19T09:05:25.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:25 smithi190 ceph-mon[35358]: pgmap v598: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 9.0 MiB/s wr, 956 op/s 2024-09-19T09:05:26.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:25 smithi092 ceph-mon[31407]: pgmap v598: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 9.0 MiB/s wr, 956 op/s 2024-09-19T09:05:27.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:27 smithi167 ceph-mon[35359]: pgmap v599: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.6 MiB/s wr, 730 op/s 2024-09-19T09:05:27.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:27 smithi190 ceph-mon[35358]: pgmap v599: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.6 MiB/s wr, 730 op/s 2024-09-19T09:05:28.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:27 smithi092 ceph-mon[31407]: pgmap v599: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.6 MiB/s wr, 730 op/s 2024-09-19T09:05:29.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:29 smithi167 ceph-mon[35359]: pgmap v600: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 11 MiB/s wr, 875 op/s 2024-09-19T09:05:29.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:29 smithi190 ceph-mon[35358]: pgmap v600: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 11 MiB/s wr, 875 op/s 2024-09-19T09:05:30.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:29 smithi092 ceph-mon[31407]: pgmap v600: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 11 MiB/s wr, 875 op/s 2024-09-19T09:05:30.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 525.0 s, 2615.0 tps, lat 38.330 ms stddev 41.012 2024-09-19T09:05:31.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:31 smithi167 ceph-mon[35359]: pgmap v601: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 885 op/s 2024-09-19T09:05:31.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:31 smithi190 ceph-mon[35358]: pgmap v601: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 885 op/s 2024-09-19T09:05:32.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:31 smithi092 ceph-mon[31407]: pgmap v601: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 885 op/s 2024-09-19T09:05:32.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.783+0000 7fd638998640 1 -- 172.21.15.92:0/1760086165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd634103710 msgr2=0x7fd634109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:32.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.783+0000 7fd638998640 1 --2- 172.21.15.92:0/1760086165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd634103710 0x7fd634109fa0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd62c009be0 tx=0x7fd62c02a6d0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.787 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.783+0000 7fd638998640 1 -- 172.21.15.92:0/1760086165 shutdown_connections 2024-09-19T09:05:32.787 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.783+0000 7fd638998640 1 --2- 172.21.15.92:0/1760086165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd634103710 0x7fd634109fa0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.787 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.783+0000 7fd638998640 1 --2- 172.21.15.92:0/1760086165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd634102d50 0x7fd6341031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.787 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.783+0000 7fd638998640 1 --2- 172.21.15.92:0/1760086165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd634101b60 0x7fd634101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.787 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.783+0000 7fd638998640 1 -- 172.21.15.92:0/1760086165 >> 172.21.15.92:0/1760086165 conn(0x7fd6340fd2c0 msgr2=0x7fd6340ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:32.787 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.783+0000 7fd638998640 1 -- 172.21.15.92:0/1760086165 shutdown_connections 2024-09-19T09:05:32.787 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.783+0000 7fd638998640 1 -- 172.21.15.92:0/1760086165 wait complete. 2024-09-19T09:05:32.787 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.784+0000 7fd638998640 1 Processor -- start 2024-09-19T09:05:32.787 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.784+0000 7fd638998640 1 -- start start 2024-09-19T09:05:32.787 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.784+0000 7fd638998640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd634101b60 0x7fd634197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:32.787 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.784+0000 7fd638998640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd634102d50 0x7fd634198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:32.788 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.784+0000 7fd638998640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd634103710 0x7fd63419f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:32.788 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.784+0000 7fd638998640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd63410d840 con 0x7fd634103710 2024-09-19T09:05:32.788 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.784+0000 7fd638998640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd63410d6c0 con 0x7fd634101b60 2024-09-19T09:05:32.788 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.784+0000 7fd638998640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd63410d9c0 con 0x7fd634102d50 2024-09-19T09:05:32.788 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.784+0000 7fd631d9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd634102d50 0x7fd634198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:32.788 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.784+0000 7fd632d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd634103710 0x7fd63419f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:32.788 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.784+0000 7fd631d9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd634102d50 0x7fd634198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:43758/0 (socket says 172.21.15.92:43758) 2024-09-19T09:05:32.788 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.784+0000 7fd631d9b640 1 -- 172.21.15.92:0/3283565747 learned_addr learned my addr 172.21.15.92:0/3283565747 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:32.788 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.785+0000 7fd63259c640 1 --2- 172.21.15.92:0/3283565747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd634101b60 0x7fd634197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:32.788 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.785+0000 7fd632d9d640 1 -- 172.21.15.92:0/3283565747 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd634102d50 msgr2=0x7fd634198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.785+0000 7fd632d9d640 1 --2- 172.21.15.92:0/3283565747 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd634102d50 0x7fd634198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.785+0000 7fd632d9d640 1 -- 172.21.15.92:0/3283565747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd634101b60 msgr2=0x7fd634197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.785+0000 7fd632d9d640 1 --2- 172.21.15.92:0/3283565747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd634101b60 0x7fd634197e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.785+0000 7fd632d9d640 1 -- 172.21.15.92:0/3283565747 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd63419fa30 con 0x7fd634103710 2024-09-19T09:05:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.785+0000 7fd631d9b640 1 --2- 172.21.15.92:0/3283565747 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd634102d50 0x7fd634198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:05:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.785+0000 7fd63259c640 1 --2- 172.21.15.92:0/3283565747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd634101b60 0x7fd634197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:05:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.785+0000 7fd632d9d640 1 --2- 172.21.15.92:0/3283565747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd634103710 0x7fd63419f3c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fd62c009b30 tx=0x7fd62c030710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.785+0000 7fd6237fe640 1 -- 172.21.15.92:0/3283565747 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62c041020 con 0x7fd634103710 2024-09-19T09:05:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.785+0000 7fd638998640 1 -- 172.21.15.92:0/3283565747 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd63419fcc0 con 0x7fd634103710 2024-09-19T09:05:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.785+0000 7fd6237fe640 1 -- 172.21.15.92:0/3283565747 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd62c031920 con 0x7fd634103710 2024-09-19T09:05:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.785+0000 7fd6237fe640 1 -- 172.21.15.92:0/3283565747 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62c036040 con 0x7fd634103710 2024-09-19T09:05:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.785+0000 7fd638998640 1 -- 172.21.15.92:0/3283565747 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6341a0230 con 0x7fd634103710 2024-09-19T09:05:32.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.789+0000 7fd63b80f740 1 Processor -- start 2024-09-19T09:05:32.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.789+0000 7fd6237fe640 1 -- 172.21.15.92:0/3283565747 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd62c044020 con 0x7fd634103710 2024-09-19T09:05:32.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.789+0000 7fd63b80f740 1 -- start start 2024-09-19T09:05:32.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.790+0000 7fd63b80f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55679ed019a0 0x55679ed01da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:32.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.790+0000 7fd63b80f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55679ed022e0 0x55679ed11680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:32.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.790+0000 7fd63b80f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55679ed11bc0 0x55679ed14030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:32.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.790+0000 7fd63b80f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55679ec672f0 con 0x55679ed019a0 2024-09-19T09:05:32.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.790+0000 7fd63b80f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55679ec0f270 con 0x55679ed11bc0 2024-09-19T09:05:32.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.790+0000 7fd63b80f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55679ec632b0 con 0x55679ed022e0 2024-09-19T09:05:32.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.790+0000 7fd631d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55679ed019a0 0x55679ed01da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:32.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.790+0000 7fd63259c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55679ed022e0 0x55679ed11680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:32.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.790+0000 7fd631d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55679ed019a0 0x55679ed01da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60534/0 (socket says 172.21.15.92:60534) 2024-09-19T09:05:32.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.790+0000 7fd63259c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55679ed022e0 0x55679ed11680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:43766/0 (socket says 172.21.15.92:43766) 2024-09-19T09:05:32.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.790+0000 7fd631d9b640 1 -- 172.21.15.92:0/471009848 learned_addr learned my addr 172.21.15.92:0/471009848 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.790+0000 7fd631d9b640 1 --2- 172.21.15.92:0/471009848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55679ed11bc0 0x55679ed14030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.790+0000 7fd6237fe640 1 --2- 172.21.15.92:0/3283565747 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd61c0a3370 0x7fd61c0a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.790+0000 7fd631d9b640 1 -- 172.21.15.92:0/471009848 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55679ed022e0 msgr2=0x55679ed11680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.790+0000 7fd631d9b640 1 --2- 172.21.15.92:0/471009848 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55679ed022e0 0x55679ed11680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.790+0000 7fd631d9b640 1 -- 172.21.15.92:0/471009848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55679ed11bc0 msgr2=0x55679ed14030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.790+0000 7fd631d9b640 1 --2- 172.21.15.92:0/471009848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55679ed11bc0 0x55679ed14030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.790+0000 7fd631d9b640 1 -- 172.21.15.92:0/471009848 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55679ec0e340 con 0x55679ed019a0 2024-09-19T09:05:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.790+0000 7fd63259c640 1 --2- 172.21.15.92:0/471009848 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55679ed022e0 0x55679ed11680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:05:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.790+0000 7fd632d9d640 1 --2- 172.21.15.92:0/3283565747 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd61c0a3370 0x7fd61c0a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.790+0000 7fd6237fe640 1 -- 172.21.15.92:0/3283565747 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd62c0f0710 con 0x7fd634103710 2024-09-19T09:05:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.790+0000 7fd631d9b640 1 --2- 172.21.15.92:0/471009848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55679ed019a0 0x55679ed01da0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fd628015780 tx=0x7fd628009a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad15e2f43baa71d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:32.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.791+0000 7fd620ff9640 1 -- 172.21.15.92:0/471009848 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6280108f0 con 0x55679ed019a0 2024-09-19T09:05:32.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.791+0000 7fd620ff9640 1 -- 172.21.15.92:0/471009848 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd62801c070 con 0x55679ed019a0 2024-09-19T09:05:32.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.791+0000 7fd620ff9640 1 -- 172.21.15.92:0/471009848 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd628017d20 con 0x55679ed019a0 2024-09-19T09:05:32.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.792+0000 7fd63b80f740 1 -- 172.21.15.92:0/471009848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55679ed019a0 msgr2=0x55679ed01da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:32.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.792+0000 7fd63b80f740 1 --2- 172.21.15.92:0/471009848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55679ed019a0 0x55679ed01da0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fd628015780 tx=0x7fd628009a30 comp rx=0 tx=0).stop 2024-09-19T09:05:32.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.792+0000 7fd632d9d640 1 --2- 172.21.15.92:0/3283565747 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd61c0a3370 0x7fd61c0a5830 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd62c0b96c0 tx=0x7fd62c087730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:32.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.792+0000 7fd63b80f740 1 -- 172.21.15.92:0/471009848 shutdown_connections 2024-09-19T09:05:32.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.792+0000 7fd63b80f740 1 --2- 172.21.15.92:0/471009848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55679ed11bc0 0x55679ed14030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.792+0000 7fd63b80f740 1 --2- 172.21.15.92:0/471009848 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55679ed022e0 0x55679ed11680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.792+0000 7fd63b80f740 1 --2- 172.21.15.92:0/471009848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55679ed019a0 0x55679ed01da0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.792+0000 7fd63b80f740 1 -- 172.21.15.92:0/471009848 >> 172.21.15.92:0/471009848 conn(0x55679ecfef90 msgr2=0x55679ecff370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:32.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.792+0000 7fd63b80f740 1 -- 172.21.15.92:0/471009848 shutdown_connections 2024-09-19T09:05:32.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.793+0000 7fd63b80f740 1 -- 172.21.15.92:0/471009848 wait complete. 2024-09-19T09:05:32.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.793+0000 7fd63b80f740 1 -- start start 2024-09-19T09:05:32.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.793+0000 7fd63b80f740 1 Processor -- start 2024-09-19T09:05:32.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.793+0000 7fd63b80f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55679ed019a0 0x55679ed16360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:32.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.793+0000 7fd63b80f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55679ed022e0 0x55679ed168a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:32.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.793+0000 7fd63b80f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55679ed11bc0 0x55679ed1d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:32.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.793+0000 7fd63b80f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55679ed14ae0 con 0x55679ed019a0 2024-09-19T09:05:32.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.793+0000 7fd63b80f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55679ebf0290 con 0x55679ed11bc0 2024-09-19T09:05:32.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.793+0000 7fd63b80f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55679ed14c60 con 0x55679ed022e0 2024-09-19T09:05:32.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.793+0000 7fd63b80f740 10 client.0 _ll_register_callbacks cb 0x55679ec21140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:32.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.793+0000 7fd631d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55679ed019a0 0x55679ed16360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:32.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.794+0000 7fd631d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55679ed019a0 0x55679ed16360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60538/0 (socket says 172.21.15.92:60538) 2024-09-19T09:05:32.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.794+0000 7fd631d9b640 1 -- 172.21.15.92:0/428354937 learned_addr learned my addr 172.21.15.92:0/428354937 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:32.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.794+0000 7fd631d9b640 1 --2- 172.21.15.92:0/428354937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55679ed11bc0 0x55679ed1d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:32.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.794+0000 7fd631d9b640 1 -- 172.21.15.92:0/428354937 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55679ed022e0 msgr2=0x55679ed168a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:05:32.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.794+0000 7fd631d9b640 1 --2- 172.21.15.92:0/428354937 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55679ed022e0 0x55679ed168a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.794+0000 7fd631d9b640 1 -- 172.21.15.92:0/428354937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55679ed11bc0 msgr2=0x55679ed1d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:32.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.794+0000 7fd631d9b640 1 --2- 172.21.15.92:0/428354937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55679ed11bc0 0x55679ed1d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.794+0000 7fd631d9b640 1 -- 172.21.15.92:0/428354937 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55679e97a210 con 0x55679ed019a0 2024-09-19T09:05:32.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.794+0000 7fd631d9b640 1 --2- 172.21.15.92:0/428354937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55679ed019a0 0x55679ed16360 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fd628006df0 tx=0x7fd628006d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=167ec2b55e4781b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:32.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.794+0000 7fd619ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:05:32.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.794+0000 7fd619ffb640 1 -- 172.21.15.92:0/428354937 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd628010b00 con 0x55679ed019a0 2024-09-19T09:05:32.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.794+0000 7fd63b80f740 1 -- 172.21.15.92:0/428354937 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd62801c070 con 0x55679ed019a0 2024-09-19T09:05:32.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.794+0000 7fd619ffb640 1 -- 172.21.15.92:0/428354937 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd628010ca0 con 0x55679ed019a0 2024-09-19T09:05:32.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.794+0000 7fd619ffb640 1 -- 172.21.15.92:0/428354937 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd628010ea0 con 0x55679ed019a0 2024-09-19T09:05:32.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.794+0000 7fd63b80f740 10 client.17421 fetch_fsmap learned FSMap version 19 2024-09-19T09:05:32.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.795+0000 7fd63b80f740 1 -- 172.21.15.92:0/428354937 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55679ea46620 con 0x55679ed019a0 2024-09-19T09:05:32.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.795+0000 7fd619ffb640 1 -- 172.21.15.92:0/428354937 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd62801c070 con 0x55679ed019a0 2024-09-19T09:05:32.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.795+0000 7fd619ffb640 1 -- 172.21.15.92:0/428354937 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fd628022560 con 0x55679ed019a0 2024-09-19T09:05:32.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.795+0000 7fd63b80f740 10 client.17421 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:05:32.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.795+0000 7fd63b80f740 10 client.17421 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:05:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.795+0000 7fd63b80f740 20 client.17421 populate_metadata read hostname 'smithi092' 2024-09-19T09:05:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.795+0000 7fd63b80f740 1 --2- 172.21.15.92:0/428354937 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55679ed21cc0 0x55679ed240e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.795+0000 7fd63b80f740 4 client.17421 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:05:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.795+0000 7fd63b80f740 1 -- 172.21.15.92:0/428354937 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55679ec74a20 con 0x55679ed21cc0 2024-09-19T09:05:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.795+0000 7fd63259c640 1 --2- 172.21.15.92:0/428354937 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55679ed21cc0 0x55679ed240e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.796+0000 7fd63259c640 1 --2- 172.21.15.92:0/428354937 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55679ed21cc0 0x55679ed240e0 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1aae0386c24cf54 server_cookie=91cde19a7ff7a743 in_seq=0 out_seq=0 2024-09-19T09:05:32.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.796+0000 7fd619ffb640 10 client.17421 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:32.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.796+0000 7fd619ffb640 1 -- 172.21.15.92:0/428354937 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55679ec74a20 con 0x55679ed21cc0 2024-09-19T09:05:32.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.796+0000 7fd619ffb640 10 client.17421 handle_command_reply: tid=0 2024-09-19T09:05:32.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.797+0000 7fd63b80f740 1 client.17421 shutdown 2024-09-19T09:05:32.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.797+0000 7fd63b80f740 1 -- 172.21.15.92:0/428354937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55679ed019a0 msgr2=0x55679ed16360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:32.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.797+0000 7fd63b80f740 1 --2- 172.21.15.92:0/428354937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55679ed019a0 0x55679ed16360 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fd628006df0 tx=0x7fd628006d80 comp rx=0 tx=0).stop 2024-09-19T09:05:32.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.798+0000 7fd63b80f740 1 -- 172.21.15.92:0/428354937 shutdown_connections 2024-09-19T09:05:32.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.798+0000 7fd63b80f740 1 --2- 172.21.15.92:0/428354937 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55679ed21cc0 0x55679ed240e0 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.798+0000 7fd619ffb640 0 client.17421 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:32.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.798+0000 7fd63b80f740 1 --2- 172.21.15.92:0/428354937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55679ed11bc0 0x55679ed1d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.798+0000 7fd63b80f740 1 --2- 172.21.15.92:0/428354937 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55679ed022e0 0x55679ed168a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.798+0000 7fd63b80f740 1 --2- 172.21.15.92:0/428354937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55679ed019a0 0x55679ed16360 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.798+0000 7fd63b80f740 1 -- 172.21.15.92:0/428354937 >> 172.21.15.92:0/428354937 conn(0x55679ecfef90 msgr2=0x55679ed007a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:32.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.798+0000 7fd63b80f740 1 -- 172.21.15.92:0/428354937 shutdown_connections 2024-09-19T09:05:32.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.798+0000 7fd63b80f740 1 -- 172.21.15.92:0/428354937 wait complete. 2024-09-19T09:05:32.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.799+0000 7fd63b80f740 20 client.17421 trim_cache size 0 max 16384 2024-09-19T09:05:32.822 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.818+0000 7fd63b80f740 1 Processor -- start 2024-09-19T09:05:32.822 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.818+0000 7fd63b80f740 1 -- start start 2024-09-19T09:05:32.822 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.819+0000 7fd63b80f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55679ed019a0 0x55679ecfe0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:32.822 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.819+0000 7fd63b80f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55679ed022e0 0x55679ed1d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:32.822 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.819+0000 7fd63b80f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55679ed11bc0 0x55679ed289a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:32.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.819+0000 7fd63b80f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd6341a4e90 con 0x55679ed022e0 2024-09-19T09:05:32.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.819+0000 7fd63b80f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd6341a7730 con 0x55679ed019a0 2024-09-19T09:05:32.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.819+0000 7fd63b80f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd6341a5520 con 0x55679ed11bc0 2024-09-19T09:05:32.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.819+0000 7fd63259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55679ed022e0 0x55679ed1d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:32.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.819+0000 7fd63259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55679ed022e0 0x55679ed1d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60550/0 (socket says 172.21.15.92:60550) 2024-09-19T09:05:32.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.819+0000 7fd63259c640 1 -- 172.21.15.92:0/1828879394 learned_addr learned my addr 172.21.15.92:0/1828879394 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:32.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.819+0000 7fd631d9b640 1 --2- 172.21.15.92:0/1828879394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55679ed11bc0 0x55679ed289a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:32.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.819+0000 7fd631d9b640 1 --2- 172.21.15.92:0/1828879394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55679ed019a0 0x55679ecfe0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:32.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.819+0000 7fd63259c640 1 -- 172.21.15.92:0/1828879394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55679ed11bc0 msgr2=0x55679ed289a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:32.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.819+0000 7fd63259c640 1 --2- 172.21.15.92:0/1828879394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55679ed11bc0 0x55679ed289a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.819+0000 7fd63259c640 1 -- 172.21.15.92:0/1828879394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55679ed019a0 msgr2=0x55679ecfe0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:32.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.819+0000 7fd63259c640 1 --2- 172.21.15.92:0/1828879394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55679ed019a0 0x55679ecfe0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.819+0000 7fd63259c640 1 -- 172.21.15.92:0/1828879394 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55679ed11030 con 0x55679ed022e0 2024-09-19T09:05:32.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.819+0000 7fd63259c640 1 --2- 172.21.15.92:0/1828879394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55679ed022e0 0x55679ed1d850 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fd634102bb0 tx=0x7fd624004b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2848e1bc7095629c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:32.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.819+0000 7fd61bfff640 1 -- 172.21.15.92:0/1828879394 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd624011540 con 0x55679ed022e0 2024-09-19T09:05:32.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.819+0000 7fd61bfff640 1 -- 172.21.15.92:0/1828879394 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd624011bc0 con 0x55679ed022e0 2024-09-19T09:05:32.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.819+0000 7fd61bfff640 1 -- 172.21.15.92:0/1828879394 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd624025be0 con 0x55679ed022e0 2024-09-19T09:05:32.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.820+0000 7fd63b80f740 1 -- 172.21.15.92:0/1828879394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55679ed022e0 msgr2=0x55679ed1d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:32.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.820+0000 7fd63b80f740 1 --2- 172.21.15.92:0/1828879394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55679ed022e0 0x55679ed1d850 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fd634102bb0 tx=0x7fd624004b00 comp rx=0 tx=0).stop 2024-09-19T09:05:32.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.820+0000 7fd63b80f740 1 -- 172.21.15.92:0/1828879394 shutdown_connections 2024-09-19T09:05:32.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.820+0000 7fd63b80f740 1 --2- 172.21.15.92:0/1828879394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55679ed11bc0 0x55679ed289a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.820+0000 7fd63b80f740 1 --2- 172.21.15.92:0/1828879394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55679ed022e0 0x55679ed1d850 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.820+0000 7fd63b80f740 1 --2- 172.21.15.92:0/1828879394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55679ed019a0 0x55679ecfe0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.820+0000 7fd63b80f740 1 -- 172.21.15.92:0/1828879394 >> 172.21.15.92:0/1828879394 conn(0x55679ecfef90 msgr2=0x55679ecfd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:32.825 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.820+0000 7fd63b80f740 1 -- 172.21.15.92:0/1828879394 shutdown_connections 2024-09-19T09:05:32.825 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.820+0000 7fd63b80f740 1 -- 172.21.15.92:0/1828879394 wait complete. 2024-09-19T09:05:32.825 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.820+0000 7fd63b80f740 1 -- start start 2024-09-19T09:05:32.825 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.821+0000 7fd63b80f740 1 Processor -- start 2024-09-19T09:05:32.825 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.821+0000 7fd63b80f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55679ed019a0 0x55679ed1ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:32.825 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.821+0000 7fd63b80f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55679ed022e0 0x55679ed1b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:32.825 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.821+0000 7fd63b80f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55679ed11bc0 0x55679ed1c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:32.825 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.821+0000 7fd63b80f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd6341a5bf0 con 0x55679ed019a0 2024-09-19T09:05:32.825 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.821+0000 7fd63b80f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd6341a7060 con 0x55679ed022e0 2024-09-19T09:05:32.825 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.821+0000 7fd63b80f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd6341a62c0 con 0x55679ed11bc0 2024-09-19T09:05:32.825 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.821+0000 7fd63b80f740 10 client.0 _ll_register_callbacks cb 0x7fd6280155b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:32.825 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.821+0000 7fd631d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55679ed019a0 0x55679ed1ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:32.826 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.821+0000 7fd631d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55679ed019a0 0x55679ed1ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60558/0 (socket says 172.21.15.92:60558) 2024-09-19T09:05:32.826 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.821+0000 7fd63259c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55679ed022e0 0x55679ed1b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:32.826 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.821+0000 7fd631d9b640 1 -- 172.21.15.92:0/2535646927 learned_addr learned my addr 172.21.15.92:0/2535646927 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:32.826 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.821+0000 7fd631d9b640 1 --2- 172.21.15.92:0/2535646927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55679ed11bc0 0x55679ed1c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:32.826 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.821+0000 7fd63259c640 1 -- 172.21.15.92:0/2535646927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55679ed11bc0 msgr2=0x55679ed1c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:32.826 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.821+0000 7fd63259c640 1 --2- 172.21.15.92:0/2535646927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55679ed11bc0 0x55679ed1c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.826 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.821+0000 7fd63259c640 1 -- 172.21.15.92:0/2535646927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55679ed019a0 msgr2=0x55679ed1ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:32.826 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.821+0000 7fd63259c640 1 --2- 172.21.15.92:0/2535646927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55679ed019a0 0x55679ed1ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.826 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.821+0000 7fd63259c640 1 -- 172.21.15.92:0/2535646927 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55679ed1c8b0 con 0x55679ed022e0 2024-09-19T09:05:32.826 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.822+0000 7fd631d9b640 1 --2- 172.21.15.92:0/2535646927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55679ed019a0 0x55679ed1ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:05:32.826 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.822+0000 7fd63259c640 1 --2- 172.21.15.92:0/2535646927 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55679ed022e0 0x55679ed1b290 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd624005330 tx=0x7fd62400bbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d66ed4ac32e12bcf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:32.826 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.822+0000 7fd619ffb640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:05:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.822+0000 7fd619ffb640 1 -- 172.21.15.92:0/2535646927 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd624034060 con 0x55679ed022e0 2024-09-19T09:05:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.822+0000 7fd619ffb640 1 -- 172.21.15.92:0/2535646927 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd624025b70 con 0x55679ed022e0 2024-09-19T09:05:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.823+0000 7fd63b80f740 1 -- 172.21.15.92:0/2535646927 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd624011bc0 con 0x55679ed022e0 2024-09-19T09:05:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.823+0000 7fd619ffb640 1 -- 172.21.15.92:0/2535646927 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd624025d70 con 0x55679ed022e0 2024-09-19T09:05:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.823+0000 7fd63b80f740 10 client.26777 fetch_fsmap learned FSMap version 19 2024-09-19T09:05:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.823+0000 7fd63b80f740 1 -- 172.21.15.92:0/2535646927 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55679ed1dc30 con 0x55679ed022e0 2024-09-19T09:05:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.823+0000 7fd619ffb640 1 -- 172.21.15.92:0/2535646927 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd624011bc0 con 0x55679ed022e0 2024-09-19T09:05:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.824+0000 7fd619ffb640 1 -- 172.21.15.92:0/2535646927 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fd62402f690 con 0x55679ed022e0 2024-09-19T09:05:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.824+0000 7fd63b80f740 10 client.26777 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:05:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.824+0000 7fd63b80f740 10 client.26777 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:05:32.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.824+0000 7fd63b80f740 20 client.26777 populate_metadata read hostname 'smithi092' 2024-09-19T09:05:32.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.824+0000 7fd63b80f740 1 --2- 172.21.15.92:0/2535646927 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55679ed21cc0 0x55679ed8f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:32.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.824+0000 7fd63b80f740 4 client.26777 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:05:32.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.824+0000 7fd63b80f740 1 -- 172.21.15.92:0/2535646927 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55679ec6ed70 con 0x55679ed21cc0 2024-09-19T09:05:32.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.824+0000 7fd631d9b640 1 --2- 172.21.15.92:0/2535646927 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55679ed21cc0 0x55679ed8f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:32.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.824+0000 7fd619ffb640 10 client.26777 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:32.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.824+0000 7fd631d9b640 1 --2- 172.21.15.92:0/2535646927 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55679ed21cc0 0x55679ed8f0e0 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70c7016cef42ec6f server_cookie=abc085ec2a313795 in_seq=0 out_seq=0 2024-09-19T09:05:32.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.840+0000 7fd619ffb640 1 -- 172.21.15.92:0/2535646927 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55679ec6ed70 con 0x55679ed21cc0 2024-09-19T09:05:32.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.840+0000 7fd619ffb640 10 client.26777 handle_command_reply: tid=0 2024-09-19T09:05:32.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.840+0000 7fd63b80f740 1 client.26777 shutdown 2024-09-19T09:05:32.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.840+0000 7fd63b80f740 1 -- 172.21.15.92:0/2535646927 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55679ed022e0 msgr2=0x55679ed1b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:32.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.840+0000 7fd63b80f740 1 --2- 172.21.15.92:0/2535646927 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55679ed022e0 0x55679ed1b290 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd624005330 tx=0x7fd62400bbe0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.840+0000 7fd63b80f740 1 -- 172.21.15.92:0/2535646927 shutdown_connections 2024-09-19T09:05:32.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.840+0000 7fd63b80f740 1 --2- 172.21.15.92:0/2535646927 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55679ed21cc0 0x55679ed8f0e0 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.840+0000 7fd63b80f740 1 --2- 172.21.15.92:0/2535646927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55679ed11bc0 0x55679ed1c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.840+0000 7fd63b80f740 1 --2- 172.21.15.92:0/2535646927 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55679ed022e0 0x55679ed1b290 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.840+0000 7fd619ffb640 0 client.26777 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:32.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.840+0000 7fd63b80f740 1 --2- 172.21.15.92:0/2535646927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55679ed019a0 0x55679ed1ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.840+0000 7fd63b80f740 1 -- 172.21.15.92:0/2535646927 >> 172.21.15.92:0/2535646927 conn(0x55679ecfef90 msgr2=0x55679ecfe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:32.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.840+0000 7fd63b80f740 1 -- 172.21.15.92:0/2535646927 shutdown_connections 2024-09-19T09:05:32.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.840+0000 7fd63b80f740 1 -- 172.21.15.92:0/2535646927 wait complete. 2024-09-19T09:05:32.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.840+0000 7fd63b80f740 20 client.26777 trim_cache size 0 max 16384 2024-09-19T09:05:32.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:05:32.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:05:32.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:05:32.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:05:32.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.841+0000 7fd638998640 1 -- 172.21.15.92:0/3283565747 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd61c0a3370 msgr2=0x7fd61c0a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:32.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.841+0000 7fd638998640 1 --2- 172.21.15.92:0/3283565747 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd61c0a3370 0x7fd61c0a5830 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd62c0b96c0 tx=0x7fd62c087730 comp rx=0 tx=0).stop 2024-09-19T09:05:32.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.841+0000 7fd638998640 1 -- 172.21.15.92:0/3283565747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd634103710 msgr2=0x7fd63419f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:32.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.841+0000 7fd638998640 1 --2- 172.21.15.92:0/3283565747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd634103710 0x7fd63419f3c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fd62c009b30 tx=0x7fd62c030710 comp rx=0 tx=0).stop 2024-09-19T09:05:32.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.841+0000 7fd638998640 1 -- 172.21.15.92:0/3283565747 shutdown_connections 2024-09-19T09:05:32.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.841+0000 7fd638998640 1 --2- 172.21.15.92:0/3283565747 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd61c0a3370 0x7fd61c0a5830 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.841+0000 7fd638998640 1 --2- 172.21.15.92:0/3283565747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd634103710 0x7fd63419f3c0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.841+0000 7fd638998640 1 --2- 172.21.15.92:0/3283565747 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd634102d50 0x7fd634198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.841+0000 7fd638998640 1 --2- 172.21.15.92:0/3283565747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd634101b60 0x7fd634197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.841+0000 7fd638998640 1 -- 172.21.15.92:0/3283565747 >> 172.21.15.92:0/3283565747 conn(0x7fd6340fd2c0 msgr2=0x7fd634106070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:32.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.841+0000 7fd638998640 1 -- 172.21.15.92:0/3283565747 shutdown_connections 2024-09-19T09:05:32.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:32.841+0000 7fd638998640 1 -- 172.21.15.92:0/3283565747 wait complete. 2024-09-19T09:05:33.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:33 smithi167 ceph-mon[35359]: pgmap v602: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 820 op/s 2024-09-19T09:05:33.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:33 smithi190 ceph-mon[35358]: pgmap v602: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 820 op/s 2024-09-19T09:05:34.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:33 smithi092 ceph-mon[31407]: pgmap v602: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 820 op/s 2024-09-19T09:05:35.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 530.0 s, 3079.0 tps, lat 32.418 ms stddev 37.603 2024-09-19T09:05:35.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:35 smithi167 ceph-mon[35359]: pgmap v603: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 21 MiB/s wr, 967 op/s 2024-09-19T09:05:35.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:35 smithi190 ceph-mon[35358]: pgmap v603: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 21 MiB/s wr, 967 op/s 2024-09-19T09:05:36.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:35 smithi092 ceph-mon[31407]: pgmap v603: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 21 MiB/s wr, 967 op/s 2024-09-19T09:05:37.005 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:36 smithi092 ceph-mon[31407]: pgmap v604: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 21 MiB/s wr, 819 op/s 2024-09-19T09:05:37.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:36 smithi167 ceph-mon[35359]: pgmap v604: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 21 MiB/s wr, 819 op/s 2024-09-19T09:05:37.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:36 smithi190 ceph-mon[35358]: pgmap v604: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 21 MiB/s wr, 819 op/s 2024-09-19T09:05:39.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:39 smithi167 ceph-mon[35359]: pgmap v605: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 MiB/s wr, 857 op/s 2024-09-19T09:05:39.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:39 smithi190 ceph-mon[35358]: pgmap v605: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 MiB/s wr, 857 op/s 2024-09-19T09:05:40.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:39 smithi092 ceph-mon[31407]: pgmap v605: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 MiB/s wr, 857 op/s 2024-09-19T09:05:40.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 535.0 s, 2919.4 tps, lat 34.243 ms stddev 36.777 2024-09-19T09:05:41.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:41 smithi167 ceph-mon[35359]: pgmap v606: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 794 op/s 2024-09-19T09:05:41.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:41 smithi190 ceph-mon[35358]: pgmap v606: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 794 op/s 2024-09-19T09:05:42.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:41 smithi092 ceph-mon[31407]: pgmap v606: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 794 op/s 2024-09-19T09:05:43.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:43 smithi167 ceph-mon[35359]: pgmap v607: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 23 MiB/s wr, 773 op/s 2024-09-19T09:05:43.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:43 smithi190 ceph-mon[35358]: pgmap v607: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 23 MiB/s wr, 773 op/s 2024-09-19T09:05:44.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:43 smithi092 ceph-mon[31407]: pgmap v607: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 23 MiB/s wr, 773 op/s 2024-09-19T09:05:44.575 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:05:44.944 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:45.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.499+0000 7f7fe19a6640 1 -- 172.21.15.92:0/983069204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fdc102db0 msgr2=0x7f7fdc103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:45.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.499+0000 7f7fe19a6640 1 --2- 172.21.15.92:0/983069204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fdc102db0 0x7f7fdc103190 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc009930 tx=0x7f7fcc02a420 comp rx=0 tx=0).stop 2024-09-19T09:05:45.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.499+0000 7f7fe19a6640 1 -- 172.21.15.92:0/983069204 shutdown_connections 2024-09-19T09:05:45.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.499+0000 7f7fe19a6640 1 --2- 172.21.15.92:0/983069204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fdc1082e0 0x7f7fdc10ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.499+0000 7f7fe19a6640 1 --2- 172.21.15.92:0/983069204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fdc103760 0x7f7fdc107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.499+0000 7f7fe19a6640 1 --2- 172.21.15.92:0/983069204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fdc102db0 0x7f7fdc103190 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.499+0000 7f7fe19a6640 1 -- 172.21.15.92:0/983069204 >> 172.21.15.92:0/983069204 conn(0x7f7fdc0fc7d0 msgr2=0x7f7fdc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:45.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.499+0000 7f7fe19a6640 1 -- 172.21.15.92:0/983069204 shutdown_connections 2024-09-19T09:05:45.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.499+0000 7f7fe19a6640 1 -- 172.21.15.92:0/983069204 wait complete. 2024-09-19T09:05:45.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.500+0000 7f7fe19a6640 1 Processor -- start 2024-09-19T09:05:45.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.500+0000 7f7fe19a6640 1 -- start start 2024-09-19T09:05:45.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.501+0000 7f7fe19a6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fdc102db0 0x7f7fdc100a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:45.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.501+0000 7f7fe19a6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fdc103760 0x7f7fdc100f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:45.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.501+0000 7f7fe19a6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fdc1082e0 0x7f7fdc101490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:45.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.501+0000 7f7fe19a6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7fdc112100 con 0x7f7fdc1082e0 2024-09-19T09:05:45.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.501+0000 7f7fe19a6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7fdc111f80 con 0x7f7fdc102db0 2024-09-19T09:05:45.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.501+0000 7f7fe19a6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7fdc112280 con 0x7f7fdc103760 2024-09-19T09:05:45.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.501+0000 7f7fdb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fdc1082e0 0x7f7fdc101490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:45.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.501+0000 7f7fdaffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fdc102db0 0x7f7fdc100a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:45.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.501+0000 7f7fdb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fdc1082e0 0x7f7fdc101490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56730/0 (socket says 172.21.15.92:56730) 2024-09-19T09:05:45.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.501+0000 7f7fda7fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fdc103760 0x7f7fdc100f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:45.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.501+0000 7f7fdb7fe640 1 -- 172.21.15.92:0/203587718 learned_addr learned my addr 172.21.15.92:0/203587718 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:45.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.502+0000 7f7fdaffd640 1 -- 172.21.15.92:0/203587718 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fdc103760 msgr2=0x7f7fdc100f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:45.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.502+0000 7f7fdaffd640 1 --2- 172.21.15.92:0/203587718 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fdc103760 0x7f7fdc100f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.502+0000 7f7fdaffd640 1 -- 172.21.15.92:0/203587718 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fdc1082e0 msgr2=0x7f7fdc101490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:45.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.502+0000 7f7fdaffd640 1 --2- 172.21.15.92:0/203587718 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fdc1082e0 0x7f7fdc101490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.502+0000 7f7fdaffd640 1 -- 172.21.15.92:0/203587718 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fdc1a6ac0 con 0x7f7fdc102db0 2024-09-19T09:05:45.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.502+0000 7f7fda7fc640 1 --2- 172.21.15.92:0/203587718 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fdc103760 0x7f7fdc100f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:05:45.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.502+0000 7f7fdb7fe640 1 --2- 172.21.15.92:0/203587718 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fdc1082e0 0x7f7fdc101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:05:45.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.502+0000 7f7fdaffd640 1 --2- 172.21.15.92:0/203587718 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fdc102db0 0x7f7fdc100a10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc02a940 tx=0x7f7fcc003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:45.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.502+0000 7f7fe09a4640 1 -- 172.21.15.92:0/203587718 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc03f070 con 0x7f7fdc102db0 2024-09-19T09:05:45.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.502+0000 7f7fe09a4640 1 -- 172.21.15.92:0/203587718 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fcc031c20 con 0x7f7fdc102db0 2024-09-19T09:05:45.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.502+0000 7f7fe19a6640 1 -- 172.21.15.92:0/203587718 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fdc1a6d50 con 0x7f7fdc102db0 2024-09-19T09:05:45.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.502+0000 7f7fe09a4640 1 -- 172.21.15.92:0/203587718 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc035030 con 0x7f7fdc102db0 2024-09-19T09:05:45.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.503+0000 7f7fe19a6640 1 -- 172.21.15.92:0/203587718 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fdc1a7220 con 0x7f7fdc102db0 2024-09-19T09:05:45.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.506+0000 7f7fe3d7f740 1 Processor -- start 2024-09-19T09:05:45.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.506+0000 7f7fe3d7f740 1 -- start start 2024-09-19T09:05:45.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.507+0000 7f7fe3d7f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56129e4934a0 0x56129e493880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:45.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.507+0000 7f7fe3d7f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56129e493dc0 0x56129e49e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:45.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.507+0000 7f7fe3d7f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56129e49e680 0x56129e4a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:45.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.507+0000 7f7fe3d7f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56129e3f92e0 con 0x56129e49e680 2024-09-19T09:05:45.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.507+0000 7f7fe3d7f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56129e3a0ce0 con 0x56129e493dc0 2024-09-19T09:05:45.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.507+0000 7f7fe3d7f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56129e3f52a0 con 0x56129e4934a0 2024-09-19T09:05:45.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.507+0000 7f7fdb7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56129e4934a0 0x56129e493880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:45.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.507+0000 7f7fdb7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56129e4934a0 0x56129e493880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:33974/0 (socket says 172.21.15.92:33974) 2024-09-19T09:05:45.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.507+0000 7f7fdb7fe640 1 -- 172.21.15.92:0/3718664246 learned_addr learned my addr 172.21.15.92:0/3718664246 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:45.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.507+0000 7f7fdb7fe640 1 -- 172.21.15.92:0/3718664246 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56129e493dc0 msgr2=0x56129e49e140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:05:45.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.507+0000 7f7fdb7fe640 1 --2- 172.21.15.92:0/3718664246 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56129e493dc0 0x56129e49e140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.507+0000 7f7fdb7fe640 1 -- 172.21.15.92:0/3718664246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56129e49e680 msgr2=0x56129e4a0a70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:05:45.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.507+0000 7f7fdb7fe640 1 --2- 172.21.15.92:0/3718664246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56129e49e680 0x56129e4a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.507+0000 7f7fdb7fe640 1 -- 172.21.15.92:0/3718664246 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56129e385440 con 0x56129e4934a0 2024-09-19T09:05:45.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.507+0000 7f7fe09a4640 1 -- 172.21.15.92:0/203587718 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7fcc042070 con 0x7f7fdc102db0 2024-09-19T09:05:45.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.508+0000 7f7fdb7fe640 1 --2- 172.21.15.92:0/3718664246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56129e4934a0 0x56129e493880 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4010810 tx=0x7f7fd4010cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63cb05acbc9897f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:45.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.508+0000 7f7fc1ffb640 1 -- 172.21.15.92:0/3718664246 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd400eb30 con 0x56129e4934a0 2024-09-19T09:05:45.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.508+0000 7f7fc1ffb640 1 -- 172.21.15.92:0/3718664246 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fd4015070 con 0x56129e4934a0 2024-09-19T09:05:45.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.508+0000 7f7fc1ffb640 1 -- 172.21.15.92:0/3718664246 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd40116a0 con 0x56129e4934a0 2024-09-19T09:05:45.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.509+0000 7f7fe09a4640 1 --2- 172.21.15.92:0/203587718 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7fc40a32c0 0x7f7fc40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:45.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.509+0000 7f7fe3d7f740 1 -- 172.21.15.92:0/3718664246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56129e4934a0 msgr2=0x56129e493880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:45.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.509+0000 7f7fe3d7f740 1 --2- 172.21.15.92:0/3718664246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56129e4934a0 0x56129e493880 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4010810 tx=0x7f7fd4010cd0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.509+0000 7f7fe3d7f740 1 -- 172.21.15.92:0/3718664246 shutdown_connections 2024-09-19T09:05:45.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.509+0000 7f7fe3d7f740 1 --2- 172.21.15.92:0/3718664246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56129e49e680 0x56129e4a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.509+0000 7f7fe3d7f740 1 --2- 172.21.15.92:0/3718664246 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56129e493dc0 0x56129e49e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.509+0000 7f7fe3d7f740 1 --2- 172.21.15.92:0/3718664246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56129e4934a0 0x56129e493880 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.509+0000 7f7fe3d7f740 1 -- 172.21.15.92:0/3718664246 >> 172.21.15.92:0/3718664246 conn(0x56129e48fa30 msgr2=0x56129e48fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:45.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.509+0000 7f7fe09a4640 1 -- 172.21.15.92:0/203587718 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f7fcc0efff0 con 0x7f7fdc102db0 2024-09-19T09:05:45.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.509+0000 7f7fe3d7f740 1 -- 172.21.15.92:0/3718664246 shutdown_connections 2024-09-19T09:05:45.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.509+0000 7f7fe3d7f740 1 -- 172.21.15.92:0/3718664246 wait complete. 2024-09-19T09:05:45.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.509+0000 7f7fdaffd640 1 --2- 172.21.15.92:0/203587718 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7fc40a32c0 0x7f7fc40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:45.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.510+0000 7f7fe3d7f740 1 -- start start 2024-09-19T09:05:45.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.510+0000 7f7fe3d7f740 1 Processor -- start 2024-09-19T09:05:45.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.510+0000 7f7fdaffd640 1 --2- 172.21.15.92:0/203587718 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7fc40a32c0 0x7f7fc40a5780 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc000c00 tx=0x7f7fcc02a420 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:45.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.511+0000 7f7fe3d7f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56129e4934a0 0x56129e49dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:45.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.511+0000 7f7fe3d7f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56129e493dc0 0x56129e49b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:45.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.511+0000 7f7fe3d7f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56129e49e680 0x56129e49b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:45.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.511+0000 7f7fe3d7f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56129e4b2260 con 0x56129e49e680 2024-09-19T09:05:45.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.511+0000 7f7fe3d7f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56129e3b4050 con 0x56129e493dc0 2024-09-19T09:05:45.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.511+0000 7f7fe3d7f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56129e4b23e0 con 0x56129e4934a0 2024-09-19T09:05:45.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.511+0000 7f7fda7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56129e493dc0 0x56129e49b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:45.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.511+0000 7f7fdb7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56129e4934a0 0x56129e49dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:45.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.511+0000 7f7fda7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56129e493dc0 0x56129e49b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:37712/0 (socket says 172.21.15.92:37712) 2024-09-19T09:05:45.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.511+0000 7f7fdb7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56129e4934a0 0x56129e49dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:33976/0 (socket says 172.21.15.92:33976) 2024-09-19T09:05:45.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.511+0000 7f7fda7fc640 1 -- 172.21.15.92:0/3054412716 learned_addr learned my addr 172.21.15.92:0/3054412716 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:45.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.511+0000 7f7fe3d7f740 10 client.0 _ll_register_callbacks cb 0x56129e3f4160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:45.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.511+0000 7f7fdb7fe640 1 --2- 172.21.15.92:0/3054412716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56129e49e680 0x56129e49b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:45.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.512+0000 7f7fda7fc640 1 -- 172.21.15.92:0/3054412716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56129e4934a0 msgr2=0x56129e49dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:45.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.512+0000 7f7fda7fc640 1 --2- 172.21.15.92:0/3054412716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56129e4934a0 0x56129e49dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.512+0000 7f7fda7fc640 1 -- 172.21.15.92:0/3054412716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56129e49e680 msgr2=0x56129e49b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:45.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.512+0000 7f7fda7fc640 1 --2- 172.21.15.92:0/3054412716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56129e49e680 0x56129e49b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.512+0000 7f7fda7fc640 1 -- 172.21.15.92:0/3054412716 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56129e16a3c0 con 0x56129e493dc0 2024-09-19T09:05:45.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.512+0000 7f7fdb7fe640 1 --2- 172.21.15.92:0/3054412716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56129e4934a0 0x56129e49dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:05:45.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.512+0000 7f7fda7fc640 1 --2- 172.21.15.92:0/3054412716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56129e493dc0 0x56129e49b280 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7fd00042c0 tx=0x7f7fd00039c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cac7a3a2c674d4f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:45.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.512+0000 7f7fbaffd640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:05:45.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.512+0000 7f7fbaffd640 1 -- 172.21.15.92:0/3054412716 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0011850 con 0x56129e493dc0 2024-09-19T09:05:45.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.512+0000 7f7fbaffd640 1 -- 172.21.15.92:0/3054412716 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f7fd00119f0 con 0x56129e493dc0 2024-09-19T09:05:45.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.512+0000 7f7fe3d7f740 1 -- 172.21.15.92:0/3054412716 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fd4015070 con 0x56129e493dc0 2024-09-19T09:05:45.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.512+0000 7f7fbaffd640 1 -- 172.21.15.92:0/3054412716 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7fd0011bf0 con 0x56129e493dc0 2024-09-19T09:05:45.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.513+0000 7f7fe3d7f740 10 client.26786 fetch_fsmap learned FSMap version 19 2024-09-19T09:05:45.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.513+0000 7f7fe3d7f740 1 -- 172.21.15.92:0/3054412716 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56129e4bdd10 con 0x56129e493dc0 2024-09-19T09:05:45.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.513+0000 7f7fbaffd640 1 -- 172.21.15.92:0/3054412716 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fd0015070 con 0x56129e493dc0 2024-09-19T09:05:45.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.513+0000 7f7fbaffd640 1 -- 172.21.15.92:0/3054412716 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f7fd0024420 con 0x56129e493dc0 2024-09-19T09:05:45.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.513+0000 7f7fe3d7f740 10 client.26786 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:05:45.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.513+0000 7f7fe3d7f740 10 client.26786 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:05:45.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.513+0000 7f7fe3d7f740 20 client.26786 populate_metadata read hostname 'smithi092' 2024-09-19T09:05:45.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.513+0000 7f7fe3d7f740 1 --2- 172.21.15.92:0/3054412716 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56129e4bf120 0x56129e4c1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:45.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.513+0000 7f7fe3d7f740 4 client.26786 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:05:45.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.513+0000 7f7fe3d7f740 1 -- 172.21.15.92:0/3054412716 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7fd4015070 con 0x56129e4bf120 2024-09-19T09:05:45.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.513+0000 7f7fdb7fe640 1 --2- 172.21.15.92:0/3054412716 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56129e4bf120 0x56129e4c1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:45.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.514+0000 7f7fbaffd640 10 client.26786 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:45.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.514+0000 7f7fdb7fe640 1 --2- 172.21.15.92:0/3054412716 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56129e4bf120 0x56129e4c1510 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17149de3b8c1a93c server_cookie=b085a20ce8904104 in_seq=0 out_seq=0 2024-09-19T09:05:45.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.516+0000 7f7fbaffd640 1 -- 172.21.15.92:0/3054412716 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f7fd4015070 con 0x56129e4bf120 2024-09-19T09:05:45.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.516+0000 7f7fbaffd640 10 client.26786 handle_command_reply: tid=0 2024-09-19T09:05:45.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.516+0000 7f7fe3d7f740 1 client.26786 shutdown 2024-09-19T09:05:45.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.516+0000 7f7fe3d7f740 1 -- 172.21.15.92:0/3054412716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56129e493dc0 msgr2=0x56129e49b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:45.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.517+0000 7f7fe3d7f740 1 --2- 172.21.15.92:0/3054412716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56129e493dc0 0x56129e49b280 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7fd00042c0 tx=0x7f7fd00039c0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.517+0000 7f7fe3d7f740 1 -- 172.21.15.92:0/3054412716 shutdown_connections 2024-09-19T09:05:45.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.518+0000 7f7fe3d7f740 1 --2- 172.21.15.92:0/3054412716 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56129e4bf120 0x56129e4c1510 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.518+0000 7f7fe3d7f740 1 --2- 172.21.15.92:0/3054412716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56129e49e680 0x56129e49b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.518+0000 7f7fbaffd640 0 client.26786 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:45.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.518+0000 7f7fe3d7f740 1 --2- 172.21.15.92:0/3054412716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56129e493dc0 0x56129e49b280 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.518+0000 7f7fe3d7f740 1 --2- 172.21.15.92:0/3054412716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56129e4934a0 0x56129e49dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.518+0000 7f7fe3d7f740 1 -- 172.21.15.92:0/3054412716 >> 172.21.15.92:0/3054412716 conn(0x56129e48fa30 msgr2=0x56129e495710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:45.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.518+0000 7f7fe3d7f740 1 -- 172.21.15.92:0/3054412716 shutdown_connections 2024-09-19T09:05:45.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.518+0000 7f7fe3d7f740 1 -- 172.21.15.92:0/3054412716 wait complete. 2024-09-19T09:05:45.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.518+0000 7f7fe3d7f740 20 client.26786 trim_cache size 0 max 16384 2024-09-19T09:05:45.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.546+0000 7f7fe3d7f740 1 Processor -- start 2024-09-19T09:05:45.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.546+0000 7f7fe3d7f740 1 -- start start 2024-09-19T09:05:45.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.546+0000 7f7fe3d7f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56129e4934a0 0x56129e4bb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:45.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.546+0000 7f7fe3d7f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56129e493dc0 0x56129e496760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:45.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.546+0000 7f7fe3d7f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56129e49e680 0x56129e4c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:45.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.546+0000 7f7fe3d7f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7fdc06daf0 con 0x56129e4934a0 2024-09-19T09:05:45.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.546+0000 7f7fe3d7f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7fdc070390 con 0x56129e493dc0 2024-09-19T09:05:45.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.546+0000 7f7fe3d7f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7fdc06e180 con 0x56129e49e680 2024-09-19T09:05:45.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.546+0000 7f7fdb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56129e4934a0 0x56129e4bb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:45.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.547+0000 7f7fda7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56129e493dc0 0x56129e496760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:45.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.547+0000 7f7fdb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56129e4934a0 0x56129e4bb4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56754/0 (socket says 172.21.15.92:56754) 2024-09-19T09:05:45.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.547+0000 7f7fdb7fe640 1 -- 172.21.15.92:0/2193909859 learned_addr learned my addr 172.21.15.92:0/2193909859 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:45.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.547+0000 7f7fdb7fe640 1 --2- 172.21.15.92:0/2193909859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56129e49e680 0x56129e4c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:45.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.548+0000 7f7fdb7fe640 1 -- 172.21.15.92:0/2193909859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56129e49e680 msgr2=0x56129e4c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:45.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.548+0000 7f7fdb7fe640 1 --2- 172.21.15.92:0/2193909859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56129e49e680 0x56129e4c6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.548+0000 7f7fdb7fe640 1 -- 172.21.15.92:0/2193909859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56129e493dc0 msgr2=0x56129e496760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:45.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.548+0000 7f7fdb7fe640 1 --2- 172.21.15.92:0/2193909859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56129e493dc0 0x56129e496760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.548+0000 7f7fdb7fe640 1 -- 172.21.15.92:0/2193909859 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56129e493bf0 con 0x56129e4934a0 2024-09-19T09:05:45.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.548+0000 7f7fdb7fe640 1 --2- 172.21.15.92:0/2193909859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56129e4934a0 0x56129e4bb4f0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f7fd400e720 tx=0x7f7fd4000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f57a065669b347 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:45.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.549+0000 7f7fc17fa640 1 -- 172.21.15.92:0/2193909859 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd4004e40 con 0x56129e4934a0 2024-09-19T09:05:45.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.549+0000 7f7fc17fa640 1 -- 172.21.15.92:0/2193909859 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fd4015070 con 0x56129e4934a0 2024-09-19T09:05:45.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.549+0000 7f7fc17fa640 1 -- 172.21.15.92:0/2193909859 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd4004020 con 0x56129e4934a0 2024-09-19T09:05:45.554 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.550+0000 7f7fe3d7f740 1 -- 172.21.15.92:0/2193909859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56129e4934a0 msgr2=0x56129e4bb4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:45.554 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.550+0000 7f7fe3d7f740 1 --2- 172.21.15.92:0/2193909859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56129e4934a0 0x56129e4bb4f0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f7fd400e720 tx=0x7f7fd4000f40 comp rx=0 tx=0).stop 2024-09-19T09:05:45.554 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.553+0000 7f7fe3d7f740 1 -- 172.21.15.92:0/2193909859 shutdown_connections 2024-09-19T09:05:45.554 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.553+0000 7f7fe3d7f740 1 --2- 172.21.15.92:0/2193909859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56129e49e680 0x56129e4c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.554 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.553+0000 7f7fe3d7f740 1 --2- 172.21.15.92:0/2193909859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56129e493dc0 0x56129e496760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.554 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.553+0000 7f7fe3d7f740 1 --2- 172.21.15.92:0/2193909859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56129e4934a0 0x56129e4bb4f0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.553+0000 7f7fe3d7f740 1 -- 172.21.15.92:0/2193909859 >> 172.21.15.92:0/2193909859 conn(0x56129e48fa30 msgr2=0x56129e496050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:45.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.553+0000 7f7fe3d7f740 1 -- 172.21.15.92:0/2193909859 shutdown_connections 2024-09-19T09:05:45.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.560+0000 7f7fe3d7f740 1 -- 172.21.15.92:0/2193909859 wait complete. 2024-09-19T09:05:45.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.560+0000 7f7fe3d7f740 1 -- start start 2024-09-19T09:05:45.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.560+0000 7f7fe3d7f740 1 Processor -- start 2024-09-19T09:05:45.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.561+0000 7f7fe3d7f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56129e4934a0 0x56129e525610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:45.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.561+0000 7f7fe3d7f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56129e493dc0 0x56129e4b7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:45.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.561+0000 7f7fe3d7f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56129e49e680 0x56129e4b7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:45.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.561+0000 7f7fe3d7f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7fdc06e850 con 0x56129e49e680 2024-09-19T09:05:45.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.561+0000 7f7fe3d7f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7fdc06fcc0 con 0x56129e493dc0 2024-09-19T09:05:45.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.561+0000 7f7fe3d7f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7fdc06ef20 con 0x56129e4934a0 2024-09-19T09:05:45.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.561+0000 7f7fe3d7f740 10 client.0 _ll_register_callbacks cb 0x7f7fd000be00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:45.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.563+0000 7f7fda7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56129e493dc0 0x56129e4b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:45.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.563+0000 7f7fda7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56129e493dc0 0x56129e4b7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:37730/0 (socket says 172.21.15.92:37730) 2024-09-19T09:05:45.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.563+0000 7f7fda7fc640 1 -- 172.21.15.92:0/3456888089 learned_addr learned my addr 172.21.15.92:0/3456888089 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:45.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.563+0000 7f7fda7fc640 1 -- 172.21.15.92:0/3456888089 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56129e4934a0 msgr2=0x56129e525610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:45.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.563+0000 7f7fda7fc640 1 --2- 172.21.15.92:0/3456888089 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56129e4934a0 0x56129e525610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.563+0000 7f7fda7fc640 1 -- 172.21.15.92:0/3456888089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56129e49e680 msgr2=0x56129e4b7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:45.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.563+0000 7f7fda7fc640 1 --2- 172.21.15.92:0/3456888089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56129e49e680 0x56129e4b7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.563+0000 7f7fda7fc640 1 -- 172.21.15.92:0/3456888089 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56129e522960 con 0x56129e493dc0 2024-09-19T09:05:45.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.564+0000 7f7fda7fc640 1 --2- 172.21.15.92:0/3456888089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56129e493dc0 0x56129e4b7660 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0000c00 tx=0x7f7fd0024730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1a80597757139c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:45.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.564+0000 7f7fbaffd640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:05:45.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.564+0000 7f7fbaffd640 1 -- 172.21.15.92:0/3456888089 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0032060 con 0x56129e493dc0 2024-09-19T09:05:45.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.564+0000 7f7fe3d7f740 1 -- 172.21.15.92:0/3456888089 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fd4015070 con 0x56129e493dc0 2024-09-19T09:05:45.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.564+0000 7f7fbaffd640 1 -- 172.21.15.92:0/3456888089 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f7fd0011860 con 0x56129e493dc0 2024-09-19T09:05:45.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.565+0000 7f7fbaffd640 1 -- 172.21.15.92:0/3456888089 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7fd002a070 con 0x56129e493dc0 2024-09-19T09:05:45.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.566+0000 7f7fe3d7f740 10 client.26789 fetch_fsmap learned FSMap version 19 2024-09-19T09:05:45.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.566+0000 7f7fe3d7f740 1 -- 172.21.15.92:0/3456888089 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56129e53af20 con 0x56129e493dc0 2024-09-19T09:05:45.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.570+0000 7f7fbaffd640 1 -- 172.21.15.92:0/3456888089 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fd4015070 con 0x56129e493dc0 2024-09-19T09:05:45.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.570+0000 7f7fbaffd640 1 -- 172.21.15.92:0/3456888089 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f7fd00047f0 con 0x56129e493dc0 2024-09-19T09:05:45.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.570+0000 7f7fe3d7f740 10 client.26789 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:05:45.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.570+0000 7f7fe3d7f740 10 client.26789 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:05:45.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.570+0000 7f7fe3d7f740 20 client.26789 populate_metadata read hostname 'smithi092' 2024-09-19T09:05:45.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.570+0000 7f7fe3d7f740 1 --2- 172.21.15.92:0/3456888089 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56129e4bf120 0x56129e53d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:45.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.570+0000 7f7fe3d7f740 4 client.26789 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:05:45.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.570+0000 7f7fe3d7f740 1 -- 172.21.15.92:0/3456888089 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56129e406850 con 0x56129e4bf120 2024-09-19T09:05:45.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.570+0000 7f7fdb7fe640 1 --2- 172.21.15.92:0/3456888089 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56129e4bf120 0x56129e53d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:45.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.571+0000 7f7fdb7fe640 1 --2- 172.21.15.92:0/3456888089 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56129e4bf120 0x56129e53d6c0 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e850321030d7d8e server_cookie=69b253604e37ee69 in_seq=0 out_seq=0 2024-09-19T09:05:45.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.571+0000 7f7fbaffd640 10 client.26789 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:45.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.571+0000 7f7fbaffd640 1 -- 172.21.15.92:0/3456888089 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56129e406850 con 0x56129e4bf120 2024-09-19T09:05:45.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.571+0000 7f7fbaffd640 10 client.26789 handle_command_reply: tid=0 2024-09-19T09:05:45.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.571+0000 7f7fe3d7f740 1 client.26789 shutdown 2024-09-19T09:05:45.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.572+0000 7f7fe3d7f740 1 -- 172.21.15.92:0/3456888089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56129e493dc0 msgr2=0x56129e4b7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:45.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.572+0000 7f7fe3d7f740 1 --2- 172.21.15.92:0/3456888089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56129e493dc0 0x56129e4b7660 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0000c00 tx=0x7f7fd0024730 comp rx=0 tx=0).stop 2024-09-19T09:05:45.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.572+0000 7f7fe3d7f740 1 -- 172.21.15.92:0/3456888089 shutdown_connections 2024-09-19T09:05:45.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.572+0000 7f7fe3d7f740 1 --2- 172.21.15.92:0/3456888089 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56129e4bf120 0x56129e53d6c0 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.572+0000 7f7fe3d7f740 1 --2- 172.21.15.92:0/3456888089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56129e49e680 0x56129e4b7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.572+0000 7f7fe3d7f740 1 --2- 172.21.15.92:0/3456888089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56129e493dc0 0x56129e4b7660 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.572+0000 7f7fe3d7f740 1 --2- 172.21.15.92:0/3456888089 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56129e4934a0 0x56129e525610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.572+0000 7f7fbaffd640 0 client.26789 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:45.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.572+0000 7f7fe3d7f740 1 -- 172.21.15.92:0/3456888089 >> 172.21.15.92:0/3456888089 conn(0x56129e48fa30 msgr2=0x56129e495710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:45.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.572+0000 7f7fe3d7f740 1 -- 172.21.15.92:0/3456888089 shutdown_connections 2024-09-19T09:05:45.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.572+0000 7f7fe3d7f740 1 -- 172.21.15.92:0/3456888089 wait complete. 2024-09-19T09:05:45.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.573+0000 7f7fe3d7f740 20 client.26789 trim_cache size 0 max 16384 2024-09-19T09:05:45.575 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:05:45.575 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-19T09:05:45.575 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {} 2024-09-19T09:05:45.575 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:05:45.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.573+0000 7f7fe19a6640 1 -- 172.21.15.92:0/203587718 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7fc40a32c0 msgr2=0x7f7fc40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:45.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.573+0000 7f7fe19a6640 1 --2- 172.21.15.92:0/203587718 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7fc40a32c0 0x7f7fc40a5780 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc000c00 tx=0x7f7fcc02a420 comp rx=0 tx=0).stop 2024-09-19T09:05:45.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.573+0000 7f7fe19a6640 1 -- 172.21.15.92:0/203587718 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fdc102db0 msgr2=0x7f7fdc100a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:45.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.573+0000 7f7fe19a6640 1 --2- 172.21.15.92:0/203587718 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fdc102db0 0x7f7fdc100a10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc02a940 tx=0x7f7fcc003b90 comp rx=0 tx=0).stop 2024-09-19T09:05:45.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.573+0000 7f7fe19a6640 1 -- 172.21.15.92:0/203587718 shutdown_connections 2024-09-19T09:05:45.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.573+0000 7f7fe19a6640 1 --2- 172.21.15.92:0/203587718 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7fc40a32c0 0x7f7fc40a5780 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.574+0000 7f7fe19a6640 1 --2- 172.21.15.92:0/203587718 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fdc1082e0 0x7f7fdc101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.574+0000 7f7fe19a6640 1 --2- 172.21.15.92:0/203587718 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fdc103760 0x7f7fdc100f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.574+0000 7f7fe19a6640 1 --2- 172.21.15.92:0/203587718 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fdc102db0 0x7f7fdc100a10 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.574+0000 7f7fe19a6640 1 -- 172.21.15.92:0/203587718 >> 172.21.15.92:0/203587718 conn(0x7f7fdc0fc7d0 msgr2=0x7f7fdc106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:45.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.574+0000 7f7fe19a6640 1 -- 172.21.15.92:0/203587718 shutdown_connections 2024-09-19T09:05:45.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:45.574+0000 7f7fe19a6640 1 -- 172.21.15.92:0/203587718 wait complete. 2024-09-19T09:05:45.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:45 smithi092 ceph-mon[31407]: pgmap v608: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 24 MiB/s wr, 811 op/s 2024-09-19T09:05:45.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 540.0 s, 2585.2 tps, lat 38.318 ms stddev 43.014 2024-09-19T09:05:45.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:45 smithi167 ceph-mon[35359]: pgmap v608: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 24 MiB/s wr, 811 op/s 2024-09-19T09:05:45.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:45 smithi190 ceph-mon[35358]: pgmap v608: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 24 MiB/s wr, 811 op/s 2024-09-19T09:05:45.981 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:45.977+0000 7f32fbae6640 1 -- 172.21.15.92:0/2638098479 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32f4109700 msgr2=0x7f32f4109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:45.981 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:45.978+0000 7f32fbae6640 1 --2- 172.21.15.92:0/2638098479 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32f4109700 0x7f32f4109b00 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f32ec009ca0 tx=0x7f32ec02a8f0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:45.981+0000 7f32fbae6640 1 -- 172.21.15.92:0/2638098479 shutdown_connections 2024-09-19T09:05:45.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:45.981+0000 7f32fbae6640 1 --2- 172.21.15.92:0/2638098479 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32f40736c0 0x7f32f4119130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:45.981+0000 7f32fbae6640 1 --2- 172.21.15.92:0/2638098479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32f4072d20 0x7f32f4073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:45.981+0000 7f32fbae6640 1 --2- 172.21.15.92:0/2638098479 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32f4109700 0x7f32f4109b00 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:45.981+0000 7f32fbae6640 1 -- 172.21.15.92:0/2638098479 >> 172.21.15.92:0/2638098479 conn(0x7f32f406ece0 msgr2=0x7f32f4071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:45.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:45.987+0000 7f32fbae6640 1 -- 172.21.15.92:0/2638098479 shutdown_connections 2024-09-19T09:05:45.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:45.988+0000 7f32fbae6640 1 -- 172.21.15.92:0/2638098479 wait complete. 2024-09-19T09:05:45.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:45.990+0000 7f32fbae6640 1 Processor -- start 2024-09-19T09:05:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:45.991+0000 7f32fbae6640 1 -- start start 2024-09-19T09:05:45.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:45.991+0000 7f32fbae6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32f4072d20 0x7f32f41188e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:45.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:45.991+0000 7f32fbae6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32f40736c0 0x7f32f4118e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:45.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:45.991+0000 7f32fbae6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32f4109700 0x7f32f4116f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:45.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:45.991+0000 7f32fbae6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f32f4111370 con 0x7f32f4072d20 2024-09-19T09:05:45.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:45.991+0000 7f32fbae6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f32f41111f0 con 0x7f32f40736c0 2024-09-19T09:05:45.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:45.991+0000 7f32fbae6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f32f41114f0 con 0x7f32f4109700 2024-09-19T09:05:45.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:45.991+0000 7f32fa083640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32f4109700 0x7f32f4116f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:45.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:45.991+0000 7f32fa083640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32f4109700 0x7f32f4116f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:34012/0 (socket says 172.21.15.92:34012) 2024-09-19T09:05:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:45.991+0000 7f32fa083640 1 -- 172.21.15.92:0/2618500247 learned_addr learned my addr 172.21.15.92:0/2618500247 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:45.992+0000 7f32f9081640 1 --2- 172.21.15.92:0/2618500247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32f40736c0 0x7f32f4118e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:45.992+0000 7f32f9882640 1 --2- 172.21.15.92:0/2618500247 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32f4072d20 0x7f32f41188e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:45.993+0000 7f32fa083640 1 -- 172.21.15.92:0/2618500247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32f40736c0 msgr2=0x7f32f4118e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:45.993+0000 7f32fa083640 1 --2- 172.21.15.92:0/2618500247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32f40736c0 0x7f32f4118e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:45.993+0000 7f32fa083640 1 -- 172.21.15.92:0/2618500247 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32f4072d20 msgr2=0x7f32f41188e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:45.993+0000 7f32fa083640 1 --2- 172.21.15.92:0/2618500247 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32f4072d20 0x7f32f41188e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:45.993+0000 7f32fa083640 1 -- 172.21.15.92:0/2618500247 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f4117650 con 0x7f32f4109700 2024-09-19T09:05:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:45.994+0000 7f32fa083640 1 --2- 172.21.15.92:0/2618500247 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32f4109700 0x7f32f4116f20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f32e400d750 tx=0x7f32e400dc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:45.994+0000 7f32eaffd640 1 -- 172.21.15.92:0/2618500247 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e4017070 con 0x7f32f4109700 2024-09-19T09:05:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:45.994+0000 7f32fbae6640 1 -- 172.21.15.92:0/2618500247 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32f41178e0 con 0x7f32f4109700 2024-09-19T09:05:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:45.994+0000 7f32fbae6640 1 -- 172.21.15.92:0/2618500247 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32f41b7980 con 0x7f32f4109700 2024-09-19T09:05:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:45.997+0000 7f32eaffd640 1 -- 172.21.15.92:0/2618500247 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32e4005500 con 0x7f32f4109700 2024-09-19T09:05:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:45.997+0000 7f32eaffd640 1 -- 172.21.15.92:0/2618500247 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e4004d90 con 0x7f32f4109700 2024-09-19T09:05:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:45.997+0000 7f32eaffd640 1 -- 172.21.15.92:0/2618500247 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f32e4010460 con 0x7f32f4109700 2024-09-19T09:05:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:45.999+0000 7f32eaffd640 1 --2- 172.21.15.92:0/2618500247 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f32e00a34c0 0x7f32e00a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:45.999+0000 7f32eaffd640 1 -- 172.21.15.92:0/2618500247 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f32e40d03c0 con 0x7f32f4109700 2024-09-19T09:05:46.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.000+0000 7f32f9882640 1 --2- 172.21.15.92:0/2618500247 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f32e00a34c0 0x7f32e00a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:46.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.001+0000 7f32f9882640 1 --2- 172.21.15.92:0/2618500247 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f32e00a34c0 0x7f32e00a5980 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f32ec000f80 tx=0x7f32ec009860 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:46.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.001+0000 7f32fe87e740 1 Processor -- start 2024-09-19T09:05:46.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.002+0000 7f32fe87e740 1 -- start start 2024-09-19T09:05:46.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.002+0000 7f32fe87e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b62d5929a0 0x55b62d592da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:46.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.002+0000 7f32fe87e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b62d5932e0 0x55b62d597da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:46.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.002+0000 7f32fe87e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b62d598370 0x55b62d59a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:46.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.002+0000 7f32fe87e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b62d4f62f0 con 0x55b62d5932e0 2024-09-19T09:05:46.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.002+0000 7f32fe87e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b62d49e270 con 0x55b62d598370 2024-09-19T09:05:46.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.002+0000 7f32fe87e740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55b62d4f22b0 con 0x55b62d5929a0 2024-09-19T09:05:46.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.002+0000 7f32f9882640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b62d5929a0 0x55b62d592da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:46.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.002+0000 7f32fa083640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b62d598370 0x55b62d59a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:46.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.002+0000 7f32f9081640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b62d5932e0 0x55b62d597da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:46.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.002+0000 7f32f9882640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b62d5929a0 0x55b62d592da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:34026/0 (socket says 172.21.15.92:34026) 2024-09-19T09:05:46.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.002+0000 7f32f9882640 1 -- 172.21.15.92:0/2854284779 learned_addr learned my addr 172.21.15.92:0/2854284779 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:46.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.003+0000 7f32fa083640 1 -- 172.21.15.92:0/2854284779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b62d5929a0 msgr2=0x55b62d592da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:46.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.003+0000 7f32fa083640 1 --2- 172.21.15.92:0/2854284779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b62d5929a0 0x55b62d592da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:46.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.003+0000 7f32fa083640 1 -- 172.21.15.92:0/2854284779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b62d5932e0 msgr2=0x55b62d597da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:46.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.003+0000 7f32fa083640 1 --2- 172.21.15.92:0/2854284779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b62d5932e0 0x55b62d597da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:46.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.003+0000 7f32fa083640 1 -- 172.21.15.92:0/2854284779 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b62d49d340 con 0x55b62d598370 2024-09-19T09:05:46.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.003+0000 7f32fa083640 1 --2- 172.21.15.92:0/2854284779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b62d598370 0x55b62d59a830 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f32e4098e80 tx=0x7f32e409c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d150002a713e95a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:46.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.003+0000 7f32dffff640 1 -- 172.21.15.92:0/2854284779 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e4020070 con 0x55b62d598370 2024-09-19T09:05:46.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.003+0000 7f32dffff640 1 -- 172.21.15.92:0/2854284779 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32e40a5690 con 0x55b62d598370 2024-09-19T09:05:46.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.003+0000 7f32dffff640 1 -- 172.21.15.92:0/2854284779 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e40a5200 con 0x55b62d598370 2024-09-19T09:05:46.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.005+0000 7f32fe87e740 1 -- 172.21.15.92:0/2854284779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b62d598370 msgr2=0x55b62d59a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:46.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.005+0000 7f32fe87e740 1 --2- 172.21.15.92:0/2854284779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b62d598370 0x55b62d59a830 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f32e4098e80 tx=0x7f32e409c4b0 comp rx=0 tx=0).stop 2024-09-19T09:05:46.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.006+0000 7f32fe87e740 1 -- 172.21.15.92:0/2854284779 shutdown_connections 2024-09-19T09:05:46.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.006+0000 7f32fe87e740 1 --2- 172.21.15.92:0/2854284779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b62d598370 0x55b62d59a830 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:46.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.006+0000 7f32fe87e740 1 --2- 172.21.15.92:0/2854284779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b62d5932e0 0x55b62d597da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:46.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.006+0000 7f32fe87e740 1 --2- 172.21.15.92:0/2854284779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b62d5929a0 0x55b62d592da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:46.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.006+0000 7f32fe87e740 1 -- 172.21.15.92:0/2854284779 >> 172.21.15.92:0/2854284779 conn(0x55b62d58e010 msgr2=0x55b62d58e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:46.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.007+0000 7f32fe87e740 1 -- 172.21.15.92:0/2854284779 shutdown_connections 2024-09-19T09:05:46.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.007+0000 7f32fe87e740 1 -- 172.21.15.92:0/2854284779 wait complete. 2024-09-19T09:05:46.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.007+0000 7f32fe87e740 1 -- start start 2024-09-19T09:05:46.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.007+0000 7f32fe87e740 1 Processor -- start 2024-09-19T09:05:46.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.008+0000 7f32fe87e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b62d5929a0 0x55b62d59ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:46.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.008+0000 7f32fe87e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b62d5932e0 0x55b62d59d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:46.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.008+0000 7f32fe87e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b62d598370 0x55b62d5a4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:46.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.008+0000 7f32fe87e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b62d59b340 con 0x55b62d5932e0 2024-09-19T09:05:46.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.008+0000 7f32fe87e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b62d47f290 con 0x55b62d5929a0 2024-09-19T09:05:46.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.008+0000 7f32fe87e740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55b62d59b4c0 con 0x55b62d598370 2024-09-19T09:05:46.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.008+0000 7f32fe87e740 10 client.0 _ll_register_callbacks cb 0x55b62d4b0140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:46.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.009+0000 7f32fa083640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b62d598370 0x55b62d5a4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:46.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.009+0000 7f32f9882640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b62d5929a0 0x55b62d59ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:46.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.009+0000 7f32fa083640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b62d598370 0x55b62d5a4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:34042/0 (socket says 172.21.15.92:34042) 2024-09-19T09:05:46.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.009+0000 7f32fa083640 1 -- 172.21.15.92:0/2648483124 learned_addr learned my addr 172.21.15.92:0/2648483124 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:46.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.009+0000 7f32fa083640 1 -- 172.21.15.92:0/2648483124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b62d5929a0 msgr2=0x55b62d59ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.009+0000 7f32fa083640 1 --2- 172.21.15.92:0/2648483124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b62d5929a0 0x55b62d59ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.009+0000 7f32fa083640 1 -- 172.21.15.92:0/2648483124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b62d5932e0 msgr2=0x55b62d59d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.009+0000 7f32fa083640 1 --2- 172.21.15.92:0/2648483124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b62d5932e0 0x55b62d59d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.009+0000 7f32fa083640 1 -- 172.21.15.92:0/2648483124 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b62d209210 con 0x55b62d598370 2024-09-19T09:05:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.009+0000 7f32fa083640 1 --2- 172.21.15.92:0/2648483124 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b62d598370 0x55b62d5a4250 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f32e409c720 tx=0x7f32e4098de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2de246d80dad4bf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.009+0000 7f32dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:05:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.010+0000 7f32dd7fa640 1 -- 172.21.15.92:0/2648483124 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e40b4020 con 0x55b62d598370 2024-09-19T09:05:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.010+0000 7f32dd7fa640 1 -- 172.21.15.92:0/2648483124 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f32e4099090 con 0x55b62d598370 2024-09-19T09:05:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.010+0000 7f32fe87e740 1 -- 172.21.15.92:0/2648483124 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32e40a5690 con 0x55b62d598370 2024-09-19T09:05:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.010+0000 7f32dd7fa640 1 -- 172.21.15.92:0/2648483124 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f32e4020050 con 0x55b62d598370 2024-09-19T09:05:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.010+0000 7f32fe87e740 10 client.26701 fetch_fsmap learned FSMap version 19 2024-09-19T09:05:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.010+0000 7f32fe87e740 1 -- 172.21.15.92:0/2648483124 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55b62d2d5620 con 0x55b62d598370 2024-09-19T09:05:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.010+0000 7f32dd7fa640 1 -- 172.21.15.92:0/2648483124 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32e40a5690 con 0x55b62d598370 2024-09-19T09:05:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.011+0000 7f32dd7fa640 1 -- 172.21.15.92:0/2648483124 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f32e409be70 con 0x55b62d598370 2024-09-19T09:05:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.011+0000 7f32fe87e740 10 client.26701 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:05:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.011+0000 7f32fe87e740 10 client.26701 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:05:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.011+0000 7f32fe87e740 20 client.26701 populate_metadata read hostname 'smithi092' 2024-09-19T09:05:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.011+0000 7f32fe87e740 1 --2- 172.21.15.92:0/2648483124 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b62d5a8550 0x55b62d5aa940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.011+0000 7f32fe87e740 4 client.26701 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:05:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.011+0000 7f32fe87e740 1 -- 172.21.15.92:0/2648483124 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b62d503a20 con 0x55b62d5a8550 2024-09-19T09:05:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.012+0000 7f32f9882640 1 --2- 172.21.15.92:0/2648483124 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b62d5a8550 0x55b62d5aa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.012+0000 7f32f9882640 1 --2- 172.21.15.92:0/2648483124 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b62d5a8550 0x55b62d5aa940 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81ee09f15de7837b server_cookie=4375c6b4c4bb1978 in_seq=0 out_seq=0 2024-09-19T09:05:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.012+0000 7f32dd7fa640 10 client.26701 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.013+0000 7f32dd7fa640 1 -- 172.21.15.92:0/2648483124 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b62d503a20 con 0x55b62d5a8550 2024-09-19T09:05:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.013+0000 7f32dd7fa640 10 client.26701 handle_command_reply: tid=0 2024-09-19T09:05:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.013+0000 7f32fe87e740 1 client.26701 shutdown 2024-09-19T09:05:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.013+0000 7f32fe87e740 1 -- 172.21.15.92:0/2648483124 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b62d598370 msgr2=0x55b62d5a4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.013+0000 7f32fe87e740 1 --2- 172.21.15.92:0/2648483124 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b62d598370 0x55b62d5a4250 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f32e409c720 tx=0x7f32e4098de0 comp rx=0 tx=0).stop 2024-09-19T09:05:46.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.014+0000 7f32fe87e740 1 -- 172.21.15.92:0/2648483124 shutdown_connections 2024-09-19T09:05:46.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.014+0000 7f32fe87e740 1 --2- 172.21.15.92:0/2648483124 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b62d5a8550 0x55b62d5aa940 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:46.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.014+0000 7f32fe87e740 1 --2- 172.21.15.92:0/2648483124 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b62d598370 0x55b62d5a4250 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:46.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.014+0000 7f32fe87e740 1 --2- 172.21.15.92:0/2648483124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b62d5932e0 0x55b62d59d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:46.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.014+0000 7f32fe87e740 1 --2- 172.21.15.92:0/2648483124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b62d5929a0 0x55b62d59ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:46.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.014+0000 7f32fe87e740 1 -- 172.21.15.92:0/2648483124 >> 172.21.15.92:0/2648483124 conn(0x55b62d58e010 msgr2=0x55b62d58f820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:46.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.014+0000 7f32dd7fa640 0 client.26701 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:46.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.014+0000 7f32fe87e740 1 -- 172.21.15.92:0/2648483124 shutdown_connections 2024-09-19T09:05:46.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.014+0000 7f32fe87e740 1 -- 172.21.15.92:0/2648483124 wait complete. 2024-09-19T09:05:46.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.014+0000 7f32fe87e740 20 client.26701 trim_cache size 0 max 16384 2024-09-19T09:05:46.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.037+0000 7f32fe87e740 1 Processor -- start 2024-09-19T09:05:46.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.037+0000 7f32fe87e740 1 -- start start 2024-09-19T09:05:46.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.037+0000 7f32fe87e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b62d5929a0 0x55b62d58d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:46.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.037+0000 7f32fe87e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b62d5932e0 0x55b62d5a4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:46.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.037+0000 7f32fe87e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b62d598370 0x55b62d5af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:46.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.037+0000 7f32fe87e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f32d800c500 con 0x55b62d598370 2024-09-19T09:05:46.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.037+0000 7f32fe87e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f32d800eda0 con 0x55b62d5932e0 2024-09-19T09:05:46.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.037+0000 7f32fe87e740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f32d800cb90 con 0x55b62d5929a0 2024-09-19T09:05:46.040 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.038+0000 7f32f9882640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b62d5929a0 0x55b62d58d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:46.040 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.038+0000 7f32f9081640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b62d5932e0 0x55b62d5a4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:46.040 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.038+0000 7f32f9081640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b62d5932e0 0x55b62d5a4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:37774/0 (socket says 172.21.15.92:37774) 2024-09-19T09:05:46.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.038+0000 7f32f9081640 1 -- 172.21.15.92:0/957331047 learned_addr learned my addr 172.21.15.92:0/957331047 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:46.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.038+0000 7f32fa083640 1 --2- 172.21.15.92:0/957331047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b62d598370 0x55b62d5af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:46.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.038+0000 7f32f9081640 1 -- 172.21.15.92:0/957331047 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b62d5929a0 msgr2=0x55b62d58d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:46.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.038+0000 7f32f9081640 1 --2- 172.21.15.92:0/957331047 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b62d5929a0 0x55b62d58d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:46.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.038+0000 7f32f9081640 1 -- 172.21.15.92:0/957331047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b62d598370 msgr2=0x55b62d5af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:46.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.038+0000 7f32f9081640 1 --2- 172.21.15.92:0/957331047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b62d598370 0x55b62d5af0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:46.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.038+0000 7f32f9081640 1 -- 172.21.15.92:0/957331047 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b62d59c810 con 0x55b62d5932e0 2024-09-19T09:05:46.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.038+0000 7f32fa083640 1 --2- 172.21.15.92:0/957331047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b62d598370 0x55b62d5af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:46.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.039+0000 7f32f9081640 1 --2- 172.21.15.92:0/957331047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b62d5932e0 0x55b62d5a4210 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f32f4118650 tx=0x7f32f000bb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eaa86f5385abab79 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:46.042 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.039+0000 7f32df7fe640 1 -- 172.21.15.92:0/957331047 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f001a020 con 0x55b62d5932e0 2024-09-19T09:05:46.042 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.039+0000 7f32df7fe640 1 -- 172.21.15.92:0/957331047 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32f0010c90 con 0x55b62d5932e0 2024-09-19T09:05:46.042 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.039+0000 7f32df7fe640 1 -- 172.21.15.92:0/957331047 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f0014430 con 0x55b62d5932e0 2024-09-19T09:05:46.042 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.040+0000 7f32fe87e740 1 -- 172.21.15.92:0/957331047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b62d5932e0 msgr2=0x55b62d5a4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:46.042 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.040+0000 7f32fe87e740 1 --2- 172.21.15.92:0/957331047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b62d5932e0 0x55b62d5a4210 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f32f4118650 tx=0x7f32f000bb80 comp rx=0 tx=0).stop 2024-09-19T09:05:46.045 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.040+0000 7f32fe87e740 1 -- 172.21.15.92:0/957331047 shutdown_connections 2024-09-19T09:05:46.045 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.040+0000 7f32fe87e740 1 --2- 172.21.15.92:0/957331047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b62d598370 0x55b62d5af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:46.045 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.040+0000 7f32fe87e740 1 --2- 172.21.15.92:0/957331047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b62d5932e0 0x55b62d5a4210 secure :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f32f4118650 tx=0x7f32f000bb80 comp rx=0 tx=0).stop 2024-09-19T09:05:46.045 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.040+0000 7f32fe87e740 1 --2- 172.21.15.92:0/957331047 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b62d5929a0 0x55b62d58d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:46.046 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.040+0000 7f32fe87e740 1 -- 172.21.15.92:0/957331047 >> 172.21.15.92:0/957331047 conn(0x55b62d58e010 msgr2=0x55b62d58c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:46.046 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.041+0000 7f32fe87e740 1 -- 172.21.15.92:0/957331047 shutdown_connections 2024-09-19T09:05:46.046 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.041+0000 7f32fe87e740 1 -- 172.21.15.92:0/957331047 wait complete. 2024-09-19T09:05:46.046 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.041+0000 7f32fe87e740 1 -- start start 2024-09-19T09:05:46.046 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.041+0000 7f32fe87e740 1 Processor -- start 2024-09-19T09:05:46.046 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.042+0000 7f32fe87e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b62d5929a0 0x55b62d5a2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:46.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.042+0000 7f32fe87e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b62d598370 0x55b62d5a2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:46.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.042+0000 7f32fe87e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b62d5a3560 0x55b62d5a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:46.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.042+0000 7f32fe87e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f32d800d260 con 0x55b62d5929a0 2024-09-19T09:05:46.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.042+0000 7f32fe87e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f32d800e6d0 con 0x55b62d598370 2024-09-19T09:05:46.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.042+0000 7f32fe87e740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f32d800d930 con 0x55b62d5a3560 2024-09-19T09:05:46.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.042+0000 7f32fe87e740 10 client.0 _ll_register_callbacks cb 0x7f32e40a0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:46.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.042+0000 7f32f9882640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b62d5929a0 0x55b62d5a2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:46.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.042+0000 7f32fa083640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b62d5a3560 0x55b62d5a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:46.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.042+0000 7f32f9882640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b62d5929a0 0x55b62d5a2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56810/0 (socket says 172.21.15.92:56810) 2024-09-19T09:05:46.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.042+0000 7f32f9882640 1 -- 172.21.15.92:0/1368524731 learned_addr learned my addr 172.21.15.92:0/1368524731 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:46.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.042+0000 7f32f9081640 1 --2- 172.21.15.92:0/1368524731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b62d598370 0x55b62d5a2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:46.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.042+0000 7f32fa083640 1 -- 172.21.15.92:0/1368524731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b62d598370 msgr2=0x55b62d5a2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:46.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.042+0000 7f32fa083640 1 --2- 172.21.15.92:0/1368524731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b62d598370 0x55b62d5a2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:46.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.042+0000 7f32fa083640 1 -- 172.21.15.92:0/1368524731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b62d5929a0 msgr2=0x55b62d5a2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:46.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.042+0000 7f32fa083640 1 --2- 172.21.15.92:0/1368524731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b62d5929a0 0x55b62d5a2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:46.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.042+0000 7f32fa083640 1 -- 172.21.15.92:0/1368524731 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b62d5a3f50 con 0x55b62d5a3560 2024-09-19T09:05:46.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.043+0000 7f32fa083640 1 --2- 172.21.15.92:0/1368524731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b62d5a3560 0x55b62d5a39c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f32e4098e80 tx=0x7f32e4098960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f408653cd63f4716 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:46.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.043+0000 7f32dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:05:46.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.043+0000 7f32dd7fa640 1 -- 172.21.15.92:0/1368524731 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e40b4040 con 0x55b62d5a3560 2024-09-19T09:05:46.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.043+0000 7f32dd7fa640 1 -- 172.21.15.92:0/1368524731 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f32e40cdf80 con 0x55b62d5a3560 2024-09-19T09:05:46.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.043+0000 7f32fe87e740 1 -- 172.21.15.92:0/1368524731 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32f0010c90 con 0x55b62d5a3560 2024-09-19T09:05:46.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.043+0000 7f32dd7fa640 1 -- 172.21.15.92:0/1368524731 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f32e40ab050 con 0x55b62d5a3560 2024-09-19T09:05:46.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.043+0000 7f32fe87e740 10 client.26707 fetch_fsmap learned FSMap version 19 2024-09-19T09:05:46.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.043+0000 7f32fe87e740 1 -- 172.21.15.92:0/1368524731 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55b62d613bb0 con 0x55b62d5a3560 2024-09-19T09:05:46.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.043+0000 7f32dd7fa640 1 -- 172.21.15.92:0/1368524731 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32f0010c90 con 0x55b62d5a3560 2024-09-19T09:05:46.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.044+0000 7f32dd7fa640 1 -- 172.21.15.92:0/1368524731 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f32e40bb1e0 con 0x55b62d5a3560 2024-09-19T09:05:46.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.044+0000 7f32fe87e740 10 client.26707 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:05:46.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.044+0000 7f32fe87e740 10 client.26707 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:05:46.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.044+0000 7f32fe87e740 20 client.26707 populate_metadata read hostname 'smithi092' 2024-09-19T09:05:46.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.044+0000 7f32fe87e740 1 --2- 172.21.15.92:0/1368524731 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b62d614420 0x55b62d616840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:46.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.044+0000 7f32fe87e740 4 client.26707 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:05:46.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.044+0000 7f32fe87e740 1 -- 172.21.15.92:0/1368524731 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b62d4fdd70 con 0x55b62d614420 2024-09-19T09:05:46.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.044+0000 7f32f9882640 1 --2- 172.21.15.92:0/1368524731 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b62d614420 0x55b62d616840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:46.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.045+0000 7f32f9882640 1 --2- 172.21.15.92:0/1368524731 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b62d614420 0x55b62d616840 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e378c7078ec61a22 server_cookie=59baa38871a38198 in_seq=0 out_seq=0 2024-09-19T09:05:46.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.045+0000 7f32dd7fa640 10 client.26707 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:46.067 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.066+0000 7f32dd7fa640 1 -- 172.21.15.92:0/1368524731 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b62d4fdd70 con 0x55b62d614420 2024-09-19T09:05:46.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.066+0000 7f32dd7fa640 10 client.26707 handle_command_reply: tid=0 2024-09-19T09:05:46.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.066+0000 7f32fe87e740 1 client.26707 shutdown 2024-09-19T09:05:46.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.067+0000 7f32fe87e740 1 -- 172.21.15.92:0/1368524731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b62d5a3560 msgr2=0x55b62d5a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:46.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.067+0000 7f32fe87e740 1 --2- 172.21.15.92:0/1368524731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b62d5a3560 0x55b62d5a39c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f32e4098e80 tx=0x7f32e4098960 comp rx=0 tx=0).stop 2024-09-19T09:05:46.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.067+0000 7f32fe87e740 1 -- 172.21.15.92:0/1368524731 shutdown_connections 2024-09-19T09:05:46.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.067+0000 7f32fe87e740 1 --2- 172.21.15.92:0/1368524731 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b62d614420 0x55b62d616840 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:46.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.067+0000 7f32fe87e740 1 --2- 172.21.15.92:0/1368524731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b62d5a3560 0x55b62d5a39c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:46.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.067+0000 7f32dd7fa640 0 client.26707 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:46.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.067+0000 7f32fe87e740 1 --2- 172.21.15.92:0/1368524731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b62d598370 0x55b62d5a2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:46.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.067+0000 7f32fe87e740 1 --2- 172.21.15.92:0/1368524731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b62d5929a0 0x55b62d5a2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:46.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.067+0000 7f32fe87e740 1 -- 172.21.15.92:0/1368524731 >> 172.21.15.92:0/1368524731 conn(0x55b62d58e010 msgr2=0x55b62d58d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:46.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.067+0000 7f32fe87e740 1 -- 172.21.15.92:0/1368524731 shutdown_connections 2024-09-19T09:05:46.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.067+0000 7f32fe87e740 1 -- 172.21.15.92:0/1368524731 wait complete. 2024-09-19T09:05:46.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.067+0000 7f32fe87e740 20 client.26707 trim_cache size 0 max 16384 2024-09-19T09:05:46.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:05:46.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:05:46.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:05:46.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:05:46.070 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.068+0000 7f32fbae6640 1 -- 172.21.15.92:0/2618500247 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f32e00a34c0 msgr2=0x7f32e00a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:46.070 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.068+0000 7f32fbae6640 1 --2- 172.21.15.92:0/2618500247 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f32e00a34c0 0x7f32e00a5980 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f32ec000f80 tx=0x7f32ec009860 comp rx=0 tx=0).stop 2024-09-19T09:05:46.070 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.068+0000 7f32fbae6640 1 -- 172.21.15.92:0/2618500247 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32f4109700 msgr2=0x7f32f4116f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:46.070 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.068+0000 7f32fbae6640 1 --2- 172.21.15.92:0/2618500247 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32f4109700 0x7f32f4116f20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f32e400d750 tx=0x7f32e400dc10 comp rx=0 tx=0).stop 2024-09-19T09:05:46.070 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.068+0000 7f32fbae6640 1 -- 172.21.15.92:0/2618500247 shutdown_connections 2024-09-19T09:05:46.070 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.068+0000 7f32fbae6640 1 --2- 172.21.15.92:0/2618500247 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32f4109700 0x7f32f4116f20 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:46.071 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.068+0000 7f32fbae6640 1 --2- 172.21.15.92:0/2618500247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32f40736c0 0x7f32f4118e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:46.071 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.068+0000 7f32fbae6640 1 --2- 172.21.15.92:0/2618500247 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f32e00a34c0 0x7f32e00a5980 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:46.071 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.068+0000 7f32fbae6640 1 --2- 172.21.15.92:0/2618500247 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32f4072d20 0x7f32f41188e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:46.071 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.068+0000 7f32fbae6640 1 -- 172.21.15.92:0/2618500247 >> 172.21.15.92:0/2618500247 conn(0x7f32f406ece0 msgr2=0x7f32f410c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:46.071 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.068+0000 7f32fbae6640 1 -- 172.21.15.92:0/2618500247 shutdown_connections 2024-09-19T09:05:46.071 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:46.068+0000 7f32fbae6640 1 -- 172.21.15.92:0/2618500247 wait complete. 2024-09-19T09:05:46.315 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:05:46.316 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:05:46.750 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:47.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.335+0000 7fa4602fe640 1 -- 172.21.15.92:0/3972563331 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa458109830 msgr2=0x7fa458109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:47.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.336+0000 7fa4602fe640 1 --2- 172.21.15.92:0/3972563331 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa458109830 0x7fa458109c90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa454009860 tx=0x7fa45402a380 comp rx=0 tx=0).stop 2024-09-19T09:05:47.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.340+0000 7fa4602fe640 1 -- 172.21.15.92:0/3972563331 shutdown_connections 2024-09-19T09:05:47.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.340+0000 7fa4602fe640 1 --2- 172.21.15.92:0/3972563331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa45811b140 0x7fa45811d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:47.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.340+0000 7fa4602fe640 1 --2- 172.21.15.92:0/3972563331 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa458109830 0x7fa458109c90 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:47.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.340+0000 7fa4602fe640 1 --2- 172.21.15.92:0/3972563331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa458109450 0x7fa458110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:47.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.340+0000 7fa4602fe640 1 -- 172.21.15.92:0/3972563331 >> 172.21.15.92:0/3972563331 conn(0x7fa45806e140 msgr2=0x7fa45806e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:47.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.344+0000 7fa4602fe640 1 -- 172.21.15.92:0/3972563331 shutdown_connections 2024-09-19T09:05:47.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.344+0000 7fa4602fe640 1 -- 172.21.15.92:0/3972563331 wait complete. 2024-09-19T09:05:47.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.345+0000 7fa4602fe640 1 Processor -- start 2024-09-19T09:05:47.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.346+0000 7fa4602fe640 1 -- start start 2024-09-19T09:05:47.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.346+0000 7fa4602fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa458109450 0x7fa4581a7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:47.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.346+0000 7fa4602fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa458109830 0x7fa4581a76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:47.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.346+0000 7fa4602fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa45811b140 0x7fa4581aba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:47.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.346+0000 7fa4602fe640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa458120e30 con 0x7fa458109830 2024-09-19T09:05:47.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.346+0000 7fa4602fe640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa458120cb0 con 0x7fa458109450 2024-09-19T09:05:47.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.346+0000 7fa4602fe640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa458120fb0 con 0x7fa45811b140 2024-09-19T09:05:47.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.347+0000 7fa45e89b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa45811b140 0x7fa4581aba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:47.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.347+0000 7fa45e09a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa458109450 0x7fa4581a7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:47.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.348+0000 7fa45e09a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa458109450 0x7fa4581a7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:37816/0 (socket says 172.21.15.92:37816) 2024-09-19T09:05:47.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.348+0000 7fa45e09a640 1 -- 172.21.15.92:0/2848314079 learned_addr learned my addr 172.21.15.92:0/2848314079 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:47.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.349+0000 7fa45e09a640 1 -- 172.21.15.92:0/2848314079 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa45811b140 msgr2=0x7fa4581aba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:47.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.349+0000 7fa45e09a640 1 --2- 172.21.15.92:0/2848314079 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa45811b140 0x7fa4581aba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:47.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.349+0000 7fa45e09a640 1 -- 172.21.15.92:0/2848314079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa458109830 msgr2=0x7fa4581a76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:47.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.349+0000 7fa45e09a640 1 --2- 172.21.15.92:0/2848314079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa458109830 0x7fa4581a76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:47.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.349+0000 7fa45e09a640 1 -- 172.21.15.92:0/2848314079 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4581ac140 con 0x7fa458109450 2024-09-19T09:05:47.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.351+0000 7fa45e09a640 1 --2- 172.21.15.92:0/2848314079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa458109450 0x7fa4581a7190 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa45000efb0 tx=0x7fa45000c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:47.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.352+0000 7fa44f7fe640 1 -- 172.21.15.92:0/2848314079 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45001b070 con 0x7fa458109450 2024-09-19T09:05:47.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.352+0000 7fa44f7fe640 1 -- 172.21.15.92:0/2848314079 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa45000ba50 con 0x7fa458109450 2024-09-19T09:05:47.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.352+0000 7fa44f7fe640 1 -- 172.21.15.92:0/2848314079 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa450016cb0 con 0x7fa458109450 2024-09-19T09:05:47.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.353+0000 7fa4602fe640 1 -- 172.21.15.92:0/2848314079 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4581ac430 con 0x7fa458109450 2024-09-19T09:05:47.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.353+0000 7fa4602fe640 1 -- 172.21.15.92:0/2848314079 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4581b3d10 con 0x7fa458109450 2024-09-19T09:05:47.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.355+0000 7fa4602fe640 1 -- 172.21.15.92:0/2848314079 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4581a84f0 con 0x7fa458109450 2024-09-19T09:05:47.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.357+0000 7fa44f7fe640 1 -- 172.21.15.92:0/2848314079 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa45001e070 con 0x7fa458109450 2024-09-19T09:05:47.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.359+0000 7fa44f7fe640 1 --2- 172.21.15.92:0/2848314079 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa4440a33d0 0x7fa4440a5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:47.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.359+0000 7fa44f7fe640 1 -- 172.21.15.92:0/2848314079 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa4500cfc70 con 0x7fa458109450 2024-09-19T09:05:47.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.362+0000 7fa44f7fe640 1 -- 172.21.15.92:0/2848314079 <== mon.2 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa45009c9d0 con 0x7fa458109450 2024-09-19T09:05:47.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.366+0000 7fa45d899640 1 --2- 172.21.15.92:0/2848314079 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa4440a33d0 0x7fa4440a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:47.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.371+0000 7fa45d899640 1 --2- 172.21.15.92:0/2848314079 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa4440a33d0 0x7fa4440a5890 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa4540095f0 tx=0x7fa45402a880 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:47.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.745+0000 7fa4602fe640 1 -- 172.21.15.92:0/2848314079 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa45810b340 con 0x7fa458109450 2024-09-19T09:05:47.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.747+0000 7fa44f7fe640 1 -- 172.21.15.92:0/2848314079 <== mon.2 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7fa45009c2d0 con 0x7fa458109450 2024-09-19T09:05:47.748 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:05:47.749 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:05:47.749 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:05:47.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.752+0000 7fa4602fe640 1 -- 172.21.15.92:0/2848314079 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa4440a33d0 msgr2=0x7fa4440a5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:47.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.752+0000 7fa4602fe640 1 --2- 172.21.15.92:0/2848314079 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa4440a33d0 0x7fa4440a5890 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa4540095f0 tx=0x7fa45402a880 comp rx=0 tx=0).stop 2024-09-19T09:05:47.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.752+0000 7fa4602fe640 1 -- 172.21.15.92:0/2848314079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa458109450 msgr2=0x7fa4581a7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:47.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.752+0000 7fa4602fe640 1 --2- 172.21.15.92:0/2848314079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa458109450 0x7fa4581a7190 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa45000efb0 tx=0x7fa45000c800 comp rx=0 tx=0).stop 2024-09-19T09:05:47.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:47 smithi092 ceph-mon[31407]: pgmap v609: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 18 MiB/s wr, 656 op/s 2024-09-19T09:05:47.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.753+0000 7fa4602fe640 1 -- 172.21.15.92:0/2848314079 shutdown_connections 2024-09-19T09:05:47.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.753+0000 7fa4602fe640 1 --2- 172.21.15.92:0/2848314079 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa45811b140 0x7fa4581aba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:47.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.753+0000 7fa4602fe640 1 --2- 172.21.15.92:0/2848314079 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa4440a33d0 0x7fa4440a5890 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:47.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.753+0000 7fa4602fe640 1 --2- 172.21.15.92:0/2848314079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa458109830 0x7fa4581a76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:47.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.753+0000 7fa4602fe640 1 --2- 172.21.15.92:0/2848314079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa458109450 0x7fa4581a7190 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:47.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.753+0000 7fa4602fe640 1 -- 172.21.15.92:0/2848314079 >> 172.21.15.92:0/2848314079 conn(0x7fa45806e140 msgr2=0x7fa45811c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:47.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.753+0000 7fa4602fe640 1 -- 172.21.15.92:0/2848314079 shutdown_connections 2024-09-19T09:05:47.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:47.753+0000 7fa4602fe640 1 -- 172.21.15.92:0/2848314079 wait complete. 2024-09-19T09:05:47.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:47 smithi167 ceph-mon[35359]: pgmap v609: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 18 MiB/s wr, 656 op/s 2024-09-19T09:05:47.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:47 smithi190 ceph-mon[35358]: pgmap v609: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 18 MiB/s wr, 656 op/s 2024-09-19T09:05:48.494 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:05:48.756 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:48 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/2848314079' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:05:48.756 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:48 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:05:48.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:48 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/2848314079' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:05:48.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:48 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:05:48.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:48 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/2848314079' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:05:48.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:48 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:05:48.909 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:49.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.454+0000 7f2c3f468640 1 -- 172.21.15.92:0/718609791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c3810c180 msgr2=0x7f2c3810e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:49.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.454+0000 7f2c3f468640 1 --2- 172.21.15.92:0/718609791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c3810c180 0x7f2c3810e620 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f2c30009ca0 tx=0x7f2c3002a950 comp rx=0 tx=0).stop 2024-09-19T09:05:49.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.454+0000 7f2c3f468640 1 -- 172.21.15.92:0/718609791 shutdown_connections 2024-09-19T09:05:49.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.454+0000 7f2c3f468640 1 --2- 172.21.15.92:0/718609791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c3810c180 0x7f2c3810e620 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.455+0000 7f2c3f468640 1 --2- 172.21.15.92:0/718609791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c38103670 0x7f2c3810bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.455+0000 7f2c3f468640 1 --2- 172.21.15.92:0/718609791 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2c38102d50 0x7f2c38103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.455+0000 7f2c3f468640 1 -- 172.21.15.92:0/718609791 >> 172.21.15.92:0/718609791 conn(0x7f2c380fc7d0 msgr2=0x7f2c380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:49.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.455+0000 7f2c3f468640 1 -- 172.21.15.92:0/718609791 shutdown_connections 2024-09-19T09:05:49.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.455+0000 7f2c3f468640 1 -- 172.21.15.92:0/718609791 wait complete. 2024-09-19T09:05:49.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.456+0000 7f2c3f468640 1 Processor -- start 2024-09-19T09:05:49.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.456+0000 7f2c3f468640 1 -- start start 2024-09-19T09:05:49.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.456+0000 7f2c3f468640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c38102d50 0x7f2c38198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:49.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.456+0000 7f2c3f468640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2c38103670 0x7f2c38198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:49.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.456+0000 7f2c3f468640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c3810c180 0x7f2c3819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:49.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.456+0000 7f2c3f468640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2c38111f80 con 0x7f2c38102d50 2024-09-19T09:05:49.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.456+0000 7f2c3f468640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2c38111e00 con 0x7f2c3810c180 2024-09-19T09:05:49.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.456+0000 7f2c3d204640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c38102d50 0x7f2c38198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:49.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.456+0000 7f2c3d204640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c38102d50 0x7f2c38198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56838/0 (socket says 172.21.15.92:56838) 2024-09-19T09:05:49.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.456+0000 7f2c3d204640 1 -- 172.21.15.92:0/1896300818 learned_addr learned my addr 172.21.15.92:0/1896300818 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:49.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.456+0000 7f2c3f468640 1 -- 172.21.15.92:0/1896300818 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2c38112100 con 0x7f2c38103670 2024-09-19T09:05:49.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.456+0000 7f2c3da05640 1 --2- 172.21.15.92:0/1896300818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c3810c180 0x7f2c3819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:49.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.456+0000 7f2c3ca03640 1 --2- 172.21.15.92:0/1896300818 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2c38103670 0x7f2c38198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:49.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.457+0000 7f2c3d204640 1 -- 172.21.15.92:0/1896300818 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2c38103670 msgr2=0x7f2c38198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:49.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.457+0000 7f2c3d204640 1 --2- 172.21.15.92:0/1896300818 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2c38103670 0x7f2c38198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.457+0000 7f2c3d204640 1 -- 172.21.15.92:0/1896300818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c3810c180 msgr2=0x7f2c3819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:49.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.457+0000 7f2c3d204640 1 --2- 172.21.15.92:0/1896300818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c3810c180 0x7f2c3819cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.457+0000 7f2c3d204640 1 -- 172.21.15.92:0/1896300818 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c3819d3c0 con 0x7f2c38102d50 2024-09-19T09:05:49.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.457+0000 7f2c3da05640 1 --2- 172.21.15.92:0/1896300818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c3810c180 0x7f2c3819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:05:49.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.457+0000 7f2c3d204640 1 --2- 172.21.15.92:0/1896300818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c38102d50 0x7f2c38198410 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f2c3400e9f0 tx=0x7f2c3400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:49.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.457+0000 7f2c2e7fc640 1 -- 172.21.15.92:0/1896300818 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3400cd80 con 0x7f2c38102d50 2024-09-19T09:05:49.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.457+0000 7f2c2e7fc640 1 -- 172.21.15.92:0/1896300818 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c34005500 con 0x7f2c38102d50 2024-09-19T09:05:49.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.457+0000 7f2c3f468640 1 -- 172.21.15.92:0/1896300818 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c3819d6b0 con 0x7f2c38102d50 2024-09-19T09:05:49.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.457+0000 7f2c2e7fc640 1 -- 172.21.15.92:0/1896300818 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3400cd80 con 0x7f2c38102d50 2024-09-19T09:05:49.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.458+0000 7f2c3f468640 1 -- 172.21.15.92:0/1896300818 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c381a4f90 con 0x7f2c38102d50 2024-09-19T09:05:49.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.461+0000 7f2c41841740 1 Processor -- start 2024-09-19T09:05:49.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.461+0000 7f2c41841740 1 -- start start 2024-09-19T09:05:49.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.461+0000 7f2c41841740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55965a20cb40 0x55965a20b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:49.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.461+0000 7f2c41841740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55965a20b5d0 0x55965a20ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:49.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.461+0000 7f2c41841740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55965a21a780 0x55965a21cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:49.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.462+0000 7f2c41841740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55965a1712f0 con 0x55965a20cb40 2024-09-19T09:05:49.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.462+0000 7f2c41841740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55965a118cf0 con 0x55965a21a780 2024-09-19T09:05:49.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.462+0000 7f2c41841740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55965a16d2b0 con 0x55965a20b5d0 2024-09-19T09:05:49.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.462+0000 7f2c3ca03640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55965a21a780 0x55965a21cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:49.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.462+0000 7f2c3ca03640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55965a21a780 0x55965a21cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:37828/0 (socket says 172.21.15.92:37828) 2024-09-19T09:05:49.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.462+0000 7f2c3da05640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55965a20cb40 0x55965a20b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:49.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.462+0000 7f2c3ca03640 1 -- 172.21.15.92:0/1863506525 learned_addr learned my addr 172.21.15.92:0/1863506525 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:49.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.462+0000 7f2c3ca03640 1 -- 172.21.15.92:0/1863506525 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55965a20b5d0 msgr2=0x55965a20ba10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:05:49.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.462+0000 7f2c3ca03640 1 --2- 172.21.15.92:0/1863506525 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55965a20b5d0 0x55965a20ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.462+0000 7f2c3ca03640 1 -- 172.21.15.92:0/1863506525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55965a20cb40 msgr2=0x55965a20b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:49.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.462+0000 7f2c3ca03640 1 --2- 172.21.15.92:0/1863506525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55965a20cb40 0x55965a20b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.462+0000 7f2c3ca03640 1 -- 172.21.15.92:0/1863506525 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55965a0fd3a0 con 0x55965a21a780 2024-09-19T09:05:49.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.462+0000 7f2c3ca03640 1 --2- 172.21.15.92:0/1863506525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55965a21a780 0x55965a21cb70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2c28009c00 tx=0x7f2c28011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a15381625d77f7a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:49.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.463+0000 7f2c2e7fc640 1 -- 172.21.15.92:0/1896300818 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2c340046c0 con 0x7f2c38102d50 2024-09-19T09:05:49.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.463+0000 7f2c237fe640 1 -- 172.21.15.92:0/1863506525 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c28004230 con 0x55965a21a780 2024-09-19T09:05:49.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.463+0000 7f2c237fe640 1 -- 172.21.15.92:0/1863506525 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c280043d0 con 0x55965a21a780 2024-09-19T09:05:49.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.463+0000 7f2c237fe640 1 -- 172.21.15.92:0/1863506525 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c28004dc0 con 0x55965a21a780 2024-09-19T09:05:49.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.463+0000 7f2c2e7fc640 1 --2- 172.21.15.92:0/1896300818 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2c240a3440 0x7f2c240a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:49.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.463+0000 7f2c2e7fc640 1 -- 172.21.15.92:0/1896300818 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2c340cf870 con 0x7f2c38102d50 2024-09-19T09:05:49.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.464+0000 7f2c3da05640 1 --2- 172.21.15.92:0/1896300818 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2c240a3440 0x7f2c240a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:49.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.464+0000 7f2c41841740 1 -- 172.21.15.92:0/1863506525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55965a21a780 msgr2=0x55965a21cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:49.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.464+0000 7f2c41841740 1 --2- 172.21.15.92:0/1863506525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55965a21a780 0x55965a21cb70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2c28009c00 tx=0x7f2c28011810 comp rx=0 tx=0).stop 2024-09-19T09:05:49.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.464+0000 7f2c41841740 1 -- 172.21.15.92:0/1863506525 shutdown_connections 2024-09-19T09:05:49.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.464+0000 7f2c41841740 1 --2- 172.21.15.92:0/1863506525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55965a21a780 0x55965a21cb70 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.464+0000 7f2c41841740 1 --2- 172.21.15.92:0/1863506525 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55965a20b5d0 0x55965a20ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.464+0000 7f2c41841740 1 --2- 172.21.15.92:0/1863506525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55965a20cb40 0x55965a20b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.464+0000 7f2c41841740 1 -- 172.21.15.92:0/1863506525 >> 172.21.15.92:0/1863506525 conn(0x55965a1d4310 msgr2=0x55965a207c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:49.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.464+0000 7f2c41841740 1 -- 172.21.15.92:0/1863506525 shutdown_connections 2024-09-19T09:05:49.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.464+0000 7f2c41841740 1 -- 172.21.15.92:0/1863506525 wait complete. 2024-09-19T09:05:49.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.464+0000 7f2c3da05640 1 --2- 172.21.15.92:0/1896300818 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2c240a3440 0x7f2c240a5900 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2c3002fd90 tx=0x7f2c30005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:49.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.464+0000 7f2c41841740 1 -- start start 2024-09-19T09:05:49.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.465+0000 7f2c41841740 1 Processor -- start 2024-09-19T09:05:49.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.466+0000 7f2c41841740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55965a20b5d0 0x55965a21a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:49.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.466+0000 7f2c41841740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55965a20cb40 0x55965a217430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:49.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.466+0000 7f2c41841740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55965a21a780 0x55965a217a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:49.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.466+0000 7f2c41841740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55965a21d480 con 0x55965a20cb40 2024-09-19T09:05:49.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.466+0000 7f2c41841740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55965a12c060 con 0x55965a21a780 2024-09-19T09:05:49.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.466+0000 7f2c41841740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55965a21d600 con 0x55965a20b5d0 2024-09-19T09:05:49.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.467+0000 7f2c41841740 10 client.0 _ll_register_callbacks cb 0x559659e7f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:49.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.467+0000 7f2c3da05640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55965a21a780 0x55965a217a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:49.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.467+0000 7f2c3da05640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55965a21a780 0x55965a217a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:37832/0 (socket says 172.21.15.92:37832) 2024-09-19T09:05:49.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.467+0000 7f2c3da05640 1 -- 172.21.15.92:0/780313626 learned_addr learned my addr 172.21.15.92:0/780313626 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:49.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.467+0000 7f2c3d204640 1 --2- 172.21.15.92:0/780313626 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55965a20b5d0 0x55965a21a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:49.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.467+0000 7f2c3d204640 1 -- 172.21.15.92:0/780313626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55965a21a780 msgr2=0x55965a217a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:49.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.467+0000 7f2c3d204640 1 --2- 172.21.15.92:0/780313626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55965a21a780 0x55965a217a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.467+0000 7f2c3d204640 1 -- 172.21.15.92:0/780313626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55965a20cb40 msgr2=0x55965a217430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:49.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.467+0000 7f2c3d204640 1 --2- 172.21.15.92:0/780313626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55965a20cb40 0x55965a217430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.467+0000 7f2c3d204640 1 -- 172.21.15.92:0/780313626 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559659ee23c0 con 0x55965a20b5d0 2024-09-19T09:05:49.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.467+0000 7f2c3d204640 1 --2- 172.21.15.92:0/780313626 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55965a20b5d0 0x55965a21a180 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55965a208ac0 tx=0x7f2c3409b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c01a3fb5f633a080 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:49.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.467+0000 7f2c20ff9640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:05:49.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.467+0000 7f2c20ff9640 1 -- 172.21.15.92:0/780313626 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c340a0240 con 0x55965a20b5d0 2024-09-19T09:05:49.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.467+0000 7f2c20ff9640 1 -- 172.21.15.92:0/780313626 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2c340a4670 con 0x55965a20b5d0 2024-09-19T09:05:49.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.468+0000 7f2c41841740 1 -- 172.21.15.92:0/780313626 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c280043d0 con 0x55965a20b5d0 2024-09-19T09:05:49.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.468+0000 7f2c20ff9640 1 -- 172.21.15.92:0/780313626 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2c340a4b00 con 0x55965a20b5d0 2024-09-19T09:05:49.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.468+0000 7f2c41841740 10 client.26722 fetch_fsmap learned FSMap version 19 2024-09-19T09:05:49.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.468+0000 7f2c41841740 1 -- 172.21.15.92:0/780313626 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55965a239f30 con 0x55965a20b5d0 2024-09-19T09:05:49.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.468+0000 7f2c20ff9640 1 -- 172.21.15.92:0/780313626 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c280043d0 con 0x55965a20b5d0 2024-09-19T09:05:49.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.468+0000 7f2c20ff9640 1 -- 172.21.15.92:0/780313626 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f2c340bab60 con 0x55965a20b5d0 2024-09-19T09:05:49.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.468+0000 7f2c41841740 10 client.26722 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:05:49.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.468+0000 7f2c41841740 10 client.26722 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:05:49.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.468+0000 7f2c41841740 20 client.26722 populate_metadata read hostname 'smithi092' 2024-09-19T09:05:49.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.468+0000 7f2c41841740 1 --2- 172.21.15.92:0/780313626 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55965a23b390 0x55965a23d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:49.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.468+0000 7f2c41841740 4 client.26722 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:05:49.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.468+0000 7f2c41841740 1 -- 172.21.15.92:0/780313626 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55965a17e860 con 0x55965a23b390 2024-09-19T09:05:49.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.468+0000 7f2c3ca03640 1 --2- 172.21.15.92:0/780313626 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55965a23b390 0x55965a23d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:49.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.469+0000 7f2c20ff9640 10 client.26722 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:49.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.469+0000 7f2c3ca03640 1 --2- 172.21.15.92:0/780313626 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55965a23b390 0x55965a23d7c0 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13cb727554618c6c server_cookie=d0e3eb09032af25c in_seq=0 out_seq=0 2024-09-19T09:05:49.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.469+0000 7f2c20ff9640 1 -- 172.21.15.92:0/780313626 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55965a17e860 con 0x55965a23b390 2024-09-19T09:05:49.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.469+0000 7f2c20ff9640 10 client.26722 handle_command_reply: tid=0 2024-09-19T09:05:49.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.469+0000 7f2c41841740 1 client.26722 shutdown 2024-09-19T09:05:49.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.470+0000 7f2c41841740 1 -- 172.21.15.92:0/780313626 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55965a20b5d0 msgr2=0x55965a21a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:49.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.470+0000 7f2c41841740 1 --2- 172.21.15.92:0/780313626 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55965a20b5d0 0x55965a21a180 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55965a208ac0 tx=0x7f2c3409b8b0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.470+0000 7f2c41841740 1 -- 172.21.15.92:0/780313626 shutdown_connections 2024-09-19T09:05:49.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.470+0000 7f2c41841740 1 --2- 172.21.15.92:0/780313626 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55965a23b390 0x55965a23d7c0 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.470+0000 7f2c41841740 1 --2- 172.21.15.92:0/780313626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55965a21a780 0x55965a217a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.470+0000 7f2c41841740 1 --2- 172.21.15.92:0/780313626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55965a20cb40 0x55965a217430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.470+0000 7f2c41841740 1 --2- 172.21.15.92:0/780313626 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55965a20b5d0 0x55965a21a180 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.470+0000 7f2c41841740 1 -- 172.21.15.92:0/780313626 >> 172.21.15.92:0/780313626 conn(0x55965a1d4310 msgr2=0x55965a20d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:49.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.470+0000 7f2c20ff9640 0 client.26722 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:49.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.470+0000 7f2c41841740 1 -- 172.21.15.92:0/780313626 shutdown_connections 2024-09-19T09:05:49.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.470+0000 7f2c41841740 1 -- 172.21.15.92:0/780313626 wait complete. 2024-09-19T09:05:49.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.470+0000 7f2c41841740 20 client.26722 trim_cache size 0 max 16384 2024-09-19T09:05:49.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.487+0000 7f2c41841740 1 Processor -- start 2024-09-19T09:05:49.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.487+0000 7f2c41841740 1 -- start start 2024-09-19T09:05:49.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.488+0000 7f2c41841740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55965a20b5d0 0x55965a207700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:49.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.488+0000 7f2c41841740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55965a20cb40 0x55965a207c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:49.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.488+0000 7f2c41841740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55965a21a780 0x55965a243090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:49.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.488+0000 7f2c41841740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3806fe50 con 0x55965a20b5d0 2024-09-19T09:05:49.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.488+0000 7f2c41841740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2c380726f0 con 0x55965a21a780 2024-09-19T09:05:49.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.488+0000 7f2c41841740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2c380704e0 con 0x55965a20cb40 2024-09-19T09:05:49.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.488+0000 7f2c3ca03640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55965a20cb40 0x55965a207c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:49.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.488+0000 7f2c3ca03640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55965a20cb40 0x55965a207c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:34124/0 (socket says 172.21.15.92:34124) 2024-09-19T09:05:49.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.488+0000 7f2c3ca03640 1 -- 172.21.15.92:0/2166549112 learned_addr learned my addr 172.21.15.92:0/2166549112 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:49.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.488+0000 7f2c3da05640 1 --2- 172.21.15.92:0/2166549112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55965a21a780 0x55965a243090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:49.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.488+0000 7f2c3d204640 1 --2- 172.21.15.92:0/2166549112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55965a20b5d0 0x55965a207700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:49.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.489+0000 7f2c3da05640 1 -- 172.21.15.92:0/2166549112 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55965a20cb40 msgr2=0x55965a207c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:49.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.489+0000 7f2c3da05640 1 --2- 172.21.15.92:0/2166549112 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55965a20cb40 0x55965a207c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.489+0000 7f2c3da05640 1 -- 172.21.15.92:0/2166549112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55965a20b5d0 msgr2=0x55965a207700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:49.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.489+0000 7f2c3da05640 1 --2- 172.21.15.92:0/2166549112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55965a20b5d0 0x55965a207700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.489+0000 7f2c3da05640 1 -- 172.21.15.92:0/2166549112 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55965a208180 con 0x55965a21a780 2024-09-19T09:05:49.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.489+0000 7f2c3d204640 1 --2- 172.21.15.92:0/2166549112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55965a20b5d0 0x55965a207700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:49.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.489+0000 7f2c3da05640 1 --2- 172.21.15.92:0/2166549112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55965a21a780 0x55965a243090 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2c30005cc0 tx=0x7f2c30045000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46421553a005334d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:49.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.489+0000 7f2c22ffd640 1 -- 172.21.15.92:0/2166549112 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c30056070 con 0x55965a21a780 2024-09-19T09:05:49.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.489+0000 7f2c22ffd640 1 -- 172.21.15.92:0/2166549112 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c3002f760 con 0x55965a21a780 2024-09-19T09:05:49.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.489+0000 7f2c22ffd640 1 -- 172.21.15.92:0/2166549112 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c30034040 con 0x55965a21a780 2024-09-19T09:05:49.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.490+0000 7f2c41841740 1 -- 172.21.15.92:0/2166549112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55965a21a780 msgr2=0x55965a243090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:49.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.490+0000 7f2c41841740 1 --2- 172.21.15.92:0/2166549112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55965a21a780 0x55965a243090 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2c30005cc0 tx=0x7f2c30045000 comp rx=0 tx=0).stop 2024-09-19T09:05:49.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.490+0000 7f2c41841740 1 -- 172.21.15.92:0/2166549112 shutdown_connections 2024-09-19T09:05:49.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.490+0000 7f2c41841740 1 --2- 172.21.15.92:0/2166549112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55965a21a780 0x55965a243090 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.490+0000 7f2c41841740 1 --2- 172.21.15.92:0/2166549112 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55965a20cb40 0x55965a207c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.490+0000 7f2c41841740 1 --2- 172.21.15.92:0/2166549112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55965a20b5d0 0x55965a207700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.490+0000 7f2c41841740 1 -- 172.21.15.92:0/2166549112 >> 172.21.15.92:0/2166549112 conn(0x55965a1d4310 msgr2=0x55965a202a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:49.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.490+0000 7f2c41841740 1 -- 172.21.15.92:0/2166549112 shutdown_connections 2024-09-19T09:05:49.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.490+0000 7f2c41841740 1 -- 172.21.15.92:0/2166549112 wait complete. 2024-09-19T09:05:49.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.491+0000 7f2c41841740 1 -- start start 2024-09-19T09:05:49.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.491+0000 7f2c41841740 1 Processor -- start 2024-09-19T09:05:49.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.491+0000 7f2c41841740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55965a20b5d0 0x55965a21fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:49.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.491+0000 7f2c41841740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55965a20cb40 0x55965a220340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:49.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.491+0000 7f2c41841740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55965a21a780 0x55965a2a0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:49.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.491+0000 7f2c41841740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2c38070bb0 con 0x55965a20cb40 2024-09-19T09:05:49.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.491+0000 7f2c41841740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2c38072020 con 0x55965a20b5d0 2024-09-19T09:05:49.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.491+0000 7f2c41841740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2c38071280 con 0x55965a21a780 2024-09-19T09:05:49.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.491+0000 7f2c41841740 10 client.0 _ll_register_callbacks cb 0x7f2c34004aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:49.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.491+0000 7f2c3d204640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55965a20b5d0 0x55965a21fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:49.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.491+0000 7f2c3d204640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55965a20b5d0 0x55965a21fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:37854/0 (socket says 172.21.15.92:37854) 2024-09-19T09:05:49.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.491+0000 7f2c3d204640 1 -- 172.21.15.92:0/1148658676 learned_addr learned my addr 172.21.15.92:0/1148658676 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:49.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.492+0000 7f2c3ca03640 1 --2- 172.21.15.92:0/1148658676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55965a20cb40 0x55965a220340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:49.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.492+0000 7f2c3da05640 1 --2- 172.21.15.92:0/1148658676 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55965a21a780 0x55965a2a0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:49.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.492+0000 7f2c3d204640 1 -- 172.21.15.92:0/1148658676 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55965a21a780 msgr2=0x55965a2a0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:49.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.492+0000 7f2c3d204640 1 --2- 172.21.15.92:0/1148658676 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55965a21a780 0x55965a2a0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.492+0000 7f2c3d204640 1 -- 172.21.15.92:0/1148658676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55965a20cb40 msgr2=0x55965a220340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:49.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.492+0000 7f2c3d204640 1 --2- 172.21.15.92:0/1148658676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55965a20cb40 0x55965a220340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.492+0000 7f2c3d204640 1 -- 172.21.15.92:0/1148658676 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55965a2a0570 con 0x55965a20b5d0 2024-09-19T09:05:49.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.492+0000 7f2c3d204640 1 --2- 172.21.15.92:0/1148658676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55965a20b5d0 0x55965a21fe00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2c34098860 tx=0x7f2c3409bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3186aa50ba156484 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:49.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.492+0000 7f2c20ff9640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:05:49.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.492+0000 7f2c20ff9640 1 -- 172.21.15.92:0/1148658676 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c340b8030 con 0x55965a20b5d0 2024-09-19T09:05:49.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.492+0000 7f2c20ff9640 1 -- 172.21.15.92:0/1148658676 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2c340a4670 con 0x55965a20b5d0 2024-09-19T09:05:49.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.492+0000 7f2c41841740 1 -- 172.21.15.92:0/1148658676 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c3002f760 con 0x55965a20b5d0 2024-09-19T09:05:49.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.492+0000 7f2c20ff9640 1 -- 172.21.15.92:0/1148658676 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2c340a0240 con 0x55965a20b5d0 2024-09-19T09:05:49.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.493+0000 7f2c41841740 10 client.26828 fetch_fsmap learned FSMap version 19 2024-09-19T09:05:49.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.493+0000 7f2c41841740 1 -- 172.21.15.92:0/1148658676 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55965a2a17e0 con 0x55965a20b5d0 2024-09-19T09:05:49.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.493+0000 7f2c20ff9640 1 -- 172.21.15.92:0/1148658676 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c3002f760 con 0x55965a20b5d0 2024-09-19T09:05:49.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.493+0000 7f2c20ff9640 1 -- 172.21.15.92:0/1148658676 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f2c34081070 con 0x55965a20b5d0 2024-09-19T09:05:49.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.493+0000 7f2c41841740 10 client.26828 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:05:49.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.493+0000 7f2c41841740 10 client.26828 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:05:49.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.493+0000 7f2c41841740 20 client.26828 populate_metadata read hostname 'smithi092' 2024-09-19T09:05:49.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.493+0000 7f2c41841740 1 --2- 172.21.15.92:0/1148658676 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55965a2a1c80 0x55965a2a4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:49.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.493+0000 7f2c41841740 4 client.26828 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:05:49.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.493+0000 7f2c41841740 1 -- 172.21.15.92:0/1148658676 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55965a178d70 con 0x55965a2a1c80 2024-09-19T09:05:49.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.493+0000 7f2c3ca03640 1 --2- 172.21.15.92:0/1148658676 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55965a2a1c80 0x55965a2a4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:49.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.494+0000 7f2c20ff9640 10 client.26828 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:49.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.494+0000 7f2c3ca03640 1 --2- 172.21.15.92:0/1148658676 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55965a2a1c80 0x55965a2a4070 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11837897d6b6f78e server_cookie=17f85717825a8d88 in_seq=0 out_seq=0 2024-09-19T09:05:49.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.494+0000 7f2c20ff9640 1 -- 172.21.15.92:0/1148658676 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55965a178d70 con 0x55965a2a1c80 2024-09-19T09:05:49.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.494+0000 7f2c20ff9640 10 client.26828 handle_command_reply: tid=0 2024-09-19T09:05:49.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.494+0000 7f2c41841740 1 client.26828 shutdown 2024-09-19T09:05:49.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.494+0000 7f2c41841740 1 -- 172.21.15.92:0/1148658676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55965a20b5d0 msgr2=0x55965a21fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:49.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.494+0000 7f2c41841740 1 --2- 172.21.15.92:0/1148658676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55965a20b5d0 0x55965a21fe00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2c34098860 tx=0x7f2c3409bf50 comp rx=0 tx=0).stop 2024-09-19T09:05:49.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.494+0000 7f2c41841740 1 -- 172.21.15.92:0/1148658676 shutdown_connections 2024-09-19T09:05:49.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.494+0000 7f2c41841740 1 --2- 172.21.15.92:0/1148658676 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55965a2a1c80 0x55965a2a4070 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.494+0000 7f2c41841740 1 --2- 172.21.15.92:0/1148658676 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55965a21a780 0x55965a2a0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.494+0000 7f2c41841740 1 --2- 172.21.15.92:0/1148658676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55965a20cb40 0x55965a220340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.494+0000 7f2c41841740 1 --2- 172.21.15.92:0/1148658676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55965a20b5d0 0x55965a21fe00 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.494+0000 7f2c20ff9640 0 client.26828 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:49.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.494+0000 7f2c41841740 1 -- 172.21.15.92:0/1148658676 >> 172.21.15.92:0/1148658676 conn(0x55965a1d4310 msgr2=0x55965a2076e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:49.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.494+0000 7f2c41841740 1 -- 172.21.15.92:0/1148658676 shutdown_connections 2024-09-19T09:05:49.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.494+0000 7f2c41841740 1 -- 172.21.15.92:0/1148658676 wait complete. 2024-09-19T09:05:49.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.495+0000 7f2c41841740 20 client.26828 trim_cache size 0 max 16384 2024-09-19T09:05:49.503 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-19T09:05:49.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.495+0000 7f2c3f468640 1 -- 172.21.15.92:0/1896300818 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2c240a3440 msgr2=0x7f2c240a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:49.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.495+0000 7f2c3f468640 1 --2- 172.21.15.92:0/1896300818 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2c240a3440 0x7f2c240a5900 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2c3002fd90 tx=0x7f2c30005c50 comp rx=0 tx=0).stop 2024-09-19T09:05:49.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.495+0000 7f2c3f468640 1 -- 172.21.15.92:0/1896300818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c38102d50 msgr2=0x7f2c38198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:49.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.495+0000 7f2c3f468640 1 --2- 172.21.15.92:0/1896300818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c38102d50 0x7f2c38198410 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f2c3400e9f0 tx=0x7f2c3400edf0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.495+0000 7f2c3f468640 1 -- 172.21.15.92:0/1896300818 shutdown_connections 2024-09-19T09:05:49.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.495+0000 7f2c3f468640 1 --2- 172.21.15.92:0/1896300818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c3810c180 0x7f2c3819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.495+0000 7f2c3f468640 1 --2- 172.21.15.92:0/1896300818 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2c38103670 0x7f2c38198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.495+0000 7f2c3f468640 1 --2- 172.21.15.92:0/1896300818 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2c240a3440 0x7f2c240a5900 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.495+0000 7f2c3f468640 1 --2- 172.21.15.92:0/1896300818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c38102d50 0x7f2c38198410 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.495+0000 7f2c3f468640 1 -- 172.21.15.92:0/1896300818 >> 172.21.15.92:0/1896300818 conn(0x7f2c380fc7d0 msgr2=0x7f2c380fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:49.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.495+0000 7f2c3f468640 1 -- 172.21.15.92:0/1896300818 shutdown_connections 2024-09-19T09:05:49.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:49.495+0000 7f2c3f468640 1 -- 172.21.15.92:0/1896300818 wait complete. 2024-09-19T09:05:49.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:49 smithi092 ceph-mon[31407]: pgmap v610: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 18 MiB/s wr, 687 op/s 2024-09-19T09:05:49.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:49 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:49.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:49 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:05:49.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:49 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:05:49.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:49 smithi167 ceph-mon[35359]: pgmap v610: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 18 MiB/s wr, 687 op/s 2024-09-19T09:05:49.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:49 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:49.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:49 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:05:49.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:49 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:05:49.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:49 smithi190 ceph-mon[35358]: pgmap v610: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 18 MiB/s wr, 687 op/s 2024-09-19T09:05:49.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:49 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:49.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:49 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:05:49.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:49 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:05:50.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 545.0 s, 2805.4 tps, lat 36.071 ms stddev 40.887 2024-09-19T09:05:51.239 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:05:51.239 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:05:51.775 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:51.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:51 smithi167 ceph-mon[35359]: pgmap v611: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 18 MiB/s wr, 734 op/s 2024-09-19T09:05:51.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:51 smithi190 ceph-mon[35358]: pgmap v611: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 18 MiB/s wr, 734 op/s 2024-09-19T09:05:51.919 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:51 smithi092 ceph-mon[31407]: pgmap v611: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 18 MiB/s wr, 734 op/s 2024-09-19T09:05:52.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.329+0000 7ff8912d0640 1 -- 172.21.15.92:0/2228706021 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff888030940 con 0x7ff88c1008c0 2024-09-19T09:05:52.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.330+0000 7ff894536640 1 -- 172.21.15.92:0/2228706021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff88c1008c0 msgr2=0x7ff88c100ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:52.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.330+0000 7ff894536640 1 --2- 172.21.15.92:0/2228706021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff88c1008c0 0x7ff88c100ca0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7ff888009860 tx=0x7ff88802a340 comp rx=0 tx=0).stop 2024-09-19T09:05:52.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.330+0000 7ff894536640 1 -- 172.21.15.92:0/2228706021 shutdown_connections 2024-09-19T09:05:52.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.330+0000 7ff894536640 1 --2- 172.21.15.92:0/2228706021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff88c105ec0 0x7ff88c106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:52.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.330+0000 7ff894536640 1 --2- 172.21.15.92:0/2228706021 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff88c1011e0 0x7ff88c105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:52.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.330+0000 7ff894536640 1 --2- 172.21.15.92:0/2228706021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff88c1008c0 0x7ff88c100ca0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:52.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.330+0000 7ff894536640 1 -- 172.21.15.92:0/2228706021 >> 172.21.15.92:0/2228706021 conn(0x7ff88c0fc7d0 msgr2=0x7ff88c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:52.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.331+0000 7ff894536640 1 -- 172.21.15.92:0/2228706021 shutdown_connections 2024-09-19T09:05:52.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.331+0000 7ff894536640 1 -- 172.21.15.92:0/2228706021 wait complete. 2024-09-19T09:05:52.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.331+0000 7ff894536640 1 Processor -- start 2024-09-19T09:05:52.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.332+0000 7ff894536640 1 -- start start 2024-09-19T09:05:52.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.332+0000 7ff894536640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff88c1008c0 0x7ff88c114ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:52.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.332+0000 7ff894536640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff88c1011e0 0x7ff88c10df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:52.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.332+0000 7ff894536640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff88c105ec0 0x7ff88c10e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:52.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.332+0000 7ff894536640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff88c118660 con 0x7ff88c105ec0 2024-09-19T09:05:52.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.332+0000 7ff894536640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff88c1184e0 con 0x7ff88c1008c0 2024-09-19T09:05:52.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.332+0000 7ff894536640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff88c1187e0 con 0x7ff88c1011e0 2024-09-19T09:05:52.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.332+0000 7ff8922d2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff88c1008c0 0x7ff88c114ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:52.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.332+0000 7ff8922d2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff88c1008c0 0x7ff88c114ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:60474/0 (socket says 172.21.15.92:60474) 2024-09-19T09:05:52.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.332+0000 7ff8922d2640 1 -- 172.21.15.92:0/3311599224 learned_addr learned my addr 172.21.15.92:0/3311599224 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:52.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.332+0000 7ff892ad3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff88c105ec0 0x7ff88c10e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:52.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.332+0000 7ff8922d2640 1 -- 172.21.15.92:0/3311599224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff88c1011e0 msgr2=0x7ff88c10df30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:05:52.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.332+0000 7ff8922d2640 1 --2- 172.21.15.92:0/3311599224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff88c1011e0 0x7ff88c10df30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:52.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.332+0000 7ff8922d2640 1 -- 172.21.15.92:0/3311599224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff88c105ec0 msgr2=0x7ff88c10e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:52.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.332+0000 7ff8922d2640 1 --2- 172.21.15.92:0/3311599224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff88c105ec0 0x7ff88c10e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:52.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.332+0000 7ff8922d2640 1 -- 172.21.15.92:0/3311599224 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff88c10ebf0 con 0x7ff88c1008c0 2024-09-19T09:05:52.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.333+0000 7ff8922d2640 1 --2- 172.21.15.92:0/3311599224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff88c1008c0 0x7ff88c114ea0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff888009830 tx=0x7ff888032760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:52.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.333+0000 7ff8837fe640 1 -- 172.21.15.92:0/3311599224 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff88803f020 con 0x7ff88c1008c0 2024-09-19T09:05:52.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.333+0000 7ff894536640 1 -- 172.21.15.92:0/3311599224 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff88c1129d0 con 0x7ff88c1008c0 2024-09-19T09:05:52.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.333+0000 7ff8837fe640 1 -- 172.21.15.92:0/3311599224 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff888033b60 con 0x7ff88c1008c0 2024-09-19T09:05:52.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.333+0000 7ff8837fe640 1 -- 172.21.15.92:0/3311599224 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff888037040 con 0x7ff88c1008c0 2024-09-19T09:05:52.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.333+0000 7ff894536640 1 -- 172.21.15.92:0/3311599224 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff88c112eb0 con 0x7ff88c1008c0 2024-09-19T09:05:52.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.336+0000 7ff8837fe640 1 -- 172.21.15.92:0/3311599224 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff888042020 con 0x7ff88c1008c0 2024-09-19T09:05:52.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.336+0000 7ff89690f740 1 Processor -- start 2024-09-19T09:05:52.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.337+0000 7ff89690f740 1 -- start start 2024-09-19T09:05:52.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.337+0000 7ff89690f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593196b2b60 0x5593196b2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:52.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.337+0000 7ff89690f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593196b3480 0x5593196bd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:52.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.337+0000 7ff89690f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593196bdd40 0x5593196c0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:52.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.337+0000 7ff89690f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559319618280 con 0x5593196b3480 2024-09-19T09:05:52.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.337+0000 7ff89690f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5593195bfb10 con 0x5593196b2b60 2024-09-19T09:05:52.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.337+0000 7ff89690f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x559319614240 con 0x5593196bdd40 2024-09-19T09:05:52.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.337+0000 7ff892ad3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593196b2b60 0x5593196b2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:52.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.337+0000 7ff8922d2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593196b3480 0x5593196bd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:52.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.337+0000 7ff892ad3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593196b2b60 0x5593196b2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:60488/0 (socket says 172.21.15.92:60488) 2024-09-19T09:05:52.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.337+0000 7ff892ad3640 1 -- 172.21.15.92:0/3137172759 learned_addr learned my addr 172.21.15.92:0/3137172759 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:52.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.337+0000 7ff891ad1640 1 --2- 172.21.15.92:0/3137172759 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593196bdd40 0x5593196c0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:52.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.337+0000 7ff892ad3640 1 -- 172.21.15.92:0/3137172759 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593196bdd40 msgr2=0x5593196c0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:52.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.337+0000 7ff892ad3640 1 --2- 172.21.15.92:0/3137172759 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593196bdd40 0x5593196c0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:52.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.337+0000 7ff8837fe640 1 --2- 172.21.15.92:0/3311599224 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff8780b4250 0x7ff8780b6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:52.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.337+0000 7ff892ad3640 1 -- 172.21.15.92:0/3137172759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593196b3480 msgr2=0x5593196bd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:52.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.337+0000 7ff892ad3640 1 --2- 172.21.15.92:0/3137172759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593196b3480 0x5593196bd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:52.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.337+0000 7ff892ad3640 1 -- 172.21.15.92:0/3137172759 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593195cc1f0 con 0x5593196b2b60 2024-09-19T09:05:52.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.338+0000 7ff891ad1640 1 --2- 172.21.15.92:0/3137172759 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593196bdd40 0x5593196c0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:05:52.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.338+0000 7ff8922d2640 1 --2- 172.21.15.92:0/3137172759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593196b3480 0x5593196bd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:52.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.338+0000 7ff8837fe640 1 -- 172.21.15.92:0/3311599224 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff8880efa80 con 0x7ff88c1008c0 2024-09-19T09:05:52.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.338+0000 7ff892ad3640 1 --2- 172.21.15.92:0/3137172759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593196b2b60 0x5593196b2f40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff884009f60 tx=0x7ff884009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5fe3911b2b483ab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:52.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.338+0000 7ff892ad3640 1 --2- 172.21.15.92:0/3311599224 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff8780b4250 0x7ff8780b6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:52.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.338+0000 7ff880ff9640 1 -- 172.21.15.92:0/3137172759 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff884004250 con 0x5593196b2b60 2024-09-19T09:05:52.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.338+0000 7ff880ff9640 1 -- 172.21.15.92:0/3137172759 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff88402de50 con 0x5593196b2b60 2024-09-19T09:05:52.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.338+0000 7ff880ff9640 1 -- 172.21.15.92:0/3137172759 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff88402bc30 con 0x5593196b2b60 2024-09-19T09:05:52.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.339+0000 7ff89690f740 1 -- 172.21.15.92:0/3137172759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593196b2b60 msgr2=0x5593196b2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:52.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.339+0000 7ff89690f740 1 --2- 172.21.15.92:0/3137172759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593196b2b60 0x5593196b2f40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff884009f60 tx=0x7ff884009f90 comp rx=0 tx=0).stop 2024-09-19T09:05:52.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.339+0000 7ff892ad3640 1 --2- 172.21.15.92:0/3311599224 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff8780b4250 0x7ff8780b6710 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff884032000 tx=0x7ff884035000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:52.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.339+0000 7ff89690f740 1 -- 172.21.15.92:0/3137172759 shutdown_connections 2024-09-19T09:05:52.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.339+0000 7ff89690f740 1 --2- 172.21.15.92:0/3137172759 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593196bdd40 0x5593196c0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:52.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.339+0000 7ff89690f740 1 --2- 172.21.15.92:0/3137172759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593196b3480 0x5593196bd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:52.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.339+0000 7ff89690f740 1 --2- 172.21.15.92:0/3137172759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593196b2b60 0x5593196b2f40 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:52.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.339+0000 7ff89690f740 1 -- 172.21.15.92:0/3137172759 >> 172.21.15.92:0/3137172759 conn(0x5593196af0f0 msgr2=0x5593196af4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:52.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.340+0000 7ff89690f740 1 -- 172.21.15.92:0/3137172759 shutdown_connections 2024-09-19T09:05:52.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.340+0000 7ff89690f740 1 -- 172.21.15.92:0/3137172759 wait complete. 2024-09-19T09:05:52.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.340+0000 7ff89690f740 1 -- start start 2024-09-19T09:05:52.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.340+0000 7ff89690f740 1 Processor -- start 2024-09-19T09:05:52.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.340+0000 7ff89690f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593196b2b60 0x5593196bab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:52.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.340+0000 7ff89690f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593196b3480 0x5593196bb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:52.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.340+0000 7ff89690f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593196bdd40 0x5593196bb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:52.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.341+0000 7ff89690f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5593196c0910 con 0x5593196b2b60 2024-09-19T09:05:52.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.341+0000 7ff89690f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5593195d2f10 con 0x5593196b3480 2024-09-19T09:05:52.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.341+0000 7ff8922d2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593196b2b60 0x5593196bab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:52.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.341+0000 7ff89690f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5593196c0a90 con 0x5593196bdd40 2024-09-19T09:05:52.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.341+0000 7ff8922d2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593196b2b60 0x5593196bab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50838/0 (socket says 172.21.15.92:50838) 2024-09-19T09:05:52.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.341+0000 7ff8922d2640 1 -- 172.21.15.92:0/549736854 learned_addr learned my addr 172.21.15.92:0/549736854 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:52.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.341+0000 7ff891ad1640 1 --2- 172.21.15.92:0/549736854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593196b3480 0x5593196bb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:52.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.341+0000 7ff89690f740 10 client.0 _ll_register_callbacks cb 0x55931959ba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:52.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.341+0000 7ff892ad3640 1 --2- 172.21.15.92:0/549736854 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593196bdd40 0x5593196bb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:52.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.341+0000 7ff8922d2640 1 -- 172.21.15.92:0/549736854 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593196bdd40 msgr2=0x5593196bb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:52.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.341+0000 7ff8922d2640 1 --2- 172.21.15.92:0/549736854 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593196bdd40 0x5593196bb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:52.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.341+0000 7ff8922d2640 1 -- 172.21.15.92:0/549736854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593196b3480 msgr2=0x5593196bb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:52.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.341+0000 7ff8922d2640 1 --2- 172.21.15.92:0/549736854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593196b3480 0x5593196bb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:52.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.341+0000 7ff8922d2640 1 -- 172.21.15.92:0/549736854 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593193896a0 con 0x5593196b2b60 2024-09-19T09:05:52.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.341+0000 7ff891ad1640 1 --2- 172.21.15.92:0/549736854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593196b3480 0x5593196bb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:05:52.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.342+0000 7ff8922d2640 1 --2- 172.21.15.92:0/549736854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593196b2b60 0x5593196bab80 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7ff8880b8500 tx=0x7ff88802a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b63ed088d3048e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:52.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.342+0000 7ff875ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:05:52.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.342+0000 7ff875ffb640 1 -- 172.21.15.92:0/549736854 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8880bba00 con 0x5593196b2b60 2024-09-19T09:05:52.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.342+0000 7ff89690f740 1 -- 172.21.15.92:0/549736854 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff88402de50 con 0x5593196b2b60 2024-09-19T09:05:52.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.342+0000 7ff875ffb640 1 -- 172.21.15.92:0/549736854 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff888033d10 con 0x5593196b2b60 2024-09-19T09:05:52.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.343+0000 7ff875ffb640 1 -- 172.21.15.92:0/549736854 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff888030940 con 0x5593196b2b60 2024-09-19T09:05:52.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.343+0000 7ff89690f740 10 client.17481 fetch_fsmap learned FSMap version 19 2024-09-19T09:05:52.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.343+0000 7ff89690f740 1 -- 172.21.15.92:0/549736854 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5593196cc490 con 0x5593196b2b60 2024-09-19T09:05:52.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.344+0000 7ff875ffb640 1 -- 172.21.15.92:0/549736854 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff88402de50 con 0x5593196b2b60 2024-09-19T09:05:52.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.345+0000 7ff875ffb640 1 -- 172.21.15.92:0/549736854 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff8880dace0 con 0x5593196b2b60 2024-09-19T09:05:52.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.345+0000 7ff89690f740 10 client.17481 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:05:52.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.345+0000 7ff89690f740 10 client.17481 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:05:52.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.345+0000 7ff89690f740 20 client.17481 populate_metadata read hostname 'smithi092' 2024-09-19T09:05:52.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.345+0000 7ff89690f740 1 --2- 172.21.15.92:0/549736854 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5593196cd880 0x5593196cfd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:52.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.345+0000 7ff89690f740 4 client.17481 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:05:52.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.345+0000 7ff89690f740 1 -- 172.21.15.92:0/549736854 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593196257f0 con 0x5593196cd880 2024-09-19T09:05:52.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.346+0000 7ff891ad1640 1 --2- 172.21.15.92:0/549736854 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5593196cd880 0x5593196cfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:52.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.346+0000 7ff891ad1640 1 --2- 172.21.15.92:0/549736854 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5593196cd880 0x5593196cfd10 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee2bd836485429b2 server_cookie=804a9a10c2694968 in_seq=0 out_seq=0 2024-09-19T09:05:52.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.346+0000 7ff875ffb640 10 client.17481 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:52.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.348+0000 7ff875ffb640 1 -- 172.21.15.92:0/549736854 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5593196257f0 con 0x5593196cd880 2024-09-19T09:05:52.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.348+0000 7ff875ffb640 10 client.17481 handle_command_reply: tid=0 2024-09-19T09:05:52.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.348+0000 7ff89690f740 1 client.17481 shutdown 2024-09-19T09:05:52.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.348+0000 7ff89690f740 1 -- 172.21.15.92:0/549736854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593196b2b60 msgr2=0x5593196bab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:52.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.348+0000 7ff89690f740 1 --2- 172.21.15.92:0/549736854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593196b2b60 0x5593196bab80 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7ff8880b8500 tx=0x7ff88802a340 comp rx=0 tx=0).stop 2024-09-19T09:05:52.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.349+0000 7ff89690f740 1 -- 172.21.15.92:0/549736854 shutdown_connections 2024-09-19T09:05:52.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.349+0000 7ff89690f740 1 --2- 172.21.15.92:0/549736854 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5593196cd880 0x5593196cfd10 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:52.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.349+0000 7ff89690f740 1 --2- 172.21.15.92:0/549736854 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593196bdd40 0x5593196bb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:52.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.349+0000 7ff89690f740 1 --2- 172.21.15.92:0/549736854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593196b3480 0x5593196bb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:52.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.349+0000 7ff89690f740 1 --2- 172.21.15.92:0/549736854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593196b2b60 0x5593196bab80 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:52.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.349+0000 7ff89690f740 1 -- 172.21.15.92:0/549736854 >> 172.21.15.92:0/549736854 conn(0x5593196af0f0 msgr2=0x5593196ae270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:52.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.349+0000 7ff875ffb640 0 client.17481 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:52.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.349+0000 7ff89690f740 1 -- 172.21.15.92:0/549736854 shutdown_connections 2024-09-19T09:05:52.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.349+0000 7ff89690f740 1 -- 172.21.15.92:0/549736854 wait complete. 2024-09-19T09:05:52.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.349+0000 7ff89690f740 20 client.17481 trim_cache size 0 max 16384 2024-09-19T09:05:52.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.375+0000 7ff89690f740 1 Processor -- start 2024-09-19T09:05:52.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.375+0000 7ff89690f740 1 -- start start 2024-09-19T09:05:52.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.375+0000 7ff89690f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593196b2b60 0x5593196b5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:52.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.375+0000 7ff89690f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593196b3480 0x5593196bc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:52.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.375+0000 7ff89690f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593196bdd40 0x5593196d55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:52.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.375+0000 7ff89690f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff88c0716f0 con 0x5593196b3480 2024-09-19T09:05:52.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.375+0000 7ff891ad1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593196b3480 0x5593196bc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:52.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.375+0000 7ff89690f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff88c073f90 con 0x5593196bdd40 2024-09-19T09:05:52.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.375+0000 7ff89690f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff88c071d80 con 0x5593196b2b60 2024-09-19T09:05:52.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.375+0000 7ff891ad1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593196b3480 0x5593196bc9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50854/0 (socket says 172.21.15.92:50854) 2024-09-19T09:05:52.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.375+0000 7ff891ad1640 1 -- 172.21.15.92:0/2529613969 learned_addr learned my addr 172.21.15.92:0/2529613969 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:52.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.375+0000 7ff8922d2640 1 --2- 172.21.15.92:0/2529613969 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593196b2b60 0x5593196b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:52.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.376+0000 7ff892ad3640 1 --2- 172.21.15.92:0/2529613969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593196bdd40 0x5593196d55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:52.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.376+0000 7ff891ad1640 1 -- 172.21.15.92:0/2529613969 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593196b2b60 msgr2=0x5593196b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:52.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.376+0000 7ff891ad1640 1 --2- 172.21.15.92:0/2529613969 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593196b2b60 0x5593196b5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:52.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.376+0000 7ff891ad1640 1 -- 172.21.15.92:0/2529613969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593196bdd40 msgr2=0x5593196d55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:52.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.376+0000 7ff891ad1640 1 --2- 172.21.15.92:0/2529613969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593196bdd40 0x5593196d55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:52.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.376+0000 7ff891ad1640 1 -- 172.21.15.92:0/2529613969 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593196aa830 con 0x5593196b3480 2024-09-19T09:05:52.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.376+0000 7ff891ad1640 1 --2- 172.21.15.92:0/2529613969 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593196b3480 0x5593196bc9e0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7ff88c10f780 tx=0x7ff87c0054d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf25f4ceed6c349 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:52.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.377+0000 7ff877fff640 1 -- 172.21.15.92:0/2529613969 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff87c0120d0 con 0x5593196b3480 2024-09-19T09:05:52.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.377+0000 7ff877fff640 1 -- 172.21.15.92:0/2529613969 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff87c004b80 con 0x5593196b3480 2024-09-19T09:05:52.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.377+0000 7ff877fff640 1 -- 172.21.15.92:0/2529613969 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff87c003dd0 con 0x5593196b3480 2024-09-19T09:05:52.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.378+0000 7ff89690f740 1 -- 172.21.15.92:0/2529613969 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593196b3480 msgr2=0x5593196bc9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:52.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.378+0000 7ff89690f740 1 --2- 172.21.15.92:0/2529613969 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593196b3480 0x5593196bc9e0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7ff88c10f780 tx=0x7ff87c0054d0 comp rx=0 tx=0).stop 2024-09-19T09:05:52.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.378+0000 7ff89690f740 1 -- 172.21.15.92:0/2529613969 shutdown_connections 2024-09-19T09:05:52.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.378+0000 7ff89690f740 1 --2- 172.21.15.92:0/2529613969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593196bdd40 0x5593196d55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:52.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.378+0000 7ff89690f740 1 --2- 172.21.15.92:0/2529613969 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593196b3480 0x5593196bc9e0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:52.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.378+0000 7ff89690f740 1 --2- 172.21.15.92:0/2529613969 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593196b2b60 0x5593196b5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:52.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.378+0000 7ff89690f740 1 -- 172.21.15.92:0/2529613969 >> 172.21.15.92:0/2529613969 conn(0x5593196af0f0 msgr2=0x5593196bc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:52.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.378+0000 7ff89690f740 1 -- 172.21.15.92:0/2529613969 shutdown_connections 2024-09-19T09:05:52.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.378+0000 7ff89690f740 1 -- 172.21.15.92:0/2529613969 wait complete. 2024-09-19T09:05:52.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.378+0000 7ff89690f740 1 -- start start 2024-09-19T09:05:52.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.379+0000 7ff89690f740 1 Processor -- start 2024-09-19T09:05:52.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.379+0000 7ff89690f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593196b2b60 0x5593196c6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:52.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.379+0000 7ff89690f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593196b3480 0x5593196c14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:52.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.379+0000 7ff89690f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593196bdd40 0x5593196c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:52.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.379+0000 7ff8922d2640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593196b2b60 0x5593196c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:52.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.379+0000 7ff8922d2640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593196b2b60 0x5593196c6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:49108/0 (socket says 172.21.15.92:49108) 2024-09-19T09:05:52.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.379+0000 7ff8922d2640 1 -- 172.21.15.92:0/1736210099 learned_addr learned my addr 172.21.15.92:0/1736210099 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:52.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.379+0000 7ff89690f740 1 -- 172.21.15.92:0/1736210099 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff88c072450 con 0x5593196bdd40 2024-09-19T09:05:52.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.379+0000 7ff89690f740 1 -- 172.21.15.92:0/1736210099 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff88c0738c0 con 0x5593196b3480 2024-09-19T09:05:52.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.379+0000 7ff89690f740 1 -- 172.21.15.92:0/1736210099 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff88c072b20 con 0x5593196b2b60 2024-09-19T09:05:52.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.379+0000 7ff892ad3640 1 --2- 172.21.15.92:0/1736210099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593196bdd40 0x5593196c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:52.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.379+0000 7ff891ad1640 1 --2- 172.21.15.92:0/1736210099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593196b3480 0x5593196c14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:52.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.379+0000 7ff89690f740 10 client.0 _ll_register_callbacks cb 0x7ff888005760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:52.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.379+0000 7ff8922d2640 1 -- 172.21.15.92:0/1736210099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593196b3480 msgr2=0x5593196c14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:52.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.379+0000 7ff8922d2640 1 --2- 172.21.15.92:0/1736210099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593196b3480 0x5593196c14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:52.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.379+0000 7ff8922d2640 1 -- 172.21.15.92:0/1736210099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593196bdd40 msgr2=0x5593196c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:52.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.379+0000 7ff8922d2640 1 --2- 172.21.15.92:0/1736210099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593196bdd40 0x5593196c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:52.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.379+0000 7ff8922d2640 1 -- 172.21.15.92:0/1736210099 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593196b32b0 con 0x5593196b2b60 2024-09-19T09:05:52.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.380+0000 7ff891ad1640 1 --2- 172.21.15.92:0/1736210099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593196b3480 0x5593196c14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:52.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.380+0000 7ff8922d2640 1 --2- 172.21.15.92:0/1736210099 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593196b2b60 0x5593196c6170 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff8880d5210 tx=0x7ff888033f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cec3de75ff91364 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:52.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.380+0000 7ff875ffb640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:05:52.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.380+0000 7ff875ffb640 1 -- 172.21.15.92:0/1736210099 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8880bba00 con 0x5593196b2b60 2024-09-19T09:05:52.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.380+0000 7ff875ffb640 1 -- 172.21.15.92:0/1736210099 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff8880bb4f0 con 0x5593196b2b60 2024-09-19T09:05:52.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.380+0000 7ff89690f740 1 -- 172.21.15.92:0/1736210099 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff87c004b80 con 0x5593196b2b60 2024-09-19T09:05:52.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.380+0000 7ff875ffb640 1 -- 172.21.15.92:0/1736210099 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff8880c0240 con 0x5593196b2b60 2024-09-19T09:05:52.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.380+0000 7ff89690f740 10 client.26740 fetch_fsmap learned FSMap version 19 2024-09-19T09:05:52.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.380+0000 7ff89690f740 1 -- 172.21.15.92:0/1736210099 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5593196b32b0 con 0x5593196b2b60 2024-09-19T09:05:52.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.380+0000 7ff875ffb640 1 -- 172.21.15.92:0/1736210099 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff87c004b80 con 0x5593196b2b60 2024-09-19T09:05:52.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.381+0000 7ff875ffb640 1 -- 172.21.15.92:0/1736210099 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff8880dace0 con 0x5593196b2b60 2024-09-19T09:05:52.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.381+0000 7ff89690f740 10 client.26740 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:05:52.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.381+0000 7ff89690f740 10 client.26740 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:05:52.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.381+0000 7ff89690f740 20 client.26740 populate_metadata read hostname 'smithi092' 2024-09-19T09:05:52.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.381+0000 7ff89690f740 1 --2- 172.21.15.92:0/1736210099 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5593197384d0 0x55931973a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:52.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.381+0000 7ff89690f740 4 client.26740 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:05:52.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.381+0000 7ff89690f740 1 -- 172.21.15.92:0/1736210099 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55931961fd00 con 0x5593197384d0 2024-09-19T09:05:52.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.381+0000 7ff891ad1640 1 --2- 172.21.15.92:0/1736210099 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5593197384d0 0x55931973a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:52.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.381+0000 7ff891ad1640 1 --2- 172.21.15.92:0/1736210099 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5593197384d0 0x55931973a8c0 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cea9027839399e2 server_cookie=23fe1668ecea9bec in_seq=0 out_seq=0 2024-09-19T09:05:52.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.381+0000 7ff875ffb640 10 client.26740 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:52.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.384+0000 7ff875ffb640 1 -- 172.21.15.92:0/1736210099 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55931961fd00 con 0x5593197384d0 2024-09-19T09:05:52.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.384+0000 7ff875ffb640 10 client.26740 handle_command_reply: tid=0 2024-09-19T09:05:52.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.384+0000 7ff89690f740 1 client.26740 shutdown 2024-09-19T09:05:52.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.385+0000 7ff89690f740 1 -- 172.21.15.92:0/1736210099 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593196b2b60 msgr2=0x5593196c6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:52.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.385+0000 7ff89690f740 1 --2- 172.21.15.92:0/1736210099 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593196b2b60 0x5593196c6170 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff8880d5210 tx=0x7ff888033f40 comp rx=0 tx=0).stop 2024-09-19T09:05:52.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.385+0000 7ff89690f740 1 -- 172.21.15.92:0/1736210099 shutdown_connections 2024-09-19T09:05:52.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.385+0000 7ff89690f740 1 --2- 172.21.15.92:0/1736210099 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5593197384d0 0x55931973a8c0 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:52.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.385+0000 7ff89690f740 1 --2- 172.21.15.92:0/1736210099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593196bdd40 0x5593196c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:52.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.385+0000 7ff89690f740 1 --2- 172.21.15.92:0/1736210099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5593196b3480 0x5593196c14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:52.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.385+0000 7ff89690f740 1 --2- 172.21.15.92:0/1736210099 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5593196b2b60 0x5593196c6170 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:52.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.385+0000 7ff89690f740 1 -- 172.21.15.92:0/1736210099 >> 172.21.15.92:0/1736210099 conn(0x5593196af0f0 msgr2=0x5593196ae270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:52.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.385+0000 7ff875ffb640 0 client.26740 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:52.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.385+0000 7ff89690f740 1 -- 172.21.15.92:0/1736210099 shutdown_connections 2024-09-19T09:05:52.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.385+0000 7ff89690f740 1 -- 172.21.15.92:0/1736210099 wait complete. 2024-09-19T09:05:52.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.385+0000 7ff89690f740 20 client.26740 trim_cache size 0 max 16384 2024-09-19T09:05:52.388 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:05:52.388 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-19T09:05:52.388 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "c082f2b4-a3ac-4082-9f1f-cee2b7f35f5d", 2024-09-19T09:05:52.388 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-19T09:05:52.388 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:05:52.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.386+0000 7ff894536640 1 -- 172.21.15.92:0/3311599224 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff8780b4250 msgr2=0x7ff8780b6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:52.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.386+0000 7ff894536640 1 --2- 172.21.15.92:0/3311599224 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff8780b4250 0x7ff8780b6710 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff884032000 tx=0x7ff884035000 comp rx=0 tx=0).stop 2024-09-19T09:05:52.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.386+0000 7ff894536640 1 -- 172.21.15.92:0/3311599224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff88c1008c0 msgr2=0x7ff88c114ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:52.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.386+0000 7ff894536640 1 --2- 172.21.15.92:0/3311599224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff88c1008c0 0x7ff88c114ea0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff888009830 tx=0x7ff888032760 comp rx=0 tx=0).stop 2024-09-19T09:05:52.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.386+0000 7ff894536640 1 -- 172.21.15.92:0/3311599224 shutdown_connections 2024-09-19T09:05:52.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.386+0000 7ff894536640 1 --2- 172.21.15.92:0/3311599224 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff8780b4250 0x7ff8780b6710 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:52.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.386+0000 7ff894536640 1 --2- 172.21.15.92:0/3311599224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff88c105ec0 0x7ff88c10e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:52.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.386+0000 7ff894536640 1 --2- 172.21.15.92:0/3311599224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff88c1011e0 0x7ff88c10df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:52.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.386+0000 7ff894536640 1 --2- 172.21.15.92:0/3311599224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff88c1008c0 0x7ff88c114ea0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:52.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.386+0000 7ff894536640 1 -- 172.21.15.92:0/3311599224 >> 172.21.15.92:0/3311599224 conn(0x7ff88c0fc7d0 msgr2=0x7ff88c103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:52.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.387+0000 7ff894536640 1 -- 172.21.15.92:0/3311599224 shutdown_connections 2024-09-19T09:05:52.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:52.387+0000 7ff894536640 1 -- 172.21.15.92:0/3311599224 wait complete. 2024-09-19T09:05:52.794 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T09:05:52.794 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-09-19T09:05:52.795 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:05:53.179 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:05:53.252 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:53.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:53 smithi092 ceph-mon[31407]: scrub queued for path: / 2024-09-19T09:05:53.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:53 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:05:53.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:53 smithi092 ceph-mon[31407]: scrub summary: active paths [/] 2024-09-19T09:05:53.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:53 smithi092 ceph-mon[31407]: pgmap v612: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 20 MiB/s wr, 848 op/s 2024-09-19T09:05:53.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:53 smithi167 ceph-mon[35359]: scrub queued for path: / 2024-09-19T09:05:53.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:53 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:05:53.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:53 smithi167 ceph-mon[35359]: scrub summary: active paths [/] 2024-09-19T09:05:53.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:53 smithi167 ceph-mon[35359]: pgmap v612: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 20 MiB/s wr, 848 op/s 2024-09-19T09:05:53.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:53 smithi190 ceph-mon[35358]: scrub queued for path: / 2024-09-19T09:05:53.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:53 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:05:53.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:53 smithi190 ceph-mon[35358]: scrub summary: active paths [/] 2024-09-19T09:05:53.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:53 smithi190 ceph-mon[35358]: pgmap v612: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 20 MiB/s wr, 848 op/s 2024-09-19T09:05:53.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.842+0000 7ffb418d0640 1 -- 172.21.15.92:0/83481835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb3c102570 msgr2=0x7ffb3c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:53.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.842+0000 7ffb418d0640 1 --2- 172.21.15.92:0/83481835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb3c102570 0x7ffb3c1029b0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7ffb30009900 tx=0x7ffb3002a480 comp rx=0 tx=0).stop 2024-09-19T09:05:53.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.843+0000 7ffb418d0640 1 -- 172.21.15.92:0/83481835 shutdown_connections 2024-09-19T09:05:53.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.843+0000 7ffb418d0640 1 --2- 172.21.15.92:0/83481835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb3c102ef0 0x7ffb3c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:53.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.843+0000 7ffb418d0640 1 --2- 172.21.15.92:0/83481835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb3c102570 0x7ffb3c1029b0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:53.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.843+0000 7ffb418d0640 1 --2- 172.21.15.92:0/83481835 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb3c100e20 0x7ffb3c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:53.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.843+0000 7ffb418d0640 1 -- 172.21.15.92:0/83481835 >> 172.21.15.92:0/83481835 conn(0x7ffb3c0fc7d0 msgr2=0x7ffb3c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:53.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.843+0000 7ffb418d0640 1 -- 172.21.15.92:0/83481835 shutdown_connections 2024-09-19T09:05:53.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.843+0000 7ffb418d0640 1 -- 172.21.15.92:0/83481835 wait complete. 2024-09-19T09:05:53.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.844+0000 7ffb418d0640 1 Processor -- start 2024-09-19T09:05:53.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.844+0000 7ffb418d0640 1 -- start start 2024-09-19T09:05:53.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.844+0000 7ffb418d0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb3c100e20 0x7ffb3c1a47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:53.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.844+0000 7ffb418d0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb3c102570 0x7ffb3c1a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:53.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.844+0000 7ffb418d0640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb3c102ef0 0x7ffb3c19ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:53.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.844+0000 7ffb418d0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffb3c110f80 con 0x7ffb3c100e20 2024-09-19T09:05:53.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.844+0000 7ffb418d0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ffb3c110e00 con 0x7ffb3c102570 2024-09-19T09:05:53.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.844+0000 7ffb418d0640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ffb3c111100 con 0x7ffb3c102ef0 2024-09-19T09:05:53.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.845+0000 7ffb3affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb3c100e20 0x7ffb3c1a47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:53.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.845+0000 7ffb3affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb3c100e20 0x7ffb3c1a47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50894/0 (socket says 172.21.15.92:50894) 2024-09-19T09:05:53.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.845+0000 7ffb3a7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb3c102570 0x7ffb3c1a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:53.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.845+0000 7ffb3affd640 1 -- 172.21.15.92:0/2264695435 learned_addr learned my addr 172.21.15.92:0/2264695435 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:53.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.845+0000 7ffb3affd640 1 -- 172.21.15.92:0/2264695435 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb3c102ef0 msgr2=0x7ffb3c19ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:53.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.845+0000 7ffb3affd640 1 --2- 172.21.15.92:0/2264695435 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb3c102ef0 0x7ffb3c19ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:53.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.845+0000 7ffb3affd640 1 -- 172.21.15.92:0/2264695435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb3c102570 msgr2=0x7ffb3c1a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:53.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.845+0000 7ffb3affd640 1 --2- 172.21.15.92:0/2264695435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb3c102570 0x7ffb3c1a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:53.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.845+0000 7ffb3affd640 1 -- 172.21.15.92:0/2264695435 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb3c19f3f0 con 0x7ffb3c100e20 2024-09-19T09:05:53.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.845+0000 7ffb3a7fc640 1 --2- 172.21.15.92:0/2264695435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb3c102570 0x7ffb3c1a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:05:53.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.846+0000 7ffb3affd640 1 --2- 172.21.15.92:0/2264695435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb3c100e20 0x7ffb3c1a47d0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c00e9f0 tx=0x7ffb2c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:53.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.846+0000 7ffb408ce640 1 -- 172.21.15.92:0/2264695435 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c00cd80 con 0x7ffb3c100e20 2024-09-19T09:05:53.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.846+0000 7ffb408ce640 1 -- 172.21.15.92:0/2264695435 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb2c005500 con 0x7ffb3c100e20 2024-09-19T09:05:53.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.846+0000 7ffb418d0640 1 -- 172.21.15.92:0/2264695435 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb3c19f6e0 con 0x7ffb3c100e20 2024-09-19T09:05:53.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.847+0000 7ffb418d0640 1 -- 172.21.15.92:0/2264695435 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb3c1ab610 con 0x7ffb3c100e20 2024-09-19T09:05:53.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.847+0000 7ffb408ce640 1 -- 172.21.15.92:0/2264695435 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c010690 con 0x7ffb3c100e20 2024-09-19T09:05:53.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.851+0000 7ffb408ce640 1 -- 172.21.15.92:0/2264695435 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ffb2c010830 con 0x7ffb3c100e20 2024-09-19T09:05:53.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.851+0000 7ffb408ce640 1 --2- 172.21.15.92:0/2264695435 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffb240a3390 0x7ffb240a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:53.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.852+0000 7ffb3a7fc640 1 --2- 172.21.15.92:0/2264695435 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffb240a3390 0x7ffb240a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:53.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.857+0000 7ffb3a7fc640 1 --2- 172.21.15.92:0/2264695435 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffb240a3390 0x7ffb240a5850 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ffb30009230 tx=0x7ffb300058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:53.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.858+0000 7ffb408ce640 1 -- 172.21.15.92:0/2264695435 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ffb2c09a1b0 con 0x7ffb3c100e20 2024-09-19T09:05:53.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.859+0000 7ffb418d0640 1 -- 172.21.15.92:0/2264695435 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb28005290 con 0x7ffb3c100e20 2024-09-19T09:05:53.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:53.869+0000 7ffb408ce640 1 -- 172.21.15.92:0/2264695435 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffb2c09c810 con 0x7ffb3c100e20 2024-09-19T09:05:53.957 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:54.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.174+0000 7ffb418d0640 1 -- 172.21.15.92:0/2264695435 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb28005580 con 0x7ffb3c100e20 2024-09-19T09:05:54.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.175+0000 7ffb408ce640 1 -- 172.21.15.92:0/2264695435 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7ffb2c09c110 con 0x7ffb3c100e20 2024-09-19T09:05:54.177 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:05:54.177 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:05:54.177 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:05:54.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.177+0000 7ffb418d0640 1 -- 172.21.15.92:0/2264695435 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffb240a3390 msgr2=0x7ffb240a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:54.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.177+0000 7ffb418d0640 1 --2- 172.21.15.92:0/2264695435 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffb240a3390 0x7ffb240a5850 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ffb30009230 tx=0x7ffb300058d0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.177+0000 7ffb418d0640 1 -- 172.21.15.92:0/2264695435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb3c100e20 msgr2=0x7ffb3c1a47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:54.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.177+0000 7ffb418d0640 1 --2- 172.21.15.92:0/2264695435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb3c100e20 0x7ffb3c1a47d0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c00e9f0 tx=0x7ffb2c00edf0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.177+0000 7ffb418d0640 1 -- 172.21.15.92:0/2264695435 shutdown_connections 2024-09-19T09:05:54.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.177+0000 7ffb418d0640 1 --2- 172.21.15.92:0/2264695435 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb3c102ef0 0x7ffb3c19ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.177+0000 7ffb418d0640 1 --2- 172.21.15.92:0/2264695435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb3c102570 0x7ffb3c1a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.177+0000 7ffb418d0640 1 --2- 172.21.15.92:0/2264695435 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffb240a3390 0x7ffb240a5850 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.177+0000 7ffb418d0640 1 --2- 172.21.15.92:0/2264695435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb3c100e20 0x7ffb3c1a47d0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.177+0000 7ffb418d0640 1 -- 172.21.15.92:0/2264695435 >> 172.21.15.92:0/2264695435 conn(0x7ffb3c0fc7d0 msgr2=0x7ffb3c06a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:54.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.178+0000 7ffb418d0640 1 -- 172.21.15.92:0/2264695435 shutdown_connections 2024-09-19T09:05:54.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.178+0000 7ffb418d0640 1 -- 172.21.15.92:0/2264695435 wait complete. 2024-09-19T09:05:54.783 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:54 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:05:54.783 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:54 smithi092 ceph-mon[31407]: scrub summary: idle 2024-09-19T09:05:54.783 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:54 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/2264695435' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:05:54.783 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:54 smithi092 ceph-mon[31407]: pgmap v613: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 37 MiB/s wr, 1.42k op/s 2024-09-19T09:05:54.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.824+0000 7f290c287640 1 -- 172.21.15.92:0/2582308202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29041027a0 msgr2=0x7f29041067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:54.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.824+0000 7f290c287640 1 --2- 172.21.15.92:0/2582308202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29041027a0 0x7f29041067f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f28f4009860 tx=0x7f28f402a340 comp rx=0 tx=0).stop 2024-09-19T09:05:54.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.825+0000 7f290c287640 1 -- 172.21.15.92:0/2582308202 shutdown_connections 2024-09-19T09:05:54.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.825+0000 7f290c287640 1 --2- 172.21.15.92:0/2582308202 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2904106f20 0x7f290410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.825+0000 7f290c287640 1 --2- 172.21.15.92:0/2582308202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29041027a0 0x7f29041067f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.825+0000 7f290c287640 1 --2- 172.21.15.92:0/2582308202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2904101df0 0x7f29041021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.825+0000 7f290c287640 1 -- 172.21.15.92:0/2582308202 >> 172.21.15.92:0/2582308202 conn(0x7f29040fd8b0 msgr2=0x7f29040ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:54.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.825+0000 7f290c287640 1 -- 172.21.15.92:0/2582308202 shutdown_connections 2024-09-19T09:05:54.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.825+0000 7f290c287640 1 -- 172.21.15.92:0/2582308202 wait complete. 2024-09-19T09:05:54.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.826+0000 7f290c287640 1 Processor -- start 2024-09-19T09:05:54.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.826+0000 7f290c287640 1 -- start start 2024-09-19T09:05:54.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.826+0000 7f290c287640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2904101df0 0x7f2904196200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:54.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.826+0000 7f290c287640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29041027a0 0x7f2904196740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:54.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.826+0000 7f290c287640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2904106f20 0x7f290419aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:54.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.826+0000 7f290c287640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f290410fd70 con 0x7f2904101df0 2024-09-19T09:05:54.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.826+0000 7f290c287640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f290410fbf0 con 0x7f29041027a0 2024-09-19T09:05:54.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.826+0000 7f2909822640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29041027a0 0x7f2904196740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:54.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.826+0000 7f290c287640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f290410fef0 con 0x7f2904106f20 2024-09-19T09:05:54.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.826+0000 7f2909822640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29041027a0 0x7f2904196740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:60568/0 (socket says 172.21.15.92:60568) 2024-09-19T09:05:54.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.826+0000 7f290a023640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2904101df0 0x7f2904196200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:54.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.826+0000 7f2909822640 1 -- 172.21.15.92:0/3152240368 learned_addr learned my addr 172.21.15.92:0/3152240368 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:54.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.826+0000 7f290a824640 1 --2- 172.21.15.92:0/3152240368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2904106f20 0x7f290419aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:54.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.827+0000 7f2909822640 1 -- 172.21.15.92:0/3152240368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2904106f20 msgr2=0x7f290419aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:54.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.827+0000 7f2909822640 1 --2- 172.21.15.92:0/3152240368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2904106f20 0x7f290419aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.827+0000 7f2909822640 1 -- 172.21.15.92:0/3152240368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2904101df0 msgr2=0x7f2904196200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:54.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.827+0000 7f2909822640 1 --2- 172.21.15.92:0/3152240368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2904101df0 0x7f2904196200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.827+0000 7f2909822640 1 -- 172.21.15.92:0/3152240368 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f290419b1b0 con 0x7f29041027a0 2024-09-19T09:05:54.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.827+0000 7f290a023640 1 --2- 172.21.15.92:0/3152240368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2904101df0 0x7f2904196200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:05:54.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.827+0000 7f290a824640 1 --2- 172.21.15.92:0/3152240368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2904106f20 0x7f290419aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:05:54.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.827+0000 7f2909822640 1 --2- 172.21.15.92:0/3152240368 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29041027a0 0x7f2904196740 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f28f4035040 tx=0x7f28f4033d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:54.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.827+0000 7f28fb7fe640 1 -- 172.21.15.92:0/3152240368 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f403f020 con 0x7f29041027a0 2024-09-19T09:05:54.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.827+0000 7f28fb7fe640 1 -- 172.21.15.92:0/3152240368 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28f4032770 con 0x7f29041027a0 2024-09-19T09:05:54.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.827+0000 7f290c287640 1 -- 172.21.15.92:0/3152240368 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f290419b440 con 0x7f29041027a0 2024-09-19T09:05:54.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.827+0000 7f290c287640 1 -- 172.21.15.92:0/3152240368 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29041a2d80 con 0x7f29041027a0 2024-09-19T09:05:54.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.828+0000 7f28fb7fe640 1 -- 172.21.15.92:0/3152240368 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f4037040 con 0x7f29041027a0 2024-09-19T09:05:54.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.831+0000 7f290e660740 1 Processor -- start 2024-09-19T09:05:54.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.831+0000 7f290e660740 1 -- start start 2024-09-19T09:05:54.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.831+0000 7f28fb7fe640 1 -- 172.21.15.92:0/3152240368 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f28f4042020 con 0x7f29041027a0 2024-09-19T09:05:54.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.831+0000 7f290e660740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dedd8354a0 0x55dedd835880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:54.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.831+0000 7f290e660740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dedd835dc0 0x55dedd840140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:54.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.831+0000 7f290e660740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dedd840680 0x55dedd842a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:54.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.831+0000 7f290e660740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55dedd79b2e0 con 0x55dedd8354a0 2024-09-19T09:05:54.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.831+0000 7f290e660740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55dedd742ce0 con 0x55dedd840680 2024-09-19T09:05:54.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.831+0000 7f290e660740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55dedd7972a0 con 0x55dedd835dc0 2024-09-19T09:05:54.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.832+0000 7f290a824640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dedd8354a0 0x55dedd835880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:54.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.832+0000 7f290a824640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dedd8354a0 0x55dedd835880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50922/0 (socket says 172.21.15.92:50922) 2024-09-19T09:05:54.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.832+0000 7f290a824640 1 -- 172.21.15.92:0/2303257336 learned_addr learned my addr 172.21.15.92:0/2303257336 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:54.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.832+0000 7f290a023640 1 --2- 172.21.15.92:0/2303257336 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dedd835dc0 0x55dedd840140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:54.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.832+0000 7f2909822640 1 --2- 172.21.15.92:0/2303257336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dedd840680 0x55dedd842a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:54.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.832+0000 7f290a824640 1 -- 172.21.15.92:0/2303257336 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dedd835dc0 msgr2=0x55dedd840140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:54.834 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.832+0000 7f290a824640 1 --2- 172.21.15.92:0/2303257336 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dedd835dc0 0x55dedd840140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.832+0000 7f290a824640 1 -- 172.21.15.92:0/2303257336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dedd840680 msgr2=0x55dedd842a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:54.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.832+0000 7f290a824640 1 --2- 172.21.15.92:0/2303257336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dedd840680 0x55dedd842a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.832+0000 7f290a824640 1 -- 172.21.15.92:0/2303257336 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dedd727440 con 0x55dedd8354a0 2024-09-19T09:05:54.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.832+0000 7f2909822640 1 --2- 172.21.15.92:0/2303257336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dedd840680 0x55dedd842a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:05:54.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.833+0000 7f28fb7fe640 1 --2- 172.21.15.92:0/3152240368 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f28f00a32c0 0x7f28f00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:54.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.833+0000 7f290a824640 1 --2- 172.21.15.92:0/2303257336 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dedd8354a0 0x55dedd835880 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f28fc003c90 tx=0x7f28fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=679ac76826c98e94 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:54.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.833+0000 7f28fb7fe640 1 -- 172.21.15.92:0/3152240368 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f28f40efb90 con 0x7f29041027a0 2024-09-19T09:05:54.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.834+0000 7f290a023640 1 --2- 172.21.15.92:0/3152240368 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f28f00a32c0 0x7f28f00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:54.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.834+0000 7f28f8dea640 1 -- 172.21.15.92:0/2303257336 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28fc004820 con 0x55dedd8354a0 2024-09-19T09:05:54.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.834+0000 7f28f8dea640 1 -- 172.21.15.92:0/2303257336 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28fc003e40 con 0x55dedd8354a0 2024-09-19T09:05:54.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.835+0000 7f290e660740 1 -- 172.21.15.92:0/2303257336 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dedd8354a0 msgr2=0x55dedd835880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:54.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.835+0000 7f290e660740 1 --2- 172.21.15.92:0/2303257336 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dedd8354a0 0x55dedd835880 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f28fc003c90 tx=0x7f28fc009bb0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.835+0000 7f290e660740 1 -- 172.21.15.92:0/2303257336 shutdown_connections 2024-09-19T09:05:54.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.835+0000 7f290e660740 1 --2- 172.21.15.92:0/2303257336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dedd840680 0x55dedd842a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.835+0000 7f290e660740 1 --2- 172.21.15.92:0/2303257336 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dedd835dc0 0x55dedd840140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.835+0000 7f290e660740 1 --2- 172.21.15.92:0/2303257336 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dedd8354a0 0x55dedd835880 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.835+0000 7f290e660740 1 -- 172.21.15.92:0/2303257336 >> 172.21.15.92:0/2303257336 conn(0x55dedd831a30 msgr2=0x55dedd831e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:54.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.836+0000 7f290a023640 1 --2- 172.21.15.92:0/3152240368 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f28f00a32c0 0x7f28f00a5780 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f290000d5c0 tx=0x7f290000f040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:54.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.836+0000 7f290e660740 1 -- 172.21.15.92:0/2303257336 shutdown_connections 2024-09-19T09:05:54.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.836+0000 7f290e660740 1 -- 172.21.15.92:0/2303257336 wait complete. 2024-09-19T09:05:54.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.836+0000 7f290e660740 1 -- start start 2024-09-19T09:05:54.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.836+0000 7f290e660740 1 Processor -- start 2024-09-19T09:05:54.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.837+0000 7f290e660740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dedd8354a0 0x55dedd83fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:54.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.837+0000 7f290e660740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dedd835dc0 0x55dedd83d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:54.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.837+0000 7f290a023640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dedd8354a0 0x55dedd83fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:54.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.837+0000 7f290a023640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dedd8354a0 0x55dedd83fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50928/0 (socket says 172.21.15.92:50928) 2024-09-19T09:05:54.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.837+0000 7f290e660740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dedd840680 0x55dedd83d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:54.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.837+0000 7f290a023640 1 -- 172.21.15.92:0/428504465 learned_addr learned my addr 172.21.15.92:0/428504465 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:54.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.837+0000 7f290e660740 1 -- 172.21.15.92:0/428504465 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55dedd8432f0 con 0x55dedd8354a0 2024-09-19T09:05:54.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.837+0000 7f290e660740 1 -- 172.21.15.92:0/428504465 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55dedd756050 con 0x55dedd835dc0 2024-09-19T09:05:54.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.837+0000 7f290e660740 1 -- 172.21.15.92:0/428504465 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55dedd843470 con 0x55dedd840680 2024-09-19T09:05:54.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.837+0000 7f290e660740 10 client.0 _ll_register_callbacks cb 0x55dedd796160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:54.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.838+0000 7f290a824640 1 --2- 172.21.15.92:0/428504465 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dedd840680 0x55dedd83d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:54.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.838+0000 7f2909822640 1 --2- 172.21.15.92:0/428504465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dedd835dc0 0x55dedd83d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:54.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.838+0000 7f290a023640 1 -- 172.21.15.92:0/428504465 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dedd840680 msgr2=0x55dedd83d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:54.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.838+0000 7f290a023640 1 --2- 172.21.15.92:0/428504465 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dedd840680 0x55dedd83d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.838+0000 7f290a023640 1 -- 172.21.15.92:0/428504465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dedd835dc0 msgr2=0x55dedd83d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:54.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.838+0000 7f290a023640 1 --2- 172.21.15.92:0/428504465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dedd835dc0 0x55dedd83d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.838+0000 7f290a023640 1 -- 172.21.15.92:0/428504465 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dedd50c3c0 con 0x55dedd8354a0 2024-09-19T09:05:54.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.838+0000 7f290a023640 1 --2- 172.21.15.92:0/428504465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dedd8354a0 0x55dedd83fea0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f29000038a0 tx=0x7f2900004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca43cee32a7b56a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:54.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.838+0000 7f28edffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:05:54.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.839+0000 7f28edffb640 1 -- 172.21.15.92:0/428504465 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2900028060 con 0x55dedd8354a0 2024-09-19T09:05:54.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.840+0000 7f290e660740 1 -- 172.21.15.92:0/428504465 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dedd7a8850 con 0x55dedd8354a0 2024-09-19T09:05:54.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.840+0000 7f28edffb640 1 -- 172.21.15.92:0/428504465 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2900003d60 con 0x55dedd8354a0 2024-09-19T09:05:54.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.841+0000 7f28edffb640 1 -- 172.21.15.92:0/428504465 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f290001f040 con 0x55dedd8354a0 2024-09-19T09:05:54.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.841+0000 7f290e660740 10 client.17502 fetch_fsmap learned FSMap version 19 2024-09-19T09:05:54.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.841+0000 7f290e660740 1 -- 172.21.15.92:0/428504465 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55dedd85fc40 con 0x55dedd8354a0 2024-09-19T09:05:54.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.842+0000 7f28edffb640 1 -- 172.21.15.92:0/428504465 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55dedd7a8850 con 0x55dedd8354a0 2024-09-19T09:05:54.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.842+0000 7f28edffb640 1 -- 172.21.15.92:0/428504465 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f290002d070 con 0x55dedd8354a0 2024-09-19T09:05:54.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.842+0000 7f290e660740 10 client.17502 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:05:54.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.842+0000 7f290e660740 10 client.17502 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:05:54.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.842+0000 7f290e660740 20 client.17502 populate_metadata read hostname 'smithi092' 2024-09-19T09:05:54.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.842+0000 7f290e660740 1 --2- 172.21.15.92:0/428504465 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55dedd8613e0 0x55dedd863850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:54.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.842+0000 7f290e660740 4 client.17502 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:05:54.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.842+0000 7f290e660740 1 -- 172.21.15.92:0/428504465 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dedd7a2d60 con 0x55dedd8613e0 2024-09-19T09:05:54.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.843+0000 7f2909822640 1 --2- 172.21.15.92:0/428504465 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55dedd8613e0 0x55dedd863850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:54.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.843+0000 7f28edffb640 10 client.17502 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:54.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.843+0000 7f2909822640 1 --2- 172.21.15.92:0/428504465 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55dedd8613e0 0x55dedd863850 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60fca38c50b99632 server_cookie=2a0c981a1979f3f2 in_seq=0 out_seq=0 2024-09-19T09:05:54.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.844+0000 7f28edffb640 1 -- 172.21.15.92:0/428504465 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dedd7a2d60 con 0x55dedd8613e0 2024-09-19T09:05:54.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.844+0000 7f28edffb640 10 client.17502 handle_command_reply: tid=0 2024-09-19T09:05:54.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.844+0000 7f290e660740 1 client.17502 shutdown 2024-09-19T09:05:54.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.845+0000 7f290e660740 1 -- 172.21.15.92:0/428504465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dedd8354a0 msgr2=0x55dedd83fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:54.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.845+0000 7f290e660740 1 --2- 172.21.15.92:0/428504465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dedd8354a0 0x55dedd83fea0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f29000038a0 tx=0x7f2900004730 comp rx=0 tx=0).stop 2024-09-19T09:05:54.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.845+0000 7f290e660740 1 -- 172.21.15.92:0/428504465 shutdown_connections 2024-09-19T09:05:54.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.845+0000 7f290e660740 1 --2- 172.21.15.92:0/428504465 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55dedd8613e0 0x55dedd863850 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.845+0000 7f290e660740 1 --2- 172.21.15.92:0/428504465 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dedd840680 0x55dedd83d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.845+0000 7f290e660740 1 --2- 172.21.15.92:0/428504465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dedd835dc0 0x55dedd83d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.845+0000 7f290e660740 1 --2- 172.21.15.92:0/428504465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dedd8354a0 0x55dedd83fea0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.845+0000 7f290e660740 1 -- 172.21.15.92:0/428504465 >> 172.21.15.92:0/428504465 conn(0x55dedd831a30 msgr2=0x55dedd830b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:54.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.845+0000 7f28edffb640 0 client.17502 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:54.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.847+0000 7f290e660740 1 -- 172.21.15.92:0/428504465 shutdown_connections 2024-09-19T09:05:54.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.847+0000 7f290e660740 1 -- 172.21.15.92:0/428504465 wait complete. 2024-09-19T09:05:54.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.847+0000 7f290e660740 20 client.17502 trim_cache size 0 max 16384 2024-09-19T09:05:54.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:54 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:05:54.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:54 smithi167 ceph-mon[35359]: scrub summary: idle 2024-09-19T09:05:54.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:54 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/2264695435' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:05:54.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:54 smithi167 ceph-mon[35359]: pgmap v613: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 37 MiB/s wr, 1.42k op/s 2024-09-19T09:05:54.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:54 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:05:54.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:54 smithi190 ceph-mon[35358]: scrub summary: idle 2024-09-19T09:05:54.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:54 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/2264695435' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:05:54.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:54 smithi190 ceph-mon[35358]: pgmap v613: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 37 MiB/s wr, 1.42k op/s 2024-09-19T09:05:54.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.875+0000 7f290e660740 1 Processor -- start 2024-09-19T09:05:54.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.875+0000 7f290e660740 1 -- start start 2024-09-19T09:05:54.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.875+0000 7f290e660740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dedd8354a0 0x55dedd83d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:54.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.875+0000 7f290e660740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dedd835dc0 0x55dedd83f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:54.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.875+0000 7f290e660740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dedd840680 0x55dedd869160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:54.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.875+0000 7f290e660740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f29041a9450 con 0x55dedd840680 2024-09-19T09:05:54.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.875+0000 7f290e660740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f29041abcf0 con 0x55dedd8354a0 2024-09-19T09:05:54.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.875+0000 7f290e660740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f29041a9ae0 con 0x55dedd835dc0 2024-09-19T09:05:54.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.875+0000 7f290a824640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dedd840680 0x55dedd869160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:54.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.875+0000 7f290a023640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dedd8354a0 0x55dedd83d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:54.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.875+0000 7f290a824640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dedd840680 0x55dedd869160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50932/0 (socket says 172.21.15.92:50932) 2024-09-19T09:05:54.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.875+0000 7f290a023640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dedd8354a0 0x55dedd83d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:60578/0 (socket says 172.21.15.92:60578) 2024-09-19T09:05:54.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.875+0000 7f2909822640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dedd835dc0 0x55dedd83f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:54.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.875+0000 7f290a824640 1 -- 172.21.15.92:0/3302588141 learned_addr learned my addr 172.21.15.92:0/3302588141 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:54.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.876+0000 7f2909822640 1 -- 172.21.15.92:0/3302588141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dedd8354a0 msgr2=0x55dedd83d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:54.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.876+0000 7f2909822640 1 --2- 172.21.15.92:0/3302588141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dedd8354a0 0x55dedd83d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.876+0000 7f2909822640 1 -- 172.21.15.92:0/3302588141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dedd840680 msgr2=0x55dedd869160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:54.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.876+0000 7f2909822640 1 --2- 172.21.15.92:0/3302588141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dedd840680 0x55dedd869160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.876+0000 7f2909822640 1 -- 172.21.15.92:0/3302588141 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dedd83c100 con 0x55dedd835dc0 2024-09-19T09:05:54.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.876+0000 7f2909822640 1 --2- 172.21.15.92:0/3302588141 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dedd835dc0 0x55dedd83f0c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x55dedd832db0 tx=0x7f28f4005dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bba13559baea4e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:54.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.877+0000 7f28effff640 1 -- 172.21.15.92:0/3302588141 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f40c4de0 con 0x55dedd835dc0 2024-09-19T09:05:54.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.877+0000 7f28effff640 1 -- 172.21.15.92:0/3302588141 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28f40ba470 con 0x55dedd835dc0 2024-09-19T09:05:54.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.877+0000 7f28effff640 1 -- 172.21.15.92:0/3302588141 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f40042d0 con 0x55dedd835dc0 2024-09-19T09:05:54.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.878+0000 7f290e660740 1 -- 172.21.15.92:0/3302588141 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dedd835dc0 msgr2=0x55dedd83f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:54.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.878+0000 7f290e660740 1 --2- 172.21.15.92:0/3302588141 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dedd835dc0 0x55dedd83f0c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x55dedd832db0 tx=0x7f28f4005dc0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.879+0000 7f290e660740 1 -- 172.21.15.92:0/3302588141 shutdown_connections 2024-09-19T09:05:54.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.879+0000 7f290e660740 1 --2- 172.21.15.92:0/3302588141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dedd840680 0x55dedd869160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.879+0000 7f290e660740 1 --2- 172.21.15.92:0/3302588141 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dedd835dc0 0x55dedd83f0c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.879+0000 7f290e660740 1 --2- 172.21.15.92:0/3302588141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dedd8354a0 0x55dedd83d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.879+0000 7f290e660740 1 -- 172.21.15.92:0/3302588141 >> 172.21.15.92:0/3302588141 conn(0x55dedd831a30 msgr2=0x55dedd83e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:54.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.879+0000 7f290e660740 1 -- 172.21.15.92:0/3302588141 shutdown_connections 2024-09-19T09:05:54.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.879+0000 7f290e660740 1 -- 172.21.15.92:0/3302588141 wait complete. 2024-09-19T09:05:54.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.880+0000 7f290e660740 1 -- start start 2024-09-19T09:05:54.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.880+0000 7f290e660740 1 Processor -- start 2024-09-19T09:05:54.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.880+0000 7f290e660740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dedd8354a0 0x55dedd848d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:54.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.880+0000 7f290e660740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dedd835dc0 0x55dedd844080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:54.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.880+0000 7f290a023640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dedd8354a0 0x55dedd848d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:54.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.881+0000 7f290a023640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dedd8354a0 0x55dedd848d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:49200/0 (socket says 172.21.15.92:49200) 2024-09-19T09:05:54.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.881+0000 7f290a023640 1 -- 172.21.15.92:0/50940457 learned_addr learned my addr 172.21.15.92:0/50940457 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:54.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.881+0000 7f290e660740 1 --2- 172.21.15.92:0/50940457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dedd840680 0x55dedd8445c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:54.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.881+0000 7f290e660740 1 -- 172.21.15.92:0/50940457 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f29041aa1b0 con 0x55dedd835dc0 2024-09-19T09:05:54.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.881+0000 7f290e660740 1 -- 172.21.15.92:0/50940457 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f29041ab620 con 0x55dedd840680 2024-09-19T09:05:54.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.881+0000 7f290e660740 1 -- 172.21.15.92:0/50940457 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f29041aa880 con 0x55dedd8354a0 2024-09-19T09:05:54.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.881+0000 7f290e660740 10 client.0 _ll_register_callbacks cb 0x7f290001c040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:54.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.881+0000 7f290a824640 1 --2- 172.21.15.92:0/50940457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dedd840680 0x55dedd8445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:54.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.881+0000 7f290a824640 1 -- 172.21.15.92:0/50940457 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dedd8354a0 msgr2=0x55dedd848d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:54.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.881+0000 7f290a824640 1 --2- 172.21.15.92:0/50940457 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dedd8354a0 0x55dedd848d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.881+0000 7f290a824640 1 -- 172.21.15.92:0/50940457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dedd835dc0 msgr2=0x55dedd844080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:54.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.881+0000 7f290a824640 1 --2- 172.21.15.92:0/50940457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dedd835dc0 0x55dedd844080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.881+0000 7f290a824640 1 -- 172.21.15.92:0/50940457 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dedd835bf0 con 0x55dedd840680 2024-09-19T09:05:54.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.882+0000 7f290a824640 1 --2- 172.21.15.92:0/50940457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dedd840680 0x55dedd8445c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f28fc003c60 tx=0x7f28fc013a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f8789f318c6f3e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:54.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.882+0000 7f28edffb640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:05:54.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.882+0000 7f28edffb640 1 -- 172.21.15.92:0/50940457 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28fc0134d0 con 0x55dedd840680 2024-09-19T09:05:54.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.882+0000 7f28edffb640 1 -- 172.21.15.92:0/50940457 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f28fc01e5a0 con 0x55dedd840680 2024-09-19T09:05:54.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.882+0000 7f290e660740 1 -- 172.21.15.92:0/50940457 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28f40ba470 con 0x55dedd840680 2024-09-19T09:05:54.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.884+0000 7f28edffb640 1 -- 172.21.15.92:0/50940457 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f28fc01e7a0 con 0x55dedd840680 2024-09-19T09:05:54.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.884+0000 7f290e660740 10 client.26867 fetch_fsmap learned FSMap version 19 2024-09-19T09:05:54.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.884+0000 7f290e660740 1 -- 172.21.15.92:0/50940457 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55dedd8cbda0 con 0x55dedd840680 2024-09-19T09:05:54.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.887+0000 7f28edffb640 1 -- 172.21.15.92:0/50940457 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28fc01ee20 con 0x55dedd840680 2024-09-19T09:05:54.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.887+0000 7f28edffb640 1 -- 172.21.15.92:0/50940457 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f28fc00b040 con 0x55dedd840680 2024-09-19T09:05:54.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.887+0000 7f290e660740 10 client.26867 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:05:54.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.887+0000 7f290e660740 10 client.26867 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:05:54.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.887+0000 7f290e660740 20 client.26867 populate_metadata read hostname 'smithi092' 2024-09-19T09:05:54.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.887+0000 7f290e660740 1 --2- 172.21.15.92:0/50940457 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55dedd8cc2a0 0x55dedd8ce760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:54.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.887+0000 7f290e660740 4 client.26867 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:05:54.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.887+0000 7f290e660740 1 -- 172.21.15.92:0/50940457 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f28f40ba470 con 0x55dedd8cc2a0 2024-09-19T09:05:54.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.902+0000 7f290a023640 1 --2- 172.21.15.92:0/50940457 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55dedd8cc2a0 0x55dedd8ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:54.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.912+0000 7f28edffb640 10 client.26867 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:54.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.912+0000 7f290a023640 1 --2- 172.21.15.92:0/50940457 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55dedd8cc2a0 0x55dedd8ce760 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d89e438b9a69a6f server_cookie=15f1dbc09b5d5f4e in_seq=0 out_seq=0 2024-09-19T09:05:54.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.914+0000 7f28edffb640 1 -- 172.21.15.92:0/50940457 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f28f40ba470 con 0x55dedd8cc2a0 2024-09-19T09:05:54.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.914+0000 7f28edffb640 10 client.26867 handle_command_reply: tid=0 2024-09-19T09:05:54.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.914+0000 7f290e660740 1 client.26867 shutdown 2024-09-19T09:05:54.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.914+0000 7f290e660740 1 -- 172.21.15.92:0/50940457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dedd840680 msgr2=0x55dedd8445c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:54.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.914+0000 7f290e660740 1 --2- 172.21.15.92:0/50940457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dedd840680 0x55dedd8445c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f28fc003c60 tx=0x7f28fc013a80 comp rx=0 tx=0).stop 2024-09-19T09:05:54.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.917+0000 7f290e660740 1 -- 172.21.15.92:0/50940457 shutdown_connections 2024-09-19T09:05:54.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.917+0000 7f290e660740 1 --2- 172.21.15.92:0/50940457 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55dedd8cc2a0 0x55dedd8ce760 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.917+0000 7f290e660740 1 --2- 172.21.15.92:0/50940457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dedd840680 0x55dedd8445c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.917+0000 7f28edffb640 0 client.26867 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:54.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.917+0000 7f290e660740 1 --2- 172.21.15.92:0/50940457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dedd835dc0 0x55dedd844080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.917+0000 7f290e660740 1 --2- 172.21.15.92:0/50940457 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55dedd8354a0 0x55dedd848d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.917+0000 7f290e660740 1 -- 172.21.15.92:0/50940457 >> 172.21.15.92:0/50940457 conn(0x55dedd831a30 msgr2=0x55dedd830b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:54.925 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:05:54.925 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-19T09:05:54.925 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {} 2024-09-19T09:05:54.925 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:05:54.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.923+0000 7f290e660740 1 -- 172.21.15.92:0/50940457 shutdown_connections 2024-09-19T09:05:54.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.923+0000 7f290e660740 1 -- 172.21.15.92:0/50940457 wait complete. 2024-09-19T09:05:54.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.923+0000 7f290e660740 20 client.26867 trim_cache size 0 max 16384 2024-09-19T09:05:54.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.924+0000 7f290c287640 1 -- 172.21.15.92:0/3152240368 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f28f00a32c0 msgr2=0x7f28f00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:54.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.924+0000 7f290c287640 1 --2- 172.21.15.92:0/3152240368 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f28f00a32c0 0x7f28f00a5780 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f290000d5c0 tx=0x7f290000f040 comp rx=0 tx=0).stop 2024-09-19T09:05:54.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.924+0000 7f290c287640 1 -- 172.21.15.92:0/3152240368 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29041027a0 msgr2=0x7f2904196740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:54.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.924+0000 7f290c287640 1 --2- 172.21.15.92:0/3152240368 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29041027a0 0x7f2904196740 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f28f4035040 tx=0x7f28f4033d90 comp rx=0 tx=0).stop 2024-09-19T09:05:54.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.924+0000 7f290c287640 1 -- 172.21.15.92:0/3152240368 shutdown_connections 2024-09-19T09:05:54.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.924+0000 7f290c287640 1 --2- 172.21.15.92:0/3152240368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2904106f20 0x7f290419aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.924+0000 7f290c287640 1 --2- 172.21.15.92:0/3152240368 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29041027a0 0x7f2904196740 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.924+0000 7f290c287640 1 --2- 172.21.15.92:0/3152240368 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f28f00a32c0 0x7f28f00a5780 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.924+0000 7f290c287640 1 --2- 172.21.15.92:0/3152240368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2904101df0 0x7f2904196200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:54.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.925+0000 7f290c287640 1 -- 172.21.15.92:0/3152240368 >> 172.21.15.92:0/3152240368 conn(0x7f29040fd8b0 msgr2=0x7f29040fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:54.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.925+0000 7f290c287640 1 -- 172.21.15.92:0/3152240368 shutdown_connections 2024-09-19T09:05:54.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:54.925+0000 7f290c287640 1 -- 172.21.15.92:0/3152240368 wait complete. 2024-09-19T09:05:55.660 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-09-19T09:05:55.660 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-09-19T09:05:55.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 550.0 s, 1885.4 tps, lat 52.956 ms stddev 97.934 2024-09-19T09:05:56.468 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:05:56.468 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:05:56.618 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:57.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.382+0000 7f83181ff640 1 -- 172.21.15.92:0/3648477631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8310102df0 msgr2=0x7f83101031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:57.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.382+0000 7f83181ff640 1 --2- 172.21.15.92:0/3648477631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8310102df0 0x7f83101031d0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f830c009900 tx=0x7f830c02a440 comp rx=0 tx=0).stop 2024-09-19T09:05:57.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.382+0000 7f83181ff640 1 -- 172.21.15.92:0/3648477631 shutdown_connections 2024-09-19T09:05:57.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.382+0000 7f83181ff640 1 --2- 172.21.15.92:0/3648477631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f831010c2f0 0x7f831010e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:57.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.382+0000 7f83181ff640 1 --2- 172.21.15.92:0/3648477631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83101037a0 0x7f831010bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:57.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.382+0000 7f83181ff640 1 --2- 172.21.15.92:0/3648477631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8310102df0 0x7f83101031d0 secure :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f830c009900 tx=0x7f830c02a440 comp rx=0 tx=0).stop 2024-09-19T09:05:57.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.382+0000 7f83181ff640 1 -- 172.21.15.92:0/3648477631 >> 172.21.15.92:0/3648477631 conn(0x7f83100fc7d0 msgr2=0x7f83100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:57.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.389+0000 7f83181ff640 1 -- 172.21.15.92:0/3648477631 shutdown_connections 2024-09-19T09:05:57.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.389+0000 7f83181ff640 1 -- 172.21.15.92:0/3648477631 wait complete. 2024-09-19T09:05:57.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.390+0000 7f83181ff640 1 Processor -- start 2024-09-19T09:05:57.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.391+0000 7f83181ff640 1 -- start start 2024-09-19T09:05:57.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.391+0000 7f83181ff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83101037a0 0x7f831010baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:57.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.391+0000 7f83181ff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f831010c2f0 0x7f8310106b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:57.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.391+0000 7f83181ff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83101070c0 0x7f8310107550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:57.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.391+0000 7f83181ff640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8310112240 con 0x7f83101070c0 2024-09-19T09:05:57.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.392+0000 7f83181ff640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f83101120c0 con 0x7f831010c2f0 2024-09-19T09:05:57.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.392+0000 7f83181ff640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f83101123c0 con 0x7f83101037a0 2024-09-19T09:05:57.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.392+0000 7f831579a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f831010c2f0 0x7f8310106b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:57.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.392+0000 7f831579a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f831010c2f0 0x7f8310106b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:60594/0 (socket says 172.21.15.92:60594) 2024-09-19T09:05:57.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.392+0000 7f831579a640 1 -- 172.21.15.92:0/3969159615 learned_addr learned my addr 172.21.15.92:0/3969159615 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:57.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.396+0000 7f8315f9b640 1 --2- 172.21.15.92:0/3969159615 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83101037a0 0x7f831010baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:57.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.396+0000 7f831579a640 1 -- 172.21.15.92:0/3969159615 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83101037a0 msgr2=0x7f831010baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:57.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.396+0000 7f831579a640 1 --2- 172.21.15.92:0/3969159615 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83101037a0 0x7f831010baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:57.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.396+0000 7f831579a640 1 -- 172.21.15.92:0/3969159615 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83101070c0 msgr2=0x7f8310107550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:57.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.396+0000 7f831579a640 1 --2- 172.21.15.92:0/3969159615 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83101070c0 0x7f8310107550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:57.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.396+0000 7f831579a640 1 -- 172.21.15.92:0/3969159615 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83101ab5b0 con 0x7f831010c2f0 2024-09-19T09:05:57.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.404+0000 7f831579a640 1 --2- 172.21.15.92:0/3969159615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f831010c2f0 0x7f8310106b80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f830000b450 tx=0x7f830000b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:57.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.406+0000 7f8306ffd640 1 -- 172.21.15.92:0/3969159615 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8300015020 con 0x7f831010c2f0 2024-09-19T09:05:57.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.406+0000 7f8306ffd640 1 -- 172.21.15.92:0/3969159615 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8300011d70 con 0x7f831010c2f0 2024-09-19T09:05:57.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.407+0000 7f8306ffd640 1 -- 172.21.15.92:0/3969159615 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830000f340 con 0x7f831010c2f0 2024-09-19T09:05:57.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.410+0000 7f83181ff640 1 -- 172.21.15.92:0/3969159615 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83101ab8a0 con 0x7f831010c2f0 2024-09-19T09:05:57.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.410+0000 7f83181ff640 1 -- 172.21.15.92:0/3969159615 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83101abd60 con 0x7f831010c2f0 2024-09-19T09:05:57.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.413+0000 7f831a5d8740 1 Processor -- start 2024-09-19T09:05:57.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.415+0000 7f831a5d8740 1 -- start start 2024-09-19T09:05:57.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.415+0000 7f831a5d8740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562469e66760 0x562469e66b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:57.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.416+0000 7f831a5d8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562469e67080 0x562469e71400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:57.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.416+0000 7f831a5d8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562469e71940 0x562469e73d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:57.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.416+0000 7f831a5d8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562469dcc2a0 con 0x562469e71940 2024-09-19T09:05:57.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.416+0000 7f831a5d8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x562469d73b10 con 0x562469e67080 2024-09-19T09:05:57.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.416+0000 7f831a5d8740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x562469dc8260 con 0x562469e66760 2024-09-19T09:05:57.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.416+0000 7f8315f9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562469e67080 0x562469e71400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:57.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.416+0000 7f8315f9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562469e67080 0x562469e71400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:60602/0 (socket says 172.21.15.92:60602) 2024-09-19T09:05:57.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.416+0000 7f8315f9b640 1 -- 172.21.15.92:0/1203859344 learned_addr learned my addr 172.21.15.92:0/1203859344 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:57.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.417+0000 7f831679c640 1 --2- 172.21.15.92:0/1203859344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562469e66760 0x562469e66b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:57.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.417+0000 7f8315f9b640 1 -- 172.21.15.92:0/1203859344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562469e66760 msgr2=0x562469e66b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:57.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.417+0000 7f8315f9b640 1 --2- 172.21.15.92:0/1203859344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562469e66760 0x562469e66b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:57.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.417+0000 7f8315f9b640 1 -- 172.21.15.92:0/1203859344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562469e71940 msgr2=0x562469e73d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:05:57.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.417+0000 7f8315f9b640 1 --2- 172.21.15.92:0/1203859344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562469e71940 0x562469e73d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:57.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.417+0000 7f8315f9b640 1 -- 172.21.15.92:0/1203859344 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562469b3db90 con 0x562469e67080 2024-09-19T09:05:57.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.417+0000 7f831679c640 1 --2- 172.21.15.92:0/1203859344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562469e66760 0x562469e66b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:57.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.418+0000 7f8315f9b640 1 --2- 172.21.15.92:0/1203859344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562469e67080 0x562469e71400 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f830c006010 tx=0x7f830c004170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28446466a32625bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:57.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.419+0000 7f82fbfff640 1 -- 172.21.15.92:0/1203859344 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830c03f020 con 0x562469e67080 2024-09-19T09:05:57.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.419+0000 7f82fbfff640 1 -- 172.21.15.92:0/1203859344 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f830c005520 con 0x562469e67080 2024-09-19T09:05:57.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.419+0000 7f82fbfff640 1 -- 172.21.15.92:0/1203859344 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830c035070 con 0x562469e67080 2024-09-19T09:05:57.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.419+0000 7f8306ffd640 1 -- 172.21.15.92:0/3969159615 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8300018020 con 0x7f831010c2f0 2024-09-19T09:05:57.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.420+0000 7f831a5d8740 1 -- 172.21.15.92:0/1203859344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562469e67080 msgr2=0x562469e71400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:57.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.420+0000 7f831a5d8740 1 --2- 172.21.15.92:0/1203859344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562469e67080 0x562469e71400 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f830c006010 tx=0x7f830c004170 comp rx=0 tx=0).stop 2024-09-19T09:05:57.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.420+0000 7f831a5d8740 1 -- 172.21.15.92:0/1203859344 shutdown_connections 2024-09-19T09:05:57.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.420+0000 7f831a5d8740 1 --2- 172.21.15.92:0/1203859344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562469e71940 0x562469e73d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:57.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.420+0000 7f831a5d8740 1 --2- 172.21.15.92:0/1203859344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562469e67080 0x562469e71400 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:57.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.420+0000 7f831a5d8740 1 --2- 172.21.15.92:0/1203859344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562469e66760 0x562469e66b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:57.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.420+0000 7f831a5d8740 1 -- 172.21.15.92:0/1203859344 >> 172.21.15.92:0/1203859344 conn(0x562469e62cf0 msgr2=0x562469e630d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:57.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.421+0000 7f8306ffd640 1 --2- 172.21.15.92:0/3969159615 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f82fc0a31f0 0x7f82fc0a56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:57.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.421+0000 7f8315f9b640 1 --2- 172.21.15.92:0/3969159615 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f82fc0a31f0 0x7f82fc0a56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:57.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.421+0000 7f8306ffd640 1 -- 172.21.15.92:0/3969159615 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f83000cf180 con 0x7f831010c2f0 2024-09-19T09:05:57.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.423+0000 7f831a5d8740 1 -- 172.21.15.92:0/1203859344 shutdown_connections 2024-09-19T09:05:57.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.425+0000 7f831a5d8740 1 -- 172.21.15.92:0/1203859344 wait complete. 2024-09-19T09:05:57.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.425+0000 7f831a5d8740 1 -- start start 2024-09-19T09:05:57.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.425+0000 7f831a5d8740 1 Processor -- start 2024-09-19T09:05:57.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.426+0000 7f831a5d8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562469e66760 0x562469e6e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:57.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.426+0000 7f831a5d8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562469e67080 0x562469e6edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:57.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.426+0000 7f831a5d8740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562469e71940 0x562469e6f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:57.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.426+0000 7f831a5d8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562469e85520 con 0x562469e66760 2024-09-19T09:05:57.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.426+0000 7f831a5d8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x562469d546e0 con 0x562469e67080 2024-09-19T09:05:57.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.426+0000 7f831a5d8740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x562469e856a0 con 0x562469e71940 2024-09-19T09:05:57.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.426+0000 7f831a5d8740 10 client.0 _ll_register_callbacks cb 0x562469d78a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:57.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.427+0000 7f831579a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562469e67080 0x562469e6edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:57.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.427+0000 7f831579a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562469e67080 0x562469e6edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:60608/0 (socket says 172.21.15.92:60608) 2024-09-19T09:05:57.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.427+0000 7f831579a640 1 -- 172.21.15.92:0/502093231 learned_addr learned my addr 172.21.15.92:0/502093231 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:57.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.427+0000 7f831679c640 1 --2- 172.21.15.92:0/502093231 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562469e71940 0x562469e6f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:57.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.428+0000 7f831579a640 1 -- 172.21.15.92:0/502093231 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562469e71940 msgr2=0x562469e6f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:57.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.428+0000 7f831579a640 1 --2- 172.21.15.92:0/502093231 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562469e71940 0x562469e6f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:57.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.428+0000 7f831579a640 1 -- 172.21.15.92:0/502093231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562469e66760 msgr2=0x562469e6e880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:05:57.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.428+0000 7f831579a640 1 --2- 172.21.15.92:0/502093231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562469e66760 0x562469e6e880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:57.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.428+0000 7f831579a640 1 -- 172.21.15.92:0/502093231 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562469e9faa0 con 0x562469e67080 2024-09-19T09:05:57.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.429+0000 7f831579a640 1 --2- 172.21.15.92:0/502093231 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562469e67080 0x562469e6edc0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8300097bc0 tx=0x7f830009bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99e85885e2789226 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:57.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.429+0000 7f82f97fa640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:05:57.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.429+0000 7f82f97fa640 1 -- 172.21.15.92:0/502093231 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83000a4140 con 0x562469e67080 2024-09-19T09:05:57.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.429+0000 7f831a5d8740 1 -- 172.21.15.92:0/502093231 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f830c005520 con 0x562469e67080 2024-09-19T09:05:57.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.430+0000 7f82f97fa640 1 -- 172.21.15.92:0/502093231 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8300017b70 con 0x562469e67080 2024-09-19T09:05:57.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.434+0000 7f8315f9b640 1 --2- 172.21.15.92:0/3969159615 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f82fc0a31f0 0x7f82fc0a56b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f830c004ca0 tx=0x7f830c02a440 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:57.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.434+0000 7f82f97fa640 1 -- 172.21.15.92:0/502093231 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f83000a43d0 con 0x562469e67080 2024-09-19T09:05:57.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.434+0000 7f831a5d8740 10 client.26876 fetch_fsmap learned FSMap version 19 2024-09-19T09:05:57.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.434+0000 7f831a5d8740 1 -- 172.21.15.92:0/502093231 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x562469ea24e0 con 0x562469e67080 2024-09-19T09:05:57.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.434+0000 7f82f97fa640 1 -- 172.21.15.92:0/502093231 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f830c005520 con 0x562469e67080 2024-09-19T09:05:57.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.435+0000 7f82f97fa640 1 -- 172.21.15.92:0/502093231 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f8300022060 con 0x562469e67080 2024-09-19T09:05:57.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.435+0000 7f831a5d8740 10 client.26876 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:05:57.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.435+0000 7f831a5d8740 10 client.26876 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:05:57.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.435+0000 7f831a5d8740 20 client.26876 populate_metadata read hostname 'smithi092' 2024-09-19T09:05:57.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.435+0000 7f831a5d8740 1 --2- 172.21.15.92:0/502093231 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562469ea38f0 0x562469ea5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:57.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.435+0000 7f831a5d8740 4 client.26876 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:05:57.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.435+0000 7f831a5d8740 1 -- 172.21.15.92:0/502093231 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562469dd99d0 con 0x562469ea38f0 2024-09-19T09:05:57.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.436+0000 7f8315f9b640 1 --2- 172.21.15.92:0/502093231 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562469ea38f0 0x562469ea5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:57.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.437+0000 7f8315f9b640 1 --2- 172.21.15.92:0/502093231 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562469ea38f0 0x562469ea5d10 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49d8392e7dc4a549 server_cookie=688a91c9a0a9f439 in_seq=0 out_seq=0 2024-09-19T09:05:57.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.437+0000 7f82f97fa640 10 client.26876 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:57.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.437+0000 7f82f97fa640 1 -- 172.21.15.92:0/502093231 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562469dd99d0 con 0x562469ea38f0 2024-09-19T09:05:57.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.437+0000 7f82f97fa640 10 client.26876 handle_command_reply: tid=0 2024-09-19T09:05:57.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.438+0000 7f831a5d8740 1 client.26876 shutdown 2024-09-19T09:05:57.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.438+0000 7f831a5d8740 1 -- 172.21.15.92:0/502093231 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562469e67080 msgr2=0x562469e6edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:57.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.438+0000 7f831a5d8740 1 --2- 172.21.15.92:0/502093231 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562469e67080 0x562469e6edc0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8300097bc0 tx=0x7f830009bf20 comp rx=0 tx=0).stop 2024-09-19T09:05:57.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.438+0000 7f831a5d8740 1 -- 172.21.15.92:0/502093231 shutdown_connections 2024-09-19T09:05:57.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.438+0000 7f831a5d8740 1 --2- 172.21.15.92:0/502093231 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562469ea38f0 0x562469ea5d10 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:57.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.438+0000 7f831a5d8740 1 --2- 172.21.15.92:0/502093231 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562469e71940 0x562469e6f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:57.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.438+0000 7f831a5d8740 1 --2- 172.21.15.92:0/502093231 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562469e67080 0x562469e6edc0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:57.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.438+0000 7f831a5d8740 1 --2- 172.21.15.92:0/502093231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562469e66760 0x562469e6e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:57.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.438+0000 7f831a5d8740 1 -- 172.21.15.92:0/502093231 >> 172.21.15.92:0/502093231 conn(0x562469e62cf0 msgr2=0x562469e68a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:57.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.438+0000 7f82f97fa640 0 client.26876 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:57.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.439+0000 7f831a5d8740 1 -- 172.21.15.92:0/502093231 shutdown_connections 2024-09-19T09:05:57.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.439+0000 7f831a5d8740 1 -- 172.21.15.92:0/502093231 wait complete. 2024-09-19T09:05:57.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.439+0000 7f831a5d8740 20 client.26876 trim_cache size 0 max 16384 2024-09-19T09:05:57.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.464+0000 7f831a5d8740 1 Processor -- start 2024-09-19T09:05:57.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.465+0000 7f831a5d8740 1 -- start start 2024-09-19T09:05:57.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.465+0000 7f831a5d8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562469e66760 0x562469e6f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:57.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.465+0000 7f831a5d8740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562469e67080 0x562469e688c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:57.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.465+0000 7f831a5d8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562469e71940 0x562469eab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:57.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.465+0000 7f831a5d8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f831006a790 con 0x562469e66760 2024-09-19T09:05:57.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.465+0000 7f831a5d8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f831006bce0 con 0x562469e71940 2024-09-19T09:05:57.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.465+0000 7f831a5d8740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f83101a22f0 con 0x562469e67080 2024-09-19T09:05:57.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.465+0000 7f8315f9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562469e66760 0x562469e6f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:57.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.465+0000 7f8315f9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562469e66760 0x562469e6f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50966/0 (socket says 172.21.15.92:50966) 2024-09-19T09:05:57.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.465+0000 7f8315f9b640 1 -- 172.21.15.92:0/1629577295 learned_addr learned my addr 172.21.15.92:0/1629577295 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:57.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.465+0000 7f831579a640 1 --2- 172.21.15.92:0/1629577295 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562469e67080 0x562469e688c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:57.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.465+0000 7f831679c640 1 --2- 172.21.15.92:0/1629577295 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562469e71940 0x562469eab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:57.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.465+0000 7f8315f9b640 1 -- 172.21.15.92:0/1629577295 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562469e67080 msgr2=0x562469e688c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:57.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.465+0000 7f8315f9b640 1 --2- 172.21.15.92:0/1629577295 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562469e67080 0x562469e688c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:57.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.465+0000 7f8315f9b640 1 -- 172.21.15.92:0/1629577295 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562469e71940 msgr2=0x562469eab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:57.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.465+0000 7f8315f9b640 1 --2- 172.21.15.92:0/1629577295 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562469e71940 0x562469eab5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:57.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.465+0000 7f8315f9b640 1 -- 172.21.15.92:0/1629577295 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562469e5e260 con 0x562469e66760 2024-09-19T09:05:57.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.465+0000 7f831679c640 1 --2- 172.21.15.92:0/1629577295 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562469e71940 0x562469eab5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:05:57.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.466+0000 7f8315f9b640 1 --2- 172.21.15.92:0/1629577295 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562469e66760 0x562469e6f150 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f830c004c00 tx=0x7f830c031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee3bc069710fe8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:57.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.466+0000 7f82fb7fe640 1 -- 172.21.15.92:0/1629577295 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830c03f070 con 0x562469e66760 2024-09-19T09:05:57.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.466+0000 7f82fb7fe640 1 -- 172.21.15.92:0/1629577295 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f830c031d50 con 0x562469e66760 2024-09-19T09:05:57.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.466+0000 7f82fb7fe640 1 -- 172.21.15.92:0/1629577295 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830c035040 con 0x562469e66760 2024-09-19T09:05:57.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.467+0000 7f831a5d8740 1 -- 172.21.15.92:0/1629577295 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562469e66760 msgr2=0x562469e6f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:57.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.467+0000 7f831a5d8740 1 --2- 172.21.15.92:0/1629577295 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562469e66760 0x562469e6f150 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f830c004c00 tx=0x7f830c031400 comp rx=0 tx=0).stop 2024-09-19T09:05:57.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.467+0000 7f831a5d8740 1 -- 172.21.15.92:0/1629577295 shutdown_connections 2024-09-19T09:05:57.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.467+0000 7f831a5d8740 1 --2- 172.21.15.92:0/1629577295 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562469e71940 0x562469eab5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:57.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.467+0000 7f831a5d8740 1 --2- 172.21.15.92:0/1629577295 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562469e67080 0x562469e688c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:57.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.467+0000 7f831a5d8740 1 --2- 172.21.15.92:0/1629577295 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562469e66760 0x562469e6f150 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:57.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.467+0000 7f831a5d8740 1 -- 172.21.15.92:0/1629577295 >> 172.21.15.92:0/1629577295 conn(0x562469e62cf0 msgr2=0x562469e681b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:57.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.467+0000 7f831a5d8740 1 -- 172.21.15.92:0/1629577295 shutdown_connections 2024-09-19T09:05:57.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.467+0000 7f831a5d8740 1 -- 172.21.15.92:0/1629577295 wait complete. 2024-09-19T09:05:57.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.468+0000 7f831a5d8740 1 -- start start 2024-09-19T09:05:57.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.468+0000 7f831a5d8740 1 Processor -- start 2024-09-19T09:05:57.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.468+0000 7f831a5d8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562469e66760 0x562469e6ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:57.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.468+0000 7f831a5d8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562469e67080 0x562469e6bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:57.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.468+0000 7f831a5d8740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562469e71940 0x562469e6c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:57.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.468+0000 7f831a5d8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f83101a29c0 con 0x562469e67080 2024-09-19T09:05:57.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.468+0000 7f831a5d8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f83101a3e30 con 0x562469e66760 2024-09-19T09:05:57.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.468+0000 7f831a5d8740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f83101a3090 con 0x562469e71940 2024-09-19T09:05:57.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.468+0000 7f831a5d8740 10 client.0 _ll_register_callbacks cb 0x7f830009b310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:57.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.469+0000 7f831579a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562469e67080 0x562469e6bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:57.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.469+0000 7f831579a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562469e67080 0x562469e6bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50972/0 (socket says 172.21.15.92:50972) 2024-09-19T09:05:57.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.469+0000 7f831579a640 1 -- 172.21.15.92:0/599305019 learned_addr learned my addr 172.21.15.92:0/599305019 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:57.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.469+0000 7f8315f9b640 1 --2- 172.21.15.92:0/599305019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562469e66760 0x562469e6ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:57.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.470+0000 7f831579a640 1 -- 172.21.15.92:0/599305019 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562469e71940 msgr2=0x562469e6c510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:05:57.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.470+0000 7f831579a640 1 --2- 172.21.15.92:0/599305019 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562469e71940 0x562469e6c510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:57.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.470+0000 7f831579a640 1 -- 172.21.15.92:0/599305019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562469e66760 msgr2=0x562469e6ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:57.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.470+0000 7f831579a640 1 --2- 172.21.15.92:0/599305019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562469e66760 0x562469e6ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:57.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.470+0000 7f831579a640 1 -- 172.21.15.92:0/599305019 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562469f0d790 con 0x562469e67080 2024-09-19T09:05:57.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.470+0000 7f831579a640 1 --2- 172.21.15.92:0/599305019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562469e67080 0x562469e6bfd0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f830000be10 tx=0x7f83000a41f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e37cae488f3d35f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:57.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.470+0000 7f82f97fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:05:57.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.471+0000 7f82f97fa640 1 -- 172.21.15.92:0/599305019 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8300017b70 con 0x562469e67080 2024-09-19T09:05:57.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.471+0000 7f831a5d8740 1 -- 172.21.15.92:0/599305019 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f830c031d50 con 0x562469e67080 2024-09-19T09:05:57.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.471+0000 7f82f97fa640 1 -- 172.21.15.92:0/599305019 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8300017d10 con 0x562469e67080 2024-09-19T09:05:57.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.472+0000 7f82f97fa640 1 -- 172.21.15.92:0/599305019 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8300011890 con 0x562469e67080 2024-09-19T09:05:57.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.472+0000 7f831a5d8740 10 client.17514 fetch_fsmap learned FSMap version 19 2024-09-19T09:05:57.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.472+0000 7f831a5d8740 1 -- 172.21.15.92:0/599305019 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x562469f0e9c0 con 0x562469e67080 2024-09-19T09:05:57.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.472+0000 7f82f97fa640 1 -- 172.21.15.92:0/599305019 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f830c031d50 con 0x562469e67080 2024-09-19T09:05:57.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.473+0000 7f82f97fa640 1 -- 172.21.15.92:0/599305019 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f83000974b0 con 0x562469e67080 2024-09-19T09:05:57.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.473+0000 7f831a5d8740 10 client.17514 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:05:57.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.473+0000 7f831a5d8740 10 client.17514 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:05:57.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.473+0000 7f831a5d8740 20 client.17514 populate_metadata read hostname 'smithi092' 2024-09-19T09:05:57.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.473+0000 7f831a5d8740 1 --2- 172.21.15.92:0/599305019 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562469f0efc0 0x562469f113b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:57.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.473+0000 7f831a5d8740 4 client.17514 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-09-19T09:05:57.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.473+0000 7f831a5d8740 1 -- 172.21.15.92:0/599305019 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x562469dd3d20 con 0x562469f0efc0 2024-09-19T09:05:57.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.474+0000 7f8315f9b640 1 --2- 172.21.15.92:0/599305019 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562469f0efc0 0x562469f113b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:57.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.474+0000 7f82f97fa640 10 client.17514 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:57.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.474+0000 7f8315f9b640 1 --2- 172.21.15.92:0/599305019 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562469f0efc0 0x562469f113b0 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0b84dd2a51cdea server_cookie=b45515f3aad6b90d in_seq=0 out_seq=0 2024-09-19T09:05:57.493 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:57.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.772+0000 7f82f97fa640 1 -- 172.21.15.92:0/599305019 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x562469dd3d20 con 0x562469f0efc0 2024-09-19T09:05:57.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.772+0000 7f82f97fa640 10 client.17514 handle_command_reply: tid=0 2024-09-19T09:05:57.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.772+0000 7f831a5d8740 1 client.17514 shutdown 2024-09-19T09:05:57.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.772+0000 7f831a5d8740 1 -- 172.21.15.92:0/599305019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562469e67080 msgr2=0x562469e6bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:57.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.772+0000 7f831a5d8740 1 --2- 172.21.15.92:0/599305019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562469e67080 0x562469e6bfd0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f830000be10 tx=0x7f83000a41f0 comp rx=0 tx=0).stop 2024-09-19T09:05:57.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.772+0000 7f831a5d8740 1 -- 172.21.15.92:0/599305019 shutdown_connections 2024-09-19T09:05:57.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.773+0000 7f831a5d8740 1 --2- 172.21.15.92:0/599305019 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562469f0efc0 0x562469f113b0 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:57.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.773+0000 7f831a5d8740 1 --2- 172.21.15.92:0/599305019 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562469e71940 0x562469e6c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:57.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.773+0000 7f831a5d8740 1 --2- 172.21.15.92:0/599305019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562469e67080 0x562469e6bfd0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:57.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.773+0000 7f82f97fa640 0 client.17514 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:57.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.773+0000 7f831a5d8740 1 --2- 172.21.15.92:0/599305019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562469e66760 0x562469e6ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:57.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.773+0000 7f831a5d8740 1 -- 172.21.15.92:0/599305019 >> 172.21.15.92:0/599305019 conn(0x562469e62cf0 msgr2=0x562469e689d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:57.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.773+0000 7f831a5d8740 1 -- 172.21.15.92:0/599305019 shutdown_connections 2024-09-19T09:05:57.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.773+0000 7f831a5d8740 1 -- 172.21.15.92:0/599305019 wait complete. 2024-09-19T09:05:57.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.773+0000 7f831a5d8740 20 client.17514 trim_cache size 0 max 16384 2024-09-19T09:05:57.776 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:05:57.776 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 19, 2024-09-19T09:05:57.776 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24472, 2024-09-19T09:05:57.776 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 34, 2024-09-19T09:05:57.776 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-09-19T09:05:57.776 INFO:teuthology.orchestra.run.smithi092.stdout: "209062f4": { 2024-09-19T09:05:57.777 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 34, 2024-09-19T09:05:57.777 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-09-19T09:05:57.777 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:05:57.777 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-09-19T09:05:57.777 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:05:57.777 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:05:57.777 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 90.0, 2024-09-19T09:05:57.777 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 150.0, 2024-09-19T09:05:57.777 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-09-19T09:05:57.777 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-09-19T09:05:57.777 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-09-19T09:05:57.777 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:05:57.777 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-09-19T09:05:57.778 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:05:57.778 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:05:57.778 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:05:57.778 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:05:57.778 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:05:57.778 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:05:57.778 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:05:57.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.773+0000 7f83181ff640 1 -- 172.21.15.92:0/3969159615 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f82fc0a31f0 msgr2=0x7f82fc0a56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:57.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.773+0000 7f83181ff640 1 --2- 172.21.15.92:0/3969159615 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f82fc0a31f0 0x7f82fc0a56b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f830c004ca0 tx=0x7f830c02a440 comp rx=0 tx=0).stop 2024-09-19T09:05:57.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.773+0000 7f83181ff640 1 -- 172.21.15.92:0/3969159615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f831010c2f0 msgr2=0x7f8310106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:57.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.773+0000 7f83181ff640 1 --2- 172.21.15.92:0/3969159615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f831010c2f0 0x7f8310106b80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f830000b450 tx=0x7f830000b910 comp rx=0 tx=0).stop 2024-09-19T09:05:57.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.773+0000 7f83181ff640 1 -- 172.21.15.92:0/3969159615 shutdown_connections 2024-09-19T09:05:57.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.773+0000 7f83181ff640 1 --2- 172.21.15.92:0/3969159615 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f82fc0a31f0 0x7f82fc0a56b0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:57.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.773+0000 7f83181ff640 1 --2- 172.21.15.92:0/3969159615 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83101070c0 0x7f8310107550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:57.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.773+0000 7f83181ff640 1 --2- 172.21.15.92:0/3969159615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f831010c2f0 0x7f8310106b80 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:57.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.773+0000 7f83181ff640 1 --2- 172.21.15.92:0/3969159615 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83101037a0 0x7f831010baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:57.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.773+0000 7f83181ff640 1 -- 172.21.15.92:0/3969159615 >> 172.21.15.92:0/3969159615 conn(0x7f83100fc7d0 msgr2=0x7f831010dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:57.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.774+0000 7f83181ff640 1 -- 172.21.15.92:0/3969159615 shutdown_connections 2024-09-19T09:05:57.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:57.774+0000 7f83181ff640 1 -- 172.21.15.92:0/3969159615 wait complete. 2024-09-19T09:05:57.788 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:57 smithi092 ceph-mon[31407]: pgmap v614: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 42 MiB/s wr, 1.57k op/s 2024-09-19T09:05:57.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:57 smithi167 ceph-mon[35359]: pgmap v614: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 42 MiB/s wr, 1.57k op/s 2024-09-19T09:05:57.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:57 smithi190 ceph-mon[35358]: pgmap v614: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 42 MiB/s wr, 1.57k op/s 2024-09-19T09:05:58.377 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '209062f4', quiesce took 5.6 seconds. Will release after: 24.4 2024-09-19T09:05:58.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.538+0000 7f98f693b640 1 -- 172.21.15.92:0/3830400742 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98f0102d80 msgr2=0x7f98f0103160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:58.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.538+0000 7f98f693b640 1 --2- 172.21.15.92:0/3830400742 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98f0102d80 0x7f98f0103160 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f98e0009900 tx=0x7f98e002a480 comp rx=0 tx=0).stop 2024-09-19T09:05:58.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.538+0000 7f98f693b640 1 -- 172.21.15.92:0/3830400742 shutdown_connections 2024-09-19T09:05:58.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.538+0000 7f98f693b640 1 --2- 172.21.15.92:0/3830400742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98f010c160 0x7f98f010e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:58.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.538+0000 7f98f693b640 1 --2- 172.21.15.92:0/3830400742 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f98f01036a0 0x7f98f010bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:58.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.538+0000 7f98f693b640 1 --2- 172.21.15.92:0/3830400742 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98f0102d80 0x7f98f0103160 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:58.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.538+0000 7f98f693b640 1 -- 172.21.15.92:0/3830400742 >> 172.21.15.92:0/3830400742 conn(0x7f98f00fc780 msgr2=0x7f98f00feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:58.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.539+0000 7f98f693b640 1 -- 172.21.15.92:0/3830400742 shutdown_connections 2024-09-19T09:05:58.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.539+0000 7f98f693b640 1 -- 172.21.15.92:0/3830400742 wait complete. 2024-09-19T09:05:58.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.539+0000 7f98f693b640 1 Processor -- start 2024-09-19T09:05:58.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.539+0000 7f98f693b640 1 -- start start 2024-09-19T09:05:58.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.539+0000 7f98f693b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98f0102d80 0x7f98f0198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:58.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.539+0000 7f98f693b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98f01036a0 0x7f98f01989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:58.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.539+0000 7f98f693b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f98f010c160 0x7f98f019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:58.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.539+0000 7f98f693b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f98f0111f40 con 0x7f98f01036a0 2024-09-19T09:05:58.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.539+0000 7f98f693b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f98f0111dc0 con 0x7f98f0102d80 2024-09-19T09:05:58.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.539+0000 7f98f693b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f98f01120c0 con 0x7f98f010c160 2024-09-19T09:05:58.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.540+0000 7f98ef7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98f01036a0 0x7f98f01989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:58.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.540+0000 7f98ef7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98f01036a0 0x7f98f01989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50984/0 (socket says 172.21.15.92:50984) 2024-09-19T09:05:58.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.540+0000 7f98ef7fe640 1 -- 172.21.15.92:0/504068634 learned_addr learned my addr 172.21.15.92:0/504068634 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:58.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.540+0000 7f98effff640 1 --2- 172.21.15.92:0/504068634 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98f0102d80 0x7f98f0198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:58.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.540+0000 7f98f4ed8640 1 --2- 172.21.15.92:0/504068634 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f98f010c160 0x7f98f019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:58.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.540+0000 7f98ef7fe640 1 -- 172.21.15.92:0/504068634 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f98f010c160 msgr2=0x7f98f019cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:58.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.540+0000 7f98ef7fe640 1 --2- 172.21.15.92:0/504068634 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f98f010c160 0x7f98f019cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:58.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.540+0000 7f98ef7fe640 1 -- 172.21.15.92:0/504068634 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98f0102d80 msgr2=0x7f98f0198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:58.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.540+0000 7f98ef7fe640 1 --2- 172.21.15.92:0/504068634 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98f0102d80 0x7f98f0198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:58.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.540+0000 7f98ef7fe640 1 -- 172.21.15.92:0/504068634 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98f019d420 con 0x7f98f01036a0 2024-09-19T09:05:58.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.540+0000 7f98ef7fe640 1 --2- 172.21.15.92:0/504068634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98f01036a0 0x7f98f01989b0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f98e400e9f0 tx=0x7f98e400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:58.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.540+0000 7f98ed7fa640 1 -- 172.21.15.92:0/504068634 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e400cd80 con 0x7f98f01036a0 2024-09-19T09:05:58.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.540+0000 7f98ed7fa640 1 -- 172.21.15.92:0/504068634 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98e4005500 con 0x7f98f01036a0 2024-09-19T09:05:58.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.540+0000 7f98f693b640 1 -- 172.21.15.92:0/504068634 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98f019d710 con 0x7f98f01036a0 2024-09-19T09:05:58.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.540+0000 7f98ed7fa640 1 -- 172.21.15.92:0/504068634 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e4010690 con 0x7f98f01036a0 2024-09-19T09:05:58.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.540+0000 7f98f693b640 1 -- 172.21.15.92:0/504068634 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98f01a4ff0 con 0x7f98f01036a0 2024-09-19T09:05:58.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.541+0000 7f98f693b640 1 -- 172.21.15.92:0/504068634 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98f0103160 con 0x7f98f01036a0 2024-09-19T09:05:58.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.542+0000 7f98ed7fa640 1 -- 172.21.15.92:0/504068634 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f98e40046c0 con 0x7f98f01036a0 2024-09-19T09:05:58.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.543+0000 7f98ed7fa640 1 --2- 172.21.15.92:0/504068634 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f98d80a3240 0x7f98d80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:58.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.543+0000 7f98effff640 1 --2- 172.21.15.92:0/504068634 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f98d80a3240 0x7f98d80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:58.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.543+0000 7f98ed7fa640 1 -- 172.21.15.92:0/504068634 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f98e40cfcf0 con 0x7f98f01036a0 2024-09-19T09:05:58.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.544+0000 7f98effff640 1 --2- 172.21.15.92:0/504068634 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f98d80a3240 0x7f98d80a5700 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f98e0009230 tx=0x7f98e00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:58.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.547+0000 7f98ed7fa640 1 -- 172.21.15.92:0/504068634 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f98e409ca10 con 0x7f98f01036a0 2024-09-19T09:05:58.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.748+0000 7f98f693b640 1 -- 172.21.15.92:0/504068634 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f98f002d7c0 con 0x7f98f01036a0 2024-09-19T09:05:58.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.749+0000 7f98ed7fa640 1 -- 172.21.15.92:0/504068634 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f98e409c310 con 0x7f98f01036a0 2024-09-19T09:05:58.751 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:05:58.751 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:05:58.751 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:05:58.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.752+0000 7f98f693b640 1 -- 172.21.15.92:0/504068634 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f98d80a3240 msgr2=0x7f98d80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:58.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.752+0000 7f98f693b640 1 --2- 172.21.15.92:0/504068634 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f98d80a3240 0x7f98d80a5700 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f98e0009230 tx=0x7f98e00058d0 comp rx=0 tx=0).stop 2024-09-19T09:05:58.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.752+0000 7f98f693b640 1 -- 172.21.15.92:0/504068634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98f01036a0 msgr2=0x7f98f01989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:58.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.752+0000 7f98f693b640 1 --2- 172.21.15.92:0/504068634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98f01036a0 0x7f98f01989b0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f98e400e9f0 tx=0x7f98e400edf0 comp rx=0 tx=0).stop 2024-09-19T09:05:58.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.752+0000 7f98f693b640 1 -- 172.21.15.92:0/504068634 shutdown_connections 2024-09-19T09:05:58.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.752+0000 7f98f693b640 1 --2- 172.21.15.92:0/504068634 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f98f010c160 0x7f98f019cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:58.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.752+0000 7f98f693b640 1 --2- 172.21.15.92:0/504068634 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f98d80a3240 0x7f98d80a5700 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:58.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.752+0000 7f98f693b640 1 --2- 172.21.15.92:0/504068634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98f01036a0 0x7f98f01989b0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:58.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.752+0000 7f98f693b640 1 --2- 172.21.15.92:0/504068634 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98f0102d80 0x7f98f0198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:58.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.752+0000 7f98f693b640 1 -- 172.21.15.92:0/504068634 >> 172.21.15.92:0/504068634 conn(0x7f98f00fc780 msgr2=0x7f98f00fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:58.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.752+0000 7f98f693b640 1 -- 172.21.15.92:0/504068634 shutdown_connections 2024-09-19T09:05:58.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:05:58.752+0000 7f98f693b640 1 -- 172.21.15.92:0/504068634 wait complete. 2024-09-19T09:05:59.165 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.162+0000 7f79d561e640 1 -- 172.21.15.92:0/3642969231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79d0102d20 msgr2=0x7f79d0105190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:59.165 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.162+0000 7f79d561e640 1 --2- 172.21.15.92:0/3642969231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79d0102d20 0x7f79d0105190 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f79b8009900 tx=0x7f79b802a410 comp rx=0 tx=0).stop 2024-09-19T09:05:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.162+0000 7f79d561e640 1 -- 172.21.15.92:0/3642969231 shutdown_connections 2024-09-19T09:05:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.162+0000 7f79d561e640 1 --2- 172.21.15.92:0/3642969231 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79d01056d0 0x7f79d0105b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.162+0000 7f79d561e640 1 --2- 172.21.15.92:0/3642969231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79d0102d20 0x7f79d0105190 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.162+0000 7f79d561e640 1 --2- 172.21.15.92:0/3642969231 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79d01003d0 0x7f79d01027e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.162+0000 7f79d561e640 1 -- 172.21.15.92:0/3642969231 >> 172.21.15.92:0/3642969231 conn(0x7f79d00fc1e0 msgr2=0x7f79d00fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.162+0000 7f79d561e640 1 -- 172.21.15.92:0/3642969231 shutdown_connections 2024-09-19T09:05:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.162+0000 7f79d561e640 1 -- 172.21.15.92:0/3642969231 wait complete. 2024-09-19T09:05:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.162+0000 7f79d561e640 1 Processor -- start 2024-09-19T09:05:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.162+0000 7f79d561e640 1 -- start start 2024-09-19T09:05:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.163+0000 7f79d561e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79d01003d0 0x7f79d019e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.163+0000 7f79d561e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79d0102d20 0x7f79d019e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.163+0000 7f79d561e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79d01056d0 0x7f79d01a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.163+0000 7f79d561e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f79d0113e10 con 0x7f79d01003d0 2024-09-19T09:05:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.163+0000 7f79d561e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f79d0113c90 con 0x7f79d01056d0 2024-09-19T09:05:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.163+0000 7f79d561e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f79d0113f90 con 0x7f79d0102d20 2024-09-19T09:05:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.163+0000 7f79ceffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79d01003d0 0x7f79d019e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.163+0000 7f79ceffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79d01003d0 0x7f79d019e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51000/0 (socket says 172.21.15.92:51000) 2024-09-19T09:05:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.163+0000 7f79ceffd640 1 -- 172.21.15.92:0/2629999356 learned_addr learned my addr 172.21.15.92:0/2629999356 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.163+0000 7f79c7fff640 1 --2- 172.21.15.92:0/2629999356 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79d0102d20 0x7f79d019e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.163+0000 7f79cf7fe640 1 --2- 172.21.15.92:0/2629999356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79d01056d0 0x7f79d01a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.163+0000 7f79ceffd640 1 -- 172.21.15.92:0/2629999356 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79d0102d20 msgr2=0x7f79d019e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.163+0000 7f79ceffd640 1 --2- 172.21.15.92:0/2629999356 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79d0102d20 0x7f79d019e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.163+0000 7f79ceffd640 1 -- 172.21.15.92:0/2629999356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79d01056d0 msgr2=0x7f79d01a5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.163+0000 7f79ceffd640 1 --2- 172.21.15.92:0/2629999356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79d01056d0 0x7f79d01a5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.163+0000 7f79ceffd640 1 -- 172.21.15.92:0/2629999356 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79d01a5ff0 con 0x7f79d01003d0 2024-09-19T09:05:59.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.163+0000 7f79ceffd640 1 --2- 172.21.15.92:0/2629999356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79d01003d0 0x7f79d019e3d0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f79c000d770 tx=0x7f79c000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:59.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.163+0000 7f79ccff9640 1 -- 172.21.15.92:0/2629999356 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c0017070 con 0x7f79d01003d0 2024-09-19T09:05:59.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.163+0000 7f79d561e640 1 -- 172.21.15.92:0/2629999356 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79d01a62e0 con 0x7f79d01003d0 2024-09-19T09:05:59.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.163+0000 7f79ccff9640 1 -- 172.21.15.92:0/2629999356 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79c0005500 con 0x7f79d01003d0 2024-09-19T09:05:59.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.163+0000 7f79ccff9640 1 -- 172.21.15.92:0/2629999356 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c0004e00 con 0x7f79d01003d0 2024-09-19T09:05:59.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.163+0000 7f79d561e640 1 -- 172.21.15.92:0/2629999356 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79d01a6800 con 0x7f79d01003d0 2024-09-19T09:05:59.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.166+0000 7f79ccff9640 1 -- 172.21.15.92:0/2629999356 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f79c0004fa0 con 0x7f79d01003d0 2024-09-19T09:05:59.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.166+0000 7f79d848f740 1 Processor -- start 2024-09-19T09:05:59.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.166+0000 7f79d848f740 1 -- start start 2024-09-19T09:05:59.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.166+0000 7f79d848f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5655270c09a0 0x5655270c0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:59.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.166+0000 7f79d848f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655270c12e0 0x5655270c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:59.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.166+0000 7f79d848f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655270c6370 0x5655270c8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:59.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.166+0000 7f79d848f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5655270242f0 con 0x5655270c6370 2024-09-19T09:05:59.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.166+0000 7f79d848f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x565526fcc270 con 0x5655270c12e0 2024-09-19T09:05:59.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.166+0000 7f79d848f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5655270202b0 con 0x5655270c09a0 2024-09-19T09:05:59.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.166+0000 7f79c7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655270c6370 0x5655270c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:59.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.166+0000 7f79c7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655270c6370 0x5655270c8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51016/0 (socket says 172.21.15.92:51016) 2024-09-19T09:05:59.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.166+0000 7f79c7fff640 1 -- 172.21.15.92:0/88219783 learned_addr learned my addr 172.21.15.92:0/88219783 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:59.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.166+0000 7f79ceffd640 1 --2- 172.21.15.92:0/88219783 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655270c12e0 0x5655270c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:59.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.166+0000 7f79cf7fe640 1 --2- 172.21.15.92:0/88219783 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5655270c09a0 0x5655270c0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:59.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.167+0000 7f79c7fff640 1 -- 172.21.15.92:0/88219783 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5655270c09a0 msgr2=0x5655270c0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:59.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.167+0000 7f79c7fff640 1 --2- 172.21.15.92:0/88219783 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5655270c09a0 0x5655270c0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:59.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.167+0000 7f79c7fff640 1 -- 172.21.15.92:0/88219783 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655270c12e0 msgr2=0x5655270c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:59.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.167+0000 7f79ccff9640 1 --2- 172.21.15.92:0/2629999356 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f79bc0a32f0 0x7f79bc0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:59.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.167+0000 7f79c7fff640 1 --2- 172.21.15.92:0/88219783 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655270c12e0 0x5655270c5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:59.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.167+0000 7f79c7fff640 1 -- 172.21.15.92:0/88219783 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565526fcb340 con 0x5655270c6370 2024-09-19T09:05:59.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.167+0000 7f79cf7fe640 1 --2- 172.21.15.92:0/2629999356 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f79bc0a32f0 0x7f79bc0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:59.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.167+0000 7f79ccff9640 1 -- 172.21.15.92:0/2629999356 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f79c00cf3d0 con 0x7f79d01003d0 2024-09-19T09:05:59.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.167+0000 7f79c7fff640 1 --2- 172.21.15.92:0/88219783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655270c6370 0x5655270c8830 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f79b802a930 tx=0x7f79b8005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=467805bd49a2ae83 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:59.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.167+0000 7f79c57fa640 1 -- 172.21.15.92:0/88219783 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b8040070 con 0x5655270c6370 2024-09-19T09:05:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.167+0000 7f79c57fa640 1 -- 172.21.15.92:0/88219783 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79b80318b0 con 0x5655270c6370 2024-09-19T09:05:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.167+0000 7f79c57fa640 1 -- 172.21.15.92:0/88219783 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b8035040 con 0x5655270c6370 2024-09-19T09:05:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.168+0000 7f79d848f740 1 -- 172.21.15.92:0/88219783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655270c6370 msgr2=0x5655270c8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.168+0000 7f79cf7fe640 1 --2- 172.21.15.92:0/2629999356 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f79bc0a32f0 0x7f79bc0a57b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f79c8005fd0 tx=0x7f79c80097f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.168+0000 7f79d848f740 1 --2- 172.21.15.92:0/88219783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655270c6370 0x5655270c8830 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f79b802a930 tx=0x7f79b8005c00 comp rx=0 tx=0).stop 2024-09-19T09:05:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.168+0000 7f79d848f740 1 -- 172.21.15.92:0/88219783 shutdown_connections 2024-09-19T09:05:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.168+0000 7f79d848f740 1 --2- 172.21.15.92:0/88219783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655270c6370 0x5655270c8830 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.168+0000 7f79d848f740 1 --2- 172.21.15.92:0/88219783 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655270c12e0 0x5655270c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.168+0000 7f79d848f740 1 --2- 172.21.15.92:0/88219783 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5655270c09a0 0x5655270c0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.168+0000 7f79d848f740 1 -- 172.21.15.92:0/88219783 >> 172.21.15.92:0/88219783 conn(0x5655270bc010 msgr2=0x5655270bc410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.168+0000 7f79d848f740 1 -- 172.21.15.92:0/88219783 shutdown_connections 2024-09-19T09:05:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.168+0000 7f79d848f740 1 -- 172.21.15.92:0/88219783 wait complete. 2024-09-19T09:05:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.168+0000 7f79d848f740 1 -- start start 2024-09-19T09:05:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.168+0000 7f79d848f740 1 Processor -- start 2024-09-19T09:05:59.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.168+0000 7f79d848f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655270c09a0 0x5655270cab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:59.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.168+0000 7f79d848f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655270c12e0 0x5655270cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:59.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.168+0000 7f79d848f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5655270c6370 0x5655270d2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:59.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.168+0000 7f79d848f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5655270c92e0 con 0x5655270c12e0 2024-09-19T09:05:59.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.168+0000 7f79d848f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x565526fad290 con 0x5655270c09a0 2024-09-19T09:05:59.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.168+0000 7f79d848f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5655270c9460 con 0x5655270c6370 2024-09-19T09:05:59.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.169+0000 7f79d848f740 10 client.0 _ll_register_callbacks cb 0x565526fde140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:59.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.169+0000 7f79c7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655270c12e0 0x5655270cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:59.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.169+0000 7f79c7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655270c12e0 0x5655270cb0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51020/0 (socket says 172.21.15.92:51020) 2024-09-19T09:05:59.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.169+0000 7f79c7fff640 1 -- 172.21.15.92:0/51666271 learned_addr learned my addr 172.21.15.92:0/51666271 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:59.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.169+0000 7f79ceffd640 1 --2- 172.21.15.92:0/51666271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655270c09a0 0x5655270cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:59.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.169+0000 7f79cf7fe640 1 --2- 172.21.15.92:0/51666271 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5655270c6370 0x5655270d2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:59.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.169+0000 7f79c7fff640 1 -- 172.21.15.92:0/51666271 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5655270c6370 msgr2=0x5655270d2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:59.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.169+0000 7f79c7fff640 1 --2- 172.21.15.92:0/51666271 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5655270c6370 0x5655270d2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:59.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.169+0000 7f79c7fff640 1 -- 172.21.15.92:0/51666271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655270c09a0 msgr2=0x5655270cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:59.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.169+0000 7f79c7fff640 1 --2- 172.21.15.92:0/51666271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655270c09a0 0x5655270cab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:59.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.169+0000 7f79c7fff640 1 -- 172.21.15.92:0/51666271 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565526d37210 con 0x5655270c12e0 2024-09-19T09:05:59.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.169+0000 7f79c7fff640 1 --2- 172.21.15.92:0/51666271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655270c12e0 0x5655270cb0d0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f79b8031610 tx=0x7f79b8032e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58912a89e2bc4b56 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:59.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.169+0000 7f79b67fc640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:05:59.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.169+0000 7f79b67fc640 1 -- 172.21.15.92:0/51666271 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b804b020 con 0x5655270c12e0 2024-09-19T09:05:59.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.169+0000 7f79b67fc640 1 -- 172.21.15.92:0/51666271 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f79b8004450 con 0x5655270c12e0 2024-09-19T09:05:59.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.169+0000 7f79d848f740 1 -- 172.21.15.92:0/51666271 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79b80318b0 con 0x5655270c12e0 2024-09-19T09:05:59.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.169+0000 7f79b67fc640 1 -- 172.21.15.92:0/51666271 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f79b8035070 con 0x5655270c12e0 2024-09-19T09:05:59.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.169+0000 7f79d848f740 10 client.17532 fetch_fsmap learned FSMap version 19 2024-09-19T09:05:59.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.169+0000 7f79d848f740 1 -- 172.21.15.92:0/51666271 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x565526e03620 con 0x5655270c12e0 2024-09-19T09:05:59.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.170+0000 7f79b67fc640 1 -- 172.21.15.92:0/51666271 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79b80318b0 con 0x5655270c12e0 2024-09-19T09:05:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.170+0000 7f79b67fc640 1 -- 172.21.15.92:0/51666271 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f79b8004b60 con 0x5655270c12e0 2024-09-19T09:05:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.170+0000 7f79d848f740 10 client.17532 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:05:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.170+0000 7f79d848f740 10 client.17532 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:05:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.170+0000 7f79d848f740 20 client.17532 populate_metadata read hostname 'smithi092' 2024-09-19T09:05:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.170+0000 7f79d848f740 1 --2- 172.21.15.92:0/51666271 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5655270d6410 0x5655270d8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.170+0000 7f79d848f740 4 client.17532 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:05:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.170+0000 7f79d848f740 1 -- 172.21.15.92:0/51666271 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565527031a20 con 0x5655270d6410 2024-09-19T09:05:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.170+0000 7f79ceffd640 1 --2- 172.21.15.92:0/51666271 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5655270d6410 0x5655270d8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.170+0000 7f79b67fc640 10 client.17532 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.170+0000 7f79ceffd640 1 --2- 172.21.15.92:0/51666271 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5655270d6410 0x5655270d8800 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=699b24d9eab5e996 server_cookie=385bd2f4c77f16ee in_seq=0 out_seq=0 2024-09-19T09:05:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.171+0000 7f79b67fc640 1 -- 172.21.15.92:0/51666271 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x565527031a20 con 0x5655270d6410 2024-09-19T09:05:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.171+0000 7f79b67fc640 10 client.17532 handle_command_reply: tid=0 2024-09-19T09:05:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.171+0000 7f79d848f740 1 client.17532 shutdown 2024-09-19T09:05:59.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.171+0000 7f79d848f740 1 -- 172.21.15.92:0/51666271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655270c12e0 msgr2=0x5655270cb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:59.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.171+0000 7f79d848f740 1 --2- 172.21.15.92:0/51666271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655270c12e0 0x5655270cb0d0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f79b8031610 tx=0x7f79b8032e60 comp rx=0 tx=0).stop 2024-09-19T09:05:59.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.171+0000 7f79d848f740 1 -- 172.21.15.92:0/51666271 shutdown_connections 2024-09-19T09:05:59.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.171+0000 7f79d848f740 1 --2- 172.21.15.92:0/51666271 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5655270d6410 0x5655270d8800 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:59.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.171+0000 7f79d848f740 1 --2- 172.21.15.92:0/51666271 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5655270c6370 0x5655270d2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:59.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.171+0000 7f79d848f740 1 --2- 172.21.15.92:0/51666271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655270c12e0 0x5655270cb0d0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:59.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.171+0000 7f79b67fc640 0 client.17532 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:59.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.171+0000 7f79d848f740 1 --2- 172.21.15.92:0/51666271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655270c09a0 0x5655270cab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:59.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.171+0000 7f79d848f740 1 -- 172.21.15.92:0/51666271 >> 172.21.15.92:0/51666271 conn(0x5655270bc010 msgr2=0x5655270bd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:59.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.171+0000 7f79d848f740 1 -- 172.21.15.92:0/51666271 shutdown_connections 2024-09-19T09:05:59.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.171+0000 7f79d848f740 1 -- 172.21.15.92:0/51666271 wait complete. 2024-09-19T09:05:59.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.171+0000 7f79d848f740 20 client.17532 trim_cache size 0 max 16384 2024-09-19T09:05:59.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.186+0000 7f79d848f740 1 Processor -- start 2024-09-19T09:05:59.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.186+0000 7f79d848f740 1 -- start start 2024-09-19T09:05:59.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.186+0000 7f79d848f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5655270c09a0 0x5655270bdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:59.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.186+0000 7f79d848f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655270c12e0 0x5655270d20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:59.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.186+0000 7f79d848f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655270c6370 0x5655270dd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:59.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.186+0000 7f79d848f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f79d01ad560 con 0x5655270c12e0 2024-09-19T09:05:59.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.186+0000 7f79d848f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f79d01afe00 con 0x5655270c6370 2024-09-19T09:05:59.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.186+0000 7f79d848f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f79d01adbf0 con 0x5655270c09a0 2024-09-19T09:05:59.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.186+0000 7f79c7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655270c12e0 0x5655270d20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:59.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.186+0000 7f79c7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655270c12e0 0x5655270d20d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51028/0 (socket says 172.21.15.92:51028) 2024-09-19T09:05:59.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.186+0000 7f79c7fff640 1 -- 172.21.15.92:0/1266941435 learned_addr learned my addr 172.21.15.92:0/1266941435 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:59.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.186+0000 7f79cf7fe640 1 --2- 172.21.15.92:0/1266941435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655270c6370 0x5655270dd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:59.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.186+0000 7f79ceffd640 1 --2- 172.21.15.92:0/1266941435 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5655270c09a0 0x5655270bdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:59.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.186+0000 7f79c7fff640 1 -- 172.21.15.92:0/1266941435 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5655270c09a0 msgr2=0x5655270bdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:59.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.186+0000 7f79c7fff640 1 --2- 172.21.15.92:0/1266941435 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5655270c09a0 0x5655270bdb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:59.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.186+0000 7f79c7fff640 1 -- 172.21.15.92:0/1266941435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655270c6370 msgr2=0x5655270dd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:59.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.186+0000 7f79c7fff640 1 --2- 172.21.15.92:0/1266941435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655270c6370 0x5655270dd040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:59.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.186+0000 7f79c7fff640 1 -- 172.21.15.92:0/1266941435 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5655270c8ba0 con 0x5655270c12e0 2024-09-19T09:05:59.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.187+0000 7f79c7fff640 1 --2- 172.21.15.92:0/1266941435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655270c12e0 0x5655270d20d0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f79b8000c00 tx=0x7f79b802ab50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3250f4dcf8b495cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:59.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.187+0000 7f79c4ff9640 1 -- 172.21.15.92:0/1266941435 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b804b070 con 0x5655270c12e0 2024-09-19T09:05:59.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.187+0000 7f79c4ff9640 1 -- 172.21.15.92:0/1266941435 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79b8004c60 con 0x5655270c12e0 2024-09-19T09:05:59.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.187+0000 7f79c4ff9640 1 -- 172.21.15.92:0/1266941435 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b8040040 con 0x5655270c12e0 2024-09-19T09:05:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.187+0000 7f79d848f740 1 -- 172.21.15.92:0/1266941435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655270c12e0 msgr2=0x5655270d20d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.187+0000 7f79d848f740 1 --2- 172.21.15.92:0/1266941435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655270c12e0 0x5655270d20d0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f79b8000c00 tx=0x7f79b802ab50 comp rx=0 tx=0).stop 2024-09-19T09:05:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.187+0000 7f79d848f740 1 -- 172.21.15.92:0/1266941435 shutdown_connections 2024-09-19T09:05:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.187+0000 7f79d848f740 1 --2- 172.21.15.92:0/1266941435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655270c6370 0x5655270dd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.187+0000 7f79d848f740 1 --2- 172.21.15.92:0/1266941435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655270c12e0 0x5655270d20d0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.187+0000 7f79d848f740 1 --2- 172.21.15.92:0/1266941435 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5655270c09a0 0x5655270bdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.187+0000 7f79d848f740 1 -- 172.21.15.92:0/1266941435 >> 172.21.15.92:0/1266941435 conn(0x5655270bc010 msgr2=0x5655270bc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.187+0000 7f79d848f740 1 -- 172.21.15.92:0/1266941435 shutdown_connections 2024-09-19T09:05:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.187+0000 7f79d848f740 1 -- 172.21.15.92:0/1266941435 wait complete. 2024-09-19T09:05:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.188+0000 7f79d848f740 1 -- start start 2024-09-19T09:05:59.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.188+0000 7f79d848f740 1 Processor -- start 2024-09-19T09:05:59.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.188+0000 7f79d848f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655270c09a0 0x5655270cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:59.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.188+0000 7f79d848f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5655270c12e0 0x5655270d04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:59.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.188+0000 7f79d848f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655270c6370 0x5655270d1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:59.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.188+0000 7f79d848f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f79d01ae2c0 con 0x5655270c09a0 2024-09-19T09:05:59.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.188+0000 7f79d848f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f79d01af730 con 0x5655270c6370 2024-09-19T09:05:59.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.188+0000 7f79d848f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f79d01ae990 con 0x5655270c12e0 2024-09-19T09:05:59.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.188+0000 7f79d848f740 10 client.0 _ll_register_callbacks cb 0x7f79b8032c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:59.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.188+0000 7f79ceffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655270c09a0 0x5655270cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:59.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.188+0000 7f79ceffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655270c09a0 0x5655270cffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51036/0 (socket says 172.21.15.92:51036) 2024-09-19T09:05:59.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.188+0000 7f79ceffd640 1 -- 172.21.15.92:0/944479255 learned_addr learned my addr 172.21.15.92:0/944479255 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:05:59.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.188+0000 7f79c7fff640 1 --2- 172.21.15.92:0/944479255 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5655270c12e0 0x5655270d04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:59.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.188+0000 7f79cf7fe640 1 --2- 172.21.15.92:0/944479255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655270c6370 0x5655270d1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:59.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.188+0000 7f79ceffd640 1 -- 172.21.15.92:0/944479255 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5655270c12e0 msgr2=0x5655270d04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:59.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.188+0000 7f79ceffd640 1 --2- 172.21.15.92:0/944479255 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5655270c12e0 0x5655270d04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:59.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.188+0000 7f79ceffd640 1 -- 172.21.15.92:0/944479255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655270c6370 msgr2=0x5655270d1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:59.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.188+0000 7f79ceffd640 1 --2- 172.21.15.92:0/944479255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655270c6370 0x5655270d1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:59.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.188+0000 7f79ceffd640 1 -- 172.21.15.92:0/944479255 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5655270d1aa0 con 0x5655270c09a0 2024-09-19T09:05:59.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.188+0000 7f79cf7fe640 1 --2- 172.21.15.92:0/944479255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655270c6370 0x5655270d1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:59.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.189+0000 7f79ceffd640 1 --2- 172.21.15.92:0/944479255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655270c09a0 0x5655270cffb0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f79c00a40f0 tx=0x7f79c0009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9f3d791c7cf7642 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:59.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.189+0000 7f79b67fc640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:05:59.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.189+0000 7f79b67fc640 1 -- 172.21.15.92:0/944479255 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c00b3070 con 0x5655270c09a0 2024-09-19T09:05:59.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.189+0000 7f79b67fc640 1 -- 172.21.15.92:0/944479255 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f79c00ccfa0 con 0x5655270c09a0 2024-09-19T09:05:59.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.189+0000 7f79d848f740 1 -- 172.21.15.92:0/944479255 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79b8004c60 con 0x5655270c09a0 2024-09-19T09:05:59.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.189+0000 7f79b67fc640 1 -- 172.21.15.92:0/944479255 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f79c0020040 con 0x5655270c09a0 2024-09-19T09:05:59.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.189+0000 7f79d848f740 10 client.17538 fetch_fsmap learned FSMap version 19 2024-09-19T09:05:59.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.189+0000 7f79d848f740 1 -- 172.21.15.92:0/944479255 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x565527141800 con 0x5655270c09a0 2024-09-19T09:05:59.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.189+0000 7f79b67fc640 1 -- 172.21.15.92:0/944479255 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79b8004c60 con 0x5655270c09a0 2024-09-19T09:05:59.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.189+0000 7f79b67fc640 1 -- 172.21.15.92:0/944479255 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f79c009cce0 con 0x5655270c09a0 2024-09-19T09:05:59.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.189+0000 7f79d848f740 10 client.17538 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:05:59.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.189+0000 7f79d848f740 10 client.17538 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:05:59.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.189+0000 7f79d848f740 20 client.17538 populate_metadata read hostname 'smithi092' 2024-09-19T09:05:59.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.189+0000 7f79d848f740 1 --2- 172.21.15.92:0/944479255 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x565527142160 0x565527144580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:59.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.189+0000 7f79d848f740 4 client.17538 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:05:59.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.189+0000 7f79d848f740 1 -- 172.21.15.92:0/944479255 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56552702bd70 con 0x565527142160 2024-09-19T09:05:59.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.189+0000 7f79c7fff640 1 --2- 172.21.15.92:0/944479255 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x565527142160 0x565527144580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:59.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.190+0000 7f79b67fc640 10 client.17538 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:59.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.190+0000 7f79c7fff640 1 --2- 172.21.15.92:0/944479255 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x565527142160 0x565527144580 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ffcc0c7f5b8710d server_cookie=b002d81bd56b8dd4 in_seq=0 out_seq=0 2024-09-19T09:05:59.250 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.249+0000 7f79b67fc640 1 -- 172.21.15.92:0/944479255 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56552702bd70 con 0x565527142160 2024-09-19T09:05:59.250 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.249+0000 7f79b67fc640 10 client.17538 handle_command_reply: tid=0 2024-09-19T09:05:59.250 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.249+0000 7f79d848f740 1 client.17538 shutdown 2024-09-19T09:05:59.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.249+0000 7f79d848f740 1 -- 172.21.15.92:0/944479255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655270c09a0 msgr2=0x5655270cffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:59.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.249+0000 7f79d848f740 1 --2- 172.21.15.92:0/944479255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655270c09a0 0x5655270cffb0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f79c00a40f0 tx=0x7f79c0009c30 comp rx=0 tx=0).stop 2024-09-19T09:05:59.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.249+0000 7f79d848f740 1 -- 172.21.15.92:0/944479255 shutdown_connections 2024-09-19T09:05:59.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.249+0000 7f79d848f740 1 --2- 172.21.15.92:0/944479255 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x565527142160 0x565527144580 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:59.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.249+0000 7f79d848f740 1 --2- 172.21.15.92:0/944479255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5655270c6370 0x5655270d1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:59.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.249+0000 7f79b67fc640 0 client.17538 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:05:59.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.249+0000 7f79d848f740 1 --2- 172.21.15.92:0/944479255 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5655270c12e0 0x5655270d04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:59.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.249+0000 7f79d848f740 1 --2- 172.21.15.92:0/944479255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655270c09a0 0x5655270cffb0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:59.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.249+0000 7f79d848f740 1 -- 172.21.15.92:0/944479255 >> 172.21.15.92:0/944479255 conn(0x5655270bc010 msgr2=0x5655270bc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:59.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.249+0000 7f79d848f740 1 -- 172.21.15.92:0/944479255 shutdown_connections 2024-09-19T09:05:59.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.249+0000 7f79d848f740 1 -- 172.21.15.92:0/944479255 wait complete. 2024-09-19T09:05:59.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.249+0000 7f79d848f740 20 client.17538 trim_cache size 0 max 16384 2024-09-19T09:05:59.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:05:59.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:05:59.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:05:59.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:05:59.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.249+0000 7f79d561e640 1 -- 172.21.15.92:0/2629999356 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f79bc0a32f0 msgr2=0x7f79bc0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:59.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.249+0000 7f79d561e640 1 --2- 172.21.15.92:0/2629999356 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f79bc0a32f0 0x7f79bc0a57b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f79c8005fd0 tx=0x7f79c80097f0 comp rx=0 tx=0).stop 2024-09-19T09:05:59.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.249+0000 7f79d561e640 1 -- 172.21.15.92:0/2629999356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79d01003d0 msgr2=0x7f79d019e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:59.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.249+0000 7f79d561e640 1 --2- 172.21.15.92:0/2629999356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79d01003d0 0x7f79d019e3d0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f79c000d770 tx=0x7f79c000dc30 comp rx=0 tx=0).stop 2024-09-19T09:05:59.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.249+0000 7f79d561e640 1 -- 172.21.15.92:0/2629999356 shutdown_connections 2024-09-19T09:05:59.254 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.249+0000 7f79d561e640 1 --2- 172.21.15.92:0/2629999356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79d01056d0 0x7f79d01a5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:59.254 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.249+0000 7f79d561e640 1 --2- 172.21.15.92:0/2629999356 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79d0102d20 0x7f79d019e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:59.254 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.249+0000 7f79d561e640 1 --2- 172.21.15.92:0/2629999356 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f79bc0a32f0 0x7f79bc0a57b0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:59.254 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.249+0000 7f79d561e640 1 --2- 172.21.15.92:0/2629999356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79d01003d0 0x7f79d019e3d0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:59.254 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.249+0000 7f79d561e640 1 -- 172.21.15.92:0/2629999356 >> 172.21.15.92:0/2629999356 conn(0x7f79d00fc1e0 msgr2=0x7f79d0100cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:59.254 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.249+0000 7f79d561e640 1 -- 172.21.15.92:0/2629999356 shutdown_connections 2024-09-19T09:05:59.254 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:05:59.249+0000 7f79d561e640 1 -- 172.21.15.92:0/2629999356 wait complete. 2024-09-19T09:05:59.502 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:05:59.748 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:59.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:59 smithi092 ceph-mon[31407]: pgmap v615: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 44 MiB/s wr, 1.65k op/s 2024-09-19T09:05:59.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:05:59 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/504068634' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:05:59.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:59 smithi167 ceph-mon[35359]: pgmap v615: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 44 MiB/s wr, 1.65k op/s 2024-09-19T09:05:59.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:05:59 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/504068634' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:05:59.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:59 smithi190 ceph-mon[35358]: pgmap v615: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 44 MiB/s wr, 1.65k op/s 2024-09-19T09:05:59.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:05:59 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/504068634' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:06:00.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.442+0000 7f02473d6640 1 -- 172.21.15.92:0/828670918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02401036e0 msgr2=0x7f0240107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:00.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.442+0000 7f02473d6640 1 --2- 172.21.15.92:0/828670918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02401036e0 0x7f0240107b90 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f0230009930 tx=0x7f023002a420 comp rx=0 tx=0).stop 2024-09-19T09:06:00.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.442+0000 7f02473d6640 1 -- 172.21.15.92:0/828670918 shutdown_connections 2024-09-19T09:06:00.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.442+0000 7f02473d6640 1 --2- 172.21.15.92:0/828670918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02401082a0 0x7f024010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:00.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.442+0000 7f02473d6640 1 --2- 172.21.15.92:0/828670918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02401036e0 0x7f0240107b90 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:00.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.442+0000 7f02473d6640 1 --2- 172.21.15.92:0/828670918 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0240102d30 0x7f0240103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:00.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.442+0000 7f02473d6640 1 -- 172.21.15.92:0/828670918 >> 172.21.15.92:0/828670918 conn(0x7f02400fc7d0 msgr2=0x7f02400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:00.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.442+0000 7f02473d6640 1 -- 172.21.15.92:0/828670918 shutdown_connections 2024-09-19T09:06:00.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.442+0000 7f02473d6640 1 -- 172.21.15.92:0/828670918 wait complete. 2024-09-19T09:06:00.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.443+0000 7f02473d6640 1 Processor -- start 2024-09-19T09:06:00.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.443+0000 7f02473d6640 1 -- start start 2024-09-19T09:06:00.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.443+0000 7f02473d6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0240102d30 0x7f0240198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:00.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.443+0000 7f02473d6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02401036e0 0x7f0240198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:00.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.443+0000 7f02473d6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02401082a0 0x7f024019ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:00.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.443+0000 7f02473d6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f02401120a0 con 0x7f0240102d30 2024-09-19T09:06:00.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.443+0000 7f02473d6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0240111f20 con 0x7f02401082a0 2024-09-19T09:06:00.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.443+0000 7f02473d6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0240112220 con 0x7f02401036e0 2024-09-19T09:06:00.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.443+0000 7f0245172640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0240102d30 0x7f0240198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:00.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.443+0000 7f0245172640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0240102d30 0x7f0240198600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51058/0 (socket says 172.21.15.92:51058) 2024-09-19T09:06:00.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.443+0000 7f0245172640 1 -- 172.21.15.92:0/2648789314 learned_addr learned my addr 172.21.15.92:0/2648789314 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:00.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.443+0000 7f0244971640 1 --2- 172.21.15.92:0/2648789314 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02401036e0 0x7f0240198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:00.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.444+0000 7f0245973640 1 --2- 172.21.15.92:0/2648789314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02401082a0 0x7f024019ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:00.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.444+0000 7f0245172640 1 -- 172.21.15.92:0/2648789314 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02401036e0 msgr2=0x7f0240198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:00.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.444+0000 7f0245172640 1 --2- 172.21.15.92:0/2648789314 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02401036e0 0x7f0240198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:00.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.444+0000 7f0245172640 1 -- 172.21.15.92:0/2648789314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02401082a0 msgr2=0x7f024019ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:00.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.444+0000 7f0245172640 1 --2- 172.21.15.92:0/2648789314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02401082a0 0x7f024019ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:00.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.444+0000 7f0245172640 1 -- 172.21.15.92:0/2648789314 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f024019d5b0 con 0x7f0240102d30 2024-09-19T09:06:00.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.444+0000 7f0244971640 1 --2- 172.21.15.92:0/2648789314 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02401036e0 0x7f0240198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:06:00.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.444+0000 7f0245172640 1 --2- 172.21.15.92:0/2648789314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0240102d30 0x7f0240198600 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f023c00e9f0 tx=0x7f023c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:00.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.444+0000 7f02367fc640 1 -- 172.21.15.92:0/2648789314 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023c00cd80 con 0x7f0240102d30 2024-09-19T09:06:00.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.444+0000 7f02367fc640 1 -- 172.21.15.92:0/2648789314 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f023c005500 con 0x7f0240102d30 2024-09-19T09:06:00.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.444+0000 7f02473d6640 1 -- 172.21.15.92:0/2648789314 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f024019d8a0 con 0x7f0240102d30 2024-09-19T09:06:00.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.444+0000 7f02367fc640 1 -- 172.21.15.92:0/2648789314 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023c010690 con 0x7f0240102d30 2024-09-19T09:06:00.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.444+0000 7f02473d6640 1 -- 172.21.15.92:0/2648789314 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02401a5180 con 0x7f0240102d30 2024-09-19T09:06:00.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.447+0000 7f02367fc640 1 -- 172.21.15.92:0/2648789314 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f023c0046c0 con 0x7f0240102d30 2024-09-19T09:06:00.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.447+0000 7f02497af740 1 Processor -- start 2024-09-19T09:06:00.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.447+0000 7f02497af740 1 -- start start 2024-09-19T09:06:00.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.447+0000 7f02497af740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b8aa11b40 0x561b8aa10090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:00.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.447+0000 7f02497af740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b8aa105d0 0x561b8aa10a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:00.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.447+0000 7f02497af740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b8aa1b370 0x561b8aa1d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:00.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.447+0000 7f02497af740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561b8a9762f0 con 0x561b8aa11b40 2024-09-19T09:06:00.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.447+0000 7f02497af740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561b8a91dcf0 con 0x561b8aa1b370 2024-09-19T09:06:00.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.447+0000 7f02497af740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x561b8a9722b0 con 0x561b8aa105d0 2024-09-19T09:06:00.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.448+0000 7f0245973640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b8aa11b40 0x561b8aa10090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:00.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.448+0000 7f0244971640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b8aa1b370 0x561b8aa1d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:00.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.448+0000 7f0245973640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b8aa11b40 0x561b8aa10090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51070/0 (socket says 172.21.15.92:51070) 2024-09-19T09:06:00.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.448+0000 7f0245973640 1 -- 172.21.15.92:0/2637683485 learned_addr learned my addr 172.21.15.92:0/2637683485 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:00.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.448+0000 7f0245172640 1 --2- 172.21.15.92:0/2637683485 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b8aa105d0 0x561b8aa10a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:00.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.448+0000 7f0244971640 1 -- 172.21.15.92:0/2637683485 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b8aa105d0 msgr2=0x561b8aa10a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:00.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.448+0000 7f0244971640 1 --2- 172.21.15.92:0/2637683485 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b8aa105d0 0x561b8aa10a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:00.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.448+0000 7f0244971640 1 -- 172.21.15.92:0/2637683485 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b8aa11b40 msgr2=0x561b8aa10090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:00.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.448+0000 7f0244971640 1 --2- 172.21.15.92:0/2637683485 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b8aa11b40 0x561b8aa10090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:00.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.448+0000 7f0244971640 1 -- 172.21.15.92:0/2637683485 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b8a9023a0 con 0x561b8aa1b370 2024-09-19T09:06:00.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.448+0000 7f02367fc640 1 --2- 172.21.15.92:0/2648789314 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f022c0a3240 0x7f022c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:00.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.448+0000 7f0244971640 1 --2- 172.21.15.92:0/2637683485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b8aa1b370 0x561b8aa1d760 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f023002a940 tx=0x7f0230005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29c5886927e7d77f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:00.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.448+0000 7f02367fc640 1 -- 172.21.15.92:0/2648789314 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f023c0cfcf0 con 0x7f0240102d30 2024-09-19T09:06:00.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.448+0000 7f0245973640 1 --2- 172.21.15.92:0/2648789314 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f022c0a3240 0x7f022c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:00.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.449+0000 7f022b7fe640 1 -- 172.21.15.92:0/2637683485 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0230040070 con 0x561b8aa1b370 2024-09-19T09:06:00.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.449+0000 7f022b7fe640 1 -- 172.21.15.92:0/2637683485 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02300318b0 con 0x561b8aa1b370 2024-09-19T09:06:00.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.449+0000 7f022b7fe640 1 -- 172.21.15.92:0/2637683485 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0230035040 con 0x561b8aa1b370 2024-09-19T09:06:00.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.449+0000 7f02497af740 1 -- 172.21.15.92:0/2637683485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b8aa1b370 msgr2=0x561b8aa1d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:00.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.449+0000 7f02497af740 1 --2- 172.21.15.92:0/2637683485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b8aa1b370 0x561b8aa1d760 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f023002a940 tx=0x7f0230005e80 comp rx=0 tx=0).stop 2024-09-19T09:06:00.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.449+0000 7f02497af740 1 -- 172.21.15.92:0/2637683485 shutdown_connections 2024-09-19T09:06:00.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.449+0000 7f02497af740 1 --2- 172.21.15.92:0/2637683485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b8aa1b370 0x561b8aa1d760 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:00.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.449+0000 7f02497af740 1 --2- 172.21.15.92:0/2637683485 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b8aa105d0 0x561b8aa10a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:00.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.449+0000 7f02497af740 1 --2- 172.21.15.92:0/2637683485 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b8aa11b40 0x561b8aa10090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:00.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.449+0000 7f02497af740 1 -- 172.21.15.92:0/2637683485 >> 172.21.15.92:0/2637683485 conn(0x561b8a9d9310 msgr2=0x561b8aa0cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:00.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.449+0000 7f02497af740 1 -- 172.21.15.92:0/2637683485 shutdown_connections 2024-09-19T09:06:00.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.450+0000 7f0245973640 1 --2- 172.21.15.92:0/2648789314 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f022c0a3240 0x7f022c0a5700 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0238005f40 tx=0x7f0238009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:00.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.450+0000 7f02497af740 1 -- 172.21.15.92:0/2637683485 wait complete. 2024-09-19T09:06:00.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.450+0000 7f02497af740 1 -- start start 2024-09-19T09:06:00.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.450+0000 7f02497af740 1 Processor -- start 2024-09-19T09:06:00.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.450+0000 7f02497af740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b8aa105d0 0x561b8aa1ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:00.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.450+0000 7f02497af740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b8aa11b40 0x561b8aa18040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:00.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.450+0000 7f02497af740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b8aa1b370 0x561b8aa18650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:00.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.450+0000 7f02497af740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561b8aa22420 con 0x561b8aa105d0 2024-09-19T09:06:00.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.450+0000 7f02497af740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561b8a931060 con 0x561b8aa1b370 2024-09-19T09:06:00.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.450+0000 7f02497af740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x561b8aa225a0 con 0x561b8aa11b40 2024-09-19T09:06:00.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.450+0000 7f02497af740 10 client.0 _ll_register_callbacks cb 0x561b8a6848c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:00.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.451+0000 7f0245172640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b8aa105d0 0x561b8aa1ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:00.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.451+0000 7f0245172640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b8aa105d0 0x561b8aa1ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51076/0 (socket says 172.21.15.92:51076) 2024-09-19T09:06:00.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.451+0000 7f0245172640 1 -- 172.21.15.92:0/871058930 learned_addr learned my addr 172.21.15.92:0/871058930 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:00.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.451+0000 7f0244971640 1 --2- 172.21.15.92:0/871058930 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b8aa11b40 0x561b8aa18040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:00.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.451+0000 7f0245973640 1 --2- 172.21.15.92:0/871058930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b8aa1b370 0x561b8aa18650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:00.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.451+0000 7f0245172640 1 -- 172.21.15.92:0/871058930 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b8aa11b40 msgr2=0x561b8aa18040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:00.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.451+0000 7f0245172640 1 --2- 172.21.15.92:0/871058930 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b8aa11b40 0x561b8aa18040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:00.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.451+0000 7f0245172640 1 -- 172.21.15.92:0/871058930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b8aa1b370 msgr2=0x561b8aa18650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:00.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.451+0000 7f0245172640 1 --2- 172.21.15.92:0/871058930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b8aa1b370 0x561b8aa18650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:00.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.451+0000 7f0245172640 1 -- 172.21.15.92:0/871058930 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b8a6e73c0 con 0x561b8aa105d0 2024-09-19T09:06:00.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.451+0000 7f0245172640 1 --2- 172.21.15.92:0/871058930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b8aa105d0 0x561b8aa1ad90 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f023c09c010 tx=0x7f023c00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58192c3cd8eb6199 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:00.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.451+0000 7f0228ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:06:00.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.451+0000 7f0228ff9640 1 -- 172.21.15.92:0/871058930 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023c09be50 con 0x561b8aa105d0 2024-09-19T09:06:00.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.451+0000 7f0228ff9640 1 -- 172.21.15.92:0/871058930 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f023c0a4cf0 con 0x561b8aa105d0 2024-09-19T09:06:00.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.451+0000 7f02497af740 1 -- 172.21.15.92:0/871058930 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02300318b0 con 0x561b8aa105d0 2024-09-19T09:06:00.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.452+0000 7f0228ff9640 1 -- 172.21.15.92:0/871058930 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f023c09bc70 con 0x561b8aa105d0 2024-09-19T09:06:00.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.452+0000 7f02497af740 10 client.17550 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:00.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.452+0000 7f02497af740 1 -- 172.21.15.92:0/871058930 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x561b8aa1ddd0 con 0x561b8aa105d0 2024-09-19T09:06:00.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.452+0000 7f0228ff9640 1 -- 172.21.15.92:0/871058930 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f023c09ca10 con 0x561b8aa105d0 2024-09-19T09:06:00.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.452+0000 7f0228ff9640 1 -- 172.21.15.92:0/871058930 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f023c09b830 con 0x561b8aa105d0 2024-09-19T09:06:00.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.453+0000 7f02497af740 10 client.17550 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:00.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.453+0000 7f02497af740 10 client.17550 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:06:00.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.453+0000 7f02497af740 20 client.17550 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:00.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.453+0000 7f02497af740 1 --2- 172.21.15.92:0/871058930 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561b8aa1f290 0x561b8aa216e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:00.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.453+0000 7f02497af740 4 client.17550 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:06:00.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.453+0000 7f02497af740 1 -- 172.21.15.92:0/871058930 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f02300318b0 con 0x561b8aa1f290 2024-09-19T09:06:00.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.453+0000 7f0244971640 1 --2- 172.21.15.92:0/871058930 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561b8aa1f290 0x561b8aa216e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:00.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.453+0000 7f0244971640 1 --2- 172.21.15.92:0/871058930 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561b8aa1f290 0x561b8aa216e0 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c1e494e4044cb19 server_cookie=5f7d66f545f0cc03 in_seq=0 out_seq=0 2024-09-19T09:06:00.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.453+0000 7f0228ff9640 10 client.17550 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:00.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.454+0000 7f0228ff9640 1 -- 172.21.15.92:0/871058930 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f02300318b0 con 0x561b8aa1f290 2024-09-19T09:06:00.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.454+0000 7f0228ff9640 10 client.17550 handle_command_reply: tid=0 2024-09-19T09:06:00.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.454+0000 7f02497af740 1 client.17550 shutdown 2024-09-19T09:06:00.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.454+0000 7f02497af740 1 -- 172.21.15.92:0/871058930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b8aa105d0 msgr2=0x561b8aa1ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:00.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.454+0000 7f02497af740 1 --2- 172.21.15.92:0/871058930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b8aa105d0 0x561b8aa1ad90 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f023c09c010 tx=0x7f023c00cf20 comp rx=0 tx=0).stop 2024-09-19T09:06:00.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.454+0000 7f02497af740 1 -- 172.21.15.92:0/871058930 shutdown_connections 2024-09-19T09:06:00.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.454+0000 7f02497af740 1 --2- 172.21.15.92:0/871058930 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561b8aa1f290 0x561b8aa216e0 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:00.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.454+0000 7f02497af740 1 --2- 172.21.15.92:0/871058930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b8aa1b370 0x561b8aa18650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:00.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.454+0000 7f02497af740 1 --2- 172.21.15.92:0/871058930 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b8aa11b40 0x561b8aa18040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:00.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.454+0000 7f02497af740 1 --2- 172.21.15.92:0/871058930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b8aa105d0 0x561b8aa1ad90 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:00.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.454+0000 7f0228ff9640 0 client.17550 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:00.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.454+0000 7f02497af740 1 -- 172.21.15.92:0/871058930 >> 172.21.15.92:0/871058930 conn(0x561b8a9d9310 msgr2=0x561b8aa129c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:00.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.455+0000 7f02497af740 1 -- 172.21.15.92:0/871058930 shutdown_connections 2024-09-19T09:06:00.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.455+0000 7f02497af740 1 -- 172.21.15.92:0/871058930 wait complete. 2024-09-19T09:06:00.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.455+0000 7f02497af740 20 client.17550 trim_cache size 0 max 16384 2024-09-19T09:06:00.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.468+0000 7f02497af740 1 Processor -- start 2024-09-19T09:06:00.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.468+0000 7f02497af740 1 -- start start 2024-09-19T09:06:00.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.468+0000 7f02497af740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b8aa105d0 0x561b8aa0ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:00.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.468+0000 7f02497af740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b8aa11b40 0x561b8aa2b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:00.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.468+0000 7f02497af740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b8aa1b370 0x561b8aa32e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:00.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.468+0000 7f02497af740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f02401a9390 con 0x561b8aa11b40 2024-09-19T09:06:00.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.468+0000 7f02497af740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f02401abc30 con 0x561b8aa1b370 2024-09-19T09:06:00.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.468+0000 7f02497af740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f02401a9a20 con 0x561b8aa105d0 2024-09-19T09:06:00.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.468+0000 7f0244971640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b8aa11b40 0x561b8aa2b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:00.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.468+0000 7f0244971640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b8aa11b40 0x561b8aa2b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51086/0 (socket says 172.21.15.92:51086) 2024-09-19T09:06:00.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.468+0000 7f0244971640 1 -- 172.21.15.92:0/3013835050 learned_addr learned my addr 172.21.15.92:0/3013835050 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:00.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.468+0000 7f0245172640 1 --2- 172.21.15.92:0/3013835050 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b8aa105d0 0x561b8aa0ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:00.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.468+0000 7f0245973640 1 --2- 172.21.15.92:0/3013835050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b8aa1b370 0x561b8aa32e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:00.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.468+0000 7f0244971640 1 -- 172.21.15.92:0/3013835050 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b8aa105d0 msgr2=0x561b8aa0ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:00.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.468+0000 7f0244971640 1 --2- 172.21.15.92:0/3013835050 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b8aa105d0 0x561b8aa0ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:00.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.468+0000 7f0244971640 1 -- 172.21.15.92:0/3013835050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b8aa1b370 msgr2=0x561b8aa32e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:00.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.468+0000 7f0244971640 1 --2- 172.21.15.92:0/3013835050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b8aa1b370 0x561b8aa32e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:00.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.468+0000 7f0244971640 1 -- 172.21.15.92:0/3013835050 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b8aa224c0 con 0x561b8aa11b40 2024-09-19T09:06:00.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.468+0000 7f0245172640 1 --2- 172.21.15.92:0/3013835050 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b8aa105d0 0x561b8aa0ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:00.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.468+0000 7f0244971640 1 --2- 172.21.15.92:0/3013835050 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b8aa11b40 0x561b8aa2b840 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f023002a940 tx=0x7f023002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e799888e0345e2bf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:00.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.469+0000 7f022affd640 1 -- 172.21.15.92:0/3013835050 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0230035040 con 0x561b8aa11b40 2024-09-19T09:06:00.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.469+0000 7f022affd640 1 -- 172.21.15.92:0/3013835050 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0230053070 con 0x561b8aa11b40 2024-09-19T09:06:00.471 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.469+0000 7f022affd640 1 -- 172.21.15.92:0/3013835050 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0230040040 con 0x561b8aa11b40 2024-09-19T09:06:00.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.469+0000 7f02497af740 1 -- 172.21.15.92:0/3013835050 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b8aa11b40 msgr2=0x561b8aa2b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:00.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.469+0000 7f02497af740 1 --2- 172.21.15.92:0/3013835050 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b8aa11b40 0x561b8aa2b840 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f023002a940 tx=0x7f023002a420 comp rx=0 tx=0).stop 2024-09-19T09:06:00.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.469+0000 7f02497af740 1 -- 172.21.15.92:0/3013835050 shutdown_connections 2024-09-19T09:06:00.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.469+0000 7f02497af740 1 --2- 172.21.15.92:0/3013835050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b8aa1b370 0x561b8aa32e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:00.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.469+0000 7f02497af740 1 --2- 172.21.15.92:0/3013835050 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b8aa11b40 0x561b8aa2b840 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:00.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.469+0000 7f02497af740 1 --2- 172.21.15.92:0/3013835050 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b8aa105d0 0x561b8aa0ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:00.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.469+0000 7f02497af740 1 -- 172.21.15.92:0/3013835050 >> 172.21.15.92:0/3013835050 conn(0x561b8a9d9310 msgr2=0x561b8aa0c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:00.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.469+0000 7f02497af740 1 -- 172.21.15.92:0/3013835050 shutdown_connections 2024-09-19T09:06:00.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.469+0000 7f02497af740 1 -- 172.21.15.92:0/3013835050 wait complete. 2024-09-19T09:06:00.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.470+0000 7f02497af740 1 -- start start 2024-09-19T09:06:00.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.470+0000 7f02497af740 1 Processor -- start 2024-09-19T09:06:00.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.470+0000 7f02497af740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b8aa105d0 0x561b8aa314b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:00.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.470+0000 7f02497af740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b8aa11b40 0x561b8aa319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:00.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.470+0000 7f02497af740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b8aa1b370 0x561b8aa8eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:00.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.470+0000 7f02497af740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f02401aa0f0 con 0x561b8aa1b370 2024-09-19T09:06:00.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.470+0000 7f02497af740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f02401ab560 con 0x561b8aa11b40 2024-09-19T09:06:00.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.470+0000 7f02497af740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f02401aa7c0 con 0x561b8aa105d0 2024-09-19T09:06:00.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.470+0000 7f02497af740 10 client.0 _ll_register_callbacks cb 0x7f023c0baf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:00.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.470+0000 7f0245973640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b8aa1b370 0x561b8aa8eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:00.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.470+0000 7f0245973640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b8aa1b370 0x561b8aa8eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51098/0 (socket says 172.21.15.92:51098) 2024-09-19T09:06:00.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.470+0000 7f0245973640 1 -- 172.21.15.92:0/1570064185 learned_addr learned my addr 172.21.15.92:0/1570064185 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:00.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.470+0000 7f0244971640 1 --2- 172.21.15.92:0/1570064185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b8aa11b40 0x561b8aa319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:00.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.470+0000 7f0245172640 1 --2- 172.21.15.92:0/1570064185 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b8aa105d0 0x561b8aa314b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:00.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.471+0000 7f0245973640 1 -- 172.21.15.92:0/1570064185 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b8aa105d0 msgr2=0x561b8aa314b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:00.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.471+0000 7f0245973640 1 --2- 172.21.15.92:0/1570064185 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b8aa105d0 0x561b8aa314b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:00.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.471+0000 7f0245973640 1 -- 172.21.15.92:0/1570064185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b8aa11b40 msgr2=0x561b8aa319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:00.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.471+0000 7f0245973640 1 --2- 172.21.15.92:0/1570064185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b8aa11b40 0x561b8aa319f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:00.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.471+0000 7f0245973640 1 -- 172.21.15.92:0/1570064185 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b8aa8f510 con 0x561b8aa1b370 2024-09-19T09:06:00.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.471+0000 7f0244971640 1 --2- 172.21.15.92:0/1570064185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b8aa11b40 0x561b8aa319f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:06:00.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.471+0000 7f0245973640 1 --2- 172.21.15.92:0/1570064185 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b8aa1b370 0x561b8aa8eed0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f0238009fd0 tx=0x7f0238004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f438270ad439b6d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:00.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.471+0000 7f0228ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:06:00.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.471+0000 7f0228ff9640 1 -- 172.21.15.92:0/1570064185 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023802f060 con 0x561b8aa1b370 2024-09-19T09:06:00.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.471+0000 7f0228ff9640 1 -- 172.21.15.92:0/1570064185 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f0238020d40 con 0x561b8aa1b370 2024-09-19T09:06:00.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.471+0000 7f02497af740 1 -- 172.21.15.92:0/1570064185 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0230053070 con 0x561b8aa1b370 2024-09-19T09:06:00.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.471+0000 7f0228ff9640 1 -- 172.21.15.92:0/1570064185 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f023801d400 con 0x561b8aa1b370 2024-09-19T09:06:00.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.471+0000 7f02497af740 10 client.17556 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:00.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.471+0000 7f02497af740 1 -- 172.21.15.92:0/1570064185 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x561b8aa968a0 con 0x561b8aa1b370 2024-09-19T09:06:00.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.471+0000 7f0228ff9640 1 -- 172.21.15.92:0/1570064185 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0230053070 con 0x561b8aa1b370 2024-09-19T09:06:00.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.472+0000 7f0228ff9640 1 -- 172.21.15.92:0/1570064185 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f0238034070 con 0x561b8aa1b370 2024-09-19T09:06:00.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.472+0000 7f02497af740 10 client.17556 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:00.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.472+0000 7f02497af740 10 client.17556 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:06:00.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.472+0000 7f02497af740 20 client.17556 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:00.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.472+0000 7f02497af740 1 --2- 172.21.15.92:0/1570064185 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561b8aa96fd0 0x561b8aa993f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:00.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.472+0000 7f02497af740 4 client.17556 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:06:00.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.472+0000 7f02497af740 1 -- 172.21.15.92:0/1570064185 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561b8a983860 con 0x561b8aa96fd0 2024-09-19T09:06:00.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.472+0000 7f0245172640 1 --2- 172.21.15.92:0/1570064185 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561b8aa96fd0 0x561b8aa993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:00.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.473+0000 7f0245172640 1 --2- 172.21.15.92:0/1570064185 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561b8aa96fd0 0x561b8aa993f0 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=841c70a43ddece76 server_cookie=a58e253c18272e5a in_seq=0 out_seq=0 2024-09-19T09:06:00.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.473+0000 7f0228ff9640 10 client.17556 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:00.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.473+0000 7f0228ff9640 1 -- 172.21.15.92:0/1570064185 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561b8a983860 con 0x561b8aa96fd0 2024-09-19T09:06:00.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.473+0000 7f0228ff9640 10 client.17556 handle_command_reply: tid=0 2024-09-19T09:06:00.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.473+0000 7f02497af740 1 client.17556 shutdown 2024-09-19T09:06:00.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.473+0000 7f02497af740 1 -- 172.21.15.92:0/1570064185 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b8aa1b370 msgr2=0x561b8aa8eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:00.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.473+0000 7f02497af740 1 --2- 172.21.15.92:0/1570064185 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b8aa1b370 0x561b8aa8eed0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f0238009fd0 tx=0x7f0238004a40 comp rx=0 tx=0).stop 2024-09-19T09:06:00.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.473+0000 7f02497af740 1 -- 172.21.15.92:0/1570064185 shutdown_connections 2024-09-19T09:06:00.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.473+0000 7f02497af740 1 --2- 172.21.15.92:0/1570064185 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561b8aa96fd0 0x561b8aa993f0 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:00.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.473+0000 7f02497af740 1 --2- 172.21.15.92:0/1570064185 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b8aa1b370 0x561b8aa8eed0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:00.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.473+0000 7f02497af740 1 --2- 172.21.15.92:0/1570064185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b8aa11b40 0x561b8aa319f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:00.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.473+0000 7f0228ff9640 0 client.17556 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:00.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.473+0000 7f02497af740 1 --2- 172.21.15.92:0/1570064185 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561b8aa105d0 0x561b8aa314b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:00.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.473+0000 7f02497af740 1 -- 172.21.15.92:0/1570064185 >> 172.21.15.92:0/1570064185 conn(0x561b8a9d9310 msgr2=0x561b8aa121a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:00.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.473+0000 7f02497af740 1 -- 172.21.15.92:0/1570064185 shutdown_connections 2024-09-19T09:06:00.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.473+0000 7f02497af740 1 -- 172.21.15.92:0/1570064185 wait complete. 2024-09-19T09:06:00.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.473+0000 7f02497af740 20 client.17556 trim_cache size 0 max 16384 2024-09-19T09:06:00.479 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-19T09:06:00.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.474+0000 7f02473d6640 1 -- 172.21.15.92:0/2648789314 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f022c0a3240 msgr2=0x7f022c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:00.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.474+0000 7f02473d6640 1 --2- 172.21.15.92:0/2648789314 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f022c0a3240 0x7f022c0a5700 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0238005f40 tx=0x7f0238009600 comp rx=0 tx=0).stop 2024-09-19T09:06:00.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.474+0000 7f02473d6640 1 -- 172.21.15.92:0/2648789314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0240102d30 msgr2=0x7f0240198600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:00.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.474+0000 7f02473d6640 1 --2- 172.21.15.92:0/2648789314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0240102d30 0x7f0240198600 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f023c00e9f0 tx=0x7f023c00edf0 comp rx=0 tx=0).stop 2024-09-19T09:06:00.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.474+0000 7f02473d6640 1 -- 172.21.15.92:0/2648789314 shutdown_connections 2024-09-19T09:06:00.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.474+0000 7f02473d6640 1 --2- 172.21.15.92:0/2648789314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02401082a0 0x7f024019ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:00.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.474+0000 7f02473d6640 1 --2- 172.21.15.92:0/2648789314 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02401036e0 0x7f0240198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:00.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.474+0000 7f02473d6640 1 --2- 172.21.15.92:0/2648789314 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f022c0a3240 0x7f022c0a5700 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:00.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.474+0000 7f02473d6640 1 --2- 172.21.15.92:0/2648789314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0240102d30 0x7f0240198600 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:00.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.474+0000 7f02473d6640 1 -- 172.21.15.92:0/2648789314 >> 172.21.15.92:0/2648789314 conn(0x7f02400fc7d0 msgr2=0x7f0240105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:00.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.474+0000 7f02473d6640 1 -- 172.21.15.92:0/2648789314 shutdown_connections 2024-09-19T09:06:00.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:00.474+0000 7f02473d6640 1 -- 172.21.15.92:0/2648789314 wait complete. 2024-09-19T09:06:00.795 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 555.0 s, 773.1 tps, lat 42.370 ms stddev 52.231 2024-09-19T09:06:01.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:01 smithi167 ceph-mon[35359]: pgmap v616: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 44 MiB/s wr, 1.67k op/s 2024-09-19T09:06:01.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:01 smithi190 ceph-mon[35358]: pgmap v616: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 44 MiB/s wr, 1.67k op/s 2024-09-19T09:06:02.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:01 smithi092 ceph-mon[31407]: pgmap v616: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 44 MiB/s wr, 1.67k op/s 2024-09-19T09:06:02.118 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:06:02.118 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:06:02.384 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:06:02.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.885+0000 7efd6e74c640 1 -- 172.21.15.92:0/3141769364 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd68102570 msgr2=0x7efd681029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:02.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.885+0000 7efd6e74c640 1 --2- 172.21.15.92:0/3141769364 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd68102570 0x7efd681029b0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7efd50009900 tx=0x7efd5002a480 comp rx=0 tx=0).stop 2024-09-19T09:06:02.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.885+0000 7efd6e74c640 1 -- 172.21.15.92:0/3141769364 shutdown_connections 2024-09-19T09:06:02.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.885+0000 7efd6e74c640 1 --2- 172.21.15.92:0/3141769364 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efd68102ef0 0x7efd6810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:02.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.885+0000 7efd6e74c640 1 --2- 172.21.15.92:0/3141769364 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd68102570 0x7efd681029b0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:02.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.885+0000 7efd6e74c640 1 --2- 172.21.15.92:0/3141769364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd68100e20 0x7efd68101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:02.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.885+0000 7efd6e74c640 1 -- 172.21.15.92:0/3141769364 >> 172.21.15.92:0/3141769364 conn(0x7efd680fc7d0 msgr2=0x7efd680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:02.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.885+0000 7efd6e74c640 1 -- 172.21.15.92:0/3141769364 shutdown_connections 2024-09-19T09:06:02.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.885+0000 7efd6e74c640 1 -- 172.21.15.92:0/3141769364 wait complete. 2024-09-19T09:06:02.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.886+0000 7efd6e74c640 1 Processor -- start 2024-09-19T09:06:02.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.886+0000 7efd6e74c640 1 -- start start 2024-09-19T09:06:02.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.886+0000 7efd6e74c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd68100e20 0x7efd681a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:02.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.886+0000 7efd6e74c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efd68102570 0x7efd681a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:02.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.886+0000 7efd6e74c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd68102ef0 0x7efd6819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:02.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.886+0000 7efd6e74c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efd68110f80 con 0x7efd68100e20 2024-09-19T09:06:02.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.886+0000 7efd6e74c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efd68110e00 con 0x7efd68102ef0 2024-09-19T09:06:02.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.886+0000 7efd6e74c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7efd68111100 con 0x7efd68102570 2024-09-19T09:06:02.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.886+0000 7efd67fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd68100e20 0x7efd681a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:02.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.886+0000 7efd67fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd68100e20 0x7efd681a03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48210/0 (socket says 172.21.15.92:48210) 2024-09-19T09:06:02.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.886+0000 7efd67fff640 1 -- 172.21.15.92:0/1683687926 learned_addr learned my addr 172.21.15.92:0/1683687926 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:02.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.886+0000 7efd6cce9640 1 --2- 172.21.15.92:0/1683687926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd68102ef0 0x7efd6819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:02.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.886+0000 7efd5ffff640 1 --2- 172.21.15.92:0/1683687926 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efd68102570 0x7efd681a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:02.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.886+0000 7efd67fff640 1 -- 172.21.15.92:0/1683687926 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efd68102570 msgr2=0x7efd681a0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:02.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.886+0000 7efd67fff640 1 --2- 172.21.15.92:0/1683687926 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efd68102570 0x7efd681a0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:02.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.886+0000 7efd67fff640 1 -- 172.21.15.92:0/1683687926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd68102ef0 msgr2=0x7efd6819a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:02.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.886+0000 7efd67fff640 1 --2- 172.21.15.92:0/1683687926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd68102ef0 0x7efd6819a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:02.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.886+0000 7efd67fff640 1 -- 172.21.15.92:0/1683687926 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd6819acc0 con 0x7efd68100e20 2024-09-19T09:06:02.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.886+0000 7efd5ffff640 1 --2- 172.21.15.92:0/1683687926 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efd68102570 0x7efd681a0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:02.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.887+0000 7efd67fff640 1 --2- 172.21.15.92:0/1683687926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd68100e20 0x7efd681a03d0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7efd5800d950 tx=0x7efd5800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:02.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.887+0000 7efd65ffb640 1 -- 172.21.15.92:0/1683687926 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd58017070 con 0x7efd68100e20 2024-09-19T09:06:02.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.887+0000 7efd6e74c640 1 -- 172.21.15.92:0/1683687926 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd6819afb0 con 0x7efd68100e20 2024-09-19T09:06:02.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.887+0000 7efd65ffb640 1 -- 172.21.15.92:0/1683687926 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd58009c30 con 0x7efd68100e20 2024-09-19T09:06:02.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.887+0000 7efd65ffb640 1 -- 172.21.15.92:0/1683687926 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd5800f6b0 con 0x7efd68100e20 2024-09-19T09:06:02.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.887+0000 7efd6e74c640 1 -- 172.21.15.92:0/1683687926 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd681a72a0 con 0x7efd68100e20 2024-09-19T09:06:02.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.889+0000 7efd65ffb640 1 -- 172.21.15.92:0/1683687926 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7efd580109d0 con 0x7efd68100e20 2024-09-19T09:06:02.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.889+0000 7efd70b25740 1 Processor -- start 2024-09-19T09:06:02.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.890+0000 7efd70b25740 1 -- start start 2024-09-19T09:06:02.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.890+0000 7efd70b25740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559879d0bb60 0x559879d0bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:02.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.890+0000 7efd70b25740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559879d0c480 0x559879d16800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:02.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.890+0000 7efd70b25740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559879d16d40 0x559879d19130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:02.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.890+0000 7efd70b25740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559879c71280 con 0x559879d0bb60 2024-09-19T09:06:02.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.890+0000 7efd70b25740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559879c18b10 con 0x559879d0c480 2024-09-19T09:06:02.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.890+0000 7efd70b25740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x559879c6d240 con 0x559879d16d40 2024-09-19T09:06:02.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.890+0000 7efd6cce9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559879d0bb60 0x559879d0bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:02.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.890+0000 7efd6cce9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559879d0bb60 0x559879d0bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48216/0 (socket says 172.21.15.92:48216) 2024-09-19T09:06:02.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.890+0000 7efd6cce9640 1 -- 172.21.15.92:0/2089902127 learned_addr learned my addr 172.21.15.92:0/2089902127 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:02.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.890+0000 7efd67fff640 1 --2- 172.21.15.92:0/2089902127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559879d0c480 0x559879d16800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:02.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.890+0000 7efd65ffb640 1 --2- 172.21.15.92:0/1683687926 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efd540a3240 0x7efd540a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:02.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.890+0000 7efd5ffff640 1 --2- 172.21.15.92:0/2089902127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559879d16d40 0x559879d19130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:02.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.890+0000 7efd6cce9640 1 --2- 172.21.15.92:0/1683687926 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efd540a3240 0x7efd540a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:02.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.890+0000 7efd65ffb640 1 -- 172.21.15.92:0/1683687926 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7efd580cf5a0 con 0x7efd68100e20 2024-09-19T09:06:02.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.890+0000 7efd6cce9640 1 -- 172.21.15.92:0/2089902127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559879d16d40 msgr2=0x559879d19130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:02.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.890+0000 7efd6cce9640 1 --2- 172.21.15.92:0/2089902127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559879d16d40 0x559879d19130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:02.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.890+0000 7efd6cce9640 1 -- 172.21.15.92:0/2089902127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559879d0c480 msgr2=0x559879d16800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:02.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.890+0000 7efd6cce9640 1 --2- 172.21.15.92:0/2089902127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559879d0c480 0x559879d16800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:02.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.890+0000 7efd6cce9640 1 -- 172.21.15.92:0/2089902127 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559879c251f0 con 0x559879d0bb60 2024-09-19T09:06:02.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.890+0000 7efd67fff640 1 --2- 172.21.15.92:0/2089902127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559879d0c480 0x559879d16800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:06:02.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.891+0000 7efd6cce9640 1 --2- 172.21.15.92:0/2089902127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559879d0bb60 0x559879d0bf40 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7efd60013940 tx=0x7efd60013e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b412b623a09f96a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:02.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.891+0000 7efd5e7fc640 1 -- 172.21.15.92:0/2089902127 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd60021030 con 0x559879d0bb60 2024-09-19T09:06:02.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.891+0000 7efd5e7fc640 1 -- 172.21.15.92:0/2089902127 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd600043a0 con 0x559879d0bb60 2024-09-19T09:06:02.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.891+0000 7efd5e7fc640 1 -- 172.21.15.92:0/2089902127 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6001d960 con 0x559879d0bb60 2024-09-19T09:06:02.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.891+0000 7efd6cce9640 1 --2- 172.21.15.92:0/1683687926 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efd540a3240 0x7efd540a5700 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7efd60021000 tx=0x7efd60020000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:02.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.892+0000 7efd70b25740 1 -- 172.21.15.92:0/2089902127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559879d0bb60 msgr2=0x559879d0bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:02.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.892+0000 7efd70b25740 1 --2- 172.21.15.92:0/2089902127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559879d0bb60 0x559879d0bf40 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7efd60013940 tx=0x7efd60013e00 comp rx=0 tx=0).stop 2024-09-19T09:06:02.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.892+0000 7efd70b25740 1 -- 172.21.15.92:0/2089902127 shutdown_connections 2024-09-19T09:06:02.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.892+0000 7efd70b25740 1 --2- 172.21.15.92:0/2089902127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559879d16d40 0x559879d19130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:02.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.892+0000 7efd70b25740 1 --2- 172.21.15.92:0/2089902127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559879d0c480 0x559879d16800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:02.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.892+0000 7efd70b25740 1 --2- 172.21.15.92:0/2089902127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559879d0bb60 0x559879d0bf40 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:02.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.892+0000 7efd70b25740 1 -- 172.21.15.92:0/2089902127 >> 172.21.15.92:0/2089902127 conn(0x559879d080f0 msgr2=0x559879d084d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:02.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.892+0000 7efd70b25740 1 -- 172.21.15.92:0/2089902127 shutdown_connections 2024-09-19T09:06:02.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.892+0000 7efd70b25740 1 -- 172.21.15.92:0/2089902127 wait complete. 2024-09-19T09:06:02.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.892+0000 7efd70b25740 1 -- start start 2024-09-19T09:06:02.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.892+0000 7efd70b25740 1 Processor -- start 2024-09-19T09:06:02.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.892+0000 7efd70b25740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559879d0bb60 0x559879d13bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:02.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.892+0000 7efd70b25740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559879d0c480 0x559879d14130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:02.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.892+0000 7efd70b25740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559879d16d40 0x559879d14670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:02.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.893+0000 7efd70b25740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559879d19910 con 0x559879d16d40 2024-09-19T09:06:02.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.893+0000 7efd70b25740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559879c2bf10 con 0x559879d0c480 2024-09-19T09:06:02.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.893+0000 7efd70b25740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x559879d19a90 con 0x559879d0bb60 2024-09-19T09:06:02.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.893+0000 7efd70b25740 10 client.0 _ll_register_callbacks cb 0x559879bf4a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:02.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.893+0000 7efd6cce9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559879d16d40 0x559879d14670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:02.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.893+0000 7efd6cce9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559879d16d40 0x559879d14670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48220/0 (socket says 172.21.15.92:48220) 2024-09-19T09:06:02.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.893+0000 7efd6cce9640 1 -- 172.21.15.92:0/965177378 learned_addr learned my addr 172.21.15.92:0/965177378 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:02.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.893+0000 7efd67fff640 1 --2- 172.21.15.92:0/965177378 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559879d0bb60 0x559879d13bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:02.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.893+0000 7efd5ffff640 1 --2- 172.21.15.92:0/965177378 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559879d0c480 0x559879d14130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:02.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.893+0000 7efd6cce9640 1 -- 172.21.15.92:0/965177378 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559879d0bb60 msgr2=0x559879d13bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:02.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.893+0000 7efd6cce9640 1 --2- 172.21.15.92:0/965177378 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559879d0bb60 0x559879d13bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:02.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.893+0000 7efd6cce9640 1 -- 172.21.15.92:0/965177378 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559879d0c480 msgr2=0x559879d14130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:02.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.893+0000 7efd6cce9640 1 --2- 172.21.15.92:0/965177378 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559879d0c480 0x559879d14130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:02.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.893+0000 7efd6cce9640 1 -- 172.21.15.92:0/965177378 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598799e26a0 con 0x559879d16d40 2024-09-19T09:06:02.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.893+0000 7efd5ffff640 1 --2- 172.21.15.92:0/965177378 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559879d0c480 0x559879d14130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:02.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.893+0000 7efd6cce9640 1 --2- 172.21.15.92:0/965177378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559879d16d40 0x559879d14670 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7efd60000f80 tx=0x7efd6001d400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c16ae5bb9c8dfa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:02.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.893+0000 7efd477fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:06:02.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.893+0000 7efd477fe640 1 -- 172.21.15.92:0/965177378 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd60031020 con 0x559879d16d40 2024-09-19T09:06:02.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.893+0000 7efd477fe640 1 -- 172.21.15.92:0/965177378 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7efd6001d8f0 con 0x559879d16d40 2024-09-19T09:06:02.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.893+0000 7efd70b25740 1 -- 172.21.15.92:0/965177378 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd600043a0 con 0x559879d16d40 2024-09-19T09:06:02.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.893+0000 7efd477fe640 1 -- 172.21.15.92:0/965177378 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7efd60004550 con 0x559879d16d40 2024-09-19T09:06:02.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.893+0000 7efd70b25740 10 client.17568 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:02.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.893+0000 7efd70b25740 1 -- 172.21.15.92:0/965177378 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x559879d25530 con 0x559879d16d40 2024-09-19T09:06:02.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.894+0000 7efd477fe640 1 -- 172.21.15.92:0/965177378 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd600043a0 con 0x559879d16d40 2024-09-19T09:06:02.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.894+0000 7efd477fe640 1 -- 172.21.15.92:0/965177378 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7efd6002d9a0 con 0x559879d16d40 2024-09-19T09:06:02.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.894+0000 7efd70b25740 10 client.17568 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:02.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.894+0000 7efd70b25740 10 client.17568 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:06:02.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.894+0000 7efd70b25740 20 client.17568 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:02.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.894+0000 7efd70b25740 1 --2- 172.21.15.92:0/965177378 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559879d268e0 0x559879d28cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:02.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.894+0000 7efd70b25740 4 client.17568 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:06:02.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.894+0000 7efd70b25740 1 -- 172.21.15.92:0/965177378 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559879c7e7f0 con 0x559879d268e0 2024-09-19T09:06:02.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.894+0000 7efd67fff640 1 --2- 172.21.15.92:0/965177378 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559879d268e0 0x559879d28cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:02.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.895+0000 7efd477fe640 10 client.17568 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:02.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.895+0000 7efd67fff640 1 --2- 172.21.15.92:0/965177378 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559879d268e0 0x559879d28cd0 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65eb14c24194f6dd server_cookie=345cbff8990c6057 in_seq=0 out_seq=0 2024-09-19T09:06:02.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.895+0000 7efd477fe640 1 -- 172.21.15.92:0/965177378 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559879c7e7f0 con 0x559879d268e0 2024-09-19T09:06:02.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.895+0000 7efd477fe640 10 client.17568 handle_command_reply: tid=0 2024-09-19T09:06:02.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.895+0000 7efd70b25740 1 client.17568 shutdown 2024-09-19T09:06:02.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.896+0000 7efd70b25740 1 -- 172.21.15.92:0/965177378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559879d16d40 msgr2=0x559879d14670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:02.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.896+0000 7efd70b25740 1 --2- 172.21.15.92:0/965177378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559879d16d40 0x559879d14670 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7efd60000f80 tx=0x7efd6001d400 comp rx=0 tx=0).stop 2024-09-19T09:06:02.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.896+0000 7efd70b25740 1 -- 172.21.15.92:0/965177378 shutdown_connections 2024-09-19T09:06:02.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.896+0000 7efd70b25740 1 --2- 172.21.15.92:0/965177378 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559879d268e0 0x559879d28cd0 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:02.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.896+0000 7efd70b25740 1 --2- 172.21.15.92:0/965177378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559879d16d40 0x559879d14670 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:02.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.896+0000 7efd70b25740 1 --2- 172.21.15.92:0/965177378 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559879d0c480 0x559879d14130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:02.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.896+0000 7efd70b25740 1 --2- 172.21.15.92:0/965177378 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559879d0bb60 0x559879d13bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:02.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.896+0000 7efd477fe640 0 client.17568 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:02.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.896+0000 7efd70b25740 1 -- 172.21.15.92:0/965177378 >> 172.21.15.92:0/965177378 conn(0x559879d080f0 msgr2=0x559879d07270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:02.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.896+0000 7efd70b25740 1 -- 172.21.15.92:0/965177378 shutdown_connections 2024-09-19T09:06:02.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.896+0000 7efd70b25740 1 -- 172.21.15.92:0/965177378 wait complete. 2024-09-19T09:06:02.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.896+0000 7efd70b25740 20 client.17568 trim_cache size 0 max 16384 2024-09-19T09:06:02.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.913+0000 7efd70b25740 1 Processor -- start 2024-09-19T09:06:02.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.913+0000 7efd70b25740 1 -- start start 2024-09-19T09:06:02.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.913+0000 7efd70b25740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559879d0bb60 0x559879d0e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:02.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.913+0000 7efd70b25740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559879d0c480 0x559879d12aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:02.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.913+0000 7efd70b25740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559879d16d40 0x559879d2e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:02.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.913+0000 7efd70b25740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efd681ad830 con 0x559879d0c480 2024-09-19T09:06:02.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.913+0000 7efd70b25740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efd681b00d0 con 0x559879d16d40 2024-09-19T09:06:02.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.913+0000 7efd70b25740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7efd681adec0 con 0x559879d0bb60 2024-09-19T09:06:02.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.913+0000 7efd5ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559879d0c480 0x559879d12aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:02.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.913+0000 7efd5ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559879d0c480 0x559879d12aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48222/0 (socket says 172.21.15.92:48222) 2024-09-19T09:06:02.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.913+0000 7efd67fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559879d0bb60 0x559879d0e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:02.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.913+0000 7efd5ffff640 1 -- 172.21.15.92:0/2507910288 learned_addr learned my addr 172.21.15.92:0/2507910288 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:02.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.913+0000 7efd6cce9640 1 --2- 172.21.15.92:0/2507910288 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559879d16d40 0x559879d2e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:02.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.913+0000 7efd5ffff640 1 -- 172.21.15.92:0/2507910288 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559879d0bb60 msgr2=0x559879d0e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:02.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.913+0000 7efd5ffff640 1 --2- 172.21.15.92:0/2507910288 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559879d0bb60 0x559879d0e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:02.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.913+0000 7efd5ffff640 1 -- 172.21.15.92:0/2507910288 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559879d16d40 msgr2=0x559879d2e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:02.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.913+0000 7efd5ffff640 1 --2- 172.21.15.92:0/2507910288 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559879d16d40 0x559879d2e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:02.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.913+0000 7efd5ffff640 1 -- 172.21.15.92:0/2507910288 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559879d07f20 con 0x559879d0c480 2024-09-19T09:06:02.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.914+0000 7efd5ffff640 1 --2- 172.21.15.92:0/2507910288 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559879d0c480 0x559879d12aa0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7efd500314e0 tx=0x7efd500043f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ce3ce9b6c94b154 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:02.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.914+0000 7efd5dffb640 1 -- 172.21.15.92:0/2507910288 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd50035040 con 0x559879d0c480 2024-09-19T09:06:02.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.914+0000 7efd5dffb640 1 -- 172.21.15.92:0/2507910288 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd500046c0 con 0x559879d0c480 2024-09-19T09:06:02.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.914+0000 7efd5dffb640 1 -- 172.21.15.92:0/2507910288 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd500038e0 con 0x559879d0c480 2024-09-19T09:06:02.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.914+0000 7efd70b25740 1 -- 172.21.15.92:0/2507910288 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559879d0c480 msgr2=0x559879d12aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:02.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.914+0000 7efd70b25740 1 --2- 172.21.15.92:0/2507910288 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559879d0c480 0x559879d12aa0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7efd500314e0 tx=0x7efd500043f0 comp rx=0 tx=0).stop 2024-09-19T09:06:02.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.914+0000 7efd70b25740 1 -- 172.21.15.92:0/2507910288 shutdown_connections 2024-09-19T09:06:02.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.914+0000 7efd70b25740 1 --2- 172.21.15.92:0/2507910288 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559879d16d40 0x559879d2e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:02.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.914+0000 7efd70b25740 1 --2- 172.21.15.92:0/2507910288 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559879d0c480 0x559879d12aa0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:02.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.914+0000 7efd70b25740 1 --2- 172.21.15.92:0/2507910288 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559879d0bb60 0x559879d0e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:02.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.914+0000 7efd70b25740 1 -- 172.21.15.92:0/2507910288 >> 172.21.15.92:0/2507910288 conn(0x559879d080f0 msgr2=0x559879d12390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:02.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.915+0000 7efd70b25740 1 -- 172.21.15.92:0/2507910288 shutdown_connections 2024-09-19T09:06:02.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.915+0000 7efd70b25740 1 -- 172.21.15.92:0/2507910288 wait complete. 2024-09-19T09:06:02.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.915+0000 7efd70b25740 1 -- start start 2024-09-19T09:06:02.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.915+0000 7efd70b25740 1 Processor -- start 2024-09-19T09:06:02.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.915+0000 7efd70b25740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559879d0bb60 0x559879d1f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:02.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.915+0000 7efd70b25740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559879d0c480 0x559879d1a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:02.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.915+0000 7efd70b25740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559879d16d40 0x559879d1ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:02.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.915+0000 7efd70b25740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efd681ae590 con 0x559879d16d40 2024-09-19T09:06:02.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.915+0000 7efd70b25740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efd681afa00 con 0x559879d0c480 2024-09-19T09:06:02.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.915+0000 7efd70b25740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7efd681aec60 con 0x559879d0bb60 2024-09-19T09:06:02.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.915+0000 7efd70b25740 10 client.0 _ll_register_callbacks cb 0x7efd5809b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:02.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.915+0000 7efd6cce9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559879d16d40 0x559879d1ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:02.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.916+0000 7efd6cce9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559879d16d40 0x559879d1ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48226/0 (socket says 172.21.15.92:48226) 2024-09-19T09:06:02.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.916+0000 7efd6cce9640 1 -- 172.21.15.92:0/1956875843 learned_addr learned my addr 172.21.15.92:0/1956875843 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:02.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.916+0000 7efd5ffff640 1 --2- 172.21.15.92:0/1956875843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559879d0c480 0x559879d1a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:02.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.916+0000 7efd67fff640 1 --2- 172.21.15.92:0/1956875843 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559879d0bb60 0x559879d1f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:02.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.916+0000 7efd6cce9640 1 -- 172.21.15.92:0/1956875843 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559879d0bb60 msgr2=0x559879d1f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:02.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.916+0000 7efd6cce9640 1 --2- 172.21.15.92:0/1956875843 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559879d0bb60 0x559879d1f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:02.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.916+0000 7efd6cce9640 1 -- 172.21.15.92:0/1956875843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559879d0c480 msgr2=0x559879d1a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:02.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.916+0000 7efd6cce9640 1 --2- 172.21.15.92:0/1956875843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559879d0c480 0x559879d1a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:02.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.916+0000 7efd6cce9640 1 -- 172.21.15.92:0/1956875843 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559879d02680 con 0x559879d16d40 2024-09-19T09:06:02.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.916+0000 7efd67fff640 1 --2- 172.21.15.92:0/1956875843 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559879d0bb60 0x559879d1f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:02.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.916+0000 7efd6cce9640 1 --2- 172.21.15.92:0/1956875843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559879d16d40 0x559879d1ac00 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7efd6000ac20 tx=0x7efd600118f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=264483e01f4e007 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:02.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.916+0000 7efd477fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:06:02.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.916+0000 7efd477fe640 1 -- 172.21.15.92:0/1956875843 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd60031070 con 0x559879d16d40 2024-09-19T09:06:02.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.916+0000 7efd477fe640 1 -- 172.21.15.92:0/1956875843 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7efd600046f0 con 0x559879d16d40 2024-09-19T09:06:02.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.916+0000 7efd70b25740 1 -- 172.21.15.92:0/1956875843 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd500046c0 con 0x559879d16d40 2024-09-19T09:06:02.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.916+0000 7efd477fe640 1 -- 172.21.15.92:0/1956875843 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7efd60004a00 con 0x559879d16d40 2024-09-19T09:06:02.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.916+0000 7efd70b25740 10 client.17574 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:02.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.916+0000 7efd70b25740 1 -- 172.21.15.92:0/1956875843 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x559879d910e0 con 0x559879d16d40 2024-09-19T09:06:02.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.917+0000 7efd477fe640 1 -- 172.21.15.92:0/1956875843 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd500046c0 con 0x559879d16d40 2024-09-19T09:06:02.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.917+0000 7efd477fe640 1 -- 172.21.15.92:0/1956875843 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7efd600258d0 con 0x559879d16d40 2024-09-19T09:06:02.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.917+0000 7efd70b25740 10 client.17574 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:02.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.917+0000 7efd70b25740 10 client.17574 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:06:02.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.917+0000 7efd70b25740 20 client.17574 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:02.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.917+0000 7efd70b25740 1 --2- 172.21.15.92:0/1956875843 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559879d917f0 0x559879d93be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:02.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.917+0000 7efd70b25740 4 client.17574 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:06:02.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.917+0000 7efd70b25740 1 -- 172.21.15.92:0/1956875843 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559879d195b0 con 0x559879d917f0 2024-09-19T09:06:02.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.917+0000 7efd67fff640 1 --2- 172.21.15.92:0/1956875843 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559879d917f0 0x559879d93be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:02.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.917+0000 7efd477fe640 10 client.17574 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:02.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.917+0000 7efd67fff640 1 --2- 172.21.15.92:0/1956875843 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559879d917f0 0x559879d93be0 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0437040d5f32c51 server_cookie=e6858fc17b2f5107 in_seq=0 out_seq=0 2024-09-19T09:06:02.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.918+0000 7efd477fe640 1 -- 172.21.15.92:0/1956875843 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559879d195b0 con 0x559879d917f0 2024-09-19T09:06:02.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.918+0000 7efd477fe640 10 client.17574 handle_command_reply: tid=0 2024-09-19T09:06:02.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.918+0000 7efd70b25740 1 client.17574 shutdown 2024-09-19T09:06:02.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.919+0000 7efd70b25740 1 -- 172.21.15.92:0/1956875843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559879d16d40 msgr2=0x559879d1ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:02.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.919+0000 7efd70b25740 1 --2- 172.21.15.92:0/1956875843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559879d16d40 0x559879d1ac00 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7efd6000ac20 tx=0x7efd600118f0 comp rx=0 tx=0).stop 2024-09-19T09:06:02.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.919+0000 7efd70b25740 1 -- 172.21.15.92:0/1956875843 shutdown_connections 2024-09-19T09:06:02.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.919+0000 7efd70b25740 1 --2- 172.21.15.92:0/1956875843 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559879d917f0 0x559879d93be0 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:02.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.919+0000 7efd70b25740 1 --2- 172.21.15.92:0/1956875843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559879d16d40 0x559879d1ac00 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:02.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.919+0000 7efd70b25740 1 --2- 172.21.15.92:0/1956875843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559879d0c480 0x559879d1a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:02.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.919+0000 7efd70b25740 1 --2- 172.21.15.92:0/1956875843 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559879d0bb60 0x559879d1f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:02.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.919+0000 7efd477fe640 0 client.17574 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:02.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.919+0000 7efd70b25740 1 -- 172.21.15.92:0/1956875843 >> 172.21.15.92:0/1956875843 conn(0x559879d080f0 msgr2=0x559879d07270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:02.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.919+0000 7efd70b25740 1 -- 172.21.15.92:0/1956875843 shutdown_connections 2024-09-19T09:06:02.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.919+0000 7efd70b25740 1 -- 172.21.15.92:0/1956875843 wait complete. 2024-09-19T09:06:02.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.919+0000 7efd70b25740 20 client.17574 trim_cache size 0 max 16384 2024-09-19T09:06:02.925 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:06:02.925 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-19T09:06:02.925 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "9423d5c9-6130-4c27-ad45-8d5f58432473", 2024-09-19T09:06:02.926 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-19T09:06:02.926 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:06:02.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.919+0000 7efd6e74c640 1 -- 172.21.15.92:0/1683687926 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efd540a3240 msgr2=0x7efd540a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:02.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.919+0000 7efd6e74c640 1 --2- 172.21.15.92:0/1683687926 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efd540a3240 0x7efd540a5700 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7efd60021000 tx=0x7efd60020000 comp rx=0 tx=0).stop 2024-09-19T09:06:02.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.919+0000 7efd6e74c640 1 -- 172.21.15.92:0/1683687926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd68100e20 msgr2=0x7efd681a03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:02.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.919+0000 7efd6e74c640 1 --2- 172.21.15.92:0/1683687926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd68100e20 0x7efd681a03d0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7efd5800d950 tx=0x7efd5800de10 comp rx=0 tx=0).stop 2024-09-19T09:06:02.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.919+0000 7efd6e74c640 1 -- 172.21.15.92:0/1683687926 shutdown_connections 2024-09-19T09:06:02.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.919+0000 7efd6e74c640 1 --2- 172.21.15.92:0/1683687926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd68102ef0 0x7efd6819a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:02.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.919+0000 7efd6e74c640 1 --2- 172.21.15.92:0/1683687926 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efd68102570 0x7efd681a0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:02.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.919+0000 7efd6e74c640 1 --2- 172.21.15.92:0/1683687926 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efd540a3240 0x7efd540a5700 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:02.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.919+0000 7efd6e74c640 1 --2- 172.21.15.92:0/1683687926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd68100e20 0x7efd681a03d0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:02.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.919+0000 7efd6e74c640 1 -- 172.21.15.92:0/1683687926 >> 172.21.15.92:0/1683687926 conn(0x7efd680fc7d0 msgr2=0x7efd680ffc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:02.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.920+0000 7efd6e74c640 1 -- 172.21.15.92:0/1683687926 shutdown_connections 2024-09-19T09:06:02.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:02.920+0000 7efd6e74c640 1 -- 172.21.15.92:0/1683687926 wait complete. 2024-09-19T09:06:03.684 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:06:03.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:03 smithi167 ceph-mon[35359]: pgmap v617: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 41 MiB/s wr, 1.58k op/s 2024-09-19T09:06:03.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:03 smithi190 ceph-mon[35358]: pgmap v617: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 41 MiB/s wr, 1.58k op/s 2024-09-19T09:06:03.929 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:06:04.005 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:03 smithi092 ceph-mon[31407]: pgmap v617: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 41 MiB/s wr, 1.58k op/s 2024-09-19T09:06:04.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.373+0000 7f1ed949d640 1 -- 172.21.15.92:0/3212693473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ed4108300 msgr2=0x7f1ed410ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:04.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.374+0000 7f1ed949d640 1 --2- 172.21.15.92:0/3212693473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ed4108300 0x7f1ed410ec70 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc009930 tx=0x7f1ecc02a420 comp rx=0 tx=0).stop 2024-09-19T09:06:04.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.374+0000 7f1ed949d640 1 -- 172.21.15.92:0/3212693473 shutdown_connections 2024-09-19T09:06:04.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.374+0000 7f1ed949d640 1 --2- 172.21.15.92:0/3212693473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ed4108300 0x7f1ed410ec70 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:04.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.374+0000 7f1ed949d640 1 --2- 172.21.15.92:0/3212693473 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ed4103780 0x7f1ed4107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:04.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.374+0000 7f1ed949d640 1 --2- 172.21.15.92:0/3212693473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ed4102dd0 0x7f1ed41031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:04.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.374+0000 7f1ed949d640 1 -- 172.21.15.92:0/3212693473 >> 172.21.15.92:0/3212693473 conn(0x7f1ed40fc7d0 msgr2=0x7f1ed40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:04.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.374+0000 7f1ed949d640 1 -- 172.21.15.92:0/3212693473 shutdown_connections 2024-09-19T09:06:04.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.374+0000 7f1ed949d640 1 -- 172.21.15.92:0/3212693473 wait complete. 2024-09-19T09:06:04.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.374+0000 7f1ed949d640 1 Processor -- start 2024-09-19T09:06:04.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.374+0000 7f1ed949d640 1 -- start start 2024-09-19T09:06:04.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.375+0000 7f1ed949d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ed4102dd0 0x7f1ed4198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:04.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.375+0000 7f1ed949d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ed4103780 0x7f1ed4198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:04.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.375+0000 7f1ed949d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ed4108300 0x7f1ed419ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:04.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.375+0000 7f1ed949d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed41120d0 con 0x7f1ed4103780 2024-09-19T09:06:04.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.375+0000 7f1ed949d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed4111f50 con 0x7f1ed4102dd0 2024-09-19T09:06:04.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.375+0000 7f1ed949d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed4112250 con 0x7f1ed4108300 2024-09-19T09:06:04.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.375+0000 7f1ed27fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ed4103780 0x7f1ed4198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:04.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.375+0000 7f1ed27fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ed4103780 0x7f1ed4198ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48252/0 (socket says 172.21.15.92:48252) 2024-09-19T09:06:04.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.375+0000 7f1ed27fc640 1 -- 172.21.15.92:0/1005852866 learned_addr learned my addr 172.21.15.92:0/1005852866 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:04.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.375+0000 7f1ed2ffd640 1 --2- 172.21.15.92:0/1005852866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ed4102dd0 0x7f1ed4198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:04.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.375+0000 7f1ed37fe640 1 --2- 172.21.15.92:0/1005852866 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ed4108300 0x7f1ed419ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:04.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.375+0000 7f1ed27fc640 1 -- 172.21.15.92:0/1005852866 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ed4108300 msgr2=0x7f1ed419ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:04.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.375+0000 7f1ed27fc640 1 --2- 172.21.15.92:0/1005852866 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ed4108300 0x7f1ed419ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:04.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.375+0000 7f1ed27fc640 1 -- 172.21.15.92:0/1005852866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ed4102dd0 msgr2=0x7f1ed4198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:04.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.375+0000 7f1ed27fc640 1 --2- 172.21.15.92:0/1005852866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ed4102dd0 0x7f1ed4198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:04.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.375+0000 7f1ed27fc640 1 -- 172.21.15.92:0/1005852866 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed419d530 con 0x7f1ed4103780 2024-09-19T09:06:04.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.375+0000 7f1ed27fc640 1 --2- 172.21.15.92:0/1005852866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ed4103780 0x7f1ed4198ac0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc00d740 tx=0x7f1ebc00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:04.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.375+0000 7f1ecbfff640 1 -- 172.21.15.92:0/1005852866 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc017070 con 0x7f1ed4103780 2024-09-19T09:06:04.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.375+0000 7f1ecbfff640 1 -- 172.21.15.92:0/1005852866 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ebc00de50 con 0x7f1ed4103780 2024-09-19T09:06:04.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.375+0000 7f1ed949d640 1 -- 172.21.15.92:0/1005852866 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ed419d820 con 0x7f1ed4103780 2024-09-19T09:06:04.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.375+0000 7f1ecbfff640 1 -- 172.21.15.92:0/1005852866 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc00f6b0 con 0x7f1ed4103780 2024-09-19T09:06:04.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.376+0000 7f1ed949d640 1 -- 172.21.15.92:0/1005852866 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ed41a5100 con 0x7f1ed4103780 2024-09-19T09:06:04.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.378+0000 7f1ecbfff640 1 -- 172.21.15.92:0/1005852866 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1ebc01a070 con 0x7f1ed4103780 2024-09-19T09:06:04.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.378+0000 7f1edb876740 1 Processor -- start 2024-09-19T09:06:04.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.378+0000 7f1edb876740 1 -- start start 2024-09-19T09:06:04.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.378+0000 7f1ecbfff640 1 --2- 172.21.15.92:0/1005852866 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1ec00a3240 0x7f1ec00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:04.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.379+0000 7f1edb876740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a3e86e4a0 0x563a3e86e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:04.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.379+0000 7f1edb876740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a3e86edc0 0x563a3e879140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:04.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.379+0000 7f1edb876740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a3e879680 0x563a3e87ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:04.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.379+0000 7f1edb876740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563a3e7d42e0 con 0x563a3e879680 2024-09-19T09:06:04.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.379+0000 7f1edb876740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563a3e77bce0 con 0x563a3e86edc0 2024-09-19T09:06:04.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.379+0000 7f1edb876740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x563a3e7d02a0 con 0x563a3e86e4a0 2024-09-19T09:06:04.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.379+0000 7f1ed37fe640 1 --2- 172.21.15.92:0/1005852866 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1ec00a3240 0x7f1ec00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:04.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.379+0000 7f1ecbfff640 1 -- 172.21.15.92:0/1005852866 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1ebc0cf220 con 0x7f1ed4103780 2024-09-19T09:06:04.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.379+0000 7f1ed27fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a3e86edc0 0x563a3e879140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:04.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.379+0000 7f1ed2ffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a3e86e4a0 0x563a3e86e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:04.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.379+0000 7f1ed27fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a3e86edc0 0x563a3e879140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:55716/0 (socket says 172.21.15.92:55716) 2024-09-19T09:06:04.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.379+0000 7f1ed27fc640 1 -- 172.21.15.92:0/3692764587 learned_addr learned my addr 172.21.15.92:0/3692764587 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:04.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.379+0000 7f1ed37fe640 1 --2- 172.21.15.92:0/3692764587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a3e879680 0x563a3e87ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:04.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.379+0000 7f1ed27fc640 1 -- 172.21.15.92:0/3692764587 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a3e86e4a0 msgr2=0x563a3e86e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:04.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.379+0000 7f1ed27fc640 1 --2- 172.21.15.92:0/3692764587 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a3e86e4a0 0x563a3e86e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:04.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.379+0000 7f1ed27fc640 1 -- 172.21.15.92:0/3692764587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a3e879680 msgr2=0x563a3e87ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:04.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.379+0000 7f1ed27fc640 1 --2- 172.21.15.92:0/3692764587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a3e879680 0x563a3e87ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:04.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.379+0000 7f1ed27fc640 1 -- 172.21.15.92:0/3692764587 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a3e760440 con 0x563a3e86edc0 2024-09-19T09:06:04.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.379+0000 7f1ed2ffd640 1 --2- 172.21.15.92:0/3692764587 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a3e86e4a0 0x563a3e86e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:06:04.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.379+0000 7f1ed37fe640 1 --2- 172.21.15.92:0/1005852866 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1ec00a3240 0x7f1ec00a5700 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc006010 tx=0x7f1ecc031780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:04.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.379+0000 7f1ed27fc640 1 --2- 172.21.15.92:0/3692764587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a3e86edc0 0x563a3e879140 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc09b5f0 tx=0x7f1ebc09b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c401c0208dd58470 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:04.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.380+0000 7f1ec97fa640 1 -- 172.21.15.92:0/3692764587 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc021070 con 0x563a3e86edc0 2024-09-19T09:06:04.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.380+0000 7f1ec97fa640 1 -- 172.21.15.92:0/3692764587 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ebc0860e0 con 0x563a3e86edc0 2024-09-19T09:06:04.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.380+0000 7f1ec97fa640 1 -- 172.21.15.92:0/3692764587 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc097f60 con 0x563a3e86edc0 2024-09-19T09:06:04.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.380+0000 7f1edb876740 1 -- 172.21.15.92:0/3692764587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a3e86edc0 msgr2=0x563a3e879140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:04.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.380+0000 7f1edb876740 1 --2- 172.21.15.92:0/3692764587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a3e86edc0 0x563a3e879140 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc09b5f0 tx=0x7f1ebc09b8f0 comp rx=0 tx=0).stop 2024-09-19T09:06:04.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.380+0000 7f1edb876740 1 -- 172.21.15.92:0/3692764587 shutdown_connections 2024-09-19T09:06:04.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.380+0000 7f1edb876740 1 --2- 172.21.15.92:0/3692764587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a3e879680 0x563a3e87ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:04.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.380+0000 7f1edb876740 1 --2- 172.21.15.92:0/3692764587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a3e86edc0 0x563a3e879140 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:04.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.380+0000 7f1edb876740 1 --2- 172.21.15.92:0/3692764587 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a3e86e4a0 0x563a3e86e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:04.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.380+0000 7f1edb876740 1 -- 172.21.15.92:0/3692764587 >> 172.21.15.92:0/3692764587 conn(0x563a3e86aa30 msgr2=0x563a3e86ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:04.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.380+0000 7f1edb876740 1 -- 172.21.15.92:0/3692764587 shutdown_connections 2024-09-19T09:06:04.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.380+0000 7f1edb876740 1 -- 172.21.15.92:0/3692764587 wait complete. 2024-09-19T09:06:04.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.381+0000 7f1edb876740 1 -- start start 2024-09-19T09:06:04.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.381+0000 7f1edb876740 1 Processor -- start 2024-09-19T09:06:04.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.381+0000 7f1edb876740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a3e86e4a0 0x563a3e879070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:04.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.381+0000 7f1edb876740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a3e86edc0 0x563a3e876320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:04.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.381+0000 7f1edb876740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a3e879680 0x563a3e876910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:04.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.381+0000 7f1edb876740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563a3e87c250 con 0x563a3e86edc0 2024-09-19T09:06:04.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.381+0000 7f1edb876740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563a3e78f050 con 0x563a3e86e4a0 2024-09-19T09:06:04.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.381+0000 7f1edb876740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x563a3e87c3d0 con 0x563a3e879680 2024-09-19T09:06:04.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.381+0000 7f1edb876740 10 client.0 _ll_register_callbacks cb 0x563a3e7cf160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:04.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.381+0000 7f1ed27fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a3e86edc0 0x563a3e876320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:04.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.381+0000 7f1ed27fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a3e86edc0 0x563a3e876320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48278/0 (socket says 172.21.15.92:48278) 2024-09-19T09:06:04.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.381+0000 7f1ed27fc640 1 -- 172.21.15.92:0/2708635204 learned_addr learned my addr 172.21.15.92:0/2708635204 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:04.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.381+0000 7f1ed2ffd640 1 --2- 172.21.15.92:0/2708635204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a3e86e4a0 0x563a3e879070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:04.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.381+0000 7f1ed37fe640 1 --2- 172.21.15.92:0/2708635204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a3e879680 0x563a3e876910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:04.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.382+0000 7f1ed2ffd640 1 -- 172.21.15.92:0/2708635204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a3e879680 msgr2=0x563a3e876910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:04.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.382+0000 7f1ed2ffd640 1 --2- 172.21.15.92:0/2708635204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a3e879680 0x563a3e876910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:04.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.382+0000 7f1ed2ffd640 1 -- 172.21.15.92:0/2708635204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a3e86edc0 msgr2=0x563a3e876320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:04.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.382+0000 7f1ed2ffd640 1 --2- 172.21.15.92:0/2708635204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a3e86edc0 0x563a3e876320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:04.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.382+0000 7f1ed2ffd640 1 -- 172.21.15.92:0/2708635204 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a3e5453c0 con 0x563a3e86e4a0 2024-09-19T09:06:04.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.382+0000 7f1ed27fc640 1 --2- 172.21.15.92:0/2708635204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a3e86edc0 0x563a3e876320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:06:04.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.382+0000 7f1ed2ffd640 1 --2- 172.21.15.92:0/2708635204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a3e86e4a0 0x563a3e879070 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4011ce0 tx=0x7f1ec400f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1624c99939cc2b3d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:04.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.382+0000 7f1eba7fc640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:06:04.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.382+0000 7f1eba7fc640 1 -- 172.21.15.92:0/2708635204 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec4004b20 con 0x563a3e86e4a0 2024-09-19T09:06:04.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.382+0000 7f1eba7fc640 1 -- 172.21.15.92:0/2708635204 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1ec4004cc0 con 0x563a3e86e4a0 2024-09-19T09:06:04.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.382+0000 7f1edb876740 1 -- 172.21.15.92:0/2708635204 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563a3e7e1850 con 0x563a3e86e4a0 2024-09-19T09:06:04.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.382+0000 7f1eba7fc640 1 -- 172.21.15.92:0/2708635204 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1ec401a430 con 0x563a3e86e4a0 2024-09-19T09:06:04.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.382+0000 7f1edb876740 10 client.26948 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:04.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.382+0000 7f1edb876740 1 -- 172.21.15.92:0/2708635204 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x563a3e887cb0 con 0x563a3e86e4a0 2024-09-19T09:06:04.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.382+0000 7f1eba7fc640 1 -- 172.21.15.92:0/2708635204 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x563a3e7e1850 con 0x563a3e86e4a0 2024-09-19T09:06:04.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.383+0000 7f1eba7fc640 1 -- 172.21.15.92:0/2708635204 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1ec4019070 con 0x563a3e86e4a0 2024-09-19T09:06:04.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.383+0000 7f1edb876740 10 client.26948 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:04.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.383+0000 7f1edb876740 10 client.26948 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:06:04.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.383+0000 7f1edb876740 20 client.26948 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:04.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.383+0000 7f1edb876740 1 --2- 172.21.15.92:0/2708635204 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x563a3e8891c0 0x563a3e88b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:04.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.383+0000 7f1edb876740 4 client.26948 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:06:04.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.383+0000 7f1edb876740 1 -- 172.21.15.92:0/2708635204 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a3e7dbd60 con 0x563a3e8891c0 2024-09-19T09:06:04.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.383+0000 7f1ed27fc640 1 --2- 172.21.15.92:0/2708635204 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x563a3e8891c0 0x563a3e88b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:04.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.383+0000 7f1ed27fc640 1 --2- 172.21.15.92:0/2708635204 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x563a3e8891c0 0x563a3e88b5d0 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9195e3d9c8f0143 server_cookie=394089c21326d61a in_seq=0 out_seq=0 2024-09-19T09:06:04.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.383+0000 7f1eba7fc640 10 client.26948 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:04.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.384+0000 7f1eba7fc640 1 -- 172.21.15.92:0/2708635204 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563a3e7dbd60 con 0x563a3e8891c0 2024-09-19T09:06:04.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.384+0000 7f1eba7fc640 10 client.26948 handle_command_reply: tid=0 2024-09-19T09:06:04.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.384+0000 7f1edb876740 1 client.26948 shutdown 2024-09-19T09:06:04.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.384+0000 7f1edb876740 1 -- 172.21.15.92:0/2708635204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a3e86e4a0 msgr2=0x563a3e879070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:04.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.384+0000 7f1edb876740 1 --2- 172.21.15.92:0/2708635204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a3e86e4a0 0x563a3e879070 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4011ce0 tx=0x7f1ec400f790 comp rx=0 tx=0).stop 2024-09-19T09:06:04.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.384+0000 7f1edb876740 1 -- 172.21.15.92:0/2708635204 shutdown_connections 2024-09-19T09:06:04.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.384+0000 7f1edb876740 1 --2- 172.21.15.92:0/2708635204 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x563a3e8891c0 0x563a3e88b5d0 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:04.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.384+0000 7f1edb876740 1 --2- 172.21.15.92:0/2708635204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a3e879680 0x563a3e876910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:04.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.384+0000 7f1edb876740 1 --2- 172.21.15.92:0/2708635204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a3e86edc0 0x563a3e876320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:04.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.384+0000 7f1eba7fc640 0 client.26948 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:04.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.384+0000 7f1edb876740 1 --2- 172.21.15.92:0/2708635204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a3e86e4a0 0x563a3e879070 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:04.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.384+0000 7f1edb876740 1 -- 172.21.15.92:0/2708635204 >> 172.21.15.92:0/2708635204 conn(0x563a3e86aa30 msgr2=0x563a3e869b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:04.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.384+0000 7f1edb876740 1 -- 172.21.15.92:0/2708635204 shutdown_connections 2024-09-19T09:06:04.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.384+0000 7f1edb876740 1 -- 172.21.15.92:0/2708635204 wait complete. 2024-09-19T09:06:04.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.384+0000 7f1edb876740 20 client.26948 trim_cache size 0 max 16384 2024-09-19T09:06:04.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.401+0000 7f1edb876740 1 Processor -- start 2024-09-19T09:06:04.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.402+0000 7f1edb876740 1 -- start start 2024-09-19T09:06:04.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.402+0000 7f1edb876740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a3e86e4a0 0x563a3e875860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:04.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.402+0000 7f1edb876740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a3e86edc0 0x563a3e890ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:04.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.402+0000 7f1edb876740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a3e879680 0x563a3e8913e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:04.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.402+0000 7f1edb876740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed41ab750 con 0x563a3e86e4a0 2024-09-19T09:06:04.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.402+0000 7f1edb876740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed41adff0 con 0x563a3e879680 2024-09-19T09:06:04.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.402+0000 7f1edb876740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed41abde0 con 0x563a3e86edc0 2024-09-19T09:06:04.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.402+0000 7f1ed2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a3e86e4a0 0x563a3e875860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:04.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.402+0000 7f1ed2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a3e86e4a0 0x563a3e875860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48282/0 (socket says 172.21.15.92:48282) 2024-09-19T09:06:04.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.402+0000 7f1ed2ffd640 1 -- 172.21.15.92:0/1584826394 learned_addr learned my addr 172.21.15.92:0/1584826394 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:04.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.402+0000 7f1ed37fe640 1 --2- 172.21.15.92:0/1584826394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a3e879680 0x563a3e8913e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:04.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.402+0000 7f1ed2ffd640 1 -- 172.21.15.92:0/1584826394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a3e86edc0 msgr2=0x563a3e890ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:04.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.402+0000 7f1ed2ffd640 1 --2- 172.21.15.92:0/1584826394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a3e86edc0 0x563a3e890ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:04.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.402+0000 7f1ed2ffd640 1 -- 172.21.15.92:0/1584826394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a3e879680 msgr2=0x563a3e8913e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:04.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.402+0000 7f1ed2ffd640 1 --2- 172.21.15.92:0/1584826394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a3e879680 0x563a3e8913e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:04.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.402+0000 7f1ed2ffd640 1 -- 172.21.15.92:0/1584826394 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a3e86e2b0 con 0x563a3e86e4a0 2024-09-19T09:06:04.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.402+0000 7f1ed37fe640 1 --2- 172.21.15.92:0/1584826394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a3e879680 0x563a3e8913e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:06:04.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.402+0000 7f1ed2ffd640 1 --2- 172.21.15.92:0/1584826394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a3e86e4a0 0x563a3e875860 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4009a00 tx=0x7f1ec400fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76dfdff8ec54eb28 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:04.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.403+0000 7f1ec8ff9640 1 -- 172.21.15.92:0/1584826394 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec4029070 con 0x563a3e86e4a0 2024-09-19T09:06:04.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.403+0000 7f1ec8ff9640 1 -- 172.21.15.92:0/1584826394 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ec4003e50 con 0x563a3e86e4a0 2024-09-19T09:06:04.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.403+0000 7f1ec8ff9640 1 -- 172.21.15.92:0/1584826394 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec401a9d0 con 0x563a3e86e4a0 2024-09-19T09:06:04.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.403+0000 7f1edb876740 1 -- 172.21.15.92:0/1584826394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a3e86e4a0 msgr2=0x563a3e875860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:04.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.403+0000 7f1edb876740 1 --2- 172.21.15.92:0/1584826394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a3e86e4a0 0x563a3e875860 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4009a00 tx=0x7f1ec400fc90 comp rx=0 tx=0).stop 2024-09-19T09:06:04.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.403+0000 7f1edb876740 1 -- 172.21.15.92:0/1584826394 shutdown_connections 2024-09-19T09:06:04.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.403+0000 7f1edb876740 1 --2- 172.21.15.92:0/1584826394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a3e879680 0x563a3e8913e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:04.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.403+0000 7f1edb876740 1 --2- 172.21.15.92:0/1584826394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a3e86edc0 0x563a3e890ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:04.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.403+0000 7f1edb876740 1 --2- 172.21.15.92:0/1584826394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a3e86e4a0 0x563a3e875860 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:04.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.403+0000 7f1edb876740 1 -- 172.21.15.92:0/1584826394 >> 172.21.15.92:0/1584826394 conn(0x563a3e86aa30 msgr2=0x563a3e8783a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:04.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.403+0000 7f1edb876740 1 -- 172.21.15.92:0/1584826394 shutdown_connections 2024-09-19T09:06:04.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.403+0000 7f1edb876740 1 -- 172.21.15.92:0/1584826394 wait complete. 2024-09-19T09:06:04.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.404+0000 7f1edb876740 1 -- start start 2024-09-19T09:06:04.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.404+0000 7f1edb876740 1 Processor -- start 2024-09-19T09:06:04.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.404+0000 7f1edb876740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a3e86e4a0 0x563a3e8eee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:04.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.404+0000 7f1edb876740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a3e86edc0 0x563a3e8ef3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:04.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.404+0000 7f1edb876740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a3e879680 0x563a3e8ef8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:04.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.404+0000 7f1edb876740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed41ac4b0 con 0x563a3e879680 2024-09-19T09:06:04.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.404+0000 7f1edb876740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed41ad920 con 0x563a3e86edc0 2024-09-19T09:06:04.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.404+0000 7f1edb876740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed41acb80 con 0x563a3e86e4a0 2024-09-19T09:06:04.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.404+0000 7f1edb876740 10 client.0 _ll_register_callbacks cb 0x7f1ec4009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:04.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.404+0000 7f1ed37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a3e879680 0x563a3e8ef8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:04.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.404+0000 7f1ed37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a3e879680 0x563a3e8ef8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48298/0 (socket says 172.21.15.92:48298) 2024-09-19T09:06:04.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.404+0000 7f1ed37fe640 1 -- 172.21.15.92:0/3854189221 learned_addr learned my addr 172.21.15.92:0/3854189221 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:04.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.404+0000 7f1ed27fc640 1 --2- 172.21.15.92:0/3854189221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a3e86edc0 0x563a3e8ef3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:04.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.404+0000 7f1ed2ffd640 1 --2- 172.21.15.92:0/3854189221 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a3e86e4a0 0x563a3e8eee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:04.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.405+0000 7f1ed37fe640 1 -- 172.21.15.92:0/3854189221 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a3e86e4a0 msgr2=0x563a3e8eee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:04.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.405+0000 7f1ed37fe640 1 --2- 172.21.15.92:0/3854189221 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a3e86e4a0 0x563a3e8eee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:04.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.405+0000 7f1ed37fe640 1 -- 172.21.15.92:0/3854189221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a3e86edc0 msgr2=0x563a3e8ef3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:04.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.405+0000 7f1ed37fe640 1 --2- 172.21.15.92:0/3854189221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a3e86edc0 0x563a3e8ef3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:04.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.405+0000 7f1ed37fe640 1 -- 172.21.15.92:0/3854189221 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a3e87f880 con 0x563a3e879680 2024-09-19T09:06:04.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.405+0000 7f1ed37fe640 1 --2- 172.21.15.92:0/3854189221 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a3e879680 0x563a3e8ef8e0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc009930 tx=0x7f1ecc02a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9875ebb769b77179 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:04.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.405+0000 7f1eba7fc640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:06:04.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.405+0000 7f1eba7fc640 1 -- 172.21.15.92:0/3854189221 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc035040 con 0x563a3e879680 2024-09-19T09:06:04.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.405+0000 7f1eba7fc640 1 -- 172.21.15.92:0/3854189221 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1ecc003b80 con 0x563a3e879680 2024-09-19T09:06:04.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.405+0000 7f1edb876740 1 -- 172.21.15.92:0/3854189221 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ec4003e50 con 0x563a3e879680 2024-09-19T09:06:04.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.405+0000 7f1eba7fc640 1 -- 172.21.15.92:0/3854189221 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1ecc003d80 con 0x563a3e879680 2024-09-19T09:06:04.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.405+0000 7f1edb876740 10 client.17592 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:04.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.405+0000 7f1edb876740 1 -- 172.21.15.92:0/3854189221 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x563a3e8f8680 con 0x563a3e879680 2024-09-19T09:06:04.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.405+0000 7f1eba7fc640 1 -- 172.21.15.92:0/3854189221 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ec4003e50 con 0x563a3e879680 2024-09-19T09:06:04.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.405+0000 7f1eba7fc640 1 -- 172.21.15.92:0/3854189221 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1ecc060590 con 0x563a3e879680 2024-09-19T09:06:04.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.405+0000 7f1edb876740 10 client.17592 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:04.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.405+0000 7f1edb876740 10 client.17592 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:06:04.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.405+0000 7f1edb876740 20 client.17592 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:04.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.405+0000 7f1edb876740 1 --2- 172.21.15.92:0/3854189221 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x563a3e8f8e00 0x563a3e8fb220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:04.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.405+0000 7f1edb876740 4 client.17592 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:06:04.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.405+0000 7f1edb876740 1 -- 172.21.15.92:0/3854189221 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563a3e758210 con 0x563a3e8f8e00 2024-09-19T09:06:04.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.406+0000 7f1ed2ffd640 1 --2- 172.21.15.92:0/3854189221 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x563a3e8f8e00 0x563a3e8fb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:04.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.406+0000 7f1eba7fc640 10 client.17592 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:04.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.406+0000 7f1ed2ffd640 1 --2- 172.21.15.92:0/3854189221 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x563a3e8f8e00 0x563a3e8fb220 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4dcd2bfc7aff236 server_cookie=a9eb592d0cac897e in_seq=0 out_seq=0 2024-09-19T09:06:04.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.406+0000 7f1eba7fc640 1 -- 172.21.15.92:0/3854189221 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x563a3e758210 con 0x563a3e8f8e00 2024-09-19T09:06:04.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.406+0000 7f1eba7fc640 10 client.17592 handle_command_reply: tid=0 2024-09-19T09:06:04.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.406+0000 7f1edb876740 1 client.17592 shutdown 2024-09-19T09:06:04.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.406+0000 7f1edb876740 1 -- 172.21.15.92:0/3854189221 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a3e879680 msgr2=0x563a3e8ef8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:04.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.406+0000 7f1edb876740 1 --2- 172.21.15.92:0/3854189221 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a3e879680 0x563a3e8ef8e0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc009930 tx=0x7f1ecc02a420 comp rx=0 tx=0).stop 2024-09-19T09:06:04.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.407+0000 7f1edb876740 1 -- 172.21.15.92:0/3854189221 shutdown_connections 2024-09-19T09:06:04.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.407+0000 7f1edb876740 1 --2- 172.21.15.92:0/3854189221 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x563a3e8f8e00 0x563a3e8fb220 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:04.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.407+0000 7f1eba7fc640 0 client.17592 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:04.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.407+0000 7f1edb876740 1 --2- 172.21.15.92:0/3854189221 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a3e879680 0x563a3e8ef8e0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:04.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.407+0000 7f1edb876740 1 --2- 172.21.15.92:0/3854189221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a3e86edc0 0x563a3e8ef3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:04.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.407+0000 7f1edb876740 1 --2- 172.21.15.92:0/3854189221 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a3e86e4a0 0x563a3e8eee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:04.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.407+0000 7f1edb876740 1 -- 172.21.15.92:0/3854189221 >> 172.21.15.92:0/3854189221 conn(0x563a3e86aa30 msgr2=0x563a3e869350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:04.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.407+0000 7f1edb876740 1 -- 172.21.15.92:0/3854189221 shutdown_connections 2024-09-19T09:06:04.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.407+0000 7f1edb876740 1 -- 172.21.15.92:0/3854189221 wait complete. 2024-09-19T09:06:04.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.407+0000 7f1edb876740 20 client.17592 trim_cache size 0 max 16384 2024-09-19T09:06:04.416 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:06:04.417 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-19T09:06:04.417 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {} 2024-09-19T09:06:04.417 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:06:04.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.407+0000 7f1ed949d640 1 -- 172.21.15.92:0/1005852866 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1ec00a3240 msgr2=0x7f1ec00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:04.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.407+0000 7f1ed949d640 1 --2- 172.21.15.92:0/1005852866 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1ec00a3240 0x7f1ec00a5700 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc006010 tx=0x7f1ecc031780 comp rx=0 tx=0).stop 2024-09-19T09:06:04.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.407+0000 7f1ed949d640 1 -- 172.21.15.92:0/1005852866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ed4103780 msgr2=0x7f1ed4198ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:04.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.407+0000 7f1ed949d640 1 --2- 172.21.15.92:0/1005852866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ed4103780 0x7f1ed4198ac0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc00d740 tx=0x7f1ebc00dc00 comp rx=0 tx=0).stop 2024-09-19T09:06:04.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.407+0000 7f1ed949d640 1 -- 172.21.15.92:0/1005852866 shutdown_connections 2024-09-19T09:06:04.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.407+0000 7f1ed949d640 1 --2- 172.21.15.92:0/1005852866 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ed4108300 0x7f1ed419ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:04.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.407+0000 7f1ed949d640 1 --2- 172.21.15.92:0/1005852866 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1ec00a3240 0x7f1ec00a5700 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:04.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.407+0000 7f1ed949d640 1 --2- 172.21.15.92:0/1005852866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ed4103780 0x7f1ed4198ac0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:04.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.407+0000 7f1ed949d640 1 --2- 172.21.15.92:0/1005852866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ed4102dd0 0x7f1ed4198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:04.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.407+0000 7f1ed949d640 1 -- 172.21.15.92:0/1005852866 >> 172.21.15.92:0/1005852866 conn(0x7f1ed40fc7d0 msgr2=0x7f1ed4105e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:04.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.407+0000 7f1ed949d640 1 -- 172.21.15.92:0/1005852866 shutdown_connections 2024-09-19T09:06:04.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:04.408+0000 7f1ed949d640 1 -- 172.21.15.92:0/1005852866 wait complete. 2024-09-19T09:06:04.696 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:04 smithi092 ceph-mon[31407]: scrub queued for path: / 2024-09-19T09:06:04.697 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:04 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:06:04.697 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:04 smithi092 ceph-mon[31407]: scrub summary: active paths [/] 2024-09-19T09:06:04.697 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:04 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:06:04.697 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:04 smithi092 ceph-mon[31407]: scrub summary: idle 2024-09-19T09:06:04.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:04 smithi167 ceph-mon[35359]: scrub queued for path: / 2024-09-19T09:06:04.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:04 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:06:04.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:04 smithi167 ceph-mon[35359]: scrub summary: active paths [/] 2024-09-19T09:06:04.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:04 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:06:04.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:04 smithi167 ceph-mon[35359]: scrub summary: idle 2024-09-19T09:06:04.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:04 smithi190 ceph-mon[35358]: scrub queued for path: / 2024-09-19T09:06:04.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:04 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:06:04.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:04 smithi190 ceph-mon[35358]: scrub summary: active paths [/] 2024-09-19T09:06:04.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:04 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:06:04.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:04 smithi190 ceph-mon[35358]: scrub summary: idle 2024-09-19T09:06:05.119 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:06:05.119 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:06:05.364 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:06:05.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:05 smithi092 ceph-mon[31407]: pgmap v618: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 35 MiB/s wr, 1.49k op/s 2024-09-19T09:06:05.799 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:06:05.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.806+0000 7fddaf6a1640 1 -- 172.21.15.92:0/3482126272 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdda8105f40 msgr2=0x7fdda81063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:05.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.806+0000 7fddaf6a1640 1 --2- 172.21.15.92:0/3482126272 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdda8105f40 0x7fdda81063d0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fdda0009900 tx=0x7fdda002a470 comp rx=0 tx=0).stop 2024-09-19T09:06:05.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.806+0000 7fddaf6a1640 1 -- 172.21.15.92:0/3482126272 shutdown_connections 2024-09-19T09:06:05.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.806+0000 7fddaf6a1640 1 --2- 172.21.15.92:0/3482126272 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdda8105f40 0x7fdda81063d0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:05.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.806+0000 7fddaf6a1640 1 --2- 172.21.15.92:0/3482126272 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdda8101450 0x7fdda8105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:05.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.806+0000 7fddaf6a1640 1 --2- 172.21.15.92:0/3482126272 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdda8100b30 0x7fdda8100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:05.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.806+0000 7fddaf6a1640 1 -- 172.21.15.92:0/3482126272 >> 172.21.15.92:0/3482126272 conn(0x7fdda80fc7a0 msgr2=0x7fdda80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:05.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.806+0000 7fddaf6a1640 1 -- 172.21.15.92:0/3482126272 shutdown_connections 2024-09-19T09:06:05.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.806+0000 7fddaf6a1640 1 -- 172.21.15.92:0/3482126272 wait complete. 2024-09-19T09:06:05.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.807+0000 7fddaf6a1640 1 Processor -- start 2024-09-19T09:06:05.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.807+0000 7fddaf6a1640 1 -- start start 2024-09-19T09:06:05.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.807+0000 7fddaf6a1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdda8100b30 0x7fdda819ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:05.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.807+0000 7fddaf6a1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdda8101450 0x7fdda819f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:05.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.807+0000 7fddaf6a1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdda8105f40 0x7fdda81a3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:05.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.807+0000 7fddaf6a1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdda8118640 con 0x7fdda8105f40 2024-09-19T09:06:05.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.807+0000 7fddaf6a1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdda81184c0 con 0x7fdda8100b30 2024-09-19T09:06:05.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.807+0000 7fddaf6a1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fdda81187c0 con 0x7fdda8101450 2024-09-19T09:06:05.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.807+0000 7fddadc3e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdda8105f40 0x7fdda81a3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:05.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.807+0000 7fddadc3e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdda8105f40 0x7fdda81a3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48326/0 (socket says 172.21.15.92:48326) 2024-09-19T09:06:05.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.807+0000 7fddadc3e640 1 -- 172.21.15.92:0/3854807057 learned_addr learned my addr 172.21.15.92:0/3854807057 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:05.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.807+0000 7fddad43d640 1 --2- 172.21.15.92:0/3854807057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdda8100b30 0x7fdda819ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:05.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.807+0000 7fddacc3c640 1 --2- 172.21.15.92:0/3854807057 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdda8101450 0x7fdda819f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:05.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.807+0000 7fddadc3e640 1 -- 172.21.15.92:0/3854807057 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdda8101450 msgr2=0x7fdda819f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:05.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.807+0000 7fddadc3e640 1 --2- 172.21.15.92:0/3854807057 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdda8101450 0x7fdda819f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:05.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.807+0000 7fddadc3e640 1 -- 172.21.15.92:0/3854807057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdda8100b30 msgr2=0x7fdda819ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:05.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.807+0000 7fddadc3e640 1 --2- 172.21.15.92:0/3854807057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdda8100b30 0x7fdda819ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:05.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.807+0000 7fddadc3e640 1 -- 172.21.15.92:0/3854807057 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda81a3c50 con 0x7fdda8105f40 2024-09-19T09:06:05.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.807+0000 7fddad43d640 1 --2- 172.21.15.92:0/3854807057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdda8100b30 0x7fdda819ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:05.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.807+0000 7fddacc3c640 1 --2- 172.21.15.92:0/3854807057 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdda8101450 0x7fdda819f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:06:05.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.808+0000 7fddadc3e640 1 --2- 172.21.15.92:0/3854807057 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdda8105f40 0x7fdda81a3520 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fdda0009230 tx=0x7fdda00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:05.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.808+0000 7fdda67fc640 1 -- 172.21.15.92:0/3854807057 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda003f030 con 0x7fdda8105f40 2024-09-19T09:06:05.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.808+0000 7fddaf6a1640 1 -- 172.21.15.92:0/3854807057 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdda81a3ee0 con 0x7fdda8105f40 2024-09-19T09:06:05.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.808+0000 7fdda67fc640 1 -- 172.21.15.92:0/3854807057 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdda0003ce0 con 0x7fdda8105f40 2024-09-19T09:06:05.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.808+0000 7fdda67fc640 1 -- 172.21.15.92:0/3854807057 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda0035070 con 0x7fdda8105f40 2024-09-19T09:06:05.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.808+0000 7fddaf6a1640 1 -- 172.21.15.92:0/3854807057 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdda81ab7d0 con 0x7fdda8105f40 2024-09-19T09:06:05.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.809+0000 7fddaf6a1640 1 -- 172.21.15.92:0/3854807057 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdda81059a0 con 0x7fdda8105f40 2024-09-19T09:06:05.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.810+0000 7fdda67fc640 1 -- 172.21.15.92:0/3854807057 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fdda0042030 con 0x7fdda8105f40 2024-09-19T09:06:05.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.811+0000 7fdda67fc640 1 --2- 172.21.15.92:0/3854807057 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdd900a3240 0x7fdd900a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:05.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.811+0000 7fddad43d640 1 --2- 172.21.15.92:0/3854807057 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdd900a3240 0x7fdd900a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:05.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.811+0000 7fdda67fc640 1 -- 172.21.15.92:0/3854807057 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fdda00f0310 con 0x7fdda8105f40 2024-09-19T09:06:05.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.811+0000 7fddad43d640 1 --2- 172.21.15.92:0/3854807057 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdd900a3240 0x7fdd900a5700 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdd98009fa0 tx=0x7fdd98009570 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:05.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:05.814+0000 7fdda67fc640 1 -- 172.21.15.92:0/3854807057 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdda00bd030 con 0x7fdda8105f40 2024-09-19T09:06:05.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:05 smithi167 ceph-mon[35359]: pgmap v618: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 35 MiB/s wr, 1.49k op/s 2024-09-19T09:06:05.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:05 smithi190 ceph-mon[35358]: pgmap v618: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 35 MiB/s wr, 1.49k op/s 2024-09-19T09:06:06.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:06.014+0000 7fddaf6a1640 1 -- 172.21.15.92:0/3854807057 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdda81ab9a0 con 0x7fdda8105f40 2024-09-19T09:06:06.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:06.014+0000 7fdda67fc640 1 -- 172.21.15.92:0/3854807057 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7fdda00bc930 con 0x7fdda8105f40 2024-09-19T09:06:06.015 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:06:06.015 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:06:06.015 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:06:06.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:06.016+0000 7fddaf6a1640 1 -- 172.21.15.92:0/3854807057 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdd900a3240 msgr2=0x7fdd900a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:06.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:06.016+0000 7fddaf6a1640 1 --2- 172.21.15.92:0/3854807057 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdd900a3240 0x7fdd900a5700 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdd98009fa0 tx=0x7fdd98009570 comp rx=0 tx=0).stop 2024-09-19T09:06:06.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:06.016+0000 7fddaf6a1640 1 -- 172.21.15.92:0/3854807057 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdda8105f40 msgr2=0x7fdda81a3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:06.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:06.016+0000 7fddaf6a1640 1 --2- 172.21.15.92:0/3854807057 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdda8105f40 0x7fdda81a3520 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fdda0009230 tx=0x7fdda00042f0 comp rx=0 tx=0).stop 2024-09-19T09:06:06.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:06.016+0000 7fddaf6a1640 1 -- 172.21.15.92:0/3854807057 shutdown_connections 2024-09-19T09:06:06.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:06.016+0000 7fddaf6a1640 1 --2- 172.21.15.92:0/3854807057 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdd900a3240 0x7fdd900a5700 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:06.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:06.016+0000 7fddaf6a1640 1 --2- 172.21.15.92:0/3854807057 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdda8105f40 0x7fdda81a3520 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:06.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:06.016+0000 7fddaf6a1640 1 --2- 172.21.15.92:0/3854807057 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdda8101450 0x7fdda819f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:06.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:06.016+0000 7fddaf6a1640 1 --2- 172.21.15.92:0/3854807057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdda8100b30 0x7fdda819ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:06.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:06.016+0000 7fddaf6a1640 1 -- 172.21.15.92:0/3854807057 >> 172.21.15.92:0/3854807057 conn(0x7fdda80fc7a0 msgr2=0x7fdda810f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:06.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:06.017+0000 7fddaf6a1640 1 -- 172.21.15.92:0/3854807057 shutdown_connections 2024-09-19T09:06:06.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:06.017+0000 7fddaf6a1640 1 -- 172.21.15.92:0/3854807057 wait complete. 2024-09-19T09:06:06.601 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:06:06.846 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:06:06.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:06 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3854807057' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:06:06.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:06 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3854807057' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:06:06.965 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:06 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3854807057' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:06:07.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.323+0000 7fe47a187640 1 -- 172.21.15.92:0/2926829039 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe474100a80 msgr2=0x7fe474100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:07.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.323+0000 7fe47a187640 1 --2- 172.21.15.92:0/2926829039 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe474100a80 0x7fe474100ee0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fe468009930 tx=0x7fe46802a420 comp rx=0 tx=0).stop 2024-09-19T09:06:07.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.323+0000 7fe47a187640 1 -- 172.21.15.92:0/2926829039 shutdown_connections 2024-09-19T09:06:07.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.323+0000 7fe47a187640 1 --2- 172.21.15.92:0/2926829039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe474101420 0x7fe47410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:07.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.323+0000 7fe47a187640 1 --2- 172.21.15.92:0/2926829039 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe474100a80 0x7fe474100ee0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:07.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.323+0000 7fe47a187640 1 --2- 172.21.15.92:0/2926829039 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe474106a80 0x7fe474106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:07.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.323+0000 7fe47a187640 1 -- 172.21.15.92:0/2926829039 >> 172.21.15.92:0/2926829039 conn(0x7fe4740fc7a0 msgr2=0x7fe4740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:07.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.323+0000 7fe47a187640 1 -- 172.21.15.92:0/2926829039 shutdown_connections 2024-09-19T09:06:07.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.323+0000 7fe47a187640 1 -- 172.21.15.92:0/2926829039 wait complete. 2024-09-19T09:06:07.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.324+0000 7fe47a187640 1 Processor -- start 2024-09-19T09:06:07.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.324+0000 7fe47a187640 1 -- start start 2024-09-19T09:06:07.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.324+0000 7fe47a187640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe474100a80 0x7fe474198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:07.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.324+0000 7fe47a187640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe474101420 0x7fe474198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:07.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.324+0000 7fe47a187640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe474106a80 0x7fe47419ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:07.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.324+0000 7fe47a187640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe474110e80 con 0x7fe474106a80 2024-09-19T09:06:07.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.324+0000 7fe47a187640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe474110d00 con 0x7fe474100a80 2024-09-19T09:06:07.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.324+0000 7fe47a187640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe474111000 con 0x7fe474101420 2024-09-19T09:06:07.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.324+0000 7fe473fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe474106a80 0x7fe47419ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:07.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.324+0000 7fe473fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe474106a80 0x7fe47419ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48340/0 (socket says 172.21.15.92:48340) 2024-09-19T09:06:07.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.324+0000 7fe473fff640 1 -- 172.21.15.92:0/2053231898 learned_addr learned my addr 172.21.15.92:0/2053231898 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:07.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.324+0000 7fe472ffd640 1 --2- 172.21.15.92:0/2053231898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe474101420 0x7fe474198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:07.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.324+0000 7fe4737fe640 1 --2- 172.21.15.92:0/2053231898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe474100a80 0x7fe474198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:07.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.325+0000 7fe473fff640 1 -- 172.21.15.92:0/2053231898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe474101420 msgr2=0x7fe474198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:07.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.325+0000 7fe473fff640 1 --2- 172.21.15.92:0/2053231898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe474101420 0x7fe474198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:07.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.325+0000 7fe473fff640 1 -- 172.21.15.92:0/2053231898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe474100a80 msgr2=0x7fe474198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:07.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.325+0000 7fe473fff640 1 --2- 172.21.15.92:0/2053231898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe474100a80 0x7fe474198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:07.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.325+0000 7fe473fff640 1 -- 172.21.15.92:0/2053231898 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe47419d3b0 con 0x7fe474106a80 2024-09-19T09:06:07.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.325+0000 7fe473fff640 1 --2- 172.21.15.92:0/2053231898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe474106a80 0x7fe47419ccd0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fe46c00cce0 tx=0x7fe46c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:07.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.325+0000 7fe470ff9640 1 -- 172.21.15.92:0/2053231898 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46c00f450 con 0x7fe474106a80 2024-09-19T09:06:07.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.325+0000 7fe470ff9640 1 -- 172.21.15.92:0/2053231898 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe46c00fad0 con 0x7fe474106a80 2024-09-19T09:06:07.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.325+0000 7fe47a187640 1 -- 172.21.15.92:0/2053231898 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe47419d6a0 con 0x7fe474106a80 2024-09-19T09:06:07.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.325+0000 7fe470ff9640 1 -- 172.21.15.92:0/2053231898 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46c018c10 con 0x7fe474106a80 2024-09-19T09:06:07.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.325+0000 7fe47a187640 1 -- 172.21.15.92:0/2053231898 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4741a4f80 con 0x7fe474106a80 2024-09-19T09:06:07.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.327+0000 7fe470ff9640 1 -- 172.21.15.92:0/2053231898 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe46c00f5f0 con 0x7fe474106a80 2024-09-19T09:06:07.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.327+0000 7fe47c560740 1 Processor -- start 2024-09-19T09:06:07.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.328+0000 7fe47c560740 1 -- start start 2024-09-19T09:06:07.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.328+0000 7fe47c560740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec2305ab40 0x55ec23059090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:07.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.328+0000 7fe47c560740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec230595d0 0x55ec23059a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:07.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.328+0000 7fe47c560740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec23064370 0x55ec23066760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:07.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.328+0000 7fe47c560740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ec22fbf2f0 con 0x55ec230595d0 2024-09-19T09:06:07.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.328+0000 7fe47c560740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ec22f66cf0 con 0x55ec2305ab40 2024-09-19T09:06:07.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.328+0000 7fe47c560740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ec22fbb2b0 con 0x55ec23064370 2024-09-19T09:06:07.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.328+0000 7fe4737fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec230595d0 0x55ec23059a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:07.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.328+0000 7fe4737fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec230595d0 0x55ec23059a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48346/0 (socket says 172.21.15.92:48346) 2024-09-19T09:06:07.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.328+0000 7fe4737fe640 1 -- 172.21.15.92:0/503024128 learned_addr learned my addr 172.21.15.92:0/503024128 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:07.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.328+0000 7fe472ffd640 1 --2- 172.21.15.92:0/503024128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec2305ab40 0x55ec23059090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:07.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.328+0000 7fe472ffd640 1 --2- 172.21.15.92:0/503024128 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec23064370 0x55ec23066760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:07.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.328+0000 7fe4737fe640 1 -- 172.21.15.92:0/503024128 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec23064370 msgr2=0x55ec23066760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:07.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.328+0000 7fe4737fe640 1 --2- 172.21.15.92:0/503024128 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec23064370 0x55ec23066760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:07.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.328+0000 7fe4737fe640 1 -- 172.21.15.92:0/503024128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec2305ab40 msgr2=0x55ec23059090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:07.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.328+0000 7fe4737fe640 1 --2- 172.21.15.92:0/503024128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec2305ab40 0x55ec23059090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:07.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.328+0000 7fe4737fe640 1 -- 172.21.15.92:0/503024128 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec22f4b3a0 con 0x55ec230595d0 2024-09-19T09:06:07.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.328+0000 7fe472ffd640 1 --2- 172.21.15.92:0/503024128 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec23064370 0x55ec23066760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:06:07.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.328+0000 7fe470ff9640 1 --2- 172.21.15.92:0/2053231898 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe45c0a3240 0x7fe45c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:07.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.328+0000 7fe4737fe640 1 --2- 172.21.15.92:0/503024128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec230595d0 0x55ec23059a10 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fe46400bc20 tx=0x7fe46400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40885fd870acd59 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:07.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.328+0000 7fe472ffd640 1 --2- 172.21.15.92:0/2053231898 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe45c0a3240 0x7fe45c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:07.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.328+0000 7fe470ff9640 1 -- 172.21.15.92:0/2053231898 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe46c0d0000 con 0x7fe474106a80 2024-09-19T09:06:07.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.328+0000 7fe459ffb640 1 -- 172.21.15.92:0/503024128 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe464015070 con 0x55ec230595d0 2024-09-19T09:06:07.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.329+0000 7fe459ffb640 1 -- 172.21.15.92:0/503024128 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe464005500 con 0x55ec230595d0 2024-09-19T09:06:07.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.329+0000 7fe459ffb640 1 -- 172.21.15.92:0/503024128 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe464011640 con 0x55ec230595d0 2024-09-19T09:06:07.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.329+0000 7fe47c560740 1 -- 172.21.15.92:0/503024128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec230595d0 msgr2=0x55ec23059a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:07.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.329+0000 7fe472ffd640 1 --2- 172.21.15.92:0/2053231898 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe45c0a3240 0x7fe45c0a5700 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe468009900 tx=0x7fe468009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:07.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.329+0000 7fe47c560740 1 --2- 172.21.15.92:0/503024128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec230595d0 0x55ec23059a10 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fe46400bc20 tx=0x7fe46400f730 comp rx=0 tx=0).stop 2024-09-19T09:06:07.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.329+0000 7fe47c560740 1 -- 172.21.15.92:0/503024128 shutdown_connections 2024-09-19T09:06:07.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.329+0000 7fe47c560740 1 --2- 172.21.15.92:0/503024128 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec23064370 0x55ec23066760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:07.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.329+0000 7fe47c560740 1 --2- 172.21.15.92:0/503024128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec230595d0 0x55ec23059a10 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:07.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.329+0000 7fe47c560740 1 --2- 172.21.15.92:0/503024128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec2305ab40 0x55ec23059090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:07.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.329+0000 7fe47c560740 1 -- 172.21.15.92:0/503024128 >> 172.21.15.92:0/503024128 conn(0x55ec23022310 msgr2=0x55ec23055c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:07.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.329+0000 7fe47c560740 1 -- 172.21.15.92:0/503024128 shutdown_connections 2024-09-19T09:06:07.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.329+0000 7fe47c560740 1 -- 172.21.15.92:0/503024128 wait complete. 2024-09-19T09:06:07.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.330+0000 7fe47c560740 1 -- start start 2024-09-19T09:06:07.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.330+0000 7fe47c560740 1 Processor -- start 2024-09-19T09:06:07.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.330+0000 7fe47c560740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec230595d0 0x55ec23063d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:07.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.330+0000 7fe47c560740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec2305ab40 0x55ec23061000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:07.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.330+0000 7fe47c560740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec23064370 0x55ec230615d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:07.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.330+0000 7fe47c560740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ec23067070 con 0x55ec2305ab40 2024-09-19T09:06:07.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.330+0000 7fe47c560740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ec22f7a060 con 0x55ec23064370 2024-09-19T09:06:07.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.330+0000 7fe47c560740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ec230671f0 con 0x55ec230595d0 2024-09-19T09:06:07.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.330+0000 7fe47c560740 10 client.0 _ll_register_callbacks cb 0x55ec22ccd8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:07.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.330+0000 7fe472ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec2305ab40 0x55ec23061000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:07.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.330+0000 7fe472ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec2305ab40 0x55ec23061000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48358/0 (socket says 172.21.15.92:48358) 2024-09-19T09:06:07.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.330+0000 7fe472ffd640 1 -- 172.21.15.92:0/1617618720 learned_addr learned my addr 172.21.15.92:0/1617618720 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:07.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.330+0000 7fe473fff640 1 --2- 172.21.15.92:0/1617618720 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec23064370 0x55ec230615d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:07.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.330+0000 7fe4737fe640 1 --2- 172.21.15.92:0/1617618720 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec230595d0 0x55ec23063d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:07.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.331+0000 7fe472ffd640 1 -- 172.21.15.92:0/1617618720 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec230595d0 msgr2=0x55ec23063d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:07.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.331+0000 7fe472ffd640 1 --2- 172.21.15.92:0/1617618720 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec230595d0 0x55ec23063d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:07.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.331+0000 7fe472ffd640 1 -- 172.21.15.92:0/1617618720 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec23064370 msgr2=0x55ec230615d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:07.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.331+0000 7fe472ffd640 1 --2- 172.21.15.92:0/1617618720 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec23064370 0x55ec230615d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:07.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.331+0000 7fe472ffd640 1 -- 172.21.15.92:0/1617618720 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec22d303c0 con 0x55ec2305ab40 2024-09-19T09:06:07.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.331+0000 7fe4737fe640 1 --2- 172.21.15.92:0/1617618720 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec230595d0 0x55ec23063d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:07.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.331+0000 7fe472ffd640 1 --2- 172.21.15.92:0/1617618720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec2305ab40 0x55ec23061000 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fe468009930 tx=0x7fe46802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d64b59450079893f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:07.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.331+0000 7fe452ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:06:07.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.331+0000 7fe452ffd640 1 -- 172.21.15.92:0/1617618720 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46804e070 con 0x55ec2305ab40 2024-09-19T09:06:07.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.331+0000 7fe47c560740 1 -- 172.21.15.92:0/1617618720 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe464005500 con 0x55ec2305ab40 2024-09-19T09:06:07.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.331+0000 7fe452ffd640 1 -- 172.21.15.92:0/1617618720 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe468003ac0 con 0x55ec2305ab40 2024-09-19T09:06:07.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.331+0000 7fe452ffd640 1 -- 172.21.15.92:0/1617618720 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe46805a050 con 0x55ec2305ab40 2024-09-19T09:06:07.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.331+0000 7fe47c560740 10 client.17610 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:07.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.331+0000 7fe47c560740 1 -- 172.21.15.92:0/1617618720 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ec23072ab0 con 0x55ec2305ab40 2024-09-19T09:06:07.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.331+0000 7fe452ffd640 1 -- 172.21.15.92:0/1617618720 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe464005500 con 0x55ec2305ab40 2024-09-19T09:06:07.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.331+0000 7fe452ffd640 1 -- 172.21.15.92:0/1617618720 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe46803d450 con 0x55ec2305ab40 2024-09-19T09:06:07.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.332+0000 7fe47c560740 10 client.17610 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:07.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.332+0000 7fe47c560740 10 client.17610 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:06:07.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.332+0000 7fe47c560740 20 client.17610 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:07.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.332+0000 7fe47c560740 1 --2- 172.21.15.92:0/1617618720 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ec230740a0 0x55ec23076490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:07.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.332+0000 7fe47c560740 4 client.17610 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:06:07.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.332+0000 7fe47c560740 1 -- 172.21.15.92:0/1617618720 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec22fcc860 con 0x55ec230740a0 2024-09-19T09:06:07.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.332+0000 7fe4737fe640 1 --2- 172.21.15.92:0/1617618720 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ec230740a0 0x55ec23076490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:07.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.332+0000 7fe4737fe640 1 --2- 172.21.15.92:0/1617618720 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ec230740a0 0x55ec23076490 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=352c7787a0059d82 server_cookie=b72d58f227a296af in_seq=0 out_seq=0 2024-09-19T09:06:07.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.332+0000 7fe452ffd640 10 client.17610 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:07.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.333+0000 7fe452ffd640 1 -- 172.21.15.92:0/1617618720 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ec22fcc860 con 0x55ec230740a0 2024-09-19T09:06:07.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.333+0000 7fe452ffd640 10 client.17610 handle_command_reply: tid=0 2024-09-19T09:06:07.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.333+0000 7fe47c560740 1 client.17610 shutdown 2024-09-19T09:06:07.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.333+0000 7fe47c560740 1 -- 172.21.15.92:0/1617618720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec2305ab40 msgr2=0x55ec23061000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:07.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.333+0000 7fe47c560740 1 --2- 172.21.15.92:0/1617618720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec2305ab40 0x55ec23061000 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fe468009930 tx=0x7fe46802a420 comp rx=0 tx=0).stop 2024-09-19T09:06:07.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.333+0000 7fe47c560740 1 -- 172.21.15.92:0/1617618720 shutdown_connections 2024-09-19T09:06:07.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.333+0000 7fe47c560740 1 --2- 172.21.15.92:0/1617618720 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ec230740a0 0x55ec23076490 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:07.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.333+0000 7fe47c560740 1 --2- 172.21.15.92:0/1617618720 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec23064370 0x55ec230615d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:07.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.333+0000 7fe47c560740 1 --2- 172.21.15.92:0/1617618720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec2305ab40 0x55ec23061000 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:07.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.333+0000 7fe47c560740 1 --2- 172.21.15.92:0/1617618720 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec230595d0 0x55ec23063d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:07.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.333+0000 7fe452ffd640 0 client.17610 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:07.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.333+0000 7fe47c560740 1 -- 172.21.15.92:0/1617618720 >> 172.21.15.92:0/1617618720 conn(0x55ec23022310 msgr2=0x55ec2305b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:07.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.334+0000 7fe47c560740 1 -- 172.21.15.92:0/1617618720 shutdown_connections 2024-09-19T09:06:07.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.334+0000 7fe47c560740 1 -- 172.21.15.92:0/1617618720 wait complete. 2024-09-19T09:06:07.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.334+0000 7fe47c560740 20 client.17610 trim_cache size 0 max 16384 2024-09-19T09:06:07.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.347+0000 7fe47c560740 1 Processor -- start 2024-09-19T09:06:07.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.347+0000 7fe47c560740 1 -- start start 2024-09-19T09:06:07.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.347+0000 7fe47c560740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec230595d0 0x55ec23062f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:07.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.347+0000 7fe47c560740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec2305ab40 0x55ec2305c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:07.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.347+0000 7fe47c560740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec23064370 0x55ec2305c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:07.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.348+0000 7fe47c560740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe4741ab4d0 con 0x55ec23064370 2024-09-19T09:06:07.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.348+0000 7fe47c560740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe4741add70 con 0x55ec2305ab40 2024-09-19T09:06:07.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.348+0000 7fe47c560740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe4741abb60 con 0x55ec230595d0 2024-09-19T09:06:07.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.348+0000 7fe473fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec23064370 0x55ec2305c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:07.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.348+0000 7fe473fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec23064370 0x55ec2305c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48368/0 (socket says 172.21.15.92:48368) 2024-09-19T09:06:07.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.348+0000 7fe473fff640 1 -- 172.21.15.92:0/1247012202 learned_addr learned my addr 172.21.15.92:0/1247012202 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:07.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.348+0000 7fe4737fe640 1 --2- 172.21.15.92:0/1247012202 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec230595d0 0x55ec23062f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:07.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.348+0000 7fe472ffd640 1 --2- 172.21.15.92:0/1247012202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec2305ab40 0x55ec2305c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:07.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.348+0000 7fe473fff640 1 -- 172.21.15.92:0/1247012202 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec230595d0 msgr2=0x55ec23062f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:07.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.348+0000 7fe473fff640 1 --2- 172.21.15.92:0/1247012202 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec230595d0 0x55ec23062f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:07.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.348+0000 7fe473fff640 1 -- 172.21.15.92:0/1247012202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec2305ab40 msgr2=0x55ec2305c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:07.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.348+0000 7fe473fff640 1 --2- 172.21.15.92:0/1247012202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec2305ab40 0x55ec2305c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:07.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.348+0000 7fe473fff640 1 -- 172.21.15.92:0/1247012202 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec2305ff40 con 0x55ec23064370 2024-09-19T09:06:07.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.348+0000 7fe472ffd640 1 --2- 172.21.15.92:0/1247012202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec2305ab40 0x55ec2305c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:07.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.348+0000 7fe473fff640 1 --2- 172.21.15.92:0/1247012202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec23064370 0x55ec2305c660 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fe46c0cdb00 tx=0x7fe46c09bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb4d1aff195854d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:07.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.348+0000 7fe4597fa640 1 -- 172.21.15.92:0/1247012202 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46c0a09d0 con 0x55ec23064370 2024-09-19T09:06:07.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.348+0000 7fe4597fa640 1 -- 172.21.15.92:0/1247012202 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe46c0a5290 con 0x55ec23064370 2024-09-19T09:06:07.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.348+0000 7fe4597fa640 1 -- 172.21.15.92:0/1247012202 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46c0a4e00 con 0x55ec23064370 2024-09-19T09:06:07.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.349+0000 7fe47c560740 1 -- 172.21.15.92:0/1247012202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec23064370 msgr2=0x55ec2305c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:07.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.349+0000 7fe47c560740 1 --2- 172.21.15.92:0/1247012202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec23064370 0x55ec2305c660 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fe46c0cdb00 tx=0x7fe46c09bf80 comp rx=0 tx=0).stop 2024-09-19T09:06:07.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.349+0000 7fe47c560740 1 -- 172.21.15.92:0/1247012202 shutdown_connections 2024-09-19T09:06:07.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.349+0000 7fe47c560740 1 --2- 172.21.15.92:0/1247012202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec23064370 0x55ec2305c660 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:07.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.349+0000 7fe47c560740 1 --2- 172.21.15.92:0/1247012202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec2305ab40 0x55ec2305c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:07.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.349+0000 7fe47c560740 1 --2- 172.21.15.92:0/1247012202 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec230595d0 0x55ec23062f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:07.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.349+0000 7fe47c560740 1 -- 172.21.15.92:0/1247012202 >> 172.21.15.92:0/1247012202 conn(0x55ec23022310 msgr2=0x55ec23062860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:07.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.349+0000 7fe47c560740 1 -- 172.21.15.92:0/1247012202 shutdown_connections 2024-09-19T09:06:07.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.349+0000 7fe47c560740 1 -- 172.21.15.92:0/1247012202 wait complete. 2024-09-19T09:06:07.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.349+0000 7fe47c560740 1 -- start start 2024-09-19T09:06:07.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.350+0000 7fe47c560740 1 Processor -- start 2024-09-19T09:06:07.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.350+0000 7fe47c560740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec230595d0 0x55ec2306c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:07.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.350+0000 7fe47c560740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec2305ab40 0x55ec2306c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:07.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.350+0000 7fe47c560740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec23064370 0x55ec23069450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:07.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.350+0000 7fe47c560740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe4741ac230 con 0x55ec23064370 2024-09-19T09:06:07.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.350+0000 7fe47c560740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe4741ad6a0 con 0x55ec230595d0 2024-09-19T09:06:07.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.350+0000 7fe47c560740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe4741ac900 con 0x55ec2305ab40 2024-09-19T09:06:07.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.350+0000 7fe47c560740 10 client.0 _ll_register_callbacks cb 0x7fe468005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:07.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.350+0000 7fe473fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec23064370 0x55ec23069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:07.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.350+0000 7fe473fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec23064370 0x55ec23069450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48380/0 (socket says 172.21.15.92:48380) 2024-09-19T09:06:07.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.350+0000 7fe473fff640 1 -- 172.21.15.92:0/873020603 learned_addr learned my addr 172.21.15.92:0/873020603 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:07.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.350+0000 7fe4737fe640 1 --2- 172.21.15.92:0/873020603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec230595d0 0x55ec2306c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:07.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.350+0000 7fe472ffd640 1 --2- 172.21.15.92:0/873020603 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec2305ab40 0x55ec2306c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:07.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.350+0000 7fe473fff640 1 -- 172.21.15.92:0/873020603 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec2305ab40 msgr2=0x55ec2306c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:07.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.350+0000 7fe473fff640 1 --2- 172.21.15.92:0/873020603 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec2305ab40 0x55ec2306c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:07.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.350+0000 7fe473fff640 1 -- 172.21.15.92:0/873020603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec230595d0 msgr2=0x55ec2306c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:07.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.350+0000 7fe473fff640 1 --2- 172.21.15.92:0/873020603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec230595d0 0x55ec2306c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:07.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.350+0000 7fe473fff640 1 -- 172.21.15.92:0/873020603 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec2306d080 con 0x55ec23064370 2024-09-19T09:06:07.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.351+0000 7fe473fff640 1 --2- 172.21.15.92:0/873020603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec23064370 0x55ec23069450 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fe46c098ff0 tx=0x7fe46c0a0b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb9fdeaeeb60b78 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:07.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.351+0000 7fe452ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:06:07.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.351+0000 7fe452ffd640 1 -- 172.21.15.92:0/873020603 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46c067470 con 0x55ec23064370 2024-09-19T09:06:07.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.351+0000 7fe452ffd640 1 -- 172.21.15.92:0/873020603 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe46c0a4e00 con 0x55ec23064370 2024-09-19T09:06:07.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.351+0000 7fe47c560740 1 -- 172.21.15.92:0/873020603 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe46c0a5290 con 0x55ec23064370 2024-09-19T09:06:07.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.351+0000 7fe452ffd640 1 -- 172.21.15.92:0/873020603 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe46c0a5000 con 0x55ec23064370 2024-09-19T09:06:07.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.351+0000 7fe47c560740 10 client.17616 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:07.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.351+0000 7fe47c560740 1 -- 172.21.15.92:0/873020603 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ec230df1c0 con 0x55ec23064370 2024-09-19T09:06:07.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.351+0000 7fe452ffd640 1 -- 172.21.15.92:0/873020603 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe46c0a5290 con 0x55ec23064370 2024-09-19T09:06:07.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.351+0000 7fe452ffd640 1 -- 172.21.15.92:0/873020603 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe46c09bae0 con 0x55ec23064370 2024-09-19T09:06:07.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.351+0000 7fe47c560740 10 client.17616 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:07.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.351+0000 7fe47c560740 10 client.17616 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:06:07.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.351+0000 7fe47c560740 20 client.17616 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:07.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.351+0000 7fe47c560740 1 --2- 172.21.15.92:0/873020603 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ec230df900 0x55ec230e1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:07.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.351+0000 7fe47c560740 4 client.17616 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:06:07.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.351+0000 7fe47c560740 1 -- 172.21.15.92:0/873020603 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ec22fc6d70 con 0x55ec230df900 2024-09-19T09:06:07.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.352+0000 7fe4737fe640 1 --2- 172.21.15.92:0/873020603 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ec230df900 0x55ec230e1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:07.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.352+0000 7fe4737fe640 1 --2- 172.21.15.92:0/873020603 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ec230df900 0x55ec230e1d20 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3ff6dcf3d0ab8e6 server_cookie=4fd463da427f0525 in_seq=0 out_seq=0 2024-09-19T09:06:07.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.352+0000 7fe452ffd640 10 client.17616 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:07.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.352+0000 7fe452ffd640 1 -- 172.21.15.92:0/873020603 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ec22fc6d70 con 0x55ec230df900 2024-09-19T09:06:07.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.352+0000 7fe452ffd640 10 client.17616 handle_command_reply: tid=0 2024-09-19T09:06:07.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.352+0000 7fe47c560740 1 client.17616 shutdown 2024-09-19T09:06:07.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.352+0000 7fe47c560740 1 -- 172.21.15.92:0/873020603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec23064370 msgr2=0x55ec23069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:07.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.352+0000 7fe47c560740 1 --2- 172.21.15.92:0/873020603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec23064370 0x55ec23069450 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fe46c098ff0 tx=0x7fe46c0a0b20 comp rx=0 tx=0).stop 2024-09-19T09:06:07.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.352+0000 7fe47c560740 1 -- 172.21.15.92:0/873020603 shutdown_connections 2024-09-19T09:06:07.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.352+0000 7fe47c560740 1 --2- 172.21.15.92:0/873020603 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ec230df900 0x55ec230e1d20 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:07.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.352+0000 7fe47c560740 1 --2- 172.21.15.92:0/873020603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec23064370 0x55ec23069450 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:07.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.352+0000 7fe47c560740 1 --2- 172.21.15.92:0/873020603 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec2305ab40 0x55ec2306c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:07.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.352+0000 7fe452ffd640 0 client.17616 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:07.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.352+0000 7fe47c560740 1 --2- 172.21.15.92:0/873020603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec230595d0 0x55ec2306c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:07.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.352+0000 7fe47c560740 1 -- 172.21.15.92:0/873020603 >> 172.21.15.92:0/873020603 conn(0x55ec23022310 msgr2=0x55ec2306f300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:07.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.352+0000 7fe47c560740 1 -- 172.21.15.92:0/873020603 shutdown_connections 2024-09-19T09:06:07.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.352+0000 7fe47c560740 1 -- 172.21.15.92:0/873020603 wait complete. 2024-09-19T09:06:07.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.353+0000 7fe47c560740 20 client.17616 trim_cache size 0 max 16384 2024-09-19T09:06:07.359 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-19T09:06:07.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.353+0000 7fe47a187640 1 -- 172.21.15.92:0/2053231898 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe45c0a3240 msgr2=0x7fe45c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:07.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.353+0000 7fe47a187640 1 --2- 172.21.15.92:0/2053231898 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe45c0a3240 0x7fe45c0a5700 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe468009900 tx=0x7fe468009260 comp rx=0 tx=0).stop 2024-09-19T09:06:07.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.353+0000 7fe47a187640 1 -- 172.21.15.92:0/2053231898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe474106a80 msgr2=0x7fe47419ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:07.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.353+0000 7fe47a187640 1 --2- 172.21.15.92:0/2053231898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe474106a80 0x7fe47419ccd0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fe46c00cce0 tx=0x7fe46c00a620 comp rx=0 tx=0).stop 2024-09-19T09:06:07.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.353+0000 7fe47a187640 1 -- 172.21.15.92:0/2053231898 shutdown_connections 2024-09-19T09:06:07.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.353+0000 7fe47a187640 1 --2- 172.21.15.92:0/2053231898 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe45c0a3240 0x7fe45c0a5700 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:07.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.353+0000 7fe47a187640 1 --2- 172.21.15.92:0/2053231898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe474106a80 0x7fe47419ccd0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:07.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.353+0000 7fe47a187640 1 --2- 172.21.15.92:0/2053231898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe474101420 0x7fe474198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:07.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.353+0000 7fe47a187640 1 --2- 172.21.15.92:0/2053231898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe474100a80 0x7fe474198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:07.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.353+0000 7fe47a187640 1 -- 172.21.15.92:0/2053231898 >> 172.21.15.92:0/2053231898 conn(0x7fe4740fc7a0 msgr2=0x7fe47406aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:07.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.353+0000 7fe47a187640 1 -- 172.21.15.92:0/2053231898 shutdown_connections 2024-09-19T09:06:07.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:07.353+0000 7fe47a187640 1 -- 172.21.15.92:0/2053231898 wait complete. 2024-09-19T09:06:07.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:07 smithi167 ceph-mon[35359]: pgmap v619: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 16 MiB/s wr, 838 op/s 2024-09-19T09:06:07.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:07 smithi190 ceph-mon[35358]: pgmap v619: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 16 MiB/s wr, 838 op/s 2024-09-19T09:06:07.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:07 smithi092 ceph-mon[31407]: pgmap v619: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 16 MiB/s wr, 838 op/s 2024-09-19T09:06:09.118 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:06:09.119 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:06:09.404 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:06:09.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:09 smithi092 ceph-mon[31407]: pgmap v620: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 6.4 MiB/s wr, 538 op/s 2024-09-19T09:06:09.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:09 smithi167 ceph-mon[35359]: pgmap v620: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 6.4 MiB/s wr, 538 op/s 2024-09-19T09:06:09.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:09 smithi190 ceph-mon[35358]: pgmap v620: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 6.4 MiB/s wr, 538 op/s 2024-09-19T09:06:09.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.888+0000 7f166f1b8640 1 -- 172.21.15.92:0/3911835837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16681036e0 msgr2=0x7f1668107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:09.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.888+0000 7f166f1b8640 1 --2- 172.21.15.92:0/3911835837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16681036e0 0x7f1668107b90 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f1654009930 tx=0x7f165402a420 comp rx=0 tx=0).stop 2024-09-19T09:06:09.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.888+0000 7f166f1b8640 1 -- 172.21.15.92:0/3911835837 shutdown_connections 2024-09-19T09:06:09.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.888+0000 7f166f1b8640 1 --2- 172.21.15.92:0/3911835837 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16681082a0 0x7f166810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.888+0000 7f166f1b8640 1 --2- 172.21.15.92:0/3911835837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16681036e0 0x7f1668107b90 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.888+0000 7f166f1b8640 1 --2- 172.21.15.92:0/3911835837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1668102d30 0x7f1668103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.888+0000 7f166f1b8640 1 -- 172.21.15.92:0/3911835837 >> 172.21.15.92:0/3911835837 conn(0x7f16680fc7d0 msgr2=0x7f16680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:09.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.888+0000 7f166f1b8640 1 -- 172.21.15.92:0/3911835837 shutdown_connections 2024-09-19T09:06:09.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.888+0000 7f166f1b8640 1 -- 172.21.15.92:0/3911835837 wait complete. 2024-09-19T09:06:09.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.888+0000 7f166f1b8640 1 Processor -- start 2024-09-19T09:06:09.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.888+0000 7f166f1b8640 1 -- start start 2024-09-19T09:06:09.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.889+0000 7f166f1b8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1668102d30 0x7f16681985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:09.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.889+0000 7f166f1b8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16681036e0 0x7f1668198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:09.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.889+0000 7f166f1b8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16681082a0 0x7f166819ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:09.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.889+0000 7f166f1b8640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f16681120a0 con 0x7f1668102d30 2024-09-19T09:06:09.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.889+0000 7f166f1b8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1668111f20 con 0x7f16681082a0 2024-09-19T09:06:09.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.889+0000 7f166f1b8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1668112220 con 0x7f16681036e0 2024-09-19T09:06:09.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.889+0000 7f166cf54640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1668102d30 0x7f16681985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:09.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.889+0000 7f166cf54640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1668102d30 0x7f16681985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48388/0 (socket says 172.21.15.92:48388) 2024-09-19T09:06:09.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.889+0000 7f166cf54640 1 -- 172.21.15.92:0/1409571017 learned_addr learned my addr 172.21.15.92:0/1409571017 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:09.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.889+0000 7f1667fff640 1 --2- 172.21.15.92:0/1409571017 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16681036e0 0x7f1668198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:09.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.889+0000 7f166d755640 1 --2- 172.21.15.92:0/1409571017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16681082a0 0x7f166819ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:09.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.889+0000 7f166cf54640 1 -- 172.21.15.92:0/1409571017 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16681036e0 msgr2=0x7f1668198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:09.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.889+0000 7f166cf54640 1 --2- 172.21.15.92:0/1409571017 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16681036e0 0x7f1668198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.889+0000 7f166cf54640 1 -- 172.21.15.92:0/1409571017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16681082a0 msgr2=0x7f166819ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:09.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.889+0000 7f166cf54640 1 --2- 172.21.15.92:0/1409571017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16681082a0 0x7f166819ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.889+0000 7f166cf54640 1 -- 172.21.15.92:0/1409571017 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f166819d570 con 0x7f1668102d30 2024-09-19T09:06:09.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.889+0000 7f166d755640 1 --2- 172.21.15.92:0/1409571017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16681082a0 0x7f166819ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:09.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.889+0000 7f166cf54640 1 --2- 172.21.15.92:0/1409571017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1668102d30 0x7f16681985c0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f165c00e9f0 tx=0x7f165c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:09.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.889+0000 7f1665ffb640 1 -- 172.21.15.92:0/1409571017 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c00cd80 con 0x7f1668102d30 2024-09-19T09:06:09.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.889+0000 7f166f1b8640 1 -- 172.21.15.92:0/1409571017 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f166819d860 con 0x7f1668102d30 2024-09-19T09:06:09.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.889+0000 7f1665ffb640 1 -- 172.21.15.92:0/1409571017 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f165c010910 con 0x7f1668102d30 2024-09-19T09:06:09.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.889+0000 7f1665ffb640 1 -- 172.21.15.92:0/1409571017 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c018990 con 0x7f1668102d30 2024-09-19T09:06:09.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.890+0000 7f166f1b8640 1 -- 172.21.15.92:0/1409571017 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16681a5140 con 0x7f1668102d30 2024-09-19T09:06:09.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.892+0000 7f1665ffb640 1 -- 172.21.15.92:0/1409571017 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f165c010ac0 con 0x7f1668102d30 2024-09-19T09:06:09.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.892+0000 7f1671591740 1 Processor -- start 2024-09-19T09:06:09.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.892+0000 7f1671591740 1 -- start start 2024-09-19T09:06:09.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.893+0000 7f1671591740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f226219a40 0x55f226219e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:09.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.893+0000 7f1671591740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f22621a360 0x55f226228c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:09.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.893+0000 7f1671591740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f226229150 0x55f22622b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:09.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.893+0000 7f1671591740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f22617f280 con 0x55f226229150 2024-09-19T09:06:09.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.893+0000 7f1671591740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f226126b10 con 0x55f226219a40 2024-09-19T09:06:09.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.893+0000 7f1671591740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f22617b240 con 0x55f22621a360 2024-09-19T09:06:09.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.893+0000 7f1665ffb640 1 --2- 172.21.15.92:0/1409571017 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f16580a3240 0x7f16580a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:09.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.893+0000 7f1667fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f226229150 0x55f22622b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:09.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.893+0000 7f1667fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f226229150 0x55f22622b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48398/0 (socket says 172.21.15.92:48398) 2024-09-19T09:06:09.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.893+0000 7f1667fff640 1 -- 172.21.15.92:0/2558521814 learned_addr learned my addr 172.21.15.92:0/2558521814 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:09.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.893+0000 7f166d755640 1 --2- 172.21.15.92:0/2558521814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f226219a40 0x55f226219e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:09.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.893+0000 7f166cf54640 1 --2- 172.21.15.92:0/2558521814 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f22621a360 0x55f226228c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:09.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.893+0000 7f166d755640 1 --2- 172.21.15.92:0/1409571017 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f16580a3240 0x7f16580a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:09.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.893+0000 7f1665ffb640 1 -- 172.21.15.92:0/1409571017 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f165c0cfd10 con 0x7f1668102d30 2024-09-19T09:06:09.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.893+0000 7f1667fff640 1 -- 172.21.15.92:0/2558521814 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f22621a360 msgr2=0x55f226228c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:09.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.893+0000 7f1667fff640 1 --2- 172.21.15.92:0/2558521814 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f22621a360 0x55f226228c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.893+0000 7f1667fff640 1 -- 172.21.15.92:0/2558521814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f226219a40 msgr2=0x55f226219e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:09.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.893+0000 7f1667fff640 1 --2- 172.21.15.92:0/2558521814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f226219a40 0x55f226219e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.893+0000 7f1667fff640 1 -- 172.21.15.92:0/2558521814 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2261331f0 con 0x55f226229150 2024-09-19T09:06:09.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.894+0000 7f166d755640 1 --2- 172.21.15.92:0/1409571017 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f16580a3240 0x7f16580a5700 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1660005c40 tx=0x7f1660009a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:09.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.894+0000 7f1667fff640 1 --2- 172.21.15.92:0/2558521814 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f226229150 0x55f22622b540 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f1654000c00 tx=0x7f1654005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=996c73c7589af716 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:09.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.894+0000 7f1652ffd640 1 -- 172.21.15.92:0/2558521814 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1654040070 con 0x55f226229150 2024-09-19T09:06:09.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.894+0000 7f1652ffd640 1 -- 172.21.15.92:0/2558521814 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1654004030 con 0x55f226229150 2024-09-19T09:06:09.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.894+0000 7f1652ffd640 1 -- 172.21.15.92:0/2558521814 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1654035040 con 0x55f226229150 2024-09-19T09:06:09.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.895+0000 7f1671591740 1 -- 172.21.15.92:0/2558521814 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f226229150 msgr2=0x55f22622b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:09.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.895+0000 7f1671591740 1 --2- 172.21.15.92:0/2558521814 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f226229150 0x55f22622b540 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f1654000c00 tx=0x7f1654005e80 comp rx=0 tx=0).stop 2024-09-19T09:06:09.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.895+0000 7f1671591740 1 -- 172.21.15.92:0/2558521814 shutdown_connections 2024-09-19T09:06:09.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.895+0000 7f1671591740 1 --2- 172.21.15.92:0/2558521814 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f226229150 0x55f22622b540 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.895+0000 7f1671591740 1 --2- 172.21.15.92:0/2558521814 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f22621a360 0x55f226228c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.895+0000 7f1671591740 1 --2- 172.21.15.92:0/2558521814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f226219a40 0x55f226219e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.895+0000 7f1671591740 1 -- 172.21.15.92:0/2558521814 >> 172.21.15.92:0/2558521814 conn(0x55f2262160f0 msgr2=0x55f2262164d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:09.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.895+0000 7f1671591740 1 -- 172.21.15.92:0/2558521814 shutdown_connections 2024-09-19T09:06:09.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.895+0000 7f1671591740 1 -- 172.21.15.92:0/2558521814 wait complete. 2024-09-19T09:06:09.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.895+0000 7f1671591740 1 -- start start 2024-09-19T09:06:09.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.895+0000 7f1671591740 1 Processor -- start 2024-09-19T09:06:09.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.896+0000 7f1671591740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f226219a40 0x55f226226070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:09.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.896+0000 7f1671591740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f22621a360 0x55f2262265b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:09.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.896+0000 7f1671591740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f226229150 0x55f226226af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:09.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.896+0000 7f1671591740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f22622bd20 con 0x55f226219a40 2024-09-19T09:06:09.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.896+0000 7f1671591740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f226139f10 con 0x55f226229150 2024-09-19T09:06:09.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.896+0000 7f1671591740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f22622bea0 con 0x55f22621a360 2024-09-19T09:06:09.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.896+0000 7f1671591740 10 client.0 _ll_register_callbacks cb 0x55f226102a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:09.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.896+0000 7f166cf54640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f226219a40 0x55f226226070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:09.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.896+0000 7f166cf54640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f226219a40 0x55f226226070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48410/0 (socket says 172.21.15.92:48410) 2024-09-19T09:06:09.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.896+0000 7f166cf54640 1 -- 172.21.15.92:0/2384461938 learned_addr learned my addr 172.21.15.92:0/2384461938 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:09.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.896+0000 7f1667fff640 1 --2- 172.21.15.92:0/2384461938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f22621a360 0x55f2262265b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:09.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.896+0000 7f166d755640 1 --2- 172.21.15.92:0/2384461938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f226229150 0x55f226226af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:09.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.896+0000 7f166cf54640 1 -- 172.21.15.92:0/2384461938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f22621a360 msgr2=0x55f2262265b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:09.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.896+0000 7f166cf54640 1 --2- 172.21.15.92:0/2384461938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f22621a360 0x55f2262265b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.896+0000 7f166cf54640 1 -- 172.21.15.92:0/2384461938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f226229150 msgr2=0x55f226226af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:09.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.896+0000 7f166cf54640 1 --2- 172.21.15.92:0/2384461938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f226229150 0x55f226226af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.896+0000 7f166cf54640 1 -- 172.21.15.92:0/2384461938 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f225ef06a0 con 0x55f226219a40 2024-09-19T09:06:09.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.896+0000 7f166cf54640 1 --2- 172.21.15.92:0/2384461938 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f226219a40 0x55f226226070 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f165c00c6a0 tx=0x7f165c06b0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e0d4b39fd56cd3e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:09.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.896+0000 7f1647fff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:06:09.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.897+0000 7f1647fff640 1 -- 172.21.15.92:0/2384461938 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c096e60 con 0x55f226219a40 2024-09-19T09:06:09.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.897+0000 7f1647fff640 1 -- 172.21.15.92:0/2384461938 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f165c09a5f0 con 0x55f226219a40 2024-09-19T09:06:09.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.897+0000 7f1671591740 1 -- 172.21.15.92:0/2384461938 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1654004030 con 0x55f226219a40 2024-09-19T09:06:09.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.897+0000 7f1647fff640 1 -- 172.21.15.92:0/2384461938 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f165c09a430 con 0x55f226219a40 2024-09-19T09:06:09.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.897+0000 7f1671591740 10 client.17628 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:09.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.897+0000 7f1671591740 1 -- 172.21.15.92:0/2384461938 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f2262379a0 con 0x55f226219a40 2024-09-19T09:06:09.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.897+0000 7f1647fff640 1 -- 172.21.15.92:0/2384461938 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1654004030 con 0x55f226219a40 2024-09-19T09:06:09.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.897+0000 7f1647fff640 1 -- 172.21.15.92:0/2384461938 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f165c066df0 con 0x55f226219a40 2024-09-19T09:06:09.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.897+0000 7f1671591740 10 client.17628 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:09.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.897+0000 7f1671591740 10 client.17628 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:06:09.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.897+0000 7f1671591740 20 client.17628 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:09.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.897+0000 7f1671591740 1 --2- 172.21.15.92:0/2384461938 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f226238e60 0x55f22623b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:09.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.897+0000 7f1671591740 4 client.17628 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:06:09.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.897+0000 7f1671591740 1 -- 172.21.15.92:0/2384461938 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f22618c7f0 con 0x55f226238e60 2024-09-19T09:06:09.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.898+0000 7f1667fff640 1 --2- 172.21.15.92:0/2384461938 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f226238e60 0x55f22623b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:09.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.898+0000 7f1667fff640 1 --2- 172.21.15.92:0/2384461938 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f226238e60 0x55f22623b270 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44c50a2535272ad5 server_cookie=6d12243e4fcc2db1 in_seq=0 out_seq=0 2024-09-19T09:06:09.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.898+0000 7f1647fff640 10 client.17628 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:09.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.899+0000 7f1647fff640 1 -- 172.21.15.92:0/2384461938 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f22618c7f0 con 0x55f226238e60 2024-09-19T09:06:09.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.899+0000 7f1647fff640 10 client.17628 handle_command_reply: tid=0 2024-09-19T09:06:09.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.899+0000 7f1671591740 1 client.17628 shutdown 2024-09-19T09:06:09.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.899+0000 7f1671591740 1 -- 172.21.15.92:0/2384461938 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f226219a40 msgr2=0x55f226226070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:09.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.899+0000 7f1671591740 1 --2- 172.21.15.92:0/2384461938 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f226219a40 0x55f226226070 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f165c00c6a0 tx=0x7f165c06b0f0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.899+0000 7f1671591740 1 -- 172.21.15.92:0/2384461938 shutdown_connections 2024-09-19T09:06:09.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.899+0000 7f1671591740 1 --2- 172.21.15.92:0/2384461938 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f226238e60 0x55f22623b270 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.899+0000 7f1671591740 1 --2- 172.21.15.92:0/2384461938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f226229150 0x55f226226af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.899+0000 7f1671591740 1 --2- 172.21.15.92:0/2384461938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f22621a360 0x55f2262265b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.899+0000 7f1671591740 1 --2- 172.21.15.92:0/2384461938 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f226219a40 0x55f226226070 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.899+0000 7f1671591740 1 -- 172.21.15.92:0/2384461938 >> 172.21.15.92:0/2384461938 conn(0x55f2262160f0 msgr2=0x55f22621be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:09.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.899+0000 7f1647fff640 0 client.17628 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:09.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.899+0000 7f1671591740 1 -- 172.21.15.92:0/2384461938 shutdown_connections 2024-09-19T09:06:09.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.899+0000 7f1671591740 1 -- 172.21.15.92:0/2384461938 wait complete. 2024-09-19T09:06:09.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.899+0000 7f1671591740 20 client.17628 trim_cache size 0 max 16384 2024-09-19T09:06:09.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.916+0000 7f1671591740 1 Processor -- start 2024-09-19T09:06:09.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.917+0000 7f1671591740 1 -- start start 2024-09-19T09:06:09.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.917+0000 7f1671591740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f226219a40 0x55f226224fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:09.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.917+0000 7f1671591740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f22621a360 0x55f226240b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:09.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.917+0000 7f1671591740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f226229150 0x55f226241080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:09.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.917+0000 7f1671591740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f16681a93e0 con 0x55f22621a360 2024-09-19T09:06:09.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.917+0000 7f1671591740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f16681abc80 con 0x55f226229150 2024-09-19T09:06:09.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.917+0000 7f1671591740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f16681a9a70 con 0x55f226219a40 2024-09-19T09:06:09.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.917+0000 7f1667fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f22621a360 0x55f226240b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:09.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.917+0000 7f1667fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f22621a360 0x55f226240b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48424/0 (socket says 172.21.15.92:48424) 2024-09-19T09:06:09.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.917+0000 7f1667fff640 1 -- 172.21.15.92:0/1363751091 learned_addr learned my addr 172.21.15.92:0/1363751091 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:09.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.917+0000 7f166cf54640 1 --2- 172.21.15.92:0/1363751091 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f226219a40 0x55f226224fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:09.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.917+0000 7f166d755640 1 --2- 172.21.15.92:0/1363751091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f226229150 0x55f226241080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:09.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.917+0000 7f1667fff640 1 -- 172.21.15.92:0/1363751091 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f226219a40 msgr2=0x55f226224fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:09.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.917+0000 7f1667fff640 1 --2- 172.21.15.92:0/1363751091 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f226219a40 0x55f226224fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.917+0000 7f1667fff640 1 -- 172.21.15.92:0/1363751091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f226229150 msgr2=0x55f226241080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:09.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.917+0000 7f1667fff640 1 --2- 172.21.15.92:0/1363751091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f226229150 0x55f226241080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.917+0000 7f1667fff640 1 -- 172.21.15.92:0/1363751091 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f226228940 con 0x55f22621a360 2024-09-19T09:06:09.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.917+0000 7f166d755640 1 --2- 172.21.15.92:0/1363751091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f226229150 0x55f226241080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:09.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.917+0000 7f1667fff640 1 --2- 172.21.15.92:0/1363751091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f22621a360 0x55f226240b40 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x55f2262171e0 tx=0x7f1654005210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c66de260969e2d6c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:09.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.918+0000 7f16527fc640 1 -- 172.21.15.92:0/1363751091 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1654040070 con 0x55f22621a360 2024-09-19T09:06:09.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.918+0000 7f16527fc640 1 -- 172.21.15.92:0/1363751091 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1654004040 con 0x55f22621a360 2024-09-19T09:06:09.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.918+0000 7f16527fc640 1 -- 172.21.15.92:0/1363751091 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1654035040 con 0x55f22621a360 2024-09-19T09:06:09.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.918+0000 7f1671591740 1 -- 172.21.15.92:0/1363751091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f22621a360 msgr2=0x55f226240b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:09.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.918+0000 7f1671591740 1 --2- 172.21.15.92:0/1363751091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f22621a360 0x55f226240b40 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x55f2262171e0 tx=0x7f1654005210 comp rx=0 tx=0).stop 2024-09-19T09:06:09.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.918+0000 7f1671591740 1 -- 172.21.15.92:0/1363751091 shutdown_connections 2024-09-19T09:06:09.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.918+0000 7f1671591740 1 --2- 172.21.15.92:0/1363751091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f226229150 0x55f226241080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.918+0000 7f1671591740 1 --2- 172.21.15.92:0/1363751091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f22621a360 0x55f226240b40 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.918+0000 7f1671591740 1 --2- 172.21.15.92:0/1363751091 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f226219a40 0x55f226224fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.918+0000 7f1671591740 1 -- 172.21.15.92:0/1363751091 >> 172.21.15.92:0/1363751091 conn(0x55f2262160f0 msgr2=0x55f226227fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:09.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.919+0000 7f1671591740 1 -- 172.21.15.92:0/1363751091 shutdown_connections 2024-09-19T09:06:09.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.919+0000 7f1671591740 1 -- 172.21.15.92:0/1363751091 wait complete. 2024-09-19T09:06:09.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.919+0000 7f1671591740 1 -- start start 2024-09-19T09:06:09.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.919+0000 7f1671591740 1 Processor -- start 2024-09-19T09:06:09.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.919+0000 7f1671591740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f226219a40 0x55f22622d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:09.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.919+0000 7f1671591740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f22621a360 0x55f22622db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:09.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.919+0000 7f1671591740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f226229150 0x55f2262a2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:09.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.919+0000 7f1671591740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f16681aa140 con 0x55f226219a40 2024-09-19T09:06:09.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.919+0000 7f1671591740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f16681ab5b0 con 0x55f226229150 2024-09-19T09:06:09.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.919+0000 7f1671591740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f16681aa810 con 0x55f22621a360 2024-09-19T09:06:09.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.919+0000 7f1671591740 10 client.0 _ll_register_callbacks cb 0x7f165c00e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:09.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.919+0000 7f166cf54640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f226219a40 0x55f22622d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:09.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.919+0000 7f166cf54640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f226219a40 0x55f22622d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48434/0 (socket says 172.21.15.92:48434) 2024-09-19T09:06:09.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.919+0000 7f166cf54640 1 -- 172.21.15.92:0/2667318817 learned_addr learned my addr 172.21.15.92:0/2667318817 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:09.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.920+0000 7f166d755640 1 --2- 172.21.15.92:0/2667318817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f226229150 0x55f2262a2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:09.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.920+0000 7f1667fff640 1 --2- 172.21.15.92:0/2667318817 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f22621a360 0x55f22622db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:09.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.920+0000 7f166cf54640 1 -- 172.21.15.92:0/2667318817 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f22621a360 msgr2=0x55f22622db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:09.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.920+0000 7f166cf54640 1 --2- 172.21.15.92:0/2667318817 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f22621a360 0x55f22622db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.920+0000 7f166cf54640 1 -- 172.21.15.92:0/2667318817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f226229150 msgr2=0x55f2262a2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:09.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.920+0000 7f166cf54640 1 --2- 172.21.15.92:0/2667318817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f226229150 0x55f2262a2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.920+0000 7f166cf54640 1 -- 172.21.15.92:0/2667318817 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2262a3050 con 0x55f226219a40 2024-09-19T09:06:09.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.920+0000 7f166cf54640 1 --2- 172.21.15.92:0/2667318817 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f226219a40 0x55f22622d5f0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f165c005b60 tx=0x7f165c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=723bf4ad338afe6d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:09.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.920+0000 7f1647fff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:06:09.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.920+0000 7f1647fff640 1 -- 172.21.15.92:0/2667318817 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c096e60 con 0x55f226219a40 2024-09-19T09:06:09.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.920+0000 7f1647fff640 1 -- 172.21.15.92:0/2667318817 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f165c099f50 con 0x55f226219a40 2024-09-19T09:06:09.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.920+0000 7f1671591740 1 -- 172.21.15.92:0/2667318817 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1654004040 con 0x55f226219a40 2024-09-19T09:06:09.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.920+0000 7f1647fff640 1 -- 172.21.15.92:0/2667318817 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f165c099940 con 0x55f226219a40 2024-09-19T09:06:09.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.920+0000 7f1671591740 10 client.17634 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:09.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.920+0000 7f1671591740 1 -- 172.21.15.92:0/2667318817 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f2262a4310 con 0x55f226219a40 2024-09-19T09:06:09.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.921+0000 7f1647fff640 1 -- 172.21.15.92:0/2667318817 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f165c06f040 con 0x55f226219a40 2024-09-19T09:06:09.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.921+0000 7f1647fff640 1 -- 172.21.15.92:0/2667318817 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f165c010430 con 0x55f226219a40 2024-09-19T09:06:09.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.921+0000 7f1671591740 10 client.17634 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:09.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.921+0000 7f1671591740 10 client.17634 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:06:09.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.921+0000 7f1671591740 20 client.17634 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:09.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.921+0000 7f1671591740 1 --2- 172.21.15.92:0/2667318817 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f2262a4a60 0x55f2262a6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:09.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.921+0000 7f1671591740 4 client.17634 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:06:09.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.921+0000 7f1671591740 1 -- 172.21.15.92:0/2667318817 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f1654004040 con 0x55f2262a4a60 2024-09-19T09:06:09.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.921+0000 7f1667fff640 1 --2- 172.21.15.92:0/2667318817 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f2262a4a60 0x55f2262a6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:09.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.921+0000 7f1647fff640 10 client.17634 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:09.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.921+0000 7f1667fff640 1 --2- 172.21.15.92:0/2667318817 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f2262a4a60 0x55f2262a6e80 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c76f8213b5d4d72 server_cookie=9ade095462f75a6 in_seq=0 out_seq=0 2024-09-19T09:06:09.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.922+0000 7f1647fff640 1 -- 172.21.15.92:0/2667318817 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f1654004040 con 0x55f2262a4a60 2024-09-19T09:06:09.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.922+0000 7f1647fff640 10 client.17634 handle_command_reply: tid=0 2024-09-19T09:06:09.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.922+0000 7f1671591740 1 client.17634 shutdown 2024-09-19T09:06:09.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.922+0000 7f1671591740 1 -- 172.21.15.92:0/2667318817 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f226219a40 msgr2=0x55f22622d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:09.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.922+0000 7f1671591740 1 --2- 172.21.15.92:0/2667318817 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f226219a40 0x55f22622d5f0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f165c005b60 tx=0x7f165c00cf90 comp rx=0 tx=0).stop 2024-09-19T09:06:09.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.922+0000 7f1671591740 1 -- 172.21.15.92:0/2667318817 shutdown_connections 2024-09-19T09:06:09.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.922+0000 7f1671591740 1 --2- 172.21.15.92:0/2667318817 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f2262a4a60 0x55f2262a6e80 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.922+0000 7f1671591740 1 --2- 172.21.15.92:0/2667318817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f226229150 0x55f2262a2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.922+0000 7f1671591740 1 --2- 172.21.15.92:0/2667318817 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f22621a360 0x55f22622db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.922+0000 7f1671591740 1 --2- 172.21.15.92:0/2667318817 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f226219a40 0x55f22622d5f0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.922+0000 7f1671591740 1 -- 172.21.15.92:0/2667318817 >> 172.21.15.92:0/2667318817 conn(0x55f2262160f0 msgr2=0x55f226227620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:09.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.923+0000 7f1647fff640 0 client.17634 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:09.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.923+0000 7f1671591740 1 -- 172.21.15.92:0/2667318817 shutdown_connections 2024-09-19T09:06:09.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.923+0000 7f1671591740 1 -- 172.21.15.92:0/2667318817 wait complete. 2024-09-19T09:06:09.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.923+0000 7f1671591740 20 client.17634 trim_cache size 0 max 16384 2024-09-19T09:06:09.932 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:06:09.933 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-19T09:06:09.933 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "e71966b3-9323-4848-b66e-e11c2bed6759", 2024-09-19T09:06:09.933 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-19T09:06:09.933 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:06:09.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.923+0000 7f166f1b8640 1 -- 172.21.15.92:0/1409571017 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f16580a3240 msgr2=0x7f16580a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:09.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.923+0000 7f166f1b8640 1 --2- 172.21.15.92:0/1409571017 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f16580a3240 0x7f16580a5700 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1660005c40 tx=0x7f1660009a20 comp rx=0 tx=0).stop 2024-09-19T09:06:09.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.923+0000 7f166f1b8640 1 -- 172.21.15.92:0/1409571017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1668102d30 msgr2=0x7f16681985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:09.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.923+0000 7f166f1b8640 1 --2- 172.21.15.92:0/1409571017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1668102d30 0x7f16681985c0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f165c00e9f0 tx=0x7f165c00eeb0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.923+0000 7f166f1b8640 1 -- 172.21.15.92:0/1409571017 shutdown_connections 2024-09-19T09:06:09.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.923+0000 7f166f1b8640 1 --2- 172.21.15.92:0/1409571017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16681082a0 0x7f166819ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.923+0000 7f166f1b8640 1 --2- 172.21.15.92:0/1409571017 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16681036e0 0x7f1668198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.923+0000 7f166f1b8640 1 --2- 172.21.15.92:0/1409571017 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f16580a3240 0x7f16580a5700 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.923+0000 7f166f1b8640 1 --2- 172.21.15.92:0/1409571017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1668102d30 0x7f16681985c0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.923+0000 7f166f1b8640 1 -- 172.21.15.92:0/1409571017 >> 172.21.15.92:0/1409571017 conn(0x7f16680fc7d0 msgr2=0x7f1668105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:09.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.924+0000 7f166f1b8640 1 -- 172.21.15.92:0/1409571017 shutdown_connections 2024-09-19T09:06:09.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:09.924+0000 7f166f1b8640 1 -- 172.21.15.92:0/1409571017 wait complete. 2024-09-19T09:06:10.610 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:06:10.799 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:06:10.858 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:06:11.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.235+0000 7f65c976d640 1 -- 172.21.15.92:0/35688918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65c4102790 msgr2=0x7f65c41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:11.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.235+0000 7f65c976d640 1 --2- 172.21.15.92:0/35688918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65c4102790 0x7f65c41067e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f65ac009900 tx=0x7f65ac02a410 comp rx=0 tx=0).stop 2024-09-19T09:06:11.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.235+0000 7f65c976d640 1 -- 172.21.15.92:0/35688918 shutdown_connections 2024-09-19T09:06:11.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.235+0000 7f65c976d640 1 --2- 172.21.15.92:0/35688918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65c4106f10 0x7f65c410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:11.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.235+0000 7f65c976d640 1 --2- 172.21.15.92:0/35688918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65c4102790 0x7f65c41067e0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:11.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.235+0000 7f65c976d640 1 --2- 172.21.15.92:0/35688918 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65c4101de0 0x7f65c41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:11.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.235+0000 7f65c976d640 1 -- 172.21.15.92:0/35688918 >> 172.21.15.92:0/35688918 conn(0x7f65c40fd8c0 msgr2=0x7f65c40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:11.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.235+0000 7f65c976d640 1 -- 172.21.15.92:0/35688918 shutdown_connections 2024-09-19T09:06:11.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.235+0000 7f65c976d640 1 -- 172.21.15.92:0/35688918 wait complete. 2024-09-19T09:06:11.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.236+0000 7f65c976d640 1 Processor -- start 2024-09-19T09:06:11.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.236+0000 7f65c976d640 1 -- start start 2024-09-19T09:06:11.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.236+0000 7f65c976d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65c4101de0 0x7f65c41985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:11.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.236+0000 7f65c976d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65c4102790 0x7f65c4198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:11.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.236+0000 7f65c976d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65c4106f10 0x7f65c419ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:11.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.236+0000 7f65c976d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f65c4112010 con 0x7f65c4101de0 2024-09-19T09:06:11.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.236+0000 7f65c976d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f65c4111e90 con 0x7f65c4106f10 2024-09-19T09:06:11.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.236+0000 7f65c976d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f65c4112190 con 0x7f65c4102790 2024-09-19T09:06:11.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.236+0000 7f65c2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65c4101de0 0x7f65c41985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:11.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.236+0000 7f65c2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65c4101de0 0x7f65c41985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48440/0 (socket says 172.21.15.92:48440) 2024-09-19T09:06:11.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.236+0000 7f65c2ffd640 1 -- 172.21.15.92:0/1301709058 learned_addr learned my addr 172.21.15.92:0/1301709058 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:11.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.236+0000 7f65c37fe640 1 --2- 172.21.15.92:0/1301709058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65c4106f10 0x7f65c419ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:11.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.236+0000 7f65bbfff640 1 --2- 172.21.15.92:0/1301709058 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65c4102790 0x7f65c4198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:11.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.237+0000 7f65c2ffd640 1 -- 172.21.15.92:0/1301709058 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65c4102790 msgr2=0x7f65c4198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:11.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.237+0000 7f65c2ffd640 1 --2- 172.21.15.92:0/1301709058 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65c4102790 0x7f65c4198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:11.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.237+0000 7f65c2ffd640 1 -- 172.21.15.92:0/1301709058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65c4106f10 msgr2=0x7f65c419ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:11.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.237+0000 7f65c2ffd640 1 --2- 172.21.15.92:0/1301709058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65c4106f10 0x7f65c419ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:11.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.237+0000 7f65c2ffd640 1 -- 172.21.15.92:0/1301709058 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65c419d560 con 0x7f65c4101de0 2024-09-19T09:06:11.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.237+0000 7f65c37fe640 1 --2- 172.21.15.92:0/1301709058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65c4106f10 0x7f65c419ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:11.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.237+0000 7f65bbfff640 1 --2- 172.21.15.92:0/1301709058 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65c4102790 0x7f65c4198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:11.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.237+0000 7f65c2ffd640 1 --2- 172.21.15.92:0/1301709058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65c4101de0 0x7f65c41985b0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f65b400b4a0 tx=0x7f65b400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:11.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.237+0000 7f65c0ff9640 1 -- 172.21.15.92:0/1301709058 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65b4014070 con 0x7f65c4101de0 2024-09-19T09:06:11.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.237+0000 7f65c976d640 1 -- 172.21.15.92:0/1301709058 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65c419d850 con 0x7f65c4101de0 2024-09-19T09:06:11.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.237+0000 7f65c0ff9640 1 -- 172.21.15.92:0/1301709058 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65b4010af0 con 0x7f65c4101de0 2024-09-19T09:06:11.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.237+0000 7f65c0ff9640 1 -- 172.21.15.92:0/1301709058 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65b4017d10 con 0x7f65c4101de0 2024-09-19T09:06:11.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.237+0000 7f65c976d640 1 -- 172.21.15.92:0/1301709058 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65c41a5130 con 0x7f65c4101de0 2024-09-19T09:06:11.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.239+0000 7f65c0ff9640 1 -- 172.21.15.92:0/1301709058 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f65b4017070 con 0x7f65c4101de0 2024-09-19T09:06:11.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.240+0000 7f65c0ff9640 1 --2- 172.21.15.92:0/1301709058 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f65b00a3240 0x7f65b00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:11.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.240+0000 7f65bbfff640 1 --2- 172.21.15.92:0/1301709058 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f65b00a3240 0x7f65b00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:11.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.240+0000 7f65c0ff9640 1 -- 172.21.15.92:0/1301709058 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f65b40cee00 con 0x7f65c4101de0 2024-09-19T09:06:11.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.240+0000 7f65cbb46740 1 Processor -- start 2024-09-19T09:06:11.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.240+0000 7f65cbb46740 1 -- start start 2024-09-19T09:06:11.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.241+0000 7f65cbb46740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f750f774a0 0x55f750f77880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:11.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.241+0000 7f65bbfff640 1 --2- 172.21.15.92:0/1301709058 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f65b00a3240 0x7f65b00a5700 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f65c40fdd50 tx=0x7f65ac005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:11.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.241+0000 7f65cbb46740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f750f77dc0 0x55f750f82140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:11.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.241+0000 7f65cbb46740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f750f82680 0x55f750f84a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:11.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.241+0000 7f65cbb46740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f750edd2e0 con 0x55f750f77dc0 2024-09-19T09:06:11.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.241+0000 7f65cbb46740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f750e84ce0 con 0x55f750f82680 2024-09-19T09:06:11.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.241+0000 7f65cbb46740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f750ed92a0 con 0x55f750f774a0 2024-09-19T09:06:11.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.241+0000 7f65bbfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f750f77dc0 0x55f750f82140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:11.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.241+0000 7f65bbfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f750f77dc0 0x55f750f82140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48446/0 (socket says 172.21.15.92:48446) 2024-09-19T09:06:11.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.241+0000 7f65bbfff640 1 -- 172.21.15.92:0/1373140654 learned_addr learned my addr 172.21.15.92:0/1373140654 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:11.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.241+0000 7f65c2ffd640 1 --2- 172.21.15.92:0/1373140654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f750f774a0 0x55f750f77880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:11.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.241+0000 7f65bbfff640 1 -- 172.21.15.92:0/1373140654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f750f774a0 msgr2=0x55f750f77880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:11.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.241+0000 7f65bbfff640 1 --2- 172.21.15.92:0/1373140654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f750f774a0 0x55f750f77880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:11.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.241+0000 7f65c37fe640 1 --2- 172.21.15.92:0/1373140654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f750f82680 0x55f750f84a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:11.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.241+0000 7f65bbfff640 1 -- 172.21.15.92:0/1373140654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f750f82680 msgr2=0x55f750f84a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:11.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.241+0000 7f65bbfff640 1 --2- 172.21.15.92:0/1373140654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f750f82680 0x55f750f84a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:11.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.241+0000 7f65bbfff640 1 -- 172.21.15.92:0/1373140654 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f750e69440 con 0x55f750f77dc0 2024-09-19T09:06:11.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.241+0000 7f65bbfff640 1 --2- 172.21.15.92:0/1373140654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f750f77dc0 0x55f750f82140 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f65ac009900 tx=0x7f65ac03c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98e1f2dbd0992ff5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:11.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.241+0000 7f65b97fa640 1 -- 172.21.15.92:0/1373140654 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ac035050 con 0x55f750f77dc0 2024-09-19T09:06:11.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.241+0000 7f65b97fa640 1 -- 172.21.15.92:0/1373140654 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65ac04d070 con 0x55f750f77dc0 2024-09-19T09:06:11.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.241+0000 7f65b97fa640 1 -- 172.21.15.92:0/1373140654 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ac048940 con 0x55f750f77dc0 2024-09-19T09:06:11.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.242+0000 7f65cbb46740 1 -- 172.21.15.92:0/1373140654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f750f77dc0 msgr2=0x55f750f82140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:11.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.242+0000 7f65cbb46740 1 --2- 172.21.15.92:0/1373140654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f750f77dc0 0x55f750f82140 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f65ac009900 tx=0x7f65ac03c000 comp rx=0 tx=0).stop 2024-09-19T09:06:11.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.242+0000 7f65cbb46740 1 -- 172.21.15.92:0/1373140654 shutdown_connections 2024-09-19T09:06:11.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.242+0000 7f65cbb46740 1 --2- 172.21.15.92:0/1373140654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f750f82680 0x55f750f84a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:11.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.242+0000 7f65cbb46740 1 --2- 172.21.15.92:0/1373140654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f750f77dc0 0x55f750f82140 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:11.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.242+0000 7f65cbb46740 1 --2- 172.21.15.92:0/1373140654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f750f774a0 0x55f750f77880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:11.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.242+0000 7f65cbb46740 1 -- 172.21.15.92:0/1373140654 >> 172.21.15.92:0/1373140654 conn(0x55f750f73a30 msgr2=0x55f750f73e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:11.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.242+0000 7f65cbb46740 1 -- 172.21.15.92:0/1373140654 shutdown_connections 2024-09-19T09:06:11.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.242+0000 7f65cbb46740 1 -- 172.21.15.92:0/1373140654 wait complete. 2024-09-19T09:06:11.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.243+0000 7f65cbb46740 1 -- start start 2024-09-19T09:06:11.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.243+0000 7f65cbb46740 1 Processor -- start 2024-09-19T09:06:11.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.243+0000 7f65cbb46740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f750f774a0 0x55f750f81fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:11.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.243+0000 7f65cbb46740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f750f77dc0 0x55f750f7f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:11.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.243+0000 7f65cbb46740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f750f82680 0x55f750f7f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:11.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.243+0000 7f65cbb46740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f750f85250 con 0x55f750f774a0 2024-09-19T09:06:11.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.243+0000 7f65cbb46740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f750e98050 con 0x55f750f82680 2024-09-19T09:06:11.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.243+0000 7f65cbb46740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f750f853d0 con 0x55f750f77dc0 2024-09-19T09:06:11.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.243+0000 7f65cbb46740 10 client.0 _ll_register_callbacks cb 0x55f750ed8160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:11.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.243+0000 7f65c2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f750f774a0 0x55f750f81fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:11.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.243+0000 7f65c2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f750f774a0 0x55f750f81fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48448/0 (socket says 172.21.15.92:48448) 2024-09-19T09:06:11.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.243+0000 7f65c2ffd640 1 -- 172.21.15.92:0/3664238749 learned_addr learned my addr 172.21.15.92:0/3664238749 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:11.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.243+0000 7f65bbfff640 1 --2- 172.21.15.92:0/3664238749 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f750f77dc0 0x55f750f7f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:11.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.244+0000 7f65c37fe640 1 --2- 172.21.15.92:0/3664238749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f750f82680 0x55f750f7f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:11.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.244+0000 7f65c2ffd640 1 -- 172.21.15.92:0/3664238749 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f750f77dc0 msgr2=0x55f750f7f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:11.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.244+0000 7f65c2ffd640 1 --2- 172.21.15.92:0/3664238749 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f750f77dc0 0x55f750f7f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:11.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.244+0000 7f65c2ffd640 1 -- 172.21.15.92:0/3664238749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f750f82680 msgr2=0x55f750f7f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:11.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.244+0000 7f65c2ffd640 1 --2- 172.21.15.92:0/3664238749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f750f82680 0x55f750f7f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:11.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.244+0000 7f65c2ffd640 1 -- 172.21.15.92:0/3664238749 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f750c4e3c0 con 0x55f750f774a0 2024-09-19T09:06:11.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.244+0000 7f65c37fe640 1 --2- 172.21.15.92:0/3664238749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f750f82680 0x55f750f7f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:06:11.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.244+0000 7f65c2ffd640 1 --2- 172.21.15.92:0/3664238749 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f750f774a0 0x55f750f81fe0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f65b409b3b0 tx=0x7f65b40092f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8d777f7b0af607b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:11.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.244+0000 7f65aa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:06:11.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.244+0000 7f65aa7fc640 1 -- 172.21.15.92:0/3664238749 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65b40b4060 con 0x55f750f774a0 2024-09-19T09:06:11.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.244+0000 7f65aa7fc640 1 -- 172.21.15.92:0/3664238749 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f65b4097a90 con 0x55f750f774a0 2024-09-19T09:06:11.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.244+0000 7f65cbb46740 1 -- 172.21.15.92:0/3664238749 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65ac04d070 con 0x55f750f774a0 2024-09-19T09:06:11.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.244+0000 7f65aa7fc640 1 -- 172.21.15.92:0/3664238749 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f65b401e070 con 0x55f750f774a0 2024-09-19T09:06:11.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.244+0000 7f65cbb46740 10 client.17646 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:11.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.244+0000 7f65cbb46740 1 -- 172.21.15.92:0/3664238749 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f750f90c80 con 0x55f750f774a0 2024-09-19T09:06:11.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.244+0000 7f65aa7fc640 1 -- 172.21.15.92:0/3664238749 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65ac04d070 con 0x55f750f774a0 2024-09-19T09:06:11.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.244+0000 7f65aa7fc640 1 -- 172.21.15.92:0/3664238749 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f65b40b4200 con 0x55f750f774a0 2024-09-19T09:06:11.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.244+0000 7f65cbb46740 10 client.17646 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:11.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.244+0000 7f65cbb46740 10 client.17646 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:06:11.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.244+0000 7f65cbb46740 20 client.17646 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:11.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.245+0000 7f65cbb46740 1 --2- 172.21.15.92:0/3664238749 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f750f92140 0x55f750f94530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:11.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.245+0000 7f65cbb46740 4 client.17646 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:06:11.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.245+0000 7f65cbb46740 1 -- 172.21.15.92:0/3664238749 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f750eea850 con 0x55f750f92140 2024-09-19T09:06:11.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.245+0000 7f65bbfff640 1 --2- 172.21.15.92:0/3664238749 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f750f92140 0x55f750f94530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:11.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.245+0000 7f65bbfff640 1 --2- 172.21.15.92:0/3664238749 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f750f92140 0x55f750f94530 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7fe61117b376131 server_cookie=69769ccfae8936e7 in_seq=0 out_seq=0 2024-09-19T09:06:11.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.245+0000 7f65aa7fc640 10 client.17646 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:11.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.246+0000 7f65aa7fc640 1 -- 172.21.15.92:0/3664238749 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f750eea850 con 0x55f750f92140 2024-09-19T09:06:11.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.246+0000 7f65aa7fc640 10 client.17646 handle_command_reply: tid=0 2024-09-19T09:06:11.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.246+0000 7f65cbb46740 1 client.17646 shutdown 2024-09-19T09:06:11.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.246+0000 7f65cbb46740 1 -- 172.21.15.92:0/3664238749 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f750f774a0 msgr2=0x55f750f81fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:11.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.246+0000 7f65cbb46740 1 --2- 172.21.15.92:0/3664238749 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f750f774a0 0x55f750f81fe0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f65b409b3b0 tx=0x7f65b40092f0 comp rx=0 tx=0).stop 2024-09-19T09:06:11.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.246+0000 7f65cbb46740 1 -- 172.21.15.92:0/3664238749 shutdown_connections 2024-09-19T09:06:11.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.246+0000 7f65cbb46740 1 --2- 172.21.15.92:0/3664238749 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f750f92140 0x55f750f94530 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:11.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.246+0000 7f65cbb46740 1 --2- 172.21.15.92:0/3664238749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f750f82680 0x55f750f7f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:11.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.246+0000 7f65cbb46740 1 --2- 172.21.15.92:0/3664238749 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f750f77dc0 0x55f750f7f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:11.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.246+0000 7f65aa7fc640 0 client.17646 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:11.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.246+0000 7f65cbb46740 1 --2- 172.21.15.92:0/3664238749 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f750f774a0 0x55f750f81fe0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:11.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.246+0000 7f65cbb46740 1 -- 172.21.15.92:0/3664238749 >> 172.21.15.92:0/3664238749 conn(0x55f750f73a30 msgr2=0x55f750f79710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:11.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.246+0000 7f65cbb46740 1 -- 172.21.15.92:0/3664238749 shutdown_connections 2024-09-19T09:06:11.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.246+0000 7f65cbb46740 1 -- 172.21.15.92:0/3664238749 wait complete. 2024-09-19T09:06:11.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.246+0000 7f65cbb46740 20 client.17646 trim_cache size 0 max 16384 2024-09-19T09:06:11.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.263+0000 7f65cbb46740 1 Processor -- start 2024-09-19T09:06:11.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.263+0000 7f65cbb46740 1 -- start start 2024-09-19T09:06:11.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.263+0000 7f65cbb46740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f750f774a0 0x55f750f7db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:11.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.263+0000 7f65cbb46740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f750f77dc0 0x55f750f99dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:11.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.263+0000 7f65cbb46740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f750f82680 0x55f750f9a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:11.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.263+0000 7f65cbb46740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f65c41ab6a0 con 0x55f750f82680 2024-09-19T09:06:11.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.263+0000 7f65cbb46740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f65c41adf40 con 0x55f750f77dc0 2024-09-19T09:06:11.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.263+0000 7f65cbb46740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f65c41abd30 con 0x55f750f774a0 2024-09-19T09:06:11.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.263+0000 7f65c37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f750f82680 0x55f750f9a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:11.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.263+0000 7f65c37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f750f82680 0x55f750f9a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48450/0 (socket says 172.21.15.92:48450) 2024-09-19T09:06:11.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.263+0000 7f65c37fe640 1 -- 172.21.15.92:0/533506308 learned_addr learned my addr 172.21.15.92:0/533506308 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:11.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.264+0000 7f65bbfff640 1 --2- 172.21.15.92:0/533506308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f750f77dc0 0x55f750f99dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:11.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.264+0000 7f65c37fe640 1 -- 172.21.15.92:0/533506308 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f750f774a0 msgr2=0x55f750f7db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:11.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.264+0000 7f65c37fe640 1 --2- 172.21.15.92:0/533506308 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f750f774a0 0x55f750f7db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:11.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.264+0000 7f65c37fe640 1 -- 172.21.15.92:0/533506308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f750f77dc0 msgr2=0x55f750f99dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:11.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.264+0000 7f65c37fe640 1 --2- 172.21.15.92:0/533506308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f750f77dc0 0x55f750f99dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:11.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.264+0000 7f65c37fe640 1 -- 172.21.15.92:0/533506308 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f750f7e240 con 0x55f750f82680 2024-09-19T09:06:11.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.264+0000 7f65bbfff640 1 --2- 172.21.15.92:0/533506308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f750f77dc0 0x55f750f99dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:06:11.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.264+0000 7f65c37fe640 1 --2- 172.21.15.92:0/533506308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f750f82680 0x55f750f9a310 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f65bc009ef0 tx=0x7f65bc00a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fdc06d34d199c90 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:11.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.264+0000 7f65b8ff9640 1 -- 172.21.15.92:0/533506308 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65bc014780 con 0x55f750f82680 2024-09-19T09:06:11.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.264+0000 7f65b8ff9640 1 -- 172.21.15.92:0/533506308 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65bc01a070 con 0x55f750f82680 2024-09-19T09:06:11.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.264+0000 7f65b8ff9640 1 -- 172.21.15.92:0/533506308 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65bc015d70 con 0x55f750f82680 2024-09-19T09:06:11.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.265+0000 7f65cbb46740 1 -- 172.21.15.92:0/533506308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f750f82680 msgr2=0x55f750f9a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:11.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.265+0000 7f65cbb46740 1 --2- 172.21.15.92:0/533506308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f750f82680 0x55f750f9a310 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f65bc009ef0 tx=0x7f65bc00a7d0 comp rx=0 tx=0).stop 2024-09-19T09:06:11.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.265+0000 7f65cbb46740 1 -- 172.21.15.92:0/533506308 shutdown_connections 2024-09-19T09:06:11.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.265+0000 7f65cbb46740 1 --2- 172.21.15.92:0/533506308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f750f82680 0x55f750f9a310 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:11.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.265+0000 7f65cbb46740 1 --2- 172.21.15.92:0/533506308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f750f77dc0 0x55f750f99dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:11.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.265+0000 7f65cbb46740 1 --2- 172.21.15.92:0/533506308 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f750f774a0 0x55f750f7db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:11.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.265+0000 7f65cbb46740 1 -- 172.21.15.92:0/533506308 >> 172.21.15.92:0/533506308 conn(0x55f750f73a30 msgr2=0x55f750f72b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:11.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.265+0000 7f65cbb46740 1 -- 172.21.15.92:0/533506308 shutdown_connections 2024-09-19T09:06:11.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.265+0000 7f65cbb46740 1 -- 172.21.15.92:0/533506308 wait complete. 2024-09-19T09:06:11.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.265+0000 7f65cbb46740 1 -- start start 2024-09-19T09:06:11.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.265+0000 7f65cbb46740 1 Processor -- start 2024-09-19T09:06:11.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.265+0000 7f65cbb46740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f750f774a0 0x55f750f88380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:11.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.265+0000 7f65cbb46740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f750f77dc0 0x55f750f888c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:11.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.265+0000 7f65cbb46740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f750f82680 0x55f750f88e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:11.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.265+0000 7f65cbb46740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f65c41ac400 con 0x55f750f82680 2024-09-19T09:06:11.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.265+0000 7f65cbb46740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f65c41ad870 con 0x55f750f77dc0 2024-09-19T09:06:11.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.265+0000 7f65cbb46740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f65c41acad0 con 0x55f750f774a0 2024-09-19T09:06:11.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.266+0000 7f65cbb46740 10 client.0 _ll_register_callbacks cb 0x7f65b40976e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:11.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.266+0000 7f65c37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f750f82680 0x55f750f88e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:11.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.266+0000 7f65c37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f750f82680 0x55f750f88e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48456/0 (socket says 172.21.15.92:48456) 2024-09-19T09:06:11.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.266+0000 7f65c37fe640 1 -- 172.21.15.92:0/270057278 learned_addr learned my addr 172.21.15.92:0/270057278 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:11.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.266+0000 7f65c2ffd640 1 --2- 172.21.15.92:0/270057278 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f750f774a0 0x55f750f88380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:11.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.266+0000 7f65bbfff640 1 --2- 172.21.15.92:0/270057278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f750f77dc0 0x55f750f888c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:11.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.266+0000 7f65c37fe640 1 -- 172.21.15.92:0/270057278 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f750f774a0 msgr2=0x55f750f88380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:11.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.266+0000 7f65c37fe640 1 --2- 172.21.15.92:0/270057278 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f750f774a0 0x55f750f88380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:11.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.266+0000 7f65c37fe640 1 -- 172.21.15.92:0/270057278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f750f77dc0 msgr2=0x55f750f888c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:11.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.266+0000 7f65c37fe640 1 --2- 172.21.15.92:0/270057278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f750f77dc0 0x55f750f888c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:11.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.266+0000 7f65c37fe640 1 -- 172.21.15.92:0/270057278 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f750f948a0 con 0x55f750f82680 2024-09-19T09:06:11.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.266+0000 7f65c37fe640 1 --2- 172.21.15.92:0/270057278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f750f82680 0x55f750f88e00 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f65bc00acd0 tx=0x7f65bc015da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b5696cc366b050 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:11.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.266+0000 7f65aa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:06:11.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.266+0000 7f65aa7fc640 1 -- 172.21.15.92:0/270057278 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65bc014790 con 0x55f750f82680 2024-09-19T09:06:11.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.266+0000 7f65aa7fc640 1 -- 172.21.15.92:0/270057278 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f65bc014930 con 0x55f750f82680 2024-09-19T09:06:11.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.266+0000 7f65cbb46740 1 -- 172.21.15.92:0/270057278 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65bc01a070 con 0x55f750f82680 2024-09-19T09:06:11.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.266+0000 7f65aa7fc640 1 -- 172.21.15.92:0/270057278 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f65bc014b30 con 0x55f750f82680 2024-09-19T09:06:11.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.266+0000 7f65cbb46740 10 client.17652 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:11.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.266+0000 7f65cbb46740 1 -- 172.21.15.92:0/270057278 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f750f82350 con 0x55f750f82680 2024-09-19T09:06:11.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.267+0000 7f65aa7fc640 1 -- 172.21.15.92:0/270057278 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65bc01a070 con 0x55f750f82680 2024-09-19T09:06:11.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.267+0000 7f65aa7fc640 1 -- 172.21.15.92:0/270057278 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f65bc035400 con 0x55f750f82680 2024-09-19T09:06:11.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.267+0000 7f65cbb46740 10 client.17652 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:11.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.267+0000 7f65cbb46740 10 client.17652 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:06:11.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.267+0000 7f65cbb46740 20 client.17652 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:11.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.267+0000 7f65cbb46740 1 --2- 172.21.15.92:0/270057278 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f750ffd360 0x55f750fff780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:11.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.267+0000 7f65cbb46740 4 client.17652 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:06:11.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.267+0000 7f65cbb46740 1 -- 172.21.15.92:0/270057278 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f750ee4d60 con 0x55f750ffd360 2024-09-19T09:06:11.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.267+0000 7f65c2ffd640 1 --2- 172.21.15.92:0/270057278 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f750ffd360 0x55f750fff780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:11.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.267+0000 7f65c2ffd640 1 --2- 172.21.15.92:0/270057278 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f750ffd360 0x55f750fff780 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32e86c8fa6bd877f server_cookie=c0b651980077b41a in_seq=0 out_seq=0 2024-09-19T09:06:11.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.267+0000 7f65aa7fc640 10 client.17652 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:11.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.268+0000 7f65aa7fc640 1 -- 172.21.15.92:0/270057278 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55f750ee4d60 con 0x55f750ffd360 2024-09-19T09:06:11.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.268+0000 7f65aa7fc640 10 client.17652 handle_command_reply: tid=0 2024-09-19T09:06:11.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.268+0000 7f65cbb46740 1 client.17652 shutdown 2024-09-19T09:06:11.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.268+0000 7f65cbb46740 1 -- 172.21.15.92:0/270057278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f750f82680 msgr2=0x55f750f88e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:11.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.268+0000 7f65cbb46740 1 --2- 172.21.15.92:0/270057278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f750f82680 0x55f750f88e00 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f65bc00acd0 tx=0x7f65bc015da0 comp rx=0 tx=0).stop 2024-09-19T09:06:11.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.268+0000 7f65cbb46740 1 -- 172.21.15.92:0/270057278 shutdown_connections 2024-09-19T09:06:11.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.268+0000 7f65cbb46740 1 --2- 172.21.15.92:0/270057278 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f750ffd360 0x55f750fff780 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:11.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.268+0000 7f65cbb46740 1 --2- 172.21.15.92:0/270057278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f750f82680 0x55f750f88e00 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:11.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.268+0000 7f65cbb46740 1 --2- 172.21.15.92:0/270057278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f750f77dc0 0x55f750f888c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:11.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.268+0000 7f65cbb46740 1 --2- 172.21.15.92:0/270057278 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f750f774a0 0x55f750f88380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:11.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.268+0000 7f65cbb46740 1 -- 172.21.15.92:0/270057278 >> 172.21.15.92:0/270057278 conn(0x55f750f73a30 msgr2=0x55f750f80af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:11.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.268+0000 7f65aa7fc640 0 client.17652 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:11.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.268+0000 7f65cbb46740 1 -- 172.21.15.92:0/270057278 shutdown_connections 2024-09-19T09:06:11.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.268+0000 7f65cbb46740 1 -- 172.21.15.92:0/270057278 wait complete. 2024-09-19T09:06:11.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.268+0000 7f65cbb46740 20 client.17652 trim_cache size 0 max 16384 2024-09-19T09:06:11.275 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:06:11.275 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:06:11.275 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": { 2024-09-19T09:06:11.275 INFO:teuthology.orchestra.run.smithi092.stdout: "e71966b3-9323-4848-b66e-e11c2bed6759": { 2024-09-19T09:06:11.275 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-19T09:06:11.276 INFO:teuthology.orchestra.run.smithi092.stdout: "tag": "e71966b3-9323-4848-b66e-e11c2bed6759", 2024-09-19T09:06:11.276 INFO:teuthology.orchestra.run.smithi092.stdout: "options": "recursive,force" 2024-09-19T09:06:11.276 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:06:11.276 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:06:11.276 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:06:11.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.269+0000 7f65c976d640 1 -- 172.21.15.92:0/1301709058 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f65b00a3240 msgr2=0x7f65b00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:11.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.269+0000 7f65c976d640 1 --2- 172.21.15.92:0/1301709058 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f65b00a3240 0x7f65b00a5700 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f65c40fdd50 tx=0x7f65ac005a20 comp rx=0 tx=0).stop 2024-09-19T09:06:11.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.269+0000 7f65c976d640 1 -- 172.21.15.92:0/1301709058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65c4101de0 msgr2=0x7f65c41985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:11.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.269+0000 7f65c976d640 1 --2- 172.21.15.92:0/1301709058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65c4101de0 0x7f65c41985b0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f65b400b4a0 tx=0x7f65b400b960 comp rx=0 tx=0).stop 2024-09-19T09:06:11.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.269+0000 7f65c976d640 1 -- 172.21.15.92:0/1301709058 shutdown_connections 2024-09-19T09:06:11.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.269+0000 7f65c976d640 1 --2- 172.21.15.92:0/1301709058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65c4106f10 0x7f65c419ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:11.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.269+0000 7f65c976d640 1 --2- 172.21.15.92:0/1301709058 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65c4102790 0x7f65c4198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:11.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.269+0000 7f65c976d640 1 --2- 172.21.15.92:0/1301709058 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f65b00a3240 0x7f65b00a5700 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:11.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.269+0000 7f65c976d640 1 --2- 172.21.15.92:0/1301709058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65c4101de0 0x7f65c41985b0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:11.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.269+0000 7f65c976d640 1 -- 172.21.15.92:0/1301709058 >> 172.21.15.92:0/1301709058 conn(0x7f65c40fd8c0 msgr2=0x7f65c40fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:11.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.269+0000 7f65c976d640 1 -- 172.21.15.92:0/1301709058 shutdown_connections 2024-09-19T09:06:11.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:11.269+0000 7f65c976d640 1 -- 172.21.15.92:0/1301709058 wait complete. 2024-09-19T09:06:11.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:11 smithi167 ceph-mon[35359]: scrub queued for path: / 2024-09-19T09:06:11.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:11 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:06:11.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:11 smithi167 ceph-mon[35359]: scrub summary: active paths [/] 2024-09-19T09:06:11.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:11 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:06:11.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:11 smithi167 ceph-mon[35359]: pgmap v621: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 3.3 MiB/s wr, 390 op/s 2024-09-19T09:06:11.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:11 smithi190 ceph-mon[35358]: scrub queued for path: / 2024-09-19T09:06:11.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:11 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:06:11.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:11 smithi190 ceph-mon[35358]: scrub summary: active paths [/] 2024-09-19T09:06:11.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:11 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:06:11.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:11 smithi190 ceph-mon[35358]: pgmap v621: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 3.3 MiB/s wr, 390 op/s 2024-09-19T09:06:11.941 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:11 smithi092 ceph-mon[31407]: scrub queued for path: / 2024-09-19T09:06:11.941 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:11 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:06:11.941 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:11 smithi092 ceph-mon[31407]: scrub summary: active paths [/] 2024-09-19T09:06:11.941 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:11 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:06:11.941 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:11 smithi092 ceph-mon[31407]: pgmap v621: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 3.3 MiB/s wr, 390 op/s 2024-09-19T09:06:11.967 INFO:tasks.cephfs.filesystem:scrub status for tag:e71966b3-9323-4848-b66e-e11c2bed6759 - {'path': '/', 'tag': 'e71966b3-9323-4848-b66e-e11c2bed6759', 'options': 'recursive,force'} 2024-09-19T09:06:12.341 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.338+0000 7f6cc70e4640 1 -- 172.21.15.92:0/808508818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cc01037c0 msgr2=0x7f6cc010a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:12.341 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.338+0000 7f6cc70e4640 1 --2- 172.21.15.92:0/808508818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cc01037c0 0x7f6cc010a050 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009ca0 tx=0x7f6cb802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:06:12.341 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.338+0000 7f6cc70e4640 1 -- 172.21.15.92:0/808508818 shutdown_connections 2024-09-19T09:06:12.341 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.338+0000 7f6cc70e4640 1 --2- 172.21.15.92:0/808508818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cc01037c0 0x7f6cc010a050 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:12.341 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.338+0000 7f6cc70e4640 1 --2- 172.21.15.92:0/808508818 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6cc0102e00 0x7f6cc0103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:12.341 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.338+0000 7f6cc70e4640 1 --2- 172.21.15.92:0/808508818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6cc00ffe30 0x7f6cc0100230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:12.341 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.338+0000 7f6cc70e4640 1 -- 172.21.15.92:0/808508818 >> 172.21.15.92:0/808508818 conn(0x7f6cc00fb970 msgr2=0x7f6cc00fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:12.341 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.338+0000 7f6cc70e4640 1 -- 172.21.15.92:0/808508818 shutdown_connections 2024-09-19T09:06:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.338+0000 7f6cc70e4640 1 -- 172.21.15.92:0/808508818 wait complete. 2024-09-19T09:06:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.339+0000 7f6cc70e4640 1 Processor -- start 2024-09-19T09:06:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.339+0000 7f6cc70e4640 1 -- start start 2024-09-19T09:06:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.339+0000 7f6cc70e4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cc00ffe30 0x7f6cc0197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.339+0000 7f6cc70e4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6cc0102e00 0x7f6cc0198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.339+0000 7f6cc70e4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6cc01037c0 0x7f6cc019f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.339+0000 7f6cc70e4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc010d860 con 0x7f6cc00ffe30 2024-09-19T09:06:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.339+0000 7f6cc70e4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc010d6e0 con 0x7f6cc01037c0 2024-09-19T09:06:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.339+0000 7f6cc70e4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc010d9e0 con 0x7f6cc0102e00 2024-09-19T09:06:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.339+0000 7f6cc4e80640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cc00ffe30 0x7f6cc0197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.339+0000 7f6cc4e80640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cc00ffe30 0x7f6cc0197e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35456/0 (socket says 172.21.15.92:35456) 2024-09-19T09:06:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.339+0000 7f6cc4e80640 1 -- 172.21.15.92:0/3030539317 learned_addr learned my addr 172.21.15.92:0/3030539317 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:12.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.339+0000 7f6cb7fff640 1 --2- 172.21.15.92:0/3030539317 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6cc0102e00 0x7f6cc0198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:12.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.339+0000 7f6cc5681640 1 --2- 172.21.15.92:0/3030539317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6cc01037c0 0x7f6cc019f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:12.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.339+0000 7f6cc4e80640 1 -- 172.21.15.92:0/3030539317 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6cc0102e00 msgr2=0x7f6cc0198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:12.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.339+0000 7f6cc4e80640 1 --2- 172.21.15.92:0/3030539317 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6cc0102e00 0x7f6cc0198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:12.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.339+0000 7f6cc4e80640 1 -- 172.21.15.92:0/3030539317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6cc01037c0 msgr2=0x7f6cc019f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:12.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.339+0000 7f6cc4e80640 1 --2- 172.21.15.92:0/3030539317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6cc01037c0 0x7f6cc019f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:12.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.339+0000 7f6cc4e80640 1 -- 172.21.15.92:0/3030539317 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cc019fa40 con 0x7f6cc00ffe30 2024-09-19T09:06:12.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.339+0000 7f6cb7fff640 1 --2- 172.21.15.92:0/3030539317 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6cc0102e00 0x7f6cc0198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:12.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.339+0000 7f6cc4e80640 1 --2- 172.21.15.92:0/3030539317 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cc00ffe30 0x7f6cc0197e20 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc00d770 tx=0x7f6cbc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:12.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.339+0000 7f6cb5ffb640 1 -- 172.21.15.92:0/3030539317 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc017070 con 0x7f6cc00ffe30 2024-09-19T09:06:12.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.339+0000 7f6cb5ffb640 1 -- 172.21.15.92:0/3030539317 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cbc009c30 con 0x7f6cc00ffe30 2024-09-19T09:06:12.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.339+0000 7f6cc70e4640 1 -- 172.21.15.92:0/3030539317 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cc019fd30 con 0x7f6cc00ffe30 2024-09-19T09:06:12.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.339+0000 7f6cb5ffb640 1 -- 172.21.15.92:0/3030539317 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc003dd0 con 0x7f6cc00ffe30 2024-09-19T09:06:12.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.340+0000 7f6cc70e4640 1 -- 172.21.15.92:0/3030539317 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cc01a0290 con 0x7f6cc00ffe30 2024-09-19T09:06:12.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.342+0000 7f6cb5ffb640 1 -- 172.21.15.92:0/3030539317 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6cbc003fb0 con 0x7f6cc00ffe30 2024-09-19T09:06:12.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.342+0000 7f6cc9e79740 1 Processor -- start 2024-09-19T09:06:12.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.342+0000 7f6cc9e79740 1 -- start start 2024-09-19T09:06:12.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.342+0000 7f6cc9e79740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7db5c49a0 0x55a7db5c4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:12.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.342+0000 7f6cc9e79740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7db5c52e0 0x55a7db5c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:12.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.342+0000 7f6cc9e79740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7db5ca370 0x55a7db5cc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:12.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.342+0000 7f6cc9e79740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a7db5282f0 con 0x55a7db5c49a0 2024-09-19T09:06:12.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.342+0000 7f6cc9e79740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a7db4d0270 con 0x55a7db5c52e0 2024-09-19T09:06:12.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.342+0000 7f6cc9e79740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55a7db5242b0 con 0x55a7db5ca370 2024-09-19T09:06:12.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.343+0000 7f6cc5681640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7db5c49a0 0x55a7db5c4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:12.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.343+0000 7f6cc5681640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7db5c49a0 0x55a7db5c4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35468/0 (socket says 172.21.15.92:35468) 2024-09-19T09:06:12.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.343+0000 7f6cc5681640 1 -- 172.21.15.92:0/2729303835 learned_addr learned my addr 172.21.15.92:0/2729303835 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:12.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.343+0000 7f6cb5ffb640 1 --2- 172.21.15.92:0/3030539317 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6ca80a3370 0x7f6ca80a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:12.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.343+0000 7f6cb7fff640 1 --2- 172.21.15.92:0/2729303835 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7db5ca370 0x55a7db5cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:12.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.343+0000 7f6cc4e80640 1 --2- 172.21.15.92:0/2729303835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7db5c52e0 0x55a7db5c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:12.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.343+0000 7f6cc5681640 1 --2- 172.21.15.92:0/3030539317 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6ca80a3370 0x7f6ca80a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:12.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.343+0000 7f6cb5ffb640 1 -- 172.21.15.92:0/3030539317 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f6cbc0cf330 con 0x7f6cc00ffe30 2024-09-19T09:06:12.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.343+0000 7f6cc5681640 1 -- 172.21.15.92:0/2729303835 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7db5ca370 msgr2=0x55a7db5cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:12.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.343+0000 7f6cc5681640 1 --2- 172.21.15.92:0/2729303835 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7db5ca370 0x55a7db5cc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:12.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.343+0000 7f6cc5681640 1 -- 172.21.15.92:0/2729303835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7db5c52e0 msgr2=0x55a7db5c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:12.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.343+0000 7f6cc5681640 1 --2- 172.21.15.92:0/2729303835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7db5c52e0 0x55a7db5c9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:12.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.343+0000 7f6cc5681640 1 -- 172.21.15.92:0/2729303835 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7db4cf340 con 0x55a7db5c49a0 2024-09-19T09:06:12.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.343+0000 7f6cc4e80640 1 --2- 172.21.15.92:0/2729303835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7db5c52e0 0x55a7db5c9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:12.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.343+0000 7f6cc5681640 1 --2- 172.21.15.92:0/2729303835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7db5c49a0 0x55a7db5c4da0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8005cc0 tx=0x7f6cb8003ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f4118de388c2210 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:12.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.343+0000 7f6ca6ffd640 1 -- 172.21.15.92:0/2729303835 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb80318e0 con 0x55a7db5c49a0 2024-09-19T09:06:12.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.343+0000 7f6ca6ffd640 1 -- 172.21.15.92:0/2729303835 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cb804e070 con 0x55a7db5c49a0 2024-09-19T09:06:12.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.343+0000 7f6ca6ffd640 1 -- 172.21.15.92:0/2729303835 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb802fbd0 con 0x55a7db5c49a0 2024-09-19T09:06:12.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.344+0000 7f6cc9e79740 1 -- 172.21.15.92:0/2729303835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7db5c49a0 msgr2=0x55a7db5c4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:12.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.344+0000 7f6cc9e79740 1 --2- 172.21.15.92:0/2729303835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7db5c49a0 0x55a7db5c4da0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8005cc0 tx=0x7f6cb8003ac0 comp rx=0 tx=0).stop 2024-09-19T09:06:12.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.344+0000 7f6cc5681640 1 --2- 172.21.15.92:0/3030539317 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6ca80a3370 0x7f6ca80a5830 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6cb804d000 tx=0x7f6cb804b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:12.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.344+0000 7f6cc9e79740 1 -- 172.21.15.92:0/2729303835 shutdown_connections 2024-09-19T09:06:12.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.344+0000 7f6cc9e79740 1 --2- 172.21.15.92:0/2729303835 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7db5ca370 0x55a7db5cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:12.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.344+0000 7f6cc9e79740 1 --2- 172.21.15.92:0/2729303835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7db5c52e0 0x55a7db5c9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:12.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.344+0000 7f6cc9e79740 1 --2- 172.21.15.92:0/2729303835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7db5c49a0 0x55a7db5c4da0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:12.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.344+0000 7f6cc9e79740 1 -- 172.21.15.92:0/2729303835 >> 172.21.15.92:0/2729303835 conn(0x55a7db5c0010 msgr2=0x55a7db5c0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:12.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.344+0000 7f6cc9e79740 1 -- 172.21.15.92:0/2729303835 shutdown_connections 2024-09-19T09:06:12.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.344+0000 7f6cc9e79740 1 -- 172.21.15.92:0/2729303835 wait complete. 2024-09-19T09:06:12.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.344+0000 7f6cc9e79740 1 -- start start 2024-09-19T09:06:12.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.344+0000 7f6cc9e79740 1 Processor -- start 2024-09-19T09:06:12.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.345+0000 7f6cc9e79740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7db5c49a0 0x55a7db5cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:12.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.345+0000 7f6cc9e79740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7db5c52e0 0x55a7db5cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:12.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.345+0000 7f6cc9e79740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7db5ca370 0x55a7db5d5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:12.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.345+0000 7f6cc9e79740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a7db5cd1c0 con 0x55a7db5c49a0 2024-09-19T09:06:12.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.345+0000 7f6cc9e79740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a7db4b1290 con 0x55a7db5ca370 2024-09-19T09:06:12.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.345+0000 7f6cc9e79740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55a7db5cd340 con 0x55a7db5c52e0 2024-09-19T09:06:12.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.345+0000 7f6cc9e79740 10 client.0 _ll_register_callbacks cb 0x55a7db4e2140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:12.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.345+0000 7f6cc4e80640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7db5c49a0 0x55a7db5cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:12.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.345+0000 7f6cc4e80640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7db5c49a0 0x55a7db5cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35472/0 (socket says 172.21.15.92:35472) 2024-09-19T09:06:12.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.345+0000 7f6cc4e80640 1 -- 172.21.15.92:0/2366750673 learned_addr learned my addr 172.21.15.92:0/2366750673 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:12.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.345+0000 7f6cb7fff640 1 --2- 172.21.15.92:0/2366750673 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7db5c52e0 0x55a7db5cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:12.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.345+0000 7f6cc4e80640 1 -- 172.21.15.92:0/2366750673 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7db5c52e0 msgr2=0x55a7db5cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:12.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.345+0000 7f6cc4e80640 1 --2- 172.21.15.92:0/2366750673 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7db5c52e0 0x55a7db5cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:12.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.345+0000 7f6cc4e80640 1 -- 172.21.15.92:0/2366750673 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7db5ca370 msgr2=0x55a7db5d5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:12.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.345+0000 7f6cc4e80640 1 --2- 172.21.15.92:0/2366750673 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7db5ca370 0x55a7db5d5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:12.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.345+0000 7f6cc4e80640 1 -- 172.21.15.92:0/2366750673 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7db23b210 con 0x55a7db5c49a0 2024-09-19T09:06:12.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.345+0000 7f6cc4e80640 1 --2- 172.21.15.92:0/2366750673 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7db5c49a0 0x55a7db5cea70 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc097db0 tx=0x7f6cbc020c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b733e6d18420b62b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:12.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.345+0000 7f6c9ffff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:06:12.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.345+0000 7f6c9ffff640 1 -- 172.21.15.92:0/2366750673 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc020040 con 0x55a7db5c49a0 2024-09-19T09:06:12.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.345+0000 7f6c9ffff640 1 -- 172.21.15.92:0/2366750673 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f6cbc0042a0 con 0x55a7db5c49a0 2024-09-19T09:06:12.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.345+0000 7f6cc9e79740 1 -- 172.21.15.92:0/2366750673 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cb804e070 con 0x55a7db5c49a0 2024-09-19T09:06:12.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.346+0000 7f6c9ffff640 1 -- 172.21.15.92:0/2366750673 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6cbc009de0 con 0x55a7db5c49a0 2024-09-19T09:06:12.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.346+0000 7f6cc9e79740 10 client.17664 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:12.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.346+0000 7f6cc9e79740 1 -- 172.21.15.92:0/2366750673 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55a7db307620 con 0x55a7db5c49a0 2024-09-19T09:06:12.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.346+0000 7f6c9ffff640 1 -- 172.21.15.92:0/2366750673 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cb804e070 con 0x55a7db5c49a0 2024-09-19T09:06:12.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.346+0000 7f6c9ffff640 1 -- 172.21.15.92:0/2366750673 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f6cbc0ce070 con 0x55a7db5c49a0 2024-09-19T09:06:12.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.346+0000 7f6cc9e79740 10 client.17664 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:12.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.346+0000 7f6cc9e79740 10 client.17664 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:06:12.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.346+0000 7f6cc9e79740 20 client.17664 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:12.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.346+0000 7f6cc9e79740 1 --2- 172.21.15.92:0/2366750673 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a7db5da710 0x55a7db5dcb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:12.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.346+0000 7f6cc9e79740 4 client.17664 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:06:12.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.346+0000 7f6cc9e79740 1 -- 172.21.15.92:0/2366750673 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7db535a20 con 0x55a7db5da710 2024-09-19T09:06:12.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.346+0000 7f6cb7fff640 1 --2- 172.21.15.92:0/2366750673 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a7db5da710 0x55a7db5dcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:12.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.347+0000 7f6c9ffff640 10 client.17664 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:12.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.347+0000 7f6cb7fff640 1 --2- 172.21.15.92:0/2366750673 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a7db5da710 0x55a7db5dcb60 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a0b7d00e84c0ed8 server_cookie=a238f02b075e2105 in_seq=0 out_seq=0 2024-09-19T09:06:12.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.347+0000 7f6c9ffff640 1 -- 172.21.15.92:0/2366750673 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a7db535a20 con 0x55a7db5da710 2024-09-19T09:06:12.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.347+0000 7f6c9ffff640 10 client.17664 handle_command_reply: tid=0 2024-09-19T09:06:12.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.347+0000 7f6cc9e79740 1 client.17664 shutdown 2024-09-19T09:06:12.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.347+0000 7f6cc9e79740 1 -- 172.21.15.92:0/2366750673 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7db5c49a0 msgr2=0x55a7db5cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:12.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.347+0000 7f6cc9e79740 1 --2- 172.21.15.92:0/2366750673 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7db5c49a0 0x55a7db5cea70 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc097db0 tx=0x7f6cbc020c00 comp rx=0 tx=0).stop 2024-09-19T09:06:12.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.348+0000 7f6cc9e79740 1 -- 172.21.15.92:0/2366750673 shutdown_connections 2024-09-19T09:06:12.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.348+0000 7f6cc9e79740 1 --2- 172.21.15.92:0/2366750673 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a7db5da710 0x55a7db5dcb60 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:12.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.348+0000 7f6cc9e79740 1 --2- 172.21.15.92:0/2366750673 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7db5ca370 0x55a7db5d5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:12.357 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.348+0000 7f6c9ffff640 0 client.17664 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:12.357 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.348+0000 7f6cc9e79740 1 --2- 172.21.15.92:0/2366750673 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7db5c52e0 0x55a7db5cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:12.357 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.348+0000 7f6cc9e79740 1 --2- 172.21.15.92:0/2366750673 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7db5c49a0 0x55a7db5cea70 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:12.357 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.348+0000 7f6cc9e79740 1 -- 172.21.15.92:0/2366750673 >> 172.21.15.92:0/2366750673 conn(0x55a7db5c0010 msgr2=0x55a7db5c1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:12.357 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.348+0000 7f6cc9e79740 1 -- 172.21.15.92:0/2366750673 shutdown_connections 2024-09-19T09:06:12.357 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.348+0000 7f6cc9e79740 1 -- 172.21.15.92:0/2366750673 wait complete. 2024-09-19T09:06:12.357 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.348+0000 7f6cc9e79740 20 client.17664 trim_cache size 0 max 16384 2024-09-19T09:06:12.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.362+0000 7f6cc9e79740 1 Processor -- start 2024-09-19T09:06:12.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.362+0000 7f6cc9e79740 1 -- start start 2024-09-19T09:06:12.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.362+0000 7f6cc9e79740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7db5c49a0 0x55a7db5c0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:12.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.362+0000 7f6cc9e79740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7db5c52e0 0x55a7db5d5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:12.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.362+0000 7f6cc9e79740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7db5ca370 0x55a7db5c1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:12.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.362+0000 7f6cc9e79740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc01a7030 con 0x55a7db5c49a0 2024-09-19T09:06:12.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.362+0000 7f6cc9e79740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc01a98d0 con 0x55a7db5c52e0 2024-09-19T09:06:12.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.362+0000 7f6cc9e79740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc01a76c0 con 0x55a7db5ca370 2024-09-19T09:06:12.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.362+0000 7f6cc4e80640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7db5c49a0 0x55a7db5c0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:12.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.362+0000 7f6cc4e80640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7db5c49a0 0x55a7db5c0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35488/0 (socket says 172.21.15.92:35488) 2024-09-19T09:06:12.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.362+0000 7f6cc4e80640 1 -- 172.21.15.92:0/3255194771 learned_addr learned my addr 172.21.15.92:0/3255194771 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:12.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.362+0000 7f6cb7fff640 1 --2- 172.21.15.92:0/3255194771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7db5c52e0 0x55a7db5d5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:12.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.362+0000 7f6cc4e80640 1 -- 172.21.15.92:0/3255194771 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7db5ca370 msgr2=0x55a7db5c1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:12.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.362+0000 7f6cc4e80640 1 --2- 172.21.15.92:0/3255194771 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7db5ca370 0x55a7db5c1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:12.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.362+0000 7f6cc4e80640 1 -- 172.21.15.92:0/3255194771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7db5c52e0 msgr2=0x55a7db5d5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:12.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.362+0000 7f6cc4e80640 1 --2- 172.21.15.92:0/3255194771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7db5c52e0 0x55a7db5d5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:12.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.362+0000 7f6cc4e80640 1 -- 172.21.15.92:0/3255194771 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7db5cd260 con 0x55a7db5c49a0 2024-09-19T09:06:12.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.362+0000 7f6cc4e80640 1 --2- 172.21.15.92:0/3255194771 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7db5c49a0 0x55a7db5c0ec0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc098320 tx=0x7f6cbc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe3c4fd4da4ce97d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:12.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.362+0000 7f6ca67fc640 1 -- 172.21.15.92:0/3255194771 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc020070 con 0x55a7db5c49a0 2024-09-19T09:06:12.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.362+0000 7f6ca67fc640 1 -- 172.21.15.92:0/3255194771 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cbc09c050 con 0x55a7db5c49a0 2024-09-19T09:06:12.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.362+0000 7f6ca67fc640 1 -- 172.21.15.92:0/3255194771 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc016bb0 con 0x55a7db5c49a0 2024-09-19T09:06:12.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.363+0000 7f6cc9e79740 1 -- 172.21.15.92:0/3255194771 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7db5c49a0 msgr2=0x55a7db5c0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:12.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.363+0000 7f6cc9e79740 1 --2- 172.21.15.92:0/3255194771 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7db5c49a0 0x55a7db5c0ec0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc098320 tx=0x7f6cbc000bc0 comp rx=0 tx=0).stop 2024-09-19T09:06:12.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.363+0000 7f6cc9e79740 1 -- 172.21.15.92:0/3255194771 shutdown_connections 2024-09-19T09:06:12.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.363+0000 7f6cc9e79740 1 --2- 172.21.15.92:0/3255194771 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7db5ca370 0x55a7db5c1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:12.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.363+0000 7f6cc9e79740 1 --2- 172.21.15.92:0/3255194771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7db5c52e0 0x55a7db5d5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:12.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.363+0000 7f6cc9e79740 1 --2- 172.21.15.92:0/3255194771 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7db5c49a0 0x55a7db5c0ec0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:12.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.363+0000 7f6cc9e79740 1 -- 172.21.15.92:0/3255194771 >> 172.21.15.92:0/3255194771 conn(0x55a7db5c0010 msgr2=0x55a7db5ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:12.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.363+0000 7f6cc9e79740 1 -- 172.21.15.92:0/3255194771 shutdown_connections 2024-09-19T09:06:12.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.363+0000 7f6cc9e79740 1 -- 172.21.15.92:0/3255194771 wait complete. 2024-09-19T09:06:12.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.363+0000 7f6cc9e79740 1 -- start start 2024-09-19T09:06:12.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.363+0000 7f6cc9e79740 1 Processor -- start 2024-09-19T09:06:12.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.364+0000 7f6cc9e79740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7db5c49a0 0x55a7db5d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:12.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.364+0000 7f6cc9e79740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7db5c52e0 0x55a7db5d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:12.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.364+0000 7f6cc9e79740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7db5ca370 0x55a7db5d4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:12.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.364+0000 7f6cc9e79740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc01a7d90 con 0x55a7db5ca370 2024-09-19T09:06:12.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.364+0000 7f6cc9e79740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc01a9200 con 0x55a7db5c52e0 2024-09-19T09:06:12.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.364+0000 7f6cc9e79740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc01a8460 con 0x55a7db5c49a0 2024-09-19T09:06:12.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.364+0000 7f6cc9e79740 10 client.0 _ll_register_callbacks cb 0x7f6cbc003770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:12.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.364+0000 7f6cc5681640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7db5ca370 0x55a7db5d4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:12.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.364+0000 7f6cc5681640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7db5ca370 0x55a7db5d4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35492/0 (socket says 172.21.15.92:35492) 2024-09-19T09:06:12.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.364+0000 7f6cc5681640 1 -- 172.21.15.92:0/414441121 learned_addr learned my addr 172.21.15.92:0/414441121 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:12.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.364+0000 7f6cb7fff640 1 --2- 172.21.15.92:0/414441121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7db5c52e0 0x55a7db5d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:12.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.364+0000 7f6cc4e80640 1 --2- 172.21.15.92:0/414441121 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7db5c49a0 0x55a7db5d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:12.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.364+0000 7f6cc5681640 1 -- 172.21.15.92:0/414441121 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7db5c49a0 msgr2=0x55a7db5d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:12.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.364+0000 7f6cc5681640 1 --2- 172.21.15.92:0/414441121 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7db5c49a0 0x55a7db5d36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:12.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.364+0000 7f6cc5681640 1 -- 172.21.15.92:0/414441121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7db5c52e0 msgr2=0x55a7db5d3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:12.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.364+0000 7f6cc5681640 1 --2- 172.21.15.92:0/414441121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7db5c52e0 0x55a7db5d3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:12.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.364+0000 7f6cc5681640 1 -- 172.21.15.92:0/414441121 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7db5d5200 con 0x55a7db5ca370 2024-09-19T09:06:12.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.364+0000 7f6cc5681640 1 --2- 172.21.15.92:0/414441121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7db5ca370 0x55a7db5d4bf0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009ba0 tx=0x7f6cb8005bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=348c0e90dbf1221d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:12.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.364+0000 7f6c9ffff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:06:12.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.365+0000 7f6c9ffff640 1 -- 172.21.15.92:0/414441121 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8059020 con 0x55a7db5ca370 2024-09-19T09:06:12.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.365+0000 7f6c9ffff640 1 -- 172.21.15.92:0/414441121 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f6cb802f7d0 con 0x55a7db5ca370 2024-09-19T09:06:12.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.365+0000 7f6cc9e79740 1 -- 172.21.15.92:0/414441121 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cbc09c050 con 0x55a7db5ca370 2024-09-19T09:06:12.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.365+0000 7f6c9ffff640 1 -- 172.21.15.92:0/414441121 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6cb80098e0 con 0x55a7db5ca370 2024-09-19T09:06:12.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.365+0000 7f6cc9e79740 10 client.17670 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:12.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.365+0000 7f6cc9e79740 1 -- 172.21.15.92:0/414441121 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55a7db645310 con 0x55a7db5ca370 2024-09-19T09:06:12.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.365+0000 7f6c9ffff640 1 -- 172.21.15.92:0/414441121 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cbc09c050 con 0x55a7db5ca370 2024-09-19T09:06:12.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.365+0000 7f6c9ffff640 1 -- 172.21.15.92:0/414441121 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f6cb8030aa0 con 0x55a7db5ca370 2024-09-19T09:06:12.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.365+0000 7f6cc9e79740 10 client.17670 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:12.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.365+0000 7f6cc9e79740 10 client.17670 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:06:12.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.365+0000 7f6cc9e79740 20 client.17670 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:12.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.365+0000 7f6cc9e79740 1 --2- 172.21.15.92:0/414441121 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a7db5da710 0x55a7db647a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:12.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.365+0000 7f6cc9e79740 4 client.17670 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:06:12.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.365+0000 7f6cc9e79740 1 -- 172.21.15.92:0/414441121 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a7db5ca0c0 con 0x55a7db5da710 2024-09-19T09:06:12.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.365+0000 7f6cc4e80640 1 --2- 172.21.15.92:0/414441121 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a7db5da710 0x55a7db647a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:12.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.366+0000 7f6c9ffff640 10 client.17670 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:12.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.366+0000 7f6cc4e80640 1 --2- 172.21.15.92:0/414441121 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a7db5da710 0x55a7db647a20 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77e842888330d832 server_cookie=cfcfa86b5539173a in_seq=0 out_seq=0 2024-09-19T09:06:12.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.380+0000 7f6c9ffff640 1 -- 172.21.15.92:0/414441121 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a7db5ca0c0 con 0x55a7db5da710 2024-09-19T09:06:12.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.380+0000 7f6c9ffff640 10 client.17670 handle_command_reply: tid=0 2024-09-19T09:06:12.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.380+0000 7f6cc9e79740 1 client.17670 shutdown 2024-09-19T09:06:12.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.380+0000 7f6cc9e79740 1 -- 172.21.15.92:0/414441121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7db5ca370 msgr2=0x55a7db5d4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:12.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.380+0000 7f6cc9e79740 1 --2- 172.21.15.92:0/414441121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7db5ca370 0x55a7db5d4bf0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009ba0 tx=0x7f6cb8005bf0 comp rx=0 tx=0).stop 2024-09-19T09:06:12.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.380+0000 7f6cc9e79740 1 -- 172.21.15.92:0/414441121 shutdown_connections 2024-09-19T09:06:12.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.380+0000 7f6cc9e79740 1 --2- 172.21.15.92:0/414441121 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a7db5da710 0x55a7db647a20 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:12.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.380+0000 7f6cc9e79740 1 --2- 172.21.15.92:0/414441121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7db5ca370 0x55a7db5d4bf0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:12.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.380+0000 7f6c9ffff640 0 client.17670 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:12.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.380+0000 7f6cc9e79740 1 --2- 172.21.15.92:0/414441121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7db5c52e0 0x55a7db5d3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:12.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.380+0000 7f6cc9e79740 1 --2- 172.21.15.92:0/414441121 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7db5c49a0 0x55a7db5d36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:12.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.380+0000 7f6cc9e79740 1 -- 172.21.15.92:0/414441121 >> 172.21.15.92:0/414441121 conn(0x55a7db5c0010 msgr2=0x55a7db5be9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:12.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.381+0000 7f6cc9e79740 1 -- 172.21.15.92:0/414441121 shutdown_connections 2024-09-19T09:06:12.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.381+0000 7f6cc9e79740 1 -- 172.21.15.92:0/414441121 wait complete. 2024-09-19T09:06:12.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.381+0000 7f6cc9e79740 20 client.17670 trim_cache size 0 max 16384 2024-09-19T09:06:12.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:06:12.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:06:12.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:06:12.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:06:12.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.381+0000 7f6cc70e4640 1 -- 172.21.15.92:0/3030539317 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6ca80a3370 msgr2=0x7f6ca80a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:12.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.381+0000 7f6cc70e4640 1 --2- 172.21.15.92:0/3030539317 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6ca80a3370 0x7f6ca80a5830 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6cb804d000 tx=0x7f6cb804b000 comp rx=0 tx=0).stop 2024-09-19T09:06:12.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.381+0000 7f6cc70e4640 1 -- 172.21.15.92:0/3030539317 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cc00ffe30 msgr2=0x7f6cc0197e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:12.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.381+0000 7f6cc70e4640 1 --2- 172.21.15.92:0/3030539317 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cc00ffe30 0x7f6cc0197e20 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc00d770 tx=0x7f6cbc00dc30 comp rx=0 tx=0).stop 2024-09-19T09:06:12.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.381+0000 7f6cc70e4640 1 -- 172.21.15.92:0/3030539317 shutdown_connections 2024-09-19T09:06:12.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.381+0000 7f6cc70e4640 1 --2- 172.21.15.92:0/3030539317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6cc01037c0 0x7f6cc019f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:12.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.381+0000 7f6cc70e4640 1 --2- 172.21.15.92:0/3030539317 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6cc0102e00 0x7f6cc0198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:12.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.381+0000 7f6cc70e4640 1 --2- 172.21.15.92:0/3030539317 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6ca80a3370 0x7f6ca80a5830 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:12.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.381+0000 7f6cc70e4640 1 --2- 172.21.15.92:0/3030539317 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cc00ffe30 0x7f6cc0197e20 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:12.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.381+0000 7f6cc70e4640 1 -- 172.21.15.92:0/3030539317 >> 172.21.15.92:0/3030539317 conn(0x7f6cc00fb970 msgr2=0x7f6cc0106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:12.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.381+0000 7f6cc70e4640 1 -- 172.21.15.92:0/3030539317 shutdown_connections 2024-09-19T09:06:12.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:12.381+0000 7f6cc70e4640 1 -- 172.21.15.92:0/3030539317 wait complete. 2024-09-19T09:06:13.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:13 smithi167 ceph-mon[35359]: pgmap v622: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 1.7 MiB/s wr, 303 op/s 2024-09-19T09:06:13.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:13 smithi190 ceph-mon[35358]: pgmap v622: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 1.7 MiB/s wr, 303 op/s 2024-09-19T09:06:14.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:13 smithi092 ceph-mon[31407]: pgmap v622: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 1.7 MiB/s wr, 303 op/s 2024-09-19T09:06:14.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:14 smithi167 ceph-mon[35359]: scrub summary: idle 2024-09-19T09:06:14.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:14 smithi190 ceph-mon[35358]: scrub summary: idle 2024-09-19T09:06:15.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:14 smithi092 ceph-mon[31407]: scrub summary: idle 2024-09-19T09:06:15.798 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:06:15.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:15 smithi167 ceph-mon[35359]: pgmap v623: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 932 KiB/s wr, 285 op/s 2024-09-19T09:06:15.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:15 smithi190 ceph-mon[35358]: pgmap v623: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 932 KiB/s wr, 285 op/s 2024-09-19T09:06:16.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:15 smithi092 ceph-mon[31407]: pgmap v623: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 932 KiB/s wr, 285 op/s 2024-09-19T09:06:17.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:16 smithi092 ceph-mon[31407]: pgmap v624: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 49 KiB/s wr, 138 op/s 2024-09-19T09:06:17.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:16 smithi167 ceph-mon[35359]: pgmap v624: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 49 KiB/s wr, 138 op/s 2024-09-19T09:06:17.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:16 smithi190 ceph-mon[35358]: pgmap v624: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 49 KiB/s wr, 138 op/s 2024-09-19T09:06:19.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:19 smithi167 ceph-mon[35359]: pgmap v625: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 3.9 KiB/s wr, 116 op/s 2024-09-19T09:06:19.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:19 smithi190 ceph-mon[35358]: pgmap v625: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 3.9 KiB/s wr, 116 op/s 2024-09-19T09:06:19.941 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:19 smithi092 ceph-mon[31407]: pgmap v625: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 3.9 KiB/s wr, 116 op/s 2024-09-19T09:06:20.799 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:06:21.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:21 smithi167 ceph-mon[35359]: pgmap v626: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 3.7 KiB/s wr, 95 op/s 2024-09-19T09:06:21.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:21 smithi190 ceph-mon[35358]: pgmap v626: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 3.7 KiB/s wr, 95 op/s 2024-09-19T09:06:22.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:21 smithi092 ceph-mon[31407]: pgmap v626: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 3.7 KiB/s wr, 95 op/s 2024-09-19T09:06:22.779 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:06:23.036 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:06:23.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.499+0000 7f068dce3640 1 -- 172.21.15.92:0/1838731569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0688103780 msgr2=0x7f0688107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:23.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.499+0000 7f068dce3640 1 --2- 172.21.15.92:0/1838731569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0688103780 0x7f0688107bc0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f067c009930 tx=0x7f067c02a420 comp rx=0 tx=0).stop 2024-09-19T09:06:23.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.499+0000 7f068dce3640 1 -- 172.21.15.92:0/1838731569 shutdown_connections 2024-09-19T09:06:23.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.499+0000 7f068dce3640 1 --2- 172.21.15.92:0/1838731569 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0688108300 0x7f068810ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:23.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.499+0000 7f068dce3640 1 --2- 172.21.15.92:0/1838731569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0688103780 0x7f0688107bc0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:23.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.499+0000 7f068dce3640 1 --2- 172.21.15.92:0/1838731569 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0688102dd0 0x7f06881031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:23.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.499+0000 7f068dce3640 1 -- 172.21.15.92:0/1838731569 >> 172.21.15.92:0/1838731569 conn(0x7f06880fc7d0 msgr2=0x7f06880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:23.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.499+0000 7f068dce3640 1 -- 172.21.15.92:0/1838731569 shutdown_connections 2024-09-19T09:06:23.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.499+0000 7f068dce3640 1 -- 172.21.15.92:0/1838731569 wait complete. 2024-09-19T09:06:23.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.500+0000 7f068dce3640 1 Processor -- start 2024-09-19T09:06:23.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.500+0000 7f068dce3640 1 -- start start 2024-09-19T09:06:23.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.500+0000 7f068dce3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0688102dd0 0x7f06881985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:23.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.501+0000 7f068dce3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0688103780 0x7f0688198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:23.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.501+0000 7f068dce3640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0688108300 0x7f068819cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:23.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.501+0000 7f068dce3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0688112070 con 0x7f0688102dd0 2024-09-19T09:06:23.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.501+0000 7f068dce3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0688111ef0 con 0x7f0688103780 2024-09-19T09:06:23.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.501+0000 7f068dce3640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f06881121f0 con 0x7f0688108300 2024-09-19T09:06:23.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.501+0000 7f06877fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0688102dd0 0x7f06881985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:23.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.501+0000 7f06877fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0688102dd0 0x7f06881985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58052/0 (socket says 172.21.15.92:58052) 2024-09-19T09:06:23.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.501+0000 7f06877fe640 1 -- 172.21.15.92:0/146825077 learned_addr learned my addr 172.21.15.92:0/146825077 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:23.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.501+0000 7f0687fff640 1 --2- 172.21.15.92:0/146825077 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0688108300 0x7f068819cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:23.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.501+0000 7f0686ffd640 1 --2- 172.21.15.92:0/146825077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0688103780 0x7f0688198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:23.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.501+0000 7f06877fe640 1 -- 172.21.15.92:0/146825077 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0688108300 msgr2=0x7f068819cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:23.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.501+0000 7f06877fe640 1 --2- 172.21.15.92:0/146825077 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0688108300 0x7f068819cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:23.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.501+0000 7f06877fe640 1 -- 172.21.15.92:0/146825077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0688103780 msgr2=0x7f0688198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:23.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.501+0000 7f06877fe640 1 --2- 172.21.15.92:0/146825077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0688103780 0x7f0688198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:23.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.501+0000 7f06877fe640 1 -- 172.21.15.92:0/146825077 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f068819d5a0 con 0x7f0688102dd0 2024-09-19T09:06:23.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.501+0000 7f0686ffd640 1 --2- 172.21.15.92:0/146825077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0688103780 0x7f0688198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:23.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.501+0000 7f06877fe640 1 --2- 172.21.15.92:0/146825077 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0688102dd0 0x7f06881985f0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f067800e9f0 tx=0x7f067800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:23.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.501+0000 7f0684ff9640 1 -- 172.21.15.92:0/146825077 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067800cd80 con 0x7f0688102dd0 2024-09-19T09:06:23.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.501+0000 7f068dce3640 1 -- 172.21.15.92:0/146825077 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f068819d890 con 0x7f0688102dd0 2024-09-19T09:06:23.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.501+0000 7f0684ff9640 1 -- 172.21.15.92:0/146825077 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0678005500 con 0x7f0688102dd0 2024-09-19T09:06:23.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.501+0000 7f0684ff9640 1 -- 172.21.15.92:0/146825077 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0678010690 con 0x7f0688102dd0 2024-09-19T09:06:23.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.501+0000 7f068dce3640 1 -- 172.21.15.92:0/146825077 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06881a5170 con 0x7f0688102dd0 2024-09-19T09:06:23.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.502+0000 7f068dce3640 1 -- 172.21.15.92:0/146825077 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06881031b0 con 0x7f0688102dd0 2024-09-19T09:06:23.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.504+0000 7f0684ff9640 1 -- 172.21.15.92:0/146825077 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f06780046c0 con 0x7f0688102dd0 2024-09-19T09:06:23.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.504+0000 7f0684ff9640 1 --2- 172.21.15.92:0/146825077 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f06700a3240 0x7f06700a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:23.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.504+0000 7f0686ffd640 1 --2- 172.21.15.92:0/146825077 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f06700a3240 0x7f06700a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:23.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.504+0000 7f0684ff9640 1 -- 172.21.15.92:0/146825077 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f06780cffd0 con 0x7f0688102dd0 2024-09-19T09:06:23.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.505+0000 7f0686ffd640 1 --2- 172.21.15.92:0/146825077 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f06700a3240 0x7f06700a5700 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f067c009900 tx=0x7f067c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:23.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.508+0000 7f0684ff9640 1 -- 172.21.15.92:0/146825077 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0678054210 con 0x7f0688102dd0 2024-09-19T09:06:23.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.712+0000 7f068dce3640 1 -- 172.21.15.92:0/146825077 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0688199950 con 0x7f0688102dd0 2024-09-19T09:06:23.713 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:23 smithi092 ceph-mon[31407]: pgmap v627: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 54 KiB/s wr, 100 op/s 2024-09-19T09:06:23.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.713+0000 7f0684ff9640 1 -- 172.21.15.92:0/146825077 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f067809ccf0 con 0x7f0688102dd0 2024-09-19T09:06:23.714 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:06:23.714 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:06:23.714 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:06:23.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.715+0000 7f068dce3640 1 -- 172.21.15.92:0/146825077 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f06700a3240 msgr2=0x7f06700a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:23.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.715+0000 7f068dce3640 1 --2- 172.21.15.92:0/146825077 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f06700a3240 0x7f06700a5700 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f067c009900 tx=0x7f067c005a20 comp rx=0 tx=0).stop 2024-09-19T09:06:23.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.715+0000 7f068dce3640 1 -- 172.21.15.92:0/146825077 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0688102dd0 msgr2=0x7f06881985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:23.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.715+0000 7f068dce3640 1 --2- 172.21.15.92:0/146825077 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0688102dd0 0x7f06881985f0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f067800e9f0 tx=0x7f067800edf0 comp rx=0 tx=0).stop 2024-09-19T09:06:23.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.715+0000 7f068dce3640 1 -- 172.21.15.92:0/146825077 shutdown_connections 2024-09-19T09:06:23.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.715+0000 7f068dce3640 1 --2- 172.21.15.92:0/146825077 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0688108300 0x7f068819cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:23.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.715+0000 7f068dce3640 1 --2- 172.21.15.92:0/146825077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0688103780 0x7f0688198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:23.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.715+0000 7f068dce3640 1 --2- 172.21.15.92:0/146825077 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f06700a3240 0x7f06700a5700 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:23.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.715+0000 7f068dce3640 1 --2- 172.21.15.92:0/146825077 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0688102dd0 0x7f06881985f0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:23.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.715+0000 7f068dce3640 1 -- 172.21.15.92:0/146825077 >> 172.21.15.92:0/146825077 conn(0x7f06880fc7d0 msgr2=0x7f0688105e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:23.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.715+0000 7f068dce3640 1 -- 172.21.15.92:0/146825077 shutdown_connections 2024-09-19T09:06:23.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:23.715+0000 7f068dce3640 1 -- 172.21.15.92:0/146825077 wait complete. 2024-09-19T09:06:23.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:23 smithi167 ceph-mon[35359]: pgmap v627: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 54 KiB/s wr, 100 op/s 2024-09-19T09:06:23.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:23 smithi190 ceph-mon[35358]: pgmap v627: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 54 KiB/s wr, 100 op/s 2024-09-19T09:06:24.467 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id 209062f4 --release --await' 2024-09-19T09:06:24.468 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id 209062f4 --release --await 2024-09-19T09:06:24.715 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:06:24.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:24 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/146825077' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:06:24.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:24 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/146825077' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:06:24.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:24 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/146825077' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:06:25.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.120+0000 7f250ce87640 1 -- 172.21.15.92:0/947581580 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2508100e20 msgr2=0x7f2508101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:25.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.120+0000 7f250ce87640 1 --2- 172.21.15.92:0/947581580 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2508100e20 0x7f2508101200 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f24f8009900 tx=0x7f24f802a480 comp rx=0 tx=0).stop 2024-09-19T09:06:25.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.120+0000 7f250ce87640 1 -- 172.21.15.92:0/947581580 shutdown_connections 2024-09-19T09:06:25.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.120+0000 7f250ce87640 1 --2- 172.21.15.92:0/947581580 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2508102ef0 0x7f250810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.120+0000 7f250ce87640 1 --2- 172.21.15.92:0/947581580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2508102570 0x7f25081029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.120+0000 7f250ce87640 1 --2- 172.21.15.92:0/947581580 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2508100e20 0x7f2508101200 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.121+0000 7f250ce87640 1 -- 172.21.15.92:0/947581580 >> 172.21.15.92:0/947581580 conn(0x7f25080fc7d0 msgr2=0x7f25080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:25.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.121+0000 7f250ce87640 1 -- 172.21.15.92:0/947581580 shutdown_connections 2024-09-19T09:06:25.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.121+0000 7f250ce87640 1 -- 172.21.15.92:0/947581580 wait complete. 2024-09-19T09:06:25.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.121+0000 7f250ce87640 1 Processor -- start 2024-09-19T09:06:25.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.121+0000 7f250ce87640 1 -- start start 2024-09-19T09:06:25.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.121+0000 7f250ce87640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2508100e20 0x7f2508198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.122+0000 7f250ce87640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2508102570 0x7f2508198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.122+0000 7f250ce87640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2508102ef0 0x7f250819ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.122+0000 7f250ce87640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2508110fa0 con 0x7f2508102ef0 2024-09-19T09:06:25.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.122+0000 7f250ce87640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2508110e20 con 0x7f2508102570 2024-09-19T09:06:25.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.122+0000 7f250ce87640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2508111120 con 0x7f2508100e20 2024-09-19T09:06:25.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.122+0000 7f2506d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2508102ef0 0x7f250819ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:25.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.122+0000 7f2506d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2508102ef0 0x7f250819ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58058/0 (socket says 172.21.15.92:58058) 2024-09-19T09:06:25.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.122+0000 7f2506d9d640 1 -- 172.21.15.92:0/513483668 learned_addr learned my addr 172.21.15.92:0/513483668 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:25.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.122+0000 7f250659c640 1 --2- 172.21.15.92:0/513483668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2508100e20 0x7f2508198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:25.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.122+0000 7f2505d9b640 1 --2- 172.21.15.92:0/513483668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2508102570 0x7f2508198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:25.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.122+0000 7f2506d9d640 1 -- 172.21.15.92:0/513483668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2508100e20 msgr2=0x7f2508198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:25.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.122+0000 7f2506d9d640 1 --2- 172.21.15.92:0/513483668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2508100e20 0x7f2508198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.122+0000 7f2506d9d640 1 -- 172.21.15.92:0/513483668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2508102570 msgr2=0x7f2508198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:25.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.122+0000 7f2506d9d640 1 --2- 172.21.15.92:0/513483668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2508102570 0x7f2508198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.122+0000 7f2506d9d640 1 -- 172.21.15.92:0/513483668 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f250819d510 con 0x7f2508102ef0 2024-09-19T09:06:25.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.122+0000 7f2506d9d640 1 --2- 172.21.15.92:0/513483668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2508102ef0 0x7f250819ce30 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f250000b970 tx=0x7f250000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:25.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.122+0000 7f24f77fe640 1 -- 172.21.15.92:0/513483668 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2500019070 con 0x7f2508102ef0 2024-09-19T09:06:25.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.122+0000 7f250ce87640 1 -- 172.21.15.92:0/513483668 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f250819d800 con 0x7f2508102ef0 2024-09-19T09:06:25.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.122+0000 7f24f77fe640 1 -- 172.21.15.92:0/513483668 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2500014440 con 0x7f2508102ef0 2024-09-19T09:06:25.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.122+0000 7f24f77fe640 1 -- 172.21.15.92:0/513483668 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25000075d0 con 0x7f2508102ef0 2024-09-19T09:06:25.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.122+0000 7f250ce87640 1 -- 172.21.15.92:0/513483668 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25081a50e0 con 0x7f2508102ef0 2024-09-19T09:06:25.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.125+0000 7f24f77fe640 1 -- 172.21.15.92:0/513483668 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f250001c070 con 0x7f2508102ef0 2024-09-19T09:06:25.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.125+0000 7f250f260740 1 Processor -- start 2024-09-19T09:06:25.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.125+0000 7f250f260740 1 -- start start 2024-09-19T09:06:25.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.125+0000 7f250f260740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56489873d060 0x56489873d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.125+0000 7f250f260740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56489873d980 0x564898747d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.125+0000 7f250f260740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564898748240 0x56489874a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.125+0000 7f250f260740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5648986a2620 con 0x564898748240 2024-09-19T09:06:25.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.125+0000 7f250f260740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564898649e50 con 0x56489873d060 2024-09-19T09:06:25.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.125+0000 7f250f260740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56489869e5e0 con 0x56489873d980 2024-09-19T09:06:25.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.125+0000 7f2505d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564898748240 0x56489874a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:25.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.126+0000 7f2505d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564898748240 0x56489874a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58060/0 (socket says 172.21.15.92:58060) 2024-09-19T09:06:25.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.126+0000 7f2505d9b640 1 -- 172.21.15.92:0/3020100975 learned_addr learned my addr 172.21.15.92:0/3020100975 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:25.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.126+0000 7f24f77fe640 1 --2- 172.21.15.92:0/513483668 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f24f00a3240 0x7f24f00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.126+0000 7f2505d9b640 1 --2- 172.21.15.92:0/3020100975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56489873d060 0x56489873d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:25.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.126+0000 7f250659c640 1 --2- 172.21.15.92:0/3020100975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56489873d980 0x564898747d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:25.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.126+0000 7f2506d9d640 1 --2- 172.21.15.92:0/513483668 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f24f00a3240 0x7f24f00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:25.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.126+0000 7f2505d9b640 1 -- 172.21.15.92:0/3020100975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56489873d980 msgr2=0x564898747d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:25.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.126+0000 7f2505d9b640 1 --2- 172.21.15.92:0/3020100975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56489873d980 0x564898747d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.126+0000 7f2505d9b640 1 -- 172.21.15.92:0/3020100975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56489873d060 msgr2=0x56489873d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:25.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.126+0000 7f2505d9b640 1 --2- 172.21.15.92:0/3020100975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56489873d060 0x56489873d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.126+0000 7f2505d9b640 1 -- 172.21.15.92:0/3020100975 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56489863ad40 con 0x564898748240 2024-09-19T09:06:25.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.126+0000 7f24f77fe640 1 -- 172.21.15.92:0/513483668 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f25000cee60 con 0x7f2508102ef0 2024-09-19T09:06:25.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.126+0000 7f2505d9b640 1 --2- 172.21.15.92:0/3020100975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564898748240 0x56489874a630 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f24fc0117e0 tx=0x7f24fc00a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ad62ac859cd54a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:25.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.126+0000 7f24f4ff9640 1 -- 172.21.15.92:0/3020100975 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24fc011e20 con 0x564898748240 2024-09-19T09:06:25.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.126+0000 7f24f4ff9640 1 -- 172.21.15.92:0/3020100975 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24fc005020 con 0x564898748240 2024-09-19T09:06:25.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.126+0000 7f2506d9d640 1 --2- 172.21.15.92:0/513483668 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f24f00a3240 0x7f24f00a5700 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2500095fd0 tx=0x7f250006e3b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:25.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.126+0000 7f24f4ff9640 1 -- 172.21.15.92:0/3020100975 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24fc004b20 con 0x564898748240 2024-09-19T09:06:25.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.127+0000 7f250f260740 1 -- 172.21.15.92:0/3020100975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564898748240 msgr2=0x56489874a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:25.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.127+0000 7f250f260740 1 --2- 172.21.15.92:0/3020100975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564898748240 0x56489874a630 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f24fc0117e0 tx=0x7f24fc00a760 comp rx=0 tx=0).stop 2024-09-19T09:06:25.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.127+0000 7f250f260740 1 -- 172.21.15.92:0/3020100975 shutdown_connections 2024-09-19T09:06:25.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.127+0000 7f250f260740 1 --2- 172.21.15.92:0/3020100975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564898748240 0x56489874a630 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.127+0000 7f250f260740 1 --2- 172.21.15.92:0/3020100975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56489873d980 0x564898747d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.127+0000 7f250f260740 1 --2- 172.21.15.92:0/3020100975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56489873d060 0x56489873d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.127+0000 7f250f260740 1 -- 172.21.15.92:0/3020100975 >> 172.21.15.92:0/3020100975 conn(0x5648987395f0 msgr2=0x5648987399d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:25.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.127+0000 7f250f260740 1 -- 172.21.15.92:0/3020100975 shutdown_connections 2024-09-19T09:06:25.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.127+0000 7f250f260740 1 -- 172.21.15.92:0/3020100975 wait complete. 2024-09-19T09:06:25.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.127+0000 7f250f260740 1 -- start start 2024-09-19T09:06:25.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.128+0000 7f250f260740 1 Processor -- start 2024-09-19T09:06:25.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.128+0000 7f250f260740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56489873d060 0x564898745180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.128+0000 7f250f260740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56489873d980 0x5648987456c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.128+0000 7f250f260740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564898748240 0x564898745c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.128+0000 7f250f260740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56489874ae10 con 0x56489873d060 2024-09-19T09:06:25.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.128+0000 7f250f260740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56489862af10 con 0x564898748240 2024-09-19T09:06:25.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.128+0000 7f250f260740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56489874af90 con 0x56489873d980 2024-09-19T09:06:25.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.128+0000 7f250f260740 10 client.0 _ll_register_callbacks cb 0x56489864edb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:25.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.128+0000 7f2505d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56489873d060 0x564898745180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:25.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.128+0000 7f2505d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56489873d060 0x564898745180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58076/0 (socket says 172.21.15.92:58076) 2024-09-19T09:06:25.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.128+0000 7f2505d9b640 1 -- 172.21.15.92:0/3694435893 learned_addr learned my addr 172.21.15.92:0/3694435893 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:25.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.128+0000 7f250659c640 1 --2- 172.21.15.92:0/3694435893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56489873d980 0x5648987456c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:25.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.128+0000 7f2505d9b640 1 -- 172.21.15.92:0/3694435893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56489873d980 msgr2=0x5648987456c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:25.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.128+0000 7f2505d9b640 1 --2- 172.21.15.92:0/3694435893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56489873d980 0x5648987456c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.128+0000 7f2505d9b640 1 -- 172.21.15.92:0/3694435893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564898748240 msgr2=0x564898745c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:25.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.128+0000 7f2505d9b640 1 --2- 172.21.15.92:0/3694435893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564898748240 0x564898745c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.128+0000 7f2505d9b640 1 -- 172.21.15.92:0/3694435893 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648983b1580 con 0x56489873d060 2024-09-19T09:06:25.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.128+0000 7f2505d9b640 1 --2- 172.21.15.92:0/3694435893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56489873d060 0x564898745180 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f24fc00f790 tx=0x7f24fc00fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a56e04811e416ab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:25.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.128+0000 7f24edffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:06:25.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.129+0000 7f24edffb640 1 -- 172.21.15.92:0/3694435893 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24fc004aa0 con 0x56489873d060 2024-09-19T09:06:25.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.129+0000 7f24edffb640 1 -- 172.21.15.92:0/3694435893 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f24fc004c40 con 0x56489873d060 2024-09-19T09:06:25.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.129+0000 7f250f260740 1 -- 172.21.15.92:0/3694435893 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24fc005020 con 0x56489873d060 2024-09-19T09:06:25.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.129+0000 7f24edffb640 1 -- 172.21.15.92:0/3694435893 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f24fc004e40 con 0x56489873d060 2024-09-19T09:06:25.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.129+0000 7f250f260740 10 client.17688 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:25.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.129+0000 7f250f260740 1 -- 172.21.15.92:0/3694435893 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56489847b960 con 0x56489873d060 2024-09-19T09:06:25.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.129+0000 7f24edffb640 1 -- 172.21.15.92:0/3694435893 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24fc005020 con 0x56489873d060 2024-09-19T09:06:25.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.129+0000 7f24edffb640 1 -- 172.21.15.92:0/3694435893 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f24fc027430 con 0x56489873d060 2024-09-19T09:06:25.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.129+0000 7f250f260740 10 client.17688 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:25.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.129+0000 7f250f260740 10 client.17688 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:06:25.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.129+0000 7f250f260740 20 client.17688 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:25.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.129+0000 7f250f260740 1 --2- 172.21.15.92:0/3694435893 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564898757c90 0x56489875a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.129+0000 7f250f260740 4 client.17688 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:06:25.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.129+0000 7f250f260740 1 -- 172.21.15.92:0/3694435893 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648986afb90 con 0x564898757c90 2024-09-19T09:06:25.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.130+0000 7f250659c640 1 --2- 172.21.15.92:0/3694435893 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564898757c90 0x56489875a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:25.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.130+0000 7f24edffb640 10 client.17688 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:25.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.130+0000 7f250659c640 1 --2- 172.21.15.92:0/3694435893 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564898757c90 0x56489875a080 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85a1e746fa288424 server_cookie=a1a2cf2f0917a393 in_seq=0 out_seq=0 2024-09-19T09:06:25.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.131+0000 7f24edffb640 1 -- 172.21.15.92:0/3694435893 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5648986afb90 con 0x564898757c90 2024-09-19T09:06:25.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.131+0000 7f24edffb640 10 client.17688 handle_command_reply: tid=0 2024-09-19T09:06:25.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.131+0000 7f250f260740 1 client.17688 shutdown 2024-09-19T09:06:25.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.131+0000 7f250f260740 1 -- 172.21.15.92:0/3694435893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56489873d060 msgr2=0x564898745180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:25.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.131+0000 7f250f260740 1 --2- 172.21.15.92:0/3694435893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56489873d060 0x564898745180 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f24fc00f790 tx=0x7f24fc00fc00 comp rx=0 tx=0).stop 2024-09-19T09:06:25.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.131+0000 7f250f260740 1 -- 172.21.15.92:0/3694435893 shutdown_connections 2024-09-19T09:06:25.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.131+0000 7f250f260740 1 --2- 172.21.15.92:0/3694435893 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564898757c90 0x56489875a080 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.131+0000 7f250f260740 1 --2- 172.21.15.92:0/3694435893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564898748240 0x564898745c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.131+0000 7f250f260740 1 --2- 172.21.15.92:0/3694435893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56489873d980 0x5648987456c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.131+0000 7f250f260740 1 --2- 172.21.15.92:0/3694435893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56489873d060 0x564898745180 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.131+0000 7f250f260740 1 -- 172.21.15.92:0/3694435893 >> 172.21.15.92:0/3694435893 conn(0x5648987395f0 msgr2=0x56489873f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:25.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.131+0000 7f24edffb640 0 client.17688 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:25.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.131+0000 7f250f260740 1 -- 172.21.15.92:0/3694435893 shutdown_connections 2024-09-19T09:06:25.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.131+0000 7f250f260740 1 -- 172.21.15.92:0/3694435893 wait complete. 2024-09-19T09:06:25.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.131+0000 7f250f260740 20 client.17688 trim_cache size 0 max 16384 2024-09-19T09:06:25.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.147+0000 7f250f260740 1 Processor -- start 2024-09-19T09:06:25.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.148+0000 7f250f260740 1 -- start start 2024-09-19T09:06:25.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.148+0000 7f250f260740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56489873d060 0x56489873f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.148+0000 7f250f260740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56489873d980 0x56489875f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.148+0000 7f250f260740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564898748240 0x56489875fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.148+0000 7f250f260740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f25081ab640 con 0x564898748240 2024-09-19T09:06:25.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.148+0000 7f250f260740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f25081adee0 con 0x56489873d060 2024-09-19T09:06:25.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.148+0000 7f250f260740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f25081abcd0 con 0x56489873d980 2024-09-19T09:06:25.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.148+0000 7f2505d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564898748240 0x56489875fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:25.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.148+0000 7f2505d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564898748240 0x56489875fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58088/0 (socket says 172.21.15.92:58088) 2024-09-19T09:06:25.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.148+0000 7f2505d9b640 1 -- 172.21.15.92:0/1986595183 learned_addr learned my addr 172.21.15.92:0/1986595183 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:25.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.148+0000 7f250659c640 1 --2- 172.21.15.92:0/1986595183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56489873d980 0x56489875f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:25.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.148+0000 7f2505d9b640 1 -- 172.21.15.92:0/1986595183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56489873d980 msgr2=0x56489875f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:25.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.148+0000 7f2505d9b640 1 --2- 172.21.15.92:0/1986595183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56489873d980 0x56489875f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.148+0000 7f2505d9b640 1 -- 172.21.15.92:0/1986595183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56489873d060 msgr2=0x56489873f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:25.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.148+0000 7f2505d9b640 1 --2- 172.21.15.92:0/1986595183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56489873d060 0x56489873f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.148+0000 7f2505d9b640 1 -- 172.21.15.92:0/1986595183 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564898739090 con 0x564898748240 2024-09-19T09:06:25.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.148+0000 7f2505d9b640 1 --2- 172.21.15.92:0/1986595183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564898748240 0x56489875fc80 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f24fc005ef0 tx=0x7f24fc0116e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=346fcaeadd27a204 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:25.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.148+0000 7f24effff640 1 -- 172.21.15.92:0/1986595183 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24fc00fe80 con 0x564898748240 2024-09-19T09:06:25.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.149+0000 7f24effff640 1 -- 172.21.15.92:0/1986595183 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24fc027e50 con 0x564898748240 2024-09-19T09:06:25.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.149+0000 7f24effff640 1 -- 172.21.15.92:0/1986595183 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24fc027430 con 0x564898748240 2024-09-19T09:06:25.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.149+0000 7f250f260740 1 -- 172.21.15.92:0/1986595183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564898748240 msgr2=0x56489875fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:25.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.149+0000 7f250f260740 1 --2- 172.21.15.92:0/1986595183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564898748240 0x56489875fc80 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f24fc005ef0 tx=0x7f24fc0116e0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.149+0000 7f250f260740 1 -- 172.21.15.92:0/1986595183 shutdown_connections 2024-09-19T09:06:25.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.149+0000 7f250f260740 1 --2- 172.21.15.92:0/1986595183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564898748240 0x56489875fc80 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.149+0000 7f250f260740 1 --2- 172.21.15.92:0/1986595183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56489873d980 0x56489875f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.149+0000 7f250f260740 1 --2- 172.21.15.92:0/1986595183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56489873d060 0x56489873f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.149+0000 7f250f260740 1 -- 172.21.15.92:0/1986595183 >> 172.21.15.92:0/1986595183 conn(0x5648987395f0 msgr2=0x56489873eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:25.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.149+0000 7f250f260740 1 -- 172.21.15.92:0/1986595183 shutdown_connections 2024-09-19T09:06:25.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.149+0000 7f250f260740 1 -- 172.21.15.92:0/1986595183 wait complete. 2024-09-19T09:06:25.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.150+0000 7f250f260740 1 -- start start 2024-09-19T09:06:25.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.150+0000 7f250f260740 1 Processor -- start 2024-09-19T09:06:25.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.150+0000 7f250f260740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56489873d060 0x56489874b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.150+0000 7f250f260740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56489873d980 0x56489874be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.150+0000 7f250f260740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564898748240 0x56489874ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.150+0000 7f250f260740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f25081ac3a0 con 0x56489873d980 2024-09-19T09:06:25.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.150+0000 7f250f260740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f25081ad810 con 0x564898748240 2024-09-19T09:06:25.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.150+0000 7f250f260740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f25081aca70 con 0x56489873d060 2024-09-19T09:06:25.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.150+0000 7f250f260740 10 client.0 _ll_register_callbacks cb 0x7f24fc00a2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:25.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.150+0000 7f250659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56489873d980 0x56489874be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:25.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.150+0000 7f250659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56489873d980 0x56489874be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58094/0 (socket says 172.21.15.92:58094) 2024-09-19T09:06:25.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.150+0000 7f250659c640 1 -- 172.21.15.92:0/1692612400 learned_addr learned my addr 172.21.15.92:0/1692612400 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:25.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.150+0000 7f2505d9b640 1 --2- 172.21.15.92:0/1692612400 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56489873d060 0x56489874b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:25.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.150+0000 7f250659c640 1 -- 172.21.15.92:0/1692612400 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56489873d060 msgr2=0x56489874b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:25.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.150+0000 7f250659c640 1 --2- 172.21.15.92:0/1692612400 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56489873d060 0x56489874b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.150+0000 7f250659c640 1 -- 172.21.15.92:0/1692612400 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564898748240 msgr2=0x56489874ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:25.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.150+0000 7f250659c640 1 --2- 172.21.15.92:0/1692612400 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564898748240 0x56489874ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.150+0000 7f250659c640 1 -- 172.21.15.92:0/1692612400 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648987505f0 con 0x56489873d980 2024-09-19T09:06:25.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.150+0000 7f2505d9b640 1 --2- 172.21.15.92:0/1692612400 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56489873d060 0x56489874b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:25.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.151+0000 7f250659c640 1 --2- 172.21.15.92:0/1692612400 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56489873d980 0x56489874be40 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f24f802a9a0 tx=0x7f24f8004550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f473b5c45f79e52f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:25.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.151+0000 7f24edffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:06:25.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.151+0000 7f24edffb640 1 -- 172.21.15.92:0/1692612400 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f8049030 con 0x56489873d980 2024-09-19T09:06:25.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.151+0000 7f24edffb640 1 -- 172.21.15.92:0/1692612400 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f24f8005020 con 0x56489873d980 2024-09-19T09:06:25.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.151+0000 7f250f260740 1 -- 172.21.15.92:0/1692612400 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24fc027e50 con 0x56489873d980 2024-09-19T09:06:25.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.151+0000 7f24edffb640 1 -- 172.21.15.92:0/1692612400 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f24f8035040 con 0x56489873d980 2024-09-19T09:06:25.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.151+0000 7f250f260740 10 client.17694 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:25.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.151+0000 7f250f260740 1 -- 172.21.15.92:0/1692612400 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5648987c2290 con 0x56489873d980 2024-09-19T09:06:25.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.151+0000 7f24edffb640 1 -- 172.21.15.92:0/1692612400 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24fc027e50 con 0x56489873d980 2024-09-19T09:06:25.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.151+0000 7f24edffb640 1 -- 172.21.15.92:0/1692612400 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f24f80047a0 con 0x56489873d980 2024-09-19T09:06:25.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.151+0000 7f250f260740 10 client.17694 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:25.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.151+0000 7f250f260740 10 client.17694 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:06:25.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.151+0000 7f250f260740 20 client.17694 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:25.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.151+0000 7f250f260740 1 --2- 172.21.15.92:0/1692612400 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5648987c2a40 0x5648987c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.151+0000 7f250f260740 4 client.17694 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "209062f4", "release": true, "await": true}] 2024-09-19T09:06:25.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.151+0000 7f250f260740 1 -- 172.21.15.92:0/1692612400 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "quiesce db", "set_id": "209062f4", "release": true, "await": true}) -- 0x5648986aa0a0 con 0x5648987c2a40 2024-09-19T09:06:25.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.151+0000 7f2505d9b640 1 --2- 172.21.15.92:0/1692612400 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5648987c2a40 0x5648987c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:25.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.152+0000 7f2505d9b640 1 --2- 172.21.15.92:0/1692612400 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5648987c2a40 0x5648987c4e60 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=456ca8de2bd3b7fb server_cookie=1dcef2aa83ffc503 in_seq=0 out_seq=0 2024-09-19T09:06:25.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.152+0000 7f24edffb640 10 client.17694 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:25.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.227+0000 7f24edffb640 1 -- 172.21.15.92:0/1692612400 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5648986aa0a0 con 0x5648987c2a40 2024-09-19T09:06:25.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.227+0000 7f24edffb640 10 client.17694 handle_command_reply: tid=0 2024-09-19T09:06:25.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.227+0000 7f250f260740 1 client.17694 shutdown 2024-09-19T09:06:25.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.227+0000 7f250f260740 1 -- 172.21.15.92:0/1692612400 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56489873d980 msgr2=0x56489874be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:25.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.227+0000 7f250f260740 1 --2- 172.21.15.92:0/1692612400 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56489873d980 0x56489874be40 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f24f802a9a0 tx=0x7f24f8004550 comp rx=0 tx=0).stop 2024-09-19T09:06:25.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.227+0000 7f250f260740 1 -- 172.21.15.92:0/1692612400 shutdown_connections 2024-09-19T09:06:25.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.227+0000 7f250f260740 1 --2- 172.21.15.92:0/1692612400 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5648987c2a40 0x5648987c4e60 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.227+0000 7f24edffb640 0 client.17694 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:25.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.227+0000 7f250f260740 1 --2- 172.21.15.92:0/1692612400 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564898748240 0x56489874ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.227+0000 7f250f260740 1 --2- 172.21.15.92:0/1692612400 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56489873d980 0x56489874be40 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.227+0000 7f250f260740 1 --2- 172.21.15.92:0/1692612400 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56489873d060 0x56489874b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.227+0000 7f250f260740 1 -- 172.21.15.92:0/1692612400 >> 172.21.15.92:0/1692612400 conn(0x5648987395f0 msgr2=0x564898738750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:25.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.227+0000 7f250f260740 1 -- 172.21.15.92:0/1692612400 shutdown_connections 2024-09-19T09:06:25.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.227+0000 7f250f260740 1 -- 172.21.15.92:0/1692612400 wait complete. 2024-09-19T09:06:25.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.228+0000 7f250f260740 20 client.17694 trim_cache size 0 max 16384 2024-09-19T09:06:25.230 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:06:25.230 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 19, 2024-09-19T09:06:25.230 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24472, 2024-09-19T09:06:25.230 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 36, 2024-09-19T09:06:25.230 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-09-19T09:06:25.231 INFO:teuthology.orchestra.run.smithi092.stdout: "209062f4": { 2024-09-19T09:06:25.231 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 36, 2024-09-19T09:06:25.231 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-09-19T09:06:25.231 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:06:25.231 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-09-19T09:06:25.231 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:06:25.231 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:06:25.231 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 90.0, 2024-09-19T09:06:25.231 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 150.0, 2024-09-19T09:06:25.231 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-09-19T09:06:25.231 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-09-19T09:06:25.231 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-09-19T09:06:25.232 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:06:25.232 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-09-19T09:06:25.232 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:06:25.232 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:06:25.232 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:06:25.232 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:06:25.232 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:06:25.232 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:06:25.232 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:06:25.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.229+0000 7f250ce87640 1 -- 172.21.15.92:0/513483668 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f24f00a3240 msgr2=0x7f24f00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:25.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.230+0000 7f250ce87640 1 --2- 172.21.15.92:0/513483668 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f24f00a3240 0x7f24f00a5700 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2500095fd0 tx=0x7f250006e3b0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.230+0000 7f250ce87640 1 -- 172.21.15.92:0/513483668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2508102ef0 msgr2=0x7f250819ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:25.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.230+0000 7f250ce87640 1 --2- 172.21.15.92:0/513483668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2508102ef0 0x7f250819ce30 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f250000b970 tx=0x7f250000bd70 comp rx=0 tx=0).stop 2024-09-19T09:06:25.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.233+0000 7f250ce87640 1 -- 172.21.15.92:0/513483668 shutdown_connections 2024-09-19T09:06:25.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.233+0000 7f250ce87640 1 --2- 172.21.15.92:0/513483668 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f24f00a3240 0x7f24f00a5700 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.233+0000 7f250ce87640 1 --2- 172.21.15.92:0/513483668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2508102ef0 0x7f250819ce30 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.233+0000 7f250ce87640 1 --2- 172.21.15.92:0/513483668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2508102570 0x7f2508198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.233+0000 7f250ce87640 1 --2- 172.21.15.92:0/513483668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2508100e20 0x7f2508198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.233+0000 7f250ce87640 1 -- 172.21.15.92:0/513483668 >> 172.21.15.92:0/513483668 conn(0x7f25080fc7d0 msgr2=0x7f250806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:25.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.237+0000 7f250ce87640 1 -- 172.21.15.92:0/513483668 shutdown_connections 2024-09-19T09:06:25.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:25.237+0000 7f250ce87640 1 -- 172.21.15.92:0/513483668 wait complete. 2024-09-19T09:06:25.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.501+0000 7fa118ee6640 1 -- 172.21.15.92:0/915981299 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa114108470 msgr2=0x7fa114108870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:25.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.501+0000 7fa118ee6640 1 --2- 172.21.15.92:0/915981299 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa114108470 0x7fa114108870 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fa10c009ca0 tx=0x7fa10c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.501+0000 7fa118ee6640 1 -- 172.21.15.92:0/915981299 shutdown_connections 2024-09-19T09:06:25.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.501+0000 7fa118ee6640 1 --2- 172.21.15.92:0/915981299 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa114109d40 0x7fa1141105d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.501+0000 7fa118ee6640 1 --2- 172.21.15.92:0/915981299 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa114109380 0x7fa114109800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.501+0000 7fa118ee6640 1 --2- 172.21.15.92:0/915981299 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa114108470 0x7fa114108870 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.501+0000 7fa118ee6640 1 -- 172.21.15.92:0/915981299 >> 172.21.15.92:0/915981299 conn(0x7fa114077490 msgr2=0x7fa1140798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:25.503 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.501+0000 7fa118ee6640 1 -- 172.21.15.92:0/915981299 shutdown_connections 2024-09-19T09:06:25.503 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.501+0000 7fa118ee6640 1 -- 172.21.15.92:0/915981299 wait complete. 2024-09-19T09:06:25.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.502+0000 7fa118ee6640 1 Processor -- start 2024-09-19T09:06:25.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.502+0000 7fa118ee6640 1 -- start start 2024-09-19T09:06:25.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.502+0000 7fa118ee6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa114108470 0x7fa11419e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.503+0000 7fa118ee6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa114109380 0x7fa11419e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.503+0000 7fa118ee6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa114109d40 0x7fa1141a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.503+0000 7fa118ee6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa114113e30 con 0x7fa114109380 2024-09-19T09:06:25.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.503+0000 7fa118ee6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa114113cb0 con 0x7fa114109d40 2024-09-19T09:06:25.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.503+0000 7fa118ee6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa114113fb0 con 0x7fa114108470 2024-09-19T09:06:25.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.503+0000 7fa111d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa114109380 0x7fa11419e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:25.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.503+0000 7fa111d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa114109380 0x7fa11419e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58120/0 (socket says 172.21.15.92:58120) 2024-09-19T09:06:25.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.503+0000 7fa11259c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa114108470 0x7fa11419e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:25.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.503+0000 7fa111d9b640 1 -- 172.21.15.92:0/475539287 learned_addr learned my addr 172.21.15.92:0/475539287 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:25.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.503+0000 7fa112d9d640 1 --2- 172.21.15.92:0/475539287 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa114109d40 0x7fa1141a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:25.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.503+0000 7fa112d9d640 1 -- 172.21.15.92:0/475539287 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa114108470 msgr2=0x7fa11419e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:25.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.503+0000 7fa112d9d640 1 --2- 172.21.15.92:0/475539287 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa114108470 0x7fa11419e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.503+0000 7fa112d9d640 1 -- 172.21.15.92:0/475539287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa114109380 msgr2=0x7fa11419e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:25.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.503+0000 7fa112d9d640 1 --2- 172.21.15.92:0/475539287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa114109380 0x7fa11419e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.503+0000 7fa112d9d640 1 -- 172.21.15.92:0/475539287 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1141a6010 con 0x7fa114109d40 2024-09-19T09:06:25.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.503+0000 7fa111d9b640 1 --2- 172.21.15.92:0/475539287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa114109380 0x7fa11419e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:06:25.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.504+0000 7fa112d9d640 1 --2- 172.21.15.92:0/475539287 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa114109d40 0x7fa1141a59a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa10800e970 tx=0x7fa10800ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:25.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.504+0000 7fa1037fe640 1 -- 172.21.15.92:0/475539287 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10800ccc0 con 0x7fa114109d40 2024-09-19T09:06:25.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.504+0000 7fa1037fe640 1 -- 172.21.15.92:0/475539287 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa108005020 con 0x7fa114109d40 2024-09-19T09:06:25.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.504+0000 7fa118ee6640 1 -- 172.21.15.92:0/475539287 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1141a6300 con 0x7fa114109d40 2024-09-19T09:06:25.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.504+0000 7fa118ee6640 1 -- 172.21.15.92:0/475539287 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1141a6850 con 0x7fa114109d40 2024-09-19T09:06:25.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.504+0000 7fa1037fe640 1 -- 172.21.15.92:0/475539287 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa108004a00 con 0x7fa114109d40 2024-09-19T09:06:25.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.508+0000 7fa11bc80740 1 Processor -- start 2024-09-19T09:06:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.508+0000 7fa1037fe640 1 -- 172.21.15.92:0/475539287 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa108004ba0 con 0x7fa114109d40 2024-09-19T09:06:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.508+0000 7fa11bc80740 1 -- start start 2024-09-19T09:06:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.509+0000 7fa11bc80740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55922a0029a0 0x55922a002da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.509+0000 7fa11bc80740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55922a0032e0 0x55922a007da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.509+0000 7fa11bc80740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55922a008370 0x55922a00a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.509+0000 7fa11bc80740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559229f662f0 con 0x55922a008370 2024-09-19T09:06:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.509+0000 7fa11bc80740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559229f0e270 con 0x55922a0032e0 2024-09-19T09:06:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.509+0000 7fa11bc80740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x559229f622b0 con 0x55922a0029a0 2024-09-19T09:06:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.509+0000 7fa111d9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55922a0029a0 0x55922a002da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.509+0000 7fa111d9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55922a0029a0 0x55922a002da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:43268/0 (socket says 172.21.15.92:43268) 2024-09-19T09:06:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.509+0000 7fa111d9b640 1 -- 172.21.15.92:0/1832313361 learned_addr learned my addr 172.21.15.92:0/1832313361 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.509+0000 7fa11259c640 1 --2- 172.21.15.92:0/1832313361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55922a0032e0 0x55922a007da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.509+0000 7fa111d9b640 1 -- 172.21.15.92:0/1832313361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55922a0032e0 msgr2=0x55922a007da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.509+0000 7fa111d9b640 1 --2- 172.21.15.92:0/1832313361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55922a0032e0 0x55922a007da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.509+0000 7fa111d9b640 1 -- 172.21.15.92:0/1832313361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55922a008370 msgr2=0x55922a00a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.509+0000 7fa111d9b640 1 --2- 172.21.15.92:0/1832313361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55922a008370 0x55922a00a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.509+0000 7fa111d9b640 1 -- 172.21.15.92:0/1832313361 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559229f0d340 con 0x55922a0029a0 2024-09-19T09:06:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.510+0000 7fa111d9b640 1 --2- 172.21.15.92:0/1832313361 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55922a0029a0 0x55922a002da0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa10400bf20 tx=0x7fa104012ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28730fae924980bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.510+0000 7fa1037fe640 1 --2- 172.21.15.92:0/475539287 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa0fc0a33f0 0x7fa0fc0a58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.510+0000 7fa100ff9640 1 -- 172.21.15.92:0/1832313361 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa104004020 con 0x55922a0029a0 2024-09-19T09:06:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.510+0000 7fa100ff9640 1 -- 172.21.15.92:0/1832313361 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa104010e30 con 0x55922a0029a0 2024-09-19T09:06:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.510+0000 7fa100ff9640 1 -- 172.21.15.92:0/1832313361 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa104003c60 con 0x55922a0029a0 2024-09-19T09:06:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.510+0000 7fa11259c640 1 --2- 172.21.15.92:0/475539287 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa0fc0a33f0 0x7fa0fc0a58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:25.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.510+0000 7fa1037fe640 1 -- 172.21.15.92:0/475539287 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa1080d0760 con 0x7fa114109d40 2024-09-19T09:06:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.511+0000 7fa11259c640 1 --2- 172.21.15.92:0/475539287 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa0fc0a33f0 0x7fa0fc0a58b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa10c005e30 tx=0x7fa10c031bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.511+0000 7fa11bc80740 1 -- 172.21.15.92:0/1832313361 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55922a0029a0 msgr2=0x55922a002da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.511+0000 7fa11bc80740 1 --2- 172.21.15.92:0/1832313361 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55922a0029a0 0x55922a002da0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa10400bf20 tx=0x7fa104012ba0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.511+0000 7fa11bc80740 1 -- 172.21.15.92:0/1832313361 shutdown_connections 2024-09-19T09:06:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.511+0000 7fa11bc80740 1 --2- 172.21.15.92:0/1832313361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55922a008370 0x55922a00a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.511+0000 7fa11bc80740 1 --2- 172.21.15.92:0/1832313361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55922a0032e0 0x55922a007da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.511+0000 7fa11bc80740 1 --2- 172.21.15.92:0/1832313361 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55922a0029a0 0x55922a002da0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.511+0000 7fa11bc80740 1 -- 172.21.15.92:0/1832313361 >> 172.21.15.92:0/1832313361 conn(0x559229ffe010 msgr2=0x559229ffe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.511+0000 7fa11bc80740 1 -- 172.21.15.92:0/1832313361 shutdown_connections 2024-09-19T09:06:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.511+0000 7fa11bc80740 1 -- 172.21.15.92:0/1832313361 wait complete. 2024-09-19T09:06:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.512+0000 7fa11bc80740 1 -- start start 2024-09-19T09:06:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.512+0000 7fa11bc80740 1 Processor -- start 2024-09-19T09:06:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.512+0000 7fa11bc80740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55922a0029a0 0x55922a00ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.512+0000 7fa11bc80740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55922a0032e0 0x55922a00d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.512+0000 7fa11bc80740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55922a008370 0x55922a014160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.512+0000 7fa11bc80740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55922a00b340 con 0x55922a0032e0 2024-09-19T09:06:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.512+0000 7fa11bc80740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559229eef290 con 0x55922a008370 2024-09-19T09:06:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.512+0000 7fa11bc80740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55922a00b4c0 con 0x55922a0029a0 2024-09-19T09:06:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.512+0000 7fa11bc80740 10 client.0 _ll_register_callbacks cb 0x559229f20140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.512+0000 7fa11259c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55922a0029a0 0x55922a00ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.512+0000 7fa11259c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55922a0029a0 0x55922a00ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:43282/0 (socket says 172.21.15.92:43282) 2024-09-19T09:06:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.512+0000 7fa11259c640 1 -- 172.21.15.92:0/4197547568 learned_addr learned my addr 172.21.15.92:0/4197547568 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.512+0000 7fa112d9d640 1 --2- 172.21.15.92:0/4197547568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55922a008370 0x55922a014160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.512+0000 7fa111d9b640 1 --2- 172.21.15.92:0/4197547568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55922a0032e0 0x55922a00d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.513+0000 7fa112d9d640 1 -- 172.21.15.92:0/4197547568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55922a0029a0 msgr2=0x55922a00ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.513+0000 7fa112d9d640 1 --2- 172.21.15.92:0/4197547568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55922a0029a0 0x55922a00ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.513+0000 7fa112d9d640 1 -- 172.21.15.92:0/4197547568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55922a0032e0 msgr2=0x55922a00d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:25.517 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.513+0000 7fa112d9d640 1 --2- 172.21.15.92:0/4197547568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55922a0032e0 0x55922a00d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.517 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.513+0000 7fa112d9d640 1 -- 172.21.15.92:0/4197547568 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559229c79210 con 0x55922a008370 2024-09-19T09:06:25.517 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.513+0000 7fa112d9d640 1 --2- 172.21.15.92:0/4197547568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55922a008370 0x55922a014160 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa1080991a0 tx=0x7fa10809d4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcf3f5e4755cd727 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:25.517 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.513+0000 7fa0f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:06:25.517 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.513+0000 7fa0f9ffb640 1 -- 172.21.15.92:0/4197547568 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10801c040 con 0x55922a008370 2024-09-19T09:06:25.517 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.513+0000 7fa11bc80740 1 -- 172.21.15.92:0/4197547568 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa104010e30 con 0x55922a008370 2024-09-19T09:06:25.517 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.513+0000 7fa0f9ffb640 1 -- 172.21.15.92:0/4197547568 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa1080a5720 con 0x55922a008370 2024-09-19T09:06:25.517 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.513+0000 7fa0f9ffb640 1 -- 172.21.15.92:0/4197547568 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa1080a59b0 con 0x55922a008370 2024-09-19T09:06:25.517 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.513+0000 7fa11bc80740 10 client.27032 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:25.517 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.513+0000 7fa11bc80740 1 -- 172.21.15.92:0/4197547568 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x559229d45620 con 0x55922a008370 2024-09-19T09:06:25.517 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.513+0000 7fa0f9ffb640 1 -- 172.21.15.92:0/4197547568 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa104010e30 con 0x55922a008370 2024-09-19T09:06:25.517 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.514+0000 7fa0f9ffb640 1 -- 172.21.15.92:0/4197547568 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fa10809bd90 con 0x55922a008370 2024-09-19T09:06:25.517 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.514+0000 7fa11bc80740 10 client.27032 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:25.517 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.514+0000 7fa11bc80740 10 client.27032 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:06:25.518 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.514+0000 7fa11bc80740 20 client.27032 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:25.518 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.514+0000 7fa11bc80740 1 --2- 172.21.15.92:0/4197547568 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55922a0188a0 0x55922a01ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.518 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.514+0000 7fa11bc80740 4 client.27032 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:06:25.518 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.514+0000 7fa11bc80740 1 -- 172.21.15.92:0/4197547568 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559229f73a20 con 0x55922a0188a0 2024-09-19T09:06:25.518 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.514+0000 7fa11259c640 1 --2- 172.21.15.92:0/4197547568 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55922a0188a0 0x55922a01ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:25.518 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.514+0000 7fa0f9ffb640 10 client.27032 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:25.518 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.514+0000 7fa11259c640 1 --2- 172.21.15.92:0/4197547568 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55922a0188a0 0x55922a01ad10 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a66e12226f1b9d61 server_cookie=3e39931172e73aaf in_seq=0 out_seq=0 2024-09-19T09:06:25.519 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.515+0000 7fa0f9ffb640 1 -- 172.21.15.92:0/4197547568 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559229f73a20 con 0x55922a0188a0 2024-09-19T09:06:25.519 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.515+0000 7fa0f9ffb640 10 client.27032 handle_command_reply: tid=0 2024-09-19T09:06:25.519 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.515+0000 7fa11bc80740 1 client.27032 shutdown 2024-09-19T09:06:25.519 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.515+0000 7fa11bc80740 1 -- 172.21.15.92:0/4197547568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55922a008370 msgr2=0x55922a014160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:25.519 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.515+0000 7fa11bc80740 1 --2- 172.21.15.92:0/4197547568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55922a008370 0x55922a014160 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa1080991a0 tx=0x7fa10809d4c0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.519 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.515+0000 7fa11bc80740 1 -- 172.21.15.92:0/4197547568 shutdown_connections 2024-09-19T09:06:25.519 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.515+0000 7fa11bc80740 1 --2- 172.21.15.92:0/4197547568 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55922a0188a0 0x55922a01ad10 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.519 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.515+0000 7fa11bc80740 1 --2- 172.21.15.92:0/4197547568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55922a008370 0x55922a014160 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.515+0000 7fa0f9ffb640 0 client.27032 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:25.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.515+0000 7fa11bc80740 1 --2- 172.21.15.92:0/4197547568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55922a0032e0 0x55922a00d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.515+0000 7fa11bc80740 1 --2- 172.21.15.92:0/4197547568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55922a0029a0 0x55922a00ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.515+0000 7fa11bc80740 1 -- 172.21.15.92:0/4197547568 >> 172.21.15.92:0/4197547568 conn(0x559229ffe010 msgr2=0x559229fff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:25.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.515+0000 7fa11bc80740 1 -- 172.21.15.92:0/4197547568 shutdown_connections 2024-09-19T09:06:25.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.515+0000 7fa11bc80740 1 -- 172.21.15.92:0/4197547568 wait complete. 2024-09-19T09:06:25.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.515+0000 7fa11bc80740 20 client.27032 trim_cache size 0 max 16384 2024-09-19T09:06:25.539 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.537+0000 7fa11bc80740 1 Processor -- start 2024-09-19T09:06:25.539 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.537+0000 7fa11bc80740 1 -- start start 2024-09-19T09:06:25.539 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.537+0000 7fa11bc80740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55922a0029a0 0x559229ffd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.539 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.537+0000 7fa11bc80740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55922a0032e0 0x55922a014080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.539 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.537+0000 7fa11bc80740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55922a008370 0x55922a01f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.539 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.537+0000 7fa11bc80740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f400c440 con 0x55922a0032e0 2024-09-19T09:06:25.539 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.537+0000 7fa11bc80740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f400ece0 con 0x55922a0029a0 2024-09-19T09:06:25.539 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.537+0000 7fa11bc80740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f400cad0 con 0x55922a008370 2024-09-19T09:06:25.539 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.537+0000 7fa111d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55922a0032e0 0x55922a014080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:25.539 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.537+0000 7fa111d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55922a0032e0 0x55922a014080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58140/0 (socket says 172.21.15.92:58140) 2024-09-19T09:06:25.539 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.537+0000 7fa111d9b640 1 -- 172.21.15.92:0/1127851665 learned_addr learned my addr 172.21.15.92:0/1127851665 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:25.539 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.537+0000 7fa112d9d640 1 --2- 172.21.15.92:0/1127851665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55922a008370 0x55922a01f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:25.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.538+0000 7fa11259c640 1 --2- 172.21.15.92:0/1127851665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55922a0029a0 0x559229ffd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:25.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.538+0000 7fa111d9b640 1 -- 172.21.15.92:0/1127851665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55922a008370 msgr2=0x55922a01f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:25.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.538+0000 7fa111d9b640 1 --2- 172.21.15.92:0/1127851665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55922a008370 0x55922a01f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.538+0000 7fa111d9b640 1 -- 172.21.15.92:0/1127851665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55922a0029a0 msgr2=0x559229ffd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:25.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.538+0000 7fa111d9b640 1 --2- 172.21.15.92:0/1127851665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55922a0029a0 0x559229ffd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.538+0000 7fa111d9b640 1 -- 172.21.15.92:0/1127851665 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55922a00c800 con 0x55922a0032e0 2024-09-19T09:06:25.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.538+0000 7fa11259c640 1 --2- 172.21.15.92:0/1127851665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55922a0029a0 0x559229ffd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:25.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.538+0000 7fa112d9d640 1 --2- 172.21.15.92:0/1127851665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55922a008370 0x55922a01f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:06:25.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.538+0000 7fa111d9b640 1 --2- 172.21.15.92:0/1127851665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55922a0032e0 0x55922a014080 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fa10400bf20 tx=0x7fa104005ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75651d69ad497f4e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:25.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.538+0000 7fa0fbfff640 1 -- 172.21.15.92:0/1127851665 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10402a070 con 0x55922a0032e0 2024-09-19T09:06:25.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.538+0000 7fa0fbfff640 1 -- 172.21.15.92:0/1127851665 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa104005040 con 0x55922a0032e0 2024-09-19T09:06:25.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.538+0000 7fa0fbfff640 1 -- 172.21.15.92:0/1127851665 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa104004a00 con 0x55922a0032e0 2024-09-19T09:06:25.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.539+0000 7fa11bc80740 1 -- 172.21.15.92:0/1127851665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55922a0032e0 msgr2=0x55922a014080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:25.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.539+0000 7fa11bc80740 1 --2- 172.21.15.92:0/1127851665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55922a0032e0 0x55922a014080 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fa10400bf20 tx=0x7fa104005ed0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.539+0000 7fa11bc80740 1 -- 172.21.15.92:0/1127851665 shutdown_connections 2024-09-19T09:06:25.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.539+0000 7fa11bc80740 1 --2- 172.21.15.92:0/1127851665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55922a008370 0x55922a01f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.539+0000 7fa11bc80740 1 --2- 172.21.15.92:0/1127851665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55922a0032e0 0x55922a014080 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.539+0000 7fa11bc80740 1 --2- 172.21.15.92:0/1127851665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55922a0029a0 0x559229ffd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.539+0000 7fa11bc80740 1 -- 172.21.15.92:0/1127851665 >> 172.21.15.92:0/1127851665 conn(0x559229ffe010 msgr2=0x559229ffc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:25.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.539+0000 7fa11bc80740 1 -- 172.21.15.92:0/1127851665 shutdown_connections 2024-09-19T09:06:25.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.539+0000 7fa11bc80740 1 -- 172.21.15.92:0/1127851665 wait complete. 2024-09-19T09:06:25.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.539+0000 7fa11bc80740 1 -- start start 2024-09-19T09:06:25.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.540+0000 7fa11bc80740 1 Processor -- start 2024-09-19T09:06:25.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.540+0000 7fa11bc80740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55922a0029a0 0x55922a011440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.540+0000 7fa11bc80740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55922a0032e0 0x55922a011980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.540+0000 7fa11bc80740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55922a008370 0x55922a012990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.540+0000 7fa11bc80740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f400d1a0 con 0x55922a0032e0 2024-09-19T09:06:25.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.540+0000 7fa11bc80740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f400e610 con 0x55922a008370 2024-09-19T09:06:25.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.540+0000 7fa11bc80740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f400d870 con 0x55922a0029a0 2024-09-19T09:06:25.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.540+0000 7fa11bc80740 10 client.0 _ll_register_callbacks cb 0x7fa108004e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:25.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.540+0000 7fa11259c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55922a0029a0 0x55922a011440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:25.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.540+0000 7fa11259c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55922a0029a0 0x55922a011440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:43300/0 (socket says 172.21.15.92:43300) 2024-09-19T09:06:25.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.540+0000 7fa11259c640 1 -- 172.21.15.92:0/3384781968 learned_addr learned my addr 172.21.15.92:0/3384781968 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:25.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.541+0000 7fa112d9d640 1 --2- 172.21.15.92:0/3384781968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55922a008370 0x55922a012990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:25.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.541+0000 7fa111d9b640 1 --2- 172.21.15.92:0/3384781968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55922a0032e0 0x55922a011980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:25.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.541+0000 7fa112d9d640 1 -- 172.21.15.92:0/3384781968 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55922a0029a0 msgr2=0x55922a011440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:25.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.541+0000 7fa112d9d640 1 --2- 172.21.15.92:0/3384781968 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55922a0029a0 0x55922a011440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.541+0000 7fa112d9d640 1 -- 172.21.15.92:0/3384781968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55922a0032e0 msgr2=0x55922a011980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:25.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.541+0000 7fa112d9d640 1 --2- 172.21.15.92:0/3384781968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55922a0032e0 0x55922a011980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.541+0000 7fa112d9d640 1 -- 172.21.15.92:0/3384781968 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55922a012fa0 con 0x55922a008370 2024-09-19T09:06:25.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.542+0000 7fa112d9d640 1 --2- 172.21.15.92:0/3384781968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55922a008370 0x55922a012990 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa1080a2410 tx=0x7fa1080a5750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97fafe8bded19fe8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:25.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.543+0000 7fa0f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:06:25.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.543+0000 7fa0f9ffb640 1 -- 172.21.15.92:0/3384781968 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10801c070 con 0x55922a008370 2024-09-19T09:06:25.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.543+0000 7fa0f9ffb640 1 -- 172.21.15.92:0/3384781968 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa10809bc00 con 0x55922a008370 2024-09-19T09:06:25.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.544+0000 7fa11bc80740 1 -- 172.21.15.92:0/3384781968 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa104005040 con 0x55922a008370 2024-09-19T09:06:25.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.544+0000 7fa0f9ffb640 1 -- 172.21.15.92:0/3384781968 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa10809be00 con 0x55922a008370 2024-09-19T09:06:25.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.544+0000 7fa11bc80740 10 client.27038 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:25.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.544+0000 7fa11bc80740 1 -- 172.21.15.92:0/3384781968 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55922a014320 con 0x55922a008370 2024-09-19T09:06:25.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.544+0000 7fa0f9ffb640 1 -- 172.21.15.92:0/3384781968 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa104005040 con 0x55922a008370 2024-09-19T09:06:25.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.545+0000 7fa0f9ffb640 1 -- 172.21.15.92:0/3384781968 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fa1080051d0 con 0x55922a008370 2024-09-19T09:06:25.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.545+0000 7fa11bc80740 10 client.27038 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:25.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.545+0000 7fa11bc80740 10 client.27038 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:06:25.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.545+0000 7fa11bc80740 20 client.27038 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:25.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.545+0000 7fa11bc80740 1 --2- 172.21.15.92:0/3384781968 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55922a0188a0 0x55922a085cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.545+0000 7fa11bc80740 4 client.27038 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:06:25.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.545+0000 7fa11bc80740 1 -- 172.21.15.92:0/3384781968 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559229f6dd70 con 0x55922a0188a0 2024-09-19T09:06:25.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.545+0000 7fa11259c640 1 --2- 172.21.15.92:0/3384781968 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55922a0188a0 0x55922a085cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:25.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.546+0000 7fa11259c640 1 --2- 172.21.15.92:0/3384781968 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55922a0188a0 0x55922a085cc0 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c459ecf4c647522 server_cookie=2edc1152a87aecb6 in_seq=0 out_seq=0 2024-09-19T09:06:25.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.546+0000 7fa0f9ffb640 10 client.27038 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:25.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.562+0000 7fa0f9ffb640 1 -- 172.21.15.92:0/3384781968 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559229f6dd70 con 0x55922a0188a0 2024-09-19T09:06:25.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.563+0000 7fa0f9ffb640 10 client.27038 handle_command_reply: tid=0 2024-09-19T09:06:25.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.563+0000 7fa11bc80740 1 client.27038 shutdown 2024-09-19T09:06:25.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.563+0000 7fa11bc80740 1 -- 172.21.15.92:0/3384781968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55922a008370 msgr2=0x55922a012990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:25.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.563+0000 7fa11bc80740 1 --2- 172.21.15.92:0/3384781968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55922a008370 0x55922a012990 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa1080a2410 tx=0x7fa1080a5750 comp rx=0 tx=0).stop 2024-09-19T09:06:25.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.563+0000 7fa11bc80740 1 -- 172.21.15.92:0/3384781968 shutdown_connections 2024-09-19T09:06:25.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.563+0000 7fa11bc80740 1 --2- 172.21.15.92:0/3384781968 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55922a0188a0 0x55922a085cc0 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.563+0000 7fa11bc80740 1 --2- 172.21.15.92:0/3384781968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55922a008370 0x55922a012990 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.563+0000 7fa0f9ffb640 0 client.27038 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:25.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.563+0000 7fa11bc80740 1 --2- 172.21.15.92:0/3384781968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55922a0032e0 0x55922a011980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.563+0000 7fa11bc80740 1 --2- 172.21.15.92:0/3384781968 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55922a0029a0 0x55922a011440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.563+0000 7fa11bc80740 1 -- 172.21.15.92:0/3384781968 >> 172.21.15.92:0/3384781968 conn(0x559229ffe010 msgr2=0x559229ffd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:25.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.564+0000 7fa11bc80740 1 -- 172.21.15.92:0/3384781968 shutdown_connections 2024-09-19T09:06:25.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.564+0000 7fa11bc80740 1 -- 172.21.15.92:0/3384781968 wait complete. 2024-09-19T09:06:25.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.564+0000 7fa11bc80740 20 client.27038 trim_cache size 0 max 16384 2024-09-19T09:06:25.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:06:25.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:06:25.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:06:25.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:06:25.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.564+0000 7fa118ee6640 1 -- 172.21.15.92:0/475539287 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa0fc0a33f0 msgr2=0x7fa0fc0a58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:25.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.564+0000 7fa118ee6640 1 --2- 172.21.15.92:0/475539287 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa0fc0a33f0 0x7fa0fc0a58b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa10c005e30 tx=0x7fa10c031bd0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.564+0000 7fa118ee6640 1 -- 172.21.15.92:0/475539287 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa114109d40 msgr2=0x7fa1141a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.564+0000 7fa118ee6640 1 --2- 172.21.15.92:0/475539287 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa114109d40 0x7fa1141a59a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa10800e970 tx=0x7fa10800ee30 comp rx=0 tx=0).stop 2024-09-19T09:06:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.564+0000 7fa118ee6640 1 -- 172.21.15.92:0/475539287 shutdown_connections 2024-09-19T09:06:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.564+0000 7fa118ee6640 1 --2- 172.21.15.92:0/475539287 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa114109d40 0x7fa1141a59a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.564+0000 7fa118ee6640 1 --2- 172.21.15.92:0/475539287 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa0fc0a33f0 0x7fa0fc0a58b0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.564+0000 7fa118ee6640 1 --2- 172.21.15.92:0/475539287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa114109380 0x7fa11419e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.564+0000 7fa118ee6640 1 --2- 172.21.15.92:0/475539287 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa114108470 0x7fa11419e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.564+0000 7fa118ee6640 1 -- 172.21.15.92:0/475539287 >> 172.21.15.92:0/475539287 conn(0x7fa114077490 msgr2=0x7fa11410c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.564+0000 7fa118ee6640 1 -- 172.21.15.92:0/475539287 shutdown_connections 2024-09-19T09:06:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:25.564+0000 7fa118ee6640 1 -- 172.21.15.92:0/475539287 wait complete. 2024-09-19T09:06:25.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 580.0 s, 201.6 tps, lat 2813.133 ms stddev 8342.050 2024-09-19T09:06:25.835 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:25 smithi092 ceph-mon[31407]: pgmap v628: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 122 KiB/s wr, 85 op/s 2024-09-19T09:06:25.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:25 smithi167 ceph-mon[35359]: pgmap v628: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 122 KiB/s wr, 85 op/s 2024-09-19T09:06:25.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:25 smithi190 ceph-mon[35358]: pgmap v628: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 122 KiB/s wr, 85 op/s 2024-09-19T09:06:26.164 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '209062f4', total seconds elapsed: 33.4 2024-09-19T09:06:26.164 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-09-19T09:06:26.165 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:06:26.532 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:06:27.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.112+0000 7f034d702640 1 -- 172.21.15.92:0/4252940563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0348105f40 msgr2=0x7f03481063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:27.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.112+0000 7f034d702640 1 --2- 172.21.15.92:0/4252940563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0348105f40 0x7f03481063d0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f0340009be0 tx=0x7f034002a740 comp rx=0 tx=0).stop 2024-09-19T09:06:27.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.112+0000 7f034d702640 1 -- 172.21.15.92:0/4252940563 shutdown_connections 2024-09-19T09:06:27.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.112+0000 7f034d702640 1 --2- 172.21.15.92:0/4252940563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0348105f40 0x7f03481063d0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.112+0000 7f034d702640 1 --2- 172.21.15.92:0/4252940563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0348101450 0x7f0348105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.112+0000 7f034d702640 1 --2- 172.21.15.92:0/4252940563 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0348100b30 0x7f0348100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.112+0000 7f034d702640 1 -- 172.21.15.92:0/4252940563 >> 172.21.15.92:0/4252940563 conn(0x7f03480fc7a0 msgr2=0x7f03480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:27.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.113+0000 7f034d702640 1 -- 172.21.15.92:0/4252940563 shutdown_connections 2024-09-19T09:06:27.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.120+0000 7f034d702640 1 -- 172.21.15.92:0/4252940563 wait complete. 2024-09-19T09:06:27.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.120+0000 7f034d702640 1 Processor -- start 2024-09-19T09:06:27.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.121+0000 7f034d702640 1 -- start start 2024-09-19T09:06:27.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.121+0000 7f034d702640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0348100b30 0x7f0348114d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:27.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.121+0000 7f034d702640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0348101450 0x7f034810dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:27.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.121+0000 7f034d702640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0348105f40 0x7f034810e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:27.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.121+0000 7f034d702640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f03481185c0 con 0x7f0348100b30 2024-09-19T09:06:27.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.121+0000 7f034d702640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0348118440 con 0x7f0348105f40 2024-09-19T09:06:27.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.121+0000 7f034d702640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0348118740 con 0x7f0348101450 2024-09-19T09:06:27.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.122+0000 7f03477fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0348105f40 0x7f034810e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:27.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.122+0000 7f03477fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0348105f40 0x7f034810e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:52428/0 (socket says 172.21.15.92:52428) 2024-09-19T09:06:27.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.122+0000 7f03477fe640 1 -- 172.21.15.92:0/3067082763 learned_addr learned my addr 172.21.15.92:0/3067082763 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:27.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.125+0000 7f0346ffd640 1 --2- 172.21.15.92:0/3067082763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0348100b30 0x7f0348114d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:27.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.127+0000 7f03477fe640 1 -- 172.21.15.92:0/3067082763 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0348101450 msgr2=0x7f034810dd90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:06:27.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.127+0000 7f03477fe640 1 --2- 172.21.15.92:0/3067082763 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0348101450 0x7f034810dd90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.127+0000 7f03477fe640 1 -- 172.21.15.92:0/3067082763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0348100b30 msgr2=0x7f0348114d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:27.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.127+0000 7f03477fe640 1 --2- 172.21.15.92:0/3067082763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0348100b30 0x7f0348114d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.127+0000 7f03477fe640 1 -- 172.21.15.92:0/3067082763 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f034810e890 con 0x7f0348105f40 2024-09-19T09:06:27.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.138+0000 7f03477fe640 1 --2- 172.21.15.92:0/3067082763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0348105f40 0x7f034810e2d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0340004af0 tx=0x7f03400318d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:27.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.139+0000 7f032ffff640 1 -- 172.21.15.92:0/3067082763 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0340041070 con 0x7f0348105f40 2024-09-19T09:06:27.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.139+0000 7f032ffff640 1 -- 172.21.15.92:0/3067082763 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0340003e50 con 0x7f0348105f40 2024-09-19T09:06:27.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.139+0000 7f034d702640 1 -- 172.21.15.92:0/3067082763 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f034810eb20 con 0x7f0348105f40 2024-09-19T09:06:27.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.139+0000 7f034d702640 1 -- 172.21.15.92:0/3067082763 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0348112ab0 con 0x7f0348105f40 2024-09-19T09:06:27.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.139+0000 7f032ffff640 1 -- 172.21.15.92:0/3067082763 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0340036070 con 0x7f0348105f40 2024-09-19T09:06:27.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.145+0000 7f032dffb640 1 -- 172.21.15.92:0/3067082763 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f034806b070 con 0x7f0348105f40 2024-09-19T09:06:27.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.147+0000 7f032ffff640 1 -- 172.21.15.92:0/3067082763 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0340044070 con 0x7f0348105f40 2024-09-19T09:06:27.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.148+0000 7f032ffff640 1 --2- 172.21.15.92:0/3067082763 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f03300a3410 0x7f03300a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:27.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.148+0000 7f032ffff640 1 -- 172.21.15.92:0/3067082763 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f03400effc0 con 0x7f0348105f40 2024-09-19T09:06:27.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.149+0000 7f0346ffd640 1 --2- 172.21.15.92:0/3067082763 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f03300a3410 0x7f03300a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:27.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.150+0000 7f0346ffd640 1 --2- 172.21.15.92:0/3067082763 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f03300a3410 0x7f03300a58d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0338005fd0 tx=0x7f0338009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:27.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.156+0000 7f032ffff640 1 -- 172.21.15.92:0/3067082763 <== mon.2 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f03400bcca0 con 0x7f0348105f40 2024-09-19T09:06:27.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.484+0000 7f032dffb640 1 -- 172.21.15.92:0/3067082763 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0348113520 con 0x7f0348105f40 2024-09-19T09:06:27.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.485+0000 7f032ffff640 1 -- 172.21.15.92:0/3067082763 <== mon.2 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f03400bc5a0 con 0x7f0348105f40 2024-09-19T09:06:27.486 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:06:27.486 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:06:27.486 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:06:27.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.488+0000 7f032dffb640 1 -- 172.21.15.92:0/3067082763 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f03300a3410 msgr2=0x7f03300a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:27.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.488+0000 7f032dffb640 1 --2- 172.21.15.92:0/3067082763 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f03300a3410 0x7f03300a58d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0338005fd0 tx=0x7f0338009260 comp rx=0 tx=0).stop 2024-09-19T09:06:27.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.488+0000 7f032dffb640 1 -- 172.21.15.92:0/3067082763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0348105f40 msgr2=0x7f034810e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:27.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.488+0000 7f032dffb640 1 --2- 172.21.15.92:0/3067082763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0348105f40 0x7f034810e2d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0340004af0 tx=0x7f03400318d0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.489+0000 7f032dffb640 1 -- 172.21.15.92:0/3067082763 shutdown_connections 2024-09-19T09:06:27.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.489+0000 7f032dffb640 1 --2- 172.21.15.92:0/3067082763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0348105f40 0x7f034810e2d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.489+0000 7f032dffb640 1 --2- 172.21.15.92:0/3067082763 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0348101450 0x7f034810dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.489+0000 7f032dffb640 1 --2- 172.21.15.92:0/3067082763 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f03300a3410 0x7f03300a58d0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.489+0000 7f032dffb640 1 --2- 172.21.15.92:0/3067082763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0348100b30 0x7f0348114d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.489+0000 7f032dffb640 1 -- 172.21.15.92:0/3067082763 >> 172.21.15.92:0/3067082763 conn(0x7f03480fc7a0 msgr2=0x7f03481038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:27.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.489+0000 7f032dffb640 1 -- 172.21.15.92:0/3067082763 shutdown_connections 2024-09-19T09:06:27.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:27.489+0000 7f032dffb640 1 -- 172.21.15.92:0/3067082763 wait complete. 2024-09-19T09:06:27.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:27 smithi092 ceph-mon[31407]: pgmap v629: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 179 KiB/s wr, 30 op/s 2024-09-19T09:06:27.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:27 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3067082763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:06:27.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:27 smithi167 ceph-mon[35359]: pgmap v629: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 179 KiB/s wr, 30 op/s 2024-09-19T09:06:27.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:27 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3067082763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:06:27.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:27 smithi190 ceph-mon[35358]: pgmap v629: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 179 KiB/s wr, 30 op/s 2024-09-19T09:06:27.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:27 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3067082763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:06:28.266 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-09-19T09:06:28.266 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-09-19T09:06:28.632 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:06:29.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.199+0000 7fcd175aa640 1 -- 172.21.15.92:0/4122637136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd10074590 msgr2=0x7fcd10074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:29.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.199+0000 7fcd175aa640 1 --2- 172.21.15.92:0/4122637136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd10074590 0x7fcd10074970 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c009900 tx=0x7fcd0c02a480 comp rx=0 tx=0).stop 2024-09-19T09:06:29.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.200+0000 7fcd175aa640 1 -- 172.21.15.92:0/4122637136 shutdown_connections 2024-09-19T09:06:29.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.200+0000 7fcd175aa640 1 --2- 172.21.15.92:0/4122637136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd10112b90 0x7fcd10114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.200+0000 7fcd175aa640 1 --2- 172.21.15.92:0/4122637136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd10074eb0 0x7fcd10112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.200+0000 7fcd175aa640 1 --2- 172.21.15.92:0/4122637136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd10074590 0x7fcd10074970 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.200+0000 7fcd175aa640 1 -- 172.21.15.92:0/4122637136 >> 172.21.15.92:0/4122637136 conn(0x7fcd100fd880 msgr2=0x7fcd100ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:29.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.200+0000 7fcd175aa640 1 -- 172.21.15.92:0/4122637136 shutdown_connections 2024-09-19T09:06:29.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.200+0000 7fcd175aa640 1 -- 172.21.15.92:0/4122637136 wait complete. 2024-09-19T09:06:29.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.201+0000 7fcd175aa640 1 Processor -- start 2024-09-19T09:06:29.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.201+0000 7fcd175aa640 1 -- start start 2024-09-19T09:06:29.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.201+0000 7fcd175aa640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd10074590 0x7fcd101a4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:29.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.201+0000 7fcd175aa640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd10074eb0 0x7fcd101a4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:29.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.201+0000 7fcd175aa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd10112b90 0x7fcd1019e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:29.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.201+0000 7fcd175aa640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcd10118570 con 0x7fcd10074590 2024-09-19T09:06:29.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.201+0000 7fcd175aa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcd101183f0 con 0x7fcd10112b90 2024-09-19T09:06:29.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.201+0000 7fcd175aa640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fcd101186f0 con 0x7fcd10074eb0 2024-09-19T09:06:29.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.201+0000 7fcd15346640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd10074590 0x7fcd101a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:29.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.201+0000 7fcd15346640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd10074590 0x7fcd101a4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58184/0 (socket says 172.21.15.92:58184) 2024-09-19T09:06:29.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.201+0000 7fcd15346640 1 -- 172.21.15.92:0/324810691 learned_addr learned my addr 172.21.15.92:0/324810691 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:29.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.201+0000 7fcd14b45640 1 --2- 172.21.15.92:0/324810691 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd10074eb0 0x7fcd101a4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:29.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.201+0000 7fcd15b47640 1 --2- 172.21.15.92:0/324810691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd10112b90 0x7fcd1019e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:29.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.201+0000 7fcd15346640 1 -- 172.21.15.92:0/324810691 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd10074eb0 msgr2=0x7fcd101a4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:29.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.201+0000 7fcd15346640 1 --2- 172.21.15.92:0/324810691 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd10074eb0 0x7fcd101a4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.201+0000 7fcd15346640 1 -- 172.21.15.92:0/324810691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd10112b90 msgr2=0x7fcd1019e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:29.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.201+0000 7fcd15346640 1 --2- 172.21.15.92:0/324810691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd10112b90 0x7fcd1019e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.201+0000 7fcd15346640 1 -- 172.21.15.92:0/324810691 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd1019f010 con 0x7fcd10074590 2024-09-19T09:06:29.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.202+0000 7fcd15346640 1 --2- 172.21.15.92:0/324810691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd10074590 0x7fcd101a4720 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c006010 tx=0x7fcd0c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:29.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.202+0000 7fcd067fc640 1 -- 172.21.15.92:0/324810691 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c03f030 con 0x7fcd10074590 2024-09-19T09:06:29.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.202+0000 7fcd067fc640 1 -- 172.21.15.92:0/324810691 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd0c004440 con 0x7fcd10074590 2024-09-19T09:06:29.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.202+0000 7fcd175aa640 1 -- 172.21.15.92:0/324810691 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd1019f2a0 con 0x7fcd10074590 2024-09-19T09:06:29.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.202+0000 7fcd067fc640 1 -- 172.21.15.92:0/324810691 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c035070 con 0x7fcd10074590 2024-09-19T09:06:29.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.202+0000 7fcd175aa640 1 -- 172.21.15.92:0/324810691 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd101ab5f0 con 0x7fcd10074590 2024-09-19T09:06:29.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.206+0000 7fcd19983740 1 Processor -- start 2024-09-19T09:06:29.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.206+0000 7fcd19983740 1 -- start start 2024-09-19T09:06:29.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.206+0000 7fcd19983740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d06b94760 0x555d06b94b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:29.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.206+0000 7fcd19983740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d06b95080 0x555d06b9f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:29.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.206+0000 7fcd19983740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d06b9f940 0x555d06ba1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:29.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.206+0000 7fcd19983740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555d06afa2a0 con 0x555d06b9f940 2024-09-19T09:06:29.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.206+0000 7fcd19983740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x555d06aa1b10 con 0x555d06b94760 2024-09-19T09:06:29.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.206+0000 7fcd19983740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x555d06af6260 con 0x555d06b95080 2024-09-19T09:06:29.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.207+0000 7fcd15b47640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d06b94760 0x555d06b94b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:29.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.207+0000 7fcd14b45640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d06b9f940 0x555d06ba1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:29.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.207+0000 7fcd15b47640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d06b94760 0x555d06b94b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:52468/0 (socket says 172.21.15.92:52468) 2024-09-19T09:06:29.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.207+0000 7fcd15b47640 1 -- 172.21.15.92:0/1403721628 learned_addr learned my addr 172.21.15.92:0/1403721628 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:29.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.207+0000 7fcd067fc640 1 -- 172.21.15.92:0/324810691 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fcd0c042030 con 0x7fcd10074590 2024-09-19T09:06:29.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.207+0000 7fcd15b47640 1 -- 172.21.15.92:0/1403721628 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d06b95080 msgr2=0x555d06b9f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:29.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.207+0000 7fcd15b47640 1 --2- 172.21.15.92:0/1403721628 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d06b95080 0x555d06b9f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.207+0000 7fcd15b47640 1 -- 172.21.15.92:0/1403721628 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d06b9f940 msgr2=0x555d06ba1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:29.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.207+0000 7fcd15b47640 1 --2- 172.21.15.92:0/1403721628 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d06b9f940 0x555d06ba1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.207+0000 7fcd15b47640 1 -- 172.21.15.92:0/1403721628 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d0686bb90 con 0x555d06b94760 2024-09-19T09:06:29.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.207+0000 7fcd15b47640 1 --2- 172.21.15.92:0/1403721628 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d06b94760 0x555d06b94b40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fcd08009f30 tx=0x7fcd080118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=939b22328d5a1d0c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:29.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.207+0000 7fccfb7fe640 1 -- 172.21.15.92:0/1403721628 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd08004d20 con 0x555d06b94760 2024-09-19T09:06:29.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.207+0000 7fccfb7fe640 1 -- 172.21.15.92:0/1403721628 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd08004050 con 0x555d06b94760 2024-09-19T09:06:29.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.207+0000 7fccfb7fe640 1 -- 172.21.15.92:0/1403721628 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd08005280 con 0x555d06b94760 2024-09-19T09:06:29.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.207+0000 7fcd067fc640 1 --2- 172.21.15.92:0/324810691 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fccfc0a3240 0x7fccfc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:29.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.208+0000 7fcd15346640 1 --2- 172.21.15.92:0/324810691 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fccfc0a3240 0x7fccfc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:29.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.208+0000 7fcd067fc640 1 -- 172.21.15.92:0/324810691 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcd0c0efc60 con 0x7fcd10074590 2024-09-19T09:06:29.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.208+0000 7fcd19983740 1 -- 172.21.15.92:0/1403721628 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d06b94760 msgr2=0x555d06b94b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:29.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.208+0000 7fcd15346640 1 --2- 172.21.15.92:0/324810691 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fccfc0a3240 0x7fccfc0a5700 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c032c00 tx=0x7fcd0c043f20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:29.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.208+0000 7fcd19983740 1 --2- 172.21.15.92:0/1403721628 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d06b94760 0x555d06b94b40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fcd08009f30 tx=0x7fcd080118d0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.209+0000 7fcd19983740 1 -- 172.21.15.92:0/1403721628 shutdown_connections 2024-09-19T09:06:29.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.209+0000 7fcd19983740 1 --2- 172.21.15.92:0/1403721628 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d06b9f940 0x555d06ba1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.209+0000 7fcd19983740 1 --2- 172.21.15.92:0/1403721628 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d06b95080 0x555d06b9f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.209+0000 7fcd19983740 1 --2- 172.21.15.92:0/1403721628 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d06b94760 0x555d06b94b40 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.209+0000 7fcd19983740 1 -- 172.21.15.92:0/1403721628 >> 172.21.15.92:0/1403721628 conn(0x555d06b90cf0 msgr2=0x555d06b910d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:29.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.209+0000 7fcd19983740 1 -- 172.21.15.92:0/1403721628 shutdown_connections 2024-09-19T09:06:29.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.209+0000 7fcd19983740 1 -- 172.21.15.92:0/1403721628 wait complete. 2024-09-19T09:06:29.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.209+0000 7fcd19983740 1 -- start start 2024-09-19T09:06:29.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.210+0000 7fcd19983740 1 Processor -- start 2024-09-19T09:06:29.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.210+0000 7fcd19983740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d06b94760 0x555d06b9c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:29.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.210+0000 7fcd19983740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d06b95080 0x555d06b9cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:29.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.210+0000 7fcd19983740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d06b9f940 0x555d06b9d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:29.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.210+0000 7fcd19983740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555d06ba2510 con 0x555d06b95080 2024-09-19T09:06:29.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.210+0000 7fcd19983740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x555d06a826e0 con 0x555d06b9f940 2024-09-19T09:06:29.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.210+0000 7fcd19983740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x555d06ba2690 con 0x555d06b94760 2024-09-19T09:06:29.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.210+0000 7fcd19983740 10 client.0 _ll_register_callbacks cb 0x555d06aa6a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:29.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.210+0000 7fcd14b45640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d06b95080 0x555d06b9cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:29.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.210+0000 7fcd15b47640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d06b94760 0x555d06b9c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:29.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.210+0000 7fcd14b45640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d06b95080 0x555d06b9cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58202/0 (socket says 172.21.15.92:58202) 2024-09-19T09:06:29.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.210+0000 7fcd14b45640 1 -- 172.21.15.92:0/3715706369 learned_addr learned my addr 172.21.15.92:0/3715706369 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:29.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.211+0000 7fcd15b47640 1 --2- 172.21.15.92:0/3715706369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d06b9f940 0x555d06b9d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:29.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.211+0000 7fcd14b45640 1 -- 172.21.15.92:0/3715706369 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d06b94760 msgr2=0x555d06b9c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:29.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.211+0000 7fcd14b45640 1 --2- 172.21.15.92:0/3715706369 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d06b94760 0x555d06b9c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.211+0000 7fcd14b45640 1 -- 172.21.15.92:0/3715706369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d06b9f940 msgr2=0x555d06b9d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:29.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.211+0000 7fcd14b45640 1 --2- 172.21.15.92:0/3715706369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d06b9f940 0x555d06b9d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.211+0000 7fcd14b45640 1 -- 172.21.15.92:0/3715706369 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d06bab9e0 con 0x555d06b95080 2024-09-19T09:06:29.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.211+0000 7fcd15b47640 1 --2- 172.21.15.92:0/3715706369 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d06b94760 0x555d06b9c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:06:29.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.211+0000 7fcd14b45640 1 --2- 172.21.15.92:0/3715706369 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d06b95080 0x555d06b9cd00 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fcd00012730 tx=0x7fcd00012bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64612b27bd2d5f20 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:29.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.211+0000 7fccf8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:06:29.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.211+0000 7fccf8ff9640 1 -- 172.21.15.92:0/3715706369 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0000f920 con 0x555d06b95080 2024-09-19T09:06:29.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.211+0000 7fccf8ff9640 1 -- 172.21.15.92:0/3715706369 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcd0000fac0 con 0x555d06b95080 2024-09-19T09:06:29.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.211+0000 7fcd19983740 1 -- 172.21.15.92:0/3715706369 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd08004050 con 0x555d06b95080 2024-09-19T09:06:29.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.212+0000 7fccf8ff9640 1 -- 172.21.15.92:0/3715706369 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fcd0000fcc0 con 0x555d06b95080 2024-09-19T09:06:29.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.212+0000 7fcd19983740 10 client.17727 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:29.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.212+0000 7fcd19983740 1 -- 172.21.15.92:0/3715706369 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x555d06bae3b0 con 0x555d06b95080 2024-09-19T09:06:29.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.212+0000 7fccf8ff9640 1 -- 172.21.15.92:0/3715706369 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd08004050 con 0x555d06b95080 2024-09-19T09:06:29.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.212+0000 7fccf8ff9640 1 -- 172.21.15.92:0/3715706369 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fcd0001c420 con 0x555d06b95080 2024-09-19T09:06:29.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.212+0000 7fcd19983740 10 client.17727 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:29.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.212+0000 7fcd19983740 10 client.17727 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:06:29.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.212+0000 7fcd19983740 20 client.17727 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:29.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.212+0000 7fcd19983740 1 --2- 172.21.15.92:0/3715706369 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555d06baf880 0x555d06bb1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:29.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.212+0000 7fcd19983740 4 client.17727 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:06:29.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.212+0000 7fcd19983740 1 -- 172.21.15.92:0/3715706369 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d06b079d0 con 0x555d06baf880 2024-09-19T09:06:29.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.212+0000 7fcd15b47640 1 --2- 172.21.15.92:0/3715706369 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555d06baf880 0x555d06bb1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:29.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.213+0000 7fcd15b47640 1 --2- 172.21.15.92:0/3715706369 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555d06baf880 0x555d06bb1cc0 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41ea8d3a1412cafa server_cookie=ea4794a6d9c62fb9 in_seq=0 out_seq=0 2024-09-19T09:06:29.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.213+0000 7fccf8ff9640 10 client.17727 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:29.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.214+0000 7fccf8ff9640 1 -- 172.21.15.92:0/3715706369 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555d06b079d0 con 0x555d06baf880 2024-09-19T09:06:29.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.214+0000 7fccf8ff9640 10 client.17727 handle_command_reply: tid=0 2024-09-19T09:06:29.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.214+0000 7fcd19983740 1 client.17727 shutdown 2024-09-19T09:06:29.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.214+0000 7fcd19983740 1 -- 172.21.15.92:0/3715706369 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d06b95080 msgr2=0x555d06b9cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:29.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.214+0000 7fcd19983740 1 --2- 172.21.15.92:0/3715706369 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d06b95080 0x555d06b9cd00 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fcd00012730 tx=0x7fcd00012bf0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.215+0000 7fcd19983740 1 -- 172.21.15.92:0/3715706369 shutdown_connections 2024-09-19T09:06:29.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.215+0000 7fcd19983740 1 --2- 172.21.15.92:0/3715706369 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555d06baf880 0x555d06bb1cc0 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.215+0000 7fcd19983740 1 --2- 172.21.15.92:0/3715706369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d06b9f940 0x555d06b9d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.215+0000 7fccf8ff9640 0 client.17727 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:29.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.215+0000 7fcd19983740 1 --2- 172.21.15.92:0/3715706369 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d06b95080 0x555d06b9cd00 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.215+0000 7fcd19983740 1 --2- 172.21.15.92:0/3715706369 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d06b94760 0x555d06b9c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.215+0000 7fcd19983740 1 -- 172.21.15.92:0/3715706369 >> 172.21.15.92:0/3715706369 conn(0x555d06b90cf0 msgr2=0x555d06b969d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:29.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.215+0000 7fcd19983740 1 -- 172.21.15.92:0/3715706369 shutdown_connections 2024-09-19T09:06:29.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.216+0000 7fcd19983740 1 -- 172.21.15.92:0/3715706369 wait complete. 2024-09-19T09:06:29.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.216+0000 7fcd19983740 20 client.17727 trim_cache size 0 max 16384 2024-09-19T09:06:29.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.241+0000 7fcd19983740 1 Processor -- start 2024-09-19T09:06:29.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.242+0000 7fcd19983740 1 -- start start 2024-09-19T09:06:29.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.243+0000 7fcd19983740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d06b94760 0x555d06b9d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:29.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.243+0000 7fcd19983740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d06b95080 0x555d06bb7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:29.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.243+0000 7fcd19983740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d06b9f940 0x555d06bb7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:29.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.243+0000 7fcd19983740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcd101b1bd0 con 0x555d06b94760 2024-09-19T09:06:29.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.243+0000 7fcd19983740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcd101b4470 con 0x555d06b95080 2024-09-19T09:06:29.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.243+0000 7fcd19983740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fcd101b2260 con 0x555d06b9f940 2024-09-19T09:06:29.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.243+0000 7fcd15b47640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d06b94760 0x555d06b9d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:29.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.243+0000 7fcd15b47640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d06b94760 0x555d06b9d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58206/0 (socket says 172.21.15.92:58206) 2024-09-19T09:06:29.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.243+0000 7fcd15b47640 1 -- 172.21.15.92:0/1645003518 learned_addr learned my addr 172.21.15.92:0/1645003518 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:29.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.243+0000 7fcd15b47640 1 --2- 172.21.15.92:0/1645003518 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d06b9f940 0x555d06bb7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:29.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.246+0000 7fcd14b45640 1 --2- 172.21.15.92:0/1645003518 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d06b95080 0x555d06bb7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:29.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.246+0000 7fcd14b45640 1 -- 172.21.15.92:0/1645003518 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d06b9f940 msgr2=0x555d06bb7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:29.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.246+0000 7fcd14b45640 1 --2- 172.21.15.92:0/1645003518 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d06b9f940 0x555d06bb7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.246+0000 7fcd14b45640 1 -- 172.21.15.92:0/1645003518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d06b94760 msgr2=0x555d06b9d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:29.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.246+0000 7fcd14b45640 1 --2- 172.21.15.92:0/1645003518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d06b94760 0x555d06b9d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.247+0000 7fcd14b45640 1 -- 172.21.15.92:0/1645003518 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d06b90b20 con 0x555d06b95080 2024-09-19T09:06:29.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.253+0000 7fcd14b45640 1 --2- 172.21.15.92:0/1645003518 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d06b95080 0x555d06bb7590 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fcd00000c00 tx=0x7fcd00009ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ba21e5ef268c90d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:29.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.254+0000 7fccfaffd640 1 -- 172.21.15.92:0/1645003518 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0001cab0 con 0x555d06b95080 2024-09-19T09:06:29.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.254+0000 7fccfaffd640 1 -- 172.21.15.92:0/1645003518 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd0002b020 con 0x555d06b95080 2024-09-19T09:06:29.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.255+0000 7fcd19983740 1 -- 172.21.15.92:0/1645003518 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d06b95080 msgr2=0x555d06bb7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:29.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.255+0000 7fcd19983740 1 --2- 172.21.15.92:0/1645003518 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d06b95080 0x555d06bb7590 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fcd00000c00 tx=0x7fcd00009ed0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.255+0000 7fcd19983740 1 -- 172.21.15.92:0/1645003518 shutdown_connections 2024-09-19T09:06:29.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.255+0000 7fcd19983740 1 --2- 172.21.15.92:0/1645003518 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d06b9f940 0x555d06bb7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.255+0000 7fcd19983740 1 --2- 172.21.15.92:0/1645003518 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d06b95080 0x555d06bb7590 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.255+0000 7fcd19983740 1 --2- 172.21.15.92:0/1645003518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d06b94760 0x555d06b9d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.255+0000 7fcd19983740 1 -- 172.21.15.92:0/1645003518 >> 172.21.15.92:0/1645003518 conn(0x555d06b90cf0 msgr2=0x555d06b9b780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:29.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.257+0000 7fcd19983740 1 -- 172.21.15.92:0/1645003518 shutdown_connections 2024-09-19T09:06:29.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.257+0000 7fcd19983740 1 -- 172.21.15.92:0/1645003518 wait complete. 2024-09-19T09:06:29.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.257+0000 7fcd19983740 1 -- start start 2024-09-19T09:06:29.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.257+0000 7fcd19983740 1 Processor -- start 2024-09-19T09:06:29.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.258+0000 7fcd19983740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d06b94760 0x555d06ba7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:29.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.258+0000 7fcd19983740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d06b95080 0x555d06ba8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:29.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.258+0000 7fcd19983740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d06b9f940 0x555d06ba48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:29.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.258+0000 7fcd19983740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcd101b2930 con 0x555d06b9f940 2024-09-19T09:06:29.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.258+0000 7fcd19983740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcd101b3da0 con 0x555d06b94760 2024-09-19T09:06:29.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.258+0000 7fcd19983740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fcd101b3000 con 0x555d06b95080 2024-09-19T09:06:29.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.258+0000 7fcd19983740 10 client.0 _ll_register_callbacks cb 0x7fcd00009e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:29.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.259+0000 7fcd15b47640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d06b94760 0x555d06ba7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:29.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.259+0000 7fcd15b47640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d06b94760 0x555d06ba7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:52482/0 (socket says 172.21.15.92:52482) 2024-09-19T09:06:29.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.259+0000 7fcd15b47640 1 -- 172.21.15.92:0/4216663979 learned_addr learned my addr 172.21.15.92:0/4216663979 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:29.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.259+0000 7fcd15b47640 1 --2- 172.21.15.92:0/4216663979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d06b9f940 0x555d06ba48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:29.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.259+0000 7fcd15b47640 1 -- 172.21.15.92:0/4216663979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d06b95080 msgr2=0x555d06ba8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:29.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.259+0000 7fcd14b45640 1 --2- 172.21.15.92:0/4216663979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d06b95080 0x555d06ba8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:29.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.259+0000 7fcd15b47640 1 --2- 172.21.15.92:0/4216663979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d06b95080 0x555d06ba8030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.259+0000 7fcd15b47640 1 -- 172.21.15.92:0/4216663979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d06b9f940 msgr2=0x555d06ba48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:29.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.259+0000 7fcd15b47640 1 --2- 172.21.15.92:0/4216663979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d06b9f940 0x555d06ba48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.259+0000 7fcd15b47640 1 -- 172.21.15.92:0/4216663979 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d06b975d0 con 0x555d06b94760 2024-09-19T09:06:29.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.260+0000 7fcd15b47640 1 --2- 172.21.15.92:0/4216663979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d06b94760 0x555d06ba7af0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcd080094d0 tx=0x7fcd0802d040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df7a667dbbd79025 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:29.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.260+0000 7fccf8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:06:29.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.261+0000 7fccf8ff9640 1 -- 172.21.15.92:0/4216663979 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd08028450 con 0x555d06b94760 2024-09-19T09:06:29.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.261+0000 7fcd19983740 1 -- 172.21.15.92:0/4216663979 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555d06b01d20 con 0x555d06b94760 2024-09-19T09:06:29.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.261+0000 7fccf8ff9640 1 -- 172.21.15.92:0/4216663979 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcd080285f0 con 0x555d06b94760 2024-09-19T09:06:29.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.261+0000 7fccf8ff9640 1 -- 172.21.15.92:0/4216663979 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fcd080287f0 con 0x555d06b94760 2024-09-19T09:06:29.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.262+0000 7fcd19983740 10 client.27059 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:29.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.262+0000 7fcd19983740 1 -- 172.21.15.92:0/4216663979 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x555d06c2bf30 con 0x555d06b94760 2024-09-19T09:06:29.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.262+0000 7fccf8ff9640 1 -- 172.21.15.92:0/4216663979 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x555d06b01d20 con 0x555d06b94760 2024-09-19T09:06:29.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.262+0000 7fccf8ff9640 1 -- 172.21.15.92:0/4216663979 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fcd08038020 con 0x555d06b94760 2024-09-19T09:06:29.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.263+0000 7fcd19983740 10 client.27059 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:29.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.263+0000 7fcd19983740 10 client.27059 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:06:29.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.263+0000 7fcd19983740 20 client.27059 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:29.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.263+0000 7fcd19983740 1 --2- 172.21.15.92:0/4216663979 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555d06baf880 0x555d06c2e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:29.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.263+0000 7fcd19983740 4 client.27059 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-09-19T09:06:29.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.263+0000 7fcd19983740 1 -- 172.21.15.92:0/4216663979 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x555d06a7dec0 con 0x555d06baf880 2024-09-19T09:06:29.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.268+0000 7fcd14b45640 1 --2- 172.21.15.92:0/4216663979 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555d06baf880 0x555d06c2e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:29.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.270+0000 7fcd14b45640 1 --2- 172.21.15.92:0/4216663979 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555d06baf880 0x555d06c2e690 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=316d7bd2d00379fe server_cookie=e776555575e32ac6 in_seq=0 out_seq=0 2024-09-19T09:06:29.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.270+0000 7fccf8ff9640 10 client.27059 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:29.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.508+0000 7fccf8ff9640 1 -- 172.21.15.92:0/4216663979 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x555d06a7dec0 con 0x555d06baf880 2024-09-19T09:06:29.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.508+0000 7fccf8ff9640 10 client.27059 handle_command_reply: tid=0 2024-09-19T09:06:29.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.508+0000 7fcd19983740 1 client.27059 shutdown 2024-09-19T09:06:29.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.508+0000 7fcd19983740 1 -- 172.21.15.92:0/4216663979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d06b94760 msgr2=0x555d06ba7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:29.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.508+0000 7fcd19983740 1 --2- 172.21.15.92:0/4216663979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d06b94760 0x555d06ba7af0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcd080094d0 tx=0x7fcd0802d040 comp rx=0 tx=0).stop 2024-09-19T09:06:29.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.508+0000 7fcd19983740 1 -- 172.21.15.92:0/4216663979 shutdown_connections 2024-09-19T09:06:29.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.508+0000 7fcd19983740 1 --2- 172.21.15.92:0/4216663979 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555d06baf880 0x555d06c2e690 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.509+0000 7fcd19983740 1 --2- 172.21.15.92:0/4216663979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d06b9f940 0x555d06ba48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.509+0000 7fcd19983740 1 --2- 172.21.15.92:0/4216663979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555d06b95080 0x555d06ba8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.509+0000 7fcd19983740 1 --2- 172.21.15.92:0/4216663979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d06b94760 0x555d06ba7af0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.509+0000 7fcd19983740 1 -- 172.21.15.92:0/4216663979 >> 172.21.15.92:0/4216663979 conn(0x555d06b90cf0 msgr2=0x555d06b8f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:29.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.509+0000 7fccf8ff9640 0 client.27059 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:29.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.509+0000 7fcd19983740 1 -- 172.21.15.92:0/4216663979 shutdown_connections 2024-09-19T09:06:29.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.509+0000 7fcd19983740 1 -- 172.21.15.92:0/4216663979 wait complete. 2024-09-19T09:06:29.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.509+0000 7fcd19983740 20 client.27059 trim_cache size 0 max 16384 2024-09-19T09:06:29.512 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:06:29.512 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 19, 2024-09-19T09:06:29.512 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24472, 2024-09-19T09:06:29.512 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 38, 2024-09-19T09:06:29.512 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-09-19T09:06:29.512 INFO:teuthology.orchestra.run.smithi092.stdout: "9658154d": { 2024-09-19T09:06:29.512 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 38, 2024-09-19T09:06:29.512 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-09-19T09:06:29.512 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:06:29.512 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-09-19T09:06:29.513 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:06:29.513 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:06:29.513 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 90.0, 2024-09-19T09:06:29.513 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 150.0, 2024-09-19T09:06:29.513 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-09-19T09:06:29.513 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-09-19T09:06:29.513 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-09-19T09:06:29.513 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:06:29.513 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-09-19T09:06:29.513 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:06:29.513 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:06:29.513 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:06:29.513 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:06:29.513 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:06:29.514 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:06:29.514 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:06:29.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.509+0000 7fcd175aa640 1 -- 172.21.15.92:0/324810691 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fccfc0a3240 msgr2=0x7fccfc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:29.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.509+0000 7fcd175aa640 1 --2- 172.21.15.92:0/324810691 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fccfc0a3240 0x7fccfc0a5700 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c032c00 tx=0x7fcd0c043f20 comp rx=0 tx=0).stop 2024-09-19T09:06:29.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.509+0000 7fcd175aa640 1 -- 172.21.15.92:0/324810691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd10074590 msgr2=0x7fcd101a4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:29.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.509+0000 7fcd175aa640 1 --2- 172.21.15.92:0/324810691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd10074590 0x7fcd101a4720 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c006010 tx=0x7fcd0c004040 comp rx=0 tx=0).stop 2024-09-19T09:06:29.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.509+0000 7fcd175aa640 1 -- 172.21.15.92:0/324810691 shutdown_connections 2024-09-19T09:06:29.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.509+0000 7fcd175aa640 1 --2- 172.21.15.92:0/324810691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd10112b90 0x7fcd1019e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.509+0000 7fcd175aa640 1 --2- 172.21.15.92:0/324810691 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd10074eb0 0x7fcd101a4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.509+0000 7fcd175aa640 1 --2- 172.21.15.92:0/324810691 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fccfc0a3240 0x7fccfc0a5700 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.509+0000 7fcd175aa640 1 --2- 172.21.15.92:0/324810691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd10074590 0x7fcd101a4720 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.509+0000 7fcd175aa640 1 -- 172.21.15.92:0/324810691 >> 172.21.15.92:0/324810691 conn(0x7fcd100fd880 msgr2=0x7fcd100ff450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:29.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.510+0000 7fcd175aa640 1 -- 172.21.15.92:0/324810691 shutdown_connections 2024-09-19T09:06:29.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:29.510+0000 7fcd175aa640 1 -- 172.21.15.92:0/324810691 wait complete. 2024-09-19T09:06:29.836 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:29 smithi092 ceph-mon[31407]: pgmap v630: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 812 KiB/s wr, 54 op/s 2024-09-19T09:06:29.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:29 smithi167 ceph-mon[35359]: pgmap v630: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 812 KiB/s wr, 54 op/s 2024-09-19T09:06:29.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:29 smithi190 ceph-mon[35358]: pgmap v630: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 812 KiB/s wr, 54 op/s 2024-09-19T09:06:30.283 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '9658154d', quiesce took 4.1 seconds. Will release after: 25.9 2024-09-19T09:06:30.796 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 585.0 s, 1835.0 tps, lat 38.169 ms stddev 45.111 2024-09-19T09:06:31.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:31 smithi167 ceph-mon[35359]: pgmap v631: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.5 MiB/s wr, 195 op/s 2024-09-19T09:06:31.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:31 smithi190 ceph-mon[35358]: pgmap v631: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.5 MiB/s wr, 195 op/s 2024-09-19T09:06:32.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:31 smithi092 ceph-mon[31407]: pgmap v631: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.5 MiB/s wr, 195 op/s 2024-09-19T09:06:33.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:33 smithi167 ceph-mon[35359]: pgmap v632: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.2 MiB/s wr, 250 op/s 2024-09-19T09:06:33.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:33 smithi190 ceph-mon[35358]: pgmap v632: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.2 MiB/s wr, 250 op/s 2024-09-19T09:06:34.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:33 smithi092 ceph-mon[31407]: pgmap v632: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.2 MiB/s wr, 250 op/s 2024-09-19T09:06:35.799 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:06:35.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:35 smithi167 ceph-mon[35359]: pgmap v633: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.0 MiB/s wr, 318 op/s 2024-09-19T09:06:35.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:35 smithi190 ceph-mon[35358]: pgmap v633: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.0 MiB/s wr, 318 op/s 2024-09-19T09:06:36.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:35 smithi092 ceph-mon[31407]: pgmap v633: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.0 MiB/s wr, 318 op/s 2024-09-19T09:06:37.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:37 smithi167 ceph-mon[35359]: pgmap v634: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.3 MiB/s wr, 339 op/s 2024-09-19T09:06:37.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:37 smithi190 ceph-mon[35358]: pgmap v634: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.3 MiB/s wr, 339 op/s 2024-09-19T09:06:38.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:37 smithi092 ceph-mon[31407]: pgmap v634: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.3 MiB/s wr, 339 op/s 2024-09-19T09:06:38.677 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.663+0000 7f8693ea6640 1 -- 172.21.15.92:0/83334611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f868c1025f0 msgr2=0x7f868c108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:38.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.663+0000 7f8693ea6640 1 --2- 172.21.15.92:0/83334611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f868c1025f0 0x7f868c108e80 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f8684009900 tx=0x7f868402a410 comp rx=0 tx=0).stop 2024-09-19T09:06:38.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.663+0000 7f8693ea6640 1 -- 172.21.15.92:0/83334611 shutdown_connections 2024-09-19T09:06:38.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.663+0000 7f8693ea6640 1 --2- 172.21.15.92:0/83334611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f868c1025f0 0x7f868c108e80 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:38.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.663+0000 7f8693ea6640 1 --2- 172.21.15.92:0/83334611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f868c101c30 0x7f868c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:38.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.663+0000 7f8693ea6640 1 --2- 172.21.15.92:0/83334611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f868c100a40 0x7f868c100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:38.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.663+0000 7f8693ea6640 1 -- 172.21.15.92:0/83334611 >> 172.21.15.92:0/83334611 conn(0x7f868c0fc1e0 msgr2=0x7f868c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:38.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.663+0000 7f8693ea6640 1 -- 172.21.15.92:0/83334611 shutdown_connections 2024-09-19T09:06:38.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.663+0000 7f8693ea6640 1 -- 172.21.15.92:0/83334611 wait complete. 2024-09-19T09:06:38.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.663+0000 7f8693ea6640 1 Processor -- start 2024-09-19T09:06:38.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.663+0000 7f8693ea6640 1 -- start start 2024-09-19T09:06:38.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.664+0000 7f8693ea6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f868c100a40 0x7f868c197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:38.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.664+0000 7f8693ea6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f868c101c30 0x7f868c1982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:38.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.664+0000 7f8693ea6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f868c1025f0 0x7f868c19f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:38.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.664+0000 7f8693ea6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f868c10d870 con 0x7f868c100a40 2024-09-19T09:06:38.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.664+0000 7f8693ea6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f868c10d6f0 con 0x7f868c101c30 2024-09-19T09:06:38.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.664+0000 7f8693ea6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f868c10d9f0 con 0x7f868c1025f0 2024-09-19T09:06:38.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.664+0000 7f8691c42640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f868c100a40 0x7f868c197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:38.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.664+0000 7f8691c42640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f868c100a40 0x7f868c197da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38732/0 (socket says 172.21.15.92:38732) 2024-09-19T09:06:38.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.664+0000 7f8691c42640 1 -- 172.21.15.92:0/1657392614 learned_addr learned my addr 172.21.15.92:0/1657392614 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:38.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.664+0000 7f8691441640 1 --2- 172.21.15.92:0/1657392614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f868c101c30 0x7f868c1982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:38.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.664+0000 7f8692443640 1 --2- 172.21.15.92:0/1657392614 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f868c1025f0 0x7f868c19f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:38.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.664+0000 7f8691c42640 1 -- 172.21.15.92:0/1657392614 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f868c1025f0 msgr2=0x7f868c19f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:38.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.664+0000 7f8691c42640 1 --2- 172.21.15.92:0/1657392614 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f868c1025f0 0x7f868c19f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:38.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.664+0000 7f8691c42640 1 -- 172.21.15.92:0/1657392614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f868c101c30 msgr2=0x7f868c1982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:38.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.664+0000 7f8691c42640 1 --2- 172.21.15.92:0/1657392614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f868c101c30 0x7f868c1982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:38.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.664+0000 7f8691c42640 1 -- 172.21.15.92:0/1657392614 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f868c19f9b0 con 0x7f868c100a40 2024-09-19T09:06:38.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.664+0000 7f8691c42640 1 --2- 172.21.15.92:0/1657392614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f868c100a40 0x7f868c197da0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f867c00ea80 tx=0x7f867c00ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:38.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.664+0000 7f868affd640 1 -- 172.21.15.92:0/1657392614 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f867c00ce40 con 0x7f868c100a40 2024-09-19T09:06:38.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.664+0000 7f868affd640 1 -- 172.21.15.92:0/1657392614 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f867c011950 con 0x7f868c100a40 2024-09-19T09:06:38.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.664+0000 7f8693ea6640 1 -- 172.21.15.92:0/1657392614 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f868c19fca0 con 0x7f868c100a40 2024-09-19T09:06:38.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.664+0000 7f868affd640 1 -- 172.21.15.92:0/1657392614 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f867c01ab80 con 0x7f868c100a40 2024-09-19T09:06:38.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.664+0000 7f8693ea6640 1 -- 172.21.15.92:0/1657392614 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f868c1a0190 con 0x7f868c100a40 2024-09-19T09:06:38.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.667+0000 7f868affd640 1 -- 172.21.15.92:0/1657392614 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f867c011b00 con 0x7f868c100a40 2024-09-19T09:06:38.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.667+0000 7f8696c38740 1 Processor -- start 2024-09-19T09:06:38.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.667+0000 7f8696c38740 1 -- start start 2024-09-19T09:06:38.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.667+0000 7f8696c38740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a2a3229a0 0x562a2a322da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:38.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.667+0000 7f8696c38740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a2a3232e0 0x562a2a327da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:38.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.667+0000 7f8696c38740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a2a328370 0x562a2a32a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:38.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.667+0000 7f868affd640 1 --2- 172.21.15.92:0/1657392614 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f86740a3370 0x7f86740a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:38.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.667+0000 7f8696c38740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562a2a2862f0 con 0x562a2a3229a0 2024-09-19T09:06:38.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.667+0000 7f8696c38740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x562a2a22e270 con 0x562a2a3232e0 2024-09-19T09:06:38.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.667+0000 7f8696c38740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x562a2a2822b0 con 0x562a2a328370 2024-09-19T09:06:38.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.668+0000 7f8692443640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a2a3229a0 0x562a2a322da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:38.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.668+0000 7f8691441640 1 --2- 172.21.15.92:0/1657392614 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f86740a3370 0x7f86740a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:38.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.668+0000 7f8692443640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a2a3229a0 0x562a2a322da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38746/0 (socket says 172.21.15.92:38746) 2024-09-19T09:06:38.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.668+0000 7f8692443640 1 -- 172.21.15.92:0/3763644265 learned_addr learned my addr 172.21.15.92:0/3763644265 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:38.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.668+0000 7f868affd640 1 -- 172.21.15.92:0/1657392614 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f867c0cff80 con 0x7f868c100a40 2024-09-19T09:06:38.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.668+0000 7f8692443640 1 --2- 172.21.15.92:0/3763644265 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a2a328370 0x562a2a32a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:38.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.668+0000 7f8691c42640 1 --2- 172.21.15.92:0/3763644265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a2a3232e0 0x562a2a327da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:38.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.668+0000 7f8692443640 1 -- 172.21.15.92:0/3763644265 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a2a328370 msgr2=0x562a2a32a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:38.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.668+0000 7f8692443640 1 --2- 172.21.15.92:0/3763644265 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a2a328370 0x562a2a32a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:38.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.668+0000 7f8692443640 1 -- 172.21.15.92:0/3763644265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a2a3232e0 msgr2=0x562a2a327da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:38.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.668+0000 7f8692443640 1 --2- 172.21.15.92:0/3763644265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a2a3232e0 0x562a2a327da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:38.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.668+0000 7f8692443640 1 -- 172.21.15.92:0/3763644265 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a2a22d340 con 0x562a2a3229a0 2024-09-19T09:06:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.668+0000 7f8691441640 1 --2- 172.21.15.92:0/1657392614 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f86740a3370 0x7f86740a5830 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f8680005fd0 tx=0x7f868000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.668+0000 7f8692443640 1 --2- 172.21.15.92:0/3763644265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a2a3229a0 0x562a2a322da0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f86840096c0 tx=0x7f8684005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f41eea6262e3f49 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.668+0000 7f8673fff640 1 -- 172.21.15.92:0/3763644265 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8684035050 con 0x562a2a3229a0 2024-09-19T09:06:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.668+0000 7f8673fff640 1 -- 172.21.15.92:0/3763644265 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86840040c0 con 0x562a2a3229a0 2024-09-19T09:06:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.668+0000 7f8673fff640 1 -- 172.21.15.92:0/3763644265 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8684004920 con 0x562a2a3229a0 2024-09-19T09:06:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.669+0000 7f8696c38740 1 -- 172.21.15.92:0/3763644265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a2a3229a0 msgr2=0x562a2a322da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.669+0000 7f8696c38740 1 --2- 172.21.15.92:0/3763644265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a2a3229a0 0x562a2a322da0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f86840096c0 tx=0x7f8684005b50 comp rx=0 tx=0).stop 2024-09-19T09:06:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.669+0000 7f8696c38740 1 -- 172.21.15.92:0/3763644265 shutdown_connections 2024-09-19T09:06:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.669+0000 7f8696c38740 1 --2- 172.21.15.92:0/3763644265 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a2a328370 0x562a2a32a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.669+0000 7f8696c38740 1 --2- 172.21.15.92:0/3763644265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a2a3232e0 0x562a2a327da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.669+0000 7f8696c38740 1 --2- 172.21.15.92:0/3763644265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a2a3229a0 0x562a2a322da0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.669+0000 7f8696c38740 1 -- 172.21.15.92:0/3763644265 >> 172.21.15.92:0/3763644265 conn(0x562a2a31e010 msgr2=0x562a2a31e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.669+0000 7f8696c38740 1 -- 172.21.15.92:0/3763644265 shutdown_connections 2024-09-19T09:06:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.669+0000 7f8696c38740 1 -- 172.21.15.92:0/3763644265 wait complete. 2024-09-19T09:06:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.670+0000 7f8696c38740 1 -- start start 2024-09-19T09:06:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.670+0000 7f8696c38740 1 Processor -- start 2024-09-19T09:06:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.670+0000 7f8696c38740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a2a3229a0 0x562a2a32cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.670+0000 7f8696c38740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a2a3232e0 0x562a2a32d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.670+0000 7f8696c38740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a2a328370 0x562a2a3340e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.670+0000 7f8696c38740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562a2a32b2e0 con 0x562a2a3232e0 2024-09-19T09:06:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.670+0000 7f8696c38740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x562a2a20f290 con 0x562a2a3229a0 2024-09-19T09:06:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.670+0000 7f8696c38740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x562a2a32b460 con 0x562a2a328370 2024-09-19T09:06:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.670+0000 7f8696c38740 10 client.0 _ll_register_callbacks cb 0x562a2a240140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:38.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.670+0000 7f8691441640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a2a3232e0 0x562a2a32d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:38.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.670+0000 7f8691441640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a2a3232e0 0x562a2a32d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38750/0 (socket says 172.21.15.92:38750) 2024-09-19T09:06:38.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.670+0000 7f8691441640 1 -- 172.21.15.92:0/463852291 learned_addr learned my addr 172.21.15.92:0/463852291 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:38.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.670+0000 7f8691c42640 1 --2- 172.21.15.92:0/463852291 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a2a3229a0 0x562a2a32cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:38.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.670+0000 7f8692443640 1 --2- 172.21.15.92:0/463852291 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a2a328370 0x562a2a3340e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:38.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.670+0000 7f8691441640 1 -- 172.21.15.92:0/463852291 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a2a328370 msgr2=0x562a2a3340e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:38.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.671+0000 7f8691441640 1 --2- 172.21.15.92:0/463852291 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a2a328370 0x562a2a3340e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:38.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.671+0000 7f8691441640 1 -- 172.21.15.92:0/463852291 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a2a3229a0 msgr2=0x562a2a32cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:38.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.671+0000 7f8691441640 1 --2- 172.21.15.92:0/463852291 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a2a3229a0 0x562a2a32cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:38.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.671+0000 7f8691441640 1 -- 172.21.15.92:0/463852291 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a29f99210 con 0x562a2a3232e0 2024-09-19T09:06:38.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.671+0000 7f8691c42640 1 --2- 172.21.15.92:0/463852291 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a2a3229a0 0x562a2a32cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:06:38.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.671+0000 7f8691441640 1 --2- 172.21.15.92:0/463852291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a2a3232e0 0x562a2a32d0a0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f8680003e60 tx=0x7f8680004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a7ad47f826ba70 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.671+0000 7f86717fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:06:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.671+0000 7f86717fa640 1 -- 172.21.15.92:0/463852291 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8680005220 con 0x562a2a3232e0 2024-09-19T09:06:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.671+0000 7f86717fa640 1 -- 172.21.15.92:0/463852291 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f86800053c0 con 0x562a2a3232e0 2024-09-19T09:06:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.671+0000 7f8696c38740 1 -- 172.21.15.92:0/463852291 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86840040c0 con 0x562a2a3232e0 2024-09-19T09:06:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.671+0000 7f86717fa640 1 -- 172.21.15.92:0/463852291 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f86800055c0 con 0x562a2a3232e0 2024-09-19T09:06:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.671+0000 7f8696c38740 10 client.17745 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.671+0000 7f8696c38740 1 -- 172.21.15.92:0/463852291 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x562a2a065620 con 0x562a2a3232e0 2024-09-19T09:06:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.671+0000 7f86717fa640 1 -- 172.21.15.92:0/463852291 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86840040c0 con 0x562a2a3232e0 2024-09-19T09:06:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.671+0000 7f86717fa640 1 -- 172.21.15.92:0/463852291 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f868001e980 con 0x562a2a3232e0 2024-09-19T09:06:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.672+0000 7f8696c38740 10 client.17745 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.672+0000 7f8696c38740 10 client.17745 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:06:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.672+0000 7f8696c38740 20 client.17745 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.672+0000 7f8696c38740 1 --2- 172.21.15.92:0/463852291 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562a2a338850 0x562a2a33acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.672+0000 7f8696c38740 4 client.17745 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:06:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.672+0000 7f8696c38740 1 -- 172.21.15.92:0/463852291 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a2a293a20 con 0x562a2a338850 2024-09-19T09:06:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.672+0000 7f8691c42640 1 --2- 172.21.15.92:0/463852291 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562a2a338850 0x562a2a33acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.672+0000 7f8691c42640 1 --2- 172.21.15.92:0/463852291 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562a2a338850 0x562a2a33acc0 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c74bd31268f0d7c4 server_cookie=879961e1af6f0651 in_seq=0 out_seq=0 2024-09-19T09:06:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.672+0000 7f86717fa640 10 client.17745 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.673+0000 7f86717fa640 1 -- 172.21.15.92:0/463852291 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562a2a293a20 con 0x562a2a338850 2024-09-19T09:06:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.673+0000 7f86717fa640 10 client.17745 handle_command_reply: tid=0 2024-09-19T09:06:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.673+0000 7f8696c38740 1 client.17745 shutdown 2024-09-19T09:06:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.673+0000 7f8696c38740 1 -- 172.21.15.92:0/463852291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a2a3232e0 msgr2=0x562a2a32d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.673+0000 7f8696c38740 1 --2- 172.21.15.92:0/463852291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a2a3232e0 0x562a2a32d0a0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f8680003e60 tx=0x7f8680004730 comp rx=0 tx=0).stop 2024-09-19T09:06:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.673+0000 7f8696c38740 1 -- 172.21.15.92:0/463852291 shutdown_connections 2024-09-19T09:06:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.673+0000 7f8696c38740 1 --2- 172.21.15.92:0/463852291 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562a2a338850 0x562a2a33acc0 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.673+0000 7f8696c38740 1 --2- 172.21.15.92:0/463852291 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a2a328370 0x562a2a3340e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:38.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.673+0000 7f8696c38740 1 --2- 172.21.15.92:0/463852291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a2a3232e0 0x562a2a32d0a0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:38.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.673+0000 7f8696c38740 1 --2- 172.21.15.92:0/463852291 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a2a3229a0 0x562a2a32cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:38.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.673+0000 7f86717fa640 0 client.17745 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:38.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.673+0000 7f8696c38740 1 -- 172.21.15.92:0/463852291 >> 172.21.15.92:0/463852291 conn(0x562a2a31e010 msgr2=0x562a2a31f820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:38.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.673+0000 7f8696c38740 1 -- 172.21.15.92:0/463852291 shutdown_connections 2024-09-19T09:06:38.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.673+0000 7f8696c38740 1 -- 172.21.15.92:0/463852291 wait complete. 2024-09-19T09:06:38.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.673+0000 7f8696c38740 20 client.17745 trim_cache size 0 max 16384 2024-09-19T09:06:38.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.688+0000 7f8696c38740 1 Processor -- start 2024-09-19T09:06:38.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.688+0000 7f8696c38740 1 -- start start 2024-09-19T09:06:38.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.688+0000 7f8696c38740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a2a3229a0 0x562a2a31f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:38.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.688+0000 7f8696c38740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a2a3232e0 0x562a2a3340a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:38.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.688+0000 7f8696c38740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a2a328370 0x562a2a31f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:38.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.688+0000 7f8696c38740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f868c1a6f60 con 0x562a2a328370 2024-09-19T09:06:38.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.688+0000 7f8696c38740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f868c1a9800 con 0x562a2a3229a0 2024-09-19T09:06:38.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.688+0000 7f8696c38740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f868c1a75f0 con 0x562a2a3232e0 2024-09-19T09:06:38.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.688+0000 7f8692443640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a2a328370 0x562a2a31f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:38.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.688+0000 7f8691c42640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a2a3229a0 0x562a2a31f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:38.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.688+0000 7f8692443640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a2a328370 0x562a2a31f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38762/0 (socket says 172.21.15.92:38762) 2024-09-19T09:06:38.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.688+0000 7f8692443640 1 -- 172.21.15.92:0/506604475 learned_addr learned my addr 172.21.15.92:0/506604475 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:38.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.688+0000 7f8691441640 1 --2- 172.21.15.92:0/506604475 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a2a3232e0 0x562a2a3340a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:38.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.688+0000 7f8692443640 1 -- 172.21.15.92:0/506604475 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a2a3232e0 msgr2=0x562a2a3340a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:38.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.688+0000 7f8692443640 1 --2- 172.21.15.92:0/506604475 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a2a3232e0 0x562a2a3340a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:38.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.688+0000 7f8692443640 1 -- 172.21.15.92:0/506604475 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a2a3229a0 msgr2=0x562a2a31f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:38.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.688+0000 7f8692443640 1 --2- 172.21.15.92:0/506604475 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a2a3229a0 0x562a2a31f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:38.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.688+0000 7f8692443640 1 -- 172.21.15.92:0/506604475 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a2a3237c0 con 0x562a2a328370 2024-09-19T09:06:38.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.689+0000 7f8692443640 1 --2- 172.21.15.92:0/506604475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a2a328370 0x562a2a31f940 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f868402a930 tx=0x7f8684000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=291abd2f908aabb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:38.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.689+0000 7f86737fe640 1 -- 172.21.15.92:0/506604475 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868404d020 con 0x562a2a328370 2024-09-19T09:06:38.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.689+0000 7f86737fe640 1 -- 172.21.15.92:0/506604475 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86840055d0 con 0x562a2a328370 2024-09-19T09:06:38.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.689+0000 7f86737fe640 1 -- 172.21.15.92:0/506604475 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8684035040 con 0x562a2a328370 2024-09-19T09:06:38.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.689+0000 7f8696c38740 1 -- 172.21.15.92:0/506604475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a2a328370 msgr2=0x562a2a31f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:38.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.689+0000 7f8696c38740 1 --2- 172.21.15.92:0/506604475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a2a328370 0x562a2a31f940 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f868402a930 tx=0x7f8684000bc0 comp rx=0 tx=0).stop 2024-09-19T09:06:38.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.689+0000 7f8696c38740 1 -- 172.21.15.92:0/506604475 shutdown_connections 2024-09-19T09:06:38.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.689+0000 7f8696c38740 1 --2- 172.21.15.92:0/506604475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a2a328370 0x562a2a31f940 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:38.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.689+0000 7f8696c38740 1 --2- 172.21.15.92:0/506604475 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a2a3232e0 0x562a2a3340a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:38.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.689+0000 7f8696c38740 1 --2- 172.21.15.92:0/506604475 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a2a3229a0 0x562a2a31f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:38.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.689+0000 7f8696c38740 1 -- 172.21.15.92:0/506604475 >> 172.21.15.92:0/506604475 conn(0x562a2a31e010 msgr2=0x562a2a31d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:38.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.689+0000 7f8696c38740 1 -- 172.21.15.92:0/506604475 shutdown_connections 2024-09-19T09:06:38.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.689+0000 7f8696c38740 1 -- 172.21.15.92:0/506604475 wait complete. 2024-09-19T09:06:38.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.690+0000 7f8696c38740 1 -- start start 2024-09-19T09:06:38.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.690+0000 7f8696c38740 1 Processor -- start 2024-09-19T09:06:38.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.690+0000 7f8696c38740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a2a3229a0 0x562a2a331900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:38.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.690+0000 7f8696c38740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a2a3232e0 0x562a2a331e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:38.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.690+0000 7f8696c38740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a2a328370 0x562a2a332e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:38.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.690+0000 7f8696c38740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f868c1a7cc0 con 0x562a2a328370 2024-09-19T09:06:38.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.690+0000 7f8696c38740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f868c1a9130 con 0x562a2a3232e0 2024-09-19T09:06:38.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.690+0000 7f8696c38740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f868c1a8390 con 0x562a2a3229a0 2024-09-19T09:06:38.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.690+0000 7f8696c38740 10 client.0 _ll_register_callbacks cb 0x7f8680004340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.690+0000 7f8692443640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a2a328370 0x562a2a332e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.690+0000 7f8692443640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a2a328370 0x562a2a332e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38774/0 (socket says 172.21.15.92:38774) 2024-09-19T09:06:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.690+0000 7f8692443640 1 -- 172.21.15.92:0/51944892 learned_addr learned my addr 172.21.15.92:0/51944892 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.690+0000 7f8691441640 1 --2- 172.21.15.92:0/51944892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a2a3232e0 0x562a2a331e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.690+0000 7f8691c42640 1 --2- 172.21.15.92:0/51944892 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a2a3229a0 0x562a2a331900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.691+0000 7f8692443640 1 -- 172.21.15.92:0/51944892 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a2a3229a0 msgr2=0x562a2a331900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.691+0000 7f8692443640 1 --2- 172.21.15.92:0/51944892 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a2a3229a0 0x562a2a331900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.691+0000 7f8692443640 1 -- 172.21.15.92:0/51944892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a2a3232e0 msgr2=0x562a2a331e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.691+0000 7f8692443640 1 --2- 172.21.15.92:0/51944892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a2a3232e0 0x562a2a331e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.691+0000 7f8692443640 1 -- 172.21.15.92:0/51944892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a2a333460 con 0x562a2a328370 2024-09-19T09:06:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.691+0000 7f8691441640 1 --2- 172.21.15.92:0/51944892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a2a3232e0 0x562a2a331e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.691+0000 7f8692443640 1 --2- 172.21.15.92:0/51944892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a2a328370 0x562a2a332e50 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f86840314e0 tx=0x7f8684031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c786ec2db803969 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.691+0000 7f86717fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:06:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.691+0000 7f86717fa640 1 -- 172.21.15.92:0/51944892 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8684035070 con 0x562a2a328370 2024-09-19T09:06:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.691+0000 7f8696c38740 1 -- 172.21.15.92:0/51944892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86840055d0 con 0x562a2a328370 2024-09-19T09:06:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.691+0000 7f86717fa640 1 -- 172.21.15.92:0/51944892 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f86840318c0 con 0x562a2a328370 2024-09-19T09:06:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.691+0000 7f86717fa640 1 -- 172.21.15.92:0/51944892 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f868404d030 con 0x562a2a328370 2024-09-19T09:06:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.691+0000 7f8696c38740 10 client.17751 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.691+0000 7f8696c38740 1 -- 172.21.15.92:0/51944892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x562a2a3a3660 con 0x562a2a328370 2024-09-19T09:06:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.691+0000 7f86717fa640 1 -- 172.21.15.92:0/51944892 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86840055d0 con 0x562a2a328370 2024-09-19T09:06:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.691+0000 7f86717fa640 1 -- 172.21.15.92:0/51944892 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f868403a040 con 0x562a2a328370 2024-09-19T09:06:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.691+0000 7f8696c38740 10 client.17751 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.691+0000 7f8696c38740 10 client.17751 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:06:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.691+0000 7f8696c38740 20 client.17751 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.691+0000 7f8696c38740 1 --2- 172.21.15.92:0/51944892 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562a2a3a3b00 0x562a2a3a5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.691+0000 7f8696c38740 4 client.17751 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:06:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.691+0000 7f8696c38740 1 -- 172.21.15.92:0/51944892 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562a2a28dd70 con 0x562a2a3a3b00 2024-09-19T09:06:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.692+0000 7f8691c42640 1 --2- 172.21.15.92:0/51944892 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562a2a3a3b00 0x562a2a3a5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.692+0000 7f86717fa640 10 client.17751 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.692+0000 7f8691c42640 1 --2- 172.21.15.92:0/51944892 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562a2a3a3b00 0x562a2a3a5ef0 crc :-1 s=READY pgs=312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7f853d520b1faa6 server_cookie=bff274e98dec5bb9 in_seq=0 out_seq=0 2024-09-19T09:06:38.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.711+0000 7f86717fa640 1 -- 172.21.15.92:0/51944892 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562a2a28dd70 con 0x562a2a3a3b00 2024-09-19T09:06:38.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.711+0000 7f86717fa640 10 client.17751 handle_command_reply: tid=0 2024-09-19T09:06:38.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.711+0000 7f8696c38740 1 client.17751 shutdown 2024-09-19T09:06:38.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.711+0000 7f8696c38740 1 -- 172.21.15.92:0/51944892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a2a328370 msgr2=0x562a2a332e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:38.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.711+0000 7f8696c38740 1 --2- 172.21.15.92:0/51944892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a2a328370 0x562a2a332e50 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f86840314e0 tx=0x7f8684031400 comp rx=0 tx=0).stop 2024-09-19T09:06:38.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.711+0000 7f8696c38740 1 -- 172.21.15.92:0/51944892 shutdown_connections 2024-09-19T09:06:38.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.711+0000 7f8696c38740 1 --2- 172.21.15.92:0/51944892 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562a2a3a3b00 0x562a2a3a5ef0 crc :-1 s=READY pgs=312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:38.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.711+0000 7f8696c38740 1 --2- 172.21.15.92:0/51944892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a2a328370 0x562a2a332e50 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:38.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.711+0000 7f8696c38740 1 --2- 172.21.15.92:0/51944892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a2a3232e0 0x562a2a331e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:38.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.711+0000 7f86717fa640 0 client.17751 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:38.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.711+0000 7f8696c38740 1 --2- 172.21.15.92:0/51944892 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a2a3229a0 0x562a2a331900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:38.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.711+0000 7f8696c38740 1 -- 172.21.15.92:0/51944892 >> 172.21.15.92:0/51944892 conn(0x562a2a31e010 msgr2=0x562a2a31e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:38.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.711+0000 7f8696c38740 1 -- 172.21.15.92:0/51944892 shutdown_connections 2024-09-19T09:06:38.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.711+0000 7f8696c38740 1 -- 172.21.15.92:0/51944892 wait complete. 2024-09-19T09:06:38.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.711+0000 7f8696c38740 20 client.17751 trim_cache size 0 max 16384 2024-09-19T09:06:38.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:06:38.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:06:38.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:06:38.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:06:38.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.712+0000 7f8693ea6640 1 -- 172.21.15.92:0/1657392614 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f86740a3370 msgr2=0x7f86740a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:38.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.712+0000 7f8693ea6640 1 --2- 172.21.15.92:0/1657392614 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f86740a3370 0x7f86740a5830 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f8680005fd0 tx=0x7f868000b390 comp rx=0 tx=0).stop 2024-09-19T09:06:38.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.712+0000 7f8693ea6640 1 -- 172.21.15.92:0/1657392614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f868c100a40 msgr2=0x7f868c197da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:38.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.712+0000 7f8693ea6640 1 --2- 172.21.15.92:0/1657392614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f868c100a40 0x7f868c197da0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f867c00ea80 tx=0x7f867c00ef40 comp rx=0 tx=0).stop 2024-09-19T09:06:38.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.712+0000 7f8693ea6640 1 -- 172.21.15.92:0/1657392614 shutdown_connections 2024-09-19T09:06:38.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.712+0000 7f8693ea6640 1 --2- 172.21.15.92:0/1657392614 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f868c1025f0 0x7f868c19f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:38.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.712+0000 7f8693ea6640 1 --2- 172.21.15.92:0/1657392614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f868c101c30 0x7f868c1982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:38.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.712+0000 7f8693ea6640 1 --2- 172.21.15.92:0/1657392614 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f86740a3370 0x7f86740a5830 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:38.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.712+0000 7f8693ea6640 1 --2- 172.21.15.92:0/1657392614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f868c100a40 0x7f868c197da0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:38.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.712+0000 7f8693ea6640 1 -- 172.21.15.92:0/1657392614 >> 172.21.15.92:0/1657392614 conn(0x7f868c0fc1e0 msgr2=0x7f868c104f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:38.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.712+0000 7f8693ea6640 1 -- 172.21.15.92:0/1657392614 shutdown_connections 2024-09-19T09:06:38.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:38.712+0000 7f8693ea6640 1 -- 172.21.15.92:0/1657392614 wait complete. 2024-09-19T09:06:39.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:38 smithi092 ceph-mon[31407]: pgmap v635: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.2 MiB/s wr, 332 op/s 2024-09-19T09:06:39.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:38 smithi167 ceph-mon[35359]: pgmap v635: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.2 MiB/s wr, 332 op/s 2024-09-19T09:06:39.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:38 smithi190 ceph-mon[35358]: pgmap v635: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.2 MiB/s wr, 332 op/s 2024-09-19T09:06:40.798 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 595.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:06:41.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:41 smithi167 ceph-mon[35359]: pgmap v636: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.6 MiB/s wr, 305 op/s 2024-09-19T09:06:41.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:41 smithi190 ceph-mon[35358]: pgmap v636: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.6 MiB/s wr, 305 op/s 2024-09-19T09:06:41.969 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:06:41.990 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:41 smithi092 ceph-mon[31407]: pgmap v636: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.6 MiB/s wr, 305 op/s 2024-09-19T09:06:42.234 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:06:42.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.656+0000 7f774a6ca640 1 -- 172.21.15.92:0/1772508686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f774410c160 msgr2=0x7f774410e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:42.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.656+0000 7f774a6ca640 1 --2- 172.21.15.92:0/1772508686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f774410c160 0x7f774410e600 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f773c009ca0 tx=0x7f773c02a950 comp rx=0 tx=0).stop 2024-09-19T09:06:42.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.656+0000 7f774a6ca640 1 -- 172.21.15.92:0/1772508686 shutdown_connections 2024-09-19T09:06:42.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.656+0000 7f774a6ca640 1 --2- 172.21.15.92:0/1772508686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f774410c160 0x7f774410e600 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.656+0000 7f774a6ca640 1 --2- 172.21.15.92:0/1772508686 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7744103650 0x7f774410bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.656+0000 7f774a6ca640 1 --2- 172.21.15.92:0/1772508686 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7744102d30 0x7f7744103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.656+0000 7f774a6ca640 1 -- 172.21.15.92:0/1772508686 >> 172.21.15.92:0/1772508686 conn(0x7f77440fc790 msgr2=0x7f77440febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:42.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.656+0000 7f774a6ca640 1 -- 172.21.15.92:0/1772508686 shutdown_connections 2024-09-19T09:06:42.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.656+0000 7f774a6ca640 1 -- 172.21.15.92:0/1772508686 wait complete. 2024-09-19T09:06:42.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.657+0000 7f774a6ca640 1 Processor -- start 2024-09-19T09:06:42.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.657+0000 7f774a6ca640 1 -- start start 2024-09-19T09:06:42.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.657+0000 7f774a6ca640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7744102d30 0x7f7744100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:42.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.657+0000 7f774a6ca640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7744103650 0x7f7744100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:42.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.657+0000 7f774a6ca640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f774410c160 0x7f7744101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:42.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.657+0000 7f774a6ca640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7744111f60 con 0x7f774410c160 2024-09-19T09:06:42.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.657+0000 7f774a6ca640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7744111de0 con 0x7f7744103650 2024-09-19T09:06:42.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.657+0000 7f774a6ca640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f77441120e0 con 0x7f7744102d30 2024-09-19T09:06:42.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.657+0000 7f7748c67640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f774410c160 0x7f7744101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:42.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.657+0000 7f7748c67640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f774410c160 0x7f7744101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52130/0 (socket says 172.21.15.92:52130) 2024-09-19T09:06:42.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.657+0000 7f7748c67640 1 -- 172.21.15.92:0/429605120 learned_addr learned my addr 172.21.15.92:0/429605120 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:42.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.657+0000 7f7743fff640 1 --2- 172.21.15.92:0/429605120 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7744102d30 0x7f7744100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:42.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.657+0000 7f773bfff640 1 --2- 172.21.15.92:0/429605120 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7744103650 0x7f7744100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:42.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.657+0000 7f7748c67640 1 -- 172.21.15.92:0/429605120 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7744102d30 msgr2=0x7f7744100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:42.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.657+0000 7f7748c67640 1 --2- 172.21.15.92:0/429605120 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7744102d30 0x7f7744100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.657+0000 7f7748c67640 1 -- 172.21.15.92:0/429605120 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7744103650 msgr2=0x7f7744100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:42.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.657+0000 7f7748c67640 1 --2- 172.21.15.92:0/429605120 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7744103650 0x7f7744100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.658+0000 7f7748c67640 1 -- 172.21.15.92:0/429605120 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77441a6930 con 0x7f774410c160 2024-09-19T09:06:42.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.658+0000 7f7748c67640 1 --2- 172.21.15.92:0/429605120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f774410c160 0x7f7744101410 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f773c02ae70 tx=0x7f773c02f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:42.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.658+0000 7f7741ffb640 1 -- 172.21.15.92:0/429605120 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773c034040 con 0x7f774410c160 2024-09-19T09:06:42.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.658+0000 7f774a6ca640 1 -- 172.21.15.92:0/429605120 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77441a6bc0 con 0x7f774410c160 2024-09-19T09:06:42.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.658+0000 7f7741ffb640 1 -- 172.21.15.92:0/429605120 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f773c030920 con 0x7f774410c160 2024-09-19T09:06:42.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.658+0000 7f7741ffb640 1 -- 172.21.15.92:0/429605120 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773c045480 con 0x7f774410c160 2024-09-19T09:06:42.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.658+0000 7f774a6ca640 1 -- 172.21.15.92:0/429605120 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77441a70f0 con 0x7f774410c160 2024-09-19T09:06:42.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.660+0000 7f7741ffb640 1 -- 172.21.15.92:0/429605120 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f773c037020 con 0x7f774410c160 2024-09-19T09:06:42.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.661+0000 7f7741ffb640 1 --2- 172.21.15.92:0/429605120 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f77300a3240 0x7f77300a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:42.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.661+0000 7f7743fff640 1 --2- 172.21.15.92:0/429605120 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f77300a3240 0x7f77300a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:42.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.661+0000 7f7741ffb640 1 -- 172.21.15.92:0/429605120 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f773c0f07d0 con 0x7f774410c160 2024-09-19T09:06:42.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.662+0000 7f774caa3740 1 Processor -- start 2024-09-19T09:06:42.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.662+0000 7f774caa3740 1 -- start start 2024-09-19T09:06:42.676 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.662+0000 7f7743fff640 1 --2- 172.21.15.92:0/429605120 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f77300a3240 0x7f77300a5700 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f7734005fd0 tx=0x7f773400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:42.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.662+0000 7f774caa3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7ea3b74a0 0x55a7ea3b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:42.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.662+0000 7f774caa3740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7ea3b7dc0 0x55a7ea3c2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:42.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.662+0000 7f774caa3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7ea3c2680 0x55a7ea3c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:42.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.662+0000 7f774caa3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a7ea31d2e0 con 0x55a7ea3b74a0 2024-09-19T09:06:42.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.662+0000 7f774caa3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a7ea2c4ce0 con 0x55a7ea3c2680 2024-09-19T09:06:42.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.662+0000 7f774caa3740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55a7ea3192a0 con 0x55a7ea3b7dc0 2024-09-19T09:06:42.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.662+0000 7f7743fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7ea3b74a0 0x55a7ea3b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:42.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.662+0000 7f7743fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7ea3b74a0 0x55a7ea3b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52146/0 (socket says 172.21.15.92:52146) 2024-09-19T09:06:42.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.662+0000 7f7743fff640 1 -- 172.21.15.92:0/1337487870 learned_addr learned my addr 172.21.15.92:0/1337487870 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:42.677 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.662+0000 7f7743fff640 1 -- 172.21.15.92:0/1337487870 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7ea3b7dc0 msgr2=0x55a7ea3c2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:42.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.662+0000 7f7743fff640 1 --2- 172.21.15.92:0/1337487870 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7ea3b7dc0 0x55a7ea3c2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.662+0000 7f7743fff640 1 -- 172.21.15.92:0/1337487870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7ea3c2680 msgr2=0x55a7ea3c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:42.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.662+0000 7f7743fff640 1 --2- 172.21.15.92:0/1337487870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7ea3c2680 0x55a7ea3c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.662+0000 7f7743fff640 1 -- 172.21.15.92:0/1337487870 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7ea2a9440 con 0x55a7ea3b74a0 2024-09-19T09:06:42.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.663+0000 7f7743fff640 1 --2- 172.21.15.92:0/1337487870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7ea3b74a0 0x55a7ea3b7880 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f773400b620 tx=0x7f7734013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2686ad590da3518b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:42.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.663+0000 7f773a7fc640 1 -- 172.21.15.92:0/1337487870 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7734003e90 con 0x55a7ea3b74a0 2024-09-19T09:06:42.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.663+0000 7f773a7fc640 1 -- 172.21.15.92:0/1337487870 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7734005500 con 0x55a7ea3b74a0 2024-09-19T09:06:42.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.663+0000 7f773a7fc640 1 -- 172.21.15.92:0/1337487870 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773401e620 con 0x55a7ea3b74a0 2024-09-19T09:06:42.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.663+0000 7f774caa3740 1 -- 172.21.15.92:0/1337487870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7ea3b74a0 msgr2=0x55a7ea3b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:42.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.663+0000 7f774caa3740 1 --2- 172.21.15.92:0/1337487870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7ea3b74a0 0x55a7ea3b7880 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f773400b620 tx=0x7f7734013000 comp rx=0 tx=0).stop 2024-09-19T09:06:42.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.664+0000 7f774caa3740 1 -- 172.21.15.92:0/1337487870 shutdown_connections 2024-09-19T09:06:42.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.664+0000 7f774caa3740 1 --2- 172.21.15.92:0/1337487870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7ea3c2680 0x55a7ea3c4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.664+0000 7f774caa3740 1 --2- 172.21.15.92:0/1337487870 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7ea3b7dc0 0x55a7ea3c2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.664+0000 7f774caa3740 1 --2- 172.21.15.92:0/1337487870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7ea3b74a0 0x55a7ea3b7880 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.664+0000 7f774caa3740 1 -- 172.21.15.92:0/1337487870 >> 172.21.15.92:0/1337487870 conn(0x55a7ea3b3a30 msgr2=0x55a7ea3b3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:42.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.664+0000 7f774caa3740 1 -- 172.21.15.92:0/1337487870 shutdown_connections 2024-09-19T09:06:42.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.664+0000 7f774caa3740 1 -- 172.21.15.92:0/1337487870 wait complete. 2024-09-19T09:06:42.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.664+0000 7f774caa3740 1 -- start start 2024-09-19T09:06:42.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.664+0000 7f774caa3740 1 Processor -- start 2024-09-19T09:06:42.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.664+0000 7f774caa3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7ea3b74a0 0x55a7ea3c1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:42.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.664+0000 7f774caa3740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7ea3b7dc0 0x55a7ea3bf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:42.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.664+0000 7f774caa3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7ea3c2680 0x55a7ea3bf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:42.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.664+0000 7f774caa3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a7ea3c5250 con 0x55a7ea3c2680 2024-09-19T09:06:42.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.664+0000 7f774caa3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a7ea2d8050 con 0x55a7ea3b74a0 2024-09-19T09:06:42.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.664+0000 7f774caa3740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55a7ea3c53d0 con 0x55a7ea3b7dc0 2024-09-19T09:06:42.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.664+0000 7f774caa3740 10 client.0 _ll_register_callbacks cb 0x55a7ea318160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:42.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.665+0000 7f7748c67640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7ea3c2680 0x55a7ea3bf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:42.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.665+0000 7f7748c67640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7ea3c2680 0x55a7ea3bf750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52156/0 (socket says 172.21.15.92:52156) 2024-09-19T09:06:42.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.665+0000 7f7748c67640 1 -- 172.21.15.92:0/1809933290 learned_addr learned my addr 172.21.15.92:0/1809933290 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:42.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.665+0000 7f7743fff640 1 --2- 172.21.15.92:0/1809933290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7ea3b74a0 0x55a7ea3c1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:42.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.665+0000 7f773bfff640 1 --2- 172.21.15.92:0/1809933290 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7ea3b7dc0 0x55a7ea3bf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:42.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.665+0000 7f7748c67640 1 -- 172.21.15.92:0/1809933290 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7ea3b7dc0 msgr2=0x55a7ea3bf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:42.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.665+0000 7f7748c67640 1 --2- 172.21.15.92:0/1809933290 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7ea3b7dc0 0x55a7ea3bf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.665+0000 7f7748c67640 1 -- 172.21.15.92:0/1809933290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7ea3b74a0 msgr2=0x55a7ea3c1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:42.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.665+0000 7f7748c67640 1 --2- 172.21.15.92:0/1809933290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7ea3b74a0 0x55a7ea3c1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.665+0000 7f7748c67640 1 -- 172.21.15.92:0/1809933290 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7ea08e3c0 con 0x55a7ea3c2680 2024-09-19T09:06:42.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.665+0000 7f7748c67640 1 --2- 172.21.15.92:0/1809933290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7ea3c2680 0x55a7ea3bf750 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f773c0b9780 tx=0x7f773c0bcb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=114fa931449b9038 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:42.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.665+0000 7f77237fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:06:42.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.665+0000 7f77237fe640 1 -- 172.21.15.92:0/1809933290 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773c02c040 con 0x55a7ea3c2680 2024-09-19T09:06:42.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.665+0000 7f77237fe640 1 -- 172.21.15.92:0/1809933290 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f773c0c5790 con 0x55a7ea3c2680 2024-09-19T09:06:42.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.665+0000 7f774caa3740 1 -- 172.21.15.92:0/1809933290 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7734005500 con 0x55a7ea3c2680 2024-09-19T09:06:42.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.665+0000 7f77237fe640 1 -- 172.21.15.92:0/1809933290 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f773c0098d0 con 0x55a7ea3c2680 2024-09-19T09:06:42.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.665+0000 7f774caa3740 10 client.17763 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:42.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.665+0000 7f774caa3740 1 -- 172.21.15.92:0/1809933290 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55a7ea3d0bf0 con 0x55a7ea3c2680 2024-09-19T09:06:42.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.666+0000 7f77237fe640 1 -- 172.21.15.92:0/1809933290 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7734005500 con 0x55a7ea3c2680 2024-09-19T09:06:42.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.666+0000 7f77237fe640 1 -- 172.21.15.92:0/1809933290 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f773c04d030 con 0x55a7ea3c2680 2024-09-19T09:06:42.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.666+0000 7f774caa3740 10 client.17763 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:42.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.666+0000 7f774caa3740 10 client.17763 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:06:42.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.666+0000 7f774caa3740 20 client.17763 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:42.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.666+0000 7f774caa3740 1 --2- 172.21.15.92:0/1809933290 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a7ea3d2000 0x55a7ea3d4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:42.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.666+0000 7f774caa3740 4 client.17763 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:06:42.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.666+0000 7f774caa3740 1 -- 172.21.15.92:0/1809933290 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7ea32a850 con 0x55a7ea3d2000 2024-09-19T09:06:42.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.666+0000 7f7743fff640 1 --2- 172.21.15.92:0/1809933290 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a7ea3d2000 0x55a7ea3d4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:42.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.667+0000 7f77237fe640 10 client.17763 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:42.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.667+0000 7f7743fff640 1 --2- 172.21.15.92:0/1809933290 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a7ea3d2000 0x55a7ea3d4420 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=396198640731f710 server_cookie=82404d438e223129 in_seq=0 out_seq=0 2024-09-19T09:06:42.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.667+0000 7f77237fe640 1 -- 172.21.15.92:0/1809933290 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a7ea32a850 con 0x55a7ea3d2000 2024-09-19T09:06:42.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.667+0000 7f77237fe640 10 client.17763 handle_command_reply: tid=0 2024-09-19T09:06:42.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.667+0000 7f774caa3740 1 client.17763 shutdown 2024-09-19T09:06:42.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.668+0000 7f774caa3740 1 -- 172.21.15.92:0/1809933290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7ea3c2680 msgr2=0x55a7ea3bf750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:42.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.668+0000 7f774caa3740 1 --2- 172.21.15.92:0/1809933290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7ea3c2680 0x55a7ea3bf750 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f773c0b9780 tx=0x7f773c0bcb80 comp rx=0 tx=0).stop 2024-09-19T09:06:42.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.668+0000 7f774caa3740 1 -- 172.21.15.92:0/1809933290 shutdown_connections 2024-09-19T09:06:42.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.668+0000 7f774caa3740 1 --2- 172.21.15.92:0/1809933290 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a7ea3d2000 0x55a7ea3d4420 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.668+0000 7f774caa3740 1 --2- 172.21.15.92:0/1809933290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7ea3c2680 0x55a7ea3bf750 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.668+0000 7f774caa3740 1 --2- 172.21.15.92:0/1809933290 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7ea3b7dc0 0x55a7ea3bf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.668+0000 7f77237fe640 0 client.17763 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:42.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.668+0000 7f774caa3740 1 --2- 172.21.15.92:0/1809933290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7ea3b74a0 0x55a7ea3c1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.668+0000 7f774caa3740 1 -- 172.21.15.92:0/1809933290 >> 172.21.15.92:0/1809933290 conn(0x55a7ea3b3a30 msgr2=0x55a7ea3b9710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:42.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.668+0000 7f774caa3740 1 -- 172.21.15.92:0/1809933290 shutdown_connections 2024-09-19T09:06:42.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.668+0000 7f774caa3740 1 -- 172.21.15.92:0/1809933290 wait complete. 2024-09-19T09:06:42.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.668+0000 7f774caa3740 20 client.17763 trim_cache size 0 max 16384 2024-09-19T09:06:42.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.685+0000 7f774caa3740 1 Processor -- start 2024-09-19T09:06:42.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.685+0000 7f774caa3740 1 -- start start 2024-09-19T09:06:42.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.685+0000 7f774caa3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7ea3b74a0 0x55a7ea3ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:42.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.685+0000 7f774caa3740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7ea3b7dc0 0x55a7ea3d9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:42.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.685+0000 7f774caa3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7ea3c2680 0x55a7ea3da230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:42.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.685+0000 7f774caa3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f77441ad670 con 0x55a7ea3c2680 2024-09-19T09:06:42.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.685+0000 7f774caa3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f77441aff10 con 0x55a7ea3b74a0 2024-09-19T09:06:42.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.685+0000 7f774caa3740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f77441add00 con 0x55a7ea3b7dc0 2024-09-19T09:06:42.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.686+0000 7f7748c67640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7ea3c2680 0x55a7ea3da230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:42.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.686+0000 7f7743fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7ea3b74a0 0x55a7ea3ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:42.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.686+0000 7f7748c67640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7ea3c2680 0x55a7ea3da230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52170/0 (socket says 172.21.15.92:52170) 2024-09-19T09:06:42.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.686+0000 7f7748c67640 1 -- 172.21.15.92:0/4194419789 learned_addr learned my addr 172.21.15.92:0/4194419789 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:42.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.686+0000 7f773bfff640 1 --2- 172.21.15.92:0/4194419789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7ea3b7dc0 0x55a7ea3d9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:42.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.686+0000 7f7748c67640 1 -- 172.21.15.92:0/4194419789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7ea3b7dc0 msgr2=0x55a7ea3d9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:42.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.686+0000 7f7748c67640 1 --2- 172.21.15.92:0/4194419789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7ea3b7dc0 0x55a7ea3d9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.686+0000 7f7748c67640 1 -- 172.21.15.92:0/4194419789 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7ea3b74a0 msgr2=0x55a7ea3ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:42.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.686+0000 7f7748c67640 1 --2- 172.21.15.92:0/4194419789 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7ea3b74a0 0x55a7ea3ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.686+0000 7f7748c67640 1 -- 172.21.15.92:0/4194419789 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7ea3c22d0 con 0x55a7ea3c2680 2024-09-19T09:06:42.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.686+0000 7f7748c67640 1 --2- 172.21.15.92:0/4194419789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7ea3c2680 0x55a7ea3da230 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f773c032000 tx=0x7f773c0bb2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf471d5ece997f91 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:42.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.686+0000 7f7739ffb640 1 -- 172.21.15.92:0/4194419789 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773c02c040 con 0x55a7ea3c2680 2024-09-19T09:06:42.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.686+0000 7f7739ffb640 1 -- 172.21.15.92:0/4194419789 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f773c0bd4b0 con 0x55a7ea3c2680 2024-09-19T09:06:42.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.686+0000 7f7739ffb640 1 -- 172.21.15.92:0/4194419789 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773c0c57b0 con 0x55a7ea3c2680 2024-09-19T09:06:42.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.687+0000 7f774caa3740 1 -- 172.21.15.92:0/4194419789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7ea3c2680 msgr2=0x55a7ea3da230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:42.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.687+0000 7f774caa3740 1 --2- 172.21.15.92:0/4194419789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7ea3c2680 0x55a7ea3da230 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f773c032000 tx=0x7f773c0bb2c0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.687+0000 7f774caa3740 1 -- 172.21.15.92:0/4194419789 shutdown_connections 2024-09-19T09:06:42.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.687+0000 7f774caa3740 1 --2- 172.21.15.92:0/4194419789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7ea3c2680 0x55a7ea3da230 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.687+0000 7f774caa3740 1 --2- 172.21.15.92:0/4194419789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7ea3b7dc0 0x55a7ea3d9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.687+0000 7f774caa3740 1 --2- 172.21.15.92:0/4194419789 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7ea3b74a0 0x55a7ea3ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.687+0000 7f774caa3740 1 -- 172.21.15.92:0/4194419789 >> 172.21.15.92:0/4194419789 conn(0x55a7ea3b3a30 msgr2=0x55a7ea3c1290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:42.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.687+0000 7f774caa3740 1 -- 172.21.15.92:0/4194419789 shutdown_connections 2024-09-19T09:06:42.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.687+0000 7f774caa3740 1 -- 172.21.15.92:0/4194419789 wait complete. 2024-09-19T09:06:42.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.687+0000 7f774caa3740 1 -- start start 2024-09-19T09:06:42.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.688+0000 7f774caa3740 1 Processor -- start 2024-09-19T09:06:42.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.688+0000 7f774caa3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7ea3b74a0 0x55a7ea3cace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:42.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.688+0000 7f774caa3740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7ea3b7dc0 0x55a7ea3c7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:42.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.688+0000 7f774caa3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7ea3c2680 0x55a7ea3c7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:42.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.688+0000 7f774caa3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f77441ae3d0 con 0x55a7ea3c2680 2024-09-19T09:06:42.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.688+0000 7f774caa3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f77441af840 con 0x55a7ea3b74a0 2024-09-19T09:06:42.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.688+0000 7f774caa3740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f77441aeaa0 con 0x55a7ea3b7dc0 2024-09-19T09:06:42.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.688+0000 7f774caa3740 10 client.0 _ll_register_callbacks cb 0x7f773c0b8930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:42.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.688+0000 7f7748c67640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7ea3c2680 0x55a7ea3c7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:42.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.688+0000 7f7748c67640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7ea3c2680 0x55a7ea3c7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52184/0 (socket says 172.21.15.92:52184) 2024-09-19T09:06:42.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.688+0000 7f7748c67640 1 -- 172.21.15.92:0/4292568839 learned_addr learned my addr 172.21.15.92:0/4292568839 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:42.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.688+0000 7f773bfff640 1 --2- 172.21.15.92:0/4292568839 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7ea3b7dc0 0x55a7ea3c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:42.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.688+0000 7f7743fff640 1 --2- 172.21.15.92:0/4292568839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7ea3b74a0 0x55a7ea3cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:42.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.688+0000 7f7748c67640 1 -- 172.21.15.92:0/4292568839 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7ea3b7dc0 msgr2=0x55a7ea3c7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:42.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.688+0000 7f7748c67640 1 --2- 172.21.15.92:0/4292568839 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7ea3b7dc0 0x55a7ea3c7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.688+0000 7f7748c67640 1 -- 172.21.15.92:0/4292568839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7ea3b74a0 msgr2=0x55a7ea3cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:42.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.688+0000 7f7748c67640 1 --2- 172.21.15.92:0/4292568839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7ea3b74a0 0x55a7ea3cace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.689+0000 7f7748c67640 1 -- 172.21.15.92:0/4292568839 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7ea3c7d40 con 0x55a7ea3c2680 2024-09-19T09:06:42.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.689+0000 7f7743fff640 1 --2- 172.21.15.92:0/4292568839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7ea3b74a0 0x55a7ea3cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:42.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.689+0000 7f7748c67640 1 --2- 172.21.15.92:0/4292568839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7ea3c2680 0x55a7ea3c7560 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f773c0b9210 tx=0x7f773c02a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17c25a60526ddb6b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:42.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.689+0000 7f77237fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:06:42.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.689+0000 7f77237fe640 1 -- 172.21.15.92:0/4292568839 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773c02c040 con 0x55a7ea3c2680 2024-09-19T09:06:42.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.689+0000 7f77237fe640 1 -- 172.21.15.92:0/4292568839 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f773c030440 con 0x55a7ea3c2680 2024-09-19T09:06:42.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.689+0000 7f774caa3740 1 -- 172.21.15.92:0/4292568839 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f773c0bd4b0 con 0x55a7ea3c2680 2024-09-19T09:06:42.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.689+0000 7f77237fe640 1 -- 172.21.15.92:0/4292568839 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f773c0bcdb0 con 0x55a7ea3c2680 2024-09-19T09:06:42.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.689+0000 7f774caa3740 10 client.17769 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:42.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.689+0000 7f774caa3740 1 -- 172.21.15.92:0/4292568839 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55a7ea3c7d40 con 0x55a7ea3c2680 2024-09-19T09:06:42.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.689+0000 7f77237fe640 1 -- 172.21.15.92:0/4292568839 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f773c0bd4b0 con 0x55a7ea3c2680 2024-09-19T09:06:42.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.689+0000 7f77237fe640 1 -- 172.21.15.92:0/4292568839 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f773c04d070 con 0x55a7ea3c2680 2024-09-19T09:06:42.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.689+0000 7f774caa3740 10 client.17769 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:42.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.689+0000 7f774caa3740 10 client.17769 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:06:42.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.689+0000 7f774caa3740 20 client.17769 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:42.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.689+0000 7f774caa3740 1 --2- 172.21.15.92:0/4292568839 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a7ea43de30 0x55a7ea440220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:42.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.689+0000 7f774caa3740 4 client.17769 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:06:42.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.689+0000 7f774caa3740 1 -- 172.21.15.92:0/4292568839 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a7ea324d60 con 0x55a7ea43de30 2024-09-19T09:06:42.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.690+0000 7f7743fff640 1 --2- 172.21.15.92:0/4292568839 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a7ea43de30 0x55a7ea440220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:42.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.690+0000 7f77237fe640 10 client.17769 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:42.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.690+0000 7f7743fff640 1 --2- 172.21.15.92:0/4292568839 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a7ea43de30 0x55a7ea440220 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1af37ce4634b64d9 server_cookie=1c9956f5bbd36419 in_seq=0 out_seq=0 2024-09-19T09:06:42.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.690+0000 7f77237fe640 1 -- 172.21.15.92:0/4292568839 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a7ea324d60 con 0x55a7ea43de30 2024-09-19T09:06:42.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.690+0000 7f77237fe640 10 client.17769 handle_command_reply: tid=0 2024-09-19T09:06:42.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.691+0000 7f774caa3740 1 client.17769 shutdown 2024-09-19T09:06:42.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.691+0000 7f774caa3740 1 -- 172.21.15.92:0/4292568839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7ea3c2680 msgr2=0x55a7ea3c7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:42.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.691+0000 7f774caa3740 1 --2- 172.21.15.92:0/4292568839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7ea3c2680 0x55a7ea3c7560 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f773c0b9210 tx=0x7f773c02a950 comp rx=0 tx=0).stop 2024-09-19T09:06:42.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.691+0000 7f774caa3740 1 -- 172.21.15.92:0/4292568839 shutdown_connections 2024-09-19T09:06:42.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.691+0000 7f774caa3740 1 --2- 172.21.15.92:0/4292568839 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a7ea43de30 0x55a7ea440220 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.691+0000 7f774caa3740 1 --2- 172.21.15.92:0/4292568839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7ea3c2680 0x55a7ea3c7560 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.691+0000 7f774caa3740 1 --2- 172.21.15.92:0/4292568839 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a7ea3b7dc0 0x55a7ea3c7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.691+0000 7f77237fe640 0 client.17769 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:42.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.691+0000 7f774caa3740 1 --2- 172.21.15.92:0/4292568839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a7ea3b74a0 0x55a7ea3cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.691+0000 7f774caa3740 1 -- 172.21.15.92:0/4292568839 >> 172.21.15.92:0/4292568839 conn(0x55a7ea3b3a30 msgr2=0x55a7ea3b2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:42.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.691+0000 7f774caa3740 1 -- 172.21.15.92:0/4292568839 shutdown_connections 2024-09-19T09:06:42.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.691+0000 7f774caa3740 1 -- 172.21.15.92:0/4292568839 wait complete. 2024-09-19T09:06:42.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.691+0000 7f774caa3740 20 client.17769 trim_cache size 0 max 16384 2024-09-19T09:06:42.700 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:06:42.700 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-19T09:06:42.701 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {} 2024-09-19T09:06:42.701 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:06:42.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.692+0000 7f774a6ca640 1 -- 172.21.15.92:0/429605120 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f77300a3240 msgr2=0x7f77300a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:42.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.692+0000 7f774a6ca640 1 --2- 172.21.15.92:0/429605120 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f77300a3240 0x7f77300a5700 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f7734005fd0 tx=0x7f773400b390 comp rx=0 tx=0).stop 2024-09-19T09:06:42.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.692+0000 7f774a6ca640 1 -- 172.21.15.92:0/429605120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f774410c160 msgr2=0x7f7744101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:42.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.692+0000 7f774a6ca640 1 --2- 172.21.15.92:0/429605120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f774410c160 0x7f7744101410 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f773c02ae70 tx=0x7f773c02f5b0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.692+0000 7f774a6ca640 1 -- 172.21.15.92:0/429605120 shutdown_connections 2024-09-19T09:06:42.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.692+0000 7f774a6ca640 1 --2- 172.21.15.92:0/429605120 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f77300a3240 0x7f77300a5700 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.692+0000 7f774a6ca640 1 --2- 172.21.15.92:0/429605120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f774410c160 0x7f7744101410 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.692+0000 7f774a6ca640 1 --2- 172.21.15.92:0/429605120 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7744103650 0x7f7744100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.692+0000 7f774a6ca640 1 --2- 172.21.15.92:0/429605120 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7744102d30 0x7f7744100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.692+0000 7f774a6ca640 1 -- 172.21.15.92:0/429605120 >> 172.21.15.92:0/429605120 conn(0x7f77440fc790 msgr2=0x7f77440fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:42.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.692+0000 7f774a6ca640 1 -- 172.21.15.92:0/429605120 shutdown_connections 2024-09-19T09:06:42.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:42.692+0000 7f774a6ca640 1 -- 172.21.15.92:0/429605120 wait complete. 2024-09-19T09:06:43.405 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:06:43.405 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:06:43.695 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:06:43.803 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:43 smithi092 ceph-mon[31407]: pgmap v637: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 1.9 MiB/s wr, 166 op/s 2024-09-19T09:06:43.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:43 smithi167 ceph-mon[35359]: pgmap v637: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 1.9 MiB/s wr, 166 op/s 2024-09-19T09:06:43.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:43 smithi190 ceph-mon[35358]: pgmap v637: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 1.9 MiB/s wr, 166 op/s 2024-09-19T09:06:44.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.102+0000 7ff68d009640 1 -- 172.21.15.92:0/1276899241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff688101de0 msgr2=0x7ff6881021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:44.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.102+0000 7ff68d009640 1 --2- 172.21.15.92:0/1276899241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff688101de0 0x7ff6881021c0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7ff678009900 tx=0x7ff67802a410 comp rx=0 tx=0).stop 2024-09-19T09:06:44.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.102+0000 7ff68d009640 1 -- 172.21.15.92:0/1276899241 shutdown_connections 2024-09-19T09:06:44.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.102+0000 7ff68d009640 1 --2- 172.21.15.92:0/1276899241 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff688106f10 0x7ff68810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:44.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.102+0000 7ff68d009640 1 --2- 172.21.15.92:0/1276899241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff688102790 0x7ff6881067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:44.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.102+0000 7ff68d009640 1 --2- 172.21.15.92:0/1276899241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff688101de0 0x7ff6881021c0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:44.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.102+0000 7ff68d009640 1 -- 172.21.15.92:0/1276899241 >> 172.21.15.92:0/1276899241 conn(0x7ff6880fd8c0 msgr2=0x7ff6880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:44.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.102+0000 7ff68d009640 1 -- 172.21.15.92:0/1276899241 shutdown_connections 2024-09-19T09:06:44.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.102+0000 7ff68d009640 1 -- 172.21.15.92:0/1276899241 wait complete. 2024-09-19T09:06:44.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.103+0000 7ff68d009640 1 Processor -- start 2024-09-19T09:06:44.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.103+0000 7ff68d009640 1 -- start start 2024-09-19T09:06:44.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.103+0000 7ff68d009640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff688101de0 0x7ff688198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:44.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.103+0000 7ff68d009640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff688102790 0x7ff688198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:44.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.103+0000 7ff68d009640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff688106f10 0x7ff68819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:44.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.103+0000 7ff68d009640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff688111f70 con 0x7ff688101de0 2024-09-19T09:06:44.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.103+0000 7ff68d009640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff688111df0 con 0x7ff688106f10 2024-09-19T09:06:44.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.103+0000 7ff68d009640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff6881120f0 con 0x7ff688102790 2024-09-19T09:06:44.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.103+0000 7ff686d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff688101de0 0x7ff688198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:44.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.103+0000 7ff686d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff688101de0 0x7ff688198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52202/0 (socket says 172.21.15.92:52202) 2024-09-19T09:06:44.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.104+0000 7ff686d9d640 1 -- 172.21.15.92:0/1826102335 learned_addr learned my addr 172.21.15.92:0/1826102335 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:44.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.104+0000 7ff68759e640 1 --2- 172.21.15.92:0/1826102335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff688106f10 0x7ff68819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:44.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.104+0000 7ff68659c640 1 --2- 172.21.15.92:0/1826102335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff688102790 0x7ff688198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:44.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.104+0000 7ff686d9d640 1 -- 172.21.15.92:0/1826102335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff688102790 msgr2=0x7ff688198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:44.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.104+0000 7ff686d9d640 1 --2- 172.21.15.92:0/1826102335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff688102790 0x7ff688198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:44.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.104+0000 7ff686d9d640 1 -- 172.21.15.92:0/1826102335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff688106f10 msgr2=0x7ff68819cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:44.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.104+0000 7ff686d9d640 1 --2- 172.21.15.92:0/1826102335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff688106f10 0x7ff68819cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:44.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.104+0000 7ff686d9d640 1 -- 172.21.15.92:0/1826102335 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff68819d3e0 con 0x7ff688101de0 2024-09-19T09:06:44.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.104+0000 7ff686d9d640 1 --2- 172.21.15.92:0/1826102335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff688101de0 0x7ff688198430 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7ff678006010 tx=0x7ff6780042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:44.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.104+0000 7ff66ffff640 1 -- 172.21.15.92:0/1826102335 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67803f030 con 0x7ff688101de0 2024-09-19T09:06:44.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.104+0000 7ff68d009640 1 -- 172.21.15.92:0/1826102335 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff68819d670 con 0x7ff688101de0 2024-09-19T09:06:44.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.104+0000 7ff66ffff640 1 -- 172.21.15.92:0/1826102335 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff678003ce0 con 0x7ff688101de0 2024-09-19T09:06:44.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.104+0000 7ff66ffff640 1 -- 172.21.15.92:0/1826102335 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff678035070 con 0x7ff688101de0 2024-09-19T09:06:44.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.104+0000 7ff68d009640 1 -- 172.21.15.92:0/1826102335 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6881a4fb0 con 0x7ff688101de0 2024-09-19T09:06:44.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.105+0000 7ff68d009640 1 -- 172.21.15.92:0/1826102335 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6881032c0 con 0x7ff688101de0 2024-09-19T09:06:44.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.107+0000 7ff66ffff640 1 -- 172.21.15.92:0/1826102335 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff678042030 con 0x7ff688101de0 2024-09-19T09:06:44.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.107+0000 7ff66ffff640 1 --2- 172.21.15.92:0/1826102335 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff6700a3240 0x7ff6700a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:44.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.107+0000 7ff68659c640 1 --2- 172.21.15.92:0/1826102335 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff6700a3240 0x7ff6700a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:44.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.107+0000 7ff66ffff640 1 -- 172.21.15.92:0/1826102335 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff6780efed0 con 0x7ff688101de0 2024-09-19T09:06:44.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.108+0000 7ff68659c640 1 --2- 172.21.15.92:0/1826102335 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff6700a3240 0x7ff6700a5700 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff6880fdce0 tx=0x7ff67c00b590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:44.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.111+0000 7ff66ffff640 1 -- 172.21.15.92:0/1826102335 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff6780bccb0 con 0x7ff688101de0 2024-09-19T09:06:44.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.311+0000 7ff68d009640 1 -- 172.21.15.92:0/1826102335 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff68810a0f0 con 0x7ff688101de0 2024-09-19T09:06:44.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.311+0000 7ff66ffff640 1 -- 172.21.15.92:0/1826102335 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7ff6780bc5b0 con 0x7ff688101de0 2024-09-19T09:06:44.312 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:06:44.312 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:06:44.312 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:06:44.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.313+0000 7ff68d009640 1 -- 172.21.15.92:0/1826102335 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff6700a3240 msgr2=0x7ff6700a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:44.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.313+0000 7ff68d009640 1 --2- 172.21.15.92:0/1826102335 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff6700a3240 0x7ff6700a5700 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff6880fdce0 tx=0x7ff67c00b590 comp rx=0 tx=0).stop 2024-09-19T09:06:44.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.313+0000 7ff68d009640 1 -- 172.21.15.92:0/1826102335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff688101de0 msgr2=0x7ff688198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:44.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.313+0000 7ff68d009640 1 --2- 172.21.15.92:0/1826102335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff688101de0 0x7ff688198430 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7ff678006010 tx=0x7ff6780042f0 comp rx=0 tx=0).stop 2024-09-19T09:06:44.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.313+0000 7ff68d009640 1 -- 172.21.15.92:0/1826102335 shutdown_connections 2024-09-19T09:06:44.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.313+0000 7ff68d009640 1 --2- 172.21.15.92:0/1826102335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff688106f10 0x7ff68819cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:44.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.313+0000 7ff68d009640 1 --2- 172.21.15.92:0/1826102335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff688102790 0x7ff688198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:44.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.313+0000 7ff68d009640 1 --2- 172.21.15.92:0/1826102335 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff6700a3240 0x7ff6700a5700 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:44.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.313+0000 7ff68d009640 1 --2- 172.21.15.92:0/1826102335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff688101de0 0x7ff688198430 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:44.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.313+0000 7ff68d009640 1 -- 172.21.15.92:0/1826102335 >> 172.21.15.92:0/1826102335 conn(0x7ff6880fd8c0 msgr2=0x7ff6880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:44.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.314+0000 7ff68d009640 1 -- 172.21.15.92:0/1826102335 shutdown_connections 2024-09-19T09:06:44.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:44.314+0000 7ff68d009640 1 -- 172.21.15.92:0/1826102335 wait complete. 2024-09-19T09:06:44.851 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:44 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1826102335' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:06:44.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:44 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/1826102335' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:06:44.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:44 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/1826102335' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:06:44.877 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:06:45.122 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:06:45.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.586+0000 7ffb12bce640 1 -- 172.21.15.92:0/2695382272 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb0c101440 msgr2=0x7ffb0c10df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:45.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.586+0000 7ffb12bce640 1 --2- 172.21.15.92:0/2695382272 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb0c101440 0x7ffb0c10df30 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4009900 tx=0x7ffaf402a410 comp rx=0 tx=0).stop 2024-09-19T09:06:45.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.586+0000 7ffb12bce640 1 -- 172.21.15.92:0/2695382272 shutdown_connections 2024-09-19T09:06:45.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.586+0000 7ffb12bce640 1 --2- 172.21.15.92:0/2695382272 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb0c10e500 0x7ffb0c110910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:45.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.586+0000 7ffb12bce640 1 --2- 172.21.15.92:0/2695382272 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb0c101440 0x7ffb0c10df30 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:45.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.586+0000 7ffb12bce640 1 --2- 172.21.15.92:0/2695382272 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb0c100b20 0x7ffb0c100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:45.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.586+0000 7ffb12bce640 1 -- 172.21.15.92:0/2695382272 >> 172.21.15.92:0/2695382272 conn(0x7ffb0c0fc7d0 msgr2=0x7ffb0c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:45.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.586+0000 7ffb12bce640 1 -- 172.21.15.92:0/2695382272 shutdown_connections 2024-09-19T09:06:45.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.586+0000 7ffb12bce640 1 -- 172.21.15.92:0/2695382272 wait complete. 2024-09-19T09:06:45.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.586+0000 7ffb12bce640 1 Processor -- start 2024-09-19T09:06:45.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.586+0000 7ffb12bce640 1 -- start start 2024-09-19T09:06:45.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.587+0000 7ffb12bce640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb0c100b20 0x7ffb0c1a0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:45.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.587+0000 7ffb12bce640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb0c101440 0x7ffb0c1a0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:45.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.587+0000 7ffb12bce640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb0c10e500 0x7ffb0c19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:45.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.587+0000 7ffb12bce640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0c114270 con 0x7ffb0c101440 2024-09-19T09:06:45.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.587+0000 7ffb12bce640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0c1140f0 con 0x7ffb0c100b20 2024-09-19T09:06:45.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.587+0000 7ffb12bce640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0c1143f0 con 0x7ffb0c10e500 2024-09-19T09:06:45.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.587+0000 7ffb0bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb0c101440 0x7ffb0c1a0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:45.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.587+0000 7ffb0bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb0c101440 0x7ffb0c1a0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52218/0 (socket says 172.21.15.92:52218) 2024-09-19T09:06:45.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.587+0000 7ffb0bfff640 1 -- 172.21.15.92:0/1635699952 learned_addr learned my addr 172.21.15.92:0/1635699952 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:45.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.587+0000 7ffb1116b640 1 --2- 172.21.15.92:0/1635699952 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb0c10e500 0x7ffb0c19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:45.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.587+0000 7ffb1096a640 1 --2- 172.21.15.92:0/1635699952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb0c100b20 0x7ffb0c1a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:45.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.587+0000 7ffb0bfff640 1 -- 172.21.15.92:0/1635699952 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb0c10e500 msgr2=0x7ffb0c19a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:45.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.587+0000 7ffb0bfff640 1 --2- 172.21.15.92:0/1635699952 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb0c10e500 0x7ffb0c19a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:45.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.587+0000 7ffb0bfff640 1 -- 172.21.15.92:0/1635699952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb0c100b20 msgr2=0x7ffb0c1a0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:45.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.587+0000 7ffb0bfff640 1 --2- 172.21.15.92:0/1635699952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb0c100b20 0x7ffb0c1a0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:45.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.587+0000 7ffb0bfff640 1 -- 172.21.15.92:0/1635699952 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb0c19ad30 con 0x7ffb0c101440 2024-09-19T09:06:45.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.587+0000 7ffb0bfff640 1 --2- 172.21.15.92:0/1635699952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb0c101440 0x7ffb0c1a0980 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4005940 tx=0x7ffaf40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:45.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.587+0000 7ffb09ffb640 1 -- 172.21.15.92:0/1635699952 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf403f030 con 0x7ffb0c101440 2024-09-19T09:06:45.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.588+0000 7ffb09ffb640 1 -- 172.21.15.92:0/1635699952 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffaf4003ce0 con 0x7ffb0c101440 2024-09-19T09:06:45.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.588+0000 7ffb12bce640 1 -- 172.21.15.92:0/1635699952 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb0c19afc0 con 0x7ffb0c101440 2024-09-19T09:06:45.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.588+0000 7ffb09ffb640 1 -- 172.21.15.92:0/1635699952 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf4035070 con 0x7ffb0c101440 2024-09-19T09:06:45.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.588+0000 7ffb12bce640 1 -- 172.21.15.92:0/1635699952 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb0c1a7310 con 0x7ffb0c101440 2024-09-19T09:06:45.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.591+0000 7ffb09ffb640 1 -- 172.21.15.92:0/1635699952 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ffaf4042030 con 0x7ffb0c101440 2024-09-19T09:06:45.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.591+0000 7ffb14fa7740 1 Processor -- start 2024-09-19T09:06:45.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.591+0000 7ffb14fa7740 1 -- start start 2024-09-19T09:06:45.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.591+0000 7ffb14fa7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56238ae8ab40 0x56238ae89090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:45.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.591+0000 7ffb14fa7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56238ae895d0 0x56238ae89a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:45.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.591+0000 7ffb14fa7740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56238ae94370 0x56238ae96760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:45.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.591+0000 7ffb14fa7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56238adef2f0 con 0x56238ae895d0 2024-09-19T09:06:45.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.591+0000 7ffb14fa7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56238ad96cf0 con 0x56238ae8ab40 2024-09-19T09:06:45.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.591+0000 7ffb14fa7740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56238adeb2b0 con 0x56238ae94370 2024-09-19T09:06:45.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.591+0000 7ffb1096a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56238ae895d0 0x56238ae89a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:45.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.591+0000 7ffb1096a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56238ae895d0 0x56238ae89a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52226/0 (socket says 172.21.15.92:52226) 2024-09-19T09:06:45.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.591+0000 7ffb1096a640 1 -- 172.21.15.92:0/1860955027 learned_addr learned my addr 172.21.15.92:0/1860955027 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:45.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.591+0000 7ffb0bfff640 1 --2- 172.21.15.92:0/1860955027 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56238ae94370 0x56238ae96760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:45.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.591+0000 7ffb1116b640 1 --2- 172.21.15.92:0/1860955027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56238ae8ab40 0x56238ae89090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:45.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.592+0000 7ffb09ffb640 1 --2- 172.21.15.92:0/1635699952 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffaf80a3240 0x7ffaf80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:45.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.592+0000 7ffb1096a640 1 -- 172.21.15.92:0/1860955027 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56238ae94370 msgr2=0x56238ae96760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:45.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.592+0000 7ffb1096a640 1 --2- 172.21.15.92:0/1860955027 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56238ae94370 0x56238ae96760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:45.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.592+0000 7ffb1096a640 1 -- 172.21.15.92:0/1860955027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56238ae8ab40 msgr2=0x56238ae89090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:45.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.592+0000 7ffb1096a640 1 --2- 172.21.15.92:0/1860955027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56238ae8ab40 0x56238ae89090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:45.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.592+0000 7ffb1096a640 1 -- 172.21.15.92:0/1860955027 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56238ad7b3a0 con 0x56238ae895d0 2024-09-19T09:06:45.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.592+0000 7ffb1116b640 1 --2- 172.21.15.92:0/1635699952 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffaf80a3240 0x7ffaf80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:45.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.592+0000 7ffb09ffb640 1 -- 172.21.15.92:0/1635699952 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ffaf40efe80 con 0x7ffb0c101440 2024-09-19T09:06:45.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.592+0000 7ffb1096a640 1 --2- 172.21.15.92:0/1860955027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56238ae895d0 0x56238ae89a10 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7ffafc009f60 tx=0x7ffafc009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a33770fc8ceabb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:45.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.592+0000 7ffb02ffd640 1 -- 172.21.15.92:0/1860955027 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffafc016070 con 0x56238ae895d0 2024-09-19T09:06:45.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.592+0000 7ffb02ffd640 1 -- 172.21.15.92:0/1860955027 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffafc004d20 con 0x56238ae895d0 2024-09-19T09:06:45.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.592+0000 7ffb02ffd640 1 -- 172.21.15.92:0/1860955027 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffafc0128b0 con 0x56238ae895d0 2024-09-19T09:06:45.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.593+0000 7ffb14fa7740 1 -- 172.21.15.92:0/1860955027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56238ae895d0 msgr2=0x56238ae89a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:45.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.593+0000 7ffb1116b640 1 --2- 172.21.15.92:0/1635699952 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffaf80a3240 0x7ffaf80a5700 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ffb04005fd0 tx=0x7ffb040046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:45.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.593+0000 7ffb14fa7740 1 --2- 172.21.15.92:0/1860955027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56238ae895d0 0x56238ae89a10 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7ffafc009f60 tx=0x7ffafc009f90 comp rx=0 tx=0).stop 2024-09-19T09:06:45.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.593+0000 7ffb14fa7740 1 -- 172.21.15.92:0/1860955027 shutdown_connections 2024-09-19T09:06:45.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.593+0000 7ffb14fa7740 1 --2- 172.21.15.92:0/1860955027 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56238ae94370 0x56238ae96760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:45.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.593+0000 7ffb14fa7740 1 --2- 172.21.15.92:0/1860955027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56238ae895d0 0x56238ae89a10 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:45.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.593+0000 7ffb14fa7740 1 --2- 172.21.15.92:0/1860955027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56238ae8ab40 0x56238ae89090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:45.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.593+0000 7ffb14fa7740 1 -- 172.21.15.92:0/1860955027 >> 172.21.15.92:0/1860955027 conn(0x56238ae52310 msgr2=0x56238ae85c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:45.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.593+0000 7ffb14fa7740 1 -- 172.21.15.92:0/1860955027 shutdown_connections 2024-09-19T09:06:45.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.593+0000 7ffb14fa7740 1 -- 172.21.15.92:0/1860955027 wait complete. 2024-09-19T09:06:45.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.593+0000 7ffb14fa7740 1 -- start start 2024-09-19T09:06:45.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.593+0000 7ffb14fa7740 1 Processor -- start 2024-09-19T09:06:45.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.594+0000 7ffb14fa7740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56238ae895d0 0x56238ae93d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:45.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.594+0000 7ffb14fa7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56238ae8ab40 0x56238ae90fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:45.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.594+0000 7ffb14fa7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56238ae94370 0x56238ae91570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:45.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.594+0000 7ffb14fa7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56238ae97070 con 0x56238ae94370 2024-09-19T09:06:45.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.594+0000 7ffb14fa7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56238adaa060 con 0x56238ae8ab40 2024-09-19T09:06:45.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.594+0000 7ffb14fa7740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56238ae971f0 con 0x56238ae895d0 2024-09-19T09:06:45.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.594+0000 7ffb14fa7740 10 client.0 _ll_register_callbacks cb 0x56238aafd8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:45.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.594+0000 7ffb1116b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56238ae94370 0x56238ae91570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:45.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.594+0000 7ffb1116b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56238ae94370 0x56238ae91570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52242/0 (socket says 172.21.15.92:52242) 2024-09-19T09:06:45.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.594+0000 7ffb1116b640 1 -- 172.21.15.92:0/3473649963 learned_addr learned my addr 172.21.15.92:0/3473649963 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:45.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.594+0000 7ffb1096a640 1 --2- 172.21.15.92:0/3473649963 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56238ae895d0 0x56238ae93d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:45.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.594+0000 7ffb0bfff640 1 --2- 172.21.15.92:0/3473649963 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56238ae8ab40 0x56238ae90fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:45.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.594+0000 7ffb1116b640 1 -- 172.21.15.92:0/3473649963 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56238ae895d0 msgr2=0x56238ae93d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:45.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.594+0000 7ffb1116b640 1 --2- 172.21.15.92:0/3473649963 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56238ae895d0 0x56238ae93d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:45.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.594+0000 7ffb1116b640 1 -- 172.21.15.92:0/3473649963 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56238ae8ab40 msgr2=0x56238ae90fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:45.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.594+0000 7ffb1116b640 1 --2- 172.21.15.92:0/3473649963 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56238ae8ab40 0x56238ae90fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:45.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.594+0000 7ffb1116b640 1 -- 172.21.15.92:0/3473649963 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56238ab603c0 con 0x56238ae94370 2024-09-19T09:06:45.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.594+0000 7ffb1116b640 1 --2- 172.21.15.92:0/3473649963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56238ae94370 0x56238ae91570 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7ffb04010ac0 tx=0x7ffb04004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcdec3ac1688a44a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:45.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.594+0000 7ffaebfff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:06:45.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.595+0000 7ffaebfff640 1 -- 172.21.15.92:0/3473649963 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0400f9f0 con 0x56238ae94370 2024-09-19T09:06:45.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.595+0000 7ffaebfff640 1 -- 172.21.15.92:0/3473649963 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ffb0400fb90 con 0x56238ae94370 2024-09-19T09:06:45.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.595+0000 7ffb14fa7740 1 -- 172.21.15.92:0/3473649963 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffafc004d20 con 0x56238ae94370 2024-09-19T09:06:45.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.595+0000 7ffaebfff640 1 -- 172.21.15.92:0/3473649963 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ffb0400fd90 con 0x56238ae94370 2024-09-19T09:06:45.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.595+0000 7ffb14fa7740 10 client.17787 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:45.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.595+0000 7ffb14fa7740 1 -- 172.21.15.92:0/3473649963 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56238aea2b20 con 0x56238ae94370 2024-09-19T09:06:45.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.595+0000 7ffaebfff640 1 -- 172.21.15.92:0/3473649963 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffafc004d20 con 0x56238ae94370 2024-09-19T09:06:45.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.595+0000 7ffaebfff640 1 -- 172.21.15.92:0/3473649963 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ffb040285c0 con 0x56238ae94370 2024-09-19T09:06:45.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.595+0000 7ffb14fa7740 10 client.17787 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:45.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.595+0000 7ffb14fa7740 10 client.17787 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:06:45.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.595+0000 7ffb14fa7740 20 client.17787 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:45.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.595+0000 7ffb14fa7740 1 --2- 172.21.15.92:0/3473649963 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56238aea3fe0 0x56238aea6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:45.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.595+0000 7ffb14fa7740 4 client.17787 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:06:45.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.595+0000 7ffb14fa7740 1 -- 172.21.15.92:0/3473649963 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56238adfc860 con 0x56238aea3fe0 2024-09-19T09:06:45.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.595+0000 7ffb1096a640 1 --2- 172.21.15.92:0/3473649963 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56238aea3fe0 0x56238aea6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:45.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.596+0000 7ffb1096a640 1 --2- 172.21.15.92:0/3473649963 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56238aea3fe0 0x56238aea6480 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=504227f28d91fc85 server_cookie=3439e002b65d02bd in_seq=0 out_seq=0 2024-09-19T09:06:45.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.596+0000 7ffaebfff640 10 client.17787 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:45.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.597+0000 7ffaebfff640 1 -- 172.21.15.92:0/3473649963 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56238adfc860 con 0x56238aea3fe0 2024-09-19T09:06:45.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.597+0000 7ffaebfff640 10 client.17787 handle_command_reply: tid=0 2024-09-19T09:06:45.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.597+0000 7ffb14fa7740 1 client.17787 shutdown 2024-09-19T09:06:45.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.597+0000 7ffb14fa7740 1 -- 172.21.15.92:0/3473649963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56238ae94370 msgr2=0x56238ae91570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:45.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.597+0000 7ffb14fa7740 1 --2- 172.21.15.92:0/3473649963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56238ae94370 0x56238ae91570 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7ffb04010ac0 tx=0x7ffb04004730 comp rx=0 tx=0).stop 2024-09-19T09:06:45.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.597+0000 7ffb14fa7740 1 -- 172.21.15.92:0/3473649963 shutdown_connections 2024-09-19T09:06:45.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.597+0000 7ffb14fa7740 1 --2- 172.21.15.92:0/3473649963 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56238aea3fe0 0x56238aea6480 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:45.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.597+0000 7ffaebfff640 0 client.17787 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:45.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.597+0000 7ffb14fa7740 1 --2- 172.21.15.92:0/3473649963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56238ae94370 0x56238ae91570 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:45.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.597+0000 7ffb14fa7740 1 --2- 172.21.15.92:0/3473649963 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56238ae8ab40 0x56238ae90fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:45.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.597+0000 7ffb14fa7740 1 --2- 172.21.15.92:0/3473649963 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56238ae895d0 0x56238ae93d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:45.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.597+0000 7ffb14fa7740 1 -- 172.21.15.92:0/3473649963 >> 172.21.15.92:0/3473649963 conn(0x56238ae52310 msgr2=0x56238ae8b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:45.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.597+0000 7ffb14fa7740 1 -- 172.21.15.92:0/3473649963 shutdown_connections 2024-09-19T09:06:45.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.597+0000 7ffb14fa7740 1 -- 172.21.15.92:0/3473649963 wait complete. 2024-09-19T09:06:45.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.597+0000 7ffb14fa7740 20 client.17787 trim_cache size 0 max 16384 2024-09-19T09:06:45.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.610+0000 7ffb14fa7740 1 Processor -- start 2024-09-19T09:06:45.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.610+0000 7ffb14fa7740 1 -- start start 2024-09-19T09:06:45.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.610+0000 7ffb14fa7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56238ae895d0 0x56238ae84bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:45.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.610+0000 7ffb14fa7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56238ae8ab40 0x56238ae8c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:45.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.610+0000 7ffb14fa7740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56238ae94370 0x56238ae8c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:45.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.610+0000 7ffb14fa7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0c1ad800 con 0x56238ae895d0 2024-09-19T09:06:45.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.610+0000 7ffb14fa7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0c1b00a0 con 0x56238ae8ab40 2024-09-19T09:06:45.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.610+0000 7ffb14fa7740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0c1ade90 con 0x56238ae94370 2024-09-19T09:06:45.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.610+0000 7ffb1096a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56238ae895d0 0x56238ae84bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:45.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.610+0000 7ffb1096a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56238ae895d0 0x56238ae84bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52256/0 (socket says 172.21.15.92:52256) 2024-09-19T09:06:45.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.610+0000 7ffb1096a640 1 -- 172.21.15.92:0/2472398826 learned_addr learned my addr 172.21.15.92:0/2472398826 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:45.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.610+0000 7ffb0bfff640 1 --2- 172.21.15.92:0/2472398826 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56238ae8ab40 0x56238ae8c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:45.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.610+0000 7ffb1116b640 1 --2- 172.21.15.92:0/2472398826 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56238ae94370 0x56238ae8c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:45.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.610+0000 7ffb1096a640 1 -- 172.21.15.92:0/2472398826 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56238ae94370 msgr2=0x56238ae8c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:45.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.610+0000 7ffb1096a640 1 --2- 172.21.15.92:0/2472398826 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56238ae94370 0x56238ae8c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:45.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.611+0000 7ffb1096a640 1 -- 172.21.15.92:0/2472398826 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56238ae8ab40 msgr2=0x56238ae8c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:45.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.611+0000 7ffb1096a640 1 --2- 172.21.15.92:0/2472398826 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56238ae8ab40 0x56238ae8c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:45.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.611+0000 7ffb1096a640 1 -- 172.21.15.92:0/2472398826 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56238ae96ad0 con 0x56238ae895d0 2024-09-19T09:06:45.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.611+0000 7ffb0bfff640 1 --2- 172.21.15.92:0/2472398826 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56238ae8ab40 0x56238ae8c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:45.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.611+0000 7ffb1116b640 1 --2- 172.21.15.92:0/2472398826 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56238ae94370 0x56238ae8c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:06:45.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.611+0000 7ffb1096a640 1 --2- 172.21.15.92:0/2472398826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56238ae895d0 0x56238ae84bf0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7ffafc009f60 tx=0x7ffafc005a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=490331073d041283 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:45.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.611+0000 7ffb027fc640 1 -- 172.21.15.92:0/2472398826 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffafc016040 con 0x56238ae895d0 2024-09-19T09:06:45.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.611+0000 7ffb027fc640 1 -- 172.21.15.92:0/2472398826 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffafc0129f0 con 0x56238ae895d0 2024-09-19T09:06:45.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.611+0000 7ffb027fc640 1 -- 172.21.15.92:0/2472398826 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffafc025b20 con 0x56238ae895d0 2024-09-19T09:06:45.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.611+0000 7ffb14fa7740 1 -- 172.21.15.92:0/2472398826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56238ae895d0 msgr2=0x56238ae84bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:45.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.611+0000 7ffb14fa7740 1 --2- 172.21.15.92:0/2472398826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56238ae895d0 0x56238ae84bf0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7ffafc009f60 tx=0x7ffafc005a80 comp rx=0 tx=0).stop 2024-09-19T09:06:45.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.612+0000 7ffb14fa7740 1 -- 172.21.15.92:0/2472398826 shutdown_connections 2024-09-19T09:06:45.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.612+0000 7ffb14fa7740 1 --2- 172.21.15.92:0/2472398826 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56238ae94370 0x56238ae8c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:45.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.612+0000 7ffb14fa7740 1 --2- 172.21.15.92:0/2472398826 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56238ae8ab40 0x56238ae8c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:45.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.612+0000 7ffb14fa7740 1 --2- 172.21.15.92:0/2472398826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56238ae895d0 0x56238ae84bf0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:45.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.612+0000 7ffb14fa7740 1 -- 172.21.15.92:0/2472398826 >> 172.21.15.92:0/2472398826 conn(0x56238ae52310 msgr2=0x56238ae844e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:45.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.612+0000 7ffb14fa7740 1 -- 172.21.15.92:0/2472398826 shutdown_connections 2024-09-19T09:06:45.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.612+0000 7ffb14fa7740 1 -- 172.21.15.92:0/2472398826 wait complete. 2024-09-19T09:06:45.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.612+0000 7ffb14fa7740 1 -- start start 2024-09-19T09:06:45.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.612+0000 7ffb14fa7740 1 Processor -- start 2024-09-19T09:06:45.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.612+0000 7ffb14fa7740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56238ae895d0 0x56238ae8df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:45.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.612+0000 7ffb14fa7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56238ae8ab40 0x56238ae8e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:45.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.612+0000 7ffb14fa7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56238ae94370 0x56238ae8e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:45.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.612+0000 7ffb14fa7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0c1ae560 con 0x56238ae8ab40 2024-09-19T09:06:45.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.612+0000 7ffb14fa7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0c1af9d0 con 0x56238ae94370 2024-09-19T09:06:45.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.612+0000 7ffb14fa7740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0c1aec30 con 0x56238ae895d0 2024-09-19T09:06:45.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.612+0000 7ffb14fa7740 10 client.0 _ll_register_callbacks cb 0x7ffb0400a880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:45.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.613+0000 7ffb0bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56238ae8ab40 0x56238ae8e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:45.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.613+0000 7ffb0bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56238ae8ab40 0x56238ae8e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52266/0 (socket says 172.21.15.92:52266) 2024-09-19T09:06:45.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.613+0000 7ffb0bfff640 1 -- 172.21.15.92:0/3110996969 learned_addr learned my addr 172.21.15.92:0/3110996969 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:45.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.613+0000 7ffb1096a640 1 --2- 172.21.15.92:0/3110996969 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56238ae895d0 0x56238ae8df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:45.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.613+0000 7ffb1116b640 1 --2- 172.21.15.92:0/3110996969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56238ae94370 0x56238ae8e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:45.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.613+0000 7ffb0bfff640 1 -- 172.21.15.92:0/3110996969 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56238ae895d0 msgr2=0x56238ae8df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:45.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.613+0000 7ffb0bfff640 1 --2- 172.21.15.92:0/3110996969 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56238ae895d0 0x56238ae8df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:45.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.613+0000 7ffb0bfff640 1 -- 172.21.15.92:0/3110996969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56238ae94370 msgr2=0x56238ae8e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:45.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.613+0000 7ffb0bfff640 1 --2- 172.21.15.92:0/3110996969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56238ae94370 0x56238ae8e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:45.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.613+0000 7ffb0bfff640 1 -- 172.21.15.92:0/3110996969 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56238af0dd70 con 0x56238ae8ab40 2024-09-19T09:06:45.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.613+0000 7ffb0bfff640 1 --2- 172.21.15.92:0/3110996969 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56238ae8ab40 0x56238ae8e440 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7ffaf40b8900 tx=0x7ffaf40f3430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7532ba8ed65d945 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:45.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.613+0000 7ffaebfff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:06:45.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.613+0000 7ffaebfff640 1 -- 172.21.15.92:0/3110996969 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf4049050 con 0x56238ae8ab40 2024-09-19T09:06:45.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.613+0000 7ffaebfff640 1 -- 172.21.15.92:0/3110996969 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ffaf40b8b10 con 0x56238ae8ab40 2024-09-19T09:06:45.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.613+0000 7ffb14fa7740 1 -- 172.21.15.92:0/3110996969 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffafc0129f0 con 0x56238ae8ab40 2024-09-19T09:06:45.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.613+0000 7ffaebfff640 1 -- 172.21.15.92:0/3110996969 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ffaf40bbfe0 con 0x56238ae8ab40 2024-09-19T09:06:45.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.613+0000 7ffb14fa7740 10 client.17793 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:45.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.613+0000 7ffb14fa7740 1 -- 172.21.15.92:0/3110996969 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56238af0efb0 con 0x56238ae8ab40 2024-09-19T09:06:45.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.613+0000 7ffaebfff640 1 -- 172.21.15.92:0/3110996969 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffafc0129f0 con 0x56238ae8ab40 2024-09-19T09:06:45.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.614+0000 7ffaebfff640 1 -- 172.21.15.92:0/3110996969 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ffaf403bc50 con 0x56238ae8ab40 2024-09-19T09:06:45.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.614+0000 7ffb14fa7740 10 client.17793 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:45.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.614+0000 7ffb14fa7740 10 client.17793 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:06:45.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.614+0000 7ffb14fa7740 20 client.17793 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:45.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.614+0000 7ffb14fa7740 1 --2- 172.21.15.92:0/3110996969 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56238aea3fe0 0x56238af117f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:45.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.614+0000 7ffb14fa7740 4 client.17793 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:06:45.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.614+0000 7ffb14fa7740 1 -- 172.21.15.92:0/3110996969 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56238adf6d70 con 0x56238aea3fe0 2024-09-19T09:06:45.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.614+0000 7ffb1096a640 1 --2- 172.21.15.92:0/3110996969 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56238aea3fe0 0x56238af117f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:45.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.614+0000 7ffaebfff640 10 client.17793 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:45.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.614+0000 7ffb1096a640 1 --2- 172.21.15.92:0/3110996969 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56238aea3fe0 0x56238af117f0 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=347294b24b370c32 server_cookie=71e3eca88dfe5f46 in_seq=0 out_seq=0 2024-09-19T09:06:45.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.615+0000 7ffaebfff640 1 -- 172.21.15.92:0/3110996969 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56238adf6d70 con 0x56238aea3fe0 2024-09-19T09:06:45.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.615+0000 7ffaebfff640 10 client.17793 handle_command_reply: tid=0 2024-09-19T09:06:45.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.615+0000 7ffb14fa7740 1 client.17793 shutdown 2024-09-19T09:06:45.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.615+0000 7ffb14fa7740 1 -- 172.21.15.92:0/3110996969 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56238ae8ab40 msgr2=0x56238ae8e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:45.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.615+0000 7ffb14fa7740 1 --2- 172.21.15.92:0/3110996969 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56238ae8ab40 0x56238ae8e440 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7ffaf40b8900 tx=0x7ffaf40f3430 comp rx=0 tx=0).stop 2024-09-19T09:06:45.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.615+0000 7ffb14fa7740 1 -- 172.21.15.92:0/3110996969 shutdown_connections 2024-09-19T09:06:45.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.615+0000 7ffb14fa7740 1 --2- 172.21.15.92:0/3110996969 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56238aea3fe0 0x56238af117f0 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:45.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.615+0000 7ffb14fa7740 1 --2- 172.21.15.92:0/3110996969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56238ae94370 0x56238ae8e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:45.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.615+0000 7ffb14fa7740 1 --2- 172.21.15.92:0/3110996969 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56238ae8ab40 0x56238ae8e440 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:45.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.615+0000 7ffb14fa7740 1 --2- 172.21.15.92:0/3110996969 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56238ae895d0 0x56238ae8df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:45.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.615+0000 7ffb14fa7740 1 -- 172.21.15.92:0/3110996969 >> 172.21.15.92:0/3110996969 conn(0x56238ae52310 msgr2=0x56238ae93050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:45.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.615+0000 7ffaebfff640 0 client.17793 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:45.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.615+0000 7ffb14fa7740 1 -- 172.21.15.92:0/3110996969 shutdown_connections 2024-09-19T09:06:45.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.615+0000 7ffb14fa7740 1 -- 172.21.15.92:0/3110996969 wait complete. 2024-09-19T09:06:45.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.615+0000 7ffb14fa7740 20 client.17793 trim_cache size 0 max 16384 2024-09-19T09:06:45.628 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-19T09:06:45.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.616+0000 7ffb12bce640 1 -- 172.21.15.92:0/1635699952 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffaf80a3240 msgr2=0x7ffaf80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:45.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.616+0000 7ffb12bce640 1 --2- 172.21.15.92:0/1635699952 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffaf80a3240 0x7ffaf80a5700 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ffb04005fd0 tx=0x7ffb040046c0 comp rx=0 tx=0).stop 2024-09-19T09:06:45.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.616+0000 7ffb12bce640 1 -- 172.21.15.92:0/1635699952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb0c101440 msgr2=0x7ffb0c1a0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:45.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.616+0000 7ffb12bce640 1 --2- 172.21.15.92:0/1635699952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb0c101440 0x7ffb0c1a0980 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4005940 tx=0x7ffaf40042f0 comp rx=0 tx=0).stop 2024-09-19T09:06:45.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.616+0000 7ffb12bce640 1 -- 172.21.15.92:0/1635699952 shutdown_connections 2024-09-19T09:06:45.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.616+0000 7ffb12bce640 1 --2- 172.21.15.92:0/1635699952 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb0c10e500 0x7ffb0c19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:45.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.616+0000 7ffb12bce640 1 --2- 172.21.15.92:0/1635699952 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffaf80a3240 0x7ffaf80a5700 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:45.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.616+0000 7ffb12bce640 1 --2- 172.21.15.92:0/1635699952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb0c101440 0x7ffb0c1a0980 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:45.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.616+0000 7ffb12bce640 1 --2- 172.21.15.92:0/1635699952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb0c100b20 0x7ffb0c1a0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:45.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.616+0000 7ffb12bce640 1 -- 172.21.15.92:0/1635699952 >> 172.21.15.92:0/1635699952 conn(0x7ffb0c0fc7d0 msgr2=0x7ffb0c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:45.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.616+0000 7ffb12bce640 1 -- 172.21.15.92:0/1635699952 shutdown_connections 2024-09-19T09:06:45.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:45.616+0000 7ffb12bce640 1 -- 172.21.15.92:0/1635699952 wait complete. 2024-09-19T09:06:45.796 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:06:45.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:45 smithi167 ceph-mon[35359]: pgmap v638: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.2 MiB/s wr, 113 op/s 2024-09-19T09:06:45.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:45 smithi190 ceph-mon[35358]: pgmap v638: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.2 MiB/s wr, 113 op/s 2024-09-19T09:06:45.925 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:45 smithi092 ceph-mon[31407]: pgmap v638: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.2 MiB/s wr, 113 op/s 2024-09-19T09:06:47.246 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:06:47.247 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:06:47.512 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:06:47.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:47 smithi167 ceph-mon[35359]: pgmap v639: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 353 KiB/s wr, 39 op/s 2024-09-19T09:06:47.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:47 smithi190 ceph-mon[35358]: pgmap v639: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 353 KiB/s wr, 39 op/s 2024-09-19T09:06:47.897 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:47 smithi092 ceph-mon[31407]: pgmap v639: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 353 KiB/s wr, 39 op/s 2024-09-19T09:06:47.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.978+0000 7f1f3cebd640 1 -- 172.21.15.92:0/3290775350 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f38103660 msgr2=0x7f1f3810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:47.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.978+0000 7f1f3cebd640 1 --2- 172.21.15.92:0/3290775350 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f38103660 0x7f1f3810bb50 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c009900 tx=0x7f1f2c02a480 comp rx=0 tx=0).stop 2024-09-19T09:06:47.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.978+0000 7f1f3cebd640 1 -- 172.21.15.92:0/3290775350 shutdown_connections 2024-09-19T09:06:47.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.978+0000 7f1f3cebd640 1 --2- 172.21.15.92:0/3290775350 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1f3810c170 0x7f1f3810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:47.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.978+0000 7f1f3cebd640 1 --2- 172.21.15.92:0/3290775350 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f38103660 0x7f1f3810bb50 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:47.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.978+0000 7f1f3cebd640 1 --2- 172.21.15.92:0/3290775350 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f38102d40 0x7f1f38103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:47.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.978+0000 7f1f3cebd640 1 -- 172.21.15.92:0/3290775350 >> 172.21.15.92:0/3290775350 conn(0x7f1f380fc7a0 msgr2=0x7f1f380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:47.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.978+0000 7f1f3cebd640 1 -- 172.21.15.92:0/3290775350 shutdown_connections 2024-09-19T09:06:47.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.978+0000 7f1f3cebd640 1 -- 172.21.15.92:0/3290775350 wait complete. 2024-09-19T09:06:47.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.979+0000 7f1f3cebd640 1 Processor -- start 2024-09-19T09:06:47.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.979+0000 7f1f3cebd640 1 -- start start 2024-09-19T09:06:47.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.979+0000 7f1f3cebd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1f38102d40 0x7f1f38198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:47.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.979+0000 7f1f3cebd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f38103660 0x7f1f38198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:47.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.979+0000 7f1f3cebd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f3810c170 0x7f1f3819ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:47.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.979+0000 7f1f3cebd640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1f38112030 con 0x7f1f3810c170 2024-09-19T09:06:47.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.979+0000 7f1f3cebd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1f38111eb0 con 0x7f1f38103660 2024-09-19T09:06:47.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.979+0000 7f1f3cebd640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1f381121b0 con 0x7f1f38102d40 2024-09-19T09:06:47.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.979+0000 7f1f36d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f3810c170 0x7f1f3819ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:47.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.979+0000 7f1f36d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f3810c170 0x7f1f3819ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52280/0 (socket says 172.21.15.92:52280) 2024-09-19T09:06:47.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.980+0000 7f1f36d9d640 1 -- 172.21.15.92:0/2832500832 learned_addr learned my addr 172.21.15.92:0/2832500832 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:47.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.980+0000 7f1f35d9b640 1 --2- 172.21.15.92:0/2832500832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f38103660 0x7f1f38198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:47.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.980+0000 7f1f3659c640 1 --2- 172.21.15.92:0/2832500832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1f38102d40 0x7f1f38198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:47.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.980+0000 7f1f36d9d640 1 -- 172.21.15.92:0/2832500832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1f38102d40 msgr2=0x7f1f38198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:47.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.980+0000 7f1f36d9d640 1 --2- 172.21.15.92:0/2832500832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1f38102d40 0x7f1f38198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:47.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.980+0000 7f1f36d9d640 1 -- 172.21.15.92:0/2832500832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f38103660 msgr2=0x7f1f38198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:47.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.980+0000 7f1f36d9d640 1 --2- 172.21.15.92:0/2832500832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f38103660 0x7f1f38198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:47.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.980+0000 7f1f36d9d640 1 -- 172.21.15.92:0/2832500832 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f3819d530 con 0x7f1f3810c170 2024-09-19T09:06:47.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.980+0000 7f1f35d9b640 1 --2- 172.21.15.92:0/2832500832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f38103660 0x7f1f38198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:47.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.980+0000 7f1f3659c640 1 --2- 172.21.15.92:0/2832500832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1f38102d40 0x7f1f38198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:06:47.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.980+0000 7f1f36d9d640 1 --2- 172.21.15.92:0/2832500832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f3810c170 0x7f1f3819ce50 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f1f3000b970 tx=0x7f1f3000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:47.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.980+0000 7f1f277fe640 1 -- 172.21.15.92:0/2832500832 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f30019070 con 0x7f1f3810c170 2024-09-19T09:06:48.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.980+0000 7f1f277fe640 1 -- 172.21.15.92:0/2832500832 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f3000cb40 con 0x7f1f3810c170 2024-09-19T09:06:48.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.980+0000 7f1f3cebd640 1 -- 172.21.15.92:0/2832500832 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f3819d820 con 0x7f1f3810c170 2024-09-19T09:06:48.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.980+0000 7f1f277fe640 1 -- 172.21.15.92:0/2832500832 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f30007650 con 0x7f1f3810c170 2024-09-19T09:06:48.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.980+0000 7f1f3cebd640 1 -- 172.21.15.92:0/2832500832 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f381a5100 con 0x7f1f3810c170 2024-09-19T09:06:48.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.982+0000 7f1f277fe640 1 -- 172.21.15.92:0/2832500832 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1f3001c070 con 0x7f1f3810c170 2024-09-19T09:06:48.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.983+0000 7f1f3f296740 1 Processor -- start 2024-09-19T09:06:48.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.983+0000 7f1f3f296740 1 -- start start 2024-09-19T09:06:48.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.983+0000 7f1f3f296740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3ca652b60 0x55e3ca652f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:48.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.983+0000 7f1f3f296740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3ca653480 0x55e3ca65d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:48.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.983+0000 7f1f3f296740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3ca65dd40 0x55e3ca660130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:48.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.983+0000 7f1f3f296740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e3ca5b8280 con 0x55e3ca65dd40 2024-09-19T09:06:48.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.983+0000 7f1f3f296740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e3ca55fb10 con 0x55e3ca653480 2024-09-19T09:06:48.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.983+0000 7f1f3f296740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e3ca5b4240 con 0x55e3ca652b60 2024-09-19T09:06:48.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.983+0000 7f1f277fe640 1 --2- 172.21.15.92:0/2832500832 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1f200a3240 0x7f1f200a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:48.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.983+0000 7f1f35d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3ca65dd40 0x55e3ca660130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:48.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.983+0000 7f1f35d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3ca65dd40 0x55e3ca660130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52286/0 (socket says 172.21.15.92:52286) 2024-09-19T09:06:48.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.983+0000 7f1f35d9b640 1 -- 172.21.15.92:0/1791915966 learned_addr learned my addr 172.21.15.92:0/1791915966 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:48.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.983+0000 7f1f35d9b640 1 --2- 172.21.15.92:0/1791915966 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3ca652b60 0x55e3ca652f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:48.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.983+0000 7f1f36d9d640 1 --2- 172.21.15.92:0/2832500832 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1f200a3240 0x7f1f200a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:48.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.983+0000 7f1f3659c640 1 --2- 172.21.15.92:0/1791915966 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3ca653480 0x55e3ca65d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:48.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.984+0000 7f1f277fe640 1 -- 172.21.15.92:0/2832500832 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1f300cefb0 con 0x7f1f3810c170 2024-09-19T09:06:48.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.984+0000 7f1f35d9b640 1 -- 172.21.15.92:0/1791915966 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3ca652b60 msgr2=0x55e3ca652f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:48.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.984+0000 7f1f35d9b640 1 --2- 172.21.15.92:0/1791915966 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3ca652b60 0x55e3ca652f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:48.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.984+0000 7f1f35d9b640 1 -- 172.21.15.92:0/1791915966 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3ca653480 msgr2=0x55e3ca65d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:48.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.984+0000 7f1f35d9b640 1 --2- 172.21.15.92:0/1791915966 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3ca653480 0x55e3ca65d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:48.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.984+0000 7f1f35d9b640 1 -- 172.21.15.92:0/1791915966 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3ca56c1f0 con 0x55e3ca65dd40 2024-09-19T09:06:48.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.984+0000 7f1f36d9d640 1 --2- 172.21.15.92:0/2832500832 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1f200a3240 0x7f1f200a5700 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1f30016000 tx=0x7f1f3000e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:48.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.984+0000 7f1f35d9b640 1 --2- 172.21.15.92:0/1791915966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3ca65dd40 0x55e3ca660130 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c02a9a0 tx=0x7f1f2c031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=631bf123727a4b05 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:48.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.984+0000 7f1f24ff9640 1 -- 172.21.15.92:0/1791915966 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c035040 con 0x55e3ca65dd40 2024-09-19T09:06:48.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.984+0000 7f1f24ff9640 1 -- 172.21.15.92:0/1791915966 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f2c005020 con 0x55e3ca65dd40 2024-09-19T09:06:48.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.984+0000 7f1f24ff9640 1 -- 172.21.15.92:0/1791915966 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c0049c0 con 0x55e3ca65dd40 2024-09-19T09:06:48.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.985+0000 7f1f3f296740 1 -- 172.21.15.92:0/1791915966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3ca65dd40 msgr2=0x55e3ca660130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:48.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.985+0000 7f1f3f296740 1 --2- 172.21.15.92:0/1791915966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3ca65dd40 0x55e3ca660130 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c02a9a0 tx=0x7f1f2c031400 comp rx=0 tx=0).stop 2024-09-19T09:06:48.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.985+0000 7f1f3f296740 1 -- 172.21.15.92:0/1791915966 shutdown_connections 2024-09-19T09:06:48.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.985+0000 7f1f3f296740 1 --2- 172.21.15.92:0/1791915966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3ca65dd40 0x55e3ca660130 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:48.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.985+0000 7f1f3f296740 1 --2- 172.21.15.92:0/1791915966 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3ca653480 0x55e3ca65d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:48.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.985+0000 7f1f3f296740 1 --2- 172.21.15.92:0/1791915966 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3ca652b60 0x55e3ca652f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:48.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.985+0000 7f1f3f296740 1 -- 172.21.15.92:0/1791915966 >> 172.21.15.92:0/1791915966 conn(0x55e3ca64f0f0 msgr2=0x55e3ca64f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:48.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.985+0000 7f1f3f296740 1 -- 172.21.15.92:0/1791915966 shutdown_connections 2024-09-19T09:06:48.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.985+0000 7f1f3f296740 1 -- 172.21.15.92:0/1791915966 wait complete. 2024-09-19T09:06:48.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.985+0000 7f1f3f296740 1 -- start start 2024-09-19T09:06:48.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.985+0000 7f1f3f296740 1 Processor -- start 2024-09-19T09:06:48.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.986+0000 7f1f3f296740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3ca652b60 0x55e3ca65ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:48.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.986+0000 7f1f3f296740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3ca653480 0x55e3ca65b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:48.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.986+0000 7f1f3f296740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3ca65dd40 0x55e3ca65b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:48.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.986+0000 7f1f3f296740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e3ca660910 con 0x55e3ca65dd40 2024-09-19T09:06:48.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.986+0000 7f1f3f296740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e3ca572f10 con 0x55e3ca652b60 2024-09-19T09:06:48.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.986+0000 7f1f3f296740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e3ca660a90 con 0x55e3ca653480 2024-09-19T09:06:48.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.986+0000 7f1f3f296740 10 client.0 _ll_register_callbacks cb 0x55e3ca53ba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:48.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.986+0000 7f1f35d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3ca65dd40 0x55e3ca65b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:48.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.986+0000 7f1f35d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3ca65dd40 0x55e3ca65b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52298/0 (socket says 172.21.15.92:52298) 2024-09-19T09:06:48.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.986+0000 7f1f35d9b640 1 -- 172.21.15.92:0/1125701620 learned_addr learned my addr 172.21.15.92:0/1125701620 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:48.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.986+0000 7f1f3659c640 1 --2- 172.21.15.92:0/1125701620 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3ca653480 0x55e3ca65b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:48.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.986+0000 7f1f35d9b640 1 --2- 172.21.15.92:0/1125701620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3ca652b60 0x55e3ca65ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:48.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.986+0000 7f1f35d9b640 1 -- 172.21.15.92:0/1125701620 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3ca653480 msgr2=0x55e3ca65b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:48.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.986+0000 7f1f35d9b640 1 --2- 172.21.15.92:0/1125701620 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3ca653480 0x55e3ca65b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:48.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.986+0000 7f1f35d9b640 1 -- 172.21.15.92:0/1125701620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3ca652b60 msgr2=0x55e3ca65ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:48.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.986+0000 7f1f35d9b640 1 --2- 172.21.15.92:0/1125701620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3ca652b60 0x55e3ca65ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:48.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.986+0000 7f1f35d9b640 1 -- 172.21.15.92:0/1125701620 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3ca3296a0 con 0x55e3ca65dd40 2024-09-19T09:06:48.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.986+0000 7f1f3659c640 1 --2- 172.21.15.92:0/1125701620 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3ca653480 0x55e3ca65b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:48.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.986+0000 7f1f35d9b640 1 --2- 172.21.15.92:0/1125701620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3ca65dd40 0x55e3ca65b6c0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c005d00 tx=0x7f1f2c032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc2bfbdb66bc448 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:48.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.986+0000 7f1f1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:06:48.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.986+0000 7f1f1dffb640 1 -- 172.21.15.92:0/1125701620 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c000e60 con 0x55e3ca65dd40 2024-09-19T09:06:48.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.986+0000 7f1f1dffb640 1 -- 172.21.15.92:0/1125701620 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1f2c0040f0 con 0x55e3ca65dd40 2024-09-19T09:06:48.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.986+0000 7f1f3f296740 1 -- 172.21.15.92:0/1125701620 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f2c005020 con 0x55e3ca65dd40 2024-09-19T09:06:48.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.987+0000 7f1f1dffb640 1 -- 172.21.15.92:0/1125701620 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1f2c035070 con 0x55e3ca65dd40 2024-09-19T09:06:48.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.987+0000 7f1f3f296740 10 client.17805 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:48.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.987+0000 7f1f3f296740 1 -- 172.21.15.92:0/1125701620 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e3ca66c540 con 0x55e3ca65dd40 2024-09-19T09:06:48.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.987+0000 7f1f1dffb640 1 -- 172.21.15.92:0/1125701620 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f2c005020 con 0x55e3ca65dd40 2024-09-19T09:06:48.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.987+0000 7f1f1dffb640 1 -- 172.21.15.92:0/1125701620 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1f2c055020 con 0x55e3ca65dd40 2024-09-19T09:06:48.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.987+0000 7f1f3f296740 10 client.17805 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:48.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.987+0000 7f1f3f296740 10 client.17805 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:06:48.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.987+0000 7f1f3f296740 20 client.17805 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:48.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.987+0000 7f1f3f296740 1 --2- 172.21.15.92:0/1125701620 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e3ca66d890 0x55e3ca66fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:48.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.987+0000 7f1f3f296740 4 client.17805 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:06:48.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.987+0000 7f1f3f296740 1 -- 172.21.15.92:0/1125701620 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e3ca5c57f0 con 0x55e3ca66d890 2024-09-19T09:06:48.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.987+0000 7f1f3659c640 1 --2- 172.21.15.92:0/1125701620 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e3ca66d890 0x55e3ca66fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:48.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.988+0000 7f1f1dffb640 10 client.17805 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:48.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.988+0000 7f1f3659c640 1 --2- 172.21.15.92:0/1125701620 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e3ca66d890 0x55e3ca66fc80 crc :-1 s=READY pgs=317 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98f02769199887c5 server_cookie=d181e0150538ec76 in_seq=0 out_seq=0 2024-09-19T09:06:48.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.989+0000 7f1f1dffb640 1 -- 172.21.15.92:0/1125701620 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e3ca5c57f0 con 0x55e3ca66d890 2024-09-19T09:06:48.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.989+0000 7f1f1dffb640 10 client.17805 handle_command_reply: tid=0 2024-09-19T09:06:48.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.989+0000 7f1f3f296740 1 client.17805 shutdown 2024-09-19T09:06:48.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.989+0000 7f1f3f296740 1 -- 172.21.15.92:0/1125701620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3ca65dd40 msgr2=0x55e3ca65b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:48.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.989+0000 7f1f3f296740 1 --2- 172.21.15.92:0/1125701620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3ca65dd40 0x55e3ca65b6c0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c005d00 tx=0x7f1f2c032dd0 comp rx=0 tx=0).stop 2024-09-19T09:06:48.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.989+0000 7f1f3f296740 1 -- 172.21.15.92:0/1125701620 shutdown_connections 2024-09-19T09:06:48.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.989+0000 7f1f3f296740 1 --2- 172.21.15.92:0/1125701620 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e3ca66d890 0x55e3ca66fc80 crc :-1 s=READY pgs=317 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:48.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.989+0000 7f1f3f296740 1 --2- 172.21.15.92:0/1125701620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3ca65dd40 0x55e3ca65b6c0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:48.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.989+0000 7f1f3f296740 1 --2- 172.21.15.92:0/1125701620 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3ca653480 0x55e3ca65b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:48.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.989+0000 7f1f1dffb640 0 client.17805 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:48.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.989+0000 7f1f3f296740 1 --2- 172.21.15.92:0/1125701620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3ca652b60 0x55e3ca65ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:48.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.989+0000 7f1f3f296740 1 -- 172.21.15.92:0/1125701620 >> 172.21.15.92:0/1125701620 conn(0x55e3ca64f0f0 msgr2=0x55e3ca654dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:48.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.989+0000 7f1f3f296740 1 -- 172.21.15.92:0/1125701620 shutdown_connections 2024-09-19T09:06:48.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.989+0000 7f1f3f296740 1 -- 172.21.15.92:0/1125701620 wait complete. 2024-09-19T09:06:48.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:47.989+0000 7f1f3f296740 20 client.17805 trim_cache size 0 max 16384 2024-09-19T09:06:48.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.006+0000 7f1f3f296740 1 Processor -- start 2024-09-19T09:06:48.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.006+0000 7f1f3f296740 1 -- start start 2024-09-19T09:06:48.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.006+0000 7f1f3f296740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3ca652b60 0x55e3ca6693f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:48.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.006+0000 7f1f3f296740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3ca653480 0x55e3ca672ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:48.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.006+0000 7f1f3f296740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3ca65dd40 0x55e3ca6731e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:48.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.006+0000 7f1f3f296740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1f381ab590 con 0x55e3ca653480 2024-09-19T09:06:48.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.006+0000 7f1f3f296740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1f381ade30 con 0x55e3ca652b60 2024-09-19T09:06:48.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.006+0000 7f1f3f296740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1f381abc20 con 0x55e3ca65dd40 2024-09-19T09:06:48.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.006+0000 7f1f3659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3ca653480 0x55e3ca672ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:48.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.006+0000 7f1f3659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3ca653480 0x55e3ca672ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52314/0 (socket says 172.21.15.92:52314) 2024-09-19T09:06:48.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.006+0000 7f1f3659c640 1 -- 172.21.15.92:0/951116993 learned_addr learned my addr 172.21.15.92:0/951116993 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:48.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.006+0000 7f1f35d9b640 1 --2- 172.21.15.92:0/951116993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3ca652b60 0x55e3ca6693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:48.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.006+0000 7f1f35d9b640 1 --2- 172.21.15.92:0/951116993 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3ca65dd40 0x55e3ca6731e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:48.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.007+0000 7f1f3659c640 1 -- 172.21.15.92:0/951116993 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3ca65dd40 msgr2=0x55e3ca6731e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:48.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.007+0000 7f1f3659c640 1 --2- 172.21.15.92:0/951116993 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3ca65dd40 0x55e3ca6731e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:48.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.007+0000 7f1f3659c640 1 -- 172.21.15.92:0/951116993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3ca652b60 msgr2=0x55e3ca6693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:48.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.007+0000 7f1f3659c640 1 --2- 172.21.15.92:0/951116993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3ca652b60 0x55e3ca6693f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:48.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.007+0000 7f1f3659c640 1 -- 172.21.15.92:0/951116993 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3ca6532b0 con 0x55e3ca653480 2024-09-19T09:06:48.016 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.007+0000 7f1f35d9b640 1 --2- 172.21.15.92:0/951116993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3ca652b60 0x55e3ca6693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:06:48.016 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.007+0000 7f1f3659c640 1 --2- 172.21.15.92:0/951116993 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3ca653480 0x55e3ca672ca0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x55e3ca64ff50 tx=0x7f1f28008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e8b72390fc386a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:48.016 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.007+0000 7f1f1ffff640 1 -- 172.21.15.92:0/951116993 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f28020070 con 0x55e3ca653480 2024-09-19T09:06:48.016 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.007+0000 7f1f1ffff640 1 -- 172.21.15.92:0/951116993 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f2800ae70 con 0x55e3ca653480 2024-09-19T09:06:48.016 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.007+0000 7f1f1ffff640 1 -- 172.21.15.92:0/951116993 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f280147b0 con 0x55e3ca653480 2024-09-19T09:06:48.016 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.008+0000 7f1f3f296740 1 -- 172.21.15.92:0/951116993 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3ca653480 msgr2=0x55e3ca672ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:48.016 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.008+0000 7f1f3f296740 1 --2- 172.21.15.92:0/951116993 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3ca653480 0x55e3ca672ca0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x55e3ca64ff50 tx=0x7f1f28008040 comp rx=0 tx=0).stop 2024-09-19T09:06:48.016 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.008+0000 7f1f3f296740 1 -- 172.21.15.92:0/951116993 shutdown_connections 2024-09-19T09:06:48.016 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.008+0000 7f1f3f296740 1 --2- 172.21.15.92:0/951116993 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3ca65dd40 0x55e3ca6731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:48.016 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.008+0000 7f1f3f296740 1 --2- 172.21.15.92:0/951116993 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3ca653480 0x55e3ca672ca0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:48.016 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.008+0000 7f1f3f296740 1 --2- 172.21.15.92:0/951116993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3ca652b60 0x55e3ca6693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:48.016 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.008+0000 7f1f3f296740 1 -- 172.21.15.92:0/951116993 >> 172.21.15.92:0/951116993 conn(0x55e3ca64f0f0 msgr2=0x55e3ca668ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:48.016 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.008+0000 7f1f3f296740 1 -- 172.21.15.92:0/951116993 shutdown_connections 2024-09-19T09:06:48.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.008+0000 7f1f3f296740 1 -- 172.21.15.92:0/951116993 wait complete. 2024-09-19T09:06:48.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.008+0000 7f1f3f296740 1 -- start start 2024-09-19T09:06:48.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.008+0000 7f1f3f296740 1 Processor -- start 2024-09-19T09:06:48.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.009+0000 7f1f3f296740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3ca652b60 0x55e3ca670dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:48.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.009+0000 7f1f3f296740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3ca653480 0x55e3ca671300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:48.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.009+0000 7f1f3f296740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3ca65dd40 0x55e3ca6d71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:48.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.009+0000 7f1f3f296740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1f381ac2f0 con 0x55e3ca652b60 2024-09-19T09:06:48.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.009+0000 7f1f3f296740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1f381ad760 con 0x55e3ca653480 2024-09-19T09:06:48.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.009+0000 7f1f3f296740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1f381ac9c0 con 0x55e3ca65dd40 2024-09-19T09:06:48.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.009+0000 7f1f3f296740 10 client.0 _ll_register_callbacks cb 0x7f1f2800a150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:48.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.009+0000 7f1f35d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3ca652b60 0x55e3ca670dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:48.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.009+0000 7f1f35d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3ca652b60 0x55e3ca670dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52320/0 (socket says 172.21.15.92:52320) 2024-09-19T09:06:48.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.009+0000 7f1f35d9b640 1 -- 172.21.15.92:0/922828525 learned_addr learned my addr 172.21.15.92:0/922828525 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:48.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.009+0000 7f1f3659c640 1 --2- 172.21.15.92:0/922828525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3ca653480 0x55e3ca671300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:48.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.009+0000 7f1f35d9b640 1 --2- 172.21.15.92:0/922828525 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3ca65dd40 0x55e3ca6d71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:48.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.009+0000 7f1f35d9b640 1 -- 172.21.15.92:0/922828525 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3ca65dd40 msgr2=0x55e3ca6d71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:48.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.009+0000 7f1f35d9b640 1 --2- 172.21.15.92:0/922828525 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3ca65dd40 0x55e3ca6d71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:48.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.009+0000 7f1f35d9b640 1 -- 172.21.15.92:0/922828525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3ca653480 msgr2=0x55e3ca671300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:48.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.009+0000 7f1f35d9b640 1 --2- 172.21.15.92:0/922828525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3ca653480 0x55e3ca671300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:48.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.009+0000 7f1f35d9b640 1 -- 172.21.15.92:0/922828525 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3ca671be0 con 0x55e3ca652b60 2024-09-19T09:06:48.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.009+0000 7f1f35d9b640 1 --2- 172.21.15.92:0/922828525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3ca652b60 0x55e3ca670dc0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c02a9a0 tx=0x7f1f2c031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb3520f2cd3aac76 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:48.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.009+0000 7f1f1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:06:48.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.009+0000 7f1f1dffb640 1 -- 172.21.15.92:0/922828525 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c004480 con 0x55e3ca652b60 2024-09-19T09:06:48.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.009+0000 7f1f3f296740 1 -- 172.21.15.92:0/922828525 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f2800ae70 con 0x55e3ca652b60 2024-09-19T09:06:48.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.009+0000 7f1f1dffb640 1 -- 172.21.15.92:0/922828525 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1f2c031bd0 con 0x55e3ca652b60 2024-09-19T09:06:48.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.010+0000 7f1f1dffb640 1 -- 172.21.15.92:0/922828525 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1f2c031dd0 con 0x55e3ca652b60 2024-09-19T09:06:48.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.010+0000 7f1f3f296740 10 client.17811 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:48.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.010+0000 7f1f3f296740 1 -- 172.21.15.92:0/922828525 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e3ca6d87a0 con 0x55e3ca652b60 2024-09-19T09:06:48.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.010+0000 7f1f1dffb640 1 -- 172.21.15.92:0/922828525 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f2800ae70 con 0x55e3ca652b60 2024-09-19T09:06:48.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.010+0000 7f1f1dffb640 1 -- 172.21.15.92:0/922828525 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1f2c03a040 con 0x55e3ca652b60 2024-09-19T09:06:48.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.010+0000 7f1f3f296740 10 client.17811 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:48.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.010+0000 7f1f3f296740 10 client.17811 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:06:48.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.010+0000 7f1f3f296740 20 client.17811 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:48.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.010+0000 7f1f3f296740 1 --2- 172.21.15.92:0/922828525 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e3ca66d890 0x55e3ca6dace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:48.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.010+0000 7f1f3f296740 4 client.17811 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:06:48.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.010+0000 7f1f3f296740 1 -- 172.21.15.92:0/922828525 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e3ca5bfd00 con 0x55e3ca66d890 2024-09-19T09:06:48.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.010+0000 7f1f3659c640 1 --2- 172.21.15.92:0/922828525 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e3ca66d890 0x55e3ca6dace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:48.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.011+0000 7f1f1dffb640 10 client.17811 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:48.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.011+0000 7f1f3659c640 1 --2- 172.21.15.92:0/922828525 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e3ca66d890 0x55e3ca6dace0 crc :-1 s=READY pgs=318 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecc31de448b5500 server_cookie=f7bec24f3a96a9be in_seq=0 out_seq=0 2024-09-19T09:06:48.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.012+0000 7f1f1dffb640 1 -- 172.21.15.92:0/922828525 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e3ca5bfd00 con 0x55e3ca66d890 2024-09-19T09:06:48.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.012+0000 7f1f1dffb640 10 client.17811 handle_command_reply: tid=0 2024-09-19T09:06:48.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.012+0000 7f1f3f296740 1 client.17811 shutdown 2024-09-19T09:06:48.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.012+0000 7f1f3f296740 1 -- 172.21.15.92:0/922828525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3ca652b60 msgr2=0x55e3ca670dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:48.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.012+0000 7f1f3f296740 1 --2- 172.21.15.92:0/922828525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3ca652b60 0x55e3ca670dc0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c02a9a0 tx=0x7f1f2c031400 comp rx=0 tx=0).stop 2024-09-19T09:06:48.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.012+0000 7f1f3f296740 1 -- 172.21.15.92:0/922828525 shutdown_connections 2024-09-19T09:06:48.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.012+0000 7f1f3f296740 1 --2- 172.21.15.92:0/922828525 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e3ca66d890 0x55e3ca6dace0 crc :-1 s=READY pgs=318 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:48.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.012+0000 7f1f3f296740 1 --2- 172.21.15.92:0/922828525 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3ca65dd40 0x55e3ca6d71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:48.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.012+0000 7f1f3f296740 1 --2- 172.21.15.92:0/922828525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3ca653480 0x55e3ca671300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:48.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.012+0000 7f1f3f296740 1 --2- 172.21.15.92:0/922828525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3ca652b60 0x55e3ca670dc0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:48.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.012+0000 7f1f3f296740 1 -- 172.21.15.92:0/922828525 >> 172.21.15.92:0/922828525 conn(0x55e3ca64f0f0 msgr2=0x55e3ca669500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:48.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.012+0000 7f1f1dffb640 0 client.17811 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:48.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.012+0000 7f1f3f296740 1 -- 172.21.15.92:0/922828525 shutdown_connections 2024-09-19T09:06:48.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.012+0000 7f1f3f296740 1 -- 172.21.15.92:0/922828525 wait complete. 2024-09-19T09:06:48.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.012+0000 7f1f3f296740 20 client.17811 trim_cache size 0 max 16384 2024-09-19T09:06:48.021 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:06:48.021 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-19T09:06:48.021 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "c133fe59-b4ef-4093-96af-a7216ecbd825", 2024-09-19T09:06:48.021 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-19T09:06:48.022 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:06:48.023 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.013+0000 7f1f3cebd640 1 -- 172.21.15.92:0/2832500832 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1f200a3240 msgr2=0x7f1f200a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:48.023 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.013+0000 7f1f3cebd640 1 --2- 172.21.15.92:0/2832500832 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1f200a3240 0x7f1f200a5700 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1f30016000 tx=0x7f1f3000e040 comp rx=0 tx=0).stop 2024-09-19T09:06:48.023 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.013+0000 7f1f3cebd640 1 -- 172.21.15.92:0/2832500832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f3810c170 msgr2=0x7f1f3819ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:48.023 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.013+0000 7f1f3cebd640 1 --2- 172.21.15.92:0/2832500832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f3810c170 0x7f1f3819ce50 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f1f3000b970 tx=0x7f1f3000be30 comp rx=0 tx=0).stop 2024-09-19T09:06:48.023 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.013+0000 7f1f3cebd640 1 -- 172.21.15.92:0/2832500832 shutdown_connections 2024-09-19T09:06:48.023 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.013+0000 7f1f3cebd640 1 --2- 172.21.15.92:0/2832500832 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1f200a3240 0x7f1f200a5700 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:48.023 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.013+0000 7f1f3cebd640 1 --2- 172.21.15.92:0/2832500832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f3810c170 0x7f1f3819ce50 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:48.023 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.013+0000 7f1f3cebd640 1 --2- 172.21.15.92:0/2832500832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f38103660 0x7f1f38198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:48.023 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.013+0000 7f1f3cebd640 1 --2- 172.21.15.92:0/2832500832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1f38102d40 0x7f1f38198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:48.023 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.013+0000 7f1f3cebd640 1 -- 172.21.15.92:0/2832500832 >> 172.21.15.92:0/2832500832 conn(0x7f1f380fc7a0 msgr2=0x7f1f380fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:48.023 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.013+0000 7f1f3cebd640 1 -- 172.21.15.92:0/2832500832 shutdown_connections 2024-09-19T09:06:48.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:48.013+0000 7f1f3cebd640 1 -- 172.21.15.92:0/2832500832 wait complete. 2024-09-19T09:06:48.780 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:06:49.031 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:06:49.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.446+0000 7f96c0667640 1 -- 172.21.15.92:0/2614651498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96b8106a80 msgr2=0x7f96b8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:49.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.446+0000 7f96c0667640 1 --2- 172.21.15.92:0/2614651498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96b8106a80 0x7f96b8106e60 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f96b4009930 tx=0x7f96b402a420 comp rx=0 tx=0).stop 2024-09-19T09:06:49.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.446+0000 7f96c0667640 1 -- 172.21.15.92:0/2614651498 shutdown_connections 2024-09-19T09:06:49.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.447+0000 7f96c0667640 1 --2- 172.21.15.92:0/2614651498 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f96b8101420 0x7f96b810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:49.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.447+0000 7f96c0667640 1 --2- 172.21.15.92:0/2614651498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96b8100a80 0x7f96b8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:49.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.447+0000 7f96c0667640 1 --2- 172.21.15.92:0/2614651498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96b8106a80 0x7f96b8106e60 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:49.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.447+0000 7f96c0667640 1 -- 172.21.15.92:0/2614651498 >> 172.21.15.92:0/2614651498 conn(0x7f96b80fc7a0 msgr2=0x7f96b80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:49.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.447+0000 7f96c0667640 1 -- 172.21.15.92:0/2614651498 shutdown_connections 2024-09-19T09:06:49.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.447+0000 7f96c0667640 1 -- 172.21.15.92:0/2614651498 wait complete. 2024-09-19T09:06:49.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.447+0000 7f96c0667640 1 Processor -- start 2024-09-19T09:06:49.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.447+0000 7f96c0667640 1 -- start start 2024-09-19T09:06:49.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.448+0000 7f96c0667640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96b8100a80 0x7f96b81a0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:49.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.448+0000 7f96c0667640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f96b8101420 0x7f96b81a0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:49.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.448+0000 7f96c0667640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96b8106a80 0x7f96b819a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:49.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.448+0000 7f96c0667640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f96b8110ed0 con 0x7f96b8100a80 2024-09-19T09:06:49.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.448+0000 7f96c0667640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f96b8110d50 con 0x7f96b8106a80 2024-09-19T09:06:49.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.448+0000 7f96c0667640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f96b8111050 con 0x7f96b8101420 2024-09-19T09:06:49.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.448+0000 7f96be403640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96b8100a80 0x7f96b81a0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:49.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.448+0000 7f96be403640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96b8100a80 0x7f96b81a0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52336/0 (socket says 172.21.15.92:52336) 2024-09-19T09:06:49.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.448+0000 7f96be403640 1 -- 172.21.15.92:0/611558294 learned_addr learned my addr 172.21.15.92:0/611558294 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:49.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.448+0000 7f96bec04640 1 --2- 172.21.15.92:0/611558294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96b8106a80 0x7f96b819a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:49.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.448+0000 7f96bdc02640 1 --2- 172.21.15.92:0/611558294 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f96b8101420 0x7f96b81a0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:49.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.448+0000 7f96be403640 1 -- 172.21.15.92:0/611558294 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f96b8101420 msgr2=0x7f96b81a0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:49.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.448+0000 7f96be403640 1 --2- 172.21.15.92:0/611558294 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f96b8101420 0x7f96b81a0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:49.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.448+0000 7f96be403640 1 -- 172.21.15.92:0/611558294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96b8106a80 msgr2=0x7f96b819a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:49.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.448+0000 7f96be403640 1 --2- 172.21.15.92:0/611558294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96b8106a80 0x7f96b819a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:49.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.448+0000 7f96be403640 1 -- 172.21.15.92:0/611558294 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b819afa0 con 0x7f96b8100a80 2024-09-19T09:06:49.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.448+0000 7f96bec04640 1 --2- 172.21.15.92:0/611558294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96b8106a80 0x7f96b819a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:06:49.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.448+0000 7f96be403640 1 --2- 172.21.15.92:0/611558294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96b8100a80 0x7f96b81a0350 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f96b402a940 tx=0x7f96b4003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:49.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.448+0000 7f96af7fe640 1 -- 172.21.15.92:0/611558294 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b403f070 con 0x7f96b8100a80 2024-09-19T09:06:49.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.448+0000 7f96af7fe640 1 -- 172.21.15.92:0/611558294 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96b4031c90 con 0x7f96b8100a80 2024-09-19T09:06:49.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.448+0000 7f96c0667640 1 -- 172.21.15.92:0/611558294 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96b819b230 con 0x7f96b8100a80 2024-09-19T09:06:49.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.448+0000 7f96af7fe640 1 -- 172.21.15.92:0/611558294 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b4035030 con 0x7f96b8100a80 2024-09-19T09:06:49.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.448+0000 7f96c0667640 1 -- 172.21.15.92:0/611558294 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96b81a7140 con 0x7f96b8100a80 2024-09-19T09:06:49.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.451+0000 7f96af7fe640 1 -- 172.21.15.92:0/611558294 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f96b4042070 con 0x7f96b8100a80 2024-09-19T09:06:49.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.451+0000 7f96c2a40740 1 Processor -- start 2024-09-19T09:06:49.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.451+0000 7f96c2a40740 1 -- start start 2024-09-19T09:06:49.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.451+0000 7f96c2a40740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571918b24a0 0x5571918b2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:49.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.451+0000 7f96c2a40740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571918b2dc0 0x5571918bd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:49.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.451+0000 7f96c2a40740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571918bd680 0x5571918bfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:49.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.452+0000 7f96c2a40740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5571918182e0 con 0x5571918bd680 2024-09-19T09:06:49.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.452+0000 7f96c2a40740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5571917bfce0 con 0x5571918b2dc0 2024-09-19T09:06:49.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.452+0000 7f96c2a40740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5571918142a0 con 0x5571918b24a0 2024-09-19T09:06:49.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.452+0000 7f96bec04640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571918b24a0 0x5571918b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:49.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.452+0000 7f96bdc02640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571918bd680 0x5571918bfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:49.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.452+0000 7f96be403640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571918b2dc0 0x5571918bd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:49.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.452+0000 7f96bec04640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571918b24a0 0x5571918b2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:57562/0 (socket says 172.21.15.92:57562) 2024-09-19T09:06:49.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.452+0000 7f96bdc02640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571918bd680 0x5571918bfa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52342/0 (socket says 172.21.15.92:52342) 2024-09-19T09:06:49.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.452+0000 7f96bec04640 1 -- 172.21.15.92:0/2206205571 learned_addr learned my addr 172.21.15.92:0/2206205571 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:49.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.452+0000 7f96af7fe640 1 --2- 172.21.15.92:0/611558294 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f96a40a3240 0x7f96a40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:49.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.452+0000 7f96bdc02640 1 -- 172.21.15.92:0/2206205571 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571918b24a0 msgr2=0x5571918b2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:49.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.452+0000 7f96bdc02640 1 --2- 172.21.15.92:0/2206205571 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571918b24a0 0x5571918b2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:49.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.452+0000 7f96bdc02640 1 -- 172.21.15.92:0/2206205571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571918b2dc0 msgr2=0x5571918bd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:49.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.452+0000 7f96bdc02640 1 --2- 172.21.15.92:0/2206205571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571918b2dc0 0x5571918bd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:49.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.452+0000 7f96bdc02640 1 -- 172.21.15.92:0/2206205571 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571917a4440 con 0x5571918bd680 2024-09-19T09:06:49.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.452+0000 7f96bec04640 1 --2- 172.21.15.92:0/2206205571 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571918b24a0 0x5571918b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:06:49.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.452+0000 7f96be403640 1 --2- 172.21.15.92:0/2206205571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571918b2dc0 0x5571918bd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:06:49.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.452+0000 7f96bec04640 1 --2- 172.21.15.92:0/611558294 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f96a40a3240 0x7f96a40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:49.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.452+0000 7f96af7fe640 1 -- 172.21.15.92:0/611558294 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f96b40f0020 con 0x7f96b8100a80 2024-09-19T09:06:49.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.452+0000 7f96bdc02640 1 --2- 172.21.15.92:0/2206205571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571918bd680 0x5571918bfa70 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f96b819b7f0 tx=0x7f96a80107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5d6e349a66fab2b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:49.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.452+0000 7f96acff9640 1 -- 172.21.15.92:0/2206205571 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a8004030 con 0x5571918bd680 2024-09-19T09:06:49.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.452+0000 7f96acff9640 1 -- 172.21.15.92:0/2206205571 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96a80041d0 con 0x5571918bd680 2024-09-19T09:06:49.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.453+0000 7f96acff9640 1 -- 172.21.15.92:0/2206205571 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a80116a0 con 0x5571918bd680 2024-09-19T09:06:49.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.453+0000 7f96c2a40740 1 -- 172.21.15.92:0/2206205571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571918bd680 msgr2=0x5571918bfa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:49.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.453+0000 7f96bec04640 1 --2- 172.21.15.92:0/611558294 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f96a40a3240 0x7f96a40a5700 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f96b00092f0 tx=0x7f96b0004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:49.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.453+0000 7f96c2a40740 1 --2- 172.21.15.92:0/2206205571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571918bd680 0x5571918bfa70 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f96b819b7f0 tx=0x7f96a80107a0 comp rx=0 tx=0).stop 2024-09-19T09:06:49.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.453+0000 7f96c2a40740 1 -- 172.21.15.92:0/2206205571 shutdown_connections 2024-09-19T09:06:49.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.453+0000 7f96c2a40740 1 --2- 172.21.15.92:0/2206205571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571918bd680 0x5571918bfa70 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:49.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.453+0000 7f96c2a40740 1 --2- 172.21.15.92:0/2206205571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571918b2dc0 0x5571918bd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:49.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.453+0000 7f96c2a40740 1 --2- 172.21.15.92:0/2206205571 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571918b24a0 0x5571918b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:49.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.453+0000 7f96c2a40740 1 -- 172.21.15.92:0/2206205571 >> 172.21.15.92:0/2206205571 conn(0x5571918aea30 msgr2=0x5571918aee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:49.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.453+0000 7f96c2a40740 1 -- 172.21.15.92:0/2206205571 shutdown_connections 2024-09-19T09:06:49.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.453+0000 7f96c2a40740 1 -- 172.21.15.92:0/2206205571 wait complete. 2024-09-19T09:06:49.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.454+0000 7f96c2a40740 1 -- start start 2024-09-19T09:06:49.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.454+0000 7f96c2a40740 1 Processor -- start 2024-09-19T09:06:49.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.454+0000 7f96c2a40740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571918b24a0 0x5571918bcfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:49.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.454+0000 7f96c2a40740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571918b2dc0 0x5571918ba270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:49.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.454+0000 7f96c2a40740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571918bd680 0x5571918ba7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:49.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.454+0000 7f96c2a40740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5571918c0250 con 0x5571918bd680 2024-09-19T09:06:49.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.454+0000 7f96c2a40740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5571917d3050 con 0x5571918b2dc0 2024-09-19T09:06:49.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.454+0000 7f96c2a40740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5571918c03d0 con 0x5571918b24a0 2024-09-19T09:06:49.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.454+0000 7f96c2a40740 10 client.0 _ll_register_callbacks cb 0x557191813160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:49.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.454+0000 7f96bec04640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571918bd680 0x5571918ba7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:49.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.454+0000 7f96bec04640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571918bd680 0x5571918ba7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52358/0 (socket says 172.21.15.92:52358) 2024-09-19T09:06:49.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.454+0000 7f96bec04640 1 -- 172.21.15.92:0/1702356700 learned_addr learned my addr 172.21.15.92:0/1702356700 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:49.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.454+0000 7f96be403640 1 --2- 172.21.15.92:0/1702356700 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571918b24a0 0x5571918bcfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:49.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.454+0000 7f96bdc02640 1 --2- 172.21.15.92:0/1702356700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571918b2dc0 0x5571918ba270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:49.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.454+0000 7f96bec04640 1 -- 172.21.15.92:0/1702356700 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571918b24a0 msgr2=0x5571918bcfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:49.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.454+0000 7f96bec04640 1 --2- 172.21.15.92:0/1702356700 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571918b24a0 0x5571918bcfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:49.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.454+0000 7f96bec04640 1 -- 172.21.15.92:0/1702356700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571918b2dc0 msgr2=0x5571918ba270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:49.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.454+0000 7f96bec04640 1 --2- 172.21.15.92:0/1702356700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571918b2dc0 0x5571918ba270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:49.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.455+0000 7f96bec04640 1 -- 172.21.15.92:0/1702356700 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571915893c0 con 0x5571918bd680 2024-09-19T09:06:49.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.455+0000 7f96bec04640 1 --2- 172.21.15.92:0/1702356700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571918bd680 0x5571918ba7b0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f96b0013dc0 tx=0x7f96b0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ffe1a2bc6d87730 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:49.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.455+0000 7f96a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:06:49.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.455+0000 7f96a1ffb640 1 -- 172.21.15.92:0/1702356700 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b0028640 con 0x5571918bd680 2024-09-19T09:06:49.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.455+0000 7f96a1ffb640 1 -- 172.21.15.92:0/1702356700 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f96b001c410 con 0x5571918bd680 2024-09-19T09:06:49.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.455+0000 7f96c2a40740 1 -- 172.21.15.92:0/1702356700 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96a80041d0 con 0x5571918bd680 2024-09-19T09:06:49.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.455+0000 7f96a1ffb640 1 -- 172.21.15.92:0/1702356700 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f96b00287e0 con 0x5571918bd680 2024-09-19T09:06:49.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.455+0000 7f96c2a40740 10 client.17823 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:49.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.455+0000 7f96c2a40740 1 -- 172.21.15.92:0/1702356700 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5571918cbc90 con 0x5571918bd680 2024-09-19T09:06:49.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.455+0000 7f96a1ffb640 1 -- 172.21.15.92:0/1702356700 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96a80041d0 con 0x5571918bd680 2024-09-19T09:06:49.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.455+0000 7f96a1ffb640 1 -- 172.21.15.92:0/1702356700 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f96b0026070 con 0x5571918bd680 2024-09-19T09:06:49.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.455+0000 7f96c2a40740 10 client.17823 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:49.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.455+0000 7f96c2a40740 10 client.17823 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:06:49.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.455+0000 7f96c2a40740 20 client.17823 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:49.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.455+0000 7f96c2a40740 1 --2- 172.21.15.92:0/1702356700 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5571918cd0a0 0x5571918cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:49.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.455+0000 7f96c2a40740 4 client.17823 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:06:49.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.455+0000 7f96c2a40740 1 -- 172.21.15.92:0/1702356700 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557191825850 con 0x5571918cd0a0 2024-09-19T09:06:49.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.456+0000 7f96be403640 1 --2- 172.21.15.92:0/1702356700 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5571918cd0a0 0x5571918cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:49.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.456+0000 7f96be403640 1 --2- 172.21.15.92:0/1702356700 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5571918cd0a0 0x5571918cf4f0 crc :-1 s=READY pgs=319 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=932d1d14a0ee47ef server_cookie=713969111b5dce4c in_seq=0 out_seq=0 2024-09-19T09:06:49.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.456+0000 7f96a1ffb640 10 client.17823 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:49.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.457+0000 7f96a1ffb640 1 -- 172.21.15.92:0/1702356700 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557191825850 con 0x5571918cd0a0 2024-09-19T09:06:49.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.457+0000 7f96a1ffb640 10 client.17823 handle_command_reply: tid=0 2024-09-19T09:06:49.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.457+0000 7f96c2a40740 1 client.17823 shutdown 2024-09-19T09:06:49.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.457+0000 7f96c2a40740 1 -- 172.21.15.92:0/1702356700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571918bd680 msgr2=0x5571918ba7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:49.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.457+0000 7f96c2a40740 1 --2- 172.21.15.92:0/1702356700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571918bd680 0x5571918ba7b0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f96b0013dc0 tx=0x7f96b0004ab0 comp rx=0 tx=0).stop 2024-09-19T09:06:49.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.457+0000 7f96c2a40740 1 -- 172.21.15.92:0/1702356700 shutdown_connections 2024-09-19T09:06:49.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.457+0000 7f96c2a40740 1 --2- 172.21.15.92:0/1702356700 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5571918cd0a0 0x5571918cf4f0 crc :-1 s=READY pgs=319 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:49.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.457+0000 7f96c2a40740 1 --2- 172.21.15.92:0/1702356700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571918bd680 0x5571918ba7b0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:49.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.457+0000 7f96a1ffb640 0 client.17823 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:49.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.457+0000 7f96c2a40740 1 --2- 172.21.15.92:0/1702356700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571918b2dc0 0x5571918ba270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:49.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.457+0000 7f96c2a40740 1 --2- 172.21.15.92:0/1702356700 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571918b24a0 0x5571918bcfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:49.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.457+0000 7f96c2a40740 1 -- 172.21.15.92:0/1702356700 >> 172.21.15.92:0/1702356700 conn(0x5571918aea30 msgr2=0x5571918b4710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:49.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.457+0000 7f96c2a40740 1 -- 172.21.15.92:0/1702356700 shutdown_connections 2024-09-19T09:06:49.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.457+0000 7f96c2a40740 1 -- 172.21.15.92:0/1702356700 wait complete. 2024-09-19T09:06:49.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.457+0000 7f96c2a40740 20 client.17823 trim_cache size 0 max 16384 2024-09-19T09:06:49.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.474+0000 7f96c2a40740 1 Processor -- start 2024-09-19T09:06:49.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.474+0000 7f96c2a40740 1 -- start start 2024-09-19T09:06:49.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.474+0000 7f96c2a40740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571918aea30 0x5571918ba230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:49.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.474+0000 7f96c2a40740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571918b24a0 0x5571918bc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:49.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.474+0000 7f96c2a40740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571918b2dc0 0x5571918d4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:49.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.474+0000 7f96c2a40740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f96b81ad760 con 0x5571918b2dc0 2024-09-19T09:06:49.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.474+0000 7f96c2a40740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f96b81b0000 con 0x5571918b24a0 2024-09-19T09:06:49.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.474+0000 7f96c2a40740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f96b81addf0 con 0x5571918aea30 2024-09-19T09:06:49.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.474+0000 7f96bec04640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571918b2dc0 0x5571918d4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:49.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.474+0000 7f96bec04640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571918b2dc0 0x5571918d4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52364/0 (socket says 172.21.15.92:52364) 2024-09-19T09:06:49.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.474+0000 7f96bec04640 1 -- 172.21.15.92:0/2707421958 learned_addr learned my addr 172.21.15.92:0/2707421958 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:49.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.474+0000 7f96bdc02640 1 --2- 172.21.15.92:0/2707421958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571918b24a0 0x5571918bc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:49.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.474+0000 7f96be403640 1 --2- 172.21.15.92:0/2707421958 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571918aea30 0x5571918ba230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:49.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.474+0000 7f96bec04640 1 -- 172.21.15.92:0/2707421958 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571918aea30 msgr2=0x5571918ba230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:49.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.474+0000 7f96bec04640 1 --2- 172.21.15.92:0/2707421958 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571918aea30 0x5571918ba230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:49.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.474+0000 7f96bec04640 1 -- 172.21.15.92:0/2707421958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571918b24a0 msgr2=0x5571918bc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:49.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.474+0000 7f96bec04640 1 --2- 172.21.15.92:0/2707421958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571918b24a0 0x5571918bc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:49.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.474+0000 7f96bec04640 1 -- 172.21.15.92:0/2707421958 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571918b22d0 con 0x5571918b2dc0 2024-09-19T09:06:49.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.474+0000 7f96bdc02640 1 --2- 172.21.15.92:0/2707421958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571918b24a0 0x5571918bc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:49.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.475+0000 7f96bec04640 1 --2- 172.21.15.92:0/2707421958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571918b2dc0 0x5571918d4e10 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f96b00092c0 tx=0x7f96b00108e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22daa414752a927a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:49.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.475+0000 7f96a3fff640 1 -- 172.21.15.92:0/2707421958 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b0037030 con 0x5571918b2dc0 2024-09-19T09:06:49.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.475+0000 7f96a3fff640 1 -- 172.21.15.92:0/2707421958 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96b0028440 con 0x5571918b2dc0 2024-09-19T09:06:49.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.475+0000 7f96a3fff640 1 -- 172.21.15.92:0/2707421958 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b001c690 con 0x5571918b2dc0 2024-09-19T09:06:49.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.475+0000 7f96c2a40740 1 -- 172.21.15.92:0/2707421958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571918b2dc0 msgr2=0x5571918d4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:49.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.475+0000 7f96c2a40740 1 --2- 172.21.15.92:0/2707421958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571918b2dc0 0x5571918d4e10 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f96b00092c0 tx=0x7f96b00108e0 comp rx=0 tx=0).stop 2024-09-19T09:06:49.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.475+0000 7f96c2a40740 1 -- 172.21.15.92:0/2707421958 shutdown_connections 2024-09-19T09:06:49.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.475+0000 7f96c2a40740 1 --2- 172.21.15.92:0/2707421958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571918b2dc0 0x5571918d4e10 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:49.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.475+0000 7f96c2a40740 1 --2- 172.21.15.92:0/2707421958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571918b24a0 0x5571918bc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:49.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.475+0000 7f96c2a40740 1 --2- 172.21.15.92:0/2707421958 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571918aea30 0x5571918ba230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:49.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.475+0000 7f96c2a40740 1 -- 172.21.15.92:0/2707421958 >> 172.21.15.92:0/2707421958 conn(0x5571918ba910 msgr2=0x5571918bbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:49.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.475+0000 7f96c2a40740 1 -- 172.21.15.92:0/2707421958 shutdown_connections 2024-09-19T09:06:49.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.475+0000 7f96c2a40740 1 -- 172.21.15.92:0/2707421958 wait complete. 2024-09-19T09:06:49.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.476+0000 7f96c2a40740 1 -- start start 2024-09-19T09:06:49.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.476+0000 7f96c2a40740 1 Processor -- start 2024-09-19T09:06:49.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.476+0000 7f96c2a40740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571918aea30 0x5571918c5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:49.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.476+0000 7f96c2a40740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571918b24a0 0x5571918c32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:49.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.476+0000 7f96c2a40740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571918b2dc0 0x5571918c3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:49.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.476+0000 7f96c2a40740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f96b81ae4c0 con 0x5571918b2dc0 2024-09-19T09:06:49.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.476+0000 7f96c2a40740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f96b81af930 con 0x5571918aea30 2024-09-19T09:06:49.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.476+0000 7f96c2a40740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f96b81aeb90 con 0x5571918b24a0 2024-09-19T09:06:49.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.476+0000 7f96c2a40740 10 client.0 _ll_register_callbacks cb 0x7f96b0009e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:49.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.476+0000 7f96bec04640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571918b2dc0 0x5571918c3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:49.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.476+0000 7f96bec04640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571918b2dc0 0x5571918c3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52370/0 (socket says 172.21.15.92:52370) 2024-09-19T09:06:49.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.476+0000 7f96bec04640 1 -- 172.21.15.92:0/3346676930 learned_addr learned my addr 172.21.15.92:0/3346676930 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:49.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.476+0000 7f96be403640 1 --2- 172.21.15.92:0/3346676930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571918aea30 0x5571918c5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:49.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.476+0000 7f96bdc02640 1 --2- 172.21.15.92:0/3346676930 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571918b24a0 0x5571918c32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:49.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.476+0000 7f96bec04640 1 -- 172.21.15.92:0/3346676930 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571918b24a0 msgr2=0x5571918c32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:49.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.476+0000 7f96bec04640 1 --2- 172.21.15.92:0/3346676930 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571918b24a0 0x5571918c32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:49.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.476+0000 7f96bec04640 1 -- 172.21.15.92:0/3346676930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571918aea30 msgr2=0x5571918c5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:49.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.476+0000 7f96bec04640 1 --2- 172.21.15.92:0/3346676930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571918aea30 0x5571918c5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:49.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.476+0000 7f96bec04640 1 -- 172.21.15.92:0/3346676930 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557191936df0 con 0x5571918b2dc0 2024-09-19T09:06:49.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.477+0000 7f96bec04640 1 --2- 172.21.15.92:0/3346676930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571918b2dc0 0x5571918c3a40 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f96b0013890 tx=0x7f96b0028c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4ad317c3a667e8b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:49.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.477+0000 7f96a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:06:49.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.477+0000 7f96a1ffb640 1 -- 172.21.15.92:0/3346676930 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b003f020 con 0x5571918b2dc0 2024-09-19T09:06:49.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.477+0000 7f96a1ffb640 1 -- 172.21.15.92:0/3346676930 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f96b001c410 con 0x5571918b2dc0 2024-09-19T09:06:49.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.477+0000 7f96c2a40740 1 -- 172.21.15.92:0/3346676930 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96b0028440 con 0x5571918b2dc0 2024-09-19T09:06:49.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.477+0000 7f96a1ffb640 1 -- 172.21.15.92:0/3346676930 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f96b0037070 con 0x5571918b2dc0 2024-09-19T09:06:49.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.477+0000 7f96c2a40740 10 client.17829 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:49.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.477+0000 7f96c2a40740 1 -- 172.21.15.92:0/3346676930 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x557191937fc0 con 0x5571918b2dc0 2024-09-19T09:06:49.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.477+0000 7f96a1ffb640 1 -- 172.21.15.92:0/3346676930 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96b0028440 con 0x5571918b2dc0 2024-09-19T09:06:49.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.477+0000 7f96a1ffb640 1 -- 172.21.15.92:0/3346676930 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f96b0026070 con 0x5571918b2dc0 2024-09-19T09:06:49.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.477+0000 7f96c2a40740 10 client.17829 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:49.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.477+0000 7f96c2a40740 10 client.17829 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:06:49.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.477+0000 7f96c2a40740 20 client.17829 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:49.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.477+0000 7f96c2a40740 1 --2- 172.21.15.92:0/3346676930 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5571918bd680 0x55719193a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:49.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.477+0000 7f96c2a40740 4 client.17829 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:06:49.519 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:06:49.519 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-19T09:06:49.519 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {} 2024-09-19T09:06:49.519 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:06:49.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.477+0000 7f96c2a40740 1 -- 172.21.15.92:0/3346676930 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55719181fd60 con 0x5571918bd680 2024-09-19T09:06:49.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.478+0000 7f96be403640 1 --2- 172.21.15.92:0/3346676930 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5571918bd680 0x55719193a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:49.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.478+0000 7f96be403640 1 --2- 172.21.15.92:0/3346676930 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5571918bd680 0x55719193a610 crc :-1 s=READY pgs=320 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=972a5f8b6126676d server_cookie=d052468051df88d2 in_seq=0 out_seq=0 2024-09-19T09:06:49.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.478+0000 7f96a1ffb640 10 client.17829 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:49.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.478+0000 7f96a1ffb640 1 -- 172.21.15.92:0/3346676930 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55719181fd60 con 0x5571918bd680 2024-09-19T09:06:49.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.478+0000 7f96a1ffb640 10 client.17829 handle_command_reply: tid=0 2024-09-19T09:06:49.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.478+0000 7f96c2a40740 1 client.17829 shutdown 2024-09-19T09:06:49.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.478+0000 7f96c2a40740 1 -- 172.21.15.92:0/3346676930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571918b2dc0 msgr2=0x5571918c3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:49.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.478+0000 7f96c2a40740 1 --2- 172.21.15.92:0/3346676930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571918b2dc0 0x5571918c3a40 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f96b0013890 tx=0x7f96b0028c30 comp rx=0 tx=0).stop 2024-09-19T09:06:49.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.478+0000 7f96c2a40740 1 -- 172.21.15.92:0/3346676930 shutdown_connections 2024-09-19T09:06:49.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.478+0000 7f96c2a40740 1 --2- 172.21.15.92:0/3346676930 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5571918bd680 0x55719193a610 crc :-1 s=READY pgs=320 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:49.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.478+0000 7f96c2a40740 1 --2- 172.21.15.92:0/3346676930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571918b2dc0 0x5571918c3a40 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:49.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.478+0000 7f96a1ffb640 0 client.17829 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:49.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.478+0000 7f96c2a40740 1 --2- 172.21.15.92:0/3346676930 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571918b24a0 0x5571918c32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:49.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.478+0000 7f96c2a40740 1 --2- 172.21.15.92:0/3346676930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571918aea30 0x5571918c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:49.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.478+0000 7f96c2a40740 1 -- 172.21.15.92:0/3346676930 >> 172.21.15.92:0/3346676930 conn(0x5571918ba910 msgr2=0x5571918bc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:49.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.478+0000 7f96c2a40740 1 -- 172.21.15.92:0/3346676930 shutdown_connections 2024-09-19T09:06:49.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.478+0000 7f96c2a40740 1 -- 172.21.15.92:0/3346676930 wait complete. 2024-09-19T09:06:49.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.478+0000 7f96c2a40740 20 client.17829 trim_cache size 0 max 16384 2024-09-19T09:06:49.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.479+0000 7f96c0667640 1 -- 172.21.15.92:0/611558294 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f96a40a3240 msgr2=0x7f96a40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:49.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.479+0000 7f96c0667640 1 --2- 172.21.15.92:0/611558294 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f96a40a3240 0x7f96a40a5700 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f96b00092f0 tx=0x7f96b0004a40 comp rx=0 tx=0).stop 2024-09-19T09:06:49.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.479+0000 7f96c0667640 1 -- 172.21.15.92:0/611558294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96b8100a80 msgr2=0x7f96b81a0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:49.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.479+0000 7f96c0667640 1 --2- 172.21.15.92:0/611558294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96b8100a80 0x7f96b81a0350 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f96b402a940 tx=0x7f96b4003b90 comp rx=0 tx=0).stop 2024-09-19T09:06:49.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.479+0000 7f96c0667640 1 -- 172.21.15.92:0/611558294 shutdown_connections 2024-09-19T09:06:49.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.479+0000 7f96c0667640 1 --2- 172.21.15.92:0/611558294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96b8106a80 0x7f96b819a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:49.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.479+0000 7f96c0667640 1 --2- 172.21.15.92:0/611558294 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f96b8101420 0x7f96b81a0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:49.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.479+0000 7f96c0667640 1 --2- 172.21.15.92:0/611558294 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f96a40a3240 0x7f96a40a5700 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:49.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.479+0000 7f96c0667640 1 --2- 172.21.15.92:0/611558294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96b8100a80 0x7f96b81a0350 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:49.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.479+0000 7f96c0667640 1 -- 172.21.15.92:0/611558294 >> 172.21.15.92:0/611558294 conn(0x7f96b80fc7a0 msgr2=0x7f96b80fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:49.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.479+0000 7f96c0667640 1 -- 172.21.15.92:0/611558294 shutdown_connections 2024-09-19T09:06:49.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:49.479+0000 7f96c0667640 1 -- 172.21.15.92:0/611558294 wait complete. 2024-09-19T09:06:49.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:49 smithi092 ceph-mon[31407]: scrub queued for path: / 2024-09-19T09:06:49.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:49 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:06:49.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:49 smithi092 ceph-mon[31407]: scrub summary: active paths [/] 2024-09-19T09:06:49.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:49 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:06:49.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:49 smithi092 ceph-mon[31407]: pgmap v640: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.2 KiB/s wr, 28 op/s 2024-09-19T09:06:49.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:49 smithi092 ceph-mon[31407]: scrub summary: idle 2024-09-19T09:06:49.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:49 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:06:49.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:49 smithi167 ceph-mon[35359]: scrub queued for path: / 2024-09-19T09:06:49.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:49 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:06:49.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:49 smithi167 ceph-mon[35359]: scrub summary: active paths [/] 2024-09-19T09:06:49.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:49 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:06:49.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:49 smithi167 ceph-mon[35359]: pgmap v640: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.2 KiB/s wr, 28 op/s 2024-09-19T09:06:49.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:49 smithi167 ceph-mon[35359]: scrub summary: idle 2024-09-19T09:06:49.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:49 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:06:49.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:49 smithi190 ceph-mon[35358]: scrub queued for path: / 2024-09-19T09:06:49.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:49 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:06:49.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:49 smithi190 ceph-mon[35358]: scrub summary: active paths [/] 2024-09-19T09:06:49.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:49 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:06:49.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:49 smithi190 ceph-mon[35358]: pgmap v640: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.2 KiB/s wr, 28 op/s 2024-09-19T09:06:49.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:49 smithi190 ceph-mon[35358]: scrub summary: idle 2024-09-19T09:06:49.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:49 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:06:50.080 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:06:50.081 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:06:50.710 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:06:50.798 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:06:51.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.171+0000 7f2b3a0dd640 1 -- 172.21.15.92:0/4016129107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b34100a90 msgr2=0x7f2b34100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:51.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.171+0000 7f2b3a0dd640 1 --2- 172.21.15.92:0/4016129107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b34100a90 0x7f2b34100ef0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c009930 tx=0x7f2b1c02a420 comp rx=0 tx=0).stop 2024-09-19T09:06:51.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.171+0000 7f2b3a0dd640 1 -- 172.21.15.92:0/4016129107 shutdown_connections 2024-09-19T09:06:51.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.171+0000 7f2b3a0dd640 1 --2- 172.21.15.92:0/4016129107 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b34101430 0x7f2b3410d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.171+0000 7f2b3a0dd640 1 --2- 172.21.15.92:0/4016129107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b34100a90 0x7f2b34100ef0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.171+0000 7f2b3a0dd640 1 --2- 172.21.15.92:0/4016129107 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b34106a90 0x7f2b34106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.171+0000 7f2b3a0dd640 1 -- 172.21.15.92:0/4016129107 >> 172.21.15.92:0/4016129107 conn(0x7f2b340fc7d0 msgr2=0x7f2b340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:51.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.171+0000 7f2b3a0dd640 1 -- 172.21.15.92:0/4016129107 shutdown_connections 2024-09-19T09:06:51.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.171+0000 7f2b3a0dd640 1 -- 172.21.15.92:0/4016129107 wait complete. 2024-09-19T09:06:51.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.172+0000 7f2b3a0dd640 1 Processor -- start 2024-09-19T09:06:51.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.172+0000 7f2b3a0dd640 1 -- start start 2024-09-19T09:06:51.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.172+0000 7f2b3a0dd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b34100a90 0x7f2b341992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:51.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.172+0000 7f2b3a0dd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b34101430 0x7f2b341997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:51.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.172+0000 7f2b3a0dd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b34106a90 0x7f2b341a4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:51.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.172+0000 7f2b3a0dd640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2b34110e90 con 0x7f2b34106a90 2024-09-19T09:06:51.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.172+0000 7f2b3a0dd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2b34110d10 con 0x7f2b34100a90 2024-09-19T09:06:51.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.172+0000 7f2b3a0dd640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2b34111010 con 0x7f2b34101430 2024-09-19T09:06:51.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.172+0000 7f2b33fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b34106a90 0x7f2b341a4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:51.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.172+0000 7f2b337fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b34100a90 0x7f2b341992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:51.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.172+0000 7f2b33fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b34106a90 0x7f2b341a4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52384/0 (socket says 172.21.15.92:52384) 2024-09-19T09:06:51.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.172+0000 7f2b33fff640 1 -- 172.21.15.92:0/1202435217 learned_addr learned my addr 172.21.15.92:0/1202435217 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:51.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.172+0000 7f2b2bfff640 1 --2- 172.21.15.92:0/1202435217 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b34101430 0x7f2b341997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:51.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.172+0000 7f2b33fff640 1 -- 172.21.15.92:0/1202435217 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b34101430 msgr2=0x7f2b341997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:51.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.172+0000 7f2b33fff640 1 --2- 172.21.15.92:0/1202435217 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b34101430 0x7f2b341997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.172+0000 7f2b33fff640 1 -- 172.21.15.92:0/1202435217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b34100a90 msgr2=0x7f2b341992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:51.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.172+0000 7f2b33fff640 1 --2- 172.21.15.92:0/1202435217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b34100a90 0x7f2b341992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.172+0000 7f2b33fff640 1 -- 172.21.15.92:0/1202435217 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b34197090 con 0x7f2b34106a90 2024-09-19T09:06:51.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.173+0000 7f2b33fff640 1 --2- 172.21.15.92:0/1202435217 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b34106a90 0x7f2b341a4320 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c00eaa0 tx=0x7f2b2c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:51.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.173+0000 7f2b317fa640 1 -- 172.21.15.92:0/1202435217 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c00cdb0 con 0x7f2b34106a90 2024-09-19T09:06:51.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.173+0000 7f2b317fa640 1 -- 172.21.15.92:0/1202435217 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b2c005020 con 0x7f2b34106a90 2024-09-19T09:06:51.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.173+0000 7f2b3a0dd640 1 -- 172.21.15.92:0/1202435217 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b34197380 con 0x7f2b34106a90 2024-09-19T09:06:51.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.173+0000 7f2b317fa640 1 -- 172.21.15.92:0/1202435217 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c0116b0 con 0x7f2b34106a90 2024-09-19T09:06:51.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.173+0000 7f2b3a0dd640 1 -- 172.21.15.92:0/1202435217 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b341978e0 con 0x7f2b34106a90 2024-09-19T09:06:51.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.174+0000 7f2b3a0dd640 1 -- 172.21.15.92:0/1202435217 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b341021d0 con 0x7f2b34106a90 2024-09-19T09:06:51.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.175+0000 7f2b317fa640 1 -- 172.21.15.92:0/1202435217 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2b2c005560 con 0x7f2b34106a90 2024-09-19T09:06:51.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.176+0000 7f2b317fa640 1 --2- 172.21.15.92:0/1202435217 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2b200a32c0 0x7f2b200a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:51.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.176+0000 7f2b337fe640 1 --2- 172.21.15.92:0/1202435217 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2b200a32c0 0x7f2b200a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:51.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.176+0000 7f2b317fa640 1 -- 172.21.15.92:0/1202435217 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2b2c0cfac0 con 0x7f2b34106a90 2024-09-19T09:06:51.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.176+0000 7f2b337fe640 1 --2- 172.21.15.92:0/1202435217 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2b200a32c0 0x7f2b200a5780 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2b24005d00 tx=0x7f2b2400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:51.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.180+0000 7f2b317fa640 1 -- 172.21.15.92:0/1202435217 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2b2c016030 con 0x7f2b34106a90 2024-09-19T09:06:51.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.414+0000 7f2b3a0dd640 1 -- 172.21.15.92:0/1202435217 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b34198d80 con 0x7f2b34106a90 2024-09-19T09:06:51.415 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:51 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:06:51.415 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:51 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:06:51.415 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:51 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:06:51.415 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:51 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:06:51.415 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:51 smithi092 ceph-mon[31407]: pgmap v641: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 6.5 KiB/s wr, 65 op/s 2024-09-19T09:06:51.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.415+0000 7f2b317fa640 1 -- 172.21.15.92:0/1202435217 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f2b2c09c7e0 con 0x7f2b34106a90 2024-09-19T09:06:51.416 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:06:51.416 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:06:51.416 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:06:51.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.417+0000 7f2b3a0dd640 1 -- 172.21.15.92:0/1202435217 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2b200a32c0 msgr2=0x7f2b200a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:51.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.417+0000 7f2b3a0dd640 1 --2- 172.21.15.92:0/1202435217 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2b200a32c0 0x7f2b200a5780 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2b24005d00 tx=0x7f2b2400b410 comp rx=0 tx=0).stop 2024-09-19T09:06:51.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.417+0000 7f2b3a0dd640 1 -- 172.21.15.92:0/1202435217 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b34106a90 msgr2=0x7f2b341a4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:51.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.417+0000 7f2b3a0dd640 1 --2- 172.21.15.92:0/1202435217 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b34106a90 0x7f2b341a4320 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c00eaa0 tx=0x7f2b2c00ef60 comp rx=0 tx=0).stop 2024-09-19T09:06:51.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.417+0000 7f2b3a0dd640 1 -- 172.21.15.92:0/1202435217 shutdown_connections 2024-09-19T09:06:51.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.417+0000 7f2b3a0dd640 1 --2- 172.21.15.92:0/1202435217 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2b200a32c0 0x7f2b200a5780 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.417+0000 7f2b3a0dd640 1 --2- 172.21.15.92:0/1202435217 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b34106a90 0x7f2b341a4320 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.417+0000 7f2b3a0dd640 1 --2- 172.21.15.92:0/1202435217 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b34101430 0x7f2b341997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.417+0000 7f2b3a0dd640 1 --2- 172.21.15.92:0/1202435217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b34100a90 0x7f2b341992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.417+0000 7f2b3a0dd640 1 -- 172.21.15.92:0/1202435217 >> 172.21.15.92:0/1202435217 conn(0x7f2b340fc7d0 msgr2=0x7f2b340fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:51.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.417+0000 7f2b3a0dd640 1 -- 172.21.15.92:0/1202435217 shutdown_connections 2024-09-19T09:06:51.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:51.417+0000 7f2b3a0dd640 1 -- 172.21.15.92:0/1202435217 wait complete. 2024-09-19T09:06:51.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:51 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:06:51.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:51 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:06:51.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:51 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:06:51.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:51 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:06:51.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:51 smithi167 ceph-mon[35359]: pgmap v641: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 6.5 KiB/s wr, 65 op/s 2024-09-19T09:06:51.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:51 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:06:51.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:51 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:06:51.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:51 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:06:51.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:51 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:06:51.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:51 smithi190 ceph-mon[35358]: pgmap v641: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 6.5 KiB/s wr, 65 op/s 2024-09-19T09:06:51.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.800+0000 7fe3a728d640 1 -- 172.21.15.92:0/3285935748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3a0102600 msgr2=0x7fe3a0108e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:51.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.800+0000 7fe3a728d640 1 --2- 172.21.15.92:0/3285935748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3a0102600 0x7fe3a0108e90 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fe398009ca0 tx=0x7fe39802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.800+0000 7fe3a728d640 1 -- 172.21.15.92:0/3285935748 shutdown_connections 2024-09-19T09:06:51.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.800+0000 7fe3a728d640 1 --2- 172.21.15.92:0/3285935748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3a0102600 0x7fe3a0108e90 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.800+0000 7fe3a728d640 1 --2- 172.21.15.92:0/3285935748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3a0101c40 0x7fe3a01020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.800+0000 7fe3a728d640 1 --2- 172.21.15.92:0/3285935748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3a0100a50 0x7fe3a0100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.800+0000 7fe3a728d640 1 -- 172.21.15.92:0/3285935748 >> 172.21.15.92:0/3285935748 conn(0x7fe3a00fc1b0 msgr2=0x7fe3a00fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:51.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.800+0000 7fe3a728d640 1 -- 172.21.15.92:0/3285935748 shutdown_connections 2024-09-19T09:06:51.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.801+0000 7fe3a728d640 1 -- 172.21.15.92:0/3285935748 wait complete. 2024-09-19T09:06:51.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.801+0000 7fe3a728d640 1 Processor -- start 2024-09-19T09:06:51.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.801+0000 7fe3a728d640 1 -- start start 2024-09-19T09:06:51.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.801+0000 7fe3a728d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3a0100a50 0x7fe3a0197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:51.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.801+0000 7fe3a728d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3a0101c40 0x7fe3a0198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:51.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.801+0000 7fe3a728d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3a0102600 0x7fe3a019f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:51.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.801+0000 7fe3a728d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a010d840 con 0x7fe3a0101c40 2024-09-19T09:06:51.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.801+0000 7fe3a728d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a010d6c0 con 0x7fe3a0102600 2024-09-19T09:06:51.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.801+0000 7fe3a728d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a010d9c0 con 0x7fe3a0100a50 2024-09-19T09:06:51.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.801+0000 7fe3a4828640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3a0101c40 0x7fe3a0198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:51.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.801+0000 7fe3a4828640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3a0101c40 0x7fe3a0198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37500/0 (socket says 172.21.15.92:37500) 2024-09-19T09:06:51.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.801+0000 7fe3a4828640 1 -- 172.21.15.92:0/3344268169 learned_addr learned my addr 172.21.15.92:0/3344268169 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:51.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.802+0000 7fe3a582a640 1 --2- 172.21.15.92:0/3344268169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3a0102600 0x7fe3a019f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.802+0000 7fe3a4828640 1 -- 172.21.15.92:0/3344268169 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3a0100a50 msgr2=0x7fe3a0197e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.802+0000 7fe3a4828640 1 --2- 172.21.15.92:0/3344268169 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3a0100a50 0x7fe3a0197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.802+0000 7fe3a4828640 1 -- 172.21.15.92:0/3344268169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3a0102600 msgr2=0x7fe3a019f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.802+0000 7fe3a4828640 1 --2- 172.21.15.92:0/3344268169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3a0102600 0x7fe3a019f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.802+0000 7fe3a4828640 1 -- 172.21.15.92:0/3344268169 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a019fa50 con 0x7fe3a0101c40 2024-09-19T09:06:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.802+0000 7fe3a582a640 1 --2- 172.21.15.92:0/3344268169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3a0102600 0x7fe3a019f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:06:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.802+0000 7fe3a4828640 1 --2- 172.21.15.92:0/3344268169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3a0101c40 0x7fe3a0198370 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fe39000b4a0 tx=0x7fe39000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.802+0000 7fe3967fc640 1 -- 172.21.15.92:0/3344268169 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe390014070 con 0x7fe3a0101c40 2024-09-19T09:06:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.802+0000 7fe3967fc640 1 -- 172.21.15.92:0/3344268169 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe390010af0 con 0x7fe3a0101c40 2024-09-19T09:06:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.802+0000 7fe3a728d640 1 -- 172.21.15.92:0/3344268169 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3a019fd40 con 0x7fe3a0101c40 2024-09-19T09:06:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.802+0000 7fe3967fc640 1 -- 172.21.15.92:0/3344268169 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe390017d10 con 0x7fe3a0101c40 2024-09-19T09:06:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.802+0000 7fe3a728d640 1 -- 172.21.15.92:0/3344268169 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3a01a02b0 con 0x7fe3a0101c40 2024-09-19T09:06:51.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.805+0000 7fe3aa02b740 1 Processor -- start 2024-09-19T09:06:51.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.805+0000 7fe3aa02b740 1 -- start start 2024-09-19T09:06:51.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.805+0000 7fe3aa02b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cba88449a0 0x55cba8844da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:51.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.805+0000 7fe3aa02b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cba88452e0 0x55cba8849da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:51.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.805+0000 7fe3aa02b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba884a370 0x55cba884c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:51.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.805+0000 7fe3aa02b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cba87a82f0 con 0x55cba88449a0 2024-09-19T09:06:51.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.805+0000 7fe3aa02b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55cba8750270 con 0x55cba88452e0 2024-09-19T09:06:51.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.805+0000 7fe3aa02b740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55cba87a42b0 con 0x55cba884a370 2024-09-19T09:06:51.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.805+0000 7fe3967fc640 1 -- 172.21.15.92:0/3344268169 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe390017070 con 0x7fe3a0101c40 2024-09-19T09:06:51.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.806+0000 7fe3a582a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cba88449a0 0x55cba8844da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:51.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.806+0000 7fe3a582a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cba88449a0 0x55cba8844da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37502/0 (socket says 172.21.15.92:37502) 2024-09-19T09:06:51.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.806+0000 7fe3a582a640 1 -- 172.21.15.92:0/2663977914 learned_addr learned my addr 172.21.15.92:0/2663977914 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:51.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.806+0000 7fe3a5029640 1 --2- 172.21.15.92:0/2663977914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cba88452e0 0x55cba8849da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:51.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.806+0000 7fe3a582a640 1 -- 172.21.15.92:0/2663977914 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba884a370 msgr2=0x55cba884c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:51.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.806+0000 7fe3a582a640 1 --2- 172.21.15.92:0/2663977914 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba884a370 0x55cba884c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.806+0000 7fe3a582a640 1 -- 172.21.15.92:0/2663977914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cba88452e0 msgr2=0x55cba8849da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:51.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.806+0000 7fe3a582a640 1 --2- 172.21.15.92:0/2663977914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cba88452e0 0x55cba8849da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.806+0000 7fe3a582a640 1 -- 172.21.15.92:0/2663977914 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cba874f340 con 0x55cba88449a0 2024-09-19T09:06:51.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.806+0000 7fe3a582a640 1 --2- 172.21.15.92:0/2663977914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cba88449a0 0x55cba8844da0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fe398009dc0 tx=0x7fe398009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29dbfe77accf6347 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:51.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.806+0000 7fe38b7fe640 1 -- 172.21.15.92:0/2663977914 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe398031450 con 0x55cba88449a0 2024-09-19T09:06:51.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.806+0000 7fe38b7fe640 1 -- 172.21.15.92:0/2663977914 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe398036070 con 0x55cba88449a0 2024-09-19T09:06:51.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.806+0000 7fe38b7fe640 1 -- 172.21.15.92:0/2663977914 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3980044f0 con 0x55cba88449a0 2024-09-19T09:06:51.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.806+0000 7fe3967fc640 1 --2- 172.21.15.92:0/3344268169 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe38c0a32f0 0x7fe38c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:51.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.806+0000 7fe3a5029640 1 --2- 172.21.15.92:0/3344268169 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe38c0a32f0 0x7fe38c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:51.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.807+0000 7fe3967fc640 1 -- 172.21.15.92:0/3344268169 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe3900ced30 con 0x7fe3a0101c40 2024-09-19T09:06:51.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.807+0000 7fe3aa02b740 1 -- 172.21.15.92:0/2663977914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cba88449a0 msgr2=0x55cba8844da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:51.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.807+0000 7fe3a5029640 1 --2- 172.21.15.92:0/3344268169 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe38c0a32f0 0x7fe38c0a57b0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe39c00a510 tx=0x7fe39c00a4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:51.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.807+0000 7fe3aa02b740 1 --2- 172.21.15.92:0/2663977914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cba88449a0 0x55cba8844da0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fe398009dc0 tx=0x7fe398009880 comp rx=0 tx=0).stop 2024-09-19T09:06:51.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.807+0000 7fe3aa02b740 1 -- 172.21.15.92:0/2663977914 shutdown_connections 2024-09-19T09:06:51.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.807+0000 7fe3aa02b740 1 --2- 172.21.15.92:0/2663977914 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba884a370 0x55cba884c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.807+0000 7fe3aa02b740 1 --2- 172.21.15.92:0/2663977914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cba88452e0 0x55cba8849da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.807+0000 7fe3aa02b740 1 --2- 172.21.15.92:0/2663977914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cba88449a0 0x55cba8844da0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.807+0000 7fe3aa02b740 1 -- 172.21.15.92:0/2663977914 >> 172.21.15.92:0/2663977914 conn(0x55cba8840010 msgr2=0x55cba8840410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:51.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.807+0000 7fe3aa02b740 1 -- 172.21.15.92:0/2663977914 shutdown_connections 2024-09-19T09:06:51.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.807+0000 7fe3aa02b740 1 -- 172.21.15.92:0/2663977914 wait complete. 2024-09-19T09:06:51.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.807+0000 7fe3aa02b740 1 -- start start 2024-09-19T09:06:51.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.807+0000 7fe3aa02b740 1 Processor -- start 2024-09-19T09:06:51.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.808+0000 7fe3aa02b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cba88449a0 0x55cba884ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:51.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.808+0000 7fe3aa02b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cba88452e0 0x55cba884f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:51.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.808+0000 7fe3aa02b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba884a370 0x55cba8856150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:51.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.808+0000 7fe3aa02b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cba884d2e0 con 0x55cba88452e0 2024-09-19T09:06:51.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.808+0000 7fe3aa02b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55cba8731290 con 0x55cba88449a0 2024-09-19T09:06:51.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.808+0000 7fe3aa02b740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55cba884d460 con 0x55cba884a370 2024-09-19T09:06:51.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.808+0000 7fe3aa02b740 10 client.0 _ll_register_callbacks cb 0x55cba8762140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:51.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.808+0000 7fe3a4828640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cba88452e0 0x55cba884f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:51.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.808+0000 7fe3a4828640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cba88452e0 0x55cba884f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37518/0 (socket says 172.21.15.92:37518) 2024-09-19T09:06:51.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.808+0000 7fe3a4828640 1 -- 172.21.15.92:0/2112221843 learned_addr learned my addr 172.21.15.92:0/2112221843 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:51.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.808+0000 7fe3a5029640 1 --2- 172.21.15.92:0/2112221843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cba88449a0 0x55cba884ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:51.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.808+0000 7fe3a582a640 1 --2- 172.21.15.92:0/2112221843 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba884a370 0x55cba8856150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:51.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.808+0000 7fe3a4828640 1 -- 172.21.15.92:0/2112221843 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba884a370 msgr2=0x55cba8856150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:51.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.808+0000 7fe3a4828640 1 --2- 172.21.15.92:0/2112221843 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba884a370 0x55cba8856150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.808+0000 7fe3a4828640 1 -- 172.21.15.92:0/2112221843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cba88449a0 msgr2=0x55cba884ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:51.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.808+0000 7fe3a4828640 1 --2- 172.21.15.92:0/2112221843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cba88449a0 0x55cba884ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.808+0000 7fe3a4828640 1 -- 172.21.15.92:0/2112221843 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cba84bb210 con 0x55cba88452e0 2024-09-19T09:06:51.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.808+0000 7fe3a4828640 1 --2- 172.21.15.92:0/2112221843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cba88452e0 0x55cba884f110 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fe3900977b0 tx=0x7fe39009ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10dc429495bd8f5f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.808+0000 7fe388ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:06:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.809+0000 7fe388ff9640 1 -- 172.21.15.92:0/2112221843 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39001e070 con 0x55cba88452e0 2024-09-19T09:06:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.809+0000 7fe388ff9640 1 -- 172.21.15.92:0/2112221843 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe390010ca0 con 0x55cba88452e0 2024-09-19T09:06:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.809+0000 7fe3aa02b740 1 -- 172.21.15.92:0/2112221843 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe398036070 con 0x55cba88452e0 2024-09-19T09:06:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.809+0000 7fe388ff9640 1 -- 172.21.15.92:0/2112221843 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe3900a3fc0 con 0x55cba88452e0 2024-09-19T09:06:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.809+0000 7fe3aa02b740 10 client.17847 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.809+0000 7fe3aa02b740 1 -- 172.21.15.92:0/2112221843 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55cba8587620 con 0x55cba88452e0 2024-09-19T09:06:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.809+0000 7fe388ff9640 1 -- 172.21.15.92:0/2112221843 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe398036070 con 0x55cba88452e0 2024-09-19T09:06:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.809+0000 7fe388ff9640 1 -- 172.21.15.92:0/2112221843 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe39009a7a0 con 0x55cba88452e0 2024-09-19T09:06:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.809+0000 7fe3aa02b740 10 client.17847 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.809+0000 7fe3aa02b740 10 client.17847 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:06:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.809+0000 7fe3aa02b740 20 client.17847 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.809+0000 7fe3aa02b740 1 --2- 172.21.15.92:0/2112221843 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55cba885a800 0x55cba885cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.809+0000 7fe3aa02b740 4 client.17847 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:06:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.809+0000 7fe3aa02b740 1 -- 172.21.15.92:0/2112221843 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cba87b5a20 con 0x55cba885a800 2024-09-19T09:06:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.809+0000 7fe3a5029640 1 --2- 172.21.15.92:0/2112221843 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55cba885a800 0x55cba885cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.810+0000 7fe3a5029640 1 --2- 172.21.15.92:0/2112221843 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55cba885a800 0x55cba885cbf0 crc :-1 s=READY pgs=321 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42cd03f4384a4ba6 server_cookie=f3f69cf7b7a01412 in_seq=0 out_seq=0 2024-09-19T09:06:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.810+0000 7fe388ff9640 10 client.17847 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.810+0000 7fe388ff9640 1 -- 172.21.15.92:0/2112221843 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cba87b5a20 con 0x55cba885a800 2024-09-19T09:06:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.810+0000 7fe388ff9640 10 client.17847 handle_command_reply: tid=0 2024-09-19T09:06:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.810+0000 7fe3aa02b740 1 client.17847 shutdown 2024-09-19T09:06:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.811+0000 7fe3aa02b740 1 -- 172.21.15.92:0/2112221843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cba88452e0 msgr2=0x55cba884f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.811+0000 7fe3aa02b740 1 --2- 172.21.15.92:0/2112221843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cba88452e0 0x55cba884f110 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fe3900977b0 tx=0x7fe39009ada0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.811+0000 7fe3aa02b740 1 -- 172.21.15.92:0/2112221843 shutdown_connections 2024-09-19T09:06:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.811+0000 7fe3aa02b740 1 --2- 172.21.15.92:0/2112221843 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55cba885a800 0x55cba885cbf0 crc :-1 s=READY pgs=321 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.811+0000 7fe3aa02b740 1 --2- 172.21.15.92:0/2112221843 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba884a370 0x55cba8856150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.811+0000 7fe3aa02b740 1 --2- 172.21.15.92:0/2112221843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cba88452e0 0x55cba884f110 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.811+0000 7fe3aa02b740 1 --2- 172.21.15.92:0/2112221843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cba88449a0 0x55cba884ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.811+0000 7fe388ff9640 0 client.17847 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.811+0000 7fe3aa02b740 1 -- 172.21.15.92:0/2112221843 >> 172.21.15.92:0/2112221843 conn(0x55cba8840010 msgr2=0x55cba8841820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.811+0000 7fe3aa02b740 1 -- 172.21.15.92:0/2112221843 shutdown_connections 2024-09-19T09:06:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.811+0000 7fe3aa02b740 1 -- 172.21.15.92:0/2112221843 wait complete. 2024-09-19T09:06:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.811+0000 7fe3aa02b740 20 client.17847 trim_cache size 0 max 16384 2024-09-19T09:06:51.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.825+0000 7fe3aa02b740 1 Processor -- start 2024-09-19T09:06:51.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.825+0000 7fe3aa02b740 1 -- start start 2024-09-19T09:06:51.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.825+0000 7fe3aa02b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba88449a0 0x55cba883f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:51.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.825+0000 7fe3aa02b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cba88452e0 0x55cba8856110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:51.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.825+0000 7fe3aa02b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cba884a370 0x55cba8861520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.825+0000 7fe3aa02b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a01a7070 con 0x55cba884a370 2024-09-19T09:06:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.825+0000 7fe3aa02b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a01a9910 con 0x55cba88452e0 2024-09-19T09:06:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.825+0000 7fe3aa02b740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a01a7700 con 0x55cba88449a0 2024-09-19T09:06:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.825+0000 7fe3a582a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cba884a370 0x55cba8861520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.825+0000 7fe3a582a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cba884a370 0x55cba8861520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37532/0 (socket says 172.21.15.92:37532) 2024-09-19T09:06:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.825+0000 7fe3a582a640 1 -- 172.21.15.92:0/1489859641 learned_addr learned my addr 172.21.15.92:0/1489859641 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.825+0000 7fe3a4828640 1 --2- 172.21.15.92:0/1489859641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cba88452e0 0x55cba8856110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.825+0000 7fe3a5029640 1 --2- 172.21.15.92:0/1489859641 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba88449a0 0x55cba883f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.825+0000 7fe3a582a640 1 -- 172.21.15.92:0/1489859641 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba88449a0 msgr2=0x55cba883f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.825+0000 7fe3a582a640 1 --2- 172.21.15.92:0/1489859641 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba88449a0 0x55cba883f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.825+0000 7fe3a582a640 1 -- 172.21.15.92:0/1489859641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cba88452e0 msgr2=0x55cba8856110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.825+0000 7fe3a582a640 1 --2- 172.21.15.92:0/1489859641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cba88452e0 0x55cba8856110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.825+0000 7fe3a582a640 1 -- 172.21.15.92:0/1489859641 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cba885d250 con 0x55cba884a370 2024-09-19T09:06:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.826+0000 7fe3a582a640 1 --2- 172.21.15.92:0/1489859641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cba884a370 0x55cba8861520 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fe398009430 tx=0x7fe39802af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=788ec8a6e9f5392e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.826+0000 7fe38affd640 1 -- 172.21.15.92:0/1489859641 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe398051070 con 0x55cba884a370 2024-09-19T09:06:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.826+0000 7fe38affd640 1 -- 172.21.15.92:0/1489859641 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe398036050 con 0x55cba884a370 2024-09-19T09:06:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.826+0000 7fe38affd640 1 -- 172.21.15.92:0/1489859641 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe398004340 con 0x55cba884a370 2024-09-19T09:06:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.826+0000 7fe3aa02b740 1 -- 172.21.15.92:0/1489859641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cba884a370 msgr2=0x55cba8861520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.826+0000 7fe3aa02b740 1 --2- 172.21.15.92:0/1489859641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cba884a370 0x55cba8861520 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fe398009430 tx=0x7fe39802af40 comp rx=0 tx=0).stop 2024-09-19T09:06:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.826+0000 7fe3aa02b740 1 -- 172.21.15.92:0/1489859641 shutdown_connections 2024-09-19T09:06:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.826+0000 7fe3aa02b740 1 --2- 172.21.15.92:0/1489859641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cba884a370 0x55cba8861520 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.826+0000 7fe3aa02b740 1 --2- 172.21.15.92:0/1489859641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cba88452e0 0x55cba8856110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.826+0000 7fe3aa02b740 1 --2- 172.21.15.92:0/1489859641 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba88449a0 0x55cba883f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.826+0000 7fe3aa02b740 1 -- 172.21.15.92:0/1489859641 >> 172.21.15.92:0/1489859641 conn(0x55cba8840010 msgr2=0x55cba883e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.826+0000 7fe3aa02b740 1 -- 172.21.15.92:0/1489859641 shutdown_connections 2024-09-19T09:06:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.826+0000 7fe3aa02b740 1 -- 172.21.15.92:0/1489859641 wait complete. 2024-09-19T09:06:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.827+0000 7fe3aa02b740 1 -- start start 2024-09-19T09:06:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.827+0000 7fe3aa02b740 1 Processor -- start 2024-09-19T09:06:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.827+0000 7fe3aa02b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba88449a0 0x55cba8853bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.827+0000 7fe3aa02b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cba88452e0 0x55cba8854100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.827+0000 7fe3aa02b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cba884a370 0x55cba8855110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.827+0000 7fe3aa02b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a01a7dd0 con 0x55cba88452e0 2024-09-19T09:06:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.827+0000 7fe3aa02b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a01a9240 con 0x55cba884a370 2024-09-19T09:06:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.827+0000 7fe3aa02b740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a01a84a0 con 0x55cba88449a0 2024-09-19T09:06:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.827+0000 7fe3aa02b740 10 client.0 _ll_register_callbacks cb 0x7fe390017eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.827+0000 7fe3a4828640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cba88452e0 0x55cba8854100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.827+0000 7fe3a4828640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cba88452e0 0x55cba8854100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37538/0 (socket says 172.21.15.92:37538) 2024-09-19T09:06:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.827+0000 7fe3a4828640 1 -- 172.21.15.92:0/1662032693 learned_addr learned my addr 172.21.15.92:0/1662032693 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.827+0000 7fe3a582a640 1 --2- 172.21.15.92:0/1662032693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cba884a370 0x55cba8855110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.827+0000 7fe3a4828640 1 -- 172.21.15.92:0/1662032693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba88449a0 msgr2=0x55cba8853bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.827+0000 7fe3a4828640 1 --2- 172.21.15.92:0/1662032693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba88449a0 0x55cba8853bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.827+0000 7fe3a4828640 1 -- 172.21.15.92:0/1662032693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cba884a370 msgr2=0x55cba8855110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.827+0000 7fe3a4828640 1 --2- 172.21.15.92:0/1662032693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cba884a370 0x55cba8855110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.827+0000 7fe3a4828640 1 -- 172.21.15.92:0/1662032693 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cba8855720 con 0x55cba88452e0 2024-09-19T09:06:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.827+0000 7fe3a582a640 1 --2- 172.21.15.92:0/1662032693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cba884a370 0x55cba8855110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.828+0000 7fe3a4828640 1 --2- 172.21.15.92:0/1662032693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cba88452e0 0x55cba8854100 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fe39009ab70 tx=0x7fe390017590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bf5fc18751dd41a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.828+0000 7fe388ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:06:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.828+0000 7fe388ff9640 1 -- 172.21.15.92:0/1662032693 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39001e050 con 0x55cba88452e0 2024-09-19T09:06:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.828+0000 7fe3aa02b740 1 -- 172.21.15.92:0/1662032693 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe398036050 con 0x55cba88452e0 2024-09-19T09:06:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.828+0000 7fe388ff9640 1 -- 172.21.15.92:0/1662032693 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe3900979c0 con 0x55cba88452e0 2024-09-19T09:06:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.828+0000 7fe388ff9640 1 -- 172.21.15.92:0/1662032693 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe3900661f0 con 0x55cba88452e0 2024-09-19T09:06:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.828+0000 7fe3aa02b740 10 client.17853 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.828+0000 7fe3aa02b740 1 -- 172.21.15.92:0/1662032693 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55cba88c58d0 con 0x55cba88452e0 2024-09-19T09:06:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.828+0000 7fe388ff9640 1 -- 172.21.15.92:0/1662032693 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe398036050 con 0x55cba88452e0 2024-09-19T09:06:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.828+0000 7fe388ff9640 1 -- 172.21.15.92:0/1662032693 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe39009a7a0 con 0x55cba88452e0 2024-09-19T09:06:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.828+0000 7fe3aa02b740 10 client.17853 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.828+0000 7fe3aa02b740 10 client.17853 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:06:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.828+0000 7fe3aa02b740 20 client.17853 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.828+0000 7fe3aa02b740 1 --2- 172.21.15.92:0/1662032693 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55cba88c6220 0x55cba88c8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:51.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.828+0000 7fe3aa02b740 4 client.17853 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:06:51.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.828+0000 7fe3aa02b740 1 -- 172.21.15.92:0/1662032693 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cba87afd70 con 0x55cba88c6220 2024-09-19T09:06:51.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.829+0000 7fe3a5029640 1 --2- 172.21.15.92:0/1662032693 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55cba88c6220 0x55cba88c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:51.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.829+0000 7fe3a5029640 1 --2- 172.21.15.92:0/1662032693 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55cba88c6220 0x55cba88c8610 crc :-1 s=READY pgs=322 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65c541cc5bb2199a server_cookie=287c33d6426e2aaf in_seq=0 out_seq=0 2024-09-19T09:06:51.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.829+0000 7fe388ff9640 10 client.17853 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:51.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.843+0000 7fe388ff9640 1 -- 172.21.15.92:0/1662032693 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cba87afd70 con 0x55cba88c6220 2024-09-19T09:06:51.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.843+0000 7fe388ff9640 10 client.17853 handle_command_reply: tid=0 2024-09-19T09:06:51.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.843+0000 7fe3aa02b740 1 client.17853 shutdown 2024-09-19T09:06:51.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.843+0000 7fe3aa02b740 1 -- 172.21.15.92:0/1662032693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cba88452e0 msgr2=0x55cba8854100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:51.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.843+0000 7fe3aa02b740 1 --2- 172.21.15.92:0/1662032693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cba88452e0 0x55cba8854100 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fe39009ab70 tx=0x7fe390017590 comp rx=0 tx=0).stop 2024-09-19T09:06:51.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.843+0000 7fe3aa02b740 1 -- 172.21.15.92:0/1662032693 shutdown_connections 2024-09-19T09:06:51.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.843+0000 7fe3aa02b740 1 --2- 172.21.15.92:0/1662032693 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55cba88c6220 0x55cba88c8610 crc :-1 s=READY pgs=322 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.843+0000 7fe3aa02b740 1 --2- 172.21.15.92:0/1662032693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cba884a370 0x55cba8855110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.843+0000 7fe388ff9640 0 client.17853 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:51.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.843+0000 7fe3aa02b740 1 --2- 172.21.15.92:0/1662032693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cba88452e0 0x55cba8854100 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.843+0000 7fe3aa02b740 1 --2- 172.21.15.92:0/1662032693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba88449a0 0x55cba8853bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.843+0000 7fe3aa02b740 1 -- 172.21.15.92:0/1662032693 >> 172.21.15.92:0/1662032693 conn(0x55cba8840010 msgr2=0x55cba883f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:51.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.843+0000 7fe3aa02b740 1 -- 172.21.15.92:0/1662032693 shutdown_connections 2024-09-19T09:06:51.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.843+0000 7fe3aa02b740 1 -- 172.21.15.92:0/1662032693 wait complete. 2024-09-19T09:06:51.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.843+0000 7fe3aa02b740 20 client.17853 trim_cache size 0 max 16384 2024-09-19T09:06:51.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:06:51.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:06:51.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:06:51.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:06:51.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.844+0000 7fe3a728d640 1 -- 172.21.15.92:0/3344268169 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe38c0a32f0 msgr2=0x7fe38c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:51.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.844+0000 7fe3a728d640 1 --2- 172.21.15.92:0/3344268169 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe38c0a32f0 0x7fe38c0a57b0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe39c00a510 tx=0x7fe39c00a4a0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.844+0000 7fe3a728d640 1 -- 172.21.15.92:0/3344268169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3a0101c40 msgr2=0x7fe3a0198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:51.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.844+0000 7fe3a728d640 1 --2- 172.21.15.92:0/3344268169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3a0101c40 0x7fe3a0198370 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fe39000b4a0 tx=0x7fe39000b960 comp rx=0 tx=0).stop 2024-09-19T09:06:51.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.844+0000 7fe3a728d640 1 -- 172.21.15.92:0/3344268169 shutdown_connections 2024-09-19T09:06:51.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.844+0000 7fe3a728d640 1 --2- 172.21.15.92:0/3344268169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3a0102600 0x7fe3a019f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.844+0000 7fe3a728d640 1 --2- 172.21.15.92:0/3344268169 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe38c0a32f0 0x7fe38c0a57b0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.844+0000 7fe3a728d640 1 --2- 172.21.15.92:0/3344268169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3a0101c40 0x7fe3a0198370 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.844+0000 7fe3a728d640 1 --2- 172.21.15.92:0/3344268169 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3a0100a50 0x7fe3a0197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:51.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.844+0000 7fe3a728d640 1 -- 172.21.15.92:0/3344268169 >> 172.21.15.92:0/3344268169 conn(0x7fe3a00fc1b0 msgr2=0x7fe3a0104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:51.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.844+0000 7fe3a728d640 1 -- 172.21.15.92:0/3344268169 shutdown_connections 2024-09-19T09:06:51.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:06:51.844+0000 7fe3a728d640 1 -- 172.21.15.92:0/3344268169 wait complete. 2024-09-19T09:06:51.966 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:06:52.267 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:06:52.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:52 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/1202435217' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:06:52.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:52 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:06:52.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:52 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:06:52.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:52 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/1202435217' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:06:52.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:52 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:06:52.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:52 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:06:52.635 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:52 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1202435217' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:06:52.635 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:06:52.635 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:06:52.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.717+0000 7f1728c57640 1 -- 172.21.15.92:0/1436968806 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1724100e20 msgr2=0x7f1724101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:52.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.717+0000 7f1728c57640 1 --2- 172.21.15.92:0/1436968806 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1724100e20 0x7f1724101200 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f1714009900 tx=0x7f171402a480 comp rx=0 tx=0).stop 2024-09-19T09:06:52.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.717+0000 7f1728c57640 1 -- 172.21.15.92:0/1436968806 shutdown_connections 2024-09-19T09:06:52.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.717+0000 7f1728c57640 1 --2- 172.21.15.92:0/1436968806 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1724102ef0 0x7f172410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:52.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.717+0000 7f1728c57640 1 --2- 172.21.15.92:0/1436968806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1724102570 0x7f17241029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:52.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.717+0000 7f1728c57640 1 --2- 172.21.15.92:0/1436968806 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1724100e20 0x7f1724101200 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:52.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.717+0000 7f1728c57640 1 -- 172.21.15.92:0/1436968806 >> 172.21.15.92:0/1436968806 conn(0x7f17240fc7d0 msgr2=0x7f17240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:52.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.717+0000 7f1728c57640 1 -- 172.21.15.92:0/1436968806 shutdown_connections 2024-09-19T09:06:52.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.717+0000 7f1728c57640 1 -- 172.21.15.92:0/1436968806 wait complete. 2024-09-19T09:06:52.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.718+0000 7f1728c57640 1 Processor -- start 2024-09-19T09:06:52.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.718+0000 7f1728c57640 1 -- start start 2024-09-19T09:06:52.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.718+0000 7f1728c57640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1724100e20 0x7f17241974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:52.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.718+0000 7f1728c57640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1724102570 0x7f1724197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:52.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.718+0000 7f1728c57640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1724102ef0 0x7f172419bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:52.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.718+0000 7f1728c57640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1724110fa0 con 0x7f1724102ef0 2024-09-19T09:06:52.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.718+0000 7f1728c57640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1724110e20 con 0x7f1724100e20 2024-09-19T09:06:52.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.718+0000 7f1728c57640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1724111120 con 0x7f1724102570 2024-09-19T09:06:52.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.719+0000 7f1722d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1724102ef0 0x7f172419bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:52.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.719+0000 7f1722d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1724102ef0 0x7f172419bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37554/0 (socket says 172.21.15.92:37554) 2024-09-19T09:06:52.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.719+0000 7f1722d9d640 1 -- 172.21.15.92:0/232379779 learned_addr learned my addr 172.21.15.92:0/232379779 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:52.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.719+0000 7f172259c640 1 --2- 172.21.15.92:0/232379779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1724100e20 0x7f17241974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:52.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.719+0000 7f171bfff640 1 --2- 172.21.15.92:0/232379779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1724102570 0x7f1724197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:52.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.719+0000 7f1722d9d640 1 -- 172.21.15.92:0/232379779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1724102570 msgr2=0x7f1724197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:52.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.719+0000 7f1722d9d640 1 --2- 172.21.15.92:0/232379779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1724102570 0x7f1724197a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:52.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.719+0000 7f1722d9d640 1 -- 172.21.15.92:0/232379779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1724100e20 msgr2=0x7f17241974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:52.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.719+0000 7f1722d9d640 1 --2- 172.21.15.92:0/232379779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1724100e20 0x7f17241974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:52.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.719+0000 7f1722d9d640 1 -- 172.21.15.92:0/232379779 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f172419c470 con 0x7f1724102ef0 2024-09-19T09:06:52.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.719+0000 7f1722d9d640 1 --2- 172.21.15.92:0/232379779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1724102ef0 0x7f172419bd90 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f171c00cad0 tx=0x7f171c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:52.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.719+0000 7f171b7fe640 1 -- 172.21.15.92:0/232379779 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c00ae20 con 0x7f1724102ef0 2024-09-19T09:06:52.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.719+0000 7f171b7fe640 1 -- 172.21.15.92:0/232379779 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f171c005020 con 0x7f1724102ef0 2024-09-19T09:06:52.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.719+0000 7f1728c57640 1 -- 172.21.15.92:0/232379779 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f172419c760 con 0x7f1724102ef0 2024-09-19T09:06:52.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.719+0000 7f171b7fe640 1 -- 172.21.15.92:0/232379779 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c00f6f0 con 0x7f1724102ef0 2024-09-19T09:06:52.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.720+0000 7f1728c57640 1 -- 172.21.15.92:0/232379779 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17241a4040 con 0x7f1724102ef0 2024-09-19T09:06:52.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.722+0000 7f171b7fe640 1 -- 172.21.15.92:0/232379779 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f171c0051d0 con 0x7f1724102ef0 2024-09-19T09:06:52.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.722+0000 7f172b030740 1 Processor -- start 2024-09-19T09:06:52.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.722+0000 7f172b030740 1 -- start start 2024-09-19T09:06:52.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.722+0000 7f172b030740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563671806b40 0x563671805090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:52.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.722+0000 7f172b030740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5636718055d0 0x563671805a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:52.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.722+0000 7f171b7fe640 1 --2- 172.21.15.92:0/232379779 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f17100a3240 0x7f17100a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:52.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.722+0000 7f172b030740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563671810370 0x563671812760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:52.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.722+0000 7f172b030740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56367176b2f0 con 0x563671810370 2024-09-19T09:06:52.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.722+0000 7f172b030740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563671712cf0 con 0x563671806b40 2024-09-19T09:06:52.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.722+0000 7f172b030740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5636717672b0 con 0x5636718055d0 2024-09-19T09:06:52.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.723+0000 7f171bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563671810370 0x563671812760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:52.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.723+0000 7f1722d9d640 1 --2- 172.21.15.92:0/232379779 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f17100a3240 0x7f17100a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:52.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.723+0000 7f171bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563671810370 0x563671812760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37556/0 (socket says 172.21.15.92:37556) 2024-09-19T09:06:52.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.723+0000 7f171bfff640 1 -- 172.21.15.92:0/3683725177 learned_addr learned my addr 172.21.15.92:0/3683725177 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:52.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.723+0000 7f171bfff640 1 --2- 172.21.15.92:0/3683725177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563671806b40 0x563671805090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:52.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.723+0000 7f172259c640 1 --2- 172.21.15.92:0/3683725177 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5636718055d0 0x563671805a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:52.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.723+0000 7f171b7fe640 1 -- 172.21.15.92:0/232379779 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f171c0cf9b0 con 0x7f1724102ef0 2024-09-19T09:06:52.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.723+0000 7f171bfff640 1 -- 172.21.15.92:0/3683725177 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5636718055d0 msgr2=0x563671805a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:52.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.723+0000 7f171bfff640 1 --2- 172.21.15.92:0/3683725177 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5636718055d0 0x563671805a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:52.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.723+0000 7f171bfff640 1 -- 172.21.15.92:0/3683725177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563671806b40 msgr2=0x563671805090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:52.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.723+0000 7f171bfff640 1 --2- 172.21.15.92:0/3683725177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563671806b40 0x563671805090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:52.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.723+0000 7f171bfff640 1 -- 172.21.15.92:0/3683725177 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636716f73a0 con 0x563671810370 2024-09-19T09:06:52.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.723+0000 7f171bfff640 1 --2- 172.21.15.92:0/3683725177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563671810370 0x563671812760 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f170c00af70 tx=0x7f170c00a2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=683d1708e473f6c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:52.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.723+0000 7f1722d9d640 1 --2- 172.21.15.92:0/232379779 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f17100a3240 0x7f17100a5700 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f171c09bcd0 tx=0x7f171c096990 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:52.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.723+0000 7f1718ff9640 1 -- 172.21.15.92:0/3683725177 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170c01d070 con 0x563671810370 2024-09-19T09:06:52.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.723+0000 7f1718ff9640 1 -- 172.21.15.92:0/3683725177 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f170c016e50 con 0x563671810370 2024-09-19T09:06:52.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.723+0000 7f1718ff9640 1 -- 172.21.15.92:0/3683725177 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170c012920 con 0x563671810370 2024-09-19T09:06:52.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.724+0000 7f172b030740 1 -- 172.21.15.92:0/3683725177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563671810370 msgr2=0x563671812760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:52.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.724+0000 7f172b030740 1 --2- 172.21.15.92:0/3683725177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563671810370 0x563671812760 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f170c00af70 tx=0x7f170c00a2b0 comp rx=0 tx=0).stop 2024-09-19T09:06:52.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.724+0000 7f172b030740 1 -- 172.21.15.92:0/3683725177 shutdown_connections 2024-09-19T09:06:52.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.724+0000 7f172b030740 1 --2- 172.21.15.92:0/3683725177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563671810370 0x563671812760 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:52.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.724+0000 7f172b030740 1 --2- 172.21.15.92:0/3683725177 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5636718055d0 0x563671805a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:52.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.724+0000 7f172b030740 1 --2- 172.21.15.92:0/3683725177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563671806b40 0x563671805090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:52.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.724+0000 7f172b030740 1 -- 172.21.15.92:0/3683725177 >> 172.21.15.92:0/3683725177 conn(0x5636717ce310 msgr2=0x563671801c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:52.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.724+0000 7f172b030740 1 -- 172.21.15.92:0/3683725177 shutdown_connections 2024-09-19T09:06:52.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.724+0000 7f172b030740 1 -- 172.21.15.92:0/3683725177 wait complete. 2024-09-19T09:06:52.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.724+0000 7f172b030740 1 -- start start 2024-09-19T09:06:52.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.725+0000 7f172b030740 1 Processor -- start 2024-09-19T09:06:52.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.725+0000 7f172b030740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5636718055d0 0x56367180fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:52.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.725+0000 7f172b030740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563671806b40 0x56367180d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:52.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.725+0000 7f172b030740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563671810370 0x56367180d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:52.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.725+0000 7f172b030740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563671813010 con 0x563671810370 2024-09-19T09:06:52.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.725+0000 7f172b030740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563671726060 con 0x563671806b40 2024-09-19T09:06:52.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.725+0000 7f172b030740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x563671813190 con 0x5636718055d0 2024-09-19T09:06:52.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.725+0000 7f172b030740 10 client.0 _ll_register_callbacks cb 0x5636714798c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:52.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.725+0000 7f171bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563671810370 0x56367180d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:52.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.725+0000 7f171bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563671810370 0x56367180d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37568/0 (socket says 172.21.15.92:37568) 2024-09-19T09:06:52.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.725+0000 7f171bfff640 1 -- 172.21.15.92:0/3031534568 learned_addr learned my addr 172.21.15.92:0/3031534568 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:52.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.725+0000 7f171bfff640 1 --2- 172.21.15.92:0/3031534568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5636718055d0 0x56367180fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:52.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.725+0000 7f172259c640 1 --2- 172.21.15.92:0/3031534568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563671806b40 0x56367180d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:52.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.725+0000 7f171bfff640 1 -- 172.21.15.92:0/3031534568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5636718055d0 msgr2=0x56367180fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:52.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.725+0000 7f171bfff640 1 --2- 172.21.15.92:0/3031534568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5636718055d0 0x56367180fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:52.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.725+0000 7f171bfff640 1 -- 172.21.15.92:0/3031534568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563671806b40 msgr2=0x56367180d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:52.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.725+0000 7f171bfff640 1 --2- 172.21.15.92:0/3031534568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563671806b40 0x56367180d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:52.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.725+0000 7f171bfff640 1 -- 172.21.15.92:0/3031534568 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636714dc3c0 con 0x563671810370 2024-09-19T09:06:52.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.725+0000 7f172259c640 1 --2- 172.21.15.92:0/3031534568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563671806b40 0x56367180d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:06:52.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.725+0000 7f171bfff640 1 --2- 172.21.15.92:0/3031534568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563671810370 0x56367180d640 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f170c001eb0 tx=0x7f170c012500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1871be0dc52274c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:52.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.725+0000 7f1709ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:06:52.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.726+0000 7f1709ffb640 1 -- 172.21.15.92:0/3031534568 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170c02a060 con 0x563671810370 2024-09-19T09:06:52.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.726+0000 7f1709ffb640 1 -- 172.21.15.92:0/3031534568 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f170c012cc0 con 0x563671810370 2024-09-19T09:06:52.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.726+0000 7f172b030740 1 -- 172.21.15.92:0/3031534568 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f170c016e50 con 0x563671810370 2024-09-19T09:06:52.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.726+0000 7f1709ffb640 1 -- 172.21.15.92:0/3031534568 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f170c01d040 con 0x563671810370 2024-09-19T09:06:52.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.726+0000 7f172b030740 10 client.17865 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:52.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.726+0000 7f172b030740 1 -- 172.21.15.92:0/3031534568 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56367181eae0 con 0x563671810370 2024-09-19T09:06:52.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.726+0000 7f1709ffb640 1 -- 172.21.15.92:0/3031534568 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f170c016e50 con 0x563671810370 2024-09-19T09:06:52.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.726+0000 7f1709ffb640 1 -- 172.21.15.92:0/3031534568 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f170c02f070 con 0x563671810370 2024-09-19T09:06:52.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.726+0000 7f172b030740 10 client.17865 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:52.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.726+0000 7f172b030740 10 client.17865 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:06:52.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.726+0000 7f172b030740 20 client.17865 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:52.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.726+0000 7f172b030740 1 --2- 172.21.15.92:0/3031534568 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56367181fe30 0x563671822220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:52.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.726+0000 7f172b030740 4 client.17865 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:06:52.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.726+0000 7f172b030740 1 -- 172.21.15.92:0/3031534568 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563671778860 con 0x56367181fe30 2024-09-19T09:06:52.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.727+0000 7f172259c640 1 --2- 172.21.15.92:0/3031534568 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56367181fe30 0x563671822220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:52.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.727+0000 7f172259c640 1 --2- 172.21.15.92:0/3031534568 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56367181fe30 0x563671822220 crc :-1 s=READY pgs=323 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e69a0e1d7dc4ebb4 server_cookie=1164a45d8733af05 in_seq=0 out_seq=0 2024-09-19T09:06:52.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.727+0000 7f1709ffb640 10 client.17865 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:52.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.728+0000 7f1709ffb640 1 -- 172.21.15.92:0/3031534568 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563671778860 con 0x56367181fe30 2024-09-19T09:06:52.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.728+0000 7f1709ffb640 10 client.17865 handle_command_reply: tid=0 2024-09-19T09:06:52.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.728+0000 7f172b030740 1 client.17865 shutdown 2024-09-19T09:06:52.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.728+0000 7f172b030740 1 -- 172.21.15.92:0/3031534568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563671810370 msgr2=0x56367180d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:52.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.728+0000 7f172b030740 1 --2- 172.21.15.92:0/3031534568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563671810370 0x56367180d640 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f170c001eb0 tx=0x7f170c012500 comp rx=0 tx=0).stop 2024-09-19T09:06:52.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.728+0000 7f172b030740 1 -- 172.21.15.92:0/3031534568 shutdown_connections 2024-09-19T09:06:52.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.728+0000 7f172b030740 1 --2- 172.21.15.92:0/3031534568 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56367181fe30 0x563671822220 crc :-1 s=READY pgs=323 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:52.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.728+0000 7f172b030740 1 --2- 172.21.15.92:0/3031534568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563671810370 0x56367180d640 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:52.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.728+0000 7f172b030740 1 --2- 172.21.15.92:0/3031534568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563671806b40 0x56367180d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:52.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.728+0000 7f172b030740 1 --2- 172.21.15.92:0/3031534568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5636718055d0 0x56367180fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:52.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.728+0000 7f172b030740 1 -- 172.21.15.92:0/3031534568 >> 172.21.15.92:0/3031534568 conn(0x5636717ce310 msgr2=0x563671807960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:52.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.728+0000 7f1709ffb640 0 client.17865 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:52.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.728+0000 7f172b030740 1 -- 172.21.15.92:0/3031534568 shutdown_connections 2024-09-19T09:06:52.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.728+0000 7f172b030740 1 -- 172.21.15.92:0/3031534568 wait complete. 2024-09-19T09:06:52.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.728+0000 7f172b030740 20 client.17865 trim_cache size 0 max 16384 2024-09-19T09:06:52.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.741+0000 7f172b030740 1 Processor -- start 2024-09-19T09:06:52.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.741+0000 7f172b030740 1 -- start start 2024-09-19T09:06:52.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.741+0000 7f172b030740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5636718055d0 0x56367181c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:52.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.741+0000 7f172b030740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563671806b40 0x563671801e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:52.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.741+0000 7f172b030740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563671810370 0x563671808120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:52.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.741+0000 7f172b030740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f17241a93e0 con 0x563671810370 2024-09-19T09:06:52.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.741+0000 7f172b030740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f17241abc80 con 0x5636718055d0 2024-09-19T09:06:52.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.741+0000 7f172b030740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f17241a9a70 con 0x563671806b40 2024-09-19T09:06:52.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.741+0000 7f171bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563671810370 0x563671808120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:52.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.741+0000 7f171bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563671810370 0x563671808120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37578/0 (socket says 172.21.15.92:37578) 2024-09-19T09:06:52.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.741+0000 7f171bfff640 1 -- 172.21.15.92:0/3098749430 learned_addr learned my addr 172.21.15.92:0/3098749430 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:52.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.741+0000 7f171bfff640 1 --2- 172.21.15.92:0/3098749430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5636718055d0 0x56367181c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:52.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.741+0000 7f172259c640 1 --2- 172.21.15.92:0/3098749430 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563671806b40 0x563671801e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:52.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.742+0000 7f171bfff640 1 -- 172.21.15.92:0/3098749430 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563671806b40 msgr2=0x563671801e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:52.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.742+0000 7f171bfff640 1 --2- 172.21.15.92:0/3098749430 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563671806b40 0x563671801e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:52.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.742+0000 7f171bfff640 1 -- 172.21.15.92:0/3098749430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5636718055d0 msgr2=0x56367181c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:52.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.742+0000 7f171bfff640 1 --2- 172.21.15.92:0/3098749430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5636718055d0 0x56367181c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:52.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.742+0000 7f171bfff640 1 -- 172.21.15.92:0/3098749430 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563671806300 con 0x563671810370 2024-09-19T09:06:52.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.742+0000 7f171bfff640 1 --2- 172.21.15.92:0/3098749430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563671810370 0x563671808120 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f170c0164d0 tx=0x7f170c0047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df07c3ebf183db7b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:52.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.742+0000 7f170bfff640 1 -- 172.21.15.92:0/3098749430 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170c035040 con 0x563671810370 2024-09-19T09:06:52.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.742+0000 7f170bfff640 1 -- 172.21.15.92:0/3098749430 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f170c00a6c0 con 0x563671810370 2024-09-19T09:06:52.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.742+0000 7f170bfff640 1 -- 172.21.15.92:0/3098749430 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170c02a040 con 0x563671810370 2024-09-19T09:06:52.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.743+0000 7f172b030740 1 -- 172.21.15.92:0/3098749430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563671810370 msgr2=0x563671808120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:52.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.743+0000 7f172b030740 1 --2- 172.21.15.92:0/3098749430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563671810370 0x563671808120 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f170c0164d0 tx=0x7f170c0047d0 comp rx=0 tx=0).stop 2024-09-19T09:06:52.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.743+0000 7f172b030740 1 -- 172.21.15.92:0/3098749430 shutdown_connections 2024-09-19T09:06:52.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.743+0000 7f172b030740 1 --2- 172.21.15.92:0/3098749430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563671810370 0x563671808120 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:52.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.743+0000 7f172b030740 1 --2- 172.21.15.92:0/3098749430 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563671806b40 0x563671801e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:52.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.743+0000 7f172b030740 1 --2- 172.21.15.92:0/3098749430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5636718055d0 0x56367181c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:52.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.743+0000 7f172b030740 1 -- 172.21.15.92:0/3098749430 >> 172.21.15.92:0/3098749430 conn(0x5636717ce310 msgr2=0x563671801700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:52.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.743+0000 7f172b030740 1 -- 172.21.15.92:0/3098749430 shutdown_connections 2024-09-19T09:06:52.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.743+0000 7f172b030740 1 -- 172.21.15.92:0/3098749430 wait complete. 2024-09-19T09:06:52.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.743+0000 7f172b030740 1 -- start start 2024-09-19T09:06:52.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.743+0000 7f172b030740 1 Processor -- start 2024-09-19T09:06:52.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.743+0000 7f172b030740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5636718055d0 0x5636718223e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:52.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.743+0000 7f172b030740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563671806b40 0x563671822920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:52.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.743+0000 7f172b030740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563671810370 0x563671888760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:52.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.743+0000 7f172b030740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f17241aa140 con 0x5636718055d0 2024-09-19T09:06:52.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.743+0000 7f172b030740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f17241ab5b0 con 0x563671810370 2024-09-19T09:06:52.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.743+0000 7f172b030740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f17241aa810 con 0x563671806b40 2024-09-19T09:06:52.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.743+0000 7f172b030740 10 client.0 _ll_register_callbacks cb 0x7f170c01b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:52.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.743+0000 7f171bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5636718055d0 0x5636718223e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:52.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.744+0000 7f171bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5636718055d0 0x5636718223e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37582/0 (socket says 172.21.15.92:37582) 2024-09-19T09:06:52.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.744+0000 7f171bfff640 1 -- 172.21.15.92:0/2459227453 learned_addr learned my addr 172.21.15.92:0/2459227453 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:52.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.744+0000 7f172259c640 1 --2- 172.21.15.92:0/2459227453 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563671806b40 0x563671822920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:52.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.744+0000 7f171bfff640 1 --2- 172.21.15.92:0/2459227453 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563671810370 0x563671888760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:52.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.744+0000 7f171bfff640 1 -- 172.21.15.92:0/2459227453 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563671806b40 msgr2=0x563671822920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:52.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.744+0000 7f171bfff640 1 --2- 172.21.15.92:0/2459227453 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563671806b40 0x563671822920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:52.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.744+0000 7f171bfff640 1 -- 172.21.15.92:0/2459227453 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563671810370 msgr2=0x563671888760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:52.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.744+0000 7f171bfff640 1 --2- 172.21.15.92:0/2459227453 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563671810370 0x563671888760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:52.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.744+0000 7f171bfff640 1 -- 172.21.15.92:0/2459227453 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563671888da0 con 0x5636718055d0 2024-09-19T09:06:52.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.744+0000 7f171bfff640 1 --2- 172.21.15.92:0/2459227453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5636718055d0 0x5636718223e0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f170c0256e0 tx=0x7f170c00ae50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f67f2b605405098 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:52.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.744+0000 7f1709ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:06:52.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.744+0000 7f1709ffb640 1 -- 172.21.15.92:0/2459227453 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170c042020 con 0x5636718055d0 2024-09-19T09:06:52.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.744+0000 7f1709ffb640 1 -- 172.21.15.92:0/2459227453 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f170c025af0 con 0x5636718055d0 2024-09-19T09:06:52.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.744+0000 7f172b030740 1 -- 172.21.15.92:0/2459227453 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f170c00a6c0 con 0x5636718055d0 2024-09-19T09:06:52.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.744+0000 7f1709ffb640 1 -- 172.21.15.92:0/2459227453 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f170c02a050 con 0x5636718055d0 2024-09-19T09:06:52.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.744+0000 7f172b030740 10 client.17871 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:52.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.744+0000 7f172b030740 1 -- 172.21.15.92:0/2459227453 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56367188a060 con 0x5636718055d0 2024-09-19T09:06:52.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.745+0000 7f1709ffb640 1 -- 172.21.15.92:0/2459227453 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f170c00a6c0 con 0x5636718055d0 2024-09-19T09:06:52.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.745+0000 7f1709ffb640 1 -- 172.21.15.92:0/2459227453 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f170c02f070 con 0x5636718055d0 2024-09-19T09:06:52.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.745+0000 7f172b030740 10 client.17871 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:52.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.745+0000 7f172b030740 10 client.17871 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:06:52.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.745+0000 7f172b030740 20 client.17871 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:52.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.745+0000 7f172b030740 1 --2- 172.21.15.92:0/2459227453 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56367188a620 0x56367188ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:52.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.745+0000 7f172b030740 4 client.17871 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:06:52.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.745+0000 7f172b030740 1 -- 172.21.15.92:0/2459227453 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563671772d70 con 0x56367188a620 2024-09-19T09:06:52.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.745+0000 7f172259c640 1 --2- 172.21.15.92:0/2459227453 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56367188a620 0x56367188ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:52.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.745+0000 7f172259c640 1 --2- 172.21.15.92:0/2459227453 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56367188a620 0x56367188ca10 crc :-1 s=READY pgs=324 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb3464d0ecbfeb39 server_cookie=bddce27ee9c345a7 in_seq=0 out_seq=0 2024-09-19T09:06:52.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.745+0000 7f1709ffb640 10 client.17871 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:52.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.746+0000 7f1709ffb640 1 -- 172.21.15.92:0/2459227453 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563671772d70 con 0x56367188a620 2024-09-19T09:06:52.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.746+0000 7f1709ffb640 10 client.17871 handle_command_reply: tid=0 2024-09-19T09:06:52.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.746+0000 7f172b030740 1 client.17871 shutdown 2024-09-19T09:06:52.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.746+0000 7f172b030740 1 -- 172.21.15.92:0/2459227453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5636718055d0 msgr2=0x5636718223e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:52.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.746+0000 7f172b030740 1 --2- 172.21.15.92:0/2459227453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5636718055d0 0x5636718223e0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f170c0256e0 tx=0x7f170c00ae50 comp rx=0 tx=0).stop 2024-09-19T09:06:52.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.746+0000 7f172b030740 1 -- 172.21.15.92:0/2459227453 shutdown_connections 2024-09-19T09:06:52.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.746+0000 7f172b030740 1 --2- 172.21.15.92:0/2459227453 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56367188a620 0x56367188ca10 crc :-1 s=READY pgs=324 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:52.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.746+0000 7f172b030740 1 --2- 172.21.15.92:0/2459227453 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563671810370 0x563671888760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:52.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.746+0000 7f172b030740 1 --2- 172.21.15.92:0/2459227453 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563671806b40 0x563671822920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:52.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.746+0000 7f1709ffb640 0 client.17871 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:52.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.746+0000 7f172b030740 1 --2- 172.21.15.92:0/2459227453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5636718055d0 0x5636718223e0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:52.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.746+0000 7f172b030740 1 -- 172.21.15.92:0/2459227453 >> 172.21.15.92:0/2459227453 conn(0x5636717ce310 msgr2=0x56367180e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:52.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.746+0000 7f172b030740 1 -- 172.21.15.92:0/2459227453 shutdown_connections 2024-09-19T09:06:52.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.746+0000 7f172b030740 1 -- 172.21.15.92:0/2459227453 wait complete. 2024-09-19T09:06:52.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.746+0000 7f172b030740 20 client.17871 trim_cache size 0 max 16384 2024-09-19T09:06:52.754 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-19T09:06:52.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.747+0000 7f1728c57640 1 -- 172.21.15.92:0/232379779 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f17100a3240 msgr2=0x7f17100a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:52.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.747+0000 7f1728c57640 1 --2- 172.21.15.92:0/232379779 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f17100a3240 0x7f17100a5700 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f171c09bcd0 tx=0x7f171c096990 comp rx=0 tx=0).stop 2024-09-19T09:06:52.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.747+0000 7f1728c57640 1 -- 172.21.15.92:0/232379779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1724102ef0 msgr2=0x7f172419bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:52.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.747+0000 7f1728c57640 1 --2- 172.21.15.92:0/232379779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1724102ef0 0x7f172419bd90 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f171c00cad0 tx=0x7f171c00cf90 comp rx=0 tx=0).stop 2024-09-19T09:06:52.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.747+0000 7f1728c57640 1 -- 172.21.15.92:0/232379779 shutdown_connections 2024-09-19T09:06:52.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.747+0000 7f1728c57640 1 --2- 172.21.15.92:0/232379779 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f17100a3240 0x7f17100a5700 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:52.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.747+0000 7f1728c57640 1 --2- 172.21.15.92:0/232379779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1724102ef0 0x7f172419bd90 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:52.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.747+0000 7f1728c57640 1 --2- 172.21.15.92:0/232379779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1724102570 0x7f1724197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:52.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.747+0000 7f1728c57640 1 --2- 172.21.15.92:0/232379779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1724100e20 0x7f17241974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:52.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.747+0000 7f1728c57640 1 -- 172.21.15.92:0/232379779 >> 172.21.15.92:0/232379779 conn(0x7f17240fc7d0 msgr2=0x7f17240febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:52.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.747+0000 7f1728c57640 1 -- 172.21.15.92:0/232379779 shutdown_connections 2024-09-19T09:06:52.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:52.747+0000 7f1728c57640 1 -- 172.21.15.92:0/232379779 wait complete. 2024-09-19T09:06:53.343 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:53 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:06:53.343 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:53 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:06:53.343 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:53 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:06:53.343 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:53 smithi092 ceph-mon[31407]: pgmap v642: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 4.1 KiB/s wr, 95 op/s 2024-09-19T09:06:53.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:53 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:06:53.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:53 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:06:53.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:53 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:06:53.603 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:53 smithi167 ceph-mon[35359]: pgmap v642: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 4.1 KiB/s wr, 95 op/s 2024-09-19T09:06:53.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:53 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:06:53.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:53 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:06:53.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:53 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:06:53.625 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:53 smithi190 ceph-mon[35358]: pgmap v642: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 4.1 KiB/s wr, 95 op/s 2024-09-19T09:06:54.425 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:06:54.426 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:06:54.678 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:06:55.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.110+0000 7ffad52ab640 1 -- 172.21.15.92:0/2908865684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffad0103780 msgr2=0x7ffad0107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:55.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.110+0000 7ffad52ab640 1 --2- 172.21.15.92:0/2908865684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffad0103780 0x7ffad0107bc0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7ffab8009930 tx=0x7ffab802a420 comp rx=0 tx=0).stop 2024-09-19T09:06:55.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.110+0000 7ffad52ab640 1 -- 172.21.15.92:0/2908865684 shutdown_connections 2024-09-19T09:06:55.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.110+0000 7ffad52ab640 1 --2- 172.21.15.92:0/2908865684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffad0108300 0x7ffad010ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:55.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.110+0000 7ffad52ab640 1 --2- 172.21.15.92:0/2908865684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffad0103780 0x7ffad0107bc0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:55.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.110+0000 7ffad52ab640 1 --2- 172.21.15.92:0/2908865684 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffad0102dd0 0x7ffad01031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:55.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.110+0000 7ffad52ab640 1 -- 172.21.15.92:0/2908865684 >> 172.21.15.92:0/2908865684 conn(0x7ffad00fc7d0 msgr2=0x7ffad00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:55.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.110+0000 7ffad52ab640 1 -- 172.21.15.92:0/2908865684 shutdown_connections 2024-09-19T09:06:55.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.110+0000 7ffad52ab640 1 -- 172.21.15.92:0/2908865684 wait complete. 2024-09-19T09:06:55.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.111+0000 7ffad52ab640 1 Processor -- start 2024-09-19T09:06:55.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.111+0000 7ffad52ab640 1 -- start start 2024-09-19T09:06:55.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.111+0000 7ffad52ab640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffad0102dd0 0x7ffad01985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:55.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.111+0000 7ffad52ab640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffad0103780 0x7ffad0198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:55.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.111+0000 7ffad52ab640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffad0108300 0x7ffad019cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:55.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.111+0000 7ffad52ab640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffad0112070 con 0x7ffad0102dd0 2024-09-19T09:06:55.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.111+0000 7ffad52ab640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ffad0111ef0 con 0x7ffad0108300 2024-09-19T09:06:55.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.111+0000 7ffad52ab640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ffad01121f0 con 0x7ffad0103780 2024-09-19T09:06:55.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.111+0000 7ffaceffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffad0102dd0 0x7ffad01985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:55.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.111+0000 7ffaceffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffad0102dd0 0x7ffad01985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37596/0 (socket says 172.21.15.92:37596) 2024-09-19T09:06:55.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.111+0000 7ffaceffd640 1 -- 172.21.15.92:0/2248019984 learned_addr learned my addr 172.21.15.92:0/2248019984 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:55.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.111+0000 7ffac7fff640 1 --2- 172.21.15.92:0/2248019984 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffad0103780 0x7ffad0198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:55.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.111+0000 7ffacf7fe640 1 --2- 172.21.15.92:0/2248019984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffad0108300 0x7ffad019cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:55.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.112+0000 7ffaceffd640 1 -- 172.21.15.92:0/2248019984 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffad0103780 msgr2=0x7ffad0198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:55.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.112+0000 7ffaceffd640 1 --2- 172.21.15.92:0/2248019984 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffad0103780 0x7ffad0198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:55.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.112+0000 7ffaceffd640 1 -- 172.21.15.92:0/2248019984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffad0108300 msgr2=0x7ffad019cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:55.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.112+0000 7ffaceffd640 1 --2- 172.21.15.92:0/2248019984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffad0108300 0x7ffad019cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:55.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.112+0000 7ffaceffd640 1 -- 172.21.15.92:0/2248019984 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad019d5a0 con 0x7ffad0102dd0 2024-09-19T09:06:55.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.112+0000 7ffacf7fe640 1 --2- 172.21.15.92:0/2248019984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffad0108300 0x7ffad019cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:06:55.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.112+0000 7ffac7fff640 1 --2- 172.21.15.92:0/2248019984 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffad0103780 0x7ffad0198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:55.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.112+0000 7ffaceffd640 1 --2- 172.21.15.92:0/2248019984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffad0102dd0 0x7ffad01985f0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7ffac000d770 tx=0x7ffac000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:55.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.112+0000 7ffaccff9640 1 -- 172.21.15.92:0/2248019984 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac0017070 con 0x7ffad0102dd0 2024-09-19T09:06:55.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.112+0000 7ffad52ab640 1 -- 172.21.15.92:0/2248019984 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffad019d890 con 0x7ffad0102dd0 2024-09-19T09:06:55.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.112+0000 7ffaccff9640 1 -- 172.21.15.92:0/2248019984 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffac0005500 con 0x7ffad0102dd0 2024-09-19T09:06:55.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.112+0000 7ffaccff9640 1 -- 172.21.15.92:0/2248019984 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac0004e00 con 0x7ffad0102dd0 2024-09-19T09:06:55.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.112+0000 7ffad52ab640 1 -- 172.21.15.92:0/2248019984 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffad01a5170 con 0x7ffad0102dd0 2024-09-19T09:06:55.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.114+0000 7ffaccff9640 1 -- 172.21.15.92:0/2248019984 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ffac0004fa0 con 0x7ffad0102dd0 2024-09-19T09:06:55.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.115+0000 7ffaccff9640 1 --2- 172.21.15.92:0/2248019984 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffabc0a3240 0x7ffabc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:55.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.115+0000 7ffac7fff640 1 --2- 172.21.15.92:0/2248019984 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffabc0a3240 0x7ffabc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:55.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.115+0000 7ffaccff9640 1 -- 172.21.15.92:0/2248019984 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ffac00cf3f0 con 0x7ffad0102dd0 2024-09-19T09:06:55.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.115+0000 7ffac7fff640 1 --2- 172.21.15.92:0/2248019984 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffabc0a3240 0x7ffabc0a5700 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ffab8009900 tx=0x7ffab8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:55.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.116+0000 7ffad7684740 1 Processor -- start 2024-09-19T09:06:55.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.116+0000 7ffad7684740 1 -- start start 2024-09-19T09:06:55.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.116+0000 7ffad7684740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f034f5b60 0x562f034f5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:55.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.116+0000 7ffad7684740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f034f6480 0x562f03500800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:55.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.116+0000 7ffad7684740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562f03500d40 0x562f03503130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:55.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.116+0000 7ffad7684740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562f0345b280 con 0x562f034f6480 2024-09-19T09:06:55.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.116+0000 7ffad7684740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x562f03402b10 con 0x562f034f5b60 2024-09-19T09:06:55.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.116+0000 7ffad7684740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x562f03457240 con 0x562f03500d40 2024-09-19T09:06:55.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.116+0000 7ffac7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f034f6480 0x562f03500800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:55.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.116+0000 7ffac7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f034f6480 0x562f03500800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37602/0 (socket says 172.21.15.92:37602) 2024-09-19T09:06:55.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.116+0000 7ffac7fff640 1 -- 172.21.15.92:0/4290185827 learned_addr learned my addr 172.21.15.92:0/4290185827 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:55.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.117+0000 7ffaceffd640 1 --2- 172.21.15.92:0/4290185827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f034f5b60 0x562f034f5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:55.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.117+0000 7ffacf7fe640 1 --2- 172.21.15.92:0/4290185827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562f03500d40 0x562f03503130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:55.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.117+0000 7ffac7fff640 1 -- 172.21.15.92:0/4290185827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562f03500d40 msgr2=0x562f03503130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:55.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.117+0000 7ffac7fff640 1 --2- 172.21.15.92:0/4290185827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562f03500d40 0x562f03503130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:55.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.117+0000 7ffac7fff640 1 -- 172.21.15.92:0/4290185827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f034f5b60 msgr2=0x562f034f5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:55.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.117+0000 7ffac7fff640 1 --2- 172.21.15.92:0/4290185827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f034f5b60 0x562f034f5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:55.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.117+0000 7ffac7fff640 1 -- 172.21.15.92:0/4290185827 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f0340f1f0 con 0x562f034f6480 2024-09-19T09:06:55.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.117+0000 7ffaceffd640 1 --2- 172.21.15.92:0/4290185827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f034f5b60 0x562f034f5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:55.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.117+0000 7ffac7fff640 1 --2- 172.21.15.92:0/4290185827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f034f6480 0x562f03500800 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7ffab8009930 tx=0x7ffab803c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=580fe65117756757 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:55.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.117+0000 7ffac57fa640 1 -- 172.21.15.92:0/4290185827 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab8035050 con 0x562f034f6480 2024-09-19T09:06:55.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.117+0000 7ffac57fa640 1 -- 172.21.15.92:0/4290185827 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffab804c070 con 0x562f034f6480 2024-09-19T09:06:55.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.117+0000 7ffac57fa640 1 -- 172.21.15.92:0/4290185827 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab8004a80 con 0x562f034f6480 2024-09-19T09:06:55.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.118+0000 7ffad7684740 1 -- 172.21.15.92:0/4290185827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f034f6480 msgr2=0x562f03500800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:55.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.118+0000 7ffad7684740 1 --2- 172.21.15.92:0/4290185827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f034f6480 0x562f03500800 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7ffab8009930 tx=0x7ffab803c000 comp rx=0 tx=0).stop 2024-09-19T09:06:55.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.118+0000 7ffad7684740 1 -- 172.21.15.92:0/4290185827 shutdown_connections 2024-09-19T09:06:55.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.118+0000 7ffad7684740 1 --2- 172.21.15.92:0/4290185827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562f03500d40 0x562f03503130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:55.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.118+0000 7ffad7684740 1 --2- 172.21.15.92:0/4290185827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f034f6480 0x562f03500800 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:55.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.118+0000 7ffad7684740 1 --2- 172.21.15.92:0/4290185827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f034f5b60 0x562f034f5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:55.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.118+0000 7ffad7684740 1 -- 172.21.15.92:0/4290185827 >> 172.21.15.92:0/4290185827 conn(0x562f034f20f0 msgr2=0x562f034f24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:55.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.118+0000 7ffad7684740 1 -- 172.21.15.92:0/4290185827 shutdown_connections 2024-09-19T09:06:55.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.118+0000 7ffad7684740 1 -- 172.21.15.92:0/4290185827 wait complete. 2024-09-19T09:06:55.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.119+0000 7ffad7684740 1 -- start start 2024-09-19T09:06:55.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.119+0000 7ffad7684740 1 Processor -- start 2024-09-19T09:06:55.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.119+0000 7ffad7684740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f034f5b60 0x562f034fdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:55.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.119+0000 7ffad7684740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f034f6480 0x562f034fe100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:55.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.119+0000 7ffad7684740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562f03500d40 0x562f034fe640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:55.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.119+0000 7ffad7684740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562f03503910 con 0x562f034f6480 2024-09-19T09:06:55.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.119+0000 7ffad7684740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x562f03415f10 con 0x562f034f5b60 2024-09-19T09:06:55.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.119+0000 7ffad7684740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x562f03503a90 con 0x562f03500d40 2024-09-19T09:06:55.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.119+0000 7ffad7684740 10 client.0 _ll_register_callbacks cb 0x562f033dea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:55.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.119+0000 7ffac7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f034f6480 0x562f034fe100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:55.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.119+0000 7ffac7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f034f6480 0x562f034fe100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37610/0 (socket says 172.21.15.92:37610) 2024-09-19T09:06:55.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.119+0000 7ffac7fff640 1 -- 172.21.15.92:0/1712967884 learned_addr learned my addr 172.21.15.92:0/1712967884 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:55.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.119+0000 7ffaceffd640 1 --2- 172.21.15.92:0/1712967884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f034f5b60 0x562f034fdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:55.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.119+0000 7ffacf7fe640 1 --2- 172.21.15.92:0/1712967884 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562f03500d40 0x562f034fe640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:55.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.120+0000 7ffac7fff640 1 -- 172.21.15.92:0/1712967884 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562f03500d40 msgr2=0x562f034fe640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:55.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.120+0000 7ffac7fff640 1 --2- 172.21.15.92:0/1712967884 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562f03500d40 0x562f034fe640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:55.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.120+0000 7ffac7fff640 1 -- 172.21.15.92:0/1712967884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f034f5b60 msgr2=0x562f034fdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:55.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.120+0000 7ffac7fff640 1 --2- 172.21.15.92:0/1712967884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f034f5b60 0x562f034fdbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:55.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.120+0000 7ffac7fff640 1 -- 172.21.15.92:0/1712967884 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f031cc6a0 con 0x562f034f6480 2024-09-19T09:06:55.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.120+0000 7ffac7fff640 1 --2- 172.21.15.92:0/1712967884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f034f6480 0x562f034fe100 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7ffab802a940 tx=0x7ffab8005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3c8d0769abca18a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:55.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.120+0000 7ffab67fc640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:06:55.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.120+0000 7ffab67fc640 1 -- 172.21.15.92:0/1712967884 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab8035030 con 0x562f034f6480 2024-09-19T09:06:55.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.120+0000 7ffab67fc640 1 -- 172.21.15.92:0/1712967884 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ffab8004a40 con 0x562f034f6480 2024-09-19T09:06:55.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.120+0000 7ffad7684740 1 -- 172.21.15.92:0/1712967884 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffab804c070 con 0x562f034f6480 2024-09-19T09:06:55.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.120+0000 7ffab67fc640 1 -- 172.21.15.92:0/1712967884 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ffab8004c40 con 0x562f034f6480 2024-09-19T09:06:55.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.120+0000 7ffad7684740 10 client.17883 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:55.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.120+0000 7ffad7684740 1 -- 172.21.15.92:0/1712967884 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x562f0350f4c0 con 0x562f034f6480 2024-09-19T09:06:55.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.120+0000 7ffab67fc640 1 -- 172.21.15.92:0/1712967884 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffab804c070 con 0x562f034f6480 2024-09-19T09:06:55.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.121+0000 7ffab67fc640 1 -- 172.21.15.92:0/1712967884 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ffab805a600 con 0x562f034f6480 2024-09-19T09:06:55.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.121+0000 7ffad7684740 10 client.17883 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:55.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.121+0000 7ffad7684740 10 client.17883 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:06:55.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.121+0000 7ffad7684740 20 client.17883 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:55.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.121+0000 7ffad7684740 1 --2- 172.21.15.92:0/1712967884 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562f03510810 0x562f03512c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:55.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.121+0000 7ffad7684740 4 client.17883 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:06:55.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.121+0000 7ffad7684740 1 -- 172.21.15.92:0/1712967884 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f034687f0 con 0x562f03510810 2024-09-19T09:06:55.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.121+0000 7ffaceffd640 1 --2- 172.21.15.92:0/1712967884 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562f03510810 0x562f03512c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:55.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.121+0000 7ffaceffd640 1 --2- 172.21.15.92:0/1712967884 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562f03510810 0x562f03512c00 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85b34bdfe5a9a1ca server_cookie=f38721158b015ca6 in_seq=0 out_seq=0 2024-09-19T09:06:55.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.121+0000 7ffab67fc640 10 client.17883 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:55.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.122+0000 7ffab67fc640 1 -- 172.21.15.92:0/1712967884 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562f034687f0 con 0x562f03510810 2024-09-19T09:06:55.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.122+0000 7ffab67fc640 10 client.17883 handle_command_reply: tid=0 2024-09-19T09:06:55.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.122+0000 7ffad7684740 1 client.17883 shutdown 2024-09-19T09:06:55.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.122+0000 7ffad7684740 1 -- 172.21.15.92:0/1712967884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f034f6480 msgr2=0x562f034fe100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:55.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.122+0000 7ffad7684740 1 --2- 172.21.15.92:0/1712967884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f034f6480 0x562f034fe100 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7ffab802a940 tx=0x7ffab8005780 comp rx=0 tx=0).stop 2024-09-19T09:06:55.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.122+0000 7ffad7684740 1 -- 172.21.15.92:0/1712967884 shutdown_connections 2024-09-19T09:06:55.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.122+0000 7ffad7684740 1 --2- 172.21.15.92:0/1712967884 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562f03510810 0x562f03512c00 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:55.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.122+0000 7ffad7684740 1 --2- 172.21.15.92:0/1712967884 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562f03500d40 0x562f034fe640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:55.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.122+0000 7ffad7684740 1 --2- 172.21.15.92:0/1712967884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f034f6480 0x562f034fe100 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:55.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.122+0000 7ffad7684740 1 --2- 172.21.15.92:0/1712967884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f034f5b60 0x562f034fdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:55.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.122+0000 7ffab67fc640 0 client.17883 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:55.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.122+0000 7ffad7684740 1 -- 172.21.15.92:0/1712967884 >> 172.21.15.92:0/1712967884 conn(0x562f034f20f0 msgr2=0x562f034f1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:55.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.123+0000 7ffad7684740 1 -- 172.21.15.92:0/1712967884 shutdown_connections 2024-09-19T09:06:55.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.123+0000 7ffad7684740 1 -- 172.21.15.92:0/1712967884 wait complete. 2024-09-19T09:06:55.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.123+0000 7ffad7684740 20 client.17883 trim_cache size 0 max 16384 2024-09-19T09:06:55.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.140+0000 7ffad7684740 1 Processor -- start 2024-09-19T09:06:55.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.140+0000 7ffad7684740 1 -- start start 2024-09-19T09:06:55.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.140+0000 7ffad7684740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f034f5b60 0x562f034fca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:55.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.140+0000 7ffad7684740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f034f6480 0x562f035181a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:55.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.140+0000 7ffad7684740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562f03500d40 0x562f035186e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:55.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.140+0000 7ffad7684740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffad01ab4d0 con 0x562f034f5b60 2024-09-19T09:06:55.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.140+0000 7ffad7684740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ffad01add70 con 0x562f034f6480 2024-09-19T09:06:55.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.140+0000 7ffad7684740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ffad01abb60 con 0x562f03500d40 2024-09-19T09:06:55.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.140+0000 7ffaceffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f034f5b60 0x562f034fca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:55.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.140+0000 7ffaceffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f034f5b60 0x562f034fca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37622/0 (socket says 172.21.15.92:37622) 2024-09-19T09:06:55.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.140+0000 7ffaceffd640 1 -- 172.21.15.92:0/737684442 learned_addr learned my addr 172.21.15.92:0/737684442 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:55.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.140+0000 7ffacf7fe640 1 --2- 172.21.15.92:0/737684442 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562f03500d40 0x562f035186e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:55.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.140+0000 7ffac7fff640 1 --2- 172.21.15.92:0/737684442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f034f6480 0x562f035181a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:55.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.141+0000 7ffaceffd640 1 -- 172.21.15.92:0/737684442 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562f03500d40 msgr2=0x562f035186e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:55.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.141+0000 7ffaceffd640 1 --2- 172.21.15.92:0/737684442 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562f03500d40 0x562f035186e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:55.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.141+0000 7ffaceffd640 1 -- 172.21.15.92:0/737684442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f034f6480 msgr2=0x562f035181a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:55.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.141+0000 7ffaceffd640 1 --2- 172.21.15.92:0/737684442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f034f6480 0x562f035181a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:55.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.141+0000 7ffaceffd640 1 -- 172.21.15.92:0/737684442 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f034ec680 con 0x562f034f5b60 2024-09-19T09:06:55.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.141+0000 7ffaceffd640 1 --2- 172.21.15.92:0/737684442 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f034f5b60 0x562f034fca70 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7ffac00983e0 tx=0x7ffac00ccdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db4af8d8c1066b28 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:55.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.141+0000 7ffac4ff9640 1 -- 172.21.15.92:0/737684442 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac0020040 con 0x562f034f5b60 2024-09-19T09:06:55.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.141+0000 7ffac4ff9640 1 -- 172.21.15.92:0/737684442 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffac00b9070 con 0x562f034f5b60 2024-09-19T09:06:55.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.141+0000 7ffac4ff9640 1 -- 172.21.15.92:0/737684442 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac0099df0 con 0x562f034f5b60 2024-09-19T09:06:55.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.142+0000 7ffad7684740 1 -- 172.21.15.92:0/737684442 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f034f5b60 msgr2=0x562f034fca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:55.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.142+0000 7ffad7684740 1 --2- 172.21.15.92:0/737684442 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f034f5b60 0x562f034fca70 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7ffac00983e0 tx=0x7ffac00ccdc0 comp rx=0 tx=0).stop 2024-09-19T09:06:55.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.142+0000 7ffad7684740 1 -- 172.21.15.92:0/737684442 shutdown_connections 2024-09-19T09:06:55.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.142+0000 7ffad7684740 1 --2- 172.21.15.92:0/737684442 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562f03500d40 0x562f035186e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:55.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.142+0000 7ffad7684740 1 --2- 172.21.15.92:0/737684442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f034f6480 0x562f035181a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:55.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.142+0000 7ffad7684740 1 --2- 172.21.15.92:0/737684442 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f034f5b60 0x562f034fca70 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:55.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.142+0000 7ffad7684740 1 -- 172.21.15.92:0/737684442 >> 172.21.15.92:0/737684442 conn(0x562f034f20f0 msgr2=0x562f034fc360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:55.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.142+0000 7ffad7684740 1 -- 172.21.15.92:0/737684442 shutdown_connections 2024-09-19T09:06:55.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.142+0000 7ffad7684740 1 -- 172.21.15.92:0/737684442 wait complete. 2024-09-19T09:06:55.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.142+0000 7ffad7684740 1 -- start start 2024-09-19T09:06:55.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.142+0000 7ffad7684740 1 Processor -- start 2024-09-19T09:06:55.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.143+0000 7ffad7684740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f034f5b60 0x562f03508ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:55.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.143+0000 7ffad7684740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562f034f6480 0x562f03509220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:55.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.143+0000 7ffad7684740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f03500d40 0x562f03505cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:55.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.143+0000 7ffad7684740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffad01ac230 con 0x562f034f5b60 2024-09-19T09:06:55.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.143+0000 7ffad7684740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ffad01ad6a0 con 0x562f03500d40 2024-09-19T09:06:55.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.143+0000 7ffad7684740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ffad01ac900 con 0x562f034f6480 2024-09-19T09:06:55.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.143+0000 7ffad7684740 10 client.0 _ll_register_callbacks cb 0x7ffab8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:55.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.143+0000 7ffaceffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f034f5b60 0x562f03508ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:55.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.143+0000 7ffaceffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f034f5b60 0x562f03508ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37630/0 (socket says 172.21.15.92:37630) 2024-09-19T09:06:55.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.143+0000 7ffaceffd640 1 -- 172.21.15.92:0/4074203390 learned_addr learned my addr 172.21.15.92:0/4074203390 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:55.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.143+0000 7ffac7fff640 1 --2- 172.21.15.92:0/4074203390 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562f034f6480 0x562f03509220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:55.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.143+0000 7ffacf7fe640 1 --2- 172.21.15.92:0/4074203390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f03500d40 0x562f03505cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:55.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.143+0000 7ffaceffd640 1 -- 172.21.15.92:0/4074203390 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562f034f6480 msgr2=0x562f03509220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:55.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.143+0000 7ffaceffd640 1 --2- 172.21.15.92:0/4074203390 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562f034f6480 0x562f03509220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:55.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.143+0000 7ffaceffd640 1 -- 172.21.15.92:0/4074203390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f03500d40 msgr2=0x562f03505cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:55.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.143+0000 7ffaceffd640 1 --2- 172.21.15.92:0/4074203390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f03500d40 0x562f03505cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:55.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.143+0000 7ffaceffd640 1 -- 172.21.15.92:0/4074203390 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f035062f0 con 0x562f034f5b60 2024-09-19T09:06:55.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.143+0000 7ffaceffd640 1 --2- 172.21.15.92:0/4074203390 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f034f5b60 0x562f03508ce0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7ffac0097e20 tx=0x7ffac0099b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea10592a065e481 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:55.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.143+0000 7ffab67fc640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:06:55.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.143+0000 7ffab67fc640 1 -- 172.21.15.92:0/4074203390 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac0064020 con 0x562f034f5b60 2024-09-19T09:06:55.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.143+0000 7ffab67fc640 1 -- 172.21.15.92:0/4074203390 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ffac0009cc0 con 0x562f034f5b60 2024-09-19T09:06:55.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.143+0000 7ffad7684740 1 -- 172.21.15.92:0/4074203390 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffac00b9070 con 0x562f034f5b60 2024-09-19T09:06:55.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.143+0000 7ffab67fc640 1 -- 172.21.15.92:0/4074203390 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ffac0020040 con 0x562f034f5b60 2024-09-19T09:06:55.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.143+0000 7ffad7684740 10 client.17889 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:55.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.143+0000 7ffad7684740 1 -- 172.21.15.92:0/4074203390 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x562f0357bb00 con 0x562f034f5b60 2024-09-19T09:06:55.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.144+0000 7ffab67fc640 1 -- 172.21.15.92:0/4074203390 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffac00b9070 con 0x562f034f5b60 2024-09-19T09:06:55.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.144+0000 7ffab67fc640 1 -- 172.21.15.92:0/4074203390 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ffac0086040 con 0x562f034f5b60 2024-09-19T09:06:55.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.144+0000 7ffad7684740 10 client.17889 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:55.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.144+0000 7ffad7684740 10 client.17889 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:06:55.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.144+0000 7ffad7684740 20 client.17889 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:55.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.144+0000 7ffad7684740 1 --2- 172.21.15.92:0/4074203390 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562f0357c280 0x562f0357e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:55.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.144+0000 7ffad7684740 4 client.17889 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:06:55.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.144+0000 7ffad7684740 1 -- 172.21.15.92:0/4074203390 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562f03462d00 con 0x562f0357c280 2024-09-19T09:06:55.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.145+0000 7ffac7fff640 1 --2- 172.21.15.92:0/4074203390 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562f0357c280 0x562f0357e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:55.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.145+0000 7ffab67fc640 10 client.17889 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:55.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.145+0000 7ffac7fff640 1 --2- 172.21.15.92:0/4074203390 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562f0357c280 0x562f0357e6a0 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b34993a479d97f8 server_cookie=ba1900bf169ec04a in_seq=0 out_seq=0 2024-09-19T09:06:55.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.146+0000 7ffab67fc640 1 -- 172.21.15.92:0/4074203390 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562f03462d00 con 0x562f0357c280 2024-09-19T09:06:55.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.146+0000 7ffab67fc640 10 client.17889 handle_command_reply: tid=0 2024-09-19T09:06:55.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.146+0000 7ffad7684740 1 client.17889 shutdown 2024-09-19T09:06:55.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.146+0000 7ffad7684740 1 -- 172.21.15.92:0/4074203390 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f034f5b60 msgr2=0x562f03508ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:55.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.146+0000 7ffad7684740 1 --2- 172.21.15.92:0/4074203390 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f034f5b60 0x562f03508ce0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7ffac0097e20 tx=0x7ffac0099b50 comp rx=0 tx=0).stop 2024-09-19T09:06:55.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.146+0000 7ffad7684740 1 -- 172.21.15.92:0/4074203390 shutdown_connections 2024-09-19T09:06:55.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.146+0000 7ffad7684740 1 --2- 172.21.15.92:0/4074203390 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562f0357c280 0x562f0357e6a0 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:55.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.146+0000 7ffad7684740 1 --2- 172.21.15.92:0/4074203390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f03500d40 0x562f03505cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:55.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.146+0000 7ffad7684740 1 --2- 172.21.15.92:0/4074203390 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562f034f6480 0x562f03509220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:55.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.146+0000 7ffad7684740 1 --2- 172.21.15.92:0/4074203390 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f034f5b60 0x562f03508ce0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:55.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.146+0000 7ffad7684740 1 -- 172.21.15.92:0/4074203390 >> 172.21.15.92:0/4074203390 conn(0x562f034f20f0 msgr2=0x562f034f7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:55.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.146+0000 7ffab67fc640 0 client.17889 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:55.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.147+0000 7ffad7684740 1 -- 172.21.15.92:0/4074203390 shutdown_connections 2024-09-19T09:06:55.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.147+0000 7ffad7684740 1 -- 172.21.15.92:0/4074203390 wait complete. 2024-09-19T09:06:55.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.147+0000 7ffad7684740 20 client.17889 trim_cache size 0 max 16384 2024-09-19T09:06:55.153 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:06:55.153 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-19T09:06:55.153 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "b7adebad-4ec3-461e-bc78-0aa977179930", 2024-09-19T09:06:55.153 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-19T09:06:55.153 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:06:55.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.147+0000 7ffad52ab640 1 -- 172.21.15.92:0/2248019984 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffabc0a3240 msgr2=0x7ffabc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:55.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.147+0000 7ffad52ab640 1 --2- 172.21.15.92:0/2248019984 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffabc0a3240 0x7ffabc0a5700 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ffab8009900 tx=0x7ffab8005a20 comp rx=0 tx=0).stop 2024-09-19T09:06:55.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.147+0000 7ffad52ab640 1 -- 172.21.15.92:0/2248019984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffad0102dd0 msgr2=0x7ffad01985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:55.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.147+0000 7ffad52ab640 1 --2- 172.21.15.92:0/2248019984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffad0102dd0 0x7ffad01985f0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7ffac000d770 tx=0x7ffac000dc30 comp rx=0 tx=0).stop 2024-09-19T09:06:55.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.147+0000 7ffad52ab640 1 -- 172.21.15.92:0/2248019984 shutdown_connections 2024-09-19T09:06:55.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.147+0000 7ffad52ab640 1 --2- 172.21.15.92:0/2248019984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffad0108300 0x7ffad019cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:55.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.147+0000 7ffad52ab640 1 --2- 172.21.15.92:0/2248019984 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffad0103780 0x7ffad0198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:55.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.147+0000 7ffad52ab640 1 --2- 172.21.15.92:0/2248019984 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffabc0a3240 0x7ffabc0a5700 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:55.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.147+0000 7ffad52ab640 1 --2- 172.21.15.92:0/2248019984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffad0102dd0 0x7ffad01985f0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:55.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.147+0000 7ffad52ab640 1 -- 172.21.15.92:0/2248019984 >> 172.21.15.92:0/2248019984 conn(0x7ffad00fc7d0 msgr2=0x7ffad0105e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:55.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.147+0000 7ffad52ab640 1 -- 172.21.15.92:0/2248019984 shutdown_connections 2024-09-19T09:06:55.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:55.147+0000 7ffad52ab640 1 -- 172.21.15.92:0/2248019984 wait complete. 2024-09-19T09:06:55.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:55 smithi092 ceph-mon[31407]: pgmap v643: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 4.8 KiB/s wr, 96 op/s 2024-09-19T09:06:55.787 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:06:55.801 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:06:55.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:55 smithi167 ceph-mon[35359]: pgmap v643: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 4.8 KiB/s wr, 96 op/s 2024-09-19T09:06:55.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:55 smithi190 ceph-mon[35358]: pgmap v643: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 4.8 KiB/s wr, 96 op/s 2024-09-19T09:06:56.040 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:06:56.184 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:06:56.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.453+0000 7fd3d3b7e640 1 -- 172.21.15.92:0/1117218183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3cc102ef0 msgr2=0x7fd3cc10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:56.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.453+0000 7fd3d3b7e640 1 --2- 172.21.15.92:0/1117218183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3cc102ef0 0x7fd3cc10da40 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4009ca0 tx=0x7fd3c402a950 comp rx=0 tx=0).stop 2024-09-19T09:06:56.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.454+0000 7fd3d3b7e640 1 -- 172.21.15.92:0/1117218183 shutdown_connections 2024-09-19T09:06:56.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.454+0000 7fd3d3b7e640 1 --2- 172.21.15.92:0/1117218183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3cc102ef0 0x7fd3cc10da40 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.454+0000 7fd3d3b7e640 1 --2- 172.21.15.92:0/1117218183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3cc102570 0x7fd3cc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.454+0000 7fd3d3b7e640 1 --2- 172.21.15.92:0/1117218183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3cc100e20 0x7fd3cc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.454+0000 7fd3d3b7e640 1 -- 172.21.15.92:0/1117218183 >> 172.21.15.92:0/1117218183 conn(0x7fd3cc0fc7d0 msgr2=0x7fd3cc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:56.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.454+0000 7fd3d3b7e640 1 -- 172.21.15.92:0/1117218183 shutdown_connections 2024-09-19T09:06:56.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.454+0000 7fd3d3b7e640 1 -- 172.21.15.92:0/1117218183 wait complete. 2024-09-19T09:06:56.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.454+0000 7fd3d3b7e640 1 Processor -- start 2024-09-19T09:06:56.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.454+0000 7fd3d3b7e640 1 -- start start 2024-09-19T09:06:56.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.455+0000 7fd3d3b7e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3cc100e20 0x7fd3cc197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:56.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.455+0000 7fd3d3b7e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3cc102570 0x7fd3cc197780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:56.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.455+0000 7fd3d3b7e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3cc102ef0 0x7fd3cc197cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:56.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.455+0000 7fd3d3b7e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd3cc111020 con 0x7fd3cc102ef0 2024-09-19T09:06:56.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.455+0000 7fd3d3b7e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd3cc110ea0 con 0x7fd3cc100e20 2024-09-19T09:06:56.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.455+0000 7fd3d3b7e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd3cc1111a0 con 0x7fd3cc102570 2024-09-19T09:06:56.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.455+0000 7fd3d211b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3cc102ef0 0x7fd3cc197cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:56.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.455+0000 7fd3d211b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3cc102ef0 0x7fd3cc197cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37658/0 (socket says 172.21.15.92:37658) 2024-09-19T09:06:56.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.455+0000 7fd3d211b640 1 -- 172.21.15.92:0/1324254279 learned_addr learned my addr 172.21.15.92:0/1324254279 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:56.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.455+0000 7fd3d191a640 1 --2- 172.21.15.92:0/1324254279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3cc100e20 0x7fd3cc197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:56.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.455+0000 7fd3d1119640 1 --2- 172.21.15.92:0/1324254279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3cc102570 0x7fd3cc197780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:56.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.455+0000 7fd3d211b640 1 -- 172.21.15.92:0/1324254279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3cc102570 msgr2=0x7fd3cc197780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:56.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.455+0000 7fd3d211b640 1 --2- 172.21.15.92:0/1324254279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3cc102570 0x7fd3cc197780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.455+0000 7fd3d211b640 1 -- 172.21.15.92:0/1324254279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3cc100e20 msgr2=0x7fd3cc197240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:56.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.455+0000 7fd3d211b640 1 --2- 172.21.15.92:0/1324254279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3cc100e20 0x7fd3cc197240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.455+0000 7fd3d211b640 1 -- 172.21.15.92:0/1324254279 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3cc1a6ab0 con 0x7fd3cc102ef0 2024-09-19T09:06:56.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.455+0000 7fd3d191a640 1 --2- 172.21.15.92:0/1324254279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3cc100e20 0x7fd3cc197240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:56.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.455+0000 7fd3d211b640 1 --2- 172.21.15.92:0/1324254279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3cc102ef0 0x7fd3cc197cc0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4006010 tx=0x7fd3c402f6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:56.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.455+0000 7fd3c2ffd640 1 -- 172.21.15.92:0/1324254279 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c4034040 con 0x7fd3cc102ef0 2024-09-19T09:06:56.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.455+0000 7fd3d3b7e640 1 -- 172.21.15.92:0/1324254279 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3cc1a6d40 con 0x7fd3cc102ef0 2024-09-19T09:06:56.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.455+0000 7fd3c2ffd640 1 -- 172.21.15.92:0/1324254279 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3c4003e00 con 0x7fd3cc102ef0 2024-09-19T09:06:56.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.455+0000 7fd3c2ffd640 1 -- 172.21.15.92:0/1324254279 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c4045480 con 0x7fd3cc102ef0 2024-09-19T09:06:56.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.456+0000 7fd3d3b7e640 1 -- 172.21.15.92:0/1324254279 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3cc1a72f0 con 0x7fd3cc102ef0 2024-09-19T09:06:56.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.458+0000 7fd3c2ffd640 1 -- 172.21.15.92:0/1324254279 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd3c4037020 con 0x7fd3cc102ef0 2024-09-19T09:06:56.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.458+0000 7fd3d5f57740 1 Processor -- start 2024-09-19T09:06:56.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.458+0000 7fd3d5f57740 1 -- start start 2024-09-19T09:06:56.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.459+0000 7fd3d5f57740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b5629994a0 0x55b562999880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:56.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.459+0000 7fd3d5f57740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b562999dc0 0x55b5629a4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:56.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.459+0000 7fd3d5f57740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b5629a4680 0x55b5629a6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:56.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.459+0000 7fd3d5f57740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b5628ff2e0 con 0x55b5629a4680 2024-09-19T09:06:56.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.459+0000 7fd3d5f57740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b5628a6ce0 con 0x55b562999dc0 2024-09-19T09:06:56.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.459+0000 7fd3c2ffd640 1 --2- 172.21.15.92:0/1324254279 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd3b80a3240 0x7fd3b80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:56.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.459+0000 7fd3d5f57740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55b5628fb2a0 con 0x55b5629994a0 2024-09-19T09:06:56.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.459+0000 7fd3d1119640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b5629a4680 0x55b5629a6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:56.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.459+0000 7fd3d211b640 1 --2- 172.21.15.92:0/1324254279 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd3b80a3240 0x7fd3b80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:56.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.459+0000 7fd3d1119640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b5629a4680 0x55b5629a6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37660/0 (socket says 172.21.15.92:37660) 2024-09-19T09:06:56.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.459+0000 7fd3d1119640 1 -- 172.21.15.92:0/4207098592 learned_addr learned my addr 172.21.15.92:0/4207098592 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:56.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.459+0000 7fd3d191a640 1 --2- 172.21.15.92:0/4207098592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b562999dc0 0x55b5629a4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:56.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.459+0000 7fd3d1119640 1 --2- 172.21.15.92:0/4207098592 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b5629994a0 0x55b562999880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:56.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.459+0000 7fd3c2ffd640 1 -- 172.21.15.92:0/1324254279 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd3c40f0b50 con 0x7fd3cc102ef0 2024-09-19T09:06:56.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.459+0000 7fd3d1119640 1 -- 172.21.15.92:0/4207098592 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b5629994a0 msgr2=0x55b562999880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:56.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.459+0000 7fd3d1119640 1 --2- 172.21.15.92:0/4207098592 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b5629994a0 0x55b562999880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.459+0000 7fd3d1119640 1 -- 172.21.15.92:0/4207098592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b562999dc0 msgr2=0x55b5629a4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:56.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.459+0000 7fd3d1119640 1 --2- 172.21.15.92:0/4207098592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b562999dc0 0x55b5629a4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.459+0000 7fd3d1119640 1 -- 172.21.15.92:0/4207098592 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b56288b440 con 0x55b5629a4680 2024-09-19T09:06:56.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.459+0000 7fd3d211b640 1 --2- 172.21.15.92:0/1324254279 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd3b80a3240 0x7fd3b80a5700 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd3c40bd0c0 tx=0x7fd3c4087f60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:56.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.460+0000 7fd3d1119640 1 --2- 172.21.15.92:0/4207098592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b5629a4680 0x55b5629a6a70 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fd3c800ad80 tx=0x7fd3c800a490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad981106fec13a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:56.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.460+0000 7fd3b7fff640 1 -- 172.21.15.92:0/4207098592 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c801b070 con 0x55b5629a4680 2024-09-19T09:06:56.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.460+0000 7fd3b7fff640 1 -- 172.21.15.92:0/4207098592 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3c800fdf0 con 0x55b5629a4680 2024-09-19T09:06:56.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.460+0000 7fd3b7fff640 1 -- 172.21.15.92:0/4207098592 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c80146c0 con 0x55b5629a4680 2024-09-19T09:06:56.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.460+0000 7fd3d5f57740 1 -- 172.21.15.92:0/4207098592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b5629a4680 msgr2=0x55b5629a6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:56.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.460+0000 7fd3d5f57740 1 --2- 172.21.15.92:0/4207098592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b5629a4680 0x55b5629a6a70 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fd3c800ad80 tx=0x7fd3c800a490 comp rx=0 tx=0).stop 2024-09-19T09:06:56.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.460+0000 7fd3d5f57740 1 -- 172.21.15.92:0/4207098592 shutdown_connections 2024-09-19T09:06:56.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.460+0000 7fd3d5f57740 1 --2- 172.21.15.92:0/4207098592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b5629a4680 0x55b5629a6a70 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.460+0000 7fd3d5f57740 1 --2- 172.21.15.92:0/4207098592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b562999dc0 0x55b5629a4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.460+0000 7fd3d5f57740 1 --2- 172.21.15.92:0/4207098592 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b5629994a0 0x55b562999880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.460+0000 7fd3d5f57740 1 -- 172.21.15.92:0/4207098592 >> 172.21.15.92:0/4207098592 conn(0x55b562995a30 msgr2=0x55b562995e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:56.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.461+0000 7fd3d5f57740 1 -- 172.21.15.92:0/4207098592 shutdown_connections 2024-09-19T09:06:56.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.461+0000 7fd3d5f57740 1 -- 172.21.15.92:0/4207098592 wait complete. 2024-09-19T09:06:56.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.461+0000 7fd3d5f57740 1 -- start start 2024-09-19T09:06:56.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.461+0000 7fd3d5f57740 1 Processor -- start 2024-09-19T09:06:56.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.461+0000 7fd3d5f57740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b5629994a0 0x55b5629a4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:56.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.461+0000 7fd3d5f57740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b562999dc0 0x55b5629a1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:56.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.461+0000 7fd3d5f57740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b5629a4680 0x55b5629a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:56.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.461+0000 7fd3d5f57740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b5629a7250 con 0x55b5629994a0 2024-09-19T09:06:56.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.461+0000 7fd3d5f57740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b5628ba050 con 0x55b562999dc0 2024-09-19T09:06:56.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.461+0000 7fd3d5f57740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55b5629a73d0 con 0x55b5629a4680 2024-09-19T09:06:56.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.461+0000 7fd3d5f57740 10 client.0 _ll_register_callbacks cb 0x55b5628fa160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:56.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.461+0000 7fd3d1119640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b5629994a0 0x55b5629a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:56.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.462+0000 7fd3d1119640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b5629994a0 0x55b5629a4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37666/0 (socket says 172.21.15.92:37666) 2024-09-19T09:06:56.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.462+0000 7fd3d1119640 1 -- 172.21.15.92:0/1675790611 learned_addr learned my addr 172.21.15.92:0/1675790611 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:56.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.462+0000 7fd3d191a640 1 --2- 172.21.15.92:0/1675790611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b562999dc0 0x55b5629a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:56.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.462+0000 7fd3d1119640 1 -- 172.21.15.92:0/1675790611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b5629a4680 msgr2=0x55b5629a18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:56.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.462+0000 7fd3d1119640 1 --2- 172.21.15.92:0/1675790611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b5629a4680 0x55b5629a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.462+0000 7fd3d1119640 1 -- 172.21.15.92:0/1675790611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b562999dc0 msgr2=0x55b5629a1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:56.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.462+0000 7fd3d1119640 1 --2- 172.21.15.92:0/1675790611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b562999dc0 0x55b5629a1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.462+0000 7fd3d1119640 1 -- 172.21.15.92:0/1675790611 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5626703c0 con 0x55b5629994a0 2024-09-19T09:06:56.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.462+0000 7fd3d1119640 1 --2- 172.21.15.92:0/1675790611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b5629994a0 0x55b5629a4060 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fd3c800ad50 tx=0x7fd3c800a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea92dd0cf59821b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:56.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.462+0000 7fd3b57fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:06:56.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.462+0000 7fd3b57fa640 1 -- 172.21.15.92:0/1675790611 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c8026060 con 0x55b5629994a0 2024-09-19T09:06:56.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.462+0000 7fd3b57fa640 1 -- 172.21.15.92:0/1675790611 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd3c80168e0 con 0x55b5629994a0 2024-09-19T09:06:56.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.462+0000 7fd3d5f57740 1 -- 172.21.15.92:0/1675790611 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3c800fdf0 con 0x55b5629994a0 2024-09-19T09:06:56.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.462+0000 7fd3b57fa640 1 -- 172.21.15.92:0/1675790611 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd3c801b040 con 0x55b5629994a0 2024-09-19T09:06:56.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.462+0000 7fd3d5f57740 10 client.17901 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:56.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.462+0000 7fd3d5f57740 1 -- 172.21.15.92:0/1675790611 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55b5629b2cc0 con 0x55b5629994a0 2024-09-19T09:06:56.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.462+0000 7fd3b57fa640 1 -- 172.21.15.92:0/1675790611 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3c800fdf0 con 0x55b5629994a0 2024-09-19T09:06:56.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.463+0000 7fd3b57fa640 1 -- 172.21.15.92:0/1675790611 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fd3c802b070 con 0x55b5629994a0 2024-09-19T09:06:56.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.463+0000 7fd3d5f57740 10 client.17901 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:56.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.463+0000 7fd3d5f57740 10 client.17901 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:06:56.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.463+0000 7fd3d5f57740 20 client.17901 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:56.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.463+0000 7fd3d5f57740 1 --2- 172.21.15.92:0/1675790611 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b5629b40d0 0x55b5629b64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:56.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.463+0000 7fd3d5f57740 4 client.17901 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:06:56.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.463+0000 7fd3d5f57740 1 -- 172.21.15.92:0/1675790611 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b56290c850 con 0x55b5629b40d0 2024-09-19T09:06:56.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.463+0000 7fd3d191a640 1 --2- 172.21.15.92:0/1675790611 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b5629b40d0 0x55b5629b64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:56.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.463+0000 7fd3b57fa640 10 client.17901 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:56.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.463+0000 7fd3d191a640 1 --2- 172.21.15.92:0/1675790611 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b5629b40d0 0x55b5629b64c0 crc :-1 s=READY pgs=327 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f68f0f207a1bcff0 server_cookie=3b774e9f3dbcf1b in_seq=0 out_seq=0 2024-09-19T09:06:56.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.464+0000 7fd3b57fa640 1 -- 172.21.15.92:0/1675790611 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b56290c850 con 0x55b5629b40d0 2024-09-19T09:06:56.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.464+0000 7fd3b57fa640 10 client.17901 handle_command_reply: tid=0 2024-09-19T09:06:56.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.464+0000 7fd3d5f57740 1 client.17901 shutdown 2024-09-19T09:06:56.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.464+0000 7fd3d5f57740 1 -- 172.21.15.92:0/1675790611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b5629994a0 msgr2=0x55b5629a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:56.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.464+0000 7fd3d5f57740 1 --2- 172.21.15.92:0/1675790611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b5629994a0 0x55b5629a4060 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fd3c800ad50 tx=0x7fd3c800a040 comp rx=0 tx=0).stop 2024-09-19T09:06:56.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.464+0000 7fd3d5f57740 1 -- 172.21.15.92:0/1675790611 shutdown_connections 2024-09-19T09:06:56.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.464+0000 7fd3d5f57740 1 --2- 172.21.15.92:0/1675790611 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b5629b40d0 0x55b5629b64c0 crc :-1 s=READY pgs=327 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.464+0000 7fd3d5f57740 1 --2- 172.21.15.92:0/1675790611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b5629a4680 0x55b5629a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.464+0000 7fd3d5f57740 1 --2- 172.21.15.92:0/1675790611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b562999dc0 0x55b5629a1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.464+0000 7fd3d5f57740 1 --2- 172.21.15.92:0/1675790611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b5629994a0 0x55b5629a4060 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.464+0000 7fd3b57fa640 0 client.17901 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:56.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.464+0000 7fd3d5f57740 1 -- 172.21.15.92:0/1675790611 >> 172.21.15.92:0/1675790611 conn(0x55b562995a30 msgr2=0x55b56299b710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:56.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.464+0000 7fd3d5f57740 1 -- 172.21.15.92:0/1675790611 shutdown_connections 2024-09-19T09:06:56.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.464+0000 7fd3d5f57740 1 -- 172.21.15.92:0/1675790611 wait complete. 2024-09-19T09:06:56.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.465+0000 7fd3d5f57740 20 client.17901 trim_cache size 0 max 16384 2024-09-19T09:06:56.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.481+0000 7fd3d5f57740 1 Processor -- start 2024-09-19T09:06:56.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.481+0000 7fd3d5f57740 1 -- start start 2024-09-19T09:06:56.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.482+0000 7fd3d5f57740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b5629994a0 0x55b5629b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:56.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.482+0000 7fd3d5f57740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b562999dc0 0x55b5629bbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:56.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.482+0000 7fd3d5f57740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b5629a4680 0x55b5629bc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:56.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.482+0000 7fd3d5f57740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd3cc1ad7e0 con 0x55b5629994a0 2024-09-19T09:06:56.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.482+0000 7fd3d5f57740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd3cc1b0080 con 0x55b562999dc0 2024-09-19T09:06:56.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.482+0000 7fd3d5f57740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd3cc1ade70 con 0x55b5629a4680 2024-09-19T09:06:56.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.482+0000 7fd3d1119640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b5629994a0 0x55b5629b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:56.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.482+0000 7fd3d1119640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b5629994a0 0x55b5629b04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37668/0 (socket says 172.21.15.92:37668) 2024-09-19T09:06:56.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.482+0000 7fd3d1119640 1 -- 172.21.15.92:0/2624196595 learned_addr learned my addr 172.21.15.92:0/2624196595 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:56.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.482+0000 7fd3d191a640 1 --2- 172.21.15.92:0/2624196595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b562999dc0 0x55b5629bbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:56.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.482+0000 7fd3d1119640 1 -- 172.21.15.92:0/2624196595 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b5629a4680 msgr2=0x55b5629bc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:56.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.482+0000 7fd3d1119640 1 --2- 172.21.15.92:0/2624196595 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b5629a4680 0x55b5629bc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.482+0000 7fd3d1119640 1 -- 172.21.15.92:0/2624196595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b562999dc0 msgr2=0x55b5629bbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:56.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.482+0000 7fd3d1119640 1 --2- 172.21.15.92:0/2624196595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b562999dc0 0x55b5629bbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.482+0000 7fd3d1119640 1 -- 172.21.15.92:0/2624196595 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5629b6830 con 0x55b5629994a0 2024-09-19T09:06:56.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.482+0000 7fd3d191a640 1 --2- 172.21.15.92:0/2624196595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b562999dc0 0x55b5629bbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:06:56.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.482+0000 7fd3d1119640 1 --2- 172.21.15.92:0/2624196595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b5629994a0 0x55b5629b04e0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8006f70 tx=0x7fd3c800af30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=454efdac74a5e70e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:56.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.482+0000 7fd3b77fe640 1 -- 172.21.15.92:0/2624196595 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c8031070 con 0x55b5629994a0 2024-09-19T09:06:56.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.482+0000 7fd3b77fe640 1 -- 172.21.15.92:0/2624196595 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3c8016cf0 con 0x55b5629994a0 2024-09-19T09:06:56.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.482+0000 7fd3b77fe640 1 -- 172.21.15.92:0/2624196595 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c8026030 con 0x55b5629994a0 2024-09-19T09:06:56.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.483+0000 7fd3d5f57740 1 -- 172.21.15.92:0/2624196595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b5629994a0 msgr2=0x55b5629b04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:56.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.483+0000 7fd3d5f57740 1 --2- 172.21.15.92:0/2624196595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b5629994a0 0x55b5629b04e0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8006f70 tx=0x7fd3c800af30 comp rx=0 tx=0).stop 2024-09-19T09:06:56.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.483+0000 7fd3d5f57740 1 -- 172.21.15.92:0/2624196595 shutdown_connections 2024-09-19T09:06:56.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.483+0000 7fd3d5f57740 1 --2- 172.21.15.92:0/2624196595 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b5629a4680 0x55b5629bc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.483+0000 7fd3d5f57740 1 --2- 172.21.15.92:0/2624196595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b562999dc0 0x55b5629bbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.483+0000 7fd3d5f57740 1 --2- 172.21.15.92:0/2624196595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b5629994a0 0x55b5629b04e0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.483+0000 7fd3d5f57740 1 -- 172.21.15.92:0/2624196595 >> 172.21.15.92:0/2624196595 conn(0x55b562995a30 msgr2=0x55b56299c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:56.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.483+0000 7fd3d5f57740 1 -- 172.21.15.92:0/2624196595 shutdown_connections 2024-09-19T09:06:56.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.483+0000 7fd3d5f57740 1 -- 172.21.15.92:0/2624196595 wait complete. 2024-09-19T09:06:56.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.483+0000 7fd3d5f57740 1 -- start start 2024-09-19T09:06:56.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.483+0000 7fd3d5f57740 1 Processor -- start 2024-09-19T09:06:56.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.484+0000 7fd3d5f57740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b5629994a0 0x55b5629a8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:56.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.484+0000 7fd3d5f57740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b562999dc0 0x55b5629a8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:56.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.484+0000 7fd3d5f57740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5629a4680 0x55b5629a90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:56.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.484+0000 7fd3d5f57740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd3cc1ae540 con 0x55b562999dc0 2024-09-19T09:06:56.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.484+0000 7fd3d5f57740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd3cc1af9b0 con 0x55b5629a4680 2024-09-19T09:06:56.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.484+0000 7fd3d5f57740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd3cc1aec10 con 0x55b5629994a0 2024-09-19T09:06:56.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.484+0000 7fd3d5f57740 10 client.0 _ll_register_callbacks cb 0x7fd3c8019070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:56.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.484+0000 7fd3d191a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b562999dc0 0x55b5629a8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:56.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.484+0000 7fd3d191a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b562999dc0 0x55b5629a8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37670/0 (socket says 172.21.15.92:37670) 2024-09-19T09:06:56.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.484+0000 7fd3d191a640 1 -- 172.21.15.92:0/765418099 learned_addr learned my addr 172.21.15.92:0/765418099 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:56.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.484+0000 7fd3d191a640 1 -- 172.21.15.92:0/765418099 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b5629994a0 msgr2=0x55b5629a8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:56.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.484+0000 7fd3d191a640 1 --2- 172.21.15.92:0/765418099 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b5629994a0 0x55b5629a8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.484+0000 7fd3d191a640 1 -- 172.21.15.92:0/765418099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5629a4680 msgr2=0x55b5629a90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:56.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.484+0000 7fd3d191a640 1 --2- 172.21.15.92:0/765418099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5629a4680 0x55b5629a90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.484+0000 7fd3d191a640 1 -- 172.21.15.92:0/765418099 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b562a1dd50 con 0x55b562999dc0 2024-09-19T09:06:56.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.484+0000 7fd3d191a640 1 --2- 172.21.15.92:0/765418099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b562999dc0 0x55b5629a8b80 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc000c00 tx=0x7fd3bc0157f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1d8ab0e282c4f40 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:56.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.484+0000 7fd3b57fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:06:56.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.484+0000 7fd3b57fa640 1 -- 172.21.15.92:0/765418099 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc024400 con 0x55b562999dc0 2024-09-19T09:06:56.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.484+0000 7fd3b57fa640 1 -- 172.21.15.92:0/765418099 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd3bc0245a0 con 0x55b562999dc0 2024-09-19T09:06:56.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.484+0000 7fd3d5f57740 1 -- 172.21.15.92:0/765418099 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b562906d60 con 0x55b562999dc0 2024-09-19T09:06:56.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.485+0000 7fd3b57fa640 1 -- 172.21.15.92:0/765418099 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd3bc0247a0 con 0x55b562999dc0 2024-09-19T09:06:56.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.485+0000 7fd3d5f57740 10 client.17907 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:56.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.485+0000 7fd3d5f57740 1 -- 172.21.15.92:0/765418099 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55b562a1f010 con 0x55b562999dc0 2024-09-19T09:06:56.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.485+0000 7fd3b57fa640 1 -- 172.21.15.92:0/765418099 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55b562906d60 con 0x55b562999dc0 2024-09-19T09:06:56.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.485+0000 7fd3b57fa640 1 -- 172.21.15.92:0/765418099 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fd3bc02e950 con 0x55b562999dc0 2024-09-19T09:06:56.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.485+0000 7fd3d5f57740 10 client.17907 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:56.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.485+0000 7fd3d5f57740 10 client.17907 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:06:56.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.485+0000 7fd3d5f57740 20 client.17907 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:56.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.485+0000 7fd3d5f57740 1 --2- 172.21.15.92:0/765418099 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b562a1f710 0x55b562a21b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:56.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.485+0000 7fd3d5f57740 4 client.17907 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:06:56.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.485+0000 7fd3d5f57740 1 -- 172.21.15.92:0/765418099 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b562883210 con 0x55b562a1f710 2024-09-19T09:06:56.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.485+0000 7fd3d1119640 1 --2- 172.21.15.92:0/765418099 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b562a1f710 0x55b562a21b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:56.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.486+0000 7fd3b57fa640 10 client.17907 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:56.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.486+0000 7fd3d1119640 1 --2- 172.21.15.92:0/765418099 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b562a1f710 0x55b562a21b30 crc :-1 s=READY pgs=328 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e8279af75fe58f4 server_cookie=349a683eb7fb1878 in_seq=0 out_seq=0 2024-09-19T09:06:56.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.486+0000 7fd3b57fa640 1 -- 172.21.15.92:0/765418099 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55b562883210 con 0x55b562a1f710 2024-09-19T09:06:56.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.486+0000 7fd3b57fa640 10 client.17907 handle_command_reply: tid=0 2024-09-19T09:06:56.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.486+0000 7fd3d5f57740 1 client.17907 shutdown 2024-09-19T09:06:56.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.486+0000 7fd3d5f57740 1 -- 172.21.15.92:0/765418099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b562999dc0 msgr2=0x55b5629a8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:56.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.486+0000 7fd3d5f57740 1 --2- 172.21.15.92:0/765418099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b562999dc0 0x55b5629a8b80 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc000c00 tx=0x7fd3bc0157f0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.486+0000 7fd3d5f57740 1 -- 172.21.15.92:0/765418099 shutdown_connections 2024-09-19T09:06:56.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.486+0000 7fd3d5f57740 1 --2- 172.21.15.92:0/765418099 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55b562a1f710 0x55b562a21b30 crc :-1 s=READY pgs=328 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.486+0000 7fd3d5f57740 1 --2- 172.21.15.92:0/765418099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5629a4680 0x55b5629a90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.486+0000 7fd3d5f57740 1 --2- 172.21.15.92:0/765418099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b562999dc0 0x55b5629a8b80 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.486+0000 7fd3b57fa640 0 client.17907 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:56.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.486+0000 7fd3d5f57740 1 --2- 172.21.15.92:0/765418099 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b5629994a0 0x55b5629a8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.486+0000 7fd3d5f57740 1 -- 172.21.15.92:0/765418099 >> 172.21.15.92:0/765418099 conn(0x55b562995a30 msgr2=0x55b5629a2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:56.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.486+0000 7fd3d5f57740 1 -- 172.21.15.92:0/765418099 shutdown_connections 2024-09-19T09:06:56.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.486+0000 7fd3d5f57740 1 -- 172.21.15.92:0/765418099 wait complete. 2024-09-19T09:06:56.520 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:06:56.520 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:06:56.520 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": { 2024-09-19T09:06:56.520 INFO:teuthology.orchestra.run.smithi092.stdout: "b7adebad-4ec3-461e-bc78-0aa977179930": { 2024-09-19T09:06:56.520 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-19T09:06:56.520 INFO:teuthology.orchestra.run.smithi092.stdout: "tag": "b7adebad-4ec3-461e-bc78-0aa977179930", 2024-09-19T09:06:56.521 INFO:teuthology.orchestra.run.smithi092.stdout: "options": "recursive,force" 2024-09-19T09:06:56.521 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:06:56.521 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:06:56.521 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:06:56.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.486+0000 7fd3d5f57740 20 client.17907 trim_cache size 0 max 16384 2024-09-19T09:06:56.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.487+0000 7fd3d3b7e640 1 -- 172.21.15.92:0/1324254279 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd3b80a3240 msgr2=0x7fd3b80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:56.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.487+0000 7fd3d3b7e640 1 --2- 172.21.15.92:0/1324254279 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd3b80a3240 0x7fd3b80a5700 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd3c40bd0c0 tx=0x7fd3c4087f60 comp rx=0 tx=0).stop 2024-09-19T09:06:56.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.487+0000 7fd3d3b7e640 1 -- 172.21.15.92:0/1324254279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3cc102ef0 msgr2=0x7fd3cc197cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:56.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.487+0000 7fd3d3b7e640 1 --2- 172.21.15.92:0/1324254279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3cc102ef0 0x7fd3cc197cc0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4006010 tx=0x7fd3c402f6f0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.488+0000 7fd3d3b7e640 1 -- 172.21.15.92:0/1324254279 shutdown_connections 2024-09-19T09:06:56.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.488+0000 7fd3d3b7e640 1 --2- 172.21.15.92:0/1324254279 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd3b80a3240 0x7fd3b80a5700 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.488+0000 7fd3d3b7e640 1 --2- 172.21.15.92:0/1324254279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3cc102ef0 0x7fd3cc197cc0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.488+0000 7fd3d3b7e640 1 --2- 172.21.15.92:0/1324254279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3cc102570 0x7fd3cc197780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.488+0000 7fd3d3b7e640 1 --2- 172.21.15.92:0/1324254279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3cc100e20 0x7fd3cc197240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.488+0000 7fd3d3b7e640 1 -- 172.21.15.92:0/1324254279 >> 172.21.15.92:0/1324254279 conn(0x7fd3cc0fc7d0 msgr2=0x7fd3cc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:56.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.488+0000 7fd3d3b7e640 1 -- 172.21.15.92:0/1324254279 shutdown_connections 2024-09-19T09:06:56.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:56.488+0000 7fd3d3b7e640 1 -- 172.21.15.92:0/1324254279 wait complete. 2024-09-19T09:06:56.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:56 smithi092 ceph-mon[31407]: scrub queued for path: / 2024-09-19T09:06:56.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:56 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:06:56.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:56 smithi092 ceph-mon[31407]: scrub summary: active paths [/] 2024-09-19T09:06:56.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:56 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:06:56.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:56 smithi167 ceph-mon[35359]: scrub queued for path: / 2024-09-19T09:06:56.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:56 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:06:56.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:56 smithi167 ceph-mon[35359]: scrub summary: active paths [/] 2024-09-19T09:06:56.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:56 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:06:56.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:56 smithi190 ceph-mon[35358]: scrub queued for path: / 2024-09-19T09:06:56.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:56 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:06:56.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:56 smithi190 ceph-mon[35358]: scrub summary: active paths [/] 2024-09-19T09:06:56.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:56 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:06:57.168 INFO:tasks.cephfs.filesystem:scrub status for tag:b7adebad-4ec3-461e-bc78-0aa977179930 - {'path': '/', 'tag': 'b7adebad-4ec3-461e-bc78-0aa977179930', 'options': 'recursive,force'} 2024-09-19T09:06:57.268 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:06:57.700 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:57 smithi092 ceph-mon[31407]: pgmap v644: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 2.6 KiB/s wr, 112 op/s 2024-09-19T09:06:57.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.700+0000 7fa357666640 1 -- 172.21.15.92:0/3334148860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa350101de0 msgr2=0x7fa3501021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:57.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.700+0000 7fa357666640 1 --2- 172.21.15.92:0/3334148860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa350101de0 0x7fa3501021c0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fa34c009900 tx=0x7fa34c02a410 comp rx=0 tx=0).stop 2024-09-19T09:06:57.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.700+0000 7fa357666640 1 -- 172.21.15.92:0/3334148860 shutdown_connections 2024-09-19T09:06:57.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.700+0000 7fa357666640 1 --2- 172.21.15.92:0/3334148860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa350106f10 0x7fa35010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:57.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.700+0000 7fa357666640 1 --2- 172.21.15.92:0/3334148860 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa350102790 0x7fa3501067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:57.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.700+0000 7fa357666640 1 --2- 172.21.15.92:0/3334148860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa350101de0 0x7fa3501021c0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:57.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.700+0000 7fa357666640 1 -- 172.21.15.92:0/3334148860 >> 172.21.15.92:0/3334148860 conn(0x7fa3500fd8c0 msgr2=0x7fa3500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:57.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.700+0000 7fa357666640 1 -- 172.21.15.92:0/3334148860 shutdown_connections 2024-09-19T09:06:57.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.700+0000 7fa357666640 1 -- 172.21.15.92:0/3334148860 wait complete. 2024-09-19T09:06:57.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.700+0000 7fa357666640 1 Processor -- start 2024-09-19T09:06:57.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.701+0000 7fa357666640 1 -- start start 2024-09-19T09:06:57.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.701+0000 7fa357666640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa350101de0 0x7fa3500744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:57.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.701+0000 7fa357666640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa350102790 0x7fa350074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:57.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.701+0000 7fa357666640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa350106f10 0x7fa350074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:57.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.701+0000 7fa357666640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa350111f70 con 0x7fa350102790 2024-09-19T09:06:57.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.701+0000 7fa357666640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa350111df0 con 0x7fa350106f10 2024-09-19T09:06:57.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.701+0000 7fa357666640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa3501120f0 con 0x7fa350101de0 2024-09-19T09:06:57.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.701+0000 7fa354c01640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa350102790 0x7fa350074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:57.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.701+0000 7fa354c01640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa350102790 0x7fa350074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37692/0 (socket says 172.21.15.92:37692) 2024-09-19T09:06:57.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.701+0000 7fa354c01640 1 -- 172.21.15.92:0/2352121859 learned_addr learned my addr 172.21.15.92:0/2352121859 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:57.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.701+0000 7fa355402640 1 --2- 172.21.15.92:0/2352121859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa350101de0 0x7fa3500744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:57.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.701+0000 7fa355c03640 1 --2- 172.21.15.92:0/2352121859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa350106f10 0x7fa350074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:57.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.701+0000 7fa354c01640 1 -- 172.21.15.92:0/2352121859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa350101de0 msgr2=0x7fa3500744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:57.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.701+0000 7fa354c01640 1 --2- 172.21.15.92:0/2352121859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa350101de0 0x7fa3500744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:57.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.701+0000 7fa354c01640 1 -- 172.21.15.92:0/2352121859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa350106f10 msgr2=0x7fa350074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:57.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.701+0000 7fa354c01640 1 --2- 172.21.15.92:0/2352121859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa350106f10 0x7fa350074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:57.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.701+0000 7fa354c01640 1 -- 172.21.15.92:0/2352121859 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3501a68f0 con 0x7fa350102790 2024-09-19T09:06:57.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.701+0000 7fa355c03640 1 --2- 172.21.15.92:0/2352121859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa350106f10 0x7fa350074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:57.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.701+0000 7fa355402640 1 --2- 172.21.15.92:0/2352121859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa350101de0 0x7fa3500744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:57.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.701+0000 7fa354c01640 1 --2- 172.21.15.92:0/2352121859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa350102790 0x7fa350074a30 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fa34000d950 tx=0x7fa34000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:57.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.702+0000 7fa3467fc640 1 -- 172.21.15.92:0/2352121859 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa340017030 con 0x7fa350102790 2024-09-19T09:06:57.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.702+0000 7fa357666640 1 -- 172.21.15.92:0/2352121859 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3501a6be0 con 0x7fa350102790 2024-09-19T09:06:57.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.702+0000 7fa3467fc640 1 -- 172.21.15.92:0/2352121859 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa340004020 con 0x7fa350102790 2024-09-19T09:06:57.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.702+0000 7fa3467fc640 1 -- 172.21.15.92:0/2352121859 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3400047a0 con 0x7fa350102790 2024-09-19T09:06:57.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.702+0000 7fa357666640 1 -- 172.21.15.92:0/2352121859 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3501a7170 con 0x7fa350102790 2024-09-19T09:06:57.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.703+0000 7fa357666640 1 -- 172.21.15.92:0/2352121859 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3501021c0 con 0x7fa350102790 2024-09-19T09:06:57.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.704+0000 7fa3467fc640 1 -- 172.21.15.92:0/2352121859 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa3400041d0 con 0x7fa350102790 2024-09-19T09:06:57.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.704+0000 7fa3467fc640 1 --2- 172.21.15.92:0/2352121859 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa33c0a3240 0x7fa33c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:57.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.705+0000 7fa355402640 1 --2- 172.21.15.92:0/2352121859 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa33c0a3240 0x7fa33c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:57.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.705+0000 7fa3467fc640 1 -- 172.21.15.92:0/2352121859 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa3400cf3d0 con 0x7fa350102790 2024-09-19T09:06:57.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.705+0000 7fa355402640 1 --2- 172.21.15.92:0/2352121859 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa33c0a3240 0x7fa33c0a5700 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa34c005ab0 tx=0x7fa34c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:57.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.709+0000 7fa3467fc640 1 -- 172.21.15.92:0/2352121859 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa34009c0f0 con 0x7fa350102790 2024-09-19T09:06:57.853 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:57 smithi167 ceph-mon[35359]: pgmap v644: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 2.6 KiB/s wr, 112 op/s 2024-09-19T09:06:57.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:57 smithi190 ceph-mon[35358]: pgmap v644: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 2.6 KiB/s wr, 112 op/s 2024-09-19T09:06:57.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.914+0000 7fa357666640 1 -- 172.21.15.92:0/2352121859 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa35002d7c0 con 0x7fa350102790 2024-09-19T09:06:57.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.914+0000 7fa3467fc640 1 -- 172.21.15.92:0/2352121859 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7fa34009b9f0 con 0x7fa350102790 2024-09-19T09:06:57.916 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:06:57.916 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:06:57.916 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:06:57.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.916+0000 7fa357666640 1 -- 172.21.15.92:0/2352121859 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa33c0a3240 msgr2=0x7fa33c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:57.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.916+0000 7fa357666640 1 --2- 172.21.15.92:0/2352121859 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa33c0a3240 0x7fa33c0a5700 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa34c005ab0 tx=0x7fa34c005a20 comp rx=0 tx=0).stop 2024-09-19T09:06:57.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.916+0000 7fa357666640 1 -- 172.21.15.92:0/2352121859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa350102790 msgr2=0x7fa350074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:57.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.916+0000 7fa357666640 1 --2- 172.21.15.92:0/2352121859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa350102790 0x7fa350074a30 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fa34000d950 tx=0x7fa34000de10 comp rx=0 tx=0).stop 2024-09-19T09:06:57.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.916+0000 7fa357666640 1 -- 172.21.15.92:0/2352121859 shutdown_connections 2024-09-19T09:06:57.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.916+0000 7fa357666640 1 --2- 172.21.15.92:0/2352121859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa350106f10 0x7fa350074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:57.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.916+0000 7fa357666640 1 --2- 172.21.15.92:0/2352121859 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa33c0a3240 0x7fa33c0a5700 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:57.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.916+0000 7fa357666640 1 --2- 172.21.15.92:0/2352121859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa350102790 0x7fa350074a30 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:57.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.916+0000 7fa357666640 1 --2- 172.21.15.92:0/2352121859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa350101de0 0x7fa3500744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:57.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.916+0000 7fa357666640 1 -- 172.21.15.92:0/2352121859 >> 172.21.15.92:0/2352121859 conn(0x7fa3500fd8c0 msgr2=0x7fa3500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:57.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.916+0000 7fa357666640 1 -- 172.21.15.92:0/2352121859 shutdown_connections 2024-09-19T09:06:57.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:57.917+0000 7fa357666640 1 -- 172.21.15.92:0/2352121859 wait complete. 2024-09-19T09:06:58.669 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id 9658154d --release --await' 2024-09-19T09:06:58.670 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id 9658154d --release --await 2024-09-19T09:06:58.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:58 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/2352121859' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:06:58.876 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:58 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/2352121859' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:06:58.917 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:06:59.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:58 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/2352121859' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:06:59.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.384+0000 7fd98ad04640 1 -- 172.21.15.92:0/2746029575 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd984102ef0 msgr2=0x7fd98410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:59.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.384+0000 7fd98ad04640 1 --2- 172.21.15.92:0/2746029575 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd984102ef0 0x7fd98410da40 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fd974009900 tx=0x7fd97402a480 comp rx=0 tx=0).stop 2024-09-19T09:06:59.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.384+0000 7fd98ad04640 1 -- 172.21.15.92:0/2746029575 shutdown_connections 2024-09-19T09:06:59.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.384+0000 7fd98ad04640 1 --2- 172.21.15.92:0/2746029575 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd984102ef0 0x7fd98410da40 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:59.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.384+0000 7fd98ad04640 1 --2- 172.21.15.92:0/2746029575 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd984102570 0x7fd9841029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:59.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.384+0000 7fd98ad04640 1 --2- 172.21.15.92:0/2746029575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd984100e20 0x7fd984101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:59.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.384+0000 7fd98ad04640 1 -- 172.21.15.92:0/2746029575 >> 172.21.15.92:0/2746029575 conn(0x7fd9840fc7d0 msgr2=0x7fd9840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:59.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.384+0000 7fd98ad04640 1 -- 172.21.15.92:0/2746029575 shutdown_connections 2024-09-19T09:06:59.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.384+0000 7fd98ad04640 1 -- 172.21.15.92:0/2746029575 wait complete. 2024-09-19T09:06:59.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.384+0000 7fd98ad04640 1 Processor -- start 2024-09-19T09:06:59.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.385+0000 7fd98ad04640 1 -- start start 2024-09-19T09:06:59.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.385+0000 7fd98ad04640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd984100e20 0x7fd984197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:59.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.385+0000 7fd98ad04640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd984102570 0x7fd984197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:59.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.385+0000 7fd98ad04640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd984102ef0 0x7fd984197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:59.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.385+0000 7fd98ad04640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd984111020 con 0x7fd984102ef0 2024-09-19T09:06:59.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.385+0000 7fd98ad04640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd984110ea0 con 0x7fd984102570 2024-09-19T09:06:59.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.385+0000 7fd98ad04640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd9841111a0 con 0x7fd984100e20 2024-09-19T09:06:59.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.385+0000 7fd9892a1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd984102ef0 0x7fd984197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:59.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.385+0000 7fd9892a1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd984102ef0 0x7fd984197d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37698/0 (socket says 172.21.15.92:37698) 2024-09-19T09:06:59.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.385+0000 7fd9892a1640 1 -- 172.21.15.92:0/2993150255 learned_addr learned my addr 172.21.15.92:0/2993150255 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:59.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.385+0000 7fd988aa0640 1 --2- 172.21.15.92:0/2993150255 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd984100e20 0x7fd984197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:59.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.385+0000 7fd9892a1640 1 -- 172.21.15.92:0/2993150255 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd984100e20 msgr2=0x7fd984197300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:59.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.385+0000 7fd983fff640 1 --2- 172.21.15.92:0/2993150255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd984102570 0x7fd984197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:59.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.385+0000 7fd9892a1640 1 --2- 172.21.15.92:0/2993150255 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd984100e20 0x7fd984197300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:59.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.385+0000 7fd9892a1640 1 -- 172.21.15.92:0/2993150255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd984102570 msgr2=0x7fd984197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:59.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.385+0000 7fd9892a1640 1 --2- 172.21.15.92:0/2993150255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd984102570 0x7fd984197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:59.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.385+0000 7fd9892a1640 1 -- 172.21.15.92:0/2993150255 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9841a6bb0 con 0x7fd984102ef0 2024-09-19T09:06:59.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.385+0000 7fd983fff640 1 --2- 172.21.15.92:0/2993150255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd984102570 0x7fd984197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:06:59.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.385+0000 7fd9892a1640 1 --2- 172.21.15.92:0/2993150255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd984102ef0 0x7fd984197d80 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fd974005ab0 tx=0x7fd974003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:59.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.386+0000 7fd981ffb640 1 -- 172.21.15.92:0/2993150255 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97403f070 con 0x7fd984102ef0 2024-09-19T09:06:59.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.386+0000 7fd981ffb640 1 -- 172.21.15.92:0/2993150255 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd974031e30 con 0x7fd984102ef0 2024-09-19T09:06:59.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.386+0000 7fd98ad04640 1 -- 172.21.15.92:0/2993150255 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9841a6e40 con 0x7fd984102ef0 2024-09-19T09:06:59.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.386+0000 7fd981ffb640 1 -- 172.21.15.92:0/2993150255 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd974035030 con 0x7fd984102ef0 2024-09-19T09:06:59.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.386+0000 7fd98ad04640 1 -- 172.21.15.92:0/2993150255 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9841a72f0 con 0x7fd984102ef0 2024-09-19T09:06:59.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.388+0000 7fd981ffb640 1 -- 172.21.15.92:0/2993150255 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd974042070 con 0x7fd984102ef0 2024-09-19T09:06:59.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.388+0000 7fd98d0dd740 1 Processor -- start 2024-09-19T09:06:59.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.388+0000 7fd98d0dd740 1 -- start start 2024-09-19T09:06:59.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.389+0000 7fd98d0dd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dd8c4060 0x5646dd8c4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:59.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.389+0000 7fd98d0dd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646dd8c4980 0x5646dd8ced00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:59.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.389+0000 7fd981ffb640 1 --2- 172.21.15.92:0/2993150255 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd9700a3240 0x7fd9700a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:59.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.389+0000 7fd98d0dd740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646dd8cf240 0x5646dd8d1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:59.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.389+0000 7fd983fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dd8c4060 0x5646dd8c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:59.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.389+0000 7fd983fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dd8c4060 0x5646dd8c4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37702/0 (socket says 172.21.15.92:37702) 2024-09-19T09:06:59.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.389+0000 7fd983fff640 1 -- 172.21.15.92:0/1456422227 learned_addr learned my addr 172.21.15.92:0/1456422227 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:59.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.389+0000 7fd98d0dd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5646dd829620 con 0x5646dd8c4060 2024-09-19T09:06:59.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.389+0000 7fd98d0dd740 1 -- 172.21.15.92:0/1456422227 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5646dd7d0e50 con 0x5646dd8c4980 2024-09-19T09:06:59.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.389+0000 7fd98d0dd740 1 -- 172.21.15.92:0/1456422227 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5646dd8255e0 con 0x5646dd8cf240 2024-09-19T09:06:59.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.389+0000 7fd981ffb640 1 -- 172.21.15.92:0/2993150255 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd9740f01a0 con 0x7fd984102ef0 2024-09-19T09:06:59.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.389+0000 7fd9892a1640 1 --2- 172.21.15.92:0/1456422227 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646dd8cf240 0x5646dd8d1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:59.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.389+0000 7fd983fff640 1 --2- 172.21.15.92:0/2993150255 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd9700a3240 0x7fd9700a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:59.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.389+0000 7fd988aa0640 1 --2- 172.21.15.92:0/1456422227 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646dd8c4980 0x5646dd8ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:59.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.389+0000 7fd983fff640 1 -- 172.21.15.92:0/1456422227 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646dd8cf240 msgr2=0x5646dd8d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:59.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.389+0000 7fd983fff640 1 --2- 172.21.15.92:0/1456422227 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646dd8cf240 0x5646dd8d1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:59.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.389+0000 7fd983fff640 1 -- 172.21.15.92:0/1456422227 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646dd8c4980 msgr2=0x5646dd8ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:59.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.389+0000 7fd983fff640 1 --2- 172.21.15.92:0/1456422227 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646dd8c4980 0x5646dd8ced00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:59.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.389+0000 7fd983fff640 1 -- 172.21.15.92:0/1456422227 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646dd7c1d40 con 0x5646dd8c4060 2024-09-19T09:06:59.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.389+0000 7fd988aa0640 1 --2- 172.21.15.92:0/1456422227 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646dd8c4980 0x5646dd8ced00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:59.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.389+0000 7fd983fff640 1 --2- 172.21.15.92:0/1456422227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dd8c4060 0x5646dd8c4440 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fd96c013380 tx=0x7fd96c013780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6049df1ba2be9f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:59.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.389+0000 7fd97affd640 1 -- 172.21.15.92:0/1456422227 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96c01a030 con 0x5646dd8c4060 2024-09-19T09:06:59.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.390+0000 7fd97affd640 1 -- 172.21.15.92:0/1456422227 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd96c01f8f0 con 0x5646dd8c4060 2024-09-19T09:06:59.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.390+0000 7fd97affd640 1 -- 172.21.15.92:0/1456422227 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96c00f040 con 0x5646dd8c4060 2024-09-19T09:06:59.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.390+0000 7fd983fff640 1 --2- 172.21.15.92:0/2993150255 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd9700a3240 0x7fd9700a5700 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd96c01d000 tx=0x7fd96c01b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:59.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.390+0000 7fd98d0dd740 1 -- 172.21.15.92:0/1456422227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dd8c4060 msgr2=0x5646dd8c4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:59.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.390+0000 7fd98d0dd740 1 --2- 172.21.15.92:0/1456422227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dd8c4060 0x5646dd8c4440 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fd96c013380 tx=0x7fd96c013780 comp rx=0 tx=0).stop 2024-09-19T09:06:59.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.390+0000 7fd98d0dd740 1 -- 172.21.15.92:0/1456422227 shutdown_connections 2024-09-19T09:06:59.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.390+0000 7fd98d0dd740 1 --2- 172.21.15.92:0/1456422227 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646dd8cf240 0x5646dd8d1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:59.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.390+0000 7fd98d0dd740 1 --2- 172.21.15.92:0/1456422227 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646dd8c4980 0x5646dd8ced00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:59.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.390+0000 7fd98d0dd740 1 --2- 172.21.15.92:0/1456422227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dd8c4060 0x5646dd8c4440 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:59.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.390+0000 7fd98d0dd740 1 -- 172.21.15.92:0/1456422227 >> 172.21.15.92:0/1456422227 conn(0x5646dd8c05f0 msgr2=0x5646dd8c09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:59.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.390+0000 7fd98d0dd740 1 -- 172.21.15.92:0/1456422227 shutdown_connections 2024-09-19T09:06:59.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.390+0000 7fd98d0dd740 1 -- 172.21.15.92:0/1456422227 wait complete. 2024-09-19T09:06:59.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.391+0000 7fd98d0dd740 1 -- start start 2024-09-19T09:06:59.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.391+0000 7fd98d0dd740 1 Processor -- start 2024-09-19T09:06:59.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.391+0000 7fd98d0dd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dd8c4060 0x5646dd8cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:59.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.391+0000 7fd98d0dd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646dd8c4980 0x5646dd8cc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:59.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.391+0000 7fd98d0dd740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646dd8cf240 0x5646dd8ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:59.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.391+0000 7fd98d0dd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5646dd8d1e10 con 0x5646dd8c4060 2024-09-19T09:06:59.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.391+0000 7fd98d0dd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5646dd7b1f10 con 0x5646dd8c4980 2024-09-19T09:06:59.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.391+0000 7fd98d0dd740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5646dd8d1f90 con 0x5646dd8cf240 2024-09-19T09:06:59.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.391+0000 7fd98d0dd740 10 client.0 _ll_register_callbacks cb 0x5646dd7d5db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:59.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.391+0000 7fd988aa0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dd8c4060 0x5646dd8cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:59.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.391+0000 7fd988aa0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dd8c4060 0x5646dd8cc0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37718/0 (socket says 172.21.15.92:37718) 2024-09-19T09:06:59.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.391+0000 7fd988aa0640 1 -- 172.21.15.92:0/561510355 learned_addr learned my addr 172.21.15.92:0/561510355 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:59.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.392+0000 7fd983fff640 1 --2- 172.21.15.92:0/561510355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646dd8c4980 0x5646dd8cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:59.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.392+0000 7fd988aa0640 1 -- 172.21.15.92:0/561510355 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646dd8cf240 msgr2=0x5646dd8ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:59.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.392+0000 7fd988aa0640 1 --2- 172.21.15.92:0/561510355 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646dd8cf240 0x5646dd8ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:59.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.392+0000 7fd988aa0640 1 -- 172.21.15.92:0/561510355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646dd8c4980 msgr2=0x5646dd8cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:59.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.392+0000 7fd988aa0640 1 --2- 172.21.15.92:0/561510355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646dd8c4980 0x5646dd8cc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:59.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.392+0000 7fd988aa0640 1 -- 172.21.15.92:0/561510355 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646dd538580 con 0x5646dd8c4060 2024-09-19T09:06:59.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.392+0000 7fd988aa0640 1 --2- 172.21.15.92:0/561510355 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dd8c4060 0x5646dd8cc0f0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fd97c00abc0 tx=0x7fd97c007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d86433d0d37e5bde server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:59.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.392+0000 7fd963fff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:06:59.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.392+0000 7fd963fff640 1 -- 172.21.15.92:0/561510355 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97c016610 con 0x5646dd8c4060 2024-09-19T09:06:59.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.392+0000 7fd963fff640 1 -- 172.21.15.92:0/561510355 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd97c0167b0 con 0x5646dd8c4060 2024-09-19T09:06:59.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.392+0000 7fd98d0dd740 1 -- 172.21.15.92:0/561510355 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd96c01f8f0 con 0x5646dd8c4060 2024-09-19T09:06:59.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.392+0000 7fd963fff640 1 -- 172.21.15.92:0/561510355 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd97c0169b0 con 0x5646dd8c4060 2024-09-19T09:06:59.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.392+0000 7fd98d0dd740 10 client.17925 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:59.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.392+0000 7fd98d0dd740 1 -- 172.21.15.92:0/561510355 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5646dd602960 con 0x5646dd8c4060 2024-09-19T09:06:59.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.392+0000 7fd963fff640 1 -- 172.21.15.92:0/561510355 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd96c01f8f0 con 0x5646dd8c4060 2024-09-19T09:06:59.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.393+0000 7fd963fff640 1 -- 172.21.15.92:0/561510355 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fd97c01faf0 con 0x5646dd8c4060 2024-09-19T09:06:59.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.393+0000 7fd98d0dd740 10 client.17925 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:59.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.393+0000 7fd98d0dd740 10 client.17925 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:06:59.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.393+0000 7fd98d0dd740 20 client.17925 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:59.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.393+0000 7fd98d0dd740 1 --2- 172.21.15.92:0/561510355 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5646dd8dee80 0x5646dd8e1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:59.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.393+0000 7fd98d0dd740 4 client.17925 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:06:59.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.393+0000 7fd98d0dd740 1 -- 172.21.15.92:0/561510355 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5646dd836b90 con 0x5646dd8dee80 2024-09-19T09:06:59.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.393+0000 7fd983fff640 1 --2- 172.21.15.92:0/561510355 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5646dd8dee80 0x5646dd8e1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:59.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.393+0000 7fd983fff640 1 --2- 172.21.15.92:0/561510355 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5646dd8dee80 0x5646dd8e1300 crc :-1 s=READY pgs=329 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c6378b77b8bb7a server_cookie=c26ca833cd7e514e in_seq=0 out_seq=0 2024-09-19T09:06:59.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.393+0000 7fd963fff640 10 client.17925 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:59.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.394+0000 7fd963fff640 1 -- 172.21.15.92:0/561510355 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5646dd836b90 con 0x5646dd8dee80 2024-09-19T09:06:59.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.394+0000 7fd963fff640 10 client.17925 handle_command_reply: tid=0 2024-09-19T09:06:59.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.394+0000 7fd98d0dd740 1 client.17925 shutdown 2024-09-19T09:06:59.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.394+0000 7fd98d0dd740 1 -- 172.21.15.92:0/561510355 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dd8c4060 msgr2=0x5646dd8cc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:59.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.394+0000 7fd98d0dd740 1 --2- 172.21.15.92:0/561510355 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dd8c4060 0x5646dd8cc0f0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fd97c00abc0 tx=0x7fd97c007680 comp rx=0 tx=0).stop 2024-09-19T09:06:59.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.394+0000 7fd98d0dd740 1 -- 172.21.15.92:0/561510355 shutdown_connections 2024-09-19T09:06:59.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.394+0000 7fd98d0dd740 1 --2- 172.21.15.92:0/561510355 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5646dd8dee80 0x5646dd8e1300 crc :-1 s=READY pgs=329 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:59.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.394+0000 7fd98d0dd740 1 --2- 172.21.15.92:0/561510355 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646dd8cf240 0x5646dd8ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:59.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.394+0000 7fd98d0dd740 1 --2- 172.21.15.92:0/561510355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646dd8c4980 0x5646dd8cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:59.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.394+0000 7fd98d0dd740 1 --2- 172.21.15.92:0/561510355 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dd8c4060 0x5646dd8cc0f0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:59.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.394+0000 7fd98d0dd740 1 -- 172.21.15.92:0/561510355 >> 172.21.15.92:0/561510355 conn(0x5646dd8c05f0 msgr2=0x5646dd8bf750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:59.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.394+0000 7fd963fff640 0 client.17925 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:59.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.394+0000 7fd98d0dd740 1 -- 172.21.15.92:0/561510355 shutdown_connections 2024-09-19T09:06:59.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.394+0000 7fd98d0dd740 1 -- 172.21.15.92:0/561510355 wait complete. 2024-09-19T09:06:59.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.395+0000 7fd98d0dd740 20 client.17925 trim_cache size 0 max 16384 2024-09-19T09:06:59.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.411+0000 7fd98d0dd740 1 Processor -- start 2024-09-19T09:06:59.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.411+0000 7fd98d0dd740 1 -- start start 2024-09-19T09:06:59.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.411+0000 7fd98d0dd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dd8c4060 0x5646dd8c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:59.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.412+0000 7fd98d0dd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646dd8c4980 0x5646dd8c7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:59.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.412+0000 7fd98d0dd740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646dd8cf240 0x5646dd8bf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:59.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.412+0000 7fd98d0dd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd9841ad7a0 con 0x5646dd8c4060 2024-09-19T09:06:59.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.412+0000 7fd98d0dd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd9841b0020 con 0x5646dd8c4980 2024-09-19T09:06:59.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.412+0000 7fd98d0dd740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd9841ade10 con 0x5646dd8cf240 2024-09-19T09:06:59.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.412+0000 7fd988aa0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dd8c4060 0x5646dd8c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:59.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.412+0000 7fd988aa0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dd8c4060 0x5646dd8c6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37724/0 (socket says 172.21.15.92:37724) 2024-09-19T09:06:59.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.412+0000 7fd988aa0640 1 -- 172.21.15.92:0/1991996980 learned_addr learned my addr 172.21.15.92:0/1991996980 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:59.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.412+0000 7fd983fff640 1 --2- 172.21.15.92:0/1991996980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646dd8c4980 0x5646dd8c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:59.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.412+0000 7fd9892a1640 1 --2- 172.21.15.92:0/1991996980 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646dd8cf240 0x5646dd8bf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:59.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.412+0000 7fd988aa0640 1 -- 172.21.15.92:0/1991996980 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646dd8cf240 msgr2=0x5646dd8bf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:59.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.412+0000 7fd988aa0640 1 --2- 172.21.15.92:0/1991996980 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646dd8cf240 0x5646dd8bf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:59.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.412+0000 7fd988aa0640 1 -- 172.21.15.92:0/1991996980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646dd8c4980 msgr2=0x5646dd8c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:59.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.412+0000 7fd988aa0640 1 --2- 172.21.15.92:0/1991996980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646dd8c4980 0x5646dd8c7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:59.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.412+0000 7fd988aa0640 1 -- 172.21.15.92:0/1991996980 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646dd8ce030 con 0x5646dd8c4060 2024-09-19T09:06:59.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.412+0000 7fd988aa0640 1 --2- 172.21.15.92:0/1991996980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dd8c4060 0x5646dd8c6ac0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fd97c020000 tx=0x7fd97c0049c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e04d5f316e174f60 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:59.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.412+0000 7fd97a7fc640 1 -- 172.21.15.92:0/1991996980 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97c016b50 con 0x5646dd8c4060 2024-09-19T09:06:59.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.412+0000 7fd97a7fc640 1 -- 172.21.15.92:0/1991996980 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd97c01b070 con 0x5646dd8c4060 2024-09-19T09:06:59.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.412+0000 7fd97a7fc640 1 -- 172.21.15.92:0/1991996980 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97c01f770 con 0x5646dd8c4060 2024-09-19T09:06:59.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.413+0000 7fd98d0dd740 1 -- 172.21.15.92:0/1991996980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dd8c4060 msgr2=0x5646dd8c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:59.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.413+0000 7fd98d0dd740 1 --2- 172.21.15.92:0/1991996980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dd8c4060 0x5646dd8c6ac0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fd97c020000 tx=0x7fd97c0049c0 comp rx=0 tx=0).stop 2024-09-19T09:06:59.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.413+0000 7fd98d0dd740 1 -- 172.21.15.92:0/1991996980 shutdown_connections 2024-09-19T09:06:59.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.413+0000 7fd98d0dd740 1 --2- 172.21.15.92:0/1991996980 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646dd8cf240 0x5646dd8bf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:59.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.413+0000 7fd98d0dd740 1 --2- 172.21.15.92:0/1991996980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646dd8c4980 0x5646dd8c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:59.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.413+0000 7fd98d0dd740 1 --2- 172.21.15.92:0/1991996980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dd8c4060 0x5646dd8c6ac0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:59.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.413+0000 7fd98d0dd740 1 -- 172.21.15.92:0/1991996980 >> 172.21.15.92:0/1991996980 conn(0x5646dd8c05f0 msgr2=0x5646dd8bef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:59.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.413+0000 7fd98d0dd740 1 -- 172.21.15.92:0/1991996980 shutdown_connections 2024-09-19T09:06:59.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.413+0000 7fd98d0dd740 1 -- 172.21.15.92:0/1991996980 wait complete. 2024-09-19T09:06:59.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.413+0000 7fd98d0dd740 1 -- start start 2024-09-19T09:06:59.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.413+0000 7fd98d0dd740 1 Processor -- start 2024-09-19T09:06:59.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.414+0000 7fd98d0dd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dd8c4060 0x5646dd8d3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:59.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.414+0000 7fd98d0dd740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646dd8c4980 0x5646dd8d3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:59.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.414+0000 7fd98d0dd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646dd8cf240 0x5646dd8d3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:59.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.414+0000 7fd98d0dd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd9841ae4e0 con 0x5646dd8c4060 2024-09-19T09:06:59.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.414+0000 7fd98d0dd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd9841af950 con 0x5646dd8cf240 2024-09-19T09:06:59.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.414+0000 7fd98d0dd740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd9841aebb0 con 0x5646dd8c4980 2024-09-19T09:06:59.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.414+0000 7fd98d0dd740 10 client.0 _ll_register_callbacks cb 0x7fd97c00a770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:59.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.414+0000 7fd988aa0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dd8c4060 0x5646dd8d3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:59.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.414+0000 7fd988aa0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dd8c4060 0x5646dd8d3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37736/0 (socket says 172.21.15.92:37736) 2024-09-19T09:06:59.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.414+0000 7fd988aa0640 1 -- 172.21.15.92:0/753339906 learned_addr learned my addr 172.21.15.92:0/753339906 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:06:59.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.414+0000 7fd983fff640 1 --2- 172.21.15.92:0/753339906 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646dd8c4980 0x5646dd8d3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:59.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.414+0000 7fd988aa0640 1 -- 172.21.15.92:0/753339906 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646dd8c4980 msgr2=0x5646dd8d3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:59.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.414+0000 7fd988aa0640 1 --2- 172.21.15.92:0/753339906 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646dd8c4980 0x5646dd8d3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:59.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.414+0000 7fd988aa0640 1 -- 172.21.15.92:0/753339906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646dd8cf240 msgr2=0x5646dd8d3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:59.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.414+0000 7fd988aa0640 1 --2- 172.21.15.92:0/753339906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646dd8cf240 0x5646dd8d3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:59.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.414+0000 7fd988aa0640 1 -- 172.21.15.92:0/753339906 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646dd8c47b0 con 0x5646dd8c4060 2024-09-19T09:06:59.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.414+0000 7fd983fff640 1 --2- 172.21.15.92:0/753339906 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646dd8c4980 0x5646dd8d3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:06:59.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.414+0000 7fd988aa0640 1 --2- 172.21.15.92:0/753339906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dd8c4060 0x5646dd8d3250 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fd97c00a010 tx=0x7fd97c016940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81eabb66abc1efef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:59.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.414+0000 7fd963fff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:06:59.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.414+0000 7fd963fff640 1 -- 172.21.15.92:0/753339906 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97c01f810 con 0x5646dd8c4060 2024-09-19T09:06:59.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.414+0000 7fd963fff640 1 -- 172.21.15.92:0/753339906 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd97c01f9b0 con 0x5646dd8c4060 2024-09-19T09:06:59.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.415+0000 7fd98d0dd740 1 -- 172.21.15.92:0/753339906 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd97c01b070 con 0x5646dd8c4060 2024-09-19T09:06:59.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.415+0000 7fd963fff640 1 -- 172.21.15.92:0/753339906 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd97c03a050 con 0x5646dd8c4060 2024-09-19T09:06:59.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.415+0000 7fd98d0dd740 10 client.17931 fetch_fsmap learned FSMap version 19 2024-09-19T09:06:59.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.415+0000 7fd98d0dd740 1 -- 172.21.15.92:0/753339906 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5646dd94a000 con 0x5646dd8c4060 2024-09-19T09:06:59.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.415+0000 7fd963fff640 1 -- 172.21.15.92:0/753339906 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd97c01b070 con 0x5646dd8c4060 2024-09-19T09:06:59.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.415+0000 7fd963fff640 1 -- 172.21.15.92:0/753339906 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fd97c02a480 con 0x5646dd8c4060 2024-09-19T09:06:59.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.415+0000 7fd98d0dd740 10 client.17931 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:06:59.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.415+0000 7fd98d0dd740 10 client.17931 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:06:59.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.415+0000 7fd98d0dd740 20 client.17931 populate_metadata read hostname 'smithi092' 2024-09-19T09:06:59.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.415+0000 7fd98d0dd740 1 --2- 172.21.15.92:0/753339906 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5646dd94a600 0x5646dd94ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:59.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.415+0000 7fd98d0dd740 4 client.17931 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "9658154d", "release": true, "await": true}] 2024-09-19T09:06:59.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.415+0000 7fd98d0dd740 1 -- 172.21.15.92:0/753339906 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "quiesce db", "set_id": "9658154d", "release": true, "await": true}) -- 0x5646dd8310a0 con 0x5646dd94a600 2024-09-19T09:06:59.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.415+0000 7fd983fff640 1 --2- 172.21.15.92:0/753339906 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5646dd94a600 0x5646dd94ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:59.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.416+0000 7fd963fff640 10 client.17931 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:59.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.416+0000 7fd983fff640 1 --2- 172.21.15.92:0/753339906 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5646dd94a600 0x5646dd94ca30 crc :-1 s=READY pgs=330 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=990c668d1612344a server_cookie=d26c89ed5df7cf7c in_seq=0 out_seq=0 2024-09-19T09:06:59.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.471+0000 7fd963fff640 1 -- 172.21.15.92:0/753339906 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5646dd8310a0 con 0x5646dd94a600 2024-09-19T09:06:59.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.471+0000 7fd963fff640 10 client.17931 handle_command_reply: tid=0 2024-09-19T09:06:59.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.471+0000 7fd98d0dd740 1 client.17931 shutdown 2024-09-19T09:06:59.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.471+0000 7fd98d0dd740 1 -- 172.21.15.92:0/753339906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dd8c4060 msgr2=0x5646dd8d3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:59.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.471+0000 7fd98d0dd740 1 --2- 172.21.15.92:0/753339906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dd8c4060 0x5646dd8d3250 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fd97c00a010 tx=0x7fd97c016940 comp rx=0 tx=0).stop 2024-09-19T09:06:59.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.471+0000 7fd98d0dd740 1 -- 172.21.15.92:0/753339906 shutdown_connections 2024-09-19T09:06:59.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.471+0000 7fd98d0dd740 1 --2- 172.21.15.92:0/753339906 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5646dd94a600 0x5646dd94ca30 crc :-1 s=READY pgs=330 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:59.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.471+0000 7fd98d0dd740 1 --2- 172.21.15.92:0/753339906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646dd8cf240 0x5646dd8d3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:59.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.471+0000 7fd98d0dd740 1 --2- 172.21.15.92:0/753339906 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646dd8c4980 0x5646dd8d3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:59.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.471+0000 7fd98d0dd740 1 --2- 172.21.15.92:0/753339906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5646dd8c4060 0x5646dd8d3250 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:59.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.471+0000 7fd98d0dd740 1 -- 172.21.15.92:0/753339906 >> 172.21.15.92:0/753339906 conn(0x5646dd8c05f0 msgr2=0x5646dd8bf750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:59.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.471+0000 7fd963fff640 0 client.17931 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:06:59.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.471+0000 7fd98d0dd740 1 -- 172.21.15.92:0/753339906 shutdown_connections 2024-09-19T09:06:59.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.471+0000 7fd98d0dd740 1 -- 172.21.15.92:0/753339906 wait complete. 2024-09-19T09:06:59.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.472+0000 7fd98d0dd740 20 client.17931 trim_cache size 0 max 16384 2024-09-19T09:06:59.473 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:06:59.474 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 19, 2024-09-19T09:06:59.474 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24472, 2024-09-19T09:06:59.474 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 40, 2024-09-19T09:06:59.474 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-09-19T09:06:59.474 INFO:teuthology.orchestra.run.smithi092.stdout: "9658154d": { 2024-09-19T09:06:59.474 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 40, 2024-09-19T09:06:59.474 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-09-19T09:06:59.474 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:06:59.474 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-09-19T09:06:59.474 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:06:59.475 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:06:59.475 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 90.0, 2024-09-19T09:06:59.475 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 150.0, 2024-09-19T09:06:59.475 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-09-19T09:06:59.475 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-09-19T09:06:59.475 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-09-19T09:06:59.475 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:06:59.475 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-09-19T09:06:59.475 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:06:59.475 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:06:59.475 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:06:59.476 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:06:59.476 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:06:59.476 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:06:59.476 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:06:59.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.472+0000 7fd98ad04640 1 -- 172.21.15.92:0/2993150255 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd9700a3240 msgr2=0x7fd9700a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:59.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.472+0000 7fd98ad04640 1 --2- 172.21.15.92:0/2993150255 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd9700a3240 0x7fd9700a5700 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd96c01d000 tx=0x7fd96c01b000 comp rx=0 tx=0).stop 2024-09-19T09:06:59.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.473+0000 7fd98ad04640 1 -- 172.21.15.92:0/2993150255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd984102ef0 msgr2=0x7fd984197d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:59.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.473+0000 7fd98ad04640 1 --2- 172.21.15.92:0/2993150255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd984102ef0 0x7fd984197d80 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fd974005ab0 tx=0x7fd974003c30 comp rx=0 tx=0).stop 2024-09-19T09:06:59.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.473+0000 7fd98ad04640 1 -- 172.21.15.92:0/2993150255 shutdown_connections 2024-09-19T09:06:59.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.473+0000 7fd98ad04640 1 --2- 172.21.15.92:0/2993150255 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd9700a3240 0x7fd9700a5700 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:59.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.473+0000 7fd98ad04640 1 --2- 172.21.15.92:0/2993150255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd984102ef0 0x7fd984197d80 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:59.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.473+0000 7fd98ad04640 1 --2- 172.21.15.92:0/2993150255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd984102570 0x7fd984197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:59.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.473+0000 7fd98ad04640 1 --2- 172.21.15.92:0/2993150255 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd984100e20 0x7fd984197300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:59.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.473+0000 7fd98ad04640 1 -- 172.21.15.92:0/2993150255 >> 172.21.15.92:0/2993150255 conn(0x7fd9840fc7d0 msgr2=0x7fd9840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:59.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.473+0000 7fd98ad04640 1 -- 172.21.15.92:0/2993150255 shutdown_connections 2024-09-19T09:06:59.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:06:59.473+0000 7fd98ad04640 1 -- 172.21.15.92:0/2993150255 wait complete. 2024-09-19T09:06:59.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:59 smithi167 ceph-mon[35359]: pgmap v645: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 2.3 MiB/s wr, 369 op/s 2024-09-19T09:06:59.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:06:59 smithi167 ceph-mon[35359]: scrub summary: idle 2024-09-19T09:06:59.867 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:59 smithi092 ceph-mon[31407]: pgmap v645: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 2.3 MiB/s wr, 369 op/s 2024-09-19T09:06:59.867 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:06:59 smithi092 ceph-mon[31407]: scrub summary: idle 2024-09-19T09:06:59.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:59 smithi190 ceph-mon[35358]: pgmap v645: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 2.3 MiB/s wr, 369 op/s 2024-09-19T09:06:59.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:06:59 smithi190 ceph-mon[35358]: scrub summary: idle 2024-09-19T09:07:00.200 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '9658154d', total seconds elapsed: 34.0 2024-09-19T09:07:00.795 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 615.0 s, 621.8 tps, lat 1014.483 ms stddev 5340.100 2024-09-19T09:07:01.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:01 smithi167 ceph-mon[35359]: pgmap v646: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 4.4 MiB/s wr, 592 op/s 2024-09-19T09:07:01.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:01 smithi190 ceph-mon[35358]: pgmap v646: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 4.4 MiB/s wr, 592 op/s 2024-09-19T09:07:02.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:01 smithi092 ceph-mon[31407]: pgmap v646: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 4.4 MiB/s wr, 592 op/s 2024-09-19T09:07:03.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:03 smithi167 ceph-mon[35359]: pgmap v647: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 6.8 MiB/s wr, 787 op/s 2024-09-19T09:07:03.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:03 smithi190 ceph-mon[35358]: pgmap v647: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 6.8 MiB/s wr, 787 op/s 2024-09-19T09:07:04.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:03 smithi092 ceph-mon[31407]: pgmap v647: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 6.8 MiB/s wr, 787 op/s 2024-09-19T09:07:04.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.961+0000 7f0498dbd640 1 -- 172.21.15.92:0/3371496121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0494107830 msgr2=0x7f0494109ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:04.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.961+0000 7f0498dbd640 1 --2- 172.21.15.92:0/3371496121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0494107830 0x7f0494109ca0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f048c009ca0 tx=0x7f048c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:07:04.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.962+0000 7f0498dbd640 1 -- 172.21.15.92:0/3371496121 shutdown_connections 2024-09-19T09:07:04.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.962+0000 7f0498dbd640 1 --2- 172.21.15.92:0/3371496121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0494107830 0x7f0494109ca0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:04.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.962+0000 7f0498dbd640 1 --2- 172.21.15.92:0/3371496121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0494104f00 0x7f04941072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:04.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.962+0000 7f0498dbd640 1 --2- 172.21.15.92:0/3371496121 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f04941025d0 0x7f04941049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:04.964 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.962+0000 7f0498dbd640 1 -- 172.21.15.92:0/3371496121 >> 172.21.15.92:0/3371496121 conn(0x7f04940fc1b0 msgr2=0x7f04940fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:04.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.962+0000 7f0498dbd640 1 -- 172.21.15.92:0/3371496121 shutdown_connections 2024-09-19T09:07:04.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.962+0000 7f0498dbd640 1 -- 172.21.15.92:0/3371496121 wait complete. 2024-09-19T09:07:04.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.963+0000 7f0498dbd640 1 Processor -- start 2024-09-19T09:07:04.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.963+0000 7f0498dbd640 1 -- start start 2024-09-19T09:07:04.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.963+0000 7f0498dbd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04941025d0 0x7f0494197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:04.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.963+0000 7f0498dbd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0494104f00 0x7f04941983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:04.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.963+0000 7f0498dbd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0494107830 0x7f049419f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:04.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.963+0000 7f0498dbd640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f049410d810 con 0x7f04941025d0 2024-09-19T09:07:04.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.963+0000 7f0498dbd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f049410d690 con 0x7f0494104f00 2024-09-19T09:07:04.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.963+0000 7f0498dbd640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f049410d990 con 0x7f0494107830 2024-09-19T09:07:04.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.963+0000 7f049259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04941025d0 0x7f0494197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:04.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.963+0000 7f049259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04941025d0 0x7f0494197e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33850/0 (socket says 172.21.15.92:33850) 2024-09-19T09:07:04.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.963+0000 7f049259c640 1 -- 172.21.15.92:0/973733293 learned_addr learned my addr 172.21.15.92:0/973733293 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:04.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.963+0000 7f0491d9b640 1 --2- 172.21.15.92:0/973733293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0494104f00 0x7f04941983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:04.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.964+0000 7f0492d9d640 1 --2- 172.21.15.92:0/973733293 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0494107830 0x7f049419f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:04.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.964+0000 7f0492d9d640 1 -- 172.21.15.92:0/973733293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0494104f00 msgr2=0x7f04941983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:04.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.964+0000 7f0492d9d640 1 --2- 172.21.15.92:0/973733293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0494104f00 0x7f04941983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:04.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.964+0000 7f0492d9d640 1 -- 172.21.15.92:0/973733293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04941025d0 msgr2=0x7f0494197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:04.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.964+0000 7f0492d9d640 1 --2- 172.21.15.92:0/973733293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04941025d0 0x7f0494197e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:04.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.964+0000 7f0492d9d640 1 -- 172.21.15.92:0/973733293 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f049419fa80 con 0x7f0494107830 2024-09-19T09:07:04.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.964+0000 7f0492d9d640 1 --2- 172.21.15.92:0/973733293 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0494107830 0x7f049419f410 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f048c02ade0 tx=0x7f048c004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:04.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.964+0000 7f04837fe640 1 -- 172.21.15.92:0/973733293 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c04b070 con 0x7f0494107830 2024-09-19T09:07:04.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.965+0000 7f0498dbd640 1 -- 172.21.15.92:0/973733293 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04941003c0 con 0x7f0494107830 2024-09-19T09:07:04.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.965+0000 7f04837fe640 1 -- 172.21.15.92:0/973733293 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f048c03cc00 con 0x7f0494107830 2024-09-19T09:07:04.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.965+0000 7f04837fe640 1 -- 172.21.15.92:0/973733293 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c004550 con 0x7f0494107830 2024-09-19T09:07:04.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.965+0000 7f0498dbd640 1 -- 172.21.15.92:0/973733293 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0494100930 con 0x7f0494107830 2024-09-19T09:07:04.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.967+0000 7f04837fe640 1 -- 172.21.15.92:0/973733293 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f048c04e070 con 0x7f0494107830 2024-09-19T09:07:04.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.967+0000 7f049bc32740 1 Processor -- start 2024-09-19T09:07:04.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.967+0000 7f049bc32740 1 -- start start 2024-09-19T09:07:04.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.967+0000 7f049bc32740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6230de9a0 0x55e6230deda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:04.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.967+0000 7f049bc32740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6230df2e0 0x55e6230e3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:04.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.967+0000 7f049bc32740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6230e4370 0x55e6230e6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:04.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.968+0000 7f049bc32740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e6230422f0 con 0x55e6230e4370 2024-09-19T09:07:04.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.968+0000 7f049bc32740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e622fea270 con 0x55e6230df2e0 2024-09-19T09:07:04.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.968+0000 7f049bc32740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e62303e2b0 con 0x55e6230de9a0 2024-09-19T09:07:04.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.968+0000 7f0491d9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6230de9a0 0x55e6230deda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:04.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.968+0000 7f049259c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6230df2e0 0x55e6230e3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:04.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.968+0000 7f049259c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6230df2e0 0x55e6230e3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:41194/0 (socket says 172.21.15.92:41194) 2024-09-19T09:07:04.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.968+0000 7f049259c640 1 -- 172.21.15.92:0/969536297 learned_addr learned my addr 172.21.15.92:0/969536297 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:04.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.968+0000 7f0491d9b640 1 --2- 172.21.15.92:0/969536297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6230e4370 0x55e6230e6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:04.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.968+0000 7f04837fe640 1 --2- 172.21.15.92:0/973733293 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f047c0a3370 0x7f047c0a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:04.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.968+0000 7f0491d9b640 1 -- 172.21.15.92:0/969536297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6230df2e0 msgr2=0x55e6230e3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:04.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.968+0000 7f0491d9b640 1 --2- 172.21.15.92:0/969536297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6230df2e0 0x55e6230e3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:04.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.969+0000 7f0491d9b640 1 -- 172.21.15.92:0/969536297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6230e4370 msgr2=0x55e6230e6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:04.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.969+0000 7f0491d9b640 1 --2- 172.21.15.92:0/969536297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6230e4370 0x55e6230e6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:04.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.969+0000 7f0491d9b640 1 -- 172.21.15.92:0/969536297 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e622fe9340 con 0x55e6230de9a0 2024-09-19T09:07:04.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.969+0000 7f04837fe640 1 -- 172.21.15.92:0/973733293 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f048c0f3fb0 con 0x7f0494107830 2024-09-19T09:07:04.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.969+0000 7f0492d9d640 1 --2- 172.21.15.92:0/973733293 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f047c0a3370 0x7f047c0a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:04.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.969+0000 7f0491d9b640 1 --2- 172.21.15.92:0/969536297 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6230de9a0 0x55e6230deda0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0494199370 tx=0x7f0488005850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c83e6f6a5512d087 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:04.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.970+0000 7f0480ff9640 1 -- 172.21.15.92:0/969536297 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0488005220 con 0x55e6230de9a0 2024-09-19T09:07:04.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.970+0000 7f0480ff9640 1 -- 172.21.15.92:0/969536297 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0488004c80 con 0x55e6230de9a0 2024-09-19T09:07:04.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.970+0000 7f0480ff9640 1 -- 172.21.15.92:0/969536297 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0488011960 con 0x55e6230de9a0 2024-09-19T09:07:04.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.971+0000 7f049bc32740 1 -- 172.21.15.92:0/969536297 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6230de9a0 msgr2=0x55e6230deda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:04.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.971+0000 7f0492d9d640 1 --2- 172.21.15.92:0/973733293 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f047c0a3370 0x7f047c0a5830 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f048c0c8d10 tx=0x7f048c004050 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:04.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.971+0000 7f049bc32740 1 --2- 172.21.15.92:0/969536297 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6230de9a0 0x55e6230deda0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0494199370 tx=0x7f0488005850 comp rx=0 tx=0).stop 2024-09-19T09:07:04.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.971+0000 7f049bc32740 1 -- 172.21.15.92:0/969536297 shutdown_connections 2024-09-19T09:07:04.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.971+0000 7f049bc32740 1 --2- 172.21.15.92:0/969536297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6230e4370 0x55e6230e6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:04.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.971+0000 7f049bc32740 1 --2- 172.21.15.92:0/969536297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6230df2e0 0x55e6230e3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:04.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.971+0000 7f049bc32740 1 --2- 172.21.15.92:0/969536297 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6230de9a0 0x55e6230deda0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:04.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.971+0000 7f049bc32740 1 -- 172.21.15.92:0/969536297 >> 172.21.15.92:0/969536297 conn(0x55e6230da010 msgr2=0x55e6230da410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:04.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.971+0000 7f049bc32740 1 -- 172.21.15.92:0/969536297 shutdown_connections 2024-09-19T09:07:04.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.971+0000 7f049bc32740 1 -- 172.21.15.92:0/969536297 wait complete. 2024-09-19T09:07:04.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.971+0000 7f049bc32740 1 -- start start 2024-09-19T09:07:04.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.972+0000 7f049bc32740 1 Processor -- start 2024-09-19T09:07:04.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.972+0000 7f049bc32740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6230de9a0 0x55e6230e8c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:04.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.972+0000 7f049bc32740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6230df2e0 0x55e6230e9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:04.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.972+0000 7f049bc32740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6230e4370 0x55e6230f01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:04.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.972+0000 7f049bc32740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e6230e7340 con 0x55e6230de9a0 2024-09-19T09:07:04.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.972+0000 7f049bc32740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e622fcb290 con 0x55e6230e4370 2024-09-19T09:07:04.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.972+0000 7f049bc32740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e6230e74c0 con 0x55e6230df2e0 2024-09-19T09:07:04.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.972+0000 7f049bc32740 10 client.0 _ll_register_callbacks cb 0x55e622ffc140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:04.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.972+0000 7f0491d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6230de9a0 0x55e6230e8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:04.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.972+0000 7f0491d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6230de9a0 0x55e6230e8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33864/0 (socket says 172.21.15.92:33864) 2024-09-19T09:07:04.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.972+0000 7f0491d9b640 1 -- 172.21.15.92:0/1113279588 learned_addr learned my addr 172.21.15.92:0/1113279588 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:04.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.972+0000 7f0491d9b640 1 --2- 172.21.15.92:0/1113279588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6230e4370 0x55e6230f01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:04.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.973+0000 7f0491d9b640 1 -- 172.21.15.92:0/1113279588 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6230df2e0 msgr2=0x55e6230e9160 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:07:04.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.973+0000 7f0491d9b640 1 --2- 172.21.15.92:0/1113279588 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6230df2e0 0x55e6230e9160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:04.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.973+0000 7f0491d9b640 1 -- 172.21.15.92:0/1113279588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6230e4370 msgr2=0x55e6230f01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:04.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.973+0000 7f0491d9b640 1 --2- 172.21.15.92:0/1113279588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6230e4370 0x55e6230f01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:04.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.973+0000 7f0491d9b640 1 -- 172.21.15.92:0/1113279588 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e622d55210 con 0x55e6230de9a0 2024-09-19T09:07:04.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.973+0000 7f0491d9b640 1 --2- 172.21.15.92:0/1113279588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6230de9a0 0x55e6230e8c20 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f0488016020 tx=0x7f0488009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b72fee5e7ad80be9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:04.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.973+0000 7f0479ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:07:04.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.973+0000 7f0479ffb640 1 -- 172.21.15.92:0/1113279588 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0488005210 con 0x55e6230de9a0 2024-09-19T09:07:04.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.973+0000 7f049bc32740 1 -- 172.21.15.92:0/1113279588 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0488004c80 con 0x55e6230de9a0 2024-09-19T09:07:04.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.973+0000 7f0479ffb640 1 -- 172.21.15.92:0/1113279588 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f04880053b0 con 0x55e6230de9a0 2024-09-19T09:07:04.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.973+0000 7f0479ffb640 1 -- 172.21.15.92:0/1113279588 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f04880055b0 con 0x55e6230de9a0 2024-09-19T09:07:04.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.973+0000 7f049bc32740 10 client.17943 fetch_fsmap learned FSMap version 19 2024-09-19T09:07:04.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.973+0000 7f049bc32740 1 -- 172.21.15.92:0/1113279588 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e622e21620 con 0x55e6230de9a0 2024-09-19T09:07:04.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.973+0000 7f0479ffb640 1 -- 172.21.15.92:0/1113279588 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0488004c80 con 0x55e6230de9a0 2024-09-19T09:07:04.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.974+0000 7f0479ffb640 1 -- 172.21.15.92:0/1113279588 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f0488035020 con 0x55e6230de9a0 2024-09-19T09:07:04.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.974+0000 7f049bc32740 10 client.17943 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:07:04.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.974+0000 7f049bc32740 10 client.17943 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:07:04.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.974+0000 7f049bc32740 20 client.17943 populate_metadata read hostname 'smithi092' 2024-09-19T09:07:04.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.974+0000 7f049bc32740 1 --2- 172.21.15.92:0/1113279588 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e623105d30 0x55e6231081b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:04.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.974+0000 7f049bc32740 4 client.17943 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:07:04.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.974+0000 7f049bc32740 1 -- 172.21.15.92:0/1113279588 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e62304fa20 con 0x55e623105d30 2024-09-19T09:07:04.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.974+0000 7f049259c640 1 --2- 172.21.15.92:0/1113279588 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e623105d30 0x55e6231081b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:04.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.974+0000 7f0479ffb640 10 client.17943 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:07:04.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.974+0000 7f049259c640 1 --2- 172.21.15.92:0/1113279588 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e623105d30 0x55e6231081b0 crc :-1 s=READY pgs=331 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdb38d9cd761a9df server_cookie=3608b7581457c229 in_seq=0 out_seq=0 2024-09-19T09:07:04.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.975+0000 7f0479ffb640 1 -- 172.21.15.92:0/1113279588 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e62304fa20 con 0x55e623105d30 2024-09-19T09:07:04.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.975+0000 7f0479ffb640 10 client.17943 handle_command_reply: tid=0 2024-09-19T09:07:04.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.975+0000 7f049bc32740 1 client.17943 shutdown 2024-09-19T09:07:04.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.975+0000 7f049bc32740 1 -- 172.21.15.92:0/1113279588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6230de9a0 msgr2=0x55e6230e8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:04.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.975+0000 7f049bc32740 1 --2- 172.21.15.92:0/1113279588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6230de9a0 0x55e6230e8c20 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f0488016020 tx=0x7f0488009640 comp rx=0 tx=0).stop 2024-09-19T09:07:04.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.975+0000 7f049bc32740 1 -- 172.21.15.92:0/1113279588 shutdown_connections 2024-09-19T09:07:04.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.975+0000 7f049bc32740 1 --2- 172.21.15.92:0/1113279588 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e623105d30 0x55e6231081b0 crc :-1 s=READY pgs=331 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:04.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.975+0000 7f049bc32740 1 --2- 172.21.15.92:0/1113279588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6230e4370 0x55e6230f01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:04.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.975+0000 7f049bc32740 1 --2- 172.21.15.92:0/1113279588 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6230df2e0 0x55e6230e9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:04.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.975+0000 7f0479ffb640 0 client.17943 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:07:04.981 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.975+0000 7f049bc32740 1 --2- 172.21.15.92:0/1113279588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6230de9a0 0x55e6230e8c20 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:04.981 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.975+0000 7f049bc32740 1 -- 172.21.15.92:0/1113279588 >> 172.21.15.92:0/1113279588 conn(0x55e6230da010 msgr2=0x55e6230db820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:04.981 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.977+0000 7f049bc32740 1 -- 172.21.15.92:0/1113279588 shutdown_connections 2024-09-19T09:07:04.981 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.977+0000 7f049bc32740 1 -- 172.21.15.92:0/1113279588 wait complete. 2024-09-19T09:07:04.981 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.977+0000 7f049bc32740 20 client.17943 trim_cache size 0 max 16384 2024-09-19T09:07:04.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.996+0000 7f049bc32740 1 Processor -- start 2024-09-19T09:07:04.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.996+0000 7f049bc32740 1 -- start start 2024-09-19T09:07:04.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.997+0000 7f049bc32740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6230de9a0 0x55e6230e90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:04.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.997+0000 7f049bc32740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6230df2e0 0x55e6230f0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:04.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.997+0000 7f049bc32740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6230e4370 0x55e6230daec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:04.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.997+0000 7f049bc32740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0494070d20 con 0x55e6230e4370 2024-09-19T09:07:04.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.997+0000 7f049bc32740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f04940735c0 con 0x55e6230df2e0 2024-09-19T09:07:04.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.997+0000 7f049bc32740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f04940713b0 con 0x55e6230de9a0 2024-09-19T09:07:05.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.997+0000 7f049259c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6230df2e0 0x55e6230f0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:05.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.997+0000 7f049259c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6230df2e0 0x55e6230f0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:41200/0 (socket says 172.21.15.92:41200) 2024-09-19T09:07:05.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.997+0000 7f049259c640 1 -- 172.21.15.92:0/3257899942 learned_addr learned my addr 172.21.15.92:0/3257899942 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:05.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.997+0000 7f0491d9b640 1 --2- 172.21.15.92:0/3257899942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6230de9a0 0x55e6230e90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:05.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.998+0000 7f0491d9b640 1 --2- 172.21.15.92:0/3257899942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6230e4370 0x55e6230daec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:05.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.998+0000 7f0491d9b640 1 -- 172.21.15.92:0/3257899942 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6230df2e0 msgr2=0x55e6230f0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:05.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.998+0000 7f0491d9b640 1 --2- 172.21.15.92:0/3257899942 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6230df2e0 0x55e6230f0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.998+0000 7f0491d9b640 1 -- 172.21.15.92:0/3257899942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6230e4370 msgr2=0x55e6230daec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:05.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.998+0000 7f0491d9b640 1 --2- 172.21.15.92:0/3257899942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6230e4370 0x55e6230daec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.998+0000 7f0491d9b640 1 -- 172.21.15.92:0/3257899942 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6230e8760 con 0x55e6230de9a0 2024-09-19T09:07:05.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.998+0000 7f0491d9b640 1 --2- 172.21.15.92:0/3257899942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6230de9a0 0x55e6230e90e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0488006010 tx=0x7f0488005970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82687a6f28dc8265 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:05.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.998+0000 7f047bfff640 1 -- 172.21.15.92:0/3257899942 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0488009940 con 0x55e6230de9a0 2024-09-19T09:07:05.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.999+0000 7f047bfff640 1 -- 172.21.15.92:0/3257899942 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f048803e040 con 0x55e6230de9a0 2024-09-19T09:07:05.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:04.999+0000 7f047bfff640 1 -- 172.21.15.92:0/3257899942 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0488003d50 con 0x55e6230de9a0 2024-09-19T09:07:05.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.000+0000 7f049bc32740 1 -- 172.21.15.92:0/3257899942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6230de9a0 msgr2=0x55e6230e90e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:05.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.000+0000 7f049bc32740 1 --2- 172.21.15.92:0/3257899942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6230de9a0 0x55e6230e90e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0488006010 tx=0x7f0488005970 comp rx=0 tx=0).stop 2024-09-19T09:07:05.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.000+0000 7f049bc32740 1 -- 172.21.15.92:0/3257899942 shutdown_connections 2024-09-19T09:07:05.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.000+0000 7f049bc32740 1 --2- 172.21.15.92:0/3257899942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6230e4370 0x55e6230daec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.000+0000 7f049bc32740 1 --2- 172.21.15.92:0/3257899942 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6230df2e0 0x55e6230f0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.000+0000 7f049bc32740 1 --2- 172.21.15.92:0/3257899942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6230de9a0 0x55e6230e90e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.000+0000 7f049bc32740 1 -- 172.21.15.92:0/3257899942 >> 172.21.15.92:0/3257899942 conn(0x55e6230da010 msgr2=0x55e6230e89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:05.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.000+0000 7f049bc32740 1 -- 172.21.15.92:0/3257899942 shutdown_connections 2024-09-19T09:07:05.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.000+0000 7f049bc32740 1 -- 172.21.15.92:0/3257899942 wait complete. 2024-09-19T09:07:05.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.000+0000 7f049bc32740 1 -- start start 2024-09-19T09:07:05.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.000+0000 7f049bc32740 1 Processor -- start 2024-09-19T09:07:05.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.000+0000 7f049bc32740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6230de9a0 0x55e6230ed250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:05.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.000+0000 7f049bc32740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6230df2e0 0x55e6230ed790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:05.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.000+0000 7f049bc32740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6230e4370 0x55e6230ee7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:05.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.000+0000 7f049bc32740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0494071a80 con 0x55e6230df2e0 2024-09-19T09:07:05.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.000+0000 7f049bc32740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0494072ef0 con 0x55e6230de9a0 2024-09-19T09:07:05.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.000+0000 7f049bc32740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0494072150 con 0x55e6230e4370 2024-09-19T09:07:05.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.001+0000 7f049bc32740 10 client.0 _ll_register_callbacks cb 0x7f0484009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:05.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.001+0000 7f049259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6230df2e0 0x55e6230ed790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:05.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.001+0000 7f0491d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6230de9a0 0x55e6230ed250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:05.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.001+0000 7f0491d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6230de9a0 0x55e6230ed250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:41210/0 (socket says 172.21.15.92:41210) 2024-09-19T09:07:05.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.001+0000 7f049259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6230df2e0 0x55e6230ed790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33892/0 (socket says 172.21.15.92:33892) 2024-09-19T09:07:05.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.001+0000 7f0491d9b640 1 -- 172.21.15.92:0/2334903353 learned_addr learned my addr 172.21.15.92:0/2334903353 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:05.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.001+0000 7f0491d9b640 1 --2- 172.21.15.92:0/2334903353 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6230e4370 0x55e6230ee7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:05.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.001+0000 7f0491d9b640 1 -- 172.21.15.92:0/2334903353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6230de9a0 msgr2=0x55e6230ed250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:05.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.001+0000 7f0491d9b640 1 --2- 172.21.15.92:0/2334903353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6230de9a0 0x55e6230ed250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.001+0000 7f0491d9b640 1 -- 172.21.15.92:0/2334903353 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6230df2e0 msgr2=0x55e6230ed790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:05.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.001+0000 7f0491d9b640 1 --2- 172.21.15.92:0/2334903353 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6230df2e0 0x55e6230ed790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.001+0000 7f0491d9b640 1 -- 172.21.15.92:0/2334903353 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e623108830 con 0x55e6230e4370 2024-09-19T09:07:05.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.001+0000 7f049259c640 1 --2- 172.21.15.92:0/2334903353 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6230df2e0 0x55e6230ed790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:05.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.001+0000 7f0491d9b640 1 --2- 172.21.15.92:0/2334903353 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6230e4370 0x55e6230ee7a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x55e6230ec820 tx=0x7f04880096f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da18863517c79c2b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:05.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.001+0000 7f0479ffb640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:07:05.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.001+0000 7f0479ffb640 1 -- 172.21.15.92:0/2334903353 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0488009940 con 0x55e6230e4370 2024-09-19T09:07:05.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.001+0000 7f0479ffb640 1 -- 172.21.15.92:0/2334903353 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f04880053b0 con 0x55e6230e4370 2024-09-19T09:07:05.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.001+0000 7f049bc32740 1 -- 172.21.15.92:0/2334903353 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f048803e040 con 0x55e6230e4370 2024-09-19T09:07:05.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.001+0000 7f0479ffb640 1 -- 172.21.15.92:0/2334903353 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f0488009d80 con 0x55e6230e4370 2024-09-19T09:07:05.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.001+0000 7f049bc32740 10 client.27103 fetch_fsmap learned FSMap version 19 2024-09-19T09:07:05.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.001+0000 7f049bc32740 1 -- 172.21.15.92:0/2334903353 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e6230efef0 con 0x55e6230e4370 2024-09-19T09:07:05.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.002+0000 7f0479ffb640 1 -- 172.21.15.92:0/2334903353 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f048803e040 con 0x55e6230e4370 2024-09-19T09:07:05.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.002+0000 7f0479ffb640 1 -- 172.21.15.92:0/2334903353 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f0488035070 con 0x55e6230e4370 2024-09-19T09:07:05.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.002+0000 7f049bc32740 10 client.27103 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:07:05.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.002+0000 7f049bc32740 10 client.27103 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:07:05.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.002+0000 7f049bc32740 20 client.27103 populate_metadata read hostname 'smithi092' 2024-09-19T09:07:05.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.002+0000 7f049bc32740 1 --2- 172.21.15.92:0/2334903353 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e623170b00 0x55e623172f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:05.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.002+0000 7f049bc32740 4 client.27103 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:07:05.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.002+0000 7f049bc32740 1 -- 172.21.15.92:0/2334903353 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e623049d70 con 0x55e623170b00 2024-09-19T09:07:05.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.003+0000 7f049259c640 1 --2- 172.21.15.92:0/2334903353 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e623170b00 0x55e623172f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:05.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.003+0000 7f0479ffb640 10 client.27103 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:07:05.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.003+0000 7f049259c640 1 --2- 172.21.15.92:0/2334903353 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e623170b00 0x55e623172f20 crc :-1 s=READY pgs=332 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0ef1c1fc085e80e server_cookie=c4505860dc764740 in_seq=0 out_seq=0 2024-09-19T09:07:05.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.030+0000 7f0479ffb640 1 -- 172.21.15.92:0/2334903353 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e623049d70 con 0x55e623170b00 2024-09-19T09:07:05.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.030+0000 7f0479ffb640 10 client.27103 handle_command_reply: tid=0 2024-09-19T09:07:05.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.031+0000 7f049bc32740 1 client.27103 shutdown 2024-09-19T09:07:05.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.031+0000 7f049bc32740 1 -- 172.21.15.92:0/2334903353 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6230e4370 msgr2=0x55e6230ee7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:05.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.031+0000 7f049bc32740 1 --2- 172.21.15.92:0/2334903353 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6230e4370 0x55e6230ee7a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x55e6230ec820 tx=0x7f04880096f0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.031+0000 7f049bc32740 1 -- 172.21.15.92:0/2334903353 shutdown_connections 2024-09-19T09:07:05.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.031+0000 7f049bc32740 1 --2- 172.21.15.92:0/2334903353 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e623170b00 0x55e623172f20 crc :-1 s=READY pgs=332 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.031+0000 7f049bc32740 1 --2- 172.21.15.92:0/2334903353 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6230e4370 0x55e6230ee7a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.031+0000 7f0479ffb640 0 client.27103 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:07:05.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.031+0000 7f049bc32740 1 --2- 172.21.15.92:0/2334903353 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6230df2e0 0x55e6230ed790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.031+0000 7f049bc32740 1 --2- 172.21.15.92:0/2334903353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6230de9a0 0x55e6230ed250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.034 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.031+0000 7f049bc32740 1 -- 172.21.15.92:0/2334903353 >> 172.21.15.92:0/2334903353 conn(0x55e6230da010 msgr2=0x55e6230d89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:05.034 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.031+0000 7f049bc32740 1 -- 172.21.15.92:0/2334903353 shutdown_connections 2024-09-19T09:07:05.034 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.031+0000 7f049bc32740 1 -- 172.21.15.92:0/2334903353 wait complete. 2024-09-19T09:07:05.034 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.031+0000 7f049bc32740 20 client.27103 trim_cache size 0 max 16384 2024-09-19T09:07:05.034 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:07:05.034 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:07:05.034 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:07:05.034 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:07:05.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.033+0000 7f0498dbd640 1 -- 172.21.15.92:0/973733293 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f047c0a3370 msgr2=0x7f047c0a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:05.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.033+0000 7f0498dbd640 1 --2- 172.21.15.92:0/973733293 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f047c0a3370 0x7f047c0a5830 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f048c0c8d10 tx=0x7f048c004050 comp rx=0 tx=0).stop 2024-09-19T09:07:05.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.033+0000 7f0498dbd640 1 -- 172.21.15.92:0/973733293 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0494107830 msgr2=0x7f049419f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:05.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.033+0000 7f0498dbd640 1 --2- 172.21.15.92:0/973733293 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0494107830 0x7f049419f410 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f048c02ade0 tx=0x7f048c004ab0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.033+0000 7f0498dbd640 1 -- 172.21.15.92:0/973733293 shutdown_connections 2024-09-19T09:07:05.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.033+0000 7f0498dbd640 1 --2- 172.21.15.92:0/973733293 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0494107830 0x7f049419f410 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.033+0000 7f0498dbd640 1 --2- 172.21.15.92:0/973733293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0494104f00 0x7f04941983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.033+0000 7f0498dbd640 1 --2- 172.21.15.92:0/973733293 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f047c0a3370 0x7f047c0a5830 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.033+0000 7f0498dbd640 1 --2- 172.21.15.92:0/973733293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04941025d0 0x7f0494197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.033+0000 7f0498dbd640 1 -- 172.21.15.92:0/973733293 >> 172.21.15.92:0/973733293 conn(0x7f04940fc1b0 msgr2=0x7f0494102f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:05.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.033+0000 7f0498dbd640 1 -- 172.21.15.92:0/973733293 shutdown_connections 2024-09-19T09:07:05.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:05.033+0000 7f0498dbd640 1 -- 172.21.15.92:0/973733293 wait complete. 2024-09-19T09:07:05.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 620.0 s, 2939.0 tps, lat 34.179 ms stddev 41.742 2024-09-19T09:07:05.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:05 smithi167 ceph-mon[35359]: pgmap v648: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 9.5 MiB/s wr, 959 op/s 2024-09-19T09:07:05.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:05 smithi190 ceph-mon[35358]: pgmap v648: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 9.5 MiB/s wr, 959 op/s 2024-09-19T09:07:05.889 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:05 smithi092 ceph-mon[31407]: pgmap v648: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 9.5 MiB/s wr, 959 op/s 2024-09-19T09:07:06.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:06 smithi092 ceph-mon[31407]: pgmap v649: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 11 MiB/s wr, 1.06k op/s 2024-09-19T09:07:06.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:06 smithi167 ceph-mon[35359]: pgmap v649: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 11 MiB/s wr, 1.06k op/s 2024-09-19T09:07:06.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:06 smithi190 ceph-mon[35358]: pgmap v649: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 11 MiB/s wr, 1.06k op/s 2024-09-19T09:07:09.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:09 smithi092 ceph-mon[31407]: pgmap v650: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 12 MiB/s wr, 1.16k op/s 2024-09-19T09:07:09.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:09 smithi167 ceph-mon[35359]: pgmap v650: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 12 MiB/s wr, 1.16k op/s 2024-09-19T09:07:09.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:09 smithi190 ceph-mon[35358]: pgmap v650: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 12 MiB/s wr, 1.16k op/s 2024-09-19T09:07:10.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 625.0 s, 2997.6 tps, lat 33.049 ms stddev 38.790 2024-09-19T09:07:11.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:11 smithi167 ceph-mon[35359]: pgmap v651: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 11 MiB/s wr, 1.01k op/s 2024-09-19T09:07:11.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:11 smithi190 ceph-mon[35358]: pgmap v651: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 11 MiB/s wr, 1.01k op/s 2024-09-19T09:07:12.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:11 smithi092 ceph-mon[31407]: pgmap v651: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 11 MiB/s wr, 1.01k op/s 2024-09-19T09:07:13.665 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:13 smithi092 ceph-mon[31407]: pgmap v652: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 11 MiB/s wr, 913 op/s 2024-09-19T09:07:13.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:13 smithi167 ceph-mon[35359]: pgmap v652: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 11 MiB/s wr, 913 op/s 2024-09-19T09:07:13.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:13 smithi190 ceph-mon[35358]: pgmap v652: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 11 MiB/s wr, 913 op/s 2024-09-19T09:07:15.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 630.0 s, 2227.4 tps, lat 44.969 ms stddev 51.070 2024-09-19T09:07:15.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:15 smithi167 ceph-mon[35359]: pgmap v653: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 11 MiB/s wr, 815 op/s 2024-09-19T09:07:15.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:15 smithi190 ceph-mon[35358]: pgmap v653: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 11 MiB/s wr, 815 op/s 2024-09-19T09:07:16.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:15 smithi092 ceph-mon[31407]: pgmap v653: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 11 MiB/s wr, 815 op/s 2024-09-19T09:07:17.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:17 smithi167 ceph-mon[35359]: pgmap v654: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 9.1 MiB/s wr, 706 op/s 2024-09-19T09:07:17.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:17 smithi190 ceph-mon[35358]: pgmap v654: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 9.1 MiB/s wr, 706 op/s 2024-09-19T09:07:18.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:17 smithi092 ceph-mon[31407]: pgmap v654: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 9.1 MiB/s wr, 706 op/s 2024-09-19T09:07:18.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.179+0000 7f3e0856f640 1 -- 172.21.15.92:0/81359228 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e00101b60 msgr2=0x7f3e00101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:18.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.179+0000 7f3e0856f640 1 --2- 172.21.15.92:0/81359228 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e00101b60 0x7f3e00101f60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc009900 tx=0x7f3dfc02a400 comp rx=0 tx=0).stop 2024-09-19T09:07:18.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.179+0000 7f3e0856f640 1 -- 172.21.15.92:0/81359228 shutdown_connections 2024-09-19T09:07:18.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.179+0000 7f3e0856f640 1 --2- 172.21.15.92:0/81359228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e00103710 0x7f3e00109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:18.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.179+0000 7f3e0856f640 1 --2- 172.21.15.92:0/81359228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e00102d50 0x7f3e001031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:18.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.179+0000 7f3e0856f640 1 --2- 172.21.15.92:0/81359228 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e00101b60 0x7f3e00101f60 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:18.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.179+0000 7f3e0856f640 1 -- 172.21.15.92:0/81359228 >> 172.21.15.92:0/81359228 conn(0x7f3e000fd2e0 msgr2=0x7f3e000ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:18.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.179+0000 7f3e0856f640 1 -- 172.21.15.92:0/81359228 shutdown_connections 2024-09-19T09:07:18.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.179+0000 7f3e0856f640 1 -- 172.21.15.92:0/81359228 wait complete. 2024-09-19T09:07:18.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.180+0000 7f3e0856f640 1 Processor -- start 2024-09-19T09:07:18.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.180+0000 7f3e0856f640 1 -- start start 2024-09-19T09:07:18.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.180+0000 7f3e0856f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e00101b60 0x7f3e00197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:18.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.180+0000 7f3e0856f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e00102d50 0x7f3e00198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:18.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.181+0000 7f3e0856f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e00103710 0x7f3e0019f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:18.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.181+0000 7f3e0856f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0010d810 con 0x7f3e00101b60 2024-09-19T09:07:18.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.181+0000 7f3e0856f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0010d690 con 0x7f3e00103710 2024-09-19T09:07:18.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.181+0000 7f3e0856f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0010d990 con 0x7f3e00102d50 2024-09-19T09:07:18.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.181+0000 7f3e0630b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e00101b60 0x7f3e00197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:18.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.181+0000 7f3e05b0a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e00102d50 0x7f3e00198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:18.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.181+0000 7f3e0630b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e00101b60 0x7f3e00197e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44386/0 (socket says 172.21.15.92:44386) 2024-09-19T09:07:18.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.181+0000 7f3e0630b640 1 -- 172.21.15.92:0/4098370662 learned_addr learned my addr 172.21.15.92:0/4098370662 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:18.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.181+0000 7f3e06b0c640 1 --2- 172.21.15.92:0/4098370662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e00103710 0x7f3e0019f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:18.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.181+0000 7f3e0630b640 1 -- 172.21.15.92:0/4098370662 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e00102d50 msgr2=0x7f3e00198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:18.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.181+0000 7f3e0630b640 1 --2- 172.21.15.92:0/4098370662 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e00102d50 0x7f3e00198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:18.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.181+0000 7f3e0630b640 1 -- 172.21.15.92:0/4098370662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e00103710 msgr2=0x7f3e0019f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:18.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.181+0000 7f3e0630b640 1 --2- 172.21.15.92:0/4098370662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e00103710 0x7f3e0019f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:18.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.181+0000 7f3e0630b640 1 -- 172.21.15.92:0/4098370662 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e0019fa20 con 0x7f3e00101b60 2024-09-19T09:07:18.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.181+0000 7f3e0630b640 1 --2- 172.21.15.92:0/4098370662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e00101b60 0x7f3e00197e00 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc031440 tx=0x7f3dfc032e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:18.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.181+0000 7f3df77fe640 1 -- 172.21.15.92:0/4098370662 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc03f030 con 0x7f3e00101b60 2024-09-19T09:07:18.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.182+0000 7f3df77fe640 1 -- 172.21.15.92:0/4098370662 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dfc003ce0 con 0x7f3e00101b60 2024-09-19T09:07:18.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.182+0000 7f3df77fe640 1 -- 172.21.15.92:0/4098370662 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc035070 con 0x7f3e00101b60 2024-09-19T09:07:18.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.183+0000 7f3e0856f640 1 -- 172.21.15.92:0/4098370662 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e0019fcb0 con 0x7f3e00101b60 2024-09-19T09:07:18.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.183+0000 7f3e0856f640 1 -- 172.21.15.92:0/4098370662 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e001a0150 con 0x7f3e00101b60 2024-09-19T09:07:18.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.186+0000 7f3e0b3e1740 1 Processor -- start 2024-09-19T09:07:18.187 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.186+0000 7f3df77fe640 1 -- 172.21.15.92:0/4098370662 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3dfc042030 con 0x7f3e00101b60 2024-09-19T09:07:18.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.187+0000 7f3e0b3e1740 1 -- start start 2024-09-19T09:07:18.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.187+0000 7f3e0b3e1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d108dbd9a0 0x55d108dbdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:18.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.187+0000 7f3e0b3e1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d108dbe2e0 0x55d108dcd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:18.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.187+0000 7f3e0b3e1740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d108dcdbc0 0x55d108dd0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:18.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.187+0000 7f3e0b3e1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d108d232f0 con 0x55d108dbd9a0 2024-09-19T09:07:18.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.187+0000 7f3e0b3e1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d108ccb270 con 0x55d108dbe2e0 2024-09-19T09:07:18.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.187+0000 7f3e0b3e1740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55d108d1f2b0 con 0x55d108dcdbc0 2024-09-19T09:07:18.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.187+0000 7f3e05b0a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d108dcdbc0 0x55d108dd0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:18.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.188+0000 7f3e05b0a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d108dcdbc0 0x55d108dd0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:55910/0 (socket says 172.21.15.92:55910) 2024-09-19T09:07:18.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.188+0000 7f3e0630b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d108dbe2e0 0x55d108dcd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:18.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.188+0000 7f3e05b0a640 1 -- 172.21.15.92:0/865790669 learned_addr learned my addr 172.21.15.92:0/865790669 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:18.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.188+0000 7f3e06b0c640 1 --2- 172.21.15.92:0/865790669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d108dbd9a0 0x55d108dbdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:18.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.188+0000 7f3e05b0a640 1 -- 172.21.15.92:0/865790669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d108dbe2e0 msgr2=0x55d108dcd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:18.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.188+0000 7f3e05b0a640 1 --2- 172.21.15.92:0/865790669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d108dbe2e0 0x55d108dcd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:18.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.188+0000 7f3e05b0a640 1 -- 172.21.15.92:0/865790669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d108dbd9a0 msgr2=0x55d108dbdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:18.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.188+0000 7f3e05b0a640 1 --2- 172.21.15.92:0/865790669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d108dbd9a0 0x55d108dbdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:18.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.188+0000 7f3e05b0a640 1 -- 172.21.15.92:0/865790669 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d108cca340 con 0x55d108dcdbc0 2024-09-19T09:07:18.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.188+0000 7f3df77fe640 1 --2- 172.21.15.92:0/4098370662 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3dec0a3370 0x7f3dec0a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:18.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.188+0000 7f3e05b0a640 1 --2- 172.21.15.92:0/865790669 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d108dcdbc0 0x55d108dd0030 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3df000bcb0 tx=0x7f3df00107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=157dc47791e448bd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:18.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.188+0000 7f3df4bfe640 1 -- 172.21.15.92:0/865790669 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df0004030 con 0x55d108dcdbc0 2024-09-19T09:07:18.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.189+0000 7f3df4bfe640 1 -- 172.21.15.92:0/865790669 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3df00041d0 con 0x55d108dcdbc0 2024-09-19T09:07:18.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.189+0000 7f3df4bfe640 1 -- 172.21.15.92:0/865790669 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df00116e0 con 0x55d108dcdbc0 2024-09-19T09:07:18.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.189+0000 7f3df77fe640 1 -- 172.21.15.92:0/4098370662 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3dfc0efc00 con 0x7f3e00101b60 2024-09-19T09:07:18.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.189+0000 7f3e06b0c640 1 --2- 172.21.15.92:0/4098370662 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3dec0a3370 0x7f3dec0a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:18.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.190+0000 7f3e0b3e1740 1 -- 172.21.15.92:0/865790669 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d108dcdbc0 msgr2=0x55d108dd0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:18.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.190+0000 7f3e0b3e1740 1 --2- 172.21.15.92:0/865790669 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d108dcdbc0 0x55d108dd0030 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3df000bcb0 tx=0x7f3df00107a0 comp rx=0 tx=0).stop 2024-09-19T09:07:18.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.190+0000 7f3e0b3e1740 1 -- 172.21.15.92:0/865790669 shutdown_connections 2024-09-19T09:07:18.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.190+0000 7f3e0b3e1740 1 --2- 172.21.15.92:0/865790669 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d108dcdbc0 0x55d108dd0030 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:18.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.190+0000 7f3e0b3e1740 1 --2- 172.21.15.92:0/865790669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d108dbe2e0 0x55d108dcd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:18.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.190+0000 7f3e0b3e1740 1 --2- 172.21.15.92:0/865790669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d108dbd9a0 0x55d108dbdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:18.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.190+0000 7f3e0b3e1740 1 -- 172.21.15.92:0/865790669 >> 172.21.15.92:0/865790669 conn(0x55d108dbaf90 msgr2=0x55d108dbb370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:18.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.190+0000 7f3e0b3e1740 1 -- 172.21.15.92:0/865790669 shutdown_connections 2024-09-19T09:07:18.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.191+0000 7f3e06b0c640 1 --2- 172.21.15.92:0/4098370662 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3dec0a3370 0x7f3dec0a5830 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3df8005fd0 tx=0x7f3df8009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:18.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.191+0000 7f3e0b3e1740 1 -- 172.21.15.92:0/865790669 wait complete. 2024-09-19T09:07:18.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.191+0000 7f3e0b3e1740 1 -- start start 2024-09-19T09:07:18.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.191+0000 7f3e0b3e1740 1 Processor -- start 2024-09-19T09:07:18.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.192+0000 7f3e0b3e1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d108dbd9a0 0x55d108dd2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:18.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.192+0000 7f3e0b3e1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d108dbe2e0 0x55d108dd2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:18.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.192+0000 7f3e0b3e1740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d108dcdbc0 0x55d108dd99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:18.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.192+0000 7f3e0b3e1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d108dd0b40 con 0x55d108dbd9a0 2024-09-19T09:07:18.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.192+0000 7f3e0b3e1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d108cac290 con 0x55d108dbe2e0 2024-09-19T09:07:18.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.192+0000 7f3e0b3e1740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55d108dd0cc0 con 0x55d108dcdbc0 2024-09-19T09:07:18.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.192+0000 7f3e0b3e1740 10 client.0 _ll_register_callbacks cb 0x55d108cdd140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:18.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.192+0000 7f3e0630b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d108dbd9a0 0x55d108dd2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:18.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.192+0000 7f3e05b0a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d108dbe2e0 0x55d108dd2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:18.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.192+0000 7f3e0630b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d108dbd9a0 0x55d108dd2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44398/0 (socket says 172.21.15.92:44398) 2024-09-19T09:07:18.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.192+0000 7f3e06b0c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d108dcdbc0 0x55d108dd99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:18.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.192+0000 7f3e05b0a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d108dbe2e0 0x55d108dd2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:45076/0 (socket says 172.21.15.92:45076) 2024-09-19T09:07:18.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.192+0000 7f3e0630b640 1 -- 172.21.15.92:0/244729627 learned_addr learned my addr 172.21.15.92:0/244729627 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:18.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.192+0000 7f3e06b0c640 1 -- 172.21.15.92:0/244729627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d108dbe2e0 msgr2=0x55d108dd2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:18.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.192+0000 7f3e06b0c640 1 --2- 172.21.15.92:0/244729627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d108dbe2e0 0x55d108dd2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:18.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.192+0000 7f3e06b0c640 1 -- 172.21.15.92:0/244729627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d108dbd9a0 msgr2=0x55d108dd2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:18.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.192+0000 7f3e06b0c640 1 --2- 172.21.15.92:0/244729627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d108dbd9a0 0x55d108dd2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:18.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.192+0000 7f3e06b0c640 1 -- 172.21.15.92:0/244729627 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d108a36210 con 0x55d108dcdbc0 2024-09-19T09:07:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.193+0000 7f3e06b0c640 1 --2- 172.21.15.92:0/244729627 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d108dcdbc0 0x55d108dd99a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3df80042c0 tx=0x7f3df8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fefac05484eaef41 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.193+0000 7f3de9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:07:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.193+0000 7f3de9ffb640 1 -- 172.21.15.92:0/244729627 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df8011ce0 con 0x55d108dcdbc0 2024-09-19T09:07:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.193+0000 7f3de9ffb640 1 -- 172.21.15.92:0/244729627 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3df8020420 con 0x55d108dcdbc0 2024-09-19T09:07:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.193+0000 7f3e0b3e1740 1 -- 172.21.15.92:0/244729627 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3df00041d0 con 0x55d108dcdbc0 2024-09-19T09:07:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.193+0000 7f3de9ffb640 1 -- 172.21.15.92:0/244729627 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3df8011e80 con 0x55d108dcdbc0 2024-09-19T09:07:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.193+0000 7f3e0b3e1740 10 client.27115 fetch_fsmap learned FSMap version 19 2024-09-19T09:07:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.193+0000 7f3e0b3e1740 1 -- 172.21.15.92:0/244729627 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55d108b02620 con 0x55d108dcdbc0 2024-09-19T09:07:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.194+0000 7f3de9ffb640 1 -- 172.21.15.92:0/244729627 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3df8020b40 con 0x55d108dcdbc0 2024-09-19T09:07:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.194+0000 7f3de9ffb640 1 -- 172.21.15.92:0/244729627 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f3df800f040 con 0x55d108dcdbc0 2024-09-19T09:07:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.194+0000 7f3e0b3e1740 10 client.27115 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:07:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.194+0000 7f3e0b3e1740 10 client.27115 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:07:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.194+0000 7f3e0b3e1740 20 client.27115 populate_metadata read hostname 'smithi092' 2024-09-19T09:07:18.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.194+0000 7f3e0b3e1740 1 --2- 172.21.15.92:0/244729627 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d108dde080 0x55d108de0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:18.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.194+0000 7f3e0b3e1740 4 client.27115 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:07:18.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.194+0000 7f3e0b3e1740 1 -- 172.21.15.92:0/244729627 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3df00041d0 con 0x55d108dde080 2024-09-19T09:07:18.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.194+0000 7f3e0630b640 1 --2- 172.21.15.92:0/244729627 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d108dde080 0x55d108de0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:18.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.195+0000 7f3e0630b640 1 --2- 172.21.15.92:0/244729627 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d108dde080 0x55d108de0470 crc :-1 s=READY pgs=333 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a16a39810424550d server_cookie=b863964842b354c9 in_seq=0 out_seq=0 2024-09-19T09:07:18.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.195+0000 7f3de9ffb640 10 client.27115 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:07:18.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.196+0000 7f3de9ffb640 1 -- 172.21.15.92:0/244729627 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f3df00041d0 con 0x55d108dde080 2024-09-19T09:07:18.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.196+0000 7f3de9ffb640 10 client.27115 handle_command_reply: tid=0 2024-09-19T09:07:18.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.196+0000 7f3e0b3e1740 1 client.27115 shutdown 2024-09-19T09:07:18.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.196+0000 7f3e0b3e1740 1 -- 172.21.15.92:0/244729627 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d108dcdbc0 msgr2=0x55d108dd99a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:18.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.196+0000 7f3e0b3e1740 1 --2- 172.21.15.92:0/244729627 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d108dcdbc0 0x55d108dd99a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3df80042c0 tx=0x7f3df8004a40 comp rx=0 tx=0).stop 2024-09-19T09:07:18.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.196+0000 7f3e0b3e1740 1 -- 172.21.15.92:0/244729627 shutdown_connections 2024-09-19T09:07:18.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.196+0000 7f3e0b3e1740 1 --2- 172.21.15.92:0/244729627 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d108dde080 0x55d108de0470 crc :-1 s=READY pgs=333 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:18.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.196+0000 7f3e0b3e1740 1 --2- 172.21.15.92:0/244729627 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d108dcdbc0 0x55d108dd99a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:18.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.196+0000 7f3de9ffb640 0 client.27115 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:07:18.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.196+0000 7f3e0b3e1740 1 --2- 172.21.15.92:0/244729627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d108dbe2e0 0x55d108dd2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:18.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.196+0000 7f3e0b3e1740 1 --2- 172.21.15.92:0/244729627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d108dbd9a0 0x55d108dd2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:18.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.196+0000 7f3e0b3e1740 1 -- 172.21.15.92:0/244729627 >> 172.21.15.92:0/244729627 conn(0x55d108dbaf90 msgr2=0x55d108dbc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:18.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.196+0000 7f3e0b3e1740 1 -- 172.21.15.92:0/244729627 shutdown_connections 2024-09-19T09:07:18.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.196+0000 7f3e0b3e1740 1 -- 172.21.15.92:0/244729627 wait complete. 2024-09-19T09:07:18.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.196+0000 7f3e0b3e1740 20 client.27115 trim_cache size 0 max 16384 2024-09-19T09:07:18.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.219+0000 7f3e0b3e1740 1 Processor -- start 2024-09-19T09:07:18.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.220+0000 7f3e0b3e1740 1 -- start start 2024-09-19T09:07:18.222 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.220+0000 7f3e0b3e1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d108dbaf90 0x55d108dbbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:18.222 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.220+0000 7f3e0b3e1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d108dbd9a0 0x55d108dd9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:18.222 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.220+0000 7f3e0b3e1740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d108dbe2e0 0x55d108dbc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:18.222 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.220+0000 7f3e0b3e1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3e001a4ed0 con 0x55d108dbaf90 2024-09-19T09:07:18.222 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.220+0000 7f3e0b3e1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3e001a7770 con 0x55d108dbd9a0 2024-09-19T09:07:18.222 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.220+0000 7f3e0b3e1740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3e001a5560 con 0x55d108dbe2e0 2024-09-19T09:07:18.222 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.220+0000 7f3e05b0a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d108dbd9a0 0x55d108dd9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:18.222 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.220+0000 7f3e0630b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d108dbaf90 0x55d108dbbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:18.222 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.220+0000 7f3e05b0a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d108dbd9a0 0x55d108dd9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:45082/0 (socket says 172.21.15.92:45082) 2024-09-19T09:07:18.222 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.220+0000 7f3e05b0a640 1 -- 172.21.15.92:0/4041518468 learned_addr learned my addr 172.21.15.92:0/4041518468 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:18.222 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.220+0000 7f3e0630b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d108dbaf90 0x55d108dbbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44404/0 (socket says 172.21.15.92:44404) 2024-09-19T09:07:18.222 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.220+0000 7f3e06b0c640 1 --2- 172.21.15.92:0/4041518468 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d108dbe2e0 0x55d108dbc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:18.222 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.220+0000 7f3e05b0a640 1 -- 172.21.15.92:0/4041518468 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d108dbe2e0 msgr2=0x55d108dbc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:18.223 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.220+0000 7f3e05b0a640 1 --2- 172.21.15.92:0/4041518468 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d108dbe2e0 0x55d108dbc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:18.223 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.220+0000 7f3e05b0a640 1 -- 172.21.15.92:0/4041518468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d108dbaf90 msgr2=0x55d108dbbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:18.223 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.220+0000 7f3e05b0a640 1 --2- 172.21.15.92:0/4041518468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d108dbaf90 0x55d108dbbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:18.223 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.220+0000 7f3e05b0a640 1 -- 172.21.15.92:0/4041518468 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d108ddca60 con 0x55d108dbd9a0 2024-09-19T09:07:18.223 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.220+0000 7f3e0630b640 1 --2- 172.21.15.92:0/4041518468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d108dbaf90 0x55d108dbbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:18.223 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.221+0000 7f3e05b0a640 1 --2- 172.21.15.92:0/4041518468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d108dbd9a0 0x55d108dd9960 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3df000bcb0 tx=0x7f3df000b590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1e1d7abbca8c37f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:18.223 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.221+0000 7f3debfff640 1 -- 172.21.15.92:0/4041518468 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df0005240 con 0x55d108dbd9a0 2024-09-19T09:07:18.223 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.221+0000 7f3debfff640 1 -- 172.21.15.92:0/4041518468 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3df000be60 con 0x55d108dbd9a0 2024-09-19T09:07:18.223 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.221+0000 7f3debfff640 1 -- 172.21.15.92:0/4041518468 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df00116a0 con 0x55d108dbd9a0 2024-09-19T09:07:18.226 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.222+0000 7f3e0b3e1740 1 -- 172.21.15.92:0/4041518468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d108dbd9a0 msgr2=0x55d108dd9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:18.226 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.222+0000 7f3e0b3e1740 1 --2- 172.21.15.92:0/4041518468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d108dbd9a0 0x55d108dd9960 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3df000bcb0 tx=0x7f3df000b590 comp rx=0 tx=0).stop 2024-09-19T09:07:18.226 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.222+0000 7f3e0b3e1740 1 -- 172.21.15.92:0/4041518468 shutdown_connections 2024-09-19T09:07:18.226 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.222+0000 7f3e0b3e1740 1 --2- 172.21.15.92:0/4041518468 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d108dbe2e0 0x55d108dbc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:18.226 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.222+0000 7f3e0b3e1740 1 --2- 172.21.15.92:0/4041518468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d108dbd9a0 0x55d108dd9960 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:18.226 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.222+0000 7f3e0b3e1740 1 --2- 172.21.15.92:0/4041518468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d108dbaf90 0x55d108dbbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:18.226 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.222+0000 7f3e0b3e1740 1 -- 172.21.15.92:0/4041518468 >> 172.21.15.92:0/4041518468 conn(0x55d108dcd7a0 msgr2=0x55d108dc9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:18.226 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.222+0000 7f3e0b3e1740 1 -- 172.21.15.92:0/4041518468 shutdown_connections 2024-09-19T09:07:18.226 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.223+0000 7f3e0b3e1740 1 -- 172.21.15.92:0/4041518468 wait complete. 2024-09-19T09:07:18.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.224+0000 7f3e0b3e1740 1 -- start start 2024-09-19T09:07:18.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.224+0000 7f3e0b3e1740 1 Processor -- start 2024-09-19T09:07:18.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.224+0000 7f3e0b3e1740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d108dbaf90 0x55d108dd4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:18.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.224+0000 7f3e0b3e1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d108dbd9a0 0x55d108dd5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:18.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.224+0000 7f3e0b3e1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d108dbe2e0 0x55d108dd8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:18.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.224+0000 7f3e0b3e1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3e001a5c30 con 0x55d108dbd9a0 2024-09-19T09:07:18.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.224+0000 7f3e0b3e1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3e001a70a0 con 0x55d108dbe2e0 2024-09-19T09:07:18.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.224+0000 7f3e0b3e1740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3e001a6300 con 0x55d108dbaf90 2024-09-19T09:07:18.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.224+0000 7f3e0b3e1740 10 client.0 _ll_register_callbacks cb 0x7f3df8009d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:18.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.224+0000 7f3e0630b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d108dbaf90 0x55d108dd4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:18.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.224+0000 7f3e0630b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d108dbaf90 0x55d108dd4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:55940/0 (socket says 172.21.15.92:55940) 2024-09-19T09:07:18.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.224+0000 7f3e0630b640 1 -- 172.21.15.92:0/1940253892 learned_addr learned my addr 172.21.15.92:0/1940253892 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:18.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.224+0000 7f3e06b0c640 1 --2- 172.21.15.92:0/1940253892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d108dbe2e0 0x55d108dd8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:18.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.224+0000 7f3e05b0a640 1 --2- 172.21.15.92:0/1940253892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d108dbd9a0 0x55d108dd5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:18.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.225+0000 7f3e06b0c640 1 -- 172.21.15.92:0/1940253892 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d108dbaf90 msgr2=0x55d108dd4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:18.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.225+0000 7f3e06b0c640 1 --2- 172.21.15.92:0/1940253892 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d108dbaf90 0x55d108dd4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:18.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.225+0000 7f3e06b0c640 1 -- 172.21.15.92:0/1940253892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d108dbd9a0 msgr2=0x55d108dd5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:18.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.225+0000 7f3e06b0c640 1 --2- 172.21.15.92:0/1940253892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d108dbd9a0 0x55d108dd5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:18.229 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.225+0000 7f3e06b0c640 1 -- 172.21.15.92:0/1940253892 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d108dd8a80 con 0x55d108dbe2e0 2024-09-19T09:07:18.229 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.225+0000 7f3e06b0c640 1 --2- 172.21.15.92:0/1940253892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d108dbe2e0 0x55d108dd8470 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3df8018040 tx=0x7f3df8004d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ba6d955df744010 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:18.229 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.225+0000 7f3de9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:07:18.229 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.226+0000 7f3de9ffb640 1 -- 172.21.15.92:0/1940253892 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df8041060 con 0x55d108dbe2e0 2024-09-19T09:07:18.229 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.226+0000 7f3de9ffb640 1 -- 172.21.15.92:0/1940253892 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3df8028610 con 0x55d108dbe2e0 2024-09-19T09:07:18.230 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.226+0000 7f3e0b3e1740 1 -- 172.21.15.92:0/1940253892 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3df000be60 con 0x55d108dbe2e0 2024-09-19T09:07:18.230 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.226+0000 7f3de9ffb640 1 -- 172.21.15.92:0/1940253892 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3df8003d70 con 0x55d108dbe2e0 2024-09-19T09:07:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.226+0000 7f3e0b3e1740 10 client.27239 fetch_fsmap learned FSMap version 19 2024-09-19T09:07:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.226+0000 7f3e0b3e1740 1 -- 172.21.15.92:0/1940253892 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55d108e48d50 con 0x55d108dbe2e0 2024-09-19T09:07:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.227+0000 7f3de9ffb640 1 -- 172.21.15.92:0/1940253892 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3df000be60 con 0x55d108dbe2e0 2024-09-19T09:07:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.227+0000 7f3de9ffb640 1 -- 172.21.15.92:0/1940253892 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f3df800f040 con 0x55d108dbe2e0 2024-09-19T09:07:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.227+0000 7f3e0b3e1740 10 client.27239 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:07:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.227+0000 7f3e0b3e1740 10 client.27239 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:07:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.227+0000 7f3e0b3e1740 20 client.27239 populate_metadata read hostname 'smithi092' 2024-09-19T09:07:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.227+0000 7f3e0b3e1740 1 --2- 172.21.15.92:0/1940253892 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d108dcdbc0 0x55d108e4b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.227+0000 7f3e0b3e1740 4 client.27239 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:07:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.227+0000 7f3e0b3e1740 1 -- 172.21.15.92:0/1940253892 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d108d30a20 con 0x55d108dcdbc0 2024-09-19T09:07:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.227+0000 7f3e0630b640 1 --2- 172.21.15.92:0/1940253892 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d108dcdbc0 0x55d108e4b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.228+0000 7f3e0630b640 1 --2- 172.21.15.92:0/1940253892 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d108dcdbc0 0x55d108e4b660 crc :-1 s=READY pgs=334 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f44182b0a0d3e533 server_cookie=e16894eb2c730647 in_seq=0 out_seq=0 2024-09-19T09:07:18.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.228+0000 7f3de9ffb640 10 client.27239 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:07:18.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.244+0000 7f3de9ffb640 1 -- 172.21.15.92:0/1940253892 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d108d30a20 con 0x55d108dcdbc0 2024-09-19T09:07:18.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.244+0000 7f3de9ffb640 10 client.27239 handle_command_reply: tid=0 2024-09-19T09:07:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.244+0000 7f3e0b3e1740 1 client.27239 shutdown 2024-09-19T09:07:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.244+0000 7f3e0b3e1740 1 -- 172.21.15.92:0/1940253892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d108dbe2e0 msgr2=0x55d108dd8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.244+0000 7f3e0b3e1740 1 --2- 172.21.15.92:0/1940253892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d108dbe2e0 0x55d108dd8470 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3df8018040 tx=0x7f3df8004d60 comp rx=0 tx=0).stop 2024-09-19T09:07:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.244+0000 7f3e0b3e1740 1 -- 172.21.15.92:0/1940253892 shutdown_connections 2024-09-19T09:07:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.244+0000 7f3e0b3e1740 1 --2- 172.21.15.92:0/1940253892 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d108dcdbc0 0x55d108e4b660 crc :-1 s=READY pgs=334 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.244+0000 7f3e0b3e1740 1 --2- 172.21.15.92:0/1940253892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d108dbe2e0 0x55d108dd8470 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.244+0000 7f3de9ffb640 0 client.27239 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:07:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.244+0000 7f3e0b3e1740 1 --2- 172.21.15.92:0/1940253892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d108dbd9a0 0x55d108dd5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.244+0000 7f3e0b3e1740 1 --2- 172.21.15.92:0/1940253892 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d108dbaf90 0x55d108dd4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.244+0000 7f3e0b3e1740 1 -- 172.21.15.92:0/1940253892 >> 172.21.15.92:0/1940253892 conn(0x55d108dcd7a0 msgr2=0x55d108dc9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.244+0000 7f3e0b3e1740 1 -- 172.21.15.92:0/1940253892 shutdown_connections 2024-09-19T09:07:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.244+0000 7f3e0b3e1740 1 -- 172.21.15.92:0/1940253892 wait complete. 2024-09-19T09:07:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.244+0000 7f3e0b3e1740 20 client.27239 trim_cache size 0 max 16384 2024-09-19T09:07:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:07:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:07:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:07:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:07:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.245+0000 7f3e0856f640 1 -- 172.21.15.92:0/4098370662 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3dec0a3370 msgr2=0x7f3dec0a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.245+0000 7f3e0856f640 1 --2- 172.21.15.92:0/4098370662 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3dec0a3370 0x7f3dec0a5830 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3df8005fd0 tx=0x7f3df8009600 comp rx=0 tx=0).stop 2024-09-19T09:07:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.245+0000 7f3e0856f640 1 -- 172.21.15.92:0/4098370662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e00101b60 msgr2=0x7f3e00197e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.245+0000 7f3e0856f640 1 --2- 172.21.15.92:0/4098370662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e00101b60 0x7f3e00197e00 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc031440 tx=0x7f3dfc032e20 comp rx=0 tx=0).stop 2024-09-19T09:07:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.245+0000 7f3e0856f640 1 -- 172.21.15.92:0/4098370662 shutdown_connections 2024-09-19T09:07:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.245+0000 7f3e0856f640 1 --2- 172.21.15.92:0/4098370662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e00103710 0x7f3e0019f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.245+0000 7f3e0856f640 1 --2- 172.21.15.92:0/4098370662 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e00102d50 0x7f3e00198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.245+0000 7f3e0856f640 1 --2- 172.21.15.92:0/4098370662 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3dec0a3370 0x7f3dec0a5830 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.245+0000 7f3e0856f640 1 --2- 172.21.15.92:0/4098370662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e00101b60 0x7f3e00197e00 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:18.249 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.245+0000 7f3e0856f640 1 -- 172.21.15.92:0/4098370662 >> 172.21.15.92:0/4098370662 conn(0x7f3e000fd2e0 msgr2=0x7f3e001060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:18.249 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.245+0000 7f3e0856f640 1 -- 172.21.15.92:0/4098370662 shutdown_connections 2024-09-19T09:07:18.249 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:18.246+0000 7f3e0856f640 1 -- 172.21.15.92:0/4098370662 wait complete. 2024-09-19T09:07:19.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:19 smithi167 ceph-mon[35359]: pgmap v655: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 9.2 MiB/s wr, 679 op/s 2024-09-19T09:07:19.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:19 smithi190 ceph-mon[35358]: pgmap v655: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 9.2 MiB/s wr, 679 op/s 2024-09-19T09:07:20.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:19 smithi092 ceph-mon[31407]: pgmap v655: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 9.2 MiB/s wr, 679 op/s 2024-09-19T09:07:20.795 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 635.0 s, 3060.2 tps, lat 32.959 ms stddev 38.992 2024-09-19T09:07:21.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:21 smithi167 ceph-mon[35359]: pgmap v656: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 9.4 MiB/s wr, 716 op/s 2024-09-19T09:07:21.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:21 smithi190 ceph-mon[35358]: pgmap v656: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 9.4 MiB/s wr, 716 op/s 2024-09-19T09:07:22.005 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:21 smithi092 ceph-mon[31407]: pgmap v656: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 9.4 MiB/s wr, 716 op/s 2024-09-19T09:07:22.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:22 smithi167 ceph-mon[35359]: pgmap v657: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 8.5 MiB/s wr, 684 op/s 2024-09-19T09:07:22.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:22 smithi190 ceph-mon[35358]: pgmap v657: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 8.5 MiB/s wr, 684 op/s 2024-09-19T09:07:23.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:22 smithi092 ceph-mon[31407]: pgmap v657: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 8.5 MiB/s wr, 684 op/s 2024-09-19T09:07:25.795 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 640.0 s, 2949.2 tps, lat 33.760 ms stddev 38.668 2024-09-19T09:07:25.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:25 smithi167 ceph-mon[35359]: pgmap v658: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 9.0 MiB/s wr, 718 op/s 2024-09-19T09:07:25.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:25 smithi190 ceph-mon[35358]: pgmap v658: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 9.0 MiB/s wr, 718 op/s 2024-09-19T09:07:26.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:25 smithi092 ceph-mon[31407]: pgmap v658: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 9.0 MiB/s wr, 718 op/s 2024-09-19T09:07:27.169 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:07:27.557 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:07:27.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:27 smithi167 ceph-mon[35359]: pgmap v659: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7.8 MiB/s wr, 682 op/s 2024-09-19T09:07:27.853 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:27 smithi092 ceph-mon[31407]: pgmap v659: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7.8 MiB/s wr, 682 op/s 2024-09-19T09:07:27.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:27 smithi190 ceph-mon[35358]: pgmap v659: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7.8 MiB/s wr, 682 op/s 2024-09-19T09:07:28.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.147+0000 7f3c5fe45640 1 -- 172.21.15.92:0/3683364045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c58101df0 msgr2=0x7f3c581021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:28.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.147+0000 7f3c5fe45640 1 --2- 172.21.15.92:0/3683364045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c58101df0 0x7f3c581021d0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f3c54009900 tx=0x7f3c5402a410 comp rx=0 tx=0).stop 2024-09-19T09:07:28.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.148+0000 7f3c5fe45640 1 -- 172.21.15.92:0/3683364045 shutdown_connections 2024-09-19T09:07:28.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.148+0000 7f3c5fe45640 1 --2- 172.21.15.92:0/3683364045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c58106f20 0x7f3c5810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.148+0000 7f3c5fe45640 1 --2- 172.21.15.92:0/3683364045 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c581027a0 0x7f3c581067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.148+0000 7f3c5fe45640 1 --2- 172.21.15.92:0/3683364045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c58101df0 0x7f3c581021d0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.148+0000 7f3c5fe45640 1 -- 172.21.15.92:0/3683364045 >> 172.21.15.92:0/3683364045 conn(0x7f3c580fd8b0 msgr2=0x7f3c580ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:28.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.148+0000 7f3c5fe45640 1 -- 172.21.15.92:0/3683364045 shutdown_connections 2024-09-19T09:07:28.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.148+0000 7f3c5fe45640 1 -- 172.21.15.92:0/3683364045 wait complete. 2024-09-19T09:07:28.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.149+0000 7f3c5fe45640 1 Processor -- start 2024-09-19T09:07:28.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.149+0000 7f3c5fe45640 1 -- start start 2024-09-19T09:07:28.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.149+0000 7f3c5fe45640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c58101df0 0x7f3c581a47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:28.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.149+0000 7f3c5fe45640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c581027a0 0x7f3c581a4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:28.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.149+0000 7f3c5fe45640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c58106f20 0x7f3c5810db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:28.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.149+0000 7f3c5fe45640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3c58111fd0 con 0x7f3c58101df0 2024-09-19T09:07:28.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.149+0000 7f3c5fe45640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3c58111e50 con 0x7f3c581027a0 2024-09-19T09:07:28.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.149+0000 7f3c5fe45640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3c58112150 con 0x7f3c58106f20 2024-09-19T09:07:28.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.149+0000 7f3c5dbe1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c58101df0 0x7f3c581a47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:28.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.149+0000 7f3c5d3e0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c581027a0 0x7f3c581a4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:28.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.149+0000 7f3c5dbe1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c58101df0 0x7f3c581a47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57188/0 (socket says 172.21.15.92:57188) 2024-09-19T09:07:28.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.149+0000 7f3c5dbe1640 1 -- 172.21.15.92:0/1443468335 learned_addr learned my addr 172.21.15.92:0/1443468335 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:28.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.149+0000 7f3c5e3e2640 1 --2- 172.21.15.92:0/1443468335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c58106f20 0x7f3c5810db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:28.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.150+0000 7f3c5e3e2640 1 -- 172.21.15.92:0/1443468335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c581027a0 msgr2=0x7f3c581a4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:28.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.150+0000 7f3c5e3e2640 1 --2- 172.21.15.92:0/1443468335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c581027a0 0x7f3c581a4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.150+0000 7f3c5e3e2640 1 -- 172.21.15.92:0/1443468335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c58101df0 msgr2=0x7f3c581a47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:28.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.150+0000 7f3c5e3e2640 1 --2- 172.21.15.92:0/1443468335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c58101df0 0x7f3c581a47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.150+0000 7f3c5e3e2640 1 -- 172.21.15.92:0/1443468335 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c5810e2d0 con 0x7f3c58106f20 2024-09-19T09:07:28.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.150+0000 7f3c5d3e0640 1 --2- 172.21.15.92:0/1443468335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c581027a0 0x7f3c581a4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:28.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.150+0000 7f3c5dbe1640 1 --2- 172.21.15.92:0/1443468335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c58101df0 0x7f3c581a47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:28.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.150+0000 7f3c5e3e2640 1 --2- 172.21.15.92:0/1443468335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c58106f20 0x7f3c5810db50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3c50009fd0 tx=0x7f3c5000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:28.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.150+0000 7f3c4effd640 1 -- 172.21.15.92:0/1443468335 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c5000ce20 con 0x7f3c58106f20 2024-09-19T09:07:28.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.150+0000 7f3c5fe45640 1 -- 172.21.15.92:0/1443468335 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c5810e5c0 con 0x7f3c58106f20 2024-09-19T09:07:28.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.150+0000 7f3c5fe45640 1 -- 172.21.15.92:0/1443468335 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c581ab600 con 0x7f3c58106f20 2024-09-19T09:07:28.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.150+0000 7f3c4effd640 1 -- 172.21.15.92:0/1443468335 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c50005020 con 0x7f3c58106f20 2024-09-19T09:07:28.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.150+0000 7f3c4effd640 1 -- 172.21.15.92:0/1443468335 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c50010720 con 0x7f3c58106f20 2024-09-19T09:07:28.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.154+0000 7f3c6221e740 1 Processor -- start 2024-09-19T09:07:28.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.154+0000 7f3c4effd640 1 -- 172.21.15.92:0/1443468335 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3c50004a40 con 0x7f3c58106f20 2024-09-19T09:07:28.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.155+0000 7f3c6221e740 1 -- start start 2024-09-19T09:07:28.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.155+0000 7f3c6221e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3de24c4a0 0x55e3de24c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:28.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.155+0000 7f3c6221e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3de24cdc0 0x55e3de257140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:28.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.155+0000 7f3c6221e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3de257680 0x55e3de259a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:28.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.155+0000 7f3c6221e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e3de1b22e0 con 0x55e3de24c4a0 2024-09-19T09:07:28.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.155+0000 7f3c6221e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e3de159ce0 con 0x55e3de24cdc0 2024-09-19T09:07:28.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.155+0000 7f3c6221e740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e3de1ae2a0 con 0x55e3de257680 2024-09-19T09:07:28.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.155+0000 7f3c5d3e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3de24c4a0 0x55e3de24c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:28.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.155+0000 7f3c5d3e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3de24c4a0 0x55e3de24c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57196/0 (socket says 172.21.15.92:57196) 2024-09-19T09:07:28.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.155+0000 7f3c5d3e0640 1 -- 172.21.15.92:0/989530713 learned_addr learned my addr 172.21.15.92:0/989530713 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:28.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.155+0000 7f3c5dbe1640 1 --2- 172.21.15.92:0/989530713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3de24cdc0 0x55e3de257140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:28.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.155+0000 7f3c5d3e0640 1 --2- 172.21.15.92:0/989530713 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3de257680 0x55e3de259a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:28.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.155+0000 7f3c4effd640 1 --2- 172.21.15.92:0/1443468335 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3c440a32c0 0x7f3c440a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:28.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.156+0000 7f3c5d3e0640 1 -- 172.21.15.92:0/989530713 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3de257680 msgr2=0x55e3de259a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:28.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.156+0000 7f3c5d3e0640 1 --2- 172.21.15.92:0/989530713 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3de257680 0x55e3de259a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.156+0000 7f3c5d3e0640 1 -- 172.21.15.92:0/989530713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3de24cdc0 msgr2=0x55e3de257140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:28.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.156+0000 7f3c5d3e0640 1 --2- 172.21.15.92:0/989530713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3de24cdc0 0x55e3de257140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.156+0000 7f3c5d3e0640 1 -- 172.21.15.92:0/989530713 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3de13e440 con 0x55e3de24c4a0 2024-09-19T09:07:28.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.156+0000 7f3c4effd640 1 -- 172.21.15.92:0/1443468335 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3c500cfd00 con 0x7f3c58106f20 2024-09-19T09:07:28.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.156+0000 7f3c5e3e2640 1 --2- 172.21.15.92:0/1443468335 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3c440a32c0 0x7f3c440a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:28.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.156+0000 7f3c5d3e0640 1 --2- 172.21.15.92:0/989530713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3de24c4a0 0x55e3de24c880 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x55e3de249db0 tx=0x7f3c48005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52b28a84447f333a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:28.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.156+0000 7f3c5e3e2640 1 --2- 172.21.15.92:0/1443468335 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3c440a32c0 0x7f3c440a5780 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3c5001a040 tx=0x7f3c500108c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:28.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.157+0000 7f3c43fff640 1 -- 172.21.15.92:0/989530713 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c48013130 con 0x55e3de24c4a0 2024-09-19T09:07:28.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.157+0000 7f3c43fff640 1 -- 172.21.15.92:0/989530713 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c48013c40 con 0x55e3de24c4a0 2024-09-19T09:07:28.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.157+0000 7f3c43fff640 1 -- 172.21.15.92:0/989530713 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c48005360 con 0x55e3de24c4a0 2024-09-19T09:07:28.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.158+0000 7f3c6221e740 1 -- 172.21.15.92:0/989530713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3de24c4a0 msgr2=0x55e3de24c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:28.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.158+0000 7f3c6221e740 1 --2- 172.21.15.92:0/989530713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3de24c4a0 0x55e3de24c880 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x55e3de249db0 tx=0x7f3c48005850 comp rx=0 tx=0).stop 2024-09-19T09:07:28.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.158+0000 7f3c6221e740 1 -- 172.21.15.92:0/989530713 shutdown_connections 2024-09-19T09:07:28.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.158+0000 7f3c6221e740 1 --2- 172.21.15.92:0/989530713 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3de257680 0x55e3de259a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.158+0000 7f3c6221e740 1 --2- 172.21.15.92:0/989530713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3de24cdc0 0x55e3de257140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.158+0000 7f3c6221e740 1 --2- 172.21.15.92:0/989530713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3de24c4a0 0x55e3de24c880 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.158+0000 7f3c6221e740 1 -- 172.21.15.92:0/989530713 >> 172.21.15.92:0/989530713 conn(0x55e3de248a30 msgr2=0x55e3de248e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:28.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.158+0000 7f3c6221e740 1 -- 172.21.15.92:0/989530713 shutdown_connections 2024-09-19T09:07:28.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.158+0000 7f3c6221e740 1 -- 172.21.15.92:0/989530713 wait complete. 2024-09-19T09:07:28.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.158+0000 7f3c6221e740 1 -- start start 2024-09-19T09:07:28.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.159+0000 7f3c6221e740 1 Processor -- start 2024-09-19T09:07:28.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.159+0000 7f3c6221e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3de24c4a0 0x55e3de256fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:28.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.159+0000 7f3c6221e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3de24cdc0 0x55e3de254270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:28.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.159+0000 7f3c6221e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3de257680 0x55e3de2547b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:28.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.159+0000 7f3c6221e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e3de25a250 con 0x55e3de257680 2024-09-19T09:07:28.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.159+0000 7f3c6221e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e3de16d050 con 0x55e3de24c4a0 2024-09-19T09:07:28.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.159+0000 7f3c6221e740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e3de25a3d0 con 0x55e3de24cdc0 2024-09-19T09:07:28.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.159+0000 7f3c6221e740 10 client.0 _ll_register_callbacks cb 0x55e3de1ad160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:28.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.159+0000 7f3c5d3e0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3de24c4a0 0x55e3de256fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:28.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.159+0000 7f3c5d3e0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3de24c4a0 0x55e3de256fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:45456/0 (socket says 172.21.15.92:45456) 2024-09-19T09:07:28.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.159+0000 7f3c5d3e0640 1 -- 172.21.15.92:0/3794038498 learned_addr learned my addr 172.21.15.92:0/3794038498 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:28.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.159+0000 7f3c5dbe1640 1 --2- 172.21.15.92:0/3794038498 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3de24cdc0 0x55e3de254270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:28.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.159+0000 7f3c5d3e0640 1 --2- 172.21.15.92:0/3794038498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3de257680 0x55e3de2547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:28.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.160+0000 7f3c5d3e0640 1 -- 172.21.15.92:0/3794038498 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3de24cdc0 msgr2=0x55e3de254270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:28.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.160+0000 7f3c5d3e0640 1 --2- 172.21.15.92:0/3794038498 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3de24cdc0 0x55e3de254270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.160+0000 7f3c5d3e0640 1 -- 172.21.15.92:0/3794038498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3de257680 msgr2=0x55e3de2547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:28.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.160+0000 7f3c5d3e0640 1 --2- 172.21.15.92:0/3794038498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3de257680 0x55e3de2547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.160+0000 7f3c5d3e0640 1 -- 172.21.15.92:0/3794038498 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3ddf233c0 con 0x55e3de24c4a0 2024-09-19T09:07:28.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.160+0000 7f3c5d3e0640 1 --2- 172.21.15.92:0/3794038498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3de24c4a0 0x55e3de256fc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3c4800fff0 tx=0x7f3c48005020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cb53e182b2aec18 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:28.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.160+0000 7f3c417fa640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:07:28.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.160+0000 7f3c417fa640 1 -- 172.21.15.92:0/3794038498 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c48018040 con 0x55e3de24c4a0 2024-09-19T09:07:28.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.161+0000 7f3c6221e740 1 -- 172.21.15.92:0/3794038498 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c48013c40 con 0x55e3de24c4a0 2024-09-19T09:07:28.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.161+0000 7f3c417fa640 1 -- 172.21.15.92:0/3794038498 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3c48005540 con 0x55e3de24c4a0 2024-09-19T09:07:28.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.161+0000 7f3c417fa640 1 -- 172.21.15.92:0/3794038498 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3c480046c0 con 0x55e3de24c4a0 2024-09-19T09:07:28.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.161+0000 7f3c6221e740 10 client.27251 fetch_fsmap learned FSMap version 19 2024-09-19T09:07:28.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.161+0000 7f3c6221e740 1 -- 172.21.15.92:0/3794038498 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e3de265c90 con 0x55e3de24c4a0 2024-09-19T09:07:28.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.162+0000 7f3c417fa640 1 -- 172.21.15.92:0/3794038498 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c48004d40 con 0x55e3de24c4a0 2024-09-19T09:07:28.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.162+0000 7f3c417fa640 1 -- 172.21.15.92:0/3794038498 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f3c4802b020 con 0x55e3de24c4a0 2024-09-19T09:07:28.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.162+0000 7f3c6221e740 10 client.27251 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:07:28.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.162+0000 7f3c6221e740 10 client.27251 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:07:28.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.162+0000 7f3c6221e740 20 client.27251 populate_metadata read hostname 'smithi092' 2024-09-19T09:07:28.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.162+0000 7f3c6221e740 1 --2- 172.21.15.92:0/3794038498 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e3de267480 0x55e3de269900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:28.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.162+0000 7f3c6221e740 4 client.27251 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:07:28.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.162+0000 7f3c6221e740 1 -- 172.21.15.92:0/3794038498 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3c48013c40 con 0x55e3de267480 2024-09-19T09:07:28.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.163+0000 7f3c5dbe1640 1 --2- 172.21.15.92:0/3794038498 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e3de267480 0x55e3de269900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:28.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.164+0000 7f3c417fa640 10 client.27251 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:07:28.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.164+0000 7f3c5dbe1640 1 --2- 172.21.15.92:0/3794038498 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e3de267480 0x55e3de269900 crc :-1 s=READY pgs=335 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c5871e873db456f server_cookie=27f53978894bf29e in_seq=0 out_seq=0 2024-09-19T09:07:28.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.164+0000 7f3c417fa640 1 -- 172.21.15.92:0/3794038498 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f3c48013c40 con 0x55e3de267480 2024-09-19T09:07:28.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.164+0000 7f3c417fa640 10 client.27251 handle_command_reply: tid=0 2024-09-19T09:07:28.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.164+0000 7f3c6221e740 1 client.27251 shutdown 2024-09-19T09:07:28.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.165+0000 7f3c6221e740 1 -- 172.21.15.92:0/3794038498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3de24c4a0 msgr2=0x55e3de256fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:28.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.165+0000 7f3c6221e740 1 --2- 172.21.15.92:0/3794038498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3de24c4a0 0x55e3de256fc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3c4800fff0 tx=0x7f3c48005020 comp rx=0 tx=0).stop 2024-09-19T09:07:28.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.165+0000 7f3c6221e740 1 -- 172.21.15.92:0/3794038498 shutdown_connections 2024-09-19T09:07:28.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.165+0000 7f3c6221e740 1 --2- 172.21.15.92:0/3794038498 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e3de267480 0x55e3de269900 crc :-1 s=READY pgs=335 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.165+0000 7f3c6221e740 1 --2- 172.21.15.92:0/3794038498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3de257680 0x55e3de2547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.165+0000 7f3c6221e740 1 --2- 172.21.15.92:0/3794038498 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3de24cdc0 0x55e3de254270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.165+0000 7f3c6221e740 1 --2- 172.21.15.92:0/3794038498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3de24c4a0 0x55e3de256fc0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.165+0000 7f3c6221e740 1 -- 172.21.15.92:0/3794038498 >> 172.21.15.92:0/3794038498 conn(0x55e3de248a30 msgr2=0x55e3de24e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:28.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.165+0000 7f3c417fa640 0 client.27251 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:07:28.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.165+0000 7f3c6221e740 1 -- 172.21.15.92:0/3794038498 shutdown_connections 2024-09-19T09:07:28.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.165+0000 7f3c6221e740 1 -- 172.21.15.92:0/3794038498 wait complete. 2024-09-19T09:07:28.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.165+0000 7f3c6221e740 20 client.27251 trim_cache size 0 max 16384 2024-09-19T09:07:28.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.189+0000 7f3c6221e740 1 Processor -- start 2024-09-19T09:07:28.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.189+0000 7f3c6221e740 1 -- start start 2024-09-19T09:07:28.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.189+0000 7f3c6221e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3de248a30 0x55e3de263540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:28.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.189+0000 7f3c6221e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3de24c4a0 0x55e3de26f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:28.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.189+0000 7f3c6221e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3de24cdc0 0x55e3de26f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:28.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.189+0000 7f3c6221e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3c00c520 con 0x55e3de248a30 2024-09-19T09:07:28.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.189+0000 7f3c6221e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3c00edc0 con 0x55e3de24cdc0 2024-09-19T09:07:28.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.189+0000 7f3c6221e740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3c00cbb0 con 0x55e3de24c4a0 2024-09-19T09:07:28.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.189+0000 7f3c5d3e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3de248a30 0x55e3de263540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:28.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.189+0000 7f3c5d3e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3de248a30 0x55e3de263540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57220/0 (socket says 172.21.15.92:57220) 2024-09-19T09:07:28.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.189+0000 7f3c5d3e0640 1 -- 172.21.15.92:0/3509817345 learned_addr learned my addr 172.21.15.92:0/3509817345 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:28.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.190+0000 7f3c5dbe1640 1 --2- 172.21.15.92:0/3509817345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3de24c4a0 0x55e3de26f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:28.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.191+0000 7f3c5dbe1640 1 -- 172.21.15.92:0/3509817345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3de24cdc0 msgr2=0x55e3de26f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:28.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.191+0000 7f3c5dbe1640 1 --2- 172.21.15.92:0/3509817345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3de24cdc0 0x55e3de26f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.191+0000 7f3c5dbe1640 1 -- 172.21.15.92:0/3509817345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3de248a30 msgr2=0x55e3de263540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:28.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.191+0000 7f3c5dbe1640 1 --2- 172.21.15.92:0/3509817345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3de248a30 0x55e3de263540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.191+0000 7f3c5dbe1640 1 -- 172.21.15.92:0/3509817345 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3de257330 con 0x55e3de24c4a0 2024-09-19T09:07:28.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.191+0000 7f3c5dbe1640 1 --2- 172.21.15.92:0/3509817345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3de24c4a0 0x55e3de26f1d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3c54000c00 tx=0x7f3c540317f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3c4458646525fe8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:28.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.192+0000 7f3c437fe640 1 -- 172.21.15.92:0/3509817345 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c54035040 con 0x55e3de24c4a0 2024-09-19T09:07:28.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.192+0000 7f3c437fe640 1 -- 172.21.15.92:0/3509817345 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c540035f0 con 0x55e3de24c4a0 2024-09-19T09:07:28.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.192+0000 7f3c437fe640 1 -- 172.21.15.92:0/3509817345 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c54046620 con 0x55e3de24c4a0 2024-09-19T09:07:28.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.193+0000 7f3c6221e740 1 -- 172.21.15.92:0/3509817345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3de24c4a0 msgr2=0x55e3de26f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:28.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.193+0000 7f3c6221e740 1 --2- 172.21.15.92:0/3509817345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3de24c4a0 0x55e3de26f1d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3c54000c00 tx=0x7f3c540317f0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.193+0000 7f3c6221e740 1 -- 172.21.15.92:0/3509817345 shutdown_connections 2024-09-19T09:07:28.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.193+0000 7f3c6221e740 1 --2- 172.21.15.92:0/3509817345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3de24cdc0 0x55e3de26f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.193+0000 7f3c6221e740 1 --2- 172.21.15.92:0/3509817345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3de24c4a0 0x55e3de26f1d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.193+0000 7f3c6221e740 1 --2- 172.21.15.92:0/3509817345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3de248a30 0x55e3de263540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.193+0000 7f3c6221e740 1 -- 172.21.15.92:0/3509817345 >> 172.21.15.92:0/3509817345 conn(0x55e3de254910 msgr2=0x55e3de252b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:28.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.193+0000 7f3c6221e740 1 -- 172.21.15.92:0/3509817345 shutdown_connections 2024-09-19T09:07:28.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.193+0000 7f3c6221e740 1 -- 172.21.15.92:0/3509817345 wait complete. 2024-09-19T09:07:28.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.193+0000 7f3c6221e740 1 -- start start 2024-09-19T09:07:28.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.194+0000 7f3c6221e740 1 Processor -- start 2024-09-19T09:07:28.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.194+0000 7f3c6221e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3de248a30 0x55e3de25fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:28.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.194+0000 7f3c6221e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3de24c4a0 0x55e3de250f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:28.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.194+0000 7f3c6221e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3de24cdc0 0x55e3de251490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:28.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.194+0000 7f3c6221e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3c00d280 con 0x55e3de248a30 2024-09-19T09:07:28.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.194+0000 7f3c6221e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3c00e6f0 con 0x55e3de24cdc0 2024-09-19T09:07:28.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.194+0000 7f3c6221e740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3c00d950 con 0x55e3de24c4a0 2024-09-19T09:07:28.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.194+0000 7f3c6221e740 10 client.0 _ll_register_callbacks cb 0x7f3c48005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:28.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.195+0000 7f3c5d3e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3de248a30 0x55e3de25fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:28.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.195+0000 7f3c5d3e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3de248a30 0x55e3de25fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57224/0 (socket says 172.21.15.92:57224) 2024-09-19T09:07:28.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.195+0000 7f3c5d3e0640 1 -- 172.21.15.92:0/3848333229 learned_addr learned my addr 172.21.15.92:0/3848333229 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:28.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.195+0000 7f3c5d3e0640 1 --2- 172.21.15.92:0/3848333229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3de24cdc0 0x55e3de251490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:28.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.195+0000 7f3c5dbe1640 1 --2- 172.21.15.92:0/3848333229 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3de24c4a0 0x55e3de250f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:28.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.195+0000 7f3c5d3e0640 1 -- 172.21.15.92:0/3848333229 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3de24c4a0 msgr2=0x55e3de250f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:28.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.195+0000 7f3c5d3e0640 1 --2- 172.21.15.92:0/3848333229 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3de24c4a0 0x55e3de250f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.195+0000 7f3c5d3e0640 1 -- 172.21.15.92:0/3848333229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3de24cdc0 msgr2=0x55e3de251490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:28.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.195+0000 7f3c5d3e0640 1 --2- 172.21.15.92:0/3848333229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3de24cdc0 0x55e3de251490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.195+0000 7f3c5d3e0640 1 -- 172.21.15.92:0/3848333229 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3de251cc0 con 0x55e3de248a30 2024-09-19T09:07:28.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.195+0000 7f3c5d3e0640 1 --2- 172.21.15.92:0/3848333229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3de248a30 0x55e3de25fd60 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f3c48013fb0 tx=0x7f3c480096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fef8dd870d57e8d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:28.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.195+0000 7f3c417fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:07:28.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.196+0000 7f3c417fa640 1 -- 172.21.15.92:0/3848333229 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c48005a70 con 0x55e3de248a30 2024-09-19T09:07:28.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.196+0000 7f3c417fa640 1 -- 172.21.15.92:0/3848333229 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3c48013660 con 0x55e3de248a30 2024-09-19T09:07:28.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.196+0000 7f3c6221e740 1 -- 172.21.15.92:0/3848333229 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c540035f0 con 0x55e3de248a30 2024-09-19T09:07:28.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.196+0000 7f3c417fa640 1 -- 172.21.15.92:0/3848333229 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3c48005540 con 0x55e3de248a30 2024-09-19T09:07:28.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.196+0000 7f3c6221e740 10 client.17982 fetch_fsmap learned FSMap version 19 2024-09-19T09:07:28.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.196+0000 7f3c6221e740 1 -- 172.21.15.92:0/3848333229 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e3de2d2190 con 0x55e3de248a30 2024-09-19T09:07:28.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.196+0000 7f3c417fa640 1 -- 172.21.15.92:0/3848333229 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c48021940 con 0x55e3de248a30 2024-09-19T09:07:28.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.196+0000 7f3c417fa640 1 -- 172.21.15.92:0/3848333229 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f3c4802d630 con 0x55e3de248a30 2024-09-19T09:07:28.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.196+0000 7f3c6221e740 10 client.17982 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:07:28.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.196+0000 7f3c6221e740 10 client.17982 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:07:28.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.196+0000 7f3c6221e740 20 client.17982 populate_metadata read hostname 'smithi092' 2024-09-19T09:07:28.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.196+0000 7f3c6221e740 1 --2- 172.21.15.92:0/3848333229 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e3de257680 0x55e3de2d4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:28.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.197+0000 7f3c6221e740 4 client.17982 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:07:28.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.197+0000 7f3c6221e740 1 -- 172.21.15.92:0/3848333229 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f3c540035f0 con 0x55e3de257680 2024-09-19T09:07:28.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.197+0000 7f3c5dbe1640 1 --2- 172.21.15.92:0/3848333229 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e3de257680 0x55e3de2d4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:28.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.197+0000 7f3c5dbe1640 1 --2- 172.21.15.92:0/3848333229 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e3de257680 0x55e3de2d4860 crc :-1 s=READY pgs=336 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2cdc18bd9880f9a server_cookie=65871ba2fc341681 in_seq=0 out_seq=0 2024-09-19T09:07:28.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.197+0000 7f3c417fa640 10 client.17982 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:07:28.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.197+0000 7f3c417fa640 1 -- 172.21.15.92:0/3848333229 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f3c540035f0 con 0x55e3de257680 2024-09-19T09:07:28.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.197+0000 7f3c417fa640 10 client.17982 handle_command_reply: tid=0 2024-09-19T09:07:28.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.197+0000 7f3c6221e740 1 client.17982 shutdown 2024-09-19T09:07:28.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.198+0000 7f3c6221e740 1 -- 172.21.15.92:0/3848333229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3de248a30 msgr2=0x55e3de25fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:28.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.198+0000 7f3c6221e740 1 --2- 172.21.15.92:0/3848333229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3de248a30 0x55e3de25fd60 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f3c48013fb0 tx=0x7f3c480096c0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.198+0000 7f3c6221e740 1 -- 172.21.15.92:0/3848333229 shutdown_connections 2024-09-19T09:07:28.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.198+0000 7f3c6221e740 1 --2- 172.21.15.92:0/3848333229 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e3de257680 0x55e3de2d4860 crc :-1 s=READY pgs=336 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.198+0000 7f3c6221e740 1 --2- 172.21.15.92:0/3848333229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e3de24cdc0 0x55e3de251490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.198+0000 7f3c417fa640 0 client.17982 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:07:28.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.198+0000 7f3c6221e740 1 --2- 172.21.15.92:0/3848333229 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e3de24c4a0 0x55e3de250f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.198+0000 7f3c6221e740 1 --2- 172.21.15.92:0/3848333229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e3de248a30 0x55e3de25fd60 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.198+0000 7f3c6221e740 1 -- 172.21.15.92:0/3848333229 >> 172.21.15.92:0/3848333229 conn(0x55e3de254910 msgr2=0x55e3de247350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:28.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.198+0000 7f3c6221e740 1 -- 172.21.15.92:0/3848333229 shutdown_connections 2024-09-19T09:07:28.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.199+0000 7f3c6221e740 1 -- 172.21.15.92:0/3848333229 wait complete. 2024-09-19T09:07:28.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.200+0000 7f3c6221e740 20 client.17982 trim_cache size 0 max 16384 2024-09-19T09:07:28.203 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:07:28.203 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-19T09:07:28.203 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {} 2024-09-19T09:07:28.203 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:07:28.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.201+0000 7f3c5fe45640 1 -- 172.21.15.92:0/1443468335 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3c440a32c0 msgr2=0x7f3c440a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:28.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.201+0000 7f3c5fe45640 1 --2- 172.21.15.92:0/1443468335 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3c440a32c0 0x7f3c440a5780 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3c5001a040 tx=0x7f3c500108c0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.201+0000 7f3c5fe45640 1 -- 172.21.15.92:0/1443468335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c58106f20 msgr2=0x7f3c5810db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:28.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.201+0000 7f3c5fe45640 1 --2- 172.21.15.92:0/1443468335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c58106f20 0x7f3c5810db50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3c50009fd0 tx=0x7f3c5000ef10 comp rx=0 tx=0).stop 2024-09-19T09:07:28.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.201+0000 7f3c5fe45640 1 -- 172.21.15.92:0/1443468335 shutdown_connections 2024-09-19T09:07:28.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.201+0000 7f3c5fe45640 1 --2- 172.21.15.92:0/1443468335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c58106f20 0x7f3c5810db50 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.201+0000 7f3c5fe45640 1 --2- 172.21.15.92:0/1443468335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c581027a0 0x7f3c581a4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.201+0000 7f3c5fe45640 1 --2- 172.21.15.92:0/1443468335 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3c440a32c0 0x7f3c440a5780 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.201+0000 7f3c5fe45640 1 --2- 172.21.15.92:0/1443468335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c58101df0 0x7f3c581a47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.201+0000 7f3c5fe45640 1 -- 172.21.15.92:0/1443468335 >> 172.21.15.92:0/1443468335 conn(0x7f3c580fd8b0 msgr2=0x7f3c580feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:28.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.201+0000 7f3c5fe45640 1 -- 172.21.15.92:0/1443468335 shutdown_connections 2024-09-19T09:07:28.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:28.201+0000 7f3c5fe45640 1 -- 172.21.15.92:0/1443468335 wait complete. 2024-09-19T09:07:29.289 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:07:29.289 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:07:29.676 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:07:29.837 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:29 smithi092 ceph-mon[31407]: pgmap v660: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8.4 MiB/s wr, 690 op/s 2024-09-19T09:07:29.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:29 smithi167 ceph-mon[35359]: pgmap v660: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8.4 MiB/s wr, 690 op/s 2024-09-19T09:07:29.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:29 smithi190 ceph-mon[35358]: pgmap v660: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8.4 MiB/s wr, 690 op/s 2024-09-19T09:07:30.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.257+0000 7f200a7b5640 1 -- 172.21.15.92:0/307011121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2004074990 msgr2=0x7f200407b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:30.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.257+0000 7f200a7b5640 1 --2- 172.21.15.92:0/307011121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2004074990 0x7f200407b3c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc00afd0 tx=0x7f1ffc02a2e0 comp rx=0 tx=0).stop 2024-09-19T09:07:30.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.257+0000 7f200a7b5640 1 -- 172.21.15.92:0/307011121 shutdown_connections 2024-09-19T09:07:30.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.257+0000 7f200a7b5640 1 --2- 172.21.15.92:0/307011121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2004074990 0x7f200407b3c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:30.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.257+0000 7f200a7b5640 1 --2- 172.21.15.92:0/307011121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2004109e00 0x7f20040742d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:30.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.257+0000 7f200a7b5640 1 --2- 172.21.15.92:0/307011121 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2004109450 0x7f2004109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:30.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.257+0000 7f200a7b5640 1 -- 172.21.15.92:0/307011121 >> 172.21.15.92:0/307011121 conn(0x7f200406e140 msgr2=0x7f200406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:30.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.257+0000 7f200a7b5640 1 -- 172.21.15.92:0/307011121 shutdown_connections 2024-09-19T09:07:30.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.257+0000 7f200a7b5640 1 -- 172.21.15.92:0/307011121 wait complete. 2024-09-19T09:07:30.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.258+0000 7f200a7b5640 1 Processor -- start 2024-09-19T09:07:30.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.258+0000 7f200a7b5640 1 -- start start 2024-09-19T09:07:30.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.258+0000 7f200a7b5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2004074990 0x7f2004084be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:30.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.258+0000 7f200a7b5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2004109450 0x7f200407fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:30.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.258+0000 7f200a7b5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2004109e00 0x7f20040801b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:30.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.258+0000 7f200a7b5640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f200407e6d0 con 0x7f2004074990 2024-09-19T09:07:30.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.258+0000 7f200a7b5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f200407e550 con 0x7f2004109450 2024-09-19T09:07:30.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.258+0000 7f200a7b5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f200407e850 con 0x7f2004109e00 2024-09-19T09:07:30.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.259+0000 7f2003fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2004074990 0x7f2004084be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:30.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.259+0000 7f2003fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2004074990 0x7f2004084be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57256/0 (socket says 172.21.15.92:57256) 2024-09-19T09:07:30.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.259+0000 7f2003fff640 1 -- 172.21.15.92:0/429959371 learned_addr learned my addr 172.21.15.92:0/429959371 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:30.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.259+0000 7f2008d52640 1 --2- 172.21.15.92:0/429959371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2004109e00 0x7f20040801b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:30.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.259+0000 7f20037fe640 1 --2- 172.21.15.92:0/429959371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2004109450 0x7f200407fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:30.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.259+0000 7f2003fff640 1 -- 172.21.15.92:0/429959371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2004109e00 msgr2=0x7f20040801b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:30.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.259+0000 7f2003fff640 1 --2- 172.21.15.92:0/429959371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2004109e00 0x7f20040801b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:30.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.259+0000 7f2003fff640 1 -- 172.21.15.92:0/429959371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2004109450 msgr2=0x7f200407fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:30.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.259+0000 7f2003fff640 1 --2- 172.21.15.92:0/429959371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2004109450 0x7f200407fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:30.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.259+0000 7f2003fff640 1 -- 172.21.15.92:0/429959371 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2004080930 con 0x7f2004074990 2024-09-19T09:07:30.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.259+0000 7f2003fff640 1 --2- 172.21.15.92:0/429959371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2004074990 0x7f2004084be0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4009db0 tx=0x7f1ff400f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:30.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.259+0000 7f20017fa640 1 -- 172.21.15.92:0/429959371 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff400b030 con 0x7f2004074990 2024-09-19T09:07:30.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.259+0000 7f20017fa640 1 -- 172.21.15.92:0/429959371 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ff400b1d0 con 0x7f2004074990 2024-09-19T09:07:30.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.259+0000 7f200a7b5640 1 -- 172.21.15.92:0/429959371 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20041bbfa0 con 0x7f2004074990 2024-09-19T09:07:30.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.260+0000 7f20017fa640 1 -- 172.21.15.92:0/429959371 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff4004a00 con 0x7f2004074990 2024-09-19T09:07:30.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.260+0000 7f200a7b5640 1 -- 172.21.15.92:0/429959371 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20041bc400 con 0x7f2004074990 2024-09-19T09:07:30.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.261+0000 7f200a7b5640 1 -- 172.21.15.92:0/429959371 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2004073b00 con 0x7f2004074990 2024-09-19T09:07:30.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.262+0000 7f20017fa640 1 -- 172.21.15.92:0/429959371 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1ff401e020 con 0x7f2004074990 2024-09-19T09:07:30.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.263+0000 7f20017fa640 1 --2- 172.21.15.92:0/429959371 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1fec0a32c0 0x7f1fec0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:30.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.263+0000 7f20017fa640 1 -- 172.21.15.92:0/429959371 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1ff40d1be0 con 0x7f2004074990 2024-09-19T09:07:30.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.264+0000 7f20037fe640 1 --2- 172.21.15.92:0/429959371 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1fec0a32c0 0x7f1fec0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:30.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.264+0000 7f20037fe640 1 --2- 172.21.15.92:0/429959371 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1fec0a32c0 0x7f1fec0a5780 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2004081430 tx=0x7f1ff8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:30.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.269+0000 7f20017fa640 1 -- 172.21.15.92:0/429959371 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1ff4025030 con 0x7f2004074990 2024-09-19T09:07:30.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.578+0000 7f200a7b5640 1 -- 172.21.15.92:0/429959371 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20040811a0 con 0x7f2004074990 2024-09-19T09:07:30.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.580+0000 7f20017fa640 1 -- 172.21.15.92:0/429959371 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f1ff4012070 con 0x7f2004074990 2024-09-19T09:07:30.581 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:07:30.582 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:07:30.582 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:07:30.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.585+0000 7f200a7b5640 1 -- 172.21.15.92:0/429959371 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1fec0a32c0 msgr2=0x7f1fec0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:30.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.585+0000 7f200a7b5640 1 --2- 172.21.15.92:0/429959371 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1fec0a32c0 0x7f1fec0a5780 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2004081430 tx=0x7f1ff8005f90 comp rx=0 tx=0).stop 2024-09-19T09:07:30.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.585+0000 7f200a7b5640 1 -- 172.21.15.92:0/429959371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2004074990 msgr2=0x7f2004084be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:30.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.585+0000 7f200a7b5640 1 --2- 172.21.15.92:0/429959371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2004074990 0x7f2004084be0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4009db0 tx=0x7f1ff400f4a0 comp rx=0 tx=0).stop 2024-09-19T09:07:30.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.587+0000 7f200a7b5640 1 -- 172.21.15.92:0/429959371 shutdown_connections 2024-09-19T09:07:30.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.587+0000 7f200a7b5640 1 --2- 172.21.15.92:0/429959371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2004109e00 0x7f20040801b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:30.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.587+0000 7f200a7b5640 1 --2- 172.21.15.92:0/429959371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2004109450 0x7f200407fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:30.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.587+0000 7f200a7b5640 1 --2- 172.21.15.92:0/429959371 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1fec0a32c0 0x7f1fec0a5780 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:30.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.587+0000 7f200a7b5640 1 --2- 172.21.15.92:0/429959371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2004074990 0x7f2004084be0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:30.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.587+0000 7f200a7b5640 1 -- 172.21.15.92:0/429959371 >> 172.21.15.92:0/429959371 conn(0x7f200406e140 msgr2=0x7f20040723b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:30.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.591+0000 7f200a7b5640 1 -- 172.21.15.92:0/429959371 shutdown_connections 2024-09-19T09:07:30.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:30.593+0000 7f200a7b5640 1 -- 172.21.15.92:0/429959371 wait complete. 2024-09-19T09:07:30.795 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 645.0 s, 2528.4 tps, lat 39.449 ms stddev 45.137 2024-09-19T09:07:30.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:30 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/429959371' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:07:30.927 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:30 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/429959371' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:07:31.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:30 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/429959371' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:07:31.254 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:07:31.362 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.361+0000 7fcb0707b640 1 -- 172.21.15.92:0/3926706192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb000ff7a0 msgr2=0x7fcb000ffba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:31.362 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.361+0000 7fcb0707b640 1 --2- 172.21.15.92:0/3926706192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb000ff7a0 0x7fcb000ffba0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8009ca0 tx=0x7fcaf802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:07:31.362 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.361+0000 7fcb0707b640 1 -- 172.21.15.92:0/3926706192 shutdown_connections 2024-09-19T09:07:31.362 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.361+0000 7fcb0707b640 1 --2- 172.21.15.92:0/3926706192 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb00107820 0x7fcb00109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:31.362 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.361+0000 7fcb0707b640 1 --2- 172.21.15.92:0/3926706192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb00100170 0x7fcb001072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.361+0000 7fcb0707b640 1 --2- 172.21.15.92:0/3926706192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb000ff7a0 0x7fcb000ffba0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.361+0000 7fcb0707b640 1 -- 172.21.15.92:0/3926706192 >> 172.21.15.92:0/3926706192 conn(0x7fcb000fb500 msgr2=0x7fcb000fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.361+0000 7fcb0707b640 1 -- 172.21.15.92:0/3926706192 shutdown_connections 2024-09-19T09:07:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.361+0000 7fcb0707b640 1 -- 172.21.15.92:0/3926706192 wait complete. 2024-09-19T09:07:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.362+0000 7fcb0707b640 1 Processor -- start 2024-09-19T09:07:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.362+0000 7fcb0707b640 1 -- start start 2024-09-19T09:07:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.362+0000 7fcb0707b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb000ff7a0 0x7fcb00197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:31.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.362+0000 7fcb0707b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb00100170 0x7fcb001982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:31.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.362+0000 7fcb0707b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb00107820 0x7fcb0019f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:31.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.362+0000 7fcb0707b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcb0010d7c0 con 0x7fcb000ff7a0 2024-09-19T09:07:31.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.362+0000 7fcb04e17640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb000ff7a0 0x7fcb00197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:31.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.362+0000 7fcb0707b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcb0010d640 con 0x7fcb00100170 2024-09-19T09:07:31.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.362+0000 7fcb0707b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fcb0010d940 con 0x7fcb00107820 2024-09-19T09:07:31.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.362+0000 7fcb05618640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb00107820 0x7fcb0019f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:31.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.363+0000 7fcb04e17640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb000ff7a0 0x7fcb00197da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57272/0 (socket says 172.21.15.92:57272) 2024-09-19T09:07:31.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.363+0000 7fcb05618640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb00107820 0x7fcb0019f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:55408/0 (socket says 172.21.15.92:55408) 2024-09-19T09:07:31.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.363+0000 7fcb04e17640 1 -- 172.21.15.92:0/604960854 learned_addr learned my addr 172.21.15.92:0/604960854 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:31.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.363+0000 7fcafffff640 1 --2- 172.21.15.92:0/604960854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb00100170 0x7fcb001982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:31.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.363+0000 7fcafffff640 1 -- 172.21.15.92:0/604960854 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb00107820 msgr2=0x7fcb0019f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.363+0000 7fcafffff640 1 --2- 172.21.15.92:0/604960854 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb00107820 0x7fcb0019f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.363+0000 7fcafffff640 1 -- 172.21.15.92:0/604960854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb000ff7a0 msgr2=0x7fcb00197da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.363+0000 7fcafffff640 1 --2- 172.21.15.92:0/604960854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb000ff7a0 0x7fcb00197da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.363+0000 7fcafffff640 1 -- 172.21.15.92:0/604960854 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb0019f9b0 con 0x7fcb00100170 2024-09-19T09:07:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.363+0000 7fcb05618640 1 --2- 172.21.15.92:0/604960854 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb00107820 0x7fcb0019f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.363+0000 7fcafffff640 1 --2- 172.21.15.92:0/604960854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb00100170 0x7fcb001982e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000d6d0 tx=0x7fcaf000db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.364+0000 7fcb04e17640 1 --2- 172.21.15.92:0/604960854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb000ff7a0 0x7fcb00197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.364+0000 7fcafdffb640 1 -- 172.21.15.92:0/604960854 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0017070 con 0x7fcb00100170 2024-09-19T09:07:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.364+0000 7fcafdffb640 1 -- 172.21.15.92:0/604960854 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcaf0009820 con 0x7fcb00100170 2024-09-19T09:07:31.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.365+0000 7fcafdffb640 1 -- 172.21.15.92:0/604960854 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0004ce0 con 0x7fcb00100170 2024-09-19T09:07:31.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.366+0000 7fcb0707b640 1 -- 172.21.15.92:0/604960854 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb00101110 con 0x7fcb00100170 2024-09-19T09:07:31.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.366+0000 7fcb0707b640 1 -- 172.21.15.92:0/604960854 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb001015e0 con 0x7fcb00100170 2024-09-19T09:07:31.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.369+0000 7fcafdffb640 1 -- 172.21.15.92:0/604960854 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fcaf00099d0 con 0x7fcb00100170 2024-09-19T09:07:31.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.370+0000 7fcb09e19740 1 Processor -- start 2024-09-19T09:07:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.370+0000 7fcb09e19740 1 -- start start 2024-09-19T09:07:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.370+0000 7fcafdffb640 1 --2- 172.21.15.92:0/604960854 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcaf40a32b0 0x7fcaf40a5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.370+0000 7fcb09e19740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558d069999a0 0x558d06999da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.370+0000 7fcb09e19740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d0699a2e0 0x558d0699eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.370+0000 7fcb09e19740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d0699f370 0x558d069a1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.370+0000 7fcafdffb640 1 -- 172.21.15.92:0/604960854 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcaf00cf330 con 0x7fcb00100170 2024-09-19T09:07:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.370+0000 7fcb09e19740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558d068fd2f0 con 0x558d0699f370 2024-09-19T09:07:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.370+0000 7fcb09e19740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558d068a5270 con 0x558d0699a2e0 2024-09-19T09:07:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.370+0000 7fcb09e19740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x558d068f92b0 con 0x558d069999a0 2024-09-19T09:07:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.370+0000 7fcb05618640 1 --2- 172.21.15.92:0/604960854 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcaf40a32b0 0x7fcaf40a5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.370+0000 7fcb04e17640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558d069999a0 0x558d06999da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.370+0000 7fcb04e17640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558d069999a0 0x558d06999da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:55412/0 (socket says 172.21.15.92:55412) 2024-09-19T09:07:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.370+0000 7fcb04e17640 1 -- 172.21.15.92:0/1501644672 learned_addr learned my addr 172.21.15.92:0/1501644672 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:31.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.370+0000 7fcafffff640 1 --2- 172.21.15.92:0/1501644672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d0699a2e0 0x558d0699eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:31.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.371+0000 7fcb05618640 1 --2- 172.21.15.92:0/1501644672 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d0699f370 0x558d069a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:31.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.371+0000 7fcb04e17640 1 -- 172.21.15.92:0/1501644672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d0699a2e0 msgr2=0x558d0699eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:31.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.371+0000 7fcb04e17640 1 --2- 172.21.15.92:0/1501644672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d0699a2e0 0x558d0699eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:31.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.371+0000 7fcb04e17640 1 -- 172.21.15.92:0/1501644672 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d0699f370 msgr2=0x558d069a1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:31.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.371+0000 7fcb04e17640 1 --2- 172.21.15.92:0/1501644672 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d0699f370 0x558d069a1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:31.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.371+0000 7fcb04e17640 1 -- 172.21.15.92:0/1501644672 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d068a4340 con 0x558d069999a0 2024-09-19T09:07:31.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.371+0000 7fcb05618640 1 --2- 172.21.15.92:0/1501644672 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d0699f370 0x558d069a1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:07:31.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.371+0000 7fcb04e17640 1 --2- 172.21.15.92:0/1501644672 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558d069999a0 0x558d06999da0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcaf80097b0 tx=0x7fcaf8005fa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55f7dec4b0a692ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:31.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.371+0000 7fcaeeffd640 1 -- 172.21.15.92:0/1501644672 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8003970 con 0x558d069999a0 2024-09-19T09:07:31.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.371+0000 7fcaeeffd640 1 -- 172.21.15.92:0/1501644672 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcaf8036030 con 0x558d069999a0 2024-09-19T09:07:31.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.371+0000 7fcaeeffd640 1 -- 172.21.15.92:0/1501644672 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf80307e0 con 0x558d069999a0 2024-09-19T09:07:31.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.373+0000 7fcb09e19740 1 -- 172.21.15.92:0/1501644672 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558d069999a0 msgr2=0x558d06999da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:31.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.373+0000 7fcb05618640 1 --2- 172.21.15.92:0/604960854 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcaf40a32b0 0x7fcaf40a5770 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fcae8010fd0 tx=0x7fcae8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:31.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.373+0000 7fcb09e19740 1 --2- 172.21.15.92:0/1501644672 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558d069999a0 0x558d06999da0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcaf80097b0 tx=0x7fcaf8005fa0 comp rx=0 tx=0).stop 2024-09-19T09:07:31.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.373+0000 7fcb09e19740 1 -- 172.21.15.92:0/1501644672 shutdown_connections 2024-09-19T09:07:31.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.373+0000 7fcb09e19740 1 --2- 172.21.15.92:0/1501644672 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d0699f370 0x558d069a1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:31.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.373+0000 7fcb09e19740 1 --2- 172.21.15.92:0/1501644672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d0699a2e0 0x558d0699eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:31.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.373+0000 7fcb09e19740 1 --2- 172.21.15.92:0/1501644672 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558d069999a0 0x558d06999da0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:31.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.373+0000 7fcb09e19740 1 -- 172.21.15.92:0/1501644672 >> 172.21.15.92:0/1501644672 conn(0x558d06995010 msgr2=0x558d06995410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:31.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.374+0000 7fcb09e19740 1 -- 172.21.15.92:0/1501644672 shutdown_connections 2024-09-19T09:07:31.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.374+0000 7fcb09e19740 1 -- 172.21.15.92:0/1501644672 wait complete. 2024-09-19T09:07:31.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.374+0000 7fcb09e19740 1 -- start start 2024-09-19T09:07:31.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.375+0000 7fcb09e19740 1 Processor -- start 2024-09-19T09:07:31.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.375+0000 7fcb09e19740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d069999a0 0x558d069a3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:31.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.375+0000 7fcb09e19740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d0699a2e0 0x558d069a3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:31.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.375+0000 7fcb09e19740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558d0699f370 0x558d069aae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:31.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.375+0000 7fcb09e19740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558d069a2160 con 0x558d0699a2e0 2024-09-19T09:07:31.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.375+0000 7fcb09e19740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558d06886290 con 0x558d069999a0 2024-09-19T09:07:31.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.375+0000 7fcb09e19740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x558d069a22e0 con 0x558d0699f370 2024-09-19T09:07:31.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.375+0000 7fcb09e19740 10 client.0 _ll_register_callbacks cb 0x558d068b7140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:31.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.375+0000 7fcafffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d0699a2e0 0x558d069a3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:31.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.375+0000 7fcb05618640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558d0699f370 0x558d069aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:31.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.375+0000 7fcb05618640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558d0699f370 0x558d069aae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:55414/0 (socket says 172.21.15.92:55414) 2024-09-19T09:07:31.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.375+0000 7fcafffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d0699a2e0 0x558d069a3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57298/0 (socket says 172.21.15.92:57298) 2024-09-19T09:07:31.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.375+0000 7fcb05618640 1 -- 172.21.15.92:0/3549708373 learned_addr learned my addr 172.21.15.92:0/3549708373 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:31.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.375+0000 7fcb04e17640 1 --2- 172.21.15.92:0/3549708373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d069999a0 0x558d069a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:31.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.376+0000 7fcb05618640 1 -- 172.21.15.92:0/3549708373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d069999a0 msgr2=0x558d069a3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:31.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.376+0000 7fcb05618640 1 --2- 172.21.15.92:0/3549708373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d069999a0 0x558d069a3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:31.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.376+0000 7fcb05618640 1 -- 172.21.15.92:0/3549708373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d0699a2e0 msgr2=0x558d069a3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:31.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.376+0000 7fcb05618640 1 --2- 172.21.15.92:0/3549708373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d0699a2e0 0x558d069a3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:31.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.376+0000 7fcb05618640 1 -- 172.21.15.92:0/3549708373 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d06610210 con 0x558d0699f370 2024-09-19T09:07:31.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.376+0000 7fcb05618640 1 --2- 172.21.15.92:0/3549708373 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558d0699f370 0x558d069aae80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcae8012010 tx=0x7fcae8012040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3273bc31cef7872 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:31.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.376+0000 7fcadffff640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:07:31.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.376+0000 7fcadffff640 1 -- 172.21.15.92:0/3549708373 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae8023070 con 0x558d0699f370 2024-09-19T09:07:31.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.376+0000 7fcadffff640 1 -- 172.21.15.92:0/3549708373 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcae80037f0 con 0x558d0699f370 2024-09-19T09:07:31.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.376+0000 7fcb09e19740 1 -- 172.21.15.92:0/3549708373 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcaf8036030 con 0x558d0699f370 2024-09-19T09:07:31.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.376+0000 7fcadffff640 1 -- 172.21.15.92:0/3549708373 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fcae80039f0 con 0x558d0699f370 2024-09-19T09:07:31.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.376+0000 7fcb09e19740 10 client.27157 fetch_fsmap learned FSMap version 19 2024-09-19T09:07:31.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.376+0000 7fcb09e19740 1 -- 172.21.15.92:0/3549708373 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x558d066dc620 con 0x558d0699f370 2024-09-19T09:07:31.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.377+0000 7fcadffff640 1 -- 172.21.15.92:0/3549708373 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcaf8036030 con 0x558d0699f370 2024-09-19T09:07:31.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.377+0000 7fcadffff640 1 -- 172.21.15.92:0/3549708373 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fcae801f410 con 0x558d0699f370 2024-09-19T09:07:31.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.377+0000 7fcb09e19740 10 client.27157 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:07:31.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.377+0000 7fcb09e19740 10 client.27157 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:07:31.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.377+0000 7fcb09e19740 20 client.27157 populate_metadata read hostname 'smithi092' 2024-09-19T09:07:31.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.377+0000 7fcb09e19740 1 --2- 172.21.15.92:0/3549708373 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558d069b7dc0 0x558d069ba1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:31.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.377+0000 7fcb09e19740 4 client.27157 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:07:31.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.377+0000 7fcb09e19740 1 -- 172.21.15.92:0/3549708373 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d0690aa20 con 0x558d069b7dc0 2024-09-19T09:07:31.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.378+0000 7fcb04e17640 1 --2- 172.21.15.92:0/3549708373 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558d069b7dc0 0x558d069ba1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:31.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.378+0000 7fcb04e17640 1 --2- 172.21.15.92:0/3549708373 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558d069b7dc0 0x558d069ba1d0 crc :-1 s=READY pgs=337 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd854c1e9e814e8 server_cookie=f61f26421598a3ac in_seq=0 out_seq=0 2024-09-19T09:07:31.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.378+0000 7fcadffff640 10 client.27157 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:07:31.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.379+0000 7fcadffff640 1 -- 172.21.15.92:0/3549708373 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558d0690aa20 con 0x558d069b7dc0 2024-09-19T09:07:31.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.379+0000 7fcadffff640 10 client.27157 handle_command_reply: tid=0 2024-09-19T09:07:31.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.379+0000 7fcb09e19740 1 client.27157 shutdown 2024-09-19T09:07:31.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.379+0000 7fcb09e19740 1 -- 172.21.15.92:0/3549708373 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558d0699f370 msgr2=0x558d069aae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:31.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.379+0000 7fcb09e19740 1 --2- 172.21.15.92:0/3549708373 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558d0699f370 0x558d069aae80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcae8012010 tx=0x7fcae8012040 comp rx=0 tx=0).stop 2024-09-19T09:07:31.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.379+0000 7fcb09e19740 1 -- 172.21.15.92:0/3549708373 shutdown_connections 2024-09-19T09:07:31.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.379+0000 7fcb09e19740 1 --2- 172.21.15.92:0/3549708373 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558d069b7dc0 0x558d069ba1d0 crc :-1 s=READY pgs=337 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:31.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.379+0000 7fcadffff640 0 client.27157 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:07:31.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.379+0000 7fcb09e19740 1 --2- 172.21.15.92:0/3549708373 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558d0699f370 0x558d069aae80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:31.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.379+0000 7fcb09e19740 1 --2- 172.21.15.92:0/3549708373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d0699a2e0 0x558d069a3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:31.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.379+0000 7fcb09e19740 1 --2- 172.21.15.92:0/3549708373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d069999a0 0x558d069a3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:31.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.379+0000 7fcb09e19740 1 -- 172.21.15.92:0/3549708373 >> 172.21.15.92:0/3549708373 conn(0x558d06995010 msgr2=0x558d06996820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:31.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.379+0000 7fcb09e19740 1 -- 172.21.15.92:0/3549708373 shutdown_connections 2024-09-19T09:07:31.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.379+0000 7fcb09e19740 1 -- 172.21.15.92:0/3549708373 wait complete. 2024-09-19T09:07:31.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.380+0000 7fcb09e19740 20 client.27157 trim_cache size 0 max 16384 2024-09-19T09:07:31.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.409+0000 7fcb09e19740 1 Processor -- start 2024-09-19T09:07:31.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.409+0000 7fcb09e19740 1 -- start start 2024-09-19T09:07:31.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.409+0000 7fcb09e19740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d06995010 0x558d069ba1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:31.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.409+0000 7fcb09e19740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d069999a0 0x558d069aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:31.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.409+0000 7fcb09e19740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558d0699a2e0 0x558d06995ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:31.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.410+0000 7fcb09e19740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcb001a4b10 con 0x558d06995010 2024-09-19T09:07:31.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.410+0000 7fcafffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d069999a0 0x558d069aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:31.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.410+0000 7fcafffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d069999a0 0x558d069aae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:45540/0 (socket says 172.21.15.92:45540) 2024-09-19T09:07:31.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.410+0000 7fcafffff640 1 -- 172.21.15.92:0/741827299 learned_addr learned my addr 172.21.15.92:0/741827299 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:31.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.410+0000 7fcb09e19740 1 -- 172.21.15.92:0/741827299 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcb001a73b0 con 0x558d069999a0 2024-09-19T09:07:31.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.410+0000 7fcb05618640 1 --2- 172.21.15.92:0/741827299 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558d0699a2e0 0x558d06995ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:31.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.410+0000 7fcb09e19740 1 -- 172.21.15.92:0/741827299 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fcb001a51a0 con 0x558d0699a2e0 2024-09-19T09:07:31.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.413+0000 7fcafffff640 1 -- 172.21.15.92:0/741827299 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558d0699a2e0 msgr2=0x558d06995ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:31.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.413+0000 7fcafffff640 1 --2- 172.21.15.92:0/741827299 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558d0699a2e0 0x558d06995ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:31.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.413+0000 7fcafffff640 1 -- 172.21.15.92:0/741827299 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d06995010 msgr2=0x558d069ba1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:31.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.413+0000 7fcafffff640 1 --2- 172.21.15.92:0/741827299 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d06995010 0x558d069ba1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:31.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.413+0000 7fcafffff640 1 -- 172.21.15.92:0/741827299 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d06994e30 con 0x558d069999a0 2024-09-19T09:07:31.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.414+0000 7fcafffff640 1 --2- 172.21.15.92:0/741827299 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d069999a0 0x558d069aae40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0098310 tx=0x7fcaf009c0d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2ffa9a7d1bb6b7c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:31.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.418+0000 7fcaee7fc640 1 -- 172.21.15.92:0/741827299 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf00a4640 con 0x558d069999a0 2024-09-19T09:07:31.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.418+0000 7fcaee7fc640 1 -- 172.21.15.92:0/741827299 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcaf0005430 con 0x558d069999a0 2024-09-19T09:07:31.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.418+0000 7fcaee7fc640 1 -- 172.21.15.92:0/741827299 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf00b4e30 con 0x558d069999a0 2024-09-19T09:07:31.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.420+0000 7fcb09e19740 1 -- 172.21.15.92:0/741827299 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d069999a0 msgr2=0x558d069aae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:31.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.420+0000 7fcb09e19740 1 --2- 172.21.15.92:0/741827299 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d069999a0 0x558d069aae40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0098310 tx=0x7fcaf009c0d0 comp rx=0 tx=0).stop 2024-09-19T09:07:31.436 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.435+0000 7fcb09e19740 1 -- 172.21.15.92:0/741827299 shutdown_connections 2024-09-19T09:07:31.436 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.435+0000 7fcb09e19740 1 --2- 172.21.15.92:0/741827299 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558d0699a2e0 0x558d06995ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:31.436 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.435+0000 7fcb09e19740 1 --2- 172.21.15.92:0/741827299 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d069999a0 0x558d069aae40 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:31.436 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.435+0000 7fcb09e19740 1 --2- 172.21.15.92:0/741827299 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d06995010 0x558d069ba1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:31.436 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.435+0000 7fcb09e19740 1 -- 172.21.15.92:0/741827299 >> 172.21.15.92:0/741827299 conn(0x558d0699ee90 msgr2=0x558d0699b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:31.437 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.436+0000 7fcb09e19740 1 -- 172.21.15.92:0/741827299 shutdown_connections 2024-09-19T09:07:31.437 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.436+0000 7fcb09e19740 1 -- 172.21.15.92:0/741827299 wait complete. 2024-09-19T09:07:31.437 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.436+0000 7fcb09e19740 1 -- start start 2024-09-19T09:07:31.437 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.436+0000 7fcb09e19740 1 Processor -- start 2024-09-19T09:07:31.437 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.437+0000 7fcb09e19740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d06995010 0x558d069a80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:31.437 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.437+0000 7fcb09e19740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558d069999a0 0x558d069a8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:31.439 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.438+0000 7fcb04e17640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d06995010 0x558d069a80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:31.439 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.438+0000 7fcb04e17640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d06995010 0x558d069a80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:45542/0 (socket says 172.21.15.92:45542) 2024-09-19T09:07:31.439 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.438+0000 7fcb04e17640 1 -- 172.21.15.92:0/3737339494 learned_addr learned my addr 172.21.15.92:0/3737339494 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:31.439 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.438+0000 7fcb09e19740 1 --2- 172.21.15.92:0/3737339494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d0699a2e0 0x558d069a9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:31.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.439+0000 7fcafffff640 1 --2- 172.21.15.92:0/3737339494 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558d069999a0 0x558d069a8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:31.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.439+0000 7fcb05618640 1 --2- 172.21.15.92:0/3737339494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d0699a2e0 0x558d069a9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:31.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.439+0000 7fcb09e19740 1 -- 172.21.15.92:0/3737339494 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcb001a5870 con 0x558d0699a2e0 2024-09-19T09:07:31.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.439+0000 7fcb09e19740 1 -- 172.21.15.92:0/3737339494 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcb001a6ce0 con 0x558d06995010 2024-09-19T09:07:31.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.439+0000 7fcb09e19740 1 -- 172.21.15.92:0/3737339494 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fcb001a5f40 con 0x558d069999a0 2024-09-19T09:07:31.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.439+0000 7fcb09e19740 10 client.0 _ll_register_callbacks cb 0x7fcae8009650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:31.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.442+0000 7fcafffff640 1 -- 172.21.15.92:0/3737339494 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d06995010 msgr2=0x558d069a80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:31.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.442+0000 7fcafffff640 1 --2- 172.21.15.92:0/3737339494 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d06995010 0x558d069a80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:31.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.442+0000 7fcafffff640 1 -- 172.21.15.92:0/3737339494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d0699a2e0 msgr2=0x558d069a9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:31.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.442+0000 7fcafffff640 1 --2- 172.21.15.92:0/3737339494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d0699a2e0 0x558d069a9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:31.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.442+0000 7fcafffff640 1 -- 172.21.15.92:0/3737339494 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d069a9c50 con 0x558d069999a0 2024-09-19T09:07:31.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.442+0000 7fcafffff640 1 --2- 172.21.15.92:0/3737339494 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558d069999a0 0x558d069a8630 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcaf009b6d0 tx=0x7fcaf0009ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=227b1ae5f65a1f27 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:31.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.443+0000 7fcadffff640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:07:31.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.449+0000 7fcadffff640 1 -- 172.21.15.92:0/3737339494 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf00aa070 con 0x558d069999a0 2024-09-19T09:07:31.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.449+0000 7fcb09e19740 1 -- 172.21.15.92:0/3737339494 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcaf0005430 con 0x558d069999a0 2024-09-19T09:07:31.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.449+0000 7fcadffff640 1 -- 172.21.15.92:0/3737339494 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcaf009ae20 con 0x558d069999a0 2024-09-19T09:07:31.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.452+0000 7fcadffff640 1 -- 172.21.15.92:0/3737339494 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fcaf0081050 con 0x558d069999a0 2024-09-19T09:07:31.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.452+0000 7fcb09e19740 10 client.27163 fetch_fsmap learned FSMap version 19 2024-09-19T09:07:31.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.452+0000 7fcb09e19740 1 -- 172.21.15.92:0/3737339494 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x558d069aaf60 con 0x558d069999a0 2024-09-19T09:07:31.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.453+0000 7fcadffff640 1 -- 172.21.15.92:0/3737339494 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcaf0005430 con 0x558d069999a0 2024-09-19T09:07:31.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.453+0000 7fcadffff640 1 -- 172.21.15.92:0/3737339494 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fcaf00ce040 con 0x558d069999a0 2024-09-19T09:07:31.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.453+0000 7fcb09e19740 10 client.27163 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:07:31.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.453+0000 7fcb09e19740 10 client.27163 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:07:31.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.453+0000 7fcb09e19740 20 client.27163 populate_metadata read hostname 'smithi092' 2024-09-19T09:07:31.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.453+0000 7fcb09e19740 1 --2- 172.21.15.92:0/3737339494 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558d0699f370 0x558d06a25070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:31.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.453+0000 7fcb09e19740 4 client.27163 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:07:31.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.453+0000 7fcb09e19740 1 -- 172.21.15.92:0/3737339494 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558d06904d70 con 0x558d0699f370 2024-09-19T09:07:31.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.453+0000 7fcb04e17640 1 --2- 172.21.15.92:0/3737339494 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558d0699f370 0x558d06a25070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:31.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.454+0000 7fcadffff640 10 client.27163 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:07:31.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.454+0000 7fcb04e17640 1 --2- 172.21.15.92:0/3737339494 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558d0699f370 0x558d06a25070 crc :-1 s=READY pgs=338 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=468edb947fa9c566 server_cookie=b5348630c1dca43a in_seq=0 out_seq=0 2024-09-19T09:07:31.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.470+0000 7fcadffff640 1 -- 172.21.15.92:0/3737339494 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558d06904d70 con 0x558d0699f370 2024-09-19T09:07:31.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.471+0000 7fcadffff640 10 client.27163 handle_command_reply: tid=0 2024-09-19T09:07:31.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.471+0000 7fcb09e19740 1 client.27163 shutdown 2024-09-19T09:07:31.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.473+0000 7fcb09e19740 1 -- 172.21.15.92:0/3737339494 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558d069999a0 msgr2=0x558d069a8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:31.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.473+0000 7fcb09e19740 1 --2- 172.21.15.92:0/3737339494 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558d069999a0 0x558d069a8630 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcaf009b6d0 tx=0x7fcaf0009ef0 comp rx=0 tx=0).stop 2024-09-19T09:07:31.476 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.476+0000 7fcb09e19740 1 -- 172.21.15.92:0/3737339494 shutdown_connections 2024-09-19T09:07:31.476 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.476+0000 7fcb09e19740 1 --2- 172.21.15.92:0/3737339494 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x558d0699f370 0x558d06a25070 crc :-1 s=READY pgs=338 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:31.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.476+0000 7fcb09e19740 1 --2- 172.21.15.92:0/3737339494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d0699a2e0 0x558d069a9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:31.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.476+0000 7fcb09e19740 1 --2- 172.21.15.92:0/3737339494 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558d069999a0 0x558d069a8630 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:31.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.476+0000 7fcb09e19740 1 --2- 172.21.15.92:0/3737339494 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d06995010 0x558d069a80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:31.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.476+0000 7fcb09e19740 1 -- 172.21.15.92:0/3737339494 >> 172.21.15.92:0/3737339494 conn(0x558d0699ee90 msgr2=0x558d069a3900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:31.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.476+0000 7fcadffff640 0 client.27163 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:07:31.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.477+0000 7fcb09e19740 1 -- 172.21.15.92:0/3737339494 shutdown_connections 2024-09-19T09:07:31.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.477+0000 7fcb09e19740 1 -- 172.21.15.92:0/3737339494 wait complete. 2024-09-19T09:07:31.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.477+0000 7fcb09e19740 20 client.27163 trim_cache size 0 max 16384 2024-09-19T09:07:31.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:07:31.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:07:31.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:07:31.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:07:31.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.478+0000 7fcb0707b640 1 -- 172.21.15.92:0/604960854 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcaf40a32b0 msgr2=0x7fcaf40a5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:31.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.478+0000 7fcb0707b640 1 --2- 172.21.15.92:0/604960854 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcaf40a32b0 0x7fcaf40a5770 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fcae8010fd0 tx=0x7fcae8005f90 comp rx=0 tx=0).stop 2024-09-19T09:07:31.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.478+0000 7fcb0707b640 1 -- 172.21.15.92:0/604960854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb00100170 msgr2=0x7fcb001982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:31.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.478+0000 7fcb0707b640 1 --2- 172.21.15.92:0/604960854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb00100170 0x7fcb001982e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000d6d0 tx=0x7fcaf000db90 comp rx=0 tx=0).stop 2024-09-19T09:07:31.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.478+0000 7fcb0707b640 1 -- 172.21.15.92:0/604960854 shutdown_connections 2024-09-19T09:07:31.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.478+0000 7fcb0707b640 1 --2- 172.21.15.92:0/604960854 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb00107820 0x7fcb0019f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:31.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.478+0000 7fcb0707b640 1 --2- 172.21.15.92:0/604960854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb00100170 0x7fcb001982e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:31.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.478+0000 7fcb0707b640 1 --2- 172.21.15.92:0/604960854 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcaf40a32b0 0x7fcaf40a5770 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:31.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.478+0000 7fcb0707b640 1 --2- 172.21.15.92:0/604960854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb000ff7a0 0x7fcb00197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:31.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.478+0000 7fcb0707b640 1 -- 172.21.15.92:0/604960854 >> 172.21.15.92:0/604960854 conn(0x7fcb000fb500 msgr2=0x7fcb001032c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:31.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.478+0000 7fcb0707b640 1 -- 172.21.15.92:0/604960854 shutdown_connections 2024-09-19T09:07:31.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:31.478+0000 7fcb0707b640 1 -- 172.21.15.92:0/604960854 wait complete. 2024-09-19T09:07:31.696 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:07:31.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:31 smithi190 ceph-mon[35358]: pgmap v661: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8.9 MiB/s wr, 748 op/s 2024-09-19T09:07:31.962 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:31 smithi092 ceph-mon[31407]: pgmap v661: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8.9 MiB/s wr, 748 op/s 2024-09-19T09:07:32.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:31 smithi167 ceph-mon[35359]: pgmap v661: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8.9 MiB/s wr, 748 op/s 2024-09-19T09:07:32.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.207+0000 7efe4cc6e640 1 -- 172.21.15.92:0/2060853256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe48106b80 msgr2=0x7efe48106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:32.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.207+0000 7efe4cc6e640 1 --2- 172.21.15.92:0/2060853256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe48106b80 0x7efe48106f60 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7efe38009900 tx=0x7efe3802a410 comp rx=0 tx=0).stop 2024-09-19T09:07:32.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.207+0000 7efe4cc6e640 1 -- 172.21.15.92:0/2060853256 shutdown_connections 2024-09-19T09:07:32.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.207+0000 7efe4cc6e640 1 --2- 172.21.15.92:0/2060853256 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efe48100aa0 0x7efe4810ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:32.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.207+0000 7efe4cc6e640 1 --2- 172.21.15.92:0/2060853256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe48100100 0x7efe48100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:32.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.207+0000 7efe4cc6e640 1 --2- 172.21.15.92:0/2060853256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe48106b80 0x7efe48106f60 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:32.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.207+0000 7efe4cc6e640 1 -- 172.21.15.92:0/2060853256 >> 172.21.15.92:0/2060853256 conn(0x7efe48077230 msgr2=0x7efe480fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:32.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.207+0000 7efe4cc6e640 1 -- 172.21.15.92:0/2060853256 shutdown_connections 2024-09-19T09:07:32.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.207+0000 7efe4cc6e640 1 -- 172.21.15.92:0/2060853256 wait complete. 2024-09-19T09:07:32.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.208+0000 7efe4cc6e640 1 Processor -- start 2024-09-19T09:07:32.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.208+0000 7efe4cc6e640 1 -- start start 2024-09-19T09:07:32.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.208+0000 7efe4cc6e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe48100100 0x7efe48198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:32.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.208+0000 7efe4cc6e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe48100aa0 0x7efe48198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:32.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.208+0000 7efe4cc6e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efe48106b80 0x7efe4819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:32.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.208+0000 7efe4cc6e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efe481120a0 con 0x7efe48100aa0 2024-09-19T09:07:32.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.208+0000 7efe4cc6e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efe48111f20 con 0x7efe48100100 2024-09-19T09:07:32.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.208+0000 7efe4cc6e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7efe48112220 con 0x7efe48106b80 2024-09-19T09:07:32.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.208+0000 7efe3ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe48100aa0 0x7efe48198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:32.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.208+0000 7efe3ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe48100aa0 0x7efe48198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36146/0 (socket says 172.21.15.92:36146) 2024-09-19T09:07:32.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.208+0000 7efe3ffff640 1 -- 172.21.15.92:0/2818985127 learned_addr learned my addr 172.21.15.92:0/2818985127 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:32.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.208+0000 7efe4659c640 1 --2- 172.21.15.92:0/2818985127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe48100100 0x7efe48198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:32.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.209+0000 7efe46d9d640 1 --2- 172.21.15.92:0/2818985127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efe48106b80 0x7efe4819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:32.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.209+0000 7efe3ffff640 1 -- 172.21.15.92:0/2818985127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efe48106b80 msgr2=0x7efe4819cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:32.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.209+0000 7efe3ffff640 1 --2- 172.21.15.92:0/2818985127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efe48106b80 0x7efe4819cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:32.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.209+0000 7efe3ffff640 1 -- 172.21.15.92:0/2818985127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe48100100 msgr2=0x7efe48198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:32.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.209+0000 7efe3ffff640 1 --2- 172.21.15.92:0/2818985127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe48100100 0x7efe48198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:32.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.209+0000 7efe3ffff640 1 -- 172.21.15.92:0/2818985127 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe4819d4b0 con 0x7efe48100aa0 2024-09-19T09:07:32.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.209+0000 7efe4659c640 1 --2- 172.21.15.92:0/2818985127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe48100100 0x7efe48198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:07:32.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.209+0000 7efe3ffff640 1 --2- 172.21.15.92:0/2818985127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe48100aa0 0x7efe48198a40 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7efe3000e9f0 tx=0x7efe3000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:32.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.210+0000 7efe3f7fe640 1 -- 172.21.15.92:0/2818985127 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3000cd80 con 0x7efe48100aa0 2024-09-19T09:07:32.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.210+0000 7efe3f7fe640 1 -- 172.21.15.92:0/2818985127 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe30010910 con 0x7efe48100aa0 2024-09-19T09:07:32.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.210+0000 7efe4cc6e640 1 -- 172.21.15.92:0/2818985127 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe4819d7a0 con 0x7efe48100aa0 2024-09-19T09:07:32.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.210+0000 7efe4cc6e640 1 -- 172.21.15.92:0/2818985127 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe481a5080 con 0x7efe48100aa0 2024-09-19T09:07:32.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.210+0000 7efe3f7fe640 1 -- 172.21.15.92:0/2818985127 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe30018990 con 0x7efe48100aa0 2024-09-19T09:07:32.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.213+0000 7efe3f7fe640 1 -- 172.21.15.92:0/2818985127 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7efe30018c10 con 0x7efe48100aa0 2024-09-19T09:07:32.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.215+0000 7efe4f047740 1 Processor -- start 2024-09-19T09:07:32.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.215+0000 7efe3f7fe640 1 --2- 172.21.15.92:0/2818985127 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efe340a3390 0x7efe340a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:32.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.215+0000 7efe4f047740 1 -- start start 2024-09-19T09:07:32.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.216+0000 7efe46d9d640 1 --2- 172.21.15.92:0/2818985127 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efe340a3390 0x7efe340a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:32.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.216+0000 7efe4f047740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e1584eb40 0x559e1584d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:32.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.216+0000 7efe4f047740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e1584d5d0 0x559e1584da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:32.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.216+0000 7efe4f047740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e15858370 0x559e1585a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:32.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.216+0000 7efe4f047740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559e157b32f0 con 0x559e1584eb40 2024-09-19T09:07:32.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.216+0000 7efe4f047740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559e1575acf0 con 0x559e1584d5d0 2024-09-19T09:07:32.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.216+0000 7efe4f047740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x559e157af2b0 con 0x559e15858370 2024-09-19T09:07:32.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.216+0000 7efe4659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e1584eb40 0x559e1584d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:32.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.216+0000 7efe3ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e1584d5d0 0x559e1584da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:32.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.216+0000 7efe4659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e1584eb40 0x559e1584d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36162/0 (socket says 172.21.15.92:36162) 2024-09-19T09:07:32.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.216+0000 7efe4659c640 1 -- 172.21.15.92:0/1788245156 learned_addr learned my addr 172.21.15.92:0/1788245156 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:32.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.216+0000 7efe46d9d640 1 --2- 172.21.15.92:0/1788245156 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e15858370 0x559e1585a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:32.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.216+0000 7efe3ffff640 1 -- 172.21.15.92:0/1788245156 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e15858370 msgr2=0x559e1585a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:32.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.216+0000 7efe3ffff640 1 --2- 172.21.15.92:0/1788245156 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e15858370 0x559e1585a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:32.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.216+0000 7efe3ffff640 1 -- 172.21.15.92:0/1788245156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e1584eb40 msgr2=0x559e1584d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:32.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.216+0000 7efe3ffff640 1 --2- 172.21.15.92:0/1788245156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e1584eb40 0x559e1584d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:32.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.216+0000 7efe3ffff640 1 -- 172.21.15.92:0/1788245156 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e1573f3a0 con 0x559e1584d5d0 2024-09-19T09:07:32.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.216+0000 7efe46d9d640 1 --2- 172.21.15.92:0/1788245156 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e15858370 0x559e1585a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:07:32.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.217+0000 7efe3f7fe640 1 -- 172.21.15.92:0/2818985127 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7efe300cfba0 con 0x7efe48100aa0 2024-09-19T09:07:32.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.217+0000 7efe46d9d640 1 --2- 172.21.15.92:0/2818985127 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efe340a3390 0x7efe340a5850 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7efe481077c0 tx=0x7efe40009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:32.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.217+0000 7efe3ffff640 1 --2- 172.21.15.92:0/1788245156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e1584d5d0 0x559e1584da10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7efe300a4900 tx=0x7efe3006f180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b99c03dcfd160076 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:32.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.217+0000 7efe3cff9640 1 -- 172.21.15.92:0/1788245156 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe300bd740 con 0x559e1584d5d0 2024-09-19T09:07:32.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.217+0000 7efe3cff9640 1 -- 172.21.15.92:0/1788245156 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe3009c8c0 con 0x559e1584d5d0 2024-09-19T09:07:32.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.217+0000 7efe3cff9640 1 -- 172.21.15.92:0/1788245156 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe300cd880 con 0x559e1584d5d0 2024-09-19T09:07:32.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.218+0000 7efe4f047740 1 -- 172.21.15.92:0/1788245156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e1584d5d0 msgr2=0x559e1584da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:32.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.218+0000 7efe4f047740 1 --2- 172.21.15.92:0/1788245156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e1584d5d0 0x559e1584da10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7efe300a4900 tx=0x7efe3006f180 comp rx=0 tx=0).stop 2024-09-19T09:07:32.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.218+0000 7efe4f047740 1 -- 172.21.15.92:0/1788245156 shutdown_connections 2024-09-19T09:07:32.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.218+0000 7efe4f047740 1 --2- 172.21.15.92:0/1788245156 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e15858370 0x559e1585a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:32.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.218+0000 7efe4f047740 1 --2- 172.21.15.92:0/1788245156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e1584d5d0 0x559e1584da10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:32.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.218+0000 7efe4f047740 1 --2- 172.21.15.92:0/1788245156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e1584eb40 0x559e1584d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:32.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.218+0000 7efe4f047740 1 -- 172.21.15.92:0/1788245156 >> 172.21.15.92:0/1788245156 conn(0x559e15816310 msgr2=0x559e15849c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:32.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.219+0000 7efe4f047740 1 -- 172.21.15.92:0/1788245156 shutdown_connections 2024-09-19T09:07:32.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.220+0000 7efe4f047740 1 -- 172.21.15.92:0/1788245156 wait complete. 2024-09-19T09:07:32.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.220+0000 7efe4f047740 1 -- start start 2024-09-19T09:07:32.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.220+0000 7efe4f047740 1 Processor -- start 2024-09-19T09:07:32.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.220+0000 7efe4f047740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e1584d5d0 0x559e15857d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:32.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.221+0000 7efe4f047740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e1584eb40 0x559e15854fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:32.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.221+0000 7efe4f047740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e15858370 0x559e158555d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:32.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.221+0000 7efe4f047740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559e1585f480 con 0x559e1584eb40 2024-09-19T09:07:32.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.221+0000 7efe4f047740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559e1576e060 con 0x559e15858370 2024-09-19T09:07:32.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.221+0000 7efe4f047740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x559e1585f600 con 0x559e1584d5d0 2024-09-19T09:07:32.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.221+0000 7efe4f047740 10 client.0 _ll_register_callbacks cb 0x559e154c18c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:32.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.221+0000 7efe4659c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e1584d5d0 0x559e15857d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:32.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.221+0000 7efe4659c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e1584d5d0 0x559e15857d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:47056/0 (socket says 172.21.15.92:47056) 2024-09-19T09:07:32.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.221+0000 7efe4659c640 1 -- 172.21.15.92:0/3237293233 learned_addr learned my addr 172.21.15.92:0/3237293233 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:32.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.221+0000 7efe3ffff640 1 --2- 172.21.15.92:0/3237293233 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e1584eb40 0x559e15854fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:32.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.221+0000 7efe46d9d640 1 --2- 172.21.15.92:0/3237293233 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e15858370 0x559e158555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:32.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.221+0000 7efe4659c640 1 -- 172.21.15.92:0/3237293233 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e15858370 msgr2=0x559e158555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:32.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.221+0000 7efe4659c640 1 --2- 172.21.15.92:0/3237293233 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e15858370 0x559e158555d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:32.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.221+0000 7efe4659c640 1 -- 172.21.15.92:0/3237293233 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e1584eb40 msgr2=0x559e15854fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:32.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.221+0000 7efe4659c640 1 --2- 172.21.15.92:0/3237293233 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e1584eb40 0x559e15854fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:32.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.221+0000 7efe4659c640 1 -- 172.21.15.92:0/3237293233 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e155243c0 con 0x559e1584d5d0 2024-09-19T09:07:32.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.221+0000 7efe3ffff640 1 --2- 172.21.15.92:0/3237293233 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e1584eb40 0x559e15854fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:32.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.221+0000 7efe4659c640 1 --2- 172.21.15.92:0/3237293233 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e1584d5d0 0x559e15857d30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7efe3802aa00 tx=0x7efe38005270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60a16ddc09e300f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:32.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.221+0000 7efe2dffb640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:07:32.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.222+0000 7efe2dffb640 1 -- 172.21.15.92:0/3237293233 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe38035040 con 0x559e1584d5d0 2024-09-19T09:07:32.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.222+0000 7efe2dffb640 1 -- 172.21.15.92:0/3237293233 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7efe380048c0 con 0x559e1584d5d0 2024-09-19T09:07:32.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.222+0000 7efe4f047740 1 -- 172.21.15.92:0/3237293233 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe3009c8c0 con 0x559e1584d5d0 2024-09-19T09:07:32.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.222+0000 7efe2dffb640 1 -- 172.21.15.92:0/3237293233 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7efe38005d50 con 0x559e1584d5d0 2024-09-19T09:07:32.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.222+0000 7efe4f047740 10 client.27175 fetch_fsmap learned FSMap version 19 2024-09-19T09:07:32.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.222+0000 7efe4f047740 1 -- 172.21.15.92:0/3237293233 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x559e1586af40 con 0x559e1584d5d0 2024-09-19T09:07:32.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.222+0000 7efe2dffb640 1 -- 172.21.15.92:0/3237293233 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe38040070 con 0x559e1584d5d0 2024-09-19T09:07:32.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.222+0000 7efe2dffb640 1 -- 172.21.15.92:0/3237293233 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7efe38003cd0 con 0x559e1584d5d0 2024-09-19T09:07:32.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.222+0000 7efe4f047740 10 client.27175 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:07:32.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.222+0000 7efe4f047740 10 client.27175 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:07:32.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.222+0000 7efe4f047740 20 client.27175 populate_metadata read hostname 'smithi092' 2024-09-19T09:07:32.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.222+0000 7efe4f047740 1 --2- 172.21.15.92:0/3237293233 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559e1586c350 0x559e1586e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:32.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.223+0000 7efe4f047740 4 client.27175 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:07:32.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.223+0000 7efe4f047740 1 -- 172.21.15.92:0/3237293233 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7efe3009c8c0 con 0x559e1586c350 2024-09-19T09:07:32.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.223+0000 7efe3ffff640 1 --2- 172.21.15.92:0/3237293233 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559e1586c350 0x559e1586e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:32.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.224+0000 7efe3ffff640 1 --2- 172.21.15.92:0/3237293233 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559e1586c350 0x559e1586e790 crc :-1 s=READY pgs=339 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3134b4753194be97 server_cookie=7c7fc95be0fc108b in_seq=0 out_seq=0 2024-09-19T09:07:32.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.224+0000 7efe2dffb640 10 client.27175 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:07:32.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.225+0000 7efe2dffb640 1 -- 172.21.15.92:0/3237293233 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7efe3009c8c0 con 0x559e1586c350 2024-09-19T09:07:32.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.225+0000 7efe2dffb640 10 client.27175 handle_command_reply: tid=0 2024-09-19T09:07:32.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.225+0000 7efe4f047740 1 client.27175 shutdown 2024-09-19T09:07:32.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.225+0000 7efe4f047740 1 -- 172.21.15.92:0/3237293233 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e1584d5d0 msgr2=0x559e15857d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:32.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.225+0000 7efe4f047740 1 --2- 172.21.15.92:0/3237293233 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e1584d5d0 0x559e15857d30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7efe3802aa00 tx=0x7efe38005270 comp rx=0 tx=0).stop 2024-09-19T09:07:32.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.225+0000 7efe4f047740 1 -- 172.21.15.92:0/3237293233 shutdown_connections 2024-09-19T09:07:32.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.225+0000 7efe4f047740 1 --2- 172.21.15.92:0/3237293233 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559e1586c350 0x559e1586e790 crc :-1 s=READY pgs=339 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:32.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.225+0000 7efe4f047740 1 --2- 172.21.15.92:0/3237293233 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e15858370 0x559e158555d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:32.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.225+0000 7efe4f047740 1 --2- 172.21.15.92:0/3237293233 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e1584eb40 0x559e15854fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:32.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.225+0000 7efe2dffb640 0 client.27175 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:07:32.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.225+0000 7efe4f047740 1 --2- 172.21.15.92:0/3237293233 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e1584d5d0 0x559e15857d30 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:32.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.225+0000 7efe4f047740 1 -- 172.21.15.92:0/3237293233 >> 172.21.15.92:0/3237293233 conn(0x559e15816310 msgr2=0x559e1584f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:32.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.225+0000 7efe4f047740 1 -- 172.21.15.92:0/3237293233 shutdown_connections 2024-09-19T09:07:32.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.225+0000 7efe4f047740 1 -- 172.21.15.92:0/3237293233 wait complete. 2024-09-19T09:07:32.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.226+0000 7efe4f047740 20 client.27175 trim_cache size 0 max 16384 2024-09-19T09:07:32.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.251+0000 7efe4f047740 1 Processor -- start 2024-09-19T09:07:32.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.253+0000 7efe4f047740 1 -- start start 2024-09-19T09:07:32.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.253+0000 7efe4f047740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e1584d5d0 0x559e15849e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:32.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.253+0000 7efe4f047740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e1584eb40 0x559e15868780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:32.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.253+0000 7efe4f047740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e15858370 0x559e15874060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:32.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.253+0000 7efe4f047740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efe2800c460 con 0x559e15858370 2024-09-19T09:07:32.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.253+0000 7efe4f047740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efe2800ed00 con 0x559e1584d5d0 2024-09-19T09:07:32.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.253+0000 7efe4f047740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7efe2800caf0 con 0x559e1584eb40 2024-09-19T09:07:32.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.253+0000 7efe3ffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e1584eb40 0x559e15868780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:32.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.253+0000 7efe4659c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e1584d5d0 0x559e15849e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:32.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.253+0000 7efe3ffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e1584eb40 0x559e15868780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:47068/0 (socket says 172.21.15.92:47068) 2024-09-19T09:07:32.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.253+0000 7efe3ffff640 1 -- 172.21.15.92:0/201755686 learned_addr learned my addr 172.21.15.92:0/201755686 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:32.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.254+0000 7efe46d9d640 1 --2- 172.21.15.92:0/201755686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e15858370 0x559e15874060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:32.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.255+0000 7efe46d9d640 1 -- 172.21.15.92:0/201755686 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e1584eb40 msgr2=0x559e15868780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:32.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.255+0000 7efe46d9d640 1 --2- 172.21.15.92:0/201755686 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e1584eb40 0x559e15868780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:32.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.255+0000 7efe46d9d640 1 -- 172.21.15.92:0/201755686 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e1584d5d0 msgr2=0x559e15849e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:32.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.255+0000 7efe46d9d640 1 --2- 172.21.15.92:0/201755686 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e1584d5d0 0x559e15849e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:32.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.255+0000 7efe46d9d640 1 -- 172.21.15.92:0/201755686 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e15856360 con 0x559e15858370 2024-09-19T09:07:32.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.256+0000 7efe46d9d640 1 --2- 172.21.15.92:0/201755686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e15858370 0x559e15874060 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7efe40005fd0 tx=0x7efe40014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16635250cbd59708 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:32.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.256+0000 7efe2ffff640 1 -- 172.21.15.92:0/201755686 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe40017040 con 0x559e15858370 2024-09-19T09:07:32.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.257+0000 7efe2ffff640 1 -- 172.21.15.92:0/201755686 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe40019050 con 0x559e15858370 2024-09-19T09:07:32.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.257+0000 7efe2ffff640 1 -- 172.21.15.92:0/201755686 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe4000f3c0 con 0x559e15858370 2024-09-19T09:07:32.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.258+0000 7efe4f047740 1 -- 172.21.15.92:0/201755686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e15858370 msgr2=0x559e15874060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:32.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.258+0000 7efe4f047740 1 --2- 172.21.15.92:0/201755686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e15858370 0x559e15874060 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7efe40005fd0 tx=0x7efe40014000 comp rx=0 tx=0).stop 2024-09-19T09:07:32.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.258+0000 7efe4f047740 1 -- 172.21.15.92:0/201755686 shutdown_connections 2024-09-19T09:07:32.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.258+0000 7efe4f047740 1 --2- 172.21.15.92:0/201755686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e15858370 0x559e15874060 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:32.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.258+0000 7efe4f047740 1 --2- 172.21.15.92:0/201755686 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e1584eb40 0x559e15868780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:32.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.258+0000 7efe4f047740 1 --2- 172.21.15.92:0/201755686 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e1584d5d0 0x559e15849e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:32.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.258+0000 7efe4f047740 1 -- 172.21.15.92:0/201755686 >> 172.21.15.92:0/201755686 conn(0x559e15816310 msgr2=0x559e15849700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:32.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.260+0000 7efe4f047740 1 -- 172.21.15.92:0/201755686 shutdown_connections 2024-09-19T09:07:32.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.261+0000 7efe4f047740 1 -- 172.21.15.92:0/201755686 wait complete. 2024-09-19T09:07:32.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.261+0000 7efe4f047740 1 -- start start 2024-09-19T09:07:32.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.261+0000 7efe4f047740 1 Processor -- start 2024-09-19T09:07:32.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.262+0000 7efe4f047740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e1584d5d0 0x559e15860750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:32.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.262+0000 7efe4f047740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e1584eb40 0x559e15860c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:32.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.262+0000 7efe4f047740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e15858370 0x559e158611d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:32.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.262+0000 7efe4f047740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efe2800d1c0 con 0x559e15858370 2024-09-19T09:07:32.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.262+0000 7efe4f047740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efe2800e630 con 0x559e1584d5d0 2024-09-19T09:07:32.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.262+0000 7efe4f047740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7efe2800d890 con 0x559e1584eb40 2024-09-19T09:07:32.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.262+0000 7efe4f047740 10 client.0 _ll_register_callbacks cb 0x7efe400093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:32.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.263+0000 7efe3ffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e1584eb40 0x559e15860c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:32.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.263+0000 7efe3ffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e1584eb40 0x559e15860c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:47074/0 (socket says 172.21.15.92:47074) 2024-09-19T09:07:32.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.263+0000 7efe3ffff640 1 -- 172.21.15.92:0/3320515337 learned_addr learned my addr 172.21.15.92:0/3320515337 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:32.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.263+0000 7efe4659c640 1 --2- 172.21.15.92:0/3320515337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e1584d5d0 0x559e15860750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:32.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.263+0000 7efe46d9d640 1 --2- 172.21.15.92:0/3320515337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e15858370 0x559e158611d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:32.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.266+0000 7efe46d9d640 1 -- 172.21.15.92:0/3320515337 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e1584eb40 msgr2=0x559e15860c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:32.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.266+0000 7efe46d9d640 1 --2- 172.21.15.92:0/3320515337 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e1584eb40 0x559e15860c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:32.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.266+0000 7efe46d9d640 1 -- 172.21.15.92:0/3320515337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e1584d5d0 msgr2=0x559e15860750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:32.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.266+0000 7efe46d9d640 1 --2- 172.21.15.92:0/3320515337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e1584d5d0 0x559e15860750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:32.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.266+0000 7efe46d9d640 1 -- 172.21.15.92:0/3320515337 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e158d6130 con 0x559e15858370 2024-09-19T09:07:32.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.267+0000 7efe46d9d640 1 --2- 172.21.15.92:0/3320515337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e15858370 0x559e158611d0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7efe40013fd0 tx=0x7efe40005c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78ad51c392f377b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:32.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.267+0000 7efe2dffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:07:32.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.271+0000 7efe2dffb640 1 -- 172.21.15.92:0/3320515337 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe40056020 con 0x559e15858370 2024-09-19T09:07:32.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.271+0000 7efe2dffb640 1 -- 172.21.15.92:0/3320515337 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7efe4001fb50 con 0x559e15858370 2024-09-19T09:07:32.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.271+0000 7efe4f047740 1 -- 172.21.15.92:0/3320515337 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe40019050 con 0x559e15858370 2024-09-19T09:07:32.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.272+0000 7efe2dffb640 1 -- 172.21.15.92:0/3320515337 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7efe4001fd50 con 0x559e15858370 2024-09-19T09:07:32.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.273+0000 7efe4f047740 10 client.18018 fetch_fsmap learned FSMap version 19 2024-09-19T09:07:32.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.273+0000 7efe4f047740 1 -- 172.21.15.92:0/3320515337 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x559e158d7410 con 0x559e15858370 2024-09-19T09:07:32.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.273+0000 7efe2dffb640 1 -- 172.21.15.92:0/3320515337 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe40019050 con 0x559e15858370 2024-09-19T09:07:32.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.274+0000 7efe2dffb640 1 -- 172.21.15.92:0/3320515337 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7efe40052630 con 0x559e15858370 2024-09-19T09:07:32.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.274+0000 7efe4f047740 10 client.18018 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:07:32.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.274+0000 7efe4f047740 10 client.18018 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:07:32.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.274+0000 7efe4f047740 20 client.18018 populate_metadata read hostname 'smithi092' 2024-09-19T09:07:32.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.274+0000 7efe4f047740 1 --2- 172.21.15.92:0/3320515337 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559e158d79d0 0x559e158d9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:32.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.274+0000 7efe4f047740 4 client.18018 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:07:32.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.274+0000 7efe4f047740 1 -- 172.21.15.92:0/3320515337 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559e157c0860 con 0x559e158d79d0 2024-09-19T09:07:32.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.274+0000 7efe4659c640 1 --2- 172.21.15.92:0/3320515337 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559e158d79d0 0x559e158d9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:32.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.275+0000 7efe4659c640 1 --2- 172.21.15.92:0/3320515337 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559e158d79d0 0x559e158d9df0 crc :-1 s=READY pgs=340 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61b8db46d7a6225c server_cookie=f9418dd8988c9be4 in_seq=0 out_seq=0 2024-09-19T09:07:32.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.275+0000 7efe2dffb640 10 client.18018 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:07:32.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.275+0000 7efe2dffb640 1 -- 172.21.15.92:0/3320515337 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559e157c0860 con 0x559e158d79d0 2024-09-19T09:07:32.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.275+0000 7efe2dffb640 10 client.18018 handle_command_reply: tid=0 2024-09-19T09:07:32.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.275+0000 7efe4f047740 1 client.18018 shutdown 2024-09-19T09:07:32.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.275+0000 7efe4f047740 1 -- 172.21.15.92:0/3320515337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e15858370 msgr2=0x559e158611d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:32.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.275+0000 7efe4f047740 1 --2- 172.21.15.92:0/3320515337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e15858370 0x559e158611d0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7efe40013fd0 tx=0x7efe40005c80 comp rx=0 tx=0).stop 2024-09-19T09:07:32.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.275+0000 7efe4f047740 1 -- 172.21.15.92:0/3320515337 shutdown_connections 2024-09-19T09:07:32.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.275+0000 7efe4f047740 1 --2- 172.21.15.92:0/3320515337 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559e158d79d0 0x559e158d9df0 crc :-1 s=READY pgs=340 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:32.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.275+0000 7efe4f047740 1 --2- 172.21.15.92:0/3320515337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e15858370 0x559e158611d0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:32.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.275+0000 7efe4f047740 1 --2- 172.21.15.92:0/3320515337 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559e1584eb40 0x559e15860c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:32.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.275+0000 7efe4f047740 1 --2- 172.21.15.92:0/3320515337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e1584d5d0 0x559e15860750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:32.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.275+0000 7efe4f047740 1 -- 172.21.15.92:0/3320515337 >> 172.21.15.92:0/3320515337 conn(0x559e15816310 msgr2=0x559e1584f110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:32.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.276+0000 7efe2dffb640 0 client.18018 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:07:32.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.276+0000 7efe4f047740 1 -- 172.21.15.92:0/3320515337 shutdown_connections 2024-09-19T09:07:32.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.276+0000 7efe4f047740 1 -- 172.21.15.92:0/3320515337 wait complete. 2024-09-19T09:07:32.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.276+0000 7efe4f047740 20 client.18018 trim_cache size 0 max 16384 2024-09-19T09:07:32.278 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-19T09:07:32.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.278+0000 7efe4cc6e640 1 -- 172.21.15.92:0/2818985127 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efe340a3390 msgr2=0x7efe340a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:32.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.278+0000 7efe4cc6e640 1 --2- 172.21.15.92:0/2818985127 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efe340a3390 0x7efe340a5850 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7efe481077c0 tx=0x7efe40009500 comp rx=0 tx=0).stop 2024-09-19T09:07:32.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.278+0000 7efe4cc6e640 1 -- 172.21.15.92:0/2818985127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe48100aa0 msgr2=0x7efe48198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:32.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.278+0000 7efe4cc6e640 1 --2- 172.21.15.92:0/2818985127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe48100aa0 0x7efe48198a40 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7efe3000e9f0 tx=0x7efe3000eeb0 comp rx=0 tx=0).stop 2024-09-19T09:07:32.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.278+0000 7efe4cc6e640 1 -- 172.21.15.92:0/2818985127 shutdown_connections 2024-09-19T09:07:32.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.278+0000 7efe4cc6e640 1 --2- 172.21.15.92:0/2818985127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efe48106b80 0x7efe4819cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:32.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.278+0000 7efe4cc6e640 1 --2- 172.21.15.92:0/2818985127 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efe340a3390 0x7efe340a5850 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:32.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.278+0000 7efe4cc6e640 1 --2- 172.21.15.92:0/2818985127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe48100aa0 0x7efe48198a40 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:32.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.278+0000 7efe4cc6e640 1 --2- 172.21.15.92:0/2818985127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe48100100 0x7efe48198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:32.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.278+0000 7efe4cc6e640 1 -- 172.21.15.92:0/2818985127 >> 172.21.15.92:0/2818985127 conn(0x7efe48077230 msgr2=0x7efe48104ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:32.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.278+0000 7efe4cc6e640 1 -- 172.21.15.92:0/2818985127 shutdown_connections 2024-09-19T09:07:32.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:32.279+0000 7efe4cc6e640 1 -- 172.21.15.92:0/2818985127 wait complete. 2024-09-19T09:07:32.856 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:32 smithi092 ceph-mon[31407]: pgmap v662: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 7.6 MiB/s wr, 675 op/s 2024-09-19T09:07:32.876 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:32 smithi190 ceph-mon[35358]: pgmap v662: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 7.6 MiB/s wr, 675 op/s 2024-09-19T09:07:33.002 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:32 smithi167 ceph-mon[35359]: pgmap v662: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 7.6 MiB/s wr, 675 op/s 2024-09-19T09:07:34.261 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:07:34.261 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:07:34.632 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:07:35.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.205+0000 7fce4ab21640 1 -- 172.21.15.92:0/3385014385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce44102d90 msgr2=0x7fce44103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:35.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.205+0000 7fce4ab21640 1 --2- 172.21.15.92:0/3385014385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce44102d90 0x7fce44103170 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fce38009900 tx=0x7fce3802a480 comp rx=0 tx=0).stop 2024-09-19T09:07:35.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.205+0000 7fce4ab21640 1 -- 172.21.15.92:0/3385014385 shutdown_connections 2024-09-19T09:07:35.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.205+0000 7fce4ab21640 1 --2- 172.21.15.92:0/3385014385 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce4410c170 0x7fce4410e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:35.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.205+0000 7fce4ab21640 1 --2- 172.21.15.92:0/3385014385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce441036b0 0x7fce4410bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:35.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.205+0000 7fce4ab21640 1 --2- 172.21.15.92:0/3385014385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce44102d90 0x7fce44103170 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:35.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.205+0000 7fce4ab21640 1 -- 172.21.15.92:0/3385014385 >> 172.21.15.92:0/3385014385 conn(0x7fce440fc790 msgr2=0x7fce440febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:35.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.206+0000 7fce4ab21640 1 -- 172.21.15.92:0/3385014385 shutdown_connections 2024-09-19T09:07:35.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.206+0000 7fce4ab21640 1 -- 172.21.15.92:0/3385014385 wait complete. 2024-09-19T09:07:35.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.206+0000 7fce4ab21640 1 Processor -- start 2024-09-19T09:07:35.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.206+0000 7fce4ab21640 1 -- start start 2024-09-19T09:07:35.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.206+0000 7fce4ab21640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce44102d90 0x7fce441009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:35.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.206+0000 7fce4ab21640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce441036b0 0x7fce44100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:35.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.206+0000 7fce4ab21640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce4410c170 0x7fce44101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:35.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.206+0000 7fce4ab21640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fce44111fb0 con 0x7fce441036b0 2024-09-19T09:07:35.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.206+0000 7fce4ab21640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fce44111e30 con 0x7fce44102d90 2024-09-19T09:07:35.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.206+0000 7fce4ab21640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fce44112130 con 0x7fce4410c170 2024-09-19T09:07:35.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.207+0000 7fce43fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce441036b0 0x7fce44100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:35.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.207+0000 7fce43fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce441036b0 0x7fce44100f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36194/0 (socket says 172.21.15.92:36194) 2024-09-19T09:07:35.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.207+0000 7fce43fff640 1 -- 172.21.15.92:0/2078559462 learned_addr learned my addr 172.21.15.92:0/2078559462 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:35.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.207+0000 7fce490be640 1 --2- 172.21.15.92:0/2078559462 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce4410c170 0x7fce44101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:35.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.207+0000 7fce488bd640 1 --2- 172.21.15.92:0/2078559462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce44102d90 0x7fce441009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:35.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.207+0000 7fce43fff640 1 -- 172.21.15.92:0/2078559462 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce4410c170 msgr2=0x7fce44101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:35.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.207+0000 7fce43fff640 1 --2- 172.21.15.92:0/2078559462 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce4410c170 0x7fce44101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:35.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.207+0000 7fce43fff640 1 -- 172.21.15.92:0/2078559462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce44102d90 msgr2=0x7fce441009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:35.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.207+0000 7fce43fff640 1 --2- 172.21.15.92:0/2078559462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce44102d90 0x7fce441009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:35.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.207+0000 7fce43fff640 1 -- 172.21.15.92:0/2078559462 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce441a6930 con 0x7fce441036b0 2024-09-19T09:07:35.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.207+0000 7fce43fff640 1 --2- 172.21.15.92:0/2078559462 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce441036b0 0x7fce44100f30 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fce3000b4a0 tx=0x7fce3000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:35.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.207+0000 7fce41ffb640 1 -- 172.21.15.92:0/2078559462 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce30014070 con 0x7fce441036b0 2024-09-19T09:07:35.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.208+0000 7fce41ffb640 1 -- 172.21.15.92:0/2078559462 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce30010af0 con 0x7fce441036b0 2024-09-19T09:07:35.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.208+0000 7fce4ab21640 1 -- 172.21.15.92:0/2078559462 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce441a6c20 con 0x7fce441036b0 2024-09-19T09:07:35.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.208+0000 7fce41ffb640 1 -- 172.21.15.92:0/2078559462 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce30017d10 con 0x7fce441036b0 2024-09-19T09:07:35.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.208+0000 7fce4ab21640 1 -- 172.21.15.92:0/2078559462 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce441a7160 con 0x7fce441036b0 2024-09-19T09:07:35.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.211+0000 7fce4cefa740 1 Processor -- start 2024-09-19T09:07:35.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.213+0000 7fce4cefa740 1 -- start start 2024-09-19T09:07:35.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.213+0000 7fce4cefa740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d0cf58230 0x559d0cf58610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:35.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.213+0000 7fce4cefa740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d0cf58b50 0x559d0cf53b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:35.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.213+0000 7fce4cefa740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559d0cf6bfc0 0x559d0cf6e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:35.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.213+0000 7fce4cefa740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559d0ceb5280 con 0x559d0cf58b50 2024-09-19T09:07:35.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.213+0000 7fce4cefa740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559d0ce5cb10 con 0x559d0cf58230 2024-09-19T09:07:35.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.213+0000 7fce4cefa740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x559d0ceb1240 con 0x559d0cf6bfc0 2024-09-19T09:07:35.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.213+0000 7fce41ffb640 1 -- 172.21.15.92:0/2078559462 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fce30017070 con 0x7fce441036b0 2024-09-19T09:07:35.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.214+0000 7fce490be640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d0cf58230 0x559d0cf58610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:35.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.215+0000 7fce41ffb640 1 --2- 172.21.15.92:0/2078559462 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fce340a32c0 0x7fce340a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:35.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.216+0000 7fce41ffb640 1 -- 172.21.15.92:0/2078559462 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fce300ceb50 con 0x7fce441036b0 2024-09-19T09:07:35.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.216+0000 7fce43fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559d0cf6bfc0 0x559d0cf6e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:35.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.217+0000 7fce490be640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d0cf58230 0x559d0cf58610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:53016/0 (socket says 172.21.15.92:53016) 2024-09-19T09:07:35.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.217+0000 7fce490be640 1 -- 172.21.15.92:0/1465967134 learned_addr learned my addr 172.21.15.92:0/1465967134 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:35.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.219+0000 7fce488bd640 1 --2- 172.21.15.92:0/1465967134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d0cf58b50 0x559d0cf53b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:35.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.220+0000 7fce488bd640 1 -- 172.21.15.92:0/1465967134 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559d0cf6bfc0 msgr2=0x559d0cf6e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:35.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.220+0000 7fce488bd640 1 --2- 172.21.15.92:0/1465967134 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559d0cf6bfc0 0x559d0cf6e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:35.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.220+0000 7fce488bd640 1 -- 172.21.15.92:0/1465967134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d0cf58230 msgr2=0x559d0cf58610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:35.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.220+0000 7fce488bd640 1 --2- 172.21.15.92:0/1465967134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d0cf58230 0x559d0cf58610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:35.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.220+0000 7fce488bd640 1 -- 172.21.15.92:0/1465967134 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d0ce691f0 con 0x559d0cf58b50 2024-09-19T09:07:35.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.221+0000 7fce490be640 1 --2- 172.21.15.92:0/2078559462 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fce340a32c0 0x7fce340a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:35.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.224+0000 7fce490be640 1 --2- 172.21.15.92:0/2078559462 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fce340a32c0 0x7fce340a5780 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fce3c009fd0 tx=0x7fce3c004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:35.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.225+0000 7fce488bd640 1 --2- 172.21.15.92:0/1465967134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d0cf58b50 0x559d0cf53b20 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fce38005940 tx=0x7fce38005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fba9b16094f7555 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:35.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.226+0000 7fce2effd640 1 -- 172.21.15.92:0/1465967134 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce38040070 con 0x559d0cf58b50 2024-09-19T09:07:35.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.226+0000 7fce2effd640 1 -- 172.21.15.92:0/1465967134 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce380319f0 con 0x559d0cf58b50 2024-09-19T09:07:35.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.227+0000 7fce4cefa740 1 -- 172.21.15.92:0/1465967134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d0cf58b50 msgr2=0x559d0cf53b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:35.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.227+0000 7fce4cefa740 1 --2- 172.21.15.92:0/1465967134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d0cf58b50 0x559d0cf53b20 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fce38005940 tx=0x7fce38005e80 comp rx=0 tx=0).stop 2024-09-19T09:07:35.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.237+0000 7fce4cefa740 1 -- 172.21.15.92:0/1465967134 shutdown_connections 2024-09-19T09:07:35.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.237+0000 7fce4cefa740 1 --2- 172.21.15.92:0/1465967134 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559d0cf6bfc0 0x559d0cf6e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:35.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.237+0000 7fce4cefa740 1 --2- 172.21.15.92:0/1465967134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d0cf58b50 0x559d0cf53b20 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:35.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.237+0000 7fce4cefa740 1 --2- 172.21.15.92:0/1465967134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d0cf58230 0x559d0cf58610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:35.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.237+0000 7fce4cefa740 1 -- 172.21.15.92:0/1465967134 >> 172.21.15.92:0/1465967134 conn(0x559d0cf54900 msgr2=0x559d0cf54ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:35.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.241+0000 7fce4cefa740 1 -- 172.21.15.92:0/1465967134 shutdown_connections 2024-09-19T09:07:35.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.241+0000 7fce4cefa740 1 -- 172.21.15.92:0/1465967134 wait complete. 2024-09-19T09:07:35.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.241+0000 7fce4cefa740 1 -- start start 2024-09-19T09:07:35.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.242+0000 7fce4cefa740 1 Processor -- start 2024-09-19T09:07:35.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.242+0000 7fce4cefa740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559d0cf58230 0x559d0cf50ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:35.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.242+0000 7fce4cefa740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d0cf58b50 0x559d0cf51420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:35.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.242+0000 7fce4cefa740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d0cf6bfc0 0x559d0cf51960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:35.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.242+0000 7fce4cefa740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559d0cf6e9b0 con 0x559d0cf58b50 2024-09-19T09:07:35.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.242+0000 7fce4cefa740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559d0ce6ff10 con 0x559d0cf6bfc0 2024-09-19T09:07:35.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.242+0000 7fce4cefa740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x559d0cf6eb30 con 0x559d0cf58230 2024-09-19T09:07:35.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.242+0000 7fce4cefa740 10 client.0 _ll_register_callbacks cb 0x559d0ce38a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:35.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.242+0000 7fce43fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d0cf58b50 0x559d0cf51420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:35.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.243+0000 7fce43fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d0cf58b50 0x559d0cf51420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36204/0 (socket says 172.21.15.92:36204) 2024-09-19T09:07:35.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.243+0000 7fce43fff640 1 -- 172.21.15.92:0/171299446 learned_addr learned my addr 172.21.15.92:0/171299446 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:35.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.243+0000 7fce488bd640 1 --2- 172.21.15.92:0/171299446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559d0cf58230 0x559d0cf50ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:35.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.243+0000 7fce490be640 1 --2- 172.21.15.92:0/171299446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d0cf6bfc0 0x559d0cf51960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:35.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.243+0000 7fce488bd640 1 -- 172.21.15.92:0/171299446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d0cf6bfc0 msgr2=0x559d0cf51960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:35.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.243+0000 7fce488bd640 1 --2- 172.21.15.92:0/171299446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d0cf6bfc0 0x559d0cf51960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:35.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.243+0000 7fce488bd640 1 -- 172.21.15.92:0/171299446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d0cf58b50 msgr2=0x559d0cf51420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:35.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.243+0000 7fce488bd640 1 --2- 172.21.15.92:0/171299446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d0cf58b50 0x559d0cf51420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:35.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.243+0000 7fce488bd640 1 -- 172.21.15.92:0/171299446 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d0cc266a0 con 0x559d0cf58230 2024-09-19T09:07:35.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.244+0000 7fce488bd640 1 --2- 172.21.15.92:0/171299446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559d0cf58230 0x559d0cf50ee0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fce38006010 tx=0x7fce38004c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdee673de5c161ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:35.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.244+0000 7fce23fff640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:07:35.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.244+0000 7fce23fff640 1 -- 172.21.15.92:0/171299446 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce38040070 con 0x559d0cf58230 2024-09-19T09:07:35.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.244+0000 7fce23fff640 1 -- 172.21.15.92:0/171299446 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fce38004030 con 0x559d0cf58230 2024-09-19T09:07:35.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.244+0000 7fce4cefa740 1 -- 172.21.15.92:0/171299446 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce380319f0 con 0x559d0cf58230 2024-09-19T09:07:35.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.245+0000 7fce23fff640 1 -- 172.21.15.92:0/171299446 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fce38004230 con 0x559d0cf58230 2024-09-19T09:07:35.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.245+0000 7fce4cefa740 10 client.27193 fetch_fsmap learned FSMap version 19 2024-09-19T09:07:35.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.245+0000 7fce4cefa740 1 -- 172.21.15.92:0/171299446 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x559d0cf6ea00 con 0x559d0cf58230 2024-09-19T09:07:35.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.245+0000 7fce23fff640 1 -- 172.21.15.92:0/171299446 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce380319f0 con 0x559d0cf58230 2024-09-19T09:07:35.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.245+0000 7fce23fff640 1 -- 172.21.15.92:0/171299446 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fce380039e0 con 0x559d0cf58230 2024-09-19T09:07:35.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.245+0000 7fce4cefa740 10 client.27193 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:07:35.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.245+0000 7fce4cefa740 10 client.27193 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:07:35.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.245+0000 7fce4cefa740 20 client.27193 populate_metadata read hostname 'smithi092' 2024-09-19T09:07:35.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.245+0000 7fce4cefa740 1 --2- 172.21.15.92:0/171299446 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559d0cf7b770 0x559d0cf7db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:35.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.245+0000 7fce4cefa740 4 client.27193 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:07:35.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.245+0000 7fce4cefa740 1 -- 172.21.15.92:0/171299446 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d0cec27f0 con 0x559d0cf7b770 2024-09-19T09:07:35.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.246+0000 7fce43fff640 1 --2- 172.21.15.92:0/171299446 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559d0cf7b770 0x559d0cf7db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:35.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.246+0000 7fce23fff640 10 client.27193 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:07:35.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.246+0000 7fce43fff640 1 --2- 172.21.15.92:0/171299446 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559d0cf7b770 0x559d0cf7db60 crc :-1 s=READY pgs=341 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58a44a39317a42a5 server_cookie=79eb3fe19fb2e2a2 in_seq=0 out_seq=0 2024-09-19T09:07:35.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.247+0000 7fce23fff640 1 -- 172.21.15.92:0/171299446 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fce30079e50 con 0x559d0cf7b770 2024-09-19T09:07:35.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.247+0000 7fce23fff640 10 client.27193 handle_command_reply: tid=0 2024-09-19T09:07:35.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.247+0000 7fce4cefa740 1 client.27193 shutdown 2024-09-19T09:07:35.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.248+0000 7fce4cefa740 1 -- 172.21.15.92:0/171299446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559d0cf58230 msgr2=0x559d0cf50ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:35.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.248+0000 7fce4cefa740 1 --2- 172.21.15.92:0/171299446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559d0cf58230 0x559d0cf50ee0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fce38006010 tx=0x7fce38004c80 comp rx=0 tx=0).stop 2024-09-19T09:07:35.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.248+0000 7fce4cefa740 1 -- 172.21.15.92:0/171299446 shutdown_connections 2024-09-19T09:07:35.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.248+0000 7fce4cefa740 1 --2- 172.21.15.92:0/171299446 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559d0cf7b770 0x559d0cf7db60 crc :-1 s=READY pgs=341 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:35.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.248+0000 7fce4cefa740 1 --2- 172.21.15.92:0/171299446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d0cf6bfc0 0x559d0cf51960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:35.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.248+0000 7fce4cefa740 1 --2- 172.21.15.92:0/171299446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d0cf58b50 0x559d0cf51420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:35.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.248+0000 7fce4cefa740 1 --2- 172.21.15.92:0/171299446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559d0cf58230 0x559d0cf50ee0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:35.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.248+0000 7fce4cefa740 1 -- 172.21.15.92:0/171299446 >> 172.21.15.92:0/171299446 conn(0x559d0cf54900 msgr2=0x559d0cf5a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:35.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.248+0000 7fce23fff640 0 client.27193 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:07:35.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.249+0000 7fce4cefa740 1 -- 172.21.15.92:0/171299446 shutdown_connections 2024-09-19T09:07:35.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.249+0000 7fce4cefa740 1 -- 172.21.15.92:0/171299446 wait complete. 2024-09-19T09:07:35.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.249+0000 7fce4cefa740 20 client.27193 trim_cache size 0 max 16384 2024-09-19T09:07:35.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.276+0000 7fce4cefa740 1 Processor -- start 2024-09-19T09:07:35.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.276+0000 7fce4cefa740 1 -- start start 2024-09-19T09:07:35.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.277+0000 7fce4cefa740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559d0cf58230 0x559d0cf517b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:35.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.277+0000 7fce4cefa740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d0cf58b50 0x559d0cf5a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:35.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.277+0000 7fce4cefa740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d0cf6bfc0 0x559d0cf5a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:35.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.277+0000 7fce4cefa740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fce441a9400 con 0x559d0cf6bfc0 2024-09-19T09:07:35.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.277+0000 7fce4cefa740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fce441abc20 con 0x559d0cf58b50 2024-09-19T09:07:35.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.277+0000 7fce4cefa740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fce441a9a50 con 0x559d0cf58230 2024-09-19T09:07:35.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.277+0000 7fce488bd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559d0cf58230 0x559d0cf517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:35.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.277+0000 7fce488bd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559d0cf58230 0x559d0cf517b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:47120/0 (socket says 172.21.15.92:47120) 2024-09-19T09:07:35.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.277+0000 7fce488bd640 1 -- 172.21.15.92:0/3286954527 learned_addr learned my addr 172.21.15.92:0/3286954527 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:35.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.277+0000 7fce490be640 1 --2- 172.21.15.92:0/3286954527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d0cf6bfc0 0x559d0cf5a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:35.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.277+0000 7fce43fff640 1 --2- 172.21.15.92:0/3286954527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d0cf58b50 0x559d0cf5a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:35.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.277+0000 7fce488bd640 1 -- 172.21.15.92:0/3286954527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d0cf58b50 msgr2=0x559d0cf5a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:35.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.277+0000 7fce488bd640 1 --2- 172.21.15.92:0/3286954527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d0cf58b50 0x559d0cf5a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:35.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.277+0000 7fce488bd640 1 -- 172.21.15.92:0/3286954527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d0cf6bfc0 msgr2=0x559d0cf5a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:35.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.277+0000 7fce488bd640 1 --2- 172.21.15.92:0/3286954527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d0cf6bfc0 0x559d0cf5a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:35.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.277+0000 7fce488bd640 1 -- 172.21.15.92:0/3286954527 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d0cf46680 con 0x559d0cf58230 2024-09-19T09:07:35.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.278+0000 7fce488bd640 1 --2- 172.21.15.92:0/3286954527 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559d0cf58230 0x559d0cf517b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fce380049f0 tx=0x7fce38009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=735131f2e20987c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:35.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.278+0000 7fce2e7fc640 1 -- 172.21.15.92:0/3286954527 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce38040070 con 0x559d0cf58230 2024-09-19T09:07:35.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.278+0000 7fce2e7fc640 1 -- 172.21.15.92:0/3286954527 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce38003ad0 con 0x559d0cf58230 2024-09-19T09:07:35.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.278+0000 7fce2e7fc640 1 -- 172.21.15.92:0/3286954527 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce38005000 con 0x559d0cf58230 2024-09-19T09:07:35.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.279+0000 7fce4cefa740 1 -- 172.21.15.92:0/3286954527 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559d0cf58230 msgr2=0x559d0cf517b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:35.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.279+0000 7fce4cefa740 1 --2- 172.21.15.92:0/3286954527 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559d0cf58230 0x559d0cf517b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fce380049f0 tx=0x7fce38009780 comp rx=0 tx=0).stop 2024-09-19T09:07:35.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.279+0000 7fce4cefa740 1 -- 172.21.15.92:0/3286954527 shutdown_connections 2024-09-19T09:07:35.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.279+0000 7fce4cefa740 1 --2- 172.21.15.92:0/3286954527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d0cf6bfc0 0x559d0cf5a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:35.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.279+0000 7fce4cefa740 1 --2- 172.21.15.92:0/3286954527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d0cf58b50 0x559d0cf5a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:35.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.279+0000 7fce4cefa740 1 --2- 172.21.15.92:0/3286954527 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559d0cf58230 0x559d0cf517b0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:35.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.279+0000 7fce4cefa740 1 -- 172.21.15.92:0/3286954527 >> 172.21.15.92:0/3286954527 conn(0x559d0cf54900 msgr2=0x559d0cf59c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:35.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.279+0000 7fce4cefa740 1 -- 172.21.15.92:0/3286954527 shutdown_connections 2024-09-19T09:07:35.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.279+0000 7fce4cefa740 1 -- 172.21.15.92:0/3286954527 wait complete. 2024-09-19T09:07:35.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.279+0000 7fce4cefa740 1 -- start start 2024-09-19T09:07:35.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.280+0000 7fce4cefa740 1 Processor -- start 2024-09-19T09:07:35.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.280+0000 7fce4cefa740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d0cf58230 0x559d0cf743a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:35.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.280+0000 7fce4cefa740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559d0cf58b50 0x559d0cf706e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:35.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.280+0000 7fce4cefa740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d0cf6bfc0 0x559d0cf70c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:35.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.280+0000 7fce4cefa740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fce441aa0e0 con 0x559d0cf6bfc0 2024-09-19T09:07:35.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.280+0000 7fce4cefa740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fce441ab550 con 0x559d0cf58230 2024-09-19T09:07:35.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.280+0000 7fce4cefa740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fce441aa7b0 con 0x559d0cf58b50 2024-09-19T09:07:35.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.280+0000 7fce490be640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d0cf6bfc0 0x559d0cf70c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:35.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.280+0000 7fce4cefa740 10 client.0 _ll_register_callbacks cb 0x7fce3c009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:35.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.280+0000 7fce490be640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d0cf6bfc0 0x559d0cf70c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36220/0 (socket says 172.21.15.92:36220) 2024-09-19T09:07:35.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.280+0000 7fce490be640 1 -- 172.21.15.92:0/268480111 learned_addr learned my addr 172.21.15.92:0/268480111 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:35.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.280+0000 7fce43fff640 1 --2- 172.21.15.92:0/268480111 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559d0cf58b50 0x559d0cf706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:35.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.281+0000 7fce488bd640 1 --2- 172.21.15.92:0/268480111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d0cf58230 0x559d0cf743a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:35.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.281+0000 7fce490be640 1 -- 172.21.15.92:0/268480111 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559d0cf58b50 msgr2=0x559d0cf706e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:35.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.281+0000 7fce490be640 1 --2- 172.21.15.92:0/268480111 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559d0cf58b50 0x559d0cf706e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:35.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.281+0000 7fce490be640 1 -- 172.21.15.92:0/268480111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d0cf58230 msgr2=0x559d0cf743a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:35.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.281+0000 7fce490be640 1 --2- 172.21.15.92:0/268480111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d0cf58230 0x559d0cf743a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:35.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.281+0000 7fce490be640 1 -- 172.21.15.92:0/268480111 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d0cf71310 con 0x559d0cf6bfc0 2024-09-19T09:07:35.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.281+0000 7fce490be640 1 --2- 172.21.15.92:0/268480111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d0cf6bfc0 0x559d0cf70c20 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fce3c0042f0 tx=0x7fce3c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b982b9b384f4689 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:35.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.282+0000 7fce23fff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:07:35.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.282+0000 7fce23fff640 1 -- 172.21.15.92:0/268480111 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3c004b20 con 0x559d0cf6bfc0 2024-09-19T09:07:35.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.282+0000 7fce23fff640 1 -- 172.21.15.92:0/268480111 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fce3c004cc0 con 0x559d0cf6bfc0 2024-09-19T09:07:35.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.282+0000 7fce4cefa740 1 -- 172.21.15.92:0/268480111 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce38003ad0 con 0x559d0cf6bfc0 2024-09-19T09:07:35.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.282+0000 7fce23fff640 1 -- 172.21.15.92:0/268480111 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fce3c010ac0 con 0x559d0cf6bfc0 2024-09-19T09:07:35.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.282+0000 7fce4cefa740 10 client.18036 fetch_fsmap learned FSMap version 19 2024-09-19T09:07:35.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.282+0000 7fce4cefa740 1 -- 172.21.15.92:0/268480111 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x559d0cfe7210 con 0x559d0cf6bfc0 2024-09-19T09:07:35.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.283+0000 7fce23fff640 1 -- 172.21.15.92:0/268480111 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce38003ad0 con 0x559d0cf6bfc0 2024-09-19T09:07:35.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.283+0000 7fce23fff640 1 -- 172.21.15.92:0/268480111 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fce3c01f040 con 0x559d0cf6bfc0 2024-09-19T09:07:35.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.283+0000 7fce4cefa740 10 client.18036 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:07:35.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.283+0000 7fce4cefa740 10 client.18036 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:07:35.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.283+0000 7fce4cefa740 20 client.18036 populate_metadata read hostname 'smithi092' 2024-09-19T09:07:35.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.283+0000 7fce4cefa740 1 --2- 172.21.15.92:0/268480111 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559d0cfe7940 0x559d0cfe9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:35.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.283+0000 7fce4cefa740 4 client.18036 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:07:35.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.283+0000 7fce4cefa740 1 -- 172.21.15.92:0/268480111 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559d0cebcd00 con 0x559d0cfe7940 2024-09-19T09:07:35.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.283+0000 7fce488bd640 1 --2- 172.21.15.92:0/268480111 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559d0cfe7940 0x559d0cfe9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:35.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.284+0000 7fce488bd640 1 --2- 172.21.15.92:0/268480111 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559d0cfe7940 0x559d0cfe9d60 crc :-1 s=READY pgs=342 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab052a5b142d8beb server_cookie=5fcd9191e2eb3312 in_seq=0 out_seq=0 2024-09-19T09:07:35.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.284+0000 7fce23fff640 10 client.18036 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:07:35.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.284+0000 7fce23fff640 1 -- 172.21.15.92:0/268480111 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559d0cebcd00 con 0x559d0cfe7940 2024-09-19T09:07:35.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.284+0000 7fce23fff640 10 client.18036 handle_command_reply: tid=0 2024-09-19T09:07:35.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.284+0000 7fce4cefa740 1 client.18036 shutdown 2024-09-19T09:07:35.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.285+0000 7fce4cefa740 1 -- 172.21.15.92:0/268480111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d0cf6bfc0 msgr2=0x559d0cf70c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:35.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.285+0000 7fce4cefa740 1 --2- 172.21.15.92:0/268480111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d0cf6bfc0 0x559d0cf70c20 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fce3c0042f0 tx=0x7fce3c004a40 comp rx=0 tx=0).stop 2024-09-19T09:07:35.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.285+0000 7fce4cefa740 1 -- 172.21.15.92:0/268480111 shutdown_connections 2024-09-19T09:07:35.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.285+0000 7fce4cefa740 1 --2- 172.21.15.92:0/268480111 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559d0cfe7940 0x559d0cfe9d60 crc :-1 s=READY pgs=342 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:35.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.285+0000 7fce4cefa740 1 --2- 172.21.15.92:0/268480111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559d0cf6bfc0 0x559d0cf70c20 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:35.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.285+0000 7fce23fff640 0 client.18036 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:07:35.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.285+0000 7fce4cefa740 1 --2- 172.21.15.92:0/268480111 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559d0cf58b50 0x559d0cf706e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:35.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.285+0000 7fce4cefa740 1 --2- 172.21.15.92:0/268480111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d0cf58230 0x559d0cf743a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:35.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.285+0000 7fce4cefa740 1 -- 172.21.15.92:0/268480111 >> 172.21.15.92:0/268480111 conn(0x559d0cf54900 msgr2=0x559d0cf5a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:35.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.285+0000 7fce4cefa740 1 -- 172.21.15.92:0/268480111 shutdown_connections 2024-09-19T09:07:35.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.285+0000 7fce4cefa740 1 -- 172.21.15.92:0/268480111 wait complete. 2024-09-19T09:07:35.291 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.285+0000 7fce4cefa740 20 client.18036 trim_cache size 0 max 16384 2024-09-19T09:07:35.291 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:07:35.291 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-19T09:07:35.291 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "03fea45f-7e09-47e5-89b2-e17125e1e13a", 2024-09-19T09:07:35.291 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-19T09:07:35.292 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:07:35.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.286+0000 7fce4ab21640 1 -- 172.21.15.92:0/2078559462 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fce340a32c0 msgr2=0x7fce340a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:35.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.286+0000 7fce4ab21640 1 --2- 172.21.15.92:0/2078559462 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fce340a32c0 0x7fce340a5780 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fce3c009fd0 tx=0x7fce3c004ab0 comp rx=0 tx=0).stop 2024-09-19T09:07:35.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.286+0000 7fce4ab21640 1 -- 172.21.15.92:0/2078559462 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce441036b0 msgr2=0x7fce44100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:35.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.286+0000 7fce4ab21640 1 --2- 172.21.15.92:0/2078559462 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce441036b0 0x7fce44100f30 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fce3000b4a0 tx=0x7fce3000b960 comp rx=0 tx=0).stop 2024-09-19T09:07:35.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.286+0000 7fce4ab21640 1 -- 172.21.15.92:0/2078559462 shutdown_connections 2024-09-19T09:07:35.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.286+0000 7fce4ab21640 1 --2- 172.21.15.92:0/2078559462 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce4410c170 0x7fce44101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:35.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.286+0000 7fce4ab21640 1 --2- 172.21.15.92:0/2078559462 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fce340a32c0 0x7fce340a5780 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:35.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.286+0000 7fce4ab21640 1 --2- 172.21.15.92:0/2078559462 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce441036b0 0x7fce44100f30 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:35.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.286+0000 7fce4ab21640 1 --2- 172.21.15.92:0/2078559462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce44102d90 0x7fce441009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:35.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.286+0000 7fce4ab21640 1 -- 172.21.15.92:0/2078559462 >> 172.21.15.92:0/2078559462 conn(0x7fce440fc790 msgr2=0x7fce440fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:35.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.286+0000 7fce4ab21640 1 -- 172.21.15.92:0/2078559462 shutdown_connections 2024-09-19T09:07:35.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:35.286+0000 7fce4ab21640 1 -- 172.21.15.92:0/2078559462 wait complete. 2024-09-19T09:07:35.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 650.0 s, 2349.2 tps, lat 42.695 ms stddev 45.767 2024-09-19T09:07:35.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:35 smithi167 ceph-mon[35359]: pgmap v663: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9.4 MiB/s wr, 773 op/s 2024-09-19T09:07:35.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:35 smithi190 ceph-mon[35358]: pgmap v663: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9.4 MiB/s wr, 773 op/s 2024-09-19T09:07:35.949 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:35 smithi092 ceph-mon[31407]: pgmap v663: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9.4 MiB/s wr, 773 op/s 2024-09-19T09:07:35.984 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:07:36.368 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:07:36.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:36 smithi092 ceph-mon[31407]: scrub queued for path: / 2024-09-19T09:07:36.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:36 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:36.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:36 smithi092 ceph-mon[31407]: scrub summary: active paths [/] 2024-09-19T09:07:36.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:36 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:36.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:36 smithi167 ceph-mon[35359]: scrub queued for path: / 2024-09-19T09:07:36.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:36 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:36.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:36 smithi167 ceph-mon[35359]: scrub summary: active paths [/] 2024-09-19T09:07:36.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:36 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:36.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:36 smithi190 ceph-mon[35358]: scrub queued for path: / 2024-09-19T09:07:36.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:36 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:36.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:36 smithi190 ceph-mon[35358]: scrub summary: active paths [/] 2024-09-19T09:07:36.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:36 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:36.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.926+0000 7f02740f1640 1 -- 172.21.15.92:0/503255109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f026c11b140 msgr2=0x7f026c11d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:36.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.926+0000 7f02740f1640 1 --2- 172.21.15.92:0/503255109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f026c11b140 0x7f026c11d530 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f0268009900 tx=0x7f026802a440 comp rx=0 tx=0).stop 2024-09-19T09:07:36.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.927+0000 7f02740f1640 1 -- 172.21.15.92:0/503255109 shutdown_connections 2024-09-19T09:07:36.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.927+0000 7f02740f1640 1 --2- 172.21.15.92:0/503255109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f026c11b140 0x7f026c11d530 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:36.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.927+0000 7f02740f1640 1 --2- 172.21.15.92:0/503255109 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f026c109830 0x7f026c109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:36.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.927+0000 7f02740f1640 1 --2- 172.21.15.92:0/503255109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f026c109450 0x7f026c110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:36.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.927+0000 7f02740f1640 1 -- 172.21.15.92:0/503255109 >> 172.21.15.92:0/503255109 conn(0x7f026c06e140 msgr2=0x7f026c06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:36.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.930+0000 7f02740f1640 1 -- 172.21.15.92:0/503255109 shutdown_connections 2024-09-19T09:07:36.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.930+0000 7f02740f1640 1 -- 172.21.15.92:0/503255109 wait complete. 2024-09-19T09:07:36.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.932+0000 7f02740f1640 1 Processor -- start 2024-09-19T09:07:36.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.932+0000 7f02740f1640 1 -- start start 2024-09-19T09:07:36.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.932+0000 7f02740f1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f026c109830 0x7f026c1a71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:36.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.933+0000 7f02740f1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f026c11b140 0x7f026c1a7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:36.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.933+0000 7f0271e8d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f026c109830 0x7f026c1a71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:36.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.933+0000 7f0271e8d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f026c109830 0x7f026c1a71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:53070/0 (socket says 172.21.15.92:53070) 2024-09-19T09:07:36.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.933+0000 7f0271e8d640 1 -- 172.21.15.92:0/2108385850 learned_addr learned my addr 172.21.15.92:0/2108385850 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:36.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.933+0000 7f02740f1640 1 --2- 172.21.15.92:0/2108385850 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f026c1aba90 0x7f026c1abf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:36.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.933+0000 7f02740f1640 1 -- 172.21.15.92:0/2108385850 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f026c120de0 con 0x7f026c11b140 2024-09-19T09:07:36.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.933+0000 7f027268e640 1 --2- 172.21.15.92:0/2108385850 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f026c1aba90 0x7f026c1abf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:36.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.933+0000 7f02740f1640 1 -- 172.21.15.92:0/2108385850 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f026c120c60 con 0x7f026c109830 2024-09-19T09:07:36.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.934+0000 7f02740f1640 1 -- 172.21.15.92:0/2108385850 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f026c120f60 con 0x7f026c1aba90 2024-09-19T09:07:36.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.934+0000 7f027168c640 1 --2- 172.21.15.92:0/2108385850 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f026c11b140 0x7f026c1a7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:36.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.934+0000 7f027268e640 1 -- 172.21.15.92:0/2108385850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f026c109830 msgr2=0x7f026c1a71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:36.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.934+0000 7f027268e640 1 --2- 172.21.15.92:0/2108385850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f026c109830 0x7f026c1a71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:36.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.934+0000 7f027268e640 1 -- 172.21.15.92:0/2108385850 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f026c11b140 msgr2=0x7f026c1a7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:36.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.934+0000 7f027268e640 1 --2- 172.21.15.92:0/2108385850 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f026c11b140 0x7f026c1a7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:36.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.934+0000 7f027268e640 1 -- 172.21.15.92:0/2108385850 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f026c1ac550 con 0x7f026c1aba90 2024-09-19T09:07:36.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.935+0000 7f027168c640 1 --2- 172.21.15.92:0/2108385850 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f026c11b140 0x7f026c1a7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:07:36.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.935+0000 7f027268e640 1 --2- 172.21.15.92:0/2108385850 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f026c1aba90 0x7f026c1abf40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f026802a9b0 tx=0x7f0268030940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:36.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.936+0000 7f0262ffd640 1 -- 172.21.15.92:0/2108385850 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026803f070 con 0x7f026c1aba90 2024-09-19T09:07:36.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.936+0000 7f02740f1640 1 -- 172.21.15.92:0/2108385850 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f026c1ac7e0 con 0x7f026c1aba90 2024-09-19T09:07:36.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.936+0000 7f0262ffd640 1 -- 172.21.15.92:0/2108385850 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0268030e40 con 0x7f026c1aba90 2024-09-19T09:07:36.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.936+0000 7f02740f1640 1 -- 172.21.15.92:0/2108385850 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f026c1b3fc0 con 0x7f026c1aba90 2024-09-19T09:07:36.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.936+0000 7f0262ffd640 1 -- 172.21.15.92:0/2108385850 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0268035030 con 0x7f026c1aba90 2024-09-19T09:07:36.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.939+0000 7f0262ffd640 1 -- 172.21.15.92:0/2108385850 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0268042070 con 0x7f026c1aba90 2024-09-19T09:07:36.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.940+0000 7f0262ffd640 1 --2- 172.21.15.92:0/2108385850 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f02580a3380 0x7f02580a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:36.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.940+0000 7f0262ffd640 1 -- 172.21.15.92:0/2108385850 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f02680f0220 con 0x7f026c1aba90 2024-09-19T09:07:36.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.940+0000 7f0271e8d640 1 --2- 172.21.15.92:0/2108385850 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f02580a3380 0x7f02580a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:36.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.942+0000 7f0271e8d640 1 --2- 172.21.15.92:0/2108385850 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f02580a3380 0x7f02580a5840 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f0264009e00 tx=0x7f02640094a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:36.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.943+0000 7f02764ca740 1 Processor -- start 2024-09-19T09:07:36.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.943+0000 7f02764ca740 1 -- start start 2024-09-19T09:07:36.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.943+0000 7f02764ca740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559365da44a0 0x559365da4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:36.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.943+0000 7f02764ca740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559365da4dc0 0x559365daf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:36.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.943+0000 7f02764ca740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559365daf680 0x559365db1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:36.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.943+0000 7f02764ca740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559365d0a2e0 con 0x559365da44a0 2024-09-19T09:07:36.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.943+0000 7f02764ca740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559365cb1ce0 con 0x559365daf680 2024-09-19T09:07:36.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.943+0000 7f02764ca740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x559365d062a0 con 0x559365da4dc0 2024-09-19T09:07:36.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.944+0000 7f0271e8d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559365da44a0 0x559365da4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:36.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.944+0000 7f0271e8d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559365da44a0 0x559365da4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36238/0 (socket says 172.21.15.92:36238) 2024-09-19T09:07:36.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.944+0000 7f0271e8d640 1 -- 172.21.15.92:0/3534802479 learned_addr learned my addr 172.21.15.92:0/3534802479 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:36.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.944+0000 7f027168c640 1 --2- 172.21.15.92:0/3534802479 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559365da4dc0 0x559365daf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:36.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.944+0000 7f027268e640 1 --2- 172.21.15.92:0/3534802479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559365daf680 0x559365db1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:36.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.944+0000 7f0271e8d640 1 -- 172.21.15.92:0/3534802479 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559365da4dc0 msgr2=0x559365daf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:36.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.944+0000 7f0271e8d640 1 --2- 172.21.15.92:0/3534802479 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559365da4dc0 0x559365daf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:36.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.944+0000 7f0271e8d640 1 -- 172.21.15.92:0/3534802479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559365daf680 msgr2=0x559365db1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:36.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.944+0000 7f0271e8d640 1 --2- 172.21.15.92:0/3534802479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559365daf680 0x559365db1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:36.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.944+0000 7f0271e8d640 1 -- 172.21.15.92:0/3534802479 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559365c96440 con 0x559365da44a0 2024-09-19T09:07:36.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.944+0000 7f0271e8d640 1 --2- 172.21.15.92:0/3534802479 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559365da44a0 0x559365da4880 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f0264012550 tx=0x7f0264013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=398b804884f8ecc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:36.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.945+0000 7f0257fff640 1 -- 172.21.15.92:0/3534802479 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0264023070 con 0x559365da44a0 2024-09-19T09:07:36.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.945+0000 7f0257fff640 1 -- 172.21.15.92:0/3534802479 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0264011b80 con 0x559365da44a0 2024-09-19T09:07:36.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.945+0000 7f0257fff640 1 -- 172.21.15.92:0/3534802479 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026401fd00 con 0x559365da44a0 2024-09-19T09:07:36.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.946+0000 7f02764ca740 1 -- 172.21.15.92:0/3534802479 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559365da44a0 msgr2=0x559365da4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:36.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.946+0000 7f02764ca740 1 --2- 172.21.15.92:0/3534802479 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559365da44a0 0x559365da4880 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f0264012550 tx=0x7f0264013000 comp rx=0 tx=0).stop 2024-09-19T09:07:36.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.946+0000 7f02764ca740 1 -- 172.21.15.92:0/3534802479 shutdown_connections 2024-09-19T09:07:36.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.946+0000 7f02764ca740 1 --2- 172.21.15.92:0/3534802479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559365daf680 0x559365db1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:36.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.946+0000 7f02764ca740 1 --2- 172.21.15.92:0/3534802479 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559365da4dc0 0x559365daf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:36.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.946+0000 7f02764ca740 1 --2- 172.21.15.92:0/3534802479 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559365da44a0 0x559365da4880 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:36.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.946+0000 7f02764ca740 1 -- 172.21.15.92:0/3534802479 >> 172.21.15.92:0/3534802479 conn(0x559365da0a30 msgr2=0x559365da0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:36.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.946+0000 7f02764ca740 1 -- 172.21.15.92:0/3534802479 shutdown_connections 2024-09-19T09:07:36.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.946+0000 7f02764ca740 1 -- 172.21.15.92:0/3534802479 wait complete. 2024-09-19T09:07:36.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.947+0000 7f02764ca740 1 -- start start 2024-09-19T09:07:36.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.947+0000 7f02764ca740 1 Processor -- start 2024-09-19T09:07:36.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.947+0000 7f02764ca740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559365da44a0 0x559365daefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:36.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.947+0000 7f02764ca740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559365da4dc0 0x559365dac280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:36.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.947+0000 7f02764ca740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559365daf680 0x559365dac7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:36.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.948+0000 7f02764ca740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559365db2250 con 0x559365da4dc0 2024-09-19T09:07:36.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.948+0000 7f02764ca740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559365cc5050 con 0x559365daf680 2024-09-19T09:07:36.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.948+0000 7f027268e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559365daf680 0x559365dac7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:36.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.948+0000 7f027268e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559365daf680 0x559365dac7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:53084/0 (socket says 172.21.15.92:53084) 2024-09-19T09:07:36.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.948+0000 7f027268e640 1 -- 172.21.15.92:0/3664718096 learned_addr learned my addr 172.21.15.92:0/3664718096 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:36.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.948+0000 7f0271e8d640 1 --2- 172.21.15.92:0/3664718096 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559365da44a0 0x559365daefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:36.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.948+0000 7f02764ca740 1 -- 172.21.15.92:0/3664718096 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x559365db23d0 con 0x559365da44a0 2024-09-19T09:07:36.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.948+0000 7f02764ca740 10 client.0 _ll_register_callbacks cb 0x559365d05160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:36.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.948+0000 7f027168c640 1 --2- 172.21.15.92:0/3664718096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559365da4dc0 0x559365dac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:36.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.948+0000 7f027268e640 1 -- 172.21.15.92:0/3664718096 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559365da44a0 msgr2=0x559365daefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:36.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.948+0000 7f027268e640 1 --2- 172.21.15.92:0/3664718096 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559365da44a0 0x559365daefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:36.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.948+0000 7f027268e640 1 -- 172.21.15.92:0/3664718096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559365da4dc0 msgr2=0x559365dac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:36.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.948+0000 7f027268e640 1 --2- 172.21.15.92:0/3664718096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559365da4dc0 0x559365dac280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:36.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.948+0000 7f027268e640 1 -- 172.21.15.92:0/3664718096 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559365a7b3c0 con 0x559365daf680 2024-09-19T09:07:36.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.949+0000 7f027168c640 1 --2- 172.21.15.92:0/3664718096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559365da4dc0 0x559365dac280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:07:36.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.949+0000 7f027268e640 1 --2- 172.21.15.92:0/3664718096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559365daf680 0x559365dac7e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f02680bc800 tx=0x7f02680bc470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9292006f146f4ef9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:36.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.949+0000 7f02557fa640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:07:36.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.949+0000 7f02557fa640 1 -- 172.21.15.92:0/3664718096 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02680d5060 con 0x559365daf680 2024-09-19T09:07:36.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.949+0000 7f02557fa640 1 -- 172.21.15.92:0/3664718096 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f02680bab70 con 0x559365daf680 2024-09-19T09:07:36.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.949+0000 7f02764ca740 1 -- 172.21.15.92:0/3664718096 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0264011b80 con 0x559365daf680 2024-09-19T09:07:36.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.949+0000 7f02557fa640 1 -- 172.21.15.92:0/3664718096 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f02680da050 con 0x559365daf680 2024-09-19T09:07:36.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.949+0000 7f02764ca740 10 client.27320 fetch_fsmap learned FSMap version 19 2024-09-19T09:07:36.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.949+0000 7f02764ca740 1 -- 172.21.15.92:0/3664718096 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x559365dbdc00 con 0x559365daf680 2024-09-19T09:07:36.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.949+0000 7f02557fa640 1 -- 172.21.15.92:0/3664718096 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0264011b80 con 0x559365daf680 2024-09-19T09:07:36.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.950+0000 7f02557fa640 1 -- 172.21.15.92:0/3664718096 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f02680b8ee0 con 0x559365daf680 2024-09-19T09:07:36.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.950+0000 7f02764ca740 10 client.27320 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:07:36.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.950+0000 7f02764ca740 10 client.27320 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:07:36.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.950+0000 7f02764ca740 20 client.27320 populate_metadata read hostname 'smithi092' 2024-09-19T09:07:36.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.950+0000 7f02764ca740 1 --2- 172.21.15.92:0/3664718096 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559365dbf330 0x559365dc17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:36.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.950+0000 7f02764ca740 4 client.27320 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:07:36.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.950+0000 7f02764ca740 1 -- 172.21.15.92:0/3664718096 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559365d17850 con 0x559365dbf330 2024-09-19T09:07:36.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.950+0000 7f0271e8d640 1 --2- 172.21.15.92:0/3664718096 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559365dbf330 0x559365dc17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:36.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.950+0000 7f0271e8d640 1 --2- 172.21.15.92:0/3664718096 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559365dbf330 0x559365dc17d0 crc :-1 s=READY pgs=343 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=988d695cf5cd73e8 server_cookie=2c3f7ce747450075 in_seq=0 out_seq=0 2024-09-19T09:07:36.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.950+0000 7f02557fa640 10 client.27320 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:07:36.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.951+0000 7f02557fa640 1 -- 172.21.15.92:0/3664718096 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559365d17850 con 0x559365dbf330 2024-09-19T09:07:36.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.951+0000 7f02557fa640 10 client.27320 handle_command_reply: tid=0 2024-09-19T09:07:36.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.951+0000 7f02764ca740 1 client.27320 shutdown 2024-09-19T09:07:36.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.951+0000 7f02764ca740 1 -- 172.21.15.92:0/3664718096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559365daf680 msgr2=0x559365dac7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:36.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.951+0000 7f02764ca740 1 --2- 172.21.15.92:0/3664718096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559365daf680 0x559365dac7e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f02680bc800 tx=0x7f02680bc470 comp rx=0 tx=0).stop 2024-09-19T09:07:36.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.952+0000 7f02764ca740 1 -- 172.21.15.92:0/3664718096 shutdown_connections 2024-09-19T09:07:36.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.952+0000 7f02764ca740 1 --2- 172.21.15.92:0/3664718096 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559365dbf330 0x559365dc17d0 crc :-1 s=READY pgs=343 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:36.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.952+0000 7f02557fa640 0 client.27320 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:07:36.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.952+0000 7f02764ca740 1 --2- 172.21.15.92:0/3664718096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559365daf680 0x559365dac7e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:36.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.952+0000 7f02764ca740 1 --2- 172.21.15.92:0/3664718096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559365da4dc0 0x559365dac280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:36.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.952+0000 7f02764ca740 1 --2- 172.21.15.92:0/3664718096 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559365da44a0 0x559365daefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:36.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.952+0000 7f02764ca740 1 -- 172.21.15.92:0/3664718096 >> 172.21.15.92:0/3664718096 conn(0x559365da0a30 msgr2=0x559365da6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:36.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.952+0000 7f02764ca740 1 -- 172.21.15.92:0/3664718096 shutdown_connections 2024-09-19T09:07:36.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.952+0000 7f02764ca740 1 -- 172.21.15.92:0/3664718096 wait complete. 2024-09-19T09:07:36.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.952+0000 7f02764ca740 20 client.27320 trim_cache size 0 max 16384 2024-09-19T09:07:36.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.975+0000 7f02764ca740 1 Processor -- start 2024-09-19T09:07:36.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.975+0000 7f02764ca740 1 -- start start 2024-09-19T09:07:36.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.976+0000 7f02764ca740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559365da44a0 0x559365dbb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:36.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.976+0000 7f02764ca740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559365da4dc0 0x559365dac240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:36.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.976+0000 7f02764ca740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559365daf680 0x559365da77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:36.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.976+0000 7f02764ca740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f026c1baa00 con 0x559365da44a0 2024-09-19T09:07:36.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.976+0000 7f02764ca740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f026c1bd2a0 con 0x559365daf680 2024-09-19T09:07:36.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.976+0000 7f0271e8d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559365da44a0 0x559365dbb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:36.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.976+0000 7f02764ca740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f026c1bb090 con 0x559365da4dc0 2024-09-19T09:07:36.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.976+0000 7f0271e8d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559365da44a0 0x559365dbb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36244/0 (socket says 172.21.15.92:36244) 2024-09-19T09:07:36.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.976+0000 7f0271e8d640 1 -- 172.21.15.92:0/747257484 learned_addr learned my addr 172.21.15.92:0/747257484 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:36.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.976+0000 7f027268e640 1 --2- 172.21.15.92:0/747257484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559365daf680 0x559365da77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:36.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.976+0000 7f027168c640 1 --2- 172.21.15.92:0/747257484 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559365da4dc0 0x559365dac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:36.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.976+0000 7f0271e8d640 1 -- 172.21.15.92:0/747257484 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559365da4dc0 msgr2=0x559365dac240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:36.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.976+0000 7f0271e8d640 1 --2- 172.21.15.92:0/747257484 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559365da4dc0 0x559365dac240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:36.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.976+0000 7f0271e8d640 1 -- 172.21.15.92:0/747257484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559365daf680 msgr2=0x559365da77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:36.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.976+0000 7f0271e8d640 1 --2- 172.21.15.92:0/747257484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559365daf680 0x559365da77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:36.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.976+0000 7f0271e8d640 1 -- 172.21.15.92:0/747257484 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559365daf340 con 0x559365da44a0 2024-09-19T09:07:36.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.976+0000 7f027268e640 1 --2- 172.21.15.92:0/747257484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559365daf680 0x559365da77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:36.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.977+0000 7f0271e8d640 1 --2- 172.21.15.92:0/747257484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559365da44a0 0x559365dbb4b0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f0264011010 tx=0x7f026401f7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e09acafa25f70a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:36.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.977+0000 7f02577fe640 1 -- 172.21.15.92:0/747257484 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0264023040 con 0x559365da44a0 2024-09-19T09:07:36.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.977+0000 7f02577fe640 1 -- 172.21.15.92:0/747257484 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f026401fdb0 con 0x559365da44a0 2024-09-19T09:07:36.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.977+0000 7f02577fe640 1 -- 172.21.15.92:0/747257484 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0264035a80 con 0x559365da44a0 2024-09-19T09:07:36.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.978+0000 7f02764ca740 1 -- 172.21.15.92:0/747257484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559365da44a0 msgr2=0x559365dbb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:36.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.978+0000 7f02764ca740 1 --2- 172.21.15.92:0/747257484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559365da44a0 0x559365dbb4b0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f0264011010 tx=0x7f026401f7c0 comp rx=0 tx=0).stop 2024-09-19T09:07:36.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.978+0000 7f02764ca740 1 -- 172.21.15.92:0/747257484 shutdown_connections 2024-09-19T09:07:36.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.978+0000 7f02764ca740 1 --2- 172.21.15.92:0/747257484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559365daf680 0x559365da77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:36.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.978+0000 7f02764ca740 1 --2- 172.21.15.92:0/747257484 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559365da4dc0 0x559365dac240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:36.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.978+0000 7f02764ca740 1 --2- 172.21.15.92:0/747257484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559365da44a0 0x559365dbb4b0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:36.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.978+0000 7f02764ca740 1 -- 172.21.15.92:0/747257484 >> 172.21.15.92:0/747257484 conn(0x559365da0a30 msgr2=0x559365da70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:36.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.978+0000 7f02764ca740 1 -- 172.21.15.92:0/747257484 shutdown_connections 2024-09-19T09:07:36.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.978+0000 7f02764ca740 1 -- 172.21.15.92:0/747257484 wait complete. 2024-09-19T09:07:36.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.979+0000 7f02764ca740 1 -- start start 2024-09-19T09:07:36.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.979+0000 7f02764ca740 1 Processor -- start 2024-09-19T09:07:36.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.979+0000 7f02764ca740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559365da44a0 0x559365db7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:36.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.979+0000 7f02764ca740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559365da4dc0 0x559365db3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:36.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.979+0000 7f02764ca740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559365daf680 0x559365db3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:36.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.979+0000 7f02764ca740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f026c1bb760 con 0x559365da44a0 2024-09-19T09:07:36.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.979+0000 7f02764ca740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f026c1bcbd0 con 0x559365daf680 2024-09-19T09:07:36.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.979+0000 7f02764ca740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f026c1bbe30 con 0x559365da4dc0 2024-09-19T09:07:36.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.979+0000 7f02764ca740 10 client.0 _ll_register_callbacks cb 0x7f0268005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:36.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.980+0000 7f027168c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559365da4dc0 0x559365db3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:36.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.980+0000 7f0271e8d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559365da44a0 0x559365db7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:36.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.980+0000 7f027168c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559365da4dc0 0x559365db3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:47176/0 (socket says 172.21.15.92:47176) 2024-09-19T09:07:36.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.980+0000 7f0271e8d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559365da44a0 0x559365db7e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36246/0 (socket says 172.21.15.92:36246) 2024-09-19T09:07:36.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.980+0000 7f027268e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559365daf680 0x559365db3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:36.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.980+0000 7f027168c640 1 -- 172.21.15.92:0/295495255 learned_addr learned my addr 172.21.15.92:0/295495255 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:36.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.980+0000 7f027168c640 1 -- 172.21.15.92:0/295495255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559365daf680 msgr2=0x559365db3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:36.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.980+0000 7f027168c640 1 --2- 172.21.15.92:0/295495255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559365daf680 0x559365db3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:36.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.980+0000 7f027168c640 1 -- 172.21.15.92:0/295495255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559365da44a0 msgr2=0x559365db7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:36.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.980+0000 7f027168c640 1 --2- 172.21.15.92:0/295495255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559365da44a0 0x559365db7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:36.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.980+0000 7f027168c640 1 -- 172.21.15.92:0/295495255 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559365db3fa0 con 0x559365da4dc0 2024-09-19T09:07:36.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.980+0000 7f0271e8d640 1 --2- 172.21.15.92:0/295495255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559365da44a0 0x559365db7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:36.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.980+0000 7f027168c640 1 --2- 172.21.15.92:0/295495255 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559365da4dc0 0x559365db3180 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x559365da1890 tx=0x7f025c013ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a4182e8fcee651e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:36.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.980+0000 7f02557fa640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:07:36.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.980+0000 7f02557fa640 1 -- 172.21.15.92:0/295495255 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c021060 con 0x559365da4dc0 2024-09-19T09:07:36.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.980+0000 7f02764ca740 1 -- 172.21.15.92:0/295495255 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f026401fdb0 con 0x559365da4dc0 2024-09-19T09:07:36.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.980+0000 7f02557fa640 1 -- 172.21.15.92:0/295495255 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f025c004320 con 0x559365da4dc0 2024-09-19T09:07:36.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.981+0000 7f02557fa640 1 -- 172.21.15.92:0/295495255 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f025c0035f0 con 0x559365da4dc0 2024-09-19T09:07:36.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.981+0000 7f02764ca740 10 client.27217 fetch_fsmap learned FSMap version 19 2024-09-19T09:07:36.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.981+0000 7f02764ca740 1 -- 172.21.15.92:0/295495255 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x559365e2a280 con 0x559365da4dc0 2024-09-19T09:07:36.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.981+0000 7f02557fa640 1 -- 172.21.15.92:0/295495255 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f026401fdb0 con 0x559365da4dc0 2024-09-19T09:07:36.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.981+0000 7f02557fa640 1 -- 172.21.15.92:0/295495255 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f025c026070 con 0x559365da4dc0 2024-09-19T09:07:36.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.981+0000 7f02764ca740 10 client.27217 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:07:36.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.981+0000 7f02764ca740 10 client.27217 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:07:36.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.981+0000 7f02764ca740 20 client.27217 populate_metadata read hostname 'smithi092' 2024-09-19T09:07:36.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.981+0000 7f02764ca740 1 --2- 172.21.15.92:0/295495255 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559365e2aa10 0x559365e2ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:36.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.981+0000 7f02764ca740 4 client.27217 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:07:36.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.981+0000 7f02764ca740 1 -- 172.21.15.92:0/295495255 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559365d11d60 con 0x559365e2aa10 2024-09-19T09:07:36.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.981+0000 7f0271e8d640 1 --2- 172.21.15.92:0/295495255 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559365e2aa10 0x559365e2ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:36.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.982+0000 7f02557fa640 10 client.27217 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:07:36.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.982+0000 7f0271e8d640 1 --2- 172.21.15.92:0/295495255 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559365e2aa10 0x559365e2ce30 crc :-1 s=READY pgs=344 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a196461a9b8ab0 server_cookie=fa822fe188260ec7 in_seq=0 out_seq=0 2024-09-19T09:07:36.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.982+0000 7f02557fa640 1 -- 172.21.15.92:0/295495255 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x559365d11d60 con 0x559365e2aa10 2024-09-19T09:07:36.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.982+0000 7f02557fa640 10 client.27217 handle_command_reply: tid=0 2024-09-19T09:07:36.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.982+0000 7f02764ca740 1 client.27217 shutdown 2024-09-19T09:07:36.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.982+0000 7f02764ca740 1 -- 172.21.15.92:0/295495255 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559365da4dc0 msgr2=0x559365db3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:36.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.982+0000 7f02764ca740 1 --2- 172.21.15.92:0/295495255 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559365da4dc0 0x559365db3180 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x559365da1890 tx=0x7f025c013ac0 comp rx=0 tx=0).stop 2024-09-19T09:07:36.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.982+0000 7f02764ca740 1 -- 172.21.15.92:0/295495255 shutdown_connections 2024-09-19T09:07:36.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.982+0000 7f02764ca740 1 --2- 172.21.15.92:0/295495255 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559365e2aa10 0x559365e2ce30 crc :-1 s=READY pgs=344 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:36.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.982+0000 7f02557fa640 0 client.27217 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:07:36.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.982+0000 7f02764ca740 1 --2- 172.21.15.92:0/295495255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559365daf680 0x559365db3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:36.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.982+0000 7f02764ca740 1 --2- 172.21.15.92:0/295495255 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x559365da4dc0 0x559365db3180 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:36.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.982+0000 7f02764ca740 1 --2- 172.21.15.92:0/295495255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559365da44a0 0x559365db7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:36.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.982+0000 7f02764ca740 1 -- 172.21.15.92:0/295495255 >> 172.21.15.92:0/295495255 conn(0x559365da0a30 msgr2=0x559365da78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:36.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.983+0000 7f02764ca740 1 -- 172.21.15.92:0/295495255 shutdown_connections 2024-09-19T09:07:36.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.983+0000 7f02764ca740 1 -- 172.21.15.92:0/295495255 wait complete. 2024-09-19T09:07:36.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.983+0000 7f02764ca740 20 client.27217 trim_cache size 0 max 16384 2024-09-19T09:07:36.990 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:07:36.990 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:07:36.990 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": { 2024-09-19T09:07:36.990 INFO:teuthology.orchestra.run.smithi092.stdout: "03fea45f-7e09-47e5-89b2-e17125e1e13a": { 2024-09-19T09:07:36.990 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-19T09:07:36.990 INFO:teuthology.orchestra.run.smithi092.stdout: "tag": "03fea45f-7e09-47e5-89b2-e17125e1e13a", 2024-09-19T09:07:36.990 INFO:teuthology.orchestra.run.smithi092.stdout: "options": "recursive,force" 2024-09-19T09:07:36.990 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:07:36.990 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:07:36.991 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:07:36.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.985+0000 7f02740f1640 1 -- 172.21.15.92:0/2108385850 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f02580a3380 msgr2=0x7f02580a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:36.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.985+0000 7f02740f1640 1 --2- 172.21.15.92:0/2108385850 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f02580a3380 0x7f02580a5840 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f0264009e00 tx=0x7f02640094a0 comp rx=0 tx=0).stop 2024-09-19T09:07:36.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.985+0000 7f02740f1640 1 -- 172.21.15.92:0/2108385850 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f026c1aba90 msgr2=0x7f026c1abf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:36.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.985+0000 7f02740f1640 1 --2- 172.21.15.92:0/2108385850 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f026c1aba90 0x7f026c1abf40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f026802a9b0 tx=0x7f0268030940 comp rx=0 tx=0).stop 2024-09-19T09:07:36.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.986+0000 7f02740f1640 1 -- 172.21.15.92:0/2108385850 shutdown_connections 2024-09-19T09:07:36.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.986+0000 7f02740f1640 1 --2- 172.21.15.92:0/2108385850 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f026c1aba90 0x7f026c1abf40 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:36.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.986+0000 7f02740f1640 1 --2- 172.21.15.92:0/2108385850 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f02580a3380 0x7f02580a5840 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:36.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.986+0000 7f02740f1640 1 --2- 172.21.15.92:0/2108385850 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f026c11b140 0x7f026c1a7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:36.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.986+0000 7f02740f1640 1 --2- 172.21.15.92:0/2108385850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f026c109830 0x7f026c1a71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:36.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.986+0000 7f02740f1640 1 -- 172.21.15.92:0/2108385850 >> 172.21.15.92:0/2108385850 conn(0x7f026c06e140 msgr2=0x7f026c11bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:36.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.986+0000 7f02740f1640 1 -- 172.21.15.92:0/2108385850 shutdown_connections 2024-09-19T09:07:36.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:07:36.986+0000 7f02740f1640 1 -- 172.21.15.92:0/2108385850 wait complete. 2024-09-19T09:07:37.708 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:37 smithi092 ceph-mon[31407]: pgmap v664: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.1 MiB/s wr, 747 op/s 2024-09-19T09:07:37.763 INFO:tasks.cephfs.filesystem:scrub status for tag:03fea45f-7e09-47e5-89b2-e17125e1e13a - {'path': '/', 'tag': '03fea45f-7e09-47e5-89b2-e17125e1e13a', 'options': 'recursive,force'} 2024-09-19T09:07:37.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:37 smithi167 ceph-mon[35359]: pgmap v664: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.1 MiB/s wr, 747 op/s 2024-09-19T09:07:37.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:37 smithi190 ceph-mon[35358]: pgmap v664: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.1 MiB/s wr, 747 op/s 2024-09-19T09:07:39.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:38 smithi092 ceph-mon[31407]: pgmap v665: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 9.2 MiB/s wr, 803 op/s 2024-09-19T09:07:39.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:38 smithi167 ceph-mon[35359]: pgmap v665: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 9.2 MiB/s wr, 803 op/s 2024-09-19T09:07:39.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:38 smithi190 ceph-mon[35358]: pgmap v665: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 9.2 MiB/s wr, 803 op/s 2024-09-19T09:07:40.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:39 smithi092 ceph-mon[31407]: scrub summary: idle 2024-09-19T09:07:40.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:39 smithi167 ceph-mon[35359]: scrub summary: idle 2024-09-19T09:07:40.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:39 smithi190 ceph-mon[35358]: scrub summary: idle 2024-09-19T09:07:40.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 655.0 s, 3252.8 tps, lat 30.837 ms stddev 39.175 2024-09-19T09:07:41.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:40 smithi092 ceph-mon[31407]: pgmap v666: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 8.6 MiB/s wr, 836 op/s 2024-09-19T09:07:41.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:40 smithi167 ceph-mon[35359]: pgmap v666: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 8.6 MiB/s wr, 836 op/s 2024-09-19T09:07:41.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:40 smithi190 ceph-mon[35358]: pgmap v666: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 8.6 MiB/s wr, 836 op/s 2024-09-19T09:07:43.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:43 smithi167 ceph-mon[35359]: pgmap v667: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 8.2 MiB/s wr, 816 op/s 2024-09-19T09:07:43.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:43 smithi190 ceph-mon[35358]: pgmap v667: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 8.2 MiB/s wr, 816 op/s 2024-09-19T09:07:44.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:43 smithi092 ceph-mon[31407]: pgmap v667: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 8.2 MiB/s wr, 816 op/s 2024-09-19T09:07:44.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.600+0000 7f4dd623c640 1 -- 172.21.15.92:0/1045770258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4dd0100a40 msgr2=0x7f4dd0100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:44.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.600+0000 7f4dd623c640 1 --2- 172.21.15.92:0/1045770258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4dd0100a40 0x7f4dd0100e40 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0009900 tx=0x7f4dc002a410 comp rx=0 tx=0).stop 2024-09-19T09:07:44.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.601+0000 7f4dd623c640 1 -- 172.21.15.92:0/1045770258 shutdown_connections 2024-09-19T09:07:44.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.601+0000 7f4dd623c640 1 --2- 172.21.15.92:0/1045770258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dd01025f0 0x7f4dd0108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:44.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.601+0000 7f4dd623c640 1 --2- 172.21.15.92:0/1045770258 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4dd0101c30 0x7f4dd01020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:44.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.601+0000 7f4dd623c640 1 --2- 172.21.15.92:0/1045770258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4dd0100a40 0x7f4dd0100e40 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:44.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.601+0000 7f4dd623c640 1 -- 172.21.15.92:0/1045770258 >> 172.21.15.92:0/1045770258 conn(0x7f4dd00fc1e0 msgr2=0x7f4dd00fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:44.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.601+0000 7f4dd623c640 1 -- 172.21.15.92:0/1045770258 shutdown_connections 2024-09-19T09:07:44.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.602+0000 7f4dd623c640 1 -- 172.21.15.92:0/1045770258 wait complete. 2024-09-19T09:07:44.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.602+0000 7f4dd623c640 1 Processor -- start 2024-09-19T09:07:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.603+0000 7f4dd623c640 1 -- start start 2024-09-19T09:07:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.603+0000 7f4dd623c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4dd0100a40 0x7f4dd0110e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.603+0000 7f4dd623c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4dd0101c30 0x7f4dd0111390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.603+0000 7f4dd623c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dd01025f0 0x7f4dd0118400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.603+0000 7f4dd623c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd010b5b0 con 0x7f4dd0100a40 2024-09-19T09:07:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.603+0000 7f4dd623c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd010b430 con 0x7f4dd01025f0 2024-09-19T09:07:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.603+0000 7f4dd623c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd010b730 con 0x7f4dd0101c30 2024-09-19T09:07:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.603+0000 7f4dcf7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4dd0100a40 0x7f4dd0110e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.603+0000 7f4dcf7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4dd0100a40 0x7f4dd0110e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50330/0 (socket says 172.21.15.92:50330) 2024-09-19T09:07:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.603+0000 7f4dcf7fe640 1 -- 172.21.15.92:0/2109833330 learned_addr learned my addr 172.21.15.92:0/2109833330 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.603+0000 7f4dceffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4dd0101c30 0x7f4dd0111390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.603+0000 7f4dcffff640 1 --2- 172.21.15.92:0/2109833330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dd01025f0 0x7f4dd0118400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.603+0000 7f4dcf7fe640 1 -- 172.21.15.92:0/2109833330 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4dd0101c30 msgr2=0x7f4dd0111390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.603+0000 7f4dcf7fe640 1 --2- 172.21.15.92:0/2109833330 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4dd0101c30 0x7f4dd0111390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.603+0000 7f4dcf7fe640 1 -- 172.21.15.92:0/2109833330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dd01025f0 msgr2=0x7f4dd0118400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.603+0000 7f4dcf7fe640 1 --2- 172.21.15.92:0/2109833330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dd01025f0 0x7f4dd0118400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.603+0000 7f4dcf7fe640 1 -- 172.21.15.92:0/2109833330 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dd0118a70 con 0x7f4dd0100a40 2024-09-19T09:07:44.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.603+0000 7f4dceffd640 1 --2- 172.21.15.92:0/2109833330 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4dd0101c30 0x7f4dd0111390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:44.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.604+0000 7f4dcf7fe640 1 --2- 172.21.15.92:0/2109833330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4dd0100a40 0x7f4dd0110e50 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0031610 tx=0x7f4dc0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:44.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.604+0000 7f4dccff9640 1 -- 172.21.15.92:0/2109833330 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc003f030 con 0x7f4dd0100a40 2024-09-19T09:07:44.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.604+0000 7f4dd623c640 1 -- 172.21.15.92:0/2109833330 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dd0118d00 con 0x7f4dd0100a40 2024-09-19T09:07:44.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.604+0000 7f4dccff9640 1 -- 172.21.15.92:0/2109833330 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4dc0003ad0 con 0x7f4dd0100a40 2024-09-19T09:07:44.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.604+0000 7f4dd623c640 1 -- 172.21.15.92:0/2109833330 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dd01aef90 con 0x7f4dd0100a40 2024-09-19T09:07:44.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.604+0000 7f4dccff9640 1 -- 172.21.15.92:0/2109833330 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0049060 con 0x7f4dd0100a40 2024-09-19T09:07:44.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.606+0000 7f4dccff9640 1 -- 172.21.15.92:0/2109833330 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4dc0042030 con 0x7f4dd0100a40 2024-09-19T09:07:44.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.607+0000 7f4dd8fd5740 1 Processor -- start 2024-09-19T09:07:44.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.607+0000 7f4dd8fd5740 1 -- start start 2024-09-19T09:07:44.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.607+0000 7f4dccff9640 1 --2- 172.21.15.92:0/2109833330 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4db80a32f0 0x7f4db80a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:44.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.607+0000 7f4dd8fd5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9fa28e9a0 0x55e9fa28eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:44.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.607+0000 7f4dd8fd5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e9fa28f2e0 0x55e9fa293da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:44.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.607+0000 7f4dd8fd5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9fa294370 0x55e9fa296830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:44.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.607+0000 7f4dd8fd5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e9fa1f22f0 con 0x55e9fa28e9a0 2024-09-19T09:07:44.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.607+0000 7f4dd8fd5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e9fa19a270 con 0x55e9fa28f2e0 2024-09-19T09:07:44.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.607+0000 7f4dd8fd5740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e9fa1ee2b0 con 0x55e9fa294370 2024-09-19T09:07:44.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.608+0000 7f4dcf7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9fa28e9a0 0x55e9fa28eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:44.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.608+0000 7f4dcf7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9fa28e9a0 0x55e9fa28eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50334/0 (socket says 172.21.15.92:50334) 2024-09-19T09:07:44.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.608+0000 7f4dcf7fe640 1 -- 172.21.15.92:0/2380314723 learned_addr learned my addr 172.21.15.92:0/2380314723 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:44.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.608+0000 7f4dceffd640 1 --2- 172.21.15.92:0/2380314723 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e9fa28f2e0 0x55e9fa293da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:44.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.608+0000 7f4dcffff640 1 --2- 172.21.15.92:0/2109833330 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4db80a32f0 0x7f4db80a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:44.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.608+0000 7f4dceffd640 1 -- 172.21.15.92:0/2380314723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9fa294370 msgr2=0x55e9fa296830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:44.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.608+0000 7f4dcffff640 1 --2- 172.21.15.92:0/2380314723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9fa294370 0x55e9fa296830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:44.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.608+0000 7f4dceffd640 1 --2- 172.21.15.92:0/2380314723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9fa294370 0x55e9fa296830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:44.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.608+0000 7f4dceffd640 1 -- 172.21.15.92:0/2380314723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9fa28e9a0 msgr2=0x55e9fa28eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:44.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.608+0000 7f4dceffd640 1 --2- 172.21.15.92:0/2380314723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9fa28e9a0 0x55e9fa28eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:44.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.608+0000 7f4dceffd640 1 -- 172.21.15.92:0/2380314723 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9fa199340 con 0x55e9fa28f2e0 2024-09-19T09:07:44.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.608+0000 7f4dcf7fe640 1 --2- 172.21.15.92:0/2380314723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9fa28e9a0 0x55e9fa28eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:44.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.608+0000 7f4dcffff640 1 --2- 172.21.15.92:0/2380314723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9fa294370 0x55e9fa296830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:07:44.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.609+0000 7f4dccff9640 1 -- 172.21.15.92:0/2109833330 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4dc00efc80 con 0x7f4dd0100a40 2024-09-19T09:07:44.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.609+0000 7f4dceffd640 1 --2- 172.21.15.92:0/2380314723 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e9fa28f2e0 0x55e9fa293da0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4009fa0 tx=0x7f4dc40118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2e5e09958643d91 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:44.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.609+0000 7f4dcffff640 1 --2- 172.21.15.92:0/2109833330 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4db80a32f0 0x7f4db80a57b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4dc80136a0 tx=0x7f4dc80079b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:44.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.609+0000 7f4db5ffb640 1 -- 172.21.15.92:0/2380314723 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc4004310 con 0x55e9fa28f2e0 2024-09-19T09:07:44.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.609+0000 7f4db5ffb640 1 -- 172.21.15.92:0/2380314723 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4dc40044b0 con 0x55e9fa28f2e0 2024-09-19T09:07:44.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.609+0000 7f4db5ffb640 1 -- 172.21.15.92:0/2380314723 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc40035f0 con 0x55e9fa28f2e0 2024-09-19T09:07:44.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.610+0000 7f4dd8fd5740 1 -- 172.21.15.92:0/2380314723 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e9fa28f2e0 msgr2=0x55e9fa293da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:44.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.610+0000 7f4dd8fd5740 1 --2- 172.21.15.92:0/2380314723 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e9fa28f2e0 0x55e9fa293da0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4009fa0 tx=0x7f4dc40118d0 comp rx=0 tx=0).stop 2024-09-19T09:07:44.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.610+0000 7f4dd8fd5740 1 -- 172.21.15.92:0/2380314723 shutdown_connections 2024-09-19T09:07:44.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.610+0000 7f4dd8fd5740 1 --2- 172.21.15.92:0/2380314723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9fa294370 0x55e9fa296830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:44.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.611+0000 7f4dd8fd5740 1 --2- 172.21.15.92:0/2380314723 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e9fa28f2e0 0x55e9fa293da0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:44.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.611+0000 7f4dd8fd5740 1 --2- 172.21.15.92:0/2380314723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9fa28e9a0 0x55e9fa28eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:44.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.611+0000 7f4dd8fd5740 1 -- 172.21.15.92:0/2380314723 >> 172.21.15.92:0/2380314723 conn(0x55e9fa28a010 msgr2=0x55e9fa28a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:44.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.611+0000 7f4dd8fd5740 1 -- 172.21.15.92:0/2380314723 shutdown_connections 2024-09-19T09:07:44.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.611+0000 7f4dd8fd5740 1 -- 172.21.15.92:0/2380314723 wait complete. 2024-09-19T09:07:44.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.611+0000 7f4dd8fd5740 1 -- start start 2024-09-19T09:07:44.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.611+0000 7f4dd8fd5740 1 Processor -- start 2024-09-19T09:07:44.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.611+0000 7f4dd8fd5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9fa28e9a0 0x55e9fa298c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:44.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.612+0000 7f4dd8fd5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e9fa28f2e0 0x55e9fa299140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:44.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.612+0000 7f4dd8fd5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9fa294370 0x55e9fa2a0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:44.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.612+0000 7f4dd8fd5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e9fa297390 con 0x55e9fa294370 2024-09-19T09:07:44.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.612+0000 7f4dd8fd5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e9fa17b290 con 0x55e9fa28f2e0 2024-09-19T09:07:44.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.612+0000 7f4dd8fd5740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e9fa297510 con 0x55e9fa28e9a0 2024-09-19T09:07:44.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.612+0000 7f4dd8fd5740 10 client.0 _ll_register_callbacks cb 0x55e9fa1ac140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:44.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.612+0000 7f4dcffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9fa294370 0x55e9fa2a0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:44.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.612+0000 7f4dceffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e9fa28f2e0 0x55e9fa299140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:44.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.612+0000 7f4dceffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e9fa28f2e0 0x55e9fa299140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:43150/0 (socket says 172.21.15.92:43150) 2024-09-19T09:07:44.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.612+0000 7f4dcf7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9fa28e9a0 0x55e9fa298c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:44.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.612+0000 7f4dceffd640 1 -- 172.21.15.92:0/1951545130 learned_addr learned my addr 172.21.15.92:0/1951545130 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:44.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.612+0000 7f4dcffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9fa294370 0x55e9fa2a0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50338/0 (socket says 172.21.15.92:50338) 2024-09-19T09:07:44.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.612+0000 7f4dceffd640 1 -- 172.21.15.92:0/1951545130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9fa28e9a0 msgr2=0x55e9fa298c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:44.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.612+0000 7f4dceffd640 1 --2- 172.21.15.92:0/1951545130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9fa28e9a0 0x55e9fa298c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:44.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.612+0000 7f4dceffd640 1 -- 172.21.15.92:0/1951545130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9fa294370 msgr2=0x55e9fa2a0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:44.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.612+0000 7f4dceffd640 1 --2- 172.21.15.92:0/1951545130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9fa294370 0x55e9fa2a0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:44.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.612+0000 7f4dceffd640 1 -- 172.21.15.92:0/1951545130 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9f9f05210 con 0x55e9fa28f2e0 2024-09-19T09:07:44.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.612+0000 7f4dceffd640 1 --2- 172.21.15.92:0/1951545130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e9fa28f2e0 0x55e9fa299140 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4dc40049c0 tx=0x7f4dc4004440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9ba77b6fb2bfb30 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:44.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.612+0000 7f4daeffd640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:07:44.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.612+0000 7f4daeffd640 1 -- 172.21.15.92:0/1951545130 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc4028070 con 0x55e9fa28f2e0 2024-09-19T09:07:44.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.612+0000 7f4dd8fd5740 1 -- 172.21.15.92:0/1951545130 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4dc40044b0 con 0x55e9fa28f2e0 2024-09-19T09:07:44.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.612+0000 7f4daeffd640 1 -- 172.21.15.92:0/1951545130 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4dc4003a80 con 0x55e9fa28f2e0 2024-09-19T09:07:44.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.613+0000 7f4daeffd640 1 -- 172.21.15.92:0/1951545130 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4dc4033050 con 0x55e9fa28f2e0 2024-09-19T09:07:44.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.613+0000 7f4dd8fd5740 10 client.27335 fetch_fsmap learned FSMap version 19 2024-09-19T09:07:44.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.613+0000 7f4dd8fd5740 1 -- 172.21.15.92:0/1951545130 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e9f9fd1620 con 0x55e9fa28f2e0 2024-09-19T09:07:44.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.613+0000 7f4daeffd640 1 -- 172.21.15.92:0/1951545130 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4dc40044b0 con 0x55e9fa28f2e0 2024-09-19T09:07:44.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.613+0000 7f4daeffd640 1 -- 172.21.15.92:0/1951545130 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f4dc400f570 con 0x55e9fa28f2e0 2024-09-19T09:07:44.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.613+0000 7f4dd8fd5740 10 client.27335 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:07:44.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.613+0000 7f4dd8fd5740 10 client.27335 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:07:44.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.613+0000 7f4dd8fd5740 20 client.27335 populate_metadata read hostname 'smithi092' 2024-09-19T09:07:44.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.613+0000 7f4dd8fd5740 1 --2- 172.21.15.92:0/1951545130 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e9fa2a4560 0x55e9fa2a6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:44.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.613+0000 7f4dd8fd5740 4 client.27335 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:07:44.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.613+0000 7f4dd8fd5740 1 -- 172.21.15.92:0/1951545130 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9fa1ffa20 con 0x55e9fa2a4560 2024-09-19T09:07:44.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.613+0000 7f4dcf7fe640 1 --2- 172.21.15.92:0/1951545130 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e9fa2a4560 0x55e9fa2a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:44.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.614+0000 7f4daeffd640 10 client.27335 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:07:44.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.614+0000 7f4dcf7fe640 1 --2- 172.21.15.92:0/1951545130 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e9fa2a4560 0x55e9fa2a6950 crc :-1 s=READY pgs=345 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b8bfd40190f940e server_cookie=ebf3eb1e85d6567b in_seq=0 out_seq=0 2024-09-19T09:07:44.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.615+0000 7f4daeffd640 1 -- 172.21.15.92:0/1951545130 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e9fa1ffa20 con 0x55e9fa2a4560 2024-09-19T09:07:44.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.615+0000 7f4daeffd640 10 client.27335 handle_command_reply: tid=0 2024-09-19T09:07:44.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.615+0000 7f4dd8fd5740 1 client.27335 shutdown 2024-09-19T09:07:44.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.615+0000 7f4dd8fd5740 1 -- 172.21.15.92:0/1951545130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e9fa28f2e0 msgr2=0x55e9fa299140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:44.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.615+0000 7f4dd8fd5740 1 --2- 172.21.15.92:0/1951545130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e9fa28f2e0 0x55e9fa299140 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4dc40049c0 tx=0x7f4dc4004440 comp rx=0 tx=0).stop 2024-09-19T09:07:44.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.615+0000 7f4dd8fd5740 1 -- 172.21.15.92:0/1951545130 shutdown_connections 2024-09-19T09:07:44.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.615+0000 7f4dd8fd5740 1 --2- 172.21.15.92:0/1951545130 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e9fa2a4560 0x55e9fa2a6950 crc :-1 s=READY pgs=345 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:44.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.615+0000 7f4daeffd640 0 client.27335 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:07:44.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.615+0000 7f4dd8fd5740 1 --2- 172.21.15.92:0/1951545130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9fa294370 0x55e9fa2a0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:44.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.615+0000 7f4dd8fd5740 1 --2- 172.21.15.92:0/1951545130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e9fa28f2e0 0x55e9fa299140 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:44.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.615+0000 7f4dd8fd5740 1 --2- 172.21.15.92:0/1951545130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9fa28e9a0 0x55e9fa298c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:44.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.615+0000 7f4dd8fd5740 1 -- 172.21.15.92:0/1951545130 >> 172.21.15.92:0/1951545130 conn(0x55e9fa28a010 msgr2=0x55e9fa28b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:44.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.615+0000 7f4dd8fd5740 1 -- 172.21.15.92:0/1951545130 shutdown_connections 2024-09-19T09:07:44.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.615+0000 7f4dd8fd5740 1 -- 172.21.15.92:0/1951545130 wait complete. 2024-09-19T09:07:44.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.615+0000 7f4dd8fd5740 20 client.27335 trim_cache size 0 max 16384 2024-09-19T09:07:44.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.635+0000 7f4dd8fd5740 1 Processor -- start 2024-09-19T09:07:44.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.636+0000 7f4dd8fd5740 1 -- start start 2024-09-19T09:07:44.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.636+0000 7f4dd8fd5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9fa28e9a0 0x55e9fa2890b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:44.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.636+0000 7f4dd8fd5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9fa28f2e0 0x55e9fa2a0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:44.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.636+0000 7f4dd8fd5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e9fa294370 0x55e9fa28b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:44.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.636+0000 7f4dd8fd5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd01b5cf0 con 0x55e9fa28f2e0 2024-09-19T09:07:44.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.636+0000 7f4dd8fd5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd01b8590 con 0x55e9fa294370 2024-09-19T09:07:44.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.636+0000 7f4dd8fd5740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd01b6380 con 0x55e9fa28e9a0 2024-09-19T09:07:44.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.636+0000 7f4dceffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9fa28f2e0 0x55e9fa2a0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:44.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.636+0000 7f4dceffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9fa28f2e0 0x55e9fa2a0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50344/0 (socket says 172.21.15.92:50344) 2024-09-19T09:07:44.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.636+0000 7f4dcf7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9fa28e9a0 0x55e9fa2890b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:44.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.636+0000 7f4dcffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e9fa294370 0x55e9fa28b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:44.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.636+0000 7f4dceffd640 1 -- 172.21.15.92:0/902242631 learned_addr learned my addr 172.21.15.92:0/902242631 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:44.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.637+0000 7f4dceffd640 1 -- 172.21.15.92:0/902242631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9fa28e9a0 msgr2=0x55e9fa2890b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:44.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.637+0000 7f4dceffd640 1 --2- 172.21.15.92:0/902242631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9fa28e9a0 0x55e9fa2890b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:44.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.637+0000 7f4dceffd640 1 -- 172.21.15.92:0/902242631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e9fa294370 msgr2=0x55e9fa28b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:44.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.637+0000 7f4dceffd640 1 --2- 172.21.15.92:0/902242631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e9fa294370 0x55e9fa28b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:44.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.637+0000 7f4dceffd640 1 -- 172.21.15.92:0/902242631 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9fa289e30 con 0x55e9fa28f2e0 2024-09-19T09:07:44.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.637+0000 7f4dcffff640 1 --2- 172.21.15.92:0/902242631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e9fa294370 0x55e9fa28b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:44.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.637+0000 7f4dcf7fe640 1 --2- 172.21.15.92:0/902242631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9fa28e9a0 0x55e9fa2890b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:44.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.637+0000 7f4dceffd640 1 --2- 172.21.15.92:0/902242631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9fa28f2e0 0x55e9fa2a0140 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4009380 tx=0x7f4dc40118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb2ea91b1c0913b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:44.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.637+0000 7f4db57fa640 1 -- 172.21.15.92:0/902242631 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc403c070 con 0x55e9fa28f2e0 2024-09-19T09:07:44.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.637+0000 7f4db57fa640 1 -- 172.21.15.92:0/902242631 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4dc4003d60 con 0x55e9fa28f2e0 2024-09-19T09:07:44.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.637+0000 7f4db57fa640 1 -- 172.21.15.92:0/902242631 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc4028050 con 0x55e9fa28f2e0 2024-09-19T09:07:44.643 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.638+0000 7f4dd8fd5740 1 -- 172.21.15.92:0/902242631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9fa28f2e0 msgr2=0x55e9fa2a0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:44.643 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.638+0000 7f4dd8fd5740 1 --2- 172.21.15.92:0/902242631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9fa28f2e0 0x55e9fa2a0140 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4009380 tx=0x7f4dc40118d0 comp rx=0 tx=0).stop 2024-09-19T09:07:44.643 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.638+0000 7f4dd8fd5740 1 -- 172.21.15.92:0/902242631 shutdown_connections 2024-09-19T09:07:44.643 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.638+0000 7f4dd8fd5740 1 --2- 172.21.15.92:0/902242631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e9fa294370 0x55e9fa28b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:44.643 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.638+0000 7f4dd8fd5740 1 --2- 172.21.15.92:0/902242631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9fa28f2e0 0x55e9fa2a0140 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:44.643 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.638+0000 7f4dd8fd5740 1 --2- 172.21.15.92:0/902242631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9fa28e9a0 0x55e9fa2890b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:44.643 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.638+0000 7f4dd8fd5740 1 -- 172.21.15.92:0/902242631 >> 172.21.15.92:0/902242631 conn(0x55e9fa28a010 msgr2=0x55e9fa2889a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:44.643 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.638+0000 7f4dd8fd5740 1 -- 172.21.15.92:0/902242631 shutdown_connections 2024-09-19T09:07:44.643 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.638+0000 7f4dd8fd5740 1 -- 172.21.15.92:0/902242631 wait complete. 2024-09-19T09:07:44.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.638+0000 7f4dd8fd5740 1 -- start start 2024-09-19T09:07:44.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.639+0000 7f4dd8fd5740 1 Processor -- start 2024-09-19T09:07:44.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.639+0000 7f4dd8fd5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9fa28e9a0 0x55e9fa29cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:44.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.639+0000 7f4dd8fd5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e9fa28f2e0 0x55e9fa29d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:44.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.639+0000 7f4dd8fd5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9fa294370 0x55e9fa30d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:44.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.639+0000 7f4dd8fd5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd01b6a50 con 0x55e9fa28e9a0 2024-09-19T09:07:44.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.639+0000 7f4dd8fd5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd01b7ec0 con 0x55e9fa28f2e0 2024-09-19T09:07:44.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.639+0000 7f4dd8fd5740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd01b7120 con 0x55e9fa294370 2024-09-19T09:07:44.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.639+0000 7f4dd8fd5740 10 client.0 _ll_register_callbacks cb 0x7f4dc00bc120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:44.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.639+0000 7f4dcf7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9fa28e9a0 0x55e9fa29cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:44.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.639+0000 7f4dcf7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9fa28e9a0 0x55e9fa29cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50358/0 (socket says 172.21.15.92:50358) 2024-09-19T09:07:44.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.639+0000 7f4dcf7fe640 1 -- 172.21.15.92:0/727559421 learned_addr learned my addr 172.21.15.92:0/727559421 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.639+0000 7f4dcffff640 1 --2- 172.21.15.92:0/727559421 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9fa294370 0x55e9fa30d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.639+0000 7f4dceffd640 1 --2- 172.21.15.92:0/727559421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e9fa28f2e0 0x55e9fa29d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.639+0000 7f4dcffff640 1 -- 172.21.15.92:0/727559421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e9fa28f2e0 msgr2=0x55e9fa29d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.639+0000 7f4dcffff640 1 --2- 172.21.15.92:0/727559421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e9fa28f2e0 0x55e9fa29d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.639+0000 7f4dcffff640 1 -- 172.21.15.92:0/727559421 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9fa28e9a0 msgr2=0x55e9fa29cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.639+0000 7f4dcffff640 1 --2- 172.21.15.92:0/727559421 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9fa28e9a0 0x55e9fa29cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.639+0000 7f4dcffff640 1 -- 172.21.15.92:0/727559421 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9fa30d720 con 0x55e9fa294370 2024-09-19T09:07:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.639+0000 7f4dcf7fe640 1 --2- 172.21.15.92:0/727559421 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9fa28e9a0 0x55e9fa29cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.640+0000 7f4dcffff640 1 --2- 172.21.15.92:0/727559421 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9fa294370 0x55e9fa30d1e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8013f30 tx=0x7f4dc8007520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d3bc77c6a5db54f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.640+0000 7f4daeffd640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:07:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.640+0000 7f4daeffd640 1 -- 172.21.15.92:0/727559421 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc8017040 con 0x55e9fa294370 2024-09-19T09:07:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.640+0000 7f4daeffd640 1 -- 172.21.15.92:0/727559421 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4dc800f420 con 0x55e9fa294370 2024-09-19T09:07:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.640+0000 7f4dd8fd5740 1 -- 172.21.15.92:0/727559421 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4dc4003d60 con 0x55e9fa294370 2024-09-19T09:07:44.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.640+0000 7f4daeffd640 1 -- 172.21.15.92:0/727559421 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4dc802a640 con 0x55e9fa294370 2024-09-19T09:07:44.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.640+0000 7f4dd8fd5740 10 client.27232 fetch_fsmap learned FSMap version 19 2024-09-19T09:07:44.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.640+0000 7f4dd8fd5740 1 -- 172.21.15.92:0/727559421 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e9fa30ea60 con 0x55e9fa294370 2024-09-19T09:07:44.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.640+0000 7f4daeffd640 1 -- 172.21.15.92:0/727559421 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4dc4003d60 con 0x55e9fa294370 2024-09-19T09:07:44.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.640+0000 7f4daeffd640 1 -- 172.21.15.92:0/727559421 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f4dc8028070 con 0x55e9fa294370 2024-09-19T09:07:44.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.640+0000 7f4dd8fd5740 10 client.27232 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:07:44.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.640+0000 7f4dd8fd5740 10 client.27232 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:07:44.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.640+0000 7f4dd8fd5740 20 client.27232 populate_metadata read hostname 'smithi092' 2024-09-19T09:07:44.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.640+0000 7f4dd8fd5740 1 --2- 172.21.15.92:0/727559421 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e9fa2a4560 0x55e9fa311480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:44.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.640+0000 7f4dd8fd5740 4 client.27232 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:07:44.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.640+0000 7f4dd8fd5740 1 -- 172.21.15.92:0/727559421 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e9fa1f9d70 con 0x55e9fa2a4560 2024-09-19T09:07:44.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.641+0000 7f4dcf7fe640 1 --2- 172.21.15.92:0/727559421 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e9fa2a4560 0x55e9fa311480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:44.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.641+0000 7f4daeffd640 10 client.27232 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:07:44.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.641+0000 7f4dcf7fe640 1 --2- 172.21.15.92:0/727559421 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e9fa2a4560 0x55e9fa311480 crc :-1 s=READY pgs=346 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38a36a6ffeb4d1c5 server_cookie=6cc40737405cf2b5 in_seq=0 out_seq=0 2024-09-19T09:07:44.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.655+0000 7f4daeffd640 1 -- 172.21.15.92:0/727559421 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e9fa1f9d70 con 0x55e9fa2a4560 2024-09-19T09:07:44.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.655+0000 7f4daeffd640 10 client.27232 handle_command_reply: tid=0 2024-09-19T09:07:44.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.655+0000 7f4dd8fd5740 1 client.27232 shutdown 2024-09-19T09:07:44.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.655+0000 7f4dd8fd5740 1 -- 172.21.15.92:0/727559421 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9fa294370 msgr2=0x55e9fa30d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:44.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.655+0000 7f4dd8fd5740 1 --2- 172.21.15.92:0/727559421 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9fa294370 0x55e9fa30d1e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8013f30 tx=0x7f4dc8007520 comp rx=0 tx=0).stop 2024-09-19T09:07:44.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.656+0000 7f4dd8fd5740 1 -- 172.21.15.92:0/727559421 shutdown_connections 2024-09-19T09:07:44.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.656+0000 7f4dd8fd5740 1 --2- 172.21.15.92:0/727559421 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e9fa2a4560 0x55e9fa311480 crc :-1 s=READY pgs=346 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:44.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.656+0000 7f4dd8fd5740 1 --2- 172.21.15.92:0/727559421 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9fa294370 0x55e9fa30d1e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:44.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.656+0000 7f4dd8fd5740 1 --2- 172.21.15.92:0/727559421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e9fa28f2e0 0x55e9fa29d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:44.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.656+0000 7f4daeffd640 0 client.27232 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:07:44.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.656+0000 7f4dd8fd5740 1 --2- 172.21.15.92:0/727559421 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9fa28e9a0 0x55e9fa29cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:44.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.656+0000 7f4dd8fd5740 1 -- 172.21.15.92:0/727559421 >> 172.21.15.92:0/727559421 conn(0x55e9fa28a010 msgr2=0x55e9fa2891c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:44.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.656+0000 7f4dd8fd5740 1 -- 172.21.15.92:0/727559421 shutdown_connections 2024-09-19T09:07:44.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.656+0000 7f4dd8fd5740 1 -- 172.21.15.92:0/727559421 wait complete. 2024-09-19T09:07:44.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.656+0000 7f4dd8fd5740 20 client.27232 trim_cache size 0 max 16384 2024-09-19T09:07:44.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:07:44.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:07:44.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:07:44.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:07:44.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.656+0000 7f4dd623c640 1 -- 172.21.15.92:0/2109833330 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4db80a32f0 msgr2=0x7f4db80a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:44.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.656+0000 7f4dd623c640 1 --2- 172.21.15.92:0/2109833330 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4db80a32f0 0x7f4db80a57b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4dc80136a0 tx=0x7f4dc80079b0 comp rx=0 tx=0).stop 2024-09-19T09:07:44.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.656+0000 7f4dd623c640 1 -- 172.21.15.92:0/2109833330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4dd0100a40 msgr2=0x7f4dd0110e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:44.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.656+0000 7f4dd623c640 1 --2- 172.21.15.92:0/2109833330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4dd0100a40 0x7f4dd0110e50 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0031610 tx=0x7f4dc0004270 comp rx=0 tx=0).stop 2024-09-19T09:07:44.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.656+0000 7f4dd623c640 1 -- 172.21.15.92:0/2109833330 shutdown_connections 2024-09-19T09:07:44.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.657+0000 7f4dd623c640 1 --2- 172.21.15.92:0/2109833330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dd01025f0 0x7f4dd0118400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:44.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.657+0000 7f4dd623c640 1 --2- 172.21.15.92:0/2109833330 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4dd0101c30 0x7f4dd0111390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:44.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.657+0000 7f4dd623c640 1 --2- 172.21.15.92:0/2109833330 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4db80a32f0 0x7f4db80a57b0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:44.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.657+0000 7f4dd623c640 1 --2- 172.21.15.92:0/2109833330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4dd0100a40 0x7f4dd0110e50 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:44.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.657+0000 7f4dd623c640 1 -- 172.21.15.92:0/2109833330 >> 172.21.15.92:0/2109833330 conn(0x7f4dd00fc1e0 msgr2=0x7f4dd0104f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:44.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.657+0000 7f4dd623c640 1 -- 172.21.15.92:0/2109833330 shutdown_connections 2024-09-19T09:07:44.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:44.657+0000 7f4dd623c640 1 -- 172.21.15.92:0/2109833330 wait complete. 2024-09-19T09:07:45.795 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 660.0 s, 3175.8 tps, lat 31.404 ms stddev 33.767 2024-09-19T09:07:45.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:45 smithi167 ceph-mon[35359]: pgmap v668: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 9.4 MiB/s wr, 887 op/s 2024-09-19T09:07:45.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:45 smithi190 ceph-mon[35358]: pgmap v668: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 9.4 MiB/s wr, 887 op/s 2024-09-19T09:07:46.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:45 smithi092 ceph-mon[31407]: pgmap v668: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 9.4 MiB/s wr, 887 op/s 2024-09-19T09:07:47.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:47 smithi167 ceph-mon[35359]: pgmap v669: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 7.7 MiB/s wr, 808 op/s 2024-09-19T09:07:47.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:47 smithi190 ceph-mon[35358]: pgmap v669: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 7.7 MiB/s wr, 808 op/s 2024-09-19T09:07:48.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:47 smithi092 ceph-mon[31407]: pgmap v669: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 7.7 MiB/s wr, 808 op/s 2024-09-19T09:07:49.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:49 smithi167 ceph-mon[35359]: pgmap v670: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 8.1 MiB/s wr, 793 op/s 2024-09-19T09:07:49.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:49 smithi190 ceph-mon[35358]: pgmap v670: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 8.1 MiB/s wr, 793 op/s 2024-09-19T09:07:50.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:49 smithi092 ceph-mon[31407]: pgmap v670: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 8.1 MiB/s wr, 793 op/s 2024-09-19T09:07:50.795 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 665.0 s, 2898.8 tps, lat 34.379 ms stddev 44.460 2024-09-19T09:07:50.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:50 smithi190 ceph-mon[35358]: pgmap v671: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 7.5 MiB/s wr, 764 op/s 2024-09-19T09:07:51.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:50 smithi092 ceph-mon[31407]: pgmap v671: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 7.5 MiB/s wr, 764 op/s 2024-09-19T09:07:51.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:50 smithi167 ceph-mon[35359]: pgmap v671: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 7.5 MiB/s wr, 764 op/s 2024-09-19T09:07:53.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:52 smithi092 ceph-mon[31407]: pgmap v672: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 7.4 MiB/s wr, 708 op/s 2024-09-19T09:07:53.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:52 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:07:53.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:52 smithi167 ceph-mon[35359]: pgmap v672: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 7.4 MiB/s wr, 708 op/s 2024-09-19T09:07:53.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:52 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:07:53.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:52 smithi190 ceph-mon[35358]: pgmap v672: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 7.4 MiB/s wr, 708 op/s 2024-09-19T09:07:53.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:52 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:07:54.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:53 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:07:54.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:53 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:07:54.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:53 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:07:54.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:53 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:07:54.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:53 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:07:54.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:53 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:07:54.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:53 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:07:54.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:53 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:07:54.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:53 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:07:55.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:54 smithi092 ceph-mon[31407]: pgmap v673: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.3 MiB/s wr, 693 op/s 2024-09-19T09:07:55.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:54 smithi167 ceph-mon[35359]: pgmap v673: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.3 MiB/s wr, 693 op/s 2024-09-19T09:07:55.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:54 smithi190 ceph-mon[35358]: pgmap v673: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.3 MiB/s wr, 693 op/s 2024-09-19T09:07:55.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 670.0 s, 3549.8 tps, lat 28.203 ms stddev 33.773 2024-09-19T09:07:57.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.766+0000 7f503cc1e640 1 -- 172.21.15.92:0/1610605525 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5038107830 msgr2=0x7f5038109ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:57.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.766+0000 7f503cc1e640 1 --2- 172.21.15.92:0/1610605525 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5038107830 0x7f5038109ca0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5030013fd0 tx=0x7f5030032d90 comp rx=0 tx=0).stop 2024-09-19T09:07:57.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.767+0000 7f503cc1e640 1 -- 172.21.15.92:0/1610605525 shutdown_connections 2024-09-19T09:07:57.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.767+0000 7f503cc1e640 1 --2- 172.21.15.92:0/1610605525 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5038107830 0x7f5038109ca0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.767+0000 7f503cc1e640 1 --2- 172.21.15.92:0/1610605525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5038104f00 0x7f50381072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.767+0000 7f503cc1e640 1 --2- 172.21.15.92:0/1610605525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50381025d0 0x7f50381049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.767+0000 7f503cc1e640 1 -- 172.21.15.92:0/1610605525 >> 172.21.15.92:0/1610605525 conn(0x7f50380fc1b0 msgr2=0x7f50380fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:57.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.767+0000 7f503cc1e640 1 -- 172.21.15.92:0/1610605525 shutdown_connections 2024-09-19T09:07:57.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.767+0000 7f503cc1e640 1 -- 172.21.15.92:0/1610605525 wait complete. 2024-09-19T09:07:57.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.767+0000 7f503cc1e640 1 Processor -- start 2024-09-19T09:07:57.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.767+0000 7f503cc1e640 1 -- start start 2024-09-19T09:07:57.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.768+0000 7f503cc1e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50381025d0 0x7f5038195bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:57.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.768+0000 7f503cc1e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5038104f00 0x7f50381960f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:57.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.768+0000 7f503cc1e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5038107830 0x7f503819d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:57.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.768+0000 7f503cc1e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f503810b5a0 con 0x7f5038107830 2024-09-19T09:07:57.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.768+0000 7f503cc1e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f503810b420 con 0x7f50381025d0 2024-09-19T09:07:57.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.768+0000 7f503cc1e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f503810b720 con 0x7f5038104f00 2024-09-19T09:07:57.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.768+0000 7f5036d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5038107830 0x7f503819d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:57.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.768+0000 7f5035d9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5038104f00 0x7f50381960f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:57.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.768+0000 7f5036d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5038107830 0x7f503819d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42534/0 (socket says 172.21.15.92:42534) 2024-09-19T09:07:57.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.768+0000 7f5036d9d640 1 -- 172.21.15.92:0/2390350551 learned_addr learned my addr 172.21.15.92:0/2390350551 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:57.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.768+0000 7f503659c640 1 --2- 172.21.15.92:0/2390350551 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50381025d0 0x7f5038195bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:57.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.768+0000 7f5036d9d640 1 -- 172.21.15.92:0/2390350551 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5038104f00 msgr2=0x7f50381960f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:57.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.768+0000 7f5036d9d640 1 --2- 172.21.15.92:0/2390350551 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5038104f00 0x7f50381960f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.768+0000 7f5036d9d640 1 -- 172.21.15.92:0/2390350551 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50381025d0 msgr2=0x7f5038195bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:57.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.768+0000 7f5036d9d640 1 --2- 172.21.15.92:0/2390350551 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50381025d0 0x7f5038195bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.768+0000 7f5036d9d640 1 -- 172.21.15.92:0/2390350551 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f503819d7d0 con 0x7f5038107830 2024-09-19T09:07:57.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.768+0000 7f5035d9b640 1 --2- 172.21.15.92:0/2390350551 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5038104f00 0x7f50381960f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:57.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.768+0000 7f503659c640 1 --2- 172.21.15.92:0/2390350551 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50381025d0 0x7f5038195bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:57.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.768+0000 7f5036d9d640 1 --2- 172.21.15.92:0/2390350551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5038107830 0x7f503819d160 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f503003e040 tx=0x7f5030034b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:57.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.769+0000 7f50277fe640 1 -- 172.21.15.92:0/2390350551 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5030040050 con 0x7f5038107830 2024-09-19T09:07:57.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.769+0000 7f50277fe640 1 -- 172.21.15.92:0/2390350551 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f503004c070 con 0x7f5038107830 2024-09-19T09:07:57.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.769+0000 7f503cc1e640 1 -- 172.21.15.92:0/2390350551 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f503819da60 con 0x7f5038107830 2024-09-19T09:07:57.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.769+0000 7f50277fe640 1 -- 172.21.15.92:0/2390350551 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5030004040 con 0x7f5038107830 2024-09-19T09:07:57.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.769+0000 7f503cc1e640 1 -- 172.21.15.92:0/2390350551 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f503819df50 con 0x7f5038107830 2024-09-19T09:07:57.775 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.772+0000 7f50277fe640 1 -- 172.21.15.92:0/2390350551 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f503003b440 con 0x7f5038107830 2024-09-19T09:07:57.775 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.772+0000 7f503fa90740 1 Processor -- start 2024-09-19T09:07:57.775 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.772+0000 7f503fa90740 1 -- start start 2024-09-19T09:07:57.775 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.772+0000 7f503fa90740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e8769e9a0 0x556e8769eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:57.775 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.772+0000 7f503fa90740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e8769f2e0 0x556e876a3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.772+0000 7f503fa90740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e876a4370 0x556e876a6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.772+0000 7f503fa90740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556e876022f0 con 0x556e876a4370 2024-09-19T09:07:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.772+0000 7f503fa90740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556e875aa270 con 0x556e8769f2e0 2024-09-19T09:07:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.772+0000 7f503fa90740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x556e875fe2b0 con 0x556e8769e9a0 2024-09-19T09:07:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.773+0000 7f5035d9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e8769e9a0 0x556e8769eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.773+0000 7f5035d9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e8769e9a0 0x556e8769eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:58932/0 (socket says 172.21.15.92:58932) 2024-09-19T09:07:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.773+0000 7f5035d9b640 1 -- 172.21.15.92:0/861264083 learned_addr learned my addr 172.21.15.92:0/861264083 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.773+0000 7f50277fe640 1 --2- 172.21.15.92:0/2390350551 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f50200a3340 0x7f50200a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.773+0000 7f5035d9b640 1 --2- 172.21.15.92:0/861264083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e876a4370 0x556e876a6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.773+0000 7f503659c640 1 --2- 172.21.15.92:0/861264083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e8769f2e0 0x556e876a3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.773+0000 7f50277fe640 1 -- 172.21.15.92:0/2390350551 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f50300f8cf0 con 0x7f5038107830 2024-09-19T09:07:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.773+0000 7f5036d9d640 1 --2- 172.21.15.92:0/2390350551 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f50200a3340 0x7f50200a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:57.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.773+0000 7f5035d9b640 1 -- 172.21.15.92:0/861264083 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e8769e9a0 msgr2=0x556e8769eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:57.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.773+0000 7f5035d9b640 1 --2- 172.21.15.92:0/861264083 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e8769e9a0 0x556e8769eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.773+0000 7f5035d9b640 1 -- 172.21.15.92:0/861264083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e8769f2e0 msgr2=0x556e876a3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:57.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.773+0000 7f5035d9b640 1 --2- 172.21.15.92:0/861264083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e8769f2e0 0x556e876a3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.773+0000 7f5035d9b640 1 -- 172.21.15.92:0/861264083 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e875a9340 con 0x556e876a4370 2024-09-19T09:07:57.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.773+0000 7f5035d9b640 1 --2- 172.21.15.92:0/861264083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e876a4370 0x556e876a6830 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f502c011b80 tx=0x7f502c00a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=befd34fac751160 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:57.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.773+0000 7f5036d9d640 1 --2- 172.21.15.92:0/2390350551 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f50200a3340 0x7f50200a5800 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5030039810 tx=0x7f5030034e20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:57.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.773+0000 7f5024ff9640 1 -- 172.21.15.92:0/861264083 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502c00dde0 con 0x556e876a4370 2024-09-19T09:07:57.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.773+0000 7f5024ff9640 1 -- 172.21.15.92:0/861264083 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f502c011810 con 0x556e876a4370 2024-09-19T09:07:57.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.774+0000 7f5024ff9640 1 -- 172.21.15.92:0/861264083 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502c00f420 con 0x556e876a4370 2024-09-19T09:07:57.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.775+0000 7f503fa90740 1 -- 172.21.15.92:0/861264083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e876a4370 msgr2=0x556e876a6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:57.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.775+0000 7f503fa90740 1 --2- 172.21.15.92:0/861264083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e876a4370 0x556e876a6830 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f502c011b80 tx=0x7f502c00a2d0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.776+0000 7f503fa90740 1 -- 172.21.15.92:0/861264083 shutdown_connections 2024-09-19T09:07:57.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.776+0000 7f503fa90740 1 --2- 172.21.15.92:0/861264083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e876a4370 0x556e876a6830 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.776+0000 7f503fa90740 1 --2- 172.21.15.92:0/861264083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e8769f2e0 0x556e876a3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.776+0000 7f503fa90740 1 --2- 172.21.15.92:0/861264083 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e8769e9a0 0x556e8769eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.776+0000 7f503fa90740 1 -- 172.21.15.92:0/861264083 >> 172.21.15.92:0/861264083 conn(0x556e8769a010 msgr2=0x556e8769a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:57.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.777+0000 7f503fa90740 1 -- 172.21.15.92:0/861264083 shutdown_connections 2024-09-19T09:07:57.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.777+0000 7f503fa90740 1 -- 172.21.15.92:0/861264083 wait complete. 2024-09-19T09:07:57.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.778+0000 7f503fa90740 1 -- start start 2024-09-19T09:07:57.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.778+0000 7f503fa90740 1 Processor -- start 2024-09-19T09:07:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.778+0000 7f503fa90740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e8769e9a0 0x556e876a8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.778+0000 7f503fa90740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e8769f2e0 0x556e876a9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.779+0000 7f503fa90740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e876a4370 0x556e876b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.779+0000 7f503fa90740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556e876a7340 con 0x556e8769f2e0 2024-09-19T09:07:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.779+0000 7f503fa90740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556e8758b290 con 0x556e876a4370 2024-09-19T09:07:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.779+0000 7f503fa90740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x556e876a74c0 con 0x556e8769e9a0 2024-09-19T09:07:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.779+0000 7f503fa90740 10 client.0 _ll_register_callbacks cb 0x556e875bc140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:57.787 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.785+0000 7f503659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e8769f2e0 0x556e876a9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:57.787 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.786+0000 7f503659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e8769f2e0 0x556e876a9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42540/0 (socket says 172.21.15.92:42540) 2024-09-19T09:07:57.787 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.786+0000 7f503659c640 1 -- 172.21.15.92:0/2474326860 learned_addr learned my addr 172.21.15.92:0/2474326860 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:57.787 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.786+0000 7f5035d9b640 1 --2- 172.21.15.92:0/2474326860 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e8769e9a0 0x556e876a8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:57.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.791+0000 7f5035d9b640 1 --2- 172.21.15.92:0/2474326860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e876a4370 0x556e876b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:57.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.793+0000 7f5035d9b640 1 -- 172.21.15.92:0/2474326860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e876a4370 msgr2=0x556e876b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:57.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.793+0000 7f5035d9b640 1 --2- 172.21.15.92:0/2474326860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e876a4370 0x556e876b01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.793+0000 7f5035d9b640 1 -- 172.21.15.92:0/2474326860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e8769f2e0 msgr2=0x556e876a9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:57.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.793+0000 7f5035d9b640 1 --2- 172.21.15.92:0/2474326860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e8769f2e0 0x556e876a9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.793+0000 7f5035d9b640 1 -- 172.21.15.92:0/2474326860 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e87315210 con 0x556e8769e9a0 2024-09-19T09:07:57.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.797+0000 7f5035d9b640 1 --2- 172.21.15.92:0/2474326860 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e8769e9a0 0x556e876a8c50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f502c001eb0 tx=0x7f502c00a550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b50bf752f507bde4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:57.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.797+0000 7f501dffb640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:07:57.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.798+0000 7f501dffb640 1 -- 172.21.15.92:0/2474326860 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502c022070 con 0x556e8769e9a0 2024-09-19T09:07:57.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.798+0000 7f501dffb640 1 -- 172.21.15.92:0/2474326860 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f502c019070 con 0x556e8769e9a0 2024-09-19T09:07:57.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.798+0000 7f503fa90740 1 -- 172.21.15.92:0/2474326860 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f502c011810 con 0x556e8769e9a0 2024-09-19T09:07:57.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.804+0000 7f501dffb640 1 -- 172.21.15.92:0/2474326860 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f502c032050 con 0x556e8769e9a0 2024-09-19T09:07:57.810 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.810+0000 7f503fa90740 10 client.27244 fetch_fsmap learned FSMap version 19 2024-09-19T09:07:57.810 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.810+0000 7f503fa90740 1 -- 172.21.15.92:0/2474326860 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x556e873e1620 con 0x556e8769e9a0 2024-09-19T09:07:57.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.810+0000 7f501dffb640 1 -- 172.21.15.92:0/2474326860 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f502c011810 con 0x556e8769e9a0 2024-09-19T09:07:57.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.810+0000 7f501dffb640 1 -- 172.21.15.92:0/2474326860 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f502c01ea80 con 0x556e8769e9a0 2024-09-19T09:07:57.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.811+0000 7f503fa90740 10 client.27244 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:07:57.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.811+0000 7f503fa90740 10 client.27244 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:07:57.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.812+0000 7f503fa90740 20 client.27244 populate_metadata read hostname 'smithi092' 2024-09-19T09:07:57.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.812+0000 7f503fa90740 1 --2- 172.21.15.92:0/2474326860 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556e876b45e0 0x556e876b69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:57.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.812+0000 7f503fa90740 4 client.27244 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:07:57.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.812+0000 7f503fa90740 1 -- 172.21.15.92:0/2474326860 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556e8760fa20 con 0x556e876b45e0 2024-09-19T09:07:57.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.812+0000 7f503659c640 1 --2- 172.21.15.92:0/2474326860 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556e876b45e0 0x556e876b69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:57.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.813+0000 7f501dffb640 10 client.27244 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:07:57.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.813+0000 7f503659c640 1 --2- 172.21.15.92:0/2474326860 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556e876b45e0 0x556e876b69f0 crc :-1 s=READY pgs=347 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22177a505e60f164 server_cookie=bea9a87dee45ff2f in_seq=0 out_seq=0 2024-09-19T09:07:57.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.814+0000 7f501dffb640 1 -- 172.21.15.92:0/2474326860 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556e8760fa20 con 0x556e876b45e0 2024-09-19T09:07:57.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.814+0000 7f501dffb640 10 client.27244 handle_command_reply: tid=0 2024-09-19T09:07:57.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.814+0000 7f503fa90740 1 client.27244 shutdown 2024-09-19T09:07:57.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.814+0000 7f503fa90740 1 -- 172.21.15.92:0/2474326860 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e8769e9a0 msgr2=0x556e876a8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:57.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.814+0000 7f503fa90740 1 --2- 172.21.15.92:0/2474326860 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e8769e9a0 0x556e876a8c50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f502c001eb0 tx=0x7f502c00a550 comp rx=0 tx=0).stop 2024-09-19T09:07:57.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.819+0000 7f503fa90740 1 -- 172.21.15.92:0/2474326860 shutdown_connections 2024-09-19T09:07:57.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.819+0000 7f503fa90740 1 --2- 172.21.15.92:0/2474326860 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556e876b45e0 0x556e876b69f0 crc :-1 s=READY pgs=347 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.819+0000 7f501dffb640 0 client.27244 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:07:57.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.819+0000 7f503fa90740 1 --2- 172.21.15.92:0/2474326860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e876a4370 0x556e876b01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.821 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.819+0000 7f503fa90740 1 --2- 172.21.15.92:0/2474326860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e8769f2e0 0x556e876a9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.821 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.819+0000 7f503fa90740 1 --2- 172.21.15.92:0/2474326860 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e8769e9a0 0x556e876a8c50 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.821 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.819+0000 7f503fa90740 1 -- 172.21.15.92:0/2474326860 >> 172.21.15.92:0/2474326860 conn(0x556e8769a010 msgr2=0x556e8769b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:57.821 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.820+0000 7f503fa90740 1 -- 172.21.15.92:0/2474326860 shutdown_connections 2024-09-19T09:07:57.821 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.820+0000 7f503fa90740 1 -- 172.21.15.92:0/2474326860 wait complete. 2024-09-19T09:07:57.822 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.820+0000 7f503fa90740 20 client.27244 trim_cache size 0 max 16384 2024-09-19T09:07:57.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.837+0000 7f503fa90740 1 Processor -- start 2024-09-19T09:07:57.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.837+0000 7f503fa90740 1 -- start start 2024-09-19T09:07:57.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.838+0000 7f503fa90740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e8769e9a0 0x556e876bb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:57.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.838+0000 7f503fa90740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e8769f2e0 0x556e876b0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:57.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.838+0000 7f503fa90740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e876a4370 0x556e876bb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:57.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.838+0000 7f503fa90740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f50381a4e10 con 0x556e8769f2e0 2024-09-19T09:07:57.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.838+0000 7f503fa90740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f50381a76b0 con 0x556e8769e9a0 2024-09-19T09:07:57.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.838+0000 7f503fa90740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f50381a54a0 con 0x556e876a4370 2024-09-19T09:07:57.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.838+0000 7f503659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e8769f2e0 0x556e876b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:57.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.838+0000 7f503659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e8769f2e0 0x556e876b0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42554/0 (socket says 172.21.15.92:42554) 2024-09-19T09:07:57.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.838+0000 7f503659c640 1 -- 172.21.15.92:0/3136021415 learned_addr learned my addr 172.21.15.92:0/3136021415 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:57.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.838+0000 7f5035d9b640 1 --2- 172.21.15.92:0/3136021415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e876a4370 0x556e876bb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:57.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.838+0000 7f5035d9b640 1 --2- 172.21.15.92:0/3136021415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e8769e9a0 0x556e876bb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:57.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.838+0000 7f503659c640 1 -- 172.21.15.92:0/3136021415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e876a4370 msgr2=0x556e876bb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:57.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.838+0000 7f503659c640 1 --2- 172.21.15.92:0/3136021415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e876a4370 0x556e876bb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.838+0000 7f503659c640 1 -- 172.21.15.92:0/3136021415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e8769e9a0 msgr2=0x556e876bb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:57.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.838+0000 7f503659c640 1 --2- 172.21.15.92:0/3136021415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e8769e9a0 0x556e876bb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.838+0000 7f503659c640 1 -- 172.21.15.92:0/3136021415 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e87699e30 con 0x556e8769f2e0 2024-09-19T09:07:57.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.838+0000 7f5035d9b640 1 --2- 172.21.15.92:0/3136021415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e876a4370 0x556e876bb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:07:57.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.838+0000 7f503659c640 1 --2- 172.21.15.92:0/3136021415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e8769f2e0 0x556e876b0190 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f50280116d0 tx=0x7f502800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e31fc33ce82ea40 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:57.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.839+0000 7f501ffff640 1 -- 172.21.15.92:0/3136021415 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5028004220 con 0x556e8769f2e0 2024-09-19T09:07:57.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.839+0000 7f501ffff640 1 -- 172.21.15.92:0/3136021415 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50280043c0 con 0x556e8769f2e0 2024-09-19T09:07:57.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.839+0000 7f501ffff640 1 -- 172.21.15.92:0/3136021415 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50280047a0 con 0x556e8769f2e0 2024-09-19T09:07:57.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.840+0000 7f503fa90740 1 -- 172.21.15.92:0/3136021415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e8769f2e0 msgr2=0x556e876b0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:57.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.840+0000 7f503fa90740 1 --2- 172.21.15.92:0/3136021415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e8769f2e0 0x556e876b0190 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f50280116d0 tx=0x7f502800b390 comp rx=0 tx=0).stop 2024-09-19T09:07:57.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.840+0000 7f503fa90740 1 -- 172.21.15.92:0/3136021415 shutdown_connections 2024-09-19T09:07:57.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.840+0000 7f503fa90740 1 --2- 172.21.15.92:0/3136021415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e876a4370 0x556e876bb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.840+0000 7f503fa90740 1 --2- 172.21.15.92:0/3136021415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e8769f2e0 0x556e876b0190 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.840+0000 7f503fa90740 1 --2- 172.21.15.92:0/3136021415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e8769e9a0 0x556e876bb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.840+0000 7f503fa90740 1 -- 172.21.15.92:0/3136021415 >> 172.21.15.92:0/3136021415 conn(0x556e8769a010 msgr2=0x556e876991c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:57.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.840+0000 7f503fa90740 1 -- 172.21.15.92:0/3136021415 shutdown_connections 2024-09-19T09:07:57.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.840+0000 7f503fa90740 1 -- 172.21.15.92:0/3136021415 wait complete. 2024-09-19T09:07:57.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.840+0000 7f503fa90740 1 -- start start 2024-09-19T09:07:57.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.840+0000 7f503fa90740 1 Processor -- start 2024-09-19T09:07:57.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.841+0000 7f503fa90740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e8769e9a0 0x556e876ad870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:57.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.841+0000 7f503fa90740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e8769f2e0 0x556e876addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:57.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.841+0000 7f503fa90740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e876a4370 0x556e876aed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:57.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.841+0000 7f503fa90740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f50381a5b70 con 0x556e8769f2e0 2024-09-19T09:07:57.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.841+0000 7f503fa90740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f50381a6fe0 con 0x556e876a4370 2024-09-19T09:07:57.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.841+0000 7f503fa90740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f50381a6240 con 0x556e8769e9a0 2024-09-19T09:07:57.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.841+0000 7f503fa90740 10 client.0 _ll_register_callbacks cb 0x7f502800bb20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:57.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.841+0000 7f5035d9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e8769e9a0 0x556e876ad870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:57.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.841+0000 7f5035d9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e8769e9a0 0x556e876ad870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:58974/0 (socket says 172.21.15.92:58974) 2024-09-19T09:07:57.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.841+0000 7f5035d9b640 1 -- 172.21.15.92:0/387381066 learned_addr learned my addr 172.21.15.92:0/387381066 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:07:57.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.841+0000 7f503659c640 1 --2- 172.21.15.92:0/387381066 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e8769f2e0 0x556e876addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:57.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.841+0000 7f5035d9b640 1 --2- 172.21.15.92:0/387381066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e876a4370 0x556e876aed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:57.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.841+0000 7f5035d9b640 1 -- 172.21.15.92:0/387381066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e876a4370 msgr2=0x556e876aed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:57.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.842+0000 7f5035d9b640 1 --2- 172.21.15.92:0/387381066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e876a4370 0x556e876aed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.842+0000 7f5035d9b640 1 -- 172.21.15.92:0/387381066 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e8769f2e0 msgr2=0x556e876addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:57.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.842+0000 7f5035d9b640 1 --2- 172.21.15.92:0/387381066 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e8769f2e0 0x556e876addb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.842+0000 7f5035d9b640 1 -- 172.21.15.92:0/387381066 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e876af380 con 0x556e8769e9a0 2024-09-19T09:07:57.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.842+0000 7f5035d9b640 1 --2- 172.21.15.92:0/387381066 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e8769e9a0 0x556e876ad870 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f502c020040 tx=0x7f502c01ffb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59a7a213326636b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:57.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.842+0000 7f501dffb640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:07:57.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.842+0000 7f501dffb640 1 -- 172.21.15.92:0/387381066 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502c03e020 con 0x556e8769e9a0 2024-09-19T09:07:57.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.842+0000 7f501dffb640 1 -- 172.21.15.92:0/387381066 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f502c00f8e0 con 0x556e8769e9a0 2024-09-19T09:07:57.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.842+0000 7f503fa90740 1 -- 172.21.15.92:0/387381066 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50280043c0 con 0x556e8769e9a0 2024-09-19T09:07:57.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.842+0000 7f501dffb640 1 -- 172.21.15.92:0/387381066 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f502c022070 con 0x556e8769e9a0 2024-09-19T09:07:57.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.842+0000 7f503fa90740 10 client.27250 fetch_fsmap learned FSMap version 19 2024-09-19T09:07:57.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.842+0000 7f503fa90740 1 -- 172.21.15.92:0/387381066 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x556e87730280 con 0x556e8769e9a0 2024-09-19T09:07:57.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.843+0000 7f501dffb640 1 -- 172.21.15.92:0/387381066 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f502c023040 con 0x556e8769e9a0 2024-09-19T09:07:57.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.843+0000 7f501dffb640 1 -- 172.21.15.92:0/387381066 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f502c0053f0 con 0x556e8769e9a0 2024-09-19T09:07:57.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.843+0000 7f503fa90740 10 client.27250 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:07:57.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.843+0000 7f503fa90740 10 client.27250 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:07:57.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.843+0000 7f503fa90740 20 client.27250 populate_metadata read hostname 'smithi092' 2024-09-19T09:07:57.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.843+0000 7f503fa90740 1 --2- 172.21.15.92:0/387381066 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556e87730b10 0x556e87732f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:57.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.843+0000 7f503fa90740 4 client.27250 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:07:57.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.843+0000 7f503fa90740 1 -- 172.21.15.92:0/387381066 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f50280043c0 con 0x556e87730b10 2024-09-19T09:07:57.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.843+0000 7f503659c640 1 --2- 172.21.15.92:0/387381066 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556e87730b10 0x556e87732f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:57.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.843+0000 7f503659c640 1 --2- 172.21.15.92:0/387381066 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556e87730b10 0x556e87732f30 crc :-1 s=READY pgs=348 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8db700af9c425e23 server_cookie=20060499d6188504 in_seq=0 out_seq=0 2024-09-19T09:07:57.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.843+0000 7f501dffb640 10 client.27250 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:07:57.851 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:57 smithi167 ceph-mon[35359]: pgmap v674: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.7 MiB/s wr, 718 op/s 2024-09-19T09:07:57.863 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.862+0000 7f501dffb640 1 -- 172.21.15.92:0/387381066 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f50280043c0 con 0x556e87730b10 2024-09-19T09:07:57.863 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.862+0000 7f501dffb640 10 client.27250 handle_command_reply: tid=0 2024-09-19T09:07:57.863 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.862+0000 7f503fa90740 1 client.27250 shutdown 2024-09-19T09:07:57.863 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.862+0000 7f503fa90740 1 -- 172.21.15.92:0/387381066 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e8769e9a0 msgr2=0x556e876ad870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:57.863 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.862+0000 7f503fa90740 1 --2- 172.21.15.92:0/387381066 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e8769e9a0 0x556e876ad870 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f502c020040 tx=0x7f502c01ffb0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.864 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.862+0000 7f503fa90740 1 -- 172.21.15.92:0/387381066 shutdown_connections 2024-09-19T09:07:57.864 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.862+0000 7f503fa90740 1 --2- 172.21.15.92:0/387381066 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556e87730b10 0x556e87732f30 crc :-1 s=READY pgs=348 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.864 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.862+0000 7f503fa90740 1 --2- 172.21.15.92:0/387381066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e876a4370 0x556e876aed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.864 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.862+0000 7f503fa90740 1 --2- 172.21.15.92:0/387381066 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e8769f2e0 0x556e876addb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.865 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.862+0000 7f503fa90740 1 --2- 172.21.15.92:0/387381066 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e8769e9a0 0x556e876ad870 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.865 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.862+0000 7f503fa90740 1 -- 172.21.15.92:0/387381066 >> 172.21.15.92:0/387381066 conn(0x556e8769a010 msgr2=0x556e876991c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:57.865 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.862+0000 7f501dffb640 0 client.27250 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:07:57.865 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.862+0000 7f503fa90740 1 -- 172.21.15.92:0/387381066 shutdown_connections 2024-09-19T09:07:57.865 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.862+0000 7f503fa90740 1 -- 172.21.15.92:0/387381066 wait complete. 2024-09-19T09:07:57.865 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.862+0000 7f503fa90740 20 client.27250 trim_cache size 0 max 16384 2024-09-19T09:07:57.866 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:07:57.866 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:07:57.866 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:07:57.866 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:07:57.868 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.863+0000 7f503cc1e640 1 -- 172.21.15.92:0/2390350551 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f50200a3340 msgr2=0x7f50200a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:57.868 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.863+0000 7f503cc1e640 1 --2- 172.21.15.92:0/2390350551 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f50200a3340 0x7f50200a5800 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5030039810 tx=0x7f5030034e20 comp rx=0 tx=0).stop 2024-09-19T09:07:57.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.863+0000 7f503cc1e640 1 -- 172.21.15.92:0/2390350551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5038107830 msgr2=0x7f503819d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:57.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.863+0000 7f503cc1e640 1 --2- 172.21.15.92:0/2390350551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5038107830 0x7f503819d160 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f503003e040 tx=0x7f5030034b20 comp rx=0 tx=0).stop 2024-09-19T09:07:57.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.863+0000 7f503cc1e640 1 -- 172.21.15.92:0/2390350551 shutdown_connections 2024-09-19T09:07:57.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.863+0000 7f503cc1e640 1 --2- 172.21.15.92:0/2390350551 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f50200a3340 0x7f50200a5800 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.863+0000 7f503cc1e640 1 --2- 172.21.15.92:0/2390350551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5038107830 0x7f503819d160 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.863+0000 7f503cc1e640 1 --2- 172.21.15.92:0/2390350551 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5038104f00 0x7f50381960f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.863+0000 7f503cc1e640 1 --2- 172.21.15.92:0/2390350551 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50381025d0 0x7f5038195bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.863+0000 7f503cc1e640 1 -- 172.21.15.92:0/2390350551 >> 172.21.15.92:0/2390350551 conn(0x7f50380fc1b0 msgr2=0x7f5038102f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:57.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.863+0000 7f503cc1e640 1 -- 172.21.15.92:0/2390350551 shutdown_connections 2024-09-19T09:07:57.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:07:57.863+0000 7f503cc1e640 1 -- 172.21.15.92:0/2390350551 wait complete. 2024-09-19T09:07:57.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:57 smithi190 ceph-mon[35358]: pgmap v674: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.7 MiB/s wr, 718 op/s 2024-09-19T09:07:58.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:57 smithi092 ceph-mon[31407]: pgmap v674: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.7 MiB/s wr, 718 op/s 2024-09-19T09:07:59.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:07:59 smithi167 ceph-mon[35359]: pgmap v675: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 MiB/s wr, 720 op/s 2024-09-19T09:07:59.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:07:59 smithi190 ceph-mon[35358]: pgmap v675: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 MiB/s wr, 720 op/s 2024-09-19T09:08:00.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:07:59 smithi092 ceph-mon[31407]: pgmap v675: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 MiB/s wr, 720 op/s 2024-09-19T09:08:00.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 675.0 s, 2494.4 tps, lat 40.137 ms stddev 48.203 2024-09-19T09:08:01.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:01 smithi167 ceph-mon[35359]: pgmap v676: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 MiB/s wr, 715 op/s 2024-09-19T09:08:01.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:01 smithi190 ceph-mon[35358]: pgmap v676: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 MiB/s wr, 715 op/s 2024-09-19T09:08:02.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:01 smithi092 ceph-mon[31407]: pgmap v676: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 MiB/s wr, 715 op/s 2024-09-19T09:08:02.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:02 smithi190 ceph-mon[35358]: pgmap v677: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.6 MiB/s wr, 674 op/s 2024-09-19T09:08:03.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:02 smithi092 ceph-mon[31407]: pgmap v677: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.6 MiB/s wr, 674 op/s 2024-09-19T09:08:03.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:02 smithi167 ceph-mon[35359]: pgmap v677: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.6 MiB/s wr, 674 op/s 2024-09-19T09:08:05.795 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 680.0 s, 2474.0 tps, lat 40.370 ms stddev 46.537 2024-09-19T09:08:05.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:05 smithi167 ceph-mon[35359]: pgmap v678: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.2 MiB/s wr, 684 op/s 2024-09-19T09:08:05.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:05 smithi190 ceph-mon[35358]: pgmap v678: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.2 MiB/s wr, 684 op/s 2024-09-19T09:08:06.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:05 smithi092 ceph-mon[31407]: pgmap v678: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.2 MiB/s wr, 684 op/s 2024-09-19T09:08:07.765 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:08:07.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:07 smithi167 ceph-mon[35359]: pgmap v679: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.6 MiB/s wr, 773 op/s 2024-09-19T09:08:07.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:07 smithi190 ceph-mon[35358]: pgmap v679: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.6 MiB/s wr, 773 op/s 2024-09-19T09:08:08.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:07 smithi092 ceph-mon[31407]: pgmap v679: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.6 MiB/s wr, 773 op/s 2024-09-19T09:08:08.099 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:08:08.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.723+0000 7f1753e87640 1 -- 172.21.15.92:0/1024740157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f174c077040 msgr2=0x7f174c1124f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:08.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.723+0000 7f1753e87640 1 --2- 172.21.15.92:0/1024740157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f174c077040 0x7f174c1124f0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f173c009900 tx=0x7f173c02a440 comp rx=0 tx=0).stop 2024-09-19T09:08:08.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.724+0000 7f1753e87640 1 -- 172.21.15.92:0/1024740157 shutdown_connections 2024-09-19T09:08:08.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.724+0000 7f1753e87640 1 --2- 172.21.15.92:0/1024740157 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f174c112a30 0x7f174c114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.724+0000 7f1753e87640 1 --2- 172.21.15.92:0/1024740157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f174c077040 0x7f174c1124f0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.724+0000 7f1753e87640 1 --2- 172.21.15.92:0/1024740157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f174c076720 0x7f174c076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.724+0000 7f1753e87640 1 -- 172.21.15.92:0/1024740157 >> 172.21.15.92:0/1024740157 conn(0x7f174c0ffa90 msgr2=0x7f174c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:08.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.724+0000 7f1753e87640 1 -- 172.21.15.92:0/1024740157 shutdown_connections 2024-09-19T09:08:08.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.724+0000 7f1753e87640 1 -- 172.21.15.92:0/1024740157 wait complete. 2024-09-19T09:08:08.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.725+0000 7f1753e87640 1 Processor -- start 2024-09-19T09:08:08.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.725+0000 7f1753e87640 1 -- start start 2024-09-19T09:08:08.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.725+0000 7f1753e87640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f174c076720 0x7f174c1a4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:08.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.725+0000 7f1753e87640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f174c077040 0x7f174c1a4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:08.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.725+0000 7f1753e87640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f174c112a30 0x7f174c19ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:08.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.725+0000 7f1753e87640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1186e0 con 0x7f174c076720 2024-09-19T09:08:08.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.725+0000 7f1753e87640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f174c118560 con 0x7f174c077040 2024-09-19T09:08:08.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.725+0000 7f1753e87640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f174c118860 con 0x7f174c112a30 2024-09-19T09:08:08.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.725+0000 7f1751c23640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f174c076720 0x7f174c1a4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:08.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.725+0000 7f1752424640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f174c112a30 0x7f174c19ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:08.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.725+0000 7f1752424640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f174c112a30 0x7f174c19ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:40418/0 (socket says 172.21.15.92:40418) 2024-09-19T09:08:08.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.725+0000 7f1751c23640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f174c076720 0x7f174c1a4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52072/0 (socket says 172.21.15.92:52072) 2024-09-19T09:08:08.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.725+0000 7f1752424640 1 -- 172.21.15.92:0/1494060296 learned_addr learned my addr 172.21.15.92:0/1494060296 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:08.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.725+0000 7f1751422640 1 --2- 172.21.15.92:0/1494060296 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f174c077040 0x7f174c1a4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:08.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.725+0000 7f1752424640 1 -- 172.21.15.92:0/1494060296 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f174c077040 msgr2=0x7f174c1a4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:08.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.725+0000 7f1752424640 1 --2- 172.21.15.92:0/1494060296 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f174c077040 0x7f174c1a4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.725+0000 7f1752424640 1 -- 172.21.15.92:0/1494060296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f174c076720 msgr2=0x7f174c1a4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:08.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.725+0000 7f1752424640 1 --2- 172.21.15.92:0/1494060296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f174c076720 0x7f174c1a4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.725+0000 7f1752424640 1 -- 172.21.15.92:0/1494060296 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f174c19f200 con 0x7f174c112a30 2024-09-19T09:08:08.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.726+0000 7f1752424640 1 --2- 172.21.15.92:0/1494060296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f174c112a30 0x7f174c19ead0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f174400b930 tx=0x7f174400bdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:08.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.726+0000 7f1742ffd640 1 -- 172.21.15.92:0/1494060296 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1744019070 con 0x7f174c112a30 2024-09-19T09:08:08.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.726+0000 7f1742ffd640 1 -- 172.21.15.92:0/1494060296 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1744014440 con 0x7f174c112a30 2024-09-19T09:08:08.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.726+0000 7f1742ffd640 1 -- 172.21.15.92:0/1494060296 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17440125a0 con 0x7f174c112a30 2024-09-19T09:08:08.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.726+0000 7f1753e87640 1 -- 172.21.15.92:0/1494060296 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f174c19f4f0 con 0x7f174c112a30 2024-09-19T09:08:08.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.726+0000 7f1753e87640 1 -- 172.21.15.92:0/1494060296 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f174c1ab7e0 con 0x7f174c112a30 2024-09-19T09:08:08.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.730+0000 7f1756260740 1 Processor -- start 2024-09-19T09:08:08.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.731+0000 7f1742ffd640 1 -- 172.21.15.92:0/1494060296 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f174401c070 con 0x7f174c112a30 2024-09-19T09:08:08.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.731+0000 7f1756260740 1 -- start start 2024-09-19T09:08:08.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.731+0000 7f1756260740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca7f4b04c0 0x55ca7f4b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:08.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.731+0000 7f1756260740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca7f4b0de0 0x55ca7f4bb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:08.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.732+0000 7f1756260740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca7f4bb6a0 0x55ca7f4bda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:08.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.732+0000 7f1756260740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ca7f4162e0 con 0x55ca7f4bb6a0 2024-09-19T09:08:08.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.732+0000 7f1756260740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ca7f3bdce0 con 0x55ca7f4b0de0 2024-09-19T09:08:08.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.732+0000 7f1756260740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ca7f4122a0 con 0x55ca7f4b04c0 2024-09-19T09:08:08.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.732+0000 7f1751422640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca7f4b04c0 0x55ca7f4b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:08.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.732+0000 7f1751422640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca7f4b04c0 0x55ca7f4b08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:40426/0 (socket says 172.21.15.92:40426) 2024-09-19T09:08:08.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.732+0000 7f1751422640 1 -- 172.21.15.92:0/3319278277 learned_addr learned my addr 172.21.15.92:0/3319278277 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:08.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.732+0000 7f1751422640 1 --2- 172.21.15.92:0/3319278277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca7f4bb6a0 0x55ca7f4bda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:08.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.732+0000 7f1751c23640 1 --2- 172.21.15.92:0/3319278277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca7f4b0de0 0x55ca7f4bb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:08.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.732+0000 7f1742ffd640 1 --2- 172.21.15.92:0/1494060296 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f17380a3280 0x7f17380a5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:08.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.732+0000 7f1751422640 1 -- 172.21.15.92:0/3319278277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca7f4b0de0 msgr2=0x55ca7f4bb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:08.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.732+0000 7f1751422640 1 --2- 172.21.15.92:0/3319278277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca7f4b0de0 0x55ca7f4bb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.732+0000 7f1752424640 1 --2- 172.21.15.92:0/1494060296 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f17380a3280 0x7f17380a5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:08.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.732+0000 7f1751422640 1 -- 172.21.15.92:0/3319278277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca7f4bb6a0 msgr2=0x55ca7f4bda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:08.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.732+0000 7f1751422640 1 --2- 172.21.15.92:0/3319278277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca7f4bb6a0 0x55ca7f4bda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.732+0000 7f1751422640 1 -- 172.21.15.92:0/3319278277 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca7f3a2440 con 0x55ca7f4b04c0 2024-09-19T09:08:08.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.732+0000 7f1742ffd640 1 -- 172.21.15.92:0/1494060296 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f17440ceed0 con 0x7f174c112a30 2024-09-19T09:08:08.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.733+0000 7f1751422640 1 --2- 172.21.15.92:0/3319278277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca7f4b04c0 0x55ca7f4b08a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f173c005c40 tx=0x7f173c009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=489ef87d571d1c38 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:08.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.733+0000 7f1737fff640 1 -- 172.21.15.92:0/3319278277 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f173c035040 con 0x55ca7f4b04c0 2024-09-19T09:08:08.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.733+0000 7f1737fff640 1 -- 172.21.15.92:0/3319278277 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f173c0047a0 con 0x55ca7f4b04c0 2024-09-19T09:08:08.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.733+0000 7f1737fff640 1 -- 172.21.15.92:0/3319278277 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f173c0039e0 con 0x55ca7f4b04c0 2024-09-19T09:08:08.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.734+0000 7f1756260740 1 -- 172.21.15.92:0/3319278277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca7f4b04c0 msgr2=0x55ca7f4b08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:08.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.734+0000 7f1756260740 1 --2- 172.21.15.92:0/3319278277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca7f4b04c0 0x55ca7f4b08a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f173c005c40 tx=0x7f173c009260 comp rx=0 tx=0).stop 2024-09-19T09:08:08.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.734+0000 7f1752424640 1 --2- 172.21.15.92:0/1494060296 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f17380a3280 0x7f17380a5740 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f174409b2a0 tx=0x7f1744014610 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:08.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.734+0000 7f1756260740 1 -- 172.21.15.92:0/3319278277 shutdown_connections 2024-09-19T09:08:08.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.734+0000 7f1756260740 1 --2- 172.21.15.92:0/3319278277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca7f4bb6a0 0x55ca7f4bda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.734+0000 7f1756260740 1 --2- 172.21.15.92:0/3319278277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca7f4b0de0 0x55ca7f4bb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.734+0000 7f1756260740 1 --2- 172.21.15.92:0/3319278277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca7f4b04c0 0x55ca7f4b08a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.735+0000 7f1756260740 1 -- 172.21.15.92:0/3319278277 >> 172.21.15.92:0/3319278277 conn(0x55ca7f4aca50 msgr2=0x55ca7f4ace30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:08.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.735+0000 7f1756260740 1 -- 172.21.15.92:0/3319278277 shutdown_connections 2024-09-19T09:08:08.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.735+0000 7f1756260740 1 -- 172.21.15.92:0/3319278277 wait complete. 2024-09-19T09:08:08.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.735+0000 7f1756260740 1 -- start start 2024-09-19T09:08:08.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.736+0000 7f1756260740 1 Processor -- start 2024-09-19T09:08:08.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.736+0000 7f1756260740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca7f4b04c0 0x55ca7f4baee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:08.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.736+0000 7f1756260740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca7f4b0de0 0x55ca7f4b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:08.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.736+0000 7f1756260740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca7f4bb6a0 0x55ca7f4b86d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:08.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.736+0000 7f1756260740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ca7f4be270 con 0x55ca7f4b04c0 2024-09-19T09:08:08.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.736+0000 7f1756260740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ca7f3d1050 con 0x55ca7f4bb6a0 2024-09-19T09:08:08.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.736+0000 7f1756260740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ca7f4be3f0 con 0x55ca7f4b0de0 2024-09-19T09:08:08.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.736+0000 7f1756260740 10 client.0 _ll_register_callbacks cb 0x55ca7f411160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:08.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.737+0000 7f1751422640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca7f4b04c0 0x55ca7f4baee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:08.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.737+0000 7f1751422640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca7f4bb6a0 0x55ca7f4b86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:08.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.737+0000 7f1751422640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca7f4bb6a0 0x55ca7f4b86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:33872/0 (socket says 172.21.15.92:33872) 2024-09-19T09:08:08.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.737+0000 7f1751422640 1 -- 172.21.15.92:0/1938570376 learned_addr learned my addr 172.21.15.92:0/1938570376 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:08.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.737+0000 7f1751c23640 1 --2- 172.21.15.92:0/1938570376 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca7f4b0de0 0x55ca7f4b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:08.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.737+0000 7f1751c23640 1 -- 172.21.15.92:0/1938570376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca7f4bb6a0 msgr2=0x55ca7f4b86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:08.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.737+0000 7f1751c23640 1 --2- 172.21.15.92:0/1938570376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca7f4bb6a0 0x55ca7f4b86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.737+0000 7f1751c23640 1 -- 172.21.15.92:0/1938570376 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca7f4b04c0 msgr2=0x55ca7f4baee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:08.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.737+0000 7f1751c23640 1 --2- 172.21.15.92:0/1938570376 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca7f4b04c0 0x55ca7f4baee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.737+0000 7f1751c23640 1 -- 172.21.15.92:0/1938570376 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca7f1873c0 con 0x55ca7f4b0de0 2024-09-19T09:08:08.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.737+0000 7f1751422640 1 --2- 172.21.15.92:0/1938570376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca7f4bb6a0 0x55ca7f4b86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:08:08.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.737+0000 7f1751c23640 1 --2- 172.21.15.92:0/1938570376 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca7f4b0de0 0x55ca7f4b8190 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1748006fd0 tx=0x7f17480119d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e71dc21008ec07d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:08.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.738+0000 7f17357fa640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:08:08.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.738+0000 7f17357fa640 1 -- 172.21.15.92:0/1938570376 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1748013730 con 0x55ca7f4b0de0 2024-09-19T09:08:08.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.738+0000 7f17357fa640 1 -- 172.21.15.92:0/1938570376 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f17480138d0 con 0x55ca7f4b0de0 2024-09-19T09:08:08.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.738+0000 7f1756260740 1 -- 172.21.15.92:0/1938570376 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f173c0047a0 con 0x55ca7f4b0de0 2024-09-19T09:08:08.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.738+0000 7f17357fa640 1 -- 172.21.15.92:0/1938570376 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1748013ad0 con 0x55ca7f4b0de0 2024-09-19T09:08:08.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.738+0000 7f1756260740 10 client.27259 fetch_fsmap learned FSMap version 19 2024-09-19T09:08:08.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.738+0000 7f1756260740 1 -- 172.21.15.92:0/1938570376 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ca7f4c9c20 con 0x55ca7f4b0de0 2024-09-19T09:08:08.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.739+0000 7f17357fa640 1 -- 172.21.15.92:0/1938570376 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f173c0047a0 con 0x55ca7f4b0de0 2024-09-19T09:08:08.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.739+0000 7f17357fa640 1 -- 172.21.15.92:0/1938570376 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1748027420 con 0x55ca7f4b0de0 2024-09-19T09:08:08.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.739+0000 7f1756260740 10 client.27259 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:08:08.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.739+0000 7f1756260740 10 client.27259 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:08:08.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.739+0000 7f1756260740 20 client.27259 populate_metadata read hostname 'smithi092' 2024-09-19T09:08:08.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.739+0000 7f1756260740 1 --2- 172.21.15.92:0/1938570376 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ca7f4cb0e0 0x55ca7f4cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:08.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.739+0000 7f1756260740 4 client.27259 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:08:08.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.739+0000 7f1756260740 1 -- 172.21.15.92:0/1938570376 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca7f423850 con 0x55ca7f4cb0e0 2024-09-19T09:08:08.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.739+0000 7f1751422640 1 --2- 172.21.15.92:0/1938570376 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ca7f4cb0e0 0x55ca7f4cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:08.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.740+0000 7f17357fa640 10 client.27259 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:08.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.740+0000 7f1751422640 1 --2- 172.21.15.92:0/1938570376 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ca7f4cb0e0 0x55ca7f4cd4f0 crc :-1 s=READY pgs=349 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47b2a06c21baf35c server_cookie=2d5ac4328ea58ed in_seq=0 out_seq=0 2024-09-19T09:08:08.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.740+0000 7f17357fa640 1 -- 172.21.15.92:0/1938570376 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ca7f423850 con 0x55ca7f4cb0e0 2024-09-19T09:08:08.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.740+0000 7f17357fa640 10 client.27259 handle_command_reply: tid=0 2024-09-19T09:08:08.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.740+0000 7f1756260740 1 client.27259 shutdown 2024-09-19T09:08:08.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.741+0000 7f1756260740 1 -- 172.21.15.92:0/1938570376 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca7f4b0de0 msgr2=0x55ca7f4b8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:08.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.741+0000 7f1756260740 1 --2- 172.21.15.92:0/1938570376 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca7f4b0de0 0x55ca7f4b8190 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1748006fd0 tx=0x7f17480119d0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.741+0000 7f1756260740 1 -- 172.21.15.92:0/1938570376 shutdown_connections 2024-09-19T09:08:08.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.741+0000 7f1756260740 1 --2- 172.21.15.92:0/1938570376 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ca7f4cb0e0 0x55ca7f4cd4f0 crc :-1 s=READY pgs=349 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.741+0000 7f1756260740 1 --2- 172.21.15.92:0/1938570376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca7f4bb6a0 0x55ca7f4b86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.741+0000 7f1756260740 1 --2- 172.21.15.92:0/1938570376 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca7f4b0de0 0x55ca7f4b8190 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.741+0000 7f1756260740 1 --2- 172.21.15.92:0/1938570376 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca7f4b04c0 0x55ca7f4baee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.741+0000 7f1756260740 1 -- 172.21.15.92:0/1938570376 >> 172.21.15.92:0/1938570376 conn(0x55ca7f4aca50 msgr2=0x55ca7f4abc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:08.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.741+0000 7f17357fa640 0 client.27259 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:08.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.742+0000 7f1756260740 1 -- 172.21.15.92:0/1938570376 shutdown_connections 2024-09-19T09:08:08.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.742+0000 7f1756260740 1 -- 172.21.15.92:0/1938570376 wait complete. 2024-09-19T09:08:08.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.742+0000 7f1756260740 20 client.27259 trim_cache size 0 max 16384 2024-09-19T09:08:08.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.775+0000 7f1756260740 1 Processor -- start 2024-09-19T09:08:08.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.776+0000 7f1756260740 1 -- start start 2024-09-19T09:08:08.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.776+0000 7f1756260740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca7f4aca50 0x55ca7f4b8150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:08.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.776+0000 7f1756260740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca7f4b04c0 0x55ca7f4abb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:08.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.776+0000 7f1756260740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca7f4b0de0 0x55ca7f4d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:08.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.776+0000 7f1756260740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1b1df0 con 0x55ca7f4aca50 2024-09-19T09:08:08.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.776+0000 7f1756260740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1b4690 con 0x55ca7f4b0de0 2024-09-19T09:08:08.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.776+0000 7f1756260740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1b2480 con 0x55ca7f4b04c0 2024-09-19T09:08:08.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.782+0000 7f1751c23640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca7f4b04c0 0x55ca7f4abb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:08.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.782+0000 7f1751422640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca7f4b0de0 0x55ca7f4d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:08.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.782+0000 7f1751422640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca7f4aca50 0x55ca7f4b8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:08.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.782+0000 7f1751422640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca7f4aca50 0x55ca7f4b8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52090/0 (socket says 172.21.15.92:52090) 2024-09-19T09:08:08.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.782+0000 7f1751422640 1 -- 172.21.15.92:0/4245043034 learned_addr learned my addr 172.21.15.92:0/4245043034 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:08.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.787+0000 7f1751422640 1 -- 172.21.15.92:0/4245043034 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca7f4b04c0 msgr2=0x55ca7f4abb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:08.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.787+0000 7f1751422640 1 --2- 172.21.15.92:0/4245043034 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca7f4b04c0 0x55ca7f4abb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.787+0000 7f1751422640 1 -- 172.21.15.92:0/4245043034 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca7f4b0de0 msgr2=0x55ca7f4d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:08.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.787+0000 7f1751422640 1 --2- 172.21.15.92:0/4245043034 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca7f4b0de0 0x55ca7f4d2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.787+0000 7f1751422640 1 -- 172.21.15.92:0/4245043034 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca7f4bb250 con 0x55ca7f4aca50 2024-09-19T09:08:08.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.787+0000 7f1751422640 1 --2- 172.21.15.92:0/4245043034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca7f4aca50 0x55ca7f4b8150 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f173c003750 tx=0x7f173c009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14439ae673cf1091 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:08.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.792+0000 7f17377fe640 1 -- 172.21.15.92:0/4245043034 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f173c035070 con 0x55ca7f4aca50 2024-09-19T09:08:08.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.792+0000 7f17377fe640 1 -- 172.21.15.92:0/4245043034 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f173c004c80 con 0x55ca7f4aca50 2024-09-19T09:08:08.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.792+0000 7f17377fe640 1 -- 172.21.15.92:0/4245043034 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f173c0315b0 con 0x55ca7f4aca50 2024-09-19T09:08:08.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.793+0000 7f1756260740 1 -- 172.21.15.92:0/4245043034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca7f4aca50 msgr2=0x55ca7f4b8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:08.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.793+0000 7f1756260740 1 --2- 172.21.15.92:0/4245043034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca7f4aca50 0x55ca7f4b8150 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f173c003750 tx=0x7f173c009520 comp rx=0 tx=0).stop 2024-09-19T09:08:08.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.796+0000 7f1756260740 1 -- 172.21.15.92:0/4245043034 shutdown_connections 2024-09-19T09:08:08.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.796+0000 7f1756260740 1 --2- 172.21.15.92:0/4245043034 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca7f4b0de0 0x55ca7f4d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.796+0000 7f1756260740 1 --2- 172.21.15.92:0/4245043034 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca7f4b04c0 0x55ca7f4abb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.796+0000 7f1756260740 1 --2- 172.21.15.92:0/4245043034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca7f4aca50 0x55ca7f4b8150 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.796+0000 7f1756260740 1 -- 172.21.15.92:0/4245043034 >> 172.21.15.92:0/4245043034 conn(0x55ca7f4b8830 msgr2=0x55ca7f4ab470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:08.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.798+0000 7f1756260740 1 -- 172.21.15.92:0/4245043034 shutdown_connections 2024-09-19T09:08:08.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.800+0000 7f1756260740 1 -- 172.21.15.92:0/4245043034 wait complete. 2024-09-19T09:08:08.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.801+0000 7f1756260740 1 -- start start 2024-09-19T09:08:08.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.801+0000 7f1756260740 1 Processor -- start 2024-09-19T09:08:08.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.802+0000 7f1756260740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca7f4aca50 0x55ca7f4c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:08.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.802+0000 7f1756260740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca7f4b04c0 0x55ca7f530dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:08.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.803+0000 7f1751c23640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca7f4b04c0 0x55ca7f530dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:08.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.803+0000 7f1751c23640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca7f4b04c0 0x55ca7f530dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52096/0 (socket says 172.21.15.92:52096) 2024-09-19T09:08:08.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.803+0000 7f1751c23640 1 -- 172.21.15.92:0/221773990 learned_addr learned my addr 172.21.15.92:0/221773990 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:08.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.803+0000 7f1756260740 1 --2- 172.21.15.92:0/221773990 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca7f4b0de0 0x55ca7f531390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:08.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.803+0000 7f1756260740 1 -- 172.21.15.92:0/221773990 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1b2b50 con 0x55ca7f4b04c0 2024-09-19T09:08:08.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.803+0000 7f1756260740 1 -- 172.21.15.92:0/221773990 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1b3fc0 con 0x55ca7f4aca50 2024-09-19T09:08:08.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.804+0000 7f1756260740 1 -- 172.21.15.92:0/221773990 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1b3220 con 0x55ca7f4b0de0 2024-09-19T09:08:08.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.804+0000 7f1756260740 10 client.0 _ll_register_callbacks cb 0x7f17480095e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:08.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.805+0000 7f1751c23640 1 -- 172.21.15.92:0/221773990 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca7f4b0de0 msgr2=0x55ca7f531390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:08:08.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.805+0000 7f1751c23640 1 --2- 172.21.15.92:0/221773990 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca7f4b0de0 0x55ca7f531390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.805+0000 7f1751c23640 1 -- 172.21.15.92:0/221773990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca7f4aca50 msgr2=0x55ca7f4c3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:08.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.805+0000 7f1751c23640 1 --2- 172.21.15.92:0/221773990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca7f4aca50 0x55ca7f4c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.805+0000 7f1751c23640 1 -- 172.21.15.92:0/221773990 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca7f531bc0 con 0x55ca7f4b04c0 2024-09-19T09:08:08.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.807+0000 7f1751c23640 1 --2- 172.21.15.92:0/221773990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca7f4b04c0 0x55ca7f530dc0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f174800b010 tx=0x7f17480139e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e7a5e81cdbd2ead server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:08.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.807+0000 7f17357fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:08:08.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.808+0000 7f17357fa640 1 -- 172.21.15.92:0/221773990 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1748034060 con 0x55ca7f4b04c0 2024-09-19T09:08:08.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.808+0000 7f17357fa640 1 -- 172.21.15.92:0/221773990 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1748027c60 con 0x55ca7f4b04c0 2024-09-19T09:08:08.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.808+0000 7f1756260740 1 -- 172.21.15.92:0/221773990 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f173c004c80 con 0x55ca7f4b04c0 2024-09-19T09:08:08.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.809+0000 7f17357fa640 1 -- 172.21.15.92:0/221773990 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1748027e60 con 0x55ca7f4b04c0 2024-09-19T09:08:08.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.810+0000 7f1756260740 10 client.18099 fetch_fsmap learned FSMap version 19 2024-09-19T09:08:08.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.810+0000 7f1756260740 1 -- 172.21.15.92:0/221773990 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ca7f546f30 con 0x55ca7f4b04c0 2024-09-19T09:08:08.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.813+0000 7f17357fa640 1 -- 172.21.15.92:0/221773990 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1748009150 con 0x55ca7f4b04c0 2024-09-19T09:08:08.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.813+0000 7f17357fa640 1 -- 172.21.15.92:0/221773990 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1748003ad0 con 0x55ca7f4b04c0 2024-09-19T09:08:08.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.813+0000 7f1756260740 10 client.18099 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:08:08.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.813+0000 7f1756260740 10 client.18099 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:08:08.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.814+0000 7f1756260740 20 client.18099 populate_metadata read hostname 'smithi092' 2024-09-19T09:08:08.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.814+0000 7f1756260740 1 --2- 172.21.15.92:0/221773990 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ca7f4bb6a0 0x55ca7f5496f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:08.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.814+0000 7f1756260740 4 client.18099 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:08:08.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.814+0000 7f1756260740 1 -- 172.21.15.92:0/221773990 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f173c004c80 con 0x55ca7f4bb6a0 2024-09-19T09:08:08.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.818+0000 7f1751422640 1 --2- 172.21.15.92:0/221773990 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ca7f4bb6a0 0x55ca7f5496f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:08.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.821+0000 7f1751422640 1 --2- 172.21.15.92:0/221773990 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ca7f4bb6a0 0x55ca7f5496f0 crc :-1 s=READY pgs=350 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43d249feb6a7eb3b server_cookie=6d4131b6f14abc36 in_seq=0 out_seq=0 2024-09-19T09:08:08.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.821+0000 7f17357fa640 10 client.18099 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:08.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.821+0000 7f17357fa640 1 -- 172.21.15.92:0/221773990 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f173c004c80 con 0x55ca7f4bb6a0 2024-09-19T09:08:08.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.821+0000 7f17357fa640 10 client.18099 handle_command_reply: tid=0 2024-09-19T09:08:08.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.821+0000 7f1756260740 1 client.18099 shutdown 2024-09-19T09:08:08.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.822+0000 7f1756260740 1 -- 172.21.15.92:0/221773990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca7f4b04c0 msgr2=0x55ca7f530dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:08.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.822+0000 7f1756260740 1 --2- 172.21.15.92:0/221773990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca7f4b04c0 0x55ca7f530dc0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f174800b010 tx=0x7f17480139e0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.822+0000 7f1756260740 1 -- 172.21.15.92:0/221773990 shutdown_connections 2024-09-19T09:08:08.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.822+0000 7f1756260740 1 --2- 172.21.15.92:0/221773990 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ca7f4bb6a0 0x55ca7f5496f0 crc :-1 s=READY pgs=350 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.823+0000 7f1756260740 1 --2- 172.21.15.92:0/221773990 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca7f4b0de0 0x55ca7f531390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.823+0000 7f1756260740 1 --2- 172.21.15.92:0/221773990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca7f4b04c0 0x55ca7f530dc0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.823+0000 7f1756260740 1 --2- 172.21.15.92:0/221773990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca7f4aca50 0x55ca7f4c3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.823+0000 7f1756260740 1 -- 172.21.15.92:0/221773990 >> 172.21.15.92:0/221773990 conn(0x55ca7f4b8830 msgr2=0x55ca7f4ba210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:08.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.823+0000 7f17357fa640 0 client.18099 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:08.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.823+0000 7f1756260740 1 -- 172.21.15.92:0/221773990 shutdown_connections 2024-09-19T09:08:08.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.823+0000 7f1756260740 1 -- 172.21.15.92:0/221773990 wait complete. 2024-09-19T09:08:08.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.823+0000 7f1756260740 20 client.18099 trim_cache size 0 max 16384 2024-09-19T09:08:08.825 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:08:08.825 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-19T09:08:08.825 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {} 2024-09-19T09:08:08.825 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:08:08.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.824+0000 7f1753e87640 1 -- 172.21.15.92:0/1494060296 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f17380a3280 msgr2=0x7f17380a5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:08.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.824+0000 7f1753e87640 1 --2- 172.21.15.92:0/1494060296 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f17380a3280 0x7f17380a5740 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f174409b2a0 tx=0x7f1744014610 comp rx=0 tx=0).stop 2024-09-19T09:08:08.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.824+0000 7f1753e87640 1 -- 172.21.15.92:0/1494060296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f174c112a30 msgr2=0x7f174c19ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:08.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.824+0000 7f1753e87640 1 --2- 172.21.15.92:0/1494060296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f174c112a30 0x7f174c19ead0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f174400b930 tx=0x7f174400bdf0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.824+0000 7f1753e87640 1 -- 172.21.15.92:0/1494060296 shutdown_connections 2024-09-19T09:08:08.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.824+0000 7f1753e87640 1 --2- 172.21.15.92:0/1494060296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f174c112a30 0x7f174c19ead0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.824+0000 7f1753e87640 1 --2- 172.21.15.92:0/1494060296 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f174c077040 0x7f174c1a4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.824+0000 7f1753e87640 1 --2- 172.21.15.92:0/1494060296 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f17380a3280 0x7f17380a5740 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.824+0000 7f1753e87640 1 --2- 172.21.15.92:0/1494060296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f174c076720 0x7f174c1a4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.824+0000 7f1753e87640 1 -- 172.21.15.92:0/1494060296 >> 172.21.15.92:0/1494060296 conn(0x7f174c0ffa90 msgr2=0x7f174c1147f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:08.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.824+0000 7f1753e87640 1 -- 172.21.15.92:0/1494060296 shutdown_connections 2024-09-19T09:08:08.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:08.824+0000 7f1753e87640 1 -- 172.21.15.92:0/1494060296 wait complete. 2024-09-19T09:08:09.613 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:08:09.613 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:08:09.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:09 smithi190 ceph-mon[35358]: pgmap v680: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.9 MiB/s wr, 659 op/s 2024-09-19T09:08:10.001 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:08:10.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:09 smithi092 ceph-mon[31407]: pgmap v680: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.9 MiB/s wr, 659 op/s 2024-09-19T09:08:10.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:09 smithi167 ceph-mon[35359]: pgmap v680: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.9 MiB/s wr, 659 op/s 2024-09-19T09:08:10.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.577+0000 7faaee42b640 1 -- 172.21.15.92:0/2702595137 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faae8101de0 msgr2=0x7faae81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:10.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.577+0000 7faaee42b640 1 --2- 172.21.15.92:0/2702595137 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faae8101de0 0x7faae81021c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7faad8009900 tx=0x7faad802a420 comp rx=0 tx=0).stop 2024-09-19T09:08:10.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.578+0000 7faaee42b640 1 -- 172.21.15.92:0/2702595137 shutdown_connections 2024-09-19T09:08:10.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.578+0000 7faaee42b640 1 --2- 172.21.15.92:0/2702595137 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faae8106f10 0x7faae810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:10.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.578+0000 7faaee42b640 1 --2- 172.21.15.92:0/2702595137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faae8102790 0x7faae81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:10.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.578+0000 7faaee42b640 1 --2- 172.21.15.92:0/2702595137 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faae8101de0 0x7faae81021c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:10.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.578+0000 7faaee42b640 1 -- 172.21.15.92:0/2702595137 >> 172.21.15.92:0/2702595137 conn(0x7faae80fd8e0 msgr2=0x7faae80ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:10.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.578+0000 7faaee42b640 1 -- 172.21.15.92:0/2702595137 shutdown_connections 2024-09-19T09:08:10.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.578+0000 7faaee42b640 1 -- 172.21.15.92:0/2702595137 wait complete. 2024-09-19T09:08:10.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.579+0000 7faaee42b640 1 Processor -- start 2024-09-19T09:08:10.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.579+0000 7faaee42b640 1 -- start start 2024-09-19T09:08:10.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.579+0000 7faaee42b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faae8101de0 0x7faae81983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:10.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.579+0000 7faaee42b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faae8102790 0x7faae8198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:10.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.579+0000 7faaee42b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faae8106f10 0x7faae819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:10.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.579+0000 7faaee42b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7faae8112030 con 0x7faae8102790 2024-09-19T09:08:10.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.580+0000 7faaee42b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7faae8111eb0 con 0x7faae8101de0 2024-09-19T09:08:10.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.580+0000 7faae7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faae8101de0 0x7faae81983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:10.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.580+0000 7faae77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faae8102790 0x7faae8198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:10.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.580+0000 7faaec9c8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faae8106f10 0x7faae819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:10.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.580+0000 7faae77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faae8102790 0x7faae8198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52116/0 (socket says 172.21.15.92:52116) 2024-09-19T09:08:10.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.580+0000 7faae77fe640 1 -- 172.21.15.92:0/1750463509 learned_addr learned my addr 172.21.15.92:0/1750463509 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:10.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.580+0000 7faae7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faae8101de0 0x7faae81983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:33904/0 (socket says 172.21.15.92:33904) 2024-09-19T09:08:10.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.580+0000 7faaee42b640 1 -- 172.21.15.92:0/1750463509 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7faae81121b0 con 0x7faae8106f10 2024-09-19T09:08:10.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.580+0000 7faae7fff640 1 -- 172.21.15.92:0/1750463509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faae8106f10 msgr2=0x7faae819cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:10.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.580+0000 7faae7fff640 1 --2- 172.21.15.92:0/1750463509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faae8106f10 0x7faae819cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:10.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.580+0000 7faae7fff640 1 -- 172.21.15.92:0/1750463509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faae8102790 msgr2=0x7faae8198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:10.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.580+0000 7faae7fff640 1 --2- 172.21.15.92:0/1750463509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faae8102790 0x7faae8198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:10.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.580+0000 7faae7fff640 1 -- 172.21.15.92:0/1750463509 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faae819d380 con 0x7faae8101de0 2024-09-19T09:08:10.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.581+0000 7faae7fff640 1 --2- 172.21.15.92:0/1750463509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faae8101de0 0x7faae81983d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7faad8009850 tx=0x7faad8030790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:10.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.581+0000 7faae57fa640 1 -- 172.21.15.92:0/1750463509 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad803f070 con 0x7faae8101de0 2024-09-19T09:08:10.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.581+0000 7faae57fa640 1 -- 172.21.15.92:0/1750463509 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faad8030e60 con 0x7faae8101de0 2024-09-19T09:08:10.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.581+0000 7faae57fa640 1 -- 172.21.15.92:0/1750463509 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad8035030 con 0x7faae8101de0 2024-09-19T09:08:10.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.581+0000 7faaee42b640 1 -- 172.21.15.92:0/1750463509 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faae819d610 con 0x7faae8101de0 2024-09-19T09:08:10.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.581+0000 7faaee42b640 1 -- 172.21.15.92:0/1750463509 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faae819d9e0 con 0x7faae8101de0 2024-09-19T09:08:10.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.583+0000 7faaee42b640 1 -- 172.21.15.92:0/1750463509 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faae8199730 con 0x7faae8101de0 2024-09-19T09:08:10.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.585+0000 7faae57fa640 1 -- 172.21.15.92:0/1750463509 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7faad8042070 con 0x7faae8101de0 2024-09-19T09:08:10.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.585+0000 7faae57fa640 1 --2- 172.21.15.92:0/1750463509 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7faad00a32c0 0x7faad00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:10.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.586+0000 7faae57fa640 1 -- 172.21.15.92:0/1750463509 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7faad80f0380 con 0x7faae8101de0 2024-09-19T09:08:10.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.586+0000 7faae77fe640 1 --2- 172.21.15.92:0/1750463509 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7faad00a32c0 0x7faad00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:10.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.586+0000 7faae77fe640 1 --2- 172.21.15.92:0/1750463509 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7faad00a32c0 0x7faad00a5780 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7faae8108370 tx=0x7faadc009190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:10.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.590+0000 7faae57fa640 1 -- 172.21.15.92:0/1750463509 <== mon.2 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faad8049030 con 0x7faae8101de0 2024-09-19T09:08:10.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:10 smithi092 ceph-mon[31407]: pgmap v681: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 7.9 MiB/s wr, 697 op/s 2024-09-19T09:08:10.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 685.0 s, 2330.6 tps, lat 42.972 ms stddev 49.533 2024-09-19T09:08:10.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.946+0000 7faaee42b640 1 -- 172.21.15.92:0/1750463509 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faae81a5230 con 0x7faae8101de0 2024-09-19T09:08:10.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.947+0000 7faae57fa640 1 -- 172.21.15.92:0/1750463509 <== mon.2 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7faad80bd0a0 con 0x7faae8101de0 2024-09-19T09:08:10.949 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:08:10.952 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:08:10.953 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:08:10.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.949+0000 7faaee42b640 1 -- 172.21.15.92:0/1750463509 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7faad00a32c0 msgr2=0x7faad00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:10.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.949+0000 7faaee42b640 1 --2- 172.21.15.92:0/1750463509 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7faad00a32c0 0x7faad00a5780 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7faae8108370 tx=0x7faadc009190 comp rx=0 tx=0).stop 2024-09-19T09:08:10.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.949+0000 7faaee42b640 1 -- 172.21.15.92:0/1750463509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faae8101de0 msgr2=0x7faae81983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:10.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.949+0000 7faaee42b640 1 --2- 172.21.15.92:0/1750463509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faae8101de0 0x7faae81983d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7faad8009850 tx=0x7faad8030790 comp rx=0 tx=0).stop 2024-09-19T09:08:10.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.949+0000 7faaee42b640 1 -- 172.21.15.92:0/1750463509 shutdown_connections 2024-09-19T09:08:10.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.949+0000 7faaee42b640 1 --2- 172.21.15.92:0/1750463509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faae8106f10 0x7faae819cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:10.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.949+0000 7faaee42b640 1 --2- 172.21.15.92:0/1750463509 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7faad00a32c0 0x7faad00a5780 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:10.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.949+0000 7faaee42b640 1 --2- 172.21.15.92:0/1750463509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faae8102790 0x7faae8198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:10.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.949+0000 7faaee42b640 1 --2- 172.21.15.92:0/1750463509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faae8101de0 0x7faae81983d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:10.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.949+0000 7faaee42b640 1 -- 172.21.15.92:0/1750463509 >> 172.21.15.92:0/1750463509 conn(0x7faae80fd8e0 msgr2=0x7faae80fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:10.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.950+0000 7faaee42b640 1 -- 172.21.15.92:0/1750463509 shutdown_connections 2024-09-19T09:08:10.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:10.950+0000 7faaee42b640 1 -- 172.21.15.92:0/1750463509 wait complete. 2024-09-19T09:08:10.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:10.994+0000 7f463c077640 1 -- 172.21.15.92:0/192521407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4634100cd0 msgr2=0x7f4634101150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:10.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:10.994+0000 7f463c077640 1 --2- 172.21.15.92:0/192521407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4634100cd0 0x7f4634101150 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f4630009900 tx=0x7f463002a410 comp rx=0 tx=0).stop 2024-09-19T09:08:10.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:10.995+0000 7f463c077640 1 -- 172.21.15.92:0/192521407 shutdown_connections 2024-09-19T09:08:10.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:10.995+0000 7f463c077640 1 --2- 172.21.15.92:0/192521407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4634101690 0x7f4634108f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:10.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:10.995+0000 7f463c077640 1 --2- 172.21.15.92:0/192521407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4634100cd0 0x7f4634101150 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:10.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:10.995+0000 7f463c077640 1 --2- 172.21.15.92:0/192521407 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4634102030 0x7f4634102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:10.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:10.995+0000 7f463c077640 1 -- 172.21.15.92:0/192521407 >> 172.21.15.92:0/192521407 conn(0x7f46340fb930 msgr2=0x7f46340fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:10.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:10.995+0000 7f463c077640 1 -- 172.21.15.92:0/192521407 shutdown_connections 2024-09-19T09:08:10.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:10.995+0000 7f463c077640 1 -- 172.21.15.92:0/192521407 wait complete. 2024-09-19T09:08:10.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:10.996+0000 7f463c077640 1 Processor -- start 2024-09-19T09:08:10.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:10.996+0000 7f463c077640 1 -- start start 2024-09-19T09:08:10.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:10.996+0000 7f463c077640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4634100cd0 0x7f4634110ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:10.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:10.996+0000 7f463c077640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4634101690 0x7f4634111420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:10.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:10.996+0000 7f463c077640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4634102030 0x7f4634116480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:10.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:10.996+0000 7f463c077640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f463410b640 con 0x7f4634102030 2024-09-19T09:08:10.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:10.996+0000 7f463c077640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f463410b4c0 con 0x7f4634101690 2024-09-19T09:08:10.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:10.996+0000 7f463c077640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f463410b7c0 con 0x7f4634100cd0 2024-09-19T09:08:10.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:10.996+0000 7f463a614640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4634102030 0x7f4634116480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:10.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:10.996+0000 7f463a614640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4634102030 0x7f4634116480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52134/0 (socket says 172.21.15.92:52134) 2024-09-19T09:08:10.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:10.996+0000 7f463a614640 1 -- 172.21.15.92:0/4220295481 learned_addr learned my addr 172.21.15.92:0/4220295481 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:10.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:10.996+0000 7f4639612640 1 --2- 172.21.15.92:0/4220295481 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4634101690 0x7f4634111420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:10.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:10.996+0000 7f4639e13640 1 --2- 172.21.15.92:0/4220295481 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4634100cd0 0x7f4634110ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:10.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:10.997+0000 7f463a614640 1 -- 172.21.15.92:0/4220295481 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4634100cd0 msgr2=0x7f4634110ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:11.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:10.997+0000 7f463a614640 1 --2- 172.21.15.92:0/4220295481 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4634100cd0 0x7f4634110ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:10.997+0000 7f463a614640 1 -- 172.21.15.92:0/4220295481 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4634101690 msgr2=0x7f4634111420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:11.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:10.997+0000 7f463a614640 1 --2- 172.21.15.92:0/4220295481 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4634101690 0x7f4634111420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:10.997+0000 7f463a614640 1 -- 172.21.15.92:0/4220295481 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4634116af0 con 0x7f4634102030 2024-09-19T09:08:11.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:10.997+0000 7f4639612640 1 --2- 172.21.15.92:0/4220295481 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4634101690 0x7f4634111420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:08:11.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:10.997+0000 7f463a614640 1 --2- 172.21.15.92:0/4220295481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4634102030 0x7f4634116480 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f462c00eb10 tx=0x7f462c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:11.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:10.998+0000 7f4626ffd640 1 -- 172.21.15.92:0/4220295481 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f462c004b20 con 0x7f4634102030 2024-09-19T09:08:11.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:10.998+0000 7f4626ffd640 1 -- 172.21.15.92:0/4220295481 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f462c004cc0 con 0x7f4634102030 2024-09-19T09:08:11.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:10.998+0000 7f463c077640 1 -- 172.21.15.92:0/4220295481 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4634116de0 con 0x7f4634102030 2024-09-19T09:08:11.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:10.998+0000 7f463c077640 1 -- 172.21.15.92:0/4220295481 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4634117300 con 0x7f4634102030 2024-09-19T09:08:11.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:10.998+0000 7f4626ffd640 1 -- 172.21.15.92:0/4220295481 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f462c010760 con 0x7f4634102030 2024-09-19T09:08:11.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.000+0000 7f4626ffd640 1 -- 172.21.15.92:0/4220295481 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f462c010900 con 0x7f4634102030 2024-09-19T09:08:11.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.001+0000 7f4626ffd640 1 --2- 172.21.15.92:0/4220295481 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f46200a3440 0x7f46200a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:11.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.001+0000 7f4639e13640 1 --2- 172.21.15.92:0/4220295481 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f46200a3440 0x7f46200a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:11.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.001+0000 7f4626ffd640 1 -- 172.21.15.92:0/4220295481 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f462c0cfe10 con 0x7f4634102030 2024-09-19T09:08:11.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.002+0000 7f463ee0b740 1 Processor -- start 2024-09-19T09:08:11.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.003+0000 7f4639e13640 1 --2- 172.21.15.92:0/4220295481 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f46200a3440 0x7f46200a5900 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f4634069660 tx=0x7f4628005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:11.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.003+0000 7f463ee0b740 1 -- start start 2024-09-19T09:08:11.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.004+0000 7f463ee0b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a986079a0 0x562a98607da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:11.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.004+0000 7f463ee0b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a986082e0 0x562a9860cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:11.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.004+0000 7f4639e13640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a986079a0 0x562a98607da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:11.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.004+0000 7f4639e13640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a986079a0 0x562a98607da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:40484/0 (socket says 172.21.15.92:40484) 2024-09-19T09:08:11.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.004+0000 7f4639e13640 1 -- 172.21.15.92:0/469194531 learned_addr learned my addr 172.21.15.92:0/469194531 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:11.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.004+0000 7f463ee0b740 1 --2- 172.21.15.92:0/469194531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a9860d370 0x562a9860f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:11.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.005+0000 7f4639612640 1 --2- 172.21.15.92:0/469194531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a986082e0 0x562a9860cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:11.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.005+0000 7f463a614640 1 --2- 172.21.15.92:0/469194531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a9860d370 0x562a9860f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:11.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.005+0000 7f463ee0b740 1 -- 172.21.15.92:0/469194531 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562a9856b2f0 con 0x562a9860d370 2024-09-19T09:08:11.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.005+0000 7f463ee0b740 1 -- 172.21.15.92:0/469194531 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x562a98513270 con 0x562a986082e0 2024-09-19T09:08:11.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.005+0000 7f463ee0b740 1 -- 172.21.15.92:0/469194531 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x562a985672b0 con 0x562a986079a0 2024-09-19T09:08:11.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.005+0000 7f4639e13640 1 -- 172.21.15.92:0/469194531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a986082e0 msgr2=0x562a9860cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.005+0000 7f4639e13640 1 --2- 172.21.15.92:0/469194531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a986082e0 0x562a9860cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.005+0000 7f4639e13640 1 -- 172.21.15.92:0/469194531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a9860d370 msgr2=0x562a9860f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.005+0000 7f4639e13640 1 --2- 172.21.15.92:0/469194531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a9860d370 0x562a9860f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.005+0000 7f4639e13640 1 -- 172.21.15.92:0/469194531 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a98512340 con 0x562a986079a0 2024-09-19T09:08:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.006+0000 7f4639e13640 1 --2- 172.21.15.92:0/469194531 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a986079a0 0x562a98607da0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f46280058c0 tx=0x7f4628014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afba8dc5c27c0eae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.006+0000 7f461ffff640 1 -- 172.21.15.92:0/469194531 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4628026430 con 0x562a986079a0 2024-09-19T09:08:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.006+0000 7f461ffff640 1 -- 172.21.15.92:0/469194531 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f462801c8f0 con 0x562a986079a0 2024-09-19T09:08:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.006+0000 7f461ffff640 1 -- 172.21.15.92:0/469194531 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f462801d980 con 0x562a986079a0 2024-09-19T09:08:11.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.007+0000 7f463ee0b740 1 -- 172.21.15.92:0/469194531 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a986079a0 msgr2=0x562a98607da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:11.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.007+0000 7f463ee0b740 1 --2- 172.21.15.92:0/469194531 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a986079a0 0x562a98607da0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f46280058c0 tx=0x7f4628014000 comp rx=0 tx=0).stop 2024-09-19T09:08:11.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.007+0000 7f463ee0b740 1 -- 172.21.15.92:0/469194531 shutdown_connections 2024-09-19T09:08:11.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.007+0000 7f463ee0b740 1 --2- 172.21.15.92:0/469194531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a9860d370 0x562a9860f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.007+0000 7f463ee0b740 1 --2- 172.21.15.92:0/469194531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a986082e0 0x562a9860cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.007+0000 7f463ee0b740 1 --2- 172.21.15.92:0/469194531 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a986079a0 0x562a98607da0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.007+0000 7f463ee0b740 1 -- 172.21.15.92:0/469194531 >> 172.21.15.92:0/469194531 conn(0x562a98603010 msgr2=0x562a98603410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:11.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.009+0000 7f463ee0b740 1 -- 172.21.15.92:0/469194531 shutdown_connections 2024-09-19T09:08:11.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.009+0000 7f463ee0b740 1 -- 172.21.15.92:0/469194531 wait complete. 2024-09-19T09:08:11.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.009+0000 7f463ee0b740 1 -- start start 2024-09-19T09:08:11.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.010+0000 7f463ee0b740 1 Processor -- start 2024-09-19T09:08:11.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.010+0000 7f463ee0b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a986079a0 0x562a98611b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:11.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.010+0000 7f463ee0b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a986082e0 0x562a986120b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:11.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.010+0000 7f4639e13640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a986079a0 0x562a98611b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:11.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.010+0000 7f4639e13640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a986079a0 0x562a98611b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:40498/0 (socket says 172.21.15.92:40498) 2024-09-19T09:08:11.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.010+0000 7f4639e13640 1 -- 172.21.15.92:0/407867273 learned_addr learned my addr 172.21.15.92:0/407867273 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:11.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.010+0000 7f463ee0b740 1 --2- 172.21.15.92:0/407867273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a9860d370 0x562a986190f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:11.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.010+0000 7f463ee0b740 1 -- 172.21.15.92:0/407867273 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562a98610340 con 0x562a986082e0 2024-09-19T09:08:11.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.010+0000 7f463ee0b740 1 -- 172.21.15.92:0/407867273 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x562a984f4290 con 0x562a9860d370 2024-09-19T09:08:11.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.010+0000 7f463ee0b740 1 -- 172.21.15.92:0/407867273 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x562a986104c0 con 0x562a986079a0 2024-09-19T09:08:11.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.011+0000 7f463a614640 1 --2- 172.21.15.92:0/407867273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a9860d370 0x562a986190f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:11.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.011+0000 7f4639e13640 1 -- 172.21.15.92:0/407867273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a9860d370 msgr2=0x562a986190f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:11.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.011+0000 7f4639e13640 1 --2- 172.21.15.92:0/407867273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a9860d370 0x562a986190f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.011+0000 7f4639e13640 1 -- 172.21.15.92:0/407867273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a986082e0 msgr2=0x562a986120b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:11.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.011+0000 7f4639e13640 1 --2- 172.21.15.92:0/407867273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a986082e0 0x562a986120b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.011+0000 7f4639e13640 1 -- 172.21.15.92:0/407867273 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a9827e210 con 0x562a986079a0 2024-09-19T09:08:11.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.011+0000 7f4639e13640 1 --2- 172.21.15.92:0/407867273 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a986079a0 0x562a98611b70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f462801c640 tx=0x7f462801c670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37b301edb3bc153b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:11.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.011+0000 7f461d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:08:11.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.011+0000 7f461d7fa640 1 -- 172.21.15.92:0/407867273 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f462802b040 con 0x562a986079a0 2024-09-19T09:08:11.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.011+0000 7f461d7fa640 1 -- 172.21.15.92:0/407867273 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f462801caa0 con 0x562a986079a0 2024-09-19T09:08:11.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.011+0000 7f463ee0b740 10 client.0 _ll_register_callbacks cb 0x562a98525140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:11.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.012+0000 7f463ee0b740 1 -- 172.21.15.92:0/407867273 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f462801c8f0 con 0x562a986079a0 2024-09-19T09:08:11.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.012+0000 7f461d7fa640 1 -- 172.21.15.92:0/407867273 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f462801cca0 con 0x562a986079a0 2024-09-19T09:08:11.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.012+0000 7f463ee0b740 10 client.27280 fetch_fsmap learned FSMap version 19 2024-09-19T09:08:11.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.012+0000 7f463ee0b740 1 -- 172.21.15.92:0/407867273 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({fsmap=19}) -- 0x562a9834a620 con 0x562a986079a0 2024-09-19T09:08:11.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.012+0000 7f461d7fa640 1 -- 172.21.15.92:0/407867273 <== mon.1 v2:172.21.15.190:3300/0 4 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f4628037030 con 0x562a986079a0 2024-09-19T09:08:11.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.012+0000 7f463ee0b740 10 client.27280 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:08:11.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.012+0000 7f463ee0b740 10 client.27280 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:08:11.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.013+0000 7f463ee0b740 20 client.27280 populate_metadata read hostname 'smithi092' 2024-09-19T09:08:11.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.013+0000 7f463ee0b740 1 --2- 172.21.15.92:0/407867273 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562a9861d2c0 0x562a9861f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:11.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.013+0000 7f463ee0b740 4 client.27280 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:08:11.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.013+0000 7f463ee0b740 1 -- 172.21.15.92:0/407867273 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f462801c8f0 con 0x562a9861d2c0 2024-09-19T09:08:11.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.014+0000 7f4639612640 1 --2- 172.21.15.92:0/407867273 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562a9861d2c0 0x562a9861f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:11.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.014+0000 7f4639612640 1 --2- 172.21.15.92:0/407867273 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562a9861d2c0 0x562a9861f750 crc :-1 s=READY pgs=351 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72fd9289ff4ab816 server_cookie=57d3f444594509fd in_seq=0 out_seq=0 2024-09-19T09:08:11.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.014+0000 7f461d7fa640 10 client.27280 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:11.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.015+0000 7f461d7fa640 1 -- 172.21.15.92:0/407867273 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f462801c8f0 con 0x562a9861d2c0 2024-09-19T09:08:11.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.015+0000 7f461d7fa640 10 client.27280 handle_command_reply: tid=0 2024-09-19T09:08:11.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.015+0000 7f463ee0b740 1 client.27280 shutdown 2024-09-19T09:08:11.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.015+0000 7f463ee0b740 1 -- 172.21.15.92:0/407867273 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a986079a0 msgr2=0x562a98611b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:11.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.015+0000 7f463ee0b740 1 --2- 172.21.15.92:0/407867273 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a986079a0 0x562a98611b70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f462801c640 tx=0x7f462801c670 comp rx=0 tx=0).stop 2024-09-19T09:08:11.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.015+0000 7f463ee0b740 1 -- 172.21.15.92:0/407867273 shutdown_connections 2024-09-19T09:08:11.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.015+0000 7f463ee0b740 1 --2- 172.21.15.92:0/407867273 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562a9861d2c0 0x562a9861f750 crc :-1 s=READY pgs=351 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.015+0000 7f463ee0b740 1 --2- 172.21.15.92:0/407867273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a9860d370 0x562a986190f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.015+0000 7f463ee0b740 1 --2- 172.21.15.92:0/407867273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a986082e0 0x562a986120b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.015+0000 7f463ee0b740 1 --2- 172.21.15.92:0/407867273 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a986079a0 0x562a98611b70 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.015+0000 7f463ee0b740 1 -- 172.21.15.92:0/407867273 >> 172.21.15.92:0/407867273 conn(0x562a98603010 msgr2=0x562a98604820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:11.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.015+0000 7f461d7fa640 0 client.27280 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:11.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.016+0000 7f463ee0b740 1 -- 172.21.15.92:0/407867273 shutdown_connections 2024-09-19T09:08:11.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.016+0000 7f463ee0b740 1 -- 172.21.15.92:0/407867273 wait complete. 2024-09-19T09:08:11.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.016+0000 7f463ee0b740 20 client.27280 trim_cache size 0 max 16384 2024-09-19T09:08:11.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.038+0000 7f463ee0b740 1 Processor -- start 2024-09-19T09:08:11.040 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.038+0000 7f463ee0b740 1 -- start start 2024-09-19T09:08:11.040 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.039+0000 7f463ee0b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a986079a0 0x562a98611b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:11.040 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.039+0000 7f463ee0b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a986082e0 0x562a986190b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:11.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.039+0000 7f463ee0b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a9860d370 0x562a98612070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:11.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.039+0000 7f463ee0b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f461800c400 con 0x562a9860d370 2024-09-19T09:08:11.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.039+0000 7f463ee0b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f461800eca0 con 0x562a986079a0 2024-09-19T09:08:11.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.039+0000 7f463ee0b740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f461800ca90 con 0x562a986082e0 2024-09-19T09:08:11.042 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.039+0000 7f4639612640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a986082e0 0x562a986190b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:11.042 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.039+0000 7f4639e13640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a986079a0 0x562a98611b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:11.042 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.039+0000 7f4639612640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a986082e0 0x562a986190b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:40508/0 (socket says 172.21.15.92:40508) 2024-09-19T09:08:11.042 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.039+0000 7f4639612640 1 -- 172.21.15.92:0/4164771087 learned_addr learned my addr 172.21.15.92:0/4164771087 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:11.043 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.039+0000 7f463a614640 1 --2- 172.21.15.92:0/4164771087 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a9860d370 0x562a98612070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:11.043 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.039+0000 7f4639e13640 1 -- 172.21.15.92:0/4164771087 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a986082e0 msgr2=0x562a986190b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:11.043 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.039+0000 7f4639e13640 1 --2- 172.21.15.92:0/4164771087 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a986082e0 0x562a986190b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.043 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.039+0000 7f4639e13640 1 -- 172.21.15.92:0/4164771087 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a9860d370 msgr2=0x562a98612070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:11.043 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.039+0000 7f4639e13640 1 --2- 172.21.15.92:0/4164771087 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a9860d370 0x562a98612070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.043 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.039+0000 7f4639e13640 1 -- 172.21.15.92:0/4164771087 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a986116b0 con 0x562a986079a0 2024-09-19T09:08:11.043 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.040+0000 7f4639e13640 1 --2- 172.21.15.92:0/4164771087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a986079a0 0x562a98611b30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4628009200 tx=0x7f4628027000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f948420208adec6a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:11.043 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.040+0000 7f461f7fe640 1 -- 172.21.15.92:0/4164771087 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f462801c6e0 con 0x562a986079a0 2024-09-19T09:08:11.043 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.040+0000 7f461f7fe640 1 -- 172.21.15.92:0/4164771087 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f462801c880 con 0x562a986079a0 2024-09-19T09:08:11.043 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.040+0000 7f461f7fe640 1 -- 172.21.15.92:0/4164771087 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f462801d810 con 0x562a986079a0 2024-09-19T09:08:11.043 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.041+0000 7f463ee0b740 1 -- 172.21.15.92:0/4164771087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a986079a0 msgr2=0x562a98611b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:11.043 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.041+0000 7f463ee0b740 1 --2- 172.21.15.92:0/4164771087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a986079a0 0x562a98611b30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4628009200 tx=0x7f4628027000 comp rx=0 tx=0).stop 2024-09-19T09:08:11.043 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.041+0000 7f463ee0b740 1 -- 172.21.15.92:0/4164771087 shutdown_connections 2024-09-19T09:08:11.044 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.041+0000 7f463ee0b740 1 --2- 172.21.15.92:0/4164771087 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a9860d370 0x562a98612070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.044 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.041+0000 7f463ee0b740 1 --2- 172.21.15.92:0/4164771087 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a986082e0 0x562a986190b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.044 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.041+0000 7f463ee0b740 1 --2- 172.21.15.92:0/4164771087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a986079a0 0x562a98611b30 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.044 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.041+0000 7f463ee0b740 1 -- 172.21.15.92:0/4164771087 >> 172.21.15.92:0/4164771087 conn(0x562a98603010 msgr2=0x562a98609480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:11.045 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.041+0000 7f463ee0b740 1 -- 172.21.15.92:0/4164771087 shutdown_connections 2024-09-19T09:08:11.046 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.042+0000 7f463ee0b740 1 -- 172.21.15.92:0/4164771087 wait complete. 2024-09-19T09:08:11.046 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.042+0000 7f463ee0b740 1 -- start start 2024-09-19T09:08:11.046 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.042+0000 7f463ee0b740 1 Processor -- start 2024-09-19T09:08:11.046 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.043+0000 7f463ee0b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a986079a0 0x562a98615ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:11.046 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.043+0000 7f463ee0b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a986082e0 0x562a98616530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:11.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.043+0000 7f463ee0b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a9860d370 0x562a98686020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:11.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.043+0000 7f463ee0b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f461800d160 con 0x562a986082e0 2024-09-19T09:08:11.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.043+0000 7f463ee0b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f461800e5d0 con 0x562a9860d370 2024-09-19T09:08:11.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.043+0000 7f463ee0b740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f461800d830 con 0x562a986079a0 2024-09-19T09:08:11.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.043+0000 7f463ee0b740 10 client.0 _ll_register_callbacks cb 0x7f462c004a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:11.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.043+0000 7f4639612640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a986082e0 0x562a98616530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:11.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.043+0000 7f4639612640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a986082e0 0x562a98616530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52176/0 (socket says 172.21.15.92:52176) 2024-09-19T09:08:11.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.043+0000 7f4639612640 1 -- 172.21.15.92:0/2182597550 learned_addr learned my addr 172.21.15.92:0/2182597550 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:11.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.043+0000 7f4639e13640 1 --2- 172.21.15.92:0/2182597550 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a986079a0 0x562a98615ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:11.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.043+0000 7f463a614640 1 --2- 172.21.15.92:0/2182597550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a9860d370 0x562a98686020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:11.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.043+0000 7f4639e13640 1 -- 172.21.15.92:0/2182597550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a9860d370 msgr2=0x562a98686020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:11.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.043+0000 7f4639e13640 1 --2- 172.21.15.92:0/2182597550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a9860d370 0x562a98686020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.043+0000 7f4639e13640 1 -- 172.21.15.92:0/2182597550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a986082e0 msgr2=0x562a98616530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:11.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.043+0000 7f4639e13640 1 --2- 172.21.15.92:0/2182597550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a986082e0 0x562a98616530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.043+0000 7f4639e13640 1 -- 172.21.15.92:0/2182597550 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a98686590 con 0x562a986079a0 2024-09-19T09:08:11.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.043+0000 7f4639612640 1 --2- 172.21.15.92:0/2182597550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a986082e0 0x562a98616530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:08:11.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.043+0000 7f463a614640 1 --2- 172.21.15.92:0/2182597550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a9860d370 0x562a98686020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:08:11.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.045+0000 7f4639e13640 1 --2- 172.21.15.92:0/2182597550 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a986079a0 0x562a98615ff0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f462800eab0 tx=0x7f4628004ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d7020c0e32ea7d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.045+0000 7f461d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:08:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.045+0000 7f461d7fa640 1 -- 172.21.15.92:0/2182597550 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4628004020 con 0x562a986079a0 2024-09-19T09:08:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.045+0000 7f461d7fa640 1 -- 172.21.15.92:0/2182597550 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4628009230 con 0x562a986079a0 2024-09-19T09:08:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.045+0000 7f463ee0b740 1 -- 172.21.15.92:0/2182597550 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f462801c880 con 0x562a986079a0 2024-09-19T09:08:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.045+0000 7f461d7fa640 1 -- 172.21.15.92:0/2182597550 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4628055050 con 0x562a986079a0 2024-09-19T09:08:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.046+0000 7f463ee0b740 10 client.27286 fetch_fsmap learned FSMap version 19 2024-09-19T09:08:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.046+0000 7f463ee0b740 1 -- 172.21.15.92:0/2182597550 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x562a986878a0 con 0x562a986079a0 2024-09-19T09:08:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.046+0000 7f461d7fa640 1 -- 172.21.15.92:0/2182597550 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f462801c880 con 0x562a986079a0 2024-09-19T09:08:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.046+0000 7f461d7fa640 1 -- 172.21.15.92:0/2182597550 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f462804e070 con 0x562a986079a0 2024-09-19T09:08:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.046+0000 7f463ee0b740 10 client.27286 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:08:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.046+0000 7f463ee0b740 10 client.27286 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:08:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.046+0000 7f463ee0b740 20 client.27286 populate_metadata read hostname 'smithi092' 2024-09-19T09:08:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.046+0000 7f463ee0b740 1 --2- 172.21.15.92:0/2182597550 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562a98688240 0x562a9868a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.046+0000 7f463ee0b740 4 client.27286 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:08:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.046+0000 7f463ee0b740 1 -- 172.21.15.92:0/2182597550 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562a98578a20 con 0x562a98688240 2024-09-19T09:08:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.046+0000 7f4639612640 1 --2- 172.21.15.92:0/2182597550 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562a98688240 0x562a9868a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.047+0000 7f461d7fa640 10 client.27286 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.047+0000 7f4639612640 1 --2- 172.21.15.92:0/2182597550 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562a98688240 0x562a9868a660 crc :-1 s=READY pgs=352 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82bf7c91c81ac837 server_cookie=ab8bec93b0849a4a in_seq=0 out_seq=0 2024-09-19T09:08:11.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:10 smithi167 ceph-mon[35359]: pgmap v681: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 7.9 MiB/s wr, 697 op/s 2024-09-19T09:08:11.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:10 smithi190 ceph-mon[35358]: pgmap v681: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 7.9 MiB/s wr, 697 op/s 2024-09-19T09:08:11.130 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.128+0000 7f461d7fa640 1 -- 172.21.15.92:0/2182597550 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562a98578a20 con 0x562a98688240 2024-09-19T09:08:11.130 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.128+0000 7f461d7fa640 10 client.27286 handle_command_reply: tid=0 2024-09-19T09:08:11.130 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.128+0000 7f463ee0b740 1 client.27286 shutdown 2024-09-19T09:08:11.130 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.129+0000 7f463ee0b740 1 -- 172.21.15.92:0/2182597550 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a986079a0 msgr2=0x562a98615ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:11.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.129+0000 7f463ee0b740 1 --2- 172.21.15.92:0/2182597550 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a986079a0 0x562a98615ff0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f462800eab0 tx=0x7f4628004ae0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.129+0000 7f463ee0b740 1 -- 172.21.15.92:0/2182597550 shutdown_connections 2024-09-19T09:08:11.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.129+0000 7f463ee0b740 1 --2- 172.21.15.92:0/2182597550 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x562a98688240 0x562a9868a660 crc :-1 s=READY pgs=352 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.129+0000 7f463ee0b740 1 --2- 172.21.15.92:0/2182597550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562a9860d370 0x562a98686020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.129+0000 7f463ee0b740 1 --2- 172.21.15.92:0/2182597550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a986082e0 0x562a98616530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.129+0000 7f463ee0b740 1 --2- 172.21.15.92:0/2182597550 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a986079a0 0x562a98615ff0 secure :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f462800eab0 tx=0x7f4628004ae0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.129+0000 7f463ee0b740 1 -- 172.21.15.92:0/2182597550 >> 172.21.15.92:0/2182597550 conn(0x562a98603010 msgr2=0x562a98609480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:11.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.129+0000 7f461d7fa640 0 client.27286 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:11.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.129+0000 7f463ee0b740 1 -- 172.21.15.92:0/2182597550 shutdown_connections 2024-09-19T09:08:11.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.130+0000 7f463ee0b740 1 -- 172.21.15.92:0/2182597550 wait complete. 2024-09-19T09:08:11.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.130+0000 7f463ee0b740 20 client.27286 trim_cache size 0 max 16384 2024-09-19T09:08:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:08:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:08:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:08:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:08:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.131+0000 7f463c077640 1 -- 172.21.15.92:0/4220295481 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f46200a3440 msgr2=0x7f46200a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.131+0000 7f463c077640 1 --2- 172.21.15.92:0/4220295481 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f46200a3440 0x7f46200a5900 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f4634069660 tx=0x7f4628005f90 comp rx=0 tx=0).stop 2024-09-19T09:08:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.131+0000 7f463c077640 1 -- 172.21.15.92:0/4220295481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4634102030 msgr2=0x7f4634116480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.131+0000 7f463c077640 1 --2- 172.21.15.92:0/4220295481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4634102030 0x7f4634116480 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f462c00eb10 tx=0x7f462c00c2d0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.131+0000 7f463c077640 1 -- 172.21.15.92:0/4220295481 shutdown_connections 2024-09-19T09:08:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.131+0000 7f463c077640 1 --2- 172.21.15.92:0/4220295481 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f46200a3440 0x7f46200a5900 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.131+0000 7f463c077640 1 --2- 172.21.15.92:0/4220295481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4634102030 0x7f4634116480 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.131+0000 7f463c077640 1 --2- 172.21.15.92:0/4220295481 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4634101690 0x7f4634111420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.131+0000 7f463c077640 1 --2- 172.21.15.92:0/4220295481 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4634100cd0 0x7f4634110ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.131+0000 7f463c077640 1 -- 172.21.15.92:0/4220295481 >> 172.21.15.92:0/4220295481 conn(0x7f46340fb930 msgr2=0x7f4634104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.131+0000 7f463c077640 1 -- 172.21.15.92:0/4220295481 shutdown_connections 2024-09-19T09:08:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:11.131+0000 7f463c077640 1 -- 172.21.15.92:0/4220295481 wait complete. 2024-09-19T09:08:11.643 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:08:12.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:11 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1750463509' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:08:12.064 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:08:12.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:11 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/1750463509' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:08:12.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:11 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/1750463509' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:08:12.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.604+0000 7fa569551640 1 -- 172.21.15.92:0/4259590402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa55c0aab50 msgr2=0x7fa55c0a47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:12.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.604+0000 7fa569551640 1 --2- 172.21.15.92:0/4259590402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa55c0aab50 0x7fa55c0a47f0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fa558009860 tx=0x7fa55802a340 comp rx=0 tx=0).stop 2024-09-19T09:08:12.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.605+0000 7fa569551640 1 -- 172.21.15.92:0/4259590402 shutdown_connections 2024-09-19T09:08:12.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.605+0000 7fa569551640 1 --2- 172.21.15.92:0/4259590402 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa55c0a4d30 0x7fa55c0a51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.605+0000 7fa569551640 1 --2- 172.21.15.92:0/4259590402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa55c0aab50 0x7fa55c0a47f0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.605+0000 7fa569551640 1 --2- 172.21.15.92:0/4259590402 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa55c0aa230 0x7fa55c0aa610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.605+0000 7fa569551640 1 -- 172.21.15.92:0/4259590402 >> 172.21.15.92:0/4259590402 conn(0x7fa55c01a0a0 msgr2=0x7fa55c01a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:12.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.605+0000 7fa569551640 1 -- 172.21.15.92:0/4259590402 shutdown_connections 2024-09-19T09:08:12.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.606+0000 7fa569551640 1 -- 172.21.15.92:0/4259590402 wait complete. 2024-09-19T09:08:12.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.606+0000 7fa569551640 1 Processor -- start 2024-09-19T09:08:12.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.607+0000 7fa569551640 1 -- start start 2024-09-19T09:08:12.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.607+0000 7fa569551640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa55c0a4d30 0x7fa55c143430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:12.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.607+0000 7fa569551640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa55c0aa230 0x7fa55c143970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:12.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.607+0000 7fa569551640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa55c0aab50 0x7fa55c147d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:12.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.607+0000 7fa569551640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa55c0bcfb0 con 0x7fa55c0aab50 2024-09-19T09:08:12.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.607+0000 7fa569551640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa55c0bce30 con 0x7fa55c0aa230 2024-09-19T09:08:12.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.607+0000 7fa569551640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa55c0bd130 con 0x7fa55c0a4d30 2024-09-19T09:08:12.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.607+0000 7fa563fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa55c0a4d30 0x7fa55c143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:12.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.607+0000 7fa563fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa55c0a4d30 0x7fa55c143430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:33762/0 (socket says 172.21.15.92:33762) 2024-09-19T09:08:12.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.607+0000 7fa563fff640 1 -- 172.21.15.92:0/1788518553 learned_addr learned my addr 172.21.15.92:0/1788518553 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:12.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.608+0000 7fa563fff640 1 -- 172.21.15.92:0/1788518553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa55c0aa230 msgr2=0x7fa55c143970 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:08:12.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.608+0000 7fa563fff640 1 --2- 172.21.15.92:0/1788518553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa55c0aa230 0x7fa55c143970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.608+0000 7fa563fff640 1 -- 172.21.15.92:0/1788518553 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa55c0aab50 msgr2=0x7fa55c147d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:12.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.608+0000 7fa563fff640 1 --2- 172.21.15.92:0/1788518553 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa55c0aab50 0x7fa55c147d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.608+0000 7fa563fff640 1 -- 172.21.15.92:0/1788518553 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa55c148400 con 0x7fa55c0a4d30 2024-09-19T09:08:12.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.608+0000 7fa563fff640 1 --2- 172.21.15.92:0/1788518553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa55c0a4d30 0x7fa55c143430 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa5640518b0 tx=0x7fa56406b680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:12.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.609+0000 7fa5617fa640 1 -- 172.21.15.92:0/1788518553 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56406ec50 con 0x7fa55c0a4d30 2024-09-19T09:08:12.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.609+0000 7fa5617fa640 1 -- 172.21.15.92:0/1788518553 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa56406edf0 con 0x7fa55c0a4d30 2024-09-19T09:08:12.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.609+0000 7fa5617fa640 1 -- 172.21.15.92:0/1788518553 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5640788b0 con 0x7fa55c0a4d30 2024-09-19T09:08:12.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.609+0000 7fa569551640 1 -- 172.21.15.92:0/1788518553 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa55c1486f0 con 0x7fa55c0a4d30 2024-09-19T09:08:12.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.609+0000 7fa569551640 1 -- 172.21.15.92:0/1788518553 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa55c0ac7b0 con 0x7fa55c0a4d30 2024-09-19T09:08:12.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.613+0000 7fa5617fa640 1 -- 172.21.15.92:0/1788518553 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa564080030 con 0x7fa55c0a4d30 2024-09-19T09:08:12.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.613+0000 7fa56cb8c740 1 Processor -- start 2024-09-19T09:08:12.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.613+0000 7fa56cb8c740 1 -- start start 2024-09-19T09:08:12.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.613+0000 7fa56cb8c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a35cd1d20 0x563a35cd0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:12.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.613+0000 7fa56cb8c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a35cd07b0 0x563a35cd0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:12.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.613+0000 7fa56cb8c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a35cdb550 0x563a35cdd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:12.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.613+0000 7fa56cb8c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563a35c362f0 con 0x563a35cd1d20 2024-09-19T09:08:12.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.613+0000 7fa56cb8c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563a35bddcf0 con 0x563a35cd07b0 2024-09-19T09:08:12.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.613+0000 7fa56cb8c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x563a35c322b0 con 0x563a35cdb550 2024-09-19T09:08:12.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.613+0000 7fa5637fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a35cdb550 0x563a35cdd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:12.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.613+0000 7fa5637fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a35cdb550 0x563a35cdd940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:33778/0 (socket says 172.21.15.92:33778) 2024-09-19T09:08:12.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.613+0000 7fa5637fe640 1 -- 172.21.15.92:0/4043040799 learned_addr learned my addr 172.21.15.92:0/4043040799 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:12.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.613+0000 7fa563fff640 1 --2- 172.21.15.92:0/4043040799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a35cd07b0 0x563a35cd0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:12.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.613+0000 7fa568d50640 1 --2- 172.21.15.92:0/4043040799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a35cd1d20 0x563a35cd0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:12.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.614+0000 7fa563fff640 1 -- 172.21.15.92:0/4043040799 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a35cdb550 msgr2=0x563a35cdd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:12.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.614+0000 7fa563fff640 1 --2- 172.21.15.92:0/4043040799 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a35cdb550 0x563a35cdd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.614+0000 7fa563fff640 1 -- 172.21.15.92:0/4043040799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a35cd1d20 msgr2=0x563a35cd0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:12.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.614+0000 7fa563fff640 1 --2- 172.21.15.92:0/4043040799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a35cd1d20 0x563a35cd0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.614+0000 7fa563fff640 1 -- 172.21.15.92:0/4043040799 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a35bc23a0 con 0x563a35cd07b0 2024-09-19T09:08:12.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.614+0000 7fa568d50640 1 --2- 172.21.15.92:0/4043040799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a35cd1d20 0x563a35cd0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:08:12.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.615+0000 7fa5617fa640 1 --2- 172.21.15.92:0/1788518553 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa5540a33a0 0x7fa5540a5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:12.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.615+0000 7fa563fff640 1 --2- 172.21.15.92:0/4043040799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a35cd07b0 0x563a35cd0bf0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa564130c00 tx=0x7fa56413b780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4017c0a7ae74af42 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:12.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.615+0000 7fa54e7fc640 1 -- 172.21.15.92:0/4043040799 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5640fba20 con 0x563a35cd07b0 2024-09-19T09:08:12.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.615+0000 7fa54e7fc640 1 -- 172.21.15.92:0/4043040799 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa564084270 con 0x563a35cd07b0 2024-09-19T09:08:12.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.615+0000 7fa54e7fc640 1 -- 172.21.15.92:0/4043040799 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56412b1e0 con 0x563a35cd07b0 2024-09-19T09:08:12.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.615+0000 7fa5617fa640 1 -- 172.21.15.92:0/1788518553 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa564133160 con 0x7fa55c0a4d30 2024-09-19T09:08:12.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.615+0000 7fa568d50640 1 --2- 172.21.15.92:0/1788518553 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa5540a33a0 0x7fa5540a5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:12.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.616+0000 7fa568d50640 1 --2- 172.21.15.92:0/1788518553 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa5540a33a0 0x7fa5540a5860 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa550005fd0 tx=0x7fa55000a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:12.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.616+0000 7fa56cb8c740 1 -- 172.21.15.92:0/4043040799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a35cd07b0 msgr2=0x563a35cd0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:12.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.616+0000 7fa56cb8c740 1 --2- 172.21.15.92:0/4043040799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a35cd07b0 0x563a35cd0bf0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa564130c00 tx=0x7fa56413b780 comp rx=0 tx=0).stop 2024-09-19T09:08:12.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.616+0000 7fa56cb8c740 1 -- 172.21.15.92:0/4043040799 shutdown_connections 2024-09-19T09:08:12.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.616+0000 7fa56cb8c740 1 --2- 172.21.15.92:0/4043040799 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a35cdb550 0x563a35cdd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.616+0000 7fa56cb8c740 1 --2- 172.21.15.92:0/4043040799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a35cd07b0 0x563a35cd0bf0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.616+0000 7fa56cb8c740 1 --2- 172.21.15.92:0/4043040799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a35cd1d20 0x563a35cd0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.616+0000 7fa56cb8c740 1 -- 172.21.15.92:0/4043040799 >> 172.21.15.92:0/4043040799 conn(0x563a35c99310 msgr2=0x563a35ccce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:12.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.616+0000 7fa56cb8c740 1 -- 172.21.15.92:0/4043040799 shutdown_connections 2024-09-19T09:08:12.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.616+0000 7fa56cb8c740 1 -- 172.21.15.92:0/4043040799 wait complete. 2024-09-19T09:08:12.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.617+0000 7fa56cb8c740 1 -- start start 2024-09-19T09:08:12.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.617+0000 7fa56cb8c740 1 Processor -- start 2024-09-19T09:08:12.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.618+0000 7fa56cb8c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a35cd07b0 0x563a35cdaf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:12.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.618+0000 7fa56cb8c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a35cd1d20 0x563a35cd8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:12.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.618+0000 7fa56cb8c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a35cdb550 0x563a35cd8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:12.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.618+0000 7fa56cb8c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563a35cde250 con 0x563a35cdb550 2024-09-19T09:08:12.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.618+0000 7fa56cb8c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563a35bf1060 con 0x563a35cd1d20 2024-09-19T09:08:12.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.618+0000 7fa56cb8c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x563a35cde3d0 con 0x563a35cd07b0 2024-09-19T09:08:12.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.618+0000 7fa56cb8c740 10 client.0 _ll_register_callbacks cb 0x563a359448c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:12.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.618+0000 7fa568d50640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a35cdb550 0x563a35cd8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:12.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.618+0000 7fa568d50640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a35cdb550 0x563a35cd8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50804/0 (socket says 172.21.15.92:50804) 2024-09-19T09:08:12.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.618+0000 7fa568d50640 1 -- 172.21.15.92:0/1044481109 learned_addr learned my addr 172.21.15.92:0/1044481109 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:12.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.619+0000 7fa5637fe640 1 --2- 172.21.15.92:0/1044481109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a35cd1d20 0x563a35cd8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:12.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.619+0000 7fa563fff640 1 --2- 172.21.15.92:0/1044481109 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a35cd07b0 0x563a35cdaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:12.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.619+0000 7fa568d50640 1 -- 172.21.15.92:0/1044481109 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a35cd07b0 msgr2=0x563a35cdaf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:12.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.619+0000 7fa568d50640 1 --2- 172.21.15.92:0/1044481109 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a35cd07b0 0x563a35cdaf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.619+0000 7fa568d50640 1 -- 172.21.15.92:0/1044481109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a35cd1d20 msgr2=0x563a35cd8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:12.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.619+0000 7fa568d50640 1 --2- 172.21.15.92:0/1044481109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a35cd1d20 0x563a35cd8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.619+0000 7fa568d50640 1 -- 172.21.15.92:0/1044481109 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a359a73c0 con 0x563a35cdb550 2024-09-19T09:08:12.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.619+0000 7fa5637fe640 1 --2- 172.21.15.92:0/1044481109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a35cd1d20 0x563a35cd8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:08:12.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.620+0000 7fa568d50640 1 --2- 172.21.15.92:0/1044481109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a35cdb550 0x563a35cd8830 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fa550005e40 tx=0x7fa5500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d95b84a8295a01a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:12.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.620+0000 7fa5437fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:08:12.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.620+0000 7fa5437fe640 1 -- 172.21.15.92:0/1044481109 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa550016070 con 0x563a35cdb550 2024-09-19T09:08:12.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.620+0000 7fa5437fe640 1 -- 172.21.15.92:0/1044481109 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa550010bb0 con 0x563a35cdb550 2024-09-19T09:08:12.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.620+0000 7fa56cb8c740 1 -- 172.21.15.92:0/1044481109 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa564084270 con 0x563a35cdb550 2024-09-19T09:08:12.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.620+0000 7fa5437fe640 1 -- 172.21.15.92:0/1044481109 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa550010db0 con 0x563a35cdb550 2024-09-19T09:08:12.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.621+0000 7fa56cb8c740 10 client.18126 fetch_fsmap learned FSMap version 19 2024-09-19T09:08:12.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.621+0000 7fa56cb8c740 1 -- 172.21.15.92:0/1044481109 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x563a35ce9e50 con 0x563a35cdb550 2024-09-19T09:08:12.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.621+0000 7fa5437fe640 1 -- 172.21.15.92:0/1044481109 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa564084270 con 0x563a35cdb550 2024-09-19T09:08:12.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.621+0000 7fa5437fe640 1 -- 172.21.15.92:0/1044481109 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fa55002f420 con 0x563a35cdb550 2024-09-19T09:08:12.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.621+0000 7fa56cb8c740 10 client.18126 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:08:12.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.621+0000 7fa56cb8c740 10 client.18126 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:08:12.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.621+0000 7fa56cb8c740 20 client.18126 populate_metadata read hostname 'smithi092' 2024-09-19T09:08:12.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.621+0000 7fa56cb8c740 1 --2- 172.21.15.92:0/1044481109 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x563a35ceb260 0x563a35ced670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:12.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.621+0000 7fa56cb8c740 4 client.18126 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:08:12.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.621+0000 7fa56cb8c740 1 -- 172.21.15.92:0/1044481109 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a35c43860 con 0x563a35ceb260 2024-09-19T09:08:12.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.621+0000 7fa563fff640 1 --2- 172.21.15.92:0/1044481109 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x563a35ceb260 0x563a35ced670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:12.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.622+0000 7fa5437fe640 10 client.18126 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:12.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.623+0000 7fa563fff640 1 --2- 172.21.15.92:0/1044481109 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x563a35ceb260 0x563a35ced670 crc :-1 s=READY pgs=353 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68a07c375df6021c server_cookie=1e7cf1903fbb2632 in_seq=0 out_seq=0 2024-09-19T09:08:12.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.624+0000 7fa5437fe640 1 -- 172.21.15.92:0/1044481109 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563a35c43860 con 0x563a35ceb260 2024-09-19T09:08:12.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.624+0000 7fa5437fe640 10 client.18126 handle_command_reply: tid=0 2024-09-19T09:08:12.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.624+0000 7fa56cb8c740 1 client.18126 shutdown 2024-09-19T09:08:12.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.625+0000 7fa56cb8c740 1 -- 172.21.15.92:0/1044481109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a35cdb550 msgr2=0x563a35cd8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:12.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.625+0000 7fa56cb8c740 1 --2- 172.21.15.92:0/1044481109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a35cdb550 0x563a35cd8830 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fa550005e40 tx=0x7fa5500046c0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.626+0000 7fa56cb8c740 1 -- 172.21.15.92:0/1044481109 shutdown_connections 2024-09-19T09:08:12.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.626+0000 7fa56cb8c740 1 --2- 172.21.15.92:0/1044481109 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x563a35ceb260 0x563a35ced670 crc :-1 s=READY pgs=353 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.626+0000 7fa56cb8c740 1 --2- 172.21.15.92:0/1044481109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a35cdb550 0x563a35cd8830 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.626+0000 7fa56cb8c740 1 --2- 172.21.15.92:0/1044481109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a35cd1d20 0x563a35cd8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.626+0000 7fa56cb8c740 1 --2- 172.21.15.92:0/1044481109 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a35cd07b0 0x563a35cdaf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.626+0000 7fa56cb8c740 1 -- 172.21.15.92:0/1044481109 >> 172.21.15.92:0/1044481109 conn(0x563a35c99310 msgr2=0x563a35cd2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:12.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.627+0000 7fa5437fe640 0 client.18126 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:12.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.627+0000 7fa56cb8c740 1 -- 172.21.15.92:0/1044481109 shutdown_connections 2024-09-19T09:08:12.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.627+0000 7fa56cb8c740 1 -- 172.21.15.92:0/1044481109 wait complete. 2024-09-19T09:08:12.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.627+0000 7fa56cb8c740 20 client.18126 trim_cache size 0 max 16384 2024-09-19T09:08:12.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.649+0000 7fa56cb8c740 1 Processor -- start 2024-09-19T09:08:12.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.649+0000 7fa56cb8c740 1 -- start start 2024-09-19T09:08:12.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.649+0000 7fa56cb8c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a35cd07b0 0x563a35cccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:12.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.649+0000 7fa56cb8c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a35cd1d20 0x563a35ce7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:12.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.649+0000 7fa56cb8c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a35cdb550 0x563a35cc7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:12.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.650+0000 7fa56cb8c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa55c0aa610 con 0x563a35cd1d20 2024-09-19T09:08:12.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.650+0000 7fa56cb8c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa55c161740 con 0x563a35cdb550 2024-09-19T09:08:12.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.650+0000 7fa56cb8c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa55c0b46f0 con 0x563a35cd07b0 2024-09-19T09:08:12.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.650+0000 7fa5637fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a35cd1d20 0x563a35ce7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:12.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.650+0000 7fa5637fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a35cd1d20 0x563a35ce7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50810/0 (socket says 172.21.15.92:50810) 2024-09-19T09:08:12.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.650+0000 7fa5637fe640 1 -- 172.21.15.92:0/2441614394 learned_addr learned my addr 172.21.15.92:0/2441614394 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:12.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.650+0000 7fa563fff640 1 --2- 172.21.15.92:0/2441614394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a35cd07b0 0x563a35cccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:12.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.650+0000 7fa568d50640 1 --2- 172.21.15.92:0/2441614394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a35cdb550 0x563a35cc7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:12.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.650+0000 7fa5637fe640 1 -- 172.21.15.92:0/2441614394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a35cd07b0 msgr2=0x563a35cccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:12.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.650+0000 7fa5637fe640 1 --2- 172.21.15.92:0/2441614394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a35cd07b0 0x563a35cccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.650+0000 7fa5637fe640 1 -- 172.21.15.92:0/2441614394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a35cdb550 msgr2=0x563a35cc7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:12.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.650+0000 7fa5637fe640 1 --2- 172.21.15.92:0/2441614394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a35cdb550 0x563a35cc7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.650+0000 7fa5637fe640 1 -- 172.21.15.92:0/2441614394 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a35cd71d0 con 0x563a35cd1d20 2024-09-19T09:08:12.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.650+0000 7fa5637fe640 1 --2- 172.21.15.92:0/2441614394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a35cd1d20 0x563a35ce7570 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fa558009860 tx=0x7fa5580058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9000f33a9cbf9daa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:12.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.650+0000 7fa54dffb640 1 -- 172.21.15.92:0/2441614394 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa558037040 con 0x563a35cd1d20 2024-09-19T09:08:12.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.650+0000 7fa54dffb640 1 -- 172.21.15.92:0/2441614394 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa558004240 con 0x563a35cd1d20 2024-09-19T09:08:12.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.650+0000 7fa54dffb640 1 -- 172.21.15.92:0/2441614394 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa558003d70 con 0x563a35cd1d20 2024-09-19T09:08:12.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.651+0000 7fa56cb8c740 1 -- 172.21.15.92:0/2441614394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a35cd1d20 msgr2=0x563a35ce7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:12.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.651+0000 7fa56cb8c740 1 --2- 172.21.15.92:0/2441614394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a35cd1d20 0x563a35ce7570 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fa558009860 tx=0x7fa5580058d0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.652+0000 7fa56cb8c740 1 -- 172.21.15.92:0/2441614394 shutdown_connections 2024-09-19T09:08:12.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.652+0000 7fa56cb8c740 1 --2- 172.21.15.92:0/2441614394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a35cdb550 0x563a35cc7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.652+0000 7fa56cb8c740 1 --2- 172.21.15.92:0/2441614394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a35cd1d20 0x563a35ce7570 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.652+0000 7fa56cb8c740 1 --2- 172.21.15.92:0/2441614394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a35cd07b0 0x563a35cccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.652+0000 7fa56cb8c740 1 -- 172.21.15.92:0/2441614394 >> 172.21.15.92:0/2441614394 conn(0x563a35c99310 msgr2=0x563a35ccc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:12.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.652+0000 7fa56cb8c740 1 -- 172.21.15.92:0/2441614394 shutdown_connections 2024-09-19T09:08:12.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.652+0000 7fa56cb8c740 1 -- 172.21.15.92:0/2441614394 wait complete. 2024-09-19T09:08:12.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.652+0000 7fa56cb8c740 1 -- start start 2024-09-19T09:08:12.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.653+0000 7fa56cb8c740 1 Processor -- start 2024-09-19T09:08:12.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.653+0000 7fa56cb8c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a35cd07b0 0x563a35ce38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:12.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.653+0000 7fa56cb8c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a35cd1d20 0x563a35ce3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:12.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.654+0000 7fa56cb8c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a35cdb550 0x563a35cd4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:12.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.654+0000 7fa56cb8c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa55c0b4dc0 con 0x563a35cd1d20 2024-09-19T09:08:12.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.654+0000 7fa56cb8c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa55c161090 con 0x563a35cd07b0 2024-09-19T09:08:12.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.654+0000 7fa56cb8c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa55c0b5490 con 0x563a35cdb550 2024-09-19T09:08:12.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.654+0000 7fa56cb8c740 10 client.0 _ll_register_callbacks cb 0x7fa55000aa60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:12.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.654+0000 7fa563fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a35cd07b0 0x563a35ce38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:12.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.654+0000 7fa5637fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a35cd1d20 0x563a35ce3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:12.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.654+0000 7fa568d50640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a35cdb550 0x563a35cd4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:12.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.654+0000 7fa563fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a35cd07b0 0x563a35ce38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:36882/0 (socket says 172.21.15.92:36882) 2024-09-19T09:08:12.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.654+0000 7fa563fff640 1 -- 172.21.15.92:0/3313013787 learned_addr learned my addr 172.21.15.92:0/3313013787 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:12.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.654+0000 7fa5637fe640 1 -- 172.21.15.92:0/3313013787 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a35cdb550 msgr2=0x563a35cd4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:12.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.654+0000 7fa5637fe640 1 --2- 172.21.15.92:0/3313013787 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a35cdb550 0x563a35cd4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.654+0000 7fa5637fe640 1 -- 172.21.15.92:0/3313013787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a35cd07b0 msgr2=0x563a35ce38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:12.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.654+0000 7fa5637fe640 1 --2- 172.21.15.92:0/3313013787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a35cd07b0 0x563a35ce38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.654+0000 7fa5637fe640 1 -- 172.21.15.92:0/3313013787 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a35cd50d0 con 0x563a35cd1d20 2024-09-19T09:08:12.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.655+0000 7fa5637fe640 1 --2- 172.21.15.92:0/3313013787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a35cd1d20 0x563a35ce3e00 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x563a35ccc890 tx=0x7fa558004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aadcbfce59f8d9a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:12.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.655+0000 7fa5437fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:08:12.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.657+0000 7fa5437fe640 1 -- 172.21.15.92:0/3313013787 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa558037040 con 0x563a35cd1d20 2024-09-19T09:08:12.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.657+0000 7fa56cb8c740 1 -- 172.21.15.92:0/3313013787 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa558004240 con 0x563a35cd1d20 2024-09-19T09:08:12.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.657+0000 7fa5437fe640 1 -- 172.21.15.92:0/3313013787 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa558005020 con 0x563a35cd1d20 2024-09-19T09:08:12.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.658+0000 7fa5437fe640 1 -- 172.21.15.92:0/3313013787 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa558005260 con 0x563a35cd1d20 2024-09-19T09:08:12.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.658+0000 7fa56cb8c740 10 client.18132 fetch_fsmap learned FSMap version 19 2024-09-19T09:08:12.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.658+0000 7fa56cb8c740 1 -- 172.21.15.92:0/3313013787 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x563a35d558b0 con 0x563a35cd1d20 2024-09-19T09:08:12.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.658+0000 7fa5437fe640 1 -- 172.21.15.92:0/3313013787 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa558004240 con 0x563a35cd1d20 2024-09-19T09:08:12.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.658+0000 7fa5437fe640 1 -- 172.21.15.92:0/3313013787 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fa558004830 con 0x563a35cd1d20 2024-09-19T09:08:12.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.658+0000 7fa56cb8c740 10 client.18132 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:08:12.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.658+0000 7fa56cb8c740 10 client.18132 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:08:12.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.658+0000 7fa56cb8c740 20 client.18132 populate_metadata read hostname 'smithi092' 2024-09-19T09:08:12.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.659+0000 7fa56cb8c740 1 --2- 172.21.15.92:0/3313013787 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x563a35d55f70 0x563a35d58360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:12.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.659+0000 7fa56cb8c740 4 client.18132 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:08:12.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.659+0000 7fa56cb8c740 1 -- 172.21.15.92:0/3313013787 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563a35c3dd70 con 0x563a35d55f70 2024-09-19T09:08:12.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.659+0000 7fa563fff640 1 --2- 172.21.15.92:0/3313013787 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x563a35d55f70 0x563a35d58360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:12.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.660+0000 7fa563fff640 1 --2- 172.21.15.92:0/3313013787 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x563a35d55f70 0x563a35d58360 crc :-1 s=READY pgs=354 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f6f26d5b701803a server_cookie=2fe6a4e15f0bc21e in_seq=0 out_seq=0 2024-09-19T09:08:12.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.660+0000 7fa5437fe640 10 client.18132 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:12.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.660+0000 7fa5437fe640 1 -- 172.21.15.92:0/3313013787 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563a35c3dd70 con 0x563a35d55f70 2024-09-19T09:08:12.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.660+0000 7fa5437fe640 10 client.18132 handle_command_reply: tid=0 2024-09-19T09:08:12.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.660+0000 7fa56cb8c740 1 client.18132 shutdown 2024-09-19T09:08:12.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.660+0000 7fa56cb8c740 1 -- 172.21.15.92:0/3313013787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a35cd1d20 msgr2=0x563a35ce3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:12.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.660+0000 7fa56cb8c740 1 --2- 172.21.15.92:0/3313013787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a35cd1d20 0x563a35ce3e00 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x563a35ccc890 tx=0x7fa558004410 comp rx=0 tx=0).stop 2024-09-19T09:08:12.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.661+0000 7fa56cb8c740 1 -- 172.21.15.92:0/3313013787 shutdown_connections 2024-09-19T09:08:12.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.661+0000 7fa56cb8c740 1 --2- 172.21.15.92:0/3313013787 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x563a35d55f70 0x563a35d58360 crc :-1 s=READY pgs=354 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.661+0000 7fa56cb8c740 1 --2- 172.21.15.92:0/3313013787 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563a35cdb550 0x563a35cd4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.661+0000 7fa5437fe640 0 client.18132 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:12.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.661+0000 7fa56cb8c740 1 --2- 172.21.15.92:0/3313013787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563a35cd1d20 0x563a35ce3e00 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.661+0000 7fa56cb8c740 1 --2- 172.21.15.92:0/3313013787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a35cd07b0 0x563a35ce38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.661+0000 7fa56cb8c740 1 -- 172.21.15.92:0/3313013787 >> 172.21.15.92:0/3313013787 conn(0x563a35c99310 msgr2=0x563a35cd9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:12.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.661+0000 7fa56cb8c740 1 -- 172.21.15.92:0/3313013787 shutdown_connections 2024-09-19T09:08:12.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.661+0000 7fa56cb8c740 1 -- 172.21.15.92:0/3313013787 wait complete. 2024-09-19T09:08:12.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.661+0000 7fa56cb8c740 20 client.18132 trim_cache size 0 max 16384 2024-09-19T09:08:12.665 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-19T09:08:12.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.663+0000 7fa569551640 1 -- 172.21.15.92:0/1788518553 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa5540a33a0 msgr2=0x7fa5540a5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:12.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.663+0000 7fa569551640 1 --2- 172.21.15.92:0/1788518553 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa5540a33a0 0x7fa5540a5860 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa550005fd0 tx=0x7fa55000a250 comp rx=0 tx=0).stop 2024-09-19T09:08:12.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.663+0000 7fa569551640 1 -- 172.21.15.92:0/1788518553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa55c0a4d30 msgr2=0x7fa55c143430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:12.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.663+0000 7fa569551640 1 --2- 172.21.15.92:0/1788518553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa55c0a4d30 0x7fa55c143430 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa5640518b0 tx=0x7fa56406b680 comp rx=0 tx=0).stop 2024-09-19T09:08:12.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.664+0000 7fa569551640 1 -- 172.21.15.92:0/1788518553 shutdown_connections 2024-09-19T09:08:12.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.664+0000 7fa569551640 1 --2- 172.21.15.92:0/1788518553 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa5540a33a0 0x7fa5540a5860 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.664+0000 7fa569551640 1 --2- 172.21.15.92:0/1788518553 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa55c0aab50 0x7fa55c147d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.664+0000 7fa569551640 1 --2- 172.21.15.92:0/1788518553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa55c0aa230 0x7fa55c143970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.664+0000 7fa569551640 1 --2- 172.21.15.92:0/1788518553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa55c0a4d30 0x7fa55c143430 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.664+0000 7fa569551640 1 -- 172.21.15.92:0/1788518553 >> 172.21.15.92:0/1788518553 conn(0x7fa55c01a0a0 msgr2=0x7fa55c0a6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:12.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.665+0000 7fa569551640 1 -- 172.21.15.92:0/1788518553 shutdown_connections 2024-09-19T09:08:12.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:12.665+0000 7fa569551640 1 -- 172.21.15.92:0/1788518553 wait complete. 2024-09-19T09:08:12.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:12 smithi092 ceph-mon[31407]: pgmap v682: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 8.4 MiB/s wr, 742 op/s 2024-09-19T09:08:13.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:12 smithi167 ceph-mon[35359]: pgmap v682: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 8.4 MiB/s wr, 742 op/s 2024-09-19T09:08:13.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:12 smithi190 ceph-mon[35358]: pgmap v682: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 8.4 MiB/s wr, 742 op/s 2024-09-19T09:08:14.368 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:08:14.368 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:08:14.658 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:14 smithi092 ceph-mon[31407]: pgmap v683: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 8.4 MiB/s wr, 740 op/s 2024-09-19T09:08:14.775 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:08:15.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:14 smithi167 ceph-mon[35359]: pgmap v683: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 8.4 MiB/s wr, 740 op/s 2024-09-19T09:08:15.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:14 smithi190 ceph-mon[35358]: pgmap v683: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 8.4 MiB/s wr, 740 op/s 2024-09-19T09:08:15.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.346+0000 7f8982d7e640 1 -- 172.21.15.92:0/1869799952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f897c10d690 msgr2=0x7f897c10db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:15.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.346+0000 7f8982d7e640 1 --2- 172.21.15.92:0/1869799952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f897c10d690 0x7f897c10db40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f896c013f10 tx=0x7f896c032990 comp rx=0 tx=0).stop 2024-09-19T09:08:15.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.346+0000 7f8982d7e640 1 -- 172.21.15.92:0/1869799952 shutdown_connections 2024-09-19T09:08:15.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.346+0000 7f8982d7e640 1 --2- 172.21.15.92:0/1869799952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f897c10d690 0x7f897c10db40 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:15.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.346+0000 7f8982d7e640 1 --2- 172.21.15.92:0/1869799952 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f897c073ca0 0x7f897c109990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:15.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.347+0000 7f8982d7e640 1 --2- 172.21.15.92:0/1869799952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f897c073830 0x7f897c109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:15.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.347+0000 7f8982d7e640 1 -- 172.21.15.92:0/1869799952 >> 172.21.15.92:0/1869799952 conn(0x7f897c06e140 msgr2=0x7f897c06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:15.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.349+0000 7f8982d7e640 1 -- 172.21.15.92:0/1869799952 shutdown_connections 2024-09-19T09:08:15.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.350+0000 7f8982d7e640 1 -- 172.21.15.92:0/1869799952 wait complete. 2024-09-19T09:08:15.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.352+0000 7f8982d7e640 1 Processor -- start 2024-09-19T09:08:15.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.352+0000 7f8982d7e640 1 -- start start 2024-09-19T09:08:15.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.353+0000 7f8982d7e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f897c073830 0x7f897c19e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:15.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.355+0000 7f8982d7e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f897c073ca0 0x7f897c19ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:15.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.356+0000 7f8982d7e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f897c10d690 0x7f897c1a3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:15.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.356+0000 7f8982d7e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f897c116560 con 0x7f897c073830 2024-09-19T09:08:15.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.356+0000 7f897bfff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f897c073ca0 0x7f897c19ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:15.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.356+0000 7f8982d7e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f897c1163e0 con 0x7f897c10d690 2024-09-19T09:08:15.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.356+0000 7f8982d7e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f897c1166e0 con 0x7f897c073ca0 2024-09-19T09:08:15.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.356+0000 7f898131b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f897c10d690 0x7f897c1a3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:15.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.356+0000 7f898131b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f897c10d690 0x7f897c1a3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:36904/0 (socket says 172.21.15.92:36904) 2024-09-19T09:08:15.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.356+0000 7f898131b640 1 -- 172.21.15.92:0/1797739801 learned_addr learned my addr 172.21.15.92:0/1797739801 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:15.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.357+0000 7f897bfff640 1 -- 172.21.15.92:0/1797739801 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f897c10d690 msgr2=0x7f897c1a3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:15.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.357+0000 7f897bfff640 1 --2- 172.21.15.92:0/1797739801 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f897c10d690 0x7f897c1a3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:15.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.357+0000 7f897bfff640 1 -- 172.21.15.92:0/1797739801 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f897c073830 msgr2=0x7f897c19e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:15.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.357+0000 7f897bfff640 1 --2- 172.21.15.92:0/1797739801 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f897c073830 0x7f897c19e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:15.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.357+0000 7f897bfff640 1 -- 172.21.15.92:0/1797739801 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f897c1a3700 con 0x7f897c073ca0 2024-09-19T09:08:15.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.357+0000 7f897bfff640 1 --2- 172.21.15.92:0/1797739801 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f897c073ca0 0x7f897c19ece0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f897400ccb0 tx=0x7f897400a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:15.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.358+0000 7f8979ffb640 1 -- 172.21.15.92:0/1797739801 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f897400f450 con 0x7f897c073ca0 2024-09-19T09:08:15.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.358+0000 7f8982d7e640 1 -- 172.21.15.92:0/1797739801 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f897c1a39f0 con 0x7f897c073ca0 2024-09-19T09:08:15.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.358+0000 7f8979ffb640 1 -- 172.21.15.92:0/1797739801 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f897400fad0 con 0x7f897c073ca0 2024-09-19T09:08:15.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.358+0000 7f8979ffb640 1 -- 172.21.15.92:0/1797739801 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8974018bd0 con 0x7f897c073ca0 2024-09-19T09:08:15.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.358+0000 7f8982d7e640 1 -- 172.21.15.92:0/1797739801 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f897c1ab2d0 con 0x7f897c073ca0 2024-09-19T09:08:15.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.362+0000 7f8985157740 1 Processor -- start 2024-09-19T09:08:15.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.362+0000 7f8985157740 1 -- start start 2024-09-19T09:08:15.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.362+0000 7f8985157740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571f2d15b60 0x5571f2d15f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:15.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.362+0000 7f8985157740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571f2d16480 0x5571f2d209e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:15.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.362+0000 7f8985157740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571f2d20f20 0x5571f2d23310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:15.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.362+0000 7f8985157740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5571f2c7b280 con 0x5571f2d15b60 2024-09-19T09:08:15.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.362+0000 7f8985157740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5571f2c22b10 con 0x5571f2d20f20 2024-09-19T09:08:15.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.362+0000 7f8985157740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5571f2c77240 con 0x5571f2d16480 2024-09-19T09:08:15.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.363+0000 7f898131b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571f2d15b60 0x5571f2d15f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:15.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.363+0000 7f898131b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571f2d15b60 0x5571f2d15f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50838/0 (socket says 172.21.15.92:50838) 2024-09-19T09:08:15.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.363+0000 7f898131b640 1 -- 172.21.15.92:0/3034701954 learned_addr learned my addr 172.21.15.92:0/3034701954 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:15.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.363+0000 7f8980b1a640 1 --2- 172.21.15.92:0/3034701954 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571f2d16480 0x5571f2d209e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:15.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.364+0000 7f898131b640 1 -- 172.21.15.92:0/3034701954 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571f2d16480 msgr2=0x5571f2d209e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:15.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.364+0000 7f898131b640 1 --2- 172.21.15.92:0/3034701954 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571f2d16480 0x5571f2d209e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:15.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.364+0000 7f898131b640 1 -- 172.21.15.92:0/3034701954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571f2d20f20 msgr2=0x5571f2d23310 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:08:15.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.364+0000 7f898131b640 1 --2- 172.21.15.92:0/3034701954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571f2d20f20 0x5571f2d23310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:15.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.364+0000 7f898131b640 1 -- 172.21.15.92:0/3034701954 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571f2c2f1f0 con 0x5571f2d15b60 2024-09-19T09:08:15.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.364+0000 7f8980b1a640 1 --2- 172.21.15.92:0/3034701954 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571f2d16480 0x5571f2d209e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:08:15.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.364+0000 7f898131b640 1 --2- 172.21.15.92:0/3034701954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571f2d15b60 0x5571f2d15f40 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f896c004650 tx=0x7f896c00a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=821b0f7074bb175f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:15.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.365+0000 7f8979ffb640 1 -- 172.21.15.92:0/1797739801 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f897400f5f0 con 0x7f897c073ca0 2024-09-19T09:08:15.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.365+0000 7f8982d7e640 1 -- 172.21.15.92:0/3034701954 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896c005250 con 0x5571f2d15b60 2024-09-19T09:08:15.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.365+0000 7f8982d7e640 1 -- 172.21.15.92:0/3034701954 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f896c0053f0 con 0x5571f2d15b60 2024-09-19T09:08:15.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.365+0000 7f8982d7e640 1 -- 172.21.15.92:0/3034701954 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896c04b900 con 0x5571f2d15b60 2024-09-19T09:08:15.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.366+0000 7f8979ffb640 1 --2- 172.21.15.92:0/1797739801 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f89640a3300 0x7f89640a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:15.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.366+0000 7f8985157740 1 -- 172.21.15.92:0/3034701954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571f2d15b60 msgr2=0x5571f2d15f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:15.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.366+0000 7f8985157740 1 --2- 172.21.15.92:0/3034701954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571f2d15b60 0x5571f2d15f40 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f896c004650 tx=0x7f896c00a180 comp rx=0 tx=0).stop 2024-09-19T09:08:15.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.366+0000 7f8979ffb640 1 -- 172.21.15.92:0/1797739801 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f89740cfd00 con 0x7f897c073ca0 2024-09-19T09:08:15.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.366+0000 7f8980b1a640 1 --2- 172.21.15.92:0/1797739801 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f89640a3300 0x7f89640a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:15.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.366+0000 7f8985157740 1 -- 172.21.15.92:0/3034701954 shutdown_connections 2024-09-19T09:08:15.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.366+0000 7f8985157740 1 --2- 172.21.15.92:0/3034701954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571f2d20f20 0x5571f2d23310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:15.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.366+0000 7f8985157740 1 --2- 172.21.15.92:0/3034701954 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571f2d16480 0x5571f2d209e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:15.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.366+0000 7f8985157740 1 --2- 172.21.15.92:0/3034701954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571f2d15b60 0x5571f2d15f40 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:15.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.366+0000 7f8985157740 1 -- 172.21.15.92:0/3034701954 >> 172.21.15.92:0/3034701954 conn(0x5571f2d122d0 msgr2=0x5571f2d126b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:15.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.366+0000 7f8985157740 1 -- 172.21.15.92:0/3034701954 shutdown_connections 2024-09-19T09:08:15.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.366+0000 7f8985157740 1 -- 172.21.15.92:0/3034701954 wait complete. 2024-09-19T09:08:15.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.367+0000 7f8985157740 1 -- start start 2024-09-19T09:08:15.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.367+0000 7f8985157740 1 Processor -- start 2024-09-19T09:08:15.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.367+0000 7f8980b1a640 1 --2- 172.21.15.92:0/1797739801 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f89640a3300 0x7f89640a57c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8970005d00 tx=0x7f8970005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:15.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.368+0000 7f8985157740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571f2d15b60 0x5571f2d1dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:15.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.368+0000 7f8985157740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571f2d16480 0x5571f2d1e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:15.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.368+0000 7f8985157740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571f2d20f20 0x5571f2d1ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:15.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.368+0000 7f8985157740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5571f2d238b0 con 0x5571f2d15b60 2024-09-19T09:08:15.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.368+0000 7f898131b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571f2d20f20 0x5571f2d1ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:15.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.368+0000 7f898131b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571f2d20f20 0x5571f2d1ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:33840/0 (socket says 172.21.15.92:33840) 2024-09-19T09:08:15.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.368+0000 7f898131b640 1 -- 172.21.15.92:0/3068388308 learned_addr learned my addr 172.21.15.92:0/3068388308 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:15.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.368+0000 7f8985157740 1 -- 172.21.15.92:0/3068388308 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5571f2c35f10 con 0x5571f2d16480 2024-09-19T09:08:15.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.368+0000 7f8980b1a640 1 --2- 172.21.15.92:0/3068388308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571f2d15b60 0x5571f2d1dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:15.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.368+0000 7f8985157740 1 -- 172.21.15.92:0/3068388308 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5571f2d23a30 con 0x5571f2d20f20 2024-09-19T09:08:15.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.369+0000 7f8985157740 10 client.0 _ll_register_callbacks cb 0x5571f2bfea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:15.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.369+0000 7f897bfff640 1 --2- 172.21.15.92:0/3068388308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571f2d16480 0x5571f2d1e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:15.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.369+0000 7f898131b640 1 -- 172.21.15.92:0/3068388308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571f2d16480 msgr2=0x5571f2d1e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:15.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.369+0000 7f898131b640 1 --2- 172.21.15.92:0/3068388308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571f2d16480 0x5571f2d1e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:15.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.369+0000 7f898131b640 1 -- 172.21.15.92:0/3068388308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571f2d15b60 msgr2=0x5571f2d1dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:15.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.369+0000 7f898131b640 1 --2- 172.21.15.92:0/3068388308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571f2d15b60 0x5571f2d1dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:15.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.369+0000 7f898131b640 1 -- 172.21.15.92:0/3068388308 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571f29ec6a0 con 0x5571f2d20f20 2024-09-19T09:08:15.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.369+0000 7f897bfff640 1 --2- 172.21.15.92:0/3068388308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571f2d16480 0x5571f2d1e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:08:15.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.369+0000 7f8980b1a640 1 --2- 172.21.15.92:0/3068388308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571f2d15b60 0x5571f2d1dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:08:15.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.369+0000 7f898131b640 1 --2- 172.21.15.92:0/3068388308 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571f2d20f20 0x5571f2d1ea70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f896c005c40 tx=0x7f896c0048f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b7e5040f595c9d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:15.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.369+0000 7f895bfff640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:08:15.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.370+0000 7f895bfff640 1 -- 172.21.15.92:0/3068388308 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896c052070 con 0x5571f2d20f20 2024-09-19T09:08:15.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.370+0000 7f895bfff640 1 -- 172.21.15.92:0/3068388308 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f896c04b680 con 0x5571f2d20f20 2024-09-19T09:08:15.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.370+0000 7f8985157740 1 -- 172.21.15.92:0/3068388308 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f896c0053f0 con 0x5571f2d20f20 2024-09-19T09:08:15.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.370+0000 7f895bfff640 1 -- 172.21.15.92:0/3068388308 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f896c05e050 con 0x5571f2d20f20 2024-09-19T09:08:15.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.370+0000 7f8985157740 10 client.27310 fetch_fsmap learned FSMap version 19 2024-09-19T09:08:15.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.370+0000 7f8985157740 1 -- 172.21.15.92:0/3068388308 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5571f2d238b0 con 0x5571f2d20f20 2024-09-19T09:08:15.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.370+0000 7f895bfff640 1 -- 172.21.15.92:0/3068388308 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f896c0053f0 con 0x5571f2d20f20 2024-09-19T09:08:15.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.371+0000 7f895bfff640 1 -- 172.21.15.92:0/3068388308 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f896c049020 con 0x5571f2d20f20 2024-09-19T09:08:15.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.371+0000 7f8985157740 10 client.27310 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:08:15.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.371+0000 7f8985157740 10 client.27310 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:08:15.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.371+0000 7f8985157740 20 client.27310 populate_metadata read hostname 'smithi092' 2024-09-19T09:08:15.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.371+0000 7f8985157740 1 --2- 172.21.15.92:0/3068388308 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5571f2d30820 0x5571f2d32c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:15.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.371+0000 7f8985157740 4 client.27310 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:08:15.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.371+0000 7f8985157740 1 -- 172.21.15.92:0/3068388308 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5571f2c887f0 con 0x5571f2d30820 2024-09-19T09:08:15.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.371+0000 7f8980b1a640 1 --2- 172.21.15.92:0/3068388308 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5571f2d30820 0x5571f2d32c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:15.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.372+0000 7f8980b1a640 1 --2- 172.21.15.92:0/3068388308 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5571f2d30820 0x5571f2d32c10 crc :-1 s=READY pgs=355 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18de638e7d3b0dda server_cookie=83652a133fc834d0 in_seq=0 out_seq=0 2024-09-19T09:08:15.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.372+0000 7f895bfff640 10 client.27310 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:15.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.373+0000 7f895bfff640 1 -- 172.21.15.92:0/3068388308 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5571f2c887f0 con 0x5571f2d30820 2024-09-19T09:08:15.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.373+0000 7f895bfff640 10 client.27310 handle_command_reply: tid=0 2024-09-19T09:08:15.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.373+0000 7f8985157740 1 client.27310 shutdown 2024-09-19T09:08:15.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.374+0000 7f8985157740 1 -- 172.21.15.92:0/3068388308 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571f2d20f20 msgr2=0x5571f2d1ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:15.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.374+0000 7f8985157740 1 --2- 172.21.15.92:0/3068388308 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571f2d20f20 0x5571f2d1ea70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f896c005c40 tx=0x7f896c0048f0 comp rx=0 tx=0).stop 2024-09-19T09:08:15.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.374+0000 7f8985157740 1 -- 172.21.15.92:0/3068388308 shutdown_connections 2024-09-19T09:08:15.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.374+0000 7f8985157740 1 --2- 172.21.15.92:0/3068388308 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5571f2d30820 0x5571f2d32c10 crc :-1 s=READY pgs=355 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:15.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.374+0000 7f8985157740 1 --2- 172.21.15.92:0/3068388308 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571f2d20f20 0x5571f2d1ea70 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:15.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.374+0000 7f895bfff640 0 client.27310 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:15.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.375+0000 7f8985157740 1 --2- 172.21.15.92:0/3068388308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571f2d16480 0x5571f2d1e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:15.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.375+0000 7f8985157740 1 --2- 172.21.15.92:0/3068388308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571f2d15b60 0x5571f2d1dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:15.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.375+0000 7f8985157740 1 -- 172.21.15.92:0/3068388308 >> 172.21.15.92:0/3068388308 conn(0x5571f2d122d0 msgr2=0x5571f2d18000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:15.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.375+0000 7f8985157740 1 -- 172.21.15.92:0/3068388308 shutdown_connections 2024-09-19T09:08:15.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.375+0000 7f8985157740 1 -- 172.21.15.92:0/3068388308 wait complete. 2024-09-19T09:08:15.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.375+0000 7f8985157740 20 client.27310 trim_cache size 0 max 16384 2024-09-19T09:08:15.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.398+0000 7f8985157740 1 Processor -- start 2024-09-19T09:08:15.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.399+0000 7f8985157740 1 -- start start 2024-09-19T09:08:15.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.399+0000 7f8985157740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571f2d15b60 0x5571f2d1e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:15.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.399+0000 7f8985157740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571f2d16480 0x5571f2d2c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:15.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.399+0000 7f8985157740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571f2d20f20 0x5571f2d35c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:15.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.399+0000 7f8985157740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f897c1b1c20 con 0x5571f2d20f20 2024-09-19T09:08:15.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.399+0000 7f8985157740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f897c1b44c0 con 0x5571f2d16480 2024-09-19T09:08:15.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.399+0000 7f8985157740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f897c1b22b0 con 0x5571f2d15b60 2024-09-19T09:08:15.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.399+0000 7f897bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571f2d16480 0x5571f2d2c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:15.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.399+0000 7f897bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571f2d16480 0x5571f2d2c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:36924/0 (socket says 172.21.15.92:36924) 2024-09-19T09:08:15.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.399+0000 7f897bfff640 1 -- 172.21.15.92:0/340801328 learned_addr learned my addr 172.21.15.92:0/340801328 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:15.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.399+0000 7f897bfff640 1 -- 172.21.15.92:0/340801328 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571f2d15b60 msgr2=0x5571f2d1e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:15.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.399+0000 7f897bfff640 1 --2- 172.21.15.92:0/340801328 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571f2d15b60 0x5571f2d1e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:15.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.399+0000 7f897bfff640 1 -- 172.21.15.92:0/340801328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571f2d20f20 msgr2=0x5571f2d35c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:15.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.399+0000 7f897bfff640 1 --2- 172.21.15.92:0/340801328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571f2d20f20 0x5571f2d35c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:15.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.399+0000 7f897bfff640 1 -- 172.21.15.92:0/340801328 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571f2d13380 con 0x5571f2d16480 2024-09-19T09:08:15.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.400+0000 7f897bfff640 1 --2- 172.21.15.92:0/340801328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571f2d16480 0x5571f2d2c390 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8974007fd0 tx=0x7f8974018510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e15f9a3f11948c86 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:15.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.400+0000 7f89627fc640 1 -- 172.21.15.92:0/340801328 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89740b5070 con 0x5571f2d16480 2024-09-19T09:08:15.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.400+0000 7f89627fc640 1 -- 172.21.15.92:0/340801328 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89740a4f90 con 0x5571f2d16480 2024-09-19T09:08:15.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.400+0000 7f89627fc640 1 -- 172.21.15.92:0/340801328 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89740b5210 con 0x5571f2d16480 2024-09-19T09:08:15.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.401+0000 7f8985157740 1 -- 172.21.15.92:0/340801328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571f2d16480 msgr2=0x5571f2d2c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:15.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.401+0000 7f8985157740 1 --2- 172.21.15.92:0/340801328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571f2d16480 0x5571f2d2c390 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8974007fd0 tx=0x7f8974018510 comp rx=0 tx=0).stop 2024-09-19T09:08:15.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.401+0000 7f8985157740 1 -- 172.21.15.92:0/340801328 shutdown_connections 2024-09-19T09:08:15.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.401+0000 7f8985157740 1 --2- 172.21.15.92:0/340801328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571f2d20f20 0x5571f2d35c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:15.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.401+0000 7f8985157740 1 --2- 172.21.15.92:0/340801328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571f2d16480 0x5571f2d2c390 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:15.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.401+0000 7f8985157740 1 --2- 172.21.15.92:0/340801328 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571f2d15b60 0x5571f2d1e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:15.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.401+0000 7f8985157740 1 -- 172.21.15.92:0/340801328 >> 172.21.15.92:0/340801328 conn(0x5571f2d122d0 msgr2=0x5571f2d2bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:15.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.401+0000 7f8985157740 1 -- 172.21.15.92:0/340801328 shutdown_connections 2024-09-19T09:08:15.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.401+0000 7f8985157740 1 -- 172.21.15.92:0/340801328 wait complete. 2024-09-19T09:08:15.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.402+0000 7f8985157740 1 -- start start 2024-09-19T09:08:15.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.402+0000 7f8985157740 1 Processor -- start 2024-09-19T09:08:15.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.403+0000 7f8985157740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571f2d15b60 0x5571f2d36360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:15.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.403+0000 7f8985157740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571f2d16480 0x5571f2d336b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:15.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.403+0000 7f8985157740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571f2d20f20 0x5571f2d33bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:15.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.403+0000 7f8980b1a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571f2d15b60 0x5571f2d36360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:15.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.403+0000 7f8980b1a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571f2d15b60 0x5571f2d36360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50852/0 (socket says 172.21.15.92:50852) 2024-09-19T09:08:15.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.403+0000 7f897bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571f2d16480 0x5571f2d336b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:15.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.403+0000 7f897bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571f2d16480 0x5571f2d336b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:36928/0 (socket says 172.21.15.92:36928) 2024-09-19T09:08:15.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.403+0000 7f8980b1a640 1 -- 172.21.15.92:0/3729587584 learned_addr learned my addr 172.21.15.92:0/3729587584 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:15.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.404+0000 7f8985157740 1 -- 172.21.15.92:0/3729587584 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f897c1b2980 con 0x5571f2d15b60 2024-09-19T09:08:15.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.404+0000 7f8985157740 1 -- 172.21.15.92:0/3729587584 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f897c1b3df0 con 0x5571f2d16480 2024-09-19T09:08:15.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.404+0000 7f8985157740 1 -- 172.21.15.92:0/3729587584 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f897c1b3050 con 0x5571f2d20f20 2024-09-19T09:08:15.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.404+0000 7f8985157740 10 client.0 _ll_register_callbacks cb 0x7f896c00a0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:15.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.404+0000 7f898131b640 1 --2- 172.21.15.92:0/3729587584 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571f2d20f20 0x5571f2d33bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:15.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.405+0000 7f8980b1a640 1 -- 172.21.15.92:0/3729587584 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571f2d20f20 msgr2=0x5571f2d33bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:15.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.405+0000 7f8980b1a640 1 --2- 172.21.15.92:0/3729587584 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571f2d20f20 0x5571f2d33bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:15.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.405+0000 7f8980b1a640 1 -- 172.21.15.92:0/3729587584 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571f2d16480 msgr2=0x5571f2d336b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:15.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.405+0000 7f8980b1a640 1 --2- 172.21.15.92:0/3729587584 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571f2d16480 0x5571f2d336b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:15.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.405+0000 7f8980b1a640 1 -- 172.21.15.92:0/3729587584 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571f2d12f60 con 0x5571f2d15b60 2024-09-19T09:08:15.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.405+0000 7f8980b1a640 1 --2- 172.21.15.92:0/3729587584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571f2d15b60 0x5571f2d36360 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f897000ff00 tx=0x7f8970005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f3b990446b0d17 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:15.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.405+0000 7f895bfff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:08:15.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.405+0000 7f895bfff640 1 -- 172.21.15.92:0/3729587584 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8970015070 con 0x5571f2d15b60 2024-09-19T09:08:15.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.406+0000 7f895bfff640 1 -- 172.21.15.92:0/3729587584 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8970005500 con 0x5571f2d15b60 2024-09-19T09:08:15.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.406+0000 7f8985157740 1 -- 172.21.15.92:0/3729587584 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89740a4f90 con 0x5571f2d15b60 2024-09-19T09:08:15.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.406+0000 7f895bfff640 1 -- 172.21.15.92:0/3729587584 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f89700047a0 con 0x5571f2d15b60 2024-09-19T09:08:15.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.406+0000 7f8985157740 10 client.18144 fetch_fsmap learned FSMap version 19 2024-09-19T09:08:15.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.406+0000 7f8985157740 1 -- 172.21.15.92:0/3729587584 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5571f2d9b000 con 0x5571f2d15b60 2024-09-19T09:08:15.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.407+0000 7f895bfff640 1 -- 172.21.15.92:0/3729587584 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f897002b070 con 0x5571f2d15b60 2024-09-19T09:08:15.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.407+0000 7f895bfff640 1 -- 172.21.15.92:0/3729587584 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f89700262c0 con 0x5571f2d15b60 2024-09-19T09:08:15.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.407+0000 7f8985157740 10 client.18144 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:08:15.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.407+0000 7f8985157740 10 client.18144 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:08:15.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.407+0000 7f8985157740 20 client.18144 populate_metadata read hostname 'smithi092' 2024-09-19T09:08:15.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.407+0000 7f8985157740 1 --2- 172.21.15.92:0/3729587584 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5571f2d30820 0x5571f2d9d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:15.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.407+0000 7f8985157740 4 client.18144 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:08:15.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.407+0000 7f8985157740 1 -- 172.21.15.92:0/3729587584 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f89740a4f90 con 0x5571f2d30820 2024-09-19T09:08:15.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.408+0000 7f897bfff640 1 --2- 172.21.15.92:0/3729587584 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5571f2d30820 0x5571f2d9d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:15.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.409+0000 7f897bfff640 1 --2- 172.21.15.92:0/3729587584 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5571f2d30820 0x5571f2d9d7c0 crc :-1 s=READY pgs=356 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=548d7abd56b5d09b server_cookie=265b6b4bde571c9 in_seq=0 out_seq=0 2024-09-19T09:08:15.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.409+0000 7f895bfff640 10 client.18144 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:15.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.410+0000 7f895bfff640 1 -- 172.21.15.92:0/3729587584 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f89740a4f90 con 0x5571f2d30820 2024-09-19T09:08:15.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.411+0000 7f895bfff640 10 client.18144 handle_command_reply: tid=0 2024-09-19T09:08:15.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.411+0000 7f8985157740 1 client.18144 shutdown 2024-09-19T09:08:15.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.411+0000 7f8985157740 1 -- 172.21.15.92:0/3729587584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571f2d15b60 msgr2=0x5571f2d36360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:15.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.412+0000 7f8985157740 1 --2- 172.21.15.92:0/3729587584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571f2d15b60 0x5571f2d36360 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f897000ff00 tx=0x7f8970005c90 comp rx=0 tx=0).stop 2024-09-19T09:08:15.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.412+0000 7f8985157740 1 -- 172.21.15.92:0/3729587584 shutdown_connections 2024-09-19T09:08:15.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.412+0000 7f8985157740 1 --2- 172.21.15.92:0/3729587584 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5571f2d30820 0x5571f2d9d7c0 crc :-1 s=READY pgs=356 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:15.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.412+0000 7f8985157740 1 --2- 172.21.15.92:0/3729587584 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5571f2d20f20 0x5571f2d33bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:15.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.412+0000 7f8985157740 1 --2- 172.21.15.92:0/3729587584 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571f2d16480 0x5571f2d336b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:15.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.412+0000 7f8985157740 1 --2- 172.21.15.92:0/3729587584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5571f2d15b60 0x5571f2d36360 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:15.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.412+0000 7f895bfff640 0 client.18144 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:15.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.412+0000 7f8985157740 1 -- 172.21.15.92:0/3729587584 >> 172.21.15.92:0/3729587584 conn(0x5571f2d122d0 msgr2=0x5571f2d2c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:15.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.412+0000 7f8985157740 1 -- 172.21.15.92:0/3729587584 shutdown_connections 2024-09-19T09:08:15.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.412+0000 7f8985157740 1 -- 172.21.15.92:0/3729587584 wait complete. 2024-09-19T09:08:15.415 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.413+0000 7f8985157740 20 client.18144 trim_cache size 0 max 16384 2024-09-19T09:08:15.415 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:08:15.415 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-19T09:08:15.415 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "7dcc2986-f58d-4845-9659-9cc38a26b562", 2024-09-19T09:08:15.415 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-19T09:08:15.415 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:08:15.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.413+0000 7f89637fe640 1 -- 172.21.15.92:0/1797739801 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f89640a3300 msgr2=0x7f89640a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:15.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.413+0000 7f89637fe640 1 --2- 172.21.15.92:0/1797739801 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f89640a3300 0x7f89640a57c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8970005d00 tx=0x7f8970005f90 comp rx=0 tx=0).stop 2024-09-19T09:08:15.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.413+0000 7f89637fe640 1 -- 172.21.15.92:0/1797739801 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f897c073ca0 msgr2=0x7f897c19ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:15.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.413+0000 7f89637fe640 1 --2- 172.21.15.92:0/1797739801 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f897c073ca0 0x7f897c19ece0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f897400ccb0 tx=0x7f897400a620 comp rx=0 tx=0).stop 2024-09-19T09:08:15.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.414+0000 7f89637fe640 1 -- 172.21.15.92:0/1797739801 shutdown_connections 2024-09-19T09:08:15.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.414+0000 7f89637fe640 1 --2- 172.21.15.92:0/1797739801 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f897c10d690 0x7f897c1a3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:15.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.414+0000 7f89637fe640 1 --2- 172.21.15.92:0/1797739801 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f897c073ca0 0x7f897c19ece0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:15.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.414+0000 7f89637fe640 1 --2- 172.21.15.92:0/1797739801 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f89640a3300 0x7f89640a57c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:15.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.414+0000 7f89637fe640 1 --2- 172.21.15.92:0/1797739801 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f897c073830 0x7f897c19e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:15.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.414+0000 7f89637fe640 1 -- 172.21.15.92:0/1797739801 >> 172.21.15.92:0/1797739801 conn(0x7f897c06e140 msgr2=0x7f897c10c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:15.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.414+0000 7f89637fe640 1 -- 172.21.15.92:0/1797739801 shutdown_connections 2024-09-19T09:08:15.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:15.414+0000 7f89637fe640 1 -- 172.21.15.92:0/1797739801 wait complete. 2024-09-19T09:08:15.795 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 690.0 s, 3606.8 tps, lat 27.817 ms stddev 33.140 2024-09-19T09:08:16.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:15 smithi092 ceph-mon[31407]: scrub queued for path: / 2024-09-19T09:08:16.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:15 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:08:16.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:15 smithi092 ceph-mon[31407]: scrub summary: active paths [/] 2024-09-19T09:08:16.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:15 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:08:16.100 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:08:16.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:15 smithi167 ceph-mon[35359]: scrub queued for path: / 2024-09-19T09:08:16.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:15 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:08:16.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:15 smithi167 ceph-mon[35359]: scrub summary: active paths [/] 2024-09-19T09:08:16.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:15 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:08:16.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:15 smithi190 ceph-mon[35358]: scrub queued for path: / 2024-09-19T09:08:16.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:15 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:08:16.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:15 smithi190 ceph-mon[35358]: scrub summary: active paths [/] 2024-09-19T09:08:16.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:15 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:08:16.496 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:08:16.877 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:16 smithi092 ceph-mon[31407]: pgmap v684: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.3 MiB/s wr, 801 op/s 2024-09-19T09:08:17.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:16 smithi167 ceph-mon[35359]: pgmap v684: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.3 MiB/s wr, 801 op/s 2024-09-19T09:08:17.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:16 smithi190 ceph-mon[35358]: pgmap v684: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.3 MiB/s wr, 801 op/s 2024-09-19T09:08:17.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.296+0000 7f1104416640 1 -- 172.21.15.92:0/1981672186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10fc10d520 msgr2=0x7f10fc1150a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:17.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.296+0000 7f1104416640 1 --2- 172.21.15.92:0/1981672186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10fc10d520 0x7f10fc1150a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f10f4009ca0 tx=0x7f10f402a8b0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.296+0000 7f1104416640 1 -- 172.21.15.92:0/1981672186 shutdown_connections 2024-09-19T09:08:17.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.296+0000 7f1104416640 1 --2- 172.21.15.92:0/1981672186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10fc10d520 0x7f10fc1150a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.296+0000 7f1104416640 1 --2- 172.21.15.92:0/1981672186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10fc108da0 0x7f10fc10cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.296+0000 7f1104416640 1 --2- 172.21.15.92:0/1981672186 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10fc1083f0 0x7f10fc1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.296+0000 7f1104416640 1 -- 172.21.15.92:0/1981672186 >> 172.21.15.92:0/1981672186 conn(0x7f10fc077af0 msgr2=0x7f10fc079f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:17.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.297+0000 7f1104416640 1 -- 172.21.15.92:0/1981672186 shutdown_connections 2024-09-19T09:08:17.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.297+0000 7f1104416640 1 -- 172.21.15.92:0/1981672186 wait complete. 2024-09-19T09:08:17.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.297+0000 7f1104416640 1 Processor -- start 2024-09-19T09:08:17.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.297+0000 7f1104416640 1 -- start start 2024-09-19T09:08:17.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.298+0000 7f1104416640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10fc1083f0 0x7f10fc1a46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:17.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.298+0000 7f1104416640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10fc108da0 0x7f10fc1a4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:17.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.298+0000 7f1104416640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10fc10d520 0x7f10fc19e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:17.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.298+0000 7f1104416640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc118550 con 0x7f10fc1083f0 2024-09-19T09:08:17.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.298+0000 7f1104416640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc1183d0 con 0x7f10fc10d520 2024-09-19T09:08:17.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.298+0000 7f1104416640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc1186d0 con 0x7f10fc108da0 2024-09-19T09:08:17.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.298+0000 7f11029b3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10fc10d520 0x7f10fc19e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:17.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.298+0000 7f11029b3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10fc10d520 0x7f10fc19e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:36954/0 (socket says 172.21.15.92:36954) 2024-09-19T09:08:17.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.298+0000 7f11029b3640 1 -- 172.21.15.92:0/3573588860 learned_addr learned my addr 172.21.15.92:0/3573588860 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:17.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.298+0000 7f11019b1640 1 --2- 172.21.15.92:0/3573588860 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10fc108da0 0x7f10fc1a4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:17.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.299+0000 7f11021b2640 1 --2- 172.21.15.92:0/3573588860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10fc1083f0 0x7f10fc1a46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:17.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.299+0000 7f11019b1640 1 -- 172.21.15.92:0/3573588860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10fc10d520 msgr2=0x7f10fc19e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:17.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.299+0000 7f11019b1640 1 --2- 172.21.15.92:0/3573588860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10fc10d520 0x7f10fc19e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.299+0000 7f11019b1640 1 -- 172.21.15.92:0/3573588860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10fc1083f0 msgr2=0x7f10fc1a46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:17.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.299+0000 7f11019b1640 1 --2- 172.21.15.92:0/3573588860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10fc1083f0 0x7f10fc1a46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.299+0000 7f11019b1640 1 -- 172.21.15.92:0/3573588860 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10fc19efe0 con 0x7f10fc108da0 2024-09-19T09:08:17.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.299+0000 7f11021b2640 1 --2- 172.21.15.92:0/3573588860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10fc1083f0 0x7f10fc1a46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:08:17.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.299+0000 7f11019b1640 1 --2- 172.21.15.92:0/3573588860 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10fc108da0 0x7f10fc1a4c00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f10ec00e9c0 tx=0x7f10ec00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:17.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.299+0000 7f10f37fe640 1 -- 172.21.15.92:0/3573588860 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ec00ccc0 con 0x7f10fc108da0 2024-09-19T09:08:17.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.299+0000 7f10f37fe640 1 -- 172.21.15.92:0/3573588860 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10ec010910 con 0x7f10fc108da0 2024-09-19T09:08:17.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.299+0000 7f10f37fe640 1 -- 172.21.15.92:0/3573588860 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ec0188c0 con 0x7f10fc108da0 2024-09-19T09:08:17.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.299+0000 7f1104416640 1 -- 172.21.15.92:0/3573588860 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10fc19f2d0 con 0x7f10fc108da0 2024-09-19T09:08:17.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.299+0000 7f1104416640 1 -- 172.21.15.92:0/3573588860 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10fc1ab520 con 0x7f10fc108da0 2024-09-19T09:08:17.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.303+0000 7f11067ef740 1 Processor -- start 2024-09-19T09:08:17.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.304+0000 7f10f37fe640 1 -- 172.21.15.92:0/3573588860 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f10ec010ac0 con 0x7f10fc108da0 2024-09-19T09:08:17.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.304+0000 7f11067ef740 1 -- start start 2024-09-19T09:08:17.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.304+0000 7f11067ef740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e4cd2714a0 0x55e4cd271880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:17.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.304+0000 7f11067ef740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4cd271dc0 0x55e4cd27c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:17.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.304+0000 7f11067ef740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4cd27c680 0x55e4cd27ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:17.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.304+0000 7f11067ef740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e4cd1d72e0 con 0x55e4cd27c680 2024-09-19T09:08:17.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.304+0000 7f11067ef740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e4cd17ece0 con 0x55e4cd2714a0 2024-09-19T09:08:17.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.304+0000 7f11067ef740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e4cd1d32a0 con 0x55e4cd271dc0 2024-09-19T09:08:17.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.304+0000 7f11021b2640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4cd271dc0 0x55e4cd27c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:17.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.305+0000 7f11021b2640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4cd271dc0 0x55e4cd27c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:33878/0 (socket says 172.21.15.92:33878) 2024-09-19T09:08:17.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.305+0000 7f11021b2640 1 -- 172.21.15.92:0/2530187018 learned_addr learned my addr 172.21.15.92:0/2530187018 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:17.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.305+0000 7f11029b3640 1 --2- 172.21.15.92:0/2530187018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e4cd2714a0 0x55e4cd271880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:17.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.305+0000 7f11019b1640 1 --2- 172.21.15.92:0/2530187018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4cd27c680 0x55e4cd27ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:17.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.305+0000 7f11029b3640 1 -- 172.21.15.92:0/2530187018 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4cd271dc0 msgr2=0x55e4cd27c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:17.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.306+0000 7f11029b3640 1 --2- 172.21.15.92:0/2530187018 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4cd271dc0 0x55e4cd27c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.306+0000 7f11029b3640 1 -- 172.21.15.92:0/2530187018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4cd27c680 msgr2=0x55e4cd27ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:17.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.306+0000 7f11029b3640 1 --2- 172.21.15.92:0/2530187018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4cd27c680 0x55e4cd27ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.306+0000 7f11029b3640 1 -- 172.21.15.92:0/2530187018 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4cd163440 con 0x55e4cd2714a0 2024-09-19T09:08:17.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.306+0000 7f11019b1640 1 --2- 172.21.15.92:0/2530187018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4cd27c680 0x55e4cd27ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:08:17.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.307+0000 7f11029b3640 1 --2- 172.21.15.92:0/2530187018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e4cd2714a0 0x55e4cd271880 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f10f4006010 tx=0x7f10f4009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c1ffc1d3f43c098 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:17.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.307+0000 7f10f37fe640 1 --2- 172.21.15.92:0/3573588860 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f10e80a32c0 0x7f10e80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:17.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.307+0000 7f10f37fe640 1 -- 172.21.15.92:0/3573588860 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f10ec0cfc70 con 0x7f10fc108da0 2024-09-19T09:08:17.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.307+0000 7f11021b2640 1 --2- 172.21.15.92:0/3573588860 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f10e80a32c0 0x7f10e80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:17.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.307+0000 7f10f0dea640 1 -- 172.21.15.92:0/2530187018 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f40306e0 con 0x55e4cd2714a0 2024-09-19T09:08:17.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.308+0000 7f10f0dea640 1 -- 172.21.15.92:0/2530187018 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10f4036030 con 0x55e4cd2714a0 2024-09-19T09:08:17.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.308+0000 7f10f0dea640 1 -- 172.21.15.92:0/2530187018 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f4004430 con 0x55e4cd2714a0 2024-09-19T09:08:17.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.309+0000 7f11067ef740 1 -- 172.21.15.92:0/2530187018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e4cd2714a0 msgr2=0x55e4cd271880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:17.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.309+0000 7f11067ef740 1 --2- 172.21.15.92:0/2530187018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e4cd2714a0 0x55e4cd271880 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f10f4006010 tx=0x7f10f4009a20 comp rx=0 tx=0).stop 2024-09-19T09:08:17.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.309+0000 7f11021b2640 1 --2- 172.21.15.92:0/3573588860 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f10e80a32c0 0x7f10e80a5780 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x55e4cd26e890 tx=0x7f10f8009390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:17.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.310+0000 7f11067ef740 1 -- 172.21.15.92:0/2530187018 shutdown_connections 2024-09-19T09:08:17.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.310+0000 7f11067ef740 1 --2- 172.21.15.92:0/2530187018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4cd27c680 0x55e4cd27ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.310+0000 7f11067ef740 1 --2- 172.21.15.92:0/2530187018 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4cd271dc0 0x55e4cd27c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.310+0000 7f11067ef740 1 --2- 172.21.15.92:0/2530187018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e4cd2714a0 0x55e4cd271880 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.310+0000 7f11067ef740 1 -- 172.21.15.92:0/2530187018 >> 172.21.15.92:0/2530187018 conn(0x55e4cd26da30 msgr2=0x55e4cd26de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:17.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.310+0000 7f11067ef740 1 -- 172.21.15.92:0/2530187018 shutdown_connections 2024-09-19T09:08:17.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.310+0000 7f11067ef740 1 -- 172.21.15.92:0/2530187018 wait complete. 2024-09-19T09:08:17.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.310+0000 7f11067ef740 1 -- start start 2024-09-19T09:08:17.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.311+0000 7f11067ef740 1 Processor -- start 2024-09-19T09:08:17.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.311+0000 7f11067ef740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e4cd2714a0 0x55e4cd27c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:17.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.312+0000 7f11067ef740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4cd271dc0 0x55e4cd279310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:17.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.312+0000 7f11067ef740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4cd27c680 0x55e4cd2798e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:17.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.312+0000 7f11067ef740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e4cd27f250 con 0x55e4cd27c680 2024-09-19T09:08:17.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.312+0000 7f11067ef740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e4cd192050 con 0x55e4cd2714a0 2024-09-19T09:08:17.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.312+0000 7f11067ef740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e4cd27f3d0 con 0x55e4cd271dc0 2024-09-19T09:08:17.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.312+0000 7f11067ef740 10 client.0 _ll_register_callbacks cb 0x55e4cd1d2160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:17.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.312+0000 7f11029b3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4cd27c680 0x55e4cd2798e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:17.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.312+0000 7f11019b1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4cd271dc0 0x55e4cd279310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:17.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.312+0000 7f11021b2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e4cd2714a0 0x55e4cd27c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:17.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.312+0000 7f11029b3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4cd27c680 0x55e4cd2798e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50902/0 (socket says 172.21.15.92:50902) 2024-09-19T09:08:17.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.312+0000 7f11029b3640 1 -- 172.21.15.92:0/3613708972 learned_addr learned my addr 172.21.15.92:0/3613708972 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:17.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.312+0000 7f11019b1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4cd271dc0 0x55e4cd279310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:33882/0 (socket says 172.21.15.92:33882) 2024-09-19T09:08:17.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.312+0000 7f11021b2640 1 --2- 172.21.15.92:0/3613708972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e4cd2714a0 0x55e4cd27c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:36964/0 (socket says 172.21.15.92:36964) 2024-09-19T09:08:17.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.312+0000 7f11019b1640 1 -- 172.21.15.92:0/3613708972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e4cd2714a0 msgr2=0x55e4cd27c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:17.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.312+0000 7f11019b1640 1 --2- 172.21.15.92:0/3613708972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e4cd2714a0 0x55e4cd27c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.312+0000 7f11019b1640 1 -- 172.21.15.92:0/3613708972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4cd27c680 msgr2=0x55e4cd2798e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:17.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.312+0000 7f11019b1640 1 --2- 172.21.15.92:0/3613708972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4cd27c680 0x55e4cd2798e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.312+0000 7f11019b1640 1 -- 172.21.15.92:0/3613708972 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4ccf483c0 con 0x55e4cd271dc0 2024-09-19T09:08:17.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.312+0000 7f11021b2640 1 --2- 172.21.15.92:0/3613708972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e4cd2714a0 0x55e4cd27c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:08:17.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.313+0000 7f11019b1640 1 --2- 172.21.15.92:0/3613708972 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4cd271dc0 0x55e4cd279310 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55e4cd26edb0 tx=0x7f10ec09c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddf1772337c70ee9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:17.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.313+0000 7f10e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:08:17.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.313+0000 7f10e5ffb640 1 -- 172.21.15.92:0/3613708972 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ec0a4ec0 con 0x55e4cd271dc0 2024-09-19T09:08:17.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.313+0000 7f10e5ffb640 1 -- 172.21.15.92:0/3613708972 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f10ec0a0150 con 0x55e4cd271dc0 2024-09-19T09:08:17.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.313+0000 7f11067ef740 1 -- 172.21.15.92:0/3613708972 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10f4036030 con 0x55e4cd271dc0 2024-09-19T09:08:17.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.313+0000 7f10e5ffb640 1 -- 172.21.15.92:0/3613708972 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f10ec0a0350 con 0x55e4cd271dc0 2024-09-19T09:08:17.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.313+0000 7f11067ef740 10 client.27325 fetch_fsmap learned FSMap version 19 2024-09-19T09:08:17.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.313+0000 7f11067ef740 1 -- 172.21.15.92:0/3613708972 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e4cd28ac50 con 0x55e4cd271dc0 2024-09-19T09:08:17.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.314+0000 7f10e5ffb640 1 -- 172.21.15.92:0/3613708972 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10ec0b5140 con 0x55e4cd271dc0 2024-09-19T09:08:17.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.314+0000 7f10e5ffb640 1 -- 172.21.15.92:0/3613708972 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f10ec09b770 con 0x55e4cd271dc0 2024-09-19T09:08:17.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.314+0000 7f11067ef740 10 client.27325 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:08:17.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.314+0000 7f11067ef740 10 client.27325 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:08:17.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.314+0000 7f11067ef740 20 client.27325 populate_metadata read hostname 'smithi092' 2024-09-19T09:08:17.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.314+0000 7f11067ef740 1 --2- 172.21.15.92:0/3613708972 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e4cd28c110 0x55e4cd28e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:17.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.314+0000 7f11067ef740 4 client.27325 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:08:17.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.314+0000 7f11067ef740 1 -- 172.21.15.92:0/3613708972 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f10f4036030 con 0x55e4cd28c110 2024-09-19T09:08:17.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.314+0000 7f11021b2640 1 --2- 172.21.15.92:0/3613708972 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e4cd28c110 0x55e4cd28e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:17.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.316+0000 7f10e5ffb640 10 client.27325 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:17.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.316+0000 7f11021b2640 1 --2- 172.21.15.92:0/3613708972 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e4cd28c110 0x55e4cd28e500 crc :-1 s=READY pgs=357 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ab6afe754d3c37a server_cookie=5c2c3519c3f50ca9 in_seq=0 out_seq=0 2024-09-19T09:08:17.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.317+0000 7f10e5ffb640 1 -- 172.21.15.92:0/3613708972 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f10f4036030 con 0x55e4cd28c110 2024-09-19T09:08:17.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.317+0000 7f10e5ffb640 10 client.27325 handle_command_reply: tid=0 2024-09-19T09:08:17.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.317+0000 7f11067ef740 1 client.27325 shutdown 2024-09-19T09:08:17.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.318+0000 7f11067ef740 1 -- 172.21.15.92:0/3613708972 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4cd271dc0 msgr2=0x55e4cd279310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:17.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.318+0000 7f11067ef740 1 --2- 172.21.15.92:0/3613708972 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4cd271dc0 0x55e4cd279310 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55e4cd26edb0 tx=0x7f10ec09c950 comp rx=0 tx=0).stop 2024-09-19T09:08:17.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.318+0000 7f11067ef740 1 -- 172.21.15.92:0/3613708972 shutdown_connections 2024-09-19T09:08:17.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.318+0000 7f11067ef740 1 --2- 172.21.15.92:0/3613708972 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e4cd28c110 0x55e4cd28e500 crc :-1 s=READY pgs=357 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.318+0000 7f11067ef740 1 --2- 172.21.15.92:0/3613708972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4cd27c680 0x55e4cd2798e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.318+0000 7f11067ef740 1 --2- 172.21.15.92:0/3613708972 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4cd271dc0 0x55e4cd279310 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.318+0000 7f10e5ffb640 0 client.27325 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:17.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.318+0000 7f11067ef740 1 --2- 172.21.15.92:0/3613708972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e4cd2714a0 0x55e4cd27c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.318+0000 7f11067ef740 1 -- 172.21.15.92:0/3613708972 >> 172.21.15.92:0/3613708972 conn(0x55e4cd26da30 msgr2=0x55e4cd273710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:17.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.318+0000 7f11067ef740 1 -- 172.21.15.92:0/3613708972 shutdown_connections 2024-09-19T09:08:17.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.318+0000 7f11067ef740 1 -- 172.21.15.92:0/3613708972 wait complete. 2024-09-19T09:08:17.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.318+0000 7f11067ef740 20 client.27325 trim_cache size 0 max 16384 2024-09-19T09:08:17.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.346+0000 7f11067ef740 1 Processor -- start 2024-09-19T09:08:17.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.346+0000 7f11067ef740 1 -- start start 2024-09-19T09:08:17.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.347+0000 7f11067ef740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4cd26da30 0x55e4cd2884b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:17.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.347+0000 7f11021b2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4cd26da30 0x55e4cd2884b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:17.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.347+0000 7f11021b2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4cd26da30 0x55e4cd2884b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50908/0 (socket says 172.21.15.92:50908) 2024-09-19T09:08:17.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.347+0000 7f11021b2640 1 -- 172.21.15.92:0/133787659 learned_addr learned my addr 172.21.15.92:0/133787659 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:17.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.347+0000 7f11067ef740 1 --2- 172.21.15.92:0/133787659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e4cd2714a0 0x55e4cd277be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:17.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.347+0000 7f11067ef740 1 --2- 172.21.15.92:0/133787659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4cd271dc0 0x55e4cd27b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:17.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.347+0000 7f11067ef740 1 -- 172.21.15.92:0/133787659 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc1b1c60 con 0x55e4cd26da30 2024-09-19T09:08:17.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.347+0000 7f11067ef740 1 -- 172.21.15.92:0/133787659 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc1b4500 con 0x55e4cd2714a0 2024-09-19T09:08:17.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.347+0000 7f11067ef740 1 -- 172.21.15.92:0/133787659 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc1b22f0 con 0x55e4cd271dc0 2024-09-19T09:08:17.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.347+0000 7f11029b3640 1 --2- 172.21.15.92:0/133787659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4cd271dc0 0x55e4cd27b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:17.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.348+0000 7f11021b2640 1 -- 172.21.15.92:0/133787659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4cd271dc0 msgr2=0x55e4cd27b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:17.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.348+0000 7f11021b2640 1 --2- 172.21.15.92:0/133787659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4cd271dc0 0x55e4cd27b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.348+0000 7f11021b2640 1 -- 172.21.15.92:0/133787659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e4cd2714a0 msgr2=0x55e4cd277be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:17.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.348+0000 7f11021b2640 1 --2- 172.21.15.92:0/133787659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e4cd2714a0 0x55e4cd277be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.348+0000 7f11021b2640 1 -- 172.21.15.92:0/133787659 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4cd2712d0 con 0x55e4cd26da30 2024-09-19T09:08:17.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.348+0000 7f11021b2640 1 --2- 172.21.15.92:0/133787659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4cd26da30 0x55e4cd2884b0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f10f8005d80 tx=0x7f10f8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f15cf2d5d5257d93 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:17.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.348+0000 7f10e7fff640 1 -- 172.21.15.92:0/133787659 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f8004020 con 0x55e4cd26da30 2024-09-19T09:08:17.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.349+0000 7f10e7fff640 1 -- 172.21.15.92:0/133787659 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10f80041c0 con 0x55e4cd26da30 2024-09-19T09:08:17.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.349+0000 7f10e7fff640 1 -- 172.21.15.92:0/133787659 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f8029650 con 0x55e4cd26da30 2024-09-19T09:08:17.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.349+0000 7f11067ef740 1 -- 172.21.15.92:0/133787659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4cd26da30 msgr2=0x55e4cd2884b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:17.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.349+0000 7f11067ef740 1 --2- 172.21.15.92:0/133787659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4cd26da30 0x55e4cd2884b0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f10f8005d80 tx=0x7f10f8016000 comp rx=0 tx=0).stop 2024-09-19T09:08:17.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.350+0000 7f11067ef740 1 -- 172.21.15.92:0/133787659 shutdown_connections 2024-09-19T09:08:17.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.350+0000 7f11067ef740 1 --2- 172.21.15.92:0/133787659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4cd271dc0 0x55e4cd27b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.350+0000 7f11067ef740 1 --2- 172.21.15.92:0/133787659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e4cd2714a0 0x55e4cd277be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.350+0000 7f11067ef740 1 --2- 172.21.15.92:0/133787659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4cd26da30 0x55e4cd2884b0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.350+0000 7f11067ef740 1 -- 172.21.15.92:0/133787659 >> 172.21.15.92:0/133787659 conn(0x55e4cd274d00 msgr2=0x55e4cd27ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:17.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.350+0000 7f11067ef740 1 -- 172.21.15.92:0/133787659 shutdown_connections 2024-09-19T09:08:17.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.350+0000 7f11067ef740 1 -- 172.21.15.92:0/133787659 wait complete. 2024-09-19T09:08:17.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.351+0000 7f11067ef740 1 -- start start 2024-09-19T09:08:17.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.351+0000 7f11067ef740 1 Processor -- start 2024-09-19T09:08:17.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.351+0000 7f11067ef740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e4cd26da30 0x55e4cd284b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:17.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.351+0000 7f11067ef740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4cd2714a0 0x55e4cd280e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:17.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.351+0000 7f11067ef740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4cd271dc0 0x55e4cd281380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:17.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.351+0000 7f11067ef740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc1b29c0 con 0x55e4cd271dc0 2024-09-19T09:08:17.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.351+0000 7f11067ef740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc1b3e30 con 0x55e4cd26da30 2024-09-19T09:08:17.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.351+0000 7f11067ef740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc1b3090 con 0x55e4cd2714a0 2024-09-19T09:08:17.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.352+0000 7f11067ef740 10 client.0 _ll_register_callbacks cb 0x7f10ec00c7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:17.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.352+0000 7f11019b1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4cd2714a0 0x55e4cd280e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:17.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.352+0000 7f11021b2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e4cd26da30 0x55e4cd284b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:17.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.352+0000 7f11019b1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4cd2714a0 0x55e4cd280e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:33900/0 (socket says 172.21.15.92:33900) 2024-09-19T09:08:17.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.352+0000 7f11019b1640 1 -- 172.21.15.92:0/824561443 learned_addr learned my addr 172.21.15.92:0/824561443 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:17.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.352+0000 7f11029b3640 1 --2- 172.21.15.92:0/824561443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4cd271dc0 0x55e4cd281380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:17.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.352+0000 7f11019b1640 1 -- 172.21.15.92:0/824561443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e4cd26da30 msgr2=0x55e4cd284b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:17.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.352+0000 7f11019b1640 1 --2- 172.21.15.92:0/824561443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e4cd26da30 0x55e4cd284b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.352+0000 7f11019b1640 1 -- 172.21.15.92:0/824561443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4cd271dc0 msgr2=0x55e4cd281380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:17.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.352+0000 7f11019b1640 1 --2- 172.21.15.92:0/824561443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4cd271dc0 0x55e4cd281380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.352+0000 7f11019b1640 1 -- 172.21.15.92:0/824561443 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4cd279ec0 con 0x55e4cd2714a0 2024-09-19T09:08:17.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.353+0000 7f11021b2640 1 --2- 172.21.15.92:0/824561443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e4cd26da30 0x55e4cd284b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:08:17.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.353+0000 7f11019b1640 1 --2- 172.21.15.92:0/824561443 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4cd2714a0 0x55e4cd280e40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f10ec098bd0 tx=0x7f10ec0b5370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6da9495d537bc642 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:17.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.353+0000 7f10e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:08:17.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.353+0000 7f10e5ffb640 1 -- 172.21.15.92:0/824561443 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ec09bd90 con 0x55e4cd2714a0 2024-09-19T09:08:17.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.353+0000 7f10e5ffb640 1 -- 172.21.15.92:0/824561443 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f10ec0bc2c0 con 0x55e4cd2714a0 2024-09-19T09:08:17.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.353+0000 7f11067ef740 1 -- 172.21.15.92:0/824561443 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10f80041c0 con 0x55e4cd2714a0 2024-09-19T09:08:17.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.353+0000 7f10e5ffb640 1 -- 172.21.15.92:0/824561443 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f10ec09c020 con 0x55e4cd2714a0 2024-09-19T09:08:17.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.353+0000 7f11067ef740 10 client.27331 fetch_fsmap learned FSMap version 19 2024-09-19T09:08:17.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.353+0000 7f11067ef740 1 -- 172.21.15.92:0/824561443 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e4cd26e6c0 con 0x55e4cd2714a0 2024-09-19T09:08:17.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.354+0000 7f10e5ffb640 1 -- 172.21.15.92:0/824561443 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10f80041c0 con 0x55e4cd2714a0 2024-09-19T09:08:17.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.354+0000 7f10e5ffb640 1 -- 172.21.15.92:0/824561443 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f10ec09b1a0 con 0x55e4cd2714a0 2024-09-19T09:08:17.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.354+0000 7f11067ef740 10 client.27331 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:08:17.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.354+0000 7f11067ef740 10 client.27331 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:08:17.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.354+0000 7f11067ef740 20 client.27331 populate_metadata read hostname 'smithi092' 2024-09-19T09:08:17.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.354+0000 7f11067ef740 1 --2- 172.21.15.92:0/824561443 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e4cd27c680 0x55e4cd2f9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:17.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.354+0000 7f11067ef740 4 client.27331 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:08:17.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.354+0000 7f11067ef740 1 -- 172.21.15.92:0/824561443 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e4cd1e4850 con 0x55e4cd27c680 2024-09-19T09:08:17.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.354+0000 7f11021b2640 1 --2- 172.21.15.92:0/824561443 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e4cd27c680 0x55e4cd2f9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:17.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.355+0000 7f11021b2640 1 --2- 172.21.15.92:0/824561443 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e4cd27c680 0x55e4cd2f9f50 crc :-1 s=READY pgs=358 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f6ae88049e25f1e server_cookie=33e1457ec5aecc3a in_seq=0 out_seq=0 2024-09-19T09:08:17.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.355+0000 7f10e5ffb640 10 client.27331 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:17.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.355+0000 7f10e5ffb640 1 -- 172.21.15.92:0/824561443 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55e4cd1e4850 con 0x55e4cd27c680 2024-09-19T09:08:17.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.355+0000 7f10e5ffb640 10 client.27331 handle_command_reply: tid=0 2024-09-19T09:08:17.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.355+0000 7f11067ef740 1 client.27331 shutdown 2024-09-19T09:08:17.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.355+0000 7f11067ef740 1 -- 172.21.15.92:0/824561443 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4cd2714a0 msgr2=0x55e4cd280e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:17.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.355+0000 7f11067ef740 1 --2- 172.21.15.92:0/824561443 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4cd2714a0 0x55e4cd280e40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f10ec098bd0 tx=0x7f10ec0b5370 comp rx=0 tx=0).stop 2024-09-19T09:08:17.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.355+0000 7f11067ef740 1 -- 172.21.15.92:0/824561443 shutdown_connections 2024-09-19T09:08:17.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.355+0000 7f11067ef740 1 --2- 172.21.15.92:0/824561443 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e4cd27c680 0x55e4cd2f9f50 crc :-1 s=READY pgs=358 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.355+0000 7f11067ef740 1 --2- 172.21.15.92:0/824561443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e4cd271dc0 0x55e4cd281380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.355+0000 7f11067ef740 1 --2- 172.21.15.92:0/824561443 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e4cd2714a0 0x55e4cd280e40 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.355+0000 7f11067ef740 1 --2- 172.21.15.92:0/824561443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e4cd26da30 0x55e4cd284b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.355+0000 7f11067ef740 1 -- 172.21.15.92:0/824561443 >> 172.21.15.92:0/824561443 conn(0x55e4cd274d00 msgr2=0x55e4cd27b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:17.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.355+0000 7f10e5ffb640 0 client.27331 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:17.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.355+0000 7f11067ef740 1 -- 172.21.15.92:0/824561443 shutdown_connections 2024-09-19T09:08:17.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.356+0000 7f11067ef740 1 -- 172.21.15.92:0/824561443 wait complete. 2024-09-19T09:08:17.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.356+0000 7f11067ef740 20 client.27331 trim_cache size 0 max 16384 2024-09-19T09:08:17.362 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:08:17.362 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:08:17.362 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": { 2024-09-19T09:08:17.362 INFO:teuthology.orchestra.run.smithi092.stdout: "7dcc2986-f58d-4845-9659-9cc38a26b562": { 2024-09-19T09:08:17.362 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-19T09:08:17.363 INFO:teuthology.orchestra.run.smithi092.stdout: "tag": "7dcc2986-f58d-4845-9659-9cc38a26b562", 2024-09-19T09:08:17.363 INFO:teuthology.orchestra.run.smithi092.stdout: "options": "recursive,force" 2024-09-19T09:08:17.363 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:08:17.363 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:08:17.363 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:08:17.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.356+0000 7f1104416640 1 -- 172.21.15.92:0/3573588860 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f10e80a32c0 msgr2=0x7f10e80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:17.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.356+0000 7f1104416640 1 --2- 172.21.15.92:0/3573588860 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f10e80a32c0 0x7f10e80a5780 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x55e4cd26e890 tx=0x7f10f8009390 comp rx=0 tx=0).stop 2024-09-19T09:08:17.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.356+0000 7f1104416640 1 -- 172.21.15.92:0/3573588860 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10fc108da0 msgr2=0x7f10fc1a4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:17.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.356+0000 7f1104416640 1 --2- 172.21.15.92:0/3573588860 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10fc108da0 0x7f10fc1a4c00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f10ec00e9c0 tx=0x7f10ec00ee80 comp rx=0 tx=0).stop 2024-09-19T09:08:17.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.357+0000 7f1104416640 1 -- 172.21.15.92:0/3573588860 shutdown_connections 2024-09-19T09:08:17.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.357+0000 7f1104416640 1 --2- 172.21.15.92:0/3573588860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10fc10d520 0x7f10fc19e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.357+0000 7f1104416640 1 --2- 172.21.15.92:0/3573588860 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10fc108da0 0x7f10fc1a4c00 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.357+0000 7f1104416640 1 --2- 172.21.15.92:0/3573588860 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f10e80a32c0 0x7f10e80a5780 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.364 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.357+0000 7f1104416640 1 --2- 172.21.15.92:0/3573588860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10fc1083f0 0x7f10fc1a46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.357+0000 7f1104416640 1 -- 172.21.15.92:0/3573588860 >> 172.21.15.92:0/3573588860 conn(0x7f10fc077af0 msgr2=0x7f10fc078dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:17.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.357+0000 7f1104416640 1 -- 172.21.15.92:0/3573588860 shutdown_connections 2024-09-19T09:08:17.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:17.357+0000 7f1104416640 1 -- 172.21.15.92:0/3573588860 wait complete. 2024-09-19T09:08:18.002 INFO:tasks.cephfs.filesystem:scrub status for tag:7dcc2986-f58d-4845-9659-9cc38a26b562 - {'path': '/', 'tag': '7dcc2986-f58d-4845-9659-9cc38a26b562', 'options': 'recursive,force'} 2024-09-19T09:08:19.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:18 smithi092 ceph-mon[31407]: pgmap v685: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 7.2 MiB/s wr, 753 op/s 2024-09-19T09:08:19.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:18 smithi167 ceph-mon[35359]: pgmap v685: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 7.2 MiB/s wr, 753 op/s 2024-09-19T09:08:19.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:18 smithi190 ceph-mon[35358]: pgmap v685: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 7.2 MiB/s wr, 753 op/s 2024-09-19T09:08:20.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:19 smithi092 ceph-mon[31407]: scrub summary: idle 2024-09-19T09:08:20.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:19 smithi167 ceph-mon[35359]: scrub summary: idle 2024-09-19T09:08:20.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:19 smithi190 ceph-mon[35358]: scrub summary: idle 2024-09-19T09:08:20.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 695.0 s, 3793.8 tps, lat 26.353 ms stddev 33.603 2024-09-19T09:08:21.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:20 smithi092 ceph-mon[31407]: pgmap v686: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 7.7 MiB/s wr, 843 op/s 2024-09-19T09:08:21.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:20 smithi167 ceph-mon[35359]: pgmap v686: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 7.7 MiB/s wr, 843 op/s 2024-09-19T09:08:21.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:20 smithi190 ceph-mon[35358]: pgmap v686: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 7.7 MiB/s wr, 843 op/s 2024-09-19T09:08:23.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:22 smithi092 ceph-mon[31407]: pgmap v687: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 7.5 MiB/s wr, 836 op/s 2024-09-19T09:08:23.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:22 smithi167 ceph-mon[35359]: pgmap v687: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 7.5 MiB/s wr, 836 op/s 2024-09-19T09:08:23.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:22 smithi190 ceph-mon[35358]: pgmap v687: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 7.5 MiB/s wr, 836 op/s 2024-09-19T09:08:24.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.262+0000 7fe1e37d6640 1 -- 172.21.15.92:0/3864274663 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1dc10e130 msgr2=0x7fe1dc110520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:24.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.262+0000 7fe1e37d6640 1 --2- 172.21.15.92:0/3864274663 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1dc10e130 0x7fe1dc110520 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe1d401acb0 tx=0x7fe1d403b900 comp rx=0 tx=0).stop 2024-09-19T09:08:24.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.263+0000 7fe1e37d6640 1 -- 172.21.15.92:0/3864274663 shutdown_connections 2024-09-19T09:08:24.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.263+0000 7fe1e37d6640 1 --2- 172.21.15.92:0/3864274663 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1dc10e130 0x7fe1dc110520 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:24.265 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.263+0000 7fe1e37d6640 1 --2- 172.21.15.92:0/3864274663 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1dc074c50 0x7fe1dc0750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:24.265 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.263+0000 7fe1e37d6640 1 --2- 172.21.15.92:0/3864274663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1dc076230 0x7fe1dc074680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:24.265 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.263+0000 7fe1e37d6640 1 -- 172.21.15.92:0/3864274663 >> 172.21.15.92:0/3864274663 conn(0x7fe1dc0fd2e0 msgr2=0x7fe1dc0ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:24.265 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.263+0000 7fe1e37d6640 1 -- 172.21.15.92:0/3864274663 shutdown_connections 2024-09-19T09:08:24.265 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.263+0000 7fe1e37d6640 1 -- 172.21.15.92:0/3864274663 wait complete. 2024-09-19T09:08:24.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.264+0000 7fe1e37d6640 1 Processor -- start 2024-09-19T09:08:24.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.264+0000 7fe1e37d6640 1 -- start start 2024-09-19T09:08:24.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.266+0000 7fe1e37d6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1dc074c50 0x7fe1dc1960f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:24.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.266+0000 7fe1e37d6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1dc076230 0x7fe1dc196630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:24.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.266+0000 7fe1e37d6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1dc10e130 0x7fe1dc19d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:24.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.266+0000 7fe1e37d6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe1dc108600 con 0x7fe1dc074c50 2024-09-19T09:08:24.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.266+0000 7fe1e37d6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe1dc108480 con 0x7fe1dc076230 2024-09-19T09:08:24.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.267+0000 7fe1e37d6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe1dc108780 con 0x7fe1dc10e130 2024-09-19T09:08:24.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.267+0000 7fe1e1572640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1dc074c50 0x7fe1dc1960f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:24.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.267+0000 7fe1e1572640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1dc074c50 0x7fe1dc1960f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35914/0 (socket says 172.21.15.92:35914) 2024-09-19T09:08:24.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.267+0000 7fe1e1572640 1 -- 172.21.15.92:0/3691426862 learned_addr learned my addr 172.21.15.92:0/3691426862 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:24.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.267+0000 7fe1e0d71640 1 --2- 172.21.15.92:0/3691426862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1dc076230 0x7fe1dc196630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:24.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.268+0000 7fe1e1d73640 1 --2- 172.21.15.92:0/3691426862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1dc10e130 0x7fe1dc19d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:24.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.268+0000 7fe1e0d71640 1 -- 172.21.15.92:0/3691426862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1dc10e130 msgr2=0x7fe1dc19d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:24.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.268+0000 7fe1e0d71640 1 --2- 172.21.15.92:0/3691426862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1dc10e130 0x7fe1dc19d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:24.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.268+0000 7fe1e0d71640 1 -- 172.21.15.92:0/3691426862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1dc074c50 msgr2=0x7fe1dc1960f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:24.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.268+0000 7fe1e0d71640 1 --2- 172.21.15.92:0/3691426862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1dc074c50 0x7fe1dc1960f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:24.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.268+0000 7fe1e0d71640 1 -- 172.21.15.92:0/3691426862 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1dc06bd40 con 0x7fe1dc076230 2024-09-19T09:08:24.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.268+0000 7fe1e0d71640 1 --2- 172.21.15.92:0/3691426862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1dc076230 0x7fe1dc196630 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe1d800d6d0 tx=0x7fe1d800db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:24.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.268+0000 7fe1d27fc640 1 -- 172.21.15.92:0/3691426862 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8017070 con 0x7fe1dc076230 2024-09-19T09:08:24.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.268+0000 7fe1e37d6640 1 -- 172.21.15.92:0/3691426862 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1dc06c030 con 0x7fe1dc076230 2024-09-19T09:08:24.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.268+0000 7fe1e37d6640 1 -- 172.21.15.92:0/3691426862 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1dc06c650 con 0x7fe1dc076230 2024-09-19T09:08:24.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.268+0000 7fe1d27fc640 1 -- 172.21.15.92:0/3691426862 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1d8009820 con 0x7fe1dc076230 2024-09-19T09:08:24.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.268+0000 7fe1d27fc640 1 -- 172.21.15.92:0/3691426862 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8004ce0 con 0x7fe1dc076230 2024-09-19T09:08:24.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.272+0000 7fe1d27fc640 1 -- 172.21.15.92:0/3691426862 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe1d8010460 con 0x7fe1dc076230 2024-09-19T09:08:24.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.273+0000 7fe1d27fc640 1 --2- 172.21.15.92:0/3691426862 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe1c80a33f0 0x7fe1c80a58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:24.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.273+0000 7fe1d27fc640 1 -- 172.21.15.92:0/3691426862 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe1d80d0250 con 0x7fe1dc076230 2024-09-19T09:08:24.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.275+0000 7fe1e1572640 1 --2- 172.21.15.92:0/3691426862 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe1c80a33f0 0x7fe1c80a58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:24.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.277+0000 7fe1e1572640 1 --2- 172.21.15.92:0/3691426862 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe1c80a33f0 0x7fe1c80a58b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc009a30 tx=0x7fe1cc009190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:24.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.277+0000 7fe1e6652740 1 Processor -- start 2024-09-19T09:08:24.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.277+0000 7fe1e6652740 1 -- start start 2024-09-19T09:08:24.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.277+0000 7fe1e6652740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca023439a0 0x55ca02343da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:24.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.277+0000 7fe1e6652740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca023442e0 0x55ca02348da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:24.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.278+0000 7fe1e6652740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca02349370 0x55ca0234b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:24.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.278+0000 7fe1e6652740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ca022a72f0 con 0x55ca023439a0 2024-09-19T09:08:24.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.278+0000 7fe1e6652740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ca0224f270 con 0x55ca02349370 2024-09-19T09:08:24.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.278+0000 7fe1e6652740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ca022a32b0 con 0x55ca023442e0 2024-09-19T09:08:24.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.278+0000 7fe1e1d73640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca02349370 0x55ca0234b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:24.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.278+0000 7fe1e1d73640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca02349370 0x55ca0234b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:54986/0 (socket says 172.21.15.92:54986) 2024-09-19T09:08:24.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.278+0000 7fe1e1d73640 1 -- 172.21.15.92:0/940564791 learned_addr learned my addr 172.21.15.92:0/940564791 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:24.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.278+0000 7fe1e1572640 1 --2- 172.21.15.92:0/940564791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca023439a0 0x55ca02343da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:24.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.278+0000 7fe1e0d71640 1 --2- 172.21.15.92:0/940564791 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca023442e0 0x55ca02348da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:24.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.278+0000 7fe1e1d73640 1 -- 172.21.15.92:0/940564791 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca023442e0 msgr2=0x55ca02348da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:24.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.278+0000 7fe1e1d73640 1 --2- 172.21.15.92:0/940564791 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca023442e0 0x55ca02348da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:24.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.279+0000 7fe1e1d73640 1 -- 172.21.15.92:0/940564791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca023439a0 msgr2=0x55ca02343da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:24.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.279+0000 7fe1e1d73640 1 --2- 172.21.15.92:0/940564791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca023439a0 0x55ca02343da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:24.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.279+0000 7fe1e1d73640 1 -- 172.21.15.92:0/940564791 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca0224e340 con 0x55ca02349370 2024-09-19T09:08:24.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.279+0000 7fe1e1d73640 1 --2- 172.21.15.92:0/940564791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca02349370 0x55ca0234b830 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe1d403be20 tx=0x7fe1d401aa30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8975a62cf049abf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:24.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.280+0000 7fe1c77fe640 1 -- 172.21.15.92:0/940564791 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d4045070 con 0x55ca02349370 2024-09-19T09:08:24.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.280+0000 7fe1c77fe640 1 -- 172.21.15.92:0/940564791 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1d4003e50 con 0x55ca02349370 2024-09-19T09:08:24.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.280+0000 7fe1c77fe640 1 -- 172.21.15.92:0/940564791 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d4004310 con 0x55ca02349370 2024-09-19T09:08:24.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.284+0000 7fe1e6652740 1 -- 172.21.15.92:0/940564791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca02349370 msgr2=0x55ca0234b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.284+0000 7fe1e6652740 1 --2- 172.21.15.92:0/940564791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca02349370 0x55ca0234b830 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe1d403be20 tx=0x7fe1d401aa30 comp rx=0 tx=0).stop 2024-09-19T09:08:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.284+0000 7fe1e6652740 1 -- 172.21.15.92:0/940564791 shutdown_connections 2024-09-19T09:08:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.284+0000 7fe1e6652740 1 --2- 172.21.15.92:0/940564791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca02349370 0x55ca0234b830 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.284+0000 7fe1e6652740 1 --2- 172.21.15.92:0/940564791 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca023442e0 0x55ca02348da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.284+0000 7fe1e6652740 1 --2- 172.21.15.92:0/940564791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca023439a0 0x55ca02343da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.284+0000 7fe1e6652740 1 -- 172.21.15.92:0/940564791 >> 172.21.15.92:0/940564791 conn(0x55ca0233f010 msgr2=0x55ca0233f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.284+0000 7fe1e6652740 1 -- 172.21.15.92:0/940564791 shutdown_connections 2024-09-19T09:08:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.284+0000 7fe1e6652740 1 -- 172.21.15.92:0/940564791 wait complete. 2024-09-19T09:08:24.286 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.286+0000 7fe1e6652740 1 -- start start 2024-09-19T09:08:24.286 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.286+0000 7fe1e6652740 1 Processor -- start 2024-09-19T09:08:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.286+0000 7fe1e6652740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca023439a0 0x55ca0234db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.287+0000 7fe1e6652740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca023442e0 0x55ca0234e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.287+0000 7fe1e6652740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca02349370 0x55ca02355110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.287+0000 7fe1e1572640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca023439a0 0x55ca0234db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.287+0000 7fe1e1572640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca023439a0 0x55ca0234db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:50626/0 (socket says 172.21.15.92:50626) 2024-09-19T09:08:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.287+0000 7fe1e0d71640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca023442e0 0x55ca0234e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.287+0000 7fe1e0d71640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca023442e0 0x55ca0234e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:54992/0 (socket says 172.21.15.92:54992) 2024-09-19T09:08:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.287+0000 7fe1e1572640 1 -- 172.21.15.92:0/318710602 learned_addr learned my addr 172.21.15.92:0/318710602 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.287+0000 7fe1e6652740 1 -- 172.21.15.92:0/318710602 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ca0234c2e0 con 0x55ca02349370 2024-09-19T09:08:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.287+0000 7fe1e6652740 1 -- 172.21.15.92:0/318710602 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ca02230290 con 0x55ca023442e0 2024-09-19T09:08:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.287+0000 7fe1e6652740 1 -- 172.21.15.92:0/318710602 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ca0234c460 con 0x55ca023439a0 2024-09-19T09:08:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.287+0000 7fe1e6652740 10 client.0 _ll_register_callbacks cb 0x55ca02261140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.288+0000 7fe1e1d73640 1 --2- 172.21.15.92:0/318710602 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca02349370 0x55ca02355110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.288+0000 7fe1e1d73640 1 -- 172.21.15.92:0/318710602 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca023439a0 msgr2=0x55ca0234db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.288+0000 7fe1e1d73640 1 --2- 172.21.15.92:0/318710602 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca023439a0 0x55ca0234db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.288+0000 7fe1e1d73640 1 -- 172.21.15.92:0/318710602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca023442e0 msgr2=0x55ca0234e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.288+0000 7fe1e1d73640 1 --2- 172.21.15.92:0/318710602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca023442e0 0x55ca0234e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.288+0000 7fe1e1d73640 1 -- 172.21.15.92:0/318710602 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca01fba210 con 0x55ca02349370 2024-09-19T09:08:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.288+0000 7fe1e1572640 1 --2- 172.21.15.92:0/318710602 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca023439a0 0x55ca0234db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:08:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.288+0000 7fe1e0d71640 1 --2- 172.21.15.92:0/318710602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca023442e0 0x55ca0234e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:08:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.288+0000 7fe1e1d73640 1 --2- 172.21.15.92:0/318710602 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca02349370 0x55ca02355110 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fe1d401a440 tx=0x7fe1d4003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c1d0a68fcb91bd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:24.291 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.288+0000 7fe1c4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:08:24.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.289+0000 7fe1c4ff9640 1 -- 172.21.15.92:0/318710602 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d4061060 con 0x55ca02349370 2024-09-19T09:08:24.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.289+0000 7fe1c4ff9640 1 -- 172.21.15.92:0/318710602 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe1d4019040 con 0x55ca02349370 2024-09-19T09:08:24.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.289+0000 7fe1e6652740 1 -- 172.21.15.92:0/318710602 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1d4003e50 con 0x55ca02349370 2024-09-19T09:08:24.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.289+0000 7fe1c4ff9640 1 -- 172.21.15.92:0/318710602 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe1d4045070 con 0x55ca02349370 2024-09-19T09:08:24.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.289+0000 7fe1e6652740 10 client.18165 fetch_fsmap learned FSMap version 19 2024-09-19T09:08:24.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.289+0000 7fe1e6652740 1 -- 172.21.15.92:0/318710602 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ca02086620 con 0x55ca02349370 2024-09-19T09:08:24.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.291+0000 7fe1c4ff9640 1 -- 172.21.15.92:0/318710602 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1d4003e50 con 0x55ca02349370 2024-09-19T09:08:24.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.291+0000 7fe1c4ff9640 1 -- 172.21.15.92:0/318710602 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe1d4051070 con 0x55ca02349370 2024-09-19T09:08:24.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.291+0000 7fe1e6652740 10 client.18165 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:08:24.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.291+0000 7fe1e6652740 10 client.18165 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:08:24.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.291+0000 7fe1e6652740 20 client.18165 populate_metadata read hostname 'smithi092' 2024-09-19T09:08:24.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.291+0000 7fe1e6652740 1 --2- 172.21.15.92:0/318710602 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ca02359410 0x55ca0235b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:24.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.291+0000 7fe1e6652740 4 client.18165 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:08:24.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.291+0000 7fe1e6652740 1 -- 172.21.15.92:0/318710602 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca022b4a20 con 0x55ca02359410 2024-09-19T09:08:24.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.292+0000 7fe1e1572640 1 --2- 172.21.15.92:0/318710602 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ca02359410 0x55ca0235b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:24.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.294+0000 7fe1e1572640 1 --2- 172.21.15.92:0/318710602 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ca02359410 0x55ca0235b800 crc :-1 s=READY pgs=359 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a38e82bd3420dae server_cookie=2a594fbef1a078f3 in_seq=0 out_seq=0 2024-09-19T09:08:24.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.294+0000 7fe1c4ff9640 10 client.18165 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:24.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.294+0000 7fe1c4ff9640 1 -- 172.21.15.92:0/318710602 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ca022b4a20 con 0x55ca02359410 2024-09-19T09:08:24.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.294+0000 7fe1c4ff9640 10 client.18165 handle_command_reply: tid=0 2024-09-19T09:08:24.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.294+0000 7fe1e6652740 1 client.18165 shutdown 2024-09-19T09:08:24.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.295+0000 7fe1e6652740 1 -- 172.21.15.92:0/318710602 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca02349370 msgr2=0x55ca02355110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:24.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.295+0000 7fe1e6652740 1 --2- 172.21.15.92:0/318710602 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca02349370 0x55ca02355110 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fe1d401a440 tx=0x7fe1d4003ba0 comp rx=0 tx=0).stop 2024-09-19T09:08:24.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.295+0000 7fe1e6652740 1 -- 172.21.15.92:0/318710602 shutdown_connections 2024-09-19T09:08:24.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.295+0000 7fe1e6652740 1 --2- 172.21.15.92:0/318710602 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ca02359410 0x55ca0235b800 crc :-1 s=READY pgs=359 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:24.297 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.295+0000 7fe1e6652740 1 --2- 172.21.15.92:0/318710602 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca02349370 0x55ca02355110 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:24.297 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.295+0000 7fe1e6652740 1 --2- 172.21.15.92:0/318710602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca023442e0 0x55ca0234e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:24.297 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.295+0000 7fe1e6652740 1 --2- 172.21.15.92:0/318710602 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca023439a0 0x55ca0234db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:24.297 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.295+0000 7fe1e6652740 1 -- 172.21.15.92:0/318710602 >> 172.21.15.92:0/318710602 conn(0x55ca0233f010 msgr2=0x55ca02340820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:24.297 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.295+0000 7fe1c4ff9640 0 client.18165 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:24.297 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.295+0000 7fe1e6652740 1 -- 172.21.15.92:0/318710602 shutdown_connections 2024-09-19T09:08:24.297 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.295+0000 7fe1e6652740 1 -- 172.21.15.92:0/318710602 wait complete. 2024-09-19T09:08:24.297 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.296+0000 7fe1e6652740 20 client.18165 trim_cache size 0 max 16384 2024-09-19T09:08:24.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.316+0000 7fe1e6652740 1 Processor -- start 2024-09-19T09:08:24.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.316+0000 7fe1e6652740 1 -- start start 2024-09-19T09:08:24.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.317+0000 7fe1e6652740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca023439a0 0x55ca02345480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:24.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.317+0000 7fe1e6652740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca023442e0 0x55ca023550d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:24.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.317+0000 7fe1e6652740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca02349370 0x55ca02341400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:24.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.317+0000 7fe1e1572640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca023439a0 0x55ca02345480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:24.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.317+0000 7fe1e6652740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c000c5b0 con 0x55ca02349370 2024-09-19T09:08:24.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.317+0000 7fe1e1572640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca023439a0 0x55ca02345480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:50628/0 (socket says 172.21.15.92:50628) 2024-09-19T09:08:24.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.317+0000 7fe1e1572640 1 -- 172.21.15.92:0/2911080909 learned_addr learned my addr 172.21.15.92:0/2911080909 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:24.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.317+0000 7fe1e0d71640 1 --2- 172.21.15.92:0/2911080909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca023442e0 0x55ca023550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:24.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.317+0000 7fe1e6652740 1 -- 172.21.15.92:0/2911080909 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c000ee50 con 0x55ca023442e0 2024-09-19T09:08:24.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.317+0000 7fe1e6652740 1 -- 172.21.15.92:0/2911080909 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c000cc40 con 0x55ca023439a0 2024-09-19T09:08:24.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.317+0000 7fe1e1d73640 1 --2- 172.21.15.92:0/2911080909 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca02349370 0x55ca02341400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:24.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.317+0000 7fe1e0d71640 1 -- 172.21.15.92:0/2911080909 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca023439a0 msgr2=0x55ca02345480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:24.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.317+0000 7fe1e0d71640 1 --2- 172.21.15.92:0/2911080909 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca023439a0 0x55ca02345480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:24.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.317+0000 7fe1e0d71640 1 -- 172.21.15.92:0/2911080909 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca02349370 msgr2=0x55ca02341400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:24.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.317+0000 7fe1e0d71640 1 --2- 172.21.15.92:0/2911080909 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca02349370 0x55ca02341400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:24.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.317+0000 7fe1e0d71640 1 -- 172.21.15.92:0/2911080909 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca0233a2d0 con 0x55ca023442e0 2024-09-19T09:08:24.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.318+0000 7fe1e0d71640 1 --2- 172.21.15.92:0/2911080909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca023442e0 0x55ca023550d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe1d80cdce0 tx=0x7fe1d809c210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b035813c50bfb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:24.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.318+0000 7fe1c6ffd640 1 -- 172.21.15.92:0/2911080909 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d80b5070 con 0x55ca023442e0 2024-09-19T09:08:24.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.318+0000 7fe1c6ffd640 1 -- 172.21.15.92:0/2911080909 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1d80a0be0 con 0x55ca023442e0 2024-09-19T09:08:24.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.318+0000 7fe1c6ffd640 1 -- 172.21.15.92:0/2911080909 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8020040 con 0x55ca023442e0 2024-09-19T09:08:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.318+0000 7fe1e6652740 1 -- 172.21.15.92:0/2911080909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca023442e0 msgr2=0x55ca023550d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.318+0000 7fe1e6652740 1 --2- 172.21.15.92:0/2911080909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca023442e0 0x55ca023550d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe1d80cdce0 tx=0x7fe1d809c210 comp rx=0 tx=0).stop 2024-09-19T09:08:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.318+0000 7fe1e6652740 1 -- 172.21.15.92:0/2911080909 shutdown_connections 2024-09-19T09:08:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.318+0000 7fe1e6652740 1 --2- 172.21.15.92:0/2911080909 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca02349370 0x55ca02341400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.318+0000 7fe1e6652740 1 --2- 172.21.15.92:0/2911080909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca023442e0 0x55ca023550d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.318+0000 7fe1e6652740 1 --2- 172.21.15.92:0/2911080909 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca023439a0 0x55ca02345480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.318+0000 7fe1e6652740 1 -- 172.21.15.92:0/2911080909 >> 172.21.15.92:0/2911080909 conn(0x55ca0233f010 msgr2=0x55ca0234d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.318+0000 7fe1e6652740 1 -- 172.21.15.92:0/2911080909 shutdown_connections 2024-09-19T09:08:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.319+0000 7fe1e6652740 1 -- 172.21.15.92:0/2911080909 wait complete. 2024-09-19T09:08:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.319+0000 7fe1e6652740 1 -- start start 2024-09-19T09:08:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.319+0000 7fe1e6652740 1 Processor -- start 2024-09-19T09:08:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.319+0000 7fe1e6652740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca023439a0 0x55ca02351dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.319+0000 7fe1e6652740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca023442e0 0x55ca02352310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.319+0000 7fe1e6652740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca02349370 0x55ca023c1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.319+0000 7fe1e6652740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c000d310 con 0x55ca02349370 2024-09-19T09:08:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.319+0000 7fe1e6652740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c000e780 con 0x55ca023442e0 2024-09-19T09:08:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.319+0000 7fe1e6652740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c000d9e0 con 0x55ca023439a0 2024-09-19T09:08:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.319+0000 7fe1e6652740 10 client.0 _ll_register_callbacks cb 0x7fe1d4005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.319+0000 7fe1e1572640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca023439a0 0x55ca02351dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.319+0000 7fe1e0d71640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca023442e0 0x55ca02352310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.319+0000 7fe1e0d71640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca023442e0 0x55ca02352310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:55008/0 (socket says 172.21.15.92:55008) 2024-09-19T09:08:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.319+0000 7fe1e1572640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca023439a0 0x55ca02351dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:50636/0 (socket says 172.21.15.92:50636) 2024-09-19T09:08:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.319+0000 7fe1e0d71640 1 -- 172.21.15.92:0/4013854519 learned_addr learned my addr 172.21.15.92:0/4013854519 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.319+0000 7fe1e1d73640 1 --2- 172.21.15.92:0/4013854519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca02349370 0x55ca023c1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.320+0000 7fe1e1572640 1 -- 172.21.15.92:0/4013854519 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca023442e0 msgr2=0x55ca02352310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.320+0000 7fe1e1572640 1 --2- 172.21.15.92:0/4013854519 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca023442e0 0x55ca02352310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.320+0000 7fe1e1572640 1 -- 172.21.15.92:0/4013854519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca02349370 msgr2=0x55ca023c1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.320+0000 7fe1e1572640 1 --2- 172.21.15.92:0/4013854519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca02349370 0x55ca023c1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.320+0000 7fe1e1572640 1 -- 172.21.15.92:0/4013854519 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca02352980 con 0x55ca023439a0 2024-09-19T09:08:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.320+0000 7fe1e1d73640 1 --2- 172.21.15.92:0/4013854519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca02349370 0x55ca023c1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:08:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.320+0000 7fe1e1572640 1 --2- 172.21.15.92:0/4013854519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca023439a0 0x55ca02351dd0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc00e5a0 tx=0x7fe1cc004700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4288363aef5a16e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.321+0000 7fe1c4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:08:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.321+0000 7fe1c4ff9640 1 -- 172.21.15.92:0/4013854519 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc00ed60 con 0x55ca023439a0 2024-09-19T09:08:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.321+0000 7fe1c4ff9640 1 -- 172.21.15.92:0/4013854519 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe1cc00f040 con 0x55ca023439a0 2024-09-19T09:08:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.321+0000 7fe1e6652740 1 -- 172.21.15.92:0/4013854519 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1d80a0be0 con 0x55ca023439a0 2024-09-19T09:08:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.321+0000 7fe1c4ff9640 1 -- 172.21.15.92:0/4013854519 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe1cc022930 con 0x55ca023439a0 2024-09-19T09:08:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.321+0000 7fe1e6652740 10 client.27343 fetch_fsmap learned FSMap version 19 2024-09-19T09:08:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.321+0000 7fe1e6652740 1 -- 172.21.15.92:0/4013854519 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ca023c3620 con 0x55ca023439a0 2024-09-19T09:08:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.322+0000 7fe1c4ff9640 1 -- 172.21.15.92:0/4013854519 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1cc022d20 con 0x55ca023439a0 2024-09-19T09:08:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.322+0000 7fe1c4ff9640 1 -- 172.21.15.92:0/4013854519 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe1d4040450 con 0x55ca023439a0 2024-09-19T09:08:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.322+0000 7fe1e6652740 10 client.27343 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:08:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.322+0000 7fe1e6652740 10 client.27343 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:08:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.322+0000 7fe1e6652740 20 client.27343 populate_metadata read hostname 'smithi092' 2024-09-19T09:08:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.322+0000 7fe1e6652740 1 --2- 172.21.15.92:0/4013854519 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ca023c3f90 0x55ca023c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.322+0000 7fe1e6652740 4 client.27343 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:08:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.322+0000 7fe1e6652740 1 -- 172.21.15.92:0/4013854519 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fe1d80a0be0 con 0x55ca023c3f90 2024-09-19T09:08:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.322+0000 7fe1e0d71640 1 --2- 172.21.15.92:0/4013854519 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ca023c3f90 0x55ca023c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.322+0000 7fe1c4ff9640 10 client.27343 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.322+0000 7fe1e0d71640 1 --2- 172.21.15.92:0/4013854519 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ca023c3f90 0x55ca023c63b0 crc :-1 s=READY pgs=360 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb0f2171d080d49d server_cookie=9895a6f8afb7e2a in_seq=0 out_seq=0 2024-09-19T09:08:24.344 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.342+0000 7fe1c4ff9640 1 -- 172.21.15.92:0/4013854519 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fe1d80a0be0 con 0x55ca023c3f90 2024-09-19T09:08:24.344 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.343+0000 7fe1c4ff9640 10 client.27343 handle_command_reply: tid=0 2024-09-19T09:08:24.344 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.343+0000 7fe1e6652740 1 client.27343 shutdown 2024-09-19T09:08:24.344 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.343+0000 7fe1e6652740 1 -- 172.21.15.92:0/4013854519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca023439a0 msgr2=0x55ca02351dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:24.344 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.343+0000 7fe1e6652740 1 --2- 172.21.15.92:0/4013854519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca023439a0 0x55ca02351dd0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc00e5a0 tx=0x7fe1cc004700 comp rx=0 tx=0).stop 2024-09-19T09:08:24.344 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.343+0000 7fe1e6652740 1 -- 172.21.15.92:0/4013854519 shutdown_connections 2024-09-19T09:08:24.344 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.343+0000 7fe1e6652740 1 --2- 172.21.15.92:0/4013854519 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ca023c3f90 0x55ca023c63b0 crc :-1 s=READY pgs=360 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:24.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.343+0000 7fe1e6652740 1 --2- 172.21.15.92:0/4013854519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca02349370 0x55ca023c1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:24.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.343+0000 7fe1e6652740 1 --2- 172.21.15.92:0/4013854519 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ca023442e0 0x55ca02352310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:24.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.343+0000 7fe1e6652740 1 --2- 172.21.15.92:0/4013854519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ca023439a0 0x55ca02351dd0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:24.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.343+0000 7fe1e6652740 1 -- 172.21.15.92:0/4013854519 >> 172.21.15.92:0/4013854519 conn(0x55ca0233f010 msgr2=0x55ca0234c860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:24.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.343+0000 7fe1c4ff9640 0 client.27343 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:24.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.343+0000 7fe1e6652740 1 -- 172.21.15.92:0/4013854519 shutdown_connections 2024-09-19T09:08:24.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.343+0000 7fe1e6652740 1 -- 172.21.15.92:0/4013854519 wait complete. 2024-09-19T09:08:24.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.343+0000 7fe1e6652740 20 client.27343 trim_cache size 0 max 16384 2024-09-19T09:08:24.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:08:24.346 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:08:24.346 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:08:24.346 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:08:24.347 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.344+0000 7fe1e37d6640 1 -- 172.21.15.92:0/3691426862 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe1c80a33f0 msgr2=0x7fe1c80a58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:24.347 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.344+0000 7fe1e37d6640 1 --2- 172.21.15.92:0/3691426862 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe1c80a33f0 0x7fe1c80a58b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc009a30 tx=0x7fe1cc009190 comp rx=0 tx=0).stop 2024-09-19T09:08:24.347 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.344+0000 7fe1e37d6640 1 -- 172.21.15.92:0/3691426862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1dc076230 msgr2=0x7fe1dc196630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:24.347 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.344+0000 7fe1e37d6640 1 --2- 172.21.15.92:0/3691426862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1dc076230 0x7fe1dc196630 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe1d800d6d0 tx=0x7fe1d800db90 comp rx=0 tx=0).stop 2024-09-19T09:08:24.347 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.344+0000 7fe1e37d6640 1 -- 172.21.15.92:0/3691426862 shutdown_connections 2024-09-19T09:08:24.347 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.344+0000 7fe1e37d6640 1 --2- 172.21.15.92:0/3691426862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1dc10e130 0x7fe1dc19d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:24.347 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.344+0000 7fe1e37d6640 1 --2- 172.21.15.92:0/3691426862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1dc076230 0x7fe1dc196630 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:24.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.344+0000 7fe1e37d6640 1 --2- 172.21.15.92:0/3691426862 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe1c80a33f0 0x7fe1c80a58b0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:24.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.344+0000 7fe1e37d6640 1 --2- 172.21.15.92:0/3691426862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1dc074c50 0x7fe1dc1960f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:24.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.344+0000 7fe1e37d6640 1 -- 172.21.15.92:0/3691426862 >> 172.21.15.92:0/3691426862 conn(0x7fe1dc0fd2e0 msgr2=0x7fe1dc1014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:24.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.344+0000 7fe1e37d6640 1 -- 172.21.15.92:0/3691426862 shutdown_connections 2024-09-19T09:08:24.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:24.344+0000 7fe1e37d6640 1 -- 172.21.15.92:0/3691426862 wait complete. 2024-09-19T09:08:25.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:24 smithi092 ceph-mon[31407]: pgmap v688: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 6.6 MiB/s wr, 771 op/s 2024-09-19T09:08:25.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:24 smithi167 ceph-mon[35359]: pgmap v688: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 6.6 MiB/s wr, 771 op/s 2024-09-19T09:08:25.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:24 smithi190 ceph-mon[35358]: pgmap v688: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 6.6 MiB/s wr, 771 op/s 2024-09-19T09:08:25.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 700.0 s, 2644.2 tps, lat 37.686 ms stddev 41.089 2024-09-19T09:08:27.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:26 smithi092 ceph-mon[31407]: pgmap v689: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 7.8 MiB/s wr, 858 op/s 2024-09-19T09:08:27.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:26 smithi167 ceph-mon[35359]: pgmap v689: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 7.8 MiB/s wr, 858 op/s 2024-09-19T09:08:27.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:26 smithi190 ceph-mon[35358]: pgmap v689: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 7.8 MiB/s wr, 858 op/s 2024-09-19T09:08:29.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:28 smithi092 ceph-mon[31407]: pgmap v690: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 7.2 MiB/s wr, 781 op/s 2024-09-19T09:08:29.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:28 smithi167 ceph-mon[35359]: pgmap v690: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 7.2 MiB/s wr, 781 op/s 2024-09-19T09:08:29.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:28 smithi190 ceph-mon[35358]: pgmap v690: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 7.2 MiB/s wr, 781 op/s 2024-09-19T09:08:30.795 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 705.0 s, 3537.6 tps, lat 28.298 ms stddev 32.447 2024-09-19T09:08:31.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:30 smithi092 ceph-mon[31407]: pgmap v691: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 6.6 MiB/s wr, 730 op/s 2024-09-19T09:08:31.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:30 smithi167 ceph-mon[35359]: pgmap v691: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 6.6 MiB/s wr, 730 op/s 2024-09-19T09:08:31.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:30 smithi190 ceph-mon[35358]: pgmap v691: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 6.6 MiB/s wr, 730 op/s 2024-09-19T09:08:33.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:32 smithi092 ceph-mon[31407]: pgmap v692: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 7.1 MiB/s wr, 721 op/s 2024-09-19T09:08:33.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:32 smithi167 ceph-mon[35359]: pgmap v692: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 7.1 MiB/s wr, 721 op/s 2024-09-19T09:08:33.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:32 smithi190 ceph-mon[35358]: pgmap v692: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 7.1 MiB/s wr, 721 op/s 2024-09-19T09:08:35.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:34 smithi092 ceph-mon[31407]: pgmap v693: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.1 MiB/s wr, 765 op/s 2024-09-19T09:08:35.105 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:34 smithi167 ceph-mon[35359]: pgmap v693: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.1 MiB/s wr, 765 op/s 2024-09-19T09:08:35.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:34 smithi190 ceph-mon[35358]: pgmap v693: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.1 MiB/s wr, 765 op/s 2024-09-19T09:08:35.795 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 710.0 s, 2722.6 tps, lat 36.532 ms stddev 43.032 2024-09-19T09:08:36.926 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:36 smithi190 ceph-mon[35358]: pgmap v694: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 7.9 MiB/s wr, 754 op/s 2024-09-19T09:08:37.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:36 smithi092 ceph-mon[31407]: pgmap v694: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 7.9 MiB/s wr, 754 op/s 2024-09-19T09:08:37.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:36 smithi167 ceph-mon[35359]: pgmap v694: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 7.9 MiB/s wr, 754 op/s 2024-09-19T09:08:37.463 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.463+0000 7ff2b3494640 1 -- 172.21.15.92:0/2200420683 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2ac103710 msgr2=0x7ff2ac109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:37.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.463+0000 7ff2b3494640 1 --2- 172.21.15.92:0/2200420683 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2ac103710 0x7ff2ac109fa0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4009ca0 tx=0x7ff2a402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:08:37.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.463+0000 7ff2b3494640 1 -- 172.21.15.92:0/2200420683 shutdown_connections 2024-09-19T09:08:37.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.463+0000 7ff2b3494640 1 --2- 172.21.15.92:0/2200420683 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2ac103710 0x7ff2ac109fa0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:37.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.463+0000 7ff2b3494640 1 --2- 172.21.15.92:0/2200420683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2ac102d50 0x7ff2ac1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:37.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.463+0000 7ff2b3494640 1 --2- 172.21.15.92:0/2200420683 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2ac101b60 0x7ff2ac101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:37.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.463+0000 7ff2b3494640 1 -- 172.21.15.92:0/2200420683 >> 172.21.15.92:0/2200420683 conn(0x7ff2ac0fd2c0 msgr2=0x7ff2ac0ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:37.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.463+0000 7ff2b3494640 1 -- 172.21.15.92:0/2200420683 shutdown_connections 2024-09-19T09:08:37.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.463+0000 7ff2b3494640 1 -- 172.21.15.92:0/2200420683 wait complete. 2024-09-19T09:08:37.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.464+0000 7ff2b3494640 1 Processor -- start 2024-09-19T09:08:37.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.464+0000 7ff2b3494640 1 -- start start 2024-09-19T09:08:37.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.464+0000 7ff2b3494640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2ac101b60 0x7ff2ac19e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:37.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.464+0000 7ff2b3494640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2ac102d50 0x7ff2ac19e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:37.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.464+0000 7ff2b3494640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2ac103710 0x7ff2ac1a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:37.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.464+0000 7ff2b3494640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ac10b660 con 0x7ff2ac103710 2024-09-19T09:08:37.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.464+0000 7ff2b3494640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ac10b4e0 con 0x7ff2ac102d50 2024-09-19T09:08:37.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.464+0000 7ff2b3494640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ac10b7e0 con 0x7ff2ac101b60 2024-09-19T09:08:37.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.464+0000 7ff2b1230640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2ac101b60 0x7ff2ac19e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:37.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.464+0000 7ff2b1230640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2ac101b60 0x7ff2ac19e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:32782/0 (socket says 172.21.15.92:32782) 2024-09-19T09:08:37.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.464+0000 7ff2b1230640 1 -- 172.21.15.92:0/1881225975 learned_addr learned my addr 172.21.15.92:0/1881225975 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:37.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.464+0000 7ff2b1a31640 1 --2- 172.21.15.92:0/1881225975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2ac103710 0x7ff2ac1a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:37.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.464+0000 7ff2b0a2f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2ac102d50 0x7ff2ac19e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:37.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.465+0000 7ff2b1a31640 1 -- 172.21.15.92:0/1881225975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2ac101b60 msgr2=0x7ff2ac19e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:37.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.465+0000 7ff2b1a31640 1 --2- 172.21.15.92:0/1881225975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2ac101b60 0x7ff2ac19e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:37.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.465+0000 7ff2b1a31640 1 -- 172.21.15.92:0/1881225975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2ac102d50 msgr2=0x7ff2ac19e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:37.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.465+0000 7ff2b1a31640 1 --2- 172.21.15.92:0/1881225975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2ac102d50 0x7ff2ac19e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:37.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.465+0000 7ff2b1a31640 1 -- 172.21.15.92:0/1881225975 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2ac1a5e00 con 0x7ff2ac103710 2024-09-19T09:08:37.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.465+0000 7ff2b0a2f640 1 --2- 172.21.15.92:0/1881225975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2ac102d50 0x7ff2ac19e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:08:37.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.465+0000 7ff2b1a31640 1 --2- 172.21.15.92:0/1881225975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2ac103710 0x7ff2ac1a5790 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7ff2a402aeb0 tx=0x7ff2a4003ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:37.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.465+0000 7ff2a27fc640 1 -- 172.21.15.92:0/1881225975 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a4031810 con 0x7ff2ac103710 2024-09-19T09:08:37.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.465+0000 7ff2a27fc640 1 -- 172.21.15.92:0/1881225975 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2a40319b0 con 0x7ff2ac103710 2024-09-19T09:08:37.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.465+0000 7ff2a27fc640 1 -- 172.21.15.92:0/1881225975 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a402fc80 con 0x7ff2ac103710 2024-09-19T09:08:37.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.465+0000 7ff2b3494640 1 -- 172.21.15.92:0/1881225975 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2ac1a6090 con 0x7ff2ac103710 2024-09-19T09:08:37.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.465+0000 7ff2b3494640 1 -- 172.21.15.92:0/1881225975 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2ac1a6560 con 0x7ff2ac103710 2024-09-19T09:08:37.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.468+0000 7ff2a27fc640 1 -- 172.21.15.92:0/1881225975 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff2a4004040 con 0x7ff2ac103710 2024-09-19T09:08:37.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.469+0000 7ff2a27fc640 1 --2- 172.21.15.92:0/1881225975 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff2980a32f0 0x7ff2980a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:37.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.469+0000 7ff2b6230740 1 Processor -- start 2024-09-19T09:08:37.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.469+0000 7ff2b6230740 1 -- start start 2024-09-19T09:08:37.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.469+0000 7ff2a27fc640 1 -- 172.21.15.92:0/1881225975 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff2a40f0cc0 con 0x7ff2ac103710 2024-09-19T09:08:37.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.469+0000 7ff2b1230640 1 --2- 172.21.15.92:0/1881225975 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff2980a32f0 0x7ff2980a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:37.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.469+0000 7ff2b6230740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5639057b19a0 0x5639057b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:37.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.469+0000 7ff2b6230740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639057b22e0 0x5639057b6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:37.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.469+0000 7ff2b6230740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5639057b7370 0x5639057b9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:37.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.469+0000 7ff2b0a2f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639057b22e0 0x5639057b6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:37.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.469+0000 7ff2b0a2f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639057b22e0 0x5639057b6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46226/0 (socket says 172.21.15.92:46226) 2024-09-19T09:08:37.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.469+0000 7ff2b0a2f640 1 -- 172.21.15.92:0/1754072094 learned_addr learned my addr 172.21.15.92:0/1754072094 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:37.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.469+0000 7ff2b6230740 1 -- 172.21.15.92:0/1754072094 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5639057152f0 con 0x5639057b22e0 2024-09-19T09:08:37.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.470+0000 7ff2b6230740 1 -- 172.21.15.92:0/1754072094 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5639056bd270 con 0x5639057b19a0 2024-09-19T09:08:37.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.469+0000 7ff2b1230640 1 --2- 172.21.15.92:0/1754072094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5639057b19a0 0x5639057b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:37.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.470+0000 7ff2b6230740 1 -- 172.21.15.92:0/1754072094 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5639057112b0 con 0x5639057b7370 2024-09-19T09:08:37.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.470+0000 7ff2b1a31640 1 --2- 172.21.15.92:0/1754072094 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5639057b7370 0x5639057b9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:37.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.470+0000 7ff2b1230640 1 --2- 172.21.15.92:0/1881225975 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff2980a32f0 0x7ff2980a57b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff2a80058c0 tx=0x7ff2a800f040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:37.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.470+0000 7ff2b1a31640 1 -- 172.21.15.92:0/1754072094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5639057b19a0 msgr2=0x5639057b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:37.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.470+0000 7ff2b1a31640 1 --2- 172.21.15.92:0/1754072094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5639057b19a0 0x5639057b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:37.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.470+0000 7ff2b1a31640 1 -- 172.21.15.92:0/1754072094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639057b22e0 msgr2=0x5639057b6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:37.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.470+0000 7ff2b1a31640 1 --2- 172.21.15.92:0/1754072094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639057b22e0 0x5639057b6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:37.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.470+0000 7ff2b1a31640 1 -- 172.21.15.92:0/1754072094 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639056bc340 con 0x5639057b7370 2024-09-19T09:08:37.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.470+0000 7ff2b1230640 1 --2- 172.21.15.92:0/1754072094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5639057b19a0 0x5639057b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:08:37.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.470+0000 7ff2b1a31640 1 --2- 172.21.15.92:0/1754072094 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5639057b7370 0x5639057b9830 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4009bf0 tx=0x7ff2a402a8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a924e6c546c43ea2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:37.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.471+0000 7ff2977fe640 1 -- 172.21.15.92:0/1754072094 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a40d6070 con 0x5639057b7370 2024-09-19T09:08:37.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.471+0000 7ff2977fe640 1 -- 172.21.15.92:0/1754072094 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2a4036040 con 0x5639057b7370 2024-09-19T09:08:37.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.471+0000 7ff2977fe640 1 -- 172.21.15.92:0/1754072094 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a40bb3f0 con 0x5639057b7370 2024-09-19T09:08:37.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.472+0000 7ff2b6230740 1 -- 172.21.15.92:0/1754072094 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5639057b7370 msgr2=0x5639057b9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:37.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.472+0000 7ff2b6230740 1 --2- 172.21.15.92:0/1754072094 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5639057b7370 0x5639057b9830 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4009bf0 tx=0x7ff2a402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:08:37.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.473+0000 7ff2b6230740 1 -- 172.21.15.92:0/1754072094 shutdown_connections 2024-09-19T09:08:37.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.473+0000 7ff2b6230740 1 --2- 172.21.15.92:0/1754072094 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5639057b7370 0x5639057b9830 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:37.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.473+0000 7ff2b6230740 1 --2- 172.21.15.92:0/1754072094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639057b22e0 0x5639057b6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:37.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.473+0000 7ff2b6230740 1 --2- 172.21.15.92:0/1754072094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5639057b19a0 0x5639057b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:37.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.473+0000 7ff2b6230740 1 -- 172.21.15.92:0/1754072094 >> 172.21.15.92:0/1754072094 conn(0x5639057ad010 msgr2=0x5639057ad410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:37.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.473+0000 7ff2b6230740 1 -- 172.21.15.92:0/1754072094 shutdown_connections 2024-09-19T09:08:37.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.473+0000 7ff2b6230740 1 -- 172.21.15.92:0/1754072094 wait complete. 2024-09-19T09:08:37.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.474+0000 7ff2b6230740 1 -- start start 2024-09-19T09:08:37.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.474+0000 7ff2b6230740 1 Processor -- start 2024-09-19T09:08:37.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.474+0000 7ff2b6230740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5639057b19a0 0x5639057bb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:37.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.474+0000 7ff2b6230740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639057b22e0 0x5639057bbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:37.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.474+0000 7ff2b6230740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5639057b7370 0x5639057c2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:37.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.474+0000 7ff2b6230740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5639057112b0 con 0x5639057b22e0 2024-09-19T09:08:37.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.474+0000 7ff2b6230740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56390569e290 con 0x5639057b7370 2024-09-19T09:08:37.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.474+0000 7ff2b6230740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5639057ba100 con 0x5639057b19a0 2024-09-19T09:08:37.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.474+0000 7ff2b1230640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5639057b19a0 0x5639057bb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:37.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.474+0000 7ff2b0a2f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639057b22e0 0x5639057bbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:37.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.474+0000 7ff2b1230640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5639057b19a0 0x5639057bb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:32792/0 (socket says 172.21.15.92:32792) 2024-09-19T09:08:37.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.475+0000 7ff2b1230640 1 -- 172.21.15.92:0/395423447 learned_addr learned my addr 172.21.15.92:0/395423447 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:37.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.475+0000 7ff2b1a31640 1 --2- 172.21.15.92:0/395423447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5639057b7370 0x5639057c2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:37.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.475+0000 7ff2b6230740 10 client.0 _ll_register_callbacks cb 0x5639056cf140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:37.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.475+0000 7ff2b1230640 1 -- 172.21.15.92:0/395423447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5639057b7370 msgr2=0x5639057c2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:37.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.475+0000 7ff2b1230640 1 --2- 172.21.15.92:0/395423447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5639057b7370 0x5639057c2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:37.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.475+0000 7ff2b1230640 1 -- 172.21.15.92:0/395423447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639057b22e0 msgr2=0x5639057bbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:37.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.475+0000 7ff2b1230640 1 --2- 172.21.15.92:0/395423447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639057b22e0 0x5639057bbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:37.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.475+0000 7ff2b1230640 1 -- 172.21.15.92:0/395423447 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563905428210 con 0x5639057b19a0 2024-09-19T09:08:37.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.475+0000 7ff2b1a31640 1 --2- 172.21.15.92:0/395423447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5639057b7370 0x5639057c2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:08:37.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.475+0000 7ff2b1230640 1 --2- 172.21.15.92:0/395423447 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5639057b19a0 0x5639057bb830 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8019b80 tx=0x7ff2a80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cba368777bd7590 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:37.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.475+0000 7ff294ff9640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:08:37.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.475+0000 7ff294ff9640 1 -- 172.21.15.92:0/395423447 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a801f040 con 0x5639057b19a0 2024-09-19T09:08:37.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.475+0000 7ff294ff9640 1 -- 172.21.15.92:0/395423447 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff2a8009040 con 0x5639057b19a0 2024-09-19T09:08:37.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.475+0000 7ff2b6230740 1 -- 172.21.15.92:0/395423447 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2a4036040 con 0x5639057b19a0 2024-09-19T09:08:37.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.475+0000 7ff294ff9640 1 -- 172.21.15.92:0/395423447 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff2a80040f0 con 0x5639057b19a0 2024-09-19T09:08:37.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.475+0000 7ff2b6230740 10 client.27355 fetch_fsmap learned FSMap version 19 2024-09-19T09:08:37.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.476+0000 7ff2b6230740 1 -- 172.21.15.92:0/395423447 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5639054f4620 con 0x5639057b19a0 2024-09-19T09:08:37.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.476+0000 7ff294ff9640 1 -- 172.21.15.92:0/395423447 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2a8018e00 con 0x5639057b19a0 2024-09-19T09:08:37.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.476+0000 7ff294ff9640 1 -- 172.21.15.92:0/395423447 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff2a802d020 con 0x5639057b19a0 2024-09-19T09:08:37.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.476+0000 7ff2b6230740 10 client.27355 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:08:37.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.476+0000 7ff2b6230740 10 client.27355 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:08:37.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.476+0000 7ff2b6230740 20 client.27355 populate_metadata read hostname 'smithi092' 2024-09-19T09:08:37.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.476+0000 7ff2b6230740 1 --2- 172.21.15.92:0/395423447 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5639057c7560 0x5639057c9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:37.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.476+0000 7ff2b6230740 4 client.27355 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:08:37.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.476+0000 7ff2b6230740 1 -- 172.21.15.92:0/395423447 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff2a4036040 con 0x5639057c7560 2024-09-19T09:08:37.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.476+0000 7ff2b0a2f640 1 --2- 172.21.15.92:0/395423447 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5639057c7560 0x5639057c9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:37.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.477+0000 7ff2b0a2f640 1 --2- 172.21.15.92:0/395423447 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5639057c7560 0x5639057c9970 crc :-1 s=READY pgs=361 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=815a21a38346b3fd server_cookie=5beaa92926668761 in_seq=0 out_seq=0 2024-09-19T09:08:37.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.477+0000 7ff294ff9640 10 client.27355 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:37.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.477+0000 7ff294ff9640 1 -- 172.21.15.92:0/395423447 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7ff2a4036040 con 0x5639057c7560 2024-09-19T09:08:37.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.477+0000 7ff294ff9640 10 client.27355 handle_command_reply: tid=0 2024-09-19T09:08:37.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.477+0000 7ff2b6230740 1 client.27355 shutdown 2024-09-19T09:08:37.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.478+0000 7ff2b6230740 1 -- 172.21.15.92:0/395423447 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5639057b19a0 msgr2=0x5639057bb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:37.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.478+0000 7ff2b6230740 1 --2- 172.21.15.92:0/395423447 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5639057b19a0 0x5639057bb830 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8019b80 tx=0x7ff2a80046c0 comp rx=0 tx=0).stop 2024-09-19T09:08:37.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.478+0000 7ff2b6230740 1 -- 172.21.15.92:0/395423447 shutdown_connections 2024-09-19T09:08:37.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.478+0000 7ff2b6230740 1 --2- 172.21.15.92:0/395423447 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5639057c7560 0x5639057c9970 crc :-1 s=READY pgs=361 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:37.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.478+0000 7ff2b6230740 1 --2- 172.21.15.92:0/395423447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5639057b7370 0x5639057c2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:37.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.478+0000 7ff294ff9640 0 client.27355 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:37.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.478+0000 7ff2b6230740 1 --2- 172.21.15.92:0/395423447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639057b22e0 0x5639057bbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:37.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.478+0000 7ff2b6230740 1 --2- 172.21.15.92:0/395423447 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5639057b19a0 0x5639057bb830 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:37.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.478+0000 7ff2b6230740 1 -- 172.21.15.92:0/395423447 >> 172.21.15.92:0/395423447 conn(0x5639057ad010 msgr2=0x5639057ae820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:37.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.479+0000 7ff2b6230740 1 -- 172.21.15.92:0/395423447 shutdown_connections 2024-09-19T09:08:37.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.479+0000 7ff2b6230740 1 -- 172.21.15.92:0/395423447 wait complete. 2024-09-19T09:08:37.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.479+0000 7ff2b6230740 20 client.27355 trim_cache size 0 max 16384 2024-09-19T09:08:37.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.497+0000 7ff2b6230740 1 Processor -- start 2024-09-19T09:08:37.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.498+0000 7ff2b6230740 1 -- start start 2024-09-19T09:08:37.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.498+0000 7ff2b6230740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5639057b19a0 0x5639057b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:37.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.498+0000 7ff2b6230740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5639057b22e0 0x5639057c2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:37.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.498+0000 7ff2b6230740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639057b7370 0x5639057ac0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:37.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.498+0000 7ff2b6230740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ac1ad600 con 0x5639057b7370 2024-09-19T09:08:37.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.498+0000 7ff2b6230740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ac1afea0 con 0x5639057b22e0 2024-09-19T09:08:37.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.498+0000 7ff2b6230740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ac1adc90 con 0x5639057b19a0 2024-09-19T09:08:37.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.498+0000 7ff2b1230640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5639057b19a0 0x5639057b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:37.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.498+0000 7ff2b1230640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5639057b19a0 0x5639057b1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:32800/0 (socket says 172.21.15.92:32800) 2024-09-19T09:08:37.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.498+0000 7ff2b1230640 1 -- 172.21.15.92:0/587246038 learned_addr learned my addr 172.21.15.92:0/587246038 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:37.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.498+0000 7ff2b1a31640 1 --2- 172.21.15.92:0/587246038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639057b7370 0x5639057ac0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:37.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.498+0000 7ff2b0a2f640 1 --2- 172.21.15.92:0/587246038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5639057b22e0 0x5639057c2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:37.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.498+0000 7ff2b1230640 1 -- 172.21.15.92:0/587246038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5639057b22e0 msgr2=0x5639057c2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:37.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.498+0000 7ff2b1230640 1 --2- 172.21.15.92:0/587246038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5639057b22e0 0x5639057c2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:37.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.498+0000 7ff2b1230640 1 -- 172.21.15.92:0/587246038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639057b7370 msgr2=0x5639057ac0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:37.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.498+0000 7ff2b1230640 1 --2- 172.21.15.92:0/587246038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639057b7370 0x5639057ac0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:37.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.498+0000 7ff2b1230640 1 -- 172.21.15.92:0/587246038 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639057ace30 con 0x5639057b19a0 2024-09-19T09:08:37.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.499+0000 7ff2b1a31640 1 --2- 172.21.15.92:0/587246038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639057b7370 0x5639057ac0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:08:37.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.499+0000 7ff2b1230640 1 --2- 172.21.15.92:0/587246038 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5639057b19a0 0x5639057b1d80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8005750 tx=0x7ff2a8005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=888cedad965ed443 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:37.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.499+0000 7ff296ffd640 1 -- 172.21.15.92:0/587246038 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a803d070 con 0x5639057b19a0 2024-09-19T09:08:37.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.499+0000 7ff296ffd640 1 -- 172.21.15.92:0/587246038 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2a8004290 con 0x5639057b19a0 2024-09-19T09:08:37.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.499+0000 7ff296ffd640 1 -- 172.21.15.92:0/587246038 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a801f070 con 0x5639057b19a0 2024-09-19T09:08:37.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.500+0000 7ff2b6230740 1 -- 172.21.15.92:0/587246038 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5639057b19a0 msgr2=0x5639057b1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:37.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.500+0000 7ff2b6230740 1 --2- 172.21.15.92:0/587246038 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5639057b19a0 0x5639057b1d80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8005750 tx=0x7ff2a8005fd0 comp rx=0 tx=0).stop 2024-09-19T09:08:37.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.500+0000 7ff2b6230740 1 -- 172.21.15.92:0/587246038 shutdown_connections 2024-09-19T09:08:37.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.500+0000 7ff2b6230740 1 --2- 172.21.15.92:0/587246038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639057b7370 0x5639057ac0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:37.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.500+0000 7ff2b6230740 1 --2- 172.21.15.92:0/587246038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5639057b22e0 0x5639057c2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:37.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.500+0000 7ff2b6230740 1 --2- 172.21.15.92:0/587246038 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5639057b19a0 0x5639057b1d80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:37.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.500+0000 7ff2b6230740 1 -- 172.21.15.92:0/587246038 >> 172.21.15.92:0/587246038 conn(0x5639057ad010 msgr2=0x5639057ab9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:37.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.500+0000 7ff2b6230740 1 -- 172.21.15.92:0/587246038 shutdown_connections 2024-09-19T09:08:37.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.500+0000 7ff2b6230740 1 -- 172.21.15.92:0/587246038 wait complete. 2024-09-19T09:08:37.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.501+0000 7ff2b6230740 1 -- start start 2024-09-19T09:08:37.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.501+0000 7ff2b6230740 1 Processor -- start 2024-09-19T09:08:37.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.501+0000 7ff2b6230740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5639057b19a0 0x5639057bfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:37.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.501+0000 7ff2b6230740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639057b22e0 0x5639057c02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:37.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.501+0000 7ff2b6230740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5639057b7370 0x5639057c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:37.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.501+0000 7ff2b6230740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ac1ae360 con 0x5639057b22e0 2024-09-19T09:08:37.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.501+0000 7ff2b6230740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ac1af7d0 con 0x5639057b7370 2024-09-19T09:08:37.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.501+0000 7ff2b6230740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ac1aea30 con 0x5639057b19a0 2024-09-19T09:08:37.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.501+0000 7ff2b6230740 10 client.0 _ll_register_callbacks cb 0x7ff2a800cd60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:37.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.501+0000 7ff2b1a31640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5639057b7370 0x5639057c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:37.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.501+0000 7ff2b1230640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5639057b19a0 0x5639057bfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:37.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.501+0000 7ff2b0a2f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639057b22e0 0x5639057c02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:37.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.501+0000 7ff2b1a31640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5639057b7370 0x5639057c12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:45652/0 (socket says 172.21.15.92:45652) 2024-09-19T09:08:37.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.502+0000 7ff2b1a31640 1 -- 172.21.15.92:0/2661883469 learned_addr learned my addr 172.21.15.92:0/2661883469 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:37.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.501+0000 7ff2b1230640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5639057b19a0 0x5639057bfd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:32802/0 (socket says 172.21.15.92:32802) 2024-09-19T09:08:37.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.502+0000 7ff2b1a31640 1 -- 172.21.15.92:0/2661883469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5639057b19a0 msgr2=0x5639057bfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:37.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.502+0000 7ff2b1a31640 1 --2- 172.21.15.92:0/2661883469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5639057b19a0 0x5639057bfd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:37.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.502+0000 7ff2b1a31640 1 -- 172.21.15.92:0/2661883469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639057b22e0 msgr2=0x5639057c02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:37.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.502+0000 7ff2b1a31640 1 --2- 172.21.15.92:0/2661883469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639057b22e0 0x5639057c02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:37.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.502+0000 7ff2b1a31640 1 -- 172.21.15.92:0/2661883469 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639057c18c0 con 0x5639057b7370 2024-09-19T09:08:37.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.502+0000 7ff2b1a31640 1 --2- 172.21.15.92:0/2661883469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5639057b7370 0x5639057c12b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff2a40b9cb0 tx=0x7ff2a40bdb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14b8732c60416745 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:37.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.502+0000 7ff294ff9640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:08:37.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.502+0000 7ff294ff9640 1 -- 172.21.15.92:0/2661883469 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a40d6040 con 0x5639057b7370 2024-09-19T09:08:37.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.502+0000 7ff294ff9640 1 -- 172.21.15.92:0/2661883469 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff2a402fe20 con 0x5639057b7370 2024-09-19T09:08:37.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.502+0000 7ff2b6230740 1 -- 172.21.15.92:0/2661883469 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2a8004290 con 0x5639057b7370 2024-09-19T09:08:37.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.502+0000 7ff294ff9640 1 -- 172.21.15.92:0/2661883469 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff2a40bd2e0 con 0x5639057b7370 2024-09-19T09:08:37.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.502+0000 7ff2b6230740 10 client.27470 fetch_fsmap learned FSMap version 19 2024-09-19T09:08:37.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.503+0000 7ff2b6230740 1 -- 172.21.15.92:0/2661883469 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5639057c2c40 con 0x5639057b7370 2024-09-19T09:08:37.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.503+0000 7ff294ff9640 1 -- 172.21.15.92:0/2661883469 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2a40a0070 con 0x5639057b7370 2024-09-19T09:08:37.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.503+0000 7ff294ff9640 1 -- 172.21.15.92:0/2661883469 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff2a403f140 con 0x5639057b7370 2024-09-19T09:08:37.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.503+0000 7ff2b6230740 10 client.27470 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:08:37.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.503+0000 7ff2b6230740 10 client.27470 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:08:37.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.503+0000 7ff2b6230740 20 client.27470 populate_metadata read hostname 'smithi092' 2024-09-19T09:08:37.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.503+0000 7ff2b6230740 1 --2- 172.21.15.92:0/2661883469 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5639057c7560 0x563905834550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:37.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.503+0000 7ff2b6230740 4 client.27470 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:08:37.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.503+0000 7ff2b6230740 1 -- 172.21.15.92:0/2661883469 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563905722a20 con 0x5639057c7560 2024-09-19T09:08:37.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.503+0000 7ff2b1230640 1 --2- 172.21.15.92:0/2661883469 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5639057c7560 0x563905834550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:37.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.504+0000 7ff294ff9640 10 client.27470 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:37.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.504+0000 7ff2b1230640 1 --2- 172.21.15.92:0/2661883469 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5639057c7560 0x563905834550 crc :-1 s=READY pgs=362 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc8e9041f50a47ae server_cookie=971f04590e333348 in_seq=0 out_seq=0 2024-09-19T09:08:37.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.519+0000 7ff294ff9640 1 -- 172.21.15.92:0/2661883469 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563905722a20 con 0x5639057c7560 2024-09-19T09:08:37.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.519+0000 7ff294ff9640 10 client.27470 handle_command_reply: tid=0 2024-09-19T09:08:37.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.519+0000 7ff2b6230740 1 client.27470 shutdown 2024-09-19T09:08:37.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.519+0000 7ff2b6230740 1 -- 172.21.15.92:0/2661883469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5639057b7370 msgr2=0x5639057c12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:37.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.519+0000 7ff2b6230740 1 --2- 172.21.15.92:0/2661883469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5639057b7370 0x5639057c12b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff2a40b9cb0 tx=0x7ff2a40bdb10 comp rx=0 tx=0).stop 2024-09-19T09:08:37.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.519+0000 7ff2b6230740 1 -- 172.21.15.92:0/2661883469 shutdown_connections 2024-09-19T09:08:37.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.519+0000 7ff2b6230740 1 --2- 172.21.15.92:0/2661883469 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5639057c7560 0x563905834550 crc :-1 s=READY pgs=362 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:37.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.519+0000 7ff294ff9640 0 client.27470 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:37.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.519+0000 7ff2b6230740 1 --2- 172.21.15.92:0/2661883469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5639057b7370 0x5639057c12b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:37.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.519+0000 7ff2b6230740 1 --2- 172.21.15.92:0/2661883469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639057b22e0 0x5639057c02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:37.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.519+0000 7ff2b6230740 1 --2- 172.21.15.92:0/2661883469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5639057b19a0 0x5639057bfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:37.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.519+0000 7ff2b6230740 1 -- 172.21.15.92:0/2661883469 >> 172.21.15.92:0/2661883469 conn(0x5639057ad010 msgr2=0x5639057ac1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:37.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.519+0000 7ff2b6230740 1 -- 172.21.15.92:0/2661883469 shutdown_connections 2024-09-19T09:08:37.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.519+0000 7ff2b6230740 1 -- 172.21.15.92:0/2661883469 wait complete. 2024-09-19T09:08:37.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.520+0000 7ff2b6230740 20 client.27470 trim_cache size 0 max 16384 2024-09-19T09:08:37.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:08:37.522 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:08:37.522 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:08:37.522 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:08:37.523 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.522+0000 7ff2b3494640 1 -- 172.21.15.92:0/1881225975 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff2980a32f0 msgr2=0x7ff2980a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:37.523 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.522+0000 7ff2b3494640 1 --2- 172.21.15.92:0/1881225975 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff2980a32f0 0x7ff2980a57b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff2a80058c0 tx=0x7ff2a800f040 comp rx=0 tx=0).stop 2024-09-19T09:08:37.523 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.522+0000 7ff2b3494640 1 -- 172.21.15.92:0/1881225975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2ac103710 msgr2=0x7ff2ac1a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:37.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.522+0000 7ff2b3494640 1 --2- 172.21.15.92:0/1881225975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2ac103710 0x7ff2ac1a5790 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7ff2a402aeb0 tx=0x7ff2a4003ef0 comp rx=0 tx=0).stop 2024-09-19T09:08:37.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.523+0000 7ff2b3494640 1 -- 172.21.15.92:0/1881225975 shutdown_connections 2024-09-19T09:08:37.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.523+0000 7ff2b3494640 1 --2- 172.21.15.92:0/1881225975 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff2980a32f0 0x7ff2980a57b0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:37.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.523+0000 7ff2b3494640 1 --2- 172.21.15.92:0/1881225975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2ac103710 0x7ff2ac1a5790 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:37.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.523+0000 7ff2b3494640 1 --2- 172.21.15.92:0/1881225975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2ac102d50 0x7ff2ac19e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:37.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.523+0000 7ff2b3494640 1 --2- 172.21.15.92:0/1881225975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2ac101b60 0x7ff2ac19e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:37.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.523+0000 7ff2b3494640 1 -- 172.21.15.92:0/1881225975 >> 172.21.15.92:0/1881225975 conn(0x7ff2ac0fd2c0 msgr2=0x7ff2ac0ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:37.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.523+0000 7ff2b3494640 1 -- 172.21.15.92:0/1881225975 shutdown_connections 2024-09-19T09:08:37.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:37.523+0000 7ff2b3494640 1 -- 172.21.15.92:0/1881225975 wait complete. 2024-09-19T09:08:39.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:38 smithi092 ceph-mon[31407]: pgmap v695: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 7.0 MiB/s wr, 653 op/s 2024-09-19T09:08:39.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:38 smithi167 ceph-mon[35359]: pgmap v695: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 7.0 MiB/s wr, 653 op/s 2024-09-19T09:08:39.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:38 smithi190 ceph-mon[35358]: pgmap v695: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 7.0 MiB/s wr, 653 op/s 2024-09-19T09:08:40.795 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 715.0 s, 2122.0 tps, lat 47.216 ms stddev 53.759 2024-09-19T09:08:41.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:40 smithi092 ceph-mon[31407]: pgmap v696: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 8.1 MiB/s wr, 737 op/s 2024-09-19T09:08:41.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:40 smithi167 ceph-mon[35359]: pgmap v696: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 8.1 MiB/s wr, 737 op/s 2024-09-19T09:08:41.130 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:40 smithi190 ceph-mon[35358]: pgmap v696: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 8.1 MiB/s wr, 737 op/s 2024-09-19T09:08:43.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:42 smithi092 ceph-mon[31407]: pgmap v697: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.9 MiB/s wr, 784 op/s 2024-09-19T09:08:43.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:42 smithi167 ceph-mon[35359]: pgmap v697: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.9 MiB/s wr, 784 op/s 2024-09-19T09:08:43.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:42 smithi190 ceph-mon[35358]: pgmap v697: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.9 MiB/s wr, 784 op/s 2024-09-19T09:08:45.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:44 smithi092 ceph-mon[31407]: pgmap v698: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 7.9 MiB/s wr, 716 op/s 2024-09-19T09:08:45.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:44 smithi167 ceph-mon[35359]: pgmap v698: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 7.9 MiB/s wr, 716 op/s 2024-09-19T09:08:45.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:44 smithi190 ceph-mon[35358]: pgmap v698: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 7.9 MiB/s wr, 716 op/s 2024-09-19T09:08:45.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 720.0 s, 3086.2 tps, lat 32.586 ms stddev 36.907 2024-09-19T09:08:47.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:46 smithi092 ceph-mon[31407]: pgmap v699: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 6.6 MiB/s wr, 652 op/s 2024-09-19T09:08:47.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:46 smithi167 ceph-mon[35359]: pgmap v699: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 6.6 MiB/s wr, 652 op/s 2024-09-19T09:08:47.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:46 smithi190 ceph-mon[35358]: pgmap v699: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 6.6 MiB/s wr, 652 op/s 2024-09-19T09:08:48.004 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:08:48.421 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:08:48.827 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:48 smithi092 ceph-mon[31407]: pgmap v700: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 8.1 MiB/s wr, 742 op/s 2024-09-19T09:08:48.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.941+0000 7fe8526f0640 1 -- 172.21.15.92:0/733474267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe84c1021b0 msgr2=0x7fe84c1056f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:48.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.941+0000 7fe8526f0640 1 --2- 172.21.15.92:0/733474267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe84c1021b0 0x7fe84c1056f0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fe840009930 tx=0x7fe84002a420 comp rx=0 tx=0).stop 2024-09-19T09:08:48.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.941+0000 7fe8526f0640 1 -- 172.21.15.92:0/733474267 shutdown_connections 2024-09-19T09:08:48.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.941+0000 7fe8526f0640 1 --2- 172.21.15.92:0/733474267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe84c105e00 0x7fe84c10d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:48.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.941+0000 7fe8526f0640 1 --2- 172.21.15.92:0/733474267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe84c1021b0 0x7fe84c1056f0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:48.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.941+0000 7fe8526f0640 1 --2- 172.21.15.92:0/733474267 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe84c101800 0x7fe84c101be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:48.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.941+0000 7fe8526f0640 1 -- 172.21.15.92:0/733474267 >> 172.21.15.92:0/733474267 conn(0x7fe84c0fba90 msgr2=0x7fe84c0fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:48.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.941+0000 7fe8526f0640 1 -- 172.21.15.92:0/733474267 shutdown_connections 2024-09-19T09:08:48.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.941+0000 7fe8526f0640 1 -- 172.21.15.92:0/733474267 wait complete. 2024-09-19T09:08:48.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.942+0000 7fe8526f0640 1 Processor -- start 2024-09-19T09:08:48.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.942+0000 7fe8526f0640 1 -- start start 2024-09-19T09:08:48.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.942+0000 7fe8526f0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe84c101800 0x7fe84c1a47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:48.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.942+0000 7fe8526f0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe84c1021b0 0x7fe84c1a4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:48.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.942+0000 7fe8526f0640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe84c105e00 0x7fe84c19eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:48.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.942+0000 7fe8526f0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe84c110e50 con 0x7fe84c101800 2024-09-19T09:08:48.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.942+0000 7fe8526f0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe84c110cd0 con 0x7fe84c1021b0 2024-09-19T09:08:48.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.942+0000 7fe8526f0640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe84c110fd0 con 0x7fe84c105e00 2024-09-19T09:08:48.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.942+0000 7fe84bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe84c101800 0x7fe84c1a47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:48.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.942+0000 7fe84b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe84c1021b0 0x7fe84c1a4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:48.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.943+0000 7fe84b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe84c1021b0 0x7fe84c1a4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:47818/0 (socket says 172.21.15.92:47818) 2024-09-19T09:08:48.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.943+0000 7fe84b7fe640 1 -- 172.21.15.92:0/177587250 learned_addr learned my addr 172.21.15.92:0/177587250 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:48.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.943+0000 7fe84b7fe640 1 -- 172.21.15.92:0/177587250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe84c105e00 msgr2=0x7fe84c19eaf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:08:48.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.943+0000 7fe84b7fe640 1 --2- 172.21.15.92:0/177587250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe84c105e00 0x7fe84c19eaf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:48.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.943+0000 7fe84b7fe640 1 -- 172.21.15.92:0/177587250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe84c101800 msgr2=0x7fe84c1a47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:48.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.944+0000 7fe84b7fe640 1 --2- 172.21.15.92:0/177587250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe84c101800 0x7fe84c1a47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:48.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.944+0000 7fe84b7fe640 1 -- 172.21.15.92:0/177587250 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe84c19f320 con 0x7fe84c1021b0 2024-09-19T09:08:48.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.944+0000 7fe84bfff640 1 --2- 172.21.15.92:0/177587250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe84c101800 0x7fe84c1a47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:08:48.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.944+0000 7fe84b7fe640 1 --2- 172.21.15.92:0/177587250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe84c1021b0 0x7fe84c1a4d00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe840005940 tx=0x7fe8400042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:48.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.945+0000 7fe8497fa640 1 -- 172.21.15.92:0/177587250 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe84003f030 con 0x7fe84c1021b0 2024-09-19T09:08:48.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.945+0000 7fe8526f0640 1 -- 172.21.15.92:0/177587250 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe84c19f5b0 con 0x7fe84c1021b0 2024-09-19T09:08:48.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.945+0000 7fe8497fa640 1 -- 172.21.15.92:0/177587250 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe840003ce0 con 0x7fe84c1021b0 2024-09-19T09:08:48.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.945+0000 7fe8526f0640 1 -- 172.21.15.92:0/177587250 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe84c1ab5b0 con 0x7fe84c1021b0 2024-09-19T09:08:48.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.945+0000 7fe8497fa640 1 -- 172.21.15.92:0/177587250 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe840035070 con 0x7fe84c1021b0 2024-09-19T09:08:48.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.948+0000 7fe8497fa640 1 -- 172.21.15.92:0/177587250 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe840042030 con 0x7fe84c1021b0 2024-09-19T09:08:48.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.948+0000 7fe854ac9740 1 Processor -- start 2024-09-19T09:08:48.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.948+0000 7fe854ac9740 1 -- start start 2024-09-19T09:08:48.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.949+0000 7fe854ac9740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632285264a0 0x563228526880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:48.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.949+0000 7fe854ac9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563228526dc0 0x563228531140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:48.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.949+0000 7fe854ac9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563228531680 0x563228533a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:48.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.949+0000 7fe854ac9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56322848c2e0 con 0x563228526dc0 2024-09-19T09:08:48.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.949+0000 7fe854ac9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563228433ce0 con 0x563228531680 2024-09-19T09:08:48.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.949+0000 7fe854ac9740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5632284882a0 con 0x5632285264a0 2024-09-19T09:08:48.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.949+0000 7fe850c8d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632285264a0 0x563228526880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:48.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.949+0000 7fe850c8d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632285264a0 0x563228526880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:55222/0 (socket says 172.21.15.92:55222) 2024-09-19T09:08:48.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.949+0000 7fe850c8d640 1 -- 172.21.15.92:0/397085257 learned_addr learned my addr 172.21.15.92:0/397085257 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:48.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.949+0000 7fe84b7fe640 1 --2- 172.21.15.92:0/397085257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563228531680 0x563228533a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:48.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.949+0000 7fe84bfff640 1 --2- 172.21.15.92:0/397085257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563228526dc0 0x563228531140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:48.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.950+0000 7fe84b7fe640 1 -- 172.21.15.92:0/397085257 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632285264a0 msgr2=0x563228526880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:48.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.950+0000 7fe84b7fe640 1 --2- 172.21.15.92:0/397085257 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632285264a0 0x563228526880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:48.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.950+0000 7fe84b7fe640 1 -- 172.21.15.92:0/397085257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563228526dc0 msgr2=0x563228531140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:48.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.950+0000 7fe84b7fe640 1 --2- 172.21.15.92:0/397085257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563228526dc0 0x563228531140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:48.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.950+0000 7fe84b7fe640 1 -- 172.21.15.92:0/397085257 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563228418440 con 0x563228531680 2024-09-19T09:08:48.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.950+0000 7fe84bfff640 1 --2- 172.21.15.92:0/397085257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563228526dc0 0x563228531140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:08:48.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.951+0000 7fe84b7fe640 1 --2- 172.21.15.92:0/397085257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563228531680 0x563228533a70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe8400ed960 tx=0x7fe8400f81a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6661b50197e1d57 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:48.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.951+0000 7fe8327fc640 1 -- 172.21.15.92:0/397085257 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8400f8d50 con 0x563228531680 2024-09-19T09:08:48.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.951+0000 7fe8497fa640 1 --2- 172.21.15.92:0/177587250 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe8340a32c0 0x7fe8340a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:48.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.951+0000 7fe8327fc640 1 -- 172.21.15.92:0/397085257 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8400fd070 con 0x563228531680 2024-09-19T09:08:48.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.952+0000 7fe8327fc640 1 -- 172.21.15.92:0/397085257 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe840100730 con 0x563228531680 2024-09-19T09:08:48.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.952+0000 7fe850c8d640 1 --2- 172.21.15.92:0/177587250 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe8340a32c0 0x7fe8340a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:48.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.952+0000 7fe8497fa640 1 -- 172.21.15.92:0/177587250 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe8400eff00 con 0x7fe84c1021b0 2024-09-19T09:08:48.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.953+0000 7fe854ac9740 1 -- 172.21.15.92:0/397085257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563228531680 msgr2=0x563228533a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:48.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.953+0000 7fe854ac9740 1 --2- 172.21.15.92:0/397085257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563228531680 0x563228533a70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe8400ed960 tx=0x7fe8400f81a0 comp rx=0 tx=0).stop 2024-09-19T09:08:48.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.953+0000 7fe850c8d640 1 --2- 172.21.15.92:0/177587250 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe8340a32c0 0x7fe8340a5780 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fe844005c40 tx=0x7fe844009460 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:48.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.953+0000 7fe854ac9740 1 -- 172.21.15.92:0/397085257 shutdown_connections 2024-09-19T09:08:48.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.953+0000 7fe854ac9740 1 --2- 172.21.15.92:0/397085257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563228531680 0x563228533a70 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:48.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.953+0000 7fe854ac9740 1 --2- 172.21.15.92:0/397085257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563228526dc0 0x563228531140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:48.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.953+0000 7fe854ac9740 1 --2- 172.21.15.92:0/397085257 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632285264a0 0x563228526880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:48.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.953+0000 7fe854ac9740 1 -- 172.21.15.92:0/397085257 >> 172.21.15.92:0/397085257 conn(0x563228522a30 msgr2=0x563228522e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:48.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.953+0000 7fe854ac9740 1 -- 172.21.15.92:0/397085257 shutdown_connections 2024-09-19T09:08:48.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.953+0000 7fe854ac9740 1 -- 172.21.15.92:0/397085257 wait complete. 2024-09-19T09:08:48.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.954+0000 7fe854ac9740 1 -- start start 2024-09-19T09:08:48.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.954+0000 7fe854ac9740 1 Processor -- start 2024-09-19T09:08:48.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.954+0000 7fe854ac9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632285264a0 0x563228530ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:48.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.954+0000 7fe854ac9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563228526dc0 0x56322852e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:48.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.954+0000 7fe854ac9740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563228531680 0x56322852e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:48.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.955+0000 7fe854ac9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563228534010 con 0x5632285264a0 2024-09-19T09:08:48.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.955+0000 7fe854ac9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563228447050 con 0x563228526dc0 2024-09-19T09:08:48.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.955+0000 7fe854ac9740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x563228534190 con 0x563228531680 2024-09-19T09:08:48.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.955+0000 7fe854ac9740 10 client.0 _ll_register_callbacks cb 0x563228487160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:48.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.955+0000 7fe84bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632285264a0 0x563228530ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:48.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.955+0000 7fe850c8d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563228531680 0x56322852e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:48.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.955+0000 7fe850c8d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563228531680 0x56322852e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:55226/0 (socket says 172.21.15.92:55226) 2024-09-19T09:08:48.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.955+0000 7fe850c8d640 1 -- 172.21.15.92:0/92711012 learned_addr learned my addr 172.21.15.92:0/92711012 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:48.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.955+0000 7fe84b7fe640 1 --2- 172.21.15.92:0/92711012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563228526dc0 0x56322852e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:48.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.956+0000 7fe850c8d640 1 -- 172.21.15.92:0/92711012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563228526dc0 msgr2=0x56322852e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:48.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.956+0000 7fe850c8d640 1 --2- 172.21.15.92:0/92711012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563228526dc0 0x56322852e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:48.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.956+0000 7fe850c8d640 1 -- 172.21.15.92:0/92711012 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632285264a0 msgr2=0x563228530ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:48.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.956+0000 7fe850c8d640 1 --2- 172.21.15.92:0/92711012 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632285264a0 0x563228530ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:48.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.956+0000 7fe850c8d640 1 -- 172.21.15.92:0/92711012 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632281fd3c0 con 0x563228531680 2024-09-19T09:08:48.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.956+0000 7fe850c8d640 1 --2- 172.21.15.92:0/92711012 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563228531680 0x56322852e800 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe8440126d0 tx=0x7fe844004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c57c9fa1dbbf0a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:48.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.956+0000 7fe82b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:08:48.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.956+0000 7fe82b7fe640 1 -- 172.21.15.92:0/92711012 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe844023070 con 0x563228531680 2024-09-19T09:08:48.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.957+0000 7fe854ac9740 1 -- 172.21.15.92:0/92711012 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8400fd070 con 0x563228531680 2024-09-19T09:08:48.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.957+0000 7fe82b7fe640 1 -- 172.21.15.92:0/92711012 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe844011930 con 0x563228531680 2024-09-19T09:08:48.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.957+0000 7fe82b7fe640 1 -- 172.21.15.92:0/92711012 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe84402f050 con 0x563228531680 2024-09-19T09:08:48.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.957+0000 7fe854ac9740 10 client.27370 fetch_fsmap learned FSMap version 19 2024-09-19T09:08:48.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.957+0000 7fe854ac9740 1 -- 172.21.15.92:0/92711012 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56322853fa00 con 0x563228531680 2024-09-19T09:08:48.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.957+0000 7fe82b7fe640 1 -- 172.21.15.92:0/92711012 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8400fd070 con 0x563228531680 2024-09-19T09:08:48.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.958+0000 7fe82b7fe640 1 -- 172.21.15.92:0/92711012 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe84400f040 con 0x563228531680 2024-09-19T09:08:48.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.958+0000 7fe854ac9740 10 client.27370 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:08:48.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.958+0000 7fe854ac9740 10 client.27370 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:08:48.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.958+0000 7fe854ac9740 20 client.27370 populate_metadata read hostname 'smithi092' 2024-09-19T09:08:48.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.958+0000 7fe854ac9740 1 --2- 172.21.15.92:0/92711012 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5632285411f0 0x563228543640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:48.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.958+0000 7fe854ac9740 4 client.27370 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:08:48.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.958+0000 7fe854ac9740 1 -- 172.21.15.92:0/92711012 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563228499850 con 0x5632285411f0 2024-09-19T09:08:48.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.958+0000 7fe84bfff640 1 --2- 172.21.15.92:0/92711012 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5632285411f0 0x563228543640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:48.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.959+0000 7fe84bfff640 1 --2- 172.21.15.92:0/92711012 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5632285411f0 0x563228543640 crc :-1 s=READY pgs=363 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9b5a8a183d01e74 server_cookie=308876175be0de60 in_seq=0 out_seq=0 2024-09-19T09:08:48.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.959+0000 7fe82b7fe640 10 client.27370 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:48.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.959+0000 7fe82b7fe640 1 -- 172.21.15.92:0/92711012 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563228499850 con 0x5632285411f0 2024-09-19T09:08:48.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.959+0000 7fe82b7fe640 10 client.27370 handle_command_reply: tid=0 2024-09-19T09:08:48.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.960+0000 7fe854ac9740 1 client.27370 shutdown 2024-09-19T09:08:48.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.960+0000 7fe854ac9740 1 -- 172.21.15.92:0/92711012 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563228531680 msgr2=0x56322852e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:48.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.960+0000 7fe854ac9740 1 --2- 172.21.15.92:0/92711012 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563228531680 0x56322852e800 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe8440126d0 tx=0x7fe844004a40 comp rx=0 tx=0).stop 2024-09-19T09:08:48.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.961+0000 7fe854ac9740 1 -- 172.21.15.92:0/92711012 shutdown_connections 2024-09-19T09:08:48.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.961+0000 7fe854ac9740 1 --2- 172.21.15.92:0/92711012 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5632285411f0 0x563228543640 crc :-1 s=READY pgs=363 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:48.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.961+0000 7fe854ac9740 1 --2- 172.21.15.92:0/92711012 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563228531680 0x56322852e800 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:48.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.961+0000 7fe854ac9740 1 --2- 172.21.15.92:0/92711012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563228526dc0 0x56322852e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:48.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.961+0000 7fe854ac9740 1 --2- 172.21.15.92:0/92711012 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632285264a0 0x563228530ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:48.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.961+0000 7fe854ac9740 1 -- 172.21.15.92:0/92711012 >> 172.21.15.92:0/92711012 conn(0x563228522a30 msgr2=0x563228528760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:48.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.961+0000 7fe82b7fe640 0 client.27370 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:48.963 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.961+0000 7fe854ac9740 1 -- 172.21.15.92:0/92711012 shutdown_connections 2024-09-19T09:08:48.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.961+0000 7fe854ac9740 1 -- 172.21.15.92:0/92711012 wait complete. 2024-09-19T09:08:48.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.961+0000 7fe854ac9740 20 client.27370 trim_cache size 0 max 16384 2024-09-19T09:08:48.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.988+0000 7fe854ac9740 1 Processor -- start 2024-09-19T09:08:48.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.988+0000 7fe854ac9740 1 -- start start 2024-09-19T09:08:48.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.988+0000 7fe854ac9740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632285264a0 0x56322853cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:48.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.988+0000 7fe854ac9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563228526dc0 0x563228548f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:48.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.988+0000 7fe854ac9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563228531680 0x563228549490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:48.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.988+0000 7fe854ac9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe84c1b1ca0 con 0x563228531680 2024-09-19T09:08:48.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.988+0000 7fe854ac9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe84c1b4540 con 0x563228526dc0 2024-09-19T09:08:48.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.988+0000 7fe854ac9740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe84c1b2330 con 0x5632285264a0 2024-09-19T09:08:49.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.993+0000 7fe850c8d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563228531680 0x563228549490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:49.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.993+0000 7fe850c8d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563228531680 0x563228549490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34330/0 (socket says 172.21.15.92:34330) 2024-09-19T09:08:49.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.993+0000 7fe850c8d640 1 -- 172.21.15.92:0/2872650810 learned_addr learned my addr 172.21.15.92:0/2872650810 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:49.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.995+0000 7fe84b7fe640 1 --2- 172.21.15.92:0/2872650810 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563228526dc0 0x563228548f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:49.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.996+0000 7fe850c8d640 1 -- 172.21.15.92:0/2872650810 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632285264a0 msgr2=0x56322853cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:49.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.996+0000 7fe850c8d640 1 --2- 172.21.15.92:0/2872650810 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632285264a0 0x56322853cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.996+0000 7fe850c8d640 1 -- 172.21.15.92:0/2872650810 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563228526dc0 msgr2=0x563228548f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:49.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.996+0000 7fe850c8d640 1 --2- 172.21.15.92:0/2872650810 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563228526dc0 0x563228548f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.996+0000 7fe850c8d640 1 -- 172.21.15.92:0/2872650810 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563228526bf0 con 0x563228531680 2024-09-19T09:08:49.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.996+0000 7fe850c8d640 1 --2- 172.21.15.92:0/2872650810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563228531680 0x563228549490 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fe844005d70 tx=0x7fe844010c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cac42d56ffef147 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:49.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.998+0000 7fe831ffb640 1 -- 172.21.15.92:0/2872650810 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe844037070 con 0x563228531680 2024-09-19T09:08:49.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.998+0000 7fe831ffb640 1 -- 172.21.15.92:0/2872650810 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe844003e50 con 0x563228531680 2024-09-19T09:08:49.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.998+0000 7fe831ffb640 1 -- 172.21.15.92:0/2872650810 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe844023050 con 0x563228531680 2024-09-19T09:08:49.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.999+0000 7fe854ac9740 1 -- 172.21.15.92:0/2872650810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563228531680 msgr2=0x563228549490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:49.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.999+0000 7fe854ac9740 1 --2- 172.21.15.92:0/2872650810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563228531680 0x563228549490 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fe844005d70 tx=0x7fe844010c70 comp rx=0 tx=0).stop 2024-09-19T09:08:49.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.999+0000 7fe854ac9740 1 -- 172.21.15.92:0/2872650810 shutdown_connections 2024-09-19T09:08:49.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.999+0000 7fe854ac9740 1 --2- 172.21.15.92:0/2872650810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563228531680 0x563228549490 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.999+0000 7fe854ac9740 1 --2- 172.21.15.92:0/2872650810 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563228526dc0 0x563228548f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.999+0000 7fe854ac9740 1 --2- 172.21.15.92:0/2872650810 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632285264a0 0x56322853cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.002 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.999+0000 7fe854ac9740 1 -- 172.21.15.92:0/2872650810 >> 172.21.15.92:0/2872650810 conn(0x563228522a30 msgr2=0x563228530320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:49.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.999+0000 7fe854ac9740 1 -- 172.21.15.92:0/2872650810 shutdown_connections 2024-09-19T09:08:49.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:48.999+0000 7fe854ac9740 1 -- 172.21.15.92:0/2872650810 wait complete. 2024-09-19T09:08:49.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.000+0000 7fe854ac9740 1 -- start start 2024-09-19T09:08:49.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.000+0000 7fe854ac9740 1 Processor -- start 2024-09-19T09:08:49.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.001+0000 7fe854ac9740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632285264a0 0x5632285392c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:49.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.001+0000 7fe854ac9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563228531680 0x563228539800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:49.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.001+0000 7fe854ac9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56322852aa90 0x56322852aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:49.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.001+0000 7fe854ac9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe84c1b2a00 con 0x563228531680 2024-09-19T09:08:49.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.001+0000 7fe854ac9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe84c1b3e70 con 0x56322852aa90 2024-09-19T09:08:49.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.001+0000 7fe854ac9740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe84c1b30d0 con 0x5632285264a0 2024-09-19T09:08:49.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.001+0000 7fe854ac9740 10 client.0 _ll_register_callbacks cb 0x7fe844016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:49.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.003+0000 7fe84b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563228531680 0x563228539800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:49.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.003+0000 7fe84b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563228531680 0x563228539800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34340/0 (socket says 172.21.15.92:34340) 2024-09-19T09:08:49.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.004+0000 7fe84b7fe640 1 -- 172.21.15.92:0/1142922237 learned_addr learned my addr 172.21.15.92:0/1142922237 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:49.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.005+0000 7fe84b7fe640 1 -- 172.21.15.92:0/1142922237 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632285264a0 msgr2=0x5632285392c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:08:49.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.006+0000 7fe84b7fe640 1 --2- 172.21.15.92:0/1142922237 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632285264a0 0x5632285392c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.006+0000 7fe84b7fe640 1 -- 172.21.15.92:0/1142922237 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56322852aa90 msgr2=0x56322852aed0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:08:49.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.006+0000 7fe850c8d640 1 --2- 172.21.15.92:0/1142922237 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56322852aa90 0x56322852aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:49.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.006+0000 7fe84b7fe640 1 --2- 172.21.15.92:0/1142922237 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56322852aa90 0x56322852aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.006+0000 7fe84b7fe640 1 -- 172.21.15.92:0/1142922237 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56322852b6d0 con 0x563228531680 2024-09-19T09:08:49.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.007+0000 7fe84b7fe640 1 --2- 172.21.15.92:0/1142922237 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563228531680 0x563228539800 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fe8400f3ec0 tx=0x7fe8400f39b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6519191d1144059 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:49.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.007+0000 7fe82b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:08:49.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.008+0000 7fe82b7fe640 1 -- 172.21.15.92:0/1142922237 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe840049040 con 0x563228531680 2024-09-19T09:08:49.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.008+0000 7fe82b7fe640 1 -- 172.21.15.92:0/1142922237 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe84003b460 con 0x563228531680 2024-09-19T09:08:49.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.008+0000 7fe854ac9740 1 -- 172.21.15.92:0/1142922237 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe844003e50 con 0x563228531680 2024-09-19T09:08:49.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.008+0000 7fe82b7fe640 1 -- 172.21.15.92:0/1142922237 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe8400b8780 con 0x563228531680 2024-09-19T09:08:49.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.009+0000 7fe854ac9740 10 client.18204 fetch_fsmap learned FSMap version 19 2024-09-19T09:08:49.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.009+0000 7fe854ac9740 1 -- 172.21.15.92:0/1142922237 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5632285bce70 con 0x563228531680 2024-09-19T09:08:49.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.013+0000 7fe82b7fe640 1 -- 172.21.15.92:0/1142922237 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe844003e50 con 0x563228531680 2024-09-19T09:08:49.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.013+0000 7fe82b7fe640 1 -- 172.21.15.92:0/1142922237 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe8400f1030 con 0x563228531680 2024-09-19T09:08:49.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.013+0000 7fe854ac9740 10 client.18204 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:08:49.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.013+0000 7fe854ac9740 10 client.18204 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:08:49.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.013+0000 7fe854ac9740 20 client.18204 populate_metadata read hostname 'smithi092' 2024-09-19T09:08:49.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.013+0000 7fe854ac9740 1 --2- 172.21.15.92:0/1142922237 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5632285bd540 0x5632285bf960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:49.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.013+0000 7fe854ac9740 4 client.18204 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:08:49.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.013+0000 7fe854ac9740 1 -- 172.21.15.92:0/1142922237 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5632285439d0 con 0x5632285bd540 2024-09-19T09:08:49.016 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.015+0000 7fe84bfff640 1 --2- 172.21.15.92:0/1142922237 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5632285bd540 0x5632285bf960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:49.016 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.015+0000 7fe84bfff640 1 --2- 172.21.15.92:0/1142922237 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5632285bd540 0x5632285bf960 crc :-1 s=READY pgs=364 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46d56ba72fc8e287 server_cookie=93340df53032ca5b in_seq=0 out_seq=0 2024-09-19T09:08:49.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.015+0000 7fe82b7fe640 10 client.18204 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:49.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.015+0000 7fe82b7fe640 1 -- 172.21.15.92:0/1142922237 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5632285439d0 con 0x5632285bd540 2024-09-19T09:08:49.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.015+0000 7fe82b7fe640 10 client.18204 handle_command_reply: tid=0 2024-09-19T09:08:49.017 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.015+0000 7fe854ac9740 1 client.18204 shutdown 2024-09-19T09:08:49.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.016+0000 7fe854ac9740 1 -- 172.21.15.92:0/1142922237 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563228531680 msgr2=0x563228539800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:49.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.016+0000 7fe854ac9740 1 --2- 172.21.15.92:0/1142922237 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563228531680 0x563228539800 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fe8400f3ec0 tx=0x7fe8400f39b0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.016+0000 7fe854ac9740 1 -- 172.21.15.92:0/1142922237 shutdown_connections 2024-09-19T09:08:49.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.016+0000 7fe854ac9740 1 --2- 172.21.15.92:0/1142922237 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5632285bd540 0x5632285bf960 crc :-1 s=READY pgs=364 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.016+0000 7fe854ac9740 1 --2- 172.21.15.92:0/1142922237 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56322852aa90 0x56322852aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.016+0000 7fe854ac9740 1 --2- 172.21.15.92:0/1142922237 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563228531680 0x563228539800 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.016+0000 7fe854ac9740 1 --2- 172.21.15.92:0/1142922237 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632285264a0 0x5632285392c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.016+0000 7fe854ac9740 1 -- 172.21.15.92:0/1142922237 >> 172.21.15.92:0/1142922237 conn(0x563228522a30 msgr2=0x563228521350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:49.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.016+0000 7fe82b7fe640 0 client.18204 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:49.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.017+0000 7fe854ac9740 1 -- 172.21.15.92:0/1142922237 shutdown_connections 2024-09-19T09:08:49.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.017+0000 7fe854ac9740 1 -- 172.21.15.92:0/1142922237 wait complete. 2024-09-19T09:08:49.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.017+0000 7fe854ac9740 20 client.18204 trim_cache size 0 max 16384 2024-09-19T09:08:49.019 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:08:49.019 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-19T09:08:49.019 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {} 2024-09-19T09:08:49.020 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:08:49.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.018+0000 7fe8526f0640 1 -- 172.21.15.92:0/177587250 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe8340a32c0 msgr2=0x7fe8340a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:49.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.018+0000 7fe8526f0640 1 --2- 172.21.15.92:0/177587250 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe8340a32c0 0x7fe8340a5780 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fe844005c40 tx=0x7fe844009460 comp rx=0 tx=0).stop 2024-09-19T09:08:49.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.018+0000 7fe8526f0640 1 -- 172.21.15.92:0/177587250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe84c1021b0 msgr2=0x7fe84c1a4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:49.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.018+0000 7fe8526f0640 1 --2- 172.21.15.92:0/177587250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe84c1021b0 0x7fe84c1a4d00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe840005940 tx=0x7fe8400042f0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.018+0000 7fe8526f0640 1 -- 172.21.15.92:0/177587250 shutdown_connections 2024-09-19T09:08:49.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.018+0000 7fe8526f0640 1 --2- 172.21.15.92:0/177587250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe84c105e00 0x7fe84c19eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.018+0000 7fe8526f0640 1 --2- 172.21.15.92:0/177587250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe84c1021b0 0x7fe84c1a4d00 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.019+0000 7fe8526f0640 1 --2- 172.21.15.92:0/177587250 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe8340a32c0 0x7fe8340a5780 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.019+0000 7fe8526f0640 1 --2- 172.21.15.92:0/177587250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe84c101800 0x7fe84c1a47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.019+0000 7fe8526f0640 1 -- 172.21.15.92:0/177587250 >> 172.21.15.92:0/177587250 conn(0x7fe84c0fba90 msgr2=0x7fe84c0fd880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:49.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.019+0000 7fe8526f0640 1 -- 172.21.15.92:0/177587250 shutdown_connections 2024-09-19T09:08:49.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:49.019+0000 7fe8526f0640 1 -- 172.21.15.92:0/177587250 wait complete. 2024-09-19T09:08:49.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:48 smithi167 ceph-mon[35359]: pgmap v700: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 8.1 MiB/s wr, 742 op/s 2024-09-19T09:08:49.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:48 smithi190 ceph-mon[35358]: pgmap v700: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 8.1 MiB/s wr, 742 op/s 2024-09-19T09:08:49.829 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:08:49.830 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:08:50.219 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:08:50.643 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.643+0000 7efc3c531640 1 -- 172.21.15.92:0/3364935004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc341016a0 msgr2=0x7efc34101b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:50.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.643+0000 7efc3c531640 1 --2- 172.21.15.92:0/3364935004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc341016a0 0x7efc34101b50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7efc2c009be0 tx=0x7efc2c02a6c0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.643+0000 7efc3c531640 1 -- 172.21.15.92:0/3364935004 shutdown_connections 2024-09-19T09:08:50.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.643+0000 7efc3c531640 1 --2- 172.21.15.92:0/3364935004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc341016a0 0x7efc34101b50 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.643+0000 7efc3c531640 1 --2- 172.21.15.92:0/3364935004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc34100d00 0x7efc34101160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.643+0000 7efc3c531640 1 --2- 172.21.15.92:0/3364935004 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc341003c0 0x7efc341007c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.643+0000 7efc3c531640 1 -- 172.21.15.92:0/3364935004 >> 172.21.15.92:0/3364935004 conn(0x7efc340fc1b0 msgr2=0x7efc340fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:50.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.643+0000 7efc3c531640 1 -- 172.21.15.92:0/3364935004 shutdown_connections 2024-09-19T09:08:50.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.643+0000 7efc3c531640 1 -- 172.21.15.92:0/3364935004 wait complete. 2024-09-19T09:08:50.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.643+0000 7efc3c531640 1 Processor -- start 2024-09-19T09:08:50.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.644+0000 7efc3c531640 1 -- start start 2024-09-19T09:08:50.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.644+0000 7efc3c531640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc341003c0 0x7efc34199fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:50.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.644+0000 7efc3c531640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc34100d00 0x7efc3419a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:50.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.644+0000 7efc3c531640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc341016a0 0x7efc341a1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:50.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.644+0000 7efc3c531640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efc3410f9a0 con 0x7efc341003c0 2024-09-19T09:08:50.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.644+0000 7efc3c531640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efc3410f820 con 0x7efc341016a0 2024-09-19T09:08:50.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.644+0000 7efc3c531640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7efc3410fb20 con 0x7efc34100d00 2024-09-19T09:08:50.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.644+0000 7efc3a2cd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc341003c0 0x7efc34199fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:50.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.644+0000 7efc39acc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc34100d00 0x7efc3419a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:50.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.644+0000 7efc3aace640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc341016a0 0x7efc341a1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:50.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.644+0000 7efc39acc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc34100d00 0x7efc3419a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:55268/0 (socket says 172.21.15.92:55268) 2024-09-19T09:08:50.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.644+0000 7efc39acc640 1 -- 172.21.15.92:0/2861263316 learned_addr learned my addr 172.21.15.92:0/2861263316 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:50.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.644+0000 7efc3a2cd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc341003c0 0x7efc34199fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34350/0 (socket says 172.21.15.92:34350) 2024-09-19T09:08:50.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.644+0000 7efc39acc640 1 -- 172.21.15.92:0/2861263316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc341016a0 msgr2=0x7efc341a1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:50.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.644+0000 7efc39acc640 1 --2- 172.21.15.92:0/2861263316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc341016a0 0x7efc341a1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.644+0000 7efc39acc640 1 -- 172.21.15.92:0/2861263316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc341003c0 msgr2=0x7efc34199fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:50.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.644+0000 7efc39acc640 1 --2- 172.21.15.92:0/2861263316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc341003c0 0x7efc34199fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.644+0000 7efc39acc640 1 -- 172.21.15.92:0/2861263316 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc341a1bc0 con 0x7efc34100d00 2024-09-19T09:08:50.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.644+0000 7efc39acc640 1 --2- 172.21.15.92:0/2861263316 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc34100d00 0x7efc3419a4e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7efc2400e940 tx=0x7efc2400ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:50.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.645+0000 7efc2b7fe640 1 -- 172.21.15.92:0/2861263316 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2400cd80 con 0x7efc34100d00 2024-09-19T09:08:50.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.645+0000 7efc2b7fe640 1 -- 172.21.15.92:0/2861263316 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc240035f0 con 0x7efc34100d00 2024-09-19T09:08:50.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.645+0000 7efc2b7fe640 1 -- 172.21.15.92:0/2861263316 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc24010670 con 0x7efc34100d00 2024-09-19T09:08:50.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.645+0000 7efc3c531640 1 -- 172.21.15.92:0/2861263316 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc341a1eb0 con 0x7efc34100d00 2024-09-19T09:08:50.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.646+0000 7efc3c531640 1 -- 172.21.15.92:0/2861263316 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc341a2320 con 0x7efc34100d00 2024-09-19T09:08:50.650 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.649+0000 7efc2b7fe640 1 -- 172.21.15.92:0/2861263316 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7efc240037a0 con 0x7efc34100d00 2024-09-19T09:08:50.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.650+0000 7efc2b7fe640 1 --2- 172.21.15.92:0/2861263316 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efc200a3440 0x7efc200a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:50.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.650+0000 7efc2b7fe640 1 -- 172.21.15.92:0/2861263316 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7efc240cfad0 con 0x7efc34100d00 2024-09-19T09:08:50.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.651+0000 7efc3f2cf740 1 Processor -- start 2024-09-19T09:08:50.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.651+0000 7efc3a2cd640 1 --2- 172.21.15.92:0/2861263316 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efc200a3440 0x7efc200a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:50.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.651+0000 7efc3f2cf740 1 -- start start 2024-09-19T09:08:50.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.651+0000 7efc3f2cf740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf6f8f41b0 0x55cf6f8f45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:50.653 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.651+0000 7efc3f2cf740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cf6f8f4af0 0x55cf6f8f95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:50.653 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.651+0000 7efc3f2cf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf6f8f9b80 0x55cf6f8fc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:50.653 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.651+0000 7efc3f2cf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cf6f84f2f0 con 0x55cf6f8f9b80 2024-09-19T09:08:50.653 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.651+0000 7efc3f2cf740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55cf6f7f7270 con 0x55cf6f8f4af0 2024-09-19T09:08:50.653 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.651+0000 7efc3f2cf740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55cf6f84b2b0 con 0x55cf6f8f41b0 2024-09-19T09:08:50.654 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.652+0000 7efc3aace640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf6f8f9b80 0x55cf6f8fc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:50.654 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.652+0000 7efc39acc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cf6f8f4af0 0x55cf6f8f95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:50.654 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.652+0000 7efc3aace640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf6f8f9b80 0x55cf6f8fc040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34356/0 (socket says 172.21.15.92:34356) 2024-09-19T09:08:50.654 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.652+0000 7efc3aace640 1 -- 172.21.15.92:0/2213068134 learned_addr learned my addr 172.21.15.92:0/2213068134 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:50.654 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.652+0000 7efc39acc640 1 -- 172.21.15.92:0/2213068134 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf6f8f41b0 msgr2=0x55cf6f8f45b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:08:50.654 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.652+0000 7efc39acc640 1 --2- 172.21.15.92:0/2213068134 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf6f8f41b0 0x55cf6f8f45b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.654 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.652+0000 7efc39acc640 1 -- 172.21.15.92:0/2213068134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf6f8f9b80 msgr2=0x55cf6f8fc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:50.654 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.652+0000 7efc39acc640 1 --2- 172.21.15.92:0/2213068134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf6f8f9b80 0x55cf6f8fc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.654 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.652+0000 7efc39acc640 1 -- 172.21.15.92:0/2213068134 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf6f7f6340 con 0x55cf6f8f4af0 2024-09-19T09:08:50.654 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.653+0000 7efc39acc640 1 --2- 172.21.15.92:0/2213068134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cf6f8f4af0 0x55cf6f8f95b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efc2409c040 tx=0x7efc2409ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a6a3472fb8c6c2d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:50.654 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.653+0000 7efc3a2cd640 1 --2- 172.21.15.92:0/2861263316 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efc200a3440 0x7efc200a5900 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7efc30009c70 tx=0x7efc30005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:50.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.653+0000 7efc28bfe640 1 -- 172.21.15.92:0/2213068134 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2409c0b0 con 0x55cf6f8f4af0 2024-09-19T09:08:50.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.653+0000 7efc28bfe640 1 -- 172.21.15.92:0/2213068134 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc240a0460 con 0x55cf6f8f4af0 2024-09-19T09:08:50.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.653+0000 7efc28bfe640 1 -- 172.21.15.92:0/2213068134 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc240a4890 con 0x55cf6f8f4af0 2024-09-19T09:08:50.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.654+0000 7efc3f2cf740 1 -- 172.21.15.92:0/2213068134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cf6f8f4af0 msgr2=0x55cf6f8f95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:50.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.654+0000 7efc3f2cf740 1 --2- 172.21.15.92:0/2213068134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cf6f8f4af0 0x55cf6f8f95b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efc2409c040 tx=0x7efc2409ba10 comp rx=0 tx=0).stop 2024-09-19T09:08:50.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.655+0000 7efc3f2cf740 1 -- 172.21.15.92:0/2213068134 shutdown_connections 2024-09-19T09:08:50.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.655+0000 7efc3f2cf740 1 --2- 172.21.15.92:0/2213068134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf6f8f9b80 0x55cf6f8fc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.655+0000 7efc3f2cf740 1 --2- 172.21.15.92:0/2213068134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cf6f8f4af0 0x55cf6f8f95b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.655+0000 7efc3f2cf740 1 --2- 172.21.15.92:0/2213068134 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf6f8f41b0 0x55cf6f8f45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.655+0000 7efc3f2cf740 1 -- 172.21.15.92:0/2213068134 >> 172.21.15.92:0/2213068134 conn(0x55cf6f8ef820 msgr2=0x55cf6f8efc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:50.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.655+0000 7efc3f2cf740 1 -- 172.21.15.92:0/2213068134 shutdown_connections 2024-09-19T09:08:50.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.655+0000 7efc3f2cf740 1 -- 172.21.15.92:0/2213068134 wait complete. 2024-09-19T09:08:50.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.656+0000 7efc3f2cf740 1 -- start start 2024-09-19T09:08:50.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.656+0000 7efc3f2cf740 1 Processor -- start 2024-09-19T09:08:50.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.657+0000 7efc3f2cf740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf6f8f41b0 0x55cf6f8fe490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:50.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.657+0000 7efc3f2cf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf6f8f4af0 0x55cf6f8fe9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:50.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.657+0000 7efc3f2cf740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cf6f8f9b80 0x55cf6f905a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:50.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.657+0000 7efc3a2cd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf6f8f41b0 0x55cf6f8fe490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:50.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.657+0000 7efc3a2cd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf6f8f41b0 0x55cf6f8fe490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:55272/0 (socket says 172.21.15.92:55272) 2024-09-19T09:08:50.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.657+0000 7efc3a2cd640 1 -- 172.21.15.92:0/207341986 learned_addr learned my addr 172.21.15.92:0/207341986 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:50.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.657+0000 7efc3f2cf740 1 -- 172.21.15.92:0/207341986 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cf6f8fcaf0 con 0x55cf6f8f4af0 2024-09-19T09:08:50.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.657+0000 7efc3f2cf740 1 -- 172.21.15.92:0/207341986 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55cf6f7d8290 con 0x55cf6f8f9b80 2024-09-19T09:08:50.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.657+0000 7efc3f2cf740 1 -- 172.21.15.92:0/207341986 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55cf6f8fcc70 con 0x55cf6f8f41b0 2024-09-19T09:08:50.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.657+0000 7efc3aace640 1 --2- 172.21.15.92:0/207341986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cf6f8f9b80 0x55cf6f905a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:50.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.657+0000 7efc3f2cf740 10 client.0 _ll_register_callbacks cb 0x55cf6f809140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:50.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.657+0000 7efc3a2cd640 1 -- 172.21.15.92:0/207341986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cf6f8f9b80 msgr2=0x55cf6f905a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:50.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.657+0000 7efc3a2cd640 1 --2- 172.21.15.92:0/207341986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cf6f8f9b80 0x55cf6f905a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.657+0000 7efc3a2cd640 1 -- 172.21.15.92:0/207341986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf6f8f4af0 msgr2=0x55cf6f8fe9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:50.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.657+0000 7efc3a2cd640 1 --2- 172.21.15.92:0/207341986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf6f8f4af0 0x55cf6f8fe9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.657+0000 7efc3a2cd640 1 -- 172.21.15.92:0/207341986 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf6f562210 con 0x55cf6f8f41b0 2024-09-19T09:08:50.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.657+0000 7efc3aace640 1 --2- 172.21.15.92:0/207341986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cf6f8f9b80 0x55cf6f905a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:08:50.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.657+0000 7efc3f2cf740 1 -- 172.21.15.92:0/207341986 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc240a0460 con 0x55cf6f8f41b0 2024-09-19T09:08:50.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.658+0000 7efc3a2cd640 1 --2- 172.21.15.92:0/207341986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf6f8f41b0 0x55cf6f8fe490 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7efc30009e20 tx=0x7efc30004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d52cb8ad8196419 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:50.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.658+0000 7efc1dffb640 10 client.27379 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:08:50.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.658+0000 7efc1dffb640 1 -- 172.21.15.92:0/207341986 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc30045070 con 0x55cf6f8f41b0 2024-09-19T09:08:50.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.658+0000 7efc1dffb640 1 -- 172.21.15.92:0/207341986 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7efc30005220 con 0x55cf6f8f41b0 2024-09-19T09:08:50.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.658+0000 7efc1dffb640 1 -- 172.21.15.92:0/207341986 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7efc30005480 con 0x55cf6f8f41b0 2024-09-19T09:08:50.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.658+0000 7efc3f2cf740 10 client.27379 fetch_fsmap learned FSMap version 19 2024-09-19T09:08:50.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.658+0000 7efc3f2cf740 1 -- 172.21.15.92:0/207341986 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55cf6f62e620 con 0x55cf6f8f41b0 2024-09-19T09:08:50.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.659+0000 7efc1dffb640 1 -- 172.21.15.92:0/207341986 <== mon.1 v2:172.21.15.190:3300/0 4 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7efc300047a0 con 0x55cf6f8f41b0 2024-09-19T09:08:50.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.659+0000 7efc3f2cf740 10 client.27379 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:08:50.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.659+0000 7efc3f2cf740 10 client.27379 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:08:50.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.659+0000 7efc3f2cf740 20 client.27379 populate_metadata read hostname 'smithi092' 2024-09-19T09:08:50.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.659+0000 7efc3f2cf740 1 --2- 172.21.15.92:0/207341986 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55cf6f8eaaf0 0x55cf6f8ecf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:50.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.659+0000 7efc3f2cf740 4 client.27379 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:08:50.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.659+0000 7efc3f2cf740 1 -- 172.21.15.92:0/207341986 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf6f85ca20 con 0x55cf6f8eaaf0 2024-09-19T09:08:50.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.659+0000 7efc39acc640 1 --2- 172.21.15.92:0/207341986 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55cf6f8eaaf0 0x55cf6f8ecf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:50.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.660+0000 7efc39acc640 1 --2- 172.21.15.92:0/207341986 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55cf6f8eaaf0 0x55cf6f8ecf80 crc :-1 s=READY pgs=365 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24a8d2267c571b88 server_cookie=dc60934c1f4e2c28 in_seq=0 out_seq=0 2024-09-19T09:08:50.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.660+0000 7efc1dffb640 10 client.27379 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:50.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.661+0000 7efc1dffb640 1 -- 172.21.15.92:0/207341986 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cf6f85ca20 con 0x55cf6f8eaaf0 2024-09-19T09:08:50.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.661+0000 7efc1dffb640 10 client.27379 handle_command_reply: tid=0 2024-09-19T09:08:50.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.661+0000 7efc3f2cf740 1 client.27379 shutdown 2024-09-19T09:08:50.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.661+0000 7efc3f2cf740 1 -- 172.21.15.92:0/207341986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf6f8f41b0 msgr2=0x55cf6f8fe490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:50.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.661+0000 7efc3f2cf740 1 --2- 172.21.15.92:0/207341986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf6f8f41b0 0x55cf6f8fe490 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7efc30009e20 tx=0x7efc30004730 comp rx=0 tx=0).stop 2024-09-19T09:08:50.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.661+0000 7efc3f2cf740 1 -- 172.21.15.92:0/207341986 shutdown_connections 2024-09-19T09:08:50.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.661+0000 7efc3f2cf740 1 --2- 172.21.15.92:0/207341986 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55cf6f8eaaf0 0x55cf6f8ecf80 crc :-1 s=READY pgs=365 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.661+0000 7efc3f2cf740 1 --2- 172.21.15.92:0/207341986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cf6f8f9b80 0x55cf6f905a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.661+0000 7efc3f2cf740 1 --2- 172.21.15.92:0/207341986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf6f8f4af0 0x55cf6f8fe9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.661+0000 7efc3f2cf740 1 --2- 172.21.15.92:0/207341986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf6f8f41b0 0x55cf6f8fe490 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.661+0000 7efc3f2cf740 1 -- 172.21.15.92:0/207341986 >> 172.21.15.92:0/207341986 conn(0x55cf6f8ef820 msgr2=0x55cf6f8f1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:50.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.661+0000 7efc1dffb640 0 client.27379 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:50.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.662+0000 7efc3f2cf740 1 -- 172.21.15.92:0/207341986 shutdown_connections 2024-09-19T09:08:50.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.662+0000 7efc3f2cf740 1 -- 172.21.15.92:0/207341986 wait complete. 2024-09-19T09:08:50.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.662+0000 7efc3f2cf740 20 client.27379 trim_cache size 0 max 16384 2024-09-19T09:08:50.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.696+0000 7efc3f2cf740 1 Processor -- start 2024-09-19T09:08:50.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.698+0000 7efc3f2cf740 1 -- start start 2024-09-19T09:08:50.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.699+0000 7efc3f2cf740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf6f8f41b0 0x55cf6f8f4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:50.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.699+0000 7efc3f2cf740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cf6f8f4af0 0x55cf6f8fe450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:50.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.699+0000 7efc3f2cf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf6f8f9b80 0x55cf6f8fe990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:50.701 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.699+0000 7efc39acc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cf6f8f4af0 0x55cf6f8fe450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:50.701 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.699+0000 7efc39acc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cf6f8f4af0 0x55cf6f8fe450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:47898/0 (socket says 172.21.15.92:47898) 2024-09-19T09:08:50.701 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.699+0000 7efc39acc640 1 -- 172.21.15.92:0/3489397712 learned_addr learned my addr 172.21.15.92:0/3489397712 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:50.701 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.700+0000 7efc3f2cf740 1 -- 172.21.15.92:0/3489397712 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efc341a4e50 con 0x55cf6f8f9b80 2024-09-19T09:08:50.701 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.700+0000 7efc3f2cf740 1 -- 172.21.15.92:0/3489397712 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efc341a76f0 con 0x55cf6f8f4af0 2024-09-19T09:08:50.701 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.700+0000 7efc3f2cf740 1 -- 172.21.15.92:0/3489397712 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7efc341a54e0 con 0x55cf6f8f41b0 2024-09-19T09:08:50.701 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.700+0000 7efc3aace640 1 --2- 172.21.15.92:0/3489397712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf6f8f9b80 0x55cf6f8fe990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:50.702 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.701+0000 7efc39acc640 1 -- 172.21.15.92:0/3489397712 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf6f8f41b0 msgr2=0x55cf6f8f4590 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:08:50.702 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.701+0000 7efc39acc640 1 --2- 172.21.15.92:0/3489397712 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf6f8f41b0 0x55cf6f8f4590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.702 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.701+0000 7efc39acc640 1 -- 172.21.15.92:0/3489397712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf6f8f9b80 msgr2=0x55cf6f8fe990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:50.702 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.701+0000 7efc39acc640 1 --2- 172.21.15.92:0/3489397712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf6f8f9b80 0x55cf6f8fe990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.702 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.701+0000 7efc39acc640 1 -- 172.21.15.92:0/3489397712 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf6f8ef640 con 0x55cf6f8f4af0 2024-09-19T09:08:50.702 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.702+0000 7efc39acc640 1 --2- 172.21.15.92:0/3489397712 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cf6f8f4af0 0x55cf6f8fe450 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7efc2409bdb0 tx=0x7efc2409bb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6dcdb66401cd9dc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:50.706 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.702+0000 7efc1ffff640 1 -- 172.21.15.92:0/3489397712 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2407f070 con 0x55cf6f8f4af0 2024-09-19T09:08:50.706 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.702+0000 7efc1ffff640 1 -- 172.21.15.92:0/3489397712 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc2409c0b0 con 0x55cf6f8f4af0 2024-09-19T09:08:50.706 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.702+0000 7efc1ffff640 1 -- 172.21.15.92:0/3489397712 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc240a4af0 con 0x55cf6f8f4af0 2024-09-19T09:08:50.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.707+0000 7efc3f2cf740 1 -- 172.21.15.92:0/3489397712 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cf6f8f4af0 msgr2=0x55cf6f8fe450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:50.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.707+0000 7efc3f2cf740 1 --2- 172.21.15.92:0/3489397712 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cf6f8f4af0 0x55cf6f8fe450 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7efc2409bdb0 tx=0x7efc2409bb40 comp rx=0 tx=0).stop 2024-09-19T09:08:50.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.708+0000 7efc3f2cf740 1 -- 172.21.15.92:0/3489397712 shutdown_connections 2024-09-19T09:08:50.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.708+0000 7efc3f2cf740 1 --2- 172.21.15.92:0/3489397712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf6f8f9b80 0x55cf6f8fe990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.708+0000 7efc3f2cf740 1 --2- 172.21.15.92:0/3489397712 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cf6f8f4af0 0x55cf6f8fe450 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.708+0000 7efc3f2cf740 1 --2- 172.21.15.92:0/3489397712 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf6f8f41b0 0x55cf6f8f4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.708+0000 7efc3f2cf740 1 -- 172.21.15.92:0/3489397712 >> 172.21.15.92:0/3489397712 conn(0x55cf6f8ef820 msgr2=0x55cf6f8f5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:50.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.709+0000 7efc3f2cf740 1 -- 172.21.15.92:0/3489397712 shutdown_connections 2024-09-19T09:08:50.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.711+0000 7efc3f2cf740 1 -- 172.21.15.92:0/3489397712 wait complete. 2024-09-19T09:08:50.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.711+0000 7efc3f2cf740 1 -- start start 2024-09-19T09:08:50.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.711+0000 7efc3f2cf740 1 Processor -- start 2024-09-19T09:08:50.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.717+0000 7efc3f2cf740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf6f8f41b0 0x55cf6f9025c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:50.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.717+0000 7efc3f2cf740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cf6f8f4af0 0x55cf6f902b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:50.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.717+0000 7efc3f2cf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf6f8f9b80 0x55cf6f903b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:50.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.717+0000 7efc3f2cf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efc341a5bb0 con 0x55cf6f8f9b80 2024-09-19T09:08:50.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.717+0000 7efc3f2cf740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efc341a7020 con 0x55cf6f8f4af0 2024-09-19T09:08:50.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.717+0000 7efc3f2cf740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7efc341a6280 con 0x55cf6f8f41b0 2024-09-19T09:08:50.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.717+0000 7efc3f2cf740 10 client.0 _ll_register_callbacks cb 0x7efc30009660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:50.719 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.718+0000 7efc3aace640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf6f8f9b80 0x55cf6f903b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:50.719 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.718+0000 7efc3aace640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf6f8f9b80 0x55cf6f903b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34372/0 (socket says 172.21.15.92:34372) 2024-09-19T09:08:50.719 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.718+0000 7efc3aace640 1 -- 172.21.15.92:0/2380038806 learned_addr learned my addr 172.21.15.92:0/2380038806 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:50.719 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.718+0000 7efc39acc640 1 --2- 172.21.15.92:0/2380038806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cf6f8f4af0 0x55cf6f902b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:50.719 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.719+0000 7efc3a2cd640 1 --2- 172.21.15.92:0/2380038806 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf6f8f41b0 0x55cf6f9025c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:50.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.722+0000 7efc39acc640 1 -- 172.21.15.92:0/2380038806 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf6f8f41b0 msgr2=0x55cf6f9025c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:50.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.722+0000 7efc39acc640 1 --2- 172.21.15.92:0/2380038806 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf6f8f41b0 0x55cf6f9025c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.722+0000 7efc39acc640 1 -- 172.21.15.92:0/2380038806 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf6f8f9b80 msgr2=0x55cf6f903b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:50.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.722+0000 7efc39acc640 1 --2- 172.21.15.92:0/2380038806 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf6f8f9b80 0x55cf6f903b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.722+0000 7efc39acc640 1 -- 172.21.15.92:0/2380038806 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf6f904120 con 0x55cf6f8f4af0 2024-09-19T09:08:50.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.724+0000 7efc39acc640 1 --2- 172.21.15.92:0/2380038806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cf6f8f4af0 0x55cf6f902b00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7efc2409bdb0 tx=0x7efc240bc2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca7baa46cfe4ac10 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:50.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.724+0000 7efc1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:08:50.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.725+0000 7efc1dffb640 1 -- 172.21.15.92:0/2380038806 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2407f070 con 0x55cf6f8f4af0 2024-09-19T09:08:50.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.725+0000 7efc1dffb640 1 -- 172.21.15.92:0/2380038806 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7efc240a4890 con 0x55cf6f8f4af0 2024-09-19T09:08:50.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.726+0000 7efc3f2cf740 1 -- 172.21.15.92:0/2380038806 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc2409c0b0 con 0x55cf6f8f4af0 2024-09-19T09:08:50.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.726+0000 7efc1dffb640 1 -- 172.21.15.92:0/2380038806 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7efc240a9050 con 0x55cf6f8f4af0 2024-09-19T09:08:50.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.726+0000 7efc3f2cf740 10 client.27503 fetch_fsmap learned FSMap version 19 2024-09-19T09:08:50.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.726+0000 7efc3f2cf740 1 -- 172.21.15.92:0/2380038806 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55cf6f905430 con 0x55cf6f8f4af0 2024-09-19T09:08:50.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.726+0000 7efc1dffb640 1 -- 172.21.15.92:0/2380038806 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc2409c0b0 con 0x55cf6f8f4af0 2024-09-19T09:08:50.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.727+0000 7efc1dffb640 1 -- 172.21.15.92:0/2380038806 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7efc2407ace0 con 0x55cf6f8f4af0 2024-09-19T09:08:50.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.727+0000 7efc3f2cf740 10 client.27503 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:08:50.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.727+0000 7efc3f2cf740 10 client.27503 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:08:50.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.727+0000 7efc3f2cf740 20 client.27503 populate_metadata read hostname 'smithi092' 2024-09-19T09:08:50.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.727+0000 7efc3f2cf740 1 --2- 172.21.15.92:0/2380038806 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55cf6f96bfb0 0x55cf6f96e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:50.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.727+0000 7efc3f2cf740 4 client.27503 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:08:50.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.727+0000 7efc3f2cf740 1 -- 172.21.15.92:0/2380038806 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cf6f856d70 con 0x55cf6f96bfb0 2024-09-19T09:08:50.732 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.732+0000 7efc3a2cd640 1 --2- 172.21.15.92:0/2380038806 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55cf6f96bfb0 0x55cf6f96e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:50.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.744+0000 7efc1dffb640 10 client.27503 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:50.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.744+0000 7efc3a2cd640 1 --2- 172.21.15.92:0/2380038806 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55cf6f96bfb0 0x55cf6f96e3a0 crc :-1 s=READY pgs=366 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25afa3464552ae30 server_cookie=35629885628d2126 in_seq=0 out_seq=0 2024-09-19T09:08:50.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.780+0000 7fedc5d20640 1 -- 172.21.15.92:0/1851832111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fedc0105d90 msgr2=0x7fedc0106220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:50.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.780+0000 7fedc5d20640 1 --2- 172.21.15.92:0/1851832111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fedc0105d90 0x7fedc0106220 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fedb8009ca0 tx=0x7fedb802a940 comp rx=0 tx=0).stop 2024-09-19T09:08:50.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.780+0000 7fedc5d20640 1 -- 172.21.15.92:0/1851832111 shutdown_connections 2024-09-19T09:08:50.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.780+0000 7fedc5d20640 1 --2- 172.21.15.92:0/1851832111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fedc0105d90 0x7fedc0106220 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.780+0000 7fedc5d20640 1 --2- 172.21.15.92:0/1851832111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedc01012a0 0x7fedc0105770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.780+0000 7fedc5d20640 1 --2- 172.21.15.92:0/1851832111 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedc0100980 0x7fedc0100d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.780+0000 7fedc5d20640 1 -- 172.21.15.92:0/1851832111 >> 172.21.15.92:0/1851832111 conn(0x7fedc00fc630 msgr2=0x7fedc00fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:50.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.780+0000 7fedc5d20640 1 -- 172.21.15.92:0/1851832111 shutdown_connections 2024-09-19T09:08:50.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.780+0000 7fedc5d20640 1 -- 172.21.15.92:0/1851832111 wait complete. 2024-09-19T09:08:50.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.781+0000 7fedc5d20640 1 Processor -- start 2024-09-19T09:08:50.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.781+0000 7fedc5d20640 1 -- start start 2024-09-19T09:08:50.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.782+0000 7fedc5d20640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fedc0100980 0x7fedc01a46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:50.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.782+0000 7fedc5d20640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedc01012a0 0x7fedc01a4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:50.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.782+0000 7fedc5d20640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedc0105d90 0x7fedc019e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:50.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.782+0000 7fedc5d20640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fedc0118490 con 0x7fedc0100980 2024-09-19T09:08:50.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.782+0000 7fedc5d20640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fedc0118310 con 0x7fedc0105d90 2024-09-19T09:08:50.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.782+0000 7fedc5d20640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fedc0118610 con 0x7fedc01012a0 2024-09-19T09:08:50.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.782+0000 7fedc4d1e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fedc0100980 0x7fedc01a46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:50.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.782+0000 7fedc4d1e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fedc0100980 0x7fedc01a46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34398/0 (socket says 172.21.15.92:34398) 2024-09-19T09:08:50.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.782+0000 7fedc4d1e640 1 -- 172.21.15.92:0/2785355112 learned_addr learned my addr 172.21.15.92:0/2785355112 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:50.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.782+0000 7fedc551f640 1 --2- 172.21.15.92:0/2785355112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedc0105d90 0x7fedc019e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:50.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.782+0000 7fedbffff640 1 --2- 172.21.15.92:0/2785355112 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedc01012a0 0x7fedc01a4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:50.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.783+0000 7fedc551f640 1 -- 172.21.15.92:0/2785355112 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedc01012a0 msgr2=0x7fedc01a4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:50.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.783+0000 7fedc551f640 1 --2- 172.21.15.92:0/2785355112 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedc01012a0 0x7fedc01a4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.783+0000 7fedc551f640 1 -- 172.21.15.92:0/2785355112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fedc0100980 msgr2=0x7fedc01a46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:50.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.783+0000 7fedc551f640 1 --2- 172.21.15.92:0/2785355112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fedc0100980 0x7fedc01a46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.783+0000 7fedc551f640 1 -- 172.21.15.92:0/2785355112 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedc019efd0 con 0x7fedc0105d90 2024-09-19T09:08:50.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.783+0000 7fedc551f640 1 --2- 172.21.15.92:0/2785355112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedc0105d90 0x7fedc019e8a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fedb8006010 tx=0x7fedb802f780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:50.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.784+0000 7fedbdffb640 1 -- 172.21.15.92:0/2785355112 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb8034040 con 0x7fedc0105d90 2024-09-19T09:08:50.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.784+0000 7fedc5d20640 1 -- 172.21.15.92:0/2785355112 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedc019f260 con 0x7fedc0105d90 2024-09-19T09:08:50.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.784+0000 7fedc5d20640 1 -- 172.21.15.92:0/2785355112 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedc01ab5b0 con 0x7fedc0105d90 2024-09-19T09:08:50.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.784+0000 7fedbdffb640 1 -- 172.21.15.92:0/2785355112 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fedb8003e50 con 0x7fedc0105d90 2024-09-19T09:08:50.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.784+0000 7fedbdffb640 1 -- 172.21.15.92:0/2785355112 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb8004800 con 0x7fedc0105d90 2024-09-19T09:08:50.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.786+0000 7fedc5d20640 1 -- 172.21.15.92:0/2785355112 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feda4005290 con 0x7fedc0105d90 2024-09-19T09:08:50.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.787+0000 7fedbdffb640 1 -- 172.21.15.92:0/2785355112 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fedb8037020 con 0x7fedc0105d90 2024-09-19T09:08:50.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.788+0000 7fedbdffb640 1 --2- 172.21.15.92:0/2785355112 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fedb00a3390 0x7fedb00a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:50.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.788+0000 7fedc4d1e640 1 --2- 172.21.15.92:0/2785355112 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fedb00a3390 0x7fedb00a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:50.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.788+0000 7fedbdffb640 1 -- 172.21.15.92:0/2785355112 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fedb80f0810 con 0x7fedc0105d90 2024-09-19T09:08:50.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.789+0000 7fedc4d1e640 1 --2- 172.21.15.92:0/2785355112 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fedb00a3390 0x7fedb00a5850 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fedc019f9e0 tx=0x7fedb4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:50.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:50.792+0000 7fedbdffb640 1 -- 172.21.15.92:0/2785355112 <== mon.2 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fedb80bd5c0 con 0x7fedc0105d90 2024-09-19T09:08:50.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 725.0 s, 3749.0 tps, lat 26.478 ms stddev 30.738 2024-09-19T09:08:50.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.803+0000 7efc1dffb640 1 -- 172.21.15.92:0/2380038806 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cf6f856d70 con 0x55cf6f96bfb0 2024-09-19T09:08:50.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.803+0000 7efc1dffb640 10 client.27503 handle_command_reply: tid=0 2024-09-19T09:08:50.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.803+0000 7efc3f2cf740 1 client.27503 shutdown 2024-09-19T09:08:50.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.805+0000 7efc3f2cf740 1 -- 172.21.15.92:0/2380038806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cf6f8f4af0 msgr2=0x55cf6f902b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:50.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.805+0000 7efc3f2cf740 1 --2- 172.21.15.92:0/2380038806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cf6f8f4af0 0x55cf6f902b00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7efc2409bdb0 tx=0x7efc240bc2e0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.805+0000 7efc3f2cf740 1 -- 172.21.15.92:0/2380038806 shutdown_connections 2024-09-19T09:08:50.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.805+0000 7efc3f2cf740 1 --2- 172.21.15.92:0/2380038806 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55cf6f96bfb0 0x55cf6f96e3a0 crc :-1 s=READY pgs=366 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.805+0000 7efc3f2cf740 1 --2- 172.21.15.92:0/2380038806 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf6f8f9b80 0x55cf6f903b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.807 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.805+0000 7efc3f2cf740 1 --2- 172.21.15.92:0/2380038806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cf6f8f4af0 0x55cf6f902b00 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.807 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.805+0000 7efc1dffb640 0 client.27503 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:50.807 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.805+0000 7efc3f2cf740 1 --2- 172.21.15.92:0/2380038806 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf6f8f41b0 0x55cf6f9025c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.807 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.805+0000 7efc3f2cf740 1 -- 172.21.15.92:0/2380038806 >> 172.21.15.92:0/2380038806 conn(0x55cf6f8ef820 msgr2=0x55cf6f8f5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:50.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.807+0000 7efc3f2cf740 1 -- 172.21.15.92:0/2380038806 shutdown_connections 2024-09-19T09:08:50.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.807+0000 7efc3f2cf740 1 -- 172.21.15.92:0/2380038806 wait complete. 2024-09-19T09:08:50.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:08:50.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:08:50.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:08:50.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:08:50.810 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.808+0000 7efc3f2cf740 20 client.27503 trim_cache size 0 max 16384 2024-09-19T09:08:50.810 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.809+0000 7efc3c531640 1 -- 172.21.15.92:0/2861263316 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efc200a3440 msgr2=0x7efc200a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:50.810 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.809+0000 7efc3c531640 1 --2- 172.21.15.92:0/2861263316 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efc200a3440 0x7efc200a5900 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7efc30009c70 tx=0x7efc30005f90 comp rx=0 tx=0).stop 2024-09-19T09:08:50.810 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.809+0000 7efc3c531640 1 -- 172.21.15.92:0/2861263316 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc34100d00 msgr2=0x7efc3419a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:50.810 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.809+0000 7efc3c531640 1 --2- 172.21.15.92:0/2861263316 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc34100d00 0x7efc3419a4e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7efc2400e940 tx=0x7efc2400ee00 comp rx=0 tx=0).stop 2024-09-19T09:08:50.811 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.810+0000 7efc3c531640 1 -- 172.21.15.92:0/2861263316 shutdown_connections 2024-09-19T09:08:50.811 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.810+0000 7efc3c531640 1 --2- 172.21.15.92:0/2861263316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc341016a0 0x7efc341a1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.811 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.810+0000 7efc3c531640 1 --2- 172.21.15.92:0/2861263316 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc34100d00 0x7efc3419a4e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.811 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.810+0000 7efc3c531640 1 --2- 172.21.15.92:0/2861263316 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efc200a3440 0x7efc200a5900 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.811 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.810+0000 7efc3c531640 1 --2- 172.21.15.92:0/2861263316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc341003c0 0x7efc34199fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.810+0000 7efc3c531640 1 -- 172.21.15.92:0/2861263316 >> 172.21.15.92:0/2861263316 conn(0x7efc340fc1b0 msgr2=0x7efc340fdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:50.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.810+0000 7efc3c531640 1 -- 172.21.15.92:0/2861263316 shutdown_connections 2024-09-19T09:08:50.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:08:50.811+0000 7efc3c531640 1 -- 172.21.15.92:0/2861263316 wait complete. 2024-09-19T09:08:51.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:50 smithi092 ceph-mon[31407]: pgmap v701: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 7.9 MiB/s wr, 759 op/s 2024-09-19T09:08:51.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:50 smithi167 ceph-mon[35359]: pgmap v701: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 7.9 MiB/s wr, 759 op/s 2024-09-19T09:08:51.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:50 smithi190 ceph-mon[35358]: pgmap v701: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 7.9 MiB/s wr, 759 op/s 2024-09-19T09:08:51.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:51.174+0000 7fedc5d20640 1 -- 172.21.15.92:0/2785355112 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feda4005580 con 0x7fedc0105d90 2024-09-19T09:08:51.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:51.175+0000 7fedbdffb640 1 -- 172.21.15.92:0/2785355112 <== mon.2 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7fedb80bcec0 con 0x7fedc0105d90 2024-09-19T09:08:51.176 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:08:51.176 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:08:51.176 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:08:51.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:51.178+0000 7fedc5d20640 1 -- 172.21.15.92:0/2785355112 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fedb00a3390 msgr2=0x7fedb00a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:51.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:51.178+0000 7fedc5d20640 1 --2- 172.21.15.92:0/2785355112 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fedb00a3390 0x7fedb00a5850 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fedc019f9e0 tx=0x7fedb4008040 comp rx=0 tx=0).stop 2024-09-19T09:08:51.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:51.178+0000 7fedc5d20640 1 -- 172.21.15.92:0/2785355112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedc0105d90 msgr2=0x7fedc019e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:51.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:51.178+0000 7fedc5d20640 1 --2- 172.21.15.92:0/2785355112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedc0105d90 0x7fedc019e8a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fedb8006010 tx=0x7fedb802f780 comp rx=0 tx=0).stop 2024-09-19T09:08:51.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:51.178+0000 7fedc5d20640 1 -- 172.21.15.92:0/2785355112 shutdown_connections 2024-09-19T09:08:51.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:51.178+0000 7fedc5d20640 1 --2- 172.21.15.92:0/2785355112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedc0105d90 0x7fedc019e8a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:51.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:51.179+0000 7fedc5d20640 1 --2- 172.21.15.92:0/2785355112 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedc01012a0 0x7fedc01a4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:51.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:51.179+0000 7fedc5d20640 1 --2- 172.21.15.92:0/2785355112 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fedb00a3390 0x7fedb00a5850 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:51.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:51.179+0000 7fedc5d20640 1 --2- 172.21.15.92:0/2785355112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fedc0100980 0x7fedc01a46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:51.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:51.179+0000 7fedc5d20640 1 -- 172.21.15.92:0/2785355112 >> 172.21.15.92:0/2785355112 conn(0x7fedc00fc630 msgr2=0x7fedc010f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:51.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:51.179+0000 7fedc5d20640 1 -- 172.21.15.92:0/2785355112 shutdown_connections 2024-09-19T09:08:51.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:51.179+0000 7fedc5d20640 1 -- 172.21.15.92:0/2785355112 wait complete. 2024-09-19T09:08:51.629 INFO:tasks.quiescer.fs.[cephfs]:Total duration (44.4) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T09:08:51.630 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.2 2024-09-19T09:08:51.630 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:08:51.918 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:51 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/2785355112' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:08:51.974 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:08:52.039 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:08:52.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:51 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/2785355112' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:08:52.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:51 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/2785355112' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:08:52.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.635+0000 7f6a4f7fe640 1 -- 172.21.15.92:0/3386548772 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a400309b0 con 0x7f6a50109d70 2024-09-19T09:08:52.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.635+0000 7f6a56d01640 1 -- 172.21.15.92:0/3386548772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a50109d70 msgr2=0x7f6a50109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:52.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.635+0000 7f6a56d01640 1 --2- 172.21.15.92:0/3386548772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a50109d70 0x7f6a50109450 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6a40009860 tx=0x7f6a4002a380 comp rx=0 tx=0).stop 2024-09-19T09:08:52.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.636+0000 7f6a56d01640 1 -- 172.21.15.92:0/3386548772 shutdown_connections 2024-09-19T09:08:52.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.636+0000 7f6a56d01640 1 --2- 172.21.15.92:0/3386548772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a5010e890 0x7f6a5010ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:52.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.636+0000 7f6a56d01640 1 --2- 172.21.15.92:0/3386548772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a50109d70 0x7f6a50109450 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:52.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.636+0000 7f6a56d01640 1 --2- 172.21.15.92:0/3386548772 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a50069ab0 0x7f6a5010e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:52.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.636+0000 7f6a56d01640 1 -- 172.21.15.92:0/3386548772 >> 172.21.15.92:0/3386548772 conn(0x7f6a5006e2d0 msgr2=0x7f6a5006e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:52.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.636+0000 7f6a56d01640 1 -- 172.21.15.92:0/3386548772 shutdown_connections 2024-09-19T09:08:52.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.636+0000 7f6a56d01640 1 -- 172.21.15.92:0/3386548772 wait complete. 2024-09-19T09:08:52.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.637+0000 7f6a56d01640 1 Processor -- start 2024-09-19T09:08:52.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.637+0000 7f6a56d01640 1 -- start start 2024-09-19T09:08:52.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.637+0000 7f6a56d01640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a50069ab0 0x7f6a5010b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:52.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.637+0000 7f6a56d01640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a50109d70 0x7f6a5010be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:52.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.637+0000 7f6a56d01640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a5010e890 0x7f6a501b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:52.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.637+0000 7f6a56d01640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6a501185e0 con 0x7f6a5010e890 2024-09-19T09:08:52.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.637+0000 7f6a56d01640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6a50118460 con 0x7f6a50069ab0 2024-09-19T09:08:52.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.637+0000 7f6a56d01640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6a50118760 con 0x7f6a50109d70 2024-09-19T09:08:52.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.637+0000 7f6a4ffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a50109d70 0x7f6a5010be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:52.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.637+0000 7f6a54a9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a50069ab0 0x7f6a5010b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:52.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.637+0000 7f6a4ffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a50109d70 0x7f6a5010be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:33366/0 (socket says 172.21.15.92:33366) 2024-09-19T09:08:52.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.637+0000 7f6a4ffff640 1 -- 172.21.15.92:0/3713940156 learned_addr learned my addr 172.21.15.92:0/3713940156 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:52.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.637+0000 7f6a5529e640 1 --2- 172.21.15.92:0/3713940156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a5010e890 0x7f6a501b31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:52.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.638+0000 7f6a54a9d640 1 -- 172.21.15.92:0/3713940156 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a50109d70 msgr2=0x7f6a5010be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:52.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.638+0000 7f6a54a9d640 1 --2- 172.21.15.92:0/3713940156 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a50109d70 0x7f6a5010be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:52.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.638+0000 7f6a54a9d640 1 -- 172.21.15.92:0/3713940156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a5010e890 msgr2=0x7f6a501b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:52.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.638+0000 7f6a54a9d640 1 --2- 172.21.15.92:0/3713940156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a5010e890 0x7f6a501b31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:52.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.638+0000 7f6a54a9d640 1 -- 172.21.15.92:0/3713940156 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a501b36e0 con 0x7f6a50069ab0 2024-09-19T09:08:52.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.638+0000 7f6a4ffff640 1 --2- 172.21.15.92:0/3713940156 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a50109d70 0x7f6a5010be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:08:52.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.639+0000 7f6a54a9d640 1 --2- 172.21.15.92:0/3713940156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a50069ab0 0x7f6a5010b8c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6a4800dab0 tx=0x7f6a4800deb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:52.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.639+0000 7f6a4dffb640 1 -- 172.21.15.92:0/3713940156 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4800bd70 con 0x7f6a50069ab0 2024-09-19T09:08:52.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.640+0000 7f6a4dffb640 1 -- 172.21.15.92:0/3713940156 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a48003e50 con 0x7f6a50069ab0 2024-09-19T09:08:52.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.640+0000 7f6a4dffb640 1 -- 172.21.15.92:0/3713940156 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a480106c0 con 0x7f6a50069ab0 2024-09-19T09:08:52.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.641+0000 7f6a56d01640 1 -- 172.21.15.92:0/3713940156 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a501b38b0 con 0x7f6a50069ab0 2024-09-19T09:08:52.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.641+0000 7f6a56d01640 1 -- 172.21.15.92:0/3713940156 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a501b3d70 con 0x7f6a50069ab0 2024-09-19T09:08:52.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.643+0000 7f6a56d01640 1 -- 172.21.15.92:0/3713940156 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a50109450 con 0x7f6a50069ab0 2024-09-19T09:08:52.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.644+0000 7f6a4dffb640 1 -- 172.21.15.92:0/3713940156 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6a48003970 con 0x7f6a50069ab0 2024-09-19T09:08:52.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.645+0000 7f6a4dffb640 1 --2- 172.21.15.92:0/3713940156 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6a380a3410 0x7f6a380a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:52.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.645+0000 7f6a4dffb640 1 -- 172.21.15.92:0/3713940156 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f6a480cf1d0 con 0x7f6a50069ab0 2024-09-19T09:08:52.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.646+0000 7f6a4ffff640 1 --2- 172.21.15.92:0/3713940156 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6a380a3410 0x7f6a380a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:52.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.647+0000 7f6a4ffff640 1 --2- 172.21.15.92:0/3713940156 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6a380a3410 0x7f6a380a58d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6a40009460 tx=0x7f6a40005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:52.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:52.649+0000 7f6a4dffb640 1 -- 172.21.15.92:0/3713940156 <== mon.2 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6a48020020 con 0x7f6a50069ab0 2024-09-19T09:08:52.667 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:08:52.798 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:52 smithi092 ceph-mon[31407]: pgmap v702: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.4 MiB/s wr, 736 op/s 2024-09-19T09:08:53.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.025+0000 7f6a56d01640 1 -- 172.21.15.92:0/3713940156 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a5011c4a0 con 0x7f6a50069ab0 2024-09-19T09:08:53.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.028+0000 7f6a4dffb640 1 -- 172.21.15.92:0/3713940156 <== mon.2 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f6a4809bfc0 con 0x7f6a50069ab0 2024-09-19T09:08:53.030 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:08:53.030 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:08:53.031 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:08:53.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.031+0000 7f6a56d01640 1 -- 172.21.15.92:0/3713940156 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6a380a3410 msgr2=0x7f6a380a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:53.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.031+0000 7f6a56d01640 1 --2- 172.21.15.92:0/3713940156 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6a380a3410 0x7f6a380a58d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6a40009460 tx=0x7f6a40005d30 comp rx=0 tx=0).stop 2024-09-19T09:08:53.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.031+0000 7f6a56d01640 1 -- 172.21.15.92:0/3713940156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a50069ab0 msgr2=0x7f6a5010b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:53.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.031+0000 7f6a56d01640 1 --2- 172.21.15.92:0/3713940156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a50069ab0 0x7f6a5010b8c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6a4800dab0 tx=0x7f6a4800deb0 comp rx=0 tx=0).stop 2024-09-19T09:08:53.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.033+0000 7f6a56d01640 1 -- 172.21.15.92:0/3713940156 shutdown_connections 2024-09-19T09:08:53.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.033+0000 7f6a56d01640 1 --2- 172.21.15.92:0/3713940156 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6a380a3410 0x7f6a380a58d0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:53.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.033+0000 7f6a56d01640 1 --2- 172.21.15.92:0/3713940156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a5010e890 0x7f6a501b31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:53.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.033+0000 7f6a56d01640 1 --2- 172.21.15.92:0/3713940156 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a50109d70 0x7f6a5010be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:53.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.033+0000 7f6a56d01640 1 --2- 172.21.15.92:0/3713940156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a50069ab0 0x7f6a5010b8c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:53.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.033+0000 7f6a56d01640 1 -- 172.21.15.92:0/3713940156 >> 172.21.15.92:0/3713940156 conn(0x7f6a5006e2d0 msgr2=0x7f6a500709d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:53.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.033+0000 7f6a56d01640 1 -- 172.21.15.92:0/3713940156 shutdown_connections 2024-09-19T09:08:53.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.034+0000 7f6a56d01640 1 -- 172.21.15.92:0/3713940156 wait complete. 2024-09-19T09:08:53.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:52 smithi167 ceph-mon[35359]: pgmap v702: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.4 MiB/s wr, 736 op/s 2024-09-19T09:08:53.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:52 smithi190 ceph-mon[35358]: pgmap v702: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.4 MiB/s wr, 736 op/s 2024-09-19T09:08:53.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.246+0000 7f28c759e640 1 -- 172.21.15.92:0/1096310575 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f28c8077040 msgr2=0x7f28c8112320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:53.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.246+0000 7f28c759e640 1 --2- 172.21.15.92:0/1096310575 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f28c8077040 0x7f28c8112320 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f28bc009900 tx=0x7f28bc02a420 comp rx=0 tx=0).stop 2024-09-19T09:08:53.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.248+0000 7f28c759e640 1 -- 172.21.15.92:0/1096310575 shutdown_connections 2024-09-19T09:08:53.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.248+0000 7f28c759e640 1 --2- 172.21.15.92:0/1096310575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28c8112860 0x7f28c8114c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:53.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.248+0000 7f28c759e640 1 --2- 172.21.15.92:0/1096310575 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f28c8077040 0x7f28c8112320 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:53.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.248+0000 7f28c759e640 1 --2- 172.21.15.92:0/1096310575 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28c8076720 0x7f28c8076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:53.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.248+0000 7f28c759e640 1 -- 172.21.15.92:0/1096310575 >> 172.21.15.92:0/1096310575 conn(0x7f28c80ff860 msgr2=0x7f28c8101c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:53.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.252+0000 7f28c759e640 1 -- 172.21.15.92:0/1096310575 shutdown_connections 2024-09-19T09:08:53.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.253+0000 7f28c759e640 1 -- 172.21.15.92:0/1096310575 wait complete. 2024-09-19T09:08:53.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.254+0000 7f28c759e640 1 Processor -- start 2024-09-19T09:08:53.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.256+0000 7f28c759e640 1 -- start start 2024-09-19T09:08:53.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.257+0000 7f28c759e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28c8077040 0x7f28c81121d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:53.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.257+0000 7f28c759e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f28c8112860 0x7f28c810c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:53.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.257+0000 7f28c759e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28c810c790 0x7f28c810cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:53.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.257+0000 7f28c759e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f28c8104660 con 0x7f28c8077040 2024-09-19T09:08:53.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.257+0000 7f28c759e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f28c81044e0 con 0x7f28c810c790 2024-09-19T09:08:53.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.257+0000 7f28c759e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f28c81047e0 con 0x7f28c8112860 2024-09-19T09:08:53.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.257+0000 7f28c659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28c8077040 0x7f28c81121d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:53.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.257+0000 7f28c659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28c8077040 0x7f28c81121d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51582/0 (socket says 172.21.15.92:51582) 2024-09-19T09:08:53.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.257+0000 7f28c5d9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f28c8112860 0x7f28c810c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:53.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.257+0000 7f28c659c640 1 -- 172.21.15.92:0/3281477731 learned_addr learned my addr 172.21.15.92:0/3281477731 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:53.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.257+0000 7f28c6d9d640 1 --2- 172.21.15.92:0/3281477731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28c810c790 0x7f28c810cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:53.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.258+0000 7f28c659c640 1 -- 172.21.15.92:0/3281477731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f28c8112860 msgr2=0x7f28c810c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:53.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.258+0000 7f28c659c640 1 --2- 172.21.15.92:0/3281477731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f28c8112860 0x7f28c810c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:53.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.258+0000 7f28c659c640 1 -- 172.21.15.92:0/3281477731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28c810c790 msgr2=0x7f28c810cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:53.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.258+0000 7f28c659c640 1 --2- 172.21.15.92:0/3281477731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28c810c790 0x7f28c810cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:53.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.258+0000 7f28c659c640 1 -- 172.21.15.92:0/3281477731 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28c81b3870 con 0x7f28c8077040 2024-09-19T09:08:53.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.258+0000 7f28c659c640 1 --2- 172.21.15.92:0/3281477731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28c8077040 0x7f28c81121d0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f28c000b990 tx=0x7f28c000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:53.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.262+0000 7f28b77fe640 1 -- 172.21.15.92:0/3281477731 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c0019070 con 0x7f28c8077040 2024-09-19T09:08:53.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.262+0000 7f28b77fe640 1 -- 172.21.15.92:0/3281477731 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28c0014440 con 0x7f28c8077040 2024-09-19T09:08:53.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.263+0000 7f28c759e640 1 -- 172.21.15.92:0/3281477731 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28c81b3b60 con 0x7f28c8077040 2024-09-19T09:08:53.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.263+0000 7f28b77fe640 1 -- 172.21.15.92:0/3281477731 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c00125e0 con 0x7f28c8077040 2024-09-19T09:08:53.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.263+0000 7f28c759e640 1 -- 172.21.15.92:0/3281477731 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28c81b4020 con 0x7f28c8077040 2024-09-19T09:08:53.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.267+0000 7f28cee45740 1 Processor -- start 2024-09-19T09:08:53.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.268+0000 7f28cee45740 1 -- start start 2024-09-19T09:08:53.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.269+0000 7f28cee45740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56112431fcf0 0x56112431e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:53.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.269+0000 7f28cee45740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56112431e780 0x56112431ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:53.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.269+0000 7f28cee45740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561124329520 0x56112432b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:53.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.269+0000 7f28cee45740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5611242842f0 con 0x56112431e780 2024-09-19T09:08:53.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.269+0000 7f28cee45740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56112422bcf0 con 0x561124329520 2024-09-19T09:08:53.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.269+0000 7f28cee45740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5611242802b0 con 0x56112431fcf0 2024-09-19T09:08:53.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.270+0000 7f28b77fe640 1 -- 172.21.15.92:0/3281477731 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f28c000cb20 con 0x7f28c8077040 2024-09-19T09:08:53.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.270+0000 7f28c5d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561124329520 0x56112432b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:53.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.270+0000 7f28c5d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561124329520 0x56112432b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:59136/0 (socket says 172.21.15.92:59136) 2024-09-19T09:08:53.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.270+0000 7f28c5d9b640 1 -- 172.21.15.92:0/325089076 learned_addr learned my addr 172.21.15.92:0/325089076 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:53.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.270+0000 7f28c6d9d640 1 --2- 172.21.15.92:0/325089076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56112431fcf0 0x56112431e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:53.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.270+0000 7f28c5d9b640 1 -- 172.21.15.92:0/325089076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56112431fcf0 msgr2=0x56112431e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:53.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.270+0000 7f28c5d9b640 1 --2- 172.21.15.92:0/325089076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56112431fcf0 0x56112431e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:53.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.270+0000 7f28c5d9b640 1 -- 172.21.15.92:0/325089076 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56112431e780 msgr2=0x56112431ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:53.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.270+0000 7f28c5d9b640 1 --2- 172.21.15.92:0/325089076 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56112431e780 0x56112431ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:53.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.270+0000 7f28c5d9b640 1 -- 172.21.15.92:0/325089076 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611242103a0 con 0x561124329520 2024-09-19T09:08:53.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.271+0000 7f28c5d9b640 1 --2- 172.21.15.92:0/325089076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561124329520 0x56112432b910 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f28bc009230 tx=0x7f28bc0314b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a693fb996088bd48 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:53.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.272+0000 7f28b77fe640 1 --2- 172.21.15.92:0/3281477731 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f28b00a3240 0x7f28b00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:53.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.272+0000 7f28c6d9d640 1 --2- 172.21.15.92:0/3281477731 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f28b00a3240 0x7f28b00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:53.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.272+0000 7f28b77fe640 1 -- 172.21.15.92:0/3281477731 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f28c00cc780 con 0x7f28c8077040 2024-09-19T09:08:53.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.272+0000 7f28b4ff9640 1 -- 172.21.15.92:0/325089076 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28bc040030 con 0x561124329520 2024-09-19T09:08:53.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.272+0000 7f28b4ff9640 1 -- 172.21.15.92:0/325089076 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28bc0315b0 con 0x561124329520 2024-09-19T09:08:53.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.273+0000 7f28b4ff9640 1 -- 172.21.15.92:0/325089076 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28bc035040 con 0x561124329520 2024-09-19T09:08:53.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.273+0000 7f28cee45740 1 -- 172.21.15.92:0/325089076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561124329520 msgr2=0x56112432b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:53.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.273+0000 7f28cee45740 1 --2- 172.21.15.92:0/325089076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561124329520 0x56112432b910 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f28bc009230 tx=0x7f28bc0314b0 comp rx=0 tx=0).stop 2024-09-19T09:08:53.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.274+0000 7f28c6d9d640 1 --2- 172.21.15.92:0/3281477731 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f28b00a3240 0x7f28b00a5700 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f28b800b7f0 tx=0x7f28b800b2e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:53.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.274+0000 7f28cee45740 1 -- 172.21.15.92:0/325089076 shutdown_connections 2024-09-19T09:08:53.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.274+0000 7f28cee45740 1 --2- 172.21.15.92:0/325089076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561124329520 0x56112432b910 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:53.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.274+0000 7f28cee45740 1 --2- 172.21.15.92:0/325089076 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56112431e780 0x56112431ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:53.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.274+0000 7f28cee45740 1 --2- 172.21.15.92:0/325089076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56112431fcf0 0x56112431e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:53.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.274+0000 7f28cee45740 1 -- 172.21.15.92:0/325089076 >> 172.21.15.92:0/325089076 conn(0x5611242e7310 msgr2=0x56112431ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:53.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.274+0000 7f28cee45740 1 -- 172.21.15.92:0/325089076 shutdown_connections 2024-09-19T09:08:53.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.274+0000 7f28cee45740 1 -- 172.21.15.92:0/325089076 wait complete. 2024-09-19T09:08:53.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.274+0000 7f28cee45740 1 -- start start 2024-09-19T09:08:53.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.274+0000 7f28cee45740 1 Processor -- start 2024-09-19T09:08:53.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.275+0000 7f28cee45740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56112431e780 0x561124328d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:53.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.275+0000 7f28cee45740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56112431fcf0 0x561124326040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:53.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.275+0000 7f28cee45740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561124329520 0x561124326580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:53.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.275+0000 7f28cee45740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56112432c260 con 0x56112431fcf0 2024-09-19T09:08:53.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.275+0000 7f28cee45740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56112423f060 con 0x561124329520 2024-09-19T09:08:53.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.275+0000 7f28cee45740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56112432c3e0 con 0x56112431e780 2024-09-19T09:08:53.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.275+0000 7f28cee45740 10 client.0 _ll_register_callbacks cb 0x561123f928c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:53.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.275+0000 7f28c659c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56112431e780 0x561124328d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:53.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.276+0000 7f28c659c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56112431e780 0x561124328d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:33414/0 (socket says 172.21.15.92:33414) 2024-09-19T09:08:53.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.276+0000 7f28c6d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561124329520 0x561124326580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:53.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.276+0000 7f28c5d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56112431fcf0 0x561124326040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:53.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.276+0000 7f28c6d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561124329520 0x561124326580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:59146/0 (socket says 172.21.15.92:59146) 2024-09-19T09:08:53.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.276+0000 7f28c6d9d640 1 -- 172.21.15.92:0/2652226137 learned_addr learned my addr 172.21.15.92:0/2652226137 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:53.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.276+0000 7f28c5d9b640 1 -- 172.21.15.92:0/2652226137 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56112431e780 msgr2=0x561124328d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:53.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.276+0000 7f28c5d9b640 1 --2- 172.21.15.92:0/2652226137 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56112431e780 0x561124328d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:53.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.276+0000 7f28c5d9b640 1 -- 172.21.15.92:0/2652226137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561124329520 msgr2=0x561124326580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:53.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.276+0000 7f28c5d9b640 1 --2- 172.21.15.92:0/2652226137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561124329520 0x561124326580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:53.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.276+0000 7f28c5d9b640 1 -- 172.21.15.92:0/2652226137 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561123ff53c0 con 0x56112431fcf0 2024-09-19T09:08:53.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.276+0000 7f28c6d9d640 1 --2- 172.21.15.92:0/2652226137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561124329520 0x561124326580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:08:53.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.276+0000 7f28c659c640 1 --2- 172.21.15.92:0/2652226137 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56112431e780 0x561124328d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:08:53.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.276+0000 7f28c5d9b640 1 --2- 172.21.15.92:0/2652226137 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56112431fcf0 0x561124326040 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f28bc000c00 tx=0x7f28bc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e078f578c8ade7d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:53.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.277+0000 7f28adffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:08:53.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.277+0000 7f28adffb640 1 -- 172.21.15.92:0/2652226137 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28bc035050 con 0x56112431fcf0 2024-09-19T09:08:53.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.277+0000 7f28cee45740 1 -- 172.21.15.92:0/2652226137 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28bc0315b0 con 0x56112431fcf0 2024-09-19T09:08:53.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.277+0000 7f28adffb640 1 -- 172.21.15.92:0/2652226137 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f28bc0035f0 con 0x56112431fcf0 2024-09-19T09:08:53.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.277+0000 7f28adffb640 1 -- 172.21.15.92:0/2652226137 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f28bc040040 con 0x56112431fcf0 2024-09-19T09:08:53.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.277+0000 7f28cee45740 10 client.18237 fetch_fsmap learned FSMap version 19 2024-09-19T09:08:53.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.277+0000 7f28cee45740 1 -- 172.21.15.92:0/2652226137 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x561124337c20 con 0x56112431fcf0 2024-09-19T09:08:53.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.278+0000 7f28adffb640 1 -- 172.21.15.92:0/2652226137 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28bc0315b0 con 0x56112431fcf0 2024-09-19T09:08:53.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.278+0000 7f28adffb640 1 -- 172.21.15.92:0/2652226137 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f28bc03a040 con 0x56112431fcf0 2024-09-19T09:08:53.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.278+0000 7f28cee45740 10 client.18237 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:08:53.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.278+0000 7f28cee45740 10 client.18237 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:08:53.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.278+0000 7f28cee45740 20 client.18237 populate_metadata read hostname 'smithi092' 2024-09-19T09:08:53.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.278+0000 7f28cee45740 1 --2- 172.21.15.92:0/2652226137 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561124339170 0x56112433b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:53.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.278+0000 7f28cee45740 4 client.18237 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:08:53.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.278+0000 7f28cee45740 1 -- 172.21.15.92:0/2652226137 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561124291860 con 0x561124339170 2024-09-19T09:08:53.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.279+0000 7f28c659c640 1 --2- 172.21.15.92:0/2652226137 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561124339170 0x56112433b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:53.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.280+0000 7f28adffb640 10 client.18237 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:53.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.280+0000 7f28c659c640 1 --2- 172.21.15.92:0/2652226137 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561124339170 0x56112433b5a0 crc :-1 s=READY pgs=367 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4935f13ac409fc1a server_cookie=1f89b57395a93189 in_seq=0 out_seq=0 2024-09-19T09:08:53.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.281+0000 7f28adffb640 1 -- 172.21.15.92:0/2652226137 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561124291860 con 0x561124339170 2024-09-19T09:08:53.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.281+0000 7f28adffb640 10 client.18237 handle_command_reply: tid=0 2024-09-19T09:08:53.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.281+0000 7f28cee45740 1 client.18237 shutdown 2024-09-19T09:08:53.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.281+0000 7f28cee45740 1 -- 172.21.15.92:0/2652226137 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56112431fcf0 msgr2=0x561124326040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:53.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.281+0000 7f28cee45740 1 --2- 172.21.15.92:0/2652226137 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56112431fcf0 0x561124326040 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f28bc000c00 tx=0x7f28bc009260 comp rx=0 tx=0).stop 2024-09-19T09:08:53.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.281+0000 7f28cee45740 1 -- 172.21.15.92:0/2652226137 shutdown_connections 2024-09-19T09:08:53.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.281+0000 7f28cee45740 1 --2- 172.21.15.92:0/2652226137 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561124339170 0x56112433b5a0 crc :-1 s=READY pgs=367 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:53.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.281+0000 7f28cee45740 1 --2- 172.21.15.92:0/2652226137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561124329520 0x561124326580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:53.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.281+0000 7f28cee45740 1 --2- 172.21.15.92:0/2652226137 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56112431fcf0 0x561124326040 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:53.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.281+0000 7f28cee45740 1 --2- 172.21.15.92:0/2652226137 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56112431e780 0x561124328d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:53.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.281+0000 7f28cee45740 1 -- 172.21.15.92:0/2652226137 >> 172.21.15.92:0/2652226137 conn(0x5611242e7310 msgr2=0x561124320ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:53.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.281+0000 7f28adffb640 0 client.18237 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:53.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.281+0000 7f28cee45740 1 -- 172.21.15.92:0/2652226137 shutdown_connections 2024-09-19T09:08:53.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.281+0000 7f28cee45740 1 -- 172.21.15.92:0/2652226137 wait complete. 2024-09-19T09:08:53.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.281+0000 7f28cee45740 20 client.18237 trim_cache size 0 max 16384 2024-09-19T09:08:53.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.302+0000 7f28cee45740 1 Processor -- start 2024-09-19T09:08:53.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.302+0000 7f28cee45740 1 -- start start 2024-09-19T09:08:53.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.302+0000 7f28cee45740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56112431e780 0x5611243212d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:53.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.302+0000 7f28cee45740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56112431fcf0 0x561124321810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:53.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.302+0000 7f28cee45740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561124329520 0x561124340eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:53.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.303+0000 7f28cee45740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f28c81ba4b0 con 0x561124329520 2024-09-19T09:08:53.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.303+0000 7f28c5d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56112431fcf0 0x561124321810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:53.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.303+0000 7f28c659c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56112431e780 0x5611243212d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:53.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.303+0000 7f28c5d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56112431fcf0 0x561124321810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:59160/0 (socket says 172.21.15.92:59160) 2024-09-19T09:08:53.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.303+0000 7f28c5d9b640 1 -- 172.21.15.92:0/3157476981 learned_addr learned my addr 172.21.15.92:0/3157476981 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:53.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.303+0000 7f28cee45740 1 -- 172.21.15.92:0/3157476981 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f28c81bcd50 con 0x56112431fcf0 2024-09-19T09:08:53.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.303+0000 7f28cee45740 1 -- 172.21.15.92:0/3157476981 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f28c81bab40 con 0x56112431e780 2024-09-19T09:08:53.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.303+0000 7f28c6d9d640 1 --2- 172.21.15.92:0/3157476981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561124329520 0x561124340eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:53.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.303+0000 7f28c659c640 1 -- 172.21.15.92:0/3157476981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56112431fcf0 msgr2=0x561124321810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:53.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.303+0000 7f28c659c640 1 --2- 172.21.15.92:0/3157476981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56112431fcf0 0x561124321810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:53.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.303+0000 7f28c659c640 1 -- 172.21.15.92:0/3157476981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561124329520 msgr2=0x561124340eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:53.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.303+0000 7f28c659c640 1 --2- 172.21.15.92:0/3157476981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561124329520 0x561124340eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:53.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.303+0000 7f28c659c640 1 -- 172.21.15.92:0/3157476981 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561124324590 con 0x56112431e780 2024-09-19T09:08:53.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.303+0000 7f28c6d9d640 1 --2- 172.21.15.92:0/3157476981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561124329520 0x561124340eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:08:53.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.304+0000 7f28c659c640 1 --2- 172.21.15.92:0/3157476981 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56112431e780 0x5611243212d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f28c00cc640 tx=0x7f28c00bb040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b704b4ad4fd3cb93 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:53.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.304+0000 7f28affff640 1 -- 172.21.15.92:0/3157476981 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c00d3060 con 0x56112431e780 2024-09-19T09:08:53.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.304+0000 7f28affff640 1 -- 172.21.15.92:0/3157476981 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x561124291860 con 0x56112431e780 2024-09-19T09:08:53.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.304+0000 7f28affff640 1 -- 172.21.15.92:0/3157476981 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c00bb0b0 con 0x56112431e780 2024-09-19T09:08:53.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.305+0000 7f28cee45740 1 -- 172.21.15.92:0/3157476981 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56112431e780 msgr2=0x5611243212d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:53.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.305+0000 7f28cee45740 1 --2- 172.21.15.92:0/3157476981 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56112431e780 0x5611243212d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f28c00cc640 tx=0x7f28c00bb040 comp rx=0 tx=0).stop 2024-09-19T09:08:53.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.305+0000 7f28cee45740 1 -- 172.21.15.92:0/3157476981 shutdown_connections 2024-09-19T09:08:53.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.305+0000 7f28cee45740 1 --2- 172.21.15.92:0/3157476981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561124329520 0x561124340eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:53.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.305+0000 7f28cee45740 1 --2- 172.21.15.92:0/3157476981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56112431fcf0 0x561124321810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:53.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.305+0000 7f28cee45740 1 --2- 172.21.15.92:0/3157476981 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56112431e780 0x5611243212d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:53.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.305+0000 7f28cee45740 1 -- 172.21.15.92:0/3157476981 >> 172.21.15.92:0/3157476981 conn(0x5611242e7310 msgr2=0x5611243280c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:53.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.305+0000 7f28cee45740 1 -- 172.21.15.92:0/3157476981 shutdown_connections 2024-09-19T09:08:53.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.305+0000 7f28cee45740 1 -- 172.21.15.92:0/3157476981 wait complete. 2024-09-19T09:08:53.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.305+0000 7f28cee45740 1 -- start start 2024-09-19T09:08:53.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.306+0000 7f28cee45740 1 Processor -- start 2024-09-19T09:08:53.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.306+0000 7f28cee45740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56112431e780 0x561124331a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:53.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.306+0000 7f28cee45740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56112431fcf0 0x561124331f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:53.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.306+0000 7f28cee45740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561124329520 0x561124322a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:53.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.306+0000 7f28c659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56112431e780 0x561124331a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:53.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.306+0000 7f28c5d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56112431fcf0 0x561124331f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:53.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.306+0000 7f28c5d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56112431fcf0 0x561124331f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:59174/0 (socket says 172.21.15.92:59174) 2024-09-19T09:08:53.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.306+0000 7f28cee45740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f28c81bb210 con 0x56112431e780 2024-09-19T09:08:53.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.306+0000 7f28c5d9b640 1 -- 172.21.15.92:0/1088910000 learned_addr learned my addr 172.21.15.92:0/1088910000 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:53.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.306+0000 7f28cee45740 1 -- 172.21.15.92:0/1088910000 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f28c81bc680 con 0x56112431fcf0 2024-09-19T09:08:53.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.306+0000 7f28cee45740 1 -- 172.21.15.92:0/1088910000 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f28c81bb8e0 con 0x561124329520 2024-09-19T09:08:53.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.306+0000 7f28c6d9d640 1 --2- 172.21.15.92:0/1088910000 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561124329520 0x561124322a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:53.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.306+0000 7f28cee45740 10 client.0 _ll_register_callbacks cb 0x7f28b8004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:53.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.307+0000 7f28c5d9b640 1 -- 172.21.15.92:0/1088910000 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561124329520 msgr2=0x561124322a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:53.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.307+0000 7f28c5d9b640 1 --2- 172.21.15.92:0/1088910000 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561124329520 0x561124322a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:53.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.307+0000 7f28c5d9b640 1 -- 172.21.15.92:0/1088910000 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56112431e780 msgr2=0x561124331a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:53.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.307+0000 7f28c5d9b640 1 --2- 172.21.15.92:0/1088910000 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56112431e780 0x561124331a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:53.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.307+0000 7f28c5d9b640 1 -- 172.21.15.92:0/1088910000 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611243232b0 con 0x56112431fcf0 2024-09-19T09:08:53.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.307+0000 7f28c5d9b640 1 --2- 172.21.15.92:0/1088910000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56112431fcf0 0x561124331f40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f28bc0057c0 tx=0x7f28bc005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a0b5b0a56e0137f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:53.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.307+0000 7f28adffb640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:08:53.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.307+0000 7f28adffb640 1 -- 172.21.15.92:0/1088910000 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28bc061060 con 0x56112431fcf0 2024-09-19T09:08:53.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.307+0000 7f28cee45740 1 -- 172.21.15.92:0/1088910000 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561124291860 con 0x56112431fcf0 2024-09-19T09:08:53.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.307+0000 7f28adffb640 1 -- 172.21.15.92:0/1088910000 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f28bc004450 con 0x56112431fcf0 2024-09-19T09:08:53.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.307+0000 7f28adffb640 1 -- 172.21.15.92:0/1088910000 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f28bc035040 con 0x56112431fcf0 2024-09-19T09:08:53.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.307+0000 7f28cee45740 10 client.27530 fetch_fsmap learned FSMap version 19 2024-09-19T09:08:53.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.307+0000 7f28cee45740 1 -- 172.21.15.92:0/1088910000 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5611243a3a80 con 0x56112431fcf0 2024-09-19T09:08:53.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.308+0000 7f28adffb640 1 -- 172.21.15.92:0/1088910000 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x561124291860 con 0x56112431fcf0 2024-09-19T09:08:53.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.309+0000 7f28adffb640 1 -- 172.21.15.92:0/1088910000 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f28bc066070 con 0x56112431fcf0 2024-09-19T09:08:53.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.309+0000 7f28cee45740 10 client.27530 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:08:53.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.310+0000 7f28cee45740 10 client.27530 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:08:53.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.310+0000 7f28cee45740 20 client.27530 populate_metadata read hostname 'smithi092' 2024-09-19T09:08:53.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.310+0000 7f28cee45740 1 --2- 172.21.15.92:0/1088910000 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5611243a4140 0x5611243a6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:53.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.310+0000 7f28cee45740 4 client.27530 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:08:53.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.310+0000 7f28cee45740 1 -- 172.21.15.92:0/1088910000 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56112428bd70 con 0x5611243a4140 2024-09-19T09:08:53.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.310+0000 7f28c659c640 1 --2- 172.21.15.92:0/1088910000 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5611243a4140 0x5611243a6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:53.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.311+0000 7f28adffb640 10 client.27530 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:53.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.311+0000 7f28c659c640 1 --2- 172.21.15.92:0/1088910000 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5611243a4140 0x5611243a6560 crc :-1 s=READY pgs=368 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbc82636d36c926b server_cookie=bfc11f4a40d8fceb in_seq=0 out_seq=0 2024-09-19T09:08:53.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.312+0000 7f28adffb640 1 -- 172.21.15.92:0/1088910000 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56112428bd70 con 0x5611243a4140 2024-09-19T09:08:53.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.312+0000 7f28adffb640 10 client.27530 handle_command_reply: tid=0 2024-09-19T09:08:53.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.312+0000 7f28cee45740 1 client.27530 shutdown 2024-09-19T09:08:53.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.312+0000 7f28cee45740 1 -- 172.21.15.92:0/1088910000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56112431fcf0 msgr2=0x561124331f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:53.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.312+0000 7f28cee45740 1 --2- 172.21.15.92:0/1088910000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56112431fcf0 0x561124331f40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f28bc0057c0 tx=0x7f28bc005850 comp rx=0 tx=0).stop 2024-09-19T09:08:53.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.312+0000 7f28cee45740 1 -- 172.21.15.92:0/1088910000 shutdown_connections 2024-09-19T09:08:53.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.312+0000 7f28cee45740 1 --2- 172.21.15.92:0/1088910000 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5611243a4140 0x5611243a6560 crc :-1 s=READY pgs=368 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:53.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.312+0000 7f28adffb640 0 client.27530 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:53.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.312+0000 7f28cee45740 1 --2- 172.21.15.92:0/1088910000 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561124329520 0x561124322a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:53.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.312+0000 7f28cee45740 1 --2- 172.21.15.92:0/1088910000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56112431fcf0 0x561124331f40 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:53.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.312+0000 7f28cee45740 1 --2- 172.21.15.92:0/1088910000 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56112431e780 0x561124331a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:53.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.312+0000 7f28cee45740 1 -- 172.21.15.92:0/1088910000 >> 172.21.15.92:0/1088910000 conn(0x5611242e7310 msgr2=0x561124319690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:53.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.313+0000 7f28cee45740 1 -- 172.21.15.92:0/1088910000 shutdown_connections 2024-09-19T09:08:53.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.313+0000 7f28cee45740 1 -- 172.21.15.92:0/1088910000 wait complete. 2024-09-19T09:08:53.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.313+0000 7f28cee45740 20 client.27530 trim_cache size 0 max 16384 2024-09-19T09:08:53.317 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-19T09:08:53.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.314+0000 7f28c759e640 1 -- 172.21.15.92:0/3281477731 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f28b00a3240 msgr2=0x7f28b00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:53.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.314+0000 7f28c759e640 1 --2- 172.21.15.92:0/3281477731 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f28b00a3240 0x7f28b00a5700 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f28b800b7f0 tx=0x7f28b800b2e0 comp rx=0 tx=0).stop 2024-09-19T09:08:53.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.314+0000 7f28c759e640 1 -- 172.21.15.92:0/3281477731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28c8077040 msgr2=0x7f28c81121d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:53.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.314+0000 7f28c759e640 1 --2- 172.21.15.92:0/3281477731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28c8077040 0x7f28c81121d0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f28c000b990 tx=0x7f28c000be50 comp rx=0 tx=0).stop 2024-09-19T09:08:53.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.314+0000 7f28c759e640 1 -- 172.21.15.92:0/3281477731 shutdown_connections 2024-09-19T09:08:53.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.314+0000 7f28c759e640 1 --2- 172.21.15.92:0/3281477731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28c810c790 0x7f28c810cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:53.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.314+0000 7f28c759e640 1 --2- 172.21.15.92:0/3281477731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f28c8112860 0x7f28c810c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:53.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.314+0000 7f28c759e640 1 --2- 172.21.15.92:0/3281477731 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f28b00a3240 0x7f28b00a5700 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:53.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.314+0000 7f28c759e640 1 --2- 172.21.15.92:0/3281477731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28c8077040 0x7f28c81121d0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:53.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.314+0000 7f28c759e640 1 -- 172.21.15.92:0/3281477731 >> 172.21.15.92:0/3281477731 conn(0x7f28c80ff860 msgr2=0x7f28c8113dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:53.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.314+0000 7f28c759e640 1 -- 172.21.15.92:0/3281477731 shutdown_connections 2024-09-19T09:08:53.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:53.314+0000 7f28c759e640 1 -- 172.21.15.92:0/3281477731 wait complete. 2024-09-19T09:08:53.916 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:53 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3713940156' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:08:53.916 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:53 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:08:53.957 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 142.2 --await-for 45.0' 2024-09-19T09:08:53.957 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 142.2 --await-for 45.0 2024-09-19T09:08:54.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:53 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3713940156' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:08:54.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:53 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:08:54.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:53 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3713940156' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:08:54.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:53 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:08:54.696 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:08:54.839 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:54 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:08:54.839 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:54 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:08:54.839 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:54 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:08:54.839 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:54 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:08:54.840 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:54 smithi092 ceph-mon[31407]: pgmap v703: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.4 MiB/s wr, 742 op/s 2024-09-19T09:08:55.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:54 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:08:55.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:54 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:08:55.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:54 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:08:55.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:54 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:08:55.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:54 smithi167 ceph-mon[35359]: pgmap v703: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.4 MiB/s wr, 742 op/s 2024-09-19T09:08:55.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:54 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:08:55.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:54 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:08:55.125 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:54 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:08:55.125 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:54 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:08:55.125 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:54 smithi190 ceph-mon[35358]: pgmap v703: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.4 MiB/s wr, 742 op/s 2024-09-19T09:08:55.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.564+0000 7fa082409640 1 -- 172.21.15.92:0/3646128614 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa07c109830 msgr2=0x7fa07c109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:55.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.564+0000 7fa082409640 1 --2- 172.21.15.92:0/3646128614 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa07c109830 0x7fa07c109c90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa06c009900 tx=0x7fa06c02a410 comp rx=0 tx=0).stop 2024-09-19T09:08:55.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.565+0000 7fa082409640 1 -- 172.21.15.92:0/3646128614 shutdown_connections 2024-09-19T09:08:55.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.565+0000 7fa082409640 1 --2- 172.21.15.92:0/3646128614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa07c11b140 0x7fa07c11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:55.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.565+0000 7fa082409640 1 --2- 172.21.15.92:0/3646128614 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa07c109830 0x7fa07c109c90 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:55.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.565+0000 7fa082409640 1 --2- 172.21.15.92:0/3646128614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa07c109450 0x7fa07c110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:55.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.565+0000 7fa082409640 1 -- 172.21.15.92:0/3646128614 >> 172.21.15.92:0/3646128614 conn(0x7fa07c06e140 msgr2=0x7fa07c06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:55.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.565+0000 7fa082409640 1 -- 172.21.15.92:0/3646128614 shutdown_connections 2024-09-19T09:08:55.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.565+0000 7fa082409640 1 -- 172.21.15.92:0/3646128614 wait complete. 2024-09-19T09:08:55.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.566+0000 7fa082409640 1 Processor -- start 2024-09-19T09:08:55.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.566+0000 7fa082409640 1 -- start start 2024-09-19T09:08:55.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.566+0000 7fa082409640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa07c109450 0x7fa07c118700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:55.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.566+0000 7fa082409640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa07c109830 0x7fa07c111790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:55.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.566+0000 7fa082409640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa07c11b140 0x7fa07c111cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:55.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.566+0000 7fa082409640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa07c120df0 con 0x7fa07c109450 2024-09-19T09:08:55.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.566+0000 7fa082409640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa07c120c70 con 0x7fa07c109830 2024-09-19T09:08:55.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.566+0000 7fa082409640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa07c120f70 con 0x7fa07c11b140 2024-09-19T09:08:55.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.567+0000 7fa07bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa07c109450 0x7fa07c118700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:55.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.567+0000 7fa07b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa07c109830 0x7fa07c111790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:55.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.567+0000 7fa07b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa07c109830 0x7fa07c111790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:59190/0 (socket says 172.21.15.92:59190) 2024-09-19T09:08:55.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.567+0000 7fa07b7fe640 1 -- 172.21.15.92:0/1575475799 learned_addr learned my addr 172.21.15.92:0/1575475799 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:55.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.567+0000 7fa0809a6640 1 --2- 172.21.15.92:0/1575475799 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa07c11b140 0x7fa07c111cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:55.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.568+0000 7fa07b7fe640 1 -- 172.21.15.92:0/1575475799 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa07c11b140 msgr2=0x7fa07c111cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:55.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.568+0000 7fa07b7fe640 1 --2- 172.21.15.92:0/1575475799 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa07c11b140 0x7fa07c111cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:55.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.568+0000 7fa07b7fe640 1 -- 172.21.15.92:0/1575475799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa07c109450 msgr2=0x7fa07c118700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:55.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.568+0000 7fa07b7fe640 1 --2- 172.21.15.92:0/1575475799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa07c109450 0x7fa07c118700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:55.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.569+0000 7fa07b7fe640 1 -- 172.21.15.92:0/1575475799 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa07c112290 con 0x7fa07c109830 2024-09-19T09:08:55.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.570+0000 7fa07b7fe640 1 --2- 172.21.15.92:0/1575475799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa07c109830 0x7fa07c111790 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa06c000c00 tx=0x7fa06c003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:55.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.571+0000 7fa0797fa640 1 -- 172.21.15.92:0/1575475799 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06c03f070 con 0x7fa07c109830 2024-09-19T09:08:55.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.571+0000 7fa082409640 1 -- 172.21.15.92:0/1575475799 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa07c112520 con 0x7fa07c109830 2024-09-19T09:08:55.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.571+0000 7fa0797fa640 1 -- 172.21.15.92:0/1575475799 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa06c031c90 con 0x7fa07c109830 2024-09-19T09:08:55.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.571+0000 7fa082409640 1 -- 172.21.15.92:0/1575475799 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa07c116510 con 0x7fa07c109830 2024-09-19T09:08:55.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.572+0000 7fa0797fa640 1 -- 172.21.15.92:0/1575475799 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06c03f070 con 0x7fa07c109830 2024-09-19T09:08:55.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.575+0000 7fa0847e2740 1 Processor -- start 2024-09-19T09:08:55.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.576+0000 7fa0847e2740 1 -- start start 2024-09-19T09:08:55.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.576+0000 7fa0847e2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5586a6fc3760 0x5586a6fc3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:55.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.576+0000 7fa0847e2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586a6fc4080 0x5586a6fce400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:55.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.576+0000 7fa0847e2740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5586a6fce940 0x5586a6fd0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:55.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.576+0000 7fa0847e2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5586a6f292a0 con 0x5586a6fc4080 2024-09-19T09:08:55.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.576+0000 7fa0847e2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5586a6ed0b10 con 0x5586a6fc3760 2024-09-19T09:08:55.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.576+0000 7fa0847e2740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5586a6f25260 con 0x5586a6fce940 2024-09-19T09:08:55.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.578+0000 7fa0797fa640 1 -- 172.21.15.92:0/1575475799 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa06c042070 con 0x7fa07c109830 2024-09-19T09:08:55.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.578+0000 7fa0809a6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5586a6fc3760 0x5586a6fc3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:55.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.579+0000 7fa07bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586a6fc4080 0x5586a6fce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:55.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.579+0000 7fa07bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586a6fc4080 0x5586a6fce400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51638/0 (socket says 172.21.15.92:51638) 2024-09-19T09:08:55.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.579+0000 7fa07bfff640 1 -- 172.21.15.92:0/1220879951 learned_addr learned my addr 172.21.15.92:0/1220879951 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:55.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.579+0000 7fa07b7fe640 1 --2- 172.21.15.92:0/1220879951 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5586a6fce940 0x5586a6fd0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:55.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.579+0000 7fa0797fa640 1 --2- 172.21.15.92:0/1575475799 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa0640a3690 0x7fa0640a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:55.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.580+0000 7fa0797fa640 1 -- 172.21.15.92:0/1575475799 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa06c0315b0 con 0x7fa07c109830 2024-09-19T09:08:55.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.580+0000 7fa0809a6640 1 -- 172.21.15.92:0/1220879951 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5586a6fce940 msgr2=0x5586a6fd0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:55.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.580+0000 7fa0809a6640 1 --2- 172.21.15.92:0/1220879951 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5586a6fce940 0x5586a6fd0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:55.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.580+0000 7fa0809a6640 1 -- 172.21.15.92:0/1220879951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586a6fc4080 msgr2=0x5586a6fce400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:55.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.580+0000 7fa0809a6640 1 --2- 172.21.15.92:0/1220879951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586a6fc4080 0x5586a6fce400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:55.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.580+0000 7fa0809a6640 1 -- 172.21.15.92:0/1220879951 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586a6c9ab90 con 0x5586a6fc3760 2024-09-19T09:08:55.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.582+0000 7fa0809a6640 1 --2- 172.21.15.92:0/1220879951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5586a6fc3760 0x5586a6fc3b40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa07000aa20 tx=0x7fa07000aee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7feebf80a70429c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:55.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.582+0000 7fa0809a6640 1 --2- 172.21.15.92:0/1575475799 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa0640a3690 0x7fa0640a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:55.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.583+0000 7fa0627fc640 1 -- 172.21.15.92:0/1220879951 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa070010630 con 0x5586a6fc3760 2024-09-19T09:08:55.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.583+0000 7fa0627fc640 1 -- 172.21.15.92:0/1220879951 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa070010cb0 con 0x5586a6fc3760 2024-09-19T09:08:55.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.583+0000 7fa0627fc640 1 -- 172.21.15.92:0/1220879951 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa070018e00 con 0x5586a6fc3760 2024-09-19T09:08:55.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.584+0000 7fa0847e2740 1 -- 172.21.15.92:0/1220879951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5586a6fc3760 msgr2=0x5586a6fc3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:55.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.584+0000 7fa0847e2740 1 --2- 172.21.15.92:0/1220879951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5586a6fc3760 0x5586a6fc3b40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa07000aa20 tx=0x7fa07000aee0 comp rx=0 tx=0).stop 2024-09-19T09:08:55.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.584+0000 7fa0809a6640 1 --2- 172.21.15.92:0/1575475799 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa0640a3690 0x7fa0640a5b50 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa07001f000 tx=0x7fa07001a440 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:55.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.590+0000 7fa0847e2740 1 -- 172.21.15.92:0/1220879951 shutdown_connections 2024-09-19T09:08:55.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.590+0000 7fa0847e2740 1 --2- 172.21.15.92:0/1220879951 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5586a6fce940 0x5586a6fd0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:55.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.590+0000 7fa0847e2740 1 --2- 172.21.15.92:0/1220879951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586a6fc4080 0x5586a6fce400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:55.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.590+0000 7fa0847e2740 1 --2- 172.21.15.92:0/1220879951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5586a6fc3760 0x5586a6fc3b40 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:55.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.590+0000 7fa0847e2740 1 -- 172.21.15.92:0/1220879951 >> 172.21.15.92:0/1220879951 conn(0x5586a6fbfcf0 msgr2=0x5586a6fc00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:55.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.591+0000 7fa0847e2740 1 -- 172.21.15.92:0/1220879951 shutdown_connections 2024-09-19T09:08:55.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.591+0000 7fa0847e2740 1 -- 172.21.15.92:0/1220879951 wait complete. 2024-09-19T09:08:55.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.591+0000 7fa0847e2740 1 -- start start 2024-09-19T09:08:55.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.591+0000 7fa0847e2740 1 Processor -- start 2024-09-19T09:08:55.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.592+0000 7fa0847e2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586a6fc3760 0x5586a6fcb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:55.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.592+0000 7fa0847e2740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5586a6fc4080 0x5586a6fcbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:55.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.592+0000 7fa0847e2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5586a6fce940 0x5586a6fcc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:55.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.592+0000 7fa0847e2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5586a6fd1510 con 0x5586a6fc3760 2024-09-19T09:08:55.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.592+0000 7fa0847e2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5586a6eb16e0 con 0x5586a6fce940 2024-09-19T09:08:55.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.592+0000 7fa0847e2740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5586a6fd1690 con 0x5586a6fc4080 2024-09-19T09:08:55.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.592+0000 7fa0847e2740 10 client.0 _ll_register_callbacks cb 0x5586a6ed5a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:55.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.592+0000 7fa0809a6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5586a6fce940 0x5586a6fcc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:55.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.592+0000 7fa0809a6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5586a6fce940 0x5586a6fcc230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:59212/0 (socket says 172.21.15.92:59212) 2024-09-19T09:08:55.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.592+0000 7fa0809a6640 1 -- 172.21.15.92:0/2631957542 learned_addr learned my addr 172.21.15.92:0/2631957542 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:55.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.592+0000 7fa07b7fe640 1 --2- 172.21.15.92:0/2631957542 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5586a6fc4080 0x5586a6fcbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:55.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.593+0000 7fa0809a6640 1 -- 172.21.15.92:0/2631957542 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5586a6fc4080 msgr2=0x5586a6fcbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:55.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.593+0000 7fa0809a6640 1 --2- 172.21.15.92:0/2631957542 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5586a6fc4080 0x5586a6fcbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:55.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.593+0000 7fa0809a6640 1 -- 172.21.15.92:0/2631957542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586a6fc3760 msgr2=0x5586a6fcb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:55.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.593+0000 7fa0809a6640 1 --2- 172.21.15.92:0/2631957542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586a6fc3760 0x5586a6fcb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:55.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.593+0000 7fa0809a6640 1 -- 172.21.15.92:0/2631957542 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586a6fda9e0 con 0x5586a6fce940 2024-09-19T09:08:55.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.593+0000 7fa0809a6640 1 --2- 172.21.15.92:0/2631957542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5586a6fce940 0x5586a6fcc230 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa07000fd60 tx=0x7fa070024000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be1f8cc69a2b56bc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:55.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.593+0000 7fa05b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:08:55.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.593+0000 7fa05b7fe640 1 -- 172.21.15.92:0/2631957542 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa070010e60 con 0x5586a6fce940 2024-09-19T09:08:55.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.593+0000 7fa0847e2740 1 -- 172.21.15.92:0/2631957542 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa070010cb0 con 0x5586a6fce940 2024-09-19T09:08:55.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.593+0000 7fa05b7fe640 1 -- 172.21.15.92:0/2631957542 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa070018d10 con 0x5586a6fce940 2024-09-19T09:08:55.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.594+0000 7fa05b7fe640 1 -- 172.21.15.92:0/2631957542 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa07000a630 con 0x5586a6fce940 2024-09-19T09:08:55.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.594+0000 7fa0847e2740 10 client.27539 fetch_fsmap learned FSMap version 19 2024-09-19T09:08:55.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.594+0000 7fa0847e2740 1 -- 172.21.15.92:0/2631957542 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5586a6fdd330 con 0x5586a6fce940 2024-09-19T09:08:55.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.594+0000 7fa05b7fe640 1 -- 172.21.15.92:0/2631957542 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa070010cb0 con 0x5586a6fce940 2024-09-19T09:08:55.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.596+0000 7fa05b7fe640 1 -- 172.21.15.92:0/2631957542 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fa07003a030 con 0x5586a6fce940 2024-09-19T09:08:55.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.596+0000 7fa0847e2740 10 client.27539 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:08:55.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.596+0000 7fa0847e2740 10 client.27539 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:08:55.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.596+0000 7fa0847e2740 20 client.27539 populate_metadata read hostname 'smithi092' 2024-09-19T09:08:55.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.596+0000 7fa0847e2740 1 --2- 172.21.15.92:0/2631957542 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5586a6fdec30 0x5586a6fe10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:55.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.596+0000 7fa0847e2740 4 client.27539 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:08:55.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.596+0000 7fa0847e2740 1 -- 172.21.15.92:0/2631957542 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586a6f369d0 con 0x5586a6fdec30 2024-09-19T09:08:55.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.596+0000 7fa07bfff640 1 --2- 172.21.15.92:0/2631957542 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5586a6fdec30 0x5586a6fe10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:55.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.596+0000 7fa07bfff640 1 --2- 172.21.15.92:0/2631957542 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5586a6fdec30 0x5586a6fe10d0 crc :-1 s=READY pgs=369 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2f0db4659d6e88f server_cookie=edbdc80a563cf889 in_seq=0 out_seq=0 2024-09-19T09:08:55.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.596+0000 7fa05b7fe640 10 client.27539 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:55.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.597+0000 7fa05b7fe640 1 -- 172.21.15.92:0/2631957542 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5586a6f369d0 con 0x5586a6fdec30 2024-09-19T09:08:55.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.597+0000 7fa05b7fe640 10 client.27539 handle_command_reply: tid=0 2024-09-19T09:08:55.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.597+0000 7fa0847e2740 1 client.27539 shutdown 2024-09-19T09:08:55.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.597+0000 7fa0847e2740 1 -- 172.21.15.92:0/2631957542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5586a6fce940 msgr2=0x5586a6fcc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:55.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.597+0000 7fa0847e2740 1 --2- 172.21.15.92:0/2631957542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5586a6fce940 0x5586a6fcc230 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa07000fd60 tx=0x7fa070024000 comp rx=0 tx=0).stop 2024-09-19T09:08:55.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.597+0000 7fa0847e2740 1 -- 172.21.15.92:0/2631957542 shutdown_connections 2024-09-19T09:08:55.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.597+0000 7fa0847e2740 1 --2- 172.21.15.92:0/2631957542 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5586a6fdec30 0x5586a6fe10d0 crc :-1 s=READY pgs=369 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:55.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.597+0000 7fa0847e2740 1 --2- 172.21.15.92:0/2631957542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5586a6fce940 0x5586a6fcc230 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:55.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.597+0000 7fa0847e2740 1 --2- 172.21.15.92:0/2631957542 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5586a6fc4080 0x5586a6fcbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:55.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.597+0000 7fa0847e2740 1 --2- 172.21.15.92:0/2631957542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586a6fc3760 0x5586a6fcb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:55.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.597+0000 7fa0847e2740 1 -- 172.21.15.92:0/2631957542 >> 172.21.15.92:0/2631957542 conn(0x5586a6fbfcf0 msgr2=0x5586a6fbee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:55.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.597+0000 7fa05b7fe640 0 client.27539 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:55.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.598+0000 7fa0847e2740 1 -- 172.21.15.92:0/2631957542 shutdown_connections 2024-09-19T09:08:55.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.598+0000 7fa0847e2740 1 -- 172.21.15.92:0/2631957542 wait complete. 2024-09-19T09:08:55.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.598+0000 7fa0847e2740 20 client.27539 trim_cache size 0 max 16384 2024-09-19T09:08:55.624 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:08:55.624 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:08:55.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.623+0000 7fa0847e2740 1 Processor -- start 2024-09-19T09:08:55.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.623+0000 7fa0847e2740 1 -- start start 2024-09-19T09:08:55.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.623+0000 7fa0847e2740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5586a6fc3760 0x5586a6fc6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:55.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.623+0000 7fa0847e2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5586a6fc4080 0x5586a6fe69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:55.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.623+0000 7fa0847e2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586a6fce940 0x5586a6fe6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:55.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.623+0000 7fa0847e2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa06802e470 con 0x5586a6fce940 2024-09-19T09:08:55.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.623+0000 7fa0847e2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa068030d10 con 0x5586a6fc4080 2024-09-19T09:08:55.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.623+0000 7fa0847e2740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa06802eb00 con 0x5586a6fc3760 2024-09-19T09:08:55.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.623+0000 7fa07bfff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5586a6fc3760 0x5586a6fc6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:55.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.623+0000 7fa07bfff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5586a6fc3760 0x5586a6fc6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:33488/0 (socket says 172.21.15.92:33488) 2024-09-19T09:08:55.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.623+0000 7fa07bfff640 1 -- 172.21.15.92:0/2657125421 learned_addr learned my addr 172.21.15.92:0/2657125421 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:55.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.624+0000 7fa07b7fe640 1 --2- 172.21.15.92:0/2657125421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5586a6fc4080 0x5586a6fe69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:55.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.624+0000 7fa07bfff640 1 -- 172.21.15.92:0/2657125421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5586a6fc4080 msgr2=0x5586a6fe69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:55.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.624+0000 7fa07bfff640 1 --2- 172.21.15.92:0/2657125421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5586a6fc4080 0x5586a6fe69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:55.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.624+0000 7fa07bfff640 1 -- 172.21.15.92:0/2657125421 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586a6fce940 msgr2=0x5586a6fe6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:55.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.624+0000 7fa07bfff640 1 --2- 172.21.15.92:0/2657125421 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586a6fce940 0x5586a6fe6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:55.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.624+0000 7fa07bfff640 1 -- 172.21.15.92:0/2657125421 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586a6fc3590 con 0x5586a6fc3760 2024-09-19T09:08:55.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.624+0000 7fa07b7fe640 1 --2- 172.21.15.92:0/2657125421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5586a6fc4080 0x5586a6fe69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:08:55.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.624+0000 7fa07bfff640 1 --2- 172.21.15.92:0/2657125421 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5586a6fc3760 0x5586a6fc6130 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa074012410 tx=0x7fa074005bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=967e905e44787cbb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:55.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.624+0000 7fa061ffb640 1 -- 172.21.15.92:0/2657125421 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07401a330 con 0x5586a6fc3760 2024-09-19T09:08:55.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.624+0000 7fa061ffb640 1 -- 172.21.15.92:0/2657125421 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa07401e030 con 0x5586a6fc3760 2024-09-19T09:08:55.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.624+0000 7fa061ffb640 1 -- 172.21.15.92:0/2657125421 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa074005670 con 0x5586a6fc3760 2024-09-19T09:08:55.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.625+0000 7fa0847e2740 1 -- 172.21.15.92:0/2657125421 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5586a6fc3760 msgr2=0x5586a6fc6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:55.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.625+0000 7fa0847e2740 1 --2- 172.21.15.92:0/2657125421 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5586a6fc3760 0x5586a6fc6130 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa074012410 tx=0x7fa074005bd0 comp rx=0 tx=0).stop 2024-09-19T09:08:55.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.626+0000 7fa0847e2740 1 -- 172.21.15.92:0/2657125421 shutdown_connections 2024-09-19T09:08:55.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.626+0000 7fa0847e2740 1 --2- 172.21.15.92:0/2657125421 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586a6fce940 0x5586a6fe6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:55.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.626+0000 7fa0847e2740 1 --2- 172.21.15.92:0/2657125421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5586a6fc4080 0x5586a6fe69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:55.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.626+0000 7fa0847e2740 1 --2- 172.21.15.92:0/2657125421 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5586a6fc3760 0x5586a6fc6130 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:55.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.626+0000 7fa0847e2740 1 -- 172.21.15.92:0/2657125421 >> 172.21.15.92:0/2657125421 conn(0x5586a6fbfcf0 msgr2=0x5586a6fcd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:55.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.626+0000 7fa0847e2740 1 -- 172.21.15.92:0/2657125421 shutdown_connections 2024-09-19T09:08:55.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.626+0000 7fa0847e2740 1 -- 172.21.15.92:0/2657125421 wait complete. 2024-09-19T09:08:55.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.626+0000 7fa0847e2740 1 -- start start 2024-09-19T09:08:55.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.627+0000 7fa0847e2740 1 Processor -- start 2024-09-19T09:08:55.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.627+0000 7fa0847e2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5586a6fc3760 0x5586a6fd2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:55.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.628+0000 7fa0847e2740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5586a6fc4080 0x5586a6fd25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:55.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.628+0000 7fa0847e2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586a6fce940 0x5586a7041970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:55.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.628+0000 7fa0847e2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa06802f1d0 con 0x5586a6fce940 2024-09-19T09:08:55.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.628+0000 7fa0847e2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa068030640 con 0x5586a6fc3760 2024-09-19T09:08:55.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.628+0000 7fa0847e2740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa06802f8a0 con 0x5586a6fc4080 2024-09-19T09:08:55.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.628+0000 7fa07bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5586a6fc3760 0x5586a6fd2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:55.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.628+0000 7fa07bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5586a6fc3760 0x5586a6fd2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:59222/0 (socket says 172.21.15.92:59222) 2024-09-19T09:08:55.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.628+0000 7fa07bfff640 1 -- 172.21.15.92:0/2821120021 learned_addr learned my addr 172.21.15.92:0/2821120021 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:55.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.628+0000 7fa0847e2740 10 client.0 _ll_register_callbacks cb 0x7fa07000aee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:55.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.628+0000 7fa07b7fe640 1 --2- 172.21.15.92:0/2821120021 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5586a6fc4080 0x5586a6fd25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:55.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.628+0000 7fa07bfff640 1 -- 172.21.15.92:0/2821120021 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5586a6fc4080 msgr2=0x5586a6fd25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:55.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.628+0000 7fa07bfff640 1 --2- 172.21.15.92:0/2821120021 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5586a6fc4080 0x5586a6fd25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:55.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.628+0000 7fa07bfff640 1 -- 172.21.15.92:0/2821120021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586a6fce940 msgr2=0x5586a7041970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:55.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.628+0000 7fa07bfff640 1 --2- 172.21.15.92:0/2821120021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586a6fce940 0x5586a7041970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:55.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.628+0000 7fa07bfff640 1 -- 172.21.15.92:0/2821120021 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586a7042010 con 0x5586a6fc3760 2024-09-19T09:08:55.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.629+0000 7fa07bfff640 1 --2- 172.21.15.92:0/2821120021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5586a6fc3760 0x5586a6fd2080 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa07401d040 tx=0x7fa074005040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e7b066903d95f55 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:55.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.629+0000 7fa05b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:08:55.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.629+0000 7fa05b7fe640 1 -- 172.21.15.92:0/2821120021 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa074030060 con 0x5586a6fc3760 2024-09-19T09:08:55.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.629+0000 7fa0847e2740 1 -- 172.21.15.92:0/2821120021 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa07401e030 con 0x5586a6fc3760 2024-09-19T09:08:55.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.629+0000 7fa05b7fe640 1 -- 172.21.15.92:0/2821120021 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa074005730 con 0x5586a6fc3760 2024-09-19T09:08:55.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.629+0000 7fa05b7fe640 1 -- 172.21.15.92:0/2821120021 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa074005930 con 0x5586a6fc3760 2024-09-19T09:08:55.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.629+0000 7fa0847e2740 10 client.27542 fetch_fsmap learned FSMap version 19 2024-09-19T09:08:55.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.629+0000 7fa0847e2740 1 -- 172.21.15.92:0/2821120021 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5586a70492b0 con 0x5586a6fc3760 2024-09-19T09:08:55.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.631+0000 7fa05b7fe640 1 -- 172.21.15.92:0/2821120021 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa07401a810 con 0x5586a6fc3760 2024-09-19T09:08:55.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.631+0000 7fa05b7fe640 1 -- 172.21.15.92:0/2821120021 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fa074035070 con 0x5586a6fc3760 2024-09-19T09:08:55.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.631+0000 7fa0847e2740 10 client.27542 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:08:55.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.631+0000 7fa0847e2740 10 client.27542 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:08:55.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.631+0000 7fa0847e2740 20 client.27542 populate_metadata read hostname 'smithi092' 2024-09-19T09:08:55.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.631+0000 7fa0847e2740 1 --2- 172.21.15.92:0/2821120021 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5586a70498e0 0x5586a704bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:55.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.631+0000 7fa0847e2740 4 client.27542 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.2, "await_for": 45.0}] 2024-09-19T09:08:55.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.631+0000 7fa0847e2740 1 -- 172.21.15.92:0/2821120021 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.2, "await_for": 45.0}) -- 0x7fa07401e030 con 0x5586a70498e0 2024-09-19T09:08:55.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.631+0000 7fa07b7fe640 1 --2- 172.21.15.92:0/2821120021 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5586a70498e0 0x5586a704bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:55.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.632+0000 7fa05b7fe640 10 client.27542 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:55.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.632+0000 7fa07b7fe640 1 --2- 172.21.15.92:0/2821120021 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5586a70498e0 0x5586a704bd20 crc :-1 s=READY pgs=370 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91f7f67794cec650 server_cookie=ff5cd1f3d048649b in_seq=0 out_seq=0 2024-09-19T09:08:55.795 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 730.0 s, 2850.6 tps, lat 35.093 ms stddev 39.590 2024-09-19T09:08:55.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.906+0000 7fa05b7fe640 1 -- 172.21.15.92:0/2821120021 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7fa07401e030 con 0x5586a70498e0 2024-09-19T09:08:55.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.906+0000 7fa05b7fe640 10 client.27542 handle_command_reply: tid=0 2024-09-19T09:08:55.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.906+0000 7fa0847e2740 1 client.27542 shutdown 2024-09-19T09:08:55.907 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:55 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:08:55.907 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:55 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:08:55.907 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:55 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:08:55.908 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:55 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:08:55.908 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:55 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:08:55.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.906+0000 7fa0847e2740 1 -- 172.21.15.92:0/2821120021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5586a6fc3760 msgr2=0x5586a6fd2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:55.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.906+0000 7fa0847e2740 1 --2- 172.21.15.92:0/2821120021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5586a6fc3760 0x5586a6fd2080 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa07401d040 tx=0x7fa074005040 comp rx=0 tx=0).stop 2024-09-19T09:08:55.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.906+0000 7fa0847e2740 1 -- 172.21.15.92:0/2821120021 shutdown_connections 2024-09-19T09:08:55.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.906+0000 7fa0847e2740 1 --2- 172.21.15.92:0/2821120021 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5586a70498e0 0x5586a704bd20 crc :-1 s=READY pgs=370 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:55.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.906+0000 7fa0847e2740 1 --2- 172.21.15.92:0/2821120021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586a6fce940 0x5586a7041970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:55.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.906+0000 7fa0847e2740 1 --2- 172.21.15.92:0/2821120021 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5586a6fc4080 0x5586a6fd25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:55.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.906+0000 7fa0847e2740 1 --2- 172.21.15.92:0/2821120021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5586a6fc3760 0x5586a6fd2080 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:55.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.906+0000 7fa0847e2740 1 -- 172.21.15.92:0/2821120021 >> 172.21.15.92:0/2821120021 conn(0x5586a6fbfcf0 msgr2=0x5586a6fcd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:55.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.906+0000 7fa05b7fe640 0 client.27542 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:55.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.906+0000 7fa0847e2740 1 -- 172.21.15.92:0/2821120021 shutdown_connections 2024-09-19T09:08:55.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.907+0000 7fa0847e2740 1 -- 172.21.15.92:0/2821120021 wait complete. 2024-09-19T09:08:55.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.907+0000 7fa0847e2740 20 client.27542 trim_cache size 0 max 16384 2024-09-19T09:08:55.910 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:08:55.910 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 19, 2024-09-19T09:08:55.910 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24472, 2024-09-19T09:08:55.910 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 42, 2024-09-19T09:08:55.910 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-09-19T09:08:55.910 INFO:teuthology.orchestra.run.smithi092.stdout: "4853c4a2": { 2024-09-19T09:08:55.911 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 42, 2024-09-19T09:08:55.911 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-09-19T09:08:55.911 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:08:55.911 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-09-19T09:08:55.911 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:08:55.911 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:08:55.911 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 90.0, 2024-09-19T09:08:55.911 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 142.2, 2024-09-19T09:08:55.911 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-09-19T09:08:55.911 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-09-19T09:08:55.911 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-09-19T09:08:55.911 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:08:55.911 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-09-19T09:08:55.911 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:08:55.912 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:08:55.912 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:08:55.912 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:08:55.912 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:08:55.912 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:08:55.912 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:08:55.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.907+0000 7fa082409640 1 -- 172.21.15.92:0/1575475799 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa0640a3690 msgr2=0x7fa0640a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:55.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.907+0000 7fa082409640 1 --2- 172.21.15.92:0/1575475799 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa0640a3690 0x7fa0640a5b50 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa07001f000 tx=0x7fa07001a440 comp rx=0 tx=0).stop 2024-09-19T09:08:55.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.907+0000 7fa082409640 1 -- 172.21.15.92:0/1575475799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa07c109830 msgr2=0x7fa07c111790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:55.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.907+0000 7fa082409640 1 --2- 172.21.15.92:0/1575475799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa07c109830 0x7fa07c111790 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa06c000c00 tx=0x7fa06c003c10 comp rx=0 tx=0).stop 2024-09-19T09:08:55.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.907+0000 7fa082409640 1 -- 172.21.15.92:0/1575475799 shutdown_connections 2024-09-19T09:08:55.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.907+0000 7fa082409640 1 --2- 172.21.15.92:0/1575475799 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa07c11b140 0x7fa07c111cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:55.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.907+0000 7fa082409640 1 --2- 172.21.15.92:0/1575475799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa07c109830 0x7fa07c111790 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:55.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.907+0000 7fa082409640 1 --2- 172.21.15.92:0/1575475799 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa0640a3690 0x7fa0640a5b50 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:55.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.907+0000 7fa082409640 1 --2- 172.21.15.92:0/1575475799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa07c109450 0x7fa07c118700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:55.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.908+0000 7fa082409640 1 -- 172.21.15.92:0/1575475799 >> 172.21.15.92:0/1575475799 conn(0x7fa07c06e140 msgr2=0x7fa07c11bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:55.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.908+0000 7fa082409640 1 -- 172.21.15.92:0/1575475799 shutdown_connections 2024-09-19T09:08:55.913 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:55.908+0000 7fa082409640 1 -- 172.21.15.92:0/1575475799 wait complete. 2024-09-19T09:08:56.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:55 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:08:56.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:55 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:08:56.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:55 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:08:56.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:55 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:08:56.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:55 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:08:56.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:55 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:08:56.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:55 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:08:56.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:55 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:08:56.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:55 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:08:56.125 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:55 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:08:56.161 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:08:56.536 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '4853c4a2', quiesce took 4.9 seconds. Will release after: 17.299999999999997 2024-09-19T09:08:56.892 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:56 smithi092 ceph-mon[31407]: pgmap v704: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.6 MiB/s wr, 760 op/s 2024-09-19T09:08:57.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.974+0000 7f4fca6a8640 1 -- 172.21.15.92:0/527285930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fc4101420 msgr2=0x7f4fc410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:57.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.975+0000 7f4fca6a8640 1 --2- 172.21.15.92:0/527285930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fc4101420 0x7f4fc410d950 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc009cd0 tx=0x7f4fbc02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:08:57.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.975+0000 7f4fca6a8640 1 -- 172.21.15.92:0/527285930 shutdown_connections 2024-09-19T09:08:57.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.975+0000 7f4fca6a8640 1 --2- 172.21.15.92:0/527285930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fc4101420 0x7f4fc410d950 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:57.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.975+0000 7f4fca6a8640 1 --2- 172.21.15.92:0/527285930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fc4100a80 0x7f4fc4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:57.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.975+0000 7f4fca6a8640 1 --2- 172.21.15.92:0/527285930 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4fc4106a80 0x7f4fc4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:57.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.975+0000 7f4fca6a8640 1 -- 172.21.15.92:0/527285930 >> 172.21.15.92:0/527285930 conn(0x7f4fc40fc7a0 msgr2=0x7f4fc40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:57.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.975+0000 7f4fca6a8640 1 -- 172.21.15.92:0/527285930 shutdown_connections 2024-09-19T09:08:57.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.975+0000 7f4fca6a8640 1 -- 172.21.15.92:0/527285930 wait complete. 2024-09-19T09:08:57.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.975+0000 7f4fca6a8640 1 Processor -- start 2024-09-19T09:08:57.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.975+0000 7f4fca6a8640 1 -- start start 2024-09-19T09:08:57.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.975+0000 7f4fca6a8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fc4100a80 0x7f4fc419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:57.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.975+0000 7f4fca6a8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fc4101420 0x7f4fc419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:57.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.975+0000 7f4fca6a8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4fc4106a80 0x7f4fc419eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:57.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.975+0000 7f4fca6a8640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc4110e80 con 0x7f4fc4100a80 2024-09-19T09:08:57.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.975+0000 7f4fca6a8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc4110d00 con 0x7f4fc4101420 2024-09-19T09:08:57.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.975+0000 7f4fca6a8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc4111000 con 0x7f4fc4106a80 2024-09-19T09:08:57.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.976+0000 7f4fc3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fc4100a80 0x7f4fc419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:57.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.976+0000 7f4fc3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fc4100a80 0x7f4fc419a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51682/0 (socket says 172.21.15.92:51682) 2024-09-19T09:08:57.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.976+0000 7f4fc3fff640 1 -- 172.21.15.92:0/1996903606 learned_addr learned my addr 172.21.15.92:0/1996903606 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:57.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.976+0000 7f4fbbfff640 1 --2- 172.21.15.92:0/1996903606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fc4101420 0x7f4fc419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:57.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.976+0000 7f4fc8c45640 1 --2- 172.21.15.92:0/1996903606 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4fc4106a80 0x7f4fc419eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:57.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.976+0000 7f4fc3fff640 1 -- 172.21.15.92:0/1996903606 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4fc4106a80 msgr2=0x7f4fc419eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:57.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.976+0000 7f4fc3fff640 1 --2- 172.21.15.92:0/1996903606 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4fc4106a80 0x7f4fc419eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:57.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.976+0000 7f4fc3fff640 1 -- 172.21.15.92:0/1996903606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fc4101420 msgr2=0x7f4fc419ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:57.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.976+0000 7f4fc3fff640 1 --2- 172.21.15.92:0/1996903606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fc4101420 0x7f4fc419ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:57.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.976+0000 7f4fc3fff640 1 -- 172.21.15.92:0/1996903606 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc419f5b0 con 0x7f4fc4100a80 2024-09-19T09:08:57.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.976+0000 7f4fc8c45640 1 --2- 172.21.15.92:0/1996903606 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4fc4106a80 0x7f4fc419eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:08:57.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.976+0000 7f4fc3fff640 1 --2- 172.21.15.92:0/1996903606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fc4100a80 0x7f4fc419a600 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f4fb400d950 tx=0x7f4fb400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:57.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.976+0000 7f4fc1ffb640 1 -- 172.21.15.92:0/1996903606 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb4017030 con 0x7f4fc4100a80 2024-09-19T09:08:57.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.976+0000 7f4fca6a8640 1 -- 172.21.15.92:0/1996903606 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fc419f8a0 con 0x7f4fc4100a80 2024-09-19T09:08:57.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.976+0000 7f4fc1ffb640 1 -- 172.21.15.92:0/1996903606 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fb4004020 con 0x7f4fc4100a80 2024-09-19T09:08:57.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.976+0000 7f4fc1ffb640 1 -- 172.21.15.92:0/1996903606 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb40047a0 con 0x7f4fc4100a80 2024-09-19T09:08:57.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.976+0000 7f4fca6a8640 1 -- 172.21.15.92:0/1996903606 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fc41a7180 con 0x7f4fc4100a80 2024-09-19T09:08:57.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.979+0000 7f4fc1ffb640 1 -- 172.21.15.92:0/1996903606 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4fb40041d0 con 0x7f4fc4100a80 2024-09-19T09:08:57.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.979+0000 7f4fcca81740 1 Processor -- start 2024-09-19T09:08:57.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.979+0000 7f4fcca81740 1 -- start start 2024-09-19T09:08:57.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.979+0000 7f4fcca81740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5575bb11fb60 0x5575bb11ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:57.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.979+0000 7f4fcca81740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575bb120480 0x5575bb12a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:57.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.979+0000 7f4fcca81740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575bb12ad40 0x5575bb12d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:57.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.979+0000 7f4fcca81740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5575bb085280 con 0x5575bb120480 2024-09-19T09:08:57.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.979+0000 7f4fcca81740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5575bb02cb10 con 0x5575bb12ad40 2024-09-19T09:08:57.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.979+0000 7f4fcca81740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5575bb081240 con 0x5575bb11fb60 2024-09-19T09:08:57.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.979+0000 7f4fc3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575bb120480 0x5575bb12a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:57.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.979+0000 7f4fc3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575bb120480 0x5575bb12a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51684/0 (socket says 172.21.15.92:51684) 2024-09-19T09:08:57.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.979+0000 7f4fc1ffb640 1 --2- 172.21.15.92:0/1996903606 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4fb00a3240 0x7f4fb00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:57.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.979+0000 7f4fc3fff640 1 -- 172.21.15.92:0/708942603 learned_addr learned my addr 172.21.15.92:0/708942603 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:57.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.979+0000 7f4fc8c45640 1 --2- 172.21.15.92:0/708942603 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5575bb11fb60 0x5575bb11ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:57.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.980+0000 7f4fc8c45640 1 --2- 172.21.15.92:0/1996903606 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4fb00a3240 0x7f4fb00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:57.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.979+0000 7f4fbbfff640 1 --2- 172.21.15.92:0/708942603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575bb12ad40 0x5575bb12d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:57.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.980+0000 7f4fc1ffb640 1 -- 172.21.15.92:0/1996903606 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4fb40cf2a0 con 0x7f4fc4100a80 2024-09-19T09:08:57.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.980+0000 7f4fc3fff640 1 -- 172.21.15.92:0/708942603 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5575bb11fb60 msgr2=0x5575bb11ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:57.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.980+0000 7f4fc3fff640 1 --2- 172.21.15.92:0/708942603 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5575bb11fb60 0x5575bb11ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:57.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.980+0000 7f4fc3fff640 1 -- 172.21.15.92:0/708942603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575bb12ad40 msgr2=0x5575bb12d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:57.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.980+0000 7f4fc3fff640 1 --2- 172.21.15.92:0/708942603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575bb12ad40 0x5575bb12d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:57.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.980+0000 7f4fc3fff640 1 -- 172.21.15.92:0/708942603 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575bb0391f0 con 0x5575bb120480 2024-09-19T09:08:57.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.980+0000 7f4fc8c45640 1 --2- 172.21.15.92:0/708942603 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5575bb11fb60 0x5575bb11ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:08:57.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.980+0000 7f4fc3fff640 1 --2- 172.21.15.92:0/708942603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575bb120480 0x5575bb12a800 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f4fb40a4000 tx=0x7f4fb4004540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=404f72f03ec951f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:57.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.980+0000 7f4fba7fc640 1 -- 172.21.15.92:0/708942603 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb409b220 con 0x5575bb120480 2024-09-19T09:08:57.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.980+0000 7f4fc8c45640 1 --2- 172.21.15.92:0/1996903606 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4fb00a3240 0x7f4fb00a5700 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc033040 tx=0x7f4fbc0095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:57.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.980+0000 7f4fba7fc640 1 -- 172.21.15.92:0/708942603 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fb409bfc0 con 0x5575bb120480 2024-09-19T09:08:57.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.980+0000 7f4fba7fc640 1 -- 172.21.15.92:0/708942603 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb409bb20 con 0x5575bb120480 2024-09-19T09:08:57.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.981+0000 7f4fcca81740 1 -- 172.21.15.92:0/708942603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575bb120480 msgr2=0x5575bb12a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:57.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.981+0000 7f4fcca81740 1 --2- 172.21.15.92:0/708942603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575bb120480 0x5575bb12a800 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f4fb40a4000 tx=0x7f4fb4004540 comp rx=0 tx=0).stop 2024-09-19T09:08:57.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.981+0000 7f4fcca81740 1 -- 172.21.15.92:0/708942603 shutdown_connections 2024-09-19T09:08:57.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.981+0000 7f4fcca81740 1 --2- 172.21.15.92:0/708942603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575bb12ad40 0x5575bb12d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:57.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.981+0000 7f4fcca81740 1 --2- 172.21.15.92:0/708942603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575bb120480 0x5575bb12a800 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:57.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.981+0000 7f4fcca81740 1 --2- 172.21.15.92:0/708942603 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5575bb11fb60 0x5575bb11ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:57.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.981+0000 7f4fcca81740 1 -- 172.21.15.92:0/708942603 >> 172.21.15.92:0/708942603 conn(0x5575bb11c0f0 msgr2=0x5575bb11c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:57.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.981+0000 7f4fcca81740 1 -- 172.21.15.92:0/708942603 shutdown_connections 2024-09-19T09:08:57.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.981+0000 7f4fcca81740 1 -- 172.21.15.92:0/708942603 wait complete. 2024-09-19T09:08:57.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.981+0000 7f4fcca81740 1 -- start start 2024-09-19T09:08:57.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.982+0000 7f4fcca81740 1 Processor -- start 2024-09-19T09:08:57.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.982+0000 7f4fcca81740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5575bb11fb60 0x5575bb127c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:57.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.982+0000 7f4fcca81740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575bb120480 0x5575bb1281c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:57.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.982+0000 7f4fcca81740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575bb12ad40 0x5575bb128700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:57.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.982+0000 7f4fcca81740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5575bb12d8b0 con 0x5575bb12ad40 2024-09-19T09:08:57.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.982+0000 7f4fcca81740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5575bb03ff10 con 0x5575bb120480 2024-09-19T09:08:57.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.982+0000 7f4fcca81740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5575bb12da30 con 0x5575bb11fb60 2024-09-19T09:08:57.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.982+0000 7f4fcca81740 10 client.0 _ll_register_callbacks cb 0x5575bb008a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:57.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.982+0000 7f4fc8c45640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575bb12ad40 0x5575bb128700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:57.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.982+0000 7f4fc8c45640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575bb12ad40 0x5575bb128700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51686/0 (socket says 172.21.15.92:51686) 2024-09-19T09:08:57.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.982+0000 7f4fc8c45640 1 -- 172.21.15.92:0/958614994 learned_addr learned my addr 172.21.15.92:0/958614994 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:57.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.982+0000 7f4fbbfff640 1 --2- 172.21.15.92:0/958614994 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575bb120480 0x5575bb1281c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:57.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.982+0000 7f4fc3fff640 1 --2- 172.21.15.92:0/958614994 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5575bb11fb60 0x5575bb127c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:57.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.982+0000 7f4fc8c45640 1 -- 172.21.15.92:0/958614994 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5575bb11fb60 msgr2=0x5575bb127c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:57.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.982+0000 7f4fc8c45640 1 --2- 172.21.15.92:0/958614994 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5575bb11fb60 0x5575bb127c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:57.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.982+0000 7f4fc8c45640 1 -- 172.21.15.92:0/958614994 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575bb120480 msgr2=0x5575bb1281c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:57.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.982+0000 7f4fc8c45640 1 --2- 172.21.15.92:0/958614994 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575bb120480 0x5575bb1281c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:57.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.982+0000 7f4fc8c45640 1 -- 172.21.15.92:0/958614994 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575badf66a0 con 0x5575bb12ad40 2024-09-19T09:08:57.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.982+0000 7f4fc3fff640 1 --2- 172.21.15.92:0/958614994 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5575bb11fb60 0x5575bb127c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:08:57.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.982+0000 7f4fc8c45640 1 --2- 172.21.15.92:0/958614994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575bb12ad40 0x5575bb128700 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc035000 tx=0x7f4fbc02a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d2d3af5d46c4e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:57.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.982+0000 7f4fa37fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:08:57.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.983+0000 7f4fa37fe640 1 -- 172.21.15.92:0/958614994 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc04e030 con 0x5575bb12ad40 2024-09-19T09:08:57.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.983+0000 7f4fa37fe640 1 -- 172.21.15.92:0/958614994 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4fbc044070 con 0x5575bb12ad40 2024-09-19T09:08:57.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.983+0000 7f4fcca81740 1 -- 172.21.15.92:0/958614994 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fb409bfc0 con 0x5575bb12ad40 2024-09-19T09:08:57.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.983+0000 7f4fa37fe640 1 -- 172.21.15.92:0/958614994 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4fbc0045c0 con 0x5575bb12ad40 2024-09-19T09:08:57.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.983+0000 7f4fcca81740 10 client.18264 fetch_fsmap learned FSMap version 19 2024-09-19T09:08:57.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.983+0000 7f4fcca81740 1 -- 172.21.15.92:0/958614994 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5575bb139510 con 0x5575bb12ad40 2024-09-19T09:08:57.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.983+0000 7f4fa37fe640 1 -- 172.21.15.92:0/958614994 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fb409bfc0 con 0x5575bb12ad40 2024-09-19T09:08:57.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.983+0000 7f4fa37fe640 1 -- 172.21.15.92:0/958614994 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f4fbc047050 con 0x5575bb12ad40 2024-09-19T09:08:57.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.983+0000 7f4fcca81740 10 client.18264 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:08:57.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.983+0000 7f4fcca81740 10 client.18264 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:08:57.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.983+0000 7f4fcca81740 20 client.18264 populate_metadata read hostname 'smithi092' 2024-09-19T09:08:57.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.983+0000 7f4fcca81740 1 --2- 172.21.15.92:0/958614994 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5575bb13aa70 0x5575bb13ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:57.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.983+0000 7f4fcca81740 4 client.18264 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:08:57.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.983+0000 7f4fcca81740 1 -- 172.21.15.92:0/958614994 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575bb0927f0 con 0x5575bb13aa70 2024-09-19T09:08:57.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.983+0000 7f4fc3fff640 1 --2- 172.21.15.92:0/958614994 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5575bb13aa70 0x5575bb13ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:57.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.984+0000 7f4fa37fe640 10 client.18264 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:57.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.984+0000 7f4fc3fff640 1 --2- 172.21.15.92:0/958614994 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5575bb13aa70 0x5575bb13ced0 crc :-1 s=READY pgs=371 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28e5c5f966bd67 server_cookie=fd102b7c6cf11d34 in_seq=0 out_seq=0 2024-09-19T09:08:57.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.984+0000 7f4fa37fe640 1 -- 172.21.15.92:0/958614994 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5575bb0927f0 con 0x5575bb13aa70 2024-09-19T09:08:57.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.984+0000 7f4fa37fe640 10 client.18264 handle_command_reply: tid=0 2024-09-19T09:08:57.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.984+0000 7f4fcca81740 1 client.18264 shutdown 2024-09-19T09:08:57.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.985+0000 7f4fcca81740 1 -- 172.21.15.92:0/958614994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575bb12ad40 msgr2=0x5575bb128700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:57.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.985+0000 7f4fcca81740 1 --2- 172.21.15.92:0/958614994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575bb12ad40 0x5575bb128700 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc035000 tx=0x7f4fbc02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:08:57.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.985+0000 7f4fcca81740 1 -- 172.21.15.92:0/958614994 shutdown_connections 2024-09-19T09:08:57.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.985+0000 7f4fcca81740 1 --2- 172.21.15.92:0/958614994 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5575bb13aa70 0x5575bb13ced0 crc :-1 s=READY pgs=371 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:57.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.985+0000 7f4fcca81740 1 --2- 172.21.15.92:0/958614994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575bb12ad40 0x5575bb128700 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:57.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.985+0000 7f4fcca81740 1 --2- 172.21.15.92:0/958614994 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575bb120480 0x5575bb1281c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:57.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.985+0000 7f4fa37fe640 0 client.18264 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:57.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.985+0000 7f4fcca81740 1 --2- 172.21.15.92:0/958614994 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5575bb11fb60 0x5575bb127c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:57.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.985+0000 7f4fcca81740 1 -- 172.21.15.92:0/958614994 >> 172.21.15.92:0/958614994 conn(0x5575bb11c0f0 msgr2=0x5575bb11b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:57.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.985+0000 7f4fcca81740 1 -- 172.21.15.92:0/958614994 shutdown_connections 2024-09-19T09:08:57.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.985+0000 7f4fcca81740 1 -- 172.21.15.92:0/958614994 wait complete. 2024-09-19T09:08:57.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:56.985+0000 7f4fcca81740 20 client.18264 trim_cache size 0 max 16384 2024-09-19T09:08:57.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.002+0000 7f4fcca81740 1 Processor -- start 2024-09-19T09:08:57.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.002+0000 7f4fcca81740 1 -- start start 2024-09-19T09:08:57.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.002+0000 7f4fcca81740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5575bb11fb60 0x5575bb1427a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:57.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.002+0000 7f4fcca81740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575bb120480 0x5575bb142ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:57.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.002+0000 7f4fcca81740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575bb12ad40 0x5575bb124ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:57.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.002+0000 7f4fcca81740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc41ad850 con 0x5575bb120480 2024-09-19T09:08:57.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.002+0000 7f4fcca81740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc41b00f0 con 0x5575bb12ad40 2024-09-19T09:08:57.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.002+0000 7f4fcca81740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc41adee0 con 0x5575bb11fb60 2024-09-19T09:08:57.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.002+0000 7f4fbbfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575bb120480 0x5575bb142ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:57.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.002+0000 7f4fbbfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575bb120480 0x5575bb142ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51698/0 (socket says 172.21.15.92:51698) 2024-09-19T09:08:57.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.002+0000 7f4fbbfff640 1 -- 172.21.15.92:0/146630208 learned_addr learned my addr 172.21.15.92:0/146630208 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:57.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.002+0000 7f4fc8c45640 1 --2- 172.21.15.92:0/146630208 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575bb12ad40 0x5575bb124ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:57.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.002+0000 7f4fbbfff640 1 -- 172.21.15.92:0/146630208 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5575bb11fb60 msgr2=0x5575bb1427a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:57.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.002+0000 7f4fbbfff640 1 --2- 172.21.15.92:0/146630208 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5575bb11fb60 0x5575bb1427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:57.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.002+0000 7f4fbbfff640 1 -- 172.21.15.92:0/146630208 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575bb12ad40 msgr2=0x5575bb124ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:57.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.002+0000 7f4fbbfff640 1 --2- 172.21.15.92:0/146630208 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575bb12ad40 0x5575bb124ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:57.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.002+0000 7f4fbbfff640 1 -- 172.21.15.92:0/146630208 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575bb11d280 con 0x5575bb120480 2024-09-19T09:08:57.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.003+0000 7f4fbbfff640 1 --2- 172.21.15.92:0/146630208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575bb120480 0x5575bb142ce0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f4fc410de20 tx=0x7f4fac00bc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ec1a41e5af76a4b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:57.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.003+0000 7f4fb9ffb640 1 -- 172.21.15.92:0/146630208 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fac00bdf0 con 0x5575bb120480 2024-09-19T09:08:57.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.003+0000 7f4fb9ffb640 1 -- 172.21.15.92:0/146630208 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fac011440 con 0x5575bb120480 2024-09-19T09:08:57.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.003+0000 7f4fb9ffb640 1 -- 172.21.15.92:0/146630208 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fac010690 con 0x5575bb120480 2024-09-19T09:08:57.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.003+0000 7f4fcca81740 1 -- 172.21.15.92:0/146630208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575bb120480 msgr2=0x5575bb142ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:57.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.003+0000 7f4fcca81740 1 --2- 172.21.15.92:0/146630208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575bb120480 0x5575bb142ce0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f4fc410de20 tx=0x7f4fac00bc00 comp rx=0 tx=0).stop 2024-09-19T09:08:57.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.003+0000 7f4fcca81740 1 -- 172.21.15.92:0/146630208 shutdown_connections 2024-09-19T09:08:57.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.003+0000 7f4fcca81740 1 --2- 172.21.15.92:0/146630208 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575bb12ad40 0x5575bb124ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:57.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.003+0000 7f4fcca81740 1 --2- 172.21.15.92:0/146630208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575bb120480 0x5575bb142ce0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:57.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.003+0000 7f4fcca81740 1 --2- 172.21.15.92:0/146630208 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5575bb11fb60 0x5575bb1427a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:57.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.003+0000 7f4fcca81740 1 -- 172.21.15.92:0/146630208 >> 172.21.15.92:0/146630208 conn(0x5575bb11c0f0 msgr2=0x5575bb129bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:57.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.003+0000 7f4fcca81740 1 -- 172.21.15.92:0/146630208 shutdown_connections 2024-09-19T09:08:57.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.003+0000 7f4fcca81740 1 -- 172.21.15.92:0/146630208 wait complete. 2024-09-19T09:08:57.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.004+0000 7f4fcca81740 1 -- start start 2024-09-19T09:08:57.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.004+0000 7f4fcca81740 1 Processor -- start 2024-09-19T09:08:57.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.004+0000 7f4fcca81740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5575bb11fb60 0x5575bb12f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:57.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.004+0000 7f4fcca81740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575bb120480 0x5575bb12f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:57.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.004+0000 7f4fcca81740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575bb12ad40 0x5575bb19e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:57.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.004+0000 7f4fcca81740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc41ae5b0 con 0x5575bb120480 2024-09-19T09:08:57.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.004+0000 7f4fcca81740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc41afa20 con 0x5575bb12ad40 2024-09-19T09:08:57.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.004+0000 7f4fcca81740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc41aec80 con 0x5575bb11fb60 2024-09-19T09:08:57.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.004+0000 7f4fcca81740 10 client.0 _ll_register_callbacks cb 0x7f4fbc009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:57.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.004+0000 7f4fbbfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575bb120480 0x5575bb12f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:57.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.004+0000 7f4fbbfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575bb120480 0x5575bb12f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51710/0 (socket says 172.21.15.92:51710) 2024-09-19T09:08:57.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.004+0000 7f4fbbfff640 1 -- 172.21.15.92:0/1726060218 learned_addr learned my addr 172.21.15.92:0/1726060218 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:57.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.004+0000 7f4fc8c45640 1 --2- 172.21.15.92:0/1726060218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575bb12ad40 0x5575bb19e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:57.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.004+0000 7f4fc3fff640 1 --2- 172.21.15.92:0/1726060218 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5575bb11fb60 0x5575bb12f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:57.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.005+0000 7f4fbbfff640 1 -- 172.21.15.92:0/1726060218 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5575bb11fb60 msgr2=0x5575bb12f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:57.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.005+0000 7f4fbbfff640 1 --2- 172.21.15.92:0/1726060218 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5575bb11fb60 0x5575bb12f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:57.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.005+0000 7f4fbbfff640 1 -- 172.21.15.92:0/1726060218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575bb12ad40 msgr2=0x5575bb19e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:57.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.005+0000 7f4fbbfff640 1 --2- 172.21.15.92:0/1726060218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575bb12ad40 0x5575bb19e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:57.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.005+0000 7f4fbbfff640 1 -- 172.21.15.92:0/1726060218 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575bb19ed80 con 0x5575bb120480 2024-09-19T09:08:57.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.005+0000 7f4fbbfff640 1 --2- 172.21.15.92:0/1726060218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575bb120480 0x5575bb12f7a0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f4fac0058c0 tx=0x7f4fac004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd1b2f8553308061 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:57.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.005+0000 7f4fa37fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:08:57.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.005+0000 7f4fa37fe640 1 -- 172.21.15.92:0/1726060218 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fac021040 con 0x5575bb120480 2024-09-19T09:08:57.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.005+0000 7f4fa37fe640 1 -- 172.21.15.92:0/1726060218 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4fac0115f0 con 0x5575bb120480 2024-09-19T09:08:57.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.005+0000 7f4fcca81740 1 -- 172.21.15.92:0/1726060218 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fac011440 con 0x5575bb120480 2024-09-19T09:08:57.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.005+0000 7f4fa37fe640 1 -- 172.21.15.92:0/1726060218 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4fac0117f0 con 0x5575bb120480 2024-09-19T09:08:57.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.005+0000 7f4fcca81740 10 client.18270 fetch_fsmap learned FSMap version 19 2024-09-19T09:08:57.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.005+0000 7f4fcca81740 1 -- 172.21.15.92:0/1726060218 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5575bb1a6130 con 0x5575bb120480 2024-09-19T09:08:57.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.005+0000 7f4fa37fe640 1 -- 172.21.15.92:0/1726060218 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fac011440 con 0x5575bb120480 2024-09-19T09:08:57.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.006+0000 7f4fa37fe640 1 -- 172.21.15.92:0/1726060218 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f4fac024070 con 0x5575bb120480 2024-09-19T09:08:57.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.006+0000 7f4fcca81740 10 client.18270 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:08:57.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.006+0000 7f4fcca81740 10 client.18270 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:08:57.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.006+0000 7f4fcca81740 20 client.18270 populate_metadata read hostname 'smithi092' 2024-09-19T09:08:57.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.006+0000 7f4fcca81740 1 --2- 172.21.15.92:0/1726060218 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5575bb1a6830 0x5575bb1a8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:57.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.006+0000 7f4fcca81740 4 client.18270 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:08:57.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.006+0000 7f4fcca81740 1 -- 172.21.15.92:0/1726060218 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5575bb08cd00 con 0x5575bb1a6830 2024-09-19T09:08:57.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.006+0000 7f4fc3fff640 1 --2- 172.21.15.92:0/1726060218 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5575bb1a6830 0x5575bb1a8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:57.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.006+0000 7f4fc3fff640 1 --2- 172.21.15.92:0/1726060218 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5575bb1a6830 0x5575bb1a8c50 crc :-1 s=READY pgs=372 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9db4b3d50e44a987 server_cookie=39157cac7f030d37 in_seq=0 out_seq=0 2024-09-19T09:08:57.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.006+0000 7f4fa37fe640 10 client.18270 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:57.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.007+0000 7f4fa37fe640 1 -- 172.21.15.92:0/1726060218 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5575bb08cd00 con 0x5575bb1a6830 2024-09-19T09:08:57.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.007+0000 7f4fa37fe640 10 client.18270 handle_command_reply: tid=0 2024-09-19T09:08:57.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.007+0000 7f4fcca81740 1 client.18270 shutdown 2024-09-19T09:08:57.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.007+0000 7f4fcca81740 1 -- 172.21.15.92:0/1726060218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575bb120480 msgr2=0x5575bb12f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:57.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.007+0000 7f4fcca81740 1 --2- 172.21.15.92:0/1726060218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575bb120480 0x5575bb12f7a0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f4fac0058c0 tx=0x7f4fac004290 comp rx=0 tx=0).stop 2024-09-19T09:08:57.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.007+0000 7f4fcca81740 1 -- 172.21.15.92:0/1726060218 shutdown_connections 2024-09-19T09:08:57.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.007+0000 7f4fcca81740 1 --2- 172.21.15.92:0/1726060218 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5575bb1a6830 0x5575bb1a8c50 crc :-1 s=READY pgs=372 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:57.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.007+0000 7f4fa37fe640 0 client.18270 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:57.070 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:08:57.070 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-19T09:08:57.070 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "16c8f3ba-cdee-4d35-9051-7624a47dca5a", 2024-09-19T09:08:57.070 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-19T09:08:57.070 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:08:57.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.008+0000 7f4fcca81740 1 --2- 172.21.15.92:0/1726060218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5575bb12ad40 0x5575bb19e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:57.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.008+0000 7f4fcca81740 1 --2- 172.21.15.92:0/1726060218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575bb120480 0x5575bb12f7a0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:57.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.008+0000 7f4fcca81740 1 --2- 172.21.15.92:0/1726060218 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5575bb11fb60 0x5575bb12f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:57.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.008+0000 7f4fcca81740 1 -- 172.21.15.92:0/1726060218 >> 172.21.15.92:0/1726060218 conn(0x5575bb11c0f0 msgr2=0x5575bb127c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:57.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.008+0000 7f4fcca81740 1 -- 172.21.15.92:0/1726060218 shutdown_connections 2024-09-19T09:08:57.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.008+0000 7f4fcca81740 1 -- 172.21.15.92:0/1726060218 wait complete. 2024-09-19T09:08:57.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.008+0000 7f4fcca81740 20 client.18270 trim_cache size 0 max 16384 2024-09-19T09:08:57.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.008+0000 7f4fca6a8640 1 -- 172.21.15.92:0/1996903606 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4fb00a3240 msgr2=0x7f4fb00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:57.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.008+0000 7f4fca6a8640 1 --2- 172.21.15.92:0/1996903606 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4fb00a3240 0x7f4fb00a5700 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc033040 tx=0x7f4fbc0095c0 comp rx=0 tx=0).stop 2024-09-19T09:08:57.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.008+0000 7f4fca6a8640 1 -- 172.21.15.92:0/1996903606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fc4100a80 msgr2=0x7f4fc419a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:57.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.008+0000 7f4fca6a8640 1 --2- 172.21.15.92:0/1996903606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fc4100a80 0x7f4fc419a600 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f4fb400d950 tx=0x7f4fb400de10 comp rx=0 tx=0).stop 2024-09-19T09:08:57.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.008+0000 7f4fca6a8640 1 -- 172.21.15.92:0/1996903606 shutdown_connections 2024-09-19T09:08:57.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.008+0000 7f4fca6a8640 1 --2- 172.21.15.92:0/1996903606 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4fc4106a80 0x7f4fc419eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:57.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.008+0000 7f4fca6a8640 1 --2- 172.21.15.92:0/1996903606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fc4101420 0x7f4fc419ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:57.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.008+0000 7f4fca6a8640 1 --2- 172.21.15.92:0/1996903606 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4fb00a3240 0x7f4fb00a5700 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:57.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.008+0000 7f4fca6a8640 1 --2- 172.21.15.92:0/1996903606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fc4100a80 0x7f4fc419a600 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:57.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.008+0000 7f4fca6a8640 1 -- 172.21.15.92:0/1996903606 >> 172.21.15.92:0/1996903606 conn(0x7f4fc40fc7a0 msgr2=0x7f4fc406a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:57.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.008+0000 7f4fca6a8640 1 -- 172.21.15.92:0/1996903606 shutdown_connections 2024-09-19T09:08:57.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:57.008+0000 7f4fca6a8640 1 -- 172.21.15.92:0/1996903606 wait complete. 2024-09-19T09:08:57.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:56 smithi167 ceph-mon[35359]: pgmap v704: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.6 MiB/s wr, 760 op/s 2024-09-19T09:08:57.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:56 smithi190 ceph-mon[35358]: pgmap v704: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.6 MiB/s wr, 760 op/s 2024-09-19T09:08:57.687 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:08:57.936 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:08:58.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:57 smithi092 ceph-mon[31407]: scrub queued for path: / 2024-09-19T09:08:58.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:57 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:08:58.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:57 smithi092 ceph-mon[31407]: scrub summary: active paths [/] 2024-09-19T09:08:58.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:57 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:08:58.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:57 smithi167 ceph-mon[35359]: scrub queued for path: / 2024-09-19T09:08:58.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:57 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:08:58.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:57 smithi167 ceph-mon[35359]: scrub summary: active paths [/] 2024-09-19T09:08:58.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:57 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:08:58.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:57 smithi190 ceph-mon[35358]: scrub queued for path: / 2024-09-19T09:08:58.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:57 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:08:58.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:57 smithi190 ceph-mon[35358]: scrub summary: active paths [/] 2024-09-19T09:08:58.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:57 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:08:58.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.413+0000 7f6ee8dae640 1 -- 172.21.15.92:0/4269155643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ee41036e0 msgr2=0x7f6ee4107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:58.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.414+0000 7f6ee8dae640 1 --2- 172.21.15.92:0/4269155643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ee41036e0 0x7f6ee4107b90 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc009930 tx=0x7f6ecc02a420 comp rx=0 tx=0).stop 2024-09-19T09:08:58.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.414+0000 7f6ee8dae640 1 -- 172.21.15.92:0/4269155643 shutdown_connections 2024-09-19T09:08:58.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.414+0000 7f6ee8dae640 1 --2- 172.21.15.92:0/4269155643 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ee41082a0 0x7f6ee410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:58.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.414+0000 7f6ee8dae640 1 --2- 172.21.15.92:0/4269155643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ee41036e0 0x7f6ee4107b90 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:58.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.414+0000 7f6ee8dae640 1 --2- 172.21.15.92:0/4269155643 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ee4102d30 0x7f6ee4103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:58.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.414+0000 7f6ee8dae640 1 -- 172.21.15.92:0/4269155643 >> 172.21.15.92:0/4269155643 conn(0x7f6ee40fc7d0 msgr2=0x7f6ee40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:58.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.414+0000 7f6ee8dae640 1 -- 172.21.15.92:0/4269155643 shutdown_connections 2024-09-19T09:08:58.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.414+0000 7f6ee8dae640 1 -- 172.21.15.92:0/4269155643 wait complete. 2024-09-19T09:08:58.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.414+0000 7f6ee8dae640 1 Processor -- start 2024-09-19T09:08:58.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.414+0000 7f6ee8dae640 1 -- start start 2024-09-19T09:08:58.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.415+0000 7f6ee8dae640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ee4102d30 0x7f6ee41985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:58.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.415+0000 7f6ee8dae640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ee41036e0 0x7f6ee4198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:58.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.415+0000 7f6ee8dae640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ee41082a0 0x7f6ee419ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:58.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.415+0000 7f6ee8dae640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee4112060 con 0x7f6ee41036e0 2024-09-19T09:08:58.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.415+0000 7f6ee8dae640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee4111ee0 con 0x7f6ee4102d30 2024-09-19T09:08:58.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.415+0000 7f6ee8dae640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee41121e0 con 0x7f6ee41082a0 2024-09-19T09:08:58.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.415+0000 7f6ee1d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ee41036e0 0x7f6ee4198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:58.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.415+0000 7f6ee1d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ee41036e0 0x7f6ee4198b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51724/0 (socket says 172.21.15.92:51724) 2024-09-19T09:08:58.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.415+0000 7f6ee1d9b640 1 -- 172.21.15.92:0/230506514 learned_addr learned my addr 172.21.15.92:0/230506514 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:58.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.415+0000 7f6ee2d9d640 1 --2- 172.21.15.92:0/230506514 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ee41082a0 0x7f6ee419ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:58.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.415+0000 7f6ee259c640 1 --2- 172.21.15.92:0/230506514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ee4102d30 0x7f6ee41985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:58.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.415+0000 7f6ee1d9b640 1 -- 172.21.15.92:0/230506514 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ee41082a0 msgr2=0x7f6ee419ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:58.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.415+0000 7f6ee1d9b640 1 --2- 172.21.15.92:0/230506514 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ee41082a0 0x7f6ee419ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:58.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.415+0000 7f6ee1d9b640 1 -- 172.21.15.92:0/230506514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ee4102d30 msgr2=0x7f6ee41985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:58.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.415+0000 7f6ee1d9b640 1 --2- 172.21.15.92:0/230506514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ee4102d30 0x7f6ee41985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:58.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.415+0000 7f6ee1d9b640 1 -- 172.21.15.92:0/230506514 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee419d570 con 0x7f6ee41036e0 2024-09-19T09:08:58.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.415+0000 7f6ee1d9b640 1 --2- 172.21.15.92:0/230506514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ee41036e0 0x7f6ee4198b00 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc005940 tx=0x7f6ecc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:58.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.415+0000 7f6edb7fe640 1 -- 172.21.15.92:0/230506514 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc03f030 con 0x7f6ee41036e0 2024-09-19T09:08:58.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.416+0000 7f6edb7fe640 1 -- 172.21.15.92:0/230506514 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ecc003ce0 con 0x7f6ee41036e0 2024-09-19T09:08:58.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.416+0000 7f6ee8dae640 1 -- 172.21.15.92:0/230506514 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ee419d800 con 0x7f6ee41036e0 2024-09-19T09:08:58.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.416+0000 7f6edb7fe640 1 -- 172.21.15.92:0/230506514 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc035070 con 0x7f6ee41036e0 2024-09-19T09:08:58.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.416+0000 7f6ee8dae640 1 -- 172.21.15.92:0/230506514 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ee41a5140 con 0x7f6ee41036e0 2024-09-19T09:08:58.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.418+0000 7f6edb7fe640 1 -- 172.21.15.92:0/230506514 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6ecc042030 con 0x7f6ee41036e0 2024-09-19T09:08:58.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.418+0000 7f6eeb187740 1 Processor -- start 2024-09-19T09:08:58.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.418+0000 7f6eeb187740 1 -- start start 2024-09-19T09:08:58.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.418+0000 7f6eeb187740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c6dc2b4a0 0x564c6dc2b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:58.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.418+0000 7f6eeb187740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c6dc2bdc0 0x564c6dc36140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:58.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.419+0000 7f6eeb187740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c6dc36680 0x564c6dc38a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:58.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.419+0000 7f6eeb187740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564c6db912e0 con 0x564c6dc2b4a0 2024-09-19T09:08:58.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.419+0000 7f6eeb187740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564c6db38ce0 con 0x564c6dc36680 2024-09-19T09:08:58.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.419+0000 7f6eeb187740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x564c6db8d2a0 con 0x564c6dc2bdc0 2024-09-19T09:08:58.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.419+0000 7f6ee2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c6dc2b4a0 0x564c6dc2b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:58.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.419+0000 7f6ee2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c6dc2b4a0 0x564c6dc2b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51740/0 (socket says 172.21.15.92:51740) 2024-09-19T09:08:58.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.419+0000 7f6edb7fe640 1 --2- 172.21.15.92:0/230506514 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6ed00a3240 0x7f6ed00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:58.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.419+0000 7f6ee2d9d640 1 -- 172.21.15.92:0/401671434 learned_addr learned my addr 172.21.15.92:0/401671434 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:58.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.419+0000 7f6ee259c640 1 --2- 172.21.15.92:0/401671434 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c6dc2bdc0 0x564c6dc36140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:58.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.419+0000 7f6ee2d9d640 1 --2- 172.21.15.92:0/230506514 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6ed00a3240 0x7f6ed00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:58.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.419+0000 7f6ee1d9b640 1 --2- 172.21.15.92:0/401671434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c6dc36680 0x564c6dc38a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:58.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.419+0000 7f6edb7fe640 1 -- 172.21.15.92:0/230506514 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f6ecc0efd10 con 0x7f6ee41036e0 2024-09-19T09:08:58.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.419+0000 7f6ee2d9d640 1 -- 172.21.15.92:0/401671434 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c6dc2bdc0 msgr2=0x564c6dc36140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:58.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.419+0000 7f6ee2d9d640 1 --2- 172.21.15.92:0/401671434 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c6dc2bdc0 0x564c6dc36140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:58.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.419+0000 7f6ee2d9d640 1 -- 172.21.15.92:0/401671434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c6dc36680 msgr2=0x564c6dc38a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:58.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.419+0000 7f6ee2d9d640 1 --2- 172.21.15.92:0/401671434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c6dc36680 0x564c6dc38a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:58.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.419+0000 7f6ee2d9d640 1 -- 172.21.15.92:0/401671434 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c6db1d440 con 0x564c6dc2b4a0 2024-09-19T09:08:58.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.419+0000 7f6ee259c640 1 --2- 172.21.15.92:0/401671434 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c6dc2bdc0 0x564c6dc36140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:08:58.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.419+0000 7f6ee2d9d640 1 --2- 172.21.15.92:0/401671434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c6dc2b4a0 0x564c6dc2b880 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4014f10 tx=0x7f6ed4012760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4e6c20f80056171 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:58.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.419+0000 7f6ee2d9d640 1 --2- 172.21.15.92:0/230506514 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6ed00a3240 0x7f6ed00a5700 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4012c60 tx=0x7f6ed400b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:58.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.420+0000 7f6ed8ff9640 1 -- 172.21.15.92:0/401671434 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed4024070 con 0x564c6dc2b4a0 2024-09-19T09:08:58.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.420+0000 7f6ed8ff9640 1 -- 172.21.15.92:0/401671434 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ed4012090 con 0x564c6dc2b4a0 2024-09-19T09:08:58.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.420+0000 7f6ed8ff9640 1 -- 172.21.15.92:0/401671434 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed401f8f0 con 0x564c6dc2b4a0 2024-09-19T09:08:58.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.420+0000 7f6eeb187740 1 -- 172.21.15.92:0/401671434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c6dc2b4a0 msgr2=0x564c6dc2b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:58.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.420+0000 7f6eeb187740 1 --2- 172.21.15.92:0/401671434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c6dc2b4a0 0x564c6dc2b880 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4014f10 tx=0x7f6ed4012760 comp rx=0 tx=0).stop 2024-09-19T09:08:58.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.420+0000 7f6eeb187740 1 -- 172.21.15.92:0/401671434 shutdown_connections 2024-09-19T09:08:58.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.420+0000 7f6eeb187740 1 --2- 172.21.15.92:0/401671434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c6dc36680 0x564c6dc38a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:58.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.420+0000 7f6eeb187740 1 --2- 172.21.15.92:0/401671434 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c6dc2bdc0 0x564c6dc36140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:58.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.420+0000 7f6eeb187740 1 --2- 172.21.15.92:0/401671434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c6dc2b4a0 0x564c6dc2b880 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:58.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.420+0000 7f6eeb187740 1 -- 172.21.15.92:0/401671434 >> 172.21.15.92:0/401671434 conn(0x564c6dc27a30 msgr2=0x564c6dc27e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:58.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.420+0000 7f6eeb187740 1 -- 172.21.15.92:0/401671434 shutdown_connections 2024-09-19T09:08:58.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.421+0000 7f6eeb187740 1 -- 172.21.15.92:0/401671434 wait complete. 2024-09-19T09:08:58.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.421+0000 7f6eeb187740 1 -- start start 2024-09-19T09:08:58.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.421+0000 7f6eeb187740 1 Processor -- start 2024-09-19T09:08:58.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.421+0000 7f6eeb187740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c6dc2b4a0 0x564c6dc36030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:58.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.421+0000 7f6eeb187740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c6dc2bdc0 0x564c6dc332e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:58.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.421+0000 7f6eeb187740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c6dc36680 0x564c6dc33880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:58.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.421+0000 7f6eeb187740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564c6dc39250 con 0x564c6dc36680 2024-09-19T09:08:58.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.421+0000 7f6eeb187740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564c6db4c050 con 0x564c6dc2b4a0 2024-09-19T09:08:58.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.421+0000 7f6eeb187740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x564c6dc393d0 con 0x564c6dc2bdc0 2024-09-19T09:08:58.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.421+0000 7f6eeb187740 10 client.0 _ll_register_callbacks cb 0x564c6db8c160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:58.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.421+0000 7f6ee2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c6dc36680 0x564c6dc33880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:58.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.421+0000 7f6ee2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c6dc36680 0x564c6dc33880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51744/0 (socket says 172.21.15.92:51744) 2024-09-19T09:08:58.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.421+0000 7f6ee2d9d640 1 -- 172.21.15.92:0/92258131 learned_addr learned my addr 172.21.15.92:0/92258131 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:58.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.421+0000 7f6ee1d9b640 1 --2- 172.21.15.92:0/92258131 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c6dc2bdc0 0x564c6dc332e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:58.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.421+0000 7f6ee259c640 1 --2- 172.21.15.92:0/92258131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c6dc2b4a0 0x564c6dc36030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:58.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.422+0000 7f6ee2d9d640 1 -- 172.21.15.92:0/92258131 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c6dc2bdc0 msgr2=0x564c6dc332e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:58.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.422+0000 7f6ee2d9d640 1 --2- 172.21.15.92:0/92258131 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c6dc2bdc0 0x564c6dc332e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:58.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.422+0000 7f6ee2d9d640 1 -- 172.21.15.92:0/92258131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c6dc2b4a0 msgr2=0x564c6dc36030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:58.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.422+0000 7f6ee2d9d640 1 --2- 172.21.15.92:0/92258131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c6dc2b4a0 0x564c6dc36030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:58.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.422+0000 7f6ee2d9d640 1 -- 172.21.15.92:0/92258131 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c6d9023c0 con 0x564c6dc36680 2024-09-19T09:08:58.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.422+0000 7f6ee2d9d640 1 --2- 172.21.15.92:0/92258131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c6dc36680 0x564c6dc33880 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f6ed400ef00 tx=0x7f6ed4014520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb251ad0357590fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:58.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.422+0000 7f6ec9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:08:58.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.422+0000 7f6ec9ffb640 1 -- 172.21.15.92:0/92258131 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed402d020 con 0x564c6dc36680 2024-09-19T09:08:58.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.422+0000 7f6ec9ffb640 1 -- 172.21.15.92:0/92258131 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f6ed40049a0 con 0x564c6dc36680 2024-09-19T09:08:58.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.422+0000 7f6eeb187740 1 -- 172.21.15.92:0/92258131 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ed4012090 con 0x564c6dc36680 2024-09-19T09:08:58.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.422+0000 7f6ec9ffb640 1 -- 172.21.15.92:0/92258131 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6ed4024040 con 0x564c6dc36680 2024-09-19T09:08:58.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.422+0000 7f6eeb187740 10 client.18282 fetch_fsmap learned FSMap version 19 2024-09-19T09:08:58.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.422+0000 7f6eeb187740 1 -- 172.21.15.92:0/92258131 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x564c6dc44c60 con 0x564c6dc36680 2024-09-19T09:08:58.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.422+0000 7f6ec9ffb640 1 -- 172.21.15.92:0/92258131 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ed4012090 con 0x564c6dc36680 2024-09-19T09:08:58.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.423+0000 7f6ec9ffb640 1 -- 172.21.15.92:0/92258131 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f6ed400f040 con 0x564c6dc36680 2024-09-19T09:08:58.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.423+0000 7f6eeb187740 10 client.18282 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:08:58.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.423+0000 7f6eeb187740 10 client.18282 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:08:58.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.423+0000 7f6eeb187740 20 client.18282 populate_metadata read hostname 'smithi092' 2024-09-19T09:08:58.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.423+0000 7f6eeb187740 1 --2- 172.21.15.92:0/92258131 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564c6dc46010 0x564c6dc48400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:58.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.423+0000 7f6eeb187740 4 client.18282 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:08:58.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.423+0000 7f6eeb187740 1 -- 172.21.15.92:0/92258131 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c6db9e850 con 0x564c6dc46010 2024-09-19T09:08:58.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.423+0000 7f6ee259c640 1 --2- 172.21.15.92:0/92258131 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564c6dc46010 0x564c6dc48400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:58.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.424+0000 7f6ee259c640 1 --2- 172.21.15.92:0/92258131 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564c6dc46010 0x564c6dc48400 crc :-1 s=READY pgs=373 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=badcede3919afb20 server_cookie=eaa86ce0846a1d3b in_seq=0 out_seq=0 2024-09-19T09:08:58.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.424+0000 7f6ec9ffb640 10 client.18282 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:58.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.424+0000 7f6ec9ffb640 1 -- 172.21.15.92:0/92258131 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564c6db9e850 con 0x564c6dc46010 2024-09-19T09:08:58.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.424+0000 7f6ec9ffb640 10 client.18282 handle_command_reply: tid=0 2024-09-19T09:08:58.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.424+0000 7f6eeb187740 1 client.18282 shutdown 2024-09-19T09:08:58.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.424+0000 7f6eeb187740 1 -- 172.21.15.92:0/92258131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c6dc36680 msgr2=0x564c6dc33880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:58.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.424+0000 7f6eeb187740 1 --2- 172.21.15.92:0/92258131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c6dc36680 0x564c6dc33880 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f6ed400ef00 tx=0x7f6ed4014520 comp rx=0 tx=0).stop 2024-09-19T09:08:58.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.425+0000 7f6eeb187740 1 -- 172.21.15.92:0/92258131 shutdown_connections 2024-09-19T09:08:58.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.425+0000 7f6eeb187740 1 --2- 172.21.15.92:0/92258131 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564c6dc46010 0x564c6dc48400 crc :-1 s=READY pgs=373 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:58.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.425+0000 7f6eeb187740 1 --2- 172.21.15.92:0/92258131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c6dc36680 0x564c6dc33880 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:58.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.425+0000 7f6eeb187740 1 --2- 172.21.15.92:0/92258131 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c6dc2bdc0 0x564c6dc332e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:58.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.425+0000 7f6ec9ffb640 0 client.18282 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:58.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.425+0000 7f6eeb187740 1 --2- 172.21.15.92:0/92258131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c6dc2b4a0 0x564c6dc36030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:58.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.425+0000 7f6eeb187740 1 -- 172.21.15.92:0/92258131 >> 172.21.15.92:0/92258131 conn(0x564c6dc27a30 msgr2=0x564c6dc26b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:58.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.425+0000 7f6eeb187740 1 -- 172.21.15.92:0/92258131 shutdown_connections 2024-09-19T09:08:58.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.425+0000 7f6eeb187740 1 -- 172.21.15.92:0/92258131 wait complete. 2024-09-19T09:08:58.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.425+0000 7f6eeb187740 20 client.18282 trim_cache size 0 max 16384 2024-09-19T09:08:58.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.442+0000 7f6eeb187740 1 Processor -- start 2024-09-19T09:08:58.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.442+0000 7f6eeb187740 1 -- start start 2024-09-19T09:08:58.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.442+0000 7f6eeb187740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c6dc2b4a0 0x564c6dc424b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:58.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.442+0000 7f6eeb187740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c6dc2bdc0 0x564c6dc4db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:58.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.442+0000 7f6eeb187740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c6dc36680 0x564c6dc4e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:58.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.442+0000 7f6eeb187740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee41ab620 con 0x564c6dc2b4a0 2024-09-19T09:08:58.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.442+0000 7f6eeb187740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee41adec0 con 0x564c6dc2bdc0 2024-09-19T09:08:58.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.442+0000 7f6eeb187740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee41abcb0 con 0x564c6dc36680 2024-09-19T09:08:58.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.442+0000 7f6ee259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c6dc2b4a0 0x564c6dc424b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:58.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.442+0000 7f6ee259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c6dc2b4a0 0x564c6dc424b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51754/0 (socket says 172.21.15.92:51754) 2024-09-19T09:08:58.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.442+0000 7f6ee259c640 1 -- 172.21.15.92:0/2669995113 learned_addr learned my addr 172.21.15.92:0/2669995113 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:58.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.442+0000 7f6ee1d9b640 1 --2- 172.21.15.92:0/2669995113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c6dc2bdc0 0x564c6dc4db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:58.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.442+0000 7f6ee259c640 1 -- 172.21.15.92:0/2669995113 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c6dc36680 msgr2=0x564c6dc4e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:58.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.442+0000 7f6ee259c640 1 --2- 172.21.15.92:0/2669995113 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c6dc36680 0x564c6dc4e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:58.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.442+0000 7f6ee259c640 1 -- 172.21.15.92:0/2669995113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c6dc2bdc0 msgr2=0x564c6dc4db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:58.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.442+0000 7f6ee259c640 1 --2- 172.21.15.92:0/2669995113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c6dc2bdc0 0x564c6dc4db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:58.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.442+0000 7f6ee259c640 1 -- 172.21.15.92:0/2669995113 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c6dc363a0 con 0x564c6dc2b4a0 2024-09-19T09:08:58.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.442+0000 7f6ee1d9b640 1 --2- 172.21.15.92:0/2669995113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c6dc2bdc0 0x564c6dc4db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:08:58.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.442+0000 7f6ee259c640 1 --2- 172.21.15.92:0/2669995113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c6dc2b4a0 0x564c6dc424b0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f6edc0045f0 tx=0x7f6edc00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f817cdd9e557d35 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:58.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.442+0000 7f6ecbfff640 1 -- 172.21.15.92:0/2669995113 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6edc003ce0 con 0x564c6dc2b4a0 2024-09-19T09:08:58.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.443+0000 7f6ecbfff640 1 -- 172.21.15.92:0/2669995113 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6edc003e80 con 0x564c6dc2b4a0 2024-09-19T09:08:58.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.443+0000 7f6ecbfff640 1 -- 172.21.15.92:0/2669995113 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6edc0116a0 con 0x564c6dc2b4a0 2024-09-19T09:08:58.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.443+0000 7f6eeb187740 1 -- 172.21.15.92:0/2669995113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c6dc2b4a0 msgr2=0x564c6dc424b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:58.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.443+0000 7f6eeb187740 1 --2- 172.21.15.92:0/2669995113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c6dc2b4a0 0x564c6dc424b0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f6edc0045f0 tx=0x7f6edc00b390 comp rx=0 tx=0).stop 2024-09-19T09:08:58.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.443+0000 7f6eeb187740 1 -- 172.21.15.92:0/2669995113 shutdown_connections 2024-09-19T09:08:58.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.443+0000 7f6eeb187740 1 --2- 172.21.15.92:0/2669995113 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c6dc36680 0x564c6dc4e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:58.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.443+0000 7f6eeb187740 1 --2- 172.21.15.92:0/2669995113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c6dc2bdc0 0x564c6dc4db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:58.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.443+0000 7f6eeb187740 1 --2- 172.21.15.92:0/2669995113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c6dc2b4a0 0x564c6dc424b0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:58.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.443+0000 7f6eeb187740 1 -- 172.21.15.92:0/2669995113 >> 172.21.15.92:0/2669995113 conn(0x564c6dc27a30 msgr2=0x564c6dc35360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:58.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.443+0000 7f6eeb187740 1 -- 172.21.15.92:0/2669995113 shutdown_connections 2024-09-19T09:08:58.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.443+0000 7f6eeb187740 1 -- 172.21.15.92:0/2669995113 wait complete. 2024-09-19T09:08:58.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.444+0000 7f6eeb187740 1 -- start start 2024-09-19T09:08:58.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.444+0000 7f6eeb187740 1 Processor -- start 2024-09-19T09:08:58.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.444+0000 7f6eeb187740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c6dc2b4a0 0x564c6dc3a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:58.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.444+0000 7f6eeb187740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c6dc2bdc0 0x564c6dc3aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:58.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.444+0000 7f6eeb187740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c6dc36680 0x564c6dc3af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:58.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.444+0000 7f6eeb187740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee41ac380 con 0x564c6dc36680 2024-09-19T09:08:58.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.444+0000 7f6eeb187740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee41ad7f0 con 0x564c6dc2b4a0 2024-09-19T09:08:58.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.444+0000 7f6eeb187740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee41aca50 con 0x564c6dc2bdc0 2024-09-19T09:08:58.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.444+0000 7f6eeb187740 10 client.0 _ll_register_callbacks cb 0x7f6ed4022070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:58.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.444+0000 7f6ee2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c6dc36680 0x564c6dc3af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:58.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.444+0000 7f6ee2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c6dc36680 0x564c6dc3af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51756/0 (socket says 172.21.15.92:51756) 2024-09-19T09:08:58.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.444+0000 7f6ee2d9d640 1 -- 172.21.15.92:0/411174643 learned_addr learned my addr 172.21.15.92:0/411174643 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:08:58.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.444+0000 7f6ee259c640 1 --2- 172.21.15.92:0/411174643 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c6dc2b4a0 0x564c6dc3a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:58.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.444+0000 7f6ee2d9d640 1 -- 172.21.15.92:0/411174643 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c6dc2bdc0 msgr2=0x564c6dc3aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:58.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.444+0000 7f6ee1d9b640 1 --2- 172.21.15.92:0/411174643 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c6dc2bdc0 0x564c6dc3aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:58.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.444+0000 7f6ee2d9d640 1 --2- 172.21.15.92:0/411174643 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c6dc2bdc0 0x564c6dc3aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:58.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.444+0000 7f6ee2d9d640 1 -- 172.21.15.92:0/411174643 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c6dc2b4a0 msgr2=0x564c6dc3a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:58.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.444+0000 7f6ee2d9d640 1 --2- 172.21.15.92:0/411174643 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c6dc2b4a0 0x564c6dc3a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:58.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.444+0000 7f6ee2d9d640 1 -- 172.21.15.92:0/411174643 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c6dcafce0 con 0x564c6dc36680 2024-09-19T09:08:58.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.444+0000 7f6ee1d9b640 1 --2- 172.21.15.92:0/411174643 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c6dc2bdc0 0x564c6dc3aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:08:58.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.444+0000 7f6ee259c640 1 --2- 172.21.15.92:0/411174643 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c6dc2b4a0 0x564c6dc3a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:08:58.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.445+0000 7f6ee2d9d640 1 --2- 172.21.15.92:0/411174643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c6dc36680 0x564c6dc3af80 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4005650 tx=0x7f6ed4009670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35338a9a40d3da08 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:58.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.445+0000 7f6ec9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:08:58.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.445+0000 7f6ec9ffb640 1 -- 172.21.15.92:0/411174643 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed402d040 con 0x564c6dc36680 2024-09-19T09:08:58.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.445+0000 7f6ec9ffb640 1 -- 172.21.15.92:0/411174643 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f6ed40148f0 con 0x564c6dc36680 2024-09-19T09:08:58.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.445+0000 7f6eeb187740 1 -- 172.21.15.92:0/411174643 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564c6db98d60 con 0x564c6dc36680 2024-09-19T09:08:58.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.445+0000 7f6ec9ffb640 1 -- 172.21.15.92:0/411174643 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6ed40143d0 con 0x564c6dc36680 2024-09-19T09:08:58.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.445+0000 7f6eeb187740 10 client.18288 fetch_fsmap learned FSMap version 19 2024-09-19T09:08:58.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.445+0000 7f6eeb187740 1 -- 172.21.15.92:0/411174643 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x564c6dcb0f20 con 0x564c6dc36680 2024-09-19T09:08:58.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.445+0000 7f6ec9ffb640 1 -- 172.21.15.92:0/411174643 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x564c6db98d60 con 0x564c6dc36680 2024-09-19T09:08:58.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.445+0000 7f6ec9ffb640 1 -- 172.21.15.92:0/411174643 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f6ed403f490 con 0x564c6dc36680 2024-09-19T09:08:58.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.445+0000 7f6eeb187740 10 client.18288 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:08:58.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.445+0000 7f6eeb187740 10 client.18288 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:08:58.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.445+0000 7f6eeb187740 20 client.18288 populate_metadata read hostname 'smithi092' 2024-09-19T09:08:58.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.445+0000 7f6eeb187740 1 --2- 172.21.15.92:0/411174643 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564c6dcb1580 0x564c6dcb39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:58.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.445+0000 7f6eeb187740 4 client.18288 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:08:58.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.445+0000 7f6eeb187740 1 -- 172.21.15.92:0/411174643 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564c6db15210 con 0x564c6dcb1580 2024-09-19T09:08:58.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.446+0000 7f6ee259c640 1 --2- 172.21.15.92:0/411174643 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564c6dcb1580 0x564c6dcb39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:58.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.446+0000 7f6ec9ffb640 10 client.18288 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:58.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.446+0000 7f6ee259c640 1 --2- 172.21.15.92:0/411174643 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564c6dcb1580 0x564c6dcb39a0 crc :-1 s=READY pgs=374 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a97d453f18a7fc41 server_cookie=5ba7e24ce75635df in_seq=0 out_seq=0 2024-09-19T09:08:58.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.446+0000 7f6ec9ffb640 1 -- 172.21.15.92:0/411174643 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x564c6db15210 con 0x564c6dcb1580 2024-09-19T09:08:58.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.446+0000 7f6ec9ffb640 10 client.18288 handle_command_reply: tid=0 2024-09-19T09:08:58.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.446+0000 7f6eeb187740 1 client.18288 shutdown 2024-09-19T09:08:58.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.446+0000 7f6eeb187740 1 -- 172.21.15.92:0/411174643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c6dc36680 msgr2=0x564c6dc3af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:58.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.446+0000 7f6eeb187740 1 --2- 172.21.15.92:0/411174643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c6dc36680 0x564c6dc3af80 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4005650 tx=0x7f6ed4009670 comp rx=0 tx=0).stop 2024-09-19T09:08:58.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.446+0000 7f6eeb187740 1 -- 172.21.15.92:0/411174643 shutdown_connections 2024-09-19T09:08:58.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.446+0000 7f6eeb187740 1 --2- 172.21.15.92:0/411174643 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564c6dcb1580 0x564c6dcb39a0 crc :-1 s=READY pgs=374 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:58.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.446+0000 7f6eeb187740 1 --2- 172.21.15.92:0/411174643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564c6dc36680 0x564c6dc3af80 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:58.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.446+0000 7f6eeb187740 1 --2- 172.21.15.92:0/411174643 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c6dc2bdc0 0x564c6dc3aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:58.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.446+0000 7f6ec9ffb640 0 client.18288 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:08:58.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.446+0000 7f6eeb187740 1 --2- 172.21.15.92:0/411174643 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c6dc2b4a0 0x564c6dc3a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:58.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.446+0000 7f6eeb187740 1 -- 172.21.15.92:0/411174643 >> 172.21.15.92:0/411174643 conn(0x564c6dc27a30 msgr2=0x564c6dc31a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:58.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.447+0000 7f6eeb187740 1 -- 172.21.15.92:0/411174643 shutdown_connections 2024-09-19T09:08:58.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.447+0000 7f6eeb187740 1 -- 172.21.15.92:0/411174643 wait complete. 2024-09-19T09:08:58.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.447+0000 7f6eeb187740 20 client.18288 trim_cache size 0 max 16384 2024-09-19T09:08:58.454 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:08:58.454 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:08:58.454 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": { 2024-09-19T09:08:58.454 INFO:teuthology.orchestra.run.smithi092.stdout: "16c8f3ba-cdee-4d35-9051-7624a47dca5a": { 2024-09-19T09:08:58.454 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-19T09:08:58.454 INFO:teuthology.orchestra.run.smithi092.stdout: "tag": "16c8f3ba-cdee-4d35-9051-7624a47dca5a", 2024-09-19T09:08:58.454 INFO:teuthology.orchestra.run.smithi092.stdout: "options": "recursive,force" 2024-09-19T09:08:58.454 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:08:58.454 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:08:58.454 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:08:58.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.447+0000 7f6ee8dae640 1 -- 172.21.15.92:0/230506514 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6ed00a3240 msgr2=0x7f6ed00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:58.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.447+0000 7f6ee8dae640 1 --2- 172.21.15.92:0/230506514 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6ed00a3240 0x7f6ed00a5700 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4012c60 tx=0x7f6ed400b000 comp rx=0 tx=0).stop 2024-09-19T09:08:58.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.447+0000 7f6ee8dae640 1 -- 172.21.15.92:0/230506514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ee41036e0 msgr2=0x7f6ee4198b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:58.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.447+0000 7f6ee8dae640 1 --2- 172.21.15.92:0/230506514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ee41036e0 0x7f6ee4198b00 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc005940 tx=0x7f6ecc0042f0 comp rx=0 tx=0).stop 2024-09-19T09:08:58.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.447+0000 7f6ee8dae640 1 -- 172.21.15.92:0/230506514 shutdown_connections 2024-09-19T09:08:58.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.447+0000 7f6ee8dae640 1 --2- 172.21.15.92:0/230506514 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ee41082a0 0x7f6ee419ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:58.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.447+0000 7f6ee8dae640 1 --2- 172.21.15.92:0/230506514 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6ed00a3240 0x7f6ed00a5700 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:58.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.447+0000 7f6ee8dae640 1 --2- 172.21.15.92:0/230506514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ee41036e0 0x7f6ee4198b00 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:58.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.447+0000 7f6ee8dae640 1 --2- 172.21.15.92:0/230506514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ee4102d30 0x7f6ee41985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:58.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.447+0000 7f6ee8dae640 1 -- 172.21.15.92:0/230506514 >> 172.21.15.92:0/230506514 conn(0x7f6ee40fc7d0 msgr2=0x7f6ee4105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:58.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.447+0000 7f6ee8dae640 1 -- 172.21.15.92:0/230506514 shutdown_connections 2024-09-19T09:08:58.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:08:58.447+0000 7f6ee8dae640 1 -- 172.21.15.92:0/230506514 wait complete. 2024-09-19T09:08:59.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:58 smithi092 ceph-mon[31407]: pgmap v705: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 6.9 MiB/s wr, 712 op/s 2024-09-19T09:08:59.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:08:58 smithi092 ceph-mon[31407]: scrub summary: idle 2024-09-19T09:08:59.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:58 smithi167 ceph-mon[35359]: pgmap v705: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 6.9 MiB/s wr, 712 op/s 2024-09-19T09:08:59.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:08:58 smithi167 ceph-mon[35359]: scrub summary: idle 2024-09-19T09:08:59.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:58 smithi190 ceph-mon[35358]: pgmap v705: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 6.9 MiB/s wr, 712 op/s 2024-09-19T09:08:59.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:08:58 smithi190 ceph-mon[35358]: scrub summary: idle 2024-09-19T09:08:59.472 INFO:tasks.cephfs.filesystem:scrub status for tag:16c8f3ba-cdee-4d35-9051-7624a47dca5a - {'path': '/', 'tag': '16c8f3ba-cdee-4d35-9051-7624a47dca5a', 'options': 'recursive,force'} 2024-09-19T09:09:00.800 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:09:01.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:00 smithi092 ceph-mon[31407]: pgmap v706: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 5.2 MiB/s wr, 627 op/s 2024-09-19T09:09:01.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:00 smithi167 ceph-mon[35359]: pgmap v706: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 5.2 MiB/s wr, 627 op/s 2024-09-19T09:09:01.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:00 smithi190 ceph-mon[35358]: pgmap v706: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 5.2 MiB/s wr, 627 op/s 2024-09-19T09:09:03.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:02 smithi092 ceph-mon[31407]: pgmap v707: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 4.6 MiB/s wr, 559 op/s 2024-09-19T09:09:03.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:02 smithi167 ceph-mon[35359]: pgmap v707: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 4.6 MiB/s wr, 559 op/s 2024-09-19T09:09:03.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:02 smithi190 ceph-mon[35358]: pgmap v707: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 4.6 MiB/s wr, 559 op/s 2024-09-19T09:09:03.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.910+0000 7fcc88d86640 1 -- 172.21.15.92:0/1127909313 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc841001d0 msgr2=0x7fcc841005d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:03.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.910+0000 7fcc88d86640 1 --2- 172.21.15.92:0/1127909313 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc841001d0 0x7fcc841005d0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fcc7400adb0 tx=0x7fcc7402b7a0 comp rx=0 tx=0).stop 2024-09-19T09:09:03.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.910+0000 7fcc88d86640 1 -- 172.21.15.92:0/1127909313 shutdown_connections 2024-09-19T09:09:03.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.910+0000 7fcc88d86640 1 --2- 172.21.15.92:0/1127909313 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc84101d80 0x7fcc84108610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:03.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.910+0000 7fcc88d86640 1 --2- 172.21.15.92:0/1127909313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc841013c0 0x7fcc84101840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:03.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.910+0000 7fcc88d86640 1 --2- 172.21.15.92:0/1127909313 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc841001d0 0x7fcc841005d0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:03.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.910+0000 7fcc88d86640 1 -- 172.21.15.92:0/1127909313 >> 172.21.15.92:0/1127909313 conn(0x7fcc840fb970 msgr2=0x7fcc840fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:03.912 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.910+0000 7fcc88d86640 1 -- 172.21.15.92:0/1127909313 shutdown_connections 2024-09-19T09:09:03.912 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.910+0000 7fcc88d86640 1 -- 172.21.15.92:0/1127909313 wait complete. 2024-09-19T09:09:03.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.911+0000 7fcc88d86640 1 Processor -- start 2024-09-19T09:09:03.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.911+0000 7fcc88d86640 1 -- start start 2024-09-19T09:09:03.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.911+0000 7fcc88d86640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc841001d0 0x7fcc84195b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:03.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.911+0000 7fcc88d86640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc841013c0 0x7fcc84196070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:03.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.911+0000 7fcc88d86640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc84101d80 0x7fcc8419d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:03.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.911+0000 7fcc88d86640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcc8410b600 con 0x7fcc84101d80 2024-09-19T09:09:03.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.911+0000 7fcc88d86640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcc8410b480 con 0x7fcc841013c0 2024-09-19T09:09:03.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.911+0000 7fcc88d86640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fcc8410b780 con 0x7fcc841001d0 2024-09-19T09:09:03.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.911+0000 7fcc82d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc84101d80 0x7fcc8419d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:03.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.911+0000 7fcc82d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc84101d80 0x7fcc8419d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39614/0 (socket says 172.21.15.92:39614) 2024-09-19T09:09:03.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.911+0000 7fcc82d9d640 1 -- 172.21.15.92:0/2743773434 learned_addr learned my addr 172.21.15.92:0/2743773434 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:03.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.911+0000 7fcc81d9b640 1 --2- 172.21.15.92:0/2743773434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc841013c0 0x7fcc84196070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:03.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.912+0000 7fcc82d9d640 1 -- 172.21.15.92:0/2743773434 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc841001d0 msgr2=0x7fcc84195b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:03.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.912+0000 7fcc8259c640 1 --2- 172.21.15.92:0/2743773434 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc841001d0 0x7fcc84195b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:03.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.912+0000 7fcc82d9d640 1 --2- 172.21.15.92:0/2743773434 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc841001d0 0x7fcc84195b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:03.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.912+0000 7fcc82d9d640 1 -- 172.21.15.92:0/2743773434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc841013c0 msgr2=0x7fcc84196070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:03.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.912+0000 7fcc82d9d640 1 --2- 172.21.15.92:0/2743773434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc841013c0 0x7fcc84196070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:03.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.912+0000 7fcc82d9d640 1 -- 172.21.15.92:0/2743773434 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc8419d750 con 0x7fcc84101d80 2024-09-19T09:09:03.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.912+0000 7fcc82d9d640 1 --2- 172.21.15.92:0/2743773434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc84101d80 0x7fcc8419d0e0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c00c970 tx=0x7fcc7c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:03.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.912+0000 7fcc737fe640 1 -- 172.21.15.92:0/2743773434 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c007bb0 con 0x7fcc84101d80 2024-09-19T09:09:03.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.912+0000 7fcc737fe640 1 -- 172.21.15.92:0/2743773434 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc7c007d50 con 0x7fcc84101d80 2024-09-19T09:09:03.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.912+0000 7fcc88d86640 1 -- 172.21.15.92:0/2743773434 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc8419da40 con 0x7fcc84101d80 2024-09-19T09:09:03.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.912+0000 7fcc737fe640 1 -- 172.21.15.92:0/2743773434 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c00f450 con 0x7fcc84101d80 2024-09-19T09:09:03.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.912+0000 7fcc88d86640 1 -- 172.21.15.92:0/2743773434 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc8419df40 con 0x7fcc84101d80 2024-09-19T09:09:03.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.915+0000 7fcc737fe640 1 -- 172.21.15.92:0/2743773434 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fcc7c004f60 con 0x7fcc84101d80 2024-09-19T09:09:03.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.915+0000 7fcc8bbfe740 1 Processor -- start 2024-09-19T09:09:03.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.915+0000 7fcc8bbfe740 1 -- start start 2024-09-19T09:09:03.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.915+0000 7fcc8bbfe740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576b6077f30 0x5576b6076770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:03.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.915+0000 7fcc8bbfe740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5576b6078330 0x5576b6076cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:03.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.915+0000 7fcc8bbfe740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576b6077240 0x5576b6082cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:03.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.915+0000 7fcc8bbfe740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5576b5fda2f0 con 0x5576b6077240 2024-09-19T09:09:03.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.915+0000 7fcc8bbfe740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5576b5f82270 con 0x5576b6077f30 2024-09-19T09:09:03.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.915+0000 7fcc8bbfe740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5576b5fd62b0 con 0x5576b6078330 2024-09-19T09:09:03.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.916+0000 7fcc81d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576b6077240 0x5576b6082cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:03.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.916+0000 7fcc81d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576b6077240 0x5576b6082cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39620/0 (socket says 172.21.15.92:39620) 2024-09-19T09:09:03.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.916+0000 7fcc81d9b640 1 -- 172.21.15.92:0/3243154979 learned_addr learned my addr 172.21.15.92:0/3243154979 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:03.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.916+0000 7fcc81d9b640 1 --2- 172.21.15.92:0/3243154979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576b6077f30 0x5576b6076770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:03.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.916+0000 7fcc8259c640 1 --2- 172.21.15.92:0/3243154979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5576b6078330 0x5576b6076cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:03.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.916+0000 7fcc737fe640 1 --2- 172.21.15.92:0/2743773434 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcc6c0a32f0 0x7fcc6c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:03.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.916+0000 7fcc82d9d640 1 --2- 172.21.15.92:0/2743773434 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcc6c0a32f0 0x7fcc6c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:03.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.916+0000 7fcc81d9b640 1 -- 172.21.15.92:0/3243154979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5576b6078330 msgr2=0x5576b6076cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:03.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.916+0000 7fcc81d9b640 1 --2- 172.21.15.92:0/3243154979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5576b6078330 0x5576b6076cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:03.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.916+0000 7fcc81d9b640 1 -- 172.21.15.92:0/3243154979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576b6077f30 msgr2=0x5576b6076770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:03.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.916+0000 7fcc81d9b640 1 --2- 172.21.15.92:0/3243154979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576b6077f30 0x5576b6076770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:03.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.916+0000 7fcc81d9b640 1 -- 172.21.15.92:0/3243154979 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576b5f81340 con 0x5576b6077240 2024-09-19T09:09:03.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.916+0000 7fcc737fe640 1 -- 172.21.15.92:0/2743773434 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcc7c0cf6f0 con 0x7fcc84101d80 2024-09-19T09:09:03.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.916+0000 7fcc81d9b640 1 --2- 172.21.15.92:0/3243154979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576b6077240 0x5576b6082cd0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fcc78013930 tx=0x7fcc7800b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d4dce868938d2c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:03.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.916+0000 7fcc70ff9640 1 -- 172.21.15.92:0/3243154979 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc7800e950 con 0x5576b6077240 2024-09-19T09:09:03.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.916+0000 7fcc70ff9640 1 -- 172.21.15.92:0/3243154979 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc78011440 con 0x5576b6077240 2024-09-19T09:09:03.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.916+0000 7fcc70ff9640 1 -- 172.21.15.92:0/3243154979 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc78010630 con 0x5576b6077240 2024-09-19T09:09:03.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.917+0000 7fcc8bbfe740 1 -- 172.21.15.92:0/3243154979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576b6077240 msgr2=0x5576b6082cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:03.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.917+0000 7fcc82d9d640 1 --2- 172.21.15.92:0/2743773434 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcc6c0a32f0 0x7fcc6c0a57b0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c0a4450 tx=0x7fcc7c0666a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:03.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.917+0000 7fcc8bbfe740 1 --2- 172.21.15.92:0/3243154979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576b6077240 0x5576b6082cd0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fcc78013930 tx=0x7fcc7800b460 comp rx=0 tx=0).stop 2024-09-19T09:09:03.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.917+0000 7fcc8bbfe740 1 -- 172.21.15.92:0/3243154979 shutdown_connections 2024-09-19T09:09:03.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.917+0000 7fcc8bbfe740 1 --2- 172.21.15.92:0/3243154979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576b6077240 0x5576b6082cd0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:03.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.917+0000 7fcc8bbfe740 1 --2- 172.21.15.92:0/3243154979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5576b6078330 0x5576b6076cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:03.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.917+0000 7fcc8bbfe740 1 --2- 172.21.15.92:0/3243154979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576b6077f30 0x5576b6076770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:03.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.917+0000 7fcc8bbfe740 1 -- 172.21.15.92:0/3243154979 >> 172.21.15.92:0/3243154979 conn(0x5576b6072010 msgr2=0x5576b6072410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:03.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.917+0000 7fcc8bbfe740 1 -- 172.21.15.92:0/3243154979 shutdown_connections 2024-09-19T09:09:03.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.917+0000 7fcc8bbfe740 1 -- 172.21.15.92:0/3243154979 wait complete. 2024-09-19T09:09:03.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.918+0000 7fcc8bbfe740 1 -- start start 2024-09-19T09:09:03.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.918+0000 7fcc8bbfe740 1 Processor -- start 2024-09-19T09:09:03.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.918+0000 7fcc8bbfe740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576b6077240 0x5576b60850b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:03.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.918+0000 7fcc8bbfe740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5576b6077f30 0x5576b60855f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:03.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.918+0000 7fcc8bbfe740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576b6078330 0x5576b608c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:03.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.918+0000 7fcc8bbfe740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5576b6083770 con 0x5576b6078330 2024-09-19T09:09:03.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.918+0000 7fcc8bbfe740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5576b5f63290 con 0x5576b6077240 2024-09-19T09:09:03.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.918+0000 7fcc8bbfe740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5576b60838f0 con 0x5576b6077f30 2024-09-19T09:09:03.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.918+0000 7fcc8bbfe740 10 client.0 _ll_register_callbacks cb 0x5576b5f94140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:09:03.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.918+0000 7fcc81d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576b6078330 0x5576b608c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:03.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.918+0000 7fcc81d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576b6078330 0x5576b608c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39622/0 (socket says 172.21.15.92:39622) 2024-09-19T09:09:03.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.918+0000 7fcc81d9b640 1 -- 172.21.15.92:0/716570861 learned_addr learned my addr 172.21.15.92:0/716570861 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:03.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.918+0000 7fcc81d9b640 1 --2- 172.21.15.92:0/716570861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576b6077240 0x5576b60850b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:03.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.918+0000 7fcc81d9b640 1 -- 172.21.15.92:0/716570861 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5576b6077f30 msgr2=0x5576b60855f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:03.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.918+0000 7fcc81d9b640 1 --2- 172.21.15.92:0/716570861 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5576b6077f30 0x5576b60855f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:03.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.918+0000 7fcc81d9b640 1 -- 172.21.15.92:0/716570861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576b6077240 msgr2=0x5576b60850b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:03.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.918+0000 7fcc81d9b640 1 --2- 172.21.15.92:0/716570861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576b6077240 0x5576b60850b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:03.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.918+0000 7fcc81d9b640 1 -- 172.21.15.92:0/716570861 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576b5ced210 con 0x5576b6078330 2024-09-19T09:09:03.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.918+0000 7fcc81d9b640 1 --2- 172.21.15.92:0/716570861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576b6078330 0x5576b608c5c0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fcc78005fd0 tx=0x7fcc78005d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=853dc44c9f5037d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:03.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.918+0000 7fcc69ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:09:03.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.919+0000 7fcc69ffb640 1 -- 172.21.15.92:0/716570861 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc78011a00 con 0x5576b6078330 2024-09-19T09:09:03.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.919+0000 7fcc69ffb640 1 -- 172.21.15.92:0/716570861 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcc78004030 con 0x5576b6078330 2024-09-19T09:09:03.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.919+0000 7fcc8bbfe740 1 -- 172.21.15.92:0/716570861 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc78011440 con 0x5576b6078330 2024-09-19T09:09:03.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.919+0000 7fcc69ffb640 1 -- 172.21.15.92:0/716570861 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fcc78004230 con 0x5576b6078330 2024-09-19T09:09:03.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.919+0000 7fcc8bbfe740 10 client.18300 fetch_fsmap learned FSMap version 19 2024-09-19T09:09:03.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.919+0000 7fcc8bbfe740 1 -- 172.21.15.92:0/716570861 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5576b5db9620 con 0x5576b6078330 2024-09-19T09:09:03.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.919+0000 7fcc69ffb640 1 -- 172.21.15.92:0/716570861 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc78011440 con 0x5576b6078330 2024-09-19T09:09:03.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.919+0000 7fcc69ffb640 1 -- 172.21.15.92:0/716570861 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fcc78010810 con 0x5576b6078330 2024-09-19T09:09:03.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.919+0000 7fcc8bbfe740 10 client.18300 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:09:03.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.919+0000 7fcc8bbfe740 10 client.18300 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:09:03.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.919+0000 7fcc8bbfe740 20 client.18300 populate_metadata read hostname 'smithi092' 2024-09-19T09:09:03.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.919+0000 7fcc8bbfe740 1 --2- 172.21.15.92:0/716570861 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5576b6090b60 0x5576b6092f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:03.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.919+0000 7fcc8bbfe740 4 client.18300 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:09:03.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.919+0000 7fcc8bbfe740 1 -- 172.21.15.92:0/716570861 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576b5fe7a20 con 0x5576b6090b60 2024-09-19T09:09:03.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.920+0000 7fcc8259c640 1 --2- 172.21.15.92:0/716570861 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5576b6090b60 0x5576b6092f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:03.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.920+0000 7fcc69ffb640 10 client.18300 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:03.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.920+0000 7fcc8259c640 1 --2- 172.21.15.92:0/716570861 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5576b6090b60 0x5576b6092f50 crc :-1 s=READY pgs=375 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=473b7e9588fa6761 server_cookie=7f099e17a4afc57e in_seq=0 out_seq=0 2024-09-19T09:09:03.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.921+0000 7fcc69ffb640 1 -- 172.21.15.92:0/716570861 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5576b5fe7a20 con 0x5576b6090b60 2024-09-19T09:09:03.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.921+0000 7fcc69ffb640 10 client.18300 handle_command_reply: tid=0 2024-09-19T09:09:03.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.921+0000 7fcc8bbfe740 1 client.18300 shutdown 2024-09-19T09:09:03.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.921+0000 7fcc8bbfe740 1 -- 172.21.15.92:0/716570861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576b6078330 msgr2=0x5576b608c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:03.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.921+0000 7fcc8bbfe740 1 --2- 172.21.15.92:0/716570861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576b6078330 0x5576b608c5c0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fcc78005fd0 tx=0x7fcc78005d60 comp rx=0 tx=0).stop 2024-09-19T09:09:03.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.921+0000 7fcc8bbfe740 1 -- 172.21.15.92:0/716570861 shutdown_connections 2024-09-19T09:09:03.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.921+0000 7fcc8bbfe740 1 --2- 172.21.15.92:0/716570861 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5576b6090b60 0x5576b6092f50 crc :-1 s=READY pgs=375 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:03.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.921+0000 7fcc8bbfe740 1 --2- 172.21.15.92:0/716570861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576b6078330 0x5576b608c5c0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:03.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.921+0000 7fcc69ffb640 0 client.18300 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:03.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.921+0000 7fcc8bbfe740 1 --2- 172.21.15.92:0/716570861 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5576b6077f30 0x5576b60855f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:03.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.921+0000 7fcc8bbfe740 1 --2- 172.21.15.92:0/716570861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576b6077240 0x5576b60850b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:03.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.921+0000 7fcc8bbfe740 1 -- 172.21.15.92:0/716570861 >> 172.21.15.92:0/716570861 conn(0x5576b6072010 msgr2=0x5576b6073000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:03.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.921+0000 7fcc8bbfe740 1 -- 172.21.15.92:0/716570861 shutdown_connections 2024-09-19T09:09:03.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.921+0000 7fcc8bbfe740 1 -- 172.21.15.92:0/716570861 wait complete. 2024-09-19T09:09:03.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.921+0000 7fcc8bbfe740 20 client.18300 trim_cache size 0 max 16384 2024-09-19T09:09:03.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.935+0000 7fcc8bbfe740 1 Processor -- start 2024-09-19T09:09:03.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.935+0000 7fcc8bbfe740 1 -- start start 2024-09-19T09:09:03.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.935+0000 7fcc8bbfe740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576b6072010 0x5576b6073400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:03.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.935+0000 7fcc8bbfe740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576b6077240 0x5576b608c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:03.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.935+0000 7fcc8bbfe740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5576b6077f30 0x5576b6073940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:03.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.935+0000 7fcc8bbfe740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcc841a4d80 con 0x5576b6072010 2024-09-19T09:09:03.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.935+0000 7fcc8bbfe740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcc841a7620 con 0x5576b6077240 2024-09-19T09:09:03.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.935+0000 7fcc8bbfe740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fcc841a5410 con 0x5576b6077f30 2024-09-19T09:09:03.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.935+0000 7fcc81d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576b6072010 0x5576b6073400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:03.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.935+0000 7fcc81d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576b6072010 0x5576b6073400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39624/0 (socket says 172.21.15.92:39624) 2024-09-19T09:09:03.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.935+0000 7fcc81d9b640 1 -- 172.21.15.92:0/1697084883 learned_addr learned my addr 172.21.15.92:0/1697084883 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:03.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.936+0000 7fcc8259c640 1 --2- 172.21.15.92:0/1697084883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576b6077240 0x5576b608c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:03.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.936+0000 7fcc81d9b640 1 -- 172.21.15.92:0/1697084883 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5576b6077f30 msgr2=0x5576b6073940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:03.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.936+0000 7fcc81d9b640 1 --2- 172.21.15.92:0/1697084883 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5576b6077f30 0x5576b6073940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:03.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.936+0000 7fcc81d9b640 1 -- 172.21.15.92:0/1697084883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576b6077240 msgr2=0x5576b608c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:03.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.936+0000 7fcc81d9b640 1 --2- 172.21.15.92:0/1697084883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576b6077240 0x5576b608c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:03.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.936+0000 7fcc81d9b640 1 -- 172.21.15.92:0/1697084883 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576b60932c0 con 0x5576b6072010 2024-09-19T09:09:03.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.936+0000 7fcc81d9b640 1 --2- 172.21.15.92:0/1697084883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576b6072010 0x5576b6073400 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fcc7800b3d0 tx=0x7fcc7800b400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e87a240d33c4d35b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:03.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.936+0000 7fcc6bfff640 1 -- 172.21.15.92:0/1697084883 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc7800b640 con 0x5576b6072010 2024-09-19T09:09:03.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.936+0000 7fcc6bfff640 1 -- 172.21.15.92:0/1697084883 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc78011440 con 0x5576b6072010 2024-09-19T09:09:03.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.936+0000 7fcc6bfff640 1 -- 172.21.15.92:0/1697084883 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc7800ec50 con 0x5576b6072010 2024-09-19T09:09:03.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.936+0000 7fcc8bbfe740 1 -- 172.21.15.92:0/1697084883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576b6072010 msgr2=0x5576b6073400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:03.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.937+0000 7fcc8bbfe740 1 --2- 172.21.15.92:0/1697084883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576b6072010 0x5576b6073400 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fcc7800b3d0 tx=0x7fcc7800b400 comp rx=0 tx=0).stop 2024-09-19T09:09:03.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.937+0000 7fcc8bbfe740 1 -- 172.21.15.92:0/1697084883 shutdown_connections 2024-09-19T09:09:03.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.937+0000 7fcc8bbfe740 1 --2- 172.21.15.92:0/1697084883 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5576b6077f30 0x5576b6073940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:03.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.937+0000 7fcc8bbfe740 1 --2- 172.21.15.92:0/1697084883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576b6077240 0x5576b608c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:03.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.937+0000 7fcc8bbfe740 1 --2- 172.21.15.92:0/1697084883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576b6072010 0x5576b6073400 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:03.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.937+0000 7fcc8bbfe740 1 -- 172.21.15.92:0/1697084883 >> 172.21.15.92:0/1697084883 conn(0x5576b6082e90 msgr2=0x5576b60709a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:03.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.937+0000 7fcc8bbfe740 1 -- 172.21.15.92:0/1697084883 shutdown_connections 2024-09-19T09:09:03.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.937+0000 7fcc8bbfe740 1 -- 172.21.15.92:0/1697084883 wait complete. 2024-09-19T09:09:03.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.937+0000 7fcc8bbfe740 1 -- start start 2024-09-19T09:09:03.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.937+0000 7fcc8bbfe740 1 Processor -- start 2024-09-19T09:09:03.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.937+0000 7fcc8bbfe740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5576b6072010 0x5576b6089440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:03.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.937+0000 7fcc8bbfe740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576b6077240 0x5576b6089980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:03.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.937+0000 7fcc8bbfe740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576b6077f30 0x5576b60f97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:03.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.937+0000 7fcc8bbfe740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcc841a5ae0 con 0x5576b6077f30 2024-09-19T09:09:03.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.937+0000 7fcc8bbfe740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcc841a6f50 con 0x5576b6077240 2024-09-19T09:09:03.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.937+0000 7fcc8bbfe740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fcc841a61b0 con 0x5576b6072010 2024-09-19T09:09:03.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.937+0000 7fcc8bbfe740 10 client.0 _ll_register_callbacks cb 0x7fcc7800bea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:09:03.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.937+0000 7fcc81d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576b6077f30 0x5576b60f97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:03.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.937+0000 7fcc81d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576b6077f30 0x5576b60f97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39630/0 (socket says 172.21.15.92:39630) 2024-09-19T09:09:03.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.937+0000 7fcc81d9b640 1 -- 172.21.15.92:0/2647977818 learned_addr learned my addr 172.21.15.92:0/2647977818 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:03.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.937+0000 7fcc8259c640 1 --2- 172.21.15.92:0/2647977818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576b6077240 0x5576b6089980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:03.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.938+0000 7fcc81d9b640 1 -- 172.21.15.92:0/2647977818 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5576b6072010 msgr2=0x5576b6089440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:03.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.938+0000 7fcc81d9b640 1 --2- 172.21.15.92:0/2647977818 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5576b6072010 0x5576b6089440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:03.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.938+0000 7fcc81d9b640 1 -- 172.21.15.92:0/2647977818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576b6077240 msgr2=0x5576b6089980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:03.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.938+0000 7fcc81d9b640 1 --2- 172.21.15.92:0/2647977818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576b6077240 0x5576b6089980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:03.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.938+0000 7fcc81d9b640 1 -- 172.21.15.92:0/2647977818 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576b60f9d10 con 0x5576b6077f30 2024-09-19T09:09:03.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.938+0000 7fcc81d9b640 1 --2- 172.21.15.92:0/2647977818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576b6077f30 0x5576b60f97d0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fcc78005f20 tx=0x7fcc78011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b8eea55d93b444 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:03.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.938+0000 7fcc69ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:09:03.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.938+0000 7fcc69ffb640 1 -- 172.21.15.92:0/2647977818 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc7800b640 con 0x5576b6077f30 2024-09-19T09:09:03.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.938+0000 7fcc69ffb640 1 -- 172.21.15.92:0/2647977818 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcc780109d0 con 0x5576b6077f30 2024-09-19T09:09:03.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.938+0000 7fcc8bbfe740 1 -- 172.21.15.92:0/2647977818 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc78011440 con 0x5576b6077f30 2024-09-19T09:09:03.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.938+0000 7fcc69ffb640 1 -- 172.21.15.92:0/2647977818 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fcc78048050 con 0x5576b6077f30 2024-09-19T09:09:03.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.938+0000 7fcc8bbfe740 10 client.18306 fetch_fsmap learned FSMap version 19 2024-09-19T09:09:03.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.938+0000 7fcc8bbfe740 1 -- 172.21.15.92:0/2647977818 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5576b60faf60 con 0x5576b6077f30 2024-09-19T09:09:03.945 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.938+0000 7fcc69ffb640 1 -- 172.21.15.92:0/2647977818 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc78011440 con 0x5576b6077f30 2024-09-19T09:09:03.945 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.938+0000 7fcc69ffb640 1 -- 172.21.15.92:0/2647977818 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fcc7803f070 con 0x5576b6077f30 2024-09-19T09:09:03.945 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.938+0000 7fcc8bbfe740 10 client.18306 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:09:03.945 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.938+0000 7fcc8bbfe740 10 client.18306 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:09:03.945 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.938+0000 7fcc8bbfe740 20 client.18306 populate_metadata read hostname 'smithi092' 2024-09-19T09:09:03.945 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.938+0000 7fcc8bbfe740 1 --2- 172.21.15.92:0/2647977818 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5576b6078330 0x5576b60fd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:03.945 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.938+0000 7fcc8bbfe740 4 client.18306 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:09:03.945 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.938+0000 7fcc8bbfe740 1 -- 172.21.15.92:0/2647977818 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5576b5fe1d70 con 0x5576b6078330 2024-09-19T09:09:03.945 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.939+0000 7fcc8259c640 1 --2- 172.21.15.92:0/2647977818 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5576b6078330 0x5576b60fd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:03.945 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.939+0000 7fcc69ffb640 10 client.18306 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:03.945 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.939+0000 7fcc8259c640 1 --2- 172.21.15.92:0/2647977818 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5576b6078330 0x5576b60fd800 crc :-1 s=READY pgs=376 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e9b6e9862886fd1 server_cookie=fa4fd44fb4bc2205 in_seq=0 out_seq=0 2024-09-19T09:09:03.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.960+0000 7fcc69ffb640 1 -- 172.21.15.92:0/2647977818 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5576b5fe1d70 con 0x5576b6078330 2024-09-19T09:09:03.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.960+0000 7fcc69ffb640 10 client.18306 handle_command_reply: tid=0 2024-09-19T09:09:03.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.960+0000 7fcc8bbfe740 1 client.18306 shutdown 2024-09-19T09:09:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.960+0000 7fcc8bbfe740 1 -- 172.21.15.92:0/2647977818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576b6077f30 msgr2=0x5576b60f97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.960+0000 7fcc8bbfe740 1 --2- 172.21.15.92:0/2647977818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576b6077f30 0x5576b60f97d0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fcc78005f20 tx=0x7fcc78011b30 comp rx=0 tx=0).stop 2024-09-19T09:09:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.960+0000 7fcc8bbfe740 1 -- 172.21.15.92:0/2647977818 shutdown_connections 2024-09-19T09:09:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.960+0000 7fcc8bbfe740 1 --2- 172.21.15.92:0/2647977818 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5576b6078330 0x5576b60fd800 crc :-1 s=READY pgs=376 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.960+0000 7fcc8bbfe740 1 --2- 172.21.15.92:0/2647977818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576b6077f30 0x5576b60f97d0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.960+0000 7fcc8bbfe740 1 --2- 172.21.15.92:0/2647977818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576b6077240 0x5576b6089980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.960+0000 7fcc69ffb640 0 client.18306 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.960+0000 7fcc8bbfe740 1 --2- 172.21.15.92:0/2647977818 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5576b6072010 0x5576b6089440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.960+0000 7fcc8bbfe740 1 -- 172.21.15.92:0/2647977818 >> 172.21.15.92:0/2647977818 conn(0x5576b6082e90 msgr2=0x5576b60711c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.960+0000 7fcc8bbfe740 1 -- 172.21.15.92:0/2647977818 shutdown_connections 2024-09-19T09:09:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.960+0000 7fcc8bbfe740 1 -- 172.21.15.92:0/2647977818 wait complete. 2024-09-19T09:09:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.960+0000 7fcc8bbfe740 20 client.18306 trim_cache size 0 max 16384 2024-09-19T09:09:03.964 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:09:03.964 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:09:03.964 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:09:03.964 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:09:03.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.961+0000 7fcc88d86640 1 -- 172.21.15.92:0/2743773434 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcc6c0a32f0 msgr2=0x7fcc6c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:03.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.961+0000 7fcc88d86640 1 --2- 172.21.15.92:0/2743773434 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcc6c0a32f0 0x7fcc6c0a57b0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c0a4450 tx=0x7fcc7c0666a0 comp rx=0 tx=0).stop 2024-09-19T09:09:03.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.961+0000 7fcc88d86640 1 -- 172.21.15.92:0/2743773434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc84101d80 msgr2=0x7fcc8419d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:03.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.961+0000 7fcc88d86640 1 --2- 172.21.15.92:0/2743773434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc84101d80 0x7fcc8419d0e0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c00c970 tx=0x7fcc7c00ce30 comp rx=0 tx=0).stop 2024-09-19T09:09:03.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.961+0000 7fcc88d86640 1 -- 172.21.15.92:0/2743773434 shutdown_connections 2024-09-19T09:09:03.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.961+0000 7fcc88d86640 1 --2- 172.21.15.92:0/2743773434 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcc6c0a32f0 0x7fcc6c0a57b0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:03.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.961+0000 7fcc88d86640 1 --2- 172.21.15.92:0/2743773434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc84101d80 0x7fcc8419d0e0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:03.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.961+0000 7fcc88d86640 1 --2- 172.21.15.92:0/2743773434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc841013c0 0x7fcc84196070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:03.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.961+0000 7fcc88d86640 1 --2- 172.21.15.92:0/2743773434 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc841001d0 0x7fcc84195b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:03.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.961+0000 7fcc88d86640 1 -- 172.21.15.92:0/2743773434 >> 172.21.15.92:0/2743773434 conn(0x7fcc840fb970 msgr2=0x7fcc841046c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:03.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.961+0000 7fcc88d86640 1 -- 172.21.15.92:0/2743773434 shutdown_connections 2024-09-19T09:09:03.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:03.961+0000 7fcc88d86640 1 -- 172.21.15.92:0/2743773434 wait complete. 2024-09-19T09:09:05.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:04 smithi092 ceph-mon[31407]: pgmap v708: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 3.2 MiB/s wr, 424 op/s 2024-09-19T09:09:05.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:04 smithi167 ceph-mon[35359]: pgmap v708: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 3.2 MiB/s wr, 424 op/s 2024-09-19T09:09:05.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:04 smithi190 ceph-mon[35358]: pgmap v708: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 3.2 MiB/s wr, 424 op/s 2024-09-19T09:09:05.799 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:09:06.926 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:06 smithi190 ceph-mon[35358]: pgmap v709: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 2.1 MiB/s wr, 293 op/s 2024-09-19T09:09:07.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:06 smithi092 ceph-mon[31407]: pgmap v709: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 2.1 MiB/s wr, 293 op/s 2024-09-19T09:09:07.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:06 smithi167 ceph-mon[35359]: pgmap v709: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 2.1 MiB/s wr, 293 op/s 2024-09-19T09:09:09.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:09 smithi092 ceph-mon[31407]: pgmap v710: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 3.2 MiB/s wr, 254 op/s 2024-09-19T09:09:09.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:09 smithi167 ceph-mon[35359]: pgmap v710: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 3.2 MiB/s wr, 254 op/s 2024-09-19T09:09:09.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:09 smithi190 ceph-mon[35358]: pgmap v710: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 3.2 MiB/s wr, 254 op/s 2024-09-19T09:09:10.800 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:09:11.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:10 smithi092 ceph-mon[31407]: pgmap v711: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 4.5 MiB/s wr, 228 op/s 2024-09-19T09:09:11.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:10 smithi167 ceph-mon[35359]: pgmap v711: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 4.5 MiB/s wr, 228 op/s 2024-09-19T09:09:11.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:10 smithi190 ceph-mon[35358]: pgmap v711: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 4.5 MiB/s wr, 228 op/s 2024-09-19T09:09:13.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:12 smithi092 ceph-mon[31407]: pgmap v712: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.8 MiB/s wr, 127 op/s 2024-09-19T09:09:13.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:12 smithi167 ceph-mon[35359]: pgmap v712: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.8 MiB/s wr, 127 op/s 2024-09-19T09:09:13.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:12 smithi190 ceph-mon[35358]: pgmap v712: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.8 MiB/s wr, 127 op/s 2024-09-19T09:09:13.837 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:09:14.095 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:09:14.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.512+0000 7f0a1e05c640 1 -- 172.21.15.92:0/1151807021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a18102790 msgr2=0x7f0a181067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:14.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.512+0000 7f0a1e05c640 1 --2- 172.21.15.92:0/1151807021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a18102790 0x7f0a181067e0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f0a00009900 tx=0x7f0a0002a410 comp rx=0 tx=0).stop 2024-09-19T09:09:14.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.512+0000 7f0a1e05c640 1 -- 172.21.15.92:0/1151807021 shutdown_connections 2024-09-19T09:09:14.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.512+0000 7f0a1e05c640 1 --2- 172.21.15.92:0/1151807021 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a18106f10 0x7f0a1810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:14.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.512+0000 7f0a1e05c640 1 --2- 172.21.15.92:0/1151807021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a18102790 0x7f0a181067e0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:14.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.512+0000 7f0a1e05c640 1 --2- 172.21.15.92:0/1151807021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a18101de0 0x7f0a181021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:14.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.512+0000 7f0a1e05c640 1 -- 172.21.15.92:0/1151807021 >> 172.21.15.92:0/1151807021 conn(0x7f0a180fd880 msgr2=0x7f0a180ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:14.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.512+0000 7f0a1e05c640 1 -- 172.21.15.92:0/1151807021 shutdown_connections 2024-09-19T09:09:14.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.512+0000 7f0a1e05c640 1 -- 172.21.15.92:0/1151807021 wait complete. 2024-09-19T09:09:14.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.512+0000 7f0a1e05c640 1 Processor -- start 2024-09-19T09:09:14.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.512+0000 7f0a1e05c640 1 -- start start 2024-09-19T09:09:14.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.513+0000 7f0a1e05c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a18101de0 0x7f0a1819a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:14.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.513+0000 7f0a1e05c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a18102790 0x7f0a1819abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:14.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.513+0000 7f0a1e05c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a18106f10 0x7f0a1819ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:14.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.513+0000 7f0a1e05c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0a18111f70 con 0x7f0a18106f10 2024-09-19T09:09:14.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.513+0000 7f0a1e05c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0a18111df0 con 0x7f0a18101de0 2024-09-19T09:09:14.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.513+0000 7f0a1e05c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0a181120f0 con 0x7f0a18102790 2024-09-19T09:09:14.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.513+0000 7f0a17fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a18106f10 0x7f0a1819ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:14.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.513+0000 7f0a17fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a18106f10 0x7f0a1819ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50962/0 (socket says 172.21.15.92:50962) 2024-09-19T09:09:14.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.513+0000 7f0a17fff640 1 -- 172.21.15.92:0/3501970080 learned_addr learned my addr 172.21.15.92:0/3501970080 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:14.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.513+0000 7f0a0ffff640 1 --2- 172.21.15.92:0/3501970080 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a18102790 0x7f0a1819abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:14.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.513+0000 7f0a177fe640 1 --2- 172.21.15.92:0/3501970080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a18101de0 0x7f0a1819a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:14.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.513+0000 7f0a17fff640 1 -- 172.21.15.92:0/3501970080 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a18102790 msgr2=0x7f0a1819abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:14.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.513+0000 7f0a17fff640 1 --2- 172.21.15.92:0/3501970080 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a18102790 0x7f0a1819abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:14.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.513+0000 7f0a17fff640 1 -- 172.21.15.92:0/3501970080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a18101de0 msgr2=0x7f0a1819a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:14.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.513+0000 7f0a17fff640 1 --2- 172.21.15.92:0/3501970080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a18101de0 0x7f0a1819a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:14.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.513+0000 7f0a17fff640 1 -- 172.21.15.92:0/3501970080 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a1819f640 con 0x7f0a18106f10 2024-09-19T09:09:14.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.513+0000 7f0a0ffff640 1 --2- 172.21.15.92:0/3501970080 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a18102790 0x7f0a1819abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:09:14.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.513+0000 7f0a17fff640 1 --2- 172.21.15.92:0/3501970080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a18106f10 0x7f0a1819ef60 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f0a1000eaa0 tx=0x7f0a1000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:14.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.513+0000 7f0a157fa640 1 -- 172.21.15.92:0/3501970080 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1000cdb0 con 0x7f0a18106f10 2024-09-19T09:09:14.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.513+0000 7f0a157fa640 1 -- 172.21.15.92:0/3501970080 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a10005020 con 0x7f0a18106f10 2024-09-19T09:09:14.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.513+0000 7f0a1e05c640 1 -- 172.21.15.92:0/3501970080 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a1819f930 con 0x7f0a18106f10 2024-09-19T09:09:14.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.513+0000 7f0a157fa640 1 -- 172.21.15.92:0/3501970080 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a100116b0 con 0x7f0a18106f10 2024-09-19T09:09:14.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.513+0000 7f0a1e05c640 1 -- 172.21.15.92:0/3501970080 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a181a7210 con 0x7f0a18106f10 2024-09-19T09:09:14.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.514+0000 7f0a1e05c640 1 -- 172.21.15.92:0/3501970080 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a181021c0 con 0x7f0a18106f10 2024-09-19T09:09:14.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.515+0000 7f0a157fa640 1 -- 172.21.15.92:0/3501970080 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0a10005560 con 0x7f0a18106f10 2024-09-19T09:09:14.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.516+0000 7f0a157fa640 1 --2- 172.21.15.92:0/3501970080 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f0a040a3240 0x7f0a040a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:14.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.516+0000 7f0a177fe640 1 --2- 172.21.15.92:0/3501970080 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f0a040a3240 0x7f0a040a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:14.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.516+0000 7f0a157fa640 1 -- 172.21.15.92:0/3501970080 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f0a100cfb70 con 0x7f0a18106f10 2024-09-19T09:09:14.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.517+0000 7f0a177fe640 1 --2- 172.21.15.92:0/3501970080 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f0a040a3240 0x7f0a040a5700 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0a08005fd0 tx=0x7f0a08005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:14.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.520+0000 7f0a157fa640 1 -- 172.21.15.92:0/3501970080 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0a10016030 con 0x7f0a18106f10 2024-09-19T09:09:14.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.724+0000 7f0a1e05c640 1 -- 172.21.15.92:0/3501970080 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0a181a7470 con 0x7f0a18106f10 2024-09-19T09:09:14.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.724+0000 7f0a157fa640 1 -- 172.21.15.92:0/3501970080 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f0a1009c890 con 0x7f0a18106f10 2024-09-19T09:09:14.725 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:09:14.725 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:09:14.725 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:09:14.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.727+0000 7f0a1e05c640 1 -- 172.21.15.92:0/3501970080 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f0a040a3240 msgr2=0x7f0a040a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:14.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.727+0000 7f0a1e05c640 1 --2- 172.21.15.92:0/3501970080 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f0a040a3240 0x7f0a040a5700 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0a08005fd0 tx=0x7f0a08005850 comp rx=0 tx=0).stop 2024-09-19T09:09:14.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.727+0000 7f0a1e05c640 1 -- 172.21.15.92:0/3501970080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a18106f10 msgr2=0x7f0a1819ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:14.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.727+0000 7f0a1e05c640 1 --2- 172.21.15.92:0/3501970080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a18106f10 0x7f0a1819ef60 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f0a1000eaa0 tx=0x7f0a1000ef60 comp rx=0 tx=0).stop 2024-09-19T09:09:14.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.727+0000 7f0a1e05c640 1 -- 172.21.15.92:0/3501970080 shutdown_connections 2024-09-19T09:09:14.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.727+0000 7f0a1e05c640 1 --2- 172.21.15.92:0/3501970080 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f0a040a3240 0x7f0a040a5700 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:14.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.727+0000 7f0a1e05c640 1 --2- 172.21.15.92:0/3501970080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a18106f10 0x7f0a1819ef60 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:14.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.727+0000 7f0a1e05c640 1 --2- 172.21.15.92:0/3501970080 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a18102790 0x7f0a1819abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:14.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.727+0000 7f0a1e05c640 1 --2- 172.21.15.92:0/3501970080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a18101de0 0x7f0a1819a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:14.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.727+0000 7f0a1e05c640 1 -- 172.21.15.92:0/3501970080 >> 172.21.15.92:0/3501970080 conn(0x7f0a180fd880 msgr2=0x7f0a180feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:14.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.727+0000 7f0a1e05c640 1 -- 172.21.15.92:0/3501970080 shutdown_connections 2024-09-19T09:09:14.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:14.727+0000 7f0a1e05c640 1 -- 172.21.15.92:0/3501970080 wait complete. 2024-09-19T09:09:15.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:14 smithi092 ceph-mon[31407]: pgmap v713: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.8 MiB/s wr, 107 op/s 2024-09-19T09:09:15.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:14 smithi167 ceph-mon[35359]: pgmap v713: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.8 MiB/s wr, 107 op/s 2024-09-19T09:09:15.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:14 smithi190 ceph-mon[35358]: pgmap v713: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.8 MiB/s wr, 107 op/s 2024-09-19T09:09:15.432 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id 4853c4a2 --release --await' 2024-09-19T09:09:15.433 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id 4853c4a2 --release --await 2024-09-19T09:09:15.676 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:09:15.795 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:09:15.921 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:15 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3501970080' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:09:16.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:15 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3501970080' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:09:16.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:15 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3501970080' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:09:16.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.125+0000 7f39aaef7640 1 -- 172.21.15.92:0/2777690513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39a4102780 msgr2=0x7f39a41067d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:16.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.125+0000 7f39aaef7640 1 --2- 172.21.15.92:0/2777690513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39a4102780 0x7f39a41067d0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f398c009900 tx=0x7f398c02a410 comp rx=0 tx=0).stop 2024-09-19T09:09:16.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.125+0000 7f39aaef7640 1 -- 172.21.15.92:0/2777690513 shutdown_connections 2024-09-19T09:09:16.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.125+0000 7f39aaef7640 1 --2- 172.21.15.92:0/2777690513 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39a4106f00 0x7f39a410ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:16.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.125+0000 7f39aaef7640 1 --2- 172.21.15.92:0/2777690513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39a4102780 0x7f39a41067d0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:16.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.125+0000 7f39aaef7640 1 --2- 172.21.15.92:0/2777690513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39a4101dd0 0x7f39a41021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:16.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.125+0000 7f39aaef7640 1 -- 172.21.15.92:0/2777690513 >> 172.21.15.92:0/2777690513 conn(0x7f39a40fd8b0 msgr2=0x7f39a40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:16.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.125+0000 7f39aaef7640 1 -- 172.21.15.92:0/2777690513 shutdown_connections 2024-09-19T09:09:16.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.125+0000 7f39aaef7640 1 -- 172.21.15.92:0/2777690513 wait complete. 2024-09-19T09:09:16.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.125+0000 7f39aaef7640 1 Processor -- start 2024-09-19T09:09:16.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.125+0000 7f39aaef7640 1 -- start start 2024-09-19T09:09:16.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.125+0000 7f39aaef7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39a4101dd0 0x7f39a41a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:16.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.125+0000 7f39aaef7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39a4102780 0x7f39a41a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:16.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.126+0000 7f39aaef7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39a4106f00 0x7f39a419a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:16.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.126+0000 7f39aaef7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f39a4112000 con 0x7f39a4106f00 2024-09-19T09:09:16.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.126+0000 7f39aaef7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f39a4111e80 con 0x7f39a4102780 2024-09-19T09:09:16.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.126+0000 7f39aaef7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f39a4112180 con 0x7f39a4101dd0 2024-09-19T09:09:16.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.126+0000 7f39a9494640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39a4106f00 0x7f39a419a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:16.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.126+0000 7f39a9494640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39a4106f00 0x7f39a419a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50988/0 (socket says 172.21.15.92:50988) 2024-09-19T09:09:16.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.126+0000 7f39a9494640 1 -- 172.21.15.92:0/2074873508 learned_addr learned my addr 172.21.15.92:0/2074873508 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:16.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.126+0000 7f39a8c93640 1 --2- 172.21.15.92:0/2074873508 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39a4101dd0 0x7f39a41a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:16.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.126+0000 7f39a3fff640 1 --2- 172.21.15.92:0/2074873508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39a4102780 0x7f39a41a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:16.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.126+0000 7f39a9494640 1 -- 172.21.15.92:0/2074873508 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39a4101dd0 msgr2=0x7f39a41a0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:16.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.126+0000 7f39a9494640 1 --2- 172.21.15.92:0/2074873508 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39a4101dd0 0x7f39a41a0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:16.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.126+0000 7f39a9494640 1 -- 172.21.15.92:0/2074873508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39a4102780 msgr2=0x7f39a41a0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:16.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.126+0000 7f39a9494640 1 --2- 172.21.15.92:0/2074873508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39a4102780 0x7f39a41a0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:16.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.126+0000 7f39a9494640 1 -- 172.21.15.92:0/2074873508 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a419ad00 con 0x7f39a4106f00 2024-09-19T09:09:16.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.126+0000 7f39a8c93640 1 --2- 172.21.15.92:0/2074873508 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39a4101dd0 0x7f39a41a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:09:16.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.126+0000 7f39a9494640 1 --2- 172.21.15.92:0/2074873508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39a4106f00 0x7f39a419a5d0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f399c009fd0 tx=0x7f399c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:16.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.126+0000 7f39a1ffb640 1 -- 172.21.15.92:0/2074873508 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f399c011830 con 0x7f39a4106f00 2024-09-19T09:09:16.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.126+0000 7f39aaef7640 1 -- 172.21.15.92:0/2074873508 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39a419aff0 con 0x7f39a4106f00 2024-09-19T09:09:16.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.126+0000 7f39a1ffb640 1 -- 172.21.15.92:0/2074873508 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f399c016070 con 0x7f39a4106f00 2024-09-19T09:09:16.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.126+0000 7f39a1ffb640 1 -- 172.21.15.92:0/2074873508 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f399c00f2e0 con 0x7f39a4106f00 2024-09-19T09:09:16.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.127+0000 7f39aaef7640 1 -- 172.21.15.92:0/2074873508 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39a41a72e0 con 0x7f39a4106f00 2024-09-19T09:09:16.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.129+0000 7f39a1ffb640 1 -- 172.21.15.92:0/2074873508 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f399c0119d0 con 0x7f39a4106f00 2024-09-19T09:09:16.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.129+0000 7f39ad2d0740 1 Processor -- start 2024-09-19T09:09:16.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.129+0000 7f39ad2d0740 1 -- start start 2024-09-19T09:09:16.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.129+0000 7f39a1ffb640 1 --2- 172.21.15.92:0/2074873508 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f39900a32c0 0x7f39900a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:16.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.129+0000 7f39ad2d0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f32161f060 0x55f32161f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:16.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.129+0000 7f39ad2d0740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f32161f980 0x55f321629d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:16.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.129+0000 7f39ad2d0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f32162a240 0x55f32162c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:16.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.129+0000 7f39ad2d0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f321584620 con 0x55f32162a240 2024-09-19T09:09:16.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.129+0000 7f39ad2d0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f32152be50 con 0x55f32161f060 2024-09-19T09:09:16.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.129+0000 7f39ad2d0740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f3215805e0 con 0x55f32161f980 2024-09-19T09:09:16.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.129+0000 7f39a3fff640 1 --2- 172.21.15.92:0/2074873508 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f39900a32c0 0x7f39900a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:16.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.129+0000 7f39a1ffb640 1 -- 172.21.15.92:0/2074873508 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f399c0cefb0 con 0x7f39a4106f00 2024-09-19T09:09:16.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.129+0000 7f39a9494640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f32162a240 0x55f32162c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:16.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.130+0000 7f39a9494640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f32162a240 0x55f32162c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50996/0 (socket says 172.21.15.92:50996) 2024-09-19T09:09:16.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.130+0000 7f39a9494640 1 -- 172.21.15.92:0/3345891710 learned_addr learned my addr 172.21.15.92:0/3345891710 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:16.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.130+0000 7f39a8c93640 1 --2- 172.21.15.92:0/3345891710 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f32161f060 0x55f32161f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:16.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.130+0000 7f39a9494640 1 -- 172.21.15.92:0/3345891710 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f32161f980 msgr2=0x55f321629d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:16.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.130+0000 7f39a9494640 1 --2- 172.21.15.92:0/3345891710 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f32161f980 0x55f321629d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:16.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.130+0000 7f39a9494640 1 -- 172.21.15.92:0/3345891710 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f32161f060 msgr2=0x55f32161f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:16.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.130+0000 7f39a9494640 1 --2- 172.21.15.92:0/3345891710 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f32161f060 0x55f32161f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:16.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.130+0000 7f39a9494640 1 -- 172.21.15.92:0/3345891710 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f32151cd40 con 0x55f32162a240 2024-09-19T09:09:16.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.130+0000 7f39a8c93640 1 --2- 172.21.15.92:0/3345891710 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f32161f060 0x55f32161f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:09:16.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.130+0000 7f39a3fff640 1 --2- 172.21.15.92:0/2074873508 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f39900a32c0 0x7f39900a5780 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f39a419b710 tx=0x7f398c0315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:16.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.130+0000 7f39a9494640 1 --2- 172.21.15.92:0/3345891710 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f32162a240 0x55f32162c630 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f399c0a3cd0 tx=0x7f399c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cafbcb5585f24c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:16.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.130+0000 7f399affd640 1 -- 172.21.15.92:0/3345891710 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f399c049ad0 con 0x55f32162a240 2024-09-19T09:09:16.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.130+0000 7f399affd640 1 -- 172.21.15.92:0/3345891710 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f399c09bc90 con 0x55f32162a240 2024-09-19T09:09:16.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.130+0000 7f399affd640 1 -- 172.21.15.92:0/3345891710 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f399c0ccbe0 con 0x55f32162a240 2024-09-19T09:09:16.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.131+0000 7f39ad2d0740 1 -- 172.21.15.92:0/3345891710 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f32162a240 msgr2=0x55f32162c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:16.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.131+0000 7f39ad2d0740 1 --2- 172.21.15.92:0/3345891710 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f32162a240 0x55f32162c630 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f399c0a3cd0 tx=0x7f399c011000 comp rx=0 tx=0).stop 2024-09-19T09:09:16.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.131+0000 7f39ad2d0740 1 -- 172.21.15.92:0/3345891710 shutdown_connections 2024-09-19T09:09:16.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.131+0000 7f39ad2d0740 1 --2- 172.21.15.92:0/3345891710 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f32162a240 0x55f32162c630 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:16.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.131+0000 7f39ad2d0740 1 --2- 172.21.15.92:0/3345891710 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f32161f980 0x55f321629d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:16.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.131+0000 7f39ad2d0740 1 --2- 172.21.15.92:0/3345891710 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f32161f060 0x55f32161f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:16.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.131+0000 7f39ad2d0740 1 -- 172.21.15.92:0/3345891710 >> 172.21.15.92:0/3345891710 conn(0x55f32161b5f0 msgr2=0x55f32161b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:16.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.131+0000 7f39ad2d0740 1 -- 172.21.15.92:0/3345891710 shutdown_connections 2024-09-19T09:09:16.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.131+0000 7f39ad2d0740 1 -- 172.21.15.92:0/3345891710 wait complete. 2024-09-19T09:09:16.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.131+0000 7f39ad2d0740 1 -- start start 2024-09-19T09:09:16.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.131+0000 7f39ad2d0740 1 Processor -- start 2024-09-19T09:09:16.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.132+0000 7f39ad2d0740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f32161f060 0x55f3216270e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:16.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.132+0000 7f39ad2d0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f32161f980 0x55f321627620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:16.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.132+0000 7f39ad2d0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f32162a240 0x55f321627b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:16.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.132+0000 7f39ad2d0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f32162ce10 con 0x55f32161f980 2024-09-19T09:09:16.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.132+0000 7f39ad2d0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f32150cf10 con 0x55f32162a240 2024-09-19T09:09:16.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.132+0000 7f39ad2d0740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f32162cf90 con 0x55f32161f060 2024-09-19T09:09:16.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.132+0000 7f39ad2d0740 10 client.0 _ll_register_callbacks cb 0x55f321530db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:09:16.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.132+0000 7f39a3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f32161f980 0x55f321627620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:16.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.132+0000 7f39a3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f32161f980 0x55f321627620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51000/0 (socket says 172.21.15.92:51000) 2024-09-19T09:09:16.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.132+0000 7f39a3fff640 1 -- 172.21.15.92:0/1115398933 learned_addr learned my addr 172.21.15.92:0/1115398933 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:16.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.132+0000 7f39a8c93640 1 --2- 172.21.15.92:0/1115398933 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f32161f060 0x55f3216270e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:16.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.132+0000 7f39a9494640 1 --2- 172.21.15.92:0/1115398933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f32162a240 0x55f321627b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:16.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.132+0000 7f39a3fff640 1 -- 172.21.15.92:0/1115398933 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f32161f060 msgr2=0x55f3216270e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:16.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.132+0000 7f39a3fff640 1 --2- 172.21.15.92:0/1115398933 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f32161f060 0x55f3216270e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:16.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.132+0000 7f39a3fff640 1 -- 172.21.15.92:0/1115398933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f32162a240 msgr2=0x55f321627b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:16.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.132+0000 7f39a3fff640 1 --2- 172.21.15.92:0/1115398933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f32162a240 0x55f321627b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:16.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.132+0000 7f39a3fff640 1 -- 172.21.15.92:0/1115398933 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f321293580 con 0x55f32161f980 2024-09-19T09:09:16.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.132+0000 7f39a9494640 1 --2- 172.21.15.92:0/1115398933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f32162a240 0x55f321627b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:09:16.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.132+0000 7f39a3fff640 1 --2- 172.21.15.92:0/1115398933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f32161f980 0x55f321627620 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f398c033000 tx=0x7f398c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b05c910758fb84c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:16.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.132+0000 7f3983fff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:09:16.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.133+0000 7f3983fff640 1 -- 172.21.15.92:0/1115398933 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398c04c020 con 0x55f32161f980 2024-09-19T09:09:16.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.133+0000 7f3983fff640 1 -- 172.21.15.92:0/1115398933 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f398c003a00 con 0x55f32161f980 2024-09-19T09:09:16.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.133+0000 7f39ad2d0740 1 -- 172.21.15.92:0/1115398933 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f399c09bc90 con 0x55f32161f980 2024-09-19T09:09:16.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.133+0000 7f3983fff640 1 -- 172.21.15.92:0/1115398933 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f398c035050 con 0x55f32161f980 2024-09-19T09:09:16.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.133+0000 7f39ad2d0740 10 client.18324 fetch_fsmap learned FSMap version 19 2024-09-19T09:09:16.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.133+0000 7f39ad2d0740 1 -- 172.21.15.92:0/1115398933 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f32135d960 con 0x55f32161f980 2024-09-19T09:09:16.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.133+0000 7f3983fff640 1 -- 172.21.15.92:0/1115398933 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f399c09bc90 con 0x55f32161f980 2024-09-19T09:09:16.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.133+0000 7f3983fff640 1 -- 172.21.15.92:0/1115398933 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f398c03d450 con 0x55f32161f980 2024-09-19T09:09:16.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.133+0000 7f39ad2d0740 10 client.18324 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:09:16.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.133+0000 7f39ad2d0740 10 client.18324 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:09:16.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.133+0000 7f39ad2d0740 20 client.18324 populate_metadata read hostname 'smithi092' 2024-09-19T09:09:16.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.133+0000 7f39ad2d0740 1 --2- 172.21.15.92:0/1115398933 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f321639c40 0x55f32163c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:16.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.133+0000 7f39ad2d0740 4 client.18324 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:09:16.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.133+0000 7f39ad2d0740 1 -- 172.21.15.92:0/1115398933 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f321591b90 con 0x55f321639c40 2024-09-19T09:09:16.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.134+0000 7f39a8c93640 1 --2- 172.21.15.92:0/1115398933 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f321639c40 0x55f32163c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:16.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.134+0000 7f39a8c93640 1 --2- 172.21.15.92:0/1115398933 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f321639c40 0x55f32163c080 crc :-1 s=READY pgs=378 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3155a97f987ff342 server_cookie=d0c142473cccf16 in_seq=0 out_seq=0 2024-09-19T09:09:16.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.134+0000 7f3983fff640 10 client.18324 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:16.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.135+0000 7f3983fff640 1 -- 172.21.15.92:0/1115398933 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f321591b90 con 0x55f321639c40 2024-09-19T09:09:16.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.135+0000 7f3983fff640 10 client.18324 handle_command_reply: tid=0 2024-09-19T09:09:16.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.135+0000 7f39ad2d0740 1 client.18324 shutdown 2024-09-19T09:09:16.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.135+0000 7f39ad2d0740 1 -- 172.21.15.92:0/1115398933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f32161f980 msgr2=0x55f321627620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:16.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.135+0000 7f39ad2d0740 1 --2- 172.21.15.92:0/1115398933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f32161f980 0x55f321627620 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f398c033000 tx=0x7f398c009260 comp rx=0 tx=0).stop 2024-09-19T09:09:16.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.135+0000 7f39ad2d0740 1 -- 172.21.15.92:0/1115398933 shutdown_connections 2024-09-19T09:09:16.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.135+0000 7f39ad2d0740 1 --2- 172.21.15.92:0/1115398933 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f321639c40 0x55f32163c080 crc :-1 s=READY pgs=378 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:16.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.135+0000 7f39ad2d0740 1 --2- 172.21.15.92:0/1115398933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f32162a240 0x55f321627b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:16.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.135+0000 7f39ad2d0740 1 --2- 172.21.15.92:0/1115398933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f32161f980 0x55f321627620 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:16.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.135+0000 7f3983fff640 0 client.18324 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:16.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.135+0000 7f39ad2d0740 1 --2- 172.21.15.92:0/1115398933 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f32161f060 0x55f3216270e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:16.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.135+0000 7f39ad2d0740 1 -- 172.21.15.92:0/1115398933 >> 172.21.15.92:0/1115398933 conn(0x55f32161b5f0 msgr2=0x55f3216212d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:16.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.135+0000 7f39ad2d0740 1 -- 172.21.15.92:0/1115398933 shutdown_connections 2024-09-19T09:09:16.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.135+0000 7f39ad2d0740 1 -- 172.21.15.92:0/1115398933 wait complete. 2024-09-19T09:09:16.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.135+0000 7f39ad2d0740 20 client.18324 trim_cache size 0 max 16384 2024-09-19T09:09:16.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.152+0000 7f39ad2d0740 1 Processor -- start 2024-09-19T09:09:16.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.152+0000 7f39ad2d0740 1 -- start start 2024-09-19T09:09:16.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.152+0000 7f39ad2d0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f32161f060 0x55f321641950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:16.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.152+0000 7f39ad2d0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f32161f980 0x55f321641e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:16.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.152+0000 7f39ad2d0740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f32162a240 0x55f321624340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:16.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.152+0000 7f39ad2d0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f39a41ad990 con 0x55f32161f060 2024-09-19T09:09:16.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.152+0000 7f39ad2d0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f39a41b0230 con 0x55f32161f980 2024-09-19T09:09:16.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.152+0000 7f39ad2d0740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f39a41ae020 con 0x55f32162a240 2024-09-19T09:09:16.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.152+0000 7f39a8c93640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f32161f060 0x55f321641950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:16.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.152+0000 7f39a8c93640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f32161f060 0x55f321641950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51006/0 (socket says 172.21.15.92:51006) 2024-09-19T09:09:16.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.152+0000 7f39a8c93640 1 -- 172.21.15.92:0/4188211172 learned_addr learned my addr 172.21.15.92:0/4188211172 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:16.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.152+0000 7f39a3fff640 1 --2- 172.21.15.92:0/4188211172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f32161f980 0x55f321641e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:16.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.152+0000 7f39a8c93640 1 -- 172.21.15.92:0/4188211172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f32162a240 msgr2=0x55f321624340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:16.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.152+0000 7f39a9494640 1 --2- 172.21.15.92:0/4188211172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f32162a240 0x55f321624340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:16.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.152+0000 7f39a8c93640 1 --2- 172.21.15.92:0/4188211172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f32162a240 0x55f321624340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:16.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.152+0000 7f39a8c93640 1 -- 172.21.15.92:0/4188211172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f32161f980 msgr2=0x55f321641e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:16.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.152+0000 7f39a8c93640 1 --2- 172.21.15.92:0/4188211172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f32161f980 0x55f321641e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:16.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.153+0000 7f39a8c93640 1 -- 172.21.15.92:0/4188211172 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f32161b420 con 0x55f32161f060 2024-09-19T09:09:16.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.153+0000 7f39a3fff640 1 --2- 172.21.15.92:0/4188211172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f32161f980 0x55f321641e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:09:16.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.153+0000 7f39a8c93640 1 --2- 172.21.15.92:0/4188211172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f32161f060 0x55f321641950 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f3994009fa0 tx=0x7f3994009930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d58d8a2928b7ee1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:16.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.153+0000 7f399a7fc640 1 -- 172.21.15.92:0/4188211172 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3994026070 con 0x55f32161f060 2024-09-19T09:09:16.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.153+0000 7f399a7fc640 1 -- 172.21.15.92:0/4188211172 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3994018b80 con 0x55f32161f060 2024-09-19T09:09:16.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.153+0000 7f399a7fc640 1 -- 172.21.15.92:0/4188211172 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3994019660 con 0x55f32161f060 2024-09-19T09:09:16.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.154+0000 7f39ad2d0740 1 -- 172.21.15.92:0/4188211172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f32161f060 msgr2=0x55f321641950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:16.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.154+0000 7f39ad2d0740 1 --2- 172.21.15.92:0/4188211172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f32161f060 0x55f321641950 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f3994009fa0 tx=0x7f3994009930 comp rx=0 tx=0).stop 2024-09-19T09:09:16.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.154+0000 7f39ad2d0740 1 -- 172.21.15.92:0/4188211172 shutdown_connections 2024-09-19T09:09:16.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.154+0000 7f39ad2d0740 1 --2- 172.21.15.92:0/4188211172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f32162a240 0x55f321624340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:16.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.154+0000 7f39ad2d0740 1 --2- 172.21.15.92:0/4188211172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f32161f980 0x55f321641e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:16.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.154+0000 7f39ad2d0740 1 --2- 172.21.15.92:0/4188211172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f32161f060 0x55f321641950 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:16.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.154+0000 7f39ad2d0740 1 -- 172.21.15.92:0/4188211172 >> 172.21.15.92:0/4188211172 conn(0x55f32161b5f0 msgr2=0x55f3216259b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:16.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.154+0000 7f39ad2d0740 1 -- 172.21.15.92:0/4188211172 shutdown_connections 2024-09-19T09:09:16.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.154+0000 7f39ad2d0740 1 -- 172.21.15.92:0/4188211172 wait complete. 2024-09-19T09:09:16.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.154+0000 7f39ad2d0740 1 -- start start 2024-09-19T09:09:16.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.154+0000 7f39ad2d0740 1 Processor -- start 2024-09-19T09:09:16.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.154+0000 7f39ad2d0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f32161f060 0x55f321632530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:16.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.154+0000 7f39ad2d0740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f32161f980 0x55f321632a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:16.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.154+0000 7f39ad2d0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f32162a240 0x55f32162e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:16.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.154+0000 7f39ad2d0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f39a41ae6f0 con 0x55f32161f060 2024-09-19T09:09:16.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.154+0000 7f39ad2d0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f39a41afb60 con 0x55f32162a240 2024-09-19T09:09:16.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.154+0000 7f39ad2d0740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f39a41aedc0 con 0x55f32161f980 2024-09-19T09:09:16.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.155+0000 7f39ad2d0740 10 client.0 _ll_register_callbacks cb 0x7f398c031490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:09:16.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.155+0000 7f39a8c93640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f32161f060 0x55f321632530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:16.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.155+0000 7f39a8c93640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f32161f060 0x55f321632530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51018/0 (socket says 172.21.15.92:51018) 2024-09-19T09:09:16.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.155+0000 7f39a8c93640 1 -- 172.21.15.92:0/1660180439 learned_addr learned my addr 172.21.15.92:0/1660180439 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:16.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.155+0000 7f39a9494640 1 --2- 172.21.15.92:0/1660180439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f32162a240 0x55f32162e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:16.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.155+0000 7f39a3fff640 1 --2- 172.21.15.92:0/1660180439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f32161f980 0x55f321632a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:16.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.155+0000 7f39a8c93640 1 -- 172.21.15.92:0/1660180439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f32161f980 msgr2=0x55f321632a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:16.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.155+0000 7f39a8c93640 1 --2- 172.21.15.92:0/1660180439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f32161f980 0x55f321632a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:16.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.155+0000 7f39a8c93640 1 -- 172.21.15.92:0/1660180439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f32162a240 msgr2=0x55f32162e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:16.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.155+0000 7f39a8c93640 1 --2- 172.21.15.92:0/1660180439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f32162a240 0x55f32162e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:16.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.155+0000 7f39a8c93640 1 -- 172.21.15.92:0/1660180439 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f32161c280 con 0x55f32161f060 2024-09-19T09:09:16.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.155+0000 7f39a9494640 1 --2- 172.21.15.92:0/1660180439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f32162a240 0x55f32162e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:09:16.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.155+0000 7f39a8c93640 1 --2- 172.21.15.92:0/1660180439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f32161f060 0x55f321632530 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f3994004a80 tx=0x7f3994009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db50d5a1c2c4052 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:16.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.155+0000 7f3983fff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:09:16.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.155+0000 7f3983fff640 1 -- 172.21.15.92:0/1660180439 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f399402f060 con 0x55f32161f060 2024-09-19T09:09:16.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.155+0000 7f3983fff640 1 -- 172.21.15.92:0/1660180439 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3994021610 con 0x55f32161f060 2024-09-19T09:09:16.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.155+0000 7f39ad2d0740 1 -- 172.21.15.92:0/1660180439 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3994018b80 con 0x55f32161f060 2024-09-19T09:09:16.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.155+0000 7f3983fff640 1 -- 172.21.15.92:0/1660180439 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3994026050 con 0x55f32161f060 2024-09-19T09:09:16.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.155+0000 7f39ad2d0740 10 client.18330 fetch_fsmap learned FSMap version 19 2024-09-19T09:09:16.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.155+0000 7f39ad2d0740 1 -- 172.21.15.92:0/1660180439 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f3216a5390 con 0x55f32161f060 2024-09-19T09:09:16.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.156+0000 7f3983fff640 1 -- 172.21.15.92:0/1660180439 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3994018b80 con 0x55f32161f060 2024-09-19T09:09:16.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.156+0000 7f3983fff640 1 -- 172.21.15.92:0/1660180439 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f3994034070 con 0x55f32161f060 2024-09-19T09:09:16.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.156+0000 7f39ad2d0740 10 client.18330 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:09:16.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.156+0000 7f39ad2d0740 10 client.18330 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:09:16.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.156+0000 7f39ad2d0740 20 client.18330 populate_metadata read hostname 'smithi092' 2024-09-19T09:09:16.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.156+0000 7f39ad2d0740 1 --2- 172.21.15.92:0/1660180439 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f3216a59a0 0x55f3216a7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:16.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.156+0000 7f39ad2d0740 4 client.18330 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "4853c4a2", "release": true, "await": true}] 2024-09-19T09:09:16.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.156+0000 7f39ad2d0740 1 -- 172.21.15.92:0/1660180439 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "quiesce db", "set_id": "4853c4a2", "release": true, "await": true}) -- 0x55f32158c0a0 con 0x55f3216a59a0 2024-09-19T09:09:16.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.156+0000 7f39a3fff640 1 --2- 172.21.15.92:0/1660180439 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f3216a59a0 0x55f3216a7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:16.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.156+0000 7f3983fff640 10 client.18330 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:16.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.156+0000 7f39a3fff640 1 --2- 172.21.15.92:0/1660180439 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f3216a59a0 0x55f3216a7dc0 crc :-1 s=READY pgs=379 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7465ac04ac6bc670 server_cookie=fd14b75441d111a9 in_seq=0 out_seq=0 2024-09-19T09:09:16.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.208+0000 7f3983fff640 1 -- 172.21.15.92:0/1660180439 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55f32158c0a0 con 0x55f3216a59a0 2024-09-19T09:09:16.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.208+0000 7f3983fff640 10 client.18330 handle_command_reply: tid=0 2024-09-19T09:09:16.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.208+0000 7f39ad2d0740 1 client.18330 shutdown 2024-09-19T09:09:16.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.208+0000 7f39ad2d0740 1 -- 172.21.15.92:0/1660180439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f32161f060 msgr2=0x55f321632530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:16.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.208+0000 7f39ad2d0740 1 --2- 172.21.15.92:0/1660180439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f32161f060 0x55f321632530 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f3994004a80 tx=0x7f3994009e30 comp rx=0 tx=0).stop 2024-09-19T09:09:16.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.208+0000 7f39ad2d0740 1 -- 172.21.15.92:0/1660180439 shutdown_connections 2024-09-19T09:09:16.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.208+0000 7f39ad2d0740 1 --2- 172.21.15.92:0/1660180439 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f3216a59a0 0x55f3216a7dc0 crc :-1 s=READY pgs=379 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:16.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.208+0000 7f39ad2d0740 1 --2- 172.21.15.92:0/1660180439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f32162a240 0x55f32162e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:16.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.208+0000 7f3983fff640 0 client.18330 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:16.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.208+0000 7f39ad2d0740 1 --2- 172.21.15.92:0/1660180439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f32161f980 0x55f321632a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:16.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.208+0000 7f39ad2d0740 1 --2- 172.21.15.92:0/1660180439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f32161f060 0x55f321632530 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:16.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.208+0000 7f39ad2d0740 1 -- 172.21.15.92:0/1660180439 >> 172.21.15.92:0/1660180439 conn(0x55f32161b5f0 msgr2=0x55f321619f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:16.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.209+0000 7f39ad2d0740 1 -- 172.21.15.92:0/1660180439 shutdown_connections 2024-09-19T09:09:16.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.209+0000 7f39ad2d0740 1 -- 172.21.15.92:0/1660180439 wait complete. 2024-09-19T09:09:16.211 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:09:16.211 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 19, 2024-09-19T09:09:16.211 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24472, 2024-09-19T09:09:16.211 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 44, 2024-09-19T09:09:16.211 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-09-19T09:09:16.211 INFO:teuthology.orchestra.run.smithi092.stdout: "4853c4a2": { 2024-09-19T09:09:16.211 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 44, 2024-09-19T09:09:16.211 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-09-19T09:09:16.211 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:09:16.211 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-09-19T09:09:16.211 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:09:16.211 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:09:16.212 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 90.0, 2024-09-19T09:09:16.212 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 142.2, 2024-09-19T09:09:16.212 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-09-19T09:09:16.212 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-09-19T09:09:16.212 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-09-19T09:09:16.212 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:09:16.212 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-09-19T09:09:16.212 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:09:16.212 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:09:16.212 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:09:16.212 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:09:16.212 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:09:16.212 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:09:16.213 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:09:16.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.209+0000 7f39ad2d0740 20 client.18330 trim_cache size 0 max 16384 2024-09-19T09:09:16.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.210+0000 7f39aaef7640 1 -- 172.21.15.92:0/2074873508 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f39900a32c0 msgr2=0x7f39900a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:16.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.210+0000 7f39aaef7640 1 --2- 172.21.15.92:0/2074873508 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f39900a32c0 0x7f39900a5780 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f39a419b710 tx=0x7f398c0315b0 comp rx=0 tx=0).stop 2024-09-19T09:09:16.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.210+0000 7f39aaef7640 1 -- 172.21.15.92:0/2074873508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39a4106f00 msgr2=0x7f39a419a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:16.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.210+0000 7f39aaef7640 1 --2- 172.21.15.92:0/2074873508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39a4106f00 0x7f39a419a5d0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f399c009fd0 tx=0x7f399c00b8e0 comp rx=0 tx=0).stop 2024-09-19T09:09:16.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.210+0000 7f39aaef7640 1 -- 172.21.15.92:0/2074873508 shutdown_connections 2024-09-19T09:09:16.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.210+0000 7f39aaef7640 1 --2- 172.21.15.92:0/2074873508 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f39900a32c0 0x7f39900a5780 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:16.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.210+0000 7f39aaef7640 1 --2- 172.21.15.92:0/2074873508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39a4106f00 0x7f39a419a5d0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:16.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.210+0000 7f39aaef7640 1 --2- 172.21.15.92:0/2074873508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39a4102780 0x7f39a41a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:16.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.210+0000 7f39aaef7640 1 --2- 172.21.15.92:0/2074873508 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39a4101dd0 0x7f39a41a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:16.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.210+0000 7f39aaef7640 1 -- 172.21.15.92:0/2074873508 >> 172.21.15.92:0/2074873508 conn(0x7f39a40fd8b0 msgr2=0x7f39a40fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:16.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.211+0000 7f39aaef7640 1 -- 172.21.15.92:0/2074873508 shutdown_connections 2024-09-19T09:09:16.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:16.211+0000 7f39aaef7640 1 -- 172.21.15.92:0/2074873508 wait complete. 2024-09-19T09:09:17.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:16 smithi092 ceph-mon[31407]: pgmap v714: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.8 MiB/s wr, 107 op/s 2024-09-19T09:09:17.088 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '4853c4a2', total seconds elapsed: 25.5 2024-09-19T09:09:17.088 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.2 2024-09-19T09:09:17.088 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:09:17.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.099+0000 7fe8a1f8d640 1 -- 172.21.15.92:0/4171529967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe89c101b60 msgr2=0x7fe89c101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:17.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.099+0000 7fe8a1f8d640 1 --2- 172.21.15.92:0/4171529967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe89c101b60 0x7fe89c101f60 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fe890009900 tx=0x7fe89002a410 comp rx=0 tx=0).stop 2024-09-19T09:09:17.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.099+0000 7fe8a1f8d640 1 -- 172.21.15.92:0/4171529967 shutdown_connections 2024-09-19T09:09:17.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.099+0000 7fe8a1f8d640 1 --2- 172.21.15.92:0/4171529967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe89c103710 0x7fe89c109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:17.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.099+0000 7fe8a1f8d640 1 --2- 172.21.15.92:0/4171529967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe89c102d50 0x7fe89c1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:17.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.100+0000 7fe8a1f8d640 1 --2- 172.21.15.92:0/4171529967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe89c101b60 0x7fe89c101f60 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:17.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.100+0000 7fe8a1f8d640 1 -- 172.21.15.92:0/4171529967 >> 172.21.15.92:0/4171529967 conn(0x7fe89c0fd2c0 msgr2=0x7fe89c0ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:17.104 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:16 smithi167 ceph-mon[35359]: pgmap v714: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.8 MiB/s wr, 107 op/s 2024-09-19T09:09:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.101+0000 7fe8a1f8d640 1 -- 172.21.15.92:0/4171529967 shutdown_connections 2024-09-19T09:09:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.101+0000 7fe8a1f8d640 1 -- 172.21.15.92:0/4171529967 wait complete. 2024-09-19T09:09:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.102+0000 7fe8a1f8d640 1 Processor -- start 2024-09-19T09:09:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.102+0000 7fe8a1f8d640 1 -- start start 2024-09-19T09:09:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.103+0000 7fe8a1f8d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe89c101b60 0x7fe89c070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.103+0000 7fe8a1f8d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe89c102d50 0x7fe89c0710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.103+0000 7fe8a1f8d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe89c103710 0x7fe89c1a7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.103+0000 7fe8a1f8d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe89c10d890 con 0x7fe89c103710 2024-09-19T09:09:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.103+0000 7fe8a1f8d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe89c10d710 con 0x7fe89c101b60 2024-09-19T09:09:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.103+0000 7fe8a1f8d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe89c10da10 con 0x7fe89c102d50 2024-09-19T09:09:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.103+0000 7fe89b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe89c101b60 0x7fe89c070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.103+0000 7fe89b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe89c101b60 0x7fe89c070ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:53032/0 (socket says 172.21.15.92:53032) 2024-09-19T09:09:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.103+0000 7fe89b7fe640 1 -- 172.21.15.92:0/3374334131 learned_addr learned my addr 172.21.15.92:0/3374334131 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.103+0000 7fe89bfff640 1 --2- 172.21.15.92:0/3374334131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe89c103710 0x7fe89c1a7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.103+0000 7fe89affd640 1 --2- 172.21.15.92:0/3374334131 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe89c102d50 0x7fe89c0710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.103+0000 7fe89b7fe640 1 -- 172.21.15.92:0/3374334131 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe89c102d50 msgr2=0x7fe89c0710e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.103+0000 7fe89b7fe640 1 --2- 172.21.15.92:0/3374334131 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe89c102d50 0x7fe89c0710e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.103+0000 7fe89b7fe640 1 -- 172.21.15.92:0/3374334131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe89c103710 msgr2=0x7fe89c1a7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.103+0000 7fe89b7fe640 1 --2- 172.21.15.92:0/3374334131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe89c103710 0x7fe89c1a7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.103+0000 7fe89b7fe640 1 -- 172.21.15.92:0/3374334131 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe89c1a84e0 con 0x7fe89c101b60 2024-09-19T09:09:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.104+0000 7fe89bfff640 1 --2- 172.21.15.92:0/3374334131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe89c103710 0x7fe89c1a7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:09:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.104+0000 7fe89b7fe640 1 --2- 172.21.15.92:0/3374334131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe89c101b60 0x7fe89c070ba0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe890031610 tx=0x7fe890032c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.104+0000 7fe898ff9640 1 -- 172.21.15.92:0/3374334131 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89003f030 con 0x7fe89c101b60 2024-09-19T09:09:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.104+0000 7fe8a1f8d640 1 -- 172.21.15.92:0/3374334131 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe89c1a86b0 con 0x7fe89c101b60 2024-09-19T09:09:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.104+0000 7fe898ff9640 1 -- 172.21.15.92:0/3374334131 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe890032e50 con 0x7fe89c101b60 2024-09-19T09:09:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.104+0000 7fe898ff9640 1 -- 172.21.15.92:0/3374334131 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe890035070 con 0x7fe89c101b60 2024-09-19T09:09:17.109 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.104+0000 7fe8a1f8d640 1 -- 172.21.15.92:0/3374334131 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe89c1a8bf0 con 0x7fe89c101b60 2024-09-19T09:09:17.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.107+0000 7fe8a4e01740 1 Processor -- start 2024-09-19T09:09:17.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.108+0000 7fe8a4e01740 1 -- start start 2024-09-19T09:09:17.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.108+0000 7fe898ff9640 1 -- 172.21.15.92:0/3374334131 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe890042030 con 0x7fe89c101b60 2024-09-19T09:09:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.108+0000 7fe8a4e01740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e74598e9a0 0x55e74598eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.108+0000 7fe8a4e01740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e74598f2e0 0x55e74599e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.108+0000 7fe8a4e01740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e74599ebc0 0x55e7459a1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.108+0000 7fe8a4e01740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e7458f42f0 con 0x55e74599ebc0 2024-09-19T09:09:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.108+0000 7fe8a4e01740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e74589c270 con 0x55e74598e9a0 2024-09-19T09:09:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.108+0000 7fe8a4e01740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e7458f02b0 con 0x55e74598f2e0 2024-09-19T09:09:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.108+0000 7fe89affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e74599ebc0 0x55e7459a1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.108+0000 7fe89affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e74599ebc0 0x55e7459a1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51054/0 (socket says 172.21.15.92:51054) 2024-09-19T09:09:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.108+0000 7fe89affd640 1 -- 172.21.15.92:0/1071814500 learned_addr learned my addr 172.21.15.92:0/1071814500 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.109+0000 7fe89b7fe640 1 --2- 172.21.15.92:0/1071814500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e74598f2e0 0x55e74599e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:17.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.109+0000 7fe89affd640 1 -- 172.21.15.92:0/1071814500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e74598f2e0 msgr2=0x55e74599e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:17.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.109+0000 7fe89affd640 1 --2- 172.21.15.92:0/1071814500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e74598f2e0 0x55e74599e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:17.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.109+0000 7fe89affd640 1 -- 172.21.15.92:0/1071814500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e74598e9a0 msgr2=0x55e74598eda0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:09:17.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.109+0000 7fe89affd640 1 --2- 172.21.15.92:0/1071814500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e74598e9a0 0x55e74598eda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:17.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.109+0000 7fe89affd640 1 -- 172.21.15.92:0/1071814500 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e74589b340 con 0x55e74599ebc0 2024-09-19T09:09:17.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.109+0000 7fe89b7fe640 1 --2- 172.21.15.92:0/1071814500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e74598f2e0 0x55e74599e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:09:17.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.109+0000 7fe898ff9640 1 --2- 172.21.15.92:0/3374334131 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe8840a33f0 0x7fe8840a58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:17.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.109+0000 7fe89affd640 1 --2- 172.21.15.92:0/1071814500 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e74599ebc0 0x55e7459a1030 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fe894003a20 tx=0x7fe894009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f5fa7d5a4b0311 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:17.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.109+0000 7fe898ff9640 1 -- 172.21.15.92:0/3374334131 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe8900f0200 con 0x7fe89c101b60 2024-09-19T09:09:17.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.109+0000 7fe89bfff640 1 --2- 172.21.15.92:0/3374334131 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe8840a33f0 0x7fe8840a58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:17.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.109+0000 7fe881ffb640 1 -- 172.21.15.92:0/1071814500 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe894004b20 con 0x55e74599ebc0 2024-09-19T09:09:17.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.110+0000 7fe881ffb640 1 -- 172.21.15.92:0/1071814500 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe894004cc0 con 0x55e74599ebc0 2024-09-19T09:09:17.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.110+0000 7fe89bfff640 1 --2- 172.21.15.92:0/3374334131 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe8840a33f0 0x7fe8840a58b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe88c00b850 tx=0x7fe88c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:17.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.110+0000 7fe881ffb640 1 -- 172.21.15.92:0/1071814500 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe894012850 con 0x55e74599ebc0 2024-09-19T09:09:17.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.110+0000 7fe8a4e01740 1 -- 172.21.15.92:0/1071814500 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e74599ebc0 msgr2=0x55e7459a1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:17.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.110+0000 7fe8a4e01740 1 --2- 172.21.15.92:0/1071814500 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e74599ebc0 0x55e7459a1030 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fe894003a20 tx=0x7fe894009f90 comp rx=0 tx=0).stop 2024-09-19T09:09:17.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.110+0000 7fe8a4e01740 1 -- 172.21.15.92:0/1071814500 shutdown_connections 2024-09-19T09:09:17.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.110+0000 7fe8a4e01740 1 --2- 172.21.15.92:0/1071814500 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e74599ebc0 0x55e7459a1030 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:17.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.110+0000 7fe8a4e01740 1 --2- 172.21.15.92:0/1071814500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e74598f2e0 0x55e74599e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:17.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.110+0000 7fe8a4e01740 1 --2- 172.21.15.92:0/1071814500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e74598e9a0 0x55e74598eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:17.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.110+0000 7fe8a4e01740 1 -- 172.21.15.92:0/1071814500 >> 172.21.15.92:0/1071814500 conn(0x55e74598bf90 msgr2=0x55e74598c370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:17.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.111+0000 7fe8a4e01740 1 -- 172.21.15.92:0/1071814500 shutdown_connections 2024-09-19T09:09:17.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.111+0000 7fe8a4e01740 1 -- 172.21.15.92:0/1071814500 wait complete. 2024-09-19T09:09:17.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.111+0000 7fe8a4e01740 1 -- start start 2024-09-19T09:09:17.118 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.111+0000 7fe8a4e01740 1 Processor -- start 2024-09-19T09:09:17.118 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.112+0000 7fe8a4e01740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e74598e9a0 0x55e7459a3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:17.118 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.112+0000 7fe8a4e01740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e74598f2e0 0x55e7459a3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:17.118 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.112+0000 7fe8a4e01740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e74599ebc0 0x55e7459aa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:17.118 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.112+0000 7fe8a4e01740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e7459a1b90 con 0x55e74598e9a0 2024-09-19T09:09:17.118 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.112+0000 7fe89b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e74598e9a0 0x55e7459a3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:17.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.112+0000 7fe89b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e74598e9a0 0x55e7459a3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51058/0 (socket says 172.21.15.92:51058) 2024-09-19T09:09:17.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.112+0000 7fe89b7fe640 1 -- 172.21.15.92:0/2827315098 learned_addr learned my addr 172.21.15.92:0/2827315098 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:17.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.112+0000 7fe8a4e01740 1 -- 172.21.15.92:0/2827315098 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e74587d290 con 0x55e74598f2e0 2024-09-19T09:09:17.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.112+0000 7fe8a4e01740 1 -- 172.21.15.92:0/2827315098 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e7459a1d10 con 0x55e74599ebc0 2024-09-19T09:09:17.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.112+0000 7fe8a4e01740 10 client.0 _ll_register_callbacks cb 0x55e7458ae140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:09:17.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.112+0000 7fe89bfff640 1 --2- 172.21.15.92:0/2827315098 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e74599ebc0 0x55e7459aa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:17.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.113+0000 7fe89b7fe640 1 -- 172.21.15.92:0/2827315098 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e74599ebc0 msgr2=0x55e7459aa9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:17.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.113+0000 7fe89b7fe640 1 --2- 172.21.15.92:0/2827315098 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e74599ebc0 0x55e7459aa9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:17.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.113+0000 7fe89b7fe640 1 -- 172.21.15.92:0/2827315098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e74598f2e0 msgr2=0x55e7459a3960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:09:17.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.113+0000 7fe89b7fe640 1 --2- 172.21.15.92:0/2827315098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e74598f2e0 0x55e7459a3960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:17.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.113+0000 7fe89b7fe640 1 -- 172.21.15.92:0/2827315098 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e745607210 con 0x55e74598e9a0 2024-09-19T09:09:17.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.113+0000 7fe89b7fe640 1 --2- 172.21.15.92:0/2827315098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e74598e9a0 0x55e7459a3420 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fe8900b91b0 tx=0x7fe8900bc3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dab67810983f27e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:17.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.114+0000 7fe87affd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:09:17.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.114+0000 7fe87affd640 1 -- 172.21.15.92:0/2827315098 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe890049050 con 0x55e74598e9a0 2024-09-19T09:09:17.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.115+0000 7fe8a4e01740 1 -- 172.21.15.92:0/2827315098 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe894004cc0 con 0x55e74598e9a0 2024-09-19T09:09:17.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.115+0000 7fe87affd640 1 -- 172.21.15.92:0/2827315098 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe8900b8e50 con 0x55e74598e9a0 2024-09-19T09:09:17.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.115+0000 7fe87affd640 1 -- 172.21.15.92:0/2827315098 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe8900c0b90 con 0x55e74598e9a0 2024-09-19T09:09:17.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.115+0000 7fe8a4e01740 10 client.18342 fetch_fsmap learned FSMap version 19 2024-09-19T09:09:17.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.115+0000 7fe8a4e01740 1 -- 172.21.15.92:0/2827315098 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e7456d3620 con 0x55e74598e9a0 2024-09-19T09:09:17.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.116+0000 7fe87affd640 1 -- 172.21.15.92:0/2827315098 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8900ef070 con 0x55e74598e9a0 2024-09-19T09:09:17.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.117+0000 7fe87affd640 1 -- 172.21.15.92:0/2827315098 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe8900bca40 con 0x55e74598e9a0 2024-09-19T09:09:17.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.117+0000 7fe8a4e01740 10 client.18342 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:09:17.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.117+0000 7fe8a4e01740 10 client.18342 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:09:17.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.117+0000 7fe8a4e01740 20 client.18342 populate_metadata read hostname 'smithi092' 2024-09-19T09:09:17.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.117+0000 7fe8a4e01740 1 --2- 172.21.15.92:0/2827315098 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e7459af200 0x55e7459b1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:17.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.117+0000 7fe8a4e01740 4 client.18342 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:09:17.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.117+0000 7fe8a4e01740 1 -- 172.21.15.92:0/2827315098 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fe894004cc0 con 0x55e7459af200 2024-09-19T09:09:17.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.117+0000 7fe89affd640 1 --2- 172.21.15.92:0/2827315098 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e7459af200 0x55e7459b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:17.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.118+0000 7fe89affd640 1 --2- 172.21.15.92:0/2827315098 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e7459af200 0x55e7459b1650 crc :-1 s=READY pgs=380 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b81261551d216b92 server_cookie=3c6e408462e33516 in_seq=0 out_seq=0 2024-09-19T09:09:17.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.118+0000 7fe87affd640 10 client.18342 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.118+0000 7fe87affd640 1 -- 172.21.15.92:0/2827315098 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fe894004cc0 con 0x55e7459af200 2024-09-19T09:09:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.118+0000 7fe87affd640 10 client.18342 handle_command_reply: tid=0 2024-09-19T09:09:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.118+0000 7fe8a4e01740 1 client.18342 shutdown 2024-09-19T09:09:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.119+0000 7fe8a4e01740 1 -- 172.21.15.92:0/2827315098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e74598e9a0 msgr2=0x55e7459a3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.119+0000 7fe8a4e01740 1 --2- 172.21.15.92:0/2827315098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e74598e9a0 0x55e7459a3420 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fe8900b91b0 tx=0x7fe8900bc3a0 comp rx=0 tx=0).stop 2024-09-19T09:09:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.119+0000 7fe8a4e01740 1 -- 172.21.15.92:0/2827315098 shutdown_connections 2024-09-19T09:09:17.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.119+0000 7fe8a4e01740 1 --2- 172.21.15.92:0/2827315098 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e7459af200 0x55e7459b1650 crc :-1 s=READY pgs=380 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:17.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.119+0000 7fe8a4e01740 1 --2- 172.21.15.92:0/2827315098 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e74599ebc0 0x55e7459aa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:17.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.119+0000 7fe8a4e01740 1 --2- 172.21.15.92:0/2827315098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e74598f2e0 0x55e7459a3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:17.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.119+0000 7fe8a4e01740 1 --2- 172.21.15.92:0/2827315098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e74598e9a0 0x55e7459a3420 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:17.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.119+0000 7fe8a4e01740 1 -- 172.21.15.92:0/2827315098 >> 172.21.15.92:0/2827315098 conn(0x55e74598bf90 msgr2=0x55e74598d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:17.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.119+0000 7fe87affd640 0 client.18342 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:17.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.119+0000 7fe8a4e01740 1 -- 172.21.15.92:0/2827315098 shutdown_connections 2024-09-19T09:09:17.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.119+0000 7fe8a4e01740 1 -- 172.21.15.92:0/2827315098 wait complete. 2024-09-19T09:09:17.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.119+0000 7fe8a4e01740 20 client.18342 trim_cache size 0 max 16384 2024-09-19T09:09:17.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:16 smithi190 ceph-mon[35358]: pgmap v714: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.8 MiB/s wr, 107 op/s 2024-09-19T09:09:17.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.143+0000 7fe8a4e01740 1 Processor -- start 2024-09-19T09:09:17.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.143+0000 7fe8a4e01740 1 -- start start 2024-09-19T09:09:17.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.143+0000 7fe8a4e01740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e74598e9a0 0x55e74599ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:17.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.143+0000 7fe8a4e01740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e74598f2e0 0x55e7459aa960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:17.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.143+0000 7fe8a4e01740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e74599ebc0 0x55e74599b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:17.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.143+0000 7fe8a4e01740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe89c1ad7c0 con 0x55e74598f2e0 2024-09-19T09:09:17.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.143+0000 7fe8a4e01740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe89c1b0060 con 0x55e74599ebc0 2024-09-19T09:09:17.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.143+0000 7fe8a4e01740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe89c1ade50 con 0x55e74598e9a0 2024-09-19T09:09:17.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.143+0000 7fe89affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e74598f2e0 0x55e7459aa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:17.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.143+0000 7fe89affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e74598f2e0 0x55e7459aa960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51070/0 (socket says 172.21.15.92:51070) 2024-09-19T09:09:17.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.144+0000 7fe89affd640 1 -- 172.21.15.92:0/2752933795 learned_addr learned my addr 172.21.15.92:0/2752933795 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:17.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.144+0000 7fe89b7fe640 1 --2- 172.21.15.92:0/2752933795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e74598e9a0 0x55e74599ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:17.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.144+0000 7fe89bfff640 1 --2- 172.21.15.92:0/2752933795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e74599ebc0 0x55e74599b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:17.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.144+0000 7fe89b7fe640 1 -- 172.21.15.92:0/2752933795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e74599ebc0 msgr2=0x55e74599b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:17.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.144+0000 7fe89b7fe640 1 --2- 172.21.15.92:0/2752933795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e74599ebc0 0x55e74599b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:17.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.144+0000 7fe89b7fe640 1 -- 172.21.15.92:0/2752933795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e74598f2e0 msgr2=0x55e7459aa960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:17.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.144+0000 7fe89b7fe640 1 --2- 172.21.15.92:0/2752933795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e74598f2e0 0x55e7459aa960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:17.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.144+0000 7fe89b7fe640 1 -- 172.21.15.92:0/2752933795 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7459a2f60 con 0x55e74598e9a0 2024-09-19T09:09:17.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.144+0000 7fe89affd640 1 --2- 172.21.15.92:0/2752933795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e74598f2e0 0x55e7459aa960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:09:17.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.144+0000 7fe89b7fe640 1 --2- 172.21.15.92:0/2752933795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e74598e9a0 0x55e74599ad60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe890006010 tx=0x7fe890009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e49dcb02d482b2dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:17.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.144+0000 7fe8817fa640 1 -- 172.21.15.92:0/2752933795 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe890049070 con 0x55e74598e9a0 2024-09-19T09:09:17.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.144+0000 7fe8817fa640 1 -- 172.21.15.92:0/2752933795 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8900ef030 con 0x55e74598e9a0 2024-09-19T09:09:17.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.144+0000 7fe8817fa640 1 -- 172.21.15.92:0/2752933795 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8900c4fc0 con 0x55e74598e9a0 2024-09-19T09:09:17.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.145+0000 7fe8a4e01740 1 -- 172.21.15.92:0/2752933795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e74598e9a0 msgr2=0x55e74599ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:17.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.146+0000 7fe8a4e01740 1 --2- 172.21.15.92:0/2752933795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e74598e9a0 0x55e74599ad60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe890006010 tx=0x7fe890009260 comp rx=0 tx=0).stop 2024-09-19T09:09:17.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.146+0000 7fe8a4e01740 1 -- 172.21.15.92:0/2752933795 shutdown_connections 2024-09-19T09:09:17.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.146+0000 7fe8a4e01740 1 --2- 172.21.15.92:0/2752933795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e74599ebc0 0x55e74599b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:17.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.146+0000 7fe8a4e01740 1 --2- 172.21.15.92:0/2752933795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e74598f2e0 0x55e7459aa960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:17.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.146+0000 7fe8a4e01740 1 --2- 172.21.15.92:0/2752933795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e74598e9a0 0x55e74599ad60 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:17.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.146+0000 7fe8a4e01740 1 -- 172.21.15.92:0/2752933795 >> 172.21.15.92:0/2752933795 conn(0x55e74598bf90 msgr2=0x55e7459b1210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:17.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.146+0000 7fe8a4e01740 1 -- 172.21.15.92:0/2752933795 shutdown_connections 2024-09-19T09:09:17.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.146+0000 7fe8a4e01740 1 -- 172.21.15.92:0/2752933795 wait complete. 2024-09-19T09:09:17.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.146+0000 7fe8a4e01740 1 -- start start 2024-09-19T09:09:17.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.147+0000 7fe8a4e01740 1 Processor -- start 2024-09-19T09:09:17.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.147+0000 7fe8a4e01740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e74598e9a0 0x55e7459a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:17.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.147+0000 7fe8a4e01740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e74598f2e0 0x55e7459a5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:17.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.147+0000 7fe8a4e01740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e74599ebc0 0x55e745a17f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:17.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.147+0000 7fe8a4e01740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe89c1ae520 con 0x55e74598e9a0 2024-09-19T09:09:17.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.147+0000 7fe8a4e01740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe89c1af990 con 0x55e74599ebc0 2024-09-19T09:09:17.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.147+0000 7fe8a4e01740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe89c1aebf0 con 0x55e74598f2e0 2024-09-19T09:09:17.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.147+0000 7fe8a4e01740 10 client.0 _ll_register_callbacks cb 0x7fe8900bc5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:09:17.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.147+0000 7fe89b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e74598e9a0 0x55e7459a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:17.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.147+0000 7fe89b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e74598e9a0 0x55e7459a58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51084/0 (socket says 172.21.15.92:51084) 2024-09-19T09:09:17.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.147+0000 7fe89b7fe640 1 -- 172.21.15.92:0/1757695450 learned_addr learned my addr 172.21.15.92:0/1757695450 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:17.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.147+0000 7fe89affd640 1 --2- 172.21.15.92:0/1757695450 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e74598f2e0 0x55e7459a5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:17.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.147+0000 7fe89bfff640 1 --2- 172.21.15.92:0/1757695450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e74599ebc0 0x55e745a17f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:17.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.147+0000 7fe89affd640 1 -- 172.21.15.92:0/1757695450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e74599ebc0 msgr2=0x55e745a17f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:17.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.147+0000 7fe89affd640 1 --2- 172.21.15.92:0/1757695450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e74599ebc0 0x55e745a17f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:17.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.147+0000 7fe89affd640 1 -- 172.21.15.92:0/1757695450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e74598e9a0 msgr2=0x55e7459a58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:17.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.147+0000 7fe89affd640 1 --2- 172.21.15.92:0/1757695450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e74598e9a0 0x55e7459a58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:17.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.147+0000 7fe89affd640 1 -- 172.21.15.92:0/1757695450 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e745a184e0 con 0x55e74598f2e0 2024-09-19T09:09:17.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.148+0000 7fe89affd640 1 --2- 172.21.15.92:0/1757695450 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e74598f2e0 0x55e7459a5e10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x55e74598e6b0 tx=0x7fe894005cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61f42cb2c375efd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:17.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.148+0000 7fe87affd640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:09:17.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.148+0000 7fe87affd640 1 -- 172.21.15.92:0/1757695450 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89402e060 con 0x55e74598f2e0 2024-09-19T09:09:17.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.148+0000 7fe87affd640 1 -- 172.21.15.92:0/1757695450 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe894027640 con 0x55e74598f2e0 2024-09-19T09:09:17.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.148+0000 7fe8a4e01740 1 -- 172.21.15.92:0/1757695450 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8900ef030 con 0x55e74598f2e0 2024-09-19T09:09:17.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.148+0000 7fe87affd640 1 -- 172.21.15.92:0/1757695450 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe894027860 con 0x55e74598f2e0 2024-09-19T09:09:17.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.148+0000 7fe8a4e01740 10 client.27484 fetch_fsmap learned FSMap version 19 2024-09-19T09:09:17.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.148+0000 7fe8a4e01740 1 -- 172.21.15.92:0/1757695450 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e745a19800 con 0x55e74598f2e0 2024-09-19T09:09:17.153 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.148+0000 7fe87affd640 1 -- 172.21.15.92:0/1757695450 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8900ef030 con 0x55e74598f2e0 2024-09-19T09:09:17.153 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.149+0000 7fe87affd640 1 -- 172.21.15.92:0/1757695450 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe894033070 con 0x55e74598f2e0 2024-09-19T09:09:17.153 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.149+0000 7fe8a4e01740 10 client.27484 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:09:17.153 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.149+0000 7fe8a4e01740 10 client.27484 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:09:17.153 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.149+0000 7fe8a4e01740 20 client.27484 populate_metadata read hostname 'smithi092' 2024-09-19T09:09:17.153 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.149+0000 7fe8a4e01740 1 --2- 172.21.15.92:0/1757695450 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e745a1a050 0x55e745a1c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:17.153 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.149+0000 7fe8a4e01740 4 client.27484 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:09:17.153 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.149+0000 7fe8a4e01740 1 -- 172.21.15.92:0/1757695450 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e745901a20 con 0x55e745a1a050 2024-09-19T09:09:17.153 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.149+0000 7fe89b7fe640 1 --2- 172.21.15.92:0/1757695450 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e745a1a050 0x55e745a1c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:17.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.149+0000 7fe89b7fe640 1 --2- 172.21.15.92:0/1757695450 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e745a1a050 0x55e745a1c470 crc :-1 s=READY pgs=381 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e6a30cd01ad5fe2 server_cookie=e9e64ac174d6627e in_seq=0 out_seq=0 2024-09-19T09:09:17.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.149+0000 7fe87affd640 10 client.27484 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:17.163 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.163+0000 7fe87affd640 1 -- 172.21.15.92:0/1757695450 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e745901a20 con 0x55e745a1a050 2024-09-19T09:09:17.164 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.163+0000 7fe87affd640 10 client.27484 handle_command_reply: tid=0 2024-09-19T09:09:17.164 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.163+0000 7fe8a4e01740 1 client.27484 shutdown 2024-09-19T09:09:17.164 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.163+0000 7fe8a4e01740 1 -- 172.21.15.92:0/1757695450 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e74598f2e0 msgr2=0x55e7459a5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:17.165 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.164+0000 7fe8a4e01740 1 --2- 172.21.15.92:0/1757695450 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e74598f2e0 0x55e7459a5e10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x55e74598e6b0 tx=0x7fe894005cf0 comp rx=0 tx=0).stop 2024-09-19T09:09:17.165 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.164+0000 7fe8a4e01740 1 -- 172.21.15.92:0/1757695450 shutdown_connections 2024-09-19T09:09:17.165 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.164+0000 7fe8a4e01740 1 --2- 172.21.15.92:0/1757695450 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e745a1a050 0x55e745a1c470 crc :-1 s=READY pgs=381 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:17.165 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.164+0000 7fe87affd640 0 client.27484 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:17.165 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.164+0000 7fe8a4e01740 1 --2- 172.21.15.92:0/1757695450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e74599ebc0 0x55e745a17f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:17.165 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.164+0000 7fe8a4e01740 1 --2- 172.21.15.92:0/1757695450 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e74598f2e0 0x55e7459a5e10 secure :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0x55e74598e6b0 tx=0x7fe894005cf0 comp rx=0 tx=0).stop 2024-09-19T09:09:17.165 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.164+0000 7fe8a4e01740 1 --2- 172.21.15.92:0/1757695450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e74598e9a0 0x55e7459a58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:17.165 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.164+0000 7fe8a4e01740 1 -- 172.21.15.92:0/1757695450 >> 172.21.15.92:0/1757695450 conn(0x55e74598bf90 msgr2=0x55e7459a31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:17.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.166+0000 7fe8a4e01740 1 -- 172.21.15.92:0/1757695450 shutdown_connections 2024-09-19T09:09:17.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.166+0000 7fe8a4e01740 1 -- 172.21.15.92:0/1757695450 wait complete. 2024-09-19T09:09:17.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.166+0000 7fe8a4e01740 20 client.27484 trim_cache size 0 max 16384 2024-09-19T09:09:17.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:09:17.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:09:17.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:09:17.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:09:17.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.166+0000 7fe8a1f8d640 1 -- 172.21.15.92:0/3374334131 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe8840a33f0 msgr2=0x7fe8840a58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:17.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.166+0000 7fe8a1f8d640 1 --2- 172.21.15.92:0/3374334131 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe8840a33f0 0x7fe8840a58b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe88c00b850 tx=0x7fe88c008040 comp rx=0 tx=0).stop 2024-09-19T09:09:17.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.167+0000 7fe8a1f8d640 1 -- 172.21.15.92:0/3374334131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe89c101b60 msgr2=0x7fe89c070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:17.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.167+0000 7fe8a1f8d640 1 --2- 172.21.15.92:0/3374334131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe89c101b60 0x7fe89c070ba0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe890031610 tx=0x7fe890032c60 comp rx=0 tx=0).stop 2024-09-19T09:09:17.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.167+0000 7fe8a1f8d640 1 -- 172.21.15.92:0/3374334131 shutdown_connections 2024-09-19T09:09:17.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.167+0000 7fe8a1f8d640 1 --2- 172.21.15.92:0/3374334131 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe8840a33f0 0x7fe8840a58b0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:17.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.167+0000 7fe8a1f8d640 1 --2- 172.21.15.92:0/3374334131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe89c103710 0x7fe89c1a7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:17.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.167+0000 7fe8a1f8d640 1 --2- 172.21.15.92:0/3374334131 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe89c102d50 0x7fe89c0710e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:17.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.167+0000 7fe8a1f8d640 1 --2- 172.21.15.92:0/3374334131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe89c101b60 0x7fe89c070ba0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:17.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.167+0000 7fe8a1f8d640 1 -- 172.21.15.92:0/3374334131 >> 172.21.15.92:0/3374334131 conn(0x7fe89c0fd2c0 msgr2=0x7fe89c106070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:17.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.167+0000 7fe8a1f8d640 1 -- 172.21.15.92:0/3374334131 shutdown_connections 2024-09-19T09:09:17.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:17.167+0000 7fe8a1f8d640 1 -- 172.21.15.92:0/3374334131 wait complete. 2024-09-19T09:09:17.456 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:09:18.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.002+0000 7f050c4a9640 1 -- 172.21.15.92:0/736166978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0504102570 msgr2=0x7f05041029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:18.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.002+0000 7f050c4a9640 1 --2- 172.21.15.92:0/736166978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0504102570 0x7f05041029b0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f04f4009900 tx=0x7f04f402a480 comp rx=0 tx=0).stop 2024-09-19T09:09:18.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.002+0000 7f050c4a9640 1 -- 172.21.15.92:0/736166978 shutdown_connections 2024-09-19T09:09:18.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.002+0000 7f050c4a9640 1 --2- 172.21.15.92:0/736166978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0504102ef0 0x7f050410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:18.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.002+0000 7f050c4a9640 1 --2- 172.21.15.92:0/736166978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0504102570 0x7f05041029b0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:18.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.002+0000 7f050c4a9640 1 --2- 172.21.15.92:0/736166978 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0504100e20 0x7f0504101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:18.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.002+0000 7f050c4a9640 1 -- 172.21.15.92:0/736166978 >> 172.21.15.92:0/736166978 conn(0x7f05040fc7d0 msgr2=0x7f05040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:18.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.002+0000 7f050c4a9640 1 -- 172.21.15.92:0/736166978 shutdown_connections 2024-09-19T09:09:18.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.002+0000 7f050c4a9640 1 -- 172.21.15.92:0/736166978 wait complete. 2024-09-19T09:09:18.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.003+0000 7f050c4a9640 1 Processor -- start 2024-09-19T09:09:18.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.003+0000 7f050c4a9640 1 -- start start 2024-09-19T09:09:18.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.003+0000 7f050c4a9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0504100e20 0x7f0504197140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:18.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.003+0000 7f050c4a9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0504102570 0x7f0504197680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:18.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.003+0000 7f050c4a9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0504102ef0 0x7f0504197bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:18.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.003+0000 7f050c4a9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0504110f80 con 0x7f0504102ef0 2024-09-19T09:09:18.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.003+0000 7f050c4a9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0504110e00 con 0x7f0504100e20 2024-09-19T09:09:18.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.003+0000 7f050c4a9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0504111100 con 0x7f0504102570 2024-09-19T09:09:18.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.003+0000 7f050aa46640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0504102ef0 0x7f0504197bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:18.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.003+0000 7f050aa46640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0504102ef0 0x7f0504197bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51110/0 (socket says 172.21.15.92:51110) 2024-09-19T09:09:18.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.003+0000 7f050aa46640 1 -- 172.21.15.92:0/3963027777 learned_addr learned my addr 172.21.15.92:0/3963027777 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:18.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.003+0000 7f0509a44640 1 --2- 172.21.15.92:0/3963027777 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0504102570 0x7f0504197680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:18.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.003+0000 7f050a245640 1 --2- 172.21.15.92:0/3963027777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0504100e20 0x7f0504197140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:18.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.007+0000 7f050aa46640 1 -- 172.21.15.92:0/3963027777 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0504102570 msgr2=0x7f0504197680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:18.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.007+0000 7f050aa46640 1 --2- 172.21.15.92:0/3963027777 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0504102570 0x7f0504197680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:18.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.007+0000 7f050aa46640 1 -- 172.21.15.92:0/3963027777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0504100e20 msgr2=0x7f0504197140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:18.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.007+0000 7f050aa46640 1 --2- 172.21.15.92:0/3963027777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0504100e20 0x7f0504197140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:18.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.007+0000 7f050aa46640 1 -- 172.21.15.92:0/3963027777 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05041a69b0 con 0x7f0504102ef0 2024-09-19T09:09:18.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.007+0000 7f0509a44640 1 --2- 172.21.15.92:0/3963027777 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0504102570 0x7f0504197680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:09:18.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.007+0000 7f050aa46640 1 --2- 172.21.15.92:0/3963027777 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0504102ef0 0x7f0504197bc0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f04fc009fd0 tx=0x7f04fc00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:18.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.007+0000 7f04fb7fe640 1 -- 172.21.15.92:0/3963027777 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04fc017070 con 0x7f0504102ef0 2024-09-19T09:09:18.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.007+0000 7f050c4a9640 1 -- 172.21.15.92:0/3963027777 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05041a6ca0 con 0x7f0504102ef0 2024-09-19T09:09:18.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.008+0000 7f050c4a9640 1 -- 172.21.15.92:0/3963027777 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05041a71b0 con 0x7f0504102ef0 2024-09-19T09:09:18.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.008+0000 7f04fb7fe640 1 -- 172.21.15.92:0/3963027777 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04fc003e50 con 0x7f0504102ef0 2024-09-19T09:09:18.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.008+0000 7f04fb7fe640 1 -- 172.21.15.92:0/3963027777 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04fc020060 con 0x7f0504102ef0 2024-09-19T09:09:18.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.009+0000 7f050c4a9640 1 -- 172.21.15.92:0/3963027777 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04e8005290 con 0x7f0504102ef0 2024-09-19T09:09:18.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.011+0000 7f04fb7fe640 1 -- 172.21.15.92:0/3963027777 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f04fc003970 con 0x7f0504102ef0 2024-09-19T09:09:18.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.011+0000 7f04fb7fe640 1 --2- 172.21.15.92:0/3963027777 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f04f00a3340 0x7f04f00a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:18.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.011+0000 7f04fb7fe640 1 -- 172.21.15.92:0/3963027777 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f04fc0cf830 con 0x7f0504102ef0 2024-09-19T09:09:18.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.012+0000 7f050a245640 1 --2- 172.21.15.92:0/3963027777 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f04f00a3340 0x7f04f00a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:18.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.012+0000 7f050a245640 1 --2- 172.21.15.92:0/3963027777 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f04f00a3340 0x7f04f00a5800 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f0500005fd0 tx=0x7f050000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:18.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.019+0000 7f04fb7fe640 1 -- 172.21.15.92:0/3963027777 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f04fc09bf40 con 0x7f0504102ef0 2024-09-19T09:09:18.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.342+0000 7f050c4a9640 1 -- 172.21.15.92:0/3963027777 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f04e8005580 con 0x7f0504102ef0 2024-09-19T09:09:18.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.349+0000 7f04fb7fe640 1 -- 172.21.15.92:0/3963027777 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f04fc0a0240 con 0x7f0504102ef0 2024-09-19T09:09:18.351 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:09:18.351 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:09:18.352 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:09:18.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.355+0000 7f04f97fa640 1 -- 172.21.15.92:0/3963027777 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f04f00a3340 msgr2=0x7f04f00a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:18.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.355+0000 7f04f97fa640 1 --2- 172.21.15.92:0/3963027777 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f04f00a3340 0x7f04f00a5800 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f0500005fd0 tx=0x7f050000b390 comp rx=0 tx=0).stop 2024-09-19T09:09:18.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.355+0000 7f04f97fa640 1 -- 172.21.15.92:0/3963027777 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0504102ef0 msgr2=0x7f0504197bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:18.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.355+0000 7f04f97fa640 1 --2- 172.21.15.92:0/3963027777 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0504102ef0 0x7f0504197bc0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f04fc009fd0 tx=0x7f04fc00b260 comp rx=0 tx=0).stop 2024-09-19T09:09:18.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.355+0000 7f04f97fa640 1 -- 172.21.15.92:0/3963027777 shutdown_connections 2024-09-19T09:09:18.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.355+0000 7f04f97fa640 1 --2- 172.21.15.92:0/3963027777 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f04f00a3340 0x7f04f00a5800 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:18.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.355+0000 7f04f97fa640 1 --2- 172.21.15.92:0/3963027777 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0504102ef0 0x7f0504197bc0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:18.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.355+0000 7f04f97fa640 1 --2- 172.21.15.92:0/3963027777 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0504102570 0x7f0504197680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:18.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.355+0000 7f04f97fa640 1 --2- 172.21.15.92:0/3963027777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0504100e20 0x7f0504197140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:18.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.355+0000 7f04f97fa640 1 -- 172.21.15.92:0/3963027777 >> 172.21.15.92:0/3963027777 conn(0x7f05040fc7d0 msgr2=0x7f05040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:18.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.358+0000 7f04f97fa640 1 -- 172.21.15.92:0/3963027777 shutdown_connections 2024-09-19T09:09:18.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:18.359+0000 7f04f97fa640 1 -- 172.21.15.92:0/3963027777 wait complete. 2024-09-19T09:09:18.699 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:18 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3963027777' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:09:18.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:18 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3963027777' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:09:18.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:18 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3963027777' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:09:19.113 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 142.2 --await-for 45.0' 2024-09-19T09:09:19.113 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 142.2 --await-for 45.0 2024-09-19T09:09:19.532 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:09:19.662 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:19 smithi092 ceph-mon[31407]: pgmap v715: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.5 MiB/s wr, 118 op/s 2024-09-19T09:09:19.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:19 smithi167 ceph-mon[35359]: pgmap v715: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.5 MiB/s wr, 118 op/s 2024-09-19T09:09:19.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:19 smithi190 ceph-mon[35358]: pgmap v715: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.5 MiB/s wr, 118 op/s 2024-09-19T09:09:20.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.073+0000 7fc92531d640 1 -- 172.21.15.92:0/1589739826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc920105120 msgr2=0x7fc92010cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:20.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.073+0000 7fc92531d640 1 --2- 172.21.15.92:0/1589739826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc920105120 0x7fc92010cca0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fc910009ca0 tx=0x7fc91002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.073+0000 7fc92531d640 1 -- 172.21.15.92:0/1589739826 shutdown_connections 2024-09-19T09:09:20.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.073+0000 7fc92531d640 1 --2- 172.21.15.92:0/1589739826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc920105120 0x7fc92010cca0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.073+0000 7fc92531d640 1 --2- 172.21.15.92:0/1589739826 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9201009a0 0x7fc9201049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.073+0000 7fc92531d640 1 --2- 172.21.15.92:0/1589739826 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9200ffff0 0x7fc9201003d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.073+0000 7fc92531d640 1 -- 172.21.15.92:0/1589739826 >> 172.21.15.92:0/1589739826 conn(0x7fc9200fba90 msgr2=0x7fc9200fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:20.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.073+0000 7fc92531d640 1 -- 172.21.15.92:0/1589739826 shutdown_connections 2024-09-19T09:09:20.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.073+0000 7fc92531d640 1 -- 172.21.15.92:0/1589739826 wait complete. 2024-09-19T09:09:20.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.074+0000 7fc92531d640 1 Processor -- start 2024-09-19T09:09:20.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.074+0000 7fc92531d640 1 -- start start 2024-09-19T09:09:20.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.074+0000 7fc92531d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9200ffff0 0x7fc920198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:20.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.074+0000 7fc92531d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9201009a0 0x7fc9201989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:20.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.074+0000 7fc92531d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc920105120 0x7fc92019cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:20.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.074+0000 7fc92531d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc920111f40 con 0x7fc920105120 2024-09-19T09:09:20.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.074+0000 7fc92531d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc920111dc0 con 0x7fc9200ffff0 2024-09-19T09:09:20.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.074+0000 7fc92531d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc9201120c0 con 0x7fc9201009a0 2024-09-19T09:09:20.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.075+0000 7fc91f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc920105120 0x7fc92019cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:20.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.075+0000 7fc91f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc920105120 0x7fc92019cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51134/0 (socket says 172.21.15.92:51134) 2024-09-19T09:09:20.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.075+0000 7fc91f7fe640 1 -- 172.21.15.92:0/1878946920 learned_addr learned my addr 172.21.15.92:0/1878946920 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:20.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.075+0000 7fc91e7fc640 1 --2- 172.21.15.92:0/1878946920 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9201009a0 0x7fc9201989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:20.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.075+0000 7fc91effd640 1 --2- 172.21.15.92:0/1878946920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9200ffff0 0x7fc920198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:20.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.075+0000 7fc91e7fc640 1 -- 172.21.15.92:0/1878946920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9200ffff0 msgr2=0x7fc920198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:20.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.075+0000 7fc91e7fc640 1 --2- 172.21.15.92:0/1878946920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9200ffff0 0x7fc920198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.075+0000 7fc91e7fc640 1 -- 172.21.15.92:0/1878946920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc920105120 msgr2=0x7fc92019cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:20.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.075+0000 7fc91e7fc640 1 --2- 172.21.15.92:0/1878946920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc920105120 0x7fc92019cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.075+0000 7fc91e7fc640 1 -- 172.21.15.92:0/1878946920 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc92019d410 con 0x7fc9201009a0 2024-09-19T09:09:20.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.075+0000 7fc91effd640 1 --2- 172.21.15.92:0/1878946920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9200ffff0 0x7fc920198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:09:20.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.076+0000 7fc91e7fc640 1 --2- 172.21.15.92:0/1878946920 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9201009a0 0x7fc9201989a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc90800d6d0 tx=0x7fc90800db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:20.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.076+0000 7fc917fff640 1 -- 172.21.15.92:0/1878946920 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc908017070 con 0x7fc9201009a0 2024-09-19T09:09:20.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.076+0000 7fc917fff640 1 -- 172.21.15.92:0/1878946920 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc908009820 con 0x7fc9201009a0 2024-09-19T09:09:20.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.076+0000 7fc92531d640 1 -- 172.21.15.92:0/1878946920 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc92019d700 con 0x7fc9201009a0 2024-09-19T09:09:20.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.076+0000 7fc917fff640 1 -- 172.21.15.92:0/1878946920 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc908004d00 con 0x7fc9201009a0 2024-09-19T09:09:20.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.076+0000 7fc92531d640 1 -- 172.21.15.92:0/1878946920 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc92010eb80 con 0x7fc9201009a0 2024-09-19T09:09:20.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.079+0000 7fc917fff640 1 -- 172.21.15.92:0/1878946920 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc9080099d0 con 0x7fc9201009a0 2024-09-19T09:09:20.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.079+0000 7fc9276f6740 1 Processor -- start 2024-09-19T09:09:20.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.080+0000 7fc9276f6740 1 -- start start 2024-09-19T09:09:20.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.080+0000 7fc9276f6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea4ae76760 0x55ea4ae76b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:20.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.080+0000 7fc9276f6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea4ae77080 0x55ea4ae81400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:20.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.080+0000 7fc9276f6740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ea4ae81940 0x55ea4ae83d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:20.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.080+0000 7fc9276f6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ea4addc2a0 con 0x55ea4ae77080 2024-09-19T09:09:20.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.080+0000 7fc9276f6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ea4ad83b10 con 0x55ea4ae76760 2024-09-19T09:09:20.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.080+0000 7fc9276f6740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ea4add8260 con 0x55ea4ae81940 2024-09-19T09:09:20.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.080+0000 7fc91effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea4ae77080 0x55ea4ae81400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:20.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.080+0000 7fc91effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea4ae77080 0x55ea4ae81400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51144/0 (socket says 172.21.15.92:51144) 2024-09-19T09:09:20.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.080+0000 7fc91effd640 1 -- 172.21.15.92:0/2111580420 learned_addr learned my addr 172.21.15.92:0/2111580420 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:20.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.080+0000 7fc91e7fc640 1 --2- 172.21.15.92:0/2111580420 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ea4ae81940 0x55ea4ae83d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:20.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.080+0000 7fc91f7fe640 1 --2- 172.21.15.92:0/2111580420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea4ae76760 0x55ea4ae76b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:20.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.081+0000 7fc917fff640 1 --2- 172.21.15.92:0/1878946920 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc90c0a32c0 0x7fc90c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:20.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.081+0000 7fc91effd640 1 -- 172.21.15.92:0/2111580420 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ea4ae81940 msgr2=0x55ea4ae83d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:20.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.081+0000 7fc91effd640 1 --2- 172.21.15.92:0/2111580420 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ea4ae81940 0x55ea4ae83d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.081+0000 7fc91effd640 1 -- 172.21.15.92:0/2111580420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea4ae76760 msgr2=0x55ea4ae76b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:20.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.081+0000 7fc91effd640 1 --2- 172.21.15.92:0/2111580420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea4ae76760 0x55ea4ae76b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.081+0000 7fc91effd640 1 -- 172.21.15.92:0/2111580420 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea4ab4db90 con 0x55ea4ae77080 2024-09-19T09:09:20.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.081+0000 7fc91f7fe640 1 --2- 172.21.15.92:0/1878946920 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc90c0a32c0 0x7fc90c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:20.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.081+0000 7fc91effd640 1 --2- 172.21.15.92:0/2111580420 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea4ae77080 0x55ea4ae81400 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fc918009c30 tx=0x7fc918010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee03ee9ad0401016 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:20.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.082+0000 7fc917fff640 1 -- 172.21.15.92:0/1878946920 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc9080cf1c0 con 0x7fc9201009a0 2024-09-19T09:09:20.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.084+0000 7fc9157fa640 1 -- 172.21.15.92:0/2111580420 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc918004030 con 0x55ea4ae77080 2024-09-19T09:09:20.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.084+0000 7fc9157fa640 1 -- 172.21.15.92:0/2111580420 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9180041d0 con 0x55ea4ae77080 2024-09-19T09:09:20.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.084+0000 7fc9157fa640 1 -- 172.21.15.92:0/2111580420 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9180205b0 con 0x55ea4ae77080 2024-09-19T09:09:20.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.085+0000 7fc91f7fe640 1 --2- 172.21.15.92:0/1878946920 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc90c0a32c0 0x7fc90c0a5780 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc910009430 tx=0x7fc910040040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:20.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.085+0000 7fc9276f6740 1 -- 172.21.15.92:0/2111580420 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea4ae77080 msgr2=0x55ea4ae81400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:20.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.085+0000 7fc9276f6740 1 --2- 172.21.15.92:0/2111580420 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea4ae77080 0x55ea4ae81400 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fc918009c30 tx=0x7fc918010740 comp rx=0 tx=0).stop 2024-09-19T09:09:20.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.085+0000 7fc9276f6740 1 -- 172.21.15.92:0/2111580420 shutdown_connections 2024-09-19T09:09:20.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.085+0000 7fc9276f6740 1 --2- 172.21.15.92:0/2111580420 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ea4ae81940 0x55ea4ae83d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.085+0000 7fc9276f6740 1 --2- 172.21.15.92:0/2111580420 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea4ae77080 0x55ea4ae81400 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.085+0000 7fc9276f6740 1 --2- 172.21.15.92:0/2111580420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea4ae76760 0x55ea4ae76b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.085+0000 7fc9276f6740 1 -- 172.21.15.92:0/2111580420 >> 172.21.15.92:0/2111580420 conn(0x55ea4ae72cf0 msgr2=0x55ea4ae730d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:20.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.085+0000 7fc9276f6740 1 -- 172.21.15.92:0/2111580420 shutdown_connections 2024-09-19T09:09:20.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.085+0000 7fc9276f6740 1 -- 172.21.15.92:0/2111580420 wait complete. 2024-09-19T09:09:20.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.086+0000 7fc9276f6740 1 -- start start 2024-09-19T09:09:20.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.086+0000 7fc9276f6740 1 Processor -- start 2024-09-19T09:09:20.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.086+0000 7fc9276f6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea4ae76760 0x55ea4ae7e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:20.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.086+0000 7fc9276f6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea4ae77080 0x55ea4ae7ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:20.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.086+0000 7fc9276f6740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ea4ae81940 0x55ea4ae7f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:20.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.086+0000 7fc9276f6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ea4ae84510 con 0x55ea4ae76760 2024-09-19T09:09:20.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.087+0000 7fc9276f6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ea4ad646e0 con 0x55ea4ae77080 2024-09-19T09:09:20.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.087+0000 7fc9276f6740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ea4ae84690 con 0x55ea4ae81940 2024-09-19T09:09:20.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.087+0000 7fc91e7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea4ae77080 0x55ea4ae7ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:20.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.087+0000 7fc91effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea4ae76760 0x55ea4ae7e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:20.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.087+0000 7fc9276f6740 10 client.0 _ll_register_callbacks cb 0x55ea4ad88a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:09:20.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.087+0000 7fc91e7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea4ae77080 0x55ea4ae7ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:53092/0 (socket says 172.21.15.92:53092) 2024-09-19T09:09:20.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.087+0000 7fc91e7fc640 1 -- 172.21.15.92:0/559942942 learned_addr learned my addr 172.21.15.92:0/559942942 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:20.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.087+0000 7fc91f7fe640 1 --2- 172.21.15.92:0/559942942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ea4ae81940 0x55ea4ae7f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:20.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.087+0000 7fc91e7fc640 1 -- 172.21.15.92:0/559942942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ea4ae81940 msgr2=0x55ea4ae7f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:20.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.087+0000 7fc91e7fc640 1 --2- 172.21.15.92:0/559942942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ea4ae81940 0x55ea4ae7f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.087+0000 7fc91e7fc640 1 -- 172.21.15.92:0/559942942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea4ae76760 msgr2=0x55ea4ae7e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:20.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.087+0000 7fc91e7fc640 1 --2- 172.21.15.92:0/559942942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea4ae76760 0x55ea4ae7e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.087+0000 7fc91e7fc640 1 -- 172.21.15.92:0/559942942 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea4ae8d980 con 0x55ea4ae77080 2024-09-19T09:09:20.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.087+0000 7fc91f7fe640 1 --2- 172.21.15.92:0/559942942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ea4ae81940 0x55ea4ae7f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:09:20.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.087+0000 7fc91e7fc640 1 --2- 172.21.15.92:0/559942942 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea4ae77080 0x55ea4ae7ecf0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc9080981b0 tx=0x7fc908004fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=958c4946040e652d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:20.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.087+0000 7fc9067fc640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:09:20.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.088+0000 7fc9067fc640 1 -- 172.21.15.92:0/559942942 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc908020070 con 0x55ea4ae77080 2024-09-19T09:09:20.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.088+0000 7fc9067fc640 1 -- 172.21.15.92:0/559942942 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc908097e50 con 0x55ea4ae77080 2024-09-19T09:09:20.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.088+0000 7fc9276f6740 1 -- 172.21.15.92:0/559942942 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9180041d0 con 0x55ea4ae77080 2024-09-19T09:09:20.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.088+0000 7fc9067fc640 1 -- 172.21.15.92:0/559942942 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc90809b140 con 0x55ea4ae77080 2024-09-19T09:09:20.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.088+0000 7fc9276f6740 10 client.27632 fetch_fsmap learned FSMap version 19 2024-09-19T09:09:20.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.088+0000 7fc9276f6740 1 -- 172.21.15.92:0/559942942 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ea4ae90370 con 0x55ea4ae77080 2024-09-19T09:09:20.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.088+0000 7fc9067fc640 1 -- 172.21.15.92:0/559942942 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9080ce070 con 0x55ea4ae77080 2024-09-19T09:09:20.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.088+0000 7fc9067fc640 1 -- 172.21.15.92:0/559942942 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fc9080d2b60 con 0x55ea4ae77080 2024-09-19T09:09:20.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.088+0000 7fc9276f6740 10 client.27632 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:09:20.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.089+0000 7fc9276f6740 10 client.27632 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:09:20.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.089+0000 7fc9276f6740 20 client.27632 populate_metadata read hostname 'smithi092' 2024-09-19T09:09:20.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.089+0000 7fc9276f6740 1 --2- 172.21.15.92:0/559942942 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ea4ae91d60 0x55ea4ae941a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:20.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.089+0000 7fc9276f6740 4 client.27632 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:09:20.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.089+0000 7fc9276f6740 1 -- 172.21.15.92:0/559942942 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc9180041d0 con 0x55ea4ae91d60 2024-09-19T09:09:20.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.089+0000 7fc91effd640 1 --2- 172.21.15.92:0/559942942 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ea4ae91d60 0x55ea4ae941a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:20.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.089+0000 7fc9067fc640 10 client.27632 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:20.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.090+0000 7fc91effd640 1 --2- 172.21.15.92:0/559942942 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ea4ae91d60 0x55ea4ae941a0 crc :-1 s=READY pgs=382 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e3d1a0b81fed116 server_cookie=c37071d808c5c966 in_seq=0 out_seq=0 2024-09-19T09:09:20.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.091+0000 7fc9067fc640 1 -- 172.21.15.92:0/559942942 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fc9180041d0 con 0x55ea4ae91d60 2024-09-19T09:09:20.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.091+0000 7fc9067fc640 10 client.27632 handle_command_reply: tid=0 2024-09-19T09:09:20.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.091+0000 7fc9276f6740 1 client.27632 shutdown 2024-09-19T09:09:20.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.091+0000 7fc9276f6740 1 -- 172.21.15.92:0/559942942 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea4ae77080 msgr2=0x55ea4ae7ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:20.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.091+0000 7fc9276f6740 1 --2- 172.21.15.92:0/559942942 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea4ae77080 0x55ea4ae7ecf0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc9080981b0 tx=0x7fc908004fa0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.091+0000 7fc9276f6740 1 -- 172.21.15.92:0/559942942 shutdown_connections 2024-09-19T09:09:20.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.091+0000 7fc9276f6740 1 --2- 172.21.15.92:0/559942942 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ea4ae91d60 0x55ea4ae941a0 crc :-1 s=READY pgs=382 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.091+0000 7fc9276f6740 1 --2- 172.21.15.92:0/559942942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ea4ae81940 0x55ea4ae7f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.091+0000 7fc9276f6740 1 --2- 172.21.15.92:0/559942942 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea4ae77080 0x55ea4ae7ecf0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.091+0000 7fc9276f6740 1 --2- 172.21.15.92:0/559942942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea4ae76760 0x55ea4ae7e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.091+0000 7fc9276f6740 1 -- 172.21.15.92:0/559942942 >> 172.21.15.92:0/559942942 conn(0x55ea4ae72cf0 msgr2=0x55ea4ae78a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:20.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.091+0000 7fc9067fc640 0 client.27632 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:20.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.091+0000 7fc9276f6740 1 -- 172.21.15.92:0/559942942 shutdown_connections 2024-09-19T09:09:20.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.091+0000 7fc9276f6740 1 -- 172.21.15.92:0/559942942 wait complete. 2024-09-19T09:09:20.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.091+0000 7fc9276f6740 20 client.27632 trim_cache size 0 max 16384 2024-09-19T09:09:20.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.119+0000 7fc9276f6740 1 Processor -- start 2024-09-19T09:09:20.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.119+0000 7fc9276f6740 1 -- start start 2024-09-19T09:09:20.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.119+0000 7fc9276f6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea4ae76760 0x55ea4ae79210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:20.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.119+0000 7fc9276f6740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ea4ae77080 0x55ea4ae99ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:20.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.119+0000 7fc9276f6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea4ae81940 0x55ea4ae99ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:20.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.119+0000 7fc9276f6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc9201a9440 con 0x55ea4ae81940 2024-09-19T09:09:20.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.119+0000 7fc9276f6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc9201abce0 con 0x55ea4ae76760 2024-09-19T09:09:20.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.119+0000 7fc9276f6740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc9201a9ad0 con 0x55ea4ae77080 2024-09-19T09:09:20.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.119+0000 7fc91f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea4ae81940 0x55ea4ae99ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:20.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.119+0000 7fc91effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea4ae76760 0x55ea4ae79210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:20.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.119+0000 7fc91f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea4ae81940 0x55ea4ae99ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51170/0 (socket says 172.21.15.92:51170) 2024-09-19T09:09:20.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.120+0000 7fc91f7fe640 1 -- 172.21.15.92:0/1685807445 learned_addr learned my addr 172.21.15.92:0/1685807445 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:20.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.120+0000 7fc91e7fc640 1 --2- 172.21.15.92:0/1685807445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ea4ae77080 0x55ea4ae99ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:20.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.120+0000 7fc91e7fc640 1 -- 172.21.15.92:0/1685807445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea4ae76760 msgr2=0x55ea4ae79210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:20.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.120+0000 7fc91e7fc640 1 --2- 172.21.15.92:0/1685807445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea4ae76760 0x55ea4ae79210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.120+0000 7fc91e7fc640 1 -- 172.21.15.92:0/1685807445 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea4ae81940 msgr2=0x55ea4ae99ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:20.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.120+0000 7fc91e7fc640 1 --2- 172.21.15.92:0/1685807445 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea4ae81940 0x55ea4ae99ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.120+0000 7fc91e7fc640 1 -- 172.21.15.92:0/1685807445 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea4ae72b20 con 0x55ea4ae77080 2024-09-19T09:09:20.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.120+0000 7fc91f7fe640 1 --2- 172.21.15.92:0/1685807445 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea4ae81940 0x55ea4ae99ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:09:20.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.120+0000 7fc91e7fc640 1 --2- 172.21.15.92:0/1685807445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ea4ae77080 0x55ea4ae99ab0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc90809b770 tx=0x7fc908084e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e798aa121142f1a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:20.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.120+0000 7fc914ff9640 1 -- 172.21.15.92:0/1685807445 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9080b8030 con 0x55ea4ae77080 2024-09-19T09:09:20.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.120+0000 7fc914ff9640 1 -- 172.21.15.92:0/1685807445 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9080ce030 con 0x55ea4ae77080 2024-09-19T09:09:20.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.120+0000 7fc914ff9640 1 -- 172.21.15.92:0/1685807445 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc908020070 con 0x55ea4ae77080 2024-09-19T09:09:20.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.121+0000 7fc9276f6740 1 -- 172.21.15.92:0/1685807445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ea4ae77080 msgr2=0x55ea4ae99ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:20.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.121+0000 7fc9276f6740 1 --2- 172.21.15.92:0/1685807445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ea4ae77080 0x55ea4ae99ab0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc90809b770 tx=0x7fc908084e60 comp rx=0 tx=0).stop 2024-09-19T09:09:20.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.121+0000 7fc9276f6740 1 -- 172.21.15.92:0/1685807445 shutdown_connections 2024-09-19T09:09:20.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.121+0000 7fc9276f6740 1 --2- 172.21.15.92:0/1685807445 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea4ae81940 0x55ea4ae99ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.121+0000 7fc9276f6740 1 --2- 172.21.15.92:0/1685807445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ea4ae77080 0x55ea4ae99ab0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.121+0000 7fc9276f6740 1 --2- 172.21.15.92:0/1685807445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea4ae76760 0x55ea4ae79210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.121+0000 7fc9276f6740 1 -- 172.21.15.92:0/1685807445 >> 172.21.15.92:0/1685807445 conn(0x55ea4ae72cf0 msgr2=0x55ea4ae80830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:20.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.121+0000 7fc9276f6740 1 -- 172.21.15.92:0/1685807445 shutdown_connections 2024-09-19T09:09:20.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.121+0000 7fc9276f6740 1 -- 172.21.15.92:0/1685807445 wait complete. 2024-09-19T09:09:20.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.122+0000 7fc9276f6740 1 -- start start 2024-09-19T09:09:20.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.122+0000 7fc9276f6740 1 Processor -- start 2024-09-19T09:09:20.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.122+0000 7fc9276f6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea4ae76760 0x55ea4ae8a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:20.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.122+0000 7fc9276f6740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ea4ae77080 0x55ea4ae85340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:20.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.122+0000 7fc9276f6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea4ae81940 0x55ea4ae85880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:20.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.122+0000 7fc9276f6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc9201aa1a0 con 0x55ea4ae76760 2024-09-19T09:09:20.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.122+0000 7fc9276f6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc9201ab610 con 0x55ea4ae81940 2024-09-19T09:09:20.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.122+0000 7fc9276f6740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc9201aa870 con 0x55ea4ae77080 2024-09-19T09:09:20.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.122+0000 7fc9276f6740 10 client.0 _ll_register_callbacks cb 0x7fc9080973c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:09:20.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.122+0000 7fc91effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea4ae76760 0x55ea4ae8a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:20.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.122+0000 7fc91effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea4ae76760 0x55ea4ae8a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51176/0 (socket says 172.21.15.92:51176) 2024-09-19T09:09:20.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.122+0000 7fc91effd640 1 -- 172.21.15.92:0/224151817 learned_addr learned my addr 172.21.15.92:0/224151817 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:20.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.122+0000 7fc91f7fe640 1 --2- 172.21.15.92:0/224151817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea4ae81940 0x55ea4ae85880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:20.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.122+0000 7fc91e7fc640 1 --2- 172.21.15.92:0/224151817 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ea4ae77080 0x55ea4ae85340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:20.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.123+0000 7fc91f7fe640 1 -- 172.21.15.92:0/224151817 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ea4ae77080 msgr2=0x55ea4ae85340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:20.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.123+0000 7fc91f7fe640 1 --2- 172.21.15.92:0/224151817 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ea4ae77080 0x55ea4ae85340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.123+0000 7fc91f7fe640 1 -- 172.21.15.92:0/224151817 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea4ae76760 msgr2=0x55ea4ae8a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:20.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.123+0000 7fc91f7fe640 1 --2- 172.21.15.92:0/224151817 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea4ae76760 0x55ea4ae8a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.123+0000 7fc91f7fe640 1 -- 172.21.15.92:0/224151817 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea4ae860b0 con 0x55ea4ae81940 2024-09-19T09:09:20.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.123+0000 7fc91effd640 1 --2- 172.21.15.92:0/224151817 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea4ae76760 0x55ea4ae8a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:09:20.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.123+0000 7fc91f7fe640 1 --2- 172.21.15.92:0/224151817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea4ae81940 0x55ea4ae85880 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc910004af0 tx=0x7fc91002a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=970340ffd1363072 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:20.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.123+0000 7fc9067fc640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:09:20.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.123+0000 7fc9067fc640 1 -- 172.21.15.92:0/224151817 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc910059060 con 0x55ea4ae81940 2024-09-19T09:09:20.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.123+0000 7fc9067fc640 1 -- 172.21.15.92:0/224151817 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc9100305c0 con 0x55ea4ae81940 2024-09-19T09:09:20.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.123+0000 7fc9276f6740 1 -- 172.21.15.92:0/224151817 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9080ce030 con 0x55ea4ae81940 2024-09-19T09:09:20.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.123+0000 7fc9067fc640 1 -- 172.21.15.92:0/224151817 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc9100307c0 con 0x55ea4ae81940 2024-09-19T09:09:20.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.123+0000 7fc9276f6740 10 client.27638 fetch_fsmap learned FSMap version 19 2024-09-19T09:09:20.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.123+0000 7fc9276f6740 1 -- 172.21.15.92:0/224151817 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ea4aefca50 con 0x55ea4ae81940 2024-09-19T09:09:20.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.124+0000 7fc9067fc640 1 -- 172.21.15.92:0/224151817 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc910036040 con 0x55ea4ae81940 2024-09-19T09:09:20.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.124+0000 7fc9067fc640 1 -- 172.21.15.92:0/224151817 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fc910053030 con 0x55ea4ae81940 2024-09-19T09:09:20.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.124+0000 7fc9276f6740 10 client.27638 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:09:20.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.124+0000 7fc9276f6740 10 client.27638 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:09:20.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.124+0000 7fc9276f6740 20 client.27638 populate_metadata read hostname 'smithi092' 2024-09-19T09:09:20.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.124+0000 7fc9276f6740 1 --2- 172.21.15.92:0/224151817 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ea4aefd1e0 0x55ea4aeff600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:20.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.124+0000 7fc9276f6740 4 client.27638 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.2, "await_for": 45.0}] 2024-09-19T09:09:20.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.124+0000 7fc9276f6740 1 -- 172.21.15.92:0/224151817 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.2, "await_for": 45.0}) -- 0x7fc9080ce030 con 0x55ea4aefd1e0 2024-09-19T09:09:20.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.124+0000 7fc91effd640 1 --2- 172.21.15.92:0/224151817 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ea4aefd1e0 0x55ea4aeff600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:20.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.124+0000 7fc9067fc640 10 client.27638 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:20.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.124+0000 7fc91effd640 1 --2- 172.21.15.92:0/224151817 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ea4aefd1e0 0x55ea4aeff600 crc :-1 s=READY pgs=383 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f175d1fb1685ed5e server_cookie=4f78c8664777b93f in_seq=0 out_seq=0 2024-09-19T09:09:20.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.381+0000 7fc9067fc640 1 -- 172.21.15.92:0/224151817 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7fc9080ce030 con 0x55ea4aefd1e0 2024-09-19T09:09:20.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.381+0000 7fc9067fc640 10 client.27638 handle_command_reply: tid=0 2024-09-19T09:09:20.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.381+0000 7fc9276f6740 1 client.27638 shutdown 2024-09-19T09:09:20.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.382+0000 7fc9276f6740 1 -- 172.21.15.92:0/224151817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea4ae81940 msgr2=0x55ea4ae85880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:20.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.382+0000 7fc9276f6740 1 --2- 172.21.15.92:0/224151817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea4ae81940 0x55ea4ae85880 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc910004af0 tx=0x7fc91002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.382+0000 7fc9276f6740 1 -- 172.21.15.92:0/224151817 shutdown_connections 2024-09-19T09:09:20.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.382+0000 7fc9276f6740 1 --2- 172.21.15.92:0/224151817 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ea4aefd1e0 0x55ea4aeff600 crc :-1 s=READY pgs=383 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.382+0000 7fc9276f6740 1 --2- 172.21.15.92:0/224151817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea4ae81940 0x55ea4ae85880 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.382+0000 7fc9067fc640 0 client.27638 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:20.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.382+0000 7fc9276f6740 1 --2- 172.21.15.92:0/224151817 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ea4ae77080 0x55ea4ae85340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.382+0000 7fc9276f6740 1 --2- 172.21.15.92:0/224151817 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea4ae76760 0x55ea4ae8a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.382+0000 7fc9276f6740 1 -- 172.21.15.92:0/224151817 >> 172.21.15.92:0/224151817 conn(0x55ea4ae72cf0 msgr2=0x55ea4ae71650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:20.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.382+0000 7fc9276f6740 1 -- 172.21.15.92:0/224151817 shutdown_connections 2024-09-19T09:09:20.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.382+0000 7fc9276f6740 1 -- 172.21.15.92:0/224151817 wait complete. 2024-09-19T09:09:20.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.382+0000 7fc9276f6740 20 client.27638 trim_cache size 0 max 16384 2024-09-19T09:09:20.387 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:09:20.388 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 19, 2024-09-19T09:09:20.388 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24472, 2024-09-19T09:09:20.388 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 46, 2024-09-19T09:09:20.388 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-09-19T09:09:20.388 INFO:teuthology.orchestra.run.smithi092.stdout: "be738a60": { 2024-09-19T09:09:20.389 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 46, 2024-09-19T09:09:20.389 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-09-19T09:09:20.389 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:09:20.389 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-09-19T09:09:20.389 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:09:20.389 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:09:20.390 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 90.0, 2024-09-19T09:09:20.390 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 142.2, 2024-09-19T09:09:20.390 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-09-19T09:09:20.390 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-09-19T09:09:20.390 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-09-19T09:09:20.391 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:09:20.391 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-09-19T09:09:20.391 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:09:20.391 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:09:20.391 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:09:20.391 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:09:20.391 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:09:20.391 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:09:20.391 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:09:20.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.382+0000 7fc92531d640 1 -- 172.21.15.92:0/1878946920 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc90c0a32c0 msgr2=0x7fc90c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:20.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.382+0000 7fc92531d640 1 --2- 172.21.15.92:0/1878946920 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc90c0a32c0 0x7fc90c0a5780 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc910009430 tx=0x7fc910040040 comp rx=0 tx=0).stop 2024-09-19T09:09:20.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.382+0000 7fc92531d640 1 -- 172.21.15.92:0/1878946920 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9201009a0 msgr2=0x7fc9201989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:20.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.382+0000 7fc92531d640 1 --2- 172.21.15.92:0/1878946920 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9201009a0 0x7fc9201989a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc90800d6d0 tx=0x7fc90800db90 comp rx=0 tx=0).stop 2024-09-19T09:09:20.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.383+0000 7fc92531d640 1 -- 172.21.15.92:0/1878946920 shutdown_connections 2024-09-19T09:09:20.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.383+0000 7fc92531d640 1 --2- 172.21.15.92:0/1878946920 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc90c0a32c0 0x7fc90c0a5780 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.383+0000 7fc92531d640 1 --2- 172.21.15.92:0/1878946920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc920105120 0x7fc92019cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.383+0000 7fc92531d640 1 --2- 172.21.15.92:0/1878946920 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9201009a0 0x7fc9201989a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.383+0000 7fc92531d640 1 --2- 172.21.15.92:0/1878946920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9200ffff0 0x7fc920198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.383+0000 7fc92531d640 1 -- 172.21.15.92:0/1878946920 >> 172.21.15.92:0/1878946920 conn(0x7fc9200fba90 msgr2=0x7fc9200fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:20.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.383+0000 7fc92531d640 1 -- 172.21.15.92:0/1878946920 shutdown_connections 2024-09-19T09:09:20.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:20.383+0000 7fc92531d640 1 -- 172.21.15.92:0/1878946920 wait complete. 2024-09-19T09:09:20.795 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 755.0 s, 1503.1 tps, lat 325.531 ms stddev 2341.612 2024-09-19T09:09:20.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:20 smithi092 ceph-mon[31407]: pgmap v716: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.7 MiB/s wr, 157 op/s 2024-09-19T09:09:21.009 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'be738a60', quiesce took 3.9 seconds. Will release after: 18.3 2024-09-19T09:09:21.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:20 smithi167 ceph-mon[35359]: pgmap v716: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.7 MiB/s wr, 157 op/s 2024-09-19T09:09:21.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:20 smithi190 ceph-mon[35358]: pgmap v716: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.7 MiB/s wr, 157 op/s 2024-09-19T09:09:23.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:22 smithi092 ceph-mon[31407]: pgmap v717: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.6 MiB/s wr, 182 op/s 2024-09-19T09:09:23.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:22 smithi167 ceph-mon[35359]: pgmap v717: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.6 MiB/s wr, 182 op/s 2024-09-19T09:09:23.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:22 smithi190 ceph-mon[35358]: pgmap v717: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.6 MiB/s wr, 182 op/s 2024-09-19T09:09:25.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:24 smithi092 ceph-mon[31407]: pgmap v718: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.0 MiB/s wr, 225 op/s 2024-09-19T09:09:25.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:24 smithi167 ceph-mon[35359]: pgmap v718: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.0 MiB/s wr, 225 op/s 2024-09-19T09:09:25.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:24 smithi190 ceph-mon[35358]: pgmap v718: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.0 MiB/s wr, 225 op/s 2024-09-19T09:09:25.800 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:09:27.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:26 smithi092 ceph-mon[31407]: pgmap v719: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.1 MiB/s wr, 228 op/s 2024-09-19T09:09:27.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:26 smithi167 ceph-mon[35359]: pgmap v719: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.1 MiB/s wr, 228 op/s 2024-09-19T09:09:27.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:26 smithi190 ceph-mon[35358]: pgmap v719: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.1 MiB/s wr, 228 op/s 2024-09-19T09:09:29.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:28 smithi092 ceph-mon[31407]: pgmap v720: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.0 MiB/s wr, 228 op/s 2024-09-19T09:09:29.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:28 smithi167 ceph-mon[35359]: pgmap v720: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.0 MiB/s wr, 228 op/s 2024-09-19T09:09:29.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:28 smithi190 ceph-mon[35358]: pgmap v720: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.0 MiB/s wr, 228 op/s 2024-09-19T09:09:29.473 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:09:29.737 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:09:30.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.173+0000 7f24a5846640 1 -- 172.21.15.92:0/3273352589 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24a0101280 msgr2=0x7f24a010df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:30.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.173+0000 7f24a5846640 1 --2- 172.21.15.92:0/3273352589 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24a0101280 0x7f24a010df40 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f2488009900 tx=0x7f248802a410 comp rx=0 tx=0).stop 2024-09-19T09:09:30.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.173+0000 7f24a5846640 1 -- 172.21.15.92:0/3273352589 shutdown_connections 2024-09-19T09:09:30.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.173+0000 7f24a5846640 1 --2- 172.21.15.92:0/3273352589 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24a010e480 0x7f24a0110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.173+0000 7f24a5846640 1 --2- 172.21.15.92:0/3273352589 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24a0101280 0x7f24a010df40 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.173+0000 7f24a5846640 1 --2- 172.21.15.92:0/3273352589 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24a01008d0 0x7f24a0100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.173+0000 7f24a5846640 1 -- 172.21.15.92:0/3273352589 >> 172.21.15.92:0/3273352589 conn(0x7f24a00fc7a0 msgr2=0x7f24a00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:30.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.173+0000 7f24a5846640 1 -- 172.21.15.92:0/3273352589 shutdown_connections 2024-09-19T09:09:30.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.173+0000 7f24a5846640 1 -- 172.21.15.92:0/3273352589 wait complete. 2024-09-19T09:09:30.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.173+0000 7f24a5846640 1 Processor -- start 2024-09-19T09:09:30.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.174+0000 7f24a5846640 1 -- start start 2024-09-19T09:09:30.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.174+0000 7f24a5846640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24a01008d0 0x7f24a019a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.174+0000 7f24a5846640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24a0101280 0x7f24a019abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.174+0000 7f24a5846640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24a010e480 0x7f24a019ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.174+0000 7f24a5846640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f24a01141a0 con 0x7f24a010e480 2024-09-19T09:09:30.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.174+0000 7f24a5846640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f24a0114020 con 0x7f24a0101280 2024-09-19T09:09:30.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.174+0000 7f24a5846640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f24a0114320 con 0x7f24a01008d0 2024-09-19T09:09:30.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.174+0000 7f249f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24a010e480 0x7f24a019ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:30.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.174+0000 7f249f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24a010e480 0x7f24a019ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52032/0 (socket says 172.21.15.92:52032) 2024-09-19T09:09:30.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.174+0000 7f249f7fe640 1 -- 172.21.15.92:0/2390660315 learned_addr learned my addr 172.21.15.92:0/2390660315 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:30.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.174+0000 7f249effd640 1 --2- 172.21.15.92:0/2390660315 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24a01008d0 0x7f24a019a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:30.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.174+0000 7f249f7fe640 1 -- 172.21.15.92:0/2390660315 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24a01008d0 msgr2=0x7f24a019a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:30.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.174+0000 7f249f7fe640 1 --2- 172.21.15.92:0/2390660315 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24a01008d0 0x7f24a019a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.174+0000 7f249f7fe640 1 -- 172.21.15.92:0/2390660315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24a0101280 msgr2=0x7f24a019abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:09:30.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.174+0000 7f249f7fe640 1 --2- 172.21.15.92:0/2390660315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24a0101280 0x7f24a019abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.174+0000 7f249f7fe640 1 -- 172.21.15.92:0/2390660315 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a019f630 con 0x7f24a010e480 2024-09-19T09:09:30.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.174+0000 7f249f7fe640 1 --2- 172.21.15.92:0/2390660315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24a010e480 0x7f24a019ef50 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f249800d6a0 tx=0x7f249800db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:30.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.174+0000 7f24a4844640 1 -- 172.21.15.92:0/2390660315 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2498017070 con 0x7f24a010e480 2024-09-19T09:09:30.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.175+0000 7f24a5846640 1 -- 172.21.15.92:0/2390660315 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24a019f920 con 0x7f24a010e480 2024-09-19T09:09:30.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.175+0000 7f24a4844640 1 -- 172.21.15.92:0/2390660315 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2498009820 con 0x7f24a010e480 2024-09-19T09:09:30.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.175+0000 7f24a4844640 1 -- 172.21.15.92:0/2390660315 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2498004ce0 con 0x7f24a010e480 2024-09-19T09:09:30.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.175+0000 7f24a5846640 1 -- 172.21.15.92:0/2390660315 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24a01a7200 con 0x7f24a010e480 2024-09-19T09:09:30.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.177+0000 7f24a7c1f740 1 Processor -- start 2024-09-19T09:09:30.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.177+0000 7f24a4844640 1 -- 172.21.15.92:0/2390660315 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f24980099d0 con 0x7f24a010e480 2024-09-19T09:09:30.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.177+0000 7f24a7c1f740 1 -- start start 2024-09-19T09:09:30.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.177+0000 7f24a7c1f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a55cbc4a0 0x555a55cbc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.177+0000 7f24a7c1f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a55cbcdc0 0x555a55cc7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.177+0000 7f24a7c1f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555a55cc7680 0x555a55cc9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.177+0000 7f24a7c1f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555a55c222e0 con 0x555a55cbcdc0 2024-09-19T09:09:30.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.177+0000 7f24a7c1f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x555a55bc9ce0 con 0x555a55cbc4a0 2024-09-19T09:09:30.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.177+0000 7f24a7c1f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x555a55c1e2a0 con 0x555a55cc7680 2024-09-19T09:09:30.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.178+0000 7f249effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a55cbcdc0 0x555a55cc7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:30.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.178+0000 7f249effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a55cbcdc0 0x555a55cc7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52044/0 (socket says 172.21.15.92:52044) 2024-09-19T09:09:30.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.178+0000 7f249effd640 1 -- 172.21.15.92:0/4262175898 learned_addr learned my addr 172.21.15.92:0/4262175898 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:30.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.178+0000 7f249e7fc640 1 --2- 172.21.15.92:0/4262175898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555a55cc7680 0x555a55cc9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:30.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.178+0000 7f249e7fc640 1 --2- 172.21.15.92:0/4262175898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a55cbc4a0 0x555a55cbc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:30.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.178+0000 7f249effd640 1 -- 172.21.15.92:0/4262175898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555a55cc7680 msgr2=0x555a55cc9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:30.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.178+0000 7f249effd640 1 --2- 172.21.15.92:0/4262175898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555a55cc7680 0x555a55cc9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.178+0000 7f249effd640 1 -- 172.21.15.92:0/4262175898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a55cbc4a0 msgr2=0x555a55cbc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:30.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.178+0000 7f249effd640 1 --2- 172.21.15.92:0/4262175898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a55cbc4a0 0x555a55cbc880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.178+0000 7f249effd640 1 -- 172.21.15.92:0/4262175898 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a55bae440 con 0x555a55cbcdc0 2024-09-19T09:09:30.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.178+0000 7f249e7fc640 1 --2- 172.21.15.92:0/4262175898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a55cbc4a0 0x555a55cbc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:09:30.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.178+0000 7f249effd640 1 --2- 172.21.15.92:0/4262175898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a55cbcdc0 0x555a55cc7140 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f2490009e70 tx=0x7f249000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c51c96109cca82 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:30.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.178+0000 7f24a4844640 1 --2- 172.21.15.92:0/2390660315 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f248c0a3240 0x7f248c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.178+0000 7f2495ffb640 1 -- 172.21.15.92:0/4262175898 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249001a680 con 0x555a55cbcdc0 2024-09-19T09:09:30.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.178+0000 7f249e7fc640 1 --2- 172.21.15.92:0/2390660315 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f248c0a3240 0x7f248c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:30.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.178+0000 7f2495ffb640 1 -- 172.21.15.92:0/4262175898 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f249001ad00 con 0x555a55cbcdc0 2024-09-19T09:09:30.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.178+0000 7f2495ffb640 1 -- 172.21.15.92:0/4262175898 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2490011d60 con 0x555a55cbcdc0 2024-09-19T09:09:30.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.178+0000 7f24a4844640 1 -- 172.21.15.92:0/2390660315 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f24980cf290 con 0x7f24a010e480 2024-09-19T09:09:30.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.179+0000 7f24a7c1f740 1 -- 172.21.15.92:0/4262175898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a55cbcdc0 msgr2=0x555a55cc7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:30.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.179+0000 7f249e7fc640 1 --2- 172.21.15.92:0/2390660315 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f248c0a3240 0x7f248c0a5700 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f2488005ab0 tx=0x7f2488000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:30.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.179+0000 7f24a7c1f740 1 --2- 172.21.15.92:0/4262175898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a55cbcdc0 0x555a55cc7140 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f2490009e70 tx=0x7f249000f730 comp rx=0 tx=0).stop 2024-09-19T09:09:30.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.179+0000 7f24a7c1f740 1 -- 172.21.15.92:0/4262175898 shutdown_connections 2024-09-19T09:09:30.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.179+0000 7f24a7c1f740 1 --2- 172.21.15.92:0/4262175898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555a55cc7680 0x555a55cc9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.179+0000 7f24a7c1f740 1 --2- 172.21.15.92:0/4262175898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a55cbcdc0 0x555a55cc7140 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.179+0000 7f24a7c1f740 1 --2- 172.21.15.92:0/4262175898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a55cbc4a0 0x555a55cbc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.179+0000 7f24a7c1f740 1 -- 172.21.15.92:0/4262175898 >> 172.21.15.92:0/4262175898 conn(0x555a55cb8a30 msgr2=0x555a55cb8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:30.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.179+0000 7f24a7c1f740 1 -- 172.21.15.92:0/4262175898 shutdown_connections 2024-09-19T09:09:30.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.179+0000 7f24a7c1f740 1 -- 172.21.15.92:0/4262175898 wait complete. 2024-09-19T09:09:30.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.180+0000 7f24a7c1f740 1 -- start start 2024-09-19T09:09:30.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.180+0000 7f24a7c1f740 1 Processor -- start 2024-09-19T09:09:30.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.180+0000 7f24a7c1f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a55cbc4a0 0x555a55cc6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.180+0000 7f24a7c1f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a55cbcdc0 0x555a55cc4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.180+0000 7f24a7c1f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555a55cc7680 0x555a55cc4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.180+0000 7f24a7c1f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555a55cca250 con 0x555a55cbc4a0 2024-09-19T09:09:30.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.180+0000 7f24a7c1f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x555a55bdd050 con 0x555a55cbcdc0 2024-09-19T09:09:30.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.180+0000 7f24a7c1f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x555a55cca3d0 con 0x555a55cc7680 2024-09-19T09:09:30.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.180+0000 7f24a7c1f740 10 client.0 _ll_register_callbacks cb 0x555a55c1d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:09:30.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.180+0000 7f249effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a55cbc4a0 0x555a55cc6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:30.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.180+0000 7f249effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a55cbc4a0 0x555a55cc6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52050/0 (socket says 172.21.15.92:52050) 2024-09-19T09:09:30.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.180+0000 7f249effd640 1 -- 172.21.15.92:0/2895960152 learned_addr learned my addr 172.21.15.92:0/2895960152 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:30.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.180+0000 7f249f7fe640 1 --2- 172.21.15.92:0/2895960152 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555a55cc7680 0x555a55cc4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:30.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.180+0000 7f249e7fc640 1 --2- 172.21.15.92:0/2895960152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a55cbcdc0 0x555a55cc4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:30.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.180+0000 7f249effd640 1 -- 172.21.15.92:0/2895960152 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555a55cc7680 msgr2=0x555a55cc4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:30.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.180+0000 7f249effd640 1 --2- 172.21.15.92:0/2895960152 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555a55cc7680 0x555a55cc4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.180+0000 7f249effd640 1 -- 172.21.15.92:0/2895960152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a55cbcdc0 msgr2=0x555a55cc4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:30.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.180+0000 7f249effd640 1 --2- 172.21.15.92:0/2895960152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a55cbcdc0 0x555a55cc4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.180+0000 7f249effd640 1 -- 172.21.15.92:0/2895960152 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a559933c0 con 0x555a55cbc4a0 2024-09-19T09:09:30.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.181+0000 7f249effd640 1 --2- 172.21.15.92:0/2895960152 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a55cbc4a0 0x555a55cc6f90 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f2490000f80 tx=0x7f2490011670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bbf451865a5e0b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:30.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.181+0000 7f247effd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:09:30.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.181+0000 7f247effd640 1 -- 172.21.15.92:0/2895960152 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2490029060 con 0x555a55cbc4a0 2024-09-19T09:09:30.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.181+0000 7f247effd640 1 -- 172.21.15.92:0/2895960152 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2490011d10 con 0x555a55cbc4a0 2024-09-19T09:09:30.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.181+0000 7f24a7c1f740 1 -- 172.21.15.92:0/2895960152 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f249001ad00 con 0x555a55cbc4a0 2024-09-19T09:09:30.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.181+0000 7f247effd640 1 -- 172.21.15.92:0/2895960152 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f249001a480 con 0x555a55cbc4a0 2024-09-19T09:09:30.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.181+0000 7f24a7c1f740 10 client.18384 fetch_fsmap learned FSMap version 19 2024-09-19T09:09:30.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.181+0000 7f24a7c1f740 1 -- 172.21.15.92:0/2895960152 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x555a55cd5bd0 con 0x555a55cbc4a0 2024-09-19T09:09:30.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.181+0000 7f247effd640 1 -- 172.21.15.92:0/2895960152 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f249001ad00 con 0x555a55cbc4a0 2024-09-19T09:09:30.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.181+0000 7f247effd640 1 -- 172.21.15.92:0/2895960152 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f249002e070 con 0x555a55cbc4a0 2024-09-19T09:09:30.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.181+0000 7f24a7c1f740 10 client.18384 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:09:30.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.181+0000 7f24a7c1f740 10 client.18384 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:09:30.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.181+0000 7f24a7c1f740 20 client.18384 populate_metadata read hostname 'smithi092' 2024-09-19T09:09:30.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.181+0000 7f24a7c1f740 1 --2- 172.21.15.92:0/2895960152 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555a55cd7090 0x555a55cd9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.181+0000 7f24a7c1f740 4 client.18384 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:09:30.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.181+0000 7f24a7c1f740 1 -- 172.21.15.92:0/2895960152 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a55c2f850 con 0x555a55cd7090 2024-09-19T09:09:30.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.182+0000 7f249e7fc640 1 --2- 172.21.15.92:0/2895960152 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555a55cd7090 0x555a55cd9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:30.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.182+0000 7f249e7fc640 1 --2- 172.21.15.92:0/2895960152 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555a55cd7090 0x555a55cd9480 crc :-1 s=READY pgs=384 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6ef881cf3e6f838 server_cookie=32c836e1a1f5f912 in_seq=0 out_seq=0 2024-09-19T09:09:30.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.182+0000 7f247effd640 10 client.18384 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:30.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.183+0000 7f247effd640 1 -- 172.21.15.92:0/2895960152 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555a55c2f850 con 0x555a55cd7090 2024-09-19T09:09:30.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.183+0000 7f247effd640 10 client.18384 handle_command_reply: tid=0 2024-09-19T09:09:30.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.183+0000 7f24a7c1f740 1 client.18384 shutdown 2024-09-19T09:09:30.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.183+0000 7f24a7c1f740 1 -- 172.21.15.92:0/2895960152 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a55cbc4a0 msgr2=0x555a55cc6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:30.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.183+0000 7f24a7c1f740 1 --2- 172.21.15.92:0/2895960152 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a55cbc4a0 0x555a55cc6f90 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f2490000f80 tx=0x7f2490011670 comp rx=0 tx=0).stop 2024-09-19T09:09:30.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.183+0000 7f24a7c1f740 1 -- 172.21.15.92:0/2895960152 shutdown_connections 2024-09-19T09:09:30.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.183+0000 7f24a7c1f740 1 --2- 172.21.15.92:0/2895960152 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555a55cd7090 0x555a55cd9480 crc :-1 s=READY pgs=384 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.183+0000 7f24a7c1f740 1 --2- 172.21.15.92:0/2895960152 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555a55cc7680 0x555a55cc4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.183+0000 7f24a7c1f740 1 --2- 172.21.15.92:0/2895960152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a55cbcdc0 0x555a55cc4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.183+0000 7f24a7c1f740 1 --2- 172.21.15.92:0/2895960152 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a55cbc4a0 0x555a55cc6f90 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.183+0000 7f247effd640 0 client.18384 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:30.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.183+0000 7f24a7c1f740 1 -- 172.21.15.92:0/2895960152 >> 172.21.15.92:0/2895960152 conn(0x555a55cb8a30 msgr2=0x555a55cb7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:30.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.183+0000 7f24a7c1f740 1 -- 172.21.15.92:0/2895960152 shutdown_connections 2024-09-19T09:09:30.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.183+0000 7f24a7c1f740 1 -- 172.21.15.92:0/2895960152 wait complete. 2024-09-19T09:09:30.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.183+0000 7f24a7c1f740 20 client.18384 trim_cache size 0 max 16384 2024-09-19T09:09:30.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.219+0000 7f24a7c1f740 1 Processor -- start 2024-09-19T09:09:30.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.219+0000 7f24a7c1f740 1 -- start start 2024-09-19T09:09:30.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.219+0000 7f24a7c1f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a55cbc4a0 0x555a55cc3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.219+0000 7f24a7c1f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555a55cbcdc0 0x555a55cc4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.219+0000 7f24a7c1f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a55cc7680 0x555a55cdc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.219+0000 7f24a7c1f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f24a01ad8f0 con 0x555a55cc7680 2024-09-19T09:09:30.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.219+0000 7f24a7c1f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f24a01b0190 con 0x555a55cbc4a0 2024-09-19T09:09:30.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.219+0000 7f24a7c1f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f24a01adf80 con 0x555a55cbcdc0 2024-09-19T09:09:30.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.220+0000 7f249f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a55cc7680 0x555a55cdc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:30.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.220+0000 7f249f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a55cc7680 0x555a55cdc4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52058/0 (socket says 172.21.15.92:52058) 2024-09-19T09:09:30.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.220+0000 7f249f7fe640 1 -- 172.21.15.92:0/439647358 learned_addr learned my addr 172.21.15.92:0/439647358 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:30.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.220+0000 7f249effd640 1 --2- 172.21.15.92:0/439647358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a55cbc4a0 0x555a55cc3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:30.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.220+0000 7f249e7fc640 1 --2- 172.21.15.92:0/439647358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555a55cbcdc0 0x555a55cc4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:30.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.220+0000 7f249f7fe640 1 -- 172.21.15.92:0/439647358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555a55cbcdc0 msgr2=0x555a55cc4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:30.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.220+0000 7f249f7fe640 1 --2- 172.21.15.92:0/439647358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555a55cbcdc0 0x555a55cc4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.220+0000 7f249f7fe640 1 -- 172.21.15.92:0/439647358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a55cbc4a0 msgr2=0x555a55cc3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:30.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.220+0000 7f249f7fe640 1 --2- 172.21.15.92:0/439647358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a55cbc4a0 0x555a55cc3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.220+0000 7f249f7fe640 1 -- 172.21.15.92:0/439647358 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a55cc9da0 con 0x555a55cc7680 2024-09-19T09:09:30.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.220+0000 7f249f7fe640 1 --2- 172.21.15.92:0/439647358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a55cc7680 0x555a55cdc4a0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f24980ccd90 tx=0x7f2498004f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b66893de3dec3ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:30.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.220+0000 7f24957fa640 1 -- 172.21.15.92:0/439647358 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2498020040 con 0x555a55cc7680 2024-09-19T09:09:30.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.220+0000 7f24957fa640 1 -- 172.21.15.92:0/439647358 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f249809b8b0 con 0x555a55cc7680 2024-09-19T09:09:30.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.220+0000 7f24957fa640 1 -- 172.21.15.92:0/439647358 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249809cbe0 con 0x555a55cc7680 2024-09-19T09:09:30.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.221+0000 7f24a7c1f740 1 -- 172.21.15.92:0/439647358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a55cc7680 msgr2=0x555a55cdc4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:30.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.221+0000 7f24a7c1f740 1 --2- 172.21.15.92:0/439647358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a55cc7680 0x555a55cdc4a0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f24980ccd90 tx=0x7f2498004f40 comp rx=0 tx=0).stop 2024-09-19T09:09:30.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.221+0000 7f24a7c1f740 1 -- 172.21.15.92:0/439647358 shutdown_connections 2024-09-19T09:09:30.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.221+0000 7f24a7c1f740 1 --2- 172.21.15.92:0/439647358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a55cc7680 0x555a55cdc4a0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.221+0000 7f24a7c1f740 1 --2- 172.21.15.92:0/439647358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555a55cbcdc0 0x555a55cc4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.221+0000 7f24a7c1f740 1 --2- 172.21.15.92:0/439647358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a55cbc4a0 0x555a55cc3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.221+0000 7f24a7c1f740 1 -- 172.21.15.92:0/439647358 >> 172.21.15.92:0/439647358 conn(0x555a55cb8a30 msgr2=0x555a55cbf900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:30.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.221+0000 7f24a7c1f740 1 -- 172.21.15.92:0/439647358 shutdown_connections 2024-09-19T09:09:30.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.221+0000 7f24a7c1f740 1 -- 172.21.15.92:0/439647358 wait complete. 2024-09-19T09:09:30.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.221+0000 7f24a7c1f740 1 -- start start 2024-09-19T09:09:30.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.222+0000 7f24a7c1f740 1 Processor -- start 2024-09-19T09:09:30.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.222+0000 7f24a7c1f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555a55cbc4a0 0x555a55cdcd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.222+0000 7f24a7c1f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a55cbcdc0 0x555a55cda0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.222+0000 7f24a7c1f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a55cc7680 0x555a55cda840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.222+0000 7f24a7c1f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f24a01ae650 con 0x555a55cbcdc0 2024-09-19T09:09:30.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.222+0000 7f24a7c1f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f24a01afac0 con 0x555a55cc7680 2024-09-19T09:09:30.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.222+0000 7f24a7c1f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f24a01aed20 con 0x555a55cbc4a0 2024-09-19T09:09:30.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.222+0000 7f249e7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a55cbcdc0 0x555a55cda0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:30.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.222+0000 7f24a7c1f740 10 client.0 _ll_register_callbacks cb 0x7f2488009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:09:30.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.222+0000 7f249e7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a55cbcdc0 0x555a55cda0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52062/0 (socket says 172.21.15.92:52062) 2024-09-19T09:09:30.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.222+0000 7f249e7fc640 1 -- 172.21.15.92:0/285043144 learned_addr learned my addr 172.21.15.92:0/285043144 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:30.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.222+0000 7f249effd640 1 --2- 172.21.15.92:0/285043144 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555a55cbc4a0 0x555a55cdcd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:30.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.223+0000 7f249f7fe640 1 --2- 172.21.15.92:0/285043144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a55cc7680 0x555a55cda840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:30.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.223+0000 7f249e7fc640 1 -- 172.21.15.92:0/285043144 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555a55cbc4a0 msgr2=0x555a55cdcd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:30.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.223+0000 7f249e7fc640 1 --2- 172.21.15.92:0/285043144 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555a55cbc4a0 0x555a55cdcd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.223+0000 7f249e7fc640 1 -- 172.21.15.92:0/285043144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a55cc7680 msgr2=0x555a55cda840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:30.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.223+0000 7f249e7fc640 1 --2- 172.21.15.92:0/285043144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a55cc7680 0x555a55cda840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.223+0000 7f249e7fc640 1 -- 172.21.15.92:0/285043144 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a55d409d0 con 0x555a55cbcdc0 2024-09-19T09:09:30.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.223+0000 7f249effd640 1 --2- 172.21.15.92:0/285043144 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555a55cbc4a0 0x555a55cdcd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:09:30.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.223+0000 7f249e7fc640 1 --2- 172.21.15.92:0/285043144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a55cbcdc0 0x555a55cda0b0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f2488031550 tx=0x7f2488009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59e2a574f630159e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:30.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.223+0000 7f247effd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:09:30.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.223+0000 7f247effd640 1 -- 172.21.15.92:0/285043144 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24880037f0 con 0x555a55cbcdc0 2024-09-19T09:09:30.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.223+0000 7f247effd640 1 -- 172.21.15.92:0/285043144 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2488003990 con 0x555a55cbcdc0 2024-09-19T09:09:30.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.223+0000 7f24a7c1f740 1 -- 172.21.15.92:0/285043144 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f249809b8b0 con 0x555a55cbcdc0 2024-09-19T09:09:30.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.223+0000 7f247effd640 1 -- 172.21.15.92:0/285043144 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2488003b90 con 0x555a55cbcdc0 2024-09-19T09:09:30.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.223+0000 7f24a7c1f740 10 client.18390 fetch_fsmap learned FSMap version 19 2024-09-19T09:09:30.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.223+0000 7f24a7c1f740 1 -- 172.21.15.92:0/285043144 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x555a55d41ba0 con 0x555a55cbcdc0 2024-09-19T09:09:30.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.224+0000 7f247effd640 1 -- 172.21.15.92:0/285043144 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f249809b8b0 con 0x555a55cbcdc0 2024-09-19T09:09:30.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.224+0000 7f247effd640 1 -- 172.21.15.92:0/285043144 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f248803a040 con 0x555a55cbcdc0 2024-09-19T09:09:30.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.224+0000 7f24a7c1f740 10 client.18390 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:09:30.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.224+0000 7f24a7c1f740 10 client.18390 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:09:30.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.224+0000 7f24a7c1f740 20 client.18390 populate_metadata read hostname 'smithi092' 2024-09-19T09:09:30.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.224+0000 7f24a7c1f740 1 --2- 172.21.15.92:0/285043144 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555a55d422f0 0x555a55d44710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.224+0000 7f24a7c1f740 4 client.18390 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:09:30.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.224+0000 7f24a7c1f740 1 -- 172.21.15.92:0/285043144 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555a55c29d60 con 0x555a55d422f0 2024-09-19T09:09:30.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.224+0000 7f249effd640 1 --2- 172.21.15.92:0/285043144 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555a55d422f0 0x555a55d44710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:30.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.225+0000 7f247effd640 10 client.18390 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:30.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.225+0000 7f249effd640 1 --2- 172.21.15.92:0/285043144 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555a55d422f0 0x555a55d44710 crc :-1 s=READY pgs=385 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9679890bb076a59 server_cookie=ef505f18cde90fd7 in_seq=0 out_seq=0 2024-09-19T09:09:30.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.225+0000 7f247effd640 1 -- 172.21.15.92:0/285043144 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x555a55c29d60 con 0x555a55d422f0 2024-09-19T09:09:30.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.225+0000 7f247effd640 10 client.18390 handle_command_reply: tid=0 2024-09-19T09:09:30.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.225+0000 7f24a7c1f740 1 client.18390 shutdown 2024-09-19T09:09:30.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.225+0000 7f24a7c1f740 1 -- 172.21.15.92:0/285043144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a55cbcdc0 msgr2=0x555a55cda0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:30.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.225+0000 7f24a7c1f740 1 --2- 172.21.15.92:0/285043144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a55cbcdc0 0x555a55cda0b0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f2488031550 tx=0x7f2488009260 comp rx=0 tx=0).stop 2024-09-19T09:09:30.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.225+0000 7f24a7c1f740 1 -- 172.21.15.92:0/285043144 shutdown_connections 2024-09-19T09:09:30.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.225+0000 7f24a7c1f740 1 --2- 172.21.15.92:0/285043144 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555a55d422f0 0x555a55d44710 crc :-1 s=READY pgs=385 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.225+0000 7f24a7c1f740 1 --2- 172.21.15.92:0/285043144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555a55cc7680 0x555a55cda840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.225+0000 7f24a7c1f740 1 --2- 172.21.15.92:0/285043144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a55cbcdc0 0x555a55cda0b0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.225+0000 7f24a7c1f740 1 --2- 172.21.15.92:0/285043144 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555a55cbc4a0 0x555a55cdcd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.225+0000 7f24a7c1f740 1 -- 172.21.15.92:0/285043144 >> 172.21.15.92:0/285043144 conn(0x555a55cb8a30 msgr2=0x555a55cc5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:30.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.225+0000 7f247effd640 0 client.18390 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:30.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.225+0000 7f24a7c1f740 1 -- 172.21.15.92:0/285043144 shutdown_connections 2024-09-19T09:09:30.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.225+0000 7f24a7c1f740 1 -- 172.21.15.92:0/285043144 wait complete. 2024-09-19T09:09:30.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.225+0000 7f24a7c1f740 20 client.18390 trim_cache size 0 max 16384 2024-09-19T09:09:30.232 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:09:30.232 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-19T09:09:30.232 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {} 2024-09-19T09:09:30.232 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:09:30.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.226+0000 7f24a5846640 1 -- 172.21.15.92:0/2390660315 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f248c0a3240 msgr2=0x7f248c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:30.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.226+0000 7f24a5846640 1 --2- 172.21.15.92:0/2390660315 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f248c0a3240 0x7f248c0a5700 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f2488005ab0 tx=0x7f2488000bc0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.226+0000 7f24a5846640 1 -- 172.21.15.92:0/2390660315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24a010e480 msgr2=0x7f24a019ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:30.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.226+0000 7f24a5846640 1 --2- 172.21.15.92:0/2390660315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24a010e480 0x7f24a019ef50 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f249800d6a0 tx=0x7f249800db60 comp rx=0 tx=0).stop 2024-09-19T09:09:30.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.226+0000 7f24a5846640 1 -- 172.21.15.92:0/2390660315 shutdown_connections 2024-09-19T09:09:30.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.226+0000 7f24a5846640 1 --2- 172.21.15.92:0/2390660315 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f248c0a3240 0x7f248c0a5700 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.226+0000 7f24a5846640 1 --2- 172.21.15.92:0/2390660315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24a010e480 0x7f24a019ef50 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.226+0000 7f24a5846640 1 --2- 172.21.15.92:0/2390660315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24a0101280 0x7f24a019abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.226+0000 7f24a5846640 1 --2- 172.21.15.92:0/2390660315 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24a01008d0 0x7f24a019a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.226+0000 7f24a5846640 1 -- 172.21.15.92:0/2390660315 >> 172.21.15.92:0/2390660315 conn(0x7f24a00fc7a0 msgr2=0x7f24a00feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:30.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.226+0000 7f24a5846640 1 -- 172.21.15.92:0/2390660315 shutdown_connections 2024-09-19T09:09:30.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:30.226+0000 7f24a5846640 1 -- 172.21.15.92:0/2390660315 wait complete. 2024-09-19T09:09:30.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.278+0000 7fe89f20a640 1 -- 172.21.15.92:0/1147171781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe898101b60 msgr2=0x7fe898101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:30.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.278+0000 7fe89f20a640 1 --2- 172.21.15.92:0/1147171781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe898101b60 0x7fe898101f60 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fe88c009900 tx=0x7fe88c02a410 comp rx=0 tx=0).stop 2024-09-19T09:09:30.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.278+0000 7fe89f20a640 1 -- 172.21.15.92:0/1147171781 shutdown_connections 2024-09-19T09:09:30.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.278+0000 7fe89f20a640 1 --2- 172.21.15.92:0/1147171781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe898103710 0x7fe898109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.278+0000 7fe89f20a640 1 --2- 172.21.15.92:0/1147171781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe898102d50 0x7fe8981031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.278+0000 7fe89f20a640 1 --2- 172.21.15.92:0/1147171781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe898101b60 0x7fe898101f60 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.278+0000 7fe89f20a640 1 -- 172.21.15.92:0/1147171781 >> 172.21.15.92:0/1147171781 conn(0x7fe8980fd2e0 msgr2=0x7fe8980ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.278+0000 7fe89f20a640 1 -- 172.21.15.92:0/1147171781 shutdown_connections 2024-09-19T09:09:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.278+0000 7fe89f20a640 1 -- 172.21.15.92:0/1147171781 wait complete. 2024-09-19T09:09:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.278+0000 7fe89f20a640 1 Processor -- start 2024-09-19T09:09:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.278+0000 7fe89f20a640 1 -- start start 2024-09-19T09:09:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.279+0000 7fe89f20a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe898101b60 0x7fe898197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.279+0000 7fe89f20a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe898102d50 0x7fe898198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.279+0000 7fe89f20a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe898103710 0x7fe89819f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.279+0000 7fe89f20a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe89810d7e0 con 0x7fe898102d50 2024-09-19T09:09:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.279+0000 7fe89f20a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe89810d660 con 0x7fe898103710 2024-09-19T09:09:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.279+0000 7fe89f20a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe89810d960 con 0x7fe898101b60 2024-09-19T09:09:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.279+0000 7fe897fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe898102d50 0x7fe898198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.279+0000 7fe897fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe898102d50 0x7fe898198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52074/0 (socket says 172.21.15.92:52074) 2024-09-19T09:09:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.279+0000 7fe89cfa6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe898101b60 0x7fe898197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.279+0000 7fe897fff640 1 -- 172.21.15.92:0/1469618523 learned_addr learned my addr 172.21.15.92:0/1469618523 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.279+0000 7fe89d7a7640 1 --2- 172.21.15.92:0/1469618523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe898103710 0x7fe89819f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.279+0000 7fe897fff640 1 -- 172.21.15.92:0/1469618523 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe898101b60 msgr2=0x7fe898197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.279+0000 7fe897fff640 1 --2- 172.21.15.92:0/1469618523 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe898101b60 0x7fe898197e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.279+0000 7fe897fff640 1 -- 172.21.15.92:0/1469618523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe898103710 msgr2=0x7fe89819f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.279+0000 7fe897fff640 1 --2- 172.21.15.92:0/1469618523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe898103710 0x7fe89819f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.279+0000 7fe897fff640 1 -- 172.21.15.92:0/1469618523 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe89819fa20 con 0x7fe898102d50 2024-09-19T09:09:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.279+0000 7fe89d7a7640 1 --2- 172.21.15.92:0/1469618523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe898103710 0x7fe89819f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:09:30.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.279+0000 7fe89cfa6640 1 --2- 172.21.15.92:0/1469618523 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe898101b60 0x7fe898197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:09:30.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.279+0000 7fe897fff640 1 --2- 172.21.15.92:0/1469618523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe898102d50 0x7fe898198340 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fe88400e9f0 tx=0x7fe88400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:30.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.279+0000 7fe895ffb640 1 -- 172.21.15.92:0/1469618523 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88400cd80 con 0x7fe898102d50 2024-09-19T09:09:30.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.279+0000 7fe895ffb640 1 -- 172.21.15.92:0/1469618523 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe884010910 con 0x7fe898102d50 2024-09-19T09:09:30.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.279+0000 7fe895ffb640 1 -- 172.21.15.92:0/1469618523 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe884018990 con 0x7fe898102d50 2024-09-19T09:09:30.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.279+0000 7fe89f20a640 1 -- 172.21.15.92:0/1469618523 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe89819fd10 con 0x7fe898102d50 2024-09-19T09:09:30.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.280+0000 7fe89f20a640 1 -- 172.21.15.92:0/1469618523 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8981a0200 con 0x7fe898102d50 2024-09-19T09:09:30.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.282+0000 7fe895ffb640 1 -- 172.21.15.92:0/1469618523 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe884010ac0 con 0x7fe898102d50 2024-09-19T09:09:30.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.282+0000 7fe8a2076740 1 Processor -- start 2024-09-19T09:09:30.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.282+0000 7fe8a2076740 1 -- start start 2024-09-19T09:09:30.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.282+0000 7fe8a2076740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561d65f539a0 0x561d65f53da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.282+0000 7fe8a2076740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561d65f542e0 0x561d65f58da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.282+0000 7fe8a2076740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d65f59370 0x561d65f5b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.282+0000 7fe8a2076740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561d65eb72f0 con 0x561d65f542e0 2024-09-19T09:09:30.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.282+0000 7fe8a2076740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561d65e5f270 con 0x561d65f59370 2024-09-19T09:09:30.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.282+0000 7fe8a2076740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x561d65eb32b0 con 0x561d65f539a0 2024-09-19T09:09:30.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.282+0000 7fe89cfa6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561d65f542e0 0x561d65f58da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:30.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.282+0000 7fe89cfa6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561d65f542e0 0x561d65f58da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52078/0 (socket says 172.21.15.92:52078) 2024-09-19T09:09:30.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.282+0000 7fe89cfa6640 1 -- 172.21.15.92:0/3318441222 learned_addr learned my addr 172.21.15.92:0/3318441222 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:30.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.283+0000 7fe895ffb640 1 --2- 172.21.15.92:0/1469618523 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe8880a32f0 0x7fe8880a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.291 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.283+0000 7fe89d7a7640 1 --2- 172.21.15.92:0/3318441222 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561d65f539a0 0x561d65f53da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:30.291 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.283+0000 7fe897fff640 1 --2- 172.21.15.92:0/3318441222 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d65f59370 0x561d65f5b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:30.291 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.283+0000 7fe89d7a7640 1 --2- 172.21.15.92:0/1469618523 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe8880a32f0 0x7fe8880a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:30.291 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.283+0000 7fe89cfa6640 1 -- 172.21.15.92:0/3318441222 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561d65f539a0 msgr2=0x561d65f53da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:30.291 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.283+0000 7fe89cfa6640 1 --2- 172.21.15.92:0/3318441222 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561d65f539a0 0x561d65f53da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.291 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.283+0000 7fe89cfa6640 1 -- 172.21.15.92:0/3318441222 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d65f59370 msgr2=0x561d65f5b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:30.291 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.283+0000 7fe89cfa6640 1 --2- 172.21.15.92:0/3318441222 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d65f59370 0x561d65f5b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.291 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.283+0000 7fe89cfa6640 1 -- 172.21.15.92:0/3318441222 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d65e5e340 con 0x561d65f542e0 2024-09-19T09:09:30.291 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.283+0000 7fe895ffb640 1 -- 172.21.15.92:0/1469618523 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe8840cfcb0 con 0x7fe898102d50 2024-09-19T09:09:30.291 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.283+0000 7fe89cfa6640 1 --2- 172.21.15.92:0/3318441222 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561d65f542e0 0x561d65f58da0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fe898102bb0 tx=0x7fe88c005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88bdc2e4a1ceff7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:30.291 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.283+0000 7fe89d7a7640 1 --2- 172.21.15.92:0/1469618523 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe8880a32f0 0x7fe8880a57b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe890005c40 tx=0x7fe890009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:30.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.283+0000 7fe882ffd640 1 -- 172.21.15.92:0/3318441222 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88c040070 con 0x561d65f542e0 2024-09-19T09:09:30.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.283+0000 7fe882ffd640 1 -- 172.21.15.92:0/3318441222 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe88c0319b0 con 0x561d65f542e0 2024-09-19T09:09:30.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.283+0000 7fe882ffd640 1 -- 172.21.15.92:0/3318441222 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88c035040 con 0x561d65f542e0 2024-09-19T09:09:30.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.284+0000 7fe8a2076740 1 -- 172.21.15.92:0/3318441222 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561d65f542e0 msgr2=0x561d65f58da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:30.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.284+0000 7fe8a2076740 1 --2- 172.21.15.92:0/3318441222 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561d65f542e0 0x561d65f58da0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fe898102bb0 tx=0x7fe88c005de0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.284+0000 7fe8a2076740 1 -- 172.21.15.92:0/3318441222 shutdown_connections 2024-09-19T09:09:30.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.284+0000 7fe8a2076740 1 --2- 172.21.15.92:0/3318441222 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d65f59370 0x561d65f5b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.284+0000 7fe8a2076740 1 --2- 172.21.15.92:0/3318441222 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561d65f542e0 0x561d65f58da0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.284+0000 7fe8a2076740 1 --2- 172.21.15.92:0/3318441222 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561d65f539a0 0x561d65f53da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.284+0000 7fe8a2076740 1 -- 172.21.15.92:0/3318441222 >> 172.21.15.92:0/3318441222 conn(0x561d65f4f010 msgr2=0x561d65f4f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:30.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.284+0000 7fe8a2076740 1 -- 172.21.15.92:0/3318441222 shutdown_connections 2024-09-19T09:09:30.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.284+0000 7fe8a2076740 1 -- 172.21.15.92:0/3318441222 wait complete. 2024-09-19T09:09:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.284+0000 7fe8a2076740 1 -- start start 2024-09-19T09:09:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.284+0000 7fe8a2076740 1 Processor -- start 2024-09-19T09:09:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.285+0000 7fe8a2076740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561d65f539a0 0x561d65f5dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.285+0000 7fe8a2076740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d65f542e0 0x561d65f5e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.285+0000 7fe8a2076740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561d65f59370 0x561d65f65180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.285+0000 7fe8a2076740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561d65f5c2e0 con 0x561d65f59370 2024-09-19T09:09:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.285+0000 7fe8a2076740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561d65e40290 con 0x561d65f542e0 2024-09-19T09:09:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.285+0000 7fe8a2076740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x561d65f5c460 con 0x561d65f539a0 2024-09-19T09:09:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.285+0000 7fe8a2076740 10 client.0 _ll_register_callbacks cb 0x561d65e71140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:09:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.285+0000 7fe89d7a7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561d65f59370 0x561d65f65180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.285+0000 7fe89d7a7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561d65f59370 0x561d65f65180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52090/0 (socket says 172.21.15.92:52090) 2024-09-19T09:09:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.285+0000 7fe89d7a7640 1 -- 172.21.15.92:0/860088586 learned_addr learned my addr 172.21.15.92:0/860088586 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.285+0000 7fe89cfa6640 1 --2- 172.21.15.92:0/860088586 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561d65f539a0 0x561d65f5dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:30.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.285+0000 7fe897fff640 1 --2- 172.21.15.92:0/860088586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d65f542e0 0x561d65f5e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:30.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.285+0000 7fe89d7a7640 1 -- 172.21.15.92:0/860088586 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561d65f539a0 msgr2=0x561d65f5dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:30.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.285+0000 7fe89d7a7640 1 --2- 172.21.15.92:0/860088586 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561d65f539a0 0x561d65f5dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.285+0000 7fe89d7a7640 1 -- 172.21.15.92:0/860088586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d65f542e0 msgr2=0x561d65f5e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:30.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.285+0000 7fe89d7a7640 1 --2- 172.21.15.92:0/860088586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d65f542e0 0x561d65f5e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.285+0000 7fe89d7a7640 1 -- 172.21.15.92:0/860088586 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d65bca210 con 0x561d65f59370 2024-09-19T09:09:30.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.285+0000 7fe89d7a7640 1 --2- 172.21.15.92:0/860088586 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561d65f59370 0x561d65f65180 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fe89000ee40 tx=0x7fe890004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1898d58a5173f46b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:30.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.285+0000 7fe877fff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:09:30.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.285+0000 7fe877fff640 1 -- 172.21.15.92:0/860088586 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe890018070 con 0x561d65f59370 2024-09-19T09:09:30.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.285+0000 7fe877fff640 1 -- 172.21.15.92:0/860088586 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe89001e840 con 0x561d65f59370 2024-09-19T09:09:30.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.285+0000 7fe8a2076740 1 -- 172.21.15.92:0/860088586 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe88c0319b0 con 0x561d65f59370 2024-09-19T09:09:30.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.286+0000 7fe877fff640 1 -- 172.21.15.92:0/860088586 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe89000fe30 con 0x561d65f59370 2024-09-19T09:09:30.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.286+0000 7fe8a2076740 10 client.18402 fetch_fsmap learned FSMap version 19 2024-09-19T09:09:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.286+0000 7fe8a2076740 1 -- 172.21.15.92:0/860088586 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x561d65c96620 con 0x561d65f59370 2024-09-19T09:09:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.286+0000 7fe877fff640 1 -- 172.21.15.92:0/860088586 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe88c0319b0 con 0x561d65f59370 2024-09-19T09:09:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.286+0000 7fe877fff640 1 -- 172.21.15.92:0/860088586 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe89001fc00 con 0x561d65f59370 2024-09-19T09:09:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.286+0000 7fe8a2076740 10 client.18402 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:09:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.286+0000 7fe8a2076740 10 client.18402 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:09:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.286+0000 7fe8a2076740 20 client.18402 populate_metadata read hostname 'smithi092' 2024-09-19T09:09:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.286+0000 7fe8a2076740 1 --2- 172.21.15.92:0/860088586 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561d65f698f0 0x561d65f6bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.286+0000 7fe8a2076740 4 client.18402 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:09:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.286+0000 7fe8a2076740 1 -- 172.21.15.92:0/860088586 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d65ec4a20 con 0x561d65f698f0 2024-09-19T09:09:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.286+0000 7fe89cfa6640 1 --2- 172.21.15.92:0/860088586 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561d65f698f0 0x561d65f6bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.287+0000 7fe877fff640 10 client.18402 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.287+0000 7fe89cfa6640 1 --2- 172.21.15.92:0/860088586 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561d65f698f0 0x561d65f6bd20 crc :-1 s=READY pgs=386 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84e7ef6b1a9149cd server_cookie=3eaa4e42c347abf2 in_seq=0 out_seq=0 2024-09-19T09:09:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.287+0000 7fe877fff640 1 -- 172.21.15.92:0/860088586 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561d65ec4a20 con 0x561d65f698f0 2024-09-19T09:09:30.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.287+0000 7fe877fff640 10 client.18402 handle_command_reply: tid=0 2024-09-19T09:09:30.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.287+0000 7fe8a2076740 1 client.18402 shutdown 2024-09-19T09:09:30.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.287+0000 7fe8a2076740 1 -- 172.21.15.92:0/860088586 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561d65f59370 msgr2=0x561d65f65180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:30.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.287+0000 7fe8a2076740 1 --2- 172.21.15.92:0/860088586 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561d65f59370 0x561d65f65180 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fe89000ee40 tx=0x7fe890004a40 comp rx=0 tx=0).stop 2024-09-19T09:09:30.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.287+0000 7fe8a2076740 1 -- 172.21.15.92:0/860088586 shutdown_connections 2024-09-19T09:09:30.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.287+0000 7fe8a2076740 1 --2- 172.21.15.92:0/860088586 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561d65f698f0 0x561d65f6bd20 crc :-1 s=READY pgs=386 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.287+0000 7fe8a2076740 1 --2- 172.21.15.92:0/860088586 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561d65f59370 0x561d65f65180 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.287+0000 7fe8a2076740 1 --2- 172.21.15.92:0/860088586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d65f542e0 0x561d65f5e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.287+0000 7fe877fff640 0 client.18402 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:30.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.287+0000 7fe8a2076740 1 --2- 172.21.15.92:0/860088586 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561d65f539a0 0x561d65f5dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.287+0000 7fe8a2076740 1 -- 172.21.15.92:0/860088586 >> 172.21.15.92:0/860088586 conn(0x561d65f4f010 msgr2=0x561d65f50820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:30.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.288+0000 7fe8a2076740 1 -- 172.21.15.92:0/860088586 shutdown_connections 2024-09-19T09:09:30.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.288+0000 7fe8a2076740 1 -- 172.21.15.92:0/860088586 wait complete. 2024-09-19T09:09:30.297 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.288+0000 7fe8a2076740 20 client.18402 trim_cache size 0 max 16384 2024-09-19T09:09:30.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.302+0000 7fe8a2076740 1 Processor -- start 2024-09-19T09:09:30.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.302+0000 7fe8a2076740 1 -- start start 2024-09-19T09:09:30.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.302+0000 7fe8a2076740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561d65f539a0 0x561d65f53d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.302+0000 7fe8a2076740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d65f542e0 0x561d65f65140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.302+0000 7fe8a2076740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561d65f59370 0x561d65f4e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.302+0000 7fe8a2076740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe8981a7030 con 0x561d65f539a0 2024-09-19T09:09:30.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.302+0000 7fe8a2076740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe8981a98d0 con 0x561d65f542e0 2024-09-19T09:09:30.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.302+0000 7fe8a2076740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe8981a76c0 con 0x561d65f59370 2024-09-19T09:09:30.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.302+0000 7fe89cfa6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561d65f539a0 0x561d65f53d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:30.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.302+0000 7fe89cfa6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561d65f539a0 0x561d65f53d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52100/0 (socket says 172.21.15.92:52100) 2024-09-19T09:09:30.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.302+0000 7fe89cfa6640 1 -- 172.21.15.92:0/3566421085 learned_addr learned my addr 172.21.15.92:0/3566421085 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:30.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.302+0000 7fe89cfa6640 1 -- 172.21.15.92:0/3566421085 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561d65f59370 msgr2=0x561d65f4e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:30.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.302+0000 7fe89cfa6640 1 --2- 172.21.15.92:0/3566421085 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561d65f59370 0x561d65f4e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.302+0000 7fe897fff640 1 --2- 172.21.15.92:0/3566421085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d65f542e0 0x561d65f65140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:30.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.302+0000 7fe89cfa6640 1 -- 172.21.15.92:0/3566421085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d65f542e0 msgr2=0x561d65f65140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:30.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.302+0000 7fe89cfa6640 1 --2- 172.21.15.92:0/3566421085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d65f542e0 0x561d65f65140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.302+0000 7fe89cfa6640 1 -- 172.21.15.92:0/3566421085 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d65f4ee30 con 0x561d65f539a0 2024-09-19T09:09:30.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.302+0000 7fe89cfa6640 1 --2- 172.21.15.92:0/3566421085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561d65f539a0 0x561d65f53d80 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fe898102bb0 tx=0x7fe88c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c9c985107373211 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:30.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.303+0000 7fe8827fc640 1 -- 172.21.15.92:0/3566421085 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88c035040 con 0x561d65f539a0 2024-09-19T09:09:30.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.303+0000 7fe8827fc640 1 -- 172.21.15.92:0/3566421085 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe88c0035f0 con 0x561d65f539a0 2024-09-19T09:09:30.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.303+0000 7fe8827fc640 1 -- 172.21.15.92:0/3566421085 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88c040040 con 0x561d65f539a0 2024-09-19T09:09:30.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.303+0000 7fe8a2076740 1 -- 172.21.15.92:0/3566421085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561d65f539a0 msgr2=0x561d65f53d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:30.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.303+0000 7fe8a2076740 1 --2- 172.21.15.92:0/3566421085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561d65f539a0 0x561d65f53d80 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fe898102bb0 tx=0x7fe88c02a410 comp rx=0 tx=0).stop 2024-09-19T09:09:30.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.303+0000 7fe8a2076740 1 -- 172.21.15.92:0/3566421085 shutdown_connections 2024-09-19T09:09:30.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.303+0000 7fe8a2076740 1 --2- 172.21.15.92:0/3566421085 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561d65f59370 0x561d65f4e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.303+0000 7fe8a2076740 1 --2- 172.21.15.92:0/3566421085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d65f542e0 0x561d65f65140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.303+0000 7fe8a2076740 1 --2- 172.21.15.92:0/3566421085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561d65f539a0 0x561d65f53d80 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.303+0000 7fe8a2076740 1 -- 172.21.15.92:0/3566421085 >> 172.21.15.92:0/3566421085 conn(0x561d65f4f010 msgr2=0x561d65f4d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:30.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.303+0000 7fe8a2076740 1 -- 172.21.15.92:0/3566421085 shutdown_connections 2024-09-19T09:09:30.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.303+0000 7fe8a2076740 1 -- 172.21.15.92:0/3566421085 wait complete. 2024-09-19T09:09:30.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.304+0000 7fe8a2076740 1 -- start start 2024-09-19T09:09:30.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.304+0000 7fe8a2076740 1 Processor -- start 2024-09-19T09:09:30.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.304+0000 7fe8a2076740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561d65f539a0 0x561d65f62440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.304+0000 7fe8a2076740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561d65f542e0 0x561d65f62980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.304+0000 7fe8a2076740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d65f59370 0x561d65f63940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.304+0000 7fe8a2076740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe8981a7d90 con 0x561d65f539a0 2024-09-19T09:09:30.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.304+0000 7fe8a2076740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe8981a9200 con 0x561d65f59370 2024-09-19T09:09:30.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.304+0000 7fe8a2076740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe8981a8460 con 0x561d65f542e0 2024-09-19T09:09:30.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.304+0000 7fe8a2076740 10 client.0 _ll_register_callbacks cb 0x7fe89000eaf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:09:30.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.304+0000 7fe89cfa6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561d65f539a0 0x561d65f62440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:30.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.304+0000 7fe89cfa6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561d65f539a0 0x561d65f62440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52108/0 (socket says 172.21.15.92:52108) 2024-09-19T09:09:30.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.304+0000 7fe89cfa6640 1 -- 172.21.15.92:0/374930214 learned_addr learned my addr 172.21.15.92:0/374930214 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:30.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.304+0000 7fe897fff640 1 --2- 172.21.15.92:0/374930214 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561d65f542e0 0x561d65f62980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:30.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.304+0000 7fe89cfa6640 1 -- 172.21.15.92:0/374930214 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561d65f542e0 msgr2=0x561d65f62980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.304+0000 7fe89cfa6640 1 --2- 172.21.15.92:0/374930214 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561d65f542e0 0x561d65f62980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.304+0000 7fe89cfa6640 1 -- 172.21.15.92:0/374930214 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d65f59370 msgr2=0x561d65f63940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.304+0000 7fe89cfa6640 1 --2- 172.21.15.92:0/374930214 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d65f59370 0x561d65f63940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.304+0000 7fe89cfa6640 1 -- 172.21.15.92:0/374930214 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d65f63f50 con 0x561d65f539a0 2024-09-19T09:09:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.305+0000 7fe89cfa6640 1 --2- 172.21.15.92:0/374930214 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561d65f539a0 0x561d65f62440 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fe88c004010 tx=0x7fe88c005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffcb2e82698c11bd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.305+0000 7fe877fff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:09:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.305+0000 7fe877fff640 1 -- 172.21.15.92:0/374930214 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88c05c020 con 0x561d65f539a0 2024-09-19T09:09:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.305+0000 7fe877fff640 1 -- 172.21.15.92:0/374930214 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fe88c0039a0 con 0x561d65f539a0 2024-09-19T09:09:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.305+0000 7fe8a2076740 1 -- 172.21.15.92:0/374930214 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe88c0035f0 con 0x561d65f539a0 2024-09-19T09:09:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.305+0000 7fe877fff640 1 -- 172.21.15.92:0/374930214 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe88c035030 con 0x561d65f539a0 2024-09-19T09:09:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.305+0000 7fe8a2076740 10 client.18408 fetch_fsmap learned FSMap version 19 2024-09-19T09:09:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.305+0000 7fe8a2076740 1 -- 172.21.15.92:0/374930214 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x561d65f65260 con 0x561d65f539a0 2024-09-19T09:09:30.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.305+0000 7fe877fff640 1 -- 172.21.15.92:0/374930214 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe88c0035f0 con 0x561d65f539a0 2024-09-19T09:09:30.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.305+0000 7fe877fff640 1 -- 172.21.15.92:0/374930214 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe88c03c440 con 0x561d65f539a0 2024-09-19T09:09:30.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.305+0000 7fe8a2076740 10 client.18408 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:09:30.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.305+0000 7fe8a2076740 10 client.18408 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:09:30.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.305+0000 7fe8a2076740 20 client.18408 populate_metadata read hostname 'smithi092' 2024-09-19T09:09:30.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.305+0000 7fe8a2076740 1 --2- 172.21.15.92:0/374930214 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561d65fd4600 0x561d65fd69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.305+0000 7fe8a2076740 4 client.18408 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:09:30.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.305+0000 7fe8a2076740 1 -- 172.21.15.92:0/374930214 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561d65ebed70 con 0x561d65fd4600 2024-09-19T09:09:30.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.305+0000 7fe897fff640 1 --2- 172.21.15.92:0/374930214 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561d65fd4600 0x561d65fd69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:30.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.306+0000 7fe897fff640 1 --2- 172.21.15.92:0/374930214 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561d65fd4600 0x561d65fd69f0 crc :-1 s=READY pgs=387 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3c9a08de5747cc7 server_cookie=2ce7ae71093cf106 in_seq=0 out_seq=0 2024-09-19T09:09:30.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.306+0000 7fe877fff640 10 client.18408 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:30.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.324+0000 7fe877fff640 1 -- 172.21.15.92:0/374930214 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561d65ebed70 con 0x561d65fd4600 2024-09-19T09:09:30.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.324+0000 7fe877fff640 10 client.18408 handle_command_reply: tid=0 2024-09-19T09:09:30.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.324+0000 7fe8a2076740 1 client.18408 shutdown 2024-09-19T09:09:30.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.325+0000 7fe8a2076740 1 -- 172.21.15.92:0/374930214 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561d65f539a0 msgr2=0x561d65f62440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:30.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.325+0000 7fe8a2076740 1 --2- 172.21.15.92:0/374930214 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561d65f539a0 0x561d65f62440 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fe88c004010 tx=0x7fe88c005de0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.325+0000 7fe8a2076740 1 -- 172.21.15.92:0/374930214 shutdown_connections 2024-09-19T09:09:30.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.325+0000 7fe8a2076740 1 --2- 172.21.15.92:0/374930214 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561d65fd4600 0x561d65fd69f0 crc :-1 s=READY pgs=387 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.325+0000 7fe8a2076740 1 --2- 172.21.15.92:0/374930214 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d65f59370 0x561d65f63940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.325+0000 7fe8a2076740 1 --2- 172.21.15.92:0/374930214 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561d65f542e0 0x561d65f62980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.325+0000 7fe877fff640 0 client.18408 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:30.327 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.325+0000 7fe8a2076740 1 --2- 172.21.15.92:0/374930214 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561d65f539a0 0x561d65f62440 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.327 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.325+0000 7fe8a2076740 1 -- 172.21.15.92:0/374930214 >> 172.21.15.92:0/374930214 conn(0x561d65f4f010 msgr2=0x561d65f4d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:30.327 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.325+0000 7fe8a2076740 1 -- 172.21.15.92:0/374930214 shutdown_connections 2024-09-19T09:09:30.327 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.325+0000 7fe8a2076740 1 -- 172.21.15.92:0/374930214 wait complete. 2024-09-19T09:09:30.327 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.325+0000 7fe8a2076740 20 client.18408 trim_cache size 0 max 16384 2024-09-19T09:09:30.327 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:09:30.327 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:09:30.327 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:09:30.327 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:09:30.328 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.326+0000 7fe89f20a640 1 -- 172.21.15.92:0/1469618523 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe8880a32f0 msgr2=0x7fe8880a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:30.328 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.326+0000 7fe89f20a640 1 --2- 172.21.15.92:0/1469618523 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe8880a32f0 0x7fe8880a57b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe890005c40 tx=0x7fe890009500 comp rx=0 tx=0).stop 2024-09-19T09:09:30.328 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.326+0000 7fe89f20a640 1 -- 172.21.15.92:0/1469618523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe898102d50 msgr2=0x7fe898198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:30.328 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.326+0000 7fe89f20a640 1 --2- 172.21.15.92:0/1469618523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe898102d50 0x7fe898198340 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fe88400e9f0 tx=0x7fe88400eeb0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.326+0000 7fe89f20a640 1 -- 172.21.15.92:0/1469618523 shutdown_connections 2024-09-19T09:09:30.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.326+0000 7fe89f20a640 1 --2- 172.21.15.92:0/1469618523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe898103710 0x7fe89819f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.326+0000 7fe89f20a640 1 --2- 172.21.15.92:0/1469618523 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fe8880a32f0 0x7fe8880a57b0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.326+0000 7fe89f20a640 1 --2- 172.21.15.92:0/1469618523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe898102d50 0x7fe898198340 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.326+0000 7fe89f20a640 1 --2- 172.21.15.92:0/1469618523 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe898101b60 0x7fe898197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.326+0000 7fe89f20a640 1 -- 172.21.15.92:0/1469618523 >> 172.21.15.92:0/1469618523 conn(0x7fe8980fd2e0 msgr2=0x7fe898106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:30.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.326+0000 7fe89f20a640 1 -- 172.21.15.92:0/1469618523 shutdown_connections 2024-09-19T09:09:30.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:30.326+0000 7fe89f20a640 1 -- 172.21.15.92:0/1469618523 wait complete. 2024-09-19T09:09:30.800 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:09:31.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:30 smithi092 ceph-mon[31407]: pgmap v721: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.9 MiB/s wr, 201 op/s 2024-09-19T09:09:31.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:30 smithi167 ceph-mon[35359]: pgmap v721: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.9 MiB/s wr, 201 op/s 2024-09-19T09:09:31.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:30 smithi190 ceph-mon[35358]: pgmap v721: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.9 MiB/s wr, 201 op/s 2024-09-19T09:09:31.206 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:09:31.206 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:09:31.457 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:09:31.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.921+0000 7f9a993ed640 1 -- 172.21.15.92:0/3192091459 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a94101240 msgr2=0x7f9a94101680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:31.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.921+0000 7f9a993ed640 1 --2- 172.21.15.92:0/3192091459 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a94101240 0x7f9a94101680 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f9a84009900 tx=0x7f9a8402a410 comp rx=0 tx=0).stop 2024-09-19T09:09:31.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.921+0000 7f9a993ed640 1 -- 172.21.15.92:0/3192091459 shutdown_connections 2024-09-19T09:09:31.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.921+0000 7f9a993ed640 1 --2- 172.21.15.92:0/3192091459 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a94101bc0 0x7f9a9410d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:31.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.921+0000 7f9a993ed640 1 --2- 172.21.15.92:0/3192091459 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a94101240 0x7f9a94101680 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:31.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.921+0000 7f9a993ed640 1 --2- 172.21.15.92:0/3192091459 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a94105a90 0x7f9a94105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:31.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.921+0000 7f9a993ed640 1 -- 172.21.15.92:0/3192091459 >> 172.21.15.92:0/3192091459 conn(0x7f9a94077210 msgr2=0x7f9a940fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:31.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.921+0000 7f9a993ed640 1 -- 172.21.15.92:0/3192091459 shutdown_connections 2024-09-19T09:09:31.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.921+0000 7f9a993ed640 1 -- 172.21.15.92:0/3192091459 wait complete. 2024-09-19T09:09:31.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.922+0000 7f9a993ed640 1 Processor -- start 2024-09-19T09:09:31.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.922+0000 7f9a993ed640 1 -- start start 2024-09-19T09:09:31.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.922+0000 7f9a993ed640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a94101240 0x7f9a9419a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:31.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.922+0000 7f9a993ed640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a94101bc0 0x7f9a9419aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:31.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.922+0000 7f9a993ed640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a94105a90 0x7f9a9419ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:31.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.922+0000 7f9a993ed640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9a94110f70 con 0x7f9a94101240 2024-09-19T09:09:31.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.922+0000 7f9a993ed640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9a94110df0 con 0x7f9a94105a90 2024-09-19T09:09:31.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.922+0000 7f9a993ed640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9a941110f0 con 0x7f9a94101bc0 2024-09-19T09:09:31.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.922+0000 7f9a92ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a94101240 0x7f9a9419a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:31.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.922+0000 7f9a92ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a94101240 0x7f9a9419a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60454/0 (socket says 172.21.15.92:60454) 2024-09-19T09:09:31.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.922+0000 7f9a92ffd640 1 -- 172.21.15.92:0/3908585101 learned_addr learned my addr 172.21.15.92:0/3908585101 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:31.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.923+0000 7f9a927fc640 1 --2- 172.21.15.92:0/3908585101 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a94101bc0 0x7f9a9419aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:31.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.923+0000 7f9a937fe640 1 --2- 172.21.15.92:0/3908585101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a94105a90 0x7f9a9419ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:31.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.923+0000 7f9a92ffd640 1 -- 172.21.15.92:0/3908585101 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a94101bc0 msgr2=0x7f9a9419aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:31.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.923+0000 7f9a92ffd640 1 --2- 172.21.15.92:0/3908585101 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a94101bc0 0x7f9a9419aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:31.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.923+0000 7f9a92ffd640 1 -- 172.21.15.92:0/3908585101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a94105a90 msgr2=0x7f9a9419ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:31.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.923+0000 7f9a92ffd640 1 --2- 172.21.15.92:0/3908585101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a94105a90 0x7f9a9419ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:31.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.923+0000 7f9a92ffd640 1 -- 172.21.15.92:0/3908585101 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a9419f610 con 0x7f9a94101240 2024-09-19T09:09:31.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.923+0000 7f9a937fe640 1 --2- 172.21.15.92:0/3908585101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a94105a90 0x7f9a9419ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:09:31.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.923+0000 7f9a92ffd640 1 --2- 172.21.15.92:0/3908585101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a94101240 0x7f9a9419a660 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f9a8800cce0 tx=0x7f9a8800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:31.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.923+0000 7f9a7bfff640 1 -- 172.21.15.92:0/3908585101 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a88004b20 con 0x7f9a94101240 2024-09-19T09:09:31.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.923+0000 7f9a993ed640 1 -- 172.21.15.92:0/3908585101 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a9419f900 con 0x7f9a94101240 2024-09-19T09:09:31.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.923+0000 7f9a7bfff640 1 -- 172.21.15.92:0/3908585101 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a88004cc0 con 0x7f9a94101240 2024-09-19T09:09:31.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.923+0000 7f9a7bfff640 1 -- 172.21.15.92:0/3908585101 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a8800f7d0 con 0x7f9a94101240 2024-09-19T09:09:31.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.923+0000 7f9a993ed640 1 -- 172.21.15.92:0/3908585101 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a941a71e0 con 0x7f9a94101240 2024-09-19T09:09:31.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.924+0000 7f9a993ed640 1 -- 172.21.15.92:0/3908585101 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a94101680 con 0x7f9a94101240 2024-09-19T09:09:31.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.925+0000 7f9a7bfff640 1 -- 172.21.15.92:0/3908585101 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9a8800f970 con 0x7f9a94101240 2024-09-19T09:09:31.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.926+0000 7f9a7bfff640 1 --2- 172.21.15.92:0/3908585101 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9a7c0a3240 0x7f9a7c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:31.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.926+0000 7f9a927fc640 1 --2- 172.21.15.92:0/3908585101 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9a7c0a3240 0x7f9a7c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:31.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.926+0000 7f9a7bfff640 1 -- 172.21.15.92:0/3908585101 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f9a880cf9e0 con 0x7f9a94101240 2024-09-19T09:09:31.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.927+0000 7f9a927fc640 1 --2- 172.21.15.92:0/3908585101 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9a7c0a3240 0x7f9a7c0a5700 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f9a84009230 tx=0x7f9a840058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:31.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:31.931+0000 7f9a7bfff640 1 -- 172.21.15.92:0/3908585101 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9a88014030 con 0x7f9a94101240 2024-09-19T09:09:32.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:32.128+0000 7f9a993ed640 1 -- 172.21.15.92:0/3908585101 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a940fdcd0 con 0x7f9a94101240 2024-09-19T09:09:32.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:32.129+0000 7f9a7bfff640 1 -- 172.21.15.92:0/3908585101 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f9a8809c700 con 0x7f9a94101240 2024-09-19T09:09:32.130 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:09:32.130 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:09:32.130 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:09:32.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:32.131+0000 7f9a993ed640 1 -- 172.21.15.92:0/3908585101 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9a7c0a3240 msgr2=0x7f9a7c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:32.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:32.131+0000 7f9a993ed640 1 --2- 172.21.15.92:0/3908585101 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9a7c0a3240 0x7f9a7c0a5700 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f9a84009230 tx=0x7f9a840058d0 comp rx=0 tx=0).stop 2024-09-19T09:09:32.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:32.131+0000 7f9a993ed640 1 -- 172.21.15.92:0/3908585101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a94101240 msgr2=0x7f9a9419a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:32.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:32.131+0000 7f9a993ed640 1 --2- 172.21.15.92:0/3908585101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a94101240 0x7f9a9419a660 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f9a8800cce0 tx=0x7f9a8800a620 comp rx=0 tx=0).stop 2024-09-19T09:09:32.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:32.131+0000 7f9a993ed640 1 -- 172.21.15.92:0/3908585101 shutdown_connections 2024-09-19T09:09:32.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:32.131+0000 7f9a993ed640 1 --2- 172.21.15.92:0/3908585101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a94105a90 0x7f9a9419ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:32.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:32.131+0000 7f9a993ed640 1 --2- 172.21.15.92:0/3908585101 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a94101bc0 0x7f9a9419aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:32.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:32.131+0000 7f9a993ed640 1 --2- 172.21.15.92:0/3908585101 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f9a7c0a3240 0x7f9a7c0a5700 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:32.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:32.131+0000 7f9a993ed640 1 --2- 172.21.15.92:0/3908585101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a94101240 0x7f9a9419a660 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:32.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:32.131+0000 7f9a993ed640 1 -- 172.21.15.92:0/3908585101 >> 172.21.15.92:0/3908585101 conn(0x7f9a94077210 msgr2=0x7f9a94104b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:32.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:32.131+0000 7f9a993ed640 1 -- 172.21.15.92:0/3908585101 shutdown_connections 2024-09-19T09:09:32.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:32.131+0000 7f9a993ed640 1 -- 172.21.15.92:0/3908585101 wait complete. 2024-09-19T09:09:32.430 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:32 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3908585101' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:09:32.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:32 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3908585101' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:09:32.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:32 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3908585101' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:09:32.792 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:09:33.035 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:09:33.409 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:33 smithi092 ceph-mon[31407]: pgmap v722: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 973 KiB/s wr, 112 op/s 2024-09-19T09:09:33.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.414+0000 7f4577dfd640 1 -- 172.21.15.92:0/920961861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45701002f0 msgr2=0x7f45701006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:33.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.414+0000 7f4577dfd640 1 --2- 172.21.15.92:0/920961861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45701002f0 0x7f45701006d0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f456c009930 tx=0x7f456c02a420 comp rx=0 tx=0).stop 2024-09-19T09:09:33.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.414+0000 7f4577dfd640 1 -- 172.21.15.92:0/920961861 shutdown_connections 2024-09-19T09:09:33.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.414+0000 7f4577dfd640 1 --2- 172.21.15.92:0/920961861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4570106f50 0x7f457010eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:33.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.414+0000 7f4577dfd640 1 --2- 172.21.15.92:0/920961861 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4570100ca0 0x7f4570106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:33.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.414+0000 7f4577dfd640 1 --2- 172.21.15.92:0/920961861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45701002f0 0x7f45701006d0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:33.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.414+0000 7f4577dfd640 1 -- 172.21.15.92:0/920961861 >> 172.21.15.92:0/920961861 conn(0x7f4570077210 msgr2=0x7f45700fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:33.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.414+0000 7f4577dfd640 1 -- 172.21.15.92:0/920961861 shutdown_connections 2024-09-19T09:09:33.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.414+0000 7f4577dfd640 1 -- 172.21.15.92:0/920961861 wait complete. 2024-09-19T09:09:33.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.415+0000 7f4577dfd640 1 Processor -- start 2024-09-19T09:09:33.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.415+0000 7f4577dfd640 1 -- start start 2024-09-19T09:09:33.417 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.415+0000 7f4577dfd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45701002f0 0x7f45701984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:33.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.415+0000 7f4577dfd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4570100ca0 0x7f4570198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:33.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.415+0000 7f4577dfd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4570106f50 0x7f457019cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:33.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.415+0000 7f4577dfd640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4570112000 con 0x7f4570106f50 2024-09-19T09:09:33.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.415+0000 7f4577dfd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4570111e80 con 0x7f45701002f0 2024-09-19T09:09:33.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.415+0000 7f4577dfd640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4570112180 con 0x7f4570100ca0 2024-09-19T09:09:33.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.415+0000 7f457639a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4570106f50 0x7f457019cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:33.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.415+0000 7f4575b99640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45701002f0 0x7f45701984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:33.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.415+0000 7f457639a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4570106f50 0x7f457019cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60476/0 (socket says 172.21.15.92:60476) 2024-09-19T09:09:33.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.415+0000 7f457639a640 1 -- 172.21.15.92:0/1905619488 learned_addr learned my addr 172.21.15.92:0/1905619488 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:33.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.416+0000 7f4575398640 1 --2- 172.21.15.92:0/1905619488 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4570100ca0 0x7f4570198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:33.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.416+0000 7f457639a640 1 -- 172.21.15.92:0/1905619488 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4570100ca0 msgr2=0x7f4570198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:33.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.416+0000 7f457639a640 1 --2- 172.21.15.92:0/1905619488 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4570100ca0 0x7f4570198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:33.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.416+0000 7f457639a640 1 -- 172.21.15.92:0/1905619488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45701002f0 msgr2=0x7f45701984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:33.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.416+0000 7f457639a640 1 --2- 172.21.15.92:0/1905619488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45701002f0 0x7f45701984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:33.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.416+0000 7f457639a640 1 -- 172.21.15.92:0/1905619488 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f457019d490 con 0x7f4570106f50 2024-09-19T09:09:33.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.416+0000 7f457639a640 1 --2- 172.21.15.92:0/1905619488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4570106f50 0x7f457019cdb0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f456800cce0 tx=0x7f456800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:33.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.416+0000 7f4566ffd640 1 -- 172.21.15.92:0/1905619488 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f456800f450 con 0x7f4570106f50 2024-09-19T09:09:33.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.416+0000 7f4566ffd640 1 -- 172.21.15.92:0/1905619488 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f456800fad0 con 0x7f4570106f50 2024-09-19T09:09:33.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.416+0000 7f4577dfd640 1 -- 172.21.15.92:0/1905619488 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f457019d780 con 0x7f4570106f50 2024-09-19T09:09:33.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.416+0000 7f4566ffd640 1 -- 172.21.15.92:0/1905619488 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4568018c10 con 0x7f4570106f50 2024-09-19T09:09:33.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.416+0000 7f4577dfd640 1 -- 172.21.15.92:0/1905619488 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45701a5060 con 0x7f4570106f50 2024-09-19T09:09:33.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.418+0000 7f4566ffd640 1 -- 172.21.15.92:0/1905619488 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f456800f5f0 con 0x7f4570106f50 2024-09-19T09:09:33.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.419+0000 7f457a1d6740 1 Processor -- start 2024-09-19T09:09:33.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.419+0000 7f457a1d6740 1 -- start start 2024-09-19T09:09:33.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.419+0000 7f457a1d6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1577e0b40 0x55a1577df090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:33.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.419+0000 7f457a1d6740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1577df5d0 0x55a1577dfa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:33.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.419+0000 7f4566ffd640 1 --2- 172.21.15.92:0/1905619488 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f455c0a32c0 0x7f455c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:33.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.419+0000 7f457a1d6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1577ea370 0x55a1577ec760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:33.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.419+0000 7f457a1d6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a1577452f0 con 0x55a1577ea370 2024-09-19T09:09:33.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.419+0000 7f457a1d6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a1576eccf0 con 0x55a1577e0b40 2024-09-19T09:09:33.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.419+0000 7f457a1d6740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55a1577412b0 con 0x55a1577df5d0 2024-09-19T09:09:33.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.419+0000 7f457639a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1577ea370 0x55a1577ec760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:33.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.419+0000 7f4575b99640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1577df5d0 0x55a1577dfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:33.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.419+0000 7f4575b99640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1577df5d0 0x55a1577dfa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:60392/0 (socket says 172.21.15.92:60392) 2024-09-19T09:09:33.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.419+0000 7f457639a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1577ea370 0x55a1577ec760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60478/0 (socket says 172.21.15.92:60478) 2024-09-19T09:09:33.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.419+0000 7f4575398640 1 --2- 172.21.15.92:0/1905619488 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f455c0a32c0 0x7f455c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:33.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.419+0000 7f4575b99640 1 -- 172.21.15.92:0/3644315396 learned_addr learned my addr 172.21.15.92:0/3644315396 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:33.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.419+0000 7f4566ffd640 1 -- 172.21.15.92:0/1905619488 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f45680cff60 con 0x7f4570106f50 2024-09-19T09:09:33.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.419+0000 7f4575398640 1 --2- 172.21.15.92:0/3644315396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1577e0b40 0x55a1577df090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:33.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.420+0000 7f457639a640 1 -- 172.21.15.92:0/3644315396 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1577df5d0 msgr2=0x55a1577dfa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:33.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.420+0000 7f457639a640 1 --2- 172.21.15.92:0/3644315396 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1577df5d0 0x55a1577dfa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:33.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.420+0000 7f457639a640 1 -- 172.21.15.92:0/3644315396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1577e0b40 msgr2=0x55a1577df090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:33.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.420+0000 7f457639a640 1 --2- 172.21.15.92:0/3644315396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1577e0b40 0x55a1577df090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:33.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.420+0000 7f457639a640 1 -- 172.21.15.92:0/3644315396 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1576d13a0 con 0x55a1577ea370 2024-09-19T09:09:33.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.420+0000 7f457639a640 1 --2- 172.21.15.92:0/3644315396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1577ea370 0x55a1577ec760 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f456800ccb0 tx=0x7f456801baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9341770690d71df8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:33.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.420+0000 7f4575398640 1 --2- 172.21.15.92:0/1905619488 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f455c0a32c0 0x7f455c0a5780 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f45700ff810 tx=0x7f4560006f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:33.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.420+0000 7f455bfff640 1 -- 172.21.15.92:0/3644315396 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f456809cc80 con 0x55a1577ea370 2024-09-19T09:09:33.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.420+0000 7f455bfff640 1 -- 172.21.15.92:0/3644315396 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f456809c580 con 0x55a1577ea370 2024-09-19T09:09:33.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.420+0000 7f455bfff640 1 -- 172.21.15.92:0/3644315396 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f456800fc80 con 0x55a1577ea370 2024-09-19T09:09:33.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.421+0000 7f457a1d6740 1 -- 172.21.15.92:0/3644315396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1577ea370 msgr2=0x55a1577ec760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:33.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.421+0000 7f457a1d6740 1 --2- 172.21.15.92:0/3644315396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1577ea370 0x55a1577ec760 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f456800ccb0 tx=0x7f456801baf0 comp rx=0 tx=0).stop 2024-09-19T09:09:33.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.421+0000 7f457a1d6740 1 -- 172.21.15.92:0/3644315396 shutdown_connections 2024-09-19T09:09:33.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.421+0000 7f457a1d6740 1 --2- 172.21.15.92:0/3644315396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1577ea370 0x55a1577ec760 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:33.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.421+0000 7f457a1d6740 1 --2- 172.21.15.92:0/3644315396 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1577df5d0 0x55a1577dfa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:33.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.421+0000 7f457a1d6740 1 --2- 172.21.15.92:0/3644315396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1577e0b40 0x55a1577df090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:33.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.421+0000 7f457a1d6740 1 -- 172.21.15.92:0/3644315396 >> 172.21.15.92:0/3644315396 conn(0x55a1577a8310 msgr2=0x55a1577dbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:33.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.421+0000 7f457a1d6740 1 -- 172.21.15.92:0/3644315396 shutdown_connections 2024-09-19T09:09:33.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.421+0000 7f457a1d6740 1 -- 172.21.15.92:0/3644315396 wait complete. 2024-09-19T09:09:33.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.421+0000 7f457a1d6740 1 -- start start 2024-09-19T09:09:33.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.421+0000 7f457a1d6740 1 Processor -- start 2024-09-19T09:09:33.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.422+0000 7f457a1d6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1577df5d0 0x55a1577e9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:33.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.422+0000 7f457a1d6740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1577e0b40 0x55a1577e7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:33.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.422+0000 7f457a1d6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1577ea370 0x55a1577e77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:33.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.422+0000 7f457a1d6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a1577ed010 con 0x55a1577ea370 2024-09-19T09:09:33.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.422+0000 7f457a1d6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a157700060 con 0x55a1577df5d0 2024-09-19T09:09:33.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.422+0000 7f457a1d6740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55a1577ed190 con 0x55a1577e0b40 2024-09-19T09:09:33.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.422+0000 7f457a1d6740 10 client.0 _ll_register_callbacks cb 0x55a1574538c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:09:33.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.422+0000 7f457639a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1577ea370 0x55a1577e77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:33.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.422+0000 7f457639a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1577ea370 0x55a1577e77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60482/0 (socket says 172.21.15.92:60482) 2024-09-19T09:09:33.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.422+0000 7f457639a640 1 -- 172.21.15.92:0/4096617629 learned_addr learned my addr 172.21.15.92:0/4096617629 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:33.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.422+0000 7f4575b99640 1 --2- 172.21.15.92:0/4096617629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1577df5d0 0x55a1577e9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:33.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.422+0000 7f4575398640 1 --2- 172.21.15.92:0/4096617629 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1577e0b40 0x55a1577e7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:33.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.422+0000 7f4575b99640 1 -- 172.21.15.92:0/4096617629 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1577e0b40 msgr2=0x55a1577e7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:33.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.422+0000 7f4575b99640 1 --2- 172.21.15.92:0/4096617629 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1577e0b40 0x55a1577e7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:33.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.422+0000 7f4575b99640 1 -- 172.21.15.92:0/4096617629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1577ea370 msgr2=0x55a1577e77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:33.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.422+0000 7f4575b99640 1 --2- 172.21.15.92:0/4096617629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1577ea370 0x55a1577e77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:33.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.422+0000 7f4575b99640 1 -- 172.21.15.92:0/4096617629 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1574b63c0 con 0x55a1577df5d0 2024-09-19T09:09:33.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.422+0000 7f457639a640 1 --2- 172.21.15.92:0/4096617629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1577ea370 0x55a1577e77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:09:33.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.423+0000 7f4575b99640 1 --2- 172.21.15.92:0/4096617629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1577df5d0 0x55a1577e9db0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x55a1577dcac0 tx=0x7f456c031a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b93bb0a396a784f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:33.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.423+0000 7f45597fa640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:09:33.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.423+0000 7f45597fa640 1 -- 172.21.15.92:0/4096617629 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f456c035040 con 0x55a1577df5d0 2024-09-19T09:09:33.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.423+0000 7f457a1d6740 1 -- 172.21.15.92:0/4096617629 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f456809c580 con 0x55a1577df5d0 2024-09-19T09:09:33.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.423+0000 7f45597fa640 1 -- 172.21.15.92:0/4096617629 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f456c004380 con 0x55a1577df5d0 2024-09-19T09:09:33.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.423+0000 7f45597fa640 1 -- 172.21.15.92:0/4096617629 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f456c005020 con 0x55a1577df5d0 2024-09-19T09:09:33.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.423+0000 7f457a1d6740 10 client.27671 fetch_fsmap learned FSMap version 19 2024-09-19T09:09:33.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.423+0000 7f457a1d6740 1 -- 172.21.15.92:0/4096617629 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55a1577f8b00 con 0x55a1577df5d0 2024-09-19T09:09:33.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.423+0000 7f45597fa640 1 -- 172.21.15.92:0/4096617629 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f456809c580 con 0x55a1577df5d0 2024-09-19T09:09:33.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.423+0000 7f45597fa640 1 -- 172.21.15.92:0/4096617629 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f456c0035f0 con 0x55a1577df5d0 2024-09-19T09:09:33.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.423+0000 7f457a1d6740 10 client.27671 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:09:33.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.423+0000 7f457a1d6740 10 client.27671 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:09:33.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.423+0000 7f457a1d6740 20 client.27671 populate_metadata read hostname 'smithi092' 2024-09-19T09:09:33.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.423+0000 7f457a1d6740 1 --2- 172.21.15.92:0/4096617629 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a1577f9fc0 0x55a1577fc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:33.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.423+0000 7f457a1d6740 4 client.27671 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:09:33.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.423+0000 7f457a1d6740 1 -- 172.21.15.92:0/4096617629 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a157752860 con 0x55a1577f9fc0 2024-09-19T09:09:33.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.424+0000 7f4575398640 1 --2- 172.21.15.92:0/4096617629 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a1577f9fc0 0x55a1577fc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:33.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.424+0000 7f45597fa640 10 client.27671 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:33.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.424+0000 7f4575398640 1 --2- 172.21.15.92:0/4096617629 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a1577f9fc0 0x55a1577fc3b0 crc :-1 s=READY pgs=388 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=730141ffe324d236 server_cookie=ca608f6de9521fe0 in_seq=0 out_seq=0 2024-09-19T09:09:33.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.425+0000 7f45597fa640 1 -- 172.21.15.92:0/4096617629 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a157752860 con 0x55a1577f9fc0 2024-09-19T09:09:33.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.425+0000 7f45597fa640 10 client.27671 handle_command_reply: tid=0 2024-09-19T09:09:33.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.425+0000 7f457a1d6740 1 client.27671 shutdown 2024-09-19T09:09:33.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.425+0000 7f457a1d6740 1 -- 172.21.15.92:0/4096617629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1577df5d0 msgr2=0x55a1577e9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:33.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.425+0000 7f457a1d6740 1 --2- 172.21.15.92:0/4096617629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1577df5d0 0x55a1577e9db0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x55a1577dcac0 tx=0x7f456c031a00 comp rx=0 tx=0).stop 2024-09-19T09:09:33.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.425+0000 7f457a1d6740 1 -- 172.21.15.92:0/4096617629 shutdown_connections 2024-09-19T09:09:33.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.425+0000 7f457a1d6740 1 --2- 172.21.15.92:0/4096617629 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a1577f9fc0 0x55a1577fc3b0 crc :-1 s=READY pgs=388 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:33.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.425+0000 7f457a1d6740 1 --2- 172.21.15.92:0/4096617629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1577ea370 0x55a1577e77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:33.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.425+0000 7f457a1d6740 1 --2- 172.21.15.92:0/4096617629 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1577e0b40 0x55a1577e7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:33.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.425+0000 7f45597fa640 0 client.27671 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:33.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.425+0000 7f457a1d6740 1 --2- 172.21.15.92:0/4096617629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1577df5d0 0x55a1577e9db0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:33.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.425+0000 7f457a1d6740 1 -- 172.21.15.92:0/4096617629 >> 172.21.15.92:0/4096617629 conn(0x55a1577a8310 msgr2=0x55a1577e1990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:33.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.425+0000 7f457a1d6740 1 -- 172.21.15.92:0/4096617629 shutdown_connections 2024-09-19T09:09:33.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.425+0000 7f457a1d6740 1 -- 172.21.15.92:0/4096617629 wait complete. 2024-09-19T09:09:33.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.425+0000 7f457a1d6740 20 client.27671 trim_cache size 0 max 16384 2024-09-19T09:09:33.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.438+0000 7f457a1d6740 1 Processor -- start 2024-09-19T09:09:33.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.438+0000 7f457a1d6740 1 -- start start 2024-09-19T09:09:33.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.438+0000 7f457a1d6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1577df5d0 0x55a1577dbe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:33.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.438+0000 7f457a1d6740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1577e0b40 0x55a157801c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:33.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.438+0000 7f457a1d6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1577ea370 0x55a157802170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:33.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.438+0000 7f457a1d6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f45701a9360 con 0x55a1577df5d0 2024-09-19T09:09:33.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.438+0000 7f457a1d6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f45701abc00 con 0x55a1577ea370 2024-09-19T09:09:33.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.438+0000 7f457a1d6740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f45701a99f0 con 0x55a1577e0b40 2024-09-19T09:09:33.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.438+0000 7f4575b99640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1577df5d0 0x55a1577dbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:33.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.438+0000 7f4575b99640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1577df5d0 0x55a1577dbe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60496/0 (socket says 172.21.15.92:60496) 2024-09-19T09:09:33.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.438+0000 7f4575b99640 1 -- 172.21.15.92:0/2584672954 learned_addr learned my addr 172.21.15.92:0/2584672954 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:33.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.439+0000 7f4575b99640 1 -- 172.21.15.92:0/2584672954 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1577e0b40 msgr2=0x55a157801c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:33.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.439+0000 7f4575b99640 1 --2- 172.21.15.92:0/2584672954 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1577e0b40 0x55a157801c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:33.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.439+0000 7f4575b99640 1 -- 172.21.15.92:0/2584672954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1577ea370 msgr2=0x55a157802170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:33.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.439+0000 7f4575b99640 1 --2- 172.21.15.92:0/2584672954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1577ea370 0x55a157802170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:33.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.439+0000 7f4575b99640 1 -- 172.21.15.92:0/2584672954 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1577e55d0 con 0x55a1577df5d0 2024-09-19T09:09:33.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.439+0000 7f4575b99640 1 --2- 172.21.15.92:0/2584672954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1577df5d0 0x55a1577dbe10 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f456c009850 tx=0x7f456c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e98c9fe0f87a1bbd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:33.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.439+0000 7f455b7fe640 1 -- 172.21.15.92:0/2584672954 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f456c035030 con 0x55a1577df5d0 2024-09-19T09:09:33.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.439+0000 7f455b7fe640 1 -- 172.21.15.92:0/2584672954 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f456c003e00 con 0x55a1577df5d0 2024-09-19T09:09:33.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.439+0000 7f455b7fe640 1 -- 172.21.15.92:0/2584672954 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f456c004a00 con 0x55a1577df5d0 2024-09-19T09:09:33.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.439+0000 7f457a1d6740 1 -- 172.21.15.92:0/2584672954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1577df5d0 msgr2=0x55a1577dbe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:33.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.439+0000 7f457a1d6740 1 --2- 172.21.15.92:0/2584672954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1577df5d0 0x55a1577dbe10 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f456c009850 tx=0x7f456c005fd0 comp rx=0 tx=0).stop 2024-09-19T09:09:33.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.440+0000 7f457a1d6740 1 -- 172.21.15.92:0/2584672954 shutdown_connections 2024-09-19T09:09:33.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.440+0000 7f457a1d6740 1 --2- 172.21.15.92:0/2584672954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1577ea370 0x55a157802170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:33.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.440+0000 7f457a1d6740 1 --2- 172.21.15.92:0/2584672954 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1577e0b40 0x55a157801c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:33.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.440+0000 7f457a1d6740 1 --2- 172.21.15.92:0/2584672954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1577df5d0 0x55a1577dbe10 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:33.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.440+0000 7f457a1d6740 1 -- 172.21.15.92:0/2584672954 >> 172.21.15.92:0/2584672954 conn(0x55a1577a8310 msgr2=0x55a1577db700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:33.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.440+0000 7f457a1d6740 1 -- 172.21.15.92:0/2584672954 shutdown_connections 2024-09-19T09:09:33.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.440+0000 7f457a1d6740 1 -- 172.21.15.92:0/2584672954 wait complete. 2024-09-19T09:09:33.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.440+0000 7f457a1d6740 1 -- start start 2024-09-19T09:09:33.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.440+0000 7f457a1d6740 1 Processor -- start 2024-09-19T09:09:33.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.440+0000 7f457a1d6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1577df5d0 0x55a1577f2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:33.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.440+0000 7f457a1d6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1577e0b40 0x55a1577f2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:33.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.440+0000 7f457a1d6740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1577ea370 0x55a1577ef3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:33.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.440+0000 7f457a1d6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f45701aa0c0 con 0x55a1577df5d0 2024-09-19T09:09:33.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.440+0000 7f457a1d6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f45701ab530 con 0x55a1577e0b40 2024-09-19T09:09:33.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.440+0000 7f457a1d6740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f45701aa790 con 0x55a1577ea370 2024-09-19T09:09:33.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.440+0000 7f457a1d6740 10 client.0 _ll_register_callbacks cb 0x7f456c009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:09:33.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.441+0000 7f4575b99640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1577df5d0 0x55a1577f2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:33.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.441+0000 7f4575b99640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1577df5d0 0x55a1577f2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60510/0 (socket says 172.21.15.92:60510) 2024-09-19T09:09:33.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.441+0000 7f4575b99640 1 -- 172.21.15.92:0/185270172 learned_addr learned my addr 172.21.15.92:0/185270172 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:33.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.441+0000 7f457639a640 1 --2- 172.21.15.92:0/185270172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1577ea370 0x55a1577ef3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:33.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.441+0000 7f4575398640 1 --2- 172.21.15.92:0/185270172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1577e0b40 0x55a1577f2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:33.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.441+0000 7f4575b99640 1 -- 172.21.15.92:0/185270172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1577ea370 msgr2=0x55a1577ef3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:33.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.441+0000 7f4575b99640 1 --2- 172.21.15.92:0/185270172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1577ea370 0x55a1577ef3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:33.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.441+0000 7f4575b99640 1 -- 172.21.15.92:0/185270172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1577e0b40 msgr2=0x55a1577f2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:33.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.441+0000 7f4575b99640 1 --2- 172.21.15.92:0/185270172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1577e0b40 0x55a1577f2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:33.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.441+0000 7f4575b99640 1 -- 172.21.15.92:0/185270172 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1577ef930 con 0x55a1577df5d0 2024-09-19T09:09:33.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.441+0000 7f4575b99640 1 --2- 172.21.15.92:0/185270172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1577df5d0 0x55a1577f2420 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f456c0053f0 tx=0x7f456c005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9179cfc7661aea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:33.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.441+0000 7f45597fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:09:33.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.441+0000 7f45597fa640 1 -- 172.21.15.92:0/185270172 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f456c035070 con 0x55a1577df5d0 2024-09-19T09:09:33.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.441+0000 7f45597fa640 1 -- 172.21.15.92:0/185270172 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f456c004180 con 0x55a1577df5d0 2024-09-19T09:09:33.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.441+0000 7f457a1d6740 1 -- 172.21.15.92:0/185270172 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f456c003e00 con 0x55a1577df5d0 2024-09-19T09:09:33.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.441+0000 7f45597fa640 1 -- 172.21.15.92:0/185270172 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f456c0051c0 con 0x55a1577df5d0 2024-09-19T09:09:33.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.441+0000 7f457a1d6740 10 client.18432 fetch_fsmap learned FSMap version 19 2024-09-19T09:09:33.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.442+0000 7f457a1d6740 1 -- 172.21.15.92:0/185270172 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55a1578652c0 con 0x55a1577df5d0 2024-09-19T09:09:33.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.442+0000 7f45597fa640 1 -- 172.21.15.92:0/185270172 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f456c003e00 con 0x55a1577df5d0 2024-09-19T09:09:33.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.442+0000 7f45597fa640 1 -- 172.21.15.92:0/185270172 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f456c046580 con 0x55a1577df5d0 2024-09-19T09:09:33.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.442+0000 7f457a1d6740 10 client.18432 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:09:33.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.442+0000 7f457a1d6740 10 client.18432 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:09:33.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.442+0000 7f457a1d6740 20 client.18432 populate_metadata read hostname 'smithi092' 2024-09-19T09:09:33.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.442+0000 7f457a1d6740 1 --2- 172.21.15.92:0/185270172 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a157865740 0x55a157867b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:33.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.442+0000 7f457a1d6740 4 client.18432 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:09:33.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.442+0000 7f457a1d6740 1 -- 172.21.15.92:0/185270172 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a15774cd70 con 0x55a157865740 2024-09-19T09:09:33.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.442+0000 7f4575398640 1 --2- 172.21.15.92:0/185270172 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a157865740 0x55a157867b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:33.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.442+0000 7f45597fa640 10 client.18432 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:33.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.442+0000 7f4575398640 1 --2- 172.21.15.92:0/185270172 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a157865740 0x55a157867b30 crc :-1 s=READY pgs=389 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=566f2202da88bd20 server_cookie=b05aaf62e1f91db4 in_seq=0 out_seq=0 2024-09-19T09:09:33.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.443+0000 7f45597fa640 1 -- 172.21.15.92:0/185270172 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a15774cd70 con 0x55a157865740 2024-09-19T09:09:33.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.443+0000 7f45597fa640 10 client.18432 handle_command_reply: tid=0 2024-09-19T09:09:33.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.443+0000 7f457a1d6740 1 client.18432 shutdown 2024-09-19T09:09:33.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.443+0000 7f457a1d6740 1 -- 172.21.15.92:0/185270172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1577df5d0 msgr2=0x55a1577f2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:33.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.443+0000 7f457a1d6740 1 --2- 172.21.15.92:0/185270172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1577df5d0 0x55a1577f2420 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f456c0053f0 tx=0x7f456c005850 comp rx=0 tx=0).stop 2024-09-19T09:09:33.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.443+0000 7f457a1d6740 1 -- 172.21.15.92:0/185270172 shutdown_connections 2024-09-19T09:09:33.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.443+0000 7f457a1d6740 1 --2- 172.21.15.92:0/185270172 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55a157865740 0x55a157867b30 crc :-1 s=READY pgs=389 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:33.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.443+0000 7f457a1d6740 1 --2- 172.21.15.92:0/185270172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a1577ea370 0x55a1577ef3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:33.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.443+0000 7f457a1d6740 1 --2- 172.21.15.92:0/185270172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a1577e0b40 0x55a1577f2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:33.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.443+0000 7f457a1d6740 1 --2- 172.21.15.92:0/185270172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1577df5d0 0x55a1577f2420 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:33.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.443+0000 7f45597fa640 0 client.18432 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:33.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.443+0000 7f457a1d6740 1 -- 172.21.15.92:0/185270172 >> 172.21.15.92:0/185270172 conn(0x55a1577a8310 msgr2=0x55a1577da4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:33.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.443+0000 7f457a1d6740 1 -- 172.21.15.92:0/185270172 shutdown_connections 2024-09-19T09:09:33.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.443+0000 7f457a1d6740 1 -- 172.21.15.92:0/185270172 wait complete. 2024-09-19T09:09:33.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.443+0000 7f457a1d6740 20 client.18432 trim_cache size 0 max 16384 2024-09-19T09:09:33.450 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-19T09:09:33.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.444+0000 7f4577dfd640 1 -- 172.21.15.92:0/1905619488 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f455c0a32c0 msgr2=0x7f455c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:33.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.444+0000 7f4577dfd640 1 --2- 172.21.15.92:0/1905619488 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f455c0a32c0 0x7f455c0a5780 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f45700ff810 tx=0x7f4560006f90 comp rx=0 tx=0).stop 2024-09-19T09:09:33.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.444+0000 7f4577dfd640 1 -- 172.21.15.92:0/1905619488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4570106f50 msgr2=0x7f457019cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:33.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.444+0000 7f4577dfd640 1 --2- 172.21.15.92:0/1905619488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4570106f50 0x7f457019cdb0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f456800cce0 tx=0x7f456800a620 comp rx=0 tx=0).stop 2024-09-19T09:09:33.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.444+0000 7f4577dfd640 1 -- 172.21.15.92:0/1905619488 shutdown_connections 2024-09-19T09:09:33.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.444+0000 7f4577dfd640 1 --2- 172.21.15.92:0/1905619488 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f455c0a32c0 0x7f455c0a5780 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:33.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.444+0000 7f4577dfd640 1 --2- 172.21.15.92:0/1905619488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4570106f50 0x7f457019cdb0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:33.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.444+0000 7f4577dfd640 1 --2- 172.21.15.92:0/1905619488 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4570100ca0 0x7f4570198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:33.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.444+0000 7f4577dfd640 1 --2- 172.21.15.92:0/1905619488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45701002f0 0x7f45701984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:33.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.444+0000 7f4577dfd640 1 -- 172.21.15.92:0/1905619488 >> 172.21.15.92:0/1905619488 conn(0x7f4570077210 msgr2=0x7f4570105210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:33.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.444+0000 7f4577dfd640 1 -- 172.21.15.92:0/1905619488 shutdown_connections 2024-09-19T09:09:33.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:33.444+0000 7f4577dfd640 1 -- 172.21.15.92:0/1905619488 wait complete. 2024-09-19T09:09:33.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:33 smithi167 ceph-mon[35359]: pgmap v722: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 973 KiB/s wr, 112 op/s 2024-09-19T09:09:33.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:33 smithi190 ceph-mon[35358]: pgmap v722: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 973 KiB/s wr, 112 op/s 2024-09-19T09:09:35.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:34 smithi092 ceph-mon[31407]: pgmap v723: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 500 KiB/s wr, 55 op/s 2024-09-19T09:09:35.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:34 smithi167 ceph-mon[35359]: pgmap v723: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 500 KiB/s wr, 55 op/s 2024-09-19T09:09:35.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:34 smithi190 ceph-mon[35358]: pgmap v723: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 500 KiB/s wr, 55 op/s 2024-09-19T09:09:35.207 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:09:35.207 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:09:35.653 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:09:35.799 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:09:36.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.112+0000 7f2195afd640 1 -- 172.21.15.92:0/1422236240 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21901036c0 msgr2=0x7f219010bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:36.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.112+0000 7f2195afd640 1 --2- 172.21.15.92:0/1422236240 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21901036c0 0x7f219010bbb0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f2178009900 tx=0x7f217802a480 comp rx=0 tx=0).stop 2024-09-19T09:09:36.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.112+0000 7f2195afd640 1 -- 172.21.15.92:0/1422236240 shutdown_connections 2024-09-19T09:09:36.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.112+0000 7f2195afd640 1 --2- 172.21.15.92:0/1422236240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f219010c180 0x7f219010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:36.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.112+0000 7f2195afd640 1 --2- 172.21.15.92:0/1422236240 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21901036c0 0x7f219010bbb0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:36.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.112+0000 7f2195afd640 1 --2- 172.21.15.92:0/1422236240 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2190102da0 0x7f2190103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:36.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.112+0000 7f2195afd640 1 -- 172.21.15.92:0/1422236240 >> 172.21.15.92:0/1422236240 conn(0x7f21900fc7a0 msgr2=0x7f21900febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:36.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.112+0000 7f2195afd640 1 -- 172.21.15.92:0/1422236240 shutdown_connections 2024-09-19T09:09:36.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.112+0000 7f2195afd640 1 -- 172.21.15.92:0/1422236240 wait complete. 2024-09-19T09:09:36.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.113+0000 7f2195afd640 1 Processor -- start 2024-09-19T09:09:36.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.113+0000 7f2195afd640 1 -- start start 2024-09-19T09:09:36.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.113+0000 7f2195afd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2190102da0 0x7f2190198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:36.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.113+0000 7f2195afd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f21901036c0 0x7f2190198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:36.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.113+0000 7f2195afd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f219010c180 0x7f219019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:36.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.113+0000 7f2195afd640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2190111fb0 con 0x7f2190102da0 2024-09-19T09:09:36.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.113+0000 7f2195afd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2190111e30 con 0x7f219010c180 2024-09-19T09:09:36.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.113+0000 7f2195afd640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2190112130 con 0x7f21901036c0 2024-09-19T09:09:36.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.113+0000 7f218f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2190102da0 0x7f2190198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:36.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.113+0000 7f218f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2190102da0 0x7f2190198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60540/0 (socket says 172.21.15.92:60540) 2024-09-19T09:09:36.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.113+0000 7f218f7fe640 1 -- 172.21.15.92:0/3831493294 learned_addr learned my addr 172.21.15.92:0/3831493294 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:36.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.113+0000 7f2187fff640 1 --2- 172.21.15.92:0/3831493294 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f21901036c0 0x7f2190198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:36.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.113+0000 7f218ffff640 1 --2- 172.21.15.92:0/3831493294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f219010c180 0x7f219019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:36.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.113+0000 7f218f7fe640 1 -- 172.21.15.92:0/3831493294 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f21901036c0 msgr2=0x7f2190198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:36.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.113+0000 7f218f7fe640 1 --2- 172.21.15.92:0/3831493294 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f21901036c0 0x7f2190198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:36.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.114+0000 7f218f7fe640 1 -- 172.21.15.92:0/3831493294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f219010c180 msgr2=0x7f219019cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:36.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.114+0000 7f218f7fe640 1 --2- 172.21.15.92:0/3831493294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f219010c180 0x7f219019cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:36.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.114+0000 7f218f7fe640 1 -- 172.21.15.92:0/3831493294 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f219019d3e0 con 0x7f2190102da0 2024-09-19T09:09:36.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.114+0000 7f218f7fe640 1 --2- 172.21.15.92:0/3831493294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2190102da0 0x7f2190198430 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f218000d950 tx=0x7f218000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:36.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.114+0000 7f218d7fa640 1 -- 172.21.15.92:0/3831493294 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2180017070 con 0x7f2190102da0 2024-09-19T09:09:36.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.114+0000 7f218d7fa640 1 -- 172.21.15.92:0/3831493294 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2180009c30 con 0x7f2190102da0 2024-09-19T09:09:36.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.114+0000 7f2195afd640 1 -- 172.21.15.92:0/3831493294 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f219019d6d0 con 0x7f2190102da0 2024-09-19T09:09:36.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.114+0000 7f218d7fa640 1 -- 172.21.15.92:0/3831493294 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f218000f6b0 con 0x7f2190102da0 2024-09-19T09:09:36.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.114+0000 7f2195afd640 1 -- 172.21.15.92:0/3831493294 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21901a4fb0 con 0x7f2190102da0 2024-09-19T09:09:36.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.117+0000 7f218d7fa640 1 -- 172.21.15.92:0/3831493294 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f21800109d0 con 0x7f2190102da0 2024-09-19T09:09:36.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.117+0000 7f2197ed6740 1 Processor -- start 2024-09-19T09:09:36.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.117+0000 7f2197ed6740 1 -- start start 2024-09-19T09:09:36.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.117+0000 7f2197ed6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647bee00a60 0x5647bee00e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:36.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.117+0000 7f2197ed6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647bee01380 0x5647bee0fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:36.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.117+0000 7f2197ed6740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647bee10150 0x5647bee12540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:36.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.117+0000 7f2197ed6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5647bed66280 con 0x5647bee00a60 2024-09-19T09:09:36.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.117+0000 7f2197ed6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5647bed0db10 con 0x5647bee01380 2024-09-19T09:09:36.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.117+0000 7f2197ed6740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5647bed62240 con 0x5647bee10150 2024-09-19T09:09:36.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.117+0000 7f218ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647bee00a60 0x5647bee00e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:36.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.117+0000 7f218d7fa640 1 --2- 172.21.15.92:0/3831493294 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f217c0a3240 0x7f217c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:36.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.118+0000 7f218ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647bee00a60 0x5647bee00e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60542/0 (socket says 172.21.15.92:60542) 2024-09-19T09:09:36.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.118+0000 7f218ffff640 1 -- 172.21.15.92:0/3157227618 learned_addr learned my addr 172.21.15.92:0/3157227618 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:36.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.118+0000 7f2187fff640 1 --2- 172.21.15.92:0/3157227618 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647bee10150 0x5647bee12540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:36.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.118+0000 7f218f7fe640 1 --2- 172.21.15.92:0/3157227618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647bee01380 0x5647bee0fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:36.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.118+0000 7f218ffff640 1 -- 172.21.15.92:0/3157227618 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647bee10150 msgr2=0x5647bee12540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:36.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.118+0000 7f218ffff640 1 --2- 172.21.15.92:0/3157227618 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647bee10150 0x5647bee12540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:36.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.118+0000 7f218ffff640 1 -- 172.21.15.92:0/3157227618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647bee01380 msgr2=0x5647bee0fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:36.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.118+0000 7f218ffff640 1 --2- 172.21.15.92:0/3157227618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647bee01380 0x5647bee0fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:36.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.118+0000 7f218d7fa640 1 -- 172.21.15.92:0/3831493294 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f21800cf4f0 con 0x7f2190102da0 2024-09-19T09:09:36.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.118+0000 7f218ffff640 1 -- 172.21.15.92:0/3157227618 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647bed1a1f0 con 0x5647bee00a60 2024-09-19T09:09:36.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.118+0000 7f218f7fe640 1 --2- 172.21.15.92:0/3157227618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647bee01380 0x5647bee0fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:09:36.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.118+0000 7f2187fff640 1 --2- 172.21.15.92:0/3157227618 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647bee10150 0x5647bee12540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:09:36.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.118+0000 7f218ffff640 1 --2- 172.21.15.92:0/3831493294 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f217c0a3240 0x7f217c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:36.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.118+0000 7f218ffff640 1 --2- 172.21.15.92:0/3157227618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647bee00a60 0x5647bee00e40 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f2188011590 tx=0x7f2188011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=480e0b1583bc8539 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:36.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.118+0000 7f2185ffb640 1 -- 172.21.15.92:0/3157227618 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2188017050 con 0x5647bee00a60 2024-09-19T09:09:36.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.118+0000 7f2185ffb640 1 -- 172.21.15.92:0/3157227618 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f218801bb90 con 0x5647bee00a60 2024-09-19T09:09:36.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.118+0000 7f2185ffb640 1 -- 172.21.15.92:0/3157227618 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2188025dc0 con 0x5647bee00a60 2024-09-19T09:09:36.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.119+0000 7f2197ed6740 1 -- 172.21.15.92:0/3157227618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647bee00a60 msgr2=0x5647bee00e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:36.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.119+0000 7f218ffff640 1 --2- 172.21.15.92:0/3831493294 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f217c0a3240 0x7f217c0a5700 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f2188022000 tx=0x7f2188023000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:36.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.119+0000 7f2197ed6740 1 --2- 172.21.15.92:0/3157227618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647bee00a60 0x5647bee00e40 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f2188011590 tx=0x7f2188011a50 comp rx=0 tx=0).stop 2024-09-19T09:09:36.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.119+0000 7f2197ed6740 1 -- 172.21.15.92:0/3157227618 shutdown_connections 2024-09-19T09:09:36.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.119+0000 7f2197ed6740 1 --2- 172.21.15.92:0/3157227618 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647bee10150 0x5647bee12540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:36.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.119+0000 7f2197ed6740 1 --2- 172.21.15.92:0/3157227618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647bee01380 0x5647bee0fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:36.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.119+0000 7f2197ed6740 1 --2- 172.21.15.92:0/3157227618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647bee00a60 0x5647bee00e40 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:36.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.119+0000 7f2197ed6740 1 -- 172.21.15.92:0/3157227618 >> 172.21.15.92:0/3157227618 conn(0x5647bedfd0f0 msgr2=0x5647bedfd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:36.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.119+0000 7f2197ed6740 1 -- 172.21.15.92:0/3157227618 shutdown_connections 2024-09-19T09:09:36.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.119+0000 7f2197ed6740 1 -- 172.21.15.92:0/3157227618 wait complete. 2024-09-19T09:09:36.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.120+0000 7f2197ed6740 1 -- start start 2024-09-19T09:09:36.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.120+0000 7f2197ed6740 1 Processor -- start 2024-09-19T09:09:36.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.120+0000 7f2197ed6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647bee00a60 0x5647bee0d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:36.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.120+0000 7f2197ed6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647bee01380 0x5647bee0d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:36.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.120+0000 7f2197ed6740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647bee10150 0x5647bee0daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:36.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.120+0000 7f2197ed6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5647bee12d80 con 0x5647bee00a60 2024-09-19T09:09:36.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.120+0000 7f2197ed6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5647bed20f10 con 0x5647bee01380 2024-09-19T09:09:36.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.120+0000 7f2197ed6740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5647bee12f00 con 0x5647bee10150 2024-09-19T09:09:36.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.120+0000 7f2197ed6740 10 client.0 _ll_register_callbacks cb 0x5647bece9a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:09:36.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.120+0000 7f218f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647bee00a60 0x5647bee0d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:36.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.120+0000 7f218f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647bee00a60 0x5647bee0d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60556/0 (socket says 172.21.15.92:60556) 2024-09-19T09:09:36.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.120+0000 7f218f7fe640 1 -- 172.21.15.92:0/2418157366 learned_addr learned my addr 172.21.15.92:0/2418157366 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:36.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.120+0000 7f218ffff640 1 --2- 172.21.15.92:0/2418157366 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647bee10150 0x5647bee0daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:36.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.121+0000 7f2187fff640 1 --2- 172.21.15.92:0/2418157366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647bee01380 0x5647bee0d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:36.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.121+0000 7f218f7fe640 1 -- 172.21.15.92:0/2418157366 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647bee10150 msgr2=0x5647bee0daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:36.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.121+0000 7f218f7fe640 1 --2- 172.21.15.92:0/2418157366 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647bee10150 0x5647bee0daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:36.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.121+0000 7f218f7fe640 1 -- 172.21.15.92:0/2418157366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647bee01380 msgr2=0x5647bee0d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:36.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.121+0000 7f218f7fe640 1 --2- 172.21.15.92:0/2418157366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647bee01380 0x5647bee0d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:36.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.121+0000 7f218f7fe640 1 -- 172.21.15.92:0/2418157366 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647bead76a0 con 0x5647bee00a60 2024-09-19T09:09:36.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.121+0000 7f2187fff640 1 --2- 172.21.15.92:0/2418157366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647bee01380 0x5647bee0d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:09:36.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.121+0000 7f218f7fe640 1 --2- 172.21.15.92:0/2418157366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647bee00a60 0x5647bee0d070 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f218009b8c0 tx=0x7f218009b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1558e076a68ddd4d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:36.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.121+0000 7f216effd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:09:36.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.121+0000 7f216effd640 1 -- 172.21.15.92:0/2418157366 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2180020040 con 0x5647bee00a60 2024-09-19T09:09:36.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.121+0000 7f216effd640 1 -- 172.21.15.92:0/2418157366 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2180076140 con 0x5647bee00a60 2024-09-19T09:09:36.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.121+0000 7f2197ed6740 1 -- 172.21.15.92:0/2418157366 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f218801bb90 con 0x5647bee00a60 2024-09-19T09:09:36.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.121+0000 7f216effd640 1 -- 172.21.15.92:0/2418157366 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2180076340 con 0x5647bee00a60 2024-09-19T09:09:36.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.121+0000 7f2197ed6740 10 client.18444 fetch_fsmap learned FSMap version 19 2024-09-19T09:09:36.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.121+0000 7f2197ed6740 1 -- 172.21.15.92:0/2418157366 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5647bee1e970 con 0x5647bee00a60 2024-09-19T09:09:36.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.122+0000 7f216effd640 1 -- 172.21.15.92:0/2418157366 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21800a4780 con 0x5647bee00a60 2024-09-19T09:09:36.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.122+0000 7f216effd640 1 -- 172.21.15.92:0/2418157366 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f218009b010 con 0x5647bee00a60 2024-09-19T09:09:36.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.122+0000 7f2197ed6740 10 client.18444 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:09:36.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.122+0000 7f2197ed6740 10 client.18444 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:09:36.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.122+0000 7f2197ed6740 20 client.18444 populate_metadata read hostname 'smithi092' 2024-09-19T09:09:36.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.122+0000 7f2197ed6740 1 --2- 172.21.15.92:0/2418157366 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5647bee1fd10 0x5647bee22120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:36.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.122+0000 7f2197ed6740 4 client.18444 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:09:36.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.122+0000 7f2197ed6740 1 -- 172.21.15.92:0/2418157366 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f218801bb90 con 0x5647bee1fd10 2024-09-19T09:09:36.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.122+0000 7f2187fff640 1 --2- 172.21.15.92:0/2418157366 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5647bee1fd10 0x5647bee22120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:36.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.123+0000 7f216effd640 10 client.18444 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:36.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.123+0000 7f2187fff640 1 --2- 172.21.15.92:0/2418157366 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5647bee1fd10 0x5647bee22120 crc :-1 s=READY pgs=390 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9e8ddb366c6c2de server_cookie=ae1b6003d60e8cf0 in_seq=0 out_seq=0 2024-09-19T09:09:36.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.123+0000 7f216effd640 1 -- 172.21.15.92:0/2418157366 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f218801bb90 con 0x5647bee1fd10 2024-09-19T09:09:36.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.123+0000 7f216effd640 10 client.18444 handle_command_reply: tid=0 2024-09-19T09:09:36.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.123+0000 7f2197ed6740 1 client.18444 shutdown 2024-09-19T09:09:36.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.124+0000 7f2197ed6740 1 -- 172.21.15.92:0/2418157366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647bee00a60 msgr2=0x5647bee0d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:36.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.124+0000 7f2197ed6740 1 --2- 172.21.15.92:0/2418157366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647bee00a60 0x5647bee0d070 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f218009b8c0 tx=0x7f218009b610 comp rx=0 tx=0).stop 2024-09-19T09:09:36.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.124+0000 7f2197ed6740 1 -- 172.21.15.92:0/2418157366 shutdown_connections 2024-09-19T09:09:36.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.124+0000 7f2197ed6740 1 --2- 172.21.15.92:0/2418157366 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5647bee1fd10 0x5647bee22120 crc :-1 s=READY pgs=390 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:36.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.124+0000 7f2197ed6740 1 --2- 172.21.15.92:0/2418157366 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647bee10150 0x5647bee0daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:36.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.124+0000 7f2197ed6740 1 --2- 172.21.15.92:0/2418157366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647bee01380 0x5647bee0d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:36.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.124+0000 7f2197ed6740 1 --2- 172.21.15.92:0/2418157366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647bee00a60 0x5647bee0d070 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:36.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.124+0000 7f2197ed6740 1 -- 172.21.15.92:0/2418157366 >> 172.21.15.92:0/2418157366 conn(0x5647bedfd0f0 msgr2=0x5647bee02e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:36.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.124+0000 7f216effd640 0 client.18444 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:36.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.124+0000 7f2197ed6740 1 -- 172.21.15.92:0/2418157366 shutdown_connections 2024-09-19T09:09:36.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.124+0000 7f2197ed6740 1 -- 172.21.15.92:0/2418157366 wait complete. 2024-09-19T09:09:36.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.124+0000 7f2197ed6740 20 client.18444 trim_cache size 0 max 16384 2024-09-19T09:09:36.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.141+0000 7f2197ed6740 1 Processor -- start 2024-09-19T09:09:36.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.141+0000 7f2197ed6740 1 -- start start 2024-09-19T09:09:36.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.141+0000 7f2197ed6740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647bee00a60 0x5647bee0eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:36.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.141+0000 7f2197ed6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647bee01380 0x5647bee279f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:36.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.141+0000 7f2197ed6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647bee10150 0x5647bee27f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:36.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.141+0000 7f2197ed6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f21901a9410 con 0x5647bee01380 2024-09-19T09:09:36.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.141+0000 7f2197ed6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f21901abcb0 con 0x5647bee10150 2024-09-19T09:09:36.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.141+0000 7f2197ed6740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f21901a9aa0 con 0x5647bee00a60 2024-09-19T09:09:36.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.141+0000 7f2187fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647bee01380 0x5647bee279f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:36.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.141+0000 7f2187fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647bee01380 0x5647bee279f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60558/0 (socket says 172.21.15.92:60558) 2024-09-19T09:09:36.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.141+0000 7f218ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647bee10150 0x5647bee27f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:36.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.141+0000 7f2187fff640 1 -- 172.21.15.92:0/736725067 learned_addr learned my addr 172.21.15.92:0/736725067 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:36.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.142+0000 7f218f7fe640 1 --2- 172.21.15.92:0/736725067 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647bee00a60 0x5647bee0eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:36.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.142+0000 7f2187fff640 1 -- 172.21.15.92:0/736725067 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647bee00a60 msgr2=0x5647bee0eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:36.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.142+0000 7f2187fff640 1 --2- 172.21.15.92:0/736725067 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647bee00a60 0x5647bee0eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:36.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.142+0000 7f2187fff640 1 -- 172.21.15.92:0/736725067 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647bee10150 msgr2=0x5647bee27f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:36.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.142+0000 7f2187fff640 1 --2- 172.21.15.92:0/736725067 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647bee10150 0x5647bee27f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:36.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.142+0000 7f2187fff640 1 -- 172.21.15.92:0/736725067 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647bee1c020 con 0x5647bee01380 2024-09-19T09:09:36.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.142+0000 7f218ffff640 1 --2- 172.21.15.92:0/736725067 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647bee10150 0x5647bee27f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:09:36.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.142+0000 7f2187fff640 1 --2- 172.21.15.92:0/736725067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647bee01380 0x5647bee279f0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f217802ac70 tx=0x7f217802ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c19c4d8472dc4b3d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:36.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.142+0000 7f21857fa640 1 -- 172.21.15.92:0/736725067 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2178035040 con 0x5647bee01380 2024-09-19T09:09:36.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.142+0000 7f21857fa640 1 -- 172.21.15.92:0/736725067 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2178049070 con 0x5647bee01380 2024-09-19T09:09:36.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.142+0000 7f21857fa640 1 -- 172.21.15.92:0/736725067 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21780315b0 con 0x5647bee01380 2024-09-19T09:09:36.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.143+0000 7f2197ed6740 1 -- 172.21.15.92:0/736725067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647bee01380 msgr2=0x5647bee279f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:36.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.143+0000 7f2197ed6740 1 --2- 172.21.15.92:0/736725067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647bee01380 0x5647bee279f0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f217802ac70 tx=0x7f217802ac00 comp rx=0 tx=0).stop 2024-09-19T09:09:36.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.143+0000 7f2197ed6740 1 -- 172.21.15.92:0/736725067 shutdown_connections 2024-09-19T09:09:36.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.143+0000 7f2197ed6740 1 --2- 172.21.15.92:0/736725067 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647bee10150 0x5647bee27f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:36.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.143+0000 7f2197ed6740 1 --2- 172.21.15.92:0/736725067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647bee01380 0x5647bee279f0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:36.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.143+0000 7f2197ed6740 1 --2- 172.21.15.92:0/736725067 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647bee00a60 0x5647bee0eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:36.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.143+0000 7f2197ed6740 1 -- 172.21.15.92:0/736725067 >> 172.21.15.92:0/736725067 conn(0x5647bedfd0f0 msgr2=0x5647bee0e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:36.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.143+0000 7f2197ed6740 1 -- 172.21.15.92:0/736725067 shutdown_connections 2024-09-19T09:09:36.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.143+0000 7f2197ed6740 1 -- 172.21.15.92:0/736725067 wait complete. 2024-09-19T09:09:36.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.143+0000 7f2197ed6740 1 -- start start 2024-09-19T09:09:36.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.143+0000 7f2197ed6740 1 Processor -- start 2024-09-19T09:09:36.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.144+0000 7f2197ed6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647bee00a60 0x5647bee18190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:36.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.144+0000 7f2197ed6740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647bee01380 0x5647bee186d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:36.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.144+0000 7f2197ed6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647bee10150 0x5647bee15160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:36.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.144+0000 7f2197ed6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f21901aa170 con 0x5647bee00a60 2024-09-19T09:09:36.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.144+0000 7f2197ed6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f21901ab5e0 con 0x5647bee10150 2024-09-19T09:09:36.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.144+0000 7f2197ed6740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f21901aa840 con 0x5647bee01380 2024-09-19T09:09:36.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.144+0000 7f2197ed6740 10 client.0 _ll_register_callbacks cb 0x7f218000df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:09:36.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.144+0000 7f218f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647bee00a60 0x5647bee18190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:36.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.144+0000 7f218f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647bee00a60 0x5647bee18190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60572/0 (socket says 172.21.15.92:60572) 2024-09-19T09:09:36.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.144+0000 7f218f7fe640 1 -- 172.21.15.92:0/4003096620 learned_addr learned my addr 172.21.15.92:0/4003096620 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:36.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.144+0000 7f2187fff640 1 --2- 172.21.15.92:0/4003096620 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647bee01380 0x5647bee186d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:36.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.144+0000 7f218ffff640 1 --2- 172.21.15.92:0/4003096620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647bee10150 0x5647bee15160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:36.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.144+0000 7f218f7fe640 1 -- 172.21.15.92:0/4003096620 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647bee01380 msgr2=0x5647bee186d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:36.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.144+0000 7f218f7fe640 1 --2- 172.21.15.92:0/4003096620 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647bee01380 0x5647bee186d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:36.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.144+0000 7f218f7fe640 1 -- 172.21.15.92:0/4003096620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647bee10150 msgr2=0x5647bee15160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:36.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.144+0000 7f218f7fe640 1 --2- 172.21.15.92:0/4003096620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647bee10150 0x5647bee15160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:36.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.144+0000 7f218f7fe640 1 -- 172.21.15.92:0/4003096620 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647bee156a0 con 0x5647bee00a60 2024-09-19T09:09:36.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.144+0000 7f2187fff640 1 --2- 172.21.15.92:0/4003096620 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647bee01380 0x5647bee186d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:09:36.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.144+0000 7f218f7fe640 1 --2- 172.21.15.92:0/4003096620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647bee00a60 0x5647bee18190 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f2180076020 tx=0x7f2180000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f5b3e9d216ccef9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:36.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.144+0000 7f216effd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:09:36.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.144+0000 7f216effd640 1 -- 172.21.15.92:0/4003096620 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2180020070 con 0x5647bee00a60 2024-09-19T09:09:36.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.145+0000 7f216effd640 1 -- 172.21.15.92:0/4003096620 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f21800cf0f0 con 0x5647bee00a60 2024-09-19T09:09:36.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.145+0000 7f2197ed6740 1 -- 172.21.15.92:0/4003096620 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2178049070 con 0x5647bee00a60 2024-09-19T09:09:36.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.145+0000 7f216effd640 1 -- 172.21.15.92:0/4003096620 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f218009b220 con 0x5647bee00a60 2024-09-19T09:09:36.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.145+0000 7f2197ed6740 10 client.18450 fetch_fsmap learned FSMap version 19 2024-09-19T09:09:36.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.145+0000 7f2197ed6740 1 -- 172.21.15.92:0/4003096620 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5647bee8b100 con 0x5647bee00a60 2024-09-19T09:09:36.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.145+0000 7f216effd640 1 -- 172.21.15.92:0/4003096620 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2178049070 con 0x5647bee00a60 2024-09-19T09:09:36.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.145+0000 7f216effd640 1 -- 172.21.15.92:0/4003096620 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f218009ab00 con 0x5647bee00a60 2024-09-19T09:09:36.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.145+0000 7f2197ed6740 10 client.18450 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:09:36.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.145+0000 7f2197ed6740 10 client.18450 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:09:36.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.145+0000 7f2197ed6740 20 client.18450 populate_metadata read hostname 'smithi092' 2024-09-19T09:09:36.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.145+0000 7f2197ed6740 1 --2- 172.21.15.92:0/4003096620 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5647bee8b690 0x5647bee8da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:36.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.145+0000 7f2197ed6740 4 client.18450 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:09:36.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.145+0000 7f2197ed6740 1 -- 172.21.15.92:0/4003096620 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5647bed737f0 con 0x5647bee8b690 2024-09-19T09:09:36.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.145+0000 7f2187fff640 1 --2- 172.21.15.92:0/4003096620 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5647bee8b690 0x5647bee8da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:36.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.146+0000 7f2187fff640 1 --2- 172.21.15.92:0/4003096620 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5647bee8b690 0x5647bee8da80 crc :-1 s=READY pgs=391 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3bdcc37d46119df server_cookie=99d6a726cf97af9e in_seq=0 out_seq=0 2024-09-19T09:09:36.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.146+0000 7f216effd640 10 client.18450 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:36.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.146+0000 7f216effd640 1 -- 172.21.15.92:0/4003096620 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5647bed737f0 con 0x5647bee8b690 2024-09-19T09:09:36.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.147+0000 7f216effd640 10 client.18450 handle_command_reply: tid=0 2024-09-19T09:09:36.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.147+0000 7f2197ed6740 1 client.18450 shutdown 2024-09-19T09:09:36.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.147+0000 7f2197ed6740 1 -- 172.21.15.92:0/4003096620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647bee00a60 msgr2=0x5647bee18190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:36.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.147+0000 7f2197ed6740 1 --2- 172.21.15.92:0/4003096620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647bee00a60 0x5647bee18190 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f2180076020 tx=0x7f2180000bc0 comp rx=0 tx=0).stop 2024-09-19T09:09:36.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.147+0000 7f2197ed6740 1 -- 172.21.15.92:0/4003096620 shutdown_connections 2024-09-19T09:09:36.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.147+0000 7f2197ed6740 1 --2- 172.21.15.92:0/4003096620 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5647bee8b690 0x5647bee8da80 crc :-1 s=READY pgs=391 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:36.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.147+0000 7f2197ed6740 1 --2- 172.21.15.92:0/4003096620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647bee10150 0x5647bee15160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:36.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.147+0000 7f2197ed6740 1 --2- 172.21.15.92:0/4003096620 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5647bee01380 0x5647bee186d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:36.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.147+0000 7f2197ed6740 1 --2- 172.21.15.92:0/4003096620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647bee00a60 0x5647bee18190 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:36.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.147+0000 7f216effd640 0 client.18450 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:36.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.147+0000 7f2197ed6740 1 -- 172.21.15.92:0/4003096620 >> 172.21.15.92:0/4003096620 conn(0x5647bedfd0f0 msgr2=0x5647bee1b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:36.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.147+0000 7f2197ed6740 1 -- 172.21.15.92:0/4003096620 shutdown_connections 2024-09-19T09:09:36.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.147+0000 7f2197ed6740 1 -- 172.21.15.92:0/4003096620 wait complete. 2024-09-19T09:09:36.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.147+0000 7f2197ed6740 20 client.18450 trim_cache size 0 max 16384 2024-09-19T09:09:36.153 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:09:36.153 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-19T09:09:36.153 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "2ab276b0-e73c-4ac8-9c2b-05a8248426bc", 2024-09-19T09:09:36.154 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-19T09:09:36.154 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:09:36.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.148+0000 7f2195afd640 1 -- 172.21.15.92:0/3831493294 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f217c0a3240 msgr2=0x7f217c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:36.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.148+0000 7f2195afd640 1 --2- 172.21.15.92:0/3831493294 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f217c0a3240 0x7f217c0a5700 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f2188022000 tx=0x7f2188023000 comp rx=0 tx=0).stop 2024-09-19T09:09:36.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.148+0000 7f2195afd640 1 -- 172.21.15.92:0/3831493294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2190102da0 msgr2=0x7f2190198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:36.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.148+0000 7f2195afd640 1 --2- 172.21.15.92:0/3831493294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2190102da0 0x7f2190198430 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f218000d950 tx=0x7f218000de10 comp rx=0 tx=0).stop 2024-09-19T09:09:36.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.148+0000 7f2195afd640 1 -- 172.21.15.92:0/3831493294 shutdown_connections 2024-09-19T09:09:36.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.148+0000 7f2195afd640 1 --2- 172.21.15.92:0/3831493294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f219010c180 0x7f219019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:36.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.148+0000 7f2195afd640 1 --2- 172.21.15.92:0/3831493294 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f21901036c0 0x7f2190198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:36.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.148+0000 7f2195afd640 1 --2- 172.21.15.92:0/3831493294 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f217c0a3240 0x7f217c0a5700 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:36.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.148+0000 7f2195afd640 1 --2- 172.21.15.92:0/3831493294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2190102da0 0x7f2190198430 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:36.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.148+0000 7f2195afd640 1 -- 172.21.15.92:0/3831493294 >> 172.21.15.92:0/3831493294 conn(0x7f21900fc7a0 msgr2=0x7f21900fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:36.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.148+0000 7f2195afd640 1 -- 172.21.15.92:0/3831493294 shutdown_connections 2024-09-19T09:09:36.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:36.148+0000 7f2195afd640 1 -- 172.21.15.92:0/3831493294 wait complete. 2024-09-19T09:09:36.791 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:09:36.926 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:36 smithi190 ceph-mon[35358]: pgmap v724: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.5 MiB/s wr, 174 op/s 2024-09-19T09:09:37.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:36 smithi092 ceph-mon[31407]: pgmap v724: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.5 MiB/s wr, 174 op/s 2024-09-19T09:09:37.039 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:09:37.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:36 smithi167 ceph-mon[35359]: pgmap v724: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.5 MiB/s wr, 174 op/s 2024-09-19T09:09:37.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.508+0000 7f15e066f640 1 -- 172.21.15.92:0/181336946 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15d81036e0 msgr2=0x7f15d8107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:37.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.508+0000 7f15e066f640 1 --2- 172.21.15.92:0/181336946 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15d81036e0 0x7f15d8107b90 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f15c8009930 tx=0x7f15c802a420 comp rx=0 tx=0).stop 2024-09-19T09:09:37.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.508+0000 7f15e066f640 1 -- 172.21.15.92:0/181336946 shutdown_connections 2024-09-19T09:09:37.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.508+0000 7f15e066f640 1 --2- 172.21.15.92:0/181336946 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15d81082a0 0x7f15d810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.508+0000 7f15e066f640 1 --2- 172.21.15.92:0/181336946 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15d81036e0 0x7f15d8107b90 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.508+0000 7f15e066f640 1 --2- 172.21.15.92:0/181336946 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15d8102d30 0x7f15d8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.508+0000 7f15e066f640 1 -- 172.21.15.92:0/181336946 >> 172.21.15.92:0/181336946 conn(0x7f15d80fc7d0 msgr2=0x7f15d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:37.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.508+0000 7f15e066f640 1 -- 172.21.15.92:0/181336946 shutdown_connections 2024-09-19T09:09:37.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.508+0000 7f15e066f640 1 -- 172.21.15.92:0/181336946 wait complete. 2024-09-19T09:09:37.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.509+0000 7f15e066f640 1 Processor -- start 2024-09-19T09:09:37.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.509+0000 7f15e066f640 1 -- start start 2024-09-19T09:09:37.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.509+0000 7f15e066f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15d8102d30 0x7f15d81985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:37.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.509+0000 7f15e066f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15d81036e0 0x7f15d8198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:37.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.509+0000 7f15e066f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15d81082a0 0x7f15d819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:37.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.509+0000 7f15e066f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f15d8112060 con 0x7f15d8102d30 2024-09-19T09:09:37.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.509+0000 7f15e066f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f15d8111ee0 con 0x7f15d81036e0 2024-09-19T09:09:37.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.509+0000 7f15e066f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f15d81121e0 con 0x7f15d81082a0 2024-09-19T09:09:37.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.509+0000 7f15de40b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15d8102d30 0x7f15d81985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:37.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.509+0000 7f15de40b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15d8102d30 0x7f15d81985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60592/0 (socket says 172.21.15.92:60592) 2024-09-19T09:09:37.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.509+0000 7f15de40b640 1 -- 172.21.15.92:0/1519871778 learned_addr learned my addr 172.21.15.92:0/1519871778 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:37.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.509+0000 7f15ddc0a640 1 --2- 172.21.15.92:0/1519871778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15d81036e0 0x7f15d8198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:37.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.509+0000 7f15dec0c640 1 --2- 172.21.15.92:0/1519871778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15d81082a0 0x7f15d819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:37.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.509+0000 7f15de40b640 1 -- 172.21.15.92:0/1519871778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15d81082a0 msgr2=0x7f15d819ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:37.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.509+0000 7f15de40b640 1 --2- 172.21.15.92:0/1519871778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15d81082a0 0x7f15d819ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.509+0000 7f15de40b640 1 -- 172.21.15.92:0/1519871778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15d81036e0 msgr2=0x7f15d8198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:37.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.509+0000 7f15de40b640 1 --2- 172.21.15.92:0/1519871778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15d81036e0 0x7f15d8198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.509+0000 7f15de40b640 1 -- 172.21.15.92:0/1519871778 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d819d550 con 0x7f15d8102d30 2024-09-19T09:09:37.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.509+0000 7f15de40b640 1 --2- 172.21.15.92:0/1519871778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15d8102d30 0x7f15d81985a0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f15d400d950 tx=0x7f15d400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:37.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.510+0000 7f15cf7fe640 1 -- 172.21.15.92:0/1519871778 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d4017070 con 0x7f15d8102d30 2024-09-19T09:09:37.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.510+0000 7f15e066f640 1 -- 172.21.15.92:0/1519871778 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15d819d840 con 0x7f15d8102d30 2024-09-19T09:09:37.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.510+0000 7f15cf7fe640 1 -- 172.21.15.92:0/1519871778 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15d4009c30 con 0x7f15d8102d30 2024-09-19T09:09:37.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.510+0000 7f15cf7fe640 1 -- 172.21.15.92:0/1519871778 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d400f6b0 con 0x7f15d8102d30 2024-09-19T09:09:37.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.510+0000 7f15e066f640 1 -- 172.21.15.92:0/1519871778 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15d81a5120 con 0x7f15d8102d30 2024-09-19T09:09:37.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.512+0000 7f15cf7fe640 1 -- 172.21.15.92:0/1519871778 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f15d40109d0 con 0x7f15d8102d30 2024-09-19T09:09:37.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.512+0000 7f15e2a48740 1 Processor -- start 2024-09-19T09:09:37.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.512+0000 7f15e2a48740 1 -- start start 2024-09-19T09:09:37.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.513+0000 7f15e2a48740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556db59a4360 0x556db59a4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:37.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.513+0000 7f15e2a48740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db59a4c80 0x556db59b3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:37.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.513+0000 7f15e2a48740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556db59b3a90 0x556db59b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:37.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.513+0000 7f15e2a48740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556db590a2e0 con 0x556db59a4360 2024-09-19T09:09:37.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.513+0000 7f15e2a48740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556db58b1ce0 con 0x556db59b3a90 2024-09-19T09:09:37.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.513+0000 7f15e2a48740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x556db59062a0 con 0x556db59a4c80 2024-09-19T09:09:37.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.513+0000 7f15dec0c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556db59a4360 0x556db59a4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:37.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.513+0000 7f15de40b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db59a4c80 0x556db59b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:37.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.513+0000 7f15ddc0a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556db59b3a90 0x556db59b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:37.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.513+0000 7f15de40b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db59a4c80 0x556db59b3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:60522/0 (socket says 172.21.15.92:60522) 2024-09-19T09:09:37.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.513+0000 7f15de40b640 1 -- 172.21.15.92:0/3137762116 learned_addr learned my addr 172.21.15.92:0/3137762116 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:37.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.513+0000 7f15cf7fe640 1 --2- 172.21.15.92:0/1519871778 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f15c40a3240 0x7f15c40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:37.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.513+0000 7f15de40b640 1 -- 172.21.15.92:0/3137762116 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556db59b3a90 msgr2=0x556db59b5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:37.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.513+0000 7f15de40b640 1 --2- 172.21.15.92:0/3137762116 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556db59b3a90 0x556db59b5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.513+0000 7f15de40b640 1 -- 172.21.15.92:0/3137762116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556db59a4360 msgr2=0x556db59a4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:37.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.513+0000 7f15de40b640 1 --2- 172.21.15.92:0/3137762116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556db59a4360 0x556db59a4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.513+0000 7f15de40b640 1 -- 172.21.15.92:0/3137762116 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556db5896440 con 0x556db59a4c80 2024-09-19T09:09:37.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.513+0000 7f15ddc0a640 1 --2- 172.21.15.92:0/3137762116 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556db59b3a90 0x556db59b5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:09:37.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.513+0000 7f15dec0c640 1 --2- 172.21.15.92:0/3137762116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556db59a4360 0x556db59a4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:09:37.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.513+0000 7f15cf7fe640 1 -- 172.21.15.92:0/1519871778 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f15d40cf5a0 con 0x7f15d8102d30 2024-09-19T09:09:37.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.513+0000 7f15dec0c640 1 --2- 172.21.15.92:0/1519871778 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f15c40a3240 0x7f15c40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:37.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.514+0000 7f15de40b640 1 --2- 172.21.15.92:0/3137762116 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db59a4c80 0x556db59b3550 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f15d409b8c0 tx=0x7f15d4000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=350848b8919c2887 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:37.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.514+0000 7f15ccff9640 1 -- 172.21.15.92:0/3137762116 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d4020070 con 0x556db59a4c80 2024-09-19T09:09:37.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.514+0000 7f15dec0c640 1 --2- 172.21.15.92:0/1519871778 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f15c40a3240 0x7f15c40a5700 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f15d0009fd0 tx=0x7f15d0004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:37.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.514+0000 7f15ccff9640 1 -- 172.21.15.92:0/3137762116 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15d401a750 con 0x556db59a4c80 2024-09-19T09:09:37.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.514+0000 7f15ccff9640 1 -- 172.21.15.92:0/3137762116 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d40a4830 con 0x556db59a4c80 2024-09-19T09:09:37.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.515+0000 7f15e2a48740 1 -- 172.21.15.92:0/3137762116 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db59a4c80 msgr2=0x556db59b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:37.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.515+0000 7f15e2a48740 1 --2- 172.21.15.92:0/3137762116 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db59a4c80 0x556db59b3550 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f15d409b8c0 tx=0x7f15d4000bc0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.515+0000 7f15e2a48740 1 -- 172.21.15.92:0/3137762116 shutdown_connections 2024-09-19T09:09:37.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.515+0000 7f15e2a48740 1 --2- 172.21.15.92:0/3137762116 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556db59b3a90 0x556db59b5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.515+0000 7f15e2a48740 1 --2- 172.21.15.92:0/3137762116 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db59a4c80 0x556db59b3550 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.515+0000 7f15e2a48740 1 --2- 172.21.15.92:0/3137762116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556db59a4360 0x556db59a4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.515+0000 7f15e2a48740 1 -- 172.21.15.92:0/3137762116 >> 172.21.15.92:0/3137762116 conn(0x556db59a0a30 msgr2=0x556db59a0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:37.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.515+0000 7f15e2a48740 1 -- 172.21.15.92:0/3137762116 shutdown_connections 2024-09-19T09:09:37.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.515+0000 7f15e2a48740 1 -- 172.21.15.92:0/3137762116 wait complete. 2024-09-19T09:09:37.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.515+0000 7f15e2a48740 1 -- start start 2024-09-19T09:09:37.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.515+0000 7f15e2a48740 1 Processor -- start 2024-09-19T09:09:37.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.515+0000 7f15e2a48740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556db59a4360 0x556db59b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:37.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.515+0000 7f15e2a48740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db59a4c80 0x556db59b0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:37.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.515+0000 7f15e2a48740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556db59b3a90 0x556db59b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:37.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.515+0000 7f15e2a48740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556db59b6600 con 0x556db59a4360 2024-09-19T09:09:37.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.515+0000 7f15e2a48740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556db58c5050 con 0x556db59b3a90 2024-09-19T09:09:37.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.515+0000 7f15e2a48740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x556db59b6780 con 0x556db59a4c80 2024-09-19T09:09:37.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.515+0000 7f15e2a48740 10 client.0 _ll_register_callbacks cb 0x556db5905160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:09:37.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.516+0000 7f15de40b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556db59a4360 0x556db59b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:37.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.516+0000 7f15ddc0a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db59a4c80 0x556db59b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:37.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.516+0000 7f15ddc0a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db59a4c80 0x556db59b0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:60528/0 (socket says 172.21.15.92:60528) 2024-09-19T09:09:37.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.516+0000 7f15dec0c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556db59b3a90 0x556db59b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:37.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.516+0000 7f15ddc0a640 1 -- 172.21.15.92:0/1646819404 learned_addr learned my addr 172.21.15.92:0/1646819404 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:37.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.516+0000 7f15de40b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556db59a4360 0x556db59b33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60616/0 (socket says 172.21.15.92:60616) 2024-09-19T09:09:37.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.516+0000 7f15ddc0a640 1 -- 172.21.15.92:0/1646819404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556db59b3a90 msgr2=0x556db59b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:37.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.516+0000 7f15ddc0a640 1 --2- 172.21.15.92:0/1646819404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556db59b3a90 0x556db59b0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.516+0000 7f15ddc0a640 1 -- 172.21.15.92:0/1646819404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556db59a4360 msgr2=0x556db59b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:37.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.516+0000 7f15ddc0a640 1 --2- 172.21.15.92:0/1646819404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556db59a4360 0x556db59b33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.516+0000 7f15ddc0a640 1 -- 172.21.15.92:0/1646819404 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556db567b3c0 con 0x556db59a4c80 2024-09-19T09:09:37.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.516+0000 7f15de40b640 1 --2- 172.21.15.92:0/1646819404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556db59a4360 0x556db59b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:09:37.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.516+0000 7f15ddc0a640 1 --2- 172.21.15.92:0/1646819404 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db59a4c80 0x556db59b0670 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f15c8009900 tx=0x7f15c80315b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=260ec5b98f73be75 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:37.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.516+0000 7f15c1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:09:37.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.516+0000 7f15c1ffb640 1 -- 172.21.15.92:0/1646819404 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c8035040 con 0x556db59a4c80 2024-09-19T09:09:37.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.516+0000 7f15e2a48740 1 -- 172.21.15.92:0/1646819404 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15d401a750 con 0x556db59a4c80 2024-09-19T09:09:37.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.516+0000 7f15c1ffb640 1 -- 172.21.15.92:0/1646819404 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f15c80319a0 con 0x556db59a4c80 2024-09-19T09:09:37.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.516+0000 7f15c1ffb640 1 -- 172.21.15.92:0/1646819404 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f15c8004040 con 0x556db59a4c80 2024-09-19T09:09:37.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.516+0000 7f15e2a48740 10 client.27586 fetch_fsmap learned FSMap version 19 2024-09-19T09:09:37.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.516+0000 7f15e2a48740 1 -- 172.21.15.92:0/1646819404 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x556db59c1ff0 con 0x556db59a4c80 2024-09-19T09:09:37.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.517+0000 7f15c1ffb640 1 -- 172.21.15.92:0/1646819404 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15d401a750 con 0x556db59a4c80 2024-09-19T09:09:37.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.517+0000 7f15c1ffb640 1 -- 172.21.15.92:0/1646819404 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f15c8004910 con 0x556db59a4c80 2024-09-19T09:09:37.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.517+0000 7f15e2a48740 10 client.27586 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:09:37.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.517+0000 7f15e2a48740 10 client.27586 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:09:37.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.517+0000 7f15e2a48740 20 client.27586 populate_metadata read hostname 'smithi092' 2024-09-19T09:09:37.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.517+0000 7f15e2a48740 1 --2- 172.21.15.92:0/1646819404 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556db59c34b0 0x556db59c5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:37.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.517+0000 7f15e2a48740 4 client.27586 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:09:37.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.517+0000 7f15e2a48740 1 -- 172.21.15.92:0/1646819404 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556db5917850 con 0x556db59c34b0 2024-09-19T09:09:37.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.517+0000 7f15de40b640 1 --2- 172.21.15.92:0/1646819404 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556db59c34b0 0x556db59c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:37.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.518+0000 7f15c1ffb640 10 client.27586 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:37.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.518+0000 7f15de40b640 1 --2- 172.21.15.92:0/1646819404 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556db59c34b0 0x556db59c5910 crc :-1 s=READY pgs=392 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abb6a35a986544fc server_cookie=c2e37f013fc391af in_seq=0 out_seq=0 2024-09-19T09:09:37.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.518+0000 7f15c1ffb640 1 -- 172.21.15.92:0/1646819404 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556db5917850 con 0x556db59c34b0 2024-09-19T09:09:37.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.518+0000 7f15c1ffb640 10 client.27586 handle_command_reply: tid=0 2024-09-19T09:09:37.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.518+0000 7f15e2a48740 1 client.27586 shutdown 2024-09-19T09:09:37.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.518+0000 7f15e2a48740 1 -- 172.21.15.92:0/1646819404 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db59a4c80 msgr2=0x556db59b0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:37.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.518+0000 7f15e2a48740 1 --2- 172.21.15.92:0/1646819404 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db59a4c80 0x556db59b0670 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f15c8009900 tx=0x7f15c80315b0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.518+0000 7f15e2a48740 1 -- 172.21.15.92:0/1646819404 shutdown_connections 2024-09-19T09:09:37.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.518+0000 7f15e2a48740 1 --2- 172.21.15.92:0/1646819404 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556db59c34b0 0x556db59c5910 crc :-1 s=READY pgs=392 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.518+0000 7f15e2a48740 1 --2- 172.21.15.92:0/1646819404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556db59b3a90 0x556db59b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.518+0000 7f15c1ffb640 0 client.27586 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:37.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.518+0000 7f15e2a48740 1 --2- 172.21.15.92:0/1646819404 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db59a4c80 0x556db59b0670 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.518+0000 7f15e2a48740 1 --2- 172.21.15.92:0/1646819404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556db59a4360 0x556db59b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.518+0000 7f15e2a48740 1 -- 172.21.15.92:0/1646819404 >> 172.21.15.92:0/1646819404 conn(0x556db59a0a30 msgr2=0x556db59a6790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:37.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.518+0000 7f15e2a48740 1 -- 172.21.15.92:0/1646819404 shutdown_connections 2024-09-19T09:09:37.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.518+0000 7f15e2a48740 1 -- 172.21.15.92:0/1646819404 wait complete. 2024-09-19T09:09:37.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.519+0000 7f15e2a48740 20 client.27586 trim_cache size 0 max 16384 2024-09-19T09:09:37.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.535+0000 7f15e2a48740 1 Processor -- start 2024-09-19T09:09:37.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.535+0000 7f15e2a48740 1 -- start start 2024-09-19T09:09:37.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.536+0000 7f15e2a48740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556db59a4360 0x556db59bf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:37.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.536+0000 7f15e2a48740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db59a4c80 0x556db59af650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:37.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.536+0000 7f15e2a48740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556db59b3a90 0x556db59cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:37.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.536+0000 7f15e2a48740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f15d81a9480 con 0x556db59a4360 2024-09-19T09:09:37.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.536+0000 7f15e2a48740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f15d81abd20 con 0x556db59b3a90 2024-09-19T09:09:37.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.536+0000 7f15e2a48740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f15d81a9b10 con 0x556db59a4c80 2024-09-19T09:09:37.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.536+0000 7f15de40b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556db59a4360 0x556db59bf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:37.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.536+0000 7f15de40b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556db59a4360 0x556db59bf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60620/0 (socket says 172.21.15.92:60620) 2024-09-19T09:09:37.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.536+0000 7f15de40b640 1 -- 172.21.15.92:0/48045137 learned_addr learned my addr 172.21.15.92:0/48045137 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:37.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.536+0000 7f15ddc0a640 1 --2- 172.21.15.92:0/48045137 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db59a4c80 0x556db59af650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:37.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.536+0000 7f15dec0c640 1 --2- 172.21.15.92:0/48045137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556db59b3a90 0x556db59cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:37.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.536+0000 7f15de40b640 1 -- 172.21.15.92:0/48045137 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db59a4c80 msgr2=0x556db59af650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:37.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.536+0000 7f15de40b640 1 --2- 172.21.15.92:0/48045137 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db59a4c80 0x556db59af650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.536+0000 7f15de40b640 1 -- 172.21.15.92:0/48045137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556db59b3a90 msgr2=0x556db59cb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:37.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.536+0000 7f15de40b640 1 --2- 172.21.15.92:0/48045137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556db59b3a90 0x556db59cb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.536+0000 7f15de40b640 1 -- 172.21.15.92:0/48045137 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556db59a54b0 con 0x556db59a4360 2024-09-19T09:09:37.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.536+0000 7f15dec0c640 1 --2- 172.21.15.92:0/48045137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556db59b3a90 0x556db59cb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:09:37.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.536+0000 7f15de40b640 1 --2- 172.21.15.92:0/48045137 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556db59a4360 0x556db59bf8a0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f15d401c4d0 tx=0x7f15d4009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a20ee22a760b918f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:37.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.536+0000 7f15c3fff640 1 -- 172.21.15.92:0/48045137 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d4020040 con 0x556db59a4360 2024-09-19T09:09:37.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.537+0000 7f15c3fff640 1 -- 172.21.15.92:0/48045137 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15d40a4830 con 0x556db59a4360 2024-09-19T09:09:37.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.537+0000 7f15c3fff640 1 -- 172.21.15.92:0/48045137 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d40a43a0 con 0x556db59a4360 2024-09-19T09:09:37.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.537+0000 7f15e2a48740 1 -- 172.21.15.92:0/48045137 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556db59a4360 msgr2=0x556db59bf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:37.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.537+0000 7f15e2a48740 1 --2- 172.21.15.92:0/48045137 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556db59a4360 0x556db59bf8a0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f15d401c4d0 tx=0x7f15d4009740 comp rx=0 tx=0).stop 2024-09-19T09:09:37.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.537+0000 7f15e2a48740 1 -- 172.21.15.92:0/48045137 shutdown_connections 2024-09-19T09:09:37.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.537+0000 7f15e2a48740 1 --2- 172.21.15.92:0/48045137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556db59b3a90 0x556db59cb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.537+0000 7f15e2a48740 1 --2- 172.21.15.92:0/48045137 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db59a4c80 0x556db59af650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.537+0000 7f15e2a48740 1 --2- 172.21.15.92:0/48045137 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556db59a4360 0x556db59bf8a0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.537+0000 7f15e2a48740 1 -- 172.21.15.92:0/48045137 >> 172.21.15.92:0/48045137 conn(0x556db59a0a30 msgr2=0x556db59aef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:37.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.537+0000 7f15e2a48740 1 -- 172.21.15.92:0/48045137 shutdown_connections 2024-09-19T09:09:37.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.537+0000 7f15e2a48740 1 -- 172.21.15.92:0/48045137 wait complete. 2024-09-19T09:09:37.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.538+0000 7f15e2a48740 1 -- start start 2024-09-19T09:09:37.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.538+0000 7f15e2a48740 1 Processor -- start 2024-09-19T09:09:37.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.538+0000 7f15e2a48740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db59a4360 0x556db59b6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:37.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.538+0000 7f15e2a48740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556db59a4c80 0x556db59b74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:37.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.538+0000 7f15e2a48740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556db59b3a90 0x556db5a2c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:37.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.538+0000 7f15e2a48740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f15d81aa1e0 con 0x556db59b3a90 2024-09-19T09:09:37.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.538+0000 7f15e2a48740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f15d81ab650 con 0x556db59a4c80 2024-09-19T09:09:37.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.538+0000 7f15e2a48740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f15d81aa8b0 con 0x556db59a4360 2024-09-19T09:09:37.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.538+0000 7f15e2a48740 10 client.0 _ll_register_callbacks cb 0x7f15c8032c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:09:37.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.538+0000 7f15dec0c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556db59b3a90 0x556db5a2c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:37.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.538+0000 7f15dec0c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556db59b3a90 0x556db5a2c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60632/0 (socket says 172.21.15.92:60632) 2024-09-19T09:09:37.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.538+0000 7f15dec0c640 1 -- 172.21.15.92:0/3102604715 learned_addr learned my addr 172.21.15.92:0/3102604715 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:37.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.538+0000 7f15de40b640 1 --2- 172.21.15.92:0/3102604715 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db59a4360 0x556db59b6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:37.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.538+0000 7f15ddc0a640 1 --2- 172.21.15.92:0/3102604715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556db59a4c80 0x556db59b74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:37.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.538+0000 7f15dec0c640 1 -- 172.21.15.92:0/3102604715 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db59a4360 msgr2=0x556db59b6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:37.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.538+0000 7f15dec0c640 1 --2- 172.21.15.92:0/3102604715 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db59a4360 0x556db59b6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.538+0000 7f15dec0c640 1 -- 172.21.15.92:0/3102604715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556db59a4c80 msgr2=0x556db59b74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:37.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.538+0000 7f15dec0c640 1 --2- 172.21.15.92:0/3102604715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556db59a4c80 0x556db59b74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.538+0000 7f15dec0c640 1 -- 172.21.15.92:0/3102604715 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556db5a2c760 con 0x556db59b3a90 2024-09-19T09:09:37.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.539+0000 7f15dec0c640 1 --2- 172.21.15.92:0/3102604715 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556db59b3a90 0x556db5a2c1a0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f15d00109b0 tx=0x7f15d0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a7dcc4f67ec1715 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:37.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.539+0000 7f15c1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:09:37.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.539+0000 7f15c1ffb640 1 -- 172.21.15.92:0/3102604715 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d0013340 con 0x556db59b3a90 2024-09-19T09:09:37.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.539+0000 7f15c1ffb640 1 -- 172.21.15.92:0/3102604715 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f15d0011b50 con 0x556db59b3a90 2024-09-19T09:09:37.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.539+0000 7f15e2a48740 1 -- 172.21.15.92:0/3102604715 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15d40a4830 con 0x556db59b3a90 2024-09-19T09:09:37.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.539+0000 7f15c1ffb640 1 -- 172.21.15.92:0/3102604715 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f15d0011d50 con 0x556db59b3a90 2024-09-19T09:09:37.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.539+0000 7f15e2a48740 10 client.18468 fetch_fsmap learned FSMap version 19 2024-09-19T09:09:37.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.539+0000 7f15e2a48740 1 -- 172.21.15.92:0/3102604715 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x556db5a2dab0 con 0x556db59b3a90 2024-09-19T09:09:37.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.539+0000 7f15c1ffb640 1 -- 172.21.15.92:0/3102604715 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15d40a4830 con 0x556db59b3a90 2024-09-19T09:09:37.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.539+0000 7f15c1ffb640 1 -- 172.21.15.92:0/3102604715 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f15d0027070 con 0x556db59b3a90 2024-09-19T09:09:37.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.539+0000 7f15e2a48740 10 client.18468 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:09:37.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.539+0000 7f15e2a48740 10 client.18468 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:09:37.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.539+0000 7f15e2a48740 20 client.18468 populate_metadata read hostname 'smithi092' 2024-09-19T09:09:37.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.539+0000 7f15e2a48740 1 --2- 172.21.15.92:0/3102604715 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556db5a2e280 0x556db5a306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:37.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.539+0000 7f15e2a48740 4 client.18468 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:09:37.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.539+0000 7f15e2a48740 1 -- 172.21.15.92:0/3102604715 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556db5911d60 con 0x556db5a2e280 2024-09-19T09:09:37.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.540+0000 7f15de40b640 1 --2- 172.21.15.92:0/3102604715 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556db5a2e280 0x556db5a306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:37.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.540+0000 7f15c1ffb640 10 client.18468 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:37.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.540+0000 7f15de40b640 1 --2- 172.21.15.92:0/3102604715 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556db5a2e280 0x556db5a306a0 crc :-1 s=READY pgs=393 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e202e2dacf04a8 server_cookie=ecbafbc01ce3ca76 in_seq=0 out_seq=0 2024-09-19T09:09:37.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.540+0000 7f15c1ffb640 1 -- 172.21.15.92:0/3102604715 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x556db5911d60 con 0x556db5a2e280 2024-09-19T09:09:37.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.540+0000 7f15c1ffb640 10 client.18468 handle_command_reply: tid=0 2024-09-19T09:09:37.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.540+0000 7f15e2a48740 1 client.18468 shutdown 2024-09-19T09:09:37.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.540+0000 7f15e2a48740 1 -- 172.21.15.92:0/3102604715 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556db59b3a90 msgr2=0x556db5a2c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:37.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.540+0000 7f15e2a48740 1 --2- 172.21.15.92:0/3102604715 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556db59b3a90 0x556db5a2c1a0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f15d00109b0 tx=0x7f15d0004ab0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.540+0000 7f15e2a48740 1 -- 172.21.15.92:0/3102604715 shutdown_connections 2024-09-19T09:09:37.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.540+0000 7f15e2a48740 1 --2- 172.21.15.92:0/3102604715 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556db5a2e280 0x556db5a306a0 crc :-1 s=READY pgs=393 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.540+0000 7f15e2a48740 1 --2- 172.21.15.92:0/3102604715 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556db59b3a90 0x556db5a2c1a0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.540+0000 7f15c1ffb640 0 client.18468 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:37.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.541+0000 7f15e2a48740 1 --2- 172.21.15.92:0/3102604715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556db59a4c80 0x556db59b74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.541+0000 7f15e2a48740 1 --2- 172.21.15.92:0/3102604715 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556db59a4360 0x556db59b6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.541+0000 7f15e2a48740 1 -- 172.21.15.92:0/3102604715 >> 172.21.15.92:0/3102604715 conn(0x556db59a0a30 msgr2=0x556db59af760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:37.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.541+0000 7f15e2a48740 1 -- 172.21.15.92:0/3102604715 shutdown_connections 2024-09-19T09:09:37.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.541+0000 7f15e2a48740 1 -- 172.21.15.92:0/3102604715 wait complete. 2024-09-19T09:09:37.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.541+0000 7f15e2a48740 20 client.18468 trim_cache size 0 max 16384 2024-09-19T09:09:37.550 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:09:37.551 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:09:37.551 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": { 2024-09-19T09:09:37.551 INFO:teuthology.orchestra.run.smithi092.stdout: "2ab276b0-e73c-4ac8-9c2b-05a8248426bc": { 2024-09-19T09:09:37.551 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-19T09:09:37.551 INFO:teuthology.orchestra.run.smithi092.stdout: "tag": "2ab276b0-e73c-4ac8-9c2b-05a8248426bc", 2024-09-19T09:09:37.551 INFO:teuthology.orchestra.run.smithi092.stdout: "options": "recursive,force" 2024-09-19T09:09:37.551 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:09:37.551 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:09:37.551 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:09:37.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.541+0000 7f15e066f640 1 -- 172.21.15.92:0/1519871778 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f15c40a3240 msgr2=0x7f15c40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:37.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.541+0000 7f15e066f640 1 --2- 172.21.15.92:0/1519871778 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f15c40a3240 0x7f15c40a5700 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f15d0009fd0 tx=0x7f15d0004a40 comp rx=0 tx=0).stop 2024-09-19T09:09:37.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.541+0000 7f15e066f640 1 -- 172.21.15.92:0/1519871778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15d8102d30 msgr2=0x7f15d81985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:37.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.541+0000 7f15e066f640 1 --2- 172.21.15.92:0/1519871778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15d8102d30 0x7f15d81985a0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f15d400d950 tx=0x7f15d400de10 comp rx=0 tx=0).stop 2024-09-19T09:09:37.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.541+0000 7f15e066f640 1 -- 172.21.15.92:0/1519871778 shutdown_connections 2024-09-19T09:09:37.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.541+0000 7f15e066f640 1 --2- 172.21.15.92:0/1519871778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15d81082a0 0x7f15d819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.541+0000 7f15e066f640 1 --2- 172.21.15.92:0/1519871778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15d81036e0 0x7f15d8198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.541+0000 7f15e066f640 1 --2- 172.21.15.92:0/1519871778 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f15c40a3240 0x7f15c40a5700 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.541+0000 7f15e066f640 1 --2- 172.21.15.92:0/1519871778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15d8102d30 0x7f15d81985a0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.541+0000 7f15e066f640 1 -- 172.21.15.92:0/1519871778 >> 172.21.15.92:0/1519871778 conn(0x7f15d80fc7d0 msgr2=0x7f15d8105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:37.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.542+0000 7f15e066f640 1 -- 172.21.15.92:0/1519871778 shutdown_connections 2024-09-19T09:09:37.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:37.542+0000 7f15e066f640 1 -- 172.21.15.92:0/1519871778 wait complete. 2024-09-19T09:09:37.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:37 smithi092 ceph-mon[31407]: scrub queued for path: / 2024-09-19T09:09:37.810 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:37 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:09:37.810 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:37 smithi092 ceph-mon[31407]: scrub summary: active paths [/] 2024-09-19T09:09:37.810 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:37 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:09:38.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:37 smithi167 ceph-mon[35359]: scrub queued for path: / 2024-09-19T09:09:38.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:37 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:09:38.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:37 smithi167 ceph-mon[35359]: scrub summary: active paths [/] 2024-09-19T09:09:38.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:37 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:09:38.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:37 smithi190 ceph-mon[35358]: scrub queued for path: / 2024-09-19T09:09:38.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:37 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:09:38.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:37 smithi190 ceph-mon[35358]: scrub summary: active paths [/] 2024-09-19T09:09:38.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:37 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:09:38.173 INFO:tasks.cephfs.filesystem:scrub status for tag:2ab276b0-e73c-4ac8-9c2b-05a8248426bc - {'path': '/', 'tag': '2ab276b0-e73c-4ac8-9c2b-05a8248426bc', 'options': 'recursive,force'} 2024-09-19T09:09:39.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:38 smithi092 ceph-mon[31407]: pgmap v725: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 8.9 MiB/s wr, 287 op/s 2024-09-19T09:09:39.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:38 smithi167 ceph-mon[35359]: pgmap v725: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 8.9 MiB/s wr, 287 op/s 2024-09-19T09:09:39.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:38 smithi190 ceph-mon[35358]: pgmap v725: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 8.9 MiB/s wr, 287 op/s 2024-09-19T09:09:39.310 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:09:39.556 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:09:39.987 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:39 smithi092 ceph-mon[31407]: scrub summary: idle 2024-09-19T09:09:39.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.986+0000 7f7f846bf640 1 -- 172.21.15.92:0/2459229124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f7c103660 msgr2=0x7f7f7c10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:39.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.986+0000 7f7f846bf640 1 --2- 172.21.15.92:0/2459229124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f7c103660 0x7f7f7c10bb50 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f7f70009900 tx=0x7f7f7002a480 comp rx=0 tx=0).stop 2024-09-19T09:09:39.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.986+0000 7f7f846bf640 1 -- 172.21.15.92:0/2459229124 shutdown_connections 2024-09-19T09:09:39.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.986+0000 7f7f846bf640 1 --2- 172.21.15.92:0/2459229124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f7c10c170 0x7f7f7c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:39.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.986+0000 7f7f846bf640 1 --2- 172.21.15.92:0/2459229124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f7c103660 0x7f7f7c10bb50 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:39.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.986+0000 7f7f846bf640 1 --2- 172.21.15.92:0/2459229124 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f7c102d40 0x7f7f7c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:39.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.986+0000 7f7f846bf640 1 -- 172.21.15.92:0/2459229124 >> 172.21.15.92:0/2459229124 conn(0x7f7f7c0fc7a0 msgr2=0x7f7f7c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:39.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.986+0000 7f7f846bf640 1 -- 172.21.15.92:0/2459229124 shutdown_connections 2024-09-19T09:09:39.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.986+0000 7f7f846bf640 1 -- 172.21.15.92:0/2459229124 wait complete. 2024-09-19T09:09:39.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.987+0000 7f7f846bf640 1 Processor -- start 2024-09-19T09:09:39.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.987+0000 7f7f846bf640 1 -- start start 2024-09-19T09:09:39.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.987+0000 7f7f846bf640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f7c102d40 0x7f7f7c19a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:39.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.987+0000 7f7f846bf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f7c103660 0x7f7f7c19ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:39.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.987+0000 7f7f846bf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f7c10c170 0x7f7f7c19efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:39.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.987+0000 7f7f846bf640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7c111f70 con 0x7f7f7c10c170 2024-09-19T09:09:39.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.987+0000 7f7f846bf640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7c111df0 con 0x7f7f7c103660 2024-09-19T09:09:39.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.987+0000 7f7f846bf640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7c1120f0 con 0x7f7f7c102d40 2024-09-19T09:09:39.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.987+0000 7f7f82c5c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f7c10c170 0x7f7f7c19efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:39.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.987+0000 7f7f82c5c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f7c10c170 0x7f7f7c19efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60650/0 (socket says 172.21.15.92:60650) 2024-09-19T09:09:39.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.987+0000 7f7f82c5c640 1 -- 172.21.15.92:0/124118949 learned_addr learned my addr 172.21.15.92:0/124118949 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:39.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.987+0000 7f7f81c5a640 1 --2- 172.21.15.92:0/124118949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f7c103660 0x7f7f7c19ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:39.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.987+0000 7f7f8245b640 1 --2- 172.21.15.92:0/124118949 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f7c102d40 0x7f7f7c19a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:39.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.987+0000 7f7f82c5c640 1 -- 172.21.15.92:0/124118949 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f7c102d40 msgr2=0x7f7f7c19a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:39.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.987+0000 7f7f82c5c640 1 --2- 172.21.15.92:0/124118949 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f7c102d40 0x7f7f7c19a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:39.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.987+0000 7f7f82c5c640 1 -- 172.21.15.92:0/124118949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f7c103660 msgr2=0x7f7f7c19ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:39.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.987+0000 7f7f82c5c640 1 --2- 172.21.15.92:0/124118949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f7c103660 0x7f7f7c19ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:39.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.987+0000 7f7f82c5c640 1 -- 172.21.15.92:0/124118949 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f7c19f680 con 0x7f7f7c10c170 2024-09-19T09:09:39.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.988+0000 7f7f82c5c640 1 --2- 172.21.15.92:0/124118949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f7c10c170 0x7f7f7c19efa0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c00eaa0 tx=0x7f7f6c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:39.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.988+0000 7f7f7b7fe640 1 -- 172.21.15.92:0/124118949 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c00cdb0 con 0x7f7f7c10c170 2024-09-19T09:09:39.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.988+0000 7f7f846bf640 1 -- 172.21.15.92:0/124118949 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f7c19f970 con 0x7f7f7c10c170 2024-09-19T09:09:39.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.988+0000 7f7f7b7fe640 1 -- 172.21.15.92:0/124118949 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f6c005020 con 0x7f7f7c10c170 2024-09-19T09:09:39.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.988+0000 7f7f7b7fe640 1 -- 172.21.15.92:0/124118949 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c0116b0 con 0x7f7f7c10c170 2024-09-19T09:09:39.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.988+0000 7f7f846bf640 1 -- 172.21.15.92:0/124118949 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f7c1a7250 con 0x7f7f7c10c170 2024-09-19T09:09:39.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.989+0000 7f7f846bf640 1 -- 172.21.15.92:0/124118949 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f7c103120 con 0x7f7f7c10c170 2024-09-19T09:09:39.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.990+0000 7f7f7b7fe640 1 -- 172.21.15.92:0/124118949 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7f6c005560 con 0x7f7f7c10c170 2024-09-19T09:09:39.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.990+0000 7f7f7b7fe640 1 --2- 172.21.15.92:0/124118949 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7f640a3240 0x7f7f640a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:39.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.991+0000 7f7f8245b640 1 --2- 172.21.15.92:0/124118949 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7f640a3240 0x7f7f640a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:39.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.991+0000 7f7f7b7fe640 1 -- 172.21.15.92:0/124118949 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f7f6c0cfb40 con 0x7f7f7c10c170 2024-09-19T09:09:39.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.991+0000 7f7f8245b640 1 --2- 172.21.15.92:0/124118949 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7f640a3240 0x7f7f640a5700 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7f74005fd0 tx=0x7f7f74005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:39.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:39.995+0000 7f7f7b7fe640 1 -- 172.21.15.92:0/124118949 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7f6c016030 con 0x7f7f7c10c170 2024-09-19T09:09:40.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:39 smithi167 ceph-mon[35359]: scrub summary: idle 2024-09-19T09:09:40.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:39 smithi190 ceph-mon[35358]: scrub summary: idle 2024-09-19T09:09:40.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:40.195+0000 7f7f846bf640 1 -- 172.21.15.92:0/124118949 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7f7c1a74b0 con 0x7f7f7c10c170 2024-09-19T09:09:40.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:40.196+0000 7f7f7b7fe640 1 -- 172.21.15.92:0/124118949 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f7f6c09c820 con 0x7f7f7c10c170 2024-09-19T09:09:40.198 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:09:40.198 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:09:40.199 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:09:40.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:40.198+0000 7f7f846bf640 1 -- 172.21.15.92:0/124118949 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7f640a3240 msgr2=0x7f7f640a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:40.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:40.198+0000 7f7f846bf640 1 --2- 172.21.15.92:0/124118949 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7f640a3240 0x7f7f640a5700 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7f74005fd0 tx=0x7f7f74005850 comp rx=0 tx=0).stop 2024-09-19T09:09:40.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:40.198+0000 7f7f846bf640 1 -- 172.21.15.92:0/124118949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f7c10c170 msgr2=0x7f7f7c19efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:40.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:40.198+0000 7f7f846bf640 1 --2- 172.21.15.92:0/124118949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f7c10c170 0x7f7f7c19efa0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c00eaa0 tx=0x7f7f6c00ef60 comp rx=0 tx=0).stop 2024-09-19T09:09:40.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:40.198+0000 7f7f846bf640 1 -- 172.21.15.92:0/124118949 shutdown_connections 2024-09-19T09:09:40.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:40.198+0000 7f7f846bf640 1 --2- 172.21.15.92:0/124118949 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f7f640a3240 0x7f7f640a5700 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:40.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:40.198+0000 7f7f846bf640 1 --2- 172.21.15.92:0/124118949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f7c10c170 0x7f7f7c19efa0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:40.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:40.198+0000 7f7f846bf640 1 --2- 172.21.15.92:0/124118949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f7c103660 0x7f7f7c19ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:40.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:40.198+0000 7f7f846bf640 1 --2- 172.21.15.92:0/124118949 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f7c102d40 0x7f7f7c19a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:40.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:40.198+0000 7f7f846bf640 1 -- 172.21.15.92:0/124118949 >> 172.21.15.92:0/124118949 conn(0x7f7f7c0fc7a0 msgr2=0x7f7f7c0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:40.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:40.198+0000 7f7f846bf640 1 -- 172.21.15.92:0/124118949 shutdown_connections 2024-09-19T09:09:40.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:40.198+0000 7f7f846bf640 1 -- 172.21.15.92:0/124118949 wait complete. 2024-09-19T09:09:40.791 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id be738a60 --release --await' 2024-09-19T09:09:40.791 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id be738a60 --release --await 2024-09-19T09:09:40.799 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:09:41.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:40 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/124118949' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:09:41.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:40 smithi092 ceph-mon[31407]: pgmap v726: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 15 MiB/s wr, 489 op/s 2024-09-19T09:09:41.037 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:09:41.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:40 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/124118949' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:09:41.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:40 smithi167 ceph-mon[35359]: pgmap v726: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 15 MiB/s wr, 489 op/s 2024-09-19T09:09:41.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:40 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/124118949' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:09:41.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:40 smithi190 ceph-mon[35358]: pgmap v726: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 15 MiB/s wr, 489 op/s 2024-09-19T09:09:41.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.496+0000 7ff745233640 1 -- 172.21.15.92:0/679113064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff740102d40 msgr2=0x7ff740103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:41.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.496+0000 7ff745233640 1 --2- 172.21.15.92:0/679113064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff740102d40 0x7ff740103120 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7ff730009900 tx=0x7ff73002a480 comp rx=0 tx=0).stop 2024-09-19T09:09:41.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.496+0000 7ff745233640 1 -- 172.21.15.92:0/679113064 shutdown_connections 2024-09-19T09:09:41.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.496+0000 7ff745233640 1 --2- 172.21.15.92:0/679113064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff74010c170 0x7ff74010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:41.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.496+0000 7ff745233640 1 --2- 172.21.15.92:0/679113064 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff740103660 0x7ff74010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:41.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.496+0000 7ff745233640 1 --2- 172.21.15.92:0/679113064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff740102d40 0x7ff740103120 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:41.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.496+0000 7ff745233640 1 -- 172.21.15.92:0/679113064 >> 172.21.15.92:0/679113064 conn(0x7ff7400fc7a0 msgr2=0x7ff7400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:41.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.496+0000 7ff745233640 1 -- 172.21.15.92:0/679113064 shutdown_connections 2024-09-19T09:09:41.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.497+0000 7ff745233640 1 -- 172.21.15.92:0/679113064 wait complete. 2024-09-19T09:09:41.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.497+0000 7ff745233640 1 Processor -- start 2024-09-19T09:09:41.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.497+0000 7ff745233640 1 -- start start 2024-09-19T09:09:41.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.498+0000 7ff745233640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff740102d40 0x7ff740198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:41.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.498+0000 7ff745233640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff740103660 0x7ff740198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:41.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.498+0000 7ff745233640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff74010c170 0x7ff74019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:41.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.498+0000 7ff745233640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff740111f70 con 0x7ff74010c170 2024-09-19T09:09:41.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.498+0000 7ff745233640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff740111df0 con 0x7ff740102d40 2024-09-19T09:09:41.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.498+0000 7ff745233640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff7401120f0 con 0x7ff740103660 2024-09-19T09:09:41.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.498+0000 7ff73f59e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff74010c170 0x7ff74019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:41.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.498+0000 7ff73f59e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff74010c170 0x7ff74019cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34508/0 (socket says 172.21.15.92:34508) 2024-09-19T09:09:41.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.498+0000 7ff73f59e640 1 -- 172.21.15.92:0/2140921560 learned_addr learned my addr 172.21.15.92:0/2140921560 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:41.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.498+0000 7ff73e59c640 1 --2- 172.21.15.92:0/2140921560 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff740103660 0x7ff740198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:41.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.498+0000 7ff73ed9d640 1 --2- 172.21.15.92:0/2140921560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff740102d40 0x7ff740198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:41.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.498+0000 7ff73f59e640 1 -- 172.21.15.92:0/2140921560 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff740103660 msgr2=0x7ff740198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:41.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.498+0000 7ff73f59e640 1 --2- 172.21.15.92:0/2140921560 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff740103660 0x7ff740198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:41.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.498+0000 7ff73f59e640 1 -- 172.21.15.92:0/2140921560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff740102d40 msgr2=0x7ff740198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:41.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.498+0000 7ff73f59e640 1 --2- 172.21.15.92:0/2140921560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff740102d40 0x7ff740198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:41.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.498+0000 7ff73f59e640 1 -- 172.21.15.92:0/2140921560 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff74019d3e0 con 0x7ff74010c170 2024-09-19T09:09:41.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.498+0000 7ff73f59e640 1 --2- 172.21.15.92:0/2140921560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff74010c170 0x7ff74019cd00 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7ff73800eaa0 tx=0x7ff73800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:41.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.498+0000 7ff727fff640 1 -- 172.21.15.92:0/2140921560 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73800cdb0 con 0x7ff74010c170 2024-09-19T09:09:41.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.498+0000 7ff745233640 1 -- 172.21.15.92:0/2140921560 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff74019d6d0 con 0x7ff74010c170 2024-09-19T09:09:41.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.498+0000 7ff727fff640 1 -- 172.21.15.92:0/2140921560 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff738005020 con 0x7ff74010c170 2024-09-19T09:09:41.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.498+0000 7ff727fff640 1 -- 172.21.15.92:0/2140921560 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7380116b0 con 0x7ff74010c170 2024-09-19T09:09:41.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.499+0000 7ff745233640 1 -- 172.21.15.92:0/2140921560 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7401a4fb0 con 0x7ff74010c170 2024-09-19T09:09:41.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.501+0000 7ff727fff640 1 -- 172.21.15.92:0/2140921560 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff738005560 con 0x7ff74010c170 2024-09-19T09:09:41.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.501+0000 7ff74760c740 1 Processor -- start 2024-09-19T09:09:41.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.502+0000 7ff74760c740 1 -- start start 2024-09-19T09:09:41.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.502+0000 7ff74760c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556c3e2df40 0x5556c3e2e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:41.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.502+0000 7ff74760c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5556c3e2e860 0x5556c3e3d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:41.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.502+0000 7ff74760c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556c3e3d650 0x5556c3e3fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:41.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.502+0000 7ff74760c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5556c3d93620 con 0x5556c3e2df40 2024-09-19T09:09:41.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.502+0000 7ff74760c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5556c3d3ae50 con 0x5556c3e3d650 2024-09-19T09:09:41.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.502+0000 7ff74760c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5556c3d8f5e0 con 0x5556c3e2e860 2024-09-19T09:09:41.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.502+0000 7ff73e59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556c3e2df40 0x5556c3e2e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:41.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.502+0000 7ff73e59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556c3e2df40 0x5556c3e2e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34522/0 (socket says 172.21.15.92:34522) 2024-09-19T09:09:41.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.502+0000 7ff73e59c640 1 -- 172.21.15.92:0/1674419591 learned_addr learned my addr 172.21.15.92:0/1674419591 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:41.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.502+0000 7ff727fff640 1 --2- 172.21.15.92:0/2140921560 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff7280a3240 0x7ff7280a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:41.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.502+0000 7ff73ed9d640 1 --2- 172.21.15.92:0/1674419591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5556c3e2e860 0x5556c3e3d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:41.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.502+0000 7ff73f59e640 1 --2- 172.21.15.92:0/2140921560 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff7280a3240 0x7ff7280a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:41.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.502+0000 7ff73e59c640 1 --2- 172.21.15.92:0/1674419591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556c3e3d650 0x5556c3e3fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:41.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.502+0000 7ff727fff640 1 -- 172.21.15.92:0/2140921560 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff7380cfa70 con 0x7ff74010c170 2024-09-19T09:09:41.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.502+0000 7ff73e59c640 1 -- 172.21.15.92:0/1674419591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5556c3e2e860 msgr2=0x5556c3e3d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:41.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.502+0000 7ff73e59c640 1 --2- 172.21.15.92:0/1674419591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5556c3e2e860 0x5556c3e3d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:41.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.502+0000 7ff73e59c640 1 -- 172.21.15.92:0/1674419591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556c3e3d650 msgr2=0x5556c3e3fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:41.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.502+0000 7ff73e59c640 1 --2- 172.21.15.92:0/1674419591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556c3e3d650 0x5556c3e3fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:41.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.502+0000 7ff73e59c640 1 -- 172.21.15.92:0/1674419591 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556c3d2bd40 con 0x5556c3e2df40 2024-09-19T09:09:41.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.503+0000 7ff73e59c640 1 --2- 172.21.15.92:0/1674419591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556c3e2df40 0x5556c3e2e320 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7ff734004650 tx=0x7ff734004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f64af0418ac53d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:41.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.503+0000 7ff73f59e640 1 --2- 172.21.15.92:0/2140921560 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff7280a3240 0x7ff7280a5700 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ff7380985a0 tx=0x7ff7380bc040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:41.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.503+0000 7ff7257fa640 1 -- 172.21.15.92:0/1674419591 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff734005020 con 0x5556c3e2df40 2024-09-19T09:09:41.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.503+0000 7ff7257fa640 1 -- 172.21.15.92:0/1674419591 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7340056a0 con 0x5556c3e2df40 2024-09-19T09:09:41.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.503+0000 7ff7257fa640 1 -- 172.21.15.92:0/1674419591 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7340106c0 con 0x5556c3e2df40 2024-09-19T09:09:41.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.503+0000 7ff74760c740 1 -- 172.21.15.92:0/1674419591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556c3e2df40 msgr2=0x5556c3e2e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:41.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.503+0000 7ff74760c740 1 --2- 172.21.15.92:0/1674419591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556c3e2df40 0x5556c3e2e320 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7ff734004650 tx=0x7ff734004250 comp rx=0 tx=0).stop 2024-09-19T09:09:41.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.504+0000 7ff74760c740 1 -- 172.21.15.92:0/1674419591 shutdown_connections 2024-09-19T09:09:41.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.504+0000 7ff74760c740 1 --2- 172.21.15.92:0/1674419591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556c3e3d650 0x5556c3e3fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:41.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.504+0000 7ff74760c740 1 --2- 172.21.15.92:0/1674419591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5556c3e2e860 0x5556c3e3d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:41.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.504+0000 7ff74760c740 1 --2- 172.21.15.92:0/1674419591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556c3e2df40 0x5556c3e2e320 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:41.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.504+0000 7ff74760c740 1 -- 172.21.15.92:0/1674419591 >> 172.21.15.92:0/1674419591 conn(0x5556c3e2a5f0 msgr2=0x5556c3e2a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:41.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.504+0000 7ff74760c740 1 -- 172.21.15.92:0/1674419591 shutdown_connections 2024-09-19T09:09:41.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.504+0000 7ff74760c740 1 -- 172.21.15.92:0/1674419591 wait complete. 2024-09-19T09:09:41.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.504+0000 7ff74760c740 1 -- start start 2024-09-19T09:09:41.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.504+0000 7ff74760c740 1 Processor -- start 2024-09-19T09:09:41.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.504+0000 7ff74760c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556c3e2df40 0x5556c3e3a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:41.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.504+0000 7ff74760c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556c3e2e860 0x5556c3e3aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:41.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.504+0000 7ff74760c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5556c3e3d650 0x5556c3e3af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:41.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.504+0000 7ff74760c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5556c3e40220 con 0x5556c3e2df40 2024-09-19T09:09:41.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.504+0000 7ff74760c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5556c3d1bf10 con 0x5556c3e2e860 2024-09-19T09:09:41.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.504+0000 7ff74760c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5556c3e403a0 con 0x5556c3e3d650 2024-09-19T09:09:41.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.504+0000 7ff74760c740 10 client.0 _ll_register_callbacks cb 0x5556c3d3fdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:09:41.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.504+0000 7ff73e59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556c3e2df40 0x5556c3e3a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:41.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.504+0000 7ff73e59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556c3e2df40 0x5556c3e3a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34536/0 (socket says 172.21.15.92:34536) 2024-09-19T09:09:41.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.504+0000 7ff73e59c640 1 -- 172.21.15.92:0/77352615 learned_addr learned my addr 172.21.15.92:0/77352615 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:41.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.504+0000 7ff73ed9d640 1 --2- 172.21.15.92:0/77352615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556c3e2e860 0x5556c3e3aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:41.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.505+0000 7ff73e59c640 1 --2- 172.21.15.92:0/77352615 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5556c3e3d650 0x5556c3e3af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:41.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.505+0000 7ff73e59c640 1 -- 172.21.15.92:0/77352615 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5556c3e3d650 msgr2=0x5556c3e3af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:41.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.505+0000 7ff73e59c640 1 --2- 172.21.15.92:0/77352615 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5556c3e3d650 0x5556c3e3af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:41.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.505+0000 7ff73e59c640 1 -- 172.21.15.92:0/77352615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556c3e2e860 msgr2=0x5556c3e3aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:41.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.505+0000 7ff73e59c640 1 --2- 172.21.15.92:0/77352615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556c3e2e860 0x5556c3e3aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:41.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.505+0000 7ff73e59c640 1 -- 172.21.15.92:0/77352615 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556c3aa2580 con 0x5556c3e2df40 2024-09-19T09:09:41.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.505+0000 7ff73e59c640 1 --2- 172.21.15.92:0/77352615 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556c3e2df40 0x5556c3e3a4f0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7ff734004fa0 tx=0x7ff734005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0cc1dadee330ec7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:41.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.505+0000 7ff722ff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:09:41.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.505+0000 7ff722ff5640 1 -- 172.21.15.92:0/77352615 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff734005200 con 0x5556c3e2df40 2024-09-19T09:09:41.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.505+0000 7ff722ff5640 1 -- 172.21.15.92:0/77352615 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff7340053a0 con 0x5556c3e2df40 2024-09-19T09:09:41.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.505+0000 7ff74760c740 1 -- 172.21.15.92:0/77352615 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7340056a0 con 0x5556c3e2df40 2024-09-19T09:09:41.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.505+0000 7ff722ff5640 1 -- 172.21.15.92:0/77352615 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff7340049d0 con 0x5556c3e2df40 2024-09-19T09:09:41.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.505+0000 7ff74760c740 10 client.18486 fetch_fsmap learned FSMap version 19 2024-09-19T09:09:41.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.505+0000 7ff74760c740 1 -- 172.21.15.92:0/77352615 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5556c3b6c960 con 0x5556c3e2df40 2024-09-19T09:09:41.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.505+0000 7ff722ff5640 1 -- 172.21.15.92:0/77352615 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7340056a0 con 0x5556c3e2df40 2024-09-19T09:09:41.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.505+0000 7ff722ff5640 1 -- 172.21.15.92:0/77352615 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff73401d480 con 0x5556c3e2df40 2024-09-19T09:09:41.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.505+0000 7ff74760c740 10 client.18486 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:09:41.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.506+0000 7ff74760c740 10 client.18486 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:09:41.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.506+0000 7ff74760c740 20 client.18486 populate_metadata read hostname 'smithi092' 2024-09-19T09:09:41.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.506+0000 7ff74760c740 1 --2- 172.21.15.92:0/77352615 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5556c3e4d040 0x5556c3e4f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:41.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.506+0000 7ff74760c740 4 client.18486 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:09:41.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.506+0000 7ff74760c740 1 -- 172.21.15.92:0/77352615 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556c3da0b90 con 0x5556c3e4d040 2024-09-19T09:09:41.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.506+0000 7ff73ed9d640 1 --2- 172.21.15.92:0/77352615 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5556c3e4d040 0x5556c3e4f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:41.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.506+0000 7ff73ed9d640 1 --2- 172.21.15.92:0/77352615 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5556c3e4d040 0x5556c3e4f430 crc :-1 s=READY pgs=394 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da24491f9fed7d7 server_cookie=c8b68c38ee8911d9 in_seq=0 out_seq=0 2024-09-19T09:09:41.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.506+0000 7ff722ff5640 10 client.18486 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:41.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.507+0000 7ff722ff5640 1 -- 172.21.15.92:0/77352615 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5556c3da0b90 con 0x5556c3e4d040 2024-09-19T09:09:41.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.507+0000 7ff722ff5640 10 client.18486 handle_command_reply: tid=0 2024-09-19T09:09:41.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.507+0000 7ff74760c740 1 client.18486 shutdown 2024-09-19T09:09:41.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.507+0000 7ff74760c740 1 -- 172.21.15.92:0/77352615 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556c3e2df40 msgr2=0x5556c3e3a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:41.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.507+0000 7ff74760c740 1 --2- 172.21.15.92:0/77352615 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556c3e2df40 0x5556c3e3a4f0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7ff734004fa0 tx=0x7ff734005f30 comp rx=0 tx=0).stop 2024-09-19T09:09:41.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.507+0000 7ff74760c740 1 -- 172.21.15.92:0/77352615 shutdown_connections 2024-09-19T09:09:41.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.507+0000 7ff74760c740 1 --2- 172.21.15.92:0/77352615 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5556c3e4d040 0x5556c3e4f430 crc :-1 s=READY pgs=394 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:41.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.507+0000 7ff74760c740 1 --2- 172.21.15.92:0/77352615 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5556c3e3d650 0x5556c3e3af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:41.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.507+0000 7ff722ff5640 0 client.18486 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:41.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.507+0000 7ff74760c740 1 --2- 172.21.15.92:0/77352615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556c3e2e860 0x5556c3e3aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:41.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.507+0000 7ff74760c740 1 --2- 172.21.15.92:0/77352615 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556c3e2df40 0x5556c3e3a4f0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:41.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.507+0000 7ff74760c740 1 -- 172.21.15.92:0/77352615 >> 172.21.15.92:0/77352615 conn(0x5556c3e2a5f0 msgr2=0x5556c3e30350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:41.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.507+0000 7ff74760c740 1 -- 172.21.15.92:0/77352615 shutdown_connections 2024-09-19T09:09:41.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.507+0000 7ff74760c740 1 -- 172.21.15.92:0/77352615 wait complete. 2024-09-19T09:09:41.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.507+0000 7ff74760c740 20 client.18486 trim_cache size 0 max 16384 2024-09-19T09:09:41.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.524+0000 7ff74760c740 1 Processor -- start 2024-09-19T09:09:41.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.524+0000 7ff74760c740 1 -- start start 2024-09-19T09:09:41.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.524+0000 7ff74760c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5556c3e2df40 0x5556c3e54ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:41.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.524+0000 7ff74760c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556c3e2e860 0x5556c3e55000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:41.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.524+0000 7ff74760c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556c3e3d650 0x5556c3e37750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:41.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.524+0000 7ff74760c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff7401a9390 con 0x5556c3e2e860 2024-09-19T09:09:41.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.524+0000 7ff74760c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff7401abc30 con 0x5556c3e3d650 2024-09-19T09:09:41.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.524+0000 7ff74760c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff7401a9a20 con 0x5556c3e2df40 2024-09-19T09:09:41.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.524+0000 7ff73ed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556c3e2e860 0x5556c3e55000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:41.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.525+0000 7ff73ed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556c3e2e860 0x5556c3e55000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34542/0 (socket says 172.21.15.92:34542) 2024-09-19T09:09:41.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.525+0000 7ff73ed9d640 1 -- 172.21.15.92:0/1673438359 learned_addr learned my addr 172.21.15.92:0/1673438359 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:41.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.525+0000 7ff73e59c640 1 --2- 172.21.15.92:0/1673438359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556c3e3d650 0x5556c3e37750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:41.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.525+0000 7ff73e59c640 1 --2- 172.21.15.92:0/1673438359 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5556c3e2df40 0x5556c3e54ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:41.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.525+0000 7ff73ed9d640 1 -- 172.21.15.92:0/1673438359 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5556c3e2df40 msgr2=0x5556c3e54ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:41.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.525+0000 7ff73ed9d640 1 --2- 172.21.15.92:0/1673438359 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5556c3e2df40 0x5556c3e54ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:41.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.525+0000 7ff73ed9d640 1 -- 172.21.15.92:0/1673438359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556c3e3d650 msgr2=0x5556c3e37750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:41.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.525+0000 7ff73ed9d640 1 --2- 172.21.15.92:0/1673438359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556c3e3d650 0x5556c3e37750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:41.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.525+0000 7ff73ed9d640 1 -- 172.21.15.92:0/1673438359 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556c3e28bb0 con 0x5556c3e2e860 2024-09-19T09:09:41.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.525+0000 7ff73e59c640 1 --2- 172.21.15.92:0/1673438359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556c3e3d650 0x5556c3e37750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:09:41.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.525+0000 7ff73ed9d640 1 --2- 172.21.15.92:0/1673438359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556c3e2e860 0x5556c3e55000 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7ff73002a9a0 tx=0x7ff730000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12b71b4c1be61cd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:41.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.525+0000 7ff724ff9640 1 -- 172.21.15.92:0/1673438359 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff730035040 con 0x5556c3e2e860 2024-09-19T09:09:41.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.525+0000 7ff724ff9640 1 -- 172.21.15.92:0/1673438359 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff730005500 con 0x5556c3e2e860 2024-09-19T09:09:41.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.525+0000 7ff724ff9640 1 -- 172.21.15.92:0/1673438359 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff730004c60 con 0x5556c3e2e860 2024-09-19T09:09:41.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.526+0000 7ff74760c740 1 -- 172.21.15.92:0/1673438359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556c3e2e860 msgr2=0x5556c3e55000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:41.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.526+0000 7ff74760c740 1 --2- 172.21.15.92:0/1673438359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556c3e2e860 0x5556c3e55000 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7ff73002a9a0 tx=0x7ff730000bc0 comp rx=0 tx=0).stop 2024-09-19T09:09:41.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.526+0000 7ff74760c740 1 -- 172.21.15.92:0/1673438359 shutdown_connections 2024-09-19T09:09:41.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.526+0000 7ff74760c740 1 --2- 172.21.15.92:0/1673438359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556c3e3d650 0x5556c3e37750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:41.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.526+0000 7ff74760c740 1 --2- 172.21.15.92:0/1673438359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556c3e2e860 0x5556c3e55000 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:41.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.526+0000 7ff74760c740 1 --2- 172.21.15.92:0/1673438359 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5556c3e2df40 0x5556c3e54ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:41.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.526+0000 7ff74760c740 1 -- 172.21.15.92:0/1673438359 >> 172.21.15.92:0/1673438359 conn(0x5556c3e2a5f0 msgr2=0x5556c3e3bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:41.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.526+0000 7ff74760c740 1 -- 172.21.15.92:0/1673438359 shutdown_connections 2024-09-19T09:09:41.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.526+0000 7ff74760c740 1 -- 172.21.15.92:0/1673438359 wait complete. 2024-09-19T09:09:41.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.526+0000 7ff74760c740 1 -- start start 2024-09-19T09:09:41.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.526+0000 7ff74760c740 1 Processor -- start 2024-09-19T09:09:41.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.527+0000 7ff74760c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5556c3e2df40 0x5556c3e41370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:41.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.527+0000 7ff74760c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556c3e2e860 0x5556c3e418b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:41.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.527+0000 7ff74760c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556c3e3d650 0x5556c3e41df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:41.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.527+0000 7ff74760c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff7401aa0f0 con 0x5556c3e2e860 2024-09-19T09:09:41.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.527+0000 7ff74760c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff7401ab560 con 0x5556c3e3d650 2024-09-19T09:09:41.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.527+0000 7ff74760c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff7401aa7c0 con 0x5556c3e2df40 2024-09-19T09:09:41.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.527+0000 7ff74760c740 10 client.0 _ll_register_callbacks cb 0x7ff734004ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:09:41.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.527+0000 7ff73ed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556c3e2e860 0x5556c3e418b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:41.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.527+0000 7ff73ed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556c3e2e860 0x5556c3e418b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34548/0 (socket says 172.21.15.92:34548) 2024-09-19T09:09:41.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.527+0000 7ff73ed9d640 1 -- 172.21.15.92:0/1439066086 learned_addr learned my addr 172.21.15.92:0/1439066086 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:41.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.527+0000 7ff73e59c640 1 --2- 172.21.15.92:0/1439066086 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5556c3e2df40 0x5556c3e41370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:41.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.527+0000 7ff73e59c640 1 --2- 172.21.15.92:0/1439066086 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556c3e3d650 0x5556c3e41df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:41.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.527+0000 7ff73ed9d640 1 -- 172.21.15.92:0/1439066086 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5556c3e2df40 msgr2=0x5556c3e41370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:41.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.527+0000 7ff73ed9d640 1 --2- 172.21.15.92:0/1439066086 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5556c3e2df40 0x5556c3e41370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:41.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.527+0000 7ff73ed9d640 1 -- 172.21.15.92:0/1439066086 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556c3e3d650 msgr2=0x5556c3e41df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:41.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.527+0000 7ff73ed9d640 1 --2- 172.21.15.92:0/1439066086 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556c3e3d650 0x5556c3e41df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:41.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.527+0000 7ff73ed9d640 1 -- 172.21.15.92:0/1439066086 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556c3eb6a90 con 0x5556c3e2e860 2024-09-19T09:09:41.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.527+0000 7ff73e59c640 1 --2- 172.21.15.92:0/1439066086 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556c3e3d650 0x5556c3e41df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:09:41.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.527+0000 7ff73ed9d640 1 --2- 172.21.15.92:0/1439066086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556c3e2e860 0x5556c3e418b0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7ff73002a9a0 tx=0x7ff730005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecc5c9c4276f63a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:41.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.527+0000 7ff722ff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:09:41.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.527+0000 7ff722ff5640 1 -- 172.21.15.92:0/1439066086 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff730056070 con 0x5556c3e2e860 2024-09-19T09:09:41.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.527+0000 7ff722ff5640 1 -- 172.21.15.92:0/1439066086 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff730004240 con 0x5556c3e2e860 2024-09-19T09:09:41.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.527+0000 7ff74760c740 1 -- 172.21.15.92:0/1439066086 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff730005500 con 0x5556c3e2e860 2024-09-19T09:09:41.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.528+0000 7ff722ff5640 1 -- 172.21.15.92:0/1439066086 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff730062050 con 0x5556c3e2e860 2024-09-19T09:09:41.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.528+0000 7ff74760c740 10 client.18492 fetch_fsmap learned FSMap version 19 2024-09-19T09:09:41.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.528+0000 7ff74760c740 1 -- 172.21.15.92:0/1439066086 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5556c3eb7cc0 con 0x5556c3e2e860 2024-09-19T09:09:41.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.528+0000 7ff722ff5640 1 -- 172.21.15.92:0/1439066086 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff730005500 con 0x5556c3e2e860 2024-09-19T09:09:41.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.528+0000 7ff722ff5640 1 -- 172.21.15.92:0/1439066086 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff730048640 con 0x5556c3e2e860 2024-09-19T09:09:41.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.528+0000 7ff74760c740 10 client.18492 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:09:41.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.528+0000 7ff74760c740 10 client.18492 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:09:41.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.528+0000 7ff74760c740 20 client.18492 populate_metadata read hostname 'smithi092' 2024-09-19T09:09:41.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.528+0000 7ff74760c740 1 --2- 172.21.15.92:0/1439066086 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5556c3eb8360 0x5556c3eba780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:41.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.528+0000 7ff74760c740 4 client.18492 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "be738a60", "release": true, "await": true}] 2024-09-19T09:09:41.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.528+0000 7ff74760c740 1 -- 172.21.15.92:0/1439066086 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "quiesce db", "set_id": "be738a60", "release": true, "await": true}) -- 0x5556c3d9b0a0 con 0x5556c3eb8360 2024-09-19T09:09:41.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.528+0000 7ff73e59c640 1 --2- 172.21.15.92:0/1439066086 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5556c3eb8360 0x5556c3eba780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:41.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.529+0000 7ff722ff5640 10 client.18492 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:41.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.529+0000 7ff73e59c640 1 --2- 172.21.15.92:0/1439066086 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5556c3eb8360 0x5556c3eba780 crc :-1 s=READY pgs=395 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5811144c328b870 server_cookie=20f175c2950f36d0 in_seq=0 out_seq=0 2024-09-19T09:09:41.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.576+0000 7ff722ff5640 1 -- 172.21.15.92:0/1439066086 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5556c3d9b0a0 con 0x5556c3eb8360 2024-09-19T09:09:41.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.576+0000 7ff722ff5640 10 client.18492 handle_command_reply: tid=0 2024-09-19T09:09:41.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.576+0000 7ff74760c740 1 client.18492 shutdown 2024-09-19T09:09:41.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.576+0000 7ff74760c740 1 -- 172.21.15.92:0/1439066086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556c3e2e860 msgr2=0x5556c3e418b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:41.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.576+0000 7ff74760c740 1 --2- 172.21.15.92:0/1439066086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556c3e2e860 0x5556c3e418b0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7ff73002a9a0 tx=0x7ff730005c00 comp rx=0 tx=0).stop 2024-09-19T09:09:41.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.576+0000 7ff74760c740 1 -- 172.21.15.92:0/1439066086 shutdown_connections 2024-09-19T09:09:41.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.576+0000 7ff74760c740 1 --2- 172.21.15.92:0/1439066086 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5556c3eb8360 0x5556c3eba780 crc :-1 s=READY pgs=395 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:41.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.576+0000 7ff74760c740 1 --2- 172.21.15.92:0/1439066086 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556c3e3d650 0x5556c3e41df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:41.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.576+0000 7ff74760c740 1 --2- 172.21.15.92:0/1439066086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556c3e2e860 0x5556c3e418b0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:41.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.576+0000 7ff74760c740 1 --2- 172.21.15.92:0/1439066086 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5556c3e2df40 0x5556c3e41370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:41.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.576+0000 7ff74760c740 1 -- 172.21.15.92:0/1439066086 >> 172.21.15.92:0/1439066086 conn(0x5556c3e2a5f0 msgr2=0x5556c3e2fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:41.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.577+0000 7ff722ff5640 0 client.18492 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:41.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.577+0000 7ff74760c740 1 -- 172.21.15.92:0/1439066086 shutdown_connections 2024-09-19T09:09:41.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.577+0000 7ff74760c740 1 -- 172.21.15.92:0/1439066086 wait complete. 2024-09-19T09:09:41.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.577+0000 7ff74760c740 20 client.18492 trim_cache size 0 max 16384 2024-09-19T09:09:41.579 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:09:41.579 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 19, 2024-09-19T09:09:41.579 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24472, 2024-09-19T09:09:41.579 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 48, 2024-09-19T09:09:41.579 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-09-19T09:09:41.579 INFO:teuthology.orchestra.run.smithi092.stdout: "be738a60": { 2024-09-19T09:09:41.579 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 48, 2024-09-19T09:09:41.579 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-09-19T09:09:41.579 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:09:41.579 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-09-19T09:09:41.579 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:09:41.580 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:09:41.580 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 90.0, 2024-09-19T09:09:41.580 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 142.2, 2024-09-19T09:09:41.580 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-09-19T09:09:41.580 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-09-19T09:09:41.580 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-09-19T09:09:41.580 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:09:41.580 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-09-19T09:09:41.580 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:09:41.580 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:09:41.580 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:09:41.580 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:09:41.580 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:09:41.581 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:09:41.581 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:09:41.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.577+0000 7ff745233640 1 -- 172.21.15.92:0/2140921560 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff7280a3240 msgr2=0x7ff7280a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:41.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.578+0000 7ff745233640 1 --2- 172.21.15.92:0/2140921560 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff7280a3240 0x7ff7280a5700 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ff7380985a0 tx=0x7ff7380bc040 comp rx=0 tx=0).stop 2024-09-19T09:09:41.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.578+0000 7ff745233640 1 -- 172.21.15.92:0/2140921560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff74010c170 msgr2=0x7ff74019cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:41.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.578+0000 7ff745233640 1 --2- 172.21.15.92:0/2140921560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff74010c170 0x7ff74019cd00 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7ff73800eaa0 tx=0x7ff73800ef60 comp rx=0 tx=0).stop 2024-09-19T09:09:41.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.578+0000 7ff745233640 1 -- 172.21.15.92:0/2140921560 shutdown_connections 2024-09-19T09:09:41.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.578+0000 7ff745233640 1 --2- 172.21.15.92:0/2140921560 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff7280a3240 0x7ff7280a5700 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:41.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.578+0000 7ff745233640 1 --2- 172.21.15.92:0/2140921560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff74010c170 0x7ff74019cd00 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:41.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.578+0000 7ff745233640 1 --2- 172.21.15.92:0/2140921560 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff740103660 0x7ff740198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:41.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.578+0000 7ff745233640 1 --2- 172.21.15.92:0/2140921560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff740102d40 0x7ff740198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:41.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.578+0000 7ff745233640 1 -- 172.21.15.92:0/2140921560 >> 172.21.15.92:0/2140921560 conn(0x7ff7400fc7a0 msgr2=0x7ff7400fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:41.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.578+0000 7ff745233640 1 -- 172.21.15.92:0/2140921560 shutdown_connections 2024-09-19T09:09:41.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:09:41.578+0000 7ff745233640 1 -- 172.21.15.92:0/2140921560 wait complete. 2024-09-19T09:09:42.232 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'be738a60', total seconds elapsed: 25.1 2024-09-19T09:09:43.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:42 smithi092 ceph-mon[31407]: pgmap v727: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 15 MiB/s wr, 505 op/s 2024-09-19T09:09:43.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:42 smithi167 ceph-mon[35359]: pgmap v727: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 15 MiB/s wr, 505 op/s 2024-09-19T09:09:43.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:42 smithi190 ceph-mon[35358]: pgmap v727: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 15 MiB/s wr, 505 op/s 2024-09-19T09:09:43.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.446+0000 7f6ca4186640 1 -- 172.21.15.92:0/3157501903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c9c1003c0 msgr2=0x7f6c9c1027d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:43.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.446+0000 7f6ca4186640 1 --2- 172.21.15.92:0/3157501903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c9c1003c0 0x7f6c9c1027d0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f6c94009ca0 tx=0x7f6c9402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:09:43.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.446+0000 7f6ca4186640 1 -- 172.21.15.92:0/3157501903 shutdown_connections 2024-09-19T09:09:43.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.446+0000 7f6ca4186640 1 --2- 172.21.15.92:0/3157501903 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c9c1056c0 0x7f6c9c105b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:43.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.446+0000 7f6ca4186640 1 --2- 172.21.15.92:0/3157501903 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c9c102d10 0x7f6c9c105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:43.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.446+0000 7f6ca4186640 1 --2- 172.21.15.92:0/3157501903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c9c1003c0 0x7f6c9c1027d0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:43.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.446+0000 7f6ca4186640 1 -- 172.21.15.92:0/3157501903 >> 172.21.15.92:0/3157501903 conn(0x7f6c9c0fc1b0 msgr2=0x7f6c9c0fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:43.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.446+0000 7f6ca4186640 1 -- 172.21.15.92:0/3157501903 shutdown_connections 2024-09-19T09:09:43.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.446+0000 7f6ca4186640 1 -- 172.21.15.92:0/3157501903 wait complete. 2024-09-19T09:09:43.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.447+0000 7f6ca4186640 1 Processor -- start 2024-09-19T09:09:43.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.447+0000 7f6ca4186640 1 -- start start 2024-09-19T09:09:43.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.447+0000 7f6ca4186640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c9c1003c0 0x7f6c9c19e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:43.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.447+0000 7f6ca4186640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c9c102d10 0x7f6c9c19e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:43.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.447+0000 7f6ca4186640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c9c1056c0 0x7f6c9c1a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:43.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.447+0000 7f6ca4186640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6c9c113dd0 con 0x7f6c9c1056c0 2024-09-19T09:09:43.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.447+0000 7f6ca4186640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6c9c113c50 con 0x7f6c9c102d10 2024-09-19T09:09:43.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.447+0000 7f6ca4186640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6c9c113f50 con 0x7f6c9c1003c0 2024-09-19T09:09:43.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.447+0000 7f6ca2723640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c9c1056c0 0x7f6c9c1a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:43.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.447+0000 7f6ca2723640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c9c1056c0 0x7f6c9c1a5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34568/0 (socket says 172.21.15.92:34568) 2024-09-19T09:09:43.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.447+0000 7f6ca2723640 1 -- 172.21.15.92:0/888340369 learned_addr learned my addr 172.21.15.92:0/888340369 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:43.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.447+0000 7f6ca1721640 1 --2- 172.21.15.92:0/888340369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c9c102d10 0x7f6c9c19e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:43.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.448+0000 7f6ca1f22640 1 --2- 172.21.15.92:0/888340369 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c9c1003c0 0x7f6c9c19e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:43.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.448+0000 7f6ca1721640 1 -- 172.21.15.92:0/888340369 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c9c1003c0 msgr2=0x7f6c9c19e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:43.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.448+0000 7f6ca1721640 1 --2- 172.21.15.92:0/888340369 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c9c1003c0 0x7f6c9c19e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:43.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.448+0000 7f6ca1721640 1 -- 172.21.15.92:0/888340369 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c9c1056c0 msgr2=0x7f6c9c1a5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:43.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.448+0000 7f6ca1721640 1 --2- 172.21.15.92:0/888340369 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c9c1056c0 0x7f6c9c1a5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:43.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.448+0000 7f6ca1721640 1 -- 172.21.15.92:0/888340369 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c9c1a6000 con 0x7f6c9c102d10 2024-09-19T09:09:43.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.448+0000 7f6ca2723640 1 --2- 172.21.15.92:0/888340369 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c9c1056c0 0x7f6c9c1a5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:09:43.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.448+0000 7f6ca1721640 1 --2- 172.21.15.92:0/888340369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c9c102d10 0x7f6c9c19e920 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c00d6d0 tx=0x7f6c8c00db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:43.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.449+0000 7f6c92ffd640 1 -- 172.21.15.92:0/888340369 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c017070 con 0x7f6c9c102d10 2024-09-19T09:09:43.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.449+0000 7f6c92ffd640 1 -- 172.21.15.92:0/888340369 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c8c009820 con 0x7f6c9c102d10 2024-09-19T09:09:43.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.449+0000 7f6c92ffd640 1 -- 172.21.15.92:0/888340369 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c004d00 con 0x7f6c9c102d10 2024-09-19T09:09:43.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.449+0000 7f6ca4186640 1 -- 172.21.15.92:0/888340369 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c9c1a62f0 con 0x7f6c9c102d10 2024-09-19T09:09:43.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.449+0000 7f6ca4186640 1 -- 172.21.15.92:0/888340369 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c9c1a67f0 con 0x7f6c9c102d10 2024-09-19T09:09:43.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.452+0000 7f6ca6ff8740 1 Processor -- start 2024-09-19T09:09:43.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.452+0000 7f6ca6ff8740 1 -- start start 2024-09-19T09:09:43.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.452+0000 7f6ca6ff8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db0739d9a0 0x55db0739dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:43.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.452+0000 7f6ca6ff8740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55db0739e2e0 0x55db073a2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:43.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.452+0000 7f6ca6ff8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55db073a3370 0x55db073a5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:43.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.452+0000 7f6c92ffd640 1 -- 172.21.15.92:0/888340369 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6c8c0099d0 con 0x7f6c9c102d10 2024-09-19T09:09:43.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.453+0000 7f6ca6ff8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55db073012f0 con 0x55db073a3370 2024-09-19T09:09:43.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.453+0000 7f6ca6ff8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55db072a9270 con 0x55db0739d9a0 2024-09-19T09:09:43.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.453+0000 7f6ca6ff8740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55db072fd2b0 con 0x55db0739e2e0 2024-09-19T09:09:43.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.453+0000 7f6ca1721640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55db073a3370 0x55db073a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:43.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.453+0000 7f6ca2723640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db0739d9a0 0x55db0739dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:43.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.453+0000 7f6ca1f22640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55db0739e2e0 0x55db073a2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:43.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.453+0000 7f6ca1721640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55db073a3370 0x55db073a5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34580/0 (socket says 172.21.15.92:34580) 2024-09-19T09:09:43.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.453+0000 7f6ca1721640 1 -- 172.21.15.92:0/3652581455 learned_addr learned my addr 172.21.15.92:0/3652581455 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:43.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.453+0000 7f6ca2723640 1 -- 172.21.15.92:0/3652581455 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55db0739e2e0 msgr2=0x55db073a2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:43.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.453+0000 7f6ca2723640 1 --2- 172.21.15.92:0/3652581455 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55db0739e2e0 0x55db073a2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:43.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.453+0000 7f6ca2723640 1 -- 172.21.15.92:0/3652581455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55db073a3370 msgr2=0x55db073a5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:43.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.453+0000 7f6ca2723640 1 --2- 172.21.15.92:0/3652581455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55db073a3370 0x55db073a5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:43.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.453+0000 7f6ca2723640 1 -- 172.21.15.92:0/3652581455 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db072a8340 con 0x55db0739d9a0 2024-09-19T09:09:43.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.453+0000 7f6c92ffd640 1 --2- 172.21.15.92:0/888340369 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6c880a3460 0x7f6c880a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:43.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.453+0000 7f6ca2723640 1 --2- 172.21.15.92:0/3652581455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db0739d9a0 0x55db0739dda0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6c98011490 tx=0x7f6c98011950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42735882bba3a7fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:43.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.454+0000 7f6c87fff640 1 -- 172.21.15.92:0/3652581455 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9801e070 con 0x55db0739d9a0 2024-09-19T09:09:43.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.454+0000 7f6c92ffd640 1 -- 172.21.15.92:0/888340369 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f6c8c0cf1b0 con 0x7f6c9c102d10 2024-09-19T09:09:43.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.454+0000 7f6c87fff640 1 -- 172.21.15.92:0/3652581455 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c9800fa20 con 0x55db0739d9a0 2024-09-19T09:09:43.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.454+0000 7f6c87fff640 1 -- 172.21.15.92:0/3652581455 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c98019bc0 con 0x55db0739d9a0 2024-09-19T09:09:43.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.454+0000 7f6ca1f22640 1 --2- 172.21.15.92:0/888340369 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6c880a3460 0x7f6c880a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:43.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.455+0000 7f6ca6ff8740 1 -- 172.21.15.92:0/3652581455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db0739d9a0 msgr2=0x55db0739dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:43.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.455+0000 7f6ca6ff8740 1 --2- 172.21.15.92:0/3652581455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db0739d9a0 0x55db0739dda0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6c98011490 tx=0x7f6c98011950 comp rx=0 tx=0).stop 2024-09-19T09:09:43.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.455+0000 7f6ca6ff8740 1 -- 172.21.15.92:0/3652581455 shutdown_connections 2024-09-19T09:09:43.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.455+0000 7f6ca6ff8740 1 --2- 172.21.15.92:0/3652581455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55db073a3370 0x55db073a5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:43.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.455+0000 7f6ca6ff8740 1 --2- 172.21.15.92:0/3652581455 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55db0739e2e0 0x55db073a2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:43.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.455+0000 7f6ca6ff8740 1 --2- 172.21.15.92:0/3652581455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db0739d9a0 0x55db0739dda0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:43.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.455+0000 7f6ca6ff8740 1 -- 172.21.15.92:0/3652581455 >> 172.21.15.92:0/3652581455 conn(0x55db07399010 msgr2=0x55db07399410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:43.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.455+0000 7f6ca1f22640 1 --2- 172.21.15.92:0/888340369 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6c880a3460 0x7f6c880a5920 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6c94000f80 tx=0x7f6c94031bb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:43.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.455+0000 7f6ca6ff8740 1 -- 172.21.15.92:0/3652581455 shutdown_connections 2024-09-19T09:09:43.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.455+0000 7f6ca6ff8740 1 -- 172.21.15.92:0/3652581455 wait complete. 2024-09-19T09:09:43.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.456+0000 7f6ca6ff8740 1 -- start start 2024-09-19T09:09:43.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.456+0000 7f6ca6ff8740 1 Processor -- start 2024-09-19T09:09:43.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.456+0000 7f6ca6ff8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db0739d9a0 0x55db073a7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:43.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.456+0000 7f6ca6ff8740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55db0739e2e0 0x55db073a81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:43.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.456+0000 7f6ca6ff8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55db073a3370 0x55db073af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:43.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.457+0000 7f6ca6ff8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55db073a6340 con 0x55db073a3370 2024-09-19T09:09:43.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.457+0000 7f6ca6ff8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55db0728a290 con 0x55db0739d9a0 2024-09-19T09:09:43.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.457+0000 7f6ca6ff8740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55db073a64c0 con 0x55db0739e2e0 2024-09-19T09:09:43.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.457+0000 7f6ca1f22640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db0739d9a0 0x55db073a7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:43.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.457+0000 7f6ca1721640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55db0739e2e0 0x55db073a81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:43.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.457+0000 7f6ca6ff8740 10 client.0 _ll_register_callbacks cb 0x55db072bb140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:09:43.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.457+0000 7f6ca1721640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55db0739e2e0 0x55db073a81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:58246/0 (socket says 172.21.15.92:58246) 2024-09-19T09:09:43.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.457+0000 7f6ca1f22640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db0739d9a0 0x55db073a7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:40092/0 (socket says 172.21.15.92:40092) 2024-09-19T09:09:43.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.457+0000 7f6ca1721640 1 -- 172.21.15.92:0/4041697998 learned_addr learned my addr 172.21.15.92:0/4041697998 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:43.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.457+0000 7f6ca2723640 1 --2- 172.21.15.92:0/4041697998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55db073a3370 0x55db073af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:43.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.457+0000 7f6ca1f22640 1 -- 172.21.15.92:0/4041697998 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55db0739e2e0 msgr2=0x55db073a81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:43.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.457+0000 7f6ca1f22640 1 --2- 172.21.15.92:0/4041697998 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55db0739e2e0 0x55db073a81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:43.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.457+0000 7f6ca1f22640 1 -- 172.21.15.92:0/4041697998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55db073a3370 msgr2=0x55db073af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:43.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.457+0000 7f6ca1f22640 1 --2- 172.21.15.92:0/4041697998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55db073a3370 0x55db073af1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:43.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.457+0000 7f6ca1f22640 1 -- 172.21.15.92:0/4041697998 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db07014210 con 0x55db0739d9a0 2024-09-19T09:09:43.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.457+0000 7f6ca2723640 1 --2- 172.21.15.92:0/4041697998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55db073a3370 0x55db073af1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:09:43.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.457+0000 7f6ca1f22640 1 --2- 172.21.15.92:0/4041697998 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db0739d9a0 0x55db073a7c90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6c94031ae0 tx=0x7f6c9402a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a41cfcca45d0961 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:43.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.457+0000 7f6c857fa640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:09:43.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.458+0000 7f6c857fa640 1 -- 172.21.15.92:0/4041697998 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c94003e00 con 0x55db0739d9a0 2024-09-19T09:09:43.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.458+0000 7f6c857fa640 1 -- 172.21.15.92:0/4041697998 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f6c94004510 con 0x55db0739d9a0 2024-09-19T09:09:43.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.458+0000 7f6ca6ff8740 1 -- 172.21.15.92:0/4041697998 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c9800fa20 con 0x55db0739d9a0 2024-09-19T09:09:43.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.458+0000 7f6c857fa640 1 -- 172.21.15.92:0/4041697998 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6c94004710 con 0x55db0739d9a0 2024-09-19T09:09:43.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.458+0000 7f6ca6ff8740 10 client.27743 fetch_fsmap learned FSMap version 19 2024-09-19T09:09:43.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.458+0000 7f6ca6ff8740 1 -- 172.21.15.92:0/4041697998 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55db070e0620 con 0x55db0739d9a0 2024-09-19T09:09:43.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.458+0000 7f6c857fa640 1 -- 172.21.15.92:0/4041697998 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c9800fa20 con 0x55db0739d9a0 2024-09-19T09:09:43.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.458+0000 7f6c857fa640 1 -- 172.21.15.92:0/4041697998 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f6c940306c0 con 0x55db0739d9a0 2024-09-19T09:09:43.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.458+0000 7f6ca6ff8740 10 client.27743 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:09:43.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.458+0000 7f6ca6ff8740 10 client.27743 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:09:43.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.458+0000 7f6ca6ff8740 20 client.27743 populate_metadata read hostname 'smithi092' 2024-09-19T09:09:43.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.458+0000 7f6ca6ff8740 1 --2- 172.21.15.92:0/4041697998 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55db073b38c0 0x55db073b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:43.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.458+0000 7f6ca6ff8740 4 client.27743 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:09:43.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.458+0000 7f6ca6ff8740 1 -- 172.21.15.92:0/4041697998 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db0730ea20 con 0x55db073b38c0 2024-09-19T09:09:43.463 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.459+0000 7f6ca1721640 1 --2- 172.21.15.92:0/4041697998 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55db073b38c0 0x55db073b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:43.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.459+0000 7f6ca1721640 1 --2- 172.21.15.92:0/4041697998 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55db073b38c0 0x55db073b5cd0 crc :-1 s=READY pgs=396 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=653b4276962589d6 server_cookie=bf710ab72f2bd11b in_seq=0 out_seq=0 2024-09-19T09:09:43.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.459+0000 7f6c857fa640 10 client.27743 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:43.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.460+0000 7f6c857fa640 1 -- 172.21.15.92:0/4041697998 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55db0730ea20 con 0x55db073b38c0 2024-09-19T09:09:43.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.460+0000 7f6c857fa640 10 client.27743 handle_command_reply: tid=0 2024-09-19T09:09:43.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.460+0000 7f6ca6ff8740 1 client.27743 shutdown 2024-09-19T09:09:43.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.460+0000 7f6ca6ff8740 1 -- 172.21.15.92:0/4041697998 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db0739d9a0 msgr2=0x55db073a7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:43.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.460+0000 7f6ca6ff8740 1 --2- 172.21.15.92:0/4041697998 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db0739d9a0 0x55db073a7c90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6c94031ae0 tx=0x7f6c9402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:09:43.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.461+0000 7f6ca6ff8740 1 -- 172.21.15.92:0/4041697998 shutdown_connections 2024-09-19T09:09:43.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.461+0000 7f6ca6ff8740 1 --2- 172.21.15.92:0/4041697998 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55db073b38c0 0x55db073b5cd0 crc :-1 s=READY pgs=396 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:43.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.461+0000 7f6ca6ff8740 1 --2- 172.21.15.92:0/4041697998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55db073a3370 0x55db073af1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:43.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.461+0000 7f6ca6ff8740 1 --2- 172.21.15.92:0/4041697998 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55db0739e2e0 0x55db073a81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:43.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.461+0000 7f6c857fa640 0 client.27743 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:43.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.461+0000 7f6ca6ff8740 1 --2- 172.21.15.92:0/4041697998 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db0739d9a0 0x55db073a7c90 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:43.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.461+0000 7f6ca6ff8740 1 -- 172.21.15.92:0/4041697998 >> 172.21.15.92:0/4041697998 conn(0x55db07399010 msgr2=0x55db0739a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:43.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.461+0000 7f6ca6ff8740 1 -- 172.21.15.92:0/4041697998 shutdown_connections 2024-09-19T09:09:43.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.461+0000 7f6ca6ff8740 1 -- 172.21.15.92:0/4041697998 wait complete. 2024-09-19T09:09:43.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.461+0000 7f6ca6ff8740 20 client.27743 trim_cache size 0 max 16384 2024-09-19T09:09:43.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.480+0000 7f6ca6ff8740 1 Processor -- start 2024-09-19T09:09:43.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.480+0000 7f6ca6ff8740 1 -- start start 2024-09-19T09:09:43.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.481+0000 7f6ca6ff8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db0739d9a0 0x55db073a7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:43.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.481+0000 7f6ca6ff8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55db0739e2e0 0x55db073af110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:43.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.481+0000 7f6ca6ff8740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55db073a3370 0x55db073a8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:43.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.481+0000 7f6ca6ff8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6c9c1ad710 con 0x55db0739e2e0 2024-09-19T09:09:43.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.481+0000 7f6ca6ff8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6c9c1affb0 con 0x55db0739d9a0 2024-09-19T09:09:43.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.481+0000 7f6ca6ff8740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6c9c1adda0 con 0x55db073a3370 2024-09-19T09:09:43.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.481+0000 7f6ca2723640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55db073a3370 0x55db073a8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.481+0000 7f6ca2723640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55db073a3370 0x55db073a8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:58260/0 (socket says 172.21.15.92:58260) 2024-09-19T09:09:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.481+0000 7f6ca2723640 1 -- 172.21.15.92:0/3708693093 learned_addr learned my addr 172.21.15.92:0/3708693093 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.481+0000 7f6ca1f22640 1 --2- 172.21.15.92:0/3708693093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db0739d9a0 0x55db073a7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.481+0000 7f6ca2723640 1 -- 172.21.15.92:0/3708693093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db0739d9a0 msgr2=0x55db073a7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.481+0000 7f6ca2723640 1 --2- 172.21.15.92:0/3708693093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db0739d9a0 0x55db073a7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.481+0000 7f6ca2723640 1 -- 172.21.15.92:0/3708693093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55db0739e2e0 msgr2=0x55db073af110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.481+0000 7f6ca2723640 1 --2- 172.21.15.92:0/3708693093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55db0739e2e0 0x55db073af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.481+0000 7f6ca2723640 1 -- 172.21.15.92:0/3708693093 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db073b2260 con 0x55db073a3370 2024-09-19T09:09:43.487 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.482+0000 7f6ca2723640 1 --2- 172.21.15.92:0/3708693093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55db073a3370 0x55db073a8190 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6c9801b000 tx=0x7f6c980095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b3162f7a1edee6c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:43.487 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.482+0000 7f6c877fe640 1 -- 172.21.15.92:0/3708693093 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9801e040 con 0x55db073a3370 2024-09-19T09:09:43.487 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.482+0000 7f6c877fe640 1 -- 172.21.15.92:0/3708693093 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c98004680 con 0x55db073a3370 2024-09-19T09:09:43.487 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.482+0000 7f6c877fe640 1 -- 172.21.15.92:0/3708693093 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9800f8b0 con 0x55db073a3370 2024-09-19T09:09:43.487 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.483+0000 7f6ca6ff8740 1 -- 172.21.15.92:0/3708693093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55db073a3370 msgr2=0x55db073a8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:43.487 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.483+0000 7f6ca6ff8740 1 --2- 172.21.15.92:0/3708693093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55db073a3370 0x55db073a8190 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6c9801b000 tx=0x7f6c980095c0 comp rx=0 tx=0).stop 2024-09-19T09:09:43.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.483+0000 7f6ca6ff8740 1 -- 172.21.15.92:0/3708693093 shutdown_connections 2024-09-19T09:09:43.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.483+0000 7f6ca6ff8740 1 --2- 172.21.15.92:0/3708693093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55db073a3370 0x55db073a8190 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:43.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.483+0000 7f6ca6ff8740 1 --2- 172.21.15.92:0/3708693093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55db0739e2e0 0x55db073af110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:43.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.483+0000 7f6ca6ff8740 1 --2- 172.21.15.92:0/3708693093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db0739d9a0 0x55db073a7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:43.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.483+0000 7f6ca6ff8740 1 -- 172.21.15.92:0/3708693093 >> 172.21.15.92:0/3708693093 conn(0x55db07399010 msgr2=0x55db07393d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:43.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.483+0000 7f6ca6ff8740 1 -- 172.21.15.92:0/3708693093 shutdown_connections 2024-09-19T09:09:43.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.483+0000 7f6ca6ff8740 1 -- 172.21.15.92:0/3708693093 wait complete. 2024-09-19T09:09:43.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.483+0000 7f6ca6ff8740 1 -- start start 2024-09-19T09:09:43.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.484+0000 7f6ca6ff8740 1 Processor -- start 2024-09-19T09:09:43.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.484+0000 7f6ca6ff8740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55db0739d9a0 0x55db073ac310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:43.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.484+0000 7f6ca6ff8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55db0739e2e0 0x55db073ac850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:43.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.484+0000 7f6ca6ff8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db073a3370 0x55db073ad860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:43.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.484+0000 7f6ca6ff8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6c9c1ae470 con 0x55db0739e2e0 2024-09-19T09:09:43.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.484+0000 7f6ca6ff8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6c9c1af8e0 con 0x55db073a3370 2024-09-19T09:09:43.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.484+0000 7f6ca6ff8740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6c9c1aeb40 con 0x55db0739d9a0 2024-09-19T09:09:43.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.484+0000 7f6ca6ff8740 10 client.0 _ll_register_callbacks cb 0x7f6c94009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:09:43.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.484+0000 7f6ca1721640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55db0739e2e0 0x55db073ac850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:43.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.484+0000 7f6ca1721640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55db0739e2e0 0x55db073ac850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34610/0 (socket says 172.21.15.92:34610) 2024-09-19T09:09:43.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.484+0000 7f6ca1721640 1 -- 172.21.15.92:0/2940064405 learned_addr learned my addr 172.21.15.92:0/2940064405 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:43.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.484+0000 7f6ca1f22640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55db0739d9a0 0x55db073ac310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:43.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.484+0000 7f6ca2723640 1 --2- 172.21.15.92:0/2940064405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db073a3370 0x55db073ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:43.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.484+0000 7f6ca1721640 1 -- 172.21.15.92:0/2940064405 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55db0739d9a0 msgr2=0x55db073ac310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:43.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.484+0000 7f6ca1721640 1 --2- 172.21.15.92:0/2940064405 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55db0739d9a0 0x55db073ac310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:43.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.484+0000 7f6ca1721640 1 -- 172.21.15.92:0/2940064405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db073a3370 msgr2=0x55db073ad860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:43.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.484+0000 7f6ca1721640 1 --2- 172.21.15.92:0/2940064405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db073a3370 0x55db073ad860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:43.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.484+0000 7f6ca1721640 1 -- 172.21.15.92:0/2940064405 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db073ade70 con 0x55db0739e2e0 2024-09-19T09:09:43.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.484+0000 7f6ca2723640 1 --2- 172.21.15.92:0/2940064405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db073a3370 0x55db073ad860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:09:43.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.485+0000 7f6ca1721640 1 --2- 172.21.15.92:0/2940064405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55db0739e2e0 0x55db073ac850 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c0981a0 tx=0x7f6c8c0d2dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6de75adda8615581 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:43.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.485+0000 7f6c857fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:09:43.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.485+0000 7f6c857fa640 1 -- 172.21.15.92:0/2940064405 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c0b4070 con 0x55db0739e2e0 2024-09-19T09:09:43.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.485+0000 7f6c857fa640 1 -- 172.21.15.92:0/2940064405 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f6c8c009d40 con 0x55db0739e2e0 2024-09-19T09:09:43.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.485+0000 7f6ca6ff8740 1 -- 172.21.15.92:0/2940064405 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c98004680 con 0x55db0739e2e0 2024-09-19T09:09:43.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.485+0000 7f6c857fa640 1 -- 172.21.15.92:0/2940064405 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6c8c0ce040 con 0x55db0739e2e0 2024-09-19T09:09:43.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.485+0000 7f6ca6ff8740 10 client.18507 fetch_fsmap learned FSMap version 19 2024-09-19T09:09:43.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.485+0000 7f6ca6ff8740 1 -- 172.21.15.92:0/2940064405 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55db073af1f0 con 0x55db0739e2e0 2024-09-19T09:09:43.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.485+0000 7f6c857fa640 1 -- 172.21.15.92:0/2940064405 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c8c015060 con 0x55db0739e2e0 2024-09-19T09:09:43.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.485+0000 7f6c857fa640 1 -- 172.21.15.92:0/2940064405 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f6c8c097e40 con 0x55db0739e2e0 2024-09-19T09:09:43.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.485+0000 7f6ca6ff8740 10 client.18507 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:09:43.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.485+0000 7f6ca6ff8740 10 client.18507 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:09:43.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.485+0000 7f6ca6ff8740 20 client.18507 populate_metadata read hostname 'smithi092' 2024-09-19T09:09:43.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.486+0000 7f6ca6ff8740 1 --2- 172.21.15.92:0/2940064405 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55db0742faa0 0x55db07431ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:43.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.486+0000 7f6ca6ff8740 4 client.18507 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:09:43.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.486+0000 7f6ca6ff8740 1 -- 172.21.15.92:0/2940064405 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f6c98004680 con 0x55db0742faa0 2024-09-19T09:09:43.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.486+0000 7f6ca1f22640 1 --2- 172.21.15.92:0/2940064405 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55db0742faa0 0x55db07431ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:43.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.513+0000 7f6ca1f22640 1 --2- 172.21.15.92:0/2940064405 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55db0742faa0 0x55db07431ec0 crc :-1 s=READY pgs=397 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=292f4bfe1b8f9ef7 server_cookie=86b8111aa1f7d6e4 in_seq=0 out_seq=0 2024-09-19T09:09:43.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.513+0000 7f6c857fa640 10 client.18507 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.537+0000 7f6c857fa640 1 -- 172.21.15.92:0/2940064405 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f6c98004680 con 0x55db0742faa0 2024-09-19T09:09:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.537+0000 7f6c857fa640 10 client.18507 handle_command_reply: tid=0 2024-09-19T09:09:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.537+0000 7f6ca6ff8740 1 client.18507 shutdown 2024-09-19T09:09:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.537+0000 7f6ca6ff8740 1 -- 172.21.15.92:0/2940064405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55db0739e2e0 msgr2=0x55db073ac850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.537+0000 7f6ca6ff8740 1 --2- 172.21.15.92:0/2940064405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55db0739e2e0 0x55db073ac850 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c0981a0 tx=0x7f6c8c0d2dc0 comp rx=0 tx=0).stop 2024-09-19T09:09:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.537+0000 7f6ca6ff8740 1 -- 172.21.15.92:0/2940064405 shutdown_connections 2024-09-19T09:09:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.537+0000 7f6ca6ff8740 1 --2- 172.21.15.92:0/2940064405 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55db0742faa0 0x55db07431ec0 crc :-1 s=READY pgs=397 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.537+0000 7f6ca6ff8740 1 --2- 172.21.15.92:0/2940064405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db073a3370 0x55db073ad860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:43.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.537+0000 7f6c857fa640 0 client.18507 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:43.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.537+0000 7f6ca6ff8740 1 --2- 172.21.15.92:0/2940064405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55db0739e2e0 0x55db073ac850 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:43.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.537+0000 7f6ca6ff8740 1 --2- 172.21.15.92:0/2940064405 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55db0739d9a0 0x55db073ac310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:43.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.538+0000 7f6ca6ff8740 1 -- 172.21.15.92:0/2940064405 >> 172.21.15.92:0/2940064405 conn(0x55db07399010 msgr2=0x55db073a7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:43.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.538+0000 7f6ca6ff8740 1 -- 172.21.15.92:0/2940064405 shutdown_connections 2024-09-19T09:09:43.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.538+0000 7f6ca6ff8740 1 -- 172.21.15.92:0/2940064405 wait complete. 2024-09-19T09:09:43.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.539+0000 7f6ca6ff8740 20 client.18507 trim_cache size 0 max 16384 2024-09-19T09:09:43.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:09:43.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:09:43.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:09:43.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:09:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.540+0000 7f6ca4186640 1 -- 172.21.15.92:0/888340369 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6c880a3460 msgr2=0x7f6c880a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.540+0000 7f6ca4186640 1 --2- 172.21.15.92:0/888340369 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6c880a3460 0x7f6c880a5920 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6c94000f80 tx=0x7f6c94031bb0 comp rx=0 tx=0).stop 2024-09-19T09:09:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.540+0000 7f6ca4186640 1 -- 172.21.15.92:0/888340369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c9c102d10 msgr2=0x7f6c9c19e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.540+0000 7f6ca4186640 1 --2- 172.21.15.92:0/888340369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c9c102d10 0x7f6c9c19e920 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c00d6d0 tx=0x7f6c8c00db90 comp rx=0 tx=0).stop 2024-09-19T09:09:43.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.540+0000 7f6ca4186640 1 -- 172.21.15.92:0/888340369 shutdown_connections 2024-09-19T09:09:43.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.540+0000 7f6ca4186640 1 --2- 172.21.15.92:0/888340369 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6c880a3460 0x7f6c880a5920 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:43.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.540+0000 7f6ca4186640 1 --2- 172.21.15.92:0/888340369 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c9c1056c0 0x7f6c9c1a5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:43.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.540+0000 7f6ca4186640 1 --2- 172.21.15.92:0/888340369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c9c102d10 0x7f6c9c19e920 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:43.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.540+0000 7f6ca4186640 1 --2- 172.21.15.92:0/888340369 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c9c1003c0 0x7f6c9c19e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:43.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.540+0000 7f6ca4186640 1 -- 172.21.15.92:0/888340369 >> 172.21.15.92:0/888340369 conn(0x7f6c9c0fc1b0 msgr2=0x7f6c9c1036b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.540+0000 7f6ca4186640 1 -- 172.21.15.92:0/888340369 shutdown_connections 2024-09-19T09:09:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:43.540+0000 7f6ca4186640 1 -- 172.21.15.92:0/888340369 wait complete. 2024-09-19T09:09:45.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:44 smithi092 ceph-mon[31407]: pgmap v728: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 16 MiB/s wr, 575 op/s 2024-09-19T09:09:45.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:44 smithi167 ceph-mon[35359]: pgmap v728: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 16 MiB/s wr, 575 op/s 2024-09-19T09:09:45.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:44 smithi190 ceph-mon[35358]: pgmap v728: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 16 MiB/s wr, 575 op/s 2024-09-19T09:09:45.795 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 780.0 s, 2664.0 tps, lat 192.048 ms stddev 1843.141 2024-09-19T09:09:47.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:46 smithi092 ceph-mon[31407]: pgmap v729: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 17 MiB/s wr, 647 op/s 2024-09-19T09:09:47.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:46 smithi167 ceph-mon[35359]: pgmap v729: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 17 MiB/s wr, 647 op/s 2024-09-19T09:09:47.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:46 smithi190 ceph-mon[35358]: pgmap v729: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 17 MiB/s wr, 647 op/s 2024-09-19T09:09:49.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:48 smithi092 ceph-mon[31407]: pgmap v730: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 12 MiB/s wr, 558 op/s 2024-09-19T09:09:49.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:48 smithi167 ceph-mon[35359]: pgmap v730: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 12 MiB/s wr, 558 op/s 2024-09-19T09:09:49.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:48 smithi190 ceph-mon[35358]: pgmap v730: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 12 MiB/s wr, 558 op/s 2024-09-19T09:09:50.795 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 785.0 s, 2695.4 tps, lat 37.075 ms stddev 39.659 2024-09-19T09:09:51.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:50 smithi092 ceph-mon[31407]: pgmap v731: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 10 MiB/s wr, 624 op/s 2024-09-19T09:09:51.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:50 smithi167 ceph-mon[35359]: pgmap v731: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 10 MiB/s wr, 624 op/s 2024-09-19T09:09:51.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:50 smithi190 ceph-mon[35358]: pgmap v731: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 10 MiB/s wr, 624 op/s 2024-09-19T09:09:53.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:52 smithi092 ceph-mon[31407]: pgmap v732: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.8 MiB/s wr, 504 op/s 2024-09-19T09:09:53.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:52 smithi167 ceph-mon[35359]: pgmap v732: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.8 MiB/s wr, 504 op/s 2024-09-19T09:09:53.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:52 smithi190 ceph-mon[35358]: pgmap v732: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.8 MiB/s wr, 504 op/s 2024-09-19T09:09:55.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:54 smithi092 ceph-mon[31407]: pgmap v733: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.2 MiB/s wr, 627 op/s 2024-09-19T09:09:55.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:54 smithi167 ceph-mon[35359]: pgmap v733: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.2 MiB/s wr, 627 op/s 2024-09-19T09:09:55.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:54 smithi190 ceph-mon[35358]: pgmap v733: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.2 MiB/s wr, 627 op/s 2024-09-19T09:09:55.795 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 790.0 s, 2782.8 tps, lat 36.044 ms stddev 40.480 2024-09-19T09:09:56.005 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:55 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:09:56.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:55 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:09:56.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:55 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:09:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.672+0000 7f4c1760e640 1 -- 172.21.15.92:0/498813127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c10072d20 msgr2=0x7f4c10073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.672+0000 7f4c1760e640 1 --2- 172.21.15.92:0/498813127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c10072d20 0x7f4c10073180 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f4c04009900 tx=0x7f4c0402a410 comp rx=0 tx=0).stop 2024-09-19T09:09:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.672+0000 7f4c1760e640 1 -- 172.21.15.92:0/498813127 shutdown_connections 2024-09-19T09:09:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.672+0000 7f4c1760e640 1 --2- 172.21.15.92:0/498813127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c100736c0 0x7f4c10119130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.672+0000 7f4c1760e640 1 --2- 172.21.15.92:0/498813127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c10072d20 0x7f4c10073180 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.672+0000 7f4c1760e640 1 --2- 172.21.15.92:0/498813127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c10109700 0x7f4c10109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.672+0000 7f4c1760e640 1 -- 172.21.15.92:0/498813127 >> 172.21.15.92:0/498813127 conn(0x7f4c1006ece0 msgr2=0x7f4c10071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.672+0000 7f4c1760e640 1 -- 172.21.15.92:0/498813127 shutdown_connections 2024-09-19T09:09:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.674+0000 7f4c1760e640 1 -- 172.21.15.92:0/498813127 wait complete. 2024-09-19T09:09:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.675+0000 7f4c1760e640 1 Processor -- start 2024-09-19T09:09:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.676+0000 7f4c1760e640 1 -- start start 2024-09-19T09:09:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.676+0000 7f4c1760e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c10072d20 0x7f4c10115cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.676+0000 7f4c1760e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c100736c0 0x7f4c10116230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.676+0000 7f4c1760e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c10109700 0x7f4c101b6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.676+0000 7f4c1760e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4c1011c5b0 con 0x7f4c10072d20 2024-09-19T09:09:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.676+0000 7f4c1760e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4c1011c430 con 0x7f4c10109700 2024-09-19T09:09:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.676+0000 7f4c1760e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4c1011c730 con 0x7f4c100736c0 2024-09-19T09:09:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.676+0000 7f4c15bab640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c10109700 0x7f4c101b6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.676+0000 7f4c15bab640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c10109700 0x7f4c101b6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:38014/0 (socket says 172.21.15.92:38014) 2024-09-19T09:09:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.676+0000 7f4c15bab640 1 -- 172.21.15.92:0/3739840914 learned_addr learned my addr 172.21.15.92:0/3739840914 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.677+0000 7f4c153aa640 1 --2- 172.21.15.92:0/3739840914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c10072d20 0x7f4c10115cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.677+0000 7f4c14ba9640 1 --2- 172.21.15.92:0/3739840914 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c100736c0 0x7f4c10116230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.678+0000 7f4c15bab640 1 -- 172.21.15.92:0/3739840914 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c100736c0 msgr2=0x7f4c10116230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.678+0000 7f4c15bab640 1 --2- 172.21.15.92:0/3739840914 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c100736c0 0x7f4c10116230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.678+0000 7f4c15bab640 1 -- 172.21.15.92:0/3739840914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c10072d20 msgr2=0x7f4c10115cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.678+0000 7f4c15bab640 1 --2- 172.21.15.92:0/3739840914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c10072d20 0x7f4c10115cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.678+0000 7f4c15bab640 1 -- 172.21.15.92:0/3739840914 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c101193b0 con 0x7f4c10109700 2024-09-19T09:09:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.679+0000 7f4c15bab640 1 --2- 172.21.15.92:0/3739840914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c10109700 0x7f4c101b6cc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c00e970 tx=0x7f4c0c00ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.680+0000 7f4c027fc640 1 -- 172.21.15.92:0/3739840914 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c00ccc0 con 0x7f4c10109700 2024-09-19T09:09:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.680+0000 7f4c027fc640 1 -- 172.21.15.92:0/3739840914 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c0c00ce60 con 0x7f4c10109700 2024-09-19T09:09:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.680+0000 7f4c027fc640 1 -- 172.21.15.92:0/3739840914 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c010450 con 0x7f4c10109700 2024-09-19T09:09:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.680+0000 7f4c1760e640 1 -- 172.21.15.92:0/3739840914 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c101b7260 con 0x7f4c10109700 2024-09-19T09:09:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.680+0000 7f4c1760e640 1 -- 172.21.15.92:0/3739840914 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c101b7730 con 0x7f4c10109700 2024-09-19T09:09:56.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.683+0000 7f4c1a486740 1 Processor -- start 2024-09-19T09:09:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.687+0000 7f4c027fc640 1 -- 172.21.15.92:0/3739840914 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4c0c005020 con 0x7f4c10109700 2024-09-19T09:09:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.687+0000 7f4c027fc640 1 --2- 172.21.15.92:0/3739840914 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4bfc0a33f0 0x7f4bfc0a58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.688+0000 7f4c1a486740 1 -- start start 2024-09-19T09:09:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.688+0000 7f4c027fc640 1 -- 172.21.15.92:0/3739840914 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4c0c0cfd00 con 0x7f4c10109700 2024-09-19T09:09:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.688+0000 7f4c1a486740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3483f39a0 0x55f3483f3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.688+0000 7f4c1a486740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3483f42e0 0x55f3483f8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.688+0000 7f4c1a486740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f3483f9370 0x55f3483fb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.688+0000 7f4c1a486740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f3483572f0 con 0x55f3483f9370 2024-09-19T09:09:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.688+0000 7f4c1a486740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f3482ff270 con 0x55f3483f39a0 2024-09-19T09:09:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.688+0000 7f4c1a486740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f3483532b0 con 0x55f3483f42e0 2024-09-19T09:09:56.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.688+0000 7f4c14ba9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3483f42e0 0x55f3483f8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:56.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.688+0000 7f4c14ba9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3483f42e0 0x55f3483f8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:51482/0 (socket says 172.21.15.92:51482) 2024-09-19T09:09:56.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.688+0000 7f4c14ba9640 1 -- 172.21.15.92:0/1322575858 learned_addr learned my addr 172.21.15.92:0/1322575858 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:56.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.688+0000 7f4c15bab640 1 --2- 172.21.15.92:0/1322575858 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f3483f9370 0x55f3483fb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:56.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.689+0000 7f4c153aa640 1 --2- 172.21.15.92:0/1322575858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3483f39a0 0x55f3483f3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:56.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.689+0000 7f4c14ba9640 1 -- 172.21.15.92:0/1322575858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3483f39a0 msgr2=0x55f3483f3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:56.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.689+0000 7f4c14ba9640 1 --2- 172.21.15.92:0/1322575858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3483f39a0 0x55f3483f3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:56.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.689+0000 7f4c14ba9640 1 -- 172.21.15.92:0/1322575858 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f3483f9370 msgr2=0x55f3483fb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:56.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.689+0000 7f4c14ba9640 1 --2- 172.21.15.92:0/1322575858 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f3483f9370 0x55f3483fb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:56.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.689+0000 7f4c14ba9640 1 -- 172.21.15.92:0/1322575858 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3482fe340 con 0x55f3483f42e0 2024-09-19T09:09:56.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.689+0000 7f4c14ba9640 1 --2- 172.21.15.92:0/1322575858 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3483f42e0 0x55f3483f8da0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4c040314e0 tx=0x7f4c04005dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20504fd2f0106eca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:56.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.689+0000 7f4bfb7fe640 1 -- 172.21.15.92:0/1322575858 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c04035020 con 0x55f3483f42e0 2024-09-19T09:09:56.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.689+0000 7f4bfb7fe640 1 -- 172.21.15.92:0/1322575858 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c040053e0 con 0x55f3483f42e0 2024-09-19T09:09:56.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.689+0000 7f4bfb7fe640 1 -- 172.21.15.92:0/1322575858 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c04004920 con 0x55f3483f42e0 2024-09-19T09:09:56.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.690+0000 7f4c14ba9640 1 --2- 172.21.15.92:0/3739840914 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4bfc0a33f0 0x7f4bfc0a58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.691+0000 7f4c1a486740 1 -- 172.21.15.92:0/1322575858 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3483f42e0 msgr2=0x55f3483f8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.691+0000 7f4c1a486740 1 --2- 172.21.15.92:0/1322575858 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3483f42e0 0x55f3483f8da0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4c040314e0 tx=0x7f4c04005dd0 comp rx=0 tx=0).stop 2024-09-19T09:09:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.692+0000 7f4c1a486740 1 -- 172.21.15.92:0/1322575858 shutdown_connections 2024-09-19T09:09:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.692+0000 7f4c1a486740 1 --2- 172.21.15.92:0/1322575858 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f3483f9370 0x55f3483fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.692+0000 7f4c1a486740 1 --2- 172.21.15.92:0/1322575858 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3483f42e0 0x55f3483f8da0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.692+0000 7f4c1a486740 1 --2- 172.21.15.92:0/1322575858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3483f39a0 0x55f3483f3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.692+0000 7f4c1a486740 1 -- 172.21.15.92:0/1322575858 >> 172.21.15.92:0/1322575858 conn(0x55f3483ef010 msgr2=0x55f3483ef410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.692+0000 7f4c1a486740 1 -- 172.21.15.92:0/1322575858 shutdown_connections 2024-09-19T09:09:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.692+0000 7f4c14ba9640 1 --2- 172.21.15.92:0/3739840914 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4bfc0a33f0 0x7f4bfc0a58b0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f4c04005c40 tx=0x7f4c04004bf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.692+0000 7f4c1a486740 1 -- 172.21.15.92:0/1322575858 wait complete. 2024-09-19T09:09:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.693+0000 7f4c1a486740 1 -- start start 2024-09-19T09:09:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.693+0000 7f4c1a486740 1 Processor -- start 2024-09-19T09:09:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.693+0000 7f4c1a486740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3483f39a0 0x55f3483fdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.693+0000 7f4c1a486740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f3483f42e0 0x55f3483fe130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.693+0000 7f4c1a486740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3483f9370 0x55f348405100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.694+0000 7f4c153aa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3483f39a0 0x55f3483fdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.694+0000 7f4c1a486740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f3483fc2e0 con 0x55f3483f42e0 2024-09-19T09:09:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.694+0000 7f4c1a486740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f3482e0290 con 0x55f3483f39a0 2024-09-19T09:09:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.694+0000 7f4c1a486740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f3483fc460 con 0x55f3483f9370 2024-09-19T09:09:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.694+0000 7f4c1a486740 10 client.0 _ll_register_callbacks cb 0x55f348311140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:09:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.694+0000 7f4c15bab640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3483f9370 0x55f348405100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.694+0000 7f4c15bab640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3483f9370 0x55f348405100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:51494/0 (socket says 172.21.15.92:51494) 2024-09-19T09:09:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.694+0000 7f4c153aa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3483f39a0 0x55f3483fdbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:38028/0 (socket says 172.21.15.92:38028) 2024-09-19T09:09:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.694+0000 7f4c15bab640 1 -- 172.21.15.92:0/3880539543 learned_addr learned my addr 172.21.15.92:0/3880539543 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.694+0000 7f4c14ba9640 1 --2- 172.21.15.92:0/3880539543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f3483f42e0 0x55f3483fe130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.694+0000 7f4c15bab640 1 -- 172.21.15.92:0/3880539543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3483f39a0 msgr2=0x55f3483fdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:56.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.694+0000 7f4c15bab640 1 --2- 172.21.15.92:0/3880539543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3483f39a0 0x55f3483fdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:56.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.694+0000 7f4c15bab640 1 -- 172.21.15.92:0/3880539543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f3483f42e0 msgr2=0x55f3483fe130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:56.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.694+0000 7f4c15bab640 1 --2- 172.21.15.92:0/3880539543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f3483f42e0 0x55f3483fe130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:56.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.694+0000 7f4c15bab640 1 -- 172.21.15.92:0/3880539543 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f34806a210 con 0x55f3483f9370 2024-09-19T09:09:56.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.694+0000 7f4c14ba9640 1 --2- 172.21.15.92:0/3880539543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f3483f42e0 0x55f3483fe130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:09:56.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.694+0000 7f4c15bab640 1 --2- 172.21.15.92:0/3880539543 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3483f9370 0x55f348405100 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c098740 tx=0x7f4c0c09cb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27c05010e69083fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:56.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.694+0000 7f4bf8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:09:56.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.695+0000 7f4bf8ff9640 1 -- 172.21.15.92:0/3880539543 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c0a4f50 con 0x55f3483f9370 2024-09-19T09:09:56.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.695+0000 7f4bf8ff9640 1 -- 172.21.15.92:0/3880539543 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4c0c09c540 con 0x55f3483f9370 2024-09-19T09:09:56.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.695+0000 7f4c1a486740 1 -- 172.21.15.92:0/3880539543 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c040053e0 con 0x55f3483f9370 2024-09-19T09:09:56.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.696+0000 7f4bf8ff9640 1 -- 172.21.15.92:0/3880539543 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4c0c0b5290 con 0x55f3483f9370 2024-09-19T09:09:56.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.696+0000 7f4c1a486740 10 client.27643 fetch_fsmap learned FSMap version 19 2024-09-19T09:09:56.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.696+0000 7f4c1a486740 1 -- 172.21.15.92:0/3880539543 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f348136620 con 0x55f3483f9370 2024-09-19T09:09:56.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.696+0000 7f4bf8ff9640 1 -- 172.21.15.92:0/3880539543 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c0c096e50 con 0x55f3483f9370 2024-09-19T09:09:56.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.696+0000 7f4bf8ff9640 1 -- 172.21.15.92:0/3880539543 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f4c0c0bc0b0 con 0x55f3483f9370 2024-09-19T09:09:56.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.696+0000 7f4c1a486740 10 client.27643 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:09:56.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.696+0000 7f4c1a486740 10 client.27643 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:09:56.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.696+0000 7f4c1a486740 20 client.27643 populate_metadata read hostname 'smithi092' 2024-09-19T09:09:56.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.696+0000 7f4c1a486740 1 --2- 172.21.15.92:0/3880539543 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f348409800 0x55f34840bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:56.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.696+0000 7f4c1a486740 4 client.27643 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:09:56.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.696+0000 7f4c1a486740 1 -- 172.21.15.92:0/3880539543 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4c040053e0 con 0x55f348409800 2024-09-19T09:09:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.696+0000 7f4c153aa640 1 --2- 172.21.15.92:0/3880539543 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f348409800 0x55f34840bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.697+0000 7f4bf8ff9640 10 client.27643 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.697+0000 7f4c153aa640 1 --2- 172.21.15.92:0/3880539543 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f348409800 0x55f34840bbf0 crc :-1 s=READY pgs=398 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9df1361b166c2401 server_cookie=3fc40857bef03625 in_seq=0 out_seq=0 2024-09-19T09:09:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.698+0000 7f4bf8ff9640 1 -- 172.21.15.92:0/3880539543 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f4c040053e0 con 0x55f348409800 2024-09-19T09:09:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.698+0000 7f4bf8ff9640 10 client.27643 handle_command_reply: tid=0 2024-09-19T09:09:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.698+0000 7f4c1a486740 1 client.27643 shutdown 2024-09-19T09:09:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.698+0000 7f4c1a486740 1 -- 172.21.15.92:0/3880539543 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3483f9370 msgr2=0x55f348405100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.698+0000 7f4c1a486740 1 --2- 172.21.15.92:0/3880539543 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3483f9370 0x55f348405100 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c098740 tx=0x7f4c0c09cb20 comp rx=0 tx=0).stop 2024-09-19T09:09:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.698+0000 7f4c1a486740 1 -- 172.21.15.92:0/3880539543 shutdown_connections 2024-09-19T09:09:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.698+0000 7f4c1a486740 1 --2- 172.21.15.92:0/3880539543 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f348409800 0x55f34840bbf0 crc :-1 s=READY pgs=398 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.698+0000 7f4bf8ff9640 0 client.27643 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.698+0000 7f4c1a486740 1 --2- 172.21.15.92:0/3880539543 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3483f9370 0x55f348405100 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.698+0000 7f4c1a486740 1 --2- 172.21.15.92:0/3880539543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f3483f42e0 0x55f3483fe130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:56.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.698+0000 7f4c1a486740 1 --2- 172.21.15.92:0/3880539543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3483f39a0 0x55f3483fdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:56.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.698+0000 7f4c1a486740 1 -- 172.21.15.92:0/3880539543 >> 172.21.15.92:0/3880539543 conn(0x55f3483ef010 msgr2=0x55f3483f0820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:56.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.698+0000 7f4c1a486740 1 -- 172.21.15.92:0/3880539543 shutdown_connections 2024-09-19T09:09:56.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.698+0000 7f4c1a486740 1 -- 172.21.15.92:0/3880539543 wait complete. 2024-09-19T09:09:56.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.698+0000 7f4c1a486740 20 client.27643 trim_cache size 0 max 16384 2024-09-19T09:09:56.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.721+0000 7f4c1a486740 1 Processor -- start 2024-09-19T09:09:56.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.721+0000 7f4c1a486740 1 -- start start 2024-09-19T09:09:56.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.721+0000 7f4c1a486740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f3483f39a0 0x55f3484104d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:56.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.721+0000 7f4c1a486740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3483f42e0 0x55f3484050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:56.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.721+0000 7f4c1a486740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3483f9370 0x55f348410a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:56.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.721+0000 7f4c1a486740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4c101be660 con 0x55f3483f39a0 2024-09-19T09:09:56.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.721+0000 7f4c1a486740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4c101c0f00 con 0x55f3483f42e0 2024-09-19T09:09:56.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.721+0000 7f4c1a486740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4c101becf0 con 0x55f3483f9370 2024-09-19T09:09:56.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.721+0000 7f4c153aa640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f3483f39a0 0x55f3484104d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:56.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.721+0000 7f4c15bab640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3483f9370 0x55f348410a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:56.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.721+0000 7f4c15bab640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3483f9370 0x55f348410a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:51500/0 (socket says 172.21.15.92:51500) 2024-09-19T09:09:56.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.721+0000 7f4c15bab640 1 -- 172.21.15.92:0/1265720088 learned_addr learned my addr 172.21.15.92:0/1265720088 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:56.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.721+0000 7f4c14ba9640 1 --2- 172.21.15.92:0/1265720088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3483f42e0 0x55f3484050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:56.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.721+0000 7f4c15bab640 1 -- 172.21.15.92:0/1265720088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3483f42e0 msgr2=0x55f3484050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:56.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.721+0000 7f4c15bab640 1 --2- 172.21.15.92:0/1265720088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3483f42e0 0x55f3484050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:56.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.722+0000 7f4c15bab640 1 -- 172.21.15.92:0/1265720088 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f3483f39a0 msgr2=0x55f3484104d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:56.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.722+0000 7f4c15bab640 1 --2- 172.21.15.92:0/1265720088 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f3483f39a0 0x55f3484104d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:56.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.722+0000 7f4c15bab640 1 -- 172.21.15.92:0/1265720088 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3483fb760 con 0x55f3483f9370 2024-09-19T09:09:56.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.722+0000 7f4c15bab640 1 --2- 172.21.15.92:0/1265720088 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3483f9370 0x55f348410a10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c09c270 tx=0x7f4c0c009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=738e14861b943f82 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:56.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.723+0000 7f4bfaffd640 1 -- 172.21.15.92:0/1265720088 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c0a4f50 con 0x55f3483f9370 2024-09-19T09:09:56.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.723+0000 7f4bfaffd640 1 -- 172.21.15.92:0/1265720088 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c0c096e50 con 0x55f3483f9370 2024-09-19T09:09:56.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.723+0000 7f4bfaffd640 1 -- 172.21.15.92:0/1265720088 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c09c7a0 con 0x55f3483f9370 2024-09-19T09:09:56.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.723+0000 7f4c1a486740 1 -- 172.21.15.92:0/1265720088 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3483f9370 msgr2=0x55f348410a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:56.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.723+0000 7f4c1a486740 1 --2- 172.21.15.92:0/1265720088 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3483f9370 0x55f348410a10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c09c270 tx=0x7f4c0c009310 comp rx=0 tx=0).stop 2024-09-19T09:09:56.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.723+0000 7f4c1a486740 1 -- 172.21.15.92:0/1265720088 shutdown_connections 2024-09-19T09:09:56.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.723+0000 7f4c1a486740 1 --2- 172.21.15.92:0/1265720088 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3483f9370 0x55f348410a10 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:56.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.723+0000 7f4c1a486740 1 --2- 172.21.15.92:0/1265720088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3483f42e0 0x55f3484050c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:56.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.723+0000 7f4c1a486740 1 --2- 172.21.15.92:0/1265720088 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f3483f39a0 0x55f3484104d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:56.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.723+0000 7f4c1a486740 1 -- 172.21.15.92:0/1265720088 >> 172.21.15.92:0/1265720088 conn(0x55f3483ef010 msgr2=0x55f3483ee1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:56.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.723+0000 7f4c1a486740 1 -- 172.21.15.92:0/1265720088 shutdown_connections 2024-09-19T09:09:56.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.723+0000 7f4c1a486740 1 -- 172.21.15.92:0/1265720088 wait complete. 2024-09-19T09:09:56.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.724+0000 7f4c1a486740 1 -- start start 2024-09-19T09:09:56.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.724+0000 7f4c1a486740 1 Processor -- start 2024-09-19T09:09:56.732 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.724+0000 7f4c1a486740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3483f39a0 0x55f3484048c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:56.732 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.724+0000 7f4c1a486740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3483f42e0 0x55f348404e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:56.732 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.724+0000 7f4c1a486740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f3483f9370 0x55f348402ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:56.732 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.725+0000 7f4c14ba9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3483f42e0 0x55f348404e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:56.732 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.725+0000 7f4c14ba9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3483f42e0 0x55f348404e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:51514/0 (socket says 172.21.15.92:51514) 2024-09-19T09:09:56.732 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.725+0000 7f4c14ba9640 1 -- 172.21.15.92:0/742841635 learned_addr learned my addr 172.21.15.92:0/742841635 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:09:56.732 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.724+0000 7f4c1a486740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4c101bf3c0 con 0x55f3483f9370 2024-09-19T09:09:56.732 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.725+0000 7f4c1a486740 1 -- 172.21.15.92:0/742841635 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4c101c0830 con 0x55f3483f39a0 2024-09-19T09:09:56.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.725+0000 7f4c1a486740 1 -- 172.21.15.92:0/742841635 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4c101bfa90 con 0x55f3483f42e0 2024-09-19T09:09:56.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.725+0000 7f4c1a486740 10 client.0 _ll_register_callbacks cb 0x7f4c0c098580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:09:56.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.725+0000 7f4c153aa640 1 --2- 172.21.15.92:0/742841635 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3483f39a0 0x55f3484048c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:56.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.725+0000 7f4c14ba9640 1 -- 172.21.15.92:0/742841635 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3483f39a0 msgr2=0x55f3484048c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:56.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.725+0000 7f4c14ba9640 1 --2- 172.21.15.92:0/742841635 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3483f39a0 0x55f3484048c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:56.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.725+0000 7f4c14ba9640 1 -- 172.21.15.92:0/742841635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f3483f9370 msgr2=0x55f348402ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:09:56.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.725+0000 7f4c14ba9640 1 --2- 172.21.15.92:0/742841635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f3483f9370 0x55f348402ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:56.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.725+0000 7f4c14ba9640 1 -- 172.21.15.92:0/742841635 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f348403570 con 0x55f3483f42e0 2024-09-19T09:09:56.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.725+0000 7f4c14ba9640 1 --2- 172.21.15.92:0/742841635 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3483f42e0 0x55f348404e00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4c04009900 tx=0x7f4c0404e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc6292dba5a87a25 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:56.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.725+0000 7f4bf8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:09:56.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.726+0000 7f4bf8ff9640 1 -- 172.21.15.92:0/742841635 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c04035040 con 0x55f3483f42e0 2024-09-19T09:09:56.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.726+0000 7f4bf8ff9640 1 -- 172.21.15.92:0/742841635 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4c040053e0 con 0x55f3483f42e0 2024-09-19T09:09:56.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.726+0000 7f4c1a486740 1 -- 172.21.15.92:0/742841635 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c0c096e50 con 0x55f3483f42e0 2024-09-19T09:09:56.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.726+0000 7f4bf8ff9640 1 -- 172.21.15.92:0/742841635 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4c040048d0 con 0x55f3483f42e0 2024-09-19T09:09:56.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.726+0000 7f4c1a486740 10 client.27649 fetch_fsmap learned FSMap version 19 2024-09-19T09:09:56.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.726+0000 7f4c1a486740 1 -- 172.21.15.92:0/742841635 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f348474e90 con 0x55f3483f42e0 2024-09-19T09:09:56.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.726+0000 7f4bf8ff9640 1 -- 172.21.15.92:0/742841635 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c0c096e50 con 0x55f3483f42e0 2024-09-19T09:09:56.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.727+0000 7f4bf8ff9640 1 -- 172.21.15.92:0/742841635 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f4c04053040 con 0x55f3483f42e0 2024-09-19T09:09:56.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.727+0000 7f4c1a486740 10 client.27649 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:09:56.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.727+0000 7f4c1a486740 10 client.27649 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:09:56.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.727+0000 7f4c1a486740 20 client.27649 populate_metadata read hostname 'smithi092' 2024-09-19T09:09:56.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.727+0000 7f4c1a486740 1 --2- 172.21.15.92:0/742841635 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f348409800 0x55f348477420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:56.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.727+0000 7f4c1a486740 4 client.27649 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:09:56.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.727+0000 7f4c1a486740 1 -- 172.21.15.92:0/742841635 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f348364a20 con 0x55f348409800 2024-09-19T09:09:56.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.727+0000 7f4c153aa640 1 --2- 172.21.15.92:0/742841635 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f348409800 0x55f348477420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:56.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.728+0000 7f4c153aa640 1 --2- 172.21.15.92:0/742841635 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f348409800 0x55f348477420 crc :-1 s=READY pgs=399 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3c7fdb20ea4d52d server_cookie=a946612ff2186ff in_seq=0 out_seq=0 2024-09-19T09:09:56.736 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.728+0000 7f4bf8ff9640 10 client.27649 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:56.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.759+0000 7f4bf8ff9640 1 -- 172.21.15.92:0/742841635 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f348364a20 con 0x55f348409800 2024-09-19T09:09:56.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.759+0000 7f4bf8ff9640 10 client.27649 handle_command_reply: tid=0 2024-09-19T09:09:56.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.759+0000 7f4c1a486740 1 client.27649 shutdown 2024-09-19T09:09:56.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.759+0000 7f4c1a486740 1 -- 172.21.15.92:0/742841635 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3483f42e0 msgr2=0x55f348404e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:56.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.759+0000 7f4c1a486740 1 --2- 172.21.15.92:0/742841635 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3483f42e0 0x55f348404e00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4c04009900 tx=0x7f4c0404e000 comp rx=0 tx=0).stop 2024-09-19T09:09:56.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.759+0000 7f4c1a486740 1 -- 172.21.15.92:0/742841635 shutdown_connections 2024-09-19T09:09:56.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.759+0000 7f4c1a486740 1 --2- 172.21.15.92:0/742841635 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f348409800 0x55f348477420 crc :-1 s=READY pgs=399 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:56.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.759+0000 7f4bf8ff9640 0 client.27649 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:09:56.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.759+0000 7f4c1a486740 1 --2- 172.21.15.92:0/742841635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f3483f9370 0x55f348402ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:56.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.759+0000 7f4c1a486740 1 --2- 172.21.15.92:0/742841635 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f3483f42e0 0x55f348404e00 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:56.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.759+0000 7f4c1a486740 1 --2- 172.21.15.92:0/742841635 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3483f39a0 0x55f3484048c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:56.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.759+0000 7f4c1a486740 1 -- 172.21.15.92:0/742841635 >> 172.21.15.92:0/742841635 conn(0x55f3483ef010 msgr2=0x55f3483efec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:56.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.759+0000 7f4c1a486740 1 -- 172.21.15.92:0/742841635 shutdown_connections 2024-09-19T09:09:56.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.759+0000 7f4c1a486740 1 -- 172.21.15.92:0/742841635 wait complete. 2024-09-19T09:09:56.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.759+0000 7f4c1a486740 20 client.27649 trim_cache size 0 max 16384 2024-09-19T09:09:56.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:09:56.763 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:09:56.763 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:09:56.763 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:09:56.763 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.760+0000 7f4c1760e640 1 -- 172.21.15.92:0/3739840914 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4bfc0a33f0 msgr2=0x7f4bfc0a58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:56.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.760+0000 7f4c1760e640 1 --2- 172.21.15.92:0/3739840914 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4bfc0a33f0 0x7f4bfc0a58b0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f4c04005c40 tx=0x7f4c04004bf0 comp rx=0 tx=0).stop 2024-09-19T09:09:56.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.760+0000 7f4c1760e640 1 -- 172.21.15.92:0/3739840914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c10109700 msgr2=0x7f4c101b6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:56.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.760+0000 7f4c1760e640 1 --2- 172.21.15.92:0/3739840914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c10109700 0x7f4c101b6cc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c00e970 tx=0x7f4c0c00ed70 comp rx=0 tx=0).stop 2024-09-19T09:09:56.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.760+0000 7f4c1760e640 1 -- 172.21.15.92:0/3739840914 shutdown_connections 2024-09-19T09:09:56.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.760+0000 7f4c1760e640 1 --2- 172.21.15.92:0/3739840914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c10109700 0x7f4c101b6cc0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:56.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.760+0000 7f4c1760e640 1 --2- 172.21.15.92:0/3739840914 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c100736c0 0x7f4c10116230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:56.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.760+0000 7f4c1760e640 1 --2- 172.21.15.92:0/3739840914 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4bfc0a33f0 0x7f4bfc0a58b0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:56.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.760+0000 7f4c1760e640 1 --2- 172.21.15.92:0/3739840914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c10072d20 0x7f4c10115cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:56.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.760+0000 7f4c1760e640 1 -- 172.21.15.92:0/3739840914 >> 172.21.15.92:0/3739840914 conn(0x7f4c1006ece0 msgr2=0x7f4c1010c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:56.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.760+0000 7f4c1760e640 1 -- 172.21.15.92:0/3739840914 shutdown_connections 2024-09-19T09:09:56.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:09:56.760+0000 7f4c1760e640 1 -- 172.21.15.92:0/3739840914 wait complete. 2024-09-19T09:09:57.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:56 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:09:57.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:56 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:09:57.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:56 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:09:57.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:56 smithi092 ceph-mon[31407]: pgmap v734: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 6.1 MiB/s wr, 643 op/s 2024-09-19T09:09:57.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:56 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:09:57.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:56 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:09:57.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:56 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:09:57.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:56 smithi167 ceph-mon[35359]: pgmap v734: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 6.1 MiB/s wr, 643 op/s 2024-09-19T09:09:57.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:56 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:09:57.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:56 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:09:57.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:56 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:09:57.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:56 smithi190 ceph-mon[35358]: pgmap v734: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 6.1 MiB/s wr, 643 op/s 2024-09-19T09:09:59.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:09:58 smithi092 ceph-mon[31407]: pgmap v735: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 6.7 MiB/s wr, 677 op/s 2024-09-19T09:09:59.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:09:58 smithi167 ceph-mon[35359]: pgmap v735: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 6.7 MiB/s wr, 677 op/s 2024-09-19T09:09:59.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:09:58 smithi190 ceph-mon[35358]: pgmap v735: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 6.7 MiB/s wr, 677 op/s 2024-09-19T09:10:00.352 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:00 smithi167 ceph-mon[35359]: overall HEALTH_OK 2024-09-19T09:10:00.374 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:00 smithi190 ceph-mon[35358]: overall HEALTH_OK 2024-09-19T09:10:00.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:00 smithi092 ceph-mon[31407]: overall HEALTH_OK 2024-09-19T09:10:00.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 795.0 s, 2577.0 tps, lat 38.477 ms stddev 44.279 2024-09-19T09:10:01.352 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:01 smithi167 ceph-mon[35359]: pgmap v736: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 6.8 MiB/s wr, 709 op/s 2024-09-19T09:10:01.374 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:01 smithi190 ceph-mon[35358]: pgmap v736: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 6.8 MiB/s wr, 709 op/s 2024-09-19T09:10:01.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:01 smithi092 ceph-mon[31407]: pgmap v736: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 6.8 MiB/s wr, 709 op/s 2024-09-19T09:10:03.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:02 smithi092 ceph-mon[31407]: pgmap v737: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 8.9 MiB/s wr, 713 op/s 2024-09-19T09:10:03.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:02 smithi167 ceph-mon[35359]: pgmap v737: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 8.9 MiB/s wr, 713 op/s 2024-09-19T09:10:03.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:02 smithi190 ceph-mon[35358]: pgmap v737: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 8.9 MiB/s wr, 713 op/s 2024-09-19T09:10:05.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:04 smithi092 ceph-mon[31407]: pgmap v738: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 12 MiB/s wr, 791 op/s 2024-09-19T09:10:05.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:04 smithi167 ceph-mon[35359]: pgmap v738: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 12 MiB/s wr, 791 op/s 2024-09-19T09:10:05.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:04 smithi190 ceph-mon[35358]: pgmap v738: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 12 MiB/s wr, 791 op/s 2024-09-19T09:10:05.795 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 800.0 s, 2072.8 tps, lat 48.534 ms stddev 57.435 2024-09-19T09:10:07.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:06 smithi092 ceph-mon[31407]: pgmap v739: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 14 MiB/s wr, 775 op/s 2024-09-19T09:10:07.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:06 smithi167 ceph-mon[35359]: pgmap v739: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 14 MiB/s wr, 775 op/s 2024-09-19T09:10:07.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:06 smithi190 ceph-mon[35358]: pgmap v739: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 14 MiB/s wr, 775 op/s 2024-09-19T09:10:08.175 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:10:08.559 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:10:08.821 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:08 smithi092 ceph-mon[31407]: pgmap v740: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 16 MiB/s wr, 773 op/s 2024-09-19T09:10:09.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:08 smithi167 ceph-mon[35359]: pgmap v740: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 16 MiB/s wr, 773 op/s 2024-09-19T09:10:09.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.108+0000 7f11b1fa9640 1 -- 172.21.15.92:0/448800078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11ac109450 msgr2=0x7f11ac110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:09.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.108+0000 7f11b1fa9640 1 --2- 172.21.15.92:0/448800078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11ac109450 0x7f11ac110250 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f11a0009900 tx=0x7f11a002a440 comp rx=0 tx=0).stop 2024-09-19T09:10:09.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.116+0000 7f11b1fa9640 1 -- 172.21.15.92:0/448800078 shutdown_connections 2024-09-19T09:10:09.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.116+0000 7f11b1fa9640 1 --2- 172.21.15.92:0/448800078 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11ac11b140 0x7f11ac11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.116+0000 7f11b1fa9640 1 --2- 172.21.15.92:0/448800078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11ac109830 0x7f11ac109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.116+0000 7f11b1fa9640 1 --2- 172.21.15.92:0/448800078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11ac109450 0x7f11ac110250 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.116+0000 7f11b1fa9640 1 -- 172.21.15.92:0/448800078 >> 172.21.15.92:0/448800078 conn(0x7f11ac06e140 msgr2=0x7f11ac06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:09.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.118+0000 7f11b1fa9640 1 -- 172.21.15.92:0/448800078 shutdown_connections 2024-09-19T09:10:09.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.118+0000 7f11b1fa9640 1 -- 172.21.15.92:0/448800078 wait complete. 2024-09-19T09:10:09.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.119+0000 7f11b1fa9640 1 Processor -- start 2024-09-19T09:10:09.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.119+0000 7f11b1fa9640 1 -- start start 2024-09-19T09:10:09.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.119+0000 7f11b1fa9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11ac109450 0x7f11ac118770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.119+0000 7f11b1fa9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11ac109830 0x7f11ac111800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.119+0000 7f11b1fa9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11ac11b140 0x7f11ac111d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.119+0000 7f11b1fa9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f11ac120ed0 con 0x7f11ac109450 2024-09-19T09:10:09.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.119+0000 7f11b1fa9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f11ac120d50 con 0x7f11ac11b140 2024-09-19T09:10:09.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.119+0000 7f11b1fa9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f11ac121050 con 0x7f11ac109830 2024-09-19T09:10:09.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.120+0000 7f11ab7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11ac109450 0x7f11ac118770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:09.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.120+0000 7f11ab7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11ac109450 0x7f11ac118770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59556/0 (socket says 172.21.15.92:59556) 2024-09-19T09:10:09.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.120+0000 7f11ab7fe640 1 -- 172.21.15.92:0/1536474857 learned_addr learned my addr 172.21.15.92:0/1536474857 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:09.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.120+0000 7f11aaffd640 1 --2- 172.21.15.92:0/1536474857 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11ac109830 0x7f11ac111800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:09.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.120+0000 7f11abfff640 1 --2- 172.21.15.92:0/1536474857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11ac11b140 0x7f11ac111d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:09.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.120+0000 7f11ab7fe640 1 -- 172.21.15.92:0/1536474857 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11ac109830 msgr2=0x7f11ac111800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:09.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.120+0000 7f11ab7fe640 1 --2- 172.21.15.92:0/1536474857 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11ac109830 0x7f11ac111800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.120+0000 7f11ab7fe640 1 -- 172.21.15.92:0/1536474857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11ac11b140 msgr2=0x7f11ac111d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:09.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.120+0000 7f11ab7fe640 1 --2- 172.21.15.92:0/1536474857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11ac11b140 0x7f11ac111d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.120+0000 7f11ab7fe640 1 -- 172.21.15.92:0/1536474857 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11ac112380 con 0x7f11ac109450 2024-09-19T09:10:09.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.121+0000 7f11aaffd640 1 --2- 172.21.15.92:0/1536474857 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11ac109830 0x7f11ac111800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:10:09.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.121+0000 7f11abfff640 1 --2- 172.21.15.92:0/1536474857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11ac11b140 0x7f11ac111d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:10:09.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:08 smithi190 ceph-mon[35358]: pgmap v740: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 16 MiB/s wr, 773 op/s 2024-09-19T09:10:09.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.124+0000 7f11ab7fe640 1 --2- 172.21.15.92:0/1536474857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11ac109450 0x7f11ac118770 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f11a002a9b0 tx=0x7f11a0003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:09.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.124+0000 7f11a8ff9640 1 -- 172.21.15.92:0/1536474857 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a003f070 con 0x7f11ac109450 2024-09-19T09:10:09.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.125+0000 7f11a8ff9640 1 -- 172.21.15.92:0/1536474857 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11a0003e10 con 0x7f11ac109450 2024-09-19T09:10:09.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.125+0000 7f11b1fa9640 1 -- 172.21.15.92:0/1536474857 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11ac112610 con 0x7f11ac109450 2024-09-19T09:10:09.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.125+0000 7f11a8ff9640 1 -- 172.21.15.92:0/1536474857 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a0035030 con 0x7f11ac109450 2024-09-19T09:10:09.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.125+0000 7f11b1fa9640 1 -- 172.21.15.92:0/1536474857 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11ac116580 con 0x7f11ac109450 2024-09-19T09:10:09.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.128+0000 7f11b4382740 1 Processor -- start 2024-09-19T09:10:09.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.129+0000 7f11a8ff9640 1 -- 172.21.15.92:0/1536474857 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f11a0042070 con 0x7f11ac109450 2024-09-19T09:10:09.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.130+0000 7f11a8ff9640 1 --2- 172.21.15.92:0/1536474857 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f11940a33d0 0x7f11940a5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.130+0000 7f11b4382740 1 -- start start 2024-09-19T09:10:09.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.131+0000 7f11b4382740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b014d4a0 0x5594b014d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.131+0000 7f11b4382740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594b014ddc0 0x5594b0158140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.131+0000 7f11b4382740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594b0158680 0x5594b015aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.131+0000 7f11b4382740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5594b00b32e0 con 0x5594b0158680 2024-09-19T09:10:09.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.131+0000 7f11b4382740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5594b005ace0 con 0x5594b014d4a0 2024-09-19T09:10:09.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.131+0000 7f11b4382740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5594b00af2a0 con 0x5594b014ddc0 2024-09-19T09:10:09.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.131+0000 7f11aaffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594b014ddc0 0x5594b0158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:09.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.131+0000 7f11aaffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594b014ddc0 0x5594b0158140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:46156/0 (socket says 172.21.15.92:46156) 2024-09-19T09:10:09.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.131+0000 7f11aaffd640 1 -- 172.21.15.92:0/523817750 learned_addr learned my addr 172.21.15.92:0/523817750 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:09.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.131+0000 7f11aaffd640 1 -- 172.21.15.92:0/523817750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b014d4a0 msgr2=0x5594b014d880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:10:09.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.131+0000 7f11a8ff9640 1 -- 172.21.15.92:0/1536474857 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f11a00ba9d0 con 0x7f11ac109450 2024-09-19T09:10:09.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.131+0000 7f11ab7fe640 1 --2- 172.21.15.92:0/523817750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b014d4a0 0x5594b014d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:09.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.132+0000 7f11abfff640 1 --2- 172.21.15.92:0/1536474857 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f11940a33d0 0x7f11940a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:09.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.132+0000 7f11aaffd640 1 --2- 172.21.15.92:0/523817750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b014d4a0 0x5594b014d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.132+0000 7f11aaffd640 1 -- 172.21.15.92:0/523817750 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594b0158680 msgr2=0x5594b015aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:09.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.132+0000 7f11aaffd640 1 --2- 172.21.15.92:0/523817750 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594b0158680 0x5594b015aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.132+0000 7f11aaffd640 1 -- 172.21.15.92:0/523817750 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594b003f440 con 0x5594b014ddc0 2024-09-19T09:10:09.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.132+0000 7f11ab7fe640 1 --2- 172.21.15.92:0/523817750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b014d4a0 0x5594b014d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:10:09.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.132+0000 7f11aaffd640 1 --2- 172.21.15.92:0/523817750 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594b014ddc0 0x5594b0158140 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f119c00a950 tx=0x7f119c00ae10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=316b2e4921ab7217 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:09.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.133+0000 7f1191ffb640 1 -- 172.21.15.92:0/523817750 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119c015070 con 0x5594b014ddc0 2024-09-19T09:10:09.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.133+0000 7f1191ffb640 1 -- 172.21.15.92:0/523817750 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f119c00cc00 con 0x5594b014ddc0 2024-09-19T09:10:09.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.135+0000 7f11b4382740 1 -- 172.21.15.92:0/523817750 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594b014ddc0 msgr2=0x5594b0158140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:09.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.135+0000 7f11abfff640 1 --2- 172.21.15.92:0/1536474857 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f11940a33d0 0x7f11940a5890 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x5594b014adb0 tx=0x7f11a40078b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:09.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.135+0000 7f1191ffb640 1 -- 172.21.15.92:0/523817750 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119c015070 con 0x5594b014ddc0 2024-09-19T09:10:09.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.135+0000 7f11b4382740 1 --2- 172.21.15.92:0/523817750 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594b014ddc0 0x5594b0158140 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f119c00a950 tx=0x7f119c00ae10 comp rx=0 tx=0).stop 2024-09-19T09:10:09.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.135+0000 7f11b4382740 1 -- 172.21.15.92:0/523817750 shutdown_connections 2024-09-19T09:10:09.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.135+0000 7f11b4382740 1 --2- 172.21.15.92:0/523817750 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594b0158680 0x5594b015aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.135+0000 7f11b4382740 1 --2- 172.21.15.92:0/523817750 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594b014ddc0 0x5594b0158140 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.135+0000 7f11b4382740 1 --2- 172.21.15.92:0/523817750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b014d4a0 0x5594b014d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.135+0000 7f11b4382740 1 -- 172.21.15.92:0/523817750 >> 172.21.15.92:0/523817750 conn(0x5594b0149a30 msgr2=0x5594b0149e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:09.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.136+0000 7f11b4382740 1 -- 172.21.15.92:0/523817750 shutdown_connections 2024-09-19T09:10:09.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.136+0000 7f11b4382740 1 -- 172.21.15.92:0/523817750 wait complete. 2024-09-19T09:10:09.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.137+0000 7f11b4382740 1 -- start start 2024-09-19T09:10:09.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.137+0000 7f11b4382740 1 Processor -- start 2024-09-19T09:10:09.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.137+0000 7f11b4382740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594b014d4a0 0x5594b0157e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.137+0000 7f11b4382740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b014ddc0 0x5594b0155140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.137+0000 7f11b4382740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594b0158680 0x5594b0155680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.137+0000 7f11b4382740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5594b015b2a0 con 0x5594b014d4a0 2024-09-19T09:10:09.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.137+0000 7f11b4382740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5594b006e050 con 0x5594b014ddc0 2024-09-19T09:10:09.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.137+0000 7f11b4382740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5594b015b420 con 0x5594b0158680 2024-09-19T09:10:09.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.137+0000 7f11b4382740 10 client.0 _ll_register_callbacks cb 0x5594b00ae160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:10:09.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.138+0000 7f11abfff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594b0158680 0x5594b0155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:09.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.138+0000 7f11abfff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594b0158680 0x5594b0155680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:46168/0 (socket says 172.21.15.92:46168) 2024-09-19T09:10:09.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.138+0000 7f11abfff640 1 -- 172.21.15.92:0/2157409421 learned_addr learned my addr 172.21.15.92:0/2157409421 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:09.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.138+0000 7f11ab7fe640 1 --2- 172.21.15.92:0/2157409421 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594b014d4a0 0x5594b0157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:09.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.138+0000 7f11aaffd640 1 --2- 172.21.15.92:0/2157409421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b014ddc0 0x5594b0155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:09.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.138+0000 7f11abfff640 1 -- 172.21.15.92:0/2157409421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b014ddc0 msgr2=0x5594b0155140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:09.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.138+0000 7f11abfff640 1 --2- 172.21.15.92:0/2157409421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b014ddc0 0x5594b0155140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.138+0000 7f11abfff640 1 -- 172.21.15.92:0/2157409421 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594b014d4a0 msgr2=0x5594b0157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:09.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.138+0000 7f11abfff640 1 --2- 172.21.15.92:0/2157409421 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594b014d4a0 0x5594b0157e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.138+0000 7f11abfff640 1 -- 172.21.15.92:0/2157409421 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594afe243c0 con 0x5594b0158680 2024-09-19T09:10:09.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.139+0000 7f118affd640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:10:09.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.139+0000 7f11abfff640 1 --2- 172.21.15.92:0/2157409421 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594b0158680 0x5594b0155680 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f11a4007360 tx=0x7f11a4004b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=672f6cf19876c465 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:09.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.139+0000 7f118affd640 1 -- 172.21.15.92:0/2157409421 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a4020020 con 0x5594b0158680 2024-09-19T09:10:09.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.139+0000 7f118affd640 1 -- 172.21.15.92:0/2157409421 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f11a400cdb0 con 0x5594b0158680 2024-09-19T09:10:09.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.139+0000 7f11b4382740 1 -- 172.21.15.92:0/2157409421 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f119c00cc00 con 0x5594b0158680 2024-09-19T09:10:09.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.140+0000 7f118affd640 1 -- 172.21.15.92:0/2157409421 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f11a401c440 con 0x5594b0158680 2024-09-19T09:10:09.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.140+0000 7f11b4382740 10 client.27655 fetch_fsmap learned FSMap version 19 2024-09-19T09:10:09.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.140+0000 7f11b4382740 1 -- 172.21.15.92:0/2157409421 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5594b0166ba0 con 0x5594b0158680 2024-09-19T09:10:09.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.141+0000 7f118affd640 1 -- 172.21.15.92:0/2157409421 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f119c00cc00 con 0x5594b0158680 2024-09-19T09:10:09.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.141+0000 7f118affd640 1 -- 172.21.15.92:0/2157409421 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f11a402d020 con 0x5594b0158680 2024-09-19T09:10:09.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.141+0000 7f11b4382740 10 client.27655 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:10:09.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.141+0000 7f11b4382740 10 client.27655 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:10:09.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.141+0000 7f11b4382740 20 client.27655 populate_metadata read hostname 'smithi092' 2024-09-19T09:10:09.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.142+0000 7f11b4382740 1 --2- 172.21.15.92:0/2157409421 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5594b0168490 0x5594b016a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.142+0000 7f11b4382740 4 client.27655 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:10:09.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.142+0000 7f11b4382740 1 -- 172.21.15.92:0/2157409421 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5594b00c0850 con 0x5594b0168490 2024-09-19T09:10:09.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.142+0000 7f11ab7fe640 1 --2- 172.21.15.92:0/2157409421 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5594b0168490 0x5594b016a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:09.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.142+0000 7f11ab7fe640 1 --2- 172.21.15.92:0/2157409421 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5594b0168490 0x5594b016a8f0 crc :-1 s=READY pgs=400 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f1c49ffd80dc257 server_cookie=bc4e9b83a8504e81 in_seq=0 out_seq=0 2024-09-19T09:10:09.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.142+0000 7f118affd640 10 client.27655 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:09.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.143+0000 7f118affd640 1 -- 172.21.15.92:0/2157409421 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5594b00c0850 con 0x5594b0168490 2024-09-19T09:10:09.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.143+0000 7f118affd640 10 client.27655 handle_command_reply: tid=0 2024-09-19T09:10:09.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.143+0000 7f11b4382740 1 client.27655 shutdown 2024-09-19T09:10:09.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.143+0000 7f11b4382740 1 -- 172.21.15.92:0/2157409421 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594b0158680 msgr2=0x5594b0155680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:09.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.143+0000 7f11b4382740 1 --2- 172.21.15.92:0/2157409421 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594b0158680 0x5594b0155680 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f11a4007360 tx=0x7f11a4004b90 comp rx=0 tx=0).stop 2024-09-19T09:10:09.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.143+0000 7f11b4382740 1 -- 172.21.15.92:0/2157409421 shutdown_connections 2024-09-19T09:10:09.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.143+0000 7f11b4382740 1 --2- 172.21.15.92:0/2157409421 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5594b0168490 0x5594b016a8f0 crc :-1 s=READY pgs=400 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.143+0000 7f11b4382740 1 --2- 172.21.15.92:0/2157409421 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594b0158680 0x5594b0155680 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.143+0000 7f11b4382740 1 --2- 172.21.15.92:0/2157409421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b014ddc0 0x5594b0155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.143+0000 7f11b4382740 1 --2- 172.21.15.92:0/2157409421 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594b014d4a0 0x5594b0157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.143+0000 7f11b4382740 1 -- 172.21.15.92:0/2157409421 >> 172.21.15.92:0/2157409421 conn(0x5594b0149a30 msgr2=0x5594b014f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:09.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.143+0000 7f118affd640 0 client.27655 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:09.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.144+0000 7f11b4382740 1 -- 172.21.15.92:0/2157409421 shutdown_connections 2024-09-19T09:10:09.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.144+0000 7f11b4382740 1 -- 172.21.15.92:0/2157409421 wait complete. 2024-09-19T09:10:09.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.144+0000 7f11b4382740 20 client.27655 trim_cache size 0 max 16384 2024-09-19T09:10:09.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.176+0000 7f11b4382740 1 Processor -- start 2024-09-19T09:10:09.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.177+0000 7f11b4382740 1 -- start start 2024-09-19T09:10:09.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.177+0000 7f11b4382740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b014d4a0 0x5594b016a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.177+0000 7f11b4382740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594b014ddc0 0x5594b01507f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.177+0000 7f11b4382740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594b0158680 0x5594b0170200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.177+0000 7f11aaffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594b014ddc0 0x5594b01507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:09.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.177+0000 7f11aaffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594b014ddc0 0x5594b01507f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:46172/0 (socket says 172.21.15.92:46172) 2024-09-19T09:10:09.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.177+0000 7f11aaffd640 1 -- 172.21.15.92:0/226026666 learned_addr learned my addr 172.21.15.92:0/226026666 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:09.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.177+0000 7f11b4382740 1 -- 172.21.15.92:0/226026666 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f11ac1c2c90 con 0x5594b0158680 2024-09-19T09:10:09.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.177+0000 7f11b4382740 1 -- 172.21.15.92:0/226026666 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f11ac1c5530 con 0x5594b014d4a0 2024-09-19T09:10:09.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.177+0000 7f11b4382740 1 -- 172.21.15.92:0/226026666 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f11ac1c3320 con 0x5594b014ddc0 2024-09-19T09:10:09.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.178+0000 7f11abfff640 1 --2- 172.21.15.92:0/226026666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594b0158680 0x5594b0170200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:09.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.178+0000 7f11aaffd640 1 -- 172.21.15.92:0/226026666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b014d4a0 msgr2=0x5594b016a4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:10:09.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.178+0000 7f11aaffd640 1 --2- 172.21.15.92:0/226026666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b014d4a0 0x5594b016a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.178+0000 7f11aaffd640 1 -- 172.21.15.92:0/226026666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594b0158680 msgr2=0x5594b0170200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:09.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.178+0000 7f11aaffd640 1 --2- 172.21.15.92:0/226026666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594b0158680 0x5594b0170200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.178+0000 7f11aaffd640 1 -- 172.21.15.92:0/226026666 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594b01540f0 con 0x5594b014ddc0 2024-09-19T09:10:09.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.178+0000 7f11aaffd640 1 --2- 172.21.15.92:0/226026666 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594b014ddc0 0x5594b01507f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f119c00a950 tx=0x7f119c00a6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca5c9a2a61abafd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:09.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.178+0000 7f11917fa640 1 -- 172.21.15.92:0/226026666 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119c015040 con 0x5594b014ddc0 2024-09-19T09:10:09.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.178+0000 7f11917fa640 1 -- 172.21.15.92:0/226026666 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f119c004040 con 0x5594b014ddc0 2024-09-19T09:10:09.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.178+0000 7f11917fa640 1 -- 172.21.15.92:0/226026666 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119c0118c0 con 0x5594b014ddc0 2024-09-19T09:10:09.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.179+0000 7f11b4382740 1 -- 172.21.15.92:0/226026666 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594b014ddc0 msgr2=0x5594b01507f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:09.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.179+0000 7f11b4382740 1 --2- 172.21.15.92:0/226026666 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594b014ddc0 0x5594b01507f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f119c00a950 tx=0x7f119c00a6a0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.180+0000 7f11b4382740 1 -- 172.21.15.92:0/226026666 shutdown_connections 2024-09-19T09:10:09.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.180+0000 7f11b4382740 1 --2- 172.21.15.92:0/226026666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594b0158680 0x5594b0170200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.180+0000 7f11b4382740 1 --2- 172.21.15.92:0/226026666 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594b014ddc0 0x5594b01507f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.180+0000 7f11b4382740 1 --2- 172.21.15.92:0/226026666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b014d4a0 0x5594b016a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.180+0000 7f11b4382740 1 -- 172.21.15.92:0/226026666 >> 172.21.15.92:0/226026666 conn(0x5594b0149a30 msgr2=0x5594b01500e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:09.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.180+0000 7f11b4382740 1 -- 172.21.15.92:0/226026666 shutdown_connections 2024-09-19T09:10:09.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.180+0000 7f11b4382740 1 -- 172.21.15.92:0/226026666 wait complete. 2024-09-19T09:10:09.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.180+0000 7f11b4382740 1 -- start start 2024-09-19T09:10:09.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.181+0000 7f11b4382740 1 Processor -- start 2024-09-19T09:10:09.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.181+0000 7f11b4382740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594b014d4a0 0x5594b0160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.182+0000 7f11b4382740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b014ddc0 0x5594b0160fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.182+0000 7f11ab7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594b014d4a0 0x5594b0160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:09.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.182+0000 7f11ab7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594b014d4a0 0x5594b0160a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59600/0 (socket says 172.21.15.92:59600) 2024-09-19T09:10:09.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.182+0000 7f11ab7fe640 1 -- 172.21.15.92:0/449091775 learned_addr learned my addr 172.21.15.92:0/449091775 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:09.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.182+0000 7f11b4382740 1 --2- 172.21.15.92:0/449091775 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594b0158680 0x5594b01593c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.183+0000 7f11aaffd640 1 --2- 172.21.15.92:0/449091775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b014ddc0 0x5594b0160fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:09.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.183+0000 7f11b4382740 1 -- 172.21.15.92:0/449091775 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f11ac1c39f0 con 0x5594b014d4a0 2024-09-19T09:10:09.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.183+0000 7f11abfff640 1 --2- 172.21.15.92:0/449091775 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594b0158680 0x5594b01593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:09.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.183+0000 7f11b4382740 1 -- 172.21.15.92:0/449091775 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f11ac1c4e60 con 0x5594b014ddc0 2024-09-19T09:10:09.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.183+0000 7f11b4382740 1 -- 172.21.15.92:0/449091775 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f11ac1c40c0 con 0x5594b0158680 2024-09-19T09:10:09.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.183+0000 7f11b4382740 10 client.0 _ll_register_callbacks cb 0x7f11ac110870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:10:09.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.184+0000 7f11aaffd640 1 -- 172.21.15.92:0/449091775 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594b0158680 msgr2=0x5594b01593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:09.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.184+0000 7f11aaffd640 1 --2- 172.21.15.92:0/449091775 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594b0158680 0x5594b01593c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.184+0000 7f11aaffd640 1 -- 172.21.15.92:0/449091775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594b014d4a0 msgr2=0x5594b0160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:09.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.184+0000 7f11aaffd640 1 --2- 172.21.15.92:0/449091775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594b014d4a0 0x5594b0160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.184+0000 7f11aaffd640 1 -- 172.21.15.92:0/449091775 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594b0158200 con 0x5594b014ddc0 2024-09-19T09:10:09.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.184+0000 7f11b4382740 1 -- 172.21.15.92:0/449091775 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f119c004040 con 0x5594b014ddc0 2024-09-19T09:10:09.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.184+0000 7f11aaffd640 1 --2- 172.21.15.92:0/449091775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b014ddc0 0x5594b0160fa0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x5594b014dd90 tx=0x7f119c00a400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f11000e4df22345 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:09.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.184+0000 7f118affd640 10 client.27770 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:10:09.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.184+0000 7f118affd640 1 -- 172.21.15.92:0/449091775 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119c032060 con 0x5594b014ddc0 2024-09-19T09:10:09.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.184+0000 7f118affd640 1 -- 172.21.15.92:0/449091775 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f119c00cc10 con 0x5594b014ddc0 2024-09-19T09:10:09.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.184+0000 7f118affd640 1 -- 172.21.15.92:0/449091775 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f119c015050 con 0x5594b014ddc0 2024-09-19T09:10:09.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.184+0000 7f11b4382740 10 client.27770 fetch_fsmap learned FSMap version 19 2024-09-19T09:10:09.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.184+0000 7f11b4382740 1 -- 172.21.15.92:0/449091775 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5594b015f0c0 con 0x5594b014ddc0 2024-09-19T09:10:09.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.185+0000 7f118affd640 1 -- 172.21.15.92:0/449091775 <== mon.2 v2:172.21.15.167:3300/0 4 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f119c035050 con 0x5594b014ddc0 2024-09-19T09:10:09.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.185+0000 7f11b4382740 10 client.27770 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:10:09.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.185+0000 7f11b4382740 10 client.27770 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:10:09.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.185+0000 7f11b4382740 20 client.27770 populate_metadata read hostname 'smithi092' 2024-09-19T09:10:09.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.185+0000 7f11b4382740 1 --2- 172.21.15.92:0/449091775 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5594b01d31d0 0x5594b01d55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.185+0000 7f11b4382740 4 client.27770 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:10:09.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.185+0000 7f11b4382740 1 -- 172.21.15.92:0/449091775 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5594b00bad60 con 0x5594b01d31d0 2024-09-19T09:10:09.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.186+0000 7f11ab7fe640 1 --2- 172.21.15.92:0/449091775 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5594b01d31d0 0x5594b01d55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:09.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.186+0000 7f118affd640 10 client.27770 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:09.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.186+0000 7f11ab7fe640 1 --2- 172.21.15.92:0/449091775 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5594b01d31d0 0x5594b01d55c0 crc :-1 s=READY pgs=401 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=228ba7db73443d09 server_cookie=eba2619334e23154 in_seq=0 out_seq=0 2024-09-19T09:10:09.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.187+0000 7f118affd640 1 -- 172.21.15.92:0/449091775 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5594b00bad60 con 0x5594b01d31d0 2024-09-19T09:10:09.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.187+0000 7f118affd640 10 client.27770 handle_command_reply: tid=0 2024-09-19T09:10:09.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.187+0000 7f11b4382740 1 client.27770 shutdown 2024-09-19T09:10:09.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.187+0000 7f11b4382740 1 -- 172.21.15.92:0/449091775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b014ddc0 msgr2=0x5594b0160fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:09.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.187+0000 7f11b4382740 1 --2- 172.21.15.92:0/449091775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b014ddc0 0x5594b0160fa0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x5594b014dd90 tx=0x7f119c00a400 comp rx=0 tx=0).stop 2024-09-19T09:10:09.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.187+0000 7f11b4382740 1 -- 172.21.15.92:0/449091775 shutdown_connections 2024-09-19T09:10:09.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.187+0000 7f11b4382740 1 --2- 172.21.15.92:0/449091775 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5594b01d31d0 0x5594b01d55c0 crc :-1 s=READY pgs=401 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.187+0000 7f118affd640 0 client.27770 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:09.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.187+0000 7f11b4382740 1 --2- 172.21.15.92:0/449091775 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5594b0158680 0x5594b01593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.187+0000 7f11b4382740 1 --2- 172.21.15.92:0/449091775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b014ddc0 0x5594b0160fa0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.187+0000 7f11b4382740 1 --2- 172.21.15.92:0/449091775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594b014d4a0 0x5594b0160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.187+0000 7f11b4382740 1 -- 172.21.15.92:0/449091775 >> 172.21.15.92:0/449091775 conn(0x5594b0149a30 msgr2=0x5594b0148350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:09.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.187+0000 7f11b4382740 1 -- 172.21.15.92:0/449091775 shutdown_connections 2024-09-19T09:10:09.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.187+0000 7f11b4382740 1 -- 172.21.15.92:0/449091775 wait complete. 2024-09-19T09:10:09.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.187+0000 7f11b4382740 20 client.27770 trim_cache size 0 max 16384 2024-09-19T09:10:09.192 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:10:09.192 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-19T09:10:09.192 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {} 2024-09-19T09:10:09.192 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:10:09.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.188+0000 7f11b1fa9640 1 -- 172.21.15.92:0/1536474857 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f11940a33d0 msgr2=0x7f11940a5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:09.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.188+0000 7f11b1fa9640 1 --2- 172.21.15.92:0/1536474857 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f11940a33d0 0x7f11940a5890 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x5594b014adb0 tx=0x7f11a40078b0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.188+0000 7f11b1fa9640 1 -- 172.21.15.92:0/1536474857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11ac109450 msgr2=0x7f11ac118770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:09.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.188+0000 7f11b1fa9640 1 --2- 172.21.15.92:0/1536474857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11ac109450 0x7f11ac118770 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f11a002a9b0 tx=0x7f11a0003c20 comp rx=0 tx=0).stop 2024-09-19T09:10:09.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.188+0000 7f11b1fa9640 1 -- 172.21.15.92:0/1536474857 shutdown_connections 2024-09-19T09:10:09.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.188+0000 7f11b1fa9640 1 --2- 172.21.15.92:0/1536474857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11ac11b140 0x7f11ac111d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.188+0000 7f11b1fa9640 1 --2- 172.21.15.92:0/1536474857 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11ac109830 0x7f11ac111800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.188+0000 7f11b1fa9640 1 --2- 172.21.15.92:0/1536474857 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f11940a33d0 0x7f11940a5890 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.188+0000 7f11b1fa9640 1 --2- 172.21.15.92:0/1536474857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11ac109450 0x7f11ac118770 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.188+0000 7f11b1fa9640 1 -- 172.21.15.92:0/1536474857 >> 172.21.15.92:0/1536474857 conn(0x7f11ac06e140 msgr2=0x7f11ac11be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:09.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.189+0000 7f11b1fa9640 1 -- 172.21.15.92:0/1536474857 shutdown_connections 2024-09-19T09:10:09.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:09.189+0000 7f11b1fa9640 1 -- 172.21.15.92:0/1536474857 wait complete. 2024-09-19T09:10:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.890+0000 7fb3ee58d640 1 -- 172.21.15.92:0/3268188140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3e8100cf0 msgr2=0x7fb3e8101170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.890+0000 7fb3ee58d640 1 --2- 172.21.15.92:0/3268188140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3e8100cf0 0x7fb3e8101170 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc009900 tx=0x7fb3dc02a410 comp rx=0 tx=0).stop 2024-09-19T09:10:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.891+0000 7fb3ee58d640 1 -- 172.21.15.92:0/3268188140 shutdown_connections 2024-09-19T09:10:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.891+0000 7fb3ee58d640 1 --2- 172.21.15.92:0/3268188140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3e81016b0 0x7fb3e8108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.891+0000 7fb3ee58d640 1 --2- 172.21.15.92:0/3268188140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3e8100cf0 0x7fb3e8101170 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.891+0000 7fb3ee58d640 1 --2- 172.21.15.92:0/3268188140 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3e8102050 0x7fb3e8102450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.891+0000 7fb3ee58d640 1 -- 172.21.15.92:0/3268188140 >> 172.21.15.92:0/3268188140 conn(0x7fb3e80fb930 msgr2=0x7fb3e80fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.892+0000 7fb3ee58d640 1 -- 172.21.15.92:0/3268188140 shutdown_connections 2024-09-19T09:10:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.892+0000 7fb3ee58d640 1 -- 172.21.15.92:0/3268188140 wait complete. 2024-09-19T09:10:09.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.892+0000 7fb3ee58d640 1 Processor -- start 2024-09-19T09:10:09.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.892+0000 7fb3ee58d640 1 -- start start 2024-09-19T09:10:09.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.893+0000 7fb3ee58d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3e8100cf0 0x7fb3e8197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.893+0000 7fb3ee58d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3e81016b0 0x7fb3e81982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.893+0000 7fb3ee58d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3e8102050 0x7fb3e819f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.893+0000 7fb3ee58d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e810c6c0 con 0x7fb3e8102050 2024-09-19T09:10:09.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.893+0000 7fb3ee58d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e810c540 con 0x7fb3e8100cf0 2024-09-19T09:10:09.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.893+0000 7fb3ee58d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e810c840 con 0x7fb3e81016b0 2024-09-19T09:10:09.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.893+0000 7fb3e77fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3e81016b0 0x7fb3e81982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:09.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.893+0000 7fb3e7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3e8100cf0 0x7fb3e8197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:09.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.893+0000 7fb3e7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3e8100cf0 0x7fb3e8197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:39218/0 (socket says 172.21.15.92:39218) 2024-09-19T09:10:09.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.893+0000 7fb3e7fff640 1 -- 172.21.15.92:0/2019089574 learned_addr learned my addr 172.21.15.92:0/2019089574 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:09.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.893+0000 7fb3ecb2a640 1 --2- 172.21.15.92:0/2019089574 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3e8102050 0x7fb3e819f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:09.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.893+0000 7fb3e77fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3e81016b0 0x7fb3e81982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:46206/0 (socket says 172.21.15.92:46206) 2024-09-19T09:10:09.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.893+0000 7fb3e7fff640 1 -- 172.21.15.92:0/2019089574 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3e81016b0 msgr2=0x7fb3e81982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:09.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.893+0000 7fb3e7fff640 1 --2- 172.21.15.92:0/2019089574 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3e81016b0 0x7fb3e81982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.893+0000 7fb3e7fff640 1 -- 172.21.15.92:0/2019089574 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3e8102050 msgr2=0x7fb3e819f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:09.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.893+0000 7fb3e7fff640 1 --2- 172.21.15.92:0/2019089574 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3e8102050 0x7fb3e819f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.893+0000 7fb3e7fff640 1 -- 172.21.15.92:0/2019089574 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3e819f9d0 con 0x7fb3e8100cf0 2024-09-19T09:10:09.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.894+0000 7fb3e7fff640 1 --2- 172.21.15.92:0/2019089574 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3e8100cf0 0x7fb3e8197db0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8009f20 tx=0x7fb3d800ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:09.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.894+0000 7fb3e57fa640 1 -- 172.21.15.92:0/2019089574 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d800cd00 con 0x7fb3e8100cf0 2024-09-19T09:10:09.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.894+0000 7fb3ee58d640 1 -- 172.21.15.92:0/2019089574 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3e8102f80 con 0x7fb3e8100cf0 2024-09-19T09:10:09.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.894+0000 7fb3e57fa640 1 -- 172.21.15.92:0/2019089574 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3d80137d0 con 0x7fb3e8100cf0 2024-09-19T09:10:09.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.894+0000 7fb3e57fa640 1 -- 172.21.15.92:0/2019089574 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8003830 con 0x7fb3e8100cf0 2024-09-19T09:10:09.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.894+0000 7fb3ee58d640 1 -- 172.21.15.92:0/2019089574 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3e81034f0 con 0x7fb3e8100cf0 2024-09-19T09:10:09.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.898+0000 7fb3f1403740 1 Processor -- start 2024-09-19T09:10:09.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.898+0000 7fb3e57fa640 1 -- 172.21.15.92:0/2019089574 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb3d8022020 con 0x7fb3e8100cf0 2024-09-19T09:10:09.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.898+0000 7fb3f1403740 1 -- start start 2024-09-19T09:10:09.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.898+0000 7fb3f1403740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e7c5e799a0 0x55e7c5e79da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.898+0000 7fb3f1403740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7c5e7a2e0 0x55e7c5e7eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.898+0000 7fb3f1403740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7c5e7f370 0x55e7c5e81830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.898+0000 7fb3f1403740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e7c5ddd2f0 con 0x55e7c5e7f370 2024-09-19T09:10:09.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.898+0000 7fb3f1403740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e7c5d85270 con 0x55e7c5e799a0 2024-09-19T09:10:09.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.898+0000 7fb3f1403740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e7c5dd92b0 con 0x55e7c5e7a2e0 2024-09-19T09:10:09.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.899+0000 7fb3e7fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7c5e7a2e0 0x55e7c5e7eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:09.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.899+0000 7fb3e7fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7c5e7a2e0 0x55e7c5e7eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:46220/0 (socket says 172.21.15.92:46220) 2024-09-19T09:10:09.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.899+0000 7fb3e7fff640 1 -- 172.21.15.92:0/3100904592 learned_addr learned my addr 172.21.15.92:0/3100904592 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:09.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.899+0000 7fb3ecb2a640 1 --2- 172.21.15.92:0/3100904592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e7c5e799a0 0x55e7c5e79da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:09.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.899+0000 7fb3e77fe640 1 --2- 172.21.15.92:0/3100904592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7c5e7f370 0x55e7c5e81830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:09.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.899+0000 7fb3e7fff640 1 -- 172.21.15.92:0/3100904592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e7c5e799a0 msgr2=0x55e7c5e79da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:09.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.899+0000 7fb3e7fff640 1 --2- 172.21.15.92:0/3100904592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e7c5e799a0 0x55e7c5e79da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.899+0000 7fb3e7fff640 1 -- 172.21.15.92:0/3100904592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7c5e7f370 msgr2=0x55e7c5e81830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:09.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.899+0000 7fb3e7fff640 1 --2- 172.21.15.92:0/3100904592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7c5e7f370 0x55e7c5e81830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.899+0000 7fb3e7fff640 1 -- 172.21.15.92:0/3100904592 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7c5d84340 con 0x55e7c5e7a2e0 2024-09-19T09:10:09.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.899+0000 7fb3ecb2a640 1 --2- 172.21.15.92:0/3100904592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e7c5e799a0 0x55e7c5e79da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:10:09.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.899+0000 7fb3e7fff640 1 --2- 172.21.15.92:0/3100904592 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7c5e7a2e0 0x55e7c5e7eda0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb3d80d7970 tx=0x7fb3d80d7a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6d893112de046e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:09.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.899+0000 7fb3ce7fc640 1 -- 172.21.15.92:0/3100904592 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d80de040 con 0x55e7c5e7a2e0 2024-09-19T09:10:09.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.899+0000 7fb3ce7fc640 1 -- 172.21.15.92:0/3100904592 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3d80e38c0 con 0x55e7c5e7a2e0 2024-09-19T09:10:09.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.900+0000 7fb3ce7fc640 1 -- 172.21.15.92:0/3100904592 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d80e0820 con 0x55e7c5e7a2e0 2024-09-19T09:10:09.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.900+0000 7fb3f1403740 1 -- 172.21.15.92:0/3100904592 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7c5e7a2e0 msgr2=0x55e7c5e7eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:09.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.900+0000 7fb3f1403740 1 --2- 172.21.15.92:0/3100904592 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7c5e7a2e0 0x55e7c5e7eda0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb3d80d7970 tx=0x7fb3d80d7a60 comp rx=0 tx=0).stop 2024-09-19T09:10:09.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.901+0000 7fb3f1403740 1 -- 172.21.15.92:0/3100904592 shutdown_connections 2024-09-19T09:10:09.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.901+0000 7fb3f1403740 1 --2- 172.21.15.92:0/3100904592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7c5e7f370 0x55e7c5e81830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.901+0000 7fb3f1403740 1 --2- 172.21.15.92:0/3100904592 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7c5e7a2e0 0x55e7c5e7eda0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.901+0000 7fb3f1403740 1 --2- 172.21.15.92:0/3100904592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e7c5e799a0 0x55e7c5e79da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.901+0000 7fb3f1403740 1 -- 172.21.15.92:0/3100904592 >> 172.21.15.92:0/3100904592 conn(0x55e7c5e75010 msgr2=0x55e7c5e75410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.901+0000 7fb3e57fa640 1 --2- 172.21.15.92:0/2019089574 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb3d00a32f0 0x7fb3d00a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.901+0000 7fb3f1403740 1 -- 172.21.15.92:0/3100904592 shutdown_connections 2024-09-19T09:10:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.901+0000 7fb3f1403740 1 -- 172.21.15.92:0/3100904592 wait complete. 2024-09-19T09:10:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.901+0000 7fb3e77fe640 1 --2- 172.21.15.92:0/2019089574 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb3d00a32f0 0x7fb3d00a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.901+0000 7fb3e57fa640 1 -- 172.21.15.92:0/2019089574 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb3d80d3a80 con 0x7fb3e8100cf0 2024-09-19T09:10:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.901+0000 7fb3f1403740 1 -- start start 2024-09-19T09:10:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.902+0000 7fb3f1403740 1 Processor -- start 2024-09-19T09:10:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.902+0000 7fb3f1403740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e7c5e799a0 0x55e7c5e94b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.902+0000 7fb3f1403740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7c5e7a2e0 0x55e7c5e950b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.902+0000 7fb3f1403740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7c5e7f370 0x55e7c5e9c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.902+0000 7fb3f1403740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e7c5e93350 con 0x55e7c5e7f370 2024-09-19T09:10:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.902+0000 7fb3f1403740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e7c5d66290 con 0x55e7c5e799a0 2024-09-19T09:10:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.902+0000 7fb3f1403740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e7c5e934d0 con 0x55e7c5e7a2e0 2024-09-19T09:10:09.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.902+0000 7fb3f1403740 10 client.0 _ll_register_callbacks cb 0x55e7c5d97140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:10:09.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.902+0000 7fb3e7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e7c5e799a0 0x55e7c5e94b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:09.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.902+0000 7fb3e7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e7c5e799a0 0x55e7c5e94b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:39222/0 (socket says 172.21.15.92:39222) 2024-09-19T09:10:09.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.902+0000 7fb3e7fff640 1 -- 172.21.15.92:0/296836 learned_addr learned my addr 172.21.15.92:0/296836 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:09.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.902+0000 7fb3ecb2a640 1 --2- 172.21.15.92:0/296836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7c5e7f370 0x55e7c5e9c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:09.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.903+0000 7fb3e77fe640 1 --2- 172.21.15.92:0/2019089574 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb3d00a32f0 0x7fb3d00a57b0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc0314e0 tx=0x7fb3dc005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:09.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.903+0000 7fb3ecb2a640 1 -- 172.21.15.92:0/296836 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7c5e7a2e0 msgr2=0x55e7c5e950b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.903+0000 7fb3ecb2a640 1 --2- 172.21.15.92:0/296836 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7c5e7a2e0 0x55e7c5e950b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.903+0000 7fb3ecb2a640 1 -- 172.21.15.92:0/296836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e7c5e799a0 msgr2=0x55e7c5e94b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.903+0000 7fb3ecb2a640 1 --2- 172.21.15.92:0/296836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e7c5e799a0 0x55e7c5e94b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.903+0000 7fb3ecb2a640 1 -- 172.21.15.92:0/296836 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7c5af0210 con 0x55e7c5e7f370 2024-09-19T09:10:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.903+0000 7fb3ecb2a640 1 --2- 172.21.15.92:0/296836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7c5e7f370 0x55e7c5e9c0f0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0011ce0 tx=0x7fb3e000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eae99e8173b8c5e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.903+0000 7fb3c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:10:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.904+0000 7fb3c77fe640 1 -- 172.21.15.92:0/296836 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e0003970 con 0x55e7c5e7f370 2024-09-19T09:10:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.904+0000 7fb3f1403740 1 -- 172.21.15.92:0/296836 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3d80e38c0 con 0x55e7c5e7f370 2024-09-19T09:10:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.904+0000 7fb3c77fe640 1 -- 172.21.15.92:0/296836 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb3e0003b10 con 0x55e7c5e7f370 2024-09-19T09:10:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.904+0000 7fb3c77fe640 1 -- 172.21.15.92:0/296836 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb3e0003d10 con 0x55e7c5e7f370 2024-09-19T09:10:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.905+0000 7fb3f1403740 10 client.18546 fetch_fsmap learned FSMap version 19 2024-09-19T09:10:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.905+0000 7fb3f1403740 1 -- 172.21.15.92:0/296836 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e7c5bbc620 con 0x55e7c5e7f370 2024-09-19T09:10:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.906+0000 7fb3c77fe640 1 -- 172.21.15.92:0/296836 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3e0004530 con 0x55e7c5e7f370 2024-09-19T09:10:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.906+0000 7fb3c77fe640 1 -- 172.21.15.92:0/296836 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fb3e001a990 con 0x55e7c5e7f370 2024-09-19T09:10:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.906+0000 7fb3f1403740 10 client.18546 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:10:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.906+0000 7fb3f1403740 10 client.18546 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:10:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.906+0000 7fb3f1403740 20 client.18546 populate_metadata read hostname 'smithi092' 2024-09-19T09:10:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.906+0000 7fb3f1403740 1 --2- 172.21.15.92:0/296836 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e7c5ea0990 0x55e7c5ea2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.906+0000 7fb3f1403740 4 client.18546 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:10:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.906+0000 7fb3f1403740 1 -- 172.21.15.92:0/296836 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb3d80e38c0 con 0x55e7c5ea0990 2024-09-19T09:10:09.913 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.913+0000 7fb3e7fff640 1 --2- 172.21.15.92:0/296836 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e7c5ea0990 0x55e7c5ea2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:09.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.919+0000 7fb3c77fe640 10 client.18546 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:09.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.919+0000 7fb3e7fff640 1 --2- 172.21.15.92:0/296836 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e7c5ea0990 0x55e7c5ea2dd0 crc :-1 s=READY pgs=402 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd33f55d479694cb server_cookie=bc4699cc0d1ea748 in_seq=0 out_seq=0 2024-09-19T09:10:09.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.920+0000 7fb3c77fe640 1 -- 172.21.15.92:0/296836 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fb3d80e38c0 con 0x55e7c5ea0990 2024-09-19T09:10:09.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.920+0000 7fb3c77fe640 10 client.18546 handle_command_reply: tid=0 2024-09-19T09:10:09.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.920+0000 7fb3f1403740 1 client.18546 shutdown 2024-09-19T09:10:09.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.921+0000 7fb3f1403740 1 -- 172.21.15.92:0/296836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7c5e7f370 msgr2=0x55e7c5e9c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:09.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.921+0000 7fb3f1403740 1 --2- 172.21.15.92:0/296836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7c5e7f370 0x55e7c5e9c0f0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0011ce0 tx=0x7fb3e000f790 comp rx=0 tx=0).stop 2024-09-19T09:10:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.927+0000 7fb3f1403740 1 -- 172.21.15.92:0/296836 shutdown_connections 2024-09-19T09:10:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.927+0000 7fb3f1403740 1 --2- 172.21.15.92:0/296836 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e7c5ea0990 0x55e7c5ea2dd0 crc :-1 s=READY pgs=402 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.927+0000 7fb3f1403740 1 --2- 172.21.15.92:0/296836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7c5e7f370 0x55e7c5e9c0f0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.928+0000 7fb3f1403740 1 --2- 172.21.15.92:0/296836 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7c5e7a2e0 0x55e7c5e950b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.928+0000 7fb3f1403740 1 --2- 172.21.15.92:0/296836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e7c5e799a0 0x55e7c5e94b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.928+0000 7fb3f1403740 1 -- 172.21.15.92:0/296836 >> 172.21.15.92:0/296836 conn(0x55e7c5e75010 msgr2=0x55e7c5e76820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:09.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.928+0000 7fb3c77fe640 0 client.18546 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:09.930 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.930+0000 7fb3f1403740 1 -- 172.21.15.92:0/296836 shutdown_connections 2024-09-19T09:10:09.930 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.930+0000 7fb3f1403740 1 -- 172.21.15.92:0/296836 wait complete. 2024-09-19T09:10:09.930 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.930+0000 7fb3f1403740 20 client.18546 trim_cache size 0 max 16384 2024-09-19T09:10:09.957 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.956+0000 7fb3f1403740 1 Processor -- start 2024-09-19T09:10:09.957 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.956+0000 7fb3f1403740 1 -- start start 2024-09-19T09:10:09.957 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.957+0000 7fb3f1403740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7c5e799a0 0x55e7c5e740b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.957+0000 7fb3e7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7c5e799a0 0x55e7c5e740b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:09.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.957+0000 7fb3e7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7c5e799a0 0x55e7c5e740b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59648/0 (socket says 172.21.15.92:59648) 2024-09-19T09:10:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.957+0000 7fb3f1403740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7c5e7a2e0 0x55e7c5e9c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.958+0000 7fb3e7fff640 1 -- 172.21.15.92:0/2278418277 learned_addr learned my addr 172.21.15.92:0/2278418277 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.958+0000 7fb3f1403740 1 --2- 172.21.15.92:0/2278418277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e7c5e7f370 0x55e7c5e76400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.958+0000 7fb3e77fe640 1 --2- 172.21.15.92:0/2278418277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7c5e7a2e0 0x55e7c5e9c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.958+0000 7fb3f1403740 1 -- 172.21.15.92:0/2278418277 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e8071020 con 0x55e7c5e799a0 2024-09-19T09:10:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.958+0000 7fb3f1403740 1 -- 172.21.15.92:0/2278418277 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e80738c0 con 0x55e7c5e7f370 2024-09-19T09:10:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.958+0000 7fb3ecb2a640 1 --2- 172.21.15.92:0/2278418277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e7c5e7f370 0x55e7c5e76400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.958+0000 7fb3f1403740 1 -- 172.21.15.92:0/2278418277 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e80716b0 con 0x55e7c5e7a2e0 2024-09-19T09:10:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.959+0000 7fb3ecb2a640 1 -- 172.21.15.92:0/2278418277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7c5e7a2e0 msgr2=0x55e7c5e9c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.959+0000 7fb3ecb2a640 1 --2- 172.21.15.92:0/2278418277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7c5e7a2e0 0x55e7c5e9c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.959+0000 7fb3ecb2a640 1 -- 172.21.15.92:0/2278418277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7c5e799a0 msgr2=0x55e7c5e740b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.959+0000 7fb3ecb2a640 1 --2- 172.21.15.92:0/2278418277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7c5e799a0 0x55e7c5e740b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.959+0000 7fb3ecb2a640 1 -- 172.21.15.92:0/2278418277 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7c5e74e30 con 0x55e7c5e7f370 2024-09-19T09:10:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.959+0000 7fb3ecb2a640 1 --2- 172.21.15.92:0/2278418277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e7c5e7f370 0x55e7c5e76400 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0019590 tx=0x7fb3e0005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e5f18d15131b80c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.960+0000 7fb3cdffb640 1 -- 172.21.15.92:0/2278418277 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e0029040 con 0x55e7c5e7f370 2024-09-19T09:10:09.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.960+0000 7fb3cdffb640 1 -- 172.21.15.92:0/2278418277 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3e0019d50 con 0x55e7c5e7f370 2024-09-19T09:10:09.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.960+0000 7fb3cdffb640 1 -- 172.21.15.92:0/2278418277 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e001a5c0 con 0x55e7c5e7f370 2024-09-19T09:10:09.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.963+0000 7fb3f1403740 1 -- 172.21.15.92:0/2278418277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e7c5e7f370 msgr2=0x55e7c5e76400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:09.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.963+0000 7fb3f1403740 1 --2- 172.21.15.92:0/2278418277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e7c5e7f370 0x55e7c5e76400 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0019590 tx=0x7fb3e0005fd0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.966+0000 7fb3f1403740 1 -- 172.21.15.92:0/2278418277 shutdown_connections 2024-09-19T09:10:09.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.966+0000 7fb3f1403740 1 --2- 172.21.15.92:0/2278418277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e7c5e7f370 0x55e7c5e76400 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.966+0000 7fb3f1403740 1 --2- 172.21.15.92:0/2278418277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7c5e7a2e0 0x55e7c5e9c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.966+0000 7fb3f1403740 1 --2- 172.21.15.92:0/2278418277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7c5e799a0 0x55e7c5e740b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.966+0000 7fb3f1403740 1 -- 172.21.15.92:0/2278418277 >> 172.21.15.92:0/2278418277 conn(0x55e7c5e75010 msgr2=0x55e7c5e739a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:09.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.970+0000 7fb3f1403740 1 -- 172.21.15.92:0/2278418277 shutdown_connections 2024-09-19T09:10:09.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.970+0000 7fb3f1403740 1 -- 172.21.15.92:0/2278418277 wait complete. 2024-09-19T09:10:09.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.970+0000 7fb3f1403740 1 -- start start 2024-09-19T09:10:09.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.971+0000 7fb3f1403740 1 Processor -- start 2024-09-19T09:10:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.971+0000 7fb3f1403740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e7c5e799a0 0x55e7c5e99360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.972+0000 7fb3f1403740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7c5e7a2e0 0x55e7c5e998a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.972+0000 7fb3e7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e7c5e799a0 0x55e7c5e99360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:09.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.972+0000 7fb3e7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e7c5e799a0 0x55e7c5e99360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:39230/0 (socket says 172.21.15.92:39230) 2024-09-19T09:10:09.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.972+0000 7fb3e7fff640 1 -- 172.21.15.92:0/4291531782 learned_addr learned my addr 172.21.15.92:0/4291531782 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:09.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.972+0000 7fb3f1403740 1 --2- 172.21.15.92:0/4291531782 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7c5e7f370 0x55e7c5e9a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.972+0000 7fb3f1403740 1 -- 172.21.15.92:0/4291531782 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e8071d80 con 0x55e7c5e7a2e0 2024-09-19T09:10:09.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.972+0000 7fb3f1403740 1 -- 172.21.15.92:0/4291531782 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e80731f0 con 0x55e7c5e799a0 2024-09-19T09:10:09.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.972+0000 7fb3ecb2a640 1 --2- 172.21.15.92:0/4291531782 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7c5e7f370 0x55e7c5e9a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:09.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.972+0000 7fb3f1403740 1 -- 172.21.15.92:0/4291531782 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e8072450 con 0x55e7c5e7f370 2024-09-19T09:10:09.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.973+0000 7fb3f1403740 10 client.0 _ll_register_callbacks cb 0x7fb3e0009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:10:09.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.973+0000 7fb3e77fe640 1 --2- 172.21.15.92:0/4291531782 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7c5e7a2e0 0x55e7c5e998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:09.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.973+0000 7fb3e77fe640 1 -- 172.21.15.92:0/4291531782 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7c5e7f370 msgr2=0x55e7c5e9a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:09.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.973+0000 7fb3e77fe640 1 --2- 172.21.15.92:0/4291531782 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7c5e7f370 0x55e7c5e9a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.973+0000 7fb3e77fe640 1 -- 172.21.15.92:0/4291531782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e7c5e799a0 msgr2=0x55e7c5e99360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:09.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.973+0000 7fb3e77fe640 1 --2- 172.21.15.92:0/4291531782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e7c5e799a0 0x55e7c5e99360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.973+0000 7fb3e77fe640 1 -- 172.21.15.92:0/4291531782 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7c5e9ae70 con 0x55e7c5e7a2e0 2024-09-19T09:10:09.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.974+0000 7fb3e77fe640 1 --2- 172.21.15.92:0/4291531782 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7c5e7a2e0 0x55e7c5e998a0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc031440 tx=0x7fb3dc02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b644453d9f2d446d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:09.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.974+0000 7fb3c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:10:09.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.976+0000 7fb3c77fe640 1 -- 172.21.15.92:0/4291531782 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc035040 con 0x55e7c5e7a2e0 2024-09-19T09:10:09.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.976+0000 7fb3c77fe640 1 -- 172.21.15.92:0/4291531782 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb3dc004230 con 0x55e7c5e7a2e0 2024-09-19T09:10:09.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.976+0000 7fb3f1403740 1 -- 172.21.15.92:0/4291531782 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3e0019d50 con 0x55e7c5e7a2e0 2024-09-19T09:10:09.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.977+0000 7fb3c77fe640 1 -- 172.21.15.92:0/4291531782 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb3dc004430 con 0x55e7c5e7a2e0 2024-09-19T09:10:09.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.977+0000 7fb3f1403740 10 client.18552 fetch_fsmap learned FSMap version 19 2024-09-19T09:10:09.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.977+0000 7fb3f1403740 1 -- 172.21.15.92:0/4291531782 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e7c5e9c1d0 con 0x55e7c5e7a2e0 2024-09-19T09:10:09.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.978+0000 7fb3c77fe640 1 -- 172.21.15.92:0/4291531782 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3dc004780 con 0x55e7c5e7a2e0 2024-09-19T09:10:09.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.979+0000 7fb3c77fe640 1 -- 172.21.15.92:0/4291531782 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fb3dc003750 con 0x55e7c5e7a2e0 2024-09-19T09:10:09.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.979+0000 7fb3f1403740 10 client.18552 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:10:09.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.979+0000 7fb3f1403740 10 client.18552 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:10:09.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.979+0000 7fb3f1403740 20 client.18552 populate_metadata read hostname 'smithi092' 2024-09-19T09:10:09.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.979+0000 7fb3f1403740 1 --2- 172.21.15.92:0/4291531782 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e7c5f0ba60 0x55e7c5f0de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.979+0000 7fb3f1403740 4 client.18552 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:10:09.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.979+0000 7fb3f1403740 1 -- 172.21.15.92:0/4291531782 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fb3e0019d50 con 0x55e7c5f0ba60 2024-09-19T09:10:09.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.979+0000 7fb3e7fff640 1 --2- 172.21.15.92:0/4291531782 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e7c5f0ba60 0x55e7c5f0de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:09.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.982+0000 7fb3e7fff640 1 --2- 172.21.15.92:0/4291531782 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e7c5f0ba60 0x55e7c5f0de80 crc :-1 s=READY pgs=403 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8fbe048dc9801a2 server_cookie=c9233fd4addd8fbb in_seq=0 out_seq=0 2024-09-19T09:10:09.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:09.982+0000 7fb3c77fe640 10 client.18552 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:10.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:10.002+0000 7fb3c77fe640 1 -- 172.21.15.92:0/4291531782 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fb3e0019d50 con 0x55e7c5f0ba60 2024-09-19T09:10:10.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:10.002+0000 7fb3c77fe640 10 client.18552 handle_command_reply: tid=0 2024-09-19T09:10:10.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:10.002+0000 7fb3f1403740 1 client.18552 shutdown 2024-09-19T09:10:10.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:10.002+0000 7fb3f1403740 1 -- 172.21.15.92:0/4291531782 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7c5e7a2e0 msgr2=0x55e7c5e998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:10.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:10.002+0000 7fb3f1403740 1 --2- 172.21.15.92:0/4291531782 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7c5e7a2e0 0x55e7c5e998a0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc031440 tx=0x7fb3dc02a410 comp rx=0 tx=0).stop 2024-09-19T09:10:10.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:10.002+0000 7fb3f1403740 1 -- 172.21.15.92:0/4291531782 shutdown_connections 2024-09-19T09:10:10.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:10.002+0000 7fb3f1403740 1 --2- 172.21.15.92:0/4291531782 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e7c5f0ba60 0x55e7c5f0de80 crc :-1 s=READY pgs=403 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:10.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:10.002+0000 7fb3f1403740 1 --2- 172.21.15.92:0/4291531782 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7c5e7f370 0x55e7c5e9a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:10.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:10.003+0000 7fb3f1403740 1 --2- 172.21.15.92:0/4291531782 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7c5e7a2e0 0x55e7c5e998a0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:10.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:10.003+0000 7fb3f1403740 1 --2- 172.21.15.92:0/4291531782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e7c5e799a0 0x55e7c5e99360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:10.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:10.003+0000 7fb3f1403740 1 -- 172.21.15.92:0/4291531782 >> 172.21.15.92:0/4291531782 conn(0x55e7c5e75010 msgr2=0x55e7c5e741c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:10.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:10.003+0000 7fb3c77fe640 0 client.18552 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:10.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:10.003+0000 7fb3f1403740 1 -- 172.21.15.92:0/4291531782 shutdown_connections 2024-09-19T09:10:10.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:10.003+0000 7fb3f1403740 1 -- 172.21.15.92:0/4291531782 wait complete. 2024-09-19T09:10:10.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:10.003+0000 7fb3f1403740 20 client.18552 trim_cache size 0 max 16384 2024-09-19T09:10:10.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:10:10.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:10:10.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:10:10.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:10:10.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:10.004+0000 7fb3ee58d640 1 -- 172.21.15.92:0/2019089574 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb3d00a32f0 msgr2=0x7fb3d00a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:10.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:10.004+0000 7fb3ee58d640 1 --2- 172.21.15.92:0/2019089574 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb3d00a32f0 0x7fb3d00a57b0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc0314e0 tx=0x7fb3dc005fd0 comp rx=0 tx=0).stop 2024-09-19T09:10:10.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:10.004+0000 7fb3ee58d640 1 -- 172.21.15.92:0/2019089574 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3e8100cf0 msgr2=0x7fb3e8197db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:10.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:10.004+0000 7fb3ee58d640 1 --2- 172.21.15.92:0/2019089574 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3e8100cf0 0x7fb3e8197db0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8009f20 tx=0x7fb3d800ee50 comp rx=0 tx=0).stop 2024-09-19T09:10:10.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:10.004+0000 7fb3ee58d640 1 -- 172.21.15.92:0/2019089574 shutdown_connections 2024-09-19T09:10:10.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:10.004+0000 7fb3ee58d640 1 --2- 172.21.15.92:0/2019089574 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb3d00a32f0 0x7fb3d00a57b0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:10.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:10.004+0000 7fb3ee58d640 1 --2- 172.21.15.92:0/2019089574 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3e8102050 0x7fb3e819f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:10.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:10.004+0000 7fb3ee58d640 1 --2- 172.21.15.92:0/2019089574 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3e81016b0 0x7fb3e81982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:10.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:10.004+0000 7fb3ee58d640 1 --2- 172.21.15.92:0/2019089574 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3e8100cf0 0x7fb3e8197db0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:10.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:10.004+0000 7fb3ee58d640 1 -- 172.21.15.92:0/2019089574 >> 172.21.15.92:0/2019089574 conn(0x7fb3e80fb930 msgr2=0x7fb3e80fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:10.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:10.004+0000 7fb3ee58d640 1 -- 172.21.15.92:0/2019089574 shutdown_connections 2024-09-19T09:10:10.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:10.004+0000 7fb3ee58d640 1 -- 172.21.15.92:0/2019089574 wait complete. 2024-09-19T09:10:10.340 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:10:10.340 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:10:10.783 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:10:10.798 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 805.0 s, 2081.3 tps, lat 47.564 ms stddev 57.551 2024-09-19T09:10:11.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:10 smithi092 ceph-mon[31407]: pgmap v741: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 MiB/s wr, 812 op/s 2024-09-19T09:10:11.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:10 smithi167 ceph-mon[35359]: pgmap v741: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 MiB/s wr, 812 op/s 2024-09-19T09:10:11.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:10 smithi190 ceph-mon[35358]: pgmap v741: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 MiB/s wr, 812 op/s 2024-09-19T09:10:11.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.305+0000 7f018daff640 1 -- 172.21.15.92:0/3611000984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01881027a0 msgr2=0x7f01881067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:11.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.305+0000 7f018daff640 1 --2- 172.21.15.92:0/3611000984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01881027a0 0x7f01881067f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0170009900 tx=0x7f017002a3f0 comp rx=0 tx=0).stop 2024-09-19T09:10:11.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.305+0000 7f018daff640 1 -- 172.21.15.92:0/3611000984 shutdown_connections 2024-09-19T09:10:11.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.305+0000 7f018daff640 1 --2- 172.21.15.92:0/3611000984 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0188106f20 0x7f018810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:11.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.305+0000 7f018daff640 1 --2- 172.21.15.92:0/3611000984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01881027a0 0x7f01881067f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:11.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.305+0000 7f018daff640 1 --2- 172.21.15.92:0/3611000984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0188101df0 0x7f01881021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:11.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.305+0000 7f018daff640 1 -- 172.21.15.92:0/3611000984 >> 172.21.15.92:0/3611000984 conn(0x7f01880fd8f0 msgr2=0x7f01880ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:11.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.305+0000 7f018daff640 1 -- 172.21.15.92:0/3611000984 shutdown_connections 2024-09-19T09:10:11.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.305+0000 7f018daff640 1 -- 172.21.15.92:0/3611000984 wait complete. 2024-09-19T09:10:11.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.306+0000 7f018daff640 1 Processor -- start 2024-09-19T09:10:11.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.306+0000 7f018daff640 1 -- start start 2024-09-19T09:10:11.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.306+0000 7f018daff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0188101df0 0x7f01880744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:11.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.306+0000 7f018daff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01881027a0 0x7f0188074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:11.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.306+0000 7f018daff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0188106f20 0x7f0188074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:11.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.306+0000 7f018daff640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0188111fa0 con 0x7f01881027a0 2024-09-19T09:10:11.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.306+0000 7f018daff640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0188111e20 con 0x7f0188101df0 2024-09-19T09:10:11.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.306+0000 7f018daff640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0188112120 con 0x7f0188106f20 2024-09-19T09:10:11.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.306+0000 7f0186ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01881027a0 0x7f0188074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:11.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.306+0000 7f0186ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01881027a0 0x7f0188074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59680/0 (socket says 172.21.15.92:59680) 2024-09-19T09:10:11.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.306+0000 7f0186ffd640 1 -- 172.21.15.92:0/4068704466 learned_addr learned my addr 172.21.15.92:0/4068704466 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:11.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.306+0000 7f0187fff640 1 --2- 172.21.15.92:0/4068704466 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0188106f20 0x7f0188074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:11.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.307+0000 7f0187fff640 1 -- 172.21.15.92:0/4068704466 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0188101df0 msgr2=0x7f01880744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:11.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.307+0000 7f0187fff640 1 --2- 172.21.15.92:0/4068704466 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0188101df0 0x7f01880744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:11.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.307+0000 7f0187fff640 1 -- 172.21.15.92:0/4068704466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01881027a0 msgr2=0x7f0188074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:11.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.307+0000 7f0187fff640 1 --2- 172.21.15.92:0/4068704466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01881027a0 0x7f0188074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:11.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.307+0000 7f0187fff640 1 -- 172.21.15.92:0/4068704466 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01881a6a30 con 0x7f0188106f20 2024-09-19T09:10:11.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.307+0000 7f0186ffd640 1 --2- 172.21.15.92:0/4068704466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01881027a0 0x7f0188074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:10:11.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.307+0000 7f0187fff640 1 --2- 172.21.15.92:0/4068704466 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0188106f20 0x7f0188074f70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f018000be20 tx=0x7f018000bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:11.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.307+0000 7f0184ff9640 1 -- 172.21.15.92:0/4068704466 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0180019070 con 0x7f0188106f20 2024-09-19T09:10:11.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.307+0000 7f0184ff9640 1 -- 172.21.15.92:0/4068704466 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0180014920 con 0x7f0188106f20 2024-09-19T09:10:11.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.307+0000 7f0184ff9640 1 -- 172.21.15.92:0/4068704466 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0180012920 con 0x7f0188106f20 2024-09-19T09:10:11.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.308+0000 7f018daff640 1 -- 172.21.15.92:0/4068704466 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01881a6d20 con 0x7f0188106f20 2024-09-19T09:10:11.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.308+0000 7f018daff640 1 -- 172.21.15.92:0/4068704466 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01881a7210 con 0x7f0188106f20 2024-09-19T09:10:11.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.309+0000 7f018daff640 1 -- 172.21.15.92:0/4068704466 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0168005290 con 0x7f0188106f20 2024-09-19T09:10:11.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.310+0000 7f0184ff9640 1 -- 172.21.15.92:0/4068704466 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f018001c070 con 0x7f0188106f20 2024-09-19T09:10:11.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.311+0000 7f0184ff9640 1 --2- 172.21.15.92:0/4068704466 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f01740a32c0 0x7f01740a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:11.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.311+0000 7f0184ff9640 1 -- 172.21.15.92:0/4068704466 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f01800cf080 con 0x7f0188106f20 2024-09-19T09:10:11.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.311+0000 7f01877fe640 1 --2- 172.21.15.92:0/4068704466 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f01740a32c0 0x7f01740a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:11.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.313+0000 7f01877fe640 1 --2- 172.21.15.92:0/4068704466 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f01740a32c0 0x7f01740a5780 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f01780058c0 tx=0x7f0178005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:11.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.316+0000 7f0184ff9640 1 -- 172.21.15.92:0/4068704466 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f018009b710 con 0x7f0188106f20 2024-09-19T09:10:11.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.645+0000 7f018daff640 1 -- 172.21.15.92:0/4068704466 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0168005580 con 0x7f0188106f20 2024-09-19T09:10:11.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.646+0000 7f0184ff9640 1 -- 172.21.15.92:0/4068704466 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f018009fa10 con 0x7f0188106f20 2024-09-19T09:10:11.647 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:10:11.647 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:10:11.647 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:10:11.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.648+0000 7f018daff640 1 -- 172.21.15.92:0/4068704466 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f01740a32c0 msgr2=0x7f01740a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:11.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.648+0000 7f018daff640 1 --2- 172.21.15.92:0/4068704466 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f01740a32c0 0x7f01740a5780 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f01780058c0 tx=0x7f0178005850 comp rx=0 tx=0).stop 2024-09-19T09:10:11.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.648+0000 7f018daff640 1 -- 172.21.15.92:0/4068704466 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0188106f20 msgr2=0x7f0188074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:11.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.648+0000 7f018daff640 1 --2- 172.21.15.92:0/4068704466 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0188106f20 0x7f0188074f70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f018000be20 tx=0x7f018000bf10 comp rx=0 tx=0).stop 2024-09-19T09:10:11.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.648+0000 7f018daff640 1 -- 172.21.15.92:0/4068704466 shutdown_connections 2024-09-19T09:10:11.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.648+0000 7f018daff640 1 --2- 172.21.15.92:0/4068704466 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0188106f20 0x7f0188074f70 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:11.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.648+0000 7f018daff640 1 --2- 172.21.15.92:0/4068704466 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f01740a32c0 0x7f01740a5780 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:11.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.648+0000 7f018daff640 1 --2- 172.21.15.92:0/4068704466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01881027a0 0x7f0188074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:11.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.648+0000 7f018daff640 1 --2- 172.21.15.92:0/4068704466 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0188101df0 0x7f01880744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:11.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.648+0000 7f018daff640 1 -- 172.21.15.92:0/4068704466 >> 172.21.15.92:0/4068704466 conn(0x7f01880fd8f0 msgr2=0x7f01880fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:11.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.648+0000 7f018daff640 1 -- 172.21.15.92:0/4068704466 shutdown_connections 2024-09-19T09:10:11.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:11.648+0000 7f018daff640 1 -- 172.21.15.92:0/4068704466 wait complete. 2024-09-19T09:10:11.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:11 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/4068704466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:10:12.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:11 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/4068704466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:10:12.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:11 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/4068704466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:10:12.434 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:10:12.800 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:10:12.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:12 smithi092 ceph-mon[31407]: pgmap v742: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 20 MiB/s wr, 803 op/s 2024-09-19T09:10:13.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:12 smithi167 ceph-mon[35359]: pgmap v742: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 20 MiB/s wr, 803 op/s 2024-09-19T09:10:13.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:12 smithi190 ceph-mon[35358]: pgmap v742: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 20 MiB/s wr, 803 op/s 2024-09-19T09:10:13.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.407+0000 7efc17d5b640 1 -- 172.21.15.92:0/674437862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc10100aa0 msgr2=0x7efc1010ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:13.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.408+0000 7efc17d5b640 1 --2- 172.21.15.92:0/674437862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc10100aa0 0x7efc1010ea20 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7efc08009ca0 tx=0x7efc0802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:10:13.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.408+0000 7efc17d5b640 1 -- 172.21.15.92:0/674437862 shutdown_connections 2024-09-19T09:10:13.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.408+0000 7efc17d5b640 1 --2- 172.21.15.92:0/674437862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc10100aa0 0x7efc1010ea20 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:13.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.408+0000 7efc17d5b640 1 --2- 172.21.15.92:0/674437862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc10100100 0x7efc10100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:13.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.408+0000 7efc17d5b640 1 --2- 172.21.15.92:0/674437862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc10106b80 0x7efc10106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:13.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.408+0000 7efc17d5b640 1 -- 172.21.15.92:0/674437862 >> 172.21.15.92:0/674437862 conn(0x7efc10077230 msgr2=0x7efc100fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:13.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.408+0000 7efc17d5b640 1 -- 172.21.15.92:0/674437862 shutdown_connections 2024-09-19T09:10:13.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.408+0000 7efc17d5b640 1 -- 172.21.15.92:0/674437862 wait complete. 2024-09-19T09:10:13.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.409+0000 7efc17d5b640 1 Processor -- start 2024-09-19T09:10:13.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.409+0000 7efc17d5b640 1 -- start start 2024-09-19T09:10:13.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.409+0000 7efc17d5b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc10100100 0x7efc10198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:13.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.409+0000 7efc17d5b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc10100aa0 0x7efc101989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:13.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.409+0000 7efc17d5b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc10106b80 0x7efc1019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:13.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.409+0000 7efc17d5b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efc10112050 con 0x7efc10100aa0 2024-09-19T09:10:13.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.409+0000 7efc17d5b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efc10111ed0 con 0x7efc10100100 2024-09-19T09:10:13.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.409+0000 7efc17d5b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7efc101121d0 con 0x7efc10106b80 2024-09-19T09:10:13.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.410+0000 7efc152f6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc10100aa0 0x7efc101989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:13.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.410+0000 7efc152f6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc10100aa0 0x7efc101989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40564/0 (socket says 172.21.15.92:40564) 2024-09-19T09:10:13.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.410+0000 7efc152f6640 1 -- 172.21.15.92:0/3662277419 learned_addr learned my addr 172.21.15.92:0/3662277419 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:13.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.410+0000 7efc15af7640 1 --2- 172.21.15.92:0/3662277419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc10100100 0x7efc10198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:13.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.410+0000 7efc162f8640 1 --2- 172.21.15.92:0/3662277419 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc10106b80 0x7efc1019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:13.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.410+0000 7efc15af7640 1 -- 172.21.15.92:0/3662277419 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc10106b80 msgr2=0x7efc1019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:13.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.410+0000 7efc15af7640 1 --2- 172.21.15.92:0/3662277419 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc10106b80 0x7efc1019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:13.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.410+0000 7efc15af7640 1 -- 172.21.15.92:0/3662277419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc10100aa0 msgr2=0x7efc101989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:13.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.410+0000 7efc15af7640 1 --2- 172.21.15.92:0/3662277419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc10100aa0 0x7efc101989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:13.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.410+0000 7efc15af7640 1 -- 172.21.15.92:0/3662277419 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc1019d440 con 0x7efc10100100 2024-09-19T09:10:13.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.410+0000 7efc162f8640 1 --2- 172.21.15.92:0/3662277419 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc10106b80 0x7efc1019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:10:13.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.410+0000 7efc15af7640 1 --2- 172.21.15.92:0/3662277419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc10100100 0x7efc10198490 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7efc0c00e9f0 tx=0x7efc0c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:13.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.411+0000 7efc06ffd640 1 -- 172.21.15.92:0/3662277419 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0c00cd80 con 0x7efc10100100 2024-09-19T09:10:13.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.411+0000 7efc06ffd640 1 -- 172.21.15.92:0/3662277419 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc0c0035f0 con 0x7efc10100100 2024-09-19T09:10:13.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.411+0000 7efc06ffd640 1 -- 172.21.15.92:0/3662277419 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0c010690 con 0x7efc10100100 2024-09-19T09:10:13.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.411+0000 7efc17d5b640 1 -- 172.21.15.92:0/3662277419 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc1019d730 con 0x7efc10100100 2024-09-19T09:10:13.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.411+0000 7efc17d5b640 1 -- 172.21.15.92:0/3662277419 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc10101210 con 0x7efc10100100 2024-09-19T09:10:13.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.414+0000 7efc1a134740 1 Processor -- start 2024-09-19T09:10:13.416 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.416+0000 7efc1a134740 1 -- start start 2024-09-19T09:10:13.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.416+0000 7efc1a134740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8f39b2b40 0x55d8f39b1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:13.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.416+0000 7efc1a134740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8f39b15d0 0x55d8f39b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:13.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.416+0000 7efc1a134740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8f39bc370 0x55d8f39be760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:13.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.416+0000 7efc1a134740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d8f39172f0 con 0x55d8f39bc370 2024-09-19T09:10:13.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.416+0000 7efc1a134740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d8f38becf0 con 0x55d8f39b2b40 2024-09-19T09:10:13.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.416+0000 7efc1a134740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55d8f39132b0 con 0x55d8f39b15d0 2024-09-19T09:10:13.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.416+0000 7efc15af7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8f39b15d0 0x55d8f39b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:13.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.416+0000 7efc162f8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8f39b2b40 0x55d8f39b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:13.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.417+0000 7efc15af7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8f39b15d0 0x55d8f39b1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:57976/0 (socket says 172.21.15.92:57976) 2024-09-19T09:10:13.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.417+0000 7efc15af7640 1 -- 172.21.15.92:0/3764385547 learned_addr learned my addr 172.21.15.92:0/3764385547 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:13.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.417+0000 7efc162f8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8f39b2b40 0x55d8f39b1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:51874/0 (socket says 172.21.15.92:51874) 2024-09-19T09:10:13.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.416+0000 7efc06ffd640 1 -- 172.21.15.92:0/3662277419 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7efc0c003b30 con 0x7efc10100100 2024-09-19T09:10:13.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.417+0000 7efc152f6640 1 --2- 172.21.15.92:0/3764385547 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8f39bc370 0x55d8f39be760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:13.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.417+0000 7efc15af7640 1 -- 172.21.15.92:0/3764385547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8f39b2b40 msgr2=0x55d8f39b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:13.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.417+0000 7efc15af7640 1 --2- 172.21.15.92:0/3764385547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8f39b2b40 0x55d8f39b1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:13.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.417+0000 7efc15af7640 1 -- 172.21.15.92:0/3764385547 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8f39bc370 msgr2=0x55d8f39be760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:13.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.417+0000 7efc15af7640 1 --2- 172.21.15.92:0/3764385547 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8f39bc370 0x55d8f39be760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:13.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.417+0000 7efc15af7640 1 -- 172.21.15.92:0/3764385547 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8f38a33a0 con 0x55d8f39b15d0 2024-09-19T09:10:13.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.417+0000 7efc152f6640 1 --2- 172.21.15.92:0/3764385547 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8f39bc370 0x55d8f39be760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:10:13.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.418+0000 7efc15af7640 1 --2- 172.21.15.92:0/3764385547 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8f39b15d0 0x55d8f39b1a10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efc0c0d3b80 tx=0x7efc0c0d8630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74cb1886b043ec12 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:13.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.418+0000 7efbfbfff640 1 -- 172.21.15.92:0/3764385547 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0c0e0020 con 0x55d8f39b15d0 2024-09-19T09:10:13.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.418+0000 7efbfbfff640 1 -- 172.21.15.92:0/3764385547 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc0c0dc960 con 0x55d8f39b15d0 2024-09-19T09:10:13.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.418+0000 7efbfbfff640 1 -- 172.21.15.92:0/3764385547 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0c0db7e0 con 0x55d8f39b15d0 2024-09-19T09:10:13.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.418+0000 7efc06ffd640 1 --2- 172.21.15.92:0/3662277419 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efbfc0a3340 0x7efbfc0a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:13.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.418+0000 7efc06ffd640 1 -- 172.21.15.92:0/3662277419 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7efc0c0cfc60 con 0x7efc10100100 2024-09-19T09:10:13.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.418+0000 7efc162f8640 1 --2- 172.21.15.92:0/3662277419 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efbfc0a3340 0x7efbfc0a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:13.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.419+0000 7efc1a134740 1 -- 172.21.15.92:0/3764385547 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8f39b15d0 msgr2=0x55d8f39b1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:13.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.419+0000 7efc1a134740 1 --2- 172.21.15.92:0/3764385547 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8f39b15d0 0x55d8f39b1a10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efc0c0d3b80 tx=0x7efc0c0d8630 comp rx=0 tx=0).stop 2024-09-19T09:10:13.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.419+0000 7efc162f8640 1 --2- 172.21.15.92:0/3662277419 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efbfc0a3340 0x7efbfc0a5800 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7efc08004af0 tx=0x7efc08005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:13.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.419+0000 7efc1a134740 1 -- 172.21.15.92:0/3764385547 shutdown_connections 2024-09-19T09:10:13.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.419+0000 7efc1a134740 1 --2- 172.21.15.92:0/3764385547 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8f39bc370 0x55d8f39be760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:13.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.419+0000 7efc1a134740 1 --2- 172.21.15.92:0/3764385547 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8f39b15d0 0x55d8f39b1a10 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:13.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.419+0000 7efc1a134740 1 --2- 172.21.15.92:0/3764385547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8f39b2b40 0x55d8f39b1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:13.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.419+0000 7efc1a134740 1 -- 172.21.15.92:0/3764385547 >> 172.21.15.92:0/3764385547 conn(0x55d8f397a310 msgr2=0x55d8f39adc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:13.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.419+0000 7efc1a134740 1 -- 172.21.15.92:0/3764385547 shutdown_connections 2024-09-19T09:10:13.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.420+0000 7efc1a134740 1 -- 172.21.15.92:0/3764385547 wait complete. 2024-09-19T09:10:13.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.420+0000 7efc1a134740 1 -- start start 2024-09-19T09:10:13.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.420+0000 7efc1a134740 1 Processor -- start 2024-09-19T09:10:13.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.421+0000 7efc1a134740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8f39b15d0 0x55d8f39bbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:13.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.421+0000 7efc1a134740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8f39b2b40 0x55d8f39b9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:13.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.421+0000 7efc1a134740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8f39bc370 0x55d8f39b9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:13.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.421+0000 7efc1a134740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d8f39bf070 con 0x55d8f39b2b40 2024-09-19T09:10:13.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.421+0000 7efc1a134740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d8f38d2060 con 0x55d8f39bc370 2024-09-19T09:10:13.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.421+0000 7efc1a134740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55d8f39bf1f0 con 0x55d8f39b15d0 2024-09-19T09:10:13.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.421+0000 7efc15af7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8f39b15d0 0x55d8f39bbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:13.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.421+0000 7efc15af7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8f39b15d0 0x55d8f39bbd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:57980/0 (socket says 172.21.15.92:57980) 2024-09-19T09:10:13.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.421+0000 7efc15af7640 1 -- 172.21.15.92:0/2233377689 learned_addr learned my addr 172.21.15.92:0/2233377689 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:13.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.421+0000 7efc152f6640 1 --2- 172.21.15.92:0/2233377689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8f39b2b40 0x55d8f39b9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:13.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.421+0000 7efc1a134740 10 client.0 _ll_register_callbacks cb 0x55d8f36258c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:10:13.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.421+0000 7efc15af7640 1 -- 172.21.15.92:0/2233377689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8f39bc370 msgr2=0x55d8f39b9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:13.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.421+0000 7efc15af7640 1 --2- 172.21.15.92:0/2233377689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8f39bc370 0x55d8f39b9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:13.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.421+0000 7efc15af7640 1 -- 172.21.15.92:0/2233377689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8f39b2b40 msgr2=0x55d8f39b9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:13.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.421+0000 7efc15af7640 1 --2- 172.21.15.92:0/2233377689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8f39b2b40 0x55d8f39b9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:13.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.421+0000 7efc15af7640 1 -- 172.21.15.92:0/2233377689 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8f36883c0 con 0x55d8f39b15d0 2024-09-19T09:10:13.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.421+0000 7efc1a134740 1 -- 172.21.15.92:0/2233377689 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc0c0dc960 con 0x55d8f39b15d0 2024-09-19T09:10:13.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.421+0000 7efc15af7640 1 --2- 172.21.15.92:0/2233377689 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8f39b15d0 0x55d8f39bbd80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7efc0c0986a0 tx=0x7efc0c0d38d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8a81eda68668bdb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:13.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.421+0000 7efbf97fa640 10 client.27688 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:10:13.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.422+0000 7efbf97fa640 1 -- 172.21.15.92:0/2233377689 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0c0e0030 con 0x55d8f39b15d0 2024-09-19T09:10:13.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.422+0000 7efbf97fa640 1 -- 172.21.15.92:0/2233377689 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7efc0c09a540 con 0x55d8f39b15d0 2024-09-19T09:10:13.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.422+0000 7efbf97fa640 1 -- 172.21.15.92:0/2233377689 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7efc0c0984e0 con 0x55d8f39b15d0 2024-09-19T09:10:13.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.422+0000 7efc1a134740 10 client.27688 fetch_fsmap learned FSMap version 19 2024-09-19T09:10:13.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.422+0000 7efc1a134740 1 -- 172.21.15.92:0/2233377689 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55d8f39bf070 con 0x55d8f39b15d0 2024-09-19T09:10:13.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.422+0000 7efbf97fa640 1 -- 172.21.15.92:0/2233377689 <== mon.1 v2:172.21.15.190:3300/0 4 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7efc0c0988b0 con 0x55d8f39b15d0 2024-09-19T09:10:13.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.422+0000 7efc1a134740 10 client.27688 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:10:13.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.422+0000 7efc1a134740 10 client.27688 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:10:13.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.422+0000 7efc1a134740 20 client.27688 populate_metadata read hostname 'smithi092' 2024-09-19T09:10:13.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.422+0000 7efc1a134740 1 --2- 172.21.15.92:0/2233377689 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d8f39cbae0 0x55d8f39cded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:13.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.422+0000 7efc1a134740 4 client.27688 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:10:13.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.422+0000 7efc1a134740 1 -- 172.21.15.92:0/2233377689 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8f3924860 con 0x55d8f39cbae0 2024-09-19T09:10:13.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.422+0000 7efc152f6640 1 --2- 172.21.15.92:0/2233377689 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d8f39cbae0 0x55d8f39cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:13.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.424+0000 7efc152f6640 1 --2- 172.21.15.92:0/2233377689 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d8f39cbae0 0x55d8f39cded0 crc :-1 s=READY pgs=404 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=120ab11a2fb7d3ac server_cookie=fa3cd13bf4aa0229 in_seq=0 out_seq=0 2024-09-19T09:10:13.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.424+0000 7efbf97fa640 10 client.27688 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:13.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.425+0000 7efbf97fa640 1 -- 172.21.15.92:0/2233377689 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d8f3924860 con 0x55d8f39cbae0 2024-09-19T09:10:13.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.425+0000 7efbf97fa640 10 client.27688 handle_command_reply: tid=0 2024-09-19T09:10:13.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.425+0000 7efc1a134740 1 client.27688 shutdown 2024-09-19T09:10:13.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.425+0000 7efc1a134740 1 -- 172.21.15.92:0/2233377689 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8f39b15d0 msgr2=0x55d8f39bbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:13.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.425+0000 7efc1a134740 1 --2- 172.21.15.92:0/2233377689 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8f39b15d0 0x55d8f39bbd80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7efc0c0986a0 tx=0x7efc0c0d38d0 comp rx=0 tx=0).stop 2024-09-19T09:10:13.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.426+0000 7efc1a134740 1 -- 172.21.15.92:0/2233377689 shutdown_connections 2024-09-19T09:10:13.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.426+0000 7efc1a134740 1 --2- 172.21.15.92:0/2233377689 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d8f39cbae0 0x55d8f39cded0 crc :-1 s=READY pgs=404 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:13.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.426+0000 7efc1a134740 1 --2- 172.21.15.92:0/2233377689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8f39bc370 0x55d8f39b9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:13.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.426+0000 7efbf97fa640 0 client.27688 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:13.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.426+0000 7efc1a134740 1 --2- 172.21.15.92:0/2233377689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8f39b2b40 0x55d8f39b9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:13.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.426+0000 7efc1a134740 1 --2- 172.21.15.92:0/2233377689 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8f39b15d0 0x55d8f39bbd80 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:13.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.426+0000 7efc1a134740 1 -- 172.21.15.92:0/2233377689 >> 172.21.15.92:0/2233377689 conn(0x55d8f397a310 msgr2=0x55d8f39b3960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:13.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.426+0000 7efc1a134740 1 -- 172.21.15.92:0/2233377689 shutdown_connections 2024-09-19T09:10:13.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.426+0000 7efc1a134740 1 -- 172.21.15.92:0/2233377689 wait complete. 2024-09-19T09:10:13.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.426+0000 7efc1a134740 20 client.27688 trim_cache size 0 max 16384 2024-09-19T09:10:13.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.446+0000 7efc1a134740 1 Processor -- start 2024-09-19T09:10:13.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.446+0000 7efc1a134740 1 -- start start 2024-09-19T09:10:13.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.447+0000 7efc1a134740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8f39b15d0 0x55d8f39c8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:13.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.447+0000 7efc1a134740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8f39b2b40 0x55d8f39d3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:13.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.447+0000 7efc1a134740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8f39bc370 0x55d8f39d3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:13.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.447+0000 7efc1a134740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efc101a9400 con 0x55d8f39b15d0 2024-09-19T09:10:13.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.447+0000 7efc1a134740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efc101abca0 con 0x55d8f39bc370 2024-09-19T09:10:13.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.447+0000 7efc1a134740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7efc101a9a90 con 0x55d8f39b2b40 2024-09-19T09:10:13.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.447+0000 7efc15af7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8f39b15d0 0x55d8f39c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:13.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.447+0000 7efc15af7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8f39b15d0 0x55d8f39c8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40584/0 (socket says 172.21.15.92:40584) 2024-09-19T09:10:13.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.447+0000 7efc15af7640 1 -- 172.21.15.92:0/861077301 learned_addr learned my addr 172.21.15.92:0/861077301 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:13.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.447+0000 7efc152f6640 1 --2- 172.21.15.92:0/861077301 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8f39b2b40 0x55d8f39d3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:13.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.447+0000 7efc162f8640 1 --2- 172.21.15.92:0/861077301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8f39bc370 0x55d8f39d3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:13.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.447+0000 7efc15af7640 1 -- 172.21.15.92:0/861077301 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8f39b2b40 msgr2=0x55d8f39d3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:13.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.447+0000 7efc15af7640 1 --2- 172.21.15.92:0/861077301 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8f39b2b40 0x55d8f39d3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:13.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.447+0000 7efc15af7640 1 -- 172.21.15.92:0/861077301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8f39bc370 msgr2=0x55d8f39d3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:13.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.447+0000 7efc15af7640 1 --2- 172.21.15.92:0/861077301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8f39bc370 0x55d8f39d3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:13.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.447+0000 7efc15af7640 1 -- 172.21.15.92:0/861077301 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8f39ae960 con 0x55d8f39b15d0 2024-09-19T09:10:13.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.447+0000 7efc162f8640 1 --2- 172.21.15.92:0/861077301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8f39bc370 0x55d8f39d3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:10:13.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.447+0000 7efc15af7640 1 --2- 172.21.15.92:0/861077301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8f39b15d0 0x55d8f39c8340 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7efc0c09bf40 tx=0x7efc0c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d54f6a0f4c61a77 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:13.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.448+0000 7efbfb7fe640 1 -- 172.21.15.92:0/861077301 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0c0e0030 con 0x55d8f39b15d0 2024-09-19T09:10:13.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.448+0000 7efbfb7fe640 1 -- 172.21.15.92:0/861077301 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc0c0dc960 con 0x55d8f39b15d0 2024-09-19T09:10:13.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.448+0000 7efbfb7fe640 1 -- 172.21.15.92:0/861077301 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0c09bba0 con 0x55d8f39b15d0 2024-09-19T09:10:13.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.449+0000 7efc1a134740 1 -- 172.21.15.92:0/861077301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8f39b15d0 msgr2=0x55d8f39c8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:13.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.449+0000 7efc1a134740 1 --2- 172.21.15.92:0/861077301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8f39b15d0 0x55d8f39c8340 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7efc0c09bf40 tx=0x7efc0c019000 comp rx=0 tx=0).stop 2024-09-19T09:10:13.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.449+0000 7efc1a134740 1 -- 172.21.15.92:0/861077301 shutdown_connections 2024-09-19T09:10:13.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.449+0000 7efc1a134740 1 --2- 172.21.15.92:0/861077301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8f39bc370 0x55d8f39d3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:13.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.449+0000 7efc1a134740 1 --2- 172.21.15.92:0/861077301 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8f39b2b40 0x55d8f39d3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:13.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.449+0000 7efc1a134740 1 --2- 172.21.15.92:0/861077301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8f39b15d0 0x55d8f39c8340 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:13.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.449+0000 7efc1a134740 1 -- 172.21.15.92:0/861077301 >> 172.21.15.92:0/861077301 conn(0x55d8f397a310 msgr2=0x55d8f39acd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:13.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.449+0000 7efc1a134740 1 -- 172.21.15.92:0/861077301 shutdown_connections 2024-09-19T09:10:13.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.449+0000 7efc1a134740 1 -- 172.21.15.92:0/861077301 wait complete. 2024-09-19T09:10:13.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.449+0000 7efc1a134740 1 -- start start 2024-09-19T09:10:13.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.449+0000 7efc1a134740 1 Processor -- start 2024-09-19T09:10:13.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.450+0000 7efc1a134740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8f39b15d0 0x55d8f39c4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:13.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.450+0000 7efc1a134740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8f39b2b40 0x55d8f39b5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:13.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.450+0000 7efc1a134740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8f39bc370 0x55d8f39b6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:13.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.450+0000 7efc1a134740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efc101aa160 con 0x55d8f39bc370 2024-09-19T09:10:13.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.450+0000 7efc1a134740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efc101ab5d0 con 0x55d8f39b2b40 2024-09-19T09:10:13.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.450+0000 7efc1a134740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7efc101aa830 con 0x55d8f39b15d0 2024-09-19T09:10:13.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.450+0000 7efc162f8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8f39bc370 0x55d8f39b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:13.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.450+0000 7efc1a134740 10 client.0 _ll_register_callbacks cb 0x7efc0c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:10:13.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.450+0000 7efc15af7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8f39b15d0 0x55d8f39c4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:13.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.450+0000 7efc15af7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8f39b15d0 0x55d8f39c4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:57996/0 (socket says 172.21.15.92:57996) 2024-09-19T09:10:13.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.450+0000 7efc15af7640 1 -- 172.21.15.92:0/311977978 learned_addr learned my addr 172.21.15.92:0/311977978 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:13.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.450+0000 7efc152f6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8f39b2b40 0x55d8f39b5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:13.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.450+0000 7efc15af7640 1 -- 172.21.15.92:0/311977978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8f39b2b40 msgr2=0x55d8f39b5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:13.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.450+0000 7efc15af7640 1 --2- 172.21.15.92:0/311977978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8f39b2b40 0x55d8f39b5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:13.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.450+0000 7efc15af7640 1 -- 172.21.15.92:0/311977978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8f39bc370 msgr2=0x55d8f39b6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:13.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.450+0000 7efc15af7640 1 --2- 172.21.15.92:0/311977978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8f39bc370 0x55d8f39b6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:13.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.450+0000 7efc15af7640 1 -- 172.21.15.92:0/311977978 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8f39b6680 con 0x55d8f39b15d0 2024-09-19T09:10:13.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.451+0000 7efc15af7640 1 --2- 172.21.15.92:0/311977978 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8f39b15d0 0x55d8f39c4a00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7efc0c0d30c0 tx=0x7efc0c09a750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acb6c858f55e3314 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:13.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.451+0000 7efbf97fa640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:10:13.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.451+0000 7efbf97fa640 1 -- 172.21.15.92:0/311977978 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0c0e0070 con 0x55d8f39b15d0 2024-09-19T09:10:13.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.451+0000 7efbf97fa640 1 -- 172.21.15.92:0/311977978 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7efc0c0cdde0 con 0x55d8f39b15d0 2024-09-19T09:10:13.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.452+0000 7efc1a134740 1 -- 172.21.15.92:0/311977978 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc0c0dc960 con 0x55d8f39b15d0 2024-09-19T09:10:13.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.452+0000 7efbf97fa640 1 -- 172.21.15.92:0/311977978 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7efc0c09bd80 con 0x55d8f39b15d0 2024-09-19T09:10:13.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.452+0000 7efc1a134740 10 client.27694 fetch_fsmap learned FSMap version 19 2024-09-19T09:10:13.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.452+0000 7efc1a134740 1 -- 172.21.15.92:0/311977978 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55d8f39b6680 con 0x55d8f39b15d0 2024-09-19T09:10:13.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.452+0000 7efbf97fa640 1 -- 172.21.15.92:0/311977978 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc0c0dc960 con 0x55d8f39b15d0 2024-09-19T09:10:13.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.453+0000 7efbf97fa640 1 -- 172.21.15.92:0/311977978 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7efc0c0a4a20 con 0x55d8f39b15d0 2024-09-19T09:10:13.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.453+0000 7efc1a134740 10 client.27694 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:10:13.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.453+0000 7efc1a134740 10 client.27694 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:10:13.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.453+0000 7efc1a134740 20 client.27694 populate_metadata read hostname 'smithi092' 2024-09-19T09:10:13.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.453+0000 7efc1a134740 1 --2- 172.21.15.92:0/311977978 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d8f39cbae0 0x55d8f3a385f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:13.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.453+0000 7efc1a134740 4 client.27694 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:10:13.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.453+0000 7efc1a134740 1 -- 172.21.15.92:0/311977978 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d8f391ed70 con 0x55d8f39cbae0 2024-09-19T09:10:13.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.453+0000 7efc152f6640 1 --2- 172.21.15.92:0/311977978 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d8f39cbae0 0x55d8f3a385f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:13.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.454+0000 7efc152f6640 1 --2- 172.21.15.92:0/311977978 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d8f39cbae0 0x55d8f3a385f0 crc :-1 s=READY pgs=405 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bd3bc86a4ae54c server_cookie=1d0c9454558a7d60 in_seq=0 out_seq=0 2024-09-19T09:10:13.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.454+0000 7efbf97fa640 10 client.27694 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:13.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.454+0000 7efbf97fa640 1 -- 172.21.15.92:0/311977978 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d8f391ed70 con 0x55d8f39cbae0 2024-09-19T09:10:13.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.454+0000 7efbf97fa640 10 client.27694 handle_command_reply: tid=0 2024-09-19T09:10:13.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.454+0000 7efc1a134740 1 client.27694 shutdown 2024-09-19T09:10:13.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.455+0000 7efc1a134740 1 -- 172.21.15.92:0/311977978 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8f39b15d0 msgr2=0x55d8f39c4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:13.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.455+0000 7efc1a134740 1 --2- 172.21.15.92:0/311977978 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8f39b15d0 0x55d8f39c4a00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7efc0c0d30c0 tx=0x7efc0c09a750 comp rx=0 tx=0).stop 2024-09-19T09:10:13.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.459+0000 7efc1a134740 1 -- 172.21.15.92:0/311977978 shutdown_connections 2024-09-19T09:10:13.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.459+0000 7efc1a134740 1 --2- 172.21.15.92:0/311977978 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d8f39cbae0 0x55d8f3a385f0 crc :-1 s=READY pgs=405 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:13.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.459+0000 7efc1a134740 1 --2- 172.21.15.92:0/311977978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8f39bc370 0x55d8f39b6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:13.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.459+0000 7efc1a134740 1 --2- 172.21.15.92:0/311977978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8f39b2b40 0x55d8f39b5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:13.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.459+0000 7efc1a134740 1 --2- 172.21.15.92:0/311977978 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8f39b15d0 0x55d8f39c4a00 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:13.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.459+0000 7efbf97fa640 0 client.27694 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:13.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.459+0000 7efc1a134740 1 -- 172.21.15.92:0/311977978 >> 172.21.15.92:0/311977978 conn(0x55d8f397a310 msgr2=0x55d8f39b77d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:13.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.459+0000 7efc1a134740 1 -- 172.21.15.92:0/311977978 shutdown_connections 2024-09-19T09:10:13.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.461+0000 7efc1a134740 1 -- 172.21.15.92:0/311977978 wait complete. 2024-09-19T09:10:13.466 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-19T09:10:13.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.465+0000 7efc1a134740 20 client.27694 trim_cache size 0 max 16384 2024-09-19T09:10:13.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.467+0000 7efc17d5b640 1 -- 172.21.15.92:0/3662277419 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efbfc0a3340 msgr2=0x7efbfc0a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:13.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.467+0000 7efc17d5b640 1 --2- 172.21.15.92:0/3662277419 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efbfc0a3340 0x7efbfc0a5800 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7efc08004af0 tx=0x7efc08005d80 comp rx=0 tx=0).stop 2024-09-19T09:10:13.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.467+0000 7efc17d5b640 1 -- 172.21.15.92:0/3662277419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc10100100 msgr2=0x7efc10198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:13.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.467+0000 7efc17d5b640 1 --2- 172.21.15.92:0/3662277419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc10100100 0x7efc10198490 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7efc0c00e9f0 tx=0x7efc0c00eeb0 comp rx=0 tx=0).stop 2024-09-19T09:10:13.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.467+0000 7efc17d5b640 1 -- 172.21.15.92:0/3662277419 shutdown_connections 2024-09-19T09:10:13.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.467+0000 7efc17d5b640 1 --2- 172.21.15.92:0/3662277419 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc10106b80 0x7efc1019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:13.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.467+0000 7efc17d5b640 1 --2- 172.21.15.92:0/3662277419 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7efbfc0a3340 0x7efbfc0a5800 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:13.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.467+0000 7efc17d5b640 1 --2- 172.21.15.92:0/3662277419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc10100aa0 0x7efc101989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:13.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.467+0000 7efc17d5b640 1 --2- 172.21.15.92:0/3662277419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc10100100 0x7efc10198490 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:13.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.467+0000 7efc17d5b640 1 -- 172.21.15.92:0/3662277419 >> 172.21.15.92:0/3662277419 conn(0x7efc10077230 msgr2=0x7efc100fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:13.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.468+0000 7efc17d5b640 1 -- 172.21.15.92:0/3662277419 shutdown_connections 2024-09-19T09:10:13.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:13.472+0000 7efc17d5b640 1 -- 172.21.15.92:0/3662277419 wait complete. 2024-09-19T09:10:15.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:14 smithi092 ceph-mon[31407]: pgmap v743: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 21 MiB/s wr, 767 op/s 2024-09-19T09:10:15.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:14 smithi167 ceph-mon[35359]: pgmap v743: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 21 MiB/s wr, 767 op/s 2024-09-19T09:10:15.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:14 smithi190 ceph-mon[35358]: pgmap v743: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 21 MiB/s wr, 767 op/s 2024-09-19T09:10:15.329 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:10:15.329 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:10:15.731 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:10:15.798 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 810.0 s, 2027.0 tps, lat 49.507 ms stddev 55.659 2024-09-19T09:10:16.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.268+0000 7fba069d9640 1 -- 172.21.15.92:0/1705427278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba0010c180 msgr2=0x7fba0010e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:16.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.268+0000 7fba069d9640 1 --2- 172.21.15.92:0/1705427278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba0010c180 0x7fba0010e620 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8009ca0 tx=0x7fb9f802a950 comp rx=0 tx=0).stop 2024-09-19T09:10:16.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.268+0000 7fba069d9640 1 -- 172.21.15.92:0/1705427278 shutdown_connections 2024-09-19T09:10:16.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.268+0000 7fba069d9640 1 --2- 172.21.15.92:0/1705427278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba0010c180 0x7fba0010e620 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.268+0000 7fba069d9640 1 --2- 172.21.15.92:0/1705427278 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba00103670 0x7fba0010bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.268+0000 7fba069d9640 1 --2- 172.21.15.92:0/1705427278 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba00102d50 0x7fba00103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.268+0000 7fba069d9640 1 -- 172.21.15.92:0/1705427278 >> 172.21.15.92:0/1705427278 conn(0x7fba000fc7d0 msgr2=0x7fba000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:16.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.268+0000 7fba069d9640 1 -- 172.21.15.92:0/1705427278 shutdown_connections 2024-09-19T09:10:16.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.268+0000 7fba069d9640 1 -- 172.21.15.92:0/1705427278 wait complete. 2024-09-19T09:10:16.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.268+0000 7fba069d9640 1 Processor -- start 2024-09-19T09:10:16.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.268+0000 7fba069d9640 1 -- start start 2024-09-19T09:10:16.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.269+0000 7fba069d9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba00102d50 0x7fba00198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:16.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.269+0000 7fba069d9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba00103670 0x7fba00198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:16.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.269+0000 7fba069d9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba0010c180 0x7fba0019ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:16.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.269+0000 7fb9f7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba00103670 0x7fba00198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:16.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.270+0000 7fb9f7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba00103670 0x7fba00198aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:51904/0 (socket says 172.21.15.92:51904) 2024-09-19T09:10:16.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.270+0000 7fb9f7fff640 1 -- 172.21.15.92:0/2925254685 learned_addr learned my addr 172.21.15.92:0/2925254685 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:16.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.270+0000 7fba069d9640 1 -- 172.21.15.92:0/2925254685 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fba00112040 con 0x7fba0010c180 2024-09-19T09:10:16.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.270+0000 7fba069d9640 1 -- 172.21.15.92:0/2925254685 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fba00111ec0 con 0x7fba00103670 2024-09-19T09:10:16.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.270+0000 7fba069d9640 1 -- 172.21.15.92:0/2925254685 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fba001121c0 con 0x7fba00102d50 2024-09-19T09:10:16.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.270+0000 7fba04f76640 1 --2- 172.21.15.92:0/2925254685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba0010c180 0x7fba0019ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:16.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.270+0000 7fb9fffff640 1 --2- 172.21.15.92:0/2925254685 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba00102d50 0x7fba00198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:16.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.270+0000 7fba04f76640 1 -- 172.21.15.92:0/2925254685 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba00102d50 msgr2=0x7fba00198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:16.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.270+0000 7fba04f76640 1 --2- 172.21.15.92:0/2925254685 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba00102d50 0x7fba00198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.270+0000 7fba04f76640 1 -- 172.21.15.92:0/2925254685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba00103670 msgr2=0x7fba00198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:16.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.270+0000 7fba04f76640 1 --2- 172.21.15.92:0/2925254685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba00103670 0x7fba00198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.270+0000 7fba04f76640 1 -- 172.21.15.92:0/2925254685 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba0019d510 con 0x7fba0010c180 2024-09-19T09:10:16.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.271+0000 7fba04f76640 1 --2- 172.21.15.92:0/2925254685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba0010c180 0x7fba0019ce30 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8005cc0 tx=0x7fb9f802f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:16.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.271+0000 7fb9fdffb640 1 -- 172.21.15.92:0/2925254685 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8034040 con 0x7fba0010c180 2024-09-19T09:10:16.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.271+0000 7fb9fdffb640 1 -- 172.21.15.92:0/2925254685 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9f8030920 con 0x7fba0010c180 2024-09-19T09:10:16.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.271+0000 7fba069d9640 1 -- 172.21.15.92:0/2925254685 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba0019d7a0 con 0x7fba0010c180 2024-09-19T09:10:16.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.272+0000 7fb9fdffb640 1 -- 172.21.15.92:0/2925254685 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8004860 con 0x7fba0010c180 2024-09-19T09:10:16.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.272+0000 7fba069d9640 1 -- 172.21.15.92:0/2925254685 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba0019dbc0 con 0x7fba0010c180 2024-09-19T09:10:16.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.275+0000 7fba08db2740 1 Processor -- start 2024-09-19T09:10:16.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.275+0000 7fb9fdffb640 1 -- 172.21.15.92:0/2925254685 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb9f8037020 con 0x7fba0010c180 2024-09-19T09:10:16.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.275+0000 7fba08db2740 1 -- start start 2024-09-19T09:10:16.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.276+0000 7fba08db2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d842d6b60 0x560d842d6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:16.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.276+0000 7fba08db2740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d842d7480 0x560d842e1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:16.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.276+0000 7fba08db2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d842e1d40 0x560d842e4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:16.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.276+0000 7fba08db2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560d8423c280 con 0x560d842d6b60 2024-09-19T09:10:16.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.276+0000 7fba08db2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560d841e3b10 con 0x560d842e1d40 2024-09-19T09:10:16.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.276+0000 7fba08db2740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x560d84238240 con 0x560d842d7480 2024-09-19T09:10:16.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.276+0000 7fb9fffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d842d7480 0x560d842e1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:16.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.276+0000 7fb9f7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d842d6b60 0x560d842d6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:16.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.276+0000 7fb9f7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d842d6b60 0x560d842d6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40616/0 (socket says 172.21.15.92:40616) 2024-09-19T09:10:16.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.276+0000 7fb9f7fff640 1 -- 172.21.15.92:0/1850206373 learned_addr learned my addr 172.21.15.92:0/1850206373 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:16.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.276+0000 7fb9fffff640 1 --2- 172.21.15.92:0/1850206373 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d842d7480 0x560d842e1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:58016/0 (socket says 172.21.15.92:58016) 2024-09-19T09:10:16.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.276+0000 7fb9f7fff640 1 -- 172.21.15.92:0/1850206373 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d842d7480 msgr2=0x560d842e1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:16.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.276+0000 7fb9f7fff640 1 --2- 172.21.15.92:0/1850206373 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d842d7480 0x560d842e1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.276+0000 7fb9f7fff640 1 -- 172.21.15.92:0/1850206373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d842e1d40 msgr2=0x560d842e4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:16.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.276+0000 7fb9f7fff640 1 --2- 172.21.15.92:0/1850206373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d842e1d40 0x560d842e4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.276+0000 7fb9f7fff640 1 -- 172.21.15.92:0/1850206373 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d841f01f0 con 0x560d842d6b60 2024-09-19T09:10:16.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.276+0000 7fb9fdffb640 1 --2- 172.21.15.92:0/2925254685 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb9ec0a3390 0x7fb9ec0a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:16.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.277+0000 7fb9fffff640 1 --2- 172.21.15.92:0/2925254685 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb9ec0a3390 0x7fb9ec0a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:16.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.277+0000 7fb9f7fff640 1 --2- 172.21.15.92:0/1850206373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d842d6b60 0x560d842d6f40 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8006aa0 tx=0x7fb9e80105c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba01053549f8adf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:16.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.277+0000 7fb9fdffb640 1 -- 172.21.15.92:0/2925254685 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb9f80f08c0 con 0x7fba0010c180 2024-09-19T09:10:16.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.277+0000 7fb9f67fc640 1 -- 172.21.15.92:0/1850206373 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e8018020 con 0x560d842d6b60 2024-09-19T09:10:16.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.277+0000 7fb9f67fc640 1 -- 172.21.15.92:0/1850206373 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9e8009e40 con 0x560d842d6b60 2024-09-19T09:10:16.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.277+0000 7fb9f67fc640 1 -- 172.21.15.92:0/1850206373 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e8013820 con 0x560d842d6b60 2024-09-19T09:10:16.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.278+0000 7fba08db2740 1 -- 172.21.15.92:0/1850206373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d842d6b60 msgr2=0x560d842d6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:16.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.278+0000 7fb9fffff640 1 --2- 172.21.15.92:0/2925254685 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb9ec0a3390 0x7fb9ec0a5850 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x560d842d3f50 tx=0x7fb9f0009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:16.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.278+0000 7fba08db2740 1 --2- 172.21.15.92:0/1850206373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d842d6b60 0x560d842d6f40 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8006aa0 tx=0x7fb9e80105c0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.278+0000 7fba08db2740 1 -- 172.21.15.92:0/1850206373 shutdown_connections 2024-09-19T09:10:16.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.278+0000 7fba08db2740 1 --2- 172.21.15.92:0/1850206373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d842e1d40 0x560d842e4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.278+0000 7fba08db2740 1 --2- 172.21.15.92:0/1850206373 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d842d7480 0x560d842e1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.278+0000 7fba08db2740 1 --2- 172.21.15.92:0/1850206373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d842d6b60 0x560d842d6f40 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.278+0000 7fba08db2740 1 -- 172.21.15.92:0/1850206373 >> 172.21.15.92:0/1850206373 conn(0x560d842d30f0 msgr2=0x560d842d34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:16.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.278+0000 7fba08db2740 1 -- 172.21.15.92:0/1850206373 shutdown_connections 2024-09-19T09:10:16.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.278+0000 7fba08db2740 1 -- 172.21.15.92:0/1850206373 wait complete. 2024-09-19T09:10:16.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.278+0000 7fba08db2740 1 -- start start 2024-09-19T09:10:16.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.279+0000 7fba08db2740 1 Processor -- start 2024-09-19T09:10:16.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.279+0000 7fba08db2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d842d6b60 0x560d842dec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:16.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.279+0000 7fba08db2740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d842d7480 0x560d842df160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:16.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.279+0000 7fba08db2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d842e1d40 0x560d842df6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:16.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.279+0000 7fba08db2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560d842e8d20 con 0x560d842d6b60 2024-09-19T09:10:16.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.279+0000 7fba08db2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560d841f6f10 con 0x560d842e1d40 2024-09-19T09:10:16.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.279+0000 7fba08db2740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x560d842e8ea0 con 0x560d842d7480 2024-09-19T09:10:16.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.279+0000 7fba08db2740 10 client.0 _ll_register_callbacks cb 0x560d841bfa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:10:16.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.279+0000 7fb9f7fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d842d7480 0x560d842df160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:16.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.279+0000 7fba04f76640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d842e1d40 0x560d842df6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:16.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.279+0000 7fb9f7fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d842d7480 0x560d842df160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:58032/0 (socket says 172.21.15.92:58032) 2024-09-19T09:10:16.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.279+0000 7fb9f7fff640 1 -- 172.21.15.92:0/2285646074 learned_addr learned my addr 172.21.15.92:0/2285646074 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:16.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.280+0000 7fb9fffff640 1 --2- 172.21.15.92:0/2285646074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d842d6b60 0x560d842dec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:16.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.280+0000 7fb9f7fff640 1 -- 172.21.15.92:0/2285646074 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d842e1d40 msgr2=0x560d842df6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:16.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.280+0000 7fb9f7fff640 1 --2- 172.21.15.92:0/2285646074 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d842e1d40 0x560d842df6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.280+0000 7fb9f7fff640 1 -- 172.21.15.92:0/2285646074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d842d6b60 msgr2=0x560d842dec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:16.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.280+0000 7fb9f7fff640 1 --2- 172.21.15.92:0/2285646074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d842d6b60 0x560d842dec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.280+0000 7fb9f7fff640 1 -- 172.21.15.92:0/2285646074 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d83fad6a0 con 0x560d842d7480 2024-09-19T09:10:16.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.280+0000 7fba04f76640 1 --2- 172.21.15.92:0/2285646074 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d842e1d40 0x560d842df6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:10:16.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.280+0000 7fb9fffff640 1 --2- 172.21.15.92:0/2285646074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d842d6b60 0x560d842dec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:10:16.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.280+0000 7fb9f7fff640 1 --2- 172.21.15.92:0/2285646074 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d842d7480 0x560d842df160 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb9e80133e0 tx=0x7fb9e8014b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41523b0775faee9f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:16.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.280+0000 7fb9df7fe640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:10:16.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.280+0000 7fb9df7fe640 1 -- 172.21.15.92:0/2285646074 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e8013730 con 0x560d842d7480 2024-09-19T09:10:16.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.280+0000 7fb9df7fe640 1 -- 172.21.15.92:0/2285646074 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb9e80138d0 con 0x560d842d7480 2024-09-19T09:10:16.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.280+0000 7fba08db2740 1 -- 172.21.15.92:0/2285646074 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9e8009e40 con 0x560d842d7480 2024-09-19T09:10:16.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.280+0000 7fb9df7fe640 1 -- 172.21.15.92:0/2285646074 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb9e8013ad0 con 0x560d842d7480 2024-09-19T09:10:16.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.280+0000 7fba08db2740 10 client.27703 fetch_fsmap learned FSMap version 19 2024-09-19T09:10:16.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.280+0000 7fba08db2740 1 -- 172.21.15.92:0/2285646074 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x560d842f4920 con 0x560d842d7480 2024-09-19T09:10:16.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.280+0000 7fb9df7fe640 1 -- 172.21.15.92:0/2285646074 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9e8009e40 con 0x560d842d7480 2024-09-19T09:10:16.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.281+0000 7fb9df7fe640 1 -- 172.21.15.92:0/2285646074 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fb9e8025020 con 0x560d842d7480 2024-09-19T09:10:16.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.281+0000 7fba08db2740 10 client.27703 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:10:16.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.281+0000 7fba08db2740 10 client.27703 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:10:16.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.281+0000 7fba08db2740 20 client.27703 populate_metadata read hostname 'smithi092' 2024-09-19T09:10:16.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.281+0000 7fba08db2740 1 --2- 172.21.15.92:0/2285646074 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x560d842f5c70 0x560d842f8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:16.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.281+0000 7fba08db2740 4 client.27703 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:10:16.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.281+0000 7fba08db2740 1 -- 172.21.15.92:0/2285646074 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d842497f0 con 0x560d842f5c70 2024-09-19T09:10:16.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.281+0000 7fb9fffff640 1 --2- 172.21.15.92:0/2285646074 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x560d842f5c70 0x560d842f8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:16.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.282+0000 7fb9df7fe640 10 client.27703 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:16.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.282+0000 7fb9fffff640 1 --2- 172.21.15.92:0/2285646074 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x560d842f5c70 0x560d842f8060 crc :-1 s=READY pgs=406 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad951ef07bf2c243 server_cookie=1208f6824cbc5d60 in_seq=0 out_seq=0 2024-09-19T09:10:16.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.282+0000 7fb9df7fe640 1 -- 172.21.15.92:0/2285646074 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560d842497f0 con 0x560d842f5c70 2024-09-19T09:10:16.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.282+0000 7fb9df7fe640 10 client.27703 handle_command_reply: tid=0 2024-09-19T09:10:16.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.283+0000 7fba08db2740 1 client.27703 shutdown 2024-09-19T09:10:16.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.283+0000 7fba08db2740 1 -- 172.21.15.92:0/2285646074 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d842d7480 msgr2=0x560d842df160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:16.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.283+0000 7fba08db2740 1 --2- 172.21.15.92:0/2285646074 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d842d7480 0x560d842df160 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb9e80133e0 tx=0x7fb9e8014b00 comp rx=0 tx=0).stop 2024-09-19T09:10:16.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.283+0000 7fba08db2740 1 -- 172.21.15.92:0/2285646074 shutdown_connections 2024-09-19T09:10:16.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.283+0000 7fba08db2740 1 --2- 172.21.15.92:0/2285646074 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x560d842f5c70 0x560d842f8060 crc :-1 s=READY pgs=406 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.283+0000 7fba08db2740 1 --2- 172.21.15.92:0/2285646074 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d842e1d40 0x560d842df6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.283+0000 7fba08db2740 1 --2- 172.21.15.92:0/2285646074 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d842d7480 0x560d842df160 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.283+0000 7fba08db2740 1 --2- 172.21.15.92:0/2285646074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d842d6b60 0x560d842dec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.283+0000 7fba08db2740 1 -- 172.21.15.92:0/2285646074 >> 172.21.15.92:0/2285646074 conn(0x560d842d30f0 msgr2=0x560d842d8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:16.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.284+0000 7fb9df7fe640 0 client.27703 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:16.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.284+0000 7fba08db2740 1 -- 172.21.15.92:0/2285646074 shutdown_connections 2024-09-19T09:10:16.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.284+0000 7fba08db2740 1 -- 172.21.15.92:0/2285646074 wait complete. 2024-09-19T09:10:16.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.285+0000 7fba08db2740 20 client.27703 trim_cache size 0 max 16384 2024-09-19T09:10:16.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.308+0000 7fba08db2740 1 Processor -- start 2024-09-19T09:10:16.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.309+0000 7fba08db2740 1 -- start start 2024-09-19T09:10:16.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.309+0000 7fba08db2740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d842d6b60 0x560d842d95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:16.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.309+0000 7fba08db2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d842d7480 0x560d842e0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:16.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.309+0000 7fba08db2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d842e1d40 0x560d842fd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:16.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.309+0000 7fba08db2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fba001a9330 con 0x560d842e1d40 2024-09-19T09:10:16.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.309+0000 7fba04f76640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d842e1d40 0x560d842fd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:16.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.309+0000 7fba04f76640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d842e1d40 0x560d842fd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40638/0 (socket says 172.21.15.92:40638) 2024-09-19T09:10:16.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.309+0000 7fba04f76640 1 -- 172.21.15.92:0/3559179515 learned_addr learned my addr 172.21.15.92:0/3559179515 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:16.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.309+0000 7fba08db2740 1 -- 172.21.15.92:0/3559179515 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fba001abbd0 con 0x560d842d7480 2024-09-19T09:10:16.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.309+0000 7fba08db2740 1 -- 172.21.15.92:0/3559179515 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fba001a99c0 con 0x560d842d6b60 2024-09-19T09:10:16.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.310+0000 7fb9f7fff640 1 --2- 172.21.15.92:0/3559179515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d842d7480 0x560d842e0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:16.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.310+0000 7fba04f76640 1 -- 172.21.15.92:0/3559179515 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d842d6b60 msgr2=0x560d842d95c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:10:16.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.310+0000 7fba04f76640 1 --2- 172.21.15.92:0/3559179515 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d842d6b60 0x560d842d95c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.310+0000 7fba04f76640 1 -- 172.21.15.92:0/3559179515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d842d7480 msgr2=0x560d842e0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:16.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.310+0000 7fba04f76640 1 --2- 172.21.15.92:0/3559179515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d842d7480 0x560d842e0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.310+0000 7fba04f76640 1 -- 172.21.15.92:0/3559179515 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d842ce830 con 0x560d842e1d40 2024-09-19T09:10:16.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.310+0000 7fba04f76640 1 --2- 172.21.15.92:0/3559179515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d842e1d40 0x560d842fd6f0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8030040 tx=0x7fb9f8004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b25bba1b7ec2a297 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:16.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.311+0000 7fb9f5ffb640 1 -- 172.21.15.92:0/3559179515 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f80bcee0 con 0x560d842e1d40 2024-09-19T09:10:16.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.311+0000 7fb9f5ffb640 1 -- 172.21.15.92:0/3559179515 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9f80c1290 con 0x560d842e1d40 2024-09-19T09:10:16.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.311+0000 7fb9f5ffb640 1 -- 172.21.15.92:0/3559179515 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f80bd3a0 con 0x560d842e1d40 2024-09-19T09:10:16.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.312+0000 7fba08db2740 1 -- 172.21.15.92:0/3559179515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d842e1d40 msgr2=0x560d842fd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:16.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.312+0000 7fba08db2740 1 --2- 172.21.15.92:0/3559179515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d842e1d40 0x560d842fd6f0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8030040 tx=0x7fb9f8004300 comp rx=0 tx=0).stop 2024-09-19T09:10:16.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.312+0000 7fba08db2740 1 -- 172.21.15.92:0/3559179515 shutdown_connections 2024-09-19T09:10:16.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.312+0000 7fba08db2740 1 --2- 172.21.15.92:0/3559179515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d842e1d40 0x560d842fd6f0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.312+0000 7fba08db2740 1 --2- 172.21.15.92:0/3559179515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d842d7480 0x560d842e0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.312+0000 7fba08db2740 1 --2- 172.21.15.92:0/3559179515 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d842d6b60 0x560d842d95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.312+0000 7fba08db2740 1 -- 172.21.15.92:0/3559179515 >> 172.21.15.92:0/3559179515 conn(0x560d842d30f0 msgr2=0x560d842e0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:16.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.313+0000 7fba08db2740 1 -- 172.21.15.92:0/3559179515 shutdown_connections 2024-09-19T09:10:16.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.313+0000 7fba08db2740 1 -- 172.21.15.92:0/3559179515 wait complete. 2024-09-19T09:10:16.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.313+0000 7fba08db2740 1 -- start start 2024-09-19T09:10:16.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.314+0000 7fba08db2740 1 Processor -- start 2024-09-19T09:10:16.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.314+0000 7fba08db2740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d842d6b60 0x560d842e8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:16.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.314+0000 7fba08db2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d842d7480 0x560d842ee0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:16.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.314+0000 7fba08db2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d842e1d40 0x560d842ee630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:16.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.314+0000 7fba08db2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fba001aa090 con 0x560d842e1d40 2024-09-19T09:10:16.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.314+0000 7fba08db2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fba001ab500 con 0x560d842d7480 2024-09-19T09:10:16.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.314+0000 7fba08db2740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fba001aa760 con 0x560d842d6b60 2024-09-19T09:10:16.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.314+0000 7fba08db2740 10 client.0 _ll_register_callbacks cb 0x7fb9f00093c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:10:16.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.315+0000 7fba04f76640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d842e1d40 0x560d842ee630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:16.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.315+0000 7fba04f76640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d842e1d40 0x560d842ee630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40652/0 (socket says 172.21.15.92:40652) 2024-09-19T09:10:16.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.315+0000 7fba04f76640 1 -- 172.21.15.92:0/341698610 learned_addr learned my addr 172.21.15.92:0/341698610 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:16.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.315+0000 7fba04f76640 1 -- 172.21.15.92:0/341698610 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d842d6b60 msgr2=0x560d842e8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:16.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.315+0000 7fba04f76640 1 --2- 172.21.15.92:0/341698610 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d842d6b60 0x560d842e8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.315+0000 7fba04f76640 1 -- 172.21.15.92:0/341698610 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d842d7480 msgr2=0x560d842ee0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:10:16.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.315+0000 7fba04f76640 1 --2- 172.21.15.92:0/341698610 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d842d7480 0x560d842ee0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.315+0000 7fba04f76640 1 -- 172.21.15.92:0/341698610 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d842e5730 con 0x560d842e1d40 2024-09-19T09:10:16.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.316+0000 7fba04f76640 1 --2- 172.21.15.92:0/341698610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d842e1d40 0x560d842ee630 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fb9f80c5620 tx=0x7fb9f80dd0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f2d979657cb7f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:16.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.316+0000 7fb9df7fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:10:16.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.316+0000 7fb9df7fe640 1 -- 172.21.15.92:0/341698610 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f80ca060 con 0x560d842e1d40 2024-09-19T09:10:16.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.316+0000 7fb9df7fe640 1 -- 172.21.15.92:0/341698610 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb9f80c56c0 con 0x560d842e1d40 2024-09-19T09:10:16.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.317+0000 7fba08db2740 1 -- 172.21.15.92:0/341698610 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9f80c1290 con 0x560d842e1d40 2024-09-19T09:10:16.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.317+0000 7fb9df7fe640 1 -- 172.21.15.92:0/341698610 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb9f80b96c0 con 0x560d842e1d40 2024-09-19T09:10:16.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.317+0000 7fba08db2740 10 client.18588 fetch_fsmap learned FSMap version 19 2024-09-19T09:10:16.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.317+0000 7fba08db2740 1 -- 172.21.15.92:0/341698610 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x560d84358880 con 0x560d842e1d40 2024-09-19T09:10:16.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.318+0000 7fb9df7fe640 1 -- 172.21.15.92:0/341698610 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9f80c1290 con 0x560d842e1d40 2024-09-19T09:10:16.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.318+0000 7fb9df7fe640 1 -- 172.21.15.92:0/341698610 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fb9f80bc330 con 0x560d842e1d40 2024-09-19T09:10:16.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.318+0000 7fba08db2740 10 client.18588 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:10:16.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.318+0000 7fba08db2740 10 client.18588 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:10:16.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.318+0000 7fba08db2740 20 client.18588 populate_metadata read hostname 'smithi092' 2024-09-19T09:10:16.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.318+0000 7fba08db2740 1 --2- 172.21.15.92:0/341698610 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x560d84358ef0 0x560d8435b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:16.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.318+0000 7fba08db2740 4 client.18588 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:10:16.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.318+0000 7fba08db2740 1 -- 172.21.15.92:0/341698610 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560d84243d00 con 0x560d84358ef0 2024-09-19T09:10:16.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.329+0000 7fb9fffff640 1 --2- 172.21.15.92:0/341698610 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x560d84358ef0 0x560d8435b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:16.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.344+0000 7fb9df7fe640 10 client.18588 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:16.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.344+0000 7fb9fffff640 1 --2- 172.21.15.92:0/341698610 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x560d84358ef0 0x560d8435b3b0 crc :-1 s=READY pgs=407 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e823f00a7e3c82ca server_cookie=347e9316f1dc02cb in_seq=0 out_seq=0 2024-09-19T09:10:16.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.345+0000 7fb9df7fe640 1 -- 172.21.15.92:0/341698610 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560d84243d00 con 0x560d84358ef0 2024-09-19T09:10:16.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.345+0000 7fb9df7fe640 10 client.18588 handle_command_reply: tid=0 2024-09-19T09:10:16.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.345+0000 7fba08db2740 1 client.18588 shutdown 2024-09-19T09:10:16.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.347+0000 7fba08db2740 1 -- 172.21.15.92:0/341698610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d842e1d40 msgr2=0x560d842ee630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:16.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.347+0000 7fba08db2740 1 --2- 172.21.15.92:0/341698610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d842e1d40 0x560d842ee630 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fb9f80c5620 tx=0x7fb9f80dd0c0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.349+0000 7fba08db2740 1 -- 172.21.15.92:0/341698610 shutdown_connections 2024-09-19T09:10:16.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.349+0000 7fba08db2740 1 --2- 172.21.15.92:0/341698610 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x560d84358ef0 0x560d8435b3b0 crc :-1 s=READY pgs=407 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.349+0000 7fba08db2740 1 --2- 172.21.15.92:0/341698610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d842e1d40 0x560d842ee630 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.349+0000 7fba08db2740 1 --2- 172.21.15.92:0/341698610 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d842d7480 0x560d842ee0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.349+0000 7fba08db2740 1 --2- 172.21.15.92:0/341698610 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d842d6b60 0x560d842e8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.349+0000 7fb9df7fe640 0 client.18588 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:16.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.349+0000 7fba08db2740 1 -- 172.21.15.92:0/341698610 >> 172.21.15.92:0/341698610 conn(0x560d842d30f0 msgr2=0x560d842d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:16.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.349+0000 7fba08db2740 1 -- 172.21.15.92:0/341698610 shutdown_connections 2024-09-19T09:10:16.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.350+0000 7fba08db2740 1 -- 172.21.15.92:0/341698610 wait complete. 2024-09-19T09:10:16.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.350+0000 7fba08db2740 20 client.18588 trim_cache size 0 max 16384 2024-09-19T09:10:16.351 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:10:16.351 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-19T09:10:16.351 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "4d6703de-9ba2-4391-a1f0-587a5b03c26a", 2024-09-19T09:10:16.351 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-19T09:10:16.351 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:10:16.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.351+0000 7fba069d9640 1 -- 172.21.15.92:0/2925254685 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb9ec0a3390 msgr2=0x7fb9ec0a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:16.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.351+0000 7fba069d9640 1 --2- 172.21.15.92:0/2925254685 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb9ec0a3390 0x7fb9ec0a5850 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x560d842d3f50 tx=0x7fb9f0009110 comp rx=0 tx=0).stop 2024-09-19T09:10:16.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.351+0000 7fba069d9640 1 -- 172.21.15.92:0/2925254685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba0010c180 msgr2=0x7fba0019ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:16.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.351+0000 7fba069d9640 1 --2- 172.21.15.92:0/2925254685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba0010c180 0x7fba0019ce30 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8005cc0 tx=0x7fb9f802f6a0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.352+0000 7fba069d9640 1 -- 172.21.15.92:0/2925254685 shutdown_connections 2024-09-19T09:10:16.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.352+0000 7fba069d9640 1 --2- 172.21.15.92:0/2925254685 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb9ec0a3390 0x7fb9ec0a5850 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.352+0000 7fba069d9640 1 --2- 172.21.15.92:0/2925254685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba0010c180 0x7fba0019ce30 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.352+0000 7fba069d9640 1 --2- 172.21.15.92:0/2925254685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba00103670 0x7fba00198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.352+0000 7fba069d9640 1 --2- 172.21.15.92:0/2925254685 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba00102d50 0x7fba00198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.352+0000 7fba069d9640 1 -- 172.21.15.92:0/2925254685 >> 172.21.15.92:0/2925254685 conn(0x7fba000fc7d0 msgr2=0x7fba000fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:16.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.352+0000 7fba069d9640 1 -- 172.21.15.92:0/2925254685 shutdown_connections 2024-09-19T09:10:16.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:16.352+0000 7fba069d9640 1 -- 172.21.15.92:0/2925254685 wait complete. 2024-09-19T09:10:16.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:16 smithi092 ceph-mon[31407]: pgmap v744: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 721 op/s 2024-09-19T09:10:17.030 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:10:17.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:16 smithi167 ceph-mon[35359]: pgmap v744: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 721 op/s 2024-09-19T09:10:17.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:16 smithi190 ceph-mon[35358]: pgmap v744: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 721 op/s 2024-09-19T09:10:17.404 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:10:17.791 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:17 smithi092 ceph-mon[31407]: scrub queued for path: / 2024-09-19T09:10:17.791 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:17 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:10:17.791 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:17 smithi092 ceph-mon[31407]: scrub summary: active paths [/] 2024-09-19T09:10:17.791 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:17 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:10:18.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:17 smithi167 ceph-mon[35359]: scrub queued for path: / 2024-09-19T09:10:18.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:17 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:10:18.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:17 smithi167 ceph-mon[35359]: scrub summary: active paths [/] 2024-09-19T09:10:18.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:17 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:10:18.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:17 smithi190 ceph-mon[35358]: scrub queued for path: / 2024-09-19T09:10:18.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:17 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:10:18.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:17 smithi190 ceph-mon[35358]: scrub summary: active paths [/] 2024-09-19T09:10:18.125 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:17 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:10:18.150 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:10:18.150 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:10:18.151 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": { 2024-09-19T09:10:18.151 INFO:teuthology.orchestra.run.smithi092.stdout: "4d6703de-9ba2-4391-a1f0-587a5b03c26a": { 2024-09-19T09:10:18.151 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-19T09:10:18.151 INFO:teuthology.orchestra.run.smithi092.stdout: "tag": "4d6703de-9ba2-4391-a1f0-587a5b03c26a", 2024-09-19T09:10:18.151 INFO:teuthology.orchestra.run.smithi092.stdout: "options": "recursive,force" 2024-09-19T09:10:18.151 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:10:18.151 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:10:18.151 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:10:18.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.898+0000 7f70e4f1c640 1 -- 172.21.15.92:0/2074824106 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70e011b140 msgr2=0x7f70e011d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:18.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.898+0000 7f70e4f1c640 1 --2- 172.21.15.92:0/2074824106 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70e011b140 0x7f70e011d530 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f70d8009ca0 tx=0x7f70d802a8f0 comp rx=0 tx=0).stop 2024-09-19T09:10:18.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.898+0000 7f70e4f1c640 1 -- 172.21.15.92:0/2074824106 shutdown_connections 2024-09-19T09:10:18.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.898+0000 7f70e4f1c640 1 --2- 172.21.15.92:0/2074824106 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70e011b140 0x7f70e011d530 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:18.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.898+0000 7f70e4f1c640 1 --2- 172.21.15.92:0/2074824106 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70e0109830 0x7f70e0109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:18.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.898+0000 7f70e4f1c640 1 --2- 172.21.15.92:0/2074824106 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70e0109450 0x7f70e0110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:18.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.898+0000 7f70e4f1c640 1 -- 172.21.15.92:0/2074824106 >> 172.21.15.92:0/2074824106 conn(0x7f70e006e140 msgr2=0x7f70e006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:18.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.899+0000 7f70e4f1c640 1 -- 172.21.15.92:0/2074824106 shutdown_connections 2024-09-19T09:10:18.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.899+0000 7f70e4f1c640 1 -- 172.21.15.92:0/2074824106 wait complete. 2024-09-19T09:10:18.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.899+0000 7f70e4f1c640 1 Processor -- start 2024-09-19T09:10:18.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.900+0000 7f70e4f1c640 1 -- start start 2024-09-19T09:10:18.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.900+0000 7f70e4f1c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70e0109450 0x7f70e01a7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:18.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.900+0000 7f70e4f1c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70e0109830 0x7f70e01a78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:18.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.900+0000 7f70e4f1c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70e011b140 0x7f70e01abc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:18.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.900+0000 7f70e4f1c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f70e0120e80 con 0x7f70e011b140 2024-09-19T09:10:18.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.900+0000 7f70e4f1c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f70e0120d00 con 0x7f70e0109830 2024-09-19T09:10:18.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.900+0000 7f70e4f1c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f70e0121000 con 0x7f70e0109450 2024-09-19T09:10:18.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.902+0000 7f70ddd9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70e0109830 0x7f70e01a78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:18.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.902+0000 7f70ddd9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70e0109830 0x7f70e01a78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:51954/0 (socket says 172.21.15.92:51954) 2024-09-19T09:10:18.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.902+0000 7f70ddd9b640 1 -- 172.21.15.92:0/3437994897 learned_addr learned my addr 172.21.15.92:0/3437994897 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:18.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.902+0000 7f70de59c640 1 --2- 172.21.15.92:0/3437994897 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70e0109450 0x7f70e01a7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:18.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.904+0000 7f70ded9d640 1 --2- 172.21.15.92:0/3437994897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70e011b140 0x7f70e01abc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:18.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.904+0000 7f70ddd9b640 1 -- 172.21.15.92:0/3437994897 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70e0109450 msgr2=0x7f70e01a7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:18.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.904+0000 7f70ddd9b640 1 --2- 172.21.15.92:0/3437994897 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70e0109450 0x7f70e01a7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:18.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.904+0000 7f70ddd9b640 1 -- 172.21.15.92:0/3437994897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70e011b140 msgr2=0x7f70e01abc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:18.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.904+0000 7f70ddd9b640 1 --2- 172.21.15.92:0/3437994897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70e011b140 0x7f70e01abc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:18.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.905+0000 7f70ddd9b640 1 -- 172.21.15.92:0/3437994897 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e01ac350 con 0x7f70e0109830 2024-09-19T09:10:18.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.905+0000 7f70ddd9b640 1 --2- 172.21.15.92:0/3437994897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70e0109830 0x7f70e01a78c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f70d000b450 tx=0x7f70d000b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:18.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.905+0000 7f70cf7fe640 1 -- 172.21.15.92:0/3437994897 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d0015020 con 0x7f70e0109830 2024-09-19T09:10:18.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.906+0000 7f70e4f1c640 1 -- 172.21.15.92:0/3437994897 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70e01ac640 con 0x7f70e0109830 2024-09-19T09:10:18.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.906+0000 7f70e4f1c640 1 -- 172.21.15.92:0/3437994897 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70e0110920 con 0x7f70e0109830 2024-09-19T09:10:18.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.906+0000 7f70cf7fe640 1 -- 172.21.15.92:0/3437994897 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70d0011d70 con 0x7f70e0109830 2024-09-19T09:10:18.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.906+0000 7f70cf7fe640 1 -- 172.21.15.92:0/3437994897 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d000f340 con 0x7f70e0109830 2024-09-19T09:10:18.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.909+0000 7f70cf7fe640 1 -- 172.21.15.92:0/3437994897 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f70d0018020 con 0x7f70e0109830 2024-09-19T09:10:18.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.910+0000 7f70cf7fe640 1 --2- 172.21.15.92:0/3437994897 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f70c80a32c0 0x7f70c80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:18.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.910+0000 7f70e72f5740 1 Processor -- start 2024-09-19T09:10:18.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.910+0000 7f70cf7fe640 1 -- 172.21.15.92:0/3437994897 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f70d00cf370 con 0x7f70e0109830 2024-09-19T09:10:18.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.911+0000 7f70e72f5740 1 -- start start 2024-09-19T09:10:18.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.912+0000 7f70e72f5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab801e54a0 0x55ab801e5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:18.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.912+0000 7f70e72f5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab801e5dc0 0x55ab801f0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:18.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.912+0000 7f70e72f5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab801f0680 0x55ab801f2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:18.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.912+0000 7f70e72f5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ab8014b2e0 con 0x55ab801f0680 2024-09-19T09:10:18.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.912+0000 7f70e72f5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ab800f2ce0 con 0x55ab801e5dc0 2024-09-19T09:10:18.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.912+0000 7f70e72f5740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ab801472a0 con 0x55ab801e54a0 2024-09-19T09:10:18.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.912+0000 7f70de59c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab801e54a0 0x55ab801e5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:18.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.912+0000 7f70de59c640 1 --2- 172.21.15.92:0/3437994897 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f70c80a32c0 0x7f70c80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:18.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.913+0000 7f70de59c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab801e54a0 0x55ab801e5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:58076/0 (socket says 172.21.15.92:58076) 2024-09-19T09:10:18.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.913+0000 7f70de59c640 1 -- 172.21.15.92:0/873862392 learned_addr learned my addr 172.21.15.92:0/873862392 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:18.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.916+0000 7f70ddd9b640 1 --2- 172.21.15.92:0/873862392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab801e5dc0 0x55ab801f0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:18.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.921+0000 7f70ddd9b640 1 -- 172.21.15.92:0/873862392 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab801e54a0 msgr2=0x55ab801e5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:18.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.921+0000 7f70ddd9b640 1 --2- 172.21.15.92:0/873862392 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab801e54a0 0x55ab801e5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:18.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.921+0000 7f70ddd9b640 1 -- 172.21.15.92:0/873862392 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab801f0680 msgr2=0x55ab801f2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:18.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.921+0000 7f70ddd9b640 1 --2- 172.21.15.92:0/873862392 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab801f0680 0x55ab801f2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:18.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.921+0000 7f70ddd9b640 1 -- 172.21.15.92:0/873862392 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab800d7440 con 0x55ab801e5dc0 2024-09-19T09:10:18.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.923+0000 7f70ddd9b640 1 --2- 172.21.15.92:0/873862392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab801e5dc0 0x55ab801f0140 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f70d0009fd0 tx=0x7f70d009b890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc6347ca027290f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:18.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.924+0000 7f70ccff9640 1 -- 172.21.15.92:0/873862392 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d00b4070 con 0x55ab801e5dc0 2024-09-19T09:10:18.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.924+0000 7f70ccff9640 1 -- 172.21.15.92:0/873862392 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70d00a4600 con 0x55ab801e5dc0 2024-09-19T09:10:18.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.925+0000 7f70e72f5740 1 -- 172.21.15.92:0/873862392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab801e5dc0 msgr2=0x55ab801f0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:18.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.925+0000 7f70e72f5740 1 --2- 172.21.15.92:0/873862392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab801e5dc0 0x55ab801f0140 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f70d0009fd0 tx=0x7f70d009b890 comp rx=0 tx=0).stop 2024-09-19T09:10:18.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.926+0000 7f70e72f5740 1 -- 172.21.15.92:0/873862392 shutdown_connections 2024-09-19T09:10:18.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.926+0000 7f70e72f5740 1 --2- 172.21.15.92:0/873862392 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab801f0680 0x55ab801f2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:18.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.926+0000 7f70e72f5740 1 --2- 172.21.15.92:0/873862392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab801e5dc0 0x55ab801f0140 secure :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f70d0009fd0 tx=0x7f70d009b890 comp rx=0 tx=0).stop 2024-09-19T09:10:18.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.926+0000 7f70e72f5740 1 --2- 172.21.15.92:0/873862392 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab801e54a0 0x55ab801e5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:18.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.926+0000 7f70e72f5740 1 -- 172.21.15.92:0/873862392 >> 172.21.15.92:0/873862392 conn(0x55ab801e1a30 msgr2=0x55ab801e1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:18.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.926+0000 7f70de59c640 1 --2- 172.21.15.92:0/3437994897 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f70c80a32c0 0x7f70c80a5780 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f70d4006a50 tx=0x7f70d40069e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:18.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.929+0000 7f70e72f5740 1 -- 172.21.15.92:0/873862392 shutdown_connections 2024-09-19T09:10:18.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.929+0000 7f70e72f5740 1 -- 172.21.15.92:0/873862392 wait complete. 2024-09-19T09:10:18.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.929+0000 7f70e72f5740 1 -- start start 2024-09-19T09:10:18.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.929+0000 7f70e72f5740 1 Processor -- start 2024-09-19T09:10:18.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.930+0000 7f70e72f5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab801e54a0 0x55ab801ed4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:18.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.930+0000 7f70e72f5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab801f0680 0x55ab801eda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:18.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.930+0000 7f70e72f5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab801edf60 0x55ab801fc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:18.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.930+0000 7f70e72f5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ab801f32f0 con 0x55ab801edf60 2024-09-19T09:10:18.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.930+0000 7f70e72f5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ab80106050 con 0x55ab801e54a0 2024-09-19T09:10:18.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.930+0000 7f70e72f5740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ab801f3470 con 0x55ab801f0680 2024-09-19T09:10:18.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.930+0000 7f70e72f5740 10 client.0 _ll_register_callbacks cb 0x55ab80146160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:10:18.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.932+0000 7f70ded9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab801edf60 0x55ab801fc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:18.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.932+0000 7f70ded9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab801edf60 0x55ab801fc810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40698/0 (socket says 172.21.15.92:40698) 2024-09-19T09:10:18.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.932+0000 7f70ded9d640 1 -- 172.21.15.92:0/4234934767 learned_addr learned my addr 172.21.15.92:0/4234934767 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:18.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.933+0000 7f70ddd9b640 1 --2- 172.21.15.92:0/4234934767 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab801f0680 0x55ab801eda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:18.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.933+0000 7f70de59c640 1 --2- 172.21.15.92:0/4234934767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab801e54a0 0x55ab801ed4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:18.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.934+0000 7f70ded9d640 1 -- 172.21.15.92:0/4234934767 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab801f0680 msgr2=0x55ab801eda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:18.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.934+0000 7f70ded9d640 1 --2- 172.21.15.92:0/4234934767 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab801f0680 0x55ab801eda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:18.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.934+0000 7f70ded9d640 1 -- 172.21.15.92:0/4234934767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab801e54a0 msgr2=0x55ab801ed4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:18.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.934+0000 7f70ded9d640 1 --2- 172.21.15.92:0/4234934767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab801e54a0 0x55ab801ed4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:18.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.934+0000 7f70ded9d640 1 -- 172.21.15.92:0/4234934767 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab7febc3c0 con 0x55ab801edf60 2024-09-19T09:10:18.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.935+0000 7f70ded9d640 1 --2- 172.21.15.92:0/4234934767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab801edf60 0x55ab801fc810 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f70d8009430 tx=0x7f70d8031bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e728b1aca5f164 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:18.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.935+0000 7f70c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:10:18.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.935+0000 7f70c5ffb640 1 -- 172.21.15.92:0/4234934767 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d8030a30 con 0x55ab801edf60 2024-09-19T09:10:18.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.935+0000 7f70e72f5740 1 -- 172.21.15.92:0/4234934767 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ab80158850 con 0x55ab801edf60 2024-09-19T09:10:18.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.935+0000 7f70c5ffb640 1 -- 172.21.15.92:0/4234934767 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f70d8030bd0 con 0x55ab801edf60 2024-09-19T09:10:18.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.936+0000 7f70c5ffb640 1 -- 172.21.15.92:0/4234934767 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f70d8030dd0 con 0x55ab801edf60 2024-09-19T09:10:18.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.940+0000 7f70e72f5740 10 client.18597 fetch_fsmap learned FSMap version 19 2024-09-19T09:10:18.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.940+0000 7f70e72f5740 1 -- 172.21.15.92:0/4234934767 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ab801ff470 con 0x55ab801edf60 2024-09-19T09:10:18.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.941+0000 7f70c5ffb640 1 -- 172.21.15.92:0/4234934767 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55ab80158850 con 0x55ab801edf60 2024-09-19T09:10:18.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.941+0000 7f70c5ffb640 1 -- 172.21.15.92:0/4234934767 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f70d8004040 con 0x55ab801edf60 2024-09-19T09:10:18.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.941+0000 7f70e72f5740 10 client.18597 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:10:18.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.941+0000 7f70e72f5740 10 client.18597 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:10:18.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.941+0000 7f70e72f5740 20 client.18597 populate_metadata read hostname 'smithi092' 2024-09-19T09:10:18.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.941+0000 7f70e72f5740 1 --2- 172.21.15.92:0/4234934767 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ab80200cf0 0x55ab80203130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:18.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.941+0000 7f70e72f5740 4 client.18597 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:10:18.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.941+0000 7f70e72f5740 1 -- 172.21.15.92:0/4234934767 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab80152d60 con 0x55ab80200cf0 2024-09-19T09:10:18.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.943+0000 7f70de59c640 1 --2- 172.21.15.92:0/4234934767 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ab80200cf0 0x55ab80203130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:18.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.947+0000 7f70de59c640 1 --2- 172.21.15.92:0/4234934767 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ab80200cf0 0x55ab80203130 crc :-1 s=READY pgs=408 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90bf91af5eef4b40 server_cookie=57f11180c7a57318 in_seq=0 out_seq=0 2024-09-19T09:10:18.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.948+0000 7f70c5ffb640 10 client.18597 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:18.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.948+0000 7f70c5ffb640 1 -- 172.21.15.92:0/4234934767 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ab80152d60 con 0x55ab80200cf0 2024-09-19T09:10:18.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.948+0000 7f70c5ffb640 10 client.18597 handle_command_reply: tid=0 2024-09-19T09:10:18.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.948+0000 7f70e72f5740 1 client.18597 shutdown 2024-09-19T09:10:18.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.949+0000 7f70e72f5740 1 -- 172.21.15.92:0/4234934767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab801edf60 msgr2=0x55ab801fc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:18.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.949+0000 7f70e72f5740 1 --2- 172.21.15.92:0/4234934767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab801edf60 0x55ab801fc810 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f70d8009430 tx=0x7f70d8031bc0 comp rx=0 tx=0).stop 2024-09-19T09:10:18.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.949+0000 7f70e72f5740 1 -- 172.21.15.92:0/4234934767 shutdown_connections 2024-09-19T09:10:18.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.949+0000 7f70e72f5740 1 --2- 172.21.15.92:0/4234934767 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ab80200cf0 0x55ab80203130 crc :-1 s=READY pgs=408 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:18.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.949+0000 7f70e72f5740 1 --2- 172.21.15.92:0/4234934767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab801edf60 0x55ab801fc810 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:18.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.949+0000 7f70e72f5740 1 --2- 172.21.15.92:0/4234934767 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab801f0680 0x55ab801eda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:18.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.949+0000 7f70e72f5740 1 --2- 172.21.15.92:0/4234934767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab801e54a0 0x55ab801ed4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:18.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.949+0000 7f70e72f5740 1 -- 172.21.15.92:0/4234934767 >> 172.21.15.92:0/4234934767 conn(0x55ab801e1a30 msgr2=0x55ab801e7790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:18.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.950+0000 7f70c5ffb640 0 client.18597 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:18.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.951+0000 7f70e72f5740 1 -- 172.21.15.92:0/4234934767 shutdown_connections 2024-09-19T09:10:18.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.951+0000 7f70e72f5740 1 -- 172.21.15.92:0/4234934767 wait complete. 2024-09-19T09:10:18.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.951+0000 7f70e72f5740 20 client.18597 trim_cache size 0 max 16384 2024-09-19T09:10:18.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.976+0000 7f70e72f5740 1 Processor -- start 2024-09-19T09:10:18.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.976+0000 7f70e72f5740 1 -- start start 2024-09-19T09:10:18.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.977+0000 7f70e72f5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab801e54a0 0x55ab801fc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:18.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.977+0000 7f70e72f5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab801edf60 0x55ab801fcb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:18.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.977+0000 7f70e72f5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab801f0680 0x55ab80208a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:18.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.977+0000 7f70ded9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab801f0680 0x55ab80208a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:18.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.977+0000 7f70ded9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab801f0680 0x55ab80208a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40712/0 (socket says 172.21.15.92:40712) 2024-09-19T09:10:18.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.977+0000 7f70ded9d640 1 -- 172.21.15.92:0/3382069708 learned_addr learned my addr 172.21.15.92:0/3382069708 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:18.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.977+0000 7f70e72f5740 1 -- 172.21.15.92:0/3382069708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f70c000c4b0 con 0x55ab801f0680 2024-09-19T09:10:18.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.977+0000 7f70e72f5740 1 -- 172.21.15.92:0/3382069708 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f70c000ed50 con 0x55ab801e54a0 2024-09-19T09:10:18.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.977+0000 7f70e72f5740 1 -- 172.21.15.92:0/3382069708 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f70c000cb40 con 0x55ab801edf60 2024-09-19T09:10:18.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.977+0000 7f70ddd9b640 1 --2- 172.21.15.92:0/3382069708 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab801edf60 0x55ab801fcb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:18.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.977+0000 7f70de59c640 1 --2- 172.21.15.92:0/3382069708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab801e54a0 0x55ab801fc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:18.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.978+0000 7f70ded9d640 1 -- 172.21.15.92:0/3382069708 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab801edf60 msgr2=0x55ab801fcb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:18.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.978+0000 7f70ded9d640 1 --2- 172.21.15.92:0/3382069708 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab801edf60 0x55ab801fcb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:18.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.978+0000 7f70ded9d640 1 -- 172.21.15.92:0/3382069708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab801e54a0 msgr2=0x55ab801fc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:18.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.978+0000 7f70ded9d640 1 --2- 172.21.15.92:0/3382069708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab801e54a0 0x55ab801fc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:18.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.978+0000 7f70ded9d640 1 -- 172.21.15.92:0/3382069708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab802037b0 con 0x55ab801f0680 2024-09-19T09:10:18.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.978+0000 7f70ded9d640 1 --2- 172.21.15.92:0/3382069708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab801f0680 0x55ab80208a40 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f70d8009ca0 tx=0x7f70d8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1469eb881a28dcb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:18.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.979+0000 7f70c7fff640 1 -- 172.21.15.92:0/3382069708 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d8055070 con 0x55ab801f0680 2024-09-19T09:10:18.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.979+0000 7f70c7fff640 1 -- 172.21.15.92:0/3382069708 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70d8036040 con 0x55ab801f0680 2024-09-19T09:10:18.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.979+0000 7f70c7fff640 1 -- 172.21.15.92:0/3382069708 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d802f650 con 0x55ab801f0680 2024-09-19T09:10:18.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.980+0000 7f70e72f5740 1 -- 172.21.15.92:0/3382069708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab801f0680 msgr2=0x55ab80208a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:18.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.980+0000 7f70e72f5740 1 --2- 172.21.15.92:0/3382069708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab801f0680 0x55ab80208a40 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f70d8009ca0 tx=0x7f70d8009b20 comp rx=0 tx=0).stop 2024-09-19T09:10:18.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.980+0000 7f70e72f5740 1 -- 172.21.15.92:0/3382069708 shutdown_connections 2024-09-19T09:10:18.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.980+0000 7f70e72f5740 1 --2- 172.21.15.92:0/3382069708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab801f0680 0x55ab80208a40 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:18.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.980+0000 7f70e72f5740 1 --2- 172.21.15.92:0/3382069708 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab801edf60 0x55ab801fcb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:18.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.980+0000 7f70e72f5740 1 --2- 172.21.15.92:0/3382069708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab801e54a0 0x55ab801fc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:18.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.981+0000 7f70e72f5740 1 -- 172.21.15.92:0/3382069708 >> 172.21.15.92:0/3382069708 conn(0x55ab801e1a30 msgr2=0x55ab801ef560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:18.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.981+0000 7f70e72f5740 1 -- 172.21.15.92:0/3382069708 shutdown_connections 2024-09-19T09:10:18.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.981+0000 7f70e72f5740 1 -- 172.21.15.92:0/3382069708 wait complete. 2024-09-19T09:10:18.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.982+0000 7f70e72f5740 1 -- start start 2024-09-19T09:10:18.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.982+0000 7f70e72f5740 1 Processor -- start 2024-09-19T09:10:18.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.982+0000 7f70e72f5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab801e54a0 0x55ab801f4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:18.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.982+0000 7f70e72f5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab801edf60 0x55ab801f4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:18.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.982+0000 7f70e72f5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab801f0680 0x55ab801f51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:18.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.982+0000 7f70e72f5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f70c000d210 con 0x55ab801f0680 2024-09-19T09:10:18.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.982+0000 7f70e72f5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f70c000e680 con 0x55ab801edf60 2024-09-19T09:10:18.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.982+0000 7f70e72f5740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f70c000d8e0 con 0x55ab801e54a0 2024-09-19T09:10:18.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.982+0000 7f70e72f5740 10 client.0 _ll_register_callbacks cb 0x7f70e0110870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:10:18.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.983+0000 7f70ded9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab801f0680 0x55ab801f51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:18.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.983+0000 7f70de59c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab801e54a0 0x55ab801f4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:18.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.983+0000 7f70ded9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab801f0680 0x55ab801f51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40726/0 (socket says 172.21.15.92:40726) 2024-09-19T09:10:18.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.983+0000 7f70ded9d640 1 -- 172.21.15.92:0/188427529 learned_addr learned my addr 172.21.15.92:0/188427529 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:18.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.983+0000 7f70de59c640 1 -- 172.21.15.92:0/188427529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab801edf60 msgr2=0x55ab801f4c70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:10:18.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.983+0000 7f70de59c640 1 --2- 172.21.15.92:0/188427529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab801edf60 0x55ab801f4c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:18.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.983+0000 7f70de59c640 1 -- 172.21.15.92:0/188427529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab801f0680 msgr2=0x55ab801f51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:18.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.983+0000 7f70de59c640 1 --2- 172.21.15.92:0/188427529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab801f0680 0x55ab801f51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:18.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.983+0000 7f70de59c640 1 -- 172.21.15.92:0/188427529 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab801e26c0 con 0x55ab801e54a0 2024-09-19T09:10:18.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.983+0000 7f70ded9d640 1 --2- 172.21.15.92:0/188427529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab801f0680 0x55ab801f51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:10:18.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.983+0000 7f70de59c640 1 --2- 172.21.15.92:0/188427529 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab801e54a0 0x55ab801f4730 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x55ab80203980 tx=0x7f70d40046e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8304c499cffdb2ce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:18.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.984+0000 7f70c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:10:18.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.984+0000 7f70c5ffb640 1 -- 172.21.15.92:0/188427529 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d4031060 con 0x55ab801e54a0 2024-09-19T09:10:18.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.984+0000 7f70e72f5740 1 -- 172.21.15.92:0/188427529 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70d8036040 con 0x55ab801e54a0 2024-09-19T09:10:18.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.984+0000 7f70c5ffb640 1 -- 172.21.15.92:0/188427529 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f70d40067a0 con 0x55ab801e54a0 2024-09-19T09:10:18.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.984+0000 7f70c5ffb640 1 -- 172.21.15.92:0/188427529 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f70d402c440 con 0x55ab801e54a0 2024-09-19T09:10:18.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.984+0000 7f70e72f5740 10 client.27718 fetch_fsmap learned FSMap version 19 2024-09-19T09:10:18.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.984+0000 7f70e72f5740 1 -- 172.21.15.92:0/188427529 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ab8026be50 con 0x55ab801e54a0 2024-09-19T09:10:18.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.984+0000 7f70c5ffb640 1 -- 172.21.15.92:0/188427529 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70d8036040 con 0x55ab801e54a0 2024-09-19T09:10:18.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.984+0000 7f70c5ffb640 1 -- 172.21.15.92:0/188427529 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f70d4036070 con 0x55ab801e54a0 2024-09-19T09:10:18.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.985+0000 7f70e72f5740 10 client.27718 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:10:18.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.985+0000 7f70e72f5740 10 client.27718 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:10:18.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.985+0000 7f70e72f5740 20 client.27718 populate_metadata read hostname 'smithi092' 2024-09-19T09:10:18.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.985+0000 7f70e72f5740 1 --2- 172.21.15.92:0/188427529 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ab8026c520 0x55ab8026e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:18.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.985+0000 7f70e72f5740 4 client.27718 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:10:18.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.985+0000 7f70e72f5740 1 -- 172.21.15.92:0/188427529 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ab801eddb0 con 0x55ab8026c520 2024-09-19T09:10:18.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.985+0000 7f70ddd9b640 1 --2- 172.21.15.92:0/188427529 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ab8026c520 0x55ab8026e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:18.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.986+0000 7f70c5ffb640 10 client.27718 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:18.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.986+0000 7f70ddd9b640 1 --2- 172.21.15.92:0/188427529 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ab8026c520 0x55ab8026e9c0 crc :-1 s=READY pgs=409 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bd1e4c2b2bdb09f server_cookie=2a33da94bbd7db03 in_seq=0 out_seq=0 2024-09-19T09:10:18.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.986+0000 7f70c5ffb640 1 -- 172.21.15.92:0/188427529 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55ab801eddb0 con 0x55ab8026c520 2024-09-19T09:10:18.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.986+0000 7f70c5ffb640 10 client.27718 handle_command_reply: tid=0 2024-09-19T09:10:18.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.986+0000 7f70e72f5740 1 client.27718 shutdown 2024-09-19T09:10:18.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.986+0000 7f70e72f5740 1 -- 172.21.15.92:0/188427529 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab801e54a0 msgr2=0x55ab801f4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:18.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.986+0000 7f70e72f5740 1 --2- 172.21.15.92:0/188427529 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab801e54a0 0x55ab801f4730 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x55ab80203980 tx=0x7f70d40046e0 comp rx=0 tx=0).stop 2024-09-19T09:10:18.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.986+0000 7f70e72f5740 1 -- 172.21.15.92:0/188427529 shutdown_connections 2024-09-19T09:10:18.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.986+0000 7f70e72f5740 1 --2- 172.21.15.92:0/188427529 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ab8026c520 0x55ab8026e9c0 crc :-1 s=READY pgs=409 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:18.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.986+0000 7f70e72f5740 1 --2- 172.21.15.92:0/188427529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab801f0680 0x55ab801f51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:18.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.986+0000 7f70e72f5740 1 --2- 172.21.15.92:0/188427529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ab801edf60 0x55ab801f4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:18.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.986+0000 7f70e72f5740 1 --2- 172.21.15.92:0/188427529 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab801e54a0 0x55ab801f4730 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:18.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.986+0000 7f70e72f5740 1 -- 172.21.15.92:0/188427529 >> 172.21.15.92:0/188427529 conn(0x55ab801e1a30 msgr2=0x55ab801e6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:18.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.986+0000 7f70c5ffb640 0 client.27718 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:18.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.986+0000 7f70e72f5740 1 -- 172.21.15.92:0/188427529 shutdown_connections 2024-09-19T09:10:18.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.986+0000 7f70e72f5740 1 -- 172.21.15.92:0/188427529 wait complete. 2024-09-19T09:10:18.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.987+0000 7f70e72f5740 20 client.27718 trim_cache size 0 max 16384 2024-09-19T09:10:18.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.987+0000 7f70e4f1c640 1 -- 172.21.15.92:0/3437994897 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f70c80a32c0 msgr2=0x7f70c80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:18.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.987+0000 7f70e4f1c640 1 --2- 172.21.15.92:0/3437994897 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f70c80a32c0 0x7f70c80a5780 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f70d4006a50 tx=0x7f70d40069e0 comp rx=0 tx=0).stop 2024-09-19T09:10:18.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.988+0000 7f70e4f1c640 1 -- 172.21.15.92:0/3437994897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70e0109830 msgr2=0x7f70e01a78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:18.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.988+0000 7f70e4f1c640 1 --2- 172.21.15.92:0/3437994897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70e0109830 0x7f70e01a78c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f70d000b450 tx=0x7f70d000b910 comp rx=0 tx=0).stop 2024-09-19T09:10:18.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.988+0000 7f70e4f1c640 1 -- 172.21.15.92:0/3437994897 shutdown_connections 2024-09-19T09:10:18.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.988+0000 7f70e4f1c640 1 --2- 172.21.15.92:0/3437994897 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f70c80a32c0 0x7f70c80a5780 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:18.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.988+0000 7f70e4f1c640 1 --2- 172.21.15.92:0/3437994897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70e011b140 0x7f70e01abc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:18.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.988+0000 7f70e4f1c640 1 --2- 172.21.15.92:0/3437994897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70e0109830 0x7f70e01a78c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:18.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.988+0000 7f70e4f1c640 1 --2- 172.21.15.92:0/3437994897 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70e0109450 0x7f70e01a7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:18.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.988+0000 7f70e4f1c640 1 -- 172.21.15.92:0/3437994897 >> 172.21.15.92:0/3437994897 conn(0x7f70e006e140 msgr2=0x7f70e011be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:18.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.988+0000 7f70e4f1c640 1 -- 172.21.15.92:0/3437994897 shutdown_connections 2024-09-19T09:10:18.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:17.988+0000 7f70e4f1c640 1 -- 172.21.15.92:0/3437994897 wait complete. 2024-09-19T09:10:19.005 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:18 smithi092 ceph-mon[31407]: pgmap v745: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 19 MiB/s wr, 741 op/s 2024-09-19T09:10:19.065 INFO:tasks.cephfs.filesystem:scrub status for tag:4d6703de-9ba2-4391-a1f0-587a5b03c26a - {'path': '/', 'tag': '4d6703de-9ba2-4391-a1f0-587a5b03c26a', 'options': 'recursive,force'} 2024-09-19T09:10:19.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:18 smithi167 ceph-mon[35359]: pgmap v745: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 19 MiB/s wr, 741 op/s 2024-09-19T09:10:19.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:18 smithi190 ceph-mon[35358]: pgmap v745: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 19 MiB/s wr, 741 op/s 2024-09-19T09:10:20.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:19 smithi092 ceph-mon[31407]: scrub summary: idle 2024-09-19T09:10:20.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:19 smithi167 ceph-mon[35359]: scrub summary: idle 2024-09-19T09:10:20.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:19 smithi190 ceph-mon[35358]: scrub summary: idle 2024-09-19T09:10:20.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 815.0 s, 2210.1 tps, lat 45.637 ms stddev 55.364 2024-09-19T09:10:21.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:20 smithi092 ceph-mon[31407]: pgmap v746: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 18 MiB/s wr, 845 op/s 2024-09-19T09:10:21.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:20 smithi167 ceph-mon[35359]: pgmap v746: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 18 MiB/s wr, 845 op/s 2024-09-19T09:10:21.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:20 smithi190 ceph-mon[35358]: pgmap v746: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 18 MiB/s wr, 845 op/s 2024-09-19T09:10:23.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:22 smithi092 ceph-mon[31407]: pgmap v747: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 16 MiB/s wr, 831 op/s 2024-09-19T09:10:23.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:22 smithi167 ceph-mon[35359]: pgmap v747: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 16 MiB/s wr, 831 op/s 2024-09-19T09:10:23.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:22 smithi190 ceph-mon[35358]: pgmap v747: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 16 MiB/s wr, 831 op/s 2024-09-19T09:10:23.153 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.151+0000 7fddaeff1640 1 -- 172.21.15.92:0/924981868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdda810a150 msgr2=0x7fdda81109e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:23.153 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.151+0000 7fddaeff1640 1 --2- 172.21.15.92:0/924981868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdda810a150 0x7fdda81109e0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fdda0008570 tx=0x7fdda000ac00 comp rx=0 tx=0).stop 2024-09-19T09:10:23.153 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.153+0000 7fddaeff1640 1 -- 172.21.15.92:0/924981868 shutdown_connections 2024-09-19T09:10:23.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.153+0000 7fddaeff1640 1 --2- 172.21.15.92:0/924981868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdda810a150 0x7fdda81109e0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:23.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.153+0000 7fddaeff1640 1 --2- 172.21.15.92:0/924981868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdda8109790 0x7fdda8109c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:23.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.153+0000 7fddaeff1640 1 --2- 172.21.15.92:0/924981868 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdda8073730 0x7fdda8073b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:23.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.153+0000 7fddaeff1640 1 -- 172.21.15.92:0/924981868 >> 172.21.15.92:0/924981868 conn(0x7fdda806ef20 msgr2=0x7fdda8071360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.159+0000 7fddaeff1640 1 -- 172.21.15.92:0/924981868 shutdown_connections 2024-09-19T09:10:23.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.161+0000 7fddaeff1640 1 -- 172.21.15.92:0/924981868 wait complete. 2024-09-19T09:10:23.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.162+0000 7fddaeff1640 1 Processor -- start 2024-09-19T09:10:23.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.162+0000 7fddaeff1640 1 -- start start 2024-09-19T09:10:23.164 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.162+0000 7fddaeff1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdda8073730 0x7fdda81181a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:23.164 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.162+0000 7fddaeff1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdda8109790 0x7fdda81186e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:23.165 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.163+0000 7fddaeff1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdda810a150 0x7fdda8119720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:23.165 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.163+0000 7fddaeff1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdda8112960 con 0x7fdda8109790 2024-09-19T09:10:23.165 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.163+0000 7fddaeff1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdda81127e0 con 0x7fdda810a150 2024-09-19T09:10:23.165 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.163+0000 7fddaeff1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fdda8112ae0 con 0x7fdda8073730 2024-09-19T09:10:23.165 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.163+0000 7fddacd8d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdda8073730 0x7fdda81181a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:23.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.163+0000 7fddacd8d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdda8073730 0x7fdda81181a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:45084/0 (socket says 172.21.15.92:45084) 2024-09-19T09:10:23.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.163+0000 7fddacd8d640 1 -- 172.21.15.92:0/1897286893 learned_addr learned my addr 172.21.15.92:0/1897286893 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:23.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.163+0000 7fddad58e640 1 --2- 172.21.15.92:0/1897286893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdda810a150 0x7fdda8119720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:23.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.163+0000 7fddacd8d640 1 -- 172.21.15.92:0/1897286893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdda810a150 msgr2=0x7fdda8119720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:23.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.163+0000 7fddacd8d640 1 --2- 172.21.15.92:0/1897286893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdda810a150 0x7fdda8119720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:23.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.163+0000 7fddacd8d640 1 -- 172.21.15.92:0/1897286893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdda8109790 msgr2=0x7fdda81186e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:10:23.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.163+0000 7fddacd8d640 1 --2- 172.21.15.92:0/1897286893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdda8109790 0x7fdda81186e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:23.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.163+0000 7fddacd8d640 1 -- 172.21.15.92:0/1897286893 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda8119d90 con 0x7fdda8073730 2024-09-19T09:10:23.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.165+0000 7fddacd8d640 1 --2- 172.21.15.92:0/1897286893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdda8073730 0x7fdda81181a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fdd9800bed0 tx=0x7fdd980095b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:23.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.166+0000 7fdda5ffb640 1 -- 172.21.15.92:0/1897286893 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9801b070 con 0x7fdda8073730 2024-09-19T09:10:23.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.166+0000 7fddaeff1640 1 -- 172.21.15.92:0/1897286893 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdda811a080 con 0x7fdda8073730 2024-09-19T09:10:23.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.166+0000 7fdda5ffb640 1 -- 172.21.15.92:0/1897286893 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd98003e50 con 0x7fdda8073730 2024-09-19T09:10:23.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.167+0000 7fddaeff1640 1 -- 172.21.15.92:0/1897286893 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdda811a5d0 con 0x7fdda8073730 2024-09-19T09:10:23.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.167+0000 7fdda5ffb640 1 -- 172.21.15.92:0/1897286893 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd98016420 con 0x7fdda8073730 2024-09-19T09:10:23.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.172+0000 7fdda5ffb640 1 -- 172.21.15.92:0/1897286893 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fdd9801e070 con 0x7fdda8073730 2024-09-19T09:10:23.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.172+0000 7fddb1e63740 1 Processor -- start 2024-09-19T09:10:23.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.172+0000 7fddb1e63740 1 -- start start 2024-09-19T09:10:23.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.173+0000 7fddb1e63740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630d2d0c9a0 0x5630d2d0cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:23.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.173+0000 7fddb1e63740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630d2d0d2e0 0x5630d2d11da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:23.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.173+0000 7fddb1e63740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630d2d12370 0x5630d2d14830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:23.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.173+0000 7fddb1e63740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5630d2c702f0 con 0x5630d2d12370 2024-09-19T09:10:23.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.173+0000 7fddb1e63740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5630d2c18270 con 0x5630d2d0d2e0 2024-09-19T09:10:23.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.173+0000 7fddb1e63740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5630d2c6c2b0 con 0x5630d2d0c9a0 2024-09-19T09:10:23.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.173+0000 7fddad58e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630d2d0c9a0 0x5630d2d0cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:23.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.173+0000 7fddad58e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630d2d0c9a0 0x5630d2d0cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:45094/0 (socket says 172.21.15.92:45094) 2024-09-19T09:10:23.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.173+0000 7fddad58e640 1 -- 172.21.15.92:0/1869805160 learned_addr learned my addr 172.21.15.92:0/1869805160 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:23.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.173+0000 7fdda7fff640 1 --2- 172.21.15.92:0/1869805160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630d2d12370 0x5630d2d14830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:23.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.173+0000 7fdda5ffb640 1 --2- 172.21.15.92:0/1897286893 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdd940a3300 0x7fdd940a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:23.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.173+0000 7fddad58e640 1 -- 172.21.15.92:0/1869805160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630d2d0d2e0 msgr2=0x5630d2d11da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:23.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.173+0000 7fddad58e640 1 --2- 172.21.15.92:0/1869805160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630d2d0d2e0 0x5630d2d11da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:23.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.173+0000 7fddad58e640 1 -- 172.21.15.92:0/1869805160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630d2d12370 msgr2=0x5630d2d14830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:23.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.173+0000 7fddad58e640 1 --2- 172.21.15.92:0/1869805160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630d2d12370 0x5630d2d14830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:23.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.173+0000 7fddad58e640 1 -- 172.21.15.92:0/1869805160 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630d2c17340 con 0x5630d2d0c9a0 2024-09-19T09:10:23.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.173+0000 7fdda7fff640 1 --2- 172.21.15.92:0/1869805160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630d2d12370 0x5630d2d14830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:10:23.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.173+0000 7fdda5ffb640 1 -- 172.21.15.92:0/1897286893 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fdd980cf0c0 con 0x7fdda8073730 2024-09-19T09:10:23.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.174+0000 7fddad58e640 1 --2- 172.21.15.92:0/1897286893 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdd940a3300 0x7fdd940a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:23.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.174+0000 7fddad58e640 1 --2- 172.21.15.92:0/1869805160 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630d2d0c9a0 0x5630d2d0cda0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fdda002a500 tx=0x7fdda000ade0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88fa6e483ed510dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:23.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.174+0000 7fdd9effd640 1 -- 172.21.15.92:0/1869805160 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda002aad0 con 0x5630d2d0c9a0 2024-09-19T09:10:23.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.174+0000 7fdd9effd640 1 -- 172.21.15.92:0/1869805160 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdda0004f80 con 0x5630d2d0c9a0 2024-09-19T09:10:23.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.174+0000 7fdd9effd640 1 -- 172.21.15.92:0/1869805160 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda000a490 con 0x5630d2d0c9a0 2024-09-19T09:10:23.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.175+0000 7fddb1e63740 1 -- 172.21.15.92:0/1869805160 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630d2d0c9a0 msgr2=0x5630d2d0cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:23.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.175+0000 7fddb1e63740 1 --2- 172.21.15.92:0/1869805160 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630d2d0c9a0 0x5630d2d0cda0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fdda002a500 tx=0x7fdda000ade0 comp rx=0 tx=0).stop 2024-09-19T09:10:23.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.176+0000 7fddad58e640 1 --2- 172.21.15.92:0/1897286893 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdd940a3300 0x7fdd940a57c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fdda0005ab0 tx=0x7fdda003e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:23.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.176+0000 7fddb1e63740 1 -- 172.21.15.92:0/1869805160 shutdown_connections 2024-09-19T09:10:23.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.176+0000 7fddb1e63740 1 --2- 172.21.15.92:0/1869805160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630d2d12370 0x5630d2d14830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:23.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.176+0000 7fddb1e63740 1 --2- 172.21.15.92:0/1869805160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630d2d0d2e0 0x5630d2d11da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:23.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.176+0000 7fddb1e63740 1 --2- 172.21.15.92:0/1869805160 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630d2d0c9a0 0x5630d2d0cda0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:23.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.176+0000 7fddb1e63740 1 -- 172.21.15.92:0/1869805160 >> 172.21.15.92:0/1869805160 conn(0x5630d2d08010 msgr2=0x5630d2d08410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:23.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.176+0000 7fddb1e63740 1 -- 172.21.15.92:0/1869805160 shutdown_connections 2024-09-19T09:10:23.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.176+0000 7fddb1e63740 1 -- 172.21.15.92:0/1869805160 wait complete. 2024-09-19T09:10:23.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.177+0000 7fddb1e63740 1 -- start start 2024-09-19T09:10:23.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.177+0000 7fddb1e63740 1 Processor -- start 2024-09-19T09:10:23.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.178+0000 7fddb1e63740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630d2d0c9a0 0x5630d2d16cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:23.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.178+0000 7fddb1e63740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630d2d0d2e0 0x5630d2d17200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:23.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.178+0000 7fddb1e63740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630d2d12370 0x5630d2d1e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:23.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.178+0000 7fddacd8d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630d2d0c9a0 0x5630d2d16cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:23.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.178+0000 7fddacd8d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630d2d0c9a0 0x5630d2d16cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42164/0 (socket says 172.21.15.92:42164) 2024-09-19T09:10:23.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.178+0000 7fddacd8d640 1 -- 172.21.15.92:0/2134421247 learned_addr learned my addr 172.21.15.92:0/2134421247 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:23.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.178+0000 7fddb1e63740 1 -- 172.21.15.92:0/2134421247 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5630d2d15340 con 0x5630d2d0c9a0 2024-09-19T09:10:23.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.178+0000 7fddb1e63740 1 -- 172.21.15.92:0/2134421247 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5630d2bf9290 con 0x5630d2d0d2e0 2024-09-19T09:10:23.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.178+0000 7fddb1e63740 1 -- 172.21.15.92:0/2134421247 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5630d2d154c0 con 0x5630d2d12370 2024-09-19T09:10:23.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.178+0000 7fddad58e640 1 --2- 172.21.15.92:0/2134421247 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630d2d12370 0x5630d2d1e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:23.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.178+0000 7fdda7fff640 1 --2- 172.21.15.92:0/2134421247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630d2d0d2e0 0x5630d2d17200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:23.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.178+0000 7fddb1e63740 10 client.0 _ll_register_callbacks cb 0x5630d2c2a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:10:23.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.179+0000 7fddad58e640 1 -- 172.21.15.92:0/2134421247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630d2d0d2e0 msgr2=0x5630d2d17200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:23.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.179+0000 7fddad58e640 1 --2- 172.21.15.92:0/2134421247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630d2d0d2e0 0x5630d2d17200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:23.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.179+0000 7fddad58e640 1 -- 172.21.15.92:0/2134421247 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630d2d0c9a0 msgr2=0x5630d2d16cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:23.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.179+0000 7fddad58e640 1 --2- 172.21.15.92:0/2134421247 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630d2d0c9a0 0x5630d2d16cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:23.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.179+0000 7fddad58e640 1 -- 172.21.15.92:0/2134421247 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630d2983210 con 0x5630d2d12370 2024-09-19T09:10:23.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.179+0000 7fddacd8d640 1 --2- 172.21.15.92:0/2134421247 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630d2d0c9a0 0x5630d2d16cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:10:23.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.179+0000 7fddad58e640 1 --2- 172.21.15.92:0/2134421247 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630d2d12370 0x5630d2d1e240 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdda000aed0 tx=0x7fdda0005310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b5593f8f175f123 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:23.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.179+0000 7fdd87fff640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:10:23.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.179+0000 7fdd87fff640 1 -- 172.21.15.92:0/2134421247 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda000a460 con 0x5630d2d12370 2024-09-19T09:10:23.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.179+0000 7fdd87fff640 1 -- 172.21.15.92:0/2134421247 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fdda000a600 con 0x5630d2d12370 2024-09-19T09:10:23.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.179+0000 7fddb1e63740 1 -- 172.21.15.92:0/2134421247 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdda0004f80 con 0x5630d2d12370 2024-09-19T09:10:23.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.179+0000 7fdd87fff640 1 -- 172.21.15.92:0/2134421247 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fdda000a800 con 0x5630d2d12370 2024-09-19T09:10:23.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.180+0000 7fddb1e63740 10 client.27730 fetch_fsmap learned FSMap version 19 2024-09-19T09:10:23.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.180+0000 7fddb1e63740 1 -- 172.21.15.92:0/2134421247 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5630d2a4f620 con 0x5630d2d12370 2024-09-19T09:10:23.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.180+0000 7fdd87fff640 1 -- 172.21.15.92:0/2134421247 <== mon.1 v2:172.21.15.190:3300/0 4 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fdda0055030 con 0x5630d2d12370 2024-09-19T09:10:23.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.181+0000 7fddb1e63740 10 client.27730 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:10:23.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.181+0000 7fddb1e63740 10 client.27730 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:10:23.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.181+0000 7fddb1e63740 20 client.27730 populate_metadata read hostname 'smithi092' 2024-09-19T09:10:23.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.181+0000 7fddb1e63740 1 --2- 172.21.15.92:0/2134421247 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5630d2d223a0 0x5630d2d24790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:23.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.181+0000 7fddb1e63740 4 client.27730 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:10:23.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.181+0000 7fddb1e63740 1 -- 172.21.15.92:0/2134421247 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5630d2c7da20 con 0x5630d2d223a0 2024-09-19T09:10:23.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.181+0000 7fddacd8d640 1 --2- 172.21.15.92:0/2134421247 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5630d2d223a0 0x5630d2d24790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:23.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.188+0000 7fdd87fff640 10 client.27730 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:23.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.188+0000 7fddacd8d640 1 --2- 172.21.15.92:0/2134421247 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5630d2d223a0 0x5630d2d24790 crc :-1 s=READY pgs=410 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e66837e86ebfe12f server_cookie=4d92adc6fb5466b1 in_seq=0 out_seq=0 2024-09-19T09:10:23.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.189+0000 7fdd87fff640 1 -- 172.21.15.92:0/2134421247 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5630d2c7da20 con 0x5630d2d223a0 2024-09-19T09:10:23.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.189+0000 7fdd87fff640 10 client.27730 handle_command_reply: tid=0 2024-09-19T09:10:23.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.189+0000 7fddb1e63740 1 client.27730 shutdown 2024-09-19T09:10:23.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.189+0000 7fddb1e63740 1 -- 172.21.15.92:0/2134421247 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630d2d12370 msgr2=0x5630d2d1e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:23.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.189+0000 7fddb1e63740 1 --2- 172.21.15.92:0/2134421247 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630d2d12370 0x5630d2d1e240 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdda000aed0 tx=0x7fdda0005310 comp rx=0 tx=0).stop 2024-09-19T09:10:23.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.189+0000 7fddb1e63740 1 -- 172.21.15.92:0/2134421247 shutdown_connections 2024-09-19T09:10:23.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.189+0000 7fddb1e63740 1 --2- 172.21.15.92:0/2134421247 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5630d2d223a0 0x5630d2d24790 crc :-1 s=READY pgs=410 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:23.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.189+0000 7fdd87fff640 0 client.27730 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:23.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.189+0000 7fddb1e63740 1 --2- 172.21.15.92:0/2134421247 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630d2d12370 0x5630d2d1e240 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:23.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.189+0000 7fddb1e63740 1 --2- 172.21.15.92:0/2134421247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630d2d0d2e0 0x5630d2d17200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:23.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.189+0000 7fddb1e63740 1 --2- 172.21.15.92:0/2134421247 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630d2d0c9a0 0x5630d2d16cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:23.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.189+0000 7fddb1e63740 1 -- 172.21.15.92:0/2134421247 >> 172.21.15.92:0/2134421247 conn(0x5630d2d08010 msgr2=0x5630d2d09820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:23.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.190+0000 7fddb1e63740 1 -- 172.21.15.92:0/2134421247 shutdown_connections 2024-09-19T09:10:23.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.190+0000 7fddb1e63740 1 -- 172.21.15.92:0/2134421247 wait complete. 2024-09-19T09:10:23.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.190+0000 7fddb1e63740 20 client.27730 trim_cache size 0 max 16384 2024-09-19T09:10:23.210 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.207+0000 7fddb1e63740 1 Processor -- start 2024-09-19T09:10:23.210 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.207+0000 7fddb1e63740 1 -- start start 2024-09-19T09:10:23.210 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.207+0000 7fddb1e63740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630d2d0c9a0 0x5630d2d15f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:23.210 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.207+0000 7fddb1e63740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630d2d0d2e0 0x5630d2d1e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:23.210 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.207+0000 7fddb1e63740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630d2d12370 0x5630d2d08ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:23.210 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.207+0000 7fddb1e63740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdda81be310 con 0x5630d2d0d2e0 2024-09-19T09:10:23.211 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.207+0000 7fddb1e63740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdda81c0bb0 con 0x5630d2d12370 2024-09-19T09:10:23.211 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.207+0000 7fddb1e63740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fdda81be9a0 con 0x5630d2d0c9a0 2024-09-19T09:10:23.211 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.208+0000 7fdda7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630d2d0d2e0 0x5630d2d1e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:23.211 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.208+0000 7fdda7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630d2d0d2e0 0x5630d2d1e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42176/0 (socket says 172.21.15.92:42176) 2024-09-19T09:10:23.211 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.208+0000 7fdda7fff640 1 -- 172.21.15.92:0/3233525552 learned_addr learned my addr 172.21.15.92:0/3233525552 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:23.211 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.208+0000 7fddad58e640 1 --2- 172.21.15.92:0/3233525552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630d2d12370 0x5630d2d08ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:23.211 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.208+0000 7fddacd8d640 1 --2- 172.21.15.92:0/3233525552 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630d2d0c9a0 0x5630d2d15f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:23.211 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.208+0000 7fddad58e640 1 -- 172.21.15.92:0/3233525552 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630d2d0c9a0 msgr2=0x5630d2d15f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:23.211 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.208+0000 7fddad58e640 1 --2- 172.21.15.92:0/3233525552 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630d2d0c9a0 0x5630d2d15f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:23.211 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.208+0000 7fddad58e640 1 -- 172.21.15.92:0/3233525552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630d2d0d2e0 msgr2=0x5630d2d1e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.208+0000 7fddad58e640 1 --2- 172.21.15.92:0/3233525552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630d2d0d2e0 0x5630d2d1e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.208+0000 7fddad58e640 1 -- 172.21.15.92:0/3233525552 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630d2d032d0 con 0x5630d2d12370 2024-09-19T09:10:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.208+0000 7fdda7fff640 1 --2- 172.21.15.92:0/3233525552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630d2d0d2e0 0x5630d2d1e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:10:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.208+0000 7fddad58e640 1 --2- 172.21.15.92:0/3233525552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630d2d12370 0x5630d2d08ec0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fdda0008330 tx=0x7fdda004c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7b86515370aa67b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.208+0000 7fdd9e7fc640 1 -- 172.21.15.92:0/3233525552 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda005b060 con 0x5630d2d12370 2024-09-19T09:10:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.208+0000 7fdd9e7fc640 1 -- 172.21.15.92:0/3233525552 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdda0004f80 con 0x5630d2d12370 2024-09-19T09:10:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.208+0000 7fdd9e7fc640 1 -- 172.21.15.92:0/3233525552 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda003eb80 con 0x5630d2d12370 2024-09-19T09:10:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.209+0000 7fddb1e63740 1 -- 172.21.15.92:0/3233525552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630d2d12370 msgr2=0x5630d2d08ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.209+0000 7fddb1e63740 1 --2- 172.21.15.92:0/3233525552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630d2d12370 0x5630d2d08ec0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fdda0008330 tx=0x7fdda004c000 comp rx=0 tx=0).stop 2024-09-19T09:10:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.209+0000 7fddb1e63740 1 -- 172.21.15.92:0/3233525552 shutdown_connections 2024-09-19T09:10:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.209+0000 7fddb1e63740 1 --2- 172.21.15.92:0/3233525552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630d2d12370 0x5630d2d08ec0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.209+0000 7fddb1e63740 1 --2- 172.21.15.92:0/3233525552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630d2d0d2e0 0x5630d2d1e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.209+0000 7fddb1e63740 1 --2- 172.21.15.92:0/3233525552 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630d2d0c9a0 0x5630d2d15f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:23.213 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.209+0000 7fddb1e63740 1 -- 172.21.15.92:0/3233525552 >> 172.21.15.92:0/3233525552 conn(0x5630d2d08010 msgr2=0x5630d2d15810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:23.213 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.209+0000 7fddb1e63740 1 -- 172.21.15.92:0/3233525552 shutdown_connections 2024-09-19T09:10:23.213 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.209+0000 7fddb1e63740 1 -- 172.21.15.92:0/3233525552 wait complete. 2024-09-19T09:10:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.210+0000 7fddb1e63740 1 -- start start 2024-09-19T09:10:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.210+0000 7fddb1e63740 1 Processor -- start 2024-09-19T09:10:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.210+0000 7fddb1e63740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630d2d0c9a0 0x5630d2d1b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.210+0000 7fddb1e63740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630d2d0d2e0 0x5630d2d1b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.210+0000 7fddb1e63740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630d2d12370 0x5630d2d8af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.210+0000 7fddb1e63740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdda81bf070 con 0x5630d2d0c9a0 2024-09-19T09:10:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.210+0000 7fddb1e63740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdda81c04e0 con 0x5630d2d0d2e0 2024-09-19T09:10:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.210+0000 7fddb1e63740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fdda81bf740 con 0x5630d2d12370 2024-09-19T09:10:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.210+0000 7fddb1e63740 10 client.0 _ll_register_callbacks cb 0x7fdd90005f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:10:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.210+0000 7fddacd8d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630d2d0c9a0 0x5630d2d1b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.211+0000 7fddacd8d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630d2d0c9a0 0x5630d2d1b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42186/0 (socket says 172.21.15.92:42186) 2024-09-19T09:10:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.211+0000 7fddacd8d640 1 -- 172.21.15.92:0/2600071928 learned_addr learned my addr 172.21.15.92:0/2600071928 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.211+0000 7fdda7fff640 1 --2- 172.21.15.92:0/2600071928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630d2d0d2e0 0x5630d2d1b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.211+0000 7fddad58e640 1 --2- 172.21.15.92:0/2600071928 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630d2d12370 0x5630d2d8af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.211+0000 7fddacd8d640 1 -- 172.21.15.92:0/2600071928 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630d2d12370 msgr2=0x5630d2d8af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.211+0000 7fddacd8d640 1 --2- 172.21.15.92:0/2600071928 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630d2d12370 0x5630d2d8af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.211+0000 7fddacd8d640 1 -- 172.21.15.92:0/2600071928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630d2d0d2e0 msgr2=0x5630d2d1b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.211+0000 7fddacd8d640 1 --2- 172.21.15.92:0/2600071928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630d2d0d2e0 0x5630d2d1b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.211+0000 7fddacd8d640 1 -- 172.21.15.92:0/2600071928 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630d2d8b540 con 0x5630d2d0c9a0 2024-09-19T09:10:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.211+0000 7fddacd8d640 1 --2- 172.21.15.92:0/2600071928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630d2d0c9a0 0x5630d2d1b1b0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fdd98009ab0 tx=0x7fdd9809b530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f919c79c34f092 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.211+0000 7fdd87fff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:10:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.211+0000 7fdd87fff640 1 -- 172.21.15.92:0/2600071928 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd98044040 con 0x5630d2d0c9a0 2024-09-19T09:10:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.211+0000 7fdd87fff640 1 -- 172.21.15.92:0/2600071928 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fdd98004860 con 0x5630d2d0c9a0 2024-09-19T09:10:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.211+0000 7fddb1e63740 1 -- 172.21.15.92:0/2600071928 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdda0004f80 con 0x5630d2d0c9a0 2024-09-19T09:10:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.211+0000 7fdd87fff640 1 -- 172.21.15.92:0/2600071928 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fdd98009c60 con 0x5630d2d0c9a0 2024-09-19T09:10:23.218 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.211+0000 7fddb1e63740 10 client.18618 fetch_fsmap learned FSMap version 19 2024-09-19T09:10:23.218 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.211+0000 7fddb1e63740 1 -- 172.21.15.92:0/2600071928 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5630d2d8c8c0 con 0x5630d2d0c9a0 2024-09-19T09:10:23.218 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.212+0000 7fdd87fff640 1 -- 172.21.15.92:0/2600071928 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdda0004f80 con 0x5630d2d0c9a0 2024-09-19T09:10:23.218 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.212+0000 7fdd87fff640 1 -- 172.21.15.92:0/2600071928 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fdd98004bf0 con 0x5630d2d0c9a0 2024-09-19T09:10:23.218 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.212+0000 7fddb1e63740 10 client.18618 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:10:23.218 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.212+0000 7fddb1e63740 10 client.18618 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:10:23.218 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.212+0000 7fddb1e63740 20 client.18618 populate_metadata read hostname 'smithi092' 2024-09-19T09:10:23.218 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.212+0000 7fddb1e63740 1 --2- 172.21.15.92:0/2600071928 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5630d2d223a0 0x5630d2d8f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:23.218 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.212+0000 7fddb1e63740 4 client.18618 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:10:23.218 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.212+0000 7fddb1e63740 1 -- 172.21.15.92:0/2600071928 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5630d2c77d70 con 0x5630d2d223a0 2024-09-19T09:10:23.218 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.213+0000 7fdda7fff640 1 --2- 172.21.15.92:0/2600071928 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5630d2d223a0 0x5630d2d8f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:23.218 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.213+0000 7fdda7fff640 1 --2- 172.21.15.92:0/2600071928 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5630d2d223a0 0x5630d2d8f290 crc :-1 s=READY pgs=411 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd1e28cd999d0b52 server_cookie=a364ae28403b845a in_seq=0 out_seq=0 2024-09-19T09:10:23.219 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.213+0000 7fdd87fff640 10 client.18618 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:23.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.233+0000 7fdd87fff640 1 -- 172.21.15.92:0/2600071928 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5630d2c77d70 con 0x5630d2d223a0 2024-09-19T09:10:23.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.233+0000 7fdd87fff640 10 client.18618 handle_command_reply: tid=0 2024-09-19T09:10:23.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.233+0000 7fddb1e63740 1 client.18618 shutdown 2024-09-19T09:10:23.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.233+0000 7fddb1e63740 1 -- 172.21.15.92:0/2600071928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630d2d0c9a0 msgr2=0x5630d2d1b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:23.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.233+0000 7fddb1e63740 1 --2- 172.21.15.92:0/2600071928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630d2d0c9a0 0x5630d2d1b1b0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fdd98009ab0 tx=0x7fdd9809b530 comp rx=0 tx=0).stop 2024-09-19T09:10:23.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.234+0000 7fddb1e63740 1 -- 172.21.15.92:0/2600071928 shutdown_connections 2024-09-19T09:10:23.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.234+0000 7fddb1e63740 1 --2- 172.21.15.92:0/2600071928 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5630d2d223a0 0x5630d2d8f290 crc :-1 s=READY pgs=411 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:23.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.234+0000 7fddb1e63740 1 --2- 172.21.15.92:0/2600071928 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630d2d12370 0x5630d2d8af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:23.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.234+0000 7fddb1e63740 1 --2- 172.21.15.92:0/2600071928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630d2d0d2e0 0x5630d2d1b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:23.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.234+0000 7fddb1e63740 1 --2- 172.21.15.92:0/2600071928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630d2d0c9a0 0x5630d2d1b1b0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:23.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.234+0000 7fddb1e63740 1 -- 172.21.15.92:0/2600071928 >> 172.21.15.92:0/2600071928 conn(0x5630d2d08010 msgr2=0x5630d2d16030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:23.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.234+0000 7fdd87fff640 0 client.18618 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:23.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.234+0000 7fddb1e63740 1 -- 172.21.15.92:0/2600071928 shutdown_connections 2024-09-19T09:10:23.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.234+0000 7fddb1e63740 1 -- 172.21.15.92:0/2600071928 wait complete. 2024-09-19T09:10:23.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.234+0000 7fddb1e63740 20 client.18618 trim_cache size 0 max 16384 2024-09-19T09:10:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:10:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:10:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:10:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:10:23.237 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.235+0000 7fddaeff1640 1 -- 172.21.15.92:0/1897286893 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdd940a3300 msgr2=0x7fdd940a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:23.237 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.235+0000 7fddaeff1640 1 --2- 172.21.15.92:0/1897286893 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdd940a3300 0x7fdd940a57c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fdda0005ab0 tx=0x7fdda003e000 comp rx=0 tx=0).stop 2024-09-19T09:10:23.237 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.235+0000 7fddaeff1640 1 -- 172.21.15.92:0/1897286893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdda8073730 msgr2=0x7fdda81181a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:23.237 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.235+0000 7fddaeff1640 1 --2- 172.21.15.92:0/1897286893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdda8073730 0x7fdda81181a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fdd9800bed0 tx=0x7fdd980095b0 comp rx=0 tx=0).stop 2024-09-19T09:10:23.237 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.235+0000 7fddaeff1640 1 -- 172.21.15.92:0/1897286893 shutdown_connections 2024-09-19T09:10:23.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.235+0000 7fddaeff1640 1 --2- 172.21.15.92:0/1897286893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdda810a150 0x7fdda8119720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:23.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.235+0000 7fddaeff1640 1 --2- 172.21.15.92:0/1897286893 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdd940a3300 0x7fdd940a57c0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:23.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.235+0000 7fddaeff1640 1 --2- 172.21.15.92:0/1897286893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdda8109790 0x7fdda81186e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:23.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.235+0000 7fddaeff1640 1 --2- 172.21.15.92:0/1897286893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdda8073730 0x7fdda81181a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:23.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.235+0000 7fddaeff1640 1 -- 172.21.15.92:0/1897286893 >> 172.21.15.92:0/1897286893 conn(0x7fdda806ef20 msgr2=0x7fdda810ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:23.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.236+0000 7fddaeff1640 1 -- 172.21.15.92:0/1897286893 shutdown_connections 2024-09-19T09:10:23.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:23.236+0000 7fddaeff1640 1 -- 172.21.15.92:0/1897286893 wait complete. 2024-09-19T09:10:25.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:24 smithi092 ceph-mon[31407]: pgmap v748: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 17 MiB/s wr, 865 op/s 2024-09-19T09:10:25.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:24 smithi167 ceph-mon[35359]: pgmap v748: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 17 MiB/s wr, 865 op/s 2024-09-19T09:10:25.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:24 smithi190 ceph-mon[35358]: pgmap v748: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 17 MiB/s wr, 865 op/s 2024-09-19T09:10:25.795 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 820.0 s, 1963.2 tps, lat 50.752 ms stddev 58.646 2024-09-19T09:10:27.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:26 smithi092 ceph-mon[31407]: pgmap v749: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 14 MiB/s wr, 830 op/s 2024-09-19T09:10:27.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:26 smithi167 ceph-mon[35359]: pgmap v749: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 14 MiB/s wr, 830 op/s 2024-09-19T09:10:27.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:26 smithi190 ceph-mon[35358]: pgmap v749: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 14 MiB/s wr, 830 op/s 2024-09-19T09:10:29.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:28 smithi092 ceph-mon[31407]: pgmap v750: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 14 MiB/s wr, 791 op/s 2024-09-19T09:10:29.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:28 smithi167 ceph-mon[35359]: pgmap v750: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 14 MiB/s wr, 791 op/s 2024-09-19T09:10:29.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:28 smithi190 ceph-mon[35358]: pgmap v750: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 14 MiB/s wr, 791 op/s 2024-09-19T09:10:30.795 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 825.0 s, 2096.8 tps, lat 47.727 ms stddev 54.388 2024-09-19T09:10:31.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:30 smithi092 ceph-mon[31407]: pgmap v751: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 14 MiB/s wr, 790 op/s 2024-09-19T09:10:31.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:30 smithi167 ceph-mon[35359]: pgmap v751: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 14 MiB/s wr, 790 op/s 2024-09-19T09:10:31.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:30 smithi190 ceph-mon[35358]: pgmap v751: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 14 MiB/s wr, 790 op/s 2024-09-19T09:10:33.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:32 smithi092 ceph-mon[31407]: pgmap v752: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 835 op/s 2024-09-19T09:10:33.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:32 smithi167 ceph-mon[35359]: pgmap v752: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 835 op/s 2024-09-19T09:10:33.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:32 smithi190 ceph-mon[35358]: pgmap v752: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 835 op/s 2024-09-19T09:10:35.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:34 smithi092 ceph-mon[31407]: pgmap v753: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 25 MiB/s wr, 1.19k op/s 2024-09-19T09:10:35.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:34 smithi167 ceph-mon[35359]: pgmap v753: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 25 MiB/s wr, 1.19k op/s 2024-09-19T09:10:35.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:34 smithi190 ceph-mon[35358]: pgmap v753: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 25 MiB/s wr, 1.19k op/s 2024-09-19T09:10:35.795 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 830.0 s, 1817.4 tps, lat 54.560 ms stddev 87.224 2024-09-19T09:10:36.346 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.345+0000 7ffa3759d640 1 -- 172.21.15.92:0/3243021908 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa301003b0 msgr2=0x7ffa30109f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:36.346 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.345+0000 7ffa3759d640 1 --2- 172.21.15.92:0/3243021908 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa301003b0 0x7ffa30109f60 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7ffa28009ca0 tx=0x7ffa2802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:10:36.347 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.346+0000 7ffa3759d640 1 -- 172.21.15.92:0/3243021908 shutdown_connections 2024-09-19T09:10:36.347 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.346+0000 7ffa3759d640 1 --2- 172.21.15.92:0/3243021908 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa301003b0 0x7ffa30109f60 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:36.347 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.346+0000 7ffa3759d640 1 --2- 172.21.15.92:0/3243021908 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa300ff9f0 0x7ffa300ffe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:36.347 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.346+0000 7ffa3759d640 1 --2- 172.21.15.92:0/3243021908 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa30102f80 0x7ffa30103380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:36.347 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.346+0000 7ffa3759d640 1 -- 172.21.15.92:0/3243021908 >> 172.21.15.92:0/3243021908 conn(0x7ffa300fb740 msgr2=0x7ffa300fdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:36.347 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.346+0000 7ffa3759d640 1 -- 172.21.15.92:0/3243021908 shutdown_connections 2024-09-19T09:10:36.347 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.346+0000 7ffa3759d640 1 -- 172.21.15.92:0/3243021908 wait complete. 2024-09-19T09:10:36.349 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.347+0000 7ffa3759d640 1 Processor -- start 2024-09-19T09:10:36.349 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.347+0000 7ffa3759d640 1 -- start start 2024-09-19T09:10:36.349 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.347+0000 7ffa3759d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa300ff9f0 0x7ffa30070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:36.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.347+0000 7ffa3759d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa301003b0 0x7ffa300710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:36.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.347+0000 7ffa3759d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa30102f80 0x7ffa301a7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:36.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.347+0000 7ffa3759d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3010d5c0 con 0x7ffa300ff9f0 2024-09-19T09:10:36.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.347+0000 7ffa3759d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3010d440 con 0x7ffa301003b0 2024-09-19T09:10:36.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.347+0000 7ffa3759d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3010d740 con 0x7ffa30102f80 2024-09-19T09:10:36.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.347+0000 7ffa3659b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa300ff9f0 0x7ffa30070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:36.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.347+0000 7ffa3659b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa300ff9f0 0x7ffa30070b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39108/0 (socket says 172.21.15.92:39108) 2024-09-19T09:10:36.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.347+0000 7ffa3659b640 1 -- 172.21.15.92:0/3414941920 learned_addr learned my addr 172.21.15.92:0/3414941920 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:36.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.347+0000 7ffa35d9a640 1 --2- 172.21.15.92:0/3414941920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa301003b0 0x7ffa300710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:36.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.347+0000 7ffa36d9c640 1 --2- 172.21.15.92:0/3414941920 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa30102f80 0x7ffa301a7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:36.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.348+0000 7ffa3659b640 1 -- 172.21.15.92:0/3414941920 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa30102f80 msgr2=0x7ffa301a7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:36.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.348+0000 7ffa3659b640 1 --2- 172.21.15.92:0/3414941920 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa30102f80 0x7ffa301a7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:36.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.348+0000 7ffa3659b640 1 -- 172.21.15.92:0/3414941920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa301003b0 msgr2=0x7ffa300710c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:36.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.348+0000 7ffa3659b640 1 --2- 172.21.15.92:0/3414941920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa301003b0 0x7ffa300710c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:36.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.348+0000 7ffa3659b640 1 -- 172.21.15.92:0/3414941920 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa301a8210 con 0x7ffa300ff9f0 2024-09-19T09:10:36.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.348+0000 7ffa3659b640 1 --2- 172.21.15.92:0/3414941920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa300ff9f0 0x7ffa30070b80 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c00e9c0 tx=0x7ffa2c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:36.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.348+0000 7ffa277fe640 1 -- 172.21.15.92:0/3414941920 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c00cd80 con 0x7ffa300ff9f0 2024-09-19T09:10:36.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.348+0000 7ffa277fe640 1 -- 172.21.15.92:0/3414941920 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa2c0035f0 con 0x7ffa300ff9f0 2024-09-19T09:10:36.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.348+0000 7ffa277fe640 1 -- 172.21.15.92:0/3414941920 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c010690 con 0x7ffa300ff9f0 2024-09-19T09:10:36.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.348+0000 7ffa3759d640 1 -- 172.21.15.92:0/3414941920 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa301a83e0 con 0x7ffa300ff9f0 2024-09-19T09:10:36.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.348+0000 7ffa3759d640 1 -- 172.21.15.92:0/3414941920 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa301a8850 con 0x7ffa300ff9f0 2024-09-19T09:10:36.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.351+0000 7ffa3b66e740 1 Processor -- start 2024-09-19T09:10:36.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.351+0000 7ffa3b66e740 1 -- start start 2024-09-19T09:10:36.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.351+0000 7ffa3b66e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d324fe3b70 0x55d324fe3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:36.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.351+0000 7ffa3b66e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d324fe44b0 0x55d324fe8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.351+0000 7ffa3b66e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d324fe9540 0x55d324feba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.351+0000 7ffa3b66e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d324f472f0 con 0x55d324fe3b70 2024-09-19T09:10:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.351+0000 7ffa3b66e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d324eef270 con 0x55d324fe9540 2024-09-19T09:10:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.351+0000 7ffa3b66e740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55d324f432b0 con 0x55d324fe44b0 2024-09-19T09:10:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.352+0000 7ffa35d9a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d324fe9540 0x55d324feba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.352+0000 7ffa35d9a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d324fe9540 0x55d324feba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:52992/0 (socket says 172.21.15.92:52992) 2024-09-19T09:10:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.352+0000 7ffa35d9a640 1 -- 172.21.15.92:0/2815570809 learned_addr learned my addr 172.21.15.92:0/2815570809 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:36.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.352+0000 7ffa277fe640 1 -- 172.21.15.92:0/3414941920 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ffa2c004020 con 0x7ffa300ff9f0 2024-09-19T09:10:36.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.353+0000 7ffa36d9c640 1 --2- 172.21.15.92:0/2815570809 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d324fe3b70 0x55d324fe3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:36.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.353+0000 7ffa35d9a640 1 -- 172.21.15.92:0/2815570809 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d324fe44b0 msgr2=0x55d324fe8f70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:10:36.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.353+0000 7ffa35d9a640 1 --2- 172.21.15.92:0/2815570809 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d324fe44b0 0x55d324fe8f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:36.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.353+0000 7ffa35d9a640 1 -- 172.21.15.92:0/2815570809 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d324fe3b70 msgr2=0x55d324fe3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:36.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.353+0000 7ffa35d9a640 1 --2- 172.21.15.92:0/2815570809 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d324fe3b70 0x55d324fe3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:36.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.353+0000 7ffa35d9a640 1 -- 172.21.15.92:0/2815570809 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d324eee340 con 0x55d324fe9540 2024-09-19T09:10:36.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.353+0000 7ffa36d9c640 1 --2- 172.21.15.92:0/2815570809 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d324fe3b70 0x55d324fe3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:10:36.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.353+0000 7ffa277fe640 1 --2- 172.21.15.92:0/3414941920 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffa1c0a32c0 0x7ffa1c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:36.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.353+0000 7ffa35d9a640 1 --2- 172.21.15.92:0/2815570809 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d324fe9540 0x55d324feba00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ffa20015c90 tx=0x7ffa20009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2565e091f187d4f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:36.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.353+0000 7ffa36d9c640 1 --2- 172.21.15.92:0/3414941920 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffa1c0a32c0 0x7ffa1c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:36.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.353+0000 7ffa24ff9640 1 -- 172.21.15.92:0/2815570809 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2000fba0 con 0x55d324fe9540 2024-09-19T09:10:36.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.353+0000 7ffa277fe640 1 -- 172.21.15.92:0/3414941920 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ffa2c0cfd40 con 0x7ffa300ff9f0 2024-09-19T09:10:36.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.353+0000 7ffa24ff9640 1 -- 172.21.15.92:0/2815570809 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa20009e10 con 0x55d324fe9540 2024-09-19T09:10:36.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.353+0000 7ffa24ff9640 1 -- 172.21.15.92:0/2815570809 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa20015680 con 0x55d324fe9540 2024-09-19T09:10:36.358 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.354+0000 7ffa3b66e740 1 -- 172.21.15.92:0/2815570809 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d324fe9540 msgr2=0x55d324feba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:36.358 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.354+0000 7ffa36d9c640 1 --2- 172.21.15.92:0/3414941920 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffa1c0a32c0 0x7ffa1c0a5780 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ffa28005e30 tx=0x7ffa2803d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:36.358 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.354+0000 7ffa3b66e740 1 --2- 172.21.15.92:0/2815570809 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d324fe9540 0x55d324feba00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ffa20015c90 tx=0x7ffa20009c20 comp rx=0 tx=0).stop 2024-09-19T09:10:36.358 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.354+0000 7ffa3b66e740 1 -- 172.21.15.92:0/2815570809 shutdown_connections 2024-09-19T09:10:36.358 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.354+0000 7ffa3b66e740 1 --2- 172.21.15.92:0/2815570809 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d324fe9540 0x55d324feba00 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:36.358 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.354+0000 7ffa3b66e740 1 --2- 172.21.15.92:0/2815570809 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d324fe44b0 0x55d324fe8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:36.358 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.354+0000 7ffa3b66e740 1 --2- 172.21.15.92:0/2815570809 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d324fe3b70 0x55d324fe3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:36.358 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.354+0000 7ffa3b66e740 1 -- 172.21.15.92:0/2815570809 >> 172.21.15.92:0/2815570809 conn(0x55d324fdf1e0 msgr2=0x55d324fdf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:36.358 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.355+0000 7ffa3b66e740 1 -- 172.21.15.92:0/2815570809 shutdown_connections 2024-09-19T09:10:36.358 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.355+0000 7ffa3b66e740 1 -- 172.21.15.92:0/2815570809 wait complete. 2024-09-19T09:10:36.358 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.355+0000 7ffa3b66e740 1 -- start start 2024-09-19T09:10:36.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.355+0000 7ffa3b66e740 1 Processor -- start 2024-09-19T09:10:36.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.355+0000 7ffa3b66e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d324fe3b70 0x55d324feddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:36.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.355+0000 7ffa3b66e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d324fe44b0 0x55d324fee330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:36.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.355+0000 7ffa3b66e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d324fe9540 0x55d324ff5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:36.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.355+0000 7ffa3b66e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d324fec510 con 0x55d324fe3b70 2024-09-19T09:10:36.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.355+0000 7ffa3b66e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d324ed0290 con 0x55d324fe9540 2024-09-19T09:10:36.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.355+0000 7ffa3b66e740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55d324fec690 con 0x55d324fe44b0 2024-09-19T09:10:36.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.355+0000 7ffa3b66e740 10 client.0 _ll_register_callbacks cb 0x55d324f01140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:10:36.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.355+0000 7ffa36d9c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d324fe9540 0x55d324ff5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:36.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.355+0000 7ffa35d9a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d324fe44b0 0x55d324fee330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:36.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.355+0000 7ffa36d9c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d324fe9540 0x55d324ff5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:53000/0 (socket says 172.21.15.92:53000) 2024-09-19T09:10:36.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.355+0000 7ffa36d9c640 1 -- 172.21.15.92:0/4216145048 learned_addr learned my addr 172.21.15.92:0/4216145048 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:36.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.355+0000 7ffa3659b640 1 --2- 172.21.15.92:0/4216145048 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d324fe3b70 0x55d324feddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:36.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.356+0000 7ffa36d9c640 1 -- 172.21.15.92:0/4216145048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d324fe44b0 msgr2=0x55d324fee330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:36.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.356+0000 7ffa36d9c640 1 --2- 172.21.15.92:0/4216145048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d324fe44b0 0x55d324fee330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:36.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.356+0000 7ffa36d9c640 1 -- 172.21.15.92:0/4216145048 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d324fe3b70 msgr2=0x55d324feddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:36.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.356+0000 7ffa36d9c640 1 --2- 172.21.15.92:0/4216145048 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d324fe3b70 0x55d324feddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:36.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.356+0000 7ffa36d9c640 1 -- 172.21.15.92:0/4216145048 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d324c5a210 con 0x55d324fe9540 2024-09-19T09:10:36.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.356+0000 7ffa35d9a640 1 --2- 172.21.15.92:0/4216145048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d324fe44b0 0x55d324fee330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:10:36.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.356+0000 7ffa36d9c640 1 --2- 172.21.15.92:0/4216145048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d324fe9540 0x55d324ff5370 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ffa28035000 tx=0x7ffa2802a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95e01e7802629bf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:36.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.356+0000 7ffa19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:10:36.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.357+0000 7ffa19ffb640 1 -- 172.21.15.92:0/4216145048 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa28003e00 con 0x55d324fe9540 2024-09-19T09:10:36.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.357+0000 7ffa19ffb640 1 -- 172.21.15.92:0/4216145048 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ffa280046d0 con 0x55d324fe9540 2024-09-19T09:10:36.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.357+0000 7ffa3b66e740 1 -- 172.21.15.92:0/4216145048 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa20009e10 con 0x55d324fe9540 2024-09-19T09:10:36.362 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.358+0000 7ffa19ffb640 1 -- 172.21.15.92:0/4216145048 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ffa2802f610 con 0x55d324fe9540 2024-09-19T09:10:36.362 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.358+0000 7ffa3b66e740 10 client.27845 fetch_fsmap learned FSMap version 19 2024-09-19T09:10:36.362 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.358+0000 7ffa3b66e740 1 -- 172.21.15.92:0/4216145048 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55d324d26620 con 0x55d324fe9540 2024-09-19T09:10:36.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.358+0000 7ffa19ffb640 1 -- 172.21.15.92:0/4216145048 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa20009e10 con 0x55d324fe9540 2024-09-19T09:10:36.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.358+0000 7ffa19ffb640 1 -- 172.21.15.92:0/4216145048 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ffa28030760 con 0x55d324fe9540 2024-09-19T09:10:36.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.358+0000 7ffa3b66e740 10 client.27845 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:10:36.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.358+0000 7ffa3b66e740 10 client.27845 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:10:36.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.359+0000 7ffa3b66e740 20 client.27845 populate_metadata read hostname 'smithi092' 2024-09-19T09:10:36.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.359+0000 7ffa3b66e740 1 --2- 172.21.15.92:0/4216145048 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d324ff9ab0 0x55d324ffbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:36.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.359+0000 7ffa3b66e740 4 client.27845 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:10:36.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.359+0000 7ffa3b66e740 1 -- 172.21.15.92:0/4216145048 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d324f54a20 con 0x55d324ff9ab0 2024-09-19T09:10:36.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.359+0000 7ffa3659b640 1 --2- 172.21.15.92:0/4216145048 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d324ff9ab0 0x55d324ffbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:36.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.359+0000 7ffa19ffb640 10 client.27845 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:36.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.359+0000 7ffa3659b640 1 --2- 172.21.15.92:0/4216145048 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d324ff9ab0 0x55d324ffbec0 crc :-1 s=READY pgs=412 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1de8e816d4173bfb server_cookie=62472c80545a0a0d in_seq=0 out_seq=0 2024-09-19T09:10:36.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.360+0000 7ffa19ffb640 1 -- 172.21.15.92:0/4216145048 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d324f54a20 con 0x55d324ff9ab0 2024-09-19T09:10:36.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.360+0000 7ffa19ffb640 10 client.27845 handle_command_reply: tid=0 2024-09-19T09:10:36.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.360+0000 7ffa3b66e740 1 client.27845 shutdown 2024-09-19T09:10:36.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.360+0000 7ffa3b66e740 1 -- 172.21.15.92:0/4216145048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d324fe9540 msgr2=0x55d324ff5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:36.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.360+0000 7ffa3b66e740 1 --2- 172.21.15.92:0/4216145048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d324fe9540 0x55d324ff5370 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ffa28035000 tx=0x7ffa2802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:10:36.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.360+0000 7ffa3b66e740 1 -- 172.21.15.92:0/4216145048 shutdown_connections 2024-09-19T09:10:36.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.360+0000 7ffa3b66e740 1 --2- 172.21.15.92:0/4216145048 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d324ff9ab0 0x55d324ffbec0 crc :-1 s=READY pgs=412 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:36.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.360+0000 7ffa19ffb640 0 client.27845 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:36.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.360+0000 7ffa3b66e740 1 --2- 172.21.15.92:0/4216145048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d324fe9540 0x55d324ff5370 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:36.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.360+0000 7ffa3b66e740 1 --2- 172.21.15.92:0/4216145048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d324fe44b0 0x55d324fee330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:36.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.360+0000 7ffa3b66e740 1 --2- 172.21.15.92:0/4216145048 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d324fe3b70 0x55d324feddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:36.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.360+0000 7ffa3b66e740 1 -- 172.21.15.92:0/4216145048 >> 172.21.15.92:0/4216145048 conn(0x55d324fdf1e0 msgr2=0x55d324fe09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:36.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.364+0000 7ffa3b66e740 1 -- 172.21.15.92:0/4216145048 shutdown_connections 2024-09-19T09:10:36.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.365+0000 7ffa3b66e740 1 -- 172.21.15.92:0/4216145048 wait complete. 2024-09-19T09:10:36.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.365+0000 7ffa3b66e740 20 client.27845 trim_cache size 0 max 16384 2024-09-19T09:10:36.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.401+0000 7ffa3b66e740 1 Processor -- start 2024-09-19T09:10:36.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.401+0000 7ffa3b66e740 1 -- start start 2024-09-19T09:10:36.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.402+0000 7ffa3b66e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d324fe3b70 0x55d324feddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:36.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.402+0000 7ffa3b66e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d324fe44b0 0x55d324ff5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.402+0000 7ffa3b66e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d324fe9540 0x55d324fee330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.402+0000 7ffa3b66e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffa301ad5c0 con 0x55d324fe9540 2024-09-19T09:10:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.402+0000 7ffa3b66e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ffa301afe10 con 0x55d324fe44b0 2024-09-19T09:10:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.402+0000 7ffa3b66e740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ffa301adc50 con 0x55d324fe3b70 2024-09-19T09:10:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.402+0000 7ffa36d9c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d324fe9540 0x55d324fee330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.402+0000 7ffa36d9c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d324fe9540 0x55d324fee330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39134/0 (socket says 172.21.15.92:39134) 2024-09-19T09:10:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.402+0000 7ffa36d9c640 1 -- 172.21.15.92:0/2369480388 learned_addr learned my addr 172.21.15.92:0/2369480388 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.402+0000 7ffa35d9a640 1 --2- 172.21.15.92:0/2369480388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d324fe44b0 0x55d324ff5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.402+0000 7ffa3659b640 1 --2- 172.21.15.92:0/2369480388 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d324fe3b70 0x55d324feddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.402+0000 7ffa36d9c640 1 -- 172.21.15.92:0/2369480388 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d324fe3b70 msgr2=0x55d324feddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.402+0000 7ffa36d9c640 1 --2- 172.21.15.92:0/2369480388 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d324fe3b70 0x55d324feddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.402+0000 7ffa36d9c640 1 -- 172.21.15.92:0/2369480388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d324fe44b0 msgr2=0x55d324ff5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.402+0000 7ffa36d9c640 1 --2- 172.21.15.92:0/2369480388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d324fe44b0 0x55d324ff5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:36.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.402+0000 7ffa36d9c640 1 -- 172.21.15.92:0/2369480388 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d324fed930 con 0x55d324fe9540 2024-09-19T09:10:36.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.402+0000 7ffa36d9c640 1 --2- 172.21.15.92:0/2369480388 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d324fe9540 0x55d324fee330 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7ffa28005dc0 tx=0x7ffa2802f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac308d3e9e555f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.403+0000 7ffa1bfff640 1 -- 172.21.15.92:0/2369480388 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2805e070 con 0x55d324fe9540 2024-09-19T09:10:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.403+0000 7ffa1bfff640 1 -- 172.21.15.92:0/2369480388 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa28036040 con 0x55d324fe9540 2024-09-19T09:10:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.403+0000 7ffa1bfff640 1 -- 172.21.15.92:0/2369480388 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2802f7b0 con 0x55d324fe9540 2024-09-19T09:10:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.404+0000 7ffa3b66e740 1 -- 172.21.15.92:0/2369480388 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d324fe9540 msgr2=0x55d324fee330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.404+0000 7ffa3b66e740 1 --2- 172.21.15.92:0/2369480388 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d324fe9540 0x55d324fee330 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7ffa28005dc0 tx=0x7ffa2802f450 comp rx=0 tx=0).stop 2024-09-19T09:10:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.405+0000 7ffa3b66e740 1 -- 172.21.15.92:0/2369480388 shutdown_connections 2024-09-19T09:10:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.405+0000 7ffa3b66e740 1 --2- 172.21.15.92:0/2369480388 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d324fe9540 0x55d324fee330 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.405+0000 7ffa3b66e740 1 --2- 172.21.15.92:0/2369480388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d324fe44b0 0x55d324ff5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.405+0000 7ffa3b66e740 1 --2- 172.21.15.92:0/2369480388 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d324fe3b70 0x55d324feddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.405+0000 7ffa3b66e740 1 -- 172.21.15.92:0/2369480388 >> 172.21.15.92:0/2369480388 conn(0x55d324fdf1e0 msgr2=0x55d324fdf5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.405+0000 7ffa3b66e740 1 -- 172.21.15.92:0/2369480388 shutdown_connections 2024-09-19T09:10:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.405+0000 7ffa3b66e740 1 -- 172.21.15.92:0/2369480388 wait complete. 2024-09-19T09:10:36.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.405+0000 7ffa3b66e740 1 -- start start 2024-09-19T09:10:36.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.406+0000 7ffa3b66e740 1 Processor -- start 2024-09-19T09:10:36.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.406+0000 7ffa3b66e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d324fe3b70 0x55d324ff52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:36.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.406+0000 7ffa3b66e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d324fe44b0 0x55d324ff1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:36.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.406+0000 7ffa3b66e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d324fe9540 0x55d324ff23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:36.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.406+0000 7ffa3b66e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffa301ae2d0 con 0x55d324fe3b70 2024-09-19T09:10:36.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.406+0000 7ffa3b66e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ffa301af740 con 0x55d324fe9540 2024-09-19T09:10:36.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.406+0000 7ffa3659b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d324fe3b70 0x55d324ff52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:36.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.406+0000 7ffa3b66e740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ffa301ae9a0 con 0x55d324fe44b0 2024-09-19T09:10:36.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.406+0000 7ffa35d9a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d324fe44b0 0x55d324ff1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:36.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.406+0000 7ffa3659b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d324fe3b70 0x55d324ff52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39142/0 (socket says 172.21.15.92:39142) 2024-09-19T09:10:36.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.406+0000 7ffa3659b640 1 -- 172.21.15.92:0/1595014224 learned_addr learned my addr 172.21.15.92:0/1595014224 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:36.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.406+0000 7ffa3b66e740 10 client.0 _ll_register_callbacks cb 0x7ffa2c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:10:36.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.406+0000 7ffa36d9c640 1 --2- 172.21.15.92:0/1595014224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d324fe9540 0x55d324ff23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:36.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.407+0000 7ffa3659b640 1 -- 172.21.15.92:0/1595014224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d324fe44b0 msgr2=0x55d324ff1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:36.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.407+0000 7ffa3659b640 1 --2- 172.21.15.92:0/1595014224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d324fe44b0 0x55d324ff1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:36.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.407+0000 7ffa3659b640 1 -- 172.21.15.92:0/1595014224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d324fe9540 msgr2=0x55d324ff23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:36.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.407+0000 7ffa3659b640 1 --2- 172.21.15.92:0/1595014224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d324fe9540 0x55d324ff23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:36.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.407+0000 7ffa3659b640 1 -- 172.21.15.92:0/1595014224 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d32506b050 con 0x55d324fe3b70 2024-09-19T09:10:36.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.407+0000 7ffa35d9a640 1 --2- 172.21.15.92:0/1595014224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d324fe44b0 0x55d324ff1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:10:36.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.407+0000 7ffa3659b640 1 --2- 172.21.15.92:0/1595014224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d324fe3b70 0x55d324ff52f0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c00c6a0 tx=0x7ffa2c009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcb2e22395719fc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:36.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.407+0000 7ffa19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:10:36.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.407+0000 7ffa19ffb640 1 -- 172.21.15.92:0/1595014224 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c09c320 con 0x55d324fe3b70 2024-09-19T09:10:36.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.407+0000 7ffa19ffb640 1 -- 172.21.15.92:0/1595014224 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ffa2c0cd910 con 0x55d324fe3b70 2024-09-19T09:10:36.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.407+0000 7ffa3b66e740 1 -- 172.21.15.92:0/1595014224 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa28036040 con 0x55d324fe3b70 2024-09-19T09:10:36.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.407+0000 7ffa19ffb640 1 -- 172.21.15.92:0/1595014224 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ffa2c0a06d0 con 0x55d324fe3b70 2024-09-19T09:10:36.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.407+0000 7ffa3b66e740 10 client.18636 fetch_fsmap learned FSMap version 19 2024-09-19T09:10:36.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.407+0000 7ffa3b66e740 1 -- 172.21.15.92:0/1595014224 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55d32506c3b0 con 0x55d324fe3b70 2024-09-19T09:10:36.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.408+0000 7ffa19ffb640 1 -- 172.21.15.92:0/1595014224 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa28036040 con 0x55d324fe3b70 2024-09-19T09:10:36.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.408+0000 7ffa19ffb640 1 -- 172.21.15.92:0/1595014224 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ffa2c09b770 con 0x55d324fe3b70 2024-09-19T09:10:36.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.408+0000 7ffa3b66e740 10 client.18636 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:10:36.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.408+0000 7ffa3b66e740 10 client.18636 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:10:36.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.408+0000 7ffa3b66e740 20 client.18636 populate_metadata read hostname 'smithi092' 2024-09-19T09:10:36.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.408+0000 7ffa3b66e740 1 --2- 172.21.15.92:0/1595014224 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d324ff9ab0 0x55d32506ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:36.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.408+0000 7ffa3b66e740 4 client.18636 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:10:36.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.408+0000 7ffa3b66e740 1 -- 172.21.15.92:0/1595014224 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d324f4ed70 con 0x55d324ff9ab0 2024-09-19T09:10:36.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.408+0000 7ffa35d9a640 1 --2- 172.21.15.92:0/1595014224 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d324ff9ab0 0x55d32506ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:36.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.409+0000 7ffa35d9a640 1 --2- 172.21.15.92:0/1595014224 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d324ff9ab0 0x55d32506ed50 crc :-1 s=READY pgs=413 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9cce921508af815 server_cookie=6bc85075a9151944 in_seq=0 out_seq=0 2024-09-19T09:10:36.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.410+0000 7ffa19ffb640 10 client.18636 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:36.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.459+0000 7ffa19ffb640 1 -- 172.21.15.92:0/1595014224 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d324f4ed70 con 0x55d324ff9ab0 2024-09-19T09:10:36.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.460+0000 7ffa19ffb640 10 client.18636 handle_command_reply: tid=0 2024-09-19T09:10:36.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.460+0000 7ffa3b66e740 1 client.18636 shutdown 2024-09-19T09:10:36.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.460+0000 7ffa3b66e740 1 -- 172.21.15.92:0/1595014224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d324fe3b70 msgr2=0x55d324ff52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:36.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.460+0000 7ffa3b66e740 1 --2- 172.21.15.92:0/1595014224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d324fe3b70 0x55d324ff52f0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c00c6a0 tx=0x7ffa2c009740 comp rx=0 tx=0).stop 2024-09-19T09:10:36.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.460+0000 7ffa3b66e740 1 -- 172.21.15.92:0/1595014224 shutdown_connections 2024-09-19T09:10:36.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.460+0000 7ffa3b66e740 1 --2- 172.21.15.92:0/1595014224 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d324ff9ab0 0x55d32506ed50 crc :-1 s=READY pgs=413 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:36.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.460+0000 7ffa19ffb640 0 client.18636 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:36.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.460+0000 7ffa3b66e740 1 --2- 172.21.15.92:0/1595014224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d324fe9540 0x55d324ff23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:36.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.460+0000 7ffa3b66e740 1 --2- 172.21.15.92:0/1595014224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d324fe44b0 0x55d324ff1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:36.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.460+0000 7ffa3b66e740 1 --2- 172.21.15.92:0/1595014224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d324fe3b70 0x55d324ff52f0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:36.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.460+0000 7ffa3b66e740 1 -- 172.21.15.92:0/1595014224 >> 172.21.15.92:0/1595014224 conn(0x55d324fdf1e0 msgr2=0x55d324feddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:36.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.460+0000 7ffa3b66e740 1 -- 172.21.15.92:0/1595014224 shutdown_connections 2024-09-19T09:10:36.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.460+0000 7ffa3b66e740 1 -- 172.21.15.92:0/1595014224 wait complete. 2024-09-19T09:10:36.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.460+0000 7ffa3b66e740 20 client.18636 trim_cache size 0 max 16384 2024-09-19T09:10:36.463 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:10:36.463 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:10:36.463 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:10:36.463 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:10:36.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.460+0000 7ffa3759d640 1 -- 172.21.15.92:0/3414941920 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffa1c0a32c0 msgr2=0x7ffa1c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:36.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.460+0000 7ffa3759d640 1 --2- 172.21.15.92:0/3414941920 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffa1c0a32c0 0x7ffa1c0a5780 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ffa28005e30 tx=0x7ffa2803d040 comp rx=0 tx=0).stop 2024-09-19T09:10:36.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.460+0000 7ffa3759d640 1 -- 172.21.15.92:0/3414941920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa300ff9f0 msgr2=0x7ffa30070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:36.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.460+0000 7ffa3759d640 1 --2- 172.21.15.92:0/3414941920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa300ff9f0 0x7ffa30070b80 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c00e9c0 tx=0x7ffa2c00ee80 comp rx=0 tx=0).stop 2024-09-19T09:10:36.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.461+0000 7ffa3759d640 1 -- 172.21.15.92:0/3414941920 shutdown_connections 2024-09-19T09:10:36.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.461+0000 7ffa3759d640 1 --2- 172.21.15.92:0/3414941920 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa30102f80 0x7ffa301a7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:36.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.461+0000 7ffa3759d640 1 --2- 172.21.15.92:0/3414941920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa301003b0 0x7ffa300710c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:36.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.461+0000 7ffa3759d640 1 --2- 172.21.15.92:0/3414941920 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffa1c0a32c0 0x7ffa1c0a5780 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:36.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.461+0000 7ffa3759d640 1 --2- 172.21.15.92:0/3414941920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa300ff9f0 0x7ffa30070b80 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:36.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.461+0000 7ffa3759d640 1 -- 172.21.15.92:0/3414941920 >> 172.21.15.92:0/3414941920 conn(0x7ffa300fb740 msgr2=0x7ffa30106090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:36.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.461+0000 7ffa3759d640 1 -- 172.21.15.92:0/3414941920 shutdown_connections 2024-09-19T09:10:36.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:36.461+0000 7ffa3759d640 1 -- 172.21.15.92:0/3414941920 wait complete. 2024-09-19T09:10:37.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:36 smithi092 ceph-mon[31407]: pgmap v754: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 33 MiB/s wr, 1.54k op/s 2024-09-19T09:10:37.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:36 smithi167 ceph-mon[35359]: pgmap v754: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 33 MiB/s wr, 1.54k op/s 2024-09-19T09:10:37.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:36 smithi190 ceph-mon[35358]: pgmap v754: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 33 MiB/s wr, 1.54k op/s 2024-09-19T09:10:39.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:38 smithi092 ceph-mon[31407]: pgmap v755: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 36 MiB/s wr, 1.66k op/s 2024-09-19T09:10:39.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:38 smithi167 ceph-mon[35359]: pgmap v755: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 36 MiB/s wr, 1.66k op/s 2024-09-19T09:10:39.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:38 smithi190 ceph-mon[35358]: pgmap v755: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 36 MiB/s wr, 1.66k op/s 2024-09-19T09:10:40.795 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 835.0 s, 2658.0 tps, lat 37.922 ms stddev 45.600 2024-09-19T09:10:41.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:40 smithi092 ceph-mon[31407]: pgmap v756: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 38 MiB/s wr, 1.81k op/s 2024-09-19T09:10:41.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:40 smithi167 ceph-mon[35359]: pgmap v756: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 38 MiB/s wr, 1.81k op/s 2024-09-19T09:10:41.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:40 smithi190 ceph-mon[35358]: pgmap v756: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 38 MiB/s wr, 1.81k op/s 2024-09-19T09:10:43.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:42 smithi092 ceph-mon[31407]: pgmap v757: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 37 MiB/s wr, 1.82k op/s 2024-09-19T09:10:43.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:42 smithi167 ceph-mon[35359]: pgmap v757: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 37 MiB/s wr, 1.82k op/s 2024-09-19T09:10:43.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:42 smithi190 ceph-mon[35358]: pgmap v757: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 37 MiB/s wr, 1.82k op/s 2024-09-19T09:10:45.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:44 smithi092 ceph-mon[31407]: pgmap v758: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 35 MiB/s wr, 1.70k op/s 2024-09-19T09:10:45.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:44 smithi167 ceph-mon[35359]: pgmap v758: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 35 MiB/s wr, 1.70k op/s 2024-09-19T09:10:45.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:44 smithi190 ceph-mon[35358]: pgmap v758: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 35 MiB/s wr, 1.70k op/s 2024-09-19T09:10:45.795 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 840.0 s, 2221.6 tps, lat 45.032 ms stddev 52.797 2024-09-19T09:10:47.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:46 smithi092 ceph-mon[31407]: pgmap v759: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 24 MiB/s wr, 1.31k op/s 2024-09-19T09:10:47.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:46 smithi167 ceph-mon[35359]: pgmap v759: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 24 MiB/s wr, 1.31k op/s 2024-09-19T09:10:47.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:46 smithi190 ceph-mon[35358]: pgmap v759: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 24 MiB/s wr, 1.31k op/s 2024-09-19T09:10:49.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:48 smithi092 ceph-mon[31407]: pgmap v760: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 16 MiB/s wr, 984 op/s 2024-09-19T09:10:49.066 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:10:49.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:48 smithi167 ceph-mon[35359]: pgmap v760: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 16 MiB/s wr, 984 op/s 2024-09-19T09:10:49.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:48 smithi190 ceph-mon[35358]: pgmap v760: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 16 MiB/s wr, 984 op/s 2024-09-19T09:10:49.445 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:10:49.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.583+0000 7f2b3514b640 1 -- 172.21.15.92:0/3078262546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b30100c70 msgr2=0x7f2b301010f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:49.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.583+0000 7f2b3514b640 1 --2- 172.21.15.92:0/3078262546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b30100c70 0x7f2b301010f0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f2b18009900 tx=0x7f2b1802a480 comp rx=0 tx=0).stop 2024-09-19T09:10:49.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.583+0000 7f2b3514b640 1 -- 172.21.15.92:0/3078262546 shutdown_connections 2024-09-19T09:10:49.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.583+0000 7f2b3514b640 1 --2- 172.21.15.92:0/3078262546 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b30101630 0x7f2b30108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:49.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.583+0000 7f2b3514b640 1 --2- 172.21.15.92:0/3078262546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b30100c70 0x7f2b301010f0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:49.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.583+0000 7f2b3514b640 1 --2- 172.21.15.92:0/3078262546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b30102020 0x7f2b30102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:49.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.583+0000 7f2b3514b640 1 -- 172.21.15.92:0/3078262546 >> 172.21.15.92:0/3078262546 conn(0x7f2b300fb930 msgr2=0x7f2b300fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:49.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.583+0000 7f2b3514b640 1 -- 172.21.15.92:0/3078262546 shutdown_connections 2024-09-19T09:10:49.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.583+0000 7f2b3514b640 1 -- 172.21.15.92:0/3078262546 wait complete. 2024-09-19T09:10:49.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.584+0000 7f2b3514b640 1 Processor -- start 2024-09-19T09:10:49.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.584+0000 7f2b3514b640 1 -- start start 2024-09-19T09:10:49.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.584+0000 7f2b3514b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b30100c70 0x7f2b3019a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:49.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.585+0000 7f2b3514b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b30101630 0x7f2b3019a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:49.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.585+0000 7f2b3514b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b30102020 0x7f2b301a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:49.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.585+0000 7f2b3514b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2b3010b620 con 0x7f2b30100c70 2024-09-19T09:10:49.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.585+0000 7f2b3514b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2b3010b4a0 con 0x7f2b30102020 2024-09-19T09:10:49.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.585+0000 7f2b3514b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2b3010b7a0 con 0x7f2b30101630 2024-09-19T09:10:49.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.585+0000 7f2b2ed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b30100c70 0x7f2b3019a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:49.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.585+0000 7f2b2ed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b30100c70 0x7f2b3019a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55126/0 (socket says 172.21.15.92:55126) 2024-09-19T09:10:49.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.585+0000 7f2b2ed9d640 1 -- 172.21.15.92:0/1297976329 learned_addr learned my addr 172.21.15.92:0/1297976329 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:49.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.585+0000 7f2b27fff640 1 --2- 172.21.15.92:0/1297976329 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b30101630 0x7f2b3019a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:49.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.585+0000 7f2b2f59e640 1 --2- 172.21.15.92:0/1297976329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b30102020 0x7f2b301a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:49.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.585+0000 7f2b2ed9d640 1 -- 172.21.15.92:0/1297976329 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b30101630 msgr2=0x7f2b3019a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:49.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.585+0000 7f2b2ed9d640 1 --2- 172.21.15.92:0/1297976329 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b30101630 0x7f2b3019a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:49.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.585+0000 7f2b2ed9d640 1 -- 172.21.15.92:0/1297976329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b30102020 msgr2=0x7f2b301a15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:49.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.585+0000 7f2b2ed9d640 1 --2- 172.21.15.92:0/1297976329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b30102020 0x7f2b301a15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:49.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.585+0000 7f2b2ed9d640 1 -- 172.21.15.92:0/1297976329 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b301a1c20 con 0x7f2b30100c70 2024-09-19T09:10:49.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.585+0000 7f2b2f59e640 1 --2- 172.21.15.92:0/1297976329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b30102020 0x7f2b301a15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:10:49.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.585+0000 7f2b2ed9d640 1 --2- 172.21.15.92:0/1297976329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b30100c70 0x7f2b3019a000 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f2b2000d770 tx=0x7f2b2000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:49.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.586+0000 7f2b2cd99640 1 -- 172.21.15.92:0/1297976329 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b20017070 con 0x7f2b30100c70 2024-09-19T09:10:49.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.586+0000 7f2b2cd99640 1 -- 172.21.15.92:0/1297976329 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b20009c30 con 0x7f2b30100c70 2024-09-19T09:10:49.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.586+0000 7f2b2cd99640 1 -- 172.21.15.92:0/1297976329 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b20003da0 con 0x7f2b30100c70 2024-09-19T09:10:49.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.586+0000 7f2b3514b640 1 -- 172.21.15.92:0/1297976329 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b301a1f10 con 0x7f2b30100c70 2024-09-19T09:10:49.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.586+0000 7f2b3514b640 1 -- 172.21.15.92:0/1297976329 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b301a22c0 con 0x7f2b30100c70 2024-09-19T09:10:49.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.588+0000 7f2b37fc3740 1 Processor -- start 2024-09-19T09:10:49.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.588+0000 7f2b37fc3740 1 -- start start 2024-09-19T09:10:49.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.588+0000 7f2b2cd99640 1 -- 172.21.15.92:0/1297976329 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2b20003f40 con 0x7f2b30100c70 2024-09-19T09:10:49.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.589+0000 7f2b37fc3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ecbc5379a0 0x55ecbc537da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:49.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.589+0000 7f2b37fc3740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ecbc5382e0 0x55ecbc53cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:49.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.589+0000 7f2b37fc3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ecbc53d370 0x55ecbc53f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:49.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.589+0000 7f2b37fc3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ecbc49b2f0 con 0x55ecbc5379a0 2024-09-19T09:10:49.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.589+0000 7f2b37fc3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ecbc443270 con 0x55ecbc53d370 2024-09-19T09:10:49.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.589+0000 7f2b37fc3740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ecbc4972b0 con 0x55ecbc5382e0 2024-09-19T09:10:49.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.589+0000 7f2b2f59e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ecbc5379a0 0x55ecbc537da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:49.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.589+0000 7f2b2ed9d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ecbc5382e0 0x55ecbc53cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:49.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.589+0000 7f2b2f59e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ecbc5379a0 0x55ecbc537da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55134/0 (socket says 172.21.15.92:55134) 2024-09-19T09:10:49.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.589+0000 7f2b2f59e640 1 -- 172.21.15.92:0/2488921511 learned_addr learned my addr 172.21.15.92:0/2488921511 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:49.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.589+0000 7f2b27fff640 1 --2- 172.21.15.92:0/2488921511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ecbc53d370 0x55ecbc53f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:49.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.589+0000 7f2b2f59e640 1 -- 172.21.15.92:0/2488921511 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ecbc5382e0 msgr2=0x55ecbc53cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:49.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.589+0000 7f2b2f59e640 1 --2- 172.21.15.92:0/2488921511 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ecbc5382e0 0x55ecbc53cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:49.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.589+0000 7f2b2f59e640 1 -- 172.21.15.92:0/2488921511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ecbc53d370 msgr2=0x55ecbc53f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:49.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.589+0000 7f2b2f59e640 1 --2- 172.21.15.92:0/2488921511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ecbc53d370 0x55ecbc53f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:49.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.589+0000 7f2b2f59e640 1 -- 172.21.15.92:0/2488921511 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecbc442340 con 0x55ecbc5379a0 2024-09-19T09:10:49.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.589+0000 7f2b2f59e640 1 --2- 172.21.15.92:0/2488921511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ecbc5379a0 0x55ecbc537da0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f2b2800f430 tx=0x7f2b2800f8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=812657bff3feabdf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:49.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.590+0000 7f2b257fa640 1 -- 172.21.15.92:0/2488921511 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b28015070 con 0x55ecbc5379a0 2024-09-19T09:10:49.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.590+0000 7f2b257fa640 1 -- 172.21.15.92:0/2488921511 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b28011be0 con 0x55ecbc5379a0 2024-09-19T09:10:49.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.590+0000 7f2b257fa640 1 -- 172.21.15.92:0/2488921511 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b28010d90 con 0x55ecbc5379a0 2024-09-19T09:10:49.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.590+0000 7f2b2cd99640 1 --2- 172.21.15.92:0/1297976329 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2b1c0a3340 0x7f2b1c0a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:49.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.590+0000 7f2b2ed9d640 1 --2- 172.21.15.92:0/1297976329 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2b1c0a3340 0x7f2b1c0a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:49.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.590+0000 7f2b2cd99640 1 -- 172.21.15.92:0/1297976329 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2b200cf260 con 0x7f2b30100c70 2024-09-19T09:10:49.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.590+0000 7f2b37fc3740 1 -- 172.21.15.92:0/2488921511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ecbc5379a0 msgr2=0x55ecbc537da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:49.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.590+0000 7f2b37fc3740 1 --2- 172.21.15.92:0/2488921511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ecbc5379a0 0x55ecbc537da0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f2b2800f430 tx=0x7f2b2800f8f0 comp rx=0 tx=0).stop 2024-09-19T09:10:49.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.591+0000 7f2b37fc3740 1 -- 172.21.15.92:0/2488921511 shutdown_connections 2024-09-19T09:10:49.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.591+0000 7f2b37fc3740 1 --2- 172.21.15.92:0/2488921511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ecbc53d370 0x55ecbc53f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:49.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.591+0000 7f2b37fc3740 1 --2- 172.21.15.92:0/2488921511 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ecbc5382e0 0x55ecbc53cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:49.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.591+0000 7f2b37fc3740 1 --2- 172.21.15.92:0/2488921511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ecbc5379a0 0x55ecbc537da0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:49.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.591+0000 7f2b37fc3740 1 -- 172.21.15.92:0/2488921511 >> 172.21.15.92:0/2488921511 conn(0x55ecbc533010 msgr2=0x55ecbc533410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:49.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.591+0000 7f2b2ed9d640 1 --2- 172.21.15.92:0/1297976329 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2b1c0a3340 0x7f2b1c0a5800 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2b2000d740 tx=0x7f2b20086040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:49.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.591+0000 7f2b37fc3740 1 -- 172.21.15.92:0/2488921511 shutdown_connections 2024-09-19T09:10:49.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.591+0000 7f2b37fc3740 1 -- 172.21.15.92:0/2488921511 wait complete. 2024-09-19T09:10:49.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.591+0000 7f2b37fc3740 1 -- start start 2024-09-19T09:10:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.591+0000 7f2b37fc3740 1 Processor -- start 2024-09-19T09:10:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.592+0000 7f2b37fc3740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ecbc5379a0 0x55ecbc541bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.592+0000 7f2b37fc3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ecbc5382e0 0x55ecbc542130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.592+0000 7f2b27fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ecbc5382e0 0x55ecbc542130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.592+0000 7f2b37fc3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ecbc53d370 0x55ecbc549170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.592+0000 7f2b2f59e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ecbc5379a0 0x55ecbc541bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.592+0000 7f2b2f59e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ecbc5379a0 0x55ecbc541bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:48422/0 (socket says 172.21.15.92:48422) 2024-09-19T09:10:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.592+0000 7f2b2f59e640 1 -- 172.21.15.92:0/2026497850 learned_addr learned my addr 172.21.15.92:0/2026497850 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.592+0000 7f2b27fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ecbc5382e0 0x55ecbc542130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55140/0 (socket says 172.21.15.92:55140) 2024-09-19T09:10:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.593+0000 7f2b37fc3740 1 -- 172.21.15.92:0/2026497850 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ecbc540340 con 0x55ecbc5382e0 2024-09-19T09:10:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.593+0000 7f2b37fc3740 1 -- 172.21.15.92:0/2026497850 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ecbc424290 con 0x55ecbc53d370 2024-09-19T09:10:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.593+0000 7f2b37fc3740 1 -- 172.21.15.92:0/2026497850 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ecbc5404c0 con 0x55ecbc5379a0 2024-09-19T09:10:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.593+0000 7f2b37fc3740 10 client.0 _ll_register_callbacks cb 0x55ecbc455140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:10:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.593+0000 7f2b2f59e640 1 --2- 172.21.15.92:0/2026497850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ecbc53d370 0x55ecbc549170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.593+0000 7f2b2f59e640 1 -- 172.21.15.92:0/2026497850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ecbc53d370 msgr2=0x55ecbc549170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.593+0000 7f2b2f59e640 1 --2- 172.21.15.92:0/2026497850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ecbc53d370 0x55ecbc549170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.593+0000 7f2b2f59e640 1 -- 172.21.15.92:0/2026497850 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ecbc5382e0 msgr2=0x55ecbc542130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.593+0000 7f2b2f59e640 1 --2- 172.21.15.92:0/2026497850 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ecbc5382e0 0x55ecbc542130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.593+0000 7f2b2f59e640 1 -- 172.21.15.92:0/2026497850 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecbc1ae210 con 0x55ecbc5379a0 2024-09-19T09:10:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.593+0000 7f2b2f59e640 1 --2- 172.21.15.92:0/2026497850 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ecbc5379a0 0x55ecbc541bf0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2b28000f80 tx=0x7f2b280107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b89ec1169ad8c3c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.593+0000 7f2b167fc640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:10:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.594+0000 7f2b167fc640 1 -- 172.21.15.92:0/2026497850 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b28015050 con 0x55ecbc5379a0 2024-09-19T09:10:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.594+0000 7f2b37fc3740 1 -- 172.21.15.92:0/2026497850 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b28011be0 con 0x55ecbc5379a0 2024-09-19T09:10:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.594+0000 7f2b167fc640 1 -- 172.21.15.92:0/2026497850 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2b28010d20 con 0x55ecbc5379a0 2024-09-19T09:10:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.594+0000 7f2b167fc640 1 -- 172.21.15.92:0/2026497850 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2b28004a40 con 0x55ecbc5379a0 2024-09-19T09:10:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.594+0000 7f2b37fc3740 10 client.27763 fetch_fsmap learned FSMap version 19 2024-09-19T09:10:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.594+0000 7f2b37fc3740 1 -- 172.21.15.92:0/2026497850 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ecbc27a620 con 0x55ecbc5379a0 2024-09-19T09:10:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.594+0000 7f2b167fc640 1 -- 172.21.15.92:0/2026497850 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b28011be0 con 0x55ecbc5379a0 2024-09-19T09:10:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.594+0000 7f2b167fc640 1 -- 172.21.15.92:0/2026497850 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f2b28026020 con 0x55ecbc5379a0 2024-09-19T09:10:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.594+0000 7f2b37fc3740 10 client.27763 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:10:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.594+0000 7f2b37fc3740 10 client.27763 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:10:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.594+0000 7f2b37fc3740 20 client.27763 populate_metadata read hostname 'smithi092' 2024-09-19T09:10:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.594+0000 7f2b37fc3740 1 --2- 172.21.15.92:0/2026497850 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ecbc54d560 0x55ecbc54f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.594+0000 7f2b37fc3740 4 client.27763 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:10:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.594+0000 7f2b37fc3740 1 -- 172.21.15.92:0/2026497850 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ecbc4a8a20 con 0x55ecbc54d560 2024-09-19T09:10:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.595+0000 7f2b27fff640 1 --2- 172.21.15.92:0/2026497850 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ecbc54d560 0x55ecbc54f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:49.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.595+0000 7f2b27fff640 1 --2- 172.21.15.92:0/2026497850 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ecbc54d560 0x55ecbc54f950 crc :-1 s=READY pgs=414 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2907436693bed8c server_cookie=ca15bbfb097d2755 in_seq=0 out_seq=0 2024-09-19T09:10:49.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.595+0000 7f2b167fc640 10 client.27763 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:49.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.596+0000 7f2b167fc640 1 -- 172.21.15.92:0/2026497850 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ecbc4a8a20 con 0x55ecbc54d560 2024-09-19T09:10:49.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.596+0000 7f2b167fc640 10 client.27763 handle_command_reply: tid=0 2024-09-19T09:10:49.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.596+0000 7f2b37fc3740 1 client.27763 shutdown 2024-09-19T09:10:49.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.596+0000 7f2b37fc3740 1 -- 172.21.15.92:0/2026497850 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ecbc5379a0 msgr2=0x55ecbc541bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:49.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.596+0000 7f2b37fc3740 1 --2- 172.21.15.92:0/2026497850 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ecbc5379a0 0x55ecbc541bf0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2b28000f80 tx=0x7f2b280107a0 comp rx=0 tx=0).stop 2024-09-19T09:10:49.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.596+0000 7f2b37fc3740 1 -- 172.21.15.92:0/2026497850 shutdown_connections 2024-09-19T09:10:49.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.596+0000 7f2b37fc3740 1 --2- 172.21.15.92:0/2026497850 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ecbc54d560 0x55ecbc54f950 crc :-1 s=READY pgs=414 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:49.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.596+0000 7f2b37fc3740 1 --2- 172.21.15.92:0/2026497850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ecbc53d370 0x55ecbc549170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:49.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.596+0000 7f2b167fc640 0 client.27763 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:49.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.596+0000 7f2b37fc3740 1 --2- 172.21.15.92:0/2026497850 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ecbc5382e0 0x55ecbc542130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:49.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.596+0000 7f2b37fc3740 1 --2- 172.21.15.92:0/2026497850 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ecbc5379a0 0x55ecbc541bf0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.596+0000 7f2b37fc3740 1 -- 172.21.15.92:0/2026497850 >> 172.21.15.92:0/2026497850 conn(0x55ecbc533010 msgr2=0x55ecbc534820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.596+0000 7f2b37fc3740 1 -- 172.21.15.92:0/2026497850 shutdown_connections 2024-09-19T09:10:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.596+0000 7f2b37fc3740 1 -- 172.21.15.92:0/2026497850 wait complete. 2024-09-19T09:10:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.596+0000 7f2b37fc3740 20 client.27763 trim_cache size 0 max 16384 2024-09-19T09:10:49.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.615+0000 7f2b37fc3740 1 Processor -- start 2024-09-19T09:10:49.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.615+0000 7f2b37fc3740 1 -- start start 2024-09-19T09:10:49.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.615+0000 7f2b37fc3740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ecbc5379a0 0x55ecbc5420b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:49.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.615+0000 7f2b37fc3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ecbc5382e0 0x55ecbc549130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:49.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.615+0000 7f2b37fc3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ecbc53d370 0x55ecbc5333f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:49.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.615+0000 7f2b37fc3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2b30072a90 con 0x55ecbc5382e0 2024-09-19T09:10:49.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.615+0000 7f2b37fc3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2b301a3400 con 0x55ecbc53d370 2024-09-19T09:10:49.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.615+0000 7f2b37fc3740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2b30073120 con 0x55ecbc5379a0 2024-09-19T09:10:49.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.616+0000 7f2b27fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ecbc5382e0 0x55ecbc549130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:49.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.616+0000 7f2b2f59e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ecbc5379a0 0x55ecbc5420b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:49.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.616+0000 7f2b2f59e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ecbc5379a0 0x55ecbc5420b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:48424/0 (socket says 172.21.15.92:48424) 2024-09-19T09:10:49.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.616+0000 7f2b27fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ecbc5382e0 0x55ecbc549130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55142/0 (socket says 172.21.15.92:55142) 2024-09-19T09:10:49.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.616+0000 7f2b2f59e640 1 -- 172.21.15.92:0/736930893 learned_addr learned my addr 172.21.15.92:0/736930893 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:49.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.616+0000 7f2b2f59e640 1 --2- 172.21.15.92:0/736930893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ecbc53d370 0x55ecbc5333f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:49.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.616+0000 7f2b27fff640 1 -- 172.21.15.92:0/736930893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ecbc5379a0 msgr2=0x55ecbc5420b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:49.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.616+0000 7f2b27fff640 1 --2- 172.21.15.92:0/736930893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ecbc5379a0 0x55ecbc5420b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:49.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.616+0000 7f2b27fff640 1 -- 172.21.15.92:0/736930893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ecbc53d370 msgr2=0x55ecbc5333f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:49.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.616+0000 7f2b27fff640 1 --2- 172.21.15.92:0/736930893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ecbc53d370 0x55ecbc5333f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:49.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.616+0000 7f2b27fff640 1 -- 172.21.15.92:0/736930893 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecbc532e30 con 0x55ecbc5382e0 2024-09-19T09:10:49.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.616+0000 7f2b2f59e640 1 --2- 172.21.15.92:0/736930893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ecbc5379a0 0x55ecbc5420b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:10:49.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.616+0000 7f2b27fff640 1 --2- 172.21.15.92:0/736930893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ecbc5382e0 0x55ecbc549130 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f2b18009230 tx=0x7f2b18005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78c87f5b03222571 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:49.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.616+0000 7f2b24ff9640 1 -- 172.21.15.92:0/736930893 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1804c070 con 0x55ecbc5382e0 2024-09-19T09:10:49.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.616+0000 7f2b24ff9640 1 -- 172.21.15.92:0/736930893 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b18005610 con 0x55ecbc5382e0 2024-09-19T09:10:49.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.616+0000 7f2b24ff9640 1 -- 172.21.15.92:0/736930893 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b18035040 con 0x55ecbc5382e0 2024-09-19T09:10:49.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.617+0000 7f2b37fc3740 1 -- 172.21.15.92:0/736930893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ecbc5382e0 msgr2=0x55ecbc549130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:49.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.617+0000 7f2b37fc3740 1 --2- 172.21.15.92:0/736930893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ecbc5382e0 0x55ecbc549130 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f2b18009230 tx=0x7f2b18005c00 comp rx=0 tx=0).stop 2024-09-19T09:10:49.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.617+0000 7f2b37fc3740 1 -- 172.21.15.92:0/736930893 shutdown_connections 2024-09-19T09:10:49.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.617+0000 7f2b37fc3740 1 --2- 172.21.15.92:0/736930893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ecbc53d370 0x55ecbc5333f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:49.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.617+0000 7f2b37fc3740 1 --2- 172.21.15.92:0/736930893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ecbc5382e0 0x55ecbc549130 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:49.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.617+0000 7f2b37fc3740 1 --2- 172.21.15.92:0/736930893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ecbc5379a0 0x55ecbc5420b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:49.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.617+0000 7f2b37fc3740 1 -- 172.21.15.92:0/736930893 >> 172.21.15.92:0/736930893 conn(0x55ecbc533010 msgr2=0x55ecbc5419a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:49.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.617+0000 7f2b37fc3740 1 -- 172.21.15.92:0/736930893 shutdown_connections 2024-09-19T09:10:49.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.617+0000 7f2b37fc3740 1 -- 172.21.15.92:0/736930893 wait complete. 2024-09-19T09:10:49.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.618+0000 7f2b37fc3740 1 -- start start 2024-09-19T09:10:49.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.618+0000 7f2b37fc3740 1 Processor -- start 2024-09-19T09:10:49.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.618+0000 7f2b37fc3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ecbc5379a0 0x55ecbc546090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:49.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.618+0000 7f2b37fc3740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ecbc5382e0 0x55ecbc5465d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:49.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.618+0000 7f2b37fc3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ecbc53d370 0x55ecbc5b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:49.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.618+0000 7f2b37fc3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2b300737f0 con 0x55ecbc53d370 2024-09-19T09:10:49.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.618+0000 7f2b37fc3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2b301a2d30 con 0x55ecbc5379a0 2024-09-19T09:10:49.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.618+0000 7f2b37fc3740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2b30073ec0 con 0x55ecbc5382e0 2024-09-19T09:10:49.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.618+0000 7f2b37fc3740 10 client.0 _ll_register_callbacks cb 0x7f2b18005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:10:49.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.618+0000 7f2b27fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ecbc5382e0 0x55ecbc5465d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:49.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.618+0000 7f2b27fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ecbc5382e0 0x55ecbc5465d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:48428/0 (socket says 172.21.15.92:48428) 2024-09-19T09:10:49.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.618+0000 7f2b2f59e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ecbc53d370 0x55ecbc5b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:49.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.618+0000 7f2b27fff640 1 -- 172.21.15.92:0/38374181 learned_addr learned my addr 172.21.15.92:0/38374181 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:49.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.618+0000 7f2b2f59e640 1 --2- 172.21.15.92:0/38374181 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ecbc5379a0 0x55ecbc546090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:49.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.619+0000 7f2b27fff640 1 -- 172.21.15.92:0/38374181 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ecbc5379a0 msgr2=0x55ecbc546090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:49.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.619+0000 7f2b27fff640 1 --2- 172.21.15.92:0/38374181 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ecbc5379a0 0x55ecbc546090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:49.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.619+0000 7f2b27fff640 1 -- 172.21.15.92:0/38374181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ecbc53d370 msgr2=0x55ecbc5b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:49.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.619+0000 7f2b27fff640 1 --2- 172.21.15.92:0/38374181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ecbc53d370 0x55ecbc5b60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:49.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.619+0000 7f2b27fff640 1 -- 172.21.15.92:0/38374181 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecbc5b6660 con 0x55ecbc5382e0 2024-09-19T09:10:49.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.619+0000 7f2b27fff640 1 --2- 172.21.15.92:0/38374181 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ecbc5382e0 0x55ecbc5465d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2b1804a040 tx=0x7f2b18004b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9bc73bb7fb521ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:49.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.619+0000 7f2b167fc640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:10:49.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.619+0000 7f2b167fc640 1 -- 172.21.15.92:0/38374181 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b18056060 con 0x55ecbc5382e0 2024-09-19T09:10:49.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.619+0000 7f2b37fc3740 1 -- 172.21.15.92:0/38374181 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b18005610 con 0x55ecbc5382e0 2024-09-19T09:10:49.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.619+0000 7f2b167fc640 1 -- 172.21.15.92:0/38374181 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2b18004d50 con 0x55ecbc5382e0 2024-09-19T09:10:49.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.619+0000 7f2b167fc640 1 -- 172.21.15.92:0/38374181 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2b1804c040 con 0x55ecbc5382e0 2024-09-19T09:10:49.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.619+0000 7f2b37fc3740 10 client.27769 fetch_fsmap learned FSMap version 19 2024-09-19T09:10:49.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.619+0000 7f2b37fc3740 1 -- 172.21.15.92:0/38374181 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ecbc5b7950 con 0x55ecbc5382e0 2024-09-19T09:10:49.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.619+0000 7f2b167fc640 1 -- 172.21.15.92:0/38374181 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b18005610 con 0x55ecbc5382e0 2024-09-19T09:10:49.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.620+0000 7f2b167fc640 1 -- 172.21.15.92:0/38374181 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f2b1805b070 con 0x55ecbc5382e0 2024-09-19T09:10:49.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.620+0000 7f2b37fc3740 10 client.27769 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:10:49.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.620+0000 7f2b37fc3740 10 client.27769 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:10:49.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.620+0000 7f2b37fc3740 20 client.27769 populate_metadata read hostname 'smithi092' 2024-09-19T09:10:49.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.620+0000 7f2b37fc3740 1 --2- 172.21.15.92:0/38374181 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ecbc5b8260 0x55ecbc5ba680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:49.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.620+0000 7f2b37fc3740 4 client.27769 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:10:49.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.620+0000 7f2b37fc3740 1 -- 172.21.15.92:0/38374181 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ecbc4a2d70 con 0x55ecbc5b8260 2024-09-19T09:10:49.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.620+0000 7f2b2f59e640 1 --2- 172.21.15.92:0/38374181 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ecbc5b8260 0x55ecbc5ba680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:49.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.620+0000 7f2b167fc640 10 client.27769 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:49.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.620+0000 7f2b2f59e640 1 --2- 172.21.15.92:0/38374181 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ecbc5b8260 0x55ecbc5ba680 crc :-1 s=READY pgs=415 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34c6dc15041b1681 server_cookie=e36ea4f0dc667a71 in_seq=0 out_seq=0 2024-09-19T09:10:49.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.637+0000 7f2b167fc640 1 -- 172.21.15.92:0/38374181 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ecbc4a2d70 con 0x55ecbc5b8260 2024-09-19T09:10:49.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.637+0000 7f2b167fc640 10 client.27769 handle_command_reply: tid=0 2024-09-19T09:10:49.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.638+0000 7f2b37fc3740 1 client.27769 shutdown 2024-09-19T09:10:49.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.638+0000 7f2b37fc3740 1 -- 172.21.15.92:0/38374181 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ecbc5382e0 msgr2=0x55ecbc5465d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:49.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.638+0000 7f2b37fc3740 1 --2- 172.21.15.92:0/38374181 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ecbc5382e0 0x55ecbc5465d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2b1804a040 tx=0x7f2b18004b60 comp rx=0 tx=0).stop 2024-09-19T09:10:49.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.638+0000 7f2b37fc3740 1 -- 172.21.15.92:0/38374181 shutdown_connections 2024-09-19T09:10:49.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.638+0000 7f2b37fc3740 1 --2- 172.21.15.92:0/38374181 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ecbc5b8260 0x55ecbc5ba680 crc :-1 s=READY pgs=415 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:49.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.638+0000 7f2b37fc3740 1 --2- 172.21.15.92:0/38374181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ecbc53d370 0x55ecbc5b60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:49.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.638+0000 7f2b37fc3740 1 --2- 172.21.15.92:0/38374181 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ecbc5382e0 0x55ecbc5465d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:49.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.638+0000 7f2b37fc3740 1 --2- 172.21.15.92:0/38374181 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ecbc5379a0 0x55ecbc546090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:49.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.638+0000 7f2b167fc640 0 client.27769 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:49.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.638+0000 7f2b37fc3740 1 -- 172.21.15.92:0/38374181 >> 172.21.15.92:0/38374181 conn(0x55ecbc533010 msgr2=0x55ecbc5319a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:49.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.639+0000 7f2b37fc3740 1 -- 172.21.15.92:0/38374181 shutdown_connections 2024-09-19T09:10:49.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.639+0000 7f2b37fc3740 1 -- 172.21.15.92:0/38374181 wait complete. 2024-09-19T09:10:49.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.639+0000 7f2b37fc3740 20 client.27769 trim_cache size 0 max 16384 2024-09-19T09:10:49.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:10:49.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:10:49.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:10:49.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:10:49.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.639+0000 7f2b3514b640 1 -- 172.21.15.92:0/1297976329 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2b1c0a3340 msgr2=0x7f2b1c0a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:49.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.639+0000 7f2b3514b640 1 --2- 172.21.15.92:0/1297976329 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2b1c0a3340 0x7f2b1c0a5800 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2b2000d740 tx=0x7f2b20086040 comp rx=0 tx=0).stop 2024-09-19T09:10:49.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.639+0000 7f2b3514b640 1 -- 172.21.15.92:0/1297976329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b30100c70 msgr2=0x7f2b3019a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:49.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.639+0000 7f2b3514b640 1 --2- 172.21.15.92:0/1297976329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b30100c70 0x7f2b3019a000 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f2b2000d770 tx=0x7f2b2000dc30 comp rx=0 tx=0).stop 2024-09-19T09:10:49.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.639+0000 7f2b3514b640 1 -- 172.21.15.92:0/1297976329 shutdown_connections 2024-09-19T09:10:49.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.639+0000 7f2b3514b640 1 --2- 172.21.15.92:0/1297976329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b30102020 0x7f2b301a15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:49.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.639+0000 7f2b3514b640 1 --2- 172.21.15.92:0/1297976329 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b30101630 0x7f2b3019a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:49.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.639+0000 7f2b3514b640 1 --2- 172.21.15.92:0/1297976329 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2b1c0a3340 0x7f2b1c0a5800 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:49.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.639+0000 7f2b3514b640 1 --2- 172.21.15.92:0/1297976329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b30100c70 0x7f2b3019a000 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:49.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.639+0000 7f2b3514b640 1 -- 172.21.15.92:0/1297976329 >> 172.21.15.92:0/1297976329 conn(0x7f2b300fb930 msgr2=0x7f2b30104f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:49.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.640+0000 7f2b3514b640 1 -- 172.21.15.92:0/1297976329 shutdown_connections 2024-09-19T09:10:49.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:10:49.640+0000 7f2b3514b640 1 -- 172.21.15.92:0/1297976329 wait complete. 2024-09-19T09:10:50.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.362+0000 7f065498e640 1 -- 172.21.15.92:0/285029372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0650100a50 msgr2=0x7f06501057e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:50.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.362+0000 7f065498e640 1 --2- 172.21.15.92:0/285029372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0650100a50 0x7f06501057e0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f0648009ca0 tx=0x7f064802a8f0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.363+0000 7f065498e640 1 -- 172.21.15.92:0/285029372 shutdown_connections 2024-09-19T09:10:50.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.363+0000 7f065498e640 1 --2- 172.21.15.92:0/285029372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0650100a50 0x7f06501057e0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.363+0000 7f065498e640 1 --2- 172.21.15.92:0/285029372 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0650100090 0x7f0650100510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.363+0000 7f065498e640 1 --2- 172.21.15.92:0/285029372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0650106b70 0x7f0650106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.363+0000 7f065498e640 1 -- 172.21.15.92:0/285029372 >> 172.21.15.92:0/285029372 conn(0x7f0650077220 msgr2=0x7f06500fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:50.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.363+0000 7f065498e640 1 -- 172.21.15.92:0/285029372 shutdown_connections 2024-09-19T09:10:50.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.363+0000 7f065498e640 1 -- 172.21.15.92:0/285029372 wait complete. 2024-09-19T09:10:50.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.364+0000 7f065498e640 1 Processor -- start 2024-09-19T09:10:50.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.368+0000 7f065498e640 1 -- start start 2024-09-19T09:10:50.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.368+0000 7f065498e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0650100090 0x7f0650073990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:50.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.368+0000 7f065498e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0650100a50 0x7f0650073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:50.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.368+0000 7f065498e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0650106b70 0x7f065006cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:50.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.369+0000 7f065498e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f06501185e0 con 0x7f0650100a50 2024-09-19T09:10:50.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.369+0000 7f065498e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0650118460 con 0x7f0650100090 2024-09-19T09:10:50.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.369+0000 7f065498e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0650118760 con 0x7f0650106b70 2024-09-19T09:10:50.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.369+0000 7f064ed9d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0650106b70 0x7f065006cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:50.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.369+0000 7f064ed9d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0650106b70 0x7f065006cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:48442/0 (socket says 172.21.15.92:48442) 2024-09-19T09:10:50.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.369+0000 7f064ed9d640 1 -- 172.21.15.92:0/2000329598 learned_addr learned my addr 172.21.15.92:0/2000329598 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:50.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.370+0000 7f064ed9d640 1 -- 172.21.15.92:0/2000329598 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0650100090 msgr2=0x7f0650073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:50.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.370+0000 7f064ed9d640 1 --2- 172.21.15.92:0/2000329598 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0650100090 0x7f0650073990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.370+0000 7f064ed9d640 1 -- 172.21.15.92:0/2000329598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0650100a50 msgr2=0x7f0650073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:50.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.370+0000 7f064ed9d640 1 --2- 172.21.15.92:0/2000329598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0650100a50 0x7f0650073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.370+0000 7f064ed9d640 1 -- 172.21.15.92:0/2000329598 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f065006d4c0 con 0x7f0650106b70 2024-09-19T09:10:50.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.371+0000 7f064ed9d640 1 --2- 172.21.15.92:0/2000329598 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0650106b70 0x7f065006cc00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0648031a50 tx=0x7f0648031a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:50.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.371+0000 7f063f7fe640 1 -- 172.21.15.92:0/2000329598 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0648003d80 con 0x7f0650106b70 2024-09-19T09:10:50.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.371+0000 7f063f7fe640 1 -- 172.21.15.92:0/2000329598 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f064803f070 con 0x7f0650106b70 2024-09-19T09:10:50.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.371+0000 7f063f7fe640 1 -- 172.21.15.92:0/2000329598 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f064802fc00 con 0x7f0650106b70 2024-09-19T09:10:50.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.371+0000 7f065498e640 1 -- 172.21.15.92:0/2000329598 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f065006d750 con 0x7f0650106b70 2024-09-19T09:10:50.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.372+0000 7f065498e640 1 -- 172.21.15.92:0/2000329598 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06500716f0 con 0x7f0650106b70 2024-09-19T09:10:50.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.375+0000 7f063f7fe640 1 -- 172.21.15.92:0/2000329598 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f06480046a0 con 0x7f0650106b70 2024-09-19T09:10:50.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.376+0000 7f063f7fe640 1 --2- 172.21.15.92:0/2000329598 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f06380a3300 0x7f06380a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:50.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.376+0000 7f063f7fe640 1 -- 172.21.15.92:0/2000329598 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f06480f0b40 con 0x7f0650106b70 2024-09-19T09:10:50.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.377+0000 7f0656d67740 1 Processor -- start 2024-09-19T09:10:50.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.377+0000 7f0656d67740 1 -- start start 2024-09-19T09:10:50.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.377+0000 7f064e59c640 1 --2- 172.21.15.92:0/2000329598 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f06380a3300 0x7f06380a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:50.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.377+0000 7f0656d67740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b2d7a64a0 0x557b2d7a6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:50.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.377+0000 7f0656d67740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d7a6dc0 0x557b2d7b1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:50.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.378+0000 7f0656d67740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b2d7b1680 0x557b2d7b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:50.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.378+0000 7f0656d67740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557b2d70c2e0 con 0x557b2d7b1680 2024-09-19T09:10:50.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.378+0000 7f0656d67740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x557b2d6b3ce0 con 0x557b2d7a6dc0 2024-09-19T09:10:50.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.378+0000 7f0656d67740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x557b2d7082a0 con 0x557b2d7a64a0 2024-09-19T09:10:50.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.378+0000 7f064ed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b2d7b1680 0x557b2d7b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:50.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.378+0000 7f064ed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b2d7b1680 0x557b2d7b3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55180/0 (socket says 172.21.15.92:55180) 2024-09-19T09:10:50.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.378+0000 7f064ed9d640 1 -- 172.21.15.92:0/2062748160 learned_addr learned my addr 172.21.15.92:0/2062748160 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:50.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.378+0000 7f064e59c640 1 --2- 172.21.15.92:0/2062748160 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b2d7a64a0 0x557b2d7a6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:50.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.378+0000 7f064e59c640 1 -- 172.21.15.92:0/2062748160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d7a6dc0 msgr2=0x557b2d7b1140 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:10:50.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.378+0000 7f064e59c640 1 --2- 172.21.15.92:0/2062748160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d7a6dc0 0x557b2d7b1140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.378+0000 7f064e59c640 1 -- 172.21.15.92:0/2062748160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b2d7b1680 msgr2=0x557b2d7b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:50.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.378+0000 7f064e59c640 1 --2- 172.21.15.92:0/2062748160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b2d7b1680 0x557b2d7b3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.378+0000 7f064e59c640 1 -- 172.21.15.92:0/2062748160 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b2d698440 con 0x557b2d7a64a0 2024-09-19T09:10:50.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.379+0000 7f064e59c640 1 --2- 172.21.15.92:0/2062748160 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b2d7a64a0 0x557b2d7a6880 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0640009eb0 tx=0x7f06400125e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e22fa52e43500371 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:50.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.379+0000 7f063cff9640 1 -- 172.21.15.92:0/2062748160 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f064000f070 con 0x557b2d7a64a0 2024-09-19T09:10:50.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.379+0000 7f063cff9640 1 -- 172.21.15.92:0/2062748160 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0640016a90 con 0x557b2d7a64a0 2024-09-19T09:10:50.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.379+0000 7f063cff9640 1 -- 172.21.15.92:0/2062748160 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0640015c90 con 0x557b2d7a64a0 2024-09-19T09:10:50.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.380+0000 7f0656d67740 1 -- 172.21.15.92:0/2062748160 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b2d7a64a0 msgr2=0x557b2d7a6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:50.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.380+0000 7f0656d67740 1 --2- 172.21.15.92:0/2062748160 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b2d7a64a0 0x557b2d7a6880 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0640009eb0 tx=0x7f06400125e0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.380+0000 7f0656d67740 1 -- 172.21.15.92:0/2062748160 shutdown_connections 2024-09-19T09:10:50.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.380+0000 7f0656d67740 1 --2- 172.21.15.92:0/2062748160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b2d7b1680 0x557b2d7b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.380+0000 7f0656d67740 1 --2- 172.21.15.92:0/2062748160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d7a6dc0 0x557b2d7b1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.380+0000 7f0656d67740 1 --2- 172.21.15.92:0/2062748160 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b2d7a64a0 0x557b2d7a6880 secure :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0640009eb0 tx=0x7f06400125e0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.380+0000 7f0656d67740 1 -- 172.21.15.92:0/2062748160 >> 172.21.15.92:0/2062748160 conn(0x557b2d7a2a30 msgr2=0x557b2d7a2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:50.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.381+0000 7f0656d67740 1 -- 172.21.15.92:0/2062748160 shutdown_connections 2024-09-19T09:10:50.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.382+0000 7f064e59c640 1 --2- 172.21.15.92:0/2000329598 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f06380a3300 0x7f06380a57c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f064001a000 tx=0x7f06400146c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:50.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.382+0000 7f0656d67740 1 -- 172.21.15.92:0/2062748160 wait complete. 2024-09-19T09:10:50.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.382+0000 7f0656d67740 1 -- start start 2024-09-19T09:10:50.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.382+0000 7f0656d67740 1 Processor -- start 2024-09-19T09:10:50.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.383+0000 7f0656d67740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b2d7a6dc0 0x557b2d7b10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:50.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.383+0000 7f0656d67740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d7b1680 0x557b2d7ae390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:50.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.383+0000 7f0656d67740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b2d7aea80 0x557b2d7df6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:50.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.383+0000 7f064e59c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b2d7a6dc0 0x557b2d7b10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:50.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.383+0000 7f0656d67740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557b2d7d6260 con 0x557b2d7aea80 2024-09-19T09:10:50.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.383+0000 7f0656d67740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x557b2d6c7050 con 0x557b2d7b1680 2024-09-19T09:10:50.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.383+0000 7f0656d67740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x557b2d7d63e0 con 0x557b2d7a6dc0 2024-09-19T09:10:50.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.383+0000 7f064dd9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d7b1680 0x557b2d7ae390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:50.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.384+0000 7f064e59c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b2d7a6dc0 0x557b2d7b10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:48458/0 (socket says 172.21.15.92:48458) 2024-09-19T09:10:50.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.384+0000 7f064e59c640 1 -- 172.21.15.92:0/1524567623 learned_addr learned my addr 172.21.15.92:0/1524567623 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:50.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.384+0000 7f0656d67740 10 client.0 _ll_register_callbacks cb 0x557b2d707160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:10:50.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.384+0000 7f064ed9d640 1 --2- 172.21.15.92:0/1524567623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b2d7aea80 0x557b2d7df6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:50.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.384+0000 7f064dd9b640 1 -- 172.21.15.92:0/1524567623 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b2d7a6dc0 msgr2=0x557b2d7b10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:50.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.384+0000 7f064dd9b640 1 --2- 172.21.15.92:0/1524567623 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b2d7a6dc0 0x557b2d7b10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.384+0000 7f064dd9b640 1 -- 172.21.15.92:0/1524567623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b2d7aea80 msgr2=0x557b2d7df6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:50.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.384+0000 7f064dd9b640 1 --2- 172.21.15.92:0/1524567623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b2d7aea80 0x557b2d7df6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.384+0000 7f064dd9b640 1 -- 172.21.15.92:0/1524567623 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b2d47d3c0 con 0x557b2d7b1680 2024-09-19T09:10:50.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.384+0000 7f064dd9b640 1 --2- 172.21.15.92:0/1524567623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d7b1680 0x557b2d7ae390 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f065006e1e0 tx=0x7f064400ea60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f45ee0b3306c17f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:50.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.384+0000 7f0635ffb640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:10:50.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.384+0000 7f0635ffb640 1 -- 172.21.15.92:0/1524567623 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0644004220 con 0x557b2d7b1680 2024-09-19T09:10:50.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.385+0000 7f0635ffb640 1 -- 172.21.15.92:0/1524567623 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f06440043c0 con 0x557b2d7b1680 2024-09-19T09:10:50.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.385+0000 7f0656d67740 1 -- 172.21.15.92:0/1524567623 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0640016a90 con 0x557b2d7b1680 2024-09-19T09:10:50.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.385+0000 7f0635ffb640 1 -- 172.21.15.92:0/1524567623 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f0644005020 con 0x557b2d7b1680 2024-09-19T09:10:50.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.385+0000 7f0656d67740 10 client.27872 fetch_fsmap learned FSMap version 19 2024-09-19T09:10:50.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.385+0000 7f0656d67740 1 -- 172.21.15.92:0/1524567623 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x557b2d7e2160 con 0x557b2d7b1680 2024-09-19T09:10:50.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.386+0000 7f0635ffb640 1 -- 172.21.15.92:0/1524567623 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0640016a90 con 0x557b2d7b1680 2024-09-19T09:10:50.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.386+0000 7f0635ffb640 1 -- 172.21.15.92:0/1524567623 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f0644021070 con 0x557b2d7b1680 2024-09-19T09:10:50.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.386+0000 7f0656d67740 10 client.27872 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:10:50.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.386+0000 7f0656d67740 10 client.27872 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:10:50.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.386+0000 7f0656d67740 20 client.27872 populate_metadata read hostname 'smithi092' 2024-09-19T09:10:50.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.387+0000 7f0656d67740 1 --2- 172.21.15.92:0/1524567623 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557b2d7e3a60 0x557b2d7e5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:50.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.387+0000 7f0656d67740 4 client.27872 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:10:50.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.387+0000 7f0656d67740 1 -- 172.21.15.92:0/1524567623 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b2d719850 con 0x557b2d7e3a60 2024-09-19T09:10:50.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.387+0000 7f064e59c640 1 --2- 172.21.15.92:0/1524567623 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557b2d7e3a60 0x557b2d7e5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:50.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.387+0000 7f0635ffb640 10 client.27872 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:50.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.387+0000 7f064e59c640 1 --2- 172.21.15.92:0/1524567623 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557b2d7e3a60 0x557b2d7e5f20 crc :-1 s=READY pgs=416 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=faa2742e946d342a server_cookie=7752738a2ef7082d in_seq=0 out_seq=0 2024-09-19T09:10:50.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.389+0000 7f0635ffb640 1 -- 172.21.15.92:0/1524567623 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557b2d719850 con 0x557b2d7e3a60 2024-09-19T09:10:50.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.389+0000 7f0635ffb640 10 client.27872 handle_command_reply: tid=0 2024-09-19T09:10:50.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.389+0000 7f0656d67740 1 client.27872 shutdown 2024-09-19T09:10:50.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.390+0000 7f0656d67740 1 -- 172.21.15.92:0/1524567623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d7b1680 msgr2=0x557b2d7ae390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:50.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.390+0000 7f0656d67740 1 --2- 172.21.15.92:0/1524567623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d7b1680 0x557b2d7ae390 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f065006e1e0 tx=0x7f064400ea60 comp rx=0 tx=0).stop 2024-09-19T09:10:50.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.390+0000 7f0656d67740 1 -- 172.21.15.92:0/1524567623 shutdown_connections 2024-09-19T09:10:50.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.390+0000 7f0656d67740 1 --2- 172.21.15.92:0/1524567623 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557b2d7e3a60 0x557b2d7e5f20 crc :-1 s=READY pgs=416 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.390+0000 7f0656d67740 1 --2- 172.21.15.92:0/1524567623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b2d7aea80 0x557b2d7df6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.390+0000 7f0635ffb640 0 client.27872 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:50.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.390+0000 7f0656d67740 1 --2- 172.21.15.92:0/1524567623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d7b1680 0x557b2d7ae390 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.390+0000 7f0656d67740 1 --2- 172.21.15.92:0/1524567623 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b2d7a6dc0 0x557b2d7b10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.390+0000 7f0656d67740 1 -- 172.21.15.92:0/1524567623 >> 172.21.15.92:0/1524567623 conn(0x557b2d7a2a30 msgr2=0x557b2d7a8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:50.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.390+0000 7f0656d67740 1 -- 172.21.15.92:0/1524567623 shutdown_connections 2024-09-19T09:10:50.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.390+0000 7f0656d67740 1 -- 172.21.15.92:0/1524567623 wait complete. 2024-09-19T09:10:50.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.390+0000 7f0656d67740 20 client.27872 trim_cache size 0 max 16384 2024-09-19T09:10:50.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.417+0000 7f0656d67740 1 Processor -- start 2024-09-19T09:10:50.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.417+0000 7f0656d67740 1 -- start start 2024-09-19T09:10:50.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.417+0000 7f0656d67740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d7a6dc0 0x557b2d7adc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:50.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.417+0000 7f0656d67740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b2d7aea80 0x557b2d7a97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:50.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.417+0000 7f0656d67740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b2d7b1680 0x557b2d7df4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:50.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.417+0000 7f0656d67740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f06501a3480 con 0x557b2d7b1680 2024-09-19T09:10:50.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.417+0000 7f0656d67740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f06501a5d20 con 0x557b2d7a6dc0 2024-09-19T09:10:50.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.417+0000 7f0656d67740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f06501a3b10 con 0x557b2d7aea80 2024-09-19T09:10:50.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.417+0000 7f064e59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d7a6dc0 0x557b2d7adc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:50.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.417+0000 7f064e59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d7a6dc0 0x557b2d7adc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:33928/0 (socket says 172.21.15.92:33928) 2024-09-19T09:10:50.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.417+0000 7f064e59c640 1 -- 172.21.15.92:0/914989366 learned_addr learned my addr 172.21.15.92:0/914989366 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:50.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.417+0000 7f064ed9d640 1 --2- 172.21.15.92:0/914989366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b2d7b1680 0x557b2d7df4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:50.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.418+0000 7f064dd9b640 1 --2- 172.21.15.92:0/914989366 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b2d7aea80 0x557b2d7a97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:50.419 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.418+0000 7f064e59c640 1 -- 172.21.15.92:0/914989366 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b2d7aea80 msgr2=0x557b2d7a97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:50.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.418+0000 7f064e59c640 1 --2- 172.21.15.92:0/914989366 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b2d7aea80 0x557b2d7a97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.418+0000 7f064e59c640 1 -- 172.21.15.92:0/914989366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b2d7b1680 msgr2=0x557b2d7df4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:50.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.418+0000 7f064e59c640 1 --2- 172.21.15.92:0/914989366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b2d7b1680 0x557b2d7df4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.418+0000 7f064e59c640 1 -- 172.21.15.92:0/914989366 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b2d7ac8e0 con 0x557b2d7a6dc0 2024-09-19T09:10:50.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.418+0000 7f064dd9b640 1 --2- 172.21.15.92:0/914989366 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b2d7aea80 0x557b2d7a97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:10:50.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.418+0000 7f064e59c640 1 --2- 172.21.15.92:0/914989366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d7a6dc0 0x557b2d7adc50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0640009530 tx=0x7f0640023000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7eebfdb573391cf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:50.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.418+0000 7f0637fff640 1 -- 172.21.15.92:0/914989366 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f064003c070 con 0x557b2d7a6dc0 2024-09-19T09:10:50.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.418+0000 7f0637fff640 1 -- 172.21.15.92:0/914989366 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0640009aa0 con 0x557b2d7a6dc0 2024-09-19T09:10:50.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.418+0000 7f0637fff640 1 -- 172.21.15.92:0/914989366 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f064000f040 con 0x557b2d7a6dc0 2024-09-19T09:10:50.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.419+0000 7f0656d67740 1 -- 172.21.15.92:0/914989366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d7a6dc0 msgr2=0x557b2d7adc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:50.420 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.419+0000 7f0656d67740 1 --2- 172.21.15.92:0/914989366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d7a6dc0 0x557b2d7adc50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0640009530 tx=0x7f0640023000 comp rx=0 tx=0).stop 2024-09-19T09:10:50.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.419+0000 7f0656d67740 1 -- 172.21.15.92:0/914989366 shutdown_connections 2024-09-19T09:10:50.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.419+0000 7f0656d67740 1 --2- 172.21.15.92:0/914989366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b2d7b1680 0x557b2d7df4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.419+0000 7f0656d67740 1 --2- 172.21.15.92:0/914989366 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b2d7aea80 0x557b2d7a97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.419+0000 7f0656d67740 1 --2- 172.21.15.92:0/914989366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d7a6dc0 0x557b2d7adc50 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.419+0000 7f0656d67740 1 -- 172.21.15.92:0/914989366 >> 172.21.15.92:0/914989366 conn(0x557b2d7a2a30 msgr2=0x557b2d7a90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:50.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.419+0000 7f0656d67740 1 -- 172.21.15.92:0/914989366 shutdown_connections 2024-09-19T09:10:50.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.419+0000 7f0656d67740 1 -- 172.21.15.92:0/914989366 wait complete. 2024-09-19T09:10:50.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.420+0000 7f0656d67740 1 -- start start 2024-09-19T09:10:50.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.420+0000 7f0656d67740 1 Processor -- start 2024-09-19T09:10:50.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.420+0000 7f0656d67740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b2d7a6dc0 0x557b2d7dbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:50.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.420+0000 7f0656d67740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b2d7aea80 0x557b2d7d6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:50.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.420+0000 7f0656d67740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d7b1680 0x557b2d7d7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:50.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.420+0000 7f0656d67740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f06501a41e0 con 0x557b2d7aea80 2024-09-19T09:10:50.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.420+0000 7f0656d67740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f06501a5650 con 0x557b2d7b1680 2024-09-19T09:10:50.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.420+0000 7f0656d67740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f06501a48b0 con 0x557b2d7a6dc0 2024-09-19T09:10:50.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.421+0000 7f0656d67740 10 client.0 _ll_register_callbacks cb 0x7f0644009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:10:50.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.421+0000 7f064dd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b2d7aea80 0x557b2d7d6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:50.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.421+0000 7f064dd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b2d7aea80 0x557b2d7d6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55214/0 (socket says 172.21.15.92:55214) 2024-09-19T09:10:50.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.421+0000 7f064dd9b640 1 -- 172.21.15.92:0/2031205696 learned_addr learned my addr 172.21.15.92:0/2031205696 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:50.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.421+0000 7f064ed9d640 1 --2- 172.21.15.92:0/2031205696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d7b1680 0x557b2d7d7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:50.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.421+0000 7f064e59c640 1 --2- 172.21.15.92:0/2031205696 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b2d7a6dc0 0x557b2d7dbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:50.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.421+0000 7f064ed9d640 1 -- 172.21.15.92:0/2031205696 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b2d7a6dc0 msgr2=0x557b2d7dbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:50.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.421+0000 7f064ed9d640 1 --2- 172.21.15.92:0/2031205696 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b2d7a6dc0 0x557b2d7dbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.421+0000 7f064ed9d640 1 -- 172.21.15.92:0/2031205696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b2d7aea80 msgr2=0x557b2d7d6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:50.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.421+0000 7f064ed9d640 1 --2- 172.21.15.92:0/2031205696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b2d7aea80 0x557b2d7d6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.421+0000 7f064ed9d640 1 -- 172.21.15.92:0/2031205696 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b2d7d7a20 con 0x557b2d7b1680 2024-09-19T09:10:50.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.422+0000 7f064ed9d640 1 --2- 172.21.15.92:0/2031205696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d7b1680 0x557b2d7d7430 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f06480bd0f0 tx=0x7f064802f4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cedaf993d921743 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:50.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.422+0000 7f0635ffb640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:10:50.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.422+0000 7f0635ffb640 1 -- 172.21.15.92:0/2031205696 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f064804b040 con 0x557b2d7b1680 2024-09-19T09:10:50.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.422+0000 7f0656d67740 1 -- 172.21.15.92:0/2031205696 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0640009aa0 con 0x557b2d7b1680 2024-09-19T09:10:50.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.422+0000 7f0635ffb640 1 -- 172.21.15.92:0/2031205696 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f06480b97d0 con 0x557b2d7b1680 2024-09-19T09:10:50.427 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.422+0000 7f0635ffb640 1 -- 172.21.15.92:0/2031205696 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f06480c5dd0 con 0x557b2d7b1680 2024-09-19T09:10:50.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.422+0000 7f0656d67740 10 client.27878 fetch_fsmap learned FSMap version 19 2024-09-19T09:10:50.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.422+0000 7f0656d67740 1 -- 172.21.15.92:0/2031205696 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x557b2d84e630 con 0x557b2d7b1680 2024-09-19T09:10:50.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.422+0000 7f0635ffb640 1 -- 172.21.15.92:0/2031205696 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0640009aa0 con 0x557b2d7b1680 2024-09-19T09:10:50.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.422+0000 7f0635ffb640 1 -- 172.21.15.92:0/2031205696 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f06480c5940 con 0x557b2d7b1680 2024-09-19T09:10:50.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.422+0000 7f0656d67740 10 client.27878 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:10:50.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.422+0000 7f0656d67740 10 client.27878 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:10:50.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.422+0000 7f0656d67740 20 client.27878 populate_metadata read hostname 'smithi092' 2024-09-19T09:10:50.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.422+0000 7f0656d67740 1 --2- 172.21.15.92:0/2031205696 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557b2d84ed00 0x557b2d851120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:50.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.423+0000 7f0656d67740 4 client.27878 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:10:50.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.423+0000 7f0656d67740 1 -- 172.21.15.92:0/2031205696 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557b2d713d60 con 0x557b2d84ed00 2024-09-19T09:10:50.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.423+0000 7f064e59c640 1 --2- 172.21.15.92:0/2031205696 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557b2d84ed00 0x557b2d851120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:50.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.423+0000 7f064e59c640 1 --2- 172.21.15.92:0/2031205696 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557b2d84ed00 0x557b2d851120 crc :-1 s=READY pgs=417 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c968daa9e037923a server_cookie=1a079e9dec5f1006 in_seq=0 out_seq=0 2024-09-19T09:10:50.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.424+0000 7f0635ffb640 10 client.27878 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:50.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.424+0000 7f0635ffb640 1 -- 172.21.15.92:0/2031205696 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x557b2d713d60 con 0x557b2d84ed00 2024-09-19T09:10:50.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.424+0000 7f0635ffb640 10 client.27878 handle_command_reply: tid=0 2024-09-19T09:10:50.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.424+0000 7f0656d67740 1 client.27878 shutdown 2024-09-19T09:10:50.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.424+0000 7f0656d67740 1 -- 172.21.15.92:0/2031205696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d7b1680 msgr2=0x557b2d7d7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:50.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.424+0000 7f0656d67740 1 --2- 172.21.15.92:0/2031205696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d7b1680 0x557b2d7d7430 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f06480bd0f0 tx=0x7f064802f4f0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.424+0000 7f0656d67740 1 -- 172.21.15.92:0/2031205696 shutdown_connections 2024-09-19T09:10:50.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.424+0000 7f0656d67740 1 --2- 172.21.15.92:0/2031205696 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x557b2d84ed00 0x557b2d851120 crc :-1 s=READY pgs=417 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.424+0000 7f0656d67740 1 --2- 172.21.15.92:0/2031205696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557b2d7b1680 0x557b2d7d7430 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.424+0000 7f0656d67740 1 --2- 172.21.15.92:0/2031205696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b2d7aea80 0x557b2d7d6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.424+0000 7f0635ffb640 0 client.27878 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:50.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.424+0000 7f0656d67740 1 --2- 172.21.15.92:0/2031205696 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557b2d7a6dc0 0x557b2d7dbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.424+0000 7f0656d67740 1 -- 172.21.15.92:0/2031205696 >> 172.21.15.92:0/2031205696 conn(0x557b2d7a2a30 msgr2=0x557b2d7b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:50.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.425+0000 7f0656d67740 1 -- 172.21.15.92:0/2031205696 shutdown_connections 2024-09-19T09:10:50.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.425+0000 7f0656d67740 1 -- 172.21.15.92:0/2031205696 wait complete. 2024-09-19T09:10:50.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.425+0000 7f0656d67740 20 client.27878 trim_cache size 0 max 16384 2024-09-19T09:10:50.430 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:10:50.430 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-19T09:10:50.430 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {} 2024-09-19T09:10:50.430 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:10:50.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.426+0000 7f065498e640 1 -- 172.21.15.92:0/2000329598 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f06380a3300 msgr2=0x7f06380a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:50.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.426+0000 7f065498e640 1 --2- 172.21.15.92:0/2000329598 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f06380a3300 0x7f06380a57c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f064001a000 tx=0x7f06400146c0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.426+0000 7f065498e640 1 -- 172.21.15.92:0/2000329598 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0650106b70 msgr2=0x7f065006cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:50.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.426+0000 7f065498e640 1 --2- 172.21.15.92:0/2000329598 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0650106b70 0x7f065006cc00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0648031a50 tx=0x7f0648031a80 comp rx=0 tx=0).stop 2024-09-19T09:10:50.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.427+0000 7f065498e640 1 -- 172.21.15.92:0/2000329598 shutdown_connections 2024-09-19T09:10:50.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.427+0000 7f065498e640 1 --2- 172.21.15.92:0/2000329598 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0650106b70 0x7f065006cc00 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.427+0000 7f065498e640 1 --2- 172.21.15.92:0/2000329598 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f06380a3300 0x7f06380a57c0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.427+0000 7f065498e640 1 --2- 172.21.15.92:0/2000329598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0650100a50 0x7f0650073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.427+0000 7f065498e640 1 --2- 172.21.15.92:0/2000329598 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0650100090 0x7f0650073990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.427+0000 7f065498e640 1 -- 172.21.15.92:0/2000329598 >> 172.21.15.92:0/2000329598 conn(0x7f0650077220 msgr2=0x7f06501037b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:50.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.427+0000 7f065498e640 1 -- 172.21.15.92:0/2000329598 shutdown_connections 2024-09-19T09:10:50.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:50.427+0000 7f065498e640 1 -- 172.21.15.92:0/2000329598 wait complete. 2024-09-19T09:10:50.795 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 845.0 s, 2696.2 tps, lat 36.896 ms stddev 44.066 2024-09-19T09:10:51.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:50 smithi092 ceph-mon[31407]: pgmap v761: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 12 MiB/s wr, 882 op/s 2024-09-19T09:10:51.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:50 smithi167 ceph-mon[35359]: pgmap v761: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 12 MiB/s wr, 882 op/s 2024-09-19T09:10:51.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:50 smithi190 ceph-mon[35358]: pgmap v761: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 12 MiB/s wr, 882 op/s 2024-09-19T09:10:51.268 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:10:51.268 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:10:51.667 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:10:52.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.179+0000 7f594a07c640 1 -- 172.21.15.92:0/2043738968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5944106c80 msgr2=0x7f5944107060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:52.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.179+0000 7f594a07c640 1 --2- 172.21.15.92:0/2043738968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5944106c80 0x7f5944107060 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f5938009930 tx=0x7f593802a420 comp rx=0 tx=0).stop 2024-09-19T09:10:52.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.180+0000 7f594a07c640 1 -- 172.21.15.92:0/2043738968 shutdown_connections 2024-09-19T09:10:52.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.180+0000 7f594a07c640 1 --2- 172.21.15.92:0/2043738968 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5944100600 0x7f594410e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:52.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.180+0000 7f594a07c640 1 --2- 172.21.15.92:0/2043738968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59440ffc40 0x7f59441000c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:52.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.180+0000 7f594a07c640 1 --2- 172.21.15.92:0/2043738968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5944106c80 0x7f5944107060 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:52.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.180+0000 7f594a07c640 1 -- 172.21.15.92:0/2043738968 >> 172.21.15.92:0/2043738968 conn(0x7f59440fba90 msgr2=0x7f59440fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:52.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.180+0000 7f594a07c640 1 -- 172.21.15.92:0/2043738968 shutdown_connections 2024-09-19T09:10:52.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.180+0000 7f594a07c640 1 -- 172.21.15.92:0/2043738968 wait complete. 2024-09-19T09:10:52.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.181+0000 7f594a07c640 1 Processor -- start 2024-09-19T09:10:52.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.181+0000 7f594a07c640 1 -- start start 2024-09-19T09:10:52.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.181+0000 7f594a07c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59440ffc40 0x7f59441983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:52.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.182+0000 7f594a07c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5944100600 0x7f59441988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:52.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.182+0000 7f594a07c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5944106c80 0x7f594419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:52.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.182+0000 7f5943fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5944106c80 0x7f594419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:52.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.182+0000 7f5942ffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5944100600 0x7f59441988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:52.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.182+0000 7f5942ffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5944100600 0x7f59441988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:60782/0 (socket says 172.21.15.92:60782) 2024-09-19T09:10:52.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.182+0000 7f5942ffd640 1 -- 172.21.15.92:0/137664164 learned_addr learned my addr 172.21.15.92:0/137664164 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:52.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.182+0000 7f594a07c640 1 -- 172.21.15.92:0/137664164 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5944111f30 con 0x7f5944106c80 2024-09-19T09:10:52.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.182+0000 7f594a07c640 1 -- 172.21.15.92:0/137664164 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5944111db0 con 0x7f59440ffc40 2024-09-19T09:10:52.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.182+0000 7f594a07c640 1 -- 172.21.15.92:0/137664164 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f59441120b0 con 0x7f5944100600 2024-09-19T09:10:52.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.182+0000 7f59437fe640 1 --2- 172.21.15.92:0/137664164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59440ffc40 0x7f59441983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:52.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.183+0000 7f5942ffd640 1 -- 172.21.15.92:0/137664164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59440ffc40 msgr2=0x7f59441983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:52.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.183+0000 7f5942ffd640 1 --2- 172.21.15.92:0/137664164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59440ffc40 0x7f59441983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:52.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.183+0000 7f5942ffd640 1 -- 172.21.15.92:0/137664164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5944106c80 msgr2=0x7f594419cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:52.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.183+0000 7f5942ffd640 1 --2- 172.21.15.92:0/137664164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5944106c80 0x7f594419cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:52.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.183+0000 7f5942ffd640 1 -- 172.21.15.92:0/137664164 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f594419d360 con 0x7f5944100600 2024-09-19T09:10:52.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.183+0000 7f5942ffd640 1 --2- 172.21.15.92:0/137664164 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5944100600 0x7f59441988f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5934009de0 tx=0x7f593400c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:52.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.183+0000 7f5940ff9640 1 -- 172.21.15.92:0/137664164 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593401f070 con 0x7f5944100600 2024-09-19T09:10:52.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.183+0000 7f5940ff9640 1 -- 172.21.15.92:0/137664164 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5934011750 con 0x7f5944100600 2024-09-19T09:10:52.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.183+0000 7f594a07c640 1 -- 172.21.15.92:0/137664164 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f594419d650 con 0x7f5944100600 2024-09-19T09:10:52.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.183+0000 7f5940ff9640 1 -- 172.21.15.92:0/137664164 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593401a850 con 0x7f5944100600 2024-09-19T09:10:52.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.183+0000 7f594a07c640 1 -- 172.21.15.92:0/137664164 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59441015e0 con 0x7f5944100600 2024-09-19T09:10:52.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.184+0000 7f594a07c640 1 -- 172.21.15.92:0/137664164 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59441000c0 con 0x7f5944100600 2024-09-19T09:10:52.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.186+0000 7f5940ff9640 1 -- 172.21.15.92:0/137664164 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5934022070 con 0x7f5944100600 2024-09-19T09:10:52.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.187+0000 7f5940ff9640 1 --2- 172.21.15.92:0/137664164 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f592c0a3340 0x7f592c0a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:52.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.187+0000 7f5940ff9640 1 -- 172.21.15.92:0/137664164 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f59340d3690 con 0x7f5944100600 2024-09-19T09:10:52.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.187+0000 7f59437fe640 1 --2- 172.21.15.92:0/137664164 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f592c0a3340 0x7f592c0a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:52.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.188+0000 7f59437fe640 1 --2- 172.21.15.92:0/137664164 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f592c0a3340 0x7f592c0a5800 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5938009900 tx=0x7f59380058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:52.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.191+0000 7f5940ff9640 1 -- 172.21.15.92:0/137664164 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f593409fd20 con 0x7f5944100600 2024-09-19T09:10:52.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.510+0000 7f594a07c640 1 -- 172.21.15.92:0/137664164 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5944101840 con 0x7f5944100600 2024-09-19T09:10:52.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.511+0000 7f5940ff9640 1 -- 172.21.15.92:0/137664164 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f59340a4020 con 0x7f5944100600 2024-09-19T09:10:52.512 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:10:52.512 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:10:52.512 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:10:52.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.513+0000 7f594a07c640 1 -- 172.21.15.92:0/137664164 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f592c0a3340 msgr2=0x7f592c0a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:52.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.513+0000 7f594a07c640 1 --2- 172.21.15.92:0/137664164 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f592c0a3340 0x7f592c0a5800 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5938009900 tx=0x7f59380058d0 comp rx=0 tx=0).stop 2024-09-19T09:10:52.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.513+0000 7f594a07c640 1 -- 172.21.15.92:0/137664164 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5944100600 msgr2=0x7f59441988f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:52.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.513+0000 7f594a07c640 1 --2- 172.21.15.92:0/137664164 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5944100600 0x7f59441988f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5934009de0 tx=0x7f593400c6a0 comp rx=0 tx=0).stop 2024-09-19T09:10:52.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.513+0000 7f594a07c640 1 -- 172.21.15.92:0/137664164 shutdown_connections 2024-09-19T09:10:52.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.513+0000 7f594a07c640 1 --2- 172.21.15.92:0/137664164 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f592c0a3340 0x7f592c0a5800 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:52.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.513+0000 7f594a07c640 1 --2- 172.21.15.92:0/137664164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5944106c80 0x7f594419cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:52.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.513+0000 7f594a07c640 1 --2- 172.21.15.92:0/137664164 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5944100600 0x7f59441988f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:52.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.513+0000 7f594a07c640 1 --2- 172.21.15.92:0/137664164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59440ffc40 0x7f59441983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:52.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.513+0000 7f594a07c640 1 -- 172.21.15.92:0/137664164 >> 172.21.15.92:0/137664164 conn(0x7f59440fba90 msgr2=0x7f59440fd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:52.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.514+0000 7f594a07c640 1 -- 172.21.15.92:0/137664164 shutdown_connections 2024-09-19T09:10:52.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:52.514+0000 7f594a07c640 1 -- 172.21.15.92:0/137664164 wait complete. 2024-09-19T09:10:52.825 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:52 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/137664164' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:10:52.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:52 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/137664164' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:10:52.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:52 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/137664164' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:10:53.258 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:10:53.639 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:10:53.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:53 smithi167 ceph-mon[35359]: pgmap v762: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 754 op/s 2024-09-19T09:10:53.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:53 smithi190 ceph-mon[35358]: pgmap v762: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 754 op/s 2024-09-19T09:10:53.931 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:53 smithi092 ceph-mon[31407]: pgmap v762: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 754 op/s 2024-09-19T09:10:54.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.197+0000 7f514a464640 1 -- 172.21.15.92:0/1438404079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5144102570 msgr2=0x7f51441029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:54.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.197+0000 7f514a464640 1 --2- 172.21.15.92:0/1438404079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5144102570 0x7f51441029b0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f5138009900 tx=0x7f513802e890 comp rx=0 tx=0).stop 2024-09-19T09:10:54.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.197+0000 7f514a464640 1 -- 172.21.15.92:0/1438404079 shutdown_connections 2024-09-19T09:10:54.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.197+0000 7f514a464640 1 --2- 172.21.15.92:0/1438404079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5144102ef0 0x7f514410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.197+0000 7f514a464640 1 --2- 172.21.15.92:0/1438404079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5144102570 0x7f51441029b0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.197+0000 7f514a464640 1 --2- 172.21.15.92:0/1438404079 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5144100e20 0x7f5144101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.197+0000 7f514a464640 1 -- 172.21.15.92:0/1438404079 >> 172.21.15.92:0/1438404079 conn(0x7f51440fc7d0 msgr2=0x7f51440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:54.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.197+0000 7f514a464640 1 -- 172.21.15.92:0/1438404079 shutdown_connections 2024-09-19T09:10:54.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.197+0000 7f514a464640 1 -- 172.21.15.92:0/1438404079 wait complete. 2024-09-19T09:10:54.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.198+0000 7f514a464640 1 Processor -- start 2024-09-19T09:10:54.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.198+0000 7f514a464640 1 -- start start 2024-09-19T09:10:54.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.199+0000 7f514a464640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5144100e20 0x7f5144196240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:54.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.199+0000 7f514a464640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5144102570 0x7f5144196780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:54.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.199+0000 7f514a464640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5144102ef0 0x7f514419ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:54.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.199+0000 7f514a464640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f514410fe80 con 0x7f5144100e20 2024-09-19T09:10:54.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.199+0000 7f514a464640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f514410fd00 con 0x7f5144102570 2024-09-19T09:10:54.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.199+0000 7f514a464640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5144110000 con 0x7f5144102ef0 2024-09-19T09:10:54.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.199+0000 7f5143fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5144100e20 0x7f5144196240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:54.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.199+0000 7f5143fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5144100e20 0x7f5144196240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38832/0 (socket says 172.21.15.92:38832) 2024-09-19T09:10:54.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.199+0000 7f5143fff640 1 -- 172.21.15.92:0/2154767509 learned_addr learned my addr 172.21.15.92:0/2154767509 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:54.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.199+0000 7f51437fe640 1 --2- 172.21.15.92:0/2154767509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5144102570 0x7f5144196780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:54.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.200+0000 7f5148a01640 1 --2- 172.21.15.92:0/2154767509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5144102ef0 0x7f514419ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:54.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.200+0000 7f5143fff640 1 -- 172.21.15.92:0/2154767509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5144102ef0 msgr2=0x7f514419ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:54.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.200+0000 7f5143fff640 1 --2- 172.21.15.92:0/2154767509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5144102ef0 0x7f514419ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.200+0000 7f5143fff640 1 -- 172.21.15.92:0/2154767509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5144102570 msgr2=0x7f5144196780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:54.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.200+0000 7f5143fff640 1 --2- 172.21.15.92:0/2154767509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5144102570 0x7f5144196780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.200+0000 7f5143fff640 1 -- 172.21.15.92:0/2154767509 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f514419b1f0 con 0x7f5144100e20 2024-09-19T09:10:54.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.200+0000 7f5143fff640 1 --2- 172.21.15.92:0/2154767509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5144100e20 0x7f5144196240 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f513400c920 tx=0x7f513400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:54.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.201+0000 7f51417fa640 1 -- 172.21.15.92:0/2154767509 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5134007c70 con 0x7f5144100e20 2024-09-19T09:10:54.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.202+0000 7f51417fa640 1 -- 172.21.15.92:0/2154767509 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5134007e10 con 0x7f5144100e20 2024-09-19T09:10:54.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.202+0000 7f514a464640 1 -- 172.21.15.92:0/2154767509 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f514419b4e0 con 0x7f5144100e20 2024-09-19T09:10:54.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.202+0000 7f514a464640 1 -- 172.21.15.92:0/2154767509 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51441a2dc0 con 0x7f5144100e20 2024-09-19T09:10:54.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.203+0000 7f51417fa640 1 -- 172.21.15.92:0/2154767509 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5134018890 con 0x7f5144100e20 2024-09-19T09:10:54.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.206+0000 7f51417fa640 1 -- 172.21.15.92:0/2154767509 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5134005020 con 0x7f5144100e20 2024-09-19T09:10:54.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.207+0000 7f51417fa640 1 --2- 172.21.15.92:0/2154767509 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f512c0a32e0 0x7f512c0a57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:54.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.207+0000 7f51417fa640 1 -- 172.21.15.92:0/2154767509 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f51340cf910 con 0x7f5144100e20 2024-09-19T09:10:54.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.207+0000 7f51437fe640 1 --2- 172.21.15.92:0/2154767509 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f512c0a32e0 0x7f512c0a57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:54.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.207+0000 7f514c83d740 1 Processor -- start 2024-09-19T09:10:54.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.207+0000 7f514c83d740 1 -- start start 2024-09-19T09:10:54.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.207+0000 7f514c83d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e470dd6b40 0x55e470dd5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:54.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.207+0000 7f514c83d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e470dd55d0 0x55e470dd5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:54.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.207+0000 7f514c83d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e470de0370 0x55e470de2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:54.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.208+0000 7f514c83d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e470d3b2f0 con 0x55e470dd55d0 2024-09-19T09:10:54.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.208+0000 7f514c83d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e470ce2cf0 con 0x55e470dd6b40 2024-09-19T09:10:54.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.208+0000 7f514c83d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e470d372b0 con 0x55e470de0370 2024-09-19T09:10:54.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.208+0000 7f5143fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e470dd6b40 0x55e470dd5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:54.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.208+0000 7f5143fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e470dd6b40 0x55e470dd5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:55632/0 (socket says 172.21.15.92:55632) 2024-09-19T09:10:54.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.208+0000 7f5143fff640 1 -- 172.21.15.92:0/2944313067 learned_addr learned my addr 172.21.15.92:0/2944313067 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:54.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.208+0000 7f5148a01640 1 --2- 172.21.15.92:0/2944313067 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e470de0370 0x55e470de2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:54.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.208+0000 7f5143fff640 1 -- 172.21.15.92:0/2944313067 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e470de0370 msgr2=0x55e470de2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:54.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.208+0000 7f5143fff640 1 --2- 172.21.15.92:0/2944313067 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e470de0370 0x55e470de2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.208+0000 7f5143fff640 1 -- 172.21.15.92:0/2944313067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e470dd55d0 msgr2=0x55e470dd5a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:10:54.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.208+0000 7f5143fff640 1 --2- 172.21.15.92:0/2944313067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e470dd55d0 0x55e470dd5a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.208+0000 7f5143fff640 1 -- 172.21.15.92:0/2944313067 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e470cc73a0 con 0x55e470dd6b40 2024-09-19T09:10:54.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.208+0000 7f5143fff640 1 --2- 172.21.15.92:0/2944313067 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e470dd6b40 0x55e470dd5090 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f51340a4630 tx=0x7f513409c6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e4197eaefb4e445 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:54.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.208+0000 7f51437fe640 1 --2- 172.21.15.92:0/2154767509 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f512c0a32e0 0x7f512c0a57a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5138004770 tx=0x7f5138035420 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:54.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.208+0000 7f512a7fc640 1 -- 172.21.15.92:0/2944313067 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513409bcc0 con 0x55e470dd6b40 2024-09-19T09:10:54.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.208+0000 7f512a7fc640 1 -- 172.21.15.92:0/2944313067 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51340a4b60 con 0x55e470dd6b40 2024-09-19T09:10:54.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.209+0000 7f512a7fc640 1 -- 172.21.15.92:0/2944313067 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513409bcc0 con 0x55e470dd6b40 2024-09-19T09:10:54.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.209+0000 7f514c83d740 1 -- 172.21.15.92:0/2944313067 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e470dd6b40 msgr2=0x55e470dd5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:54.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.209+0000 7f514c83d740 1 --2- 172.21.15.92:0/2944313067 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e470dd6b40 0x55e470dd5090 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f51340a4630 tx=0x7f513409c6b0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.209+0000 7f514c83d740 1 -- 172.21.15.92:0/2944313067 shutdown_connections 2024-09-19T09:10:54.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.209+0000 7f514c83d740 1 --2- 172.21.15.92:0/2944313067 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e470de0370 0x55e470de2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.209+0000 7f514c83d740 1 --2- 172.21.15.92:0/2944313067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e470dd55d0 0x55e470dd5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.209+0000 7f514c83d740 1 --2- 172.21.15.92:0/2944313067 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e470dd6b40 0x55e470dd5090 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.209+0000 7f514c83d740 1 -- 172.21.15.92:0/2944313067 >> 172.21.15.92:0/2944313067 conn(0x55e470d9e310 msgr2=0x55e470dd1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:54.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.209+0000 7f514c83d740 1 -- 172.21.15.92:0/2944313067 shutdown_connections 2024-09-19T09:10:54.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.209+0000 7f514c83d740 1 -- 172.21.15.92:0/2944313067 wait complete. 2024-09-19T09:10:54.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.210+0000 7f514c83d740 1 -- start start 2024-09-19T09:10:54.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.210+0000 7f514c83d740 1 Processor -- start 2024-09-19T09:10:54.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.210+0000 7f514c83d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e470dd55d0 0x55e470ddfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:54.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.210+0000 7f514c83d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e470dd6b40 0x55e470ddd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:54.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.210+0000 7f514c83d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e470de0370 0x55e470ddd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:54.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.210+0000 7f514c83d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e470de3070 con 0x55e470de0370 2024-09-19T09:10:54.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.210+0000 7f514c83d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e470cf6060 con 0x55e470dd55d0 2024-09-19T09:10:54.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.210+0000 7f514c83d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e470de31f0 con 0x55e470dd6b40 2024-09-19T09:10:54.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.211+0000 7f5143fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e470dd55d0 0x55e470ddfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:54.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.211+0000 7f5143fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e470dd55d0 0x55e470ddfd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:55648/0 (socket says 172.21.15.92:55648) 2024-09-19T09:10:54.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.211+0000 7f5143fff640 1 -- 172.21.15.92:0/3315492059 learned_addr learned my addr 172.21.15.92:0/3315492059 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:54.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.211+0000 7f514c83d740 10 client.0 _ll_register_callbacks cb 0x55e470a498c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:10:54.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.211+0000 7f5148a01640 1 --2- 172.21.15.92:0/3315492059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e470de0370 0x55e470ddd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:54.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.211+0000 7f51437fe640 1 --2- 172.21.15.92:0/3315492059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e470dd6b40 0x55e470ddd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:54.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.212+0000 7f5148a01640 1 -- 172.21.15.92:0/3315492059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e470dd6b40 msgr2=0x55e470ddd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:54.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.212+0000 7f5148a01640 1 --2- 172.21.15.92:0/3315492059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e470dd6b40 0x55e470ddd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.212+0000 7f5148a01640 1 -- 172.21.15.92:0/3315492059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e470dd55d0 msgr2=0x55e470ddfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:54.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.212+0000 7f5148a01640 1 --2- 172.21.15.92:0/3315492059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e470dd55d0 0x55e470ddfd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.212+0000 7f5148a01640 1 -- 172.21.15.92:0/3315492059 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e470aac3c0 con 0x55e470de0370 2024-09-19T09:10:54.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.213+0000 7f5148a01640 1 --2- 172.21.15.92:0/3315492059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e470de0370 0x55e470ddd600 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x55e470dd6070 tx=0x7f513c00acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22ad81bbcf8b1991 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:54.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.213+0000 7f51237fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:10:54.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.214+0000 7f51237fe640 1 -- 172.21.15.92:0/3315492059 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513c01c060 con 0x55e470de0370 2024-09-19T09:10:54.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.214+0000 7f51237fe640 1 -- 172.21.15.92:0/3315492059 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f513c009c00 con 0x55e470de0370 2024-09-19T09:10:54.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.214+0000 7f514c83d740 1 -- 172.21.15.92:0/3315492059 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51340a4b60 con 0x55e470de0370 2024-09-19T09:10:54.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.215+0000 7f51237fe640 1 -- 172.21.15.92:0/3315492059 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f513c009e00 con 0x55e470de0370 2024-09-19T09:10:54.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.215+0000 7f514c83d740 10 client.18684 fetch_fsmap learned FSMap version 19 2024-09-19T09:10:54.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.215+0000 7f514c83d740 1 -- 172.21.15.92:0/3315492059 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e470deebc0 con 0x55e470de0370 2024-09-19T09:10:54.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.215+0000 7f51237fe640 1 -- 172.21.15.92:0/3315492059 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f513c0178d0 con 0x55e470de0370 2024-09-19T09:10:54.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.215+0000 7f51237fe640 1 -- 172.21.15.92:0/3315492059 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f513c021070 con 0x55e470de0370 2024-09-19T09:10:54.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.215+0000 7f514c83d740 10 client.18684 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:10:54.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.215+0000 7f514c83d740 10 client.18684 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:10:54.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.215+0000 7f514c83d740 20 client.18684 populate_metadata read hostname 'smithi092' 2024-09-19T09:10:54.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.215+0000 7f514c83d740 1 --2- 172.21.15.92:0/3315492059 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e470df0080 0x55e470df2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:54.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.215+0000 7f514c83d740 4 client.18684 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:10:54.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.215+0000 7f514c83d740 1 -- 172.21.15.92:0/3315492059 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f51340a4b60 con 0x55e470df0080 2024-09-19T09:10:54.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.216+0000 7f5143fff640 1 --2- 172.21.15.92:0/3315492059 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e470df0080 0x55e470df2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:54.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.216+0000 7f5143fff640 1 --2- 172.21.15.92:0/3315492059 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e470df0080 0x55e470df2470 crc :-1 s=READY pgs=418 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2054314e6d91cf01 server_cookie=c1bbbd7d923f55fd in_seq=0 out_seq=0 2024-09-19T09:10:54.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.216+0000 7f51237fe640 10 client.18684 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:54.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.217+0000 7f51237fe640 1 -- 172.21.15.92:0/3315492059 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f51340a4b60 con 0x55e470df0080 2024-09-19T09:10:54.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.217+0000 7f51237fe640 10 client.18684 handle_command_reply: tid=0 2024-09-19T09:10:54.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.217+0000 7f514c83d740 1 client.18684 shutdown 2024-09-19T09:10:54.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.217+0000 7f514c83d740 1 -- 172.21.15.92:0/3315492059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e470de0370 msgr2=0x55e470ddd600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:54.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.217+0000 7f514c83d740 1 --2- 172.21.15.92:0/3315492059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e470de0370 0x55e470ddd600 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x55e470dd6070 tx=0x7f513c00acd0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.218+0000 7f514c83d740 1 -- 172.21.15.92:0/3315492059 shutdown_connections 2024-09-19T09:10:54.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.218+0000 7f514c83d740 1 --2- 172.21.15.92:0/3315492059 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e470df0080 0x55e470df2470 crc :-1 s=READY pgs=418 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.218+0000 7f514c83d740 1 --2- 172.21.15.92:0/3315492059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e470de0370 0x55e470ddd600 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.218+0000 7f514c83d740 1 --2- 172.21.15.92:0/3315492059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e470dd6b40 0x55e470ddd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.218+0000 7f51237fe640 0 client.18684 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:54.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.218+0000 7f514c83d740 1 --2- 172.21.15.92:0/3315492059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e470dd55d0 0x55e470ddfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.218+0000 7f514c83d740 1 -- 172.21.15.92:0/3315492059 >> 172.21.15.92:0/3315492059 conn(0x55e470d9e310 msgr2=0x55e470dd79c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:54.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.218+0000 7f514c83d740 1 -- 172.21.15.92:0/3315492059 shutdown_connections 2024-09-19T09:10:54.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.218+0000 7f514c83d740 1 -- 172.21.15.92:0/3315492059 wait complete. 2024-09-19T09:10:54.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.218+0000 7f514c83d740 20 client.18684 trim_cache size 0 max 16384 2024-09-19T09:10:54.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.240+0000 7f514c83d740 1 Processor -- start 2024-09-19T09:10:54.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.240+0000 7f514c83d740 1 -- start start 2024-09-19T09:10:54.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.240+0000 7f514c83d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e470dd55d0 0x55e470dd0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:54.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.240+0000 7f514c83d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e470dd6b40 0x55e470de1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:54.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.240+0000 7f514c83d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e470de0370 0x55e470de1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:54.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.241+0000 7f514c83d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f51441a9050 con 0x55e470de0370 2024-09-19T09:10:54.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.241+0000 7f514c83d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f51441ab8f0 con 0x55e470dd6b40 2024-09-19T09:10:54.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.241+0000 7f514c83d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f51441a96e0 con 0x55e470dd55d0 2024-09-19T09:10:54.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.241+0000 7f5148a01640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e470de0370 0x55e470de1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:54.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.241+0000 7f5148a01640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e470de0370 0x55e470de1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38850/0 (socket says 172.21.15.92:38850) 2024-09-19T09:10:54.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.241+0000 7f5148a01640 1 -- 172.21.15.92:0/2023224204 learned_addr learned my addr 172.21.15.92:0/2023224204 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:54.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.241+0000 7f5143fff640 1 --2- 172.21.15.92:0/2023224204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e470dd55d0 0x55e470dd0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:54.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.241+0000 7f51437fe640 1 --2- 172.21.15.92:0/2023224204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e470dd6b40 0x55e470de1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:54.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.241+0000 7f5148a01640 1 -- 172.21.15.92:0/2023224204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e470dd55d0 msgr2=0x55e470dd0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:54.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.241+0000 7f5148a01640 1 --2- 172.21.15.92:0/2023224204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e470dd55d0 0x55e470dd0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.241+0000 7f5148a01640 1 -- 172.21.15.92:0/2023224204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e470dd6b40 msgr2=0x55e470de1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:54.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.241+0000 7f5148a01640 1 --2- 172.21.15.92:0/2023224204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e470dd6b40 0x55e470de1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.241+0000 7f5148a01640 1 -- 172.21.15.92:0/2023224204 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e470de21e0 con 0x55e470de0370 2024-09-19T09:10:54.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.241+0000 7f5143fff640 1 --2- 172.21.15.92:0/2023224204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e470dd55d0 0x55e470dd0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:10:54.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.241+0000 7f5148a01640 1 --2- 172.21.15.92:0/2023224204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e470de0370 0x55e470de1ca0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f513c00bf00 tx=0x7f513c009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b05560e4a945b19d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:54.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.241+0000 7f5129ffb640 1 -- 172.21.15.92:0/2023224204 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513c027040 con 0x55e470de0370 2024-09-19T09:10:54.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.242+0000 7f5129ffb640 1 -- 172.21.15.92:0/2023224204 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f513c0223e0 con 0x55e470de0370 2024-09-19T09:10:54.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.242+0000 7f5129ffb640 1 -- 172.21.15.92:0/2023224204 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513c022e40 con 0x55e470de0370 2024-09-19T09:10:54.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.242+0000 7f514c83d740 1 -- 172.21.15.92:0/2023224204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e470de0370 msgr2=0x55e470de1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:54.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.242+0000 7f514c83d740 1 --2- 172.21.15.92:0/2023224204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e470de0370 0x55e470de1ca0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f513c00bf00 tx=0x7f513c009710 comp rx=0 tx=0).stop 2024-09-19T09:10:54.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.244+0000 7f514c83d740 1 -- 172.21.15.92:0/2023224204 shutdown_connections 2024-09-19T09:10:54.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.244+0000 7f514c83d740 1 --2- 172.21.15.92:0/2023224204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e470de0370 0x55e470de1ca0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.244+0000 7f514c83d740 1 --2- 172.21.15.92:0/2023224204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e470dd6b40 0x55e470de1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.244+0000 7f514c83d740 1 --2- 172.21.15.92:0/2023224204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e470dd55d0 0x55e470dd0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.244+0000 7f514c83d740 1 -- 172.21.15.92:0/2023224204 >> 172.21.15.92:0/2023224204 conn(0x55e470d9e310 msgr2=0x55e470dd0500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:54.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.244+0000 7f514c83d740 1 -- 172.21.15.92:0/2023224204 shutdown_connections 2024-09-19T09:10:54.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.244+0000 7f514c83d740 1 -- 172.21.15.92:0/2023224204 wait complete. 2024-09-19T09:10:54.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.245+0000 7f514c83d740 1 -- start start 2024-09-19T09:10:54.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.245+0000 7f514c83d740 1 Processor -- start 2024-09-19T09:10:54.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.246+0000 7f514c83d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e470dd55d0 0x55e470de8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:54.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.246+0000 7f514c83d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e470dd6b40 0x55e470de89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:54.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.246+0000 7f514c83d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e470de0370 0x55e470de3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:54.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.246+0000 7f514c83d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f51441a9db0 con 0x55e470dd6b40 2024-09-19T09:10:54.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.246+0000 7f514c83d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f51441ab220 con 0x55e470dd55d0 2024-09-19T09:10:54.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.246+0000 7f514c83d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f51441aa480 con 0x55e470de0370 2024-09-19T09:10:54.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.246+0000 7f514c83d740 10 client.0 _ll_register_callbacks cb 0x7f513c00b790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:10:54.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.246+0000 7f5143fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e470dd55d0 0x55e470de8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:54.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.246+0000 7f5148a01640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e470de0370 0x55e470de3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:54.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.246+0000 7f5143fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e470dd55d0 0x55e470de8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:55676/0 (socket says 172.21.15.92:55676) 2024-09-19T09:10:54.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.246+0000 7f5148a01640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e470de0370 0x55e470de3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:60824/0 (socket says 172.21.15.92:60824) 2024-09-19T09:10:54.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.246+0000 7f5143fff640 1 -- 172.21.15.92:0/2581554101 learned_addr learned my addr 172.21.15.92:0/2581554101 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:54.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.246+0000 7f51437fe640 1 --2- 172.21.15.92:0/2581554101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e470dd6b40 0x55e470de89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:54.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.247+0000 7f5143fff640 1 -- 172.21.15.92:0/2581554101 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e470de0370 msgr2=0x55e470de3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:54.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.247+0000 7f5143fff640 1 --2- 172.21.15.92:0/2581554101 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e470de0370 0x55e470de3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.247+0000 7f5143fff640 1 -- 172.21.15.92:0/2581554101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e470dd6b40 msgr2=0x55e470de89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:54.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.247+0000 7f5143fff640 1 --2- 172.21.15.92:0/2581554101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e470dd6b40 0x55e470de89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.247+0000 7f5143fff640 1 -- 172.21.15.92:0/2581554101 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e470de3980 con 0x55e470dd55d0 2024-09-19T09:10:54.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.247+0000 7f5143fff640 1 --2- 172.21.15.92:0/2581554101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e470dd55d0 0x55e470de8490 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f513409a1a0 tx=0x7f5134098190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=190965930bb1f0d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:54.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.247+0000 7f51237fe640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:10:54.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.247+0000 7f51237fe640 1 -- 172.21.15.92:0/2581554101 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513409bcc0 con 0x55e470dd55d0 2024-09-19T09:10:54.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.247+0000 7f514c83d740 1 -- 172.21.15.92:0/2581554101 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f513c0223e0 con 0x55e470dd55d0 2024-09-19T09:10:54.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.247+0000 7f51237fe640 1 -- 172.21.15.92:0/2581554101 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f51340a4790 con 0x55e470dd55d0 2024-09-19T09:10:54.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.247+0000 7f51237fe640 1 -- 172.21.15.92:0/2581554101 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f51340b00d0 con 0x55e470dd55d0 2024-09-19T09:10:54.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.247+0000 7f514c83d740 10 client.27902 fetch_fsmap learned FSMap version 19 2024-09-19T09:10:54.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.248+0000 7f514c83d740 1 -- 172.21.15.92:0/2581554101 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e470e5b230 con 0x55e470dd55d0 2024-09-19T09:10:54.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.248+0000 7f51237fe640 1 -- 172.21.15.92:0/2581554101 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f513c0223e0 con 0x55e470dd55d0 2024-09-19T09:10:54.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.248+0000 7f51237fe640 1 -- 172.21.15.92:0/2581554101 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f513409b340 con 0x55e470dd55d0 2024-09-19T09:10:54.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.248+0000 7f514c83d740 10 client.27902 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:10:54.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.248+0000 7f514c83d740 10 client.27902 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:10:54.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.248+0000 7f514c83d740 20 client.27902 populate_metadata read hostname 'smithi092' 2024-09-19T09:10:54.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.248+0000 7f514c83d740 1 --2- 172.21.15.92:0/2581554101 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e470df0080 0x55e470e5d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:54.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.248+0000 7f514c83d740 4 client.27902 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:10:54.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.248+0000 7f514c83d740 1 -- 172.21.15.92:0/2581554101 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e470d48860 con 0x55e470df0080 2024-09-19T09:10:54.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.248+0000 7f51437fe640 1 --2- 172.21.15.92:0/2581554101 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e470df0080 0x55e470e5d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:54.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.249+0000 7f51237fe640 10 client.27902 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:54.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.249+0000 7f51437fe640 1 --2- 172.21.15.92:0/2581554101 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e470df0080 0x55e470e5d470 crc :-1 s=READY pgs=419 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d197a10b2d5c47b server_cookie=56239fc4a10f1b41 in_seq=0 out_seq=0 2024-09-19T09:10:54.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.249+0000 7f51237fe640 1 -- 172.21.15.92:0/2581554101 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e470d48860 con 0x55e470df0080 2024-09-19T09:10:54.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.249+0000 7f51237fe640 10 client.27902 handle_command_reply: tid=0 2024-09-19T09:10:54.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.249+0000 7f514c83d740 1 client.27902 shutdown 2024-09-19T09:10:54.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.249+0000 7f514c83d740 1 -- 172.21.15.92:0/2581554101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e470dd55d0 msgr2=0x55e470de8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:54.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.249+0000 7f514c83d740 1 --2- 172.21.15.92:0/2581554101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e470dd55d0 0x55e470de8490 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f513409a1a0 tx=0x7f5134098190 comp rx=0 tx=0).stop 2024-09-19T09:10:54.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.250+0000 7f514c83d740 1 -- 172.21.15.92:0/2581554101 shutdown_connections 2024-09-19T09:10:54.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.250+0000 7f514c83d740 1 --2- 172.21.15.92:0/2581554101 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e470df0080 0x55e470e5d470 crc :-1 s=READY pgs=419 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.250+0000 7f514c83d740 1 --2- 172.21.15.92:0/2581554101 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e470de0370 0x55e470de3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.250+0000 7f514c83d740 1 --2- 172.21.15.92:0/2581554101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e470dd6b40 0x55e470de89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.250+0000 7f514c83d740 1 --2- 172.21.15.92:0/2581554101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e470dd55d0 0x55e470de8490 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.250+0000 7f514c83d740 1 -- 172.21.15.92:0/2581554101 >> 172.21.15.92:0/2581554101 conn(0x55e470d9e310 msgr2=0x55e470dd0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:54.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.250+0000 7f51237fe640 0 client.27902 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:54.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.250+0000 7f514c83d740 1 -- 172.21.15.92:0/2581554101 shutdown_connections 2024-09-19T09:10:54.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.250+0000 7f514c83d740 1 -- 172.21.15.92:0/2581554101 wait complete. 2024-09-19T09:10:54.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.250+0000 7f514c83d740 20 client.27902 trim_cache size 0 max 16384 2024-09-19T09:10:54.254 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-19T09:10:54.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.251+0000 7f514a464640 1 -- 172.21.15.92:0/2154767509 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f512c0a32e0 msgr2=0x7f512c0a57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:54.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.251+0000 7f514a464640 1 --2- 172.21.15.92:0/2154767509 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f512c0a32e0 0x7f512c0a57a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5138004770 tx=0x7f5138035420 comp rx=0 tx=0).stop 2024-09-19T09:10:54.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.251+0000 7f514a464640 1 -- 172.21.15.92:0/2154767509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5144100e20 msgr2=0x7f5144196240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:54.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.251+0000 7f514a464640 1 --2- 172.21.15.92:0/2154767509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5144100e20 0x7f5144196240 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f513400c920 tx=0x7f513400cde0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.251+0000 7f514a464640 1 -- 172.21.15.92:0/2154767509 shutdown_connections 2024-09-19T09:10:54.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.251+0000 7f514a464640 1 --2- 172.21.15.92:0/2154767509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5144102ef0 0x7f514419ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.251+0000 7f514a464640 1 --2- 172.21.15.92:0/2154767509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5144102570 0x7f5144196780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.251+0000 7f514a464640 1 --2- 172.21.15.92:0/2154767509 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f512c0a32e0 0x7f512c0a57a0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.251+0000 7f514a464640 1 --2- 172.21.15.92:0/2154767509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5144100e20 0x7f5144196240 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.251+0000 7f514a464640 1 -- 172.21.15.92:0/2154767509 >> 172.21.15.92:0/2154767509 conn(0x7f51440fc7d0 msgr2=0x7f5144106800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:54.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.251+0000 7f514a464640 1 -- 172.21.15.92:0/2154767509 shutdown_connections 2024-09-19T09:10:54.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:54.251+0000 7f514a464640 1 -- 172.21.15.92:0/2154767509 wait complete. 2024-09-19T09:10:55.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:54 smithi092 ceph-mon[31407]: pgmap v763: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 727 op/s 2024-09-19T09:10:55.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:54 smithi167 ceph-mon[35359]: pgmap v763: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 727 op/s 2024-09-19T09:10:55.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:54 smithi190 ceph-mon[35358]: pgmap v763: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 727 op/s 2024-09-19T09:10:55.795 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 850.0 s, 1679.8 tps, lat 59.626 ms stddev 68.741 2024-09-19T09:10:56.211 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:10:56.211 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:10:56.628 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:10:56.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:56 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:10:56.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:56 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:10:56.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:56 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:10:57.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.207+0000 7f6c31fe2640 1 -- 172.21.15.92:0/547974047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c2c103ff0 msgr2=0x7f6c2c1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:57.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.207+0000 7f6c31fe2640 1 --2- 172.21.15.92:0/547974047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c2c103ff0 0x7f6c2c1043d0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c009900 tx=0x7f6c1c02a410 comp rx=0 tx=0).stop 2024-09-19T09:10:57.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.208+0000 7f6c31fe2640 1 -- 172.21.15.92:0/547974047 shutdown_connections 2024-09-19T09:10:57.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.208+0000 7f6c31fe2640 1 --2- 172.21.15.92:0/547974047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c2c109120 0x7f6c2c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:57.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.208+0000 7f6c31fe2640 1 --2- 172.21.15.92:0/547974047 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c2c1049a0 0x7f6c2c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:57.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.208+0000 7f6c31fe2640 1 --2- 172.21.15.92:0/547974047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c2c103ff0 0x7f6c2c1043d0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:57.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.208+0000 7f6c31fe2640 1 -- 172.21.15.92:0/547974047 >> 172.21.15.92:0/547974047 conn(0x7f6c2c0ffab0 msgr2=0x7f6c2c101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:57.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.208+0000 7f6c31fe2640 1 -- 172.21.15.92:0/547974047 shutdown_connections 2024-09-19T09:10:57.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.208+0000 7f6c31fe2640 1 -- 172.21.15.92:0/547974047 wait complete. 2024-09-19T09:10:57.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.209+0000 7f6c31fe2640 1 Processor -- start 2024-09-19T09:10:57.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.209+0000 7f6c31fe2640 1 -- start start 2024-09-19T09:10:57.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.209+0000 7f6c31fe2640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c2c103ff0 0x7f6c2c19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:57.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.209+0000 7f6c31fe2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c2c1049a0 0x7f6c2c19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:57.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.209+0000 7f6c31fe2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c2c109120 0x7f6c2c19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:57.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.209+0000 7f6c31fe2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c114190 con 0x7f6c2c109120 2024-09-19T09:10:57.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.209+0000 7f6c31fe2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c114010 con 0x7f6c2c1049a0 2024-09-19T09:10:57.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.209+0000 7f6c31fe2640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c114310 con 0x7f6c2c103ff0 2024-09-19T09:10:57.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.209+0000 7f6c2bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c2c109120 0x7f6c2c19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:57.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.209+0000 7f6c2bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c2c109120 0x7f6c2c19ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38864/0 (socket says 172.21.15.92:38864) 2024-09-19T09:10:57.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.209+0000 7f6c2bfff640 1 -- 172.21.15.92:0/1630963951 learned_addr learned my addr 172.21.15.92:0/1630963951 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:57.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.210+0000 7f6c2bfff640 1 -- 172.21.15.92:0/1630963951 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c2c103ff0 msgr2=0x7f6c2c19a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:57.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.210+0000 7f6c2bfff640 1 --2- 172.21.15.92:0/1630963951 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c2c103ff0 0x7f6c2c19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:57.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.210+0000 7f6c23fff640 1 --2- 172.21.15.92:0/1630963951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c2c1049a0 0x7f6c2c19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:57.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.210+0000 7f6c2bfff640 1 -- 172.21.15.92:0/1630963951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c2c1049a0 msgr2=0x7f6c2c19abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:57.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.210+0000 7f6c2bfff640 1 --2- 172.21.15.92:0/1630963951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c2c1049a0 0x7f6c2c19abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:57.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.210+0000 7f6c2bfff640 1 -- 172.21.15.92:0/1630963951 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c2c19f620 con 0x7f6c2c109120 2024-09-19T09:10:57.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.210+0000 7f6c23fff640 1 --2- 172.21.15.92:0/1630963951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c2c1049a0 0x7f6c2c19abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:10:57.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.210+0000 7f6c2bfff640 1 --2- 172.21.15.92:0/1630963951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c2c109120 0x7f6c2c19ef40 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400eb10 tx=0x7f6c2400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:57.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.210+0000 7f6c297fa640 1 -- 172.21.15.92:0/1630963951 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c24004b20 con 0x7f6c2c109120 2024-09-19T09:10:57.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.210+0000 7f6c297fa640 1 -- 172.21.15.92:0/1630963951 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c24004cc0 con 0x7f6c2c109120 2024-09-19T09:10:57.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.210+0000 7f6c297fa640 1 -- 172.21.15.92:0/1630963951 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c24010760 con 0x7f6c2c109120 2024-09-19T09:10:57.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.210+0000 7f6c31fe2640 1 -- 172.21.15.92:0/1630963951 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c2c19f910 con 0x7f6c2c109120 2024-09-19T09:10:57.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.210+0000 7f6c31fe2640 1 -- 172.21.15.92:0/1630963951 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c2c1a71f0 con 0x7f6c2c109120 2024-09-19T09:10:57.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.216+0000 7f6c297fa640 1 -- 172.21.15.92:0/1630963951 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6c24005020 con 0x7f6c2c109120 2024-09-19T09:10:57.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.217+0000 7f6c297fa640 1 --2- 172.21.15.92:0/1630963951 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6c180a32c0 0x7f6c180a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:57.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.217+0000 7f6c297fa640 1 -- 172.21.15.92:0/1630963951 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f6c240cffa0 con 0x7f6c2c109120 2024-09-19T09:10:57.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.217+0000 7f6c2b7fe640 1 --2- 172.21.15.92:0/1630963951 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6c180a32c0 0x7f6c180a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:57.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.217+0000 7f6c343bb740 1 Processor -- start 2024-09-19T09:10:57.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.217+0000 7f6c343bb740 1 -- start start 2024-09-19T09:10:57.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.218+0000 7f6c343bb740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8a3a2aa80 0x55d8a3a2ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:57.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.218+0000 7f6c343bb740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8a3a2b3a0 0x55d8a3a3e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:57.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.218+0000 7f6c343bb740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8a3a3e550 0x55d8a3a40940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:57.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.218+0000 7f6c343bb740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d8a3990280 con 0x55d8a3a2b3a0 2024-09-19T09:10:57.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.218+0000 7f6c343bb740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d8a3937b10 con 0x55d8a3a3e550 2024-09-19T09:10:57.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.218+0000 7f6c343bb740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55d8a398c240 con 0x55d8a3a2aa80 2024-09-19T09:10:57.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.218+0000 7f6c2bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8a3a3e550 0x55d8a3a40940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:57.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.218+0000 7f6c2bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8a3a3e550 0x55d8a3a40940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:55716/0 (socket says 172.21.15.92:55716) 2024-09-19T09:10:57.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.218+0000 7f6c2bfff640 1 -- 172.21.15.92:0/624605733 learned_addr learned my addr 172.21.15.92:0/624605733 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:57.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.218+0000 7f6c2b7fe640 1 --2- 172.21.15.92:0/1630963951 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6c180a32c0 0x7f6c180a5780 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c0096c0 tx=0x7f6c1c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:57.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.218+0000 7f6c2b7fe640 1 --2- 172.21.15.92:0/624605733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8a3a2aa80 0x55d8a3a2ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:57.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.218+0000 7f6c2bfff640 1 -- 172.21.15.92:0/624605733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8a3a2aa80 msgr2=0x55d8a3a2ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:57.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.218+0000 7f6c2bfff640 1 --2- 172.21.15.92:0/624605733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8a3a2aa80 0x55d8a3a2ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:57.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.218+0000 7f6c2bfff640 1 -- 172.21.15.92:0/624605733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8a3a2b3a0 msgr2=0x55d8a3a3e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:57.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.218+0000 7f6c2bfff640 1 --2- 172.21.15.92:0/624605733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8a3a2b3a0 0x55d8a3a3e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:57.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.218+0000 7f6c2bfff640 1 -- 172.21.15.92:0/624605733 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8a39441f0 con 0x55d8a3a3e550 2024-09-19T09:10:57.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.219+0000 7f6c2bfff640 1 --2- 172.21.15.92:0/624605733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8a3a3e550 0x55d8a3a40940 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6c240a4cc0 tx=0x7f6c2409c180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8365f77aa91f8b3c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:57.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.220+0000 7f6c21ffb640 1 -- 172.21.15.92:0/624605733 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2409c580 con 0x55d8a3a3e550 2024-09-19T09:10:57.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.220+0000 7f6c21ffb640 1 -- 172.21.15.92:0/624605733 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c240a0930 con 0x55d8a3a3e550 2024-09-19T09:10:57.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.220+0000 7f6c21ffb640 1 -- 172.21.15.92:0/624605733 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c240a4fc0 con 0x55d8a3a3e550 2024-09-19T09:10:57.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.221+0000 7f6c343bb740 1 -- 172.21.15.92:0/624605733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8a3a3e550 msgr2=0x55d8a3a40940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:57.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.221+0000 7f6c343bb740 1 --2- 172.21.15.92:0/624605733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8a3a3e550 0x55d8a3a40940 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6c240a4cc0 tx=0x7f6c2409c180 comp rx=0 tx=0).stop 2024-09-19T09:10:57.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.221+0000 7f6c343bb740 1 -- 172.21.15.92:0/624605733 shutdown_connections 2024-09-19T09:10:57.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.221+0000 7f6c343bb740 1 --2- 172.21.15.92:0/624605733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8a3a3e550 0x55d8a3a40940 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:57.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.221+0000 7f6c343bb740 1 --2- 172.21.15.92:0/624605733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8a3a2b3a0 0x55d8a3a3e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:57.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.221+0000 7f6c343bb740 1 --2- 172.21.15.92:0/624605733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8a3a2aa80 0x55d8a3a2ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:57.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.221+0000 7f6c343bb740 1 -- 172.21.15.92:0/624605733 >> 172.21.15.92:0/624605733 conn(0x55d8a3a270f0 msgr2=0x55d8a3a274d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:57.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.221+0000 7f6c343bb740 1 -- 172.21.15.92:0/624605733 shutdown_connections 2024-09-19T09:10:57.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.221+0000 7f6c343bb740 1 -- 172.21.15.92:0/624605733 wait complete. 2024-09-19T09:10:57.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.221+0000 7f6c343bb740 1 -- start start 2024-09-19T09:10:57.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.221+0000 7f6c343bb740 1 Processor -- start 2024-09-19T09:10:57.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.222+0000 7f6c343bb740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8a3a2aa80 0x55d8a3a3b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:57.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.222+0000 7f6c343bb740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8a3a2b3a0 0x55d8a3a3ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:57.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.222+0000 7f6c343bb740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8a3a3e550 0x55d8a3a3bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:57.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.222+0000 7f6c343bb740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d8a3a41060 con 0x55d8a3a3e550 2024-09-19T09:10:57.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.222+0000 7f6c343bb740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d8a394af10 con 0x55d8a3a2b3a0 2024-09-19T09:10:57.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.222+0000 7f6c343bb740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55d8a3a411e0 con 0x55d8a3a2aa80 2024-09-19T09:10:57.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.222+0000 7f6c343bb740 10 client.0 _ll_register_callbacks cb 0x55d8a3913a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:10:57.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.222+0000 7f6c2bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8a3a3e550 0x55d8a3a3bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:57.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.222+0000 7f6c2bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8a3a3e550 0x55d8a3a3bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38894/0 (socket says 172.21.15.92:38894) 2024-09-19T09:10:57.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.222+0000 7f6c2bfff640 1 -- 172.21.15.92:0/800419936 learned_addr learned my addr 172.21.15.92:0/800419936 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:57.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.223+0000 7f6c2bfff640 1 -- 172.21.15.92:0/800419936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8a3a2aa80 msgr2=0x55d8a3a3b500 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:10:57.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.223+0000 7f6c2bfff640 1 --2- 172.21.15.92:0/800419936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8a3a2aa80 0x55d8a3a3b500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:57.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.223+0000 7f6c2bfff640 1 -- 172.21.15.92:0/800419936 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8a3a2b3a0 msgr2=0x55d8a3a3ba40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:10:57.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.223+0000 7f6c2bfff640 1 --2- 172.21.15.92:0/800419936 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8a3a2b3a0 0x55d8a3a3ba40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:57.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.223+0000 7f6c2bfff640 1 -- 172.21.15.92:0/800419936 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8a37016a0 con 0x55d8a3a3e550 2024-09-19T09:10:57.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.223+0000 7f6c2bfff640 1 --2- 172.21.15.92:0/800419936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8a3a3e550 0x55d8a3a3bf80 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f6c240049d0 tx=0x7f6c240a51f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a824d124f1ad1d5c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:57.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.223+0000 7f6c0affd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:10:57.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.223+0000 7f6c0affd640 1 -- 172.21.15.92:0/800419936 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c240b9020 con 0x55d8a3a3e550 2024-09-19T09:10:57.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.223+0000 7f6c0affd640 1 -- 172.21.15.92:0/800419936 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f6c24005310 con 0x55d8a3a3e550 2024-09-19T09:10:57.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.223+0000 7f6c343bb740 1 -- 172.21.15.92:0/800419936 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c240a0930 con 0x55d8a3a3e550 2024-09-19T09:10:57.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.224+0000 7f6c0affd640 1 -- 172.21.15.92:0/800419936 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6c2409c580 con 0x55d8a3a3e550 2024-09-19T09:10:57.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.224+0000 7f6c343bb740 10 client.18699 fetch_fsmap learned FSMap version 19 2024-09-19T09:10:57.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.224+0000 7f6c343bb740 1 -- 172.21.15.92:0/800419936 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55d8a3a4cd80 con 0x55d8a3a3e550 2024-09-19T09:10:57.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.224+0000 7f6c0affd640 1 -- 172.21.15.92:0/800419936 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c240a0930 con 0x55d8a3a3e550 2024-09-19T09:10:57.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.224+0000 7f6c0affd640 1 -- 172.21.15.92:0/800419936 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f6c24098360 con 0x55d8a3a3e550 2024-09-19T09:10:57.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.224+0000 7f6c343bb740 10 client.18699 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:10:57.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.224+0000 7f6c343bb740 10 client.18699 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:10:57.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.224+0000 7f6c343bb740 20 client.18699 populate_metadata read hostname 'smithi092' 2024-09-19T09:10:57.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.224+0000 7f6c343bb740 1 --2- 172.21.15.92:0/800419936 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d8a3a4e0d0 0x55d8a3a504c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:57.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.224+0000 7f6c343bb740 4 client.18699 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:10:57.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.224+0000 7f6c343bb740 1 -- 172.21.15.92:0/800419936 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8a399d7f0 con 0x55d8a3a4e0d0 2024-09-19T09:10:57.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.225+0000 7f6c2b7fe640 1 --2- 172.21.15.92:0/800419936 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d8a3a4e0d0 0x55d8a3a504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:57.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.225+0000 7f6c0affd640 10 client.18699 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:57.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.225+0000 7f6c2b7fe640 1 --2- 172.21.15.92:0/800419936 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d8a3a4e0d0 0x55d8a3a504c0 crc :-1 s=READY pgs=420 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f0094d30254c882 server_cookie=db87a0515c417dbb in_seq=0 out_seq=0 2024-09-19T09:10:57.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.226+0000 7f6c0affd640 1 -- 172.21.15.92:0/800419936 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d8a399d7f0 con 0x55d8a3a4e0d0 2024-09-19T09:10:57.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.226+0000 7f6c0affd640 10 client.18699 handle_command_reply: tid=0 2024-09-19T09:10:57.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.226+0000 7f6c343bb740 1 client.18699 shutdown 2024-09-19T09:10:57.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.226+0000 7f6c343bb740 1 -- 172.21.15.92:0/800419936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8a3a3e550 msgr2=0x55d8a3a3bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:57.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.226+0000 7f6c343bb740 1 --2- 172.21.15.92:0/800419936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8a3a3e550 0x55d8a3a3bf80 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f6c240049d0 tx=0x7f6c240a51f0 comp rx=0 tx=0).stop 2024-09-19T09:10:57.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.226+0000 7f6c343bb740 1 -- 172.21.15.92:0/800419936 shutdown_connections 2024-09-19T09:10:57.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.226+0000 7f6c343bb740 1 --2- 172.21.15.92:0/800419936 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d8a3a4e0d0 0x55d8a3a504c0 crc :-1 s=READY pgs=420 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:57.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.226+0000 7f6c343bb740 1 --2- 172.21.15.92:0/800419936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8a3a3e550 0x55d8a3a3bf80 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:57.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.227+0000 7f6c343bb740 1 --2- 172.21.15.92:0/800419936 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8a3a2b3a0 0x55d8a3a3ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:57.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.227+0000 7f6c343bb740 1 --2- 172.21.15.92:0/800419936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8a3a2aa80 0x55d8a3a3b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:57.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.227+0000 7f6c343bb740 1 -- 172.21.15.92:0/800419936 >> 172.21.15.92:0/800419936 conn(0x55d8a3a270f0 msgr2=0x55d8a3a2ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:57.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.227+0000 7f6c0affd640 0 client.18699 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:57.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.227+0000 7f6c343bb740 1 -- 172.21.15.92:0/800419936 shutdown_connections 2024-09-19T09:10:57.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.227+0000 7f6c343bb740 1 -- 172.21.15.92:0/800419936 wait complete. 2024-09-19T09:10:57.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.227+0000 7f6c343bb740 20 client.18699 trim_cache size 0 max 16384 2024-09-19T09:10:57.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.254+0000 7f6c343bb740 1 Processor -- start 2024-09-19T09:10:57.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.255+0000 7f6c343bb740 1 -- start start 2024-09-19T09:10:57.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.255+0000 7f6c343bb740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8a3a2aa80 0x55d8a3a26160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:57.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.255+0000 7f6c343bb740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8a3a2b3a0 0x55d8a3a55a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:57.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.255+0000 7f6c343bb740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8a3a3e550 0x55d8a3a55fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:57.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.255+0000 7f6c343bb740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c1a9440 con 0x55d8a3a2aa80 2024-09-19T09:10:57.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.255+0000 7f6c343bb740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c1abce0 con 0x55d8a3a2b3a0 2024-09-19T09:10:57.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.255+0000 7f6c343bb740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c1a9ad0 con 0x55d8a3a3e550 2024-09-19T09:10:57.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.255+0000 7f6c2b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8a3a2aa80 0x55d8a3a26160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:57.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.256+0000 7f6c23fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8a3a2b3a0 0x55d8a3a55a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:57.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.256+0000 7f6c23fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8a3a2b3a0 0x55d8a3a55a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:55732/0 (socket says 172.21.15.92:55732) 2024-09-19T09:10:57.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.256+0000 7f6c23fff640 1 -- 172.21.15.92:0/1835199292 learned_addr learned my addr 172.21.15.92:0/1835199292 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:57.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.256+0000 7f6c2bfff640 1 --2- 172.21.15.92:0/1835199292 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8a3a3e550 0x55d8a3a55fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:57.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.256+0000 7f6c23fff640 1 -- 172.21.15.92:0/1835199292 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8a3a3e550 msgr2=0x55d8a3a55fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:57.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.256+0000 7f6c23fff640 1 --2- 172.21.15.92:0/1835199292 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8a3a3e550 0x55d8a3a55fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:57.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.256+0000 7f6c23fff640 1 -- 172.21.15.92:0/1835199292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8a3a2aa80 msgr2=0x55d8a3a26160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:57.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.256+0000 7f6c23fff640 1 --2- 172.21.15.92:0/1835199292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8a3a2aa80 0x55d8a3a26160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:57.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.256+0000 7f6c23fff640 1 -- 172.21.15.92:0/1835199292 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8a3a21680 con 0x55d8a3a2b3a0 2024-09-19T09:10:57.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.256+0000 7f6c23fff640 1 --2- 172.21.15.92:0/1835199292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8a3a2b3a0 0x55d8a3a55a90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6c14009bb0 tx=0x7f6c14010370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47f2897a6876bd4f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:57.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.256+0000 7f6c217fa640 1 -- 172.21.15.92:0/1835199292 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c14010d20 con 0x55d8a3a2b3a0 2024-09-19T09:10:57.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.256+0000 7f6c217fa640 1 -- 172.21.15.92:0/1835199292 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c14005500 con 0x55d8a3a2b3a0 2024-09-19T09:10:57.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.256+0000 7f6c217fa640 1 -- 172.21.15.92:0/1835199292 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c140126b0 con 0x55d8a3a2b3a0 2024-09-19T09:10:57.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.258+0000 7f6c343bb740 1 -- 172.21.15.92:0/1835199292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8a3a2b3a0 msgr2=0x55d8a3a55a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:57.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.258+0000 7f6c343bb740 1 --2- 172.21.15.92:0/1835199292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8a3a2b3a0 0x55d8a3a55a90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6c14009bb0 tx=0x7f6c14010370 comp rx=0 tx=0).stop 2024-09-19T09:10:57.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.258+0000 7f6c343bb740 1 -- 172.21.15.92:0/1835199292 shutdown_connections 2024-09-19T09:10:57.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.258+0000 7f6c343bb740 1 --2- 172.21.15.92:0/1835199292 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8a3a3e550 0x55d8a3a55fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:57.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.258+0000 7f6c343bb740 1 --2- 172.21.15.92:0/1835199292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8a3a2b3a0 0x55d8a3a55a90 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:57.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.258+0000 7f6c343bb740 1 --2- 172.21.15.92:0/1835199292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8a3a2aa80 0x55d8a3a26160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:57.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.258+0000 7f6c343bb740 1 -- 172.21.15.92:0/1835199292 >> 172.21.15.92:0/1835199292 conn(0x55d8a3a270f0 msgr2=0x55d8a3a25a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:57.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.258+0000 7f6c343bb740 1 -- 172.21.15.92:0/1835199292 shutdown_connections 2024-09-19T09:10:57.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.258+0000 7f6c343bb740 1 -- 172.21.15.92:0/1835199292 wait complete. 2024-09-19T09:10:57.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.259+0000 7f6c343bb740 1 -- start start 2024-09-19T09:10:57.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.259+0000 7f6c343bb740 1 Processor -- start 2024-09-19T09:10:57.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.259+0000 7f6c343bb740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8a3a2aa80 0x55d8a3a46a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:57.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.259+0000 7f6c343bb740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8a3a2b3a0 0x55d8a3a42d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:57.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.259+0000 7f6c343bb740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8a3a3e550 0x55d8a3a432d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:57.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.259+0000 7f6c343bb740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c1aa1a0 con 0x55d8a3a3e550 2024-09-19T09:10:57.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.259+0000 7f6c343bb740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c1ab610 con 0x55d8a3a2b3a0 2024-09-19T09:10:57.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.259+0000 7f6c343bb740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c1aa870 con 0x55d8a3a2aa80 2024-09-19T09:10:57.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.259+0000 7f6c343bb740 10 client.0 _ll_register_callbacks cb 0x7f6c240988b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:10:57.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.259+0000 7f6c23fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8a3a2b3a0 0x55d8a3a42d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:57.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.259+0000 7f6c2b7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8a3a2aa80 0x55d8a3a46a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:57.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.260+0000 7f6c2bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8a3a3e550 0x55d8a3a432d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:57.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.260+0000 7f6c2b7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8a3a2aa80 0x55d8a3a46a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:60884/0 (socket says 172.21.15.92:60884) 2024-09-19T09:10:57.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.260+0000 7f6c23fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8a3a2b3a0 0x55d8a3a42d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:55742/0 (socket says 172.21.15.92:55742) 2024-09-19T09:10:57.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.260+0000 7f6c2b7fe640 1 -- 172.21.15.92:0/1791161126 learned_addr learned my addr 172.21.15.92:0/1791161126 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:57.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.260+0000 7f6c23fff640 1 -- 172.21.15.92:0/1791161126 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8a3a2aa80 msgr2=0x55d8a3a46a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:57.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.260+0000 7f6c23fff640 1 --2- 172.21.15.92:0/1791161126 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8a3a2aa80 0x55d8a3a46a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:57.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.260+0000 7f6c23fff640 1 -- 172.21.15.92:0/1791161126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8a3a3e550 msgr2=0x55d8a3a432d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:57.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.260+0000 7f6c23fff640 1 --2- 172.21.15.92:0/1791161126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8a3a3e550 0x55d8a3a432d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:57.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.260+0000 7f6c23fff640 1 -- 172.21.15.92:0/1791161126 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8a3a43970 con 0x55d8a3a2b3a0 2024-09-19T09:10:57.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.260+0000 7f6c23fff640 1 --2- 172.21.15.92:0/1791161126 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8a3a2b3a0 0x55d8a3a42d90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x55d8a3a3a040 tx=0x7f6c14009370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e53b56a82082c1d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:57.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.262+0000 7f6c0affd640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:10:57.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.262+0000 7f6c0affd640 1 -- 172.21.15.92:0/1791161126 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c1402a060 con 0x55d8a3a2b3a0 2024-09-19T09:10:57.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.262+0000 7f6c0affd640 1 -- 172.21.15.92:0/1791161126 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f6c14010d20 con 0x55d8a3a2b3a0 2024-09-19T09:10:57.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.262+0000 7f6c343bb740 1 -- 172.21.15.92:0/1791161126 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c14005500 con 0x55d8a3a2b3a0 2024-09-19T09:10:57.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.262+0000 7f6c0affd640 1 -- 172.21.15.92:0/1791161126 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6c14009800 con 0x55d8a3a2b3a0 2024-09-19T09:10:57.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.262+0000 7f6c343bb740 10 client.27914 fetch_fsmap learned FSMap version 19 2024-09-19T09:10:57.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.262+0000 7f6c343bb740 1 -- 172.21.15.92:0/1791161126 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55d8a3ab9940 con 0x55d8a3a2b3a0 2024-09-19T09:10:57.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.262+0000 7f6c0affd640 1 -- 172.21.15.92:0/1791161126 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c14005500 con 0x55d8a3a2b3a0 2024-09-19T09:10:57.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.262+0000 7f6c0affd640 1 -- 172.21.15.92:0/1791161126 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f6c1400f040 con 0x55d8a3a2b3a0 2024-09-19T09:10:57.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.262+0000 7f6c343bb740 10 client.27914 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:10:57.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.262+0000 7f6c343bb740 10 client.27914 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:10:57.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.262+0000 7f6c343bb740 20 client.27914 populate_metadata read hostname 'smithi092' 2024-09-19T09:10:57.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.262+0000 7f6c343bb740 1 --2- 172.21.15.92:0/1791161126 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d8a3ab9f60 0x55d8a3abc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:57.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.262+0000 7f6c343bb740 4 client.27914 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:10:57.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.262+0000 7f6c343bb740 1 -- 172.21.15.92:0/1791161126 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d8a3997d00 con 0x55d8a3ab9f60 2024-09-19T09:10:57.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.263+0000 7f6c2b7fe640 1 --2- 172.21.15.92:0/1791161126 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d8a3ab9f60 0x55d8a3abc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:57.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.263+0000 7f6c2b7fe640 1 --2- 172.21.15.92:0/1791161126 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d8a3ab9f60 0x55d8a3abc380 crc :-1 s=READY pgs=421 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1944c73e7fd6ef23 server_cookie=e96743e74f9c9752 in_seq=0 out_seq=0 2024-09-19T09:10:57.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.264+0000 7f6c0affd640 10 client.27914 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:57.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.265+0000 7f6c0affd640 1 -- 172.21.15.92:0/1791161126 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d8a3997d00 con 0x55d8a3ab9f60 2024-09-19T09:10:57.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.265+0000 7f6c0affd640 10 client.27914 handle_command_reply: tid=0 2024-09-19T09:10:57.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.265+0000 7f6c343bb740 1 client.27914 shutdown 2024-09-19T09:10:57.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.265+0000 7f6c343bb740 1 -- 172.21.15.92:0/1791161126 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8a3a2b3a0 msgr2=0x55d8a3a42d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:57.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.265+0000 7f6c343bb740 1 --2- 172.21.15.92:0/1791161126 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8a3a2b3a0 0x55d8a3a42d90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x55d8a3a3a040 tx=0x7f6c14009370 comp rx=0 tx=0).stop 2024-09-19T09:10:57.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.265+0000 7f6c343bb740 1 -- 172.21.15.92:0/1791161126 shutdown_connections 2024-09-19T09:10:57.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.265+0000 7f6c343bb740 1 --2- 172.21.15.92:0/1791161126 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55d8a3ab9f60 0x55d8a3abc380 crc :-1 s=READY pgs=421 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:57.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.265+0000 7f6c343bb740 1 --2- 172.21.15.92:0/1791161126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d8a3a3e550 0x55d8a3a432d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:57.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.266+0000 7f6c0affd640 0 client.27914 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:57.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.266+0000 7f6c343bb740 1 --2- 172.21.15.92:0/1791161126 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d8a3a2b3a0 0x55d8a3a42d90 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:57.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.266+0000 7f6c343bb740 1 --2- 172.21.15.92:0/1791161126 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8a3a2aa80 0x55d8a3a46a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:57.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.266+0000 7f6c343bb740 1 -- 172.21.15.92:0/1791161126 >> 172.21.15.92:0/1791161126 conn(0x55d8a3a270f0 msgr2=0x55d8a3a3bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:57.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.269+0000 7f6c343bb740 1 -- 172.21.15.92:0/1791161126 shutdown_connections 2024-09-19T09:10:57.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.269+0000 7f6c343bb740 1 -- 172.21.15.92:0/1791161126 wait complete. 2024-09-19T09:10:57.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.272+0000 7f6c343bb740 20 client.27914 trim_cache size 0 max 16384 2024-09-19T09:10:57.276 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:10:57.277 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-19T09:10:57.277 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "68137df2-663a-4a1c-941d-6965700f9a79", 2024-09-19T09:10:57.277 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-19T09:10:57.277 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:10:57.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.277+0000 7f6c31fe2640 1 -- 172.21.15.92:0/1630963951 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6c180a32c0 msgr2=0x7f6c180a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:57.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.278+0000 7f6c31fe2640 1 --2- 172.21.15.92:0/1630963951 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6c180a32c0 0x7f6c180a5780 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c0096c0 tx=0x7f6c1c000bc0 comp rx=0 tx=0).stop 2024-09-19T09:10:57.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.278+0000 7f6c31fe2640 1 -- 172.21.15.92:0/1630963951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c2c109120 msgr2=0x7f6c2c19ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:57.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.278+0000 7f6c31fe2640 1 --2- 172.21.15.92:0/1630963951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c2c109120 0x7f6c2c19ef40 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400eb10 tx=0x7f6c2400c2d0 comp rx=0 tx=0).stop 2024-09-19T09:10:57.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.280+0000 7f6c31fe2640 1 -- 172.21.15.92:0/1630963951 shutdown_connections 2024-09-19T09:10:57.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.280+0000 7f6c31fe2640 1 --2- 172.21.15.92:0/1630963951 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6c180a32c0 0x7f6c180a5780 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:57.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.280+0000 7f6c31fe2640 1 --2- 172.21.15.92:0/1630963951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c2c109120 0x7f6c2c19ef40 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:57.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.280+0000 7f6c31fe2640 1 --2- 172.21.15.92:0/1630963951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c2c1049a0 0x7f6c2c19abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:57.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.280+0000 7f6c31fe2640 1 --2- 172.21.15.92:0/1630963951 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c2c103ff0 0x7f6c2c19a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:57.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.280+0000 7f6c31fe2640 1 -- 172.21.15.92:0/1630963951 >> 172.21.15.92:0/1630963951 conn(0x7f6c2c0ffab0 msgr2=0x7f6c2c100d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:57.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.281+0000 7f6c31fe2640 1 -- 172.21.15.92:0/1630963951 shutdown_connections 2024-09-19T09:10:57.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:57.281+0000 7f6c31fe2640 1 -- 172.21.15.92:0/1630963951 wait complete. 2024-09-19T09:10:57.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:57 smithi092 ceph-mon[31407]: pgmap v764: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.1 MiB/s wr, 706 op/s 2024-09-19T09:10:57.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:57 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:57.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:57 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:10:57.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:57 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:10:57.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:57 smithi167 ceph-mon[35359]: pgmap v764: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.1 MiB/s wr, 706 op/s 2024-09-19T09:10:57.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:57 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:57.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:57 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:10:57.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:57 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:10:57.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:57 smithi190 ceph-mon[35358]: pgmap v764: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.1 MiB/s wr, 706 op/s 2024-09-19T09:10:57.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:57 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:57.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:57 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:10:57.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:57 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:10:58.098 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:10:58.491 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:10:58.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:58 smithi092 ceph-mon[31407]: scrub queued for path: / 2024-09-19T09:10:58.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:58 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:10:58.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:58 smithi092 ceph-mon[31407]: scrub summary: active paths [/] 2024-09-19T09:10:58.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:58 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:10:58.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:58 smithi167 ceph-mon[35359]: scrub queued for path: / 2024-09-19T09:10:58.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:58 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:10:58.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:58 smithi167 ceph-mon[35359]: scrub summary: active paths [/] 2024-09-19T09:10:58.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:58 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:10:58.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:58 smithi190 ceph-mon[35358]: scrub queued for path: / 2024-09-19T09:10:58.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:58 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:10:58.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:58 smithi190 ceph-mon[35358]: scrub summary: active paths [/] 2024-09-19T09:10:58.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:58 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:10:59.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.027+0000 7f196a500640 1 -- 172.21.15.92:0/1562325009 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1964108300 msgr2=0x7f196410ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:59.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.027+0000 7f196a500640 1 --2- 172.21.15.92:0/1562325009 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1964108300 0x7f196410ec70 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f195c009cd0 tx=0x7f195c02a8d0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.027+0000 7f196a500640 1 -- 172.21.15.92:0/1562325009 shutdown_connections 2024-09-19T09:10:59.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.027+0000 7f196a500640 1 --2- 172.21.15.92:0/1562325009 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1964108300 0x7f196410ec70 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.027+0000 7f196a500640 1 --2- 172.21.15.92:0/1562325009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1964103780 0x7f1964107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.027+0000 7f196a500640 1 --2- 172.21.15.92:0/1562325009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1964102dd0 0x7f19641031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.027+0000 7f196a500640 1 -- 172.21.15.92:0/1562325009 >> 172.21.15.92:0/1562325009 conn(0x7f19640fc7d0 msgr2=0x7f19640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:59.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.027+0000 7f196a500640 1 -- 172.21.15.92:0/1562325009 shutdown_connections 2024-09-19T09:10:59.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.027+0000 7f196a500640 1 -- 172.21.15.92:0/1562325009 wait complete. 2024-09-19T09:10:59.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.028+0000 7f196a500640 1 Processor -- start 2024-09-19T09:10:59.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.028+0000 7f196a500640 1 -- start start 2024-09-19T09:10:59.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.028+0000 7f196a500640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1964102dd0 0x7f1964073bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:59.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.028+0000 7f196a500640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1964103780 0x7f1964100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:59.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.028+0000 7f196a500640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1964108300 0x7f1964100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:59.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.028+0000 7f19637fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1964103780 0x7f1964100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:59.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.028+0000 7f19637fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1964103780 0x7f1964100a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38922/0 (socket says 172.21.15.92:38922) 2024-09-19T09:10:59.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.028+0000 7f19637fe640 1 -- 172.21.15.92:0/2620635882 learned_addr learned my addr 172.21.15.92:0/2620635882 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:59.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.028+0000 7f1963fff640 1 --2- 172.21.15.92:0/2620635882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1964102dd0 0x7f1964073bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:59.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.028+0000 7f196a500640 1 -- 172.21.15.92:0/2620635882 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f19641120d0 con 0x7f1964103780 2024-09-19T09:10:59.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.028+0000 7f196a500640 1 -- 172.21.15.92:0/2620635882 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1964111f50 con 0x7f1964102dd0 2024-09-19T09:10:59.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.028+0000 7f196a500640 1 -- 172.21.15.92:0/2620635882 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1964112250 con 0x7f1964108300 2024-09-19T09:10:59.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.029+0000 7f1968a9d640 1 --2- 172.21.15.92:0/2620635882 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1964108300 0x7f1964100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:59.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.029+0000 7f1963fff640 1 -- 172.21.15.92:0/2620635882 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1964108300 msgr2=0x7f1964100f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:59.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.029+0000 7f1963fff640 1 --2- 172.21.15.92:0/2620635882 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1964108300 0x7f1964100f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.029+0000 7f1963fff640 1 -- 172.21.15.92:0/2620635882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1964103780 msgr2=0x7f1964100a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:59.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.029+0000 7f1963fff640 1 --2- 172.21.15.92:0/2620635882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1964103780 0x7f1964100a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.029+0000 7f1963fff640 1 -- 172.21.15.92:0/2620635882 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19641014e0 con 0x7f1964102dd0 2024-09-19T09:10:59.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.029+0000 7f1963fff640 1 --2- 172.21.15.92:0/2620635882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1964102dd0 0x7f1964073bc0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f195400d6d0 tx=0x7f195400db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:59.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.030+0000 7f19617fa640 1 -- 172.21.15.92:0/2620635882 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1954017070 con 0x7f1964102dd0 2024-09-19T09:10:59.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.030+0000 7f196a500640 1 -- 172.21.15.92:0/2620635882 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19641017d0 con 0x7f1964102dd0 2024-09-19T09:10:59.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.030+0000 7f19617fa640 1 -- 172.21.15.92:0/2620635882 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1954009820 con 0x7f1964102dd0 2024-09-19T09:10:59.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.030+0000 7f19617fa640 1 -- 172.21.15.92:0/2620635882 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1954004cd0 con 0x7f1964102dd0 2024-09-19T09:10:59.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.030+0000 7f196a500640 1 -- 172.21.15.92:0/2620635882 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19641af8e0 con 0x7f1964102dd0 2024-09-19T09:10:59.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.032+0000 7f19617fa640 1 -- 172.21.15.92:0/2620635882 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f19540099d0 con 0x7f1964102dd0 2024-09-19T09:10:59.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.033+0000 7f196c8d9740 1 Processor -- start 2024-09-19T09:10:59.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.033+0000 7f196c8d9740 1 -- start start 2024-09-19T09:10:59.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.033+0000 7f19617fa640 1 --2- 172.21.15.92:0/2620635882 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f194c0a3490 0x7f194c0a5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:59.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.033+0000 7f196c8d9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588ed5364a0 0x5588ed536880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:59.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.033+0000 7f1968a9d640 1 --2- 172.21.15.92:0/2620635882 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f194c0a3490 0x7f194c0a5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:59.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.033+0000 7f196c8d9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ed536dc0 0x5588ed541140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:59.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.033+0000 7f196c8d9740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588ed541680 0x5588ed543a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:59.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.033+0000 7f196c8d9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5588ed49c2e0 con 0x5588ed536dc0 2024-09-19T09:10:59.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.033+0000 7f196c8d9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5588ed443ce0 con 0x5588ed5364a0 2024-09-19T09:10:59.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.033+0000 7f196c8d9740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5588ed4982a0 con 0x5588ed541680 2024-09-19T09:10:59.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.033+0000 7f19617fa640 1 -- 172.21.15.92:0/2620635882 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1954004a70 con 0x7f1964102dd0 2024-09-19T09:10:59.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.034+0000 7f19637fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ed536dc0 0x5588ed541140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:59.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.034+0000 7f1968a9d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588ed541680 0x5588ed543a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:59.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.034+0000 7f19637fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ed536dc0 0x5588ed541140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38926/0 (socket says 172.21.15.92:38926) 2024-09-19T09:10:59.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.034+0000 7f19637fe640 1 -- 172.21.15.92:0/109028680 learned_addr learned my addr 172.21.15.92:0/109028680 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:59.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.034+0000 7f1963fff640 1 --2- 172.21.15.92:0/109028680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588ed5364a0 0x5588ed536880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:59.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.034+0000 7f19637fe640 1 -- 172.21.15.92:0/109028680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588ed541680 msgr2=0x5588ed543a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:59.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.034+0000 7f19637fe640 1 --2- 172.21.15.92:0/109028680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588ed541680 0x5588ed543a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.034+0000 7f19637fe640 1 -- 172.21.15.92:0/109028680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588ed5364a0 msgr2=0x5588ed536880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:59.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.034+0000 7f19637fe640 1 --2- 172.21.15.92:0/109028680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588ed5364a0 0x5588ed536880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.034+0000 7f19637fe640 1 -- 172.21.15.92:0/109028680 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588ed428440 con 0x5588ed536dc0 2024-09-19T09:10:59.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.034+0000 7f1968a9d640 1 --2- 172.21.15.92:0/109028680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588ed541680 0x5588ed543a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:10:59.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.034+0000 7f1968a9d640 1 --2- 172.21.15.92:0/2620635882 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f194c0a3490 0x7f194c0a5950 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f195c001190 tx=0x7f195c02f4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:59.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.034+0000 7f19637fe640 1 --2- 172.21.15.92:0/109028680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ed536dc0 0x5588ed541140 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f1958009c80 tx=0x7f1958011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca48264464737d48 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:59.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.034+0000 7f194a7fc640 1 -- 172.21.15.92:0/109028680 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1958004220 con 0x5588ed536dc0 2024-09-19T09:10:59.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.034+0000 7f194a7fc640 1 -- 172.21.15.92:0/109028680 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1958009e30 con 0x5588ed536dc0 2024-09-19T09:10:59.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.035+0000 7f194a7fc640 1 -- 172.21.15.92:0/109028680 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1958018790 con 0x5588ed536dc0 2024-09-19T09:10:59.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.035+0000 7f196c8d9740 1 -- 172.21.15.92:0/109028680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ed536dc0 msgr2=0x5588ed541140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:59.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.035+0000 7f196c8d9740 1 --2- 172.21.15.92:0/109028680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ed536dc0 0x5588ed541140 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f1958009c80 tx=0x7f1958011810 comp rx=0 tx=0).stop 2024-09-19T09:10:59.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.036+0000 7f196c8d9740 1 -- 172.21.15.92:0/109028680 shutdown_connections 2024-09-19T09:10:59.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.036+0000 7f196c8d9740 1 --2- 172.21.15.92:0/109028680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588ed541680 0x5588ed543a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.036+0000 7f196c8d9740 1 --2- 172.21.15.92:0/109028680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ed536dc0 0x5588ed541140 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.036+0000 7f196c8d9740 1 --2- 172.21.15.92:0/109028680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588ed5364a0 0x5588ed536880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.036+0000 7f196c8d9740 1 -- 172.21.15.92:0/109028680 >> 172.21.15.92:0/109028680 conn(0x5588ed532a30 msgr2=0x5588ed532e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:59.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.036+0000 7f196c8d9740 1 -- 172.21.15.92:0/109028680 shutdown_connections 2024-09-19T09:10:59.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.036+0000 7f196c8d9740 1 -- 172.21.15.92:0/109028680 wait complete. 2024-09-19T09:10:59.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.036+0000 7f196c8d9740 1 -- start start 2024-09-19T09:10:59.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.036+0000 7f196c8d9740 1 Processor -- start 2024-09-19T09:10:59.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.037+0000 7f196c8d9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588ed5364a0 0x5588ed5410e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:59.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.037+0000 7f196c8d9740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588ed541680 0x5588ed53e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:59.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.037+0000 7f196c8d9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ed53ea80 0x5588ed54d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:59.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.037+0000 7f1963fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588ed5364a0 0x5588ed5410e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:59.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.037+0000 7f196c8d9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5588ed544250 con 0x5588ed53ea80 2024-09-19T09:10:59.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.037+0000 7f196c8d9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5588ed457050 con 0x5588ed5364a0 2024-09-19T09:10:59.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.037+0000 7f196c8d9740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5588ed5443d0 con 0x5588ed541680 2024-09-19T09:10:59.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.037+0000 7f1963fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588ed5364a0 0x5588ed5410e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:55770/0 (socket says 172.21.15.92:55770) 2024-09-19T09:10:59.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.037+0000 7f1963fff640 1 -- 172.21.15.92:0/743603245 learned_addr learned my addr 172.21.15.92:0/743603245 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:59.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.037+0000 7f19637fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588ed541680 0x5588ed53e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:59.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.037+0000 7f1968a9d640 1 --2- 172.21.15.92:0/743603245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ed53ea80 0x5588ed54d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:59.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.038+0000 7f1963fff640 1 -- 172.21.15.92:0/743603245 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588ed541680 msgr2=0x5588ed53e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:59.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.038+0000 7f1963fff640 1 --2- 172.21.15.92:0/743603245 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588ed541680 0x5588ed53e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.038+0000 7f1963fff640 1 -- 172.21.15.92:0/743603245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ed53ea80 msgr2=0x5588ed54d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:59.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.038+0000 7f1963fff640 1 --2- 172.21.15.92:0/743603245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ed53ea80 0x5588ed54d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.038+0000 7f1963fff640 1 -- 172.21.15.92:0/743603245 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588ed20d3c0 con 0x5588ed5364a0 2024-09-19T09:10:59.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.038+0000 7f1968a9d640 1 --2- 172.21.15.92:0/743603245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ed53ea80 0x5588ed54d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:10:59.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.038+0000 7f1963fff640 1 --2- 172.21.15.92:0/743603245 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588ed5364a0 0x5588ed5410e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f19540982c0 tx=0x7f195409c0b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0787d876b1405ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:59.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.038+0000 7f19437fe640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:10:59.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.038+0000 7f196c8d9740 10 client.0 _ll_register_callbacks cb 0x5588ed497160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:10:59.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.038+0000 7f196c8d9740 1 -- 172.21.15.92:0/743603245 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1958009e30 con 0x5588ed5364a0 2024-09-19T09:10:59.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.038+0000 7f19437fe640 1 -- 172.21.15.92:0/743603245 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1954020040 con 0x5588ed5364a0 2024-09-19T09:10:59.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.038+0000 7f19437fe640 1 -- 172.21.15.92:0/743603245 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1954097f60 con 0x5588ed5364a0 2024-09-19T09:10:59.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.038+0000 7f19437fe640 1 -- 172.21.15.92:0/743603245 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f19540a4560 con 0x5588ed5364a0 2024-09-19T09:10:59.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.038+0000 7f196c8d9740 10 client.27926 fetch_fsmap learned FSMap version 19 2024-09-19T09:10:59.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.038+0000 7f196c8d9740 1 -- 172.21.15.92:0/743603245 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5588ed571fb0 con 0x5588ed5364a0 2024-09-19T09:10:59.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.039+0000 7f19437fe640 1 -- 172.21.15.92:0/743603245 <== mon.2 v2:172.21.15.167:3300/0 4 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f195409ad40 con 0x5588ed5364a0 2024-09-19T09:10:59.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.039+0000 7f196c8d9740 10 client.27926 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:10:59.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.039+0000 7f196c8d9740 10 client.27926 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:10:59.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.039+0000 7f196c8d9740 20 client.27926 populate_metadata read hostname 'smithi092' 2024-09-19T09:10:59.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.039+0000 7f196c8d9740 1 --2- 172.21.15.92:0/743603245 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5588ed573620 0x5588ed575ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:59.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.039+0000 7f196c8d9740 4 client.27926 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:10:59.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.039+0000 7f196c8d9740 1 -- 172.21.15.92:0/743603245 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5588ed4a9850 con 0x5588ed573620 2024-09-19T09:10:59.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.039+0000 7f19637fe640 1 --2- 172.21.15.92:0/743603245 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5588ed573620 0x5588ed575ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:59.044 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.040+0000 7f19637fe640 1 --2- 172.21.15.92:0/743603245 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5588ed573620 0x5588ed575ae0 crc :-1 s=READY pgs=422 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26f4f0f11a19a3ec server_cookie=68975939ae69eaa6 in_seq=0 out_seq=0 2024-09-19T09:10:59.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.040+0000 7f19437fe640 10 client.27926 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:59.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.041+0000 7f19437fe640 1 -- 172.21.15.92:0/743603245 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5588ed4a9850 con 0x5588ed573620 2024-09-19T09:10:59.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.041+0000 7f19437fe640 10 client.27926 handle_command_reply: tid=0 2024-09-19T09:10:59.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.041+0000 7f196c8d9740 1 client.27926 shutdown 2024-09-19T09:10:59.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.041+0000 7f196c8d9740 1 -- 172.21.15.92:0/743603245 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588ed5364a0 msgr2=0x5588ed5410e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:59.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.041+0000 7f196c8d9740 1 --2- 172.21.15.92:0/743603245 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588ed5364a0 0x5588ed5410e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f19540982c0 tx=0x7f195409c0b0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.041+0000 7f196c8d9740 1 -- 172.21.15.92:0/743603245 shutdown_connections 2024-09-19T09:10:59.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.041+0000 7f196c8d9740 1 --2- 172.21.15.92:0/743603245 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5588ed573620 0x5588ed575ae0 crc :-1 s=READY pgs=422 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.041+0000 7f19437fe640 0 client.27926 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:59.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.041+0000 7f196c8d9740 1 --2- 172.21.15.92:0/743603245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ed53ea80 0x5588ed54d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.041+0000 7f196c8d9740 1 --2- 172.21.15.92:0/743603245 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588ed541680 0x5588ed53e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.041+0000 7f196c8d9740 1 --2- 172.21.15.92:0/743603245 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588ed5364a0 0x5588ed5410e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.041+0000 7f196c8d9740 1 -- 172.21.15.92:0/743603245 >> 172.21.15.92:0/743603245 conn(0x5588ed532a30 msgr2=0x5588ed538760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:59.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.041+0000 7f196c8d9740 1 -- 172.21.15.92:0/743603245 shutdown_connections 2024-09-19T09:10:59.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.041+0000 7f196c8d9740 1 -- 172.21.15.92:0/743603245 wait complete. 2024-09-19T09:10:59.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.042+0000 7f196c8d9740 20 client.27926 trim_cache size 0 max 16384 2024-09-19T09:10:59.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.063+0000 7f196c8d9740 1 Processor -- start 2024-09-19T09:10:59.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.063+0000 7f196c8d9740 1 -- start start 2024-09-19T09:10:59.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.064+0000 7f196c8d9740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588ed5364a0 0x5588ed53e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:59.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.064+0000 7f196c8d9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ed53ea80 0x5588ed54d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:59.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.064+0000 7f196c8d9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588ed541680 0x5588ed57b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:59.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.064+0000 7f196c8d9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1964101f60 con 0x5588ed53ea80 2024-09-19T09:10:59.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.064+0000 7f196c8d9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f19641a05d0 con 0x5588ed541680 2024-09-19T09:10:59.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.064+0000 7f196c8d9740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f196419e3c0 con 0x5588ed5364a0 2024-09-19T09:10:59.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.064+0000 7f19637fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ed53ea80 0x5588ed54d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:59.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.064+0000 7f1963fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588ed5364a0 0x5588ed53e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:59.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.064+0000 7f19637fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ed53ea80 0x5588ed54d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38942/0 (socket says 172.21.15.92:38942) 2024-09-19T09:10:59.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.064+0000 7f19637fe640 1 -- 172.21.15.92:0/1600885975 learned_addr learned my addr 172.21.15.92:0/1600885975 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:59.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.064+0000 7f1968a9d640 1 --2- 172.21.15.92:0/1600885975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588ed541680 0x5588ed57b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:59.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.064+0000 7f19637fe640 1 -- 172.21.15.92:0/1600885975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588ed5364a0 msgr2=0x5588ed53e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:59.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.064+0000 7f19637fe640 1 --2- 172.21.15.92:0/1600885975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588ed5364a0 0x5588ed53e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.064+0000 7f19637fe640 1 -- 172.21.15.92:0/1600885975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588ed541680 msgr2=0x5588ed57b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:59.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.064+0000 7f19637fe640 1 --2- 172.21.15.92:0/1600885975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588ed541680 0x5588ed57b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.064+0000 7f19637fe640 1 -- 172.21.15.92:0/1600885975 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588ed5362d0 con 0x5588ed53ea80 2024-09-19T09:10:59.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.064+0000 7f19637fe640 1 --2- 172.21.15.92:0/1600885975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ed53ea80 0x5588ed54d4b0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f1958011d10 tx=0x7f1958009720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b26bd93ac358c043 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:59.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.065+0000 7f1949ffb640 1 -- 172.21.15.92:0/1600885975 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195801e040 con 0x5588ed53ea80 2024-09-19T09:10:59.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.065+0000 7f1949ffb640 1 -- 172.21.15.92:0/1600885975 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1958005520 con 0x5588ed53ea80 2024-09-19T09:10:59.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.065+0000 7f1949ffb640 1 -- 172.21.15.92:0/1600885975 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1958004e20 con 0x5588ed53ea80 2024-09-19T09:10:59.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.065+0000 7f196c8d9740 1 -- 172.21.15.92:0/1600885975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ed53ea80 msgr2=0x5588ed54d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:59.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.065+0000 7f196c8d9740 1 --2- 172.21.15.92:0/1600885975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ed53ea80 0x5588ed54d4b0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f1958011d10 tx=0x7f1958009720 comp rx=0 tx=0).stop 2024-09-19T09:10:59.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.065+0000 7f196c8d9740 1 -- 172.21.15.92:0/1600885975 shutdown_connections 2024-09-19T09:10:59.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.066+0000 7f196c8d9740 1 --2- 172.21.15.92:0/1600885975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588ed541680 0x5588ed57b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.066+0000 7f196c8d9740 1 --2- 172.21.15.92:0/1600885975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ed53ea80 0x5588ed54d4b0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.066+0000 7f196c8d9740 1 --2- 172.21.15.92:0/1600885975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588ed5364a0 0x5588ed53e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.066+0000 7f196c8d9740 1 -- 172.21.15.92:0/1600885975 >> 172.21.15.92:0/1600885975 conn(0x5588ed532a30 msgr2=0x5588ed53dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:59.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.066+0000 7f196c8d9740 1 -- 172.21.15.92:0/1600885975 shutdown_connections 2024-09-19T09:10:59.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.066+0000 7f196c8d9740 1 -- 172.21.15.92:0/1600885975 wait complete. 2024-09-19T09:10:59.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.066+0000 7f196c8d9740 1 -- start start 2024-09-19T09:10:59.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.066+0000 7f196c8d9740 1 Processor -- start 2024-09-19T09:10:59.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.066+0000 7f196c8d9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588ed5364a0 0x5588ed549f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:59.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.067+0000 7f196c8d9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ed53ea80 0x5588ed5452c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:59.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.067+0000 7f196c8d9740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588ed541680 0x5588ed545a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:59.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.067+0000 7f196c8d9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f196419ea90 con 0x5588ed53ea80 2024-09-19T09:10:59.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.067+0000 7f196c8d9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f196419ff00 con 0x5588ed5364a0 2024-09-19T09:10:59.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.067+0000 7f196c8d9740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f196419f160 con 0x5588ed541680 2024-09-19T09:10:59.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.067+0000 7f1963fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588ed5364a0 0x5588ed549f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:59.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.067+0000 7f19637fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ed53ea80 0x5588ed5452c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:59.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.067+0000 7f1963fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588ed5364a0 0x5588ed549f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:55794/0 (socket says 172.21.15.92:55794) 2024-09-19T09:10:59.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.067+0000 7f1963fff640 1 -- 172.21.15.92:0/2115195440 learned_addr learned my addr 172.21.15.92:0/2115195440 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:10:59.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.067+0000 7f1968a9d640 1 --2- 172.21.15.92:0/2115195440 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588ed541680 0x5588ed545a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:59.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.067+0000 7f1963fff640 1 -- 172.21.15.92:0/2115195440 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588ed541680 msgr2=0x5588ed545a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:59.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.067+0000 7f1963fff640 1 --2- 172.21.15.92:0/2115195440 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588ed541680 0x5588ed545a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.067+0000 7f1963fff640 1 -- 172.21.15.92:0/2115195440 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ed53ea80 msgr2=0x5588ed5452c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:10:59.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.067+0000 7f1963fff640 1 --2- 172.21.15.92:0/2115195440 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ed53ea80 0x5588ed5452c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.067+0000 7f1963fff640 1 -- 172.21.15.92:0/2115195440 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588ed5336c0 con 0x5588ed5364a0 2024-09-19T09:10:59.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.067+0000 7f196c8d9740 10 client.0 _ll_register_callbacks cb 0x7f1954004cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:10:59.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.067+0000 7f196c8d9740 1 -- 172.21.15.92:0/2115195440 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1958005520 con 0x5588ed5364a0 2024-09-19T09:10:59.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.068+0000 7f1963fff640 1 --2- 172.21.15.92:0/2115195440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588ed5364a0 0x5588ed549f40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1954009790 tx=0x7f1954097cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b902d53bee18165 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:59.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.068+0000 7f19437fe640 10 client.27932 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:10:59.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.068+0000 7f19437fe640 1 -- 172.21.15.92:0/2115195440 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1954020040 con 0x5588ed5364a0 2024-09-19T09:10:59.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.068+0000 7f19437fe640 1 -- 172.21.15.92:0/2115195440 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f19540b4af0 con 0x5588ed5364a0 2024-09-19T09:10:59.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.068+0000 7f19437fe640 1 -- 172.21.15.92:0/2115195440 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f19540b4cf0 con 0x5588ed5364a0 2024-09-19T09:10:59.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.068+0000 7f196c8d9740 10 client.27932 fetch_fsmap learned FSMap version 19 2024-09-19T09:10:59.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.068+0000 7f196c8d9740 1 -- 172.21.15.92:0/2115195440 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5588ed5de020 con 0x5588ed5364a0 2024-09-19T09:10:59.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.069+0000 7f19437fe640 1 -- 172.21.15.92:0/2115195440 <== mon.2 v2:172.21.15.167:3300/0 4 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1954097640 con 0x5588ed5364a0 2024-09-19T09:10:59.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.069+0000 7f196c8d9740 10 client.27932 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:10:59.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.069+0000 7f196c8d9740 10 client.27932 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:10:59.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.069+0000 7f196c8d9740 20 client.27932 populate_metadata read hostname 'smithi092' 2024-09-19T09:10:59.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.069+0000 7f196c8d9740 1 --2- 172.21.15.92:0/2115195440 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5588ed5de450 0x5588ed5e0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:59.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.069+0000 7f196c8d9740 4 client.27932 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:10:59.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.069+0000 7f196c8d9740 1 -- 172.21.15.92:0/2115195440 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5588ed4a3d60 con 0x5588ed5de450 2024-09-19T09:10:59.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.069+0000 7f19637fe640 1 --2- 172.21.15.92:0/2115195440 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5588ed5de450 0x5588ed5e0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:59.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.070+0000 7f19637fe640 1 --2- 172.21.15.92:0/2115195440 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5588ed5de450 0x5588ed5e0840 crc :-1 s=READY pgs=423 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=263b6475f19416a0 server_cookie=f12a8c607c25bee8 in_seq=0 out_seq=0 2024-09-19T09:10:59.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.070+0000 7f19437fe640 10 client.27932 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:59.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.070+0000 7f19437fe640 1 -- 172.21.15.92:0/2115195440 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5588ed4a3d60 con 0x5588ed5de450 2024-09-19T09:10:59.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.070+0000 7f19437fe640 10 client.27932 handle_command_reply: tid=0 2024-09-19T09:10:59.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.070+0000 7f196c8d9740 1 client.27932 shutdown 2024-09-19T09:10:59.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.070+0000 7f196c8d9740 1 -- 172.21.15.92:0/2115195440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588ed5364a0 msgr2=0x5588ed549f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:59.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.070+0000 7f196c8d9740 1 --2- 172.21.15.92:0/2115195440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588ed5364a0 0x5588ed549f40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1954009790 tx=0x7f1954097cc0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.070+0000 7f196c8d9740 1 -- 172.21.15.92:0/2115195440 shutdown_connections 2024-09-19T09:10:59.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.070+0000 7f196c8d9740 1 --2- 172.21.15.92:0/2115195440 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5588ed5de450 0x5588ed5e0840 crc :-1 s=READY pgs=423 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.070+0000 7f19437fe640 0 client.27932 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:10:59.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.070+0000 7f196c8d9740 1 --2- 172.21.15.92:0/2115195440 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588ed541680 0x5588ed545a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.070+0000 7f196c8d9740 1 --2- 172.21.15.92:0/2115195440 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ed53ea80 0x5588ed5452c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.070+0000 7f196c8d9740 1 --2- 172.21.15.92:0/2115195440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5588ed5364a0 0x5588ed549f40 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.070+0000 7f196c8d9740 1 -- 172.21.15.92:0/2115195440 >> 172.21.15.92:0/2115195440 conn(0x5588ed532a30 msgr2=0x5588ed531350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:59.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.070+0000 7f196c8d9740 1 -- 172.21.15.92:0/2115195440 shutdown_connections 2024-09-19T09:10:59.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.070+0000 7f196c8d9740 1 -- 172.21.15.92:0/2115195440 wait complete. 2024-09-19T09:10:59.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.071+0000 7f196c8d9740 20 client.27932 trim_cache size 0 max 16384 2024-09-19T09:10:59.075 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:10:59.075 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-19T09:10:59.075 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {} 2024-09-19T09:10:59.076 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:10:59.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.071+0000 7f196a500640 1 -- 172.21.15.92:0/2620635882 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f194c0a3490 msgr2=0x7f194c0a5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:59.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.071+0000 7f196a500640 1 --2- 172.21.15.92:0/2620635882 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f194c0a3490 0x7f194c0a5950 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f195c001190 tx=0x7f195c02f4a0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.071+0000 7f196a500640 1 -- 172.21.15.92:0/2620635882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1964102dd0 msgr2=0x7f1964073bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:59.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.071+0000 7f196a500640 1 --2- 172.21.15.92:0/2620635882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1964102dd0 0x7f1964073bc0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f195400d6d0 tx=0x7f195400db90 comp rx=0 tx=0).stop 2024-09-19T09:10:59.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.072+0000 7f196a500640 1 -- 172.21.15.92:0/2620635882 shutdown_connections 2024-09-19T09:10:59.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.072+0000 7f196a500640 1 --2- 172.21.15.92:0/2620635882 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1964108300 0x7f1964100f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.072+0000 7f196a500640 1 --2- 172.21.15.92:0/2620635882 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f194c0a3490 0x7f194c0a5950 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.072+0000 7f196a500640 1 --2- 172.21.15.92:0/2620635882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1964103780 0x7f1964100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.072+0000 7f196a500640 1 --2- 172.21.15.92:0/2620635882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1964102dd0 0x7f1964073bc0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.072+0000 7f196a500640 1 -- 172.21.15.92:0/2620635882 >> 172.21.15.92:0/2620635882 conn(0x7f19640fc7d0 msgr2=0x7f19640fe240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:59.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.072+0000 7f196a500640 1 -- 172.21.15.92:0/2620635882 shutdown_connections 2024-09-19T09:10:59.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:10:59.072+0000 7f196a500640 1 -- 172.21.15.92:0/2620635882 wait complete. 2024-09-19T09:10:59.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:59 smithi092 ceph-mon[31407]: scrub summary: idle 2024-09-19T09:10:59.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:10:59 smithi092 ceph-mon[31407]: pgmap v765: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 9.5 MiB/s wr, 735 op/s 2024-09-19T09:10:59.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:59 smithi167 ceph-mon[35359]: scrub summary: idle 2024-09-19T09:10:59.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:10:59 smithi167 ceph-mon[35359]: pgmap v765: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 9.5 MiB/s wr, 735 op/s 2024-09-19T09:10:59.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:59 smithi190 ceph-mon[35358]: scrub summary: idle 2024-09-19T09:10:59.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:10:59 smithi190 ceph-mon[35358]: pgmap v765: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 9.5 MiB/s wr, 735 op/s 2024-09-19T09:11:00.011 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:11:00.012 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:11:00.377 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:11:00.784 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:00 smithi092 ceph-mon[31407]: pgmap v766: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 9.2 MiB/s wr, 777 op/s 2024-09-19T09:11:00.794 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 855.0 s, 2149.0 tps, lat 46.569 ms stddev 59.790 2024-09-19T09:11:01.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:00 smithi167 ceph-mon[35359]: pgmap v766: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 9.2 MiB/s wr, 777 op/s 2024-09-19T09:11:01.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:00 smithi190 ceph-mon[35358]: pgmap v766: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 9.2 MiB/s wr, 777 op/s 2024-09-19T09:11:01.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.209+0000 7f48093d5640 1 -- 172.21.15.92:0/4137825482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4804106f50 msgr2=0x7f480410eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:01.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.209+0000 7f48093d5640 1 --2- 172.21.15.92:0/4137825482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4804106f50 0x7f480410eaf0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f47fc009cd0 tx=0x7f47fc02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:11:01.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.210+0000 7f48093d5640 1 -- 172.21.15.92:0/4137825482 shutdown_connections 2024-09-19T09:11:01.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.210+0000 7f48093d5640 1 --2- 172.21.15.92:0/4137825482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4804106f50 0x7f480410eaf0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:01.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.210+0000 7f48093d5640 1 --2- 172.21.15.92:0/4137825482 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4804100ca0 0x7f4804106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:01.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.210+0000 7f48093d5640 1 --2- 172.21.15.92:0/4137825482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48041002f0 0x7f48041006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:01.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.210+0000 7f48093d5640 1 -- 172.21.15.92:0/4137825482 >> 172.21.15.92:0/4137825482 conn(0x7f4804077220 msgr2=0x7f48040fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:01.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.210+0000 7f48093d5640 1 -- 172.21.15.92:0/4137825482 shutdown_connections 2024-09-19T09:11:01.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.210+0000 7f48093d5640 1 -- 172.21.15.92:0/4137825482 wait complete. 2024-09-19T09:11:01.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.210+0000 7f48093d5640 1 Processor -- start 2024-09-19T09:11:01.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.211+0000 7f48093d5640 1 -- start start 2024-09-19T09:11:01.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.211+0000 7f48093d5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48041002f0 0x7f4804198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:01.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.211+0000 7f48093d5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4804100ca0 0x7f4804198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:01.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.211+0000 7f48093d5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4804106f50 0x7f480419ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:01.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.211+0000 7f48093d5640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4804111fa0 con 0x7f4804100ca0 2024-09-19T09:11:01.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.211+0000 7f48093d5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4804111e20 con 0x7f4804106f50 2024-09-19T09:11:01.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.211+0000 7f48093d5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4804112120 con 0x7f48041002f0 2024-09-19T09:11:01.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.211+0000 7f48037fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4804106f50 0x7f480419ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:01.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.211+0000 7f4802ffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48041002f0 0x7f4804198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:01.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.211+0000 7f48037fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4804106f50 0x7f480419ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:55816/0 (socket says 172.21.15.92:55816) 2024-09-19T09:11:01.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.211+0000 7f48037fe640 1 -- 172.21.15.92:0/529596735 learned_addr learned my addr 172.21.15.92:0/529596735 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:01.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.211+0000 7f48027fc640 1 --2- 172.21.15.92:0/529596735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4804100ca0 0x7f4804198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:01.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.211+0000 7f48037fe640 1 -- 172.21.15.92:0/529596735 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48041002f0 msgr2=0x7f4804198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:01.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.211+0000 7f48037fe640 1 --2- 172.21.15.92:0/529596735 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48041002f0 0x7f4804198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:01.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.211+0000 7f48037fe640 1 -- 172.21.15.92:0/529596735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4804100ca0 msgr2=0x7f4804198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:01.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.211+0000 7f48037fe640 1 --2- 172.21.15.92:0/529596735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4804100ca0 0x7f4804198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:01.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.211+0000 7f48037fe640 1 -- 172.21.15.92:0/529596735 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f480419d3b0 con 0x7f4804106f50 2024-09-19T09:11:01.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.211+0000 7f48027fc640 1 --2- 172.21.15.92:0/529596735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4804100ca0 0x7f4804198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:11:01.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.212+0000 7f48037fe640 1 --2- 172.21.15.92:0/529596735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4804106f50 0x7f480419ccd0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f47fc005cc0 tx=0x7f47fc003970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:01.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.212+0000 7f47ebfff640 1 -- 172.21.15.92:0/529596735 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47fc004040 con 0x7f4804106f50 2024-09-19T09:11:01.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.212+0000 7f48093d5640 1 -- 172.21.15.92:0/529596735 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f480419d640 con 0x7f4804106f50 2024-09-19T09:11:01.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.212+0000 7f47ebfff640 1 -- 172.21.15.92:0/529596735 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47fc0046c0 con 0x7f4804106f50 2024-09-19T09:11:01.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.212+0000 7f47ebfff640 1 -- 172.21.15.92:0/529596735 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47fc030e70 con 0x7f4804106f50 2024-09-19T09:11:01.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.212+0000 7f48093d5640 1 -- 172.21.15.92:0/529596735 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48041011a0 con 0x7f4804106f50 2024-09-19T09:11:01.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.213+0000 7f48093d5640 1 -- 172.21.15.92:0/529596735 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4804199760 con 0x7f4804106f50 2024-09-19T09:11:01.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.215+0000 7f47ebfff640 1 -- 172.21.15.92:0/529596735 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f47fc0305a0 con 0x7f4804106f50 2024-09-19T09:11:01.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.216+0000 7f47ebfff640 1 --2- 172.21.15.92:0/529596735 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f47ec0a32c0 0x7f47ec0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:01.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.217+0000 7f47ebfff640 1 -- 172.21.15.92:0/529596735 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f47fc02e030 con 0x7f4804106f50 2024-09-19T09:11:01.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.217+0000 7f4802ffd640 1 --2- 172.21.15.92:0/529596735 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f47ec0a32c0 0x7f47ec0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:01.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.217+0000 7f4802ffd640 1 --2- 172.21.15.92:0/529596735 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f47ec0a32c0 0x7f47ec0a5780 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f47f4005d00 tx=0x7f47f400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:01.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.218+0000 7f47ebfff640 1 -- 172.21.15.92:0/529596735 <== mon.2 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f47fc0bdcc0 con 0x7f4804106f50 2024-09-19T09:11:01.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.538+0000 7f48093d5640 1 -- 172.21.15.92:0/529596735 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f480402d7c0 con 0x7f4804106f50 2024-09-19T09:11:01.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.539+0000 7f47ebfff640 1 -- 172.21.15.92:0/529596735 <== mon.2 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f47fc0098b0 con 0x7f4804106f50 2024-09-19T09:11:01.540 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:11:01.540 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:11:01.540 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:11:01.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.542+0000 7f48093d5640 1 -- 172.21.15.92:0/529596735 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f47ec0a32c0 msgr2=0x7f47ec0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:01.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.542+0000 7f48093d5640 1 --2- 172.21.15.92:0/529596735 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f47ec0a32c0 0x7f47ec0a5780 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f47f4005d00 tx=0x7f47f400b410 comp rx=0 tx=0).stop 2024-09-19T09:11:01.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.542+0000 7f48093d5640 1 -- 172.21.15.92:0/529596735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4804106f50 msgr2=0x7f480419ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:01.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.542+0000 7f48093d5640 1 --2- 172.21.15.92:0/529596735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4804106f50 0x7f480419ccd0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f47fc005cc0 tx=0x7f47fc003970 comp rx=0 tx=0).stop 2024-09-19T09:11:01.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.542+0000 7f48093d5640 1 -- 172.21.15.92:0/529596735 shutdown_connections 2024-09-19T09:11:01.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.542+0000 7f48093d5640 1 --2- 172.21.15.92:0/529596735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4804106f50 0x7f480419ccd0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:01.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.542+0000 7f48093d5640 1 --2- 172.21.15.92:0/529596735 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f47ec0a32c0 0x7f47ec0a5780 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:01.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.542+0000 7f48093d5640 1 --2- 172.21.15.92:0/529596735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4804100ca0 0x7f4804198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:01.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.542+0000 7f48093d5640 1 --2- 172.21.15.92:0/529596735 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48041002f0 0x7f4804198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:01.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.542+0000 7f48093d5640 1 -- 172.21.15.92:0/529596735 >> 172.21.15.92:0/529596735 conn(0x7f4804077220 msgr2=0x7f48041057b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:01.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.543+0000 7f48093d5640 1 -- 172.21.15.92:0/529596735 shutdown_connections 2024-09-19T09:11:01.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:01.543+0000 7f48093d5640 1 -- 172.21.15.92:0/529596735 wait complete. 2024-09-19T09:11:01.874 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:01 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/529596735' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:11:02.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:01 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/529596735' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:11:02.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:01 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/529596735' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:11:02.269 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:11:02.638 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:11:02.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.767+0000 7ff4d1331640 1 -- 172.21.15.92:0/3128392566 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4cc1056b0 msgr2=0x7ff4cc105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:02.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.767+0000 7ff4d1331640 1 --2- 172.21.15.92:0/3128392566 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4cc1056b0 0x7ff4cc105b60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff4c001a910 tx=0x7ff4c003b450 comp rx=0 tx=0).stop 2024-09-19T09:11:02.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.767+0000 7ff4d1331640 1 -- 172.21.15.92:0/3128392566 shutdown_connections 2024-09-19T09:11:02.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.767+0000 7ff4d1331640 1 --2- 172.21.15.92:0/3128392566 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4cc1056b0 0x7ff4cc105b60 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:02.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.767+0000 7ff4d1331640 1 --2- 172.21.15.92:0/3128392566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4cc102d00 0x7ff4cc105170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:02.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.767+0000 7ff4d1331640 1 --2- 172.21.15.92:0/3128392566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4cc1003b0 0x7ff4cc1027c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:02.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.767+0000 7ff4d1331640 1 -- 172.21.15.92:0/3128392566 >> 172.21.15.92:0/3128392566 conn(0x7ff4cc0fc1e0 msgr2=0x7ff4cc0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:02.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.776+0000 7ff4d1331640 1 -- 172.21.15.92:0/3128392566 shutdown_connections 2024-09-19T09:11:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.780+0000 7ff4d1331640 1 -- 172.21.15.92:0/3128392566 wait complete. 2024-09-19T09:11:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.780+0000 7ff4d1331640 1 Processor -- start 2024-09-19T09:11:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.781+0000 7ff4d1331640 1 -- start start 2024-09-19T09:11:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.781+0000 7ff4d1331640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4cc1003b0 0x7ff4cc195bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.781+0000 7ff4d1331640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4cc102d00 0x7ff4cc196130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.781+0000 7ff4d1331640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4cc1056b0 0x7ff4cc19d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.781+0000 7ff4d1331640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff4cc109660 con 0x7ff4cc1003b0 2024-09-19T09:11:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.781+0000 7ff4d1331640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff4cc1094e0 con 0x7ff4cc102d00 2024-09-19T09:11:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.781+0000 7ff4d1331640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff4cc1097e0 con 0x7ff4cc1056b0 2024-09-19T09:11:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.781+0000 7ff4cb7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4cc1056b0 0x7ff4cc19d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.781+0000 7ff4cb7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4cc1056b0 0x7ff4cc19d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:54634/0 (socket says 172.21.15.92:54634) 2024-09-19T09:11:02.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.781+0000 7ff4cb7fe640 1 -- 172.21.15.92:0/2575298052 learned_addr learned my addr 172.21.15.92:0/2575298052 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:02.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.781+0000 7ff4ca7fc640 1 --2- 172.21.15.92:0/2575298052 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4cc102d00 0x7ff4cc196130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:02.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.782+0000 7ff4cb7fe640 1 -- 172.21.15.92:0/2575298052 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4cc102d00 msgr2=0x7ff4cc196130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:02.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.782+0000 7ff4cb7fe640 1 --2- 172.21.15.92:0/2575298052 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4cc102d00 0x7ff4cc196130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:02.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.782+0000 7ff4cb7fe640 1 -- 172.21.15.92:0/2575298052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4cc1003b0 msgr2=0x7ff4cc195bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:02.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.782+0000 7ff4cb7fe640 1 --2- 172.21.15.92:0/2575298052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4cc1003b0 0x7ff4cc195bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:02.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.782+0000 7ff4cb7fe640 1 -- 172.21.15.92:0/2575298052 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4cc19d810 con 0x7ff4cc1056b0 2024-09-19T09:11:02.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.782+0000 7ff4cb7fe640 1 --2- 172.21.15.92:0/2575298052 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4cc1056b0 0x7ff4cc19d1a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff4c003b970 tx=0x7ff4c0004ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:02.790 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.789+0000 7ff4b3fff640 1 -- 172.21.15.92:0/2575298052 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c004f020 con 0x7ff4cc1056b0 2024-09-19T09:11:02.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.789+0000 7ff4b3fff640 1 -- 172.21.15.92:0/2575298052 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4c0004260 con 0x7ff4cc1056b0 2024-09-19T09:11:02.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.789+0000 7ff4b3fff640 1 -- 172.21.15.92:0/2575298052 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0046070 con 0x7ff4cc1056b0 2024-09-19T09:11:02.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.791+0000 7ff4d1331640 1 -- 172.21.15.92:0/2575298052 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4cc19daa0 con 0x7ff4cc1056b0 2024-09-19T09:11:02.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.791+0000 7ff4d1331640 1 -- 172.21.15.92:0/2575298052 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4cc19df90 con 0x7ff4cc1056b0 2024-09-19T09:11:02.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.797+0000 7ff4d40d0740 1 Processor -- start 2024-09-19T09:11:02.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.797+0000 7ff4d40d0740 1 -- start start 2024-09-19T09:11:02.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.797+0000 7ff4d40d0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643d43489a0 0x5643d4348da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:02.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.797+0000 7ff4d40d0740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5643d43492e0 0x5643d434dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:02.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.797+0000 7ff4d40d0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643d434e370 0x5643d4350830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:02.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.797+0000 7ff4d40d0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5643d42ac2f0 con 0x5643d43489a0 2024-09-19T09:11:02.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.797+0000 7ff4d40d0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5643d4254270 con 0x5643d434e370 2024-09-19T09:11:02.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.797+0000 7ff4d40d0740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5643d42a82b0 con 0x5643d43492e0 2024-09-19T09:11:02.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.797+0000 7ff4b3fff640 1 -- 172.21.15.92:0/2575298052 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff4c0052020 con 0x7ff4cc1056b0 2024-09-19T09:11:02.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.798+0000 7ff4ca7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643d434e370 0x5643d4350830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:02.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.798+0000 7ff4ca7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643d434e370 0x5643d4350830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:49120/0 (socket says 172.21.15.92:49120) 2024-09-19T09:11:02.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.798+0000 7ff4ca7fc640 1 -- 172.21.15.92:0/3590615689 learned_addr learned my addr 172.21.15.92:0/3590615689 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:02.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.798+0000 7ff4ca7fc640 1 --2- 172.21.15.92:0/3590615689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643d43489a0 0x5643d4348da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:02.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.798+0000 7ff4ca7fc640 1 -- 172.21.15.92:0/3590615689 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5643d43492e0 msgr2=0x5643d434dda0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:11:02.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.798+0000 7ff4ca7fc640 1 --2- 172.21.15.92:0/3590615689 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5643d43492e0 0x5643d434dda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:02.801 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.798+0000 7ff4ca7fc640 1 -- 172.21.15.92:0/3590615689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643d43489a0 msgr2=0x5643d4348da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:02.801 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.798+0000 7ff4ca7fc640 1 --2- 172.21.15.92:0/3590615689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643d43489a0 0x5643d4348da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:02.801 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.798+0000 7ff4ca7fc640 1 -- 172.21.15.92:0/3590615689 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643d4253340 con 0x5643d434e370 2024-09-19T09:11:02.801 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.798+0000 7ff4ca7fc640 1 --2- 172.21.15.92:0/3590615689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643d434e370 0x5643d4350830 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4009fc0 tx=0x7ff4c4009cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30d6c9a80747f7f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:02.801 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.800+0000 7ff4b17fa640 1 -- 172.21.15.92:0/3590615689 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c401c070 con 0x5643d434e370 2024-09-19T09:11:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.800+0000 7ff4b17fa640 1 -- 172.21.15.92:0/3590615689 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4c4008af0 con 0x5643d434e370 2024-09-19T09:11:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.800+0000 7ff4b17fa640 1 -- 172.21.15.92:0/3590615689 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c4017ce0 con 0x5643d434e370 2024-09-19T09:11:02.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.801+0000 7ff4d40d0740 1 -- 172.21.15.92:0/3590615689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643d434e370 msgr2=0x5643d4350830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:02.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.801+0000 7ff4d40d0740 1 --2- 172.21.15.92:0/3590615689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643d434e370 0x5643d4350830 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4009fc0 tx=0x7ff4c4009cc0 comp rx=0 tx=0).stop 2024-09-19T09:11:02.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.802+0000 7ff4d40d0740 1 -- 172.21.15.92:0/3590615689 shutdown_connections 2024-09-19T09:11:02.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.802+0000 7ff4d40d0740 1 --2- 172.21.15.92:0/3590615689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643d434e370 0x5643d4350830 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:02.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.802+0000 7ff4d40d0740 1 --2- 172.21.15.92:0/3590615689 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5643d43492e0 0x5643d434dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:02.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.802+0000 7ff4d40d0740 1 --2- 172.21.15.92:0/3590615689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643d43489a0 0x5643d4348da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:02.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.802+0000 7ff4d40d0740 1 -- 172.21.15.92:0/3590615689 >> 172.21.15.92:0/3590615689 conn(0x5643d4344010 msgr2=0x5643d4344410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.802+0000 7ff4b3fff640 1 --2- 172.21.15.92:0/2575298052 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff4b40a34e0 0x7ff4b40a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.802+0000 7ff4b3fff640 1 -- 172.21.15.92:0/2575298052 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff4c01009b0 con 0x7ff4cc1056b0 2024-09-19T09:11:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.802+0000 7ff4d40d0740 1 -- 172.21.15.92:0/3590615689 shutdown_connections 2024-09-19T09:11:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.803+0000 7ff4d40d0740 1 -- 172.21.15.92:0/3590615689 wait complete. 2024-09-19T09:11:02.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.803+0000 7ff4d40d0740 1 -- start start 2024-09-19T09:11:02.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.803+0000 7ff4d40d0740 1 Processor -- start 2024-09-19T09:11:02.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.803+0000 7ff4d40d0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643d43489a0 0x5643d4363c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:02.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.804+0000 7ff4d40d0740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5643d43492e0 0x5643d43641a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:02.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.804+0000 7ff4d40d0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643d434e370 0x5643d436b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:02.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.804+0000 7ff4d40d0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5643d4362350 con 0x5643d43489a0 2024-09-19T09:11:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.804+0000 7ff4d40d0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5643d4235290 con 0x5643d434e370 2024-09-19T09:11:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.804+0000 7ff4d40d0740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5643d43624d0 con 0x5643d43492e0 2024-09-19T09:11:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.804+0000 7ff4caffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643d43489a0 0x5643d4363c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.804+0000 7ff4d40d0740 10 client.0 _ll_register_callbacks cb 0x5643d4266140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:11:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.804+0000 7ff4caffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643d43489a0 0x5643d4363c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49036/0 (socket says 172.21.15.92:49036) 2024-09-19T09:11:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.804+0000 7ff4caffd640 1 -- 172.21.15.92:0/2740509051 learned_addr learned my addr 172.21.15.92:0/2740509051 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.804+0000 7ff4caffd640 1 -- 172.21.15.92:0/2740509051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5643d43492e0 msgr2=0x5643d43641a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:11:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.804+0000 7ff4caffd640 1 --2- 172.21.15.92:0/2740509051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5643d43492e0 0x5643d43641a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.804+0000 7ff4caffd640 1 -- 172.21.15.92:0/2740509051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643d434e370 msgr2=0x5643d436b1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:11:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.804+0000 7ff4caffd640 1 --2- 172.21.15.92:0/2740509051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643d434e370 0x5643d436b1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.804+0000 7ff4caffd640 1 -- 172.21.15.92:0/2740509051 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643d3fbf210 con 0x5643d43489a0 2024-09-19T09:11:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.804+0000 7ff4caffd640 1 --2- 172.21.15.92:0/2575298052 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff4b40a34e0 0x7ff4b40a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:02.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.811+0000 7ff4caffd640 1 --2- 172.21.15.92:0/2740509051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643d43489a0 0x5643d4363c60 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc00dd90 tx=0x7ff4bc00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bcce60f62f5d3be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:02.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.814+0000 7ff4aeff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:11:02.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.814+0000 7ff4aeff5640 1 -- 172.21.15.92:0/2740509051 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc044060 con 0x5643d43489a0 2024-09-19T09:11:02.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.814+0000 7ff4aeff5640 1 -- 172.21.15.92:0/2740509051 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff4bc033be0 con 0x5643d43489a0 2024-09-19T09:11:02.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.815+0000 7ff4d40d0740 1 -- 172.21.15.92:0/2740509051 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4c4008af0 con 0x5643d43489a0 2024-09-19T09:11:02.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.816+0000 7ff4caffd640 1 --2- 172.21.15.92:0/2575298052 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff4b40a34e0 0x7ff4b40a59a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc041000 tx=0x7ff4bc042000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:02.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.816+0000 7ff4aeff5640 1 -- 172.21.15.92:0/2740509051 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff4bc032d40 con 0x5643d43489a0 2024-09-19T09:11:02.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.816+0000 7ff4d40d0740 10 client.18735 fetch_fsmap learned FSMap version 19 2024-09-19T09:11:02.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.816+0000 7ff4d40d0740 1 -- 172.21.15.92:0/2740509051 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5643d408b620 con 0x5643d43489a0 2024-09-19T09:11:02.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.816+0000 7ff4aeff5640 1 -- 172.21.15.92:0/2740509051 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4c4008af0 con 0x5643d43489a0 2024-09-19T09:11:02.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.816+0000 7ff4aeff5640 1 -- 172.21.15.92:0/2740509051 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff4bc047050 con 0x5643d43489a0 2024-09-19T09:11:02.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.816+0000 7ff4d40d0740 10 client.18735 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:11:02.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.817+0000 7ff4d40d0740 10 client.18735 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:11:02.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.817+0000 7ff4d40d0740 20 client.18735 populate_metadata read hostname 'smithi092' 2024-09-19T09:11:02.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.817+0000 7ff4d40d0740 1 --2- 172.21.15.92:0/2740509051 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5643d436f9a0 0x5643d4371e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:02.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.817+0000 7ff4d40d0740 4 client.18735 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:11:02.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.817+0000 7ff4d40d0740 1 -- 172.21.15.92:0/2740509051 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643d42b9a20 con 0x5643d436f9a0 2024-09-19T09:11:02.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.817+0000 7ff4ca7fc640 1 --2- 172.21.15.92:0/2740509051 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5643d436f9a0 0x5643d4371e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:02.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.818+0000 7ff4ca7fc640 1 --2- 172.21.15.92:0/2740509051 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5643d436f9a0 0x5643d4371e40 crc :-1 s=READY pgs=424 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6244a8848a1630d8 server_cookie=16898441e26e59d9 in_seq=0 out_seq=0 2024-09-19T09:11:02.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.818+0000 7ff4aeff5640 10 client.18735 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.825+0000 7ff4aeff5640 1 -- 172.21.15.92:0/2740509051 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5643d42b9a20 con 0x5643d436f9a0 2024-09-19T09:11:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.825+0000 7ff4aeff5640 10 client.18735 handle_command_reply: tid=0 2024-09-19T09:11:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.825+0000 7ff4d40d0740 1 client.18735 shutdown 2024-09-19T09:11:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.825+0000 7ff4d40d0740 1 -- 172.21.15.92:0/2740509051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643d43489a0 msgr2=0x5643d4363c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.825+0000 7ff4d40d0740 1 --2- 172.21.15.92:0/2740509051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643d43489a0 0x5643d4363c60 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc00dd90 tx=0x7ff4bc00f730 comp rx=0 tx=0).stop 2024-09-19T09:11:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.827+0000 7ff4d40d0740 1 -- 172.21.15.92:0/2740509051 shutdown_connections 2024-09-19T09:11:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.827+0000 7ff4d40d0740 1 --2- 172.21.15.92:0/2740509051 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5643d436f9a0 0x5643d4371e40 crc :-1 s=READY pgs=424 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.828+0000 7ff4aeff5640 0 client.18735 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.828+0000 7ff4d40d0740 1 --2- 172.21.15.92:0/2740509051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643d434e370 0x5643d436b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.828+0000 7ff4d40d0740 1 --2- 172.21.15.92:0/2740509051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5643d43492e0 0x5643d43641a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.828+0000 7ff4d40d0740 1 --2- 172.21.15.92:0/2740509051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643d43489a0 0x5643d4363c60 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.828+0000 7ff4d40d0740 1 -- 172.21.15.92:0/2740509051 >> 172.21.15.92:0/2740509051 conn(0x5643d4344010 msgr2=0x5643d4345820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.828+0000 7ff4d40d0740 1 -- 172.21.15.92:0/2740509051 shutdown_connections 2024-09-19T09:11:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.828+0000 7ff4d40d0740 1 -- 172.21.15.92:0/2740509051 wait complete. 2024-09-19T09:11:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.828+0000 7ff4d40d0740 20 client.18735 trim_cache size 0 max 16384 2024-09-19T09:11:02.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.850+0000 7ff4d40d0740 1 Processor -- start 2024-09-19T09:11:02.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.850+0000 7ff4d40d0740 1 -- start start 2024-09-19T09:11:02.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.851+0000 7ff4d40d0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643d43489a0 0x5643d4345400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:02.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.851+0000 7ff4d40d0740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5643d43492e0 0x5643d436b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:02.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.851+0000 7ff4d40d0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643d434e370 0x5643d4345940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:02.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.851+0000 7ff4caffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643d43489a0 0x5643d4345400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:02.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.851+0000 7ff4ca7fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5643d43492e0 0x5643d436b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:02.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.851+0000 7ff4caffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643d43489a0 0x5643d4345400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49040/0 (socket says 172.21.15.92:49040) 2024-09-19T09:11:02.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.851+0000 7ff4ca7fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5643d43492e0 0x5643d436b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:54648/0 (socket says 172.21.15.92:54648) 2024-09-19T09:11:02.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.851+0000 7ff4caffd640 1 -- 172.21.15.92:0/2464454822 learned_addr learned my addr 172.21.15.92:0/2464454822 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:02.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.851+0000 7ff4d40d0740 1 -- 172.21.15.92:0/2464454822 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff4cc072820 con 0x5643d43489a0 2024-09-19T09:11:02.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.851+0000 7ff4d40d0740 1 -- 172.21.15.92:0/2464454822 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff4cc19ef00 con 0x5643d434e370 2024-09-19T09:11:02.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.851+0000 7ff4d40d0740 1 -- 172.21.15.92:0/2464454822 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff4cc072e90 con 0x5643d43492e0 2024-09-19T09:11:02.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.851+0000 7ff4cb7fe640 1 --2- 172.21.15.92:0/2464454822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643d434e370 0x5643d4345940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:02.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.852+0000 7ff4caffd640 1 -- 172.21.15.92:0/2464454822 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5643d43492e0 msgr2=0x5643d436b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:02.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.852+0000 7ff4caffd640 1 --2- 172.21.15.92:0/2464454822 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5643d43492e0 0x5643d436b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:02.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.852+0000 7ff4caffd640 1 -- 172.21.15.92:0/2464454822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643d434e370 msgr2=0x5643d4345940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:02.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.852+0000 7ff4caffd640 1 --2- 172.21.15.92:0/2464454822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643d434e370 0x5643d4345940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:02.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.852+0000 7ff4caffd640 1 -- 172.21.15.92:0/2464454822 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643d43640f0 con 0x5643d43489a0 2024-09-19T09:11:02.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.852+0000 7ff4caffd640 1 --2- 172.21.15.92:0/2464454822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643d43489a0 0x5643d4345400 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc00fc30 tx=0x7ff4bc00fea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=365c512df43abc5b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:02.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.852+0000 7ff4b0ff9640 1 -- 172.21.15.92:0/2464454822 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc04d070 con 0x5643d43489a0 2024-09-19T09:11:02.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.852+0000 7ff4b0ff9640 1 -- 172.21.15.92:0/2464454822 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4bc03a070 con 0x5643d43489a0 2024-09-19T09:11:02.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.852+0000 7ff4b0ff9640 1 -- 172.21.15.92:0/2464454822 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc0479a0 con 0x5643d43489a0 2024-09-19T09:11:02.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.853+0000 7ff4d40d0740 1 -- 172.21.15.92:0/2464454822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643d43489a0 msgr2=0x5643d4345400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:02.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.853+0000 7ff4d40d0740 1 --2- 172.21.15.92:0/2464454822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643d43489a0 0x5643d4345400 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc00fc30 tx=0x7ff4bc00fea0 comp rx=0 tx=0).stop 2024-09-19T09:11:02.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.853+0000 7ff4d40d0740 1 -- 172.21.15.92:0/2464454822 shutdown_connections 2024-09-19T09:11:02.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.853+0000 7ff4d40d0740 1 --2- 172.21.15.92:0/2464454822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643d434e370 0x5643d4345940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:02.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.853+0000 7ff4d40d0740 1 --2- 172.21.15.92:0/2464454822 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5643d43492e0 0x5643d436b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:02.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.853+0000 7ff4d40d0740 1 --2- 172.21.15.92:0/2464454822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643d43489a0 0x5643d4345400 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:02.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.853+0000 7ff4d40d0740 1 -- 172.21.15.92:0/2464454822 >> 172.21.15.92:0/2464454822 conn(0x5643d4344010 msgr2=0x5643d43431c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:02.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.853+0000 7ff4d40d0740 1 -- 172.21.15.92:0/2464454822 shutdown_connections 2024-09-19T09:11:02.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.853+0000 7ff4d40d0740 1 -- 172.21.15.92:0/2464454822 wait complete. 2024-09-19T09:11:02.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.853+0000 7ff4d40d0740 1 -- start start 2024-09-19T09:11:02.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.853+0000 7ff4d40d0740 1 Processor -- start 2024-09-19T09:11:02.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.854+0000 7ff4d40d0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643d43489a0 0x5643d436ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:02.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.854+0000 7ff4d40d0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643d43492e0 0x5643d436b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:02.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.854+0000 7ff4d40d0740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5643d434e370 0x5643d43691e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:02.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.854+0000 7ff4d40d0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff4cc073560 con 0x5643d43492e0 2024-09-19T09:11:02.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.854+0000 7ff4d40d0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff4cc19e830 con 0x5643d43489a0 2024-09-19T09:11:02.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.854+0000 7ff4d40d0740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff4cc073c30 con 0x5643d434e370 2024-09-19T09:11:02.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.854+0000 7ff4caffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643d43489a0 0x5643d436ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:02.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.854+0000 7ff4d40d0740 10 client.0 _ll_register_callbacks cb 0x7ff4bc00d3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:11:02.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.854+0000 7ff4caffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643d43489a0 0x5643d436ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:49150/0 (socket says 172.21.15.92:49150) 2024-09-19T09:11:02.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.854+0000 7ff4caffd640 1 -- 172.21.15.92:0/3270995579 learned_addr learned my addr 172.21.15.92:0/3270995579 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:02.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.854+0000 7ff4cb7fe640 1 --2- 172.21.15.92:0/3270995579 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5643d434e370 0x5643d43691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:02.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.854+0000 7ff4caffd640 1 -- 172.21.15.92:0/3270995579 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5643d434e370 msgr2=0x5643d43691e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:02.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.854+0000 7ff4caffd640 1 --2- 172.21.15.92:0/3270995579 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5643d434e370 0x5643d43691e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:02.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.854+0000 7ff4caffd640 1 -- 172.21.15.92:0/3270995579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643d43492e0 msgr2=0x5643d436b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:02.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.854+0000 7ff4caffd640 1 --2- 172.21.15.92:0/3270995579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643d43492e0 0x5643d436b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:02.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.854+0000 7ff4caffd640 1 -- 172.21.15.92:0/3270995579 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643d43699f0 con 0x5643d43489a0 2024-09-19T09:11:02.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.855+0000 7ff4caffd640 1 --2- 172.21.15.92:0/3270995579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643d43489a0 0x5643d436ab60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc005e70 tx=0x7ff4bc00da20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c657f93e5a05e08 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:02.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.855+0000 7ff4aeff5640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:11:02.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.855+0000 7ff4aeff5640 1 -- 172.21.15.92:0/3270995579 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc05e060 con 0x5643d43489a0 2024-09-19T09:11:02.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.855+0000 7ff4aeff5640 1 -- 172.21.15.92:0/3270995579 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff4bc047ab0 con 0x5643d43489a0 2024-09-19T09:11:02.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.855+0000 7ff4d40d0740 1 -- 172.21.15.92:0/3270995579 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4bc03a070 con 0x5643d43489a0 2024-09-19T09:11:02.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.855+0000 7ff4aeff5640 1 -- 172.21.15.92:0/3270995579 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff4bc04d040 con 0x5643d43489a0 2024-09-19T09:11:02.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.855+0000 7ff4d40d0740 10 client.27950 fetch_fsmap learned FSMap version 19 2024-09-19T09:11:02.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.855+0000 7ff4d40d0740 1 -- 172.21.15.92:0/3270995579 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5643d43db230 con 0x5643d43489a0 2024-09-19T09:11:02.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.855+0000 7ff4aeff5640 1 -- 172.21.15.92:0/3270995579 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4bc03a070 con 0x5643d43489a0 2024-09-19T09:11:02.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.856+0000 7ff4aeff5640 1 -- 172.21.15.92:0/3270995579 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff4bc063070 con 0x5643d43489a0 2024-09-19T09:11:02.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.856+0000 7ff4d40d0740 10 client.27950 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:11:02.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.856+0000 7ff4d40d0740 10 client.27950 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:11:02.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.856+0000 7ff4d40d0740 20 client.27950 populate_metadata read hostname 'smithi092' 2024-09-19T09:11:02.862 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.856+0000 7ff4d40d0740 1 --2- 172.21.15.92:0/3270995579 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5643d436f9a0 0x5643d43ddb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:02.862 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.856+0000 7ff4d40d0740 4 client.27950 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:11:02.862 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.856+0000 7ff4d40d0740 1 -- 172.21.15.92:0/3270995579 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5643d42b3d70 con 0x5643d436f9a0 2024-09-19T09:11:02.862 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.856+0000 7ff4ca7fc640 1 --2- 172.21.15.92:0/3270995579 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5643d436f9a0 0x5643d43ddb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:02.862 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.857+0000 7ff4aeff5640 10 client.27950 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:02.862 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.857+0000 7ff4ca7fc640 1 --2- 172.21.15.92:0/3270995579 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5643d436f9a0 0x5643d43ddb70 crc :-1 s=READY pgs=425 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49d4e781ca038243 server_cookie=8bfec495d63ff081 in_seq=0 out_seq=0 2024-09-19T09:11:02.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.886+0000 7ff4aeff5640 1 -- 172.21.15.92:0/3270995579 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5643d42b3d70 con 0x5643d436f9a0 2024-09-19T09:11:02.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.886+0000 7ff4aeff5640 10 client.27950 handle_command_reply: tid=0 2024-09-19T09:11:02.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.887+0000 7ff4d40d0740 1 client.27950 shutdown 2024-09-19T09:11:02.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.887+0000 7ff4d40d0740 1 -- 172.21.15.92:0/3270995579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643d43489a0 msgr2=0x5643d436ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:02.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.887+0000 7ff4d40d0740 1 --2- 172.21.15.92:0/3270995579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643d43489a0 0x5643d436ab60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc005e70 tx=0x7ff4bc00da20 comp rx=0 tx=0).stop 2024-09-19T09:11:02.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.887+0000 7ff4d40d0740 1 -- 172.21.15.92:0/3270995579 shutdown_connections 2024-09-19T09:11:02.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.887+0000 7ff4d40d0740 1 --2- 172.21.15.92:0/3270995579 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5643d436f9a0 0x5643d43ddb70 crc :-1 s=READY pgs=425 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:02.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.887+0000 7ff4aeff5640 0 client.27950 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:02.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.887+0000 7ff4d40d0740 1 --2- 172.21.15.92:0/3270995579 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5643d434e370 0x5643d43691e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:02.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.887+0000 7ff4d40d0740 1 --2- 172.21.15.92:0/3270995579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5643d43492e0 0x5643d436b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:02.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.887+0000 7ff4d40d0740 1 --2- 172.21.15.92:0/3270995579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643d43489a0 0x5643d436ab60 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:02.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.887+0000 7ff4d40d0740 1 -- 172.21.15.92:0/3270995579 >> 172.21.15.92:0/3270995579 conn(0x5643d4344010 msgr2=0x5643d43431c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:02.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.888+0000 7ff4d40d0740 1 -- 172.21.15.92:0/3270995579 shutdown_connections 2024-09-19T09:11:02.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.888+0000 7ff4d40d0740 1 -- 172.21.15.92:0/3270995579 wait complete. 2024-09-19T09:11:02.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.888+0000 7ff4d40d0740 20 client.27950 trim_cache size 0 max 16384 2024-09-19T09:11:02.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:11:02.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:11:02.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:11:02.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:11:02.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.888+0000 7ff4d1331640 1 -- 172.21.15.92:0/2575298052 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff4b40a34e0 msgr2=0x7ff4b40a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:02.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.888+0000 7ff4d1331640 1 --2- 172.21.15.92:0/2575298052 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff4b40a34e0 0x7ff4b40a59a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc041000 tx=0x7ff4bc042000 comp rx=0 tx=0).stop 2024-09-19T09:11:02.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.888+0000 7ff4d1331640 1 -- 172.21.15.92:0/2575298052 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4cc1056b0 msgr2=0x7ff4cc19d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:02.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.888+0000 7ff4d1331640 1 --2- 172.21.15.92:0/2575298052 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4cc1056b0 0x7ff4cc19d1a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff4c003b970 tx=0x7ff4c0004ac0 comp rx=0 tx=0).stop 2024-09-19T09:11:02.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.888+0000 7ff4d1331640 1 -- 172.21.15.92:0/2575298052 shutdown_connections 2024-09-19T09:11:02.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.888+0000 7ff4d1331640 1 --2- 172.21.15.92:0/2575298052 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4cc1056b0 0x7ff4cc19d1a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:02.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.888+0000 7ff4d1331640 1 --2- 172.21.15.92:0/2575298052 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4cc102d00 0x7ff4cc196130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:02.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.888+0000 7ff4d1331640 1 --2- 172.21.15.92:0/2575298052 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff4b40a34e0 0x7ff4b40a59a0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:02.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.888+0000 7ff4d1331640 1 --2- 172.21.15.92:0/2575298052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4cc1003b0 0x7ff4cc195bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:02.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.888+0000 7ff4d1331640 1 -- 172.21.15.92:0/2575298052 >> 172.21.15.92:0/2575298052 conn(0x7ff4cc0fc1e0 msgr2=0x7ff4cc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:02.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.888+0000 7ff4d1331640 1 -- 172.21.15.92:0/2575298052 shutdown_connections 2024-09-19T09:11:02.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:02.888+0000 7ff4d1331640 1 -- 172.21.15.92:0/2575298052 wait complete. 2024-09-19T09:11:02.962 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:02 smithi092 ceph-mon[31407]: pgmap v767: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 8.8 MiB/s wr, 751 op/s 2024-09-19T09:11:03.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:02 smithi167 ceph-mon[35359]: pgmap v767: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 8.8 MiB/s wr, 751 op/s 2024-09-19T09:11:03.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:02 smithi190 ceph-mon[35358]: pgmap v767: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 8.8 MiB/s wr, 751 op/s 2024-09-19T09:11:03.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.428+0000 7f404f0d7640 1 -- 172.21.15.92:0/3590220120 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4048100e20 msgr2=0x7f4048101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:03.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.428+0000 7f404f0d7640 1 --2- 172.21.15.92:0/3590220120 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4048100e20 0x7f4048101200 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4040009c10 tx=0x7f404002a7a0 comp rx=0 tx=0).stop 2024-09-19T09:11:03.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.429+0000 7f404f0d7640 1 -- 172.21.15.92:0/3590220120 shutdown_connections 2024-09-19T09:11:03.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.429+0000 7f404f0d7640 1 --2- 172.21.15.92:0/3590220120 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4048102ef0 0x7f404810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:03.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.429+0000 7f404f0d7640 1 --2- 172.21.15.92:0/3590220120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4048102570 0x7f40481029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:03.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.429+0000 7f404f0d7640 1 --2- 172.21.15.92:0/3590220120 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4048100e20 0x7f4048101200 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:03.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.429+0000 7f404f0d7640 1 -- 172.21.15.92:0/3590220120 >> 172.21.15.92:0/3590220120 conn(0x7f40480fc7d0 msgr2=0x7f40480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:03.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.432+0000 7f404f0d7640 1 -- 172.21.15.92:0/3590220120 shutdown_connections 2024-09-19T09:11:03.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.432+0000 7f404f0d7640 1 -- 172.21.15.92:0/3590220120 wait complete. 2024-09-19T09:11:03.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.433+0000 7f404f0d7640 1 Processor -- start 2024-09-19T09:11:03.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.434+0000 7f404f0d7640 1 -- start start 2024-09-19T09:11:03.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.434+0000 7f404f0d7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4048100e20 0x7f4048197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:03.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.434+0000 7f404f0d7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4048102570 0x7f4048197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:03.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.434+0000 7f404f0d7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4048102ef0 0x7f404819bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:03.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.434+0000 7f404f0d7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4048110f00 con 0x7f4048100e20 2024-09-19T09:11:03.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.435+0000 7f404f0d7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4048110d80 con 0x7f4048102ef0 2024-09-19T09:11:03.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.435+0000 7f404f0d7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4048111080 con 0x7f4048102570 2024-09-19T09:11:03.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.435+0000 7f404d674640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4048102ef0 0x7f404819bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:03.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.435+0000 7f404ce73640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4048100e20 0x7f4048197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:03.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.435+0000 7f404d674640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4048102ef0 0x7f404819bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:49164/0 (socket says 172.21.15.92:49164) 2024-09-19T09:11:03.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.435+0000 7f404d674640 1 -- 172.21.15.92:0/26801065 learned_addr learned my addr 172.21.15.92:0/26801065 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:03.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.435+0000 7f4047fff640 1 --2- 172.21.15.92:0/26801065 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4048102570 0x7f4048197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:03.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.435+0000 7f404d674640 1 -- 172.21.15.92:0/26801065 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4048102570 msgr2=0x7f4048197960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:03.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.435+0000 7f404d674640 1 --2- 172.21.15.92:0/26801065 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4048102570 0x7f4048197960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:03.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.435+0000 7f404d674640 1 -- 172.21.15.92:0/26801065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4048100e20 msgr2=0x7f4048197420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:03.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.435+0000 7f404d674640 1 --2- 172.21.15.92:0/26801065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4048100e20 0x7f4048197420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:03.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.436+0000 7f404d674640 1 -- 172.21.15.92:0/26801065 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f404819c3d0 con 0x7f4048102ef0 2024-09-19T09:11:03.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.436+0000 7f404ce73640 1 --2- 172.21.15.92:0/26801065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4048100e20 0x7f4048197420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:11:03.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.436+0000 7f404d674640 1 --2- 172.21.15.92:0/26801065 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4048102ef0 0x7f404819bcf0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4038009c40 tx=0x7f403800d6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:03.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.436+0000 7f4045ffb640 1 -- 172.21.15.92:0/26801065 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4038005020 con 0x7f4048102ef0 2024-09-19T09:11:03.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.436+0000 7f404f0d7640 1 -- 172.21.15.92:0/26801065 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f404819c6c0 con 0x7f4048102ef0 2024-09-19T09:11:03.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.436+0000 7f4045ffb640 1 -- 172.21.15.92:0/26801065 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40380047a0 con 0x7f4048102ef0 2024-09-19T09:11:03.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.436+0000 7f4045ffb640 1 -- 172.21.15.92:0/26801065 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4038005020 con 0x7f4048102ef0 2024-09-19T09:11:03.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.437+0000 7f404f0d7640 1 -- 172.21.15.92:0/26801065 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4048069f70 con 0x7f4048102ef0 2024-09-19T09:11:03.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.440+0000 7f4045ffb640 1 -- 172.21.15.92:0/26801065 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f40380051c0 con 0x7f4048102ef0 2024-09-19T09:11:03.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.441+0000 7f4045ffb640 1 --2- 172.21.15.92:0/26801065 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f40300a3490 0x7f40300a5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:03.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.442+0000 7f4045ffb640 1 -- 172.21.15.92:0/26801065 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f40380cf0f0 con 0x7f4048102ef0 2024-09-19T09:11:03.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.442+0000 7f404ce73640 1 --2- 172.21.15.92:0/26801065 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f40300a3490 0x7f40300a5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:03.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.444+0000 7f404ce73640 1 --2- 172.21.15.92:0/26801065 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f40300a3490 0x7f40300a5950 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f4040009be0 tx=0x7f4040000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:03.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.444+0000 7f40514b0740 1 Processor -- start 2024-09-19T09:11:03.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.444+0000 7f40514b0740 1 -- start start 2024-09-19T09:11:03.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.445+0000 7f40514b0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b2996cb40 0x564b2996b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:03.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.445+0000 7f40514b0740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b2996b5d0 0x564b2996ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:03.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.445+0000 7f40514b0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b29976370 0x564b29978760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:03.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.446+0000 7f40514b0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564b298d12f0 con 0x564b29976370 2024-09-19T09:11:03.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.446+0000 7f40514b0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564b29878cf0 con 0x564b2996cb40 2024-09-19T09:11:03.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.446+0000 7f40514b0740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x564b298cd2b0 con 0x564b2996b5d0 2024-09-19T09:11:03.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.446+0000 7f404ce73640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b2996cb40 0x564b2996b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:03.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.446+0000 7f404d674640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b29976370 0x564b29978760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:03.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.446+0000 7f4047fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b2996b5d0 0x564b2996ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:03.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.446+0000 7f404d674640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b29976370 0x564b29978760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49064/0 (socket says 172.21.15.92:49064) 2024-09-19T09:11:03.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.446+0000 7f404d674640 1 -- 172.21.15.92:0/3209431352 learned_addr learned my addr 172.21.15.92:0/3209431352 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:03.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.446+0000 7f404ce73640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b2996cb40 0x564b2996b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:49174/0 (socket says 172.21.15.92:49174) 2024-09-19T09:11:03.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.447+0000 7f404ce73640 1 -- 172.21.15.92:0/3209431352 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b2996b5d0 msgr2=0x564b2996ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:03.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.447+0000 7f404ce73640 1 --2- 172.21.15.92:0/3209431352 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b2996b5d0 0x564b2996ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:03.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.447+0000 7f404ce73640 1 -- 172.21.15.92:0/3209431352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b29976370 msgr2=0x564b29978760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:03.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.447+0000 7f404ce73640 1 --2- 172.21.15.92:0/3209431352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b29976370 0x564b29978760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:03.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.447+0000 7f404ce73640 1 -- 172.21.15.92:0/3209431352 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b2985d3a0 con 0x564b2996cb40 2024-09-19T09:11:03.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.447+0000 7f404ce73640 1 --2- 172.21.15.92:0/3209431352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b2996cb40 0x564b2996b090 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f404002ad90 tx=0x7f404003d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bffb3d7d0f19d0e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:03.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.448+0000 7f402effd640 1 -- 172.21.15.92:0/3209431352 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4040036050 con 0x564b2996cb40 2024-09-19T09:11:03.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.448+0000 7f402effd640 1 -- 172.21.15.92:0/3209431352 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4040049070 con 0x564b2996cb40 2024-09-19T09:11:03.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.448+0000 7f402effd640 1 -- 172.21.15.92:0/3209431352 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4040036050 con 0x564b2996cb40 2024-09-19T09:11:03.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.448+0000 7f40514b0740 1 -- 172.21.15.92:0/3209431352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b2996cb40 msgr2=0x564b2996b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:03.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.448+0000 7f40514b0740 1 --2- 172.21.15.92:0/3209431352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b2996cb40 0x564b2996b090 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f404002ad90 tx=0x7f404003d000 comp rx=0 tx=0).stop 2024-09-19T09:11:03.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.448+0000 7f40514b0740 1 -- 172.21.15.92:0/3209431352 shutdown_connections 2024-09-19T09:11:03.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.448+0000 7f40514b0740 1 --2- 172.21.15.92:0/3209431352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b29976370 0x564b29978760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:03.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.449+0000 7f40514b0740 1 --2- 172.21.15.92:0/3209431352 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b2996b5d0 0x564b2996ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:03.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.449+0000 7f40514b0740 1 --2- 172.21.15.92:0/3209431352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b2996cb40 0x564b2996b090 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:03.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.449+0000 7f40514b0740 1 -- 172.21.15.92:0/3209431352 >> 172.21.15.92:0/3209431352 conn(0x564b29934310 msgr2=0x564b29967c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:03.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.449+0000 7f40514b0740 1 -- 172.21.15.92:0/3209431352 shutdown_connections 2024-09-19T09:11:03.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.449+0000 7f40514b0740 1 -- 172.21.15.92:0/3209431352 wait complete. 2024-09-19T09:11:03.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.449+0000 7f40514b0740 1 -- start start 2024-09-19T09:11:03.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.449+0000 7f40514b0740 1 Processor -- start 2024-09-19T09:11:03.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.450+0000 7f40514b0740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b2996b5d0 0x564b29975d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:03.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.450+0000 7f40514b0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b2996cb40 0x564b29972fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:03.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.450+0000 7f40514b0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b29976370 0x564b29973560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:03.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.450+0000 7f40514b0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564b29979010 con 0x564b29976370 2024-09-19T09:11:03.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.450+0000 7f40514b0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564b2988c060 con 0x564b2996cb40 2024-09-19T09:11:03.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.450+0000 7f40514b0740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x564b29979190 con 0x564b2996b5d0 2024-09-19T09:11:03.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.450+0000 7f40514b0740 10 client.0 _ll_register_callbacks cb 0x564b295df8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:11:03.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.450+0000 7f404ce73640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b2996b5d0 0x564b29975d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:03.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.450+0000 7f404ce73640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b2996b5d0 0x564b29975d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:54688/0 (socket says 172.21.15.92:54688) 2024-09-19T09:11:03.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.450+0000 7f404ce73640 1 -- 172.21.15.92:0/3158393389 learned_addr learned my addr 172.21.15.92:0/3158393389 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:03.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.450+0000 7f4047fff640 1 --2- 172.21.15.92:0/3158393389 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b2996cb40 0x564b29972fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:03.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.450+0000 7f404d674640 1 --2- 172.21.15.92:0/3158393389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b29976370 0x564b29973560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:03.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.451+0000 7f4047fff640 1 -- 172.21.15.92:0/3158393389 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b2996b5d0 msgr2=0x564b29975d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:03.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.451+0000 7f4047fff640 1 --2- 172.21.15.92:0/3158393389 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b2996b5d0 0x564b29975d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:03.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.451+0000 7f4047fff640 1 -- 172.21.15.92:0/3158393389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b29976370 msgr2=0x564b29973560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:03.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.451+0000 7f4047fff640 1 --2- 172.21.15.92:0/3158393389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b29976370 0x564b29973560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:03.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.451+0000 7f4047fff640 1 -- 172.21.15.92:0/3158393389 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b296423c0 con 0x564b2996cb40 2024-09-19T09:11:03.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.451+0000 7f4047fff640 1 --2- 172.21.15.92:0/3158393389 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b2996cb40 0x564b29972fc0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f40480fec10 tx=0x7f403c003ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85e8380489ccd3c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:03.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.451+0000 7f4027fff640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:11:03.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.452+0000 7f4027fff640 1 -- 172.21.15.92:0/3158393389 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f403c023020 con 0x564b2996cb40 2024-09-19T09:11:03.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.452+0000 7f4027fff640 1 -- 172.21.15.92:0/3158393389 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f403c009df0 con 0x564b2996cb40 2024-09-19T09:11:03.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.452+0000 7f40514b0740 1 -- 172.21.15.92:0/3158393389 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4040049070 con 0x564b2996cb40 2024-09-19T09:11:03.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.452+0000 7f4027fff640 1 -- 172.21.15.92:0/3158393389 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f403c01f450 con 0x564b2996cb40 2024-09-19T09:11:03.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.453+0000 7f40514b0740 10 client.27962 fetch_fsmap learned FSMap version 19 2024-09-19T09:11:03.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.453+0000 7f40514b0740 1 -- 172.21.15.92:0/3158393389 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x564b29984ac0 con 0x564b2996cb40 2024-09-19T09:11:03.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.453+0000 7f4027fff640 1 -- 172.21.15.92:0/3158393389 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4040049070 con 0x564b2996cb40 2024-09-19T09:11:03.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.453+0000 7f4027fff640 1 -- 172.21.15.92:0/3158393389 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f403c02a830 con 0x564b2996cb40 2024-09-19T09:11:03.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.454+0000 7f40514b0740 10 client.27962 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:11:03.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.454+0000 7f40514b0740 10 client.27962 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:11:03.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.454+0000 7f40514b0740 20 client.27962 populate_metadata read hostname 'smithi092' 2024-09-19T09:11:03.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.454+0000 7f40514b0740 1 --2- 172.21.15.92:0/3158393389 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564b29986440 0x564b299888e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:03.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.454+0000 7f40514b0740 4 client.27962 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:11:03.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.454+0000 7f40514b0740 1 -- 172.21.15.92:0/3158393389 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b298de860 con 0x564b29986440 2024-09-19T09:11:03.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.454+0000 7f404ce73640 1 --2- 172.21.15.92:0/3158393389 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564b29986440 0x564b299888e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:03.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.455+0000 7f4027fff640 10 client.27962 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:03.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.455+0000 7f404ce73640 1 --2- 172.21.15.92:0/3158393389 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564b29986440 0x564b299888e0 crc :-1 s=READY pgs=426 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21ec8f57dbbbdbe3 server_cookie=1a8e3ed97747d443 in_seq=0 out_seq=0 2024-09-19T09:11:03.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.455+0000 7f4027fff640 1 -- 172.21.15.92:0/3158393389 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564b298de860 con 0x564b29986440 2024-09-19T09:11:03.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.455+0000 7f4027fff640 10 client.27962 handle_command_reply: tid=0 2024-09-19T09:11:03.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.456+0000 7f40514b0740 1 client.27962 shutdown 2024-09-19T09:11:03.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.456+0000 7f40514b0740 1 -- 172.21.15.92:0/3158393389 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b2996cb40 msgr2=0x564b29972fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:03.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.456+0000 7f40514b0740 1 --2- 172.21.15.92:0/3158393389 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b2996cb40 0x564b29972fc0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f40480fec10 tx=0x7f403c003ec0 comp rx=0 tx=0).stop 2024-09-19T09:11:03.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.456+0000 7f40514b0740 1 -- 172.21.15.92:0/3158393389 shutdown_connections 2024-09-19T09:11:03.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.456+0000 7f40514b0740 1 --2- 172.21.15.92:0/3158393389 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564b29986440 0x564b299888e0 crc :-1 s=READY pgs=426 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:03.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.456+0000 7f40514b0740 1 --2- 172.21.15.92:0/3158393389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b29976370 0x564b29973560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:03.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.456+0000 7f40514b0740 1 --2- 172.21.15.92:0/3158393389 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b2996cb40 0x564b29972fc0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:03.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.457+0000 7f40514b0740 1 --2- 172.21.15.92:0/3158393389 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b2996b5d0 0x564b29975d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:03.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.457+0000 7f40514b0740 1 -- 172.21.15.92:0/3158393389 >> 172.21.15.92:0/3158393389 conn(0x564b29934310 msgr2=0x564b2996d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:03.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.457+0000 7f4027fff640 0 client.27962 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:03.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.457+0000 7f40514b0740 1 -- 172.21.15.92:0/3158393389 shutdown_connections 2024-09-19T09:11:03.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.457+0000 7f40514b0740 1 -- 172.21.15.92:0/3158393389 wait complete. 2024-09-19T09:11:03.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.457+0000 7f40514b0740 20 client.27962 trim_cache size 0 max 16384 2024-09-19T09:11:03.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.476+0000 7f40514b0740 1 Processor -- start 2024-09-19T09:11:03.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.476+0000 7f40514b0740 1 -- start start 2024-09-19T09:11:03.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.476+0000 7f40514b0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b2996b5d0 0x564b299822b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:03.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.476+0000 7f40514b0740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b2996cb40 0x564b2998e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:03.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.476+0000 7f40514b0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b29976370 0x564b2998e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:03.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.476+0000 7f40514b0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f40481a9400 con 0x564b29976370 2024-09-19T09:11:03.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.476+0000 7f40514b0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f40481abca0 con 0x564b2996b5d0 2024-09-19T09:11:03.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.476+0000 7f40514b0740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f40481a9a90 con 0x564b2996cb40 2024-09-19T09:11:03.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.476+0000 7f404ce73640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b2996b5d0 0x564b299822b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:03.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.476+0000 7f404ce73640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b2996b5d0 0x564b299822b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:49198/0 (socket says 172.21.15.92:49198) 2024-09-19T09:11:03.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.476+0000 7f404ce73640 1 -- 172.21.15.92:0/2248827583 learned_addr learned my addr 172.21.15.92:0/2248827583 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:03.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.477+0000 7f404d674640 1 --2- 172.21.15.92:0/2248827583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b29976370 0x564b2998e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:03.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.477+0000 7f404ce73640 1 -- 172.21.15.92:0/2248827583 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b2996cb40 msgr2=0x564b2998e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:03.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.477+0000 7f404ce73640 1 --2- 172.21.15.92:0/2248827583 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b2996cb40 0x564b2998e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:03.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.477+0000 7f404ce73640 1 -- 172.21.15.92:0/2248827583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b29976370 msgr2=0x564b2998e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:03.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.477+0000 7f404ce73640 1 --2- 172.21.15.92:0/2248827583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b29976370 0x564b2998e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:03.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.477+0000 7f404ce73640 1 -- 172.21.15.92:0/2248827583 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b29976080 con 0x564b2996b5d0 2024-09-19T09:11:03.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.477+0000 7f404ce73640 1 --2- 172.21.15.92:0/2248827583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b2996b5d0 0x564b299822b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4040004480 tx=0x7f40400044b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4461ea8fdf5688b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:03.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.478+0000 7f402e7fc640 1 -- 172.21.15.92:0/2248827583 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404005e070 con 0x564b2996b5d0 2024-09-19T09:11:03.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.478+0000 7f402e7fc640 1 -- 172.21.15.92:0/2248827583 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4040049050 con 0x564b2996b5d0 2024-09-19T09:11:03.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.478+0000 7f402e7fc640 1 -- 172.21.15.92:0/2248827583 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4040036040 con 0x564b2996b5d0 2024-09-19T09:11:03.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.479+0000 7f40514b0740 1 -- 172.21.15.92:0/2248827583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b2996b5d0 msgr2=0x564b299822b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:03.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.479+0000 7f40514b0740 1 --2- 172.21.15.92:0/2248827583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b2996b5d0 0x564b299822b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4040004480 tx=0x7f40400044b0 comp rx=0 tx=0).stop 2024-09-19T09:11:03.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.479+0000 7f40514b0740 1 -- 172.21.15.92:0/2248827583 shutdown_connections 2024-09-19T09:11:03.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.479+0000 7f40514b0740 1 --2- 172.21.15.92:0/2248827583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b29976370 0x564b2998e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:03.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.479+0000 7f40514b0740 1 --2- 172.21.15.92:0/2248827583 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b2996cb40 0x564b2998e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:03.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.479+0000 7f40514b0740 1 --2- 172.21.15.92:0/2248827583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b2996b5d0 0x564b299822b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:03.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.479+0000 7f40514b0740 1 -- 172.21.15.92:0/2248827583 >> 172.21.15.92:0/2248827583 conn(0x564b29934310 msgr2=0x564b29971890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:03.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.479+0000 7f40514b0740 1 -- 172.21.15.92:0/2248827583 shutdown_connections 2024-09-19T09:11:03.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.479+0000 7f40514b0740 1 -- 172.21.15.92:0/2248827583 wait complete. 2024-09-19T09:11:03.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.479+0000 7f40514b0740 1 -- start start 2024-09-19T09:11:03.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.479+0000 7f40514b0740 1 Processor -- start 2024-09-19T09:11:03.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.480+0000 7f40514b0740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b2996b5d0 0x564b2997ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:03.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.480+0000 7f40514b0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b2996cb40 0x564b2996fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:03.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.480+0000 7f40514b0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b29976370 0x564b29970080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:03.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.480+0000 7f404ce73640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b2996b5d0 0x564b2997ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:03.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.480+0000 7f404ce73640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b2996b5d0 0x564b2997ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:54710/0 (socket says 172.21.15.92:54710) 2024-09-19T09:11:03.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.480+0000 7f404ce73640 1 -- 172.21.15.92:0/4085764127 learned_addr learned my addr 172.21.15.92:0/4085764127 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:03.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.480+0000 7f4047fff640 1 --2- 172.21.15.92:0/4085764127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b2996cb40 0x564b2996fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:03.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.480+0000 7f404d674640 1 --2- 172.21.15.92:0/4085764127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b29976370 0x564b29970080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:03.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.480+0000 7f40514b0740 1 -- 172.21.15.92:0/4085764127 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f40481aa160 con 0x564b29976370 2024-09-19T09:11:03.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.481+0000 7f40514b0740 1 -- 172.21.15.92:0/4085764127 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f40481ab5d0 con 0x564b2996cb40 2024-09-19T09:11:03.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.481+0000 7f40514b0740 1 -- 172.21.15.92:0/4085764127 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f40481aa830 con 0x564b2996b5d0 2024-09-19T09:11:03.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.481+0000 7f40514b0740 10 client.0 _ll_register_callbacks cb 0x7f403c0040f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:11:03.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.482+0000 7f4047fff640 1 -- 172.21.15.92:0/4085764127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b2996b5d0 msgr2=0x564b2997ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:03.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.482+0000 7f4047fff640 1 --2- 172.21.15.92:0/4085764127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b2996b5d0 0x564b2997ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:03.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.482+0000 7f4047fff640 1 -- 172.21.15.92:0/4085764127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b29976370 msgr2=0x564b29970080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:03.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.482+0000 7f4047fff640 1 --2- 172.21.15.92:0/4085764127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b29976370 0x564b29970080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:03.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.482+0000 7f4047fff640 1 -- 172.21.15.92:0/4085764127 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b299706c0 con 0x564b2996cb40 2024-09-19T09:11:03.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.482+0000 7f4047fff640 1 --2- 172.21.15.92:0/4085764127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b2996cb40 0x564b2996fb40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x564b29974570 tx=0x7f403c0096e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aaaa48def885e9b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:03.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.482+0000 7f4027fff640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:11:03.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.482+0000 7f4027fff640 1 -- 172.21.15.92:0/4085764127 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f403c038020 con 0x564b2996cb40 2024-09-19T09:11:03.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.482+0000 7f4027fff640 1 -- 172.21.15.92:0/4085764127 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f403c02a840 con 0x564b2996cb40 2024-09-19T09:11:03.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.482+0000 7f40514b0740 1 -- 172.21.15.92:0/4085764127 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4040049050 con 0x564b2996cb40 2024-09-19T09:11:03.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.483+0000 7f4027fff640 1 -- 172.21.15.92:0/4085764127 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f403c023050 con 0x564b2996cb40 2024-09-19T09:11:03.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.483+0000 7f40514b0740 10 client.27968 fetch_fsmap learned FSMap version 19 2024-09-19T09:11:03.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.483+0000 7f40514b0740 1 -- 172.21.15.92:0/4085764127 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x564b299f0ff0 con 0x564b2996cb40 2024-09-19T09:11:03.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.483+0000 7f4027fff640 1 -- 172.21.15.92:0/4085764127 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4040049050 con 0x564b2996cb40 2024-09-19T09:11:03.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.483+0000 7f4027fff640 1 -- 172.21.15.92:0/4085764127 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f403c01e650 con 0x564b2996cb40 2024-09-19T09:11:03.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.483+0000 7f40514b0740 10 client.27968 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:11:03.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.483+0000 7f40514b0740 10 client.27968 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:11:03.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.483+0000 7f40514b0740 20 client.27968 populate_metadata read hostname 'smithi092' 2024-09-19T09:11:03.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.483+0000 7f40514b0740 1 --2- 172.21.15.92:0/4085764127 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564b299f16b0 0x564b299f3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:03.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.483+0000 7f40514b0740 4 client.27968 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:11:03.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.483+0000 7f40514b0740 1 -- 172.21.15.92:0/4085764127 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564b298d8d70 con 0x564b299f16b0 2024-09-19T09:11:03.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.484+0000 7f404ce73640 1 --2- 172.21.15.92:0/4085764127 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564b299f16b0 0x564b299f3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:03.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.484+0000 7f4027fff640 10 client.27968 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:03.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.484+0000 7f404ce73640 1 --2- 172.21.15.92:0/4085764127 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564b299f16b0 0x564b299f3ad0 crc :-1 s=READY pgs=427 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6a13d6ded0e6808 server_cookie=d6b48920f25ef343 in_seq=0 out_seq=0 2024-09-19T09:11:03.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.485+0000 7f4027fff640 1 -- 172.21.15.92:0/4085764127 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564b298d8d70 con 0x564b299f16b0 2024-09-19T09:11:03.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.485+0000 7f4027fff640 10 client.27968 handle_command_reply: tid=0 2024-09-19T09:11:03.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.485+0000 7f40514b0740 1 client.27968 shutdown 2024-09-19T09:11:03.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.485+0000 7f40514b0740 1 -- 172.21.15.92:0/4085764127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b2996cb40 msgr2=0x564b2996fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:03.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.485+0000 7f40514b0740 1 --2- 172.21.15.92:0/4085764127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b2996cb40 0x564b2996fb40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x564b29974570 tx=0x7f403c0096e0 comp rx=0 tx=0).stop 2024-09-19T09:11:03.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.485+0000 7f40514b0740 1 -- 172.21.15.92:0/4085764127 shutdown_connections 2024-09-19T09:11:03.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.485+0000 7f40514b0740 1 --2- 172.21.15.92:0/4085764127 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564b299f16b0 0x564b299f3ad0 crc :-1 s=READY pgs=427 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:03.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.485+0000 7f40514b0740 1 --2- 172.21.15.92:0/4085764127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b29976370 0x564b29970080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:03.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.485+0000 7f40514b0740 1 --2- 172.21.15.92:0/4085764127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564b2996cb40 0x564b2996fb40 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:03.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.485+0000 7f40514b0740 1 --2- 172.21.15.92:0/4085764127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564b2996b5d0 0x564b2997ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:03.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.485+0000 7f40514b0740 1 -- 172.21.15.92:0/4085764127 >> 172.21.15.92:0/4085764127 conn(0x564b29934310 msgr2=0x564b29975040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:03.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.485+0000 7f4027fff640 0 client.27968 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:03.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.485+0000 7f40514b0740 1 -- 172.21.15.92:0/4085764127 shutdown_connections 2024-09-19T09:11:03.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.485+0000 7f40514b0740 1 -- 172.21.15.92:0/4085764127 wait complete. 2024-09-19T09:11:03.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.485+0000 7f40514b0740 20 client.27968 trim_cache size 0 max 16384 2024-09-19T09:11:03.491 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-19T09:11:03.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.487+0000 7f404f0d7640 1 -- 172.21.15.92:0/26801065 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f40300a3490 msgr2=0x7f40300a5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:03.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.487+0000 7f404f0d7640 1 --2- 172.21.15.92:0/26801065 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f40300a3490 0x7f40300a5950 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f4040009be0 tx=0x7f4040000f40 comp rx=0 tx=0).stop 2024-09-19T09:11:03.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.487+0000 7f404f0d7640 1 -- 172.21.15.92:0/26801065 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4048102ef0 msgr2=0x7f404819bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:03.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.487+0000 7f404f0d7640 1 --2- 172.21.15.92:0/26801065 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4048102ef0 0x7f404819bcf0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4038009c40 tx=0x7f403800d6b0 comp rx=0 tx=0).stop 2024-09-19T09:11:03.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.487+0000 7f404f0d7640 1 -- 172.21.15.92:0/26801065 shutdown_connections 2024-09-19T09:11:03.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.487+0000 7f404f0d7640 1 --2- 172.21.15.92:0/26801065 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4048102ef0 0x7f404819bcf0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:03.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.487+0000 7f404f0d7640 1 --2- 172.21.15.92:0/26801065 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4048102570 0x7f4048197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:03.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.487+0000 7f404f0d7640 1 --2- 172.21.15.92:0/26801065 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f40300a3490 0x7f40300a5950 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:03.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.487+0000 7f404f0d7640 1 --2- 172.21.15.92:0/26801065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4048100e20 0x7f4048197420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:03.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.487+0000 7f404f0d7640 1 -- 172.21.15.92:0/26801065 >> 172.21.15.92:0/26801065 conn(0x7f40480fc7d0 msgr2=0x7f40481048b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:03.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.487+0000 7f404f0d7640 1 -- 172.21.15.92:0/26801065 shutdown_connections 2024-09-19T09:11:03.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:03.487+0000 7f404f0d7640 1 -- 172.21.15.92:0/26801065 wait complete. 2024-09-19T09:11:04.690 INFO:tasks.quiescer.fs.[cephfs]:Total duration (58.9) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T09:11:04.691 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.45 2024-09-19T09:11:04.691 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:11:05.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:04 smithi092 ceph-mon[31407]: pgmap v768: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 9.1 MiB/s wr, 763 op/s 2024-09-19T09:11:05.098 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:11:05.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:04 smithi167 ceph-mon[35359]: pgmap v768: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 9.1 MiB/s wr, 763 op/s 2024-09-19T09:11:05.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:04 smithi190 ceph-mon[35358]: pgmap v768: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 9.1 MiB/s wr, 763 op/s 2024-09-19T09:11:05.228 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:11:05.229 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:11:05.795 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 860.0 s, 2696.4 tps, lat 37.159 ms stddev 44.839 2024-09-19T09:11:05.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.844+0000 7fdabe606640 1 -- 172.21.15.92:0/1468655360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdab8106a90 msgr2=0x7fdab8106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:05.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.844+0000 7fdabe606640 1 --2- 172.21.15.92:0/1468655360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdab8106a90 0x7fdab8106e70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fdab0009be0 tx=0x7fdab002c900 comp rx=0 tx=0).stop 2024-09-19T09:11:05.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.844+0000 7fdabe606640 1 -- 172.21.15.92:0/1468655360 shutdown_connections 2024-09-19T09:11:05.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.844+0000 7fdabe606640 1 --2- 172.21.15.92:0/1468655360 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdab8101430 0x7fdab810d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:05.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.844+0000 7fdabe606640 1 --2- 172.21.15.92:0/1468655360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdab8100a90 0x7fdab8100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:05.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.844+0000 7fdabe606640 1 --2- 172.21.15.92:0/1468655360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdab8106a90 0x7fdab8106e70 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:05.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.844+0000 7fdabe606640 1 -- 172.21.15.92:0/1468655360 >> 172.21.15.92:0/1468655360 conn(0x7fdab80fc7d0 msgr2=0x7fdab80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:05.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.844+0000 7fdabe606640 1 -- 172.21.15.92:0/1468655360 shutdown_connections 2024-09-19T09:11:05.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.844+0000 7fdabe606640 1 -- 172.21.15.92:0/1468655360 wait complete. 2024-09-19T09:11:05.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.845+0000 7fdabe606640 1 Processor -- start 2024-09-19T09:11:05.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.846+0000 7fdabe606640 1 -- start start 2024-09-19T09:11:05.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.846+0000 7fdabe606640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdab8100a90 0x7fdab8196070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:05.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.846+0000 7fdabe606640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdab8101430 0x7fdab81965b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:05.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.846+0000 7fdabe606640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdab8106a90 0x7fdab8196af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:05.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.846+0000 7fdabe606640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdab810fd80 con 0x7fdab8101430 2024-09-19T09:11:05.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.846+0000 7fdabe606640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdab810fc00 con 0x7fdab8100a90 2024-09-19T09:11:05.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.846+0000 7fdabe606640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fdab810ff00 con 0x7fdab8106a90 2024-09-19T09:11:05.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.846+0000 7fdab77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdab8101430 0x7fdab81965b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:05.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.846+0000 7fdab77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdab8101430 0x7fdab81965b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49102/0 (socket says 172.21.15.92:49102) 2024-09-19T09:11:05.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.846+0000 7fdab77fe640 1 -- 172.21.15.92:0/2845432193 learned_addr learned my addr 172.21.15.92:0/2845432193 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:05.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.846+0000 7fdab7fff640 1 --2- 172.21.15.92:0/2845432193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdab8100a90 0x7fdab8196070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:05.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.847+0000 7fdabcba3640 1 --2- 172.21.15.92:0/2845432193 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdab8106a90 0x7fdab8196af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:05.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.847+0000 7fdab77fe640 1 -- 172.21.15.92:0/2845432193 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdab8106a90 msgr2=0x7fdab8196af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:05.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.847+0000 7fdab77fe640 1 --2- 172.21.15.92:0/2845432193 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdab8106a90 0x7fdab8196af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:05.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.847+0000 7fdab77fe640 1 -- 172.21.15.92:0/2845432193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdab8100a90 msgr2=0x7fdab8196070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:05.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.847+0000 7fdab77fe640 1 --2- 172.21.15.92:0/2845432193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdab8100a90 0x7fdab8196070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:05.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.847+0000 7fdab77fe640 1 -- 172.21.15.92:0/2845432193 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdab81aacf0 con 0x7fdab8101430 2024-09-19T09:11:05.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.847+0000 7fdab77fe640 1 --2- 172.21.15.92:0/2845432193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdab8101430 0x7fdab81965b0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fdaac00d980 tx=0x7fdaac00de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:05.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.847+0000 7fdab57fa640 1 -- 172.21.15.92:0/2845432193 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaac017070 con 0x7fdab8101430 2024-09-19T09:11:05.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.847+0000 7fdabe606640 1 -- 172.21.15.92:0/2845432193 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdab81aafe0 con 0x7fdab8101430 2024-09-19T09:11:05.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.847+0000 7fdab57fa640 1 -- 172.21.15.92:0/2845432193 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdaac009c30 con 0x7fdab8101430 2024-09-19T09:11:05.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.847+0000 7fdab57fa640 1 -- 172.21.15.92:0/2845432193 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaac00f6b0 con 0x7fdab8101430 2024-09-19T09:11:05.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.847+0000 7fdabe606640 1 -- 172.21.15.92:0/2845432193 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdab81ab4e0 con 0x7fdab8101430 2024-09-19T09:11:05.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.851+0000 7fdabe606640 1 -- 172.21.15.92:0/2845432193 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdab81021d0 con 0x7fdab8101430 2024-09-19T09:11:05.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.851+0000 7fdab57fa640 1 -- 172.21.15.92:0/2845432193 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fdaac010460 con 0x7fdab8101430 2024-09-19T09:11:05.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.852+0000 7fdab57fa640 1 --2- 172.21.15.92:0/2845432193 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdaa00a32c0 0x7fdaa00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:05.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.852+0000 7fdab57fa640 1 -- 172.21.15.92:0/2845432193 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fdaac0cf3c0 con 0x7fdab8101430 2024-09-19T09:11:05.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.852+0000 7fdab7fff640 1 --2- 172.21.15.92:0/2845432193 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdaa00a32c0 0x7fdaa00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:05.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.853+0000 7fdab7fff640 1 --2- 172.21.15.92:0/2845432193 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdaa00a32c0 0x7fdaa00a5780 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fdab0005c40 tx=0x7fdab0005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:05.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:05.858+0000 7fdab57fa640 1 -- 172.21.15.92:0/2845432193 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdaac009de0 con 0x7fdab8101430 2024-09-19T09:11:06.000 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:11:06.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.235+0000 7fdabe606640 1 -- 172.21.15.92:0/2845432193 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdab8100ef0 con 0x7fdab8101430 2024-09-19T09:11:06.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.237+0000 7fdab57fa640 1 -- 172.21.15.92:0/2845432193 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7fdaac09ba90 con 0x7fdab8101430 2024-09-19T09:11:06.239 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:11:06.239 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:11:06.240 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:11:06.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.241+0000 7fdabe606640 1 -- 172.21.15.92:0/2845432193 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdaa00a32c0 msgr2=0x7fdaa00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:06.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.241+0000 7fdabe606640 1 --2- 172.21.15.92:0/2845432193 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdaa00a32c0 0x7fdaa00a5780 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fdab0005c40 tx=0x7fdab0005bd0 comp rx=0 tx=0).stop 2024-09-19T09:11:06.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.241+0000 7fdabe606640 1 -- 172.21.15.92:0/2845432193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdab8101430 msgr2=0x7fdab81965b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:06.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.241+0000 7fdabe606640 1 --2- 172.21.15.92:0/2845432193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdab8101430 0x7fdab81965b0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fdaac00d980 tx=0x7fdaac00de40 comp rx=0 tx=0).stop 2024-09-19T09:11:06.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.242+0000 7fdabe606640 1 -- 172.21.15.92:0/2845432193 shutdown_connections 2024-09-19T09:11:06.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.242+0000 7fdabe606640 1 --2- 172.21.15.92:0/2845432193 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdab8106a90 0x7fdab8196af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:06.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.242+0000 7fdabe606640 1 --2- 172.21.15.92:0/2845432193 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdaa00a32c0 0x7fdaa00a5780 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:06.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.242+0000 7fdabe606640 1 --2- 172.21.15.92:0/2845432193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdab8101430 0x7fdab81965b0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:06.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.242+0000 7fdabe606640 1 --2- 172.21.15.92:0/2845432193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdab8100a90 0x7fdab8196070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:06.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.242+0000 7fdabe606640 1 -- 172.21.15.92:0/2845432193 >> 172.21.15.92:0/2845432193 conn(0x7fdab80fc7d0 msgr2=0x7fdab80fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:06.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.242+0000 7fdabe606640 1 -- 172.21.15.92:0/2845432193 shutdown_connections 2024-09-19T09:11:06.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.242+0000 7fdabe606640 1 -- 172.21.15.92:0/2845432193 wait complete. 2024-09-19T09:11:06.406 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:06 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/2845432193' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:11:06.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:06 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/2845432193' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:11:06.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:06 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/2845432193' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:11:06.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.822+0000 7f572ff9f640 1 -- 172.21.15.92:0/1520489927 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5728110220 msgr2=0x7f572806e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:06.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.822+0000 7f572ff9f640 1 --2- 172.21.15.92:0/1520489927 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5728110220 0x7f572806e4f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5724009900 tx=0x7f572402a420 comp rx=0 tx=0).stop 2024-09-19T09:11:06.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.823+0000 7f572ff9f640 1 -- 172.21.15.92:0/1520489927 shutdown_connections 2024-09-19T09:11:06.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.823+0000 7f572ff9f640 1 --2- 172.21.15.92:0/1520489927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f572811b140 0x7f572811d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:06.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.823+0000 7f572ff9f640 1 --2- 172.21.15.92:0/1520489927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f572806ea30 0x7f572806ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:06.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.823+0000 7f572ff9f640 1 --2- 172.21.15.92:0/1520489927 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5728110220 0x7f572806e4f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:06.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.823+0000 7f572ff9f640 1 -- 172.21.15.92:0/1520489927 >> 172.21.15.92:0/1520489927 conn(0x7f5728073210 msgr2=0x7f5728073620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:06.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.823+0000 7f572ff9f640 1 -- 172.21.15.92:0/1520489927 shutdown_connections 2024-09-19T09:11:06.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.823+0000 7f572ff9f640 1 -- 172.21.15.92:0/1520489927 wait complete. 2024-09-19T09:11:06.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.824+0000 7f572ff9f640 1 Processor -- start 2024-09-19T09:11:06.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.824+0000 7f572ff9f640 1 -- start start 2024-09-19T09:11:06.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.824+0000 7f572ff9f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f572806ea30 0x7f5728119690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:06.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.824+0000 7f572ff9f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5728110220 0x7f5728119bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:06.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.824+0000 7f572ff9f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f572811b140 0x7f57281128d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:06.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.824+0000 7f572ff9f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5728120d90 con 0x7f5728110220 2024-09-19T09:11:06.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.824+0000 7f572ff9f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5728120c10 con 0x7f572806ea30 2024-09-19T09:11:06.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.824+0000 7f572ff9f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5728120f10 con 0x7f572811b140 2024-09-19T09:11:06.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.824+0000 7f572e53c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f572811b140 0x7f57281128d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:06.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.824+0000 7f572e53c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f572811b140 0x7f57281128d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:54748/0 (socket says 172.21.15.92:54748) 2024-09-19T09:11:06.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.824+0000 7f572e53c640 1 -- 172.21.15.92:0/1447247017 learned_addr learned my addr 172.21.15.92:0/1447247017 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:06.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.824+0000 7f572dd3b640 1 --2- 172.21.15.92:0/1447247017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f572806ea30 0x7f5728119690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:06.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.825+0000 7f572dd3b640 1 -- 172.21.15.92:0/1447247017 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f572811b140 msgr2=0x7f57281128d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:06.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.825+0000 7f572dd3b640 1 --2- 172.21.15.92:0/1447247017 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f572811b140 0x7f57281128d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:06.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.825+0000 7f572dd3b640 1 -- 172.21.15.92:0/1447247017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5728110220 msgr2=0x7f5728119bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:06.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.825+0000 7f572dd3b640 1 --2- 172.21.15.92:0/1447247017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5728110220 0x7f5728119bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:06.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.825+0000 7f572dd3b640 1 -- 172.21.15.92:0/1447247017 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5728113190 con 0x7f572806ea30 2024-09-19T09:11:06.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.825+0000 7f572dd3b640 1 --2- 172.21.15.92:0/1447247017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f572806ea30 0x7f5728119690 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5724005940 tx=0x7f5724004360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:06.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.825+0000 7f571effd640 1 -- 172.21.15.92:0/1447247017 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f572403f030 con 0x7f572806ea30 2024-09-19T09:11:06.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.825+0000 7f572ff9f640 1 -- 172.21.15.92:0/1447247017 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5728113420 con 0x7f572806ea30 2024-09-19T09:11:06.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.825+0000 7f572ff9f640 1 -- 172.21.15.92:0/1447247017 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57281173e0 con 0x7f572806ea30 2024-09-19T09:11:06.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.825+0000 7f571effd640 1 -- 172.21.15.92:0/1447247017 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5724003ce0 con 0x7f572806ea30 2024-09-19T09:11:06.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.825+0000 7f571effd640 1 -- 172.21.15.92:0/1447247017 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5724035070 con 0x7f572806ea30 2024-09-19T09:11:06.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.829+0000 7f5732378740 1 Processor -- start 2024-09-19T09:11:06.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.829+0000 7f5732378740 1 -- start start 2024-09-19T09:11:06.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.829+0000 7f5732378740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557124253d70 0x557124254150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:06.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.829+0000 7f5732378740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557124254690 0x55712425ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:06.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.830+0000 7f5732378740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55712425ef50 0x557124261340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:06.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.830+0000 7f5732378740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5571241b9280 con 0x557124253d70 2024-09-19T09:11:06.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.830+0000 7f572e53c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557124253d70 0x557124254150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:06.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.830+0000 7f5732378740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x557124160b10 con 0x55712425ef50 2024-09-19T09:11:06.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.830+0000 7f572e53c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557124253d70 0x557124254150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49128/0 (socket says 172.21.15.92:49128) 2024-09-19T09:11:06.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.830+0000 7f5732378740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5571241b5240 con 0x557124254690 2024-09-19T09:11:06.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.830+0000 7f572e53c640 1 -- 172.21.15.92:0/1150476257 learned_addr learned my addr 172.21.15.92:0/1150476257 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:06.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.830+0000 7f572d53a640 1 --2- 172.21.15.92:0/1150476257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55712425ef50 0x557124261340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:06.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.830+0000 7f571effd640 1 -- 172.21.15.92:0/1447247017 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5724042030 con 0x7f572806ea30 2024-09-19T09:11:06.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.831+0000 7f572d53a640 1 -- 172.21.15.92:0/1150476257 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557124254690 msgr2=0x55712425ea10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:11:06.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.831+0000 7f572d53a640 1 --2- 172.21.15.92:0/1150476257 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557124254690 0x55712425ea10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:06.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.831+0000 7f572d53a640 1 -- 172.21.15.92:0/1150476257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557124253d70 msgr2=0x557124254150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:06.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.831+0000 7f572d53a640 1 --2- 172.21.15.92:0/1150476257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557124253d70 0x557124254150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:06.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.831+0000 7f572d53a640 1 -- 172.21.15.92:0/1150476257 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55712416d1f0 con 0x55712425ef50 2024-09-19T09:11:06.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.831+0000 7f572d53a640 1 --2- 172.21.15.92:0/1150476257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55712425ef50 0x557124261340 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5728113f70 tx=0x7f5718009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f233e0320ebc2f07 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:06.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.832+0000 7f5713fff640 1 -- 172.21.15.92:0/1150476257 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5718015020 con 0x55712425ef50 2024-09-19T09:11:06.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.832+0000 7f571effd640 1 --2- 172.21.15.92:0/1447247017 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f57140a3340 0x7f57140a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:06.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.832+0000 7f5713fff640 1 -- 172.21.15.92:0/1150476257 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f571800bdb0 con 0x55712425ef50 2024-09-19T09:11:06.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.832+0000 7f572e53c640 1 --2- 172.21.15.92:0/1447247017 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f57140a3340 0x7f57140a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:06.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.832+0000 7f5713fff640 1 -- 172.21.15.92:0/1150476257 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5718010380 con 0x55712425ef50 2024-09-19T09:11:06.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.833+0000 7f5732378740 1 -- 172.21.15.92:0/1150476257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55712425ef50 msgr2=0x557124261340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:06.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.833+0000 7f5732378740 1 --2- 172.21.15.92:0/1150476257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55712425ef50 0x557124261340 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5728113f70 tx=0x7f5718009bb0 comp rx=0 tx=0).stop 2024-09-19T09:11:06.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.833+0000 7f5732378740 1 -- 172.21.15.92:0/1150476257 shutdown_connections 2024-09-19T09:11:06.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.833+0000 7f5732378740 1 --2- 172.21.15.92:0/1150476257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55712425ef50 0x557124261340 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:06.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.833+0000 7f5732378740 1 --2- 172.21.15.92:0/1150476257 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557124254690 0x55712425ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:06.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.833+0000 7f5732378740 1 --2- 172.21.15.92:0/1150476257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557124253d70 0x557124254150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:06.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.833+0000 7f5732378740 1 -- 172.21.15.92:0/1150476257 >> 172.21.15.92:0/1150476257 conn(0x557124250300 msgr2=0x5571242506e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:06.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.833+0000 7f5732378740 1 -- 172.21.15.92:0/1150476257 shutdown_connections 2024-09-19T09:11:06.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.833+0000 7f5732378740 1 -- 172.21.15.92:0/1150476257 wait complete. 2024-09-19T09:11:06.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.834+0000 7f5732378740 1 -- start start 2024-09-19T09:11:06.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.834+0000 7f5732378740 1 Processor -- start 2024-09-19T09:11:06.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.834+0000 7f571effd640 1 -- 172.21.15.92:0/1447247017 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f57240efe50 con 0x7f572806ea30 2024-09-19T09:11:06.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.834+0000 7f572e53c640 1 --2- 172.21.15.92:0/1447247017 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f57140a3340 0x7f57140a5800 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5720009500 tx=0x7f572000b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:06.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.834+0000 7f5732378740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557124253d70 0x55712425e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:06.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.835+0000 7f5732378740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557124254690 0x55712425bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:06.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.835+0000 7f5732378740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55712425ef50 0x55712425c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:06.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.835+0000 7f5732378740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557124261b70 con 0x557124253d70 2024-09-19T09:11:06.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.835+0000 7f5732378740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x557124173f10 con 0x557124254690 2024-09-19T09:11:06.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.835+0000 7f5732378740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x557124261cf0 con 0x55712425ef50 2024-09-19T09:11:06.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.835+0000 7f5732378740 10 client.0 _ll_register_callbacks cb 0x55712413ca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:11:06.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.835+0000 7f572e53c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55712425ef50 0x55712425c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:06.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.835+0000 7f572e53c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55712425ef50 0x55712425c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:54768/0 (socket says 172.21.15.92:54768) 2024-09-19T09:11:06.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.835+0000 7f572e53c640 1 -- 172.21.15.92:0/3347891781 learned_addr learned my addr 172.21.15.92:0/3347891781 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:06.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.836+0000 7f572e53c640 1 -- 172.21.15.92:0/3347891781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557124254690 msgr2=0x55712425bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:06.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.836+0000 7f572e53c640 1 --2- 172.21.15.92:0/3347891781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557124254690 0x55712425bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:06.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.836+0000 7f572e53c640 1 -- 172.21.15.92:0/3347891781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557124253d70 msgr2=0x55712425e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:06.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.836+0000 7f572e53c640 1 --2- 172.21.15.92:0/3347891781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557124253d70 0x55712425e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:06.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.836+0000 7f572e53c640 1 -- 172.21.15.92:0/3347891781 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557123f2a6a0 con 0x55712425ef50 2024-09-19T09:11:06.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.837+0000 7f572e53c640 1 --2- 172.21.15.92:0/3347891781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55712425ef50 0x55712425c250 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5720016d70 tx=0x7f5720004a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e81daf66c959e75b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:06.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.837+0000 7f57117fa640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:11:06.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.837+0000 7f57117fa640 1 -- 172.21.15.92:0/3347891781 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5720025020 con 0x55712425ef50 2024-09-19T09:11:06.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.837+0000 7f57117fa640 1 -- 172.21.15.92:0/3347891781 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f5720016da0 con 0x55712425ef50 2024-09-19T09:11:06.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.837+0000 7f5732378740 1 -- 172.21.15.92:0/3347891781 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f571800bdb0 con 0x55712425ef50 2024-09-19T09:11:06.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.837+0000 7f57117fa640 1 -- 172.21.15.92:0/3347891781 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f572001d040 con 0x55712425ef50 2024-09-19T09:11:06.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.837+0000 7f5732378740 10 client.27877 fetch_fsmap learned FSMap version 19 2024-09-19T09:11:06.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.837+0000 7f5732378740 1 -- 172.21.15.92:0/3347891781 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55712426d700 con 0x55712425ef50 2024-09-19T09:11:06.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.838+0000 7f57117fa640 1 -- 172.21.15.92:0/3347891781 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f571800bdb0 con 0x55712425ef50 2024-09-19T09:11:06.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.838+0000 7f57117fa640 1 -- 172.21.15.92:0/3347891781 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f5720020030 con 0x55712425ef50 2024-09-19T09:11:06.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.838+0000 7f5732378740 10 client.27877 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:11:06.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.838+0000 7f5732378740 10 client.27877 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:11:06.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.838+0000 7f5732378740 20 client.27877 populate_metadata read hostname 'smithi092' 2024-09-19T09:11:06.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.838+0000 7f5732378740 1 --2- 172.21.15.92:0/3347891781 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55712426ec00 0x557124271090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:06.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.838+0000 7f5732378740 4 client.27877 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:11:06.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.838+0000 7f5732378740 1 -- 172.21.15.92:0/3347891781 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5571241c67f0 con 0x55712426ec00 2024-09-19T09:11:06.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.838+0000 7f572dd3b640 1 --2- 172.21.15.92:0/3347891781 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55712426ec00 0x557124271090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:06.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.839+0000 7f57117fa640 10 client.27877 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:06.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.839+0000 7f572dd3b640 1 --2- 172.21.15.92:0/3347891781 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55712426ec00 0x557124271090 crc :-1 s=READY pgs=428 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1847e0a1ccf56d server_cookie=f7934816ee7a6bbc in_seq=0 out_seq=0 2024-09-19T09:11:06.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.839+0000 7f57117fa640 1 -- 172.21.15.92:0/3347891781 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5571241c67f0 con 0x55712426ec00 2024-09-19T09:11:06.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.839+0000 7f57117fa640 10 client.27877 handle_command_reply: tid=0 2024-09-19T09:11:06.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.840+0000 7f5732378740 1 client.27877 shutdown 2024-09-19T09:11:06.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.840+0000 7f5732378740 1 -- 172.21.15.92:0/3347891781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55712425ef50 msgr2=0x55712425c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:06.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.840+0000 7f5732378740 1 --2- 172.21.15.92:0/3347891781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55712425ef50 0x55712425c250 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5720016d70 tx=0x7f5720004a60 comp rx=0 tx=0).stop 2024-09-19T09:11:06.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.840+0000 7f5732378740 1 -- 172.21.15.92:0/3347891781 shutdown_connections 2024-09-19T09:11:06.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.840+0000 7f5732378740 1 --2- 172.21.15.92:0/3347891781 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55712426ec00 0x557124271090 crc :-1 s=READY pgs=428 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:06.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.840+0000 7f5732378740 1 --2- 172.21.15.92:0/3347891781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55712425ef50 0x55712425c250 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:06.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.840+0000 7f5732378740 1 --2- 172.21.15.92:0/3347891781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557124254690 0x55712425bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:06.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.840+0000 7f5732378740 1 --2- 172.21.15.92:0/3347891781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557124253d70 0x55712425e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:06.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.840+0000 7f5732378740 1 -- 172.21.15.92:0/3347891781 >> 172.21.15.92:0/3347891781 conn(0x557124250300 msgr2=0x557124256030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:06.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.840+0000 7f57117fa640 0 client.27877 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:06.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.840+0000 7f5732378740 1 -- 172.21.15.92:0/3347891781 shutdown_connections 2024-09-19T09:11:06.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.840+0000 7f5732378740 1 -- 172.21.15.92:0/3347891781 wait complete. 2024-09-19T09:11:06.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.840+0000 7f5732378740 20 client.27877 trim_cache size 0 max 16384 2024-09-19T09:11:06.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.864+0000 7f5732378740 1 Processor -- start 2024-09-19T09:11:06.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.864+0000 7f5732378740 1 -- start start 2024-09-19T09:11:06.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.864+0000 7f5732378740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557124253d70 0x55712426aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:06.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.864+0000 7f5732378740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557124254690 0x5571242769a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:06.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.864+0000 7f5732378740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55712425ef50 0x557124276ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:06.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.864+0000 7f5732378740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f570c00c460 con 0x557124253d70 2024-09-19T09:11:06.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.864+0000 7f5732378740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f570c00ed00 con 0x557124254690 2024-09-19T09:11:06.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.864+0000 7f5732378740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f570c00caf0 con 0x55712425ef50 2024-09-19T09:11:06.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.864+0000 7f572dd3b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557124253d70 0x55712426aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:06.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.864+0000 7f572dd3b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557124253d70 0x55712426aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49142/0 (socket says 172.21.15.92:49142) 2024-09-19T09:11:06.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.864+0000 7f572dd3b640 1 -- 172.21.15.92:0/1266570089 learned_addr learned my addr 172.21.15.92:0/1266570089 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:06.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.864+0000 7f572d53a640 1 --2- 172.21.15.92:0/1266570089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557124254690 0x5571242769a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:06.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.864+0000 7f572e53c640 1 --2- 172.21.15.92:0/1266570089 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55712425ef50 0x557124276ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:06.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.865+0000 7f572dd3b640 1 -- 172.21.15.92:0/1266570089 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55712425ef50 msgr2=0x557124276ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:06.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.865+0000 7f572dd3b640 1 --2- 172.21.15.92:0/1266570089 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55712425ef50 0x557124276ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:06.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.865+0000 7f572dd3b640 1 -- 172.21.15.92:0/1266570089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557124254690 msgr2=0x5571242769a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:06.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.865+0000 7f572dd3b640 1 --2- 172.21.15.92:0/1266570089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557124254690 0x5571242769a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:06.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.865+0000 7f572dd3b640 1 -- 172.21.15.92:0/1266570089 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55712425ec80 con 0x557124253d70 2024-09-19T09:11:06.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.865+0000 7f572d53a640 1 --2- 172.21.15.92:0/1266570089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557124254690 0x5571242769a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:11:06.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.865+0000 7f572dd3b640 1 --2- 172.21.15.92:0/1266570089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557124253d70 0x55712426aeb0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f572403b7c0 tx=0x7f57240f00a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e1a999ed057eac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:06.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.865+0000 7f57137fe640 1 -- 172.21.15.92:0/1266570089 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57240bbd90 con 0x557124253d70 2024-09-19T09:11:06.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.865+0000 7f57137fe640 1 -- 172.21.15.92:0/1266570089 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57240bcb30 con 0x557124253d70 2024-09-19T09:11:06.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.865+0000 7f57137fe640 1 -- 172.21.15.92:0/1266570089 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57240eda20 con 0x557124253d70 2024-09-19T09:11:06.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.866+0000 7f5732378740 1 -- 172.21.15.92:0/1266570089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557124253d70 msgr2=0x55712426aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:06.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.866+0000 7f5732378740 1 --2- 172.21.15.92:0/1266570089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557124253d70 0x55712426aeb0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f572403b7c0 tx=0x7f57240f00a0 comp rx=0 tx=0).stop 2024-09-19T09:11:06.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.866+0000 7f5732378740 1 -- 172.21.15.92:0/1266570089 shutdown_connections 2024-09-19T09:11:06.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.866+0000 7f5732378740 1 --2- 172.21.15.92:0/1266570089 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55712425ef50 0x557124276ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:06.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.866+0000 7f5732378740 1 --2- 172.21.15.92:0/1266570089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557124254690 0x5571242769a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:06.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.866+0000 7f5732378740 1 --2- 172.21.15.92:0/1266570089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557124253d70 0x55712426aeb0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:06.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.866+0000 7f5732378740 1 -- 172.21.15.92:0/1266570089 >> 172.21.15.92:0/1266570089 conn(0x557124250300 msgr2=0x55712425a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.866+0000 7f5732378740 1 -- 172.21.15.92:0/1266570089 shutdown_connections 2024-09-19T09:11:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.866+0000 7f5732378740 1 -- 172.21.15.92:0/1266570089 wait complete. 2024-09-19T09:11:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.866+0000 7f5732378740 1 -- start start 2024-09-19T09:11:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.866+0000 7f5732378740 1 Processor -- start 2024-09-19T09:11:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.867+0000 7f5732378740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557124253d70 0x557124267030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.867+0000 7f5732378740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557124254690 0x557124267570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.867+0000 7f5732378740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55712425ef50 0x557124261fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.867+0000 7f5732378740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f570c00d1c0 con 0x557124253d70 2024-09-19T09:11:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.867+0000 7f5732378740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f570c00e630 con 0x557124254690 2024-09-19T09:11:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.867+0000 7f5732378740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f570c00d890 con 0x55712425ef50 2024-09-19T09:11:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.867+0000 7f5732378740 10 client.0 _ll_register_callbacks cb 0x7f5720016a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:11:06.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.867+0000 7f572dd3b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557124253d70 0x557124267030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.867+0000 7f572dd3b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557124253d70 0x557124267030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49156/0 (socket says 172.21.15.92:49156) 2024-09-19T09:11:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.867+0000 7f572dd3b640 1 -- 172.21.15.92:0/591215944 learned_addr learned my addr 172.21.15.92:0/591215944 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.867+0000 7f572e53c640 1 --2- 172.21.15.92:0/591215944 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55712425ef50 0x557124261fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.867+0000 7f572d53a640 1 --2- 172.21.15.92:0/591215944 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557124254690 0x557124267570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.867+0000 7f572dd3b640 1 -- 172.21.15.92:0/591215944 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55712425ef50 msgr2=0x557124261fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.867+0000 7f572dd3b640 1 --2- 172.21.15.92:0/591215944 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55712425ef50 0x557124261fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.867+0000 7f572dd3b640 1 -- 172.21.15.92:0/591215944 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557124254690 msgr2=0x557124267570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.867+0000 7f572dd3b640 1 --2- 172.21.15.92:0/591215944 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557124254690 0x557124267570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.867+0000 7f572dd3b640 1 -- 172.21.15.92:0/591215944 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571242625d0 con 0x557124253d70 2024-09-19T09:11:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.867+0000 7f572dd3b640 1 --2- 172.21.15.92:0/591215944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557124253d70 0x557124267030 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f572402a940 tx=0x7f57240bbe00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38a7e383c9f50d92 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.867+0000 7f57117fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:11:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.867+0000 7f57117fa640 1 -- 172.21.15.92:0/591215944 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57240d4070 con 0x557124253d70 2024-09-19T09:11:06.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.867+0000 7f57117fa640 1 -- 172.21.15.92:0/591215944 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f57240b8aa0 con 0x557124253d70 2024-09-19T09:11:06.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.867+0000 7f5732378740 1 -- 172.21.15.92:0/591215944 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57240bcb30 con 0x557124253d70 2024-09-19T09:11:06.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.867+0000 7f57117fa640 1 -- 172.21.15.92:0/591215944 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f57240c07e0 con 0x557124253d70 2024-09-19T09:11:06.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.867+0000 7f5732378740 10 client.18771 fetch_fsmap learned FSMap version 19 2024-09-19T09:11:06.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.868+0000 7f5732378740 1 -- 172.21.15.92:0/591215944 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5571242da290 con 0x557124253d70 2024-09-19T09:11:06.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.868+0000 7f57117fa640 1 -- 172.21.15.92:0/591215944 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57240bcb30 con 0x557124253d70 2024-09-19T09:11:06.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.868+0000 7f57117fa640 1 -- 172.21.15.92:0/591215944 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f572403bc60 con 0x557124253d70 2024-09-19T09:11:06.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.868+0000 7f5732378740 10 client.18771 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:11:06.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.868+0000 7f5732378740 10 client.18771 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:11:06.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.868+0000 7f5732378740 20 client.18771 populate_metadata read hostname 'smithi092' 2024-09-19T09:11:06.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.868+0000 7f5732378740 1 --2- 172.21.15.92:0/591215944 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5571242da8f0 0x5571242dcce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:06.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.868+0000 7f5732378740 4 client.18771 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:11:06.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.868+0000 7f5732378740 1 -- 172.21.15.92:0/591215944 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5571241c0d00 con 0x5571242da8f0 2024-09-19T09:11:06.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.870+0000 7f572d53a640 1 --2- 172.21.15.92:0/591215944 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5571242da8f0 0x5571242dcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:06.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.871+0000 7f572d53a640 1 --2- 172.21.15.92:0/591215944 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5571242da8f0 0x5571242dcce0 crc :-1 s=READY pgs=429 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f88310e4e78be23e server_cookie=87bc7f1db18b2dcd in_seq=0 out_seq=0 2024-09-19T09:11:06.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.871+0000 7f57117fa640 10 client.18771 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:06.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.872+0000 7f57117fa640 1 -- 172.21.15.92:0/591215944 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5571241c0d00 con 0x5571242da8f0 2024-09-19T09:11:06.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.872+0000 7f57117fa640 10 client.18771 handle_command_reply: tid=0 2024-09-19T09:11:06.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.872+0000 7f5732378740 1 client.18771 shutdown 2024-09-19T09:11:06.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.872+0000 7f5732378740 1 -- 172.21.15.92:0/591215944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557124253d70 msgr2=0x557124267030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:06.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.872+0000 7f5732378740 1 --2- 172.21.15.92:0/591215944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557124253d70 0x557124267030 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f572402a940 tx=0x7f57240bbe00 comp rx=0 tx=0).stop 2024-09-19T09:11:06.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.873+0000 7f5732378740 1 -- 172.21.15.92:0/591215944 shutdown_connections 2024-09-19T09:11:06.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.873+0000 7f5732378740 1 --2- 172.21.15.92:0/591215944 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5571242da8f0 0x5571242dcce0 crc :-1 s=READY pgs=429 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:06.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.873+0000 7f5732378740 1 --2- 172.21.15.92:0/591215944 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55712425ef50 0x557124261fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:06.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.873+0000 7f5732378740 1 --2- 172.21.15.92:0/591215944 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557124254690 0x557124267570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:06.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.873+0000 7f5732378740 1 --2- 172.21.15.92:0/591215944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557124253d70 0x557124267030 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:06.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.873+0000 7f5732378740 1 -- 172.21.15.92:0/591215944 >> 172.21.15.92:0/591215944 conn(0x557124250300 msgr2=0x5571242557c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:06.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.873+0000 7f57117fa640 0 client.18771 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:06.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.873+0000 7f5732378740 1 -- 172.21.15.92:0/591215944 shutdown_connections 2024-09-19T09:11:06.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.873+0000 7f5732378740 1 -- 172.21.15.92:0/591215944 wait complete. 2024-09-19T09:11:06.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.873+0000 7f5732378740 20 client.18771 trim_cache size 0 max 16384 2024-09-19T09:11:06.880 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:11:06.880 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-19T09:11:06.880 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "b31dcfc2-614c-4111-9d9b-4f6d89e1b04e", 2024-09-19T09:11:06.880 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-19T09:11:06.881 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:11:06.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.874+0000 7f572ff9f640 1 -- 172.21.15.92:0/1447247017 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f57140a3340 msgr2=0x7f57140a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:06.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.874+0000 7f572ff9f640 1 --2- 172.21.15.92:0/1447247017 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f57140a3340 0x7f57140a5800 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5720009500 tx=0x7f572000b040 comp rx=0 tx=0).stop 2024-09-19T09:11:06.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.874+0000 7f572ff9f640 1 -- 172.21.15.92:0/1447247017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f572806ea30 msgr2=0x7f5728119690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:06.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.874+0000 7f572ff9f640 1 --2- 172.21.15.92:0/1447247017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f572806ea30 0x7f5728119690 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5724005940 tx=0x7f5724004360 comp rx=0 tx=0).stop 2024-09-19T09:11:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.874+0000 7f572ff9f640 1 -- 172.21.15.92:0/1447247017 shutdown_connections 2024-09-19T09:11:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.874+0000 7f572ff9f640 1 --2- 172.21.15.92:0/1447247017 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f572811b140 0x7f57281128d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.874+0000 7f572ff9f640 1 --2- 172.21.15.92:0/1447247017 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f57140a3340 0x7f57140a5800 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.874+0000 7f572ff9f640 1 --2- 172.21.15.92:0/1447247017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5728110220 0x7f5728119bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.874+0000 7f572ff9f640 1 --2- 172.21.15.92:0/1447247017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f572806ea30 0x7f5728119690 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.874+0000 7f572ff9f640 1 -- 172.21.15.92:0/1447247017 >> 172.21.15.92:0/1447247017 conn(0x7f5728073210 msgr2=0x7f572806b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.874+0000 7f572ff9f640 1 -- 172.21.15.92:0/1447247017 shutdown_connections 2024-09-19T09:11:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:06.874+0000 7f572ff9f640 1 -- 172.21.15.92:0/1447247017 wait complete. 2024-09-19T09:11:07.382 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 149.45 --await-for 45.0' 2024-09-19T09:11:07.382 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 149.45 --await-for 45.0 2024-09-19T09:11:07.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:07 smithi167 ceph-mon[35359]: pgmap v769: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 8.5 MiB/s wr, 735 op/s 2024-09-19T09:11:07.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:07 smithi190 ceph-mon[35358]: pgmap v769: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 8.5 MiB/s wr, 735 op/s 2024-09-19T09:11:07.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:07 smithi092 ceph-mon[31407]: pgmap v769: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 8.5 MiB/s wr, 735 op/s 2024-09-19T09:11:08.067 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:11:08.246 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:11:08.300 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:08 smithi092 ceph-mon[31407]: scrub queued for path: / 2024-09-19T09:11:08.301 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:08 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:11:08.560 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:08 smithi092 ceph-mon[31407]: scrub summary: active paths [/] 2024-09-19T09:11:08.560 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:08 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:11:08.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:08 smithi167 ceph-mon[35359]: scrub queued for path: / 2024-09-19T09:11:08.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:08 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:11:08.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:08 smithi167 ceph-mon[35359]: scrub summary: active paths [/] 2024-09-19T09:11:08.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:08 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:11:08.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:08 smithi190 ceph-mon[35358]: scrub queued for path: / 2024-09-19T09:11:08.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:08 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:11:08.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:08 smithi190 ceph-mon[35358]: scrub summary: active paths [/] 2024-09-19T09:11:08.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:08 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:11:08.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.970+0000 7f8a25c34640 1 -- 172.21.15.92:0/2829935521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a2011b140 msgr2=0x7f8a2011d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:08.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.970+0000 7f8a25c34640 1 --2- 172.21.15.92:0/2829935521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a2011b140 0x7f8a2011d530 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f8a18009ca0 tx=0x7f8a1802a8f0 comp rx=0 tx=0).stop 2024-09-19T09:11:08.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.971+0000 7f8a25c34640 1 -- 172.21.15.92:0/2829935521 shutdown_connections 2024-09-19T09:11:08.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.971+0000 7f8a25c34640 1 --2- 172.21.15.92:0/2829935521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a2011b140 0x7f8a2011d530 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:08.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.971+0000 7f8a25c34640 1 --2- 172.21.15.92:0/2829935521 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a20109830 0x7f8a20109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:08.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.971+0000 7f8a25c34640 1 --2- 172.21.15.92:0/2829935521 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a20109450 0x7f8a20110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:08.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.971+0000 7f8a25c34640 1 -- 172.21.15.92:0/2829935521 >> 172.21.15.92:0/2829935521 conn(0x7f8a2006e140 msgr2=0x7f8a2006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:08.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.971+0000 7f8a25c34640 1 -- 172.21.15.92:0/2829935521 shutdown_connections 2024-09-19T09:11:08.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.971+0000 7f8a25c34640 1 -- 172.21.15.92:0/2829935521 wait complete. 2024-09-19T09:11:08.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.972+0000 7f8a25c34640 1 Processor -- start 2024-09-19T09:11:08.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.972+0000 7f8a25c34640 1 -- start start 2024-09-19T09:11:08.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.972+0000 7f8a25c34640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a20109450 0x7f8a20118a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:08.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.972+0000 7f8a25c34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a20109830 0x7f8a201109f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:08.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.972+0000 7f8a25c34640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a20110f30 0x7f8a201113e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:08.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.972+0000 7f8a25c34640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8a20120ed0 con 0x7f8a20109830 2024-09-19T09:11:08.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.972+0000 7f8a25c34640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8a20120d50 con 0x7f8a20109450 2024-09-19T09:11:08.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.972+0000 7f8a25c34640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8a20121050 con 0x7f8a20110f30 2024-09-19T09:11:08.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.973+0000 7f8a1f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a20109450 0x7f8a20118a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:08.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.974+0000 7f8a1f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a20109450 0x7f8a20118a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:49292/0 (socket says 172.21.15.92:49292) 2024-09-19T09:11:08.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.974+0000 7f8a1f7fe640 1 -- 172.21.15.92:0/3870397725 learned_addr learned my addr 172.21.15.92:0/3870397725 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:08.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.974+0000 7f8a1f7fe640 1 -- 172.21.15.92:0/3870397725 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a20110f30 msgr2=0x7f8a201113e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:11:08.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.974+0000 7f8a1f7fe640 1 --2- 172.21.15.92:0/3870397725 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a20110f30 0x7f8a201113e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:08.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.974+0000 7f8a1f7fe640 1 -- 172.21.15.92:0/3870397725 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a20109830 msgr2=0x7f8a201109f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:08.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.974+0000 7f8a1f7fe640 1 --2- 172.21.15.92:0/3870397725 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a20109830 0x7f8a201109f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:08.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.974+0000 7f8a1f7fe640 1 -- 172.21.15.92:0/3870397725 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a201bc000 con 0x7f8a20109450 2024-09-19T09:11:08.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.975+0000 7f8a1f7fe640 1 --2- 172.21.15.92:0/3870397725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a20109450 0x7f8a20118a20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400b450 tx=0x7f8a1400b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:08.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.976+0000 7f8a1cff9640 1 -- 172.21.15.92:0/3870397725 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a14015020 con 0x7f8a20109450 2024-09-19T09:11:08.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.976+0000 7f8a25c34640 1 -- 172.21.15.92:0/3870397725 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a201bc2f0 con 0x7f8a20109450 2024-09-19T09:11:08.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.976+0000 7f8a25c34640 1 -- 172.21.15.92:0/3870397725 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a201bc830 con 0x7f8a20109450 2024-09-19T09:11:08.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.977+0000 7f8a1cff9640 1 -- 172.21.15.92:0/3870397725 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a14011d70 con 0x7f8a20109450 2024-09-19T09:11:08.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.977+0000 7f8a1cff9640 1 -- 172.21.15.92:0/3870397725 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1400f340 con 0x7f8a20109450 2024-09-19T09:11:08.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.982+0000 7f8a1cff9640 1 -- 172.21.15.92:0/3870397725 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8a14018020 con 0x7f8a20109450 2024-09-19T09:11:08.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.983+0000 7f8a2800d740 1 Processor -- start 2024-09-19T09:11:08.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.984+0000 7f8a2800d740 1 -- start start 2024-09-19T09:11:08.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.984+0000 7f8a1cff9640 1 --2- 172.21.15.92:0/3870397725 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8a080a33d0 0x7f8a080a5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:08.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.984+0000 7f8a2800d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56439a22a850 0x56439a22ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:08.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.984+0000 7f8a1f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56439a22a850 0x56439a22ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:08.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.984+0000 7f8a2800d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56439a22b170 0x56439a2354f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:08.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.984+0000 7f8a2800d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439a235a30 0x56439a237e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:08.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.984+0000 7f8a2800d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56439a18f160 con 0x56439a22a850 2024-09-19T09:11:08.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.984+0000 7f8a2800d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56439a136720 con 0x56439a235a30 2024-09-19T09:11:08.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.984+0000 7f8a2800d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56439a18b120 con 0x56439a22b170 2024-09-19T09:11:08.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.984+0000 7f8a1cff9640 1 -- 172.21.15.92:0/3870397725 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8a140cf2b0 con 0x7f8a20109450 2024-09-19T09:11:08.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.985+0000 7f8a1ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439a235a30 0x56439a237e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:08.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.985+0000 7f8a1ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439a235a30 0x56439a237e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:49304/0 (socket says 172.21.15.92:49304) 2024-09-19T09:11:08.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.985+0000 7f8a1ffff640 1 -- 172.21.15.92:0/2130292604 learned_addr learned my addr 172.21.15.92:0/2130292604 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:08.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.985+0000 7f8a1ffff640 1 -- 172.21.15.92:0/2130292604 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56439a22b170 msgr2=0x56439a2354f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:11:08.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.985+0000 7f8a1ffff640 1 --2- 172.21.15.92:0/2130292604 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56439a22b170 0x56439a2354f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:08.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.985+0000 7f8a1ffff640 1 -- 172.21.15.92:0/2130292604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56439a22a850 msgr2=0x56439a22ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:08.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.985+0000 7f8a1ffff640 1 --2- 172.21.15.92:0/2130292604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56439a22a850 0x56439a22ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:08.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.985+0000 7f8a1ffff640 1 -- 172.21.15.92:0/2130292604 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564399f00ba0 con 0x56439a235a30 2024-09-19T09:11:08.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.986+0000 7f8a1ffff640 1 --2- 172.21.15.92:0/2130292604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439a235a30 0x56439a237e20 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8a18033040 tx=0x7f8a18009760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d196d28743579925 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:08.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.988+0000 7f8a05ffb640 1 -- 172.21.15.92:0/2130292604 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1802f8a0 con 0x56439a235a30 2024-09-19T09:11:08.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.988+0000 7f8a05ffb640 1 -- 172.21.15.92:0/2130292604 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a18041070 con 0x56439a235a30 2024-09-19T09:11:08.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.989+0000 7f8a1ffff640 1 --2- 172.21.15.92:0/3870397725 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8a080a33d0 0x7f8a080a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:08.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.989+0000 7f8a2800d740 1 -- 172.21.15.92:0/2130292604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439a235a30 msgr2=0x56439a237e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:08.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.989+0000 7f8a2800d740 1 --2- 172.21.15.92:0/2130292604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439a235a30 0x56439a237e20 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8a18033040 tx=0x7f8a18009760 comp rx=0 tx=0).stop 2024-09-19T09:11:08.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.989+0000 7f8a2800d740 1 -- 172.21.15.92:0/2130292604 shutdown_connections 2024-09-19T09:11:08.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.989+0000 7f8a2800d740 1 --2- 172.21.15.92:0/2130292604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439a235a30 0x56439a237e20 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:08.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.989+0000 7f8a2800d740 1 --2- 172.21.15.92:0/2130292604 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56439a22b170 0x56439a2354f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:08.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.989+0000 7f8a2800d740 1 --2- 172.21.15.92:0/2130292604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56439a22a850 0x56439a22ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:08.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.989+0000 7f8a2800d740 1 -- 172.21.15.92:0/2130292604 >> 172.21.15.92:0/2130292604 conn(0x56439a226de0 msgr2=0x56439a2271c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:08.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.990+0000 7f8a1ffff640 1 --2- 172.21.15.92:0/3870397725 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8a080a33d0 0x7f8a080a5890 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f8a18033040 tx=0x7f8a18009760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:08.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.993+0000 7f8a2800d740 1 -- 172.21.15.92:0/2130292604 shutdown_connections 2024-09-19T09:11:08.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.993+0000 7f8a2800d740 1 -- 172.21.15.92:0/2130292604 wait complete. 2024-09-19T09:11:08.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.993+0000 7f8a2800d740 1 -- start start 2024-09-19T09:11:08.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.993+0000 7f8a2800d740 1 Processor -- start 2024-09-19T09:11:08.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.994+0000 7f8a2800d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56439a22a850 0x56439a2327f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:08.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.994+0000 7f8a2800d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439a22b170 0x56439a232d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:08.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.994+0000 7f8a2800d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56439a235a30 0x56439a233270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:08.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.994+0000 7f8a2800d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56439a238650 con 0x56439a22a850 2024-09-19T09:11:08.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.994+0000 7f8a2800d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56439a117900 con 0x56439a22b170 2024-09-19T09:11:08.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.994+0000 7f8a2800d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56439a2387d0 con 0x56439a235a30 2024-09-19T09:11:08.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.994+0000 7f8a2800d740 10 client.0 _ll_register_callbacks cb 0x56439a115780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:11:08.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.994+0000 7f8a1ffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56439a235a30 0x56439a233270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:08.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.994+0000 7f8a1ffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56439a235a30 0x56439a233270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:54842/0 (socket says 172.21.15.92:54842) 2024-09-19T09:11:08.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.994+0000 7f8a1ffff640 1 -- 172.21.15.92:0/1844823977 learned_addr learned my addr 172.21.15.92:0/1844823977 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:08.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.994+0000 7f8a1effd640 1 --2- 172.21.15.92:0/1844823977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439a22b170 0x56439a232d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:08.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.995+0000 7f8a1ffff640 1 -- 172.21.15.92:0/1844823977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439a22b170 msgr2=0x56439a232d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:08.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.995+0000 7f8a1ffff640 1 --2- 172.21.15.92:0/1844823977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439a22b170 0x56439a232d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:08.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.995+0000 7f8a1ffff640 1 -- 172.21.15.92:0/1844823977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56439a22a850 msgr2=0x56439a2327f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:08.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.995+0000 7f8a1ffff640 1 --2- 172.21.15.92:0/1844823977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56439a22a850 0x56439a2327f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:08.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.995+0000 7f8a1ffff640 1 -- 172.21.15.92:0/1844823977 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56439a157c50 con 0x56439a235a30 2024-09-19T09:11:08.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.995+0000 7f8a1ffff640 1 --2- 172.21.15.92:0/1844823977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56439a235a30 0x56439a233270 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8a18033010 tx=0x7f8a1803f040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=684f5a1e420f19e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:08.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:08.995+0000 7f8a037f6640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:11:09.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.001+0000 7f8a037f6640 1 -- 172.21.15.92:0/1844823977 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1805f060 con 0x56439a235a30 2024-09-19T09:11:09.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.001+0000 7f8a037f6640 1 -- 172.21.15.92:0/1844823977 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8a1802fd70 con 0x56439a235a30 2024-09-19T09:11:09.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.003+0000 7f8a2800d740 1 -- 172.21.15.92:0/1844823977 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a18041070 con 0x56439a235a30 2024-09-19T09:11:09.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.003+0000 7f8a037f6640 1 -- 172.21.15.92:0/1844823977 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8a18046470 con 0x56439a235a30 2024-09-19T09:11:09.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.004+0000 7f8a2800d740 10 client.27886 fetch_fsmap learned FSMap version 19 2024-09-19T09:11:09.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.004+0000 7f8a2800d740 1 -- 172.21.15.92:0/1844823977 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56439a238650 con 0x56439a235a30 2024-09-19T09:11:09.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.004+0000 7f8a037f6640 1 -- 172.21.15.92:0/1844823977 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a18041070 con 0x56439a235a30 2024-09-19T09:11:09.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.005+0000 7f8a037f6640 1 -- 172.21.15.92:0/1844823977 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f8a1803d590 con 0x56439a235a30 2024-09-19T09:11:09.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.005+0000 7f8a2800d740 10 client.27886 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:11:09.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.005+0000 7f8a2800d740 10 client.27886 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:11:09.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.005+0000 7f8a2800d740 20 client.27886 populate_metadata read hostname 'smithi092' 2024-09-19T09:11:09.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.005+0000 7f8a2800d740 1 --2- 172.21.15.92:0/1844823977 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56439a2673c0 0x56439a2697b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:09.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.005+0000 7f8a2800d740 4 client.27886 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:11:09.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.005+0000 7f8a2800d740 1 -- 172.21.15.92:0/1844823977 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56439a19c890 con 0x56439a2673c0 2024-09-19T09:11:09.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.006+0000 7f8a1f7fe640 1 --2- 172.21.15.92:0/1844823977 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56439a2673c0 0x56439a2697b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:09.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.010+0000 7f8a1f7fe640 1 --2- 172.21.15.92:0/1844823977 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56439a2673c0 0x56439a2697b0 crc :-1 s=READY pgs=430 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59082d506b8eacb1 server_cookie=9b591516fd8d488a in_seq=0 out_seq=0 2024-09-19T09:11:09.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.010+0000 7f8a037f6640 10 client.27886 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:09.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.011+0000 7f8a037f6640 1 -- 172.21.15.92:0/1844823977 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56439a19c890 con 0x56439a2673c0 2024-09-19T09:11:09.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.011+0000 7f8a037f6640 10 client.27886 handle_command_reply: tid=0 2024-09-19T09:11:09.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.011+0000 7f8a2800d740 1 client.27886 shutdown 2024-09-19T09:11:09.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.011+0000 7f8a2800d740 1 -- 172.21.15.92:0/1844823977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56439a235a30 msgr2=0x56439a233270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:09.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.011+0000 7f8a2800d740 1 --2- 172.21.15.92:0/1844823977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56439a235a30 0x56439a233270 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8a18033010 tx=0x7f8a1803f040 comp rx=0 tx=0).stop 2024-09-19T09:11:09.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.011+0000 7f8a2800d740 1 -- 172.21.15.92:0/1844823977 shutdown_connections 2024-09-19T09:11:09.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.011+0000 7f8a2800d740 1 --2- 172.21.15.92:0/1844823977 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56439a2673c0 0x56439a2697b0 crc :-1 s=READY pgs=430 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.011+0000 7f8a2800d740 1 --2- 172.21.15.92:0/1844823977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56439a235a30 0x56439a233270 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.011+0000 7f8a2800d740 1 --2- 172.21.15.92:0/1844823977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439a22b170 0x56439a232d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.011+0000 7f8a2800d740 1 --2- 172.21.15.92:0/1844823977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56439a22a850 0x56439a2327f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.011+0000 7f8a037f6640 0 client.27886 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:09.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.011+0000 7f8a2800d740 1 -- 172.21.15.92:0/1844823977 >> 172.21.15.92:0/1844823977 conn(0x56439a226de0 msgr2=0x56439a22cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:09.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.013+0000 7f8a2800d740 1 -- 172.21.15.92:0/1844823977 shutdown_connections 2024-09-19T09:11:09.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.013+0000 7f8a2800d740 1 -- 172.21.15.92:0/1844823977 wait complete. 2024-09-19T09:11:09.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.013+0000 7f8a2800d740 20 client.27886 trim_cache size 0 max 16384 2024-09-19T09:11:09.019 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:11:09.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.045+0000 7f8a2800d740 1 Processor -- start 2024-09-19T09:11:09.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.047+0000 7f8a2800d740 1 -- start start 2024-09-19T09:11:09.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.048+0000 7f8a2800d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56439a22a850 0x56439a231750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:09.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.048+0000 7f8a2800d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439a22b170 0x56439a26ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:09.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.048+0000 7f8a2800d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56439a235a30 0x56439a26f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:09.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.048+0000 7f8a2800d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c00c580 con 0x56439a235a30 2024-09-19T09:11:09.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.048+0000 7f8a2800d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c00ee20 con 0x56439a22b170 2024-09-19T09:11:09.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.048+0000 7f8a2800d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c00cc10 con 0x56439a22a850 2024-09-19T09:11:09.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.048+0000 7f8a1effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439a22b170 0x56439a26ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:09.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.048+0000 7f8a1effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439a22b170 0x56439a26ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:49314/0 (socket says 172.21.15.92:49314) 2024-09-19T09:11:09.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.048+0000 7f8a1effd640 1 -- 172.21.15.92:0/49385526 learned_addr learned my addr 172.21.15.92:0/49385526 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:09.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.048+0000 7f8a1f7fe640 1 --2- 172.21.15.92:0/49385526 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56439a22a850 0x56439a231750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:09.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.049+0000 7f8a1f7fe640 1 -- 172.21.15.92:0/49385526 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439a22b170 msgr2=0x56439a26ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:09.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.049+0000 7f8a1f7fe640 1 --2- 172.21.15.92:0/49385526 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439a22b170 0x56439a26ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.049+0000 7f8a1f7fe640 1 -- 172.21.15.92:0/49385526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56439a235a30 msgr2=0x56439a26f480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:11:09.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.049+0000 7f8a1f7fe640 1 --2- 172.21.15.92:0/49385526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56439a235a30 0x56439a26f480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.049+0000 7f8a1f7fe640 1 -- 172.21.15.92:0/49385526 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56439a226c10 con 0x56439a22a850 2024-09-19T09:11:09.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.049+0000 7f8a1f7fe640 1 --2- 172.21.15.92:0/49385526 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56439a22a850 0x56439a231750 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8a14009fd0 tx=0x7f8a140ccc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e6937ea4208a123 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:09.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.049+0000 7f8a057fa640 1 -- 172.21.15.92:0/49385526 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a140b9070 con 0x56439a22a850 2024-09-19T09:11:09.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.050+0000 7f8a057fa640 1 -- 172.21.15.92:0/49385526 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a140b3070 con 0x56439a22a850 2024-09-19T09:11:09.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.050+0000 7f8a057fa640 1 -- 172.21.15.92:0/49385526 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a140a40b0 con 0x56439a22a850 2024-09-19T09:11:09.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.051+0000 7f8a2800d740 1 -- 172.21.15.92:0/49385526 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56439a22a850 msgr2=0x56439a231750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:09.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.051+0000 7f8a2800d740 1 --2- 172.21.15.92:0/49385526 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56439a22a850 0x56439a231750 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8a14009fd0 tx=0x7f8a140ccc80 comp rx=0 tx=0).stop 2024-09-19T09:11:09.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.052+0000 7f8a2800d740 1 -- 172.21.15.92:0/49385526 shutdown_connections 2024-09-19T09:11:09.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.052+0000 7f8a2800d740 1 --2- 172.21.15.92:0/49385526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56439a235a30 0x56439a26f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.052+0000 7f8a2800d740 1 --2- 172.21.15.92:0/49385526 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439a22b170 0x56439a26ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.052+0000 7f8a2800d740 1 --2- 172.21.15.92:0/49385526 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56439a22a850 0x56439a231750 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.052+0000 7f8a2800d740 1 -- 172.21.15.92:0/49385526 >> 172.21.15.92:0/49385526 conn(0x56439a226de0 msgr2=0x56439a234870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:09.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.053+0000 7f8a2800d740 1 -- 172.21.15.92:0/49385526 shutdown_connections 2024-09-19T09:11:09.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.053+0000 7f8a2800d740 1 -- 172.21.15.92:0/49385526 wait complete. 2024-09-19T09:11:09.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.053+0000 7f8a2800d740 1 -- start start 2024-09-19T09:11:09.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.053+0000 7f8a2800d740 1 Processor -- start 2024-09-19T09:11:09.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.054+0000 7f8a2800d740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56439a22a850 0x56439a23e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:09.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.054+0000 7f8a2800d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56439a22b170 0x56439a238ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:09.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.054+0000 7f8a2800d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439a235a30 0x56439a239250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:09.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.054+0000 7f8a2800d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c00d2e0 con 0x56439a22b170 2024-09-19T09:11:09.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.054+0000 7f8a2800d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c00e750 con 0x56439a235a30 2024-09-19T09:11:09.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.054+0000 7f8a2800d740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c00d9b0 con 0x56439a22a850 2024-09-19T09:11:09.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.054+0000 7f8a1f7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56439a22a850 0x56439a23e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:09.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.054+0000 7f8a1f7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56439a22a850 0x56439a23e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:54856/0 (socket says 172.21.15.92:54856) 2024-09-19T09:11:09.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.054+0000 7f8a1f7fe640 1 -- 172.21.15.92:0/988404528 learned_addr learned my addr 172.21.15.92:0/988404528 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:09.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.054+0000 7f8a1ffff640 1 --2- 172.21.15.92:0/988404528 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439a235a30 0x56439a239250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:09.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.055+0000 7f8a1effd640 1 --2- 172.21.15.92:0/988404528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56439a22b170 0x56439a238ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:09.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.055+0000 7f8a2800d740 10 client.0 _ll_register_callbacks cb 0x7f8a18009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:11:09.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.056+0000 7f8a1effd640 1 -- 172.21.15.92:0/988404528 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56439a22a850 msgr2=0x56439a23e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:09.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.056+0000 7f8a1effd640 1 --2- 172.21.15.92:0/988404528 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56439a22a850 0x56439a23e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.056+0000 7f8a1effd640 1 -- 172.21.15.92:0/988404528 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439a235a30 msgr2=0x56439a239250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:09.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.056+0000 7f8a1effd640 1 --2- 172.21.15.92:0/988404528 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439a235a30 0x56439a239250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.056+0000 7f8a1effd640 1 -- 172.21.15.92:0/988404528 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56439a227a70 con 0x56439a22b170 2024-09-19T09:11:09.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.057+0000 7f8a1effd640 1 --2- 172.21.15.92:0/988404528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56439a22b170 0x56439a238ac0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x56439a2350a0 tx=0x7f8a100106e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bcfd09d21d4ad46 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:09.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.057+0000 7f8a037f6640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:11:09.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.057+0000 7f8a037f6640 1 -- 172.21.15.92:0/988404528 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1001a020 con 0x56439a22b170 2024-09-19T09:11:09.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.057+0000 7f8a037f6640 1 -- 172.21.15.92:0/988404528 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8a10016690 con 0x56439a22b170 2024-09-19T09:11:09.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.057+0000 7f8a2800d740 1 -- 172.21.15.92:0/988404528 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a140b3070 con 0x56439a22b170 2024-09-19T09:11:09.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.057+0000 7f8a037f6640 1 -- 172.21.15.92:0/988404528 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8a10010e80 con 0x56439a22b170 2024-09-19T09:11:09.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.058+0000 7f8a2800d740 10 client.18780 fetch_fsmap learned FSMap version 19 2024-09-19T09:11:09.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.058+0000 7f8a2800d740 1 -- 172.21.15.92:0/988404528 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56439a22b790 con 0x56439a22b170 2024-09-19T09:11:09.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.058+0000 7f8a037f6640 1 -- 172.21.15.92:0/988404528 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a10016d70 con 0x56439a22b170 2024-09-19T09:11:09.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.058+0000 7f8a037f6640 1 -- 172.21.15.92:0/988404528 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f8a100133d0 con 0x56439a22b170 2024-09-19T09:11:09.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.058+0000 7f8a2800d740 10 client.18780 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:11:09.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.058+0000 7f8a2800d740 10 client.18780 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:11:09.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.058+0000 7f8a2800d740 20 client.18780 populate_metadata read hostname 'smithi092' 2024-09-19T09:11:09.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.058+0000 7f8a2800d740 1 --2- 172.21.15.92:0/988404528 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56439a2d3550 0x56439a2d5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:09.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.058+0000 7f8a2800d740 4 client.18780 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.45, "await_for": 45.0}] 2024-09-19T09:11:09.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.058+0000 7f8a2800d740 1 -- 172.21.15.92:0/988404528 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.45, "await_for": 45.0}) -- 0x7f8a140b3070 con 0x56439a2d3550 2024-09-19T09:11:09.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.059+0000 7f8a1f7fe640 1 --2- 172.21.15.92:0/988404528 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56439a2d3550 0x56439a2d5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:09.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.059+0000 7f8a1f7fe640 1 --2- 172.21.15.92:0/988404528 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56439a2d3550 0x56439a2d5970 crc :-1 s=READY pgs=431 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=218b03a5550d2266 server_cookie=4403ec6c2b1ee795 in_seq=0 out_seq=0 2024-09-19T09:11:09.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.059+0000 7f8a037f6640 10 client.18780 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:09.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.405+0000 7f8a037f6640 1 -- 172.21.15.92:0/988404528 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7f8a140b3070 con 0x56439a2d3550 2024-09-19T09:11:09.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.405+0000 7f8a037f6640 10 client.18780 handle_command_reply: tid=0 2024-09-19T09:11:09.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.405+0000 7f8a2800d740 1 client.18780 shutdown 2024-09-19T09:11:09.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.405+0000 7f8a2800d740 1 -- 172.21.15.92:0/988404528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56439a22b170 msgr2=0x56439a238ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:09.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.405+0000 7f8a2800d740 1 --2- 172.21.15.92:0/988404528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56439a22b170 0x56439a238ac0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x56439a2350a0 tx=0x7f8a100106e0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.405+0000 7f8a2800d740 1 -- 172.21.15.92:0/988404528 shutdown_connections 2024-09-19T09:11:09.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.405+0000 7f8a2800d740 1 --2- 172.21.15.92:0/988404528 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56439a2d3550 0x56439a2d5970 crc :-1 s=READY pgs=431 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.405+0000 7f8a2800d740 1 --2- 172.21.15.92:0/988404528 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439a235a30 0x56439a239250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.405+0000 7f8a2800d740 1 --2- 172.21.15.92:0/988404528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56439a22b170 0x56439a238ac0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.405+0000 7f8a2800d740 1 --2- 172.21.15.92:0/988404528 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56439a22a850 0x56439a23e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.405+0000 7f8a2800d740 1 -- 172.21.15.92:0/988404528 >> 172.21.15.92:0/988404528 conn(0x56439a226de0 msgr2=0x56439a22c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:09.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.405+0000 7f8a037f6640 0 client.18780 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:09.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.405+0000 7f8a2800d740 1 -- 172.21.15.92:0/988404528 shutdown_connections 2024-09-19T09:11:09.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.405+0000 7f8a2800d740 1 -- 172.21.15.92:0/988404528 wait complete. 2024-09-19T09:11:09.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.405+0000 7f8a2800d740 20 client.18780 trim_cache size 0 max 16384 2024-09-19T09:11:09.407 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:11:09.408 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 19, 2024-09-19T09:11:09.408 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24472, 2024-09-19T09:11:09.408 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 50, 2024-09-19T09:11:09.408 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-09-19T09:11:09.408 INFO:teuthology.orchestra.run.smithi092.stdout: "7b482bc7": { 2024-09-19T09:11:09.408 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 50, 2024-09-19T09:11:09.408 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-09-19T09:11:09.408 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:11:09.408 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-09-19T09:11:09.408 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:11:09.408 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:11:09.408 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 90.0, 2024-09-19T09:11:09.409 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 149.4, 2024-09-19T09:11:09.409 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-09-19T09:11:09.409 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-09-19T09:11:09.409 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-09-19T09:11:09.409 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:11:09.409 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-09-19T09:11:09.409 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:11:09.409 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:11:09.409 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:11:09.409 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:11:09.409 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:11:09.409 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:11:09.409 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:11:09.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.406+0000 7f8a25c34640 1 -- 172.21.15.92:0/3870397725 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8a080a33d0 msgr2=0x7f8a080a5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:09.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.406+0000 7f8a25c34640 1 --2- 172.21.15.92:0/3870397725 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8a080a33d0 0x7f8a080a5890 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f8a18033040 tx=0x7f8a18009760 comp rx=0 tx=0).stop 2024-09-19T09:11:09.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.406+0000 7f8a25c34640 1 -- 172.21.15.92:0/3870397725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a20109450 msgr2=0x7f8a20118a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:09.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.406+0000 7f8a25c34640 1 --2- 172.21.15.92:0/3870397725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a20109450 0x7f8a20118a20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400b450 tx=0x7f8a1400b910 comp rx=0 tx=0).stop 2024-09-19T09:11:09.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.406+0000 7f8a25c34640 1 -- 172.21.15.92:0/3870397725 shutdown_connections 2024-09-19T09:11:09.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.406+0000 7f8a25c34640 1 --2- 172.21.15.92:0/3870397725 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a20110f30 0x7f8a201113e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.406+0000 7f8a25c34640 1 --2- 172.21.15.92:0/3870397725 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8a080a33d0 0x7f8a080a5890 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.406+0000 7f8a25c34640 1 --2- 172.21.15.92:0/3870397725 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a20109830 0x7f8a201109f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.406+0000 7f8a25c34640 1 --2- 172.21.15.92:0/3870397725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a20109450 0x7f8a20118a20 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.406+0000 7f8a25c34640 1 -- 172.21.15.92:0/3870397725 >> 172.21.15.92:0/3870397725 conn(0x7f8a2006e140 msgr2=0x7f8a201191d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:09.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.406+0000 7f8a25c34640 1 -- 172.21.15.92:0/3870397725 shutdown_connections 2024-09-19T09:11:09.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.406+0000 7f8a25c34640 1 -- 172.21.15.92:0/3870397725 wait complete. 2024-09-19T09:11:09.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.599+0000 7fdd500cc640 1 -- 172.21.15.92:0/1842417905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd48102ef0 msgr2=0x7fdd4810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:09.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.599+0000 7fdd500cc640 1 --2- 172.21.15.92:0/1842417905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd48102ef0 0x7fdd4810da40 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fdd40009ca0 tx=0x7fdd4002a950 comp rx=0 tx=0).stop 2024-09-19T09:11:09.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.599+0000 7fdd500cc640 1 -- 172.21.15.92:0/1842417905 shutdown_connections 2024-09-19T09:11:09.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.599+0000 7fdd500cc640 1 --2- 172.21.15.92:0/1842417905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd48102ef0 0x7fdd4810da40 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.599+0000 7fdd500cc640 1 --2- 172.21.15.92:0/1842417905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd48102570 0x7fdd481029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.599+0000 7fdd500cc640 1 --2- 172.21.15.92:0/1842417905 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd48100e20 0x7fdd48101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.599+0000 7fdd500cc640 1 -- 172.21.15.92:0/1842417905 >> 172.21.15.92:0/1842417905 conn(0x7fdd480fc7d0 msgr2=0x7fdd480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:09.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.599+0000 7fdd500cc640 1 -- 172.21.15.92:0/1842417905 shutdown_connections 2024-09-19T09:11:09.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.599+0000 7fdd500cc640 1 -- 172.21.15.92:0/1842417905 wait complete. 2024-09-19T09:11:09.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.600+0000 7fdd500cc640 1 Processor -- start 2024-09-19T09:11:09.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.600+0000 7fdd500cc640 1 -- start start 2024-09-19T09:11:09.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.601+0000 7fdd500cc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd48100e20 0x7fdd481993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:09.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.601+0000 7fdd500cc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd48102570 0x7fdd48199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:09.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.601+0000 7fdd500cc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd48102ef0 0x7fdd48199e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:09.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.601+0000 7fdd500cc640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdd48110f80 con 0x7fdd48102ef0 2024-09-19T09:11:09.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.601+0000 7fdd500cc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdd48110e00 con 0x7fdd48102570 2024-09-19T09:11:09.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.601+0000 7fdd500cc640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fdd48111100 con 0x7fdd48100e20 2024-09-19T09:11:09.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.601+0000 7fdd4e669640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd48102ef0 0x7fdd48199e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:09.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.601+0000 7fdd4d667640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd48102570 0x7fdd48199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:09.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.601+0000 7fdd4d667640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd48102570 0x7fdd48199910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:49356/0 (socket says 172.21.15.92:49356) 2024-09-19T09:11:09.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.601+0000 7fdd4e669640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd48102ef0 0x7fdd48199e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49212/0 (socket says 172.21.15.92:49212) 2024-09-19T09:11:09.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.601+0000 7fdd4d667640 1 -- 172.21.15.92:0/2607501446 learned_addr learned my addr 172.21.15.92:0/2607501446 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:09.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.601+0000 7fdd4de68640 1 --2- 172.21.15.92:0/2607501446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd48100e20 0x7fdd481993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:09.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.601+0000 7fdd4d667640 1 -- 172.21.15.92:0/2607501446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd48100e20 msgr2=0x7fdd481993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:09.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.601+0000 7fdd4d667640 1 --2- 172.21.15.92:0/2607501446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd48100e20 0x7fdd481993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.601+0000 7fdd4d667640 1 -- 172.21.15.92:0/2607501446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd48102ef0 msgr2=0x7fdd48199e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:09.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.601+0000 7fdd4d667640 1 --2- 172.21.15.92:0/2607501446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd48102ef0 0x7fdd48199e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.601+0000 7fdd4d667640 1 -- 172.21.15.92:0/2607501446 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd481a47d0 con 0x7fdd48102570 2024-09-19T09:11:09.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.601+0000 7fdd4e669640 1 --2- 172.21.15.92:0/2607501446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd48102ef0 0x7fdd48199e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:11:09.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.601+0000 7fdd4d667640 1 --2- 172.21.15.92:0/2607501446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd48102570 0x7fdd48199910 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdd3800d950 tx=0x7fdd3800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:09.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.601+0000 7fdd3effd640 1 -- 172.21.15.92:0/2607501446 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd38017030 con 0x7fdd48102570 2024-09-19T09:11:09.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.602+0000 7fdd500cc640 1 -- 172.21.15.92:0/2607501446 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd481a4ac0 con 0x7fdd48102570 2024-09-19T09:11:09.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.602+0000 7fdd3effd640 1 -- 172.21.15.92:0/2607501446 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd38004020 con 0x7fdd48102570 2024-09-19T09:11:09.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.602+0000 7fdd3effd640 1 -- 172.21.15.92:0/2607501446 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd380047a0 con 0x7fdd48102570 2024-09-19T09:11:09.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.602+0000 7fdd500cc640 1 -- 172.21.15.92:0/2607501446 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd481a5050 con 0x7fdd48102570 2024-09-19T09:11:09.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.604+0000 7fdd3effd640 1 -- 172.21.15.92:0/2607501446 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fdd380041d0 con 0x7fdd48102570 2024-09-19T09:11:09.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.604+0000 7fdd524a5740 1 Processor -- start 2024-09-19T09:11:09.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.604+0000 7fdd524a5740 1 -- start start 2024-09-19T09:11:09.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.605+0000 7fdd524a5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564f90e224a0 0x564f90e22880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:09.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.605+0000 7fdd524a5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f90e22dc0 0x564f90e2d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:09.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.605+0000 7fdd524a5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f90e2d680 0x564f90e2fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:09.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.605+0000 7fdd524a5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564f90d882e0 con 0x564f90e224a0 2024-09-19T09:11:09.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.605+0000 7fdd524a5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564f90d2fce0 con 0x564f90e22dc0 2024-09-19T09:11:09.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.605+0000 7fdd524a5740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x564f90d842a0 con 0x564f90e2d680 2024-09-19T09:11:09.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.605+0000 7fdd3effd640 1 --2- 172.21.15.92:0/2607501446 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdd340a3240 0x7fdd340a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:09.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.605+0000 7fdd4e669640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564f90e224a0 0x564f90e22880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:09.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.605+0000 7fdd4de68640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f90e22dc0 0x564f90e2d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:09.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.605+0000 7fdd4e669640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564f90e224a0 0x564f90e22880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49224/0 (socket says 172.21.15.92:49224) 2024-09-19T09:11:09.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.605+0000 7fdd4e669640 1 -- 172.21.15.92:0/2905764772 learned_addr learned my addr 172.21.15.92:0/2905764772 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:09.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.605+0000 7fdd4d667640 1 --2- 172.21.15.92:0/2905764772 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f90e2d680 0x564f90e2fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:09.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.605+0000 7fdd3effd640 1 -- 172.21.15.92:0/2607501446 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fdd380cf230 con 0x7fdd48102570 2024-09-19T09:11:09.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.605+0000 7fdd4de68640 1 -- 172.21.15.92:0/2905764772 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f90e2d680 msgr2=0x564f90e2fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:09.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.605+0000 7fdd4e669640 1 --2- 172.21.15.92:0/2607501446 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdd340a3240 0x7fdd340a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:09.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.605+0000 7fdd4de68640 1 --2- 172.21.15.92:0/2905764772 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f90e2d680 0x564f90e2fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.605+0000 7fdd4de68640 1 -- 172.21.15.92:0/2905764772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564f90e224a0 msgr2=0x564f90e22880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:09.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.605+0000 7fdd4de68640 1 --2- 172.21.15.92:0/2905764772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564f90e224a0 0x564f90e22880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.605+0000 7fdd4de68640 1 -- 172.21.15.92:0/2905764772 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f90d14440 con 0x564f90e22dc0 2024-09-19T09:11:09.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.606+0000 7fdd4de68640 1 --2- 172.21.15.92:0/2905764772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f90e22dc0 0x564f90e2d140 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fdd44009c00 tx=0x7fdd44011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b78eead53192b14 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:09.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.606+0000 7fdd33fff640 1 -- 172.21.15.92:0/2905764772 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd44004230 con 0x564f90e22dc0 2024-09-19T09:11:09.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.606+0000 7fdd4e669640 1 --2- 172.21.15.92:0/2607501446 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdd340a3240 0x7fdd340a5700 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fdd40009a60 tx=0x7fdd40005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:09.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.606+0000 7fdd33fff640 1 -- 172.21.15.92:0/2905764772 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd440043d0 con 0x564f90e22dc0 2024-09-19T09:11:09.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.606+0000 7fdd33fff640 1 -- 172.21.15.92:0/2905764772 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd44004d90 con 0x564f90e22dc0 2024-09-19T09:11:09.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.607+0000 7fdd524a5740 1 -- 172.21.15.92:0/2905764772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f90e22dc0 msgr2=0x564f90e2d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:09.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.607+0000 7fdd524a5740 1 --2- 172.21.15.92:0/2905764772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f90e22dc0 0x564f90e2d140 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fdd44009c00 tx=0x7fdd44011810 comp rx=0 tx=0).stop 2024-09-19T09:11:09.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.607+0000 7fdd524a5740 1 -- 172.21.15.92:0/2905764772 shutdown_connections 2024-09-19T09:11:09.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.607+0000 7fdd524a5740 1 --2- 172.21.15.92:0/2905764772 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f90e2d680 0x564f90e2fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.607+0000 7fdd524a5740 1 --2- 172.21.15.92:0/2905764772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f90e22dc0 0x564f90e2d140 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.607+0000 7fdd524a5740 1 --2- 172.21.15.92:0/2905764772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564f90e224a0 0x564f90e22880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.607+0000 7fdd524a5740 1 -- 172.21.15.92:0/2905764772 >> 172.21.15.92:0/2905764772 conn(0x564f90e1ea30 msgr2=0x564f90e1ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:09.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.607+0000 7fdd524a5740 1 -- 172.21.15.92:0/2905764772 shutdown_connections 2024-09-19T09:11:09.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.607+0000 7fdd524a5740 1 -- 172.21.15.92:0/2905764772 wait complete. 2024-09-19T09:11:09.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.607+0000 7fdd524a5740 1 -- start start 2024-09-19T09:11:09.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.607+0000 7fdd524a5740 1 Processor -- start 2024-09-19T09:11:09.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.608+0000 7fdd524a5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564f90e224a0 0x564f90e2cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:09.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.608+0000 7fdd524a5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f90e22dc0 0x564f90e2a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:09.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.608+0000 7fdd524a5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f90e2d680 0x564f90e2a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:09.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.608+0000 7fdd524a5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564f90e30250 con 0x564f90e224a0 2024-09-19T09:11:09.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.608+0000 7fdd524a5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564f90d43050 con 0x564f90e22dc0 2024-09-19T09:11:09.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.608+0000 7fdd524a5740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x564f90e303d0 con 0x564f90e2d680 2024-09-19T09:11:09.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.608+0000 7fdd524a5740 10 client.0 _ll_register_callbacks cb 0x564f90d83160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:11:09.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.608+0000 7fdd4de68640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564f90e224a0 0x564f90e2cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:09.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.608+0000 7fdd4de68640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564f90e224a0 0x564f90e2cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49228/0 (socket says 172.21.15.92:49228) 2024-09-19T09:11:09.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.608+0000 7fdd4d667640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f90e22dc0 0x564f90e2a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:09.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.608+0000 7fdd4de68640 1 -- 172.21.15.92:0/3083695105 learned_addr learned my addr 172.21.15.92:0/3083695105 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:09.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.608+0000 7fdd4e669640 1 --2- 172.21.15.92:0/3083695105 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f90e2d680 0x564f90e2a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:09.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.608+0000 7fdd4de68640 1 -- 172.21.15.92:0/3083695105 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f90e2d680 msgr2=0x564f90e2a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:09.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.608+0000 7fdd4de68640 1 --2- 172.21.15.92:0/3083695105 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f90e2d680 0x564f90e2a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.608+0000 7fdd4de68640 1 -- 172.21.15.92:0/3083695105 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f90e22dc0 msgr2=0x564f90e2a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:09.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.608+0000 7fdd4de68640 1 --2- 172.21.15.92:0/3083695105 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f90e22dc0 0x564f90e2a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.608+0000 7fdd4de68640 1 -- 172.21.15.92:0/3083695105 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f90af93c0 con 0x564f90e224a0 2024-09-19T09:11:09.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.608+0000 7fdd4d667640 1 --2- 172.21.15.92:0/3083695105 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f90e22dc0 0x564f90e2a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:11:09.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.608+0000 7fdd4de68640 1 --2- 172.21.15.92:0/3083695105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564f90e224a0 0x564f90e2cea0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fdd44005890 tx=0x7fdd44019af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe04651dad2a8d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:09.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.608+0000 7fdd317fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:11:09.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.609+0000 7fdd317fa640 1 -- 172.21.15.92:0/3083695105 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd44028020 con 0x564f90e224a0 2024-09-19T09:11:09.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.609+0000 7fdd317fa640 1 -- 172.21.15.92:0/3083695105 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fdd44024620 con 0x564f90e224a0 2024-09-19T09:11:09.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.609+0000 7fdd524a5740 1 -- 172.21.15.92:0/3083695105 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd440043d0 con 0x564f90e224a0 2024-09-19T09:11:09.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.609+0000 7fdd317fa640 1 -- 172.21.15.92:0/3083695105 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fdd44009e70 con 0x564f90e224a0 2024-09-19T09:11:09.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.609+0000 7fdd524a5740 10 client.18792 fetch_fsmap learned FSMap version 19 2024-09-19T09:11:09.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.609+0000 7fdd524a5740 1 -- 172.21.15.92:0/3083695105 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x564f90e3ff10 con 0x564f90e224a0 2024-09-19T09:11:09.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.609+0000 7fdd317fa640 1 -- 172.21.15.92:0/3083695105 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd440043d0 con 0x564f90e224a0 2024-09-19T09:11:09.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.609+0000 7fdd317fa640 1 -- 172.21.15.92:0/3083695105 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fdd44018070 con 0x564f90e224a0 2024-09-19T09:11:09.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.609+0000 7fdd524a5740 10 client.18792 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:11:09.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.609+0000 7fdd524a5740 10 client.18792 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:11:09.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.609+0000 7fdd524a5740 20 client.18792 populate_metadata read hostname 'smithi092' 2024-09-19T09:11:09.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.609+0000 7fdd524a5740 1 --2- 172.21.15.92:0/3083695105 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564f90e41320 0x564f90e43710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:09.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.609+0000 7fdd524a5740 4 client.18792 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:11:09.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.609+0000 7fdd524a5740 1 -- 172.21.15.92:0/3083695105 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f90d95850 con 0x564f90e41320 2024-09-19T09:11:09.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.610+0000 7fdd4d667640 1 --2- 172.21.15.92:0/3083695105 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564f90e41320 0x564f90e43710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:09.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.610+0000 7fdd317fa640 10 client.18792 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:09.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.610+0000 7fdd4d667640 1 --2- 172.21.15.92:0/3083695105 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564f90e41320 0x564f90e43710 crc :-1 s=READY pgs=432 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87edb3b5edd295 server_cookie=354b32786290fa4c in_seq=0 out_seq=0 2024-09-19T09:11:09.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.611+0000 7fdd317fa640 1 -- 172.21.15.92:0/3083695105 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564f90d95850 con 0x564f90e41320 2024-09-19T09:11:09.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.611+0000 7fdd317fa640 10 client.18792 handle_command_reply: tid=0 2024-09-19T09:11:09.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.611+0000 7fdd524a5740 1 client.18792 shutdown 2024-09-19T09:11:09.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.611+0000 7fdd524a5740 1 -- 172.21.15.92:0/3083695105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564f90e224a0 msgr2=0x564f90e2cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:09.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.611+0000 7fdd524a5740 1 --2- 172.21.15.92:0/3083695105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564f90e224a0 0x564f90e2cea0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fdd44005890 tx=0x7fdd44019af0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.611+0000 7fdd524a5740 1 -- 172.21.15.92:0/3083695105 shutdown_connections 2024-09-19T09:11:09.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.611+0000 7fdd524a5740 1 --2- 172.21.15.92:0/3083695105 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564f90e41320 0x564f90e43710 crc :-1 s=READY pgs=432 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.611+0000 7fdd524a5740 1 --2- 172.21.15.92:0/3083695105 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f90e2d680 0x564f90e2a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.611+0000 7fdd524a5740 1 --2- 172.21.15.92:0/3083695105 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f90e22dc0 0x564f90e2a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.611+0000 7fdd524a5740 1 --2- 172.21.15.92:0/3083695105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564f90e224a0 0x564f90e2cea0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.611+0000 7fdd317fa640 0 client.18792 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:09.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.611+0000 7fdd524a5740 1 -- 172.21.15.92:0/3083695105 >> 172.21.15.92:0/3083695105 conn(0x564f90e1ea30 msgr2=0x564f90e24760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:09.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.611+0000 7fdd524a5740 1 -- 172.21.15.92:0/3083695105 shutdown_connections 2024-09-19T09:11:09.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.611+0000 7fdd524a5740 1 -- 172.21.15.92:0/3083695105 wait complete. 2024-09-19T09:11:09.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.611+0000 7fdd524a5740 20 client.18792 trim_cache size 0 max 16384 2024-09-19T09:11:09.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.628+0000 7fdd524a5740 1 Processor -- start 2024-09-19T09:11:09.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.628+0000 7fdd524a5740 1 -- start start 2024-09-19T09:11:09.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.628+0000 7fdd524a5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f90e224a0 0x564f90e25900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:09.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.628+0000 7fdd524a5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f90e22dc0 0x564f90e1da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:09.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.628+0000 7fdd524a5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564f90e2d680 0x564f90e48f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:09.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.628+0000 7fdd524a5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdd481a93f0 con 0x564f90e2d680 2024-09-19T09:11:09.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.628+0000 7fdd524a5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdd481abc90 con 0x564f90e22dc0 2024-09-19T09:11:09.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.628+0000 7fdd524a5740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fdd481a9a80 con 0x564f90e224a0 2024-09-19T09:11:09.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.628+0000 7fdd4e669640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564f90e2d680 0x564f90e48f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:09.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.629+0000 7fdd4e669640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564f90e2d680 0x564f90e48f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49244/0 (socket says 172.21.15.92:49244) 2024-09-19T09:11:09.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.629+0000 7fdd4e669640 1 -- 172.21.15.92:0/3980492317 learned_addr learned my addr 172.21.15.92:0/3980492317 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:09.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.629+0000 7fdd4d667640 1 --2- 172.21.15.92:0/3980492317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f90e22dc0 0x564f90e1da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:09.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.629+0000 7fdd4de68640 1 --2- 172.21.15.92:0/3980492317 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f90e224a0 0x564f90e25900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:09.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.629+0000 7fdd4d667640 1 -- 172.21.15.92:0/3980492317 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f90e224a0 msgr2=0x564f90e25900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:09.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.629+0000 7fdd4d667640 1 --2- 172.21.15.92:0/3980492317 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f90e224a0 0x564f90e25900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.629+0000 7fdd4d667640 1 -- 172.21.15.92:0/3980492317 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564f90e2d680 msgr2=0x564f90e48f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:09.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.629+0000 7fdd4d667640 1 --2- 172.21.15.92:0/3980492317 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564f90e2d680 0x564f90e48f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.629+0000 7fdd4d667640 1 -- 172.21.15.92:0/3980492317 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f90e1e860 con 0x564f90e22dc0 2024-09-19T09:11:09.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.629+0000 7fdd4e669640 1 --2- 172.21.15.92:0/3980492317 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564f90e2d680 0x564f90e48f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:11:09.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.629+0000 7fdd4d667640 1 --2- 172.21.15.92:0/3980492317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f90e22dc0 0x564f90e1da60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fdd380981e0 tx=0x7fdd38017ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc685c46dd66d691 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:09.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.629+0000 7fdd337fe640 1 -- 172.21.15.92:0/3980492317 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3809b350 con 0x564f90e22dc0 2024-09-19T09:11:09.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.629+0000 7fdd337fe640 1 -- 172.21.15.92:0/3980492317 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd3809bf10 con 0x564f90e22dc0 2024-09-19T09:11:09.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.629+0000 7fdd337fe640 1 -- 172.21.15.92:0/3980492317 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3809b170 con 0x564f90e22dc0 2024-09-19T09:11:09.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.630+0000 7fdd524a5740 1 -- 172.21.15.92:0/3980492317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f90e22dc0 msgr2=0x564f90e1da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:09.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.630+0000 7fdd524a5740 1 --2- 172.21.15.92:0/3980492317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f90e22dc0 0x564f90e1da60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fdd380981e0 tx=0x7fdd38017ba0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.630+0000 7fdd524a5740 1 -- 172.21.15.92:0/3980492317 shutdown_connections 2024-09-19T09:11:09.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.630+0000 7fdd524a5740 1 --2- 172.21.15.92:0/3980492317 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564f90e2d680 0x564f90e48f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.630+0000 7fdd524a5740 1 --2- 172.21.15.92:0/3980492317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f90e22dc0 0x564f90e1da60 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.630+0000 7fdd524a5740 1 --2- 172.21.15.92:0/3980492317 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f90e224a0 0x564f90e25900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.630+0000 7fdd524a5740 1 -- 172.21.15.92:0/3980492317 >> 172.21.15.92:0/3980492317 conn(0x564f90e1ea30 msgr2=0x564f90e1d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:09.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.630+0000 7fdd524a5740 1 -- 172.21.15.92:0/3980492317 shutdown_connections 2024-09-19T09:11:09.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.630+0000 7fdd524a5740 1 -- 172.21.15.92:0/3980492317 wait complete. 2024-09-19T09:11:09.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.630+0000 7fdd524a5740 1 -- start start 2024-09-19T09:11:09.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.630+0000 7fdd524a5740 1 Processor -- start 2024-09-19T09:11:09.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.631+0000 7fdd524a5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f90e224a0 0x564f90e35960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:09.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.631+0000 7fdd524a5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564f90e22dc0 0x564f90e35ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:09.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.631+0000 7fdd524a5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f90e2d680 0x564f90e30db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:09.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.631+0000 7fdd524a5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdd481aa150 con 0x564f90e22dc0 2024-09-19T09:11:09.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.631+0000 7fdd524a5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdd481ab5c0 con 0x564f90e224a0 2024-09-19T09:11:09.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.631+0000 7fdd524a5740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fdd481aa820 con 0x564f90e2d680 2024-09-19T09:11:09.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.631+0000 7fdd524a5740 10 client.0 _ll_register_callbacks cb 0x7fdd40009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:11:09.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.631+0000 7fdd4d667640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564f90e22dc0 0x564f90e35ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:09.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.631+0000 7fdd4d667640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564f90e22dc0 0x564f90e35ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49248/0 (socket says 172.21.15.92:49248) 2024-09-19T09:11:09.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.631+0000 7fdd4d667640 1 -- 172.21.15.92:0/1367510627 learned_addr learned my addr 172.21.15.92:0/1367510627 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:09.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.631+0000 7fdd4e669640 1 --2- 172.21.15.92:0/1367510627 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f90e2d680 0x564f90e30db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:09.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.631+0000 7fdd4de68640 1 --2- 172.21.15.92:0/1367510627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f90e224a0 0x564f90e35960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:09.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.631+0000 7fdd4e669640 1 -- 172.21.15.92:0/1367510627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f90e224a0 msgr2=0x564f90e35960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:09.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.631+0000 7fdd4e669640 1 --2- 172.21.15.92:0/1367510627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f90e224a0 0x564f90e35960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.631+0000 7fdd4e669640 1 -- 172.21.15.92:0/1367510627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564f90e22dc0 msgr2=0x564f90e35ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:09.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.631+0000 7fdd4e669640 1 --2- 172.21.15.92:0/1367510627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564f90e22dc0 0x564f90e35ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.631+0000 7fdd4e669640 1 -- 172.21.15.92:0/1367510627 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f90e315e0 con 0x564f90e2d680 2024-09-19T09:11:09.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.631+0000 7fdd4d667640 1 --2- 172.21.15.92:0/1367510627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564f90e22dc0 0x564f90e35ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:11:09.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.632+0000 7fdd4e669640 1 --2- 172.21.15.92:0/1367510627 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f90e2d680 0x564f90e30db0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fdd4002ae70 tx=0x7fdd400095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c14bcfadab33276a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:09.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.632+0000 7fdd317fa640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:11:09.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.632+0000 7fdd317fa640 1 -- 172.21.15.92:0/1367510627 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd40034040 con 0x564f90e2d680 2024-09-19T09:11:09.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.632+0000 7fdd317fa640 1 -- 172.21.15.92:0/1367510627 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fdd400047a0 con 0x564f90e2d680 2024-09-19T09:11:09.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.632+0000 7fdd524a5740 1 -- 172.21.15.92:0/1367510627 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd3809bf10 con 0x564f90e2d680 2024-09-19T09:11:09.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.632+0000 7fdd317fa640 1 -- 172.21.15.92:0/1367510627 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fdd40030440 con 0x564f90e2d680 2024-09-19T09:11:09.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.632+0000 7fdd524a5740 10 client.27910 fetch_fsmap learned FSMap version 19 2024-09-19T09:11:09.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.632+0000 7fdd524a5740 1 -- 172.21.15.92:0/1367510627 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x564f90eabaf0 con 0x564f90e2d680 2024-09-19T09:11:09.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.632+0000 7fdd317fa640 1 -- 172.21.15.92:0/1367510627 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd3809bf10 con 0x564f90e2d680 2024-09-19T09:11:09.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.632+0000 7fdd317fa640 1 -- 172.21.15.92:0/1367510627 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fdd40053020 con 0x564f90e2d680 2024-09-19T09:11:09.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.632+0000 7fdd524a5740 10 client.27910 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:11:09.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.632+0000 7fdd524a5740 10 client.27910 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:11:09.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.632+0000 7fdd524a5740 20 client.27910 populate_metadata read hostname 'smithi092' 2024-09-19T09:11:09.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.632+0000 7fdd524a5740 1 --2- 172.21.15.92:0/1367510627 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564f90eac240 0x564f90eae660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:09.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.633+0000 7fdd524a5740 4 client.27910 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:11:09.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.633+0000 7fdd524a5740 1 -- 172.21.15.92:0/1367510627 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564f90d8fd60 con 0x564f90eac240 2024-09-19T09:11:09.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.633+0000 7fdd4de68640 1 --2- 172.21.15.92:0/1367510627 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564f90eac240 0x564f90eae660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:09.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.633+0000 7fdd317fa640 10 client.27910 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:09.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.633+0000 7fdd4de68640 1 --2- 172.21.15.92:0/1367510627 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564f90eac240 0x564f90eae660 crc :-1 s=READY pgs=433 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db4f5b4500a82264 server_cookie=3fc6ca50a8feb322 in_seq=0 out_seq=0 2024-09-19T09:11:09.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.633+0000 7fdd317fa640 1 -- 172.21.15.92:0/1367510627 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x564f90d8fd60 con 0x564f90eac240 2024-09-19T09:11:09.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.633+0000 7fdd317fa640 10 client.27910 handle_command_reply: tid=0 2024-09-19T09:11:09.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.633+0000 7fdd524a5740 1 client.27910 shutdown 2024-09-19T09:11:09.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.633+0000 7fdd524a5740 1 -- 172.21.15.92:0/1367510627 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f90e2d680 msgr2=0x564f90e30db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:09.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.633+0000 7fdd524a5740 1 --2- 172.21.15.92:0/1367510627 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f90e2d680 0x564f90e30db0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fdd4002ae70 tx=0x7fdd400095c0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.634+0000 7fdd524a5740 1 -- 172.21.15.92:0/1367510627 shutdown_connections 2024-09-19T09:11:09.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.634+0000 7fdd524a5740 1 --2- 172.21.15.92:0/1367510627 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564f90eac240 0x564f90eae660 crc :-1 s=READY pgs=433 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.634+0000 7fdd524a5740 1 --2- 172.21.15.92:0/1367510627 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564f90e2d680 0x564f90e30db0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.634+0000 7fdd524a5740 1 --2- 172.21.15.92:0/1367510627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564f90e22dc0 0x564f90e35ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.634+0000 7fdd317fa640 0 client.27910 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:09.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.634+0000 7fdd524a5740 1 --2- 172.21.15.92:0/1367510627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f90e224a0 0x564f90e35960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.634+0000 7fdd524a5740 1 -- 172.21.15.92:0/1367510627 >> 172.21.15.92:0/1367510627 conn(0x564f90e1ea30 msgr2=0x564f90e288f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:09.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.634+0000 7fdd524a5740 1 -- 172.21.15.92:0/1367510627 shutdown_connections 2024-09-19T09:11:09.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.634+0000 7fdd524a5740 1 -- 172.21.15.92:0/1367510627 wait complete. 2024-09-19T09:11:09.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.634+0000 7fdd524a5740 20 client.27910 trim_cache size 0 max 16384 2024-09-19T09:11:09.640 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:11:09.640 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-19T09:11:09.641 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {} 2024-09-19T09:11:09.641 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:11:09.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.634+0000 7fdd500cc640 1 -- 172.21.15.92:0/2607501446 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdd340a3240 msgr2=0x7fdd340a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:09.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.634+0000 7fdd500cc640 1 --2- 172.21.15.92:0/2607501446 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdd340a3240 0x7fdd340a5700 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fdd40009a60 tx=0x7fdd40005c50 comp rx=0 tx=0).stop 2024-09-19T09:11:09.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.634+0000 7fdd500cc640 1 -- 172.21.15.92:0/2607501446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd48102570 msgr2=0x7fdd48199910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:09.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.634+0000 7fdd500cc640 1 --2- 172.21.15.92:0/2607501446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd48102570 0x7fdd48199910 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdd3800d950 tx=0x7fdd3800de10 comp rx=0 tx=0).stop 2024-09-19T09:11:09.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.634+0000 7fdd500cc640 1 -- 172.21.15.92:0/2607501446 shutdown_connections 2024-09-19T09:11:09.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.634+0000 7fdd500cc640 1 --2- 172.21.15.92:0/2607501446 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdd340a3240 0x7fdd340a5700 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.634+0000 7fdd500cc640 1 --2- 172.21.15.92:0/2607501446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd48102ef0 0x7fdd48199e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.634+0000 7fdd500cc640 1 --2- 172.21.15.92:0/2607501446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd48102570 0x7fdd48199910 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.634+0000 7fdd500cc640 1 --2- 172.21.15.92:0/2607501446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd48100e20 0x7fdd481993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:09.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.634+0000 7fdd500cc640 1 -- 172.21.15.92:0/2607501446 >> 172.21.15.92:0/2607501446 conn(0x7fdd480fc7d0 msgr2=0x7fdd481068d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:09.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.635+0000 7fdd500cc640 1 -- 172.21.15.92:0/2607501446 shutdown_connections 2024-09-19T09:11:09.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:09.635+0000 7fdd500cc640 1 -- 172.21.15.92:0/2607501446 wait complete. 2024-09-19T09:11:09.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:09 smithi092 ceph-mon[31407]: scrub summary: idle 2024-09-19T09:11:09.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:09 smithi092 ceph-mon[31407]: pgmap v770: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 9.5 MiB/s wr, 803 op/s 2024-09-19T09:11:09.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:09 smithi167 ceph-mon[35359]: scrub summary: idle 2024-09-19T09:11:09.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:09 smithi167 ceph-mon[35359]: pgmap v770: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 9.5 MiB/s wr, 803 op/s 2024-09-19T09:11:09.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:09 smithi190 ceph-mon[35358]: scrub summary: idle 2024-09-19T09:11:09.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:09 smithi190 ceph-mon[35358]: pgmap v770: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 9.5 MiB/s wr, 803 op/s 2024-09-19T09:11:10.518 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:11:10.519 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:11:10.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:10 smithi092 ceph-mon[31407]: pgmap v771: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 9.4 MiB/s wr, 846 op/s 2024-09-19T09:11:10.796 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 865.0 s, 1796.4 tps, lat 38.095 ms stddev 43.692 2024-09-19T09:11:11.069 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '7b482bc7', quiesce took 6.4 seconds. Will release after: 23.049999999999997 2024-09-19T09:11:11.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:10 smithi167 ceph-mon[35359]: pgmap v771: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 9.4 MiB/s wr, 846 op/s 2024-09-19T09:11:11.103 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:11:11.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:10 smithi190 ceph-mon[35358]: pgmap v771: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 9.4 MiB/s wr, 846 op/s 2024-09-19T09:11:11.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.535+0000 7fcee7460640 1 -- 172.21.15.92:0/4141167127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcee0101df0 msgr2=0x7fcee01021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:11.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.535+0000 7fcee7460640 1 --2- 172.21.15.92:0/4141167127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcee0101df0 0x7fcee01021d0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fcedc009900 tx=0x7fcedc02a410 comp rx=0 tx=0).stop 2024-09-19T09:11:11.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.535+0000 7fcee7460640 1 -- 172.21.15.92:0/4141167127 shutdown_connections 2024-09-19T09:11:11.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.535+0000 7fcee7460640 1 --2- 172.21.15.92:0/4141167127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcee0106f20 0x7fcee010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:11.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.535+0000 7fcee7460640 1 --2- 172.21.15.92:0/4141167127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcee01027a0 0x7fcee01067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:11.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.535+0000 7fcee7460640 1 --2- 172.21.15.92:0/4141167127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcee0101df0 0x7fcee01021d0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:11.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.535+0000 7fcee7460640 1 -- 172.21.15.92:0/4141167127 >> 172.21.15.92:0/4141167127 conn(0x7fcee00fd8b0 msgr2=0x7fcee00ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:11.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.536+0000 7fcee7460640 1 -- 172.21.15.92:0/4141167127 shutdown_connections 2024-09-19T09:11:11.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.536+0000 7fcee7460640 1 -- 172.21.15.92:0/4141167127 wait complete. 2024-09-19T09:11:11.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.536+0000 7fcee7460640 1 Processor -- start 2024-09-19T09:11:11.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.536+0000 7fcee7460640 1 -- start start 2024-09-19T09:11:11.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.536+0000 7fcee7460640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcee0101df0 0x7fcee00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:11.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.536+0000 7fcee7460640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcee01027a0 0x7fcee0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:11.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.536+0000 7fcee7460640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcee0106f20 0x7fcee0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:11.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.537+0000 7fcee7460640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcee0111f80 con 0x7fcee0101df0 2024-09-19T09:11:11.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.537+0000 7fcee7460640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcee0111e00 con 0x7fcee01027a0 2024-09-19T09:11:11.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.537+0000 7fcee7460640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fcee0112100 con 0x7fcee0106f20 2024-09-19T09:11:11.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.537+0000 7fcee51fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcee0101df0 0x7fcee00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:11.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.537+0000 7fcee51fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcee0101df0 0x7fcee00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39796/0 (socket says 172.21.15.92:39796) 2024-09-19T09:11:11.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.537+0000 7fcee51fc640 1 -- 172.21.15.92:0/2037224418 learned_addr learned my addr 172.21.15.92:0/2037224418 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:11.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.537+0000 7fcee49fb640 1 --2- 172.21.15.92:0/2037224418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcee01027a0 0x7fcee0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:11.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.537+0000 7fcee59fd640 1 --2- 172.21.15.92:0/2037224418 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcee0106f20 0x7fcee0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:11.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.537+0000 7fcee51fc640 1 -- 172.21.15.92:0/2037224418 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcee0106f20 msgr2=0x7fcee0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:11.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.537+0000 7fcee51fc640 1 --2- 172.21.15.92:0/2037224418 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcee0106f20 0x7fcee0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:11.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.537+0000 7fcee51fc640 1 -- 172.21.15.92:0/2037224418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcee01027a0 msgr2=0x7fcee0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:11.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.537+0000 7fcee51fc640 1 --2- 172.21.15.92:0/2037224418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcee01027a0 0x7fcee0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:11.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.537+0000 7fcee51fc640 1 -- 172.21.15.92:0/2037224418 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcee01a6900 con 0x7fcee0101df0 2024-09-19T09:11:11.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.537+0000 7fcee49fb640 1 --2- 172.21.15.92:0/2037224418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcee01027a0 0x7fcee0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:11:11.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.537+0000 7fcee51fc640 1 --2- 172.21.15.92:0/2037224418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcee0101df0 0x7fcee00744f0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fcedc006010 tx=0x7fcedc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:11.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.537+0000 7fced67fc640 1 -- 172.21.15.92:0/2037224418 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcedc03f030 con 0x7fcee0101df0 2024-09-19T09:11:11.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.537+0000 7fced67fc640 1 -- 172.21.15.92:0/2037224418 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcedc003ce0 con 0x7fcee0101df0 2024-09-19T09:11:11.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.537+0000 7fcee7460640 1 -- 172.21.15.92:0/2037224418 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcee01a6b90 con 0x7fcee0101df0 2024-09-19T09:11:11.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.537+0000 7fced67fc640 1 -- 172.21.15.92:0/2037224418 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcedc035070 con 0x7fcee0101df0 2024-09-19T09:11:11.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.537+0000 7fcee7460640 1 -- 172.21.15.92:0/2037224418 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcee01a7070 con 0x7fcee0101df0 2024-09-19T09:11:11.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.538+0000 7fcee7460640 1 -- 172.21.15.92:0/2037224418 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcee01021d0 con 0x7fcee0101df0 2024-09-19T09:11:11.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.540+0000 7fced67fc640 1 -- 172.21.15.92:0/2037224418 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fcedc042030 con 0x7fcee0101df0 2024-09-19T09:11:11.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.540+0000 7fced67fc640 1 --2- 172.21.15.92:0/2037224418 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcecc0a3240 0x7fcecc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:11.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.540+0000 7fcee49fb640 1 --2- 172.21.15.92:0/2037224418 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcecc0a3240 0x7fcecc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:11.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.540+0000 7fced67fc640 1 -- 172.21.15.92:0/2037224418 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fcedc0f0020 con 0x7fcee0101df0 2024-09-19T09:11:11.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.541+0000 7fcee49fb640 1 --2- 172.21.15.92:0/2037224418 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcecc0a3240 0x7fcecc0a5700 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fcee0075f80 tx=0x7fced000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:11.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.544+0000 7fced67fc640 1 -- 172.21.15.92:0/2037224418 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcedc0bc7b0 con 0x7fcee0101df0 2024-09-19T09:11:11.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.752+0000 7fcee7460640 1 -- 172.21.15.92:0/2037224418 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcee010a100 con 0x7fcee0101df0 2024-09-19T09:11:11.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.753+0000 7fced67fc640 1 -- 172.21.15.92:0/2037224418 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7fcedc0c0ab0 con 0x7fcee0101df0 2024-09-19T09:11:11.754 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:11:11.754 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:11:11.754 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:11:11.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.755+0000 7fcee7460640 1 -- 172.21.15.92:0/2037224418 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcecc0a3240 msgr2=0x7fcecc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:11.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.755+0000 7fcee7460640 1 --2- 172.21.15.92:0/2037224418 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcecc0a3240 0x7fcecc0a5700 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fcee0075f80 tx=0x7fced000b390 comp rx=0 tx=0).stop 2024-09-19T09:11:11.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.755+0000 7fcee7460640 1 -- 172.21.15.92:0/2037224418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcee0101df0 msgr2=0x7fcee00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:11.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.755+0000 7fcee7460640 1 --2- 172.21.15.92:0/2037224418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcee0101df0 0x7fcee00744f0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fcedc006010 tx=0x7fcedc0042f0 comp rx=0 tx=0).stop 2024-09-19T09:11:11.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.755+0000 7fcee7460640 1 -- 172.21.15.92:0/2037224418 shutdown_connections 2024-09-19T09:11:11.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.755+0000 7fcee7460640 1 --2- 172.21.15.92:0/2037224418 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcee0106f20 0x7fcee0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:11.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.755+0000 7fcee7460640 1 --2- 172.21.15.92:0/2037224418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcee01027a0 0x7fcee0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:11.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.755+0000 7fcee7460640 1 --2- 172.21.15.92:0/2037224418 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fcecc0a3240 0x7fcecc0a5700 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:11.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.755+0000 7fcee7460640 1 --2- 172.21.15.92:0/2037224418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcee0101df0 0x7fcee00744f0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:11.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.755+0000 7fcee7460640 1 -- 172.21.15.92:0/2037224418 >> 172.21.15.92:0/2037224418 conn(0x7fcee00fd8b0 msgr2=0x7fcee00fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:11.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.755+0000 7fcee7460640 1 -- 172.21.15.92:0/2037224418 shutdown_connections 2024-09-19T09:11:11.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:11.755+0000 7fcee7460640 1 -- 172.21.15.92:0/2037224418 wait complete. 2024-09-19T09:11:12.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:11 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/2037224418' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:11:12.104 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:11 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/2037224418' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:11:12.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:11 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/2037224418' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:11:12.462 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:11:12.750 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:11:13.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:12 smithi167 ceph-mon[35359]: pgmap v772: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 7.7 MiB/s wr, 724 op/s 2024-09-19T09:11:13.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:12 smithi190 ceph-mon[35358]: pgmap v772: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 7.7 MiB/s wr, 724 op/s 2024-09-19T09:11:13.153 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:12 smithi092 ceph-mon[31407]: pgmap v772: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 7.7 MiB/s wr, 724 op/s 2024-09-19T09:11:13.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.234+0000 7f872599a640 1 -- 172.21.15.92:0/3628505679 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8720102ef0 msgr2=0x7f872010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:13.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.234+0000 7f872599a640 1 --2- 172.21.15.92:0/3628505679 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8720102ef0 0x7f872010da40 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f8718009900 tx=0x7f871802a480 comp rx=0 tx=0).stop 2024-09-19T09:11:13.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.234+0000 7f872599a640 1 -- 172.21.15.92:0/3628505679 shutdown_connections 2024-09-19T09:11:13.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.234+0000 7f872599a640 1 --2- 172.21.15.92:0/3628505679 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8720102ef0 0x7f872010da40 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:13.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.234+0000 7f872599a640 1 --2- 172.21.15.92:0/3628505679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8720102570 0x7f87201029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:13.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.234+0000 7f872599a640 1 --2- 172.21.15.92:0/3628505679 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8720100e20 0x7f8720101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:13.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.234+0000 7f872599a640 1 -- 172.21.15.92:0/3628505679 >> 172.21.15.92:0/3628505679 conn(0x7f87200fc7d0 msgr2=0x7f87200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:13.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.234+0000 7f872599a640 1 -- 172.21.15.92:0/3628505679 shutdown_connections 2024-09-19T09:11:13.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.234+0000 7f872599a640 1 -- 172.21.15.92:0/3628505679 wait complete. 2024-09-19T09:11:13.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.235+0000 7f872599a640 1 Processor -- start 2024-09-19T09:11:13.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.235+0000 7f872599a640 1 -- start start 2024-09-19T09:11:13.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.235+0000 7f872599a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8720100e20 0x7f8720199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:13.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.235+0000 7f872599a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8720102570 0x7f8720199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:13.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.235+0000 7f872599a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8720102ef0 0x7f87201a44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:13.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.235+0000 7f872599a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8720111020 con 0x7f8720102ef0 2024-09-19T09:11:13.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.235+0000 7f872599a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8720110ea0 con 0x7f8720102570 2024-09-19T09:11:13.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.235+0000 7f872599a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f87201111a0 con 0x7f8720100e20 2024-09-19T09:11:13.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.235+0000 7f871f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8720102ef0 0x7f87201a44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:13.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.235+0000 7f871f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8720102ef0 0x7f87201a44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39826/0 (socket says 172.21.15.92:39826) 2024-09-19T09:11:13.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.235+0000 7f871f7fe640 1 -- 172.21.15.92:0/287056033 learned_addr learned my addr 172.21.15.92:0/287056033 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:13.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.235+0000 7f871effd640 1 --2- 172.21.15.92:0/287056033 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8720100e20 0x7f8720199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:13.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.235+0000 7f871e7fc640 1 --2- 172.21.15.92:0/287056033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8720102570 0x7f8720199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:13.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.236+0000 7f871f7fe640 1 -- 172.21.15.92:0/287056033 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8720100e20 msgr2=0x7f8720199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:13.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.236+0000 7f871f7fe640 1 --2- 172.21.15.92:0/287056033 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8720100e20 0x7f8720199450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:13.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.236+0000 7f871f7fe640 1 -- 172.21.15.92:0/287056033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8720102570 msgr2=0x7f8720199990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:13.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.236+0000 7f871f7fe640 1 --2- 172.21.15.92:0/287056033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8720102570 0x7f8720199990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:13.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.236+0000 7f871f7fe640 1 -- 172.21.15.92:0/287056033 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87201a4a10 con 0x7f8720102ef0 2024-09-19T09:11:13.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.236+0000 7f871f7fe640 1 --2- 172.21.15.92:0/287056033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8720102ef0 0x7f87201a44d0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f8718005ab0 tx=0x7f8718003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:13.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.236+0000 7f8724998640 1 -- 172.21.15.92:0/287056033 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871803f070 con 0x7f8720102ef0 2024-09-19T09:11:13.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.236+0000 7f8724998640 1 -- 172.21.15.92:0/287056033 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8718031e30 con 0x7f8720102ef0 2024-09-19T09:11:13.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.236+0000 7f8724998640 1 -- 172.21.15.92:0/287056033 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8718035030 con 0x7f8720102ef0 2024-09-19T09:11:13.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.236+0000 7f872599a640 1 -- 172.21.15.92:0/287056033 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87201a4be0 con 0x7f8720102ef0 2024-09-19T09:11:13.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.236+0000 7f872599a640 1 -- 172.21.15.92:0/287056033 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87201a5040 con 0x7f8720102ef0 2024-09-19T09:11:13.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.238+0000 7f8724998640 1 -- 172.21.15.92:0/287056033 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8718042070 con 0x7f8720102ef0 2024-09-19T09:11:13.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.238+0000 7f8727d73740 1 Processor -- start 2024-09-19T09:11:13.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.239+0000 7f8727d73740 1 -- start start 2024-09-19T09:11:13.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.239+0000 7f8727d73740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632953dfb40 0x5632953de090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:13.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.239+0000 7f8727d73740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632953de5d0 0x5632953dea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:13.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.239+0000 7f8727d73740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632953e9370 0x5632953eb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:13.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.239+0000 7f8727d73740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5632953442f0 con 0x5632953e9370 2024-09-19T09:11:13.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.239+0000 7f8727d73740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5632952ebcf0 con 0x5632953de5d0 2024-09-19T09:11:13.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.239+0000 7f8727d73740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5632953402b0 con 0x5632953dfb40 2024-09-19T09:11:13.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.239+0000 7f871e7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632953e9370 0x5632953eb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:13.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.239+0000 7f871e7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632953e9370 0x5632953eb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39840/0 (socket says 172.21.15.92:39840) 2024-09-19T09:11:13.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.239+0000 7f871e7fc640 1 -- 172.21.15.92:0/1475158698 learned_addr learned my addr 172.21.15.92:0/1475158698 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:13.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.239+0000 7f871e7fc640 1 --2- 172.21.15.92:0/1475158698 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632953dfb40 0x5632953de090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:13.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.239+0000 7f8724998640 1 --2- 172.21.15.92:0/287056033 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f87080a32c0 0x7f87080a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:13.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.239+0000 7f871effd640 1 --2- 172.21.15.92:0/1475158698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632953de5d0 0x5632953dea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:13.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.239+0000 7f871f7fe640 1 --2- 172.21.15.92:0/287056033 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f87080a32c0 0x7f87080a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:13.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.239+0000 7f871e7fc640 1 -- 172.21.15.92:0/1475158698 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632953dfb40 msgr2=0x5632953de090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:13.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.239+0000 7f871e7fc640 1 --2- 172.21.15.92:0/1475158698 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632953dfb40 0x5632953de090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:13.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.239+0000 7f871e7fc640 1 -- 172.21.15.92:0/1475158698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632953de5d0 msgr2=0x5632953dea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:13.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.239+0000 7f871e7fc640 1 --2- 172.21.15.92:0/1475158698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632953de5d0 0x5632953dea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:13.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.239+0000 7f871e7fc640 1 -- 172.21.15.92:0/1475158698 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632952d03a0 con 0x5632953e9370 2024-09-19T09:11:13.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.239+0000 7f8724998640 1 -- 172.21.15.92:0/287056033 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f87180f0170 con 0x7f8720102ef0 2024-09-19T09:11:13.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.239+0000 7f871e7fc640 1 --2- 172.21.15.92:0/1475158698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632953e9370 0x5632953eb760 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f8714016530 tx=0x7f871400a2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d46082d846de066b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:13.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.240+0000 7f8705ffb640 1 -- 172.21.15.92:0/1475158698 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8714018430 con 0x5632953e9370 2024-09-19T09:11:13.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.240+0000 7f8705ffb640 1 -- 172.21.15.92:0/1475158698 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8714018ab0 con 0x5632953e9370 2024-09-19T09:11:13.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.240+0000 7f871f7fe640 1 --2- 172.21.15.92:0/287056033 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f87080a32c0 0x7f87080a5780 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8718009280 tx=0x7f871802a480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:13.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.240+0000 7f8705ffb640 1 -- 172.21.15.92:0/1475158698 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87140179b0 con 0x5632953e9370 2024-09-19T09:11:13.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.240+0000 7f8727d73740 1 -- 172.21.15.92:0/1475158698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632953e9370 msgr2=0x5632953eb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:13.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.240+0000 7f8727d73740 1 --2- 172.21.15.92:0/1475158698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632953e9370 0x5632953eb760 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f8714016530 tx=0x7f871400a2b0 comp rx=0 tx=0).stop 2024-09-19T09:11:13.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.240+0000 7f8727d73740 1 -- 172.21.15.92:0/1475158698 shutdown_connections 2024-09-19T09:11:13.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.240+0000 7f8727d73740 1 --2- 172.21.15.92:0/1475158698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632953e9370 0x5632953eb760 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:13.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.240+0000 7f8727d73740 1 --2- 172.21.15.92:0/1475158698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632953de5d0 0x5632953dea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:13.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.240+0000 7f8727d73740 1 --2- 172.21.15.92:0/1475158698 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632953dfb40 0x5632953de090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:13.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.240+0000 7f8727d73740 1 -- 172.21.15.92:0/1475158698 >> 172.21.15.92:0/1475158698 conn(0x5632953a7310 msgr2=0x5632953dac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:13.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.241+0000 7f8727d73740 1 -- 172.21.15.92:0/1475158698 shutdown_connections 2024-09-19T09:11:13.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.241+0000 7f8727d73740 1 -- 172.21.15.92:0/1475158698 wait complete. 2024-09-19T09:11:13.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.241+0000 7f8727d73740 1 -- start start 2024-09-19T09:11:13.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.241+0000 7f8727d73740 1 Processor -- start 2024-09-19T09:11:13.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.241+0000 7f8727d73740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632953de5d0 0x5632953e8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:13.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.241+0000 7f8727d73740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632953dfb40 0x5632953e6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:13.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.241+0000 7f8727d73740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632953e9370 0x5632953e6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:13.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.241+0000 7f8727d73740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5632953ebfb0 con 0x5632953e9370 2024-09-19T09:11:13.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.241+0000 7f8727d73740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5632952ff060 con 0x5632953dfb40 2024-09-19T09:11:13.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.241+0000 7f8727d73740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5632953ec130 con 0x5632953de5d0 2024-09-19T09:11:13.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.241+0000 7f8727d73740 10 client.0 _ll_register_callbacks cb 0x5632950528c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:11:13.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.241+0000 7f871e7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632953e9370 0x5632953e6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:13.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.242+0000 7f871e7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632953e9370 0x5632953e6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39850/0 (socket says 172.21.15.92:39850) 2024-09-19T09:11:13.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.242+0000 7f871e7fc640 1 -- 172.21.15.92:0/3201141827 learned_addr learned my addr 172.21.15.92:0/3201141827 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:13.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.242+0000 7f871e7fc640 1 --2- 172.21.15.92:0/3201141827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632953de5d0 0x5632953e8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:13.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.242+0000 7f871effd640 1 --2- 172.21.15.92:0/3201141827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632953dfb40 0x5632953e6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:13.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.242+0000 7f871e7fc640 1 -- 172.21.15.92:0/3201141827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632953de5d0 msgr2=0x5632953e8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:13.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.242+0000 7f871e7fc640 1 --2- 172.21.15.92:0/3201141827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632953de5d0 0x5632953e8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:13.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.242+0000 7f871e7fc640 1 -- 172.21.15.92:0/3201141827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632953dfb40 msgr2=0x5632953e6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:13.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.242+0000 7f871e7fc640 1 --2- 172.21.15.92:0/3201141827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632953dfb40 0x5632953e6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:13.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.242+0000 7f871e7fc640 1 -- 172.21.15.92:0/3201141827 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632950b53c0 con 0x5632953e9370 2024-09-19T09:11:13.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.242+0000 7f871e7fc640 1 --2- 172.21.15.92:0/3201141827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632953e9370 0x5632953e6610 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f8714001eb0 tx=0x7f8714017590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=becdc003f0be5e10 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:13.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.242+0000 7f86feffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:11:13.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.242+0000 7f86feffd640 1 -- 172.21.15.92:0/3201141827 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871402b060 con 0x5632953e9370 2024-09-19T09:11:13.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.242+0000 7f86feffd640 1 -- 172.21.15.92:0/3201141827 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8714017730 con 0x5632953e9370 2024-09-19T09:11:13.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.242+0000 7f8727d73740 1 -- 172.21.15.92:0/3201141827 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8714018ab0 con 0x5632953e9370 2024-09-19T09:11:13.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.242+0000 7f86feffd640 1 -- 172.21.15.92:0/3201141827 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8714017930 con 0x5632953e9370 2024-09-19T09:11:13.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.242+0000 7f8727d73740 10 client.18816 fetch_fsmap learned FSMap version 19 2024-09-19T09:11:13.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.242+0000 7f8727d73740 1 -- 172.21.15.92:0/3201141827 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5632953f7a80 con 0x5632953e9370 2024-09-19T09:11:13.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.243+0000 7f86feffd640 1 -- 172.21.15.92:0/3201141827 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8714018ab0 con 0x5632953e9370 2024-09-19T09:11:13.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.243+0000 7f86feffd640 1 -- 172.21.15.92:0/3201141827 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f8714012050 con 0x5632953e9370 2024-09-19T09:11:13.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.243+0000 7f8727d73740 10 client.18816 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:11:13.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.243+0000 7f8727d73740 10 client.18816 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:11:13.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.243+0000 7f8727d73740 20 client.18816 populate_metadata read hostname 'smithi092' 2024-09-19T09:11:13.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.243+0000 7f8727d73740 1 --2- 172.21.15.92:0/3201141827 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5632953f8dd0 0x5632953fb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:13.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.243+0000 7f8727d73740 4 client.18816 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:11:13.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.243+0000 7f8727d73740 1 -- 172.21.15.92:0/3201141827 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563295351860 con 0x5632953f8dd0 2024-09-19T09:11:13.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.243+0000 7f871effd640 1 --2- 172.21.15.92:0/3201141827 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5632953f8dd0 0x5632953fb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:13.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.244+0000 7f86feffd640 10 client.18816 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:13.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.244+0000 7f871effd640 1 --2- 172.21.15.92:0/3201141827 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5632953f8dd0 0x5632953fb1c0 crc :-1 s=READY pgs=434 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f62cd6a81ae3850 server_cookie=b03f338ec9a9d650 in_seq=0 out_seq=0 2024-09-19T09:11:13.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.244+0000 7f86feffd640 1 -- 172.21.15.92:0/3201141827 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563295351860 con 0x5632953f8dd0 2024-09-19T09:11:13.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.244+0000 7f86feffd640 10 client.18816 handle_command_reply: tid=0 2024-09-19T09:11:13.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.244+0000 7f8727d73740 1 client.18816 shutdown 2024-09-19T09:11:13.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.245+0000 7f8727d73740 1 -- 172.21.15.92:0/3201141827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632953e9370 msgr2=0x5632953e6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:13.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.245+0000 7f8727d73740 1 --2- 172.21.15.92:0/3201141827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632953e9370 0x5632953e6610 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f8714001eb0 tx=0x7f8714017590 comp rx=0 tx=0).stop 2024-09-19T09:11:13.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.245+0000 7f8727d73740 1 -- 172.21.15.92:0/3201141827 shutdown_connections 2024-09-19T09:11:13.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.245+0000 7f8727d73740 1 --2- 172.21.15.92:0/3201141827 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5632953f8dd0 0x5632953fb1c0 crc :-1 s=READY pgs=434 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:13.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.245+0000 7f8727d73740 1 --2- 172.21.15.92:0/3201141827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632953e9370 0x5632953e6610 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:13.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.245+0000 7f8727d73740 1 --2- 172.21.15.92:0/3201141827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632953dfb40 0x5632953e6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:13.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.245+0000 7f8727d73740 1 --2- 172.21.15.92:0/3201141827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632953de5d0 0x5632953e8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:13.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.245+0000 7f8727d73740 1 -- 172.21.15.92:0/3201141827 >> 172.21.15.92:0/3201141827 conn(0x5632953a7310 msgr2=0x5632953e0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:13.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.245+0000 7f86feffd640 0 client.18816 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:13.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.245+0000 7f8727d73740 1 -- 172.21.15.92:0/3201141827 shutdown_connections 2024-09-19T09:11:13.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.245+0000 7f8727d73740 1 -- 172.21.15.92:0/3201141827 wait complete. 2024-09-19T09:11:13.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.245+0000 7f8727d73740 20 client.18816 trim_cache size 0 max 16384 2024-09-19T09:11:13.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.257+0000 7f8727d73740 1 Processor -- start 2024-09-19T09:11:13.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.258+0000 7f8727d73740 1 -- start start 2024-09-19T09:11:13.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.258+0000 7f8727d73740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632953de5d0 0x5632953dae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:13.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.258+0000 7f8727d73740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632953dfb40 0x5632953fde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:13.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.258+0000 7f8727d73740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632953e9370 0x5632953fe340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:13.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.258+0000 7f8727d73740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f87201ab640 con 0x5632953de5d0 2024-09-19T09:11:13.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.258+0000 7f8727d73740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f87201adee0 con 0x5632953dfb40 2024-09-19T09:11:13.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.258+0000 7f8727d73740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f87201abcd0 con 0x5632953e9370 2024-09-19T09:11:13.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.258+0000 7f871e7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632953de5d0 0x5632953dae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:13.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.258+0000 7f871e7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632953de5d0 0x5632953dae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39866/0 (socket says 172.21.15.92:39866) 2024-09-19T09:11:13.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.258+0000 7f871e7fc640 1 -- 172.21.15.92:0/533118159 learned_addr learned my addr 172.21.15.92:0/533118159 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:13.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.258+0000 7f871e7fc640 1 -- 172.21.15.92:0/533118159 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632953e9370 msgr2=0x5632953fe340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:13.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.258+0000 7f871effd640 1 --2- 172.21.15.92:0/533118159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632953dfb40 0x5632953fde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:13.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.258+0000 7f871e7fc640 1 --2- 172.21.15.92:0/533118159 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632953e9370 0x5632953fe340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:13.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.258+0000 7f871e7fc640 1 -- 172.21.15.92:0/533118159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632953dfb40 msgr2=0x5632953fde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:13.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.258+0000 7f871e7fc640 1 --2- 172.21.15.92:0/533118159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632953dfb40 0x5632953fde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:13.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.258+0000 7f871e7fc640 1 -- 172.21.15.92:0/533118159 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632953ebcc0 con 0x5632953de5d0 2024-09-19T09:11:13.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.258+0000 7f871effd640 1 --2- 172.21.15.92:0/533118159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632953dfb40 0x5632953fde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:11:13.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.258+0000 7f871e7fc640 1 --2- 172.21.15.92:0/533118159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632953de5d0 0x5632953dae10 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f8714006e10 tx=0x7f8714026df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=449477f2cc4d108a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:13.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.258+0000 7f87057fa640 1 -- 172.21.15.92:0/533118159 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871402b070 con 0x5632953de5d0 2024-09-19T09:11:13.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.258+0000 7f87057fa640 1 -- 172.21.15.92:0/533118159 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8714016fd0 con 0x5632953de5d0 2024-09-19T09:11:13.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.258+0000 7f87057fa640 1 -- 172.21.15.92:0/533118159 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8714035080 con 0x5632953de5d0 2024-09-19T09:11:13.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.259+0000 7f8727d73740 1 -- 172.21.15.92:0/533118159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632953de5d0 msgr2=0x5632953dae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:13.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.259+0000 7f8727d73740 1 --2- 172.21.15.92:0/533118159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632953de5d0 0x5632953dae10 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f8714006e10 tx=0x7f8714026df0 comp rx=0 tx=0).stop 2024-09-19T09:11:13.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.259+0000 7f8727d73740 1 -- 172.21.15.92:0/533118159 shutdown_connections 2024-09-19T09:11:13.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.259+0000 7f8727d73740 1 --2- 172.21.15.92:0/533118159 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632953e9370 0x5632953fe340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:13.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.259+0000 7f8727d73740 1 --2- 172.21.15.92:0/533118159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632953dfb40 0x5632953fde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:13.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.259+0000 7f8727d73740 1 --2- 172.21.15.92:0/533118159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632953de5d0 0x5632953dae10 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:13.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.259+0000 7f8727d73740 1 -- 172.21.15.92:0/533118159 >> 172.21.15.92:0/533118159 conn(0x5632953a7310 msgr2=0x5632953da700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:13.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.259+0000 7f8727d73740 1 -- 172.21.15.92:0/533118159 shutdown_connections 2024-09-19T09:11:13.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.259+0000 7f8727d73740 1 -- 172.21.15.92:0/533118159 wait complete. 2024-09-19T09:11:13.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.259+0000 7f8727d73740 1 -- start start 2024-09-19T09:11:13.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.260+0000 7f8727d73740 1 Processor -- start 2024-09-19T09:11:13.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.260+0000 7f8727d73740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632953de5d0 0x5632953fb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:13.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.260+0000 7f8727d73740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632953dfb40 0x5632953fb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:13.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.260+0000 7f8727d73740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632953e9370 0x563295461700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:13.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.260+0000 7f8727d73740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f87201ac3a0 con 0x5632953dfb40 2024-09-19T09:11:13.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.260+0000 7f8727d73740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f87201ad810 con 0x5632953de5d0 2024-09-19T09:11:13.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.260+0000 7f8727d73740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f87201aca70 con 0x5632953e9370 2024-09-19T09:11:13.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.260+0000 7f8727d73740 10 client.0 _ll_register_callbacks cb 0x7f8710009a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:11:13.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.260+0000 7f871effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632953dfb40 0x5632953fb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:13.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.260+0000 7f871effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632953dfb40 0x5632953fb550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39880/0 (socket says 172.21.15.92:39880) 2024-09-19T09:11:13.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.260+0000 7f871effd640 1 -- 172.21.15.92:0/3991565435 learned_addr learned my addr 172.21.15.92:0/3991565435 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:13.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.260+0000 7f871e7fc640 1 --2- 172.21.15.92:0/3991565435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632953de5d0 0x5632953fb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:13.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.260+0000 7f871effd640 1 -- 172.21.15.92:0/3991565435 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632953e9370 msgr2=0x563295461700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:13.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.260+0000 7f871effd640 1 --2- 172.21.15.92:0/3991565435 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632953e9370 0x563295461700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:13.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.260+0000 7f871effd640 1 -- 172.21.15.92:0/3991565435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632953de5d0 msgr2=0x5632953fb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:13.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.260+0000 7f871effd640 1 --2- 172.21.15.92:0/3991565435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632953de5d0 0x5632953fb010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:13.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.260+0000 7f871effd640 1 -- 172.21.15.92:0/3991565435 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563295461c40 con 0x5632953dfb40 2024-09-19T09:11:13.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.260+0000 7f871effd640 1 --2- 172.21.15.92:0/3991565435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632953dfb40 0x5632953fb550 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f8710004b90 tx=0x7f871000ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a833911d022c831b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:13.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.260+0000 7f86feffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:11:13.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.261+0000 7f86feffd640 1 -- 172.21.15.92:0/3991565435 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8710018cc0 con 0x5632953dfb40 2024-09-19T09:11:13.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.261+0000 7f86feffd640 1 -- 172.21.15.92:0/3991565435 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f87100203f0 con 0x5632953dfb40 2024-09-19T09:11:13.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.261+0000 7f8727d73740 1 -- 172.21.15.92:0/3991565435 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8714016fd0 con 0x5632953dfb40 2024-09-19T09:11:13.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.261+0000 7f86feffd640 1 -- 172.21.15.92:0/3991565435 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8710018e60 con 0x5632953dfb40 2024-09-19T09:11:13.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.261+0000 7f8727d73740 10 client.18822 fetch_fsmap learned FSMap version 19 2024-09-19T09:11:13.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.261+0000 7f8727d73740 1 -- 172.21.15.92:0/3991565435 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x563295462e20 con 0x5632953dfb40 2024-09-19T09:11:13.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.261+0000 7f86feffd640 1 -- 172.21.15.92:0/3991565435 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8714016fd0 con 0x5632953dfb40 2024-09-19T09:11:13.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.261+0000 7f86feffd640 1 -- 172.21.15.92:0/3991565435 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f871002b880 con 0x5632953dfb40 2024-09-19T09:11:13.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.261+0000 7f8727d73740 10 client.18822 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:11:13.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.261+0000 7f8727d73740 10 client.18822 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:11:13.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.261+0000 7f8727d73740 20 client.18822 populate_metadata read hostname 'smithi092' 2024-09-19T09:11:13.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.261+0000 7f8727d73740 1 --2- 172.21.15.92:0/3991565435 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x563295463620 0x563295465a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:13.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.261+0000 7f8727d73740 4 client.18822 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:11:13.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.261+0000 7f8727d73740 1 -- 172.21.15.92:0/3991565435 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56329534bd70 con 0x563295463620 2024-09-19T09:11:13.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.261+0000 7f871e7fc640 1 --2- 172.21.15.92:0/3991565435 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x563295463620 0x563295465a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:13.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.262+0000 7f871e7fc640 1 --2- 172.21.15.92:0/3991565435 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x563295463620 0x563295465a40 crc :-1 s=READY pgs=435 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60b3716fc6ef980 server_cookie=9f7acaa0ef3164ab in_seq=0 out_seq=0 2024-09-19T09:11:13.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.262+0000 7f86feffd640 10 client.18822 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:13.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.262+0000 7f86feffd640 1 -- 172.21.15.92:0/3991565435 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56329534bd70 con 0x563295463620 2024-09-19T09:11:13.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.262+0000 7f86feffd640 10 client.18822 handle_command_reply: tid=0 2024-09-19T09:11:13.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.262+0000 7f8727d73740 1 client.18822 shutdown 2024-09-19T09:11:13.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.262+0000 7f8727d73740 1 -- 172.21.15.92:0/3991565435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632953dfb40 msgr2=0x5632953fb550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:13.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.262+0000 7f8727d73740 1 --2- 172.21.15.92:0/3991565435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632953dfb40 0x5632953fb550 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f8710004b90 tx=0x7f871000ad50 comp rx=0 tx=0).stop 2024-09-19T09:11:13.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.262+0000 7f8727d73740 1 -- 172.21.15.92:0/3991565435 shutdown_connections 2024-09-19T09:11:13.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.262+0000 7f8727d73740 1 --2- 172.21.15.92:0/3991565435 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x563295463620 0x563295465a40 crc :-1 s=READY pgs=435 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:13.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.262+0000 7f8727d73740 1 --2- 172.21.15.92:0/3991565435 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5632953e9370 0x563295461700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:13.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.262+0000 7f8727d73740 1 --2- 172.21.15.92:0/3991565435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632953dfb40 0x5632953fb550 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:13.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.262+0000 7f86feffd640 0 client.18822 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:13.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.262+0000 7f8727d73740 1 --2- 172.21.15.92:0/3991565435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632953de5d0 0x5632953fb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:13.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.262+0000 7f8727d73740 1 -- 172.21.15.92:0/3991565435 >> 172.21.15.92:0/3991565435 conn(0x5632953a7310 msgr2=0x5632953e7880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:13.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.262+0000 7f8727d73740 1 -- 172.21.15.92:0/3991565435 shutdown_connections 2024-09-19T09:11:13.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.262+0000 7f8727d73740 1 -- 172.21.15.92:0/3991565435 wait complete. 2024-09-19T09:11:13.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.262+0000 7f8727d73740 20 client.18822 trim_cache size 0 max 16384 2024-09-19T09:11:13.269 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-19T09:11:13.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.263+0000 7f872599a640 1 -- 172.21.15.92:0/287056033 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f87080a32c0 msgr2=0x7f87080a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:13.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.263+0000 7f872599a640 1 --2- 172.21.15.92:0/287056033 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f87080a32c0 0x7f87080a5780 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8718009280 tx=0x7f871802a480 comp rx=0 tx=0).stop 2024-09-19T09:11:13.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.263+0000 7f872599a640 1 -- 172.21.15.92:0/287056033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8720102ef0 msgr2=0x7f87201a44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:13.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.263+0000 7f872599a640 1 --2- 172.21.15.92:0/287056033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8720102ef0 0x7f87201a44d0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f8718005ab0 tx=0x7f8718003c30 comp rx=0 tx=0).stop 2024-09-19T09:11:13.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.263+0000 7f872599a640 1 -- 172.21.15.92:0/287056033 shutdown_connections 2024-09-19T09:11:13.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.263+0000 7f872599a640 1 --2- 172.21.15.92:0/287056033 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f87080a32c0 0x7f87080a5780 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:13.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.263+0000 7f872599a640 1 --2- 172.21.15.92:0/287056033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8720102ef0 0x7f87201a44d0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:13.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.263+0000 7f872599a640 1 --2- 172.21.15.92:0/287056033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8720102570 0x7f8720199990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:13.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.263+0000 7f872599a640 1 --2- 172.21.15.92:0/287056033 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8720100e20 0x7f8720199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:13.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.263+0000 7f872599a640 1 -- 172.21.15.92:0/287056033 >> 172.21.15.92:0/287056033 conn(0x7f87200fc7d0 msgr2=0x7f87200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:13.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.263+0000 7f872599a640 1 -- 172.21.15.92:0/287056033 shutdown_connections 2024-09-19T09:11:13.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:13.263+0000 7f872599a640 1 -- 172.21.15.92:0/287056033 wait complete. 2024-09-19T09:11:14.953 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:11:14.953 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:11:14.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:14 smithi092 ceph-mon[31407]: pgmap v773: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 6.9 MiB/s wr, 631 op/s 2024-09-19T09:11:15.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:14 smithi167 ceph-mon[35359]: pgmap v773: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 6.9 MiB/s wr, 631 op/s 2024-09-19T09:11:15.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:14 smithi190 ceph-mon[35358]: pgmap v773: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 6.9 MiB/s wr, 631 op/s 2024-09-19T09:11:15.211 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:11:15.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.652+0000 7fea26b33640 1 -- 172.21.15.92:0/1158655386 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea20102790 msgr2=0x7fea201067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:15.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.652+0000 7fea26b33640 1 --2- 172.21.15.92:0/1158655386 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea20102790 0x7fea201067e0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fea0c009900 tx=0x7fea0c02a410 comp rx=0 tx=0).stop 2024-09-19T09:11:15.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.652+0000 7fea26b33640 1 -- 172.21.15.92:0/1158655386 shutdown_connections 2024-09-19T09:11:15.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.652+0000 7fea26b33640 1 --2- 172.21.15.92:0/1158655386 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea20106f10 0x7fea2010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.652+0000 7fea26b33640 1 --2- 172.21.15.92:0/1158655386 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea20102790 0x7fea201067e0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.652+0000 7fea26b33640 1 --2- 172.21.15.92:0/1158655386 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea20101de0 0x7fea201021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.652+0000 7fea26b33640 1 -- 172.21.15.92:0/1158655386 >> 172.21.15.92:0/1158655386 conn(0x7fea200fd8c0 msgr2=0x7fea200ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:15.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.652+0000 7fea26b33640 1 -- 172.21.15.92:0/1158655386 shutdown_connections 2024-09-19T09:11:15.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.652+0000 7fea26b33640 1 -- 172.21.15.92:0/1158655386 wait complete. 2024-09-19T09:11:15.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.653+0000 7fea26b33640 1 Processor -- start 2024-09-19T09:11:15.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.653+0000 7fea26b33640 1 -- start start 2024-09-19T09:11:15.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.653+0000 7fea26b33640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea20101de0 0x7fea200744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:15.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.653+0000 7fea26b33640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea20102790 0x7fea20074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:15.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.653+0000 7fea26b33640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea20106f10 0x7fea20074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:15.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.653+0000 7fea26b33640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fea20111f70 con 0x7fea20102790 2024-09-19T09:11:15.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.653+0000 7fea26b33640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fea20111df0 con 0x7fea20106f10 2024-09-19T09:11:15.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.653+0000 7fea26b33640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fea201120f0 con 0x7fea20101de0 2024-09-19T09:11:15.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.653+0000 7fea1ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea20102790 0x7fea20074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:15.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.653+0000 7fea1ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea20102790 0x7fea20074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39902/0 (socket says 172.21.15.92:39902) 2024-09-19T09:11:15.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.653+0000 7fea1ffff640 1 -- 172.21.15.92:0/3592882052 learned_addr learned my addr 172.21.15.92:0/3592882052 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:15.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.653+0000 7fea250d0640 1 --2- 172.21.15.92:0/3592882052 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea20106f10 0x7fea20074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:15.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.653+0000 7fea248cf640 1 --2- 172.21.15.92:0/3592882052 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea20101de0 0x7fea200744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:15.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.654+0000 7fea1ffff640 1 -- 172.21.15.92:0/3592882052 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea20101de0 msgr2=0x7fea200744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:15.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.654+0000 7fea1ffff640 1 --2- 172.21.15.92:0/3592882052 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea20101de0 0x7fea200744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.654+0000 7fea1ffff640 1 -- 172.21.15.92:0/3592882052 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea20106f10 msgr2=0x7fea20074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:15.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.654+0000 7fea1ffff640 1 --2- 172.21.15.92:0/3592882052 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea20106f10 0x7fea20074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.654+0000 7fea1ffff640 1 -- 172.21.15.92:0/3592882052 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea201a6910 con 0x7fea20102790 2024-09-19T09:11:15.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.654+0000 7fea250d0640 1 --2- 172.21.15.92:0/3592882052 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea20106f10 0x7fea20074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:11:15.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.654+0000 7fea1ffff640 1 --2- 172.21.15.92:0/3592882052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea20102790 0x7fea20074a30 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fea0c006010 tx=0x7fea0c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:15.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.654+0000 7fea1dffb640 1 -- 172.21.15.92:0/3592882052 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0c03f030 con 0x7fea20102790 2024-09-19T09:11:15.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.654+0000 7fea26b33640 1 -- 172.21.15.92:0/3592882052 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea201a6ba0 con 0x7fea20102790 2024-09-19T09:11:15.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.654+0000 7fea1dffb640 1 -- 172.21.15.92:0/3592882052 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea0c003ce0 con 0x7fea20102790 2024-09-19T09:11:15.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.654+0000 7fea1dffb640 1 -- 172.21.15.92:0/3592882052 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0c035070 con 0x7fea20102790 2024-09-19T09:11:15.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.654+0000 7fea26b33640 1 -- 172.21.15.92:0/3592882052 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea201a70d0 con 0x7fea20102790 2024-09-19T09:11:15.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.656+0000 7fea1dffb640 1 -- 172.21.15.92:0/3592882052 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fea0c042030 con 0x7fea20102790 2024-09-19T09:11:15.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.657+0000 7fea28f0c740 1 Processor -- start 2024-09-19T09:11:15.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.657+0000 7fea28f0c740 1 -- start start 2024-09-19T09:11:15.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.657+0000 7fea1dffb640 1 --2- 172.21.15.92:0/3592882052 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fea100a3240 0x7fea100a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:15.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.657+0000 7fea28f0c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f08a112b60 0x55f08a112f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:15.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.657+0000 7fea28f0c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f08a113480 0x55f08a11d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:15.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.657+0000 7fea28f0c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f08a11dd40 0x55f08a120130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:15.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.657+0000 7fea28f0c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f08a078280 con 0x55f08a11dd40 2024-09-19T09:11:15.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.657+0000 7fea28f0c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f08a01fb10 con 0x55f08a113480 2024-09-19T09:11:15.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.657+0000 7fea28f0c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f08a074240 con 0x55f08a112b60 2024-09-19T09:11:15.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.657+0000 7fea250d0640 1 --2- 172.21.15.92:0/3592882052 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fea100a3240 0x7fea100a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:15.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.657+0000 7fea1dffb640 1 -- 172.21.15.92:0/3592882052 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fea0c0eff10 con 0x7fea20102790 2024-09-19T09:11:15.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.657+0000 7fea250d0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f08a11dd40 0x55f08a120130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:15.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.657+0000 7fea250d0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f08a11dd40 0x55f08a120130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39912/0 (socket says 172.21.15.92:39912) 2024-09-19T09:11:15.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.657+0000 7fea250d0640 1 -- 172.21.15.92:0/673342412 learned_addr learned my addr 172.21.15.92:0/673342412 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:15.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.657+0000 7fea248cf640 1 --2- 172.21.15.92:0/673342412 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f08a112b60 0x55f08a112f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:15.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.657+0000 7fea1ffff640 1 --2- 172.21.15.92:0/673342412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f08a113480 0x55f08a11d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:15.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.658+0000 7fea250d0640 1 -- 172.21.15.92:0/673342412 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f08a112b60 msgr2=0x55f08a112f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:15.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.658+0000 7fea250d0640 1 --2- 172.21.15.92:0/673342412 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f08a112b60 0x55f08a112f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.658+0000 7fea250d0640 1 -- 172.21.15.92:0/673342412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f08a113480 msgr2=0x55f08a11d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:15.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.658+0000 7fea250d0640 1 --2- 172.21.15.92:0/673342412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f08a113480 0x55f08a11d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.658+0000 7fea250d0640 1 -- 172.21.15.92:0/673342412 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f08a02c1f0 con 0x55f08a11dd40 2024-09-19T09:11:15.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.658+0000 7fea250d0640 1 --2- 172.21.15.92:0/3592882052 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fea100a3240 0x7fea100a5700 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fea18012be0 tx=0x7fea18009db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:15.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.658+0000 7fea250d0640 1 --2- 172.21.15.92:0/673342412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f08a11dd40 0x55f08a120130 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fea18005b30 tx=0x7fea1801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f388cfbae7dc88ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:15.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.658+0000 7fea0affd640 1 -- 172.21.15.92:0/673342412 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1800c7a0 con 0x55f08a11dd40 2024-09-19T09:11:15.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.658+0000 7fea0affd640 1 -- 172.21.15.92:0/673342412 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea18025070 con 0x55f08a11dd40 2024-09-19T09:11:15.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.658+0000 7fea0affd640 1 -- 172.21.15.92:0/673342412 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea18020cb0 con 0x55f08a11dd40 2024-09-19T09:11:15.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.659+0000 7fea28f0c740 1 -- 172.21.15.92:0/673342412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f08a11dd40 msgr2=0x55f08a120130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:15.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.659+0000 7fea28f0c740 1 --2- 172.21.15.92:0/673342412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f08a11dd40 0x55f08a120130 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fea18005b30 tx=0x7fea1801c000 comp rx=0 tx=0).stop 2024-09-19T09:11:15.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.659+0000 7fea28f0c740 1 -- 172.21.15.92:0/673342412 shutdown_connections 2024-09-19T09:11:15.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.659+0000 7fea28f0c740 1 --2- 172.21.15.92:0/673342412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f08a11dd40 0x55f08a120130 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.659+0000 7fea28f0c740 1 --2- 172.21.15.92:0/673342412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f08a113480 0x55f08a11d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.659+0000 7fea28f0c740 1 --2- 172.21.15.92:0/673342412 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f08a112b60 0x55f08a112f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.659+0000 7fea28f0c740 1 -- 172.21.15.92:0/673342412 >> 172.21.15.92:0/673342412 conn(0x55f08a10f0f0 msgr2=0x55f08a10f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:15.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.659+0000 7fea28f0c740 1 -- 172.21.15.92:0/673342412 shutdown_connections 2024-09-19T09:11:15.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.659+0000 7fea28f0c740 1 -- 172.21.15.92:0/673342412 wait complete. 2024-09-19T09:11:15.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.659+0000 7fea28f0c740 1 -- start start 2024-09-19T09:11:15.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.659+0000 7fea28f0c740 1 Processor -- start 2024-09-19T09:11:15.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.660+0000 7fea28f0c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f08a112b60 0x55f08a11aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:15.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.660+0000 7fea28f0c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f08a113480 0x55f08a11b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:15.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.660+0000 7fea28f0c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f08a11dd40 0x55f08a11b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:15.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.660+0000 7fea28f0c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f08a120910 con 0x55f08a112b60 2024-09-19T09:11:15.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.660+0000 7fea28f0c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f08a032f10 con 0x55f08a113480 2024-09-19T09:11:15.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.660+0000 7fea28f0c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f08a120a90 con 0x55f08a11dd40 2024-09-19T09:11:15.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.660+0000 7fea28f0c740 10 client.0 _ll_register_callbacks cb 0x55f089ffba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:11:15.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.660+0000 7fea248cf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f08a112b60 0x55f08a11aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:15.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.660+0000 7fea248cf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f08a112b60 0x55f08a11aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39918/0 (socket says 172.21.15.92:39918) 2024-09-19T09:11:15.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.660+0000 7fea248cf640 1 -- 172.21.15.92:0/3507289354 learned_addr learned my addr 172.21.15.92:0/3507289354 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:15.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.660+0000 7fea1ffff640 1 --2- 172.21.15.92:0/3507289354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f08a113480 0x55f08a11b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:15.668 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.660+0000 7fea250d0640 1 --2- 172.21.15.92:0/3507289354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f08a11dd40 0x55f08a11b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:15.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.660+0000 7fea248cf640 1 -- 172.21.15.92:0/3507289354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f08a11dd40 msgr2=0x55f08a11b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:15.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.660+0000 7fea248cf640 1 --2- 172.21.15.92:0/3507289354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f08a11dd40 0x55f08a11b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.660+0000 7fea248cf640 1 -- 172.21.15.92:0/3507289354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f08a113480 msgr2=0x55f08a11b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:15.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.660+0000 7fea248cf640 1 --2- 172.21.15.92:0/3507289354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f08a113480 0x55f08a11b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.660+0000 7fea248cf640 1 -- 172.21.15.92:0/3507289354 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f089de96a0 con 0x55f08a112b60 2024-09-19T09:11:15.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.660+0000 7fea248cf640 1 --2- 172.21.15.92:0/3507289354 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f08a112b60 0x55f08a11aba0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fea1400bf60 tx=0x7fea1400bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7f453869361b871 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:15.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.660+0000 7fe9fffff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:11:15.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.660+0000 7fe9fffff640 1 -- 172.21.15.92:0/3507289354 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1401f060 con 0x55f08a112b60 2024-09-19T09:11:15.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.661+0000 7fe9fffff640 1 -- 172.21.15.92:0/3507289354 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fea140107e0 con 0x55f08a112b60 2024-09-19T09:11:15.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.661+0000 7fea28f0c740 1 -- 172.21.15.92:0/3507289354 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea18025070 con 0x55f08a112b60 2024-09-19T09:11:15.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.661+0000 7fe9fffff640 1 -- 172.21.15.92:0/3507289354 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fea140109e0 con 0x55f08a112b60 2024-09-19T09:11:15.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.661+0000 7fea28f0c740 10 client.18834 fetch_fsmap learned FSMap version 19 2024-09-19T09:11:15.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.661+0000 7fea28f0c740 1 -- 172.21.15.92:0/3507289354 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f08a12c580 con 0x55f08a112b60 2024-09-19T09:11:15.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.661+0000 7fe9fffff640 1 -- 172.21.15.92:0/3507289354 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea18025070 con 0x55f08a112b60 2024-09-19T09:11:15.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.661+0000 7fe9fffff640 1 -- 172.21.15.92:0/3507289354 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fea14024070 con 0x55f08a112b60 2024-09-19T09:11:15.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.661+0000 7fea28f0c740 10 client.18834 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:11:15.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.661+0000 7fea28f0c740 10 client.18834 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:11:15.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.661+0000 7fea28f0c740 20 client.18834 populate_metadata read hostname 'smithi092' 2024-09-19T09:11:15.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.661+0000 7fea28f0c740 1 --2- 172.21.15.92:0/3507289354 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f08a12da40 0x55f08a12fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:15.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.661+0000 7fea28f0c740 4 client.18834 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:11:15.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.661+0000 7fea28f0c740 1 -- 172.21.15.92:0/3507289354 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f08a0857f0 con 0x55f08a12da40 2024-09-19T09:11:15.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.662+0000 7fea1ffff640 1 --2- 172.21.15.92:0/3507289354 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f08a12da40 0x55f08a12fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:15.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.662+0000 7fea1ffff640 1 --2- 172.21.15.92:0/3507289354 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f08a12da40 0x55f08a12fe90 crc :-1 s=READY pgs=436 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=515f64cd5629a5f8 server_cookie=13aa2c5543e0e70a in_seq=0 out_seq=0 2024-09-19T09:11:15.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.662+0000 7fe9fffff640 10 client.18834 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:15.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.663+0000 7fe9fffff640 1 -- 172.21.15.92:0/3507289354 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f08a0857f0 con 0x55f08a12da40 2024-09-19T09:11:15.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.663+0000 7fe9fffff640 10 client.18834 handle_command_reply: tid=0 2024-09-19T09:11:15.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.663+0000 7fea28f0c740 1 client.18834 shutdown 2024-09-19T09:11:15.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.663+0000 7fea28f0c740 1 -- 172.21.15.92:0/3507289354 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f08a112b60 msgr2=0x55f08a11aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:15.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.663+0000 7fea28f0c740 1 --2- 172.21.15.92:0/3507289354 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f08a112b60 0x55f08a11aba0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fea1400bf60 tx=0x7fea1400bf90 comp rx=0 tx=0).stop 2024-09-19T09:11:15.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.663+0000 7fea28f0c740 1 -- 172.21.15.92:0/3507289354 shutdown_connections 2024-09-19T09:11:15.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.663+0000 7fea28f0c740 1 --2- 172.21.15.92:0/3507289354 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f08a12da40 0x55f08a12fe90 crc :-1 s=READY pgs=436 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.663+0000 7fea28f0c740 1 --2- 172.21.15.92:0/3507289354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f08a11dd40 0x55f08a11b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.663+0000 7fea28f0c740 1 --2- 172.21.15.92:0/3507289354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f08a113480 0x55f08a11b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.663+0000 7fea28f0c740 1 --2- 172.21.15.92:0/3507289354 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f08a112b60 0x55f08a11aba0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.663+0000 7fe9fffff640 0 client.18834 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:15.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.663+0000 7fea28f0c740 1 -- 172.21.15.92:0/3507289354 >> 172.21.15.92:0/3507289354 conn(0x55f08a10f0f0 msgr2=0x55f08a114e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:15.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.663+0000 7fea28f0c740 1 -- 172.21.15.92:0/3507289354 shutdown_connections 2024-09-19T09:11:15.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.663+0000 7fea28f0c740 1 -- 172.21.15.92:0/3507289354 wait complete. 2024-09-19T09:11:15.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.663+0000 7fea28f0c740 20 client.18834 trim_cache size 0 max 16384 2024-09-19T09:11:15.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.680+0000 7fea28f0c740 1 Processor -- start 2024-09-19T09:11:15.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.680+0000 7fea28f0c740 1 -- start start 2024-09-19T09:11:15.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.680+0000 7fea28f0c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f08a112b60 0x55f08a119a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:15.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.680+0000 7fea28f0c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f08a113480 0x55f08a135760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:15.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.680+0000 7fea28f0c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f08a11dd40 0x55f08a135ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:15.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.680+0000 7fea28f0c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fea201ad710 con 0x55f08a113480 2024-09-19T09:11:15.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.680+0000 7fea28f0c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fea201affb0 con 0x55f08a11dd40 2024-09-19T09:11:15.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.680+0000 7fea28f0c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fea201adda0 con 0x55f08a112b60 2024-09-19T09:11:15.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.680+0000 7fea1ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f08a113480 0x55f08a135760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:15.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.680+0000 7fea1ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f08a113480 0x55f08a135760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39932/0 (socket says 172.21.15.92:39932) 2024-09-19T09:11:15.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.680+0000 7fea1ffff640 1 -- 172.21.15.92:0/725760711 learned_addr learned my addr 172.21.15.92:0/725760711 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:15.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.680+0000 7fea248cf640 1 --2- 172.21.15.92:0/725760711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f08a112b60 0x55f08a119a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:15.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.680+0000 7fea1ffff640 1 -- 172.21.15.92:0/725760711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f08a112b60 msgr2=0x55f08a119a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:15.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.680+0000 7fea1ffff640 1 --2- 172.21.15.92:0/725760711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f08a112b60 0x55f08a119a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.680+0000 7fea250d0640 1 --2- 172.21.15.92:0/725760711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f08a11dd40 0x55f08a135ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:15.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.680+0000 7fea1ffff640 1 -- 172.21.15.92:0/725760711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f08a11dd40 msgr2=0x55f08a135ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:15.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.680+0000 7fea1ffff640 1 --2- 172.21.15.92:0/725760711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f08a11dd40 0x55f08a135ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.680+0000 7fea1ffff640 1 -- 172.21.15.92:0/725760711 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f08a1132b0 con 0x55f08a113480 2024-09-19T09:11:15.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.681+0000 7fea1ffff640 1 --2- 172.21.15.92:0/725760711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f08a113480 0x55f08a135760 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fea0c005c40 tx=0x7fea0c0ed8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f10c841a153b46e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:15.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.681+0000 7fea0a7fc640 1 -- 172.21.15.92:0/725760711 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0c049040 con 0x55f08a113480 2024-09-19T09:11:15.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.681+0000 7fea0a7fc640 1 -- 172.21.15.92:0/725760711 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea0c03b580 con 0x55f08a113480 2024-09-19T09:11:15.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.681+0000 7fea0a7fc640 1 -- 172.21.15.92:0/725760711 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0c0c0960 con 0x55f08a113480 2024-09-19T09:11:15.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.681+0000 7fea28f0c740 1 -- 172.21.15.92:0/725760711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f08a113480 msgr2=0x55f08a135760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:15.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.681+0000 7fea28f0c740 1 --2- 172.21.15.92:0/725760711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f08a113480 0x55f08a135760 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fea0c005c40 tx=0x7fea0c0ed8a0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.681+0000 7fea28f0c740 1 -- 172.21.15.92:0/725760711 shutdown_connections 2024-09-19T09:11:15.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.681+0000 7fea28f0c740 1 --2- 172.21.15.92:0/725760711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f08a11dd40 0x55f08a135ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.681+0000 7fea28f0c740 1 --2- 172.21.15.92:0/725760711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f08a113480 0x55f08a135760 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.681+0000 7fea28f0c740 1 --2- 172.21.15.92:0/725760711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f08a112b60 0x55f08a119a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.681+0000 7fea28f0c740 1 -- 172.21.15.92:0/725760711 >> 172.21.15.92:0/725760711 conn(0x55f08a10f0f0 msgr2=0x55f08a119340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:15.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.681+0000 7fea28f0c740 1 -- 172.21.15.92:0/725760711 shutdown_connections 2024-09-19T09:11:15.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.681+0000 7fea28f0c740 1 -- 172.21.15.92:0/725760711 wait complete. 2024-09-19T09:11:15.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.682+0000 7fea28f0c740 1 -- start start 2024-09-19T09:11:15.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.682+0000 7fea28f0c740 1 Processor -- start 2024-09-19T09:11:15.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.682+0000 7fea28f0c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f08a112b60 0x55f08a121aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:15.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.682+0000 7fea28f0c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f08a113480 0x55f08a121fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:15.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.682+0000 7fea28f0c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f08a11dd40 0x55f08a122520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:15.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.682+0000 7fea28f0c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fea201ae470 con 0x55f08a112b60 2024-09-19T09:11:15.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.682+0000 7fea28f0c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fea201af8e0 con 0x55f08a113480 2024-09-19T09:11:15.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.682+0000 7fea28f0c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fea201aeb40 con 0x55f08a11dd40 2024-09-19T09:11:15.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.682+0000 7fea28f0c740 10 client.0 _ll_register_callbacks cb 0x7fea1400b790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:11:15.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.682+0000 7fea248cf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f08a112b60 0x55f08a121aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:15.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.682+0000 7fea248cf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f08a112b60 0x55f08a121aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39938/0 (socket says 172.21.15.92:39938) 2024-09-19T09:11:15.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.682+0000 7fea248cf640 1 -- 172.21.15.92:0/1209077126 learned_addr learned my addr 172.21.15.92:0/1209077126 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:15.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.683+0000 7fea248cf640 1 -- 172.21.15.92:0/1209077126 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f08a11dd40 msgr2=0x55f08a122520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:15.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.683+0000 7fea248cf640 1 --2- 172.21.15.92:0/1209077126 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f08a11dd40 0x55f08a122520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.683+0000 7fea248cf640 1 -- 172.21.15.92:0/1209077126 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f08a113480 msgr2=0x55f08a121fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:15.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.683+0000 7fea1ffff640 1 --2- 172.21.15.92:0/1209077126 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f08a113480 0x55f08a121fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:15.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.683+0000 7fea248cf640 1 --2- 172.21.15.92:0/1209077126 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f08a113480 0x55f08a121fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.683+0000 7fea248cf640 1 -- 172.21.15.92:0/1209077126 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f08a197730 con 0x55f08a112b60 2024-09-19T09:11:15.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.683+0000 7fea248cf640 1 --2- 172.21.15.92:0/1209077126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f08a112b60 0x55f08a121aa0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fea14025480 tx=0x7fea1400bc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be185b8be9e5eaa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:15.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.683+0000 7fe9fffff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:11:15.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.683+0000 7fe9fffff640 1 -- 172.21.15.92:0/1209077126 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1402a070 con 0x55f08a112b60 2024-09-19T09:11:15.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.683+0000 7fe9fffff640 1 -- 172.21.15.92:0/1209077126 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fea14005040 con 0x55f08a112b60 2024-09-19T09:11:15.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.683+0000 7fea28f0c740 1 -- 172.21.15.92:0/1209077126 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f08a07fd00 con 0x55f08a112b60 2024-09-19T09:11:15.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.683+0000 7fe9fffff640 1 -- 172.21.15.92:0/1209077126 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fea1401f020 con 0x55f08a112b60 2024-09-19T09:11:15.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.683+0000 7fea28f0c740 10 client.18840 fetch_fsmap learned FSMap version 19 2024-09-19T09:11:15.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.683+0000 7fea28f0c740 1 -- 172.21.15.92:0/1209077126 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f08a198a90 con 0x55f08a112b60 2024-09-19T09:11:15.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.683+0000 7fe9fffff640 1 -- 172.21.15.92:0/1209077126 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55f08a07fd00 con 0x55f08a112b60 2024-09-19T09:11:15.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.683+0000 7fe9fffff640 1 -- 172.21.15.92:0/1209077126 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fea14024070 con 0x55f08a112b60 2024-09-19T09:11:15.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.683+0000 7fea28f0c740 10 client.18840 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:11:15.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.683+0000 7fea28f0c740 10 client.18840 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:11:15.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.683+0000 7fea28f0c740 20 client.18840 populate_metadata read hostname 'smithi092' 2024-09-19T09:11:15.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.683+0000 7fea28f0c740 1 --2- 172.21.15.92:0/1209077126 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f08a199210 0x55f08a19b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:15.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.683+0000 7fea28f0c740 4 client.18840 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:11:15.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.683+0000 7fea28f0c740 1 -- 172.21.15.92:0/1209077126 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f089ffc110 con 0x55f08a199210 2024-09-19T09:11:15.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.684+0000 7fea1ffff640 1 --2- 172.21.15.92:0/1209077126 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f08a199210 0x55f08a19b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:15.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.684+0000 7fea1ffff640 1 --2- 172.21.15.92:0/1209077126 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f08a199210 0x55f08a19b670 crc :-1 s=READY pgs=437 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3508f1316802c682 server_cookie=15f35ff9e279d6a in_seq=0 out_seq=0 2024-09-19T09:11:15.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.684+0000 7fe9fffff640 10 client.18840 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:15.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.685+0000 7fe9fffff640 1 -- 172.21.15.92:0/1209077126 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f089ffc110 con 0x55f08a199210 2024-09-19T09:11:15.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.685+0000 7fe9fffff640 10 client.18840 handle_command_reply: tid=0 2024-09-19T09:11:15.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.685+0000 7fea28f0c740 1 client.18840 shutdown 2024-09-19T09:11:15.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.685+0000 7fea28f0c740 1 -- 172.21.15.92:0/1209077126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f08a112b60 msgr2=0x55f08a121aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:15.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.685+0000 7fea28f0c740 1 --2- 172.21.15.92:0/1209077126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f08a112b60 0x55f08a121aa0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fea14025480 tx=0x7fea1400bc40 comp rx=0 tx=0).stop 2024-09-19T09:11:15.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.685+0000 7fea28f0c740 1 -- 172.21.15.92:0/1209077126 shutdown_connections 2024-09-19T09:11:15.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.685+0000 7fea28f0c740 1 --2- 172.21.15.92:0/1209077126 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55f08a199210 0x55f08a19b670 crc :-1 s=READY pgs=437 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.685+0000 7fea28f0c740 1 --2- 172.21.15.92:0/1209077126 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f08a11dd40 0x55f08a122520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.685+0000 7fea28f0c740 1 --2- 172.21.15.92:0/1209077126 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f08a113480 0x55f08a121fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.685+0000 7fea28f0c740 1 --2- 172.21.15.92:0/1209077126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f08a112b60 0x55f08a121aa0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.685+0000 7fea28f0c740 1 -- 172.21.15.92:0/1209077126 >> 172.21.15.92:0/1209077126 conn(0x55f08a10f0f0 msgr2=0x55f08a11b360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:15.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.685+0000 7fe9fffff640 0 client.18840 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:15.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.686+0000 7fea28f0c740 1 -- 172.21.15.92:0/1209077126 shutdown_connections 2024-09-19T09:11:15.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.686+0000 7fea28f0c740 1 -- 172.21.15.92:0/1209077126 wait complete. 2024-09-19T09:11:15.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.686+0000 7fea28f0c740 20 client.18840 trim_cache size 0 max 16384 2024-09-19T09:11:15.693 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:11:15.694 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-19T09:11:15.694 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "d5627989-5547-4217-b734-293cc87cf565", 2024-09-19T09:11:15.694 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-19T09:11:15.694 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:11:15.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.686+0000 7fea26b33640 1 -- 172.21.15.92:0/3592882052 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fea100a3240 msgr2=0x7fea100a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:15.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.686+0000 7fea26b33640 1 --2- 172.21.15.92:0/3592882052 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fea100a3240 0x7fea100a5700 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fea18012be0 tx=0x7fea18009db0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.686+0000 7fea26b33640 1 -- 172.21.15.92:0/3592882052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea20102790 msgr2=0x7fea20074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:15.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.686+0000 7fea26b33640 1 --2- 172.21.15.92:0/3592882052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea20102790 0x7fea20074a30 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fea0c006010 tx=0x7fea0c0042f0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.686+0000 7fea26b33640 1 -- 172.21.15.92:0/3592882052 shutdown_connections 2024-09-19T09:11:15.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.686+0000 7fea26b33640 1 --2- 172.21.15.92:0/3592882052 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea20106f10 0x7fea20074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.686+0000 7fea26b33640 1 --2- 172.21.15.92:0/3592882052 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fea100a3240 0x7fea100a5700 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.686+0000 7fea26b33640 1 --2- 172.21.15.92:0/3592882052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea20102790 0x7fea20074a30 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.686+0000 7fea26b33640 1 --2- 172.21.15.92:0/3592882052 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea20101de0 0x7fea200744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.686+0000 7fea26b33640 1 -- 172.21.15.92:0/3592882052 >> 172.21.15.92:0/3592882052 conn(0x7fea200fd8c0 msgr2=0x7fea200febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:15.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.686+0000 7fea26b33640 1 -- 172.21.15.92:0/3592882052 shutdown_connections 2024-09-19T09:11:15.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:15.686+0000 7fea26b33640 1 -- 172.21.15.92:0/3592882052 wait complete. 2024-09-19T09:11:15.801 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:11:15.981 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.979+0000 7fdf5c242640 1 -- 172.21.15.92:0/1069507371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf54102d10 msgr2=0x7fdf54105180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:15.981 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.979+0000 7fdf5c242640 1 --2- 172.21.15.92:0/1069507371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf54102d10 0x7fdf54105180 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fdf44009900 tx=0x7fdf4402a410 comp rx=0 tx=0).stop 2024-09-19T09:11:15.981 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.979+0000 7fdf5c242640 1 -- 172.21.15.92:0/1069507371 shutdown_connections 2024-09-19T09:11:15.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.979+0000 7fdf5c242640 1 --2- 172.21.15.92:0/1069507371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf541056c0 0x7fdf54105b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.979+0000 7fdf5c242640 1 --2- 172.21.15.92:0/1069507371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf54102d10 0x7fdf54105180 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.979+0000 7fdf5c242640 1 --2- 172.21.15.92:0/1069507371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf541003c0 0x7fdf541027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.979+0000 7fdf5c242640 1 -- 172.21.15.92:0/1069507371 >> 172.21.15.92:0/1069507371 conn(0x7fdf540fc1b0 msgr2=0x7fdf540fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:15.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.979+0000 7fdf5c242640 1 -- 172.21.15.92:0/1069507371 shutdown_connections 2024-09-19T09:11:15.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.979+0000 7fdf5c242640 1 -- 172.21.15.92:0/1069507371 wait complete. 2024-09-19T09:11:15.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.979+0000 7fdf5c242640 1 Processor -- start 2024-09-19T09:11:15.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.979+0000 7fdf5c242640 1 -- start start 2024-09-19T09:11:15.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.979+0000 7fdf5c242640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf541003c0 0x7fdf5419e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:15.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.979+0000 7fdf5c242640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf54102d10 0x7fdf5419e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:15.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.979+0000 7fdf5c242640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf541056c0 0x7fdf541a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:15.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.979+0000 7fdf5c242640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdf54113dd0 con 0x7fdf541056c0 2024-09-19T09:11:15.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.979+0000 7fdf5c242640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdf54113c50 con 0x7fdf541003c0 2024-09-19T09:11:15.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.979+0000 7fdf5c242640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fdf54113f50 con 0x7fdf54102d10 2024-09-19T09:11:15.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.980+0000 7fdf5a7df640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf541056c0 0x7fdf541a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:15.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.980+0000 7fdf5a7df640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf541056c0 0x7fdf541a5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39968/0 (socket says 172.21.15.92:39968) 2024-09-19T09:11:15.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.980+0000 7fdf5a7df640 1 -- 172.21.15.92:0/307535322 learned_addr learned my addr 172.21.15.92:0/307535322 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:15.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.980+0000 7fdf59fde640 1 --2- 172.21.15.92:0/307535322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf541003c0 0x7fdf5419e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:15.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.980+0000 7fdf597dd640 1 --2- 172.21.15.92:0/307535322 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf54102d10 0x7fdf5419e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:15.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.980+0000 7fdf5a7df640 1 -- 172.21.15.92:0/307535322 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf54102d10 msgr2=0x7fdf5419e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:15.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.980+0000 7fdf5a7df640 1 --2- 172.21.15.92:0/307535322 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf54102d10 0x7fdf5419e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.980+0000 7fdf5a7df640 1 -- 172.21.15.92:0/307535322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf541003c0 msgr2=0x7fdf5419e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:15.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.980+0000 7fdf5a7df640 1 --2- 172.21.15.92:0/307535322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf541003c0 0x7fdf5419e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.980+0000 7fdf5a7df640 1 -- 172.21.15.92:0/307535322 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf541a6000 con 0x7fdf541056c0 2024-09-19T09:11:15.984 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.980+0000 7fdf5a7df640 1 --2- 172.21.15.92:0/307535322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf541056c0 0x7fdf541a5990 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c00eb10 tx=0x7fdf4c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:15.984 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.980+0000 7fdf4affd640 1 -- 172.21.15.92:0/307535322 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c004b20 con 0x7fdf541056c0 2024-09-19T09:11:15.984 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.980+0000 7fdf4affd640 1 -- 172.21.15.92:0/307535322 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf4c004cc0 con 0x7fdf541056c0 2024-09-19T09:11:15.984 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.980+0000 7fdf5c242640 1 -- 172.21.15.92:0/307535322 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf541a62f0 con 0x7fdf541056c0 2024-09-19T09:11:15.984 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.980+0000 7fdf4affd640 1 -- 172.21.15.92:0/307535322 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c010760 con 0x7fdf541056c0 2024-09-19T09:11:15.984 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.980+0000 7fdf5c242640 1 -- 172.21.15.92:0/307535322 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf541a67f0 con 0x7fdf541056c0 2024-09-19T09:11:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.983+0000 7fdf4affd640 1 -- 172.21.15.92:0/307535322 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fdf4c005020 con 0x7fdf541056c0 2024-09-19T09:11:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.983+0000 7fdf5efd3740 1 Processor -- start 2024-09-19T09:11:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.983+0000 7fdf5efd3740 1 -- start start 2024-09-19T09:11:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.983+0000 7fdf5efd3740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55837afe99a0 0x55837afe9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.983+0000 7fdf5efd3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55837afea2e0 0x55837afeeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.983+0000 7fdf5efd3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55837afef370 0x55837aff1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.983+0000 7fdf5efd3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55837af4d2f0 con 0x55837afea2e0 2024-09-19T09:11:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.983+0000 7fdf5efd3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55837aef5270 con 0x55837afef370 2024-09-19T09:11:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.983+0000 7fdf5efd3740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55837af492b0 con 0x55837afe99a0 2024-09-19T09:11:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.983+0000 7fdf59fde640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55837afea2e0 0x55837afeeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.983+0000 7fdf59fde640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55837afea2e0 0x55837afeeda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39978/0 (socket says 172.21.15.92:39978) 2024-09-19T09:11:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.983+0000 7fdf59fde640 1 -- 172.21.15.92:0/2007414997 learned_addr learned my addr 172.21.15.92:0/2007414997 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.983+0000 7fdf597dd640 1 --2- 172.21.15.92:0/2007414997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55837afef370 0x55837aff1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.983+0000 7fdf597dd640 1 --2- 172.21.15.92:0/2007414997 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55837afe99a0 0x55837afe9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.983+0000 7fdf59fde640 1 -- 172.21.15.92:0/2007414997 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55837afe99a0 msgr2=0x55837afe9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.983+0000 7fdf59fde640 1 --2- 172.21.15.92:0/2007414997 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55837afe99a0 0x55837afe9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.983+0000 7fdf59fde640 1 -- 172.21.15.92:0/2007414997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55837afef370 msgr2=0x55837aff1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.983+0000 7fdf59fde640 1 --2- 172.21.15.92:0/2007414997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55837afef370 0x55837aff1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.983+0000 7fdf59fde640 1 -- 172.21.15.92:0/2007414997 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55837aef4340 con 0x55837afea2e0 2024-09-19T09:11:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.984+0000 7fdf4affd640 1 --2- 172.21.15.92:0/307535322 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdf400a32f0 0x7fdf400a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.984+0000 7fdf59fde640 1 --2- 172.21.15.92:0/2007414997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55837afea2e0 0x55837afeeda0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fdf5000bd50 tx=0x7fdf500107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5085dbad461ca1d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.984+0000 7fdf597dd640 1 --2- 172.21.15.92:0/307535322 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdf400a32f0 0x7fdf400a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.984+0000 7fdf4affd640 1 -- 172.21.15.92:0/307535322 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fdf4c0cfeb0 con 0x7fdf541056c0 2024-09-19T09:11:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.984+0000 7fdf3ffff640 1 -- 172.21.15.92:0/2007414997 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf50005220 con 0x55837afea2e0 2024-09-19T09:11:15.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.984+0000 7fdf3ffff640 1 -- 172.21.15.92:0/2007414997 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf5000be40 con 0x55837afea2e0 2024-09-19T09:11:15.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.984+0000 7fdf3ffff640 1 -- 172.21.15.92:0/2007414997 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf50011800 con 0x55837afea2e0 2024-09-19T09:11:15.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.985+0000 7fdf5efd3740 1 -- 172.21.15.92:0/2007414997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55837afea2e0 msgr2=0x55837afeeda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:15.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.985+0000 7fdf597dd640 1 --2- 172.21.15.92:0/307535322 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdf400a32f0 0x7fdf400a57b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fdf44005ab0 tx=0x7fdf44031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:15.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.985+0000 7fdf5efd3740 1 --2- 172.21.15.92:0/2007414997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55837afea2e0 0x55837afeeda0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fdf5000bd50 tx=0x7fdf500107a0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.985+0000 7fdf5efd3740 1 -- 172.21.15.92:0/2007414997 shutdown_connections 2024-09-19T09:11:15.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.985+0000 7fdf5efd3740 1 --2- 172.21.15.92:0/2007414997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55837afef370 0x55837aff1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.985+0000 7fdf5efd3740 1 --2- 172.21.15.92:0/2007414997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55837afea2e0 0x55837afeeda0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.985+0000 7fdf5efd3740 1 --2- 172.21.15.92:0/2007414997 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55837afe99a0 0x55837afe9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.985+0000 7fdf5efd3740 1 -- 172.21.15.92:0/2007414997 >> 172.21.15.92:0/2007414997 conn(0x55837afe5010 msgr2=0x55837afe5410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:15.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.985+0000 7fdf5efd3740 1 -- 172.21.15.92:0/2007414997 shutdown_connections 2024-09-19T09:11:15.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.985+0000 7fdf5efd3740 1 -- 172.21.15.92:0/2007414997 wait complete. 2024-09-19T09:11:15.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.985+0000 7fdf5efd3740 1 -- start start 2024-09-19T09:11:15.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.985+0000 7fdf5efd3740 1 Processor -- start 2024-09-19T09:11:15.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.986+0000 7fdf5efd3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55837afe99a0 0x55837aff3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:15.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.986+0000 7fdf5efd3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55837afea2e0 0x55837aff4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:15.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.986+0000 7fdf5efd3740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55837afef370 0x55837affb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:15.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.986+0000 7fdf5efd3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55837aff2340 con 0x55837afe99a0 2024-09-19T09:11:15.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.986+0000 7fdf5efd3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55837aed6290 con 0x55837afea2e0 2024-09-19T09:11:15.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.986+0000 7fdf5efd3740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55837aff24c0 con 0x55837afef370 2024-09-19T09:11:15.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.986+0000 7fdf5efd3740 10 client.0 _ll_register_callbacks cb 0x55837af07140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:11:15.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.986+0000 7fdf59fde640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55837afe99a0 0x55837aff3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:15.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.986+0000 7fdf59fde640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55837afe99a0 0x55837aff3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39984/0 (socket says 172.21.15.92:39984) 2024-09-19T09:11:15.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.986+0000 7fdf59fde640 1 -- 172.21.15.92:0/925583394 learned_addr learned my addr 172.21.15.92:0/925583394 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:15.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.986+0000 7fdf597dd640 1 --2- 172.21.15.92:0/925583394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55837afea2e0 0x55837aff4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:15.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.986+0000 7fdf5a7df640 1 --2- 172.21.15.92:0/925583394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55837afef370 0x55837affb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:15.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.986+0000 7fdf59fde640 1 -- 172.21.15.92:0/925583394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55837afef370 msgr2=0x55837affb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:15.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.986+0000 7fdf59fde640 1 --2- 172.21.15.92:0/925583394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55837afef370 0x55837affb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.986+0000 7fdf59fde640 1 -- 172.21.15.92:0/925583394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55837afea2e0 msgr2=0x55837aff4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:15.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.986+0000 7fdf59fde640 1 --2- 172.21.15.92:0/925583394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55837afea2e0 0x55837aff4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.986+0000 7fdf59fde640 1 -- 172.21.15.92:0/925583394 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55837ac60210 con 0x55837afe99a0 2024-09-19T09:11:15.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.986+0000 7fdf5a7df640 1 --2- 172.21.15.92:0/925583394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55837afef370 0x55837affb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:11:15.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.986+0000 7fdf59fde640 1 --2- 172.21.15.92:0/925583394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55837afe99a0 0x55837aff3c00 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fdf50000c00 tx=0x7fdf5000baa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf65ac0bfa7144b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:15.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.986+0000 7fdf3d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:11:15.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.986+0000 7fdf3d7fa640 1 -- 172.21.15.92:0/925583394 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf50011b30 con 0x55837afe99a0 2024-09-19T09:11:15.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.986+0000 7fdf3d7fa640 1 -- 172.21.15.92:0/925583394 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fdf50011cd0 con 0x55837afe99a0 2024-09-19T09:11:15.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.986+0000 7fdf5efd3740 1 -- 172.21.15.92:0/925583394 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55837af5aa20 con 0x55837afe99a0 2024-09-19T09:11:15.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.986+0000 7fdf3d7fa640 1 -- 172.21.15.92:0/925583394 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fdf50004020 con 0x55837afe99a0 2024-09-19T09:11:15.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.986+0000 7fdf5efd3740 10 client.18852 fetch_fsmap learned FSMap version 19 2024-09-19T09:11:15.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.986+0000 7fdf5efd3740 1 -- 172.21.15.92:0/925583394 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55837ad2c620 con 0x55837afe99a0 2024-09-19T09:11:15.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.987+0000 7fdf3d7fa640 1 -- 172.21.15.92:0/925583394 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55837af5aa20 con 0x55837afe99a0 2024-09-19T09:11:15.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.987+0000 7fdf3d7fa640 1 -- 172.21.15.92:0/925583394 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fdf50026470 con 0x55837afe99a0 2024-09-19T09:11:15.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.987+0000 7fdf5efd3740 10 client.18852 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:11:15.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.987+0000 7fdf5efd3740 10 client.18852 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:11:15.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.987+0000 7fdf5efd3740 20 client.18852 populate_metadata read hostname 'smithi092' 2024-09-19T09:11:15.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.987+0000 7fdf5efd3740 1 --2- 172.21.15.92:0/925583394 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55837afff590 0x55837b001980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:15.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.987+0000 7fdf5efd3740 4 client.18852 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:11:15.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.987+0000 7fdf5efd3740 1 -- 172.21.15.92:0/925583394 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55837af54d70 con 0x55837afff590 2024-09-19T09:11:15.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.987+0000 7fdf597dd640 1 --2- 172.21.15.92:0/925583394 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55837afff590 0x55837b001980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:15.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.988+0000 7fdf3d7fa640 10 client.18852 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:15.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.988+0000 7fdf597dd640 1 --2- 172.21.15.92:0/925583394 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55837afff590 0x55837b001980 crc :-1 s=READY pgs=438 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53788513ccf11000 server_cookie=3d062677c9774895 in_seq=0 out_seq=0 2024-09-19T09:11:15.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.988+0000 7fdf3d7fa640 1 -- 172.21.15.92:0/925583394 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55837af54d70 con 0x55837afff590 2024-09-19T09:11:15.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.988+0000 7fdf3d7fa640 10 client.18852 handle_command_reply: tid=0 2024-09-19T09:11:15.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.988+0000 7fdf5efd3740 1 client.18852 shutdown 2024-09-19T09:11:15.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.988+0000 7fdf5efd3740 1 -- 172.21.15.92:0/925583394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55837afe99a0 msgr2=0x55837aff3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:15.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.988+0000 7fdf5efd3740 1 --2- 172.21.15.92:0/925583394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55837afe99a0 0x55837aff3c00 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fdf50000c00 tx=0x7fdf5000baa0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.988+0000 7fdf5efd3740 1 -- 172.21.15.92:0/925583394 shutdown_connections 2024-09-19T09:11:15.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.988+0000 7fdf5efd3740 1 --2- 172.21.15.92:0/925583394 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55837afff590 0x55837b001980 crc :-1 s=READY pgs=438 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.988+0000 7fdf5efd3740 1 --2- 172.21.15.92:0/925583394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55837afef370 0x55837affb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.988+0000 7fdf3d7fa640 0 client.18852 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:15.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.988+0000 7fdf5efd3740 1 --2- 172.21.15.92:0/925583394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55837afea2e0 0x55837aff4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.988+0000 7fdf5efd3740 1 --2- 172.21.15.92:0/925583394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55837afe99a0 0x55837aff3c00 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:15.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.988+0000 7fdf5efd3740 1 -- 172.21.15.92:0/925583394 >> 172.21.15.92:0/925583394 conn(0x55837afe5010 msgr2=0x55837afe6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:15.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.988+0000 7fdf5efd3740 1 -- 172.21.15.92:0/925583394 shutdown_connections 2024-09-19T09:11:15.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.989+0000 7fdf5efd3740 1 -- 172.21.15.92:0/925583394 wait complete. 2024-09-19T09:11:15.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:15.989+0000 7fdf5efd3740 20 client.18852 trim_cache size 0 max 16384 2024-09-19T09:11:16.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.003+0000 7fdf5efd3740 1 Processor -- start 2024-09-19T09:11:16.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.003+0000 7fdf5efd3740 1 -- start start 2024-09-19T09:11:16.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.003+0000 7fdf5efd3740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55837afe99a0 0x55837afe40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:16.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.003+0000 7fdf5efd3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55837afea2e0 0x55837affb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:16.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.003+0000 7fdf5efd3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55837afef370 0x55837afe6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:16.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.003+0000 7fdf5efd3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdf541ad670 con 0x55837afef370 2024-09-19T09:11:16.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.003+0000 7fdf5efd3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdf541aff10 con 0x55837afea2e0 2024-09-19T09:11:16.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.003+0000 7fdf5efd3740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fdf541add00 con 0x55837afe99a0 2024-09-19T09:11:16.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.003+0000 7fdf5a7df640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55837afef370 0x55837afe6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:16.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.003+0000 7fdf5a7df640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55837afef370 0x55837afe6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39988/0 (socket says 172.21.15.92:39988) 2024-09-19T09:11:16.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.003+0000 7fdf597dd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55837afea2e0 0x55837affb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:16.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.003+0000 7fdf5a7df640 1 -- 172.21.15.92:0/2379649076 learned_addr learned my addr 172.21.15.92:0/2379649076 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:16.005 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:15 smithi092 ceph-mon[31407]: scrub queued for path: / 2024-09-19T09:11:16.005 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:15 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:11:16.005 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:15 smithi092 ceph-mon[31407]: scrub summary: active paths [/] 2024-09-19T09:11:16.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.003+0000 7fdf59fde640 1 --2- 172.21.15.92:0/2379649076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55837afe99a0 0x55837afe40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:16.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.003+0000 7fdf5a7df640 1 -- 172.21.15.92:0/2379649076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55837afe99a0 msgr2=0x55837afe40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:16.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.003+0000 7fdf5a7df640 1 --2- 172.21.15.92:0/2379649076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55837afe99a0 0x55837afe40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:16.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.003+0000 7fdf5a7df640 1 -- 172.21.15.92:0/2379649076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55837afea2e0 msgr2=0x55837affb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.003+0000 7fdf5a7df640 1 --2- 172.21.15.92:0/2379649076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55837afea2e0 0x55837affb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.003+0000 7fdf5a7df640 1 -- 172.21.15.92:0/2379649076 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55837b001cf0 con 0x55837afef370 2024-09-19T09:11:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.003+0000 7fdf5a7df640 1 --2- 172.21.15.92:0/2379649076 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55837afef370 0x55837afe6400 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c0049d0 tx=0x7fdf4c0058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70120a9920a5166d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.003+0000 7fdf3f7fe640 1 -- 172.21.15.92:0/2379649076 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c0b4020 con 0x55837afef370 2024-09-19T09:11:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.004+0000 7fdf3f7fe640 1 -- 172.21.15.92:0/2379649076 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf4c09cbd0 con 0x55837afef370 2024-09-19T09:11:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.004+0000 7fdf3f7fe640 1 -- 172.21.15.92:0/2379649076 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c0a4cb0 con 0x55837afef370 2024-09-19T09:11:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.004+0000 7fdf5efd3740 1 -- 172.21.15.92:0/2379649076 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55837afef370 msgr2=0x55837afe6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.004+0000 7fdf5efd3740 1 --2- 172.21.15.92:0/2379649076 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55837afef370 0x55837afe6400 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c0049d0 tx=0x7fdf4c0058d0 comp rx=0 tx=0).stop 2024-09-19T09:11:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.004+0000 7fdf5efd3740 1 -- 172.21.15.92:0/2379649076 shutdown_connections 2024-09-19T09:11:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.004+0000 7fdf5efd3740 1 --2- 172.21.15.92:0/2379649076 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55837afef370 0x55837afe6400 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.004+0000 7fdf5efd3740 1 --2- 172.21.15.92:0/2379649076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55837afea2e0 0x55837affb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.004+0000 7fdf5efd3740 1 --2- 172.21.15.92:0/2379649076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55837afe99a0 0x55837afe40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:16.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.004+0000 7fdf5efd3740 1 -- 172.21.15.92:0/2379649076 >> 172.21.15.92:0/2379649076 conn(0x55837afe5010 msgr2=0x55837afe39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:16.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.004+0000 7fdf5efd3740 1 -- 172.21.15.92:0/2379649076 shutdown_connections 2024-09-19T09:11:16.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.004+0000 7fdf5efd3740 1 -- 172.21.15.92:0/2379649076 wait complete. 2024-09-19T09:11:16.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.005+0000 7fdf5efd3740 1 -- start start 2024-09-19T09:11:16.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.005+0000 7fdf5efd3740 1 Processor -- start 2024-09-19T09:11:16.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.005+0000 7fdf5efd3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55837afe99a0 0x55837aff8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:16.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.005+0000 7fdf5efd3740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55837afea2e0 0x55837aff8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:16.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.005+0000 7fdf5efd3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55837afef370 0x55837aff9980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:16.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.005+0000 7fdf5efd3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdf541ae3d0 con 0x55837afef370 2024-09-19T09:11:16.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.005+0000 7fdf5efd3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdf541af840 con 0x55837afe99a0 2024-09-19T09:11:16.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.005+0000 7fdf5efd3740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fdf541aeaa0 con 0x55837afea2e0 2024-09-19T09:11:16.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.005+0000 7fdf5efd3740 10 client.0 _ll_register_callbacks cb 0x7fdf4c0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:11:16.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.005+0000 7fdf5a7df640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55837afef370 0x55837aff9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:16.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.005+0000 7fdf5a7df640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55837afef370 0x55837aff9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39998/0 (socket says 172.21.15.92:39998) 2024-09-19T09:11:16.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.005+0000 7fdf5a7df640 1 -- 172.21.15.92:0/1106549246 learned_addr learned my addr 172.21.15.92:0/1106549246 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:16.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.005+0000 7fdf59fde640 1 --2- 172.21.15.92:0/1106549246 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55837afe99a0 0x55837aff8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:16.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.006+0000 7fdf597dd640 1 --2- 172.21.15.92:0/1106549246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55837afea2e0 0x55837aff8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:16.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.006+0000 7fdf5a7df640 1 -- 172.21.15.92:0/1106549246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55837afea2e0 msgr2=0x55837aff8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:16.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.006+0000 7fdf5a7df640 1 --2- 172.21.15.92:0/1106549246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55837afea2e0 0x55837aff8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:16.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.006+0000 7fdf5a7df640 1 -- 172.21.15.92:0/1106549246 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55837afe99a0 msgr2=0x55837aff8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:16.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.006+0000 7fdf5a7df640 1 --2- 172.21.15.92:0/1106549246 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55837afe99a0 0x55837aff8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:16.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.006+0000 7fdf5a7df640 1 -- 172.21.15.92:0/1106549246 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55837aff9f90 con 0x55837afef370 2024-09-19T09:11:16.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.006+0000 7fdf5a7df640 1 --2- 172.21.15.92:0/1106549246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55837afef370 0x55837aff9980 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c098ea0 tx=0x7fdf4c009a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da7425ea14fd2435 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:16.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.006+0000 7fdf3d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:11:16.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.006+0000 7fdf3d7fa640 1 -- 172.21.15.92:0/1106549246 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c0b4070 con 0x55837afef370 2024-09-19T09:11:16.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.006+0000 7fdf3d7fa640 1 -- 172.21.15.92:0/1106549246 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fdf4c0672a0 con 0x55837afef370 2024-09-19T09:11:16.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.006+0000 7fdf5efd3740 1 -- 172.21.15.92:0/1106549246 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf4c09cbd0 con 0x55837afef370 2024-09-19T09:11:16.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.006+0000 7fdf3d7fa640 1 -- 172.21.15.92:0/1106549246 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fdf4c0a0880 con 0x55837afef370 2024-09-19T09:11:16.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.006+0000 7fdf5efd3740 10 client.18858 fetch_fsmap learned FSMap version 19 2024-09-19T09:11:16.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.006+0000 7fdf5efd3740 1 -- 172.21.15.92:0/1106549246 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55837affb2a0 con 0x55837afef370 2024-09-19T09:11:16.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.006+0000 7fdf3d7fa640 1 -- 172.21.15.92:0/1106549246 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf4c09cbd0 con 0x55837afef370 2024-09-19T09:11:16.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.006+0000 7fdf3d7fa640 1 -- 172.21.15.92:0/1106549246 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fdf4c09b920 con 0x55837afef370 2024-09-19T09:11:16.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.006+0000 7fdf5efd3740 10 client.18858 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:11:16.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.006+0000 7fdf5efd3740 10 client.18858 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:11:16.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.006+0000 7fdf5efd3740 20 client.18858 populate_metadata read hostname 'smithi092' 2024-09-19T09:11:16.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.006+0000 7fdf5efd3740 1 --2- 172.21.15.92:0/1106549246 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55837b06a750 0x55837b06cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:16.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.006+0000 7fdf5efd3740 4 client.18858 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:11:16.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.006+0000 7fdf5efd3740 1 -- 172.21.15.92:0/1106549246 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55837aed1900 con 0x55837b06a750 2024-09-19T09:11:16.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.007+0000 7fdf59fde640 1 --2- 172.21.15.92:0/1106549246 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55837b06a750 0x55837b06cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:16.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.007+0000 7fdf3d7fa640 10 client.18858 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:16.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.007+0000 7fdf59fde640 1 --2- 172.21.15.92:0/1106549246 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55837b06a750 0x55837b06cb70 crc :-1 s=READY pgs=439 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9387ea793249e07 server_cookie=6aab169b6207d11c in_seq=0 out_seq=0 2024-09-19T09:11:16.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.029+0000 7fdf3d7fa640 1 -- 172.21.15.92:0/1106549246 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55837aed1900 con 0x55837b06a750 2024-09-19T09:11:16.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.029+0000 7fdf3d7fa640 10 client.18858 handle_command_reply: tid=0 2024-09-19T09:11:16.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.029+0000 7fdf5efd3740 1 client.18858 shutdown 2024-09-19T09:11:16.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.029+0000 7fdf5efd3740 1 -- 172.21.15.92:0/1106549246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55837afef370 msgr2=0x55837aff9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:16.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.029+0000 7fdf5efd3740 1 --2- 172.21.15.92:0/1106549246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55837afef370 0x55837aff9980 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c098ea0 tx=0x7fdf4c009a70 comp rx=0 tx=0).stop 2024-09-19T09:11:16.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.029+0000 7fdf5efd3740 1 -- 172.21.15.92:0/1106549246 shutdown_connections 2024-09-19T09:11:16.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.029+0000 7fdf5efd3740 1 --2- 172.21.15.92:0/1106549246 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55837b06a750 0x55837b06cb70 crc :-1 s=READY pgs=439 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:16.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.029+0000 7fdf5efd3740 1 --2- 172.21.15.92:0/1106549246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55837afef370 0x55837aff9980 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:16.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.029+0000 7fdf5efd3740 1 --2- 172.21.15.92:0/1106549246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55837afea2e0 0x55837aff8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.029+0000 7fdf3d7fa640 0 client.18858 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.029+0000 7fdf5efd3740 1 --2- 172.21.15.92:0/1106549246 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55837afe99a0 0x55837aff8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.029+0000 7fdf5efd3740 1 -- 172.21.15.92:0/1106549246 >> 172.21.15.92:0/1106549246 conn(0x55837afe5010 msgr2=0x55837afe41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.029+0000 7fdf5efd3740 1 -- 172.21.15.92:0/1106549246 shutdown_connections 2024-09-19T09:11:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.029+0000 7fdf5efd3740 1 -- 172.21.15.92:0/1106549246 wait complete. 2024-09-19T09:11:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.029+0000 7fdf5efd3740 20 client.18858 trim_cache size 0 max 16384 2024-09-19T09:11:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:11:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:11:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:11:16.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:11:16.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.030+0000 7fdf5c242640 1 -- 172.21.15.92:0/307535322 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdf400a32f0 msgr2=0x7fdf400a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:16.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.030+0000 7fdf5c242640 1 --2- 172.21.15.92:0/307535322 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdf400a32f0 0x7fdf400a57b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fdf44005ab0 tx=0x7fdf44031400 comp rx=0 tx=0).stop 2024-09-19T09:11:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.030+0000 7fdf5c242640 1 -- 172.21.15.92:0/307535322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf541056c0 msgr2=0x7fdf541a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.030+0000 7fdf5c242640 1 --2- 172.21.15.92:0/307535322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf541056c0 0x7fdf541a5990 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c00eb10 tx=0x7fdf4c00c2d0 comp rx=0 tx=0).stop 2024-09-19T09:11:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.030+0000 7fdf5c242640 1 -- 172.21.15.92:0/307535322 shutdown_connections 2024-09-19T09:11:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.030+0000 7fdf5c242640 1 --2- 172.21.15.92:0/307535322 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fdf400a32f0 0x7fdf400a57b0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.030+0000 7fdf5c242640 1 --2- 172.21.15.92:0/307535322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf541056c0 0x7fdf541a5990 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.030+0000 7fdf5c242640 1 --2- 172.21.15.92:0/307535322 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf54102d10 0x7fdf5419e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.030+0000 7fdf5c242640 1 --2- 172.21.15.92:0/307535322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf541003c0 0x7fdf5419e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.030+0000 7fdf5c242640 1 -- 172.21.15.92:0/307535322 >> 172.21.15.92:0/307535322 conn(0x7fdf540fc1b0 msgr2=0x7fdf54100e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.030+0000 7fdf5c242640 1 -- 172.21.15.92:0/307535322 shutdown_connections 2024-09-19T09:11:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:16.030+0000 7fdf5c242640 1 -- 172.21.15.92:0/307535322 wait complete. 2024-09-19T09:11:16.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:15 smithi167 ceph-mon[35359]: scrub queued for path: / 2024-09-19T09:11:16.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:15 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:11:16.103 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:15 smithi167 ceph-mon[35359]: scrub summary: active paths [/] 2024-09-19T09:11:16.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:15 smithi190 ceph-mon[35358]: scrub queued for path: / 2024-09-19T09:11:16.125 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:15 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:11:16.125 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:15 smithi190 ceph-mon[35358]: scrub summary: active paths [/] 2024-09-19T09:11:16.461 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:11:16.745 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:11:17.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:16 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:11:17.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:16 smithi167 ceph-mon[35359]: pgmap v774: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 5.6 MiB/s wr, 530 op/s 2024-09-19T09:11:17.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:16 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:11:17.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:16 smithi190 ceph-mon[35358]: pgmap v774: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 5.6 MiB/s wr, 530 op/s 2024-09-19T09:11:17.138 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:16 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:11:17.138 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:16 smithi092 ceph-mon[31407]: pgmap v774: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 5.6 MiB/s wr, 530 op/s 2024-09-19T09:11:17.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.218+0000 7f8eb3829640 1 -- 172.21.15.92:0/1910547796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8eac105f40 msgr2=0x7f8eac1063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:17.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.218+0000 7f8eb3829640 1 --2- 172.21.15.92:0/1910547796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8eac105f40 0x7f8eac1063d0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4009ca0 tx=0x7f8ea402a940 comp rx=0 tx=0).stop 2024-09-19T09:11:17.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.218+0000 7f8eb3829640 1 -- 172.21.15.92:0/1910547796 shutdown_connections 2024-09-19T09:11:17.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.218+0000 7f8eb3829640 1 --2- 172.21.15.92:0/1910547796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8eac105f40 0x7f8eac1063d0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:17.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.218+0000 7f8eb3829640 1 --2- 172.21.15.92:0/1910547796 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8eac101450 0x7f8eac105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:17.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.218+0000 7f8eb3829640 1 --2- 172.21.15.92:0/1910547796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8eac100b30 0x7f8eac100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:17.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.218+0000 7f8eb3829640 1 -- 172.21.15.92:0/1910547796 >> 172.21.15.92:0/1910547796 conn(0x7f8eac0fc7a0 msgr2=0x7f8eac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:17.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.218+0000 7f8eb3829640 1 -- 172.21.15.92:0/1910547796 shutdown_connections 2024-09-19T09:11:17.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.218+0000 7f8eb3829640 1 -- 172.21.15.92:0/1910547796 wait complete. 2024-09-19T09:11:17.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.219+0000 7f8eb3829640 1 Processor -- start 2024-09-19T09:11:17.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.219+0000 7f8eb3829640 1 -- start start 2024-09-19T09:11:17.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.219+0000 7f8eb3829640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8eac100b30 0x7f8eac1a4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:17.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.219+0000 7f8eb3829640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8eac101450 0x7f8eac1a4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:17.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.219+0000 7f8eb3829640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8eac105f40 0x7f8eac19e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:17.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.219+0000 7f8eb3829640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8eac118560 con 0x7f8eac101450 2024-09-19T09:11:17.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.219+0000 7f8eb3829640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8eac1183e0 con 0x7f8eac105f40 2024-09-19T09:11:17.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.219+0000 7f8eb3829640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8eac1186e0 con 0x7f8eac100b30 2024-09-19T09:11:17.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.219+0000 7f8eb0dc4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8eac101450 0x7f8eac1a4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:17.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.219+0000 7f8eb0dc4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8eac101450 0x7f8eac1a4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40012/0 (socket says 172.21.15.92:40012) 2024-09-19T09:11:17.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.219+0000 7f8eb0dc4640 1 -- 172.21.15.92:0/3480055097 learned_addr learned my addr 172.21.15.92:0/3480055097 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:17.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.219+0000 7f8eb15c5640 1 --2- 172.21.15.92:0/3480055097 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8eac100b30 0x7f8eac1a4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:17.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.219+0000 7f8eb1dc6640 1 --2- 172.21.15.92:0/3480055097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8eac105f40 0x7f8eac19e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:17.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.219+0000 7f8eb0dc4640 1 -- 172.21.15.92:0/3480055097 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8eac100b30 msgr2=0x7f8eac1a4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:17.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.219+0000 7f8eb0dc4640 1 --2- 172.21.15.92:0/3480055097 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8eac100b30 0x7f8eac1a4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:17.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.219+0000 7f8eb0dc4640 1 -- 172.21.15.92:0/3480055097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8eac105f40 msgr2=0x7f8eac19e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:17.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.219+0000 7f8eb0dc4640 1 --2- 172.21.15.92:0/3480055097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8eac105f40 0x7f8eac19e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:17.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.219+0000 7f8eb0dc4640 1 -- 172.21.15.92:0/3480055097 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eac19ef50 con 0x7f8eac101450 2024-09-19T09:11:17.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.220+0000 7f8eb0dc4640 1 --2- 172.21.15.92:0/3480055097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8eac101450 0x7f8eac1a4b70 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c00d740 tx=0x7f8e9c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:17.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.220+0000 7f8ea27fc640 1 -- 172.21.15.92:0/3480055097 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c017070 con 0x7f8eac101450 2024-09-19T09:11:17.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.220+0000 7f8ea27fc640 1 -- 172.21.15.92:0/3480055097 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e9c00de50 con 0x7f8eac101450 2024-09-19T09:11:17.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.220+0000 7f8eb3829640 1 -- 172.21.15.92:0/3480055097 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eac19f240 con 0x7f8eac101450 2024-09-19T09:11:17.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.220+0000 7f8ea27fc640 1 -- 172.21.15.92:0/3480055097 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c00f620 con 0x7f8eac101450 2024-09-19T09:11:17.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.220+0000 7f8eb3829640 1 -- 172.21.15.92:0/3480055097 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eac1ab490 con 0x7f8eac101450 2024-09-19T09:11:17.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.222+0000 7f8ea27fc640 1 -- 172.21.15.92:0/3480055097 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8e9c009c30 con 0x7f8eac101450 2024-09-19T09:11:17.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.222+0000 7f8eb5c02740 1 Processor -- start 2024-09-19T09:11:17.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.222+0000 7f8eb5c02740 1 -- start start 2024-09-19T09:11:17.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.223+0000 7f8eb5c02740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569874784a0 0x556987478880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:17.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.223+0000 7f8eb5c02740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556987478dc0 0x556987483140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:17.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.223+0000 7f8eb5c02740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556987483680 0x556987485a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:17.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.223+0000 7f8eb5c02740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5569873de2e0 con 0x5569874784a0 2024-09-19T09:11:17.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.223+0000 7f8eb5c02740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556987385ce0 con 0x556987478dc0 2024-09-19T09:11:17.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.223+0000 7f8eb5c02740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5569873da2a0 con 0x556987483680 2024-09-19T09:11:17.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.223+0000 7f8eb1dc6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569874784a0 0x556987478880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:17.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.223+0000 7f8eb1dc6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569874784a0 0x556987478880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40018/0 (socket says 172.21.15.92:40018) 2024-09-19T09:11:17.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.223+0000 7f8eb1dc6640 1 -- 172.21.15.92:0/2935815854 learned_addr learned my addr 172.21.15.92:0/2935815854 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:17.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.223+0000 7f8ea27fc640 1 --2- 172.21.15.92:0/3480055097 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8e980a32c0 0x7f8e980a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:17.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.223+0000 7f8eb0dc4640 1 --2- 172.21.15.92:0/2935815854 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556987483680 0x556987485a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:17.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.223+0000 7f8eb1dc6640 1 --2- 172.21.15.92:0/3480055097 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8e980a32c0 0x7f8e980a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:17.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.223+0000 7f8eb15c5640 1 --2- 172.21.15.92:0/2935815854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556987478dc0 0x556987483140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:17.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.223+0000 7f8ea27fc640 1 -- 172.21.15.92:0/3480055097 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8e9c0cf4d0 con 0x7f8eac101450 2024-09-19T09:11:17.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.223+0000 7f8eb1dc6640 1 -- 172.21.15.92:0/2935815854 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556987483680 msgr2=0x556987485a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:17.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.223+0000 7f8eb1dc6640 1 --2- 172.21.15.92:0/2935815854 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556987483680 0x556987485a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:17.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.223+0000 7f8eb1dc6640 1 -- 172.21.15.92:0/2935815854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556987478dc0 msgr2=0x556987483140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:17.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.223+0000 7f8eb1dc6640 1 --2- 172.21.15.92:0/2935815854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556987478dc0 0x556987483140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:17.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.223+0000 7f8eb1dc6640 1 -- 172.21.15.92:0/2935815854 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55698736a440 con 0x5569874784a0 2024-09-19T09:11:17.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.223+0000 7f8eb0dc4640 1 --2- 172.21.15.92:0/2935815854 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556987483680 0x556987485a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:11:17.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.223+0000 7f8eb1dc6640 1 --2- 172.21.15.92:0/2935815854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569874784a0 0x556987478880 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4005e30 tx=0x7f8ea402f6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d0edf0e82714526 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:17.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.224+0000 7f8eb1dc6640 1 --2- 172.21.15.92:0/3480055097 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8e980a32c0 0x7f8e980a5780 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f8ea402ae60 tx=0x7f8ea4047000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:17.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.224+0000 7f8e977fe640 1 -- 172.21.15.92:0/2935815854 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea404d070 con 0x5569874784a0 2024-09-19T09:11:17.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.224+0000 7f8e977fe640 1 -- 172.21.15.92:0/2935815854 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ea4030b20 con 0x5569874784a0 2024-09-19T09:11:17.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.224+0000 7f8e977fe640 1 -- 172.21.15.92:0/2935815854 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4034040 con 0x5569874784a0 2024-09-19T09:11:17.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.224+0000 7f8eb5c02740 1 -- 172.21.15.92:0/2935815854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569874784a0 msgr2=0x556987478880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:17.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.224+0000 7f8eb5c02740 1 --2- 172.21.15.92:0/2935815854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569874784a0 0x556987478880 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4005e30 tx=0x7f8ea402f6b0 comp rx=0 tx=0).stop 2024-09-19T09:11:17.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.224+0000 7f8eb5c02740 1 -- 172.21.15.92:0/2935815854 shutdown_connections 2024-09-19T09:11:17.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.224+0000 7f8eb5c02740 1 --2- 172.21.15.92:0/2935815854 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556987483680 0x556987485a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:17.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.224+0000 7f8eb5c02740 1 --2- 172.21.15.92:0/2935815854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556987478dc0 0x556987483140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:17.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.224+0000 7f8eb5c02740 1 --2- 172.21.15.92:0/2935815854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569874784a0 0x556987478880 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:17.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.224+0000 7f8eb5c02740 1 -- 172.21.15.92:0/2935815854 >> 172.21.15.92:0/2935815854 conn(0x556987474a30 msgr2=0x556987474e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:17.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.224+0000 7f8eb5c02740 1 -- 172.21.15.92:0/2935815854 shutdown_connections 2024-09-19T09:11:17.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.225+0000 7f8eb5c02740 1 -- 172.21.15.92:0/2935815854 wait complete. 2024-09-19T09:11:17.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.225+0000 7f8eb5c02740 1 -- start start 2024-09-19T09:11:17.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.225+0000 7f8eb5c02740 1 Processor -- start 2024-09-19T09:11:17.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.225+0000 7f8eb5c02740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569874784a0 0x556987482fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:17.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.225+0000 7f8eb5c02740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556987478dc0 0x556987480290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:17.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.225+0000 7f8eb5c02740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556987483680 0x5569874807f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:17.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.225+0000 7f8eb5c02740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556987486250 con 0x556987483680 2024-09-19T09:11:17.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.225+0000 7f8eb5c02740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556987399050 con 0x5569874784a0 2024-09-19T09:11:17.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.225+0000 7f8eb5c02740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5569874863d0 con 0x556987478dc0 2024-09-19T09:11:17.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.225+0000 7f8eb5c02740 10 client.0 _ll_register_callbacks cb 0x5569873d9160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:11:17.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.225+0000 7f8eb1dc6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556987483680 0x5569874807f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:17.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.226+0000 7f8eb1dc6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556987483680 0x5569874807f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40034/0 (socket says 172.21.15.92:40034) 2024-09-19T09:11:17.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.226+0000 7f8eb15c5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569874784a0 0x556987482fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:17.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.226+0000 7f8eb1dc6640 1 -- 172.21.15.92:0/44869226 learned_addr learned my addr 172.21.15.92:0/44869226 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:17.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.226+0000 7f8eb0dc4640 1 --2- 172.21.15.92:0/44869226 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556987478dc0 0x556987480290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:17.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.226+0000 7f8eb1dc6640 1 -- 172.21.15.92:0/44869226 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556987478dc0 msgr2=0x556987480290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:17.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.226+0000 7f8eb1dc6640 1 --2- 172.21.15.92:0/44869226 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556987478dc0 0x556987480290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:17.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.226+0000 7f8eb1dc6640 1 -- 172.21.15.92:0/44869226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569874784a0 msgr2=0x556987482fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:17.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.226+0000 7f8eb1dc6640 1 --2- 172.21.15.92:0/44869226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569874784a0 0x556987482fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:17.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.226+0000 7f8eb1dc6640 1 -- 172.21.15.92:0/44869226 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55698714f3c0 con 0x556987483680 2024-09-19T09:11:17.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.226+0000 7f8eb1dc6640 1 --2- 172.21.15.92:0/44869226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556987483680 0x5569874807f0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4004310 tx=0x7f8ea40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8247d8dc6cbf94c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:17.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.226+0000 7f8e94ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:11:17.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.226+0000 7f8e94ff9640 1 -- 172.21.15.92:0/44869226 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4054020 con 0x556987483680 2024-09-19T09:11:17.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.226+0000 7f8eb5c02740 1 -- 172.21.15.92:0/44869226 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ea4030b20 con 0x556987483680 2024-09-19T09:11:17.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.226+0000 7f8e94ff9640 1 -- 172.21.15.92:0/44869226 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8ea4039420 con 0x556987483680 2024-09-19T09:11:17.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.226+0000 7f8e94ff9640 1 -- 172.21.15.92:0/44869226 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8ea4034030 con 0x556987483680 2024-09-19T09:11:17.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.226+0000 7f8eb5c02740 10 client.18870 fetch_fsmap learned FSMap version 19 2024-09-19T09:11:17.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.226+0000 7f8eb5c02740 1 -- 172.21.15.92:0/44869226 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x556987486250 con 0x556987483680 2024-09-19T09:11:17.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.226+0000 7f8e94ff9640 1 -- 172.21.15.92:0/44869226 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ea4030b20 con 0x556987483680 2024-09-19T09:11:17.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.227+0000 7f8e94ff9640 1 -- 172.21.15.92:0/44869226 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f8ea402f070 con 0x556987483680 2024-09-19T09:11:17.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.227+0000 7f8eb5c02740 10 client.18870 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:11:17.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.227+0000 7f8eb5c02740 10 client.18870 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:11:17.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.227+0000 7f8eb5c02740 20 client.18870 populate_metadata read hostname 'smithi092' 2024-09-19T09:11:17.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.227+0000 7f8eb5c02740 1 --2- 172.21.15.92:0/44869226 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556987492da0 0x556987495190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:17.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.227+0000 7f8eb5c02740 4 client.18870 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:11:17.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.227+0000 7f8eb5c02740 1 -- 172.21.15.92:0/44869226 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569873eb850 con 0x556987492da0 2024-09-19T09:11:17.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.227+0000 7f8eb15c5640 1 --2- 172.21.15.92:0/44869226 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556987492da0 0x556987495190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:17.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.227+0000 7f8eb15c5640 1 --2- 172.21.15.92:0/44869226 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556987492da0 0x556987495190 crc :-1 s=READY pgs=440 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c92dee3ba832ae8c server_cookie=19c3b58998783253 in_seq=0 out_seq=0 2024-09-19T09:11:17.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.227+0000 7f8e94ff9640 10 client.18870 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:17.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.228+0000 7f8e94ff9640 1 -- 172.21.15.92:0/44869226 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5569873eb850 con 0x556987492da0 2024-09-19T09:11:17.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.228+0000 7f8e94ff9640 10 client.18870 handle_command_reply: tid=0 2024-09-19T09:11:17.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.228+0000 7f8eb5c02740 1 client.18870 shutdown 2024-09-19T09:11:17.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.228+0000 7f8eb5c02740 1 -- 172.21.15.92:0/44869226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556987483680 msgr2=0x5569874807f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:17.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.228+0000 7f8eb5c02740 1 --2- 172.21.15.92:0/44869226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556987483680 0x5569874807f0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4004310 tx=0x7f8ea40045e0 comp rx=0 tx=0).stop 2024-09-19T09:11:17.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.228+0000 7f8eb5c02740 1 -- 172.21.15.92:0/44869226 shutdown_connections 2024-09-19T09:11:17.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.228+0000 7f8eb5c02740 1 --2- 172.21.15.92:0/44869226 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556987492da0 0x556987495190 crc :-1 s=READY pgs=440 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:17.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.228+0000 7f8eb5c02740 1 --2- 172.21.15.92:0/44869226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556987483680 0x5569874807f0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:17.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.228+0000 7f8eb5c02740 1 --2- 172.21.15.92:0/44869226 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556987478dc0 0x556987480290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:17.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.228+0000 7f8eb5c02740 1 --2- 172.21.15.92:0/44869226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569874784a0 0x556987482fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:17.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.228+0000 7f8eb5c02740 1 -- 172.21.15.92:0/44869226 >> 172.21.15.92:0/44869226 conn(0x556987474a30 msgr2=0x55698747a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:17.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.228+0000 7f8e94ff9640 0 client.18870 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:17.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.228+0000 7f8eb5c02740 1 -- 172.21.15.92:0/44869226 shutdown_connections 2024-09-19T09:11:17.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.228+0000 7f8eb5c02740 1 -- 172.21.15.92:0/44869226 wait complete. 2024-09-19T09:11:17.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.229+0000 7f8eb5c02740 20 client.18870 trim_cache size 0 max 16384 2024-09-19T09:11:17.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.245+0000 7f8eb5c02740 1 Processor -- start 2024-09-19T09:11:17.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.246+0000 7f8eb5c02740 1 -- start start 2024-09-19T09:11:17.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.246+0000 7f8eb5c02740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569874784a0 0x55698747fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:17.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.246+0000 7f8eb5c02740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556987478dc0 0x55698749a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:17.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.246+0000 7f8eb5c02740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556987483680 0x55698749ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:17.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.246+0000 7f8eb5c02740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8eac1b1b80 con 0x556987483680 2024-09-19T09:11:17.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.246+0000 7f8eb5c02740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8eac1b4420 con 0x556987478dc0 2024-09-19T09:11:17.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.246+0000 7f8eb5c02740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8eac1b2210 con 0x5569874784a0 2024-09-19T09:11:17.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.246+0000 7f8eb1dc6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556987483680 0x55698749ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:17.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.246+0000 7f8eb1dc6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556987483680 0x55698749ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40040/0 (socket says 172.21.15.92:40040) 2024-09-19T09:11:17.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.246+0000 7f8eb1dc6640 1 -- 172.21.15.92:0/2459948059 learned_addr learned my addr 172.21.15.92:0/2459948059 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:17.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.246+0000 7f8eb0dc4640 1 --2- 172.21.15.92:0/2459948059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556987478dc0 0x55698749a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:17.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.246+0000 7f8eb15c5640 1 --2- 172.21.15.92:0/2459948059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569874784a0 0x55698747fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:17.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.246+0000 7f8eb1dc6640 1 -- 172.21.15.92:0/2459948059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569874784a0 msgr2=0x55698747fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:17.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.246+0000 7f8eb1dc6640 1 --2- 172.21.15.92:0/2459948059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569874784a0 0x55698747fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:17.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.246+0000 7f8eb1dc6640 1 -- 172.21.15.92:0/2459948059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556987478dc0 msgr2=0x55698749a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:17.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.246+0000 7f8eb1dc6640 1 --2- 172.21.15.92:0/2459948059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556987478dc0 0x55698749a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:17.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.246+0000 7f8eb1dc6640 1 -- 172.21.15.92:0/2459948059 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569874782d0 con 0x556987483680 2024-09-19T09:11:17.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.246+0000 7f8eb1dc6640 1 --2- 172.21.15.92:0/2459948059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556987483680 0x55698749ad30 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4004380 tx=0x7f8ea4030a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da93731222852b8b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:17.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.246+0000 7f8e96ffd640 1 -- 172.21.15.92:0/2459948059 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4054070 con 0x556987483680 2024-09-19T09:11:17.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.246+0000 7f8e96ffd640 1 -- 172.21.15.92:0/2459948059 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ea4003e00 con 0x556987483680 2024-09-19T09:11:17.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.246+0000 7f8e96ffd640 1 -- 172.21.15.92:0/2459948059 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea404d040 con 0x556987483680 2024-09-19T09:11:17.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.247+0000 7f8eb5c02740 1 -- 172.21.15.92:0/2459948059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556987483680 msgr2=0x55698749ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:17.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.247+0000 7f8eb5c02740 1 --2- 172.21.15.92:0/2459948059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556987483680 0x55698749ad30 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4004380 tx=0x7f8ea4030a60 comp rx=0 tx=0).stop 2024-09-19T09:11:17.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.247+0000 7f8eb5c02740 1 -- 172.21.15.92:0/2459948059 shutdown_connections 2024-09-19T09:11:17.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.247+0000 7f8eb5c02740 1 --2- 172.21.15.92:0/2459948059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556987483680 0x55698749ad30 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:17.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.247+0000 7f8eb5c02740 1 --2- 172.21.15.92:0/2459948059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556987478dc0 0x55698749a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:17.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.247+0000 7f8eb5c02740 1 --2- 172.21.15.92:0/2459948059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569874784a0 0x55698747fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:17.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.247+0000 7f8eb5c02740 1 -- 172.21.15.92:0/2459948059 >> 172.21.15.92:0/2459948059 conn(0x556987474a30 msgr2=0x556987473b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:17.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.247+0000 7f8eb5c02740 1 -- 172.21.15.92:0/2459948059 shutdown_connections 2024-09-19T09:11:17.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.247+0000 7f8eb5c02740 1 -- 172.21.15.92:0/2459948059 wait complete. 2024-09-19T09:11:17.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.248+0000 7f8eb5c02740 1 -- start start 2024-09-19T09:11:17.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.248+0000 7f8eb5c02740 1 Processor -- start 2024-09-19T09:11:17.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.248+0000 7f8eb5c02740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569874784a0 0x556987488af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:17.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.248+0000 7f8eb5c02740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556987478dc0 0x556987489030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:17.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.248+0000 7f8eb5c02740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556987483680 0x5569874fb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:17.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.248+0000 7f8eb5c02740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8eac1b28e0 con 0x556987478dc0 2024-09-19T09:11:17.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.248+0000 7f8eb5c02740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8eac1b3d50 con 0x556987483680 2024-09-19T09:11:17.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.248+0000 7f8eb5c02740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8eac1b2fb0 con 0x5569874784a0 2024-09-19T09:11:17.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.248+0000 7f8eb5c02740 10 client.0 _ll_register_callbacks cb 0x7f8ea404b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:11:17.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.248+0000 7f8eb0dc4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556987478dc0 0x556987489030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:17.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.248+0000 7f8eb0dc4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556987478dc0 0x556987489030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40044/0 (socket says 172.21.15.92:40044) 2024-09-19T09:11:17.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.248+0000 7f8eb0dc4640 1 -- 172.21.15.92:0/793842619 learned_addr learned my addr 172.21.15.92:0/793842619 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:17.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.248+0000 7f8eb15c5640 1 --2- 172.21.15.92:0/793842619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569874784a0 0x556987488af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:17.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.248+0000 7f8eb1dc6640 1 --2- 172.21.15.92:0/793842619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556987483680 0x5569874fb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:17.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.248+0000 7f8eb0dc4640 1 -- 172.21.15.92:0/793842619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569874784a0 msgr2=0x556987488af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:17.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.248+0000 7f8eb0dc4640 1 --2- 172.21.15.92:0/793842619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569874784a0 0x556987488af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:17.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.248+0000 7f8eb0dc4640 1 -- 172.21.15.92:0/793842619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556987483680 msgr2=0x5569874fb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:17.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.248+0000 7f8eb0dc4640 1 --2- 172.21.15.92:0/793842619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556987483680 0x5569874fb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:17.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.248+0000 7f8eb0dc4640 1 -- 172.21.15.92:0/793842619 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569874fbd30 con 0x556987478dc0 2024-09-19T09:11:17.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.248+0000 7f8eb1dc6640 1 --2- 172.21.15.92:0/793842619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556987483680 0x5569874fb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:11:17.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.248+0000 7f8eb15c5640 1 --2- 172.21.15.92:0/793842619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569874784a0 0x556987488af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:11:17.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.249+0000 7f8eb0dc4640 1 --2- 172.21.15.92:0/793842619 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556987478dc0 0x556987489030 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c097f10 tx=0x7f8e9c09bb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3878c85621a067f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:17.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.249+0000 7f8e94ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:11:17.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.249+0000 7f8e94ff9640 1 -- 172.21.15.92:0/793842619 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c020040 con 0x556987478dc0 2024-09-19T09:11:17.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.249+0000 7f8e94ff9640 1 -- 172.21.15.92:0/793842619 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8e9c0cd0a0 con 0x556987478dc0 2024-09-19T09:11:17.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.249+0000 7f8eb5c02740 1 -- 172.21.15.92:0/793842619 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ea4003e00 con 0x556987478dc0 2024-09-19T09:11:17.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.249+0000 7f8e94ff9640 1 -- 172.21.15.92:0/793842619 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8e9c09fe60 con 0x556987478dc0 2024-09-19T09:11:17.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.249+0000 7f8eb5c02740 10 client.18876 fetch_fsmap learned FSMap version 19 2024-09-19T09:11:17.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.249+0000 7f8eb5c02740 1 -- 172.21.15.92:0/793842619 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5569874fd080 con 0x556987478dc0 2024-09-19T09:11:17.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.249+0000 7f8e94ff9640 1 -- 172.21.15.92:0/793842619 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ea4003e00 con 0x556987478dc0 2024-09-19T09:11:17.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.249+0000 7f8e94ff9640 1 -- 172.21.15.92:0/793842619 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f8e9c09af00 con 0x556987478dc0 2024-09-19T09:11:17.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.249+0000 7f8eb5c02740 10 client.18876 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:11:17.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.249+0000 7f8eb5c02740 10 client.18876 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:11:17.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.249+0000 7f8eb5c02740 20 client.18876 populate_metadata read hostname 'smithi092' 2024-09-19T09:11:17.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.249+0000 7f8eb5c02740 1 --2- 172.21.15.92:0/793842619 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5569874fd750 0x5569874ffb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:17.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.249+0000 7f8eb5c02740 4 client.18876 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:11:17.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.249+0000 7f8eb5c02740 1 -- 172.21.15.92:0/793842619 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5569873e5d60 con 0x5569874fd750 2024-09-19T09:11:17.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.250+0000 7f8eb15c5640 1 --2- 172.21.15.92:0/793842619 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5569874fd750 0x5569874ffb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:17.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.250+0000 7f8eb15c5640 1 --2- 172.21.15.92:0/793842619 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5569874fd750 0x5569874ffb70 crc :-1 s=READY pgs=441 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c20ecafbaa44272 server_cookie=714bd05d8b8bcffc in_seq=0 out_seq=0 2024-09-19T09:11:17.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.250+0000 7f8e94ff9640 10 client.18876 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:17.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.250+0000 7f8e94ff9640 1 -- 172.21.15.92:0/793842619 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5569873e5d60 con 0x5569874fd750 2024-09-19T09:11:17.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.250+0000 7f8e94ff9640 10 client.18876 handle_command_reply: tid=0 2024-09-19T09:11:17.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.250+0000 7f8eb5c02740 1 client.18876 shutdown 2024-09-19T09:11:17.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.250+0000 7f8eb5c02740 1 -- 172.21.15.92:0/793842619 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556987478dc0 msgr2=0x556987489030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:17.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.250+0000 7f8eb5c02740 1 --2- 172.21.15.92:0/793842619 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556987478dc0 0x556987489030 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c097f10 tx=0x7f8e9c09bb70 comp rx=0 tx=0).stop 2024-09-19T09:11:17.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.250+0000 7f8eb5c02740 1 -- 172.21.15.92:0/793842619 shutdown_connections 2024-09-19T09:11:17.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.250+0000 7f8eb5c02740 1 --2- 172.21.15.92:0/793842619 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5569874fd750 0x5569874ffb70 crc :-1 s=READY pgs=441 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:17.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.250+0000 7f8eb5c02740 1 --2- 172.21.15.92:0/793842619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556987483680 0x5569874fb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:17.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.250+0000 7f8eb5c02740 1 --2- 172.21.15.92:0/793842619 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556987478dc0 0x556987489030 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:17.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.250+0000 7f8e94ff9640 0 client.18876 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:17.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.250+0000 7f8eb5c02740 1 --2- 172.21.15.92:0/793842619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569874784a0 0x556987488af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:17.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.250+0000 7f8eb5c02740 1 -- 172.21.15.92:0/793842619 >> 172.21.15.92:0/793842619 conn(0x556987474a30 msgr2=0x556987481af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:17.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.250+0000 7f8eb5c02740 1 -- 172.21.15.92:0/793842619 shutdown_connections 2024-09-19T09:11:17.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.251+0000 7f8eb5c02740 1 -- 172.21.15.92:0/793842619 wait complete. 2024-09-19T09:11:17.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.251+0000 7f8eb5c02740 20 client.18876 trim_cache size 0 max 16384 2024-09-19T09:11:17.258 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:11:17.258 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:11:17.258 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": { 2024-09-19T09:11:17.259 INFO:teuthology.orchestra.run.smithi092.stdout: "d5627989-5547-4217-b734-293cc87cf565": { 2024-09-19T09:11:17.259 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-19T09:11:17.259 INFO:teuthology.orchestra.run.smithi092.stdout: "tag": "d5627989-5547-4217-b734-293cc87cf565", 2024-09-19T09:11:17.259 INFO:teuthology.orchestra.run.smithi092.stdout: "options": "recursive,force" 2024-09-19T09:11:17.259 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:11:17.259 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:11:17.259 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:11:17.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.251+0000 7f8eb3829640 1 -- 172.21.15.92:0/3480055097 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8e980a32c0 msgr2=0x7f8e980a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:17.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.251+0000 7f8eb3829640 1 --2- 172.21.15.92:0/3480055097 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8e980a32c0 0x7f8e980a5780 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f8ea402ae60 tx=0x7f8ea4047000 comp rx=0 tx=0).stop 2024-09-19T09:11:17.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.251+0000 7f8eb3829640 1 -- 172.21.15.92:0/3480055097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8eac101450 msgr2=0x7f8eac1a4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:17.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.251+0000 7f8eb3829640 1 --2- 172.21.15.92:0/3480055097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8eac101450 0x7f8eac1a4b70 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c00d740 tx=0x7f8e9c00dc00 comp rx=0 tx=0).stop 2024-09-19T09:11:17.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.251+0000 7f8eb3829640 1 -- 172.21.15.92:0/3480055097 shutdown_connections 2024-09-19T09:11:17.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.251+0000 7f8eb3829640 1 --2- 172.21.15.92:0/3480055097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8eac105f40 0x7f8eac19e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:17.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.251+0000 7f8eb3829640 1 --2- 172.21.15.92:0/3480055097 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8e980a32c0 0x7f8e980a5780 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:17.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.251+0000 7f8eb3829640 1 --2- 172.21.15.92:0/3480055097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8eac101450 0x7f8eac1a4b70 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:17.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.251+0000 7f8eb3829640 1 --2- 172.21.15.92:0/3480055097 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8eac100b30 0x7f8eac1a4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:17.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.251+0000 7f8eb3829640 1 -- 172.21.15.92:0/3480055097 >> 172.21.15.92:0/3480055097 conn(0x7f8eac0fc7a0 msgr2=0x7f8eac1038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:17.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.251+0000 7f8eb3829640 1 -- 172.21.15.92:0/3480055097 shutdown_connections 2024-09-19T09:11:17.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:17.251+0000 7f8eb3829640 1 -- 172.21.15.92:0/3480055097 wait complete. 2024-09-19T09:11:17.927 INFO:tasks.cephfs.filesystem:scrub status for tag:d5627989-5547-4217-b734-293cc87cf565 - {'path': '/', 'tag': 'd5627989-5547-4217-b734-293cc87cf565', 'options': 'recursive,force'} 2024-09-19T09:11:19.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:18 smithi092 ceph-mon[31407]: pgmap v775: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 4.5 MiB/s wr, 468 op/s 2024-09-19T09:11:19.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:18 smithi167 ceph-mon[35359]: pgmap v775: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 4.5 MiB/s wr, 468 op/s 2024-09-19T09:11:19.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:18 smithi190 ceph-mon[35358]: pgmap v775: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 4.5 MiB/s wr, 468 op/s 2024-09-19T09:11:20.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:19 smithi092 ceph-mon[31407]: scrub summary: idle 2024-09-19T09:11:20.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:19 smithi167 ceph-mon[35359]: scrub summary: idle 2024-09-19T09:11:20.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:19 smithi190 ceph-mon[35358]: scrub summary: idle 2024-09-19T09:11:20.800 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:11:21.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:20 smithi092 ceph-mon[31407]: pgmap v776: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 2.9 MiB/s wr, 392 op/s 2024-09-19T09:11:21.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:20 smithi167 ceph-mon[35359]: pgmap v776: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 2.9 MiB/s wr, 392 op/s 2024-09-19T09:11:21.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:20 smithi190 ceph-mon[35358]: pgmap v776: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 2.9 MiB/s wr, 392 op/s 2024-09-19T09:11:23.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:22 smithi092 ceph-mon[31407]: pgmap v777: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 1.6 MiB/s wr, 250 op/s 2024-09-19T09:11:23.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:22 smithi167 ceph-mon[35359]: pgmap v777: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 1.6 MiB/s wr, 250 op/s 2024-09-19T09:11:23.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:22 smithi190 ceph-mon[35358]: pgmap v777: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 1.6 MiB/s wr, 250 op/s 2024-09-19T09:11:25.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:24 smithi092 ceph-mon[31407]: pgmap v778: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 1.3 MiB/s wr, 188 op/s 2024-09-19T09:11:25.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:24 smithi167 ceph-mon[35359]: pgmap v778: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 1.3 MiB/s wr, 188 op/s 2024-09-19T09:11:25.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:24 smithi190 ceph-mon[35358]: pgmap v778: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 1.3 MiB/s wr, 188 op/s 2024-09-19T09:11:25.800 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:11:27.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:26 smithi092 ceph-mon[31407]: pgmap v779: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 1014 KiB/s wr, 168 op/s 2024-09-19T09:11:27.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:26 smithi167 ceph-mon[35359]: pgmap v779: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 1014 KiB/s wr, 168 op/s 2024-09-19T09:11:27.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:26 smithi190 ceph-mon[35358]: pgmap v779: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 1014 KiB/s wr, 168 op/s 2024-09-19T09:11:29.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:28 smithi092 ceph-mon[31407]: pgmap v780: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 1016 KiB/s wr, 159 op/s 2024-09-19T09:11:29.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:28 smithi167 ceph-mon[35359]: pgmap v780: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 1016 KiB/s wr, 159 op/s 2024-09-19T09:11:29.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.123+0000 7f1f5d2c9640 1 -- 172.21.15.92:0/4258706239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f580ffe10 msgr2=0x7f1f58100210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:29.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.123+0000 7f1f5d2c9640 1 --2- 172.21.15.92:0/4258706239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f580ffe10 0x7f1f58100210 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f1f48009900 tx=0x7f1f4802a3f0 comp rx=0 tx=0).stop 2024-09-19T09:11:29.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.123+0000 7f1f5d2c9640 1 -- 172.21.15.92:0/4258706239 shutdown_connections 2024-09-19T09:11:29.125 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.123+0000 7f1f5d2c9640 1 --2- 172.21.15.92:0/4258706239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f581037a0 0x7f1f5810a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:29.125 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.123+0000 7f1f5d2c9640 1 --2- 172.21.15.92:0/4258706239 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1f58102de0 0x7f1f58103260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:29.125 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.123+0000 7f1f5d2c9640 1 --2- 172.21.15.92:0/4258706239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f580ffe10 0x7f1f58100210 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:29.125 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.123+0000 7f1f5d2c9640 1 -- 172.21.15.92:0/4258706239 >> 172.21.15.92:0/4258706239 conn(0x7f1f580fb930 msgr2=0x7f1f580fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:29.125 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.123+0000 7f1f5d2c9640 1 -- 172.21.15.92:0/4258706239 shutdown_connections 2024-09-19T09:11:29.125 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.123+0000 7f1f5d2c9640 1 -- 172.21.15.92:0/4258706239 wait complete. 2024-09-19T09:11:29.126 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:28 smithi190 ceph-mon[35358]: pgmap v780: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 1016 KiB/s wr, 159 op/s 2024-09-19T09:11:29.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.124+0000 7f1f5d2c9640 1 Processor -- start 2024-09-19T09:11:29.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.124+0000 7f1f5d2c9640 1 -- start start 2024-09-19T09:11:29.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.125+0000 7f1f5d2c9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1f580ffe10 0x7f1f58197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:29.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.125+0000 7f1f5d2c9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f58102de0 0x7f1f581982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:29.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.125+0000 7f1f5d2c9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f581037a0 0x7f1f5819f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:29.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.125+0000 7f1f5d2c9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5810d7e0 con 0x7f1f58102de0 2024-09-19T09:11:29.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.125+0000 7f1f5d2c9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5810d660 con 0x7f1f581037a0 2024-09-19T09:11:29.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.125+0000 7f1f5d2c9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5810d960 con 0x7f1f580ffe10 2024-09-19T09:11:29.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.125+0000 7f1f4e7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f58102de0 0x7f1f581982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:29.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.125+0000 7f1f4e7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f58102de0 0x7f1f581982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53988/0 (socket says 172.21.15.92:53988) 2024-09-19T09:11:29.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.125+0000 7f1f4e7fc640 1 -- 172.21.15.92:0/1688629352 learned_addr learned my addr 172.21.15.92:0/1688629352 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:29.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.125+0000 7f1f56ffd640 1 --2- 172.21.15.92:0/1688629352 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1f580ffe10 0x7f1f58197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:29.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.125+0000 7f1f577fe640 1 --2- 172.21.15.92:0/1688629352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f581037a0 0x7f1f5819f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:29.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.125+0000 7f1f4e7fc640 1 -- 172.21.15.92:0/1688629352 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1f580ffe10 msgr2=0x7f1f58197da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:29.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.125+0000 7f1f4e7fc640 1 --2- 172.21.15.92:0/1688629352 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1f580ffe10 0x7f1f58197da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:29.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.125+0000 7f1f4e7fc640 1 -- 172.21.15.92:0/1688629352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f581037a0 msgr2=0x7f1f5819f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:29.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.125+0000 7f1f4e7fc640 1 --2- 172.21.15.92:0/1688629352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f581037a0 0x7f1f5819f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:29.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.125+0000 7f1f4e7fc640 1 -- 172.21.15.92:0/1688629352 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5819f9b0 con 0x7f1f58102de0 2024-09-19T09:11:29.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.125+0000 7f1f577fe640 1 --2- 172.21.15.92:0/1688629352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f581037a0 0x7f1f5819f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:11:29.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.125+0000 7f1f4e7fc640 1 --2- 172.21.15.92:0/1688629352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f58102de0 0x7f1f581982e0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f1f4000d770 tx=0x7f1f4000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:29.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.125+0000 7f1f54ff9640 1 -- 172.21.15.92:0/1688629352 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f40017070 con 0x7f1f58102de0 2024-09-19T09:11:29.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.125+0000 7f1f5d2c9640 1 -- 172.21.15.92:0/1688629352 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f5819fca0 con 0x7f1f58102de0 2024-09-19T09:11:29.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.125+0000 7f1f54ff9640 1 -- 172.21.15.92:0/1688629352 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f40005500 con 0x7f1f58102de0 2024-09-19T09:11:29.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.125+0000 7f1f54ff9640 1 -- 172.21.15.92:0/1688629352 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f40004e00 con 0x7f1f58102de0 2024-09-19T09:11:29.130 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.125+0000 7f1f5d2c9640 1 -- 172.21.15.92:0/1688629352 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f581a01a0 con 0x7f1f58102de0 2024-09-19T09:11:29.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.128+0000 7f1f54ff9640 1 -- 172.21.15.92:0/1688629352 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1f40004fa0 con 0x7f1f58102de0 2024-09-19T09:11:29.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.128+0000 7f1f6005f740 1 Processor -- start 2024-09-19T09:11:29.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.128+0000 7f1f6005f740 1 -- start start 2024-09-19T09:11:29.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.129+0000 7f1f6005f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e54d37db0 0x556e54d381b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:29.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.129+0000 7f1f6005f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e54d386f0 0x556e54d3d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:29.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.129+0000 7f1f6005f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e54d3d780 0x556e54d3fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:29.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.129+0000 7f1f6005f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556e54c972f0 con 0x556e54d386f0 2024-09-19T09:11:29.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.129+0000 7f1f6005f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556e54c3f270 con 0x556e54d3d780 2024-09-19T09:11:29.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.129+0000 7f1f6005f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x556e54c932b0 con 0x556e54d37db0 2024-09-19T09:11:29.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.129+0000 7f1f56ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e54d386f0 0x556e54d3d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:29.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.129+0000 7f1f56ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e54d386f0 0x556e54d3d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53998/0 (socket says 172.21.15.92:53998) 2024-09-19T09:11:29.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.129+0000 7f1f56ffd640 1 -- 172.21.15.92:0/2308467967 learned_addr learned my addr 172.21.15.92:0/2308467967 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:29.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.129+0000 7f1f577fe640 1 --2- 172.21.15.92:0/2308467967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e54d37db0 0x556e54d381b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:29.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.129+0000 7f1f4e7fc640 1 --2- 172.21.15.92:0/2308467967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e54d3d780 0x556e54d3fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:29.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.129+0000 7f1f56ffd640 1 -- 172.21.15.92:0/2308467967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e54d37db0 msgr2=0x556e54d381b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:29.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.129+0000 7f1f56ffd640 1 --2- 172.21.15.92:0/2308467967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e54d37db0 0x556e54d381b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:29.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.129+0000 7f1f56ffd640 1 -- 172.21.15.92:0/2308467967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e54d3d780 msgr2=0x556e54d3fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:29.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.129+0000 7f1f56ffd640 1 --2- 172.21.15.92:0/2308467967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e54d3d780 0x556e54d3fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:29.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.129+0000 7f1f56ffd640 1 -- 172.21.15.92:0/2308467967 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e54c3e340 con 0x556e54d386f0 2024-09-19T09:11:29.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.129+0000 7f1f4e7fc640 1 --2- 172.21.15.92:0/2308467967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e54d3d780 0x556e54d3fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:11:29.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.129+0000 7f1f54ff9640 1 --2- 172.21.15.92:0/1688629352 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1f440a32f0 0x7f1f440a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:29.138 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.129+0000 7f1f56ffd640 1 --2- 172.21.15.92:0/2308467967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e54d386f0 0x556e54d3d1b0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f1f48031440 tx=0x7f1f48032d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6803a5616eb0659f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:29.138 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.129+0000 7f1f577fe640 1 --2- 172.21.15.92:0/1688629352 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1f440a32f0 0x7f1f440a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:29.138 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.129+0000 7f1f54ff9640 1 -- 172.21.15.92:0/1688629352 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1f400cf510 con 0x7f1f58102de0 2024-09-19T09:11:29.138 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.129+0000 7f1f4d7fa640 1 -- 172.21.15.92:0/2308467967 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4803f070 con 0x556e54d386f0 2024-09-19T09:11:29.138 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.130+0000 7f1f4d7fa640 1 -- 172.21.15.92:0/2308467967 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f480318b0 con 0x556e54d386f0 2024-09-19T09:11:29.138 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.130+0000 7f1f4d7fa640 1 -- 172.21.15.92:0/2308467967 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f48035070 con 0x556e54d386f0 2024-09-19T09:11:29.138 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.130+0000 7f1f6005f740 1 -- 172.21.15.92:0/2308467967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e54d386f0 msgr2=0x556e54d3d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:29.138 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.130+0000 7f1f577fe640 1 --2- 172.21.15.92:0/1688629352 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1f440a32f0 0x7f1f440a57b0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1f50007f90 tx=0x7f1f50007720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:29.138 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.130+0000 7f1f6005f740 1 --2- 172.21.15.92:0/2308467967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e54d386f0 0x556e54d3d1b0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f1f48031440 tx=0x7f1f48032d20 comp rx=0 tx=0).stop 2024-09-19T09:11:29.138 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.130+0000 7f1f6005f740 1 -- 172.21.15.92:0/2308467967 shutdown_connections 2024-09-19T09:11:29.138 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.130+0000 7f1f6005f740 1 --2- 172.21.15.92:0/2308467967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e54d3d780 0x556e54d3fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:29.138 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.130+0000 7f1f6005f740 1 --2- 172.21.15.92:0/2308467967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e54d386f0 0x556e54d3d1b0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:29.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.130+0000 7f1f6005f740 1 --2- 172.21.15.92:0/2308467967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e54d37db0 0x556e54d381b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:29.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.130+0000 7f1f6005f740 1 -- 172.21.15.92:0/2308467967 >> 172.21.15.92:0/2308467967 conn(0x556e54d2f010 msgr2=0x556e54d2f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:29.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.130+0000 7f1f6005f740 1 -- 172.21.15.92:0/2308467967 shutdown_connections 2024-09-19T09:11:29.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.130+0000 7f1f6005f740 1 -- 172.21.15.92:0/2308467967 wait complete. 2024-09-19T09:11:29.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.131+0000 7f1f6005f740 1 -- start start 2024-09-19T09:11:29.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.131+0000 7f1f6005f740 1 Processor -- start 2024-09-19T09:11:29.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.131+0000 7f1f6005f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e54d37db0 0x556e54d41f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:29.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.131+0000 7f1f6005f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e54d386f0 0x556e54d424b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:29.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.131+0000 7f1f6005f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e54d3d780 0x556e54d494f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:29.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.131+0000 7f1f6005f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556e54d406f0 con 0x556e54d3d780 2024-09-19T09:11:29.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.131+0000 7f1f6005f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556e54c20290 con 0x556e54d386f0 2024-09-19T09:11:29.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.131+0000 7f1f6005f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x556e54d40870 con 0x556e54d37db0 2024-09-19T09:11:29.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.131+0000 7f1f6005f740 10 client.0 _ll_register_callbacks cb 0x556e54c51140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:11:29.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.131+0000 7f1f577fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e54d3d780 0x556e54d494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:29.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.131+0000 7f1f577fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e54d3d780 0x556e54d494f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54010/0 (socket says 172.21.15.92:54010) 2024-09-19T09:11:29.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.131+0000 7f1f577fe640 1 -- 172.21.15.92:0/3095743847 learned_addr learned my addr 172.21.15.92:0/3095743847 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:29.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.131+0000 7f1f56ffd640 1 --2- 172.21.15.92:0/3095743847 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e54d37db0 0x556e54d41f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:29.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.131+0000 7f1f4e7fc640 1 --2- 172.21.15.92:0/3095743847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e54d386f0 0x556e54d424b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:29.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.131+0000 7f1f577fe640 1 -- 172.21.15.92:0/3095743847 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e54d37db0 msgr2=0x556e54d41f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:29.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.131+0000 7f1f577fe640 1 --2- 172.21.15.92:0/3095743847 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e54d37db0 0x556e54d41f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:29.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.131+0000 7f1f577fe640 1 -- 172.21.15.92:0/3095743847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e54d386f0 msgr2=0x556e54d424b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:29.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.131+0000 7f1f577fe640 1 --2- 172.21.15.92:0/3095743847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e54d386f0 0x556e54d424b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:29.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.131+0000 7f1f577fe640 1 -- 172.21.15.92:0/3095743847 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e549aa210 con 0x556e54d3d780 2024-09-19T09:11:29.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.132+0000 7f1f577fe640 1 --2- 172.21.15.92:0/3095743847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e54d3d780 0x556e54d494f0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f1f5000fe80 tx=0x7f1f50004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e7217bc6f3e0fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:29.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.132+0000 7f1f3e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:11:29.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.132+0000 7f1f3e7fc640 1 -- 172.21.15.92:0/3095743847 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5000ec30 con 0x556e54d3d780 2024-09-19T09:11:29.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.132+0000 7f1f6005f740 1 -- 172.21.15.92:0/3095743847 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f480318b0 con 0x556e54d3d780 2024-09-19T09:11:29.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.132+0000 7f1f3e7fc640 1 -- 172.21.15.92:0/3095743847 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1f5000edd0 con 0x556e54d3d780 2024-09-19T09:11:29.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.132+0000 7f1f3e7fc640 1 -- 172.21.15.92:0/3095743847 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1f50026430 con 0x556e54d3d780 2024-09-19T09:11:29.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.132+0000 7f1f6005f740 10 client.18888 fetch_fsmap learned FSMap version 19 2024-09-19T09:11:29.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.132+0000 7f1f6005f740 1 -- 172.21.15.92:0/3095743847 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x556e54a76620 con 0x556e54d3d780 2024-09-19T09:11:29.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.132+0000 7f1f3e7fc640 1 -- 172.21.15.92:0/3095743847 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f480318b0 con 0x556e54d3d780 2024-09-19T09:11:29.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.132+0000 7f1f3e7fc640 1 -- 172.21.15.92:0/3095743847 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1f5001d640 con 0x556e54d3d780 2024-09-19T09:11:29.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.132+0000 7f1f6005f740 10 client.18888 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:11:29.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.132+0000 7f1f6005f740 10 client.18888 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:11:29.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.132+0000 7f1f6005f740 20 client.18888 populate_metadata read hostname 'smithi092' 2024-09-19T09:11:29.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.132+0000 7f1f6005f740 1 --2- 172.21.15.92:0/3095743847 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556e54d4dc70 0x556e54d50060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:29.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.132+0000 7f1f6005f740 4 client.18888 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:11:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.132+0000 7f1f6005f740 1 -- 172.21.15.92:0/3095743847 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556e54ca4a20 con 0x556e54d4dc70 2024-09-19T09:11:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.133+0000 7f1f56ffd640 1 --2- 172.21.15.92:0/3095743847 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556e54d4dc70 0x556e54d50060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.133+0000 7f1f3e7fc640 10 client.18888 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.133+0000 7f1f56ffd640 1 --2- 172.21.15.92:0/3095743847 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556e54d4dc70 0x556e54d50060 crc :-1 s=READY pgs=442 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=674a5f77ea5bb2e2 server_cookie=437f91084a185025 in_seq=0 out_seq=0 2024-09-19T09:11:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.134+0000 7f1f3e7fc640 1 -- 172.21.15.92:0/3095743847 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556e54ca4a20 con 0x556e54d4dc70 2024-09-19T09:11:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.134+0000 7f1f3e7fc640 10 client.18888 handle_command_reply: tid=0 2024-09-19T09:11:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.134+0000 7f1f6005f740 1 client.18888 shutdown 2024-09-19T09:11:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.134+0000 7f1f6005f740 1 -- 172.21.15.92:0/3095743847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e54d3d780 msgr2=0x556e54d494f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.134+0000 7f1f6005f740 1 --2- 172.21.15.92:0/3095743847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e54d3d780 0x556e54d494f0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f1f5000fe80 tx=0x7f1f50004a40 comp rx=0 tx=0).stop 2024-09-19T09:11:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.134+0000 7f1f6005f740 1 -- 172.21.15.92:0/3095743847 shutdown_connections 2024-09-19T09:11:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.134+0000 7f1f6005f740 1 --2- 172.21.15.92:0/3095743847 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556e54d4dc70 0x556e54d50060 crc :-1 s=READY pgs=442 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.134+0000 7f1f6005f740 1 --2- 172.21.15.92:0/3095743847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e54d3d780 0x556e54d494f0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.134+0000 7f1f3e7fc640 0 client.18888 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.134+0000 7f1f6005f740 1 --2- 172.21.15.92:0/3095743847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e54d386f0 0x556e54d424b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.134+0000 7f1f6005f740 1 --2- 172.21.15.92:0/3095743847 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e54d37db0 0x556e54d41f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.134+0000 7f1f6005f740 1 -- 172.21.15.92:0/3095743847 >> 172.21.15.92:0/3095743847 conn(0x556e54d2f010 msgr2=0x556e54d30820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.134+0000 7f1f6005f740 1 -- 172.21.15.92:0/3095743847 shutdown_connections 2024-09-19T09:11:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.134+0000 7f1f6005f740 1 -- 172.21.15.92:0/3095743847 wait complete. 2024-09-19T09:11:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.134+0000 7f1f6005f740 20 client.18888 trim_cache size 0 max 16384 2024-09-19T09:11:29.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.148+0000 7f1f6005f740 1 Processor -- start 2024-09-19T09:11:29.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.148+0000 7f1f6005f740 1 -- start start 2024-09-19T09:11:29.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.149+0000 7f1f6005f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e54d37db0 0x556e54d2d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:29.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.149+0000 7f1f6005f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e54d386f0 0x556e54d494b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:29.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.149+0000 7f1f6005f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e54d3d780 0x556e54d2dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.149+0000 7f1f6005f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1f581a4c40 con 0x556e54d3d780 2024-09-19T09:11:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.149+0000 7f1f6005f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1f581a74e0 con 0x556e54d37db0 2024-09-19T09:11:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.149+0000 7f1f6005f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1f581a52d0 con 0x556e54d386f0 2024-09-19T09:11:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.149+0000 7f1f577fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e54d3d780 0x556e54d2dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.149+0000 7f1f577fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e54d3d780 0x556e54d2dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54026/0 (socket says 172.21.15.92:54026) 2024-09-19T09:11:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.149+0000 7f1f577fe640 1 -- 172.21.15.92:0/1361650893 learned_addr learned my addr 172.21.15.92:0/1361650893 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.149+0000 7f1f56ffd640 1 --2- 172.21.15.92:0/1361650893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e54d37db0 0x556e54d2d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.149+0000 7f1f4e7fc640 1 --2- 172.21.15.92:0/1361650893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e54d386f0 0x556e54d494b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.149+0000 7f1f577fe640 1 -- 172.21.15.92:0/1361650893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e54d386f0 msgr2=0x556e54d494b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.149+0000 7f1f577fe640 1 --2- 172.21.15.92:0/1361650893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e54d386f0 0x556e54d494b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.149+0000 7f1f577fe640 1 -- 172.21.15.92:0/1361650893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e54d37db0 msgr2=0x556e54d2d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.149+0000 7f1f577fe640 1 --2- 172.21.15.92:0/1361650893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e54d37db0 0x556e54d2d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.149+0000 7f1f577fe640 1 -- 172.21.15.92:0/1361650893 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e54d38bd0 con 0x556e54d3d780 2024-09-19T09:11:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.149+0000 7f1f4e7fc640 1 --2- 172.21.15.92:0/1361650893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e54d386f0 0x556e54d494b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:11:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.149+0000 7f1f577fe640 1 --2- 172.21.15.92:0/1361650893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e54d3d780 0x556e54d2dee0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f1f5001dae0 tx=0x7f1f5000e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=576fa815694af700 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.149+0000 7f1f4cff9640 1 -- 172.21.15.92:0/1361650893 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f50004d70 con 0x556e54d3d780 2024-09-19T09:11:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.149+0000 7f1f4cff9640 1 -- 172.21.15.92:0/1361650893 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f50034070 con 0x556e54d3d780 2024-09-19T09:11:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.149+0000 7f1f4cff9640 1 -- 172.21.15.92:0/1361650893 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f500269b0 con 0x556e54d3d780 2024-09-19T09:11:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.150+0000 7f1f6005f740 1 -- 172.21.15.92:0/1361650893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e54d3d780 msgr2=0x556e54d2dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.150+0000 7f1f6005f740 1 --2- 172.21.15.92:0/1361650893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e54d3d780 0x556e54d2dee0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f1f5001dae0 tx=0x7f1f5000e820 comp rx=0 tx=0).stop 2024-09-19T09:11:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.150+0000 7f1f6005f740 1 -- 172.21.15.92:0/1361650893 shutdown_connections 2024-09-19T09:11:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.150+0000 7f1f6005f740 1 --2- 172.21.15.92:0/1361650893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e54d3d780 0x556e54d2dee0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.150+0000 7f1f6005f740 1 --2- 172.21.15.92:0/1361650893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e54d386f0 0x556e54d494b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.150+0000 7f1f6005f740 1 --2- 172.21.15.92:0/1361650893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e54d37db0 0x556e54d2d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.150+0000 7f1f6005f740 1 -- 172.21.15.92:0/1361650893 >> 172.21.15.92:0/1361650893 conn(0x556e54d2f010 msgr2=0x556e54d41f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.150+0000 7f1f6005f740 1 -- 172.21.15.92:0/1361650893 shutdown_connections 2024-09-19T09:11:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.150+0000 7f1f6005f740 1 -- 172.21.15.92:0/1361650893 wait complete. 2024-09-19T09:11:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.150+0000 7f1f6005f740 1 -- start start 2024-09-19T09:11:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.151+0000 7f1f6005f740 1 Processor -- start 2024-09-19T09:11:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.151+0000 7f1f6005f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e54d37db0 0x556e54d46e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.151+0000 7f1f6005f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e54d386f0 0x556e54d473d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.151+0000 7f1f6005f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e54d3d780 0x556e54d483e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.151+0000 7f1f6005f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1f581a59a0 con 0x556e54d37db0 2024-09-19T09:11:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.151+0000 7f1f6005f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1f581a6e10 con 0x556e54d3d780 2024-09-19T09:11:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.151+0000 7f1f6005f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1f581a6070 con 0x556e54d386f0 2024-09-19T09:11:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.151+0000 7f1f6005f740 10 client.0 _ll_register_callbacks cb 0x7f1f5000fb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:11:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.151+0000 7f1f56ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e54d37db0 0x556e54d46e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.151+0000 7f1f56ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e54d37db0 0x556e54d46e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54038/0 (socket says 172.21.15.92:54038) 2024-09-19T09:11:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.151+0000 7f1f56ffd640 1 -- 172.21.15.92:0/3029586545 learned_addr learned my addr 172.21.15.92:0/3029586545 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.151+0000 7f1f56ffd640 1 -- 172.21.15.92:0/3029586545 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e54d386f0 msgr2=0x556e54d473d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.151+0000 7f1f56ffd640 1 --2- 172.21.15.92:0/3029586545 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e54d386f0 0x556e54d473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.151+0000 7f1f56ffd640 1 -- 172.21.15.92:0/3029586545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e54d3d780 msgr2=0x556e54d483e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.151+0000 7f1f56ffd640 1 --2- 172.21.15.92:0/3029586545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e54d3d780 0x556e54d483e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.151+0000 7f1f56ffd640 1 -- 172.21.15.92:0/3029586545 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e54d489f0 con 0x556e54d37db0 2024-09-19T09:11:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.151+0000 7f1f56ffd640 1 --2- 172.21.15.92:0/3029586545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e54d37db0 0x556e54d46e90 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f1f480314e0 tx=0x7f1f48032f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe703003750382a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:29.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.151+0000 7f1f3e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:11:29.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.151+0000 7f1f3e7fc640 1 -- 172.21.15.92:0/3029586545 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f48052070 con 0x556e54d37db0 2024-09-19T09:11:29.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.151+0000 7f1f3e7fc640 1 -- 172.21.15.92:0/3029586545 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1f48004230 con 0x556e54d37db0 2024-09-19T09:11:29.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.151+0000 7f1f6005f740 1 -- 172.21.15.92:0/3029586545 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f50034070 con 0x556e54d37db0 2024-09-19T09:11:29.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.152+0000 7f1f3e7fc640 1 -- 172.21.15.92:0/3029586545 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1f4805e050 con 0x556e54d37db0 2024-09-19T09:11:29.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.152+0000 7f1f6005f740 10 client.18894 fetch_fsmap learned FSMap version 19 2024-09-19T09:11:29.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.152+0000 7f1f6005f740 1 -- 172.21.15.92:0/3029586545 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x556e54db8c90 con 0x556e54d37db0 2024-09-19T09:11:29.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.152+0000 7f1f3e7fc640 1 -- 172.21.15.92:0/3029586545 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f50034070 con 0x556e54d37db0 2024-09-19T09:11:29.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.152+0000 7f1f3e7fc640 1 -- 172.21.15.92:0/3029586545 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1f4804e560 con 0x556e54d37db0 2024-09-19T09:11:29.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.152+0000 7f1f6005f740 10 client.18894 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:11:29.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.152+0000 7f1f6005f740 10 client.18894 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:11:29.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.152+0000 7f1f6005f740 20 client.18894 populate_metadata read hostname 'smithi092' 2024-09-19T09:11:29.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.152+0000 7f1f6005f740 1 --2- 172.21.15.92:0/3029586545 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556e54db9260 0x556e54dbb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:29.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.152+0000 7f1f6005f740 4 client.18894 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:11:29.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.152+0000 7f1f6005f740 1 -- 172.21.15.92:0/3029586545 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556e54c9ed70 con 0x556e54db9260 2024-09-19T09:11:29.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.152+0000 7f1f4e7fc640 1 --2- 172.21.15.92:0/3029586545 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556e54db9260 0x556e54dbb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:29.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.153+0000 7f1f4e7fc640 1 --2- 172.21.15.92:0/3029586545 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556e54db9260 0x556e54dbb670 crc :-1 s=READY pgs=443 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8877fcfcd926ae1 server_cookie=4dbb31c6c2964d35 in_seq=0 out_seq=0 2024-09-19T09:11:29.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.153+0000 7f1f3e7fc640 10 client.18894 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:29.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.166+0000 7f1f3e7fc640 1 -- 172.21.15.92:0/3029586545 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556e54c9ed70 con 0x556e54db9260 2024-09-19T09:11:29.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.166+0000 7f1f3e7fc640 10 client.18894 handle_command_reply: tid=0 2024-09-19T09:11:29.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.166+0000 7f1f6005f740 1 client.18894 shutdown 2024-09-19T09:11:29.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.166+0000 7f1f6005f740 1 -- 172.21.15.92:0/3029586545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e54d37db0 msgr2=0x556e54d46e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:29.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.166+0000 7f1f6005f740 1 --2- 172.21.15.92:0/3029586545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e54d37db0 0x556e54d46e90 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f1f480314e0 tx=0x7f1f48032f80 comp rx=0 tx=0).stop 2024-09-19T09:11:29.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.167+0000 7f1f6005f740 1 -- 172.21.15.92:0/3029586545 shutdown_connections 2024-09-19T09:11:29.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.167+0000 7f1f6005f740 1 --2- 172.21.15.92:0/3029586545 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x556e54db9260 0x556e54dbb670 crc :-1 s=READY pgs=443 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:29.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.167+0000 7f1f6005f740 1 --2- 172.21.15.92:0/3029586545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556e54d3d780 0x556e54d483e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:29.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.167+0000 7f1f6005f740 1 --2- 172.21.15.92:0/3029586545 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556e54d386f0 0x556e54d473d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:29.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.167+0000 7f1f6005f740 1 --2- 172.21.15.92:0/3029586545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e54d37db0 0x556e54d46e90 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:29.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.167+0000 7f1f3e7fc640 0 client.18894 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:29.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.167+0000 7f1f6005f740 1 -- 172.21.15.92:0/3029586545 >> 172.21.15.92:0/3029586545 conn(0x556e54d2f010 msgr2=0x556e54d2fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:29.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.167+0000 7f1f6005f740 1 -- 172.21.15.92:0/3029586545 shutdown_connections 2024-09-19T09:11:29.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.167+0000 7f1f6005f740 1 -- 172.21.15.92:0/3029586545 wait complete. 2024-09-19T09:11:29.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.167+0000 7f1f6005f740 20 client.18894 trim_cache size 0 max 16384 2024-09-19T09:11:29.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:11:29.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:11:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:11:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:11:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.167+0000 7f1f5d2c9640 1 -- 172.21.15.92:0/1688629352 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1f440a32f0 msgr2=0x7f1f440a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.167+0000 7f1f5d2c9640 1 --2- 172.21.15.92:0/1688629352 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1f440a32f0 0x7f1f440a57b0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1f50007f90 tx=0x7f1f50007720 comp rx=0 tx=0).stop 2024-09-19T09:11:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.167+0000 7f1f5d2c9640 1 -- 172.21.15.92:0/1688629352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f58102de0 msgr2=0x7f1f581982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.167+0000 7f1f5d2c9640 1 --2- 172.21.15.92:0/1688629352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f58102de0 0x7f1f581982e0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f1f4000d770 tx=0x7f1f4000dc30 comp rx=0 tx=0).stop 2024-09-19T09:11:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.167+0000 7f1f5d2c9640 1 -- 172.21.15.92:0/1688629352 shutdown_connections 2024-09-19T09:11:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.167+0000 7f1f5d2c9640 1 --2- 172.21.15.92:0/1688629352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f581037a0 0x7f1f5819f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.167+0000 7f1f5d2c9640 1 --2- 172.21.15.92:0/1688629352 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1f440a32f0 0x7f1f440a57b0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.167+0000 7f1f5d2c9640 1 --2- 172.21.15.92:0/1688629352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f58102de0 0x7f1f581982e0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.167+0000 7f1f5d2c9640 1 --2- 172.21.15.92:0/1688629352 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1f580ffe10 0x7f1f58197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.167+0000 7f1f5d2c9640 1 -- 172.21.15.92:0/1688629352 >> 172.21.15.92:0/1688629352 conn(0x7f1f580fb930 msgr2=0x7f1f58106130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.167+0000 7f1f5d2c9640 1 -- 172.21.15.92:0/1688629352 shutdown_connections 2024-09-19T09:11:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:29.167+0000 7f1f5d2c9640 1 -- 172.21.15.92:0/1688629352 wait complete. 2024-09-19T09:11:30.800 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:11:31.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:30 smithi092 ceph-mon[31407]: pgmap v781: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 1.0 MiB/s wr, 126 op/s 2024-09-19T09:11:31.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:30 smithi167 ceph-mon[35359]: pgmap v781: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 1.0 MiB/s wr, 126 op/s 2024-09-19T09:11:31.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:30 smithi190 ceph-mon[35358]: pgmap v781: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 1.0 MiB/s wr, 126 op/s 2024-09-19T09:11:33.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:32 smithi092 ceph-mon[31407]: pgmap v782: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 520 KiB/s wr, 41 op/s 2024-09-19T09:11:33.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:32 smithi167 ceph-mon[35359]: pgmap v782: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 520 KiB/s wr, 41 op/s 2024-09-19T09:11:33.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:32 smithi190 ceph-mon[35358]: pgmap v782: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 520 KiB/s wr, 41 op/s 2024-09-19T09:11:34.120 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:11:34.372 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:11:34.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:34 smithi092 ceph-mon[31407]: pgmap v783: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6.1 MiB/s wr, 197 op/s 2024-09-19T09:11:34.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.885+0000 7f677816d640 1 -- 172.21.15.92:0/3156234776 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67700747f0 msgr2=0x7f6770074bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:34.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.885+0000 7f677816d640 1 --2- 172.21.15.92:0/3156234776 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67700747f0 0x7f6770074bd0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f676c009860 tx=0x7f676c02a340 comp rx=0 tx=0).stop 2024-09-19T09:11:34.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.885+0000 7f677816d640 1 -- 172.21.15.92:0/3156234776 shutdown_connections 2024-09-19T09:11:34.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.885+0000 7f677816d640 1 --2- 172.21.15.92:0/3156234776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f677010e480 0x7f67701108b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:34.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.885+0000 7f677816d640 1 --2- 172.21.15.92:0/3156234776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6770075110 0x7f677010deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:34.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.885+0000 7f677816d640 1 --2- 172.21.15.92:0/3156234776 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67700747f0 0x7f6770074bd0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:34.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.885+0000 7f677816d640 1 -- 172.21.15.92:0/3156234776 >> 172.21.15.92:0/3156234776 conn(0x7f67700fd8d0 msgr2=0x7f67700ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:34.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.885+0000 7f677816d640 1 -- 172.21.15.92:0/3156234776 shutdown_connections 2024-09-19T09:11:34.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.885+0000 7f677816d640 1 -- 172.21.15.92:0/3156234776 wait complete. 2024-09-19T09:11:34.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.886+0000 7f677816d640 1 Processor -- start 2024-09-19T09:11:34.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.886+0000 7f677816d640 1 -- start start 2024-09-19T09:11:34.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.886+0000 7f677816d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67700747f0 0x7f677019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:34.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.886+0000 7f677816d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6770075110 0x7f677019ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:34.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.886+0000 7f677816d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f677010e480 0x7f677019efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:34.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.886+0000 7f677816d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6770114210 con 0x7f67700747f0 2024-09-19T09:11:34.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.886+0000 7f677816d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6770114090 con 0x7f677010e480 2024-09-19T09:11:34.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.886+0000 7f677816d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6770114390 con 0x7f6770075110 2024-09-19T09:11:34.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.887+0000 7f6775f09640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67700747f0 0x7f677019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:34.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.887+0000 7f6775708640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6770075110 0x7f677019ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:34.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.887+0000 7f6775708640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6770075110 0x7f677019ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:42028/0 (socket says 172.21.15.92:42028) 2024-09-19T09:11:34.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.887+0000 7f6775f09640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67700747f0 0x7f677019a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57602/0 (socket says 172.21.15.92:57602) 2024-09-19T09:11:34.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.887+0000 7f677670a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f677010e480 0x7f677019efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:34.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.887+0000 7f6775708640 1 -- 172.21.15.92:0/361211627 learned_addr learned my addr 172.21.15.92:0/361211627 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:34.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.887+0000 7f6775708640 1 -- 172.21.15.92:0/361211627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f677010e480 msgr2=0x7f677019efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:34.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.887+0000 7f6775708640 1 --2- 172.21.15.92:0/361211627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f677010e480 0x7f677019efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:34.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.887+0000 7f6775708640 1 -- 172.21.15.92:0/361211627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67700747f0 msgr2=0x7f677019a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:34.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.887+0000 7f6775708640 1 --2- 172.21.15.92:0/361211627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67700747f0 0x7f677019a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:34.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.887+0000 7f6775708640 1 -- 172.21.15.92:0/361211627 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f677019f6a0 con 0x7f6770075110 2024-09-19T09:11:34.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.887+0000 7f6775708640 1 --2- 172.21.15.92:0/361211627 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6770075110 0x7f677019ac30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f676000d950 tx=0x7f676000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:34.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.887+0000 7f6766ffd640 1 -- 172.21.15.92:0/361211627 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6760017070 con 0x7f6770075110 2024-09-19T09:11:34.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.887+0000 7f6766ffd640 1 -- 172.21.15.92:0/361211627 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6760009c30 con 0x7f6770075110 2024-09-19T09:11:34.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.887+0000 7f677816d640 1 -- 172.21.15.92:0/361211627 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f677019f990 con 0x7f6770075110 2024-09-19T09:11:34.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.887+0000 7f6766ffd640 1 -- 172.21.15.92:0/361211627 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676000f6b0 con 0x7f6770075110 2024-09-19T09:11:34.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.887+0000 7f677816d640 1 -- 172.21.15.92:0/361211627 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67701a7270 con 0x7f6770075110 2024-09-19T09:11:34.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.888+0000 7f677816d640 1 -- 172.21.15.92:0/361211627 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6770074bd0 con 0x7f6770075110 2024-09-19T09:11:34.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.890+0000 7f6766ffd640 1 -- 172.21.15.92:0/361211627 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f67600109d0 con 0x7f6770075110 2024-09-19T09:11:34.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.891+0000 7f6766ffd640 1 --2- 172.21.15.92:0/361211627 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f675c0a32c0 0x7f675c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:34.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.891+0000 7f6775f09640 1 --2- 172.21.15.92:0/361211627 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f675c0a32c0 0x7f675c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:34.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.891+0000 7f6766ffd640 1 -- 172.21.15.92:0/361211627 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f67600cf450 con 0x7f6770075110 2024-09-19T09:11:34.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.891+0000 7f6775f09640 1 --2- 172.21.15.92:0/361211627 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f675c0a32c0 0x7f675c0a5780 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f676c02a930 tx=0x7f676c0056d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:34.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:34.895+0000 7f6766ffd640 1 -- 172.21.15.92:0/361211627 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6760009de0 con 0x7f6770075110 2024-09-19T09:11:35.104 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:34 smithi167 ceph-mon[35359]: pgmap v783: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6.1 MiB/s wr, 197 op/s 2024-09-19T09:11:35.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:35.111+0000 7f677816d640 1 -- 172.21.15.92:0/361211627 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6770108fe0 con 0x7f6770075110 2024-09-19T09:11:35.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:35.112+0000 7f6766ffd640 1 -- 172.21.15.92:0/361211627 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f676009bb20 con 0x7f6770075110 2024-09-19T09:11:35.113 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:11:35.113 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:11:35.113 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:11:35.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:35.115+0000 7f677816d640 1 -- 172.21.15.92:0/361211627 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f675c0a32c0 msgr2=0x7f675c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:35.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:35.115+0000 7f677816d640 1 --2- 172.21.15.92:0/361211627 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f675c0a32c0 0x7f675c0a5780 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f676c02a930 tx=0x7f676c0056d0 comp rx=0 tx=0).stop 2024-09-19T09:11:35.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:35.115+0000 7f677816d640 1 -- 172.21.15.92:0/361211627 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6770075110 msgr2=0x7f677019ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:35.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:35.115+0000 7f677816d640 1 --2- 172.21.15.92:0/361211627 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6770075110 0x7f677019ac30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f676000d950 tx=0x7f676000de10 comp rx=0 tx=0).stop 2024-09-19T09:11:35.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:35.115+0000 7f677816d640 1 -- 172.21.15.92:0/361211627 shutdown_connections 2024-09-19T09:11:35.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:35.115+0000 7f677816d640 1 --2- 172.21.15.92:0/361211627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f677010e480 0x7f677019efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:35.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:35.115+0000 7f677816d640 1 --2- 172.21.15.92:0/361211627 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6770075110 0x7f677019ac30 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:35.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:35.115+0000 7f677816d640 1 --2- 172.21.15.92:0/361211627 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f675c0a32c0 0x7f675c0a5780 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:35.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:35.115+0000 7f677816d640 1 --2- 172.21.15.92:0/361211627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67700747f0 0x7f677019a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:35.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:35.115+0000 7f677816d640 1 -- 172.21.15.92:0/361211627 >> 172.21.15.92:0/361211627 conn(0x7f67700fd8d0 msgr2=0x7f67700fe530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:35.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:35.115+0000 7f677816d640 1 -- 172.21.15.92:0/361211627 shutdown_connections 2024-09-19T09:11:35.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:35.115+0000 7f677816d640 1 -- 172.21.15.92:0/361211627 wait complete. 2024-09-19T09:11:35.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:34 smithi190 ceph-mon[35358]: pgmap v783: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6.1 MiB/s wr, 197 op/s 2024-09-19T09:11:35.800 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:35 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/361211627' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:11:35.800 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:11:35.828 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id 7b482bc7 --release --await' 2024-09-19T09:11:35.828 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id 7b482bc7 --release --await 2024-09-19T09:11:36.003 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:35 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/361211627' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:11:36.025 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:35 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/361211627' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:11:36.080 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:11:36.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.512+0000 7f3a22e19640 1 -- 172.21.15.92:0/4055969346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a1c102ef0 msgr2=0x7f3a1c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:36.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.512+0000 7f3a22e19640 1 --2- 172.21.15.92:0/4055969346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a1c102ef0 0x7f3a1c10da40 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f3a14009ca0 tx=0x7f3a1402a950 comp rx=0 tx=0).stop 2024-09-19T09:11:36.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.512+0000 7f3a22e19640 1 -- 172.21.15.92:0/4055969346 shutdown_connections 2024-09-19T09:11:36.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.512+0000 7f3a22e19640 1 --2- 172.21.15.92:0/4055969346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a1c102ef0 0x7f3a1c10da40 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:36.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.512+0000 7f3a22e19640 1 --2- 172.21.15.92:0/4055969346 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a1c102570 0x7f3a1c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:36.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.512+0000 7f3a22e19640 1 --2- 172.21.15.92:0/4055969346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a1c100e20 0x7f3a1c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:36.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.512+0000 7f3a22e19640 1 -- 172.21.15.92:0/4055969346 >> 172.21.15.92:0/4055969346 conn(0x7f3a1c0fc7d0 msgr2=0x7f3a1c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:36.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.512+0000 7f3a22e19640 1 -- 172.21.15.92:0/4055969346 shutdown_connections 2024-09-19T09:11:36.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.512+0000 7f3a22e19640 1 -- 172.21.15.92:0/4055969346 wait complete. 2024-09-19T09:11:36.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.512+0000 7f3a22e19640 1 Processor -- start 2024-09-19T09:11:36.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.513+0000 7f3a22e19640 1 -- start start 2024-09-19T09:11:36.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.513+0000 7f3a22e19640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a1c100e20 0x7f3a1c19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:36.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.513+0000 7f3a22e19640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a1c102570 0x7f3a1c19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:36.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.513+0000 7f3a22e19640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a1c102ef0 0x7f3a1c19ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:36.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.513+0000 7f3a22e19640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1c10fe80 con 0x7f3a1c102ef0 2024-09-19T09:11:36.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.513+0000 7f3a22e19640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1c10fd00 con 0x7f3a1c100e20 2024-09-19T09:11:36.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.513+0000 7f3a22e19640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1c110000 con 0x7f3a1c102570 2024-09-19T09:11:36.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.513+0000 7f3a213b6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a1c102ef0 0x7f3a1c19ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:36.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.513+0000 7f3a213b6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a1c102ef0 0x7f3a1c19ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57622/0 (socket says 172.21.15.92:57622) 2024-09-19T09:11:36.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.513+0000 7f3a213b6640 1 -- 172.21.15.92:0/3193100358 learned_addr learned my addr 172.21.15.92:0/3193100358 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:36.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.513+0000 7f3a13fff640 1 --2- 172.21.15.92:0/3193100358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a1c102570 0x7f3a1c19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:36.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.513+0000 7f3a20bb5640 1 --2- 172.21.15.92:0/3193100358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a1c100e20 0x7f3a1c19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:36.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.513+0000 7f3a213b6640 1 -- 172.21.15.92:0/3193100358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a1c102570 msgr2=0x7f3a1c19ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:36.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.513+0000 7f3a213b6640 1 --2- 172.21.15.92:0/3193100358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a1c102570 0x7f3a1c19ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:36.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.513+0000 7f3a213b6640 1 -- 172.21.15.92:0/3193100358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a1c100e20 msgr2=0x7f3a1c19a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:36.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.513+0000 7f3a213b6640 1 --2- 172.21.15.92:0/3193100358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a1c100e20 0x7f3a1c19a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:36.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.513+0000 7f3a213b6640 1 -- 172.21.15.92:0/3193100358 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a1c19f5f0 con 0x7f3a1c102ef0 2024-09-19T09:11:36.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.513+0000 7f3a213b6640 1 --2- 172.21.15.92:0/3193100358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a1c102ef0 0x7f3a1c19ef10 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f3a1402ae70 tx=0x7f3a1402f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:36.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.513+0000 7f3a11ffb640 1 -- 172.21.15.92:0/3193100358 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a14034040 con 0x7f3a1c102ef0 2024-09-19T09:11:36.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.513+0000 7f3a11ffb640 1 -- 172.21.15.92:0/3193100358 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a14030920 con 0x7f3a1c102ef0 2024-09-19T09:11:36.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.513+0000 7f3a22e19640 1 -- 172.21.15.92:0/3193100358 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a1c19f880 con 0x7f3a1c102ef0 2024-09-19T09:11:36.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.513+0000 7f3a11ffb640 1 -- 172.21.15.92:0/3193100358 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a140047f0 con 0x7f3a1c102ef0 2024-09-19T09:11:36.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.514+0000 7f3a22e19640 1 -- 172.21.15.92:0/3193100358 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a1c1a71c0 con 0x7f3a1c102ef0 2024-09-19T09:11:36.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.516+0000 7f3a11ffb640 1 -- 172.21.15.92:0/3193100358 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3a14037020 con 0x7f3a1c102ef0 2024-09-19T09:11:36.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.516+0000 7f3a251f2740 1 Processor -- start 2024-09-19T09:11:36.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.516+0000 7f3a251f2740 1 -- start start 2024-09-19T09:11:36.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.516+0000 7f3a251f2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb09548060 0x55bb09548440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:36.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.517+0000 7f3a251f2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb09548980 0x55bb09552d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:36.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.517+0000 7f3a251f2740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bb09553240 0x55bb09555630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:36.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.517+0000 7f3a251f2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55bb094ad620 con 0x55bb09548060 2024-09-19T09:11:36.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.517+0000 7f3a251f2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55bb09454e50 con 0x55bb09548980 2024-09-19T09:11:36.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.517+0000 7f3a251f2740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55bb094a95e0 con 0x55bb09553240 2024-09-19T09:11:36.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.517+0000 7f3a11ffb640 1 --2- 172.21.15.92:0/3193100358 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3a040a32b0 0x7f3a040a5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:36.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.517+0000 7f3a13fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb09548060 0x55bb09548440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:36.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.517+0000 7f3a13fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb09548060 0x55bb09548440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57624/0 (socket says 172.21.15.92:57624) 2024-09-19T09:11:36.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.517+0000 7f3a13fff640 1 -- 172.21.15.92:0/1191229157 learned_addr learned my addr 172.21.15.92:0/1191229157 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:36.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.517+0000 7f3a213b6640 1 --2- 172.21.15.92:0/3193100358 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3a040a32b0 0x7f3a040a5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:36.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.517+0000 7f3a13fff640 1 --2- 172.21.15.92:0/1191229157 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bb09553240 0x55bb09555630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:36.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.517+0000 7f3a20bb5640 1 --2- 172.21.15.92:0/1191229157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb09548980 0x55bb09552d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:36.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.517+0000 7f3a11ffb640 1 -- 172.21.15.92:0/3193100358 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3a140f0710 con 0x7f3a1c102ef0 2024-09-19T09:11:36.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.517+0000 7f3a13fff640 1 -- 172.21.15.92:0/1191229157 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bb09553240 msgr2=0x55bb09555630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:36.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.517+0000 7f3a13fff640 1 --2- 172.21.15.92:0/1191229157 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bb09553240 0x55bb09555630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:36.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.517+0000 7f3a13fff640 1 -- 172.21.15.92:0/1191229157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb09548980 msgr2=0x55bb09552d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:36.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.517+0000 7f3a13fff640 1 --2- 172.21.15.92:0/1191229157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb09548980 0x55bb09552d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:36.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.517+0000 7f3a13fff640 1 -- 172.21.15.92:0/1191229157 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb09445d40 con 0x55bb09548060 2024-09-19T09:11:36.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.517+0000 7f3a213b6640 1 --2- 172.21.15.92:0/3193100358 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3a040a32b0 0x7f3a040a5770 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f3a14082220 tx=0x7f3a140b76f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:36.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.517+0000 7f3a13fff640 1 --2- 172.21.15.92:0/1191229157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb09548060 0x55bb09548440 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c00bdf0 tx=0x7f3a0c004160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be13870c6fc33f46 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:36.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.517+0000 7f3a02ffd640 1 -- 172.21.15.92:0/1191229157 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c003e80 con 0x55bb09548060 2024-09-19T09:11:36.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.518+0000 7f3a02ffd640 1 -- 172.21.15.92:0/1191229157 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a0c005500 con 0x55bb09548060 2024-09-19T09:11:36.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.518+0000 7f3a02ffd640 1 -- 172.21.15.92:0/1191229157 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c012450 con 0x55bb09548060 2024-09-19T09:11:36.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.518+0000 7f3a251f2740 1 -- 172.21.15.92:0/1191229157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb09548060 msgr2=0x55bb09548440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:36.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.518+0000 7f3a251f2740 1 --2- 172.21.15.92:0/1191229157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb09548060 0x55bb09548440 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c00bdf0 tx=0x7f3a0c004160 comp rx=0 tx=0).stop 2024-09-19T09:11:36.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.518+0000 7f3a251f2740 1 -- 172.21.15.92:0/1191229157 shutdown_connections 2024-09-19T09:11:36.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.518+0000 7f3a251f2740 1 --2- 172.21.15.92:0/1191229157 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bb09553240 0x55bb09555630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:36.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.518+0000 7f3a251f2740 1 --2- 172.21.15.92:0/1191229157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb09548980 0x55bb09552d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:36.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.518+0000 7f3a251f2740 1 --2- 172.21.15.92:0/1191229157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb09548060 0x55bb09548440 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:36.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.518+0000 7f3a251f2740 1 -- 172.21.15.92:0/1191229157 >> 172.21.15.92:0/1191229157 conn(0x55bb095445f0 msgr2=0x55bb095449d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:36.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.518+0000 7f3a251f2740 1 -- 172.21.15.92:0/1191229157 shutdown_connections 2024-09-19T09:11:36.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.518+0000 7f3a251f2740 1 -- 172.21.15.92:0/1191229157 wait complete. 2024-09-19T09:11:36.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.519+0000 7f3a251f2740 1 -- start start 2024-09-19T09:11:36.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.519+0000 7f3a251f2740 1 Processor -- start 2024-09-19T09:11:36.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.519+0000 7f3a251f2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb09548060 0x55bb095500f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:36.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.519+0000 7f3a251f2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb09548980 0x55bb09550630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:36.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.519+0000 7f3a251f2740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bb09553240 0x55bb09550b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:36.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.519+0000 7f3a251f2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55bb09555e10 con 0x55bb09548060 2024-09-19T09:11:36.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.519+0000 7f3a251f2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55bb09435f10 con 0x55bb09548980 2024-09-19T09:11:36.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.519+0000 7f3a251f2740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55bb09555f90 con 0x55bb09553240 2024-09-19T09:11:36.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.519+0000 7f3a251f2740 10 client.0 _ll_register_callbacks cb 0x55bb09459db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:11:36.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.519+0000 7f3a13fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb09548060 0x55bb095500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:36.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.519+0000 7f3a13fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb09548060 0x55bb095500f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57628/0 (socket says 172.21.15.92:57628) 2024-09-19T09:11:36.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.519+0000 7f3a13fff640 1 -- 172.21.15.92:0/3685697955 learned_addr learned my addr 172.21.15.92:0/3685697955 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:36.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.519+0000 7f3a20bb5640 1 --2- 172.21.15.92:0/3685697955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb09548980 0x55bb09550630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:36.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.520+0000 7f3a13fff640 1 --2- 172.21.15.92:0/3685697955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bb09553240 0x55bb09550b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:36.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.520+0000 7f3a13fff640 1 -- 172.21.15.92:0/3685697955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bb09553240 msgr2=0x55bb09550b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:36.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.520+0000 7f3a13fff640 1 --2- 172.21.15.92:0/3685697955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bb09553240 0x55bb09550b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:36.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.520+0000 7f3a13fff640 1 -- 172.21.15.92:0/3685697955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb09548980 msgr2=0x55bb09550630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:36.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.520+0000 7f3a13fff640 1 --2- 172.21.15.92:0/3685697955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb09548980 0x55bb09550630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:36.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.520+0000 7f3a13fff640 1 -- 172.21.15.92:0/3685697955 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb091bc580 con 0x55bb09548060 2024-09-19T09:11:36.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.520+0000 7f3a13fff640 1 --2- 172.21.15.92:0/3685697955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb09548060 0x55bb095500f0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c00b480 tx=0x7f3a0c004bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8247053800357b5d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:36.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.520+0000 7f39fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:11:36.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.520+0000 7f39fbfff640 1 -- 172.21.15.92:0/3685697955 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c005000 con 0x55bb09548060 2024-09-19T09:11:36.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.520+0000 7f39fbfff640 1 -- 172.21.15.92:0/3685697955 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3a0c0051a0 con 0x55bb09548060 2024-09-19T09:11:36.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.520+0000 7f3a251f2740 1 -- 172.21.15.92:0/3685697955 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a0c005500 con 0x55bb09548060 2024-09-19T09:11:36.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.520+0000 7f39fbfff640 1 -- 172.21.15.92:0/3685697955 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3a0c031050 con 0x55bb09548060 2024-09-19T09:11:36.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.520+0000 7f3a251f2740 10 client.18912 fetch_fsmap learned FSMap version 19 2024-09-19T09:11:36.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.520+0000 7f3a251f2740 1 -- 172.21.15.92:0/3685697955 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55bb09286960 con 0x55bb09548060 2024-09-19T09:11:36.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.520+0000 7f39fbfff640 1 -- 172.21.15.92:0/3685697955 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a0c005500 con 0x55bb09548060 2024-09-19T09:11:36.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.521+0000 7f39fbfff640 1 -- 172.21.15.92:0/3685697955 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f3a0c01f480 con 0x55bb09548060 2024-09-19T09:11:36.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.521+0000 7f3a251f2740 10 client.18912 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:11:36.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.521+0000 7f3a251f2740 10 client.18912 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:11:36.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.521+0000 7f3a251f2740 20 client.18912 populate_metadata read hostname 'smithi092' 2024-09-19T09:11:36.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.521+0000 7f3a251f2740 1 --2- 172.21.15.92:0/3685697955 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55bb09562c10 0x55bb09565000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:36.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.521+0000 7f3a251f2740 4 client.18912 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:11:36.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.521+0000 7f3a251f2740 1 -- 172.21.15.92:0/3685697955 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb094bab90 con 0x55bb09562c10 2024-09-19T09:11:36.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.521+0000 7f3a20bb5640 1 --2- 172.21.15.92:0/3685697955 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55bb09562c10 0x55bb09565000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:36.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.521+0000 7f39fbfff640 10 client.18912 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:36.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.521+0000 7f3a20bb5640 1 --2- 172.21.15.92:0/3685697955 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55bb09562c10 0x55bb09565000 crc :-1 s=READY pgs=444 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e23954c4bb1aaf5 server_cookie=2a2f58e26c2c478b in_seq=0 out_seq=0 2024-09-19T09:11:36.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.522+0000 7f39fbfff640 1 -- 172.21.15.92:0/3685697955 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bb094bab90 con 0x55bb09562c10 2024-09-19T09:11:36.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.522+0000 7f39fbfff640 10 client.18912 handle_command_reply: tid=0 2024-09-19T09:11:36.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.522+0000 7f3a251f2740 1 client.18912 shutdown 2024-09-19T09:11:36.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.522+0000 7f3a251f2740 1 -- 172.21.15.92:0/3685697955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb09548060 msgr2=0x55bb095500f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:36.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.522+0000 7f3a251f2740 1 --2- 172.21.15.92:0/3685697955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb09548060 0x55bb095500f0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c00b480 tx=0x7f3a0c004bf0 comp rx=0 tx=0).stop 2024-09-19T09:11:36.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.522+0000 7f3a251f2740 1 -- 172.21.15.92:0/3685697955 shutdown_connections 2024-09-19T09:11:36.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.522+0000 7f3a251f2740 1 --2- 172.21.15.92:0/3685697955 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55bb09562c10 0x55bb09565000 crc :-1 s=READY pgs=444 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:36.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.522+0000 7f3a251f2740 1 --2- 172.21.15.92:0/3685697955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bb09553240 0x55bb09550b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:36.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.522+0000 7f3a251f2740 1 --2- 172.21.15.92:0/3685697955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb09548980 0x55bb09550630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:36.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.522+0000 7f3a251f2740 1 --2- 172.21.15.92:0/3685697955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb09548060 0x55bb095500f0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:36.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.522+0000 7f3a251f2740 1 -- 172.21.15.92:0/3685697955 >> 172.21.15.92:0/3685697955 conn(0x55bb095445f0 msgr2=0x55bb0954a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:36.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.522+0000 7f39fbfff640 0 client.18912 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:36.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.522+0000 7f3a251f2740 1 -- 172.21.15.92:0/3685697955 shutdown_connections 2024-09-19T09:11:36.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.522+0000 7f3a251f2740 1 -- 172.21.15.92:0/3685697955 wait complete. 2024-09-19T09:11:36.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.522+0000 7f3a251f2740 20 client.18912 trim_cache size 0 max 16384 2024-09-19T09:11:36.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.539+0000 7f3a251f2740 1 Processor -- start 2024-09-19T09:11:36.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.539+0000 7f3a251f2740 1 -- start start 2024-09-19T09:11:36.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.539+0000 7f3a251f2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb09548060 0x55bb0956a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:36.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.539+0000 7f3a251f2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb09548980 0x55bb0956acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:36.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.539+0000 7f3a251f2740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bb09553240 0x55bb0954d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:36.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.539+0000 7f3a251f2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1c1ad670 con 0x55bb09548060 2024-09-19T09:11:36.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.539+0000 7f3a251f2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1c1aff10 con 0x55bb09548980 2024-09-19T09:11:36.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.539+0000 7f3a251f2740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1c1add00 con 0x55bb09553240 2024-09-19T09:11:36.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.539+0000 7f3a13fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb09548060 0x55bb0956a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:36.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.539+0000 7f3a13fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb09548060 0x55bb0956a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57644/0 (socket says 172.21.15.92:57644) 2024-09-19T09:11:36.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.539+0000 7f3a13fff640 1 -- 172.21.15.92:0/623069696 learned_addr learned my addr 172.21.15.92:0/623069696 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:36.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.540+0000 7f3a20bb5640 1 --2- 172.21.15.92:0/623069696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb09548980 0x55bb0956acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:36.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.540+0000 7f3a13fff640 1 -- 172.21.15.92:0/623069696 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bb09553240 msgr2=0x55bb0954d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:36.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.540+0000 7f3a13fff640 1 --2- 172.21.15.92:0/623069696 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bb09553240 0x55bb0954d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:36.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.540+0000 7f3a13fff640 1 -- 172.21.15.92:0/623069696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb09548980 msgr2=0x55bb0956acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:36.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.540+0000 7f3a13fff640 1 --2- 172.21.15.92:0/623069696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb09548980 0x55bb0956acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:36.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.540+0000 7f3a13fff640 1 -- 172.21.15.92:0/623069696 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb095487b0 con 0x55bb09548060 2024-09-19T09:11:36.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.540+0000 7f3a13fff640 1 --2- 172.21.15.92:0/623069696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb09548060 0x55bb0956a790 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c00b620 tx=0x7f3a0c004b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fdc44a02ccabcb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:36.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.540+0000 7f3a027fc640 1 -- 172.21.15.92:0/623069696 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c0048d0 con 0x55bb09548060 2024-09-19T09:11:36.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.540+0000 7f3a027fc640 1 -- 172.21.15.92:0/623069696 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a0c016040 con 0x55bb09548060 2024-09-19T09:11:36.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.540+0000 7f3a027fc640 1 -- 172.21.15.92:0/623069696 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c005460 con 0x55bb09548060 2024-09-19T09:11:36.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.541+0000 7f3a251f2740 1 -- 172.21.15.92:0/623069696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb09548060 msgr2=0x55bb0956a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:36.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.541+0000 7f3a251f2740 1 --2- 172.21.15.92:0/623069696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb09548060 0x55bb0956a790 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c00b620 tx=0x7f3a0c004b80 comp rx=0 tx=0).stop 2024-09-19T09:11:36.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.541+0000 7f3a251f2740 1 -- 172.21.15.92:0/623069696 shutdown_connections 2024-09-19T09:11:36.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.541+0000 7f3a251f2740 1 --2- 172.21.15.92:0/623069696 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bb09553240 0x55bb0954d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:36.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.541+0000 7f3a251f2740 1 --2- 172.21.15.92:0/623069696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb09548980 0x55bb0956acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:36.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.541+0000 7f3a251f2740 1 --2- 172.21.15.92:0/623069696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb09548060 0x55bb0956a790 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:36.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.541+0000 7f3a251f2740 1 -- 172.21.15.92:0/623069696 >> 172.21.15.92:0/623069696 conn(0x55bb095445f0 msgr2=0x55bb09551950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:36.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.541+0000 7f3a251f2740 1 -- 172.21.15.92:0/623069696 shutdown_connections 2024-09-19T09:11:36.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.541+0000 7f3a251f2740 1 -- 172.21.15.92:0/623069696 wait complete. 2024-09-19T09:11:36.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.541+0000 7f3a251f2740 1 -- start start 2024-09-19T09:11:36.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.541+0000 7f3a251f2740 1 Processor -- start 2024-09-19T09:11:36.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.541+0000 7f3a251f2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb09548060 0x55bb09557020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:36.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.541+0000 7f3a251f2740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bb09548980 0x55bb09557560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:36.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.541+0000 7f3a251f2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb09553240 0x55bb09557aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:36.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.541+0000 7f3a251f2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1c1ae3d0 con 0x55bb09548060 2024-09-19T09:11:36.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.542+0000 7f3a251f2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1c1af840 con 0x55bb09553240 2024-09-19T09:11:36.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.542+0000 7f3a251f2740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1c1aeaa0 con 0x55bb09548980 2024-09-19T09:11:36.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.542+0000 7f3a251f2740 10 client.0 _ll_register_callbacks cb 0x7f3a0c00bcf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:11:36.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.542+0000 7f3a13fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb09548060 0x55bb09557020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:36.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.542+0000 7f3a13fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb09548060 0x55bb09557020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57650/0 (socket says 172.21.15.92:57650) 2024-09-19T09:11:36.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.542+0000 7f3a13fff640 1 -- 172.21.15.92:0/1803860893 learned_addr learned my addr 172.21.15.92:0/1803860893 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:36.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.542+0000 7f3a13fff640 1 --2- 172.21.15.92:0/1803860893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb09553240 0x55bb09557aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:36.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.542+0000 7f3a20bb5640 1 --2- 172.21.15.92:0/1803860893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bb09548980 0x55bb09557560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:36.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.542+0000 7f3a13fff640 1 -- 172.21.15.92:0/1803860893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bb09548980 msgr2=0x55bb09557560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:36.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.542+0000 7f3a13fff640 1 --2- 172.21.15.92:0/1803860893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bb09548980 0x55bb09557560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:36.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.542+0000 7f3a13fff640 1 -- 172.21.15.92:0/1803860893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb09553240 msgr2=0x55bb09557aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:36.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.542+0000 7f3a13fff640 1 --2- 172.21.15.92:0/1803860893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb09553240 0x55bb09557aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:36.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.542+0000 7f3a13fff640 1 -- 172.21.15.92:0/1803860893 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb095cc860 con 0x55bb09548060 2024-09-19T09:11:36.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.542+0000 7f3a20bb5640 1 --2- 172.21.15.92:0/1803860893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bb09548980 0x55bb09557560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:11:36.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.542+0000 7f3a13fff640 1 --2- 172.21.15.92:0/1803860893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb09548060 0x55bb09557020 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c000c00 tx=0x7f3a0c01f480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a4bbfa73cf92e14 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:36.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.542+0000 7f39fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:11:36.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.542+0000 7f39fbfff640 1 -- 172.21.15.92:0/1803860893 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c01fb00 con 0x55bb09548060 2024-09-19T09:11:36.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.542+0000 7f39fbfff640 1 -- 172.21.15.92:0/1803860893 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3a0c01f580 con 0x55bb09548060 2024-09-19T09:11:36.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.542+0000 7f3a251f2740 1 -- 172.21.15.92:0/1803860893 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a0c016040 con 0x55bb09548060 2024-09-19T09:11:36.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.542+0000 7f39fbfff640 1 -- 172.21.15.92:0/1803860893 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3a0c004f80 con 0x55bb09548060 2024-09-19T09:11:36.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.542+0000 7f3a251f2740 10 client.18918 fetch_fsmap learned FSMap version 19 2024-09-19T09:11:36.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.542+0000 7f3a251f2740 1 -- 172.21.15.92:0/1803860893 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55bb095cdb60 con 0x55bb09548060 2024-09-19T09:11:36.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.543+0000 7f39fbfff640 1 -- 172.21.15.92:0/1803860893 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a0c016040 con 0x55bb09548060 2024-09-19T09:11:36.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.543+0000 7f39fbfff640 1 -- 172.21.15.92:0/1803860893 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f3a0c012570 con 0x55bb09548060 2024-09-19T09:11:36.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.543+0000 7f3a251f2740 10 client.18918 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:11:36.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.543+0000 7f3a251f2740 10 client.18918 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:11:36.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.543+0000 7f3a251f2740 20 client.18918 populate_metadata read hostname 'smithi092' 2024-09-19T09:11:36.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.543+0000 7f3a251f2740 1 --2- 172.21.15.92:0/1803860893 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55bb095ce180 0x55bb095d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:36.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.543+0000 7f3a251f2740 4 client.18918 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "7b482bc7", "release": true, "await": true}] 2024-09-19T09:11:36.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.543+0000 7f3a251f2740 1 -- 172.21.15.92:0/1803860893 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "quiesce db", "set_id": "7b482bc7", "release": true, "await": true}) -- 0x55bb094b50a0 con 0x55bb095ce180 2024-09-19T09:11:36.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.543+0000 7f3a20bb5640 1 --2- 172.21.15.92:0/1803860893 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55bb095ce180 0x55bb095d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:36.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.543+0000 7f39fbfff640 10 client.18918 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:36.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.543+0000 7f3a20bb5640 1 --2- 172.21.15.92:0/1803860893 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55bb095ce180 0x55bb095d05a0 crc :-1 s=READY pgs=445 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8563a2010ab5aba8 server_cookie=8c9acdd5dc165da1 in_seq=0 out_seq=0 2024-09-19T09:11:36.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.592+0000 7f39fbfff640 1 -- 172.21.15.92:0/1803860893 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55bb094b50a0 con 0x55bb095ce180 2024-09-19T09:11:36.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.592+0000 7f39fbfff640 10 client.18918 handle_command_reply: tid=0 2024-09-19T09:11:36.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.594+0000 7f3a251f2740 1 client.18918 shutdown 2024-09-19T09:11:36.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.594+0000 7f3a251f2740 1 -- 172.21.15.92:0/1803860893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb09548060 msgr2=0x55bb09557020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:36.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.594+0000 7f3a251f2740 1 --2- 172.21.15.92:0/1803860893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb09548060 0x55bb09557020 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c000c00 tx=0x7f3a0c01f480 comp rx=0 tx=0).stop 2024-09-19T09:11:36.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.594+0000 7f3a251f2740 1 -- 172.21.15.92:0/1803860893 shutdown_connections 2024-09-19T09:11:36.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.594+0000 7f3a251f2740 1 --2- 172.21.15.92:0/1803860893 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55bb095ce180 0x55bb095d05a0 crc :-1 s=READY pgs=445 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:36.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.594+0000 7f3a251f2740 1 --2- 172.21.15.92:0/1803860893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb09553240 0x55bb09557aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:36.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.594+0000 7f3a251f2740 1 --2- 172.21.15.92:0/1803860893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55bb09548980 0x55bb09557560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:36.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.594+0000 7f3a251f2740 1 --2- 172.21.15.92:0/1803860893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb09548060 0x55bb09557020 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:36.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.594+0000 7f3a251f2740 1 -- 172.21.15.92:0/1803860893 >> 172.21.15.92:0/1803860893 conn(0x55bb095445f0 msgr2=0x55bb09542f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:36.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.594+0000 7f39fbfff640 0 client.18918 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:36.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.595+0000 7f3a251f2740 1 -- 172.21.15.92:0/1803860893 shutdown_connections 2024-09-19T09:11:36.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.595+0000 7f3a251f2740 1 -- 172.21.15.92:0/1803860893 wait complete. 2024-09-19T09:11:36.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.595+0000 7f3a251f2740 20 client.18918 trim_cache size 0 max 16384 2024-09-19T09:11:36.598 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:11:36.598 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 19, 2024-09-19T09:11:36.598 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24472, 2024-09-19T09:11:36.598 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 52, 2024-09-19T09:11:36.598 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-09-19T09:11:36.598 INFO:teuthology.orchestra.run.smithi092.stdout: "7b482bc7": { 2024-09-19T09:11:36.598 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 52, 2024-09-19T09:11:36.598 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-09-19T09:11:36.598 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:11:36.598 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-09-19T09:11:36.599 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:11:36.599 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:11:36.599 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 90.0, 2024-09-19T09:11:36.599 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 149.4, 2024-09-19T09:11:36.599 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-09-19T09:11:36.599 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-09-19T09:11:36.599 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-09-19T09:11:36.599 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:11:36.599 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-09-19T09:11:36.599 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:11:36.599 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:11:36.599 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:11:36.599 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:11:36.600 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:11:36.600 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:11:36.600 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:11:36.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.596+0000 7f3a22e19640 1 -- 172.21.15.92:0/3193100358 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3a040a32b0 msgr2=0x7f3a040a5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:36.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.596+0000 7f3a22e19640 1 --2- 172.21.15.92:0/3193100358 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3a040a32b0 0x7f3a040a5770 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f3a14082220 tx=0x7f3a140b76f0 comp rx=0 tx=0).stop 2024-09-19T09:11:36.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.596+0000 7f3a22e19640 1 -- 172.21.15.92:0/3193100358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a1c102ef0 msgr2=0x7f3a1c19ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:36.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.596+0000 7f3a22e19640 1 --2- 172.21.15.92:0/3193100358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a1c102ef0 0x7f3a1c19ef10 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f3a1402ae70 tx=0x7f3a1402f5d0 comp rx=0 tx=0).stop 2024-09-19T09:11:36.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.596+0000 7f3a22e19640 1 -- 172.21.15.92:0/3193100358 shutdown_connections 2024-09-19T09:11:36.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.596+0000 7f3a22e19640 1 --2- 172.21.15.92:0/3193100358 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f3a040a32b0 0x7f3a040a5770 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:36.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.596+0000 7f3a22e19640 1 --2- 172.21.15.92:0/3193100358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a1c102ef0 0x7f3a1c19ef10 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:36.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.596+0000 7f3a22e19640 1 --2- 172.21.15.92:0/3193100358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a1c102570 0x7f3a1c19ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:36.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.596+0000 7f3a22e19640 1 --2- 172.21.15.92:0/3193100358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a1c100e20 0x7f3a1c19a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:36.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.596+0000 7f3a22e19640 1 -- 172.21.15.92:0/3193100358 >> 172.21.15.92:0/3193100358 conn(0x7f3a1c0fc7d0 msgr2=0x7f3a1c106cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:36.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.596+0000 7f3a22e19640 1 -- 172.21.15.92:0/3193100358 shutdown_connections 2024-09-19T09:11:36.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:36.596+0000 7f3a22e19640 1 -- 172.21.15.92:0/3193100358 wait complete. 2024-09-19T09:11:36.957 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:36 smithi092 ceph-mon[31407]: pgmap v784: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 12 MiB/s wr, 365 op/s 2024-09-19T09:11:37.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:36 smithi167 ceph-mon[35359]: pgmap v784: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 12 MiB/s wr, 365 op/s 2024-09-19T09:11:37.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:36 smithi190 ceph-mon[35358]: pgmap v784: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 12 MiB/s wr, 365 op/s 2024-09-19T09:11:37.317 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '7b482bc7', total seconds elapsed: 32.6 2024-09-19T09:11:37.317 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.45 2024-09-19T09:11:37.317 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:11:37.701 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:11:38.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.262+0000 7f696b7fe640 1 -- 172.21.15.92:0/4048544841 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6958035020 con 0x7f696c101e20 2024-09-19T09:11:38.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.264+0000 7f6972dc0640 1 -- 172.21.15.92:0/4048544841 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f696c101e20 msgr2=0x7f696c1056b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:38.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.264+0000 7f6972dc0640 1 --2- 172.21.15.92:0/4048544841 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f696c101e20 0x7f696c1056b0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f6958009900 tx=0x7f695802a410 comp rx=0 tx=0).stop 2024-09-19T09:11:38.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.264+0000 7f6972dc0640 1 -- 172.21.15.92:0/4048544841 shutdown_connections 2024-09-19T09:11:38.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.264+0000 7f6972dc0640 1 --2- 172.21.15.92:0/4048544841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f696c105de0 0x7f696c10d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:38.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.264+0000 7f6972dc0640 1 --2- 172.21.15.92:0/4048544841 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f696c101e20 0x7f696c1056b0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:38.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.264+0000 7f6972dc0640 1 --2- 172.21.15.92:0/4048544841 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f696c101470 0x7f696c101850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:38.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.264+0000 7f6972dc0640 1 -- 172.21.15.92:0/4048544841 >> 172.21.15.92:0/4048544841 conn(0x7f696c077230 msgr2=0x7f696c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:38.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.265+0000 7f6972dc0640 1 -- 172.21.15.92:0/4048544841 shutdown_connections 2024-09-19T09:11:38.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.265+0000 7f6972dc0640 1 -- 172.21.15.92:0/4048544841 wait complete. 2024-09-19T09:11:38.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.265+0000 7f6972dc0640 1 Processor -- start 2024-09-19T09:11:38.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.265+0000 7f6972dc0640 1 -- start start 2024-09-19T09:11:38.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.266+0000 7f6972dc0640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f696c101470 0x7f696c1961f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:38.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.266+0000 7f6972dc0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f696c101e20 0x7f696c196730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:38.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.266+0000 7f6972dc0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f696c105de0 0x7f696c19aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:38.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.266+0000 7f6972dc0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f696c10fd30 con 0x7f696c101e20 2024-09-19T09:11:38.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.266+0000 7f6970b5c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f696c101470 0x7f696c1961f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:38.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.266+0000 7f6970b5c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f696c101470 0x7f696c1961f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:42094/0 (socket says 172.21.15.92:42094) 2024-09-19T09:11:38.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.266+0000 7f6970b5c640 1 -- 172.21.15.92:0/2013439238 learned_addr learned my addr 172.21.15.92:0/2013439238 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:38.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.266+0000 7f696bfff640 1 --2- 172.21.15.92:0/2013439238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f696c101e20 0x7f696c196730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:38.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.266+0000 7f6972dc0640 1 -- 172.21.15.92:0/2013439238 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f696c10fbb0 con 0x7f696c105de0 2024-09-19T09:11:38.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.266+0000 7f6972dc0640 1 -- 172.21.15.92:0/2013439238 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f696c10feb0 con 0x7f696c101470 2024-09-19T09:11:38.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.267+0000 7f697135d640 1 --2- 172.21.15.92:0/2013439238 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f696c105de0 0x7f696c19aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:38.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.267+0000 7f6970b5c640 1 -- 172.21.15.92:0/2013439238 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f696c105de0 msgr2=0x7f696c19aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:38.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.267+0000 7f6970b5c640 1 --2- 172.21.15.92:0/2013439238 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f696c105de0 0x7f696c19aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:38.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.267+0000 7f6970b5c640 1 -- 172.21.15.92:0/2013439238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f696c101e20 msgr2=0x7f696c196730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:38.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.267+0000 7f6970b5c640 1 --2- 172.21.15.92:0/2013439238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f696c101e20 0x7f696c196730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:38.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.267+0000 7f6970b5c640 1 -- 172.21.15.92:0/2013439238 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f696c19b1a0 con 0x7f696c101470 2024-09-19T09:11:38.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.267+0000 7f6970b5c640 1 --2- 172.21.15.92:0/2013439238 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f696c101470 0x7f696c1961f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f696000e9f0 tx=0x7f696000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:38.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.268+0000 7f6969ffb640 1 -- 172.21.15.92:0/2013439238 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696000cd80 con 0x7f696c101470 2024-09-19T09:11:38.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.268+0000 7f6972dc0640 1 -- 172.21.15.92:0/2013439238 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f696c19b490 con 0x7f696c101470 2024-09-19T09:11:38.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.268+0000 7f6969ffb640 1 -- 172.21.15.92:0/2013439238 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6960010910 con 0x7f696c101470 2024-09-19T09:11:38.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.268+0000 7f6972dc0640 1 -- 172.21.15.92:0/2013439238 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f696c1a2d70 con 0x7f696c101470 2024-09-19T09:11:38.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.268+0000 7f6969ffb640 1 -- 172.21.15.92:0/2013439238 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6960018980 con 0x7f696c101470 2024-09-19T09:11:38.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.270+0000 7f6972dc0640 1 -- 172.21.15.92:0/2013439238 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f696c101850 con 0x7f696c101470 2024-09-19T09:11:38.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.270+0000 7f6969ffb640 1 -- 172.21.15.92:0/2013439238 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6960010430 con 0x7f696c101470 2024-09-19T09:11:38.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.271+0000 7f6969ffb640 1 --2- 172.21.15.92:0/2013439238 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f695c0a54d0 0x7f695c0a7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:38.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.271+0000 7f6969ffb640 1 -- 172.21.15.92:0/2013439238 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f69600cfc80 con 0x7f696c101470 2024-09-19T09:11:38.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.272+0000 7f696bfff640 1 --2- 172.21.15.92:0/2013439238 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f695c0a54d0 0x7f695c0a7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:38.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.273+0000 7f696bfff640 1 --2- 172.21.15.92:0/2013439238 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f695c0a54d0 0x7f695c0a7990 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f696c0ff860 tx=0x7f6958031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:38.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.276+0000 7f6969ffb640 1 -- 172.21.15.92:0/2013439238 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f69600d6080 con 0x7f696c101470 2024-09-19T09:11:38.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.608+0000 7f6972dc0640 1 -- 172.21.15.92:0/2013439238 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f696c108fc0 con 0x7f696c101470 2024-09-19T09:11:38.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.609+0000 7f6969ffb640 1 -- 172.21.15.92:0/2013439238 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f696009c9a0 con 0x7f696c101470 2024-09-19T09:11:38.611 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:11:38.611 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:11:38.611 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:11:38.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.612+0000 7f6972dc0640 1 -- 172.21.15.92:0/2013439238 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f695c0a54d0 msgr2=0x7f695c0a7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:38.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.612+0000 7f6972dc0640 1 --2- 172.21.15.92:0/2013439238 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f695c0a54d0 0x7f695c0a7990 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f696c0ff860 tx=0x7f6958031400 comp rx=0 tx=0).stop 2024-09-19T09:11:38.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.612+0000 7f6972dc0640 1 -- 172.21.15.92:0/2013439238 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f696c101470 msgr2=0x7f696c1961f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:38.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.612+0000 7f6972dc0640 1 --2- 172.21.15.92:0/2013439238 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f696c101470 0x7f696c1961f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f696000e9f0 tx=0x7f696000eeb0 comp rx=0 tx=0).stop 2024-09-19T09:11:38.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.612+0000 7f6972dc0640 1 -- 172.21.15.92:0/2013439238 shutdown_connections 2024-09-19T09:11:38.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.612+0000 7f6972dc0640 1 --2- 172.21.15.92:0/2013439238 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f696c105de0 0x7f696c19aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:38.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.612+0000 7f6972dc0640 1 --2- 172.21.15.92:0/2013439238 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f695c0a54d0 0x7f695c0a7990 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:38.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.612+0000 7f6972dc0640 1 --2- 172.21.15.92:0/2013439238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f696c101e20 0x7f696c196730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:38.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.612+0000 7f6972dc0640 1 --2- 172.21.15.92:0/2013439238 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f696c101470 0x7f696c1961f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:38.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.612+0000 7f6972dc0640 1 -- 172.21.15.92:0/2013439238 >> 172.21.15.92:0/2013439238 conn(0x7f696c077230 msgr2=0x7f696c104060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:38.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.612+0000 7f6972dc0640 1 -- 172.21.15.92:0/2013439238 shutdown_connections 2024-09-19T09:11:38.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:38.612+0000 7f6972dc0640 1 -- 172.21.15.92:0/2013439238 wait complete. 2024-09-19T09:11:38.927 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:38 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/2013439238' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:11:38.928 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:38 smithi092 ceph-mon[31407]: pgmap v785: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 15 MiB/s wr, 513 op/s 2024-09-19T09:11:39.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:38 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/2013439238' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:11:39.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:38 smithi167 ceph-mon[35359]: pgmap v785: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 15 MiB/s wr, 513 op/s 2024-09-19T09:11:39.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:38 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/2013439238' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:11:39.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:38 smithi190 ceph-mon[35358]: pgmap v785: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 15 MiB/s wr, 513 op/s 2024-09-19T09:11:39.272 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 149.45 --await-for 45.0' 2024-09-19T09:11:39.273 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 149.45 --await-for 45.0 2024-09-19T09:11:39.663 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:11:40.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.170+0000 7fa312240640 1 -- 172.21.15.92:0/2574635182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa30c1027a0 msgr2=0x7fa30c1067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:40.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.170+0000 7fa312240640 1 --2- 172.21.15.92:0/2574635182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa30c1027a0 0x7fa30c1067f0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fa300009900 tx=0x7fa30002a410 comp rx=0 tx=0).stop 2024-09-19T09:11:40.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.170+0000 7fa312240640 1 -- 172.21.15.92:0/2574635182 shutdown_connections 2024-09-19T09:11:40.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.170+0000 7fa312240640 1 --2- 172.21.15.92:0/2574635182 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa30c106f20 0x7fa30c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:40.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.171+0000 7fa312240640 1 --2- 172.21.15.92:0/2574635182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa30c1027a0 0x7fa30c1067f0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:40.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.171+0000 7fa312240640 1 --2- 172.21.15.92:0/2574635182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa30c101df0 0x7fa30c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:40.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.171+0000 7fa312240640 1 -- 172.21.15.92:0/2574635182 >> 172.21.15.92:0/2574635182 conn(0x7fa30c0fd8b0 msgr2=0x7fa30c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:40.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.171+0000 7fa312240640 1 -- 172.21.15.92:0/2574635182 shutdown_connections 2024-09-19T09:11:40.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.171+0000 7fa312240640 1 -- 172.21.15.92:0/2574635182 wait complete. 2024-09-19T09:11:40.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.171+0000 7fa312240640 1 Processor -- start 2024-09-19T09:11:40.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.171+0000 7fa312240640 1 -- start start 2024-09-19T09:11:40.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.172+0000 7fa312240640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa30c101df0 0x7fa30c10af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:40.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.172+0000 7fa312240640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa30c1027a0 0x7fa30c10b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:40.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.172+0000 7fa312240640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa30c106f20 0x7fa30c1aa900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:40.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.172+0000 7fa312240640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa30c075470 con 0x7fa30c101df0 2024-09-19T09:11:40.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.172+0000 7fa312240640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa30c0752f0 con 0x7fa30c1027a0 2024-09-19T09:11:40.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.172+0000 7fa312240640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa30c0755f0 con 0x7fa30c106f20 2024-09-19T09:11:40.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.172+0000 7fa30b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa30c101df0 0x7fa30c10af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:40.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.172+0000 7fa30b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa30c101df0 0x7fa30c10af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57690/0 (socket says 172.21.15.92:57690) 2024-09-19T09:11:40.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.172+0000 7fa30affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa30c1027a0 0x7fa30c10b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:40.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.172+0000 7fa30b7fe640 1 -- 172.21.15.92:0/2592778824 learned_addr learned my addr 172.21.15.92:0/2592778824 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:40.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.172+0000 7fa30bfff640 1 --2- 172.21.15.92:0/2592778824 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa30c106f20 0x7fa30c1aa900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:40.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.172+0000 7fa30b7fe640 1 -- 172.21.15.92:0/2592778824 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa30c106f20 msgr2=0x7fa30c1aa900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:40.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.172+0000 7fa30b7fe640 1 --2- 172.21.15.92:0/2592778824 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa30c106f20 0x7fa30c1aa900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:40.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.172+0000 7fa30b7fe640 1 -- 172.21.15.92:0/2592778824 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa30c1027a0 msgr2=0x7fa30c10b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:40.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.172+0000 7fa30b7fe640 1 --2- 172.21.15.92:0/2592778824 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa30c1027a0 0x7fa30c10b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:40.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.172+0000 7fa30b7fe640 1 -- 172.21.15.92:0/2592778824 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa30c1aae40 con 0x7fa30c101df0 2024-09-19T09:11:40.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.172+0000 7fa30affd640 1 --2- 172.21.15.92:0/2592778824 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa30c1027a0 0x7fa30c10b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:11:40.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.173+0000 7fa30b7fe640 1 --2- 172.21.15.92:0/2592778824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa30c101df0 0x7fa30c10af90 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc00e9f0 tx=0x7fa2fc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:40.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.173+0000 7fa308ff9640 1 -- 172.21.15.92:0/2592778824 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc00cd80 con 0x7fa30c101df0 2024-09-19T09:11:40.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.173+0000 7fa308ff9640 1 -- 172.21.15.92:0/2592778824 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2fc010910 con 0x7fa30c101df0 2024-09-19T09:11:40.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.173+0000 7fa308ff9640 1 -- 172.21.15.92:0/2592778824 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc018990 con 0x7fa30c101df0 2024-09-19T09:11:40.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.173+0000 7fa312240640 1 -- 172.21.15.92:0/2592778824 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa30c1ab010 con 0x7fa30c101df0 2024-09-19T09:11:40.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.173+0000 7fa312240640 1 -- 172.21.15.92:0/2592778824 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa30c1ab470 con 0x7fa30c101df0 2024-09-19T09:11:40.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.177+0000 7fa308ff9640 1 -- 172.21.15.92:0/2592778824 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa2fc010ac0 con 0x7fa30c101df0 2024-09-19T09:11:40.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.177+0000 7fa314619740 1 Processor -- start 2024-09-19T09:11:40.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.178+0000 7fa314619740 1 -- start start 2024-09-19T09:11:40.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.178+0000 7fa314619740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec73bab850 0x55ec73babc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:40.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.178+0000 7fa314619740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec73bac170 0x55ec73bb64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:40.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.178+0000 7fa314619740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec73bb6a30 0x55ec73bb8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:40.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.178+0000 7fa314619740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ec73b10160 con 0x55ec73bb6a30 2024-09-19T09:11:40.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.178+0000 7fa314619740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ec73ab7720 con 0x55ec73bac170 2024-09-19T09:11:40.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.178+0000 7fa314619740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ec73b0c120 con 0x55ec73bab850 2024-09-19T09:11:40.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.178+0000 7fa30b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec73bac170 0x55ec73bb64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:40.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.178+0000 7fa30affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec73bb6a30 0x55ec73bb8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:40.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.178+0000 7fa30b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec73bac170 0x55ec73bb64f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:33392/0 (socket says 172.21.15.92:33392) 2024-09-19T09:11:40.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.178+0000 7fa30b7fe640 1 -- 172.21.15.92:0/2309032613 learned_addr learned my addr 172.21.15.92:0/2309032613 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:40.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.178+0000 7fa30bfff640 1 --2- 172.21.15.92:0/2309032613 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec73bab850 0x55ec73babc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:40.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.178+0000 7fa30b7fe640 1 -- 172.21.15.92:0/2309032613 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec73bab850 msgr2=0x55ec73babc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:40.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.178+0000 7fa308ff9640 1 --2- 172.21.15.92:0/2592778824 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa2f40a32c0 0x7fa2f40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:40.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.178+0000 7fa30b7fe640 1 --2- 172.21.15.92:0/2309032613 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec73bab850 0x55ec73babc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:40.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.178+0000 7fa30b7fe640 1 -- 172.21.15.92:0/2309032613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec73bb6a30 msgr2=0x55ec73bb8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:40.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.178+0000 7fa30b7fe640 1 --2- 172.21.15.92:0/2309032613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec73bb6a30 0x55ec73bb8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:40.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.178+0000 7fa30b7fe640 1 -- 172.21.15.92:0/2309032613 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec73881ba0 con 0x55ec73bac170 2024-09-19T09:11:40.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.179+0000 7fa308ff9640 1 -- 172.21.15.92:0/2592778824 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa2fc0cfb80 con 0x7fa30c101df0 2024-09-19T09:11:40.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.179+0000 7fa30b7fe640 1 --2- 172.21.15.92:0/2309032613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec73bac170 0x55ec73bb64f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc0a2a80 tx=0x7fa2fc098320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af316690ebc823c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:40.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.179+0000 7fa30bfff640 1 --2- 172.21.15.92:0/2592778824 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa2f40a32c0 0x7fa2f40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:40.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.179+0000 7fa2f1ffb640 1 -- 172.21.15.92:0/2309032613 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc09c020 con 0x55ec73bac170 2024-09-19T09:11:40.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.179+0000 7fa2f1ffb640 1 -- 172.21.15.92:0/2309032613 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2fc0a2630 con 0x55ec73bac170 2024-09-19T09:11:40.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.179+0000 7fa2f1ffb640 1 -- 172.21.15.92:0/2309032613 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc09bbb0 con 0x55ec73bac170 2024-09-19T09:11:40.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.180+0000 7fa314619740 1 -- 172.21.15.92:0/2309032613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec73bac170 msgr2=0x55ec73bb64f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:40.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.180+0000 7fa30bfff640 1 --2- 172.21.15.92:0/2592778824 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa2f40a32c0 0x7fa2f40a5780 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa304005fd0 tx=0x7fa304004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:40.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.180+0000 7fa314619740 1 --2- 172.21.15.92:0/2309032613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec73bac170 0x55ec73bb64f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc0a2a80 tx=0x7fa2fc098320 comp rx=0 tx=0).stop 2024-09-19T09:11:40.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.181+0000 7fa314619740 1 -- 172.21.15.92:0/2309032613 shutdown_connections 2024-09-19T09:11:40.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.181+0000 7fa314619740 1 --2- 172.21.15.92:0/2309032613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec73bb6a30 0x55ec73bb8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:40.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.181+0000 7fa314619740 1 --2- 172.21.15.92:0/2309032613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec73bac170 0x55ec73bb64f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:40.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.181+0000 7fa314619740 1 --2- 172.21.15.92:0/2309032613 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec73bab850 0x55ec73babc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:40.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.181+0000 7fa314619740 1 -- 172.21.15.92:0/2309032613 >> 172.21.15.92:0/2309032613 conn(0x55ec73ba7de0 msgr2=0x55ec73ba81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:40.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.189+0000 7fa314619740 1 -- 172.21.15.92:0/2309032613 shutdown_connections 2024-09-19T09:11:40.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.190+0000 7fa314619740 1 -- 172.21.15.92:0/2309032613 wait complete. 2024-09-19T09:11:40.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.190+0000 7fa314619740 1 -- start start 2024-09-19T09:11:40.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.190+0000 7fa314619740 1 Processor -- start 2024-09-19T09:11:40.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.191+0000 7fa314619740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec73bab850 0x55ec73bb3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:40.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.191+0000 7fa314619740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec73bac170 0x55ec73bb3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:40.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.191+0000 7fa314619740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec73bb6a30 0x55ec73bb43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:40.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.191+0000 7fa314619740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ec73bb9600 con 0x55ec73bac170 2024-09-19T09:11:40.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.191+0000 7fa314619740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ec73a98900 con 0x55ec73bab850 2024-09-19T09:11:40.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.191+0000 7fa314619740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55ec73bb9780 con 0x55ec73bb6a30 2024-09-19T09:11:40.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.191+0000 7fa314619740 10 client.0 _ll_register_callbacks cb 0x55ec73a96780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:11:40.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.192+0000 7fa30affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec73bac170 0x55ec73bb3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:40.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.192+0000 7fa30affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec73bac170 0x55ec73bb3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57706/0 (socket says 172.21.15.92:57706) 2024-09-19T09:11:40.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.192+0000 7fa30affd640 1 -- 172.21.15.92:0/4284101205 learned_addr learned my addr 172.21.15.92:0/4284101205 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:40.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.192+0000 7fa30b7fe640 1 --2- 172.21.15.92:0/4284101205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec73bab850 0x55ec73bb3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:40.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.196+0000 7fa30bfff640 1 --2- 172.21.15.92:0/4284101205 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec73bb6a30 0x55ec73bb43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:40.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.197+0000 7fa30b7fe640 1 -- 172.21.15.92:0/4284101205 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec73bb6a30 msgr2=0x55ec73bb43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:40.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.197+0000 7fa30b7fe640 1 --2- 172.21.15.92:0/4284101205 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec73bb6a30 0x55ec73bb43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:40.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.197+0000 7fa30b7fe640 1 -- 172.21.15.92:0/4284101205 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec73bac170 msgr2=0x55ec73bb3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:40.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.197+0000 7fa30b7fe640 1 --2- 172.21.15.92:0/4284101205 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec73bac170 0x55ec73bb3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:40.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.197+0000 7fa30b7fe640 1 -- 172.21.15.92:0/4284101205 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec73ad8c50 con 0x55ec73bab850 2024-09-19T09:11:40.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.200+0000 7fa30b7fe640 1 --2- 172.21.15.92:0/4284101205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec73bab850 0x55ec73bb3970 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc086000 tx=0x7fa2fc009720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9a8f2389ecd01b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:40.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.200+0000 7fa2eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T09:11:40.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.200+0000 7fa2eaffd640 1 -- 172.21.15.92:0/4284101205 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc09bd90 con 0x55ec73bab850 2024-09-19T09:11:40.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.200+0000 7fa2eaffd640 1 -- 172.21.15.92:0/4284101205 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa2fc09a550 con 0x55ec73bab850 2024-09-19T09:11:40.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.204+0000 7fa314619740 1 -- 172.21.15.92:0/4284101205 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2fc0a2630 con 0x55ec73bab850 2024-09-19T09:11:40.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.209+0000 7fa2eaffd640 1 -- 172.21.15.92:0/4284101205 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa2fc09bbb0 con 0x55ec73bab850 2024-09-19T09:11:40.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.210+0000 7fa314619740 10 client.28124 fetch_fsmap learned FSMap version 19 2024-09-19T09:11:40.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.210+0000 7fa314619740 1 -- 172.21.15.92:0/4284101205 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ec73bbb310 con 0x55ec73bab850 2024-09-19T09:11:40.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.210+0000 7fa2eaffd640 1 -- 172.21.15.92:0/4284101205 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2fc0a2630 con 0x55ec73bab850 2024-09-19T09:11:40.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.210+0000 7fa2eaffd640 1 -- 172.21.15.92:0/4284101205 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fa2fc0988c0 con 0x55ec73bab850 2024-09-19T09:11:40.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.211+0000 7fa314619740 10 client.28124 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:11:40.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.211+0000 7fa314619740 10 client.28124 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:11:40.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.211+0000 7fa314619740 20 client.28124 populate_metadata read hostname 'smithi092' 2024-09-19T09:11:40.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.211+0000 7fa314619740 1 --2- 172.21.15.92:0/4284101205 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ec73bbc720 0x55ec73bbeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:40.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.211+0000 7fa314619740 4 client.28124 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:11:40.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.211+0000 7fa314619740 1 -- 172.21.15.92:0/4284101205 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec73b1d890 con 0x55ec73bbc720 2024-09-19T09:11:40.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.213+0000 7fa30affd640 1 --2- 172.21.15.92:0/4284101205 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ec73bbc720 0x55ec73bbeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:40.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.219+0000 7fa2eaffd640 10 client.28124 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:40.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.219+0000 7fa30affd640 1 --2- 172.21.15.92:0/4284101205 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ec73bbc720 0x55ec73bbeb60 crc :-1 s=READY pgs=446 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66186f3b83fd4aab server_cookie=d23efceb81a506b9 in_seq=0 out_seq=0 2024-09-19T09:11:40.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.227+0000 7fa2eaffd640 1 -- 172.21.15.92:0/4284101205 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ec73b1d890 con 0x55ec73bbc720 2024-09-19T09:11:40.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.227+0000 7fa2eaffd640 10 client.28124 handle_command_reply: tid=0 2024-09-19T09:11:40.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.227+0000 7fa314619740 1 client.28124 shutdown 2024-09-19T09:11:40.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.232+0000 7fa314619740 1 -- 172.21.15.92:0/4284101205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec73bab850 msgr2=0x55ec73bb3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:40.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.232+0000 7fa314619740 1 --2- 172.21.15.92:0/4284101205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec73bab850 0x55ec73bb3970 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc086000 tx=0x7fa2fc009720 comp rx=0 tx=0).stop 2024-09-19T09:11:40.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.232+0000 7fa314619740 1 -- 172.21.15.92:0/4284101205 shutdown_connections 2024-09-19T09:11:40.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.232+0000 7fa314619740 1 --2- 172.21.15.92:0/4284101205 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ec73bbc720 0x55ec73bbeb60 crc :-1 s=READY pgs=446 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:40.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.232+0000 7fa314619740 1 --2- 172.21.15.92:0/4284101205 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec73bb6a30 0x55ec73bb43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:40.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.232+0000 7fa314619740 1 --2- 172.21.15.92:0/4284101205 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec73bac170 0x55ec73bb3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:40.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.232+0000 7fa314619740 1 --2- 172.21.15.92:0/4284101205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec73bab850 0x55ec73bb3970 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:40.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.232+0000 7fa314619740 1 -- 172.21.15.92:0/4284101205 >> 172.21.15.92:0/4284101205 conn(0x55ec73ba7de0 msgr2=0x55ec73badac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:40.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.232+0000 7fa2eaffd640 0 client.28124 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:40.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.233+0000 7fa314619740 1 -- 172.21.15.92:0/4284101205 shutdown_connections 2024-09-19T09:11:40.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.233+0000 7fa314619740 1 -- 172.21.15.92:0/4284101205 wait complete. 2024-09-19T09:11:40.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.233+0000 7fa314619740 20 client.28124 trim_cache size 0 max 16384 2024-09-19T09:11:40.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.260+0000 7fa314619740 1 Processor -- start 2024-09-19T09:11:40.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.261+0000 7fa314619740 1 -- start start 2024-09-19T09:11:40.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.261+0000 7fa314619740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec73bab850 0x55ec73bb4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:40.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.261+0000 7fa314619740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec73bac170 0x55ec73bb2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:40.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.261+0000 7fa314619740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec73bb6a30 0x55ec73bb0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:40.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.261+0000 7fa314619740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa30c1021d0 con 0x55ec73bab850 2024-09-19T09:11:40.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.261+0000 7fa314619740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa30c1abcd0 con 0x55ec73bb6a30 2024-09-19T09:11:40.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.261+0000 7fa314619740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa30c11bff0 con 0x55ec73bac170 2024-09-19T09:11:40.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.261+0000 7fa30affd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec73bac170 0x55ec73bb2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:40.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.261+0000 7fa30affd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec73bac170 0x55ec73bb2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:42140/0 (socket says 172.21.15.92:42140) 2024-09-19T09:11:40.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.261+0000 7fa30affd640 1 -- 172.21.15.92:0/591229128 learned_addr learned my addr 172.21.15.92:0/591229128 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:40.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.261+0000 7fa30bfff640 1 --2- 172.21.15.92:0/591229128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec73bb6a30 0x55ec73bb0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:40.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.261+0000 7fa30b7fe640 1 --2- 172.21.15.92:0/591229128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec73bab850 0x55ec73bb4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:40.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.262+0000 7fa30b7fe640 1 -- 172.21.15.92:0/591229128 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec73bac170 msgr2=0x55ec73bb2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:40.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.262+0000 7fa30b7fe640 1 --2- 172.21.15.92:0/591229128 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec73bac170 0x55ec73bb2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:40.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.262+0000 7fa30b7fe640 1 -- 172.21.15.92:0/591229128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec73bb6a30 msgr2=0x55ec73bb0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:40.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.262+0000 7fa30b7fe640 1 --2- 172.21.15.92:0/591229128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec73bb6a30 0x55ec73bb0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:40.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.262+0000 7fa30b7fe640 1 -- 172.21.15.92:0/591229128 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec73bb62e0 con 0x55ec73bab850 2024-09-19T09:11:40.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.262+0000 7fa30b7fe640 1 --2- 172.21.15.92:0/591229128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec73bab850 0x55ec73bb4240 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc00e9c0 tx=0x7fa2fc018420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2467cd7624256ec0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:40.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.262+0000 7fa2f17fa640 1 -- 172.21.15.92:0/591229128 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc09c020 con 0x55ec73bab850 2024-09-19T09:11:40.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.262+0000 7fa2f17fa640 1 -- 172.21.15.92:0/591229128 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2fc0d33d0 con 0x55ec73bab850 2024-09-19T09:11:40.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.262+0000 7fa2f17fa640 1 -- 172.21.15.92:0/591229128 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc0a4e10 con 0x55ec73bab850 2024-09-19T09:11:40.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.263+0000 7fa314619740 1 -- 172.21.15.92:0/591229128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec73bab850 msgr2=0x55ec73bb4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:40.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.263+0000 7fa314619740 1 --2- 172.21.15.92:0/591229128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec73bab850 0x55ec73bb4240 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc00e9c0 tx=0x7fa2fc018420 comp rx=0 tx=0).stop 2024-09-19T09:11:40.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.263+0000 7fa314619740 1 -- 172.21.15.92:0/591229128 shutdown_connections 2024-09-19T09:11:40.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.263+0000 7fa314619740 1 --2- 172.21.15.92:0/591229128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec73bb6a30 0x55ec73bb0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:40.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.263+0000 7fa314619740 1 --2- 172.21.15.92:0/591229128 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec73bac170 0x55ec73bb2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:40.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.263+0000 7fa314619740 1 --2- 172.21.15.92:0/591229128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec73bab850 0x55ec73bb4240 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:40.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.263+0000 7fa314619740 1 -- 172.21.15.92:0/591229128 >> 172.21.15.92:0/591229128 conn(0x55ec73ba7de0 msgr2=0x55ec73bb2110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:40.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.263+0000 7fa314619740 1 -- 172.21.15.92:0/591229128 shutdown_connections 2024-09-19T09:11:40.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.263+0000 7fa314619740 1 -- 172.21.15.92:0/591229128 wait complete. 2024-09-19T09:11:40.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.264+0000 7fa314619740 1 -- start start 2024-09-19T09:11:40.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.264+0000 7fa314619740 1 Processor -- start 2024-09-19T09:11:40.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.264+0000 7fa314619740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec73bab850 0x55ec73bc4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:40.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.264+0000 7fa314619740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec73bac170 0x55ec73bc1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:40.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.264+0000 7fa314619740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec73bb6a30 0x55ec73bc2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:40.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.264+0000 7fa314619740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa30c11c6c0 con 0x55ec73bb6a30 2024-09-19T09:11:40.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.264+0000 7fa314619740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa30c1ab6a0 con 0x55ec73bab850 2024-09-19T09:11:40.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.264+0000 7fa314619740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa30c11cd90 con 0x55ec73bac170 2024-09-19T09:11:40.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.264+0000 7fa314619740 10 client.0 _ll_register_callbacks cb 0x7fa300009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:11:40.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.264+0000 7fa30affd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec73bac170 0x55ec73bc1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:40.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.264+0000 7fa30affd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec73bac170 0x55ec73bc1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:42144/0 (socket says 172.21.15.92:42144) 2024-09-19T09:11:40.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.265+0000 7fa30affd640 1 -- 172.21.15.92:0/520373734 learned_addr learned my addr 172.21.15.92:0/520373734 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:40.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.265+0000 7fa30affd640 1 -- 172.21.15.92:0/520373734 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec73bab850 msgr2=0x55ec73bc4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:40.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.265+0000 7fa30affd640 1 --2- 172.21.15.92:0/520373734 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec73bab850 0x55ec73bc4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:40.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.265+0000 7fa30affd640 1 -- 172.21.15.92:0/520373734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec73bb6a30 msgr2=0x55ec73bc2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:40.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.265+0000 7fa30affd640 1 --2- 172.21.15.92:0/520373734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec73bb6a30 0x55ec73bc2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:40.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.265+0000 7fa30affd640 1 -- 172.21.15.92:0/520373734 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec73bc2d30 con 0x55ec73bac170 2024-09-19T09:11:40.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.265+0000 7fa30affd640 1 --2- 172.21.15.92:0/520373734 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec73bac170 0x55ec73bc1f80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa300009900 tx=0x7fa3000051f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2605e20c8060676a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:40.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.265+0000 7fa2eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:11:40.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.265+0000 7fa2eaffd640 1 -- 172.21.15.92:0/520373734 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa300035040 con 0x55ec73bac170 2024-09-19T09:11:40.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.266+0000 7fa2eaffd640 1 -- 172.21.15.92:0/520373734 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa300004760 con 0x55ec73bac170 2024-09-19T09:11:40.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.266+0000 7fa314619740 1 -- 172.21.15.92:0/520373734 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2fc0d33d0 con 0x55ec73bac170 2024-09-19T09:11:40.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.266+0000 7fa2eaffd640 1 -- 172.21.15.92:0/520373734 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa300057050 con 0x55ec73bac170 2024-09-19T09:11:40.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.266+0000 7fa314619740 10 client.28024 fetch_fsmap learned FSMap version 19 2024-09-19T09:11:40.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.266+0000 7fa314619740 1 -- 172.21.15.92:0/520373734 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ec73c52c70 con 0x55ec73bac170 2024-09-19T09:11:40.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.266+0000 7fa2eaffd640 1 -- 172.21.15.92:0/520373734 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa300004e40 con 0x55ec73bac170 2024-09-19T09:11:40.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.266+0000 7fa2eaffd640 1 -- 172.21.15.92:0/520373734 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fa3000035f0 con 0x55ec73bac170 2024-09-19T09:11:40.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.266+0000 7fa314619740 10 client.28024 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:11:40.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.266+0000 7fa314619740 10 client.28024 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:11:40.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.266+0000 7fa314619740 20 client.28024 populate_metadata read hostname 'smithi092' 2024-09-19T09:11:40.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.266+0000 7fa314619740 1 --2- 172.21.15.92:0/520373734 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ec73c53490 0x55ec73c558f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:40.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.266+0000 7fa314619740 4 client.28024 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.45, "await_for": 45.0}] 2024-09-19T09:11:40.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.266+0000 7fa314619740 1 -- 172.21.15.92:0/520373734 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.45, "await_for": 45.0}) -- 0x7fa2fc0d33d0 con 0x55ec73c53490 2024-09-19T09:11:40.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.267+0000 7fa30b7fe640 1 --2- 172.21.15.92:0/520373734 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ec73c53490 0x55ec73c558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:40.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.267+0000 7fa2eaffd640 10 client.28024 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:40.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.267+0000 7fa30b7fe640 1 --2- 172.21.15.92:0/520373734 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ec73c53490 0x55ec73c558f0 crc :-1 s=READY pgs=447 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=359c3587ee8ccb9a server_cookie=281e6d87aad8ac1e in_seq=0 out_seq=0 2024-09-19T09:11:40.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.503+0000 7fa2eaffd640 1 -- 172.21.15.92:0/520373734 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7fa2fc0d33d0 con 0x55ec73c53490 2024-09-19T09:11:40.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.503+0000 7fa2eaffd640 10 client.28024 handle_command_reply: tid=0 2024-09-19T09:11:40.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.503+0000 7fa314619740 1 client.28024 shutdown 2024-09-19T09:11:40.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.503+0000 7fa314619740 1 -- 172.21.15.92:0/520373734 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec73bac170 msgr2=0x55ec73bc1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:40.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.503+0000 7fa314619740 1 --2- 172.21.15.92:0/520373734 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec73bac170 0x55ec73bc1f80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa300009900 tx=0x7fa3000051f0 comp rx=0 tx=0).stop 2024-09-19T09:11:40.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.503+0000 7fa314619740 1 -- 172.21.15.92:0/520373734 shutdown_connections 2024-09-19T09:11:40.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.503+0000 7fa314619740 1 --2- 172.21.15.92:0/520373734 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55ec73c53490 0x55ec73c558f0 crc :-1 s=READY pgs=447 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:40.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.503+0000 7fa314619740 1 --2- 172.21.15.92:0/520373734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec73bb6a30 0x55ec73bc2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:40.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.503+0000 7fa314619740 1 --2- 172.21.15.92:0/520373734 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec73bac170 0x55ec73bc1f80 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:40.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.503+0000 7fa2eaffd640 0 client.28024 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:40.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.503+0000 7fa314619740 1 --2- 172.21.15.92:0/520373734 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec73bab850 0x55ec73bc4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:40.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.503+0000 7fa314619740 1 -- 172.21.15.92:0/520373734 >> 172.21.15.92:0/520373734 conn(0x55ec73ba7de0 msgr2=0x55ec73ba6ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:40.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.503+0000 7fa314619740 1 -- 172.21.15.92:0/520373734 shutdown_connections 2024-09-19T09:11:40.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.503+0000 7fa314619740 1 -- 172.21.15.92:0/520373734 wait complete. 2024-09-19T09:11:40.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.503+0000 7fa314619740 20 client.28024 trim_cache size 0 max 16384 2024-09-19T09:11:40.507 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:11:40.507 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 19, 2024-09-19T09:11:40.507 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24472, 2024-09-19T09:11:40.507 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 54, 2024-09-19T09:11:40.507 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-09-19T09:11:40.507 INFO:teuthology.orchestra.run.smithi092.stdout: "da998558": { 2024-09-19T09:11:40.507 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 54, 2024-09-19T09:11:40.507 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-09-19T09:11:40.507 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:11:40.507 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-09-19T09:11:40.508 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:11:40.508 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:11:40.508 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 90.0, 2024-09-19T09:11:40.508 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 149.4, 2024-09-19T09:11:40.508 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-09-19T09:11:40.508 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-09-19T09:11:40.508 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-09-19T09:11:40.508 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:11:40.508 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-09-19T09:11:40.508 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:11:40.509 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:11:40.509 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:11:40.509 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:11:40.509 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:11:40.509 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:11:40.509 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:11:40.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.504+0000 7fa312240640 1 -- 172.21.15.92:0/2592778824 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa2f40a32c0 msgr2=0x7fa2f40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:40.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.504+0000 7fa312240640 1 --2- 172.21.15.92:0/2592778824 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa2f40a32c0 0x7fa2f40a5780 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa304005fd0 tx=0x7fa304004a40 comp rx=0 tx=0).stop 2024-09-19T09:11:40.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.504+0000 7fa312240640 1 -- 172.21.15.92:0/2592778824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa30c101df0 msgr2=0x7fa30c10af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:40.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.504+0000 7fa312240640 1 --2- 172.21.15.92:0/2592778824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa30c101df0 0x7fa30c10af90 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc00e9f0 tx=0x7fa2fc00eeb0 comp rx=0 tx=0).stop 2024-09-19T09:11:40.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.504+0000 7fa312240640 1 -- 172.21.15.92:0/2592778824 shutdown_connections 2024-09-19T09:11:40.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.504+0000 7fa312240640 1 --2- 172.21.15.92:0/2592778824 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa30c106f20 0x7fa30c1aa900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:40.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.504+0000 7fa312240640 1 --2- 172.21.15.92:0/2592778824 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa30c1027a0 0x7fa30c10b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:40.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.504+0000 7fa312240640 1 --2- 172.21.15.92:0/2592778824 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa2f40a32c0 0x7fa2f40a5780 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:40.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.504+0000 7fa312240640 1 --2- 172.21.15.92:0/2592778824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa30c101df0 0x7fa30c10af90 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:40.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.504+0000 7fa312240640 1 -- 172.21.15.92:0/2592778824 >> 172.21.15.92:0/2592778824 conn(0x7fa30c0fd8b0 msgr2=0x7fa30c0fe470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:40.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.504+0000 7fa312240640 1 -- 172.21.15.92:0/2592778824 shutdown_connections 2024-09-19T09:11:40.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:40.504+0000 7fa312240640 1 -- 172.21.15.92:0/2592778824 wait complete. 2024-09-19T09:11:40.795 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 895.0 s, 1859.9 tps, lat 335.407 ms stddev 2831.360 2024-09-19T09:11:40.985 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:40 smithi092 ceph-mon[31407]: pgmap v786: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 17 MiB/s wr, 601 op/s 2024-09-19T09:11:41.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:40 smithi167 ceph-mon[35359]: pgmap v786: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 17 MiB/s wr, 601 op/s 2024-09-19T09:11:41.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:40 smithi190 ceph-mon[35358]: pgmap v786: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 17 MiB/s wr, 601 op/s 2024-09-19T09:11:41.274 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'da998558', quiesce took 4.0 seconds. Will release after: 25.45 2024-09-19T09:11:42.265 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.261+0000 7ff899c7b640 1 -- 172.21.15.92:0/2029723645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff894102600 msgr2=0x7ff894108e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:42.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.261+0000 7ff899c7b640 1 --2- 172.21.15.92:0/2029723645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff894102600 0x7ff894108e90 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7ff88c009ca0 tx=0x7ff88c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:11:42.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.261+0000 7ff899c7b640 1 -- 172.21.15.92:0/2029723645 shutdown_connections 2024-09-19T09:11:42.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.261+0000 7ff899c7b640 1 --2- 172.21.15.92:0/2029723645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff894102600 0x7ff894108e90 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:42.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.261+0000 7ff899c7b640 1 --2- 172.21.15.92:0/2029723645 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff894101c40 0x7ff8941020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:42.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.261+0000 7ff899c7b640 1 --2- 172.21.15.92:0/2029723645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff894100a50 0x7ff894100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:42.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.261+0000 7ff899c7b640 1 -- 172.21.15.92:0/2029723645 >> 172.21.15.92:0/2029723645 conn(0x7ff8940fc1b0 msgr2=0x7ff8940fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:42.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.262+0000 7ff899c7b640 1 -- 172.21.15.92:0/2029723645 shutdown_connections 2024-09-19T09:11:42.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.262+0000 7ff899c7b640 1 -- 172.21.15.92:0/2029723645 wait complete. 2024-09-19T09:11:42.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.262+0000 7ff899c7b640 1 Processor -- start 2024-09-19T09:11:42.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.262+0000 7ff899c7b640 1 -- start start 2024-09-19T09:11:42.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.262+0000 7ff899c7b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff894100a50 0x7ff894197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:42.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.262+0000 7ff899c7b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff894101c40 0x7ff8941982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:42.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.262+0000 7ff899c7b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff894102600 0x7ff89419f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:42.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.263+0000 7ff899c7b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff89410c6d0 con 0x7ff894101c40 2024-09-19T09:11:42.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.263+0000 7ff899c7b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff89410c550 con 0x7ff894102600 2024-09-19T09:11:42.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.263+0000 7ff899c7b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff89410c850 con 0x7ff894100a50 2024-09-19T09:11:42.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.263+0000 7ff892ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff894101c40 0x7ff8941982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:42.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.263+0000 7ff892ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff894101c40 0x7ff8941982b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33638/0 (socket says 172.21.15.92:33638) 2024-09-19T09:11:42.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.263+0000 7ff892ffd640 1 -- 172.21.15.92:0/362125303 learned_addr learned my addr 172.21.15.92:0/362125303 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:42.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.263+0000 7ff8937fe640 1 --2- 172.21.15.92:0/362125303 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff894100a50 0x7ff894197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:42.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.263+0000 7ff893fff640 1 --2- 172.21.15.92:0/362125303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff894102600 0x7ff89419f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:42.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.263+0000 7ff892ffd640 1 -- 172.21.15.92:0/362125303 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff894100a50 msgr2=0x7ff894197d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:42.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.263+0000 7ff892ffd640 1 --2- 172.21.15.92:0/362125303 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff894100a50 0x7ff894197d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:42.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.263+0000 7ff892ffd640 1 -- 172.21.15.92:0/362125303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff894102600 msgr2=0x7ff89419f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:42.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.263+0000 7ff892ffd640 1 --2- 172.21.15.92:0/362125303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff894102600 0x7ff89419f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:42.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.263+0000 7ff892ffd640 1 -- 172.21.15.92:0/362125303 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff89419f990 con 0x7ff894101c40 2024-09-19T09:11:42.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.263+0000 7ff892ffd640 1 --2- 172.21.15.92:0/362125303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff894101c40 0x7ff8941982b0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7ff88800d770 tx=0x7ff88800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:42.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.263+0000 7ff890ff9640 1 -- 172.21.15.92:0/362125303 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff888017070 con 0x7ff894101c40 2024-09-19T09:11:42.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.263+0000 7ff890ff9640 1 -- 172.21.15.92:0/362125303 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff888005500 con 0x7ff894101c40 2024-09-19T09:11:42.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.263+0000 7ff890ff9640 1 -- 172.21.15.92:0/362125303 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff888004e00 con 0x7ff894101c40 2024-09-19T09:11:42.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.263+0000 7ff899c7b640 1 -- 172.21.15.92:0/362125303 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff89419fc80 con 0x7ff894101c40 2024-09-19T09:11:42.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.263+0000 7ff899c7b640 1 -- 172.21.15.92:0/362125303 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8941a0180 con 0x7ff894101c40 2024-09-19T09:11:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.266+0000 7ff890ff9640 1 -- 172.21.15.92:0/362125303 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff888004fa0 con 0x7ff894101c40 2024-09-19T09:11:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.266+0000 7ff89ca19740 1 Processor -- start 2024-09-19T09:11:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.266+0000 7ff89ca19740 1 -- start start 2024-09-19T09:11:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.266+0000 7ff89ca19740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55989a3c79a0 0x55989a3c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.266+0000 7ff89ca19740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55989a3c82e0 0x55989a3ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.266+0000 7ff89ca19740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55989a3cd370 0x55989a3cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.266+0000 7ff89ca19740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55989a32b2f0 con 0x55989a3c79a0 2024-09-19T09:11:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.266+0000 7ff89ca19740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55989a2d3270 con 0x55989a3c82e0 2024-09-19T09:11:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.266+0000 7ff89ca19740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55989a3272b0 con 0x55989a3cd370 2024-09-19T09:11:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.266+0000 7ff893fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55989a3c79a0 0x55989a3c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.266+0000 7ff893fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55989a3c79a0 0x55989a3c7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33646/0 (socket says 172.21.15.92:33646) 2024-09-19T09:11:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.266+0000 7ff893fff640 1 -- 172.21.15.92:0/804140296 learned_addr learned my addr 172.21.15.92:0/804140296 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.266+0000 7ff890ff9640 1 --2- 172.21.15.92:0/362125303 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff87c0a32f0 0x7ff87c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.266+0000 7ff8937fe640 1 --2- 172.21.15.92:0/804140296 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55989a3c82e0 0x55989a3ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.267+0000 7ff893fff640 1 -- 172.21.15.92:0/804140296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55989a3cd370 msgr2=0x55989a3cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.267+0000 7ff892ffd640 1 --2- 172.21.15.92:0/804140296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55989a3cd370 0x55989a3cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.267+0000 7ff890ff9640 1 -- 172.21.15.92:0/362125303 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff8880cf2e0 con 0x7ff894101c40 2024-09-19T09:11:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.267+0000 7ff893fff640 1 --2- 172.21.15.92:0/804140296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55989a3cd370 0x55989a3cf830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:42.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.267+0000 7ff893fff640 1 -- 172.21.15.92:0/804140296 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55989a3c82e0 msgr2=0x55989a3ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:42.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.267+0000 7ff893fff640 1 --2- 172.21.15.92:0/804140296 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55989a3c82e0 0x55989a3ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:42.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.267+0000 7ff893fff640 1 -- 172.21.15.92:0/804140296 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55989a2d2340 con 0x55989a3c79a0 2024-09-19T09:11:42.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.267+0000 7ff8937fe640 1 --2- 172.21.15.92:0/804140296 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55989a3c82e0 0x55989a3ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:11:42.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.267+0000 7ff892ffd640 1 --2- 172.21.15.92:0/804140296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55989a3cd370 0x55989a3cf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:11:42.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.267+0000 7ff893fff640 1 --2- 172.21.15.92:0/362125303 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff87c0a32f0 0x7ff87c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:42.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.267+0000 7ff893fff640 1 --2- 172.21.15.92:0/804140296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55989a3c79a0 0x55989a3c7da0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7ff88c005cc0 tx=0x7ff88c005fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23004a7f44352ce9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:42.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.267+0000 7ff879ffb640 1 -- 172.21.15.92:0/804140296 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff88c041040 con 0x55989a3c79a0 2024-09-19T09:11:42.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.267+0000 7ff879ffb640 1 -- 172.21.15.92:0/804140296 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff88c036070 con 0x55989a3c79a0 2024-09-19T09:11:42.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.267+0000 7ff879ffb640 1 -- 172.21.15.92:0/804140296 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff88c02fb40 con 0x55989a3c79a0 2024-09-19T09:11:42.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.267+0000 7ff893fff640 1 --2- 172.21.15.92:0/362125303 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff87c0a32f0 0x7ff87c0a57b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff88c04c000 tx=0x7ff88c04d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:42.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.268+0000 7ff89ca19740 1 -- 172.21.15.92:0/804140296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55989a3c79a0 msgr2=0x55989a3c7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:42.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.268+0000 7ff89ca19740 1 --2- 172.21.15.92:0/804140296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55989a3c79a0 0x55989a3c7da0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7ff88c005cc0 tx=0x7ff88c005fc0 comp rx=0 tx=0).stop 2024-09-19T09:11:42.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.268+0000 7ff89ca19740 1 -- 172.21.15.92:0/804140296 shutdown_connections 2024-09-19T09:11:42.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.268+0000 7ff89ca19740 1 --2- 172.21.15.92:0/804140296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55989a3cd370 0x55989a3cf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:42.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.268+0000 7ff89ca19740 1 --2- 172.21.15.92:0/804140296 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55989a3c82e0 0x55989a3ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:42.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.268+0000 7ff89ca19740 1 --2- 172.21.15.92:0/804140296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55989a3c79a0 0x55989a3c7da0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:42.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.268+0000 7ff89ca19740 1 -- 172.21.15.92:0/804140296 >> 172.21.15.92:0/804140296 conn(0x55989a3c3010 msgr2=0x55989a3c3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:42.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.268+0000 7ff89ca19740 1 -- 172.21.15.92:0/804140296 shutdown_connections 2024-09-19T09:11:42.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.268+0000 7ff89ca19740 1 -- 172.21.15.92:0/804140296 wait complete. 2024-09-19T09:11:42.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.268+0000 7ff89ca19740 1 -- start start 2024-09-19T09:11:42.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.268+0000 7ff89ca19740 1 Processor -- start 2024-09-19T09:11:42.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.269+0000 7ff89ca19740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55989a3c79a0 0x55989a3d1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:42.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.269+0000 7ff89ca19740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55989a3c82e0 0x55989a3d2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:42.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.269+0000 7ff89ca19740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55989a3cd370 0x55989a3d9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:42.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.269+0000 7ff89ca19740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55989a3d0340 con 0x55989a3c79a0 2024-09-19T09:11:42.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.269+0000 7ff89ca19740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55989a2b4290 con 0x55989a3c82e0 2024-09-19T09:11:42.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.269+0000 7ff89ca19740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55989a3d04c0 con 0x55989a3cd370 2024-09-19T09:11:42.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.269+0000 7ff89ca19740 10 client.0 _ll_register_callbacks cb 0x55989a2e5140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:11:42.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.269+0000 7ff8937fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55989a3c79a0 0x55989a3d1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:42.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.269+0000 7ff8937fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55989a3c79a0 0x55989a3d1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33652/0 (socket says 172.21.15.92:33652) 2024-09-19T09:11:42.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.269+0000 7ff8937fe640 1 -- 172.21.15.92:0/2442614155 learned_addr learned my addr 172.21.15.92:0/2442614155 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:42.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.269+0000 7ff893fff640 1 --2- 172.21.15.92:0/2442614155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55989a3cd370 0x55989a3d9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:42.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.269+0000 7ff892ffd640 1 --2- 172.21.15.92:0/2442614155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55989a3c82e0 0x55989a3d2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:42.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.269+0000 7ff8937fe640 1 -- 172.21.15.92:0/2442614155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55989a3cd370 msgr2=0x55989a3d9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:42.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.269+0000 7ff8937fe640 1 --2- 172.21.15.92:0/2442614155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55989a3cd370 0x55989a3d9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:42.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.269+0000 7ff8937fe640 1 -- 172.21.15.92:0/2442614155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55989a3c82e0 msgr2=0x55989a3d2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.269+0000 7ff8937fe640 1 --2- 172.21.15.92:0/2442614155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55989a3c82e0 0x55989a3d2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.269+0000 7ff8937fe640 1 -- 172.21.15.92:0/2442614155 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55989a03e210 con 0x55989a3c79a0 2024-09-19T09:11:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.269+0000 7ff8937fe640 1 --2- 172.21.15.92:0/2442614155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55989a3c79a0 0x55989a3d1bf0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7ff88400ba80 tx=0x7ff88400bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62b347724563aa70 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.269+0000 7ff872ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:11:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.269+0000 7ff872ffd640 1 -- 172.21.15.92:0/2442614155 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff884003ea0 con 0x55989a3c79a0 2024-09-19T09:11:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.270+0000 7ff872ffd640 1 -- 172.21.15.92:0/2442614155 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff884011640 con 0x55989a3c79a0 2024-09-19T09:11:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.270+0000 7ff89ca19740 1 -- 172.21.15.92:0/2442614155 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff88c036070 con 0x55989a3c79a0 2024-09-19T09:11:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.270+0000 7ff872ffd640 1 -- 172.21.15.92:0/2442614155 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff884011880 con 0x55989a3c79a0 2024-09-19T09:11:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.270+0000 7ff89ca19740 10 client.18951 fetch_fsmap learned FSMap version 19 2024-09-19T09:11:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.270+0000 7ff89ca19740 1 -- 172.21.15.92:0/2442614155 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55989a10a620 con 0x55989a3c79a0 2024-09-19T09:11:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.270+0000 7ff872ffd640 1 -- 172.21.15.92:0/2442614155 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff88c036070 con 0x55989a3c79a0 2024-09-19T09:11:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.270+0000 7ff872ffd640 1 -- 172.21.15.92:0/2442614155 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff884010ce0 con 0x55989a3c79a0 2024-09-19T09:11:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.270+0000 7ff89ca19740 10 client.18951 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:11:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.270+0000 7ff89ca19740 10 client.18951 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:11:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.270+0000 7ff89ca19740 20 client.18951 populate_metadata read hostname 'smithi092' 2024-09-19T09:11:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.270+0000 7ff89ca19740 1 --2- 172.21.15.92:0/2442614155 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55989a3dd8a0 0x55989a3dfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.270+0000 7ff89ca19740 4 client.18951 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:11:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.270+0000 7ff89ca19740 1 -- 172.21.15.92:0/2442614155 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55989a338a20 con 0x55989a3dd8a0 2024-09-19T09:11:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.270+0000 7ff892ffd640 1 --2- 172.21.15.92:0/2442614155 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55989a3dd8a0 0x55989a3dfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.271+0000 7ff892ffd640 1 --2- 172.21.15.92:0/2442614155 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55989a3dd8a0 0x55989a3dfcf0 crc :-1 s=READY pgs=448 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40fed9a6330c2540 server_cookie=e4672882cf9039b in_seq=0 out_seq=0 2024-09-19T09:11:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.271+0000 7ff872ffd640 10 client.18951 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.271+0000 7ff872ffd640 1 -- 172.21.15.92:0/2442614155 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55989a338a20 con 0x55989a3dd8a0 2024-09-19T09:11:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.271+0000 7ff872ffd640 10 client.18951 handle_command_reply: tid=0 2024-09-19T09:11:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.272+0000 7ff89ca19740 1 client.18951 shutdown 2024-09-19T09:11:42.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.272+0000 7ff89ca19740 1 -- 172.21.15.92:0/2442614155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55989a3c79a0 msgr2=0x55989a3d1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:42.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.272+0000 7ff89ca19740 1 --2- 172.21.15.92:0/2442614155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55989a3c79a0 0x55989a3d1bf0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7ff88400ba80 tx=0x7ff88400bf40 comp rx=0 tx=0).stop 2024-09-19T09:11:42.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.272+0000 7ff89ca19740 1 -- 172.21.15.92:0/2442614155 shutdown_connections 2024-09-19T09:11:42.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.272+0000 7ff89ca19740 1 --2- 172.21.15.92:0/2442614155 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55989a3dd8a0 0x55989a3dfcf0 crc :-1 s=READY pgs=448 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:42.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.272+0000 7ff89ca19740 1 --2- 172.21.15.92:0/2442614155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55989a3cd370 0x55989a3d9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:42.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.272+0000 7ff89ca19740 1 --2- 172.21.15.92:0/2442614155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55989a3c82e0 0x55989a3d2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:42.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.272+0000 7ff872ffd640 0 client.18951 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:42.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.272+0000 7ff89ca19740 1 --2- 172.21.15.92:0/2442614155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55989a3c79a0 0x55989a3d1bf0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:42.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.272+0000 7ff89ca19740 1 -- 172.21.15.92:0/2442614155 >> 172.21.15.92:0/2442614155 conn(0x55989a3c3010 msgr2=0x55989a3c4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:42.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.272+0000 7ff89ca19740 1 -- 172.21.15.92:0/2442614155 shutdown_connections 2024-09-19T09:11:42.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.272+0000 7ff89ca19740 1 -- 172.21.15.92:0/2442614155 wait complete. 2024-09-19T09:11:42.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.272+0000 7ff89ca19740 20 client.18951 trim_cache size 0 max 16384 2024-09-19T09:11:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.286+0000 7ff89ca19740 1 Processor -- start 2024-09-19T09:11:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.286+0000 7ff89ca19740 1 -- start start 2024-09-19T09:11:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.286+0000 7ff89ca19740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55989a3c79a0 0x55989a3c4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.286+0000 7ff89ca19740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55989a3c82e0 0x55989a3d9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.286+0000 7ff89ca19740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55989a3cd370 0x55989a3c4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.286+0000 7ff89ca19740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff8941a7010 con 0x55989a3c82e0 2024-09-19T09:11:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.286+0000 7ff89ca19740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff8941a98b0 con 0x55989a3c79a0 2024-09-19T09:11:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.286+0000 7ff89ca19740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff8941a76a0 con 0x55989a3cd370 2024-09-19T09:11:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.286+0000 7ff892ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55989a3c82e0 0x55989a3d9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.286+0000 7ff892ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55989a3c82e0 0x55989a3d9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33654/0 (socket says 172.21.15.92:33654) 2024-09-19T09:11:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.286+0000 7ff892ffd640 1 -- 172.21.15.92:0/4077930385 learned_addr learned my addr 172.21.15.92:0/4077930385 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.287+0000 7ff8937fe640 1 --2- 172.21.15.92:0/4077930385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55989a3c79a0 0x55989a3c4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.287+0000 7ff892ffd640 1 -- 172.21.15.92:0/4077930385 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55989a3cd370 msgr2=0x55989a3c4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.287+0000 7ff892ffd640 1 --2- 172.21.15.92:0/4077930385 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55989a3cd370 0x55989a3c4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.287+0000 7ff892ffd640 1 -- 172.21.15.92:0/4077930385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55989a3c79a0 msgr2=0x55989a3c4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.287+0000 7ff892ffd640 1 --2- 172.21.15.92:0/4077930385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55989a3c79a0 0x55989a3c4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.287+0000 7ff892ffd640 1 -- 172.21.15.92:0/4077930385 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55989a3d1730 con 0x55989a3c82e0 2024-09-19T09:11:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.287+0000 7ff892ffd640 1 --2- 172.21.15.92:0/4077930385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55989a3c82e0 0x55989a3d9130 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7ff88800d740 tx=0x7ff888016310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=949e55e1fbb9dd51 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.287+0000 7ff8797fa640 1 -- 172.21.15.92:0/4077930385 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8880860d0 con 0x55989a3c82e0 2024-09-19T09:11:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.287+0000 7ff8797fa640 1 -- 172.21.15.92:0/4077930385 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff88809fcb0 con 0x55989a3c82e0 2024-09-19T09:11:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.287+0000 7ff8797fa640 1 -- 172.21.15.92:0/4077930385 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff888097f70 con 0x55989a3c82e0 2024-09-19T09:11:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.288+0000 7ff89ca19740 1 -- 172.21.15.92:0/4077930385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55989a3c82e0 msgr2=0x55989a3d9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.288+0000 7ff89ca19740 1 --2- 172.21.15.92:0/4077930385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55989a3c82e0 0x55989a3d9130 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7ff88800d740 tx=0x7ff888016310 comp rx=0 tx=0).stop 2024-09-19T09:11:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.288+0000 7ff89ca19740 1 -- 172.21.15.92:0/4077930385 shutdown_connections 2024-09-19T09:11:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.288+0000 7ff89ca19740 1 --2- 172.21.15.92:0/4077930385 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55989a3cd370 0x55989a3c4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.288+0000 7ff89ca19740 1 --2- 172.21.15.92:0/4077930385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55989a3c82e0 0x55989a3d9130 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.288+0000 7ff89ca19740 1 --2- 172.21.15.92:0/4077930385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55989a3c79a0 0x55989a3c4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.288+0000 7ff89ca19740 1 -- 172.21.15.92:0/4077930385 >> 172.21.15.92:0/4077930385 conn(0x55989a3c3010 msgr2=0x55989a3c21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.288+0000 7ff89ca19740 1 -- 172.21.15.92:0/4077930385 shutdown_connections 2024-09-19T09:11:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.288+0000 7ff89ca19740 1 -- 172.21.15.92:0/4077930385 wait complete. 2024-09-19T09:11:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.288+0000 7ff89ca19740 1 -- start start 2024-09-19T09:11:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.288+0000 7ff89ca19740 1 Processor -- start 2024-09-19T09:11:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.288+0000 7ff89ca19740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55989a3c79a0 0x55989a3d8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.288+0000 7ff89ca19740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55989a3c82e0 0x55989a3d9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.288+0000 7ff89ca19740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55989a3cd370 0x55989a3d71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.288+0000 7ff89ca19740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff8941a7d70 con 0x55989a3cd370 2024-09-19T09:11:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.288+0000 7ff89ca19740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff8941a91e0 con 0x55989a3c82e0 2024-09-19T09:11:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.288+0000 7ff89ca19740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff8941a8440 con 0x55989a3c79a0 2024-09-19T09:11:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.288+0000 7ff89ca19740 10 client.0 _ll_register_callbacks cb 0x7ff884004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:11:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.288+0000 7ff893fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55989a3cd370 0x55989a3d71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.288+0000 7ff893fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55989a3cd370 0x55989a3d71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33664/0 (socket says 172.21.15.92:33664) 2024-09-19T09:11:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.288+0000 7ff893fff640 1 -- 172.21.15.92:0/4060435611 learned_addr learned my addr 172.21.15.92:0/4060435611 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.289+0000 7ff892ffd640 1 --2- 172.21.15.92:0/4060435611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55989a3c82e0 0x55989a3d9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.289+0000 7ff893fff640 1 -- 172.21.15.92:0/4060435611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55989a3c79a0 msgr2=0x55989a3d8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.289+0000 7ff893fff640 1 --2- 172.21.15.92:0/4060435611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55989a3c79a0 0x55989a3d8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.289+0000 7ff893fff640 1 -- 172.21.15.92:0/4060435611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55989a3c82e0 msgr2=0x55989a3d9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.289+0000 7ff893fff640 1 --2- 172.21.15.92:0/4060435611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55989a3c82e0 0x55989a3d9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.289+0000 7ff893fff640 1 -- 172.21.15.92:0/4060435611 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55989a3d7a10 con 0x55989a3cd370 2024-09-19T09:11:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.289+0000 7ff893fff640 1 --2- 172.21.15.92:0/4060435611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55989a3cd370 0x55989a3d71e0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7ff88c009ca0 tx=0x7ff88c02fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8d486468e279e3f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:42.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.289+0000 7ff872ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:11:42.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.289+0000 7ff872ffd640 1 -- 172.21.15.92:0/4060435611 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff88c041070 con 0x55989a3cd370 2024-09-19T09:11:42.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.289+0000 7ff872ffd640 1 -- 172.21.15.92:0/4060435611 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff88c0305c0 con 0x55989a3cd370 2024-09-19T09:11:42.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.289+0000 7ff89ca19740 1 -- 172.21.15.92:0/4060435611 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff88809fcb0 con 0x55989a3cd370 2024-09-19T09:11:42.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.289+0000 7ff872ffd640 1 -- 172.21.15.92:0/4060435611 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff88c02f310 con 0x55989a3cd370 2024-09-19T09:11:42.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.289+0000 7ff89ca19740 10 client.18957 fetch_fsmap learned FSMap version 19 2024-09-19T09:11:42.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.289+0000 7ff89ca19740 1 -- 172.21.15.92:0/4060435611 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55989a4491b0 con 0x55989a3cd370 2024-09-19T09:11:42.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.289+0000 7ff872ffd640 1 -- 172.21.15.92:0/4060435611 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff88809fcb0 con 0x55989a3cd370 2024-09-19T09:11:42.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.289+0000 7ff872ffd640 1 -- 172.21.15.92:0/4060435611 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff88c050880 con 0x55989a3cd370 2024-09-19T09:11:42.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.290+0000 7ff89ca19740 10 client.18957 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:11:42.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.290+0000 7ff89ca19740 10 client.18957 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:11:42.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.290+0000 7ff89ca19740 20 client.18957 populate_metadata read hostname 'smithi092' 2024-09-19T09:11:42.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.290+0000 7ff89ca19740 1 --2- 172.21.15.92:0/4060435611 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55989a449730 0x55989a44bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:42.297 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.290+0000 7ff89ca19740 4 client.18957 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:11:42.297 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.290+0000 7ff89ca19740 1 -- 172.21.15.92:0/4060435611 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55989a332d70 con 0x55989a449730 2024-09-19T09:11:42.297 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.290+0000 7ff8937fe640 1 --2- 172.21.15.92:0/4060435611 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55989a449730 0x55989a44bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:42.297 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.290+0000 7ff872ffd640 10 client.18957 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:42.297 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.290+0000 7ff8937fe640 1 --2- 172.21.15.92:0/4060435611 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55989a449730 0x55989a44bb50 crc :-1 s=READY pgs=449 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cd56eedad775108 server_cookie=c9079d9301d92430 in_seq=0 out_seq=0 2024-09-19T09:11:42.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.306+0000 7ff872ffd640 1 -- 172.21.15.92:0/4060435611 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55989a332d70 con 0x55989a449730 2024-09-19T09:11:42.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.306+0000 7ff872ffd640 10 client.18957 handle_command_reply: tid=0 2024-09-19T09:11:42.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.306+0000 7ff89ca19740 1 client.18957 shutdown 2024-09-19T09:11:42.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.306+0000 7ff89ca19740 1 -- 172.21.15.92:0/4060435611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55989a3cd370 msgr2=0x55989a3d71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:42.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.306+0000 7ff89ca19740 1 --2- 172.21.15.92:0/4060435611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55989a3cd370 0x55989a3d71e0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7ff88c009ca0 tx=0x7ff88c02fc30 comp rx=0 tx=0).stop 2024-09-19T09:11:42.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.306+0000 7ff89ca19740 1 -- 172.21.15.92:0/4060435611 shutdown_connections 2024-09-19T09:11:42.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.306+0000 7ff89ca19740 1 --2- 172.21.15.92:0/4060435611 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55989a449730 0x55989a44bb50 crc :-1 s=READY pgs=449 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:42.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.306+0000 7ff89ca19740 1 --2- 172.21.15.92:0/4060435611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55989a3cd370 0x55989a3d71e0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:42.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.306+0000 7ff872ffd640 0 client.18957 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:42.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.306+0000 7ff89ca19740 1 --2- 172.21.15.92:0/4060435611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55989a3c82e0 0x55989a3d9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:42.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.306+0000 7ff89ca19740 1 --2- 172.21.15.92:0/4060435611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55989a3c79a0 0x55989a3d8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:42.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.306+0000 7ff89ca19740 1 -- 172.21.15.92:0/4060435611 >> 172.21.15.92:0/4060435611 conn(0x55989a3c3010 msgr2=0x55989a3c21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:42.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.306+0000 7ff89ca19740 1 -- 172.21.15.92:0/4060435611 shutdown_connections 2024-09-19T09:11:42.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.306+0000 7ff89ca19740 1 -- 172.21.15.92:0/4060435611 wait complete. 2024-09-19T09:11:42.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.306+0000 7ff89ca19740 20 client.18957 trim_cache size 0 max 16384 2024-09-19T09:11:42.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:11:42.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:11:42.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:11:42.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:11:42.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.307+0000 7ff899c7b640 1 -- 172.21.15.92:0/362125303 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff87c0a32f0 msgr2=0x7ff87c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.307+0000 7ff899c7b640 1 --2- 172.21.15.92:0/362125303 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff87c0a32f0 0x7ff87c0a57b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff88c04c000 tx=0x7ff88c04d000 comp rx=0 tx=0).stop 2024-09-19T09:11:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.307+0000 7ff899c7b640 1 -- 172.21.15.92:0/362125303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff894101c40 msgr2=0x7ff8941982b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.307+0000 7ff899c7b640 1 --2- 172.21.15.92:0/362125303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff894101c40 0x7ff8941982b0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7ff88800d770 tx=0x7ff88800dc30 comp rx=0 tx=0).stop 2024-09-19T09:11:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.307+0000 7ff899c7b640 1 -- 172.21.15.92:0/362125303 shutdown_connections 2024-09-19T09:11:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.307+0000 7ff899c7b640 1 --2- 172.21.15.92:0/362125303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff894102600 0x7ff89419f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.307+0000 7ff899c7b640 1 --2- 172.21.15.92:0/362125303 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff87c0a32f0 0x7ff87c0a57b0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.307+0000 7ff899c7b640 1 --2- 172.21.15.92:0/362125303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff894101c40 0x7ff8941982b0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.307+0000 7ff899c7b640 1 --2- 172.21.15.92:0/362125303 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff894100a50 0x7ff894197d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.307+0000 7ff899c7b640 1 -- 172.21.15.92:0/362125303 >> 172.21.15.92:0/362125303 conn(0x7ff8940fc1b0 msgr2=0x7ff8940fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.307+0000 7ff899c7b640 1 -- 172.21.15.92:0/362125303 shutdown_connections 2024-09-19T09:11:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:42.307+0000 7ff899c7b640 1 -- 172.21.15.92:0/362125303 wait complete. 2024-09-19T09:11:43.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:42 smithi092 ceph-mon[31407]: pgmap v787: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 17 MiB/s wr, 664 op/s 2024-09-19T09:11:43.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:42 smithi167 ceph-mon[35359]: pgmap v787: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 17 MiB/s wr, 664 op/s 2024-09-19T09:11:43.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:42 smithi190 ceph-mon[35358]: pgmap v787: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 17 MiB/s wr, 664 op/s 2024-09-19T09:11:45.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:44 smithi092 ceph-mon[31407]: pgmap v788: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 18 MiB/s wr, 716 op/s 2024-09-19T09:11:45.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:44 smithi167 ceph-mon[35359]: pgmap v788: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 18 MiB/s wr, 716 op/s 2024-09-19T09:11:45.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:44 smithi190 ceph-mon[35358]: pgmap v788: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 18 MiB/s wr, 716 op/s 2024-09-19T09:11:45.795 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:11:47.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:46 smithi092 ceph-mon[31407]: pgmap v789: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 12 MiB/s wr, 534 op/s 2024-09-19T09:11:47.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:46 smithi167 ceph-mon[35359]: pgmap v789: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 12 MiB/s wr, 534 op/s 2024-09-19T09:11:47.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:46 smithi190 ceph-mon[35358]: pgmap v789: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 12 MiB/s wr, 534 op/s 2024-09-19T09:11:47.928 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:11:48.183 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:11:48.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.638+0000 7f4af4cdc640 1 -- 172.21.15.92:0/1248859230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4af0102d30 msgr2=0x7f4af0103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:48.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.638+0000 7f4af4cdc640 1 --2- 172.21.15.92:0/1248859230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4af0102d30 0x7f4af0103110 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0009cd0 tx=0x7f4ae002a8e0 comp rx=0 tx=0).stop 2024-09-19T09:11:48.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.639+0000 7f4af4cdc640 1 -- 172.21.15.92:0/1248859230 shutdown_connections 2024-09-19T09:11:48.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.639+0000 7f4af4cdc640 1 --2- 172.21.15.92:0/1248859230 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4af01082a0 0x7f4af010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:48.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.639+0000 7f4af4cdc640 1 --2- 172.21.15.92:0/1248859230 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4af01036e0 0x7f4af0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:48.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.639+0000 7f4af4cdc640 1 --2- 172.21.15.92:0/1248859230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4af0102d30 0x7f4af0103110 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:48.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.639+0000 7f4af4cdc640 1 -- 172.21.15.92:0/1248859230 >> 172.21.15.92:0/1248859230 conn(0x7f4af00fc7d0 msgr2=0x7f4af00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:48.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.639+0000 7f4af4cdc640 1 -- 172.21.15.92:0/1248859230 shutdown_connections 2024-09-19T09:11:48.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.639+0000 7f4af4cdc640 1 -- 172.21.15.92:0/1248859230 wait complete. 2024-09-19T09:11:48.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.639+0000 7f4af4cdc640 1 Processor -- start 2024-09-19T09:11:48.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.639+0000 7f4af4cdc640 1 -- start start 2024-09-19T09:11:48.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.640+0000 7f4af4cdc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4af0102d30 0x7f4af0100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:48.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.640+0000 7f4af4cdc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4af01036e0 0x7f4af0100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:48.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.640+0000 7f4af4cdc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4af01082a0 0x7f4af0101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:48.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.640+0000 7f4af4cdc640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4af01120a0 con 0x7f4af01082a0 2024-09-19T09:11:48.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.640+0000 7f4af4cdc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4af0111f20 con 0x7f4af01036e0 2024-09-19T09:11:48.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.640+0000 7f4af4cdc640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4af0112220 con 0x7f4af0102d30 2024-09-19T09:11:48.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.640+0000 7f4aeed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4af01082a0 0x7f4af0101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:48.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.640+0000 7f4aeed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4af01082a0 0x7f4af0101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33686/0 (socket says 172.21.15.92:33686) 2024-09-19T09:11:48.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.640+0000 7f4aee59c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4af0102d30 0x7f4af0100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:48.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.640+0000 7f4aeed9d640 1 -- 172.21.15.92:0/2897342982 learned_addr learned my addr 172.21.15.92:0/2897342982 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:48.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.640+0000 7f4aedd9b640 1 --2- 172.21.15.92:0/2897342982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4af01036e0 0x7f4af0100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:48.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.640+0000 7f4aeed9d640 1 -- 172.21.15.92:0/2897342982 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4af0102d30 msgr2=0x7f4af0100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:48.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.640+0000 7f4aeed9d640 1 --2- 172.21.15.92:0/2897342982 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4af0102d30 0x7f4af0100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:48.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.640+0000 7f4aeed9d640 1 -- 172.21.15.92:0/2897342982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4af01036e0 msgr2=0x7f4af0100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:48.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.640+0000 7f4aeed9d640 1 --2- 172.21.15.92:0/2897342982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4af01036e0 0x7f4af0100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:48.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.640+0000 7f4aeed9d640 1 -- 172.21.15.92:0/2897342982 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af01a6a80 con 0x7f4af01082a0 2024-09-19T09:11:48.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.640+0000 7f4aeed9d640 1 --2- 172.21.15.92:0/2897342982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4af01082a0 0x7f4af0101410 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f4ae800c970 tx=0x7f4ae800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:48.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.640+0000 7f4ae77fe640 1 -- 172.21.15.92:0/2897342982 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8007bb0 con 0x7f4af01082a0 2024-09-19T09:11:48.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.640+0000 7f4af4cdc640 1 -- 172.21.15.92:0/2897342982 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4af01a6d70 con 0x7f4af01082a0 2024-09-19T09:11:48.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.641+0000 7f4ae77fe640 1 -- 172.21.15.92:0/2897342982 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ae8007d50 con 0x7f4af01082a0 2024-09-19T09:11:48.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.641+0000 7f4ae77fe640 1 -- 172.21.15.92:0/2897342982 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae800f450 con 0x7f4af01082a0 2024-09-19T09:11:48.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.641+0000 7f4af4cdc640 1 -- 172.21.15.92:0/2897342982 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4af01a7280 con 0x7f4af01082a0 2024-09-19T09:11:48.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.643+0000 7f4ae77fe640 1 -- 172.21.15.92:0/2897342982 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4ae8004f20 con 0x7f4af01082a0 2024-09-19T09:11:48.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.643+0000 7f4af70b5740 1 Processor -- start 2024-09-19T09:11:48.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.643+0000 7f4af70b5740 1 -- start start 2024-09-19T09:11:48.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.643+0000 7f4af70b5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a638914a0 0x561a63891880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:48.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.643+0000 7f4af70b5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a63891dc0 0x561a6389c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:48.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.643+0000 7f4af70b5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a6389c680 0x561a6389ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:48.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.643+0000 7f4af70b5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561a637f72e0 con 0x561a638914a0 2024-09-19T09:11:48.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.643+0000 7f4af70b5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561a6379ece0 con 0x561a6389c680 2024-09-19T09:11:48.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.643+0000 7f4af70b5740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x561a637f32a0 con 0x561a63891dc0 2024-09-19T09:11:48.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.643+0000 7f4aedd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a638914a0 0x561a63891880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:48.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.644+0000 7f4aedd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a638914a0 0x561a63891880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33694/0 (socket says 172.21.15.92:33694) 2024-09-19T09:11:48.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.644+0000 7f4aedd9b640 1 -- 172.21.15.92:0/1508411884 learned_addr learned my addr 172.21.15.92:0/1508411884 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:48.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.644+0000 7f4ae77fe640 1 --2- 172.21.15.92:0/2897342982 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4adc0a3240 0x7f4adc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:48.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.644+0000 7f4aee59c640 1 --2- 172.21.15.92:0/1508411884 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a63891dc0 0x561a6389c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:48.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.644+0000 7f4aeed9d640 1 --2- 172.21.15.92:0/2897342982 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4adc0a3240 0x7f4adc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:48.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.644+0000 7f4ae77fe640 1 -- 172.21.15.92:0/2897342982 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4ae80cf470 con 0x7f4af01082a0 2024-09-19T09:11:48.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.644+0000 7f4aee59c640 1 -- 172.21.15.92:0/1508411884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a6389c680 msgr2=0x561a6389ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:48.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.644+0000 7f4aedd9b640 1 --2- 172.21.15.92:0/1508411884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a6389c680 0x561a6389ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:48.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.644+0000 7f4aee59c640 1 --2- 172.21.15.92:0/1508411884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a6389c680 0x561a6389ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:48.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.644+0000 7f4aee59c640 1 -- 172.21.15.92:0/1508411884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a638914a0 msgr2=0x561a63891880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:48.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.644+0000 7f4aee59c640 1 --2- 172.21.15.92:0/1508411884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a638914a0 0x561a63891880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:48.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.644+0000 7f4aee59c640 1 -- 172.21.15.92:0/1508411884 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a63783440 con 0x561a63891dc0 2024-09-19T09:11:48.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.644+0000 7f4aedd9b640 1 --2- 172.21.15.92:0/1508411884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a6389c680 0x561a6389ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:11:48.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.644+0000 7f4aeed9d640 1 --2- 172.21.15.92:0/2897342982 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4adc0a3240 0x7f4adc0a5700 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f4ae80cc990 tx=0x7f4ae8066580 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:48.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.644+0000 7f4aee59c640 1 --2- 172.21.15.92:0/1508411884 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a63891dc0 0x561a6389c140 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0005e30 tx=0x7f4ae00314e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1042a3ff4d2f78b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:48.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.645+0000 7f4ae4ff9640 1 -- 172.21.15.92:0/1508411884 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0048070 con 0x561a63891dc0 2024-09-19T09:11:48.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.645+0000 7f4ae4ff9640 1 -- 172.21.15.92:0/1508411884 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ae0036070 con 0x561a63891dc0 2024-09-19T09:11:48.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.645+0000 7f4ae4ff9640 1 -- 172.21.15.92:0/1508411884 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0004540 con 0x561a63891dc0 2024-09-19T09:11:48.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.645+0000 7f4af70b5740 1 -- 172.21.15.92:0/1508411884 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a63891dc0 msgr2=0x561a6389c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:48.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.645+0000 7f4af70b5740 1 --2- 172.21.15.92:0/1508411884 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a63891dc0 0x561a6389c140 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0005e30 tx=0x7f4ae00314e0 comp rx=0 tx=0).stop 2024-09-19T09:11:48.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.646+0000 7f4af70b5740 1 -- 172.21.15.92:0/1508411884 shutdown_connections 2024-09-19T09:11:48.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.646+0000 7f4af70b5740 1 --2- 172.21.15.92:0/1508411884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a6389c680 0x561a6389ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:48.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.646+0000 7f4af70b5740 1 --2- 172.21.15.92:0/1508411884 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a63891dc0 0x561a6389c140 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:48.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.646+0000 7f4af70b5740 1 --2- 172.21.15.92:0/1508411884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a638914a0 0x561a63891880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:48.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.646+0000 7f4af70b5740 1 -- 172.21.15.92:0/1508411884 >> 172.21.15.92:0/1508411884 conn(0x561a6388da30 msgr2=0x561a6388de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:48.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.646+0000 7f4af70b5740 1 -- 172.21.15.92:0/1508411884 shutdown_connections 2024-09-19T09:11:48.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.646+0000 7f4af70b5740 1 -- 172.21.15.92:0/1508411884 wait complete. 2024-09-19T09:11:48.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.646+0000 7f4af70b5740 1 -- start start 2024-09-19T09:11:48.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.646+0000 7f4af70b5740 1 Processor -- start 2024-09-19T09:11:48.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.646+0000 7f4af70b5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a638914a0 0x561a6389bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:48.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.646+0000 7f4af70b5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a63891dc0 0x561a63899250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:48.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.646+0000 7f4af70b5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a6389c680 0x561a63899790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:48.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.646+0000 7f4af70b5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561a6389f250 con 0x561a638914a0 2024-09-19T09:11:48.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.646+0000 7f4af70b5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561a637b2050 con 0x561a6389c680 2024-09-19T09:11:48.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.646+0000 7f4af70b5740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x561a6389f3d0 con 0x561a63891dc0 2024-09-19T09:11:48.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.646+0000 7f4af70b5740 10 client.0 _ll_register_callbacks cb 0x561a637f2160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:11:48.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.646+0000 7f4aedd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a638914a0 0x561a6389bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:48.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.646+0000 7f4aedd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a638914a0 0x561a6389bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33698/0 (socket says 172.21.15.92:33698) 2024-09-19T09:11:48.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.646+0000 7f4aedd9b640 1 -- 172.21.15.92:0/842654061 learned_addr learned my addr 172.21.15.92:0/842654061 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:48.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.647+0000 7f4aee59c640 1 --2- 172.21.15.92:0/842654061 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a63891dc0 0x561a63899250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:48.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.647+0000 7f4aedd9b640 1 -- 172.21.15.92:0/842654061 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a63891dc0 msgr2=0x561a63899250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:48.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.647+0000 7f4aedd9b640 1 --2- 172.21.15.92:0/842654061 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a63891dc0 0x561a63899250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:48.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.647+0000 7f4aedd9b640 1 -- 172.21.15.92:0/842654061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a6389c680 msgr2=0x561a63899790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:48.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.647+0000 7f4aedd9b640 1 --2- 172.21.15.92:0/842654061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a6389c680 0x561a63899790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:48.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.647+0000 7f4aedd9b640 1 -- 172.21.15.92:0/842654061 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a635683c0 con 0x561a638914a0 2024-09-19T09:11:48.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.647+0000 7f4aedd9b640 1 --2- 172.21.15.92:0/842654061 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a638914a0 0x561a6389bfa0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f4ad80042d0 tx=0x7f4ad80039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede4768c2cb7ae9f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:48.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.647+0000 7f4ad5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:11:48.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.647+0000 7f4ad5ffb640 1 -- 172.21.15.92:0/842654061 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad8005220 con 0x561a638914a0 2024-09-19T09:11:48.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.647+0000 7f4ad5ffb640 1 -- 172.21.15.92:0/842654061 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4ad80053c0 con 0x561a638914a0 2024-09-19T09:11:48.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.647+0000 7f4af70b5740 1 -- 172.21.15.92:0/842654061 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ae0036070 con 0x561a638914a0 2024-09-19T09:11:48.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.648+0000 7f4ad5ffb640 1 -- 172.21.15.92:0/842654061 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4ad80055c0 con 0x561a638914a0 2024-09-19T09:11:48.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.648+0000 7f4af70b5740 10 client.18969 fetch_fsmap learned FSMap version 19 2024-09-19T09:11:48.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.648+0000 7f4af70b5740 1 -- 172.21.15.92:0/842654061 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x561a638aaba0 con 0x561a638914a0 2024-09-19T09:11:48.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.648+0000 7f4ad5ffb640 1 -- 172.21.15.92:0/842654061 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ae0036070 con 0x561a638914a0 2024-09-19T09:11:48.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.648+0000 7f4ad5ffb640 1 -- 172.21.15.92:0/842654061 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f4ad8010b00 con 0x561a638914a0 2024-09-19T09:11:48.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.648+0000 7f4af70b5740 10 client.18969 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:11:48.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.648+0000 7f4af70b5740 10 client.18969 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:11:48.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.648+0000 7f4af70b5740 20 client.18969 populate_metadata read hostname 'smithi092' 2024-09-19T09:11:48.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.648+0000 7f4af70b5740 1 --2- 172.21.15.92:0/842654061 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561a638ac060 0x561a638ae450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:48.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.648+0000 7f4af70b5740 4 client.18969 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:11:48.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.648+0000 7f4af70b5740 1 -- 172.21.15.92:0/842654061 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a63804850 con 0x561a638ac060 2024-09-19T09:11:48.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.648+0000 7f4aee59c640 1 --2- 172.21.15.92:0/842654061 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561a638ac060 0x561a638ae450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:48.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.649+0000 7f4aee59c640 1 --2- 172.21.15.92:0/842654061 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561a638ac060 0x561a638ae450 crc :-1 s=READY pgs=450 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f4792c80ace1dbb server_cookie=44e4e4630b09fae2 in_seq=0 out_seq=0 2024-09-19T09:11:48.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.649+0000 7f4ad5ffb640 10 client.18969 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:48.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.650+0000 7f4ad5ffb640 1 -- 172.21.15.92:0/842654061 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561a63804850 con 0x561a638ac060 2024-09-19T09:11:48.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.650+0000 7f4ad5ffb640 10 client.18969 handle_command_reply: tid=0 2024-09-19T09:11:48.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.650+0000 7f4af70b5740 1 client.18969 shutdown 2024-09-19T09:11:48.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.650+0000 7f4af70b5740 1 -- 172.21.15.92:0/842654061 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a638914a0 msgr2=0x561a6389bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:48.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.650+0000 7f4af70b5740 1 --2- 172.21.15.92:0/842654061 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a638914a0 0x561a6389bfa0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f4ad80042d0 tx=0x7f4ad80039c0 comp rx=0 tx=0).stop 2024-09-19T09:11:48.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.650+0000 7f4af70b5740 1 -- 172.21.15.92:0/842654061 shutdown_connections 2024-09-19T09:11:48.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.650+0000 7f4af70b5740 1 --2- 172.21.15.92:0/842654061 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561a638ac060 0x561a638ae450 crc :-1 s=READY pgs=450 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:48.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.650+0000 7f4af70b5740 1 --2- 172.21.15.92:0/842654061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a6389c680 0x561a63899790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:48.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.650+0000 7f4af70b5740 1 --2- 172.21.15.92:0/842654061 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a63891dc0 0x561a63899250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:48.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.650+0000 7f4af70b5740 1 --2- 172.21.15.92:0/842654061 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a638914a0 0x561a6389bfa0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:48.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.650+0000 7f4ad5ffb640 0 client.18969 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:48.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.650+0000 7f4af70b5740 1 -- 172.21.15.92:0/842654061 >> 172.21.15.92:0/842654061 conn(0x561a6388da30 msgr2=0x561a6388cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:48.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.650+0000 7f4af70b5740 1 -- 172.21.15.92:0/842654061 shutdown_connections 2024-09-19T09:11:48.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.650+0000 7f4af70b5740 1 -- 172.21.15.92:0/842654061 wait complete. 2024-09-19T09:11:48.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.650+0000 7f4af70b5740 20 client.18969 trim_cache size 0 max 16384 2024-09-19T09:11:48.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.667+0000 7f4af70b5740 1 Processor -- start 2024-09-19T09:11:48.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.667+0000 7f4af70b5740 1 -- start start 2024-09-19T09:11:48.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.667+0000 7f4af70b5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a6388da30 0x561a638a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:48.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.667+0000 7f4af70b5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a638914a0 0x561a638b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:48.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.668+0000 7f4af70b5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a63891dc0 0x561a638b4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:48.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.668+0000 7f4af70b5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4af01ad7b0 con 0x561a6388da30 2024-09-19T09:11:48.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.668+0000 7f4af70b5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4af01b0050 con 0x561a63891dc0 2024-09-19T09:11:48.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.668+0000 7f4af70b5740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4af01ade40 con 0x561a638914a0 2024-09-19T09:11:48.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.668+0000 7f4aedd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a6388da30 0x561a638a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:48.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.668+0000 7f4aedd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a6388da30 0x561a638a84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33704/0 (socket says 172.21.15.92:33704) 2024-09-19T09:11:48.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.668+0000 7f4aedd9b640 1 -- 172.21.15.92:0/4244527425 learned_addr learned my addr 172.21.15.92:0/4244527425 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:48.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.668+0000 7f4aee59c640 1 --2- 172.21.15.92:0/4244527425 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a638914a0 0x561a638b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:48.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.668+0000 7f4aedd9b640 1 --2- 172.21.15.92:0/4244527425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a63891dc0 0x561a638b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:48.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.668+0000 7f4aedd9b640 1 -- 172.21.15.92:0/4244527425 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a638914a0 msgr2=0x561a638b3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:48.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.668+0000 7f4aedd9b640 1 --2- 172.21.15.92:0/4244527425 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a638914a0 0x561a638b3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:48.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.668+0000 7f4aedd9b640 1 -- 172.21.15.92:0/4244527425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a63891dc0 msgr2=0x561a638b4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:48.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.668+0000 7f4aedd9b640 1 --2- 172.21.15.92:0/4244527425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a63891dc0 0x561a638b4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:48.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.668+0000 7f4aedd9b640 1 -- 172.21.15.92:0/4244527425 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a6389c310 con 0x561a6388da30 2024-09-19T09:11:48.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.668+0000 7f4aedd9b640 1 --2- 172.21.15.92:0/4244527425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a6388da30 0x561a638a84b0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8004470 tx=0x7f4ad80043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a32ab5c005d275 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:48.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.669+0000 7f4ad7fff640 1 -- 172.21.15.92:0/4244527425 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad80119b0 con 0x561a6388da30 2024-09-19T09:11:48.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.669+0000 7f4ad7fff640 1 -- 172.21.15.92:0/4244527425 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ad8010b30 con 0x561a6388da30 2024-09-19T09:11:48.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.669+0000 7f4ad7fff640 1 -- 172.21.15.92:0/4244527425 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad8034680 con 0x561a6388da30 2024-09-19T09:11:48.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.670+0000 7f4af70b5740 1 -- 172.21.15.92:0/4244527425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a6388da30 msgr2=0x561a638a84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:48.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.670+0000 7f4af70b5740 1 --2- 172.21.15.92:0/4244527425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a6388da30 0x561a638a84b0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8004470 tx=0x7f4ad80043c0 comp rx=0 tx=0).stop 2024-09-19T09:11:48.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.670+0000 7f4af70b5740 1 -- 172.21.15.92:0/4244527425 shutdown_connections 2024-09-19T09:11:48.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.670+0000 7f4af70b5740 1 --2- 172.21.15.92:0/4244527425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a63891dc0 0x561a638b4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:48.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.670+0000 7f4af70b5740 1 --2- 172.21.15.92:0/4244527425 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a638914a0 0x561a638b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:48.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.670+0000 7f4af70b5740 1 --2- 172.21.15.92:0/4244527425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a6388da30 0x561a638a84b0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:48.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.670+0000 7f4af70b5740 1 -- 172.21.15.92:0/4244527425 >> 172.21.15.92:0/4244527425 conn(0x561a638998f0 msgr2=0x561a63897b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:48.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.670+0000 7f4af70b5740 1 -- 172.21.15.92:0/4244527425 shutdown_connections 2024-09-19T09:11:48.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.670+0000 7f4af70b5740 1 -- 172.21.15.92:0/4244527425 wait complete. 2024-09-19T09:11:48.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.670+0000 7f4af70b5740 1 -- start start 2024-09-19T09:11:48.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.671+0000 7f4af70b5740 1 Processor -- start 2024-09-19T09:11:48.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.671+0000 7f4af70b5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a638914a0 0x561a638a0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:48.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.671+0000 7f4af70b5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a63891dc0 0x561a638a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:48.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.671+0000 7f4af70b5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a6389c680 0x561a638a0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:48.680 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.671+0000 7f4af70b5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4af01ae510 con 0x561a638914a0 2024-09-19T09:11:48.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.671+0000 7f4af70b5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4af01af980 con 0x561a6389c680 2024-09-19T09:11:48.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.671+0000 7f4af70b5740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4af01aebe0 con 0x561a63891dc0 2024-09-19T09:11:48.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.671+0000 7f4af70b5740 10 client.0 _ll_register_callbacks cb 0x7f4ad800baa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:11:48.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.671+0000 7f4aee59c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a63891dc0 0x561a638a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:48.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.671+0000 7f4aee59c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a63891dc0 0x561a638a0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:58578/0 (socket says 172.21.15.92:58578) 2024-09-19T09:11:48.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.671+0000 7f4aee59c640 1 -- 172.21.15.92:0/2483458869 learned_addr learned my addr 172.21.15.92:0/2483458869 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:48.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.671+0000 7f4aedd9b640 1 --2- 172.21.15.92:0/2483458869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a638914a0 0x561a638a0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:48.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.672+0000 7f4aee59c640 1 -- 172.21.15.92:0/2483458869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a6389c680 msgr2=0x561a638a0fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:11:48.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.672+0000 7f4aee59c640 1 --2- 172.21.15.92:0/2483458869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a6389c680 0x561a638a0fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:48.681 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.672+0000 7f4aee59c640 1 -- 172.21.15.92:0/2483458869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a638914a0 msgr2=0x561a638a0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:48.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.672+0000 7f4aee59c640 1 --2- 172.21.15.92:0/2483458869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a638914a0 0x561a638a0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:48.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.672+0000 7f4aee59c640 1 -- 172.21.15.92:0/2483458869 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a63915fa0 con 0x561a63891dc0 2024-09-19T09:11:48.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.672+0000 7f4aedd9b640 1 --2- 172.21.15.92:0/2483458869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a638914a0 0x561a638a0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:11:48.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.672+0000 7f4aee59c640 1 --2- 172.21.15.92:0/2483458869 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a63891dc0 0x561a638a0aa0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0005e30 tx=0x7f4ae0009800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcb9657e2c8a84f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:48.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.672+0000 7f4ad5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:11:48.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.673+0000 7f4ad5ffb640 1 -- 172.21.15.92:0/2483458869 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae005e060 con 0x561a63891dc0 2024-09-19T09:11:48.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.673+0000 7f4ad5ffb640 1 -- 172.21.15.92:0/2483458869 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4ae0031a40 con 0x561a63891dc0 2024-09-19T09:11:48.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.673+0000 7f4af70b5740 1 -- 172.21.15.92:0/2483458869 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ad8010b30 con 0x561a63891dc0 2024-09-19T09:11:48.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.673+0000 7f4ad5ffb640 1 -- 172.21.15.92:0/2483458869 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4ae0048040 con 0x561a63891dc0 2024-09-19T09:11:48.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.673+0000 7f4af70b5740 10 client.28048 fetch_fsmap learned FSMap version 19 2024-09-19T09:11:48.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.673+0000 7f4af70b5740 1 -- 172.21.15.92:0/2483458869 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x561a63917290 con 0x561a63891dc0 2024-09-19T09:11:48.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.673+0000 7f4ad5ffb640 1 -- 172.21.15.92:0/2483458869 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ad8010b30 con 0x561a63891dc0 2024-09-19T09:11:48.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.673+0000 7f4ad5ffb640 1 -- 172.21.15.92:0/2483458869 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f4ae0042030 con 0x561a63891dc0 2024-09-19T09:11:48.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.673+0000 7f4af70b5740 10 client.28048 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:11:48.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.674+0000 7f4af70b5740 10 client.28048 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:11:48.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.674+0000 7f4af70b5740 20 client.28048 populate_metadata read hostname 'smithi092' 2024-09-19T09:11:48.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.674+0000 7f4af70b5740 1 --2- 172.21.15.92:0/2483458869 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561a63917620 0x561a63919a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:48.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.674+0000 7f4af70b5740 4 client.28048 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:11:48.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.674+0000 7f4af70b5740 1 -- 172.21.15.92:0/2483458869 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561a637fed60 con 0x561a63917620 2024-09-19T09:11:48.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.674+0000 7f4aedd9b640 1 --2- 172.21.15.92:0/2483458869 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561a63917620 0x561a63919a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:48.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.674+0000 7f4aedd9b640 1 --2- 172.21.15.92:0/2483458869 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561a63917620 0x561a63919a60 crc :-1 s=READY pgs=451 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12d9bc58de5251b7 server_cookie=b898a0437623ea4 in_seq=0 out_seq=0 2024-09-19T09:11:48.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.674+0000 7f4ad5ffb640 10 client.28048 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:48.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.675+0000 7f4ad5ffb640 1 -- 172.21.15.92:0/2483458869 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x561a637fed60 con 0x561a63917620 2024-09-19T09:11:48.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.675+0000 7f4ad5ffb640 10 client.28048 handle_command_reply: tid=0 2024-09-19T09:11:48.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.675+0000 7f4af70b5740 1 client.28048 shutdown 2024-09-19T09:11:48.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.675+0000 7f4af70b5740 1 -- 172.21.15.92:0/2483458869 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a63891dc0 msgr2=0x561a638a0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:48.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.675+0000 7f4af70b5740 1 --2- 172.21.15.92:0/2483458869 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a63891dc0 0x561a638a0aa0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0005e30 tx=0x7f4ae0009800 comp rx=0 tx=0).stop 2024-09-19T09:11:48.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.675+0000 7f4af70b5740 1 -- 172.21.15.92:0/2483458869 shutdown_connections 2024-09-19T09:11:48.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.675+0000 7f4af70b5740 1 --2- 172.21.15.92:0/2483458869 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x561a63917620 0x561a63919a60 crc :-1 s=READY pgs=451 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:48.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.675+0000 7f4af70b5740 1 --2- 172.21.15.92:0/2483458869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a6389c680 0x561a638a0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:48.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.675+0000 7f4ad5ffb640 0 client.28048 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:48.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.675+0000 7f4af70b5740 1 --2- 172.21.15.92:0/2483458869 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561a63891dc0 0x561a638a0aa0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:48.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.675+0000 7f4af70b5740 1 --2- 172.21.15.92:0/2483458869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a638914a0 0x561a638a0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:48.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.675+0000 7f4af70b5740 1 -- 172.21.15.92:0/2483458869 >> 172.21.15.92:0/2483458869 conn(0x561a638998f0 msgr2=0x561a63892ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:48.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.675+0000 7f4af70b5740 1 -- 172.21.15.92:0/2483458869 shutdown_connections 2024-09-19T09:11:48.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.675+0000 7f4af70b5740 1 -- 172.21.15.92:0/2483458869 wait complete. 2024-09-19T09:11:48.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.675+0000 7f4af70b5740 20 client.28048 trim_cache size 0 max 16384 2024-09-19T09:11:48.685 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:11:48.685 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-19T09:11:48.685 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {} 2024-09-19T09:11:48.685 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:11:48.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.676+0000 7f4af4cdc640 1 -- 172.21.15.92:0/2897342982 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4adc0a3240 msgr2=0x7f4adc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:48.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.676+0000 7f4af4cdc640 1 --2- 172.21.15.92:0/2897342982 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4adc0a3240 0x7f4adc0a5700 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f4ae80cc990 tx=0x7f4ae8066580 comp rx=0 tx=0).stop 2024-09-19T09:11:48.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.676+0000 7f4af4cdc640 1 -- 172.21.15.92:0/2897342982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4af01082a0 msgr2=0x7f4af0101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:48.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.676+0000 7f4af4cdc640 1 --2- 172.21.15.92:0/2897342982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4af01082a0 0x7f4af0101410 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f4ae800c970 tx=0x7f4ae800ce30 comp rx=0 tx=0).stop 2024-09-19T09:11:48.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.676+0000 7f4af4cdc640 1 -- 172.21.15.92:0/2897342982 shutdown_connections 2024-09-19T09:11:48.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.676+0000 7f4af4cdc640 1 --2- 172.21.15.92:0/2897342982 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4adc0a3240 0x7f4adc0a5700 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:48.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.676+0000 7f4af4cdc640 1 --2- 172.21.15.92:0/2897342982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4af01082a0 0x7f4af0101410 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:48.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.676+0000 7f4af4cdc640 1 --2- 172.21.15.92:0/2897342982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4af01036e0 0x7f4af0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:48.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.676+0000 7f4af4cdc640 1 --2- 172.21.15.92:0/2897342982 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4af0102d30 0x7f4af0100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:48.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.676+0000 7f4af4cdc640 1 -- 172.21.15.92:0/2897342982 >> 172.21.15.92:0/2897342982 conn(0x7f4af00fc7d0 msgr2=0x7f4af0105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:48.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.676+0000 7f4af4cdc640 1 -- 172.21.15.92:0/2897342982 shutdown_connections 2024-09-19T09:11:48.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:48.676+0000 7f4af4cdc640 1 -- 172.21.15.92:0/2897342982 wait complete. 2024-09-19T09:11:49.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:48 smithi092 ceph-mon[31407]: pgmap v790: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.7 MiB/s wr, 366 op/s 2024-09-19T09:11:49.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:48 smithi167 ceph-mon[35359]: pgmap v790: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.7 MiB/s wr, 366 op/s 2024-09-19T09:11:49.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:48 smithi190 ceph-mon[35358]: pgmap v790: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.7 MiB/s wr, 366 op/s 2024-09-19T09:11:49.507 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:11:49.507 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:11:49.754 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:11:50.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.245+0000 7fba6b727640 1 -- 172.21.15.92:0/1515682586 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba641055b0 msgr2=0x7fba6410d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:50.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.245+0000 7fba6b727640 1 --2- 172.21.15.92:0/1515682586 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba641055b0 0x7fba6410d130 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fba5c00adb0 tx=0x7fba5c02b7a0 comp rx=0 tx=0).stop 2024-09-19T09:11:50.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.245+0000 7fba6b727640 1 -- 172.21.15.92:0/1515682586 shutdown_connections 2024-09-19T09:11:50.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.245+0000 7fba6b727640 1 --2- 172.21.15.92:0/1515682586 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba641055b0 0x7fba6410d130 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:50.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.245+0000 7fba6b727640 1 --2- 172.21.15.92:0/1515682586 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba64100e30 0x7fba64104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:50.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.245+0000 7fba6b727640 1 --2- 172.21.15.92:0/1515682586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba64100480 0x7fba64100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:50.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.245+0000 7fba6b727640 1 -- 172.21.15.92:0/1515682586 >> 172.21.15.92:0/1515682586 conn(0x7fba64077210 msgr2=0x7fba640fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:50.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.245+0000 7fba6b727640 1 -- 172.21.15.92:0/1515682586 shutdown_connections 2024-09-19T09:11:50.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.245+0000 7fba6b727640 1 -- 172.21.15.92:0/1515682586 wait complete. 2024-09-19T09:11:50.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.246+0000 7fba6b727640 1 Processor -- start 2024-09-19T09:11:50.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.246+0000 7fba6b727640 1 -- start start 2024-09-19T09:11:50.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.246+0000 7fba6b727640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba64100480 0x7fba64198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:50.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.246+0000 7fba6b727640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba64100e30 0x7fba641989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:50.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.246+0000 7fba6b727640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba641055b0 0x7fba6419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:50.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.246+0000 7fba6b727640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fba6410fdb0 con 0x7fba64100480 2024-09-19T09:11:50.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.246+0000 7fba6b727640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fba6410fc30 con 0x7fba64100e30 2024-09-19T09:11:50.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.246+0000 7fba6b727640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fba6410ff30 con 0x7fba641055b0 2024-09-19T09:11:50.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.246+0000 7fba694c3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba64100480 0x7fba64198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:50.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.246+0000 7fba694c3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba64100480 0x7fba64198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33732/0 (socket says 172.21.15.92:33732) 2024-09-19T09:11:50.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.246+0000 7fba694c3640 1 -- 172.21.15.92:0/3019042743 learned_addr learned my addr 172.21.15.92:0/3019042743 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:50.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.246+0000 7fba68cc2640 1 --2- 172.21.15.92:0/3019042743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba64100e30 0x7fba641989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:50.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.246+0000 7fba69cc4640 1 --2- 172.21.15.92:0/3019042743 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba641055b0 0x7fba6419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:50.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.246+0000 7fba694c3640 1 -- 172.21.15.92:0/3019042743 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba641055b0 msgr2=0x7fba6419cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:50.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.246+0000 7fba694c3640 1 --2- 172.21.15.92:0/3019042743 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba641055b0 0x7fba6419cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:50.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.246+0000 7fba694c3640 1 -- 172.21.15.92:0/3019042743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba64100e30 msgr2=0x7fba641989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:50.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.246+0000 7fba694c3640 1 --2- 172.21.15.92:0/3019042743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba64100e30 0x7fba641989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:50.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.246+0000 7fba694c3640 1 -- 172.21.15.92:0/3019042743 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba6419d420 con 0x7fba64100480 2024-09-19T09:11:50.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.246+0000 7fba69cc4640 1 --2- 172.21.15.92:0/3019042743 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba641055b0 0x7fba6419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:11:50.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.247+0000 7fba694c3640 1 --2- 172.21.15.92:0/3019042743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba64100480 0x7fba64198470 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fba5400d950 tx=0x7fba5400dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:50.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.247+0000 7fba5a7fc640 1 -- 172.21.15.92:0/3019042743 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba54017070 con 0x7fba64100480 2024-09-19T09:11:50.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.247+0000 7fba5a7fc640 1 -- 172.21.15.92:0/3019042743 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba5400de80 con 0x7fba64100480 2024-09-19T09:11:50.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.247+0000 7fba6b727640 1 -- 172.21.15.92:0/3019042743 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba6419d710 con 0x7fba64100480 2024-09-19T09:11:50.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.247+0000 7fba5a7fc640 1 -- 172.21.15.92:0/3019042743 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5400f620 con 0x7fba64100480 2024-09-19T09:11:50.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.247+0000 7fba6b727640 1 -- 172.21.15.92:0/3019042743 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba641a4ff0 con 0x7fba64100480 2024-09-19T09:11:50.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.248+0000 7fba6b727640 1 -- 172.21.15.92:0/3019042743 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba64100860 con 0x7fba64100480 2024-09-19T09:11:50.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.249+0000 7fba5a7fc640 1 -- 172.21.15.92:0/3019042743 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fba54009c30 con 0x7fba64100480 2024-09-19T09:11:50.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.250+0000 7fba5a7fc640 1 --2- 172.21.15.92:0/3019042743 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fba500a3240 0x7fba500a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:50.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.250+0000 7fba68cc2640 1 --2- 172.21.15.92:0/3019042743 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fba500a3240 0x7fba500a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:50.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.250+0000 7fba5a7fc640 1 -- 172.21.15.92:0/3019042743 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fba540cf5c0 con 0x7fba64100480 2024-09-19T09:11:50.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.250+0000 7fba68cc2640 1 --2- 172.21.15.92:0/3019042743 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fba500a3240 0x7fba500a5700 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fba640ff7f0 tx=0x7fba60009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:50.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.254+0000 7fba5a7fc640 1 -- 172.21.15.92:0/3019042743 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fba5409c2a0 con 0x7fba64100480 2024-09-19T09:11:50.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.457+0000 7fba6b727640 1 -- 172.21.15.92:0/3019042743 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba64108200 con 0x7fba64100480 2024-09-19T09:11:50.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.458+0000 7fba5a7fc640 1 -- 172.21.15.92:0/3019042743 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7fba5409bba0 con 0x7fba64100480 2024-09-19T09:11:50.459 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:11:50.459 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:11:50.459 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:11:50.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.460+0000 7fba6b727640 1 -- 172.21.15.92:0/3019042743 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fba500a3240 msgr2=0x7fba500a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:50.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.460+0000 7fba6b727640 1 --2- 172.21.15.92:0/3019042743 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fba500a3240 0x7fba500a5700 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fba640ff7f0 tx=0x7fba60009110 comp rx=0 tx=0).stop 2024-09-19T09:11:50.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.460+0000 7fba6b727640 1 -- 172.21.15.92:0/3019042743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba64100480 msgr2=0x7fba64198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:50.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.460+0000 7fba6b727640 1 --2- 172.21.15.92:0/3019042743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba64100480 0x7fba64198470 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fba5400d950 tx=0x7fba5400dd50 comp rx=0 tx=0).stop 2024-09-19T09:11:50.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.460+0000 7fba6b727640 1 -- 172.21.15.92:0/3019042743 shutdown_connections 2024-09-19T09:11:50.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.460+0000 7fba6b727640 1 --2- 172.21.15.92:0/3019042743 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba641055b0 0x7fba6419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:50.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.460+0000 7fba6b727640 1 --2- 172.21.15.92:0/3019042743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba64100e30 0x7fba641989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:50.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.460+0000 7fba6b727640 1 --2- 172.21.15.92:0/3019042743 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fba500a3240 0x7fba500a5700 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:50.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.460+0000 7fba6b727640 1 --2- 172.21.15.92:0/3019042743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba64100480 0x7fba64198470 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:50.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.460+0000 7fba6b727640 1 -- 172.21.15.92:0/3019042743 >> 172.21.15.92:0/3019042743 conn(0x7fba64077210 msgr2=0x7fba64103780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:50.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.460+0000 7fba6b727640 1 -- 172.21.15.92:0/3019042743 shutdown_connections 2024-09-19T09:11:50.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:50.460+0000 7fba6b727640 1 -- 172.21.15.92:0/3019042743 wait complete. 2024-09-19T09:11:50.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:50 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3019042743' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:11:50.800 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:11:50.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:50 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3019042743' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:11:50.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:50 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3019042743' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:11:51.165 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:11:51.414 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:11:51.807 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:51 smithi092 ceph-mon[31407]: pgmap v791: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.7 MiB/s wr, 218 op/s 2024-09-19T09:11:51.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:51 smithi167 ceph-mon[35359]: pgmap v791: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.7 MiB/s wr, 218 op/s 2024-09-19T09:11:51.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:51 smithi190 ceph-mon[35358]: pgmap v791: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.7 MiB/s wr, 218 op/s 2024-09-19T09:11:52.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.021+0000 7f12fcee6640 1 -- 172.21.15.92:0/868670270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12f8102790 msgr2=0x7f12f81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:52.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.021+0000 7f12fcee6640 1 --2- 172.21.15.92:0/868670270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12f8102790 0x7f12f81067e0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f12e0009900 tx=0x7f12e002a410 comp rx=0 tx=0).stop 2024-09-19T09:11:52.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.021+0000 7f12fcee6640 1 -- 172.21.15.92:0/868670270 shutdown_connections 2024-09-19T09:11:52.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.021+0000 7f12fcee6640 1 --2- 172.21.15.92:0/868670270 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12f8106f10 0x7f12f810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:52.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.021+0000 7f12fcee6640 1 --2- 172.21.15.92:0/868670270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12f8102790 0x7f12f81067e0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:52.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.021+0000 7f12fcee6640 1 --2- 172.21.15.92:0/868670270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12f8101de0 0x7f12f81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:52.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.021+0000 7f12fcee6640 1 -- 172.21.15.92:0/868670270 >> 172.21.15.92:0/868670270 conn(0x7f12f80fd8c0 msgr2=0x7f12f80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:52.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.021+0000 7f12fcee6640 1 -- 172.21.15.92:0/868670270 shutdown_connections 2024-09-19T09:11:52.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.021+0000 7f12fcee6640 1 -- 172.21.15.92:0/868670270 wait complete. 2024-09-19T09:11:52.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.022+0000 7f12fcee6640 1 Processor -- start 2024-09-19T09:11:52.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.022+0000 7f12fcee6640 1 -- start start 2024-09-19T09:11:52.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.022+0000 7f12fcee6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12f8101de0 0x7f12f8198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:52.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.022+0000 7f12fcee6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12f8102790 0x7f12f81989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:52.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.022+0000 7f12fcee6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12f8106f10 0x7f12f819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:52.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.023+0000 7f12fcee6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f12f8111f70 con 0x7f12f8106f10 2024-09-19T09:11:52.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.023+0000 7f12fcee6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f12f8111df0 con 0x7f12f8101de0 2024-09-19T09:11:52.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.023+0000 7f12fcee6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f12f81120f0 con 0x7f12f8102790 2024-09-19T09:11:52.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.023+0000 7f12f6d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12f8106f10 0x7f12f819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:52.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.023+0000 7f12f6d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12f8106f10 0x7f12f819cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56754/0 (socket says 172.21.15.92:56754) 2024-09-19T09:11:52.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.023+0000 7f12f6d9d640 1 -- 172.21.15.92:0/3626119094 learned_addr learned my addr 172.21.15.92:0/3626119094 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:52.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.023+0000 7f12f659c640 1 --2- 172.21.15.92:0/3626119094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12f8101de0 0x7f12f8198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:52.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.023+0000 7f12edd9b640 1 --2- 172.21.15.92:0/3626119094 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12f8102790 0x7f12f81989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:52.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.023+0000 7f12f6d9d640 1 -- 172.21.15.92:0/3626119094 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12f8102790 msgr2=0x7f12f81989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:52.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.023+0000 7f12f6d9d640 1 --2- 172.21.15.92:0/3626119094 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12f8102790 0x7f12f81989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:52.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.023+0000 7f12f6d9d640 1 -- 172.21.15.92:0/3626119094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12f8101de0 msgr2=0x7f12f8198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:52.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.023+0000 7f12f6d9d640 1 --2- 172.21.15.92:0/3626119094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12f8101de0 0x7f12f8198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:52.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.023+0000 7f12f6d9d640 1 -- 172.21.15.92:0/3626119094 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12f819d440 con 0x7f12f8106f10 2024-09-19T09:11:52.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.023+0000 7f12f6d9d640 1 --2- 172.21.15.92:0/3626119094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12f8106f10 0x7f12f819cd60 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f12f000eaa0 tx=0x7f12f000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:52.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.023+0000 7f12effff640 1 -- 172.21.15.92:0/3626119094 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f000cdb0 con 0x7f12f8106f10 2024-09-19T09:11:52.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.023+0000 7f12fcee6640 1 -- 172.21.15.92:0/3626119094 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12f819d730 con 0x7f12f8106f10 2024-09-19T09:11:52.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.023+0000 7f12effff640 1 -- 172.21.15.92:0/3626119094 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12f0005020 con 0x7f12f8106f10 2024-09-19T09:11:52.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.023+0000 7f12effff640 1 -- 172.21.15.92:0/3626119094 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f00116d0 con 0x7f12f8106f10 2024-09-19T09:11:52.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.023+0000 7f12fcee6640 1 -- 172.21.15.92:0/3626119094 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12f81a5010 con 0x7f12f8106f10 2024-09-19T09:11:52.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.025+0000 7f12effff640 1 -- 172.21.15.92:0/3626119094 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f12f00054d0 con 0x7f12f8106f10 2024-09-19T09:11:52.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.026+0000 7f12ff2bf740 1 Processor -- start 2024-09-19T09:11:52.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.026+0000 7f12ff2bf740 1 -- start start 2024-09-19T09:11:52.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.026+0000 7f12ff2bf740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555984be8b40 0x555984be7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:52.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.026+0000 7f12ff2bf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555984be75d0 0x555984be7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:52.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.026+0000 7f12ff2bf740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555984bf2370 0x555984bf4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:52.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.026+0000 7f12ff2bf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555984b4d2f0 con 0x555984be75d0 2024-09-19T09:11:52.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.026+0000 7f12ff2bf740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x555984af4cf0 con 0x555984be8b40 2024-09-19T09:11:52.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.026+0000 7f12ff2bf740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x555984b492b0 con 0x555984bf2370 2024-09-19T09:11:52.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.026+0000 7f12effff640 1 --2- 172.21.15.92:0/3626119094 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f12e40a3240 0x7f12e40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:52.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.026+0000 7f12f659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555984be75d0 0x555984be7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:52.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.027+0000 7f12f659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555984be75d0 0x555984be7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56760/0 (socket says 172.21.15.92:56760) 2024-09-19T09:11:52.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.027+0000 7f12f659c640 1 -- 172.21.15.92:0/773298192 learned_addr learned my addr 172.21.15.92:0/773298192 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:52.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.027+0000 7f12f6d9d640 1 --2- 172.21.15.92:0/3626119094 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f12e40a3240 0x7f12e40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:52.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.027+0000 7f12edd9b640 1 --2- 172.21.15.92:0/773298192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555984be8b40 0x555984be7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:52.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.027+0000 7f12effff640 1 -- 172.21.15.92:0/3626119094 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f12f00cfa60 con 0x7f12f8106f10 2024-09-19T09:11:52.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.027+0000 7f12edd9b640 1 --2- 172.21.15.92:0/773298192 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555984bf2370 0x555984bf4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:52.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.027+0000 7f12f659c640 1 -- 172.21.15.92:0/773298192 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555984bf2370 msgr2=0x555984bf4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:52.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.027+0000 7f12f659c640 1 --2- 172.21.15.92:0/773298192 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555984bf2370 0x555984bf4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:52.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.027+0000 7f12f659c640 1 -- 172.21.15.92:0/773298192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555984be8b40 msgr2=0x555984be7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:52.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.027+0000 7f12f659c640 1 --2- 172.21.15.92:0/773298192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555984be8b40 0x555984be7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:52.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.027+0000 7f12f659c640 1 -- 172.21.15.92:0/773298192 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555984ad93a0 con 0x555984be75d0 2024-09-19T09:11:52.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.027+0000 7f12edd9b640 1 --2- 172.21.15.92:0/773298192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555984be8b40 0x555984be7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:11:52.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.027+0000 7f12f6d9d640 1 --2- 172.21.15.92:0/3626119094 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f12e40a3240 0x7f12e40a5700 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f12f00a47c0 tx=0x7f12f00c6e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:52.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.027+0000 7f12f659c640 1 --2- 172.21.15.92:0/773298192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555984be75d0 0x555984be7a10 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f12e800bcd0 tx=0x7f12e80107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8001ef09fde34417 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:52.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.027+0000 7f12ecd99640 1 -- 172.21.15.92:0/773298192 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e8005220 con 0x555984be75d0 2024-09-19T09:11:52.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.027+0000 7f12ecd99640 1 -- 172.21.15.92:0/773298192 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12e8004c80 con 0x555984be75d0 2024-09-19T09:11:52.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.027+0000 7f12ecd99640 1 -- 172.21.15.92:0/773298192 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e8011780 con 0x555984be75d0 2024-09-19T09:11:52.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.028+0000 7f12ff2bf740 1 -- 172.21.15.92:0/773298192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555984be75d0 msgr2=0x555984be7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:52.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.028+0000 7f12ff2bf740 1 --2- 172.21.15.92:0/773298192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555984be75d0 0x555984be7a10 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f12e800bcd0 tx=0x7f12e80107a0 comp rx=0 tx=0).stop 2024-09-19T09:11:52.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.028+0000 7f12ff2bf740 1 -- 172.21.15.92:0/773298192 shutdown_connections 2024-09-19T09:11:52.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.028+0000 7f12ff2bf740 1 --2- 172.21.15.92:0/773298192 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555984bf2370 0x555984bf4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:52.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.028+0000 7f12ff2bf740 1 --2- 172.21.15.92:0/773298192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555984be75d0 0x555984be7a10 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:52.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.028+0000 7f12ff2bf740 1 --2- 172.21.15.92:0/773298192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555984be8b40 0x555984be7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:52.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.028+0000 7f12ff2bf740 1 -- 172.21.15.92:0/773298192 >> 172.21.15.92:0/773298192 conn(0x555984bb0310 msgr2=0x555984be3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:52.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.028+0000 7f12ff2bf740 1 -- 172.21.15.92:0/773298192 shutdown_connections 2024-09-19T09:11:52.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.028+0000 7f12ff2bf740 1 -- 172.21.15.92:0/773298192 wait complete. 2024-09-19T09:11:52.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.028+0000 7f12ff2bf740 1 -- start start 2024-09-19T09:11:52.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.029+0000 7f12ff2bf740 1 Processor -- start 2024-09-19T09:11:52.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.029+0000 7f12ff2bf740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555984be75d0 0x555984bf1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:52.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.029+0000 7f12ff2bf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555984be8b40 0x555984bef000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:52.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.029+0000 7f12ff2bf740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555984bf2370 0x555984bef5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:52.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.029+0000 7f12ff2bf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555984bf5070 con 0x555984be8b40 2024-09-19T09:11:52.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.029+0000 7f12ff2bf740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x555984b08060 con 0x555984be75d0 2024-09-19T09:11:52.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.029+0000 7f12ff2bf740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x555984bf51f0 con 0x555984bf2370 2024-09-19T09:11:52.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.029+0000 7f12ff2bf740 10 client.0 _ll_register_callbacks cb 0x55598485b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:11:52.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.029+0000 7f12f659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555984be8b40 0x555984bef000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:52.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.029+0000 7f12f659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555984be8b40 0x555984bef000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56768/0 (socket says 172.21.15.92:56768) 2024-09-19T09:11:52.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.029+0000 7f12f659c640 1 -- 172.21.15.92:0/2116054664 learned_addr learned my addr 172.21.15.92:0/2116054664 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:52.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.029+0000 7f12edd9b640 1 --2- 172.21.15.92:0/2116054664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555984be75d0 0x555984bf1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:52.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.029+0000 7f12edd9b640 1 --2- 172.21.15.92:0/2116054664 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555984bf2370 0x555984bef5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:52.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.029+0000 7f12f659c640 1 -- 172.21.15.92:0/2116054664 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555984bf2370 msgr2=0x555984bef5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:52.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.029+0000 7f12f659c640 1 --2- 172.21.15.92:0/2116054664 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555984bf2370 0x555984bef5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:52.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.029+0000 7f12f659c640 1 -- 172.21.15.92:0/2116054664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555984be75d0 msgr2=0x555984bf1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:52.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.029+0000 7f12f659c640 1 --2- 172.21.15.92:0/2116054664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555984be75d0 0x555984bf1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:52.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.029+0000 7f12f659c640 1 -- 172.21.15.92:0/2116054664 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559848be3c0 con 0x555984be8b40 2024-09-19T09:11:52.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.029+0000 7f12f659c640 1 --2- 172.21.15.92:0/2116054664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555984be8b40 0x555984bef000 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f12e8005720 tx=0x7f12e80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89691b51015eb0e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:52.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.029+0000 7f12ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:11:52.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.030+0000 7f12ddffb640 1 -- 172.21.15.92:0/2116054664 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e8004ae0 con 0x555984be8b40 2024-09-19T09:11:52.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.030+0000 7f12ddffb640 1 -- 172.21.15.92:0/2116054664 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f12e8005040 con 0x555984be8b40 2024-09-19T09:11:52.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.030+0000 7f12ff2bf740 1 -- 172.21.15.92:0/2116054664 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12e8004c80 con 0x555984be8b40 2024-09-19T09:11:52.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.030+0000 7f12ddffb640 1 -- 172.21.15.92:0/2116054664 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f12e800be80 con 0x555984be8b40 2024-09-19T09:11:52.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.030+0000 7f12ff2bf740 10 client.18993 fetch_fsmap learned FSMap version 19 2024-09-19T09:11:52.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.030+0000 7f12ff2bf740 1 -- 172.21.15.92:0/2116054664 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x555984c00a60 con 0x555984be8b40 2024-09-19T09:11:52.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.030+0000 7f12ddffb640 1 -- 172.21.15.92:0/2116054664 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12e8004c80 con 0x555984be8b40 2024-09-19T09:11:52.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.030+0000 7f12ddffb640 1 -- 172.21.15.92:0/2116054664 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f12e802e050 con 0x555984be8b40 2024-09-19T09:11:52.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.030+0000 7f12ff2bf740 10 client.18993 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:11:52.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.030+0000 7f12ff2bf740 10 client.18993 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:11:52.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.030+0000 7f12ff2bf740 20 client.18993 populate_metadata read hostname 'smithi092' 2024-09-19T09:11:52.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.030+0000 7f12ff2bf740 1 --2- 172.21.15.92:0/2116054664 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555984c01db0 0x555984c041a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:52.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.030+0000 7f12ff2bf740 4 client.18993 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:11:52.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.030+0000 7f12ff2bf740 1 -- 172.21.15.92:0/2116054664 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555984b5a860 con 0x555984c01db0 2024-09-19T09:11:52.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.030+0000 7f12edd9b640 1 --2- 172.21.15.92:0/2116054664 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555984c01db0 0x555984c041a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:52.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.031+0000 7f12ddffb640 10 client.18993 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:52.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.031+0000 7f12edd9b640 1 --2- 172.21.15.92:0/2116054664 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555984c01db0 0x555984c041a0 crc :-1 s=READY pgs=452 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc794092a71b0413 server_cookie=d240398524031799 in_seq=0 out_seq=0 2024-09-19T09:11:52.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.032+0000 7f12ddffb640 1 -- 172.21.15.92:0/2116054664 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555984b5a860 con 0x555984c01db0 2024-09-19T09:11:52.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.032+0000 7f12ddffb640 10 client.18993 handle_command_reply: tid=0 2024-09-19T09:11:52.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.032+0000 7f12ff2bf740 1 client.18993 shutdown 2024-09-19T09:11:52.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.032+0000 7f12ff2bf740 1 -- 172.21.15.92:0/2116054664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555984be8b40 msgr2=0x555984bef000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:52.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.032+0000 7f12ff2bf740 1 --2- 172.21.15.92:0/2116054664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555984be8b40 0x555984bef000 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f12e8005720 tx=0x7f12e80048f0 comp rx=0 tx=0).stop 2024-09-19T09:11:52.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.032+0000 7f12ff2bf740 1 -- 172.21.15.92:0/2116054664 shutdown_connections 2024-09-19T09:11:52.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.032+0000 7f12ff2bf740 1 --2- 172.21.15.92:0/2116054664 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555984c01db0 0x555984c041a0 crc :-1 s=READY pgs=452 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:52.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.032+0000 7f12ff2bf740 1 --2- 172.21.15.92:0/2116054664 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555984bf2370 0x555984bef5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:52.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.032+0000 7f12ff2bf740 1 --2- 172.21.15.92:0/2116054664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555984be8b40 0x555984bef000 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:52.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.032+0000 7f12ff2bf740 1 --2- 172.21.15.92:0/2116054664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555984be75d0 0x555984bf1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:52.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.032+0000 7f12ff2bf740 1 -- 172.21.15.92:0/2116054664 >> 172.21.15.92:0/2116054664 conn(0x555984bb0310 msgr2=0x555984be9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:52.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.032+0000 7f12ddffb640 0 client.18993 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:52.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.032+0000 7f12ff2bf740 1 -- 172.21.15.92:0/2116054664 shutdown_connections 2024-09-19T09:11:52.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.032+0000 7f12ff2bf740 1 -- 172.21.15.92:0/2116054664 wait complete. 2024-09-19T09:11:52.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.032+0000 7f12ff2bf740 20 client.18993 trim_cache size 0 max 16384 2024-09-19T09:11:52.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.045+0000 7f12ff2bf740 1 Processor -- start 2024-09-19T09:11:52.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.045+0000 7f12ff2bf740 1 -- start start 2024-09-19T09:11:52.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.045+0000 7f12ff2bf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555984be75d0 0x555984bef6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:52.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.045+0000 7f12ff2bf740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555984be8b40 0x555984bfe310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:52.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.045+0000 7f12ff2bf740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555984bf2370 0x555984c09800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:52.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.045+0000 7f12ff2bf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f12f81ab660 con 0x555984be75d0 2024-09-19T09:11:52.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.045+0000 7f12ff2bf740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f12f81adf00 con 0x555984be8b40 2024-09-19T09:11:52.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.045+0000 7f12ff2bf740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f12f81abcf0 con 0x555984bf2370 2024-09-19T09:11:52.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.045+0000 7f12edd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555984be75d0 0x555984bef6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:52.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.045+0000 7f12edd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555984be75d0 0x555984bef6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56784/0 (socket says 172.21.15.92:56784) 2024-09-19T09:11:52.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.045+0000 7f12edd9b640 1 -- 172.21.15.92:0/3426413827 learned_addr learned my addr 172.21.15.92:0/3426413827 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:52.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.045+0000 7f12f659c640 1 --2- 172.21.15.92:0/3426413827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555984be8b40 0x555984bfe310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:52.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.045+0000 7f12edd9b640 1 -- 172.21.15.92:0/3426413827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555984bf2370 msgr2=0x555984c09800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:52.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.045+0000 7f12edd9b640 1 --2- 172.21.15.92:0/3426413827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555984bf2370 0x555984c09800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:52.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.045+0000 7f12edd9b640 1 -- 172.21.15.92:0/3426413827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555984be8b40 msgr2=0x555984bfe310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:52.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.045+0000 7f12edd9b640 1 --2- 172.21.15.92:0/3426413827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555984be8b40 0x555984bfe310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:52.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.045+0000 7f12edd9b640 1 -- 172.21.15.92:0/3426413827 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555984bea120 con 0x555984be75d0 2024-09-19T09:11:52.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.045+0000 7f12edd9b640 1 --2- 172.21.15.92:0/3426413827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555984be75d0 0x555984bef6d0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f12e0031bf0 tx=0x7f12e0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20df2aa3b3566e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:52.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.046+0000 7f12dffff640 1 -- 172.21.15.92:0/3426413827 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e0035040 con 0x555984be75d0 2024-09-19T09:11:52.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.046+0000 7f12dffff640 1 -- 172.21.15.92:0/3426413827 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12e0005020 con 0x555984be75d0 2024-09-19T09:11:52.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.046+0000 7f12dffff640 1 -- 172.21.15.92:0/3426413827 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e0004b20 con 0x555984be75d0 2024-09-19T09:11:52.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.046+0000 7f12ff2bf740 1 -- 172.21.15.92:0/3426413827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555984be75d0 msgr2=0x555984bef6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:52.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.046+0000 7f12ff2bf740 1 --2- 172.21.15.92:0/3426413827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555984be75d0 0x555984bef6d0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f12e0031bf0 tx=0x7f12e0009260 comp rx=0 tx=0).stop 2024-09-19T09:11:52.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.046+0000 7f12ff2bf740 1 -- 172.21.15.92:0/3426413827 shutdown_connections 2024-09-19T09:11:52.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.046+0000 7f12ff2bf740 1 --2- 172.21.15.92:0/3426413827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555984bf2370 0x555984c09800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:52.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.046+0000 7f12ff2bf740 1 --2- 172.21.15.92:0/3426413827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555984be8b40 0x555984bfe310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:52.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.046+0000 7f12ff2bf740 1 --2- 172.21.15.92:0/3426413827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555984be75d0 0x555984bef6d0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:52.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.046+0000 7f12ff2bf740 1 -- 172.21.15.92:0/3426413827 >> 172.21.15.92:0/3426413827 conn(0x555984bb0310 msgr2=0x555984beefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:52.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.046+0000 7f12ff2bf740 1 -- 172.21.15.92:0/3426413827 shutdown_connections 2024-09-19T09:11:52.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.046+0000 7f12ff2bf740 1 -- 172.21.15.92:0/3426413827 wait complete. 2024-09-19T09:11:52.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.047+0000 7f12ff2bf740 1 -- start start 2024-09-19T09:11:52.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.047+0000 7f12ff2bf740 1 Processor -- start 2024-09-19T09:11:52.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.047+0000 7f12ff2bf740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555984be75d0 0x555984bfa780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:52.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.047+0000 7f12ff2bf740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555984be8b40 0x555984bfacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:52.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.047+0000 7f12ff2bf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555984bf2370 0x555984beba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:52.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.047+0000 7f12ff2bf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f12f81ac3c0 con 0x555984bf2370 2024-09-19T09:11:52.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.047+0000 7f12ff2bf740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f12f81ad830 con 0x555984be75d0 2024-09-19T09:11:52.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.047+0000 7f12ff2bf740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f12f81aca90 con 0x555984be8b40 2024-09-19T09:11:52.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.047+0000 7f12ff2bf740 10 client.0 _ll_register_callbacks cb 0x7f12e800bb20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:11:52.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.047+0000 7f12edd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555984bf2370 0x555984beba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:52.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.047+0000 7f12edd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555984bf2370 0x555984beba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56796/0 (socket says 172.21.15.92:56796) 2024-09-19T09:11:52.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.047+0000 7f12edd9b640 1 -- 172.21.15.92:0/2984512674 learned_addr learned my addr 172.21.15.92:0/2984512674 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:52.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.047+0000 7f12f659c640 1 --2- 172.21.15.92:0/2984512674 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555984be8b40 0x555984bfacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:52.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.047+0000 7f12edd9b640 1 --2- 172.21.15.92:0/2984512674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555984be75d0 0x555984bfa780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:52.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.047+0000 7f12edd9b640 1 -- 172.21.15.92:0/2984512674 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555984be8b40 msgr2=0x555984bfacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:52.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.047+0000 7f12edd9b640 1 --2- 172.21.15.92:0/2984512674 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555984be8b40 0x555984bfacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:52.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.047+0000 7f12edd9b640 1 -- 172.21.15.92:0/2984512674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555984be75d0 msgr2=0x555984bfa780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:52.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.047+0000 7f12edd9b640 1 --2- 172.21.15.92:0/2984512674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555984be75d0 0x555984bfa780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:52.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.047+0000 7f12edd9b640 1 -- 172.21.15.92:0/2984512674 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555984be3510 con 0x555984bf2370 2024-09-19T09:11:52.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.048+0000 7f12edd9b640 1 --2- 172.21.15.92:0/2984512674 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555984bf2370 0x555984beba30 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f12e0000c00 tx=0x7f12e0009830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11fcef7321a56458 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:52.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.048+0000 7f12ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:11:52.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.048+0000 7f12ddffb640 1 -- 172.21.15.92:0/2984512674 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e005b020 con 0x555984bf2370 2024-09-19T09:11:52.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.048+0000 7f12ddffb640 1 -- 172.21.15.92:0/2984512674 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f12e00043d0 con 0x555984bf2370 2024-09-19T09:11:52.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.048+0000 7f12ff2bf740 1 -- 172.21.15.92:0/2984512674 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12e0005020 con 0x555984bf2370 2024-09-19T09:11:52.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.048+0000 7f12ddffb640 1 -- 172.21.15.92:0/2984512674 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f12e00051d0 con 0x555984bf2370 2024-09-19T09:11:52.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.048+0000 7f12ff2bf740 10 client.18999 fetch_fsmap learned FSMap version 19 2024-09-19T09:11:52.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.048+0000 7f12ff2bf740 1 -- 172.21.15.92:0/2984512674 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x555984c6c230 con 0x555984bf2370 2024-09-19T09:11:52.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.048+0000 7f12ddffb640 1 -- 172.21.15.92:0/2984512674 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12e0005020 con 0x555984bf2370 2024-09-19T09:11:52.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.048+0000 7f12ddffb640 1 -- 172.21.15.92:0/2984512674 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f12e0003a30 con 0x555984bf2370 2024-09-19T09:11:52.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.048+0000 7f12ff2bf740 10 client.18999 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:11:52.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.048+0000 7f12ff2bf740 10 client.18999 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:11:52.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.048+0000 7f12ff2bf740 20 client.18999 populate_metadata read hostname 'smithi092' 2024-09-19T09:11:52.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.048+0000 7f12ff2bf740 1 --2- 172.21.15.92:0/2984512674 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555984c6c8a0 0x555984c6ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:52.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.048+0000 7f12ff2bf740 4 client.18999 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:11:52.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.048+0000 7f12ff2bf740 1 -- 172.21.15.92:0/2984512674 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555984b54d70 con 0x555984c6c8a0 2024-09-19T09:11:52.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.049+0000 7f12f659c640 1 --2- 172.21.15.92:0/2984512674 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555984c6c8a0 0x555984c6ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:52.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.049+0000 7f12ddffb640 10 client.18999 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:52.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.049+0000 7f12f659c640 1 --2- 172.21.15.92:0/2984512674 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555984c6c8a0 0x555984c6ecc0 crc :-1 s=READY pgs=453 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9b072ee77d4101a server_cookie=5f9d5cdcaa03578f in_seq=0 out_seq=0 2024-09-19T09:11:52.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.049+0000 7f12ddffb640 1 -- 172.21.15.92:0/2984512674 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555984b54d70 con 0x555984c6c8a0 2024-09-19T09:11:52.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.049+0000 7f12ddffb640 10 client.18999 handle_command_reply: tid=0 2024-09-19T09:11:52.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.049+0000 7f12ff2bf740 1 client.18999 shutdown 2024-09-19T09:11:52.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.049+0000 7f12ff2bf740 1 -- 172.21.15.92:0/2984512674 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555984bf2370 msgr2=0x555984beba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:52.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.049+0000 7f12ff2bf740 1 --2- 172.21.15.92:0/2984512674 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555984bf2370 0x555984beba30 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f12e0000c00 tx=0x7f12e0009830 comp rx=0 tx=0).stop 2024-09-19T09:11:52.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.049+0000 7f12ff2bf740 1 -- 172.21.15.92:0/2984512674 shutdown_connections 2024-09-19T09:11:52.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.049+0000 7f12ff2bf740 1 --2- 172.21.15.92:0/2984512674 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x555984c6c8a0 0x555984c6ecc0 crc :-1 s=READY pgs=453 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:52.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.049+0000 7f12ff2bf740 1 --2- 172.21.15.92:0/2984512674 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555984bf2370 0x555984beba30 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:52.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.049+0000 7f12ff2bf740 1 --2- 172.21.15.92:0/2984512674 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555984be8b40 0x555984bfacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:52.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.049+0000 7f12ff2bf740 1 --2- 172.21.15.92:0/2984512674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555984be75d0 0x555984bfa780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:52.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.049+0000 7f12ddffb640 0 client.18999 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:52.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.049+0000 7f12ff2bf740 1 -- 172.21.15.92:0/2984512674 >> 172.21.15.92:0/2984512674 conn(0x555984bb0310 msgr2=0x555984be24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:52.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.049+0000 7f12ff2bf740 1 -- 172.21.15.92:0/2984512674 shutdown_connections 2024-09-19T09:11:52.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.050+0000 7f12ff2bf740 1 -- 172.21.15.92:0/2984512674 wait complete. 2024-09-19T09:11:52.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.050+0000 7f12ff2bf740 20 client.18999 trim_cache size 0 max 16384 2024-09-19T09:11:52.057 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-19T09:11:52.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.050+0000 7f12fcee6640 1 -- 172.21.15.92:0/3626119094 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f12e40a3240 msgr2=0x7f12e40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:52.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.050+0000 7f12fcee6640 1 --2- 172.21.15.92:0/3626119094 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f12e40a3240 0x7f12e40a5700 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f12f00a47c0 tx=0x7f12f00c6e50 comp rx=0 tx=0).stop 2024-09-19T09:11:52.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.050+0000 7f12fcee6640 1 -- 172.21.15.92:0/3626119094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12f8106f10 msgr2=0x7f12f819cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:52.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.050+0000 7f12fcee6640 1 --2- 172.21.15.92:0/3626119094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12f8106f10 0x7f12f819cd60 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f12f000eaa0 tx=0x7f12f000ef60 comp rx=0 tx=0).stop 2024-09-19T09:11:52.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.050+0000 7f12fcee6640 1 -- 172.21.15.92:0/3626119094 shutdown_connections 2024-09-19T09:11:52.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.050+0000 7f12fcee6640 1 --2- 172.21.15.92:0/3626119094 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f12e40a3240 0x7f12e40a5700 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:52.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.050+0000 7f12fcee6640 1 --2- 172.21.15.92:0/3626119094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12f8106f10 0x7f12f819cd60 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:52.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.050+0000 7f12fcee6640 1 --2- 172.21.15.92:0/3626119094 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12f8102790 0x7f12f81989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:52.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.050+0000 7f12fcee6640 1 --2- 172.21.15.92:0/3626119094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12f8101de0 0x7f12f8198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:52.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.050+0000 7f12fcee6640 1 -- 172.21.15.92:0/3626119094 >> 172.21.15.92:0/3626119094 conn(0x7f12f80fd8c0 msgr2=0x7f12f80fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:52.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.050+0000 7f12fcee6640 1 -- 172.21.15.92:0/3626119094 shutdown_connections 2024-09-19T09:11:52.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:52.050+0000 7f12fcee6640 1 -- 172.21.15.92:0/3626119094 wait complete. 2024-09-19T09:11:52.955 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:52 smithi092 ceph-mon[31407]: pgmap v792: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 1.6 MiB/s wr, 130 op/s 2024-09-19T09:11:53.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:52 smithi167 ceph-mon[35359]: pgmap v792: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 1.6 MiB/s wr, 130 op/s 2024-09-19T09:11:53.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:52 smithi190 ceph-mon[35358]: pgmap v792: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 1.6 MiB/s wr, 130 op/s 2024-09-19T09:11:53.988 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:11:53.988 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:11:54.249 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:11:54.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.712+0000 7ff7b9b9f640 1 -- 172.21.15.92:0/2992113602 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7b4102570 msgr2=0x7ff7b41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:54.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.712+0000 7ff7b9b9f640 1 --2- 172.21.15.92:0/2992113602 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7b4102570 0x7ff7b41029b0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7ff79c009900 tx=0x7ff79c02a480 comp rx=0 tx=0).stop 2024-09-19T09:11:54.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.712+0000 7ff7b9b9f640 1 -- 172.21.15.92:0/2992113602 shutdown_connections 2024-09-19T09:11:54.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.712+0000 7ff7b9b9f640 1 --2- 172.21.15.92:0/2992113602 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7b4102ef0 0x7ff7b410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:54.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.712+0000 7ff7b9b9f640 1 --2- 172.21.15.92:0/2992113602 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7b4102570 0x7ff7b41029b0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:54.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.712+0000 7ff7b9b9f640 1 --2- 172.21.15.92:0/2992113602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7b4100e20 0x7ff7b4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:54.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.712+0000 7ff7b9b9f640 1 -- 172.21.15.92:0/2992113602 >> 172.21.15.92:0/2992113602 conn(0x7ff7b40fc7d0 msgr2=0x7ff7b40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:54.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.712+0000 7ff7b9b9f640 1 -- 172.21.15.92:0/2992113602 shutdown_connections 2024-09-19T09:11:54.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.712+0000 7ff7b9b9f640 1 -- 172.21.15.92:0/2992113602 wait complete. 2024-09-19T09:11:54.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.712+0000 7ff7b9b9f640 1 Processor -- start 2024-09-19T09:11:54.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.712+0000 7ff7b9b9f640 1 -- start start 2024-09-19T09:11:54.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.713+0000 7ff7b9b9f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7b4100e20 0x7ff7b41973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:54.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.713+0000 7ff7b9b9f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7b4102570 0x7ff7b41978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:54.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.713+0000 7ff7b9b9f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7b4102ef0 0x7ff7b419bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:54.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.713+0000 7ff7b9b9f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b4110f80 con 0x7ff7b4100e20 2024-09-19T09:11:54.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.713+0000 7ff7b9b9f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b4110e00 con 0x7ff7b4102570 2024-09-19T09:11:54.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.713+0000 7ff7b9b9f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b4111100 con 0x7ff7b4102ef0 2024-09-19T09:11:54.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.713+0000 7ff7b37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7b4100e20 0x7ff7b41973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:54.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.713+0000 7ff7b37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7b4100e20 0x7ff7b41973a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56824/0 (socket says 172.21.15.92:56824) 2024-09-19T09:11:54.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.713+0000 7ff7b37fe640 1 -- 172.21.15.92:0/2707826839 learned_addr learned my addr 172.21.15.92:0/2707826839 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:54.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.713+0000 7ff7abfff640 1 --2- 172.21.15.92:0/2707826839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7b4102570 0x7ff7b41978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:54.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.713+0000 7ff7b37fe640 1 -- 172.21.15.92:0/2707826839 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7b4102ef0 msgr2=0x7ff7b419bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:54.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.713+0000 7ff7b37fe640 1 --2- 172.21.15.92:0/2707826839 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7b4102ef0 0x7ff7b419bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:54.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.713+0000 7ff7b37fe640 1 -- 172.21.15.92:0/2707826839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7b4102570 msgr2=0x7ff7b41978e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:54.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.713+0000 7ff7b37fe640 1 --2- 172.21.15.92:0/2707826839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7b4102570 0x7ff7b41978e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:54.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.713+0000 7ff7b37fe640 1 -- 172.21.15.92:0/2707826839 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b419c350 con 0x7ff7b4100e20 2024-09-19T09:11:54.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.713+0000 7ff7abfff640 1 --2- 172.21.15.92:0/2707826839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7b4102570 0x7ff7b41978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:11:54.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.713+0000 7ff7b37fe640 1 --2- 172.21.15.92:0/2707826839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7b4100e20 0x7ff7b41973a0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7ff7a400d950 tx=0x7ff7a400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:54.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.713+0000 7ff7b17fa640 1 -- 172.21.15.92:0/2707826839 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4017030 con 0x7ff7b4100e20 2024-09-19T09:11:54.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.713+0000 7ff7b9b9f640 1 -- 172.21.15.92:0/2707826839 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7b419c640 con 0x7ff7b4100e20 2024-09-19T09:11:54.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.713+0000 7ff7b17fa640 1 -- 172.21.15.92:0/2707826839 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7a4004020 con 0x7ff7b4100e20 2024-09-19T09:11:54.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.713+0000 7ff7b17fa640 1 -- 172.21.15.92:0/2707826839 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a40047a0 con 0x7ff7b4100e20 2024-09-19T09:11:54.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.713+0000 7ff7b9b9f640 1 -- 172.21.15.92:0/2707826839 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7b41a3f20 con 0x7ff7b4100e20 2024-09-19T09:11:54.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.716+0000 7ff7b17fa640 1 -- 172.21.15.92:0/2707826839 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff7a40041d0 con 0x7ff7b4100e20 2024-09-19T09:11:54.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.716+0000 7ff7bbf78740 1 Processor -- start 2024-09-19T09:11:54.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.716+0000 7ff7bbf78740 1 -- start start 2024-09-19T09:11:54.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.716+0000 7ff7bbf78740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560099978200 0x560099976a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:54.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.716+0000 7ff7bbf78740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560099976fd0 0x560099977410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:54.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.716+0000 7ff7bbf78740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560099985e00 0x5600999881f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:54.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.716+0000 7ff7bbf78740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5600998dc280 con 0x560099976fd0 2024-09-19T09:11:54.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.716+0000 7ff7bbf78740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560099883b10 con 0x560099978200 2024-09-19T09:11:54.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.716+0000 7ff7bbf78740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5600998d8240 con 0x560099985e00 2024-09-19T09:11:54.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.716+0000 7ff7b17fa640 1 --2- 172.21.15.92:0/2707826839 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff7a00a3240 0x7ff7a00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:54.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.716+0000 7ff7b37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560099976fd0 0x560099977410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:54.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.716+0000 7ff7b37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560099976fd0 0x560099977410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56826/0 (socket says 172.21.15.92:56826) 2024-09-19T09:11:54.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.716+0000 7ff7b37fe640 1 -- 172.21.15.92:0/443169631 learned_addr learned my addr 172.21.15.92:0/443169631 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:54.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.716+0000 7ff7b3fff640 1 --2- 172.21.15.92:0/443169631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560099978200 0x560099976a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:54.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.716+0000 7ff7b3fff640 1 --2- 172.21.15.92:0/2707826839 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff7a00a3240 0x7ff7a00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:54.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.716+0000 7ff7abfff640 1 --2- 172.21.15.92:0/443169631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560099985e00 0x5600999881f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:54.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.717+0000 7ff7b17fa640 1 -- 172.21.15.92:0/2707826839 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff7a40cf400 con 0x7ff7b4100e20 2024-09-19T09:11:54.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.717+0000 7ff7b3fff640 1 -- 172.21.15.92:0/443169631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560099985e00 msgr2=0x5600999881f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:54.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.717+0000 7ff7b3fff640 1 --2- 172.21.15.92:0/443169631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560099985e00 0x5600999881f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:54.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.717+0000 7ff7b3fff640 1 -- 172.21.15.92:0/443169631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560099976fd0 msgr2=0x560099977410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:54.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.717+0000 7ff7b3fff640 1 --2- 172.21.15.92:0/443169631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560099976fd0 0x560099977410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:54.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.717+0000 7ff7b3fff640 1 -- 172.21.15.92:0/443169631 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600998901f0 con 0x560099978200 2024-09-19T09:11:54.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.717+0000 7ff7abfff640 1 --2- 172.21.15.92:0/443169631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560099985e00 0x5600999881f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:11:54.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.717+0000 7ff7b37fe640 1 --2- 172.21.15.92:0/443169631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560099976fd0 0x560099977410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:11:54.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.717+0000 7ff7b3fff640 1 --2- 172.21.15.92:0/2707826839 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff7a00a3240 0x7ff7a00a5700 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac005c40 tx=0x7ff7ac00c000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:54.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.717+0000 7ff7b3fff640 1 --2- 172.21.15.92:0/443169631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560099978200 0x560099976a00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac0092f0 tx=0x7ff7ac00f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=549ba31d19765ac4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:54.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.717+0000 7ff7a9ffb640 1 -- 172.21.15.92:0/443169631 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac020070 con 0x560099978200 2024-09-19T09:11:54.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.718+0000 7ff7a9ffb640 1 -- 172.21.15.92:0/443169631 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7ac01c3f0 con 0x560099978200 2024-09-19T09:11:54.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.718+0000 7ff7a9ffb640 1 -- 172.21.15.92:0/443169631 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac009a70 con 0x560099978200 2024-09-19T09:11:54.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.718+0000 7ff7bbf78740 1 -- 172.21.15.92:0/443169631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560099978200 msgr2=0x560099976a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:54.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.718+0000 7ff7bbf78740 1 --2- 172.21.15.92:0/443169631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560099978200 0x560099976a00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac0092f0 tx=0x7ff7ac00f730 comp rx=0 tx=0).stop 2024-09-19T09:11:54.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.718+0000 7ff7bbf78740 1 -- 172.21.15.92:0/443169631 shutdown_connections 2024-09-19T09:11:54.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.718+0000 7ff7bbf78740 1 --2- 172.21.15.92:0/443169631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560099985e00 0x5600999881f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:54.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.718+0000 7ff7bbf78740 1 --2- 172.21.15.92:0/443169631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560099976fd0 0x560099977410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:54.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.718+0000 7ff7bbf78740 1 --2- 172.21.15.92:0/443169631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560099978200 0x560099976a00 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:54.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.718+0000 7ff7bbf78740 1 -- 172.21.15.92:0/443169631 >> 172.21.15.92:0/443169631 conn(0x5600999730f0 msgr2=0x5600999734d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:54.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.718+0000 7ff7bbf78740 1 -- 172.21.15.92:0/443169631 shutdown_connections 2024-09-19T09:11:54.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.718+0000 7ff7bbf78740 1 -- 172.21.15.92:0/443169631 wait complete. 2024-09-19T09:11:54.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.719+0000 7ff7bbf78740 1 -- start start 2024-09-19T09:11:54.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.719+0000 7ff7bbf78740 1 Processor -- start 2024-09-19T09:11:54.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.719+0000 7ff7bbf78740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560099976fd0 0x560099982dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:54.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.719+0000 7ff7bbf78740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560099978200 0x560099983310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:54.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.719+0000 7ff7bbf78740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560099985e00 0x560099983850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:54.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.719+0000 7ff7bbf78740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560099988c90 con 0x560099985e00 2024-09-19T09:11:54.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.719+0000 7ff7bbf78740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560099896f10 con 0x560099978200 2024-09-19T09:11:54.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.719+0000 7ff7bbf78740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x560099988e10 con 0x560099976fd0 2024-09-19T09:11:54.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.719+0000 7ff7bbf78740 10 client.0 _ll_register_callbacks cb 0x56009985fa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:11:54.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.719+0000 7ff7b3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560099985e00 0x560099983850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:54.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.719+0000 7ff7b3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560099985e00 0x560099983850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56840/0 (socket says 172.21.15.92:56840) 2024-09-19T09:11:54.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.719+0000 7ff7b3fff640 1 -- 172.21.15.92:0/3188431585 learned_addr learned my addr 172.21.15.92:0/3188431585 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:54.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.719+0000 7ff7abfff640 1 --2- 172.21.15.92:0/3188431585 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560099978200 0x560099983310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:54.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.719+0000 7ff7b37fe640 1 --2- 172.21.15.92:0/3188431585 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560099976fd0 0x560099982dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:54.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.720+0000 7ff7b3fff640 1 -- 172.21.15.92:0/3188431585 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560099976fd0 msgr2=0x560099982dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:54.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.720+0000 7ff7b3fff640 1 --2- 172.21.15.92:0/3188431585 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560099976fd0 0x560099982dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:54.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.720+0000 7ff7b3fff640 1 -- 172.21.15.92:0/3188431585 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560099978200 msgr2=0x560099983310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:54.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.720+0000 7ff7b3fff640 1 --2- 172.21.15.92:0/3188431585 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560099978200 0x560099983310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:54.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.720+0000 7ff7b3fff640 1 -- 172.21.15.92:0/3188431585 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56009964d6a0 con 0x560099985e00 2024-09-19T09:11:54.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.720+0000 7ff7b3fff640 1 --2- 172.21.15.92:0/3188431585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560099985e00 0x560099983850 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac009c60 tx=0x7ff7ac01cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc069ca9bc3f166 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:54.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.720+0000 7ff792ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:11:54.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.720+0000 7ff792ffd640 1 -- 172.21.15.92:0/3188431585 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac031020 con 0x560099985e00 2024-09-19T09:11:54.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.720+0000 7ff7bbf78740 1 -- 172.21.15.92:0/3188431585 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7ac01c3f0 con 0x560099985e00 2024-09-19T09:11:54.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.720+0000 7ff792ffd640 1 -- 172.21.15.92:0/3188431585 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff7ac004b20 con 0x560099985e00 2024-09-19T09:11:54.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.720+0000 7ff792ffd640 1 -- 172.21.15.92:0/3188431585 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff7ac020050 con 0x560099985e00 2024-09-19T09:11:54.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.720+0000 7ff7bbf78740 10 client.19011 fetch_fsmap learned FSMap version 19 2024-09-19T09:11:54.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.720+0000 7ff7bbf78740 1 -- 172.21.15.92:0/3188431585 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5600999949d0 con 0x560099985e00 2024-09-19T09:11:54.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.720+0000 7ff792ffd640 1 -- 172.21.15.92:0/3188431585 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7ac01c3f0 con 0x560099985e00 2024-09-19T09:11:54.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.721+0000 7ff792ffd640 1 -- 172.21.15.92:0/3188431585 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff7ac003970 con 0x560099985e00 2024-09-19T09:11:54.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.721+0000 7ff7bbf78740 10 client.19011 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:11:54.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.721+0000 7ff7bbf78740 10 client.19011 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:11:54.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.721+0000 7ff7bbf78740 20 client.19011 populate_metadata read hostname 'smithi092' 2024-09-19T09:11:54.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.721+0000 7ff7bbf78740 1 --2- 172.21.15.92:0/3188431585 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x560099995e90 0x560099998280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:54.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.721+0000 7ff7bbf78740 4 client.19011 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:11:54.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.721+0000 7ff7bbf78740 1 -- 172.21.15.92:0/3188431585 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5600998e97f0 con 0x560099995e90 2024-09-19T09:11:54.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.721+0000 7ff7b37fe640 1 --2- 172.21.15.92:0/3188431585 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x560099995e90 0x560099998280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:54.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.721+0000 7ff7b37fe640 1 --2- 172.21.15.92:0/3188431585 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x560099995e90 0x560099998280 crc :-1 s=READY pgs=454 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1532ccd31fb9385 server_cookie=1271c6c68d9b5d73 in_seq=0 out_seq=0 2024-09-19T09:11:54.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.721+0000 7ff792ffd640 10 client.19011 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:54.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.722+0000 7ff792ffd640 1 -- 172.21.15.92:0/3188431585 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5600998e97f0 con 0x560099995e90 2024-09-19T09:11:54.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.722+0000 7ff792ffd640 10 client.19011 handle_command_reply: tid=0 2024-09-19T09:11:54.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.722+0000 7ff7bbf78740 1 client.19011 shutdown 2024-09-19T09:11:54.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.722+0000 7ff7bbf78740 1 -- 172.21.15.92:0/3188431585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560099985e00 msgr2=0x560099983850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:54.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.722+0000 7ff7bbf78740 1 --2- 172.21.15.92:0/3188431585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560099985e00 0x560099983850 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac009c60 tx=0x7ff7ac01cce0 comp rx=0 tx=0).stop 2024-09-19T09:11:54.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.722+0000 7ff7bbf78740 1 -- 172.21.15.92:0/3188431585 shutdown_connections 2024-09-19T09:11:54.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.722+0000 7ff7bbf78740 1 --2- 172.21.15.92:0/3188431585 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x560099995e90 0x560099998280 crc :-1 s=READY pgs=454 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:54.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.722+0000 7ff7bbf78740 1 --2- 172.21.15.92:0/3188431585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560099985e00 0x560099983850 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:54.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.722+0000 7ff7bbf78740 1 --2- 172.21.15.92:0/3188431585 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560099978200 0x560099983310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:54.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.722+0000 7ff7bbf78740 1 --2- 172.21.15.92:0/3188431585 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560099976fd0 0x560099982dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:54.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.722+0000 7ff792ffd640 0 client.19011 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:54.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.722+0000 7ff7bbf78740 1 -- 172.21.15.92:0/3188431585 >> 172.21.15.92:0/3188431585 conn(0x5600999730f0 msgr2=0x560099978e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:54.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.722+0000 7ff7bbf78740 1 -- 172.21.15.92:0/3188431585 shutdown_connections 2024-09-19T09:11:54.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.722+0000 7ff7bbf78740 1 -- 172.21.15.92:0/3188431585 wait complete. 2024-09-19T09:11:54.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.722+0000 7ff7bbf78740 20 client.19011 trim_cache size 0 max 16384 2024-09-19T09:11:54.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.739+0000 7ff7bbf78740 1 Processor -- start 2024-09-19T09:11:54.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.739+0000 7ff7bbf78740 1 -- start start 2024-09-19T09:11:54.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.739+0000 7ff7bbf78740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560099976fd0 0x5600999785e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:54.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.739+0000 7ff7bbf78740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560099978200 0x560099978b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:54.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.739+0000 7ff7bbf78740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560099985e00 0x560099979060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:54.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.739+0000 7ff7bbf78740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b41a9370 con 0x560099976fd0 2024-09-19T09:11:54.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.739+0000 7ff7bbf78740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b41abc10 con 0x560099978200 2024-09-19T09:11:54.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.739+0000 7ff7bbf78740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b41a9a00 con 0x560099985e00 2024-09-19T09:11:54.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.739+0000 7ff7b37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560099976fd0 0x5600999785e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:54.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.739+0000 7ff7b37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560099976fd0 0x5600999785e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56848/0 (socket says 172.21.15.92:56848) 2024-09-19T09:11:54.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.739+0000 7ff7b37fe640 1 -- 172.21.15.92:0/3274251688 learned_addr learned my addr 172.21.15.92:0/3274251688 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:54.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.740+0000 7ff7b37fe640 1 -- 172.21.15.92:0/3274251688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560099985e00 msgr2=0x560099979060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:54.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.740+0000 7ff7b37fe640 1 --2- 172.21.15.92:0/3274251688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560099985e00 0x560099979060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:54.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.740+0000 7ff7b37fe640 1 -- 172.21.15.92:0/3274251688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560099978200 msgr2=0x560099978b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:54.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.740+0000 7ff7b37fe640 1 --2- 172.21.15.92:0/3274251688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560099978200 0x560099978b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:54.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.740+0000 7ff7b37fe640 1 -- 172.21.15.92:0/3274251688 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560099981320 con 0x560099976fd0 2024-09-19T09:11:54.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.740+0000 7ff7b37fe640 1 --2- 172.21.15.92:0/3274251688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560099976fd0 0x5600999785e0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7ff7a40983f0 tx=0x7ff7a40ccdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a55d71d99e47ec2f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:54.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.740+0000 7ff7a97fa640 1 -- 172.21.15.92:0/3274251688 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a409b380 con 0x560099976fd0 2024-09-19T09:11:54.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.740+0000 7ff7a97fa640 1 -- 172.21.15.92:0/3274251688 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7a409c120 con 0x560099976fd0 2024-09-19T09:11:54.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.740+0000 7ff7a97fa640 1 -- 172.21.15.92:0/3274251688 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a40cd0c0 con 0x560099976fd0 2024-09-19T09:11:54.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.741+0000 7ff7bbf78740 1 -- 172.21.15.92:0/3274251688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560099976fd0 msgr2=0x5600999785e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:54.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.741+0000 7ff7bbf78740 1 --2- 172.21.15.92:0/3274251688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560099976fd0 0x5600999785e0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7ff7a40983f0 tx=0x7ff7a40ccdd0 comp rx=0 tx=0).stop 2024-09-19T09:11:54.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.741+0000 7ff7bbf78740 1 -- 172.21.15.92:0/3274251688 shutdown_connections 2024-09-19T09:11:54.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.741+0000 7ff7bbf78740 1 --2- 172.21.15.92:0/3274251688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560099985e00 0x560099979060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:54.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.741+0000 7ff7bbf78740 1 --2- 172.21.15.92:0/3274251688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560099978200 0x560099978b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:54.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.741+0000 7ff7bbf78740 1 --2- 172.21.15.92:0/3274251688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560099976fd0 0x5600999785e0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:54.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.741+0000 7ff7bbf78740 1 -- 172.21.15.92:0/3274251688 >> 172.21.15.92:0/3274251688 conn(0x5600999730f0 msgr2=0x560099981ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:54.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.741+0000 7ff7bbf78740 1 -- 172.21.15.92:0/3274251688 shutdown_connections 2024-09-19T09:11:54.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.741+0000 7ff7bbf78740 1 -- 172.21.15.92:0/3274251688 wait complete. 2024-09-19T09:11:54.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.741+0000 7ff7bbf78740 1 -- start start 2024-09-19T09:11:54.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.741+0000 7ff7bbf78740 1 Processor -- start 2024-09-19T09:11:54.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.742+0000 7ff7bbf78740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560099976fd0 0x56009998e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:54.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.742+0000 7ff7bbf78740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560099978200 0x56009998e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:54.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.742+0000 7ff7bbf78740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560099985e00 0x560099979760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:54.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.742+0000 7ff7bbf78740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b41aa0d0 con 0x560099978200 2024-09-19T09:11:54.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.742+0000 7ff7bbf78740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b41ab540 con 0x560099985e00 2024-09-19T09:11:54.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.742+0000 7ff7bbf78740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b41aa7a0 con 0x560099976fd0 2024-09-19T09:11:54.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.742+0000 7ff7bbf78740 10 client.0 _ll_register_callbacks cb 0x7ff7a4098110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:11:54.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.742+0000 7ff7abfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560099978200 0x56009998e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:54.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.742+0000 7ff7abfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560099978200 0x56009998e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56850/0 (socket says 172.21.15.92:56850) 2024-09-19T09:11:54.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.742+0000 7ff7abfff640 1 -- 172.21.15.92:0/2890350056 learned_addr learned my addr 172.21.15.92:0/2890350056 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:54.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.742+0000 7ff7b3fff640 1 --2- 172.21.15.92:0/2890350056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560099985e00 0x560099979760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:54.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.742+0000 7ff7b37fe640 1 --2- 172.21.15.92:0/2890350056 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560099976fd0 0x56009998e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:54.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.742+0000 7ff7abfff640 1 -- 172.21.15.92:0/2890350056 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560099976fd0 msgr2=0x56009998e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:54.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.742+0000 7ff7abfff640 1 --2- 172.21.15.92:0/2890350056 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560099976fd0 0x56009998e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:54.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.742+0000 7ff7abfff640 1 -- 172.21.15.92:0/2890350056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560099985e00 msgr2=0x560099979760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:54.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.742+0000 7ff7abfff640 1 --2- 172.21.15.92:0/2890350056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560099985e00 0x560099979760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:54.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.742+0000 7ff7abfff640 1 -- 172.21.15.92:0/2890350056 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560099979dd0 con 0x560099978200 2024-09-19T09:11:54.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.742+0000 7ff7b37fe640 1 --2- 172.21.15.92:0/2890350056 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560099976fd0 0x56009998e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:11:54.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.742+0000 7ff7abfff640 1 --2- 172.21.15.92:0/2890350056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560099978200 0x56009998e7c0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7ff79c0314e0 tx=0x7ff79c005250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9345f1b65ceaa4dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:54.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.742+0000 7ff792ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:11:54.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.742+0000 7ff792ffd640 1 -- 172.21.15.92:0/2890350056 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79c035040 con 0x560099978200 2024-09-19T09:11:54.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.742+0000 7ff792ffd640 1 -- 172.21.15.92:0/2890350056 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ff79c0046c0 con 0x560099978200 2024-09-19T09:11:54.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.742+0000 7ff7bbf78740 1 -- 172.21.15.92:0/2890350056 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7a409c120 con 0x560099978200 2024-09-19T09:11:54.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.743+0000 7ff792ffd640 1 -- 172.21.15.92:0/2890350056 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff79c004900 con 0x560099978200 2024-09-19T09:11:54.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.743+0000 7ff7bbf78740 10 client.19017 fetch_fsmap learned FSMap version 19 2024-09-19T09:11:54.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.743+0000 7ff7bbf78740 1 -- 172.21.15.92:0/2890350056 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56009997b110 con 0x560099978200 2024-09-19T09:11:54.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.743+0000 7ff792ffd640 1 -- 172.21.15.92:0/2890350056 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7a409c120 con 0x560099978200 2024-09-19T09:11:54.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.743+0000 7ff792ffd640 1 -- 172.21.15.92:0/2890350056 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff79c043020 con 0x560099978200 2024-09-19T09:11:54.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.743+0000 7ff7bbf78740 10 client.19017 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:11:54.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.743+0000 7ff7bbf78740 10 client.19017 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:11:54.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.743+0000 7ff7bbf78740 20 client.19017 populate_metadata read hostname 'smithi092' 2024-09-19T09:11:54.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.743+0000 7ff7bbf78740 1 --2- 172.21.15.92:0/2890350056 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x560099a01b40 0x560099a03f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:54.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.743+0000 7ff7bbf78740 4 client.19017 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:11:54.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.743+0000 7ff7bbf78740 1 -- 172.21.15.92:0/2890350056 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5600998e3d00 con 0x560099a01b40 2024-09-19T09:11:54.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.743+0000 7ff7b37fe640 1 --2- 172.21.15.92:0/2890350056 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x560099a01b40 0x560099a03f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:54.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.744+0000 7ff7b37fe640 1 --2- 172.21.15.92:0/2890350056 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x560099a01b40 0x560099a03f60 crc :-1 s=READY pgs=455 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e1bff68e7cbe612 server_cookie=1a2fff55a1892d60 in_seq=0 out_seq=0 2024-09-19T09:11:54.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.744+0000 7ff792ffd640 10 client.19017 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:54.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.744+0000 7ff792ffd640 1 -- 172.21.15.92:0/2890350056 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5600998e3d00 con 0x560099a01b40 2024-09-19T09:11:54.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.744+0000 7ff792ffd640 10 client.19017 handle_command_reply: tid=0 2024-09-19T09:11:54.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.744+0000 7ff7bbf78740 1 client.19017 shutdown 2024-09-19T09:11:54.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.745+0000 7ff7bbf78740 1 -- 172.21.15.92:0/2890350056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560099978200 msgr2=0x56009998e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:54.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.745+0000 7ff7bbf78740 1 --2- 172.21.15.92:0/2890350056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560099978200 0x56009998e7c0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7ff79c0314e0 tx=0x7ff79c005250 comp rx=0 tx=0).stop 2024-09-19T09:11:54.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.745+0000 7ff7bbf78740 1 -- 172.21.15.92:0/2890350056 shutdown_connections 2024-09-19T09:11:54.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.745+0000 7ff7bbf78740 1 --2- 172.21.15.92:0/2890350056 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x560099a01b40 0x560099a03f60 crc :-1 s=READY pgs=455 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:54.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.745+0000 7ff7bbf78740 1 --2- 172.21.15.92:0/2890350056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560099985e00 0x560099979760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:54.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.745+0000 7ff7bbf78740 1 --2- 172.21.15.92:0/2890350056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560099978200 0x56009998e7c0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:54.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.745+0000 7ff7bbf78740 1 --2- 172.21.15.92:0/2890350056 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560099976fd0 0x56009998e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:54.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.745+0000 7ff792ffd640 0 client.19017 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:54.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.745+0000 7ff7bbf78740 1 -- 172.21.15.92:0/2890350056 >> 172.21.15.92:0/2890350056 conn(0x5600999730f0 msgr2=0x560099971a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:54.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.745+0000 7ff7bbf78740 1 -- 172.21.15.92:0/2890350056 shutdown_connections 2024-09-19T09:11:54.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.745+0000 7ff7bbf78740 1 -- 172.21.15.92:0/2890350056 wait complete. 2024-09-19T09:11:54.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.745+0000 7ff7bbf78740 20 client.19017 trim_cache size 0 max 16384 2024-09-19T09:11:54.751 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:11:54.751 INFO:teuthology.orchestra.run.smithi092.stdout: "return_code": 0, 2024-09-19T09:11:54.751 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_tag": "2327662a-a460-463f-be0f-2cf76142840b", 2024-09-19T09:11:54.751 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": "asynchronous" 2024-09-19T09:11:54.751 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:11:54.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.745+0000 7ff7b9b9f640 1 -- 172.21.15.92:0/2707826839 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff7a00a3240 msgr2=0x7ff7a00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:54.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.745+0000 7ff7b9b9f640 1 --2- 172.21.15.92:0/2707826839 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff7a00a3240 0x7ff7a00a5700 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac005c40 tx=0x7ff7ac00c000 comp rx=0 tx=0).stop 2024-09-19T09:11:54.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.745+0000 7ff7b9b9f640 1 -- 172.21.15.92:0/2707826839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7b4100e20 msgr2=0x7ff7b41973a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:54.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.745+0000 7ff7b9b9f640 1 --2- 172.21.15.92:0/2707826839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7b4100e20 0x7ff7b41973a0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7ff7a400d950 tx=0x7ff7a400de10 comp rx=0 tx=0).stop 2024-09-19T09:11:54.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.746+0000 7ff7b9b9f640 1 -- 172.21.15.92:0/2707826839 shutdown_connections 2024-09-19T09:11:54.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.746+0000 7ff7b9b9f640 1 --2- 172.21.15.92:0/2707826839 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7b4102ef0 0x7ff7b419bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:54.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.746+0000 7ff7b9b9f640 1 --2- 172.21.15.92:0/2707826839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7b4102570 0x7ff7b41978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:54.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.746+0000 7ff7b9b9f640 1 --2- 172.21.15.92:0/2707826839 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ff7a00a3240 0x7ff7a00a5700 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:54.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.746+0000 7ff7b9b9f640 1 --2- 172.21.15.92:0/2707826839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7b4100e20 0x7ff7b41973a0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:54.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.746+0000 7ff7b9b9f640 1 -- 172.21.15.92:0/2707826839 >> 172.21.15.92:0/2707826839 conn(0x7ff7b40fc7d0 msgr2=0x7ff7b40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:54.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.746+0000 7ff7b9b9f640 1 -- 172.21.15.92:0/2707826839 shutdown_connections 2024-09-19T09:11:54.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:54.746+0000 7ff7b9b9f640 1 -- 172.21.15.92:0/2707826839 wait complete. 2024-09-19T09:11:55.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:54 smithi092 ceph-mon[31407]: pgmap v793: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 840 KiB/s wr, 63 op/s 2024-09-19T09:11:55.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:54 smithi167 ceph-mon[35359]: pgmap v793: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 840 KiB/s wr, 63 op/s 2024-09-19T09:11:55.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:54 smithi190 ceph-mon[35358]: pgmap v793: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 840 KiB/s wr, 63 op/s 2024-09-19T09:11:55.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.397+0000 7fb125baf640 1 -- 172.21.15.92:0/670178331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1201025f0 msgr2=0x7fb120108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:55.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.397+0000 7fb125baf640 1 --2- 172.21.15.92:0/670178331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1201025f0 0x7fb120108e80 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fb118009ca0 tx=0x7fb11802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:11:55.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.397+0000 7fb125baf640 1 -- 172.21.15.92:0/670178331 shutdown_connections 2024-09-19T09:11:55.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.397+0000 7fb125baf640 1 --2- 172.21.15.92:0/670178331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1201025f0 0x7fb120108e80 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:55.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.397+0000 7fb125baf640 1 --2- 172.21.15.92:0/670178331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb120101c30 0x7fb1201020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:55.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.397+0000 7fb125baf640 1 --2- 172.21.15.92:0/670178331 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb120100a40 0x7fb120100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:55.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.397+0000 7fb125baf640 1 -- 172.21.15.92:0/670178331 >> 172.21.15.92:0/670178331 conn(0x7fb1200fc1e0 msgr2=0x7fb1200fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:55.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.397+0000 7fb125baf640 1 -- 172.21.15.92:0/670178331 shutdown_connections 2024-09-19T09:11:55.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.397+0000 7fb125baf640 1 -- 172.21.15.92:0/670178331 wait complete. 2024-09-19T09:11:55.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.397+0000 7fb125baf640 1 Processor -- start 2024-09-19T09:11:55.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.398+0000 7fb125baf640 1 -- start start 2024-09-19T09:11:55.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.398+0000 7fb125baf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb120100a40 0x7fb120197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:55.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.398+0000 7fb125baf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb120101c30 0x7fb120198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:55.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.398+0000 7fb125baf640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1201025f0 0x7fb12019f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:55.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.398+0000 7fb125baf640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb12010c740 con 0x7fb120101c30 2024-09-19T09:11:55.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.398+0000 7fb125baf640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb12010c5c0 con 0x7fb120100a40 2024-09-19T09:11:55.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.398+0000 7fb125baf640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb12010c8c0 con 0x7fb1201025f0 2024-09-19T09:11:55.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.398+0000 7fb11effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb120101c30 0x7fb120198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:55.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.398+0000 7fb11effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb120101c30 0x7fb120198290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56874/0 (socket says 172.21.15.92:56874) 2024-09-19T09:11:55.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.398+0000 7fb11effd640 1 -- 172.21.15.92:0/311192102 learned_addr learned my addr 172.21.15.92:0/311192102 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:55.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.398+0000 7fb11f7fe640 1 --2- 172.21.15.92:0/311192102 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb120100a40 0x7fb120197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:55.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.398+0000 7fb11ffff640 1 --2- 172.21.15.92:0/311192102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1201025f0 0x7fb12019f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:55.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.398+0000 7fb11effd640 1 -- 172.21.15.92:0/311192102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1201025f0 msgr2=0x7fb12019f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:55.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.398+0000 7fb11effd640 1 --2- 172.21.15.92:0/311192102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1201025f0 0x7fb12019f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:55.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.398+0000 7fb11effd640 1 -- 172.21.15.92:0/311192102 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb120100a40 msgr2=0x7fb120197d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:55.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.398+0000 7fb11effd640 1 --2- 172.21.15.92:0/311192102 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb120100a40 0x7fb120197d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:55.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.398+0000 7fb11effd640 1 -- 172.21.15.92:0/311192102 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb12019f970 con 0x7fb120101c30 2024-09-19T09:11:55.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.398+0000 7fb11f7fe640 1 --2- 172.21.15.92:0/311192102 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb120100a40 0x7fb120197d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:11:55.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.398+0000 7fb11effd640 1 --2- 172.21.15.92:0/311192102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb120101c30 0x7fb120198290 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fb11400c920 tx=0x7fb11400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:55.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.398+0000 7fb11cff9640 1 -- 172.21.15.92:0/311192102 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb114007c70 con 0x7fb120101c30 2024-09-19T09:11:55.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.399+0000 7fb125baf640 1 -- 172.21.15.92:0/311192102 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb12019fc60 con 0x7fb120101c30 2024-09-19T09:11:55.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.399+0000 7fb11cff9640 1 -- 172.21.15.92:0/311192102 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb114007e10 con 0x7fb120101c30 2024-09-19T09:11:55.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.399+0000 7fb11cff9640 1 -- 172.21.15.92:0/311192102 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb114018890 con 0x7fb120101c30 2024-09-19T09:11:55.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.399+0000 7fb125baf640 1 -- 172.21.15.92:0/311192102 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1201a0230 con 0x7fb120101c30 2024-09-19T09:11:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.401+0000 7fb11cff9640 1 -- 172.21.15.92:0/311192102 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb114018a70 con 0x7fb120101c30 2024-09-19T09:11:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.401+0000 7fb128a24740 1 Processor -- start 2024-09-19T09:11:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.401+0000 7fb128a24740 1 -- start start 2024-09-19T09:11:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.401+0000 7fb128a24740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560f46a7ddb0 0x560f46a7e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.401+0000 7fb128a24740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f46a7e6f0 0x560f46a831b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.401+0000 7fb128a24740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f46a83780 0x560f46a85c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.401+0000 7fb128a24740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560f469dd2f0 con 0x560f46a7e6f0 2024-09-19T09:11:55.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.401+0000 7fb128a24740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560f46985270 con 0x560f46a83780 2024-09-19T09:11:55.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.401+0000 7fb128a24740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x560f469d92b0 con 0x560f46a7ddb0 2024-09-19T09:11:55.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.402+0000 7fb11f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f46a7e6f0 0x560f46a831b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:55.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.402+0000 7fb11f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f46a7e6f0 0x560f46a831b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56886/0 (socket says 172.21.15.92:56886) 2024-09-19T09:11:55.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.402+0000 7fb11f7fe640 1 -- 172.21.15.92:0/4292684922 learned_addr learned my addr 172.21.15.92:0/4292684922 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:55.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.402+0000 7fb11ffff640 1 --2- 172.21.15.92:0/4292684922 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560f46a7ddb0 0x560f46a7e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:55.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.402+0000 7fb11effd640 1 --2- 172.21.15.92:0/4292684922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f46a83780 0x560f46a85c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:55.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.402+0000 7fb11cff9640 1 --2- 172.21.15.92:0/311192102 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb1080a32f0 0x7fb1080a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:55.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.402+0000 7fb11f7fe640 1 -- 172.21.15.92:0/4292684922 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560f46a7ddb0 msgr2=0x560f46a7e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:55.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.402+0000 7fb11f7fe640 1 --2- 172.21.15.92:0/4292684922 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560f46a7ddb0 0x560f46a7e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:55.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.402+0000 7fb11f7fe640 1 -- 172.21.15.92:0/4292684922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f46a83780 msgr2=0x560f46a85c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:55.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.402+0000 7fb11f7fe640 1 --2- 172.21.15.92:0/4292684922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f46a83780 0x560f46a85c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.402+0000 7fb11f7fe640 1 -- 172.21.15.92:0/4292684922 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f46984340 con 0x560f46a7e6f0 2024-09-19T09:11:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.402+0000 7fb11ffff640 1 --2- 172.21.15.92:0/311192102 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb1080a32f0 0x7fb1080a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.402+0000 7fb11cff9640 1 -- 172.21.15.92:0/311192102 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb1140cfb10 con 0x7fb120101c30 2024-09-19T09:11:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.402+0000 7fb11f7fe640 1 --2- 172.21.15.92:0/4292684922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f46a7e6f0 0x560f46a831b0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fb110007820 tx=0x7fb110007ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3506e2a5d9f92fad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.402+0000 7fb105ffb640 1 -- 172.21.15.92:0/4292684922 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb11000d950 con 0x560f46a7e6f0 2024-09-19T09:11:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.402+0000 7fb105ffb640 1 -- 172.21.15.92:0/4292684922 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb110018070 con 0x560f46a7e6f0 2024-09-19T09:11:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.402+0000 7fb105ffb640 1 -- 172.21.15.92:0/4292684922 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1100123e0 con 0x560f46a7e6f0 2024-09-19T09:11:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.403+0000 7fb128a24740 1 -- 172.21.15.92:0/4292684922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f46a7e6f0 msgr2=0x560f46a831b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.403+0000 7fb11ffff640 1 --2- 172.21.15.92:0/311192102 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb1080a32f0 0x7fb1080a57b0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fb118031c10 tx=0x7fb1180095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.403+0000 7fb128a24740 1 --2- 172.21.15.92:0/4292684922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f46a7e6f0 0x560f46a831b0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fb110007820 tx=0x7fb110007ce0 comp rx=0 tx=0).stop 2024-09-19T09:11:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.403+0000 7fb128a24740 1 -- 172.21.15.92:0/4292684922 shutdown_connections 2024-09-19T09:11:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.403+0000 7fb128a24740 1 --2- 172.21.15.92:0/4292684922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f46a83780 0x560f46a85c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:55.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.403+0000 7fb128a24740 1 --2- 172.21.15.92:0/4292684922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f46a7e6f0 0x560f46a831b0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:55.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.403+0000 7fb128a24740 1 --2- 172.21.15.92:0/4292684922 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560f46a7ddb0 0x560f46a7e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:55.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.403+0000 7fb128a24740 1 -- 172.21.15.92:0/4292684922 >> 172.21.15.92:0/4292684922 conn(0x560f46a75010 msgr2=0x560f46a75410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:55.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.403+0000 7fb128a24740 1 -- 172.21.15.92:0/4292684922 shutdown_connections 2024-09-19T09:11:55.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.403+0000 7fb128a24740 1 -- 172.21.15.92:0/4292684922 wait complete. 2024-09-19T09:11:55.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.403+0000 7fb128a24740 1 -- start start 2024-09-19T09:11:55.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.403+0000 7fb128a24740 1 Processor -- start 2024-09-19T09:11:55.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.404+0000 7fb128a24740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f46a7ddb0 0x560f46a87fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:55.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.404+0000 7fb128a24740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f46a7e6f0 0x560f46a884e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:55.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.404+0000 7fb128a24740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560f46a83780 0x560f46a8f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:55.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.404+0000 7fb128a24740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560f46a86750 con 0x560f46a7e6f0 2024-09-19T09:11:55.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.404+0000 7fb128a24740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560f46966290 con 0x560f46a7ddb0 2024-09-19T09:11:55.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.404+0000 7fb128a24740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x560f46a868d0 con 0x560f46a83780 2024-09-19T09:11:55.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.404+0000 7fb128a24740 10 client.0 _ll_register_callbacks cb 0x560f46997140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:11:55.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.404+0000 7fb11effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f46a7e6f0 0x560f46a884e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:55.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.404+0000 7fb11effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f46a7e6f0 0x560f46a884e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56890/0 (socket says 172.21.15.92:56890) 2024-09-19T09:11:55.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.404+0000 7fb11effd640 1 -- 172.21.15.92:0/1078696524 learned_addr learned my addr 172.21.15.92:0/1078696524 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:55.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.404+0000 7fb11f7fe640 1 --2- 172.21.15.92:0/1078696524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f46a7ddb0 0x560f46a87fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:55.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.404+0000 7fb11ffff640 1 --2- 172.21.15.92:0/1078696524 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560f46a83780 0x560f46a8f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:55.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.404+0000 7fb11effd640 1 -- 172.21.15.92:0/1078696524 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560f46a83780 msgr2=0x560f46a8f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:55.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.404+0000 7fb11effd640 1 --2- 172.21.15.92:0/1078696524 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560f46a83780 0x560f46a8f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:55.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.404+0000 7fb11effd640 1 -- 172.21.15.92:0/1078696524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f46a7ddb0 msgr2=0x560f46a87fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:55.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.404+0000 7fb11effd640 1 --2- 172.21.15.92:0/1078696524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f46a7ddb0 0x560f46a87fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:55.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.404+0000 7fb11effd640 1 -- 172.21.15.92:0/1078696524 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f466f0210 con 0x560f46a7e6f0 2024-09-19T09:11:55.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.404+0000 7fb11effd640 1 --2- 172.21.15.92:0/1078696524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f46a7e6f0 0x560f46a884e0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fb114098b00 tx=0x7fb1140a0740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fa112b3b122fd22 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:55.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.404+0000 7fb0feffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:11:55.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.404+0000 7fb0feffd640 1 -- 172.21.15.92:0/1078696524 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb11400de20 con 0x560f46a7e6f0 2024-09-19T09:11:55.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.404+0000 7fb0feffd640 1 -- 172.21.15.92:0/1078696524 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb114018d60 con 0x560f46a7e6f0 2024-09-19T09:11:55.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.404+0000 7fb128a24740 1 -- 172.21.15.92:0/1078696524 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb110018070 con 0x560f46a7e6f0 2024-09-19T09:11:55.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.405+0000 7fb0feffd640 1 -- 172.21.15.92:0/1078696524 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb11409c130 con 0x560f46a7e6f0 2024-09-19T09:11:55.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.405+0000 7fb128a24740 10 client.19029 fetch_fsmap learned FSMap version 19 2024-09-19T09:11:55.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.405+0000 7fb128a24740 1 -- 172.21.15.92:0/1078696524 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x560f467bc620 con 0x560f46a7e6f0 2024-09-19T09:11:55.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.405+0000 7fb0feffd640 1 -- 172.21.15.92:0/1078696524 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb110018070 con 0x560f46a7e6f0 2024-09-19T09:11:55.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.405+0000 7fb0feffd640 1 -- 172.21.15.92:0/1078696524 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fb1140a4910 con 0x560f46a7e6f0 2024-09-19T09:11:55.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.405+0000 7fb128a24740 10 client.19029 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:11:55.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.405+0000 7fb128a24740 10 client.19029 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:11:55.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.405+0000 7fb128a24740 20 client.19029 populate_metadata read hostname 'smithi092' 2024-09-19T09:11:55.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.405+0000 7fb128a24740 1 --2- 172.21.15.92:0/1078696524 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x560f46a93c10 0x560f46a96020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:55.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.405+0000 7fb128a24740 4 client.19029 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:11:55.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.405+0000 7fb128a24740 1 -- 172.21.15.92:0/1078696524 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f469eaa20 con 0x560f46a93c10 2024-09-19T09:11:55.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.405+0000 7fb11f7fe640 1 --2- 172.21.15.92:0/1078696524 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x560f46a93c10 0x560f46a96020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:55.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.406+0000 7fb0feffd640 10 client.19029 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:55.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.406+0000 7fb11f7fe640 1 --2- 172.21.15.92:0/1078696524 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x560f46a93c10 0x560f46a96020 crc :-1 s=READY pgs=456 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d82f4368ad2ba598 server_cookie=bcdca1c9fe93f14e in_seq=0 out_seq=0 2024-09-19T09:11:55.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.406+0000 7fb0feffd640 1 -- 172.21.15.92:0/1078696524 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560f469eaa20 con 0x560f46a93c10 2024-09-19T09:11:55.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.406+0000 7fb0feffd640 10 client.19029 handle_command_reply: tid=0 2024-09-19T09:11:55.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.407+0000 7fb128a24740 1 client.19029 shutdown 2024-09-19T09:11:55.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.407+0000 7fb128a24740 1 -- 172.21.15.92:0/1078696524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f46a7e6f0 msgr2=0x560f46a884e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:55.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.407+0000 7fb128a24740 1 --2- 172.21.15.92:0/1078696524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f46a7e6f0 0x560f46a884e0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fb114098b00 tx=0x7fb1140a0740 comp rx=0 tx=0).stop 2024-09-19T09:11:55.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.407+0000 7fb128a24740 1 -- 172.21.15.92:0/1078696524 shutdown_connections 2024-09-19T09:11:55.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.407+0000 7fb128a24740 1 --2- 172.21.15.92:0/1078696524 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x560f46a93c10 0x560f46a96020 crc :-1 s=READY pgs=456 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:55.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.407+0000 7fb128a24740 1 --2- 172.21.15.92:0/1078696524 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560f46a83780 0x560f46a8f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:55.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.407+0000 7fb128a24740 1 --2- 172.21.15.92:0/1078696524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f46a7e6f0 0x560f46a884e0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:55.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.407+0000 7fb128a24740 1 --2- 172.21.15.92:0/1078696524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f46a7ddb0 0x560f46a87fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:55.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.407+0000 7fb128a24740 1 -- 172.21.15.92:0/1078696524 >> 172.21.15.92:0/1078696524 conn(0x560f46a75010 msgr2=0x560f46a76820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:55.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.407+0000 7fb0feffd640 0 client.19029 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:55.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.407+0000 7fb128a24740 1 -- 172.21.15.92:0/1078696524 shutdown_connections 2024-09-19T09:11:55.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.407+0000 7fb128a24740 1 -- 172.21.15.92:0/1078696524 wait complete. 2024-09-19T09:11:55.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.407+0000 7fb128a24740 20 client.19029 trim_cache size 0 max 16384 2024-09-19T09:11:55.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.421+0000 7fb128a24740 1 Processor -- start 2024-09-19T09:11:55.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.421+0000 7fb128a24740 1 -- start start 2024-09-19T09:11:55.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.421+0000 7fb128a24740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560f46a7ddb0 0x560f46a75ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:55.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.421+0000 7fb128a24740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f46a7e6f0 0x560f46a8f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:55.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.421+0000 7fb128a24740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f46a83780 0x560f46a76400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:55.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.421+0000 7fb128a24740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb1201a4d50 con 0x560f46a83780 2024-09-19T09:11:55.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.421+0000 7fb128a24740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb1201a75f0 con 0x560f46a7e6f0 2024-09-19T09:11:55.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.421+0000 7fb128a24740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb1201a53e0 con 0x560f46a7ddb0 2024-09-19T09:11:55.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.421+0000 7fb11ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f46a83780 0x560f46a76400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:55.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.421+0000 7fb11ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f46a83780 0x560f46a76400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56902/0 (socket says 172.21.15.92:56902) 2024-09-19T09:11:55.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.422+0000 7fb11ffff640 1 -- 172.21.15.92:0/121272160 learned_addr learned my addr 172.21.15.92:0/121272160 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:55.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.422+0000 7fb11effd640 1 --2- 172.21.15.92:0/121272160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f46a7e6f0 0x560f46a8f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:55.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.422+0000 7fb11ffff640 1 -- 172.21.15.92:0/121272160 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560f46a7ddb0 msgr2=0x560f46a75ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:55.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.422+0000 7fb11f7fe640 1 --2- 172.21.15.92:0/121272160 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560f46a7ddb0 0x560f46a75ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:55.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.422+0000 7fb11ffff640 1 --2- 172.21.15.92:0/121272160 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560f46a7ddb0 0x560f46a75ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:55.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.422+0000 7fb11ffff640 1 -- 172.21.15.92:0/121272160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f46a7e6f0 msgr2=0x560f46a8f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:55.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.422+0000 7fb11ffff640 1 --2- 172.21.15.92:0/121272160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f46a7e6f0 0x560f46a8f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:55.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.422+0000 7fb11ffff640 1 -- 172.21.15.92:0/121272160 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f46a702d0 con 0x560f46a83780 2024-09-19T09:11:55.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.422+0000 7fb11ffff640 1 --2- 172.21.15.92:0/121272160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f46a83780 0x560f46a76400 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fb118009ca0 tx=0x7fb11803f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5af50143aaa6afb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.422+0000 7fb1057fa640 1 -- 172.21.15.92:0/121272160 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb118003af0 con 0x560f46a83780 2024-09-19T09:11:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.422+0000 7fb1057fa640 1 -- 172.21.15.92:0/121272160 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb118036040 con 0x560f46a83780 2024-09-19T09:11:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.422+0000 7fb1057fa640 1 -- 172.21.15.92:0/121272160 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb11802f990 con 0x560f46a83780 2024-09-19T09:11:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.423+0000 7fb128a24740 1 -- 172.21.15.92:0/121272160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f46a83780 msgr2=0x560f46a76400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.423+0000 7fb128a24740 1 --2- 172.21.15.92:0/121272160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f46a83780 0x560f46a76400 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fb118009ca0 tx=0x7fb11803f000 comp rx=0 tx=0).stop 2024-09-19T09:11:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.423+0000 7fb128a24740 1 -- 172.21.15.92:0/121272160 shutdown_connections 2024-09-19T09:11:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.423+0000 7fb128a24740 1 --2- 172.21.15.92:0/121272160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f46a83780 0x560f46a76400 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.423+0000 7fb128a24740 1 --2- 172.21.15.92:0/121272160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f46a7e6f0 0x560f46a8f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.423+0000 7fb128a24740 1 --2- 172.21.15.92:0/121272160 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560f46a7ddb0 0x560f46a75ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.423+0000 7fb128a24740 1 -- 172.21.15.92:0/121272160 >> 172.21.15.92:0/121272160 conn(0x560f46a75010 msgr2=0x560f46a7f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.423+0000 7fb128a24740 1 -- 172.21.15.92:0/121272160 shutdown_connections 2024-09-19T09:11:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.423+0000 7fb128a24740 1 -- 172.21.15.92:0/121272160 wait complete. 2024-09-19T09:11:55.431 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.423+0000 7fb128a24740 1 -- start start 2024-09-19T09:11:55.431 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.423+0000 7fb128a24740 1 Processor -- start 2024-09-19T09:11:55.431 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.423+0000 7fb128a24740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560f46a7ddb0 0x560f46a8c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:55.431 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.423+0000 7fb128a24740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f46a7e6f0 0x560f46a8cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:55.431 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.423+0000 7fb128a24740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f46a83780 0x560f46a8dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:55.431 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.423+0000 7fb128a24740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb1201a5ab0 con 0x560f46a7e6f0 2024-09-19T09:11:55.431 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.423+0000 7fb128a24740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb1201a6f20 con 0x560f46a83780 2024-09-19T09:11:55.431 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.423+0000 7fb128a24740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb1201a6180 con 0x560f46a7ddb0 2024-09-19T09:11:55.431 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.423+0000 7fb128a24740 10 client.0 _ll_register_callbacks cb 0x7fb11400c870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:11:55.431 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.424+0000 7fb11effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f46a7e6f0 0x560f46a8cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:55.431 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.424+0000 7fb11effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f46a7e6f0 0x560f46a8cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56918/0 (socket says 172.21.15.92:56918) 2024-09-19T09:11:55.431 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.424+0000 7fb11effd640 1 -- 172.21.15.92:0/1615038726 learned_addr learned my addr 172.21.15.92:0/1615038726 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:55.431 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.424+0000 7fb11ffff640 1 --2- 172.21.15.92:0/1615038726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f46a83780 0x560f46a8dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:55.432 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.424+0000 7fb11f7fe640 1 --2- 172.21.15.92:0/1615038726 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560f46a7ddb0 0x560f46a8c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:55.432 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.424+0000 7fb11effd640 1 -- 172.21.15.92:0/1615038726 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560f46a7ddb0 msgr2=0x560f46a8c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:55.432 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.424+0000 7fb11effd640 1 --2- 172.21.15.92:0/1615038726 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560f46a7ddb0 0x560f46a8c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:55.432 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.424+0000 7fb11effd640 1 -- 172.21.15.92:0/1615038726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f46a83780 msgr2=0x560f46a8dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:55.432 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.424+0000 7fb11effd640 1 --2- 172.21.15.92:0/1615038726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f46a83780 0x560f46a8dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:55.432 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.424+0000 7fb11effd640 1 -- 172.21.15.92:0/1615038726 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f46a87300 con 0x560f46a7e6f0 2024-09-19T09:11:55.432 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.424+0000 7fb11f7fe640 1 --2- 172.21.15.92:0/1615038726 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560f46a7ddb0 0x560f46a8c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:11:55.432 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.424+0000 7fb11effd640 1 --2- 172.21.15.92:0/1615038726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f46a7e6f0 0x560f46a8cdb0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fb114098590 tx=0x7fb1140984b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d80eee02981f8255 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:55.432 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.424+0000 7fb0feffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:11:55.432 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.424+0000 7fb0feffd640 1 -- 172.21.15.92:0/1615038726 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb11409bc70 con 0x560f46a7e6f0 2024-09-19T09:11:55.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.424+0000 7fb0feffd640 1 -- 172.21.15.92:0/1615038726 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fb11400fb30 con 0x560f46a7e6f0 2024-09-19T09:11:55.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.424+0000 7fb128a24740 1 -- 172.21.15.92:0/1615038726 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb118036040 con 0x560f46a7e6f0 2024-09-19T09:11:55.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.424+0000 7fb0feffd640 1 -- 172.21.15.92:0/1615038726 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb11400de20 con 0x560f46a7e6f0 2024-09-19T09:11:55.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.424+0000 7fb128a24740 10 client.19035 fetch_fsmap learned FSMap version 19 2024-09-19T09:11:55.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.424+0000 7fb128a24740 1 -- 172.21.15.92:0/1615038726 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x560f46a8f530 con 0x560f46a7e6f0 2024-09-19T09:11:55.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.424+0000 7fb0feffd640 1 -- 172.21.15.92:0/1615038726 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb118036040 con 0x560f46a7e6f0 2024-09-19T09:11:55.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.425+0000 7fb0feffd640 1 -- 172.21.15.92:0/1615038726 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fb1140cdb40 con 0x560f46a7e6f0 2024-09-19T09:11:55.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.425+0000 7fb128a24740 10 client.19035 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:11:55.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.425+0000 7fb128a24740 10 client.19035 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:11:55.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.425+0000 7fb128a24740 20 client.19035 populate_metadata read hostname 'smithi092' 2024-09-19T09:11:55.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.425+0000 7fb128a24740 1 --2- 172.21.15.92:0/1615038726 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x560f46afed60 0x560f46b01180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:55.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.425+0000 7fb128a24740 4 client.19035 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:11:55.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.425+0000 7fb128a24740 1 -- 172.21.15.92:0/1615038726 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560f469e4d70 con 0x560f46afed60 2024-09-19T09:11:55.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.425+0000 7fb11f7fe640 1 --2- 172.21.15.92:0/1615038726 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x560f46afed60 0x560f46b01180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:55.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.425+0000 7fb0feffd640 10 client.19035 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:55.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.425+0000 7fb11f7fe640 1 --2- 172.21.15.92:0/1615038726 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x560f46afed60 0x560f46b01180 crc :-1 s=READY pgs=457 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5859ba4f7447eab4 server_cookie=cb20b7147527056 in_seq=0 out_seq=0 2024-09-19T09:11:55.439 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.437+0000 7fb0feffd640 1 -- 172.21.15.92:0/1615038726 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560f469e4d70 con 0x560f46afed60 2024-09-19T09:11:55.439 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.437+0000 7fb0feffd640 10 client.19035 handle_command_reply: tid=0 2024-09-19T09:11:55.439 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.437+0000 7fb128a24740 1 client.19035 shutdown 2024-09-19T09:11:55.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.437+0000 7fb128a24740 1 -- 172.21.15.92:0/1615038726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f46a7e6f0 msgr2=0x560f46a8cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:55.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.437+0000 7fb128a24740 1 --2- 172.21.15.92:0/1615038726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f46a7e6f0 0x560f46a8cdb0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fb114098590 tx=0x7fb1140984b0 comp rx=0 tx=0).stop 2024-09-19T09:11:55.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.437+0000 7fb128a24740 1 -- 172.21.15.92:0/1615038726 shutdown_connections 2024-09-19T09:11:55.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.437+0000 7fb128a24740 1 --2- 172.21.15.92:0/1615038726 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x560f46afed60 0x560f46b01180 crc :-1 s=READY pgs=457 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:55.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.437+0000 7fb128a24740 1 --2- 172.21.15.92:0/1615038726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f46a83780 0x560f46a8dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:55.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.437+0000 7fb128a24740 1 --2- 172.21.15.92:0/1615038726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560f46a7e6f0 0x560f46a8cdb0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:55.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.437+0000 7fb128a24740 1 --2- 172.21.15.92:0/1615038726 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560f46a7ddb0 0x560f46a8c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:55.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.437+0000 7fb0feffd640 0 client.19035 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:55.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.437+0000 7fb128a24740 1 -- 172.21.15.92:0/1615038726 >> 172.21.15.92:0/1615038726 conn(0x560f46a75010 msgr2=0x560f46a739a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:55.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.438+0000 7fb128a24740 1 -- 172.21.15.92:0/1615038726 shutdown_connections 2024-09-19T09:11:55.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.438+0000 7fb128a24740 1 -- 172.21.15.92:0/1615038726 wait complete. 2024-09-19T09:11:55.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.438+0000 7fb128a24740 20 client.19035 trim_cache size 0 max 16384 2024-09-19T09:11:55.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:11:55.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:11:55.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:11:55.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:11:55.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.438+0000 7fb125baf640 1 -- 172.21.15.92:0/311192102 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb1080a32f0 msgr2=0x7fb1080a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:55.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.438+0000 7fb125baf640 1 --2- 172.21.15.92:0/311192102 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb1080a32f0 0x7fb1080a57b0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fb118031c10 tx=0x7fb1180095c0 comp rx=0 tx=0).stop 2024-09-19T09:11:55.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.438+0000 7fb125baf640 1 -- 172.21.15.92:0/311192102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb120101c30 msgr2=0x7fb120198290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:55.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.438+0000 7fb125baf640 1 --2- 172.21.15.92:0/311192102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb120101c30 0x7fb120198290 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fb11400c920 tx=0x7fb11400cde0 comp rx=0 tx=0).stop 2024-09-19T09:11:55.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.438+0000 7fb125baf640 1 -- 172.21.15.92:0/311192102 shutdown_connections 2024-09-19T09:11:55.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.438+0000 7fb125baf640 1 --2- 172.21.15.92:0/311192102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1201025f0 0x7fb12019f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:55.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.438+0000 7fb125baf640 1 --2- 172.21.15.92:0/311192102 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb1080a32f0 0x7fb1080a57b0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:55.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.438+0000 7fb125baf640 1 --2- 172.21.15.92:0/311192102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb120101c30 0x7fb120198290 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:55.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.438+0000 7fb125baf640 1 --2- 172.21.15.92:0/311192102 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb120100a40 0x7fb120197d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:55.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.438+0000 7fb125baf640 1 -- 172.21.15.92:0/311192102 >> 172.21.15.92:0/311192102 conn(0x7fb1200fc1e0 msgr2=0x7fb1200fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:55.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.438+0000 7fb125baf640 1 -- 172.21.15.92:0/311192102 shutdown_connections 2024-09-19T09:11:55.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:11:55.438+0000 7fb125baf640 1 -- 172.21.15.92:0/311192102 wait complete. 2024-09-19T09:11:55.476 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:11:55.721 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:11:55.799 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:11:56.077 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:55 smithi092 ceph-mon[31407]: scrub queued for path: / 2024-09-19T09:11:56.077 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:55 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:11:56.077 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:55 smithi092 ceph-mon[31407]: scrub summary: active paths [/] 2024-09-19T09:11:56.077 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:55 smithi092 ceph-mon[31407]: scrub summary: idle+waiting paths [/] 2024-09-19T09:11:56.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:55 smithi167 ceph-mon[35359]: scrub queued for path: / 2024-09-19T09:11:56.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:55 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:11:56.103 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:55 smithi167 ceph-mon[35359]: scrub summary: active paths [/] 2024-09-19T09:11:56.103 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:55 smithi167 ceph-mon[35359]: scrub summary: idle+waiting paths [/] 2024-09-19T09:11:56.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:55 smithi190 ceph-mon[35358]: scrub queued for path: / 2024-09-19T09:11:56.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:55 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:11:56.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:55 smithi190 ceph-mon[35358]: scrub summary: active paths [/] 2024-09-19T09:11:56.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:55 smithi190 ceph-mon[35358]: scrub summary: idle+waiting paths [/] 2024-09-19T09:11:56.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.159+0000 7fefbb1c7640 1 -- 172.21.15.92:0/4206079242 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefb4100e20 msgr2=0x7fefb4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:56.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.159+0000 7fefbb1c7640 1 --2- 172.21.15.92:0/4206079242 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefb4100e20 0x7fefb4101200 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fefac009900 tx=0x7fefac02a480 comp rx=0 tx=0).stop 2024-09-19T09:11:56.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.159+0000 7fefbb1c7640 1 -- 172.21.15.92:0/4206079242 shutdown_connections 2024-09-19T09:11:56.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.159+0000 7fefbb1c7640 1 --2- 172.21.15.92:0/4206079242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefb4102ef0 0x7fefb410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:56.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.159+0000 7fefbb1c7640 1 --2- 172.21.15.92:0/4206079242 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fefb4102570 0x7fefb41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:56.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.159+0000 7fefbb1c7640 1 --2- 172.21.15.92:0/4206079242 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefb4100e20 0x7fefb4101200 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:56.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.159+0000 7fefbb1c7640 1 -- 172.21.15.92:0/4206079242 >> 172.21.15.92:0/4206079242 conn(0x7fefb40fc7d0 msgr2=0x7fefb40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:56.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.159+0000 7fefbb1c7640 1 -- 172.21.15.92:0/4206079242 shutdown_connections 2024-09-19T09:11:56.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.159+0000 7fefbb1c7640 1 -- 172.21.15.92:0/4206079242 wait complete. 2024-09-19T09:11:56.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.159+0000 7fefbb1c7640 1 Processor -- start 2024-09-19T09:11:56.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.160+0000 7fefbb1c7640 1 -- start start 2024-09-19T09:11:56.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.160+0000 7fefbb1c7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefb4100e20 0x7fefb41992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:56.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.160+0000 7fefbb1c7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefb4102570 0x7fefb41997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:56.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.160+0000 7fefbb1c7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fefb4102ef0 0x7fefb41a4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:56.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.160+0000 7fefbb1c7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fefb4110f50 con 0x7fefb4100e20 2024-09-19T09:11:56.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.160+0000 7fefbb1c7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fefb4110dd0 con 0x7fefb4102570 2024-09-19T09:11:56.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.160+0000 7fefbb1c7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fefb41110d0 con 0x7fefb4102ef0 2024-09-19T09:11:56.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.160+0000 7fefb8f63640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefb4100e20 0x7fefb41992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:56.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.160+0000 7fefb8f63640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefb4100e20 0x7fefb41992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56932/0 (socket says 172.21.15.92:56932) 2024-09-19T09:11:56.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.160+0000 7fefb8f63640 1 -- 172.21.15.92:0/4221827898 learned_addr learned my addr 172.21.15.92:0/4221827898 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:56.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.160+0000 7fefb3fff640 1 --2- 172.21.15.92:0/4221827898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefb4102570 0x7fefb41997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:56.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.160+0000 7fefb9764640 1 --2- 172.21.15.92:0/4221827898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fefb4102ef0 0x7fefb41a4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:56.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.160+0000 7fefb8f63640 1 -- 172.21.15.92:0/4221827898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fefb4102ef0 msgr2=0x7fefb41a4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:56.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.160+0000 7fefb8f63640 1 --2- 172.21.15.92:0/4221827898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fefb4102ef0 0x7fefb41a4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:56.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.160+0000 7fefb8f63640 1 -- 172.21.15.92:0/4221827898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefb4102570 msgr2=0x7fefb41997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:56.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.160+0000 7fefb8f63640 1 --2- 172.21.15.92:0/4221827898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefb4102570 0x7fefb41997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:56.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.160+0000 7fefb8f63640 1 -- 172.21.15.92:0/4221827898 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefb41a4860 con 0x7fefb4100e20 2024-09-19T09:11:56.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.160+0000 7fefb9764640 1 --2- 172.21.15.92:0/4221827898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fefb4102ef0 0x7fefb41a4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:11:56.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.160+0000 7fefb8f63640 1 --2- 172.21.15.92:0/4221827898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefb4100e20 0x7fefb41992a0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fefac006010 tx=0x7fefac003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:56.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.160+0000 7fefb1ffb640 1 -- 172.21.15.92:0/4221827898 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefac03f070 con 0x7fefb4100e20 2024-09-19T09:11:56.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.161+0000 7fefb1ffb640 1 -- 172.21.15.92:0/4221827898 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefac031c30 con 0x7fefb4100e20 2024-09-19T09:11:56.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.161+0000 7fefbb1c7640 1 -- 172.21.15.92:0/4221827898 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefb41a4a30 con 0x7fefb4100e20 2024-09-19T09:11:56.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.161+0000 7fefb1ffb640 1 -- 172.21.15.92:0/4221827898 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefac035030 con 0x7fefb4100e20 2024-09-19T09:11:56.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.161+0000 7fefbb1c7640 1 -- 172.21.15.92:0/4221827898 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefb41a4f10 con 0x7fefb4100e20 2024-09-19T09:11:56.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.163+0000 7fefb1ffb640 1 -- 172.21.15.92:0/4221827898 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fefac042070 con 0x7fefb4100e20 2024-09-19T09:11:56.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.163+0000 7fefbd5a0740 1 Processor -- start 2024-09-19T09:11:56.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.163+0000 7fefbd5a0740 1 -- start start 2024-09-19T09:11:56.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.163+0000 7fefbd5a0740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590956e34a0 0x5590956e3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:56.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.163+0000 7fefbd5a0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5590956e3dc0 0x5590956ee140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:56.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.163+0000 7fefbd5a0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590956ee680 0x5590956f0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:56.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.163+0000 7fefbd5a0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5590956492e0 con 0x5590956ee680 2024-09-19T09:11:56.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.163+0000 7fefbd5a0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5590955f0ce0 con 0x5590956e3dc0 2024-09-19T09:11:56.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.163+0000 7fefbd5a0740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5590956452a0 con 0x5590956e34a0 2024-09-19T09:11:56.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.164+0000 7fefb3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590956ee680 0x5590956f0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:56.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.164+0000 7fefb3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590956ee680 0x5590956f0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56934/0 (socket says 172.21.15.92:56934) 2024-09-19T09:11:56.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.164+0000 7fefb3fff640 1 -- 172.21.15.92:0/3645630080 learned_addr learned my addr 172.21.15.92:0/3645630080 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:56.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.164+0000 7fefb8f63640 1 --2- 172.21.15.92:0/3645630080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5590956e3dc0 0x5590956ee140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:56.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.164+0000 7fefb1ffb640 1 --2- 172.21.15.92:0/4221827898 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fefa00a32c0 0x7fefa00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:56.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.164+0000 7fefb9764640 1 --2- 172.21.15.92:0/3645630080 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590956e34a0 0x5590956e3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:56.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.164+0000 7fefb3fff640 1 -- 172.21.15.92:0/3645630080 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590956e34a0 msgr2=0x5590956e3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:56.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.164+0000 7fefb3fff640 1 --2- 172.21.15.92:0/3645630080 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590956e34a0 0x5590956e3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:56.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.164+0000 7fefb3fff640 1 -- 172.21.15.92:0/3645630080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5590956e3dc0 msgr2=0x5590956ee140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:56.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.164+0000 7fefb3fff640 1 --2- 172.21.15.92:0/3645630080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5590956e3dc0 0x5590956ee140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:56.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.164+0000 7fefb3fff640 1 -- 172.21.15.92:0/3645630080 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590955d5440 con 0x5590956ee680 2024-09-19T09:11:56.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.164+0000 7fefb8f63640 1 --2- 172.21.15.92:0/3645630080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5590956e3dc0 0x5590956ee140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:11:56.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.164+0000 7fefb9764640 1 --2- 172.21.15.92:0/4221827898 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fefa00a32c0 0x7fefa00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:56.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.164+0000 7fefb3fff640 1 --2- 172.21.15.92:0/3645630080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590956ee680 0x5590956f0a70 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fefa4007f60 tx=0x7fefa4007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=605f83ecbc288c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:56.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.164+0000 7fefb1ffb640 1 -- 172.21.15.92:0/4221827898 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fefac0f00f0 con 0x7fefb4100e20 2024-09-19T09:11:56.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.164+0000 7fefaaffd640 1 -- 172.21.15.92:0/3645630080 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa4004d20 con 0x5590956ee680 2024-09-19T09:11:56.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.164+0000 7fefaaffd640 1 -- 172.21.15.92:0/3645630080 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefa4010be0 con 0x5590956ee680 2024-09-19T09:11:56.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.164+0000 7fefb9764640 1 --2- 172.21.15.92:0/4221827898 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fefa00a32c0 0x7fefa00a5780 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fef9c0058c0 tx=0x7fef9c004730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:56.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.164+0000 7fefaaffd640 1 -- 172.21.15.92:0/3645630080 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa4005770 con 0x5590956ee680 2024-09-19T09:11:56.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.165+0000 7fefbd5a0740 1 -- 172.21.15.92:0/3645630080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590956ee680 msgr2=0x5590956f0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:56.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.165+0000 7fefbd5a0740 1 --2- 172.21.15.92:0/3645630080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590956ee680 0x5590956f0a70 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fefa4007f60 tx=0x7fefa4007f90 comp rx=0 tx=0).stop 2024-09-19T09:11:56.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.165+0000 7fefbd5a0740 1 -- 172.21.15.92:0/3645630080 shutdown_connections 2024-09-19T09:11:56.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.165+0000 7fefbd5a0740 1 --2- 172.21.15.92:0/3645630080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590956ee680 0x5590956f0a70 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:56.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.165+0000 7fefbd5a0740 1 --2- 172.21.15.92:0/3645630080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5590956e3dc0 0x5590956ee140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:56.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.165+0000 7fefbd5a0740 1 --2- 172.21.15.92:0/3645630080 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590956e34a0 0x5590956e3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:56.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.165+0000 7fefbd5a0740 1 -- 172.21.15.92:0/3645630080 >> 172.21.15.92:0/3645630080 conn(0x5590956dfa30 msgr2=0x5590956dfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:56.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.165+0000 7fefbd5a0740 1 -- 172.21.15.92:0/3645630080 shutdown_connections 2024-09-19T09:11:56.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.165+0000 7fefbd5a0740 1 -- 172.21.15.92:0/3645630080 wait complete. 2024-09-19T09:11:56.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.165+0000 7fefbd5a0740 1 -- start start 2024-09-19T09:11:56.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.166+0000 7fefbd5a0740 1 Processor -- start 2024-09-19T09:11:56.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.166+0000 7fefbd5a0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5590956e34a0 0x5590956edee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:56.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.166+0000 7fefbd5a0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590956e3dc0 0x5590956eb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:56.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.166+0000 7fefbd5a0740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590956ee680 0x5590956eb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:56.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.166+0000 7fefbd5a0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5590956f1250 con 0x5590956e3dc0 2024-09-19T09:11:56.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.166+0000 7fefbd5a0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559095604050 con 0x5590956e34a0 2024-09-19T09:11:56.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.166+0000 7fefbd5a0740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5590956f13d0 con 0x5590956ee680 2024-09-19T09:11:56.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.166+0000 7fefbd5a0740 10 client.0 _ll_register_callbacks cb 0x559095644160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:11:56.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.166+0000 7fefb3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590956e3dc0 0x5590956eb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:56.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.166+0000 7fefb3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590956e3dc0 0x5590956eb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56936/0 (socket says 172.21.15.92:56936) 2024-09-19T09:11:56.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.166+0000 7fefb3fff640 1 -- 172.21.15.92:0/1339665268 learned_addr learned my addr 172.21.15.92:0/1339665268 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:56.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.166+0000 7fefb8f63640 1 --2- 172.21.15.92:0/1339665268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5590956e34a0 0x5590956edee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:56.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.166+0000 7fefb3fff640 1 -- 172.21.15.92:0/1339665268 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590956ee680 msgr2=0x5590956eb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:56.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.166+0000 7fefb3fff640 1 --2- 172.21.15.92:0/1339665268 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590956ee680 0x5590956eb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:56.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.166+0000 7fefb3fff640 1 -- 172.21.15.92:0/1339665268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5590956e34a0 msgr2=0x5590956edee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:56.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.166+0000 7fefb3fff640 1 --2- 172.21.15.92:0/1339665268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5590956e34a0 0x5590956edee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:56.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.166+0000 7fefb3fff640 1 -- 172.21.15.92:0/1339665268 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590953ba3c0 con 0x5590956e3dc0 2024-09-19T09:11:56.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.166+0000 7fefb8f63640 1 --2- 172.21.15.92:0/1339665268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5590956e34a0 0x5590956edee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:11:56.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.167+0000 7fefb3fff640 1 --2- 172.21.15.92:0/1339665268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590956e3dc0 0x5590956eb190 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fefa4005450 tx=0x7fefa40051b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ce2127d0902b68 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:56.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.167+0000 7fef93fff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:11:56.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.167+0000 7fef93fff640 1 -- 172.21.15.92:0/1339665268 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa4026020 con 0x5590956e3dc0 2024-09-19T09:11:56.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.167+0000 7fef93fff640 1 -- 172.21.15.92:0/1339665268 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fefa4005770 con 0x5590956e3dc0 2024-09-19T09:11:56.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.167+0000 7fefbd5a0740 1 -- 172.21.15.92:0/1339665268 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fefa4010be0 con 0x5590956e3dc0 2024-09-19T09:11:56.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.167+0000 7fef93fff640 1 -- 172.21.15.92:0/1339665268 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fefa401d040 con 0x5590956e3dc0 2024-09-19T09:11:56.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.167+0000 7fefbd5a0740 10 client.19047 fetch_fsmap learned FSMap version 19 2024-09-19T09:11:56.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.167+0000 7fefbd5a0740 1 -- 172.21.15.92:0/1339665268 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5590956fcb70 con 0x5590956e3dc0 2024-09-19T09:11:56.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.167+0000 7fef93fff640 1 -- 172.21.15.92:0/1339665268 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefa4010be0 con 0x5590956e3dc0 2024-09-19T09:11:56.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.167+0000 7fef93fff640 1 -- 172.21.15.92:0/1339665268 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fefa40228d0 con 0x5590956e3dc0 2024-09-19T09:11:56.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.167+0000 7fefbd5a0740 10 client.19047 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:11:56.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.167+0000 7fefbd5a0740 10 client.19047 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:11:56.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.167+0000 7fefbd5a0740 20 client.19047 populate_metadata read hostname 'smithi092' 2024-09-19T09:11:56.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.167+0000 7fefbd5a0740 1 --2- 172.21.15.92:0/1339665268 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5590956fdf80 0x559095700370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:56.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.167+0000 7fefbd5a0740 4 client.19047 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:11:56.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.167+0000 7fefbd5a0740 1 -- 172.21.15.92:0/1339665268 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559095656850 con 0x5590956fdf80 2024-09-19T09:11:56.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.168+0000 7fefb8f63640 1 --2- 172.21.15.92:0/1339665268 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5590956fdf80 0x559095700370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:56.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.168+0000 7fefb8f63640 1 --2- 172.21.15.92:0/1339665268 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5590956fdf80 0x559095700370 crc :-1 s=READY pgs=458 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21b4f3ae5701202b server_cookie=1614f6929c3c9626 in_seq=0 out_seq=0 2024-09-19T09:11:56.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.168+0000 7fef93fff640 10 client.19047 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:56.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.169+0000 7fef93fff640 1 -- 172.21.15.92:0/1339665268 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559095656850 con 0x5590956fdf80 2024-09-19T09:11:56.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.169+0000 7fef93fff640 10 client.19047 handle_command_reply: tid=0 2024-09-19T09:11:56.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.169+0000 7fefbd5a0740 1 client.19047 shutdown 2024-09-19T09:11:56.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.169+0000 7fefbd5a0740 1 -- 172.21.15.92:0/1339665268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590956e3dc0 msgr2=0x5590956eb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:56.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.169+0000 7fefbd5a0740 1 --2- 172.21.15.92:0/1339665268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590956e3dc0 0x5590956eb190 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fefa4005450 tx=0x7fefa40051b0 comp rx=0 tx=0).stop 2024-09-19T09:11:56.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.169+0000 7fefbd5a0740 1 -- 172.21.15.92:0/1339665268 shutdown_connections 2024-09-19T09:11:56.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.169+0000 7fefbd5a0740 1 --2- 172.21.15.92:0/1339665268 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5590956fdf80 0x559095700370 crc :-1 s=READY pgs=458 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:56.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.169+0000 7fefbd5a0740 1 --2- 172.21.15.92:0/1339665268 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590956ee680 0x5590956eb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:56.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.169+0000 7fefbd5a0740 1 --2- 172.21.15.92:0/1339665268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590956e3dc0 0x5590956eb190 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:56.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.169+0000 7fef93fff640 0 client.19047 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:56.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.169+0000 7fefbd5a0740 1 --2- 172.21.15.92:0/1339665268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5590956e34a0 0x5590956edee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:56.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.169+0000 7fefbd5a0740 1 -- 172.21.15.92:0/1339665268 >> 172.21.15.92:0/1339665268 conn(0x5590956dfa30 msgr2=0x5590956e5710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:56.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.169+0000 7fefbd5a0740 1 -- 172.21.15.92:0/1339665268 shutdown_connections 2024-09-19T09:11:56.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.169+0000 7fefbd5a0740 1 -- 172.21.15.92:0/1339665268 wait complete. 2024-09-19T09:11:56.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.169+0000 7fefbd5a0740 20 client.19047 trim_cache size 0 max 16384 2024-09-19T09:11:56.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.186+0000 7fefbd5a0740 1 Processor -- start 2024-09-19T09:11:56.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.186+0000 7fefbd5a0740 1 -- start start 2024-09-19T09:11:56.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.186+0000 7fefbd5a0740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590956e34a0 0x5590956e6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:56.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.186+0000 7fefbd5a0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590956e3dc0 0x5590956ed100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:56.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.186+0000 7fefbd5a0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5590956ee680 0x559095705a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:56.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.186+0000 7fefbd5a0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fefb41ab550 con 0x5590956e3dc0 2024-09-19T09:11:56.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.186+0000 7fefbd5a0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fefb41addf0 con 0x5590956ee680 2024-09-19T09:11:56.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.186+0000 7fefbd5a0740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fefb41abbe0 con 0x5590956e34a0 2024-09-19T09:11:56.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.186+0000 7fefb3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590956e3dc0 0x5590956ed100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:56.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.186+0000 7fefb3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590956e3dc0 0x5590956ed100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56942/0 (socket says 172.21.15.92:56942) 2024-09-19T09:11:56.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.186+0000 7fefb3fff640 1 -- 172.21.15.92:0/1942575742 learned_addr learned my addr 172.21.15.92:0/1942575742 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:56.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.187+0000 7fefb8f63640 1 --2- 172.21.15.92:0/1942575742 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590956e34a0 0x5590956e6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:56.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.187+0000 7fefb3fff640 1 -- 172.21.15.92:0/1942575742 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590956e34a0 msgr2=0x5590956e6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:56.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.187+0000 7fefb3fff640 1 --2- 172.21.15.92:0/1942575742 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590956e34a0 0x5590956e6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:56.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.187+0000 7fefb9764640 1 --2- 172.21.15.92:0/1942575742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5590956ee680 0x559095705a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:56.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.187+0000 7fefb3fff640 1 -- 172.21.15.92:0/1942575742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5590956ee680 msgr2=0x559095705a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:56.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.187+0000 7fefb3fff640 1 --2- 172.21.15.92:0/1942575742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5590956ee680 0x559095705a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:56.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.187+0000 7fefb3fff640 1 -- 172.21.15.92:0/1942575742 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590956df860 con 0x5590956e3dc0 2024-09-19T09:11:56.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.187+0000 7fefb9764640 1 --2- 172.21.15.92:0/1942575742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5590956ee680 0x559095705a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:11:56.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.187+0000 7fefb3fff640 1 --2- 172.21.15.92:0/1942575742 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590956e3dc0 0x5590956ed100 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fefa402f040 tx=0x7fefa4005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c284b597a34c5c4f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:56.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.187+0000 7fefaa7fc640 1 -- 172.21.15.92:0/1942575742 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa4026030 con 0x5590956e3dc0 2024-09-19T09:11:56.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.187+0000 7fefaa7fc640 1 -- 172.21.15.92:0/1942575742 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefa403a070 con 0x5590956e3dc0 2024-09-19T09:11:56.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.187+0000 7fefaa7fc640 1 -- 172.21.15.92:0/1942575742 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa4004ff0 con 0x5590956e3dc0 2024-09-19T09:11:56.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.188+0000 7fefbd5a0740 1 -- 172.21.15.92:0/1942575742 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590956e3dc0 msgr2=0x5590956ed100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:56.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.188+0000 7fefbd5a0740 1 --2- 172.21.15.92:0/1942575742 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590956e3dc0 0x5590956ed100 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fefa402f040 tx=0x7fefa4005bd0 comp rx=0 tx=0).stop 2024-09-19T09:11:56.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.188+0000 7fefbd5a0740 1 -- 172.21.15.92:0/1942575742 shutdown_connections 2024-09-19T09:11:56.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.188+0000 7fefbd5a0740 1 --2- 172.21.15.92:0/1942575742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5590956ee680 0x559095705a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:56.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.188+0000 7fefbd5a0740 1 --2- 172.21.15.92:0/1942575742 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590956e3dc0 0x5590956ed100 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:56.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.188+0000 7fefbd5a0740 1 --2- 172.21.15.92:0/1942575742 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590956e34a0 0x5590956e6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:56.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.188+0000 7fefbd5a0740 1 -- 172.21.15.92:0/1942575742 >> 172.21.15.92:0/1942575742 conn(0x5590956dfa30 msgr2=0x5590956ec9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:56.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.188+0000 7fefbd5a0740 1 -- 172.21.15.92:0/1942575742 shutdown_connections 2024-09-19T09:11:56.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.188+0000 7fefbd5a0740 1 -- 172.21.15.92:0/1942575742 wait complete. 2024-09-19T09:11:56.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.188+0000 7fefbd5a0740 1 -- start start 2024-09-19T09:11:56.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.188+0000 7fefbd5a0740 1 Processor -- start 2024-09-19T09:11:56.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.189+0000 7fefbd5a0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5590956e34a0 0x5590956f69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:56.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.189+0000 7fefbd5a0740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590956e3dc0 0x5590956f6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:56.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.189+0000 7fefbd5a0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590956ee680 0x5590956e7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:56.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.189+0000 7fefbd5a0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fefb41ac2b0 con 0x5590956ee680 2024-09-19T09:11:56.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.189+0000 7fefbd5a0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fefb41ad720 con 0x5590956e34a0 2024-09-19T09:11:56.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.189+0000 7fefbd5a0740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fefb41ac980 con 0x5590956e3dc0 2024-09-19T09:11:56.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.189+0000 7fefbd5a0740 10 client.0 _ll_register_callbacks cb 0x7fefa4007de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:11:56.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.189+0000 7fefb9764640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590956ee680 0x5590956e7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:56.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.189+0000 7fefb9764640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590956ee680 0x5590956e7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56952/0 (socket says 172.21.15.92:56952) 2024-09-19T09:11:56.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.189+0000 7fefb9764640 1 -- 172.21.15.92:0/1811813133 learned_addr learned my addr 172.21.15.92:0/1811813133 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:11:56.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.189+0000 7fefb3fff640 1 --2- 172.21.15.92:0/1811813133 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590956e3dc0 0x5590956f6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:56.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.189+0000 7fefb8f63640 1 --2- 172.21.15.92:0/1811813133 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5590956e34a0 0x5590956f69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:56.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.189+0000 7fefb9764640 1 -- 172.21.15.92:0/1811813133 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590956e3dc0 msgr2=0x5590956f6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:56.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.189+0000 7fefb9764640 1 --2- 172.21.15.92:0/1811813133 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590956e3dc0 0x5590956f6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:56.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.189+0000 7fefb9764640 1 -- 172.21.15.92:0/1811813133 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5590956e34a0 msgr2=0x5590956f69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:11:56.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.189+0000 7fefb9764640 1 --2- 172.21.15.92:0/1811813133 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5590956e34a0 0x5590956f69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:56.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.189+0000 7fefb9764640 1 -- 172.21.15.92:0/1811813133 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590956e8530 con 0x5590956ee680 2024-09-19T09:11:56.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.189+0000 7fefb9764640 1 --2- 172.21.15.92:0/1811813133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590956ee680 0x5590956e7d30 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fef9c012810 tx=0x7fef9c0092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe80ba9f70ed34d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:56.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.189+0000 7fef93fff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:11:56.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.189+0000 7fef93fff640 1 -- 172.21.15.92:0/1811813133 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9c022070 con 0x5590956ee680 2024-09-19T09:11:56.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.189+0000 7fef93fff640 1 -- 172.21.15.92:0/1811813133 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fef9c010950 con 0x5590956ee680 2024-09-19T09:11:56.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.189+0000 7fefbd5a0740 1 -- 172.21.15.92:0/1811813133 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fefa403a070 con 0x5590956ee680 2024-09-19T09:11:56.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.190+0000 7fef93fff640 1 -- 172.21.15.92:0/1811813133 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fef9c02e050 con 0x5590956ee680 2024-09-19T09:11:56.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.190+0000 7fefbd5a0740 10 client.19053 fetch_fsmap learned FSMap version 19 2024-09-19T09:11:56.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.190+0000 7fefbd5a0740 1 -- 172.21.15.92:0/1811813133 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x559095768600 con 0x5590956ee680 2024-09-19T09:11:56.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.190+0000 7fef93fff640 1 -- 172.21.15.92:0/1811813133 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefa403a070 con 0x5590956ee680 2024-09-19T09:11:56.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.190+0000 7fef93fff640 1 -- 172.21.15.92:0/1811813133 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fef9c0263b0 con 0x5590956ee680 2024-09-19T09:11:56.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.190+0000 7fefbd5a0740 10 client.19053 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:11:56.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.190+0000 7fefbd5a0740 10 client.19053 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:11:56.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.190+0000 7fefbd5a0740 20 client.19053 populate_metadata read hostname 'smithi092' 2024-09-19T09:11:56.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.190+0000 7fefbd5a0740 1 --2- 172.21.15.92:0/1811813133 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559095768d50 0x55909576b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:56.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.190+0000 7fefbd5a0740 4 client.19053 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:11:56.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.190+0000 7fefbd5a0740 1 -- 172.21.15.92:0/1811813133 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559095650d60 con 0x559095768d50 2024-09-19T09:11:56.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.190+0000 7fefb8f63640 1 --2- 172.21.15.92:0/1811813133 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559095768d50 0x55909576b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:56.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.191+0000 7fefb8f63640 1 --2- 172.21.15.92:0/1811813133 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559095768d50 0x55909576b170 crc :-1 s=READY pgs=459 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce5cca182240171a server_cookie=81342f4f0d4d69e9 in_seq=0 out_seq=0 2024-09-19T09:11:56.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.191+0000 7fef93fff640 10 client.19053 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:56.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.191+0000 7fef93fff640 1 -- 172.21.15.92:0/1811813133 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x559095650d60 con 0x559095768d50 2024-09-19T09:11:56.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.191+0000 7fef93fff640 10 client.19053 handle_command_reply: tid=0 2024-09-19T09:11:56.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.191+0000 7fefbd5a0740 1 client.19053 shutdown 2024-09-19T09:11:56.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.191+0000 7fefbd5a0740 1 -- 172.21.15.92:0/1811813133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590956ee680 msgr2=0x5590956e7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:56.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.191+0000 7fefbd5a0740 1 --2- 172.21.15.92:0/1811813133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590956ee680 0x5590956e7d30 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fef9c012810 tx=0x7fef9c0092c0 comp rx=0 tx=0).stop 2024-09-19T09:11:56.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.191+0000 7fefbd5a0740 1 -- 172.21.15.92:0/1811813133 shutdown_connections 2024-09-19T09:11:56.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.191+0000 7fefbd5a0740 1 --2- 172.21.15.92:0/1811813133 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x559095768d50 0x55909576b170 crc :-1 s=READY pgs=459 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:56.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.191+0000 7fef93fff640 0 client.19053 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:11:56.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.191+0000 7fefbd5a0740 1 --2- 172.21.15.92:0/1811813133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590956ee680 0x5590956e7d30 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:56.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.191+0000 7fefbd5a0740 1 --2- 172.21.15.92:0/1811813133 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5590956e3dc0 0x5590956f6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:56.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.191+0000 7fefbd5a0740 1 --2- 172.21.15.92:0/1811813133 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5590956e34a0 0x5590956f69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:56.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.191+0000 7fefbd5a0740 1 -- 172.21.15.92:0/1811813133 >> 172.21.15.92:0/1811813133 conn(0x5590956dfa30 msgr2=0x5590956e4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:56.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.191+0000 7fefbd5a0740 1 -- 172.21.15.92:0/1811813133 shutdown_connections 2024-09-19T09:11:56.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.191+0000 7fefbd5a0740 1 -- 172.21.15.92:0/1811813133 wait complete. 2024-09-19T09:11:56.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.191+0000 7fefbd5a0740 20 client.19053 trim_cache size 0 max 16384 2024-09-19T09:11:56.202 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:11:56.202 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:11:56.202 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": { 2024-09-19T09:11:56.202 INFO:teuthology.orchestra.run.smithi092.stdout: "2327662a-a460-463f-be0f-2cf76142840b": { 2024-09-19T09:11:56.202 INFO:teuthology.orchestra.run.smithi092.stdout: "path": "/", 2024-09-19T09:11:56.202 INFO:teuthology.orchestra.run.smithi092.stdout: "tag": "2327662a-a460-463f-be0f-2cf76142840b", 2024-09-19T09:11:56.202 INFO:teuthology.orchestra.run.smithi092.stdout: "options": "recursive,force" 2024-09-19T09:11:56.202 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:11:56.202 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:11:56.202 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:11:56.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.192+0000 7fefbb1c7640 1 -- 172.21.15.92:0/4221827898 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fefa00a32c0 msgr2=0x7fefa00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:56.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.192+0000 7fefbb1c7640 1 --2- 172.21.15.92:0/4221827898 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fefa00a32c0 0x7fefa00a5780 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fef9c0058c0 tx=0x7fef9c004730 comp rx=0 tx=0).stop 2024-09-19T09:11:56.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.192+0000 7fefbb1c7640 1 -- 172.21.15.92:0/4221827898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefb4100e20 msgr2=0x7fefb41992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:56.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.192+0000 7fefbb1c7640 1 --2- 172.21.15.92:0/4221827898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefb4100e20 0x7fefb41992a0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fefac006010 tx=0x7fefac003c10 comp rx=0 tx=0).stop 2024-09-19T09:11:56.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.192+0000 7fefbb1c7640 1 -- 172.21.15.92:0/4221827898 shutdown_connections 2024-09-19T09:11:56.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.192+0000 7fefbb1c7640 1 --2- 172.21.15.92:0/4221827898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fefb4102ef0 0x7fefb41a4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:56.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.192+0000 7fefbb1c7640 1 --2- 172.21.15.92:0/4221827898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefb4102570 0x7fefb41997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:56.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.192+0000 7fefbb1c7640 1 --2- 172.21.15.92:0/4221827898 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fefa00a32c0 0x7fefa00a5780 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:56.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.192+0000 7fefbb1c7640 1 --2- 172.21.15.92:0/4221827898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefb4100e20 0x7fefb41992a0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:56.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.192+0000 7fefbb1c7640 1 -- 172.21.15.92:0/4221827898 >> 172.21.15.92:0/4221827898 conn(0x7fefb40fc7d0 msgr2=0x7fefb4105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:56.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.192+0000 7fefbb1c7640 1 -- 172.21.15.92:0/4221827898 shutdown_connections 2024-09-19T09:11:56.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:11:56.192+0000 7fefbb1c7640 1 -- 172.21.15.92:0/4221827898 wait complete. 2024-09-19T09:11:57.009 INFO:tasks.cephfs.filesystem:scrub status for tag:2327662a-a460-463f-be0f-2cf76142840b - {'path': '/', 'tag': '2327662a-a460-463f-be0f-2cf76142840b', 'options': 'recursive,force'} 2024-09-19T09:11:57.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:56 smithi167 ceph-mon[35359]: pgmap v794: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 48 KiB/s wr, 32 op/s 2024-09-19T09:11:57.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:56 smithi190 ceph-mon[35358]: pgmap v794: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 48 KiB/s wr, 32 op/s 2024-09-19T09:11:57.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:56 smithi092 ceph-mon[31407]: pgmap v794: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 48 KiB/s wr, 32 op/s 2024-09-19T09:11:58.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:57 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:11:58.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:57 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:11:58.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:57 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:11:59.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:58 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:59.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:58 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:11:59.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:58 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:11:59.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:58 smithi167 ceph-mon[35359]: scrub summary: idle 2024-09-19T09:11:59.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:11:58 smithi167 ceph-mon[35359]: pgmap v795: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 2.7 KiB/s wr, 58 op/s 2024-09-19T09:11:59.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:58 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:59.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:58 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:11:59.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:58 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:11:59.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:58 smithi190 ceph-mon[35358]: scrub summary: idle 2024-09-19T09:11:59.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:11:58 smithi190 ceph-mon[35358]: pgmap v795: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 2.7 KiB/s wr, 58 op/s 2024-09-19T09:11:59.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:58 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:59.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:58 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:11:59.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:58 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' 2024-09-19T09:11:59.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:58 smithi092 ceph-mon[31407]: scrub summary: idle 2024-09-19T09:11:59.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:11:58 smithi092 ceph-mon[31407]: pgmap v795: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 2.7 KiB/s wr, 58 op/s 2024-09-19T09:12:00.800 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:12:01.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:00 smithi092 ceph-mon[31407]: pgmap v796: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 3.0 KiB/s wr, 93 op/s 2024-09-19T09:12:01.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:00 smithi167 ceph-mon[35359]: pgmap v796: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 3.0 KiB/s wr, 93 op/s 2024-09-19T09:12:01.181 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:00 smithi190 ceph-mon[35358]: pgmap v796: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 3.0 KiB/s wr, 93 op/s 2024-09-19T09:12:03.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:02 smithi092 ceph-mon[31407]: pgmap v797: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 6.7 KiB/s wr, 95 op/s 2024-09-19T09:12:03.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:02 smithi167 ceph-mon[35359]: pgmap v797: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 6.7 KiB/s wr, 95 op/s 2024-09-19T09:12:03.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:02 smithi190 ceph-mon[35358]: pgmap v797: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 6.7 KiB/s wr, 95 op/s 2024-09-19T09:12:05.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:04 smithi092 ceph-mon[31407]: pgmap v798: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 6.0 KiB/s wr, 95 op/s 2024-09-19T09:12:05.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:04 smithi167 ceph-mon[35359]: pgmap v798: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 6.0 KiB/s wr, 95 op/s 2024-09-19T09:12:05.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:04 smithi190 ceph-mon[35358]: pgmap v798: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 6.0 KiB/s wr, 95 op/s 2024-09-19T09:12:05.800 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T09:12:06.725 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:12:06.978 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:12:07.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:06 smithi092 ceph-mon[31407]: pgmap v799: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 5.9 KiB/s wr, 95 op/s 2024-09-19T09:12:07.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:06 smithi167 ceph-mon[35359]: pgmap v799: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 5.9 KiB/s wr, 95 op/s 2024-09-19T09:12:07.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:06 smithi190 ceph-mon[35358]: pgmap v799: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 5.9 KiB/s wr, 95 op/s 2024-09-19T09:12:07.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.415+0000 7f58d2520640 1 -- 172.21.15.92:0/3138817980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58cc101de0 msgr2=0x7f58cc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:07.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.415+0000 7f58d2520640 1 --2- 172.21.15.92:0/3138817980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58cc101de0 0x7f58cc1021c0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f58bc009900 tx=0x7f58bc02a410 comp rx=0 tx=0).stop 2024-09-19T09:12:07.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.415+0000 7f58d2520640 1 -- 172.21.15.92:0/3138817980 shutdown_connections 2024-09-19T09:12:07.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.415+0000 7f58d2520640 1 --2- 172.21.15.92:0/3138817980 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58cc106f10 0x7f58cc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:07.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.415+0000 7f58d2520640 1 --2- 172.21.15.92:0/3138817980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58cc102790 0x7f58cc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:07.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.415+0000 7f58d2520640 1 --2- 172.21.15.92:0/3138817980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58cc101de0 0x7f58cc1021c0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:07.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.415+0000 7f58d2520640 1 -- 172.21.15.92:0/3138817980 >> 172.21.15.92:0/3138817980 conn(0x7f58cc0fd8c0 msgr2=0x7f58cc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:07.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.415+0000 7f58d2520640 1 -- 172.21.15.92:0/3138817980 shutdown_connections 2024-09-19T09:12:07.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.415+0000 7f58d2520640 1 -- 172.21.15.92:0/3138817980 wait complete. 2024-09-19T09:12:07.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.415+0000 7f58d2520640 1 Processor -- start 2024-09-19T09:12:07.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.416+0000 7f58d2520640 1 -- start start 2024-09-19T09:12:07.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.416+0000 7f58d2520640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58cc101de0 0x7f58cc1984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:07.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.416+0000 7f58d2520640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58cc102790 0x7f58cc198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:07.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.416+0000 7f58d2520640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58cc106f10 0x7f58cc19cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:07.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.416+0000 7f58d2520640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f58cc111fb0 con 0x7f58cc102790 2024-09-19T09:12:07.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.416+0000 7f58d2520640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f58cc111e30 con 0x7f58cc106f10 2024-09-19T09:12:07.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.416+0000 7f58d2520640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f58cc112130 con 0x7f58cc101de0 2024-09-19T09:12:07.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.416+0000 7f58c3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58cc102790 0x7f58cc198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:07.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.416+0000 7f58cbfff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58cc101de0 0x7f58cc1984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:07.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.416+0000 7f58cbfff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58cc101de0 0x7f58cc1984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:54956/0 (socket says 172.21.15.92:54956) 2024-09-19T09:12:07.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.416+0000 7f58cbfff640 1 -- 172.21.15.92:0/3330829978 learned_addr learned my addr 172.21.15.92:0/3330829978 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:07.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.416+0000 7f58d0abd640 1 --2- 172.21.15.92:0/3330829978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58cc106f10 0x7f58cc19cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:07.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.417+0000 7f58c3fff640 1 -- 172.21.15.92:0/3330829978 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58cc101de0 msgr2=0x7f58cc1984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:07.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.417+0000 7f58c3fff640 1 --2- 172.21.15.92:0/3330829978 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58cc101de0 0x7f58cc1984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:07.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.417+0000 7f58c3fff640 1 -- 172.21.15.92:0/3330829978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58cc106f10 msgr2=0x7f58cc19cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:07.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.417+0000 7f58c3fff640 1 --2- 172.21.15.92:0/3330829978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58cc106f10 0x7f58cc19cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:07.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.417+0000 7f58c3fff640 1 -- 172.21.15.92:0/3330829978 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58cc19d4a0 con 0x7f58cc102790 2024-09-19T09:12:07.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.417+0000 7f58c3fff640 1 --2- 172.21.15.92:0/3330829978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58cc102790 0x7f58cc198a30 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f58b400b3f0 tx=0x7f58b400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:07.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.417+0000 7f58c9ffb640 1 -- 172.21.15.92:0/3330829978 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b4015020 con 0x7f58cc102790 2024-09-19T09:12:07.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.417+0000 7f58c9ffb640 1 -- 172.21.15.92:0/3330829978 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58b4011d10 con 0x7f58cc102790 2024-09-19T09:12:07.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.417+0000 7f58d2520640 1 -- 172.21.15.92:0/3330829978 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58cc19d790 con 0x7f58cc102790 2024-09-19T09:12:07.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.417+0000 7f58c9ffb640 1 -- 172.21.15.92:0/3330829978 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b400f2e0 con 0x7f58cc102790 2024-09-19T09:12:07.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.417+0000 7f58d2520640 1 -- 172.21.15.92:0/3330829978 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58cc074420 con 0x7f58cc102790 2024-09-19T09:12:07.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.418+0000 7f58d2520640 1 -- 172.21.15.92:0/3330829978 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58cc1021c0 con 0x7f58cc102790 2024-09-19T09:12:07.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.419+0000 7f58c9ffb640 1 -- 172.21.15.92:0/3330829978 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f58b4018020 con 0x7f58cc102790 2024-09-19T09:12:07.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.420+0000 7f58c9ffb640 1 --2- 172.21.15.92:0/3330829978 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f58b80a3240 0x7f58b80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:07.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.420+0000 7f58cbfff640 1 --2- 172.21.15.92:0/3330829978 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f58b80a3240 0x7f58b80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:07.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.420+0000 7f58c9ffb640 1 -- 172.21.15.92:0/3330829978 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f58b40cf5f0 con 0x7f58cc102790 2024-09-19T09:12:07.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.420+0000 7f58cbfff640 1 --2- 172.21.15.92:0/3330829978 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f58b80a3240 0x7f58b80a5700 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f58bc0096c0 tx=0x7f58bc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:07.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.423+0000 7f58c9ffb640 1 -- 172.21.15.92:0/3330829978 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f58b401f020 con 0x7f58cc102790 2024-09-19T09:12:07.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.631+0000 7f58d2520640 1 -- 172.21.15.92:0/3330829978 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58cc10a0f0 con 0x7f58cc102790 2024-09-19T09:12:07.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.632+0000 7f58c9ffb640 1 -- 172.21.15.92:0/3330829978 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f58b409c310 con 0x7f58cc102790 2024-09-19T09:12:07.632 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:12:07.633 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:12:07.633 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:12:07.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.634+0000 7f58d2520640 1 -- 172.21.15.92:0/3330829978 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f58b80a3240 msgr2=0x7f58b80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:07.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.634+0000 7f58d2520640 1 --2- 172.21.15.92:0/3330829978 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f58b80a3240 0x7f58b80a5700 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f58bc0096c0 tx=0x7f58bc005a20 comp rx=0 tx=0).stop 2024-09-19T09:12:07.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.634+0000 7f58d2520640 1 -- 172.21.15.92:0/3330829978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58cc102790 msgr2=0x7f58cc198a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:07.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.634+0000 7f58d2520640 1 --2- 172.21.15.92:0/3330829978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58cc102790 0x7f58cc198a30 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f58b400b3f0 tx=0x7f58b400b8b0 comp rx=0 tx=0).stop 2024-09-19T09:12:07.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.634+0000 7f58d2520640 1 -- 172.21.15.92:0/3330829978 shutdown_connections 2024-09-19T09:12:07.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.634+0000 7f58d2520640 1 --2- 172.21.15.92:0/3330829978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58cc106f10 0x7f58cc19cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:07.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.634+0000 7f58d2520640 1 --2- 172.21.15.92:0/3330829978 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f58b80a3240 0x7f58b80a5700 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:07.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.634+0000 7f58d2520640 1 --2- 172.21.15.92:0/3330829978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58cc102790 0x7f58cc198a30 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:07.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.634+0000 7f58d2520640 1 --2- 172.21.15.92:0/3330829978 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58cc101de0 0x7f58cc1984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:07.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.634+0000 7f58d2520640 1 -- 172.21.15.92:0/3330829978 >> 172.21.15.92:0/3330829978 conn(0x7f58cc0fd8c0 msgr2=0x7f58cc0fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:07.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.634+0000 7f58d2520640 1 -- 172.21.15.92:0/3330829978 shutdown_connections 2024-09-19T09:12:07.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:07.634+0000 7f58d2520640 1 -- 172.21.15.92:0/3330829978 wait complete. 2024-09-19T09:12:07.925 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:07 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3330829978' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:12:08.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:07 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3330829978' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:12:08.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:07 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3330829978' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:12:08.338 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id da998558 --release --await' 2024-09-19T09:12:08.338 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id da998558 --release --await 2024-09-19T09:12:08.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.530+0000 7f4191759640 1 -- 172.21.15.92:0/2174043219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f418c103730 msgr2=0x7f418c109fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:08.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.530+0000 7f4191759640 1 --2- 172.21.15.92:0/2174043219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f418c103730 0x7f418c109fc0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f4184009ca0 tx=0x7f418402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.530+0000 7f4191759640 1 -- 172.21.15.92:0/2174043219 shutdown_connections 2024-09-19T09:12:08.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.530+0000 7f4191759640 1 --2- 172.21.15.92:0/2174043219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f418c103730 0x7f418c109fc0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.530+0000 7f4191759640 1 --2- 172.21.15.92:0/2174043219 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f418c102d70 0x7f418c1031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.530+0000 7f4191759640 1 --2- 172.21.15.92:0/2174043219 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f418c101b80 0x7f418c101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.530+0000 7f4191759640 1 -- 172.21.15.92:0/2174043219 >> 172.21.15.92:0/2174043219 conn(0x7f418c0fd2a0 msgr2=0x7f418c0ff720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:08.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.530+0000 7f4191759640 1 -- 172.21.15.92:0/2174043219 shutdown_connections 2024-09-19T09:12:08.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.530+0000 7f4191759640 1 -- 172.21.15.92:0/2174043219 wait complete. 2024-09-19T09:12:08.533 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.531+0000 7f4191759640 1 Processor -- start 2024-09-19T09:12:08.534 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.531+0000 7f4191759640 1 -- start start 2024-09-19T09:12:08.534 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.531+0000 7f4191759640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f418c101b80 0x7f418c075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:08.534 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.531+0000 7f4191759640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f418c102d70 0x7f418c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:08.534 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.531+0000 7f4191759640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f418c103730 0x7f418c074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:08.534 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.531+0000 7f4191759640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f418c10d8d0 con 0x7f418c101b80 2024-09-19T09:12:08.534 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.531+0000 7f4191759640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f418c10d750 con 0x7f418c102d70 2024-09-19T09:12:08.534 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.531+0000 7f4191759640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f418c10da50 con 0x7f418c103730 2024-09-19T09:12:08.534 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.531+0000 7f418affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f418c101b80 0x7f418c075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:08.534 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.532+0000 7f418affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f418c101b80 0x7f418c075fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56580/0 (socket says 172.21.15.92:56580) 2024-09-19T09:12:08.535 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.532+0000 7f418affd640 1 -- 172.21.15.92:0/3584547339 learned_addr learned my addr 172.21.15.92:0/3584547339 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:08.535 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.532+0000 7f418a7fc640 1 --2- 172.21.15.92:0/3584547339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f418c102d70 0x7f418c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:08.535 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.532+0000 7f418b7fe640 1 --2- 172.21.15.92:0/3584547339 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f418c103730 0x7f418c074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:08.535 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.532+0000 7f418affd640 1 -- 172.21.15.92:0/3584547339 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f418c103730 msgr2=0x7f418c074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:08.535 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.532+0000 7f418affd640 1 --2- 172.21.15.92:0/3584547339 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f418c103730 0x7f418c074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.535 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.532+0000 7f418affd640 1 -- 172.21.15.92:0/3584547339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f418c102d70 msgr2=0x7f418c0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:08.535 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.532+0000 7f418affd640 1 --2- 172.21.15.92:0/3584547339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f418c102d70 0x7f418c0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.535 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.532+0000 7f418affd640 1 -- 172.21.15.92:0/3584547339 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f418c0753b0 con 0x7f418c101b80 2024-09-19T09:12:08.535 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.532+0000 7f418affd640 1 --2- 172.21.15.92:0/3584547339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f418c101b80 0x7f418c075fa0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f417c00b450 tx=0x7f417c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:08.535 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.532+0000 7f4173fff640 1 -- 172.21.15.92:0/3584547339 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c015020 con 0x7f418c101b80 2024-09-19T09:12:08.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.532+0000 7f4173fff640 1 -- 172.21.15.92:0/3584547339 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f417c011d70 con 0x7f418c101b80 2024-09-19T09:12:08.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.532+0000 7f4191759640 1 -- 172.21.15.92:0/3584547339 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f418c1a1eb0 con 0x7f418c101b80 2024-09-19T09:12:08.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.532+0000 7f4173fff640 1 -- 172.21.15.92:0/3584547339 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c00f340 con 0x7f418c101b80 2024-09-19T09:12:08.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.532+0000 7f4191759640 1 -- 172.21.15.92:0/3584547339 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f418c1a2390 con 0x7f418c101b80 2024-09-19T09:12:08.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.535+0000 7f41945d1740 1 Processor -- start 2024-09-19T09:12:08.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.536+0000 7f41945d1740 1 -- start start 2024-09-19T09:12:08.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.536+0000 7f4173fff640 1 -- 172.21.15.92:0/3584547339 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f417c018020 con 0x7f418c101b80 2024-09-19T09:12:08.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.536+0000 7f41945d1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ad1e3e9a0 0x564ad1e3eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:08.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.536+0000 7f41945d1740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564ad1e3f2e0 0x564ad1e43da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:08.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.536+0000 7f41945d1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ad1e44370 0x564ad1e46830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:08.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.536+0000 7f41945d1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564ad1da22f0 con 0x564ad1e3e9a0 2024-09-19T09:12:08.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.536+0000 7f41945d1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564ad1d4a270 con 0x564ad1e44370 2024-09-19T09:12:08.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.536+0000 7f41945d1740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x564ad1d9e2b0 con 0x564ad1e3f2e0 2024-09-19T09:12:08.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.536+0000 7f418b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ad1e3e9a0 0x564ad1e3eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:08.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.536+0000 7f418affd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564ad1e3f2e0 0x564ad1e43da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:08.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.536+0000 7f418b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ad1e3e9a0 0x564ad1e3eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56592/0 (socket says 172.21.15.92:56592) 2024-09-19T09:12:08.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.536+0000 7f418b7fe640 1 -- 172.21.15.92:0/241316795 learned_addr learned my addr 172.21.15.92:0/241316795 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:08.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.536+0000 7f418a7fc640 1 --2- 172.21.15.92:0/241316795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ad1e44370 0x564ad1e46830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:08.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.536+0000 7f418b7fe640 1 -- 172.21.15.92:0/241316795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564ad1e3f2e0 msgr2=0x564ad1e43da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:08.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.536+0000 7f418b7fe640 1 --2- 172.21.15.92:0/241316795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564ad1e3f2e0 0x564ad1e43da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.536+0000 7f418b7fe640 1 -- 172.21.15.92:0/241316795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ad1e44370 msgr2=0x564ad1e46830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:08.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.536+0000 7f418b7fe640 1 --2- 172.21.15.92:0/241316795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ad1e44370 0x564ad1e46830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.536+0000 7f418b7fe640 1 -- 172.21.15.92:0/241316795 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ad1d49340 con 0x564ad1e3e9a0 2024-09-19T09:12:08.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.537+0000 7f418b7fe640 1 --2- 172.21.15.92:0/241316795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ad1e3e9a0 0x564ad1e3eda0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f4184009ca0 tx=0x7f41840098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3352c43f3059af27 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:08.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.537+0000 7f4173fff640 1 --2- 172.21.15.92:0/3584547339 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f41740a3370 0x7f41740a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:08.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.537+0000 7f41717fa640 1 -- 172.21.15.92:0/241316795 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4184031790 con 0x564ad1e3e9a0 2024-09-19T09:12:08.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.537+0000 7f41717fa640 1 -- 172.21.15.92:0/241316795 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4184036040 con 0x564ad1e3e9a0 2024-09-19T09:12:08.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.537+0000 7f41717fa640 1 -- 172.21.15.92:0/241316795 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f418402f610 con 0x564ad1e3e9a0 2024-09-19T09:12:08.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.537+0000 7f418affd640 1 --2- 172.21.15.92:0/3584547339 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f41740a3370 0x7f41740a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:08.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.537+0000 7f4173fff640 1 -- 172.21.15.92:0/3584547339 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f417c0cf3c0 con 0x7f418c101b80 2024-09-19T09:12:08.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.538+0000 7f41945d1740 1 -- 172.21.15.92:0/241316795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ad1e3e9a0 msgr2=0x564ad1e3eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:08.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.538+0000 7f41945d1740 1 --2- 172.21.15.92:0/241316795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ad1e3e9a0 0x564ad1e3eda0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f4184009ca0 tx=0x7f41840098b0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.538+0000 7f418affd640 1 --2- 172.21.15.92:0/3584547339 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f41740a3370 0x7f41740a5830 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f417c097e40 tx=0x7f417c0d4040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:08.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.538+0000 7f41945d1740 1 -- 172.21.15.92:0/241316795 shutdown_connections 2024-09-19T09:12:08.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.538+0000 7f41945d1740 1 --2- 172.21.15.92:0/241316795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ad1e44370 0x564ad1e46830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.538+0000 7f41945d1740 1 --2- 172.21.15.92:0/241316795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564ad1e3f2e0 0x564ad1e43da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.538+0000 7f41945d1740 1 --2- 172.21.15.92:0/241316795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ad1e3e9a0 0x564ad1e3eda0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.538+0000 7f41945d1740 1 -- 172.21.15.92:0/241316795 >> 172.21.15.92:0/241316795 conn(0x564ad1e3a010 msgr2=0x564ad1e3a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:08.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.538+0000 7f41945d1740 1 -- 172.21.15.92:0/241316795 shutdown_connections 2024-09-19T09:12:08.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.538+0000 7f41945d1740 1 -- 172.21.15.92:0/241316795 wait complete. 2024-09-19T09:12:08.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.538+0000 7f41945d1740 1 -- start start 2024-09-19T09:12:08.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.538+0000 7f41945d1740 1 Processor -- start 2024-09-19T09:12:08.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.538+0000 7f41945d1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ad1e3e9a0 0x564ad1e48c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:08.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.538+0000 7f41945d1740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564ad1e3f2e0 0x564ad1e49160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:08.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.538+0000 7f41945d1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ad1e44370 0x564ad1e500c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:08.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.538+0000 7f41945d1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564ad1e472e0 con 0x564ad1e3e9a0 2024-09-19T09:12:08.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.538+0000 7f41945d1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564ad1d2b290 con 0x564ad1e44370 2024-09-19T09:12:08.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.538+0000 7f41945d1740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x564ad1e47460 con 0x564ad1e3f2e0 2024-09-19T09:12:08.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.538+0000 7f41945d1740 10 client.0 _ll_register_callbacks cb 0x564ad1d5c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:12:08.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.538+0000 7f418b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ad1e3e9a0 0x564ad1e48c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:08.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.538+0000 7f418b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ad1e3e9a0 0x564ad1e48c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56602/0 (socket says 172.21.15.92:56602) 2024-09-19T09:12:08.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.538+0000 7f418b7fe640 1 -- 172.21.15.92:0/222083861 learned_addr learned my addr 172.21.15.92:0/222083861 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:08.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.539+0000 7f418a7fc640 1 --2- 172.21.15.92:0/222083861 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564ad1e3f2e0 0x564ad1e49160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:08.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.539+0000 7f418b7fe640 1 --2- 172.21.15.92:0/222083861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ad1e44370 0x564ad1e500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:08.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.539+0000 7f418b7fe640 1 -- 172.21.15.92:0/222083861 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564ad1e3f2e0 msgr2=0x564ad1e49160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:08.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.539+0000 7f418b7fe640 1 --2- 172.21.15.92:0/222083861 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564ad1e3f2e0 0x564ad1e49160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.539+0000 7f418b7fe640 1 -- 172.21.15.92:0/222083861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ad1e44370 msgr2=0x564ad1e500c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:08.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.539+0000 7f418b7fe640 1 --2- 172.21.15.92:0/222083861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ad1e44370 0x564ad1e500c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.539+0000 7f418b7fe640 1 -- 172.21.15.92:0/222083861 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ad1ab5210 con 0x564ad1e3e9a0 2024-09-19T09:12:08.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.539+0000 7f418a7fc640 1 --2- 172.21.15.92:0/222083861 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564ad1e3f2e0 0x564ad1e49160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:12:08.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.539+0000 7f418b7fe640 1 --2- 172.21.15.92:0/222083861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ad1e3e9a0 0x564ad1e48c20 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f4184009a60 tx=0x7f4184031bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b884ac82baa3b154 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:08.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.539+0000 7f416eff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:12:08.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.539+0000 7f416eff5640 1 -- 172.21.15.92:0/222083861 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4184058060 con 0x564ad1e3e9a0 2024-09-19T09:12:08.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.539+0000 7f416eff5640 1 -- 172.21.15.92:0/222083861 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4184031820 con 0x564ad1e3e9a0 2024-09-19T09:12:08.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.539+0000 7f41945d1740 1 -- 172.21.15.92:0/222083861 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4184036040 con 0x564ad1e3e9a0 2024-09-19T09:12:08.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.539+0000 7f416eff5640 1 -- 172.21.15.92:0/222083861 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f418402f610 con 0x564ad1e3e9a0 2024-09-19T09:12:08.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.539+0000 7f41945d1740 10 client.19071 fetch_fsmap learned FSMap version 19 2024-09-19T09:12:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.539+0000 7f41945d1740 1 -- 172.21.15.92:0/222083861 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x564ad1b81620 con 0x564ad1e3e9a0 2024-09-19T09:12:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.540+0000 7f416eff5640 1 -- 172.21.15.92:0/222083861 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4184036040 con 0x564ad1e3e9a0 2024-09-19T09:12:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.540+0000 7f416eff5640 1 -- 172.21.15.92:0/222083861 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f418405d070 con 0x564ad1e3e9a0 2024-09-19T09:12:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.540+0000 7f41945d1740 10 client.19071 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:12:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.540+0000 7f41945d1740 10 client.19071 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:12:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.540+0000 7f41945d1740 20 client.19071 populate_metadata read hostname 'smithi092' 2024-09-19T09:12:08.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.540+0000 7f41945d1740 1 --2- 172.21.15.92:0/222083861 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564ad1e543c0 0x564ad1e567b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:08.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.540+0000 7f41945d1740 4 client.19071 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:12:08.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.540+0000 7f41945d1740 1 -- 172.21.15.92:0/222083861 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ad1dafa20 con 0x564ad1e543c0 2024-09-19T09:12:08.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.540+0000 7f418a7fc640 1 --2- 172.21.15.92:0/222083861 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564ad1e543c0 0x564ad1e567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:08.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.541+0000 7f418a7fc640 1 --2- 172.21.15.92:0/222083861 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564ad1e543c0 0x564ad1e567b0 crc :-1 s=READY pgs=460 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a71e43564b373178 server_cookie=27f469be1ec37734 in_seq=0 out_seq=0 2024-09-19T09:12:08.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.541+0000 7f416eff5640 10 client.19071 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:12:08.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.541+0000 7f416eff5640 1 -- 172.21.15.92:0/222083861 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564ad1dafa20 con 0x564ad1e543c0 2024-09-19T09:12:08.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.541+0000 7f416eff5640 10 client.19071 handle_command_reply: tid=0 2024-09-19T09:12:08.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.541+0000 7f41945d1740 1 client.19071 shutdown 2024-09-19T09:12:08.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.541+0000 7f41945d1740 1 -- 172.21.15.92:0/222083861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ad1e3e9a0 msgr2=0x564ad1e48c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:08.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.541+0000 7f41945d1740 1 --2- 172.21.15.92:0/222083861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ad1e3e9a0 0x564ad1e48c20 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f4184009a60 tx=0x7f4184031bd0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.541+0000 7f41945d1740 1 -- 172.21.15.92:0/222083861 shutdown_connections 2024-09-19T09:12:08.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.541+0000 7f41945d1740 1 --2- 172.21.15.92:0/222083861 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564ad1e543c0 0x564ad1e567b0 crc :-1 s=READY pgs=460 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.541+0000 7f41945d1740 1 --2- 172.21.15.92:0/222083861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ad1e44370 0x564ad1e500c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.541+0000 7f416eff5640 0 client.19071 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:12:08.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.541+0000 7f41945d1740 1 --2- 172.21.15.92:0/222083861 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564ad1e3f2e0 0x564ad1e49160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.541+0000 7f41945d1740 1 --2- 172.21.15.92:0/222083861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ad1e3e9a0 0x564ad1e48c20 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.541+0000 7f41945d1740 1 -- 172.21.15.92:0/222083861 >> 172.21.15.92:0/222083861 conn(0x564ad1e3a010 msgr2=0x564ad1e3b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:08.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.542+0000 7f41945d1740 1 -- 172.21.15.92:0/222083861 shutdown_connections 2024-09-19T09:12:08.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.542+0000 7f41945d1740 1 -- 172.21.15.92:0/222083861 wait complete. 2024-09-19T09:12:08.554 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.542+0000 7f41945d1740 20 client.19071 trim_cache size 0 max 16384 2024-09-19T09:12:08.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.557+0000 7f41945d1740 1 Processor -- start 2024-09-19T09:12:08.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.557+0000 7f41945d1740 1 -- start start 2024-09-19T09:12:08.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.557+0000 7f41945d1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ad1e3a010 0x564ad1e567b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:08.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.557+0000 7f41945d1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ad1e3e9a0 0x564ad1e50080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:08.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.557+0000 7f41945d1740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564ad1e3f2e0 0x564ad1e3b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:08.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.557+0000 7f41945d1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f418c1a9250 con 0x564ad1e3e9a0 2024-09-19T09:12:08.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.557+0000 7f41945d1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f418c1abaf0 con 0x564ad1e3a010 2024-09-19T09:12:08.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.557+0000 7f41945d1740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f418c1a98e0 con 0x564ad1e3f2e0 2024-09-19T09:12:08.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.557+0000 7f418a7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ad1e3e9a0 0x564ad1e50080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:08.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.557+0000 7f418a7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ad1e3e9a0 0x564ad1e50080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56612/0 (socket says 172.21.15.92:56612) 2024-09-19T09:12:08.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.557+0000 7f418a7fc640 1 -- 172.21.15.92:0/3521995304 learned_addr learned my addr 172.21.15.92:0/3521995304 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:08.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.557+0000 7f418b7fe640 1 --2- 172.21.15.92:0/3521995304 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564ad1e3f2e0 0x564ad1e3b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:08.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.557+0000 7f418b7fe640 1 --2- 172.21.15.92:0/3521995304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ad1e3a010 0x564ad1e567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:08.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.557+0000 7f418a7fc640 1 -- 172.21.15.92:0/3521995304 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564ad1e3f2e0 msgr2=0x564ad1e3b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:08.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.557+0000 7f418a7fc640 1 --2- 172.21.15.92:0/3521995304 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564ad1e3f2e0 0x564ad1e3b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.557+0000 7f418a7fc640 1 -- 172.21.15.92:0/3521995304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ad1e3a010 msgr2=0x564ad1e567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:08.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.557+0000 7f418a7fc640 1 --2- 172.21.15.92:0/3521995304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ad1e3a010 0x564ad1e567b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.557+0000 7f418a7fc640 1 -- 172.21.15.92:0/3521995304 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ad1e56d90 con 0x564ad1e3e9a0 2024-09-19T09:12:08.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.558+0000 7f418a7fc640 1 --2- 172.21.15.92:0/3521995304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ad1e3e9a0 0x564ad1e50080 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f4180004700 tx=0x7f418000ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5b2d416e83b8928 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:08.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.558+0000 7f4170ff9640 1 -- 172.21.15.92:0/3521995304 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4180021020 con 0x564ad1e3e9a0 2024-09-19T09:12:08.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.558+0000 7f4170ff9640 1 -- 172.21.15.92:0/3521995304 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4180003e20 con 0x564ad1e3e9a0 2024-09-19T09:12:08.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.558+0000 7f4170ff9640 1 -- 172.21.15.92:0/3521995304 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4180010860 con 0x564ad1e3e9a0 2024-09-19T09:12:08.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.558+0000 7f41945d1740 1 -- 172.21.15.92:0/3521995304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ad1e3e9a0 msgr2=0x564ad1e50080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:08.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.558+0000 7f41945d1740 1 --2- 172.21.15.92:0/3521995304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ad1e3e9a0 0x564ad1e50080 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f4180004700 tx=0x7f418000ce70 comp rx=0 tx=0).stop 2024-09-19T09:12:08.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.559+0000 7f41945d1740 1 -- 172.21.15.92:0/3521995304 shutdown_connections 2024-09-19T09:12:08.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.559+0000 7f41945d1740 1 --2- 172.21.15.92:0/3521995304 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564ad1e3f2e0 0x564ad1e3b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.559+0000 7f41945d1740 1 --2- 172.21.15.92:0/3521995304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ad1e3e9a0 0x564ad1e50080 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.559+0000 7f41945d1740 1 --2- 172.21.15.92:0/3521995304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ad1e3a010 0x564ad1e567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.559+0000 7f41945d1740 1 -- 172.21.15.92:0/3521995304 >> 172.21.15.92:0/3521995304 conn(0x564ad1e43f00 msgr2=0x564ad1e3aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:08.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.559+0000 7f41945d1740 1 -- 172.21.15.92:0/3521995304 shutdown_connections 2024-09-19T09:12:08.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.559+0000 7f41945d1740 1 -- 172.21.15.92:0/3521995304 wait complete. 2024-09-19T09:12:08.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.559+0000 7f41945d1740 1 -- start start 2024-09-19T09:12:08.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.559+0000 7f41945d1740 1 Processor -- start 2024-09-19T09:12:08.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.559+0000 7f41945d1740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564ad1e3a010 0x564ad1e4d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:08.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.559+0000 7f41945d1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ad1e3e9a0 0x564ad1e4ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:08.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.559+0000 7f41945d1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ad1e3f2e0 0x564ad1e4ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:08.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.559+0000 7f41945d1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f418c1a9fb0 con 0x564ad1e3f2e0 2024-09-19T09:12:08.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.559+0000 7f41945d1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f418c1ab420 con 0x564ad1e3e9a0 2024-09-19T09:12:08.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.559+0000 7f41945d1740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f418c1aa680 con 0x564ad1e3a010 2024-09-19T09:12:08.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.559+0000 7f41945d1740 10 client.0 _ll_register_callbacks cb 0x7f418000c350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:12:08.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.559+0000 7f418b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ad1e3f2e0 0x564ad1e4ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:08.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.559+0000 7f418b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ad1e3f2e0 0x564ad1e4ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56628/0 (socket says 172.21.15.92:56628) 2024-09-19T09:12:08.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.559+0000 7f418b7fe640 1 -- 172.21.15.92:0/4111748430 learned_addr learned my addr 172.21.15.92:0/4111748430 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:08.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.559+0000 7f418b7fe640 1 --2- 172.21.15.92:0/4111748430 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564ad1e3a010 0x564ad1e4d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:08.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.559+0000 7f418a7fc640 1 --2- 172.21.15.92:0/4111748430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ad1e3e9a0 0x564ad1e4ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:08.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.560+0000 7f418b7fe640 1 -- 172.21.15.92:0/4111748430 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564ad1e3a010 msgr2=0x564ad1e4d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:08.575 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.560+0000 7f418b7fe640 1 --2- 172.21.15.92:0/4111748430 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564ad1e3a010 0x564ad1e4d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.575 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.560+0000 7f418b7fe640 1 -- 172.21.15.92:0/4111748430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ad1e3e9a0 msgr2=0x564ad1e4ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:08.575 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.560+0000 7f418b7fe640 1 --2- 172.21.15.92:0/4111748430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ad1e3e9a0 0x564ad1e4ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.575 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.560+0000 7f418b7fe640 1 -- 172.21.15.92:0/4111748430 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ad1e4f3f0 con 0x564ad1e3f2e0 2024-09-19T09:12:08.575 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.560+0000 7f418b7fe640 1 --2- 172.21.15.92:0/4111748430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ad1e3f2e0 0x564ad1e4ede0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f418402aeb0 tx=0x7f4184004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce2c7ef25df2214 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:08.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.560+0000 7f416eff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:12:08.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.560+0000 7f416eff5640 1 -- 172.21.15.92:0/4111748430 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4184058040 con 0x564ad1e3f2e0 2024-09-19T09:12:08.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.560+0000 7f416eff5640 1 -- 172.21.15.92:0/4111748430 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f41840307d0 con 0x564ad1e3f2e0 2024-09-19T09:12:08.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.560+0000 7f41945d1740 1 -- 172.21.15.92:0/4111748430 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4180003e20 con 0x564ad1e3f2e0 2024-09-19T09:12:08.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.560+0000 7f416eff5640 1 -- 172.21.15.92:0/4111748430 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f418406f050 con 0x564ad1e3f2e0 2024-09-19T09:12:08.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.560+0000 7f41945d1740 10 client.19077 fetch_fsmap learned FSMap version 19 2024-09-19T09:12:08.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.560+0000 7f41945d1740 1 -- 172.21.15.92:0/4111748430 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x564ad1ebf0b0 con 0x564ad1e3f2e0 2024-09-19T09:12:08.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.560+0000 7f416eff5640 1 -- 172.21.15.92:0/4111748430 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4180003e20 con 0x564ad1e3f2e0 2024-09-19T09:12:08.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.561+0000 7f416eff5640 1 -- 172.21.15.92:0/4111748430 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f418405d040 con 0x564ad1e3f2e0 2024-09-19T09:12:08.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.561+0000 7f41945d1740 10 client.19077 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:12:08.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.561+0000 7f41945d1740 10 client.19077 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T09:12:08.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.561+0000 7f41945d1740 20 client.19077 populate_metadata read hostname 'smithi092' 2024-09-19T09:12:08.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.561+0000 7f41945d1740 1 --2- 172.21.15.92:0/4111748430 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564ad1e44370 0x564ad1ec1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:08.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.561+0000 7f41945d1740 4 client.19077 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:12:08.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.561+0000 7f41945d1740 1 -- 172.21.15.92:0/4111748430 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564ad1da9d70 con 0x564ad1e44370 2024-09-19T09:12:08.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.561+0000 7f418a7fc640 1 --2- 172.21.15.92:0/4111748430 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564ad1e44370 0x564ad1ec1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:08.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.561+0000 7f418a7fc640 1 --2- 172.21.15.92:0/4111748430 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564ad1e44370 0x564ad1ec1950 crc :-1 s=READY pgs=461 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=414862c2e97928e server_cookie=6af39b96930ab2f4 in_seq=0 out_seq=0 2024-09-19T09:12:08.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.561+0000 7f416eff5640 10 client.19077 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:12:08.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.577+0000 7f416eff5640 1 -- 172.21.15.92:0/4111748430 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564ad1da9d70 con 0x564ad1e44370 2024-09-19T09:12:08.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.577+0000 7f416eff5640 10 client.19077 handle_command_reply: tid=0 2024-09-19T09:12:08.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.577+0000 7f41945d1740 1 client.19077 shutdown 2024-09-19T09:12:08.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.577+0000 7f41945d1740 1 -- 172.21.15.92:0/4111748430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ad1e3f2e0 msgr2=0x564ad1e4ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:08.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.577+0000 7f41945d1740 1 --2- 172.21.15.92:0/4111748430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ad1e3f2e0 0x564ad1e4ede0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f418402aeb0 tx=0x7f4184004730 comp rx=0 tx=0).stop 2024-09-19T09:12:08.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.577+0000 7f41945d1740 1 -- 172.21.15.92:0/4111748430 shutdown_connections 2024-09-19T09:12:08.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.577+0000 7f41945d1740 1 --2- 172.21.15.92:0/4111748430 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x564ad1e44370 0x564ad1ec1950 crc :-1 s=READY pgs=461 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.577+0000 7f41945d1740 1 --2- 172.21.15.92:0/4111748430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ad1e3f2e0 0x564ad1e4ede0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.577+0000 7f41945d1740 1 --2- 172.21.15.92:0/4111748430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564ad1e3e9a0 0x564ad1e4ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.577+0000 7f41945d1740 1 --2- 172.21.15.92:0/4111748430 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564ad1e3a010 0x564ad1e4d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.577+0000 7f41945d1740 1 -- 172.21.15.92:0/4111748430 >> 172.21.15.92:0/4111748430 conn(0x564ad1e43f00 msgr2=0x564ad1e3aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:08.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.577+0000 7f416eff5640 0 client.19077 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:12:08.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.577+0000 7f41945d1740 1 -- 172.21.15.92:0/4111748430 shutdown_connections 2024-09-19T09:12:08.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.577+0000 7f41945d1740 1 -- 172.21.15.92:0/4111748430 wait complete. 2024-09-19T09:12:08.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.578+0000 7f41945d1740 20 client.19077 trim_cache size 0 max 16384 2024-09-19T09:12:08.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-19T09:12:08.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-19T09:12:08.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-19T09:12:08.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-19T09:12:08.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.578+0000 7f4191759640 1 -- 172.21.15.92:0/3584547339 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f41740a3370 msgr2=0x7f41740a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:08.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.578+0000 7f4191759640 1 --2- 172.21.15.92:0/3584547339 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f41740a3370 0x7f41740a5830 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f417c097e40 tx=0x7f417c0d4040 comp rx=0 tx=0).stop 2024-09-19T09:12:08.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.578+0000 7f4191759640 1 -- 172.21.15.92:0/3584547339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f418c101b80 msgr2=0x7f418c075fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:08.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.578+0000 7f4191759640 1 --2- 172.21.15.92:0/3584547339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f418c101b80 0x7f418c075fa0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f417c00b450 tx=0x7f417c00b910 comp rx=0 tx=0).stop 2024-09-19T09:12:08.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.578+0000 7f4191759640 1 -- 172.21.15.92:0/3584547339 shutdown_connections 2024-09-19T09:12:08.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.578+0000 7f4191759640 1 --2- 172.21.15.92:0/3584547339 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f418c103730 0x7f418c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.578+0000 7f4191759640 1 --2- 172.21.15.92:0/3584547339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f418c102d70 0x7f418c0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.578+0000 7f4191759640 1 --2- 172.21.15.92:0/3584547339 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f41740a3370 0x7f41740a5830 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.578+0000 7f4191759640 1 --2- 172.21.15.92:0/3584547339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f418c101b80 0x7f418c075fa0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.578+0000 7f4191759640 1 -- 172.21.15.92:0/3584547339 >> 172.21.15.92:0/3584547339 conn(0x7f418c0fd2a0 msgr2=0x7f418c105fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.578+0000 7f4191759640 1 -- 172.21.15.92:0/3584547339 shutdown_connections 2024-09-19T09:12:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-19T09:12:08.578+0000 7f4191759640 1 -- 172.21.15.92:0/3584547339 wait complete. 2024-09-19T09:12:08.603 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:12:08.986 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:08 smithi092 ceph-mon[31407]: pgmap v800: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 6.2 KiB/s wr, 74 op/s 2024-09-19T09:12:09.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:08 smithi167 ceph-mon[35359]: pgmap v800: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 6.2 KiB/s wr, 74 op/s 2024-09-19T09:12:09.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:08 smithi190 ceph-mon[35358]: pgmap v800: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 6.2 KiB/s wr, 74 op/s 2024-09-19T09:12:09.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.197+0000 7ffac06eb640 1 -- 172.21.15.92:0/1451987104 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffab8109830 msgr2=0x7ffab8109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:09.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.197+0000 7ffac06eb640 1 --2- 172.21.15.92:0/1451987104 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffab8109830 0x7ffab8109c90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ffab0009ca0 tx=0x7ffab002a8f0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.204+0000 7ffac06eb640 1 -- 172.21.15.92:0/1451987104 shutdown_connections 2024-09-19T09:12:09.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.204+0000 7ffac06eb640 1 --2- 172.21.15.92:0/1451987104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffab811b140 0x7ffab811d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.204+0000 7ffac06eb640 1 --2- 172.21.15.92:0/1451987104 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffab8109830 0x7ffab8109c90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.204+0000 7ffac06eb640 1 --2- 172.21.15.92:0/1451987104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffab8109450 0x7ffab8110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.204+0000 7ffac06eb640 1 -- 172.21.15.92:0/1451987104 >> 172.21.15.92:0/1451987104 conn(0x7ffab806e140 msgr2=0x7ffab806e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:09.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.205+0000 7ffac06eb640 1 -- 172.21.15.92:0/1451987104 shutdown_connections 2024-09-19T09:12:09.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.207+0000 7ffac06eb640 1 -- 172.21.15.92:0/1451987104 wait complete. 2024-09-19T09:12:09.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.208+0000 7ffac06eb640 1 Processor -- start 2024-09-19T09:12:09.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.209+0000 7ffac06eb640 1 -- start start 2024-09-19T09:12:09.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.209+0000 7ffac06eb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffab8109450 0x7ffab81a7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:09.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.209+0000 7ffac06eb640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffab8109830 0x7ffab81a79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:09.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.209+0000 7ffac06eb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffab811b140 0x7ffab81abd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:09.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.209+0000 7ffac06eb640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffab8120ed0 con 0x7ffab8109450 2024-09-19T09:12:09.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.209+0000 7ffac06eb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ffab8120d50 con 0x7ffab811b140 2024-09-19T09:12:09.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.209+0000 7ffac06eb640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ffab8121050 con 0x7ffab8109830 2024-09-19T09:12:09.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.210+0000 7ffabdc86640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffab8109830 0x7ffab81a79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:09.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.210+0000 7ffabdc86640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffab8109830 0x7ffab81a79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:55008/0 (socket says 172.21.15.92:55008) 2024-09-19T09:12:09.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.210+0000 7ffabdc86640 1 -- 172.21.15.92:0/353620733 learned_addr learned my addr 172.21.15.92:0/353620733 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:09.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.210+0000 7ffabec88640 1 --2- 172.21.15.92:0/353620733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffab811b140 0x7ffab81abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:09.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.212+0000 7ffabdc86640 1 -- 172.21.15.92:0/353620733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffab811b140 msgr2=0x7ffab81abd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:09.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.212+0000 7ffabdc86640 1 --2- 172.21.15.92:0/353620733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffab811b140 0x7ffab81abd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.212+0000 7ffabe487640 1 --2- 172.21.15.92:0/353620733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffab8109450 0x7ffab81a7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:09.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.212+0000 7ffabdc86640 1 -- 172.21.15.92:0/353620733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffab8109450 msgr2=0x7ffab81a7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:09.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.212+0000 7ffabdc86640 1 --2- 172.21.15.92:0/353620733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffab8109450 0x7ffab81a7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.212+0000 7ffabdc86640 1 -- 172.21.15.92:0/353620733 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab81ac440 con 0x7ffab8109830 2024-09-19T09:12:09.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.213+0000 7ffabe487640 1 --2- 172.21.15.92:0/353620733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffab8109450 0x7ffab81a7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:12:09.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.213+0000 7ffabdc86640 1 --2- 172.21.15.92:0/353620733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffab8109830 0x7ffab81a79b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ffab0000f80 tx=0x7ffab0003f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:09.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.225+0000 7ffab77fe640 1 -- 172.21.15.92:0/353620733 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab0031830 con 0x7ffab8109830 2024-09-19T09:12:09.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.225+0000 7ffab77fe640 1 -- 172.21.15.92:0/353620733 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffab002d070 con 0x7ffab8109830 2024-09-19T09:12:09.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.225+0000 7ffab77fe640 1 -- 172.21.15.92:0/353620733 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab002fca0 con 0x7ffab8109830 2024-09-19T09:12:09.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.225+0000 7ffac06eb640 1 -- 172.21.15.92:0/353620733 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffab81ac6d0 con 0x7ffab8109830 2024-09-19T09:12:09.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.225+0000 7ffac06eb640 1 -- 172.21.15.92:0/353620733 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffab8110920 con 0x7ffab8109830 2024-09-19T09:12:09.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.230+0000 7ffac2ac4740 1 Processor -- start 2024-09-19T09:12:09.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.231+0000 7ffac2ac4740 1 -- start start 2024-09-19T09:12:09.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.231+0000 7ffac2ac4740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564810805060 0x564810805440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:09.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.231+0000 7ffac2ac4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564810805980 0x56481080fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:09.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.231+0000 7ffac2ac4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564810810240 0x564810812630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:09.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.231+0000 7ffac2ac4740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56481076a620 con 0x564810805980 2024-09-19T09:12:09.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.231+0000 7ffac2ac4740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564810711e50 con 0x564810810240 2024-09-19T09:12:09.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.231+0000 7ffac2ac4740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5648107665e0 con 0x564810805060 2024-09-19T09:12:09.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.232+0000 7ffabec88640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564810805060 0x564810805440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:09.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.232+0000 7ffabec88640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564810805060 0x564810805440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:55020/0 (socket says 172.21.15.92:55020) 2024-09-19T09:12:09.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.232+0000 7ffabec88640 1 -- 172.21.15.92:0/2533944225 learned_addr learned my addr 172.21.15.92:0/2533944225 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:09.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.234+0000 7ffabec88640 1 -- 172.21.15.92:0/2533944225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564810810240 msgr2=0x564810812630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:12:09.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.234+0000 7ffabec88640 1 --2- 172.21.15.92:0/2533944225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564810810240 0x564810812630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.234+0000 7ffabec88640 1 -- 172.21.15.92:0/2533944225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564810805980 msgr2=0x56481080fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:09.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.234+0000 7ffabec88640 1 --2- 172.21.15.92:0/2533944225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564810805980 0x56481080fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.234+0000 7ffabec88640 1 -- 172.21.15.92:0/2533944225 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564810702d40 con 0x564810805060 2024-09-19T09:12:09.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.238+0000 7ffab77fe640 1 -- 172.21.15.92:0/353620733 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ffab0004040 con 0x7ffab8109830 2024-09-19T09:12:09.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.241+0000 7ffabec88640 1 --2- 172.21.15.92:0/2533944225 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564810805060 0x564810805440 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ffaac0099b0 tx=0x7ffaac009e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d15a6535c60244e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:09.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.242+0000 7ffab77fe640 1 --2- 172.21.15.92:0/353620733 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffaa00a3460 0x7ffaa00a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:09.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.242+0000 7ffab77fe640 1 -- 172.21.15.92:0/353620733 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ffab00f0ea0 con 0x7ffab8109830 2024-09-19T09:12:09.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.243+0000 7ffab4ff9640 1 -- 172.21.15.92:0/2533944225 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaac017070 con 0x564810805060 2024-09-19T09:12:09.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.243+0000 7ffab4ff9640 1 -- 172.21.15.92:0/2533944225 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffaac013470 con 0x564810805060 2024-09-19T09:12:09.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.243+0000 7ffab4ff9640 1 -- 172.21.15.92:0/2533944225 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaac012630 con 0x564810805060 2024-09-19T09:12:09.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.244+0000 7ffac2ac4740 1 -- 172.21.15.92:0/2533944225 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564810805060 msgr2=0x564810805440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:09.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.244+0000 7ffac2ac4740 1 --2- 172.21.15.92:0/2533944225 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564810805060 0x564810805440 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ffaac0099b0 tx=0x7ffaac009e70 comp rx=0 tx=0).stop 2024-09-19T09:12:09.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.245+0000 7ffac2ac4740 1 -- 172.21.15.92:0/2533944225 shutdown_connections 2024-09-19T09:12:09.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.245+0000 7ffac2ac4740 1 --2- 172.21.15.92:0/2533944225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564810810240 0x564810812630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.245+0000 7ffac2ac4740 1 --2- 172.21.15.92:0/2533944225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564810805980 0x56481080fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.245+0000 7ffac2ac4740 1 --2- 172.21.15.92:0/2533944225 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564810805060 0x564810805440 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.245+0000 7ffac2ac4740 1 -- 172.21.15.92:0/2533944225 >> 172.21.15.92:0/2533944225 conn(0x5648108015f0 msgr2=0x5648108019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:09.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.245+0000 7ffabe487640 1 --2- 172.21.15.92:0/353620733 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffaa00a3460 0x7ffaa00a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:09.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.245+0000 7ffac2ac4740 1 -- 172.21.15.92:0/2533944225 shutdown_connections 2024-09-19T09:12:09.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.247+0000 7ffac2ac4740 1 -- 172.21.15.92:0/2533944225 wait complete. 2024-09-19T09:12:09.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.247+0000 7ffabe487640 1 --2- 172.21.15.92:0/353620733 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffaa00a3460 0x7ffaa00a5920 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x564810802450 tx=0x7ffaa8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:09.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.247+0000 7ffac2ac4740 1 -- start start 2024-09-19T09:12:09.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.248+0000 7ffac2ac4740 1 Processor -- start 2024-09-19T09:12:09.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.248+0000 7ffac2ac4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564810805060 0x56481080d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:09.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.248+0000 7ffac2ac4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564810805980 0x56481080d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:09.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.249+0000 7ffabe487640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564810805060 0x56481080d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:09.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.249+0000 7ffabe487640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564810805060 0x56481080d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.92:37928/0 (socket says 172.21.15.92:37928) 2024-09-19T09:12:09.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.249+0000 7ffabe487640 1 -- 172.21.15.92:0/2960738266 learned_addr learned my addr 172.21.15.92:0/2960738266 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:09.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.249+0000 7ffac2ac4740 1 --2- 172.21.15.92:0/2960738266 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564810810240 0x56481080daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:09.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.249+0000 7ffac2ac4740 1 -- 172.21.15.92:0/2960738266 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564810812e60 con 0x564810805980 2024-09-19T09:12:09.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.249+0000 7ffac2ac4740 1 -- 172.21.15.92:0/2960738266 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5648106f2f10 con 0x564810805060 2024-09-19T09:12:09.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.249+0000 7ffabec88640 1 --2- 172.21.15.92:0/2960738266 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564810810240 0x56481080daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:09.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.249+0000 7ffac2ac4740 1 -- 172.21.15.92:0/2960738266 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x564810812fe0 con 0x564810810240 2024-09-19T09:12:09.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.250+0000 7ffac2ac4740 10 client.0 _ll_register_callbacks cb 0x564810716db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:12:09.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.251+0000 7ffabec88640 1 -- 172.21.15.92:0/2960738266 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564810805060 msgr2=0x56481080d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:09.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.251+0000 7ffabec88640 1 --2- 172.21.15.92:0/2960738266 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564810805060 0x56481080d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.251+0000 7ffabec88640 1 -- 172.21.15.92:0/2960738266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564810805980 msgr2=0x56481080d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:09.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.251+0000 7ffabec88640 1 --2- 172.21.15.92:0/2960738266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564810805980 0x56481080d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.251+0000 7ffabec88640 1 -- 172.21.15.92:0/2960738266 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564810479580 con 0x564810810240 2024-09-19T09:12:09.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.251+0000 7ffabec88640 1 --2- 172.21.15.92:0/2960738266 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564810810240 0x56481080daf0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ffaac000c00 tx=0x7ffaac00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79709ef03be4c7d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:09.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.253+0000 7ffa9dffb640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:12:09.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.253+0000 7ffa9dffb640 1 -- 172.21.15.92:0/2960738266 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaac017050 con 0x564810810240 2024-09-19T09:12:09.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.253+0000 7ffac2ac4740 1 -- 172.21.15.92:0/2960738266 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffaac013470 con 0x564810810240 2024-09-19T09:12:09.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.253+0000 7ffa9dffb640 1 -- 172.21.15.92:0/2960738266 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ffaac01c860 con 0x564810810240 2024-09-19T09:12:09.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.254+0000 7ffa9dffb640 1 -- 172.21.15.92:0/2960738266 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ffaac01ca60 con 0x564810810240 2024-09-19T09:12:09.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.258+0000 7ffac2ac4740 10 client.28120 fetch_fsmap learned FSMap version 19 2024-09-19T09:12:09.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.258+0000 7ffac2ac4740 1 -- 172.21.15.92:0/2960738266 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x564810543960 con 0x564810810240 2024-09-19T09:12:09.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.259+0000 7ffa9dffb640 1 -- 172.21.15.92:0/2960738266 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffaac013470 con 0x564810810240 2024-09-19T09:12:09.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.259+0000 7ffa9dffb640 1 -- 172.21.15.92:0/2960738266 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ffaac026b50 con 0x564810810240 2024-09-19T09:12:09.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.261+0000 7ffac2ac4740 10 client.28120 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:12:09.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.261+0000 7ffac2ac4740 10 client.28120 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:12:09.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.261+0000 7ffac2ac4740 20 client.28120 populate_metadata read hostname 'smithi092' 2024-09-19T09:12:09.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.261+0000 7ffac2ac4740 1 --2- 172.21.15.92:0/2960738266 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56481081fdc0 0x5648108221b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:09.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.261+0000 7ffac2ac4740 4 client.28120 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:12:09.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.261+0000 7ffac2ac4740 1 -- 172.21.15.92:0/2960738266 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564810777b90 con 0x56481081fdc0 2024-09-19T09:12:09.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.262+0000 7ffabe487640 1 --2- 172.21.15.92:0/2960738266 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56481081fdc0 0x5648108221b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:09.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.269+0000 7ffa9dffb640 10 client.28120 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:12:09.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.269+0000 7ffabe487640 1 --2- 172.21.15.92:0/2960738266 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56481081fdc0 0x5648108221b0 crc :-1 s=READY pgs=462 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb5ef8d042c96b28 server_cookie=4038de172a17401f in_seq=0 out_seq=0 2024-09-19T09:12:09.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.270+0000 7ffa9dffb640 1 -- 172.21.15.92:0/2960738266 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564810777b90 con 0x56481081fdc0 2024-09-19T09:12:09.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.270+0000 7ffa9dffb640 10 client.28120 handle_command_reply: tid=0 2024-09-19T09:12:09.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.271+0000 7ffac2ac4740 1 client.28120 shutdown 2024-09-19T09:12:09.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.273+0000 7ffac2ac4740 1 -- 172.21.15.92:0/2960738266 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564810810240 msgr2=0x56481080daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:09.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.273+0000 7ffac2ac4740 1 --2- 172.21.15.92:0/2960738266 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564810810240 0x56481080daf0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ffaac000c00 tx=0x7ffaac00ecb0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.274+0000 7ffac2ac4740 1 -- 172.21.15.92:0/2960738266 shutdown_connections 2024-09-19T09:12:09.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.275+0000 7ffac2ac4740 1 --2- 172.21.15.92:0/2960738266 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56481081fdc0 0x5648108221b0 crc :-1 s=READY pgs=462 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.275+0000 7ffac2ac4740 1 --2- 172.21.15.92:0/2960738266 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564810810240 0x56481080daf0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.275+0000 7ffac2ac4740 1 --2- 172.21.15.92:0/2960738266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564810805980 0x56481080d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.275+0000 7ffac2ac4740 1 --2- 172.21.15.92:0/2960738266 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564810805060 0x56481080d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.275+0000 7ffac2ac4740 1 -- 172.21.15.92:0/2960738266 >> 172.21.15.92:0/2960738266 conn(0x5648108015f0 msgr2=0x564810807320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:09.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.275+0000 7ffa9dffb640 0 client.28120 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:12:09.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.275+0000 7ffac2ac4740 1 -- 172.21.15.92:0/2960738266 shutdown_connections 2024-09-19T09:12:09.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.275+0000 7ffac2ac4740 1 -- 172.21.15.92:0/2960738266 wait complete. 2024-09-19T09:12:09.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.278+0000 7ffac2ac4740 20 client.28120 trim_cache size 0 max 16384 2024-09-19T09:12:09.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.314+0000 7ffac2ac4740 1 Processor -- start 2024-09-19T09:12:09.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.314+0000 7ffac2ac4740 1 -- start start 2024-09-19T09:12:09.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.314+0000 7ffac2ac4740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564810805060 0x564810827860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:09.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.315+0000 7ffac2ac4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564810805980 0x564810827da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:09.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.315+0000 7ffac2ac4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564810810240 0x56481080a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:09.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.315+0000 7ffabe487640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564810805060 0x564810827860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:09.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.315+0000 7ffabe487640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564810805060 0x564810827860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:55044/0 (socket says 172.21.15.92:55044) 2024-09-19T09:12:09.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.315+0000 7ffabe487640 1 -- 172.21.15.92:0/2468055769 learned_addr learned my addr 172.21.15.92:0/2468055769 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:09.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.315+0000 7ffac2ac4740 1 -- 172.21.15.92:0/2468055769 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa400c500 con 0x564810805980 2024-09-19T09:12:09.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.315+0000 7ffac2ac4740 1 -- 172.21.15.92:0/2468055769 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa400eda0 con 0x564810810240 2024-09-19T09:12:09.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.315+0000 7ffabec88640 1 --2- 172.21.15.92:0/2468055769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564810810240 0x56481080a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:09.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.315+0000 7ffac2ac4740 1 -- 172.21.15.92:0/2468055769 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa400cb90 con 0x564810805060 2024-09-19T09:12:09.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.316+0000 7ffabdc86640 1 --2- 172.21.15.92:0/2468055769 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564810805980 0x564810827da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:09.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.316+0000 7ffabdc86640 1 -- 172.21.15.92:0/2468055769 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564810805060 msgr2=0x564810827860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:09.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.316+0000 7ffabdc86640 1 --2- 172.21.15.92:0/2468055769 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564810805060 0x564810827860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.316+0000 7ffabdc86640 1 -- 172.21.15.92:0/2468055769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564810810240 msgr2=0x56481080a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:09.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.316+0000 7ffabdc86640 1 --2- 172.21.15.92:0/2468055769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564810810240 0x56481080a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.316+0000 7ffabdc86640 1 -- 172.21.15.92:0/2468055769 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648108057b0 con 0x564810805980 2024-09-19T09:12:09.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.317+0000 7ffabdc86640 1 --2- 172.21.15.92:0/2468055769 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564810805980 0x564810827da0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x564810802970 tx=0x7ffab00bd250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0f054ebc0f064f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:09.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.317+0000 7ffa9ffff640 1 -- 172.21.15.92:0/2468055769 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab00bdb80 con 0x564810805980 2024-09-19T09:12:09.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.318+0000 7ffa9ffff640 1 -- 172.21.15.92:0/2468055769 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffab0036030 con 0x564810805980 2024-09-19T09:12:09.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.319+0000 7ffac2ac4740 1 -- 172.21.15.92:0/2468055769 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564810805980 msgr2=0x564810827da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:09.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.319+0000 7ffac2ac4740 1 --2- 172.21.15.92:0/2468055769 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564810805980 0x564810827da0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x564810802970 tx=0x7ffab00bd250 comp rx=0 tx=0).stop 2024-09-19T09:12:09.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.319+0000 7ffac2ac4740 1 -- 172.21.15.92:0/2468055769 shutdown_connections 2024-09-19T09:12:09.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.319+0000 7ffac2ac4740 1 --2- 172.21.15.92:0/2468055769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564810810240 0x56481080a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.319+0000 7ffac2ac4740 1 --2- 172.21.15.92:0/2468055769 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564810805980 0x564810827da0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.319+0000 7ffac2ac4740 1 --2- 172.21.15.92:0/2468055769 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564810805060 0x564810827860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.319+0000 7ffac2ac4740 1 -- 172.21.15.92:0/2468055769 >> 172.21.15.92:0/2468055769 conn(0x5648108015f0 msgr2=0x56481080b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:09.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.320+0000 7ffac2ac4740 1 -- 172.21.15.92:0/2468055769 shutdown_connections 2024-09-19T09:12:09.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.320+0000 7ffac2ac4740 1 -- 172.21.15.92:0/2468055769 wait complete. 2024-09-19T09:12:09.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.320+0000 7ffac2ac4740 1 -- start start 2024-09-19T09:12:09.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.320+0000 7ffac2ac4740 1 Processor -- start 2024-09-19T09:12:09.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.321+0000 7ffac2ac4740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564810805060 0x564810818310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:09.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.321+0000 7ffac2ac4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564810810240 0x564810818850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:09.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.321+0000 7ffac2ac4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648108152e0 0x564810815760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:09.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.321+0000 7ffac2ac4740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa400d260 con 0x5648108152e0 2024-09-19T09:12:09.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.321+0000 7ffac2ac4740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa400e6d0 con 0x564810810240 2024-09-19T09:12:09.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.321+0000 7ffac2ac4740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa400d930 con 0x564810805060 2024-09-19T09:12:09.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.321+0000 7ffac2ac4740 10 client.0 _ll_register_callbacks cb 0x7ffaac013a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:12:09.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.321+0000 7ffabe487640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564810805060 0x564810818310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:09.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.321+0000 7ffabe487640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564810805060 0x564810818310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:55048/0 (socket says 172.21.15.92:55048) 2024-09-19T09:12:09.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.321+0000 7ffabe487640 1 -- 172.21.15.92:0/2140877070 learned_addr learned my addr 172.21.15.92:0/2140877070 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:09.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.325+0000 7ffabe487640 1 -- 172.21.15.92:0/2140877070 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564810810240 msgr2=0x564810818850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:09.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.325+0000 7ffabe487640 1 --2- 172.21.15.92:0/2140877070 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564810810240 0x564810818850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.325+0000 7ffabe487640 1 -- 172.21.15.92:0/2140877070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648108152e0 msgr2=0x564810815760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:09.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.325+0000 7ffabe487640 1 --2- 172.21.15.92:0/2140877070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648108152e0 0x564810815760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.325+0000 7ffabe487640 1 -- 172.21.15.92:0/2140877070 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564810815ca0 con 0x564810805060 2024-09-19T09:12:09.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.325+0000 7ffabe487640 1 --2- 172.21.15.92:0/2140877070 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564810805060 0x564810818310 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800ce90 tx=0x7ffaa80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e35469676859e817 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:09.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.326+0000 7ffa9dffb640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-09-19T09:12:09.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.329+0000 7ffa9dffb640 1 -- 172.21.15.92:0/2140877070 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8015980 con 0x564810805060 2024-09-19T09:12:09.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.329+0000 7ffa9dffb640 1 -- 172.21.15.92:0/2140877070 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7ffaa8015b20 con 0x564810805060 2024-09-19T09:12:09.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.329+0000 7ffac2ac4740 1 -- 172.21.15.92:0/2140877070 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5648107720a0 con 0x564810805060 2024-09-19T09:12:09.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.330+0000 7ffa9dffb640 1 -- 172.21.15.92:0/2140877070 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ffaa8015d20 con 0x564810805060 2024-09-19T09:12:09.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.333+0000 7ffac2ac4740 10 client.28126 fetch_fsmap learned FSMap version 19 2024-09-19T09:12:09.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.333+0000 7ffac2ac4740 1 -- 172.21.15.92:0/2140877070 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56481088b5a0 con 0x564810805060 2024-09-19T09:12:09.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.335+0000 7ffa9dffb640 1 -- 172.21.15.92:0/2140877070 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5648107720a0 con 0x564810805060 2024-09-19T09:12:09.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.335+0000 7ffa9dffb640 1 -- 172.21.15.92:0/2140877070 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ffaa8031030 con 0x564810805060 2024-09-19T09:12:09.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.336+0000 7ffac2ac4740 10 client.28126 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:12:09.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.336+0000 7ffac2ac4740 10 client.28126 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:12:09.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.336+0000 7ffac2ac4740 20 client.28126 populate_metadata read hostname 'smithi092' 2024-09-19T09:12:09.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.336+0000 7ffac2ac4740 1 --2- 172.21.15.92:0/2140877070 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56481088bd20 0x56481088e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:09.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.336+0000 7ffac2ac4740 4 client.28126 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "da998558", "release": true, "await": true}] 2024-09-19T09:12:09.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.336+0000 7ffac2ac4740 1 -- 172.21.15.92:0/2140877070 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "quiesce db", "set_id": "da998558", "release": true, "await": true}) -- 0x5648106ee5a0 con 0x56481088bd20 2024-09-19T09:12:09.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.336+0000 7ffabdc86640 1 --2- 172.21.15.92:0/2140877070 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56481088bd20 0x56481088e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:09.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.338+0000 7ffabdc86640 1 --2- 172.21.15.92:0/2140877070 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56481088bd20 0x56481088e1a0 crc :-1 s=READY pgs=463 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51962b5aed997397 server_cookie=79d2ddc71e72f760 in_seq=0 out_seq=0 2024-09-19T09:12:09.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.338+0000 7ffa9dffb640 10 client.28126 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:12:09.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.422+0000 7ffa9dffb640 1 -- 172.21.15.92:0/2140877070 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5648106ee5a0 con 0x56481088bd20 2024-09-19T09:12:09.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.423+0000 7ffa9dffb640 10 client.28126 handle_command_reply: tid=0 2024-09-19T09:12:09.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.423+0000 7ffac2ac4740 1 client.28126 shutdown 2024-09-19T09:12:09.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.423+0000 7ffac2ac4740 1 -- 172.21.15.92:0/2140877070 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564810805060 msgr2=0x564810818310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:09.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.423+0000 7ffac2ac4740 1 --2- 172.21.15.92:0/2140877070 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564810805060 0x564810818310 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800ce90 tx=0x7ffaa80046c0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.423+0000 7ffac2ac4740 1 -- 172.21.15.92:0/2140877070 shutdown_connections 2024-09-19T09:12:09.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.423+0000 7ffac2ac4740 1 --2- 172.21.15.92:0/2140877070 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56481088bd20 0x56481088e1a0 crc :-1 s=READY pgs=463 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.423+0000 7ffac2ac4740 1 --2- 172.21.15.92:0/2140877070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5648108152e0 0x564810815760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.423+0000 7ffac2ac4740 1 --2- 172.21.15.92:0/2140877070 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564810810240 0x564810818850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.423+0000 7ffac2ac4740 1 --2- 172.21.15.92:0/2140877070 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564810805060 0x564810818310 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.423+0000 7ffac2ac4740 1 -- 172.21.15.92:0/2140877070 >> 172.21.15.92:0/2140877070 conn(0x5648108015f0 msgr2=0x5648107fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:09.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.423+0000 7ffa9dffb640 0 client.28126 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:12:09.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.423+0000 7ffac2ac4740 1 -- 172.21.15.92:0/2140877070 shutdown_connections 2024-09-19T09:12:09.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.423+0000 7ffac2ac4740 1 -- 172.21.15.92:0/2140877070 wait complete. 2024-09-19T09:12:09.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.423+0000 7ffac2ac4740 20 client.28126 trim_cache size 0 max 16384 2024-09-19T09:12:09.425 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:12:09.425 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 19, 2024-09-19T09:12:09.425 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24472, 2024-09-19T09:12:09.426 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 56, 2024-09-19T09:12:09.426 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-09-19T09:12:09.426 INFO:teuthology.orchestra.run.smithi092.stdout: "da998558": { 2024-09-19T09:12:09.426 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 56, 2024-09-19T09:12:09.426 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-09-19T09:12:09.426 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:12:09.426 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-09-19T09:12:09.426 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:12:09.426 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:09.426 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 90.0, 2024-09-19T09:12:09.426 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 149.4, 2024-09-19T09:12:09.426 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-09-19T09:12:09.426 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-09-19T09:12:09.426 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-09-19T09:12:09.426 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-09-19T09:12:09.427 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-09-19T09:12:09.427 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-09-19T09:12:09.427 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:09.427 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:09.427 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:09.427 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:09.427 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:09.427 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:12:09.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.424+0000 7ffac06eb640 1 -- 172.21.15.92:0/353620733 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffaa00a3460 msgr2=0x7ffaa00a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:09.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.424+0000 7ffac06eb640 1 --2- 172.21.15.92:0/353620733 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffaa00a3460 0x7ffaa00a5920 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x564810802450 tx=0x7ffaa8008040 comp rx=0 tx=0).stop 2024-09-19T09:12:09.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.424+0000 7ffac06eb640 1 -- 172.21.15.92:0/353620733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffab8109830 msgr2=0x7ffab81a79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:09.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.424+0000 7ffac06eb640 1 --2- 172.21.15.92:0/353620733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffab8109830 0x7ffab81a79b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ffab0000f80 tx=0x7ffab0003f80 comp rx=0 tx=0).stop 2024-09-19T09:12:09.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.424+0000 7ffac06eb640 1 -- 172.21.15.92:0/353620733 shutdown_connections 2024-09-19T09:12:09.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.424+0000 7ffac06eb640 1 --2- 172.21.15.92:0/353620733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffab811b140 0x7ffab81abd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.424+0000 7ffac06eb640 1 --2- 172.21.15.92:0/353620733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffab8109830 0x7ffab81a79b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.424+0000 7ffac06eb640 1 --2- 172.21.15.92:0/353620733 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7ffaa00a3460 0x7ffaa00a5920 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.424+0000 7ffac06eb640 1 --2- 172.21.15.92:0/353620733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffab8109450 0x7ffab81a7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.425+0000 7ffac06eb640 1 -- 172.21.15.92:0/353620733 >> 172.21.15.92:0/353620733 conn(0x7ffab806e140 msgr2=0x7ffab811bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:09.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.425+0000 7ffac06eb640 1 -- 172.21.15.92:0/353620733 shutdown_connections 2024-09-19T09:12:09.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:09.425+0000 7ffac06eb640 1 -- 172.21.15.92:0/353620733 wait complete. 2024-09-19T09:12:09.731 INFO:teuthology.orchestra.run.smithi092.stdout:transaction type: 2024-09-19T09:12:09.732 INFO:teuthology.orchestra.run.smithi092.stdout:scaling factor: 32 2024-09-19T09:12:09.732 INFO:teuthology.orchestra.run.smithi092.stdout:query mode: simple 2024-09-19T09:12:09.732 INFO:teuthology.orchestra.run.smithi092.stdout:number of clients: 100 2024-09-19T09:12:09.732 INFO:teuthology.orchestra.run.smithi092.stdout:number of threads: 4 2024-09-19T09:12:09.732 INFO:teuthology.orchestra.run.smithi092.stdout:duration: 900 s 2024-09-19T09:12:09.732 INFO:teuthology.orchestra.run.smithi092.stdout:number of transactions actually processed: 2219131 2024-09-19T09:12:09.732 INFO:teuthology.orchestra.run.smithi092.stdout:latency average = 41.622 ms 2024-09-19T09:12:09.732 INFO:teuthology.orchestra.run.smithi092.stdout:latency stddev = 609.922 ms 2024-09-19T09:12:09.732 INFO:teuthology.orchestra.run.smithi092.stdout:tps = 2401.821306 (including connections establishing) 2024-09-19T09:12:09.732 INFO:teuthology.orchestra.run.smithi092.stdout:tps = 2401.826968 (excluding connections establishing) 2024-09-19T09:12:09.735 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl stop postgresql' 2024-09-19T09:12:10.186 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'da998558', total seconds elapsed: 32.9 2024-09-19T09:12:11.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:10 smithi092 ceph-mon[31407]: pgmap v801: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 5.2 MiB/s wr, 265 op/s 2024-09-19T09:12:11.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:10 smithi167 ceph-mon[35359]: pgmap v801: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 5.2 MiB/s wr, 265 op/s 2024-09-19T09:12:11.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:10 smithi190 ceph-mon[35358]: pgmap v801: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 5.2 MiB/s wr, 265 op/s 2024-09-19T09:12:13.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:12 smithi092 ceph-mon[31407]: pgmap v802: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 9.4 MiB/s wr, 469 op/s 2024-09-19T09:12:13.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:12 smithi167 ceph-mon[35359]: pgmap v802: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 9.4 MiB/s wr, 469 op/s 2024-09-19T09:12:13.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:12 smithi190 ceph-mon[35358]: pgmap v802: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 9.4 MiB/s wr, 469 op/s 2024-09-19T09:12:15.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:14 smithi092 ceph-mon[31407]: pgmap v803: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 18 MiB/s wr, 1.01k op/s 2024-09-19T09:12:15.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:14 smithi167 ceph-mon[35359]: pgmap v803: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 18 MiB/s wr, 1.01k op/s 2024-09-19T09:12:15.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:14 smithi190 ceph-mon[35358]: pgmap v803: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 18 MiB/s wr, 1.01k op/s 2024-09-19T09:12:16.578 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-19T09:12:16.635 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/: 2024-09-19T09:12:16.635 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-19T09:12:16.635 INFO:teuthology.orchestra.run.smithi092.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 08:56 . 2024-09-19T09:12:16.635 INFO:teuthology.orchestra.run.smithi092.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Sep 19 08:56 .. 2024-09-19T09:12:16.635 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 09:12 data 2024-09-19T09:12:16.635 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:12:16.635 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data: 2024-09-19T09:12:16.635 INFO:teuthology.orchestra.run.smithi092.stdout:total 36 2024-09-19T09:12:16.636 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 09:12 . 2024-09-19T09:12:16.636 INFO:teuthology.orchestra.run.smithi092.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 08:56 .. 2024-09-19T09:12:16.636 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 19 08:56 base 2024-09-19T09:12:16.636 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 30 Sep 19 08:56 current_logfiles 2024-09-19T09:12:16.636 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Sep 19 08:56 global 2024-09-19T09:12:16.636 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 08:56 log 2024-09-19T09:12:16.636 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 pg_commit_ts 2024-09-19T09:12:16.636 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 pg_dynshmem 2024-09-19T09:12:16.636 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 Sep 19 08:56 pg_hba.conf 2024-09-19T09:12:16.636 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Sep 19 08:56 pg_ident.conf 2024-09-19T09:12:16.636 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 09:12 pg_logical 2024-09-19T09:12:16.636 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 19 08:56 pg_multixact 2024-09-19T09:12:16.637 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 pg_notify 2024-09-19T09:12:16.637 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 pg_replslot 2024-09-19T09:12:16.637 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 pg_serial 2024-09-19T09:12:16.637 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 pg_snapshots 2024-09-19T09:12:16.637 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 09:12 pg_stat 2024-09-19T09:12:16.637 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 09:12 pg_stat_tmp 2024-09-19T09:12:16.637 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 09:12 pg_subtrans 2024-09-19T09:12:16.637 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 pg_tblspc 2024-09-19T09:12:16.637 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 pg_twophase 2024-09-19T09:12:16.637 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 08:56 PG_VERSION 2024-09-19T09:12:16.637 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 65 Sep 19 09:12 pg_wal 2024-09-19T09:12:16.637 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 09:12 pg_xact 2024-09-19T09:12:16.637 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Sep 19 08:56 postgresql.auto.conf 2024-09-19T09:12:16.638 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28074 Sep 19 08:56 postgresql.conf 2024-09-19T09:12:16.638 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 51 Sep 19 08:56 postmaster.opts 2024-09-19T09:12:16.638 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:12:16.638 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/base: 2024-09-19T09:12:16.638 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-19T09:12:16.638 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 19 08:56 . 2024-09-19T09:12:16.638 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 09:12 .. 2024-09-19T09:12:16.638 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 19 08:56 1 2024-09-19T09:12:16.638 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 19 08:56 13493 2024-09-19T09:12:16.638 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 305 Sep 19 08:59 13494 2024-09-19T09:12:16.638 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 pgsql_tmp 2024-09-19T09:12:16.638 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:12:16.638 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/base/1: 2024-09-19T09:12:16.639 INFO:teuthology.orchestra.run.smithi092.stdout:total 7777 2024-09-19T09:12:16.639 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 19 08:56 . 2024-09-19T09:12:16.639 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 19 08:56 .. 2024-09-19T09:12:16.639 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 112 2024-09-19T09:12:16.639 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 113 2024-09-19T09:12:16.639 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 19 08:56 1247 2024-09-19T09:12:16.639 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 1247_fsm 2024-09-19T09:12:16.639 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1247_vm 2024-09-19T09:12:16.639 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 19 08:56 1249 2024-09-19T09:12:16.639 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 1249_fsm 2024-09-19T09:12:16.639 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1249_vm 2024-09-19T09:12:16.639 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 19 08:56 1255 2024-09-19T09:12:16.639 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 1255_fsm 2024-09-19T09:12:16.640 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1255_vm 2024-09-19T09:12:16.640 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 19 08:56 1259 2024-09-19T09:12:16.640 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 1259_fsm 2024-09-19T09:12:16.640 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1259_vm 2024-09-19T09:12:16.640 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 19 08:56 13344 2024-09-19T09:12:16.640 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 13344_fsm 2024-09-19T09:12:16.640 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13344_vm 2024-09-19T09:12:16.640 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 13346 2024-09-19T09:12:16.640 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13348 2024-09-19T09:12:16.640 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13349 2024-09-19T09:12:16.640 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 13349_fsm 2024-09-19T09:12:16.640 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13349_vm 2024-09-19T09:12:16.640 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 13351 2024-09-19T09:12:16.641 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13353 2024-09-19T09:12:16.641 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13354 2024-09-19T09:12:16.641 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 13354_fsm 2024-09-19T09:12:16.641 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13354_vm 2024-09-19T09:12:16.641 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 13356 2024-09-19T09:12:16.641 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13358 2024-09-19T09:12:16.641 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13359 2024-09-19T09:12:16.641 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 13359_fsm 2024-09-19T09:12:16.641 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13359_vm 2024-09-19T09:12:16.641 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 13361 2024-09-19T09:12:16.641 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13363 2024-09-19T09:12:16.641 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 1417 2024-09-19T09:12:16.641 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 1418 2024-09-19T09:12:16.642 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 174 2024-09-19T09:12:16.642 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 175 2024-09-19T09:12:16.642 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2187 2024-09-19T09:12:16.642 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2224 2024-09-19T09:12:16.642 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2328 2024-09-19T09:12:16.642 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2336 2024-09-19T09:12:16.642 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2337 2024-09-19T09:12:16.642 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2579 2024-09-19T09:12:16.642 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2600 2024-09-19T09:12:16.642 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2600_fsm 2024-09-19T09:12:16.642 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2600_vm 2024-09-19T09:12:16.642 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2601 2024-09-19T09:12:16.642 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2601_fsm 2024-09-19T09:12:16.643 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2601_vm 2024-09-19T09:12:16.643 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 08:56 2602 2024-09-19T09:12:16.643 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2602_fsm 2024-09-19T09:12:16.643 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2602_vm 2024-09-19T09:12:16.643 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2603 2024-09-19T09:12:16.643 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2603_fsm 2024-09-19T09:12:16.643 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2603_vm 2024-09-19T09:12:16.643 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2604 2024-09-19T09:12:16.643 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2605 2024-09-19T09:12:16.643 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2605_fsm 2024-09-19T09:12:16.643 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2605_vm 2024-09-19T09:12:16.643 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2606 2024-09-19T09:12:16.643 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2606_fsm 2024-09-19T09:12:16.644 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2606_vm 2024-09-19T09:12:16.644 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2607 2024-09-19T09:12:16.644 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2607_fsm 2024-09-19T09:12:16.644 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2607_vm 2024-09-19T09:12:16.644 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 19 08:56 2608 2024-09-19T09:12:16.644 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2608_fsm 2024-09-19T09:12:16.644 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2608_vm 2024-09-19T09:12:16.644 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 19 08:56 2609 2024-09-19T09:12:16.644 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2609_fsm 2024-09-19T09:12:16.644 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2609_vm 2024-09-19T09:12:16.644 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2610 2024-09-19T09:12:16.644 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2610_fsm 2024-09-19T09:12:16.644 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2610_vm 2024-09-19T09:12:16.645 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2611 2024-09-19T09:12:16.645 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2612 2024-09-19T09:12:16.645 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2612_fsm 2024-09-19T09:12:16.645 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2612_vm 2024-09-19T09:12:16.645 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2613 2024-09-19T09:12:16.645 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2615 2024-09-19T09:12:16.645 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2615_fsm 2024-09-19T09:12:16.645 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2615_vm 2024-09-19T09:12:16.645 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2616 2024-09-19T09:12:16.645 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2616_fsm 2024-09-19T09:12:16.645 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2616_vm 2024-09-19T09:12:16.646 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 19 08:56 2617 2024-09-19T09:12:16.646 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2617_fsm 2024-09-19T09:12:16.646 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2617_vm 2024-09-19T09:12:16.646 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 19 08:56 2618 2024-09-19T09:12:16.646 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2618_fsm 2024-09-19T09:12:16.646 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2618_vm 2024-09-19T09:12:16.646 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 19 08:56 2619 2024-09-19T09:12:16.646 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2619_fsm 2024-09-19T09:12:16.646 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2619_vm 2024-09-19T09:12:16.646 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2620 2024-09-19T09:12:16.647 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2650 2024-09-19T09:12:16.647 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2651 2024-09-19T09:12:16.647 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2652 2024-09-19T09:12:16.647 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 08:56 2653 2024-09-19T09:12:16.647 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 08:56 2654 2024-09-19T09:12:16.647 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2655 2024-09-19T09:12:16.647 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2656 2024-09-19T09:12:16.647 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2657 2024-09-19T09:12:16.647 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 19 08:56 2658 2024-09-19T09:12:16.647 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 19 08:56 2659 2024-09-19T09:12:16.647 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2660 2024-09-19T09:12:16.647 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2661 2024-09-19T09:12:16.648 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2662 2024-09-19T09:12:16.648 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 08:56 2663 2024-09-19T09:12:16.648 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2664 2024-09-19T09:12:16.648 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2665 2024-09-19T09:12:16.648 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2666 2024-09-19T09:12:16.648 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2667 2024-09-19T09:12:16.648 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2668 2024-09-19T09:12:16.648 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2669 2024-09-19T09:12:16.648 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2670 2024-09-19T09:12:16.648 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 19 08:56 2673 2024-09-19T09:12:16.648 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 19 08:56 2674 2024-09-19T09:12:16.648 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 19 08:56 2675 2024-09-19T09:12:16.648 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2678 2024-09-19T09:12:16.649 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2679 2024-09-19T09:12:16.649 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2680 2024-09-19T09:12:16.649 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2681 2024-09-19T09:12:16.649 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2682 2024-09-19T09:12:16.649 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2683 2024-09-19T09:12:16.649 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2684 2024-09-19T09:12:16.649 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2685 2024-09-19T09:12:16.649 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2686 2024-09-19T09:12:16.649 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2687 2024-09-19T09:12:16.649 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 08:56 2688 2024-09-19T09:12:16.649 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 08:56 2689 2024-09-19T09:12:16.649 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 19 08:56 2690 2024-09-19T09:12:16.649 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 19 08:56 2691 2024-09-19T09:12:16.650 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2692 2024-09-19T09:12:16.650 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2693 2024-09-19T09:12:16.650 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2696 2024-09-19T09:12:16.650 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2699 2024-09-19T09:12:16.650 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2701 2024-09-19T09:12:16.650 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2702 2024-09-19T09:12:16.650 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2703 2024-09-19T09:12:16.650 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 08:56 2704 2024-09-19T09:12:16.650 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2753 2024-09-19T09:12:16.650 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2753_fsm 2024-09-19T09:12:16.650 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2753_vm 2024-09-19T09:12:16.650 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2754 2024-09-19T09:12:16.650 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2755 2024-09-19T09:12:16.651 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2756 2024-09-19T09:12:16.651 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2757 2024-09-19T09:12:16.651 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2830 2024-09-19T09:12:16.651 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2831 2024-09-19T09:12:16.651 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2832 2024-09-19T09:12:16.651 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2833 2024-09-19T09:12:16.651 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2834 2024-09-19T09:12:16.651 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2835 2024-09-19T09:12:16.651 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2836 2024-09-19T09:12:16.651 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2837 2024-09-19T09:12:16.651 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 19 08:56 2838 2024-09-19T09:12:16.651 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2838_fsm 2024-09-19T09:12:16.651 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2838_vm 2024-09-19T09:12:16.651 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2839 2024-09-19T09:12:16.652 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2840 2024-09-19T09:12:16.652 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2840_fsm 2024-09-19T09:12:16.652 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2840_vm 2024-09-19T09:12:16.652 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2841 2024-09-19T09:12:16.652 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2995 2024-09-19T09:12:16.652 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2996 2024-09-19T09:12:16.652 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3079 2024-09-19T09:12:16.652 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3079_fsm 2024-09-19T09:12:16.652 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3079_vm 2024-09-19T09:12:16.652 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3080 2024-09-19T09:12:16.652 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3081 2024-09-19T09:12:16.652 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 08:56 3085 2024-09-19T09:12:16.653 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3118 2024-09-19T09:12:16.653 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3119 2024-09-19T09:12:16.653 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 19 08:56 3164 2024-09-19T09:12:16.653 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3256 2024-09-19T09:12:16.653 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3257 2024-09-19T09:12:16.653 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3258 2024-09-19T09:12:16.653 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3350 2024-09-19T09:12:16.653 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3351 2024-09-19T09:12:16.653 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3379 2024-09-19T09:12:16.654 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3380 2024-09-19T09:12:16.654 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3381 2024-09-19T09:12:16.654 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3394 2024-09-19T09:12:16.654 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3394_fsm 2024-09-19T09:12:16.654 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3394_vm 2024-09-19T09:12:16.654 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3395 2024-09-19T09:12:16.654 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3429 2024-09-19T09:12:16.654 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3430 2024-09-19T09:12:16.654 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3431 2024-09-19T09:12:16.654 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3433 2024-09-19T09:12:16.654 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3439 2024-09-19T09:12:16.654 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3440 2024-09-19T09:12:16.654 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 08:56 3455 2024-09-19T09:12:16.654 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 19 08:56 3456 2024-09-19T09:12:16.655 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3456_fsm 2024-09-19T09:12:16.655 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3456_vm 2024-09-19T09:12:16.655 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3466 2024-09-19T09:12:16.655 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3467 2024-09-19T09:12:16.655 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3468 2024-09-19T09:12:16.655 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3501 2024-09-19T09:12:16.655 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3502 2024-09-19T09:12:16.655 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3503 2024-09-19T09:12:16.655 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3534 2024-09-19T09:12:16.655 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3541 2024-09-19T09:12:16.655 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3541_fsm 2024-09-19T09:12:16.655 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3541_vm 2024-09-19T09:12:16.655 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3542 2024-09-19T09:12:16.655 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3574 2024-09-19T09:12:16.656 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3575 2024-09-19T09:12:16.656 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3576 2024-09-19T09:12:16.656 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3596 2024-09-19T09:12:16.656 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3597 2024-09-19T09:12:16.656 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3598 2024-09-19T09:12:16.656 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3599 2024-09-19T09:12:16.656 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3600 2024-09-19T09:12:16.656 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3600_fsm 2024-09-19T09:12:16.656 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3600_vm 2024-09-19T09:12:16.656 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3601 2024-09-19T09:12:16.656 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3601_fsm 2024-09-19T09:12:16.656 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3601_vm 2024-09-19T09:12:16.656 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3602 2024-09-19T09:12:16.657 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3602_fsm 2024-09-19T09:12:16.657 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3602_vm 2024-09-19T09:12:16.657 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3603 2024-09-19T09:12:16.657 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3603_fsm 2024-09-19T09:12:16.657 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3603_vm 2024-09-19T09:12:16.657 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3604 2024-09-19T09:12:16.657 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3605 2024-09-19T09:12:16.657 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3606 2024-09-19T09:12:16.657 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3607 2024-09-19T09:12:16.657 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3608 2024-09-19T09:12:16.657 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 3609 2024-09-19T09:12:16.657 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3712 2024-09-19T09:12:16.657 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3764 2024-09-19T09:12:16.657 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3764_fsm 2024-09-19T09:12:16.658 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3764_vm 2024-09-19T09:12:16.658 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3766 2024-09-19T09:12:16.658 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3767 2024-09-19T09:12:16.659 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3997 2024-09-19T09:12:16.659 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4143 2024-09-19T09:12:16.659 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4144 2024-09-19T09:12:16.659 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4145 2024-09-19T09:12:16.659 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4146 2024-09-19T09:12:16.659 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4147 2024-09-19T09:12:16.659 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4148 2024-09-19T09:12:16.659 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4149 2024-09-19T09:12:16.659 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4150 2024-09-19T09:12:16.660 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4151 2024-09-19T09:12:16.660 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4152 2024-09-19T09:12:16.660 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4153 2024-09-19T09:12:16.660 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4154 2024-09-19T09:12:16.660 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4155 2024-09-19T09:12:16.660 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4156 2024-09-19T09:12:16.660 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4157 2024-09-19T09:12:16.660 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4158 2024-09-19T09:12:16.660 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4159 2024-09-19T09:12:16.660 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4160 2024-09-19T09:12:16.660 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4161 2024-09-19T09:12:16.660 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4162 2024-09-19T09:12:16.663 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4163 2024-09-19T09:12:16.663 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4164 2024-09-19T09:12:16.663 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4165 2024-09-19T09:12:16.663 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4166 2024-09-19T09:12:16.663 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4167 2024-09-19T09:12:16.663 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4168 2024-09-19T09:12:16.663 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4169 2024-09-19T09:12:16.663 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4170 2024-09-19T09:12:16.664 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4171 2024-09-19T09:12:16.664 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4172 2024-09-19T09:12:16.664 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4173 2024-09-19T09:12:16.664 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4174 2024-09-19T09:12:16.664 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 5002 2024-09-19T09:12:16.664 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 548 2024-09-19T09:12:16.664 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 549 2024-09-19T09:12:16.664 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 6102 2024-09-19T09:12:16.664 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 6104 2024-09-19T09:12:16.664 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 6106 2024-09-19T09:12:16.664 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 6110 2024-09-19T09:12:16.664 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 6111 2024-09-19T09:12:16.664 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 6112 2024-09-19T09:12:16.665 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 6113 2024-09-19T09:12:16.665 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 6117 2024-09-19T09:12:16.665 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 826 2024-09-19T09:12:16.665 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 827 2024-09-19T09:12:16.665 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 828 2024-09-19T09:12:16.665 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 19 08:56 pg_filenode.map 2024-09-19T09:12:16.665 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 08:56 PG_VERSION 2024-09-19T09:12:16.665 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:12:16.665 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-09-19T09:12:16.665 INFO:teuthology.orchestra.run.smithi092.stdout:total 7777 2024-09-19T09:12:16.665 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 19 08:56 . 2024-09-19T09:12:16.665 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 19 08:56 .. 2024-09-19T09:12:16.665 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 112 2024-09-19T09:12:16.666 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 113 2024-09-19T09:12:16.666 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 19 08:56 1247 2024-09-19T09:12:16.666 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 1247_fsm 2024-09-19T09:12:16.666 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1247_vm 2024-09-19T09:12:16.666 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 19 08:56 1249 2024-09-19T09:12:16.666 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 1249_fsm 2024-09-19T09:12:16.666 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1249_vm 2024-09-19T09:12:16.666 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 19 08:56 1255 2024-09-19T09:12:16.666 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 1255_fsm 2024-09-19T09:12:16.666 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1255_vm 2024-09-19T09:12:16.666 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 19 08:56 1259 2024-09-19T09:12:16.666 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 1259_fsm 2024-09-19T09:12:16.666 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1259_vm 2024-09-19T09:12:16.667 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 19 08:56 13344 2024-09-19T09:12:16.667 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 13344_fsm 2024-09-19T09:12:16.667 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13344_vm 2024-09-19T09:12:16.667 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 13346 2024-09-19T09:12:16.667 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13348 2024-09-19T09:12:16.667 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13349 2024-09-19T09:12:16.667 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 13349_fsm 2024-09-19T09:12:16.667 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13349_vm 2024-09-19T09:12:16.667 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 13351 2024-09-19T09:12:16.667 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13353 2024-09-19T09:12:16.667 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13354 2024-09-19T09:12:16.667 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 13354_fsm 2024-09-19T09:12:16.667 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13354_vm 2024-09-19T09:12:16.667 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 13356 2024-09-19T09:12:16.668 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13358 2024-09-19T09:12:16.668 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13359 2024-09-19T09:12:16.668 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 13359_fsm 2024-09-19T09:12:16.668 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13359_vm 2024-09-19T09:12:16.668 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 13361 2024-09-19T09:12:16.668 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13363 2024-09-19T09:12:16.668 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 1417 2024-09-19T09:12:16.668 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 1418 2024-09-19T09:12:16.668 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 174 2024-09-19T09:12:16.668 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 175 2024-09-19T09:12:16.668 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2187 2024-09-19T09:12:16.668 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2224 2024-09-19T09:12:16.668 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2328 2024-09-19T09:12:16.668 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2336 2024-09-19T09:12:16.669 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2337 2024-09-19T09:12:16.669 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2579 2024-09-19T09:12:16.669 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2600 2024-09-19T09:12:16.669 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2600_fsm 2024-09-19T09:12:16.669 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2600_vm 2024-09-19T09:12:16.669 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2601 2024-09-19T09:12:16.669 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2601_fsm 2024-09-19T09:12:16.669 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2601_vm 2024-09-19T09:12:16.669 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 08:56 2602 2024-09-19T09:12:16.669 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2602_fsm 2024-09-19T09:12:16.669 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2602_vm 2024-09-19T09:12:16.669 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2603 2024-09-19T09:12:16.669 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2603_fsm 2024-09-19T09:12:16.670 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2603_vm 2024-09-19T09:12:16.670 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2604 2024-09-19T09:12:16.670 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2605 2024-09-19T09:12:16.670 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2605_fsm 2024-09-19T09:12:16.670 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2605_vm 2024-09-19T09:12:16.670 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2606 2024-09-19T09:12:16.670 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2606_fsm 2024-09-19T09:12:16.670 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2606_vm 2024-09-19T09:12:16.670 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2607 2024-09-19T09:12:16.670 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2607_fsm 2024-09-19T09:12:16.670 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2607_vm 2024-09-19T09:12:16.670 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 19 08:56 2608 2024-09-19T09:12:16.670 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2608_fsm 2024-09-19T09:12:16.670 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2608_vm 2024-09-19T09:12:16.671 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 19 08:56 2609 2024-09-19T09:12:16.671 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2609_fsm 2024-09-19T09:12:16.671 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2609_vm 2024-09-19T09:12:16.671 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2610 2024-09-19T09:12:16.671 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2610_fsm 2024-09-19T09:12:16.671 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2610_vm 2024-09-19T09:12:16.671 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2611 2024-09-19T09:12:16.671 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2612 2024-09-19T09:12:16.671 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2612_fsm 2024-09-19T09:12:16.671 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2612_vm 2024-09-19T09:12:16.671 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2613 2024-09-19T09:12:16.671 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2615 2024-09-19T09:12:16.671 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2615_fsm 2024-09-19T09:12:16.672 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2615_vm 2024-09-19T09:12:16.672 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2616 2024-09-19T09:12:16.672 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2616_fsm 2024-09-19T09:12:16.672 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2616_vm 2024-09-19T09:12:16.672 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 19 08:56 2617 2024-09-19T09:12:16.672 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2617_fsm 2024-09-19T09:12:16.672 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2617_vm 2024-09-19T09:12:16.672 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 19 08:56 2618 2024-09-19T09:12:16.672 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2618_fsm 2024-09-19T09:12:16.672 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2618_vm 2024-09-19T09:12:16.672 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 19 08:56 2619 2024-09-19T09:12:16.672 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2619_fsm 2024-09-19T09:12:16.672 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2619_vm 2024-09-19T09:12:16.672 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2620 2024-09-19T09:12:16.673 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2650 2024-09-19T09:12:16.673 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2651 2024-09-19T09:12:16.673 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2652 2024-09-19T09:12:16.673 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 08:56 2653 2024-09-19T09:12:16.673 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 08:56 2654 2024-09-19T09:12:16.673 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2655 2024-09-19T09:12:16.673 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2656 2024-09-19T09:12:16.673 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2657 2024-09-19T09:12:16.673 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 19 08:56 2658 2024-09-19T09:12:16.673 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 19 08:56 2659 2024-09-19T09:12:16.673 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2660 2024-09-19T09:12:16.673 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2661 2024-09-19T09:12:16.673 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2662 2024-09-19T09:12:16.674 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 08:56 2663 2024-09-19T09:12:16.674 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2664 2024-09-19T09:12:16.674 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2665 2024-09-19T09:12:16.674 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2666 2024-09-19T09:12:16.674 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2667 2024-09-19T09:12:16.674 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2668 2024-09-19T09:12:16.674 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2669 2024-09-19T09:12:16.674 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2670 2024-09-19T09:12:16.674 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 19 08:56 2673 2024-09-19T09:12:16.674 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 19 08:56 2674 2024-09-19T09:12:16.674 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 19 08:56 2675 2024-09-19T09:12:16.674 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2678 2024-09-19T09:12:16.674 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2679 2024-09-19T09:12:16.674 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2680 2024-09-19T09:12:16.675 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2681 2024-09-19T09:12:16.675 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2682 2024-09-19T09:12:16.675 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2683 2024-09-19T09:12:16.675 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2684 2024-09-19T09:12:16.675 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2685 2024-09-19T09:12:16.675 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2686 2024-09-19T09:12:16.675 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2687 2024-09-19T09:12:16.675 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 08:56 2688 2024-09-19T09:12:16.675 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 08:56 2689 2024-09-19T09:12:16.675 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 19 08:56 2690 2024-09-19T09:12:16.675 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 19 08:56 2691 2024-09-19T09:12:16.675 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2692 2024-09-19T09:12:16.675 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2693 2024-09-19T09:12:16.675 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2696 2024-09-19T09:12:16.676 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2699 2024-09-19T09:12:16.676 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2701 2024-09-19T09:12:16.676 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2702 2024-09-19T09:12:16.676 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2703 2024-09-19T09:12:16.676 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 08:56 2704 2024-09-19T09:12:16.676 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2753 2024-09-19T09:12:16.676 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2753_fsm 2024-09-19T09:12:16.676 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2753_vm 2024-09-19T09:12:16.676 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2754 2024-09-19T09:12:16.676 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2755 2024-09-19T09:12:16.676 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2756 2024-09-19T09:12:16.676 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2757 2024-09-19T09:12:16.676 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2830 2024-09-19T09:12:16.677 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2831 2024-09-19T09:12:16.677 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2832 2024-09-19T09:12:16.677 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2833 2024-09-19T09:12:16.677 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2834 2024-09-19T09:12:16.677 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2835 2024-09-19T09:12:16.677 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2836 2024-09-19T09:12:16.677 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2837 2024-09-19T09:12:16.677 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 19 08:56 2838 2024-09-19T09:12:16.677 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2838_fsm 2024-09-19T09:12:16.677 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2838_vm 2024-09-19T09:12:16.677 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2839 2024-09-19T09:12:16.677 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2840 2024-09-19T09:12:16.678 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2840_fsm 2024-09-19T09:12:16.678 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2840_vm 2024-09-19T09:12:16.678 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2841 2024-09-19T09:12:16.678 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2995 2024-09-19T09:12:16.678 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2996 2024-09-19T09:12:16.678 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3079 2024-09-19T09:12:16.678 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3079_fsm 2024-09-19T09:12:16.678 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3079_vm 2024-09-19T09:12:16.678 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3080 2024-09-19T09:12:16.678 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3081 2024-09-19T09:12:16.678 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 08:56 3085 2024-09-19T09:12:16.678 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3118 2024-09-19T09:12:16.678 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3119 2024-09-19T09:12:16.678 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 19 08:56 3164 2024-09-19T09:12:16.679 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3256 2024-09-19T09:12:16.679 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3257 2024-09-19T09:12:16.679 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3258 2024-09-19T09:12:16.679 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3350 2024-09-19T09:12:16.679 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3351 2024-09-19T09:12:16.679 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3379 2024-09-19T09:12:16.679 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3380 2024-09-19T09:12:16.679 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3381 2024-09-19T09:12:16.679 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3394 2024-09-19T09:12:16.679 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3394_fsm 2024-09-19T09:12:16.679 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3394_vm 2024-09-19T09:12:16.679 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3395 2024-09-19T09:12:16.679 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3429 2024-09-19T09:12:16.680 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3430 2024-09-19T09:12:16.680 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3431 2024-09-19T09:12:16.680 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3433 2024-09-19T09:12:16.680 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3439 2024-09-19T09:12:16.680 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3440 2024-09-19T09:12:16.680 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 08:56 3455 2024-09-19T09:12:16.680 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 19 08:56 3456 2024-09-19T09:12:16.680 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3456_fsm 2024-09-19T09:12:16.680 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3456_vm 2024-09-19T09:12:16.680 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3466 2024-09-19T09:12:16.680 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3467 2024-09-19T09:12:16.680 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3468 2024-09-19T09:12:16.680 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3501 2024-09-19T09:12:16.681 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3502 2024-09-19T09:12:16.681 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3503 2024-09-19T09:12:16.681 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3534 2024-09-19T09:12:16.681 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3541 2024-09-19T09:12:16.681 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3541_fsm 2024-09-19T09:12:16.681 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3541_vm 2024-09-19T09:12:16.681 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3542 2024-09-19T09:12:16.681 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3574 2024-09-19T09:12:16.681 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3575 2024-09-19T09:12:16.681 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3576 2024-09-19T09:12:16.681 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3596 2024-09-19T09:12:16.681 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3597 2024-09-19T09:12:16.681 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3598 2024-09-19T09:12:16.681 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3599 2024-09-19T09:12:16.682 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3600 2024-09-19T09:12:16.682 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3600_fsm 2024-09-19T09:12:16.682 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3600_vm 2024-09-19T09:12:16.682 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3601 2024-09-19T09:12:16.682 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3601_fsm 2024-09-19T09:12:16.682 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3601_vm 2024-09-19T09:12:16.682 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3602 2024-09-19T09:12:16.682 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3602_fsm 2024-09-19T09:12:16.682 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3602_vm 2024-09-19T09:12:16.682 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3603 2024-09-19T09:12:16.682 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3603_fsm 2024-09-19T09:12:16.682 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3603_vm 2024-09-19T09:12:16.682 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3604 2024-09-19T09:12:16.683 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3605 2024-09-19T09:12:16.683 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3606 2024-09-19T09:12:16.683 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3607 2024-09-19T09:12:16.683 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3608 2024-09-19T09:12:16.683 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 3609 2024-09-19T09:12:16.683 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3712 2024-09-19T09:12:16.683 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3764 2024-09-19T09:12:16.683 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3764_fsm 2024-09-19T09:12:16.683 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3764_vm 2024-09-19T09:12:16.683 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3766 2024-09-19T09:12:16.683 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3767 2024-09-19T09:12:16.683 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3997 2024-09-19T09:12:16.683 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4143 2024-09-19T09:12:16.683 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4144 2024-09-19T09:12:16.684 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4145 2024-09-19T09:12:16.684 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4146 2024-09-19T09:12:16.684 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4147 2024-09-19T09:12:16.684 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4148 2024-09-19T09:12:16.684 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4149 2024-09-19T09:12:16.684 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4150 2024-09-19T09:12:16.684 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4151 2024-09-19T09:12:16.684 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4152 2024-09-19T09:12:16.684 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4153 2024-09-19T09:12:16.684 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4154 2024-09-19T09:12:16.684 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4155 2024-09-19T09:12:16.684 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4156 2024-09-19T09:12:16.684 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4157 2024-09-19T09:12:16.685 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4158 2024-09-19T09:12:16.685 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4159 2024-09-19T09:12:16.685 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4160 2024-09-19T09:12:16.685 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4161 2024-09-19T09:12:16.685 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4162 2024-09-19T09:12:16.685 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4163 2024-09-19T09:12:16.685 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4164 2024-09-19T09:12:16.685 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4165 2024-09-19T09:12:16.685 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4166 2024-09-19T09:12:16.685 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4167 2024-09-19T09:12:16.685 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4168 2024-09-19T09:12:16.685 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4169 2024-09-19T09:12:16.685 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4170 2024-09-19T09:12:16.686 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4171 2024-09-19T09:12:16.686 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4172 2024-09-19T09:12:16.686 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4173 2024-09-19T09:12:16.686 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4174 2024-09-19T09:12:16.686 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 5002 2024-09-19T09:12:16.686 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 548 2024-09-19T09:12:16.686 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 549 2024-09-19T09:12:16.686 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 6102 2024-09-19T09:12:16.686 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 6104 2024-09-19T09:12:16.686 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 6106 2024-09-19T09:12:16.686 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 6110 2024-09-19T09:12:16.686 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 6111 2024-09-19T09:12:16.686 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 6112 2024-09-19T09:12:16.686 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 6113 2024-09-19T09:12:16.687 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 6117 2024-09-19T09:12:16.687 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 826 2024-09-19T09:12:16.687 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 827 2024-09-19T09:12:16.687 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 828 2024-09-19T09:12:16.687 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 19 08:56 pg_filenode.map 2024-09-19T09:12:16.687 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 08:56 PG_VERSION 2024-09-19T09:12:16.687 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:12:16.687 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-09-19T09:12:16.687 INFO:teuthology.orchestra.run.smithi092.stdout:total 634286 2024-09-19T09:12:16.687 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 305 Sep 19 08:59 . 2024-09-19T09:12:16.687 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 19 08:56 .. 2024-09-19T09:12:16.687 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 112 2024-09-19T09:12:16.688 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 113 2024-09-19T09:12:16.688 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 19 08:56 1247 2024-09-19T09:12:16.688 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 1247_fsm 2024-09-19T09:12:16.688 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1247_vm 2024-09-19T09:12:16.688 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 19 08:56 1249 2024-09-19T09:12:16.688 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 1249_fsm 2024-09-19T09:12:16.688 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1249_vm 2024-09-19T09:12:16.688 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 19 08:56 1255 2024-09-19T09:12:16.688 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 1255_fsm 2024-09-19T09:12:16.688 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1255_vm 2024-09-19T09:12:16.688 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 19 09:12 1259 2024-09-19T09:12:16.688 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 1259_fsm 2024-09-19T09:12:16.688 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1259_vm 2024-09-19T09:12:16.688 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 19 08:56 13344 2024-09-19T09:12:16.689 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 13344_fsm 2024-09-19T09:12:16.689 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13344_vm 2024-09-19T09:12:16.689 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 13346 2024-09-19T09:12:16.689 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13348 2024-09-19T09:12:16.689 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13349 2024-09-19T09:12:16.689 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 13349_fsm 2024-09-19T09:12:16.689 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13349_vm 2024-09-19T09:12:16.689 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 13351 2024-09-19T09:12:16.689 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13353 2024-09-19T09:12:16.689 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13354 2024-09-19T09:12:16.689 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 13354_fsm 2024-09-19T09:12:16.689 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13354_vm 2024-09-19T09:12:16.690 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 13356 2024-09-19T09:12:16.690 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13358 2024-09-19T09:12:16.690 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13359 2024-09-19T09:12:16.690 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 13359_fsm 2024-09-19T09:12:16.690 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13359_vm 2024-09-19T09:12:16.690 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 13361 2024-09-19T09:12:16.690 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 13363 2024-09-19T09:12:16.690 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 1417 2024-09-19T09:12:16.690 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 1418 2024-09-19T09:12:16.690 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 447913984 Sep 19 09:12 16396 2024-09-19T09:12:16.690 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Sep 19 09:12 16396_fsm 2024-09-19T09:12:16.690 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:59 16396_vm 2024-09-19T09:12:16.690 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1146880 Sep 19 09:12 16397 2024-09-19T09:12:16.691 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 09:12 16397_fsm 2024-09-19T09:12:16.691 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 09:12 16397_vm 2024-09-19T09:12:16.691 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 2965504 Sep 19 09:12 16399 2024-09-19T09:12:16.691 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 09:12 16399_fsm 2024-09-19T09:12:16.691 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 09:12 16399_vm 2024-09-19T09:12:16.691 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 09:12 16400 2024-09-19T09:12:16.691 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 19 09:12 16402 2024-09-19T09:12:16.691 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 71901184 Sep 19 09:12 16404 2024-09-19T09:12:16.691 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 117055488 Sep 19 09:12 16406 2024-09-19T09:12:16.691 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 09:12 16406_fsm 2024-09-19T09:12:16.691 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 09:09 16406_vm 2024-09-19T09:12:16.691 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 174 2024-09-19T09:12:16.691 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 175 2024-09-19T09:12:16.691 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2187 2024-09-19T09:12:16.692 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2224 2024-09-19T09:12:16.692 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2328 2024-09-19T09:12:16.692 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2336 2024-09-19T09:12:16.692 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2337 2024-09-19T09:12:16.692 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2579 2024-09-19T09:12:16.692 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2600 2024-09-19T09:12:16.692 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2600_fsm 2024-09-19T09:12:16.692 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2600_vm 2024-09-19T09:12:16.692 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2601 2024-09-19T09:12:16.692 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2601_fsm 2024-09-19T09:12:16.692 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2601_vm 2024-09-19T09:12:16.692 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 08:56 2602 2024-09-19T09:12:16.692 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2602_fsm 2024-09-19T09:12:16.693 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2602_vm 2024-09-19T09:12:16.693 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2603 2024-09-19T09:12:16.693 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2603_fsm 2024-09-19T09:12:16.693 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2603_vm 2024-09-19T09:12:16.693 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2604 2024-09-19T09:12:16.693 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2605 2024-09-19T09:12:16.693 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2605_fsm 2024-09-19T09:12:16.693 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2605_vm 2024-09-19T09:12:16.693 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2606 2024-09-19T09:12:16.693 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2606_fsm 2024-09-19T09:12:16.693 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2606_vm 2024-09-19T09:12:16.693 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2607 2024-09-19T09:12:16.693 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2607_fsm 2024-09-19T09:12:16.693 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2607_vm 2024-09-19T09:12:16.694 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 19 08:56 2608 2024-09-19T09:12:16.694 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2608_fsm 2024-09-19T09:12:16.694 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2608_vm 2024-09-19T09:12:16.694 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 19 08:56 2609 2024-09-19T09:12:16.694 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2609_fsm 2024-09-19T09:12:16.694 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2609_vm 2024-09-19T09:12:16.694 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2610 2024-09-19T09:12:16.694 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2610_fsm 2024-09-19T09:12:16.694 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2610_vm 2024-09-19T09:12:16.694 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2611 2024-09-19T09:12:16.694 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2612 2024-09-19T09:12:16.694 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2612_fsm 2024-09-19T09:12:16.694 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2612_vm 2024-09-19T09:12:16.695 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2613 2024-09-19T09:12:16.695 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2615 2024-09-19T09:12:16.695 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2615_fsm 2024-09-19T09:12:16.695 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2615_vm 2024-09-19T09:12:16.695 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2616 2024-09-19T09:12:16.695 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2616_fsm 2024-09-19T09:12:16.695 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2616_vm 2024-09-19T09:12:16.695 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 19 08:56 2617 2024-09-19T09:12:16.695 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2617_fsm 2024-09-19T09:12:16.695 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2617_vm 2024-09-19T09:12:16.695 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 19 08:56 2618 2024-09-19T09:12:16.695 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2618_fsm 2024-09-19T09:12:16.696 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2618_vm 2024-09-19T09:12:16.696 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 163840 Sep 19 09:12 2619 2024-09-19T09:12:16.696 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:59 2619_fsm 2024-09-19T09:12:16.696 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2619_vm 2024-09-19T09:12:16.696 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2620 2024-09-19T09:12:16.696 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2650 2024-09-19T09:12:16.696 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2651 2024-09-19T09:12:16.696 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2652 2024-09-19T09:12:16.696 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 08:56 2653 2024-09-19T09:12:16.696 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 08:56 2654 2024-09-19T09:12:16.696 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2655 2024-09-19T09:12:16.696 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2656 2024-09-19T09:12:16.696 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2657 2024-09-19T09:12:16.697 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 19 08:56 2658 2024-09-19T09:12:16.697 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 19 08:56 2659 2024-09-19T09:12:16.697 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2660 2024-09-19T09:12:16.697 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2661 2024-09-19T09:12:16.697 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2662 2024-09-19T09:12:16.697 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 08:56 2663 2024-09-19T09:12:16.697 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2664 2024-09-19T09:12:16.697 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2665 2024-09-19T09:12:16.697 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2666 2024-09-19T09:12:16.697 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2667 2024-09-19T09:12:16.697 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2668 2024-09-19T09:12:16.697 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2669 2024-09-19T09:12:16.697 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2670 2024-09-19T09:12:16.698 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 19 08:56 2673 2024-09-19T09:12:16.698 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 19 08:56 2674 2024-09-19T09:12:16.698 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 19 08:56 2675 2024-09-19T09:12:16.698 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2678 2024-09-19T09:12:16.698 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2679 2024-09-19T09:12:16.698 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2680 2024-09-19T09:12:16.698 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2681 2024-09-19T09:12:16.698 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2682 2024-09-19T09:12:16.698 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2683 2024-09-19T09:12:16.698 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2684 2024-09-19T09:12:16.698 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2685 2024-09-19T09:12:16.698 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2686 2024-09-19T09:12:16.698 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2687 2024-09-19T09:12:16.698 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 08:56 2688 2024-09-19T09:12:16.699 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 08:56 2689 2024-09-19T09:12:16.699 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 19 08:56 2690 2024-09-19T09:12:16.699 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 19 08:56 2691 2024-09-19T09:12:16.699 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2692 2024-09-19T09:12:16.699 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2693 2024-09-19T09:12:16.699 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 09:01 2696 2024-09-19T09:12:16.699 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2699 2024-09-19T09:12:16.699 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2701 2024-09-19T09:12:16.699 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2702 2024-09-19T09:12:16.699 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2703 2024-09-19T09:12:16.699 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 08:56 2704 2024-09-19T09:12:16.699 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2753 2024-09-19T09:12:16.699 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2753_fsm 2024-09-19T09:12:16.699 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2753_vm 2024-09-19T09:12:16.700 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2754 2024-09-19T09:12:16.700 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2755 2024-09-19T09:12:16.700 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2756 2024-09-19T09:12:16.700 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 2757 2024-09-19T09:12:16.700 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2830 2024-09-19T09:12:16.700 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2831 2024-09-19T09:12:16.700 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2832 2024-09-19T09:12:16.700 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2833 2024-09-19T09:12:16.700 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2834 2024-09-19T09:12:16.700 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2835 2024-09-19T09:12:16.700 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2836 2024-09-19T09:12:16.700 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2837 2024-09-19T09:12:16.700 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 19 08:56 2838 2024-09-19T09:12:16.700 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2838_fsm 2024-09-19T09:12:16.701 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2838_vm 2024-09-19T09:12:16.701 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2839 2024-09-19T09:12:16.701 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2840 2024-09-19T09:12:16.701 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2840_fsm 2024-09-19T09:12:16.701 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2840_vm 2024-09-19T09:12:16.701 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2841 2024-09-19T09:12:16.701 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2995 2024-09-19T09:12:16.701 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2996 2024-09-19T09:12:16.701 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3079 2024-09-19T09:12:16.701 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3079_fsm 2024-09-19T09:12:16.701 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3079_vm 2024-09-19T09:12:16.701 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3080 2024-09-19T09:12:16.701 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3081 2024-09-19T09:12:16.701 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 08:56 3085 2024-09-19T09:12:16.702 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3118 2024-09-19T09:12:16.702 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3119 2024-09-19T09:12:16.702 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 19 08:56 3164 2024-09-19T09:12:16.702 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3256 2024-09-19T09:12:16.702 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3257 2024-09-19T09:12:16.702 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3258 2024-09-19T09:12:16.702 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3350 2024-09-19T09:12:16.702 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3351 2024-09-19T09:12:16.702 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3379 2024-09-19T09:12:16.702 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3380 2024-09-19T09:12:16.702 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3381 2024-09-19T09:12:16.702 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3394 2024-09-19T09:12:16.703 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3394_fsm 2024-09-19T09:12:16.703 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3394_vm 2024-09-19T09:12:16.703 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3395 2024-09-19T09:12:16.703 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3429 2024-09-19T09:12:16.703 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3430 2024-09-19T09:12:16.703 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3431 2024-09-19T09:12:16.703 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3433 2024-09-19T09:12:16.703 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3439 2024-09-19T09:12:16.703 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3440 2024-09-19T09:12:16.703 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 08:56 3455 2024-09-19T09:12:16.703 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 19 08:56 3456 2024-09-19T09:12:16.703 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3456_fsm 2024-09-19T09:12:16.703 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3456_vm 2024-09-19T09:12:16.703 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3466 2024-09-19T09:12:16.704 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3467 2024-09-19T09:12:16.704 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3468 2024-09-19T09:12:16.704 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3501 2024-09-19T09:12:16.704 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3502 2024-09-19T09:12:16.704 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3503 2024-09-19T09:12:16.704 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3534 2024-09-19T09:12:16.704 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3541 2024-09-19T09:12:16.704 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3541_fsm 2024-09-19T09:12:16.704 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3541_vm 2024-09-19T09:12:16.704 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3542 2024-09-19T09:12:16.704 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3574 2024-09-19T09:12:16.704 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3575 2024-09-19T09:12:16.704 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3576 2024-09-19T09:12:16.704 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3596 2024-09-19T09:12:16.705 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3597 2024-09-19T09:12:16.705 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3598 2024-09-19T09:12:16.705 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3599 2024-09-19T09:12:16.705 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3600 2024-09-19T09:12:16.705 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3600_fsm 2024-09-19T09:12:16.705 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3600_vm 2024-09-19T09:12:16.705 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3601 2024-09-19T09:12:16.705 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3601_fsm 2024-09-19T09:12:16.705 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3601_vm 2024-09-19T09:12:16.705 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3602 2024-09-19T09:12:16.705 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3602_fsm 2024-09-19T09:12:16.705 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3602_vm 2024-09-19T09:12:16.705 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3603 2024-09-19T09:12:16.706 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3603_fsm 2024-09-19T09:12:16.706 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3603_vm 2024-09-19T09:12:16.706 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3604 2024-09-19T09:12:16.706 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3605 2024-09-19T09:12:16.706 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3606 2024-09-19T09:12:16.706 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3607 2024-09-19T09:12:16.706 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3608 2024-09-19T09:12:16.706 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 08:56 3609 2024-09-19T09:12:16.706 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3712 2024-09-19T09:12:16.706 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3764 2024-09-19T09:12:16.706 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 3764_fsm 2024-09-19T09:12:16.706 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3764_vm 2024-09-19T09:12:16.706 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3766 2024-09-19T09:12:16.706 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 3767 2024-09-19T09:12:16.707 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3997 2024-09-19T09:12:16.707 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4143 2024-09-19T09:12:16.707 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4144 2024-09-19T09:12:16.707 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4145 2024-09-19T09:12:16.707 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4146 2024-09-19T09:12:16.707 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4147 2024-09-19T09:12:16.707 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4148 2024-09-19T09:12:16.707 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4149 2024-09-19T09:12:16.707 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4150 2024-09-19T09:12:16.707 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4151 2024-09-19T09:12:16.707 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4152 2024-09-19T09:12:16.707 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4153 2024-09-19T09:12:16.707 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4154 2024-09-19T09:12:16.708 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4155 2024-09-19T09:12:16.708 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4156 2024-09-19T09:12:16.708 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4157 2024-09-19T09:12:16.708 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4158 2024-09-19T09:12:16.708 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4159 2024-09-19T09:12:16.708 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4160 2024-09-19T09:12:16.708 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4161 2024-09-19T09:12:16.708 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4162 2024-09-19T09:12:16.708 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4163 2024-09-19T09:12:16.708 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4164 2024-09-19T09:12:16.708 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4165 2024-09-19T09:12:16.708 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4166 2024-09-19T09:12:16.708 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4167 2024-09-19T09:12:16.709 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4168 2024-09-19T09:12:16.709 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4169 2024-09-19T09:12:16.709 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4170 2024-09-19T09:12:16.709 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4171 2024-09-19T09:12:16.709 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4172 2024-09-19T09:12:16.709 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4173 2024-09-19T09:12:16.709 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4174 2024-09-19T09:12:16.709 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 5002 2024-09-19T09:12:16.709 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 548 2024-09-19T09:12:16.709 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 549 2024-09-19T09:12:16.709 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 6102 2024-09-19T09:12:16.709 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 6104 2024-09-19T09:12:16.709 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 6106 2024-09-19T09:12:16.710 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 6110 2024-09-19T09:12:16.710 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 6111 2024-09-19T09:12:16.710 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 6112 2024-09-19T09:12:16.710 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 6113 2024-09-19T09:12:16.710 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 6117 2024-09-19T09:12:16.710 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 826 2024-09-19T09:12:16.710 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 827 2024-09-19T09:12:16.710 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 828 2024-09-19T09:12:16.710 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 19 08:56 pg_filenode.map 2024-09-19T09:12:16.710 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 151596 Sep 19 08:56 pg_internal.init 2024-09-19T09:12:16.710 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 08:56 PG_VERSION 2024-09-19T09:12:16.710 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:12:16.710 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/base/pgsql_tmp: 2024-09-19T09:12:16.710 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-19T09:12:16.711 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 . 2024-09-19T09:12:16.711 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 19 08:56 .. 2024-09-19T09:12:16.711 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:12:16.711 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/global: 2024-09-19T09:12:16.711 INFO:teuthology.orchestra.run.smithi092.stdout:total 560 2024-09-19T09:12:16.711 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Sep 19 08:56 . 2024-09-19T09:12:16.711 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 09:12 .. 2024-09-19T09:12:16.711 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1213 2024-09-19T09:12:16.711 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 1213_fsm 2024-09-19T09:12:16.711 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1213_vm 2024-09-19T09:12:16.711 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1214 2024-09-19T09:12:16.711 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 1214_fsm 2024-09-19T09:12:16.711 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1214_vm 2024-09-19T09:12:16.712 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 1232 2024-09-19T09:12:16.712 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 1233 2024-09-19T09:12:16.712 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1260 2024-09-19T09:12:16.712 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 1260_fsm 2024-09-19T09:12:16.712 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1260_vm 2024-09-19T09:12:16.712 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1261 2024-09-19T09:12:16.712 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 1261_fsm 2024-09-19T09:12:16.712 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1261_vm 2024-09-19T09:12:16.712 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1262 2024-09-19T09:12:16.712 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 1262_fsm 2024-09-19T09:12:16.712 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 1262_vm 2024-09-19T09:12:16.712 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2396 2024-09-19T09:12:16.712 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 08:56 2396_fsm 2024-09-19T09:12:16.712 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2396_vm 2024-09-19T09:12:16.713 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2397 2024-09-19T09:12:16.713 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2671 2024-09-19T09:12:16.713 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2672 2024-09-19T09:12:16.713 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2676 2024-09-19T09:12:16.713 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2677 2024-09-19T09:12:16.713 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2694 2024-09-19T09:12:16.713 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2695 2024-09-19T09:12:16.713 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2697 2024-09-19T09:12:16.713 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 08:56 2698 2024-09-19T09:12:16.713 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2846 2024-09-19T09:12:16.713 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2847 2024-09-19T09:12:16.713 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2964 2024-09-19T09:12:16.713 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2965 2024-09-19T09:12:16.713 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 2966 2024-09-19T09:12:16.714 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 2967 2024-09-19T09:12:16.714 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 3592 2024-09-19T09:12:16.714 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 3593 2024-09-19T09:12:16.714 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4060 2024-09-19T09:12:16.714 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4061 2024-09-19T09:12:16.714 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4175 2024-09-19T09:12:16.714 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4176 2024-09-19T09:12:16.714 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4177 2024-09-19T09:12:16.714 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4178 2024-09-19T09:12:16.714 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4181 2024-09-19T09:12:16.714 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4182 2024-09-19T09:12:16.714 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4183 2024-09-19T09:12:16.714 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4184 2024-09-19T09:12:16.714 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 4185 2024-09-19T09:12:16.715 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 4186 2024-09-19T09:12:16.715 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 6000 2024-09-19T09:12:16.715 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 6001 2024-09-19T09:12:16.715 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 6002 2024-09-19T09:12:16.715 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 6100 2024-09-19T09:12:16.715 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 6114 2024-09-19T09:12:16.715 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 6115 2024-09-19T09:12:16.715 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 09:12 pg_control 2024-09-19T09:12:16.715 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 19 08:56 pg_filenode.map 2024-09-19T09:12:16.716 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 23144 Sep 19 08:56 pg_internal.init 2024-09-19T09:12:16.716 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:12:16.716 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/log: 2024-09-19T09:12:16.716 INFO:teuthology.orchestra.run.smithi092.stdout:total 2 2024-09-19T09:12:16.716 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 08:56 . 2024-09-19T09:12:16.716 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 09:12 .. 2024-09-19T09:12:16.716 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1594 Sep 19 09:12 postgresql-Thu.log 2024-09-19T09:12:16.716 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:12:16.716 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-09-19T09:12:16.716 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-19T09:12:16.716 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 . 2024-09-19T09:12:16.716 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 09:12 .. 2024-09-19T09:12:16.716 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:12:16.717 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-09-19T09:12:16.717 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-19T09:12:16.717 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 . 2024-09-19T09:12:16.717 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 09:12 .. 2024-09-19T09:12:16.717 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:12:16.717 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-09-19T09:12:16.717 INFO:teuthology.orchestra.run.smithi092.stdout:total 1 2024-09-19T09:12:16.717 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 09:12 . 2024-09-19T09:12:16.717 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 09:12 .. 2024-09-19T09:12:16.717 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 mappings 2024-09-19T09:12:16.717 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 19 09:12 replorigin_checkpoint 2024-09-19T09:12:16.717 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 snapshots 2024-09-19T09:12:16.717 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:12:16.718 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-09-19T09:12:16.718 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-19T09:12:16.718 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 . 2024-09-19T09:12:16.718 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 09:12 .. 2024-09-19T09:12:16.718 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:12:16.718 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-09-19T09:12:16.718 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-19T09:12:16.718 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 . 2024-09-19T09:12:16.718 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 09:12 .. 2024-09-19T09:12:16.718 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:12:16.718 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-09-19T09:12:16.718 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-19T09:12:16.718 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 19 08:56 . 2024-09-19T09:12:16.718 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 09:12 .. 2024-09-19T09:12:16.719 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 08:56 members 2024-09-19T09:12:16.719 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 08:56 offsets 2024-09-19T09:12:16.719 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:12:16.719 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-09-19T09:12:16.719 INFO:teuthology.orchestra.run.smithi092.stdout:total 8 2024-09-19T09:12:16.719 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 08:56 . 2024-09-19T09:12:16.719 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 19 08:56 .. 2024-09-19T09:12:16.719 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:56 0000 2024-09-19T09:12:16.719 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:12:16.719 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-09-19T09:12:16.719 INFO:teuthology.orchestra.run.smithi092.stdout:total 8 2024-09-19T09:12:16.719 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 08:56 . 2024-09-19T09:12:16.719 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 19 08:56 .. 2024-09-19T09:12:16.719 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 08:59 0000 2024-09-19T09:12:16.719 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:12:16.720 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-09-19T09:12:16.720 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-19T09:12:16.720 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 . 2024-09-19T09:12:16.720 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 09:12 .. 2024-09-19T09:12:16.720 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:12:16.720 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-09-19T09:12:16.720 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-19T09:12:16.720 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 . 2024-09-19T09:12:16.721 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 09:12 .. 2024-09-19T09:12:16.721 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:12:16.722 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-09-19T09:12:16.722 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-19T09:12:16.722 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 . 2024-09-19T09:12:16.722 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 09:12 .. 2024-09-19T09:12:16.722 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:12:16.722 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-09-19T09:12:16.722 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-19T09:12:16.722 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 . 2024-09-19T09:12:16.722 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 09:12 .. 2024-09-19T09:12:16.722 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:12:16.722 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-09-19T09:12:16.722 INFO:teuthology.orchestra.run.smithi092.stdout:total 15 2024-09-19T09:12:16.722 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 09:12 . 2024-09-19T09:12:16.723 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 09:12 .. 2024-09-19T09:12:16.723 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1952 Sep 19 09:12 db_0.stat 2024-09-19T09:12:16.723 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 10979 Sep 19 09:12 db_13494.stat 2024-09-19T09:12:16.723 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1151 Sep 19 09:12 global.stat 2024-09-19T09:12:16.723 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:12:16.723 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-09-19T09:12:16.723 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-19T09:12:16.723 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 09:12 . 2024-09-19T09:12:16.723 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 09:12 .. 2024-09-19T09:12:16.723 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:12:16.723 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-09-19T09:12:16.723 INFO:teuthology.orchestra.run.smithi092.stdout:total 224 2024-09-19T09:12:16.723 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 09:12 . 2024-09-19T09:12:16.724 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 09:12 .. 2024-09-19T09:12:16.724 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 229376 Sep 19 09:12 0021 2024-09-19T09:12:16.724 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:12:16.724 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-09-19T09:12:16.724 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-19T09:12:16.724 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 . 2024-09-19T09:12:16.724 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 09:12 .. 2024-09-19T09:12:16.724 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:12:16.724 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-09-19T09:12:16.724 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-19T09:12:16.724 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 . 2024-09-19T09:12:16.724 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 09:12 .. 2024-09-19T09:12:16.724 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:12:16.724 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-09-19T09:12:16.725 INFO:teuthology.orchestra.run.smithi092.stdout:total 1048576 2024-09-19T09:12:16.725 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 65 Sep 19 09:12 . 2024-09-19T09:12:16.725 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 09:12 .. 2024-09-19T09:12:16.725 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:12 0000000100000000000000C7 2024-09-19T09:12:16.725 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:05 0000000100000000000000C8 2024-09-19T09:12:16.725 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:05 0000000100000000000000C9 2024-09-19T09:12:16.725 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:06 0000000100000000000000CA 2024-09-19T09:12:16.725 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:08 0000000100000000000000CB 2024-09-19T09:12:16.725 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:05 0000000100000000000000CC 2024-09-19T09:12:16.725 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:05 0000000100000000000000CD 2024-09-19T09:12:16.725 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:05 0000000100000000000000CE 2024-09-19T09:12:16.725 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:07 0000000100000000000000CF 2024-09-19T09:12:16.725 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:08 0000000100000000000000D0 2024-09-19T09:12:16.726 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:08 0000000100000000000000D1 2024-09-19T09:12:16.726 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:05 0000000100000000000000D2 2024-09-19T09:12:16.726 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:07 0000000100000000000000D3 2024-09-19T09:12:16.726 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:05 0000000100000000000000D4 2024-09-19T09:12:16.726 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:07 0000000100000000000000D5 2024-09-19T09:12:16.726 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:06 0000000100000000000000D6 2024-09-19T09:12:16.726 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:07 0000000100000000000000D7 2024-09-19T09:12:16.726 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:05 0000000100000000000000D8 2024-09-19T09:12:16.726 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:08 0000000100000000000000D9 2024-09-19T09:12:16.726 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:05 0000000100000000000000DA 2024-09-19T09:12:16.726 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:05 0000000100000000000000DB 2024-09-19T09:12:16.726 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:05 0000000100000000000000DC 2024-09-19T09:12:16.726 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:05 0000000100000000000000DD 2024-09-19T09:12:16.726 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:05 0000000100000000000000DE 2024-09-19T09:12:16.727 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:09 0000000100000000000000DF 2024-09-19T09:12:16.727 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:07 0000000100000000000000E0 2024-09-19T09:12:16.727 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:05 0000000100000000000000E1 2024-09-19T09:12:16.727 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:07 0000000100000000000000E2 2024-09-19T09:12:16.727 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:08 0000000100000000000000E3 2024-09-19T09:12:16.727 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:05 0000000100000000000000E4 2024-09-19T09:12:16.727 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:05 0000000100000000000000E5 2024-09-19T09:12:16.727 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:05 0000000100000000000000E6 2024-09-19T09:12:16.727 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:05 0000000100000000000000E7 2024-09-19T09:12:16.727 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:09 0000000100000000000000E8 2024-09-19T09:12:16.727 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:11 0000000100000000000000E9 2024-09-19T09:12:16.727 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:10 0000000100000000000000EA 2024-09-19T09:12:16.727 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:10 0000000100000000000000EB 2024-09-19T09:12:16.728 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:10 0000000100000000000000EC 2024-09-19T09:12:16.728 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:10 0000000100000000000000ED 2024-09-19T09:12:16.728 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:10 0000000100000000000000EE 2024-09-19T09:12:16.728 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:10 0000000100000000000000EF 2024-09-19T09:12:16.728 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:10 0000000100000000000000F0 2024-09-19T09:12:16.728 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:10 0000000100000000000000F1 2024-09-19T09:12:16.728 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:10 0000000100000000000000F2 2024-09-19T09:12:16.728 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:10 0000000100000000000000F3 2024-09-19T09:12:16.728 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:10 0000000100000000000000F4 2024-09-19T09:12:16.728 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:10 0000000100000000000000F5 2024-09-19T09:12:16.728 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:10 0000000100000000000000F6 2024-09-19T09:12:16.728 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:10 0000000100000000000000F7 2024-09-19T09:12:16.728 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:10 0000000100000000000000F8 2024-09-19T09:12:16.729 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:10 0000000100000000000000F9 2024-09-19T09:12:16.729 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:11 0000000100000000000000FA 2024-09-19T09:12:16.729 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:10 0000000100000000000000FB 2024-09-19T09:12:16.729 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:10 0000000100000000000000FC 2024-09-19T09:12:16.729 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:10 0000000100000000000000FD 2024-09-19T09:12:16.729 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:10 0000000100000000000000FE 2024-09-19T09:12:16.729 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:10 0000000100000000000000FF 2024-09-19T09:12:16.729 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:09 000000010000000100000000 2024-09-19T09:12:16.729 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:10 000000010000000100000001 2024-09-19T09:12:16.729 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:10 000000010000000100000002 2024-09-19T09:12:16.729 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:10 000000010000000100000003 2024-09-19T09:12:16.729 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:10 000000010000000100000004 2024-09-19T09:12:16.729 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:10 000000010000000100000005 2024-09-19T09:12:16.729 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 09:10 000000010000000100000006 2024-09-19T09:12:16.730 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 archive_status 2024-09-19T09:12:16.730 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:12:16.730 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-09-19T09:12:16.730 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-19T09:12:16.730 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 08:56 . 2024-09-19T09:12:16.730 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 65 Sep 19 09:12 .. 2024-09-19T09:12:16.730 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:12:16.730 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-09-19T09:12:16.730 INFO:teuthology.orchestra.run.smithi092.stdout:total 544 2024-09-19T09:12:16.730 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 09:12 . 2024-09-19T09:12:16.730 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 09:12 .. 2024-09-19T09:12:16.730 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 262144 Sep 19 09:02 0000 2024-09-19T09:12:16.730 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 262144 Sep 19 09:12 0001 2024-09-19T09:12:16.731 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 09:12 0002 2024-09-19T09:12:16.731 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-19T09:12:16.744 INFO:tasks.quiescer:joining Quiescers 2024-09-19T09:12:16.745 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-19T09:12:16.745 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:12:16.991 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:12:17.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:16 smithi092 ceph-mon[31407]: pgmap v804: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 20 MiB/s wr, 1.25k op/s 2024-09-19T09:12:17.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:16 smithi167 ceph-mon[35359]: pgmap v804: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 20 MiB/s wr, 1.25k op/s 2024-09-19T09:12:17.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:16 smithi190 ceph-mon[35358]: pgmap v804: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 20 MiB/s wr, 1.25k op/s 2024-09-19T09:12:17.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.427+0000 7f619d58d640 1 -- 172.21.15.92:0/548275662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6198102ef0 msgr2=0x7f619810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:17.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.427+0000 7f619d58d640 1 --2- 172.21.15.92:0/548275662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6198102ef0 0x7f619810da40 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f6190009900 tx=0x7f619002a480 comp rx=0 tx=0).stop 2024-09-19T09:12:17.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.427+0000 7f619d58d640 1 -- 172.21.15.92:0/548275662 shutdown_connections 2024-09-19T09:12:17.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.427+0000 7f619d58d640 1 --2- 172.21.15.92:0/548275662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6198102ef0 0x7f619810da40 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:17.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.427+0000 7f619d58d640 1 --2- 172.21.15.92:0/548275662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6198102570 0x7f61981029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:17.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.427+0000 7f619d58d640 1 --2- 172.21.15.92:0/548275662 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6198100e20 0x7f6198101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:17.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.427+0000 7f619d58d640 1 -- 172.21.15.92:0/548275662 >> 172.21.15.92:0/548275662 conn(0x7f61980fc7d0 msgr2=0x7f61980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:17.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.427+0000 7f619d58d640 1 -- 172.21.15.92:0/548275662 shutdown_connections 2024-09-19T09:12:17.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.427+0000 7f619d58d640 1 -- 172.21.15.92:0/548275662 wait complete. 2024-09-19T09:12:17.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.427+0000 7f619d58d640 1 Processor -- start 2024-09-19T09:12:17.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.427+0000 7f619d58d640 1 -- start start 2024-09-19T09:12:17.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.428+0000 7f619d58d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6198100e20 0x7f6198198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:17.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.428+0000 7f619d58d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6198102570 0x7f61981989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:17.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.428+0000 7f619d58d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6198102ef0 0x7f619819cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:17.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.428+0000 7f619d58d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6198110fd0 con 0x7f6198102570 2024-09-19T09:12:17.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.428+0000 7f619d58d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6198110e50 con 0x7f6198100e20 2024-09-19T09:12:17.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.428+0000 7f619d58d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6198111150 con 0x7f6198102ef0 2024-09-19T09:12:17.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.428+0000 7f61967fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6198102570 0x7f61981989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:17.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.428+0000 7f61967fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6198102570 0x7f61981989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45402/0 (socket says 172.21.15.92:45402) 2024-09-19T09:12:17.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.428+0000 7f61967fc640 1 -- 172.21.15.92:0/3658395601 learned_addr learned my addr 172.21.15.92:0/3658395601 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:17.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.428+0000 7f6196ffd640 1 --2- 172.21.15.92:0/3658395601 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6198100e20 0x7f6198198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:17.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.428+0000 7f61977fe640 1 --2- 172.21.15.92:0/3658395601 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6198102ef0 0x7f619819cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:17.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.428+0000 7f61967fc640 1 -- 172.21.15.92:0/3658395601 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6198102ef0 msgr2=0x7f619819cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:17.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.428+0000 7f61967fc640 1 --2- 172.21.15.92:0/3658395601 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6198102ef0 0x7f619819cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:17.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.428+0000 7f61967fc640 1 -- 172.21.15.92:0/3658395601 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6198100e20 msgr2=0x7f6198198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:17.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.428+0000 7f61967fc640 1 --2- 172.21.15.92:0/3658395601 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6198100e20 0x7f6198198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:17.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.428+0000 7f61967fc640 1 -- 172.21.15.92:0/3658395601 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f619819d410 con 0x7f6198102570 2024-09-19T09:12:17.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.428+0000 7f6196ffd640 1 --2- 172.21.15.92:0/3658395601 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6198100e20 0x7f6198198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:12:17.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.428+0000 7f61967fc640 1 --2- 172.21.15.92:0/3658395601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6198102570 0x7f61981989a0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f618000d950 tx=0x7f618000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:17.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.428+0000 7f618ffff640 1 -- 172.21.15.92:0/3658395601 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6180017070 con 0x7f6198102570 2024-09-19T09:12:17.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.428+0000 7f619d58d640 1 -- 172.21.15.92:0/3658395601 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f619819d700 con 0x7f6198102570 2024-09-19T09:12:17.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.429+0000 7f618ffff640 1 -- 172.21.15.92:0/3658395601 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6180009c30 con 0x7f6198102570 2024-09-19T09:12:17.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.429+0000 7f619d58d640 1 -- 172.21.15.92:0/3658395601 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61981a4fe0 con 0x7f6198102570 2024-09-19T09:12:17.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.429+0000 7f618ffff640 1 -- 172.21.15.92:0/3658395601 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618000f6b0 con 0x7f6198102570 2024-09-19T09:12:17.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.430+0000 7f619d58d640 1 -- 172.21.15.92:0/3658395601 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6198101200 con 0x7f6198102570 2024-09-19T09:12:17.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.432+0000 7f618ffff640 1 -- 172.21.15.92:0/3658395601 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f61800109d0 con 0x7f6198102570 2024-09-19T09:12:17.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.432+0000 7f618ffff640 1 --2- 172.21.15.92:0/3658395601 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f61840a32c0 0x7f61840a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:17.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.432+0000 7f6196ffd640 1 --2- 172.21.15.92:0/3658395601 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f61840a32c0 0x7f61840a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:17.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.432+0000 7f618ffff640 1 -- 172.21.15.92:0/3658395601 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f61800cf950 con 0x7f6198102570 2024-09-19T09:12:17.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.433+0000 7f6196ffd640 1 --2- 172.21.15.92:0/3658395601 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f61840a32c0 0x7f61840a5780 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f6188005c40 tx=0x7f618800a430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:17.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.436+0000 7f618ffff640 1 -- 172.21.15.92:0/3658395601 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6180009de0 con 0x7f6198102570 2024-09-19T09:12:17.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.640+0000 7f619d58d640 1 -- 172.21.15.92:0/3658395601 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f619810a0a0 con 0x7f6198102570 2024-09-19T09:12:17.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.640+0000 7f618ffff640 1 -- 172.21.15.92:0/3658395601 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f618009c6f0 con 0x7f6198102570 2024-09-19T09:12:17.642 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:12:17.642 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:12:17.642 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:12:17.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.642+0000 7f619d58d640 1 -- 172.21.15.92:0/3658395601 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f61840a32c0 msgr2=0x7f61840a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:17.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.642+0000 7f619d58d640 1 --2- 172.21.15.92:0/3658395601 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f61840a32c0 0x7f61840a5780 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f6188005c40 tx=0x7f618800a430 comp rx=0 tx=0).stop 2024-09-19T09:12:17.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.642+0000 7f619d58d640 1 -- 172.21.15.92:0/3658395601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6198102570 msgr2=0x7f61981989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:17.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.642+0000 7f619d58d640 1 --2- 172.21.15.92:0/3658395601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6198102570 0x7f61981989a0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f618000d950 tx=0x7f618000de10 comp rx=0 tx=0).stop 2024-09-19T09:12:17.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.642+0000 7f619d58d640 1 -- 172.21.15.92:0/3658395601 shutdown_connections 2024-09-19T09:12:17.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.642+0000 7f619d58d640 1 --2- 172.21.15.92:0/3658395601 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6198102ef0 0x7f619819cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:17.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.642+0000 7f619d58d640 1 --2- 172.21.15.92:0/3658395601 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f61840a32c0 0x7f61840a5780 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:17.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.642+0000 7f619d58d640 1 --2- 172.21.15.92:0/3658395601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6198102570 0x7f61981989a0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:17.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.643+0000 7f619d58d640 1 --2- 172.21.15.92:0/3658395601 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6198100e20 0x7f6198198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:17.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.643+0000 7f619d58d640 1 -- 172.21.15.92:0/3658395601 >> 172.21.15.92:0/3658395601 conn(0x7f61980fc7d0 msgr2=0x7f619806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:17.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.643+0000 7f619d58d640 1 -- 172.21.15.92:0/3658395601 shutdown_connections 2024-09-19T09:12:17.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:17.643+0000 7f619d58d640 1 -- 172.21.15.92:0/3658395601 wait complete. 2024-09-19T09:12:18.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:17 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3658395601' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:12:18.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:17 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3658395601' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:12:18.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:17 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3658395601' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:12:18.220 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --cancel --all' 2024-09-19T09:12:18.221 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --cancel --all 2024-09-19T09:12:18.466 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:12:18.905 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:18 smithi092 ceph-mon[31407]: pgmap v805: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 21 MiB/s wr, 1.35k op/s 2024-09-19T09:12:19.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.989+0000 7f8e3a3d9640 1 -- 172.21.15.92:0/438456962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e34101e20 msgr2=0x7f8e341056b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:19.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.989+0000 7f8e3a3d9640 1 --2- 172.21.15.92:0/438456962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e34101e20 0x7f8e341056b0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c009900 tx=0x7f8e1c02a410 comp rx=0 tx=0).stop 2024-09-19T09:12:19.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.989+0000 7f8e3a3d9640 1 -- 172.21.15.92:0/438456962 shutdown_connections 2024-09-19T09:12:19.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.989+0000 7f8e3a3d9640 1 --2- 172.21.15.92:0/438456962 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e34105de0 0x7f8e3410d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:19.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.989+0000 7f8e3a3d9640 1 --2- 172.21.15.92:0/438456962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e34101e20 0x7f8e341056b0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:19.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.989+0000 7f8e3a3d9640 1 --2- 172.21.15.92:0/438456962 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e34101470 0x7f8e34101850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:19.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.989+0000 7f8e3a3d9640 1 -- 172.21.15.92:0/438456962 >> 172.21.15.92:0/438456962 conn(0x7f8e34077230 msgr2=0x7f8e340fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:19.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.989+0000 7f8e3a3d9640 1 -- 172.21.15.92:0/438456962 shutdown_connections 2024-09-19T09:12:19.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.989+0000 7f8e3a3d9640 1 -- 172.21.15.92:0/438456962 wait complete. 2024-09-19T09:12:19.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.989+0000 7f8e3a3d9640 1 Processor -- start 2024-09-19T09:12:19.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.989+0000 7f8e3a3d9640 1 -- start start 2024-09-19T09:12:19.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.989+0000 7f8e3a3d9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e34101470 0x7f8e34197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:19.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.989+0000 7f8e3a3d9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e34101e20 0x7f8e341975a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:19.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.989+0000 7f8e3a3d9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e34105de0 0x7f8e34197ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:19.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.989+0000 7f8e3a3d9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8e34110e60 con 0x7f8e34101470 2024-09-19T09:12:19.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.989+0000 7f8e3a3d9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8e34110ce0 con 0x7f8e34105de0 2024-09-19T09:12:19.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.989+0000 7f8e3a3d9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8e34110fe0 con 0x7f8e34101e20 2024-09-19T09:12:19.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.990+0000 7f8e33fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e34101470 0x7f8e34197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:19.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.990+0000 7f8e33fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e34101470 0x7f8e34197060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45414/0 (socket says 172.21.15.92:45414) 2024-09-19T09:12:19.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.990+0000 7f8e33fff640 1 -- 172.21.15.92:0/992547470 learned_addr learned my addr 172.21.15.92:0/992547470 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:19.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.990+0000 7f8e38976640 1 --2- 172.21.15.92:0/992547470 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e34105de0 0x7f8e34197ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:19.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.990+0000 7f8e2bfff640 1 --2- 172.21.15.92:0/992547470 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e34101e20 0x7f8e341975a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:19.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.990+0000 7f8e33fff640 1 -- 172.21.15.92:0/992547470 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e34101e20 msgr2=0x7f8e341975a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:19.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.990+0000 7f8e33fff640 1 --2- 172.21.15.92:0/992547470 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e34101e20 0x7f8e341975a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:19.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.990+0000 7f8e33fff640 1 -- 172.21.15.92:0/992547470 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e34105de0 msgr2=0x7f8e34197ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:19.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.990+0000 7f8e33fff640 1 --2- 172.21.15.92:0/992547470 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e34105de0 0x7f8e34197ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:19.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.990+0000 7f8e33fff640 1 -- 172.21.15.92:0/992547470 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e341a68d0 con 0x7f8e34101470 2024-09-19T09:12:19.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.990+0000 7f8e2bfff640 1 --2- 172.21.15.92:0/992547470 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e34101e20 0x7f8e341975a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:12:19.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.990+0000 7f8e33fff640 1 --2- 172.21.15.92:0/992547470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e34101470 0x7f8e34197060 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f8e2400c920 tx=0x7f8e2400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:19.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.990+0000 7f8e31ffb640 1 -- 172.21.15.92:0/992547470 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e24007c70 con 0x7f8e34101470 2024-09-19T09:12:19.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.990+0000 7f8e31ffb640 1 -- 172.21.15.92:0/992547470 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e24007e10 con 0x7f8e34101470 2024-09-19T09:12:19.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.990+0000 7f8e3a3d9640 1 -- 172.21.15.92:0/992547470 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e341a6bc0 con 0x7f8e34101470 2024-09-19T09:12:19.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.990+0000 7f8e31ffb640 1 -- 172.21.15.92:0/992547470 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e24018890 con 0x7f8e34101470 2024-09-19T09:12:19.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.990+0000 7f8e3a3d9640 1 -- 172.21.15.92:0/992547470 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e341a7150 con 0x7f8e34101470 2024-09-19T09:12:19.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.992+0000 7f8e31ffb640 1 -- 172.21.15.92:0/992547470 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8e24018a70 con 0x7f8e34101470 2024-09-19T09:12:19.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.993+0000 7f8e3c7b2740 1 Processor -- start 2024-09-19T09:12:19.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.993+0000 7f8e3c7b2740 1 -- start start 2024-09-19T09:12:19.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.993+0000 7f8e3c7b2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563207561a00 0x563207561de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:19.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.993+0000 7f8e3c7b2740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563207562320 0x56320756c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:19.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.993+0000 7f8e31ffb640 1 --2- 172.21.15.92:0/992547470 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8e200a32c0 0x7f8e200a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:19.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.993+0000 7f8e3c7b2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56320756cbe0 0x56320756efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:19.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.993+0000 7f8e3c7b2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5632074c6200 con 0x56320756cbe0 2024-09-19T09:12:19.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.993+0000 7f8e3c7b2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56320746cdc0 con 0x563207561a00 2024-09-19T09:12:19.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.993+0000 7f8e3c7b2740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5632074c21c0 con 0x563207562320 2024-09-19T09:12:19.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.993+0000 7f8e38976640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56320756cbe0 0x56320756efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:19.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.993+0000 7f8e33fff640 1 --2- 172.21.15.92:0/992547470 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8e200a32c0 0x7f8e200a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:19.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.993+0000 7f8e38976640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56320756cbe0 0x56320756efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45430/0 (socket says 172.21.15.92:45430) 2024-09-19T09:12:19.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.993+0000 7f8e38976640 1 -- 172.21.15.92:0/3299476543 learned_addr learned my addr 172.21.15.92:0/3299476543 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:19.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.993+0000 7f8e31ffb640 1 -- 172.21.15.92:0/992547470 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8e240cfab0 con 0x7f8e34101470 2024-09-19T09:12:19.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.993+0000 7f8e2bfff640 1 --2- 172.21.15.92:0/3299476543 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563207562320 0x56320756c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:19.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.993+0000 7f8e38976640 1 --2- 172.21.15.92:0/3299476543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563207561a00 0x563207561de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:19.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.994+0000 7f8e38976640 1 -- 172.21.15.92:0/3299476543 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563207562320 msgr2=0x56320756c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:19.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.994+0000 7f8e38976640 1 --2- 172.21.15.92:0/3299476543 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563207562320 0x56320756c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:19.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.994+0000 7f8e38976640 1 -- 172.21.15.92:0/3299476543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563207561a00 msgr2=0x563207561de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:19.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.994+0000 7f8e38976640 1 --2- 172.21.15.92:0/3299476543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563207561a00 0x563207561de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:19.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.994+0000 7f8e38976640 1 -- 172.21.15.92:0/3299476543 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563207237620 con 0x56320756cbe0 2024-09-19T09:12:19.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.994+0000 7f8e33fff640 1 --2- 172.21.15.92:0/992547470 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8e200a32c0 0x7f8e200a5780 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f8e24098a60 tx=0x7f8e24091570 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:19.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.994+0000 7f8e38976640 1 --2- 172.21.15.92:0/3299476543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56320756cbe0 0x56320756efd0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c00ace0 tx=0x7f8e2c0097c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06601439025a053 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:19.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.994+0000 7f8e2a7fc640 1 -- 172.21.15.92:0/3299476543 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c013040 con 0x56320756cbe0 2024-09-19T09:12:19.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.994+0000 7f8e2a7fc640 1 -- 172.21.15.92:0/3299476543 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e2c01a430 con 0x56320756cbe0 2024-09-19T09:12:19.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.994+0000 7f8e2a7fc640 1 -- 172.21.15.92:0/3299476543 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c019640 con 0x56320756cbe0 2024-09-19T09:12:19.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.995+0000 7f8e3c7b2740 1 -- 172.21.15.92:0/3299476543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56320756cbe0 msgr2=0x56320756efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:19.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.995+0000 7f8e3c7b2740 1 --2- 172.21.15.92:0/3299476543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56320756cbe0 0x56320756efd0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c00ace0 tx=0x7f8e2c0097c0 comp rx=0 tx=0).stop 2024-09-19T09:12:19.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.995+0000 7f8e3c7b2740 1 -- 172.21.15.92:0/3299476543 shutdown_connections 2024-09-19T09:12:19.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.995+0000 7f8e3c7b2740 1 --2- 172.21.15.92:0/3299476543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56320756cbe0 0x56320756efd0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:19.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.995+0000 7f8e3c7b2740 1 --2- 172.21.15.92:0/3299476543 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563207562320 0x56320756c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:19.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.995+0000 7f8e3c7b2740 1 --2- 172.21.15.92:0/3299476543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563207561a00 0x563207561de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:19.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.995+0000 7f8e3c7b2740 1 -- 172.21.15.92:0/3299476543 >> 172.21.15.92:0/3299476543 conn(0x56320755df90 msgr2=0x56320755e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:19.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.995+0000 7f8e3c7b2740 1 -- 172.21.15.92:0/3299476543 shutdown_connections 2024-09-19T09:12:19.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.995+0000 7f8e3c7b2740 1 -- 172.21.15.92:0/3299476543 wait complete. 2024-09-19T09:12:19.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.995+0000 7f8e3c7b2740 1 -- start start 2024-09-19T09:12:19.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.995+0000 7f8e3c7b2740 1 Processor -- start 2024-09-19T09:12:19.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.995+0000 7f8e3c7b2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563207561a00 0x56320756c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:19.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.995+0000 7f8e3c7b2740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563207562320 0x5632075697d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:19.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.995+0000 7f8e3c7b2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56320756cbe0 0x563207569d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:19.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.995+0000 7f8e3c7b2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56320756f7b0 con 0x563207561a00 2024-09-19T09:12:19.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.995+0000 7f8e3c7b2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563207460c50 con 0x56320756cbe0 2024-09-19T09:12:19.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.995+0000 7f8e3c7b2740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56320756f930 con 0x563207562320 2024-09-19T09:12:19.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.996+0000 7f8e3c7b2740 10 client.0 _ll_register_callbacks cb 0x563207472ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:12:19.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.996+0000 7f8e38976640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563207561a00 0x56320756c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:19.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.996+0000 7f8e38976640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563207561a00 0x56320756c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45438/0 (socket says 172.21.15.92:45438) 2024-09-19T09:12:19.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.996+0000 7f8e38976640 1 -- 172.21.15.92:0/2226534377 learned_addr learned my addr 172.21.15.92:0/2226534377 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:19.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.996+0000 7f8e38976640 1 -- 172.21.15.92:0/2226534377 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563207562320 msgr2=0x5632075697d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:19.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.996+0000 7f8e2bfff640 1 --2- 172.21.15.92:0/2226534377 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563207562320 0x5632075697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:19.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.996+0000 7f8e38976640 1 --2- 172.21.15.92:0/2226534377 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563207562320 0x5632075697d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:19.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.996+0000 7f8e38976640 1 -- 172.21.15.92:0/2226534377 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56320756cbe0 msgr2=0x563207569d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:19.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.996+0000 7f8e38976640 1 --2- 172.21.15.92:0/2226534377 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56320756cbe0 0x563207569d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:19.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.996+0000 7f8e38976640 1 -- 172.21.15.92:0/2226534377 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56320756a540 con 0x563207561a00 2024-09-19T09:12:19.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.996+0000 7f8e38976640 1 --2- 172.21.15.92:0/2226534377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563207561a00 0x56320756c520 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c004a80 tx=0x7f8e2c00a400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe3e84717c193c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:19.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.996+0000 7f8e137fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:12:19.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.996+0000 7f8e137fe640 1 -- 172.21.15.92:0/2226534377 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c027020 con 0x563207561a00 2024-09-19T09:12:19.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.996+0000 7f8e137fe640 1 -- 172.21.15.92:0/2226534377 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8e2c012040 con 0x563207561a00 2024-09-19T09:12:19.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.996+0000 7f8e3c7b2740 1 -- 172.21.15.92:0/2226534377 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e2c01a430 con 0x563207561a00 2024-09-19T09:12:19.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.996+0000 7f8e137fe640 1 -- 172.21.15.92:0/2226534377 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8e2c01a7f0 con 0x563207561a00 2024-09-19T09:12:19.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.996+0000 7f8e3c7b2740 10 client.19098 fetch_fsmap learned FSMap version 19 2024-09-19T09:12:19.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.996+0000 7f8e3c7b2740 1 -- 172.21.15.92:0/2226534377 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56320757b360 con 0x563207561a00 2024-09-19T09:12:19.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.997+0000 7f8e137fe640 1 -- 172.21.15.92:0/2226534377 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e2c01a430 con 0x563207561a00 2024-09-19T09:12:19.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.997+0000 7f8e137fe640 1 -- 172.21.15.92:0/2226534377 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f8e2c023a20 con 0x563207561a00 2024-09-19T09:12:19.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.997+0000 7f8e3c7b2740 10 client.19098 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:12:19.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.997+0000 7f8e3c7b2740 10 client.19098 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:12:19.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.997+0000 7f8e3c7b2740 20 client.19098 populate_metadata read hostname 'smithi092' 2024-09-19T09:12:19.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.997+0000 7f8e3c7b2740 1 --2- 172.21.15.92:0/2226534377 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56320757ca30 0x56320757ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:19.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.997+0000 7f8e3c7b2740 4 client.19098 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:12:19.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.997+0000 7f8e3c7b2740 1 -- 172.21.15.92:0/2226534377 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5632074d3770 con 0x56320757ca30 2024-09-19T09:12:19.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.997+0000 7f8e2bfff640 1 --2- 172.21.15.92:0/2226534377 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56320757ca30 0x56320757ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:19.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.998+0000 7f8e2bfff640 1 --2- 172.21.15.92:0/2226534377 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56320757ca30 0x56320757ee20 crc :-1 s=READY pgs=464 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2ddebd2a3d59699 server_cookie=1834ae8c748cb498 in_seq=0 out_seq=0 2024-09-19T09:12:19.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.998+0000 7f8e137fe640 10 client.19098 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:12:19.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.998+0000 7f8e137fe640 1 -- 172.21.15.92:0/2226534377 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5632074d3770 con 0x56320757ca30 2024-09-19T09:12:19.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.998+0000 7f8e137fe640 10 client.19098 handle_command_reply: tid=0 2024-09-19T09:12:19.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.998+0000 7f8e3c7b2740 1 client.19098 shutdown 2024-09-19T09:12:19.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.999+0000 7f8e3c7b2740 1 -- 172.21.15.92:0/2226534377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563207561a00 msgr2=0x56320756c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:19.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.999+0000 7f8e3c7b2740 1 --2- 172.21.15.92:0/2226534377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563207561a00 0x56320756c520 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c004a80 tx=0x7f8e2c00a400 comp rx=0 tx=0).stop 2024-09-19T09:12:19.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.999+0000 7f8e3c7b2740 1 -- 172.21.15.92:0/2226534377 shutdown_connections 2024-09-19T09:12:19.014 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.999+0000 7f8e3c7b2740 1 --2- 172.21.15.92:0/2226534377 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x56320757ca30 0x56320757ee20 crc :-1 s=READY pgs=464 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:19.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.999+0000 7f8e3c7b2740 1 --2- 172.21.15.92:0/2226534377 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56320756cbe0 0x563207569d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:19.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.999+0000 7f8e3c7b2740 1 --2- 172.21.15.92:0/2226534377 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563207562320 0x5632075697d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:19.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.999+0000 7f8e3c7b2740 1 --2- 172.21.15.92:0/2226534377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563207561a00 0x56320756c520 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:19.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.999+0000 7f8e137fe640 0 client.19098 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:12:19.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.999+0000 7f8e3c7b2740 1 -- 172.21.15.92:0/2226534377 >> 172.21.15.92:0/2226534377 conn(0x56320755df90 msgr2=0x56320755d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:19.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.999+0000 7f8e3c7b2740 1 -- 172.21.15.92:0/2226534377 shutdown_connections 2024-09-19T09:12:19.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.999+0000 7f8e3c7b2740 1 -- 172.21.15.92:0/2226534377 wait complete. 2024-09-19T09:12:19.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:18.999+0000 7f8e3c7b2740 20 client.19098 trim_cache size 0 max 16384 2024-09-19T09:12:19.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.015+0000 7f8e3c7b2740 1 Processor -- start 2024-09-19T09:12:19.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.015+0000 7f8e3c7b2740 1 -- start start 2024-09-19T09:12:19.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.016+0000 7f8e3c7b2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563207561a00 0x563207578bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:19.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.016+0000 7f8e3c7b2740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563207562320 0x563207564d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:19.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.016+0000 7f8e3c7b2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56320756cbe0 0x563207581880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:19.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.016+0000 7f8e3c7b2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8e341ad830 con 0x56320756cbe0 2024-09-19T09:12:19.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.016+0000 7f8e3c7b2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8e341b00d0 con 0x563207561a00 2024-09-19T09:12:19.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.016+0000 7f8e3c7b2740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8e341adec0 con 0x563207562320 2024-09-19T09:12:19.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.016+0000 7f8e38976640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56320756cbe0 0x563207581880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:19.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.016+0000 7f8e38976640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56320756cbe0 0x563207581880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45440/0 (socket says 172.21.15.92:45440) 2024-09-19T09:12:19.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.016+0000 7f8e38976640 1 -- 172.21.15.92:0/1622100406 learned_addr learned my addr 172.21.15.92:0/1622100406 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:19.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.016+0000 7f8e38976640 1 --2- 172.21.15.92:0/1622100406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563207561a00 0x563207578bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:19.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.016+0000 7f8e2bfff640 1 --2- 172.21.15.92:0/1622100406 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563207562320 0x563207564d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:19.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.016+0000 7f8e38976640 1 -- 172.21.15.92:0/1622100406 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563207562320 msgr2=0x563207564d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:19.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.016+0000 7f8e38976640 1 --2- 172.21.15.92:0/1622100406 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563207562320 0x563207564d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:19.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.016+0000 7f8e38976640 1 -- 172.21.15.92:0/1622100406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563207561a00 msgr2=0x563207578bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:19.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.016+0000 7f8e38976640 1 --2- 172.21.15.92:0/1622100406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563207561a00 0x563207578bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:19.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.016+0000 7f8e38976640 1 -- 172.21.15.92:0/1622100406 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563207568780 con 0x56320756cbe0 2024-09-19T09:12:19.023 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.016+0000 7f8e2bfff640 1 --2- 172.21.15.92:0/1622100406 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563207562320 0x563207564d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:12:19.023 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.016+0000 7f8e38976640 1 --2- 172.21.15.92:0/1622100406 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56320756cbe0 0x563207581880 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c004b90 tx=0x7f8e2c00c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53b49d059e90908c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:19.023 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.016+0000 7f8e29ffb640 1 -- 172.21.15.92:0/1622100406 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c027070 con 0x56320756cbe0 2024-09-19T09:12:19.023 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.016+0000 7f8e29ffb640 1 -- 172.21.15.92:0/1622100406 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e2c019430 con 0x56320756cbe0 2024-09-19T09:12:19.023 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.016+0000 7f8e29ffb640 1 -- 172.21.15.92:0/1622100406 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c019cd0 con 0x56320756cbe0 2024-09-19T09:12:19.023 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.017+0000 7f8e3c7b2740 1 -- 172.21.15.92:0/1622100406 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56320756cbe0 msgr2=0x563207581880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:19.023 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.017+0000 7f8e3c7b2740 1 --2- 172.21.15.92:0/1622100406 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56320756cbe0 0x563207581880 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c004b90 tx=0x7f8e2c00c040 comp rx=0 tx=0).stop 2024-09-19T09:12:19.023 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.017+0000 7f8e3c7b2740 1 -- 172.21.15.92:0/1622100406 shutdown_connections 2024-09-19T09:12:19.023 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.017+0000 7f8e3c7b2740 1 --2- 172.21.15.92:0/1622100406 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56320756cbe0 0x563207581880 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:19.023 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.017+0000 7f8e3c7b2740 1 --2- 172.21.15.92:0/1622100406 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563207562320 0x563207564d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:19.023 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.017+0000 7f8e3c7b2740 1 --2- 172.21.15.92:0/1622100406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563207561a00 0x563207578bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:19.023 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.017+0000 7f8e3c7b2740 1 -- 172.21.15.92:0/1622100406 >> 172.21.15.92:0/1622100406 conn(0x56320755df90 msgr2=0x5632075645f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:19.023 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.017+0000 7f8e3c7b2740 1 -- 172.21.15.92:0/1622100406 shutdown_connections 2024-09-19T09:12:19.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.017+0000 7f8e3c7b2740 1 -- 172.21.15.92:0/1622100406 wait complete. 2024-09-19T09:12:19.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.017+0000 7f8e3c7b2740 1 -- start start 2024-09-19T09:12:19.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.018+0000 7f8e3c7b2740 1 Processor -- start 2024-09-19T09:12:19.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.018+0000 7f8e3c7b2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563207561a00 0x56320757ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:19.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.018+0000 7f8e3c7b2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563207562320 0x56320757f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:19.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.018+0000 7f8e3c7b2740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56320756cbe0 0x5632075e5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:19.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.018+0000 7f8e3c7b2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8e341ae590 con 0x563207562320 2024-09-19T09:12:19.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.018+0000 7f8e3c7b2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8e341afa00 con 0x563207561a00 2024-09-19T09:12:19.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.018+0000 7f8e3c7b2740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8e341aec60 con 0x56320756cbe0 2024-09-19T09:12:19.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.018+0000 7f8e3c7b2740 10 client.0 _ll_register_callbacks cb 0x7f8e2c009390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:12:19.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.018+0000 7f8e2bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563207562320 0x56320757f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:19.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.018+0000 7f8e2bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563207562320 0x56320757f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45450/0 (socket says 172.21.15.92:45450) 2024-09-19T09:12:19.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.018+0000 7f8e2bfff640 1 -- 172.21.15.92:0/708346836 learned_addr learned my addr 172.21.15.92:0/708346836 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:19.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.018+0000 7f8e38976640 1 --2- 172.21.15.92:0/708346836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563207561a00 0x56320757ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:19.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.018+0000 7f8e2bfff640 1 -- 172.21.15.92:0/708346836 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56320756cbe0 msgr2=0x5632075e5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:19.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.018+0000 7f8e2bfff640 1 --2- 172.21.15.92:0/708346836 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56320756cbe0 0x5632075e5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:19.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.018+0000 7f8e2bfff640 1 -- 172.21.15.92:0/708346836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563207561a00 msgr2=0x56320757ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:19.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.018+0000 7f8e2bfff640 1 --2- 172.21.15.92:0/708346836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563207561a00 0x56320757ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:19.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.018+0000 7f8e2bfff640 1 -- 172.21.15.92:0/708346836 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632075e58a0 con 0x563207562320 2024-09-19T09:12:19.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.018+0000 7f8e2bfff640 1 --2- 172.21.15.92:0/708346836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563207562320 0x56320757f260 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c005ab0 tx=0x7f8e1c004090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9eb9180098fff05 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:19.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.018+0000 7f8e137fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:12:19.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.019+0000 7f8e137fe640 1 -- 172.21.15.92:0/708346836 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c035040 con 0x563207562320 2024-09-19T09:12:19.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.019+0000 7f8e137fe640 1 -- 172.21.15.92:0/708346836 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8e1c004450 con 0x563207562320 2024-09-19T09:12:19.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.019+0000 7f8e3c7b2740 1 -- 172.21.15.92:0/708346836 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e2c019430 con 0x563207562320 2024-09-19T09:12:19.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.019+0000 7f8e137fe640 1 -- 172.21.15.92:0/708346836 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8e1c005040 con 0x563207562320 2024-09-19T09:12:19.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.019+0000 7f8e3c7b2740 10 client.19104 fetch_fsmap learned FSMap version 19 2024-09-19T09:12:19.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.019+0000 7f8e3c7b2740 1 -- 172.21.15.92:0/708346836 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5632075e6a60 con 0x563207562320 2024-09-19T09:12:19.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.019+0000 7f8e137fe640 1 -- 172.21.15.92:0/708346836 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e2c019430 con 0x563207562320 2024-09-19T09:12:19.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.019+0000 7f8e137fe640 1 -- 172.21.15.92:0/708346836 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f8e1c0035f0 con 0x563207562320 2024-09-19T09:12:19.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.019+0000 7f8e3c7b2740 10 client.19104 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:12:19.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.019+0000 7f8e3c7b2740 10 client.19104 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T09:12:19.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.019+0000 7f8e3c7b2740 20 client.19104 populate_metadata read hostname 'smithi092' 2024-09-19T09:12:19.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.019+0000 7f8e3c7b2740 1 --2- 172.21.15.92:0/708346836 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5632075e71c0 0x5632075e95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:19.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.019+0000 7f8e3c7b2740 4 client.19104 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-19T09:12:19.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.019+0000 7f8e3c7b2740 1 -- 172.21.15.92:0/708346836 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x5632074cdc80 con 0x5632075e71c0 2024-09-19T09:12:19.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.019+0000 7f8e38976640 1 --2- 172.21.15.92:0/708346836 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5632075e71c0 0x5632075e95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:19.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.020+0000 7f8e38976640 1 --2- 172.21.15.92:0/708346836 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5632075e71c0 0x5632075e95e0 crc :-1 s=READY pgs=465 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=570010ddaea7da03 server_cookie=5d69d230a7273b95 in_seq=0 out_seq=0 2024-09-19T09:12:19.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.020+0000 7f8e137fe640 10 client.19104 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:12:19.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.020+0000 7f8e137fe640 1 -- 172.21.15.92:0/708346836 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x5632074cdc80 con 0x5632075e71c0 2024-09-19T09:12:19.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.020+0000 7f8e137fe640 10 client.19104 handle_command_reply: tid=0 2024-09-19T09:12:19.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.020+0000 7f8e3c7b2740 1 client.19104 shutdown 2024-09-19T09:12:19.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.020+0000 7f8e3c7b2740 1 -- 172.21.15.92:0/708346836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563207562320 msgr2=0x56320757f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:19.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.020+0000 7f8e3c7b2740 1 --2- 172.21.15.92:0/708346836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563207562320 0x56320757f260 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c005ab0 tx=0x7f8e1c004090 comp rx=0 tx=0).stop 2024-09-19T09:12:19.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.020+0000 7f8e3c7b2740 1 -- 172.21.15.92:0/708346836 shutdown_connections 2024-09-19T09:12:19.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.020+0000 7f8e3c7b2740 1 --2- 172.21.15.92:0/708346836 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x5632075e71c0 0x5632075e95e0 crc :-1 s=READY pgs=465 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:19.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.020+0000 7f8e3c7b2740 1 --2- 172.21.15.92:0/708346836 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56320756cbe0 0x5632075e5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:19.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.020+0000 7f8e3c7b2740 1 --2- 172.21.15.92:0/708346836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563207562320 0x56320757f260 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:19.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.020+0000 7f8e3c7b2740 1 --2- 172.21.15.92:0/708346836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563207561a00 0x56320757ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:19.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.020+0000 7f8e3c7b2740 1 -- 172.21.15.92:0/708346836 >> 172.21.15.92:0/708346836 conn(0x56320755df90 msgr2=0x56320755d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:19.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.020+0000 7f8e137fe640 0 client.19104 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:12:19.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.020+0000 7f8e3c7b2740 1 -- 172.21.15.92:0/708346836 shutdown_connections 2024-09-19T09:12:19.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.020+0000 7f8e3c7b2740 1 -- 172.21.15.92:0/708346836 wait complete. 2024-09-19T09:12:19.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.021+0000 7f8e3c7b2740 20 client.19104 trim_cache size 0 max 16384 2024-09-19T09:12:19.028 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:12:19.028 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 19, 2024-09-19T09:12:19.028 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24472, 2024-09-19T09:12:19.028 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 56, 2024-09-19T09:12:19.028 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": {} 2024-09-19T09:12:19.028 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:12:19.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.021+0000 7f8e3a3d9640 1 -- 172.21.15.92:0/992547470 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8e200a32c0 msgr2=0x7f8e200a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:19.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.021+0000 7f8e3a3d9640 1 --2- 172.21.15.92:0/992547470 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8e200a32c0 0x7f8e200a5780 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f8e24098a60 tx=0x7f8e24091570 comp rx=0 tx=0).stop 2024-09-19T09:12:19.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.021+0000 7f8e3a3d9640 1 -- 172.21.15.92:0/992547470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e34101470 msgr2=0x7f8e34197060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:19.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.021+0000 7f8e3a3d9640 1 --2- 172.21.15.92:0/992547470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e34101470 0x7f8e34197060 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f8e2400c920 tx=0x7f8e2400cde0 comp rx=0 tx=0).stop 2024-09-19T09:12:19.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.021+0000 7f8e3a3d9640 1 -- 172.21.15.92:0/992547470 shutdown_connections 2024-09-19T09:12:19.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.021+0000 7f8e3a3d9640 1 --2- 172.21.15.92:0/992547470 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e34105de0 0x7f8e34197ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:19.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.021+0000 7f8e3a3d9640 1 --2- 172.21.15.92:0/992547470 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e34101e20 0x7f8e341975a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:19.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.021+0000 7f8e3a3d9640 1 --2- 172.21.15.92:0/992547470 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8e200a32c0 0x7f8e200a5780 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:19.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.021+0000 7f8e3a3d9640 1 --2- 172.21.15.92:0/992547470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e34101470 0x7f8e34197060 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:19.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.021+0000 7f8e3a3d9640 1 -- 172.21.15.92:0/992547470 >> 172.21.15.92:0/992547470 conn(0x7f8e34077230 msgr2=0x7f8e34104620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:19.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.021+0000 7f8e3a3d9640 1 -- 172.21.15.92:0/992547470 shutdown_connections 2024-09-19T09:12:19.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:19.021+0000 7f8e3a3d9640 1 -- 172.21.15.92:0/992547470 wait complete. 2024-09-19T09:12:19.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:18 smithi167 ceph-mon[35359]: pgmap v805: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 21 MiB/s wr, 1.35k op/s 2024-09-19T09:12:19.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:18 smithi190 ceph-mon[35358]: pgmap v805: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 21 MiB/s wr, 1.35k op/s 2024-09-19T09:12:19.703 INFO:tasks.quiescer:done joining Quiescers 2024-09-19T09:12:19.703 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-19T09:12:19.714 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi092.front.sepia.ceph.com 2024-09-19T09:12:19.722 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-19T09:12:19.743 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-19T09:12:21.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:20 smithi092 ceph-mon[31407]: pgmap v806: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 22 MiB/s wr, 1.43k op/s 2024-09-19T09:12:21.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:20 smithi167 ceph-mon[35359]: pgmap v806: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 22 MiB/s wr, 1.43k op/s 2024-09-19T09:12:21.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:20 smithi190 ceph-mon[35358]: pgmap v806: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 22 MiB/s wr, 1.43k op/s 2024-09-19T09:12:23.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:22 smithi092 ceph-mon[31407]: pgmap v807: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 17 MiB/s wr, 1.20k op/s 2024-09-19T09:12:23.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:22 smithi167 ceph-mon[35359]: pgmap v807: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 17 MiB/s wr, 1.20k op/s 2024-09-19T09:12:23.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:22 smithi190 ceph-mon[35358]: pgmap v807: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 17 MiB/s wr, 1.20k op/s 2024-09-19T09:12:25.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:24 smithi092 ceph-mon[31407]: pgmap v808: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 12 MiB/s wr, 966 op/s 2024-09-19T09:12:25.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:24 smithi167 ceph-mon[35359]: pgmap v808: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 12 MiB/s wr, 966 op/s 2024-09-19T09:12:25.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:24 smithi190 ceph-mon[35358]: pgmap v808: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 12 MiB/s wr, 966 op/s 2024-09-19T09:12:27.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:26 smithi092 ceph-mon[31407]: pgmap v809: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 4.0 MiB/s wr, 421 op/s 2024-09-19T09:12:27.010 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:12:27.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:26 smithi167 ceph-mon[35359]: pgmap v809: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 4.0 MiB/s wr, 421 op/s 2024-09-19T09:12:27.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:26 smithi190 ceph-mon[35358]: pgmap v809: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 4.0 MiB/s wr, 421 op/s 2024-09-19T09:12:27.273 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:12:27.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.751+0000 7f7407ae9640 1 -- 172.21.15.92:0/828168469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7400101450 msgr2=0x7f7400105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:27.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.751+0000 7f7407ae9640 1 --2- 172.21.15.92:0/828168469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7400101450 0x7f7400105920 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f73f0009900 tx=0x7f73f002a470 comp rx=0 tx=0).stop 2024-09-19T09:12:27.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.751+0000 7f7407ae9640 1 -- 172.21.15.92:0/828168469 shutdown_connections 2024-09-19T09:12:27.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.751+0000 7f7407ae9640 1 --2- 172.21.15.92:0/828168469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7400105f40 0x7f74001063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:27.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.751+0000 7f7407ae9640 1 --2- 172.21.15.92:0/828168469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7400101450 0x7f7400105920 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:27.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.751+0000 7f7407ae9640 1 --2- 172.21.15.92:0/828168469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7400100b30 0x7f7400100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:27.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.751+0000 7f7407ae9640 1 -- 172.21.15.92:0/828168469 >> 172.21.15.92:0/828168469 conn(0x7f74000fc7a0 msgr2=0x7f74000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:27.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.751+0000 7f7407ae9640 1 -- 172.21.15.92:0/828168469 shutdown_connections 2024-09-19T09:12:27.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.751+0000 7f7407ae9640 1 -- 172.21.15.92:0/828168469 wait complete. 2024-09-19T09:12:27.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.752+0000 7f7407ae9640 1 Processor -- start 2024-09-19T09:12:27.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.752+0000 7f7407ae9640 1 -- start start 2024-09-19T09:12:27.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.752+0000 7f7407ae9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7400100b30 0x7f74001a4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:27.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.752+0000 7f7407ae9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7400101450 0x7f74001a4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:27.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.752+0000 7f7407ae9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7400105f40 0x7f740019e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:27.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.752+0000 7f7407ae9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7400118540 con 0x7f7400101450 2024-09-19T09:12:27.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.752+0000 7f7407ae9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f74001183c0 con 0x7f7400105f40 2024-09-19T09:12:27.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.752+0000 7f7407ae9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f74001186c0 con 0x7f7400100b30 2024-09-19T09:12:27.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.752+0000 7f7405084640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7400101450 0x7f74001a4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:27.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.752+0000 7f7405084640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7400101450 0x7f74001a4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59520/0 (socket says 172.21.15.92:59520) 2024-09-19T09:12:27.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.752+0000 7f7405084640 1 -- 172.21.15.92:0/632346244 learned_addr learned my addr 172.21.15.92:0/632346244 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:27.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.752+0000 7f7405885640 1 --2- 172.21.15.92:0/632346244 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7400100b30 0x7f74001a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:27.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.753+0000 7f7405084640 1 -- 172.21.15.92:0/632346244 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7400100b30 msgr2=0x7f74001a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:27.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.753+0000 7f7405084640 1 --2- 172.21.15.92:0/632346244 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7400100b30 0x7f74001a4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:27.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.753+0000 7f7405084640 1 -- 172.21.15.92:0/632346244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7400105f40 msgr2=0x7f740019e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:27.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.753+0000 7f7405084640 1 --2- 172.21.15.92:0/632346244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7400105f40 0x7f740019e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:27.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.753+0000 7f7405084640 1 -- 172.21.15.92:0/632346244 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f740019ef20 con 0x7f7400101450 2024-09-19T09:12:27.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.753+0000 7f7405885640 1 --2- 172.21.15.92:0/632346244 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7400100b30 0x7f74001a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:12:27.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.753+0000 7f7405084640 1 --2- 172.21.15.92:0/632346244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7400101450 0x7f74001a4b40 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f73f0005ab0 tx=0x7f73f00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:27.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.753+0000 7f73f6ffd640 1 -- 172.21.15.92:0/632346244 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f003f030 con 0x7f7400101450 2024-09-19T09:12:27.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.753+0000 7f7407ae9640 1 -- 172.21.15.92:0/632346244 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f740019f1b0 con 0x7f7400101450 2024-09-19T09:12:27.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.753+0000 7f73f6ffd640 1 -- 172.21.15.92:0/632346244 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73f0003ce0 con 0x7f7400101450 2024-09-19T09:12:27.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.753+0000 7f73f6ffd640 1 -- 172.21.15.92:0/632346244 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f0035070 con 0x7f7400101450 2024-09-19T09:12:27.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.753+0000 7f7407ae9640 1 -- 172.21.15.92:0/632346244 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74001ab460 con 0x7f7400101450 2024-09-19T09:12:27.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.756+0000 7f73f6ffd640 1 -- 172.21.15.92:0/632346244 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f73f0042030 con 0x7f7400101450 2024-09-19T09:12:27.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.756+0000 7f7409ec2740 1 Processor -- start 2024-09-19T09:12:27.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.756+0000 7f7409ec2740 1 -- start start 2024-09-19T09:12:27.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.757+0000 7f7409ec2740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6e735e4a0 0x55e6e735e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:27.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.757+0000 7f7409ec2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6e735edc0 0x55e6e7369140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:27.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.757+0000 7f7409ec2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6e7369680 0x55e6e736ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:27.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.757+0000 7f7409ec2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e6e72c42e0 con 0x55e6e735edc0 2024-09-19T09:12:27.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.757+0000 7f7409ec2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e6e726bce0 con 0x55e6e7369680 2024-09-19T09:12:27.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.757+0000 7f7409ec2740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e6e72c02a0 con 0x55e6e735e4a0 2024-09-19T09:12:27.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.757+0000 7f7405885640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6e735edc0 0x55e6e7369140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:27.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.757+0000 7f7405885640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6e735edc0 0x55e6e7369140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59528/0 (socket says 172.21.15.92:59528) 2024-09-19T09:12:27.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.757+0000 7f7405885640 1 -- 172.21.15.92:0/1692658773 learned_addr learned my addr 172.21.15.92:0/1692658773 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:27.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.757+0000 7f7406086640 1 --2- 172.21.15.92:0/1692658773 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6e735e4a0 0x55e6e735e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:27.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.757+0000 7f7405084640 1 --2- 172.21.15.92:0/1692658773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6e7369680 0x55e6e736ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:27.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.757+0000 7f7405885640 1 -- 172.21.15.92:0/1692658773 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6e735e4a0 msgr2=0x55e6e735e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:27.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.757+0000 7f7405885640 1 --2- 172.21.15.92:0/1692658773 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6e735e4a0 0x55e6e735e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:27.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.757+0000 7f7405885640 1 -- 172.21.15.92:0/1692658773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6e7369680 msgr2=0x55e6e736ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:27.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.757+0000 7f7405885640 1 --2- 172.21.15.92:0/1692658773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6e7369680 0x55e6e736ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:27.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.757+0000 7f73f6ffd640 1 --2- 172.21.15.92:0/632346244 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f73ec0a3240 0x7f73ec0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:27.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.757+0000 7f7405885640 1 -- 172.21.15.92:0/1692658773 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6e7250440 con 0x55e6e735edc0 2024-09-19T09:12:27.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.757+0000 7f7406086640 1 --2- 172.21.15.92:0/632346244 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f73ec0a3240 0x7f73ec0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:27.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.757+0000 7f7405885640 1 --2- 172.21.15.92:0/1692658773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6e735edc0 0x55e6e7369140 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f73fc008c60 tx=0x7f73fc00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c5074c43b036188 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:27.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.757+0000 7f73f6ffd640 1 -- 172.21.15.92:0/632346244 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f73f00f0220 con 0x7f7400101450 2024-09-19T09:12:27.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.757+0000 7f73ebfff640 1 -- 172.21.15.92:0/1692658773 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73fc014070 con 0x55e6e735edc0 2024-09-19T09:12:27.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.758+0000 7f73ebfff640 1 -- 172.21.15.92:0/1692658773 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73fc0047a0 con 0x55e6e735edc0 2024-09-19T09:12:27.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.758+0000 7f73ebfff640 1 -- 172.21.15.92:0/1692658773 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73fc014070 con 0x55e6e735edc0 2024-09-19T09:12:27.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.758+0000 7f7409ec2740 1 -- 172.21.15.92:0/1692658773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6e735edc0 msgr2=0x55e6e7369140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:27.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.758+0000 7f7406086640 1 --2- 172.21.15.92:0/632346244 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f73ec0a3240 0x7f73ec0a5700 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f73f8005cc0 tx=0x7f73f80074a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:27.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.758+0000 7f7409ec2740 1 --2- 172.21.15.92:0/1692658773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6e735edc0 0x55e6e7369140 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f73fc008c60 tx=0x7f73fc00e720 comp rx=0 tx=0).stop 2024-09-19T09:12:27.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.758+0000 7f7409ec2740 1 -- 172.21.15.92:0/1692658773 shutdown_connections 2024-09-19T09:12:27.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.758+0000 7f7409ec2740 1 --2- 172.21.15.92:0/1692658773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6e7369680 0x55e6e736ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:27.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.758+0000 7f7409ec2740 1 --2- 172.21.15.92:0/1692658773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6e735edc0 0x55e6e7369140 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:27.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.758+0000 7f7409ec2740 1 --2- 172.21.15.92:0/1692658773 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6e735e4a0 0x55e6e735e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:27.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.758+0000 7f7409ec2740 1 -- 172.21.15.92:0/1692658773 >> 172.21.15.92:0/1692658773 conn(0x55e6e735aa30 msgr2=0x55e6e735ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:27.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.758+0000 7f7409ec2740 1 -- 172.21.15.92:0/1692658773 shutdown_connections 2024-09-19T09:12:27.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.759+0000 7f7409ec2740 1 -- 172.21.15.92:0/1692658773 wait complete. 2024-09-19T09:12:27.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.759+0000 7f7409ec2740 1 -- start start 2024-09-19T09:12:27.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.759+0000 7f7409ec2740 1 Processor -- start 2024-09-19T09:12:27.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.759+0000 7f7409ec2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6e735e4a0 0x55e6e7368f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:27.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.759+0000 7f7409ec2740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6e735edc0 0x55e6e7366230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:27.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.759+0000 7f7409ec2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6e7369680 0x55e6e7366770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:27.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.759+0000 7f7409ec2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e6e736c250 con 0x55e6e735e4a0 2024-09-19T09:12:27.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.759+0000 7f7409ec2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e6e727f050 con 0x55e6e7369680 2024-09-19T09:12:27.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.759+0000 7f7409ec2740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e6e736c3d0 con 0x55e6e735edc0 2024-09-19T09:12:27.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.759+0000 7f7409ec2740 10 client.0 _ll_register_callbacks cb 0x55e6e72bf160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:12:27.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.760+0000 7f7405885640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6e735e4a0 0x55e6e7368f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:27.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.760+0000 7f7405885640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6e735e4a0 0x55e6e7368f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59530/0 (socket says 172.21.15.92:59530) 2024-09-19T09:12:27.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.760+0000 7f7405885640 1 -- 172.21.15.92:0/2158828110 learned_addr learned my addr 172.21.15.92:0/2158828110 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:27.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.760+0000 7f7405084640 1 --2- 172.21.15.92:0/2158828110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6e735edc0 0x55e6e7366230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:27.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.760+0000 7f7406086640 1 --2- 172.21.15.92:0/2158828110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6e7369680 0x55e6e7366770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:27.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.760+0000 7f7405885640 1 -- 172.21.15.92:0/2158828110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6e735edc0 msgr2=0x55e6e7366230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:27.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.760+0000 7f7405885640 1 --2- 172.21.15.92:0/2158828110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6e735edc0 0x55e6e7366230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:27.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.760+0000 7f7405885640 1 -- 172.21.15.92:0/2158828110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6e7369680 msgr2=0x55e6e7366770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:27.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.760+0000 7f7405885640 1 --2- 172.21.15.92:0/2158828110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6e7369680 0x55e6e7366770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:27.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.760+0000 7f7405885640 1 -- 172.21.15.92:0/2158828110 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6e70353c0 con 0x55e6e735e4a0 2024-09-19T09:12:27.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.760+0000 7f7406086640 1 --2- 172.21.15.92:0/2158828110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6e7369680 0x55e6e7366770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:12:27.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.760+0000 7f7405885640 1 --2- 172.21.15.92:0/2158828110 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6e735e4a0 0x55e6e7368f30 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f73fc0057c0 tx=0x7f73fc004b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97a5866c89a4c7f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:27.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.760+0000 7f73e97fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:12:27.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.760+0000 7f73e97fa640 1 -- 172.21.15.92:0/2158828110 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73fc014070 con 0x55e6e735e4a0 2024-09-19T09:12:27.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.760+0000 7f73e97fa640 1 -- 172.21.15.92:0/2158828110 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f73fc005020 con 0x55e6e735e4a0 2024-09-19T09:12:27.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.760+0000 7f7409ec2740 1 -- 172.21.15.92:0/2158828110 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73fc0047a0 con 0x55e6e735e4a0 2024-09-19T09:12:27.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.760+0000 7f73e97fa640 1 -- 172.21.15.92:0/2158828110 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f73fc004260 con 0x55e6e735e4a0 2024-09-19T09:12:27.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.761+0000 7f7409ec2740 10 client.19116 fetch_fsmap learned FSMap version 19 2024-09-19T09:12:27.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.761+0000 7f7409ec2740 1 -- 172.21.15.92:0/2158828110 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e6e7377bf0 con 0x55e6e735e4a0 2024-09-19T09:12:27.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.761+0000 7f73e97fa640 1 -- 172.21.15.92:0/2158828110 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73fc0047a0 con 0x55e6e735e4a0 2024-09-19T09:12:27.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.761+0000 7f73e97fa640 1 -- 172.21.15.92:0/2158828110 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f73fc003bf0 con 0x55e6e735e4a0 2024-09-19T09:12:27.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.761+0000 7f7409ec2740 10 client.19116 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:12:27.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.761+0000 7f7409ec2740 10 client.19116 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:12:27.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.761+0000 7f7409ec2740 20 client.19116 populate_metadata read hostname 'smithi092' 2024-09-19T09:12:27.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.761+0000 7f7409ec2740 1 --2- 172.21.15.92:0/2158828110 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e6e7378fa0 0x55e6e737b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:27.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.761+0000 7f7409ec2740 4 client.19116 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:12:27.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.761+0000 7f7409ec2740 1 -- 172.21.15.92:0/2158828110 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6e72d1850 con 0x55e6e7378fa0 2024-09-19T09:12:27.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.761+0000 7f7405084640 1 --2- 172.21.15.92:0/2158828110 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e6e7378fa0 0x55e6e737b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:27.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.762+0000 7f73e97fa640 10 client.19116 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:12:27.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.762+0000 7f7405084640 1 --2- 172.21.15.92:0/2158828110 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e6e7378fa0 0x55e6e737b390 crc :-1 s=READY pgs=466 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=350da635520025af server_cookie=b0f7da4b7c5c7f0a in_seq=0 out_seq=0 2024-09-19T09:12:27.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.762+0000 7f73e97fa640 1 -- 172.21.15.92:0/2158828110 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e6e72d1850 con 0x55e6e7378fa0 2024-09-19T09:12:27.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.762+0000 7f73e97fa640 10 client.19116 handle_command_reply: tid=0 2024-09-19T09:12:27.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.762+0000 7f7409ec2740 1 client.19116 shutdown 2024-09-19T09:12:27.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.762+0000 7f7409ec2740 1 -- 172.21.15.92:0/2158828110 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6e735e4a0 msgr2=0x55e6e7368f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:27.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.762+0000 7f7409ec2740 1 --2- 172.21.15.92:0/2158828110 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6e735e4a0 0x55e6e7368f30 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f73fc0057c0 tx=0x7f73fc004b80 comp rx=0 tx=0).stop 2024-09-19T09:12:27.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.763+0000 7f7409ec2740 1 -- 172.21.15.92:0/2158828110 shutdown_connections 2024-09-19T09:12:27.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.763+0000 7f7409ec2740 1 --2- 172.21.15.92:0/2158828110 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e6e7378fa0 0x55e6e737b390 crc :-1 s=READY pgs=466 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:27.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.763+0000 7f7409ec2740 1 --2- 172.21.15.92:0/2158828110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6e7369680 0x55e6e7366770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:27.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.763+0000 7f7409ec2740 1 --2- 172.21.15.92:0/2158828110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6e735edc0 0x55e6e7366230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:27.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.763+0000 7f7409ec2740 1 --2- 172.21.15.92:0/2158828110 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6e735e4a0 0x55e6e7368f30 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:27.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.763+0000 7f73e97fa640 0 client.19116 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:12:27.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.763+0000 7f7409ec2740 1 -- 172.21.15.92:0/2158828110 >> 172.21.15.92:0/2158828110 conn(0x55e6e735aa30 msgr2=0x55e6e7360710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:27.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.763+0000 7f7409ec2740 1 -- 172.21.15.92:0/2158828110 shutdown_connections 2024-09-19T09:12:27.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.763+0000 7f7409ec2740 1 -- 172.21.15.92:0/2158828110 wait complete. 2024-09-19T09:12:27.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.763+0000 7f7409ec2740 20 client.19116 trim_cache size 0 max 16384 2024-09-19T09:12:27.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.779+0000 7f7409ec2740 1 Processor -- start 2024-09-19T09:12:27.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.779+0000 7f7409ec2740 1 -- start start 2024-09-19T09:12:27.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.780+0000 7f7409ec2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6e735e4a0 0x55e6e73754e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:27.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.780+0000 7f7409ec2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6e735edc0 0x55e6e7365b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:27.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.780+0000 7f7409ec2740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6e7369680 0x55e6e7380b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:27.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.780+0000 7f7409ec2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f74001b1a80 con 0x55e6e735edc0 2024-09-19T09:12:27.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.780+0000 7f7409ec2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f74001b4320 con 0x55e6e735e4a0 2024-09-19T09:12:27.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.780+0000 7f7409ec2740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f74001b2110 con 0x55e6e7369680 2024-09-19T09:12:27.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.780+0000 7f7405084640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6e735edc0 0x55e6e7365b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:27.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.780+0000 7f7405084640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6e735edc0 0x55e6e7365b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59540/0 (socket says 172.21.15.92:59540) 2024-09-19T09:12:27.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.780+0000 7f7405084640 1 -- 172.21.15.92:0/758982289 learned_addr learned my addr 172.21.15.92:0/758982289 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:27.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.780+0000 7f7405885640 1 --2- 172.21.15.92:0/758982289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6e735e4a0 0x55e6e73754e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:27.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.780+0000 7f7405084640 1 -- 172.21.15.92:0/758982289 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6e7369680 msgr2=0x55e6e7380b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:27.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.780+0000 7f7406086640 1 --2- 172.21.15.92:0/758982289 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6e7369680 0x55e6e7380b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:27.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.780+0000 7f7405084640 1 --2- 172.21.15.92:0/758982289 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6e7369680 0x55e6e7380b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:27.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.780+0000 7f7405084640 1 -- 172.21.15.92:0/758982289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6e735e4a0 msgr2=0x55e6e73754e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:27.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.780+0000 7f7405084640 1 --2- 172.21.15.92:0/758982289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6e735e4a0 0x55e6e73754e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:27.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.780+0000 7f7405084640 1 -- 172.21.15.92:0/758982289 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6e7366aa0 con 0x55e6e735edc0 2024-09-19T09:12:27.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.780+0000 7f7405885640 1 --2- 172.21.15.92:0/758982289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6e735e4a0 0x55e6e73754e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:12:27.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.780+0000 7f7405084640 1 --2- 172.21.15.92:0/758982289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6e735edc0 0x55e6e7365b10 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f73f00bc540 tx=0x7f73f002a470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7919173e58277807 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:27.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.780+0000 7f73eb7fe640 1 -- 172.21.15.92:0/758982289 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f0049040 con 0x55e6e735edc0 2024-09-19T09:12:27.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.780+0000 7f73eb7fe640 1 -- 172.21.15.92:0/758982289 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73f00bc840 con 0x55e6e735edc0 2024-09-19T09:12:27.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.780+0000 7f73eb7fe640 1 -- 172.21.15.92:0/758982289 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f003b460 con 0x55e6e735edc0 2024-09-19T09:12:27.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.781+0000 7f7409ec2740 1 -- 172.21.15.92:0/758982289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6e735edc0 msgr2=0x55e6e7365b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:27.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.781+0000 7f7409ec2740 1 --2- 172.21.15.92:0/758982289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6e735edc0 0x55e6e7365b10 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f73f00bc540 tx=0x7f73f002a470 comp rx=0 tx=0).stop 2024-09-19T09:12:27.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.781+0000 7f7409ec2740 1 -- 172.21.15.92:0/758982289 shutdown_connections 2024-09-19T09:12:27.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.781+0000 7f7409ec2740 1 --2- 172.21.15.92:0/758982289 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6e7369680 0x55e6e7380b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:27.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.781+0000 7f7409ec2740 1 --2- 172.21.15.92:0/758982289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6e735edc0 0x55e6e7365b10 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:27.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.781+0000 7f7409ec2740 1 --2- 172.21.15.92:0/758982289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6e735e4a0 0x55e6e73754e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:27.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.781+0000 7f7409ec2740 1 -- 172.21.15.92:0/758982289 >> 172.21.15.92:0/758982289 conn(0x55e6e735aa30 msgr2=0x55e6e7359b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:27.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.781+0000 7f7409ec2740 1 -- 172.21.15.92:0/758982289 shutdown_connections 2024-09-19T09:12:27.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.781+0000 7f7409ec2740 1 -- 172.21.15.92:0/758982289 wait complete. 2024-09-19T09:12:27.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.781+0000 7f7409ec2740 1 -- start start 2024-09-19T09:12:27.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.781+0000 7f7409ec2740 1 Processor -- start 2024-09-19T09:12:27.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.782+0000 7f7409ec2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6e735e4a0 0x55e6e736d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:27.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.782+0000 7f7409ec2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6e735edc0 0x55e6e736db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:27.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.782+0000 7f7409ec2740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6e7369680 0x55e6e736e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:27.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.782+0000 7f7409ec2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f74001b27e0 con 0x55e6e735e4a0 2024-09-19T09:12:27.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.782+0000 7f7409ec2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f74001b3c50 con 0x55e6e735edc0 2024-09-19T09:12:27.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.782+0000 7f7409ec2740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f74001b2eb0 con 0x55e6e7369680 2024-09-19T09:12:27.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.782+0000 7f7409ec2740 10 client.0 _ll_register_callbacks cb 0x7f73f8007340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:12:27.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.782+0000 7f7405885640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6e735e4a0 0x55e6e736d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:27.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.782+0000 7f7405885640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6e735e4a0 0x55e6e736d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59546/0 (socket says 172.21.15.92:59546) 2024-09-19T09:12:27.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.782+0000 7f7405885640 1 -- 172.21.15.92:0/1569663600 learned_addr learned my addr 172.21.15.92:0/1569663600 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:27.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.782+0000 7f7405084640 1 --2- 172.21.15.92:0/1569663600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6e735edc0 0x55e6e736db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:27.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.782+0000 7f7406086640 1 --2- 172.21.15.92:0/1569663600 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6e7369680 0x55e6e736e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:27.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.782+0000 7f7405885640 1 -- 172.21.15.92:0/1569663600 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6e7369680 msgr2=0x55e6e736e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:27.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.782+0000 7f7405885640 1 --2- 172.21.15.92:0/1569663600 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6e7369680 0x55e6e736e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:27.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.782+0000 7f7405885640 1 -- 172.21.15.92:0/1569663600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6e735edc0 msgr2=0x55e6e736db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:27.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.782+0000 7f7405885640 1 --2- 172.21.15.92:0/1569663600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6e735edc0 0x55e6e736db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:27.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.782+0000 7f7405885640 1 -- 172.21.15.92:0/1569663600 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6e73e2d90 con 0x55e6e735e4a0 2024-09-19T09:12:27.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.783+0000 7f7405885640 1 --2- 172.21.15.92:0/1569663600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6e735e4a0 0x55e6e736d650 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f73fc008fd0 tx=0x7f73fc005c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1117e36caa48960c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:27.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.783+0000 7f73e97fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:12:27.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.783+0000 7f73e97fa640 1 -- 172.21.15.92:0/1569663600 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73fc014040 con 0x55e6e735e4a0 2024-09-19T09:12:27.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.783+0000 7f73e97fa640 1 -- 172.21.15.92:0/1569663600 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f73fc005530 con 0x55e6e735e4a0 2024-09-19T09:12:27.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.783+0000 7f7409ec2740 1 -- 172.21.15.92:0/1569663600 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73f00bc840 con 0x55e6e735e4a0 2024-09-19T09:12:27.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.783+0000 7f73e97fa640 1 -- 172.21.15.92:0/1569663600 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f73fc00ec50 con 0x55e6e735e4a0 2024-09-19T09:12:27.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.783+0000 7f7409ec2740 10 client.19122 fetch_fsmap learned FSMap version 19 2024-09-19T09:12:27.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.783+0000 7f7409ec2740 1 -- 172.21.15.92:0/1569663600 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e6e73e4080 con 0x55e6e735e4a0 2024-09-19T09:12:27.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.783+0000 7f73e97fa640 1 -- 172.21.15.92:0/1569663600 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73f00bc840 con 0x55e6e735e4a0 2024-09-19T09:12:27.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.783+0000 7f73e97fa640 1 -- 172.21.15.92:0/1569663600 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f73fc004e50 con 0x55e6e735e4a0 2024-09-19T09:12:27.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.783+0000 7f7409ec2740 10 client.19122 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:12:27.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.783+0000 7f7409ec2740 10 client.19122 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:12:27.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.783+0000 7f7409ec2740 20 client.19122 populate_metadata read hostname 'smithi092' 2024-09-19T09:12:27.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.783+0000 7f7409ec2740 1 --2- 172.21.15.92:0/1569663600 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e6e73e4730 0x55e6e73e6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:27.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.783+0000 7f7409ec2740 4 client.19122 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:12:27.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.783+0000 7f7409ec2740 1 -- 172.21.15.92:0/1569663600 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e6e72cbd60 con 0x55e6e73e4730 2024-09-19T09:12:27.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.784+0000 7f7405084640 1 --2- 172.21.15.92:0/1569663600 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e6e73e4730 0x55e6e73e6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:27.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.784+0000 7f7405084640 1 --2- 172.21.15.92:0/1569663600 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e6e73e4730 0x55e6e73e6b20 crc :-1 s=READY pgs=467 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb717e01c24c400a server_cookie=6d51cc6ff54420c1 in_seq=0 out_seq=0 2024-09-19T09:12:27.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.784+0000 7f73e97fa640 10 client.19122 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:12:27.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.784+0000 7f73e97fa640 1 -- 172.21.15.92:0/1569663600 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55e6e72cbd60 con 0x55e6e73e4730 2024-09-19T09:12:27.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.784+0000 7f73e97fa640 10 client.19122 handle_command_reply: tid=0 2024-09-19T09:12:27.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.784+0000 7f7409ec2740 1 client.19122 shutdown 2024-09-19T09:12:27.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.784+0000 7f7409ec2740 1 -- 172.21.15.92:0/1569663600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6e735e4a0 msgr2=0x55e6e736d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:27.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.784+0000 7f7409ec2740 1 --2- 172.21.15.92:0/1569663600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6e735e4a0 0x55e6e736d650 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f73fc008fd0 tx=0x7f73fc005c60 comp rx=0 tx=0).stop 2024-09-19T09:12:27.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.784+0000 7f7409ec2740 1 -- 172.21.15.92:0/1569663600 shutdown_connections 2024-09-19T09:12:27.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.784+0000 7f7409ec2740 1 --2- 172.21.15.92:0/1569663600 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55e6e73e4730 0x55e6e73e6b20 crc :-1 s=READY pgs=467 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:27.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.784+0000 7f7409ec2740 1 --2- 172.21.15.92:0/1569663600 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e6e7369680 0x55e6e736e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:27.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.784+0000 7f7409ec2740 1 --2- 172.21.15.92:0/1569663600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6e735edc0 0x55e6e736db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:27.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.784+0000 7f73e97fa640 0 client.19122 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:12:27.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.784+0000 7f7409ec2740 1 --2- 172.21.15.92:0/1569663600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e6e735e4a0 0x55e6e736d650 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:27.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.784+0000 7f7409ec2740 1 -- 172.21.15.92:0/1569663600 >> 172.21.15.92:0/1569663600 conn(0x55e6e735aa30 msgr2=0x55e6e7359350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:27.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.784+0000 7f7409ec2740 1 -- 172.21.15.92:0/1569663600 shutdown_connections 2024-09-19T09:12:27.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.784+0000 7f7409ec2740 1 -- 172.21.15.92:0/1569663600 wait complete. 2024-09-19T09:12:27.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.785+0000 7f7409ec2740 20 client.19122 trim_cache size 0 max 16384 2024-09-19T09:12:27.791 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:12:27.792 INFO:teuthology.orchestra.run.smithi092.stdout: "status": "no active scrubs running", 2024-09-19T09:12:27.792 INFO:teuthology.orchestra.run.smithi092.stdout: "scrubs": {} 2024-09-19T09:12:27.792 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:12:27.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.785+0000 7f7407ae9640 1 -- 172.21.15.92:0/632346244 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f73ec0a3240 msgr2=0x7f73ec0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:27.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.785+0000 7f7407ae9640 1 --2- 172.21.15.92:0/632346244 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f73ec0a3240 0x7f73ec0a5700 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f73f8005cc0 tx=0x7f73f80074a0 comp rx=0 tx=0).stop 2024-09-19T09:12:27.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.785+0000 7f7407ae9640 1 -- 172.21.15.92:0/632346244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7400101450 msgr2=0x7f74001a4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:27.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.785+0000 7f7407ae9640 1 --2- 172.21.15.92:0/632346244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7400101450 0x7f74001a4b40 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f73f0005ab0 tx=0x7f73f00042f0 comp rx=0 tx=0).stop 2024-09-19T09:12:27.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.785+0000 7f7407ae9640 1 -- 172.21.15.92:0/632346244 shutdown_connections 2024-09-19T09:12:27.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.785+0000 7f7407ae9640 1 --2- 172.21.15.92:0/632346244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7400105f40 0x7f740019e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:27.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.785+0000 7f7407ae9640 1 --2- 172.21.15.92:0/632346244 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f73ec0a3240 0x7f73ec0a5700 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:27.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.785+0000 7f7407ae9640 1 --2- 172.21.15.92:0/632346244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7400101450 0x7f74001a4b40 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:27.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.785+0000 7f7407ae9640 1 --2- 172.21.15.92:0/632346244 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7400100b30 0x7f74001a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:27.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.785+0000 7f7407ae9640 1 -- 172.21.15.92:0/632346244 >> 172.21.15.92:0/632346244 conn(0x7f74000fc7a0 msgr2=0x7f74001038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:27.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.785+0000 7f7407ae9640 1 -- 172.21.15.92:0/632346244 shutdown_connections 2024-09-19T09:12:27.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:27.785+0000 7f7407ae9640 1 -- 172.21.15.92:0/632346244 wait complete. 2024-09-19T09:12:28.694 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:12:28.695 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:12:28.945 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:12:29.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:28 smithi092 ceph-mon[31407]: pgmap v810: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 1.7 MiB/s wr, 184 op/s 2024-09-19T09:12:29.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:28 smithi167 ceph-mon[35359]: pgmap v810: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 1.7 MiB/s wr, 184 op/s 2024-09-19T09:12:29.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:28 smithi190 ceph-mon[35358]: pgmap v810: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 1.7 MiB/s wr, 184 op/s 2024-09-19T09:12:29.401 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.375+0000 7f2d35805640 1 -- 172.21.15.92:0/3688875157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d30102790 msgr2=0x7f2d301067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:29.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.375+0000 7f2d35805640 1 --2- 172.21.15.92:0/3688875157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d30102790 0x7f2d301067e0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f2d20009900 tx=0x7f2d2002a410 comp rx=0 tx=0).stop 2024-09-19T09:12:29.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.375+0000 7f2d35805640 1 -- 172.21.15.92:0/3688875157 shutdown_connections 2024-09-19T09:12:29.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.375+0000 7f2d35805640 1 --2- 172.21.15.92:0/3688875157 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2d30106f10 0x7f2d3010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:29.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.375+0000 7f2d35805640 1 --2- 172.21.15.92:0/3688875157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d30102790 0x7f2d301067e0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:29.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.375+0000 7f2d35805640 1 --2- 172.21.15.92:0/3688875157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d30101de0 0x7f2d301021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:29.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.375+0000 7f2d35805640 1 -- 172.21.15.92:0/3688875157 >> 172.21.15.92:0/3688875157 conn(0x7f2d300fd8c0 msgr2=0x7f2d300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:29.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.375+0000 7f2d35805640 1 -- 172.21.15.92:0/3688875157 shutdown_connections 2024-09-19T09:12:29.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.375+0000 7f2d35805640 1 -- 172.21.15.92:0/3688875157 wait complete. 2024-09-19T09:12:29.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.375+0000 7f2d35805640 1 Processor -- start 2024-09-19T09:12:29.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.376+0000 7f2d35805640 1 -- start start 2024-09-19T09:12:29.402 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.376+0000 7f2d35805640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d30101de0 0x7f2d30198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:29.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.376+0000 7f2d35805640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d30102790 0x7f2d30198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:29.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.376+0000 7f2d35805640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2d30106f10 0x7f2d3019cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:29.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.376+0000 7f2d35805640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2d30111f90 con 0x7f2d30102790 2024-09-19T09:12:29.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.376+0000 7f2d35805640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2d30111e10 con 0x7f2d30101de0 2024-09-19T09:12:29.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.376+0000 7f2d35805640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2d30112110 con 0x7f2d30106f10 2024-09-19T09:12:29.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.376+0000 7f2d2e7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d30102790 0x7f2d30198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:29.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.376+0000 7f2d2e7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d30102790 0x7f2d30198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59554/0 (socket says 172.21.15.92:59554) 2024-09-19T09:12:29.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.376+0000 7f2d2e7fc640 1 -- 172.21.15.92:0/1068150226 learned_addr learned my addr 172.21.15.92:0/1068150226 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:29.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.376+0000 7f2d2effd640 1 --2- 172.21.15.92:0/1068150226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d30101de0 0x7f2d30198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:29.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.376+0000 7f2d2e7fc640 1 -- 172.21.15.92:0/1068150226 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2d30106f10 msgr2=0x7f2d3019cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:29.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.376+0000 7f2d2e7fc640 1 --2- 172.21.15.92:0/1068150226 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2d30106f10 0x7f2d3019cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:29.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.376+0000 7f2d2e7fc640 1 -- 172.21.15.92:0/1068150226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d30101de0 msgr2=0x7f2d30198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:29.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.376+0000 7f2d2e7fc640 1 --2- 172.21.15.92:0/1068150226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d30101de0 0x7f2d30198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:29.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.376+0000 7f2d2e7fc640 1 -- 172.21.15.92:0/1068150226 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d3019d3c0 con 0x7f2d30102790 2024-09-19T09:12:29.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.376+0000 7f2d2effd640 1 --2- 172.21.15.92:0/1068150226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d30101de0 0x7f2d30198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:12:29.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.376+0000 7f2d2e7fc640 1 --2- 172.21.15.92:0/1068150226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d30102790 0x7f2d30198950 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f2d20005ab0 tx=0x7f2d200042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:29.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.377+0000 7f2d34803640 1 -- 172.21.15.92:0/1068150226 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2003f030 con 0x7f2d30102790 2024-09-19T09:12:29.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.377+0000 7f2d35805640 1 -- 172.21.15.92:0/1068150226 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d3019d650 con 0x7f2d30102790 2024-09-19T09:12:29.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.377+0000 7f2d34803640 1 -- 172.21.15.92:0/1068150226 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d20003ce0 con 0x7f2d30102790 2024-09-19T09:12:29.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.377+0000 7f2d34803640 1 -- 172.21.15.92:0/1068150226 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d20035070 con 0x7f2d30102790 2024-09-19T09:12:29.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.377+0000 7f2d35805640 1 -- 172.21.15.92:0/1068150226 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d301a4f90 con 0x7f2d30102790 2024-09-19T09:12:29.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.378+0000 7f2d35805640 1 -- 172.21.15.92:0/1068150226 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d301032c0 con 0x7f2d30102790 2024-09-19T09:12:29.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.379+0000 7f2d34803640 1 -- 172.21.15.92:0/1068150226 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2d20042030 con 0x7f2d30102790 2024-09-19T09:12:29.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.380+0000 7f2d34803640 1 --2- 172.21.15.92:0/1068150226 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2d1c0a3240 0x7f2d1c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:29.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.380+0000 7f2d2effd640 1 --2- 172.21.15.92:0/1068150226 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2d1c0a3240 0x7f2d1c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:29.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.380+0000 7f2d34803640 1 -- 172.21.15.92:0/1068150226 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f2d200f0500 con 0x7f2d30102790 2024-09-19T09:12:29.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.380+0000 7f2d2effd640 1 --2- 172.21.15.92:0/1068150226 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2d1c0a3240 0x7f2d1c0a5700 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2d18006fd0 tx=0x7f2d18008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:29.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.383+0000 7f2d34803640 1 -- 172.21.15.92:0/1068150226 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2d200bd220 con 0x7f2d30102790 2024-09-19T09:12:29.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.588+0000 7f2d35805640 1 -- 172.21.15.92:0/1068150226 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2d301021c0 con 0x7f2d30102790 2024-09-19T09:12:29.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.588+0000 7f2d34803640 1 -- 172.21.15.92:0/1068150226 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f2d301021c0 con 0x7f2d30102790 2024-09-19T09:12:29.589 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:12:29.590 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:12:29.590 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:12:29.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.590+0000 7f2d35805640 1 -- 172.21.15.92:0/1068150226 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2d1c0a3240 msgr2=0x7f2d1c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:29.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.590+0000 7f2d35805640 1 --2- 172.21.15.92:0/1068150226 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2d1c0a3240 0x7f2d1c0a5700 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2d18006fd0 tx=0x7f2d18008040 comp rx=0 tx=0).stop 2024-09-19T09:12:29.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.590+0000 7f2d35805640 1 -- 172.21.15.92:0/1068150226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d30102790 msgr2=0x7f2d30198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:29.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.590+0000 7f2d35805640 1 --2- 172.21.15.92:0/1068150226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d30102790 0x7f2d30198950 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f2d20005ab0 tx=0x7f2d200042f0 comp rx=0 tx=0).stop 2024-09-19T09:12:29.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.590+0000 7f2d35805640 1 -- 172.21.15.92:0/1068150226 shutdown_connections 2024-09-19T09:12:29.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.590+0000 7f2d35805640 1 --2- 172.21.15.92:0/1068150226 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2d30106f10 0x7f2d3019cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:29.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.590+0000 7f2d35805640 1 --2- 172.21.15.92:0/1068150226 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f2d1c0a3240 0x7f2d1c0a5700 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:29.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.590+0000 7f2d35805640 1 --2- 172.21.15.92:0/1068150226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d30102790 0x7f2d30198950 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:29.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.590+0000 7f2d35805640 1 --2- 172.21.15.92:0/1068150226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d30101de0 0x7f2d30198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:29.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.591+0000 7f2d35805640 1 -- 172.21.15.92:0/1068150226 >> 172.21.15.92:0/1068150226 conn(0x7f2d300fd8c0 msgr2=0x7f2d300fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:29.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.591+0000 7f2d35805640 1 -- 172.21.15.92:0/1068150226 shutdown_connections 2024-09-19T09:12:29.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:29.591+0000 7f2d35805640 1 -- 172.21.15.92:0/1068150226 wait complete. 2024-09-19T09:12:30.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:29 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1068150226' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:12:30.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:29 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/1068150226' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:12:30.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:29 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/1068150226' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:12:30.247 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:12:30.491 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:12:30.903 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:30 smithi092 ceph-mon[31407]: pgmap v811: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 793 KiB/s wr, 86 op/s 2024-09-19T09:12:30.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.903+0000 7fc1a9bcc640 1 -- 172.21.15.92:0/4173461172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1a4106a80 msgr2=0x7fc1a4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:30.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.903+0000 7fc1a9bcc640 1 --2- 172.21.15.92:0/4173461172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1a4106a80 0x7fc1a4106e60 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fc194009cd0 tx=0x7fc19402a8e0 comp rx=0 tx=0).stop 2024-09-19T09:12:30.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.903+0000 7fc1a9bcc640 1 -- 172.21.15.92:0/4173461172 shutdown_connections 2024-09-19T09:12:30.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.903+0000 7fc1a9bcc640 1 --2- 172.21.15.92:0/4173461172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1a4101420 0x7fc1a410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:30.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.903+0000 7fc1a9bcc640 1 --2- 172.21.15.92:0/4173461172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1a4100a80 0x7fc1a4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:30.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.903+0000 7fc1a9bcc640 1 --2- 172.21.15.92:0/4173461172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1a4106a80 0x7fc1a4106e60 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:30.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.903+0000 7fc1a9bcc640 1 -- 172.21.15.92:0/4173461172 >> 172.21.15.92:0/4173461172 conn(0x7fc1a40fc7a0 msgr2=0x7fc1a40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:30.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.903+0000 7fc1a9bcc640 1 -- 172.21.15.92:0/4173461172 shutdown_connections 2024-09-19T09:12:30.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.903+0000 7fc1a9bcc640 1 -- 172.21.15.92:0/4173461172 wait complete. 2024-09-19T09:12:30.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.904+0000 7fc1a9bcc640 1 Processor -- start 2024-09-19T09:12:30.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.904+0000 7fc1a9bcc640 1 -- start start 2024-09-19T09:12:30.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.904+0000 7fc1a9bcc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1a4100a80 0x7fc1a41973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:30.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.904+0000 7fc1a9bcc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1a4101420 0x7fc1a4197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:30.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.904+0000 7fc1a9bcc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1a4106a80 0x7fc1a419bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:30.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.904+0000 7fc1a9bcc640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a4110ec0 con 0x7fc1a4100a80 2024-09-19T09:12:30.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.904+0000 7fc1a9bcc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a4110d40 con 0x7fc1a4101420 2024-09-19T09:12:30.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.904+0000 7fc1a9bcc640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a4111040 con 0x7fc1a4106a80 2024-09-19T09:12:30.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.904+0000 7fc1a37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1a4100a80 0x7fc1a41973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:30.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.904+0000 7fc1a37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1a4100a80 0x7fc1a41973e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59574/0 (socket says 172.21.15.92:59574) 2024-09-19T09:12:30.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.904+0000 7fc1a37fe640 1 -- 172.21.15.92:0/2280381622 learned_addr learned my addr 172.21.15.92:0/2280381622 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:30.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.904+0000 7fc1a3fff640 1 --2- 172.21.15.92:0/2280381622 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1a4106a80 0x7fc1a419bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:30.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.904+0000 7fc1a2ffd640 1 --2- 172.21.15.92:0/2280381622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1a4101420 0x7fc1a4197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:30.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.904+0000 7fc1a37fe640 1 -- 172.21.15.92:0/2280381622 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1a4106a80 msgr2=0x7fc1a419bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:30.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.904+0000 7fc1a37fe640 1 --2- 172.21.15.92:0/2280381622 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1a4106a80 0x7fc1a419bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:30.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.904+0000 7fc1a37fe640 1 -- 172.21.15.92:0/2280381622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1a4101420 msgr2=0x7fc1a4197920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:30.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.904+0000 7fc1a37fe640 1 --2- 172.21.15.92:0/2280381622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1a4101420 0x7fc1a4197920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:30.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.904+0000 7fc1a37fe640 1 -- 172.21.15.92:0/2280381622 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1a419c390 con 0x7fc1a4100a80 2024-09-19T09:12:30.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.905+0000 7fc1a37fe640 1 --2- 172.21.15.92:0/2280381622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1a4100a80 0x7fc1a41973e0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fc19402ae00 tx=0x7fc194003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:30.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.905+0000 7fc1a0ff9640 1 -- 172.21.15.92:0/2280381622 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc194004040 con 0x7fc1a4100a80 2024-09-19T09:12:30.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.905+0000 7fc1a9bcc640 1 -- 172.21.15.92:0/2280381622 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1a419c620 con 0x7fc1a4100a80 2024-09-19T09:12:30.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.905+0000 7fc1a0ff9640 1 -- 172.21.15.92:0/2280381622 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1940046c0 con 0x7fc1a4100a80 2024-09-19T09:12:30.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.905+0000 7fc1a0ff9640 1 -- 172.21.15.92:0/2280381622 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc194046480 con 0x7fc1a4100a80 2024-09-19T09:12:30.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.905+0000 7fc1a9bcc640 1 -- 172.21.15.92:0/2280381622 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1a41a3f60 con 0x7fc1a4100a80 2024-09-19T09:12:30.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.907+0000 7fc1a0ff9640 1 -- 172.21.15.92:0/2280381622 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc1940305a0 con 0x7fc1a4100a80 2024-09-19T09:12:30.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.908+0000 7fc1a0ff9640 1 --2- 172.21.15.92:0/2280381622 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc18c0a3240 0x7fc18c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:30.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.908+0000 7fc1abfa5740 1 Processor -- start 2024-09-19T09:12:30.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.908+0000 7fc1abfa5740 1 -- start start 2024-09-19T09:12:30.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.908+0000 7fc1a2ffd640 1 --2- 172.21.15.92:0/2280381622 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc18c0a3240 0x7fc18c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:30.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.908+0000 7fc1a0ff9640 1 -- 172.21.15.92:0/2280381622 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc19402e030 con 0x7fc1a4100a80 2024-09-19T09:12:30.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.908+0000 7fc1abfa5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55726c21bb40 0x55726c21a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:30.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.908+0000 7fc1abfa5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55726c21a5d0 0x55726c21aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:30.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.908+0000 7fc1abfa5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55726c227580 0x55726c229970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:30.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.908+0000 7fc1abfa5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55726c1802f0 con 0x55726c227580 2024-09-19T09:12:30.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.908+0000 7fc1abfa5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55726c127cf0 con 0x55726c21a5d0 2024-09-19T09:12:30.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.908+0000 7fc1abfa5740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55726c17c2b0 con 0x55726c21bb40 2024-09-19T09:12:30.936 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.908+0000 7fc1a3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55726c227580 0x55726c229970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:30.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.908+0000 7fc1a3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55726c227580 0x55726c229970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59586/0 (socket says 172.21.15.92:59586) 2024-09-19T09:12:30.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.908+0000 7fc1a3fff640 1 -- 172.21.15.92:0/2636783941 learned_addr learned my addr 172.21.15.92:0/2636783941 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:30.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.908+0000 7fc1a37fe640 1 --2- 172.21.15.92:0/2636783941 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55726c21bb40 0x55726c21a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:30.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.908+0000 7fc1a2ffd640 1 --2- 172.21.15.92:0/2636783941 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55726c21a5d0 0x55726c21aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:30.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.908+0000 7fc1a3fff640 1 -- 172.21.15.92:0/2636783941 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55726c21bb40 msgr2=0x55726c21a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:30.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.908+0000 7fc1a3fff640 1 --2- 172.21.15.92:0/2636783941 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55726c21bb40 0x55726c21a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:30.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.908+0000 7fc1a3fff640 1 -- 172.21.15.92:0/2636783941 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55726c21a5d0 msgr2=0x55726c21aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:30.937 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.908+0000 7fc1a3fff640 1 --2- 172.21.15.92:0/2636783941 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55726c21a5d0 0x55726c21aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:30.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.908+0000 7fc1a3fff640 1 -- 172.21.15.92:0/2636783941 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55726c10c3a0 con 0x55726c227580 2024-09-19T09:12:30.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.908+0000 7fc1a37fe640 1 --2- 172.21.15.92:0/2636783941 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55726c21bb40 0x55726c21a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:12:30.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.908+0000 7fc1a2ffd640 1 --2- 172.21.15.92:0/2280381622 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc18c0a3240 0x7fc18c0a5700 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fc1a40fed90 tx=0x7fc198009c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:30.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.909+0000 7fc1a3fff640 1 --2- 172.21.15.92:0/2636783941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55726c227580 0x55726c229970 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fc19c00bc70 tx=0x7fc19c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108a4e8d0e2d2e60 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:30.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.909+0000 7fc189ffb640 1 -- 172.21.15.92:0/2636783941 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19c015070 con 0x55726c227580 2024-09-19T09:12:30.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.909+0000 7fc189ffb640 1 -- 172.21.15.92:0/2636783941 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc19c011920 con 0x55726c227580 2024-09-19T09:12:30.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.909+0000 7fc189ffb640 1 -- 172.21.15.92:0/2636783941 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19c010890 con 0x55726c227580 2024-09-19T09:12:30.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.909+0000 7fc1abfa5740 1 -- 172.21.15.92:0/2636783941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55726c227580 msgr2=0x55726c229970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:30.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.909+0000 7fc1abfa5740 1 --2- 172.21.15.92:0/2636783941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55726c227580 0x55726c229970 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fc19c00bc70 tx=0x7fc19c00f730 comp rx=0 tx=0).stop 2024-09-19T09:12:30.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.909+0000 7fc1abfa5740 1 -- 172.21.15.92:0/2636783941 shutdown_connections 2024-09-19T09:12:30.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.909+0000 7fc1abfa5740 1 --2- 172.21.15.92:0/2636783941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55726c227580 0x55726c229970 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:30.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.909+0000 7fc1abfa5740 1 --2- 172.21.15.92:0/2636783941 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55726c21a5d0 0x55726c21aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:30.938 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.909+0000 7fc1abfa5740 1 --2- 172.21.15.92:0/2636783941 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55726c21bb40 0x55726c21a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:30.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.910+0000 7fc1abfa5740 1 -- 172.21.15.92:0/2636783941 >> 172.21.15.92:0/2636783941 conn(0x55726c1e3310 msgr2=0x55726c216c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:30.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.910+0000 7fc1abfa5740 1 -- 172.21.15.92:0/2636783941 shutdown_connections 2024-09-19T09:12:30.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.910+0000 7fc1abfa5740 1 -- 172.21.15.92:0/2636783941 wait complete. 2024-09-19T09:12:30.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.910+0000 7fc1abfa5740 1 -- start start 2024-09-19T09:12:30.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.910+0000 7fc1abfa5740 1 Processor -- start 2024-09-19T09:12:30.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.910+0000 7fc1abfa5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55726c21a5d0 0x55726c226fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:30.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.910+0000 7fc1abfa5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55726c21bb40 0x55726c224250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:30.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.910+0000 7fc1abfa5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55726c227580 0x55726c224860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:30.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.910+0000 7fc1abfa5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55726c22a280 con 0x55726c227580 2024-09-19T09:12:30.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.910+0000 7fc1abfa5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55726c13b060 con 0x55726c21bb40 2024-09-19T09:12:30.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.910+0000 7fc1abfa5740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55726c22a400 con 0x55726c21a5d0 2024-09-19T09:12:30.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.910+0000 7fc1abfa5740 10 client.0 _ll_register_callbacks cb 0x55726be8e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:12:30.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.910+0000 7fc1a3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55726c227580 0x55726c224860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:30.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.910+0000 7fc1a3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55726c227580 0x55726c224860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59590/0 (socket says 172.21.15.92:59590) 2024-09-19T09:12:30.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.910+0000 7fc1a3fff640 1 -- 172.21.15.92:0/2214439009 learned_addr learned my addr 172.21.15.92:0/2214439009 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:30.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.911+0000 7fc1a37fe640 1 --2- 172.21.15.92:0/2214439009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55726c21a5d0 0x55726c226fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:30.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.911+0000 7fc1a2ffd640 1 --2- 172.21.15.92:0/2214439009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55726c21bb40 0x55726c224250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:30.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.911+0000 7fc1a3fff640 1 -- 172.21.15.92:0/2214439009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55726c21a5d0 msgr2=0x55726c226fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:30.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.911+0000 7fc1a3fff640 1 --2- 172.21.15.92:0/2214439009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55726c21a5d0 0x55726c226fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:30.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.911+0000 7fc1a3fff640 1 -- 172.21.15.92:0/2214439009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55726c21bb40 msgr2=0x55726c224250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:30.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.911+0000 7fc1a3fff640 1 --2- 172.21.15.92:0/2214439009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55726c21bb40 0x55726c224250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:30.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.911+0000 7fc1a3fff640 1 -- 172.21.15.92:0/2214439009 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55726bef13c0 con 0x55726c227580 2024-09-19T09:12:30.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.911+0000 7fc1a2ffd640 1 --2- 172.21.15.92:0/2214439009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55726c21bb40 0x55726c224250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:12:30.940 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.911+0000 7fc1a3fff640 1 --2- 172.21.15.92:0/2214439009 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55726c227580 0x55726c224860 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fc19c010410 tx=0x7fc19c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e201756e16e9fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:30.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.911+0000 7fc182ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:12:30.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.911+0000 7fc182ffd640 1 -- 172.21.15.92:0/2214439009 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19c015070 con 0x55726c227580 2024-09-19T09:12:30.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.911+0000 7fc182ffd640 1 -- 172.21.15.92:0/2214439009 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc19c011cd0 con 0x55726c227580 2024-09-19T09:12:30.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.911+0000 7fc1abfa5740 1 -- 172.21.15.92:0/2214439009 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc19c011920 con 0x55726c227580 2024-09-19T09:12:30.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.911+0000 7fc182ffd640 1 -- 172.21.15.92:0/2214439009 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc19c011750 con 0x55726c227580 2024-09-19T09:12:30.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.911+0000 7fc1abfa5740 10 client.19140 fetch_fsmap learned FSMap version 19 2024-09-19T09:12:30.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.911+0000 7fc1abfa5740 1 -- 172.21.15.92:0/2214439009 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55726c21d310 con 0x55726c227580 2024-09-19T09:12:30.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.911+0000 7fc182ffd640 1 -- 172.21.15.92:0/2214439009 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc19c011920 con 0x55726c227580 2024-09-19T09:12:30.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.912+0000 7fc182ffd640 1 -- 172.21.15.92:0/2214439009 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fc19c004c20 con 0x55726c227580 2024-09-19T09:12:30.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.912+0000 7fc1abfa5740 10 client.19140 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:12:30.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.912+0000 7fc1abfa5740 10 client.19140 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:12:30.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.912+0000 7fc1abfa5740 20 client.19140 populate_metadata read hostname 'smithi092' 2024-09-19T09:12:30.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.912+0000 7fc1abfa5740 1 --2- 172.21.15.92:0/2214439009 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55726c21e770 0x55726c21ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:30.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.912+0000 7fc1abfa5740 4 client.19140 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:12:30.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.912+0000 7fc1abfa5740 1 -- 172.21.15.92:0/2214439009 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55726c18d860 con 0x55726c21e770 2024-09-19T09:12:30.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.912+0000 7fc1a37fe640 1 --2- 172.21.15.92:0/2214439009 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55726c21e770 0x55726c21ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:30.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.912+0000 7fc1a37fe640 1 --2- 172.21.15.92:0/2214439009 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55726c21e770 0x55726c21ebc0 crc :-1 s=READY pgs=468 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fed22871b375de79 server_cookie=4826f2f449966723 in_seq=0 out_seq=0 2024-09-19T09:12:30.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.912+0000 7fc182ffd640 10 client.19140 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:12:30.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.913+0000 7fc182ffd640 1 -- 172.21.15.92:0/2214439009 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55726c18d860 con 0x55726c21e770 2024-09-19T09:12:30.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.913+0000 7fc182ffd640 10 client.19140 handle_command_reply: tid=0 2024-09-19T09:12:30.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.913+0000 7fc1abfa5740 1 client.19140 shutdown 2024-09-19T09:12:30.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.913+0000 7fc1abfa5740 1 -- 172.21.15.92:0/2214439009 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55726c227580 msgr2=0x55726c224860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:30.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.913+0000 7fc1abfa5740 1 --2- 172.21.15.92:0/2214439009 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55726c227580 0x55726c224860 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fc19c010410 tx=0x7fc19c00b910 comp rx=0 tx=0).stop 2024-09-19T09:12:30.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.913+0000 7fc1abfa5740 1 -- 172.21.15.92:0/2214439009 shutdown_connections 2024-09-19T09:12:30.942 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.913+0000 7fc1abfa5740 1 --2- 172.21.15.92:0/2214439009 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55726c21e770 0x55726c21ebc0 crc :-1 s=READY pgs=468 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:30.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.913+0000 7fc1abfa5740 1 --2- 172.21.15.92:0/2214439009 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55726c227580 0x55726c224860 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:30.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.913+0000 7fc1abfa5740 1 --2- 172.21.15.92:0/2214439009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55726c21bb40 0x55726c224250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:30.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.913+0000 7fc1abfa5740 1 --2- 172.21.15.92:0/2214439009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55726c21a5d0 0x55726c226fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:30.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.913+0000 7fc182ffd640 0 client.19140 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:12:30.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.913+0000 7fc1abfa5740 1 -- 172.21.15.92:0/2214439009 >> 172.21.15.92:0/2214439009 conn(0x55726c1e3310 msgr2=0x55726c21c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:30.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.913+0000 7fc1abfa5740 1 -- 172.21.15.92:0/2214439009 shutdown_connections 2024-09-19T09:12:30.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.914+0000 7fc1abfa5740 1 -- 172.21.15.92:0/2214439009 wait complete. 2024-09-19T09:12:30.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.914+0000 7fc1abfa5740 20 client.19140 trim_cache size 0 max 16384 2024-09-19T09:12:30.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.926+0000 7fc1abfa5740 1 Processor -- start 2024-09-19T09:12:30.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.926+0000 7fc1abfa5740 1 -- start start 2024-09-19T09:12:30.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.926+0000 7fc1abfa5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55726c21a5d0 0x55726c2336a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:30.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.926+0000 7fc1abfa5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55726c21bb40 0x55726c21f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:30.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.926+0000 7fc1abfa5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55726c227580 0x55726c23ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:30.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.926+0000 7fc1abfa5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a41a9310 con 0x55726c21a5d0 2024-09-19T09:12:30.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.926+0000 7fc1abfa5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a41abb90 con 0x55726c21bb40 2024-09-19T09:12:30.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.926+0000 7fc1abfa5740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a41a9980 con 0x55726c227580 2024-09-19T09:12:30.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.927+0000 7fc1a37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55726c21a5d0 0x55726c2336a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:30.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.927+0000 7fc1a37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55726c21a5d0 0x55726c2336a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59600/0 (socket says 172.21.15.92:59600) 2024-09-19T09:12:30.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.927+0000 7fc1a37fe640 1 -- 172.21.15.92:0/3249789315 learned_addr learned my addr 172.21.15.92:0/3249789315 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:30.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.927+0000 7fc1a37fe640 1 -- 172.21.15.92:0/3249789315 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55726c227580 msgr2=0x55726c23ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:30.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.927+0000 7fc1a37fe640 1 --2- 172.21.15.92:0/3249789315 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55726c227580 0x55726c23ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:30.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.927+0000 7fc1a37fe640 1 -- 172.21.15.92:0/3249789315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55726c21bb40 msgr2=0x55726c21f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:30.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.927+0000 7fc1a37fe640 1 --2- 172.21.15.92:0/3249789315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55726c21bb40 0x55726c21f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:30.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.927+0000 7fc1a37fe640 1 -- 172.21.15.92:0/3249789315 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55726c223190 con 0x55726c21a5d0 2024-09-19T09:12:30.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.927+0000 7fc1a37fe640 1 --2- 172.21.15.92:0/3249789315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55726c21a5d0 0x55726c2336a0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fc1940bd740 tx=0x7fc19403d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=873dfe985135b634 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:30.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.927+0000 7fc1897fa640 1 -- 172.21.15.92:0/3249789315 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1940bd7b0 con 0x55726c21a5d0 2024-09-19T09:12:30.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.927+0000 7fc1897fa640 1 -- 172.21.15.92:0/3249789315 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc194036040 con 0x55726c21a5d0 2024-09-19T09:12:30.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.927+0000 7fc1897fa640 1 -- 172.21.15.92:0/3249789315 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1940b9e20 con 0x55726c21a5d0 2024-09-19T09:12:30.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.928+0000 7fc1abfa5740 1 -- 172.21.15.92:0/3249789315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55726c21a5d0 msgr2=0x55726c2336a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:30.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.928+0000 7fc1abfa5740 1 --2- 172.21.15.92:0/3249789315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55726c21a5d0 0x55726c2336a0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fc1940bd740 tx=0x7fc19403d040 comp rx=0 tx=0).stop 2024-09-19T09:12:30.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.928+0000 7fc1abfa5740 1 -- 172.21.15.92:0/3249789315 shutdown_connections 2024-09-19T09:12:30.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.928+0000 7fc1abfa5740 1 --2- 172.21.15.92:0/3249789315 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55726c227580 0x55726c23ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:30.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.928+0000 7fc1abfa5740 1 --2- 172.21.15.92:0/3249789315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55726c21bb40 0x55726c21f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:30.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.928+0000 7fc1abfa5740 1 --2- 172.21.15.92:0/3249789315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55726c21a5d0 0x55726c2336a0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:30.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.928+0000 7fc1abfa5740 1 -- 172.21.15.92:0/3249789315 >> 172.21.15.92:0/3249789315 conn(0x55726c1e3310 msgr2=0x55726c21f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:30.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.928+0000 7fc1abfa5740 1 -- 172.21.15.92:0/3249789315 shutdown_connections 2024-09-19T09:12:30.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.928+0000 7fc1abfa5740 1 -- 172.21.15.92:0/3249789315 wait complete. 2024-09-19T09:12:30.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.928+0000 7fc1abfa5740 1 -- start start 2024-09-19T09:12:30.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.928+0000 7fc1abfa5740 1 Processor -- start 2024-09-19T09:12:30.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.928+0000 7fc1abfa5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55726c21a5d0 0x55726c23b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:30.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.928+0000 7fc1abfa5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55726c21bb40 0x55726c238850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:30.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.928+0000 7fc1abfa5740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55726c227580 0x55726c238df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:30.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.929+0000 7fc1abfa5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a41aa050 con 0x55726c21a5d0 2024-09-19T09:12:30.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.929+0000 7fc1abfa5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a41ab4c0 con 0x55726c21bb40 2024-09-19T09:12:30.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.929+0000 7fc1abfa5740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a41aa720 con 0x55726c227580 2024-09-19T09:12:30.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.929+0000 7fc1abfa5740 10 client.0 _ll_register_callbacks cb 0x7fc19c00bac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:12:30.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.929+0000 7fc1a37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55726c21a5d0 0x55726c23b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:30.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.929+0000 7fc1a37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55726c21a5d0 0x55726c23b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59610/0 (socket says 172.21.15.92:59610) 2024-09-19T09:12:30.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.929+0000 7fc1a37fe640 1 -- 172.21.15.92:0/246730375 learned_addr learned my addr 172.21.15.92:0/246730375 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:30.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.929+0000 7fc1a2ffd640 1 --2- 172.21.15.92:0/246730375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55726c21bb40 0x55726c238850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:30.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.929+0000 7fc1a3fff640 1 --2- 172.21.15.92:0/246730375 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55726c227580 0x55726c238df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:30.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.929+0000 7fc1a37fe640 1 -- 172.21.15.92:0/246730375 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55726c227580 msgr2=0x55726c238df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:30.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.929+0000 7fc1a37fe640 1 --2- 172.21.15.92:0/246730375 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55726c227580 0x55726c238df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:30.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.929+0000 7fc1a37fe640 1 -- 172.21.15.92:0/246730375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55726c21bb40 msgr2=0x55726c238850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:12:30.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.929+0000 7fc1a37fe640 1 --2- 172.21.15.92:0/246730375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55726c21bb40 0x55726c238850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:30.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.929+0000 7fc1a37fe640 1 -- 172.21.15.92:0/246730375 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55726c239620 con 0x55726c21a5d0 2024-09-19T09:12:30.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.929+0000 7fc1a37fe640 1 --2- 172.21.15.92:0/246730375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55726c21a5d0 0x55726c23b4b0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fc194000f80 tx=0x7fc194003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b75f3c4cbd659e8b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:30.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.929+0000 7fc182ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T09:12:30.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.929+0000 7fc182ffd640 1 -- 172.21.15.92:0/246730375 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc194087030 con 0x55726c21a5d0 2024-09-19T09:12:30.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.929+0000 7fc182ffd640 1 -- 172.21.15.92:0/246730375 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fc1940db040 con 0x55726c21a5d0 2024-09-19T09:12:30.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.929+0000 7fc1abfa5740 1 -- 172.21.15.92:0/246730375 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc194036040 con 0x55726c21a5d0 2024-09-19T09:12:30.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.929+0000 7fc182ffd640 1 -- 172.21.15.92:0/246730375 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc1940c6420 con 0x55726c21a5d0 2024-09-19T09:12:30.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.929+0000 7fc1abfa5740 10 client.19146 fetch_fsmap learned FSMap version 19 2024-09-19T09:12:30.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.929+0000 7fc1abfa5740 1 -- 172.21.15.92:0/246730375 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55726c29fe40 con 0x55726c21a5d0 2024-09-19T09:12:30.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.930+0000 7fc182ffd640 1 -- 172.21.15.92:0/246730375 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc194036040 con 0x55726c21a5d0 2024-09-19T09:12:30.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.930+0000 7fc182ffd640 1 -- 172.21.15.92:0/246730375 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fc19404e070 con 0x55726c21a5d0 2024-09-19T09:12:30.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.930+0000 7fc1abfa5740 10 client.19146 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:12:30.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.930+0000 7fc1abfa5740 10 client.19146 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T09:12:30.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.930+0000 7fc1abfa5740 20 client.19146 populate_metadata read hostname 'smithi092' 2024-09-19T09:12:30.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.930+0000 7fc1abfa5740 1 --2- 172.21.15.92:0/246730375 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55726c2a0560 0x55726c2a2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:30.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.930+0000 7fc1abfa5740 4 client.19146 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:12:30.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.930+0000 7fc1abfa5740 1 -- 172.21.15.92:0/246730375 --> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55726c21f0f0 con 0x55726c2a0560 2024-09-19T09:12:30.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.930+0000 7fc1a2ffd640 1 --2- 172.21.15.92:0/246730375 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55726c2a0560 0x55726c2a2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:30.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.931+0000 7fc182ffd640 10 client.19146 ms_handle_connect on v2:172.21.15.190:6838/3861238400 2024-09-19T09:12:30.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.931+0000 7fc1a2ffd640 1 --2- 172.21.15.92:0/246730375 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55726c2a0560 0x55726c2a2980 crc :-1 s=READY pgs=469 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54b2d2ddfd99eba6 server_cookie=389ff9db3b1a4955 in_seq=0 out_seq=0 2024-09-19T09:12:30.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.931+0000 7fc182ffd640 1 -- 172.21.15.92:0/246730375 <== mds.0 v2:172.21.15.190:6838/3861238400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55726c21f0f0 con 0x55726c2a0560 2024-09-19T09:12:30.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.931+0000 7fc182ffd640 10 client.19146 handle_command_reply: tid=0 2024-09-19T09:12:30.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.931+0000 7fc1abfa5740 1 client.19146 shutdown 2024-09-19T09:12:30.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.931+0000 7fc1abfa5740 1 -- 172.21.15.92:0/246730375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55726c21a5d0 msgr2=0x55726c23b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:30.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.931+0000 7fc1abfa5740 1 --2- 172.21.15.92:0/246730375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55726c21a5d0 0x55726c23b4b0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fc194000f80 tx=0x7fc194003f70 comp rx=0 tx=0).stop 2024-09-19T09:12:30.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.931+0000 7fc1abfa5740 1 -- 172.21.15.92:0/246730375 shutdown_connections 2024-09-19T09:12:30.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.931+0000 7fc1abfa5740 1 --2- 172.21.15.92:0/246730375 >> [v2:172.21.15.190:6838/3861238400,v1:172.21.15.190:6839/3861238400] conn(0x55726c2a0560 0x55726c2a2980 crc :-1 s=READY pgs=469 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:30.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.931+0000 7fc1abfa5740 1 --2- 172.21.15.92:0/246730375 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55726c227580 0x55726c238df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:30.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.931+0000 7fc1abfa5740 1 --2- 172.21.15.92:0/246730375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55726c21bb40 0x55726c238850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:30.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.931+0000 7fc1abfa5740 1 --2- 172.21.15.92:0/246730375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55726c21a5d0 0x55726c23b4b0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:30.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.931+0000 7fc1abfa5740 1 -- 172.21.15.92:0/246730375 >> 172.21.15.92:0/246730375 conn(0x55726c1e3310 msgr2=0x55726c2154e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:30.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.931+0000 7fc182ffd640 0 client.19146 ms_handle_reset on v2:172.21.15.190:6838/3861238400 2024-09-19T09:12:30.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.931+0000 7fc1abfa5740 1 -- 172.21.15.92:0/246730375 shutdown_connections 2024-09-19T09:12:30.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.931+0000 7fc1abfa5740 1 -- 172.21.15.92:0/246730375 wait complete. 2024-09-19T09:12:30.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.931+0000 7fc1abfa5740 20 client.19146 trim_cache size 0 max 16384 2024-09-19T09:12:30.950 INFO:teuthology.orchestra.run.smithi092.stdout:[] 2024-09-19T09:12:30.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.932+0000 7fc1a9bcc640 1 -- 172.21.15.92:0/2280381622 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc18c0a3240 msgr2=0x7fc18c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:30.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.932+0000 7fc1a9bcc640 1 --2- 172.21.15.92:0/2280381622 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc18c0a3240 0x7fc18c0a5700 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fc1a40fed90 tx=0x7fc198009c70 comp rx=0 tx=0).stop 2024-09-19T09:12:30.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.932+0000 7fc1a9bcc640 1 -- 172.21.15.92:0/2280381622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1a4100a80 msgr2=0x7fc1a41973e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:30.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.932+0000 7fc1a9bcc640 1 --2- 172.21.15.92:0/2280381622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1a4100a80 0x7fc1a41973e0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fc19402ae00 tx=0x7fc194003970 comp rx=0 tx=0).stop 2024-09-19T09:12:30.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.932+0000 7fc1a9bcc640 1 -- 172.21.15.92:0/2280381622 shutdown_connections 2024-09-19T09:12:30.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.932+0000 7fc1a9bcc640 1 --2- 172.21.15.92:0/2280381622 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1a4106a80 0x7fc1a419bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:30.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.932+0000 7fc1a9bcc640 1 --2- 172.21.15.92:0/2280381622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1a4101420 0x7fc1a4197920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:30.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.932+0000 7fc1a9bcc640 1 --2- 172.21.15.92:0/2280381622 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fc18c0a3240 0x7fc18c0a5700 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:30.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.932+0000 7fc1a9bcc640 1 --2- 172.21.15.92:0/2280381622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1a4100a80 0x7fc1a41973e0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:30.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.932+0000 7fc1a9bcc640 1 -- 172.21.15.92:0/2280381622 >> 172.21.15.92:0/2280381622 conn(0x7fc1a40fc7a0 msgr2=0x7fc1a40fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:30.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.932+0000 7fc1a9bcc640 1 -- 172.21.15.92:0/2280381622 shutdown_connections 2024-09-19T09:12:30.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:30.932+0000 7fc1a9bcc640 1 -- 172.21.15.92:0/2280381622 wait complete. 2024-09-19T09:12:31.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:30 smithi167 ceph-mon[35359]: pgmap v811: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 793 KiB/s wr, 86 op/s 2024-09-19T09:12:31.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:30 smithi190 ceph-mon[35358]: pgmap v811: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 793 KiB/s wr, 86 op/s 2024-09-19T09:12:31.444 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-19T09:12:31.445 INFO:tasks.fwd_scrub:done joining 2024-09-19T09:12:31.445 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-19T09:12:31.463 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:12:31.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.566+0000 7f4dd81be640 1 -- 172.21.15.92:0/2289676935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4dd01025c0 msgr2=0x7f4dd0108e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:31.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.566+0000 7f4dd81be640 1 --2- 172.21.15.92:0/2289676935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4dd01025c0 0x7f4dd0108e50 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8009ca0 tx=0x7f4dc802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:12:31.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.566+0000 7f4dd81be640 1 -- 172.21.15.92:0/2289676935 shutdown_connections 2024-09-19T09:12:31.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.566+0000 7f4dd81be640 1 --2- 172.21.15.92:0/2289676935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4dd01025c0 0x7f4dd0108e50 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:31.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.566+0000 7f4dd81be640 1 --2- 172.21.15.92:0/2289676935 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4dd0101c00 0x7f4dd0102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:31.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.566+0000 7f4dd81be640 1 --2- 172.21.15.92:0/2289676935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dd0100a10 0x7f4dd0100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:31.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.566+0000 7f4dd81be640 1 -- 172.21.15.92:0/2289676935 >> 172.21.15.92:0/2289676935 conn(0x7f4dd00fc170 msgr2=0x7f4dd00fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:31.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.566+0000 7f4dd81be640 1 -- 172.21.15.92:0/2289676935 shutdown_connections 2024-09-19T09:12:31.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.566+0000 7f4dd81be640 1 -- 172.21.15.92:0/2289676935 wait complete. 2024-09-19T09:12:31.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.567+0000 7f4dd81be640 1 Processor -- start 2024-09-19T09:12:31.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.567+0000 7f4dd81be640 1 -- start start 2024-09-19T09:12:31.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.567+0000 7f4dd81be640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dd0100a10 0x7f4dd010b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:31.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.567+0000 7f4dd81be640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4dd0101c00 0x7f4dd01099d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:31.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.567+0000 7f4dd81be640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4dd01025c0 0x7f4dd0109f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:31.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.567+0000 7f4dd81be640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd010d7e0 con 0x7f4dd0101c00 2024-09-19T09:12:31.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.567+0000 7f4dd81be640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd010d660 con 0x7f4dd0100a10 2024-09-19T09:12:31.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.567+0000 7f4dd81be640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd010d960 con 0x7f4dd01025c0 2024-09-19T09:12:31.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.567+0000 7f4dd5759640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4dd0101c00 0x7f4dd01099d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:31.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.567+0000 7f4dd5759640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4dd0101c00 0x7f4dd01099d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52100/0 (socket says 172.21.15.92:52100) 2024-09-19T09:12:31.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.567+0000 7f4dd5759640 1 -- 172.21.15.92:0/4136902161 learned_addr learned my addr 172.21.15.92:0/4136902161 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:31.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.567+0000 7f4dd5f5a640 1 --2- 172.21.15.92:0/4136902161 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dd0100a10 0x7f4dd010b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:31.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.567+0000 7f4dd675b640 1 --2- 172.21.15.92:0/4136902161 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4dd01025c0 0x7f4dd0109f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:31.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.567+0000 7f4dd5759640 1 -- 172.21.15.92:0/4136902161 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4dd01025c0 msgr2=0x7f4dd0109f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:31.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.567+0000 7f4dd5759640 1 --2- 172.21.15.92:0/4136902161 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4dd01025c0 0x7f4dd0109f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:31.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.567+0000 7f4dd5759640 1 -- 172.21.15.92:0/4136902161 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dd0100a10 msgr2=0x7f4dd010b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:31.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.567+0000 7f4dd5759640 1 --2- 172.21.15.92:0/4136902161 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dd0100a10 0x7f4dd010b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:31.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.567+0000 7f4dd5759640 1 -- 172.21.15.92:0/4136902161 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dd010a7a0 con 0x7f4dd0101c00 2024-09-19T09:12:31.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.567+0000 7f4dd5f5a640 1 --2- 172.21.15.92:0/4136902161 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dd0100a10 0x7f4dd010b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:12:31.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.567+0000 7f4dd5759640 1 --2- 172.21.15.92:0/4136902161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4dd0101c00 0x7f4dd01099d0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f4dc400c920 tx=0x7f4dc400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:31.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.568+0000 7f4dc2ffd640 1 -- 172.21.15.92:0/4136902161 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc4007c70 con 0x7f4dd0101c00 2024-09-19T09:12:31.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.568+0000 7f4dc2ffd640 1 -- 172.21.15.92:0/4136902161 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4dc4007e10 con 0x7f4dd0101c00 2024-09-19T09:12:31.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.568+0000 7f4dd81be640 1 -- 172.21.15.92:0/4136902161 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dd01a1ea0 con 0x7f4dd0101c00 2024-09-19T09:12:31.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.568+0000 7f4dc2ffd640 1 -- 172.21.15.92:0/4136902161 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc4018890 con 0x7f4dd0101c00 2024-09-19T09:12:31.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.568+0000 7f4dd81be640 1 -- 172.21.15.92:0/4136902161 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dd01a2300 con 0x7f4dd0101c00 2024-09-19T09:12:31.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.569+0000 7f4dd81be640 1 -- 172.21.15.92:0/4136902161 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dd0107d30 con 0x7f4dd0101c00 2024-09-19T09:12:31.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.570+0000 7f4dc2ffd640 1 -- 172.21.15.92:0/4136902161 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4dc4018a70 con 0x7f4dd0101c00 2024-09-19T09:12:31.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.570+0000 7f4dc2ffd640 1 --2- 172.21.15.92:0/4136902161 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4dbc0a3250 0x7f4dbc0a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:31.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.570+0000 7f4dc2ffd640 1 -- 172.21.15.92:0/4136902161 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f4dc40cfad0 con 0x7f4dd0101c00 2024-09-19T09:12:31.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.570+0000 7f4dd5f5a640 1 --2- 172.21.15.92:0/4136902161 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4dbc0a3250 0x7f4dbc0a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:31.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.571+0000 7f4dd5f5a640 1 --2- 172.21.15.92:0/4136902161 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4dbc0a3250 0x7f4dbc0a5710 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc0058c0 tx=0x7f4dcc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:31.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.575+0000 7f4dc2ffd640 1 -- 172.21.15.92:0/4136902161 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4dc4014030 con 0x7f4dd0101c00 2024-09-19T09:12:31.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.748+0000 7f4dd81be640 1 -- 172.21.15.92:0/4136902161 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4dd0062f70 con 0x7f4dd0101c00 2024-09-19T09:12:31.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.750+0000 7f4dc2ffd640 1 -- 172.21.15.92:0/4136902161 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22782 (secure 0 0 0) 0x7f4dc400de20 con 0x7f4dd0101c00 2024-09-19T09:12:31.751 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:12:31.751 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":82,"fsid":"91ff74f2-7663-11ef-bceb-c7b262605968","created":"2024-09-19T08:47:08.162150+0000","modified":"2024-09-19T08:54:53.324204+0000","last_up_change":"2024-09-19T08:53:43.021949+0000","last_in_change":"2024-09-19T08:53:19.246805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:50:04.482034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:54:28.005336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:54:30.188980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd104fe2-b828-4c98-a499-b212717f2997","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6803","nonce":4232030626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6805","nonce":4232030626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6809","nonce":4232030626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6807","nonce":4232030626}]},"public_addr":"172.21.15.92:6803/4232030626","cluster_addr":"172.21.15.92:6805/4232030626","heartbeat_back_addr":"172.21.15.92:6809/4232030626","heartbeat_front_addr":"172.21.15.92:6807/4232030626","state":["exists","up"]},{"osd":1,"uuid":"0f725330-5e61-413c-b3c8-41bc2c0d8e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6801","nonce":4163493234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6803","nonce":4163493234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6807","nonce":4163493234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6805","nonce":4163493234}]},"public_addr":"172.21.15.167:6801/4163493234","cluster_addr":"172.21.15.167:6803/4163493234","heartbeat_back_addr":"172.21.15.167:6807/4163493234","heartbeat_front_addr":"172.21.15.167:6805/4163493234","state":["exists","up"]},{"osd":2,"uuid":"286d2943-23a0-4184-93cf-9d3430781f99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6801","nonce":702507556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6803","nonce":702507556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6807","nonce":702507556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6805","nonce":702507556}]},"public_addr":"172.21.15.190:6801/702507556","cluster_addr":"172.21.15.190:6803/702507556","heartbeat_back_addr":"172.21.15.190:6807/702507556","heartbeat_front_addr":"172.21.15.190:6805/702507556","state":["exists","up"]},{"osd":3,"uuid":"9d126671-7fc1-4f29-9bc3-3598052fd20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6811","nonce":945752895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6813","nonce":945752895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6817","nonce":945752895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6815","nonce":945752895}]},"public_addr":"172.21.15.92:6811/945752895","cluster_addr":"172.21.15.92:6813/945752895","heartbeat_back_addr":"172.21.15.92:6817/945752895","heartbeat_front_addr":"172.21.15.92:6815/945752895","state":["exists","up"]},{"osd":4,"uuid":"cb10b38d-ae13-4b92-b906-3505fb873b2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6809","nonce":3576893400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6811","nonce":3576893400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6815","nonce":3576893400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6813","nonce":3576893400}]},"public_addr":"172.21.15.167:6809/3576893400","cluster_addr":"172.21.15.167:6811/3576893400","heartbeat_back_addr":"172.21.15.167:6815/3576893400","heartbeat_front_addr":"172.21.15.167:6813/3576893400","state":["exists","up"]},{"osd":5,"uuid":"cd90668b-eca5-4bb4-870e-e58578730c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6809","nonce":1880491675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6811","nonce":1880491675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6815","nonce":1880491675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6813","nonce":1880491675}]},"public_addr":"172.21.15.190:6809/1880491675","cluster_addr":"172.21.15.190:6811/1880491675","heartbeat_back_addr":"172.21.15.190:6815/1880491675","heartbeat_front_addr":"172.21.15.190:6813/1880491675","state":["exists","up"]},{"osd":6,"uuid":"4e047963-afa7-4934-b887-8086165fb831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6819","nonce":1743435653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6821","nonce":1743435653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6825","nonce":1743435653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6823","nonce":1743435653}]},"public_addr":"172.21.15.92:6819/1743435653","cluster_addr":"172.21.15.92:6821/1743435653","heartbeat_back_addr":"172.21.15.92:6825/1743435653","heartbeat_front_addr":"172.21.15.92:6823/1743435653","state":["exists","up"]},{"osd":7,"uuid":"652a6aa1-bb94-4608-952e-67cd02bdff66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6817","nonce":2984111963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6819","nonce":2984111963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6823","nonce":2984111963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6821","nonce":2984111963}]},"public_addr":"172.21.15.167:6817/2984111963","cluster_addr":"172.21.15.167:6819/2984111963","heartbeat_back_addr":"172.21.15.167:6823/2984111963","heartbeat_front_addr":"172.21.15.167:6821/2984111963","state":["exists","up"]},{"osd":8,"uuid":"1510ef1f-fdfe-4887-a771-146efce062fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6817","nonce":4190304434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6819","nonce":4190304434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6823","nonce":4190304434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6821","nonce":4190304434}]},"public_addr":"172.21.15.190:6817/4190304434","cluster_addr":"172.21.15.190:6819/4190304434","heartbeat_back_addr":"172.21.15.190:6823/4190304434","heartbeat_front_addr":"172.21.15.190:6821/4190304434","state":["exists","up"]},{"osd":9,"uuid":"9b774bbe-6700-4020-900b-3fdbaa546773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6827","nonce":3066744542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6829","nonce":3066744542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6833","nonce":3066744542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6831","nonce":3066744542}]},"public_addr":"172.21.15.92:6827/3066744542","cluster_addr":"172.21.15.92:6829/3066744542","heartbeat_back_addr":"172.21.15.92:6833/3066744542","heartbeat_front_addr":"172.21.15.92:6831/3066744542","state":["exists","up"]},{"osd":10,"uuid":"8abdb835-db2c-4597-ae1d-8ef56e63ab6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6825","nonce":2309134313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6827","nonce":2309134313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6831","nonce":2309134313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6829","nonce":2309134313}]},"public_addr":"172.21.15.167:6825/2309134313","cluster_addr":"172.21.15.167:6827/2309134313","heartbeat_back_addr":"172.21.15.167:6831/2309134313","heartbeat_front_addr":"172.21.15.167:6829/2309134313","state":["exists","up"]},{"osd":11,"uuid":"564c844a-378f-40cd-9717-cde35a65631c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6825","nonce":1849208751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6827","nonce":1849208751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6831","nonce":1849208751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6829","nonce":1849208751}]},"public_addr":"172.21.15.190:6825/1849208751","cluster_addr":"172.21.15.190:6827/1849208751","heartbeat_back_addr":"172.21.15.190:6831/1849208751","heartbeat_front_addr":"172.21.15.190:6829/1849208751","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:12.072109+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:36.689174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:01.908763+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:26.857439+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:50.881629+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:51:15.160744+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:51:39.101605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:03.179877+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:27.324563+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:51.971287+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:53:15.917311+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:53:40.592486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/2948821221":"2024-09-20T08:47:52.180093+0000","172.21.15.92:0/1441365956":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6801/2908709470":"2024-09-20T08:47:52.180093+0000","172.21.15.92:0/608374871":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6801/1369295034":"2024-09-20T08:47:29.812397+0000","172.21.15.92:6800/2908709470":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6800/1369295034":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/813486656":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/1963725565":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/1668504617":"2024-09-20T08:47:29.812397+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:12:31.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.752+0000 7f4dd81be640 1 -- 172.21.15.92:0/4136902161 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4dbc0a3250 msgr2=0x7f4dbc0a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:31.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.752+0000 7f4dd81be640 1 --2- 172.21.15.92:0/4136902161 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4dbc0a3250 0x7f4dbc0a5710 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc0058c0 tx=0x7f4dcc005850 comp rx=0 tx=0).stop 2024-09-19T09:12:31.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.752+0000 7f4dd81be640 1 -- 172.21.15.92:0/4136902161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4dd0101c00 msgr2=0x7f4dd01099d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:31.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.752+0000 7f4dd81be640 1 --2- 172.21.15.92:0/4136902161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4dd0101c00 0x7f4dd01099d0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f4dc400c920 tx=0x7f4dc400cde0 comp rx=0 tx=0).stop 2024-09-19T09:12:31.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.752+0000 7f4dd81be640 1 -- 172.21.15.92:0/4136902161 shutdown_connections 2024-09-19T09:12:31.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.752+0000 7f4dd81be640 1 --2- 172.21.15.92:0/4136902161 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4dd01025c0 0x7f4dd0109f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:31.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.752+0000 7f4dd81be640 1 --2- 172.21.15.92:0/4136902161 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f4dbc0a3250 0x7f4dbc0a5710 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:31.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.752+0000 7f4dd81be640 1 --2- 172.21.15.92:0/4136902161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4dd0101c00 0x7f4dd01099d0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:31.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.752+0000 7f4dd81be640 1 --2- 172.21.15.92:0/4136902161 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dd0100a10 0x7f4dd010b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:31.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.752+0000 7f4dd81be640 1 -- 172.21.15.92:0/4136902161 >> 172.21.15.92:0/4136902161 conn(0x7f4dd00fc170 msgr2=0x7f4dd0104f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:31.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.752+0000 7f4dd81be640 1 -- 172.21.15.92:0/4136902161 shutdown_connections 2024-09-19T09:12:31.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.752+0000 7f4dd81be640 1 -- 172.21.15.92:0/4136902161 wait complete. 2024-09-19T09:12:31.764 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T08:50:04.482034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T08:54:28.005336+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T08:54:30.188980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T09:12:31.764 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T09:12:31.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.865+0000 7fd5c2277640 1 -- 172.21.15.92:0/967231265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5bc102d00 msgr2=0x7fd5bc103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:31.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.865+0000 7fd5c2277640 1 --2- 172.21.15.92:0/967231265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5bc102d00 0x7fd5bc103180 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0009900 tx=0x7fd5b002a410 comp rx=0 tx=0).stop 2024-09-19T09:12:31.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.865+0000 7fd5c2277640 1 -- 172.21.15.92:0/967231265 shutdown_connections 2024-09-19T09:12:31.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.865+0000 7fd5c2277640 1 --2- 172.21.15.92:0/967231265 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5bc1036c0 0x7fd5bc109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:31.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.865+0000 7fd5c2277640 1 --2- 172.21.15.92:0/967231265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5bc102d00 0x7fd5bc103180 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:31.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.865+0000 7fd5c2277640 1 --2- 172.21.15.92:0/967231265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5bc101b10 0x7fd5bc101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:31.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.865+0000 7fd5c2277640 1 -- 172.21.15.92:0/967231265 >> 172.21.15.92:0/967231265 conn(0x7fd5bc0fd2b0 msgr2=0x7fd5bc0ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:31.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.865+0000 7fd5c2277640 1 -- 172.21.15.92:0/967231265 shutdown_connections 2024-09-19T09:12:31.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.865+0000 7fd5c2277640 1 -- 172.21.15.92:0/967231265 wait complete. 2024-09-19T09:12:31.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.866+0000 7fd5c2277640 1 Processor -- start 2024-09-19T09:12:31.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.866+0000 7fd5c2277640 1 -- start start 2024-09-19T09:12:31.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.866+0000 7fd5c2277640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5bc101b10 0x7fd5bc197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:31.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.866+0000 7fd5c2277640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5bc102d00 0x7fd5bc1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:31.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.866+0000 7fd5c2277640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5bc1036c0 0x7fd5bc19f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:31.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.866+0000 7fd5c2277640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd5bc10d7f0 con 0x7fd5bc102d00 2024-09-19T09:12:31.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.866+0000 7fd5c2277640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd5bc10d670 con 0x7fd5bc1036c0 2024-09-19T09:12:31.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.866+0000 7fd5c2277640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd5bc10d970 con 0x7fd5bc101b10 2024-09-19T09:12:31.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.866+0000 7fd5bb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5bc102d00 0x7fd5bc1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:31.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.866+0000 7fd5bb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5bc102d00 0x7fd5bc1983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52130/0 (socket says 172.21.15.92:52130) 2024-09-19T09:12:31.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.866+0000 7fd5bb7fe640 1 -- 172.21.15.92:0/105140918 learned_addr learned my addr 172.21.15.92:0/105140918 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:31.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.867+0000 7fd5bb7fe640 1 -- 172.21.15.92:0/105140918 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5bc101b10 msgr2=0x7fd5bc197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:31.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.867+0000 7fd5bb7fe640 1 --2- 172.21.15.92:0/105140918 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5bc101b10 0x7fd5bc197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:31.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.867+0000 7fd5bb7fe640 1 -- 172.21.15.92:0/105140918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5bc1036c0 msgr2=0x7fd5bc19f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:31.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.867+0000 7fd5bb7fe640 1 --2- 172.21.15.92:0/105140918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5bc1036c0 0x7fd5bc19f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:31.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.867+0000 7fd5bb7fe640 1 -- 172.21.15.92:0/105140918 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5bc19fac0 con 0x7fd5bc102d00 2024-09-19T09:12:31.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.867+0000 7fd5bb7fe640 1 --2- 172.21.15.92:0/105140918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5bc102d00 0x7fd5bc1983e0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0009230 tx=0x7fd5b0004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:31.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.867+0000 7fd5b97fa640 1 -- 172.21.15.92:0/105140918 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b003f030 con 0x7fd5bc102d00 2024-09-19T09:12:31.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.867+0000 7fd5b97fa640 1 -- 172.21.15.92:0/105140918 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5b0003ce0 con 0x7fd5bc102d00 2024-09-19T09:12:31.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.867+0000 7fd5b97fa640 1 -- 172.21.15.92:0/105140918 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b0035070 con 0x7fd5bc102d00 2024-09-19T09:12:31.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.867+0000 7fd5c2277640 1 -- 172.21.15.92:0/105140918 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5bc19fd50 con 0x7fd5bc102d00 2024-09-19T09:12:31.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.867+0000 7fd5c2277640 1 -- 172.21.15.92:0/105140918 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5bc1a0210 con 0x7fd5bc102d00 2024-09-19T09:12:31.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.868+0000 7fd5c2277640 1 -- 172.21.15.92:0/105140918 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5bc108f90 con 0x7fd5bc102d00 2024-09-19T09:12:31.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.869+0000 7fd5b97fa640 1 -- 172.21.15.92:0/105140918 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd5b0042030 con 0x7fd5bc102d00 2024-09-19T09:12:31.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.870+0000 7fd5b97fa640 1 --2- 172.21.15.92:0/105140918 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd5a40a3250 0x7fd5a40a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:31.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.870+0000 7fd5bbfff640 1 --2- 172.21.15.92:0/105140918 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd5a40a3250 0x7fd5a40a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:31.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.870+0000 7fd5b97fa640 1 -- 172.21.15.92:0/105140918 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fd5b00f0130 con 0x7fd5bc102d00 2024-09-19T09:12:31.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.870+0000 7fd5bbfff640 1 --2- 172.21.15.92:0/105140918 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd5a40a3250 0x7fd5a40a5710 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc102b60 tx=0x7fd5ac005c10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:31.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:31.874+0000 7fd5b97fa640 1 -- 172.21.15.92:0/105140918 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd5b00bce50 con 0x7fd5bc102d00 2024-09-19T09:12:32.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.038+0000 7fd5c2277640 1 -- 172.21.15.92:0/105140918 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd5bc062630 con 0x7fd5bc102d00 2024-09-19T09:12:32.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.038+0000 7fd5b97fa640 1 -- 172.21.15.92:0/105140918 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7fd5b00bc750 con 0x7fd5bc102d00 2024-09-19T09:12:32.039 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2024-09-19T09:12:32.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.040+0000 7fd5c2277640 1 -- 172.21.15.92:0/105140918 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd5a40a3250 msgr2=0x7fd5a40a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:32.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.040+0000 7fd5c2277640 1 --2- 172.21.15.92:0/105140918 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd5a40a3250 0x7fd5a40a5710 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc102b60 tx=0x7fd5ac005c10 comp rx=0 tx=0).stop 2024-09-19T09:12:32.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.040+0000 7fd5c2277640 1 -- 172.21.15.92:0/105140918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5bc102d00 msgr2=0x7fd5bc1983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:32.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.040+0000 7fd5c2277640 1 --2- 172.21.15.92:0/105140918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5bc102d00 0x7fd5bc1983e0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0009230 tx=0x7fd5b0004430 comp rx=0 tx=0).stop 2024-09-19T09:12:32.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.041+0000 7fd5c2277640 1 -- 172.21.15.92:0/105140918 shutdown_connections 2024-09-19T09:12:32.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.041+0000 7fd5c2277640 1 --2- 172.21.15.92:0/105140918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5bc1036c0 0x7fd5bc19f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.041+0000 7fd5c2277640 1 --2- 172.21.15.92:0/105140918 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fd5a40a3250 0x7fd5a40a5710 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.041+0000 7fd5c2277640 1 --2- 172.21.15.92:0/105140918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5bc102d00 0x7fd5bc1983e0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.041+0000 7fd5c2277640 1 --2- 172.21.15.92:0/105140918 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5bc101b10 0x7fd5bc197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.041+0000 7fd5c2277640 1 -- 172.21.15.92:0/105140918 >> 172.21.15.92:0/105140918 conn(0x7fd5bc0fd2b0 msgr2=0x7fd5bc106160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:32.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.041+0000 7fd5c2277640 1 -- 172.21.15.92:0/105140918 shutdown_connections 2024-09-19T09:12:32.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.041+0000 7fd5c2277640 1 -- 172.21.15.92:0/105140918 wait complete. 2024-09-19T09:12:32.051 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:31 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/4136902161' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:12:32.052 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T09:12:32.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:31 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/4136902161' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:12:32.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:31 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/4136902161' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:12:32.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.154+0000 7f6f059bd640 1 -- 172.21.15.92:0/2914412396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f001016a0 msgr2=0x7f6f00108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:32.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.154+0000 7f6f059bd640 1 --2- 172.21.15.92:0/2914412396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f001016a0 0x7f6f00108f40 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8009ca0 tx=0x7f6ef802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.154+0000 7f6f059bd640 1 -- 172.21.15.92:0/2914412396 shutdown_connections 2024-09-19T09:12:32.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.154+0000 7f6f059bd640 1 --2- 172.21.15.92:0/2914412396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f001016a0 0x7f6f00108f40 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.154+0000 7f6f059bd640 1 --2- 172.21.15.92:0/2914412396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f00100ce0 0x7f6f00101160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.154+0000 7f6f059bd640 1 --2- 172.21.15.92:0/2914412396 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f00101fb0 0x7f6f001023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.154+0000 7f6f059bd640 1 -- 172.21.15.92:0/2914412396 >> 172.21.15.92:0/2914412396 conn(0x7f6f000fb900 msgr2=0x7f6f000fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:32.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.154+0000 7f6f059bd640 1 -- 172.21.15.92:0/2914412396 shutdown_connections 2024-09-19T09:12:32.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.154+0000 7f6f059bd640 1 -- 172.21.15.92:0/2914412396 wait complete. 2024-09-19T09:12:32.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.155+0000 7f6f059bd640 1 Processor -- start 2024-09-19T09:12:32.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.155+0000 7f6f059bd640 1 -- start start 2024-09-19T09:12:32.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.155+0000 7f6f059bd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f00100ce0 0x7f6f00100780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:32.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.155+0000 7f6f059bd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f001016a0 0x7f6f0019cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:32.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.155+0000 7f6f059bd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f00101fb0 0x7f6f0019f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:32.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.155+0000 7f6f059bd640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0010c6b0 con 0x7f6f00101fb0 2024-09-19T09:12:32.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.155+0000 7f6f059bd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0010c530 con 0x7f6f00100ce0 2024-09-19T09:12:32.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.155+0000 7f6f059bd640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0010c830 con 0x7f6f001016a0 2024-09-19T09:12:32.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.155+0000 7f6eff7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f00101fb0 0x7f6f0019f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:32.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.155+0000 7f6eff7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f00101fb0 0x7f6f0019f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52152/0 (socket says 172.21.15.92:52152) 2024-09-19T09:12:32.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.155+0000 7f6eff7fe640 1 -- 172.21.15.92:0/1221979545 learned_addr learned my addr 172.21.15.92:0/1221979545 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:32.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.155+0000 7f6eff7fe640 1 -- 172.21.15.92:0/1221979545 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f001016a0 msgr2=0x7f6f0019cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:32.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.155+0000 7f6eff7fe640 1 --2- 172.21.15.92:0/1221979545 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f001016a0 0x7f6f0019cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.155+0000 7f6eff7fe640 1 -- 172.21.15.92:0/1221979545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f00100ce0 msgr2=0x7f6f00100780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:32.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.155+0000 7f6efeffd640 1 --2- 172.21.15.92:0/1221979545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f00100ce0 0x7f6f00100780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:32.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.155+0000 7f6eff7fe640 1 --2- 172.21.15.92:0/1221979545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f00100ce0 0x7f6f00100780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.155+0000 7f6eff7fe640 1 -- 172.21.15.92:0/1221979545 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f0019fa50 con 0x7f6f00101fb0 2024-09-19T09:12:32.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.155+0000 7f6efeffd640 1 --2- 172.21.15.92:0/1221979545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f00100ce0 0x7f6f00100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:12:32.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.155+0000 7f6eff7fe640 1 --2- 172.21.15.92:0/1221979545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f00101fb0 0x7f6f0019f190 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8005e30 tx=0x7f6ef8031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:32.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.155+0000 7f6f049bb640 1 -- 172.21.15.92:0/1221979545 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef8003c30 con 0x7f6f00101fb0 2024-09-19T09:12:32.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.155+0000 7f6f059bd640 1 -- 172.21.15.92:0/1221979545 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f0019fce0 con 0x7f6f00101fb0 2024-09-19T09:12:32.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.155+0000 7f6f049bb640 1 -- 172.21.15.92:0/1221979545 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ef8003dd0 con 0x7f6f00101fb0 2024-09-19T09:12:32.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.155+0000 7f6f049bb640 1 -- 172.21.15.92:0/1221979545 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef802fda0 con 0x7f6f00101fb0 2024-09-19T09:12:32.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.156+0000 7f6f059bd640 1 -- 172.21.15.92:0/1221979545 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f001a0230 con 0x7f6f00101fb0 2024-09-19T09:12:32.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.156+0000 7f6f059bd640 1 -- 172.21.15.92:0/1221979545 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f00107e40 con 0x7f6f00101fb0 2024-09-19T09:12:32.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.158+0000 7f6f049bb640 1 -- 172.21.15.92:0/1221979545 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6ef8004050 con 0x7f6f00101fb0 2024-09-19T09:12:32.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.158+0000 7f6f049bb640 1 --2- 172.21.15.92:0/1221979545 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6eec0a3250 0x7f6eec0a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:32.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.158+0000 7f6efeffd640 1 --2- 172.21.15.92:0/1221979545 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6eec0a3250 0x7f6eec0a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:32.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.158+0000 7f6f049bb640 1 -- 172.21.15.92:0/1221979545 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f6ef80f0e50 con 0x7f6f00101fb0 2024-09-19T09:12:32.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.159+0000 7f6efeffd640 1 --2- 172.21.15.92:0/1221979545 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6eec0a3250 0x7f6eec0a5710 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6f0006a160 tx=0x7f6ef0005e70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:32.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.161+0000 7f6f049bb640 1 -- 172.21.15.92:0/1221979545 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6ef80bdb70 con 0x7f6f00101fb0 2024-09-19T09:12:32.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.327+0000 7f6f059bd640 1 -- 172.21.15.92:0/1221979545 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6f0002d9c0 con 0x7f6f00101fb0 2024-09-19T09:12:32.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.327+0000 7f6f049bb640 1 -- 172.21.15.92:0/1221979545 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) ==== 104+0+11 (secure 0 0 0) 0x7f6ef80bd470 con 0x7f6f00101fb0 2024-09-19T09:12:32.328 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 32 2024-09-19T09:12:32.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.329+0000 7f6f059bd640 1 -- 172.21.15.92:0/1221979545 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6eec0a3250 msgr2=0x7f6eec0a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:32.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.329+0000 7f6f059bd640 1 --2- 172.21.15.92:0/1221979545 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6eec0a3250 0x7f6eec0a5710 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6f0006a160 tx=0x7f6ef0005e70 comp rx=0 tx=0).stop 2024-09-19T09:12:32.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.329+0000 7f6f059bd640 1 -- 172.21.15.92:0/1221979545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f00101fb0 msgr2=0x7f6f0019f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:32.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.329+0000 7f6f059bd640 1 --2- 172.21.15.92:0/1221979545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f00101fb0 0x7f6f0019f190 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8005e30 tx=0x7f6ef8031ee0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.329+0000 7f6f059bd640 1 -- 172.21.15.92:0/1221979545 shutdown_connections 2024-09-19T09:12:32.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.329+0000 7f6f059bd640 1 --2- 172.21.15.92:0/1221979545 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f6eec0a3250 0x7f6eec0a5710 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.329+0000 7f6f059bd640 1 --2- 172.21.15.92:0/1221979545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f00101fb0 0x7f6f0019f190 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.329+0000 7f6f059bd640 1 --2- 172.21.15.92:0/1221979545 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f001016a0 0x7f6f0019cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.329+0000 7f6f059bd640 1 --2- 172.21.15.92:0/1221979545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f00100ce0 0x7f6f00100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.329+0000 7f6f059bd640 1 -- 172.21.15.92:0/1221979545 >> 172.21.15.92:0/1221979545 conn(0x7f6f000fb900 msgr2=0x7f6f00105010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:32.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.329+0000 7f6f059bd640 1 -- 172.21.15.92:0/1221979545 shutdown_connections 2024-09-19T09:12:32.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.330+0000 7f6f059bd640 1 -- 172.21.15.92:0/1221979545 wait complete. 2024-09-19T09:12:32.341 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T09:12:32.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.444+0000 7f018e378640 1 -- 172.21.15.92:0/2017375956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0188101bf0 msgr2=0x7f0188102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:32.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.444+0000 7f018e378640 1 --2- 172.21.15.92:0/2017375956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0188101bf0 0x7f0188102070 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f017c009900 tx=0x7f017c02a410 comp rx=0 tx=0).stop 2024-09-19T09:12:32.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.444+0000 7f018e378640 1 -- 172.21.15.92:0/2017375956 shutdown_connections 2024-09-19T09:12:32.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.444+0000 7f018e378640 1 --2- 172.21.15.92:0/2017375956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01881025b0 0x7f0188108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.444+0000 7f018e378640 1 --2- 172.21.15.92:0/2017375956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0188101bf0 0x7f0188102070 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.444+0000 7f018e378640 1 --2- 172.21.15.92:0/2017375956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0188100a00 0x7f0188100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.444+0000 7f018e378640 1 -- 172.21.15.92:0/2017375956 >> 172.21.15.92:0/2017375956 conn(0x7f01880fc140 msgr2=0x7f01880fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:32.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.444+0000 7f018e378640 1 -- 172.21.15.92:0/2017375956 shutdown_connections 2024-09-19T09:12:32.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.444+0000 7f018e378640 1 -- 172.21.15.92:0/2017375956 wait complete. 2024-09-19T09:12:32.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.444+0000 7f018e378640 1 Processor -- start 2024-09-19T09:12:32.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.444+0000 7f018e378640 1 -- start start 2024-09-19T09:12:32.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.445+0000 7f018e378640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0188100a00 0x7f0188196d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:32.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.445+0000 7f018e378640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0188101bf0 0x7f01881972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:32.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.445+0000 7f018e378640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01881025b0 0x7f018819e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:32.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.445+0000 7f018e378640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f018810c660 con 0x7f0188101bf0 2024-09-19T09:12:32.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.445+0000 7f018e378640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f018810c4e0 con 0x7f0188100a00 2024-09-19T09:12:32.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.445+0000 7f018e378640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f018810c7e0 con 0x7f01881025b0 2024-09-19T09:12:32.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.445+0000 7f01877fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0188101bf0 0x7f01881972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:32.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.445+0000 7f01877fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0188101bf0 0x7f01881972a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52180/0 (socket says 172.21.15.92:52180) 2024-09-19T09:12:32.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.445+0000 7f01877fe640 1 -- 172.21.15.92:0/3673662774 learned_addr learned my addr 172.21.15.92:0/3673662774 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:32.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.445+0000 7f0187fff640 1 --2- 172.21.15.92:0/3673662774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0188100a00 0x7f0188196d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:32.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.445+0000 7f018c915640 1 --2- 172.21.15.92:0/3673662774 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01881025b0 0x7f018819e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:32.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.445+0000 7f01877fe640 1 -- 172.21.15.92:0/3673662774 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01881025b0 msgr2=0x7f018819e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:32.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.445+0000 7f01877fe640 1 --2- 172.21.15.92:0/3673662774 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01881025b0 0x7f018819e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.445+0000 7f01877fe640 1 -- 172.21.15.92:0/3673662774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0188100a00 msgr2=0x7f0188196d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:32.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.445+0000 7f01877fe640 1 --2- 172.21.15.92:0/3673662774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0188100a00 0x7f0188196d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.445+0000 7f01877fe640 1 -- 172.21.15.92:0/3673662774 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f018819e980 con 0x7f0188101bf0 2024-09-19T09:12:32.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.445+0000 7f018c915640 1 --2- 172.21.15.92:0/3673662774 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01881025b0 0x7f018819e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:12:32.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.445+0000 7f01877fe640 1 --2- 172.21.15.92:0/3673662774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0188101bf0 0x7f01881972a0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f017c009230 tx=0x7f017c004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:32.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.445+0000 7f01857fa640 1 -- 172.21.15.92:0/3673662774 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017c03f030 con 0x7f0188101bf0 2024-09-19T09:12:32.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.445+0000 7f018e378640 1 -- 172.21.15.92:0/3673662774 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f018819ec10 con 0x7f0188101bf0 2024-09-19T09:12:32.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.445+0000 7f01857fa640 1 -- 172.21.15.92:0/3673662774 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f017c003ce0 con 0x7f0188101bf0 2024-09-19T09:12:32.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.445+0000 7f01857fa640 1 -- 172.21.15.92:0/3673662774 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017c035070 con 0x7f0188101bf0 2024-09-19T09:12:32.449 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.446+0000 7f018e378640 1 -- 172.21.15.92:0/3673662774 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f018819f100 con 0x7f0188101bf0 2024-09-19T09:12:32.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.446+0000 7f018e378640 1 -- 172.21.15.92:0/3673662774 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0188107ee0 con 0x7f0188101bf0 2024-09-19T09:12:32.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.448+0000 7f01857fa640 1 -- 172.21.15.92:0/3673662774 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f017c042030 con 0x7f0188101bf0 2024-09-19T09:12:32.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.448+0000 7f01857fa640 1 --2- 172.21.15.92:0/3673662774 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f01700a3250 0x7f01700a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:32.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.448+0000 7f0187fff640 1 --2- 172.21.15.92:0/3673662774 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f01700a3250 0x7f01700a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:32.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.449+0000 7f01857fa640 1 -- 172.21.15.92:0/3673662774 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f017c0f02b0 con 0x7f0188101bf0 2024-09-19T09:12:32.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.449+0000 7f0187fff640 1 --2- 172.21.15.92:0/3673662774 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f01700a3250 0x7f01700a5710 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0188101a50 tx=0x7f017800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:32.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.451+0000 7f01857fa640 1 -- 172.21.15.92:0/3673662774 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f017c0bcfd0 con 0x7f0188101bf0 2024-09-19T09:12:32.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.619+0000 7f018e378640 1 -- 172.21.15.92:0/3673662774 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f018802da50 con 0x7f0188101bf0 2024-09-19T09:12:32.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.619+0000 7f01857fa640 1 -- 172.21.15.92:0/3673662774 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) ==== 100+0+11 (secure 0 0 0) 0x7f017c0bc8d0 con 0x7f0188101bf0 2024-09-19T09:12:32.620 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 64 2024-09-19T09:12:32.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.621+0000 7f018e378640 1 -- 172.21.15.92:0/3673662774 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f01700a3250 msgr2=0x7f01700a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:32.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.621+0000 7f018e378640 1 --2- 172.21.15.92:0/3673662774 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f01700a3250 0x7f01700a5710 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0188101a50 tx=0x7f017800b390 comp rx=0 tx=0).stop 2024-09-19T09:12:32.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.621+0000 7f018e378640 1 -- 172.21.15.92:0/3673662774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0188101bf0 msgr2=0x7f01881972a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:32.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.621+0000 7f018e378640 1 --2- 172.21.15.92:0/3673662774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0188101bf0 0x7f01881972a0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f017c009230 tx=0x7f017c004360 comp rx=0 tx=0).stop 2024-09-19T09:12:32.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.621+0000 7f018e378640 1 -- 172.21.15.92:0/3673662774 shutdown_connections 2024-09-19T09:12:32.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.621+0000 7f018e378640 1 --2- 172.21.15.92:0/3673662774 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01881025b0 0x7f018819e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.621+0000 7f018e378640 1 --2- 172.21.15.92:0/3673662774 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f01700a3250 0x7f01700a5710 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.621+0000 7f018e378640 1 --2- 172.21.15.92:0/3673662774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0188101bf0 0x7f01881972a0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.621+0000 7f018e378640 1 --2- 172.21.15.92:0/3673662774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0188100a00 0x7f0188196d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.621+0000 7f018e378640 1 -- 172.21.15.92:0/3673662774 >> 172.21.15.92:0/3673662774 conn(0x7f01880fc140 msgr2=0x7f01881050b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:32.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.621+0000 7f018e378640 1 -- 172.21.15.92:0/3673662774 shutdown_connections 2024-09-19T09:12:32.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.621+0000 7f018e378640 1 -- 172.21.15.92:0/3673662774 wait complete. 2024-09-19T09:12:32.633 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-19T09:12:32.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.732+0000 7f094fe96640 1 -- 172.21.15.92:0/3811380720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09481025e0 msgr2=0x7f0948108e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:32.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.732+0000 7f094fe96640 1 --2- 172.21.15.92:0/3811380720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09481025e0 0x7f0948108e70 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f0940009ca0 tx=0x7f094002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.732+0000 7f094fe96640 1 -- 172.21.15.92:0/3811380720 shutdown_connections 2024-09-19T09:12:32.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.732+0000 7f094fe96640 1 --2- 172.21.15.92:0/3811380720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09481025e0 0x7f0948108e70 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.732+0000 7f094fe96640 1 --2- 172.21.15.92:0/3811380720 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0948101c20 0x7f09481020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.732+0000 7f094fe96640 1 --2- 172.21.15.92:0/3811380720 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0948100a30 0x7f0948100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.732+0000 7f094fe96640 1 -- 172.21.15.92:0/3811380720 >> 172.21.15.92:0/3811380720 conn(0x7f09480fc1b0 msgr2=0x7f09480fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:32.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.732+0000 7f094fe96640 1 -- 172.21.15.92:0/3811380720 shutdown_connections 2024-09-19T09:12:32.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.732+0000 7f094fe96640 1 -- 172.21.15.92:0/3811380720 wait complete. 2024-09-19T09:12:32.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.733+0000 7f094fe96640 1 Processor -- start 2024-09-19T09:12:32.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.733+0000 7f094fe96640 1 -- start start 2024-09-19T09:12:32.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.733+0000 7f094fe96640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0948100a30 0x7f094806af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:32.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.733+0000 7f094fe96640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0948101c20 0x7f094819ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:32.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.733+0000 7f094fe96640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09481025e0 0x7f09481a1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:32.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.733+0000 7f094fe96640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f094810c6b0 con 0x7f09481025e0 2024-09-19T09:12:32.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.733+0000 7f094fe96640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f094810c530 con 0x7f0948101c20 2024-09-19T09:12:32.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.733+0000 7f094fe96640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f094810c830 con 0x7f0948100a30 2024-09-19T09:12:32.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.733+0000 7f094e433640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09481025e0 0x7f09481a1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:32.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.733+0000 7f094e433640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09481025e0 0x7f09481a1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52208/0 (socket says 172.21.15.92:52208) 2024-09-19T09:12:32.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.733+0000 7f094e433640 1 -- 172.21.15.92:0/4029267437 learned_addr learned my addr 172.21.15.92:0/4029267437 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:32.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.733+0000 7f094d431640 1 --2- 172.21.15.92:0/4029267437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0948101c20 0x7f094819ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:32.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.734+0000 7f094e433640 1 -- 172.21.15.92:0/4029267437 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0948100a30 msgr2=0x7f094806af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:32.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.734+0000 7f094e433640 1 --2- 172.21.15.92:0/4029267437 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0948100a30 0x7f094806af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.734+0000 7f094e433640 1 -- 172.21.15.92:0/4029267437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0948101c20 msgr2=0x7f094819ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:32.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.734+0000 7f094e433640 1 --2- 172.21.15.92:0/4029267437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0948101c20 0x7f094819ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.734+0000 7f094e433640 1 -- 172.21.15.92:0/4029267437 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09481a1c70 con 0x7f09481025e0 2024-09-19T09:12:32.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.734+0000 7f094e433640 1 --2- 172.21.15.92:0/4029267437 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09481025e0 0x7f09481a1480 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f0940005e30 tx=0x7f0940031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:32.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.734+0000 7f093effd640 1 -- 172.21.15.92:0/4029267437 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0940003c30 con 0x7f09481025e0 2024-09-19T09:12:32.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.734+0000 7f093effd640 1 -- 172.21.15.92:0/4029267437 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0940003dd0 con 0x7f09481025e0 2024-09-19T09:12:32.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.734+0000 7f094fe96640 1 -- 172.21.15.92:0/4029267437 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09481a1ea0 con 0x7f09481025e0 2024-09-19T09:12:32.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.734+0000 7f093effd640 1 -- 172.21.15.92:0/4029267437 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f094002fde0 con 0x7f09481025e0 2024-09-19T09:12:32.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.734+0000 7f094fe96640 1 -- 172.21.15.92:0/4029267437 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09481a2360 con 0x7f09481025e0 2024-09-19T09:12:32.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.735+0000 7f094fe96640 1 -- 172.21.15.92:0/4029267437 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0948107df0 con 0x7f09481025e0 2024-09-19T09:12:32.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.736+0000 7f093effd640 1 -- 172.21.15.92:0/4029267437 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0940004050 con 0x7f09481025e0 2024-09-19T09:12:32.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.736+0000 7f093effd640 1 --2- 172.21.15.92:0/4029267437 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f09340a3280 0x7f09340a5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:32.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.737+0000 7f094dc32640 1 --2- 172.21.15.92:0/4029267437 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f09340a3280 0x7f09340a5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:32.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.737+0000 7f093effd640 1 -- 172.21.15.92:0/4029267437 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f09400f0be0 con 0x7f09481025e0 2024-09-19T09:12:32.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.737+0000 7f094dc32640 1 --2- 172.21.15.92:0/4029267437 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f09340a3280 0x7f09340a5740 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f0948101a80 tx=0x7f0944005ed0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:32.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.741+0000 7f093effd640 1 -- 172.21.15.92:0/4029267437 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f09400bd900 con 0x7f09481025e0 2024-09-19T09:12:32.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.961+0000 7f094fe96640 1 -- 172.21.15.92:0/4029267437 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f0948062df0 con 0x7f09481025e0 2024-09-19T09:12:32.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.968+0000 7f093effd640 1 -- 172.21.15.92:0/4029267437 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+742340 (secure 0 0 0) 0x7f09400bd200 con 0x7f09481025e0 2024-09-19T09:12:32.979 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:12:32.979 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T09:12:32.979 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 18, 2024-09-19T09:12:32.979 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:32.979 INFO:teuthology.orchestra.run.smithi092.stdout: "active_gid": 14150, 2024-09-19T09:12:32.980 INFO:teuthology.orchestra.run.smithi092.stdout: "active_name": "x", 2024-09-19T09:12:32.980 INFO:teuthology.orchestra.run.smithi092.stdout: "active_addrs": { 2024-09-19T09:12:32.980 INFO:teuthology.orchestra.run.smithi092.stdout: "addrvec": [ 2024-09-19T09:12:32.980 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:32.980 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v2", 2024-09-19T09:12:32.980 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "172.21.15.92:6800", 2024-09-19T09:12:32.980 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 2435349378 2024-09-19T09:12:32.980 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:32.980 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:32.980 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v1", 2024-09-19T09:12:32.980 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "172.21.15.92:6801", 2024-09-19T09:12:32.980 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 2435349378 2024-09-19T09:12:32.980 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:32.981 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-09-19T09:12:32.981 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:32.981 INFO:teuthology.orchestra.run.smithi092.stdout: "active_addr": "172.21.15.92:6801/2435349378", 2024-09-19T09:12:32.981 INFO:teuthology.orchestra.run.smithi092.stdout: "active_change": "2024-09-19T08:47:52.180227+0000", 2024-09-19T09:12:32.981 INFO:teuthology.orchestra.run.smithi092.stdout: "active_mgr_features": 4540701547738038271, 2024-09-19T09:12:32.981 INFO:teuthology.orchestra.run.smithi092.stdout: "available": true, 2024-09-19T09:12:32.981 INFO:teuthology.orchestra.run.smithi092.stdout: "standbys": [ 2024-09-19T09:12:32.981 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:32.981 INFO:teuthology.orchestra.run.smithi092.stdout: "gid": 24106, 2024-09-19T09:12:32.981 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "z", 2024-09-19T09:12:32.981 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr_features": 4540701547738038271, 2024-09-19T09:12:32.981 INFO:teuthology.orchestra.run.smithi092.stdout: "available_modules": [ 2024-09-19T09:12:32.981 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:32.982 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "alerts", 2024-09-19T09:12:32.982 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:32.982 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:32.982 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:32.982 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-19T09:12:32.982 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-19T09:12:32.982 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:32.982 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:32.982 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:32.982 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-19T09:12:32.982 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:32.982 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:32.982 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:32.983 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T09:12:32.983 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:32.983 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:32.983 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:32.983 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:32.983 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:32.983 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:32.983 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:32.983 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:32.983 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:32.983 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:32.983 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:32.983 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:32.984 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:32.984 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:32.984 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:32.984 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:32.984 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:32.984 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:32.984 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:32.984 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:32.984 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:32.984 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:32.984 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:32.984 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:32.985 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:32.985 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:32.985 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:32.985 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:32.985 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:32.985 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:32.985 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:32.985 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:32.985 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:32.985 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:32.985 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:32.985 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:32.985 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:32.986 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:32.986 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:32.986 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:32.986 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:32.986 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:32.986 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:32.986 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:32.986 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:32.986 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:32.986 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:32.986 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:32.986 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:32.986 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:32.987 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:32.987 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:32.987 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:32.987 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:32.987 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:32.987 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:32.987 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:32.987 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:32.987 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:32.987 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:32.987 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:32.987 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:32.987 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:32.988 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:32.988 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:32.988 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:32.988 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:32.988 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:32.988 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:32.988 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:32.988 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:32.988 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:32.988 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:32.988 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:32.988 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_destination": { 2024-09-19T09:12:32.988 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_destination", 2024-09-19T09:12:32.988 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:32.989 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:32.989 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:32.989 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:32.989 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:32.989 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:32.989 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:32.989 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Email address to send alerts to", 2024-09-19T09:12:32.989 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:32.989 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:32.989 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:32.989 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:32.989 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_from_name": { 2024-09-19T09:12:32.989 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_from_name", 2024-09-19T09:12:32.990 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:32.990 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:32.990 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:32.990 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "Ceph", 2024-09-19T09:12:32.990 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:32.990 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:32.990 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:32.990 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Email From: name", 2024-09-19T09:12:32.990 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:32.990 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:32.990 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:32.990 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:32.990 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_host": { 2024-09-19T09:12:32.991 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_host", 2024-09-19T09:12:32.991 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:32.991 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:32.991 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:32.991 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:32.991 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:32.991 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:32.991 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:32.991 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SMTP server", 2024-09-19T09:12:32.991 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:32.991 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:32.991 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:32.991 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:32.991 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_password": { 2024-09-19T09:12:32.992 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_password", 2024-09-19T09:12:32.992 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:32.992 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:32.992 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:32.992 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:32.992 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:32.992 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:32.992 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:32.992 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Password to authenticate with", 2024-09-19T09:12:32.992 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:32.992 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:32.992 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:32.992 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:32.993 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_port": { 2024-09-19T09:12:32.993 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_port", 2024-09-19T09:12:32.993 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:32.993 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:32.993 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:32.993 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "465", 2024-09-19T09:12:32.993 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:32.993 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:32.993 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:32.993 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SMTP port", 2024-09-19T09:12:32.993 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:32.993 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:32.993 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:32.994 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:32.994 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_sender": { 2024-09-19T09:12:32.994 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_sender", 2024-09-19T09:12:32.994 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:32.994 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:32.994 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:32.994 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:32.994 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:32.994 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:32.994 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:32.994 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SMTP envelope sender", 2024-09-19T09:12:32.994 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:32.994 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:32.995 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:32.995 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:32.995 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_ssl": { 2024-09-19T09:12:32.995 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_ssl", 2024-09-19T09:12:32.995 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:32.995 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:32.995 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:32.995 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:32.995 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:32.995 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:32.995 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:32.995 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T09:12:32.995 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:32.996 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:32.996 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:32.996 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:32.996 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_user": { 2024-09-19T09:12:32.996 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_user", 2024-09-19T09:12:32.996 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:32.996 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:32.996 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:32.996 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:32.996 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:32.996 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:32.996 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:32.997 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "User to authenticate as", 2024-09-19T09:12:32.997 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:32.997 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:32.997 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:32.997 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:32.997 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:32.997 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:32.997 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:32.997 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "balancer", 2024-09-19T09:12:32.997 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:32.997 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:32.997 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:32.997 INFO:teuthology.orchestra.run.smithi092.stdout: "active": { 2024-09-19T09:12:32.998 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "active", 2024-09-19T09:12:32.998 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:32.998 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:32.998 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:32.998 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:32.998 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:32.998 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:32.998 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:32.998 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T09:12:32.998 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:32.998 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:32.998 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:32.998 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:32.999 INFO:teuthology.orchestra.run.smithi092.stdout: "begin_time": { 2024-09-19T09:12:32.999 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "begin_time", 2024-09-19T09:12:32.999 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:32.999 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:32.999 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:32.999 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0000", 2024-09-19T09:12:32.999 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:32.999 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:32.999 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:32.999 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T09:12:32.999 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:12:32.999 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:32.999 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:32.999 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.000 INFO:teuthology.orchestra.run.smithi092.stdout: "begin_weekday": { 2024-09-19T09:12:33.000 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "begin_weekday", 2024-09-19T09:12:33.000 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-19T09:12:33.000 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.000 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.000 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-19T09:12:33.000 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "0", 2024-09-19T09:12:33.000 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "6", 2024-09-19T09:12:33.000 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.000 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T09:12:33.000 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:12:33.000 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.000 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.001 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.001 INFO:teuthology.orchestra.run.smithi092.stdout: "crush_compat_max_iterations": { 2024-09-19T09:12:33.001 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crush_compat_max_iterations", 2024-09-19T09:12:33.001 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-19T09:12:33.001 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.001 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.001 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "25", 2024-09-19T09:12:33.001 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2024-09-19T09:12:33.001 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "250", 2024-09-19T09:12:33.001 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.001 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T09:12:33.001 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.001 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.002 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.002 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.002 INFO:teuthology.orchestra.run.smithi092.stdout: "crush_compat_metrics": { 2024-09-19T09:12:33.002 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crush_compat_metrics", 2024-09-19T09:12:33.002 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.002 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.002 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.002 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T09:12:33.002 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.002 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.002 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.002 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T09:12:33.002 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T09:12:33.003 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.003 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.003 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.003 INFO:teuthology.orchestra.run.smithi092.stdout: "crush_compat_step": { 2024-09-19T09:12:33.003 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crush_compat_step", 2024-09-19T09:12:33.003 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-19T09:12:33.003 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.003 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.003 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0.5", 2024-09-19T09:12:33.003 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "0.001", 2024-09-19T09:12:33.003 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "0.999", 2024-09-19T09:12:33.003 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.003 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "aggressiveness of optimization", 2024-09-19T09:12:33.003 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T09:12:33.004 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.004 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.004 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.004 INFO:teuthology.orchestra.run.smithi092.stdout: "end_time": { 2024-09-19T09:12:33.004 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "end_time", 2024-09-19T09:12:33.004 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.004 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.004 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.004 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "2359", 2024-09-19T09:12:33.004 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.004 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.004 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.004 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T09:12:33.005 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:12:33.005 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.005 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.005 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.005 INFO:teuthology.orchestra.run.smithi092.stdout: "end_weekday": { 2024-09-19T09:12:33.005 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "end_weekday", 2024-09-19T09:12:33.005 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-19T09:12:33.005 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.005 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.005 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-19T09:12:33.005 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "0", 2024-09-19T09:12:33.005 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "6", 2024-09-19T09:12:33.005 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.006 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T09:12:33.006 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:12:33.006 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.006 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.006 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.006 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.006 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.006 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.006 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.006 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.006 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.006 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.006 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.007 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.007 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.007 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.007 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.007 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.007 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.007 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.007 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.007 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.007 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.007 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.007 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.007 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.008 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.008 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.008 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.008 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.008 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.008 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.008 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.008 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.008 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.008 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.008 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.008 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.009 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.009 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.009 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.009 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.009 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.009 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.009 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.009 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.009 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.009 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.009 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.009 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.009 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.010 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.010 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.010 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.010 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.010 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.010 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.010 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.010 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.010 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.010 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.010 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.010 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.010 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.011 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.011 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.011 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.011 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.011 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.011 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.011 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.011 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.011 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.011 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.011 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.011 INFO:teuthology.orchestra.run.smithi092.stdout: "min_score": { 2024-09-19T09:12:33.011 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "min_score", 2024-09-19T09:12:33.012 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-19T09:12:33.012 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.012 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.012 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-19T09:12:33.012 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.012 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.012 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.012 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T09:12:33.012 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.012 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.012 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.012 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.013 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": { 2024-09-19T09:12:33.013 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mode", 2024-09-19T09:12:33.013 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.013 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.013 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.013 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "upmap", 2024-09-19T09:12:33.013 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.013 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.013 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.013 INFO:teuthology.orchestra.run.smithi092.stdout: "crush-compat", 2024-09-19T09:12:33.013 INFO:teuthology.orchestra.run.smithi092.stdout: "none", 2024-09-19T09:12:33.013 INFO:teuthology.orchestra.run.smithi092.stdout: "read", 2024-09-19T09:12:33.013 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap", 2024-09-19T09:12:33.013 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap-read" 2024-09-19T09:12:33.014 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.014 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Balancer mode", 2024-09-19T09:12:33.014 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.014 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.014 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.014 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.014 INFO:teuthology.orchestra.run.smithi092.stdout: "pool_ids": { 2024-09-19T09:12:33.014 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pool_ids", 2024-09-19T09:12:33.014 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.014 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.014 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.014 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.014 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.015 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.015 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.015 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T09:12:33.015 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.015 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.015 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.015 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.015 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-19T09:12:33.015 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-19T09:12:33.015 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.015 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.015 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.015 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-19T09:12:33.015 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.015 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.016 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.016 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T09:12:33.016 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.016 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.016 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.016 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.016 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap_max_deviation": { 2024-09-19T09:12:33.016 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "upmap_max_deviation", 2024-09-19T09:12:33.016 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.016 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.016 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.016 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-19T09:12:33.016 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2024-09-19T09:12:33.016 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.017 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.017 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T09:12:33.017 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T09:12:33.017 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.017 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.017 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.017 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap_max_optimizations": { 2024-09-19T09:12:33.017 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "upmap_max_optimizations", 2024-09-19T09:12:33.017 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-19T09:12:33.017 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.017 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.017 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-19T09:12:33.017 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.018 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.018 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.018 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T09:12:33.018 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.018 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.018 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.018 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.018 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.018 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.018 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.018 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cephadm", 2024-09-19T09:12:33.018 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.018 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.018 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.019 INFO:teuthology.orchestra.run.smithi092.stdout: "agent_down_multiplier": { 2024-09-19T09:12:33.019 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "agent_down_multiplier", 2024-09-19T09:12:33.019 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-19T09:12:33.019 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.019 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.019 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3.0", 2024-09-19T09:12:33.019 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.019 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.019 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.019 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T09:12:33.019 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.019 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.019 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.020 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.020 INFO:teuthology.orchestra.run.smithi092.stdout: "agent_refresh_rate": { 2024-09-19T09:12:33.020 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "agent_refresh_rate", 2024-09-19T09:12:33.020 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.020 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.020 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.020 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "20", 2024-09-19T09:12:33.020 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.020 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.020 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.020 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T09:12:33.020 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.021 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.021 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.021 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.021 INFO:teuthology.orchestra.run.smithi092.stdout: "agent_starting_port": { 2024-09-19T09:12:33.021 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "agent_starting_port", 2024-09-19T09:12:33.021 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.021 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.021 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.021 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "4721", 2024-09-19T09:12:33.021 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.021 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.021 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.021 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T09:12:33.022 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.022 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.022 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.022 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.022 INFO:teuthology.orchestra.run.smithi092.stdout: "allow_ptrace": { 2024-09-19T09:12:33.022 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "allow_ptrace", 2024-09-19T09:12:33.022 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.022 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.022 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.022 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.022 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.022 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.023 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.023 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T09:12:33.023 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T09:12:33.023 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.023 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.023 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.023 INFO:teuthology.orchestra.run.smithi092.stdout: "autotune_interval": { 2024-09-19T09:12:33.023 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "autotune_interval", 2024-09-19T09:12:33.023 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.023 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.023 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.023 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-19T09:12:33.023 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.023 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.024 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.024 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T09:12:33.024 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.024 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.024 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.024 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.024 INFO:teuthology.orchestra.run.smithi092.stdout: "autotune_memory_target_ratio": { 2024-09-19T09:12:33.024 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T09:12:33.024 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-19T09:12:33.024 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.024 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.024 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0.7", 2024-09-19T09:12:33.024 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.025 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.025 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.025 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T09:12:33.025 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.025 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.025 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.025 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.025 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm_log_destination": { 2024-09-19T09:12:33.025 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cephadm_log_destination", 2024-09-19T09:12:33.025 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.025 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.025 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.025 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.025 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.026 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.026 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.026 INFO:teuthology.orchestra.run.smithi092.stdout: "file", 2024-09-19T09:12:33.026 INFO:teuthology.orchestra.run.smithi092.stdout: "file,syslog", 2024-09-19T09:12:33.026 INFO:teuthology.orchestra.run.smithi092.stdout: "syslog" 2024-09-19T09:12:33.026 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.026 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T09:12:33.026 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.026 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.026 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.026 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.026 INFO:teuthology.orchestra.run.smithi092.stdout: "cgroups_split": { 2024-09-19T09:12:33.026 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cgroups_split", 2024-09-19T09:12:33.026 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.026 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.027 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.027 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.027 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.027 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.027 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.027 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T09:12:33.027 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.027 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.027 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.027 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.027 INFO:teuthology.orchestra.run.smithi092.stdout: "config_checks_enabled": { 2024-09-19T09:12:33.027 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "config_checks_enabled", 2024-09-19T09:12:33.027 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.028 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.028 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.028 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.028 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.028 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.028 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.028 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T09:12:33.028 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.028 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.028 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.028 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.028 INFO:teuthology.orchestra.run.smithi092.stdout: "config_dashboard": { 2024-09-19T09:12:33.028 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "config_dashboard", 2024-09-19T09:12:33.029 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.029 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.029 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.029 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.029 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.029 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.029 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.029 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T09:12:33.029 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.029 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.029 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.029 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.029 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_alertmanager": { 2024-09-19T09:12:33.029 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_alertmanager", 2024-09-19T09:12:33.030 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.030 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.030 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.030 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T09:12:33.030 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.030 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.030 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.030 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2024-09-19T09:12:33.030 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.030 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.030 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.030 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.030 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_base": { 2024-09-19T09:12:33.030 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_base", 2024-09-19T09:12:33.030 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.031 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.031 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.031 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T09:12:33.031 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.031 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.031 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.031 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Container image name, without the tag", 2024-09-19T09:12:33.031 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.031 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.031 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.031 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.031 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_elasticsearch": { 2024-09-19T09:12:33.031 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_elasticsearch", 2024-09-19T09:12:33.031 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.031 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.032 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.032 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T09:12:33.032 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.032 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.032 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.032 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "elasticsearch container image", 2024-09-19T09:12:33.032 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.032 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.032 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.032 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.032 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_grafana": { 2024-09-19T09:12:33.032 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_grafana", 2024-09-19T09:12:33.032 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.032 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.032 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.033 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T09:12:33.033 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.033 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.033 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.033 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2024-09-19T09:12:33.033 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.033 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.033 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.033 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.033 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_haproxy": { 2024-09-19T09:12:33.033 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_haproxy", 2024-09-19T09:12:33.033 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.033 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.033 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.034 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T09:12:33.034 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.034 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.034 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.034 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "HAproxy container image", 2024-09-19T09:12:33.034 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.034 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.034 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.034 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.034 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_jaeger_agent": { 2024-09-19T09:12:33.034 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_jaeger_agent", 2024-09-19T09:12:33.034 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.035 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.035 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.035 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T09:12:33.035 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.035 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.035 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.035 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Jaeger agent container image", 2024-09-19T09:12:33.035 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.035 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.035 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.035 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.035 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_jaeger_collector": { 2024-09-19T09:12:33.035 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_jaeger_collector", 2024-09-19T09:12:33.035 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.035 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.036 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.036 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T09:12:33.036 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.036 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.036 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.036 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Jaeger collector container image", 2024-09-19T09:12:33.036 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.036 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.036 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.036 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.036 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_jaeger_query": { 2024-09-19T09:12:33.036 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_jaeger_query", 2024-09-19T09:12:33.036 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.037 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.037 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.037 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T09:12:33.037 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.037 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.037 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.037 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Jaeger query container image", 2024-09-19T09:12:33.037 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.037 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.037 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.037 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.037 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_keepalived": { 2024-09-19T09:12:33.037 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_keepalived", 2024-09-19T09:12:33.038 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.038 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.038 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.038 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T09:12:33.038 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.038 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.038 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.038 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Keepalived container image", 2024-09-19T09:12:33.038 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.038 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.038 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.038 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.038 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_loki": { 2024-09-19T09:12:33.038 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_loki", 2024-09-19T09:12:33.039 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.039 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.039 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.039 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T09:12:33.039 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.039 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.039 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.039 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Loki container image", 2024-09-19T09:12:33.039 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.039 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.039 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.039 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.039 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_node_exporter": { 2024-09-19T09:12:33.040 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_node_exporter", 2024-09-19T09:12:33.040 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.040 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.040 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.040 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T09:12:33.040 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.040 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.040 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.040 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2024-09-19T09:12:33.040 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.040 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.040 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.040 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.040 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_nvmeof": { 2024-09-19T09:12:33.041 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_nvmeof", 2024-09-19T09:12:33.041 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.041 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.041 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.041 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T09:12:33.041 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.041 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.041 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.041 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Nvme-of container image", 2024-09-19T09:12:33.041 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.041 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.041 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.041 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.042 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_prometheus": { 2024-09-19T09:12:33.042 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_prometheus", 2024-09-19T09:12:33.042 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.042 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.042 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.042 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T09:12:33.042 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.042 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.042 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.042 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2024-09-19T09:12:33.042 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.042 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.042 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.042 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.043 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_promtail": { 2024-09-19T09:12:33.043 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_promtail", 2024-09-19T09:12:33.043 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.043 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.043 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.043 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T09:12:33.043 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.043 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.043 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.043 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Promtail container image", 2024-09-19T09:12:33.043 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.043 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.043 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.043 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.044 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_samba": { 2024-09-19T09:12:33.044 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_samba", 2024-09-19T09:12:33.044 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.044 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.044 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.044 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T09:12:33.044 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.044 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.044 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.044 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Samba/SMB container image", 2024-09-19T09:12:33.044 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.044 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.044 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.045 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.045 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_snmp_gateway": { 2024-09-19T09:12:33.045 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_snmp_gateway", 2024-09-19T09:12:33.045 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.045 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.045 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.045 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T09:12:33.045 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.045 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.045 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.045 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SNMP Gateway container image", 2024-09-19T09:12:33.045 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.045 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.046 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.046 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.046 INFO:teuthology.orchestra.run.smithi092.stdout: "container_init": { 2024-09-19T09:12:33.046 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_init", 2024-09-19T09:12:33.046 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.046 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.046 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.046 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.046 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.046 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.046 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.046 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T09:12:33.047 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.047 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.047 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.047 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.047 INFO:teuthology.orchestra.run.smithi092.stdout: "daemon_cache_timeout": { 2024-09-19T09:12:33.047 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "daemon_cache_timeout", 2024-09-19T09:12:33.047 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.047 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.047 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.047 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-19T09:12:33.047 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.047 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.047 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.047 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T09:12:33.048 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.048 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.048 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.048 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.048 INFO:teuthology.orchestra.run.smithi092.stdout: "default_cephadm_command_timeout": { 2024-09-19T09:12:33.048 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T09:12:33.048 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.048 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.048 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.048 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "900", 2024-09-19T09:12:33.048 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.048 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.048 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.049 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T09:12:33.049 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.049 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.049 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.049 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.049 INFO:teuthology.orchestra.run.smithi092.stdout: "default_registry": { 2024-09-19T09:12:33.049 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "default_registry", 2024-09-19T09:12:33.049 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.049 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.049 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.049 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io", 2024-09-19T09:12:33.049 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.049 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.050 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.050 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T09:12:33.050 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.050 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.050 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.050 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.050 INFO:teuthology.orchestra.run.smithi092.stdout: "device_cache_timeout": { 2024-09-19T09:12:33.050 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "device_cache_timeout", 2024-09-19T09:12:33.050 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.050 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.050 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.050 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "1800", 2024-09-19T09:12:33.050 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.050 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.050 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.051 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "seconds to cache device inventory", 2024-09-19T09:12:33.051 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.051 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.051 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.051 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.051 INFO:teuthology.orchestra.run.smithi092.stdout: "device_enhanced_scan": { 2024-09-19T09:12:33.051 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "device_enhanced_scan", 2024-09-19T09:12:33.051 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.051 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.051 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.051 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.051 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.051 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.052 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.052 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T09:12:33.052 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.052 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.052 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.052 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.052 INFO:teuthology.orchestra.run.smithi092.stdout: "facts_cache_timeout": { 2024-09-19T09:12:33.052 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "facts_cache_timeout", 2024-09-19T09:12:33.052 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.052 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.052 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.052 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-19T09:12:33.052 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.053 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.053 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.053 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "seconds to cache host facts data", 2024-09-19T09:12:33.053 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.053 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.053 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.053 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.053 INFO:teuthology.orchestra.run.smithi092.stdout: "grafana_dashboards_path": { 2024-09-19T09:12:33.053 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "grafana_dashboards_path", 2024-09-19T09:12:33.053 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.053 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.053 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.053 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T09:12:33.054 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.054 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.054 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.054 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T09:12:33.054 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.054 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.054 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.054 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.054 INFO:teuthology.orchestra.run.smithi092.stdout: "host_check_interval": { 2024-09-19T09:12:33.054 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "host_check_interval", 2024-09-19T09:12:33.054 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.054 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.054 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.055 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-19T09:12:33.055 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.055 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.055 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.055 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to perform a host check", 2024-09-19T09:12:33.055 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.055 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.055 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.055 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.055 INFO:teuthology.orchestra.run.smithi092.stdout: "hw_monitoring": { 2024-09-19T09:12:33.055 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "hw_monitoring", 2024-09-19T09:12:33.055 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.055 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.055 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.056 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.056 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.056 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.056 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.056 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T09:12:33.056 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.056 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.056 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.056 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.056 INFO:teuthology.orchestra.run.smithi092.stdout: "inventory_list_all": { 2024-09-19T09:12:33.056 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "inventory_list_all", 2024-09-19T09:12:33.056 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.056 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.057 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.057 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.057 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.057 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.057 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.057 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T09:12:33.057 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.057 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.057 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.057 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.057 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.057 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.057 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.058 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.058 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.058 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.058 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.058 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.058 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.058 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.058 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.058 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.058 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.058 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.058 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.058 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.058 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.059 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.059 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.059 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.059 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.059 INFO:teuthology.orchestra.run.smithi092.stdout: "log_refresh_metadata": { 2024-09-19T09:12:33.059 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_refresh_metadata", 2024-09-19T09:12:33.059 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.059 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.059 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.059 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.059 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.059 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.059 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.059 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T09:12:33.060 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.060 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.060 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.060 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.060 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.060 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.060 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.060 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.060 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.060 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.060 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.060 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.060 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.061 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T09:12:33.061 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.061 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.061 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.061 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.061 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.061 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.061 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.061 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.061 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.061 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.061 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.061 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.062 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.062 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.062 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.062 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.062 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.062 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.062 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.062 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.062 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.062 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.062 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.062 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.062 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.062 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.063 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.063 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.063 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.063 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.063 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.063 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.063 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.063 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.063 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.063 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.063 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.063 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.063 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.063 INFO:teuthology.orchestra.run.smithi092.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T09:12:33.064 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T09:12:33.064 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.064 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.064 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.064 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.064 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.064 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.064 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.064 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T09:12:33.064 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.064 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.064 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.064 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.065 INFO:teuthology.orchestra.run.smithi092.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T09:12:33.065 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T09:12:33.065 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.065 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.065 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.065 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "*", 2024-09-19T09:12:33.065 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.065 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.065 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.065 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T09:12:33.065 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.065 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.065 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.066 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.066 INFO:teuthology.orchestra.run.smithi092.stdout: "max_count_per_host": { 2024-09-19T09:12:33.066 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_count_per_host", 2024-09-19T09:12:33.066 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.066 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.066 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.066 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-19T09:12:33.066 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.066 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.066 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.066 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "max number of daemons per service per host", 2024-09-19T09:12:33.066 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.066 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.067 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.067 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.067 INFO:teuthology.orchestra.run.smithi092.stdout: "max_osd_draining_count": { 2024-09-19T09:12:33.067 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_osd_draining_count", 2024-09-19T09:12:33.067 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.067 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.067 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.067 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-19T09:12:33.067 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.067 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.067 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.067 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T09:12:33.067 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.068 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.068 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.068 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.068 INFO:teuthology.orchestra.run.smithi092.stdout: "migration_current": { 2024-09-19T09:12:33.068 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "migration_current", 2024-09-19T09:12:33.068 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.068 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.068 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.068 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.068 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.068 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.068 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.068 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "internal - do not modify", 2024-09-19T09:12:33.069 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.069 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.069 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.069 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.069 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": { 2024-09-19T09:12:33.069 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mode", 2024-09-19T09:12:33.069 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.069 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.069 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.069 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "root", 2024-09-19T09:12:33.069 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.069 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.069 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.070 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm-package", 2024-09-19T09:12:33.070 INFO:teuthology.orchestra.run.smithi092.stdout: "root" 2024-09-19T09:12:33.070 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.070 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T09:12:33.070 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.070 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.070 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.070 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.070 INFO:teuthology.orchestra.run.smithi092.stdout: "oob_default_addr": { 2024-09-19T09:12:33.070 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "oob_default_addr", 2024-09-19T09:12:33.070 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.070 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.070 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.071 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "169.254.1.1", 2024-09-19T09:12:33.071 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.071 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.071 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.071 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T09:12:33.071 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.071 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.071 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.071 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.071 INFO:teuthology.orchestra.run.smithi092.stdout: "prometheus_alerts_path": { 2024-09-19T09:12:33.071 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "prometheus_alerts_path", 2024-09-19T09:12:33.071 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.071 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.071 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.072 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T09:12:33.072 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.072 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.072 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.072 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T09:12:33.072 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.072 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.072 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.072 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.072 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_insecure": { 2024-09-19T09:12:33.072 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_insecure", 2024-09-19T09:12:33.072 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.073 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.073 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.073 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.073 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.073 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.073 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.073 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T09:12:33.073 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.073 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.073 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.073 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.073 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_password": { 2024-09-19T09:12:33.073 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_password", 2024-09-19T09:12:33.074 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.074 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.074 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.074 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.074 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.074 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.074 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.074 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T09:12:33.074 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.074 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.074 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.074 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.074 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_url": { 2024-09-19T09:12:33.075 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_url", 2024-09-19T09:12:33.075 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.075 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.075 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.075 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.075 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.075 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.075 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.075 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T09:12:33.075 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.075 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.075 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.075 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.076 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_username": { 2024-09-19T09:12:33.076 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_username", 2024-09-19T09:12:33.076 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.076 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.076 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.076 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.076 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.076 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.076 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.076 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T09:12:33.076 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.076 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.076 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.077 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.077 INFO:teuthology.orchestra.run.smithi092.stdout: "secure_monitoring_stack": { 2024-09-19T09:12:33.077 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "secure_monitoring_stack", 2024-09-19T09:12:33.077 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.077 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.077 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.077 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.077 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.077 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.077 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.077 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T09:12:33.077 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.077 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.078 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.078 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.078 INFO:teuthology.orchestra.run.smithi092.stdout: "service_discovery_port": { 2024-09-19T09:12:33.078 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "service_discovery_port", 2024-09-19T09:12:33.078 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.078 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.078 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.078 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8765", 2024-09-19T09:12:33.078 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.078 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.078 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.078 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "cephadm service discovery port", 2024-09-19T09:12:33.078 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.079 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.079 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.079 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.079 INFO:teuthology.orchestra.run.smithi092.stdout: "ssh_config_file": { 2024-09-19T09:12:33.079 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssh_config_file", 2024-09-19T09:12:33.079 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.079 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.079 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.079 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.079 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.079 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.079 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.079 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T09:12:33.079 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.080 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.080 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.080 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.080 INFO:teuthology.orchestra.run.smithi092.stdout: "use_agent": { 2024-09-19T09:12:33.080 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "use_agent", 2024-09-19T09:12:33.080 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.080 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.080 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.080 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.080 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.080 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.080 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.080 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T09:12:33.080 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.080 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.081 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.081 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.081 INFO:teuthology.orchestra.run.smithi092.stdout: "use_repo_digest": { 2024-09-19T09:12:33.081 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "use_repo_digest", 2024-09-19T09:12:33.081 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.081 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.081 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.081 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.081 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.081 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.081 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.081 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T09:12:33.081 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.081 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.082 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.082 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.082 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_on_failed_host_check": { 2024-09-19T09:12:33.082 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_on_failed_host_check", 2024-09-19T09:12:33.082 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.082 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.082 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.082 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.082 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.082 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.082 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.082 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T09:12:33.082 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.082 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.082 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.083 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.083 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_on_stray_daemons": { 2024-09-19T09:12:33.083 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_on_stray_daemons", 2024-09-19T09:12:33.083 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.083 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.083 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.083 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.083 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.083 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.083 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.083 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T09:12:33.083 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.083 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.084 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.084 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.084 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_on_stray_hosts": { 2024-09-19T09:12:33.084 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_on_stray_hosts", 2024-09-19T09:12:33.084 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.084 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.084 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.084 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.084 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.084 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.084 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.084 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T09:12:33.084 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.085 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.085 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.085 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.085 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.085 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.085 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.085 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crash", 2024-09-19T09:12:33.085 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.085 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.085 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.085 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.086 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.086 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.086 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.086 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.086 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.086 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.086 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.086 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.086 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.086 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.086 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.086 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.086 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.087 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.087 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.087 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.087 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.087 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.087 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.087 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.087 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.087 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.087 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.087 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.087 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.088 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.088 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.088 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.088 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.088 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.088 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.088 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.088 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.088 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.088 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.088 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.088 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.088 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.089 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.089 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.089 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.089 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.089 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.089 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.089 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.089 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.089 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.089 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.092 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.092 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.092 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.092 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.092 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.092 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.093 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.093 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.093 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.093 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.093 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.093 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.093 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.093 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.093 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.093 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.093 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.093 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.093 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.094 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.094 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.094 INFO:teuthology.orchestra.run.smithi092.stdout: "retain_interval": { 2024-09-19T09:12:33.094 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "retain_interval", 2024-09-19T09:12:33.094 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.094 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.094 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.094 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "31536000", 2024-09-19T09:12:33.094 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.094 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.094 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.094 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T09:12:33.094 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.094 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.095 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.095 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.095 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_recent_interval": { 2024-09-19T09:12:33.095 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_recent_interval", 2024-09-19T09:12:33.095 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.095 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.095 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.095 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "1209600", 2024-09-19T09:12:33.095 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.095 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.095 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.095 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T09:12:33.095 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.096 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.096 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.096 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.096 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.096 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.096 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.096 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "dashboard", 2024-09-19T09:12:33.096 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.096 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.096 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.096 INFO:teuthology.orchestra.run.smithi092.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T09:12:33.096 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T09:12:33.096 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.097 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.097 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.097 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-19T09:12:33.097 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.097 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.097 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.097 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.097 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.097 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.097 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.097 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.097 INFO:teuthology.orchestra.run.smithi092.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T09:12:33.097 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T09:12:33.098 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.098 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.098 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.098 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.098 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.098 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.098 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.098 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.098 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.098 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.098 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.098 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.098 INFO:teuthology.orchestra.run.smithi092.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T09:12:33.098 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T09:12:33.099 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.099 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.099 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.099 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.099 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.099 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.099 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.099 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.099 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.099 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.099 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.099 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.099 INFO:teuthology.orchestra.run.smithi092.stdout: "AUDIT_API_ENABLED": { 2024-09-19T09:12:33.099 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T09:12:33.100 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.100 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.100 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.100 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.100 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.100 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.100 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.100 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.100 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.100 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.100 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.100 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.100 INFO:teuthology.orchestra.run.smithi092.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T09:12:33.100 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T09:12:33.101 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.101 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.101 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.101 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.101 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.101 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.101 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.101 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.101 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.101 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.101 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.101 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.101 INFO:teuthology.orchestra.run.smithi092.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T09:12:33.101 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T09:12:33.102 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.102 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.102 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.102 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.102 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.102 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.102 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.102 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.102 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.102 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.102 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.103 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.103 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T09:12:33.103 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T09:12:33.103 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.103 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.103 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.103 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.103 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.103 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.103 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.103 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.103 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.103 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.103 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.104 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.104 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T09:12:33.104 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T09:12:33.104 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.104 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.104 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.104 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.104 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.104 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.104 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.104 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.104 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.104 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.105 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.105 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.105 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T09:12:33.105 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T09:12:33.105 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.105 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.105 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.105 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.105 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.105 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.105 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.105 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.105 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.106 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.106 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.106 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.106 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T09:12:33.106 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T09:12:33.106 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.106 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.106 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.106 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.106 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.106 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.106 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.106 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.107 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.107 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.107 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.107 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.107 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T09:12:33.107 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T09:12:33.107 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.107 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.107 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.107 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.107 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.107 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.107 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.108 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.108 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.108 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.108 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.108 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.108 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T09:12:33.108 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T09:12:33.108 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.108 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.108 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.108 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.108 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.108 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.108 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.109 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.109 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.109 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.109 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.109 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.109 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T09:12:33.109 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T09:12:33.109 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.109 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.109 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.109 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.109 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.109 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.110 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.110 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.110 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.110 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.110 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.110 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.110 INFO:teuthology.orchestra.run.smithi092.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T09:12:33.110 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T09:12:33.110 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.110 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.110 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.110 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.110 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.111 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.111 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.111 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.111 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.111 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.111 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.111 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.111 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T09:12:33.111 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T09:12:33.111 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.111 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.111 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.111 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "admin", 2024-09-19T09:12:33.111 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.112 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.112 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.112 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.112 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.112 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.112 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.112 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.112 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T09:12:33.112 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T09:12:33.112 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.112 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.112 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.112 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.113 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.113 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.113 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.113 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.113 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.113 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.113 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.113 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.113 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_URL": { 2024-09-19T09:12:33.113 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_URL", 2024-09-19T09:12:33.113 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.113 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.113 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.114 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.114 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.114 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.114 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.114 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.114 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.114 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.114 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.114 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.114 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T09:12:33.114 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T09:12:33.114 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.114 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.115 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.115 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "admin", 2024-09-19T09:12:33.115 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.115 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.115 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.115 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.115 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.115 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.115 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.115 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.115 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T09:12:33.115 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T09:12:33.115 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.115 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.116 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.116 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.116 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.116 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.116 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.116 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.116 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.116 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.116 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.116 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.116 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T09:12:33.116 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T09:12:33.117 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.117 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.117 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.117 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.117 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.117 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.117 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.117 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.117 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.117 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.117 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.117 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.117 INFO:teuthology.orchestra.run.smithi092.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T09:12:33.118 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T09:12:33.118 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.118 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.118 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.118 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.118 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.118 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.118 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.118 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.118 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.118 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.118 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.118 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.118 INFO:teuthology.orchestra.run.smithi092.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T09:12:33.119 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T09:12:33.119 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.119 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.119 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.119 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.119 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.119 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.119 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.119 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.119 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.119 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.119 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.119 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.120 INFO:teuthology.orchestra.run.smithi092.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T09:12:33.120 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T09:12:33.120 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.120 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.120 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.120 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.120 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.120 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.120 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.120 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.120 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.120 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.120 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.120 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.121 INFO:teuthology.orchestra.run.smithi092.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T09:12:33.121 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T09:12:33.121 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.121 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.121 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.121 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.121 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.121 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.121 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.121 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.121 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.121 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.122 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.122 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.122 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T09:12:33.122 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T09:12:33.122 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.122 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.122 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.122 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.122 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.122 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.122 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.122 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.122 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.122 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.123 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.123 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.123 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T09:12:33.123 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T09:12:33.123 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.123 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.123 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.123 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.123 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.123 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.123 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.123 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.123 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.124 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.124 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.124 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.124 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T09:12:33.124 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T09:12:33.124 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.124 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.124 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.124 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.124 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.124 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.124 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.124 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.125 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.125 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.125 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.125 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.125 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T09:12:33.125 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T09:12:33.125 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.125 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.125 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.125 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.125 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.125 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.125 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.125 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.126 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.126 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.126 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.126 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.126 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T09:12:33.126 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T09:12:33.126 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.126 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.126 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.126 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.126 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.126 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.126 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.126 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.127 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.127 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.127 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.127 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.127 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T09:12:33.127 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T09:12:33.127 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.127 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.127 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.127 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.127 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.127 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.128 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.128 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.128 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.128 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.128 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.128 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.128 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T09:12:33.128 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T09:12:33.128 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.128 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.128 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.128 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.128 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.128 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.129 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.129 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.129 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.129 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.129 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.129 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.129 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T09:12:33.129 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T09:12:33.129 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.129 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.129 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.129 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.129 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.130 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.130 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.130 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.130 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.130 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.130 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.130 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.130 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T09:12:33.130 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T09:12:33.130 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.130 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.130 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.130 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T09:12:33.131 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.131 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.131 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.131 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.131 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.131 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.131 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.131 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.131 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T09:12:33.131 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T09:12:33.131 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.131 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.131 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.131 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-19T09:12:33.132 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.132 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.132 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.132 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.132 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.132 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.132 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.132 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.132 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T09:12:33.132 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T09:12:33.132 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.132 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.132 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.133 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8", 2024-09-19T09:12:33.133 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.133 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.133 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.133 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.133 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.133 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.133 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.133 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.133 INFO:teuthology.orchestra.run.smithi092.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T09:12:33.133 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T09:12:33.133 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.133 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.134 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.134 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "45", 2024-09-19T09:12:33.134 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.134 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.134 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.134 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.134 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.134 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.134 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.134 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.134 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T09:12:33.134 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T09:12:33.134 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.134 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.135 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.135 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.135 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.135 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.135 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.135 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.135 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.135 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.135 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.135 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.135 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T09:12:33.135 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T09:12:33.136 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.136 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.136 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.136 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "admin", 2024-09-19T09:12:33.136 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.136 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.136 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.136 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.136 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.136 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.136 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.136 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.136 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T09:12:33.136 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T09:12:33.137 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.137 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.137 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.137 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.137 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.137 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.137 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.137 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.137 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.137 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.137 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.137 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.137 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T09:12:33.138 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T09:12:33.138 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.138 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.138 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.138 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.138 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.138 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.138 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.138 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.138 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.138 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.138 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.138 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.138 INFO:teuthology.orchestra.run.smithi092.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T09:12:33.139 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T09:12:33.139 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.139 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.139 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.139 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-19T09:12:33.139 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.139 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.139 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.139 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.139 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.139 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.139 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.139 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.139 INFO:teuthology.orchestra.run.smithi092.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T09:12:33.140 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T09:12:33.140 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.140 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.140 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.140 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-19T09:12:33.140 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.140 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.140 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.140 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.140 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.140 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.141 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.141 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.141 INFO:teuthology.orchestra.run.smithi092.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T09:12:33.141 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T09:12:33.141 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.141 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.141 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.141 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-19T09:12:33.141 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.141 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.141 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.141 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.141 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.141 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.142 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.142 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.142 INFO:teuthology.orchestra.run.smithi092.stdout: "cross_origin_url": { 2024-09-19T09:12:33.142 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cross_origin_url", 2024-09-19T09:12:33.142 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.142 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.142 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.142 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.142 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.142 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.142 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.142 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.142 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.142 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.143 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.143 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.143 INFO:teuthology.orchestra.run.smithi092.stdout: "crt_file": { 2024-09-19T09:12:33.143 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crt_file", 2024-09-19T09:12:33.143 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.143 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.143 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.143 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.143 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.143 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.143 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.143 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.143 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.144 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.144 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.144 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.144 INFO:teuthology.orchestra.run.smithi092.stdout: "debug": { 2024-09-19T09:12:33.144 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "debug", 2024-09-19T09:12:33.144 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.144 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.144 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.144 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.144 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.144 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.144 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.145 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Enable/disable debug options", 2024-09-19T09:12:33.145 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.145 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.145 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.145 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.145 INFO:teuthology.orchestra.run.smithi092.stdout: "jwt_token_ttl": { 2024-09-19T09:12:33.145 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "jwt_token_ttl", 2024-09-19T09:12:33.145 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.145 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.145 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.145 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "28800", 2024-09-19T09:12:33.145 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.145 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.146 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.146 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.146 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.146 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.146 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.146 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.146 INFO:teuthology.orchestra.run.smithi092.stdout: "key_file": { 2024-09-19T09:12:33.146 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "key_file", 2024-09-19T09:12:33.146 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.146 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.146 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.146 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.146 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.147 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.147 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.147 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.147 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.147 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.147 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.147 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.147 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.147 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.147 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.147 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.147 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.147 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.147 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.148 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.148 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.148 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.148 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.148 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.148 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.148 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.148 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.148 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.148 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.148 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.148 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.148 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.149 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.149 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.149 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.149 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.149 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.149 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.149 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.149 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.149 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.149 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.149 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.149 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.149 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.149 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.150 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.150 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.150 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.150 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.150 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.150 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.150 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.150 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.150 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.150 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.150 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.150 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.150 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.151 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.151 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.151 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.151 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.151 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.151 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.151 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.151 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.151 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.151 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.151 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.151 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.151 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.152 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.152 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.152 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.152 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.152 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.152 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.152 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.152 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.152 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.152 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.152 INFO:teuthology.orchestra.run.smithi092.stdout: "motd": { 2024-09-19T09:12:33.152 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "motd", 2024-09-19T09:12:33.153 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.153 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.153 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.153 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.153 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.153 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.153 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.153 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "The message of the day", 2024-09-19T09:12:33.153 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.153 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.153 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.153 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.153 INFO:teuthology.orchestra.run.smithi092.stdout: "redirect_resolve_ip_addr": { 2024-09-19T09:12:33.154 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T09:12:33.154 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.154 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.154 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.154 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.154 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.154 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.154 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.154 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.154 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.154 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.154 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.155 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.155 INFO:teuthology.orchestra.run.smithi092.stdout: "server_addr": { 2024-09-19T09:12:33.155 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_addr", 2024-09-19T09:12:33.155 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.155 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.155 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.155 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "::", 2024-09-19T09:12:33.155 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.155 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.155 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.155 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.155 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.155 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.156 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.156 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.156 INFO:teuthology.orchestra.run.smithi092.stdout: "server_port": { 2024-09-19T09:12:33.156 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_port", 2024-09-19T09:12:33.156 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.156 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.156 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.156 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8080", 2024-09-19T09:12:33.156 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.156 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.156 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.156 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.156 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.157 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.157 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.157 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.157 INFO:teuthology.orchestra.run.smithi092.stdout: "ssl": { 2024-09-19T09:12:33.157 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssl", 2024-09-19T09:12:33.157 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.157 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.157 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.157 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.157 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.157 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.157 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.157 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.157 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.158 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.158 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.158 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.158 INFO:teuthology.orchestra.run.smithi092.stdout: "ssl_server_port": { 2024-09-19T09:12:33.158 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssl_server_port", 2024-09-19T09:12:33.158 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.158 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.158 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.158 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8443", 2024-09-19T09:12:33.158 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.158 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.158 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.158 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.159 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.159 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.159 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.159 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.159 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_behaviour": { 2024-09-19T09:12:33.159 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_behaviour", 2024-09-19T09:12:33.159 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.159 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.159 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.159 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "redirect", 2024-09-19T09:12:33.159 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.160 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.160 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.160 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.160 INFO:teuthology.orchestra.run.smithi092.stdout: "redirect" 2024-09-19T09:12:33.160 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.160 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.160 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.160 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.160 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.160 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.160 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_error_status_code": { 2024-09-19T09:12:33.160 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_error_status_code", 2024-09-19T09:12:33.160 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.161 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.161 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.161 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "500", 2024-09-19T09:12:33.161 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "400", 2024-09-19T09:12:33.161 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "599", 2024-09-19T09:12:33.161 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.161 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.161 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.161 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.161 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.161 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.161 INFO:teuthology.orchestra.run.smithi092.stdout: "url_prefix": { 2024-09-19T09:12:33.161 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "url_prefix", 2024-09-19T09:12:33.162 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.162 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.162 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.162 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.162 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.162 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.162 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.162 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.162 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.162 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.162 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.162 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.162 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.163 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.163 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.163 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "devicehealth", 2024-09-19T09:12:33.163 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.163 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.163 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.163 INFO:teuthology.orchestra.run.smithi092.stdout: "enable_monitoring": { 2024-09-19T09:12:33.163 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enable_monitoring", 2024-09-19T09:12:33.163 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.163 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.163 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.163 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.163 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.163 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.164 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.164 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "monitor device health metrics", 2024-09-19T09:12:33.164 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.164 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.164 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.164 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.164 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.164 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.164 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.164 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.164 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.164 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.164 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.165 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.165 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.165 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.165 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.165 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.165 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.165 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.165 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.165 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.165 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.165 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.165 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.165 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.166 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.166 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.166 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.166 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.166 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.166 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.166 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.166 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.166 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.166 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.166 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.166 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.166 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.167 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.167 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.167 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.167 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.167 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.167 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.167 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.167 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.167 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.167 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.167 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.167 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.167 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.167 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.168 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.168 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.168 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.168 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.168 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.168 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.168 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.168 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.168 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.168 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.168 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.168 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.168 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.169 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.169 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.169 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.169 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.169 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.169 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.169 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.169 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.169 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.169 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.169 INFO:teuthology.orchestra.run.smithi092.stdout: "mark_out_threshold": { 2024-09-19T09:12:33.169 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mark_out_threshold", 2024-09-19T09:12:33.169 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.169 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.170 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.170 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "2419200", 2024-09-19T09:12:33.170 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.170 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.170 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.170 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T09:12:33.170 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.170 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.170 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.170 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.170 INFO:teuthology.orchestra.run.smithi092.stdout: "pool_name": { 2024-09-19T09:12:33.170 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pool_name", 2024-09-19T09:12:33.170 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.171 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.171 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.171 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "device_health_metrics", 2024-09-19T09:12:33.171 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.171 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.171 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.171 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T09:12:33.171 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.171 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.171 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.171 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.171 INFO:teuthology.orchestra.run.smithi092.stdout: "retention_period": { 2024-09-19T09:12:33.171 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "retention_period", 2024-09-19T09:12:33.171 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.172 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.172 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.172 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "15552000", 2024-09-19T09:12:33.172 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.172 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.172 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.172 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how long to retain device health metrics", 2024-09-19T09:12:33.172 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.172 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.172 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.172 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.172 INFO:teuthology.orchestra.run.smithi092.stdout: "scrape_frequency": { 2024-09-19T09:12:33.172 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "scrape_frequency", 2024-09-19T09:12:33.173 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.173 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.173 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.173 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "86400", 2024-09-19T09:12:33.173 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.173 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.173 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.173 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T09:12:33.173 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.173 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.173 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.174 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.174 INFO:teuthology.orchestra.run.smithi092.stdout: "self_heal": { 2024-09-19T09:12:33.174 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "self_heal", 2024-09-19T09:12:33.174 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.174 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.174 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.174 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.174 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.174 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.174 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.174 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T09:12:33.174 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.174 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.175 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.175 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.175 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-19T09:12:33.175 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-19T09:12:33.175 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.175 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.175 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.175 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-19T09:12:33.175 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.175 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.175 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.175 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T09:12:33.175 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.176 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.176 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.176 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.176 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_threshold": { 2024-09-19T09:12:33.176 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_threshold", 2024-09-19T09:12:33.176 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.176 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.176 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.176 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "7257600", 2024-09-19T09:12:33.176 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.176 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.176 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.176 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T09:12:33.177 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.177 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.177 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.177 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.177 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.177 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.177 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.177 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "diskprediction_local", 2024-09-19T09:12:33.177 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.177 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.177 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.177 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.177 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.178 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.178 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.178 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.178 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.178 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.178 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.178 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.178 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.178 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.178 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.178 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.178 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.178 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.179 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.179 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.179 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.179 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.179 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.179 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.179 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.179 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.179 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.179 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.179 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.179 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.179 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.180 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.180 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.180 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.180 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.180 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.180 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.180 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.180 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.180 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.180 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.180 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.180 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.180 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.180 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.181 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.181 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.181 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.181 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.181 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.181 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.181 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.181 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.181 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.181 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.181 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.181 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.181 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.182 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.182 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.182 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.182 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.182 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.182 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.182 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.182 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.182 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.182 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.182 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.182 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.182 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.182 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.183 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.183 INFO:teuthology.orchestra.run.smithi092.stdout: "predict_interval": { 2024-09-19T09:12:33.183 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "predict_interval", 2024-09-19T09:12:33.183 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.183 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.183 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.183 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "86400", 2024-09-19T09:12:33.183 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.183 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.183 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.183 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.183 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.183 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.183 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.184 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.184 INFO:teuthology.orchestra.run.smithi092.stdout: "predictor_model": { 2024-09-19T09:12:33.184 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "predictor_model", 2024-09-19T09:12:33.184 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.184 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.184 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.184 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "prophetstor", 2024-09-19T09:12:33.184 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.184 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.184 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.184 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.184 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.184 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.184 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.184 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.185 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-19T09:12:33.185 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-19T09:12:33.185 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.185 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.185 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.185 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-19T09:12:33.185 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.185 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.185 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.185 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.185 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.185 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.185 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.185 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.185 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.186 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.186 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.186 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "influx", 2024-09-19T09:12:33.186 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": false, 2024-09-19T09:12:33.186 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "influxdb python module not found", 2024-09-19T09:12:33.186 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.186 INFO:teuthology.orchestra.run.smithi092.stdout: "batch_size": { 2024-09-19T09:12:33.186 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "batch_size", 2024-09-19T09:12:33.186 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.186 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.186 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.186 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5000", 2024-09-19T09:12:33.186 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.186 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.187 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.187 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T09:12:33.187 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.187 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.187 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.187 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.187 INFO:teuthology.orchestra.run.smithi092.stdout: "database": { 2024-09-19T09:12:33.187 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "database", 2024-09-19T09:12:33.187 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.187 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.187 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.187 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "ceph", 2024-09-19T09:12:33.188 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.188 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.188 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.188 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T09:12:33.188 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.188 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.188 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.188 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.188 INFO:teuthology.orchestra.run.smithi092.stdout: "hostname": { 2024-09-19T09:12:33.188 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "hostname", 2024-09-19T09:12:33.188 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.188 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.188 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.189 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.189 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.189 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.189 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.189 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "InfluxDB server hostname", 2024-09-19T09:12:33.189 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.189 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.189 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.189 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.189 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-19T09:12:33.189 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-19T09:12:33.189 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.189 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.190 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.190 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "30", 2024-09-19T09:12:33.190 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "5", 2024-09-19T09:12:33.190 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.190 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.190 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T09:12:33.190 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.190 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.190 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.190 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.190 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.190 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.190 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.190 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.191 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.191 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.191 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.191 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.191 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.191 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.191 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.191 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.191 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.191 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.191 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.191 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.191 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.192 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.192 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.192 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.192 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.192 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.192 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.192 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.192 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.192 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.192 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.192 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.192 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.192 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.193 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.193 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.193 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.193 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.193 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.193 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.193 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.193 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.193 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.193 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.193 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.193 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.193 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.194 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.194 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.194 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.194 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.194 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.194 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.194 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.194 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.194 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.194 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.194 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.194 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.194 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.194 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.195 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.195 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.195 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.195 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.195 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.195 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.195 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.195 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.195 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.195 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.195 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.195 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.195 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.196 INFO:teuthology.orchestra.run.smithi092.stdout: "password": { 2024-09-19T09:12:33.196 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "password", 2024-09-19T09:12:33.196 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.196 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.196 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.196 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.196 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.196 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.196 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.196 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "password of InfluxDB server user", 2024-09-19T09:12:33.196 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.196 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.196 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.197 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.197 INFO:teuthology.orchestra.run.smithi092.stdout: "port": { 2024-09-19T09:12:33.197 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "port", 2024-09-19T09:12:33.197 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.197 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.197 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.197 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8086", 2024-09-19T09:12:33.197 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.197 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.197 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.197 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "InfluxDB server port", 2024-09-19T09:12:33.197 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.197 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.198 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.198 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.198 INFO:teuthology.orchestra.run.smithi092.stdout: "ssl": { 2024-09-19T09:12:33.198 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssl", 2024-09-19T09:12:33.198 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.198 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.198 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.198 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "false", 2024-09-19T09:12:33.198 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.198 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.198 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.198 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:12:33.198 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.199 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.199 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.199 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.199 INFO:teuthology.orchestra.run.smithi092.stdout: "threads": { 2024-09-19T09:12:33.199 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "threads", 2024-09-19T09:12:33.199 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.199 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.199 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.199 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-19T09:12:33.199 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2024-09-19T09:12:33.199 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "32", 2024-09-19T09:12:33.199 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.199 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T09:12:33.199 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.200 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.200 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.200 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.200 INFO:teuthology.orchestra.run.smithi092.stdout: "username": { 2024-09-19T09:12:33.200 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "username", 2024-09-19T09:12:33.200 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.200 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.200 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.200 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.200 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.200 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.200 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.200 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "username of InfluxDB server user", 2024-09-19T09:12:33.201 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.201 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.201 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.201 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.201 INFO:teuthology.orchestra.run.smithi092.stdout: "verify_ssl": { 2024-09-19T09:12:33.201 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "verify_ssl", 2024-09-19T09:12:33.201 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.201 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.201 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.201 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "true", 2024-09-19T09:12:33.201 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.201 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.202 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.202 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:12:33.202 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.202 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.202 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.202 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.202 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.202 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.202 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.202 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "insights", 2024-09-19T09:12:33.202 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.202 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.202 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.203 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.203 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.203 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.203 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.203 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.203 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.203 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.203 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.203 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.203 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.203 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.203 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.203 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.203 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.204 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.204 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.204 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.204 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.204 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.204 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.204 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.204 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.204 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.204 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.204 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.204 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.204 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.205 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.205 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.205 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.205 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.205 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.205 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.205 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.205 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.205 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.205 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.205 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.205 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.205 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.205 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.206 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.206 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.206 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.206 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.206 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.206 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.206 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.206 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.206 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.206 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.206 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.206 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.206 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.207 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.207 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.207 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.207 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.207 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.207 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.207 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.207 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.207 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.207 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.207 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.207 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.207 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.207 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.208 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.208 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.208 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.208 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.208 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.208 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "iostat", 2024-09-19T09:12:33.208 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.208 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.208 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.208 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.208 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.208 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.208 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.209 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.209 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.209 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.209 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.209 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.209 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.209 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.209 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.209 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.209 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.209 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.209 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.209 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.209 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.210 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.210 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.210 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.210 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.210 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.210 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.210 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.210 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.210 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.210 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.210 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.210 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.210 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.210 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.211 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.211 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.211 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.211 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.211 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.211 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.211 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.211 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.211 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.211 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.211 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.211 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.211 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.212 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.212 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.212 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.212 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.212 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.212 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.212 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.212 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.212 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.212 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.212 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.212 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.212 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.212 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.213 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.213 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.213 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.213 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.213 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.213 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.213 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.213 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.213 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.213 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.213 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.213 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.214 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.214 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.214 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "k8sevents", 2024-09-19T09:12:33.214 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.214 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.214 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.214 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_event_retention_days": { 2024-09-19T09:12:33.214 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ceph_event_retention_days", 2024-09-19T09:12:33.214 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.214 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.214 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.214 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "7", 2024-09-19T09:12:33.214 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.215 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.215 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.215 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T09:12:33.215 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.215 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.215 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.215 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.215 INFO:teuthology.orchestra.run.smithi092.stdout: "config_check_secs": { 2024-09-19T09:12:33.215 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "config_check_secs", 2024-09-19T09:12:33.215 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.215 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.215 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.215 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-19T09:12:33.215 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "10", 2024-09-19T09:12:33.216 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.216 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.216 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T09:12:33.216 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.216 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.216 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.216 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.216 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.216 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.216 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.216 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.216 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.217 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.217 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.217 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.217 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.217 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.217 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.217 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.217 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.217 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.217 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.217 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.217 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.217 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.218 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.218 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.218 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.218 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.218 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.218 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.218 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.218 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.218 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.218 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.218 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.218 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.219 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.219 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.219 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.219 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.219 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.219 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.219 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.219 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.219 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.219 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.219 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.219 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.219 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.219 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.220 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.220 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.220 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.220 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.220 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.220 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.220 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.220 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.220 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.220 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.220 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.220 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.220 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.221 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.221 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.221 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.221 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.221 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.221 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.221 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.221 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.221 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.221 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.221 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.221 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.221 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.221 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.222 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.222 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.222 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "localpool", 2024-09-19T09:12:33.222 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.222 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.222 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.222 INFO:teuthology.orchestra.run.smithi092.stdout: "failure_domain": { 2024-09-19T09:12:33.222 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "failure_domain", 2024-09-19T09:12:33.222 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.222 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.222 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.222 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "host", 2024-09-19T09:12:33.222 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.223 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.223 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.223 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "failure domain for any created local pool", 2024-09-19T09:12:33.223 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T09:12:33.223 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.223 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.223 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.223 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.223 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.223 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.223 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.223 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.223 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.223 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.224 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.224 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.224 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.224 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.224 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.224 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.224 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.224 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.224 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.224 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.224 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.224 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.224 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.224 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.225 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.225 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.225 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.225 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.225 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.225 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.225 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.225 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.225 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.225 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.225 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.225 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.225 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.226 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.226 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.226 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.226 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.226 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.226 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.226 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.226 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.226 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.226 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.226 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.226 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.226 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.226 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.227 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.227 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.227 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.227 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.227 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.227 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.227 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.227 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.227 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.227 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.227 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.227 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.227 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.228 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.228 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.228 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.228 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.228 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.228 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.228 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.228 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.228 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.228 INFO:teuthology.orchestra.run.smithi092.stdout: "min_size": { 2024-09-19T09:12:33.228 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "min_size", 2024-09-19T09:12:33.228 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.228 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.228 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.228 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.229 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.229 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.229 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.229 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "default min_size for any created local pool", 2024-09-19T09:12:33.229 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T09:12:33.229 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.229 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.229 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.229 INFO:teuthology.orchestra.run.smithi092.stdout: "num_rep": { 2024-09-19T09:12:33.229 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "num_rep", 2024-09-19T09:12:33.229 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.229 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.229 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.230 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3", 2024-09-19T09:12:33.230 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.230 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.230 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.230 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "default replica count for any created local pool", 2024-09-19T09:12:33.230 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.230 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.230 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.230 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.230 INFO:teuthology.orchestra.run.smithi092.stdout: "pg_num": { 2024-09-19T09:12:33.230 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pg_num", 2024-09-19T09:12:33.230 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.230 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.231 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.231 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "128", 2024-09-19T09:12:33.231 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.231 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.231 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.231 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T09:12:33.231 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.231 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.231 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.231 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.231 INFO:teuthology.orchestra.run.smithi092.stdout: "prefix": { 2024-09-19T09:12:33.231 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "prefix", 2024-09-19T09:12:33.231 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.232 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.232 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.232 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.232 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.232 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.232 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.232 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "name prefix for any created local pool", 2024-09-19T09:12:33.232 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.232 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.232 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.232 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.232 INFO:teuthology.orchestra.run.smithi092.stdout: "subtree": { 2024-09-19T09:12:33.232 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "subtree", 2024-09-19T09:12:33.233 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.233 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.233 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.233 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "rack", 2024-09-19T09:12:33.233 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.233 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.233 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.233 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T09:12:33.233 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T09:12:33.233 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.233 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.233 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.233 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.234 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.234 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.234 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mds_autoscaler", 2024-09-19T09:12:33.234 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.234 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.234 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.234 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.234 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.234 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.234 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.234 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.234 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.235 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.235 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.235 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.235 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.235 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.235 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.235 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.235 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.235 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.235 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.235 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.235 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.235 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.236 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.236 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.236 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.236 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.236 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.236 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.236 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.236 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.236 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.236 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.236 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.236 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.236 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.237 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.237 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.237 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.237 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.237 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.237 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.237 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.237 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.237 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.237 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.237 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.237 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.237 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.238 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.238 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.238 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.238 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.238 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.238 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.238 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.238 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.238 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.238 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.238 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.238 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.238 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.239 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.239 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.239 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.239 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.239 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.239 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.239 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.239 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.239 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.239 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.239 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.239 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.239 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.239 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.240 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.240 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mirroring", 2024-09-19T09:12:33.240 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.240 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.240 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.240 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.240 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.240 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.240 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.240 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.240 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.240 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.240 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.241 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.241 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.241 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.241 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.241 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.241 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.241 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.241 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.241 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.241 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.241 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.241 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.241 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.241 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.242 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.242 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.242 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.242 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.242 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.242 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.242 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.242 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.242 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.242 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.242 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.242 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.242 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.242 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.243 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.243 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.243 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.243 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.243 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.243 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.243 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.243 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.243 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.243 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.243 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.243 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.243 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.244 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.244 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.244 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.244 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.244 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.244 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.244 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.244 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.244 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.244 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.244 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.244 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.245 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.245 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.245 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.245 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.245 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.245 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.245 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.245 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.245 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.245 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.245 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.245 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.245 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "nfs", 2024-09-19T09:12:33.246 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.246 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.246 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.246 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.246 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.246 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.246 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.246 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.246 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.246 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.246 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.246 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.246 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.247 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.247 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.247 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.247 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.247 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.247 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.247 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.247 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.247 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.247 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.247 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.247 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.247 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.247 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.248 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.248 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.248 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.248 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.248 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.248 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.248 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.248 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.248 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.248 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.248 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.248 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.249 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.249 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.249 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.249 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.249 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.249 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.249 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.249 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.249 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.249 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.249 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.249 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.249 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.250 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.250 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.250 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.250 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.250 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.250 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.250 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.250 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.250 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.250 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.250 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.250 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.250 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.250 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.251 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.251 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.251 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.251 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.251 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.251 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.251 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.251 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.251 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.251 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.251 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "orchestrator", 2024-09-19T09:12:33.251 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.251 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.252 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.252 INFO:teuthology.orchestra.run.smithi092.stdout: "fail_fs": { 2024-09-19T09:12:33.252 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "fail_fs", 2024-09-19T09:12:33.252 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.252 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.252 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.252 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.252 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.252 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.252 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.252 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T09:12:33.252 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.253 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.253 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.253 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.253 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.253 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.253 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.253 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.253 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.253 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.253 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.253 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.253 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.253 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.253 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.254 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.254 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.254 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.254 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.254 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.254 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.254 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.254 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.254 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.254 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.254 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.254 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.254 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.254 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.255 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.255 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.255 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.255 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.255 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.255 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.255 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.255 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.255 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.255 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.255 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.255 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.255 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.256 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.256 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.256 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.256 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.256 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.256 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.256 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.256 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.256 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.256 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.256 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.256 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.256 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.256 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.257 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.257 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.257 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.257 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.257 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.257 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.257 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.257 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.257 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.257 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.257 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.257 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.257 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.258 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.258 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.258 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.258 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.258 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.258 INFO:teuthology.orchestra.run.smithi092.stdout: "orchestrator": { 2024-09-19T09:12:33.258 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "orchestrator", 2024-09-19T09:12:33.258 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.258 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.258 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.258 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.258 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.258 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.258 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.259 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm", 2024-09-19T09:12:33.259 INFO:teuthology.orchestra.run.smithi092.stdout: "rook", 2024-09-19T09:12:33.259 INFO:teuthology.orchestra.run.smithi092.stdout: "test_orchestrator" 2024-09-19T09:12:33.259 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.259 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Orchestrator backend", 2024-09-19T09:12:33.259 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.259 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.259 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.259 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.259 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.259 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.259 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.260 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "osd_perf_query", 2024-09-19T09:12:33.260 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.260 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.260 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.260 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.260 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.260 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.260 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.260 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.260 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.260 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.260 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.260 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.261 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.261 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.261 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.261 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.261 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.261 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.261 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.261 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.261 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.261 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.261 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.261 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.262 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.262 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.262 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.262 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.262 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.262 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.262 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.262 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.262 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.262 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.262 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.262 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.262 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.262 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.263 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.263 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.263 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.263 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.263 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.263 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.263 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.263 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.263 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.263 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.263 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.263 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.263 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.264 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.264 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.264 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.264 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.264 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.264 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.264 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.264 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.264 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.264 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.264 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.264 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.264 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.264 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.265 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.265 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.265 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.265 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.265 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.265 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.265 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.265 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.265 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.265 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.265 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.265 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "osd_support", 2024-09-19T09:12:33.265 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.266 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.266 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.266 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.266 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.266 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.266 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.266 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.266 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.266 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.266 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.266 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.266 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.266 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.266 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.267 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.267 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.267 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.267 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.267 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.267 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.267 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.267 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.267 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.267 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.267 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.267 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.267 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.268 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.268 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.268 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.268 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.268 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.268 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.268 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.268 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.268 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.268 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.268 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.268 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.268 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.268 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.269 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.269 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.269 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.269 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.269 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.269 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.269 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.269 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.269 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.269 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.269 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.269 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.269 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.270 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.270 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.270 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.270 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.270 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.270 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.270 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.270 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.270 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.270 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.270 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.270 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.270 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.270 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.271 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.271 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.271 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.271 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.271 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.271 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.271 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.271 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pg_autoscaler", 2024-09-19T09:12:33.271 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.271 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.271 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.271 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.271 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.271 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.272 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.272 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.272 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.272 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.272 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.272 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.272 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.272 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.272 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.272 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.272 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.272 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.272 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.272 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.273 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.273 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.273 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.273 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.273 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.273 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.273 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.273 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.273 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.273 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.273 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.273 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.273 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.274 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.274 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.274 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.274 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.274 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.274 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.274 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.274 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.274 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.274 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.274 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.274 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.275 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.275 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.275 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.275 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.275 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.275 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.275 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.275 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.275 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.275 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.275 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.275 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.275 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.276 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.276 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.276 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.276 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.276 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.276 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.276 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.276 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.276 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.276 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.276 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.276 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.276 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.277 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.277 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.277 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-19T09:12:33.277 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-19T09:12:33.277 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.277 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.277 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.277 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-19T09:12:33.277 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.277 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.277 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.277 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.277 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.277 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.278 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.278 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.278 INFO:teuthology.orchestra.run.smithi092.stdout: "threshold": { 2024-09-19T09:12:33.278 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "threshold", 2024-09-19T09:12:33.278 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-19T09:12:33.278 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.278 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.278 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3.0", 2024-09-19T09:12:33.278 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1.0", 2024-09-19T09:12:33.278 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.278 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.278 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "scaling threshold", 2024-09-19T09:12:33.278 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T09:12:33.279 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.279 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.279 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.279 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.279 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.279 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.279 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "progress", 2024-09-19T09:12:33.279 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.279 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.279 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.279 INFO:teuthology.orchestra.run.smithi092.stdout: "allow_pg_recovery_event": { 2024-09-19T09:12:33.279 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "allow_pg_recovery_event", 2024-09-19T09:12:33.279 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.280 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.280 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.280 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.280 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.280 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.280 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.280 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T09:12:33.280 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.280 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.280 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.280 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.280 INFO:teuthology.orchestra.run.smithi092.stdout: "enabled": { 2024-09-19T09:12:33.280 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enabled", 2024-09-19T09:12:33.281 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.281 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.281 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.281 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.281 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.281 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.281 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.281 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.281 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.281 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.281 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.281 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.281 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.282 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.282 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.282 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.282 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.282 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.282 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.282 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.282 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.282 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.282 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.282 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.282 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.282 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.283 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.283 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.283 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.283 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.283 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.283 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.283 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.283 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.283 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.283 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.283 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.283 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.283 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.283 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.284 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.284 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.284 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.284 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.284 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.284 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.284 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.284 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.284 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.284 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.284 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.284 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.284 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.285 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.285 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.285 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.285 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.285 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.285 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.285 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.285 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.285 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.285 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.285 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.285 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.286 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.286 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.286 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.286 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.286 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.286 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.286 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.286 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.286 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.286 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.286 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.286 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.286 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.287 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.287 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.287 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.287 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.287 INFO:teuthology.orchestra.run.smithi092.stdout: "max_completed_events": { 2024-09-19T09:12:33.287 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_completed_events", 2024-09-19T09:12:33.287 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.287 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.287 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.287 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "50", 2024-09-19T09:12:33.287 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.287 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.287 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.287 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "number of past completed events to remember", 2024-09-19T09:12:33.288 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.288 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.288 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.288 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.288 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-19T09:12:33.288 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-19T09:12:33.288 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.288 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.288 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.288 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-19T09:12:33.288 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.288 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.288 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.289 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how long the module is going to sleep", 2024-09-19T09:12:33.289 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.289 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.289 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.289 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.289 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.289 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.289 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.289 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "prometheus", 2024-09-19T09:12:33.289 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.289 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.289 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.290 INFO:teuthology.orchestra.run.smithi092.stdout: "cache": { 2024-09-19T09:12:33.290 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cache", 2024-09-19T09:12:33.290 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.290 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.290 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.290 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.290 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.290 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.290 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.290 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.290 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.290 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.290 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.291 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.291 INFO:teuthology.orchestra.run.smithi092.stdout: "exclude_perf_counters": { 2024-09-19T09:12:33.291 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "exclude_perf_counters", 2024-09-19T09:12:33.291 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.291 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.291 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.291 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.291 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.291 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.291 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.291 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T09:12:33.291 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T09:12:33.291 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.292 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.292 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.292 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.292 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.292 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.292 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.292 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.292 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.292 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.292 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.292 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.292 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.293 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.293 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.293 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.293 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.293 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.293 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.293 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.293 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.293 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.293 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.293 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.296 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.296 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.296 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.296 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.297 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.297 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.297 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.297 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.297 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.297 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.297 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.297 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.297 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.297 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.297 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.297 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.298 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.298 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.298 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.298 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.298 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.298 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.298 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.298 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.298 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.298 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.298 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.298 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.298 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.298 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.299 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.299 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.299 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.299 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.299 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.299 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.299 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.299 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.299 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.299 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.299 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.299 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.299 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.299 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.300 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.300 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.300 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.300 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.300 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.300 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_stats_pools": { 2024-09-19T09:12:33.300 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_stats_pools", 2024-09-19T09:12:33.300 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.300 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.300 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.300 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.300 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.300 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.301 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.301 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.301 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.301 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.301 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.301 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.301 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T09:12:33.301 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T09:12:33.301 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.301 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.301 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.301 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "300", 2024-09-19T09:12:33.301 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.302 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.302 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.302 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.302 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.302 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.302 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.302 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.302 INFO:teuthology.orchestra.run.smithi092.stdout: "scrape_interval": { 2024-09-19T09:12:33.302 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "scrape_interval", 2024-09-19T09:12:33.302 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-19T09:12:33.302 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.302 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.302 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "15.0", 2024-09-19T09:12:33.302 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.303 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.303 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.303 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.303 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.303 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.303 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.303 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.303 INFO:teuthology.orchestra.run.smithi092.stdout: "server_addr": { 2024-09-19T09:12:33.303 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_addr", 2024-09-19T09:12:33.303 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.303 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.303 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.304 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "::", 2024-09-19T09:12:33.304 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.304 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.304 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.304 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T09:12:33.304 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.304 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.304 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.304 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.304 INFO:teuthology.orchestra.run.smithi092.stdout: "server_port": { 2024-09-19T09:12:33.304 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_port", 2024-09-19T09:12:33.304 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.304 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.305 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.305 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "9283", 2024-09-19T09:12:33.305 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.305 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.305 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.305 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T09:12:33.305 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.305 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.305 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.305 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.305 INFO:teuthology.orchestra.run.smithi092.stdout: "stale_cache_strategy": { 2024-09-19T09:12:33.305 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "stale_cache_strategy", 2024-09-19T09:12:33.306 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.306 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.306 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.306 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "log", 2024-09-19T09:12:33.306 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.306 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.306 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.306 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.306 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.306 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.306 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.306 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.306 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_behaviour": { 2024-09-19T09:12:33.306 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_behaviour", 2024-09-19T09:12:33.306 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.307 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.307 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.307 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "default", 2024-09-19T09:12:33.307 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.307 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.307 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.307 INFO:teuthology.orchestra.run.smithi092.stdout: "default", 2024-09-19T09:12:33.307 INFO:teuthology.orchestra.run.smithi092.stdout: "error" 2024-09-19T09:12:33.307 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.307 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.307 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.307 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.308 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.308 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.308 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_error_status_code": { 2024-09-19T09:12:33.308 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_error_status_code", 2024-09-19T09:12:33.308 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.308 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.308 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.308 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "500", 2024-09-19T09:12:33.308 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "400", 2024-09-19T09:12:33.308 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "599", 2024-09-19T09:12:33.308 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.308 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.308 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.308 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.309 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.309 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.309 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.309 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.309 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.309 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_support", 2024-09-19T09:12:33.309 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.309 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.309 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.309 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.309 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.309 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.309 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.310 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.310 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.310 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.310 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.310 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.310 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.310 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.310 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.310 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.310 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.310 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.310 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.310 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.311 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.311 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.311 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.311 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.311 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.311 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.311 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.311 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.311 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.311 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.311 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.311 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.311 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.312 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.312 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.312 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.312 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.312 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.312 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.312 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.312 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.312 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.312 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.312 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.312 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.312 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.313 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.313 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.313 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.313 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.313 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.313 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.313 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.313 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.313 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.313 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.313 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.313 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.314 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.314 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.314 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.314 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.314 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.314 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.314 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.314 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.314 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.314 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.314 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.314 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.314 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.314 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.315 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.315 INFO:teuthology.orchestra.run.smithi092.stdout: "max_concurrent_snap_create": { 2024-09-19T09:12:33.315 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_concurrent_snap_create", 2024-09-19T09:12:33.315 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.315 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.315 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.315 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-19T09:12:33.315 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.315 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.315 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.315 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.315 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.315 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.316 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.316 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.316 INFO:teuthology.orchestra.run.smithi092.stdout: "mirror_snapshot_schedule": { 2024-09-19T09:12:33.316 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T09:12:33.316 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.316 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.316 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.316 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.316 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.316 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.316 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.316 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.316 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.317 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.317 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.317 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.317 INFO:teuthology.orchestra.run.smithi092.stdout: "trash_purge_schedule": { 2024-09-19T09:12:33.317 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "trash_purge_schedule", 2024-09-19T09:12:33.317 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.317 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.317 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.317 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.317 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.317 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.317 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.317 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.318 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.318 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.318 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.318 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.318 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.318 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.318 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.318 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "restful", 2024-09-19T09:12:33.318 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.318 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.318 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.318 INFO:teuthology.orchestra.run.smithi092.stdout: "enable_auth": { 2024-09-19T09:12:33.318 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enable_auth", 2024-09-19T09:12:33.319 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.319 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.319 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.319 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.319 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.319 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.319 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.319 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.319 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.319 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.319 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.319 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.319 INFO:teuthology.orchestra.run.smithi092.stdout: "key_file": { 2024-09-19T09:12:33.319 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "key_file", 2024-09-19T09:12:33.319 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.320 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.320 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.320 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.320 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.320 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.320 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.320 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.320 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.320 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.321 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.321 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.321 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.321 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.321 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.321 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.321 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.321 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.321 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.321 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.321 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.321 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.321 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.322 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.322 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.322 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.322 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.322 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.322 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.322 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.322 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.322 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.322 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.322 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.322 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.323 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.323 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.323 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.323 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.323 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.323 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.323 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.323 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.323 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.323 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.323 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.323 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.323 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.324 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.324 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.324 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.324 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.324 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.324 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.324 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.324 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.324 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.324 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.324 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.324 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.324 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.325 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.325 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.325 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.325 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.325 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.325 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.325 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.325 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.325 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.325 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.325 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.325 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.325 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.326 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.326 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.326 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.326 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.326 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.326 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.326 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.326 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.326 INFO:teuthology.orchestra.run.smithi092.stdout: "server_addr": { 2024-09-19T09:12:33.326 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_addr", 2024-09-19T09:12:33.326 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.326 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.326 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.326 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.327 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.327 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.327 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.327 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.327 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.327 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.327 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.327 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.327 INFO:teuthology.orchestra.run.smithi092.stdout: "server_port": { 2024-09-19T09:12:33.327 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_port", 2024-09-19T09:12:33.327 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.327 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.327 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.328 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.328 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.328 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.328 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.328 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.328 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.328 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.328 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.328 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.328 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.328 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.328 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.328 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rgw", 2024-09-19T09:12:33.328 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.329 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.329 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.329 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.329 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.329 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.329 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.329 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.329 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.329 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.329 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.329 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.329 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.329 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.330 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.330 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.330 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.330 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.330 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.330 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.330 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.330 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.330 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.330 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.330 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.330 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.330 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.331 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.331 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.331 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.331 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.331 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.331 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.331 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.331 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.331 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.331 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.331 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.331 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.331 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.332 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.332 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.332 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.332 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.332 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.332 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.332 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.332 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.332 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.332 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.332 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.332 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.332 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.332 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.333 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.333 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.333 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.333 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.333 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.333 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.333 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.333 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.333 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.333 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.333 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.333 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.333 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.333 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.334 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.334 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.334 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.334 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.334 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.334 INFO:teuthology.orchestra.run.smithi092.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T09:12:33.334 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T09:12:33.334 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.334 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.334 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.334 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-19T09:12:33.334 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.334 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.334 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.334 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T09:12:33.335 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.335 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.335 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.335 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.335 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.335 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.335 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.335 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rook", 2024-09-19T09:12:33.335 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.335 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.335 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.335 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.335 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.335 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.335 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.336 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.336 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.336 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.336 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.336 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.336 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.336 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.336 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.336 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.336 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.336 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.336 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.336 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.337 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.337 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.337 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.337 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.337 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.337 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.337 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.337 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.337 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.337 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.337 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.337 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.337 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.338 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.338 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.338 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.338 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.338 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.338 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.338 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.338 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.338 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.338 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.338 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.338 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.338 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.338 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.339 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.339 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.339 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.339 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.339 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.339 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.339 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.339 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.339 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.339 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.339 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.339 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.339 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.339 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.339 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.340 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.340 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.340 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.340 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.340 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.340 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.340 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.340 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.340 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.340 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.340 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.340 INFO:teuthology.orchestra.run.smithi092.stdout: "storage_class": { 2024-09-19T09:12:33.340 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "storage_class", 2024-09-19T09:12:33.340 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.340 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.341 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.341 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "local", 2024-09-19T09:12:33.341 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.341 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.341 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.341 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T09:12:33.341 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.341 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.341 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.341 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.341 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.341 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.341 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.341 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "selftest", 2024-09-19T09:12:33.342 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.342 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.342 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.342 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.342 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.342 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.342 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.342 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.342 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.342 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.342 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.342 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.343 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.343 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.343 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.343 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.343 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.343 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.343 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.343 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.343 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.343 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.343 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.343 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.343 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.343 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.344 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.344 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.344 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.344 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.344 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.344 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.344 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.344 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.344 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.344 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.344 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.344 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.345 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.345 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.345 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.345 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.345 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.345 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.345 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.345 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.345 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.345 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.345 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.345 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.345 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.345 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.346 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.346 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.346 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.346 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.346 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.346 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.346 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.346 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.346 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.346 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.346 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.346 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.346 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.346 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.347 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.347 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.347 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.347 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.347 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.347 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.347 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.347 INFO:teuthology.orchestra.run.smithi092.stdout: "roption1": { 2024-09-19T09:12:33.347 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "roption1", 2024-09-19T09:12:33.347 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.347 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.347 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.348 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.348 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.348 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.348 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.348 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.348 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.348 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.348 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.348 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.348 INFO:teuthology.orchestra.run.smithi092.stdout: "roption2": { 2024-09-19T09:12:33.348 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "roption2", 2024-09-19T09:12:33.348 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.348 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.349 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.349 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "xyz", 2024-09-19T09:12:33.349 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.349 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.349 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.349 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.349 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.349 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.349 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.349 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.349 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption1": { 2024-09-19T09:12:33.350 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption1", 2024-09-19T09:12:33.350 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.350 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.350 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.350 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.350 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.350 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.350 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.350 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.350 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.350 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.350 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.351 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.351 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption2": { 2024-09-19T09:12:33.351 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption2", 2024-09-19T09:12:33.351 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.351 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.351 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.351 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.351 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.351 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.351 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.351 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.351 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.351 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.351 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.352 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.352 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption3": { 2024-09-19T09:12:33.352 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption3", 2024-09-19T09:12:33.352 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-19T09:12:33.352 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.352 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.352 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.352 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.352 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.352 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.352 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.352 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.352 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.353 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.353 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.353 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption4": { 2024-09-19T09:12:33.353 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption4", 2024-09-19T09:12:33.353 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.353 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.353 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.353 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.353 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.353 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.353 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.353 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.354 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.354 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.354 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.354 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.354 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption5": { 2024-09-19T09:12:33.354 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption5", 2024-09-19T09:12:33.354 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.354 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.354 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.354 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.354 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.354 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.354 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.355 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.355 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.355 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.355 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.355 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.355 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption6": { 2024-09-19T09:12:33.355 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption6", 2024-09-19T09:12:33.355 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.355 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.355 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.355 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.355 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.355 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.356 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.356 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.356 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.356 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.356 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.356 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.356 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption7": { 2024-09-19T09:12:33.356 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption7", 2024-09-19T09:12:33.356 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.356 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.356 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.356 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.356 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2024-09-19T09:12:33.357 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "42", 2024-09-19T09:12:33.357 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.357 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.357 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.357 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.357 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.357 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.357 INFO:teuthology.orchestra.run.smithi092.stdout: "testkey": { 2024-09-19T09:12:33.357 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "testkey", 2024-09-19T09:12:33.357 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.357 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.357 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.358 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.358 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.358 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.358 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.358 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.358 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.358 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.358 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.358 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.358 INFO:teuthology.orchestra.run.smithi092.stdout: "testlkey": { 2024-09-19T09:12:33.358 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "testlkey", 2024-09-19T09:12:33.358 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.359 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.359 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.359 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.359 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.359 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.359 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.359 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.359 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.359 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.359 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.359 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.359 INFO:teuthology.orchestra.run.smithi092.stdout: "testnewline": { 2024-09-19T09:12:33.359 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "testnewline", 2024-09-19T09:12:33.360 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.360 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.360 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.360 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.360 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.360 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.360 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.360 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.360 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.360 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.360 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.360 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.361 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.361 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.361 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.361 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "snap_schedule", 2024-09-19T09:12:33.361 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.361 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.361 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.361 INFO:teuthology.orchestra.run.smithi092.stdout: "allow_m_granularity": { 2024-09-19T09:12:33.361 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "allow_m_granularity", 2024-09-19T09:12:33.361 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.361 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.361 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.361 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.361 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.362 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.362 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.362 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T09:12:33.362 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.362 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.362 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.362 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.362 INFO:teuthology.orchestra.run.smithi092.stdout: "dump_on_update": { 2024-09-19T09:12:33.362 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "dump_on_update", 2024-09-19T09:12:33.362 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.362 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.362 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.362 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.363 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.363 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.363 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.363 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "dump database to debug log on update", 2024-09-19T09:12:33.363 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.363 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.363 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.363 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.363 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.363 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.363 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.363 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.363 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.363 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.364 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.364 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.364 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.364 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.364 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.364 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.364 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.364 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.364 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.364 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.364 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.364 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.364 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.364 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.365 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.365 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.365 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.365 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.365 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.365 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.365 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.365 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.365 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.365 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.365 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.365 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.365 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.366 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.366 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.366 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.366 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.366 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.366 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.366 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.366 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.366 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.366 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.366 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.366 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.366 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.366 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.366 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.367 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.367 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.367 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.367 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.367 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.367 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.367 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.367 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.367 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.367 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.367 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.367 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.367 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.367 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.368 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.368 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.368 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.368 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.368 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.368 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.368 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.368 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.368 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.368 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.368 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.368 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "stats", 2024-09-19T09:12:33.368 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.368 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.369 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.369 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.369 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.369 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.369 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.369 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.369 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.369 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.369 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.369 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.369 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.369 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.369 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.369 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.370 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.370 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.370 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.370 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.370 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.370 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.370 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.370 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.370 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.370 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.370 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.370 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.370 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.370 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.370 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.371 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.371 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.371 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.371 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.371 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.371 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.371 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.371 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.371 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.371 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.371 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.371 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.371 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.371 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.372 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.372 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.372 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.372 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.372 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.372 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.372 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.372 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.372 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.372 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.372 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.372 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.372 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.372 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.372 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.373 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.373 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.373 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.373 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.373 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.373 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.373 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.373 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.373 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.373 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.373 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.373 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.373 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.374 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.374 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.374 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.374 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "status", 2024-09-19T09:12:33.374 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.374 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.374 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.374 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.374 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.374 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.374 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.374 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.374 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.375 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.375 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.375 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.375 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.375 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.375 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.375 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.375 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.375 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.375 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.375 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.375 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.375 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.375 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.375 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.376 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.376 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.376 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.376 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.376 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.376 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.376 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.376 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.376 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.376 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.376 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.376 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.376 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.377 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.377 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.377 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.377 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.377 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.377 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.377 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.377 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.377 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.377 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.377 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.377 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.377 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.378 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.378 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.378 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.378 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.378 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.378 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.378 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.378 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.378 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.378 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.378 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.378 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.378 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.378 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.378 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.379 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.379 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.379 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.379 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.379 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.379 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.379 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.379 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.379 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.379 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.379 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.379 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "telegraf", 2024-09-19T09:12:33.379 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.380 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.380 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.380 INFO:teuthology.orchestra.run.smithi092.stdout: "address": { 2024-09-19T09:12:33.380 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "address", 2024-09-19T09:12:33.380 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.380 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.380 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.380 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T09:12:33.380 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.380 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.380 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.380 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.380 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.381 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.381 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.381 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.381 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-19T09:12:33.381 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-19T09:12:33.381 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.381 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.381 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.381 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "15", 2024-09-19T09:12:33.381 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.381 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.381 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.382 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.382 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.382 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.382 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.382 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.382 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.382 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.382 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.382 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.382 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.382 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.382 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.382 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.383 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.383 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.383 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.383 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.383 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.383 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.383 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.383 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.383 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.383 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.383 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.383 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.383 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.384 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.384 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.384 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.384 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.384 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.384 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.384 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.384 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.384 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.384 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.384 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.384 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.384 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.384 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.385 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.385 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.385 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.385 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.385 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.385 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.385 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.385 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.385 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.385 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.385 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.385 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.385 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.386 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.386 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.386 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.386 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.386 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.386 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.386 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.386 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.386 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.386 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.386 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.386 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.386 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.386 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.387 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.387 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.387 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.387 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.387 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.387 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.387 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.387 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.387 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.387 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.387 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.387 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "telemetry", 2024-09-19T09:12:33.387 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.387 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.388 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.388 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_basic": { 2024-09-19T09:12:33.388 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_basic", 2024-09-19T09:12:33.388 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.388 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.388 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.388 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.388 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.388 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.388 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.388 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T09:12:33.388 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.388 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.389 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.389 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.389 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_crash": { 2024-09-19T09:12:33.389 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_crash", 2024-09-19T09:12:33.389 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.389 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.389 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.389 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.389 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.389 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.389 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.389 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T09:12:33.389 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.389 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.390 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.390 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.390 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_device": { 2024-09-19T09:12:33.390 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_device", 2024-09-19T09:12:33.390 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.390 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.390 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.390 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.390 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.390 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.390 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.390 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T09:12:33.390 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.391 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.391 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.391 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.391 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_ident": { 2024-09-19T09:12:33.391 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_ident", 2024-09-19T09:12:33.391 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.391 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.391 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.391 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.391 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.391 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.391 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.391 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T09:12:33.391 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.392 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.392 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.392 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.392 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_perf": { 2024-09-19T09:12:33.392 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_perf", 2024-09-19T09:12:33.392 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.392 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.392 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.392 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.392 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.392 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.392 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.392 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T09:12:33.392 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.393 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.393 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.393 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.393 INFO:teuthology.orchestra.run.smithi092.stdout: "contact": { 2024-09-19T09:12:33.393 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "contact", 2024-09-19T09:12:33.393 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.393 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.393 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.393 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.393 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.393 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.394 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.394 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.394 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.394 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.394 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.394 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.394 INFO:teuthology.orchestra.run.smithi092.stdout: "description": { 2024-09-19T09:12:33.394 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "description", 2024-09-19T09:12:33.394 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.394 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.394 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.394 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.394 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.394 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.395 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.395 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.395 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.395 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.395 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.395 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.395 INFO:teuthology.orchestra.run.smithi092.stdout: "device_url": { 2024-09-19T09:12:33.395 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "device_url", 2024-09-19T09:12:33.395 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.395 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.395 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.395 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T09:12:33.395 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.396 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.396 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.396 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.396 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.396 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.396 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.396 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.396 INFO:teuthology.orchestra.run.smithi092.stdout: "enabled": { 2024-09-19T09:12:33.396 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enabled", 2024-09-19T09:12:33.396 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.396 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.396 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.396 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.397 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.397 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.397 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.397 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.397 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.397 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.397 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.397 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.397 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-19T09:12:33.397 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-19T09:12:33.397 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.397 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.397 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.398 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "24", 2024-09-19T09:12:33.398 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "8", 2024-09-19T09:12:33.398 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.398 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.398 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.398 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.398 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.398 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.398 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.398 INFO:teuthology.orchestra.run.smithi092.stdout: "last_opt_revision": { 2024-09-19T09:12:33.398 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "last_opt_revision", 2024-09-19T09:12:33.398 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.398 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.399 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.399 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "1", 2024-09-19T09:12:33.399 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.399 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.399 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.399 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.399 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.399 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.399 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.399 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.399 INFO:teuthology.orchestra.run.smithi092.stdout: "leaderboard": { 2024-09-19T09:12:33.399 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "leaderboard", 2024-09-19T09:12:33.399 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.400 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.400 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.400 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.400 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.400 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.400 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.400 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.400 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.400 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.400 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.400 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.400 INFO:teuthology.orchestra.run.smithi092.stdout: "leaderboard_description": { 2024-09-19T09:12:33.400 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "leaderboard_description", 2024-09-19T09:12:33.401 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.401 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.401 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.401 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.401 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.401 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.401 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.401 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.401 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.401 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.401 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.401 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.401 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.402 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.402 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.402 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.402 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.402 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.402 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.402 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.402 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.402 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.402 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.402 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.402 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.402 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.403 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.403 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.403 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.403 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.403 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.403 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.403 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.403 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.403 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.403 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.403 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.403 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.403 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.403 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.404 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.404 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.404 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.404 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.404 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.404 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.404 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.404 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.404 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.404 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.404 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.404 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.404 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.405 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.405 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.405 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.405 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.405 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.405 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.405 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.405 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.405 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.405 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.405 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.405 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.405 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.405 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.406 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.406 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.406 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.406 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.406 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.406 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.406 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.406 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.406 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.406 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.406 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.406 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.406 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.407 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.407 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.407 INFO:teuthology.orchestra.run.smithi092.stdout: "organization": { 2024-09-19T09:12:33.407 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "organization", 2024-09-19T09:12:33.407 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.407 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.407 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.407 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.407 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.407 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.407 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.407 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.407 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.408 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.408 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.408 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.408 INFO:teuthology.orchestra.run.smithi092.stdout: "proxy": { 2024-09-19T09:12:33.408 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "proxy", 2024-09-19T09:12:33.408 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.408 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.408 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.408 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.408 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.408 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.408 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.408 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.409 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.409 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.409 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.409 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.409 INFO:teuthology.orchestra.run.smithi092.stdout: "url": { 2024-09-19T09:12:33.409 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "url", 2024-09-19T09:12:33.409 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.409 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.409 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.409 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T09:12:33.409 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.409 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.409 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.410 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.410 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.410 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.410 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.410 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.410 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.410 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.410 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.410 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "test_orchestrator", 2024-09-19T09:12:33.410 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.410 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.410 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.410 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.411 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.411 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.411 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.411 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.411 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.411 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.411 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.411 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.411 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.411 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.411 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.411 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.411 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.411 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.412 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.412 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.412 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.412 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.412 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.412 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.412 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.412 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.412 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.412 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.412 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.412 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.412 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.412 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.413 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.413 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.413 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.413 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.413 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.413 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.413 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.413 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.413 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.413 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.413 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.413 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.413 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.414 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.414 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.414 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.414 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.414 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.414 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.414 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.414 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.414 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.414 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.414 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.414 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.414 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.414 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.415 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.415 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.415 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.415 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.415 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.415 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.415 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.415 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.415 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.415 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.415 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.415 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.415 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.415 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.416 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.416 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.416 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.416 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "volumes", 2024-09-19T09:12:33.416 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.416 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.416 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.416 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.416 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.416 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.416 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.416 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.416 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.417 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.417 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.417 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.417 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.417 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.417 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.417 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.417 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.417 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.417 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.417 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.418 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.418 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.418 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.418 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.418 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.418 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.418 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.418 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.418 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.418 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.418 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.418 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.418 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.418 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.419 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.419 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.419 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.419 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.419 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.419 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.419 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.419 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.419 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.419 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.419 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.419 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.419 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.420 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.420 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.420 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.420 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.420 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.420 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.420 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.420 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.420 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.420 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.420 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.420 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.420 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.421 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.421 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.421 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.421 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.421 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.421 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.421 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.421 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.421 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.421 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.421 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.421 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.421 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.422 INFO:teuthology.orchestra.run.smithi092.stdout: "max_concurrent_clones": { 2024-09-19T09:12:33.422 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_concurrent_clones", 2024-09-19T09:12:33.422 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.422 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.422 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.422 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "4", 2024-09-19T09:12:33.422 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.422 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.422 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.422 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T09:12:33.422 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.422 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.422 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.422 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.423 INFO:teuthology.orchestra.run.smithi092.stdout: "periodic_async_work": { 2024-09-19T09:12:33.423 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "periodic_async_work", 2024-09-19T09:12:33.423 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.423 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.423 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.423 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.423 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.423 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.423 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.423 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Periodically check for async work", 2024-09-19T09:12:33.423 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.423 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.424 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.424 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.424 INFO:teuthology.orchestra.run.smithi092.stdout: "snapshot_clone_delay": { 2024-09-19T09:12:33.424 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "snapshot_clone_delay", 2024-09-19T09:12:33.424 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.424 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.424 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.424 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-19T09:12:33.424 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.424 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.424 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.424 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T09:12:33.424 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.424 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.425 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.425 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.425 INFO:teuthology.orchestra.run.smithi092.stdout: "snapshot_clone_no_wait": { 2024-09-19T09:12:33.425 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T09:12:33.425 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.425 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.425 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.425 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.425 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.425 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.425 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.425 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T09:12:33.425 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.426 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.426 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.426 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.426 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.426 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.426 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.426 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix", 2024-09-19T09:12:33.426 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.426 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.426 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.426 INFO:teuthology.orchestra.run.smithi092.stdout: "discovery_interval": { 2024-09-19T09:12:33.426 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "discovery_interval", 2024-09-19T09:12:33.426 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-19T09:12:33.426 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.427 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.427 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "100", 2024-09-19T09:12:33.427 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.427 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.427 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.427 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.427 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.427 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.427 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.427 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.427 INFO:teuthology.orchestra.run.smithi092.stdout: "identifier": { 2024-09-19T09:12:33.427 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "identifier", 2024-09-19T09:12:33.427 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.427 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.428 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.428 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.428 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.428 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.428 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.428 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.428 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.428 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.428 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.428 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.428 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-19T09:12:33.428 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-19T09:12:33.428 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.428 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.429 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.429 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-19T09:12:33.429 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.429 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.429 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.429 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.429 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.429 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.429 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.429 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.429 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.429 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.429 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.430 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.430 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.430 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.430 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.430 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.430 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.430 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.430 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.430 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.430 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.430 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.430 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.430 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.431 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.431 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.431 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.431 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.431 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.431 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.431 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.431 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.431 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.431 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.431 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.431 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.431 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.432 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.432 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.432 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.432 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.432 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.432 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.432 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.432 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.432 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.432 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.432 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.432 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.432 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.432 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.433 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.433 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.433 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.433 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.433 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.433 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.433 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.433 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.433 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.433 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.433 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.433 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.433 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.433 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.433 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.434 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.434 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.434 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.434 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.434 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.434 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.434 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.434 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.434 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.434 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.434 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.434 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.434 INFO:teuthology.orchestra.run.smithi092.stdout: "zabbix_host": { 2024-09-19T09:12:33.435 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix_host", 2024-09-19T09:12:33.435 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.435 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.435 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.435 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.435 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.435 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.435 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.435 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.435 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.435 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.435 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.436 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.436 INFO:teuthology.orchestra.run.smithi092.stdout: "zabbix_port": { 2024-09-19T09:12:33.436 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix_port", 2024-09-19T09:12:33.436 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.436 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.436 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.436 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10051", 2024-09-19T09:12:33.436 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.436 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.436 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.436 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.436 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.437 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.437 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.437 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.437 INFO:teuthology.orchestra.run.smithi092.stdout: "zabbix_sender": { 2024-09-19T09:12:33.437 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix_sender", 2024-09-19T09:12:33.437 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.437 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.437 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.437 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T09:12:33.437 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.437 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.437 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.438 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.438 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.438 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.438 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.438 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.438 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.438 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.438 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-09-19T09:12:33.438 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.438 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.438 INFO:teuthology.orchestra.run.smithi092.stdout: "gid": 24113, 2024-09-19T09:12:33.438 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "y", 2024-09-19T09:12:33.439 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr_features": 4540701547738038271, 2024-09-19T09:12:33.439 INFO:teuthology.orchestra.run.smithi092.stdout: "available_modules": [ 2024-09-19T09:12:33.439 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.439 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "alerts", 2024-09-19T09:12:33.439 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.439 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.439 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.439 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-19T09:12:33.439 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-19T09:12:33.439 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.439 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.439 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.440 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-19T09:12:33.440 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.440 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.440 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.440 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T09:12:33.440 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.440 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.440 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.440 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.440 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.440 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.440 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.440 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.441 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.441 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.441 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.441 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.441 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.441 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.441 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.441 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.441 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.441 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.441 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.441 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.442 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.442 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.442 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.442 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.442 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.442 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.442 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.442 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.442 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.442 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.442 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.442 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.442 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.443 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.443 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.443 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.443 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.443 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.443 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.443 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.443 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.443 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.443 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.443 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.443 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.443 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.444 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.444 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.444 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.444 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.444 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.444 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.444 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.444 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.444 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.444 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.444 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.444 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.444 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.444 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.445 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.445 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.445 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.445 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.445 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.445 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.445 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.445 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.445 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.445 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.445 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.445 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.445 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.446 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.446 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_destination": { 2024-09-19T09:12:33.446 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_destination", 2024-09-19T09:12:33.446 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.446 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.446 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.446 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.446 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.446 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.446 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.446 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Email address to send alerts to", 2024-09-19T09:12:33.446 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.446 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.447 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.447 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.447 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_from_name": { 2024-09-19T09:12:33.447 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_from_name", 2024-09-19T09:12:33.447 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.447 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.447 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.447 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "Ceph", 2024-09-19T09:12:33.447 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.447 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.447 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.447 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Email From: name", 2024-09-19T09:12:33.448 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.448 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.448 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.448 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.448 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_host": { 2024-09-19T09:12:33.448 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_host", 2024-09-19T09:12:33.448 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.448 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.448 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.448 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.448 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.448 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.448 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.448 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SMTP server", 2024-09-19T09:12:33.449 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.449 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.449 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.449 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.449 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_password": { 2024-09-19T09:12:33.449 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_password", 2024-09-19T09:12:33.449 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.449 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.449 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.449 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.449 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.449 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.450 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.450 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Password to authenticate with", 2024-09-19T09:12:33.450 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.450 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.450 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.450 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.450 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_port": { 2024-09-19T09:12:33.450 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_port", 2024-09-19T09:12:33.450 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.450 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.450 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.450 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "465", 2024-09-19T09:12:33.450 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.450 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.451 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.451 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SMTP port", 2024-09-19T09:12:33.451 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.451 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.451 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.451 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.451 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_sender": { 2024-09-19T09:12:33.451 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_sender", 2024-09-19T09:12:33.451 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.451 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.451 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.451 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.451 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.451 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.452 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.452 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SMTP envelope sender", 2024-09-19T09:12:33.452 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.452 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.452 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.452 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.452 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_ssl": { 2024-09-19T09:12:33.452 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_ssl", 2024-09-19T09:12:33.452 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.452 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.452 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.452 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.452 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.453 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.453 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.453 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T09:12:33.453 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.453 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.453 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.453 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.453 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_user": { 2024-09-19T09:12:33.453 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_user", 2024-09-19T09:12:33.453 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.453 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.453 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.453 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.454 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.454 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.454 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.454 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "User to authenticate as", 2024-09-19T09:12:33.454 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.454 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.454 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.454 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.454 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.454 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.454 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.455 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "balancer", 2024-09-19T09:12:33.455 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.455 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.455 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.455 INFO:teuthology.orchestra.run.smithi092.stdout: "active": { 2024-09-19T09:12:33.455 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "active", 2024-09-19T09:12:33.455 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.455 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.455 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.455 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.455 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.455 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.455 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.456 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T09:12:33.456 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.456 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.456 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.456 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.456 INFO:teuthology.orchestra.run.smithi092.stdout: "begin_time": { 2024-09-19T09:12:33.456 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "begin_time", 2024-09-19T09:12:33.456 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.456 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.456 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.456 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0000", 2024-09-19T09:12:33.456 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.456 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.457 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.457 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T09:12:33.457 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:12:33.457 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.457 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.457 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.457 INFO:teuthology.orchestra.run.smithi092.stdout: "begin_weekday": { 2024-09-19T09:12:33.457 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "begin_weekday", 2024-09-19T09:12:33.457 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-19T09:12:33.457 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.457 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.457 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-19T09:12:33.458 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "0", 2024-09-19T09:12:33.458 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "6", 2024-09-19T09:12:33.458 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.458 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T09:12:33.458 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:12:33.458 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.458 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.458 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.458 INFO:teuthology.orchestra.run.smithi092.stdout: "crush_compat_max_iterations": { 2024-09-19T09:12:33.458 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crush_compat_max_iterations", 2024-09-19T09:12:33.458 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-19T09:12:33.458 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.458 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.459 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "25", 2024-09-19T09:12:33.459 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2024-09-19T09:12:33.459 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "250", 2024-09-19T09:12:33.459 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.459 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T09:12:33.459 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.459 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.459 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.459 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.459 INFO:teuthology.orchestra.run.smithi092.stdout: "crush_compat_metrics": { 2024-09-19T09:12:33.459 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crush_compat_metrics", 2024-09-19T09:12:33.459 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.459 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.460 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.460 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T09:12:33.460 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.460 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.460 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.460 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T09:12:33.460 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T09:12:33.460 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.460 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.460 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.460 INFO:teuthology.orchestra.run.smithi092.stdout: "crush_compat_step": { 2024-09-19T09:12:33.460 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crush_compat_step", 2024-09-19T09:12:33.460 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-19T09:12:33.461 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.461 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.461 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0.5", 2024-09-19T09:12:33.461 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "0.001", 2024-09-19T09:12:33.461 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "0.999", 2024-09-19T09:12:33.461 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.461 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "aggressiveness of optimization", 2024-09-19T09:12:33.461 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T09:12:33.461 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.461 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.461 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.461 INFO:teuthology.orchestra.run.smithi092.stdout: "end_time": { 2024-09-19T09:12:33.461 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "end_time", 2024-09-19T09:12:33.462 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.462 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.462 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.462 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "2359", 2024-09-19T09:12:33.462 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.462 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.462 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.462 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T09:12:33.462 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:12:33.462 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.462 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.462 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.463 INFO:teuthology.orchestra.run.smithi092.stdout: "end_weekday": { 2024-09-19T09:12:33.463 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "end_weekday", 2024-09-19T09:12:33.463 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-19T09:12:33.463 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.463 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.463 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-19T09:12:33.463 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "0", 2024-09-19T09:12:33.463 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "6", 2024-09-19T09:12:33.463 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.463 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T09:12:33.463 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:12:33.463 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.463 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.463 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.464 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.464 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.464 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.464 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.464 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.464 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.464 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.464 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.464 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.464 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.464 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.464 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.464 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.465 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.465 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.465 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.465 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.465 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.465 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.465 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.465 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.465 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.465 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.465 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.465 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.466 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.466 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.466 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.466 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.466 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.466 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.466 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.466 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.466 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.466 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.466 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.466 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.467 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.467 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.467 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.467 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.467 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.467 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.467 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.467 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.467 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.467 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.467 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.467 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.467 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.468 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.468 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.468 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.468 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.468 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.468 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.468 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.468 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.468 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.468 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.468 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.468 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.468 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.469 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.469 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.469 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.469 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.469 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.469 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.469 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.469 INFO:teuthology.orchestra.run.smithi092.stdout: "min_score": { 2024-09-19T09:12:33.469 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "min_score", 2024-09-19T09:12:33.469 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-19T09:12:33.469 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.469 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.469 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-19T09:12:33.470 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.470 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.470 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.470 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T09:12:33.470 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.470 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.470 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.470 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.470 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": { 2024-09-19T09:12:33.470 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mode", 2024-09-19T09:12:33.470 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.470 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.470 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.470 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "upmap", 2024-09-19T09:12:33.471 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.471 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.471 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.471 INFO:teuthology.orchestra.run.smithi092.stdout: "crush-compat", 2024-09-19T09:12:33.471 INFO:teuthology.orchestra.run.smithi092.stdout: "none", 2024-09-19T09:12:33.471 INFO:teuthology.orchestra.run.smithi092.stdout: "read", 2024-09-19T09:12:33.471 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap", 2024-09-19T09:12:33.471 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap-read" 2024-09-19T09:12:33.471 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.471 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Balancer mode", 2024-09-19T09:12:33.471 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.471 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.471 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.471 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.472 INFO:teuthology.orchestra.run.smithi092.stdout: "pool_ids": { 2024-09-19T09:12:33.472 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pool_ids", 2024-09-19T09:12:33.472 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.472 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.472 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.472 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.472 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.472 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.472 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.472 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T09:12:33.472 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.472 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.473 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.473 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.473 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-19T09:12:33.473 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-19T09:12:33.473 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.473 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.473 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.473 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-19T09:12:33.473 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.473 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.473 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.473 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T09:12:33.473 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.473 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.474 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.474 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.474 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap_max_deviation": { 2024-09-19T09:12:33.474 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "upmap_max_deviation", 2024-09-19T09:12:33.474 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.474 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.474 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.474 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-19T09:12:33.474 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2024-09-19T09:12:33.474 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.474 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.474 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T09:12:33.474 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T09:12:33.475 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.475 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.475 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.475 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap_max_optimizations": { 2024-09-19T09:12:33.475 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "upmap_max_optimizations", 2024-09-19T09:12:33.475 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-19T09:12:33.475 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.475 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.475 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-19T09:12:33.475 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.475 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.475 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.475 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T09:12:33.475 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.476 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.476 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.476 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.476 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.476 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.476 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.476 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cephadm", 2024-09-19T09:12:33.476 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.476 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.476 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.476 INFO:teuthology.orchestra.run.smithi092.stdout: "agent_down_multiplier": { 2024-09-19T09:12:33.476 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "agent_down_multiplier", 2024-09-19T09:12:33.476 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-19T09:12:33.477 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.477 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.477 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3.0", 2024-09-19T09:12:33.477 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.477 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.477 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.477 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T09:12:33.477 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.477 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.477 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.477 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.477 INFO:teuthology.orchestra.run.smithi092.stdout: "agent_refresh_rate": { 2024-09-19T09:12:33.477 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "agent_refresh_rate", 2024-09-19T09:12:33.478 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.478 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.478 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.478 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "20", 2024-09-19T09:12:33.478 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.478 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.478 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.478 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T09:12:33.478 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.478 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.478 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.478 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.478 INFO:teuthology.orchestra.run.smithi092.stdout: "agent_starting_port": { 2024-09-19T09:12:33.478 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "agent_starting_port", 2024-09-19T09:12:33.479 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.479 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.479 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.479 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "4721", 2024-09-19T09:12:33.479 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.479 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.479 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.479 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T09:12:33.479 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.479 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.479 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.479 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.479 INFO:teuthology.orchestra.run.smithi092.stdout: "allow_ptrace": { 2024-09-19T09:12:33.479 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "allow_ptrace", 2024-09-19T09:12:33.480 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.480 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.480 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.480 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.480 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.480 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.480 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.480 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T09:12:33.480 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T09:12:33.480 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.480 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.480 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.480 INFO:teuthology.orchestra.run.smithi092.stdout: "autotune_interval": { 2024-09-19T09:12:33.481 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "autotune_interval", 2024-09-19T09:12:33.481 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.481 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.481 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.481 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-19T09:12:33.481 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.481 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.481 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.481 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T09:12:33.481 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.481 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.481 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.481 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.482 INFO:teuthology.orchestra.run.smithi092.stdout: "autotune_memory_target_ratio": { 2024-09-19T09:12:33.482 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T09:12:33.482 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-19T09:12:33.482 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.482 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.482 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0.7", 2024-09-19T09:12:33.482 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.482 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.482 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.482 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T09:12:33.482 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.482 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.482 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.483 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.483 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm_log_destination": { 2024-09-19T09:12:33.483 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cephadm_log_destination", 2024-09-19T09:12:33.483 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.483 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.483 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.483 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.483 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.483 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.483 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.483 INFO:teuthology.orchestra.run.smithi092.stdout: "file", 2024-09-19T09:12:33.483 INFO:teuthology.orchestra.run.smithi092.stdout: "file,syslog", 2024-09-19T09:12:33.483 INFO:teuthology.orchestra.run.smithi092.stdout: "syslog" 2024-09-19T09:12:33.483 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.484 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T09:12:33.484 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.484 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.484 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.484 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.484 INFO:teuthology.orchestra.run.smithi092.stdout: "cgroups_split": { 2024-09-19T09:12:33.484 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cgroups_split", 2024-09-19T09:12:33.484 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.484 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.484 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.484 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.484 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.485 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.485 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.485 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T09:12:33.485 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.485 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.485 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.485 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.485 INFO:teuthology.orchestra.run.smithi092.stdout: "config_checks_enabled": { 2024-09-19T09:12:33.485 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "config_checks_enabled", 2024-09-19T09:12:33.485 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.485 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.485 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.485 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.485 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.486 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.486 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.486 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T09:12:33.486 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.486 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.486 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.486 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.486 INFO:teuthology.orchestra.run.smithi092.stdout: "config_dashboard": { 2024-09-19T09:12:33.486 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "config_dashboard", 2024-09-19T09:12:33.486 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.486 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.486 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.486 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.486 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.486 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.487 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.487 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T09:12:33.487 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.487 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.487 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.487 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.487 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_alertmanager": { 2024-09-19T09:12:33.487 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_alertmanager", 2024-09-19T09:12:33.487 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.487 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.487 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.487 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T09:12:33.487 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.488 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.488 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.488 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2024-09-19T09:12:33.488 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.488 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.488 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.488 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.488 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_base": { 2024-09-19T09:12:33.488 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_base", 2024-09-19T09:12:33.488 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.488 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.488 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.488 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T09:12:33.489 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.489 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.489 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.489 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Container image name, without the tag", 2024-09-19T09:12:33.489 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.489 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.489 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.489 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.489 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_elasticsearch": { 2024-09-19T09:12:33.489 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_elasticsearch", 2024-09-19T09:12:33.489 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.489 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.489 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.489 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T09:12:33.490 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.490 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.490 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.490 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "elasticsearch container image", 2024-09-19T09:12:33.490 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.490 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.490 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.490 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.490 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_grafana": { 2024-09-19T09:12:33.490 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_grafana", 2024-09-19T09:12:33.490 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.490 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.490 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.490 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T09:12:33.491 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.491 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.491 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.491 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2024-09-19T09:12:33.491 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.491 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.491 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.491 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.491 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_haproxy": { 2024-09-19T09:12:33.491 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_haproxy", 2024-09-19T09:12:33.491 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.491 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.491 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.492 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T09:12:33.492 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.492 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.492 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.492 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "HAproxy container image", 2024-09-19T09:12:33.492 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.492 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.492 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.492 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.492 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_jaeger_agent": { 2024-09-19T09:12:33.492 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_jaeger_agent", 2024-09-19T09:12:33.492 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.492 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.492 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.493 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T09:12:33.493 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.493 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.493 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.493 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Jaeger agent container image", 2024-09-19T09:12:33.493 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.493 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.493 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.493 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.493 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_jaeger_collector": { 2024-09-19T09:12:33.493 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_jaeger_collector", 2024-09-19T09:12:33.493 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.493 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.493 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.494 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T09:12:33.494 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.494 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.494 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.494 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Jaeger collector container image", 2024-09-19T09:12:33.494 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.494 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.494 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.494 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.494 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_jaeger_query": { 2024-09-19T09:12:33.494 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_jaeger_query", 2024-09-19T09:12:33.494 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.494 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.494 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.495 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T09:12:33.495 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.495 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.495 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.495 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Jaeger query container image", 2024-09-19T09:12:33.495 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.495 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.495 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.495 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.495 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_keepalived": { 2024-09-19T09:12:33.495 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_keepalived", 2024-09-19T09:12:33.495 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.495 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.495 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.496 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T09:12:33.496 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.496 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.496 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.496 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Keepalived container image", 2024-09-19T09:12:33.496 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.496 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.496 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.496 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.496 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_loki": { 2024-09-19T09:12:33.496 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_loki", 2024-09-19T09:12:33.496 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.497 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.497 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.497 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T09:12:33.497 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.497 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.497 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.497 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Loki container image", 2024-09-19T09:12:33.497 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.497 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.497 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.497 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.497 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_node_exporter": { 2024-09-19T09:12:33.497 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_node_exporter", 2024-09-19T09:12:33.498 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.498 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.498 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.498 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T09:12:33.498 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.498 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.498 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.498 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2024-09-19T09:12:33.498 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.498 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.498 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.498 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.498 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_nvmeof": { 2024-09-19T09:12:33.499 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_nvmeof", 2024-09-19T09:12:33.499 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.499 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.499 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.499 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T09:12:33.499 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.499 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.499 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.499 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Nvme-of container image", 2024-09-19T09:12:33.499 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.499 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.499 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.499 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.500 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_prometheus": { 2024-09-19T09:12:33.500 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_prometheus", 2024-09-19T09:12:33.500 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.500 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.500 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.500 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T09:12:33.500 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.500 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.500 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.500 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2024-09-19T09:12:33.500 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.500 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.500 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.501 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.501 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_promtail": { 2024-09-19T09:12:33.501 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_promtail", 2024-09-19T09:12:33.501 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.501 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.501 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.501 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T09:12:33.504 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.504 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.504 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.504 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Promtail container image", 2024-09-19T09:12:33.504 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.505 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.505 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.505 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.505 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_samba": { 2024-09-19T09:12:33.505 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_samba", 2024-09-19T09:12:33.505 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.505 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.505 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.505 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T09:12:33.505 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.505 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.505 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.505 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Samba/SMB container image", 2024-09-19T09:12:33.506 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.506 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.506 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.506 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.506 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_snmp_gateway": { 2024-09-19T09:12:33.506 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_snmp_gateway", 2024-09-19T09:12:33.506 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.506 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.506 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.506 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T09:12:33.506 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.506 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.506 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.506 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SNMP Gateway container image", 2024-09-19T09:12:33.507 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.507 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.507 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.507 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.507 INFO:teuthology.orchestra.run.smithi092.stdout: "container_init": { 2024-09-19T09:12:33.507 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_init", 2024-09-19T09:12:33.507 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.507 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.507 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.507 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.507 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.507 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.508 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.508 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T09:12:33.508 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.508 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.508 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.508 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.508 INFO:teuthology.orchestra.run.smithi092.stdout: "daemon_cache_timeout": { 2024-09-19T09:12:33.508 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "daemon_cache_timeout", 2024-09-19T09:12:33.508 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.508 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.508 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.508 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-19T09:12:33.509 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.509 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.509 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.509 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T09:12:33.509 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.509 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.509 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.509 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.509 INFO:teuthology.orchestra.run.smithi092.stdout: "default_cephadm_command_timeout": { 2024-09-19T09:12:33.509 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T09:12:33.509 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.509 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.509 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.509 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "900", 2024-09-19T09:12:33.510 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.510 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.510 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.510 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T09:12:33.510 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.510 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.510 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.510 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.510 INFO:teuthology.orchestra.run.smithi092.stdout: "default_registry": { 2024-09-19T09:12:33.510 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "default_registry", 2024-09-19T09:12:33.510 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.510 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.510 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.510 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io", 2024-09-19T09:12:33.510 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.511 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.511 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.511 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T09:12:33.511 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.511 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.511 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.511 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.511 INFO:teuthology.orchestra.run.smithi092.stdout: "device_cache_timeout": { 2024-09-19T09:12:33.511 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "device_cache_timeout", 2024-09-19T09:12:33.511 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.511 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.511 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.512 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "1800", 2024-09-19T09:12:33.512 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.512 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.512 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.512 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "seconds to cache device inventory", 2024-09-19T09:12:33.512 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.512 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.512 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.512 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.512 INFO:teuthology.orchestra.run.smithi092.stdout: "device_enhanced_scan": { 2024-09-19T09:12:33.512 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "device_enhanced_scan", 2024-09-19T09:12:33.512 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.512 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.512 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.513 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.513 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.513 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.513 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.513 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T09:12:33.513 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.513 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.513 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.513 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.513 INFO:teuthology.orchestra.run.smithi092.stdout: "facts_cache_timeout": { 2024-09-19T09:12:33.513 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "facts_cache_timeout", 2024-09-19T09:12:33.513 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.514 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.514 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.514 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-19T09:12:33.514 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.514 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.514 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.514 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "seconds to cache host facts data", 2024-09-19T09:12:33.514 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.514 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.514 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.514 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.514 INFO:teuthology.orchestra.run.smithi092.stdout: "grafana_dashboards_path": { 2024-09-19T09:12:33.514 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "grafana_dashboards_path", 2024-09-19T09:12:33.514 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.515 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.515 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.515 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T09:12:33.515 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.515 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.515 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.515 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T09:12:33.515 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.515 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.515 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.515 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.515 INFO:teuthology.orchestra.run.smithi092.stdout: "host_check_interval": { 2024-09-19T09:12:33.515 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "host_check_interval", 2024-09-19T09:12:33.516 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.516 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.516 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.516 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-19T09:12:33.516 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.516 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.516 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.516 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to perform a host check", 2024-09-19T09:12:33.516 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.516 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.516 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.516 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.517 INFO:teuthology.orchestra.run.smithi092.stdout: "hw_monitoring": { 2024-09-19T09:12:33.517 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "hw_monitoring", 2024-09-19T09:12:33.517 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.517 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.517 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.517 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.517 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.517 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.517 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.517 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T09:12:33.517 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.517 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.517 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.517 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.518 INFO:teuthology.orchestra.run.smithi092.stdout: "inventory_list_all": { 2024-09-19T09:12:33.518 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "inventory_list_all", 2024-09-19T09:12:33.518 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.518 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.518 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.518 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.518 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.518 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.518 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.518 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T09:12:33.518 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.518 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.518 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.519 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.519 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.519 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.519 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.519 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.519 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.519 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.519 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.519 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.519 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.519 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.519 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.519 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.520 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.520 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.520 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.520 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.520 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.520 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.520 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.520 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.520 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.520 INFO:teuthology.orchestra.run.smithi092.stdout: "log_refresh_metadata": { 2024-09-19T09:12:33.520 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_refresh_metadata", 2024-09-19T09:12:33.520 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.521 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.521 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.521 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.521 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.521 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.521 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.521 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T09:12:33.521 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.521 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.521 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.521 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.521 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.521 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.522 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.522 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.522 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.522 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.522 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.522 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.522 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.522 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T09:12:33.522 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.522 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.522 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.522 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.522 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.523 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.523 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.523 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.523 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.523 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.523 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.523 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.523 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.523 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.523 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.523 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.523 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.523 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.524 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.524 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.524 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.524 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.524 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.524 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.524 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.524 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.524 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.524 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.524 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.524 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.524 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.525 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.525 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.525 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.525 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.525 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.525 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.525 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.525 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.525 INFO:teuthology.orchestra.run.smithi092.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T09:12:33.525 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T09:12:33.525 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.525 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.525 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.526 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.526 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.526 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.526 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.526 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T09:12:33.526 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.526 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.526 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.526 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.526 INFO:teuthology.orchestra.run.smithi092.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T09:12:33.526 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T09:12:33.526 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.526 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.526 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.527 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "*", 2024-09-19T09:12:33.527 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.527 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.527 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.527 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T09:12:33.527 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.527 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.527 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.527 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.527 INFO:teuthology.orchestra.run.smithi092.stdout: "max_count_per_host": { 2024-09-19T09:12:33.527 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_count_per_host", 2024-09-19T09:12:33.527 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.528 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.528 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.528 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-19T09:12:33.528 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.528 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.528 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.528 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "max number of daemons per service per host", 2024-09-19T09:12:33.528 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.528 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.528 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.528 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.528 INFO:teuthology.orchestra.run.smithi092.stdout: "max_osd_draining_count": { 2024-09-19T09:12:33.528 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_osd_draining_count", 2024-09-19T09:12:33.528 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.529 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.529 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.529 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-19T09:12:33.529 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.529 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.529 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.529 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T09:12:33.529 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.529 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.529 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.529 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.529 INFO:teuthology.orchestra.run.smithi092.stdout: "migration_current": { 2024-09-19T09:12:33.529 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "migration_current", 2024-09-19T09:12:33.530 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.530 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.530 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.530 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.530 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.530 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.530 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.530 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "internal - do not modify", 2024-09-19T09:12:33.530 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.530 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.530 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.530 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.530 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": { 2024-09-19T09:12:33.530 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mode", 2024-09-19T09:12:33.530 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.531 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.531 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.531 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "root", 2024-09-19T09:12:33.531 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.531 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.531 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.531 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm-package", 2024-09-19T09:12:33.531 INFO:teuthology.orchestra.run.smithi092.stdout: "root" 2024-09-19T09:12:33.531 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.531 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T09:12:33.531 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.531 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.531 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.531 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.531 INFO:teuthology.orchestra.run.smithi092.stdout: "oob_default_addr": { 2024-09-19T09:12:33.532 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "oob_default_addr", 2024-09-19T09:12:33.532 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.532 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.532 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.532 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "169.254.1.1", 2024-09-19T09:12:33.532 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.532 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.532 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.532 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T09:12:33.532 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.532 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.532 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.532 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.532 INFO:teuthology.orchestra.run.smithi092.stdout: "prometheus_alerts_path": { 2024-09-19T09:12:33.532 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "prometheus_alerts_path", 2024-09-19T09:12:33.533 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.533 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.533 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.533 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T09:12:33.533 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.533 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.533 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.533 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T09:12:33.533 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.533 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.533 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.533 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.533 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_insecure": { 2024-09-19T09:12:33.533 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_insecure", 2024-09-19T09:12:33.533 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.534 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.534 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.534 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.534 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.534 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.534 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.534 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T09:12:33.534 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.534 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.534 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.534 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.534 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_password": { 2024-09-19T09:12:33.534 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_password", 2024-09-19T09:12:33.534 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.535 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.535 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.535 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.535 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.535 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.535 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.535 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T09:12:33.535 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.535 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.535 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.535 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.535 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_url": { 2024-09-19T09:12:33.535 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_url", 2024-09-19T09:12:33.535 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.536 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.536 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.536 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.536 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.536 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.536 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.536 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T09:12:33.536 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.536 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.536 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.536 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.536 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_username": { 2024-09-19T09:12:33.537 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_username", 2024-09-19T09:12:33.537 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.537 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.537 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.537 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.537 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.537 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.537 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.537 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T09:12:33.537 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.537 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.537 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.538 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.538 INFO:teuthology.orchestra.run.smithi092.stdout: "secure_monitoring_stack": { 2024-09-19T09:12:33.538 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "secure_monitoring_stack", 2024-09-19T09:12:33.538 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.538 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.538 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.538 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.538 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.538 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.538 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.538 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T09:12:33.538 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.538 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.539 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.539 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.539 INFO:teuthology.orchestra.run.smithi092.stdout: "service_discovery_port": { 2024-09-19T09:12:33.539 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "service_discovery_port", 2024-09-19T09:12:33.539 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.539 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.539 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.539 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8765", 2024-09-19T09:12:33.539 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.539 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.539 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.539 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "cephadm service discovery port", 2024-09-19T09:12:33.539 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.540 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.540 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.540 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.540 INFO:teuthology.orchestra.run.smithi092.stdout: "ssh_config_file": { 2024-09-19T09:12:33.540 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssh_config_file", 2024-09-19T09:12:33.540 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.540 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.540 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.540 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.540 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.540 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.540 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.540 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T09:12:33.541 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.541 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.541 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.541 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.541 INFO:teuthology.orchestra.run.smithi092.stdout: "use_agent": { 2024-09-19T09:12:33.541 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "use_agent", 2024-09-19T09:12:33.541 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.541 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.541 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.541 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.541 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.541 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.541 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.541 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T09:12:33.542 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.542 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.542 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.542 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.542 INFO:teuthology.orchestra.run.smithi092.stdout: "use_repo_digest": { 2024-09-19T09:12:33.542 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "use_repo_digest", 2024-09-19T09:12:33.542 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.542 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.542 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.542 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.542 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.542 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.542 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.542 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T09:12:33.543 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.543 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.543 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.543 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.543 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_on_failed_host_check": { 2024-09-19T09:12:33.543 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_on_failed_host_check", 2024-09-19T09:12:33.543 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.543 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.543 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.543 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.543 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.543 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.543 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.544 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T09:12:33.544 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.544 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.544 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.544 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.544 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_on_stray_daemons": { 2024-09-19T09:12:33.544 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_on_stray_daemons", 2024-09-19T09:12:33.544 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.544 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.544 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.544 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.544 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.544 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.544 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.545 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T09:12:33.545 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.545 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.545 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.545 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.545 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_on_stray_hosts": { 2024-09-19T09:12:33.545 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_on_stray_hosts", 2024-09-19T09:12:33.545 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.545 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.545 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.545 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.545 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.546 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.546 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.546 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T09:12:33.546 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.546 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.546 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.546 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.546 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.546 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.546 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.546 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crash", 2024-09-19T09:12:33.546 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.546 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.547 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.547 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.547 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.547 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.547 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.547 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.547 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.547 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.547 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.547 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.547 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.547 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.548 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.548 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.548 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.548 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.548 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.548 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.548 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.548 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.548 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.548 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.548 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.548 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.548 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.549 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.549 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.549 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.549 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.549 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.549 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.549 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.549 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.549 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.549 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.549 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.549 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.550 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.550 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.550 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.550 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.550 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.550 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.550 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.550 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.550 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.550 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.550 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.550 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.550 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.551 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.551 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.551 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.551 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.551 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.551 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.551 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.551 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.551 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.551 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.551 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.551 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.551 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.551 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.552 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.552 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.552 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.552 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.552 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.552 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.552 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.552 INFO:teuthology.orchestra.run.smithi092.stdout: "retain_interval": { 2024-09-19T09:12:33.552 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "retain_interval", 2024-09-19T09:12:33.552 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.552 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.552 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.552 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "31536000", 2024-09-19T09:12:33.552 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.553 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.553 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.553 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T09:12:33.553 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.553 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.553 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.553 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.553 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_recent_interval": { 2024-09-19T09:12:33.553 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_recent_interval", 2024-09-19T09:12:33.553 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.553 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.553 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.553 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "1209600", 2024-09-19T09:12:33.553 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.554 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.554 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.554 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T09:12:33.554 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.554 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.554 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.554 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.554 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.554 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.554 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.554 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "dashboard", 2024-09-19T09:12:33.554 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.554 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.554 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.554 INFO:teuthology.orchestra.run.smithi092.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T09:12:33.555 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T09:12:33.555 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.555 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.555 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.555 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-19T09:12:33.555 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.555 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.555 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.555 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.555 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.555 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.555 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.555 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.555 INFO:teuthology.orchestra.run.smithi092.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T09:12:33.555 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T09:12:33.556 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.556 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.556 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.556 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.556 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.556 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.556 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.556 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.556 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.556 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.556 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.556 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.556 INFO:teuthology.orchestra.run.smithi092.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T09:12:33.557 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T09:12:33.557 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.557 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.557 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.557 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.557 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.557 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.557 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.557 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.557 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.557 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.557 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.558 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.558 INFO:teuthology.orchestra.run.smithi092.stdout: "AUDIT_API_ENABLED": { 2024-09-19T09:12:33.558 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T09:12:33.558 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.558 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.558 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.558 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.558 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.558 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.558 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.558 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.558 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.558 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.559 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.559 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.559 INFO:teuthology.orchestra.run.smithi092.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T09:12:33.559 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T09:12:33.559 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.559 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.559 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.559 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.559 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.559 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.559 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.559 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.559 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.559 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.559 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.559 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.560 INFO:teuthology.orchestra.run.smithi092.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T09:12:33.560 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T09:12:33.560 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.560 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.560 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.560 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.560 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.560 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.560 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.560 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.560 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.560 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.561 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.561 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.561 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T09:12:33.561 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T09:12:33.561 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.561 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.561 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.561 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.561 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.561 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.561 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.561 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.561 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.562 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.562 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.562 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.562 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T09:12:33.562 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T09:12:33.562 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.562 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.562 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.562 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.562 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.562 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.562 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.562 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.562 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.563 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.563 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.563 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.563 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T09:12:33.563 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T09:12:33.563 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.563 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.563 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.563 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.563 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.563 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.563 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.563 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.563 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.564 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.564 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.564 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.564 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T09:12:33.564 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T09:12:33.564 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.564 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.564 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.564 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.564 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.564 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.564 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.564 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.564 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.565 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.565 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.565 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.565 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T09:12:33.565 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T09:12:33.565 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.565 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.565 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.565 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.565 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.565 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.565 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.565 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.566 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.566 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.566 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.566 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.566 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T09:12:33.566 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T09:12:33.566 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.566 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.566 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.566 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.566 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.566 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.566 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.567 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.567 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.567 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.567 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.567 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.567 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T09:12:33.567 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T09:12:33.567 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.567 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.567 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.567 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.567 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.567 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.568 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.568 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.568 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.568 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.568 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.568 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.568 INFO:teuthology.orchestra.run.smithi092.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T09:12:33.568 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T09:12:33.568 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.568 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.568 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.568 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.568 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.569 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.569 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.569 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.569 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.569 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.569 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.569 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.569 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T09:12:33.569 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T09:12:33.569 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.569 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.569 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.569 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "admin", 2024-09-19T09:12:33.569 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.570 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.570 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.570 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.570 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.570 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.570 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.570 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.570 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T09:12:33.570 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T09:12:33.570 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.570 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.570 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.570 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.571 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.571 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.571 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.571 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.571 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.571 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.571 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.571 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.571 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_URL": { 2024-09-19T09:12:33.571 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_URL", 2024-09-19T09:12:33.571 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.571 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.571 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.571 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.572 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.572 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.572 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.572 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.572 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.572 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.572 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.572 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.572 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T09:12:33.572 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T09:12:33.572 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.572 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.572 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.573 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "admin", 2024-09-19T09:12:33.573 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.573 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.573 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.573 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.573 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.573 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.573 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.573 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.573 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T09:12:33.573 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T09:12:33.573 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.573 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.574 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.574 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.574 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.574 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.574 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.574 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.574 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.574 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.574 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.574 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.574 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T09:12:33.574 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T09:12:33.575 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.575 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.575 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.575 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.575 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.575 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.575 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.575 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.575 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.575 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.575 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.575 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.575 INFO:teuthology.orchestra.run.smithi092.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T09:12:33.575 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T09:12:33.575 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.576 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.576 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.576 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.576 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.576 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.576 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.576 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.576 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.576 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.576 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.576 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.576 INFO:teuthology.orchestra.run.smithi092.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T09:12:33.577 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T09:12:33.577 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.577 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.577 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.577 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.577 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.577 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.577 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.577 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.577 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.577 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.577 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.577 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.578 INFO:teuthology.orchestra.run.smithi092.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T09:12:33.578 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T09:12:33.578 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.578 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.578 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.578 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.578 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.578 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.578 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.578 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.578 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.578 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.578 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.578 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.579 INFO:teuthology.orchestra.run.smithi092.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T09:12:33.579 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T09:12:33.579 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.579 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.579 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.579 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.579 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.579 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.579 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.579 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.579 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.579 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.579 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.580 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.580 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T09:12:33.580 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T09:12:33.580 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.580 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.580 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.580 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.580 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.580 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.580 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.580 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.580 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.580 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.581 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.581 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.581 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T09:12:33.581 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T09:12:33.581 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.581 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.581 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.581 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.581 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.581 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.581 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.581 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.581 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.581 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.582 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.582 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.582 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T09:12:33.582 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T09:12:33.582 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.582 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.582 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.582 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.582 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.582 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.582 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.582 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.582 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.583 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.583 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.583 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.583 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T09:12:33.583 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T09:12:33.583 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.583 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.583 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.583 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.583 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.583 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.583 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.583 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.583 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.584 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.584 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.584 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.584 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T09:12:33.584 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T09:12:33.584 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.584 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.584 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.584 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.584 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.584 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.584 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.584 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.585 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.585 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.585 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.585 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.585 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T09:12:33.585 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T09:12:33.585 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.585 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.585 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.585 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.585 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.585 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.585 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.586 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.586 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.586 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.586 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.586 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.586 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T09:12:33.586 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T09:12:33.586 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.586 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.586 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.586 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.586 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.586 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.586 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.587 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.587 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.587 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.587 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.587 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.587 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T09:12:33.587 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T09:12:33.587 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.587 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.587 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.587 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.587 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.587 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.588 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.588 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.588 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.588 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.588 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.588 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.588 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T09:12:33.588 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T09:12:33.588 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.588 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.588 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.588 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T09:12:33.589 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.589 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.589 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.589 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.589 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.589 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.589 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.589 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.589 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T09:12:33.589 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T09:12:33.589 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.589 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.589 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.589 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-19T09:12:33.590 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.590 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.590 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.590 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.590 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.590 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.590 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.590 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.590 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T09:12:33.590 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T09:12:33.590 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.590 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.590 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.591 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8", 2024-09-19T09:12:33.591 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.591 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.591 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.591 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.591 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.591 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.591 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.591 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.591 INFO:teuthology.orchestra.run.smithi092.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T09:12:33.591 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T09:12:33.591 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.591 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.591 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.592 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "45", 2024-09-19T09:12:33.592 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.592 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.592 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.592 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.592 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.592 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.592 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.592 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.592 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T09:12:33.592 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T09:12:33.592 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.593 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.593 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.593 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.593 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.593 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.593 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.593 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.593 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.593 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.593 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.593 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.593 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T09:12:33.593 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T09:12:33.594 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.594 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.594 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.594 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "admin", 2024-09-19T09:12:33.594 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.594 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.594 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.594 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.594 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.594 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.594 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.594 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.594 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T09:12:33.594 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T09:12:33.594 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.595 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.595 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.595 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.595 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.595 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.595 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.595 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.595 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.595 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.595 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.595 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.595 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T09:12:33.595 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T09:12:33.595 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.595 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.596 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.596 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.596 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.596 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.596 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.596 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.596 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.596 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.596 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.596 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.596 INFO:teuthology.orchestra.run.smithi092.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T09:12:33.596 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T09:12:33.596 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.596 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.596 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.597 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-19T09:12:33.597 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.597 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.597 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.597 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.597 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.597 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.597 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.597 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.597 INFO:teuthology.orchestra.run.smithi092.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T09:12:33.597 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T09:12:33.597 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.597 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.598 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.598 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-19T09:12:33.598 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.598 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.598 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.598 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.598 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.598 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.598 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.598 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.598 INFO:teuthology.orchestra.run.smithi092.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T09:12:33.598 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T09:12:33.599 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.599 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.599 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.599 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-19T09:12:33.599 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.599 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.599 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.599 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.599 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.599 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.599 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.599 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.599 INFO:teuthology.orchestra.run.smithi092.stdout: "cross_origin_url": { 2024-09-19T09:12:33.600 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cross_origin_url", 2024-09-19T09:12:33.600 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.600 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.600 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.600 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.600 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.600 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.600 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.600 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.600 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.600 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.600 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.600 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.600 INFO:teuthology.orchestra.run.smithi092.stdout: "crt_file": { 2024-09-19T09:12:33.601 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crt_file", 2024-09-19T09:12:33.601 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.601 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.601 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.601 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.601 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.601 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.601 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.601 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.601 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.601 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.601 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.601 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.602 INFO:teuthology.orchestra.run.smithi092.stdout: "debug": { 2024-09-19T09:12:33.602 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "debug", 2024-09-19T09:12:33.602 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.602 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.602 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.602 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.602 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.602 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.602 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.602 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Enable/disable debug options", 2024-09-19T09:12:33.602 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.602 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.602 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.602 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.603 INFO:teuthology.orchestra.run.smithi092.stdout: "jwt_token_ttl": { 2024-09-19T09:12:33.603 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "jwt_token_ttl", 2024-09-19T09:12:33.603 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.603 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.603 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.603 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "28800", 2024-09-19T09:12:33.603 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.603 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.603 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.603 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.603 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.603 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.603 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.604 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.604 INFO:teuthology.orchestra.run.smithi092.stdout: "key_file": { 2024-09-19T09:12:33.604 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "key_file", 2024-09-19T09:12:33.604 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.604 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.604 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.604 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.604 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.604 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.604 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.604 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.604 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.604 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.605 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.605 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.605 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.605 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.605 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.605 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.605 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.605 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.605 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.605 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.605 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.605 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.605 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.606 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.606 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.606 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.606 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.606 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.606 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.606 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.606 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.606 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.606 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.606 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.606 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.606 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.607 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.607 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.607 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.607 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.607 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.607 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.607 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.607 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.607 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.607 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.607 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.607 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.607 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.608 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.608 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.608 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.608 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.608 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.608 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.608 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.608 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.608 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.608 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.608 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.608 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.609 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.609 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.609 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.609 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.609 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.609 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.609 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.609 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.609 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.609 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.609 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.609 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.609 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.610 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.610 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.610 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.610 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.610 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.610 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.610 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.610 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.610 INFO:teuthology.orchestra.run.smithi092.stdout: "motd": { 2024-09-19T09:12:33.610 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "motd", 2024-09-19T09:12:33.610 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.610 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.610 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.611 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.611 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.611 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.611 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.611 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "The message of the day", 2024-09-19T09:12:33.611 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.611 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.611 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.611 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.611 INFO:teuthology.orchestra.run.smithi092.stdout: "redirect_resolve_ip_addr": { 2024-09-19T09:12:33.611 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T09:12:33.611 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.611 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.612 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.612 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.612 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.612 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.612 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.612 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.612 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.612 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.612 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.612 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.612 INFO:teuthology.orchestra.run.smithi092.stdout: "server_addr": { 2024-09-19T09:12:33.612 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_addr", 2024-09-19T09:12:33.612 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.612 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.613 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.613 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "::", 2024-09-19T09:12:33.613 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.613 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.613 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.613 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.613 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.613 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.613 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.613 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.613 INFO:teuthology.orchestra.run.smithi092.stdout: "server_port": { 2024-09-19T09:12:33.613 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_port", 2024-09-19T09:12:33.614 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.614 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.614 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.614 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8080", 2024-09-19T09:12:33.614 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.614 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.614 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.614 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.614 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.614 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.614 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.614 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.614 INFO:teuthology.orchestra.run.smithi092.stdout: "ssl": { 2024-09-19T09:12:33.614 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssl", 2024-09-19T09:12:33.615 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.615 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.615 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.615 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.615 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.615 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.615 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.615 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.615 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.615 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.615 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.615 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.615 INFO:teuthology.orchestra.run.smithi092.stdout: "ssl_server_port": { 2024-09-19T09:12:33.616 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssl_server_port", 2024-09-19T09:12:33.616 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.616 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.616 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.616 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8443", 2024-09-19T09:12:33.616 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.616 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.616 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.616 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.616 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.616 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.616 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.617 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.617 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_behaviour": { 2024-09-19T09:12:33.617 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_behaviour", 2024-09-19T09:12:33.617 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.617 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.617 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.617 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "redirect", 2024-09-19T09:12:33.617 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.617 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.617 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.617 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.617 INFO:teuthology.orchestra.run.smithi092.stdout: "redirect" 2024-09-19T09:12:33.618 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.618 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.618 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.618 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.618 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.618 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.618 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_error_status_code": { 2024-09-19T09:12:33.618 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_error_status_code", 2024-09-19T09:12:33.618 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.618 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.618 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.618 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "500", 2024-09-19T09:12:33.618 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "400", 2024-09-19T09:12:33.619 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "599", 2024-09-19T09:12:33.619 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.619 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.619 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.619 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.619 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.619 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.619 INFO:teuthology.orchestra.run.smithi092.stdout: "url_prefix": { 2024-09-19T09:12:33.619 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "url_prefix", 2024-09-19T09:12:33.619 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.619 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.619 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.620 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.620 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.620 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.620 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.620 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.620 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.620 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.620 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.620 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.620 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.620 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.620 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.620 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "devicehealth", 2024-09-19T09:12:33.621 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.621 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.621 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.621 INFO:teuthology.orchestra.run.smithi092.stdout: "enable_monitoring": { 2024-09-19T09:12:33.621 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enable_monitoring", 2024-09-19T09:12:33.621 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.621 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.621 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.621 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.621 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.621 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.621 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.621 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "monitor device health metrics", 2024-09-19T09:12:33.622 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.622 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.622 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.622 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.622 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.622 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.622 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.622 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.622 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.622 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.622 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.622 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.623 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.623 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.623 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.623 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.623 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.623 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.623 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.623 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.623 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.623 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.623 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.623 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.623 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.624 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.624 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.624 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.624 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.624 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.624 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.624 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.624 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.624 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.624 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.624 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.624 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.624 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.625 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.625 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.625 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.625 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.625 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.625 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.625 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.625 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.625 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.625 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.625 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.625 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.626 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.626 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.626 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.626 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.626 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.626 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.626 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.626 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.626 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.626 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.626 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.626 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.626 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.627 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.627 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.627 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.627 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.627 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.627 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.627 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.627 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.627 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.627 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.627 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.627 INFO:teuthology.orchestra.run.smithi092.stdout: "mark_out_threshold": { 2024-09-19T09:12:33.627 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mark_out_threshold", 2024-09-19T09:12:33.628 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.628 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.628 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.628 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "2419200", 2024-09-19T09:12:33.628 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.628 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.628 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.628 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T09:12:33.628 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.628 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.628 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.628 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.628 INFO:teuthology.orchestra.run.smithi092.stdout: "pool_name": { 2024-09-19T09:12:33.629 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pool_name", 2024-09-19T09:12:33.629 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.629 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.629 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.629 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "device_health_metrics", 2024-09-19T09:12:33.629 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.629 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.629 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.629 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T09:12:33.629 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.629 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.629 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.629 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.629 INFO:teuthology.orchestra.run.smithi092.stdout: "retention_period": { 2024-09-19T09:12:33.630 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "retention_period", 2024-09-19T09:12:33.630 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.630 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.630 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.630 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "15552000", 2024-09-19T09:12:33.630 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.630 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.630 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.630 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how long to retain device health metrics", 2024-09-19T09:12:33.630 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.630 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.630 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.630 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.630 INFO:teuthology.orchestra.run.smithi092.stdout: "scrape_frequency": { 2024-09-19T09:12:33.631 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "scrape_frequency", 2024-09-19T09:12:33.631 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.631 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.631 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.631 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "86400", 2024-09-19T09:12:33.631 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.631 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.631 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.631 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T09:12:33.631 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.631 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.631 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.631 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.632 INFO:teuthology.orchestra.run.smithi092.stdout: "self_heal": { 2024-09-19T09:12:33.632 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "self_heal", 2024-09-19T09:12:33.632 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.632 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.632 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.632 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.632 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.632 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.632 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.632 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T09:12:33.632 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.632 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.633 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.633 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.633 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-19T09:12:33.633 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-19T09:12:33.633 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.633 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.633 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.633 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-19T09:12:33.633 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.633 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.633 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.633 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T09:12:33.634 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.634 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.634 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.634 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.634 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_threshold": { 2024-09-19T09:12:33.634 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_threshold", 2024-09-19T09:12:33.634 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.634 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.634 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.634 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "7257600", 2024-09-19T09:12:33.634 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.634 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.634 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.635 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T09:12:33.635 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.635 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.635 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.635 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.635 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.635 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.635 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.635 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "diskprediction_local", 2024-09-19T09:12:33.635 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.635 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.635 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.636 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.636 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.636 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.636 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.636 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.636 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.636 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.636 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.636 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.636 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.636 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.636 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.637 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.637 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.637 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.637 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.637 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.637 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.637 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.637 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.637 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.637 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.637 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.637 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.637 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.638 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.638 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.638 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.638 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.638 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.638 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.638 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.638 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.638 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.638 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.638 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.638 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.638 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.639 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.639 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.639 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.639 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.639 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.639 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.639 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.639 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.639 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.639 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.639 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.639 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.639 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.639 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.640 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.640 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.640 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.640 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.640 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.640 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.640 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.640 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.640 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.640 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.640 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.640 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.640 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.641 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.641 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.641 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.641 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.641 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.641 INFO:teuthology.orchestra.run.smithi092.stdout: "predict_interval": { 2024-09-19T09:12:33.641 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "predict_interval", 2024-09-19T09:12:33.641 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.641 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.641 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.641 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "86400", 2024-09-19T09:12:33.641 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.641 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.642 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.642 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.642 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.642 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.642 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.642 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.642 INFO:teuthology.orchestra.run.smithi092.stdout: "predictor_model": { 2024-09-19T09:12:33.642 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "predictor_model", 2024-09-19T09:12:33.642 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.642 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.642 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.642 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "prophetstor", 2024-09-19T09:12:33.642 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.642 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.642 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.643 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.643 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.643 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.643 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.643 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.643 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-19T09:12:33.643 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-19T09:12:33.643 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.643 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.643 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.643 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-19T09:12:33.643 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.643 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.643 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.644 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.644 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.644 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.644 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.644 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.644 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.644 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.644 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.644 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "influx", 2024-09-19T09:12:33.644 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": false, 2024-09-19T09:12:33.644 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "influxdb python module not found", 2024-09-19T09:12:33.644 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.644 INFO:teuthology.orchestra.run.smithi092.stdout: "batch_size": { 2024-09-19T09:12:33.645 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "batch_size", 2024-09-19T09:12:33.645 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.645 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.645 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.645 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5000", 2024-09-19T09:12:33.645 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.645 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.645 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.645 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T09:12:33.645 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.645 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.645 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.646 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.646 INFO:teuthology.orchestra.run.smithi092.stdout: "database": { 2024-09-19T09:12:33.646 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "database", 2024-09-19T09:12:33.646 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.646 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.646 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.646 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "ceph", 2024-09-19T09:12:33.646 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.646 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.646 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.646 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T09:12:33.646 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.646 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.647 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.647 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.647 INFO:teuthology.orchestra.run.smithi092.stdout: "hostname": { 2024-09-19T09:12:33.647 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "hostname", 2024-09-19T09:12:33.647 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.647 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.647 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.647 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.647 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.647 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.647 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.647 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "InfluxDB server hostname", 2024-09-19T09:12:33.647 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.648 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.648 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.648 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.648 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-19T09:12:33.648 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-19T09:12:33.648 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.648 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.648 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.648 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "30", 2024-09-19T09:12:33.648 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "5", 2024-09-19T09:12:33.648 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.648 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.648 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T09:12:33.649 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.649 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.649 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.649 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.649 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.649 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.649 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.649 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.649 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.649 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.649 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.649 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.649 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.650 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.650 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.650 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.650 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.650 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.650 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.650 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.650 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.650 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.650 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.650 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.650 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.650 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.651 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.651 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.651 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.651 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.651 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.651 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.651 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.651 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.651 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.651 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.651 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.651 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.651 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.651 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.652 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.652 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.652 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.652 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.652 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.652 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.652 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.652 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.652 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.652 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.652 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.652 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.652 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.652 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.653 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.653 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.653 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.653 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.653 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.653 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.653 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.653 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.653 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.653 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.653 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.653 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.654 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.654 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.654 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.654 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.654 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.654 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.654 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.654 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.654 INFO:teuthology.orchestra.run.smithi092.stdout: "password": { 2024-09-19T09:12:33.654 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "password", 2024-09-19T09:12:33.654 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.654 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.654 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.654 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.654 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.655 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.655 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.655 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "password of InfluxDB server user", 2024-09-19T09:12:33.655 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.655 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.655 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.655 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.655 INFO:teuthology.orchestra.run.smithi092.stdout: "port": { 2024-09-19T09:12:33.655 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "port", 2024-09-19T09:12:33.655 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.655 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.655 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.655 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8086", 2024-09-19T09:12:33.655 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.656 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.656 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.656 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "InfluxDB server port", 2024-09-19T09:12:33.656 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.656 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.656 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.656 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.656 INFO:teuthology.orchestra.run.smithi092.stdout: "ssl": { 2024-09-19T09:12:33.656 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssl", 2024-09-19T09:12:33.656 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.656 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.656 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.656 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "false", 2024-09-19T09:12:33.657 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.657 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.657 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.657 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:12:33.657 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.657 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.657 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.657 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.657 INFO:teuthology.orchestra.run.smithi092.stdout: "threads": { 2024-09-19T09:12:33.657 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "threads", 2024-09-19T09:12:33.657 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.657 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.658 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.658 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-19T09:12:33.658 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2024-09-19T09:12:33.658 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "32", 2024-09-19T09:12:33.658 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.658 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T09:12:33.658 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.658 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.658 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.658 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.658 INFO:teuthology.orchestra.run.smithi092.stdout: "username": { 2024-09-19T09:12:33.658 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "username", 2024-09-19T09:12:33.658 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.659 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.659 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.659 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.659 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.659 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.659 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.659 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "username of InfluxDB server user", 2024-09-19T09:12:33.659 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.659 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.659 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.659 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.659 INFO:teuthology.orchestra.run.smithi092.stdout: "verify_ssl": { 2024-09-19T09:12:33.659 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "verify_ssl", 2024-09-19T09:12:33.660 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.660 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.660 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.660 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "true", 2024-09-19T09:12:33.660 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.660 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.660 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.660 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:12:33.660 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.660 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.660 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.660 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.660 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.660 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.661 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.661 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "insights", 2024-09-19T09:12:33.661 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.661 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.661 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.661 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.661 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.661 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.661 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.661 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.661 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.661 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.661 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.662 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.662 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.662 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.662 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.662 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.662 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.662 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.662 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.662 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.662 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.662 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.662 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.662 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.662 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.663 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.663 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.663 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.663 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.663 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.663 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.663 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.663 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.663 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.663 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.663 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.663 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.663 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.663 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.664 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.664 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.664 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.664 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.664 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.664 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.664 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.664 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.664 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.664 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.664 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.664 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.664 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.665 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.665 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.665 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.665 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.665 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.665 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.665 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.665 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.665 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.665 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.665 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.665 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.666 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.666 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.666 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.666 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.666 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.666 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.666 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.666 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.666 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.666 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.666 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.666 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.666 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "iostat", 2024-09-19T09:12:33.666 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.667 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.667 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.667 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.667 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.667 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.667 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.667 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.667 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.667 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.667 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.667 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.667 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.667 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.667 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.668 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.668 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.668 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.668 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.668 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.668 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.668 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.668 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.668 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.668 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.668 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.668 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.668 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.668 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.668 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.669 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.669 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.669 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.669 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.669 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.669 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.669 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.669 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.669 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.669 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.669 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.669 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.669 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.670 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.670 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.670 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.670 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.670 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.670 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.670 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.670 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.670 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.670 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.670 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.670 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.671 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.671 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.671 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.671 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.671 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.671 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.671 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.671 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.671 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.671 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.671 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.671 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.671 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.671 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.672 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.672 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.672 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.672 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.672 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.672 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.672 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.672 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "k8sevents", 2024-09-19T09:12:33.672 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.672 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.672 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.672 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_event_retention_days": { 2024-09-19T09:12:33.672 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ceph_event_retention_days", 2024-09-19T09:12:33.673 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.673 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.673 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.673 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "7", 2024-09-19T09:12:33.673 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.673 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.673 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.673 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T09:12:33.673 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.673 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.673 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.673 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.673 INFO:teuthology.orchestra.run.smithi092.stdout: "config_check_secs": { 2024-09-19T09:12:33.673 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "config_check_secs", 2024-09-19T09:12:33.674 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.674 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.674 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.674 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-19T09:12:33.674 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "10", 2024-09-19T09:12:33.674 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.674 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.674 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T09:12:33.674 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.674 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.674 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.675 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.675 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.675 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.675 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.675 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.675 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.675 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.675 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.675 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.675 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.675 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.675 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.675 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.675 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.676 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.676 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.676 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.676 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.676 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.676 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.676 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.676 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.676 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.676 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.676 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.676 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.677 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.677 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.677 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.677 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.677 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.677 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.677 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.677 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.677 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.677 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.677 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.677 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.677 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.677 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.678 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.678 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.678 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.678 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.678 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.678 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.678 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.678 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.678 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.678 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.678 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.678 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.678 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.678 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.679 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.679 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.679 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.679 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.679 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.679 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.679 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.679 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.679 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.679 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.679 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.679 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.679 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.680 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.680 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.680 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.680 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.680 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.680 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.680 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.680 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "localpool", 2024-09-19T09:12:33.680 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.680 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.680 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.680 INFO:teuthology.orchestra.run.smithi092.stdout: "failure_domain": { 2024-09-19T09:12:33.681 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "failure_domain", 2024-09-19T09:12:33.681 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.681 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.681 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.681 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "host", 2024-09-19T09:12:33.681 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.681 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.681 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.681 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "failure domain for any created local pool", 2024-09-19T09:12:33.681 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T09:12:33.681 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.681 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.681 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.681 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.682 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.682 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.682 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.682 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.682 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.682 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.682 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.682 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.682 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.682 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.682 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.682 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.682 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.682 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.683 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.683 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.683 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.683 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.683 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.683 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.683 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.683 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.683 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.683 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.683 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.683 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.683 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.684 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.684 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.684 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.684 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.684 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.684 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.684 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.684 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.684 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.684 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.684 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.684 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.684 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.685 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.685 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.685 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.685 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.685 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.685 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.685 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.685 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.685 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.685 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.685 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.685 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.685 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.686 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.686 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.686 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.686 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.686 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.686 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.686 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.686 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.686 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.686 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.686 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.686 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.686 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.687 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.687 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.687 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.687 INFO:teuthology.orchestra.run.smithi092.stdout: "min_size": { 2024-09-19T09:12:33.687 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "min_size", 2024-09-19T09:12:33.687 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.687 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.687 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.687 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.687 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.687 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.687 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.687 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "default min_size for any created local pool", 2024-09-19T09:12:33.688 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T09:12:33.688 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.688 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.688 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.688 INFO:teuthology.orchestra.run.smithi092.stdout: "num_rep": { 2024-09-19T09:12:33.688 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "num_rep", 2024-09-19T09:12:33.688 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.688 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.688 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.688 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3", 2024-09-19T09:12:33.689 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.689 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.689 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.689 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "default replica count for any created local pool", 2024-09-19T09:12:33.689 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.689 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.689 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.689 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.689 INFO:teuthology.orchestra.run.smithi092.stdout: "pg_num": { 2024-09-19T09:12:33.689 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pg_num", 2024-09-19T09:12:33.689 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.689 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.689 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.690 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "128", 2024-09-19T09:12:33.690 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.690 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.690 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.690 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T09:12:33.690 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.690 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.690 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.690 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.690 INFO:teuthology.orchestra.run.smithi092.stdout: "prefix": { 2024-09-19T09:12:33.690 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "prefix", 2024-09-19T09:12:33.690 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.690 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.691 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.691 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.691 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.691 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.691 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.691 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "name prefix for any created local pool", 2024-09-19T09:12:33.691 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.691 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.691 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.691 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.691 INFO:teuthology.orchestra.run.smithi092.stdout: "subtree": { 2024-09-19T09:12:33.691 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "subtree", 2024-09-19T09:12:33.691 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.692 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.692 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.692 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "rack", 2024-09-19T09:12:33.692 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.692 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.692 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.692 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T09:12:33.692 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T09:12:33.692 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.692 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.692 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.692 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.692 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.693 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.693 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mds_autoscaler", 2024-09-19T09:12:33.693 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.693 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.693 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.693 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.693 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.693 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.693 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.693 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.693 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.693 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.693 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.694 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.694 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.694 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.694 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.694 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.694 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.694 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.694 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.694 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.694 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.694 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.694 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.694 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.694 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.695 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.695 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.695 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.695 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.695 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.695 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.695 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.695 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.695 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.695 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.695 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.695 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.696 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.696 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.696 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.696 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.696 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.696 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.696 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.696 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.696 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.696 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.696 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.696 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.696 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.697 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.697 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.697 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.697 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.697 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.697 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.697 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.697 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.697 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.697 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.697 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.697 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.697 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.698 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.698 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.698 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.698 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.698 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.698 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.698 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.698 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.698 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.698 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.698 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.698 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.698 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.699 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mirroring", 2024-09-19T09:12:33.699 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.699 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.699 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.699 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.699 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.699 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.699 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.699 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.699 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.699 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.699 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.699 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.699 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.700 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.700 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.700 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.700 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.700 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.700 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.700 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.700 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.700 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.700 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.700 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.700 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.700 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.700 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.701 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.701 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.701 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.701 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.701 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.701 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.701 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.701 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.701 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.701 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.701 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.701 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.701 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.701 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.702 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.702 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.702 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.702 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.702 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.702 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.702 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.702 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.702 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.702 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.702 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.702 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.702 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.702 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.703 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.703 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.703 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.703 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.703 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.703 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.703 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.703 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.703 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.703 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.703 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.703 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.703 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.704 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.704 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.704 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.704 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.704 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.704 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.704 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.704 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.704 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "nfs", 2024-09-19T09:12:33.704 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.704 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.704 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.704 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.704 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.705 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.705 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.705 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.705 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.705 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.705 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.708 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.708 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.708 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.708 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.708 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.708 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.709 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.709 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.709 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.709 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.709 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.709 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.709 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.709 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.709 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.709 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.709 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.709 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.709 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.710 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.710 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.710 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.710 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.710 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.710 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.710 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.710 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.710 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.710 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.710 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.710 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.711 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.711 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.711 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.711 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.711 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.711 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.711 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.711 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.711 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.711 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.711 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.711 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.711 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.711 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.712 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.712 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.712 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.712 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.712 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.712 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.712 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.712 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.712 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.712 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.712 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.712 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.712 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.713 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.713 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.713 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.713 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.713 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.713 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.713 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.713 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "orchestrator", 2024-09-19T09:12:33.713 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.713 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.713 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.713 INFO:teuthology.orchestra.run.smithi092.stdout: "fail_fs": { 2024-09-19T09:12:33.713 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "fail_fs", 2024-09-19T09:12:33.713 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.714 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.714 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.714 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.714 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.714 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.714 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.714 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T09:12:33.714 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.714 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.714 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.714 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.714 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.714 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.714 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.715 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.715 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.715 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.715 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.715 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.715 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.715 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.715 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.715 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.715 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.715 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.715 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.715 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.716 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.716 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.716 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.716 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.716 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.716 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.716 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.716 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.716 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.716 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.716 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.716 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.716 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.717 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.717 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.717 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.717 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.717 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.717 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.717 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.717 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.717 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.717 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.717 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.717 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.717 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.718 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.718 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.718 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.718 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.718 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.718 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.718 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.718 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.718 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.718 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.718 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.718 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.718 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.718 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.719 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.719 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.719 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.719 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.719 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.719 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.719 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.719 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.719 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.719 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.719 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.719 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.719 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.719 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.720 INFO:teuthology.orchestra.run.smithi092.stdout: "orchestrator": { 2024-09-19T09:12:33.720 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "orchestrator", 2024-09-19T09:12:33.720 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.720 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.720 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.720 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.720 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.720 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.720 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.720 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm", 2024-09-19T09:12:33.720 INFO:teuthology.orchestra.run.smithi092.stdout: "rook", 2024-09-19T09:12:33.720 INFO:teuthology.orchestra.run.smithi092.stdout: "test_orchestrator" 2024-09-19T09:12:33.721 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.721 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Orchestrator backend", 2024-09-19T09:12:33.721 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.721 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.721 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.721 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.721 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.721 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.721 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.721 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "osd_perf_query", 2024-09-19T09:12:33.721 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.721 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.721 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.722 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.722 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.722 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.722 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.722 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.722 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.722 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.722 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.722 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.722 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.722 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.722 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.722 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.723 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.723 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.723 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.723 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.723 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.723 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.723 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.723 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.723 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.723 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.723 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.723 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.723 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.723 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.724 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.724 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.724 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.724 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.724 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.724 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.724 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.724 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.724 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.724 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.724 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.724 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.724 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.725 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.725 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.725 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.725 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.725 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.725 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.725 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.725 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.725 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.725 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.725 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.725 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.725 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.725 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.726 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.726 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.726 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.726 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.726 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.726 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.726 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.726 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.726 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.726 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.726 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.726 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.727 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.727 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.727 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.727 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.727 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.727 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.727 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.727 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "osd_support", 2024-09-19T09:12:33.727 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.727 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.727 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.727 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.727 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.727 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.728 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.728 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.728 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.728 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.728 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.728 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.728 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.728 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.728 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.728 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.728 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.728 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.728 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.729 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.729 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.729 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.729 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.729 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.729 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.729 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.729 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.729 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.729 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.729 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.729 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.729 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.730 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.730 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.730 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.730 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.730 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.730 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.730 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.730 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.730 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.730 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.730 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.730 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.730 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.730 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.731 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.731 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.731 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.731 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.731 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.731 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.731 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.731 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.731 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.731 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.731 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.731 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.731 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.732 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.732 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.732 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.732 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.732 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.732 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.732 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.732 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.732 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.732 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.732 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.732 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.732 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.733 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.733 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.733 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.733 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.733 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pg_autoscaler", 2024-09-19T09:12:33.733 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.733 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.733 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.733 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.733 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.733 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.733 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.733 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.734 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.734 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.734 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.734 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.734 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.734 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.734 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.734 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.734 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.734 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.734 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.734 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.734 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.734 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.735 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.735 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.735 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.735 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.735 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.735 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.735 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.735 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.735 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.735 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.735 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.735 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.735 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.735 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.736 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.736 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.736 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.736 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.736 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.736 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.736 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.736 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.736 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.736 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.736 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.736 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.737 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.737 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.737 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.737 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.737 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.737 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.737 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.737 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.737 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.737 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.737 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.737 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.737 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.738 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.738 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.738 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.738 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.738 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.738 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.738 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.738 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.738 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.738 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.738 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.738 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.738 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-19T09:12:33.738 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-19T09:12:33.739 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.739 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.739 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.739 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-19T09:12:33.739 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.739 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.739 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.739 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.739 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.739 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.739 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.739 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.739 INFO:teuthology.orchestra.run.smithi092.stdout: "threshold": { 2024-09-19T09:12:33.740 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "threshold", 2024-09-19T09:12:33.740 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-19T09:12:33.740 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.740 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.740 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3.0", 2024-09-19T09:12:33.740 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1.0", 2024-09-19T09:12:33.740 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.740 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.740 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "scaling threshold", 2024-09-19T09:12:33.740 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T09:12:33.740 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.740 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.740 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.740 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.741 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.741 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.741 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "progress", 2024-09-19T09:12:33.741 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.741 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.741 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.741 INFO:teuthology.orchestra.run.smithi092.stdout: "allow_pg_recovery_event": { 2024-09-19T09:12:33.741 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "allow_pg_recovery_event", 2024-09-19T09:12:33.741 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.741 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.741 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.741 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.742 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.742 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.742 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.742 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T09:12:33.742 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.742 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.742 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.742 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.742 INFO:teuthology.orchestra.run.smithi092.stdout: "enabled": { 2024-09-19T09:12:33.742 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enabled", 2024-09-19T09:12:33.742 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.742 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.742 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.742 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.743 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.743 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.743 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.743 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.743 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.743 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.743 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.743 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.743 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.743 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.743 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.743 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.743 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.743 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.744 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.744 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.744 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.744 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.744 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.744 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.744 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.744 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.744 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.744 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.744 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.744 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.744 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.745 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.745 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.745 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.745 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.745 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.745 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.745 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.745 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.745 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.745 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.745 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.745 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.745 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.746 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.746 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.746 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.746 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.746 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.746 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.746 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.746 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.746 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.746 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.746 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.746 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.746 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.746 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.747 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.747 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.747 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.747 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.747 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.747 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.747 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.747 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.747 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.747 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.747 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.747 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.747 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.747 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.748 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.748 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.748 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.748 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.748 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.748 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.748 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.748 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.748 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.748 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.748 INFO:teuthology.orchestra.run.smithi092.stdout: "max_completed_events": { 2024-09-19T09:12:33.748 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_completed_events", 2024-09-19T09:12:33.748 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.749 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.749 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.749 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "50", 2024-09-19T09:12:33.749 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.749 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.749 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.749 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "number of past completed events to remember", 2024-09-19T09:12:33.749 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.749 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.749 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.749 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.749 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-19T09:12:33.749 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-19T09:12:33.750 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.750 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.750 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.750 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-19T09:12:33.750 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.750 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.750 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.750 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how long the module is going to sleep", 2024-09-19T09:12:33.750 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.750 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.750 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.750 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.750 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.751 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.751 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.751 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "prometheus", 2024-09-19T09:12:33.751 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.751 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.751 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.751 INFO:teuthology.orchestra.run.smithi092.stdout: "cache": { 2024-09-19T09:12:33.751 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cache", 2024-09-19T09:12:33.751 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.751 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.751 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.751 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.751 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.752 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.752 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.752 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.752 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.752 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.752 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.752 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.752 INFO:teuthology.orchestra.run.smithi092.stdout: "exclude_perf_counters": { 2024-09-19T09:12:33.752 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "exclude_perf_counters", 2024-09-19T09:12:33.752 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.752 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.752 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.752 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.753 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.753 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.753 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.753 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T09:12:33.753 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T09:12:33.753 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.753 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.753 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.753 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.753 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.753 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.753 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.753 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.753 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.754 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.754 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.754 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.754 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.754 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.754 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.754 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.754 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.754 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.754 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.754 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.754 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.754 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.755 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.755 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.755 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.755 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.755 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.755 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.755 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.755 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.755 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.755 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.755 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.755 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.755 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.756 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.756 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.756 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.756 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.756 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.756 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.756 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.756 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.756 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.756 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.756 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.756 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.756 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.757 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.757 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.757 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.757 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.757 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.757 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.757 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.757 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.757 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.757 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.757 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.757 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.757 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.758 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.758 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.758 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.758 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.758 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.758 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.758 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.758 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.758 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.758 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.758 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.758 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.758 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_stats_pools": { 2024-09-19T09:12:33.759 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_stats_pools", 2024-09-19T09:12:33.759 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.759 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.759 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.759 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.759 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.759 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.759 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.759 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.759 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.759 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.759 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.759 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.759 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T09:12:33.760 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T09:12:33.760 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.760 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.760 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.760 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "300", 2024-09-19T09:12:33.760 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.760 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.760 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.760 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.760 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.760 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.760 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.760 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.761 INFO:teuthology.orchestra.run.smithi092.stdout: "scrape_interval": { 2024-09-19T09:12:33.761 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "scrape_interval", 2024-09-19T09:12:33.761 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-19T09:12:33.761 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.761 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.761 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "15.0", 2024-09-19T09:12:33.761 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.761 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.761 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.761 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.761 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.761 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.761 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.762 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.762 INFO:teuthology.orchestra.run.smithi092.stdout: "server_addr": { 2024-09-19T09:12:33.762 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_addr", 2024-09-19T09:12:33.762 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.762 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.762 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.762 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "::", 2024-09-19T09:12:33.762 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.762 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.762 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.762 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T09:12:33.762 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.762 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.763 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.763 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.763 INFO:teuthology.orchestra.run.smithi092.stdout: "server_port": { 2024-09-19T09:12:33.763 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_port", 2024-09-19T09:12:33.763 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.763 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.763 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.763 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "9283", 2024-09-19T09:12:33.763 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.763 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.763 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.763 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T09:12:33.763 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.763 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.764 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.764 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.764 INFO:teuthology.orchestra.run.smithi092.stdout: "stale_cache_strategy": { 2024-09-19T09:12:33.764 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "stale_cache_strategy", 2024-09-19T09:12:33.764 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.764 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.764 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.764 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "log", 2024-09-19T09:12:33.764 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.764 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.764 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.764 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.765 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.765 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.765 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.765 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.765 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_behaviour": { 2024-09-19T09:12:33.765 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_behaviour", 2024-09-19T09:12:33.765 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.765 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.765 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.765 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "default", 2024-09-19T09:12:33.765 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.765 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.765 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.766 INFO:teuthology.orchestra.run.smithi092.stdout: "default", 2024-09-19T09:12:33.766 INFO:teuthology.orchestra.run.smithi092.stdout: "error" 2024-09-19T09:12:33.766 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.766 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.766 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.766 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.766 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.766 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.766 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_error_status_code": { 2024-09-19T09:12:33.766 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_error_status_code", 2024-09-19T09:12:33.766 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.766 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.766 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.767 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "500", 2024-09-19T09:12:33.767 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "400", 2024-09-19T09:12:33.767 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "599", 2024-09-19T09:12:33.767 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.767 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.767 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.767 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.767 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.767 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.767 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.767 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.767 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.767 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_support", 2024-09-19T09:12:33.767 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.768 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.768 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.768 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.768 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.768 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.768 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.768 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.768 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.768 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.768 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.768 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.768 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.768 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.768 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.769 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.769 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.769 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.769 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.769 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.769 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.769 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.769 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.769 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.769 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.769 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.769 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.769 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.770 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.770 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.770 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.770 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.770 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.770 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.770 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.770 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.770 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.770 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.770 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.770 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.770 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.771 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.771 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.771 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.771 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.771 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.771 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.771 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.771 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.771 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.771 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.771 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.771 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.771 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.771 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.772 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.772 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.772 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.772 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.772 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.772 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.772 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.772 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.772 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.772 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.772 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.772 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.772 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.773 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.773 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.773 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.773 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.773 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.773 INFO:teuthology.orchestra.run.smithi092.stdout: "max_concurrent_snap_create": { 2024-09-19T09:12:33.773 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_concurrent_snap_create", 2024-09-19T09:12:33.773 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.773 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.773 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.773 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-19T09:12:33.773 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.773 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.774 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.774 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.774 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.774 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.774 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.774 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.774 INFO:teuthology.orchestra.run.smithi092.stdout: "mirror_snapshot_schedule": { 2024-09-19T09:12:33.774 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T09:12:33.774 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.774 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.774 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.774 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.774 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.774 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.775 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.775 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.775 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.775 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.775 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.775 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.775 INFO:teuthology.orchestra.run.smithi092.stdout: "trash_purge_schedule": { 2024-09-19T09:12:33.775 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "trash_purge_schedule", 2024-09-19T09:12:33.775 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.775 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.775 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.775 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.775 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.776 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.776 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.776 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.776 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.776 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.776 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.776 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.776 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.776 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.776 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.776 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "restful", 2024-09-19T09:12:33.776 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.776 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.777 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.777 INFO:teuthology.orchestra.run.smithi092.stdout: "enable_auth": { 2024-09-19T09:12:33.777 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enable_auth", 2024-09-19T09:12:33.777 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.777 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.777 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.777 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.777 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.777 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.777 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.777 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.777 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.777 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.777 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.778 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.778 INFO:teuthology.orchestra.run.smithi092.stdout: "key_file": { 2024-09-19T09:12:33.778 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "key_file", 2024-09-19T09:12:33.778 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.778 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.778 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.778 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.778 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.778 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.778 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.778 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.778 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.778 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.779 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.779 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.779 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.779 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.779 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.779 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.779 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.779 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.779 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.779 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.779 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.779 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.779 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.780 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.780 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.780 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.780 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.780 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.780 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.780 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.780 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.780 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.780 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.780 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.780 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.780 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.781 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.781 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.781 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.781 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.781 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.781 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.781 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.781 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.781 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.781 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.781 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.781 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.781 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.781 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.782 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.782 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.782 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.782 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.782 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.782 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.782 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.782 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.782 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.782 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.782 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.782 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.782 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.783 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.783 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.783 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.783 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.783 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.783 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.783 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.783 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.783 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.783 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.783 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.783 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.783 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.784 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.784 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.784 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.784 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.784 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.784 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.784 INFO:teuthology.orchestra.run.smithi092.stdout: "server_addr": { 2024-09-19T09:12:33.784 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_addr", 2024-09-19T09:12:33.784 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.784 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.784 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.784 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.784 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.785 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.785 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.785 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.785 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.785 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.785 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.785 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.785 INFO:teuthology.orchestra.run.smithi092.stdout: "server_port": { 2024-09-19T09:12:33.785 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_port", 2024-09-19T09:12:33.785 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.785 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.785 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.785 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.786 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.786 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.786 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.786 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.786 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.786 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.786 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.786 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.786 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.786 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.786 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.786 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rgw", 2024-09-19T09:12:33.786 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.786 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.787 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.787 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.787 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.787 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.787 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.787 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.787 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.787 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.787 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.787 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.787 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.787 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.787 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.788 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.788 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.788 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.788 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.788 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.788 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.788 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.788 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.788 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.788 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.788 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.788 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.788 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.788 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.789 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.789 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.789 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.789 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.789 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.789 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.789 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.789 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.789 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.789 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.789 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.789 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.789 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.790 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.790 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.790 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.790 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.790 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.790 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.790 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.790 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.790 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.790 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.790 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.790 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.790 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.791 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.791 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.791 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.791 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.791 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.791 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.791 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.791 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.791 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.791 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.791 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.791 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.791 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.792 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.792 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.792 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.792 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.792 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.792 INFO:teuthology.orchestra.run.smithi092.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T09:12:33.792 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T09:12:33.792 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.792 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.792 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.792 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-19T09:12:33.792 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.792 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.792 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.793 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T09:12:33.793 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.793 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.793 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.793 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.793 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.793 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.793 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.793 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rook", 2024-09-19T09:12:33.793 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.793 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.793 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.794 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.794 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.794 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.794 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.794 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.794 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.794 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.794 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.794 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.794 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.794 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.794 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.794 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.794 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.795 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.795 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.795 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.795 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.795 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.795 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.795 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.795 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.795 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.795 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.795 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.795 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.795 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.796 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.796 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.796 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.796 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.796 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.796 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.796 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.796 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.796 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.796 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.796 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.796 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.796 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.797 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.797 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.797 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.797 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.797 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.797 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.797 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.797 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.797 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.797 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.797 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.797 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.797 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.798 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.798 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.798 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.798 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.798 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.798 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.798 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.798 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.798 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.798 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.798 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.798 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.799 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.799 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.799 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.799 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.799 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.799 INFO:teuthology.orchestra.run.smithi092.stdout: "storage_class": { 2024-09-19T09:12:33.799 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "storage_class", 2024-09-19T09:12:33.799 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.799 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.799 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.799 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "local", 2024-09-19T09:12:33.799 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.799 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.799 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.800 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T09:12:33.800 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.800 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.800 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.800 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.800 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.800 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.800 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.800 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "selftest", 2024-09-19T09:12:33.800 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.800 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.800 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.800 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.800 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.801 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.801 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.801 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.801 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.801 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.801 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.801 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.801 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.801 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.801 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.801 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.801 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.801 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.801 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.802 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.802 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.802 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.802 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.802 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.802 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.802 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.802 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.802 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.802 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.802 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.802 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.802 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.802 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.803 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.803 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.803 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.803 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.803 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.803 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.803 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.803 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.803 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.803 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.803 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.803 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.803 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.804 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.804 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.804 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.804 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.804 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.804 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.804 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.804 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.804 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.804 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.804 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.804 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.804 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.805 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.805 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.805 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.805 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.805 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.805 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.805 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.805 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.805 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.805 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.805 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.805 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.805 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.806 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.806 INFO:teuthology.orchestra.run.smithi092.stdout: "roption1": { 2024-09-19T09:12:33.806 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "roption1", 2024-09-19T09:12:33.806 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.806 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.806 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.806 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.806 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.806 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.806 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.806 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.806 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.806 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.807 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.807 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.807 INFO:teuthology.orchestra.run.smithi092.stdout: "roption2": { 2024-09-19T09:12:33.807 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "roption2", 2024-09-19T09:12:33.807 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.807 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.807 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.807 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "xyz", 2024-09-19T09:12:33.807 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.807 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.807 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.807 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.807 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.808 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.808 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.808 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.808 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption1": { 2024-09-19T09:12:33.808 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption1", 2024-09-19T09:12:33.808 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.808 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.808 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.808 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.808 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.808 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.808 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.809 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.809 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.809 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.809 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.809 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.809 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption2": { 2024-09-19T09:12:33.809 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption2", 2024-09-19T09:12:33.809 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.809 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.809 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.809 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.809 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.809 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.809 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.810 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.810 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.810 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.810 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.810 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.810 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption3": { 2024-09-19T09:12:33.810 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption3", 2024-09-19T09:12:33.810 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-19T09:12:33.810 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.810 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.810 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.810 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.810 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.811 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.811 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.811 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.811 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.811 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.811 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.811 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption4": { 2024-09-19T09:12:33.811 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption4", 2024-09-19T09:12:33.811 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.811 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.811 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.811 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.811 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.811 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.812 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.812 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.812 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.812 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.812 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.812 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.812 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption5": { 2024-09-19T09:12:33.812 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption5", 2024-09-19T09:12:33.812 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.812 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.812 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.812 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.812 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.813 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.813 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.813 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.813 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.813 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.813 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.813 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.813 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption6": { 2024-09-19T09:12:33.813 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption6", 2024-09-19T09:12:33.813 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.813 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.813 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.813 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.814 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.814 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.814 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.814 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.814 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.814 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.814 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.814 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.814 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption7": { 2024-09-19T09:12:33.814 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption7", 2024-09-19T09:12:33.814 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.814 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.814 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.815 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.815 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2024-09-19T09:12:33.815 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "42", 2024-09-19T09:12:33.815 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.815 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.815 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.815 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.815 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.815 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.815 INFO:teuthology.orchestra.run.smithi092.stdout: "testkey": { 2024-09-19T09:12:33.815 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "testkey", 2024-09-19T09:12:33.815 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.815 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.815 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.816 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.816 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.816 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.816 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.816 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.816 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.816 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.816 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.816 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.816 INFO:teuthology.orchestra.run.smithi092.stdout: "testlkey": { 2024-09-19T09:12:33.816 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "testlkey", 2024-09-19T09:12:33.816 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.816 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.817 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.817 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.817 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.817 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.817 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.817 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.817 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.817 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.817 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.817 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.817 INFO:teuthology.orchestra.run.smithi092.stdout: "testnewline": { 2024-09-19T09:12:33.817 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "testnewline", 2024-09-19T09:12:33.817 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.818 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.818 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.818 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.818 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.818 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.818 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.818 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.818 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.818 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.818 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.818 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.818 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.818 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.819 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.819 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "snap_schedule", 2024-09-19T09:12:33.819 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.819 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.819 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.819 INFO:teuthology.orchestra.run.smithi092.stdout: "allow_m_granularity": { 2024-09-19T09:12:33.819 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "allow_m_granularity", 2024-09-19T09:12:33.819 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.819 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.819 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.819 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.819 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.819 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.820 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.820 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T09:12:33.820 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.820 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.820 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.820 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.820 INFO:teuthology.orchestra.run.smithi092.stdout: "dump_on_update": { 2024-09-19T09:12:33.820 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "dump_on_update", 2024-09-19T09:12:33.820 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.820 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.820 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.820 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.820 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.820 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.821 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.821 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "dump database to debug log on update", 2024-09-19T09:12:33.821 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.821 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.821 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.821 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.821 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.821 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.821 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.821 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.821 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.821 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.821 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.821 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.822 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.822 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.822 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.822 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.822 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.822 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.822 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.822 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.822 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.822 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.822 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.822 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.822 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.823 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.823 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.823 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.823 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.823 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.823 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.823 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.823 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.823 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.823 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.823 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.823 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.823 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.824 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.824 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.824 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.824 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.824 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.824 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.824 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.824 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.824 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.824 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.824 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.824 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.824 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.825 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.825 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.825 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.825 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.825 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.825 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.825 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.825 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.825 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.825 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.825 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.825 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.826 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.826 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.826 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.826 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.826 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.826 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.826 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.826 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.826 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.826 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.826 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.826 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.826 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.827 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.827 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "stats", 2024-09-19T09:12:33.827 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.827 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.827 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.827 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.827 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.827 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.827 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.827 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.827 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.827 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.827 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.827 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.828 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.828 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.828 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.828 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.828 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.828 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.828 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.828 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.828 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.828 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.828 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.828 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.828 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.829 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.829 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.829 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.829 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.829 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.829 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.829 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.829 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.829 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.829 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.829 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.829 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.829 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.829 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.830 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.830 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.830 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.830 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.830 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.830 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.830 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.830 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.830 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.830 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.830 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.830 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.830 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.830 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.830 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.831 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.831 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.831 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.831 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.831 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.831 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.831 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.831 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.831 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.831 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.831 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.831 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.831 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.831 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.831 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.832 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.832 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.832 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.832 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.832 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.832 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.832 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.832 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "status", 2024-09-19T09:12:33.832 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.832 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.832 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.832 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.832 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.832 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.833 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.833 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.833 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.833 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.833 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.833 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.833 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.833 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.833 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.833 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.833 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.833 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.833 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.833 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.834 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.834 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.834 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.834 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.834 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.834 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.834 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.834 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.834 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.834 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.834 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.834 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.834 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.834 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.835 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.835 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.835 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.835 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.835 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.835 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.835 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.835 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.835 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.835 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.835 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.835 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.835 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.835 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.836 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.836 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.836 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.836 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.836 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.836 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.836 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.836 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.836 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.836 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.836 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.836 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.836 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.837 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.837 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.837 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.837 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.837 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.837 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.837 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.837 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.837 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.837 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.837 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.837 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.838 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.838 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.838 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.838 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "telegraf", 2024-09-19T09:12:33.838 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.838 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.838 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.838 INFO:teuthology.orchestra.run.smithi092.stdout: "address": { 2024-09-19T09:12:33.838 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "address", 2024-09-19T09:12:33.838 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.838 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.838 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.838 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T09:12:33.839 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.839 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.839 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.839 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.839 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.839 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.839 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.839 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.839 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-19T09:12:33.839 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-19T09:12:33.839 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.839 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.840 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.840 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "15", 2024-09-19T09:12:33.840 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.840 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.840 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.840 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.840 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.840 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.840 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.840 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.840 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.840 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.840 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.841 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.841 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.841 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.841 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.841 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.841 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.841 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.841 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.841 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.841 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.841 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.841 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.842 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.842 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.842 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.842 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.842 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.842 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.842 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.842 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.842 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.842 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.842 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.842 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.842 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.842 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.842 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.843 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.843 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.843 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.843 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.843 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.843 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.843 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.843 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.843 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.843 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.843 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.843 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.843 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.844 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.844 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.844 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.844 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.844 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.844 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.844 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.844 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.844 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.844 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.844 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.844 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.844 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.845 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.845 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.845 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.845 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.845 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.845 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.845 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.845 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.845 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.845 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.845 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.845 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.845 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.846 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.846 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.846 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.846 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.846 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "telemetry", 2024-09-19T09:12:33.846 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.846 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.846 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.846 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_basic": { 2024-09-19T09:12:33.846 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_basic", 2024-09-19T09:12:33.846 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.846 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.846 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.847 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.847 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.847 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.847 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.847 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T09:12:33.847 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.847 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.847 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.847 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.847 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_crash": { 2024-09-19T09:12:33.847 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_crash", 2024-09-19T09:12:33.847 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.847 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.848 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.848 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.848 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.848 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.848 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.848 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T09:12:33.848 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.848 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.848 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.848 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.848 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_device": { 2024-09-19T09:12:33.848 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_device", 2024-09-19T09:12:33.848 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.849 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.849 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.849 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.849 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.849 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.849 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.849 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T09:12:33.849 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.849 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.849 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.849 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.849 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_ident": { 2024-09-19T09:12:33.849 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_ident", 2024-09-19T09:12:33.850 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.850 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.850 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.850 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.850 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.850 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.850 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.850 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T09:12:33.850 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.850 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.850 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.850 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.851 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_perf": { 2024-09-19T09:12:33.851 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_perf", 2024-09-19T09:12:33.851 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.851 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.851 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.851 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.851 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.851 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.851 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.851 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T09:12:33.851 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.851 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.852 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.852 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.852 INFO:teuthology.orchestra.run.smithi092.stdout: "contact": { 2024-09-19T09:12:33.852 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "contact", 2024-09-19T09:12:33.852 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.852 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.852 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.852 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.852 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.852 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.852 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.852 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.852 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.853 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.853 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.853 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.853 INFO:teuthology.orchestra.run.smithi092.stdout: "description": { 2024-09-19T09:12:33.853 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "description", 2024-09-19T09:12:33.853 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.853 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.853 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.853 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.853 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.853 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.853 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.853 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.854 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.854 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.854 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.854 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.854 INFO:teuthology.orchestra.run.smithi092.stdout: "device_url": { 2024-09-19T09:12:33.854 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "device_url", 2024-09-19T09:12:33.854 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.854 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.854 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.854 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T09:12:33.854 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.854 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.855 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.855 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.855 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.855 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.855 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.855 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.855 INFO:teuthology.orchestra.run.smithi092.stdout: "enabled": { 2024-09-19T09:12:33.855 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enabled", 2024-09-19T09:12:33.855 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.855 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.855 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.855 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.855 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.856 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.856 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.856 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.856 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.856 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.856 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.856 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.856 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-19T09:12:33.856 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-19T09:12:33.856 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.856 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.856 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.857 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "24", 2024-09-19T09:12:33.857 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "8", 2024-09-19T09:12:33.857 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.857 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.857 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.857 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.857 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.857 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.857 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.857 INFO:teuthology.orchestra.run.smithi092.stdout: "last_opt_revision": { 2024-09-19T09:12:33.857 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "last_opt_revision", 2024-09-19T09:12:33.857 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.857 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.858 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.858 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "1", 2024-09-19T09:12:33.858 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.858 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.858 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.858 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.858 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.858 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.858 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.858 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.858 INFO:teuthology.orchestra.run.smithi092.stdout: "leaderboard": { 2024-09-19T09:12:33.858 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "leaderboard", 2024-09-19T09:12:33.858 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.859 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.859 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.859 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.859 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.859 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.859 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.859 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.859 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.859 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.859 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.859 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.859 INFO:teuthology.orchestra.run.smithi092.stdout: "leaderboard_description": { 2024-09-19T09:12:33.859 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "leaderboard_description", 2024-09-19T09:12:33.860 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.860 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.860 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.860 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.860 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.860 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.860 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.860 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.860 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.860 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.860 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.860 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.860 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.861 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.861 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.861 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.861 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.861 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.861 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.861 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.861 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.861 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.861 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.861 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.861 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.861 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.862 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.862 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.862 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.862 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.862 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.862 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.862 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.862 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.862 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.862 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.862 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.862 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.863 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.863 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.863 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.863 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.863 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.863 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.863 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.863 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.863 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.863 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.863 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.863 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.863 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.863 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.864 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.864 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.864 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.864 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.864 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.864 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.864 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.864 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.864 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.864 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.864 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.864 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.865 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.865 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.865 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.865 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.865 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.865 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.865 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.865 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.865 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.865 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.865 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.865 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.865 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.866 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.866 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.866 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.866 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.866 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.866 INFO:teuthology.orchestra.run.smithi092.stdout: "organization": { 2024-09-19T09:12:33.866 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "organization", 2024-09-19T09:12:33.866 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.866 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.866 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.866 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.866 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.867 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.867 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.867 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.867 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.867 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.867 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.867 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.867 INFO:teuthology.orchestra.run.smithi092.stdout: "proxy": { 2024-09-19T09:12:33.867 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "proxy", 2024-09-19T09:12:33.867 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.867 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.867 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.867 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.868 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.868 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.868 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.868 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.868 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.868 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.868 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.868 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.868 INFO:teuthology.orchestra.run.smithi092.stdout: "url": { 2024-09-19T09:12:33.868 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "url", 2024-09-19T09:12:33.868 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.868 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.868 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.869 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T09:12:33.869 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.869 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.869 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.869 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.869 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.869 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.869 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.869 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.869 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.869 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.869 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.869 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "test_orchestrator", 2024-09-19T09:12:33.870 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.870 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.870 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.870 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.870 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.870 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.870 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.870 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.870 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.870 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.870 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.870 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.870 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.870 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.871 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.871 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.871 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.871 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.871 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.871 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.871 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.871 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.871 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.871 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.871 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.871 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.871 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.872 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.872 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.872 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.872 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.872 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.872 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.872 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.872 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.872 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.872 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.872 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.872 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.873 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.873 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.873 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.873 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.873 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.873 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.873 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.873 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.873 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.873 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.873 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.873 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.873 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.874 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.874 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.874 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.874 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.874 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.874 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.874 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.874 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.874 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.874 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.874 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.874 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.874 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.875 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.875 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.875 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.875 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.875 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.875 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.875 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.875 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.875 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.875 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.875 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.875 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "volumes", 2024-09-19T09:12:33.876 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.876 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.876 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.876 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.876 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.876 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.876 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.876 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.876 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.876 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.876 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.876 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.876 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.877 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.877 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.877 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.877 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.877 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.877 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.877 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.877 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.877 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.877 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.877 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.877 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.877 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.878 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.878 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.878 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.878 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.878 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.878 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.878 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.878 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.878 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.878 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.878 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.878 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.878 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.878 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.879 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.879 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.879 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.879 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.879 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.879 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.879 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.879 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.879 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.879 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.879 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.879 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.880 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.880 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.880 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.880 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.880 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.880 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.880 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.880 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.880 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.880 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.880 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.880 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.880 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.881 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.881 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.881 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.881 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.881 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.881 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.881 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.881 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.881 INFO:teuthology.orchestra.run.smithi092.stdout: "max_concurrent_clones": { 2024-09-19T09:12:33.881 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_concurrent_clones", 2024-09-19T09:12:33.881 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.881 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.882 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.882 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "4", 2024-09-19T09:12:33.882 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.882 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.882 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.882 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T09:12:33.882 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.882 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.882 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.882 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.882 INFO:teuthology.orchestra.run.smithi092.stdout: "periodic_async_work": { 2024-09-19T09:12:33.882 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "periodic_async_work", 2024-09-19T09:12:33.883 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.883 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.883 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.883 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.883 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.883 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.883 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.883 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Periodically check for async work", 2024-09-19T09:12:33.883 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.883 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.883 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.883 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.883 INFO:teuthology.orchestra.run.smithi092.stdout: "snapshot_clone_delay": { 2024-09-19T09:12:33.884 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "snapshot_clone_delay", 2024-09-19T09:12:33.884 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.884 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.884 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.884 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-19T09:12:33.884 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.884 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.884 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.884 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T09:12:33.884 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.884 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.884 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.884 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.884 INFO:teuthology.orchestra.run.smithi092.stdout: "snapshot_clone_no_wait": { 2024-09-19T09:12:33.885 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T09:12:33.885 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.885 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.885 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.885 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.885 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.885 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.885 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.885 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T09:12:33.885 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.885 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.885 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.885 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.886 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.886 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.886 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.886 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix", 2024-09-19T09:12:33.886 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.886 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.886 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.886 INFO:teuthology.orchestra.run.smithi092.stdout: "discovery_interval": { 2024-09-19T09:12:33.886 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "discovery_interval", 2024-09-19T09:12:33.886 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-19T09:12:33.886 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.886 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.887 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "100", 2024-09-19T09:12:33.887 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.887 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.887 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.887 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.887 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.887 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.887 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.887 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.887 INFO:teuthology.orchestra.run.smithi092.stdout: "identifier": { 2024-09-19T09:12:33.887 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "identifier", 2024-09-19T09:12:33.887 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.887 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.887 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.888 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.888 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.888 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.888 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.888 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.888 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.888 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.888 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.888 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.888 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-19T09:12:33.888 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-19T09:12:33.888 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.888 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.888 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.889 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-19T09:12:33.889 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.889 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.889 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.889 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.889 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.889 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.889 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.889 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.889 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.889 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.889 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.890 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.890 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.890 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.890 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.890 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.890 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.890 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.890 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.890 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.890 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.890 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.890 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.890 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.890 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.891 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.891 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.891 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.891 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.891 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.891 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.891 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.891 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.891 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.891 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.891 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.891 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.891 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.891 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.892 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.892 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.892 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.892 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.892 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.892 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.892 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.892 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.892 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.892 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.892 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.892 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.892 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.893 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.893 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.893 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.893 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.893 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.893 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.893 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.893 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.893 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.893 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.893 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.893 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.893 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.893 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.894 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.894 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.894 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.894 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.894 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.894 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.894 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.894 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.894 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.894 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.894 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.894 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.894 INFO:teuthology.orchestra.run.smithi092.stdout: "zabbix_host": { 2024-09-19T09:12:33.894 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix_host", 2024-09-19T09:12:33.895 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.895 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.895 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.895 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.895 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.895 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.895 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.895 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.895 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.895 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.895 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.895 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.895 INFO:teuthology.orchestra.run.smithi092.stdout: "zabbix_port": { 2024-09-19T09:12:33.895 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix_port", 2024-09-19T09:12:33.896 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.896 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.896 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.896 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10051", 2024-09-19T09:12:33.896 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.896 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.896 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.896 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.896 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.896 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.896 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.896 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.896 INFO:teuthology.orchestra.run.smithi092.stdout: "zabbix_sender": { 2024-09-19T09:12:33.897 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix_sender", 2024-09-19T09:12:33.897 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.897 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.897 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.897 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T09:12:33.897 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.897 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.897 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.897 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.897 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.897 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.897 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.897 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.898 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.898 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.898 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-09-19T09:12:33.898 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.898 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.898 INFO:teuthology.orchestra.run.smithi092.stdout: "modules": [ 2024-09-19T09:12:33.898 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm", 2024-09-19T09:12:33.898 INFO:teuthology.orchestra.run.smithi092.stdout: "dashboard", 2024-09-19T09:12:33.898 INFO:teuthology.orchestra.run.smithi092.stdout: "iostat", 2024-09-19T09:12:33.898 INFO:teuthology.orchestra.run.smithi092.stdout: "nfs", 2024-09-19T09:12:33.898 INFO:teuthology.orchestra.run.smithi092.stdout: "restful" 2024-09-19T09:12:33.898 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.898 INFO:teuthology.orchestra.run.smithi092.stdout: "available_modules": [ 2024-09-19T09:12:33.898 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.899 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "alerts", 2024-09-19T09:12:33.899 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.899 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.899 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.899 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-19T09:12:33.899 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-19T09:12:33.899 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.899 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.899 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.899 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-19T09:12:33.899 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.899 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.899 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.900 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T09:12:33.900 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.900 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.900 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.900 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.900 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.900 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.900 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.900 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.900 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.900 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.900 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.900 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.900 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.901 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.901 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.901 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.901 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.901 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.901 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.901 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.901 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.901 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.901 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.901 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.901 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.901 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.902 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.902 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.902 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.902 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.902 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.902 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.902 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.902 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.902 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.902 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.902 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.902 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.902 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.902 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.903 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.903 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.903 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.903 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.903 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.903 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.903 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.903 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.903 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.903 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.903 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.903 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.903 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.904 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.904 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.904 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.904 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.904 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.904 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.904 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.904 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.904 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.904 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.904 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.904 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.904 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.905 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.905 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.905 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.905 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.905 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.905 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.905 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.905 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.905 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_destination": { 2024-09-19T09:12:33.905 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_destination", 2024-09-19T09:12:33.905 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.905 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.905 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.906 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.906 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.906 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.906 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.906 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Email address to send alerts to", 2024-09-19T09:12:33.906 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.906 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.906 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.906 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.906 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_from_name": { 2024-09-19T09:12:33.906 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_from_name", 2024-09-19T09:12:33.906 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.906 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.906 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.907 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "Ceph", 2024-09-19T09:12:33.907 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.907 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.907 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.907 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Email From: name", 2024-09-19T09:12:33.907 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.907 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.907 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.907 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.907 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_host": { 2024-09-19T09:12:33.907 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_host", 2024-09-19T09:12:33.907 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.907 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.908 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.908 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.908 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.908 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.908 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.908 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SMTP server", 2024-09-19T09:12:33.908 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.908 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.908 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.908 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.908 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_password": { 2024-09-19T09:12:33.908 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_password", 2024-09-19T09:12:33.909 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.909 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.909 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.909 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.909 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.909 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.909 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.909 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Password to authenticate with", 2024-09-19T09:12:33.909 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.909 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.909 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.909 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.909 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_port": { 2024-09-19T09:12:33.909 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_port", 2024-09-19T09:12:33.910 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.910 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.910 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.910 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "465", 2024-09-19T09:12:33.910 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.910 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.910 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.910 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SMTP port", 2024-09-19T09:12:33.910 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.910 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.910 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.912 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.912 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_sender": { 2024-09-19T09:12:33.912 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_sender", 2024-09-19T09:12:33.912 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.913 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.913 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.913 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.913 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.913 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.913 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.913 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SMTP envelope sender", 2024-09-19T09:12:33.913 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.913 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.913 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.913 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.913 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_ssl": { 2024-09-19T09:12:33.913 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_ssl", 2024-09-19T09:12:33.913 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.914 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.914 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.914 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.914 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.914 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.914 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.914 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T09:12:33.914 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.914 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.914 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.914 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.914 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_user": { 2024-09-19T09:12:33.914 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_user", 2024-09-19T09:12:33.914 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.915 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.915 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.915 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.915 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.915 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.915 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.915 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "User to authenticate as", 2024-09-19T09:12:33.915 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.915 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.915 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.915 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.915 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.915 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.916 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.916 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "balancer", 2024-09-19T09:12:33.916 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.916 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.916 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.916 INFO:teuthology.orchestra.run.smithi092.stdout: "active": { 2024-09-19T09:12:33.916 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "active", 2024-09-19T09:12:33.916 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.916 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.916 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.916 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.916 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.916 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.917 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.917 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T09:12:33.917 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.917 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.917 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.917 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.917 INFO:teuthology.orchestra.run.smithi092.stdout: "begin_time": { 2024-09-19T09:12:33.917 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "begin_time", 2024-09-19T09:12:33.917 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.917 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.917 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.917 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0000", 2024-09-19T09:12:33.917 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.918 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.918 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.918 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T09:12:33.918 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:12:33.918 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.918 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.918 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.918 INFO:teuthology.orchestra.run.smithi092.stdout: "begin_weekday": { 2024-09-19T09:12:33.918 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "begin_weekday", 2024-09-19T09:12:33.918 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-19T09:12:33.918 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.918 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.918 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-19T09:12:33.918 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "0", 2024-09-19T09:12:33.919 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "6", 2024-09-19T09:12:33.919 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.919 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T09:12:33.919 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:12:33.919 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.919 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.919 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.919 INFO:teuthology.orchestra.run.smithi092.stdout: "crush_compat_max_iterations": { 2024-09-19T09:12:33.919 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crush_compat_max_iterations", 2024-09-19T09:12:33.919 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-19T09:12:33.919 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.919 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.919 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "25", 2024-09-19T09:12:33.919 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2024-09-19T09:12:33.919 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "250", 2024-09-19T09:12:33.920 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.920 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T09:12:33.920 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.920 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.920 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.920 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.920 INFO:teuthology.orchestra.run.smithi092.stdout: "crush_compat_metrics": { 2024-09-19T09:12:33.920 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crush_compat_metrics", 2024-09-19T09:12:33.920 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.920 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.920 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.920 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T09:12:33.921 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.921 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.921 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.921 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T09:12:33.921 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T09:12:33.921 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.921 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.921 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.921 INFO:teuthology.orchestra.run.smithi092.stdout: "crush_compat_step": { 2024-09-19T09:12:33.921 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crush_compat_step", 2024-09-19T09:12:33.921 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-19T09:12:33.921 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.921 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.921 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0.5", 2024-09-19T09:12:33.922 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "0.001", 2024-09-19T09:12:33.922 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "0.999", 2024-09-19T09:12:33.922 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.922 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "aggressiveness of optimization", 2024-09-19T09:12:33.922 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T09:12:33.922 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.922 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.922 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.922 INFO:teuthology.orchestra.run.smithi092.stdout: "end_time": { 2024-09-19T09:12:33.922 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "end_time", 2024-09-19T09:12:33.922 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.922 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.922 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.923 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "2359", 2024-09-19T09:12:33.923 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.923 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.923 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.923 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T09:12:33.923 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:12:33.923 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.923 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.923 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.923 INFO:teuthology.orchestra.run.smithi092.stdout: "end_weekday": { 2024-09-19T09:12:33.923 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "end_weekday", 2024-09-19T09:12:33.923 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-19T09:12:33.923 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.923 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.923 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-19T09:12:33.924 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "0", 2024-09-19T09:12:33.924 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "6", 2024-09-19T09:12:33.924 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.924 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T09:12:33.924 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:12:33.924 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.924 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.924 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.924 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.924 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.924 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.924 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.924 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.924 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.925 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.925 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.925 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.925 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.925 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.925 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.925 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.925 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.925 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.925 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.925 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.925 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.925 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.925 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.926 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.926 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.926 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.926 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.926 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.926 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.926 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.926 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.926 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.926 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.926 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.926 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.926 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.927 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.927 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.927 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.927 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.927 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.927 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.927 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.927 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.927 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.927 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.927 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.927 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.927 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.928 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.928 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.928 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.928 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.928 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.928 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.928 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.928 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.928 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.928 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.928 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.928 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.928 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.928 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.929 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.929 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.929 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.929 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.929 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.929 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.929 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.929 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.929 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.929 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.929 INFO:teuthology.orchestra.run.smithi092.stdout: "min_score": { 2024-09-19T09:12:33.929 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "min_score", 2024-09-19T09:12:33.929 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-19T09:12:33.929 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.930 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.930 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-19T09:12:33.930 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.930 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.930 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.930 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T09:12:33.930 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.930 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.930 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.930 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.930 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": { 2024-09-19T09:12:33.930 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mode", 2024-09-19T09:12:33.930 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.931 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.931 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.931 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "upmap", 2024-09-19T09:12:33.931 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.931 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.931 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.931 INFO:teuthology.orchestra.run.smithi092.stdout: "crush-compat", 2024-09-19T09:12:33.931 INFO:teuthology.orchestra.run.smithi092.stdout: "none", 2024-09-19T09:12:33.931 INFO:teuthology.orchestra.run.smithi092.stdout: "read", 2024-09-19T09:12:33.931 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap", 2024-09-19T09:12:33.931 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap-read" 2024-09-19T09:12:33.931 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.931 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Balancer mode", 2024-09-19T09:12:33.932 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.932 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.932 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.932 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.932 INFO:teuthology.orchestra.run.smithi092.stdout: "pool_ids": { 2024-09-19T09:12:33.932 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pool_ids", 2024-09-19T09:12:33.932 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.932 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.932 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.932 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.932 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.932 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.932 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.933 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T09:12:33.933 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.933 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.933 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.933 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.933 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-19T09:12:33.933 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-19T09:12:33.933 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.933 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.933 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.933 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-19T09:12:33.933 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.933 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.934 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.934 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T09:12:33.934 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.934 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.934 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.934 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.934 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap_max_deviation": { 2024-09-19T09:12:33.934 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "upmap_max_deviation", 2024-09-19T09:12:33.934 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.934 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.934 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.934 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-19T09:12:33.935 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2024-09-19T09:12:33.935 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.935 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.935 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T09:12:33.935 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T09:12:33.935 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.935 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.935 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.935 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap_max_optimizations": { 2024-09-19T09:12:33.935 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "upmap_max_optimizations", 2024-09-19T09:12:33.935 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-19T09:12:33.935 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.935 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.936 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-19T09:12:33.936 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.936 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.936 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.936 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T09:12:33.936 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.936 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.936 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.936 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.936 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:33.936 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.936 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:33.937 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cephadm", 2024-09-19T09:12:33.937 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:33.937 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:33.937 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:33.937 INFO:teuthology.orchestra.run.smithi092.stdout: "agent_down_multiplier": { 2024-09-19T09:12:33.937 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "agent_down_multiplier", 2024-09-19T09:12:33.937 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-19T09:12:33.937 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.937 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.937 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3.0", 2024-09-19T09:12:33.937 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.937 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.937 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.938 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T09:12:33.938 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.938 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.938 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.938 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.938 INFO:teuthology.orchestra.run.smithi092.stdout: "agent_refresh_rate": { 2024-09-19T09:12:33.938 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "agent_refresh_rate", 2024-09-19T09:12:33.938 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.938 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.938 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.938 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "20", 2024-09-19T09:12:33.938 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.938 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.938 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.939 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T09:12:33.939 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.939 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.939 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.939 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.939 INFO:teuthology.orchestra.run.smithi092.stdout: "agent_starting_port": { 2024-09-19T09:12:33.939 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "agent_starting_port", 2024-09-19T09:12:33.939 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.939 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.939 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.939 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "4721", 2024-09-19T09:12:33.939 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.939 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.939 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.940 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T09:12:33.940 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.940 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.940 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.940 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.940 INFO:teuthology.orchestra.run.smithi092.stdout: "allow_ptrace": { 2024-09-19T09:12:33.940 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "allow_ptrace", 2024-09-19T09:12:33.940 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.940 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.940 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.940 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.940 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.940 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.941 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.941 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T09:12:33.941 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T09:12:33.941 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.941 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.941 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.941 INFO:teuthology.orchestra.run.smithi092.stdout: "autotune_interval": { 2024-09-19T09:12:33.941 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "autotune_interval", 2024-09-19T09:12:33.941 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.941 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.941 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.941 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-19T09:12:33.941 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.942 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.942 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.942 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T09:12:33.942 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.942 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.942 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.942 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.942 INFO:teuthology.orchestra.run.smithi092.stdout: "autotune_memory_target_ratio": { 2024-09-19T09:12:33.942 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T09:12:33.942 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-19T09:12:33.942 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.942 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.942 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0.7", 2024-09-19T09:12:33.942 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.943 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.943 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.943 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T09:12:33.943 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.943 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.943 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.943 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.943 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm_log_destination": { 2024-09-19T09:12:33.943 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cephadm_log_destination", 2024-09-19T09:12:33.943 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.943 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.943 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.943 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.944 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.944 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.944 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.944 INFO:teuthology.orchestra.run.smithi092.stdout: "file", 2024-09-19T09:12:33.944 INFO:teuthology.orchestra.run.smithi092.stdout: "file,syslog", 2024-09-19T09:12:33.944 INFO:teuthology.orchestra.run.smithi092.stdout: "syslog" 2024-09-19T09:12:33.944 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.944 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T09:12:33.944 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.944 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.944 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.944 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.944 INFO:teuthology.orchestra.run.smithi092.stdout: "cgroups_split": { 2024-09-19T09:12:33.945 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cgroups_split", 2024-09-19T09:12:33.945 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.945 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.945 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.945 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.945 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.945 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.945 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.945 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T09:12:33.945 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.945 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.945 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.945 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.946 INFO:teuthology.orchestra.run.smithi092.stdout: "config_checks_enabled": { 2024-09-19T09:12:33.946 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "config_checks_enabled", 2024-09-19T09:12:33.946 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.946 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.946 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.946 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.946 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.946 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.946 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.946 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T09:12:33.946 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.946 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.946 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.947 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.947 INFO:teuthology.orchestra.run.smithi092.stdout: "config_dashboard": { 2024-09-19T09:12:33.947 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "config_dashboard", 2024-09-19T09:12:33.947 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.947 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.947 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.947 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.947 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.947 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.947 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.947 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T09:12:33.947 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.948 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.948 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.948 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.948 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_alertmanager": { 2024-09-19T09:12:33.948 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_alertmanager", 2024-09-19T09:12:33.948 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.948 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.948 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.948 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T09:12:33.948 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.948 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.948 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.949 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2024-09-19T09:12:33.949 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.949 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.949 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.949 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.949 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_base": { 2024-09-19T09:12:33.949 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_base", 2024-09-19T09:12:33.949 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.949 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.949 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.949 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T09:12:33.949 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.949 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.950 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.950 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Container image name, without the tag", 2024-09-19T09:12:33.950 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.950 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.950 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.950 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.950 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_elasticsearch": { 2024-09-19T09:12:33.950 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_elasticsearch", 2024-09-19T09:12:33.950 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.950 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.950 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.950 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T09:12:33.951 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.951 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.951 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.951 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "elasticsearch container image", 2024-09-19T09:12:33.951 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.951 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.951 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.951 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.951 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_grafana": { 2024-09-19T09:12:33.951 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_grafana", 2024-09-19T09:12:33.951 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.951 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.951 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.952 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T09:12:33.952 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.952 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.952 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.952 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2024-09-19T09:12:33.952 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.952 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.952 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.952 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.952 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_haproxy": { 2024-09-19T09:12:33.952 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_haproxy", 2024-09-19T09:12:33.952 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.952 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.953 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.953 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T09:12:33.953 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.953 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.953 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.953 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "HAproxy container image", 2024-09-19T09:12:33.953 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.953 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.953 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.953 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.953 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_jaeger_agent": { 2024-09-19T09:12:33.953 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_jaeger_agent", 2024-09-19T09:12:33.954 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.954 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.954 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.954 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T09:12:33.954 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.954 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.954 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.954 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Jaeger agent container image", 2024-09-19T09:12:33.954 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.954 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.954 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.954 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.954 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_jaeger_collector": { 2024-09-19T09:12:33.954 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_jaeger_collector", 2024-09-19T09:12:33.955 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.955 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.955 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.955 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T09:12:33.955 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.955 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.955 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.955 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Jaeger collector container image", 2024-09-19T09:12:33.955 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.955 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.955 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.955 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.955 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_jaeger_query": { 2024-09-19T09:12:33.955 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_jaeger_query", 2024-09-19T09:12:33.955 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.956 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.956 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.956 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T09:12:33.956 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.956 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.956 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.956 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Jaeger query container image", 2024-09-19T09:12:33.956 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.956 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.956 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.956 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.956 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_keepalived": { 2024-09-19T09:12:33.956 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_keepalived", 2024-09-19T09:12:33.957 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.957 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.957 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.957 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T09:12:33.957 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.957 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.957 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.957 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Keepalived container image", 2024-09-19T09:12:33.957 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.957 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.957 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.957 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.957 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_loki": { 2024-09-19T09:12:33.958 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_loki", 2024-09-19T09:12:33.958 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.958 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.958 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.958 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T09:12:33.958 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.958 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.958 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.958 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Loki container image", 2024-09-19T09:12:33.958 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.958 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.958 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.959 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.959 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_node_exporter": { 2024-09-19T09:12:33.959 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_node_exporter", 2024-09-19T09:12:33.959 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.959 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.959 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.959 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T09:12:33.959 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.959 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.959 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.959 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2024-09-19T09:12:33.959 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.959 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.960 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.960 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.960 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_nvmeof": { 2024-09-19T09:12:33.960 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_nvmeof", 2024-09-19T09:12:33.960 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.960 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.960 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.960 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T09:12:33.960 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.960 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.960 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.960 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Nvme-of container image", 2024-09-19T09:12:33.960 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.960 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.961 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.961 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.961 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_prometheus": { 2024-09-19T09:12:33.961 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_prometheus", 2024-09-19T09:12:33.961 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.961 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.961 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.961 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T09:12:33.961 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.961 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.961 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.961 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2024-09-19T09:12:33.961 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.961 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.962 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.962 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.962 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_promtail": { 2024-09-19T09:12:33.962 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_promtail", 2024-09-19T09:12:33.962 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.962 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.962 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.962 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T09:12:33.962 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.962 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.962 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.962 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Promtail container image", 2024-09-19T09:12:33.962 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.962 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.962 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.963 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.963 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_samba": { 2024-09-19T09:12:33.963 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_samba", 2024-09-19T09:12:33.963 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.963 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.963 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.963 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T09:12:33.963 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.963 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.963 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.963 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Samba/SMB container image", 2024-09-19T09:12:33.964 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.964 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.964 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.964 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.964 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_snmp_gateway": { 2024-09-19T09:12:33.964 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_snmp_gateway", 2024-09-19T09:12:33.964 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.964 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.964 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.964 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T09:12:33.964 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.964 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.964 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.965 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SNMP Gateway container image", 2024-09-19T09:12:33.965 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.965 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.965 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.965 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.965 INFO:teuthology.orchestra.run.smithi092.stdout: "container_init": { 2024-09-19T09:12:33.965 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_init", 2024-09-19T09:12:33.965 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.965 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.965 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.965 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.965 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.966 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.966 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.966 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T09:12:33.966 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.966 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.966 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.966 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.966 INFO:teuthology.orchestra.run.smithi092.stdout: "daemon_cache_timeout": { 2024-09-19T09:12:33.966 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "daemon_cache_timeout", 2024-09-19T09:12:33.966 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.966 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.966 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.966 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-19T09:12:33.966 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.967 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.967 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.967 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T09:12:33.967 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.967 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.967 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.967 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.967 INFO:teuthology.orchestra.run.smithi092.stdout: "default_cephadm_command_timeout": { 2024-09-19T09:12:33.967 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T09:12:33.967 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.967 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.967 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.967 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "900", 2024-09-19T09:12:33.968 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.968 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.968 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.968 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T09:12:33.968 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.968 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.968 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.968 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.968 INFO:teuthology.orchestra.run.smithi092.stdout: "default_registry": { 2024-09-19T09:12:33.968 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "default_registry", 2024-09-19T09:12:33.968 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.968 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.968 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.968 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io", 2024-09-19T09:12:33.969 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.969 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.969 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.969 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T09:12:33.969 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.969 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.969 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.969 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.969 INFO:teuthology.orchestra.run.smithi092.stdout: "device_cache_timeout": { 2024-09-19T09:12:33.969 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "device_cache_timeout", 2024-09-19T09:12:33.969 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.969 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.969 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.970 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "1800", 2024-09-19T09:12:33.970 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.970 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.970 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.970 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "seconds to cache device inventory", 2024-09-19T09:12:33.970 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.970 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.970 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.970 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.970 INFO:teuthology.orchestra.run.smithi092.stdout: "device_enhanced_scan": { 2024-09-19T09:12:33.970 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "device_enhanced_scan", 2024-09-19T09:12:33.970 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.971 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.971 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.971 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.971 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.971 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.971 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.971 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T09:12:33.971 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.971 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.971 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.971 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.971 INFO:teuthology.orchestra.run.smithi092.stdout: "facts_cache_timeout": { 2024-09-19T09:12:33.971 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "facts_cache_timeout", 2024-09-19T09:12:33.971 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.971 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.972 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.972 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-19T09:12:33.972 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.972 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.972 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.972 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "seconds to cache host facts data", 2024-09-19T09:12:33.972 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.972 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.972 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.972 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.972 INFO:teuthology.orchestra.run.smithi092.stdout: "grafana_dashboards_path": { 2024-09-19T09:12:33.972 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "grafana_dashboards_path", 2024-09-19T09:12:33.973 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.973 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.973 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.973 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T09:12:33.973 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.973 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.973 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.973 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T09:12:33.973 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.973 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.973 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.973 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.974 INFO:teuthology.orchestra.run.smithi092.stdout: "host_check_interval": { 2024-09-19T09:12:33.974 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "host_check_interval", 2024-09-19T09:12:33.974 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:33.974 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.974 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.974 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-19T09:12:33.974 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.974 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.974 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.974 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to perform a host check", 2024-09-19T09:12:33.974 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.974 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.974 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.975 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.975 INFO:teuthology.orchestra.run.smithi092.stdout: "hw_monitoring": { 2024-09-19T09:12:33.975 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "hw_monitoring", 2024-09-19T09:12:33.975 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.975 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.975 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.975 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.975 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.975 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.975 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.975 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T09:12:33.975 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.975 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.975 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.975 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.976 INFO:teuthology.orchestra.run.smithi092.stdout: "inventory_list_all": { 2024-09-19T09:12:33.976 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "inventory_list_all", 2024-09-19T09:12:33.976 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.976 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.976 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.976 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.976 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.976 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.976 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.976 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T09:12:33.976 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.976 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.976 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.977 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.977 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:33.977 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:33.977 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.977 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.977 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.977 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.977 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.977 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.977 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.977 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.977 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.978 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.978 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.978 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.978 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.978 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.978 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.978 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.978 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.978 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.978 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.978 INFO:teuthology.orchestra.run.smithi092.stdout: "log_refresh_metadata": { 2024-09-19T09:12:33.978 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_refresh_metadata", 2024-09-19T09:12:33.978 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.979 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.979 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.979 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.979 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.979 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.979 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.979 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T09:12:33.979 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.979 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.979 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.979 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.979 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:33.979 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:33.980 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.980 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.980 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.980 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:33.980 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.980 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.980 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.980 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T09:12:33.980 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.980 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.980 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.980 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.981 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:33.981 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:33.981 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.981 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.981 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.981 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:33.981 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.981 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.981 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.981 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:33.981 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:33.981 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:33.982 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:33.982 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:33.982 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:33.982 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.982 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.982 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.982 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.982 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.982 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.982 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:33.982 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:33.982 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.982 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.982 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:33.983 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.983 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.983 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.983 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.983 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:33.983 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.983 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.983 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.983 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.983 INFO:teuthology.orchestra.run.smithi092.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T09:12:33.983 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T09:12:33.983 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.983 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.983 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.984 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.984 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.984 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.984 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.984 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T09:12:33.984 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.984 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.984 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.984 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.984 INFO:teuthology.orchestra.run.smithi092.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T09:12:33.984 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T09:12:33.984 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.985 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.985 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.985 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "*", 2024-09-19T09:12:33.985 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.985 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.985 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.985 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T09:12:33.985 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.985 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.985 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.985 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.985 INFO:teuthology.orchestra.run.smithi092.stdout: "max_count_per_host": { 2024-09-19T09:12:33.985 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_count_per_host", 2024-09-19T09:12:33.986 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.986 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.986 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.986 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-19T09:12:33.986 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.986 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.986 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.986 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "max number of daemons per service per host", 2024-09-19T09:12:33.986 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.986 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.986 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.986 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.986 INFO:teuthology.orchestra.run.smithi092.stdout: "max_osd_draining_count": { 2024-09-19T09:12:33.987 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_osd_draining_count", 2024-09-19T09:12:33.987 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.987 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.987 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.987 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-19T09:12:33.987 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.987 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.987 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.987 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T09:12:33.987 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.987 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.987 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.987 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.988 INFO:teuthology.orchestra.run.smithi092.stdout: "migration_current": { 2024-09-19T09:12:33.988 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "migration_current", 2024-09-19T09:12:33.988 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.988 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.988 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.988 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.988 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.988 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.988 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.988 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "internal - do not modify", 2024-09-19T09:12:33.988 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.988 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.988 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.988 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.989 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": { 2024-09-19T09:12:33.989 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mode", 2024-09-19T09:12:33.989 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.989 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.989 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.989 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "root", 2024-09-19T09:12:33.989 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.989 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.989 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:33.989 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm-package", 2024-09-19T09:12:33.989 INFO:teuthology.orchestra.run.smithi092.stdout: "root" 2024-09-19T09:12:33.989 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:33.989 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T09:12:33.990 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.990 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.990 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.990 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.990 INFO:teuthology.orchestra.run.smithi092.stdout: "oob_default_addr": { 2024-09-19T09:12:33.990 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "oob_default_addr", 2024-09-19T09:12:33.990 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.990 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.990 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.990 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "169.254.1.1", 2024-09-19T09:12:33.990 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.990 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.990 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.990 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T09:12:33.990 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.991 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.991 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.991 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.991 INFO:teuthology.orchestra.run.smithi092.stdout: "prometheus_alerts_path": { 2024-09-19T09:12:33.991 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "prometheus_alerts_path", 2024-09-19T09:12:33.991 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.991 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.991 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.991 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T09:12:33.991 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.991 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.991 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.991 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T09:12:33.991 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.992 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.992 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.992 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.992 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_insecure": { 2024-09-19T09:12:33.992 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_insecure", 2024-09-19T09:12:33.992 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.992 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.992 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.992 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.992 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.992 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.992 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.992 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T09:12:33.993 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.993 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.993 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.993 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.993 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_password": { 2024-09-19T09:12:33.993 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_password", 2024-09-19T09:12:33.993 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.993 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.993 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.993 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.993 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.993 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.993 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.993 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T09:12:33.994 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.994 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.994 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.994 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.994 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_url": { 2024-09-19T09:12:33.994 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_url", 2024-09-19T09:12:33.994 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.994 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.994 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.994 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.994 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.994 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.994 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.994 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T09:12:33.995 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.995 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.995 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.995 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.995 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_username": { 2024-09-19T09:12:33.995 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_username", 2024-09-19T09:12:33.995 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.995 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.995 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.995 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.995 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.995 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.995 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.996 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T09:12:33.996 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.996 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.996 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.996 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.996 INFO:teuthology.orchestra.run.smithi092.stdout: "secure_monitoring_stack": { 2024-09-19T09:12:33.996 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "secure_monitoring_stack", 2024-09-19T09:12:33.996 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.996 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.996 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.996 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.996 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.996 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.996 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.996 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T09:12:33.997 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.997 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.997 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.997 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.997 INFO:teuthology.orchestra.run.smithi092.stdout: "service_discovery_port": { 2024-09-19T09:12:33.997 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "service_discovery_port", 2024-09-19T09:12:33.997 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:33.997 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.997 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.997 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8765", 2024-09-19T09:12:33.997 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.997 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.997 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.998 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "cephadm service discovery port", 2024-09-19T09:12:33.998 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.998 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.998 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.998 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.998 INFO:teuthology.orchestra.run.smithi092.stdout: "ssh_config_file": { 2024-09-19T09:12:33.998 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssh_config_file", 2024-09-19T09:12:33.998 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:33.998 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.998 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.998 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:33.998 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.998 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:33.999 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:33.999 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T09:12:33.999 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:33.999 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:33.999 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:33.999 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:33.999 INFO:teuthology.orchestra.run.smithi092.stdout: "use_agent": { 2024-09-19T09:12:33.999 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "use_agent", 2024-09-19T09:12:33.999 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:33.999 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:33.999 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:33.999 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:33.999 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:33.999 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.000 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.000 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T09:12:34.000 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.000 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.000 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.000 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.000 INFO:teuthology.orchestra.run.smithi092.stdout: "use_repo_digest": { 2024-09-19T09:12:34.000 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "use_repo_digest", 2024-09-19T09:12:34.000 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.000 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.000 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.000 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:34.000 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.001 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.001 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.001 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T09:12:34.001 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.001 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.001 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.001 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.001 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_on_failed_host_check": { 2024-09-19T09:12:34.001 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_on_failed_host_check", 2024-09-19T09:12:34.001 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.001 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.001 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.001 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:34.002 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.002 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.002 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.002 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T09:12:34.002 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.002 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.002 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.002 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.002 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_on_stray_daemons": { 2024-09-19T09:12:34.002 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_on_stray_daemons", 2024-09-19T09:12:34.002 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.002 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.002 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.002 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:34.003 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.003 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.003 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.003 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T09:12:34.003 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.003 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.003 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.003 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.003 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_on_stray_hosts": { 2024-09-19T09:12:34.003 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_on_stray_hosts", 2024-09-19T09:12:34.003 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.003 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.003 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.004 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:34.004 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.004 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.004 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.004 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T09:12:34.004 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.004 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.004 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.004 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.004 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.004 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.004 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.004 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crash", 2024-09-19T09:12:34.004 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:34.005 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:34.005 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:34.005 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:34.005 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:34.005 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.005 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.005 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.005 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.005 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.005 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.005 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.005 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.005 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.006 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.006 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.006 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.006 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.006 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.006 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.006 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.006 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.006 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.006 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.006 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:34.006 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:34.006 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.007 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.007 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.007 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.007 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.007 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.007 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.007 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.007 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.007 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.007 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.007 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.007 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:34.007 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:34.008 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.008 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.008 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.008 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:34.008 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.008 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.008 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.008 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.008 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.008 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.008 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.008 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.008 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.008 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.009 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.009 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.009 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.009 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.009 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.009 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:34.009 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:34.009 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.009 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.009 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.009 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.009 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.009 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.010 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.010 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.010 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.010 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.010 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.010 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.010 INFO:teuthology.orchestra.run.smithi092.stdout: "retain_interval": { 2024-09-19T09:12:34.010 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "retain_interval", 2024-09-19T09:12:34.010 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:34.010 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.010 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.010 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "31536000", 2024-09-19T09:12:34.010 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.011 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.011 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.011 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T09:12:34.011 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.011 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.011 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.011 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.011 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_recent_interval": { 2024-09-19T09:12:34.011 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_recent_interval", 2024-09-19T09:12:34.011 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:34.011 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.011 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.011 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "1209600", 2024-09-19T09:12:34.012 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.012 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.012 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.012 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T09:12:34.012 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.012 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.012 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.012 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.012 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.012 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.012 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.012 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "dashboard", 2024-09-19T09:12:34.012 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:34.013 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:34.013 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:34.013 INFO:teuthology.orchestra.run.smithi092.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T09:12:34.013 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T09:12:34.013 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:34.013 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.013 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.013 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-19T09:12:34.013 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.013 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.013 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.013 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.013 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.014 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.014 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.014 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.014 INFO:teuthology.orchestra.run.smithi092.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T09:12:34.014 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T09:12:34.014 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.014 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.014 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.014 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.014 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.014 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.014 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.014 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.015 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.015 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.015 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.015 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.015 INFO:teuthology.orchestra.run.smithi092.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T09:12:34.015 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T09:12:34.015 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.015 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.015 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.015 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:34.015 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.015 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.015 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.016 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.016 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.016 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.016 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.016 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.016 INFO:teuthology.orchestra.run.smithi092.stdout: "AUDIT_API_ENABLED": { 2024-09-19T09:12:34.016 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T09:12:34.016 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.016 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.016 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.016 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.016 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.016 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.017 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.017 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.017 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.017 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.017 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.017 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.017 INFO:teuthology.orchestra.run.smithi092.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T09:12:34.017 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T09:12:34.017 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.017 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.017 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.017 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:34.017 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.017 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.018 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.018 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.018 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.018 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.018 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.018 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.018 INFO:teuthology.orchestra.run.smithi092.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T09:12:34.018 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T09:12:34.018 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.018 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.018 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.018 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:34.018 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.019 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.019 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.019 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.019 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.019 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.019 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.019 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.019 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T09:12:34.019 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T09:12:34.019 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.019 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.019 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.019 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:34.020 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.020 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.020 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.020 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.020 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.020 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.020 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.020 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.020 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T09:12:34.020 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T09:12:34.020 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.020 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.020 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.020 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:34.021 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.021 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.021 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.021 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.021 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.021 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.021 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.021 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.021 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T09:12:34.021 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T09:12:34.021 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.021 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.021 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.021 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:34.022 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.022 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.022 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.022 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.022 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.022 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.022 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.022 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.022 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T09:12:34.022 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T09:12:34.022 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.022 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.022 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.023 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:34.023 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.023 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.023 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.023 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.023 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.023 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.023 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.023 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.023 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T09:12:34.023 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T09:12:34.023 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.023 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.024 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.024 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:34.024 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.024 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.024 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.024 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.024 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.024 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.024 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.024 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.024 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T09:12:34.024 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T09:12:34.024 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.025 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.025 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.025 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:34.025 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.025 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.025 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.025 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.025 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.025 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.025 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.025 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.025 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T09:12:34.025 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T09:12:34.025 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.026 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.026 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.026 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:34.026 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.026 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.026 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.026 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.026 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.026 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.026 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.026 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.026 INFO:teuthology.orchestra.run.smithi092.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T09:12:34.026 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T09:12:34.027 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.027 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.027 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.027 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.027 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.027 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.027 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.027 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.027 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.027 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.027 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.027 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.027 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T09:12:34.028 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T09:12:34.028 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.028 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.028 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.028 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "admin", 2024-09-19T09:12:34.028 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.028 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.028 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.028 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.028 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.028 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.028 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.028 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.029 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T09:12:34.029 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T09:12:34.029 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.029 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.029 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.029 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:34.029 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.029 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.029 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.029 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.029 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.029 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.029 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.030 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.030 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_URL": { 2024-09-19T09:12:34.030 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_URL", 2024-09-19T09:12:34.030 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.030 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.030 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.030 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.030 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.030 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.030 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.030 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.030 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.030 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.031 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.031 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.031 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T09:12:34.031 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T09:12:34.031 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.031 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.031 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.031 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "admin", 2024-09-19T09:12:34.031 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.031 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.031 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.031 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.031 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.032 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.032 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.032 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.032 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T09:12:34.032 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T09:12:34.032 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.032 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.032 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.032 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.032 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.032 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.032 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.032 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.033 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.033 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.033 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.033 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.033 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T09:12:34.033 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T09:12:34.033 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.033 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.033 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.033 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.033 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.033 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.033 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.033 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.034 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.034 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.034 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.034 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.034 INFO:teuthology.orchestra.run.smithi092.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T09:12:34.034 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T09:12:34.034 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.034 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.034 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.034 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:34.034 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.034 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.034 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.035 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.035 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.035 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.035 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.035 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.035 INFO:teuthology.orchestra.run.smithi092.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T09:12:34.035 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T09:12:34.035 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.035 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.035 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.035 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.035 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.035 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.035 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.036 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.036 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.036 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.036 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.036 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.036 INFO:teuthology.orchestra.run.smithi092.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T09:12:34.036 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T09:12:34.036 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.036 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.036 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.036 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.036 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.036 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.037 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.037 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.037 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.037 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.037 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.037 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.037 INFO:teuthology.orchestra.run.smithi092.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T09:12:34.037 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T09:12:34.037 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.037 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.037 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.037 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:34.037 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.038 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.038 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.038 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.038 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.038 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.038 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.038 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.038 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T09:12:34.038 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T09:12:34.038 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.038 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.038 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.038 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.038 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.039 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.039 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.039 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.039 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.039 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.039 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.039 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.039 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T09:12:34.039 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T09:12:34.039 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.039 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.039 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.039 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.039 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.039 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.040 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.040 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.040 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.040 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.040 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.040 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.040 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T09:12:34.040 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T09:12:34.040 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.040 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.040 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.040 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:34.040 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.041 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.041 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.041 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.041 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.041 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.041 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.041 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.041 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T09:12:34.041 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T09:12:34.041 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.041 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.041 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.041 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:34.041 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.042 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.042 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.042 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.042 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.042 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.042 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.042 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.042 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T09:12:34.042 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T09:12:34.042 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.042 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.042 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.042 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.042 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.043 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.043 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.043 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.043 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.043 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.043 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.043 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.043 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T09:12:34.043 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T09:12:34.043 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.043 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.043 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.043 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.043 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.044 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.044 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.044 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.044 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.044 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.044 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.044 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.044 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T09:12:34.044 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T09:12:34.044 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.044 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.044 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.044 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.045 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.045 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.045 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.045 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.045 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.045 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.045 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.045 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.045 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T09:12:34.045 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T09:12:34.045 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.045 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.045 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.046 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:34.046 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.046 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.046 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.046 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.046 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.046 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.046 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.046 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.046 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T09:12:34.046 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T09:12:34.046 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.046 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.047 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.047 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T09:12:34.047 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.047 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.047 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.047 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.047 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.047 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.047 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.047 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.047 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T09:12:34.047 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T09:12:34.047 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:34.048 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.048 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.048 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-19T09:12:34.048 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.048 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.048 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.048 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.048 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.048 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.048 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.048 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.048 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T09:12:34.048 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T09:12:34.049 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:34.049 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.049 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.049 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8", 2024-09-19T09:12:34.049 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.049 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.049 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.049 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.049 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.049 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.049 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.049 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.049 INFO:teuthology.orchestra.run.smithi092.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T09:12:34.049 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T09:12:34.050 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:34.050 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.050 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.050 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "45", 2024-09-19T09:12:34.050 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.050 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.050 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.050 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.050 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.050 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.050 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.050 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.050 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T09:12:34.051 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T09:12:34.051 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.051 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.051 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.051 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.051 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.051 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.051 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.051 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.051 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.051 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.051 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.051 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.052 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T09:12:34.052 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T09:12:34.052 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.052 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.052 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.052 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "admin", 2024-09-19T09:12:34.052 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.052 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.052 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.052 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.052 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.052 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.052 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.052 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.053 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T09:12:34.053 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T09:12:34.053 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.053 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.053 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.053 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.053 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.053 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.053 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.053 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.053 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.053 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.053 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.054 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.054 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T09:12:34.054 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T09:12:34.054 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.054 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.054 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.054 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:34.054 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.054 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.054 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.054 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.054 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.054 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.054 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.055 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.055 INFO:teuthology.orchestra.run.smithi092.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T09:12:34.055 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T09:12:34.055 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:34.055 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.055 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.055 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-19T09:12:34.055 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.055 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.055 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.055 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.055 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.055 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.055 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.056 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.056 INFO:teuthology.orchestra.run.smithi092.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T09:12:34.056 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T09:12:34.056 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:34.056 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.056 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.056 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-19T09:12:34.056 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.056 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.056 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.056 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.056 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.056 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.057 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.057 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.057 INFO:teuthology.orchestra.run.smithi092.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T09:12:34.057 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T09:12:34.057 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:34.057 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.057 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.057 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-19T09:12:34.057 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.057 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.057 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.057 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.057 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.057 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.058 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.058 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.058 INFO:teuthology.orchestra.run.smithi092.stdout: "cross_origin_url": { 2024-09-19T09:12:34.058 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cross_origin_url", 2024-09-19T09:12:34.058 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.058 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.058 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.058 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.058 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.058 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.058 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.058 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.058 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.058 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.059 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.059 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.059 INFO:teuthology.orchestra.run.smithi092.stdout: "crt_file": { 2024-09-19T09:12:34.059 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crt_file", 2024-09-19T09:12:34.059 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.059 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.059 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.059 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.059 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.059 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.059 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.059 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.059 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.059 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.060 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.060 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.060 INFO:teuthology.orchestra.run.smithi092.stdout: "debug": { 2024-09-19T09:12:34.060 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "debug", 2024-09-19T09:12:34.060 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.060 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.060 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.060 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.060 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.060 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.060 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.060 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Enable/disable debug options", 2024-09-19T09:12:34.060 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.061 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.061 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.061 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.061 INFO:teuthology.orchestra.run.smithi092.stdout: "jwt_token_ttl": { 2024-09-19T09:12:34.061 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "jwt_token_ttl", 2024-09-19T09:12:34.061 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:34.061 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.061 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.061 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "28800", 2024-09-19T09:12:34.061 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.061 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.061 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.061 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.061 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.062 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.062 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.062 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.062 INFO:teuthology.orchestra.run.smithi092.stdout: "key_file": { 2024-09-19T09:12:34.062 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "key_file", 2024-09-19T09:12:34.062 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.062 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.062 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.062 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.062 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.062 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.062 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.062 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.063 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.063 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.063 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.063 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.063 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:34.063 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:34.063 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.063 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.063 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.063 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.063 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.063 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.063 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.063 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.064 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.064 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.064 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.064 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.064 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.064 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.064 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.064 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.064 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.064 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.064 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.064 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:34.064 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:34.064 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.065 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.065 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.065 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.065 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.065 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.065 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.065 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.065 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.065 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.065 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.065 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.065 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:34.065 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:34.066 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.066 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.066 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.066 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:34.066 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.066 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.066 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.066 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.066 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.066 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.066 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.066 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.066 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.066 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.067 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.067 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.067 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.067 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.067 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.067 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:34.067 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:34.067 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.067 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.067 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.067 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.067 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.067 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.067 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.068 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.068 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.068 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.068 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.068 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.068 INFO:teuthology.orchestra.run.smithi092.stdout: "motd": { 2024-09-19T09:12:34.068 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "motd", 2024-09-19T09:12:34.068 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.068 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.068 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.068 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.068 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.068 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.069 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.069 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "The message of the day", 2024-09-19T09:12:34.069 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.069 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.069 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.069 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.069 INFO:teuthology.orchestra.run.smithi092.stdout: "redirect_resolve_ip_addr": { 2024-09-19T09:12:34.069 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T09:12:34.069 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.069 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.069 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.069 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.069 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.070 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.070 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.070 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.070 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.070 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.070 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.070 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.070 INFO:teuthology.orchestra.run.smithi092.stdout: "server_addr": { 2024-09-19T09:12:34.070 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_addr", 2024-09-19T09:12:34.070 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.070 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.070 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.070 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "::", 2024-09-19T09:12:34.070 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.071 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.071 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.071 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.071 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.071 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.071 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.071 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.071 INFO:teuthology.orchestra.run.smithi092.stdout: "server_port": { 2024-09-19T09:12:34.071 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_port", 2024-09-19T09:12:34.071 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:34.071 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.071 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.071 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8080", 2024-09-19T09:12:34.072 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.072 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.072 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.072 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.072 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.072 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.072 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.072 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.072 INFO:teuthology.orchestra.run.smithi092.stdout: "ssl": { 2024-09-19T09:12:34.072 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssl", 2024-09-19T09:12:34.072 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.072 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.072 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.072 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:34.073 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.073 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.073 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.073 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.073 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.073 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.073 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.073 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.073 INFO:teuthology.orchestra.run.smithi092.stdout: "ssl_server_port": { 2024-09-19T09:12:34.073 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssl_server_port", 2024-09-19T09:12:34.073 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:34.073 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.074 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.074 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8443", 2024-09-19T09:12:34.074 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.074 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.074 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.074 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.074 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.074 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.074 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.074 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.074 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_behaviour": { 2024-09-19T09:12:34.074 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_behaviour", 2024-09-19T09:12:34.074 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.075 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.075 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.075 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "redirect", 2024-09-19T09:12:34.075 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.075 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.075 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.075 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.075 INFO:teuthology.orchestra.run.smithi092.stdout: "redirect" 2024-09-19T09:12:34.075 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.075 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.075 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.075 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.075 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.075 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.076 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_error_status_code": { 2024-09-19T09:12:34.076 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_error_status_code", 2024-09-19T09:12:34.076 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:34.076 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.076 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.076 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "500", 2024-09-19T09:12:34.076 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "400", 2024-09-19T09:12:34.076 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "599", 2024-09-19T09:12:34.076 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.076 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.076 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.076 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.076 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.077 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.077 INFO:teuthology.orchestra.run.smithi092.stdout: "url_prefix": { 2024-09-19T09:12:34.077 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "url_prefix", 2024-09-19T09:12:34.077 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.077 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.077 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.077 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.077 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.077 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.077 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.077 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.077 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.077 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.077 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.078 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.078 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.078 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.078 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.078 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "devicehealth", 2024-09-19T09:12:34.078 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:34.078 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:34.078 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:34.078 INFO:teuthology.orchestra.run.smithi092.stdout: "enable_monitoring": { 2024-09-19T09:12:34.078 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enable_monitoring", 2024-09-19T09:12:34.078 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.078 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.078 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.079 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:34.079 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.079 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.079 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.079 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "monitor device health metrics", 2024-09-19T09:12:34.079 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.079 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.079 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.079 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.079 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:34.079 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:34.079 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.079 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.079 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.080 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.080 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.080 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.080 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.080 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.080 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.080 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.080 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.080 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.080 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.080 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.080 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.080 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.081 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.081 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.081 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.081 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:34.081 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:34.081 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.081 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.081 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.081 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.081 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.081 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.081 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.081 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.082 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.082 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.082 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.082 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.082 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:34.082 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:34.082 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.082 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.082 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.082 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:34.082 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.082 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.082 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.082 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.083 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.083 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.083 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.083 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.083 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.083 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.083 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.083 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.083 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.083 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.083 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.083 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:34.083 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:34.084 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.084 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.084 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.084 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.084 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.084 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.084 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.084 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.084 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.084 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.084 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.084 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.084 INFO:teuthology.orchestra.run.smithi092.stdout: "mark_out_threshold": { 2024-09-19T09:12:34.084 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mark_out_threshold", 2024-09-19T09:12:34.085 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:34.085 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.085 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.085 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "2419200", 2024-09-19T09:12:34.085 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.085 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.085 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.085 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T09:12:34.085 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.085 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.085 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.085 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.085 INFO:teuthology.orchestra.run.smithi092.stdout: "pool_name": { 2024-09-19T09:12:34.086 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pool_name", 2024-09-19T09:12:34.086 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.086 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.086 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.086 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "device_health_metrics", 2024-09-19T09:12:34.086 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.086 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.086 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.086 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T09:12:34.086 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.086 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.086 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.086 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.086 INFO:teuthology.orchestra.run.smithi092.stdout: "retention_period": { 2024-09-19T09:12:34.087 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "retention_period", 2024-09-19T09:12:34.087 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:34.087 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.087 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.087 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "15552000", 2024-09-19T09:12:34.087 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.087 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.087 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.087 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how long to retain device health metrics", 2024-09-19T09:12:34.087 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.087 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.087 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.087 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.087 INFO:teuthology.orchestra.run.smithi092.stdout: "scrape_frequency": { 2024-09-19T09:12:34.088 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "scrape_frequency", 2024-09-19T09:12:34.088 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:34.088 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.088 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.088 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "86400", 2024-09-19T09:12:34.088 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.088 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.088 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.088 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T09:12:34.088 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.088 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.088 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.088 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.089 INFO:teuthology.orchestra.run.smithi092.stdout: "self_heal": { 2024-09-19T09:12:34.089 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "self_heal", 2024-09-19T09:12:34.089 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.089 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.089 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.089 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:34.089 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.089 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.089 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.089 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T09:12:34.089 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.089 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.089 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.089 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.090 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-19T09:12:34.090 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-19T09:12:34.090 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:34.090 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.090 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.090 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-19T09:12:34.090 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.090 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.090 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.090 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T09:12:34.090 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.090 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.090 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.090 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.091 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_threshold": { 2024-09-19T09:12:34.091 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_threshold", 2024-09-19T09:12:34.091 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:34.091 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.091 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.091 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "7257600", 2024-09-19T09:12:34.091 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.091 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.091 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.091 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T09:12:34.091 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.091 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.091 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.091 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.092 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.092 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.092 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.092 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "diskprediction_local", 2024-09-19T09:12:34.092 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:34.092 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:34.092 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:34.092 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:34.092 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:34.092 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.092 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.092 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.092 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.093 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.093 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.093 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.093 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.093 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.093 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.093 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.093 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.093 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.093 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.093 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.093 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.093 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.093 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.093 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.094 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:34.094 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:34.094 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.094 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.094 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.094 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.094 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.094 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.094 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.094 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.094 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.094 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.094 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.095 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.095 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:34.095 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:34.095 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.095 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.095 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.095 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:34.095 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.095 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.095 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.096 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.096 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.096 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.096 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.096 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.096 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.096 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.096 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.096 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.096 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.096 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.096 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.096 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:34.096 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:34.097 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.097 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.097 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.097 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.097 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.097 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.097 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.097 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.097 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.097 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.097 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.097 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.097 INFO:teuthology.orchestra.run.smithi092.stdout: "predict_interval": { 2024-09-19T09:12:34.098 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "predict_interval", 2024-09-19T09:12:34.098 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.098 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.098 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.098 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "86400", 2024-09-19T09:12:34.098 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.098 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.098 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.098 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.098 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.098 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.098 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.098 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.098 INFO:teuthology.orchestra.run.smithi092.stdout: "predictor_model": { 2024-09-19T09:12:34.099 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "predictor_model", 2024-09-19T09:12:34.099 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.099 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.099 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.099 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "prophetstor", 2024-09-19T09:12:34.099 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.099 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.099 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.099 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.099 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.099 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.099 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.099 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.099 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-19T09:12:34.100 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-19T09:12:34.100 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.100 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.100 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.100 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-19T09:12:34.100 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.100 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.100 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.100 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.100 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.100 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.100 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.100 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.101 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.101 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.101 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.101 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "influx", 2024-09-19T09:12:34.101 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": false, 2024-09-19T09:12:34.101 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "influxdb python module not found", 2024-09-19T09:12:34.101 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:34.101 INFO:teuthology.orchestra.run.smithi092.stdout: "batch_size": { 2024-09-19T09:12:34.101 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "batch_size", 2024-09-19T09:12:34.101 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:34.101 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.101 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.101 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5000", 2024-09-19T09:12:34.102 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.102 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.102 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.102 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T09:12:34.102 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.102 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.102 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.102 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.102 INFO:teuthology.orchestra.run.smithi092.stdout: "database": { 2024-09-19T09:12:34.102 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "database", 2024-09-19T09:12:34.102 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.102 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.102 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.102 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "ceph", 2024-09-19T09:12:34.103 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.103 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.103 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.103 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T09:12:34.103 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.103 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.103 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.103 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.103 INFO:teuthology.orchestra.run.smithi092.stdout: "hostname": { 2024-09-19T09:12:34.103 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "hostname", 2024-09-19T09:12:34.103 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.103 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.103 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.103 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.104 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.104 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.104 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.104 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "InfluxDB server hostname", 2024-09-19T09:12:34.104 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.104 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.104 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.104 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.104 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-19T09:12:34.104 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-19T09:12:34.104 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:34.104 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.104 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.105 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "30", 2024-09-19T09:12:34.105 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "5", 2024-09-19T09:12:34.105 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.105 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.105 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T09:12:34.105 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.105 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.105 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.105 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.105 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:34.105 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:34.105 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.105 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.106 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.106 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.106 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.106 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.106 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.106 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.106 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.106 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.106 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.106 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.106 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.106 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.106 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.107 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.107 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.107 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.107 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.107 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:34.107 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:34.107 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.107 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.107 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.107 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.107 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.107 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.107 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.108 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.108 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.108 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.108 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.108 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.108 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:34.108 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:34.108 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.108 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.108 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.108 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:34.108 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.108 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.109 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.109 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.109 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.109 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.109 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.109 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.109 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.109 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.109 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.109 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.109 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.109 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.109 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.110 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:34.110 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:34.110 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.110 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.110 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.110 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.110 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.110 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.110 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.110 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.110 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.110 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.110 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.110 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.111 INFO:teuthology.orchestra.run.smithi092.stdout: "password": { 2024-09-19T09:12:34.111 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "password", 2024-09-19T09:12:34.111 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.111 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.111 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.111 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.111 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.111 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.111 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.111 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "password of InfluxDB server user", 2024-09-19T09:12:34.111 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.111 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.111 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.112 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.112 INFO:teuthology.orchestra.run.smithi092.stdout: "port": { 2024-09-19T09:12:34.112 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "port", 2024-09-19T09:12:34.112 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:34.112 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.112 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.112 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8086", 2024-09-19T09:12:34.112 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.112 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.112 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.112 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "InfluxDB server port", 2024-09-19T09:12:34.112 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.112 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.113 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.113 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.113 INFO:teuthology.orchestra.run.smithi092.stdout: "ssl": { 2024-09-19T09:12:34.113 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssl", 2024-09-19T09:12:34.113 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.116 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.116 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.116 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "false", 2024-09-19T09:12:34.116 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.116 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.116 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.117 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:12:34.117 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.117 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.117 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.117 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.117 INFO:teuthology.orchestra.run.smithi092.stdout: "threads": { 2024-09-19T09:12:34.117 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "threads", 2024-09-19T09:12:34.117 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:34.117 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.117 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.117 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-19T09:12:34.117 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2024-09-19T09:12:34.117 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "32", 2024-09-19T09:12:34.117 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.118 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T09:12:34.118 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.118 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.118 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.118 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.118 INFO:teuthology.orchestra.run.smithi092.stdout: "username": { 2024-09-19T09:12:34.118 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "username", 2024-09-19T09:12:34.118 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.118 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.118 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.118 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.118 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.118 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.119 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.119 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "username of InfluxDB server user", 2024-09-19T09:12:34.119 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.119 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.119 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.119 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.119 INFO:teuthology.orchestra.run.smithi092.stdout: "verify_ssl": { 2024-09-19T09:12:34.119 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "verify_ssl", 2024-09-19T09:12:34.119 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.119 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.119 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.119 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "true", 2024-09-19T09:12:34.119 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.119 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.119 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.120 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:12:34.120 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.120 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.120 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.120 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.120 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.120 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.120 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.120 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "insights", 2024-09-19T09:12:34.120 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:34.120 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:34.120 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:34.120 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:34.121 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:34.121 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.121 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.121 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.121 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.121 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.121 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.121 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.121 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.121 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.121 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.121 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.121 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.122 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.122 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.122 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.122 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.122 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.122 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.122 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.122 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:34.122 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:34.122 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.122 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.122 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.122 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.122 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.123 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.123 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.123 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.123 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.123 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.123 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.123 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.123 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:34.123 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:34.123 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.123 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.123 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.123 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:34.124 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.124 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.124 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.124 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.124 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.124 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.124 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.124 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.124 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.124 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.124 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.124 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.124 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.125 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.125 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.125 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:34.125 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:34.125 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.125 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.125 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.125 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.125 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.125 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.125 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.125 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.125 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.125 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.126 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.126 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.126 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.126 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.126 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.126 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "iostat", 2024-09-19T09:12:34.126 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:34.126 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:34.126 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:34.126 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:34.126 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:34.126 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.126 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.126 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.127 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.127 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.127 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.127 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.127 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.127 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.127 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.127 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.127 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.127 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.127 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.127 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.127 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.127 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.128 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.128 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.128 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:34.128 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:34.128 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.128 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.128 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.128 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.128 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.128 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.128 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.128 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.128 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.129 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.129 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.129 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.129 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:34.129 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:34.129 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.129 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.129 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.129 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:34.129 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.129 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.129 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.130 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.130 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.130 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.130 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.130 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.130 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.130 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.130 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.130 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.130 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.130 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.130 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.130 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:34.130 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:34.131 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.131 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.131 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.131 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.131 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.131 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.131 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.131 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.131 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.131 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.131 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.131 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.132 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.132 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.132 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.132 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "k8sevents", 2024-09-19T09:12:34.132 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:34.132 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:34.132 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:34.132 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_event_retention_days": { 2024-09-19T09:12:34.132 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ceph_event_retention_days", 2024-09-19T09:12:34.132 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:34.132 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.132 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.132 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "7", 2024-09-19T09:12:34.132 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.132 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.133 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.133 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T09:12:34.133 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.133 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.133 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.133 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.133 INFO:teuthology.orchestra.run.smithi092.stdout: "config_check_secs": { 2024-09-19T09:12:34.133 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "config_check_secs", 2024-09-19T09:12:34.133 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:34.133 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.133 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.133 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-19T09:12:34.133 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "10", 2024-09-19T09:12:34.134 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.134 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.134 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T09:12:34.134 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.134 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.134 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.134 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.134 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:34.134 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:34.134 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.134 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.134 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.134 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.135 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.135 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.135 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.135 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.135 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.135 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.135 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.135 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.135 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.135 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.135 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.135 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.135 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.136 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.136 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.136 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:34.136 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:34.136 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.136 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.136 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.136 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.136 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.136 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.136 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.136 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.136 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.137 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.137 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.137 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.137 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:34.137 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:34.137 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.137 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.137 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.137 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:34.137 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.137 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.137 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.138 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.138 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.138 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.138 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.138 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.138 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.138 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.138 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.138 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.138 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.138 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.138 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.138 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:34.139 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:34.139 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.139 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.139 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.139 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.139 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.139 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.139 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.139 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.139 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.139 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.139 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.140 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.140 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.140 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.140 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.140 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "localpool", 2024-09-19T09:12:34.140 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:34.140 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:34.140 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:34.140 INFO:teuthology.orchestra.run.smithi092.stdout: "failure_domain": { 2024-09-19T09:12:34.140 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "failure_domain", 2024-09-19T09:12:34.140 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.140 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.140 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.141 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "host", 2024-09-19T09:12:34.141 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.141 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.141 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.141 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "failure domain for any created local pool", 2024-09-19T09:12:34.141 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T09:12:34.141 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.141 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.141 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.141 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:34.141 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:34.141 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.142 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.142 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.142 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.142 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.142 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.142 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.142 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.142 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.142 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.142 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.142 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.142 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.143 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.143 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.143 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.143 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.143 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.143 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.143 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:34.143 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:34.143 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.143 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.143 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.143 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.143 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.144 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.144 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.144 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.144 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.144 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.144 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.144 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.144 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:34.144 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:34.144 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.144 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.144 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.144 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:34.145 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.145 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.145 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.145 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.145 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.145 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.145 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.145 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.145 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.145 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.145 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.145 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.145 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.145 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.146 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.146 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:34.146 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:34.146 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.146 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.146 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.146 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.146 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.146 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.146 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.146 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.146 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.146 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.146 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.147 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.147 INFO:teuthology.orchestra.run.smithi092.stdout: "min_size": { 2024-09-19T09:12:34.147 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "min_size", 2024-09-19T09:12:34.147 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:34.147 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.147 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.147 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.147 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.147 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.147 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.147 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "default min_size for any created local pool", 2024-09-19T09:12:34.147 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T09:12:34.147 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.148 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.148 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.148 INFO:teuthology.orchestra.run.smithi092.stdout: "num_rep": { 2024-09-19T09:12:34.148 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "num_rep", 2024-09-19T09:12:34.148 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:34.148 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.148 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.148 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3", 2024-09-19T09:12:34.148 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.148 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.148 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.148 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "default replica count for any created local pool", 2024-09-19T09:12:34.148 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.148 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.149 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.149 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.149 INFO:teuthology.orchestra.run.smithi092.stdout: "pg_num": { 2024-09-19T09:12:34.149 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pg_num", 2024-09-19T09:12:34.149 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:34.149 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.149 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.149 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "128", 2024-09-19T09:12:34.149 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.149 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.149 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.149 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T09:12:34.149 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.150 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.150 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.150 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.150 INFO:teuthology.orchestra.run.smithi092.stdout: "prefix": { 2024-09-19T09:12:34.150 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "prefix", 2024-09-19T09:12:34.150 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.150 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.150 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.150 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.150 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.150 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.150 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.150 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "name prefix for any created local pool", 2024-09-19T09:12:34.151 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.151 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.151 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.151 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.151 INFO:teuthology.orchestra.run.smithi092.stdout: "subtree": { 2024-09-19T09:12:34.151 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "subtree", 2024-09-19T09:12:34.151 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.151 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.151 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.151 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "rack", 2024-09-19T09:12:34.151 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.151 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.151 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.151 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T09:12:34.152 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T09:12:34.152 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.152 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.152 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.152 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.152 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.152 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.152 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mds_autoscaler", 2024-09-19T09:12:34.152 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:34.152 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:34.152 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:34.152 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:34.152 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:34.152 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.153 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.153 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.153 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.153 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.153 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.153 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.153 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.153 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.153 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.153 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.153 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.153 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.154 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.154 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.154 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.154 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.154 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.154 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.154 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:34.154 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:34.154 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.154 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.155 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.155 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.155 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.155 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.155 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.155 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.155 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.155 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.155 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.155 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.155 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:34.155 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:34.155 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.155 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.155 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.156 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:34.156 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.156 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.156 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.156 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.156 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.156 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.156 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.156 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.156 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.156 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.156 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.157 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.157 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.157 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.157 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.157 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:34.157 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:34.157 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.157 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.157 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.157 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.157 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.157 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.158 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.158 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.158 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.158 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.158 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.158 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.158 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.158 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.158 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.158 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mirroring", 2024-09-19T09:12:34.158 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:34.158 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:34.159 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:34.159 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:34.159 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:34.159 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.159 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.159 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.159 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.159 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.159 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.159 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.159 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.159 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.159 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.159 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.160 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.160 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.160 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.160 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.160 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.160 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.160 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.160 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.160 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:34.160 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:34.160 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.160 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.161 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.161 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.161 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.161 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.161 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.161 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.161 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.161 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.161 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.161 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.161 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:34.161 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:34.161 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.161 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.162 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.162 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:34.162 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.162 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.162 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.162 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.162 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.162 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.162 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.162 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.162 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.162 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.162 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.162 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.163 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.163 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.163 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.163 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:34.163 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:34.163 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.163 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.163 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.163 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.163 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.163 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.163 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.163 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.164 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.164 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.164 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.164 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.164 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.164 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.164 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.164 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "nfs", 2024-09-19T09:12:34.164 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:34.164 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:34.164 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:34.164 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:34.164 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:34.164 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.164 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.165 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.165 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.165 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.165 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.165 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.165 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.165 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.165 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.165 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.165 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.165 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.165 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.165 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.165 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.166 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.166 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.166 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.166 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:34.166 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:34.166 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.166 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.166 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.166 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.166 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.166 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.166 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.166 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.166 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.166 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.167 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.167 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.167 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:34.167 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:34.167 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.167 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.167 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.167 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:34.167 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.167 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.167 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.167 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.167 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.167 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.168 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.168 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.168 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.168 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.168 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.168 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.168 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.168 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.168 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.168 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:34.168 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:34.168 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.168 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.168 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.169 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.169 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.169 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.169 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.169 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.169 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.169 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.169 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.169 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.169 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.169 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.169 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.169 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "orchestrator", 2024-09-19T09:12:34.170 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:34.170 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:34.170 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:34.170 INFO:teuthology.orchestra.run.smithi092.stdout: "fail_fs": { 2024-09-19T09:12:34.170 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "fail_fs", 2024-09-19T09:12:34.170 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.170 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.170 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.170 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.170 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.170 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.170 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.170 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T09:12:34.170 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.171 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.171 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.171 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.171 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:34.171 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:34.171 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.171 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.171 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.171 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.171 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.171 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.171 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.171 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.172 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.172 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.172 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.172 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.172 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.172 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.172 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.172 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.172 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.172 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.172 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.172 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:34.172 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:34.172 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.173 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.173 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.173 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.173 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.173 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.173 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.173 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.173 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.173 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.173 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.173 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.173 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:34.173 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:34.174 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.174 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.174 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.174 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:34.174 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.174 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.174 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.174 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.174 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.174 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.174 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.174 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.174 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.175 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.175 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.175 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.175 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.175 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.175 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.175 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:34.175 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:34.175 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.175 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.175 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.175 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.175 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.175 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.176 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.176 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.176 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.176 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.176 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.176 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.176 INFO:teuthology.orchestra.run.smithi092.stdout: "orchestrator": { 2024-09-19T09:12:34.176 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "orchestrator", 2024-09-19T09:12:34.176 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.176 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.176 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.176 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.176 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.177 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.177 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.177 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm", 2024-09-19T09:12:34.177 INFO:teuthology.orchestra.run.smithi092.stdout: "rook", 2024-09-19T09:12:34.177 INFO:teuthology.orchestra.run.smithi092.stdout: "test_orchestrator" 2024-09-19T09:12:34.177 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.177 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Orchestrator backend", 2024-09-19T09:12:34.177 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.177 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.177 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.177 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.177 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.177 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.177 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.178 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "osd_perf_query", 2024-09-19T09:12:34.178 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:34.178 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:34.178 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:34.178 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:34.178 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:34.178 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.178 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.178 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.178 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.178 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.178 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.178 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.178 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.178 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.179 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.179 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.179 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.179 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.179 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.179 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.179 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.179 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.179 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.179 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.179 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:34.179 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:34.179 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.180 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.180 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.180 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.180 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.180 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.180 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.180 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.180 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.180 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.180 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.180 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.180 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:34.180 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:34.180 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.180 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.181 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.181 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:34.181 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.181 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.181 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.181 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.181 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.181 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.181 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.181 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.181 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.181 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.181 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.182 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.182 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.182 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.182 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.182 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:34.182 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:34.182 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.182 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.182 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.182 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.182 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.182 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.183 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.183 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.183 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.183 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.183 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.183 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.183 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.183 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.183 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.183 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "osd_support", 2024-09-19T09:12:34.183 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:34.183 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:34.183 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:34.183 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:34.184 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:34.184 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.184 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.184 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.184 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.184 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.184 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.184 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.184 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.184 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.184 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.184 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.185 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.185 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.185 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.185 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.185 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.185 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.185 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.185 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.185 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:34.185 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:34.185 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.185 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.185 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.186 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.186 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.186 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.186 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.186 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.186 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.186 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.186 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.186 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.186 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:34.186 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:34.186 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.186 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.187 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.187 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:34.187 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.187 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.187 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.187 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.187 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.187 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.187 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.187 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.187 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.187 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.187 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.188 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.188 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.188 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.188 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.188 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:34.188 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:34.188 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.188 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.188 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.188 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.188 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.188 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.188 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.189 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.189 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.189 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.189 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.189 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.189 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.189 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.189 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.189 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pg_autoscaler", 2024-09-19T09:12:34.189 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:34.189 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:34.189 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:34.190 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:34.190 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:34.190 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.190 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.190 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.190 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.190 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.190 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.190 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.190 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.190 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.190 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.190 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.191 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.191 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.191 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.191 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.191 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.191 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.191 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.191 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.191 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:34.191 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:34.191 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.191 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.191 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.191 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.192 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.192 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.192 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.192 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.192 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.192 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.192 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.192 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.192 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:34.192 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:34.192 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.192 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.192 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.192 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:34.193 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.193 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.193 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.193 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.193 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.193 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.193 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.193 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.193 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.193 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.193 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.193 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.193 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.194 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.194 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.194 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:34.194 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:34.194 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.194 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.194 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.194 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.194 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.194 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.194 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.194 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.194 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.195 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.195 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.195 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.195 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-19T09:12:34.195 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-19T09:12:34.195 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:34.195 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.195 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.195 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-19T09:12:34.195 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.195 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.195 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.195 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.195 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.196 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.196 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.196 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.196 INFO:teuthology.orchestra.run.smithi092.stdout: "threshold": { 2024-09-19T09:12:34.196 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "threshold", 2024-09-19T09:12:34.196 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-19T09:12:34.196 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.196 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.196 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3.0", 2024-09-19T09:12:34.196 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1.0", 2024-09-19T09:12:34.196 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.196 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.196 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "scaling threshold", 2024-09-19T09:12:34.197 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T09:12:34.197 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.197 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.197 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.197 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.197 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.197 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.197 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "progress", 2024-09-19T09:12:34.197 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:34.197 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:34.197 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:34.197 INFO:teuthology.orchestra.run.smithi092.stdout: "allow_pg_recovery_event": { 2024-09-19T09:12:34.197 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "allow_pg_recovery_event", 2024-09-19T09:12:34.198 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.198 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.198 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.198 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.198 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.198 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.198 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.198 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T09:12:34.198 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.198 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.198 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.198 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.198 INFO:teuthology.orchestra.run.smithi092.stdout: "enabled": { 2024-09-19T09:12:34.198 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enabled", 2024-09-19T09:12:34.199 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.199 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.199 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.199 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:34.199 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.199 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.199 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.199 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.199 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.199 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.199 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.199 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.199 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:34.199 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:34.200 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.200 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.200 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.200 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.200 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.200 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.200 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.200 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.200 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.200 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.200 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.200 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.201 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.201 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.201 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.201 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.201 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.201 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.201 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.201 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:34.201 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:34.201 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.201 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.201 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.201 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.201 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.202 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.202 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.202 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.202 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.202 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.202 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.202 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.202 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:34.202 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:34.202 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.202 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.202 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.202 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:34.203 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.203 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.203 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.203 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.203 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.203 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.203 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.203 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.203 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.203 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.203 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.203 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.203 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.204 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.204 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.204 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:34.204 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:34.204 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.204 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.204 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.204 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.204 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.204 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.204 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.204 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.204 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.205 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.205 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.205 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.205 INFO:teuthology.orchestra.run.smithi092.stdout: "max_completed_events": { 2024-09-19T09:12:34.205 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_completed_events", 2024-09-19T09:12:34.205 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:34.205 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.205 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.205 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "50", 2024-09-19T09:12:34.205 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.205 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.205 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.206 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "number of past completed events to remember", 2024-09-19T09:12:34.206 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.206 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.206 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.206 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.206 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-19T09:12:34.206 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-19T09:12:34.206 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:34.206 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.206 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.206 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-19T09:12:34.206 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.206 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.207 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.207 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how long the module is going to sleep", 2024-09-19T09:12:34.207 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.207 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.207 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.207 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.207 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.207 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.207 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.207 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "prometheus", 2024-09-19T09:12:34.207 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:34.207 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:34.207 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:34.208 INFO:teuthology.orchestra.run.smithi092.stdout: "cache": { 2024-09-19T09:12:34.208 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cache", 2024-09-19T09:12:34.208 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.208 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.208 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.208 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:34.208 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.208 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.208 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.208 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.208 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.208 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.208 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.209 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.209 INFO:teuthology.orchestra.run.smithi092.stdout: "exclude_perf_counters": { 2024-09-19T09:12:34.209 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "exclude_perf_counters", 2024-09-19T09:12:34.209 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.209 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.209 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.209 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:34.209 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.209 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.209 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.209 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T09:12:34.209 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T09:12:34.209 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.210 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.210 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.210 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:34.210 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:34.210 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.210 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.210 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.210 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.210 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.210 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.210 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.210 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.210 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.210 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.211 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.211 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.211 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.211 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.211 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.211 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.211 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.211 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.211 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.211 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:34.211 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:34.211 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.211 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.212 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.212 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.212 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.212 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.212 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.212 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.212 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.212 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.212 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.212 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.212 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:34.212 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:34.212 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.213 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.213 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.213 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:34.213 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.213 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.213 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.213 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.213 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.213 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.213 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.213 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.213 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.213 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.214 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.214 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.214 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.214 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.214 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.214 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:34.214 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:34.214 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.214 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.214 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.214 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.214 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.214 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.215 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.215 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.215 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.215 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.215 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.215 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.215 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_stats_pools": { 2024-09-19T09:12:34.215 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_stats_pools", 2024-09-19T09:12:34.215 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.215 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.215 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.215 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.215 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.215 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.216 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.216 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.216 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.216 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.216 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.216 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.216 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T09:12:34.216 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T09:12:34.216 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:34.216 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.216 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.216 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "300", 2024-09-19T09:12:34.216 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.216 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.217 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.217 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.217 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.217 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.217 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.217 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.217 INFO:teuthology.orchestra.run.smithi092.stdout: "scrape_interval": { 2024-09-19T09:12:34.217 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "scrape_interval", 2024-09-19T09:12:34.217 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-19T09:12:34.217 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.217 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.217 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "15.0", 2024-09-19T09:12:34.217 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.218 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.218 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.218 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.218 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.218 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.218 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.218 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.218 INFO:teuthology.orchestra.run.smithi092.stdout: "server_addr": { 2024-09-19T09:12:34.218 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_addr", 2024-09-19T09:12:34.218 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.218 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.218 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.218 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "::", 2024-09-19T09:12:34.219 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.219 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.219 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.219 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T09:12:34.219 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.219 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.219 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.219 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.219 INFO:teuthology.orchestra.run.smithi092.stdout: "server_port": { 2024-09-19T09:12:34.219 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_port", 2024-09-19T09:12:34.219 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:34.219 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.219 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.219 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "9283", 2024-09-19T09:12:34.220 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.220 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.220 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.220 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T09:12:34.220 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.220 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.220 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.220 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.220 INFO:teuthology.orchestra.run.smithi092.stdout: "stale_cache_strategy": { 2024-09-19T09:12:34.220 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "stale_cache_strategy", 2024-09-19T09:12:34.220 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.220 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.221 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.221 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "log", 2024-09-19T09:12:34.221 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.221 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.221 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.221 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.221 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.221 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.221 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.221 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.221 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_behaviour": { 2024-09-19T09:12:34.221 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_behaviour", 2024-09-19T09:12:34.221 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.222 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.222 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.222 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "default", 2024-09-19T09:12:34.222 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.222 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.222 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.222 INFO:teuthology.orchestra.run.smithi092.stdout: "default", 2024-09-19T09:12:34.222 INFO:teuthology.orchestra.run.smithi092.stdout: "error" 2024-09-19T09:12:34.222 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.222 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.222 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.222 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.223 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.223 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.223 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_error_status_code": { 2024-09-19T09:12:34.223 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_error_status_code", 2024-09-19T09:12:34.223 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:34.223 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.223 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.223 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "500", 2024-09-19T09:12:34.223 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "400", 2024-09-19T09:12:34.223 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "599", 2024-09-19T09:12:34.223 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.223 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.223 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.223 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.224 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.224 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.224 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.224 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.224 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.224 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_support", 2024-09-19T09:12:34.224 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:34.224 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:34.224 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:34.224 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:34.224 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:34.224 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.224 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.224 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.225 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.225 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.225 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.225 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.225 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.225 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.225 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.225 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.225 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.225 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.225 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.225 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.225 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.226 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.226 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.226 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.226 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:34.226 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:34.226 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.226 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.226 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.226 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.226 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.226 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.226 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.227 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.227 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.227 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.227 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.227 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.227 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:34.227 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:34.227 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.227 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.227 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.227 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:34.227 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.227 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.228 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.228 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.228 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.228 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.228 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.228 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.228 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.228 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.228 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.228 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.228 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.228 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.228 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.228 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:34.229 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:34.229 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.229 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.229 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.229 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.229 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.229 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.229 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.229 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.229 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.229 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.229 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.229 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.230 INFO:teuthology.orchestra.run.smithi092.stdout: "max_concurrent_snap_create": { 2024-09-19T09:12:34.230 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_concurrent_snap_create", 2024-09-19T09:12:34.230 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:34.230 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.230 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.230 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-19T09:12:34.230 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.230 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.230 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.230 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.230 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.230 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.230 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.231 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.231 INFO:teuthology.orchestra.run.smithi092.stdout: "mirror_snapshot_schedule": { 2024-09-19T09:12:34.231 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T09:12:34.231 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.231 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.231 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.231 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.231 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.231 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.231 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.231 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.231 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.231 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.232 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.232 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.232 INFO:teuthology.orchestra.run.smithi092.stdout: "trash_purge_schedule": { 2024-09-19T09:12:34.232 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "trash_purge_schedule", 2024-09-19T09:12:34.232 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.232 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.232 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.232 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.232 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.232 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.232 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.232 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.232 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.233 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.233 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.233 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.233 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.233 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.233 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.233 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "restful", 2024-09-19T09:12:34.233 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:34.233 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:34.233 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:34.233 INFO:teuthology.orchestra.run.smithi092.stdout: "enable_auth": { 2024-09-19T09:12:34.233 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enable_auth", 2024-09-19T09:12:34.233 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.233 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.234 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.234 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:34.234 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.234 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.234 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.234 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.234 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.234 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.234 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.234 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.234 INFO:teuthology.orchestra.run.smithi092.stdout: "key_file": { 2024-09-19T09:12:34.234 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "key_file", 2024-09-19T09:12:34.234 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.235 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.235 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.235 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.235 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.235 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.235 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.235 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.235 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.235 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.235 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.235 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.235 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:34.235 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:34.235 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.236 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.236 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.236 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.236 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.236 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.236 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.236 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.236 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.236 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.236 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.236 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.236 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.237 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.237 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.237 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.237 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.237 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.237 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.237 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:34.237 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:34.237 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.237 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.237 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.237 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.237 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.237 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.238 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.238 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.238 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.238 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.238 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.238 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.238 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:34.238 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:34.238 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.238 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.238 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.238 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:34.238 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.239 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.239 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.239 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.239 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.239 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.239 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.239 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.239 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.239 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.239 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.239 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.239 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.239 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.239 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.240 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:34.240 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:34.240 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.240 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.240 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.240 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.240 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.240 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.240 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.240 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.240 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.240 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.241 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.241 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.241 INFO:teuthology.orchestra.run.smithi092.stdout: "server_addr": { 2024-09-19T09:12:34.241 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_addr", 2024-09-19T09:12:34.241 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.241 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.241 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.241 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.241 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.241 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.241 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.241 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.241 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.242 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.242 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.242 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.242 INFO:teuthology.orchestra.run.smithi092.stdout: "server_port": { 2024-09-19T09:12:34.242 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_port", 2024-09-19T09:12:34.242 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.242 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.242 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.242 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.242 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.242 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.242 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.242 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.242 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.243 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.243 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.243 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.243 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.243 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.243 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.243 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rgw", 2024-09-19T09:12:34.243 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:34.243 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:34.243 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:34.243 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:34.243 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:34.243 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.244 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.244 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.244 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.244 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.244 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.244 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.244 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.244 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.244 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.244 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.244 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.244 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.244 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.245 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.245 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.245 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.245 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.245 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.245 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:34.245 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:34.245 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.245 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.245 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.245 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.245 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.245 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.246 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.246 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.246 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.246 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.246 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.246 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.246 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:34.246 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:34.246 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.246 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.246 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.246 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:34.246 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.247 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.247 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.247 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.247 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.247 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.247 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.247 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.247 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.247 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.247 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.247 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.247 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.247 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.247 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.248 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:34.248 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:34.248 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.248 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.248 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.248 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.248 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.248 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.248 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.248 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.248 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.248 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.249 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.249 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.249 INFO:teuthology.orchestra.run.smithi092.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T09:12:34.249 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T09:12:34.249 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:34.249 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.249 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.249 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-19T09:12:34.249 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.249 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.249 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.249 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T09:12:34.249 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.250 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.250 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.250 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.250 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.250 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.250 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.250 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rook", 2024-09-19T09:12:34.250 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:34.250 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:34.250 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:34.250 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:34.250 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:34.250 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.251 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.251 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.251 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.251 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.251 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.251 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.251 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.251 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.251 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.251 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.251 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.251 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.251 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.251 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.252 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.252 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.252 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.252 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.252 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:34.252 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:34.252 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.252 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.252 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.252 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.252 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.252 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.252 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.253 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.253 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.253 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.253 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.253 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.253 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:34.253 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:34.253 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.253 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.253 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.253 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:34.253 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.253 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.254 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.254 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.254 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.254 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.254 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.254 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.254 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.254 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.254 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.254 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.254 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.254 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.254 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.255 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:34.255 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:34.255 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.255 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.255 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.255 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.255 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.255 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.255 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.255 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.255 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.255 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.255 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.255 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.256 INFO:teuthology.orchestra.run.smithi092.stdout: "storage_class": { 2024-09-19T09:12:34.256 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "storage_class", 2024-09-19T09:12:34.256 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.256 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.256 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.256 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "local", 2024-09-19T09:12:34.256 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.256 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.256 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.256 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T09:12:34.256 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.256 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.257 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.257 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.257 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.257 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.257 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.257 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "selftest", 2024-09-19T09:12:34.257 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:34.257 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:34.257 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:34.257 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:34.257 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:34.257 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.257 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.257 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.258 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.258 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.258 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.258 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.258 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.258 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.258 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.258 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.258 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.258 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.258 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.258 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.258 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.259 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.259 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.259 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.259 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:34.259 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:34.259 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.259 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.259 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.259 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.259 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.259 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.259 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.260 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.260 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.260 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.260 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.260 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.260 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:34.260 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:34.260 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.260 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.260 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.260 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:34.260 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.260 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.261 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.261 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.261 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.261 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.261 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.261 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.261 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.261 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.261 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.261 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.261 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.261 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.261 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.262 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:34.262 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:34.262 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.262 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.262 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.262 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.262 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.262 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.262 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.262 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.262 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.262 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.262 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.263 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.263 INFO:teuthology.orchestra.run.smithi092.stdout: "roption1": { 2024-09-19T09:12:34.263 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "roption1", 2024-09-19T09:12:34.263 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.263 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.263 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.263 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.263 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.263 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.263 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.263 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.263 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.263 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.264 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.264 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.264 INFO:teuthology.orchestra.run.smithi092.stdout: "roption2": { 2024-09-19T09:12:34.264 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "roption2", 2024-09-19T09:12:34.264 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.264 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.264 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.264 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "xyz", 2024-09-19T09:12:34.264 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.264 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.264 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.264 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.264 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.265 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.265 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.265 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.265 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption1": { 2024-09-19T09:12:34.265 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption1", 2024-09-19T09:12:34.265 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.265 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.265 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.265 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.265 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.265 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.265 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.265 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.266 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.266 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.266 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.266 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.266 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption2": { 2024-09-19T09:12:34.266 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption2", 2024-09-19T09:12:34.266 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:34.266 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.266 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.266 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.266 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.266 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.266 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.266 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.267 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.267 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.267 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.267 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.267 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption3": { 2024-09-19T09:12:34.267 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption3", 2024-09-19T09:12:34.267 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-19T09:12:34.267 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.267 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.267 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.267 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.267 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.267 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.268 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.268 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.268 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.268 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.268 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.268 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption4": { 2024-09-19T09:12:34.268 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption4", 2024-09-19T09:12:34.268 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.268 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.268 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.268 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.268 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.268 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.269 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.269 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.269 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.269 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.269 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.269 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.269 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption5": { 2024-09-19T09:12:34.269 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption5", 2024-09-19T09:12:34.269 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.269 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.269 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.269 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.269 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.270 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.270 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.270 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.270 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.270 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.270 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.270 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.270 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption6": { 2024-09-19T09:12:34.270 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption6", 2024-09-19T09:12:34.270 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.270 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.270 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.271 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:34.271 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.271 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.271 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.271 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.271 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.271 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.271 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.271 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.271 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption7": { 2024-09-19T09:12:34.271 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption7", 2024-09-19T09:12:34.271 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:34.272 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.272 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.272 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.272 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2024-09-19T09:12:34.272 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "42", 2024-09-19T09:12:34.272 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.272 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.272 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.272 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.272 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.272 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.272 INFO:teuthology.orchestra.run.smithi092.stdout: "testkey": { 2024-09-19T09:12:34.273 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "testkey", 2024-09-19T09:12:34.273 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.273 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.273 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.273 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.273 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.273 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.273 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.273 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.273 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.273 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.273 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.273 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.274 INFO:teuthology.orchestra.run.smithi092.stdout: "testlkey": { 2024-09-19T09:12:34.274 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "testlkey", 2024-09-19T09:12:34.274 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.274 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.274 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.274 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.274 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.274 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.274 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.274 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.274 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.274 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.275 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.275 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.275 INFO:teuthology.orchestra.run.smithi092.stdout: "testnewline": { 2024-09-19T09:12:34.275 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "testnewline", 2024-09-19T09:12:34.275 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.275 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.275 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.275 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.275 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.275 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.275 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.275 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.275 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.275 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.276 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.276 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.276 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.276 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.276 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.276 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "snap_schedule", 2024-09-19T09:12:34.276 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:34.276 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:34.276 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:34.276 INFO:teuthology.orchestra.run.smithi092.stdout: "allow_m_granularity": { 2024-09-19T09:12:34.276 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "allow_m_granularity", 2024-09-19T09:12:34.276 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.277 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.277 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.277 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.277 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.277 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.277 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.277 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T09:12:34.277 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.277 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.277 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.277 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.277 INFO:teuthology.orchestra.run.smithi092.stdout: "dump_on_update": { 2024-09-19T09:12:34.277 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "dump_on_update", 2024-09-19T09:12:34.278 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.278 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.278 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.278 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.278 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.278 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.278 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.278 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "dump database to debug log on update", 2024-09-19T09:12:34.278 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.278 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.278 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.278 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.279 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:34.279 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:34.279 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.279 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.279 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.279 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.279 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.279 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.279 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.279 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.279 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.279 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.279 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.280 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.280 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.280 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.280 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.280 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.280 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.280 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.280 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.280 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:34.280 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:34.280 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.280 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.281 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.281 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.281 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.281 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.281 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.281 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.281 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.281 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.281 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.281 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.281 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:34.281 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:34.281 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.282 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.282 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.282 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:34.282 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.282 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.282 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.282 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.282 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.282 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.282 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.282 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.282 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.282 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.283 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.283 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.283 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.283 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.283 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.283 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:34.283 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:34.283 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.283 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.283 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.283 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.283 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.283 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.284 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.284 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.284 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.284 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.284 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.284 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.284 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.284 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.284 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.284 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "stats", 2024-09-19T09:12:34.284 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:34.284 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:34.285 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:34.285 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:34.285 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:34.285 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.285 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.285 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.285 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.285 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.285 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.285 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.285 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.285 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.285 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.286 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.286 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.286 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.286 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.286 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.286 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.286 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.286 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.286 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.286 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:34.286 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:34.286 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.287 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.287 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.287 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.287 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.287 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.287 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.287 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.287 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.287 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.287 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.287 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.287 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:34.287 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:34.288 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.288 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.288 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.288 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:34.288 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.288 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.288 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.288 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.288 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.288 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.288 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.288 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.289 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.289 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.289 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.289 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.289 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.289 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.289 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.289 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:34.289 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:34.289 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.289 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.289 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.289 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.290 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.290 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.290 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.290 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.290 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.290 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.290 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.290 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.290 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.290 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.290 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.290 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "status", 2024-09-19T09:12:34.290 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:34.290 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:34.291 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:34.291 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:34.291 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:34.291 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.291 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.291 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.291 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.291 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.291 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.291 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.291 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.291 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.291 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.291 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.291 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.292 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.292 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.292 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.292 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.292 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.292 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.292 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.292 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:34.292 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:34.292 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.292 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.292 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.292 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.293 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.293 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.293 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.293 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.293 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.293 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.293 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.293 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.293 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:34.293 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:34.293 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.293 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.293 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.294 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:34.294 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.294 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.294 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.294 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.294 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.294 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.294 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.294 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.294 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.294 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.294 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.294 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.295 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.295 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.295 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.295 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:34.295 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:34.295 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.295 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.295 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.295 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.295 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.295 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.295 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.295 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.296 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.296 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.296 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.296 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.296 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.296 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.296 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.296 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "telegraf", 2024-09-19T09:12:34.296 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:34.296 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:34.296 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:34.296 INFO:teuthology.orchestra.run.smithi092.stdout: "address": { 2024-09-19T09:12:34.297 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "address", 2024-09-19T09:12:34.297 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.297 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.297 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.297 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T09:12:34.297 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.297 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.297 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.297 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.297 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.297 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.297 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.297 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.298 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-19T09:12:34.298 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-19T09:12:34.298 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:34.298 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.298 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.298 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "15", 2024-09-19T09:12:34.298 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.298 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.298 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.298 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.298 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.298 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.298 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.299 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.299 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:34.299 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:34.299 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.299 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.299 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.299 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.299 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.299 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.299 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.299 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.299 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.299 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.299 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.300 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.300 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.300 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.300 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.300 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.300 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.300 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.300 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.300 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:34.300 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:34.300 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.300 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.300 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.301 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.301 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.301 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.301 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.301 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.301 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.301 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.301 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.301 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.301 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:34.301 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:34.301 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.301 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.302 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.302 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:34.302 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.302 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.302 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.302 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.302 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.302 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.302 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.302 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.302 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.302 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.302 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.303 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.303 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.303 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.303 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.303 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:34.303 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:34.303 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.303 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.303 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.303 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.303 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.303 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.304 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.304 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.304 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.304 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.304 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.304 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.304 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.304 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.304 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.304 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "telemetry", 2024-09-19T09:12:34.304 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:34.304 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:34.304 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:34.305 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_basic": { 2024-09-19T09:12:34.305 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_basic", 2024-09-19T09:12:34.305 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.305 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.305 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.305 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:34.305 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.305 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.305 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.305 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T09:12:34.305 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.305 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.306 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.306 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.306 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_crash": { 2024-09-19T09:12:34.306 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_crash", 2024-09-19T09:12:34.306 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.306 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.306 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.306 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:34.306 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.306 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.306 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.306 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T09:12:34.306 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.307 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.307 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.307 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.307 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_device": { 2024-09-19T09:12:34.307 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_device", 2024-09-19T09:12:34.307 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.307 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.307 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.307 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:34.307 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.307 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.307 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.307 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T09:12:34.308 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.308 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.308 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.308 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.308 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_ident": { 2024-09-19T09:12:34.308 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_ident", 2024-09-19T09:12:34.308 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.308 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.308 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.308 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.308 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.308 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.308 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.309 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T09:12:34.309 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.309 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.309 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.309 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.309 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_perf": { 2024-09-19T09:12:34.309 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_perf", 2024-09-19T09:12:34.309 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.309 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.309 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.309 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.309 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.309 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.310 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.310 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T09:12:34.310 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.310 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.310 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.310 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.310 INFO:teuthology.orchestra.run.smithi092.stdout: "contact": { 2024-09-19T09:12:34.310 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "contact", 2024-09-19T09:12:34.310 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.310 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.310 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.310 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.310 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.311 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.311 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.311 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.311 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.311 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.311 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.311 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.311 INFO:teuthology.orchestra.run.smithi092.stdout: "description": { 2024-09-19T09:12:34.311 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "description", 2024-09-19T09:12:34.311 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.311 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.311 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.311 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.312 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.312 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.312 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.312 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.312 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.312 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.312 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.312 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.312 INFO:teuthology.orchestra.run.smithi092.stdout: "device_url": { 2024-09-19T09:12:34.312 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "device_url", 2024-09-19T09:12:34.312 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.312 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.312 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.312 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T09:12:34.313 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.313 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.313 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.313 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.313 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.313 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.313 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.313 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.313 INFO:teuthology.orchestra.run.smithi092.stdout: "enabled": { 2024-09-19T09:12:34.313 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enabled", 2024-09-19T09:12:34.313 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.313 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.313 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.314 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.314 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.314 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.314 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.314 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.314 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.314 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.314 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.314 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.314 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-19T09:12:34.314 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-19T09:12:34.314 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:34.315 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.315 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.315 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "24", 2024-09-19T09:12:34.315 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "8", 2024-09-19T09:12:34.315 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.315 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.315 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.315 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.315 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.315 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.315 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.315 INFO:teuthology.orchestra.run.smithi092.stdout: "last_opt_revision": { 2024-09-19T09:12:34.315 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "last_opt_revision", 2024-09-19T09:12:34.316 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:34.316 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.316 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.316 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "1", 2024-09-19T09:12:34.316 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.316 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.316 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.316 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.316 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.316 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.316 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.316 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.316 INFO:teuthology.orchestra.run.smithi092.stdout: "leaderboard": { 2024-09-19T09:12:34.317 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "leaderboard", 2024-09-19T09:12:34.317 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.317 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.317 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.317 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.317 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.317 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.317 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.317 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.317 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.317 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.320 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.320 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.320 INFO:teuthology.orchestra.run.smithi092.stdout: "leaderboard_description": { 2024-09-19T09:12:34.320 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "leaderboard_description", 2024-09-19T09:12:34.320 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.321 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.321 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.321 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.321 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.321 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.321 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.321 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.321 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.321 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.321 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.321 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.321 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:34.321 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:34.322 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.322 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.322 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.322 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.322 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.322 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.322 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.322 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.322 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.322 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.322 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.322 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.323 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.323 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.323 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.323 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.323 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.323 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.323 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.323 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:34.323 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:34.323 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.323 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.323 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.323 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.324 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.324 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.324 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.324 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.324 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.324 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.324 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.324 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.324 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:34.324 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:34.324 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.324 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.324 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.324 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:34.325 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.325 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.325 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.325 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.325 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.325 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.325 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.325 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.325 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.325 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.325 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.325 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.325 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.325 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.326 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.326 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:34.326 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:34.326 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.326 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.326 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.326 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.326 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.326 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.326 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.326 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.326 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.326 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.326 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.327 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.327 INFO:teuthology.orchestra.run.smithi092.stdout: "organization": { 2024-09-19T09:12:34.327 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "organization", 2024-09-19T09:12:34.327 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.327 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.327 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.327 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.327 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.327 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.327 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.327 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.327 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.327 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.328 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.328 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.328 INFO:teuthology.orchestra.run.smithi092.stdout: "proxy": { 2024-09-19T09:12:34.328 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "proxy", 2024-09-19T09:12:34.328 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.328 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.328 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.328 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.328 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.328 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.328 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.328 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.328 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.329 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.329 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.329 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.329 INFO:teuthology.orchestra.run.smithi092.stdout: "url": { 2024-09-19T09:12:34.329 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "url", 2024-09-19T09:12:34.329 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.329 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.329 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.329 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T09:12:34.329 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.329 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.329 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.329 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.330 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.330 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.330 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.330 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.330 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.330 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.330 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.330 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "test_orchestrator", 2024-09-19T09:12:34.330 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:34.330 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:34.330 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:34.330 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:34.330 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:34.330 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.330 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.330 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.331 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.331 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.331 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.331 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.331 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.331 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.331 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.331 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.331 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.331 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.331 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.331 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.331 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.332 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.332 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.332 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.332 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:34.332 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:34.332 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.332 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.332 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.332 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.332 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.332 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.332 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.332 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.332 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.333 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.333 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.333 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.333 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:34.333 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:34.333 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.333 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.333 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.333 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:34.333 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.333 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.333 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.333 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.333 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.334 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.334 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.334 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.334 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.334 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.334 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.334 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.334 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.334 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.334 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.334 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:34.334 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:34.334 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.335 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.335 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.335 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.335 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.335 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.335 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.335 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.335 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.335 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.335 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.335 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.335 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.335 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.336 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.336 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "volumes", 2024-09-19T09:12:34.336 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:34.336 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:34.336 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:34.336 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:34.336 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:34.336 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.336 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.336 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.336 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.336 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.337 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.337 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.337 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.337 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.337 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.337 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.337 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.337 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.337 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.337 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.337 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.337 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.338 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.338 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.338 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:34.338 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:34.338 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.338 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.338 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.338 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.338 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.338 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.338 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.338 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.338 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.339 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.339 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.339 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.339 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:34.339 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:34.339 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.339 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.339 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.339 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:34.339 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.339 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.340 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.340 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.340 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.340 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.340 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.340 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.340 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.340 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.340 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.340 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.341 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.341 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.341 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.341 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:34.341 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:34.341 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.341 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.341 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.341 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.341 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.341 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.342 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.342 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.342 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.342 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.342 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.342 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.342 INFO:teuthology.orchestra.run.smithi092.stdout: "max_concurrent_clones": { 2024-09-19T09:12:34.342 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_concurrent_clones", 2024-09-19T09:12:34.342 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:34.342 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.343 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.343 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "4", 2024-09-19T09:12:34.343 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.343 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.343 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.343 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T09:12:34.343 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.343 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.343 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.344 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.344 INFO:teuthology.orchestra.run.smithi092.stdout: "periodic_async_work": { 2024-09-19T09:12:34.344 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "periodic_async_work", 2024-09-19T09:12:34.344 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.344 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.344 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.344 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.344 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.344 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.344 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.344 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Periodically check for async work", 2024-09-19T09:12:34.345 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.345 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.345 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.345 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.345 INFO:teuthology.orchestra.run.smithi092.stdout: "snapshot_clone_delay": { 2024-09-19T09:12:34.345 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "snapshot_clone_delay", 2024-09-19T09:12:34.345 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:34.345 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.345 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.345 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-19T09:12:34.345 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.345 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.346 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.346 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T09:12:34.346 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.346 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.346 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.346 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.346 INFO:teuthology.orchestra.run.smithi092.stdout: "snapshot_clone_no_wait": { 2024-09-19T09:12:34.346 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T09:12:34.346 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.346 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.346 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.347 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-19T09:12:34.347 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.347 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.347 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.347 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T09:12:34.347 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.347 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.347 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.347 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.347 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.347 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.347 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.347 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix", 2024-09-19T09:12:34.347 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-19T09:12:34.348 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-19T09:12:34.348 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-19T09:12:34.348 INFO:teuthology.orchestra.run.smithi092.stdout: "discovery_interval": { 2024-09-19T09:12:34.348 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "discovery_interval", 2024-09-19T09:12:34.348 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-19T09:12:34.348 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.348 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.348 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "100", 2024-09-19T09:12:34.348 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.348 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.348 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.348 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.349 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.349 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.349 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.349 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.349 INFO:teuthology.orchestra.run.smithi092.stdout: "identifier": { 2024-09-19T09:12:34.349 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "identifier", 2024-09-19T09:12:34.349 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.349 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.349 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.349 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.349 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.349 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.349 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.350 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.350 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.350 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.350 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.350 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.350 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-19T09:12:34.350 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-19T09:12:34.350 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-19T09:12:34.350 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.350 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.350 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-19T09:12:34.350 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.350 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.351 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.351 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.351 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.351 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.351 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.351 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.351 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-19T09:12:34.351 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-19T09:12:34.351 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.351 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.351 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.351 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.351 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.351 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.352 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.352 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.352 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.352 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.352 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.352 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.352 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.352 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.352 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.352 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.352 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.352 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.352 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.353 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-19T09:12:34.353 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-19T09:12:34.353 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.353 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.353 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.353 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.353 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.353 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.353 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.353 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.353 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.354 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.354 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.354 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.354 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-19T09:12:34.354 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-19T09:12:34.354 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.354 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.354 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.354 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-19T09:12:34.354 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.354 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.354 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-19T09:12:34.355 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-19T09:12:34.355 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-19T09:12:34.355 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-19T09:12:34.355 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-19T09:12:34.355 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-19T09:12:34.355 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-19T09:12:34.355 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.355 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.355 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.355 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.355 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.355 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.356 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-19T09:12:34.356 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-19T09:12:34.356 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-19T09:12:34.356 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.356 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-19T09:12:34.356 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-19T09:12:34.356 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.356 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.356 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.356 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.356 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.356 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.357 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.357 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.357 INFO:teuthology.orchestra.run.smithi092.stdout: "zabbix_host": { 2024-09-19T09:12:34.357 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix_host", 2024-09-19T09:12:34.357 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.357 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.357 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.357 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-19T09:12:34.357 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.357 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.357 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.357 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.357 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.357 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.358 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.358 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.358 INFO:teuthology.orchestra.run.smithi092.stdout: "zabbix_port": { 2024-09-19T09:12:34.358 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix_port", 2024-09-19T09:12:34.358 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-19T09:12:34.358 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.358 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.358 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10051", 2024-09-19T09:12:34.358 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.358 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.358 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.358 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.359 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.359 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.359 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.359 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.359 INFO:teuthology.orchestra.run.smithi092.stdout: "zabbix_sender": { 2024-09-19T09:12:34.359 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix_sender", 2024-09-19T09:12:34.359 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-19T09:12:34.359 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-19T09:12:34.359 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-19T09:12:34.359 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T09:12:34.359 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-19T09:12:34.359 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-19T09:12:34.359 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-19T09:12:34.360 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-19T09:12:34.360 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-19T09:12:34.360 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-19T09:12:34.360 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-19T09:12:34.360 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.360 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.360 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.360 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.360 INFO:teuthology.orchestra.run.smithi092.stdout: "services": { 2024-09-19T09:12:34.360 INFO:teuthology.orchestra.run.smithi092.stdout: "dashboard": "https://172.21.15.92:8443/" 2024-09-19T09:12:34.360 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.360 INFO:teuthology.orchestra.run.smithi092.stdout: "always_on_modules": { 2024-09-19T09:12:34.360 INFO:teuthology.orchestra.run.smithi092.stdout: "octopus": [ 2024-09-19T09:12:34.361 INFO:teuthology.orchestra.run.smithi092.stdout: "balancer", 2024-09-19T09:12:34.361 INFO:teuthology.orchestra.run.smithi092.stdout: "crash", 2024-09-19T09:12:34.361 INFO:teuthology.orchestra.run.smithi092.stdout: "devicehealth", 2024-09-19T09:12:34.361 INFO:teuthology.orchestra.run.smithi092.stdout: "orchestrator", 2024-09-19T09:12:34.361 INFO:teuthology.orchestra.run.smithi092.stdout: "pg_autoscaler", 2024-09-19T09:12:34.361 INFO:teuthology.orchestra.run.smithi092.stdout: "progress", 2024-09-19T09:12:34.361 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_support", 2024-09-19T09:12:34.361 INFO:teuthology.orchestra.run.smithi092.stdout: "status", 2024-09-19T09:12:34.361 INFO:teuthology.orchestra.run.smithi092.stdout: "telemetry", 2024-09-19T09:12:34.361 INFO:teuthology.orchestra.run.smithi092.stdout: "volumes" 2024-09-19T09:12:34.361 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.361 INFO:teuthology.orchestra.run.smithi092.stdout: "pacific": [ 2024-09-19T09:12:34.362 INFO:teuthology.orchestra.run.smithi092.stdout: "balancer", 2024-09-19T09:12:34.362 INFO:teuthology.orchestra.run.smithi092.stdout: "crash", 2024-09-19T09:12:34.362 INFO:teuthology.orchestra.run.smithi092.stdout: "devicehealth", 2024-09-19T09:12:34.362 INFO:teuthology.orchestra.run.smithi092.stdout: "orchestrator", 2024-09-19T09:12:34.362 INFO:teuthology.orchestra.run.smithi092.stdout: "pg_autoscaler", 2024-09-19T09:12:34.362 INFO:teuthology.orchestra.run.smithi092.stdout: "progress", 2024-09-19T09:12:34.362 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_support", 2024-09-19T09:12:34.362 INFO:teuthology.orchestra.run.smithi092.stdout: "status", 2024-09-19T09:12:34.362 INFO:teuthology.orchestra.run.smithi092.stdout: "telemetry", 2024-09-19T09:12:34.362 INFO:teuthology.orchestra.run.smithi092.stdout: "volumes" 2024-09-19T09:12:34.362 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.362 INFO:teuthology.orchestra.run.smithi092.stdout: "quincy": [ 2024-09-19T09:12:34.362 INFO:teuthology.orchestra.run.smithi092.stdout: "balancer", 2024-09-19T09:12:34.363 INFO:teuthology.orchestra.run.smithi092.stdout: "crash", 2024-09-19T09:12:34.363 INFO:teuthology.orchestra.run.smithi092.stdout: "devicehealth", 2024-09-19T09:12:34.363 INFO:teuthology.orchestra.run.smithi092.stdout: "orchestrator", 2024-09-19T09:12:34.363 INFO:teuthology.orchestra.run.smithi092.stdout: "pg_autoscaler", 2024-09-19T09:12:34.363 INFO:teuthology.orchestra.run.smithi092.stdout: "progress", 2024-09-19T09:12:34.363 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_support", 2024-09-19T09:12:34.363 INFO:teuthology.orchestra.run.smithi092.stdout: "status", 2024-09-19T09:12:34.363 INFO:teuthology.orchestra.run.smithi092.stdout: "telemetry", 2024-09-19T09:12:34.363 INFO:teuthology.orchestra.run.smithi092.stdout: "volumes" 2024-09-19T09:12:34.363 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.363 INFO:teuthology.orchestra.run.smithi092.stdout: "reef": [ 2024-09-19T09:12:34.363 INFO:teuthology.orchestra.run.smithi092.stdout: "balancer", 2024-09-19T09:12:34.363 INFO:teuthology.orchestra.run.smithi092.stdout: "crash", 2024-09-19T09:12:34.363 INFO:teuthology.orchestra.run.smithi092.stdout: "devicehealth", 2024-09-19T09:12:34.364 INFO:teuthology.orchestra.run.smithi092.stdout: "orchestrator", 2024-09-19T09:12:34.364 INFO:teuthology.orchestra.run.smithi092.stdout: "pg_autoscaler", 2024-09-19T09:12:34.364 INFO:teuthology.orchestra.run.smithi092.stdout: "progress", 2024-09-19T09:12:34.364 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_support", 2024-09-19T09:12:34.364 INFO:teuthology.orchestra.run.smithi092.stdout: "status", 2024-09-19T09:12:34.364 INFO:teuthology.orchestra.run.smithi092.stdout: "telemetry", 2024-09-19T09:12:34.364 INFO:teuthology.orchestra.run.smithi092.stdout: "volumes" 2024-09-19T09:12:34.364 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-19T09:12:34.364 INFO:teuthology.orchestra.run.smithi092.stdout: "squid": [ 2024-09-19T09:12:34.364 INFO:teuthology.orchestra.run.smithi092.stdout: "balancer", 2024-09-19T09:12:34.364 INFO:teuthology.orchestra.run.smithi092.stdout: "crash", 2024-09-19T09:12:34.364 INFO:teuthology.orchestra.run.smithi092.stdout: "devicehealth", 2024-09-19T09:12:34.364 INFO:teuthology.orchestra.run.smithi092.stdout: "orchestrator", 2024-09-19T09:12:34.365 INFO:teuthology.orchestra.run.smithi092.stdout: "pg_autoscaler", 2024-09-19T09:12:34.365 INFO:teuthology.orchestra.run.smithi092.stdout: "progress", 2024-09-19T09:12:34.365 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_support", 2024-09-19T09:12:34.365 INFO:teuthology.orchestra.run.smithi092.stdout: "status", 2024-09-19T09:12:34.365 INFO:teuthology.orchestra.run.smithi092.stdout: "telemetry", 2024-09-19T09:12:34.365 INFO:teuthology.orchestra.run.smithi092.stdout: "volumes" 2024-09-19T09:12:34.365 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-09-19T09:12:34.365 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.365 INFO:teuthology.orchestra.run.smithi092.stdout: "last_failure_osd_epoch": 3, 2024-09-19T09:12:34.365 INFO:teuthology.orchestra.run.smithi092.stdout: "active_clients": [ 2024-09-19T09:12:34.365 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.365 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "devicehealth", 2024-09-19T09:12:34.365 INFO:teuthology.orchestra.run.smithi092.stdout: "addrvec": [ 2024-09-19T09:12:34.366 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.366 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v2", 2024-09-19T09:12:34.366 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "172.21.15.92:0", 2024-09-19T09:12:34.366 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 2089892927 2024-09-19T09:12:34.366 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.366 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-09-19T09:12:34.366 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.366 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.366 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "libcephsqlite", 2024-09-19T09:12:34.366 INFO:teuthology.orchestra.run.smithi092.stdout: "addrvec": [ 2024-09-19T09:12:34.366 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.366 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v2", 2024-09-19T09:12:34.366 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "172.21.15.92:0", 2024-09-19T09:12:34.366 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 2618542029 2024-09-19T09:12:34.367 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.367 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-09-19T09:12:34.367 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.367 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.367 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_support", 2024-09-19T09:12:34.367 INFO:teuthology.orchestra.run.smithi092.stdout: "addrvec": [ 2024-09-19T09:12:34.367 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.367 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v2", 2024-09-19T09:12:34.367 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "172.21.15.92:0", 2024-09-19T09:12:34.367 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 1411683911 2024-09-19T09:12:34.367 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.367 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-09-19T09:12:34.367 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T09:12:34.368 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.368 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "volumes", 2024-09-19T09:12:34.368 INFO:teuthology.orchestra.run.smithi092.stdout: "addrvec": [ 2024-09-19T09:12:34.368 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-19T09:12:34.368 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v2", 2024-09-19T09:12:34.368 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "172.21.15.92:0", 2024-09-19T09:12:34.368 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 120855599 2024-09-19T09:12:34.368 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.368 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-09-19T09:12:34.368 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T09:12:34.368 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-09-19T09:12:34.368 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T09:12:34.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.974+0000 7f094fe96640 1 -- 172.21.15.92:0/4029267437 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f09340a3280 msgr2=0x7f09340a5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:34.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.974+0000 7f094fe96640 1 --2- 172.21.15.92:0/4029267437 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f09340a3280 0x7f09340a5740 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f0948101a80 tx=0x7f0944005ed0 comp rx=0 tx=0).stop 2024-09-19T09:12:34.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.974+0000 7f094fe96640 1 -- 172.21.15.92:0/4029267437 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09481025e0 msgr2=0x7f09481a1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:34.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.974+0000 7f094fe96640 1 --2- 172.21.15.92:0/4029267437 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09481025e0 0x7f09481a1480 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f0940005e30 tx=0x7f0940031ee0 comp rx=0 tx=0).stop 2024-09-19T09:12:34.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.974+0000 7f094fe96640 1 -- 172.21.15.92:0/4029267437 shutdown_connections 2024-09-19T09:12:34.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.974+0000 7f094fe96640 1 --2- 172.21.15.92:0/4029267437 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f09340a3280 0x7f09340a5740 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:34.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.974+0000 7f094fe96640 1 --2- 172.21.15.92:0/4029267437 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09481025e0 0x7f09481a1480 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:34.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.974+0000 7f094fe96640 1 --2- 172.21.15.92:0/4029267437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0948101c20 0x7f094819ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:34.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.974+0000 7f094fe96640 1 --2- 172.21.15.92:0/4029267437 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0948100a30 0x7f094806af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:34.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.974+0000 7f094fe96640 1 -- 172.21.15.92:0/4029267437 >> 172.21.15.92:0/4029267437 conn(0x7f09480fc1b0 msgr2=0x7f0948104fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:34.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.974+0000 7f094fe96640 1 -- 172.21.15.92:0/4029267437 shutdown_connections 2024-09-19T09:12:34.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:32.974+0000 7f094fe96640 1 -- 172.21.15.92:0/4029267437 wait complete. 2024-09-19T09:12:34.371 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:32 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/105140918' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:12:34.371 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:32 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1221979545' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:12:34.371 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:32 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3673662774' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:12:34.371 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:32 smithi092 ceph-mon[31407]: pgmap v812: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 3.1 KiB/s wr, 3 op/s 2024-09-19T09:12:34.371 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:32 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/105140918' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:12:34.372 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:32 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/1221979545' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:12:34.372 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:32 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3673662774' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:12:34.372 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:32 smithi190 ceph-mon[35358]: pgmap v812: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 3.1 KiB/s wr, 3 op/s 2024-09-19T09:12:34.372 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:33 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/4029267437' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T09:12:34.372 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:32 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/105140918' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:12:34.372 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:32 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/1221979545' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:12:34.372 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:32 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3673662774' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:12:34.372 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:32 smithi167 ceph-mon[35359]: pgmap v812: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 3.1 KiB/s wr, 3 op/s 2024-09-19T09:12:34.372 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:33 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/4029267437' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T09:12:34.379 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-19T09:12:34.391 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-19T09:12:34.391 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-19T09:12:34.391 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:12:34.391 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:33 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/4029267437' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T09:12:34.411 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-19T09:12:34.411 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:12:34.472 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T09:12:34.770 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:12:35.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:34 smithi167 ceph-mon[35359]: pgmap v813: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.9 KiB/s wr, 3 op/s 2024-09-19T09:12:35.120 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:34 smithi092 ceph-mon[31407]: pgmap v813: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.9 KiB/s wr, 3 op/s 2024-09-19T09:12:35.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:34 smithi190 ceph-mon[35358]: pgmap v813: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.9 KiB/s wr, 3 op/s 2024-09-19T09:12:35.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.200+0000 7f8a97dea640 1 -- 172.21.15.92:0/1412015744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a90101de0 msgr2=0x7f8a901021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:35.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.200+0000 7f8a97dea640 1 --2- 172.21.15.92:0/1412015744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a90101de0 0x7f8a901021c0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c009900 tx=0x7f8a8c02a410 comp rx=0 tx=0).stop 2024-09-19T09:12:35.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.200+0000 7f8a97dea640 1 -- 172.21.15.92:0/1412015744 shutdown_connections 2024-09-19T09:12:35.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.200+0000 7f8a97dea640 1 --2- 172.21.15.92:0/1412015744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a90106f10 0x7f8a9010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:35.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.200+0000 7f8a97dea640 1 --2- 172.21.15.92:0/1412015744 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a90102790 0x7f8a901067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:35.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.200+0000 7f8a97dea640 1 --2- 172.21.15.92:0/1412015744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a90101de0 0x7f8a901021c0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:35.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.200+0000 7f8a97dea640 1 -- 172.21.15.92:0/1412015744 >> 172.21.15.92:0/1412015744 conn(0x7f8a900fd8c0 msgr2=0x7f8a900ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:35.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.200+0000 7f8a97dea640 1 -- 172.21.15.92:0/1412015744 shutdown_connections 2024-09-19T09:12:35.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.200+0000 7f8a97dea640 1 -- 172.21.15.92:0/1412015744 wait complete. 2024-09-19T09:12:35.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.200+0000 7f8a97dea640 1 Processor -- start 2024-09-19T09:12:35.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.201+0000 7f8a97dea640 1 -- start start 2024-09-19T09:12:35.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.201+0000 7f8a97dea640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a90101de0 0x7f8a900744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:35.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.201+0000 7f8a97dea640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a90102790 0x7f8a90074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:35.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.201+0000 7f8a97dea640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a90106f10 0x7f8a90074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:35.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.201+0000 7f8a97dea640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8a90111f70 con 0x7f8a90101de0 2024-09-19T09:12:35.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.201+0000 7f8a97dea640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8a90111df0 con 0x7f8a90102790 2024-09-19T09:12:35.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.201+0000 7f8a97dea640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8a901120f0 con 0x7f8a90106f10 2024-09-19T09:12:35.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.201+0000 7f8a95b86640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a90101de0 0x7f8a900744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:35.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.201+0000 7f8a95b86640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a90101de0 0x7f8a900744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52232/0 (socket says 172.21.15.92:52232) 2024-09-19T09:12:35.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.201+0000 7f8a95b86640 1 -- 172.21.15.92:0/1885321018 learned_addr learned my addr 172.21.15.92:0/1885321018 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:35.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.201+0000 7f8a95b86640 1 -- 172.21.15.92:0/1885321018 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a90106f10 msgr2=0x7f8a90074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:35.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.201+0000 7f8a96387640 1 --2- 172.21.15.92:0/1885321018 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a90106f10 0x7f8a90074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:35.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.201+0000 7f8a95385640 1 --2- 172.21.15.92:0/1885321018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a90102790 0x7f8a90074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:35.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.201+0000 7f8a95b86640 1 --2- 172.21.15.92:0/1885321018 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a90106f10 0x7f8a90074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:35.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.201+0000 7f8a95b86640 1 -- 172.21.15.92:0/1885321018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a90102790 msgr2=0x7f8a90074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:35.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.201+0000 7f8a95b86640 1 --2- 172.21.15.92:0/1885321018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a90102790 0x7f8a90074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:35.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.201+0000 7f8a95b86640 1 -- 172.21.15.92:0/1885321018 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a901a6930 con 0x7f8a90101de0 2024-09-19T09:12:35.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.201+0000 7f8a96387640 1 --2- 172.21.15.92:0/1885321018 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a90106f10 0x7f8a90074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:12:35.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.201+0000 7f8a95385640 1 --2- 172.21.15.92:0/1885321018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a90102790 0x7f8a90074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:12:35.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.201+0000 7f8a95b86640 1 --2- 172.21.15.92:0/1885321018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a90101de0 0x7f8a900744f0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c006010 tx=0x7f8a8c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:35.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.201+0000 7f8a86ffd640 1 -- 172.21.15.92:0/1885321018 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c03f030 con 0x7f8a90101de0 2024-09-19T09:12:35.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.202+0000 7f8a86ffd640 1 -- 172.21.15.92:0/1885321018 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a8c003ce0 con 0x7f8a90101de0 2024-09-19T09:12:35.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.202+0000 7f8a97dea640 1 -- 172.21.15.92:0/1885321018 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a901a6bc0 con 0x7f8a90101de0 2024-09-19T09:12:35.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.202+0000 7f8a86ffd640 1 -- 172.21.15.92:0/1885321018 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c035070 con 0x7f8a90101de0 2024-09-19T09:12:35.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.202+0000 7f8a97dea640 1 -- 172.21.15.92:0/1885321018 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a901a70a0 con 0x7f8a90101de0 2024-09-19T09:12:35.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.203+0000 7f8a97dea640 1 -- 172.21.15.92:0/1885321018 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a901021c0 con 0x7f8a90101de0 2024-09-19T09:12:35.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.204+0000 7f8a86ffd640 1 -- 172.21.15.92:0/1885321018 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8a8c042030 con 0x7f8a90101de0 2024-09-19T09:12:35.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.204+0000 7f8a86ffd640 1 --2- 172.21.15.92:0/1885321018 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8a7c0a3240 0x7f8a7c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:35.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.204+0000 7f8a95385640 1 --2- 172.21.15.92:0/1885321018 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8a7c0a3240 0x7f8a7c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:35.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.204+0000 7f8a86ffd640 1 -- 172.21.15.92:0/1885321018 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f8a8c0efed0 con 0x7f8a90101de0 2024-09-19T09:12:35.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.205+0000 7f8a95385640 1 --2- 172.21.15.92:0/1885321018 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8a7c0a3240 0x7f8a7c0a5700 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f8a90075f80 tx=0x7f8a80005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:35.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.208+0000 7f8a86ffd640 1 -- 172.21.15.92:0/1885321018 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8a8c0bccb0 con 0x7f8a90101de0 2024-09-19T09:12:35.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.385+0000 7f8a97dea640 1 -- 172.21.15.92:0/1885321018 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8a90109b60 con 0x7f8a90101de0 2024-09-19T09:12:35.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.385+0000 7f8a86ffd640 1 -- 172.21.15.92:0/1885321018 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v82) ==== 81+0+590 (secure 0 0 0) 0x7f8a8c0bc5b0 con 0x7f8a90101de0 2024-09-19T09:12:35.386 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/2948821221 2024-09-20T08:47:52.180093+0000 2024-09-19T09:12:35.387 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/1441365956 2024-09-20T08:47:52.180093+0000 2024-09-19T09:12:35.387 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:6801/2908709470 2024-09-20T08:47:52.180093+0000 2024-09-19T09:12:35.387 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/608374871 2024-09-20T08:47:52.180093+0000 2024-09-19T09:12:35.387 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:6801/1369295034 2024-09-20T08:47:29.812397+0000 2024-09-19T09:12:35.387 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:6800/2908709470 2024-09-20T08:47:52.180093+0000 2024-09-19T09:12:35.387 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:6800/1369295034 2024-09-20T08:47:29.812397+0000 2024-09-19T09:12:35.387 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/813486656 2024-09-20T08:47:29.812397+0000 2024-09-19T09:12:35.387 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/1963725565 2024-09-20T08:47:29.812397+0000 2024-09-19T09:12:35.387 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/1668504617 2024-09-20T08:47:29.812397+0000 2024-09-19T09:12:35.387 INFO:teuthology.orchestra.run.smithi092.stderr:listed 10 entries 2024-09-19T09:12:35.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.388+0000 7f8a97dea640 1 -- 172.21.15.92:0/1885321018 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8a7c0a3240 msgr2=0x7f8a7c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:35.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.388+0000 7f8a97dea640 1 --2- 172.21.15.92:0/1885321018 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8a7c0a3240 0x7f8a7c0a5700 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f8a90075f80 tx=0x7f8a80005d30 comp rx=0 tx=0).stop 2024-09-19T09:12:35.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.388+0000 7f8a97dea640 1 -- 172.21.15.92:0/1885321018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a90101de0 msgr2=0x7f8a900744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:35.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.388+0000 7f8a97dea640 1 --2- 172.21.15.92:0/1885321018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a90101de0 0x7f8a900744f0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c006010 tx=0x7f8a8c0042f0 comp rx=0 tx=0).stop 2024-09-19T09:12:35.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.388+0000 7f8a97dea640 1 -- 172.21.15.92:0/1885321018 shutdown_connections 2024-09-19T09:12:35.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.388+0000 7f8a97dea640 1 --2- 172.21.15.92:0/1885321018 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a90106f10 0x7f8a90074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:35.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.388+0000 7f8a97dea640 1 --2- 172.21.15.92:0/1885321018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a90102790 0x7f8a90074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:35.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.388+0000 7f8a97dea640 1 --2- 172.21.15.92:0/1885321018 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f8a7c0a3240 0x7f8a7c0a5700 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:35.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.388+0000 7f8a97dea640 1 --2- 172.21.15.92:0/1885321018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a90101de0 0x7f8a900744f0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:35.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.388+0000 7f8a97dea640 1 -- 172.21.15.92:0/1885321018 >> 172.21.15.92:0/1885321018 conn(0x7f8a900fd8c0 msgr2=0x7f8a900fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:35.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.388+0000 7f8a97dea640 1 -- 172.21.15.92:0/1885321018 shutdown_connections 2024-09-19T09:12:35.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:35.388+0000 7f8a97dea640 1 -- 172.21.15.92:0/1885321018 wait complete. 2024-09-19T09:12:36.069 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:35 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/1885321018' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:12:36.070 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-19T09:12:36.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:12:36.070 DEBUG:teuthology.orchestra.run.smithi092:> sudo umount /tmp/cephfs 2024-09-19T09:12:36.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:35 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/1885321018' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:12:36.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:35 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/1885321018' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:12:36.242 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi092.front.sepia.ceph.com 2024-09-19T09:12:36.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:12:36.242 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest && exec rmdir -- /tmp/cephfs) 2024-09-19T09:12:36.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:12:36.293 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2024-09-19T09:12:36.339 INFO:teuthology.orchestra.run.smithi092.stdout:ceph-ns--tmp-cephfs (id: 0) 2024-09-19T09:12:36.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:12:36.339 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns delete ceph-ns--tmp-cephfs 2024-09-19T09:12:36.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:12:36.407 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link delete ceph-brx 2024-09-19T09:12:36.513 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-19T09:12:36.523 INFO:tasks.cephadm:Teardown begin 2024-09-19T09:12:36.524 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T09:12:36.524 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:12:36.773 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:12:37.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:36 smithi167 ceph-mon[35359]: pgmap v814: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 21 KiB/s wr, 2 op/s 2024-09-19T09:12:37.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:36 smithi190 ceph-mon[35358]: pgmap v814: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 21 KiB/s wr, 2 op/s 2024-09-19T09:12:37.147 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:36 smithi092 ceph-mon[31407]: pgmap v814: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 21 KiB/s wr, 2 op/s 2024-09-19T09:12:37.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.227+0000 7fa9ddf0a640 1 -- 172.21.15.92:0/149295543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9d8101de0 msgr2=0x7fa9d81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:37.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.227+0000 7fa9ddf0a640 1 --2- 172.21.15.92:0/149295543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9d8101de0 0x7fa9d81021c0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8009900 tx=0x7fa9c802a410 comp rx=0 tx=0).stop 2024-09-19T09:12:37.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.227+0000 7fa9ddf0a640 1 -- 172.21.15.92:0/149295543 shutdown_connections 2024-09-19T09:12:37.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.227+0000 7fa9ddf0a640 1 --2- 172.21.15.92:0/149295543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9d8106f10 0x7fa9d810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:37.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.227+0000 7fa9ddf0a640 1 --2- 172.21.15.92:0/149295543 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9d8102790 0x7fa9d81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:37.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.227+0000 7fa9ddf0a640 1 --2- 172.21.15.92:0/149295543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9d8101de0 0x7fa9d81021c0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:37.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.227+0000 7fa9ddf0a640 1 -- 172.21.15.92:0/149295543 >> 172.21.15.92:0/149295543 conn(0x7fa9d80fd8c0 msgr2=0x7fa9d80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:37.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.227+0000 7fa9ddf0a640 1 -- 172.21.15.92:0/149295543 shutdown_connections 2024-09-19T09:12:37.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.228+0000 7fa9ddf0a640 1 -- 172.21.15.92:0/149295543 wait complete. 2024-09-19T09:12:37.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.228+0000 7fa9ddf0a640 1 Processor -- start 2024-09-19T09:12:37.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.228+0000 7fa9ddf0a640 1 -- start start 2024-09-19T09:12:37.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.228+0000 7fa9ddf0a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9d8101de0 0x7fa9d8198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:37.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.228+0000 7fa9ddf0a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9d8102790 0x7fa9d8198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:37.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.228+0000 7fa9ddf0a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9d8106f10 0x7fa9d819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:37.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.228+0000 7fa9ddf0a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d8111f70 con 0x7fa9d8102790 2024-09-19T09:12:37.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.228+0000 7fa9ddf0a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d8111df0 con 0x7fa9d8101de0 2024-09-19T09:12:37.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.228+0000 7fa9ddf0a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d81120f0 con 0x7fa9d8106f10 2024-09-19T09:12:37.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.229+0000 7fa9cffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9d8102790 0x7fa9d8198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:37.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.229+0000 7fa9cffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9d8102790 0x7fa9d8198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52254/0 (socket says 172.21.15.92:52254) 2024-09-19T09:12:37.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.229+0000 7fa9cffff640 1 -- 172.21.15.92:0/2775242359 learned_addr learned my addr 172.21.15.92:0/2775242359 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:37.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.229+0000 7fa9d7fff640 1 --2- 172.21.15.92:0/2775242359 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9d8106f10 0x7fa9d819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:37.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.229+0000 7fa9d77fe640 1 --2- 172.21.15.92:0/2775242359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9d8101de0 0x7fa9d8198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:37.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.229+0000 7fa9cffff640 1 -- 172.21.15.92:0/2775242359 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9d8106f10 msgr2=0x7fa9d819cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:37.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.229+0000 7fa9cffff640 1 --2- 172.21.15.92:0/2775242359 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9d8106f10 0x7fa9d819cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:37.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.229+0000 7fa9cffff640 1 -- 172.21.15.92:0/2775242359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9d8101de0 msgr2=0x7fa9d8198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:37.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.229+0000 7fa9cffff640 1 --2- 172.21.15.92:0/2775242359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9d8101de0 0x7fa9d8198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:37.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.229+0000 7fa9cffff640 1 -- 172.21.15.92:0/2775242359 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9d819d400 con 0x7fa9d8102790 2024-09-19T09:12:37.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.229+0000 7fa9d77fe640 1 --2- 172.21.15.92:0/2775242359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9d8101de0 0x7fa9d8198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:12:37.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.229+0000 7fa9cffff640 1 --2- 172.21.15.92:0/2775242359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9d8102790 0x7fa9d8198990 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fa9c000d950 tx=0x7fa9c000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:37.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.229+0000 7fa9d57fa640 1 -- 172.21.15.92:0/2775242359 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c0017070 con 0x7fa9d8102790 2024-09-19T09:12:37.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.229+0000 7fa9d57fa640 1 -- 172.21.15.92:0/2775242359 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9c0009c30 con 0x7fa9d8102790 2024-09-19T09:12:37.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.229+0000 7fa9d57fa640 1 -- 172.21.15.92:0/2775242359 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c000f6b0 con 0x7fa9d8102790 2024-09-19T09:12:37.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.229+0000 7fa9ddf0a640 1 -- 172.21.15.92:0/2775242359 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9d819d6f0 con 0x7fa9d8102790 2024-09-19T09:12:37.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.229+0000 7fa9ddf0a640 1 -- 172.21.15.92:0/2775242359 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9d81a4fd0 con 0x7fa9d8102790 2024-09-19T09:12:37.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.230+0000 7fa9ddf0a640 1 -- 172.21.15.92:0/2775242359 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9d81021c0 con 0x7fa9d8102790 2024-09-19T09:12:37.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.231+0000 7fa9d57fa640 1 -- 172.21.15.92:0/2775242359 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa9c00109d0 con 0x7fa9d8102790 2024-09-19T09:12:37.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.232+0000 7fa9d57fa640 1 --2- 172.21.15.92:0/2775242359 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa9c40a3240 0x7fa9c40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:37.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.232+0000 7fa9d77fe640 1 --2- 172.21.15.92:0/2775242359 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa9c40a3240 0x7fa9c40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:37.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.232+0000 7fa9d57fa640 1 -- 172.21.15.92:0/2775242359 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fa9c00cf650 con 0x7fa9d8102790 2024-09-19T09:12:37.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.233+0000 7fa9d77fe640 1 --2- 172.21.15.92:0/2775242359 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa9c40a3240 0x7fa9c40a5700 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8005ab0 tx=0x7fa9c8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:37.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.236+0000 7fa9d57fa640 1 -- 172.21.15.92:0/2775242359 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa9c0009de0 con 0x7fa9d8102790 2024-09-19T09:12:37.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.442+0000 7fa9ddf0a640 1 -- 172.21.15.92:0/2775242359 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa9d810a150 con 0x7fa9d8102790 2024-09-19T09:12:37.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.443+0000 7fa9d57fa640 1 -- 172.21.15.92:0/2775242359 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7fa9c009c370 con 0x7fa9d8102790 2024-09-19T09:12:37.444 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:12:37.444 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:12:37.444 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:12:37.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.445+0000 7fa9ddf0a640 1 -- 172.21.15.92:0/2775242359 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa9c40a3240 msgr2=0x7fa9c40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:37.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.445+0000 7fa9ddf0a640 1 --2- 172.21.15.92:0/2775242359 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa9c40a3240 0x7fa9c40a5700 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8005ab0 tx=0x7fa9c8005a20 comp rx=0 tx=0).stop 2024-09-19T09:12:37.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.445+0000 7fa9ddf0a640 1 -- 172.21.15.92:0/2775242359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9d8102790 msgr2=0x7fa9d8198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:37.446 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.445+0000 7fa9ddf0a640 1 --2- 172.21.15.92:0/2775242359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9d8102790 0x7fa9d8198990 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fa9c000d950 tx=0x7fa9c000de10 comp rx=0 tx=0).stop 2024-09-19T09:12:37.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.446+0000 7fa9ddf0a640 1 -- 172.21.15.92:0/2775242359 shutdown_connections 2024-09-19T09:12:37.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.446+0000 7fa9ddf0a640 1 --2- 172.21.15.92:0/2775242359 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa9d8106f10 0x7fa9d819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:37.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.446+0000 7fa9ddf0a640 1 --2- 172.21.15.92:0/2775242359 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fa9c40a3240 0x7fa9c40a5700 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:37.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.446+0000 7fa9ddf0a640 1 --2- 172.21.15.92:0/2775242359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9d8102790 0x7fa9d8198990 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:37.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.446+0000 7fa9ddf0a640 1 --2- 172.21.15.92:0/2775242359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9d8101de0 0x7fa9d8198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:37.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.446+0000 7fa9ddf0a640 1 -- 172.21.15.92:0/2775242359 >> 172.21.15.92:0/2775242359 conn(0x7fa9d80fd8c0 msgr2=0x7fa9d80fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:37.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.446+0000 7fa9ddf0a640 1 -- 172.21.15.92:0/2775242359 shutdown_connections 2024-09-19T09:12:37.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:37.446+0000 7fa9ddf0a640 1 -- 172.21.15.92:0/2775242359 wait complete. 2024-09-19T09:12:38.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:37 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/2775242359' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:12:38.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:37 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/2775242359' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:12:38.177 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:37 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/2775242359' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:12:38.206 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:12:38.462 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:12:38.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.881+0000 7f6973bf7640 1 -- 172.21.15.92:0/1072795810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f696c102d40 msgr2=0x7f696c103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:38.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.881+0000 7f6973bf7640 1 --2- 172.21.15.92:0/1072795810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f696c102d40 0x7f696c103120 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f6968009900 tx=0x7f696802a480 comp rx=0 tx=0).stop 2024-09-19T09:12:38.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.881+0000 7f6973bf7640 1 -- 172.21.15.92:0/1072795810 shutdown_connections 2024-09-19T09:12:38.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.881+0000 7f6973bf7640 1 --2- 172.21.15.92:0/1072795810 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f696c10c170 0x7f696c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:38.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.881+0000 7f6973bf7640 1 --2- 172.21.15.92:0/1072795810 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f696c103660 0x7f696c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:38.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.881+0000 7f6973bf7640 1 --2- 172.21.15.92:0/1072795810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f696c102d40 0x7f696c103120 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:38.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.881+0000 7f6973bf7640 1 -- 172.21.15.92:0/1072795810 >> 172.21.15.92:0/1072795810 conn(0x7f696c0fc7a0 msgr2=0x7f696c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:38.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.881+0000 7f6973bf7640 1 -- 172.21.15.92:0/1072795810 shutdown_connections 2024-09-19T09:12:38.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.881+0000 7f6973bf7640 1 -- 172.21.15.92:0/1072795810 wait complete. 2024-09-19T09:12:38.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.881+0000 7f6973bf7640 1 Processor -- start 2024-09-19T09:12:38.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.881+0000 7f6973bf7640 1 -- start start 2024-09-19T09:12:38.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.882+0000 7f6973bf7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f696c102d40 0x7f696c1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:38.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.882+0000 7f6973bf7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f696c103660 0x7f696c100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:38.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.882+0000 7f6973bf7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f696c10c170 0x7f696c101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:38.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.882+0000 7f6973bf7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f696c111fb0 con 0x7f696c103660 2024-09-19T09:12:38.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.882+0000 7f6973bf7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f696c111e30 con 0x7f696c102d40 2024-09-19T09:12:38.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.882+0000 7f6973bf7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f696c112130 con 0x7f696c10c170 2024-09-19T09:12:38.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.882+0000 7f6971192640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f696c103660 0x7f696c100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:38.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.882+0000 7f6971192640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f696c103660 0x7f696c100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52284/0 (socket says 172.21.15.92:52284) 2024-09-19T09:12:38.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.882+0000 7f6971192640 1 -- 172.21.15.92:0/854087929 learned_addr learned my addr 172.21.15.92:0/854087929 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:38.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.882+0000 7f6972194640 1 --2- 172.21.15.92:0/854087929 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f696c10c170 0x7f696c101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:38.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.882+0000 7f6971993640 1 --2- 172.21.15.92:0/854087929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f696c102d40 0x7f696c1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:38.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.882+0000 7f6971192640 1 -- 172.21.15.92:0/854087929 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f696c10c170 msgr2=0x7f696c101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:38.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.882+0000 7f6971192640 1 --2- 172.21.15.92:0/854087929 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f696c10c170 0x7f696c101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:38.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.882+0000 7f6971192640 1 -- 172.21.15.92:0/854087929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f696c102d40 msgr2=0x7f696c1009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:38.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.882+0000 7f6971192640 1 --2- 172.21.15.92:0/854087929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f696c102d40 0x7f696c1009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:38.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.882+0000 7f6971192640 1 -- 172.21.15.92:0/854087929 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f696c1a6910 con 0x7f696c103660 2024-09-19T09:12:38.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.882+0000 7f6972194640 1 --2- 172.21.15.92:0/854087929 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f696c10c170 0x7f696c101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:12:38.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.882+0000 7f6971993640 1 --2- 172.21.15.92:0/854087929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f696c102d40 0x7f696c1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:12:38.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.882+0000 7f6971192640 1 --2- 172.21.15.92:0/854087929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f696c103660 0x7f696c100ee0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f695c00b3f0 tx=0x7f695c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:38.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.882+0000 7f6962ffd640 1 -- 172.21.15.92:0/854087929 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f695c015020 con 0x7f696c103660 2024-09-19T09:12:38.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.882+0000 7f6973bf7640 1 -- 172.21.15.92:0/854087929 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f696c1a6c00 con 0x7f696c103660 2024-09-19T09:12:38.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.882+0000 7f6962ffd640 1 -- 172.21.15.92:0/854087929 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f695c011d10 con 0x7f696c103660 2024-09-19T09:12:38.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.882+0000 7f6962ffd640 1 -- 172.21.15.92:0/854087929 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f695c00f2e0 con 0x7f696c103660 2024-09-19T09:12:38.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.883+0000 7f6973bf7640 1 -- 172.21.15.92:0/854087929 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f696c1a7190 con 0x7f696c103660 2024-09-19T09:12:38.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.884+0000 7f6973bf7640 1 -- 172.21.15.92:0/854087929 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f696c103120 con 0x7f696c103660 2024-09-19T09:12:38.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.885+0000 7f6962ffd640 1 -- 172.21.15.92:0/854087929 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f695c018020 con 0x7f696c103660 2024-09-19T09:12:38.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.885+0000 7f6962ffd640 1 --2- 172.21.15.92:0/854087929 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f69580a3240 0x7f69580a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:38.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.886+0000 7f6971993640 1 --2- 172.21.15.92:0/854087929 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f69580a3240 0x7f69580a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:38.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.886+0000 7f6962ffd640 1 -- 172.21.15.92:0/854087929 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f695c0cf210 con 0x7f696c103660 2024-09-19T09:12:38.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.886+0000 7f6971993640 1 --2- 172.21.15.92:0/854087929 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f69580a3240 0x7f69580a5700 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f6968000c00 tx=0x7f6968032d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:38.901 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:38.890+0000 7f6962ffd640 1 -- 172.21.15.92:0/854087929 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f695c01f020 con 0x7f696c103660 2024-09-19T09:12:39.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:38 smithi167 ceph-mon[35359]: pgmap v815: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-19T09:12:39.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:39.107+0000 7f6973bf7640 1 -- 172.21.15.92:0/854087929 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f696c1a73c0 con 0x7f696c103660 2024-09-19T09:12:39.108 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:38 smithi092 ceph-mon[31407]: pgmap v815: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-19T09:12:39.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:39.108+0000 7f6962ffd640 1 -- 172.21.15.92:0/854087929 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11844 (secure 0 0 0) 0x7f695c09bf30 con 0x7f696c103660 2024-09-19T09:12:39.109 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:12:39.109 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"btime":"2024-09-19T08:54:41:480530+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3960227551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3960227551},{"type":"v1","addr":"172.21.15.92:6835","nonce":3960227551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/589903863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":589903863},{"type":"v1","addr":"172.21.15.92:6837","nonce":589903863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14628,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/4148028188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":4148028188},{"type":"v1","addr":"172.21.15.92:6839","nonce":4148028188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/265521661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":265521661},{"type":"v1","addr":"172.21.15.92:6841","nonce":265521661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/442320499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":442320499},{"type":"v1","addr":"172.21.15.167:6833","nonce":442320499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/862511072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":862511072},{"type":"v1","addr":"172.21.15.167:6835","nonce":862511072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/490523332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":490523332},{"type":"v1","addr":"172.21.15.190:6833","nonce":490523332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/440158756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":440158756},{"type":"v1","addr":"172.21.15.167:6837","nonce":440158756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/335271561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":335271561},{"type":"v1","addr":"172.21.15.190:6835","nonce":335271561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3540790060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3540790060},{"type":"v1","addr":"172.21.15.167:6839","nonce":3540790060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:54:31.939376+0000","modified":"2024-09-19T08:54:40.961053+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6837/3700975791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":3700975791},{"type":"v1","addr":"172.21.15.190:6837","nonce":3700975791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.190:6839/3861238400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":3861238400},{"type":"v1","addr":"172.21.15.190:6839","nonce":3861238400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T09:12:39.110 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 19 2024-09-19T09:12:39.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:39.112+0000 7f6973bf7640 1 -- 172.21.15.92:0/854087929 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f69580a3240 msgr2=0x7f69580a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:39.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:39.112+0000 7f6973bf7640 1 --2- 172.21.15.92:0/854087929 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f69580a3240 0x7f69580a5700 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f6968000c00 tx=0x7f6968032d50 comp rx=0 tx=0).stop 2024-09-19T09:12:39.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:39.112+0000 7f6973bf7640 1 -- 172.21.15.92:0/854087929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f696c103660 msgr2=0x7f696c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:39.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:39.112+0000 7f6973bf7640 1 --2- 172.21.15.92:0/854087929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f696c103660 0x7f696c100ee0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f695c00b3f0 tx=0x7f695c00b8b0 comp rx=0 tx=0).stop 2024-09-19T09:12:39.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:39.112+0000 7f6973bf7640 1 -- 172.21.15.92:0/854087929 shutdown_connections 2024-09-19T09:12:39.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:39.112+0000 7f6973bf7640 1 --2- 172.21.15.92:0/854087929 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f696c10c170 0x7f696c101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:39.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:39.112+0000 7f6973bf7640 1 --2- 172.21.15.92:0/854087929 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f69580a3240 0x7f69580a5700 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:39.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:39.112+0000 7f6973bf7640 1 --2- 172.21.15.92:0/854087929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f696c103660 0x7f696c100ee0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:39.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:39.112+0000 7f6973bf7640 1 --2- 172.21.15.92:0/854087929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f696c102d40 0x7f696c1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:39.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:39.112+0000 7f6973bf7640 1 -- 172.21.15.92:0/854087929 >> 172.21.15.92:0/854087929 conn(0x7f696c0fc7a0 msgr2=0x7f696c0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:39.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:39.112+0000 7f6973bf7640 1 -- 172.21.15.92:0/854087929 shutdown_connections 2024-09-19T09:12:39.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:39.112+0000 7f6973bf7640 1 -- 172.21.15.92:0/854087929 wait complete. 2024-09-19T09:12:39.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:38 smithi190 ceph-mon[35358]: pgmap v815: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-19T09:12:39.704 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:12:39.953 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:12:40.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:39 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/854087929' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:12:40.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:39 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/854087929' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:12:40.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:39 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/854087929' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:12:40.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.402+0000 7fbee8adb640 1 -- 172.21.15.92:0/857660956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbee4100e20 msgr2=0x7fbee4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:40.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.402+0000 7fbee8adb640 1 --2- 172.21.15.92:0/857660956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbee4100e20 0x7fbee4101200 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fbed4009900 tx=0x7fbed402a480 comp rx=0 tx=0).stop 2024-09-19T09:12:40.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.402+0000 7fbee8adb640 1 -- 172.21.15.92:0/857660956 shutdown_connections 2024-09-19T09:12:40.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.402+0000 7fbee8adb640 1 --2- 172.21.15.92:0/857660956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbee4102ef0 0x7fbee410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:40.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.402+0000 7fbee8adb640 1 --2- 172.21.15.92:0/857660956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbee4102570 0x7fbee41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:40.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.402+0000 7fbee8adb640 1 --2- 172.21.15.92:0/857660956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbee4100e20 0x7fbee4101200 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:40.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.402+0000 7fbee8adb640 1 -- 172.21.15.92:0/857660956 >> 172.21.15.92:0/857660956 conn(0x7fbee40fc7d0 msgr2=0x7fbee40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:40.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.402+0000 7fbee8adb640 1 -- 172.21.15.92:0/857660956 shutdown_connections 2024-09-19T09:12:40.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.402+0000 7fbee8adb640 1 -- 172.21.15.92:0/857660956 wait complete. 2024-09-19T09:12:40.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.403+0000 7fbee8adb640 1 Processor -- start 2024-09-19T09:12:40.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.403+0000 7fbee8adb640 1 -- start start 2024-09-19T09:12:40.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.403+0000 7fbee8adb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbee4100e20 0x7fbee41984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:40.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.403+0000 7fbee8adb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbee4102570 0x7fbee41989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:40.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.403+0000 7fbee8adb640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbee4102ef0 0x7fbee419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:40.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.403+0000 7fbee8adb640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbee4110f80 con 0x7fbee4100e20 2024-09-19T09:12:40.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.403+0000 7fbee8adb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbee4110e00 con 0x7fbee4102570 2024-09-19T09:12:40.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.403+0000 7fbee8adb640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fbee4111100 con 0x7fbee4102ef0 2024-09-19T09:12:40.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.403+0000 7fbee259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbee4100e20 0x7fbee41984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:40.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.403+0000 7fbee259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbee4100e20 0x7fbee41984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52300/0 (socket says 172.21.15.92:52300) 2024-09-19T09:12:40.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.403+0000 7fbee259c640 1 -- 172.21.15.92:0/3181002196 learned_addr learned my addr 172.21.15.92:0/3181002196 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:40.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.403+0000 7fbedbfff640 1 --2- 172.21.15.92:0/3181002196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbee4102570 0x7fbee41989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:40.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.403+0000 7fbee259c640 1 -- 172.21.15.92:0/3181002196 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbee4102ef0 msgr2=0x7fbee419cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:40.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.403+0000 7fbee2d9d640 1 --2- 172.21.15.92:0/3181002196 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbee4102ef0 0x7fbee419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:40.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.403+0000 7fbee259c640 1 --2- 172.21.15.92:0/3181002196 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbee4102ef0 0x7fbee419cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:40.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.404+0000 7fbee259c640 1 -- 172.21.15.92:0/3181002196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbee4102570 msgr2=0x7fbee41989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:40.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.404+0000 7fbee259c640 1 --2- 172.21.15.92:0/3181002196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbee4102570 0x7fbee41989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:40.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.404+0000 7fbee259c640 1 -- 172.21.15.92:0/3181002196 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbee419d460 con 0x7fbee4100e20 2024-09-19T09:12:40.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.404+0000 7fbedbfff640 1 --2- 172.21.15.92:0/3181002196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbee4102570 0x7fbee41989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:12:40.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.404+0000 7fbee259c640 1 --2- 172.21.15.92:0/3181002196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbee4100e20 0x7fbee41984b0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fbed4006010 tx=0x7fbed4003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:40.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.404+0000 7fbedb7fe640 1 -- 172.21.15.92:0/3181002196 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed403f070 con 0x7fbee4100e20 2024-09-19T09:12:40.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.404+0000 7fbee8adb640 1 -- 172.21.15.92:0/3181002196 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbee419d6f0 con 0x7fbee4100e20 2024-09-19T09:12:40.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.404+0000 7fbedb7fe640 1 -- 172.21.15.92:0/3181002196 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbed4031e30 con 0x7fbee4100e20 2024-09-19T09:12:40.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.404+0000 7fbedb7fe640 1 -- 172.21.15.92:0/3181002196 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed4035030 con 0x7fbee4100e20 2024-09-19T09:12:40.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.404+0000 7fbee8adb640 1 -- 172.21.15.92:0/3181002196 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbee41a5030 con 0x7fbee4100e20 2024-09-19T09:12:40.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.405+0000 7fbee8adb640 1 -- 172.21.15.92:0/3181002196 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbee41021b0 con 0x7fbee4100e20 2024-09-19T09:12:40.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.406+0000 7fbedb7fe640 1 -- 172.21.15.92:0/3181002196 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fbed4042070 con 0x7fbee4100e20 2024-09-19T09:12:40.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.407+0000 7fbedb7fe640 1 --2- 172.21.15.92:0/3181002196 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fbed00a3240 0x7fbed00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:40.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.407+0000 7fbedbfff640 1 --2- 172.21.15.92:0/3181002196 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fbed00a3240 0x7fbed00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:40.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.407+0000 7fbedb7fe640 1 -- 172.21.15.92:0/3181002196 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fbed40f0900 con 0x7fbee4100e20 2024-09-19T09:12:40.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.407+0000 7fbedbfff640 1 --2- 172.21.15.92:0/3181002196 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fbed00a3240 0x7fbed00a5700 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fbee40ffcc0 tx=0x7fbecc005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:40.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.410+0000 7fbedb7fe640 1 -- 172.21.15.92:0/3181002196 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbed40bd6b0 con 0x7fbee4100e20 2024-09-19T09:12:40.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.579+0000 7fbee8adb640 1 -- 172.21.15.92:0/3181002196 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbee4101200 con 0x7fbee4100e20 2024-09-19T09:12:40.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.580+0000 7fbedb7fe640 1 -- 172.21.15.92:0/3181002196 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22782 (secure 0 0 0) 0x7fbed40bcfb0 con 0x7fbee4100e20 2024-09-19T09:12:40.581 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T09:12:40.581 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":82,"fsid":"91ff74f2-7663-11ef-bceb-c7b262605968","created":"2024-09-19T08:47:08.162150+0000","modified":"2024-09-19T08:54:53.324204+0000","last_up_change":"2024-09-19T08:53:43.021949+0000","last_in_change":"2024-09-19T08:53:19.246805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:50:04.482034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:54:28.005336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:54:30.188980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd104fe2-b828-4c98-a499-b212717f2997","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6803","nonce":4232030626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6805","nonce":4232030626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6809","nonce":4232030626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":4232030626},{"type":"v1","addr":"172.21.15.92:6807","nonce":4232030626}]},"public_addr":"172.21.15.92:6803/4232030626","cluster_addr":"172.21.15.92:6805/4232030626","heartbeat_back_addr":"172.21.15.92:6809/4232030626","heartbeat_front_addr":"172.21.15.92:6807/4232030626","state":["exists","up"]},{"osd":1,"uuid":"0f725330-5e61-413c-b3c8-41bc2c0d8e6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6801","nonce":4163493234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6803","nonce":4163493234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6807","nonce":4163493234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":4163493234},{"type":"v1","addr":"172.21.15.167:6805","nonce":4163493234}]},"public_addr":"172.21.15.167:6801/4163493234","cluster_addr":"172.21.15.167:6803/4163493234","heartbeat_back_addr":"172.21.15.167:6807/4163493234","heartbeat_front_addr":"172.21.15.167:6805/4163493234","state":["exists","up"]},{"osd":2,"uuid":"286d2943-23a0-4184-93cf-9d3430781f99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6801","nonce":702507556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6803","nonce":702507556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6807","nonce":702507556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":702507556},{"type":"v1","addr":"172.21.15.190:6805","nonce":702507556}]},"public_addr":"172.21.15.190:6801/702507556","cluster_addr":"172.21.15.190:6803/702507556","heartbeat_back_addr":"172.21.15.190:6807/702507556","heartbeat_front_addr":"172.21.15.190:6805/702507556","state":["exists","up"]},{"osd":3,"uuid":"9d126671-7fc1-4f29-9bc3-3598052fd20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6811","nonce":945752895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6813","nonce":945752895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6817","nonce":945752895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":945752895},{"type":"v1","addr":"172.21.15.92:6815","nonce":945752895}]},"public_addr":"172.21.15.92:6811/945752895","cluster_addr":"172.21.15.92:6813/945752895","heartbeat_back_addr":"172.21.15.92:6817/945752895","heartbeat_front_addr":"172.21.15.92:6815/945752895","state":["exists","up"]},{"osd":4,"uuid":"cb10b38d-ae13-4b92-b906-3505fb873b2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6809","nonce":3576893400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6811","nonce":3576893400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6815","nonce":3576893400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3576893400},{"type":"v1","addr":"172.21.15.167:6813","nonce":3576893400}]},"public_addr":"172.21.15.167:6809/3576893400","cluster_addr":"172.21.15.167:6811/3576893400","heartbeat_back_addr":"172.21.15.167:6815/3576893400","heartbeat_front_addr":"172.21.15.167:6813/3576893400","state":["exists","up"]},{"osd":5,"uuid":"cd90668b-eca5-4bb4-870e-e58578730c89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6809","nonce":1880491675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6811","nonce":1880491675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6815","nonce":1880491675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1880491675},{"type":"v1","addr":"172.21.15.190:6813","nonce":1880491675}]},"public_addr":"172.21.15.190:6809/1880491675","cluster_addr":"172.21.15.190:6811/1880491675","heartbeat_back_addr":"172.21.15.190:6815/1880491675","heartbeat_front_addr":"172.21.15.190:6813/1880491675","state":["exists","up"]},{"osd":6,"uuid":"4e047963-afa7-4934-b887-8086165fb831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6819","nonce":1743435653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6821","nonce":1743435653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6825","nonce":1743435653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":1743435653},{"type":"v1","addr":"172.21.15.92:6823","nonce":1743435653}]},"public_addr":"172.21.15.92:6819/1743435653","cluster_addr":"172.21.15.92:6821/1743435653","heartbeat_back_addr":"172.21.15.92:6825/1743435653","heartbeat_front_addr":"172.21.15.92:6823/1743435653","state":["exists","up"]},{"osd":7,"uuid":"652a6aa1-bb94-4608-952e-67cd02bdff66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6817","nonce":2984111963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6819","nonce":2984111963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6823","nonce":2984111963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":2984111963},{"type":"v1","addr":"172.21.15.167:6821","nonce":2984111963}]},"public_addr":"172.21.15.167:6817/2984111963","cluster_addr":"172.21.15.167:6819/2984111963","heartbeat_back_addr":"172.21.15.167:6823/2984111963","heartbeat_front_addr":"172.21.15.167:6821/2984111963","state":["exists","up"]},{"osd":8,"uuid":"1510ef1f-fdfe-4887-a771-146efce062fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6817","nonce":4190304434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6819","nonce":4190304434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6823","nonce":4190304434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":4190304434},{"type":"v1","addr":"172.21.15.190:6821","nonce":4190304434}]},"public_addr":"172.21.15.190:6817/4190304434","cluster_addr":"172.21.15.190:6819/4190304434","heartbeat_back_addr":"172.21.15.190:6823/4190304434","heartbeat_front_addr":"172.21.15.190:6821/4190304434","state":["exists","up"]},{"osd":9,"uuid":"9b774bbe-6700-4020-900b-3fdbaa546773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6827","nonce":3066744542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6829","nonce":3066744542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6833","nonce":3066744542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3066744542},{"type":"v1","addr":"172.21.15.92:6831","nonce":3066744542}]},"public_addr":"172.21.15.92:6827/3066744542","cluster_addr":"172.21.15.92:6829/3066744542","heartbeat_back_addr":"172.21.15.92:6833/3066744542","heartbeat_front_addr":"172.21.15.92:6831/3066744542","state":["exists","up"]},{"osd":10,"uuid":"8abdb835-db2c-4597-ae1d-8ef56e63ab6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6825","nonce":2309134313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6827","nonce":2309134313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6831","nonce":2309134313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2309134313},{"type":"v1","addr":"172.21.15.167:6829","nonce":2309134313}]},"public_addr":"172.21.15.167:6825/2309134313","cluster_addr":"172.21.15.167:6827/2309134313","heartbeat_back_addr":"172.21.15.167:6831/2309134313","heartbeat_front_addr":"172.21.15.167:6829/2309134313","state":["exists","up"]},{"osd":11,"uuid":"564c844a-378f-40cd-9717-cde35a65631c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6825","nonce":1849208751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6827","nonce":1849208751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6831","nonce":1849208751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1849208751},{"type":"v1","addr":"172.21.15.190:6829","nonce":1849208751}]},"public_addr":"172.21.15.190:6825/1849208751","cluster_addr":"172.21.15.190:6827/1849208751","heartbeat_back_addr":"172.21.15.190:6831/1849208751","heartbeat_front_addr":"172.21.15.190:6829/1849208751","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:12.072109+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:36.689174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:01.908763+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:26.857439+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:50:50.881629+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:51:15.160744+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:51:39.101605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:03.179877+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:27.324563+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:52:51.971287+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:53:15.917311+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:53:40.592486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/2948821221":"2024-09-20T08:47:52.180093+0000","172.21.15.92:0/1441365956":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6801/2908709470":"2024-09-20T08:47:52.180093+0000","172.21.15.92:0/608374871":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6801/1369295034":"2024-09-20T08:47:29.812397+0000","172.21.15.92:6800/2908709470":"2024-09-20T08:47:52.180093+0000","172.21.15.92:6800/1369295034":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/813486656":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/1963725565":"2024-09-20T08:47:29.812397+0000","172.21.15.92:0/1668504617":"2024-09-20T08:47:29.812397+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:12:40.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.582+0000 7fbee8adb640 1 -- 172.21.15.92:0/3181002196 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fbed00a3240 msgr2=0x7fbed00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:40.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.582+0000 7fbee8adb640 1 --2- 172.21.15.92:0/3181002196 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fbed00a3240 0x7fbed00a5700 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fbee40ffcc0 tx=0x7fbecc005ec0 comp rx=0 tx=0).stop 2024-09-19T09:12:40.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.582+0000 7fbee8adb640 1 -- 172.21.15.92:0/3181002196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbee4100e20 msgr2=0x7fbee41984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:40.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.582+0000 7fbee8adb640 1 --2- 172.21.15.92:0/3181002196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbee4100e20 0x7fbee41984b0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fbed4006010 tx=0x7fbed4003c80 comp rx=0 tx=0).stop 2024-09-19T09:12:40.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.582+0000 7fbee8adb640 1 -- 172.21.15.92:0/3181002196 shutdown_connections 2024-09-19T09:12:40.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.582+0000 7fbee8adb640 1 --2- 172.21.15.92:0/3181002196 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbee4102ef0 0x7fbee419cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:40.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.582+0000 7fbee8adb640 1 --2- 172.21.15.92:0/3181002196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbee4102570 0x7fbee41989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:40.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.582+0000 7fbee8adb640 1 --2- 172.21.15.92:0/3181002196 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fbed00a3240 0x7fbed00a5700 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:40.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.582+0000 7fbee8adb640 1 --2- 172.21.15.92:0/3181002196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbee4100e20 0x7fbee41984b0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:40.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.582+0000 7fbee8adb640 1 -- 172.21.15.92:0/3181002196 >> 172.21.15.92:0/3181002196 conn(0x7fbee40fc7d0 msgr2=0x7fbee406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:40.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.583+0000 7fbee8adb640 1 -- 172.21.15.92:0/3181002196 shutdown_connections 2024-09-19T09:12:40.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:40.583+0000 7fbee8adb640 1 -- 172.21.15.92:0/3181002196 wait complete. 2024-09-19T09:12:41.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:40 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3181002196' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:12:41.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:40 smithi167 ceph-mon[35359]: pgmap v816: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 49 KiB/s wr, 4 op/s 2024-09-19T09:12:41.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:40 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3181002196' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:12:41.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:40 smithi190 ceph-mon[35358]: pgmap v816: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 49 KiB/s wr, 4 op/s 2024-09-19T09:12:41.143 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:40 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3181002196' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:12:41.143 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:40 smithi092 ceph-mon[31407]: pgmap v816: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 49 KiB/s wr, 4 op/s 2024-09-19T09:12:41.171 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs fail cephfs 2024-09-19T09:12:41.415 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:12:41.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.843+0000 7f1db29a2640 1 -- 172.21.15.92:0/1547564835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1dac101de0 msgr2=0x7f1dac1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:41.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.843+0000 7f1db29a2640 1 --2- 172.21.15.92:0/1547564835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1dac101de0 0x7f1dac1021c0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c009900 tx=0x7f1d9c02a410 comp rx=0 tx=0).stop 2024-09-19T09:12:41.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.843+0000 7f1db29a2640 1 -- 172.21.15.92:0/1547564835 shutdown_connections 2024-09-19T09:12:41.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.843+0000 7f1db29a2640 1 --2- 172.21.15.92:0/1547564835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1dac106f10 0x7f1dac10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:41.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.843+0000 7f1db29a2640 1 --2- 172.21.15.92:0/1547564835 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1dac102790 0x7f1dac1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:41.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.843+0000 7f1db29a2640 1 --2- 172.21.15.92:0/1547564835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1dac101de0 0x7f1dac1021c0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:41.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.843+0000 7f1db29a2640 1 -- 172.21.15.92:0/1547564835 >> 172.21.15.92:0/1547564835 conn(0x7f1dac0fd8c0 msgr2=0x7f1dac0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:41.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.843+0000 7f1db29a2640 1 -- 172.21.15.92:0/1547564835 shutdown_connections 2024-09-19T09:12:41.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.843+0000 7f1db29a2640 1 -- 172.21.15.92:0/1547564835 wait complete. 2024-09-19T09:12:41.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.844+0000 7f1db29a2640 1 Processor -- start 2024-09-19T09:12:41.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.844+0000 7f1db29a2640 1 -- start start 2024-09-19T09:12:41.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.844+0000 7f1db29a2640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1dac101de0 0x7f1dac0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:41.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.844+0000 7f1db29a2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1dac102790 0x7f1dac074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:41.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.844+0000 7f1db29a2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1dac106f10 0x7f1dac074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:41.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.844+0000 7f1db29a2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac111f90 con 0x7f1dac106f10 2024-09-19T09:12:41.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.844+0000 7f1db29a2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac111e10 con 0x7f1dac102790 2024-09-19T09:12:41.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.844+0000 7f1db29a2640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac112110 con 0x7f1dac101de0 2024-09-19T09:12:41.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.844+0000 7f1db0f3f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1dac106f10 0x7f1dac074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:41.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.844+0000 7f1db0f3f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1dac106f10 0x7f1dac074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59282/0 (socket says 172.21.15.92:59282) 2024-09-19T09:12:41.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.844+0000 7f1db0f3f640 1 -- 172.21.15.92:0/152438959 learned_addr learned my addr 172.21.15.92:0/152438959 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:41.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.844+0000 7f1dabfff640 1 --2- 172.21.15.92:0/152438959 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1dac101de0 0x7f1dac0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:41.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.844+0000 7f1da3fff640 1 --2- 172.21.15.92:0/152438959 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1dac102790 0x7f1dac074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:41.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.844+0000 7f1db0f3f640 1 -- 172.21.15.92:0/152438959 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1dac101de0 msgr2=0x7f1dac0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:41.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.844+0000 7f1db0f3f640 1 --2- 172.21.15.92:0/152438959 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1dac101de0 0x7f1dac0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:41.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.844+0000 7f1db0f3f640 1 -- 172.21.15.92:0/152438959 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1dac102790 msgr2=0x7f1dac074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:41.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.844+0000 7f1db0f3f640 1 --2- 172.21.15.92:0/152438959 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1dac102790 0x7f1dac074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:41.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.844+0000 7f1db0f3f640 1 -- 172.21.15.92:0/152438959 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dac1a69f0 con 0x7f1dac106f10 2024-09-19T09:12:41.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.844+0000 7f1da3fff640 1 --2- 172.21.15.92:0/152438959 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1dac102790 0x7f1dac074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:12:41.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.845+0000 7f1db0f3f640 1 --2- 172.21.15.92:0/152438959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1dac106f10 0x7f1dac074f70 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f1da400cad0 tx=0x7f1da400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:41.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.845+0000 7f1da9ffb640 1 -- 172.21.15.92:0/152438959 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da400ae20 con 0x7f1dac106f10 2024-09-19T09:12:41.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.845+0000 7f1da9ffb640 1 -- 172.21.15.92:0/152438959 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1da4005020 con 0x7f1dac106f10 2024-09-19T09:12:41.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.845+0000 7f1db29a2640 1 -- 172.21.15.92:0/152438959 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dac1a6ce0 con 0x7f1dac106f10 2024-09-19T09:12:41.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.845+0000 7f1da9ffb640 1 -- 172.21.15.92:0/152438959 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da400f6f0 con 0x7f1dac106f10 2024-09-19T09:12:41.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.845+0000 7f1db29a2640 1 -- 172.21.15.92:0/152438959 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dac1a7220 con 0x7f1dac106f10 2024-09-19T09:12:41.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.846+0000 7f1db29a2640 1 -- 172.21.15.92:0/152438959 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dac1021c0 con 0x7f1dac106f10 2024-09-19T09:12:41.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.847+0000 7f1da9ffb640 1 -- 172.21.15.92:0/152438959 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1da40051d0 con 0x7f1dac106f10 2024-09-19T09:12:41.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.848+0000 7f1da9ffb640 1 --2- 172.21.15.92:0/152438959 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1d980a32c0 0x7f1d980a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:41.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.848+0000 7f1dabfff640 1 --2- 172.21.15.92:0/152438959 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1d980a32c0 0x7f1d980a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:41.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.848+0000 7f1da9ffb640 1 -- 172.21.15.92:0/152438959 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f1da40cfd90 con 0x7f1dac106f10 2024-09-19T09:12:41.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.848+0000 7f1dabfff640 1 --2- 172.21.15.92:0/152438959 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1d980a32c0 0x7f1d980a5780 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c0096c0 tx=0x7f1d9c031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:41.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:41.851+0000 7f1da9ffb640 1 -- 172.21.15.92:0/152438959 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1da4014030 con 0x7f1dac106f10 2024-09-19T09:12:42.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:42.051+0000 7f1db29a2640 1 -- 172.21.15.92:0/152438959 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f1dac02d7c0 con 0x7f1dac106f10 2024-09-19T09:12:42.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:42.053+0000 7f1da9ffb640 1 -- 172.21.15.92:0/152438959 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) ==== 161+0+0 (secure 0 0 0) 0x7f1da409cb30 con 0x7f1dac106f10 2024-09-19T09:12:42.054 INFO:teuthology.orchestra.run.smithi092.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T09:12:42.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:42.055+0000 7f1db29a2640 1 -- 172.21.15.92:0/152438959 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1d980a32c0 msgr2=0x7f1d980a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:42.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:42.055+0000 7f1db29a2640 1 --2- 172.21.15.92:0/152438959 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1d980a32c0 0x7f1d980a5780 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c0096c0 tx=0x7f1d9c031490 comp rx=0 tx=0).stop 2024-09-19T09:12:42.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:42.055+0000 7f1db29a2640 1 -- 172.21.15.92:0/152438959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1dac106f10 msgr2=0x7f1dac074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:42.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:42.055+0000 7f1db29a2640 1 --2- 172.21.15.92:0/152438959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1dac106f10 0x7f1dac074f70 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f1da400cad0 tx=0x7f1da400cf90 comp rx=0 tx=0).stop 2024-09-19T09:12:42.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:42.056+0000 7f1db29a2640 1 -- 172.21.15.92:0/152438959 shutdown_connections 2024-09-19T09:12:42.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:42.056+0000 7f1db29a2640 1 --2- 172.21.15.92:0/152438959 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f1d980a32c0 0x7f1d980a5780 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:42.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:42.056+0000 7f1db29a2640 1 --2- 172.21.15.92:0/152438959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1dac106f10 0x7f1dac074f70 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:42.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:42.056+0000 7f1db29a2640 1 --2- 172.21.15.92:0/152438959 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1dac102790 0x7f1dac074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:42.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:42.056+0000 7f1db29a2640 1 --2- 172.21.15.92:0/152438959 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1dac101de0 0x7f1dac0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:42.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:42.056+0000 7f1db29a2640 1 -- 172.21.15.92:0/152438959 >> 172.21.15.92:0/152438959 conn(0x7f1dac0fd8c0 msgr2=0x7f1dac0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:42.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:42.056+0000 7f1db29a2640 1 -- 172.21.15.92:0/152438959 shutdown_connections 2024-09-19T09:12:42.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:42.056+0000 7f1db29a2640 1 -- 172.21.15.92:0/152438959 wait complete. 2024-09-19T09:12:42.106 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:42 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mon-a[31403]: 2024-09-19T09:12:42.052+0000 7fc218948640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:12:42.374 INFO:journalctl@ceph.mds.i.smithi190.stdout:Sep 19 09:12:42 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-i[65763]: ignoring --setuser ceph since I am not root 2024-09-19T09:12:42.374 INFO:journalctl@ceph.mds.i.smithi190.stdout:Sep 19 09:12:42 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-i[65763]: ignoring --setgroup ceph since I am not root 2024-09-19T09:12:42.375 INFO:journalctl@ceph.mds.i.smithi190.stdout:Sep 19 09:12:42 smithi190 ceph-mds[65767]: -- 172.21.15.190:0/14021646 <== mon.1 v2:172.21.15.190:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560721a75860 con 0x560721a53000 2024-09-19T09:12:42.375 INFO:journalctl@ceph.mds.i.smithi190.stdout:Sep 19 09:12:42 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-i[65763]: starting mds.i at 2024-09-19T09:12:42.375 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:42 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/152438959' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T09:12:42.375 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:42 smithi190 ceph-mon[35358]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T09:12:42.375 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:42 smithi190 ceph-mon[35358]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:12:42.375 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:42 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/152438959' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T09:12:42.375 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:42 smithi190 ceph-mon[35358]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T09:12:42.375 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:42 smithi190 ceph-mon[35358]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-19T09:12:42.376 INFO:journalctl@ceph.mds.c.smithi190.stdout:Sep 19 09:12:42 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-c[65460]: ignoring --setuser ceph since I am not root 2024-09-19T09:12:42.376 INFO:journalctl@ceph.mds.c.smithi190.stdout:Sep 19 09:12:42 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-c[65460]: ignoring --setgroup ceph since I am not root 2024-09-19T09:12:42.376 INFO:journalctl@ceph.mds.c.smithi190.stdout:Sep 19 09:12:42 smithi190 ceph-mds[65464]: -- 172.21.15.190:0/1422243263 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55735bfc9860 con 0x55735bfa7000 2024-09-19T09:12:42.376 INFO:journalctl@ceph.mds.c.smithi190.stdout:Sep 19 09:12:42 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-c[65460]: starting mds.c at 2024-09-19T09:12:42.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:42 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/152438959' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T09:12:42.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:42 smithi092 ceph-mon[31407]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T09:12:42.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:42 smithi092 ceph-mon[31407]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:12:42.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:42 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/152438959' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T09:12:42.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:42 smithi092 ceph-mon[31407]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T09:12:42.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:42 smithi092 ceph-mon[31407]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-19T09:12:42.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:42 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/152438959' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T09:12:42.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:42 smithi167 ceph-mon[35359]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T09:12:42.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:42 smithi167 ceph-mon[35359]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:12:42.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:42 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/152438959' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T09:12:42.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:42 smithi167 ceph-mon[35359]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T09:12:42.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:42 smithi167 ceph-mon[35359]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-19T09:12:42.695 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T09:12:42.939 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:12:43.374 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:43 smithi190 ceph-mon[35358]: pgmap v818: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 60 KiB/s wr, 6 op/s 2024-09-19T09:12:43.377 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:43 smithi092 ceph-mon[31407]: pgmap v818: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 60 KiB/s wr, 6 op/s 2024-09-19T09:12:43.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.376+0000 7f8753674640 1 -- 172.21.15.92:0/439421073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f874c106f10 msgr2=0x7f874c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:43.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.376+0000 7f8753674640 1 --2- 172.21.15.92:0/439421073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f874c106f10 0x7f874c10ea90 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f8744009ca0 tx=0x7f874402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:12:43.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.376+0000 7f8753674640 1 -- 172.21.15.92:0/439421073 shutdown_connections 2024-09-19T09:12:43.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.376+0000 7f8753674640 1 --2- 172.21.15.92:0/439421073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f874c106f10 0x7f874c10ea90 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:43.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.376+0000 7f8753674640 1 --2- 172.21.15.92:0/439421073 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f874c102790 0x7f874c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:43.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.376+0000 7f8753674640 1 --2- 172.21.15.92:0/439421073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f874c101de0 0x7f874c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:43.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.376+0000 7f8753674640 1 -- 172.21.15.92:0/439421073 >> 172.21.15.92:0/439421073 conn(0x7f874c0fd8c0 msgr2=0x7f874c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:43.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.376+0000 7f8753674640 1 -- 172.21.15.92:0/439421073 shutdown_connections 2024-09-19T09:12:43.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.376+0000 7f8753674640 1 -- 172.21.15.92:0/439421073 wait complete. 2024-09-19T09:12:43.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.377+0000 7f8753674640 1 Processor -- start 2024-09-19T09:12:43.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.377+0000 7f8753674640 1 -- start start 2024-09-19T09:12:43.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.377+0000 7f8753674640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f874c101de0 0x7f874c198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:43.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.377+0000 7f8753674640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f874c102790 0x7f874c198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:43.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.377+0000 7f8753674640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f874c106f10 0x7f874c19cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:43.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.377+0000 7f8753674640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f874c111fc0 con 0x7f874c106f10 2024-09-19T09:12:43.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.377+0000 7f8753674640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f874c111e40 con 0x7f874c101de0 2024-09-19T09:12:43.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.377+0000 7f8753674640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f874c112140 con 0x7f874c102790 2024-09-19T09:12:43.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.377+0000 7f8751c11640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f874c106f10 0x7f874c19cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:43.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.377+0000 7f8751c11640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f874c106f10 0x7f874c19cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59300/0 (socket says 172.21.15.92:59300) 2024-09-19T09:12:43.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.377+0000 7f8751c11640 1 -- 172.21.15.92:0/4005009127 learned_addr learned my addr 172.21.15.92:0/4005009127 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:43.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.377+0000 7f8750c0f640 1 --2- 172.21.15.92:0/4005009127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f874c102790 0x7f874c198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:43.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.378+0000 7f8751410640 1 --2- 172.21.15.92:0/4005009127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f874c101de0 0x7f874c198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:43.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.378+0000 7f8751c11640 1 -- 172.21.15.92:0/4005009127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f874c102790 msgr2=0x7f874c198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:43.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.378+0000 7f8751c11640 1 --2- 172.21.15.92:0/4005009127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f874c102790 0x7f874c198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:43.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.378+0000 7f8751c11640 1 -- 172.21.15.92:0/4005009127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f874c101de0 msgr2=0x7f874c198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:43.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.378+0000 7f8751c11640 1 --2- 172.21.15.92:0/4005009127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f874c101de0 0x7f874c198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:43.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.378+0000 7f8751c11640 1 -- 172.21.15.92:0/4005009127 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f874c19d2e0 con 0x7f874c106f10 2024-09-19T09:12:43.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.378+0000 7f8751410640 1 --2- 172.21.15.92:0/4005009127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f874c101de0 0x7f874c198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:12:43.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.378+0000 7f8751c11640 1 --2- 172.21.15.92:0/4005009127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f874c106f10 0x7f874c19cc00 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f8744003f10 tx=0x7f8744003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:43.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.378+0000 7f87427fc640 1 -- 172.21.15.92:0/4005009127 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8744031710 con 0x7f874c106f10 2024-09-19T09:12:43.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.378+0000 7f8753674640 1 -- 172.21.15.92:0/4005009127 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f874c19d570 con 0x7f874c106f10 2024-09-19T09:12:43.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.378+0000 7f87427fc640 1 -- 172.21.15.92:0/4005009127 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87440318b0 con 0x7f874c106f10 2024-09-19T09:12:43.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.378+0000 7f87427fc640 1 -- 172.21.15.92:0/4005009127 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f874402fb90 con 0x7f874c106f10 2024-09-19T09:12:43.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.378+0000 7f8753674640 1 -- 172.21.15.92:0/4005009127 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f874c1a4eb0 con 0x7f874c106f10 2024-09-19T09:12:43.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.379+0000 7f8753674640 1 -- 172.21.15.92:0/4005009127 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f874c1021c0 con 0x7f874c106f10 2024-09-19T09:12:43.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.380+0000 7f87427fc640 1 -- 172.21.15.92:0/4005009127 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f874402fd30 con 0x7f874c106f10 2024-09-19T09:12:43.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.381+0000 7f87427fc640 1 --2- 172.21.15.92:0/4005009127 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f87380a3240 0x7f87380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:43.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.381+0000 7f8751410640 1 --2- 172.21.15.92:0/4005009127 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f87380a3240 0x7f87380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:43.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.381+0000 7f87427fc640 1 -- 172.21.15.92:0/4005009127 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8326+0+0 (secure 0 0 0) 0x7f87440f1140 con 0x7f874c106f10 2024-09-19T09:12:43.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.381+0000 7f8751410640 1 --2- 172.21.15.92:0/4005009127 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f87380a3240 0x7f87380a5700 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f874800baa0 tx=0x7f8748005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:43.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.385+0000 7f87427fc640 1 -- 172.21.15.92:0/4005009127 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f87440bde00 con 0x7f874c106f10 2024-09-19T09:12:43.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:43.588+0000 7f8753674640 1 -- 172.21.15.92:0/4005009127 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f874c1a50e0 con 0x7f874c106f10 2024-09-19T09:12:43.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:43 smithi167 ceph-mon[35359]: pgmap v818: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 60 KiB/s wr, 6 op/s 2024-09-19T09:12:44.374 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:44 smithi190 ceph-mon[35358]: mds.? [v2:172.21.15.190:6837/3580224256,v1:172.21.15.190:6839/3580224256] up:boot 2024-09-19T09:12:44.374 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:44 smithi190 ceph-mon[35358]: mds.? [v2:172.21.15.190:6836/3265604319,v1:172.21.15.190:6838/3265604319] up:boot 2024-09-19T09:12:44.375 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:44 smithi190 ceph-mon[35358]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-19T09:12:44.375 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:44 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:12:44.375 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:44 smithi190 ceph-mon[35358]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:12:44.375 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:44 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/4005009127' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:12:44.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:44.471+0000 7f87427fc640 1 -- 172.21.15.92:0/4005009127 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v22) ==== 104+0+0 (secure 0 0 0) 0x7f87440bd700 con 0x7f874c106f10 2024-09-19T09:12:44.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:44 smithi092 ceph-mon[31407]: mds.? [v2:172.21.15.190:6837/3580224256,v1:172.21.15.190:6839/3580224256] up:boot 2024-09-19T09:12:44.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:44 smithi092 ceph-mon[31407]: mds.? [v2:172.21.15.190:6836/3265604319,v1:172.21.15.190:6838/3265604319] up:boot 2024-09-19T09:12:44.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:44 smithi092 ceph-mon[31407]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-19T09:12:44.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:44 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:12:44.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:44 smithi092 ceph-mon[31407]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:12:44.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:44 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/4005009127' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:12:44.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:44.474+0000 7f8753674640 1 -- 172.21.15.92:0/4005009127 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f87380a3240 msgr2=0x7f87380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:44.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:44.474+0000 7f8753674640 1 --2- 172.21.15.92:0/4005009127 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f87380a3240 0x7f87380a5700 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f874800baa0 tx=0x7f8748005d90 comp rx=0 tx=0).stop 2024-09-19T09:12:44.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:44.474+0000 7f8753674640 1 -- 172.21.15.92:0/4005009127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f874c106f10 msgr2=0x7f874c19cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:44.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:44.474+0000 7f8753674640 1 --2- 172.21.15.92:0/4005009127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f874c106f10 0x7f874c19cc00 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f8744003f10 tx=0x7f8744003f40 comp rx=0 tx=0).stop 2024-09-19T09:12:44.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:44.474+0000 7f8753674640 1 -- 172.21.15.92:0/4005009127 shutdown_connections 2024-09-19T09:12:44.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:44.474+0000 7f8753674640 1 --2- 172.21.15.92:0/4005009127 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f87380a3240 0x7f87380a5700 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:44.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:44.474+0000 7f8753674640 1 --2- 172.21.15.92:0/4005009127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f874c106f10 0x7f874c19cc00 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:44.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:44.474+0000 7f8753674640 1 --2- 172.21.15.92:0/4005009127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f874c102790 0x7f874c198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:44.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:44.474+0000 7f8753674640 1 --2- 172.21.15.92:0/4005009127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f874c101de0 0x7f874c198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:44.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:44.474+0000 7f8753674640 1 -- 172.21.15.92:0/4005009127 >> 172.21.15.92:0/4005009127 conn(0x7f874c0fd8c0 msgr2=0x7f874c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:44.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:44.474+0000 7f8753674640 1 -- 172.21.15.92:0/4005009127 shutdown_connections 2024-09-19T09:12:44.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:44.474+0000 7f8753674640 1 -- 172.21.15.92:0/4005009127 wait complete. 2024-09-19T09:12:44.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:44 smithi167 ceph-mon[35359]: mds.? [v2:172.21.15.190:6837/3580224256,v1:172.21.15.190:6839/3580224256] up:boot 2024-09-19T09:12:44.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:44 smithi167 ceph-mon[35359]: mds.? [v2:172.21.15.190:6836/3265604319,v1:172.21.15.190:6838/3265604319] up:boot 2024-09-19T09:12:44.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:44 smithi167 ceph-mon[35359]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-19T09:12:44.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:44 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:12:44.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:44 smithi167 ceph-mon[35359]: from='mgr.14150 172.21.15.92:0/2427679531' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:12:44.603 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:44 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/4005009127' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:12:45.060 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T09:12:45.311 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:12:45.377 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:45 smithi190 ceph-mon[35358]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T09:12:45.377 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:45 smithi190 ceph-mon[35358]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T09:12:45.377 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:45 smithi190 ceph-mon[35358]: Cluster is now healthy 2024-09-19T09:12:45.378 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:45 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/4005009127' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:12:45.378 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:45 smithi190 ceph-mon[35358]: fsmap 12 up:standby 2024-09-19T09:12:45.378 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:45 smithi190 ceph-mon[35358]: pgmap v819: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 60 KiB/s wr, 6 op/s 2024-09-19T09:12:45.418 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:45 smithi092 ceph-mon[31407]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T09:12:45.418 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:45 smithi092 ceph-mon[31407]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T09:12:45.418 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:45 smithi092 ceph-mon[31407]: Cluster is now healthy 2024-09-19T09:12:45.419 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:45 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/4005009127' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:12:45.419 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:45 smithi092 ceph-mon[31407]: fsmap 12 up:standby 2024-09-19T09:12:45.419 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:45 smithi092 ceph-mon[31407]: pgmap v819: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 60 KiB/s wr, 6 op/s 2024-09-19T09:12:45.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:45 smithi167 ceph-mon[35359]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T09:12:45.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:45 smithi167 ceph-mon[35359]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T09:12:45.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:45 smithi167 ceph-mon[35359]: Cluster is now healthy 2024-09-19T09:12:45.603 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:45 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/4005009127' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:12:45.603 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:45 smithi167 ceph-mon[35359]: fsmap 12 up:standby 2024-09-19T09:12:45.603 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:45 smithi167 ceph-mon[35359]: pgmap v819: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 60 KiB/s wr, 6 op/s 2024-09-19T09:12:45.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.746+0000 7f4766f18640 1 -- 172.21.15.92:0/114490264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4760101410 msgr2=0x7f476010d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:45.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.746+0000 7f4766f18640 1 --2- 172.21.15.92:0/114490264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4760101410 0x7f476010d940 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f4758009cd0 tx=0x7f475802a8e0 comp rx=0 tx=0).stop 2024-09-19T09:12:45.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.746+0000 7f4766f18640 1 -- 172.21.15.92:0/114490264 shutdown_connections 2024-09-19T09:12:45.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.746+0000 7f4766f18640 1 --2- 172.21.15.92:0/114490264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4760101410 0x7f476010d940 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:45.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.746+0000 7f4766f18640 1 --2- 172.21.15.92:0/114490264 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4760100a70 0x7f4760100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:45.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.746+0000 7f4766f18640 1 --2- 172.21.15.92:0/114490264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4760106a70 0x7f4760106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:45.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.746+0000 7f4766f18640 1 -- 172.21.15.92:0/114490264 >> 172.21.15.92:0/114490264 conn(0x7f47600fc790 msgr2=0x7f47600febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:45.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.746+0000 7f4766f18640 1 -- 172.21.15.92:0/114490264 shutdown_connections 2024-09-19T09:12:45.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.746+0000 7f4766f18640 1 -- 172.21.15.92:0/114490264 wait complete. 2024-09-19T09:12:45.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.747+0000 7f4766f18640 1 Processor -- start 2024-09-19T09:12:45.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.747+0000 7f4766f18640 1 -- start start 2024-09-19T09:12:45.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.747+0000 7f4766f18640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4760100a70 0x7f476019a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:45.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.747+0000 7f4766f18640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4760101410 0x7f476019aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:45.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.747+0000 7f4766f18640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4760106a70 0x7f476019ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:45.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.747+0000 7f4766f18640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4760110e70 con 0x7f4760100a70 2024-09-19T09:12:45.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.747+0000 7f4766f18640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4760110cf0 con 0x7f4760101410 2024-09-19T09:12:45.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.747+0000 7f4766f18640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4760110ff0 con 0x7f4760106a70 2024-09-19T09:12:45.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.747+0000 7f4764cb4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4760100a70 0x7f476019a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:45.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.747+0000 7f4764cb4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4760100a70 0x7f476019a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59326/0 (socket says 172.21.15.92:59326) 2024-09-19T09:12:45.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.747+0000 7f4764cb4640 1 -- 172.21.15.92:0/3146635876 learned_addr learned my addr 172.21.15.92:0/3146635876 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:45.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.747+0000 7f47654b5640 1 --2- 172.21.15.92:0/3146635876 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4760106a70 0x7f476019ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:45.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.747+0000 7f475ffff640 1 --2- 172.21.15.92:0/3146635876 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4760101410 0x7f476019aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:45.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.747+0000 7f4764cb4640 1 -- 172.21.15.92:0/3146635876 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4760106a70 msgr2=0x7f476019ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:45.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.747+0000 7f4764cb4640 1 --2- 172.21.15.92:0/3146635876 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4760106a70 0x7f476019ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:45.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.747+0000 7f4764cb4640 1 -- 172.21.15.92:0/3146635876 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4760101410 msgr2=0x7f476019aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:45.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.747+0000 7f4764cb4640 1 --2- 172.21.15.92:0/3146635876 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4760101410 0x7f476019aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:45.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.747+0000 7f4764cb4640 1 -- 172.21.15.92:0/3146635876 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f476019f530 con 0x7f4760100a70 2024-09-19T09:12:45.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.748+0000 7f4764cb4640 1 --2- 172.21.15.92:0/3146635876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4760100a70 0x7f476019a580 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f475400c920 tx=0x7f475400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:45.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.748+0000 7f475dffb640 1 -- 172.21.15.92:0/3146635876 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4754007c70 con 0x7f4760100a70 2024-09-19T09:12:45.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.748+0000 7f475dffb640 1 -- 172.21.15.92:0/3146635876 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4754007e10 con 0x7f4760100a70 2024-09-19T09:12:45.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.748+0000 7f4766f18640 1 -- 172.21.15.92:0/3146635876 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f476019f820 con 0x7f4760100a70 2024-09-19T09:12:45.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.748+0000 7f475dffb640 1 -- 172.21.15.92:0/3146635876 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4754018890 con 0x7f4760100a70 2024-09-19T09:12:45.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.748+0000 7f4766f18640 1 -- 172.21.15.92:0/3146635876 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47601a7100 con 0x7f4760100a70 2024-09-19T09:12:45.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.749+0000 7f4766f18640 1 -- 172.21.15.92:0/3146635876 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4760100ed0 con 0x7f4760100a70 2024-09-19T09:12:45.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.750+0000 7f475dffb640 1 -- 172.21.15.92:0/3146635876 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4754018a70 con 0x7f4760100a70 2024-09-19T09:12:45.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.751+0000 7f475dffb640 1 --2- 172.21.15.92:0/3146635876 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f47500a32c0 0x7f47500a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:45.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.751+0000 7f475ffff640 1 --2- 172.21.15.92:0/3146635876 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f47500a32c0 0x7f47500a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:45.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.751+0000 7f475dffb640 1 -- 172.21.15.92:0/3146635876 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8326+0+0 (secure 0 0 0) 0x7f47540cfa60 con 0x7f4760100a70 2024-09-19T09:12:45.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.751+0000 7f475ffff640 1 --2- 172.21.15.92:0/3146635876 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f47500a32c0 0x7f47500a5780 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f476006b7e0 tx=0x7f474c005c60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:45.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.755+0000 7f475dffb640 1 -- 172.21.15.92:0/3146635876 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4754014030 con 0x7f4760100a70 2024-09-19T09:12:45.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:45.921+0000 7f4766f18640 1 -- 172.21.15.92:0/3146635876 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f47601a7330 con 0x7f4760100a70 2024-09-19T09:12:46.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:46.478+0000 7f475dffb640 1 -- 172.21.15.92:0/3146635876 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v84) ==== 181+0+0 (secure 0 0 0) 0x7f475401f300 con 0x7f4760100a70 2024-09-19T09:12:46.480 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'cephfs_metadata' removed 2024-09-19T09:12:46.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:46.481+0000 7f4766f18640 1 -- 172.21.15.92:0/3146635876 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f47500a32c0 msgr2=0x7f47500a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:46.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:46.481+0000 7f4766f18640 1 --2- 172.21.15.92:0/3146635876 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f47500a32c0 0x7f47500a5780 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f476006b7e0 tx=0x7f474c005c60 comp rx=0 tx=0).stop 2024-09-19T09:12:46.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:46.481+0000 7f4766f18640 1 -- 172.21.15.92:0/3146635876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4760100a70 msgr2=0x7f476019a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:46.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:46.481+0000 7f4766f18640 1 --2- 172.21.15.92:0/3146635876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4760100a70 0x7f476019a580 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f475400c920 tx=0x7f475400cde0 comp rx=0 tx=0).stop 2024-09-19T09:12:46.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:46.481+0000 7f4766f18640 1 -- 172.21.15.92:0/3146635876 shutdown_connections 2024-09-19T09:12:46.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:46.481+0000 7f4766f18640 1 --2- 172.21.15.92:0/3146635876 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4760106a70 0x7f476019ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:46.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:46.481+0000 7f4766f18640 1 --2- 172.21.15.92:0/3146635876 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4760101410 0x7f476019aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:46.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:46.481+0000 7f4766f18640 1 --2- 172.21.15.92:0/3146635876 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7f47500a32c0 0x7f47500a5780 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:46.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:46.481+0000 7f4766f18640 1 --2- 172.21.15.92:0/3146635876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4760100a70 0x7f476019a580 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:46.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:46.481+0000 7f4766f18640 1 -- 172.21.15.92:0/3146635876 >> 172.21.15.92:0/3146635876 conn(0x7f47600fc790 msgr2=0x7f476006a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:46.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:46.481+0000 7f4766f18640 1 -- 172.21.15.92:0/3146635876 shutdown_connections 2024-09-19T09:12:46.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:46.481+0000 7f4766f18640 1 -- 172.21.15.92:0/3146635876 wait complete. 2024-09-19T09:12:46.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:46 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3146635876' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:12:46.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:46 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3146635876' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:12:46.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:46 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3146635876' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:12:47.062 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T09:12:47.309 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:12:47.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:47 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3146635876' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:12:47.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:47 smithi092 ceph-mon[31407]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T09:12:47.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:47 smithi092 ceph-mon[31407]: pgmap v821: 65 pgs: 65 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:12:47.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.737+0000 7fb156046640 1 -- 172.21.15.92:0/1282092950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb150106f10 msgr2=0x7fb15010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:47.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.737+0000 7fb156046640 1 --2- 172.21.15.92:0/1282092950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb150106f10 0x7fb15010ea90 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fb148009ca0 tx=0x7fb14802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:12:47.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.737+0000 7fb156046640 1 -- 172.21.15.92:0/1282092950 shutdown_connections 2024-09-19T09:12:47.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.737+0000 7fb156046640 1 --2- 172.21.15.92:0/1282092950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb150106f10 0x7fb15010ea90 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:47.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.737+0000 7fb156046640 1 --2- 172.21.15.92:0/1282092950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb150102790 0x7fb1501067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:47.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.737+0000 7fb156046640 1 --2- 172.21.15.92:0/1282092950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb150101de0 0x7fb1501021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:47.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.737+0000 7fb156046640 1 -- 172.21.15.92:0/1282092950 >> 172.21.15.92:0/1282092950 conn(0x7fb1500fd8c0 msgr2=0x7fb1500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:47.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.737+0000 7fb156046640 1 -- 172.21.15.92:0/1282092950 shutdown_connections 2024-09-19T09:12:47.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.737+0000 7fb156046640 1 -- 172.21.15.92:0/1282092950 wait complete. 2024-09-19T09:12:47.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.738+0000 7fb156046640 1 Processor -- start 2024-09-19T09:12:47.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.738+0000 7fb156046640 1 -- start start 2024-09-19T09:12:47.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.739+0000 7fb156046640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb150101de0 0x7fb15019a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:47.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.739+0000 7fb156046640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb150102790 0x7fb15019a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:47.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.739+0000 7fb156046640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb150106f10 0x7fb15019ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:47.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.739+0000 7fb156046640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb150075ab0 con 0x7fb150101de0 2024-09-19T09:12:47.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.739+0000 7fb156046640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb150075930 con 0x7fb150106f10 2024-09-19T09:12:47.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.739+0000 7fb156046640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb150075c30 con 0x7fb150102790 2024-09-19T09:12:47.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.739+0000 7fb14effd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb150102790 0x7fb15019a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:47.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.739+0000 7fb14f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb150101de0 0x7fb15019a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:47.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.739+0000 7fb14f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb150101de0 0x7fb15019a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59350/0 (socket says 172.21.15.92:59350) 2024-09-19T09:12:47.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.739+0000 7fb14effd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb150102790 0x7fb15019a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.92:47492/0 (socket says 172.21.15.92:47492) 2024-09-19T09:12:47.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.739+0000 7fb14ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb150106f10 0x7fb15019ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:47.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.739+0000 7fb14f7fe640 1 -- 172.21.15.92:0/3797358248 learned_addr learned my addr 172.21.15.92:0/3797358248 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T09:12:47.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.739+0000 7fb14f7fe640 1 -- 172.21.15.92:0/3797358248 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb150102790 msgr2=0x7fb15019a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:47.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.739+0000 7fb14f7fe640 1 --2- 172.21.15.92:0/3797358248 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb150102790 0x7fb15019a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:47.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.739+0000 7fb14f7fe640 1 -- 172.21.15.92:0/3797358248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb150106f10 msgr2=0x7fb15019ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:47.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.739+0000 7fb14f7fe640 1 --2- 172.21.15.92:0/3797358248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb150106f10 0x7fb15019ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:47.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.739+0000 7fb14f7fe640 1 -- 172.21.15.92:0/3797358248 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb15019f460 con 0x7fb150101de0 2024-09-19T09:12:47.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.739+0000 7fb14f7fe640 1 --2- 172.21.15.92:0/3797358248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb150101de0 0x7fb15019a4b0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fb14000c920 tx=0x7fb14000cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:47.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.739+0000 7fb14cff9640 1 -- 172.21.15.92:0/3797358248 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb140007bb0 con 0x7fb150101de0 2024-09-19T09:12:47.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.739+0000 7fb156046640 1 -- 172.21.15.92:0/3797358248 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb15019f750 con 0x7fb150101de0 2024-09-19T09:12:47.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.739+0000 7fb14cff9640 1 -- 172.21.15.92:0/3797358248 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb140007d50 con 0x7fb150101de0 2024-09-19T09:12:47.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.739+0000 7fb14cff9640 1 -- 172.21.15.92:0/3797358248 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1400187d0 con 0x7fb150101de0 2024-09-19T09:12:47.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.740+0000 7fb156046640 1 -- 172.21.15.92:0/3797358248 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1501a7030 con 0x7fb150101de0 2024-09-19T09:12:47.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.740+0000 7fb156046640 1 -- 172.21.15.92:0/3797358248 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1501021c0 con 0x7fb150101de0 2024-09-19T09:12:47.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.742+0000 7fb14cff9640 1 -- 172.21.15.92:0/3797358248 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb14000f450 con 0x7fb150101de0 2024-09-19T09:12:47.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.742+0000 7fb14cff9640 1 --2- 172.21.15.92:0/3797358248 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb1380a3240 0x7fb1380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:47.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.742+0000 7fb14effd640 1 --2- 172.21.15.92:0/3797358248 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb1380a3240 0x7fb1380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:47.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.742+0000 7fb14cff9640 1 -- 172.21.15.92:0/3797358248 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7772+0+0 (secure 0 0 0) 0x7fb1400cf790 con 0x7fb150101de0 2024-09-19T09:12:47.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.743+0000 7fb14effd640 1 --2- 172.21.15.92:0/3797358248 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb1380a3240 0x7fb1380a5700 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb1500ff960 tx=0x7fb14400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:47.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.747+0000 7fb14cff9640 1 -- 172.21.15.92:0/3797358248 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb140014030 con 0x7fb150101de0 2024-09-19T09:12:47.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:47 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3146635876' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:12:47.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:47 smithi167 ceph-mon[35359]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T09:12:47.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:47 smithi167 ceph-mon[35359]: pgmap v821: 65 pgs: 65 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:12:47.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:47 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3146635876' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:12:47.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:47 smithi190 ceph-mon[35358]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T09:12:47.875 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:47 smithi190 ceph-mon[35358]: pgmap v821: 65 pgs: 65 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:12:47.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:47.914+0000 7fb156046640 1 -- 172.21.15.92:0/3797358248 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb15019b810 con 0x7fb150101de0 2024-09-19T09:12:48.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:48.490+0000 7fb14cff9640 1 -- 172.21.15.92:0/3797358248 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v85) ==== 169+0+0 (secure 0 0 0) 0x7fb14009c6d0 con 0x7fb150101de0 2024-09-19T09:12:48.492 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'cephfs_data' removed 2024-09-19T09:12:48.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:48.493+0000 7fb156046640 1 -- 172.21.15.92:0/3797358248 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb1380a3240 msgr2=0x7fb1380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:48.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:48.493+0000 7fb156046640 1 --2- 172.21.15.92:0/3797358248 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb1380a3240 0x7fb1380a5700 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb1500ff960 tx=0x7fb14400a2d0 comp rx=0 tx=0).stop 2024-09-19T09:12:48.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:48.493+0000 7fb156046640 1 -- 172.21.15.92:0/3797358248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb150101de0 msgr2=0x7fb15019a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:48.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:48.493+0000 7fb156046640 1 --2- 172.21.15.92:0/3797358248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb150101de0 0x7fb15019a4b0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fb14000c920 tx=0x7fb14000cd20 comp rx=0 tx=0).stop 2024-09-19T09:12:48.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:48.493+0000 7fb156046640 1 -- 172.21.15.92:0/3797358248 shutdown_connections 2024-09-19T09:12:48.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:48.493+0000 7fb156046640 1 --2- 172.21.15.92:0/3797358248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb150106f10 0x7fb15019ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:48.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:48.493+0000 7fb156046640 1 --2- 172.21.15.92:0/3797358248 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb150102790 0x7fb15019a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:48.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:48.493+0000 7fb156046640 1 --2- 172.21.15.92:0/3797358248 >> [v2:172.21.15.92:6800/2435349378,v1:172.21.15.92:6801/2435349378] conn(0x7fb1380a3240 0x7fb1380a5700 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:48.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:48.493+0000 7fb156046640 1 --2- 172.21.15.92:0/3797358248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb150101de0 0x7fb15019a4b0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:48.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:48.493+0000 7fb156046640 1 -- 172.21.15.92:0/3797358248 >> 172.21.15.92:0/3797358248 conn(0x7fb1500fd8c0 msgr2=0x7fb1500fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:48.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:48.493+0000 7fb156046640 1 -- 172.21.15.92:0/3797358248 shutdown_connections 2024-09-19T09:12:48.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T09:12:48.494+0000 7fb156046640 1 -- 172.21.15.92:0/3797358248 wait complete. 2024-09-19T09:12:48.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:48 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3797358248' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:12:48.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:48 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3797358248' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:12:48.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:48 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3797358248' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:12:49.112 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:12:49.137 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:12:49.165 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:12:49.194 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-19T09:12:49.194 DEBUG:teuthology.orchestra.run.smithi092:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T09:12:49.210 DEBUG:teuthology.orchestra.run.smithi167:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T09:12:49.231 DEBUG:teuthology.orchestra.run.smithi190:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T09:12:49.248 INFO:tasks.cephadm:Stopping all daemons... 2024-09-19T09:12:49.248 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-19T09:12:49.249 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mon.a 2024-09-19T09:12:49.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:49 smithi092 systemd[1]: Stopping Ceph mon.a for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T09:12:49.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:49 smithi092 ceph-mon[31407]: from='client.? 172.21.15.92:0/3797358248' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:12:49.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:49 smithi092 ceph-mon[31407]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T09:12:49.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:49 smithi092 ceph-mon[31407]: pgmap v823: 1 pgs: 1 active+clean; 577 KiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:12:49.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:49 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mon-a[31403]: 2024-09-19T09:12:49.644+0000 7fc21e153640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:12:49.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:49 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mon-a[31403]: 2024-09-19T09:12:49.644+0000 7fc21e153640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-19T09:12:49.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:49 smithi092 podman[117326]: 2024-09-19 09:12:49.727581621 +0000 UTC m=+0.197763503 container died 74d516b1b00e157432c551a974e2df145e0185400acace9997e25b3605bb71ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mon-a, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-19T09:12:49.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:49 smithi167 ceph-mon[35359]: from='client.? 172.21.15.92:0/3797358248' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:12:49.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:49 smithi167 ceph-mon[35359]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T09:12:49.852 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:49 smithi167 ceph-mon[35359]: pgmap v823: 1 pgs: 1 active+clean; 577 KiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:12:49.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:49 smithi190 ceph-mon[35358]: from='client.? 172.21.15.92:0/3797358248' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:12:49.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:49 smithi190 ceph-mon[35358]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T09:12:49.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:49 smithi190 ceph-mon[35358]: pgmap v823: 1 pgs: 1 active+clean; 577 KiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:12:50.355 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:50 smithi092 podman[117326]: 2024-09-19 09:12:50.112557248 +0000 UTC m=+0.582739166 container cleanup 74d516b1b00e157432c551a974e2df145e0185400acace9997e25b3605bb71ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mon-a, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:12:50.356 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 19 09:12:50 smithi092 bash[117326]: ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mon-a 2024-09-19T09:12:50.524 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mon.a.service' 2024-09-19T09:12:50.571 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:12:50.572 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-19T09:12:50.572 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-19T09:12:50.572 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mon.b 2024-09-19T09:12:50.848 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:50 smithi167 systemd[1]: Stopping Ceph mon.b for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T09:12:51.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:50 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mon-b[35355]: 2024-09-19T09:12:50.847+0000 7f2aa2443640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:12:51.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:50 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mon-b[35355]: 2024-09-19T09:12:50.847+0000 7f2aa2443640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-19T09:12:51.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:50 smithi167 podman[70644]: 2024-09-19 09:12:50.868404076 +0000 UTC m=+0.111249997 container died 9d435bae8dfd3ee2a4900cdce519ebbc017ce38aea1113b3846d302c42cf1d7a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mon-b, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-19T09:12:51.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:51 smithi167 podman[70644]: 2024-09-19 09:12:51.347900777 +0000 UTC m=+0.590746797 container cleanup 9d435bae8dfd3ee2a4900cdce519ebbc017ce38aea1113b3846d302c42cf1d7a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:12:51.602 INFO:journalctl@ceph.mon.b.smithi167.stdout:Sep 19 09:12:51 smithi167 bash[70644]: ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mon-b 2024-09-19T09:12:51.773 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mon.b.service' 2024-09-19T09:12:51.829 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:12:51.829 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-19T09:12:51.829 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-19T09:12:51.829 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mon.c 2024-09-19T09:12:52.124 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:51 smithi190 systemd[1]: Stopping Ceph mon.c for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T09:12:52.493 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:52 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mon-c[35354]: 2024-09-19T09:12:52.141+0000 7f00f443e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:12:52.493 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:52 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mon-c[35354]: 2024-09-19T09:12:52.141+0000 7f00f443e640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-19T09:12:52.493 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:52 smithi190 podman[70659]: 2024-09-19 09:12:52.22302532 +0000 UTC m=+0.204840911 container died 5b05f588d6ae970d313367bb86c81ce23761cfeb36f423feb4ca417c4d1895ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mon-c, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-19T09:12:53.035 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:52 smithi190 podman[70659]: 2024-09-19 09:12:52.783574259 +0000 UTC m=+0.765389861 container cleanup 5b05f588d6ae970d313367bb86c81ce23761cfeb36f423feb4ca417c4d1895ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mon-c, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:12:53.035 INFO:journalctl@ceph.mon.c.smithi190.stdout:Sep 19 09:12:52 smithi190 bash[70659]: ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mon-c 2024-09-19T09:12:53.211 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mon.c.service' 2024-09-19T09:12:53.261 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:12:53.261 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-19T09:12:53.261 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-19T09:12:53.262 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mgr.x 2024-09-19T09:12:53.568 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 09:12:53 smithi092 systemd[1]: Stopping Ceph mgr.x for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T09:12:53.869 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 09:12:53 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x[31632]: 2024-09-19T09:12:53.567+0000 7fa932406640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:12:53.869 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 09:12:53 smithi092 podman[117447]: 2024-09-19 09:12:53.598465031 +0000 UTC m=+0.151502504 container died 2a2f457ff5fa483a870859f21cadf73443415c85ec08009886896b950fc7c161 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:12:54.127 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 09:12:53 smithi092 podman[117447]: 2024-09-19 09:12:53.942808392 +0000 UTC m=+0.495845855 container cleanup 2a2f457ff5fa483a870859f21cadf73443415c85ec08009886896b950fc7c161 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD) 2024-09-19T09:12:54.127 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 19 09:12:53 smithi092 bash[117447]: ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-x 2024-09-19T09:12:54.353 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-19T09:12:54.388 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:12:54.388 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-19T09:12:54.388 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-19T09:12:54.389 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mgr.y 2024-09-19T09:12:54.757 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 09:12:54 smithi167 systemd[1]: Stopping Ceph mgr.y for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T09:12:55.045 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 09:12:54 smithi167 podman[70768]: 2024-09-19 09:12:54.757287498 +0000 UTC m=+0.160990381 container died 4818274be14c5e8e817b4fd850f4e0220307cbc9a25012d7818e3aca02b42424 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-19T09:12:55.321 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 09:12:55 smithi167 podman[70768]: 2024-09-19 09:12:55.14498723 +0000 UTC m=+0.548690154 container cleanup 4818274be14c5e8e817b4fd850f4e0220307cbc9a25012d7818e3aca02b42424 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-19T09:12:55.321 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 09:12:55 smithi167 bash[70768]: ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-y 2024-09-19T09:12:55.566 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-19T09:12:55.588 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 09:12:55 smithi167 podman[70782]: 2024-09-19 09:12:55.321154064 +0000 UTC m=+0.559242170 container remove 4818274be14c5e8e817b4fd850f4e0220307cbc9a25012d7818e3aca02b42424 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:12:55.588 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 09:12:55 smithi167 systemd[1]: ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-09-19T09:12:55.588 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 09:12:55 smithi167 systemd[1]: ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mgr.y.service: Failed with result 'exit-code'. 2024-09-19T09:12:55.588 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 09:12:55 smithi167 systemd[1]: Stopped Ceph mgr.y for 91ff74f2-7663-11ef-bceb-c7b262605968. 2024-09-19T09:12:55.588 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Sep 19 09:12:55 smithi167 systemd[1]: ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mgr.y.service: Consumed 6.778s CPU time. 2024-09-19T09:12:55.601 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:12:55.602 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-19T09:12:55.602 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-19T09:12:55.602 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mgr.z 2024-09-19T09:12:55.943 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Sep 19 09:12:55 smithi190 systemd[1]: Stopping Ceph mgr.z for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T09:12:56.230 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Sep 19 09:12:55 smithi190 podman[70784]: 2024-09-19 09:12:55.942789914 +0000 UTC m=+0.146030411 container died 48f7f2fac3d0407274fe08060985f8249f876ae8ae7ee379407781d9de8df9ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4) 2024-09-19T09:12:56.581 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Sep 19 09:12:56 smithi190 podman[70784]: 2024-09-19 09:12:56.330181216 +0000 UTC m=+0.533421749 container cleanup 48f7f2fac3d0407274fe08060985f8249f876ae8ae7ee379407781d9de8df9ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-z, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-19T09:12:56.581 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Sep 19 09:12:56 smithi190 bash[70784]: ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mgr-z 2024-09-19T09:12:56.747 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-19T09:12:56.782 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:12:56.783 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-19T09:12:56.783 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-19T09:12:56.783 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-91ff74f2-7663-11ef-bceb-c7b262605968@osd.0 2024-09-19T09:12:57.097 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 19 09:12:56 smithi092 systemd[1]: Stopping Ceph osd.0 for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T09:12:57.504 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 19 09:12:57 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-0[42949]: 2024-09-19T09:12:57.096+0000 7f83f5a62640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:12:57.504 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 19 09:12:57 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-0[42949]: 2024-09-19T09:12:57.096+0000 7f83f5a62640 -1 osd.0 85 *** Got signal Terminated *** 2024-09-19T09:12:57.504 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 19 09:12:57 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-0[42949]: 2024-09-19T09:12:57.096+0000 7f83f5a62640 -1 osd.0 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:13:02.939 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 19 09:13:02 smithi092 podman[117569]: 2024-09-19 09:13:02.687729868 +0000 UTC m=+5.708543029 container died d6f28ed9db5065a5942cb51710e9dd9a18250cf3bcf3c082de5c8873f9f72485 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T09:13:03.254 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 19 09:13:03 smithi092 podman[117569]: 2024-09-19 09:13:03.013015468 +0000 UTC m=+6.033828629 container cleanup d6f28ed9db5065a5942cb51710e9dd9a18250cf3bcf3c082de5c8873f9f72485 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:13:03.254 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 19 09:13:03 smithi092 bash[117569]: ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-0 2024-09-19T09:13:03.254 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 19 09:13:03 smithi092 podman[117584]: 2024-09-19 09:13:03.1893255 +0000 UTC m=+0.499021914 container remove d6f28ed9db5065a5942cb51710e9dd9a18250cf3bcf3c082de5c8873f9f72485 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-0, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:13:03.909 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 19 09:13:03 smithi092 podman[117671]: 2024-09-19 09:13:03.526365933 +0000 UTC m=+0.016147356 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:13:03.909 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 19 09:13:03 smithi092 podman[117671]: 2024-09-19 09:13:03.648691211 +0000 UTC m=+0.138472677 container create a314254cbef3fd3aa88afeaf4089e75f9bbb95366624b1a22b615ec9ad50a07c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-0-deactivate, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-19T09:13:03.909 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 19 09:13:03 smithi092 podman[117671]: 2024-09-19 09:13:03.834377286 +0000 UTC m=+0.324158714 container init a314254cbef3fd3aa88afeaf4089e75f9bbb95366624b1a22b615ec9ad50a07c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-19T09:13:03.909 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 19 09:13:03 smithi092 podman[117671]: 2024-09-19 09:13:03.837654787 +0000 UTC m=+0.327436214 container start a314254cbef3fd3aa88afeaf4089e75f9bbb95366624b1a22b615ec9ad50a07c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T09:13:03.910 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 19 09:13:03 smithi092 podman[117671]: 2024-09-19 09:13:03.909302755 +0000 UTC m=+0.399084182 container attach a314254cbef3fd3aa88afeaf4089e75f9bbb95366624b1a22b615ec9ad50a07c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2) 2024-09-19T09:13:04.253 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 19 09:13:04 smithi092 podman[117671]: 2024-09-19 09:13:04.032927262 +0000 UTC m=+0.522708687 container died a314254cbef3fd3aa88afeaf4089e75f9bbb95366624b1a22b615ec9ad50a07c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T09:13:04.609 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@osd.0.service' 2024-09-19T09:13:04.648 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:13:04.648 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-19T09:13:04.648 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-19T09:13:04.648 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-91ff74f2-7663-11ef-bceb-c7b262605968@osd.1 2024-09-19T09:13:04.966 INFO:journalctl@ceph.osd.1.smithi167.stdout:Sep 19 09:13:04 smithi167 systemd[1]: Stopping Ceph osd.1 for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T09:13:05.352 INFO:journalctl@ceph.osd.1.smithi167.stdout:Sep 19 09:13:04 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-1[39853]: 2024-09-19T09:13:04.965+0000 7f2fcc25b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:13:05.352 INFO:journalctl@ceph.osd.1.smithi167.stdout:Sep 19 09:13:04 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-1[39853]: 2024-09-19T09:13:04.965+0000 7f2fcc25b640 -1 osd.1 85 *** Got signal Terminated *** 2024-09-19T09:13:05.352 INFO:journalctl@ceph.osd.1.smithi167.stdout:Sep 19 09:13:04 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-1[39853]: 2024-09-19T09:13:04.965+0000 7f2fcc25b640 -1 osd.1 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:13:10.725 INFO:journalctl@ceph.osd.1.smithi167.stdout:Sep 19 09:13:10 smithi167 podman[70897]: 2024-09-19 09:13:10.422728704 +0000 UTC m=+5.572218852 container died 1b18703c68d5ae870cd2821c06463c4b24b8e276bc7aea97188e34246ca221a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-1, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-19T09:13:11.034 INFO:journalctl@ceph.osd.1.smithi167.stdout:Sep 19 09:13:10 smithi167 podman[70897]: 2024-09-19 09:13:10.816131113 +0000 UTC m=+5.965621250 container cleanup 1b18703c68d5ae870cd2821c06463c4b24b8e276bc7aea97188e34246ca221a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-1, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-19T09:13:11.034 INFO:journalctl@ceph.osd.1.smithi167.stdout:Sep 19 09:13:10 smithi167 bash[70897]: ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-1 2024-09-19T09:13:11.352 INFO:journalctl@ceph.osd.1.smithi167.stdout:Sep 19 09:13:11 smithi167 podman[70911]: 2024-09-19 09:13:11.034003794 +0000 UTC m=+0.609508390 container remove 1b18703c68d5ae870cd2821c06463c4b24b8e276bc7aea97188e34246ca221a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-1, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T09:13:11.621 INFO:journalctl@ceph.osd.1.smithi167.stdout:Sep 19 09:13:11 smithi167 podman[71001]: 2024-09-19 09:13:11.268481507 +0000 UTC m=+0.016015142 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:13:11.625 INFO:journalctl@ceph.osd.1.smithi167.stdout:Sep 19 09:13:11 smithi167 podman[71001]: 2024-09-19 09:13:11.376659678 +0000 UTC m=+0.124193293 container create 6c3980a2e621066595b2fa164f40604f4372fab4d6fd23cf18cb077a3971700e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-19T09:13:11.625 INFO:journalctl@ceph.osd.1.smithi167.stdout:Sep 19 09:13:11 smithi167 podman[71001]: 2024-09-19 09:13:11.620830129 +0000 UTC m=+0.368363754 container init 6c3980a2e621066595b2fa164f40604f4372fab4d6fd23cf18cb077a3971700e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-19T09:13:12.102 INFO:journalctl@ceph.osd.1.smithi167.stdout:Sep 19 09:13:11 smithi167 podman[71001]: 2024-09-19 09:13:11.624101311 +0000 UTC m=+0.371634930 container start 6c3980a2e621066595b2fa164f40604f4372fab4d6fd23cf18cb077a3971700e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, ceph=True) 2024-09-19T09:13:12.103 INFO:journalctl@ceph.osd.1.smithi167.stdout:Sep 19 09:13:11 smithi167 podman[71001]: 2024-09-19 09:13:11.720847598 +0000 UTC m=+0.468381221 container attach 6c3980a2e621066595b2fa164f40604f4372fab4d6fd23cf18cb077a3971700e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-19T09:13:12.103 INFO:journalctl@ceph.osd.1.smithi167.stdout:Sep 19 09:13:11 smithi167 podman[71001]: 2024-09-19 09:13:11.817598098 +0000 UTC m=+0.565131715 container died 6c3980a2e621066595b2fa164f40604f4372fab4d6fd23cf18cb077a3971700e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T09:13:12.466 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@osd.1.service' 2024-09-19T09:13:12.505 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:13:12.506 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-19T09:13:12.506 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-19T09:13:12.506 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-91ff74f2-7663-11ef-bceb-c7b262605968@osd.2 2024-09-19T09:13:12.800 INFO:journalctl@ceph.osd.2.smithi190.stdout:Sep 19 09:13:12 smithi190 systemd[1]: Stopping Ceph osd.2 for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T09:13:13.062 INFO:journalctl@ceph.osd.2.smithi190.stdout:Sep 19 09:13:12 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-2[40361]: 2024-09-19T09:13:12.799+0000 7f13e40dc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:13:13.063 INFO:journalctl@ceph.osd.2.smithi190.stdout:Sep 19 09:13:12 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-2[40361]: 2024-09-19T09:13:12.799+0000 7f13e40dc640 -1 osd.2 85 *** Got signal Terminated *** 2024-09-19T09:13:13.063 INFO:journalctl@ceph.osd.2.smithi190.stdout:Sep 19 09:13:12 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-2[40361]: 2024-09-19T09:13:12.799+0000 7f13e40dc640 -1 osd.2 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:13:18.509 INFO:journalctl@ceph.osd.2.smithi190.stdout:Sep 19 09:13:18 smithi190 podman[70908]: 2024-09-19 09:13:18.188659502 +0000 UTC m=+5.492969607 container died 6f9e74c582d50919ccd9de1f6bafa6b93205b8b07e495d8b75e061b8f958f731 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:13:18.874 INFO:journalctl@ceph.osd.2.smithi190.stdout:Sep 19 09:13:18 smithi190 podman[70908]: 2024-09-19 09:13:18.508188251 +0000 UTC m=+5.812498355 container cleanup 6f9e74c582d50919ccd9de1f6bafa6b93205b8b07e495d8b75e061b8f958f731 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:13:18.874 INFO:journalctl@ceph.osd.2.smithi190.stdout:Sep 19 09:13:18 smithi190 bash[70908]: ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-2 2024-09-19T09:13:18.874 INFO:journalctl@ceph.osd.2.smithi190.stdout:Sep 19 09:13:18 smithi190 podman[70935]: 2024-09-19 09:13:18.717549028 +0000 UTC m=+0.529261477 container remove 6f9e74c582d50919ccd9de1f6bafa6b93205b8b07e495d8b75e061b8f958f731 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-19T09:13:19.470 INFO:journalctl@ceph.osd.2.smithi190.stdout:Sep 19 09:13:19 smithi190 podman[71028]: 2024-09-19 09:13:19.033621432 +0000 UTC m=+0.015818996 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:13:19.471 INFO:journalctl@ceph.osd.2.smithi190.stdout:Sep 19 09:13:19 smithi190 podman[71028]: 2024-09-19 09:13:19.143449003 +0000 UTC m=+0.125646553 container create efca7c43661d2e8f3224f66a1111d94d383ec3c04cc37dd9b16186a17aa6f5ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-19T09:13:19.471 INFO:journalctl@ceph.osd.2.smithi190.stdout:Sep 19 09:13:19 smithi190 podman[71028]: 2024-09-19 09:13:19.362478334 +0000 UTC m=+0.344675887 container init efca7c43661d2e8f3224f66a1111d94d383ec3c04cc37dd9b16186a17aa6f5ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-2f599a4) 2024-09-19T09:13:19.471 INFO:journalctl@ceph.osd.2.smithi190.stdout:Sep 19 09:13:19 smithi190 podman[71028]: 2024-09-19 09:13:19.365822926 +0000 UTC m=+0.348020482 container start efca7c43661d2e8f3224f66a1111d94d383ec3c04cc37dd9b16186a17aa6f5ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:13:19.471 INFO:journalctl@ceph.osd.2.smithi190.stdout:Sep 19 09:13:19 smithi190 podman[71028]: 2024-09-19 09:13:19.470666467 +0000 UTC m=+0.452864031 container attach efca7c43661d2e8f3224f66a1111d94d383ec3c04cc37dd9b16186a17aa6f5ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-19T09:13:19.840 INFO:journalctl@ceph.osd.2.smithi190.stdout:Sep 19 09:13:19 smithi190 podman[71028]: 2024-09-19 09:13:19.551155557 +0000 UTC m=+0.533353107 container died efca7c43661d2e8f3224f66a1111d94d383ec3c04cc37dd9b16186a17aa6f5ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-19T09:13:20.124 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@osd.2.service' 2024-09-19T09:13:20.165 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:13:20.165 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-19T09:13:20.165 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-19T09:13:20.165 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-91ff74f2-7663-11ef-bceb-c7b262605968@osd.3 2024-09-19T09:13:20.464 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 19 09:13:20 smithi092 systemd[1]: Stopping Ceph osd.3 for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T09:13:20.754 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 19 09:13:20 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-3[49435]: 2024-09-19T09:13:20.462+0000 7f7d2a0b9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:13:20.754 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 19 09:13:20 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-3[49435]: 2024-09-19T09:13:20.462+0000 7f7d2a0b9640 -1 osd.3 85 *** Got signal Terminated *** 2024-09-19T09:13:20.754 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 19 09:13:20 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-3[49435]: 2024-09-19T09:13:20.462+0000 7f7d2a0b9640 -1 osd.3 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:13:23.352 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:23 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:23.070+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:13:24.254 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:23 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:23.780+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.462803+0000 front 2024-09-19T09:12:59.462788+0000 (oldest deadline 2024-09-19T09:13:23.563010+0000) 2024-09-19T09:13:24.352 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:24 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:24.034+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:13:24.875 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:24 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:24.477+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:13:25.254 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:24 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:24.788+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.462803+0000 front 2024-09-19T09:12:59.462788+0000 (oldest deadline 2024-09-19T09:13:23.563010+0000) 2024-09-19T09:13:25.352 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:25 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:25.046+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:13:25.374 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:24 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:24.984+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:13:25.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:25 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:25.482+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:13:26.056 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:25 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:25.794+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.462803+0000 front 2024-09-19T09:12:59.462788+0000 (oldest deadline 2024-09-19T09:13:23.563010+0000) 2024-09-19T09:13:26.340 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 19 09:13:26 smithi092 podman[117776]: 2024-09-19 09:13:26.056373978 +0000 UTC m=+5.691332103 container died 6c62cdb7d08636bd050458d8b8f5571359fbfc22f7d8db8007fc88843f529632 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-3, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-19T09:13:26.352 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:26 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:26.005+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:13:26.374 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:25 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5[47211]: 2024-09-19T09:13:25.887+0000 7f2157b0b640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.985036+0000 front 2024-09-19T09:13:01.985259+0000 (oldest deadline 2024-09-19T09:13:25.484974+0000) 2024-09-19T09:13:26.375 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:25 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:25.990+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:13:26.673 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 19 09:13:26 smithi092 podman[117776]: 2024-09-19 09:13:26.505553994 +0000 UTC m=+6.140512110 container cleanup 6c62cdb7d08636bd050458d8b8f5571359fbfc22f7d8db8007fc88843f529632 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-3, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T09:13:26.674 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 19 09:13:26 smithi092 bash[117776]: ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-3 2024-09-19T09:13:26.674 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:26 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:26.437+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:13:26.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:26 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:26.436+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:13:27.003 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 19 09:13:26 smithi092 podman[117801]: 2024-09-19 09:13:26.673767051 +0000 UTC m=+0.619844543 container remove 6c62cdb7d08636bd050458d8b8f5571359fbfc22f7d8db8007fc88843f529632 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-19T09:13:27.004 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:26 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:26.842+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.462803+0000 front 2024-09-19T09:12:59.462788+0000 (oldest deadline 2024-09-19T09:13:23.563010+0000) 2024-09-19T09:13:27.352 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:27 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:27.024+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:13:27.369 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 19 09:13:27 smithi092 podman[117892]: 2024-09-19 09:13:27.099884616 +0000 UTC m=+0.099099922 container create 2e5e2585d9ecfc2fa4d5bc94bbac9334c1cce1a863705ad6f8cbb758b2ca483f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:13:27.369 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 19 09:13:27 smithi092 podman[117892]: 2024-09-19 09:13:27.016588219 +0000 UTC m=+0.015803525 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:13:27.369 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 19 09:13:27 smithi092 podman[117892]: 2024-09-19 09:13:27.277165005 +0000 UTC m=+0.276380311 container init 2e5e2585d9ecfc2fa4d5bc94bbac9334c1cce1a863705ad6f8cbb758b2ca483f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:13:27.369 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 19 09:13:27 smithi092 podman[117892]: 2024-09-19 09:13:27.280353114 +0000 UTC m=+0.279568421 container start 2e5e2585d9ecfc2fa4d5bc94bbac9334c1cce1a863705ad6f8cbb758b2ca483f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-19T09:13:27.369 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 19 09:13:27 smithi092 podman[117892]: 2024-09-19 09:13:27.368861225 +0000 UTC m=+0.368076541 container attach 2e5e2585d9ecfc2fa4d5bc94bbac9334c1cce1a863705ad6f8cbb758b2ca483f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-19T09:13:27.374 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:27 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:27.016+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:13:27.374 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:26 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5[47211]: 2024-09-19T09:13:26.899+0000 7f2157b0b640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.985036+0000 front 2024-09-19T09:13:01.985259+0000 (oldest deadline 2024-09-19T09:13:25.484974+0000) 2024-09-19T09:13:27.747 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 19 09:13:27 smithi092 podman[117892]: 2024-09-19 09:13:27.476102283 +0000 UTC m=+0.475317593 container died 2e5e2585d9ecfc2fa4d5bc94bbac9334c1cce1a863705ad6f8cbb758b2ca483f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-19T09:13:27.747 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:27 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:27.472+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:13:27.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:27 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:27.404+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:13:28.003 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:27 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:27.810+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.462803+0000 front 2024-09-19T09:12:59.462788+0000 (oldest deadline 2024-09-19T09:13:23.563010+0000) 2024-09-19T09:13:28.033 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@osd.3.service' 2024-09-19T09:13:28.074 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:13:28.075 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-19T09:13:28.075 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-19T09:13:28.075 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-91ff74f2-7663-11ef-bceb-c7b262605968@osd.4 2024-09-19T09:13:28.352 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 19 09:13:28 smithi167 systemd[1]: Stopping Ceph osd.4 for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T09:13:28.353 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:27 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:27.980+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:13:28.374 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:27 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5[47211]: 2024-09-19T09:13:27.906+0000 7f2157b0b640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.985036+0000 front 2024-09-19T09:13:01.985259+0000 (oldest deadline 2024-09-19T09:13:25.484974+0000) 2024-09-19T09:13:28.374 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:28 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:28.033+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:13:28.753 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:28 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:28.444+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:13:28.852 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 19 09:13:28 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-4[46640]: 2024-09-19T09:13:28.384+0000 7efd99853640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:13:28.852 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 19 09:13:28 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-4[46640]: 2024-09-19T09:13:28.384+0000 7efd99853640 -1 osd.4 85 *** Got signal Terminated *** 2024-09-19T09:13:28.852 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 19 09:13:28 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-4[46640]: 2024-09-19T09:13:28.384+0000 7efd99853640 -1 osd.4 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:13:28.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:28 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:28.375+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:13:29.254 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:28 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:28.804+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.462803+0000 front 2024-09-19T09:12:59.462788+0000 (oldest deadline 2024-09-19T09:13:23.563010+0000) 2024-09-19T09:13:29.352 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:28 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:28.963+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:13:29.364 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:28 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5[47211]: 2024-09-19T09:13:28.900+0000 7f2157b0b640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.985036+0000 front 2024-09-19T09:13:01.985259+0000 (oldest deadline 2024-09-19T09:13:25.484974+0000) 2024-09-19T09:13:29.364 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:29 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:29.074+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:13:29.624 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:29 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:29.363+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:13:29.753 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:29 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:29.486+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:13:30.254 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:29 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:29.845+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.462803+0000 front 2024-09-19T09:12:59.462788+0000 (oldest deadline 2024-09-19T09:13:23.563010+0000) 2024-09-19T09:13:30.352 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:29 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:29.988+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:13:30.369 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:29 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5[47211]: 2024-09-19T09:13:29.949+0000 7f2157b0b640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.985036+0000 front 2024-09-19T09:13:01.985259+0000 (oldest deadline 2024-09-19T09:13:25.484974+0000) 2024-09-19T09:13:30.370 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:30 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:30.048+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:13:30.624 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:30 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:30.369+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:13:30.821 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:30 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:30.512+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:13:31.254 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:30 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:30.820+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.462803+0000 front 2024-09-19T09:12:59.462788+0000 (oldest deadline 2024-09-19T09:13:23.563010+0000) 2024-09-19T09:13:31.352 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:31 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:31.037+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:13:31.374 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:30 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5[47211]: 2024-09-19T09:13:30.951+0000 7f2157b0b640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.985036+0000 front 2024-09-19T09:13:01.985259+0000 (oldest deadline 2024-09-19T09:13:25.484974+0000) 2024-09-19T09:13:31.374 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:31 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:31.048+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:13:31.374 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:31 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:31.048+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:13:31.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:31 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:31.497+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:13:31.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:31 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:31.373+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:13:32.253 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:31 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:31.809+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.462803+0000 front 2024-09-19T09:12:59.462788+0000 (oldest deadline 2024-09-19T09:13:23.563010+0000) 2024-09-19T09:13:32.352 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:32 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:32.086+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:13:32.352 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:32 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:32.086+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:13:32.374 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:31 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5[47211]: 2024-09-19T09:13:31.989+0000 7f2157b0b640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.985036+0000 front 2024-09-19T09:13:01.985259+0000 (oldest deadline 2024-09-19T09:13:25.484974+0000) 2024-09-19T09:13:32.374 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:31 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5[47211]: 2024-09-19T09:13:31.989+0000 7f2157b0b640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.585983+0000 front 2024-09-19T09:13:09.585973+0000 (oldest deadline 2024-09-19T09:13:31.285810+0000) 2024-09-19T09:13:32.375 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:32 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:32.090+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:13:32.375 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:32 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:32.090+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:13:32.753 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:32 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:32.483+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:13:32.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:32 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:32.381+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:13:33.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:32 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:32.805+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.690613+0000 front 2024-09-19T09:13:09.690369+0000 (oldest deadline 2024-09-19T09:13:31.990408+0000) 2024-09-19T09:13:33.254 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:32 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:32.771+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.462803+0000 front 2024-09-19T09:12:59.462788+0000 (oldest deadline 2024-09-19T09:13:23.563010+0000) 2024-09-19T09:13:33.374 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:33 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:33.072+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:13:33.375 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:33 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:33.072+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:13:33.375 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:32 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5[47211]: 2024-09-19T09:13:32.954+0000 7f2157b0b640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.985036+0000 front 2024-09-19T09:13:01.985259+0000 (oldest deadline 2024-09-19T09:13:25.484974+0000) 2024-09-19T09:13:33.375 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:32 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5[47211]: 2024-09-19T09:13:32.954+0000 7f2157b0b640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.585983+0000 front 2024-09-19T09:13:09.585973+0000 (oldest deadline 2024-09-19T09:13:31.285810+0000) 2024-09-19T09:13:33.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:33 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:33.106+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:13:33.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:33 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:33.106+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:13:33.745 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:33 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:33.489+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:13:33.745 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:33 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:33.489+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:13:33.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:33 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:33.424+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:13:34.004 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:33 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:33.742+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.462803+0000 front 2024-09-19T09:12:59.462788+0000 (oldest deadline 2024-09-19T09:13:23.563010+0000) 2024-09-19T09:13:34.095 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:33 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:33.824+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.690613+0000 front 2024-09-19T09:13:09.690369+0000 (oldest deadline 2024-09-19T09:13:31.990408+0000) 2024-09-19T09:13:34.095 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 19 09:13:33 smithi167 podman[71115]: 2024-09-19 09:13:33.836314198 +0000 UTC m=+5.562840258 container died a7e0b27e2938ddd8696076fce204249ac7db519091b8495adbfbe0ef6f972325 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-19T09:13:34.352 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 19 09:13:34 smithi167 podman[71115]: 2024-09-19 09:13:34.193832173 +0000 UTC m=+5.920358231 container cleanup a7e0b27e2938ddd8696076fce204249ac7db519091b8495adbfbe0ef6f972325 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-4, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-19T09:13:34.352 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 19 09:13:34 smithi167 bash[71115]: ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-4 2024-09-19T09:13:34.352 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:34 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:34.152+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:13:34.352 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:34 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:34.152+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:13:34.374 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:34 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:34.081+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:13:34.374 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:34 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:34.081+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:13:34.375 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:33 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5[47211]: 2024-09-19T09:13:33.985+0000 7f2157b0b640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.985036+0000 front 2024-09-19T09:13:01.985259+0000 (oldest deadline 2024-09-19T09:13:25.484974+0000) 2024-09-19T09:13:34.375 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:33 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5[47211]: 2024-09-19T09:13:33.985+0000 7f2157b0b640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.585983+0000 front 2024-09-19T09:13:09.585973+0000 (oldest deadline 2024-09-19T09:13:31.285810+0000) 2024-09-19T09:13:34.754 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:34 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:34.693+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.462803+0000 front 2024-09-19T09:12:59.462788+0000 (oldest deadline 2024-09-19T09:13:23.563010+0000) 2024-09-19T09:13:34.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:34 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:34.448+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:13:34.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:34 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:34.448+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:13:34.793 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 19 09:13:34 smithi167 podman[71132]: 2024-09-19 09:13:34.502081118 +0000 UTC m=+0.659562966 container remove a7e0b27e2938ddd8696076fce204249ac7db519091b8495adbfbe0ef6f972325 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-19T09:13:34.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:34 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:34.380+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:13:35.048 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:34 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:34.792+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.690613+0000 front 2024-09-19T09:13:09.690369+0000 (oldest deadline 2024-09-19T09:13:31.990408+0000) 2024-09-19T09:13:35.049 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 19 09:13:34 smithi167 podman[71219]: 2024-09-19 09:13:34.714797121 +0000 UTC m=+0.015628265 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:13:35.049 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 19 09:13:34 smithi167 podman[71219]: 2024-09-19 09:13:34.821240707 +0000 UTC m=+0.122071881 container create 825299b39748b6fdd78a47ddcfd3fb9dd962ea2fc406db06fdbfa51d72ed697b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:13:35.352 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:35 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:35.154+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:13:35.352 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:35 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:35.154+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:13:35.352 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 19 09:13:35 smithi167 podman[71219]: 2024-09-19 09:13:35.048614449 +0000 UTC m=+0.349445588 container init 825299b39748b6fdd78a47ddcfd3fb9dd962ea2fc406db06fdbfa51d72ed697b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:13:35.352 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 19 09:13:35 smithi167 podman[71219]: 2024-09-19 09:13:35.052193509 +0000 UTC m=+0.353024649 container start 825299b39748b6fdd78a47ddcfd3fb9dd962ea2fc406db06fdbfa51d72ed697b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4) 2024-09-19T09:13:35.353 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 19 09:13:35 smithi167 podman[71219]: 2024-09-19 09:13:35.13181762 +0000 UTC m=+0.432648751 container attach 825299b39748b6fdd78a47ddcfd3fb9dd962ea2fc406db06fdbfa51d72ed697b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:13:35.353 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 19 09:13:35 smithi167 podman[71219]: 2024-09-19 09:13:35.245636112 +0000 UTC m=+0.546467244 container died 825299b39748b6fdd78a47ddcfd3fb9dd962ea2fc406db06fdbfa51d72ed697b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4) 2024-09-19T09:13:35.372 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:35 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:35.093+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:13:35.372 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:35 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:35.093+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:13:35.372 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:35 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5[47211]: 2024-09-19T09:13:35.030+0000 7f2157b0b640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.985036+0000 front 2024-09-19T09:13:01.985259+0000 (oldest deadline 2024-09-19T09:13:25.484974+0000) 2024-09-19T09:13:35.372 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:35 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5[47211]: 2024-09-19T09:13:35.030+0000 7f2157b0b640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.585983+0000 front 2024-09-19T09:13:09.585973+0000 (oldest deadline 2024-09-19T09:13:31.285810+0000) 2024-09-19T09:13:35.624 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:35 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:35.371+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:13:35.754 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:35 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:35.661+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.462803+0000 front 2024-09-19T09:12:59.462788+0000 (oldest deadline 2024-09-19T09:13:23.563010+0000) 2024-09-19T09:13:35.754 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:35 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:35.661+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:08.864112+0000 front 2024-09-19T09:13:08.864088+0000 (oldest deadline 2024-09-19T09:13:34.764163+0000) 2024-09-19T09:13:35.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:35 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:35.496+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:13:35.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:35 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:35.496+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:13:35.835 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:35 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:35.757+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.690613+0000 front 2024-09-19T09:13:09.690369+0000 (oldest deadline 2024-09-19T09:13:31.990408+0000) 2024-09-19T09:13:35.859 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@osd.4.service' 2024-09-19T09:13:35.901 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:13:35.901 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-19T09:13:35.901 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-19T09:13:35.901 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-91ff74f2-7663-11ef-bceb-c7b262605968@osd.5 2024-09-19T09:13:36.217 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:36 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:36.134+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:13:36.218 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:36 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:36.135+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:13:36.218 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:35 smithi190 systemd[1]: Stopping Ceph osd.5 for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T09:13:36.218 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:36 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5[47211]: 2024-09-19T09:13:36.043+0000 7f2157b0b640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.985036+0000 front 2024-09-19T09:13:01.985259+0000 (oldest deadline 2024-09-19T09:13:25.484974+0000) 2024-09-19T09:13:36.218 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:36 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5[47211]: 2024-09-19T09:13:36.043+0000 7f2157b0b640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.585983+0000 front 2024-09-19T09:13:09.585973+0000 (oldest deadline 2024-09-19T09:13:31.285810+0000) 2024-09-19T09:13:36.218 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:36 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5[47211]: 2024-09-19T09:13:36.217+0000 7f215f50e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:13:36.218 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:36 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5[47211]: 2024-09-19T09:13:36.217+0000 7f215f50e640 -1 osd.5 85 *** Got signal Terminated *** 2024-09-19T09:13:36.218 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:36 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5[47211]: 2024-09-19T09:13:36.217+0000 7f215f50e640 -1 osd.5 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:13:36.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:36 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:36.131+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:13:36.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:36 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:36.131+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:13:36.624 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:36 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:36.394+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:13:36.754 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:36 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:36.682+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.462803+0000 front 2024-09-19T09:12:59.462788+0000 (oldest deadline 2024-09-19T09:13:23.563010+0000) 2024-09-19T09:13:36.754 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:36 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:36.682+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:08.864112+0000 front 2024-09-19T09:13:08.864088+0000 (oldest deadline 2024-09-19T09:13:34.764163+0000) 2024-09-19T09:13:36.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:36 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:36.482+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:13:36.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:36 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:36.482+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:13:37.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:36 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:36.716+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.690613+0000 front 2024-09-19T09:13:09.690369+0000 (oldest deadline 2024-09-19T09:13:31.990408+0000) 2024-09-19T09:13:37.374 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:37 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5[47211]: 2024-09-19T09:13:37.093+0000 7f2157b0b640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.985036+0000 front 2024-09-19T09:13:01.985259+0000 (oldest deadline 2024-09-19T09:13:25.484974+0000) 2024-09-19T09:13:37.374 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:37 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5[47211]: 2024-09-19T09:13:37.093+0000 7f2157b0b640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.585983+0000 front 2024-09-19T09:13:09.585973+0000 (oldest deadline 2024-09-19T09:13:31.285810+0000) 2024-09-19T09:13:37.375 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:37 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:37.174+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:13:37.375 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:37 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:37.174+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:13:37.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:37 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:37.181+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:13:37.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:37 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:37.181+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:13:37.754 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:37 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:37.704+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.462803+0000 front 2024-09-19T09:12:59.462788+0000 (oldest deadline 2024-09-19T09:13:23.563010+0000) 2024-09-19T09:13:37.754 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:37 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:37.704+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:08.864112+0000 front 2024-09-19T09:13:08.864088+0000 (oldest deadline 2024-09-19T09:13:34.764163+0000) 2024-09-19T09:13:37.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:37 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:37.454+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:13:37.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:37 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:37.454+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:13:37.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:37 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:37.382+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:13:38.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:37 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:37.711+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.690613+0000 front 2024-09-19T09:13:09.690369+0000 (oldest deadline 2024-09-19T09:13:31.990408+0000) 2024-09-19T09:13:38.356 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:38 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:38.186+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:13:38.356 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:38 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:38.186+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:13:38.356 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:38 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5[47211]: 2024-09-19T09:13:38.088+0000 7f2157b0b640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.985036+0000 front 2024-09-19T09:13:01.985259+0000 (oldest deadline 2024-09-19T09:13:25.484974+0000) 2024-09-19T09:13:38.356 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:38 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5[47211]: 2024-09-19T09:13:38.088+0000 7f2157b0b640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.585983+0000 front 2024-09-19T09:13:09.585973+0000 (oldest deadline 2024-09-19T09:13:31.285810+0000) 2024-09-19T09:13:38.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:38 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:38.162+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:13:38.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:38 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:38.162+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:13:38.624 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:38 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:38.355+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:13:38.687 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:38 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:38.405+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:13:38.687 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:38 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:38.405+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:13:39.004 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:38 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:38.686+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.462803+0000 front 2024-09-19T09:12:59.462788+0000 (oldest deadline 2024-09-19T09:13:23.563010+0000) 2024-09-19T09:13:39.004 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:38 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:38.686+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:08.864112+0000 front 2024-09-19T09:13:08.864088+0000 (oldest deadline 2024-09-19T09:13:34.764163+0000) 2024-09-19T09:13:39.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:38 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:38.743+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.690613+0000 front 2024-09-19T09:13:09.690369+0000 (oldest deadline 2024-09-19T09:13:31.990408+0000) 2024-09-19T09:13:39.319 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:39 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:39.196+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:13:39.320 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:39 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:39.196+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:13:39.320 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:39 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:39.196+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:13:39.320 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:39 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5[47211]: 2024-09-19T09:13:39.043+0000 7f2157b0b640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.985036+0000 front 2024-09-19T09:13:01.985259+0000 (oldest deadline 2024-09-19T09:13:25.484974+0000) 2024-09-19T09:13:39.320 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:39 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5[47211]: 2024-09-19T09:13:39.043+0000 7f2157b0b640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.585983+0000 front 2024-09-19T09:13:09.585973+0000 (oldest deadline 2024-09-19T09:13:31.285810+0000) 2024-09-19T09:13:39.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:39 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:39.166+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:13:39.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:39 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:39.167+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:13:39.624 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:39 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:39.319+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:13:39.624 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:39 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:39.319+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:14.844594+0000 front 2024-09-19T09:13:14.844692+0000 (oldest deadline 2024-09-19T09:13:38.944688+0000) 2024-09-19T09:13:39.729 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:39 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:39.373+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:13:39.729 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:39 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:39.373+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:13:40.004 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:39 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:39.728+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.462803+0000 front 2024-09-19T09:12:59.462788+0000 (oldest deadline 2024-09-19T09:13:23.563010+0000) 2024-09-19T09:13:40.004 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:39 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:39.728+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:08.864112+0000 front 2024-09-19T09:13:08.864088+0000 (oldest deadline 2024-09-19T09:13:34.764163+0000) 2024-09-19T09:13:40.004 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:39 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:39.728+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:14.765001+0000 front 2024-09-19T09:13:14.764757+0000 (oldest deadline 2024-09-19T09:13:39.464614+0000) 2024-09-19T09:13:40.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:39 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:39.775+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.690613+0000 front 2024-09-19T09:13:09.690369+0000 (oldest deadline 2024-09-19T09:13:31.990408+0000) 2024-09-19T09:13:40.303 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:40 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5[47211]: 2024-09-19T09:13:40.022+0000 7f2157b0b640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.985036+0000 front 2024-09-19T09:13:01.985259+0000 (oldest deadline 2024-09-19T09:13:25.484974+0000) 2024-09-19T09:13:40.303 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:40 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5[47211]: 2024-09-19T09:13:40.022+0000 7f2157b0b640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.585983+0000 front 2024-09-19T09:13:09.585973+0000 (oldest deadline 2024-09-19T09:13:31.285810+0000) 2024-09-19T09:13:40.303 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:40 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:40.206+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:13:40.303 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:40 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:40.206+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:13:40.304 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:40 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:40.206+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:13:40.373 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:40 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:40.138+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:13:40.373 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:40 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:40.138+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:13:40.624 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:40 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:40.302+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:13:40.624 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:40 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:40.302+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:14.844594+0000 front 2024-09-19T09:13:14.844692+0000 (oldest deadline 2024-09-19T09:13:38.944688+0000) 2024-09-19T09:13:40.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:40 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:40.402+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:13:40.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:40 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:40.402+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:13:40.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:40 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:40.402+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:16.798224+0000 front 2024-09-19T09:13:16.798130+0000 (oldest deadline 2024-09-19T09:13:40.298009+0000) 2024-09-19T09:13:41.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:40 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:40.760+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.690613+0000 front 2024-09-19T09:13:09.690369+0000 (oldest deadline 2024-09-19T09:13:31.990408+0000) 2024-09-19T09:13:41.254 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:40 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:40.772+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.462803+0000 front 2024-09-19T09:12:59.462788+0000 (oldest deadline 2024-09-19T09:13:23.563010+0000) 2024-09-19T09:13:41.254 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:40 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:40.772+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:08.864112+0000 front 2024-09-19T09:13:08.864088+0000 (oldest deadline 2024-09-19T09:13:34.764163+0000) 2024-09-19T09:13:41.254 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:40 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:40.772+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:14.765001+0000 front 2024-09-19T09:13:14.764757+0000 (oldest deadline 2024-09-19T09:13:39.464614+0000) 2024-09-19T09:13:41.350 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:41 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5[47211]: 2024-09-19T09:13:41.047+0000 7f2157b0b640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.985036+0000 front 2024-09-19T09:13:01.985259+0000 (oldest deadline 2024-09-19T09:13:25.484974+0000) 2024-09-19T09:13:41.350 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:41 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5[47211]: 2024-09-19T09:13:41.047+0000 7f2157b0b640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.585983+0000 front 2024-09-19T09:13:09.585973+0000 (oldest deadline 2024-09-19T09:13:31.285810+0000) 2024-09-19T09:13:41.351 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:41 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:41.215+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:13:41.351 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:41 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:41.215+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:13:41.351 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:41 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:41.215+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:13:41.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:41 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:41.146+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:13:41.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:41 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:41.146+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:13:41.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:41 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:41.146+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:13:41.624 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:41 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:41.349+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:13:41.624 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:41 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:41.349+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:14.844594+0000 front 2024-09-19T09:13:14.844692+0000 (oldest deadline 2024-09-19T09:13:38.944688+0000) 2024-09-19T09:13:41.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:41 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:41.444+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:13:41.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:41 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:41.444+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:13:41.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:41 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:41.444+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:16.798224+0000 front 2024-09-19T09:13:16.798130+0000 (oldest deadline 2024-09-19T09:13:40.298009+0000) 2024-09-19T09:13:42.034 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:41 smithi190 podman[71134]: 2024-09-19 09:13:41.783071772 +0000 UTC m=+5.686066268 container died fee96f10d6bba220af42567cdfa111a738f531deb659478d57283c338f1809bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-19T09:13:42.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:41 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:41.754+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.690613+0000 front 2024-09-19T09:13:09.690369+0000 (oldest deadline 2024-09-19T09:13:31.990408+0000) 2024-09-19T09:13:42.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:41 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:41.754+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:11.990946+0000 front 2024-09-19T09:13:11.990885+0000 (oldest deadline 2024-09-19T09:13:41.391317+0000) 2024-09-19T09:13:42.254 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:41 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:41.782+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.462803+0000 front 2024-09-19T09:12:59.462788+0000 (oldest deadline 2024-09-19T09:13:23.563010+0000) 2024-09-19T09:13:42.254 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:41 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:41.782+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:08.864112+0000 front 2024-09-19T09:13:08.864088+0000 (oldest deadline 2024-09-19T09:13:34.764163+0000) 2024-09-19T09:13:42.254 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:41 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:41.782+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:14.765001+0000 front 2024-09-19T09:13:14.764757+0000 (oldest deadline 2024-09-19T09:13:39.464614+0000) 2024-09-19T09:13:42.301 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:42 smithi190 podman[71134]: 2024-09-19 09:13:42.116714511 +0000 UTC m=+6.019709003 container cleanup fee96f10d6bba220af42567cdfa111a738f531deb659478d57283c338f1809bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-19T09:13:42.301 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:42 smithi190 bash[71134]: ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5 2024-09-19T09:13:42.302 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:42 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:42.192+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:13:42.302 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:42 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:42.192+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:13:42.302 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:42 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:42.192+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:13:42.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:42 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:42.158+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:13:42.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:42 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:42.158+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:13:42.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:42 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:42.158+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:13:42.624 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:42 smithi190 podman[71150]: 2024-09-19 09:13:42.301390868 +0000 UTC m=+0.516537067 container remove fee96f10d6bba220af42567cdfa111a738f531deb659478d57283c338f1809bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T09:13:42.624 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:42 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:42.312+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:13:42.625 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:42 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:42.312+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:14.844594+0000 front 2024-09-19T09:13:14.844692+0000 (oldest deadline 2024-09-19T09:13:38.944688+0000) 2024-09-19T09:13:42.748 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:42 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:42.466+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:13:42.749 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:42 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:42.466+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:13:42.749 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:42 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:42.466+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:16.798224+0000 front 2024-09-19T09:13:16.798130+0000 (oldest deadline 2024-09-19T09:13:40.298009+0000) 2024-09-19T09:13:43.003 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:42 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:42.748+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.462803+0000 front 2024-09-19T09:12:59.462788+0000 (oldest deadline 2024-09-19T09:13:23.563010+0000) 2024-09-19T09:13:43.004 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:42 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:42.748+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:08.864112+0000 front 2024-09-19T09:13:08.864088+0000 (oldest deadline 2024-09-19T09:13:34.764163+0000) 2024-09-19T09:13:43.004 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:42 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:42.748+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:14.765001+0000 front 2024-09-19T09:13:14.764757+0000 (oldest deadline 2024-09-19T09:13:39.464614+0000) 2024-09-19T09:13:43.046 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:42 smithi190 podman[71237]: 2024-09-19 09:13:42.636513409 +0000 UTC m=+0.015864789 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:13:43.046 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:42 smithi190 podman[71237]: 2024-09-19 09:13:42.743804288 +0000 UTC m=+0.123155668 container create c600970499b078ab32addca57739baa3833d600a72735297beb7f91af51da4cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-19T09:13:43.046 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:42 smithi190 podman[71237]: 2024-09-19 09:13:42.95430113 +0000 UTC m=+0.333652514 container init c600970499b078ab32addca57739baa3833d600a72735297beb7f91af51da4cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:13:43.046 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:42 smithi190 podman[71237]: 2024-09-19 09:13:42.957699377 +0000 UTC m=+0.337050758 container start c600970499b078ab32addca57739baa3833d600a72735297beb7f91af51da4cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-19T09:13:43.046 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:43 smithi190 podman[71237]: 2024-09-19 09:13:43.045964943 +0000 UTC m=+0.425316324 container attach c600970499b078ab32addca57739baa3833d600a72735297beb7f91af51da4cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-19T09:13:43.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:42 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:42.782+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.690613+0000 front 2024-09-19T09:13:09.690369+0000 (oldest deadline 2024-09-19T09:13:31.990408+0000) 2024-09-19T09:13:43.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:42 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:42.782+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:11.990946+0000 front 2024-09-19T09:13:11.990885+0000 (oldest deadline 2024-09-19T09:13:41.391317+0000) 2024-09-19T09:13:43.314 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 19 09:13:43 smithi190 podman[71237]: 2024-09-19 09:13:43.152390121 +0000 UTC m=+0.531741508 container died c600970499b078ab32addca57739baa3833d600a72735297beb7f91af51da4cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-19T09:13:43.314 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:43 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:43.213+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:13:43.314 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:43 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:43.213+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:13:43.315 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:43 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:43.213+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:13:43.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:43 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:43.120+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:13:43.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:43 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:43.120+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:13:43.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:43 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:43.120+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:13:43.624 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:43 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:43.313+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:13:43.624 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:43 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:43.313+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:14.844594+0000 front 2024-09-19T09:13:14.844692+0000 (oldest deadline 2024-09-19T09:13:38.944688+0000) 2024-09-19T09:13:43.711 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@osd.5.service' 2024-09-19T09:13:43.735 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:43 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:43.461+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:13:43.735 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:43 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:43.461+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:13:43.735 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:43 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:43.461+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:16.798224+0000 front 2024-09-19T09:13:16.798130+0000 (oldest deadline 2024-09-19T09:13:40.298009+0000) 2024-09-19T09:13:43.750 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:13:43.750 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-19T09:13:43.750 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-19T09:13:43.751 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-91ff74f2-7663-11ef-bceb-c7b262605968@osd.6 2024-09-19T09:13:44.004 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:43 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:43.734+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.462803+0000 front 2024-09-19T09:12:59.462788+0000 (oldest deadline 2024-09-19T09:13:23.563010+0000) 2024-09-19T09:13:44.004 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:43 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:43.734+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:08.864112+0000 front 2024-09-19T09:13:08.864088+0000 (oldest deadline 2024-09-19T09:13:34.764163+0000) 2024-09-19T09:13:44.004 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:43 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:43.734+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:14.765001+0000 front 2024-09-19T09:13:14.764757+0000 (oldest deadline 2024-09-19T09:13:39.464614+0000) 2024-09-19T09:13:44.004 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:43 smithi092 systemd[1]: Stopping Ceph osd.6 for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T09:13:44.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:43 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:43.743+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.690613+0000 front 2024-09-19T09:13:09.690369+0000 (oldest deadline 2024-09-19T09:13:31.990408+0000) 2024-09-19T09:13:44.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:43 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:43.743+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:11.990946+0000 front 2024-09-19T09:13:11.990885+0000 (oldest deadline 2024-09-19T09:13:41.391317+0000) 2024-09-19T09:13:44.449 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:44 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:44.040+0000 7f7ad3ebf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:13:44.449 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:44 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:44.040+0000 7f7ad3ebf640 -1 osd.6 85 *** Got signal Terminated *** 2024-09-19T09:13:44.449 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:44 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:44.040+0000 7f7ad3ebf640 -1 osd.6 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:13:44.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:44 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:44.114+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:13:44.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:44 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:44.114+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:13:44.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:44 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:44.114+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:13:44.624 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:44 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:44.282+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:13:44.624 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:44 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:44.282+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:14.844594+0000 front 2024-09-19T09:13:14.844692+0000 (oldest deadline 2024-09-19T09:13:38.944688+0000) 2024-09-19T09:13:44.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:44 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:44.241+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:13:44.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:44 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:44.241+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:13:44.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:44 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:44.241+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:13:44.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:44 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:44.448+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:13:44.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:44 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:44.448+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:13:44.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:44 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:44.448+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:16.798224+0000 front 2024-09-19T09:13:16.798130+0000 (oldest deadline 2024-09-19T09:13:40.298009+0000) 2024-09-19T09:13:45.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:44 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:44.755+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.690613+0000 front 2024-09-19T09:13:09.690369+0000 (oldest deadline 2024-09-19T09:13:31.990408+0000) 2024-09-19T09:13:45.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:44 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:44.755+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:11.990946+0000 front 2024-09-19T09:13:11.990885+0000 (oldest deadline 2024-09-19T09:13:41.391317+0000) 2024-09-19T09:13:45.254 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:44 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:44.757+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.462803+0000 front 2024-09-19T09:12:59.462788+0000 (oldest deadline 2024-09-19T09:13:23.563010+0000) 2024-09-19T09:13:45.254 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:44 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:44.757+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:08.864112+0000 front 2024-09-19T09:13:08.864088+0000 (oldest deadline 2024-09-19T09:13:34.764163+0000) 2024-09-19T09:13:45.254 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:44 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:44.757+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:14.765001+0000 front 2024-09-19T09:13:14.764757+0000 (oldest deadline 2024-09-19T09:13:39.464614+0000) 2024-09-19T09:13:45.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:45 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:45.108+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:13:45.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:45 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:45.108+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:13:45.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:45 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:45.108+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:13:45.625 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:45 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:45.329+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:13:45.625 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:45 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:45.329+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:14.844594+0000 front 2024-09-19T09:13:14.844692+0000 (oldest deadline 2024-09-19T09:13:38.944688+0000) 2024-09-19T09:13:45.626 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:45 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:45.215+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:13:45.626 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:45 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:45.215+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:13:45.626 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:45 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:45.215+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:13:45.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:45 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:45.467+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:13:45.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:45 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:45.467+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:13:45.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:45 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:45.467+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:16.798224+0000 front 2024-09-19T09:13:16.798130+0000 (oldest deadline 2024-09-19T09:13:40.298009+0000) 2024-09-19T09:13:46.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:45 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:45.757+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.690613+0000 front 2024-09-19T09:13:09.690369+0000 (oldest deadline 2024-09-19T09:13:31.990408+0000) 2024-09-19T09:13:46.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:45 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:45.757+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:11.990946+0000 front 2024-09-19T09:13:11.990885+0000 (oldest deadline 2024-09-19T09:13:41.391317+0000) 2024-09-19T09:13:46.254 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:45 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:45.768+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.462803+0000 front 2024-09-19T09:12:59.462788+0000 (oldest deadline 2024-09-19T09:13:23.563010+0000) 2024-09-19T09:13:46.254 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:45 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:45.768+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:08.864112+0000 front 2024-09-19T09:13:08.864088+0000 (oldest deadline 2024-09-19T09:13:34.764163+0000) 2024-09-19T09:13:46.254 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:45 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:45.768+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:14.765001+0000 front 2024-09-19T09:13:14.764757+0000 (oldest deadline 2024-09-19T09:13:39.464614+0000) 2024-09-19T09:13:46.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:46 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:46.103+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:13:46.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:46 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:46.104+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:13:46.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:46 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:46.104+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:13:46.624 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:46 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:46.321+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:13:46.624 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:46 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:46.321+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:14.844594+0000 front 2024-09-19T09:13:14.844692+0000 (oldest deadline 2024-09-19T09:13:38.944688+0000) 2024-09-19T09:13:46.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:46 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:46.223+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:13:46.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:46 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:46.223+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:13:46.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:46 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:46.223+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:13:46.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:46 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:46.449+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:13:46.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:46 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:46.449+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:13:46.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:46 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:46.449+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:16.798224+0000 front 2024-09-19T09:13:16.798130+0000 (oldest deadline 2024-09-19T09:13:40.298009+0000) 2024-09-19T09:13:46.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:46 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:46.449+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:20.298329+0000 front 2024-09-19T09:13:20.298359+0000 (oldest deadline 2024-09-19T09:13:46.198388+0000) 2024-09-19T09:13:47.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:46 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:46.778+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.690613+0000 front 2024-09-19T09:13:09.690369+0000 (oldest deadline 2024-09-19T09:13:31.990408+0000) 2024-09-19T09:13:47.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:46 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:46.778+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:11.990946+0000 front 2024-09-19T09:13:11.990885+0000 (oldest deadline 2024-09-19T09:13:41.391317+0000) 2024-09-19T09:13:47.254 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:46 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:46.796+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.462803+0000 front 2024-09-19T09:12:59.462788+0000 (oldest deadline 2024-09-19T09:13:23.563010+0000) 2024-09-19T09:13:47.254 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:46 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:46.796+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:08.864112+0000 front 2024-09-19T09:13:08.864088+0000 (oldest deadline 2024-09-19T09:13:34.764163+0000) 2024-09-19T09:13:47.254 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:46 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:46.796+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:14.765001+0000 front 2024-09-19T09:13:14.764757+0000 (oldest deadline 2024-09-19T09:13:39.464614+0000) 2024-09-19T09:13:47.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:47 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:47.102+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:13:47.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:47 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:47.102+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:13:47.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:47 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:47.102+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:13:47.624 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:47 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:47.319+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:13:47.624 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:47 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:47.319+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:14.844594+0000 front 2024-09-19T09:13:14.844692+0000 (oldest deadline 2024-09-19T09:13:38.944688+0000) 2024-09-19T09:13:47.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:47 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:47.241+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:13:47.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:47 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:47.241+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:13:47.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:47 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:47.241+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:13:47.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:47 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:47.448+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:13:47.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:47 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:47.448+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:13:47.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:47 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:47.448+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:16.798224+0000 front 2024-09-19T09:13:16.798130+0000 (oldest deadline 2024-09-19T09:13:40.298009+0000) 2024-09-19T09:13:47.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:47 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:47.448+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:20.298329+0000 front 2024-09-19T09:13:20.298359+0000 (oldest deadline 2024-09-19T09:13:46.198388+0000) 2024-09-19T09:13:48.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:47 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:47.760+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.690613+0000 front 2024-09-19T09:13:09.690369+0000 (oldest deadline 2024-09-19T09:13:31.990408+0000) 2024-09-19T09:13:48.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:47 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:47.760+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:11.990946+0000 front 2024-09-19T09:13:11.990885+0000 (oldest deadline 2024-09-19T09:13:41.391317+0000) 2024-09-19T09:13:48.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:47 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:47.760+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:24.093360+0000 front 2024-09-19T09:13:24.093252+0000 (oldest deadline 2024-09-19T09:13:47.593287+0000) 2024-09-19T09:13:48.254 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:47 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:47.826+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.462803+0000 front 2024-09-19T09:12:59.462788+0000 (oldest deadline 2024-09-19T09:13:23.563010+0000) 2024-09-19T09:13:48.254 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:47 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:47.826+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:08.864112+0000 front 2024-09-19T09:13:08.864088+0000 (oldest deadline 2024-09-19T09:13:34.764163+0000) 2024-09-19T09:13:48.254 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:47 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:47.826+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:14.765001+0000 front 2024-09-19T09:13:14.764757+0000 (oldest deadline 2024-09-19T09:13:39.464614+0000) 2024-09-19T09:13:48.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:48 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:48.128+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:13:48.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:48 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:48.128+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:13:48.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:48 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:48.128+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:13:48.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:48 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:48.128+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:23.027848+0000 front 2024-09-19T09:13:23.027807+0000 (oldest deadline 2024-09-19T09:13:47.727922+0000) 2024-09-19T09:13:48.624 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:48 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:48.368+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:13:48.624 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:48 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:48.368+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:14.844594+0000 front 2024-09-19T09:13:14.844692+0000 (oldest deadline 2024-09-19T09:13:38.944688+0000) 2024-09-19T09:13:48.625 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:48 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:48.368+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:24.146221+0000 front 2024-09-19T09:13:24.146238+0000 (oldest deadline 2024-09-19T09:13:47.646080+0000) 2024-09-19T09:13:48.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:48 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:48.194+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:13:48.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:48 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:48.194+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:13:48.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:48 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:48.194+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:13:48.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:48 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:48.401+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:13:48.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:48 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:48.401+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:13:48.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:48 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:48.401+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:16.798224+0000 front 2024-09-19T09:13:16.798130+0000 (oldest deadline 2024-09-19T09:13:40.298009+0000) 2024-09-19T09:13:48.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:48 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:48.401+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:20.298329+0000 front 2024-09-19T09:13:20.298359+0000 (oldest deadline 2024-09-19T09:13:46.198388+0000) 2024-09-19T09:13:49.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:48 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:48.776+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.690613+0000 front 2024-09-19T09:13:09.690369+0000 (oldest deadline 2024-09-19T09:13:31.990408+0000) 2024-09-19T09:13:49.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:48 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:48.776+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:11.990946+0000 front 2024-09-19T09:13:11.990885+0000 (oldest deadline 2024-09-19T09:13:41.391317+0000) 2024-09-19T09:13:49.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:48 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:48.776+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:24.093360+0000 front 2024-09-19T09:13:24.093252+0000 (oldest deadline 2024-09-19T09:13:47.593287+0000) 2024-09-19T09:13:49.254 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:48 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:48.812+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.462803+0000 front 2024-09-19T09:12:59.462788+0000 (oldest deadline 2024-09-19T09:13:23.563010+0000) 2024-09-19T09:13:49.254 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:48 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:48.812+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:08.864112+0000 front 2024-09-19T09:13:08.864088+0000 (oldest deadline 2024-09-19T09:13:34.764163+0000) 2024-09-19T09:13:49.254 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:48 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6[55962]: 2024-09-19T09:13:48.812+0000 7f7acc4bc640 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:14.765001+0000 front 2024-09-19T09:13:14.764757+0000 (oldest deadline 2024-09-19T09:13:39.464614+0000) 2024-09-19T09:13:49.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:49 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:49.156+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:13:49.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:49 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:49.156+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:13:49.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:49 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:49.156+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:13:49.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:49 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:49.156+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:23.027848+0000 front 2024-09-19T09:13:23.027807+0000 (oldest deadline 2024-09-19T09:13:47.727922+0000) 2024-09-19T09:13:49.624 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:49 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:49.377+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:13:49.624 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:49 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:49.377+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:14.844594+0000 front 2024-09-19T09:13:14.844692+0000 (oldest deadline 2024-09-19T09:13:38.944688+0000) 2024-09-19T09:13:49.624 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:49 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:49.377+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:24.146221+0000 front 2024-09-19T09:13:24.146238+0000 (oldest deadline 2024-09-19T09:13:47.646080+0000) 2024-09-19T09:13:49.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:49 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:49.170+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:13:49.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:49 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:49.170+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:13:49.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:49 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:49.170+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:13:49.741 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:49 smithi092 podman[117995]: 2024-09-19 09:13:49.483385498 +0000 UTC m=+5.540738965 container died 3589d37de55e257c893ac2d6ba87ef2d2f2820e7f3110ca4347d76e99b1125da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6, ceph=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-19T09:13:49.742 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:49 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:49.374+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:13:49.742 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:49 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:49.374+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:13:49.742 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:49 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:49.374+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:16.798224+0000 front 2024-09-19T09:13:16.798130+0000 (oldest deadline 2024-09-19T09:13:40.298009+0000) 2024-09-19T09:13:49.742 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:49 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:49.374+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:20.298329+0000 front 2024-09-19T09:13:20.298359+0000 (oldest deadline 2024-09-19T09:13:46.198388+0000) 2024-09-19T09:13:50.004 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:49 smithi092 podman[117995]: 2024-09-19 09:13:49.882182319 +0000 UTC m=+5.939535775 container cleanup 3589d37de55e257c893ac2d6ba87ef2d2f2820e7f3110ca4347d76e99b1125da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-19T09:13:50.004 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:49 smithi092 bash[117995]: ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6 2024-09-19T09:13:50.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:49 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:49.760+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.690613+0000 front 2024-09-19T09:13:09.690369+0000 (oldest deadline 2024-09-19T09:13:31.990408+0000) 2024-09-19T09:13:50.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:49 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:49.760+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:11.990946+0000 front 2024-09-19T09:13:11.990885+0000 (oldest deadline 2024-09-19T09:13:41.391317+0000) 2024-09-19T09:13:50.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:49 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:49.760+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:24.093360+0000 front 2024-09-19T09:13:24.093252+0000 (oldest deadline 2024-09-19T09:13:47.593287+0000) 2024-09-19T09:13:50.392 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:50 smithi092 podman[118011]: 2024-09-19 09:13:50.091942796 +0000 UTC m=+0.609107886 container remove 3589d37de55e257c893ac2d6ba87ef2d2f2820e7f3110ca4347d76e99b1125da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4) 2024-09-19T09:13:50.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:50 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:50.201+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:13:50.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:50 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:50.201+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:13:50.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:50 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:50.201+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:13:50.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:50 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:50.201+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:23.027848+0000 front 2024-09-19T09:13:23.027807+0000 (oldest deadline 2024-09-19T09:13:47.727922+0000) 2024-09-19T09:13:50.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:50 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:50.208+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:13:50.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:50 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:50.208+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:13:50.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:50 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:50.208+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:13:50.624 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:50 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:50.419+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:13:50.625 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:50 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:50.419+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:14.844594+0000 front 2024-09-19T09:13:14.844692+0000 (oldest deadline 2024-09-19T09:13:38.944688+0000) 2024-09-19T09:13:50.625 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:50 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:50.419+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:24.146221+0000 front 2024-09-19T09:13:24.146238+0000 (oldest deadline 2024-09-19T09:13:47.646080+0000) 2024-09-19T09:13:50.654 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:50 smithi092 podman[118096]: 2024-09-19 09:13:50.392679867 +0000 UTC m=+0.107583282 container create 1a29dd909b595aeeaba486ad8fa5633416a4675ac12bb6e25582bb6e9dc00833 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T09:13:50.654 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:50 smithi092 podman[118096]: 2024-09-19 09:13:50.30093407 +0000 UTC m=+0.015837494 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:13:50.654 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:50 smithi092 podman[118096]: 2024-09-19 09:13:50.653944982 +0000 UTC m=+0.368848397 container init 1a29dd909b595aeeaba486ad8fa5633416a4675ac12bb6e25582bb6e9dc00833 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-19T09:13:50.654 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:50 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:50.408+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:13:50.654 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:50 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:50.408+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:13:50.654 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:50 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:50.408+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:16.798224+0000 front 2024-09-19T09:13:16.798130+0000 (oldest deadline 2024-09-19T09:13:40.298009+0000) 2024-09-19T09:13:50.655 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:50 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:50.408+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:20.298329+0000 front 2024-09-19T09:13:20.298359+0000 (oldest deadline 2024-09-19T09:13:46.198388+0000) 2024-09-19T09:13:51.004 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:50 smithi092 podman[118096]: 2024-09-19 09:13:50.657592088 +0000 UTC m=+0.372495502 container start 1a29dd909b595aeeaba486ad8fa5633416a4675ac12bb6e25582bb6e9dc00833 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-19T09:13:51.004 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:50 smithi092 podman[118096]: 2024-09-19 09:13:50.728890808 +0000 UTC m=+0.443794234 container attach 1a29dd909b595aeeaba486ad8fa5633416a4675ac12bb6e25582bb6e9dc00833 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-19T09:13:51.004 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 19 09:13:50 smithi092 podman[118096]: 2024-09-19 09:13:50.844089728 +0000 UTC m=+0.558993146 container died 1a29dd909b595aeeaba486ad8fa5633416a4675ac12bb6e25582bb6e9dc00833 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-6-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-19T09:13:51.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:50 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:50.805+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.690613+0000 front 2024-09-19T09:13:09.690369+0000 (oldest deadline 2024-09-19T09:13:31.990408+0000) 2024-09-19T09:13:51.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:50 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:50.805+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:11.990946+0000 front 2024-09-19T09:13:11.990885+0000 (oldest deadline 2024-09-19T09:13:41.391317+0000) 2024-09-19T09:13:51.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:50 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:50.805+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:24.093360+0000 front 2024-09-19T09:13:24.093252+0000 (oldest deadline 2024-09-19T09:13:47.593287+0000) 2024-09-19T09:13:51.420 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@osd.6.service' 2024-09-19T09:13:51.459 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:13:51.459 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-19T09:13:51.460 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-19T09:13:51.460 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-91ff74f2-7663-11ef-bceb-c7b262605968@osd.7 2024-09-19T09:13:51.485 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:51 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:51.214+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:13:51.485 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:51 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:51.214+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:13:51.485 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:51 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:51.214+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:13:51.485 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:51 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:51.214+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:23.027848+0000 front 2024-09-19T09:13:23.027807+0000 (oldest deadline 2024-09-19T09:13:47.727922+0000) 2024-09-19T09:13:51.624 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:51 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:51.451+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:13:51.624 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:51 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:51.451+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:14.844594+0000 front 2024-09-19T09:13:14.844692+0000 (oldest deadline 2024-09-19T09:13:38.944688+0000) 2024-09-19T09:13:51.625 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:51 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:51.451+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:24.146221+0000 front 2024-09-19T09:13:24.146238+0000 (oldest deadline 2024-09-19T09:13:47.646080+0000) 2024-09-19T09:13:51.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:51 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:51.206+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:13:51.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:51 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:51.206+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:13:51.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:51 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:51.206+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:13:51.667 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:51 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:51.422+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:13:51.667 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:51 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:51.422+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:13:51.667 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:51 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:51.422+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:16.798224+0000 front 2024-09-19T09:13:16.798130+0000 (oldest deadline 2024-09-19T09:13:40.298009+0000) 2024-09-19T09:13:51.667 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:51 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:51.422+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:20.298329+0000 front 2024-09-19T09:13:20.298359+0000 (oldest deadline 2024-09-19T09:13:46.198388+0000) 2024-09-19T09:13:51.747 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:51 smithi167 systemd[1]: Stopping Ceph osd.7 for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T09:13:52.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:51 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:51.746+0000 7fec44fef640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:13:52.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:51 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:51.746+0000 7fec44fef640 -1 osd.7 85 *** Got signal Terminated *** 2024-09-19T09:13:52.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:51 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:51.746+0000 7fec44fef640 -1 osd.7 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:13:52.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:51 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:51.792+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.690613+0000 front 2024-09-19T09:13:09.690369+0000 (oldest deadline 2024-09-19T09:13:31.990408+0000) 2024-09-19T09:13:52.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:51 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:51.792+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:11.990946+0000 front 2024-09-19T09:13:11.990885+0000 (oldest deadline 2024-09-19T09:13:41.391317+0000) 2024-09-19T09:13:52.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:51 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:51.792+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:24.093360+0000 front 2024-09-19T09:13:24.093252+0000 (oldest deadline 2024-09-19T09:13:47.593287+0000) 2024-09-19T09:13:52.478 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:52 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:52.224+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:13:52.478 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:52 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:52.224+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:13:52.478 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:52 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:52.224+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:13:52.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:52 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:52.171+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:13:52.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:52 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:52.171+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:13:52.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:52 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:52.171+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:13:52.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:52 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:52.171+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:23.027848+0000 front 2024-09-19T09:13:23.027807+0000 (oldest deadline 2024-09-19T09:13:47.727922+0000) 2024-09-19T09:13:52.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:52 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:52.382+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:13:52.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:52 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:52.382+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:13:52.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:52 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:52.382+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:16.798224+0000 front 2024-09-19T09:13:16.798130+0000 (oldest deadline 2024-09-19T09:13:40.298009+0000) 2024-09-19T09:13:52.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:52 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:52.382+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:20.298329+0000 front 2024-09-19T09:13:20.298359+0000 (oldest deadline 2024-09-19T09:13:46.198388+0000) 2024-09-19T09:13:52.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:52 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:52.478+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:13:52.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:52 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:52.478+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:14.844594+0000 front 2024-09-19T09:13:14.844692+0000 (oldest deadline 2024-09-19T09:13:38.944688+0000) 2024-09-19T09:13:52.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:52 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:52.478+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:24.146221+0000 front 2024-09-19T09:13:24.146238+0000 (oldest deadline 2024-09-19T09:13:47.646080+0000) 2024-09-19T09:13:53.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:52 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:52.792+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.690613+0000 front 2024-09-19T09:13:09.690369+0000 (oldest deadline 2024-09-19T09:13:31.990408+0000) 2024-09-19T09:13:53.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:52 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:52.792+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:11.990946+0000 front 2024-09-19T09:13:11.990885+0000 (oldest deadline 2024-09-19T09:13:41.391317+0000) 2024-09-19T09:13:53.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:52 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:52.792+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:24.093360+0000 front 2024-09-19T09:13:24.093252+0000 (oldest deadline 2024-09-19T09:13:47.593287+0000) 2024-09-19T09:13:53.523 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:53 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:53.175+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:13:53.523 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:53 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:53.175+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:13:53.523 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:53 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:53.175+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:13:53.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:53 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:53.220+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:13:53.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:53 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:53.220+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:13:53.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:53 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:53.220+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:13:53.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:53 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:53.220+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:23.027848+0000 front 2024-09-19T09:13:23.027807+0000 (oldest deadline 2024-09-19T09:13:47.727922+0000) 2024-09-19T09:13:53.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:53 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:53.355+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:13:53.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:53 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:53.355+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:13:53.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:53 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:53.355+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:16.798224+0000 front 2024-09-19T09:13:16.798130+0000 (oldest deadline 2024-09-19T09:13:40.298009+0000) 2024-09-19T09:13:53.755 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:53 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:53.355+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:20.298329+0000 front 2024-09-19T09:13:20.298359+0000 (oldest deadline 2024-09-19T09:13:46.198388+0000) 2024-09-19T09:13:53.875 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:53 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:53.523+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:13:53.875 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:53 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:53.523+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:14.844594+0000 front 2024-09-19T09:13:14.844692+0000 (oldest deadline 2024-09-19T09:13:38.944688+0000) 2024-09-19T09:13:53.875 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:53 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:53.523+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:24.146221+0000 front 2024-09-19T09:13:24.146238+0000 (oldest deadline 2024-09-19T09:13:47.646080+0000) 2024-09-19T09:13:54.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:53 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:53.763+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.690613+0000 front 2024-09-19T09:13:09.690369+0000 (oldest deadline 2024-09-19T09:13:31.990408+0000) 2024-09-19T09:13:54.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:53 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:53.763+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:11.990946+0000 front 2024-09-19T09:13:11.990885+0000 (oldest deadline 2024-09-19T09:13:41.391317+0000) 2024-09-19T09:13:54.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:53 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:53.763+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:24.093360+0000 front 2024-09-19T09:13:24.093252+0000 (oldest deadline 2024-09-19T09:13:47.593287+0000) 2024-09-19T09:13:54.471 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:54 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:54.159+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:13:54.471 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:54 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:54.159+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:13:54.471 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:54 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:54.159+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:13:54.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:54 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:54.235+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:13:54.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:54 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:54.235+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:13:54.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:54 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:54.235+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:13:54.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:54 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:54.235+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:23.027848+0000 front 2024-09-19T09:13:23.027807+0000 (oldest deadline 2024-09-19T09:13:47.727922+0000) 2024-09-19T09:13:54.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:54 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:54.317+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:13:54.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:54 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:54.317+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:13:54.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:54 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:54.317+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:16.798224+0000 front 2024-09-19T09:13:16.798130+0000 (oldest deadline 2024-09-19T09:13:40.298009+0000) 2024-09-19T09:13:54.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:54 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:54.317+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:20.298329+0000 front 2024-09-19T09:13:20.298359+0000 (oldest deadline 2024-09-19T09:13:46.198388+0000) 2024-09-19T09:13:54.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:54 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:54.317+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:32.400713+0000 front 2024-09-19T09:13:32.400642+0000 (oldest deadline 2024-09-19T09:13:54.100470+0000) 2024-09-19T09:13:54.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:54 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:54.484+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:13:54.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:54 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:54.484+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:14.844594+0000 front 2024-09-19T09:13:14.844692+0000 (oldest deadline 2024-09-19T09:13:38.944688+0000) 2024-09-19T09:13:54.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:54 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:54.484+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:24.146221+0000 front 2024-09-19T09:13:24.146238+0000 (oldest deadline 2024-09-19T09:13:47.646080+0000) 2024-09-19T09:13:55.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:54 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:54.804+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.690613+0000 front 2024-09-19T09:13:09.690369+0000 (oldest deadline 2024-09-19T09:13:31.990408+0000) 2024-09-19T09:13:55.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:54 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:54.804+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:11.990946+0000 front 2024-09-19T09:13:11.990885+0000 (oldest deadline 2024-09-19T09:13:41.391317+0000) 2024-09-19T09:13:55.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:54 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:54.804+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:24.093360+0000 front 2024-09-19T09:13:24.093252+0000 (oldest deadline 2024-09-19T09:13:47.593287+0000) 2024-09-19T09:13:55.485 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:55 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:55.159+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:13:55.485 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:55 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:55.159+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:13:55.485 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:55 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:55.159+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:13:55.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:55 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:55.247+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:13:55.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:55 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:55.247+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:13:55.603 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:55 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:55.247+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:13:55.603 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:55 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:55.247+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:23.027848+0000 front 2024-09-19T09:13:23.027807+0000 (oldest deadline 2024-09-19T09:13:47.727922+0000) 2024-09-19T09:13:55.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:55 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:55.300+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:13:55.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:55 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:55.300+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:13:55.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:55 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:55.300+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:16.798224+0000 front 2024-09-19T09:13:16.798130+0000 (oldest deadline 2024-09-19T09:13:40.298009+0000) 2024-09-19T09:13:55.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:55 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:55.300+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:20.298329+0000 front 2024-09-19T09:13:20.298359+0000 (oldest deadline 2024-09-19T09:13:46.198388+0000) 2024-09-19T09:13:55.755 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:55 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:55.300+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:32.400713+0000 front 2024-09-19T09:13:32.400642+0000 (oldest deadline 2024-09-19T09:13:54.100470+0000) 2024-09-19T09:13:55.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:55 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:55.484+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:13:55.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:55 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:55.484+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:14.844594+0000 front 2024-09-19T09:13:14.844692+0000 (oldest deadline 2024-09-19T09:13:38.944688+0000) 2024-09-19T09:13:55.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:55 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:55.484+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:24.146221+0000 front 2024-09-19T09:13:24.146238+0000 (oldest deadline 2024-09-19T09:13:47.646080+0000) 2024-09-19T09:13:56.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:55 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:55.837+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.690613+0000 front 2024-09-19T09:13:09.690369+0000 (oldest deadline 2024-09-19T09:13:31.990408+0000) 2024-09-19T09:13:56.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:55 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:55.837+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:11.990946+0000 front 2024-09-19T09:13:11.990885+0000 (oldest deadline 2024-09-19T09:13:41.391317+0000) 2024-09-19T09:13:56.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:55 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7[53611]: 2024-09-19T09:13:55.837+0000 7fec415f4640 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:24.093360+0000 front 2024-09-19T09:13:24.093252+0000 (oldest deadline 2024-09-19T09:13:47.593287+0000) 2024-09-19T09:13:56.456 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:56 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:56.143+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:13:56.456 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:56 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:56.143+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:13:56.456 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:56 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:56.143+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:13:56.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:56 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:56.258+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:13:56.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:56 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:56.258+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:13:56.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:56 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:56.258+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:13:56.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:56 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:56.258+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:23.027848+0000 front 2024-09-19T09:13:23.027807+0000 (oldest deadline 2024-09-19T09:13:47.727922+0000) 2024-09-19T09:13:56.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:56 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:56.313+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:13:56.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:56 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:56.313+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:13:56.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:56 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:56.313+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:16.798224+0000 front 2024-09-19T09:13:16.798130+0000 (oldest deadline 2024-09-19T09:13:40.298009+0000) 2024-09-19T09:13:56.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:56 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:56.313+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:20.298329+0000 front 2024-09-19T09:13:20.298359+0000 (oldest deadline 2024-09-19T09:13:46.198388+0000) 2024-09-19T09:13:56.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:56 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:56.313+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:32.400713+0000 front 2024-09-19T09:13:32.400642+0000 (oldest deadline 2024-09-19T09:13:54.100470+0000) 2024-09-19T09:13:56.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:56 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:56.456+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:13:56.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:56 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:56.456+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:14.844594+0000 front 2024-09-19T09:13:14.844692+0000 (oldest deadline 2024-09-19T09:13:38.944688+0000) 2024-09-19T09:13:56.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:56 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:56.456+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:24.146221+0000 front 2024-09-19T09:13:24.146238+0000 (oldest deadline 2024-09-19T09:13:47.646080+0000) 2024-09-19T09:13:57.502 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:57 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:57.146+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:13:57.502 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:57 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:57.146+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:13:57.502 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:57 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:57.146+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:13:57.502 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:57 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:57.146+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:31.082547+0000 front 2024-09-19T09:13:31.082393+0000 (oldest deadline 2024-09-19T09:13:56.382324+0000) 2024-09-19T09:13:57.572 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:57 smithi167 podman[71336]: 2024-09-19 09:13:57.314467531 +0000 UTC m=+5.661973074 container died bf4d33a9985adfd039a5b54f474c46ac9a2429dd8b4d0d332777606644cb41ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-19T09:13:57.572 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:57 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:57.208+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:13:57.572 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:57 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:57.208+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:13:57.573 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:57 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:57.208+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:13:57.573 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:57 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:57.208+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:23.027848+0000 front 2024-09-19T09:13:23.027807+0000 (oldest deadline 2024-09-19T09:13:47.727922+0000) 2024-09-19T09:13:57.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:57 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:57.300+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:13:57.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:57 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:57.300+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:13:57.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:57 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:57.300+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:16.798224+0000 front 2024-09-19T09:13:16.798130+0000 (oldest deadline 2024-09-19T09:13:40.298009+0000) 2024-09-19T09:13:57.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:57 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:57.300+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:20.298329+0000 front 2024-09-19T09:13:20.298359+0000 (oldest deadline 2024-09-19T09:13:46.198388+0000) 2024-09-19T09:13:57.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:57 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:57.300+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:32.400713+0000 front 2024-09-19T09:13:32.400642+0000 (oldest deadline 2024-09-19T09:13:54.100470+0000) 2024-09-19T09:13:57.847 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:57 smithi167 podman[71336]: 2024-09-19 09:13:57.654589352 +0000 UTC m=+6.002094884 container cleanup bf4d33a9985adfd039a5b54f474c46ac9a2429dd8b4d0d332777606644cb41ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-19T09:13:57.847 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:57 smithi167 bash[71336]: ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7 2024-09-19T09:13:57.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:57 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:57.501+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:13:57.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:57 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:57.501+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:14.844594+0000 front 2024-09-19T09:13:14.844692+0000 (oldest deadline 2024-09-19T09:13:38.944688+0000) 2024-09-19T09:13:57.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:57 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:57.501+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:24.146221+0000 front 2024-09-19T09:13:24.146238+0000 (oldest deadline 2024-09-19T09:13:47.646080+0000) 2024-09-19T09:13:58.102 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:57 smithi167 podman[71352]: 2024-09-19 09:13:57.847430979 +0000 UTC m=+0.531728316 container remove bf4d33a9985adfd039a5b54f474c46ac9a2429dd8b4d0d332777606644cb41ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-19T09:13:58.509 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:58 smithi167 podman[71443]: 2024-09-19 09:13:58.167651216 +0000 UTC m=+0.015809681 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:13:58.509 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:58 smithi167 podman[71443]: 2024-09-19 09:13:58.281507199 +0000 UTC m=+0.129665646 container create 207cbbeebf22a99cb9cdb821e18adaa883187a24d846346c8745e7bde84848d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-19T09:13:58.509 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:58 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:58.164+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:13:58.509 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:58 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:58.164+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:13:58.509 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:58 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:58.164+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:13:58.510 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:58 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:58.164+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:31.082547+0000 front 2024-09-19T09:13:31.082393+0000 (oldest deadline 2024-09-19T09:13:56.382324+0000) 2024-09-19T09:13:58.510 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:58 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:58.162+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:13:58.510 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:58 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:58.162+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:13:58.510 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:58 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:58.162+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:13:58.510 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:58 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:58.162+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:23.027848+0000 front 2024-09-19T09:13:23.027807+0000 (oldest deadline 2024-09-19T09:13:47.727922+0000) 2024-09-19T09:13:58.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:58 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:58.305+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:13:58.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:58 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:58.305+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:13:58.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:58 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:58.305+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:16.798224+0000 front 2024-09-19T09:13:16.798130+0000 (oldest deadline 2024-09-19T09:13:40.298009+0000) 2024-09-19T09:13:58.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:58 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:58.305+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:20.298329+0000 front 2024-09-19T09:13:20.298359+0000 (oldest deadline 2024-09-19T09:13:46.198388+0000) 2024-09-19T09:13:58.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:58 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:58.305+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:32.400713+0000 front 2024-09-19T09:13:32.400642+0000 (oldest deadline 2024-09-19T09:13:54.100470+0000) 2024-09-19T09:13:58.852 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:58 smithi167 podman[71443]: 2024-09-19 09:13:58.509105469 +0000 UTC m=+0.357263923 container init 207cbbeebf22a99cb9cdb821e18adaa883187a24d846346c8745e7bde84848d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T09:13:58.852 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:58 smithi167 podman[71443]: 2024-09-19 09:13:58.512526857 +0000 UTC m=+0.360685314 container start 207cbbeebf22a99cb9cdb821e18adaa883187a24d846346c8745e7bde84848d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-19T09:13:58.852 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:58 smithi167 podman[71443]: 2024-09-19 09:13:58.584083378 +0000 UTC m=+0.432241853 container attach 207cbbeebf22a99cb9cdb821e18adaa883187a24d846346c8745e7bde84848d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7-deactivate, ceph=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-19T09:13:58.852 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:58 smithi167 podman[71443]: 2024-09-19 09:13:58.706841146 +0000 UTC m=+0.554999594 container died 207cbbeebf22a99cb9cdb821e18adaa883187a24d846346c8745e7bde84848d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:13:58.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:58 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:58.507+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:13:58.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:58 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:58.507+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:14.844594+0000 front 2024-09-19T09:13:14.844692+0000 (oldest deadline 2024-09-19T09:13:38.944688+0000) 2024-09-19T09:13:58.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:58 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:58.507+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:24.146221+0000 front 2024-09-19T09:13:24.146238+0000 (oldest deadline 2024-09-19T09:13:47.646080+0000) 2024-09-19T09:13:58.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:58 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:58.507+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:32.847670+0000 front 2024-09-19T09:13:32.847627+0000 (oldest deadline 2024-09-19T09:13:58.147528+0000) 2024-09-19T09:13:59.254 INFO:journalctl@ceph.osd.7.smithi167.stdout:Sep 19 09:13:59 smithi167 podman[71466]: 2024-09-19 09:13:59.237481327 +0000 UTC m=+0.519525537 container remove 207cbbeebf22a99cb9cdb821e18adaa883187a24d846346c8745e7bde84848d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-2f599a4, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-19T09:13:59.255 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:59 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:59.128+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:13:59.255 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:59 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:59.128+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:13:59.255 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:59 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:59.128+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:13:59.255 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:59 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:59.128+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:23.027848+0000 front 2024-09-19T09:13:23.027807+0000 (oldest deadline 2024-09-19T09:13:47.727922+0000) 2024-09-19T09:13:59.255 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:13:59 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:13:59.128+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:33.028800+0000 front 2024-09-19T09:13:33.028844+0000 (oldest deadline 2024-09-19T09:13:58.328900+0000) 2024-09-19T09:13:59.260 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@osd.7.service' 2024-09-19T09:13:59.353 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:13:59.354 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-19T09:13:59.354 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-19T09:13:59.354 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-91ff74f2-7663-11ef-bceb-c7b262605968@osd.8 2024-09-19T09:13:59.405 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:59 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:59.142+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:13:59.405 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:59 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:59.142+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:13:59.405 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:59 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:59.142+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:13:59.406 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:13:59 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:13:59.142+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:31.082547+0000 front 2024-09-19T09:13:31.082393+0000 (oldest deadline 2024-09-19T09:13:56.382324+0000) 2024-09-19T09:13:59.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:59 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:59.265+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:13:59.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:59 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:59.265+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:13:59.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:59 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:59.265+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:16.798224+0000 front 2024-09-19T09:13:16.798130+0000 (oldest deadline 2024-09-19T09:13:40.298009+0000) 2024-09-19T09:13:59.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:59 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:59.265+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:20.298329+0000 front 2024-09-19T09:13:20.298359+0000 (oldest deadline 2024-09-19T09:13:46.198388+0000) 2024-09-19T09:13:59.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:13:59 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:13:59.265+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:32.400713+0000 front 2024-09-19T09:13:32.400642+0000 (oldest deadline 2024-09-19T09:13:54.100470+0000) 2024-09-19T09:13:59.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:59 smithi190 systemd[1]: Stopping Ceph osd.8 for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T09:13:59.875 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:59 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:59.477+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:13:59.875 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:59 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:59.477+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:14.844594+0000 front 2024-09-19T09:13:14.844692+0000 (oldest deadline 2024-09-19T09:13:38.944688+0000) 2024-09-19T09:13:59.875 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:59 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:59.477+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:24.146221+0000 front 2024-09-19T09:13:24.146238+0000 (oldest deadline 2024-09-19T09:13:47.646080+0000) 2024-09-19T09:13:59.875 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:59 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:59.477+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:32.847670+0000 front 2024-09-19T09:13:32.847627+0000 (oldest deadline 2024-09-19T09:13:58.147528+0000) 2024-09-19T09:13:59.875 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:59 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:59.649+0000 7fe1c090f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:13:59.875 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:59 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:59.649+0000 7fe1c090f640 -1 osd.8 85 *** Got signal Terminated *** 2024-09-19T09:13:59.875 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:13:59 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:13:59.649+0000 7fe1c090f640 -1 osd.8 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:14:00.474 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:00 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:00.176+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:14:00.474 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:00 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:00.176+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:14:00.474 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:00 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:00.176+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:14:00.474 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:00 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:00.176+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:31.082547+0000 front 2024-09-19T09:13:31.082393+0000 (oldest deadline 2024-09-19T09:13:56.382324+0000) 2024-09-19T09:14:00.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:00 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:00.145+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:14:00.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:00 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:00.145+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:14:00.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:00 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:00.145+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:14:00.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:00 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:00.145+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:23.027848+0000 front 2024-09-19T09:13:23.027807+0000 (oldest deadline 2024-09-19T09:13:47.727922+0000) 2024-09-19T09:14:00.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:00 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:00.145+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:33.028800+0000 front 2024-09-19T09:13:33.028844+0000 (oldest deadline 2024-09-19T09:13:58.328900+0000) 2024-09-19T09:14:00.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:00 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:00.285+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:14:00.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:00 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:00.285+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:14:00.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:00 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:00.285+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:16.798224+0000 front 2024-09-19T09:13:16.798130+0000 (oldest deadline 2024-09-19T09:13:40.298009+0000) 2024-09-19T09:14:00.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:00 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:00.285+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:20.298329+0000 front 2024-09-19T09:13:20.298359+0000 (oldest deadline 2024-09-19T09:13:46.198388+0000) 2024-09-19T09:14:00.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:00 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:00.285+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:32.400713+0000 front 2024-09-19T09:13:32.400642+0000 (oldest deadline 2024-09-19T09:13:54.100470+0000) 2024-09-19T09:14:00.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:14:00 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:14:00.472+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:14:00.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:14:00 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:14:00.472+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:14.844594+0000 front 2024-09-19T09:13:14.844692+0000 (oldest deadline 2024-09-19T09:13:38.944688+0000) 2024-09-19T09:14:00.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:14:00 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:14:00.472+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:24.146221+0000 front 2024-09-19T09:13:24.146238+0000 (oldest deadline 2024-09-19T09:13:47.646080+0000) 2024-09-19T09:14:00.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:14:00 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:14:00.472+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:32.847670+0000 front 2024-09-19T09:13:32.847627+0000 (oldest deadline 2024-09-19T09:13:58.147528+0000) 2024-09-19T09:14:01.488 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:01 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:01.199+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:14:01.488 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:01 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:01.199+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:14:01.488 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:01 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:01.199+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:14:01.488 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:01 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:01.199+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:31.082547+0000 front 2024-09-19T09:13:31.082393+0000 (oldest deadline 2024-09-19T09:13:56.382324+0000) 2024-09-19T09:14:01.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:01 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:01.190+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:14:01.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:01 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:01.190+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:14:01.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:01 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:01.190+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:14:01.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:01 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:01.190+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:23.027848+0000 front 2024-09-19T09:13:23.027807+0000 (oldest deadline 2024-09-19T09:13:47.727922+0000) 2024-09-19T09:14:01.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:01 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:01.190+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:33.028800+0000 front 2024-09-19T09:13:33.028844+0000 (oldest deadline 2024-09-19T09:13:58.328900+0000) 2024-09-19T09:14:01.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:01 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:01.257+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:14:01.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:01 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:01.257+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:14:01.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:01 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:01.257+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:16.798224+0000 front 2024-09-19T09:13:16.798130+0000 (oldest deadline 2024-09-19T09:13:40.298009+0000) 2024-09-19T09:14:01.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:01 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:01.257+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:20.298329+0000 front 2024-09-19T09:13:20.298359+0000 (oldest deadline 2024-09-19T09:13:46.198388+0000) 2024-09-19T09:14:01.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:01 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:01.257+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:32.400713+0000 front 2024-09-19T09:13:32.400642+0000 (oldest deadline 2024-09-19T09:13:54.100470+0000) 2024-09-19T09:14:01.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:14:01 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:14:01.487+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:14:01.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:14:01 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:14:01.487+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:14.844594+0000 front 2024-09-19T09:13:14.844692+0000 (oldest deadline 2024-09-19T09:13:38.944688+0000) 2024-09-19T09:14:01.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:14:01 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:14:01.487+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:24.146221+0000 front 2024-09-19T09:13:24.146238+0000 (oldest deadline 2024-09-19T09:13:47.646080+0000) 2024-09-19T09:14:01.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:14:01 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:14:01.487+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:32.847670+0000 front 2024-09-19T09:13:32.847627+0000 (oldest deadline 2024-09-19T09:13:58.147528+0000) 2024-09-19T09:14:02.504 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:02 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:02.296+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:14:02.504 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:02 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:02.296+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:14:02.504 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:02 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:02.296+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:16.798224+0000 front 2024-09-19T09:13:16.798130+0000 (oldest deadline 2024-09-19T09:13:40.298009+0000) 2024-09-19T09:14:02.504 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:02 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:02.296+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:20.298329+0000 front 2024-09-19T09:13:20.298359+0000 (oldest deadline 2024-09-19T09:13:46.198388+0000) 2024-09-19T09:14:02.504 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:02 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:02.296+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:32.400713+0000 front 2024-09-19T09:13:32.400642+0000 (oldest deadline 2024-09-19T09:13:54.100470+0000) 2024-09-19T09:14:02.534 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:02 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:02.216+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:14:02.534 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:02 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:02.216+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:14:02.534 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:02 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:02.216+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:14:02.534 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:02 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:02.216+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:31.082547+0000 front 2024-09-19T09:13:31.082393+0000 (oldest deadline 2024-09-19T09:13:56.382324+0000) 2024-09-19T09:14:02.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:02 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:02.226+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:14:02.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:02 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:02.226+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:14:02.603 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:02 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:02.226+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:14:02.603 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:02 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:02.226+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:23.027848+0000 front 2024-09-19T09:13:23.027807+0000 (oldest deadline 2024-09-19T09:13:47.727922+0000) 2024-09-19T09:14:02.603 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:02 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:02.226+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:33.028800+0000 front 2024-09-19T09:13:33.028844+0000 (oldest deadline 2024-09-19T09:13:58.328900+0000) 2024-09-19T09:14:02.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:14:02 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:14:02.533+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:14:02.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:14:02 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:14:02.533+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:14.844594+0000 front 2024-09-19T09:13:14.844692+0000 (oldest deadline 2024-09-19T09:13:38.944688+0000) 2024-09-19T09:14:02.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:14:02 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:14:02.533+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:24.146221+0000 front 2024-09-19T09:13:24.146238+0000 (oldest deadline 2024-09-19T09:13:47.646080+0000) 2024-09-19T09:14:02.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:14:02 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:14:02.533+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:32.847670+0000 front 2024-09-19T09:13:32.847627+0000 (oldest deadline 2024-09-19T09:13:58.147528+0000) 2024-09-19T09:14:03.536 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:03 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:03.255+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:14:03.536 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:03 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:03.255+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:14:03.536 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:03 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:03.255+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:14:03.537 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:03 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:03.255+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:31.082547+0000 front 2024-09-19T09:13:31.082393+0000 (oldest deadline 2024-09-19T09:13:56.382324+0000) 2024-09-19T09:14:03.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:03 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:03.263+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:14:03.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:03 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:03.263+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:14:03.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:03 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:03.263+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:14:03.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:03 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:03.263+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:23.027848+0000 front 2024-09-19T09:13:23.027807+0000 (oldest deadline 2024-09-19T09:13:47.727922+0000) 2024-09-19T09:14:03.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:03 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:03.263+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:33.028800+0000 front 2024-09-19T09:13:33.028844+0000 (oldest deadline 2024-09-19T09:13:58.328900+0000) 2024-09-19T09:14:03.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:03 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:03.255+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:14:03.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:03 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:03.255+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:14:03.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:03 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:03.255+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:16.798224+0000 front 2024-09-19T09:13:16.798130+0000 (oldest deadline 2024-09-19T09:13:40.298009+0000) 2024-09-19T09:14:03.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:03 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:03.255+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:20.298329+0000 front 2024-09-19T09:13:20.298359+0000 (oldest deadline 2024-09-19T09:13:46.198388+0000) 2024-09-19T09:14:03.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:03 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:03.255+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:32.400713+0000 front 2024-09-19T09:13:32.400642+0000 (oldest deadline 2024-09-19T09:13:54.100470+0000) 2024-09-19T09:14:03.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:14:03 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:14:03.535+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:14:03.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:14:03 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:14:03.535+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:14.844594+0000 front 2024-09-19T09:13:14.844692+0000 (oldest deadline 2024-09-19T09:13:38.944688+0000) 2024-09-19T09:14:03.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:14:03 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:14:03.535+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:24.146221+0000 front 2024-09-19T09:13:24.146238+0000 (oldest deadline 2024-09-19T09:13:47.646080+0000) 2024-09-19T09:14:03.875 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:14:03 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:14:03.535+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:32.847670+0000 front 2024-09-19T09:13:32.847627+0000 (oldest deadline 2024-09-19T09:13:58.147528+0000) 2024-09-19T09:14:04.504 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:04 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:04.238+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:14:04.504 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:04 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:04.238+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:14:04.504 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:04 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:04.238+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:16.798224+0000 front 2024-09-19T09:13:16.798130+0000 (oldest deadline 2024-09-19T09:13:40.298009+0000) 2024-09-19T09:14:04.504 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:04 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:04.238+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:20.298329+0000 front 2024-09-19T09:13:20.298359+0000 (oldest deadline 2024-09-19T09:13:46.198388+0000) 2024-09-19T09:14:04.504 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:04 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:04.238+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:32.400713+0000 front 2024-09-19T09:13:32.400642+0000 (oldest deadline 2024-09-19T09:13:54.100470+0000) 2024-09-19T09:14:04.551 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:04 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:04.278+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:14:04.551 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:04 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:04.278+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:14:04.551 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:04 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:04.278+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:14:04.551 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:04 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:04.278+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:31.082547+0000 front 2024-09-19T09:13:31.082393+0000 (oldest deadline 2024-09-19T09:13:56.382324+0000) 2024-09-19T09:14:04.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:04 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:04.223+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:14:04.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:04 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:04.223+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:14:04.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:04 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:04.223+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:14:04.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:04 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:04.223+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:23.027848+0000 front 2024-09-19T09:13:23.027807+0000 (oldest deadline 2024-09-19T09:13:47.727922+0000) 2024-09-19T09:14:04.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:04 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:04.223+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:33.028800+0000 front 2024-09-19T09:13:33.028844+0000 (oldest deadline 2024-09-19T09:13:58.328900+0000) 2024-09-19T09:14:04.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:14:04 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:14:04.550+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:59.042371+0000 front 2024-09-19T09:12:59.042291+0000 (oldest deadline 2024-09-19T09:13:23.742492+0000) 2024-09-19T09:14:04.875 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:14:04 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:14:04.550+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:14.844594+0000 front 2024-09-19T09:13:14.844692+0000 (oldest deadline 2024-09-19T09:13:38.944688+0000) 2024-09-19T09:14:04.875 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:14:04 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:14:04.550+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:24.146221+0000 front 2024-09-19T09:13:24.146238+0000 (oldest deadline 2024-09-19T09:13:47.646080+0000) 2024-09-19T09:14:04.875 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:14:04 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8[53750]: 2024-09-19T09:14:04.550+0000 7fe1bcf14640 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:32.847670+0000 front 2024-09-19T09:13:32.847627+0000 (oldest deadline 2024-09-19T09:13:58.147528+0000) 2024-09-19T09:14:05.509 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:14:05 smithi190 podman[71350]: 2024-09-19 09:14:05.251359632 +0000 UTC m=+5.697646999 container died 43cb948bc09d9c37d0a661447a7cec7f5469c42b1b64e1f62bf12be7a349a762 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-19T09:14:05.510 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:05 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:05.261+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:14:05.510 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:05 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:05.261+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:14:05.510 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:05 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:05.261+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:14:05.510 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:05 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:05.261+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:31.082547+0000 front 2024-09-19T09:13:31.082393+0000 (oldest deadline 2024-09-19T09:13:56.382324+0000) 2024-09-19T09:14:05.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:05 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:05.224+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:14:05.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:05 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:05.224+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:14:05.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:05 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:05.224+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:14:05.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:05 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:05.224+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:23.027848+0000 front 2024-09-19T09:13:23.027807+0000 (oldest deadline 2024-09-19T09:13:47.727922+0000) 2024-09-19T09:14:05.603 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:05 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:05.224+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:33.028800+0000 front 2024-09-19T09:13:33.028844+0000 (oldest deadline 2024-09-19T09:13:58.328900+0000) 2024-09-19T09:14:05.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:05 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:05.263+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:14:05.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:05 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:05.263+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:14:05.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:05 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:05.263+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:16.798224+0000 front 2024-09-19T09:13:16.798130+0000 (oldest deadline 2024-09-19T09:13:40.298009+0000) 2024-09-19T09:14:05.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:05 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:05.263+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:20.298329+0000 front 2024-09-19T09:13:20.298359+0000 (oldest deadline 2024-09-19T09:13:46.198388+0000) 2024-09-19T09:14:05.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:05 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:05.263+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:32.400713+0000 front 2024-09-19T09:13:32.400642+0000 (oldest deadline 2024-09-19T09:13:54.100470+0000) 2024-09-19T09:14:05.835 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:14:05 smithi190 podman[71350]: 2024-09-19 09:14:05.600475519 +0000 UTC m=+6.046762891 container cleanup 43cb948bc09d9c37d0a661447a7cec7f5469c42b1b64e1f62bf12be7a349a762 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-19T09:14:05.835 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:14:05 smithi190 bash[71350]: ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8 2024-09-19T09:14:06.124 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:14:05 smithi190 podman[71367]: 2024-09-19 09:14:05.835113892 +0000 UTC m=+0.578340779 container remove 43cb948bc09d9c37d0a661447a7cec7f5469c42b1b64e1f62bf12be7a349a762 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-19T09:14:06.429 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:14:06 smithi190 podman[71458]: 2024-09-19 09:14:06.160983393 +0000 UTC m=+0.112054096 container create cf6e36e92232ee27ebd7267fe47f38a5335ca4b8f0fe957ab3ad0729dc9bfeff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-19T09:14:06.430 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:14:06 smithi190 podman[71458]: 2024-09-19 09:14:06.06480579 +0000 UTC m=+0.015876461 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:14:06.430 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:06 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:06.281+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:14:06.430 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:06 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:06.281+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:14:06.430 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:06 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:06.281+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:14:06.430 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:06 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:06.281+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:31.082547+0000 front 2024-09-19T09:13:31.082393+0000 (oldest deadline 2024-09-19T09:13:56.382324+0000) 2024-09-19T09:14:06.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:06 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:06.176+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:14:06.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:06 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:06.176+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:14:06.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:06 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:06.176+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:14:06.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:06 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:06.176+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:23.027848+0000 front 2024-09-19T09:13:23.027807+0000 (oldest deadline 2024-09-19T09:13:47.727922+0000) 2024-09-19T09:14:06.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:06 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:06.176+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:33.028800+0000 front 2024-09-19T09:13:33.028844+0000 (oldest deadline 2024-09-19T09:13:58.328900+0000) 2024-09-19T09:14:06.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:06 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:06.176+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:38.830011+0000 front 2024-09-19T09:13:38.830054+0000 (oldest deadline 2024-09-19T09:14:05.830289+0000) 2024-09-19T09:14:06.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:06 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:06.259+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:14:06.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:06 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:06.259+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:14:06.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:06 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:06.259+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:16.798224+0000 front 2024-09-19T09:13:16.798130+0000 (oldest deadline 2024-09-19T09:13:40.298009+0000) 2024-09-19T09:14:06.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:06 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:06.259+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:20.298329+0000 front 2024-09-19T09:13:20.298359+0000 (oldest deadline 2024-09-19T09:13:46.198388+0000) 2024-09-19T09:14:06.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:06 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:06.259+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:32.400713+0000 front 2024-09-19T09:13:32.400642+0000 (oldest deadline 2024-09-19T09:13:54.100470+0000) 2024-09-19T09:14:06.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:06 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:06.259+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:39.901734+0000 front 2024-09-19T09:13:39.901751+0000 (oldest deadline 2024-09-19T09:14:05.801709+0000) 2024-09-19T09:14:06.874 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:14:06 smithi190 podman[71458]: 2024-09-19 09:14:06.429809736 +0000 UTC m=+0.380880396 container init cf6e36e92232ee27ebd7267fe47f38a5335ca4b8f0fe957ab3ad0729dc9bfeff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-19T09:14:06.875 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:14:06 smithi190 podman[71458]: 2024-09-19 09:14:06.433306811 +0000 UTC m=+0.384377473 container start cf6e36e92232ee27ebd7267fe47f38a5335ca4b8f0fe957ab3ad0729dc9bfeff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2) 2024-09-19T09:14:06.875 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:14:06 smithi190 podman[71458]: 2024-09-19 09:14:06.50465966 +0000 UTC m=+0.455730335 container attach cf6e36e92232ee27ebd7267fe47f38a5335ca4b8f0fe957ab3ad0729dc9bfeff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-19T09:14:06.875 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:14:06 smithi190 podman[71458]: 2024-09-19 09:14:06.62003875 +0000 UTC m=+0.571109417 container died cf6e36e92232ee27ebd7267fe47f38a5335ca4b8f0fe957ab3ad0729dc9bfeff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:14:07.143 INFO:journalctl@ceph.osd.8.smithi190.stdout:Sep 19 09:14:07 smithi190 podman[71481]: 2024-09-19 09:14:07.140889611 +0000 UTC m=+0.514381334 container remove cf6e36e92232ee27ebd7267fe47f38a5335ca4b8f0fe957ab3ad0729dc9bfeff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-19T09:14:07.160 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@osd.8.service' 2024-09-19T09:14:07.240 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:14:07.240 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-19T09:14:07.240 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-19T09:14:07.240 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-91ff74f2-7663-11ef-bceb-c7b262605968@osd.9 2024-09-19T09:14:07.411 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:07 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:07.284+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:14:07.412 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:07 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:07.284+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:14:07.412 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:07 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:07.284+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:14:07.412 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:07 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:07.284+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:31.082547+0000 front 2024-09-19T09:13:31.082393+0000 (oldest deadline 2024-09-19T09:13:56.382324+0000) 2024-09-19T09:14:07.412 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:07 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:07.284+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:41.083094+0000 front 2024-09-19T09:13:41.083148+0000 (oldest deadline 2024-09-19T09:14:06.383257+0000) 2024-09-19T09:14:07.504 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:07 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:07.251+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:14:07.504 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:07 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:07.251+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:14:07.504 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:07 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:07.251+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:16.798224+0000 front 2024-09-19T09:13:16.798130+0000 (oldest deadline 2024-09-19T09:13:40.298009+0000) 2024-09-19T09:14:07.504 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:07 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:07.251+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:20.298329+0000 front 2024-09-19T09:13:20.298359+0000 (oldest deadline 2024-09-19T09:13:46.198388+0000) 2024-09-19T09:14:07.504 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:07 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:07.251+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:32.400713+0000 front 2024-09-19T09:13:32.400642+0000 (oldest deadline 2024-09-19T09:13:54.100470+0000) 2024-09-19T09:14:07.504 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:07 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:07.251+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:39.901734+0000 front 2024-09-19T09:13:39.901751+0000 (oldest deadline 2024-09-19T09:14:05.801709+0000) 2024-09-19T09:14:07.504 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:07 smithi092 systemd[1]: Stopping Ceph osd.9 for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T09:14:07.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:07 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:07.169+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:14:07.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:07 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:07.169+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:14:07.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:07 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:07.169+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:14:07.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:07 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:07.169+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:23.027848+0000 front 2024-09-19T09:13:23.027807+0000 (oldest deadline 2024-09-19T09:13:47.727922+0000) 2024-09-19T09:14:07.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:07 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:07.169+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:33.028800+0000 front 2024-09-19T09:13:33.028844+0000 (oldest deadline 2024-09-19T09:13:58.328900+0000) 2024-09-19T09:14:07.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:07 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:07.169+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:38.830011+0000 front 2024-09-19T09:13:38.830054+0000 (oldest deadline 2024-09-19T09:14:05.830289+0000) 2024-09-19T09:14:08.004 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:07 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:07.550+0000 7ff91e6c6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:14:08.005 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:07 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:07.550+0000 7ff91e6c6640 -1 osd.9 85 *** Got signal Terminated *** 2024-09-19T09:14:08.005 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:07 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:07.550+0000 7ff91e6c6640 -1 osd.9 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:14:08.504 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:08 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:08.250+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:14:08.504 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:08 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:08.250+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:14:08.504 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:08 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:08.250+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:16.798224+0000 front 2024-09-19T09:13:16.798130+0000 (oldest deadline 2024-09-19T09:13:40.298009+0000) 2024-09-19T09:14:08.504 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:08 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:08.250+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:20.298329+0000 front 2024-09-19T09:13:20.298359+0000 (oldest deadline 2024-09-19T09:13:46.198388+0000) 2024-09-19T09:14:08.504 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:08 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:08.250+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:32.400713+0000 front 2024-09-19T09:13:32.400642+0000 (oldest deadline 2024-09-19T09:13:54.100470+0000) 2024-09-19T09:14:08.504 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:08 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:08.250+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:39.901734+0000 front 2024-09-19T09:13:39.901751+0000 (oldest deadline 2024-09-19T09:14:05.801709+0000) 2024-09-19T09:14:08.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:08 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:08.149+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:14:08.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:08 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:08.149+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:14:08.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:08 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:08.149+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:14:08.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:08 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:08.149+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:23.027848+0000 front 2024-09-19T09:13:23.027807+0000 (oldest deadline 2024-09-19T09:13:47.727922+0000) 2024-09-19T09:14:08.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:08 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:08.149+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:33.028800+0000 front 2024-09-19T09:13:33.028844+0000 (oldest deadline 2024-09-19T09:13:58.328900+0000) 2024-09-19T09:14:08.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:08 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:08.149+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:38.830011+0000 front 2024-09-19T09:13:38.830054+0000 (oldest deadline 2024-09-19T09:14:05.830289+0000) 2024-09-19T09:14:08.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:08 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:08.249+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:14:08.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:08 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:08.249+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:14:08.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:08 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:08.249+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:14:08.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:08 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:08.249+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:31.082547+0000 front 2024-09-19T09:13:31.082393+0000 (oldest deadline 2024-09-19T09:13:56.382324+0000) 2024-09-19T09:14:08.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:08 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:08.249+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:41.083094+0000 front 2024-09-19T09:13:41.083148+0000 (oldest deadline 2024-09-19T09:14:06.383257+0000) 2024-09-19T09:14:09.504 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:09 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:09.235+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:14:09.504 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:09 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:09.235+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:14:09.504 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:09 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:09.235+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:16.798224+0000 front 2024-09-19T09:13:16.798130+0000 (oldest deadline 2024-09-19T09:13:40.298009+0000) 2024-09-19T09:14:09.504 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:09 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:09.235+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:20.298329+0000 front 2024-09-19T09:13:20.298359+0000 (oldest deadline 2024-09-19T09:13:46.198388+0000) 2024-09-19T09:14:09.504 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:09 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:09.235+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:32.400713+0000 front 2024-09-19T09:13:32.400642+0000 (oldest deadline 2024-09-19T09:13:54.100470+0000) 2024-09-19T09:14:09.504 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:09 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:09.235+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:39.901734+0000 front 2024-09-19T09:13:39.901751+0000 (oldest deadline 2024-09-19T09:14:05.801709+0000) 2024-09-19T09:14:09.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:09 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:09.165+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:14:09.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:09 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:09.165+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:14:09.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:09 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:09.165+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:14:09.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:09 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:09.165+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:23.027848+0000 front 2024-09-19T09:13:23.027807+0000 (oldest deadline 2024-09-19T09:13:47.727922+0000) 2024-09-19T09:14:09.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:09 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:09.165+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:33.028800+0000 front 2024-09-19T09:13:33.028844+0000 (oldest deadline 2024-09-19T09:13:58.328900+0000) 2024-09-19T09:14:09.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:09 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:09.165+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:38.830011+0000 front 2024-09-19T09:13:38.830054+0000 (oldest deadline 2024-09-19T09:14:05.830289+0000) 2024-09-19T09:14:09.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:09 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:09.277+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:14:09.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:09 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:09.277+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:14:09.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:09 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:09.277+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:14:09.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:09 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:09.277+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:31.082547+0000 front 2024-09-19T09:13:31.082393+0000 (oldest deadline 2024-09-19T09:13:56.382324+0000) 2024-09-19T09:14:09.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:09 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:09.277+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:41.083094+0000 front 2024-09-19T09:13:41.083148+0000 (oldest deadline 2024-09-19T09:14:06.383257+0000) 2024-09-19T09:14:10.503 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:10 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:10.123+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:14:10.504 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:10 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:10.123+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:14:10.504 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:10 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:10.123+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:14:10.504 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:10 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:10.123+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:23.027848+0000 front 2024-09-19T09:13:23.027807+0000 (oldest deadline 2024-09-19T09:13:47.727922+0000) 2024-09-19T09:14:10.504 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:10 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:10.123+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:33.028800+0000 front 2024-09-19T09:13:33.028844+0000 (oldest deadline 2024-09-19T09:13:58.328900+0000) 2024-09-19T09:14:10.504 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:10 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:10.123+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:38.830011+0000 front 2024-09-19T09:13:38.830054+0000 (oldest deadline 2024-09-19T09:14:05.830289+0000) 2024-09-19T09:14:10.504 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:10 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:10.224+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:14:10.504 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:10 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:10.224+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:14:10.505 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:10 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:10.224+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:16.798224+0000 front 2024-09-19T09:13:16.798130+0000 (oldest deadline 2024-09-19T09:13:40.298009+0000) 2024-09-19T09:14:10.505 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:10 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:10.224+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:20.298329+0000 front 2024-09-19T09:13:20.298359+0000 (oldest deadline 2024-09-19T09:13:46.198388+0000) 2024-09-19T09:14:10.505 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:10 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:10.224+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:32.400713+0000 front 2024-09-19T09:13:32.400642+0000 (oldest deadline 2024-09-19T09:13:54.100470+0000) 2024-09-19T09:14:10.505 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:10 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:10.224+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:39.901734+0000 front 2024-09-19T09:13:39.901751+0000 (oldest deadline 2024-09-19T09:14:05.801709+0000) 2024-09-19T09:14:10.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:10 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:10.266+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:14:10.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:10 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:10.266+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:14:10.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:10 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:10.266+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:14:10.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:10 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:10.266+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:31.082547+0000 front 2024-09-19T09:13:31.082393+0000 (oldest deadline 2024-09-19T09:13:56.382324+0000) 2024-09-19T09:14:10.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:10 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:10.266+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:41.083094+0000 front 2024-09-19T09:13:41.083148+0000 (oldest deadline 2024-09-19T09:14:06.383257+0000) 2024-09-19T09:14:11.521 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:11 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:11.158+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:14:11.521 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:11 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:11.158+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:14:11.521 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:11 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:11.158+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:14:11.521 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:11 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:11.158+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:23.027848+0000 front 2024-09-19T09:13:23.027807+0000 (oldest deadline 2024-09-19T09:13:47.727922+0000) 2024-09-19T09:14:11.521 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:11 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:11.158+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:33.028800+0000 front 2024-09-19T09:13:33.028844+0000 (oldest deadline 2024-09-19T09:13:58.328900+0000) 2024-09-19T09:14:11.522 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:11 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:11.158+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:38.830011+0000 front 2024-09-19T09:13:38.830054+0000 (oldest deadline 2024-09-19T09:14:05.830289+0000) 2024-09-19T09:14:11.522 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:11 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:11.158+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-19T09:13:45.831010+0000 front 2024-09-19T09:13:45.831070+0000 (oldest deadline 2024-09-19T09:14:10.530778+0000) 2024-09-19T09:14:11.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:11 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:11.303+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:14:11.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:11 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:11.303+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:14:11.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:11 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:11.303+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:14:11.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:11 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:11.303+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:31.082547+0000 front 2024-09-19T09:13:31.082393+0000 (oldest deadline 2024-09-19T09:13:56.382324+0000) 2024-09-19T09:14:11.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:11 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:11.303+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:41.083094+0000 front 2024-09-19T09:13:41.083148+0000 (oldest deadline 2024-09-19T09:14:06.383257+0000) 2024-09-19T09:14:11.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:11 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:11.303+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-19T09:13:46.383787+0000 front 2024-09-19T09:13:46.383931+0000 (oldest deadline 2024-09-19T09:14:11.083701+0000) 2024-09-19T09:14:11.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:11 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:11.273+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:14:11.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:11 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:11.273+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:14:11.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:11 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:11.273+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:16.798224+0000 front 2024-09-19T09:13:16.798130+0000 (oldest deadline 2024-09-19T09:13:40.298009+0000) 2024-09-19T09:14:11.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:11 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:11.273+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:20.298329+0000 front 2024-09-19T09:13:20.298359+0000 (oldest deadline 2024-09-19T09:13:46.198388+0000) 2024-09-19T09:14:11.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:11 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:11.273+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:32.400713+0000 front 2024-09-19T09:13:32.400642+0000 (oldest deadline 2024-09-19T09:13:54.100470+0000) 2024-09-19T09:14:11.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:11 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:11.273+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:39.901734+0000 front 2024-09-19T09:13:39.901751+0000 (oldest deadline 2024-09-19T09:14:05.801709+0000) 2024-09-19T09:14:12.526 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:12 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:12.269+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:14:12.526 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:12 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:12.269+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:14:12.526 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:12 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:12.269+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:14:12.526 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:12 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:12.269+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:31.082547+0000 front 2024-09-19T09:13:31.082393+0000 (oldest deadline 2024-09-19T09:13:56.382324+0000) 2024-09-19T09:14:12.526 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:12 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:12.269+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:41.083094+0000 front 2024-09-19T09:13:41.083148+0000 (oldest deadline 2024-09-19T09:14:06.383257+0000) 2024-09-19T09:14:12.526 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:12 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:12.269+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-19T09:13:46.383787+0000 front 2024-09-19T09:13:46.383931+0000 (oldest deadline 2024-09-19T09:14:11.083701+0000) 2024-09-19T09:14:12.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:12 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:12.186+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:14:12.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:12 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:12.186+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:14:12.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:12 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:12.186+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:14:12.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:12 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:12.186+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:23.027848+0000 front 2024-09-19T09:13:23.027807+0000 (oldest deadline 2024-09-19T09:13:47.727922+0000) 2024-09-19T09:14:12.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:12 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:12.186+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:33.028800+0000 front 2024-09-19T09:13:33.028844+0000 (oldest deadline 2024-09-19T09:13:58.328900+0000) 2024-09-19T09:14:12.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:12 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:12.186+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:38.830011+0000 front 2024-09-19T09:13:38.830054+0000 (oldest deadline 2024-09-19T09:14:05.830289+0000) 2024-09-19T09:14:12.603 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:12 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:12.186+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-19T09:13:45.831010+0000 front 2024-09-19T09:13:45.831070+0000 (oldest deadline 2024-09-19T09:14:10.530778+0000) 2024-09-19T09:14:12.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:12 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:12.305+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:00.996003+0000 front 2024-09-19T09:13:00.995983+0000 (oldest deadline 2024-09-19T09:13:26.296154+0000) 2024-09-19T09:14:12.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:12 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:12.305+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:09.197076+0000 front 2024-09-19T09:13:09.197010+0000 (oldest deadline 2024-09-19T09:13:32.697117+0000) 2024-09-19T09:14:12.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:12 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:12.305+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:16.798224+0000 front 2024-09-19T09:13:16.798130+0000 (oldest deadline 2024-09-19T09:13:40.298009+0000) 2024-09-19T09:14:12.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:12 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:12.305+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:20.298329+0000 front 2024-09-19T09:13:20.298359+0000 (oldest deadline 2024-09-19T09:13:46.198388+0000) 2024-09-19T09:14:12.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:12 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:12.305+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:32.400713+0000 front 2024-09-19T09:13:32.400642+0000 (oldest deadline 2024-09-19T09:13:54.100470+0000) 2024-09-19T09:14:12.754 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:12 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:12.305+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:39.901734+0000 front 2024-09-19T09:13:39.901751+0000 (oldest deadline 2024-09-19T09:14:05.801709+0000) 2024-09-19T09:14:12.755 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:12 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9[62952]: 2024-09-19T09:14:12.305+0000 7ff91accb640 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-19T09:13:46.302422+0000 front 2024-09-19T09:13:46.302441+0000 (oldest deadline 2024-09-19T09:14:11.602474+0000) 2024-09-19T09:14:13.408 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:13 smithi092 podman[118212]: 2024-09-19 09:14:13.058903479 +0000 UTC m=+5.613927763 container died 188309d6209d5fdb79da353a5018566490b485204a90c0d08bd581fa4a936433 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-19T09:14:13.408 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:13 smithi092 podman[118212]: 2024-09-19 09:14:13.408232947 +0000 UTC m=+5.963257223 container cleanup 188309d6209d5fdb79da353a5018566490b485204a90c0d08bd581fa4a936433 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:14:13.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:13 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:13.204+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:14:13.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:13 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:13.204+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:14:13.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:13 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:13.204+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:14:13.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:13 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:13.204+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:23.027848+0000 front 2024-09-19T09:13:23.027807+0000 (oldest deadline 2024-09-19T09:13:47.727922+0000) 2024-09-19T09:14:13.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:13 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:13.204+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:33.028800+0000 front 2024-09-19T09:13:33.028844+0000 (oldest deadline 2024-09-19T09:13:58.328900+0000) 2024-09-19T09:14:13.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:13 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:13.204+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:38.830011+0000 front 2024-09-19T09:13:38.830054+0000 (oldest deadline 2024-09-19T09:14:05.830289+0000) 2024-09-19T09:14:13.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:13 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:13.204+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-19T09:13:45.831010+0000 front 2024-09-19T09:13:45.831070+0000 (oldest deadline 2024-09-19T09:14:10.530778+0000) 2024-09-19T09:14:13.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:13 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:13.265+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:14:13.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:13 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:13.265+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:14:13.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:13 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:13.265+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:14:13.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:13 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:13.265+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:31.082547+0000 front 2024-09-19T09:13:31.082393+0000 (oldest deadline 2024-09-19T09:13:56.382324+0000) 2024-09-19T09:14:13.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:13 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:13.265+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:41.083094+0000 front 2024-09-19T09:13:41.083148+0000 (oldest deadline 2024-09-19T09:14:06.383257+0000) 2024-09-19T09:14:13.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:13 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:13.265+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-19T09:13:46.383787+0000 front 2024-09-19T09:13:46.383931+0000 (oldest deadline 2024-09-19T09:14:11.083701+0000) 2024-09-19T09:14:13.676 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:13 smithi092 bash[118212]: ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9 2024-09-19T09:14:14.004 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:13 smithi092 podman[118228]: 2024-09-19 09:14:13.676472756 +0000 UTC m=+0.620126341 container remove 188309d6209d5fdb79da353a5018566490b485204a90c0d08bd581fa4a936433 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:14:14.279 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:14 smithi092 podman[118315]: 2024-09-19 09:14:14.010546465 +0000 UTC m=+0.104292074 container create 5e375b6e8ba8df6803568b2e4d71d23d5ff164eaf13aa6a944095ac92c196887 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4) 2024-09-19T09:14:14.280 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:14 smithi092 podman[118315]: 2024-09-19 09:14:13.922017643 +0000 UTC m=+0.015763227 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:14:14.280 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:14 smithi092 podman[118315]: 2024-09-19 09:14:14.204604204 +0000 UTC m=+0.298349778 container init 5e375b6e8ba8df6803568b2e4d71d23d5ff164eaf13aa6a944095ac92c196887 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:14:14.280 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:14 smithi092 podman[118315]: 2024-09-19 09:14:14.207980218 +0000 UTC m=+0.301725781 container start 5e375b6e8ba8df6803568b2e4d71d23d5ff164eaf13aa6a944095ac92c196887 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-19T09:14:14.280 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:14 smithi092 podman[118315]: 2024-09-19 09:14:14.279461308 +0000 UTC m=+0.373206888 container attach 5e375b6e8ba8df6803568b2e4d71d23d5ff164eaf13aa6a944095ac92c196887 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-19T09:14:14.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:14 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:14.199+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:14:14.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:14 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:14.199+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:14:14.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:14 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:14.199+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:14:14.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:14 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:14.199+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:23.027848+0000 front 2024-09-19T09:13:23.027807+0000 (oldest deadline 2024-09-19T09:13:47.727922+0000) 2024-09-19T09:14:14.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:14 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:14.199+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:33.028800+0000 front 2024-09-19T09:13:33.028844+0000 (oldest deadline 2024-09-19T09:13:58.328900+0000) 2024-09-19T09:14:14.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:14 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:14.199+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:38.830011+0000 front 2024-09-19T09:13:38.830054+0000 (oldest deadline 2024-09-19T09:14:05.830289+0000) 2024-09-19T09:14:14.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:14 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:14.199+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-19T09:13:45.831010+0000 front 2024-09-19T09:13:45.831070+0000 (oldest deadline 2024-09-19T09:14:10.530778+0000) 2024-09-19T09:14:14.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:14 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:14.296+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:14:14.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:14 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:14.296+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:14:14.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:14 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:14.296+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:14:14.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:14 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:14.296+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:31.082547+0000 front 2024-09-19T09:13:31.082393+0000 (oldest deadline 2024-09-19T09:13:56.382324+0000) 2024-09-19T09:14:14.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:14 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:14.296+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:41.083094+0000 front 2024-09-19T09:13:41.083148+0000 (oldest deadline 2024-09-19T09:14:06.383257+0000) 2024-09-19T09:14:14.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:14 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:14.296+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-19T09:13:46.383787+0000 front 2024-09-19T09:13:46.383931+0000 (oldest deadline 2024-09-19T09:14:11.083701+0000) 2024-09-19T09:14:14.690 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 19 09:14:14 smithi092 podman[118315]: 2024-09-19 09:14:14.394929035 +0000 UTC m=+0.488674612 container died 5e375b6e8ba8df6803568b2e4d71d23d5ff164eaf13aa6a944095ac92c196887 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:14:15.032 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@osd.9.service' 2024-09-19T09:14:15.072 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:14:15.072 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-19T09:14:15.073 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-19T09:14:15.073 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-91ff74f2-7663-11ef-bceb-c7b262605968@osd.10 2024-09-19T09:14:15.352 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:15 smithi167 systemd[1]: Stopping Ceph osd.10 for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T09:14:15.352 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:15 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:15.191+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:14:15.352 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:15 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:15.191+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:14:15.353 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:15 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:15.191+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:14:15.353 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:15 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:15.191+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:23.027848+0000 front 2024-09-19T09:13:23.027807+0000 (oldest deadline 2024-09-19T09:13:47.727922+0000) 2024-09-19T09:14:15.353 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:15 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:15.191+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:33.028800+0000 front 2024-09-19T09:13:33.028844+0000 (oldest deadline 2024-09-19T09:13:58.328900+0000) 2024-09-19T09:14:15.353 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:15 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:15.191+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:38.830011+0000 front 2024-09-19T09:13:38.830054+0000 (oldest deadline 2024-09-19T09:14:05.830289+0000) 2024-09-19T09:14:15.353 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:15 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:15.191+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-19T09:13:45.831010+0000 front 2024-09-19T09:13:45.831070+0000 (oldest deadline 2024-09-19T09:14:10.530778+0000) 2024-09-19T09:14:15.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:15 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:15.256+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:14:15.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:15 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:15.256+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:14:15.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:15 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:15.256+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:14:15.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:15 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:15.256+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:31.082547+0000 front 2024-09-19T09:13:31.082393+0000 (oldest deadline 2024-09-19T09:13:56.382324+0000) 2024-09-19T09:14:15.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:15 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:15.256+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:41.083094+0000 front 2024-09-19T09:13:41.083148+0000 (oldest deadline 2024-09-19T09:14:06.383257+0000) 2024-09-19T09:14:15.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:15 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:15.256+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-19T09:13:46.383787+0000 front 2024-09-19T09:13:46.383931+0000 (oldest deadline 2024-09-19T09:14:11.083701+0000) 2024-09-19T09:14:15.852 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:15 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:15.389+0000 7f4575622640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:14:15.852 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:15 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:15.389+0000 7f4575622640 -1 osd.10 85 *** Got signal Terminated *** 2024-09-19T09:14:15.852 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:15 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:15.389+0000 7f4575622640 -1 osd.10 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:14:16.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:16 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:16.185+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:14:16.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:16 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:16.185+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:14:16.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:16 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:16.185+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:14:16.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:16 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:16.185+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:23.027848+0000 front 2024-09-19T09:13:23.027807+0000 (oldest deadline 2024-09-19T09:13:47.727922+0000) 2024-09-19T09:14:16.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:16 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:16.185+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:33.028800+0000 front 2024-09-19T09:13:33.028844+0000 (oldest deadline 2024-09-19T09:13:58.328900+0000) 2024-09-19T09:14:16.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:16 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:16.185+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:38.830011+0000 front 2024-09-19T09:13:38.830054+0000 (oldest deadline 2024-09-19T09:14:05.830289+0000) 2024-09-19T09:14:16.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:16 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:16.185+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-19T09:13:45.831010+0000 front 2024-09-19T09:13:45.831070+0000 (oldest deadline 2024-09-19T09:14:10.530778+0000) 2024-09-19T09:14:16.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:16 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:16.253+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:14:16.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:16 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:16.253+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:14:16.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:16 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:16.253+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:14:16.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:16 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:16.253+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:31.082547+0000 front 2024-09-19T09:13:31.082393+0000 (oldest deadline 2024-09-19T09:13:56.382324+0000) 2024-09-19T09:14:16.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:16 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:16.253+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:41.083094+0000 front 2024-09-19T09:13:41.083148+0000 (oldest deadline 2024-09-19T09:14:06.383257+0000) 2024-09-19T09:14:16.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:16 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:16.253+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-19T09:13:46.383787+0000 front 2024-09-19T09:13:46.383931+0000 (oldest deadline 2024-09-19T09:14:11.083701+0000) 2024-09-19T09:14:17.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:17 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:17.162+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:14:17.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:17 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:17.162+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:14:17.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:17 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:17.162+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:14:17.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:17 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:17.162+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:23.027848+0000 front 2024-09-19T09:13:23.027807+0000 (oldest deadline 2024-09-19T09:13:47.727922+0000) 2024-09-19T09:14:17.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:17 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:17.162+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:33.028800+0000 front 2024-09-19T09:13:33.028844+0000 (oldest deadline 2024-09-19T09:13:58.328900+0000) 2024-09-19T09:14:17.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:17 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:17.162+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:38.830011+0000 front 2024-09-19T09:13:38.830054+0000 (oldest deadline 2024-09-19T09:14:05.830289+0000) 2024-09-19T09:14:17.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:17 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:17.162+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-19T09:13:45.831010+0000 front 2024-09-19T09:13:45.831070+0000 (oldest deadline 2024-09-19T09:14:10.530778+0000) 2024-09-19T09:14:17.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:17 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:17.257+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:14:17.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:17 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:17.257+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:14:17.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:17 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:17.257+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:14:17.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:17 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:17.257+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:31.082547+0000 front 2024-09-19T09:13:31.082393+0000 (oldest deadline 2024-09-19T09:13:56.382324+0000) 2024-09-19T09:14:17.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:17 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:17.257+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:41.083094+0000 front 2024-09-19T09:13:41.083148+0000 (oldest deadline 2024-09-19T09:14:06.383257+0000) 2024-09-19T09:14:17.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:17 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:17.257+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-19T09:13:46.383787+0000 front 2024-09-19T09:13:46.383931+0000 (oldest deadline 2024-09-19T09:14:11.083701+0000) 2024-09-19T09:14:18.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:18 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:18.178+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:14:18.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:18 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:18.178+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:14:18.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:18 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:18.178+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:14:18.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:18 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:18.178+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:23.027848+0000 front 2024-09-19T09:13:23.027807+0000 (oldest deadline 2024-09-19T09:13:47.727922+0000) 2024-09-19T09:14:18.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:18 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:18.178+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:33.028800+0000 front 2024-09-19T09:13:33.028844+0000 (oldest deadline 2024-09-19T09:13:58.328900+0000) 2024-09-19T09:14:18.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:18 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:18.178+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:38.830011+0000 front 2024-09-19T09:13:38.830054+0000 (oldest deadline 2024-09-19T09:14:05.830289+0000) 2024-09-19T09:14:18.603 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:18 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:18.178+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-19T09:13:45.831010+0000 front 2024-09-19T09:13:45.831070+0000 (oldest deadline 2024-09-19T09:14:10.530778+0000) 2024-09-19T09:14:18.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:18 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:18.298+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:14:18.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:18 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:18.298+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:14:18.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:18 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:18.298+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:14:18.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:18 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:18.298+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:31.082547+0000 front 2024-09-19T09:13:31.082393+0000 (oldest deadline 2024-09-19T09:13:56.382324+0000) 2024-09-19T09:14:18.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:18 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:18.298+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:41.083094+0000 front 2024-09-19T09:13:41.083148+0000 (oldest deadline 2024-09-19T09:14:06.383257+0000) 2024-09-19T09:14:18.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:18 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:18.298+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-19T09:13:46.383787+0000 front 2024-09-19T09:13:46.383931+0000 (oldest deadline 2024-09-19T09:14:11.083701+0000) 2024-09-19T09:14:19.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:19 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:19.217+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:14:19.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:19 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:19.217+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:14:19.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:19 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:19.217+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:14:19.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:19 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:19.217+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:23.027848+0000 front 2024-09-19T09:13:23.027807+0000 (oldest deadline 2024-09-19T09:13:47.727922+0000) 2024-09-19T09:14:19.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:19 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:19.217+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:33.028800+0000 front 2024-09-19T09:13:33.028844+0000 (oldest deadline 2024-09-19T09:13:58.328900+0000) 2024-09-19T09:14:19.603 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:19 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:19.217+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:38.830011+0000 front 2024-09-19T09:13:38.830054+0000 (oldest deadline 2024-09-19T09:14:05.830289+0000) 2024-09-19T09:14:19.603 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:19 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:19.217+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-19T09:13:45.831010+0000 front 2024-09-19T09:13:45.831070+0000 (oldest deadline 2024-09-19T09:14:10.530778+0000) 2024-09-19T09:14:19.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:19 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:19.324+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:14:19.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:19 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:19.324+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:14:19.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:19 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:19.324+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:14:19.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:19 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:19.324+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:31.082547+0000 front 2024-09-19T09:13:31.082393+0000 (oldest deadline 2024-09-19T09:13:56.382324+0000) 2024-09-19T09:14:19.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:19 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:19.324+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:41.083094+0000 front 2024-09-19T09:13:41.083148+0000 (oldest deadline 2024-09-19T09:14:06.383257+0000) 2024-09-19T09:14:19.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:19 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:19.324+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-19T09:13:46.383787+0000 front 2024-09-19T09:13:46.383931+0000 (oldest deadline 2024-09-19T09:14:11.083701+0000) 2024-09-19T09:14:20.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:20 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:20.209+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:13:01.122604+0000 front 2024-09-19T09:13:01.122651+0000 (oldest deadline 2024-09-19T09:13:22.822501+0000) 2024-09-19T09:14:20.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:20 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:20.209+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:07.924604+0000 front 2024-09-19T09:13:07.924660+0000 (oldest deadline 2024-09-19T09:13:32.024794+0000) 2024-09-19T09:14:20.603 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:20 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:20.209+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.525902+0000 front 2024-09-19T09:13:15.525991+0000 (oldest deadline 2024-09-19T09:13:40.226096+0000) 2024-09-19T09:14:20.603 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:20 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:20.209+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-19T09:13:23.027848+0000 front 2024-09-19T09:13:23.027807+0000 (oldest deadline 2024-09-19T09:13:47.727922+0000) 2024-09-19T09:14:20.603 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:20 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:20.209+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:33.028800+0000 front 2024-09-19T09:13:33.028844+0000 (oldest deadline 2024-09-19T09:13:58.328900+0000) 2024-09-19T09:14:20.603 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:20 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:20.209+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:38.830011+0000 front 2024-09-19T09:13:38.830054+0000 (oldest deadline 2024-09-19T09:14:05.830289+0000) 2024-09-19T09:14:20.603 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:20 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10[60698]: 2024-09-19T09:14:20.209+0000 7f4571c27640 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-19T09:13:45.831010+0000 front 2024-09-19T09:13:45.831070+0000 (oldest deadline 2024-09-19T09:14:10.530778+0000) 2024-09-19T09:14:20.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:20 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:20.343+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:14:20.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:20 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:20.343+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:14:20.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:20 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:20.343+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:14:20.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:20 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:20.343+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:31.082547+0000 front 2024-09-19T09:13:31.082393+0000 (oldest deadline 2024-09-19T09:13:56.382324+0000) 2024-09-19T09:14:20.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:20 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:20.343+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:41.083094+0000 front 2024-09-19T09:13:41.083148+0000 (oldest deadline 2024-09-19T09:14:06.383257+0000) 2024-09-19T09:14:20.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:20 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:20.343+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-19T09:13:46.383787+0000 front 2024-09-19T09:13:46.383931+0000 (oldest deadline 2024-09-19T09:14:11.083701+0000) 2024-09-19T09:14:21.266 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:20 smithi167 podman[71559]: 2024-09-19 09:14:20.935425501 +0000 UTC m=+5.668097735 container died 4d47457edd71e253c7cfd6165e8762f4ad871d3a84a0c03ecbdca05709d9e8e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:14:21.566 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:21 smithi167 podman[71559]: 2024-09-19 09:14:21.356355091 +0000 UTC m=+6.089027359 container cleanup 4d47457edd71e253c7cfd6165e8762f4ad871d3a84a0c03ecbdca05709d9e8e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-19T09:14:21.566 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:21 smithi167 bash[71559]: ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10 2024-09-19T09:14:21.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:21 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:21.346+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:14:21.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:21 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:21.346+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:14:21.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:21 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:21.346+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:14:21.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:21 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:21.346+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:31.082547+0000 front 2024-09-19T09:13:31.082393+0000 (oldest deadline 2024-09-19T09:13:56.382324+0000) 2024-09-19T09:14:21.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:21 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:21.346+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:41.083094+0000 front 2024-09-19T09:13:41.083148+0000 (oldest deadline 2024-09-19T09:14:06.383257+0000) 2024-09-19T09:14:21.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:21 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:21.346+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-19T09:13:46.383787+0000 front 2024-09-19T09:13:46.383931+0000 (oldest deadline 2024-09-19T09:14:11.083701+0000) 2024-09-19T09:14:21.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:21 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:21.346+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6820 osd.7 since back 2024-09-19T09:13:55.084820+0000 front 2024-09-19T09:13:55.084894+0000 (oldest deadline 2024-09-19T09:14:20.384783+0000) 2024-09-19T09:14:21.852 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:21 smithi167 podman[71575]: 2024-09-19 09:14:21.565891971 +0000 UTC m=+0.622477434 container remove 4d47457edd71e253c7cfd6165e8762f4ad871d3a84a0c03ecbdca05709d9e8e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-19T09:14:22.239 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:21 smithi167 podman[71668]: 2024-09-19 09:14:21.974960228 +0000 UTC m=+0.109486281 container create 16145323045f5dd7abdeb939dcf56ba228cbdcf5fbb529d11fc4c8cc26280911 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:14:22.239 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:21 smithi167 podman[71668]: 2024-09-19 09:14:21.881366991 +0000 UTC m=+0.015893011 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:14:22.239 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:22 smithi167 podman[71668]: 2024-09-19 09:14:22.202392053 +0000 UTC m=+0.336918063 container init 16145323045f5dd7abdeb939dcf56ba228cbdcf5fbb529d11fc4c8cc26280911 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10-deactivate, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-19T09:14:22.240 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:22 smithi167 podman[71668]: 2024-09-19 09:14:22.205638849 +0000 UTC m=+0.340164860 container start 16145323045f5dd7abdeb939dcf56ba228cbdcf5fbb529d11fc4c8cc26280911 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T09:14:22.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:22 smithi167 podman[71668]: 2024-09-19 09:14:22.302335244 +0000 UTC m=+0.436861274 container attach 16145323045f5dd7abdeb939dcf56ba228cbdcf5fbb529d11fc4c8cc26280911 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4) 2024-09-19T09:14:22.602 INFO:journalctl@ceph.osd.10.smithi167.stdout:Sep 19 09:14:22 smithi167 podman[71668]: 2024-09-19 09:14:22.398214991 +0000 UTC m=+0.532741013 container died 16145323045f5dd7abdeb939dcf56ba228cbdcf5fbb529d11fc4c8cc26280911 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-19T09:14:22.874 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:22 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:22.386+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:14:22.874 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:22 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:22.386+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:14:22.875 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:22 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:22.386+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:14:22.875 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:22 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:22.386+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:31.082547+0000 front 2024-09-19T09:13:31.082393+0000 (oldest deadline 2024-09-19T09:13:56.382324+0000) 2024-09-19T09:14:22.875 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:22 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:22.386+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:41.083094+0000 front 2024-09-19T09:13:41.083148+0000 (oldest deadline 2024-09-19T09:14:06.383257+0000) 2024-09-19T09:14:22.875 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:22 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:22.386+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-19T09:13:46.383787+0000 front 2024-09-19T09:13:46.383931+0000 (oldest deadline 2024-09-19T09:14:11.083701+0000) 2024-09-19T09:14:22.875 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:22 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:22.386+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6820 osd.7 since back 2024-09-19T09:13:55.084820+0000 front 2024-09-19T09:13:55.084894+0000 (oldest deadline 2024-09-19T09:14:20.384783+0000) 2024-09-19T09:14:22.968 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@osd.10.service' 2024-09-19T09:14:23.005 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:14:23.006 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-19T09:14:23.006 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-19T09:14:23.006 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-91ff74f2-7663-11ef-bceb-c7b262605968@osd.11 2024-09-19T09:14:23.310 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:23 smithi190 systemd[1]: Stopping Ceph osd.11 for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T09:14:23.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:23 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:23.309+0000 7f3b5176d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:14:23.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:23 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:23.309+0000 7f3b5176d640 -1 osd.11 85 *** Got signal Terminated *** 2024-09-19T09:14:23.624 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:23 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:23.309+0000 7f3b5176d640 -1 osd.11 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:14:23.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:23 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:23.416+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:14:23.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:23 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:23.416+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:14:23.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:23 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:23.416+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:14:23.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:23 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:23.416+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:31.082547+0000 front 2024-09-19T09:13:31.082393+0000 (oldest deadline 2024-09-19T09:13:56.382324+0000) 2024-09-19T09:14:23.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:23 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:23.416+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:41.083094+0000 front 2024-09-19T09:13:41.083148+0000 (oldest deadline 2024-09-19T09:14:06.383257+0000) 2024-09-19T09:14:23.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:23 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:23.416+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-19T09:13:46.383787+0000 front 2024-09-19T09:13:46.383931+0000 (oldest deadline 2024-09-19T09:14:11.083701+0000) 2024-09-19T09:14:23.625 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:23 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:23.416+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6820 osd.7 since back 2024-09-19T09:13:55.084820+0000 front 2024-09-19T09:13:55.084894+0000 (oldest deadline 2024-09-19T09:14:20.384783+0000) 2024-09-19T09:14:24.874 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:24 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:24.401+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:14:24.875 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:24 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:24.401+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:14:24.875 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:24 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:24.401+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:14:24.875 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:24 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:24.401+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:31.082547+0000 front 2024-09-19T09:13:31.082393+0000 (oldest deadline 2024-09-19T09:13:56.382324+0000) 2024-09-19T09:14:24.875 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:24 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:24.401+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:41.083094+0000 front 2024-09-19T09:13:41.083148+0000 (oldest deadline 2024-09-19T09:14:06.383257+0000) 2024-09-19T09:14:24.875 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:24 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:24.401+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-19T09:13:46.383787+0000 front 2024-09-19T09:13:46.383931+0000 (oldest deadline 2024-09-19T09:14:11.083701+0000) 2024-09-19T09:14:24.875 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:24 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:24.401+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6820 osd.7 since back 2024-09-19T09:13:55.084820+0000 front 2024-09-19T09:13:55.084894+0000 (oldest deadline 2024-09-19T09:14:20.384783+0000) 2024-09-19T09:14:25.874 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:25 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:25.419+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:14:25.874 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:25 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:25.419+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:14:25.875 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:25 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:25.419+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:14:25.875 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:25 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:25.419+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:31.082547+0000 front 2024-09-19T09:13:31.082393+0000 (oldest deadline 2024-09-19T09:13:56.382324+0000) 2024-09-19T09:14:25.875 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:25 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:25.419+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:41.083094+0000 front 2024-09-19T09:13:41.083148+0000 (oldest deadline 2024-09-19T09:14:06.383257+0000) 2024-09-19T09:14:25.875 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:25 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:25.419+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-19T09:13:46.383787+0000 front 2024-09-19T09:13:46.383931+0000 (oldest deadline 2024-09-19T09:14:11.083701+0000) 2024-09-19T09:14:25.875 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:25 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:25.419+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6820 osd.7 since back 2024-09-19T09:13:55.084820+0000 front 2024-09-19T09:13:55.084894+0000 (oldest deadline 2024-09-19T09:14:20.384783+0000) 2024-09-19T09:14:26.874 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:26 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:26.462+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:14:26.874 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:26 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:26.462+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:14:26.874 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:26 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:26.462+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:14:26.875 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:26 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:26.462+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:31.082547+0000 front 2024-09-19T09:13:31.082393+0000 (oldest deadline 2024-09-19T09:13:56.382324+0000) 2024-09-19T09:14:26.875 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:26 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:26.462+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:41.083094+0000 front 2024-09-19T09:13:41.083148+0000 (oldest deadline 2024-09-19T09:14:06.383257+0000) 2024-09-19T09:14:26.875 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:26 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:26.462+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-19T09:13:46.383787+0000 front 2024-09-19T09:13:46.383931+0000 (oldest deadline 2024-09-19T09:14:11.083701+0000) 2024-09-19T09:14:26.875 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:26 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:26.462+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6820 osd.7 since back 2024-09-19T09:13:55.084820+0000 front 2024-09-19T09:13:55.084894+0000 (oldest deadline 2024-09-19T09:14:20.384783+0000) 2024-09-19T09:14:27.874 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:27 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:27.455+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-19T09:12:56.577657+0000 front 2024-09-19T09:12:56.577601+0000 (oldest deadline 2024-09-19T09:13:24.178090+0000) 2024-09-19T09:14:27.875 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:27 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:27.455+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-09-19T09:13:06.479206+0000 front 2024-09-19T09:13:06.479018+0000 (oldest deadline 2024-09-19T09:13:30.578953+0000) 2024-09-19T09:14:27.875 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:27 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:27.455+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-09-19T09:13:15.280048+0000 front 2024-09-19T09:13:15.280179+0000 (oldest deadline 2024-09-19T09:13:38.780237+0000) 2024-09-19T09:14:27.875 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:27 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:27.455+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-09-19T09:13:31.082547+0000 front 2024-09-19T09:13:31.082393+0000 (oldest deadline 2024-09-19T09:13:56.382324+0000) 2024-09-19T09:14:27.875 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:27 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:27.455+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-09-19T09:13:41.083094+0000 front 2024-09-19T09:13:41.083148+0000 (oldest deadline 2024-09-19T09:14:06.383257+0000) 2024-09-19T09:14:27.875 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:27 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:27.455+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-19T09:13:46.383787+0000 front 2024-09-19T09:13:46.383931+0000 (oldest deadline 2024-09-19T09:14:11.083701+0000) 2024-09-19T09:14:27.875 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:27 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:27.455+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.167:6820 osd.7 since back 2024-09-19T09:13:55.084820+0000 front 2024-09-19T09:13:55.084894+0000 (oldest deadline 2024-09-19T09:14:20.384783+0000) 2024-09-19T09:14:27.876 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:27 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11[60312]: 2024-09-19T09:14:27.455+0000 7f3b49d6a640 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.190:6820 osd.8 since back 2024-09-19T09:14:02.685512+0000 front 2024-09-19T09:14:02.685530+0000 (oldest deadline 2024-09-19T09:14:26.785488+0000) 2024-09-19T09:14:29.034 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:28 smithi190 podman[71574]: 2024-09-19 09:14:28.707973575 +0000 UTC m=+5.501127105 container died 7623b3ed3ce7ebfed220dd2aafe21c9ba5260b3d895be05188efab036627cbd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-19T09:14:29.034 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:29 smithi190 podman[71574]: 2024-09-19 09:14:29.034086911 +0000 UTC m=+5.827240441 container cleanup 7623b3ed3ce7ebfed220dd2aafe21c9ba5260b3d895be05188efab036627cbd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-19T09:14:29.374 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:29 smithi190 bash[71574]: ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11 2024-09-19T09:14:29.374 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:29 smithi190 podman[71588]: 2024-09-19 09:14:29.210169548 +0000 UTC m=+0.504087623 container remove 7623b3ed3ce7ebfed220dd2aafe21c9ba5260b3d895be05188efab036627cbd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True) 2024-09-19T09:14:29.896 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:29 smithi190 podman[71678]: 2024-09-19 09:14:29.539754492 +0000 UTC m=+0.015751965 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:14:29.897 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:29 smithi190 podman[71678]: 2024-09-19 09:14:29.670412439 +0000 UTC m=+0.146409900 container create 8963f8288fad53d4638289e83054c9e6a71eb71b83809e5a9dbc5f758f09b0e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-19T09:14:30.366 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:29 smithi190 podman[71678]: 2024-09-19 09:14:29.896488202 +0000 UTC m=+0.372485661 container init 8963f8288fad53d4638289e83054c9e6a71eb71b83809e5a9dbc5f758f09b0e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-19T09:14:30.366 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:29 smithi190 podman[71678]: 2024-09-19 09:14:29.899862094 +0000 UTC m=+0.375859565 container start 8963f8288fad53d4638289e83054c9e6a71eb71b83809e5a9dbc5f758f09b0e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0) 2024-09-19T09:14:30.366 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:29 smithi190 podman[71678]: 2024-09-19 09:14:29.971223673 +0000 UTC m=+0.447221134 container attach 8963f8288fad53d4638289e83054c9e6a71eb71b83809e5a9dbc5f758f09b0e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-19T09:14:30.366 INFO:journalctl@ceph.osd.11.smithi190.stdout:Sep 19 09:14:30 smithi190 podman[71678]: 2024-09-19 09:14:30.08596571 +0000 UTC m=+0.561963179 container died 8963f8288fad53d4638289e83054c9e6a71eb71b83809e5a9dbc5f758f09b0e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4) 2024-09-19T09:14:30.647 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@osd.11.service' 2024-09-19T09:14:30.685 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:14:30.685 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-19T09:14:30.685 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-19T09:14:30.685 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mds.a 2024-09-19T09:14:30.976 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 19 09:14:30 smithi092 systemd[1]: Stopping Ceph mds.a for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T09:14:31.254 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 19 09:14:30 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-a[69996]: 2024-09-19T09:14:30.974+0000 7f4e28e40640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:14:31.254 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 19 09:14:30 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-a[69996]: 2024-09-19T09:14:30.974+0000 7f4e28e40640 -1 mds.a *** got signal Terminated *** 2024-09-19T09:14:35.250 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 19 09:14:34 smithi092 podman[118436]: 2024-09-19 09:14:34.990099327 +0000 UTC m=+4.105965401 container died 52d54c5a9c5c3bcb02a30e762d5150ac760f252383746839547fb3f92bbc7d9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-a, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:14:35.504 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 19 09:14:35 smithi092 podman[118436]: 2024-09-19 09:14:35.433807639 +0000 UTC m=+4.549673747 container cleanup 52d54c5a9c5c3bcb02a30e762d5150ac760f252383746839547fb3f92bbc7d9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-a, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-19T09:14:35.504 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 19 09:14:35 smithi092 bash[118436]: ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-a 2024-09-19T09:14:35.822 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mds.a.service' 2024-09-19T09:14:35.859 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:14:35.859 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-19T09:14:35.859 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-19T09:14:35.860 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mds.d 2024-09-19T09:14:36.254 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 19 09:14:35 smithi092 systemd[1]: Stopping Ceph mds.d for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T09:14:36.254 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 19 09:14:36 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-d[68914]: 2024-09-19T09:14:36.162+0000 7f8fc1e75640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:14:36.254 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 19 09:14:36 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-d[68914]: 2024-09-19T09:14:36.162+0000 7f8fc1e75640 -1 mds.d *** got signal Terminated *** 2024-09-19T09:14:37.797 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 19 09:14:37 smithi092 podman[118556]: 2024-09-19 09:14:37.543335883 +0000 UTC m=+1.464303317 container died 6d8ec87e57c16d942e0641fa8de0e81914861ef700be68be3cb0fc86cf6074d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-d, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-19T09:14:38.156 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 19 09:14:37 smithi092 podman[118556]: 2024-09-19 09:14:37.980197576 +0000 UTC m=+1.901165003 container cleanup 6d8ec87e57c16d942e0641fa8de0e81914861ef700be68be3cb0fc86cf6074d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-d, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4) 2024-09-19T09:14:38.157 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 19 09:14:37 smithi092 bash[118556]: ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-d 2024-09-19T09:14:38.402 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mds.d.service' 2024-09-19T09:14:38.423 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 19 09:14:38 smithi092 podman[118569]: 2024-09-19 09:14:38.156566524 +0000 UTC m=+0.611521697 container remove 6d8ec87e57c16d942e0641fa8de0e81914861ef700be68be3cb0fc86cf6074d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-d, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-19T09:14:38.423 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 19 09:14:38 smithi092 systemd[1]: ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mds.d.service: Deactivated successfully. 2024-09-19T09:14:38.424 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 19 09:14:38 smithi092 systemd[1]: Stopped Ceph mds.d for 91ff74f2-7663-11ef-bceb-c7b262605968. 2024-09-19T09:14:38.424 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 19 09:14:38 smithi092 systemd[1]: ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mds.d.service: Consumed 1.056s CPU time. 2024-09-19T09:14:38.438 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:14:38.438 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-19T09:14:38.438 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-19T09:14:38.438 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mds.g 2024-09-19T09:14:38.751 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 19 09:14:38 smithi092 systemd[1]: Stopping Ceph mds.g for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T09:14:39.004 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 19 09:14:38 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-g[69672]: 2024-09-19T09:14:38.750+0000 7f7bd8fc0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:14:39.004 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 19 09:14:38 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-g[69672]: 2024-09-19T09:14:38.750+0000 7f7bd8fc0640 -1 mds.g *** got signal Terminated *** 2024-09-19T09:14:40.618 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 19 09:14:40 smithi092 podman[118677]: 2024-09-19 09:14:40.275101909 +0000 UTC m=+1.617555863 container died bec86d02e6273cb2e10125ce9bf4255d6bcc6d8d1edb3e7f6f327da5d6644c09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-g, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:14:41.004 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 19 09:14:40 smithi092 podman[118677]: 2024-09-19 09:14:40.784250203 +0000 UTC m=+2.126704159 container cleanup bec86d02e6273cb2e10125ce9bf4255d6bcc6d8d1edb3e7f6f327da5d6644c09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:14:41.004 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 19 09:14:40 smithi092 bash[118677]: ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-g 2024-09-19T09:14:41.160 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mds.g.service' 2024-09-19T09:14:41.193 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:14:41.193 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-19T09:14:41.193 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-19T09:14:41.193 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mds.j 2024-09-19T09:14:41.488 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 19 09:14:41 smithi092 systemd[1]: Stopping Ceph mds.j for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T09:14:41.754 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 19 09:14:41 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-j[68491]: 2024-09-19T09:14:41.487+0000 7f759d920640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:14:41.754 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 19 09:14:41 smithi092 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-j[68491]: 2024-09-19T09:14:41.487+0000 7f759d920640 -1 mds.j *** got signal Terminated *** 2024-09-19T09:14:42.705 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 19 09:14:42 smithi092 podman[118799]: 2024-09-19 09:14:42.4491878 +0000 UTC m=+1.043199289 container died 56c6763329b17a53a944344f427f26b840f425222af23ff44d3e44e24b0d8af6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-j, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-19T09:14:43.004 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 19 09:14:42 smithi092 podman[118799]: 2024-09-19 09:14:42.854911173 +0000 UTC m=+1.448922657 container cleanup 56c6763329b17a53a944344f427f26b840f425222af23ff44d3e44e24b0d8af6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-j, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-19T09:14:43.004 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 19 09:14:42 smithi092 bash[118799]: ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-j 2024-09-19T09:14:43.224 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mds.j.service' 2024-09-19T09:14:43.256 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:14:43.256 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-19T09:14:43.257 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-19T09:14:43.257 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mds.b 2024-09-19T09:14:43.552 INFO:journalctl@ceph.mds.b.smithi167.stdout:Sep 19 09:14:43 smithi167 systemd[1]: Stopping Ceph mds.b for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T09:14:43.806 INFO:journalctl@ceph.mds.b.smithi167.stdout:Sep 19 09:14:43 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-b[66333]: 2024-09-19T09:14:43.548+0000 7fd614a50640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:14:43.806 INFO:journalctl@ceph.mds.b.smithi167.stdout:Sep 19 09:14:43 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-b[66333]: 2024-09-19T09:14:43.548+0000 7fd614a50640 -1 mds.b *** got signal Terminated *** 2024-09-19T09:14:46.182 INFO:journalctl@ceph.mds.b.smithi167.stdout:Sep 19 09:14:45 smithi167 podman[71770]: 2024-09-19 09:14:45.884750726 +0000 UTC m=+2.433322295 container died e921df93c25628e2592cfa194226ad1cd8b8c1f576a8cff0bc79c4ca5c1bae25 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-19T09:14:46.499 INFO:journalctl@ceph.mds.b.smithi167.stdout:Sep 19 09:14:46 smithi167 podman[71770]: 2024-09-19 09:14:46.272929109 +0000 UTC m=+2.821500636 container cleanup e921df93c25628e2592cfa194226ad1cd8b8c1f576a8cff0bc79c4ca5c1bae25 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-19T09:14:46.499 INFO:journalctl@ceph.mds.b.smithi167.stdout:Sep 19 09:14:46 smithi167 bash[71770]: ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-b 2024-09-19T09:14:46.646 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mds.b.service' 2024-09-19T09:14:46.682 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:14:46.682 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-19T09:14:46.683 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-19T09:14:46.683 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mds.e 2024-09-19T09:14:47.102 INFO:journalctl@ceph.mds.e.smithi167.stdout:Sep 19 09:14:46 smithi167 systemd[1]: Stopping Ceph mds.e for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T09:14:47.102 INFO:journalctl@ceph.mds.e.smithi167.stdout:Sep 19 09:14:47 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-e[65731]: 2024-09-19T09:14:47.002+0000 7f39fd09e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:14:47.102 INFO:journalctl@ceph.mds.e.smithi167.stdout:Sep 19 09:14:47 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-e[65731]: 2024-09-19T09:14:47.002+0000 7f39fd09e640 -1 mds.e *** got signal Terminated *** 2024-09-19T09:14:48.287 INFO:journalctl@ceph.mds.e.smithi167.stdout:Sep 19 09:14:48 smithi167 podman[71905]: 2024-09-19 09:14:48.014971513 +0000 UTC m=+1.115641350 container died 0d0d2f3efbf2c17b22966ad4badd671adda7e29370b251f46065d4980c83bd0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T09:14:48.602 INFO:journalctl@ceph.mds.e.smithi167.stdout:Sep 19 09:14:48 smithi167 podman[71905]: 2024-09-19 09:14:48.368859126 +0000 UTC m=+1.469528962 container cleanup 0d0d2f3efbf2c17b22966ad4badd671adda7e29370b251f46065d4980c83bd0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-e, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2) 2024-09-19T09:14:48.602 INFO:journalctl@ceph.mds.e.smithi167.stdout:Sep 19 09:14:48 smithi167 bash[71905]: ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-e 2024-09-19T09:14:48.796 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mds.e.service' 2024-09-19T09:14:48.829 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:14:48.829 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-19T09:14:48.829 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-19T09:14:48.829 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mds.h 2024-09-19T09:14:49.352 INFO:journalctl@ceph.mds.h.smithi167.stdout:Sep 19 09:14:48 smithi167 systemd[1]: Stopping Ceph mds.h for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T09:14:49.352 INFO:journalctl@ceph.mds.h.smithi167.stdout:Sep 19 09:14:49 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-h[66034]: 2024-09-19T09:14:49.155+0000 7f88c2769640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:14:49.352 INFO:journalctl@ceph.mds.h.smithi167.stdout:Sep 19 09:14:49 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-h[66034]: 2024-09-19T09:14:49.155+0000 7f88c2769640 -1 mds.h *** got signal Terminated *** 2024-09-19T09:14:51.599 INFO:journalctl@ceph.mds.h.smithi167.stdout:Sep 19 09:14:51 smithi167 podman[72025]: 2024-09-19 09:14:51.234782684 +0000 UTC m=+2.180084746 container died 3041fd7082a4a5ddf428004253f1bb6842dbbd86aedc831dfa853c67772dd137 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-h, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-19T09:14:51.852 INFO:journalctl@ceph.mds.h.smithi167.stdout:Sep 19 09:14:51 smithi167 podman[72025]: 2024-09-19 09:14:51.67239566 +0000 UTC m=+2.617697721 container cleanup 3041fd7082a4a5ddf428004253f1bb6842dbbd86aedc831dfa853c67772dd137 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-h, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, RELEASE=squid-2f599a4) 2024-09-19T09:14:51.852 INFO:journalctl@ceph.mds.h.smithi167.stdout:Sep 19 09:14:51 smithi167 bash[72025]: ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-h 2024-09-19T09:14:51.852 INFO:journalctl@ceph.mds.h.smithi167.stdout:Sep 19 09:14:51 smithi167 podman[72037]: 2024-09-19 09:14:51.848618227 +0000 UTC m=+0.610066586 container remove 3041fd7082a4a5ddf428004253f1bb6842dbbd86aedc831dfa853c67772dd137 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-h, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-19T09:14:52.095 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mds.h.service' 2024-09-19T09:14:52.129 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:14:52.129 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-19T09:14:52.129 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-19T09:14:52.129 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mds.k 2024-09-19T09:14:52.352 INFO:journalctl@ceph.mds.k.smithi167.stdout:Sep 19 09:14:52 smithi167 systemd[1]: Stopping Ceph mds.k for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T09:14:52.852 INFO:journalctl@ceph.mds.k.smithi167.stdout:Sep 19 09:14:52 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-k[65414]: 2024-09-19T09:14:52.451+0000 7fb429f3d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:14:52.852 INFO:journalctl@ceph.mds.k.smithi167.stdout:Sep 19 09:14:52 smithi167 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-k[65414]: 2024-09-19T09:14:52.451+0000 7fb429f3d640 -1 mds.k *** got signal Terminated *** 2024-09-19T09:14:55.510 INFO:journalctl@ceph.mds.k.smithi167.stdout:Sep 19 09:14:55 smithi167 podman[72147]: 2024-09-19 09:14:55.227541545 +0000 UTC m=+2.883147132 container died 4aeda137d778dda4ab1c915393cada579d36812e57e7e5fb5ac408ec7d03d8d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-k, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-19T09:14:55.852 INFO:journalctl@ceph.mds.k.smithi167.stdout:Sep 19 09:14:55 smithi167 podman[72147]: 2024-09-19 09:14:55.601531622 +0000 UTC m=+3.257137209 container cleanup 4aeda137d778dda4ab1c915393cada579d36812e57e7e5fb5ac408ec7d03d8d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-k, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4) 2024-09-19T09:14:55.852 INFO:journalctl@ceph.mds.k.smithi167.stdout:Sep 19 09:14:55 smithi167 bash[72147]: ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-k 2024-09-19T09:14:55.973 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mds.k.service' 2024-09-19T09:14:56.005 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:14:56.005 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-19T09:14:56.005 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-19T09:14:56.006 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mds.c 2024-09-19T09:14:56.352 INFO:journalctl@ceph.mds.c.smithi190.stdout:Sep 19 09:14:56 smithi190 systemd[1]: Stopping Ceph mds.c for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T09:14:56.624 INFO:journalctl@ceph.mds.c.smithi190.stdout:Sep 19 09:14:56 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-c[65460]: 2024-09-19T09:14:56.382+0000 7fa173ddb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:14:56.624 INFO:journalctl@ceph.mds.c.smithi190.stdout:Sep 19 09:14:56 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-c[65460]: 2024-09-19T09:14:56.382+0000 7fa173ddb640 -1 mds.c *** got signal Terminated *** 2024-09-19T09:14:58.374 INFO:journalctl@ceph.mds.c.smithi190.stdout:Sep 19 09:14:58 smithi190 podman[71779]: 2024-09-19 09:14:58.119709655 +0000 UTC m=+1.920698264 container died c2e655d2338b6bdfff4e04453156a38b57c38095615d79e24b78297ff0c2f577 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True) 2024-09-19T09:14:58.675 INFO:journalctl@ceph.mds.c.smithi190.stdout:Sep 19 09:14:58 smithi190 podman[71779]: 2024-09-19 09:14:58.440598422 +0000 UTC m=+2.241587031 container cleanup c2e655d2338b6bdfff4e04453156a38b57c38095615d79e24b78297ff0c2f577 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:14:58.675 INFO:journalctl@ceph.mds.c.smithi190.stdout:Sep 19 09:14:58 smithi190 bash[71779]: ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-c 2024-09-19T09:14:58.815 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mds.c.service' 2024-09-19T09:14:58.851 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:14:58.851 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-19T09:14:58.852 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-19T09:14:58.852 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mds.f 2024-09-19T09:14:59.187 INFO:journalctl@ceph.mds.f.smithi190.stdout:Sep 19 09:14:58 smithi190 systemd[1]: Stopping Ceph mds.f for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T09:14:59.624 INFO:journalctl@ceph.mds.f.smithi190.stdout:Sep 19 09:14:59 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-f[65157]: 2024-09-19T09:14:59.186+0000 7f6c9bf69640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:14:59.624 INFO:journalctl@ceph.mds.f.smithi190.stdout:Sep 19 09:14:59 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-f[65157]: 2024-09-19T09:14:59.186+0000 7f6c9bf69640 -1 mds.f *** got signal Terminated *** 2024-09-19T09:15:02.603 INFO:journalctl@ceph.mds.f.smithi190.stdout:Sep 19 09:15:02 smithi190 podman[71911]: 2024-09-19 09:15:02.340317928 +0000 UTC m=+3.266839779 container died a942c88427f6def70ba1ba219a3e3c2173048969cc07e972a11e8785dd8792f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-f, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-19T09:15:02.874 INFO:journalctl@ceph.mds.f.smithi190.stdout:Sep 19 09:15:02 smithi190 podman[71911]: 2024-09-19 09:15:02.694635362 +0000 UTC m=+3.621157202 container cleanup a942c88427f6def70ba1ba219a3e3c2173048969cc07e972a11e8785dd8792f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-f, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-19T09:15:02.874 INFO:journalctl@ceph.mds.f.smithi190.stdout:Sep 19 09:15:02 smithi190 bash[71911]: ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-f 2024-09-19T09:15:03.126 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mds.f.service' 2024-09-19T09:15:03.160 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:15:03.161 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-19T09:15:03.161 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-19T09:15:03.161 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mds.i 2024-09-19T09:15:03.624 INFO:journalctl@ceph.mds.i.smithi190.stdout:Sep 19 09:15:03 smithi190 systemd[1]: Stopping Ceph mds.i for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T09:15:03.624 INFO:journalctl@ceph.mds.i.smithi190.stdout:Sep 19 09:15:03 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-i[65763]: 2024-09-19T09:15:03.464+0000 7f8b5e695640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:15:03.625 INFO:journalctl@ceph.mds.i.smithi190.stdout:Sep 19 09:15:03 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-i[65763]: 2024-09-19T09:15:03.464+0000 7f8b5e695640 -1 mds.i *** got signal Terminated *** 2024-09-19T09:15:06.374 INFO:journalctl@ceph.mds.i.smithi190.stdout:Sep 19 09:15:06 smithi190 podman[72030]: 2024-09-19 09:15:06.123278512 +0000 UTC m=+2.747582061 container died 258812e0cf31f28730958540a291cf11132f07d644f314d161d4d7d937c22293 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-19T09:15:06.866 INFO:journalctl@ceph.mds.i.smithi190.stdout:Sep 19 09:15:06 smithi190 podman[72030]: 2024-09-19 09:15:06.581390667 +0000 UTC m=+3.205694216 container cleanup 258812e0cf31f28730958540a291cf11132f07d644f314d161d4d7d937c22293 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True) 2024-09-19T09:15:06.866 INFO:journalctl@ceph.mds.i.smithi190.stdout:Sep 19 09:15:06 smithi190 bash[72030]: ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-i 2024-09-19T09:15:07.014 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mds.i.service' 2024-09-19T09:15:07.048 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:15:07.048 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-19T09:15:07.048 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-19T09:15:07.048 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mds.l 2024-09-19T09:15:07.624 INFO:journalctl@ceph.mds.l.smithi190.stdout:Sep 19 09:15:07 smithi190 systemd[1]: Stopping Ceph mds.l for 91ff74f2-7663-11ef-bceb-c7b262605968... 2024-09-19T09:15:07.624 INFO:journalctl@ceph.mds.l.smithi190.stdout:Sep 19 09:15:07 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-l[64850]: 2024-09-19T09:15:07.367+0000 7f2d56083640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:15:07.625 INFO:journalctl@ceph.mds.l.smithi190.stdout:Sep 19 09:15:07 smithi190 ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-l[64850]: 2024-09-19T09:15:07.368+0000 7f2d56083640 -1 mds.l *** got signal Terminated *** 2024-09-19T09:15:09.124 INFO:journalctl@ceph.mds.l.smithi190.stdout:Sep 19 09:15:08 smithi190 podman[72151]: 2024-09-19 09:15:08.778527159 +0000 UTC m=+1.514269885 container died 61dd0a59312380cb96bae6522ae96754ed8b6c77cc9f79b40bf2fa0f3b36dbc2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-l, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:15:09.402 INFO:journalctl@ceph.mds.l.smithi190.stdout:Sep 19 09:15:09 smithi190 podman[72151]: 2024-09-19 09:15:09.210136289 +0000 UTC m=+1.945879007 container cleanup 61dd0a59312380cb96bae6522ae96754ed8b6c77cc9f79b40bf2fa0f3b36dbc2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-l, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-19T09:15:09.403 INFO:journalctl@ceph.mds.l.smithi190.stdout:Sep 19 09:15:09 smithi190 bash[72151]: ceph-91ff74f2-7663-11ef-bceb-c7b262605968-mds-l 2024-09-19T09:15:09.627 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-91ff74f2-7663-11ef-bceb-c7b262605968@mds.l.service' 2024-09-19T09:15:09.660 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:15:09.660 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-19T09:15:09.660 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T09:15:09.868 INFO:teuthology.orchestra.run.smithi092.stdout:Deleting cluster with fsid: 91ff74f2-7663-11ef-bceb-c7b262605968 2024-09-19T09:15:12.296 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T09:15:12.499 INFO:teuthology.orchestra.run.smithi167.stdout:Deleting cluster with fsid: 91ff74f2-7663-11ef-bceb-c7b262605968 2024-09-19T09:15:15.068 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T09:15:15.269 INFO:teuthology.orchestra.run.smithi190.stdout:Deleting cluster with fsid: 91ff74f2-7663-11ef-bceb-c7b262605968 2024-09-19T09:15:17.641 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:15:17.674 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:15:17.708 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:15:17.735 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-19T09:15:17.737 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911871/remote/smithi092/crash 2024-09-19T09:15:17.738 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/crash -- . 2024-09-19T09:15:17.775 INFO:teuthology.orchestra.run.smithi092.stderr:tar: /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T09:15:17.775 INFO:teuthology.orchestra.run.smithi092.stderr:tar: Error is not recoverable: exiting now 2024-09-19T09:15:17.777 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911871/remote/smithi167/crash 2024-09-19T09:15:17.778 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/crash -- . 2024-09-19T09:15:17.821 INFO:teuthology.orchestra.run.smithi167.stderr:tar: /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T09:15:17.821 INFO:teuthology.orchestra.run.smithi167.stderr:tar: Error is not recoverable: exiting now 2024-09-19T09:15:17.823 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911871/remote/smithi190/crash 2024-09-19T09:15:17.824 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/crash -- . 2024-09-19T09:15:17.857 INFO:teuthology.orchestra.run.smithi190.stderr:tar: /var/lib/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T09:15:17.857 INFO:teuthology.orchestra.run.smithi190.stderr:tar: Error is not recoverable: exiting now 2024-09-19T09:15:17.858 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-19T09:15:17.858 DEBUG:teuthology.orchestra.run.smithi092:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-19T09:15:17.898 INFO:tasks.cephadm:Compressing logs... 2024-09-19T09:15:17.898 DEBUG:teuthology.orchestra.run.smithi092:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T09:15:17.942 DEBUG:teuthology.orchestra.run.smithi167:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T09:15:17.945 DEBUG:teuthology.orchestra.run.smithi190:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T09:15:17.966 INFO:teuthology.orchestra.run.smithi092.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-19T09:15:17.966 INFO:teuthology.orchestra.run.smithi092.stderr:: No such file or directory 2024-09-19T09:15:17.966 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-osd.9.log 2024-09-19T09:15:17.966 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose --/var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-osd.0.log: /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T09:15:17.970 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T09:15:17.970 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mds.a.log 2024-09-19T09:15:17.970 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T09:15:17.970 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph.audit.log: /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-19T09:15:17.970 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mds.g.log 2024-09-19T09:15:17.970 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mon.a.log: 82.5% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T09:15:17.970 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-19T09:15:17.970 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph.log 2024-09-19T09:15:17.972 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-osd.6.log: /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mds.g.log: 90.3% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T09:15:17.984 INFO:teuthology.orchestra.run.smithi190.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T09:15:17.985 INFO:teuthology.orchestra.run.smithi190.stderr:: No such file or directory 2024-09-19T09:15:17.985 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T09:15:17.985 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mds.i.log 2024-09-19T09:15:17.985 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-19T09:15:17.985 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T09:15:17.985 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-osd.11.log 2024-09-19T09:15:17.985 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-19T09:15:17.985 INFO:teuthology.orchestra.run.smithi190.stderr: 82.4% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T09:15:17.985 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-19T09:15:17.985 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph.log 2024-09-19T09:15:17.985 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mds.l.log 2024-09-19T09:15:17.985 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph.log: 90.5% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T09:15:17.986 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-osd.8.log 2024-09-19T09:15:17.986 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mds.l.log: 87.0% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T09:15:17.986 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mgr.z.log 2024-09-19T09:15:17.986 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-osd.8.log: 94.5% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mds.l.log.gz 2024-09-19T09:15:17.986 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mds.c.log 2024-09-19T09:15:17.986 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mgr.z.log: 90.9% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T09:15:17.986 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mds.f.log 2024-09-19T09:15:17.990 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mds.c.log: 93.2% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mgr.z.log.gz 2024-09-19T09:15:17.990 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T09:15:17.990 INFO:teuthology.orchestra.run.smithi092.stderr: 94.6% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mds.a.log.gz 2024-09-19T09:15:17.990 INFO:teuthology.orchestra.run.smithi092.stderr: 94.6% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mds.g.log.gz 2024-09-19T09:15:17.991 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mds.d.log 2024-09-19T09:15:17.991 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-19T09:15:17.991 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mds.j.log 2024-09-19T09:15:17.991 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mgr.x.log: 87.0% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T09:15:17.991 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-19T09:15:17.991 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mds.j.log: 90.9% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T09:15:17.991 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T09:15:17.991 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-osd.3.log: 94.6% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mds.d.log.gz 2024-09-19T09:15:17.991 INFO:teuthology.orchestra.run.smithi092.stderr: 94.6% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mds.j.log.gz 2024-09-19T09:15:17.993 INFO:teuthology.orchestra.run.smithi167.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-osd.10.log 2024-09-19T09:15:17.993 INFO:teuthology.orchestra.run.smithi167.stderr:: No such file or directory 2024-09-19T09:15:17.993 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-19T09:15:17.993 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-19T09:15:17.993 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T09:15:17.993 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mds.b.log 2024-09-19T09:15:17.993 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mds.k.log 2024-09-19T09:15:17.993 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-19T09:15:17.993 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T09:15:17.993 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T09:15:17.994 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph.audit.log: 90.5% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T09:15:17.994 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-19T09:15:17.994 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph.cephadm.log: 94.5% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mds.b.log.gz 82.5% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T09:15:17.994 INFO:teuthology.orchestra.run.smithi167.stderr: 2024-09-19T09:15:17.994 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph.log 2024-09-19T09:15:17.994 INFO:teuthology.orchestra.run.smithi167.stderr: 94.5% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mds.k.log.gz 2024-09-19T09:15:17.994 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mds.h.log 2024-09-19T09:15:17.994 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-19T09:15:17.994 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mds.h.log: /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph.log: 87.0% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T09:15:17.994 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mds.e.log 2024-09-19T09:15:17.994 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mon.b.log: 94.5% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mds.h.log.gz 2024-09-19T09:15:17.994 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T09:15:17.995 INFO:teuthology.orchestra.run.smithi167.stderr: 91.0%/var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mds.e.log: -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T09:15:17.995 INFO:teuthology.orchestra.run.smithi167.stderr: 93.1% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-19T09:15:17.995 INFO:teuthology.orchestra.run.smithi167.stderr: 94.5% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mds.e.log.gz 2024-09-19T09:15:17.995 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/cephadm.log: 91.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T09:15:17.996 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mds.f.log: 94.6% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mds.f.log.gz 2024-09-19T09:15:17.996 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/cephadm.log: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T09:15:17.998 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/cephadm.log: 94.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T09:15:18.293 INFO:teuthology.orchestra.run.smithi092.stderr: 90.6% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-19T09:15:18.480 INFO:teuthology.orchestra.run.smithi190.stderr: 91.6% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-19T09:15:18.496 INFO:teuthology.orchestra.run.smithi167.stderr: 91.6% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-19T09:15:18.724 INFO:teuthology.orchestra.run.smithi190.stderr: 94.5% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mds.c.log.gz 2024-09-19T09:15:18.950 INFO:teuthology.orchestra.run.smithi092.stderr: 90.2% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-19T09:15:26.939 INFO:teuthology.orchestra.run.smithi092.stderr: 94.3% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-osd.9.log.gz 2024-09-19T09:15:27.309 INFO:teuthology.orchestra.run.smithi167.stderr: 94.5% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-19T09:15:31.675 INFO:teuthology.orchestra.run.smithi167.stderr: 94.0% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-osd.10.log.gz 2024-09-19T09:15:32.032 INFO:teuthology.orchestra.run.smithi190.stderr: 94.1% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-19T09:15:32.628 INFO:teuthology.orchestra.run.smithi190.stderr: 94.5% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-19T09:15:32.918 INFO:teuthology.orchestra.run.smithi092.stderr: 94.3% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-19T09:15:33.372 INFO:teuthology.orchestra.run.smithi190.stderr: 94.9% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-mds.i.log.gz 2024-09-19T09:15:34.196 INFO:teuthology.orchestra.run.smithi190.stderr: 94.5% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-osd.8.log.gz 2024-09-19T09:15:34.679 INFO:teuthology.orchestra.run.smithi167.stderr: 94.3% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-19T09:15:36.306 INFO:teuthology.orchestra.run.smithi092.stderr: 94.2% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-19T09:15:37.052 INFO:teuthology.orchestra.run.smithi190.stderr: 94.7% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-osd.11.log.gz 2024-09-19T09:15:37.054 INFO:teuthology.orchestra.run.smithi190.stderr: 2024-09-19T09:15:37.054 INFO:teuthology.orchestra.run.smithi190.stderr:real 0m19.095s 2024-09-19T09:15:37.054 INFO:teuthology.orchestra.run.smithi190.stderr:user 1m17.843s 2024-09-19T09:15:37.054 INFO:teuthology.orchestra.run.smithi190.stderr:sys 0m2.735s 2024-09-19T09:15:38.645 INFO:teuthology.orchestra.run.smithi092.stderr: 94.3% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-19T09:15:38.647 INFO:teuthology.orchestra.run.smithi092.stderr: 2024-09-19T09:15:38.647 INFO:teuthology.orchestra.run.smithi092.stderr:real 0m20.691s 2024-09-19T09:15:38.647 INFO:teuthology.orchestra.run.smithi092.stderr:user 1m1.754s 2024-09-19T09:15:38.647 INFO:teuthology.orchestra.run.smithi092.stderr:sys 0m2.423s 2024-09-19T09:15:38.651 INFO:teuthology.orchestra.run.smithi167.stderr: 94.2% -- replaced with /var/log/ceph/91ff74f2-7663-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-19T09:15:38.653 INFO:teuthology.orchestra.run.smithi167.stderr: 2024-09-19T09:15:38.653 INFO:teuthology.orchestra.run.smithi167.stderr:real 0m20.695s 2024-09-19T09:15:38.653 INFO:teuthology.orchestra.run.smithi167.stderr:user 0m58.704s 2024-09-19T09:15:38.654 INFO:teuthology.orchestra.run.smithi167.stderr:sys 0m2.209s 2024-09-19T09:15:38.654 INFO:tasks.cephadm:Archiving logs... 2024-09-19T09:15:38.654 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911871/remote/smithi092/log 2024-09-19T09:15:38.655 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T09:15:48.230 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911871/remote/smithi167/log 2024-09-19T09:15:48.231 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T09:15:56.941 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911871/remote/smithi190/log 2024-09-19T09:15:56.942 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T09:16:06.615 INFO:tasks.cephadm:Removing cluster... 2024-09-19T09:16:06.616 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 --force 2024-09-19T09:16:06.817 INFO:teuthology.orchestra.run.smithi092.stdout:Deleting cluster with fsid: 91ff74f2-7663-11ef-bceb-c7b262605968 2024-09-19T09:16:07.196 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 --force 2024-09-19T09:16:07.397 INFO:teuthology.orchestra.run.smithi167.stdout:Deleting cluster with fsid: 91ff74f2-7663-11ef-bceb-c7b262605968 2024-09-19T09:16:07.743 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 91ff74f2-7663-11ef-bceb-c7b262605968 --force 2024-09-19T09:16:07.945 INFO:teuthology.orchestra.run.smithi190.stdout:Deleting cluster with fsid: 91ff74f2-7663-11ef-bceb-c7b262605968 2024-09-19T09:16:08.291 INFO:tasks.cephadm:Removing cephadm ... 2024-09-19T09:16:08.291 DEBUG:teuthology.orchestra.run.smithi092:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T09:16:08.310 DEBUG:teuthology.orchestra.run.smithi167:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T09:16:08.328 DEBUG:teuthology.orchestra.run.smithi190:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T09:16:08.344 INFO:tasks.cephadm:Teardown complete 2024-09-19T09:16:08.344 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T09:16:08.357 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T09:16:08.357 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T09:16:08.360 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T09:16:08.371 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T09:16:08.478 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T09:16:08.490 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T09:16:08.491 DEBUG:teuthology.orchestra.run.smithi092:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:16:08.493 DEBUG:teuthology.orchestra.run.smithi167:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:16:08.496 DEBUG:teuthology.orchestra.run.smithi190:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:16:08.507 INFO:teuthology.orchestra.run.smithi092.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:16:08.508 INFO:teuthology.orchestra.run.smithi167.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:16:08.510 INFO:teuthology.orchestra.run.smithi190.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:16:08.511 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:16:08.511 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2024-09-19T09:16:08.511 INFO:teuthology.orchestra.run.smithi092.stdout:^* hv01.front.sepia.ceph.com 3 6 377 34 +1379us[+1414us] +/- 54ms 2024-09-19T09:16:08.511 INFO:teuthology.orchestra.run.smithi092.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 37 -2761us[-2726us] +/- 54ms 2024-09-19T09:16:08.511 INFO:teuthology.orchestra.run.smithi092.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 36 +1692us[+1726us] +/- 77ms 2024-09-19T09:16:08.512 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:16:08.513 INFO:teuthology.orchestra.run.smithi167.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:16:08.514 INFO:teuthology.orchestra.run.smithi167.stdout:=============================================================================== 2024-09-19T09:16:08.514 INFO:teuthology.orchestra.run.smithi167.stdout:^* hv01.front.sepia.ceph.com 3 6 377 38 +1447us[+1451us] +/- 54ms 2024-09-19T09:16:08.514 INFO:teuthology.orchestra.run.smithi167.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 38 -2687us[-2687us] +/- 54ms 2024-09-19T09:16:08.514 INFO:teuthology.orchestra.run.smithi167.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 34 +1767us[+1767us] +/- 77ms 2024-09-19T09:16:08.514 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:16:08.515 INFO:teuthology.orchestra.run.smithi190.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:16:08.515 INFO:teuthology.orchestra.run.smithi190.stdout:=============================================================================== 2024-09-19T09:16:08.515 INFO:teuthology.orchestra.run.smithi190.stdout:^* hv01.front.sepia.ceph.com 3 6 377 36 +1486us[+1490us] +/- 54ms 2024-09-19T09:16:08.515 INFO:teuthology.orchestra.run.smithi190.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 38 -2676us[-2672us] +/- 54ms 2024-09-19T09:16:08.515 INFO:teuthology.orchestra.run.smithi190.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 38 +1802us[+1806us] +/- 77ms 2024-09-19T09:16:08.515 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:16:08.516 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T09:16:08.527 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T09:16:08.528 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T09:16:08.553 DEBUG:teuthology.orchestra.run.smithi092:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T09:16:08.640 DEBUG:teuthology.orchestra.run.smithi167:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T09:16:08.709 DEBUG:teuthology.orchestra.run.smithi190:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T09:16:08.776 DEBUG:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:16:08.805 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:16:08.806 DEBUG:teuthology.orchestra.run.smithi167:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:16:08.834 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:16:08.835 DEBUG:teuthology.orchestra.run.smithi190:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:16:08.862 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:16:08.863 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T09:16:08.874 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T09:16:08.934 INFO:teuthology.task.internal:Duration was 2163.304758 seconds 2024-09-19T09:16:08.935 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T09:16:08.965 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T09:16:08.965 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T09:16:08.968 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T09:16:08.970 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T09:16:09.005 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:16:09.007 INFO:teuthology.orchestra.run.smithi167.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:16:09.009 INFO:teuthology.orchestra.run.smithi190.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:16:09.418 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T09:16:09.418 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi092.front.sepia.ceph.com 2024-09-19T09:16:09.418 DEBUG:teuthology.orchestra.run.smithi092:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T09:16:09.439 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi167.front.sepia.ceph.com 2024-09-19T09:16:09.440 DEBUG:teuthology.orchestra.run.smithi167:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T09:16:09.477 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi190.front.sepia.ceph.com 2024-09-19T09:16:09.477 DEBUG:teuthology.orchestra.run.smithi190:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T09:16:09.507 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T09:16:09.507 DEBUG:teuthology.orchestra.run.smithi092:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T09:16:09.510 DEBUG:teuthology.orchestra.run.smithi167:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T09:16:09.520 DEBUG:teuthology.orchestra.run.smithi190:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T09:16:09.579 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T09:16:09.580 DEBUG:teuthology.orchestra.run.smithi092:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T09:16:09.582 DEBUG:teuthology.orchestra.run.smithi167:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T09:16:09.587 DEBUG:teuthology.orchestra.run.smithi190:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T09:16:10.975 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T09:16:10.986 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T09:16:10.986 DEBUG:teuthology.orchestra.run.smithi092:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T09:16:11.011 DEBUG:teuthology.orchestra.run.smithi167:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T09:16:11.042 DEBUG:teuthology.orchestra.run.smithi190:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T09:16:11.073 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T09:16:11.087 DEBUG:teuthology.orchestra.run.smithi092:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:16:11.090 DEBUG:teuthology.orchestra.run.smithi167:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:16:11.093 DEBUG:teuthology.orchestra.run.smithi190:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:16:11.111 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = core 2024-09-19T09:16:11.118 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = core 2024-09-19T09:16:11.139 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern = core 2024-09-19T09:16:11.181 DEBUG:teuthology.orchestra.run.smithi092:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:16:11.195 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:16:11.196 DEBUG:teuthology.orchestra.run.smithi167:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:16:11.212 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:16:11.212 DEBUG:teuthology.orchestra.run.smithi190:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:16:11.237 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:16:11.237 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T09:16:11.248 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T09:16:11.249 DEBUG:teuthology.misc:Transferring archived files from smithi092:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911871/remote/smithi092 2024-09-19T09:16:11.249 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T09:16:11.323 DEBUG:teuthology.misc:Transferring archived files from smithi167:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911871/remote/smithi167 2024-09-19T09:16:11.324 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T09:16:11.363 DEBUG:teuthology.misc:Transferring archived files from smithi190:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911871/remote/smithi190 2024-09-19T09:16:11.363 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T09:16:11.403 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T09:16:11.403 DEBUG:teuthology.orchestra.run.smithi092:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T09:16:11.407 DEBUG:teuthology.orchestra.run.smithi167:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T09:16:11.410 DEBUG:teuthology.orchestra.run.smithi190:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T09:16:11.455 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T09:16:11.476 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T09:16:11.476 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T09:16:11.503 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T09:16:11.504 DEBUG:teuthology.orchestra.run.smithi092:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T09:16:11.507 DEBUG:teuthology.orchestra.run.smithi167:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T09:16:11.509 DEBUG:teuthology.orchestra.run.smithi190:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T09:16:11.519 INFO:teuthology.orchestra.run.smithi092.stdout: 266064 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 09:16 /home/ubuntu/cephtest 2024-09-19T09:16:11.523 INFO:teuthology.orchestra.run.smithi167.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 09:16 /home/ubuntu/cephtest 2024-09-19T09:16:11.525 INFO:teuthology.orchestra.run.smithi190.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 09:16 /home/ubuntu/cephtest 2024-09-19T09:16:11.526 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T09:16:11.538 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T09:16:11.609 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/postgres}} duration: 2163.3047575950623 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-19T09:16:11.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T09:16:11.690 INFO:teuthology.run:pass